2024-04-25T08:47:22.429 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T08:47:22.430 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673000 --name neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/scrub} --owner scheduled_neesingh@teuthology --verbose -- /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673000/orig.config.yaml 2024-04-25T08:47:22.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T08:47:22.561 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673000 branch: wip-neesingh-testing-240416 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/scrub} email: neesingh@redhat.com first_in_suite: false job_id: '7673000' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-neesingh-testing-240416 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds cache max size: 1000 mds debug frag: true mds debug scatterstat: true mds log max segments: 1 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - Replacing daemon mds - Scrub error on inode - Behind on trimming - Metadata damage detected - bad backtrace on inode - overall HEALTH_ - \(MDS_TRIM\) sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec kclient: syntax: v1 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62537 sha1: 5787d42d10024ba410e822a8aba474331cb9af02 owner: scheduled_neesingh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5869 sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-62537 suite_path: /home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa suite_relpath: qa suite_repo: https://github.com/neesingh-rh/ceph suite_sha1: 5787d42d10024ba410e822a8aba474331cb9af02 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi173.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLkvIoXe1ldFsa6vib5Pod3FT+Y8mfSINne6Qh8b0hnzBal6UpcAhf1CpYuNHiW5h5pDSeDKtgpCOJcdBJlb11I= smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKgNB14d8U35CxwERZTG5TB48fVp7dKCGBj1/xh8wDREGcGZyiP9UJgxSHiVCqaVM/UT+oR9XsyUNSYkhvSxFII= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_scrub_checks - tasks.cephfs.test_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_08:15:18 tube: smithi user: neesingh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T08:47:22.561 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa; will attempt to use it 2024-04-25T08:47:22.561 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa/tasks 2024-04-25T08:47:22.561 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T08:47:22.563 INFO:teuthology.task.internal:Checking packages... 2024-04-25T08:47:22.584 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec' 2024-04-25T08:47:22.584 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T08:47:22.585 INFO:teuthology.packaging:ref: None 2024-04-25T08:47:22.585 INFO:teuthology.packaging:tag: None 2024-04-25T08:47:22.585 INFO:teuthology.packaging:branch: wip-neesingh-testing-240416 2024-04-25T08:47:22.585 INFO:teuthology.packaging:sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:47:22.585 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-neesingh-testing-240416 2024-04-25T08:47:22.721 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T08:47:22.722 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T08:47:22.727 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T08:47:22.728 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T08:47:22.755 INFO:teuthology.task.internal:Saving configuration 2024-04-25T08:47:22.771 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T08:47:22.779 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T08:47:22.803 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673000', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:41:40.471430', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILOtpcweJj+0/z3EKPzm5IXHHFXXRAdvIednxYOvl/gV'} 2024-04-25T08:47:22.825 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673000', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:41:40.473448', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAID6lTvpbr9cJsXSRfkTe7SEMmtSgVjRq3GkBAeXZT9PM'} 2024-04-25T08:47:22.825 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T08:47:22.832 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-25T08:47:22.832 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-25T08:47:22.832 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T08:47:22.913 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd4ee62d0d0>, signals=[15]) 2024-04-25T08:47:22.914 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T08:47:22.920 INFO:teuthology.task.internal:Opening connections... 2024-04-25T08:47:22.920 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T08:47:22.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:47:23.004 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2024-04-25T08:47:23.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:47:23.081 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T08:47:23.088 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-04-25T08:47:23.093 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-04-25T08:47:23.094 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-04-25T08:47:23.141 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T08:47:23.141 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Ubuntu" 2024-04-25T08:47:23.141 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="22.04" 2024-04-25T08:47:23.141 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T08:47:23.141 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_CODENAME=jammy 2024-04-25T08:47:23.141 INFO:teuthology.orchestra.run.smithi173.stdout:ID=ubuntu 2024-04-25T08:47:23.141 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE=debian 2024-04-25T08:47:23.141 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T08:47:23.141 INFO:teuthology.orchestra.run.smithi173.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T08:47:23.141 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T08:47:23.142 INFO:teuthology.orchestra.run.smithi173.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T08:47:23.142 INFO:teuthology.orchestra.run.smithi173.stdout:UBUNTU_CODENAME=jammy 2024-04-25T08:47:23.142 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-04-25T08:47:23.160 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-04-25T08:47:23.165 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-04-25T08:47:23.166 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-04-25T08:47:23.213 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T08:47:23.213 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Ubuntu" 2024-04-25T08:47:23.213 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="22.04" 2024-04-25T08:47:23.213 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T08:47:23.214 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_CODENAME=jammy 2024-04-25T08:47:23.214 INFO:teuthology.orchestra.run.smithi194.stdout:ID=ubuntu 2024-04-25T08:47:23.214 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE=debian 2024-04-25T08:47:23.214 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T08:47:23.214 INFO:teuthology.orchestra.run.smithi194.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T08:47:23.214 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T08:47:23.214 INFO:teuthology.orchestra.run.smithi194.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T08:47:23.214 INFO:teuthology.orchestra.run.smithi194.stdout:UBUNTU_CODENAME=jammy 2024-04-25T08:47:23.214 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-04-25T08:47:23.235 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T08:47:23.244 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T08:47:23.263 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T08:47:23.263 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2024-04-25T08:47:23.265 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2024-04-25T08:47:23.270 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T08:47:23.288 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T08:47:23.288 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2024-04-25T08:47:23.310 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2024-04-25T08:47:23.330 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T08:47:23.383 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T08:47:23.396 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-04-25T08:47:23.397 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-04-25T08:47:23.397 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-04-25T08:47:23.397 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T08:47:23.397 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T08:47:23.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:47:23.402 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-25T08:47:23.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:47:23.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-25T08:47:23.574 DEBUG:teuthology.task.kernel:sha1 for client.1 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T08:47:23.574 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-25T08:47:23.574 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-04-25T08:47:23.580 INFO:teuthology.orchestra.run.smithi194.stdout:5.15.0-56-generic 2024-04-25T08:47:23.580 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T08:47:23.580 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-25T08:47:23.580 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-04-25T08:47:23.580 DEBUG:teuthology.orchestra.run.smithi194:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-25T08:47:23.591 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T08:47:23.591 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-25T08:47:23.592 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-04-25T08:47:23.597 INFO:teuthology.orchestra.run.smithi173.stdout:5.15.0-56-generic 2024-04-25T08:47:23.597 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T08:47:23.597 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-25T08:47:23.597 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-04-25T08:47:23.598 DEBUG:teuthology.orchestra.run.smithi173:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-25T08:47:23.652 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-25T08:47:23.654 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-25T08:47:23.795 INFO:teuthology.orchestra.run.smithi194.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-25T08:47:23.795 INFO:teuthology.orchestra.run.smithi194.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-25T08:47:23.795 INFO:teuthology.orchestra.run.smithi194.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-25T08:47:23.795 INFO:teuthology.orchestra.run.smithi194.stderr:hint: 2024-04-25T08:47:23.795 INFO:teuthology.orchestra.run.smithi194.stderr:hint: git config --global init.defaultBranch 2024-04-25T08:47:23.795 INFO:teuthology.orchestra.run.smithi194.stderr:hint: 2024-04-25T08:47:23.795 INFO:teuthology.orchestra.run.smithi194.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-25T08:47:23.796 INFO:teuthology.orchestra.run.smithi194.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-25T08:47:23.796 INFO:teuthology.orchestra.run.smithi194.stderr:hint: 2024-04-25T08:47:23.796 INFO:teuthology.orchestra.run.smithi194.stderr:hint: git branch -m 2024-04-25T08:47:23.796 INFO:teuthology.orchestra.run.smithi194.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-25T08:47:23.798 DEBUG:teuthology.orchestra.run.smithi194:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-25T08:47:23.800 INFO:teuthology.orchestra.run.smithi173.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-25T08:47:23.800 INFO:teuthology.orchestra.run.smithi173.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-25T08:47:23.800 INFO:teuthology.orchestra.run.smithi173.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-25T08:47:23.800 INFO:teuthology.orchestra.run.smithi173.stderr:hint: 2024-04-25T08:47:23.800 INFO:teuthology.orchestra.run.smithi173.stderr:hint: git config --global init.defaultBranch 2024-04-25T08:47:23.800 INFO:teuthology.orchestra.run.smithi173.stderr:hint: 2024-04-25T08:47:23.800 INFO:teuthology.orchestra.run.smithi173.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-25T08:47:23.800 INFO:teuthology.orchestra.run.smithi173.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-25T08:47:23.800 INFO:teuthology.orchestra.run.smithi173.stderr:hint: 2024-04-25T08:47:23.800 INFO:teuthology.orchestra.run.smithi173.stderr:hint: git branch -m 2024-04-25T08:47:23.801 INFO:teuthology.orchestra.run.smithi173.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-25T08:47:23.803 DEBUG:teuthology.orchestra.run.smithi173:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-25T08:47:23.865 DEBUG:teuthology.orchestra.run.smithi194:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-25T08:47:23.870 DEBUG:teuthology.orchestra.run.smithi173:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-25T08:47:23.923 DEBUG:teuthology.orchestra.run.smithi194:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-25T08:47:23.927 DEBUG:teuthology.orchestra.run.smithi173:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-25T08:47:59.842 INFO:teuthology.orchestra.run.smithi194.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-25T08:47:59.842 INFO:teuthology.orchestra.run.smithi194.stderr: * [new branch] main -> origin/main 2024-04-25T08:47:59.876 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20190312 -> 20190312 2024-04-25T08:47:59.876 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20190416 -> 20190416 2024-04-25T08:47:59.876 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20190514 -> 20190514 2024-04-25T08:47:59.876 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20190618 -> 20190618 2024-04-25T08:47:59.876 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20190717 -> 20190717 2024-04-25T08:47:59.877 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20190815 -> 20190815 2024-04-25T08:47:59.878 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20190923 -> 20190923 2024-04-25T08:47:59.878 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20191022 -> 20191022 2024-04-25T08:47:59.878 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20191215 -> 20191215 2024-04-25T08:47:59.878 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20200122 -> 20200122 2024-04-25T08:47:59.878 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20200316 -> 20200316 2024-04-25T08:47:59.878 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20200421 -> 20200421 2024-04-25T08:47:59.878 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20200519 -> 20200519 2024-04-25T08:47:59.879 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20200619 -> 20200619 2024-04-25T08:47:59.879 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20200721 -> 20200721 2024-04-25T08:47:59.883 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20200817 -> 20200817 2024-04-25T08:47:59.883 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20200918 -> 20200918 2024-04-25T08:47:59.883 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20201022 -> 20201022 2024-04-25T08:47:59.883 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20201118 -> 20201118 2024-04-25T08:47:59.883 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20201218 -> 20201218 2024-04-25T08:47:59.883 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20210208 -> 20210208 2024-04-25T08:47:59.883 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20210315 -> 20210315 2024-04-25T08:47:59.884 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20210511 -> 20210511 2024-04-25T08:47:59.884 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20210716 -> 20210716 2024-04-25T08:47:59.884 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20210818 -> 20210818 2024-04-25T08:47:59.884 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20210919 -> 20210919 2024-04-25T08:47:59.884 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20211027 -> 20211027 2024-04-25T08:47:59.884 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20211216 -> 20211216 2024-04-25T08:47:59.884 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20220209 -> 20220209 2024-04-25T08:47:59.884 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20220310 -> 20220310 2024-04-25T08:47:59.884 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20220411 -> 20220411 2024-04-25T08:47:59.884 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20220509 -> 20220509 2024-04-25T08:47:59.884 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20220610 -> 20220610 2024-04-25T08:47:59.884 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20220708 -> 20220708 2024-04-25T08:47:59.884 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20220815 -> 20220815 2024-04-25T08:47:59.884 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20220913 -> 20220913 2024-04-25T08:47:59.884 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20221012 -> 20221012 2024-04-25T08:47:59.884 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20221109 -> 20221109 2024-04-25T08:47:59.885 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20221214 -> 20221214 2024-04-25T08:47:59.885 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20230117 -> 20230117 2024-04-25T08:47:59.885 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20230210 -> 20230210 2024-04-25T08:47:59.885 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20230310 -> 20230310 2024-04-25T08:47:59.885 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20230404 -> 20230404 2024-04-25T08:47:59.885 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20230515 -> 20230515 2024-04-25T08:47:59.885 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20230625 -> 20230625 2024-04-25T08:47:59.885 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20230804 -> 20230804 2024-04-25T08:47:59.885 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20230919 -> 20230919 2024-04-25T08:47:59.885 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20231030 -> 20231030 2024-04-25T08:47:59.885 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20231111 -> 20231111 2024-04-25T08:47:59.885 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20231211 -> 20231211 2024-04-25T08:47:59.885 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20240115 -> 20240115 2024-04-25T08:47:59.885 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20240220 -> 20240220 2024-04-25T08:47:59.885 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20240312 -> 20240312 2024-04-25T08:47:59.886 INFO:teuthology.orchestra.run.smithi194.stderr: * [new tag] 20240410 -> 20240410 2024-04-25T08:47:59.934 INFO:teuthology.orchestra.run.smithi173.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-25T08:47:59.934 INFO:teuthology.orchestra.run.smithi173.stderr: * [new branch] main -> origin/main 2024-04-25T08:47:59.969 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20190312 -> 20190312 2024-04-25T08:47:59.969 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20190416 -> 20190416 2024-04-25T08:47:59.969 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20190514 -> 20190514 2024-04-25T08:47:59.969 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20190618 -> 20190618 2024-04-25T08:47:59.969 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20190717 -> 20190717 2024-04-25T08:47:59.969 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20190815 -> 20190815 2024-04-25T08:47:59.969 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20190923 -> 20190923 2024-04-25T08:47:59.969 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20191022 -> 20191022 2024-04-25T08:47:59.969 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20191215 -> 20191215 2024-04-25T08:47:59.969 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20200122 -> 20200122 2024-04-25T08:47:59.969 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20200316 -> 20200316 2024-04-25T08:47:59.972 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20200421 -> 20200421 2024-04-25T08:47:59.972 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20200519 -> 20200519 2024-04-25T08:47:59.972 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20200619 -> 20200619 2024-04-25T08:47:59.972 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20200721 -> 20200721 2024-04-25T08:47:59.972 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20200817 -> 20200817 2024-04-25T08:47:59.972 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20200918 -> 20200918 2024-04-25T08:47:59.972 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20201022 -> 20201022 2024-04-25T08:47:59.972 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20201118 -> 20201118 2024-04-25T08:47:59.972 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20201218 -> 20201218 2024-04-25T08:47:59.972 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20210208 -> 20210208 2024-04-25T08:47:59.973 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20210315 -> 20210315 2024-04-25T08:47:59.973 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20210511 -> 20210511 2024-04-25T08:47:59.973 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20210716 -> 20210716 2024-04-25T08:47:59.973 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20210818 -> 20210818 2024-04-25T08:47:59.973 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20210919 -> 20210919 2024-04-25T08:47:59.973 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20211027 -> 20211027 2024-04-25T08:47:59.973 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20211216 -> 20211216 2024-04-25T08:47:59.973 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20220209 -> 20220209 2024-04-25T08:47:59.973 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20220310 -> 20220310 2024-04-25T08:47:59.973 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20220411 -> 20220411 2024-04-25T08:47:59.975 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20220509 -> 20220509 2024-04-25T08:47:59.975 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20220610 -> 20220610 2024-04-25T08:47:59.976 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20220708 -> 20220708 2024-04-25T08:47:59.976 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20220815 -> 20220815 2024-04-25T08:47:59.976 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20220913 -> 20220913 2024-04-25T08:47:59.976 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20221012 -> 20221012 2024-04-25T08:47:59.976 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20221109 -> 20221109 2024-04-25T08:47:59.976 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20221214 -> 20221214 2024-04-25T08:47:59.976 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20230117 -> 20230117 2024-04-25T08:47:59.976 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20230210 -> 20230210 2024-04-25T08:47:59.976 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20230310 -> 20230310 2024-04-25T08:47:59.976 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20230404 -> 20230404 2024-04-25T08:47:59.976 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20230515 -> 20230515 2024-04-25T08:47:59.976 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20230625 -> 20230625 2024-04-25T08:47:59.976 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20230804 -> 20230804 2024-04-25T08:47:59.976 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20230919 -> 20230919 2024-04-25T08:47:59.976 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20231030 -> 20231030 2024-04-25T08:47:59.976 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20231111 -> 20231111 2024-04-25T08:47:59.976 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20231211 -> 20231211 2024-04-25T08:47:59.977 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20240115 -> 20240115 2024-04-25T08:47:59.977 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20240220 -> 20240220 2024-04-25T08:47:59.977 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20240312 -> 20240312 2024-04-25T08:47:59.977 INFO:teuthology.orchestra.run.smithi173.stderr: * [new tag] 20240410 -> 20240410 2024-04-25T08:48:04.155 INFO:teuthology.orchestra.run.smithi194.stderr:Updating files: 44% (1515/3381) Updating files: 45% (1522/3381) Updating files: 46% (1556/3381) Updating files: 47% (1590/3381) Updating files: 48% (1623/3381) Updating files: 49% (1657/3381) Updating files: 50% (1691/3381) Updating files: 51% (1725/3381) Updating files: 52% (1759/3381) Updating files: 53% (1792/3381) Updating files: 54% (1826/3381) Updating files: 55% (1860/3381) Updating files: 56% (1894/3381) Updating files: 57% (1928/3381) Updating files: 58% (1961/3381) Updating files: 59% (1995/3381) Updating files: 59% (2004/3381) Updating files: 60% (2029/3381) Updating files: 61% (2063/3381) Updating files: 62% (2097/3381) Updating files: 63% (2131/3381) Updating files: 64% (2164/3381) Updating files: 65% (2198/3381) Updating files: 66% (2232/3381) Updating files: 67% (2266/3381) Updating files: 68% (2300/3381) Updating files: 69% (2333/3381) Updating files: 69% (2362/3381) Updating files: 70% (2367/3381) Updating files: 71% (2401/3381) Updating files: 72% (2435/3381) Updating files: 73% (2469/3381) Updating files: 74% (2502/3381) Updating files: 75% (2536/3381) Updating files: 76% (2570/3381) Updating files: 77% (2604/3381) Updating files: 78% (2638/3381) Updating files: 79% (2671/3381) Updating files: 80% (2705/3381) Updating files: 81% (2739/3381) Updating files: 82% (2773/3381) Updating files: 83% (2807/3381) Updating files: 83% (2810/3381) Updating files: 84% (2841/3381) Updating files: 85% (2874/3381) Updating files: 86% (2908/3381) Updating files: 87% (2942/3381) Updating files: 88% (2976/3381) Updating files: 89% (3010/3381) Updating files: 90% (3043/3381) Updating files: 91% (3077/3381) Updating files: 92% (3111/3381) Updating files: 93% (3145/3381) Updating files: 94% (3179/3381) Updating files: 95% (3212/3381) Updating files: 96% (3246/3381) Updating files: 97% (3280/3381) Updating files: 98% (3314/3381) Updating files: 99% (3348/3381) Updating files: 100% (3381/3381) Updating files: 100% (3381/3381), done. 2024-04-25T08:48:04.160 INFO:teuthology.orchestra.run.smithi194.stdout:HEAD is now at 63a66b66 Merge branch 'robot/pr-0-1713990671' into 'main' 2024-04-25T08:48:04.181 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-25T08:48:04.181 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T08:48:04.254 INFO:teuthology.orchestra.run.smithi173.stderr:Updating files: 44% (1517/3381) Updating files: 45% (1522/3381) Updating files: 46% (1556/3381) Updating files: 47% (1590/3381) Updating files: 48% (1623/3381) Updating files: 49% (1657/3381) Updating files: 50% (1691/3381) Updating files: 51% (1725/3381) Updating files: 52% (1759/3381) Updating files: 53% (1792/3381) Updating files: 54% (1826/3381) Updating files: 55% (1860/3381) Updating files: 56% (1894/3381) Updating files: 57% (1928/3381) Updating files: 58% (1961/3381) Updating files: 59% (1995/3381) Updating files: 59% (2005/3381) Updating files: 60% (2029/3381) Updating files: 61% (2063/3381) Updating files: 62% (2097/3381) Updating files: 63% (2131/3381) Updating files: 64% (2164/3381) Updating files: 65% (2198/3381) Updating files: 66% (2232/3381) Updating files: 67% (2266/3381) Updating files: 68% (2300/3381) Updating files: 69% (2333/3381) Updating files: 69% (2362/3381) Updating files: 70% (2367/3381) Updating files: 71% (2401/3381) Updating files: 72% (2435/3381) Updating files: 73% (2469/3381) Updating files: 74% (2502/3381) Updating files: 75% (2536/3381) Updating files: 76% (2570/3381) Updating files: 77% (2604/3381) Updating files: 78% (2638/3381) Updating files: 79% (2671/3381) Updating files: 80% (2705/3381) Updating files: 81% (2739/3381) Updating files: 82% (2773/3381) Updating files: 83% (2807/3381) Updating files: 83% (2809/3381) Updating files: 84% (2841/3381) Updating files: 85% (2874/3381) Updating files: 86% (2908/3381) Updating files: 87% (2942/3381) Updating files: 88% (2976/3381) Updating files: 89% (3010/3381) Updating files: 90% (3043/3381) Updating files: 91% (3077/3381) Updating files: 92% (3111/3381) Updating files: 93% (3145/3381) Updating files: 94% (3179/3381) Updating files: 95% (3212/3381) Updating files: 96% (3246/3381) Updating files: 97% (3280/3381) Updating files: 98% (3314/3381) Updating files: 99% (3348/3381) Updating files: 100% (3381/3381) Updating files: 100% (3381/3381), done. 2024-04-25T08:48:04.259 INFO:teuthology.orchestra.run.smithi173.stdout:HEAD is now at 63a66b66 Merge branch 'robot/pr-0-1713990671' into 'main' 2024-04-25T08:48:04.280 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T08:48:04.280 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T08:48:04.332 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-25T08:48:04.333 DEBUG:teuthology.orchestra.run.smithi194:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-25T08:48:04.335 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi194.front.sepia.ceph.com to complete... 2024-04-25T08:48:04.439 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-25T08:48:04.439 DEBUG:teuthology.orchestra.run.smithi173:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-25T08:48:04.441 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi173.front.sepia.ceph.com to complete... 2024-04-25T08:48:07.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25 08:48:07 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-25T08:48:07.402 INFO:teuthology.orchestra.run.smithi194.stderr:FINISHED --2024-04-25 08:48:07-- 2024-04-25T08:48:07.402 INFO:teuthology.orchestra.run.smithi194.stderr:Total wall clock time: 2.9s 2024-04-25T08:48:07.402 INFO:teuthology.orchestra.run.smithi194.stderr:Downloaded: 1 files, 43M in 2.8s (15.2 MB/s) 2024-04-25T08:48:07.406 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-25T08:48:07.406 DEBUG:teuthology.orchestra.run.smithi194:> sudo dpkg -i /tmp/linux-image.deb 2024-04-25T08:48:07.683 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-25T08:48:07.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25 08:48:07 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-25T08:48:07.720 INFO:teuthology.orchestra.run.smithi173.stderr:FINISHED --2024-04-25 08:48:07-- 2024-04-25T08:48:07.720 INFO:teuthology.orchestra.run.smithi173.stderr:Total wall clock time: 3.2s 2024-04-25T08:48:07.721 INFO:teuthology.orchestra.run.smithi173.stderr:Downloaded: 1 files, 43M in 3.1s (13.7 MB/s) 2024-04-25T08:48:07.724 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T08:48:07.725 DEBUG:teuthology.orchestra.run.smithi173:> sudo dpkg -i /tmp/linux-image.deb 2024-04-25T08:48:07.938 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-25T08:48:09.535 INFO:teuthology.orchestra.run.smithi194.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-25T08:48:09.539 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-25T08:48:09.646 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T08:48:09.913 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-25T08:48:09.918 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-25T08:48:10.047 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T08:48:13.424 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T08:48:13.537 INFO:teuthology.orchestra.run.smithi194.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:14.074 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T08:48:14.175 INFO:teuthology.orchestra.run.smithi173.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:35.769 INFO:teuthology.orchestra.run.smithi194.stderr:Sourcing file `/etc/default/grub' 2024-04-25T08:48:35.782 INFO:teuthology.orchestra.run.smithi194.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T08:48:35.814 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2024-04-25T08:48:36.015 INFO:teuthology.orchestra.run.smithi173.stderr:Sourcing file `/etc/default/grub' 2024-04-25T08:48:36.029 INFO:teuthology.orchestra.run.smithi173.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T08:48:36.052 INFO:teuthology.orchestra.run.smithi173.stderr:Generating grub configuration file ... 2024-04-25T08:48:36.140 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:36.156 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:36.331 INFO:teuthology.orchestra.run.smithi173.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:36.350 INFO:teuthology.orchestra.run.smithi173.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:36.424 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T08:48:36.433 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T08:48:36.492 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T08:48:36.497 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T08:48:36.622 INFO:teuthology.orchestra.run.smithi173.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T08:48:36.634 INFO:teuthology.orchestra.run.smithi194.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T08:48:36.635 INFO:teuthology.orchestra.run.smithi194.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T08:48:36.635 INFO:teuthology.orchestra.run.smithi194.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T08:48:36.638 INFO:teuthology.orchestra.run.smithi173.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T08:48:36.672 INFO:teuthology.orchestra.run.smithi194.stderr:done 2024-04-25T08:48:36.703 INFO:teuthology.orchestra.run.smithi173.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T08:48:36.709 INFO:teuthology.orchestra.run.smithi173.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T08:48:36.838 DEBUG:teuthology.orchestra.run.smithi194:> dpkg-deb -c /tmp/linux-image.deb 2024-04-25T08:48:36.847 INFO:teuthology.orchestra.run.smithi173.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T08:48:36.847 INFO:teuthology.orchestra.run.smithi173.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T08:48:36.847 INFO:teuthology.orchestra.run.smithi173.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T08:48:36.847 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-25T08:48:36.847 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-25T08:48:36.847 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:36.863 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:36.864 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:36.884 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-25T08:48:36.884 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-25T08:48:36.884 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-25T08:48:36.884 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-25T08:48:36.884 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-25T08:48:36.884 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-25T08:48:36.884 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-25T08:48:36.884 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-25T08:48:36.885 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-25T08:48:36.885 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-25T08:48:36.885 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-25T08:48:36.885 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-25T08:48:36.885 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-25T08:48:36.885 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-25T08:48:36.888 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-25T08:48:36.888 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-25T08:48:36.888 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-25T08:48:36.888 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-25T08:48:36.888 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-25T08:48:36.888 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-25T08:48:36.888 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-25T08:48:36.888 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-25T08:48:36.888 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-25T08:48:36.888 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-25T08:48:36.888 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-25T08:48:36.888 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-25T08:48:36.888 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-25T08:48:36.889 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-25T08:48:36.889 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-25T08:48:36.889 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-25T08:48:36.889 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-25T08:48:36.889 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-25T08:48:36.889 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-25T08:48:36.889 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-25T08:48:36.889 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-25T08:48:36.889 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-25T08:48:36.889 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-25T08:48:36.889 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-25T08:48:36.889 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-25T08:48:36.889 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-25T08:48:36.889 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-25T08:48:36.890 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-25T08:48:36.890 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-25T08:48:36.890 INFO:teuthology.orchestra.run.smithi173.stderr:done 2024-04-25T08:48:36.907 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-25T08:48:36.907 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-25T08:48:36.907 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-25T08:48:36.907 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-25T08:48:36.907 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-25T08:48:36.907 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-25T08:48:36.907 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-25T08:48:36.907 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-25T08:48:36.907 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-25T08:48:36.908 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-25T08:48:36.908 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-25T08:48:36.908 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-25T08:48:36.908 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-25T08:48:36.908 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-25T08:48:36.908 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-25T08:48:36.908 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-25T08:48:36.908 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-25T08:48:36.908 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-25T08:48:36.908 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-25T08:48:36.908 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-25T08:48:36.908 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-25T08:48:36.908 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-25T08:48:36.908 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-25T08:48:36.909 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-25T08:48:36.909 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-25T08:48:36.909 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-25T08:48:36.909 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-25T08:48:36.909 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-25T08:48:36.909 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-25T08:48:36.909 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-25T08:48:36.909 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-25T08:48:36.909 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-25T08:48:36.909 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-25T08:48:36.909 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-25T08:48:36.909 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-25T08:48:36.909 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-25T08:48:36.909 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-25T08:48:36.910 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-25T08:48:36.910 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-25T08:48:36.910 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-25T08:48:36.910 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-25T08:48:36.910 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-25T08:48:36.910 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-25T08:48:36.910 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-25T08:48:36.910 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-25T08:48:36.910 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-25T08:48:36.910 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-25T08:48:36.910 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-25T08:48:36.910 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-25T08:48:36.910 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-25T08:48:36.910 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-25T08:48:36.911 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-25T08:48:36.911 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-25T08:48:36.911 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-25T08:48:36.911 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-25T08:48:36.911 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-25T08:48:36.911 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-25T08:48:36.911 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-25T08:48:36.911 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-25T08:48:36.911 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-25T08:48:36.911 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-25T08:48:36.911 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-25T08:48:36.911 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-25T08:48:36.911 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-25T08:48:36.911 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-25T08:48:36.912 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-25T08:48:36.912 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-25T08:48:36.912 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-25T08:48:36.912 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-25T08:48:36.912 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-25T08:48:36.912 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-25T08:48:36.912 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-25T08:48:36.912 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-25T08:48:36.912 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-25T08:48:36.912 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-25T08:48:36.912 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-25T08:48:36.912 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-25T08:48:36.912 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-25T08:48:36.912 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-25T08:48:36.913 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-25T08:48:36.913 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-25T08:48:36.913 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-25T08:48:36.913 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-25T08:48:36.913 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-25T08:48:36.913 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-25T08:48:36.913 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-25T08:48:36.913 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-25T08:48:36.913 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-25T08:48:36.913 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-25T08:48:36.913 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-25T08:48:36.913 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-25T08:48:36.913 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-25T08:48:36.913 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-25T08:48:36.914 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-25T08:48:36.914 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-25T08:48:36.914 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-25T08:48:36.914 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-25T08:48:36.914 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-25T08:48:36.914 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-25T08:48:36.914 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-25T08:48:36.914 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-25T08:48:36.914 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-25T08:48:36.914 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-25T08:48:36.914 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-25T08:48:36.914 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-25T08:48:36.914 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-25T08:48:36.914 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-25T08:48:36.915 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-25T08:48:36.915 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-25T08:48:36.915 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-25T08:48:36.915 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-25T08:48:36.915 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-25T08:48:36.915 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-25T08:48:36.915 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-25T08:48:36.915 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-25T08:48:36.915 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-25T08:48:36.915 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-25T08:48:36.915 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-25T08:48:36.915 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-25T08:48:36.915 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-25T08:48:36.915 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-25T08:48:36.915 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-25T08:48:36.916 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-25T08:48:36.916 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-25T08:48:36.916 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-25T08:48:36.916 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-25T08:48:36.916 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-25T08:48:36.916 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-25T08:48:36.916 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-25T08:48:36.916 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-25T08:48:36.916 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-25T08:48:36.916 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-25T08:48:36.916 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-25T08:48:36.916 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-25T08:48:36.916 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-25T08:48:36.916 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-25T08:48:36.916 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-25T08:48:36.917 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-25T08:48:36.917 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-25T08:48:36.917 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-25T08:48:36.917 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-25T08:48:36.917 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-25T08:48:36.917 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-25T08:48:36.917 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-25T08:48:36.917 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-25T08:48:36.917 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-25T08:48:36.917 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-25T08:48:36.917 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-25T08:48:36.972 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-25T08:48:36.972 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-25T08:48:36.972 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-25T08:48:36.972 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-25T08:48:36.972 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-25T08:48:36.973 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-25T08:48:36.973 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-25T08:48:36.973 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-25T08:48:36.973 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-25T08:48:36.973 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-25T08:48:36.973 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-25T08:48:36.973 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-25T08:48:36.973 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-25T08:48:36.973 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-25T08:48:36.973 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-25T08:48:36.973 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-25T08:48:36.973 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-25T08:48:36.973 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-25T08:48:36.973 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-25T08:48:36.974 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-25T08:48:36.974 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-25T08:48:36.974 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-25T08:48:36.974 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-25T08:48:36.974 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-25T08:48:36.974 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-25T08:48:36.974 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-25T08:48:36.974 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-25T08:48:36.974 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-25T08:48:36.974 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-25T08:48:36.974 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-25T08:48:36.974 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-25T08:48:36.974 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-25T08:48:36.974 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-25T08:48:36.975 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-25T08:48:36.975 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-25T08:48:36.975 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-25T08:48:36.975 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-25T08:48:36.975 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-25T08:48:36.975 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-25T08:48:36.975 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-25T08:48:36.975 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-25T08:48:36.975 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-25T08:48:36.975 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-25T08:48:36.975 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-25T08:48:36.975 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-25T08:48:36.975 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-25T08:48:36.975 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-25T08:48:36.976 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-25T08:48:36.976 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-25T08:48:36.976 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-25T08:48:36.976 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-25T08:48:36.976 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-25T08:48:36.976 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-25T08:48:36.976 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-25T08:48:36.976 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-25T08:48:36.976 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-25T08:48:36.976 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-25T08:48:36.976 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-25T08:48:36.976 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-25T08:48:36.976 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-25T08:48:36.976 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-25T08:48:36.976 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-25T08:48:36.977 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-25T08:48:36.977 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-25T08:48:36.977 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-25T08:48:36.977 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-25T08:48:36.977 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-25T08:48:36.977 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-25T08:48:36.977 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-25T08:48:36.977 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-25T08:48:36.977 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-25T08:48:36.977 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-25T08:48:36.977 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-25T08:48:36.977 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-25T08:48:36.977 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-25T08:48:36.977 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-25T08:48:36.978 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-25T08:48:36.978 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-25T08:48:36.978 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-25T08:48:36.978 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-25T08:48:36.978 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-25T08:48:36.978 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-25T08:48:36.978 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-25T08:48:36.978 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-25T08:48:36.978 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-25T08:48:36.978 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-25T08:48:36.978 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-25T08:48:36.978 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-25T08:48:36.978 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-25T08:48:36.978 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-25T08:48:36.979 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-25T08:48:36.979 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-25T08:48:36.979 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-25T08:48:36.979 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-25T08:48:36.979 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-25T08:48:36.979 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-25T08:48:36.979 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-25T08:48:36.979 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-25T08:48:36.979 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-25T08:48:36.979 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-25T08:48:36.979 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-25T08:48:36.979 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-25T08:48:36.979 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-25T08:48:36.979 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-25T08:48:36.979 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-25T08:48:36.980 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-25T08:48:36.980 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-25T08:48:36.980 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-25T08:48:36.980 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-25T08:48:36.980 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-25T08:48:36.980 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-25T08:48:36.980 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-25T08:48:36.980 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-25T08:48:36.980 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-25T08:48:36.980 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-25T08:48:36.980 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-25T08:48:36.980 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-25T08:48:36.980 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-25T08:48:36.980 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-25T08:48:36.981 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-25T08:48:36.981 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-25T08:48:36.981 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-25T08:48:36.981 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-25T08:48:36.981 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-25T08:48:36.981 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-25T08:48:36.981 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-25T08:48:36.981 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-25T08:48:36.981 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-25T08:48:36.981 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-25T08:48:36.981 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-25T08:48:36.981 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-25T08:48:36.981 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-25T08:48:36.981 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-25T08:48:36.981 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-25T08:48:36.982 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-25T08:48:36.982 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-25T08:48:36.982 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-25T08:48:36.982 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-25T08:48:36.982 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-25T08:48:36.982 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-25T08:48:36.982 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-25T08:48:36.982 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-25T08:48:36.982 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-25T08:48:36.982 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-25T08:48:36.982 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-25T08:48:36.982 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-25T08:48:36.982 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-25T08:48:36.982 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-25T08:48:36.983 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-25T08:48:36.983 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-25T08:48:36.983 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-25T08:48:36.983 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-25T08:48:36.983 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-25T08:48:36.983 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-25T08:48:36.983 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-25T08:48:36.983 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-25T08:48:36.983 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-25T08:48:36.983 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-25T08:48:36.983 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-25T08:48:36.983 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-25T08:48:36.983 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-25T08:48:36.983 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-25T08:48:36.984 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-25T08:48:36.984 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-25T08:48:36.984 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-25T08:48:36.984 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-25T08:48:36.984 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-25T08:48:36.984 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-25T08:48:36.984 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-25T08:48:36.984 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-25T08:48:36.984 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-25T08:48:36.984 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-25T08:48:36.984 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-25T08:48:36.985 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-25T08:48:36.985 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-25T08:48:36.985 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-25T08:48:36.986 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-25T08:48:36.986 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-25T08:48:36.986 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-25T08:48:36.986 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-25T08:48:36.986 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-25T08:48:36.986 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-25T08:48:36.986 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-25T08:48:36.986 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-25T08:48:36.986 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-25T08:48:36.986 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-25T08:48:36.986 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-25T08:48:36.986 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-25T08:48:36.986 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-25T08:48:36.986 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-25T08:48:36.986 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-25T08:48:36.987 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-25T08:48:36.987 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-25T08:48:36.987 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-25T08:48:36.987 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-25T08:48:36.987 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-25T08:48:36.987 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-25T08:48:36.987 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-25T08:48:36.987 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-25T08:48:36.987 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-25T08:48:36.987 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-25T08:48:36.987 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-25T08:48:36.987 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-25T08:48:36.987 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-25T08:48:36.987 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-25T08:48:36.988 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-25T08:48:36.988 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-25T08:48:36.988 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-25T08:48:36.988 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-25T08:48:36.988 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-25T08:48:36.988 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-25T08:48:36.988 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-25T08:48:36.988 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-25T08:48:36.988 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-25T08:48:36.988 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-25T08:48:36.988 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-25T08:48:36.988 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-25T08:48:36.988 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-25T08:48:36.988 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-25T08:48:36.988 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-25T08:48:36.989 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-25T08:48:36.989 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-25T08:48:36.989 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-25T08:48:36.989 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-25T08:48:36.989 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-25T08:48:36.989 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-25T08:48:36.989 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-25T08:48:36.989 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-25T08:48:36.989 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-25T08:48:36.989 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-25T08:48:36.989 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-25T08:48:36.989 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-25T08:48:36.989 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-25T08:48:36.989 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-25T08:48:36.990 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-25T08:48:36.990 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-25T08:48:36.990 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-25T08:48:36.990 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-25T08:48:36.990 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-25T08:48:36.990 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-25T08:48:36.990 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-25T08:48:36.990 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-25T08:48:36.990 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-25T08:48:36.990 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-25T08:48:36.990 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-25T08:48:36.990 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-25T08:48:36.990 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-25T08:48:36.990 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-25T08:48:36.991 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-25T08:48:36.991 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-25T08:48:36.991 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-25T08:48:36.991 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-25T08:48:36.991 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-25T08:48:36.991 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-25T08:48:36.991 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-25T08:48:36.991 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-25T08:48:36.991 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-25T08:48:36.991 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-25T08:48:36.991 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-25T08:48:36.991 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-25T08:48:36.991 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-25T08:48:36.992 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-25T08:48:36.992 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-25T08:48:36.992 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-25T08:48:36.992 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-25T08:48:36.992 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-25T08:48:36.992 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-25T08:48:36.992 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-25T08:48:36.992 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-25T08:48:36.992 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-25T08:48:36.992 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-25T08:48:36.992 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-25T08:48:36.992 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-25T08:48:36.992 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-25T08:48:36.992 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-25T08:48:36.992 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-25T08:48:36.993 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-25T08:48:36.993 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-25T08:48:36.993 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-25T08:48:36.993 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-25T08:48:36.993 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-25T08:48:36.993 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-25T08:48:36.993 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-25T08:48:36.993 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-25T08:48:36.993 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-25T08:48:36.993 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-25T08:48:36.993 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-25T08:48:36.993 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-25T08:48:36.993 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-25T08:48:36.993 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-25T08:48:36.994 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-25T08:48:36.994 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-25T08:48:36.994 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-25T08:48:36.994 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-25T08:48:36.994 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-25T08:48:36.994 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-25T08:48:36.994 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-25T08:48:36.994 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-25T08:48:36.994 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-25T08:48:36.994 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-25T08:48:36.994 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-25T08:48:36.994 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-25T08:48:36.994 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-25T08:48:36.994 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-25T08:48:36.995 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-25T08:48:36.995 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-25T08:48:36.995 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-25T08:48:36.995 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-25T08:48:36.995 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-25T08:48:36.995 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-25T08:48:36.995 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-25T08:48:36.995 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-25T08:48:36.995 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-25T08:48:36.995 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-25T08:48:36.995 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-25T08:48:36.995 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-25T08:48:36.995 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-25T08:48:36.995 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-25T08:48:36.996 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-25T08:48:36.996 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-25T08:48:36.996 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-25T08:48:36.996 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-25T08:48:36.996 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-25T08:48:36.996 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-25T08:48:36.996 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-25T08:48:36.996 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-25T08:48:36.996 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-25T08:48:36.996 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-25T08:48:36.996 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-25T08:48:36.996 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-25T08:48:36.996 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-25T08:48:36.996 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-25T08:48:36.996 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-25T08:48:36.997 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-25T08:48:36.997 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-25T08:48:36.997 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-25T08:48:36.997 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-25T08:48:36.997 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-25T08:48:36.997 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-25T08:48:36.997 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-25T08:48:36.997 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-25T08:48:36.997 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-25T08:48:36.997 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-25T08:48:36.997 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-25T08:48:36.997 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-25T08:48:36.997 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-25T08:48:36.997 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-25T08:48:36.998 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-25T08:48:36.998 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-25T08:48:36.998 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-25T08:48:36.998 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-25T08:48:36.998 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-25T08:48:36.998 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-25T08:48:36.998 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-25T08:48:36.998 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-25T08:48:36.998 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-25T08:48:36.998 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-25T08:48:36.998 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-25T08:48:36.998 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-25T08:48:36.998 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-25T08:48:36.998 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-25T08:48:36.999 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-25T08:48:36.999 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-25T08:48:36.999 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-25T08:48:36.999 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-25T08:48:36.999 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-25T08:48:36.999 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-25T08:48:36.999 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-25T08:48:36.999 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-25T08:48:36.999 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-25T08:48:36.999 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-25T08:48:36.999 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-25T08:48:36.999 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-25T08:48:36.999 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-25T08:48:36.999 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-25T08:48:36.999 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-25T08:48:37.000 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-25T08:48:37.000 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-25T08:48:37.000 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-25T08:48:37.000 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-25T08:48:37.000 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-25T08:48:37.000 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-25T08:48:37.000 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-25T08:48:37.000 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-25T08:48:37.000 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-25T08:48:37.000 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-25T08:48:37.000 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-25T08:48:37.000 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-25T08:48:37.000 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-25T08:48:37.000 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-25T08:48:37.000 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-25T08:48:37.001 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-25T08:48:37.001 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-25T08:48:37.001 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-25T08:48:37.001 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-25T08:48:37.001 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-25T08:48:37.001 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-25T08:48:37.001 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-25T08:48:37.001 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-25T08:48:37.001 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-25T08:48:37.001 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-25T08:48:37.001 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-25T08:48:37.001 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-25T08:48:37.001 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-25T08:48:37.001 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-25T08:48:37.002 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-25T08:48:37.002 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-25T08:48:37.002 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-25T08:48:37.002 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-25T08:48:37.002 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-25T08:48:37.002 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-25T08:48:37.002 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-25T08:48:37.002 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-25T08:48:37.002 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-25T08:48:37.002 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-25T08:48:37.002 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-25T08:48:37.002 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-25T08:48:37.002 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-25T08:48:37.002 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-25T08:48:37.003 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-25T08:48:37.003 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-25T08:48:37.003 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-25T08:48:37.003 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-25T08:48:37.003 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-25T08:48:37.003 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-25T08:48:37.003 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-25T08:48:37.003 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-25T08:48:37.003 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-25T08:48:37.003 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-25T08:48:37.003 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-25T08:48:37.003 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-25T08:48:37.003 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-25T08:48:37.003 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-25T08:48:37.003 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-25T08:48:37.004 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-25T08:48:37.004 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-25T08:48:37.004 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-25T08:48:37.004 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-25T08:48:37.004 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-25T08:48:37.004 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-25T08:48:37.004 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-25T08:48:37.004 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-25T08:48:37.004 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-25T08:48:37.004 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-25T08:48:37.004 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-25T08:48:37.004 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-25T08:48:37.004 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-25T08:48:37.004 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-25T08:48:37.005 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-25T08:48:37.005 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-25T08:48:37.005 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-25T08:48:37.005 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-25T08:48:37.005 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-25T08:48:37.005 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-25T08:48:37.005 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-25T08:48:37.005 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-25T08:48:37.005 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-25T08:48:37.005 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-25T08:48:37.005 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-25T08:48:37.005 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-25T08:48:37.005 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-25T08:48:37.005 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-25T08:48:37.005 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-25T08:48:37.006 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-25T08:48:37.006 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-25T08:48:37.006 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-25T08:48:37.006 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-25T08:48:37.006 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-25T08:48:37.006 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-25T08:48:37.006 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-25T08:48:37.006 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-25T08:48:37.006 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-25T08:48:37.006 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-25T08:48:37.006 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-25T08:48:37.006 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-25T08:48:37.006 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-25T08:48:37.007 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-25T08:48:37.007 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-25T08:48:37.007 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-25T08:48:37.007 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-25T08:48:37.007 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-25T08:48:37.007 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-25T08:48:37.007 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-25T08:48:37.007 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-25T08:48:37.007 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-25T08:48:37.007 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-25T08:48:37.007 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-25T08:48:37.007 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-25T08:48:37.007 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-25T08:48:37.007 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-25T08:48:37.008 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-25T08:48:37.008 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-25T08:48:37.008 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-25T08:48:37.008 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-25T08:48:37.008 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-25T08:48:37.008 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-25T08:48:37.008 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-25T08:48:37.008 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-25T08:48:37.008 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-25T08:48:37.008 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-25T08:48:37.008 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-25T08:48:37.008 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-25T08:48:37.008 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-25T08:48:37.008 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-25T08:48:37.009 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-25T08:48:37.009 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-25T08:48:37.009 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-25T08:48:37.009 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-25T08:48:37.009 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-25T08:48:37.009 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-25T08:48:37.009 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-25T08:48:37.009 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-25T08:48:37.009 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-25T08:48:37.009 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-25T08:48:37.009 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-25T08:48:37.009 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-25T08:48:37.009 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-25T08:48:37.009 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-25T08:48:37.010 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-25T08:48:37.010 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-25T08:48:37.010 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-25T08:48:37.010 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-25T08:48:37.010 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-25T08:48:37.010 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-25T08:48:37.010 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-25T08:48:37.010 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-25T08:48:37.010 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-25T08:48:37.010 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-25T08:48:37.010 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-25T08:48:37.010 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-25T08:48:37.010 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-25T08:48:37.010 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-25T08:48:37.010 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-25T08:48:37.011 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-25T08:48:37.011 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-25T08:48:37.011 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-25T08:48:37.011 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-25T08:48:37.011 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-25T08:48:37.011 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-25T08:48:37.011 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-25T08:48:37.011 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-25T08:48:37.011 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-25T08:48:37.011 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-25T08:48:37.011 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-25T08:48:37.011 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-25T08:48:37.011 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-25T08:48:37.011 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-25T08:48:37.012 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-25T08:48:37.012 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-25T08:48:37.012 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-25T08:48:37.012 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-25T08:48:37.012 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-25T08:48:37.012 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-25T08:48:37.012 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-25T08:48:37.012 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-25T08:48:37.012 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-25T08:48:37.012 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-25T08:48:37.012 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-25T08:48:37.012 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-25T08:48:37.012 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-25T08:48:37.012 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-25T08:48:37.012 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-25T08:48:37.012 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-25T08:48:37.013 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-25T08:48:37.013 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-25T08:48:37.013 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-25T08:48:37.013 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-25T08:48:37.013 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-25T08:48:37.013 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-25T08:48:37.013 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-25T08:48:37.013 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-25T08:48:37.013 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-25T08:48:37.013 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-25T08:48:37.013 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-25T08:48:37.013 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-25T08:48:37.013 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-25T08:48:37.013 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-25T08:48:37.014 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-25T08:48:37.014 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-25T08:48:37.014 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-25T08:48:37.014 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-25T08:48:37.014 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-25T08:48:37.014 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-25T08:48:37.014 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-25T08:48:37.014 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-25T08:48:37.014 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-25T08:48:37.014 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-25T08:48:37.014 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-25T08:48:37.014 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-25T08:48:37.014 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-25T08:48:37.014 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-25T08:48:37.014 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-25T08:48:37.015 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-25T08:48:37.015 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-25T08:48:37.015 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-25T08:48:37.015 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-25T08:48:37.015 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-25T08:48:37.015 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-25T08:48:37.015 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-25T08:48:37.015 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-25T08:48:37.015 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-25T08:48:37.015 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-25T08:48:37.015 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-25T08:48:37.015 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-25T08:48:37.015 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-25T08:48:37.015 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-25T08:48:37.015 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-25T08:48:37.016 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-25T08:48:37.016 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-25T08:48:37.016 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-25T08:48:37.016 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-25T08:48:37.016 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-25T08:48:37.016 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-25T08:48:37.016 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-25T08:48:37.016 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-25T08:48:37.016 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-25T08:48:37.016 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-25T08:48:37.016 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-25T08:48:37.016 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-25T08:48:37.016 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-25T08:48:37.016 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-25T08:48:37.016 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-25T08:48:37.017 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-25T08:48:37.017 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-25T08:48:37.017 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-25T08:48:37.017 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-25T08:48:37.017 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-25T08:48:37.017 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-25T08:48:37.017 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-25T08:48:37.017 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-25T08:48:37.017 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-25T08:48:37.017 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-25T08:48:37.017 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-25T08:48:37.017 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-25T08:48:37.017 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-25T08:48:37.017 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-25T08:48:37.017 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-25T08:48:37.018 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-25T08:48:37.018 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-25T08:48:37.018 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-25T08:48:37.018 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-25T08:48:37.018 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-25T08:48:37.018 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-25T08:48:37.018 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-25T08:48:37.018 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-25T08:48:37.059 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-25T08:48:37.059 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-25T08:48:37.059 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-25T08:48:37.060 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-25T08:48:37.060 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-25T08:48:37.060 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-25T08:48:37.060 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-25T08:48:37.060 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-25T08:48:37.060 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-25T08:48:37.060 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-25T08:48:37.060 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-25T08:48:37.060 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-25T08:48:37.060 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-25T08:48:37.060 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-25T08:48:37.060 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-25T08:48:37.060 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-25T08:48:37.060 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-25T08:48:37.061 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-25T08:48:37.061 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-25T08:48:37.061 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-25T08:48:37.061 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-25T08:48:37.061 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-25T08:48:37.061 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-25T08:48:37.061 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-25T08:48:37.061 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-25T08:48:37.061 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-25T08:48:37.061 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-25T08:48:37.061 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-25T08:48:37.061 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-25T08:48:37.061 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-25T08:48:37.061 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-25T08:48:37.062 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-25T08:48:37.062 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-25T08:48:37.062 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-25T08:48:37.062 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-25T08:48:37.062 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-25T08:48:37.062 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-25T08:48:37.062 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-25T08:48:37.062 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-25T08:48:37.062 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-25T08:48:37.062 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-25T08:48:37.062 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-25T08:48:37.062 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-25T08:48:37.062 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-25T08:48:37.063 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-25T08:48:37.063 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-25T08:48:37.063 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-25T08:48:37.063 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-25T08:48:37.063 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-25T08:48:37.063 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-25T08:48:37.063 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-25T08:48:37.063 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-25T08:48:37.063 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-25T08:48:37.063 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-25T08:48:37.063 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-25T08:48:37.063 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-25T08:48:37.063 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-25T08:48:37.063 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-25T08:48:37.063 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-25T08:48:37.063 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-25T08:48:37.064 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-25T08:48:37.064 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-25T08:48:37.064 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-25T08:48:37.064 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-25T08:48:37.064 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-25T08:48:37.064 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-25T08:48:37.064 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-25T08:48:37.064 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-25T08:48:37.064 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-25T08:48:37.064 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-25T08:48:37.064 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-25T08:48:37.064 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-25T08:48:37.064 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-25T08:48:37.064 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-25T08:48:37.064 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-25T08:48:37.065 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-25T08:48:37.065 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-25T08:48:37.065 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-25T08:48:37.065 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-25T08:48:37.065 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-25T08:48:37.065 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-25T08:48:37.065 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-25T08:48:37.065 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-25T08:48:37.065 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-25T08:48:37.065 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-25T08:48:37.065 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-25T08:48:37.065 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-25T08:48:37.065 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-25T08:48:37.066 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-25T08:48:37.066 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-25T08:48:37.066 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-25T08:48:37.066 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-25T08:48:37.066 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-25T08:48:37.066 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-25T08:48:37.066 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-25T08:48:37.066 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-25T08:48:37.066 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-25T08:48:37.066 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-25T08:48:37.066 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-25T08:48:37.066 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-25T08:48:37.066 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-25T08:48:37.066 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-25T08:48:37.067 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-25T08:48:37.067 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-25T08:48:37.067 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-25T08:48:37.067 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-25T08:48:37.067 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-25T08:48:37.067 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-25T08:48:37.067 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-25T08:48:37.067 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-25T08:48:37.067 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-25T08:48:37.067 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-25T08:48:37.067 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-25T08:48:37.067 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-25T08:48:37.067 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-25T08:48:37.067 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-25T08:48:37.067 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-25T08:48:37.067 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-25T08:48:37.068 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-25T08:48:37.068 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-25T08:48:37.068 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-25T08:48:37.068 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-25T08:48:37.068 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-25T08:48:37.068 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-25T08:48:37.068 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-25T08:48:37.068 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-25T08:48:37.068 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-25T08:48:37.068 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-25T08:48:37.068 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-25T08:48:37.068 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-25T08:48:37.068 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-25T08:48:37.068 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-25T08:48:37.069 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-25T08:48:37.069 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-25T08:48:37.069 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-25T08:48:37.069 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-25T08:48:37.069 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-25T08:48:37.069 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-25T08:48:37.069 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-25T08:48:37.069 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-25T08:48:37.069 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-25T08:48:37.069 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-25T08:48:37.069 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-25T08:48:37.069 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-25T08:48:37.069 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-25T08:48:37.069 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-25T08:48:37.070 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-25T08:48:37.070 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-25T08:48:37.070 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-25T08:48:37.070 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-25T08:48:37.070 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-25T08:48:37.070 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-25T08:48:37.070 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-25T08:48:37.070 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-25T08:48:37.070 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-25T08:48:37.070 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-25T08:48:37.070 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-25T08:48:37.070 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-25T08:48:37.070 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-25T08:48:37.071 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-25T08:48:37.071 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-25T08:48:37.071 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-25T08:48:37.071 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-25T08:48:37.071 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-25T08:48:37.071 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-25T08:48:37.071 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-25T08:48:37.071 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-25T08:48:37.071 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-25T08:48:37.071 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-25T08:48:37.071 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-25T08:48:37.071 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-25T08:48:37.071 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-25T08:48:37.071 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-25T08:48:37.071 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-25T08:48:37.072 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-25T08:48:37.072 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-25T08:48:37.072 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-25T08:48:37.072 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-25T08:48:37.072 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-25T08:48:37.072 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-25T08:48:37.072 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-25T08:48:37.072 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-25T08:48:37.072 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-25T08:48:37.072 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-25T08:48:37.072 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-25T08:48:37.072 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-25T08:48:37.072 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-25T08:48:37.072 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-25T08:48:37.072 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-25T08:48:37.073 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-25T08:48:37.073 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-25T08:48:37.073 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-25T08:48:37.073 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-25T08:48:37.073 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-25T08:48:37.073 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-25T08:48:37.073 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-25T08:48:37.073 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-25T08:48:37.073 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-25T08:48:37.073 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-25T08:48:37.073 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-25T08:48:37.073 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-25T08:48:37.073 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-25T08:48:37.074 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-25T08:48:37.074 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-25T08:48:37.074 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-25T08:48:37.074 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-25T08:48:37.074 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-25T08:48:37.074 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-25T08:48:37.074 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-25T08:48:37.074 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-25T08:48:37.074 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-25T08:48:37.074 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-25T08:48:37.074 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-25T08:48:37.074 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-25T08:48:37.074 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-25T08:48:37.074 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-25T08:48:37.075 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-25T08:48:37.075 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-25T08:48:37.075 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-25T08:48:37.075 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-25T08:48:37.075 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-25T08:48:37.075 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-25T08:48:37.075 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-25T08:48:37.075 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-25T08:48:37.075 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-25T08:48:37.075 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-25T08:48:37.075 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-25T08:48:37.075 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-25T08:48:37.075 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-25T08:48:37.075 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-25T08:48:37.075 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-25T08:48:37.076 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-25T08:48:37.076 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-25T08:48:37.076 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-25T08:48:37.076 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-25T08:48:37.076 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-25T08:48:37.076 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-25T08:48:37.076 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-25T08:48:37.076 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-25T08:48:37.076 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-25T08:48:37.076 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-25T08:48:37.076 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-25T08:48:37.076 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-25T08:48:37.076 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-25T08:48:37.076 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-25T08:48:37.077 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-25T08:48:37.077 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-25T08:48:37.077 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-25T08:48:37.077 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-25T08:48:37.077 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-25T08:48:37.077 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-25T08:48:37.077 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-25T08:48:37.077 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-25T08:48:37.077 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-25T08:48:37.077 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-25T08:48:37.077 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-25T08:48:37.077 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-25T08:48:37.077 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-25T08:48:37.078 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-25T08:48:37.078 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-25T08:48:37.078 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-25T08:48:37.078 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-25T08:48:37.078 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-25T08:48:37.078 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-25T08:48:37.078 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-25T08:48:37.078 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-25T08:48:37.078 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-25T08:48:37.078 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-25T08:48:37.078 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-25T08:48:37.078 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-25T08:48:37.078 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-25T08:48:37.078 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-25T08:48:37.079 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-25T08:48:37.079 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-25T08:48:37.079 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-25T08:48:37.079 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-25T08:48:37.079 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-25T08:48:37.079 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-25T08:48:37.079 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-25T08:48:37.079 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-25T08:48:37.079 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-25T08:48:37.079 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-25T08:48:37.079 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-25T08:48:37.079 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-25T08:48:37.079 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-25T08:48:37.080 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-25T08:48:37.080 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-25T08:48:37.080 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-25T08:48:37.080 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-25T08:48:37.080 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-25T08:48:37.080 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-25T08:48:37.080 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-25T08:48:37.080 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-25T08:48:37.080 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-25T08:48:37.080 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-25T08:48:37.080 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-25T08:48:37.080 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-25T08:48:37.080 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-25T08:48:37.080 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-25T08:48:37.080 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-25T08:48:37.081 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-25T08:48:37.081 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-25T08:48:37.081 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-25T08:48:37.081 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-25T08:48:37.081 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-25T08:48:37.081 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-25T08:48:37.081 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-25T08:48:37.081 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-25T08:48:37.081 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-25T08:48:37.081 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-25T08:48:37.081 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-25T08:48:37.081 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-25T08:48:37.081 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-25T08:48:37.081 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-25T08:48:37.081 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-25T08:48:37.082 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-25T08:48:37.082 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-25T08:48:37.082 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-25T08:48:37.082 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-25T08:48:37.082 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-25T08:48:37.082 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-25T08:48:37.082 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-25T08:48:37.082 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-25T08:48:37.082 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-25T08:48:37.082 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-25T08:48:37.082 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-25T08:48:37.082 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-25T08:48:37.082 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-25T08:48:37.083 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-25T08:48:37.083 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-25T08:48:37.083 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-25T08:48:37.083 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-25T08:48:37.083 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-25T08:48:37.083 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-25T08:48:37.083 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-25T08:48:37.083 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-25T08:48:37.083 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-25T08:48:37.083 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-25T08:48:37.083 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-25T08:48:37.083 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-25T08:48:37.083 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-25T08:48:37.083 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-25T08:48:37.084 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-25T08:48:37.084 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-25T08:48:37.084 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-25T08:48:37.084 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-25T08:48:37.084 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-25T08:48:37.084 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-25T08:48:37.084 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-25T08:48:37.084 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-25T08:48:37.084 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-25T08:48:37.084 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-25T08:48:37.084 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-25T08:48:37.084 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-25T08:48:37.084 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-25T08:48:37.084 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-25T08:48:37.084 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-25T08:48:37.085 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-25T08:48:37.085 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-25T08:48:37.085 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-25T08:48:37.085 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-25T08:48:37.085 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-25T08:48:37.085 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-25T08:48:37.085 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-25T08:48:37.085 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-25T08:48:37.085 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-25T08:48:37.085 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-25T08:48:37.085 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-25T08:48:37.085 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-25T08:48:37.085 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-25T08:48:37.085 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-25T08:48:37.085 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-25T08:48:37.085 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-25T08:48:37.086 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-25T08:48:37.086 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-25T08:48:37.086 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-25T08:48:37.086 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-25T08:48:37.086 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-25T08:48:37.086 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-25T08:48:37.086 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-25T08:48:37.086 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-25T08:48:37.086 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-25T08:48:37.086 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-25T08:48:37.086 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-25T08:48:37.086 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-25T08:48:37.086 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-25T08:48:37.087 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-25T08:48:37.087 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-25T08:48:37.087 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-25T08:48:37.087 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-25T08:48:37.087 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-25T08:48:37.087 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-25T08:48:37.087 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-25T08:48:37.087 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-25T08:48:37.087 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-25T08:48:37.087 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-25T08:48:37.087 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-25T08:48:37.087 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-25T08:48:37.087 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-25T08:48:37.087 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-25T08:48:37.087 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-25T08:48:37.088 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-25T08:48:37.088 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-25T08:48:37.088 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-25T08:48:37.088 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-25T08:48:37.088 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-25T08:48:37.088 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-25T08:48:37.088 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-25T08:48:37.088 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-25T08:48:37.088 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-25T08:48:37.088 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-25T08:48:37.088 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-25T08:48:37.088 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-25T08:48:37.088 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-25T08:48:37.088 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-25T08:48:37.089 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-25T08:48:37.089 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-25T08:48:37.089 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-25T08:48:37.089 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-25T08:48:37.089 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-25T08:48:37.089 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-25T08:48:37.089 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-25T08:48:37.089 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-25T08:48:37.089 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-25T08:48:37.089 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-25T08:48:37.089 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-25T08:48:37.089 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-25T08:48:37.089 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-25T08:48:37.089 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-25T08:48:37.090 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-25T08:48:37.090 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-25T08:48:37.090 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-25T08:48:37.090 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-25T08:48:37.090 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-25T08:48:37.090 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-25T08:48:37.090 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-25T08:48:37.090 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-25T08:48:37.090 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-25T08:48:37.090 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-25T08:48:37.090 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-25T08:48:37.090 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-25T08:48:37.090 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-25T08:48:37.090 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-25T08:48:37.090 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-25T08:48:37.091 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-25T08:48:37.091 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-25T08:48:37.091 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-25T08:48:37.091 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-25T08:48:37.091 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-25T08:48:37.091 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-25T08:48:37.091 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-25T08:48:37.091 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-25T08:48:37.091 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-25T08:48:37.091 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-25T08:48:37.091 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-25T08:48:37.091 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-25T08:48:37.091 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-25T08:48:37.091 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-25T08:48:37.091 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-25T08:48:37.092 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-25T08:48:37.092 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-25T08:48:37.092 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-25T08:48:37.092 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-25T08:48:37.092 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-25T08:48:37.092 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-25T08:48:37.092 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-25T08:48:37.092 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-25T08:48:37.092 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-25T08:48:37.092 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-25T08:48:37.092 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-25T08:48:37.092 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-25T08:48:37.092 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-25T08:48:37.092 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-25T08:48:37.093 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-25T08:48:37.093 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-25T08:48:37.093 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-25T08:48:37.093 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-25T08:48:37.093 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-25T08:48:37.093 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-25T08:48:37.093 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-25T08:48:37.093 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-25T08:48:37.093 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-25T08:48:37.093 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-25T08:48:37.093 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-25T08:48:37.093 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-25T08:48:37.093 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-25T08:48:37.093 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-25T08:48:37.093 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-25T08:48:37.094 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-25T08:48:37.094 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-25T08:48:37.094 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-25T08:48:37.094 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-25T08:48:37.094 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-25T08:48:37.094 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-25T08:48:37.094 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-25T08:48:37.094 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-25T08:48:37.094 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-25T08:48:37.094 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-25T08:48:37.094 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-25T08:48:37.094 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-25T08:48:37.094 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-25T08:48:37.094 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-25T08:48:37.095 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-25T08:48:37.095 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-25T08:48:37.095 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-25T08:48:37.095 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-25T08:48:37.095 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-25T08:48:37.095 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-25T08:48:37.097 DEBUG:teuthology.orchestra.run.smithi173:> dpkg-deb -c /tmp/linux-image.deb 2024-04-25T08:48:37.108 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-25T08:48:37.108 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-25T08:48:37.108 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:37.128 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:37.128 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:37.138 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-25T08:48:37.138 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-25T08:48:37.138 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-25T08:48:37.138 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-25T08:48:37.139 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-25T08:48:37.139 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-25T08:48:37.139 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-25T08:48:37.139 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-25T08:48:37.139 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-25T08:48:37.139 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-25T08:48:37.139 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-25T08:48:37.139 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-25T08:48:37.139 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-25T08:48:37.139 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-25T08:48:37.139 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-25T08:48:37.139 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-25T08:48:37.139 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-25T08:48:37.139 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-25T08:48:37.140 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-25T08:48:37.140 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-25T08:48:37.140 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-25T08:48:37.140 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-25T08:48:37.140 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-25T08:48:37.140 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-25T08:48:37.140 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-25T08:48:37.140 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-25T08:48:37.140 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-25T08:48:37.140 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-25T08:48:37.140 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-25T08:48:37.140 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-25T08:48:37.140 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-25T08:48:37.141 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-25T08:48:37.141 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-25T08:48:37.141 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-25T08:48:37.141 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-25T08:48:37.141 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-25T08:48:37.141 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-25T08:48:37.141 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-25T08:48:37.141 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-25T08:48:37.141 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-25T08:48:37.141 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-25T08:48:37.141 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-25T08:48:37.141 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-25T08:48:37.141 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-25T08:48:37.141 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-25T08:48:37.142 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-25T08:48:37.142 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-25T08:48:37.142 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-25T08:48:37.142 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-25T08:48:37.142 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-25T08:48:37.142 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-25T08:48:37.142 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-25T08:48:37.142 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-25T08:48:37.142 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-25T08:48:37.142 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-25T08:48:37.142 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-25T08:48:37.142 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-25T08:48:37.142 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-25T08:48:37.142 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-25T08:48:37.143 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-25T08:48:37.143 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-25T08:48:37.143 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-25T08:48:37.143 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-25T08:48:37.143 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-25T08:48:37.143 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-25T08:48:37.143 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-25T08:48:37.143 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-25T08:48:37.143 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-25T08:48:37.143 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-25T08:48:37.143 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-25T08:48:37.143 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-25T08:48:37.143 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-25T08:48:37.144 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-25T08:48:37.144 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-25T08:48:37.144 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-25T08:48:37.144 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-25T08:48:37.144 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-25T08:48:37.144 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-25T08:48:37.144 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-25T08:48:37.144 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-25T08:48:37.144 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-25T08:48:37.144 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-25T08:48:37.144 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-25T08:48:37.144 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-25T08:48:37.144 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-25T08:48:37.144 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-25T08:48:37.144 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-25T08:48:37.145 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-25T08:48:37.145 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-25T08:48:37.145 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-25T08:48:37.145 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-25T08:48:37.145 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-25T08:48:37.145 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-25T08:48:37.145 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-25T08:48:37.145 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-25T08:48:37.145 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-25T08:48:37.145 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-25T08:48:37.145 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-25T08:48:37.145 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-25T08:48:37.145 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-25T08:48:37.145 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-25T08:48:37.146 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-25T08:48:37.146 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-25T08:48:37.146 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-25T08:48:37.146 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-25T08:48:37.146 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-25T08:48:37.146 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-25T08:48:37.146 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-25T08:48:37.146 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-25T08:48:37.146 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-25T08:48:37.146 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-25T08:48:37.146 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-25T08:48:37.146 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-25T08:48:37.146 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-25T08:48:37.146 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-25T08:48:37.147 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-25T08:48:37.147 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-25T08:48:37.147 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-25T08:48:37.147 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-25T08:48:37.147 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-25T08:48:37.147 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-25T08:48:37.147 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-25T08:48:37.147 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-25T08:48:37.147 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-25T08:48:37.147 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-25T08:48:37.147 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-25T08:48:37.147 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-25T08:48:37.147 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-25T08:48:37.147 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-25T08:48:37.148 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-25T08:48:37.148 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-25T08:48:37.148 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-25T08:48:37.148 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-25T08:48:37.148 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-25T08:48:37.148 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-25T08:48:37.148 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-25T08:48:37.148 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-25T08:48:37.148 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-25T08:48:37.148 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-25T08:48:37.148 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-25T08:48:37.148 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-25T08:48:37.148 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-25T08:48:37.148 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-25T08:48:37.149 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-25T08:48:37.149 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-25T08:48:37.149 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-25T08:48:37.149 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-25T08:48:37.149 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-25T08:48:37.149 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-25T08:48:37.149 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-25T08:48:37.149 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-25T08:48:37.149 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-25T08:48:37.149 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-25T08:48:37.149 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-25T08:48:37.149 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-25T08:48:37.149 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-25T08:48:37.149 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-25T08:48:37.150 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-25T08:48:37.150 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-25T08:48:37.150 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-25T08:48:37.150 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-25T08:48:37.150 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-25T08:48:37.150 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-25T08:48:37.150 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-25T08:48:37.150 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-25T08:48:37.150 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-25T08:48:37.150 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-25T08:48:37.150 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-25T08:48:37.150 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-25T08:48:37.150 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-25T08:48:37.151 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-25T08:48:37.151 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-25T08:48:37.151 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-25T08:48:37.151 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-25T08:48:37.151 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-25T08:48:37.151 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-25T08:48:37.151 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-25T08:48:37.151 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-25T08:48:37.151 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-25T08:48:37.151 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-25T08:48:37.151 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-25T08:48:37.151 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-25T08:48:37.151 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-25T08:48:37.151 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-25T08:48:37.151 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-25T08:48:37.152 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-25T08:48:37.152 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-25T08:48:37.152 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-25T08:48:37.152 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-25T08:48:37.152 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-25T08:48:37.152 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-25T08:48:37.152 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-25T08:48:37.152 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-25T08:48:37.152 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-25T08:48:37.152 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-25T08:48:37.152 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-25T08:48:37.152 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-25T08:48:37.152 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-25T08:48:37.152 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-25T08:48:37.153 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-25T08:48:37.153 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-25T08:48:37.153 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-25T08:48:37.153 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-25T08:48:37.153 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-25T08:48:37.153 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-25T08:48:37.153 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-25T08:48:37.153 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-25T08:48:37.153 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-25T08:48:37.153 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-25T08:48:37.153 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-25T08:48:37.153 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-25T08:48:37.153 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-25T08:48:37.153 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-25T08:48:37.154 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-25T08:48:37.154 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-25T08:48:37.154 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-25T08:48:37.154 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-25T08:48:37.154 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-25T08:48:37.154 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-25T08:48:37.154 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-25T08:48:37.154 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-25T08:48:37.154 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-25T08:48:37.154 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-25T08:48:37.154 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-25T08:48:37.154 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-25T08:48:37.154 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-25T08:48:37.154 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-25T08:48:37.155 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-25T08:48:37.155 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-25T08:48:37.155 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-25T08:48:37.155 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-25T08:48:37.155 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-25T08:48:37.155 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-25T08:48:37.155 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-25T08:48:37.155 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-25T08:48:37.155 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-25T08:48:37.155 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-25T08:48:37.155 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-25T08:48:37.155 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-25T08:48:37.155 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-25T08:48:37.155 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-25T08:48:37.156 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-25T08:48:37.156 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-25T08:48:37.156 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-25T08:48:37.156 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-25T08:48:37.156 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-25T08:48:37.156 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-25T08:48:37.156 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-25T08:48:37.156 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-25T08:48:37.156 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-25T08:48:37.156 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-25T08:48:37.156 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-25T08:48:37.156 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-25T08:48:37.156 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-25T08:48:37.156 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-25T08:48:37.157 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-25T08:48:37.157 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-25T08:48:37.157 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-25T08:48:37.157 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-25T08:48:37.157 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-25T08:48:37.157 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-25T08:48:37.157 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-25T08:48:37.157 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-25T08:48:37.157 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-25T08:48:37.157 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-25T08:48:37.157 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-25T08:48:37.157 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-25T08:48:37.157 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-25T08:48:37.157 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-25T08:48:37.158 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-25T08:48:37.158 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-25T08:48:37.158 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-25T08:48:37.158 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-25T08:48:37.158 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-25T08:48:37.158 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-25T08:48:37.158 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-25T08:48:37.158 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-25T08:48:37.158 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-25T08:48:37.158 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-25T08:48:37.158 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-25T08:48:37.158 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-25T08:48:37.158 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-25T08:48:37.159 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-25T08:48:37.159 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-25T08:48:37.159 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-25T08:48:37.159 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-25T08:48:37.159 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-25T08:48:37.159 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-25T08:48:37.159 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-25T08:48:37.159 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-25T08:48:37.159 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-25T08:48:37.159 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-25T08:48:37.159 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-25T08:48:37.159 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-25T08:48:37.159 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-25T08:48:37.159 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-25T08:48:37.160 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-25T08:48:37.160 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-25T08:48:37.160 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-25T08:48:37.160 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-25T08:48:37.160 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-25T08:48:37.160 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-25T08:48:37.160 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-25T08:48:37.160 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-25T08:48:37.160 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-25T08:48:37.160 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-25T08:48:37.160 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-25T08:48:37.160 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-25T08:48:37.160 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-25T08:48:37.161 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-25T08:48:37.161 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-25T08:48:37.161 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-25T08:48:37.161 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-25T08:48:37.161 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-25T08:48:37.161 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-25T08:48:37.161 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-25T08:48:37.161 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-25T08:48:37.161 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-25T08:48:37.161 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-25T08:48:37.161 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-25T08:48:37.161 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-25T08:48:37.161 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-25T08:48:37.161 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-25T08:48:37.162 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-25T08:48:37.162 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-25T08:48:37.162 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-25T08:48:37.162 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-25T08:48:37.162 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-25T08:48:37.162 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-25T08:48:37.162 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-25T08:48:37.162 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-25T08:48:37.162 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-25T08:48:37.162 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-25T08:48:37.162 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-25T08:48:37.162 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-25T08:48:37.163 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-25T08:48:37.163 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-25T08:48:37.163 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-25T08:48:37.163 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-25T08:48:37.163 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-25T08:48:37.163 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-25T08:48:37.163 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-25T08:48:37.163 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-25T08:48:37.163 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-25T08:48:37.163 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-25T08:48:37.163 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-25T08:48:37.163 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-25T08:48:37.163 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-25T08:48:37.163 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-25T08:48:37.164 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-25T08:48:37.164 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-25T08:48:37.164 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-25T08:48:37.164 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-25T08:48:37.164 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-25T08:48:37.164 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-25T08:48:37.164 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-25T08:48:37.164 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-25T08:48:37.164 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-25T08:48:37.164 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-25T08:48:37.164 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-25T08:48:37.164 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-25T08:48:37.164 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-25T08:48:37.164 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-25T08:48:37.164 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-25T08:48:37.165 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-25T08:48:37.165 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-25T08:48:37.165 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-25T08:48:37.165 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-25T08:48:37.165 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-25T08:48:37.165 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-25T08:48:37.165 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-25T08:48:37.165 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-25T08:48:37.165 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-25T08:48:37.165 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-25T08:48:37.165 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-25T08:48:37.165 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-25T08:48:37.165 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-25T08:48:37.165 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-25T08:48:37.165 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-25T08:48:37.166 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-25T08:48:37.166 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-25T08:48:37.166 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-25T08:48:37.166 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-25T08:48:37.166 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-25T08:48:37.166 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-25T08:48:37.166 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-25T08:48:37.166 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-25T08:48:37.166 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-25T08:48:37.166 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-25T08:48:37.166 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-25T08:48:37.166 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-25T08:48:37.166 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-25T08:48:37.166 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-25T08:48:37.167 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-25T08:48:37.167 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-25T08:48:37.167 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-25T08:48:37.167 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-25T08:48:37.167 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-25T08:48:37.167 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-25T08:48:37.167 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-25T08:48:37.167 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-25T08:48:37.167 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-25T08:48:37.167 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-25T08:48:37.167 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-25T08:48:37.167 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-25T08:48:37.167 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-25T08:48:37.167 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-25T08:48:37.168 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-25T08:48:37.168 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-25T08:48:37.168 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-25T08:48:37.168 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-25T08:48:37.168 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-25T08:48:37.168 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-25T08:48:37.168 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-25T08:48:37.168 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-25T08:48:37.168 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-25T08:48:37.168 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-25T08:48:37.168 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-25T08:48:37.168 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-25T08:48:37.168 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-25T08:48:37.168 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-25T08:48:37.168 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-25T08:48:37.169 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-25T08:48:37.169 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-25T08:48:37.169 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-25T08:48:37.169 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-25T08:48:37.169 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-25T08:48:37.169 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-25T08:48:37.169 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-25T08:48:37.169 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-25T08:48:37.169 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-25T08:48:37.169 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-25T08:48:37.169 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-25T08:48:37.169 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-25T08:48:37.169 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-25T08:48:37.169 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-25T08:48:37.169 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-25T08:48:37.170 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-25T08:48:37.170 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-25T08:48:37.170 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-25T08:48:37.170 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-25T08:48:37.170 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-25T08:48:37.170 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-25T08:48:37.170 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-25T08:48:37.170 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-25T08:48:37.170 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-25T08:48:37.170 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-25T08:48:37.170 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-25T08:48:37.170 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-25T08:48:37.170 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-25T08:48:37.170 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-25T08:48:37.171 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-25T08:48:37.171 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-25T08:48:37.171 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-25T08:48:37.171 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-25T08:48:37.171 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-25T08:48:37.171 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-25T08:48:37.171 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-25T08:48:37.171 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-25T08:48:37.171 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-25T08:48:37.171 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-25T08:48:37.171 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-25T08:48:37.171 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-25T08:48:37.171 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-25T08:48:37.171 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-25T08:48:37.171 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-25T08:48:37.172 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-25T08:48:37.172 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-25T08:48:37.172 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-25T08:48:37.172 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-25T08:48:37.172 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-25T08:48:37.172 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-25T08:48:37.172 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-25T08:48:37.172 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-25T08:48:37.172 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-25T08:48:37.172 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-25T08:48:37.172 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-25T08:48:37.172 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-25T08:48:37.172 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-25T08:48:37.172 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-25T08:48:37.172 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-25T08:48:37.173 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-25T08:48:37.173 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-25T08:48:37.173 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-25T08:48:37.280 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-25T08:48:37.280 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-25T08:48:37.280 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-25T08:48:37.280 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-25T08:48:37.280 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-25T08:48:37.281 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-25T08:48:37.281 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-25T08:48:37.281 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-25T08:48:37.281 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-25T08:48:37.281 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-25T08:48:37.281 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-25T08:48:37.281 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-25T08:48:37.281 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-25T08:48:37.281 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-25T08:48:37.281 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-25T08:48:37.281 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-25T08:48:37.281 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-25T08:48:37.281 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-25T08:48:37.282 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-25T08:48:37.282 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-25T08:48:37.282 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-25T08:48:37.282 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-25T08:48:37.282 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-25T08:48:37.282 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-25T08:48:37.282 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-25T08:48:37.282 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-25T08:48:37.282 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-25T08:48:37.282 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-25T08:48:37.282 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-25T08:48:37.282 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-25T08:48:37.282 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-25T08:48:37.283 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-25T08:48:37.283 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-25T08:48:37.283 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-25T08:48:37.283 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-25T08:48:37.283 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-25T08:48:37.283 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-25T08:48:37.283 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-25T08:48:37.283 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-25T08:48:37.283 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-25T08:48:37.283 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-25T08:48:37.283 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-25T08:48:37.283 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-25T08:48:37.283 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-25T08:48:37.284 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-25T08:48:37.284 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-25T08:48:37.284 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-25T08:48:37.284 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-25T08:48:37.284 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-25T08:48:37.284 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-25T08:48:37.284 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-25T08:48:37.284 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-25T08:48:37.284 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-25T08:48:37.284 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-25T08:48:37.284 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-25T08:48:37.285 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-25T08:48:37.285 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-25T08:48:37.285 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-25T08:48:37.285 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-25T08:48:37.285 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-25T08:48:37.285 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-25T08:48:37.285 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-25T08:48:37.285 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-25T08:48:37.285 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-25T08:48:37.285 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-25T08:48:37.285 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-25T08:48:37.285 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-25T08:48:37.285 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-25T08:48:37.286 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-25T08:48:37.286 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-25T08:48:37.286 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-25T08:48:37.286 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-25T08:48:37.286 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-25T08:48:37.286 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-25T08:48:37.286 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-25T08:48:37.286 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-25T08:48:37.287 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-25T08:48:37.287 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-25T08:48:37.287 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-25T08:48:37.287 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-25T08:48:37.287 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-25T08:48:37.287 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-25T08:48:37.287 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-25T08:48:37.287 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-25T08:48:37.287 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-25T08:48:37.288 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-25T08:48:37.288 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-25T08:48:37.288 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-25T08:48:37.288 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-25T08:48:37.288 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-25T08:48:37.288 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-25T08:48:37.288 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-25T08:48:37.288 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-25T08:48:37.288 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-25T08:48:37.288 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-25T08:48:37.289 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-25T08:48:37.289 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-25T08:48:37.289 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-25T08:48:37.289 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-25T08:48:37.289 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-25T08:48:37.289 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-25T08:48:37.289 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-25T08:48:37.289 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-25T08:48:37.289 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-25T08:48:37.289 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-25T08:48:37.289 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-25T08:48:37.290 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-25T08:48:37.290 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-25T08:48:37.290 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-25T08:48:37.290 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-25T08:48:37.290 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-25T08:48:37.290 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-25T08:48:37.290 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-25T08:48:37.290 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-25T08:48:37.290 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-25T08:48:37.290 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-25T08:48:37.291 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-25T08:48:37.291 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-25T08:48:37.291 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-25T08:48:37.291 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-25T08:48:37.291 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-25T08:48:37.291 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-25T08:48:37.292 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-25T08:48:37.292 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-25T08:48:37.292 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-25T08:48:37.292 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-25T08:48:37.292 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-25T08:48:37.292 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-25T08:48:37.293 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-25T08:48:37.293 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-25T08:48:37.293 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-25T08:48:37.293 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-25T08:48:37.293 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-25T08:48:37.293 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-25T08:48:37.294 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-25T08:48:37.294 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-25T08:48:37.294 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-25T08:48:37.294 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-25T08:48:37.294 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-25T08:48:37.294 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-25T08:48:37.295 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-25T08:48:37.295 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-25T08:48:37.295 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-25T08:48:37.295 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-25T08:48:37.295 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-25T08:48:37.295 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-25T08:48:37.296 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-25T08:48:37.296 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-25T08:48:37.296 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-25T08:48:37.296 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-25T08:48:37.296 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-25T08:48:37.297 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-25T08:48:37.297 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-25T08:48:37.297 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-25T08:48:37.297 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-25T08:48:37.297 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-25T08:48:37.297 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-25T08:48:37.297 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-25T08:48:37.297 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-25T08:48:37.297 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-25T08:48:37.297 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-25T08:48:37.297 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-25T08:48:37.297 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-25T08:48:37.297 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-25T08:48:37.297 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-25T08:48:37.297 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-25T08:48:37.298 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-25T08:48:37.298 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-25T08:48:37.298 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-25T08:48:37.298 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-25T08:48:37.298 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-25T08:48:37.298 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-25T08:48:37.298 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-25T08:48:37.298 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-25T08:48:37.298 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-25T08:48:37.298 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-25T08:48:37.298 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-25T08:48:37.298 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-25T08:48:37.298 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-25T08:48:37.298 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-25T08:48:37.299 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-25T08:48:37.299 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-25T08:48:37.299 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-25T08:48:37.299 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-25T08:48:37.299 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-25T08:48:37.299 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-25T08:48:37.299 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-25T08:48:37.300 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-25T08:48:37.300 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-25T08:48:37.300 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-25T08:48:37.300 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-25T08:48:37.300 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-25T08:48:37.300 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-25T08:48:37.300 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-25T08:48:37.300 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-25T08:48:37.301 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-25T08:48:37.301 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-25T08:48:37.301 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-25T08:48:37.301 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-25T08:48:37.301 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-25T08:48:37.301 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-25T08:48:37.301 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-25T08:48:37.301 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-25T08:48:37.301 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-25T08:48:37.301 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-25T08:48:37.301 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-25T08:48:37.301 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-25T08:48:37.302 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-25T08:48:37.302 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-25T08:48:37.302 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-25T08:48:37.302 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-25T08:48:37.302 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-25T08:48:37.302 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-25T08:48:37.302 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-25T08:48:37.302 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-25T08:48:37.302 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-25T08:48:37.302 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-25T08:48:37.302 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-25T08:48:37.302 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-25T08:48:37.303 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-25T08:48:37.303 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-25T08:48:37.303 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-25T08:48:37.303 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-25T08:48:37.303 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-25T08:48:37.303 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-25T08:48:37.303 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-25T08:48:37.303 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-25T08:48:37.303 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-25T08:48:37.303 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-25T08:48:37.303 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-25T08:48:37.303 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-25T08:48:37.303 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-25T08:48:37.303 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-25T08:48:37.303 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-25T08:48:37.304 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-25T08:48:37.304 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-25T08:48:37.304 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-25T08:48:37.304 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-25T08:48:37.304 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-25T08:48:37.304 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-25T08:48:37.304 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-25T08:48:37.304 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-25T08:48:37.304 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-25T08:48:37.304 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-25T08:48:37.304 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-25T08:48:37.304 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-25T08:48:37.304 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-25T08:48:37.304 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-25T08:48:37.305 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-25T08:48:37.305 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-25T08:48:37.305 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-25T08:48:37.305 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-25T08:48:37.305 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-25T08:48:37.305 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-25T08:48:37.305 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-25T08:48:37.305 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-25T08:48:37.305 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-25T08:48:37.305 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-25T08:48:37.305 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-25T08:48:37.305 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-25T08:48:37.305 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-25T08:48:37.305 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-25T08:48:37.305 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-25T08:48:37.306 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-25T08:48:37.306 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-25T08:48:37.306 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-25T08:48:37.306 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-25T08:48:37.306 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-25T08:48:37.306 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-25T08:48:37.306 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-25T08:48:37.306 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-25T08:48:37.306 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-25T08:48:37.306 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-25T08:48:37.306 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-25T08:48:37.306 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-25T08:48:37.306 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-25T08:48:37.306 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-25T08:48:37.307 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-25T08:48:37.307 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-25T08:48:37.307 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-25T08:48:37.307 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-25T08:48:37.307 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-25T08:48:37.307 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-25T08:48:37.307 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-25T08:48:37.307 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-25T08:48:37.308 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-25T08:48:37.308 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-25T08:48:37.308 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-25T08:48:37.308 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-25T08:48:37.308 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-25T08:48:37.308 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-25T08:48:37.308 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-25T08:48:37.308 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-25T08:48:37.308 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-25T08:48:37.308 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-25T08:48:37.308 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-25T08:48:37.308 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-25T08:48:37.309 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-25T08:48:37.309 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-25T08:48:37.309 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-25T08:48:37.309 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-25T08:48:37.309 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-25T08:48:37.309 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-25T08:48:37.309 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-25T08:48:37.309 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-25T08:48:37.309 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-25T08:48:37.309 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-25T08:48:37.309 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-25T08:48:37.309 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-25T08:48:37.309 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-25T08:48:37.309 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-25T08:48:37.310 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-25T08:48:37.310 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-25T08:48:37.310 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-25T08:48:37.310 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-25T08:48:37.310 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-25T08:48:37.310 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-25T08:48:37.310 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-25T08:48:37.310 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-25T08:48:37.310 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-25T08:48:37.310 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-25T08:48:37.310 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-25T08:48:37.310 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-25T08:48:37.311 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-25T08:48:37.311 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-25T08:48:37.311 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-25T08:48:37.311 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-25T08:48:37.311 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-25T08:48:37.311 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-25T08:48:37.311 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-25T08:48:37.311 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-25T08:48:37.311 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-25T08:48:37.311 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-25T08:48:37.311 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-25T08:48:37.311 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-25T08:48:37.312 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-25T08:48:37.312 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-25T08:48:37.312 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-25T08:48:37.312 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-25T08:48:37.312 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-25T08:48:37.312 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-25T08:48:37.312 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-25T08:48:37.312 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-25T08:48:37.312 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-25T08:48:37.312 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-25T08:48:37.312 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-25T08:48:37.312 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-25T08:48:37.312 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-25T08:48:37.313 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-25T08:48:37.313 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-25T08:48:37.313 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-25T08:48:37.313 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-25T08:48:37.313 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-25T08:48:37.313 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-25T08:48:37.313 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-25T08:48:37.313 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-25T08:48:37.313 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-25T08:48:37.313 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-25T08:48:37.313 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-25T08:48:37.313 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-25T08:48:37.313 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-25T08:48:37.314 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-25T08:48:37.314 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-25T08:48:37.314 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-25T08:48:37.314 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-25T08:48:37.314 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-25T08:48:37.314 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-25T08:48:37.314 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-25T08:48:37.314 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-25T08:48:37.314 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-25T08:48:37.314 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-25T08:48:37.314 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-25T08:48:37.314 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-25T08:48:37.315 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-25T08:48:37.315 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-25T08:48:37.315 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-25T08:48:37.315 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-25T08:48:37.315 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-25T08:48:37.315 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-25T08:48:37.315 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-25T08:48:37.315 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-25T08:48:37.315 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-25T08:48:37.315 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-25T08:48:37.315 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-25T08:48:37.315 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-25T08:48:37.316 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-25T08:48:37.316 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-25T08:48:37.316 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-25T08:48:37.316 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-25T08:48:37.316 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-25T08:48:37.316 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-25T08:48:37.316 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-25T08:48:37.316 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-25T08:48:37.316 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-25T08:48:37.316 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-25T08:48:37.316 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-25T08:48:37.316 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-25T08:48:37.317 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-25T08:48:37.317 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-25T08:48:37.317 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-25T08:48:37.317 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-25T08:48:37.317 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-25T08:48:37.317 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-25T08:48:37.317 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-25T08:48:37.317 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-25T08:48:37.317 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-25T08:48:37.317 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-25T08:48:37.317 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-25T08:48:37.317 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-25T08:48:37.317 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-25T08:48:37.318 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-25T08:48:37.318 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-25T08:48:37.318 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-25T08:48:37.318 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-25T08:48:37.318 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-25T08:48:37.318 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-25T08:48:37.318 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-25T08:48:37.318 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-25T08:48:37.318 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-25T08:48:37.318 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-25T08:48:37.318 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-25T08:48:37.318 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-25T08:48:37.319 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-25T08:48:37.319 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-25T08:48:37.319 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-25T08:48:37.319 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-25T08:48:37.319 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-25T08:48:37.319 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-25T08:48:37.319 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-25T08:48:37.319 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-25T08:48:37.319 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-25T08:48:37.319 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-25T08:48:37.319 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-25T08:48:37.319 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-25T08:48:37.319 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-25T08:48:37.320 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-25T08:48:37.320 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-25T08:48:37.320 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-25T08:48:37.320 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-25T08:48:37.320 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-25T08:48:37.320 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-25T08:48:37.320 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-25T08:48:37.320 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-25T08:48:37.320 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-25T08:48:37.320 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-25T08:48:37.320 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-25T08:48:37.320 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-25T08:48:37.321 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-25T08:48:37.321 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-25T08:48:37.321 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-25T08:48:37.321 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-25T08:48:37.321 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-25T08:48:37.321 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-25T08:48:37.321 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-25T08:48:37.321 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-25T08:48:37.321 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-25T08:48:37.321 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-25T08:48:37.321 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-25T08:48:37.322 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-25T08:48:37.322 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-25T08:48:37.322 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-25T08:48:37.322 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-25T08:48:37.322 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-25T08:48:37.322 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-25T08:48:37.322 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-25T08:48:37.322 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-25T08:48:37.322 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-25T08:48:37.322 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-25T08:48:37.322 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-25T08:48:37.322 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-25T08:48:37.323 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-25T08:48:37.323 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-25T08:48:37.323 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-25T08:48:37.323 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-25T08:48:37.323 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-25T08:48:37.323 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-25T08:48:37.323 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-25T08:48:37.323 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-25T08:48:37.323 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-25T08:48:37.323 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-25T08:48:37.323 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-25T08:48:37.323 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-25T08:48:37.323 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-25T08:48:37.324 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-25T08:48:37.324 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-25T08:48:37.324 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-25T08:48:37.324 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-25T08:48:37.324 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-25T08:48:37.324 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-25T08:48:37.324 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-25T08:48:37.324 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-25T08:48:37.324 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-25T08:48:37.324 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-25T08:48:37.324 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-25T08:48:37.324 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-25T08:48:37.324 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-25T08:48:37.325 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-25T08:48:37.325 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-25T08:48:37.325 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-25T08:48:37.325 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-25T08:48:37.325 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-25T08:48:37.325 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-25T08:48:37.325 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-25T08:48:37.325 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-25T08:48:37.325 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-25T08:48:37.325 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-25T08:48:37.325 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-25T08:48:37.325 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-25T08:48:37.325 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-25T08:48:37.326 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-25T08:48:37.326 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-25T08:48:37.326 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-25T08:48:37.326 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-25T08:48:37.326 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-25T08:48:37.326 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-25T08:48:37.326 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-25T08:48:37.326 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-25T08:48:37.326 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-25T08:48:37.326 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-25T08:48:37.326 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-25T08:48:37.326 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-25T08:48:37.326 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-25T08:48:37.327 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-25T08:48:37.327 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-25T08:48:37.327 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-25T08:48:37.327 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-25T08:48:37.327 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-25T08:48:37.327 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-25T08:48:37.327 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-25T08:48:37.327 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-25T08:48:37.327 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-25T08:48:37.327 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-25T08:48:37.327 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-25T08:48:37.327 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-25T08:48:37.328 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-25T08:48:37.328 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-25T08:48:37.328 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-25T08:48:37.328 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-25T08:48:37.328 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-25T08:48:37.328 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-25T08:48:37.328 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-25T08:48:37.328 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-25T08:48:37.328 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-25T08:48:37.328 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-25T08:48:37.328 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-25T08:48:37.328 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-25T08:48:37.328 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-25T08:48:37.329 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-25T08:48:37.329 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-25T08:48:37.329 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-25T08:48:37.329 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-25T08:48:37.329 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-25T08:48:37.329 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-25T08:48:37.329 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-25T08:48:37.329 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-25T08:48:37.329 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-25T08:48:37.329 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-25T08:48:37.329 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-25T08:48:37.329 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-25T08:48:37.329 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-25T08:48:37.330 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-25T08:48:37.330 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-25T08:48:37.330 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-25T08:48:37.330 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-25T08:48:37.330 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-25T08:48:37.330 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-25T08:48:37.330 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-25T08:48:37.330 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-25T08:48:37.330 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-25T08:48:37.330 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-25T08:48:37.330 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-25T08:48:37.331 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-25T08:48:37.331 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-25T08:48:37.331 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-25T08:48:37.331 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-25T08:48:37.331 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-25T08:48:37.331 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-25T08:48:37.331 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-25T08:48:37.331 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-25T08:48:37.331 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-25T08:48:37.331 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-25T08:48:37.331 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-25T08:48:37.331 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-25T08:48:37.332 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-25T08:48:37.332 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-25T08:48:37.332 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-25T08:48:37.332 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-25T08:48:37.332 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-25T08:48:37.332 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-25T08:48:37.332 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-25T08:48:37.332 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-25T08:48:37.332 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-25T08:48:37.332 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-25T08:48:37.332 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-25T08:48:37.332 INFO:teuthology.orchestra.run.smithi194.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-25T08:48:37.332 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-25T08:48:37.333 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-25T08:48:37.338 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:37.338 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:37.338 DEBUG:teuthology.orchestra.run.smithi194:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-25T08:48:37.349 INFO:teuthology.orchestra.run.smithi194.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T08:48:37.349 INFO:teuthology.orchestra.run.smithi194.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T08:48:37.349 INFO:teuthology.orchestra.run.smithi194.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T08:48:37.349 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-25T08:48:37.350 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:37.350 DEBUG:teuthology.orchestra.run.smithi194:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-25T08:48:37.407 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi194.front.sepia.ceph.com to complete... 2024-04-25T08:48:37.518 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-25T08:48:37.518 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-25T08:48:37.519 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-25T08:48:37.519 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-25T08:48:37.519 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-25T08:48:37.519 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-25T08:48:37.519 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-25T08:48:37.519 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-25T08:48:37.519 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-25T08:48:37.519 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-25T08:48:37.519 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-25T08:48:37.519 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-25T08:48:37.519 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-25T08:48:37.519 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-25T08:48:37.520 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-25T08:48:37.520 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-25T08:48:37.520 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-25T08:48:37.520 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-25T08:48:37.520 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-25T08:48:37.520 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-25T08:48:37.520 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-25T08:48:37.520 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-25T08:48:37.520 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-25T08:48:37.520 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-25T08:48:37.520 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-25T08:48:37.520 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-25T08:48:37.521 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-25T08:48:37.521 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-25T08:48:37.521 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-25T08:48:37.521 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-25T08:48:37.521 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-25T08:48:37.521 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-25T08:48:37.521 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-25T08:48:37.521 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-25T08:48:37.521 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-25T08:48:37.521 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-25T08:48:37.521 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-25T08:48:37.522 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-25T08:48:37.522 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-25T08:48:37.522 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-25T08:48:37.522 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-25T08:48:37.522 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-25T08:48:37.522 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-25T08:48:37.522 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-25T08:48:37.522 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-25T08:48:37.522 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-25T08:48:37.522 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-25T08:48:37.522 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-25T08:48:37.522 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-25T08:48:37.523 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-25T08:48:37.523 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-25T08:48:37.523 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-25T08:48:37.523 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-25T08:48:37.523 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-25T08:48:37.523 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-25T08:48:37.523 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-25T08:48:37.523 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-25T08:48:37.523 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-25T08:48:37.523 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-25T08:48:37.523 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-25T08:48:37.523 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-25T08:48:37.523 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-25T08:48:37.524 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-25T08:48:37.524 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-25T08:48:37.524 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-25T08:48:37.524 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-25T08:48:37.524 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-25T08:48:37.524 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-25T08:48:37.524 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-25T08:48:37.524 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-25T08:48:37.524 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-25T08:48:37.524 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-25T08:48:37.524 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-25T08:48:37.524 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-25T08:48:37.525 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-25T08:48:37.525 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-25T08:48:37.525 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-25T08:48:37.525 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-25T08:48:37.525 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-25T08:48:37.525 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-25T08:48:37.525 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-25T08:48:37.525 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-25T08:48:37.525 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-25T08:48:37.525 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-25T08:48:37.525 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-25T08:48:37.525 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-25T08:48:37.526 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-25T08:48:37.526 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-25T08:48:37.526 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-25T08:48:37.526 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-25T08:48:37.526 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-25T08:48:37.526 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-25T08:48:37.526 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-25T08:48:37.526 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-25T08:48:37.526 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-25T08:48:37.526 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-25T08:48:37.526 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-25T08:48:37.526 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-25T08:48:37.527 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-25T08:48:37.527 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-25T08:48:37.527 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-25T08:48:37.527 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-25T08:48:37.527 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-25T08:48:37.527 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-25T08:48:37.527 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-25T08:48:37.527 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-25T08:48:37.527 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-25T08:48:37.527 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-25T08:48:37.527 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-25T08:48:37.527 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-25T08:48:37.527 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-25T08:48:37.528 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-25T08:48:37.528 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-25T08:48:37.528 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-25T08:48:37.528 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-25T08:48:37.528 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-25T08:48:37.528 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-25T08:48:37.528 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-25T08:48:37.528 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-25T08:48:37.528 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-25T08:48:37.528 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-25T08:48:37.528 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-25T08:48:37.528 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-25T08:48:37.528 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-25T08:48:37.529 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-25T08:48:37.529 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-25T08:48:37.529 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-25T08:48:37.529 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-25T08:48:37.529 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-25T08:48:37.529 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-25T08:48:37.529 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-25T08:48:37.529 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-25T08:48:37.529 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-25T08:48:37.529 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-25T08:48:37.529 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-25T08:48:37.529 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-25T08:48:37.530 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-25T08:48:37.530 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-25T08:48:37.530 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-25T08:48:37.530 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-25T08:48:37.530 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-25T08:48:37.530 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-25T08:48:37.530 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-25T08:48:37.530 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-25T08:48:37.530 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-25T08:48:37.530 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-25T08:48:37.530 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-25T08:48:37.531 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-25T08:48:37.531 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-25T08:48:37.531 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-25T08:48:37.531 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-25T08:48:37.531 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-25T08:48:37.531 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-25T08:48:37.531 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-25T08:48:37.531 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-25T08:48:37.531 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-25T08:48:37.531 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-25T08:48:37.531 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-25T08:48:37.531 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-25T08:48:37.532 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-25T08:48:37.532 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-25T08:48:37.532 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-25T08:48:37.532 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-25T08:48:37.532 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-25T08:48:37.532 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-25T08:48:37.532 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-25T08:48:37.532 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-25T08:48:37.532 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-25T08:48:37.532 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-25T08:48:37.532 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-25T08:48:37.532 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-25T08:48:37.532 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-25T08:48:37.533 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-25T08:48:37.533 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-25T08:48:37.533 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-25T08:48:37.533 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-25T08:48:37.533 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-25T08:48:37.533 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-25T08:48:37.533 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-25T08:48:37.533 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-25T08:48:37.533 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-25T08:48:37.533 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-25T08:48:37.533 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-25T08:48:37.533 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-25T08:48:37.534 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-25T08:48:37.534 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-25T08:48:37.534 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-25T08:48:37.534 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-25T08:48:37.534 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-25T08:48:37.534 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-25T08:48:37.534 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-25T08:48:37.534 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-25T08:48:37.534 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-25T08:48:37.534 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-25T08:48:37.534 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-25T08:48:37.534 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-25T08:48:37.535 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-25T08:48:37.535 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-25T08:48:37.535 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-25T08:48:37.535 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-25T08:48:37.535 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-25T08:48:37.535 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-25T08:48:37.535 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-25T08:48:37.535 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-25T08:48:37.535 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-25T08:48:37.535 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-25T08:48:37.535 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-25T08:48:37.535 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-25T08:48:37.536 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-25T08:48:37.536 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-25T08:48:37.536 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-25T08:48:37.536 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-25T08:48:37.536 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-25T08:48:37.536 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-25T08:48:37.536 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-25T08:48:37.536 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-25T08:48:37.536 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-25T08:48:37.536 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-25T08:48:37.536 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-25T08:48:37.536 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-25T08:48:37.536 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-25T08:48:37.537 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-25T08:48:37.537 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-25T08:48:37.537 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-25T08:48:37.537 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-25T08:48:37.537 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-25T08:48:37.537 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-25T08:48:37.537 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-25T08:48:37.537 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-25T08:48:37.537 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-25T08:48:37.537 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-25T08:48:37.537 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-25T08:48:37.537 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-25T08:48:37.538 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-25T08:48:37.538 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-25T08:48:37.538 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-25T08:48:37.538 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-25T08:48:37.538 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-25T08:48:37.538 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-25T08:48:37.538 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-25T08:48:37.538 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-25T08:48:37.538 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-25T08:48:37.538 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-25T08:48:37.538 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-25T08:48:37.539 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-25T08:48:37.539 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-25T08:48:37.539 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-25T08:48:37.539 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-25T08:48:37.539 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-25T08:48:37.539 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-25T08:48:37.539 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-25T08:48:37.539 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-25T08:48:37.539 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-25T08:48:37.539 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-25T08:48:37.539 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-25T08:48:37.539 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-25T08:48:37.539 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-25T08:48:37.540 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-25T08:48:37.540 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-25T08:48:37.540 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-25T08:48:37.540 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-25T08:48:37.540 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-25T08:48:37.540 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-25T08:48:37.540 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-25T08:48:37.540 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-25T08:48:37.540 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-25T08:48:37.540 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-25T08:48:37.540 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-25T08:48:37.540 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-25T08:48:37.541 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-25T08:48:37.541 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-25T08:48:37.541 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-25T08:48:37.541 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-25T08:48:37.541 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-25T08:48:37.541 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-25T08:48:37.541 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-25T08:48:37.541 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-25T08:48:37.541 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-25T08:48:37.541 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-25T08:48:37.541 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-25T08:48:37.541 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-25T08:48:37.542 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-25T08:48:37.542 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-25T08:48:37.542 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-25T08:48:37.542 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-25T08:48:37.542 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-25T08:48:37.542 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-25T08:48:37.542 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-25T08:48:37.542 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-25T08:48:37.542 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-25T08:48:37.542 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-25T08:48:37.542 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-25T08:48:37.542 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-25T08:48:37.543 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-25T08:48:37.543 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-25T08:48:37.543 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-25T08:48:37.543 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-25T08:48:37.543 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-25T08:48:37.543 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-25T08:48:37.543 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-25T08:48:37.543 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-25T08:48:37.543 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-25T08:48:37.543 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-25T08:48:37.543 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-25T08:48:37.543 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-25T08:48:37.543 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-25T08:48:37.543 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-25T08:48:37.544 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-25T08:48:37.544 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-25T08:48:37.544 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-25T08:48:37.544 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-25T08:48:37.544 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-25T08:48:37.544 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-25T08:48:37.544 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-25T08:48:37.544 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-25T08:48:37.544 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-25T08:48:37.544 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-25T08:48:37.544 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-25T08:48:37.544 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-25T08:48:37.544 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-25T08:48:37.544 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-25T08:48:37.545 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-25T08:48:37.545 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-25T08:48:37.545 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-25T08:48:37.545 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-25T08:48:37.545 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-25T08:48:37.545 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-25T08:48:37.545 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-25T08:48:37.545 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-25T08:48:37.545 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-25T08:48:37.545 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-25T08:48:37.545 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-25T08:48:37.545 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-25T08:48:37.545 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-25T08:48:37.546 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-25T08:48:37.546 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-25T08:48:37.546 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-25T08:48:37.546 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-25T08:48:37.546 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-25T08:48:37.546 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-25T08:48:37.546 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-25T08:48:37.546 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-25T08:48:37.546 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-25T08:48:37.546 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-25T08:48:37.546 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-25T08:48:37.546 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-25T08:48:37.547 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-25T08:48:37.547 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-25T08:48:37.547 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-25T08:48:37.547 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-25T08:48:37.547 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-25T08:48:37.547 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-25T08:48:37.547 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-25T08:48:37.547 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-25T08:48:37.547 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-25T08:48:37.547 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-25T08:48:37.547 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-25T08:48:37.547 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-25T08:48:37.548 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-25T08:48:37.548 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-25T08:48:37.548 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-25T08:48:37.548 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-25T08:48:37.548 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-25T08:48:37.548 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-25T08:48:37.548 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-25T08:48:37.548 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-25T08:48:37.548 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-25T08:48:37.548 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-25T08:48:37.548 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-25T08:48:37.548 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-25T08:48:37.548 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-25T08:48:37.548 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-25T08:48:37.549 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-25T08:48:37.549 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-25T08:48:37.549 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-25T08:48:37.549 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-25T08:48:37.549 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-25T08:48:37.549 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-25T08:48:37.549 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-25T08:48:37.549 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-25T08:48:37.549 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-25T08:48:37.549 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-25T08:48:37.549 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-25T08:48:37.549 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-25T08:48:37.549 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-25T08:48:37.550 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-25T08:48:37.550 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-25T08:48:37.550 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-25T08:48:37.550 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-25T08:48:37.550 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-25T08:48:37.550 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-25T08:48:37.550 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-25T08:48:37.550 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-25T08:48:37.550 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-25T08:48:37.550 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-25T08:48:37.550 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-25T08:48:37.551 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-25T08:48:37.551 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-25T08:48:37.551 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-25T08:48:37.551 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-25T08:48:37.551 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-25T08:48:37.551 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-25T08:48:37.551 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-25T08:48:37.551 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-25T08:48:37.551 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-25T08:48:37.551 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-25T08:48:37.551 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-25T08:48:37.551 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-25T08:48:37.552 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-25T08:48:37.552 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-25T08:48:37.552 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-25T08:48:37.552 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-25T08:48:37.552 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-25T08:48:37.552 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-25T08:48:37.552 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-25T08:48:37.552 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-25T08:48:37.552 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-25T08:48:37.552 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-25T08:48:37.552 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-25T08:48:37.552 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-25T08:48:37.553 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-25T08:48:37.553 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-25T08:48:37.553 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-25T08:48:37.553 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-25T08:48:37.553 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-25T08:48:37.553 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-25T08:48:37.553 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-25T08:48:37.553 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-25T08:48:37.553 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-25T08:48:37.553 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-25T08:48:37.553 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-25T08:48:37.553 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-25T08:48:37.554 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-25T08:48:37.554 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-25T08:48:37.554 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-25T08:48:37.554 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-25T08:48:37.554 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-25T08:48:37.554 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-25T08:48:37.554 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-25T08:48:37.554 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-25T08:48:37.554 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-25T08:48:37.554 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-25T08:48:37.554 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-25T08:48:37.554 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-25T08:48:37.555 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-25T08:48:37.555 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-25T08:48:37.555 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-25T08:48:37.555 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-25T08:48:37.555 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-25T08:48:37.555 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-25T08:48:37.555 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-25T08:48:37.555 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-25T08:48:37.555 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-25T08:48:37.555 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-25T08:48:37.555 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-25T08:48:37.555 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-25T08:48:37.555 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-25T08:48:37.556 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-25T08:48:37.556 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-25T08:48:37.556 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-25T08:48:37.556 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-25T08:48:37.556 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-25T08:48:37.556 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-25T08:48:37.556 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-25T08:48:37.556 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-25T08:48:37.556 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-25T08:48:37.556 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-25T08:48:37.556 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-25T08:48:37.556 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-25T08:48:37.556 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-25T08:48:37.556 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-25T08:48:37.557 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-25T08:48:37.557 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-25T08:48:37.557 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-25T08:48:37.557 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-25T08:48:37.557 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-25T08:48:37.557 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-25T08:48:37.557 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-25T08:48:37.557 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-25T08:48:37.557 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-25T08:48:37.557 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-25T08:48:37.557 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-25T08:48:37.557 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-25T08:48:37.557 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-25T08:48:37.557 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-25T08:48:37.558 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-25T08:48:37.558 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-25T08:48:37.558 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-25T08:48:37.558 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-25T08:48:37.558 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-25T08:48:37.558 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-25T08:48:37.558 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-25T08:48:37.558 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-25T08:48:37.558 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-25T08:48:37.558 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-25T08:48:37.559 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-25T08:48:37.559 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-25T08:48:37.559 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-25T08:48:37.559 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-25T08:48:37.559 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-25T08:48:37.559 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-25T08:48:37.559 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-25T08:48:37.559 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-25T08:48:37.559 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-25T08:48:37.559 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-25T08:48:37.559 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-25T08:48:37.559 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-25T08:48:37.560 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-25T08:48:37.560 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-25T08:48:37.560 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-25T08:48:37.560 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-25T08:48:37.560 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-25T08:48:37.560 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-25T08:48:37.560 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-25T08:48:37.560 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-25T08:48:37.560 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-25T08:48:37.560 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-25T08:48:37.560 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-25T08:48:37.560 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-25T08:48:37.561 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-25T08:48:37.561 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-25T08:48:37.561 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-25T08:48:37.561 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-25T08:48:37.561 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-25T08:48:37.561 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-25T08:48:37.561 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-25T08:48:37.561 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-25T08:48:37.561 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-25T08:48:37.561 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-25T08:48:37.561 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-25T08:48:37.561 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-25T08:48:37.562 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-25T08:48:37.562 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-25T08:48:37.562 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-25T08:48:37.562 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-25T08:48:37.562 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-25T08:48:37.562 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-25T08:48:37.562 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-25T08:48:37.562 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-25T08:48:37.562 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-25T08:48:37.562 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-25T08:48:37.562 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-25T08:48:37.562 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-25T08:48:37.563 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-25T08:48:37.563 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-25T08:48:37.563 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-25T08:48:37.563 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-25T08:48:37.563 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-25T08:48:37.563 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-25T08:48:37.563 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-25T08:48:37.563 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-25T08:48:37.563 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-25T08:48:37.563 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-25T08:48:37.563 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-25T08:48:37.563 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-25T08:48:37.564 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-25T08:48:37.564 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-25T08:48:37.564 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-25T08:48:37.564 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-25T08:48:37.564 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-25T08:48:37.564 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-25T08:48:37.564 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-25T08:48:37.564 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-25T08:48:37.564 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-25T08:48:37.564 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-25T08:48:37.564 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-25T08:48:37.564 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-25T08:48:37.564 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-25T08:48:37.565 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-25T08:48:37.565 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-25T08:48:37.565 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-25T08:48:37.565 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-25T08:48:37.565 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-25T08:48:37.565 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-25T08:48:37.565 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-25T08:48:37.565 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-25T08:48:37.565 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-25T08:48:37.565 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-25T08:48:37.565 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-25T08:48:37.565 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-25T08:48:37.565 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-25T08:48:37.566 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-25T08:48:37.566 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-25T08:48:37.566 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-25T08:48:37.566 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-25T08:48:37.566 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-25T08:48:37.566 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-25T08:48:37.566 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-25T08:48:37.566 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-25T08:48:37.566 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-25T08:48:37.566 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-25T08:48:37.566 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-25T08:48:37.567 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-25T08:48:37.567 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-25T08:48:37.567 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-25T08:48:37.567 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-25T08:48:37.567 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-25T08:48:37.567 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-25T08:48:37.567 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-25T08:48:37.567 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-25T08:48:37.567 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-25T08:48:37.567 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-25T08:48:37.567 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-25T08:48:37.567 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-25T08:48:37.568 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-25T08:48:37.568 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-25T08:48:37.568 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-25T08:48:37.568 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-25T08:48:37.568 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-25T08:48:37.568 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-25T08:48:37.568 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-25T08:48:37.568 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-25T08:48:37.568 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-25T08:48:37.568 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-25T08:48:37.568 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-25T08:48:37.568 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-25T08:48:37.568 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-25T08:48:37.569 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-25T08:48:37.569 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-25T08:48:37.569 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-25T08:48:37.569 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-25T08:48:37.569 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-25T08:48:37.569 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-25T08:48:37.569 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-25T08:48:37.569 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-25T08:48:37.569 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-25T08:48:37.569 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-25T08:48:37.569 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-25T08:48:37.569 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-25T08:48:37.569 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-25T08:48:37.570 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-25T08:48:37.570 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-25T08:48:37.570 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-25T08:48:37.570 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-25T08:48:37.570 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-25T08:48:37.570 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-25T08:48:37.570 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-25T08:48:37.570 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-25T08:48:37.570 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-25T08:48:37.570 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-25T08:48:37.570 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-25T08:48:37.571 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-25T08:48:37.571 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-25T08:48:37.571 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-25T08:48:37.571 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-25T08:48:37.571 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-25T08:48:37.571 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-25T08:48:37.571 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-25T08:48:37.571 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-25T08:48:37.571 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-25T08:48:37.571 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-25T08:48:37.571 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-25T08:48:37.571 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-25T08:48:37.572 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-25T08:48:37.572 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-25T08:48:37.572 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-25T08:48:37.572 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-25T08:48:37.572 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-25T08:48:37.572 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-25T08:48:37.572 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-25T08:48:37.572 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-25T08:48:37.572 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-25T08:48:37.572 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-25T08:48:37.572 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-25T08:48:37.572 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-25T08:48:37.573 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-25T08:48:37.573 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-25T08:48:37.573 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-25T08:48:37.573 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-25T08:48:37.573 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-25T08:48:37.573 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-25T08:48:37.573 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-25T08:48:37.573 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-25T08:48:37.573 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-25T08:48:37.573 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-25T08:48:37.573 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-25T08:48:37.573 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-25T08:48:37.574 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-25T08:48:37.574 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-25T08:48:37.574 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-25T08:48:37.574 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-25T08:48:37.574 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-25T08:48:37.574 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-25T08:48:37.574 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-25T08:48:37.574 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-25T08:48:37.574 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-25T08:48:37.574 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-25T08:48:37.575 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-25T08:48:37.575 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-25T08:48:37.575 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-25T08:48:37.575 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-25T08:48:37.575 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-25T08:48:37.575 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-25T08:48:37.575 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-25T08:48:37.575 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-25T08:48:37.575 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-25T08:48:37.575 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-25T08:48:37.575 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-25T08:48:37.575 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-25T08:48:37.576 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-25T08:48:37.576 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-25T08:48:37.576 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-25T08:48:37.576 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-25T08:48:37.576 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-25T08:48:37.576 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-25T08:48:37.576 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-25T08:48:37.576 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-25T08:48:37.576 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-25T08:48:37.576 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-25T08:48:37.576 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-25T08:48:37.576 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-25T08:48:37.577 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-25T08:48:37.577 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-25T08:48:37.577 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-25T08:48:37.577 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-25T08:48:37.577 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-25T08:48:37.577 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-25T08:48:37.577 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-25T08:48:37.577 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-25T08:48:37.577 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-25T08:48:37.577 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-25T08:48:37.577 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-25T08:48:37.578 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-25T08:48:37.578 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-25T08:48:37.578 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-25T08:48:37.578 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-25T08:48:37.578 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-25T08:48:37.578 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-25T08:48:37.578 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-25T08:48:37.578 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-25T08:48:37.578 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-25T08:48:37.578 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-25T08:48:37.578 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-25T08:48:37.579 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-25T08:48:37.579 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-25T08:48:37.579 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-25T08:48:37.579 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-25T08:48:37.579 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-25T08:48:37.579 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-25T08:48:37.579 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-25T08:48:37.579 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-25T08:48:37.579 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-25T08:48:37.579 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-25T08:48:37.579 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-25T08:48:37.579 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-25T08:48:37.579 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-25T08:48:37.580 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-25T08:48:37.580 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-25T08:48:37.580 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-25T08:48:37.580 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-25T08:48:37.580 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-25T08:48:37.580 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-25T08:48:37.580 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-25T08:48:37.580 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-25T08:48:37.580 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-25T08:48:37.580 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-25T08:48:37.580 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-25T08:48:37.580 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-25T08:48:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-25T08:48:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-25T08:48:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-25T08:48:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-25T08:48:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-25T08:48:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-25T08:48:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-25T08:48:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-25T08:48:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-25T08:48:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-25T08:48:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-25T08:48:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-25T08:48:37.582 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-25T08:48:37.582 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-25T08:48:37.582 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-25T08:48:37.582 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-25T08:48:37.582 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-25T08:48:37.582 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-25T08:48:37.582 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-25T08:48:37.582 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-25T08:48:37.582 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-25T08:48:37.582 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-25T08:48:37.582 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-25T08:48:37.582 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-25T08:48:37.583 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-25T08:48:37.583 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-25T08:48:37.583 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-25T08:48:37.583 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-25T08:48:37.583 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-25T08:48:37.583 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-25T08:48:37.583 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-25T08:48:37.583 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-25T08:48:37.583 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-25T08:48:37.583 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-25T08:48:37.583 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-25T08:48:37.583 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-25T08:48:37.583 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-25T08:48:37.584 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-25T08:48:37.584 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-25T08:48:37.584 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-25T08:48:37.584 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-25T08:48:37.584 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-25T08:48:37.584 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-25T08:48:37.584 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-25T08:48:37.584 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-25T08:48:37.584 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-25T08:48:37.584 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-25T08:48:37.584 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-25T08:48:37.584 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-25T08:48:37.585 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-25T08:48:37.585 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-25T08:48:37.585 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-25T08:48:37.585 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-25T08:48:37.585 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-25T08:48:37.585 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-25T08:48:37.585 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-25T08:48:37.585 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-25T08:48:37.585 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-25T08:48:37.585 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-25T08:48:37.585 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-25T08:48:37.585 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-25T08:48:37.585 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-25T08:48:37.586 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-25T08:48:37.586 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-25T08:48:37.586 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-25T08:48:37.586 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-25T08:48:37.586 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-25T08:48:37.586 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-25T08:48:37.586 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-25T08:48:37.586 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-25T08:48:37.586 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-25T08:48:37.586 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-25T08:48:37.586 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-25T08:48:37.587 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-25T08:48:37.587 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-25T08:48:37.587 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-25T08:48:37.587 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-25T08:48:37.587 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-25T08:48:37.587 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-25T08:48:37.587 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-25T08:48:37.587 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-25T08:48:37.587 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-25T08:48:37.587 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-25T08:48:37.587 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-25T08:48:37.587 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-25T08:48:37.588 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-25T08:48:37.588 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-25T08:48:37.588 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-25T08:48:37.588 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-25T08:48:37.588 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-25T08:48:37.588 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-25T08:48:37.588 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-25T08:48:37.588 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-25T08:48:37.588 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-25T08:48:37.588 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-25T08:48:37.588 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-25T08:48:37.588 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-25T08:48:37.588 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-25T08:48:37.589 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-25T08:48:37.589 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-25T08:48:37.589 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-25T08:48:37.589 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-25T08:48:37.589 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-25T08:48:37.589 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-25T08:48:37.589 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-25T08:48:37.589 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-25T08:48:37.589 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-25T08:48:37.589 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-25T08:48:37.589 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-25T08:48:37.589 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-25T08:48:37.589 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-25T08:48:37.590 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-25T08:48:37.590 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-25T08:48:37.590 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-25T08:48:37.590 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-25T08:48:37.590 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-25T08:48:37.590 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-25T08:48:37.590 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-25T08:48:37.590 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-25T08:48:37.590 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-25T08:48:37.590 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-25T08:48:37.590 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-25T08:48:37.591 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-25T08:48:37.591 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-25T08:48:37.591 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-25T08:48:37.591 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-25T08:48:37.591 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-25T08:48:37.591 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-25T08:48:37.591 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-25T08:48:37.591 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-25T08:48:37.591 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-25T08:48:37.591 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-25T08:48:37.591 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-25T08:48:37.591 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-25T08:48:37.591 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-25T08:48:37.592 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-25T08:48:37.592 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-25T08:48:37.592 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-25T08:48:37.592 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-25T08:48:37.592 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-25T08:48:37.592 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-25T08:48:37.592 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-25T08:48:37.592 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-25T08:48:37.592 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-25T08:48:37.592 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-25T08:48:37.592 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-25T08:48:37.592 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-25T08:48:37.592 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-25T08:48:37.592 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-25T08:48:37.593 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-25T08:48:37.593 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-25T08:48:37.593 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-25T08:48:37.593 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-25T08:48:37.593 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-25T08:48:37.593 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-25T08:48:37.593 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-25T08:48:37.593 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-25T08:48:37.593 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-25T08:48:37.593 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-25T08:48:37.593 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-25T08:48:37.593 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-25T08:48:37.594 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-25T08:48:37.594 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-25T08:48:37.594 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-25T08:48:37.594 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-25T08:48:37.594 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-25T08:48:37.594 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-25T08:48:37.594 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-25T08:48:37.594 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-25T08:48:37.594 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-25T08:48:37.594 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-25T08:48:37.594 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-25T08:48:37.594 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-25T08:48:37.594 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-25T08:48:37.595 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-25T08:48:37.595 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-25T08:48:37.595 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-25T08:48:37.595 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-25T08:48:37.595 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-25T08:48:37.595 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-25T08:48:37.595 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-25T08:48:37.595 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-25T08:48:37.595 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-25T08:48:37.595 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-25T08:48:37.595 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-25T08:48:37.595 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-25T08:48:37.595 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-25T08:48:37.595 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-25T08:48:37.596 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-25T08:48:37.596 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-25T08:48:37.596 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-25T08:48:37.596 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-25T08:48:37.596 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-25T08:48:37.596 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-25T08:48:37.596 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-25T08:48:37.596 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-25T08:48:37.596 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-25T08:48:37.596 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-25T08:48:37.596 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-25T08:48:37.596 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-25T08:48:37.596 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-25T08:48:37.597 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-25T08:48:37.597 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-25T08:48:37.597 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-25T08:48:37.597 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-25T08:48:37.597 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-25T08:48:37.597 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-25T08:48:37.597 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-25T08:48:37.597 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-25T08:48:37.597 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-25T08:48:37.597 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-25T08:48:37.597 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-25T08:48:37.597 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-25T08:48:37.597 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-25T08:48:37.598 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-25T08:48:37.598 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-25T08:48:37.598 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-25T08:48:37.598 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-25T08:48:37.598 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-25T08:48:37.598 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-25T08:48:37.598 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-25T08:48:37.598 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-25T08:48:37.598 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-25T08:48:37.598 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-25T08:48:37.598 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-25T08:48:37.598 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-25T08:48:37.599 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-25T08:48:37.599 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-25T08:48:37.599 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-25T08:48:37.599 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-25T08:48:37.599 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-25T08:48:37.599 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-25T08:48:37.599 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-25T08:48:37.599 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-25T08:48:37.599 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-25T08:48:37.599 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-25T08:48:37.599 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-25T08:48:37.602 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-25T08:48:37.602 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-25T08:48:37.602 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-25T08:48:37.602 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-25T08:48:37.602 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-25T08:48:37.602 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-25T08:48:37.602 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-25T08:48:37.602 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-25T08:48:37.602 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-25T08:48:37.603 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-25T08:48:37.603 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-25T08:48:37.603 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-25T08:48:37.603 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-25T08:48:37.603 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-25T08:48:37.603 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-25T08:48:37.603 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-25T08:48:37.603 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-25T08:48:37.603 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-25T08:48:37.603 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-25T08:48:37.603 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-25T08:48:37.603 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-25T08:48:37.603 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-25T08:48:37.604 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-25T08:48:37.604 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-25T08:48:37.604 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-25T08:48:37.604 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-25T08:48:37.604 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-25T08:48:37.604 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-25T08:48:37.604 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-25T08:48:37.604 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-25T08:48:37.604 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-25T08:48:37.604 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-25T08:48:37.604 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-25T08:48:37.604 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-25T08:48:37.605 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-25T08:48:37.605 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-25T08:48:37.605 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-25T08:48:37.605 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-25T08:48:37.605 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-25T08:48:37.605 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-25T08:48:37.605 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-25T08:48:37.605 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-25T08:48:37.605 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-25T08:48:37.605 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-25T08:48:37.605 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-25T08:48:37.605 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-25T08:48:37.606 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-25T08:48:37.606 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-25T08:48:37.606 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-25T08:48:37.606 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-25T08:48:37.606 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-25T08:48:37.606 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-25T08:48:37.606 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-25T08:48:37.606 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-25T08:48:37.606 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-25T08:48:37.606 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-25T08:48:37.606 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-25T08:48:37.606 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-25T08:48:37.606 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-25T08:48:37.607 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-25T08:48:37.607 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-25T08:48:37.607 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-25T08:48:37.607 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-25T08:48:37.607 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-25T08:48:37.607 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-25T08:48:37.607 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-25T08:48:37.607 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-25T08:48:37.607 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-25T08:48:37.607 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-25T08:48:37.607 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-25T08:48:37.607 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-25T08:48:37.607 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-25T08:48:37.608 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-25T08:48:37.608 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-25T08:48:37.608 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-25T08:48:37.608 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-25T08:48:37.608 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-25T08:48:37.608 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-25T08:48:37.608 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-25T08:48:37.608 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-25T08:48:37.608 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-25T08:48:37.608 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-25T08:48:37.608 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-25T08:48:37.608 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-25T08:48:37.608 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-25T08:48:37.609 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-25T08:48:37.609 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-25T08:48:37.609 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-25T08:48:37.609 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-25T08:48:37.609 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-25T08:48:37.609 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-25T08:48:37.609 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-25T08:48:37.609 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-25T08:48:37.609 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-25T08:48:37.609 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-25T08:48:37.609 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-25T08:48:37.609 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-25T08:48:37.609 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-25T08:48:37.609 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-25T08:48:37.610 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-25T08:48:37.610 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-25T08:48:37.610 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-25T08:48:37.610 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-25T08:48:37.610 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-25T08:48:37.610 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-25T08:48:37.610 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-25T08:48:37.610 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-25T08:48:37.610 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-25T08:48:37.610 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-25T08:48:37.610 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-25T08:48:37.610 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-25T08:48:37.611 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-25T08:48:37.611 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-25T08:48:37.611 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-25T08:48:37.611 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-25T08:48:37.611 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-25T08:48:37.611 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-25T08:48:37.611 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-25T08:48:37.611 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-25T08:48:37.611 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-25T08:48:37.611 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-25T08:48:37.611 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-25T08:48:37.611 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-25T08:48:37.611 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-25T08:48:37.612 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-25T08:48:37.612 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-25T08:48:37.612 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-25T08:48:37.612 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-25T08:48:37.612 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-25T08:48:37.612 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-25T08:48:37.612 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-25T08:48:37.612 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-25T08:48:37.612 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-25T08:48:37.612 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-25T08:48:37.612 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-25T08:48:37.612 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-25T08:48:37.612 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-25T08:48:37.613 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-25T08:48:37.613 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-25T08:48:37.613 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-25T08:48:37.613 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-25T08:48:37.613 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-25T08:48:37.613 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-25T08:48:37.613 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-25T08:48:37.613 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-25T08:48:37.613 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-25T08:48:37.613 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-25T08:48:37.613 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-25T08:48:37.613 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-25T08:48:37.614 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-25T08:48:37.614 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-25T08:48:37.614 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-25T08:48:37.614 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-25T08:48:37.614 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-25T08:48:37.614 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-25T08:48:37.614 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-25T08:48:37.614 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-25T08:48:37.614 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-25T08:48:37.614 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-25T08:48:37.614 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-25T08:48:37.615 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-25T08:48:37.615 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-25T08:48:37.615 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-25T08:48:37.615 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-25T08:48:37.615 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-25T08:48:37.615 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-25T08:48:37.615 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-25T08:48:37.615 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-25T08:48:37.615 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-25T08:48:37.615 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-25T08:48:37.615 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-25T08:48:37.615 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-25T08:48:37.616 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-25T08:48:37.616 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-25T08:48:37.616 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-25T08:48:37.616 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-25T08:48:37.616 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-25T08:48:37.616 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-25T08:48:37.616 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-25T08:48:37.616 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-25T08:48:37.616 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-25T08:48:37.616 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-25T08:48:37.616 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-25T08:48:37.616 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-25T08:48:37.616 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-25T08:48:37.616 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-25T08:48:37.617 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-25T08:48:37.617 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-25T08:48:37.617 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-25T08:48:37.617 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-25T08:48:37.617 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-25T08:48:37.617 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-25T08:48:37.617 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-25T08:48:37.617 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-25T08:48:37.617 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-25T08:48:37.617 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-25T08:48:37.617 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-25T08:48:37.617 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-25T08:48:37.618 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-25T08:48:37.618 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-25T08:48:37.618 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-25T08:48:37.618 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-25T08:48:37.618 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-25T08:48:37.618 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-25T08:48:37.618 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-25T08:48:37.618 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-25T08:48:37.618 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-25T08:48:37.618 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-25T08:48:37.618 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-25T08:48:37.618 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-25T08:48:37.619 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-25T08:48:37.619 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-25T08:48:37.619 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-25T08:48:37.619 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-25T08:48:37.619 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-25T08:48:37.619 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-25T08:48:37.619 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-25T08:48:37.619 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-25T08:48:37.619 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-25T08:48:37.619 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-25T08:48:37.619 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-25T08:48:37.619 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-25T08:48:37.620 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-25T08:48:37.620 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-25T08:48:37.620 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-25T08:48:37.620 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-25T08:48:37.620 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-25T08:48:37.620 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-25T08:48:37.620 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-25T08:48:37.620 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-25T08:48:37.620 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-25T08:48:37.620 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-25T08:48:37.620 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-25T08:48:37.620 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-25T08:48:37.620 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-25T08:48:37.620 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-25T08:48:37.621 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-25T08:48:37.621 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-25T08:48:37.621 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-25T08:48:37.621 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-25T08:48:37.621 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-25T08:48:37.621 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-25T08:48:37.621 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-25T08:48:37.621 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-25T08:48:37.621 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-25T08:48:37.621 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-25T08:48:37.621 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-25T08:48:37.621 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-25T08:48:37.622 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-25T08:48:37.622 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-25T08:48:37.622 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-25T08:48:37.622 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-25T08:48:37.622 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-25T08:48:37.622 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-25T08:48:37.622 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-25T08:48:37.622 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-25T08:48:37.622 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-25T08:48:37.622 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-25T08:48:37.622 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-25T08:48:37.623 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-25T08:48:37.623 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-25T08:48:37.623 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-25T08:48:37.623 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-25T08:48:37.623 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-25T08:48:37.623 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-25T08:48:37.623 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-25T08:48:37.623 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-25T08:48:37.623 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-25T08:48:37.623 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-25T08:48:37.623 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-25T08:48:37.623 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-25T08:48:37.623 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-25T08:48:37.623 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-25T08:48:37.624 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-25T08:48:37.624 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-25T08:48:37.624 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-25T08:48:37.624 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-25T08:48:37.624 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-25T08:48:37.624 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-25T08:48:37.624 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-25T08:48:37.624 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-25T08:48:37.624 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-25T08:48:37.624 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-25T08:48:37.624 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-25T08:48:37.624 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-25T08:48:37.624 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-25T08:48:37.624 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-25T08:48:37.625 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-25T08:48:37.625 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-25T08:48:37.625 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-25T08:48:37.625 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-25T08:48:37.625 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-25T08:48:37.625 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-25T08:48:37.625 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-25T08:48:37.625 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-25T08:48:37.625 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-25T08:48:37.625 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-25T08:48:37.625 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-25T08:48:37.625 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-25T08:48:37.625 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-25T08:48:37.625 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-25T08:48:37.626 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-25T08:48:37.626 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-25T08:48:37.626 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-25T08:48:37.626 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-25T08:48:37.626 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-25T08:48:37.626 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-25T08:48:37.626 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-25T08:48:37.626 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-25T08:48:37.626 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-25T08:48:37.626 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-25T08:48:37.626 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-25T08:48:37.626 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-25T08:48:37.627 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-25T08:48:37.627 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-25T08:48:37.627 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-25T08:48:37.627 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-25T08:48:37.627 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-25T08:48:37.627 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-25T08:48:37.627 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-25T08:48:37.627 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-25T08:48:37.627 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-25T08:48:37.627 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-25T08:48:37.627 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-25T08:48:37.627 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-25T08:48:37.628 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-25T08:48:37.628 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-25T08:48:37.628 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-25T08:48:37.628 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-25T08:48:37.628 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-25T08:48:37.628 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-25T08:48:37.628 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-25T08:48:37.628 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-25T08:48:37.628 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-25T08:48:37.628 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-25T08:48:37.628 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-25T08:48:37.628 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-25T08:48:37.628 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-25T08:48:37.629 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-25T08:48:37.629 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-25T08:48:37.629 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-25T08:48:37.629 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-25T08:48:37.629 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-25T08:48:37.629 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-25T08:48:37.629 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-25T08:48:37.629 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-25T08:48:37.629 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-25T08:48:37.629 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-25T08:48:37.629 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-25T08:48:37.629 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-25T08:48:37.629 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-25T08:48:37.630 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-25T08:48:37.630 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-25T08:48:37.630 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-25T08:48:37.630 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-25T08:48:37.630 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-25T08:48:37.630 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-25T08:48:37.630 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-25T08:48:37.630 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-25T08:48:37.630 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-25T08:48:37.630 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-25T08:48:37.631 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-25T08:48:37.631 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-25T08:48:37.631 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-25T08:48:37.631 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-25T08:48:37.631 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-25T08:48:37.631 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-25T08:48:37.631 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-25T08:48:37.631 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-25T08:48:37.631 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-25T08:48:37.631 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-25T08:48:37.631 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-25T08:48:37.631 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-25T08:48:37.631 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-25T08:48:37.631 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-25T08:48:37.632 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-25T08:48:37.632 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-25T08:48:37.632 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-25T08:48:37.632 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-25T08:48:37.632 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-25T08:48:37.632 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-25T08:48:37.632 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-25T08:48:37.632 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-25T08:48:37.632 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-25T08:48:37.632 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-25T08:48:37.632 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-25T08:48:37.632 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-25T08:48:37.632 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-25T08:48:37.632 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-25T08:48:37.633 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-25T08:48:37.633 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-25T08:48:37.633 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-25T08:48:37.633 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-25T08:48:37.633 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-25T08:48:37.633 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-25T08:48:37.633 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-25T08:48:37.633 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-25T08:48:37.633 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-25T08:48:37.633 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-25T08:48:37.633 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-25T08:48:37.633 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-25T08:48:37.633 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-25T08:48:37.633 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-25T08:48:37.634 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-25T08:48:37.634 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-25T08:48:37.634 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-25T08:48:37.634 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-25T08:48:37.634 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-25T08:48:37.634 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-25T08:48:37.634 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-25T08:48:37.634 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-25T08:48:37.634 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-25T08:48:37.634 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-25T08:48:37.634 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-25T08:48:37.634 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-25T08:48:37.635 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-25T08:48:37.635 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-25T08:48:37.635 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-25T08:48:37.635 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-25T08:48:37.635 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-25T08:48:37.635 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-25T08:48:37.635 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-25T08:48:37.635 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-25T08:48:37.635 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-25T08:48:37.635 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-25T08:48:37.635 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-25T08:48:37.635 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-25T08:48:37.635 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-25T08:48:37.636 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-25T08:48:37.636 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-25T08:48:37.636 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-25T08:48:37.636 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-25T08:48:37.636 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-25T08:48:37.636 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-25T08:48:37.636 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-25T08:48:37.636 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-25T08:48:37.636 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-25T08:48:37.636 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-25T08:48:37.636 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-25T08:48:37.636 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-25T08:48:37.636 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-25T08:48:37.636 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-25T08:48:37.637 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-25T08:48:37.637 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-25T08:48:37.637 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-25T08:48:37.637 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-25T08:48:37.637 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-25T08:48:37.637 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-25T08:48:37.637 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-25T08:48:37.637 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-25T08:48:37.637 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-25T08:48:37.637 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-25T08:48:37.637 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-25T08:48:37.637 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-25T08:48:37.637 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-25T08:48:37.638 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-25T08:48:37.638 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-25T08:48:37.638 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-25T08:48:37.638 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-25T08:48:37.638 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-25T08:48:37.638 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-25T08:48:37.638 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-25T08:48:37.638 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-25T08:48:37.638 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-25T08:48:37.638 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-25T08:48:37.638 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-25T08:48:37.639 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-25T08:48:37.639 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-25T08:48:37.639 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-25T08:48:37.639 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-25T08:48:37.639 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-25T08:48:37.639 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-25T08:48:37.639 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-25T08:48:37.639 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-25T08:48:37.639 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-25T08:48:37.639 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-25T08:48:37.639 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-25T08:48:37.639 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-25T08:48:37.640 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-25T08:48:37.640 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-25T08:48:37.640 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-25T08:48:37.640 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-25T08:48:37.640 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-25T08:48:37.640 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-25T08:48:37.640 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-25T08:48:37.640 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-25T08:48:37.640 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-25T08:48:37.640 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-25T08:48:37.640 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-25T08:48:37.641 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-25T08:48:37.641 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-25T08:48:37.641 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-25T08:48:37.641 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-25T08:48:37.641 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-25T08:48:37.641 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-25T08:48:37.641 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-25T08:48:37.641 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-25T08:48:37.641 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-25T08:48:37.641 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-25T08:48:37.641 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-25T08:48:37.641 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-25T08:48:37.642 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-25T08:48:37.642 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-25T08:48:37.642 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-25T08:48:37.642 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-25T08:48:37.642 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-25T08:48:37.642 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-25T08:48:37.642 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-25T08:48:37.642 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-25T08:48:37.642 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-25T08:48:37.642 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-25T08:48:37.642 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-25T08:48:37.643 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-25T08:48:37.643 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-25T08:48:37.643 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-25T08:48:37.643 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-25T08:48:37.643 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-25T08:48:37.643 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-25T08:48:37.643 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-25T08:48:37.643 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-25T08:48:37.643 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-25T08:48:37.643 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-25T08:48:37.643 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-25T08:48:37.644 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-25T08:48:37.644 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-25T08:48:37.644 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-25T08:48:37.644 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-25T08:48:37.644 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-25T08:48:37.644 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-25T08:48:37.644 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-25T08:48:37.644 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-25T08:48:37.644 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-25T08:48:37.644 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-25T08:48:37.644 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-25T08:48:37.644 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-25T08:48:37.644 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-25T08:48:37.645 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-25T08:48:37.645 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-25T08:48:37.645 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-25T08:48:37.645 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-25T08:48:37.645 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-25T08:48:37.645 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-25T08:48:37.645 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-25T08:48:37.645 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-25T08:48:37.645 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-25T08:48:37.645 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-25T08:48:37.645 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-25T08:48:37.645 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-25T08:48:37.646 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-25T08:48:37.646 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-25T08:48:37.646 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-25T08:48:37.646 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-25T08:48:37.646 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-25T08:48:37.646 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-25T08:48:37.646 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-25T08:48:37.646 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-25T08:48:37.646 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-25T08:48:37.646 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-25T08:48:37.646 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-25T08:48:37.646 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-25T08:48:37.647 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-25T08:48:37.647 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-25T08:48:37.647 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-25T08:48:37.647 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-25T08:48:37.647 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-25T08:48:37.647 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-25T08:48:37.647 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-25T08:48:37.647 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-25T08:48:37.647 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-25T08:48:37.647 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-25T08:48:37.647 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-25T08:48:37.647 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-25T08:48:37.647 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-25T08:48:37.648 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-25T08:48:37.648 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-25T08:48:37.648 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-25T08:48:37.648 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-25T08:48:37.648 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-25T08:48:37.648 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-25T08:48:37.648 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-25T08:48:37.648 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-25T08:48:37.648 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-25T08:48:37.648 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-25T08:48:37.648 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-25T08:48:37.648 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-25T08:48:37.648 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-25T08:48:37.649 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-25T08:48:37.649 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-25T08:48:37.649 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-25T08:48:37.649 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-25T08:48:37.649 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-25T08:48:37.649 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-25T08:48:37.649 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-25T08:48:37.649 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-25T08:48:37.649 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-25T08:48:37.649 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-25T08:48:37.649 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-25T08:48:37.649 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-25T08:48:37.649 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-25T08:48:37.649 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-25T08:48:37.650 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-25T08:48:37.650 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-25T08:48:37.650 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-25T08:48:37.650 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-25T08:48:37.650 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-25T08:48:37.650 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-25T08:48:37.650 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-25T08:48:37.650 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-25T08:48:37.650 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-25T08:48:37.650 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-25T08:48:37.650 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-25T08:48:37.650 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-25T08:48:37.650 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-25T08:48:37.651 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-25T08:48:37.651 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-25T08:48:37.651 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-25T08:48:37.651 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-25T08:48:37.651 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-25T08:48:37.651 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-25T08:48:37.651 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-25T08:48:37.651 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-25T08:48:37.651 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-25T08:48:37.651 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-25T08:48:37.651 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-25T08:48:37.651 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-25T08:48:37.652 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-25T08:48:37.652 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-25T08:48:37.652 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-25T08:48:37.652 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-25T08:48:37.652 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-25T08:48:37.652 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-25T08:48:37.652 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-25T08:48:37.652 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-25T08:48:37.652 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-25T08:48:37.652 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-25T08:48:37.652 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-25T08:48:37.652 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-25T08:48:37.652 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-25T08:48:37.652 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-25T08:48:37.652 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-25T08:48:37.653 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-25T08:48:37.653 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-25T08:48:37.653 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-25T08:48:37.653 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-25T08:48:37.653 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-25T08:48:37.653 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-25T08:48:37.653 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-25T08:48:37.653 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-25T08:48:37.653 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-25T08:48:37.653 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-25T08:48:37.653 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-25T08:48:37.653 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-25T08:48:37.653 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-25T08:48:37.653 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-25T08:48:37.654 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-25T08:48:37.654 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-25T08:48:37.654 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-25T08:48:37.654 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-25T08:48:37.654 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-25T08:48:37.654 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-25T08:48:37.654 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-25T08:48:37.654 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-25T08:48:37.654 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-25T08:48:37.654 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-25T08:48:37.654 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-25T08:48:37.654 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-25T08:48:37.654 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-25T08:48:37.655 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-25T08:48:37.655 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-25T08:48:37.655 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-25T08:48:37.655 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-25T08:48:37.655 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-25T08:48:37.655 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-25T08:48:37.655 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-25T08:48:37.655 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-25T08:48:37.655 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-25T08:48:37.655 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-25T08:48:37.655 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-25T08:48:37.655 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-25T08:48:37.655 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-25T08:48:37.655 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-25T08:48:37.656 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-25T08:48:37.656 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-25T08:48:37.656 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-25T08:48:37.656 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-25T08:48:37.656 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-25T08:48:37.656 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-25T08:48:37.656 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-25T08:48:37.656 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-25T08:48:37.656 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-25T08:48:37.656 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-25T08:48:37.656 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-25T08:48:37.656 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-25T08:48:37.657 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-25T08:48:37.657 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-25T08:48:37.657 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-25T08:48:37.657 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-25T08:48:37.657 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-25T08:48:37.657 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-25T08:48:37.657 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-25T08:48:37.657 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-25T08:48:37.657 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-25T08:48:37.657 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-25T08:48:37.657 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-25T08:48:37.657 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-25T08:48:37.657 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-25T08:48:37.657 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-25T08:48:37.658 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-25T08:48:37.658 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-25T08:48:37.658 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-25T08:48:37.658 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-25T08:48:37.658 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-25T08:48:37.658 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-25T08:48:37.658 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-25T08:48:37.658 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-25T08:48:37.658 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-25T08:48:37.658 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-25T08:48:37.658 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-25T08:48:37.658 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-25T08:48:37.658 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-25T08:48:37.659 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-25T08:48:37.659 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-25T08:48:37.659 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-25T08:48:37.659 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-25T08:48:37.659 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-25T08:48:37.659 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-25T08:48:37.659 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-25T08:48:37.659 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-25T08:48:37.659 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-25T08:48:37.659 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-25T08:48:37.659 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-25T08:48:37.659 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-25T08:48:37.659 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-25T08:48:37.659 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-25T08:48:37.660 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-25T08:48:37.660 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-25T08:48:37.660 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-25T08:48:37.660 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-25T08:48:37.660 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-25T08:48:37.660 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-25T08:48:37.660 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-25T08:48:37.660 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-25T08:48:37.660 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-25T08:48:37.660 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-25T08:48:37.660 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-25T08:48:37.660 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-25T08:48:37.660 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-25T08:48:37.661 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-25T08:48:37.661 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-25T08:48:37.661 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-25T08:48:37.661 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-25T08:48:37.661 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-25T08:48:37.661 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-25T08:48:37.661 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-25T08:48:37.661 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-25T08:48:37.661 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-25T08:48:37.661 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-25T08:48:37.661 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-25T08:48:37.662 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-25T08:48:37.662 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-25T08:48:37.662 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-25T08:48:37.662 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-25T08:48:37.662 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-25T08:48:37.662 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-25T08:48:37.662 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-25T08:48:37.662 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-25T08:48:37.662 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-25T08:48:37.662 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-25T08:48:37.662 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-25T08:48:37.662 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-25T08:48:37.662 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-25T08:48:37.662 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-25T08:48:37.663 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-25T08:48:37.663 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-25T08:48:37.663 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-25T08:48:37.663 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-25T08:48:37.663 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-25T08:48:37.663 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-25T08:48:37.663 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-25T08:48:37.663 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-25T08:48:37.663 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-25T08:48:37.663 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-25T08:48:37.663 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-25T08:48:37.663 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-25T08:48:37.663 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-25T08:48:37.664 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-25T08:48:37.664 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-25T08:48:37.664 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-25T08:48:37.664 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-25T08:48:37.664 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-25T08:48:37.664 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-25T08:48:37.664 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-25T08:48:37.664 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-25T08:48:37.664 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-25T08:48:37.664 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-25T08:48:37.664 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-25T08:48:37.664 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-25T08:48:37.665 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-25T08:48:37.665 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-25T08:48:37.665 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-25T08:48:37.665 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-25T08:48:37.665 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-25T08:48:37.665 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-25T08:48:37.665 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-25T08:48:37.665 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-25T08:48:37.665 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-25T08:48:37.665 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-25T08:48:37.665 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-25T08:48:37.665 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-25T08:48:37.665 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-25T08:48:37.665 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-25T08:48:37.666 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-25T08:48:37.666 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-25T08:48:37.666 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-25T08:48:37.666 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-25T08:48:37.666 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-25T08:48:37.666 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-25T08:48:37.666 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-25T08:48:37.666 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-25T08:48:37.666 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-25T08:48:37.666 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-25T08:48:37.667 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-25T08:48:37.667 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-25T08:48:37.667 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-25T08:48:37.667 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-25T08:48:37.667 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-25T08:48:37.667 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-25T08:48:37.667 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-25T08:48:37.667 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-25T08:48:37.667 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-25T08:48:37.667 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-25T08:48:37.667 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-25T08:48:37.667 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-25T08:48:37.668 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-25T08:48:37.668 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-25T08:48:37.668 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-25T08:48:37.668 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-25T08:48:37.668 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-25T08:48:37.668 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-25T08:48:37.668 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-25T08:48:37.668 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-25T08:48:37.668 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-25T08:48:37.668 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-25T08:48:37.668 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-25T08:48:37.669 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-25T08:48:37.669 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-25T08:48:37.669 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-25T08:48:37.669 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-25T08:48:37.669 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-25T08:48:37.669 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-25T08:48:37.669 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-25T08:48:37.669 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-25T08:48:37.669 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-25T08:48:37.669 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-25T08:48:37.669 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-25T08:48:37.669 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-25T08:48:37.670 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-25T08:48:37.670 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-25T08:48:37.670 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-25T08:48:37.670 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-25T08:48:37.670 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-25T08:48:37.670 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-25T08:48:37.670 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-25T08:48:37.670 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-25T08:48:37.670 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-25T08:48:37.670 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-25T08:48:37.670 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-25T08:48:37.670 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-25T08:48:37.671 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-25T08:48:37.671 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-25T08:48:37.671 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-25T08:48:37.671 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-25T08:48:37.671 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-25T08:48:37.671 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-25T08:48:37.671 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-25T08:48:37.671 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-25T08:48:37.671 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-25T08:48:37.671 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-25T08:48:37.671 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-25T08:48:37.672 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-25T08:48:37.672 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-25T08:48:37.672 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-25T08:48:37.672 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-25T08:48:37.672 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-25T08:48:37.672 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-25T08:48:37.672 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-25T08:48:37.672 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-25T08:48:37.672 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-25T08:48:37.672 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-25T08:48:37.672 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-25T08:48:37.672 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-25T08:48:37.673 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-25T08:48:37.673 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-25T08:48:37.673 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-25T08:48:37.673 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-25T08:48:37.673 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-25T08:48:37.673 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-25T08:48:37.673 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-25T08:48:37.673 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-25T08:48:37.673 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-25T08:48:37.673 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-25T08:48:37.673 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-25T08:48:37.673 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-25T08:48:37.674 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-25T08:48:37.674 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-25T08:48:37.674 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-25T08:48:37.674 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-25T08:48:37.674 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-25T08:48:37.674 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-25T08:48:37.674 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-25T08:48:37.674 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-25T08:48:37.674 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-25T08:48:37.674 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-25T08:48:37.674 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-25T08:48:37.674 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-25T08:48:37.675 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-25T08:48:37.675 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-25T08:48:37.675 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-25T08:48:37.675 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-25T08:48:37.675 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-25T08:48:37.675 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-25T08:48:37.675 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-25T08:48:37.675 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-25T08:48:37.675 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-25T08:48:37.675 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-25T08:48:37.675 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-25T08:48:37.675 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-25T08:48:37.675 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-25T08:48:37.676 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-25T08:48:37.676 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-25T08:48:37.676 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-25T08:48:37.676 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-25T08:48:37.676 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-25T08:48:37.676 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-25T08:48:37.676 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-25T08:48:37.676 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-25T08:48:37.676 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-25T08:48:37.676 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-25T08:48:37.676 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-25T08:48:37.676 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-25T08:48:37.677 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-25T08:48:37.677 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-25T08:48:37.677 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-25T08:48:37.677 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-25T08:48:37.677 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-25T08:48:37.677 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-25T08:48:37.677 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-25T08:48:37.677 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-25T08:48:37.677 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-25T08:48:37.677 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-25T08:48:37.677 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-25T08:48:37.677 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-25T08:48:37.677 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-25T08:48:37.678 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-25T08:48:37.678 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-25T08:48:37.678 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-25T08:48:37.678 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-25T08:48:37.678 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-25T08:48:37.678 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-25T08:48:37.678 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-25T08:48:37.678 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-25T08:48:37.678 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-25T08:48:37.678 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-25T08:48:37.678 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-25T08:48:37.678 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-25T08:48:37.678 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-25T08:48:37.679 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-25T08:48:37.679 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-25T08:48:37.679 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-25T08:48:37.679 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-25T08:48:37.679 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-25T08:48:37.679 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-25T08:48:37.679 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-25T08:48:37.679 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-25T08:48:37.679 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-25T08:48:37.679 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-25T08:48:37.679 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-25T08:48:37.679 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-25T08:48:37.679 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-25T08:48:37.680 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-25T08:48:37.680 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-25T08:48:37.680 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-25T08:48:37.680 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-25T08:48:37.680 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-25T08:48:37.680 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-25T08:48:37.680 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-25T08:48:37.680 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-25T08:48:37.680 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-25T08:48:37.680 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-25T08:48:37.680 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-25T08:48:37.680 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-25T08:48:37.680 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-25T08:48:37.681 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-25T08:48:37.681 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-25T08:48:37.681 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-25T08:48:37.681 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-25T08:48:37.681 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-25T08:48:37.681 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-25T08:48:37.681 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-25T08:48:37.681 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-25T08:48:37.681 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-25T08:48:37.681 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-25T08:48:37.681 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-25T08:48:37.682 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-25T08:48:37.682 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-25T08:48:37.682 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-25T08:48:37.682 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-25T08:48:37.682 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-25T08:48:37.682 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-25T08:48:37.682 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-25T08:48:37.682 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-25T08:48:37.682 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-25T08:48:37.682 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-25T08:48:37.682 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-25T08:48:37.682 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-25T08:48:37.683 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-25T08:48:37.683 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-25T08:48:37.683 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-25T08:48:37.683 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-25T08:48:37.683 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-25T08:48:37.683 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-25T08:48:37.683 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-25T08:48:37.683 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-25T08:48:37.683 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-25T08:48:37.683 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-25T08:48:37.683 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-25T08:48:37.684 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-25T08:48:37.684 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-25T08:48:37.684 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-25T08:48:37.684 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-25T08:48:37.684 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-25T08:48:37.684 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-25T08:48:37.684 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-25T08:48:37.684 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-25T08:48:37.684 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-25T08:48:37.684 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-25T08:48:37.684 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-25T08:48:37.684 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-25T08:48:37.684 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-25T08:48:37.685 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-25T08:48:37.685 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-25T08:48:37.685 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-25T08:48:37.685 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-25T08:48:37.685 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-25T08:48:37.685 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-25T08:48:37.685 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-25T08:48:37.685 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-25T08:48:37.685 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-25T08:48:37.685 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-25T08:48:37.685 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-25T08:48:37.685 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-25T08:48:37.685 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-25T08:48:37.686 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-25T08:48:37.686 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-25T08:48:37.686 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-25T08:48:37.686 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-25T08:48:37.686 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-25T08:48:37.686 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-25T08:48:37.686 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-25T08:48:37.686 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-25T08:48:37.686 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-25T08:48:37.686 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-25T08:48:37.686 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-25T08:48:37.686 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-25T08:48:37.687 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-25T08:48:37.687 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-25T08:48:37.687 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-25T08:48:37.687 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-25T08:48:37.687 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-25T08:48:37.687 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-25T08:48:37.687 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-25T08:48:37.687 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-25T08:48:37.687 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-25T08:48:37.687 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-25T08:48:37.687 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-25T08:48:37.687 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-25T08:48:37.688 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-25T08:48:37.688 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-25T08:48:37.688 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-25T08:48:37.688 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-25T08:48:37.688 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-25T08:48:37.688 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-25T08:48:37.688 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-25T08:48:37.688 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-25T08:48:37.688 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-25T08:48:37.688 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-25T08:48:37.688 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-25T08:48:37.688 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-25T08:48:37.689 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-25T08:48:37.689 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-25T08:48:37.689 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-25T08:48:37.689 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-25T08:48:37.689 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-25T08:48:37.689 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-25T08:48:37.689 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-25T08:48:37.689 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-25T08:48:37.689 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-25T08:48:37.689 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-25T08:48:37.689 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-25T08:48:37.689 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-25T08:48:37.690 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-25T08:48:37.690 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-25T08:48:37.690 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-25T08:48:37.690 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-25T08:48:37.690 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-25T08:48:37.690 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-25T08:48:37.690 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-25T08:48:37.690 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-25T08:48:37.690 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-25T08:48:37.690 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-25T08:48:37.690 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-25T08:48:37.691 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-25T08:48:37.691 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-25T08:48:37.691 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-25T08:48:37.691 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-25T08:48:37.691 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-25T08:48:37.691 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-25T08:48:37.691 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-25T08:48:37.691 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-25T08:48:37.691 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-25T08:48:37.691 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-25T08:48:37.691 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-25T08:48:37.691 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-25T08:48:37.692 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-25T08:48:37.692 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-25T08:48:37.692 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-25T08:48:37.692 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-25T08:48:37.692 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-25T08:48:37.692 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-25T08:48:37.692 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-25T08:48:37.692 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-25T08:48:37.692 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-25T08:48:37.692 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-25T08:48:37.692 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-25T08:48:37.693 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-25T08:48:37.693 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-25T08:48:37.693 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-25T08:48:37.693 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-25T08:48:37.693 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-25T08:48:37.693 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-25T08:48:37.693 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-25T08:48:37.693 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-25T08:48:37.693 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-25T08:48:37.693 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-25T08:48:37.693 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-25T08:48:37.693 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-25T08:48:37.694 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-25T08:48:37.694 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-25T08:48:37.694 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-25T08:48:37.694 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-25T08:48:37.694 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-25T08:48:37.694 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-25T08:48:37.694 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-25T08:48:37.694 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-25T08:48:37.694 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-25T08:48:37.694 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-25T08:48:37.694 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-25T08:48:37.694 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-25T08:48:37.695 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-25T08:48:37.695 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-25T08:48:37.695 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-25T08:48:37.695 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-25T08:48:37.695 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-25T08:48:37.695 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-25T08:48:37.695 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-25T08:48:37.695 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-25T08:48:37.695 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-25T08:48:37.695 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-25T08:48:37.695 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-25T08:48:37.695 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-25T08:48:37.696 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-25T08:48:37.696 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-25T08:48:37.696 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-25T08:48:37.696 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-25T08:48:37.696 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-25T08:48:37.696 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-25T08:48:37.696 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-25T08:48:37.696 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-25T08:48:37.696 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-25T08:48:37.696 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-25T08:48:37.696 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-25T08:48:37.696 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-25T08:48:37.697 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-25T08:48:37.697 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-25T08:48:37.697 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-25T08:48:37.697 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-25T08:48:37.697 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-25T08:48:37.697 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-25T08:48:37.697 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-25T08:48:37.697 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-25T08:48:37.697 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-25T08:48:37.697 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-25T08:48:37.697 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-25T08:48:37.697 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-25T08:48:37.697 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-25T08:48:37.698 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-25T08:48:37.698 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-25T08:48:37.698 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-25T08:48:37.698 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-25T08:48:37.698 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-25T08:48:37.698 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-25T08:48:37.698 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-25T08:48:37.698 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-25T08:48:37.698 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-25T08:48:37.698 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-25T08:48:37.698 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-25T08:48:37.698 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-25T08:48:37.698 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-25T08:48:37.699 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-25T08:48:37.699 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-25T08:48:37.699 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-25T08:48:37.699 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-25T08:48:37.699 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-25T08:48:37.699 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-25T08:48:37.699 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-25T08:48:37.699 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-25T08:48:37.699 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-25T08:48:37.699 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-25T08:48:37.699 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-25T08:48:37.699 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-25T08:48:37.700 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-25T08:48:37.700 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-25T08:48:37.700 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-25T08:48:37.700 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-25T08:48:37.700 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-25T08:48:37.700 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-25T08:48:37.700 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-25T08:48:37.700 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-25T08:48:37.700 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-25T08:48:37.700 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-25T08:48:37.700 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-25T08:48:37.701 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-25T08:48:37.701 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-25T08:48:37.701 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-25T08:48:37.701 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-25T08:48:37.701 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-25T08:48:37.701 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-25T08:48:37.701 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-25T08:48:37.701 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-25T08:48:37.701 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-25T08:48:37.701 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-25T08:48:37.701 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-25T08:48:37.701 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-25T08:48:37.702 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-25T08:48:37.702 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-25T08:48:37.702 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-25T08:48:37.702 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-25T08:48:37.702 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-25T08:48:37.702 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-25T08:48:37.702 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-25T08:48:37.702 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-25T08:48:37.702 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-25T08:48:37.702 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-25T08:48:37.702 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-25T08:48:37.702 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-25T08:48:37.703 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-25T08:48:37.703 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-25T08:48:37.703 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-25T08:48:37.703 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-25T08:48:37.703 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-25T08:48:37.703 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-25T08:48:37.703 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-25T08:48:37.703 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-25T08:48:37.703 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-25T08:48:37.703 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-25T08:48:37.703 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-25T08:48:37.703 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-25T08:48:37.703 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-25T08:48:37.703 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-25T08:48:37.704 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-25T08:48:37.704 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-25T08:48:37.704 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-25T08:48:37.704 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-25T08:48:37.704 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-25T08:48:37.704 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-25T08:48:37.704 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-25T08:48:37.704 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-25T08:48:37.704 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-25T08:48:37.704 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-25T08:48:37.704 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-25T08:48:37.704 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-25T08:48:37.704 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-25T08:48:37.704 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-25T08:48:37.704 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-25T08:48:37.705 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-25T08:48:37.705 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-25T08:48:37.705 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-25T08:48:37.705 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-25T08:48:37.705 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-25T08:48:37.705 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-25T08:48:37.705 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-25T08:48:37.705 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-25T08:48:37.705 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-25T08:48:37.705 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-25T08:48:37.705 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-25T08:48:37.705 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-25T08:48:37.705 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-25T08:48:37.705 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-25T08:48:37.706 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-25T08:48:37.706 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-25T08:48:37.706 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-25T08:48:37.706 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-25T08:48:37.706 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-25T08:48:37.706 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-25T08:48:37.706 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-25T08:48:37.706 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-25T08:48:37.706 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-25T08:48:37.706 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-25T08:48:37.706 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-25T08:48:37.706 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-25T08:48:37.706 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-25T08:48:37.707 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-25T08:48:37.707 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-25T08:48:37.707 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-25T08:48:37.707 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-25T08:48:37.707 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-25T08:48:37.707 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-25T08:48:37.707 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-25T08:48:37.707 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-25T08:48:37.707 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-25T08:48:37.707 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-25T08:48:37.707 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-25T08:48:37.707 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-25T08:48:37.707 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-25T08:48:37.707 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-25T08:48:37.708 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-25T08:48:37.708 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-25T08:48:37.708 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-25T08:48:37.708 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-25T08:48:37.708 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-25T08:48:37.708 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-25T08:48:37.708 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-25T08:48:37.708 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-25T08:48:37.708 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-25T08:48:37.708 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-25T08:48:37.708 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-25T08:48:37.708 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-25T08:48:37.708 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-25T08:48:37.708 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-25T08:48:37.709 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-25T08:48:37.709 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-25T08:48:37.709 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-25T08:48:37.709 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-25T08:48:37.709 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-25T08:48:37.709 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-25T08:48:37.709 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-25T08:48:37.709 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-25T08:48:37.709 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-25T08:48:37.709 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-25T08:48:37.709 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-25T08:48:37.709 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-25T08:48:37.710 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-25T08:48:37.710 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-25T08:48:37.710 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-25T08:48:37.710 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-25T08:48:37.710 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-25T08:48:37.710 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-25T08:48:37.710 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-25T08:48:37.710 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-25T08:48:37.710 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-25T08:48:37.710 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-25T08:48:37.710 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-25T08:48:37.710 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-25T08:48:37.711 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-25T08:48:37.711 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-25T08:48:37.711 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-25T08:48:37.711 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-25T08:48:37.711 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-25T08:48:37.711 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-25T08:48:37.711 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-25T08:48:37.711 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-25T08:48:37.711 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-25T08:48:37.711 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-25T08:48:37.711 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-25T08:48:37.711 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-25T08:48:37.711 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-25T08:48:37.711 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-25T08:48:37.712 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-25T08:48:37.712 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-25T08:48:37.712 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-25T08:48:37.712 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-25T08:48:37.712 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-25T08:48:37.712 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-25T08:48:37.712 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-25T08:48:37.712 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-25T08:48:37.712 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-25T08:48:37.712 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-25T08:48:37.712 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-25T08:48:37.712 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-25T08:48:37.712 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-25T08:48:37.713 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-25T08:48:37.713 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-25T08:48:37.713 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-25T08:48:37.713 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-25T08:48:37.713 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-25T08:48:37.713 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-25T08:48:37.713 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-25T08:48:37.713 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-25T08:48:37.713 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-25T08:48:37.713 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-25T08:48:37.713 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-25T08:48:37.713 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-25T08:48:37.713 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-25T08:48:37.714 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-25T08:48:37.714 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-25T08:48:37.714 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-25T08:48:37.714 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-25T08:48:37.714 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-25T08:48:37.714 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-25T08:48:37.714 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-25T08:48:37.714 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-25T08:48:37.714 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-25T08:48:37.714 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-25T08:48:37.714 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-25T08:48:37.714 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-25T08:48:37.714 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-25T08:48:37.715 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-25T08:48:37.715 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-25T08:48:37.715 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-25T08:48:37.715 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-25T08:48:37.715 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-25T08:48:37.715 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-25T08:48:37.715 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-25T08:48:37.715 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-25T08:48:37.715 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-25T08:48:37.715 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-25T08:48:37.715 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-25T08:48:37.715 INFO:teuthology.orchestra.run.smithi173.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-25T08:48:37.715 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-25T08:48:37.715 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-25T08:48:37.719 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:37.720 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:37.720 DEBUG:teuthology.orchestra.run.smithi173:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-25T08:48:37.727 INFO:teuthology.orchestra.run.smithi173.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T08:48:37.727 INFO:teuthology.orchestra.run.smithi173.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T08:48:37.727 INFO:teuthology.orchestra.run.smithi173.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T08:48:37.728 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-25T08:48:37.728 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:37.728 DEBUG:teuthology.orchestra.run.smithi173:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-25T08:48:37.768 INFO:teuthology.orchestra.run.smithi194.stderr:Sourcing file `/etc/default/grub' 2024-04-25T08:48:37.769 INFO:teuthology.orchestra.run.smithi194.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T08:48:37.773 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi173.front.sepia.ceph.com to complete... 2024-04-25T08:48:37.793 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2024-04-25T08:48:37.957 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:37.962 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:38.137 INFO:teuthology.orchestra.run.smithi173.stderr:Sourcing file `/etc/default/grub' 2024-04-25T08:48:38.138 INFO:teuthology.orchestra.run.smithi173.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T08:48:38.156 INFO:teuthology.orchestra.run.smithi173.stderr:Generating grub configuration file ... 2024-04-25T08:48:38.184 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T08:48:38.189 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T08:48:38.232 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T08:48:38.237 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T08:48:38.322 INFO:teuthology.orchestra.run.smithi173.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:38.328 INFO:teuthology.orchestra.run.smithi173.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T08:48:38.366 INFO:teuthology.orchestra.run.smithi194.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T08:48:38.366 INFO:teuthology.orchestra.run.smithi194.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T08:48:38.366 INFO:teuthology.orchestra.run.smithi194.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T08:48:38.393 INFO:teuthology.orchestra.run.smithi194.stderr:done 2024-04-25T08:48:38.608 INFO:teuthology.orchestra.run.smithi173.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T08:48:38.614 INFO:teuthology.orchestra.run.smithi173.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T08:48:38.655 INFO:teuthology.orchestra.run.smithi173.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T08:48:38.660 INFO:teuthology.orchestra.run.smithi173.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T08:48:38.782 INFO:teuthology.orchestra.run.smithi173.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T08:48:38.783 INFO:teuthology.orchestra.run.smithi173.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T08:48:38.783 INFO:teuthology.orchestra.run.smithi173.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T08:48:38.798 INFO:teuthology.orchestra.run.smithi173.stderr:done 2024-04-25T08:48:39.527 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-04-25T08:49:09.531 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-25T08:49:09.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-25T08:49:09.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:49:09.888 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-25T08:49:09.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-25T08:49:09.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:49:28.095 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-04-25T08:49:28.354 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-04-25T08:49:37.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-25T08:49:37.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:49:37.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-25T08:49:37.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:49:40.162 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-04-25T08:49:40.414 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-04-25T08:49:52.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-25T08:49:52.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:49:52.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-25T08:49:52.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:50:10.590 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-04-25T08:50:10.846 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-04-25T08:50:25.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-25T08:50:25.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:50:25.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-25T08:50:25.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:50:25.938 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-04-25T08:50:26.255 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-04-25T08:50:26.995 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-25T08:50:26.996 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-25T08:50:26.996 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-04-25T08:50:27.050 INFO:teuthology.orchestra.run.smithi173.stdout:6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:27.050 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:27.050 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T08:50:27.050 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T08:50:27.160 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-25T08:50:27.160 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g806ec36b2112"... 2024-04-25T08:50:27.160 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-04-25T08:50:27.211 INFO:teuthology.orchestra.run.smithi194.stdout:6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:27.211 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:27.211 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T08:50:27.211 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T08:50:28.051 DEBUG:teuthology.parallel:result is None 2024-04-25T08:50:28.211 DEBUG:teuthology.parallel:result is None 2024-04-25T08:50:28.212 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T08:50:28.221 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T08:50:28.221 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T08:50:28.224 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T08:50:28.233 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T08:50:28.264 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T08:50:28.298 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T08:50:28.298 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T08:50:28.301 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T08:50:28.321 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T08:50:28.327 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T08:50:28.327 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T08:50:28.362 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T08:50:28.452 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:50:28.473 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:50:28.484 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:50:28.495 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:50:28.498 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T08:50:28.506 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T08:50:28.506 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T08:50:28.509 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T08:50:28.530 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T08:50:28.561 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T08:50:28.561 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T08:50:28.578 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T08:50:28.586 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T08:50:28.636 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T08:50:28.687 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T08:50:28.688 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T08:50:28.759 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T08:50:28.767 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T08:50:28.820 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T08:50:28.820 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T08:50:28.891 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2024-04-25T08:50:28.894 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2024-04-25T08:50:29.009 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T08:50:29.016 INFO:teuthology.task.internal:Starting timer... 2024-04-25T08:50:29.016 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T08:50:29.049 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T08:50:29.083 DEBUG:teuthology.task.selinux:Excluding smithi173: OS 'ubuntu' does not support SELinux 2024-04-25T08:50:29.083 DEBUG:teuthology.task.selinux:Excluding smithi194: OS 'ubuntu' does not support SELinux 2024-04-25T08:50:29.083 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T08:50:29.083 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-25T08:50:29.083 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T08:50:29.083 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T08:50:29.117 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T08:50:29.134 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T08:50:29.135 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi173.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T08:58:17.260 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi173.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2024-04-25T08:58:17.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-25T08:58:17.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:58:17.342 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-04-25T08:58:17.457 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-25T08:58:17.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-25T08:58:17.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:58:17.541 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-04-25T08:58:17.661 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-25T08:58:17.661 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T08:58:17.671 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T08:58:17.672 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T08:58:17.672 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T08:58:17.675 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T08:58:17.675 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T08:58:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T08:58:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: Command line: ntpd -gq 2024-04-25T08:58:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: ---------------------------------------------------- 2024-04-25T08:58:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T08:58:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T08:58:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: corporation. Support and training for ntp-4 are 2024-04-25T08:58:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: available at https://www.nwtime.org/support 2024-04-25T08:58:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: ---------------------------------------------------- 2024-04-25T08:58:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: proto: precision = 0.043 usec (-24) 2024-04-25T08:58:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: basedate set to 2022-02-04 2024-04-25T08:58:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: gps base set to 2022-02-06 (week 2196) 2024-04-25T08:58:17.712 INFO:teuthology.orchestra.run.smithi173.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T08:58:17.712 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T08:58:17.712 INFO:teuthology.orchestra.run.smithi173.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T08:58:17.712 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T08:58:17.713 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T08:58:17.713 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T08:58:17.713 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T08:58:17.713 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: Listen normally on 3 enp3s0f1 172.21.15.173:123 2024-04-25T08:58:17.714 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: Listen normally on 4 lo [::1]:123 2024-04-25T08:58:17.714 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7259%5]:123 2024-04-25T08:58:17.714 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:17 ntpd[17244]: Listening on routing socket on fd #22 for interface updates 2024-04-25T08:58:17.745 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T08:58:17.745 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: Command line: ntpd -gq 2024-04-25T08:58:17.745 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: ---------------------------------------------------- 2024-04-25T08:58:17.745 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T08:58:17.745 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T08:58:17.745 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: corporation. Support and training for ntp-4 are 2024-04-25T08:58:17.745 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: available at https://www.nwtime.org/support 2024-04-25T08:58:17.745 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: ---------------------------------------------------- 2024-04-25T08:58:17.746 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: proto: precision = 0.042 usec (-24) 2024-04-25T08:58:17.746 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: basedate set to 2022-02-04 2024-04-25T08:58:17.746 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: gps base set to 2022-02-06 (week 2196) 2024-04-25T08:58:17.746 INFO:teuthology.orchestra.run.smithi194.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T08:58:17.747 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T08:58:17.747 INFO:teuthology.orchestra.run.smithi194.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T08:58:17.748 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T08:58:17.748 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T08:58:17.748 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T08:58:17.748 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T08:58:17.748 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: Listen normally on 3 enp3s0f1 172.21.15.194:123 2024-04-25T08:58:17.748 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: Listen normally on 4 lo [::1]:123 2024-04-25T08:58:17.748 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ea5%5]:123 2024-04-25T08:58:17.748 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:17 ntpd[17253]: Listening on routing socket on fd #22 for interface updates 2024-04-25T08:58:18.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:18 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:18.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:18 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:18.745 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:18 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:18.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:18 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:18.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:18 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:18.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:18 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:18.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:18 ntpd[17253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:58:18.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:18 ntpd[17253]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:58:19.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:19 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:19.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:19 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:19.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:19 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:19.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:19 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:19.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:19 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:58:19.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:19 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:58:19.745 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:19 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:19.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:19 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:19.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:19 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:19.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:19 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:19.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:19 ntpd[17253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:58:19.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:19 ntpd[17253]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:58:20.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:20 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:20.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:20 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:20.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:20 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:20.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:20 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:20.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:20 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:20.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:20 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:20.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:20 ntpd[17253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:58:20.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:20 ntpd[17253]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:58:20.747 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:20 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:20.747 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:20 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:20.747 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:20 ntpd[17253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:58:20.747 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:20 ntpd[17253]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:58:21.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:21 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:21.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:21 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:21.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:21 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:21.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:21 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:21.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:21 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:21.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:21 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:21.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:21 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:58:21.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:21 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:58:21.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:21 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:21.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:21 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:21.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:21 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:58:21.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:21 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:58:21.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:21 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:21.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:21 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:21.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:21 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:21.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:21 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:21.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:21 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:21.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:21 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:21.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:21 ntpd[17253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:58:21.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:21 ntpd[17253]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:58:22.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:22 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:22.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:22 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:22.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:22 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:22.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:22 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:22.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:22 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:58:22.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:22 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:58:22.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:22 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:22.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:22 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:22.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:22 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:22.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:22 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:22.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:22 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:22.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:22 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:22.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:22 ntpd[17253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:58:22.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:22 ntpd[17253]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:58:22.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:22 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:22.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:22 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:22.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:22 ntpd[17253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:58:22.747 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:22 ntpd[17253]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:58:23.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:23 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:23.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:23 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:23.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:23 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:23.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:23 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:23.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:23 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:23.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:23 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:23.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:23 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:58:23.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:23 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:58:23.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:23 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:23.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:23 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:23.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:23 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:58:23.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:23 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:58:23.745 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:23 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:23.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:23 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:23.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:23 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:23.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:23 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:23.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:23 ntpd[17253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:58:23.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:23 ntpd[17253]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:58:24.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:24 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:24.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:24 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:24.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:24 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:24.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:24 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:24.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:24 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:58:24.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:24 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:58:24.745 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:24 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:24.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:24 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:24.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:24 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:24.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:24 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:24.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:24 ntpd[17253]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:24.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:24 ntpd[17253]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:24.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:24 ntpd[17253]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:58:24.746 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:24 ntpd[17253]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:58:24.746 INFO:teuthology.orchestra.run.smithi194.stdout:25 Apr 08:58:24 ntpd[17253]: ntpd: time slew -0.002175 s 2024-04-25T08:58:24.746 INFO:teuthology.orchestra.run.smithi194.stdout:ntpd: time slew -0.002175s 2024-04-25T08:58:24.747 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:24 ntpd[17253]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T08:58:24.747 INFO:teuthology.orchestra.run.smithi194.stderr:25 Apr 08:58:24 ntpd[17253]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T08:58:24.850 INFO:teuthology.orchestra.run.smithi194.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T08:58:24.850 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================== 2024-04-25T08:58:24.851 INFO:teuthology.orchestra.run.smithi194.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T08:58:24.851 INFO:teuthology.orchestra.run.smithi194.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T08:58:24.851 INFO:teuthology.orchestra.run.smithi194.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T08:58:24.851 INFO:teuthology.orchestra.run.smithi194.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T08:58:25.711 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:25 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:25.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:25 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:25.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:25 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:25.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:25 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:25.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:25 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:25.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:25 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:25.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:25 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:58:25.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:25 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:58:25.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:25 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:58:25.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:25 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:58:25.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:25 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:58:25.712 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:25 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:58:25.712 INFO:teuthology.orchestra.run.smithi173.stdout:25 Apr 08:58:25 ntpd[17244]: ntpd: time slew -0.000427 s 2024-04-25T08:58:25.713 INFO:teuthology.orchestra.run.smithi173.stdout:ntpd: time slew -0.000427s 2024-04-25T08:58:25.713 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:25 ntpd[17244]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T08:58:25.713 INFO:teuthology.orchestra.run.smithi173.stderr:25 Apr 08:58:25 ntpd[17244]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T08:58:25.833 INFO:teuthology.orchestra.run.smithi173.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T08:58:25.833 INFO:teuthology.orchestra.run.smithi173.stdout:============================================================================== 2024-04-25T08:58:25.833 INFO:teuthology.orchestra.run.smithi173.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T08:58:25.833 INFO:teuthology.orchestra.run.smithi173.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T08:58:25.833 INFO:teuthology.orchestra.run.smithi173.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T08:58:25.833 INFO:teuthology.orchestra.run.smithi173.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T08:58:25.834 INFO:teuthology.run_tasks:Running task install... 2024-04-25T08:58:25.843 DEBUG:teuthology.task.install:project ceph 2024-04-25T08:58:25.843 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}} 2024-04-25T08:58:25.843 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'} 2024-04-25T08:58:25.843 INFO:teuthology.task.install:Using flavor: default 2024-04-25T08:58:25.848 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T08:58:25.848 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T08:58:25.849 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-key list | grep Ceph 2024-04-25T08:58:25.849 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-key list | grep Ceph 2024-04-25T08:58:25.953 INFO:teuthology.orchestra.run.smithi194.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T08:58:25.977 INFO:teuthology.orchestra.run.smithi173.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T08:58:26.004 INFO:teuthology.orchestra.run.smithi194.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T08:58:26.004 INFO:teuthology.orchestra.run.smithi194.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T08:58:26.005 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T08:58:26.005 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T08:58:26.005 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:58:26.027 INFO:teuthology.orchestra.run.smithi173.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T08:58:26.028 INFO:teuthology.orchestra.run.smithi173.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T08:58:26.028 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T08:58:26.029 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T08:58:26.029 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:58:26.146 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default/ 2024-04-25T08:58:26.146 INFO:teuthology.task.install.deb:Package version is 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T08:58:26.165 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default/ 2024-04-25T08:58:26.165 INFO:teuthology.task.install.deb:Package version is 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T08:58:26.257 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T08:58:26.257 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T08:58:26.272 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T08:58:26.272 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T08:58:26.277 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get update 2024-04-25T08:58:26.292 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get update 2024-04-25T08:58:26.490 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T08:58:26.495 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T08:58:26.504 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T08:58:26.538 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T08:58:26.567 INFO:teuthology.orchestra.run.smithi194.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T08:58:26.581 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T08:58:26.581 INFO:teuthology.orchestra.run.smithi173.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T08:58:26.616 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T08:58:26.618 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T08:58:26.633 INFO:teuthology.orchestra.run.smithi173.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T08:58:26.682 INFO:teuthology.orchestra.run.smithi194.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T08:58:26.696 INFO:teuthology.orchestra.run.smithi173.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T08:58:26.699 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T08:58:26.726 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-25T08:58:26.745 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-25T08:58:26.782 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T08:58:26.794 INFO:teuthology.orchestra.run.smithi194.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,398 B] 2024-04-25T08:58:26.814 INFO:teuthology.orchestra.run.smithi173.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,398 B] 2024-04-25T08:58:27.083 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 28.9 kB in 1s (49.2 kB/s) 2024-04-25T08:58:27.086 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 28.9 kB in 1s (50.5 kB/s) 2024-04-25T08:58:28.073 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-04-25T08:58:28.079 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-04-25T08:58:28.087 DEBUG:teuthology.orchestra.run.smithi173:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1628-g97ae6cc9-1jammy cephadm=19.0.0-1628-g97ae6cc9-1jammy ceph-mds=19.0.0-1628-g97ae6cc9-1jammy ceph-mgr=19.0.0-1628-g97ae6cc9-1jammy ceph-common=19.0.0-1628-g97ae6cc9-1jammy ceph-fuse=19.0.0-1628-g97ae6cc9-1jammy ceph-test=19.0.0-1628-g97ae6cc9-1jammy ceph-volume=19.0.0-1628-g97ae6cc9-1jammy radosgw=19.0.0-1628-g97ae6cc9-1jammy python3-rados=19.0.0-1628-g97ae6cc9-1jammy python3-rgw=19.0.0-1628-g97ae6cc9-1jammy python3-cephfs=19.0.0-1628-g97ae6cc9-1jammy python3-rbd=19.0.0-1628-g97ae6cc9-1jammy libcephfs2=19.0.0-1628-g97ae6cc9-1jammy libcephfs-dev=19.0.0-1628-g97ae6cc9-1jammy librados2=19.0.0-1628-g97ae6cc9-1jammy librbd1=19.0.0-1628-g97ae6cc9-1jammy rbd-fuse=19.0.0-1628-g97ae6cc9-1jammy python3-cephfs=19.0.0-1628-g97ae6cc9-1jammy cephfs-shell=19.0.0-1628-g97ae6cc9-1jammy cephfs-top=19.0.0-1628-g97ae6cc9-1jammy cephfs-mirror=19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T08:58:28.094 DEBUG:teuthology.orchestra.run.smithi194:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1628-g97ae6cc9-1jammy cephadm=19.0.0-1628-g97ae6cc9-1jammy ceph-mds=19.0.0-1628-g97ae6cc9-1jammy ceph-mgr=19.0.0-1628-g97ae6cc9-1jammy ceph-common=19.0.0-1628-g97ae6cc9-1jammy ceph-fuse=19.0.0-1628-g97ae6cc9-1jammy ceph-test=19.0.0-1628-g97ae6cc9-1jammy ceph-volume=19.0.0-1628-g97ae6cc9-1jammy radosgw=19.0.0-1628-g97ae6cc9-1jammy python3-rados=19.0.0-1628-g97ae6cc9-1jammy python3-rgw=19.0.0-1628-g97ae6cc9-1jammy python3-cephfs=19.0.0-1628-g97ae6cc9-1jammy python3-rbd=19.0.0-1628-g97ae6cc9-1jammy libcephfs2=19.0.0-1628-g97ae6cc9-1jammy libcephfs-dev=19.0.0-1628-g97ae6cc9-1jammy librados2=19.0.0-1628-g97ae6cc9-1jammy librbd1=19.0.0-1628-g97ae6cc9-1jammy rbd-fuse=19.0.0-1628-g97ae6cc9-1jammy python3-cephfs=19.0.0-1628-g97ae6cc9-1jammy cephfs-shell=19.0.0-1628-g97ae6cc9-1jammy cephfs-top=19.0.0-1628-g97ae6cc9-1jammy cephfs-mirror=19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T08:58:28.161 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-04-25T08:58:28.168 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-04-25T08:58:28.336 INFO:teuthology.orchestra.run.smithi173.stdout:Building dependency tree... 2024-04-25T08:58:28.336 INFO:teuthology.orchestra.run.smithi173.stdout:Reading state information... 2024-04-25T08:58:28.347 INFO:teuthology.orchestra.run.smithi194.stdout:Building dependency tree... 2024-04-25T08:58:28.347 INFO:teuthology.orchestra.run.smithi194.stdout:Reading state information... 2024-04-25T08:58:28.513 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T08:58:28.513 INFO:teuthology.orchestra.run.smithi173.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T08:58:28.513 INFO:teuthology.orchestra.run.smithi173.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T08:58:28.513 INFO:teuthology.orchestra.run.smithi173.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T08:58:28.513 INFO:teuthology.orchestra.run.smithi173.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T08:58:28.514 INFO:teuthology.orchestra.run.smithi173.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T08:58:28.514 INFO:teuthology.orchestra.run.smithi173.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T08:58:28.514 INFO:teuthology.orchestra.run.smithi173.stdout:The following additional packages will be installed: 2024-04-25T08:58:28.514 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T08:58:28.514 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T08:58:28.516 INFO:teuthology.orchestra.run.smithi173.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T08:58:28.516 INFO:teuthology.orchestra.run.smithi173.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T08:58:28.516 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T08:58:28.516 INFO:teuthology.orchestra.run.smithi173.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T08:58:28.516 INFO:teuthology.orchestra.run.smithi173.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T08:58:28.516 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T08:58:28.516 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T08:58:28.516 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T08:58:28.516 INFO:teuthology.orchestra.run.smithi173.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T08:58:28.517 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T08:58:28.517 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T08:58:28.517 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T08:58:28.517 INFO:teuthology.orchestra.run.smithi173.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T08:58:28.517 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T08:58:28.517 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T08:58:28.517 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T08:58:28.517 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T08:58:28.517 INFO:teuthology.orchestra.run.smithi173.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T08:58:28.517 INFO:teuthology.orchestra.run.smithi173.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T08:58:28.517 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T08:58:28.517 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T08:58:28.517 INFO:teuthology.orchestra.run.smithi173.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T08:58:28.518 INFO:teuthology.orchestra.run.smithi173.stdout:Suggested packages: 2024-04-25T08:58:28.518 INFO:teuthology.orchestra.run.smithi173.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T08:58:28.518 INFO:teuthology.orchestra.run.smithi173.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T08:58:28.518 INFO:teuthology.orchestra.run.smithi173.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T08:58:28.518 INFO:teuthology.orchestra.run.smithi173.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T08:58:28.518 INFO:teuthology.orchestra.run.smithi173.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T08:58:28.518 INFO:teuthology.orchestra.run.smithi173.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T08:58:28.518 INFO:teuthology.orchestra.run.smithi173.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T08:58:28.518 INFO:teuthology.orchestra.run.smithi173.stdout:Recommended packages: 2024-04-25T08:58:28.518 INFO:teuthology.orchestra.run.smithi173.stdout: btrfs-tools 2024-04-25T08:58:28.521 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T08:58:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T08:58:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T08:58:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T08:58:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T08:58:28.521 INFO:teuthology.orchestra.run.smithi194.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T08:58:28.522 INFO:teuthology.orchestra.run.smithi194.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T08:58:28.522 INFO:teuthology.orchestra.run.smithi194.stdout:The following additional packages will be installed: 2024-04-25T08:58:28.522 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T08:58:28.522 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T08:58:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T08:58:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T08:58:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T08:58:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T08:58:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T08:58:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T08:58:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T08:58:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T08:58:28.524 INFO:teuthology.orchestra.run.smithi194.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T08:58:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T08:58:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T08:58:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T08:58:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T08:58:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T08:58:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T08:58:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T08:58:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T08:58:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T08:58:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T08:58:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T08:58:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T08:58:28.525 INFO:teuthology.orchestra.run.smithi194.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T08:58:28.526 INFO:teuthology.orchestra.run.smithi194.stdout:Suggested packages: 2024-04-25T08:58:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T08:58:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T08:58:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T08:58:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T08:58:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T08:58:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T08:58:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T08:58:28.526 INFO:teuthology.orchestra.run.smithi194.stdout:Recommended packages: 2024-04-25T08:58:28.526 INFO:teuthology.orchestra.run.smithi194.stdout: btrfs-tools 2024-04-25T08:58:28.667 INFO:teuthology.orchestra.run.smithi173.stdout:The following NEW packages will be installed: 2024-04-25T08:58:28.667 INFO:teuthology.orchestra.run.smithi173.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T08:58:28.667 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T08:58:28.667 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T08:58:28.667 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T08:58:28.667 INFO:teuthology.orchestra.run.smithi173.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T08:58:28.667 INFO:teuthology.orchestra.run.smithi173.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T08:58:28.667 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T08:58:28.667 INFO:teuthology.orchestra.run.smithi173.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T08:58:28.669 INFO:teuthology.orchestra.run.smithi173.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T08:58:28.669 INFO:teuthology.orchestra.run.smithi173.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T08:58:28.669 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T08:58:28.669 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T08:58:28.669 INFO:teuthology.orchestra.run.smithi173.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T08:58:28.669 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T08:58:28.669 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T08:58:28.669 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T08:58:28.669 INFO:teuthology.orchestra.run.smithi173.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T08:58:28.669 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T08:58:28.669 INFO:teuthology.orchestra.run.smithi173.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T08:58:28.669 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T08:58:28.670 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T08:58:28.670 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T08:58:28.670 INFO:teuthology.orchestra.run.smithi173.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T08:58:28.670 INFO:teuthology.orchestra.run.smithi173.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T08:58:28.670 INFO:teuthology.orchestra.run.smithi173.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T08:58:28.670 INFO:teuthology.orchestra.run.smithi173.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T08:58:28.670 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T08:58:28.670 INFO:teuthology.orchestra.run.smithi173.stdout: socat unzip xmlstarlet zip 2024-04-25T08:58:28.675 INFO:teuthology.orchestra.run.smithi194.stdout:The following NEW packages will be installed: 2024-04-25T08:58:28.675 INFO:teuthology.orchestra.run.smithi194.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T08:58:28.675 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T08:58:28.676 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T08:58:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T08:58:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T08:58:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T08:58:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T08:58:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T08:58:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T08:58:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T08:58:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T08:58:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T08:58:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T08:58:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T08:58:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T08:58:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T08:58:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T08:58:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T08:58:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T08:58:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T08:58:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T08:58:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T08:58:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T08:58:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T08:58:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T08:58:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T08:58:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T08:58:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: socat unzip xmlstarlet zip 2024-04-25T08:58:28.816 INFO:teuthology.orchestra.run.smithi173.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-25T08:58:28.816 INFO:teuthology.orchestra.run.smithi173.stdout:Need to get 176 MB of archives. 2024-04-25T08:58:28.816 INFO:teuthology.orchestra.run.smithi173.stdout:After this operation, 732 MB of additional disk space will be used. 2024-04-25T08:58:28.817 INFO:teuthology.orchestra.run.smithi173.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1628-g97ae6cc9-1jammy [3,533 kB] 2024-04-25T08:58:28.824 INFO:teuthology.orchestra.run.smithi194.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-25T08:58:28.824 INFO:teuthology.orchestra.run.smithi194.stdout:Need to get 176 MB of archives. 2024-04-25T08:58:28.824 INFO:teuthology.orchestra.run.smithi194.stdout:After this operation, 732 MB of additional disk space will be used. 2024-04-25T08:58:28.824 INFO:teuthology.orchestra.run.smithi194.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1628-g97ae6cc9-1jammy [3,533 kB] 2024-04-25T08:58:28.873 INFO:teuthology.orchestra.run.smithi173.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T08:58:28.873 INFO:teuthology.orchestra.run.smithi194.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T08:58:28.959 INFO:teuthology.orchestra.run.smithi194.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T08:58:28.966 INFO:teuthology.orchestra.run.smithi173.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T08:58:29.006 INFO:teuthology.orchestra.run.smithi194.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T08:58:29.019 INFO:teuthology.orchestra.run.smithi173.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T08:58:29.123 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1628-g97ae6cc9-1jammy [3,217 kB] 2024-04-25T08:58:29.139 INFO:teuthology.orchestra.run.smithi194.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1628-g97ae6cc9-1jammy [3,217 kB] 2024-04-25T08:58:29.206 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T08:58:29.222 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T08:58:29.307 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1628-g97ae6cc9-1jammy [709 kB] 2024-04-25T08:58:29.308 INFO:teuthology.orchestra.run.smithi194.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T08:58:29.322 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T08:58:29.334 INFO:teuthology.orchestra.run.smithi194.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1628-g97ae6cc9-1jammy [709 kB] 2024-04-25T08:58:29.362 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1628-g97ae6cc9-1jammy [356 kB] 2024-04-25T08:58:29.373 INFO:teuthology.orchestra.run.smithi173.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T08:58:29.373 INFO:teuthology.orchestra.run.smithi173.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1628-g97ae6cc9-1jammy [32.8 kB] 2024-04-25T08:58:29.375 INFO:teuthology.orchestra.run.smithi173.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1628-g97ae6cc9-1jammy [180 kB] 2024-04-25T08:58:29.379 INFO:teuthology.orchestra.run.smithi194.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T08:58:29.389 INFO:teuthology.orchestra.run.smithi194.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1628-g97ae6cc9-1jammy [356 kB] 2024-04-25T08:58:29.397 INFO:teuthology.orchestra.run.smithi173.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T08:58:29.400 INFO:teuthology.orchestra.run.smithi194.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1628-g97ae6cc9-1jammy [32.8 kB] 2024-04-25T08:58:29.401 INFO:teuthology.orchestra.run.smithi194.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1628-g97ae6cc9-1jammy [180 kB] 2024-04-25T08:58:29.407 INFO:teuthology.orchestra.run.smithi194.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1628-g97ae6cc9-1jammy [64.8 kB] 2024-04-25T08:58:29.409 INFO:teuthology.orchestra.run.smithi194.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1628-g97ae6cc9-1jammy [330 kB] 2024-04-25T08:58:29.415 INFO:teuthology.orchestra.run.smithi173.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1628-g97ae6cc9-1jammy [64.8 kB] 2024-04-25T08:58:29.417 INFO:teuthology.orchestra.run.smithi173.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1628-g97ae6cc9-1jammy [330 kB] 2024-04-25T08:58:29.428 INFO:teuthology.orchestra.run.smithi173.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1628-g97ae6cc9-1jammy [6,575 kB] 2024-04-25T08:58:29.454 INFO:teuthology.orchestra.run.smithi194.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1628-g97ae6cc9-1jammy [6,575 kB] 2024-04-25T08:58:29.496 INFO:teuthology.orchestra.run.smithi173.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T08:58:29.582 INFO:teuthology.orchestra.run.smithi194.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T08:58:29.592 INFO:teuthology.orchestra.run.smithi194.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T08:58:29.636 INFO:teuthology.orchestra.run.smithi194.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T08:58:29.648 INFO:teuthology.orchestra.run.smithi194.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T08:58:29.818 INFO:teuthology.orchestra.run.smithi194.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T08:58:29.861 INFO:teuthology.orchestra.run.smithi173.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1628-g97ae6cc9-1jammy [112 kB] 2024-04-25T08:58:29.863 INFO:teuthology.orchestra.run.smithi173.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1628-g97ae6cc9-1jammy [467 kB] 2024-04-25T08:58:29.882 INFO:teuthology.orchestra.run.smithi194.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1628-g97ae6cc9-1jammy [112 kB] 2024-04-25T08:58:29.884 INFO:teuthology.orchestra.run.smithi194.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1628-g97ae6cc9-1jammy [467 kB] 2024-04-25T08:58:29.899 INFO:teuthology.orchestra.run.smithi194.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1628-g97ae6cc9-1jammy [24.1 MB] 2024-04-25T08:58:29.907 INFO:teuthology.orchestra.run.smithi173.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1628-g97ae6cc9-1jammy [24.1 MB] 2024-04-25T08:58:29.979 INFO:teuthology.orchestra.run.smithi173.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T08:58:30.011 INFO:teuthology.orchestra.run.smithi173.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T08:58:30.074 INFO:teuthology.orchestra.run.smithi173.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T08:58:30.086 INFO:teuthology.orchestra.run.smithi173.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T08:58:30.734 INFO:teuthology.orchestra.run.smithi194.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T08:58:30.816 INFO:teuthology.orchestra.run.smithi173.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T08:58:30.832 INFO:teuthology.orchestra.run.smithi194.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T08:58:30.936 INFO:teuthology.orchestra.run.smithi194.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T08:58:30.988 INFO:teuthology.orchestra.run.smithi194.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T08:58:31.002 INFO:teuthology.orchestra.run.smithi194.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T08:58:31.118 INFO:teuthology.orchestra.run.smithi194.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T08:58:31.229 INFO:teuthology.orchestra.run.smithi194.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T08:58:31.414 INFO:teuthology.orchestra.run.smithi194.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T08:58:31.444 INFO:teuthology.orchestra.run.smithi194.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T08:58:31.449 INFO:teuthology.orchestra.run.smithi194.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T08:58:31.489 INFO:teuthology.orchestra.run.smithi173.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1628-g97ae6cc9-1jammy [5,076 kB] 2024-04-25T08:58:31.502 INFO:teuthology.orchestra.run.smithi194.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1628-g97ae6cc9-1jammy [5,076 kB] 2024-04-25T08:58:31.692 INFO:teuthology.orchestra.run.smithi194.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T08:58:31.777 INFO:teuthology.orchestra.run.smithi194.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T08:58:31.792 INFO:teuthology.orchestra.run.smithi194.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T08:58:31.803 INFO:teuthology.orchestra.run.smithi194.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1628-g97ae6cc9-1jammy [243 kB] 2024-04-25T08:58:31.827 INFO:teuthology.orchestra.run.smithi173.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1628-g97ae6cc9-1jammy [243 kB] 2024-04-25T08:58:31.833 INFO:teuthology.orchestra.run.smithi173.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1628-g97ae6cc9-1jammy [124 kB] 2024-04-25T08:58:31.838 INFO:teuthology.orchestra.run.smithi173.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1628-g97ae6cc9-1jammy [1,520 kB] 2024-04-25T08:58:31.844 INFO:teuthology.orchestra.run.smithi194.stdout:Get:40 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1628-g97ae6cc9-1jammy [124 kB] 2024-04-25T08:58:31.849 INFO:teuthology.orchestra.run.smithi194.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1628-g97ae6cc9-1jammy [1,520 kB] 2024-04-25T08:58:31.858 INFO:teuthology.orchestra.run.smithi194.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T08:58:31.889 INFO:teuthology.orchestra.run.smithi194.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T08:58:31.915 INFO:teuthology.orchestra.run.smithi194.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T08:58:31.935 INFO:teuthology.orchestra.run.smithi194.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1628-g97ae6cc9-1jammy [6,237 kB] 2024-04-25T08:58:31.947 INFO:teuthology.orchestra.run.smithi194.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T08:58:31.959 INFO:teuthology.orchestra.run.smithi173.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1628-g97ae6cc9-1jammy [6,237 kB] 2024-04-25T08:58:32.124 INFO:teuthology.orchestra.run.smithi194.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T08:58:32.139 INFO:teuthology.orchestra.run.smithi194.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T08:58:32.147 INFO:teuthology.orchestra.run.smithi194.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T08:58:32.152 INFO:teuthology.orchestra.run.smithi194.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T08:58:32.340 INFO:teuthology.orchestra.run.smithi194.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T08:58:32.351 INFO:teuthology.orchestra.run.smithi173.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1628-g97ae6cc9-1jammy [22.7 MB] 2024-04-25T08:58:32.359 INFO:teuthology.orchestra.run.smithi173.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T08:58:32.360 INFO:teuthology.orchestra.run.smithi194.stdout:Get:52 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1628-g97ae6cc9-1jammy [22.7 MB] 2024-04-25T08:58:32.402 INFO:teuthology.orchestra.run.smithi173.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T08:58:32.423 INFO:teuthology.orchestra.run.smithi194.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T08:58:32.438 INFO:teuthology.orchestra.run.smithi194.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T08:58:32.444 INFO:teuthology.orchestra.run.smithi173.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T08:58:32.467 INFO:teuthology.orchestra.run.smithi173.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T08:58:32.469 INFO:teuthology.orchestra.run.smithi173.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T08:58:32.537 INFO:teuthology.orchestra.run.smithi173.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T08:58:32.620 INFO:teuthology.orchestra.run.smithi173.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T08:58:32.625 INFO:teuthology.orchestra.run.smithi194.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T08:58:32.658 INFO:teuthology.orchestra.run.smithi173.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T08:58:32.661 INFO:teuthology.orchestra.run.smithi173.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T08:58:32.667 INFO:teuthology.orchestra.run.smithi173.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T08:58:32.676 INFO:teuthology.orchestra.run.smithi194.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T08:58:32.688 INFO:teuthology.orchestra.run.smithi194.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T08:58:32.847 INFO:teuthology.orchestra.run.smithi194.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T08:58:32.847 INFO:teuthology.orchestra.run.smithi194.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T08:58:32.852 INFO:teuthology.orchestra.run.smithi194.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T08:58:32.858 INFO:teuthology.orchestra.run.smithi194.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T08:58:32.858 INFO:teuthology.orchestra.run.smithi173.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T08:58:32.871 INFO:teuthology.orchestra.run.smithi194.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T08:58:32.944 INFO:teuthology.orchestra.run.smithi173.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T08:58:32.961 INFO:teuthology.orchestra.run.smithi173.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T08:58:33.026 INFO:teuthology.orchestra.run.smithi173.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T08:58:33.056 INFO:teuthology.orchestra.run.smithi194.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T08:58:33.060 INFO:teuthology.orchestra.run.smithi173.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T08:58:33.080 INFO:teuthology.orchestra.run.smithi173.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T08:58:33.110 INFO:teuthology.orchestra.run.smithi173.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T08:58:33.282 INFO:teuthology.orchestra.run.smithi173.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T08:58:33.297 INFO:teuthology.orchestra.run.smithi173.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T08:58:33.304 INFO:teuthology.orchestra.run.smithi173.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T08:58:33.309 INFO:teuthology.orchestra.run.smithi173.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T08:58:33.319 INFO:teuthology.orchestra.run.smithi194.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T08:58:33.453 INFO:teuthology.orchestra.run.smithi194.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T08:58:33.494 INFO:teuthology.orchestra.run.smithi173.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T08:58:33.495 INFO:teuthology.orchestra.run.smithi194.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T08:58:33.584 INFO:teuthology.orchestra.run.smithi173.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T08:58:33.585 INFO:teuthology.orchestra.run.smithi194.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T08:58:33.595 INFO:teuthology.orchestra.run.smithi194.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T08:58:33.597 INFO:teuthology.orchestra.run.smithi173.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T08:58:33.608 INFO:teuthology.orchestra.run.smithi194.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T08:58:33.650 INFO:teuthology.orchestra.run.smithi194.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T08:58:33.780 INFO:teuthology.orchestra.run.smithi173.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T08:58:33.833 INFO:teuthology.orchestra.run.smithi173.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T08:58:33.838 INFO:teuthology.orchestra.run.smithi194.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1628-g97ae6cc9-1jammy [14.0 kB] 2024-04-25T08:58:33.838 INFO:teuthology.orchestra.run.smithi194.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1628-g97ae6cc9-1jammy [866 kB] 2024-04-25T08:58:33.845 INFO:teuthology.orchestra.run.smithi173.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T08:58:33.874 INFO:teuthology.orchestra.run.smithi173.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1628-g97ae6cc9-1jammy [14.0 kB] 2024-04-25T08:58:33.874 INFO:teuthology.orchestra.run.smithi173.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1628-g97ae6cc9-1jammy [866 kB] 2024-04-25T08:58:33.917 INFO:teuthology.orchestra.run.smithi194.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T08:58:33.918 INFO:teuthology.orchestra.run.smithi194.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T08:58:33.920 INFO:teuthology.orchestra.run.smithi194.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T08:58:33.935 INFO:teuthology.orchestra.run.smithi173.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1628-g97ae6cc9-1jammy [2,191 kB] 2024-04-25T08:58:33.980 INFO:teuthology.orchestra.run.smithi194.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1628-g97ae6cc9-1jammy [2,191 kB] 2024-04-25T08:58:34.001 INFO:teuthology.orchestra.run.smithi173.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T08:58:34.002 INFO:teuthology.orchestra.run.smithi173.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T08:58:34.007 INFO:teuthology.orchestra.run.smithi173.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T08:58:34.012 INFO:teuthology.orchestra.run.smithi173.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T08:58:34.027 INFO:teuthology.orchestra.run.smithi173.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T08:58:34.039 INFO:teuthology.orchestra.run.smithi173.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1628-g97ae6cc9-1jammy [776 kB] 2024-04-25T08:58:34.051 INFO:teuthology.orchestra.run.smithi194.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1628-g97ae6cc9-1jammy [776 kB] 2024-04-25T08:58:34.085 INFO:teuthology.orchestra.run.smithi194.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T08:58:34.090 INFO:teuthology.orchestra.run.smithi173.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1628-g97ae6cc9-1jammy [144 kB] 2024-04-25T08:58:34.095 INFO:teuthology.orchestra.run.smithi173.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1628-g97ae6cc9-1jammy [1,921 kB] 2024-04-25T08:58:34.115 INFO:teuthology.orchestra.run.smithi194.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1628-g97ae6cc9-1jammy [144 kB] 2024-04-25T08:58:34.120 INFO:teuthology.orchestra.run.smithi194.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1628-g97ae6cc9-1jammy [1,921 kB] 2024-04-25T08:58:34.211 INFO:teuthology.orchestra.run.smithi173.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T08:58:34.215 INFO:teuthology.orchestra.run.smithi173.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1628-g97ae6cc9-1jammy [8,625 kB] 2024-04-25T08:58:34.263 INFO:teuthology.orchestra.run.smithi194.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1628-g97ae6cc9-1jammy [8,625 kB] 2024-04-25T08:58:34.428 INFO:teuthology.orchestra.run.smithi194.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T08:58:34.476 INFO:teuthology.orchestra.run.smithi173.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T08:58:34.615 INFO:teuthology.orchestra.run.smithi173.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T08:58:34.658 INFO:teuthology.orchestra.run.smithi173.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T08:58:34.703 INFO:teuthology.orchestra.run.smithi173.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1628-g97ae6cc9-1jammy [14.2 kB] 2024-04-25T08:58:34.703 INFO:teuthology.orchestra.run.smithi173.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1628-g97ae6cc9-1jammy [49.9 MB] 2024-04-25T08:58:34.751 INFO:teuthology.orchestra.run.smithi173.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T08:58:34.761 INFO:teuthology.orchestra.run.smithi173.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T08:58:34.773 INFO:teuthology.orchestra.run.smithi173.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T08:58:34.819 INFO:teuthology.orchestra.run.smithi173.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T08:58:34.843 INFO:teuthology.orchestra.run.smithi194.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T08:58:34.852 INFO:teuthology.orchestra.run.smithi194.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T08:58:34.854 INFO:teuthology.orchestra.run.smithi194.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T08:58:34.927 INFO:teuthology.orchestra.run.smithi194.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T08:58:34.928 INFO:teuthology.orchestra.run.smithi194.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T08:58:34.928 INFO:teuthology.orchestra.run.smithi194.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T08:58:34.929 INFO:teuthology.orchestra.run.smithi194.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T08:58:34.930 INFO:teuthology.orchestra.run.smithi194.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T08:58:34.931 INFO:teuthology.orchestra.run.smithi194.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T08:58:34.951 INFO:teuthology.orchestra.run.smithi194.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1628-g97ae6cc9-1jammy [14.2 kB] 2024-04-25T08:58:34.951 INFO:teuthology.orchestra.run.smithi194.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1628-g97ae6cc9-1jammy [49.9 MB] 2024-04-25T08:58:35.095 INFO:teuthology.orchestra.run.smithi173.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T08:58:35.096 INFO:teuthology.orchestra.run.smithi173.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T08:58:35.097 INFO:teuthology.orchestra.run.smithi194.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T08:58:35.098 INFO:teuthology.orchestra.run.smithi173.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T08:58:35.304 INFO:teuthology.orchestra.run.smithi194.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T08:58:35.313 INFO:teuthology.orchestra.run.smithi173.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T08:58:35.634 INFO:teuthology.orchestra.run.smithi194.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T08:58:35.684 INFO:teuthology.orchestra.run.smithi194.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T08:58:35.713 INFO:teuthology.orchestra.run.smithi194.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T08:58:35.715 INFO:teuthology.orchestra.run.smithi173.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T08:58:35.722 INFO:teuthology.orchestra.run.smithi194.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T08:58:35.770 INFO:teuthology.orchestra.run.smithi194.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T08:58:35.797 INFO:teuthology.orchestra.run.smithi194.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T08:58:35.799 INFO:teuthology.orchestra.run.smithi194.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T08:58:35.806 INFO:teuthology.orchestra.run.smithi194.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T08:58:35.813 INFO:teuthology.orchestra.run.smithi194.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T08:58:36.014 INFO:teuthology.orchestra.run.smithi194.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T08:58:36.274 INFO:teuthology.orchestra.run.smithi194.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T08:58:36.543 INFO:teuthology.orchestra.run.smithi194.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T08:58:36.546 INFO:teuthology.orchestra.run.smithi194.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T08:58:36.562 INFO:teuthology.orchestra.run.smithi194.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T08:58:36.570 INFO:teuthology.orchestra.run.smithi194.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T08:58:36.609 INFO:teuthology.orchestra.run.smithi194.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T08:58:36.625 INFO:teuthology.orchestra.run.smithi194.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T08:58:36.718 INFO:teuthology.orchestra.run.smithi194.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T08:58:36.719 INFO:teuthology.orchestra.run.smithi194.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T08:58:36.722 INFO:teuthology.orchestra.run.smithi194.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T08:58:36.779 INFO:teuthology.orchestra.run.smithi173.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T08:58:36.817 INFO:teuthology.orchestra.run.smithi173.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T08:58:36.818 INFO:teuthology.orchestra.run.smithi173.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T08:58:36.909 INFO:teuthology.orchestra.run.smithi194.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T08:58:37.040 INFO:teuthology.orchestra.run.smithi173.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T08:58:37.040 INFO:teuthology.orchestra.run.smithi173.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T08:58:37.045 INFO:teuthology.orchestra.run.smithi173.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T08:58:37.105 INFO:teuthology.orchestra.run.smithi173.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T08:58:37.129 INFO:teuthology.orchestra.run.smithi173.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T08:58:37.132 INFO:teuthology.orchestra.run.smithi173.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T08:58:37.210 INFO:teuthology.orchestra.run.smithi194.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T08:58:37.312 INFO:teuthology.orchestra.run.smithi173.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T08:58:37.598 INFO:teuthology.orchestra.run.smithi173.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1628-g97ae6cc9-1jammy [121 kB] 2024-04-25T08:58:37.605 INFO:teuthology.orchestra.run.smithi173.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T08:58:37.615 INFO:teuthology.orchestra.run.smithi173.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-1628-g97ae6cc9-1jammy [228 kB] 2024-04-25T08:58:37.622 INFO:teuthology.orchestra.run.smithi173.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-1628-g97ae6cc9-1jammy [34.0 kB] 2024-04-25T08:58:37.623 INFO:teuthology.orchestra.run.smithi173.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-1628-g97ae6cc9-1jammy [23.4 kB] 2024-04-25T08:58:37.623 INFO:teuthology.orchestra.run.smithi173.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1628-g97ae6cc9-1jammy [38.4 kB] 2024-04-25T08:58:37.625 INFO:teuthology.orchestra.run.smithi173.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1628-g97ae6cc9-1jammy [13.0 MB] 2024-04-25T08:58:38.132 INFO:teuthology.orchestra.run.smithi173.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T08:58:38.216 INFO:teuthology.orchestra.run.smithi173.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T08:58:38.310 INFO:teuthology.orchestra.run.smithi173.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T08:58:38.332 INFO:teuthology.orchestra.run.smithi173.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T08:58:38.392 INFO:teuthology.orchestra.run.smithi173.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1628-g97ae6cc9-1jammy [91.5 kB] 2024-04-25T08:58:38.407 INFO:teuthology.orchestra.run.smithi173.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T08:58:38.499 INFO:teuthology.orchestra.run.smithi173.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T08:58:38.509 INFO:teuthology.orchestra.run.smithi173.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T08:58:38.526 INFO:teuthology.orchestra.run.smithi173.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T08:58:38.531 INFO:teuthology.orchestra.run.smithi173.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T08:58:38.533 INFO:teuthology.orchestra.run.smithi194.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1628-g97ae6cc9-1jammy [121 kB] 2024-04-25T08:58:38.534 INFO:teuthology.orchestra.run.smithi194.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-1628-g97ae6cc9-1jammy [228 kB] 2024-04-25T08:58:38.536 INFO:teuthology.orchestra.run.smithi194.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-1628-g97ae6cc9-1jammy [34.0 kB] 2024-04-25T08:58:38.537 INFO:teuthology.orchestra.run.smithi194.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-1628-g97ae6cc9-1jammy [23.4 kB] 2024-04-25T08:58:38.537 INFO:teuthology.orchestra.run.smithi194.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1628-g97ae6cc9-1jammy [38.4 kB] 2024-04-25T08:58:38.538 INFO:teuthology.orchestra.run.smithi194.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1628-g97ae6cc9-1jammy [13.0 MB] 2024-04-25T08:58:38.767 INFO:teuthology.orchestra.run.smithi173.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T08:58:38.968 INFO:teuthology.orchestra.run.smithi194.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1628-g97ae6cc9-1jammy [91.5 kB] 2024-04-25T08:58:39.087 INFO:teuthology.orchestra.run.smithi173.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T08:58:39.400 INFO:teuthology.orchestra.run.smithi173.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T08:58:39.401 INFO:teuthology.orchestra.run.smithi173.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T08:58:39.425 INFO:teuthology.orchestra.run.smithi173.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T08:58:39.431 INFO:teuthology.orchestra.run.smithi173.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T08:58:39.476 INFO:teuthology.orchestra.run.smithi173.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T08:58:39.498 INFO:teuthology.orchestra.run.smithi173.stdout:Get:119 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T08:58:39.605 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 176 MB in 10s (17.2 MB/s) 2024-04-25T08:58:39.667 INFO:teuthology.orchestra.run.smithi173.stdout:Get:120 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T08:58:39.670 INFO:teuthology.orchestra.run.smithi173.stdout:Get:121 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T08:58:39.672 INFO:teuthology.orchestra.run.smithi173.stdout:Get:122 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T08:58:39.755 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T08:58:39.820 INFO:teuthology.orchestra.run.smithi194.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-25T08:58:39.823 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T08:58:39.887 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T08:58:39.930 INFO:teuthology.orchestra.run.smithi173.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T08:58:40.164 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T08:58:40.178 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T08:58:40.223 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T08:58:40.509 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T08:58:40.522 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T08:58:40.554 INFO:teuthology.orchestra.run.smithi173.stdout:Get:124 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T08:58:40.567 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T08:58:40.912 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T08:58:40.925 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T08:58:41.012 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T08:58:41.340 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T08:58:41.354 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T08:58:41.398 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T08:58:41.743 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T08:58:41.758 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T08:58:41.801 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T08:58:42.003 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 176 MB in 13s (13.9 MB/s) 2024-04-25T08:58:42.169 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T08:58:42.236 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-25T08:58:42.240 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T08:58:42.263 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T08:58:42.278 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T08:58:42.293 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T08:58:42.321 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:58:42.628 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T08:58:42.642 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T08:58:42.695 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T08:58:42.699 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T08:58:42.714 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T08:58:42.757 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:58:43.048 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T08:58:43.061 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T08:58:43.106 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T08:58:43.143 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T08:58:43.158 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T08:58:43.202 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:58:43.442 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T08:58:43.456 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T08:58:43.542 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T08:58:43.546 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T08:58:43.562 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T08:58:43.596 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T08:58:43.854 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T08:58:43.869 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T08:58:43.904 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T08:58:44.083 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librados2. 2024-04-25T08:58:44.097 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../010-librados2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:44.141 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librados2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:44.266 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T08:58:44.281 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T08:58:44.324 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T08:58:44.560 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librbd1. 2024-04-25T08:58:44.575 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../011-librbd1_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:44.610 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librbd1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:44.786 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T08:58:44.800 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T08:58:44.852 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:58:45.004 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T08:58:45.019 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:45.088 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libcephfs2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:45.256 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T08:58:45.271 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T08:58:45.305 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:58:45.399 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rados. 2024-04-25T08:58:45.414 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../013-python3-rados_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:45.457 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rados (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:45.784 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T08:58:45.799 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:45.843 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-ceph-argparse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:45.869 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T08:58:45.885 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T08:58:46.009 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:58:46.087 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T08:58:46.101 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:46.137 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cephfs (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:46.387 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T08:58:46.401 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T08:58:46.445 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T08:58:46.448 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T08:58:46.463 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:46.523 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:46.740 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package librados2. 2024-04-25T08:58:46.755 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../010-librados2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:46.806 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librados2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:46.850 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T08:58:46.865 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T08:58:46.908 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T08:58:47.178 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T08:58:47.192 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:47.236 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rbd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:47.242 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package librbd1. 2024-04-25T08:58:47.256 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../011-librbd1_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:47.300 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librbd1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:47.597 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T08:58:47.613 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T08:58:47.672 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T08:58:47.728 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T08:58:47.742 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:47.786 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libcephfs2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:47.933 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T08:58:47.948 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T08:58:47.983 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T08:58:48.089 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rados. 2024-04-25T08:58:48.104 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../013-python3-rados_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:48.147 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rados (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:48.294 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T08:58:48.309 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T08:58:48.352 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T08:58:48.425 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T08:58:48.440 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:48.500 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-ceph-argparse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:48.689 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua5.1. 2024-04-25T08:58:48.704 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T08:58:48.744 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T08:58:48.747 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T08:58:48.759 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:48.802 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cephfs (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:49.147 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T08:58:49.162 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:49.205 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:49.283 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua-any. 2024-04-25T08:58:49.298 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T08:58:49.350 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T08:58:49.558 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T08:58:49.573 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T08:58:49.616 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T08:58:49.652 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package zip. 2024-04-25T08:58:49.667 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T08:58:49.719 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T08:58:49.894 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T08:58:49.909 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:49.946 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rbd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:50.097 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package unzip. 2024-04-25T08:58:50.111 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T08:58:50.155 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T08:58:50.288 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T08:58:50.303 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T08:58:50.347 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T08:58:50.609 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package luarocks. 2024-04-25T08:58:50.624 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T08:58:50.640 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T08:58:50.655 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T08:58:50.667 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T08:58:50.699 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T08:58:51.150 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librgw2. 2024-04-25T08:58:51.164 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../027-librgw2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:51.208 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librgw2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:51.235 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T08:58:51.250 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T08:58:51.293 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T08:58:51.622 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package lua5.1. 2024-04-25T08:58:51.637 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T08:58:51.671 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T08:58:51.685 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T08:58:51.700 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:51.752 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:52.000 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package lua-any. 2024-04-25T08:58:52.015 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T08:58:52.058 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T08:58:52.163 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T08:58:52.178 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T08:58:52.230 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T08:58:52.335 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package zip. 2024-04-25T08:58:52.350 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T08:58:52.393 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T08:58:52.641 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T08:58:52.655 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:52.688 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package unzip. 2024-04-25T08:58:52.703 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T08:58:52.707 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libradosstriper1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:52.771 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T08:58:53.161 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-common. 2024-04-25T08:58:53.167 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package luarocks. 2024-04-25T08:58:53.175 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../031-ceph-common_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:53.182 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T08:58:53.217 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T08:58:53.218 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:53.650 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package librgw2. 2024-04-25T08:58:53.663 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../027-librgw2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:53.708 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librgw2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:54.218 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T08:58:54.232 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:54.277 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:54.382 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-base. 2024-04-25T08:58:54.397 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../032-ceph-base_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:54.458 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-base (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:54.630 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T08:58:54.645 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T08:58:54.688 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T08:58:54.991 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T08:58:55.005 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:55.041 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libradosstriper1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:55.095 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T08:58:55.109 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T08:58:55.161 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T08:58:55.450 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T08:58:55.464 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T08:58:55.469 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-common. 2024-04-25T08:58:55.484 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../031-ceph-common_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:55.499 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T08:58:55.527 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:55.811 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T08:58:55.826 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T08:58:55.869 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T08:58:56.171 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T08:58:56.186 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T08:58:56.230 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T08:58:56.532 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T08:58:56.548 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T08:58:56.590 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T08:58:56.683 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-base. 2024-04-25T08:58:56.698 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../032-ceph-base_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:56.750 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-base (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:56.885 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T08:58:56.900 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T08:58:56.952 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T08:58:57.254 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-portend. 2024-04-25T08:58:57.270 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T08:58:57.312 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T08:58:57.336 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T08:58:57.350 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T08:58:57.395 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T08:58:57.607 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T08:58:57.622 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T08:58:57.665 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T08:58:57.698 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T08:58:57.712 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T08:58:57.748 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T08:58:57.935 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T08:58:57.950 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T08:58:57.984 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T08:58:58.067 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T08:58:58.082 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T08:58:58.125 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T08:58:58.388 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T08:58:58.403 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T08:58:58.445 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T08:58:58.454 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T08:58:58.460 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T08:58:58.503 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T08:58:58.782 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T08:58:58.797 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T08:58:58.841 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T08:58:58.856 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T08:58:58.871 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T08:58:58.914 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T08:58:59.201 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T08:58:59.215 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T08:58:59.231 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T08:58:59.245 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T08:58:59.250 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T08:58:59.293 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T08:58:59.528 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-portend. 2024-04-25T08:58:59.543 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T08:58:59.611 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T08:58:59.679 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-mako. 2024-04-25T08:58:59.694 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T08:58:59.746 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T08:58:59.922 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T08:58:59.937 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T08:59:00.014 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T08:59:00.074 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T08:59:00.089 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T08:59:00.132 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T08:59:00.300 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T08:59:00.315 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T08:59:00.358 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T08:59:00.427 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T08:59:00.442 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T08:59:00.476 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T08:59:00.712 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T08:59:00.727 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T08:59:00.770 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T08:59:01.107 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T08:59:01.122 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T08:59:01.165 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T08:59:01.371 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-webob. 2024-04-25T08:59:01.386 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T08:59:01.430 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T08:59:01.451 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T08:59:01.466 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T08:59:01.501 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T08:59:01.807 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T08:59:01.822 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T08:59:01.868 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T08:59:02.160 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T08:59:02.175 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T08:59:02.218 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T08:59:02.521 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-paste. 2024-04-25T08:59:02.536 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T08:59:02.562 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-mako. 2024-04-25T08:59:02.578 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T08:59:02.579 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T08:59:02.620 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T08:59:02.932 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T08:59:02.947 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T08:59:02.982 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T08:59:02.990 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T08:59:03.006 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T08:59:03.049 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T08:59:03.251 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T08:59:03.266 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T08:59:03.309 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T08:59:03.360 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T08:59:03.375 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T08:59:03.418 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T08:59:03.613 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T08:59:03.627 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T08:59:03.671 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T08:59:03.712 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-webob. 2024-04-25T08:59:03.728 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T08:59:03.762 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T08:59:03.973 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T08:59:03.988 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T08:59:04.032 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T08:59:04.040 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T08:59:04.055 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T08:59:04.101 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T08:59:04.353 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T08:59:04.368 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T08:59:04.403 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T08:59:04.418 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T08:59:04.433 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T08:59:04.476 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T08:59:04.747 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-idna. 2024-04-25T08:59:04.762 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T08:59:04.804 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-paste. 2024-04-25T08:59:04.805 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T08:59:04.820 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T08:59:04.862 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T08:59:05.108 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T08:59:05.123 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T08:59:05.132 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T08:59:05.147 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T08:59:05.158 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T08:59:05.215 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T08:59:05.453 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-requests. 2024-04-25T08:59:05.468 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T08:59:05.503 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T08:59:05.527 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T08:59:05.542 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T08:59:05.585 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T08:59:05.764 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T08:59:05.779 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T08:59:05.822 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T08:59:05.896 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T08:59:05.911 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T08:59:05.954 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T08:59:06.150 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T08:59:06.165 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:59:06.200 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:06.282 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T08:59:06.298 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T08:59:06.341 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T08:59:06.563 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T08:59:06.577 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:06.621 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:06.728 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T08:59:06.746 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T08:59:06.787 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T08:59:06.907 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T08:59:06.922 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T08:59:06.965 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T08:59:07.131 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-idna. 2024-04-25T08:59:07.147 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T08:59:07.189 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T08:59:07.201 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T08:59:07.216 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T08:59:07.259 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T08:59:07.534 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T08:59:07.549 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T08:59:07.592 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T08:59:07.637 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T08:59:07.652 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:07.695 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:07.937 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-requests. 2024-04-25T08:59:07.952 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T08:59:07.995 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T08:59:08.082 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T08:59:08.097 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:08.140 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mon (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:08.332 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T08:59:08.347 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T08:59:08.389 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T08:59:08.660 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T08:59:08.674 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:08.709 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T08:59:08.710 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-osd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:08.724 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:59:08.768 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:09.199 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T08:59:09.215 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:09.249 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:09.594 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T08:59:09.610 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T08:59:09.652 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T08:59:09.680 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph. 2024-04-25T08:59:09.695 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../068-ceph_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:09.737 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:09.955 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T08:59:09.970 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T08:59:10.004 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T08:59:10.057 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T08:59:10.072 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:10.124 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:10.399 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T08:59:10.415 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:10.457 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:10.502 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T08:59:10.517 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:10.551 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mds (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:10.861 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T08:59:10.876 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:10.912 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package cephadm. 2024-04-25T08:59:10.918 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mon (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:10.923 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../071-cephadm_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:10.954 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:11.281 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T08:59:11.297 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T08:59:11.340 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T08:59:11.651 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T08:59:11.663 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T08:59:11.701 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T08:59:11.755 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T08:59:11.771 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:11.813 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-osd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:12.608 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph. 2024-04-25T08:59:12.623 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../068-ceph_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:12.658 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:12.730 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-babel. 2024-04-25T08:59:12.742 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T08:59:12.780 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T08:59:13.002 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T08:59:13.018 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:13.061 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:13.141 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T08:59:13.152 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T08:59:13.183 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T08:59:13.455 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T08:59:13.470 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:13.485 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T08:59:13.497 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:59:13.513 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mds (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:13.527 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:13.847 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T08:59:13.859 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T08:59:13.897 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T08:59:13.908 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package cephadm. 2024-04-25T08:59:13.923 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../071-cephadm_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:13.958 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:14.175 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-routes. 2024-04-25T08:59:14.190 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T08:59:14.236 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T08:59:14.251 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T08:59:14.258 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T08:59:14.286 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T08:59:14.545 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T08:59:14.558 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:59:14.594 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:14.621 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T08:59:14.636 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T08:59:14.679 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T08:59:15.031 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T08:59:15.044 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T08:59:15.088 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T08:59:15.592 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T08:59:15.605 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T08:59:15.642 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T08:59:15.643 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-babel. 2024-04-25T08:59:15.656 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T08:59:15.701 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T08:59:15.987 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T08:59:15.999 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T08:59:16.029 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T08:59:16.043 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T08:59:16.087 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T08:59:16.122 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T08:59:16.425 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T08:59:16.439 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T08:59:16.457 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T08:59:16.470 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:59:16.475 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T08:59:16.515 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:16.868 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T08:59:16.882 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T08:59:16.926 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T08:59:17.167 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T08:59:17.180 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:59:17.217 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:17.263 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-routes. 2024-04-25T08:59:17.278 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T08:59:17.321 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T08:59:17.691 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T08:59:17.706 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:59:17.749 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:18.144 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T08:59:18.157 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T08:59:18.161 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T08:59:18.175 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T08:59:18.202 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T08:59:18.211 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T08:59:18.514 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T08:59:18.527 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T08:59:18.572 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T08:59:18.747 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T08:59:18.761 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T08:59:18.805 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T08:59:18.926 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T08:59:18.939 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T08:59:18.984 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T08:59:19.176 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T08:59:19.190 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T08:59:19.295 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T08:59:19.302 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T08:59:19.308 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T08:59:19.353 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T08:59:19.647 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T08:59:19.656 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T08:59:19.696 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T08:59:19.840 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T08:59:19.853 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T08:59:19.898 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T08:59:20.243 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T08:59:20.257 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T08:59:20.301 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T08:59:20.397 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T08:59:20.405 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:59:20.474 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:20.546 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T08:59:20.559 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T08:59:20.604 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T08:59:20.932 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T08:59:20.942 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T08:59:20.982 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T08:59:21.475 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T08:59:21.487 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T08:59:21.525 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T08:59:21.704 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T08:59:21.716 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:59:21.754 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:21.853 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T08:59:21.863 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T08:59:21.903 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T08:59:22.015 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T08:59:22.027 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T08:59:22.056 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T08:59:22.198 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T08:59:22.211 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T08:59:22.265 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T08:59:22.509 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T08:59:22.520 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T08:59:22.534 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T08:59:22.545 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T08:59:22.559 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T08:59:22.576 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T08:59:22.829 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package jq. 2024-04-25T08:59:22.841 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T08:59:22.878 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T08:59:22.922 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T08:59:22.932 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T08:59:22.971 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T08:59:23.122 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package socat. 2024-04-25T08:59:23.138 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T08:59:23.172 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T08:59:23.324 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T08:59:23.335 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T08:59:23.374 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T08:59:23.492 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T08:59:23.505 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T08:59:23.542 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T08:59:23.727 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T08:59:23.738 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T08:59:23.777 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T08:59:23.896 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-test. 2024-04-25T08:59:23.908 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../099-ceph-test_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:23.946 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-test (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:24.114 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T08:59:24.124 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T08:59:24.155 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T08:59:24.835 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T08:59:24.845 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:59:24.885 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:25.173 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T08:59:25.181 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T08:59:25.246 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T08:59:25.574 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T08:59:25.585 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T08:59:25.649 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T08:59:25.860 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package jq. 2024-04-25T08:59:25.870 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T08:59:25.908 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T08:59:25.910 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T08:59:25.921 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:59:25.958 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-volume (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:26.179 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package socat. 2024-04-25T08:59:26.190 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T08:59:26.229 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T08:59:26.295 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T08:59:26.308 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:26.336 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking cephfs-mirror (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:26.549 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T08:59:26.559 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T08:59:26.599 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T08:59:26.656 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T08:59:26.669 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T08:59:26.714 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T08:59:26.986 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-test. 2024-04-25T08:59:26.996 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../099-ceph-test_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:27.000 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T08:59:27.013 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:59:27.037 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-test (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:27.050 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking cephfs-shell (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:27.319 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T08:59:27.332 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:59:27.369 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking cephfs-top (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:27.613 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T08:59:27.626 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:27.663 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libcephfs-dev (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:27.924 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T08:59:27.936 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T08:59:27.982 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T08:59:28.345 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T08:59:28.360 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T08:59:28.403 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T08:59:28.790 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T08:59:28.804 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T08:59:28.848 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T08:59:28.974 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T08:59:28.984 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:59:29.023 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-volume (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:29.244 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package pkg-config. 2024-04-25T08:59:29.258 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T08:59:29.303 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T08:59:29.394 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T08:59:29.404 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:29.444 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking cephfs-mirror (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:29.530 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T08:59:29.544 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T08:59:29.589 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T08:59:29.713 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T08:59:29.720 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T08:59:29.763 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T08:59:30.015 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T08:59:30.023 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:59:30.035 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T08:59:30.049 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T08:59:30.057 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking cephfs-shell (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:30.093 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T08:59:30.301 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T08:59:30.311 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:59:30.393 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking cephfs-top (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:30.413 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T08:59:30.427 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T08:59:30.471 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T08:59:30.646 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T08:59:30.653 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:30.695 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libcephfs-dev (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:30.791 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T08:59:30.805 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T08:59:30.849 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T08:59:31.032 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T08:59:31.040 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T08:59:31.081 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T08:59:31.160 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T08:59:31.174 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T08:59:31.218 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T08:59:31.419 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T08:59:31.428 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T08:59:31.469 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T08:59:31.562 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-py. 2024-04-25T08:59:31.576 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T08:59:31.621 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T08:59:31.949 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T08:59:31.963 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T08:59:32.007 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T08:59:32.106 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T08:59:32.117 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T08:59:32.156 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T08:59:32.469 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T08:59:32.482 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T08:59:32.519 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T08:59:32.602 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package pkg-config. 2024-04-25T08:59:32.611 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T08:59:32.652 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T08:59:32.822 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-toml. 2024-04-25T08:59:32.835 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T08:59:32.871 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T08:59:32.931 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T08:59:32.939 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T08:59:32.972 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T08:59:33.141 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T08:59:33.155 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T08:59:33.199 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T08:59:33.375 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T08:59:33.383 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T08:59:33.425 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T08:59:33.528 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T08:59:33.542 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T08:59:33.586 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T08:59:33.744 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T08:59:33.753 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T08:59:33.794 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T08:59:33.872 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T08:59:33.886 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T08:59:33.921 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T08:59:34.148 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T08:59:34.157 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T08:59:34.205 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T08:59:34.492 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T08:59:34.501 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T08:59:34.583 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T08:59:34.625 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package radosgw. 2024-04-25T08:59:34.637 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../122-radosgw_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:34.675 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking radosgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:34.886 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-py. 2024-04-25T08:59:34.895 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T08:59:34.927 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T08:59:35.214 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T08:59:35.224 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T08:59:35.256 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T08:59:35.503 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T08:59:35.517 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:35.561 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking rbd-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:35.751 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T08:59:35.760 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T08:59:35.801 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T08:59:35.879 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T08:59:36.129 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-toml. 2024-04-25T08:59:36.138 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T08:59:36.141 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T08:59:36.179 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T08:59:36.283 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T08:59:36.515 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T08:59:36.523 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T08:59:36.538 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T08:59:36.564 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T08:59:36.956 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T08:59:36.960 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T08:59:36.969 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T08:59:37.010 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T08:59:37.313 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T08:59:37.322 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T08:59:37.354 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T08:59:37.566 INFO:teuthology.orchestra.run.smithi194.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T08:59:37.629 INFO:teuthology.orchestra.run.smithi194.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-25T08:59:37.669 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:38.099 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package radosgw. 2024-04-25T08:59:38.108 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../122-radosgw_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:38.149 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking radosgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:38.187 INFO:teuthology.orchestra.run.smithi194.stdout:Adding system user cephadm....done 2024-04-25T08:59:38.349 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T08:59:38.625 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T08:59:38.836 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T08:59:38.845 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:59:38.886 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking rbd-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:38.893 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T08:59:39.003 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T08:59:39.176 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T08:59:39.262 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T08:59:39.474 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T08:59:39.530 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T08:59:39.584 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T08:59:39.672 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T08:59:39.847 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T08:59:39.990 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T08:59:40.247 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T08:59:40.359 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T08:59:40.645 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T08:59:40.844 INFO:teuthology.orchestra.run.smithi173.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T08:59:40.890 INFO:teuthology.orchestra.run.smithi173.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-25T08:59:40.903 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T08:59:40.943 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:41.163 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T08:59:41.406 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T08:59:41.445 INFO:teuthology.orchestra.run.smithi173.stdout:Adding system user cephadm....done 2024-04-25T08:59:41.574 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T08:59:41.749 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T08:59:41.859 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T08:59:42.025 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T08:59:42.292 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-ceph-argparse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:42.318 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T08:59:42.444 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T08:59:42.569 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T08:59:42.677 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T08:59:42.729 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T08:59:42.779 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T08:59:42.997 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T08:59:43.038 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T08:59:43.172 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T08:59:43.172 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T08:59:43.431 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T08:59:43.491 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T08:59:43.834 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T08:59:43.868 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T08:59:43.870 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T08:59:43.935 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T08:59:44.061 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T08:59:44.128 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T08:59:44.379 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T08:59:44.428 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T08:59:44.529 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T08:59:44.671 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T08:59:44.789 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T08:59:44.948 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T08:59:45.065 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T08:59:45.207 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T08:59:45.374 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T08:59:45.509 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T08:59:45.525 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T08:59:45.776 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-ceph-argparse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:46.061 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T08:59:46.212 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T08:59:46.219 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T08:59:46.338 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T08:59:46.478 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T08:59:46.612 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T08:59:46.613 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T08:59:46.721 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T08:59:46.739 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T08:59:47.008 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T08:59:47.039 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T08:59:47.399 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T08:59:47.440 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T08:59:47.463 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T08:59:47.527 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T08:59:47.646 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T08:59:47.733 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T08:59:48.126 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T08:59:48.180 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T08:59:48.339 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T08:59:48.428 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T08:59:48.607 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T08:59:48.745 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T08:59:48.891 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T08:59:49.080 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T08:59:49.193 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T08:59:49.310 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T08:59:49.322 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T08:59:49.448 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:49.750 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T08:59:50.004 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T08:59:50.093 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T08:59:50.272 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T08:59:50.422 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T08:59:50.548 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T08:59:50.857 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T08:59:51.253 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T08:59:51.331 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T08:59:51.512 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T08:59:51.566 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:59:51.701 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T08:59:51.931 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T08:59:51.985 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T08:59:52.111 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T08:59:52.236 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T08:59:52.257 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T08:59:52.546 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T08:59:52.550 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T08:59:52.814 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T08:59:52.893 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T08:59:53.073 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:59:53.169 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T08:59:53.174 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T08:59:53.320 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:53.509 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T08:59:53.630 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T08:59:53.768 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T08:59:54.007 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T08:59:54.028 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T08:59:54.295 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T08:59:54.555 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T08:59:54.864 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T08:59:54.990 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T08:59:55.266 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T08:59:55.271 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T08:59:55.383 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T08:59:55.556 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:59:55.682 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T08:59:55.693 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T08:59:55.942 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T08:59:56.019 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T08:59:56.068 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T08:59:56.236 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T08:59:56.287 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T08:59:56.404 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T08:59:56.530 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T08:59:56.537 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T08:59:56.602 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T08:59:56.839 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T08:59:56.840 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T08:59:56.991 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T08:59:57.090 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:59:57.191 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T08:59:57.385 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T08:59:57.643 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T08:59:57.652 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T08:59:57.753 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T08:59:57.936 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T08:59:58.012 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:59:58.163 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T08:59:58.212 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T08:59:58.488 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T08:59:58.498 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T08:59:58.781 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T08:59:58.790 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T08:59:59.041 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T08:59:59.066 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T08:59:59.141 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T08:59:59.295 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T08:59:59.442 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T08:59:59.569 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T08:59:59.587 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T08:59:59.863 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T08:59:59.895 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T09:00:00.115 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T09:00:00.213 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T09:00:00.502 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T09:00:00.514 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T09:00:00.615 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T09:00:00.716 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T09:00:00.796 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T09:00:00.818 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T09:00:01.035 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T09:00:01.145 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T09:00:01.161 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T09:00:01.271 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librados2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:01.397 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:01.548 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T09:00:01.563 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T09:00:01.864 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T09:00:01.893 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libcephfs2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:01.990 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T09:00:02.002 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libradosstriper1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:02.111 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T09:00:02.250 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T09:00:02.367 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T09:00:02.396 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librbd1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:02.505 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-modules-core (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:02.615 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:02.694 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T09:00:02.833 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T09:00:02.833 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T09:00:03.028 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T09:00:03.313 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T09:00:03.516 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libcephfs-dev (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:03.541 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T09:00:03.692 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rados (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:03.801 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T09:00:03.851 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librgw2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:03.978 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up cephfs-top (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:04.103 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T09:00:04.120 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T09:00:04.371 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T09:00:04.773 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T09:00:05.066 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T09:00:05.416 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rbd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:05.435 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T09:00:05.550 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up rbd-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:05.595 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librados2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:05.660 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:05.721 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:05.761 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cephfs (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:05.847 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T09:00:05.862 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up cephfs-shell (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:06.192 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libcephfs2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:06.238 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:06.293 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libradosstriper1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:06.461 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T09:00:06.754 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librbd1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:06.906 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-modules-core (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:06.986 INFO:teuthology.orchestra.run.smithi194.stdout:Adding group ceph....done 2024-04-25T09:00:07.007 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:07.199 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T09:00:07.199 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T09:00:07.362 INFO:teuthology.orchestra.run.smithi194.stdout:Adding system user ceph....done 2024-04-25T09:00:07.523 INFO:teuthology.orchestra.run.smithi194.stdout:Setting system user ceph properties....done 2024-04-25T09:00:07.541 INFO:teuthology.orchestra.run.smithi194.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T09:00:07.684 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T09:00:07.858 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libcephfs-dev (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:08.009 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rados (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:08.086 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T09:00:08.169 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librgw2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:08.304 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up cephfs-top (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:08.430 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T09:00:08.792 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up cephfs-mirror (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:08.984 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T09:00:08.984 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T09:00:09.594 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-test (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:09.719 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up radosgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:09.743 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rbd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:09.903 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up rbd-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:10.029 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:10.155 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cephfs (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:10.258 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:00:10.258 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:00:10.264 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up cephfs-shell (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:10.390 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:10.921 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-base (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:10.952 INFO:teuthology.orchestra.run.smithi173.stdout:Adding group ceph....done 2024-04-25T09:00:11.239 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T09:00:11.362 INFO:teuthology.orchestra.run.smithi173.stdout:Adding system user ceph....done 2024-04-25T09:00:11.607 INFO:teuthology.orchestra.run.smithi173.stdout:Setting system user ceph properties....done 2024-04-25T09:00:11.625 INFO:teuthology.orchestra.run.smithi173.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T09:00:11.770 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T09:00:11.945 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mds (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:12.179 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T09:00:12.179 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T09:00:12.189 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T09:00:12.876 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:13.079 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T09:00:13.080 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T09:00:13.383 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up cephfs-mirror (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:13.594 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T09:00:13.595 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T09:00:13.718 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-osd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:14.006 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T09:00:14.007 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T09:00:14.217 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-test (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:14.343 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up radosgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:14.628 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:14.738 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:14.863 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mon (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:14.948 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:00:14.948 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:00:15.055 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T09:00:15.056 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T09:00:15.562 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-base (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:15.706 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:15.849 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:15.942 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T09:00:16.000 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-dashboard (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:16.118 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-volume (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:16.462 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T09:00:16.571 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T09:00:16.656 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mds (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:16.739 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T09:00:16.879 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T09:00:16.879 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T09:00:17.533 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:17.747 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T09:00:17.748 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T09:00:17.881 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T09:00:18.417 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-osd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:18.571 INFO:teuthology.orchestra.run.smithi194.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T09:00:18.576 DEBUG:teuthology.orchestra.run.smithi194:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T09:00:18.650 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-04-25T09:00:18.741 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T09:00:18.742 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T09:00:18.825 INFO:teuthology.orchestra.run.smithi194.stdout:Building dependency tree... 2024-04-25T09:00:18.825 INFO:teuthology.orchestra.run.smithi194.stdout:Reading state information... 2024-04-25T09:00:18.998 INFO:teuthology.orchestra.run.smithi194.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T09:00:18.998 INFO:teuthology.orchestra.run.smithi194.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T09:00:18.998 INFO:teuthology.orchestra.run.smithi194.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T09:00:18.998 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T09:00:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T09:00:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T09:00:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T09:00:18.999 INFO:teuthology.orchestra.run.smithi194.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T09:00:18.999 INFO:teuthology.orchestra.run.smithi194.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T09:00:18.999 INFO:teuthology.orchestra.run.smithi194.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T09:00:18.999 INFO:teuthology.orchestra.run.smithi194.stdout:The following additional packages will be installed: 2024-04-25T09:00:19.000 INFO:teuthology.orchestra.run.smithi194.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T09:00:19.000 INFO:teuthology.orchestra.run.smithi194.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T09:00:19.000 INFO:teuthology.orchestra.run.smithi194.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T09:00:19.000 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T09:00:19.000 INFO:teuthology.orchestra.run.smithi194.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T09:00:19.001 INFO:teuthology.orchestra.run.smithi194.stdout:Suggested packages: 2024-04-25T09:00:19.001 INFO:teuthology.orchestra.run.smithi194.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T09:00:19.001 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T09:00:19.001 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T09:00:19.054 INFO:teuthology.orchestra.run.smithi194.stdout:The following NEW packages will be installed: 2024-04-25T09:00:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T09:00:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T09:00:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T09:00:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T09:00:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T09:00:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T09:00:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T09:00:19.057 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages will be upgraded: 2024-04-25T09:00:19.058 INFO:teuthology.orchestra.run.smithi194.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T09:00:19.394 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:19.545 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:19.688 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mon (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:19.891 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T09:00:19.892 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T09:00:20.514 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:20.632 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:20.783 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-dashboard (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:20.926 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-volume (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:21.296 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T09:00:21.413 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T09:00:21.451 INFO:teuthology.orchestra.run.smithi194.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-25T09:00:21.451 INFO:teuthology.orchestra.run.smithi194.stdout:Need to get 55.7 MB of archives. 2024-04-25T09:00:21.451 INFO:teuthology.orchestra.run.smithi194.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T09:00:21.451 INFO:teuthology.orchestra.run.smithi194.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T09:00:21.607 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T09:00:22.157 INFO:teuthology.orchestra.run.smithi194.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T09:00:22.195 INFO:teuthology.orchestra.run.smithi194.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T09:00:22.315 INFO:teuthology.orchestra.run.smithi194.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T09:00:22.315 INFO:teuthology.orchestra.run.smithi194.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T09:00:22.328 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T09:00:22.347 INFO:teuthology.orchestra.run.smithi194.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T09:00:22.348 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T09:00:22.352 INFO:teuthology.orchestra.run.smithi194.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T09:00:22.353 INFO:teuthology.orchestra.run.smithi194.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T09:00:22.354 INFO:teuthology.orchestra.run.smithi194.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T09:00:22.355 INFO:teuthology.orchestra.run.smithi194.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T09:00:22.357 INFO:teuthology.orchestra.run.smithi194.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T09:00:22.399 INFO:teuthology.orchestra.run.smithi194.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T09:00:22.399 INFO:teuthology.orchestra.run.smithi194.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T09:00:22.400 INFO:teuthology.orchestra.run.smithi194.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T09:00:22.767 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T09:00:23.042 INFO:teuthology.orchestra.run.smithi194.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T09:00:23.044 INFO:teuthology.orchestra.run.smithi194.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T09:00:23.045 INFO:teuthology.orchestra.run.smithi194.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T09:00:23.047 INFO:teuthology.orchestra.run.smithi194.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T09:00:23.048 INFO:teuthology.orchestra.run.smithi194.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T09:00:23.052 INFO:teuthology.orchestra.run.smithi194.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T09:00:23.054 INFO:teuthology.orchestra.run.smithi194.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T09:00:23.069 INFO:teuthology.orchestra.run.smithi194.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T09:00:23.069 INFO:teuthology.orchestra.run.smithi194.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T09:00:23.126 INFO:teuthology.orchestra.run.smithi194.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T09:00:23.132 INFO:teuthology.orchestra.run.smithi194.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T09:00:23.154 INFO:teuthology.orchestra.run.smithi194.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T09:00:23.208 INFO:teuthology.orchestra.run.smithi194.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T09:00:23.215 INFO:teuthology.orchestra.run.smithi194.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T09:00:23.216 INFO:teuthology.orchestra.run.smithi194.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T09:00:23.218 INFO:teuthology.orchestra.run.smithi194.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T09:00:23.219 INFO:teuthology.orchestra.run.smithi194.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T09:00:23.247 INFO:teuthology.orchestra.run.smithi194.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T09:00:23.318 INFO:teuthology.orchestra.run.smithi194.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T09:00:23.519 INFO:teuthology.orchestra.run.smithi173.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T09:00:23.524 DEBUG:teuthology.orchestra.run.smithi173:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T09:00:23.598 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-04-25T09:00:23.715 INFO:teuthology.orchestra.run.smithi194.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T09:00:23.716 INFO:teuthology.orchestra.run.smithi194.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T09:00:23.716 INFO:teuthology.orchestra.run.smithi194.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T09:00:23.716 INFO:teuthology.orchestra.run.smithi194.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T09:00:23.716 INFO:teuthology.orchestra.run.smithi194.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T09:00:23.717 INFO:teuthology.orchestra.run.smithi194.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T09:00:23.751 INFO:teuthology.orchestra.run.smithi194.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T09:00:23.751 INFO:teuthology.orchestra.run.smithi194.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T09:00:23.773 INFO:teuthology.orchestra.run.smithi173.stdout:Building dependency tree... 2024-04-25T09:00:23.773 INFO:teuthology.orchestra.run.smithi173.stdout:Reading state information... 2024-04-25T09:00:23.948 INFO:teuthology.orchestra.run.smithi173.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T09:00:23.948 INFO:teuthology.orchestra.run.smithi173.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T09:00:23.948 INFO:teuthology.orchestra.run.smithi173.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T09:00:23.948 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T09:00:23.948 INFO:teuthology.orchestra.run.smithi173.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T09:00:23.948 INFO:teuthology.orchestra.run.smithi173.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T09:00:23.949 INFO:teuthology.orchestra.run.smithi173.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T09:00:23.950 INFO:teuthology.orchestra.run.smithi173.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T09:00:23.950 INFO:teuthology.orchestra.run.smithi173.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T09:00:23.950 INFO:teuthology.orchestra.run.smithi173.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T09:00:23.950 INFO:teuthology.orchestra.run.smithi173.stdout:The following additional packages will be installed: 2024-04-25T09:00:23.950 INFO:teuthology.orchestra.run.smithi173.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T09:00:23.950 INFO:teuthology.orchestra.run.smithi173.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T09:00:23.951 INFO:teuthology.orchestra.run.smithi173.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T09:00:23.951 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T09:00:23.951 INFO:teuthology.orchestra.run.smithi173.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T09:00:23.952 INFO:teuthology.orchestra.run.smithi173.stdout:Suggested packages: 2024-04-25T09:00:23.952 INFO:teuthology.orchestra.run.smithi173.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T09:00:23.952 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T09:00:23.952 INFO:teuthology.orchestra.run.smithi173.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T09:00:24.006 INFO:teuthology.orchestra.run.smithi173.stdout:The following NEW packages will be installed: 2024-04-25T09:00:24.007 INFO:teuthology.orchestra.run.smithi173.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T09:00:24.007 INFO:teuthology.orchestra.run.smithi173.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T09:00:24.007 INFO:teuthology.orchestra.run.smithi173.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T09:00:24.008 INFO:teuthology.orchestra.run.smithi173.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T09:00:24.008 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T09:00:24.008 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T09:00:24.008 INFO:teuthology.orchestra.run.smithi173.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T09:00:24.008 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages will be upgraded: 2024-04-25T09:00:24.009 INFO:teuthology.orchestra.run.smithi173.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T09:00:24.126 INFO:teuthology.orchestra.run.smithi194.stdout:Preconfiguring packages ... 2024-04-25T09:00:24.218 INFO:teuthology.orchestra.run.smithi173.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-25T09:00:24.218 INFO:teuthology.orchestra.run.smithi173.stdout:Need to get 55.7 MB of archives. 2024-04-25T09:00:24.218 INFO:teuthology.orchestra.run.smithi173.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T09:00:24.219 INFO:teuthology.orchestra.run.smithi173.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T09:00:24.287 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 55.7 MB in 5s (11.9 MB/s) 2024-04-25T09:00:24.525 INFO:teuthology.orchestra.run.smithi194.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140582 files and directories currently installed.) 2024-04-25T09:00:24.529 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T09:00:24.645 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T09:00:24.962 INFO:teuthology.orchestra.run.smithi173.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T09:00:24.983 INFO:teuthology.orchestra.run.smithi173.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T09:00:25.123 INFO:teuthology.orchestra.run.smithi173.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T09:00:25.124 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T09:00:25.124 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T09:00:25.154 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T09:00:25.155 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T09:00:25.159 INFO:teuthology.orchestra.run.smithi173.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T09:00:25.160 INFO:teuthology.orchestra.run.smithi173.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T09:00:25.162 INFO:teuthology.orchestra.run.smithi173.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T09:00:25.296 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T09:00:25.340 INFO:teuthology.orchestra.run.smithi173.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T09:00:25.650 INFO:teuthology.orchestra.run.smithi173.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T09:00:25.661 INFO:teuthology.orchestra.run.smithi173.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T09:00:25.665 INFO:teuthology.orchestra.run.smithi173.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T09:00:25.756 INFO:teuthology.orchestra.run.smithi173.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T09:00:26.378 INFO:teuthology.orchestra.run.smithi194.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T09:00:26.676 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package flex. 2024-04-25T09:00:26.746 INFO:teuthology.orchestra.run.smithi194.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140582 files and directories currently installed.) 2024-04-25T09:00:26.749 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T09:00:26.800 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T09:00:26.824 INFO:teuthology.orchestra.run.smithi173.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T09:00:26.825 INFO:teuthology.orchestra.run.smithi173.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T09:00:26.826 INFO:teuthology.orchestra.run.smithi173.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T09:00:26.829 INFO:teuthology.orchestra.run.smithi173.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T09:00:26.829 INFO:teuthology.orchestra.run.smithi173.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T09:00:26.833 INFO:teuthology.orchestra.run.smithi173.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T09:00:27.010 INFO:teuthology.orchestra.run.smithi173.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T09:00:27.369 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T09:00:27.547 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T09:00:27.675 INFO:teuthology.orchestra.run.smithi173.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T09:00:27.675 INFO:teuthology.orchestra.run.smithi173.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T09:00:27.980 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T09:00:27.993 INFO:teuthology.orchestra.run.smithi173.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T09:00:27.994 INFO:teuthology.orchestra.run.smithi173.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T09:00:28.037 INFO:teuthology.orchestra.run.smithi173.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T09:00:28.105 INFO:teuthology.orchestra.run.smithi173.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T09:00:28.111 INFO:teuthology.orchestra.run.smithi173.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T09:00:28.112 INFO:teuthology.orchestra.run.smithi173.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T09:00:28.113 INFO:teuthology.orchestra.run.smithi173.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T09:00:28.113 INFO:teuthology.orchestra.run.smithi173.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T09:00:28.337 INFO:teuthology.orchestra.run.smithi173.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T09:00:28.551 INFO:teuthology.orchestra.run.smithi194.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140655 files and directories currently installed.) 2024-04-25T09:00:28.555 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T09:00:28.696 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T09:00:28.805 INFO:teuthology.orchestra.run.smithi173.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T09:00:29.058 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T09:00:29.202 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T09:00:29.583 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T09:00:29.994 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package bison. 2024-04-25T09:00:30.070 INFO:teuthology.orchestra.run.smithi194.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140655 files and directories currently installed.) 2024-04-25T09:00:30.074 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T09:00:30.129 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T09:00:30.564 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T09:00:30.579 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T09:00:30.622 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T09:00:30.941 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package dump. 2024-04-25T09:00:30.957 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T09:00:30.991 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T09:00:31.262 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package indent. 2024-04-25T09:00:31.278 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:00:31.337 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T09:00:31.598 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T09:00:31.614 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T09:00:31.681 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T09:00:32.035 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T09:00:32.051 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T09:00:32.093 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T09:00:32.313 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T09:00:32.329 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T09:00:32.371 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T09:00:32.708 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T09:00:32.723 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T09:00:32.766 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T09:00:33.027 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T09:00:33.043 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T09:00:33.085 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T09:00:33.321 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T09:00:33.337 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T09:00:33.371 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T09:00:33.691 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T09:00:33.706 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T09:00:33.749 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T09:00:35.144 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T09:00:35.159 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T09:00:35.218 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:00:35.496 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T09:00:35.512 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T09:00:35.554 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:00:35.949 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T09:00:35.965 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T09:00:36.015 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:00:36.451 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T09:00:36.467 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T09:00:36.518 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T09:00:36.896 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T09:00:36.912 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T09:00:36.954 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T09:00:37.382 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T09:00:37.398 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:00:37.465 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:00:37.876 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T09:00:37.892 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:00:37.943 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:00:38.246 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T09:00:38.262 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:00:38.312 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:00:38.590 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T09:00:38.606 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T09:00:38.656 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T09:00:39.210 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T09:00:39.226 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T09:00:39.276 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T09:00:39.655 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package modemmanager. 2024-04-25T09:00:39.671 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T09:00:39.742 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:00:40.486 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package network-manager. 2024-04-25T09:00:40.502 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T09:00:40.561 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T09:00:41.251 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ppp. 2024-04-25T09:00:41.268 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T09:00:41.620 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T09:00:41.973 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T09:00:41.987 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T09:00:42.048 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T09:00:42.258 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T09:00:42.273 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T09:00:42.656 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T09:00:42.945 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T09:00:42.961 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T09:00:42.995 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T09:00:43.323 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T09:00:43.340 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:00:43.382 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:00:43.962 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T09:00:43.977 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T09:00:44.039 INFO:teuthology.orchestra.run.smithi194.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T09:00:44.069 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking postgresql-common (238) ... 2024-04-25T09:00:44.493 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T09:00:44.509 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:00:44.554 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:00:45.629 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package postgresql. 2024-04-25T09:00:45.644 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T09:00:45.687 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking postgresql (14+238) ... 2024-04-25T09:00:45.931 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T09:00:45.946 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T09:00:45.989 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T09:00:46.233 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T09:00:46.248 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T09:00:46.291 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T09:00:46.552 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T09:00:46.568 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T09:00:46.610 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T09:00:46.913 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package tcl. 2024-04-25T09:00:46.929 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T09:00:46.976 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T09:00:47.324 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T09:00:47.340 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T09:00:47.374 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T09:00:47.837 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T09:00:47.853 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T09:00:47.904 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T09:00:48.331 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T09:00:48.347 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T09:00:48.398 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T09:00:48.708 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T09:00:48.896 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T09:00:49.022 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T09:00:49.148 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:00:49.274 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T09:00:49.400 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T09:00:49.543 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:00:50.492 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T09:00:50.589 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T09:00:50.943 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T09:00:50.943 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T09:00:51.658 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T09:00:51.784 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T09:00:51.910 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T09:00:52.020 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T09:00:52.121 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T09:00:52.222 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T09:00:52.348 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T09:00:52.499 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T09:00:53.521 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T09:00:53.599 INFO:teuthology.orchestra.run.smithi173.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T09:00:53.599 INFO:teuthology.orchestra.run.smithi173.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T09:00:53.604 INFO:teuthology.orchestra.run.smithi173.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T09:00:53.605 INFO:teuthology.orchestra.run.smithi173.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T09:00:53.626 INFO:teuthology.orchestra.run.smithi173.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T09:00:53.631 INFO:teuthology.orchestra.run.smithi173.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T09:00:53.672 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T09:00:53.767 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T09:00:53.831 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:00:53.932 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T09:00:54.033 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T09:00:54.142 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T09:00:54.269 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T09:00:54.475 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T09:00:54.545 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T09:00:54.671 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T09:00:54.864 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T09:00:54.990 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:00:55.116 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T09:00:55.284 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T09:00:55.410 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T09:00:55.873 INFO:teuthology.orchestra.run.smithi173.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T09:00:55.914 INFO:teuthology.orchestra.run.smithi173.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T09:00:55.992 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:00:55.992 INFO:teuthology.orchestra.run.smithi194.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T09:00:55.992 INFO:teuthology.orchestra.run.smithi194.stdout:which means they are currently configured by ifupdown: 2024-04-25T09:00:55.992 INFO:teuthology.orchestra.run.smithi194.stdout:- enp3s0f1 2024-04-25T09:00:55.992 INFO:teuthology.orchestra.run.smithi194.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T09:00:55.993 INFO:teuthology.orchestra.run.smithi194.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T09:00:55.993 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:00:56.125 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T09:00:56.407 INFO:teuthology.orchestra.run.smithi173.stdout:Preconfiguring packages ... 2024-04-25T09:00:56.522 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T09:00:56.554 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 55.7 MB in 32s (1,741 kB/s) 2024-04-25T09:00:56.817 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140582 files and directories currently installed.) 2024-04-25T09:00:56.821 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T09:00:56.938 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T09:00:56.980 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T09:00:57.647 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T09:00:57.654 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:00:57.797 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T09:00:57.923 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T09:00:58.049 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up postgresql-common (238) ... 2024-04-25T09:00:58.779 INFO:teuthology.orchestra.run.smithi173.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T09:00:58.993 INFO:teuthology.orchestra.run.smithi194.stdout:Adding user postgres to group ssl-cert 2024-04-25T09:00:59.003 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package flex. 2024-04-25T09:00:59.074 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140582 files and directories currently installed.) 2024-04-25T09:00:59.078 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T09:00:59.118 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T09:00:59.228 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:00:59.228 INFO:teuthology.orchestra.run.smithi194.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T09:00:59.509 INFO:teuthology.orchestra.run.smithi194.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T09:00:59.509 INFO:teuthology.orchestra.run.smithi194.stdout:Removing obsolete dictionary files: 2024-04-25T09:00:59.688 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T09:00:59.867 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T09:01:00.255 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T09:01:00.272 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T09:01:00.839 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140655 files and directories currently installed.) 2024-04-25T09:01:00.843 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T09:01:00.858 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:01:01.000 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T09:01:01.214 INFO:teuthology.orchestra.run.smithi194.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T09:01:01.242 INFO:teuthology.orchestra.run.smithi194.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T09:01:01.304 INFO:teuthology.orchestra.run.smithi194.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T09:01:01.304 INFO:teuthology.orchestra.run.smithi194.stdout:This user must also own the server process. 2024-04-25T09:01:01.304 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:01.304 INFO:teuthology.orchestra.run.smithi194.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T09:01:01.304 INFO:teuthology.orchestra.run.smithi194.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T09:01:01.304 INFO:teuthology.orchestra.run.smithi194.stdout:The default text search configuration will be set to "english". 2024-04-25T09:01:01.304 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:01.305 INFO:teuthology.orchestra.run.smithi194.stdout:Data page checksums are disabled. 2024-04-25T09:01:01.305 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:01.305 INFO:teuthology.orchestra.run.smithi194.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T09:01:01.305 INFO:teuthology.orchestra.run.smithi194.stdout:creating subdirectories ... ok 2024-04-25T09:01:01.305 INFO:teuthology.orchestra.run.smithi194.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T09:01:01.329 INFO:teuthology.orchestra.run.smithi194.stdout:selecting default max_connections ... 100 2024-04-25T09:01:01.363 INFO:teuthology.orchestra.run.smithi194.stdout:selecting default shared_buffers ... 128MB 2024-04-25T09:01:01.377 INFO:teuthology.orchestra.run.smithi194.stdout:selecting default time zone ... Etc/UTC 2024-04-25T09:01:01.378 INFO:teuthology.orchestra.run.smithi194.stdout:creating configuration files ... ok 2024-04-25T09:01:01.455 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T09:01:01.541 INFO:teuthology.orchestra.run.smithi194.stdout:running bootstrap script ... ok 2024-04-25T09:01:01.607 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T09:01:01.988 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T09:01:02.150 INFO:teuthology.orchestra.run.smithi194.stdout:performing post-bootstrap initialization ... ok 2024-04-25T09:01:02.434 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package bison. 2024-04-25T09:01:02.510 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140655 files and directories currently installed.) 2024-04-25T09:01:02.514 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T09:01:02.569 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T09:01:02.714 INFO:teuthology.orchestra.run.smithi194.stdout:syncing data to disk ... ok 2024-04-25T09:01:02.988 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T09:01:03.002 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T09:01:03.071 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T09:01:03.253 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T09:01:03.366 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package dump. 2024-04-25T09:01:03.381 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T09:01:03.416 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T09:01:03.703 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package indent. 2024-04-25T09:01:03.719 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:01:03.762 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T09:01:04.040 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T09:01:04.055 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T09:01:04.098 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T09:01:04.419 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T09:01:04.435 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T09:01:04.469 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T09:01:04.755 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T09:01:04.771 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T09:01:04.813 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T09:01:05.184 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T09:01:05.200 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T09:01:05.243 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T09:01:05.470 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T09:01:05.486 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T09:01:05.520 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T09:01:05.798 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T09:01:05.814 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T09:01:05.857 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T09:01:06.185 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T09:01:06.201 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T09:01:06.243 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T09:01:06.365 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:01:06.491 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T09:01:06.617 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up postgresql (14+238) ... 2024-04-25T09:01:06.743 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:01:06.878 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:01:07.122 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T09:01:07.122 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T09:01:07.696 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T09:01:07.712 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T09:01:07.746 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:01:07.905 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T09:01:07.997 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T09:01:08.025 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T09:01:08.041 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T09:01:08.083 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:01:08.341 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T09:01:08.428 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T09:01:08.444 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T09:01:08.476 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T09:01:08.486 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:01:08.828 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T09:01:08.844 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T09:01:08.889 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T09:01:09.192 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T09:01:09.208 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T09:01:09.275 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T09:01:09.620 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T09:01:09.636 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:01:09.695 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:01:10.015 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T09:01:10.031 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:01:10.061 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T09:01:10.107 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:01:10.153 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T09:01:10.402 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T09:01:10.417 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:01:10.460 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:01:10.686 INFO:teuthology.orchestra.run.smithi194.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T09:01:10.692 DEBUG:teuthology.parallel:result is None 2024-04-25T09:01:10.729 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T09:01:10.745 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T09:01:10.787 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T09:01:11.302 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T09:01:11.317 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T09:01:11.386 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T09:01:11.738 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package modemmanager. 2024-04-25T09:01:11.753 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T09:01:11.821 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:01:12.461 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package network-manager. 2024-04-25T09:01:12.474 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T09:01:12.519 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T09:01:13.194 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ppp. 2024-04-25T09:01:13.206 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T09:01:13.577 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T09:01:13.865 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T09:01:13.875 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T09:01:13.906 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T09:01:14.193 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T09:01:14.203 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T09:01:14.243 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T09:01:14.579 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T09:01:14.589 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T09:01:14.628 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T09:01:14.957 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T09:01:14.968 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:01:15.007 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:01:15.587 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T09:01:15.601 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T09:01:15.696 INFO:teuthology.orchestra.run.smithi173.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T09:01:15.727 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql-common (238) ... 2024-04-25T09:01:16.219 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T09:01:16.231 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:01:16.271 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:01:17.413 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql. 2024-04-25T09:01:17.426 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T09:01:17.463 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql (14+238) ... 2024-04-25T09:01:17.707 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T09:01:17.719 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T09:01:17.794 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T09:01:18.051 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T09:01:18.064 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T09:01:18.093 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T09:01:18.437 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T09:01:18.451 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T09:01:18.495 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T09:01:18.814 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package tcl. 2024-04-25T09:01:18.828 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T09:01:18.877 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T09:01:19.242 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T09:01:19.256 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T09:01:19.300 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T09:01:20.022 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T09:01:20.035 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T09:01:20.080 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T09:01:20.475 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T09:01:20.488 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T09:01:20.541 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T09:01:20.850 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T09:01:21.030 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T09:01:21.132 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T09:01:21.283 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:01:21.408 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T09:01:21.543 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T09:01:21.686 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:01:22.642 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T09:01:22.740 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T09:01:23.135 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T09:01:23.135 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T09:01:23.869 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T09:01:23.986 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T09:01:24.145 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T09:01:24.271 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T09:01:24.397 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T09:01:24.548 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T09:01:24.674 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T09:01:24.800 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T09:01:25.472 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T09:01:25.598 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T09:01:25.693 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T09:01:25.758 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:01:25.909 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T09:01:26.043 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T09:01:26.161 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T09:01:26.312 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T09:01:26.402 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T09:01:26.472 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T09:01:26.598 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T09:01:26.808 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T09:01:26.933 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:01:27.093 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T09:01:27.236 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T09:01:27.337 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T09:01:27.991 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:27.991 INFO:teuthology.orchestra.run.smithi173.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T09:01:27.991 INFO:teuthology.orchestra.run.smithi173.stdout:which means they are currently configured by ifupdown: 2024-04-25T09:01:27.991 INFO:teuthology.orchestra.run.smithi173.stdout:- enp3s0f1 2024-04-25T09:01:27.991 INFO:teuthology.orchestra.run.smithi173.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T09:01:27.991 INFO:teuthology.orchestra.run.smithi173.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T09:01:27.991 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:28.122 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T09:01:28.549 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T09:01:28.960 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T09:01:29.681 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:01:29.832 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T09:01:29.958 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T09:01:30.110 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql-common (238) ... 2024-04-25T09:01:31.045 INFO:teuthology.orchestra.run.smithi173.stdout:Adding user postgres to group ssl-cert 2024-04-25T09:01:31.321 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:31.321 INFO:teuthology.orchestra.run.smithi173.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T09:01:31.571 INFO:teuthology.orchestra.run.smithi173.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T09:01:31.571 INFO:teuthology.orchestra.run.smithi173.stdout:Removing obsolete dictionary files: 2024-04-25T09:01:32.325 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T09:01:32.778 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:01:33.115 INFO:teuthology.orchestra.run.smithi173.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T09:01:33.139 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T09:01:33.189 INFO:teuthology.orchestra.run.smithi173.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T09:01:33.189 INFO:teuthology.orchestra.run.smithi173.stdout:This user must also own the server process. 2024-04-25T09:01:33.189 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:33.189 INFO:teuthology.orchestra.run.smithi173.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T09:01:33.189 INFO:teuthology.orchestra.run.smithi173.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T09:01:33.189 INFO:teuthology.orchestra.run.smithi173.stdout:The default text search configuration will be set to "english". 2024-04-25T09:01:33.189 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:33.190 INFO:teuthology.orchestra.run.smithi173.stdout:Data page checksums are disabled. 2024-04-25T09:01:33.190 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:33.190 INFO:teuthology.orchestra.run.smithi173.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T09:01:33.191 INFO:teuthology.orchestra.run.smithi173.stdout:creating subdirectories ... ok 2024-04-25T09:01:33.191 INFO:teuthology.orchestra.run.smithi173.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T09:01:33.213 INFO:teuthology.orchestra.run.smithi173.stdout:selecting default max_connections ... 100 2024-04-25T09:01:33.247 INFO:teuthology.orchestra.run.smithi173.stdout:selecting default shared_buffers ... 128MB 2024-04-25T09:01:33.261 INFO:teuthology.orchestra.run.smithi173.stdout:selecting default time zone ... Etc/UTC 2024-04-25T09:01:33.262 INFO:teuthology.orchestra.run.smithi173.stdout:creating configuration files ... ok 2024-04-25T09:01:33.427 INFO:teuthology.orchestra.run.smithi173.stdout:running bootstrap script ... ok 2024-04-25T09:01:34.052 INFO:teuthology.orchestra.run.smithi173.stdout:performing post-bootstrap initialization ... ok 2024-04-25T09:01:34.574 INFO:teuthology.orchestra.run.smithi173.stdout:syncing data to disk ... ok 2024-04-25T09:01:35.087 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T09:01:38.168 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:01:38.294 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T09:01:38.420 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql (14+238) ... 2024-04-25T09:01:38.580 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:01:38.706 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:01:38.959 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T09:01:38.959 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T09:01:39.708 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T09:01:39.826 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T09:01:40.203 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T09:01:40.346 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T09:01:41.781 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T09:01:41.907 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T09:01:42.431 INFO:teuthology.orchestra.run.smithi173.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T09:01:42.438 DEBUG:teuthology.parallel:result is None 2024-04-25T09:01:42.438 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T09:01:42.578 DEBUG:teuthology.orchestra.run.smithi173:> dpkg-query -W -f '${Version}' ceph 2024-04-25T09:01:42.600 INFO:teuthology.orchestra.run.smithi173.stdout:19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T09:01:42.600 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T09:01:42.600 INFO:teuthology.task.install:The correct ceph version 19.0.0-1628-g97ae6cc9-1jammy is installed. 2024-04-25T09:01:42.603 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T09:01:42.768 DEBUG:teuthology.orchestra.run.smithi194:> dpkg-query -W -f '${Version}' ceph 2024-04-25T09:01:42.793 INFO:teuthology.orchestra.run.smithi194.stdout:19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T09:01:42.793 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T09:01:42.793 INFO:teuthology.task.install:The correct ceph version 19.0.0-1628-g97ae6cc9-1jammy is installed. 2024-04-25T09:01:42.795 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T09:01:42.795 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:01:42.795 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T09:01:42.815 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:01:42.815 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T09:01:42.863 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T09:01:42.863 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:01:42.863 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T09:01:42.881 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T09:01:42.941 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:01:42.941 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T09:01:42.963 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T09:01:43.025 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T09:01:43.025 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:01:43.025 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T09:01:43.044 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T09:01:43.105 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:01:43.105 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T09:01:43.125 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T09:01:43.189 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T09:01:43.189 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:01:43.189 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T09:01:43.208 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T09:01:43.268 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:01:43.268 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T09:01:43.289 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T09:01:43.353 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T09:01:43.444 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T09:01:43.444 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /var/log/ceph 2024-04-25T09:01:43.447 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /var/log/ceph 2024-04-25T09:01:43.467 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T09:01:43.468 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T09:01:43.509 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T09:01:43.530 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T09:01:43.530 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T09:01:43.570 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T09:01:43.599 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T09:01:43.599 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T09:01:43.600 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T09:01:43.600 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:01:43.600 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T09:01:43.634 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T09:01:43.718 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:01:43.718 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T09:01:43.727 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T09:01:43.823 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T09:01:43.823 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T09:01:43.823 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673000', 'branch': 'wip-neesingh-testing-240416', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/scrub}', 'email': 'neesingh@redhat.com', 'first_in_suite': False, 'job_id': '7673000', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-neesingh-testing-240416'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}}, 'kclient': {'syntax': 'v1'}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62537', 'sha1': '5787d42d10024ba410e822a8aba474331cb9af02'}}, 'owner': 'scheduled_neesingh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5869, 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-62537', 'suite_path': '/home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/neesingh-rh/ceph', 'suite_sha1': '5787d42d10024ba410e822a8aba474331cb9af02', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi173.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLkvIoXe1ldFsa6vib5Pod3FT+Y8mfSINne6Qh8b0hnzBal6UpcAhf1CpYuNHiW5h5pDSeDKtgpCOJcdBJlb11I=', 'smithi194.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKgNB14d8U35CxwERZTG5TB48fVp7dKCGBj1/xh8wDREGcGZyiP9UJgxSHiVCqaVM/UT+oR9XsyUNSYkhvSxFII='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_scrub_checks', 'tasks.cephfs.test_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_08:15:18', 'tube': 'smithi', 'user': 'neesingh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T09:01:43.824 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T09:01:43.827 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T09:01:43.874 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T09:01:43.877 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T09:01:43.941 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:01:43.941 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T09:01:43.949 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T09:01:43.949 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2024-04-25T09:01:43.998 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T09:01:43.998 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:01:43.998 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 880 Links: 1 2024-04-25T09:01:43.998 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:01:43.998 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-04-25 08:54:46.737352856 +0000 2024-04-25T09:01:43.999 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-04-25 08:54:46.445355463 +0000 2024-04-25T09:01:43.999 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-04-25 08:54:46.445355463 +0000 2024-04-25T09:01:43.999 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-04-25 08:54:46.445355463 +0000 2024-04-25T09:01:43.999 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T09:01:44.055 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:01:44.055 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:01:44.055 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.00035729 s, 1.4 MB/s 2024-04-25T09:01:44.057 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T09:01:44.108 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2024-04-25T09:01:44.162 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T09:01:44.162 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:01:44.162 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 894 Links: 1 2024-04-25T09:01:44.163 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:01:44.163 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-04-25 08:54:47.249348283 +0000 2024-04-25T09:01:44.163 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-04-25 08:54:46.985350641 +0000 2024-04-25T09:01:44.163 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-04-25 08:54:46.985350641 +0000 2024-04-25T09:01:44.163 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-04-25 08:54:46.985350641 +0000 2024-04-25T09:01:44.163 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T09:01:44.219 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:01:44.219 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:01:44.219 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.00035645 s, 1.4 MB/s 2024-04-25T09:01:44.221 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T09:01:44.272 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2024-04-25T09:01:44.326 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T09:01:44.327 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:01:44.327 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 912 Links: 1 2024-04-25T09:01:44.327 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:01:44.327 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-04-25 08:54:47.841342995 +0000 2024-04-25T09:01:44.327 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-04-25 08:54:47.553345567 +0000 2024-04-25T09:01:44.327 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-04-25 08:54:47.553345567 +0000 2024-04-25T09:01:44.327 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-04-25 08:54:47.553345567 +0000 2024-04-25T09:01:44.327 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T09:01:44.387 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:01:44.387 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:01:44.387 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000314632 s, 1.6 MB/s 2024-04-25T09:01:44.389 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T09:01:44.440 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2024-04-25T09:01:44.490 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T09:01:44.491 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:01:44.491 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 930 Links: 1 2024-04-25T09:01:44.491 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:01:44.491 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-04-25 08:54:48.417337849 +0000 2024-04-25T09:01:44.491 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-04-25 08:54:48.153340207 +0000 2024-04-25T09:01:44.491 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-04-25 08:54:48.153340207 +0000 2024-04-25T09:01:44.491 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-04-25 08:54:48.153340207 +0000 2024-04-25T09:01:44.491 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T09:01:44.551 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:01:44.551 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:01:44.551 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.00037118 s, 1.4 MB/s 2024-04-25T09:01:44.553 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T09:01:44.604 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:01:44.604 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:01:44.604 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T09:01:44.613 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T09:01:44.613 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2024-04-25T09:01:44.666 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T09:01:44.666 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:01:44.666 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 884 Links: 1 2024-04-25T09:01:44.666 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:01:44.666 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-04-25 08:54:38.086722680 +0000 2024-04-25T09:01:44.666 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-04-25 08:54:37.814725109 +0000 2024-04-25T09:01:44.666 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-04-25 08:54:37.814725109 +0000 2024-04-25T09:01:44.666 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-04-25 08:54:37.814725109 +0000 2024-04-25T09:01:44.667 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T09:01:44.728 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-04-25T09:01:44.728 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-04-25T09:01:44.728 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000416985 s, 1.2 MB/s 2024-04-25T09:01:44.729 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T09:01:44.784 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2024-04-25T09:01:44.838 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T09:01:44.838 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:01:44.838 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 903 Links: 1 2024-04-25T09:01:44.838 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:01:44.838 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-04-25 08:54:38.682717356 +0000 2024-04-25T09:01:44.838 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-04-25 08:54:38.410719786 +0000 2024-04-25T09:01:44.838 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-04-25 08:54:38.410719786 +0000 2024-04-25T09:01:44.838 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-04-25 08:54:38.410719786 +0000 2024-04-25T09:01:44.838 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T09:01:44.904 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-04-25T09:01:44.904 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-04-25T09:01:44.904 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.00038363 s, 1.3 MB/s 2024-04-25T09:01:44.906 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T09:01:44.960 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2024-04-25T09:01:45.009 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T09:01:45.010 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:01:45.010 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 920 Links: 1 2024-04-25T09:01:45.010 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:01:45.010 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-04-25 08:54:38.958714891 +0000 2024-04-25T09:01:45.010 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-04-25 08:54:38.954714927 +0000 2024-04-25T09:01:45.010 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-04-25 08:54:38.954714927 +0000 2024-04-25T09:01:45.010 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-04-25 08:54:38.954714927 +0000 2024-04-25T09:01:45.010 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T09:01:45.072 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-04-25T09:01:45.072 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-04-25T09:01:45.072 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000410722 s, 1.2 MB/s 2024-04-25T09:01:45.074 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T09:01:45.127 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2024-04-25T09:01:45.178 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T09:01:45.178 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:01:45.178 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 936 Links: 1 2024-04-25T09:01:45.178 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:01:45.178 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-04-25 08:54:39.802707353 +0000 2024-04-25T09:01:45.178 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-04-25 08:54:39.506709996 +0000 2024-04-25T09:01:45.178 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-04-25 08:54:39.506709996 +0000 2024-04-25T09:01:45.178 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-04-25 08:54:39.506709996 +0000 2024-04-25T09:01:45.178 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T09:01:45.243 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-04-25T09:01:45.244 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-04-25T09:01:45.244 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000392414 s, 1.3 MB/s 2024-04-25T09:01:45.246 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T09:01:45.303 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:01:45.304 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T09:01:45.304 INFO:tasks.ceph:Generating config... 2024-04-25T09:01:45.305 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T09:01:45.305 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T09:01:45.305 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T09:01:45.305 INFO:tasks.ceph:[client] pid file = 2024-04-25T09:01:45.305 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T09:01:45.305 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T09:01:45.305 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T09:01:45.305 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T09:01:45.305 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T09:01:45.305 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T09:01:45.306 INFO:tasks.ceph:[mds] mds cache max size = 1000 2024-04-25T09:01:45.306 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T09:01:45.306 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T09:01:45.306 INFO:tasks.ceph:[mds] mds log max segments = 1 2024-04-25T09:01:45.306 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T09:01:45.306 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T09:01:45.306 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T09:01:45.306 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T09:01:45.306 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T09:01:45.306 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T09:01:45.306 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T09:01:45.306 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T09:01:45.306 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T09:01:45.306 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T09:01:45.306 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T09:01:45.306 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T09:01:45.307 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T09:01:45.307 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-25T09:01:45.307 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-25T09:01:45.307 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T09:01:45.307 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T09:01:45.307 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-25T09:01:45.307 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T09:01:45.307 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T09:01:45.307 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T09:01:45.307 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T09:01:45.307 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T09:01:45.307 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T09:01:45.307 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T09:01:45.308 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T09:01:45.350 INFO:teuthology.orchestra.run.smithi173.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T09:01:45.361 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T09:01:45.452 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T09:01:45.471 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.173'), ('mon.b', '172.21.15.194'), ('mon.c', '[v2:172.21.15.194:3301,v1:172.21.15.194:6790]')] 2024-04-25T09:01:45.471 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.173,172.21.15.194,[v2:172.21.15.194:3301,v1:172.21.15.194:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T09:01:45.472 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:01:45.472 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T09:01:45.522 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.173 --add b 172.21.15.194 --addv c '[v2:172.21.15.194:3301,v1:172.21.15.194:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:01:45.612 INFO:teuthology.orchestra.run.smithi173.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:01:45.612 INFO:teuthology.orchestra.run.smithi173.stdout:monmaptool: generated fsid ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6 2024-04-25T09:01:45.612 INFO:teuthology.orchestra.run.smithi173.stdout:setting min_mon_release = quincy 2024-04-25T09:01:45.612 INFO:teuthology.orchestra.run.smithi173.stdout:epoch 0 2024-04-25T09:01:45.612 INFO:teuthology.orchestra.run.smithi173.stdout:fsid ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6 2024-04-25T09:01:45.613 INFO:teuthology.orchestra.run.smithi173.stdout:last_changed 2024-04-25T09:01:45.627985+0000 2024-04-25T09:01:45.613 INFO:teuthology.orchestra.run.smithi173.stdout:created 2024-04-25T09:01:45.627985+0000 2024-04-25T09:01:45.613 INFO:teuthology.orchestra.run.smithi173.stdout:min_mon_release 17 (quincy) 2024-04-25T09:01:45.613 INFO:teuthology.orchestra.run.smithi173.stdout:election_strategy: 1 2024-04-25T09:01:45.613 INFO:teuthology.orchestra.run.smithi173.stdout:0: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.a 2024-04-25T09:01:45.613 INFO:teuthology.orchestra.run.smithi173.stdout:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-04-25T09:01:45.613 INFO:teuthology.orchestra.run.smithi173.stdout:2: [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] mon.c 2024-04-25T09:01:45.613 INFO:teuthology.orchestra.run.smithi173.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T09:01:45.619 DEBUG:teuthology.orchestra.run.smithi173:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T09:01:45.627 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6... 2024-04-25T09:01:45.627 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:01:45.673 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:01:45.712 INFO:teuthology.orchestra.run.smithi173.stdout:[global] 2024-04-25T09:01:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: chdir = "" 2024-04-25T09:01:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:01:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: auth supported = cephx 2024-04-25T09:01:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: filestore xattr use omap = true 2024-04-25T09:01:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: mon clock drift allowed = 1.000 2024-04-25T09:01:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: osd crush chooseleaf type = 0 2024-04-25T09:01:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: auth debug = true 2024-04-25T09:01:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on old message = true 2024-04-25T09:01:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on bug = true 2024-04-25T09:01:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:01:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: mon pg warn max object skew = 0 2024-04-25T09:01:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:01:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:01:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default size = 2 2024-04-25T09:01:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow primary affinity = true 2024-04-25T09:01:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow pg remap = true 2024-04-25T09:01:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:01:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:01:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on no sortbitwise = false 2024-04-25T09:01:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:01:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on too few osds = false 2024-04-25T09:01:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:01:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:01:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: mon_allow_pool_size_one = true 2024-04-25T09:01:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:01:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: osd default data pool replay window = 5 2024-04-25T09:01:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: mon allow pool delete = true 2024-04-25T09:01:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: mon cluster log file level = debug 2024-04-25T09:01:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: debug asserts on shutdown = true 2024-04-25T09:01:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: mon health detail to clog = false 2024-04-25T09:01:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: mon host = "172.21.15.173,172.21.15.194,[v2:172.21.15.194:3301,v1:172.21.15.194:6790]" 2024-04-25T09:01:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on skipped message = False 2024-04-25T09:01:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: fsid = ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6 2024-04-25T09:01:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.715 INFO:teuthology.orchestra.run.smithi173.stdout:[osd] 2024-04-25T09:01:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: osd journal size = 100 2024-04-25T09:01:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub load threshold = 5.0 2024-04-25T09:01:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub max interval = 600 2024-04-25T09:01:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:01:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: osd recover clone overlap = true 2024-04-25T09:01:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: osd recovery max chunk = 1048576 2024-04-25T09:01:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug shutdown = true 2024-04-25T09:01:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug op order = true 2024-04-25T09:01:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify stray on activate = true 2024-04-25T09:01:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug trim objects = true 2024-04-25T09:01:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: osd open classes on start = true 2024-04-25T09:01:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug pg log writeout = true 2024-04-25T09:01:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:01:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: osd map max advance = 10 2024-04-25T09:01:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: journal zero on create = true 2024-04-25T09:01:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:01:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: filestore apply finisher threads = 3 2024-04-25T09:01:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: bdev debug aio = true 2024-04-25T09:01:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug misdirected ops = true 2024-04-25T09:01:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore block size = 96636764160 2024-04-25T09:01:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore fsck on mount = True 2024-04-25T09:01:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluefs = 20 2024-04-25T09:01:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluestore = 20 2024-04-25T09:01:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-04-25T09:01:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: debug osd = 20 2024-04-25T09:01:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: debug rocksdb = 10 2024-04-25T09:01:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:01:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd full ratio = 0.9 2024-04-25T09:01:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:01:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:01:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: osd objectstore = bluestore 2024-04-25T09:01:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: osd op complaint time = 180 2024-04-25T09:01:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.718 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr] 2024-04-25T09:01:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-04-25T09:01:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: debug mgr = 20 2024-04-25T09:01:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2024-04-25T09:01:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2024-04-25T09:01:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:01:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:01:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: mgr/telemetry/nag = false 2024-04-25T09:01:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.718 INFO:teuthology.orchestra.run.smithi173.stdout:[mon] 2024-04-25T09:01:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-04-25T09:01:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2024-04-25T09:01:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: debug paxos = 20 2024-04-25T09:01:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2024-04-25T09:01:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: mon data avail warn = 5 2024-04-25T09:01:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: mon mgr mkfs grace = 240 2024-04-25T09:01:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:01:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd reporter subtree level = osd 2024-04-25T09:01:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd prime pg temp = true 2024-04-25T09:01:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:01:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:01:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:01:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:01:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:01:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:01:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:01:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: # 1m isn't quite enough 2024-04-25T09:01:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:01:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:01:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: mon op complaint time = 120 2024-04-25T09:01:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:01:45.720 INFO:teuthology.orchestra.run.smithi173.stdout:[client] 2024-04-25T09:01:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: rgw cache enabled = true 2024-04-25T09:01:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable ops log = true 2024-04-25T09:01:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable usage log = true 2024-04-25T09:01:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:01:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:01:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: client mount timeout = 600 2024-04-25T09:01:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: debug client = 20 2024-04-25T09:01:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-04-25T09:01:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = "" 2024-04-25T09:01:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: rados mon op timeout = 900 2024-04-25T09:01:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: rados osd op timeout = 900 2024-04-25T09:01:45.721 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.a] 2024-04-25T09:01:45.721 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.b] 2024-04-25T09:01:45.721 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.c] 2024-04-25T09:01:45.721 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.a] 2024-04-25T09:01:45.721 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.c] 2024-04-25T09:01:45.721 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.b] 2024-04-25T09:01:45.722 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.d] 2024-04-25T09:01:45.722 INFO:teuthology.orchestra.run.smithi173.stdout:[mds] 2024-04-25T09:01:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: debug mds = 20 2024-04-25T09:01:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: debug mds balancer = 20 2024-04-25T09:01:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-04-25T09:01:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: mds cache max size = 1000 2024-04-25T09:01:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: mds debug frag = True 2024-04-25T09:01:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: mds debug scatterstat = True 2024-04-25T09:01:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: mds log max segments = 1 2024-04-25T09:01:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: mds op complaint time = 180 2024-04-25T09:01:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: mds verify scatter = True 2024-04-25T09:01:45.723 INFO:teuthology.orchestra.run.smithi173.stdout: osd op complaint time = 180 2024-04-25T09:01:45.723 INFO:teuthology.orchestra.run.smithi173.stdout: rados mon op timeout = 900 2024-04-25T09:01:45.723 INFO:teuthology.orchestra.run.smithi173.stdout: rados osd op timeout = 900 2024-04-25T09:01:45.723 INFO:teuthology.orchestra.run.smithi194.stdout:[global] 2024-04-25T09:01:45.723 INFO:teuthology.orchestra.run.smithi194.stdout: chdir = "" 2024-04-25T09:01:45.723 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:01:45.723 INFO:teuthology.orchestra.run.smithi194.stdout: auth supported = cephx 2024-04-25T09:01:45.723 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.723 INFO:teuthology.orchestra.run.smithi194.stdout: filestore xattr use omap = true 2024-04-25T09:01:45.723 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.724 INFO:teuthology.orchestra.run.smithi194.stdout: mon clock drift allowed = 1.000 2024-04-25T09:01:45.724 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.724 INFO:teuthology.orchestra.run.smithi194.stdout: osd crush chooseleaf type = 0 2024-04-25T09:01:45.724 INFO:teuthology.orchestra.run.smithi194.stdout: auth debug = true 2024-04-25T09:01:45.724 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.724 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on old message = true 2024-04-25T09:01:45.724 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on bug = true 2024-04-25T09:01:45.724 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.724 INFO:teuthology.orchestra.run.smithi194.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:01:45.724 INFO:teuthology.orchestra.run.smithi194.stdout: mon pg warn max object skew = 0 2024-04-25T09:01:45.724 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.724 INFO:teuthology.orchestra.run.smithi194.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:01:45.725 INFO:teuthology.orchestra.run.smithi194.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:01:45.725 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.725 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default size = 2 2024-04-25T09:01:45.725 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.725 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow primary affinity = true 2024-04-25T09:01:45.725 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow pg remap = true 2024-04-25T09:01:45.725 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:01:45.725 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:01:45.725 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on no sortbitwise = false 2024-04-25T09:01:45.725 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:01:45.725 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on too few osds = false 2024-04-25T09:01:45.725 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:01:45.726 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:01:45.726 INFO:teuthology.orchestra.run.smithi194.stdout: mon_allow_pool_size_one = true 2024-04-25T09:01:45.726 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.726 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:01:45.726 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.726 INFO:teuthology.orchestra.run.smithi194.stdout: osd default data pool replay window = 5 2024-04-25T09:01:45.726 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.726 INFO:teuthology.orchestra.run.smithi194.stdout: mon allow pool delete = true 2024-04-25T09:01:45.726 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.726 INFO:teuthology.orchestra.run.smithi194.stdout: mon cluster log file level = debug 2024-04-25T09:01:45.726 INFO:teuthology.orchestra.run.smithi194.stdout: debug asserts on shutdown = true 2024-04-25T09:01:45.726 INFO:teuthology.orchestra.run.smithi194.stdout: mon health detail to clog = false 2024-04-25T09:01:45.726 INFO:teuthology.orchestra.run.smithi194.stdout: mon host = "172.21.15.173,172.21.15.194,[v2:172.21.15.194:3301,v1:172.21.15.194:6790]" 2024-04-25T09:01:45.726 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on skipped message = False 2024-04-25T09:01:45.726 INFO:teuthology.orchestra.run.smithi194.stdout: fsid = ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6 2024-04-25T09:01:45.727 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.727 INFO:teuthology.orchestra.run.smithi194.stdout:[osd] 2024-04-25T09:01:45.727 INFO:teuthology.orchestra.run.smithi194.stdout: osd journal size = 100 2024-04-25T09:01:45.727 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.727 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub load threshold = 5.0 2024-04-25T09:01:45.727 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub max interval = 600 2024-04-25T09:01:45.727 INFO:teuthology.orchestra.run.smithi194.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:01:45.727 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.727 INFO:teuthology.orchestra.run.smithi194.stdout: osd recover clone overlap = true 2024-04-25T09:01:45.727 INFO:teuthology.orchestra.run.smithi194.stdout: osd recovery max chunk = 1048576 2024-04-25T09:01:45.727 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.727 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug shutdown = true 2024-04-25T09:01:45.727 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug op order = true 2024-04-25T09:01:45.727 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug verify stray on activate = true 2024-04-25T09:01:45.727 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug trim objects = true 2024-04-25T09:01:45.727 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.728 INFO:teuthology.orchestra.run.smithi194.stdout: osd open classes on start = true 2024-04-25T09:01:45.728 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug pg log writeout = true 2024-04-25T09:01:45.728 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.728 INFO:teuthology.orchestra.run.smithi194.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:01:45.728 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.728 INFO:teuthology.orchestra.run.smithi194.stdout: osd map max advance = 10 2024-04-25T09:01:45.728 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.728 INFO:teuthology.orchestra.run.smithi194.stdout: journal zero on create = true 2024-04-25T09:01:45.728 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.728 INFO:teuthology.orchestra.run.smithi194.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:01:45.728 INFO:teuthology.orchestra.run.smithi194.stdout: filestore apply finisher threads = 3 2024-04-25T09:01:45.728 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.728 INFO:teuthology.orchestra.run.smithi194.stdout: bdev debug aio = true 2024-04-25T09:01:45.728 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug misdirected ops = true 2024-04-25T09:01:45.728 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore block size = 96636764160 2024-04-25T09:01:45.728 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore fsck on mount = True 2024-04-25T09:01:45.729 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluefs = 20 2024-04-25T09:01:45.729 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluestore = 20 2024-04-25T09:01:45.729 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-04-25T09:01:45.729 INFO:teuthology.orchestra.run.smithi194.stdout: debug osd = 20 2024-04-25T09:01:45.729 INFO:teuthology.orchestra.run.smithi194.stdout: debug rocksdb = 10 2024-04-25T09:01:45.729 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:01:45.729 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd full ratio = 0.9 2024-04-25T09:01:45.729 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:01:45.729 INFO:teuthology.orchestra.run.smithi194.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:01:45.729 INFO:teuthology.orchestra.run.smithi194.stdout: osd objectstore = bluestore 2024-04-25T09:01:45.729 INFO:teuthology.orchestra.run.smithi194.stdout: osd op complaint time = 180 2024-04-25T09:01:45.729 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.729 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr] 2024-04-25T09:01:45.729 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-04-25T09:01:45.729 INFO:teuthology.orchestra.run.smithi194.stdout: debug mgr = 20 2024-04-25T09:01:45.729 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-04-25T09:01:45.730 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-04-25T09:01:45.730 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:01:45.730 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:01:45.730 INFO:teuthology.orchestra.run.smithi194.stdout: mgr/telemetry/nag = false 2024-04-25T09:01:45.730 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.730 INFO:teuthology.orchestra.run.smithi194.stdout:[mon] 2024-04-25T09:01:45.730 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-04-25T09:01:45.730 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-04-25T09:01:45.730 INFO:teuthology.orchestra.run.smithi194.stdout: debug paxos = 20 2024-04-25T09:01:45.730 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-04-25T09:01:45.730 INFO:teuthology.orchestra.run.smithi194.stdout: mon data avail warn = 5 2024-04-25T09:01:45.730 INFO:teuthology.orchestra.run.smithi194.stdout: mon mgr mkfs grace = 240 2024-04-25T09:01:45.730 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:01:45.730 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd reporter subtree level = osd 2024-04-25T09:01:45.731 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd prime pg temp = true 2024-04-25T09:01:45.731 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:01:45.731 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.731 INFO:teuthology.orchestra.run.smithi194.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:01:45.731 INFO:teuthology.orchestra.run.smithi194.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:01:45.731 INFO:teuthology.orchestra.run.smithi194.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:01:45.731 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.731 INFO:teuthology.orchestra.run.smithi194.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:01:45.731 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:01:45.731 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:01:45.731 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.731 INFO:teuthology.orchestra.run.smithi194.stdout: # 1m isn't quite enough 2024-04-25T09:01:45.731 INFO:teuthology.orchestra.run.smithi194.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:01:45.731 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.731 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:01:45.731 INFO:teuthology.orchestra.run.smithi194.stdout: mon op complaint time = 120 2024-04-25T09:01:45.732 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-25T09:01:45.732 INFO:teuthology.orchestra.run.smithi194.stdout:[client] 2024-04-25T09:01:45.732 INFO:teuthology.orchestra.run.smithi194.stdout: rgw cache enabled = true 2024-04-25T09:01:45.732 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable ops log = true 2024-04-25T09:01:45.732 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable usage log = true 2024-04-25T09:01:45.732 INFO:teuthology.orchestra.run.smithi194.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:01:45.732 INFO:teuthology.orchestra.run.smithi194.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:01:45.732 INFO:teuthology.orchestra.run.smithi194.stdout: client mount timeout = 600 2024-04-25T09:01:45.732 INFO:teuthology.orchestra.run.smithi194.stdout: debug client = 20 2024-04-25T09:01:45.732 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-04-25T09:01:45.732 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = "" 2024-04-25T09:01:45.732 INFO:teuthology.orchestra.run.smithi194.stdout: rados mon op timeout = 900 2024-04-25T09:01:45.732 INFO:teuthology.orchestra.run.smithi194.stdout: rados osd op timeout = 900 2024-04-25T09:01:45.732 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.a] 2024-04-25T09:01:45.732 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.b] 2024-04-25T09:01:45.732 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.c] 2024-04-25T09:01:45.733 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.a] 2024-04-25T09:01:45.733 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.c] 2024-04-25T09:01:45.733 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.b] 2024-04-25T09:01:45.733 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.d] 2024-04-25T09:01:45.733 INFO:teuthology.orchestra.run.smithi194.stdout:[mds] 2024-04-25T09:01:45.733 INFO:teuthology.orchestra.run.smithi194.stdout: debug mds = 20 2024-04-25T09:01:45.733 INFO:teuthology.orchestra.run.smithi194.stdout: debug mds balancer = 20 2024-04-25T09:01:45.733 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-04-25T09:01:45.733 INFO:teuthology.orchestra.run.smithi194.stdout: mds cache max size = 1000 2024-04-25T09:01:45.733 INFO:teuthology.orchestra.run.smithi194.stdout: mds debug frag = True 2024-04-25T09:01:45.733 INFO:teuthology.orchestra.run.smithi194.stdout: mds debug scatterstat = True 2024-04-25T09:01:45.734 INFO:teuthology.orchestra.run.smithi194.stdout: mds log max segments = 1 2024-04-25T09:01:45.734 INFO:teuthology.orchestra.run.smithi194.stdout: mds op complaint time = 180 2024-04-25T09:01:45.734 INFO:teuthology.orchestra.run.smithi194.stdout: mds verify scatter = True 2024-04-25T09:01:45.734 INFO:teuthology.orchestra.run.smithi194.stdout: osd op complaint time = 180 2024-04-25T09:01:45.734 INFO:teuthology.orchestra.run.smithi194.stdout: rados mon op timeout = 900 2024-04-25T09:01:45.734 INFO:teuthology.orchestra.run.smithi194.stdout: rados osd op timeout = 900 2024-04-25T09:01:45.735 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T09:01:45.736 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T09:01:45.835 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T09:01:45.835 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:01:45.835 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T09:01:45.844 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:01:45.844 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T09:01:45.895 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:01:45.895 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:01:45.895 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T09:01:45.895 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T09:01:45.970 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:01:45.970 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:01:46.018 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi194.front.sepia.ceph.com 2024-04-25T09:01:46.018 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:01:46.018 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T09:01:46.019 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T09:01:46.053 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:01:46.053 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:01:46.109 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T09:01:46.109 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T09:01:46.109 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T09:01:46.163 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T09:01:46.169 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T09:01:46.230 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T09:01:46.248 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T09:01:46.249 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T09:01:46.302 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T09:01:46.307 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T09:01:46.326 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T09:01:46.420 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T09:01:46.424 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T09:01:46.443 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T09:01:46.502 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T09:01:46.506 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T09:01:46.527 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T09:01:46.624 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T09:01:46.629 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T09:01:46.648 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T09:01:46.649 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T09:01:46.690 INFO:teuthology.orchestra.run.smithi173.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T09:01:46.707 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-25T09:01:46.796 INFO:teuthology.orchestra.run.smithi173.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-25T09:01:46.813 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T09:01:46.854 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T09:01:46.871 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-25T09:01:46.954 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-25T09:01:46.971 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T09:01:46.971 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T09:01:46.971 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T09:01:46.990 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:01:46.990 INFO:tasks.ceph:role: osd.0 2024-04-25T09:01:46.990 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:01:46.990 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T09:01:47.056 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:01:47.057 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:01:47.057 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:01:47.057 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:01:47.057 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:01:47.057 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:01:47.057 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:01:47.057 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:01:47.057 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:01:47.057 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:01:47.447 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-04-25T09:01:47.449 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-04-25T09:01:47.450 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T09:01:47.543 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T09:01:47.559 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:01:47.560 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:01:47.560 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T09:01:47.626 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:01:47.626 INFO:tasks.ceph:role: osd.1 2024-04-25T09:01:47.626 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:01:47.626 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T09:01:47.698 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:01:47.699 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:01:47.699 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:01:47.699 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:01:47.699 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:01:47.699 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:01:47.699 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:01:47.699 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:01:47.699 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:01:47.699 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:01:48.105 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-04-25T09:01:48.109 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-04-25T09:01:48.109 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T09:01:48.240 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T09:01:48.256 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:01:48.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:01:48.257 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T09:01:48.322 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:01:48.322 INFO:tasks.ceph:role: osd.2 2024-04-25T09:01:48.323 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:01:48.323 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T09:01:48.390 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:01:48.390 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:01:48.390 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:01:48.390 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:01:48.390 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:01:48.390 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:01:48.391 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:01:48.391 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:01:48.391 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:01:48.391 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:01:48.802 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-04-25T09:01:48.806 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-04-25T09:01:48.806 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T09:01:48.937 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T09:01:48.954 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:01:48.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:01:48.955 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T09:01:49.020 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:01:49.020 INFO:tasks.ceph:role: osd.3 2024-04-25T09:01:49.020 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:01:49.020 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T09:01:49.091 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:01:49.091 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:01:49.091 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:01:49.091 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:01:49.091 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:01:49.091 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:01:49.092 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:01:49.092 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:01:49.092 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:01:49.092 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:01:49.461 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-04-25T09:01:49.461 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-04-25T09:01:49.461 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T09:01:49.541 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T09:01:49.604 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:01:49.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:01:49.605 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:01:49.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:49.734+0000 7f00a07b47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T09:01:49.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:49.742+0000 7f00a07b47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T09:01:49.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:49.742+0000 7f00a07b47c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T09:01:49.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:49.742+0000 7f00a07b47c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T09:01:49.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:49.742+0000 7f00a07b47c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T09:01:49.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:49.750+0000 7f00a07b47c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T09:01:52.803 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T09:01:52.824 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:01:52.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:52.938+0000 7fc0be1b67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T09:01:52.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:52.938+0000 7fc0be1b67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T09:01:52.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:52.938+0000 7fc0be1b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T09:01:52.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:52.938+0000 7fc0be1b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T09:01:52.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:52.938+0000 7fc0be1b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T09:01:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:52.938+0000 7fc0be1b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T09:01:55.958 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T09:01:55.978 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:01:56.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:56.082+0000 7f7db4a8e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T09:01:56.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:56.082+0000 7f7db4a8e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T09:01:56.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:56.082+0000 7f7db4a8e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T09:01:56.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:56.082+0000 7f7db4a8e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T09:01:56.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:56.082+0000 7f7db4a8e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T09:01:56.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:56.086+0000 7f7db4a8e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T09:01:59.129 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T09:01:59.150 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:01:59.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:59.258+0000 7f8707a657c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T09:01:59.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:59.258+0000 7f8707a657c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T09:01:59.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:59.258+0000 7f8707a657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T09:01:59.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:59.258+0000 7f8707a657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T09:01:59.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:59.258+0000 7f8707a657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T09:01:59.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:01:59.262+0000 7f8707a657c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T09:02:02.321 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T09:02:02.341 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T09:02:02.363 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:02:02.363 INFO:tasks.ceph:role: osd.4 2024-04-25T09:02:02.363 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com 2024-04-25T09:02:02.363 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T09:02:02.437 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:02:02.437 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:02:02.437 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:02:02.437 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:02:02.437 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:02:02.438 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:02:02.438 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:02:02.438 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:02:02.438 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:02:02.438 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:02:02.852 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-04-25T09:02:02.855 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-04-25T09:02:02.856 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T09:02:02.984 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T09:02:03.001 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:02:03.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:02:03.002 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T09:02:03.070 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:02:03.070 INFO:tasks.ceph:role: osd.5 2024-04-25T09:02:03.070 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com 2024-04-25T09:02:03.070 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T09:02:03.141 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:02:03.141 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:02:03.141 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:02:03.141 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:02:03.141 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:02:03.141 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:02:03.141 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:02:03.141 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:02:03.142 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:02:03.142 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:02:03.511 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-04-25T09:02:03.514 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-04-25T09:02:03.514 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T09:02:03.590 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T09:02:03.650 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:02:03.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:02:03.651 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T09:02:03.717 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:02:03.717 INFO:tasks.ceph:role: osd.6 2024-04-25T09:02:03.717 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com 2024-04-25T09:02:03.718 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T09:02:03.789 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:02:03.790 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:02:03.790 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:02:03.790 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:02:03.790 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:02:03.790 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:02:03.790 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:02:03.790 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:02:03.790 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:02:03.790 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:02:04.186 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-04-25T09:02:04.190 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-04-25T09:02:04.190 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T09:02:04.292 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T09:02:04.309 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:02:04.310 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:02:04.311 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T09:02:04.378 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:02:04.378 INFO:tasks.ceph:role: osd.7 2024-04-25T09:02:04.378 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com 2024-04-25T09:02:04.378 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T09:02:04.450 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:02:04.450 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:02:04.450 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:02:04.451 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:02:04.451 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:02:04.451 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:02:04.451 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:02:04.451 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:02:04.451 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:02:04.451 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:02:04.854 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-04-25T09:02:04.857 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-04-25T09:02:04.857 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T09:02:04.969 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T09:02:04.987 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:02:04.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:02:04.988 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:02:05.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:05.134+0000 7fdf3bd317c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T09:02:05.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:05.134+0000 7fdf3bd317c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T09:02:05.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:05.134+0000 7fdf3bd317c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T09:02:05.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:05.134+0000 7fdf3bd317c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T09:02:05.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:05.134+0000 7fdf3bd317c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T09:02:05.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:05.146+0000 7fdf3bd317c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T09:02:08.171 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T09:02:08.192 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:02:08.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:08.298+0000 7eff69e607c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T09:02:08.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:08.298+0000 7eff69e607c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T09:02:08.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:08.298+0000 7eff69e607c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T09:02:08.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:08.298+0000 7eff69e607c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T09:02:08.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:08.298+0000 7eff69e607c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T09:02:08.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:08.302+0000 7eff69e607c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T09:02:11.333 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T09:02:11.355 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:02:11.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:11.462+0000 7fa56742c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T09:02:11.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:11.462+0000 7fa56742c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T09:02:11.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:11.462+0000 7fa56742c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T09:02:11.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:11.462+0000 7fa56742c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T09:02:11.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:11.462+0000 7fa56742c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T09:02:11.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:11.466+0000 7fa56742c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T09:02:13.826 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:02:13.830 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:02:14.512 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T09:02:14.533 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:02:14.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:14.638+0000 7f568082e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T09:02:14.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:14.638+0000 7f568082e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T09:02:14.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:14.638+0000 7f568082e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T09:02:14.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:14.638+0000 7f568082e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T09:02:14.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:14.638+0000 7f568082e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T09:02:14.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:14.642+0000 7f568082e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T09:02:17.664 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T09:02:17.685 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T09:02:17.686 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:02:17.686 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T09:02:17.708 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:02:17.708 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T09:02:17.776 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:02:17.777 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T09:02:17.840 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:02:17.840 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T09:02:17.904 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:02:17.904 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T09:02:17.968 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:02:17.968 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T09:02:18.032 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:02:18.032 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T09:02:18.092 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:02:18.092 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T09:02:18.113 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:02:18.114 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T09:02:18.174 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:02:18.174 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T09:02:18.237 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:02:18.237 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T09:02:18.297 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:02:18.297 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T09:02:18.357 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:02:18.357 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T09:02:18.421 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:02:18.421 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T09:02:18.485 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:02:18.485 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T09:02:18.494 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:02:18.494 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-25T09:02:18.548 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:02:18.548 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T09:02:18.557 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:02:18.557 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-25T09:02:18.610 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T09:02:18.610 DEBUG:teuthology.orchestra.run.smithi173:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T09:02:18.613 DEBUG:teuthology.orchestra.run.smithi194:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T09:02:18.657 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.y] 2024-04-25T09:02:18.657 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6GypmjCuzChAAomjH5vLVICqSFpyDVQeB4w== 2024-04-25T09:02:18.657 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.a] 2024-04-25T09:02:18.657 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6GypmnVr3EhAAn+C0Mb/MrYSZuQyr5QTXig== 2024-04-25T09:02:18.658 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.c] 2024-04-25T09:02:18.658 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6GypmQsv4GRAATNiD7udOvl8xRDIx64O5jg== 2024-04-25T09:02:18.658 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.0] 2024-04-25T09:02:18.658 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD9Gypm+Yw7LBAAnOFUKU3w1ltre7aHMWZ/SQ== 2024-04-25T09:02:18.658 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.1] 2024-04-25T09:02:18.658 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAAHCpm4BUIOBAAmbfWUWCun/una5WoemhL6Q== 2024-04-25T09:02:18.658 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.2] 2024-04-25T09:02:18.658 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAEHCpmFXIaBRAA0cN2GdLSS3jJC+x4RVUUlw== 2024-04-25T09:02:18.658 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.3] 2024-04-25T09:02:18.658 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAHHCpmUD+YDxAALPvf1wLzhuQmFPo3/vJkdQ== 2024-04-25T09:02:18.658 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.x] 2024-04-25T09:02:18.658 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6GypmMSqHDhAAe0nkrXbT7dBbAbI89ExUmw== 2024-04-25T09:02:18.658 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.b] 2024-04-25T09:02:18.658 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6Gypm0QfFHhAAuP8xE/8pvSZMcP8N33OB9Q== 2024-04-25T09:02:18.659 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.d] 2024-04-25T09:02:18.659 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6GypmtGMSJhAAonqLeuSsNrgyZks1eoJ1Gg== 2024-04-25T09:02:18.659 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.4] 2024-04-25T09:02:18.659 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQANHCpmLQ0fCBAA1Shz0Pfns+rj5r601hzOnQ== 2024-04-25T09:02:18.659 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.5] 2024-04-25T09:02:18.659 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAQHCpmyMj1ERAAMRvZ3PFQa9oe6oGemLvfxw== 2024-04-25T09:02:18.659 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.6] 2024-04-25T09:02:18.659 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQATHCpmKha6GxAAF4zfdFDlylGHHhGI5tVpGA== 2024-04-25T09:02:18.659 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.7] 2024-04-25T09:02:18.659 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAWHCpmB2lFJhAA3sYYsjS5DIC5fCDz6ur0tA== 2024-04-25T09:02:18.659 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2024-04-25T09:02:18.659 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w== 2024-04-25T09:02:18.659 INFO:teuthology.orchestra.run.smithi173.stdout:[client.2] 2024-04-25T09:02:18.659 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6GypmrTxjMBAAaqwDl5uiLxhaDIk7m6oDIw== 2024-04-25T09:02:18.660 INFO:teuthology.orchestra.run.smithi173.stdout:[client.1] 2024-04-25T09:02:18.660 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6Gypm1PbHMxAAXMrgpR/xgzfQuuNrculQxA== 2024-04-25T09:02:18.660 INFO:teuthology.orchestra.run.smithi173.stdout:[client.3] 2024-04-25T09:02:18.660 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6GypmlAS9ORAAvYbwLnUaDHXOqvEBwJJJcQ== 2024-04-25T09:02:18.671 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.y] 2024-04-25T09:02:18.671 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQD6GypmjCuzChAAomjH5vLVICqSFpyDVQeB4w== 2024-04-25T09:02:18.671 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.a] 2024-04-25T09:02:18.671 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQD6GypmnVr3EhAAn+C0Mb/MrYSZuQyr5QTXig== 2024-04-25T09:02:18.672 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.c] 2024-04-25T09:02:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQD6GypmQsv4GRAATNiD7udOvl8xRDIx64O5jg== 2024-04-25T09:02:18.672 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.0] 2024-04-25T09:02:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQD9Gypm+Yw7LBAAnOFUKU3w1ltre7aHMWZ/SQ== 2024-04-25T09:02:18.672 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.1] 2024-04-25T09:02:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAAHCpm4BUIOBAAmbfWUWCun/una5WoemhL6Q== 2024-04-25T09:02:18.672 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.2] 2024-04-25T09:02:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAEHCpmFXIaBRAA0cN2GdLSS3jJC+x4RVUUlw== 2024-04-25T09:02:18.672 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.3] 2024-04-25T09:02:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAHHCpmUD+YDxAALPvf1wLzhuQmFPo3/vJkdQ== 2024-04-25T09:02:18.672 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.x] 2024-04-25T09:02:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQD6GypmMSqHDhAAe0nkrXbT7dBbAbI89ExUmw== 2024-04-25T09:02:18.672 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.b] 2024-04-25T09:02:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQD6Gypm0QfFHhAAuP8xE/8pvSZMcP8N33OB9Q== 2024-04-25T09:02:18.673 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.d] 2024-04-25T09:02:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQD6GypmtGMSJhAAonqLeuSsNrgyZks1eoJ1Gg== 2024-04-25T09:02:18.673 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.4] 2024-04-25T09:02:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQANHCpmLQ0fCBAA1Shz0Pfns+rj5r601hzOnQ== 2024-04-25T09:02:18.673 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.5] 2024-04-25T09:02:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAQHCpmyMj1ERAAMRvZ3PFQa9oe6oGemLvfxw== 2024-04-25T09:02:18.673 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.6] 2024-04-25T09:02:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQATHCpmKha6GxAAF4zfdFDlylGHHhGI5tVpGA== 2024-04-25T09:02:18.673 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.7] 2024-04-25T09:02:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAWHCpmB2lFJhAA3sYYsjS5DIC5fCDz6ur0tA== 2024-04-25T09:02:18.673 INFO:teuthology.orchestra.run.smithi194.stdout:[client.0] 2024-04-25T09:02:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w== 2024-04-25T09:02:18.673 INFO:teuthology.orchestra.run.smithi194.stdout:[client.2] 2024-04-25T09:02:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQD6GypmrTxjMBAAaqwDl5uiLxhaDIk7m6oDIw== 2024-04-25T09:02:18.674 INFO:teuthology.orchestra.run.smithi194.stdout:[client.1] 2024-04-25T09:02:18.674 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQD6Gypm1PbHMxAAXMrgpR/xgzfQuuNrculQxA== 2024-04-25T09:02:18.674 INFO:teuthology.orchestra.run.smithi194.stdout:[client.3] 2024-04-25T09:02:18.674 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQD6GypmlAS9ORAAvYbwLnUaDHXOqvEBwJJJcQ== 2024-04-25T09:02:18.675 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T09:02:18.707 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T09:02:18.775 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:02:18.778 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:02:18.836 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:02:18.839 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:02:18.895 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:02:18.898 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:02:18.951 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:02:18.954 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:02:19.006 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:02:19.009 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:02:19.061 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:02:19.064 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:02:19.117 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T09:02:19.120 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T09:02:19.173 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:02:19.176 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:02:19.231 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:02:19.234 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:02:19.290 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:02:19.293 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:02:19.346 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:02:19.349 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:02:19.402 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:02:19.406 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:02:19.460 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:02:19.463 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:02:19.517 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:02:19.520 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:02:19.576 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:02:19.579 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:02:19.634 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:02:19.637 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:02:19.693 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:02:19.696 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:02:19.751 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T09:02:19.752 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T09:02:19.771 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T09:02:19.878 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T09:02:19.898 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T09:02:19.917 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T09:02:20.028 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T09:02:20.048 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T09:02:20.112 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T09:02:20.225 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T09:02:20.244 DEBUG:teuthology.orchestra.run.smithi173:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:02:20.248 DEBUG:teuthology.orchestra.run.smithi194:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:02:20.293 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T09:02:20.294 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T09:02:20.294 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T09:02:20.299 INFO:tasks.ceph.mon.a:Started 2024-04-25T09:02:20.299 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T09:02:20.299 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T09:02:20.337 INFO:tasks.ceph.mon.b:Started 2024-04-25T09:02:20.337 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T09:02:20.338 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T09:02:20.341 INFO:tasks.ceph.mon.c:Started 2024-04-25T09:02:20.341 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T09:02:20.341 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T09:02:20.342 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T09:02:20.345 INFO:tasks.ceph.mgr.y:Started 2024-04-25T09:02:20.345 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T09:02:20.346 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T09:02:20.351 INFO:tasks.ceph.mgr.x:Started 2024-04-25T09:02:20.351 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T09:02:20.351 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T09:02:20.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:20.500+0000 7f6141600640 1 Processor -- start 2024-04-25T09:02:20.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:20.500+0000 7f6141600640 1 -- start start 2024-04-25T09:02:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:20.500+0000 7f6141600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 0x7f613c0b6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:20.500+0000 7f6141600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f613c0b0ec0 con 0x7f613c070e70 2024-04-25T09:02:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:20.500+0000 7f6141600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f613c0b1190 con 0x7f613c158210 2024-04-25T09:02:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:20.500+0000 7f6141600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f613c15e5d0 con 0x7f613c071320 2024-04-25T09:02:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:20.500+0000 7f6133e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f613c070e70 0x7f613c0b5a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46602/0 (socket says 172.21.15.173:46602) 2024-04-25T09:02:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:20.500+0000 7f6133e00640 1 -- 172.21.15.173:0/387113934 learned_addr learned my addr 172.21.15.173:0/387113934 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:02:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:20.500+0000 7f613b400640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 0x7f613c0b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:20.500+0000 7f613b400640 1 -- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 msgr2=0x7f613c0b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T09:02:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:20.500+0000 7f613b400640 1 -- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 msgr2=0x7f613c0b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:02:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:20.500+0000 7f613b400640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 0x7f613c0b6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:02:20.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:20.500+0000 7f613b400640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 0x7f613c0b6170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T09:02:20.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:20.704+0000 7f613b400640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 0x7f613c0b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:20.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:20.704+0000 7f613b400640 1 -- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 msgr2=0x7f613c0b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T09:02:20.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:20.704+0000 7f613b400640 1 -- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 msgr2=0x7f613c0b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:02:20.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:20.704+0000 7f613b400640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 0x7f613c0b6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:02:20.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:20.704+0000 7f613b400640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 0x7f613c0b6170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T09:02:21.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:21.108+0000 7f613b400640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 0x7f613c0b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:21.108+0000 7f613b400640 1 -- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 msgr2=0x7f613c0b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T09:02:21.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:21.108+0000 7f613b400640 1 -- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 msgr2=0x7f613c0b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:02:21.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:21.108+0000 7f613b400640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 0x7f613c0b6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:02:21.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:21.108+0000 7f613b400640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 0x7f613c0b6170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T09:02:21.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:21.912+0000 7f613b400640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 0x7f613c0b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:21.912+0000 7f613b400640 1 -- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 msgr2=0x7f613c0b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T09:02:21.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:21.912+0000 7f613b400640 1 -- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 msgr2=0x7f613c0b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:02:21.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:21.912+0000 7f613b400640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 0x7f613c0b6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:02:21.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:21.912+0000 7f613b400640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 0x7f613c0b6170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T09:02:23.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.500+0000 7f6138c00640 1 -- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 msgr2=0x7f613c0b6170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T09:02:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.500+0000 7f6138c00640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.194:3300/0 conn(0x7f613c071320 0x7f613c0b6170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.500+0000 7f6138c00640 1 -- 172.21.15.173:0/387113934 >> v1:172.21.15.194:6789/0 conn(0x7f613c158210 legacy=0x7f613c0b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.500+0000 7f6138c00640 1 -- 172.21.15.173:0/387113934 >> v1:172.21.15.173:6789/0 conn(0x7f613c070e70 legacy=0x7f613c0b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.500+0000 7f6138c00640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 0x7f6118005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.500+0000 7f6138c00640 1 --2- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 0x7f6118008680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.500+0000 7f6138c00640 1 -- 172.21.15.173:0/387113934 --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f613c15e5d0 con 0x7f6118003700 2024-04-25T09:02:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.500+0000 7f6138c00640 1 -- 172.21.15.173:0/387113934 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6118008db0 con 0x7f61180061c0 2024-04-25T09:02:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.500+0000 7f613aa00640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 0x7f6118005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.500+0000 7f6133e00640 1 --2- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 0x7f6118008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.500+0000 7f613aa00640 1 -- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 msgr2=0x7f6118005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T09:02:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.500+0000 7f613aa00640 1 -- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 msgr2=0x7f6118005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:02:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.500+0000 7f613aa00640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 0x7f6118005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:02:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.500+0000 7f613aa00640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 0x7f6118005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T09:02:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.500+0000 7f6133e00640 1 -- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 msgr2=0x7f6118008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T09:02:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.500+0000 7f6133e00640 1 -- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 msgr2=0x7f6118008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:02:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.500+0000 7f6133e00640 1 --2- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 0x7f6118008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:02:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.500+0000 7f6133e00640 1 --2- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 0x7f6118008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T09:02:23.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.704+0000 7f613aa00640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 0x7f6118005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.704+0000 7f6133e00640 1 --2- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 0x7f6118008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.704+0000 7f613aa00640 1 -- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 msgr2=0x7f6118005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T09:02:23.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.704+0000 7f613aa00640 1 -- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 msgr2=0x7f6118005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:02:23.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.704+0000 7f613aa00640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 0x7f6118005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:02:23.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.704+0000 7f613aa00640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 0x7f6118005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T09:02:23.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.704+0000 7f6133e00640 1 -- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 msgr2=0x7f6118008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T09:02:23.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.704+0000 7f6133e00640 1 -- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 msgr2=0x7f6118008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:02:23.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.704+0000 7f6133e00640 1 --2- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 0x7f6118008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:02:23.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:23.704+0000 7f6133e00640 1 --2- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 0x7f6118008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T09:02:24.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.108+0000 7f613aa00640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 0x7f6118005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:24.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.108+0000 7f6133e00640 1 --2- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 0x7f6118008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:24.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.108+0000 7f613aa00640 1 -- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 msgr2=0x7f6118005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T09:02:24.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.108+0000 7f613aa00640 1 -- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 msgr2=0x7f6118005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:02:24.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.108+0000 7f613aa00640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 0x7f6118005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:02:24.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.108+0000 7f613aa00640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 0x7f6118005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T09:02:24.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.108+0000 7f6133e00640 1 -- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 msgr2=0x7f6118008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T09:02:24.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.108+0000 7f6133e00640 1 -- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 msgr2=0x7f6118008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:02:24.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.108+0000 7f6133e00640 1 --2- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 0x7f6118008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:02:24.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.108+0000 7f6133e00640 1 --2- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 0x7f6118008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T09:02:24.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.912+0000 7f613aa00640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 0x7f6118005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.912+0000 7f613aa00640 1 -- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 msgr2=0x7f6118005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T09:02:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.912+0000 7f613aa00640 1 -- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 msgr2=0x7f6118005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:02:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.912+0000 7f613aa00640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 0x7f6118005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:02:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.912+0000 7f613aa00640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 0x7f6118005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T09:02:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.912+0000 7f6133e00640 1 --2- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 0x7f6118008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.912+0000 7f6133e00640 1 -- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 msgr2=0x7f6118008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T09:02:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.912+0000 7f6133e00640 1 -- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 msgr2=0x7f6118008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:02:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.912+0000 7f6133e00640 1 --2- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 0x7f6118008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:02:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:24.912+0000 7f6133e00640 1 --2- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 0x7f6118008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T09:02:25.891 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:25.900+0000 7f4e9e655180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T09:02:26.403 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:26.412+0000 7f4e9e655180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T09:02:26.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.500+0000 7f6138c00640 1 -- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 msgr2=0x7f6118008680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T09:02:26.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.500+0000 7f6138c00640 1 --2- 172.21.15.173:0/387113934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61180061c0 0x7f6118008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.500+0000 7f6138c00640 1 -- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 msgr2=0x7f6118005b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T09:02:26.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.500+0000 7f6138c00640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118003700 0x7f6118005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.500+0000 7f613b400640 1 -- 172.21.15.173:0/387113934 reap_dead start 2024-04-25T09:02:26.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.500+0000 7f6138c00640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118009210 0x7f611800b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.500+0000 7f6138c00640 1 -- 172.21.15.173:0/387113934 --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f613c15e8b0 con 0x7f613c070e70 2024-04-25T09:02:26.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.500+0000 7f6138c00640 1 -- 172.21.15.173:0/387113934 --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6118008840 con 0x7f6118005c50 2024-04-25T09:02:26.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.500+0000 7f6138c00640 1 -- 172.21.15.173:0/387113934 --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f613c15e5d0 con 0x7f6118009210 2024-04-25T09:02:26.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.500+0000 7f613aa00640 1 --2- 172.21.15.173:0/387113934 >> v2:172.21.15.173:3300/0 conn(0x7f6118009210 0x7f611800b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.500+0000 7f613aa00640 1 -- 172.21.15.173:0/387113934 >> v1:172.21.15.194:6789/0 conn(0x7f6118005c50 legacy=0x7f611800d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.500+0000 7f613aa00640 1 -- 172.21.15.173:0/387113934 >> v1:172.21.15.173:6789/0 conn(0x7f613c070e70 legacy=0x7f611800bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.500+0000 7f613aa00640 1 -- 172.21.15.173:0/387113934 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6118010a40 con 0x7f6118009210 2024-04-25T09:02:26.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.500+0000 7f613a000640 1 -- 172.21.15.173:0/387113934 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380051626 0 0) 0x7f6118008840 con 0x7f6118005c50 2024-04-25T09:02:26.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.504+0000 7f613aa00640 1 --2- 172.21.15.173:0/387113934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6118009210 0x7f611800b600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f61180060e0 tx=0x7f612c01cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05586241c5fe40f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:26.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.504+0000 7f613a000640 1 -- 172.21.15.173:0/387113934 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c0ab070 con 0x7f6118009210 2024-04-25T09:02:26.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.504+0000 7f613a000640 1 -- 172.21.15.173:0/387113934 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612c0a9070 con 0x7f6118009210 2024-04-25T09:02:26.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.504+0000 7f613a000640 1 -- 172.21.15.173:0/387113934 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c0a5b40 con 0x7f6118009210 2024-04-25T09:02:26.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.504+0000 7f6141600640 1 -- 172.21.15.173:0/387113934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6118009210 msgr2=0x7f611800b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.504+0000 7f6141600640 1 --2- 172.21.15.173:0/387113934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6118009210 0x7f611800b600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f61180060e0 tx=0x7f612c01cb60 comp rx=0 tx=0).stop 2024-04-25T09:02:26.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.504+0000 7f6141600640 1 -- 172.21.15.173:0/387113934 shutdown_connections 2024-04-25T09:02:26.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.504+0000 7f6141600640 1 --2- 172.21.15.173:0/387113934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6118009210 0x7f611800b600 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.504+0000 7f6141600640 1 -- 172.21.15.173:0/387113934 >> 172.21.15.173:0/387113934 conn(0x7f613c0b3540 msgr2=0x7f613c0b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:26.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.504+0000 7f6141600640 1 -- 172.21.15.173:0/387113934 shutdown_connections 2024-04-25T09:02:26.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.504+0000 7f6141600640 1 -- 172.21.15.173:0/387113934 wait complete. 2024-04-25T09:02:26.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f6141600640 1 Processor -- start 2024-04-25T09:02:26.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f6141600640 1 -- start start 2024-04-25T09:02:26.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f6141600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6118005c50 0x7f613c14bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f6141600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6118009210 0x7f613c0cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f6141600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f613c070e70 0x7f613c0cff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f6141600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c0b0d40 con 0x7f613c070e70 2024-04-25T09:02:26.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f6141600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c0b0bc0 con 0x7f6118005c50 2024-04-25T09:02:26.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f6141600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613c1585f0 con 0x7f6118009210 2024-04-25T09:02:26.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f613b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f613c070e70 0x7f613c0cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f613b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f613c070e70 0x7f613c0cff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36632/0 (socket says 172.21.15.173:36632) 2024-04-25T09:02:26.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f613b400640 1 -- 172.21.15.173:0/1056942051 learned_addr learned my addr 172.21.15.173:0/1056942051 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:26.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f613aa00640 1 --2- 172.21.15.173:0/1056942051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6118005c50 0x7f613c14bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f6133e00640 1 --2- 172.21.15.173:0/1056942051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6118009210 0x7f613c0cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f613b400640 1 -- 172.21.15.173:0/1056942051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6118009210 msgr2=0x7f613c0cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f613b400640 1 --2- 172.21.15.173:0/1056942051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6118009210 0x7f613c0cf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f613b400640 1 -- 172.21.15.173:0/1056942051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6118005c50 msgr2=0x7f613c14bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f613b400640 1 --2- 172.21.15.173:0/1056942051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6118005c50 0x7f613c14bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f613b400640 1 -- 172.21.15.173:0/1056942051 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613c0ccbf0 con 0x7f613c070e70 2024-04-25T09:02:26.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f6133e00640 1 --2- 172.21.15.173:0/1056942051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6118009210 0x7f613c0cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:26.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f613b400640 1 --2- 172.21.15.173:0/1056942051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f613c070e70 0x7f613c0cff20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f613c0b4600 tx=0x7f61340015a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:26.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f6132a00640 1 -- 172.21.15.173:0/1056942051 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613401b030 con 0x7f613c070e70 2024-04-25T09:02:26.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f6132a00640 1 -- 172.21.15.173:0/1056942051 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6134001c80 con 0x7f613c070e70 2024-04-25T09:02:26.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f6132a00640 1 -- 172.21.15.173:0/1056942051 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61340039a0 con 0x7f613c070e70 2024-04-25T09:02:26.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f6141600640 1 -- 172.21.15.173:0/1056942051 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613c0cced0 con 0x7f613c070e70 2024-04-25T09:02:26.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f6141600640 1 -- 172.21.15.173:0/1056942051 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613c0cd490 con 0x7f613c070e70 2024-04-25T09:02:26.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f6132a00640 1 -- 172.21.15.173:0/1056942051 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f613401e070 con 0x7f613c070e70 2024-04-25T09:02:26.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.508+0000 7f6132a00640 1 -- 172.21.15.173:0/1056942051 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f61340205d0 con 0x7f613c070e70 2024-04-25T09:02:26.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.512+0000 7f6141600640 1 -- 172.21.15.173:0/1056942051 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f613c073ab0 con 0x7f613c070e70 2024-04-25T09:02:26.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.520+0000 7f6132a00640 1 -- 172.21.15.173:0/1056942051 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f6134010040 con 0x7f613c070e70 2024-04-25T09:02:26.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.580+0000 7f6141600640 1 -- 172.21.15.173:0/1056942051 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f613c1565f0 con 0x7f613c070e70 2024-04-25T09:02:26.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.584+0000 7f6132a00640 1 -- 172.21.15.173:0/1056942051 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f61340207d0 con 0x7f613c070e70 2024-04-25T09:02:26.574 INFO:teuthology.orchestra.run.smithi173.stderr:adjusted tunables profile to default 2024-04-25T09:02:26.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.584+0000 7f6141600640 1 -- 172.21.15.173:0/1056942051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f613c070e70 msgr2=0x7f613c0cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.584+0000 7f6141600640 1 --2- 172.21.15.173:0/1056942051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f613c070e70 0x7f613c0cff20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f613c0b4600 tx=0x7f61340015a0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.584+0000 7f6141600640 1 -- 172.21.15.173:0/1056942051 shutdown_connections 2024-04-25T09:02:26.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.584+0000 7f6141600640 1 --2- 172.21.15.173:0/1056942051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f613c070e70 0x7f613c0cff20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.584+0000 7f6141600640 1 --2- 172.21.15.173:0/1056942051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6118009210 0x7f613c0cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.584+0000 7f6141600640 1 --2- 172.21.15.173:0/1056942051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6118005c50 0x7f613c14bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.584+0000 7f6141600640 1 -- 172.21.15.173:0/1056942051 >> 172.21.15.173:0/1056942051 conn(0x7f613c0b3540 msgr2=0x7f613c06bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:26.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.584+0000 7f6141600640 1 -- 172.21.15.173:0/1056942051 shutdown_connections 2024-04-25T09:02:26.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:26.584+0000 7f6141600640 1 -- 172.21.15.173:0/1056942051 wait complete. 2024-04-25T09:02:26.595 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T09:02:26.595 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T09:02:26.595 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:02:26.595 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T09:02:26.615 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:02:26.615 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T09:02:26.635 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:26.644+0000 7f4e9e655180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T09:02:26.654 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:02:26.654 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T09:02:26.680 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:26.689+0000 7fed389d0180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T09:02:26.720 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:02:26.720 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T09:02:26.780 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:02:26.780 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T09:02:26.801 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:02:26.801 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T09:02:26.865 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:02:26.865 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T09:02:26.925 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:02:26.925 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T09:02:26.990 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 5eb61d40-d12c-4be7-8270-3cbf406bec4e 0 2024-04-25T09:02:27.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.177+0000 7f1c00200640 1 Processor -- start 2024-04-25T09:02:27.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.177+0000 7f1c00200640 1 -- start start 2024-04-25T09:02:27.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.177+0000 7f1c00200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1bf815e120 0x7f1bf80b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.177+0000 7f1c00200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1bf809a160 0x7f1bf80cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.177+0000 7f1c00200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf80d1490 con 0x7f1bf806d200 2024-04-25T09:02:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.177+0000 7f1c00200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf80d0bf0 con 0x7f1bf815e120 2024-04-25T09:02:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.177+0000 7f1c00200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf80d0ed0 con 0x7f1bf809a160 2024-04-25T09:02:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.181+0000 7f1bfe200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1bf809a160 0x7f1bf80cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.181+0000 7f1bfe200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1bf809a160 0x7f1bf80cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:39242/0 (socket says 172.21.15.194:39242) 2024-04-25T09:02:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.181+0000 7f1bfe200640 1 -- 172.21.15.194:0/1254324387 learned_addr learned my addr 172.21.15.194:0/1254324387 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-25T09:02:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.181+0000 7f1bfce00640 1 --1- 172.21.15.194:0/1254324387 >> v1:172.21.15.194:6789/0 conn(0x7f1bf806d200 0x7f1bf8099a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:36296/0 (socket says 172.21.15.194:36296) 2024-04-25T09:02:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.181+0000 7f1bfd800640 1 --2- 172.21.15.194:0/1254324387 >> v2:172.21.15.173:3300/0 conn(0x7f1bf815e120 0x7f1bf80b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.181+0000 7f1bfe200640 1 -- 172.21.15.194:0/1254324387 >> v2:172.21.15.173:3300/0 conn(0x7f1bf815e120 msgr2=0x7f1bf80b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:27.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.181+0000 7f1bfe200640 1 --2- 172.21.15.194:0/1254324387 >> v2:172.21.15.173:3300/0 conn(0x7f1bf815e120 0x7f1bf80b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.181+0000 7f1bfe200640 1 -- 172.21.15.194:0/1254324387 >> v1:172.21.15.194:6789/0 conn(0x7f1bf806d200 legacy=0x7f1bf8099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.181+0000 7f1bfe200640 1 -- 172.21.15.194:0/1254324387 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf80d11b0 con 0x7f1bf809a160 2024-04-25T09:02:27.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.181+0000 7f1bf7e00640 1 -- 172.21.15.194:0/1254324387 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029459596 0 0) 0x7f1bf80d1490 con 0x7f1bf806d200 2024-04-25T09:02:27.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.181+0000 7f1bfe200640 1 --2- 172.21.15.194:0/1254324387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf809a160 0x7f1bf80cc430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8073290 tx=0x7f1bf001c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64b0a0e5fd65e403 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:27.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.181+0000 7f1bf7e00640 1 -- 172.21.15.194:0/1254324387 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf00a5620 con 0x7f1bf809a160 2024-04-25T09:02:27.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.181+0000 7f1bf7e00640 1 -- 172.21.15.194:0/1254324387 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf00a57c0 con 0x7f1bf809a160 2024-04-25T09:02:27.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.181+0000 7f1bf7e00640 1 -- 172.21.15.194:0/1254324387 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf00a5b90 con 0x7f1bf809a160 2024-04-25T09:02:27.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1c00200640 1 -- 172.21.15.194:0/1254324387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf809a160 msgr2=0x7f1bf80cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1c00200640 1 --2- 172.21.15.194:0/1254324387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf809a160 0x7f1bf80cc430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8073290 tx=0x7f1bf001c960 comp rx=0 tx=0).stop 2024-04-25T09:02:27.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1c00200640 1 -- 172.21.15.194:0/1254324387 shutdown_connections 2024-04-25T09:02:27.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1c00200640 1 --2- 172.21.15.194:0/1254324387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf809a160 0x7f1bf80cc430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1c00200640 1 --2- 172.21.15.194:0/1254324387 >> v2:172.21.15.173:3300/0 conn(0x7f1bf815e120 0x7f1bf80b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1c00200640 1 -- 172.21.15.194:0/1254324387 >> 172.21.15.194:0/1254324387 conn(0x7f1bf80b32a0 msgr2=0x7f1bf80b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:27.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1c00200640 1 -- 172.21.15.194:0/1254324387 shutdown_connections 2024-04-25T09:02:27.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1c00200640 1 -- 172.21.15.194:0/1254324387 wait complete. 2024-04-25T09:02:27.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1c00200640 1 Processor -- start 2024-04-25T09:02:27.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1c00200640 1 -- start start 2024-04-25T09:02:27.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1c00200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf806d200 0x7f1bf80c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1c00200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bf809a160 0x7f1bf815ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1c00200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bf815e120 0x7f1bf81604b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1c00200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf80cd550 con 0x7f1bf809a160 2024-04-25T09:02:27.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1c00200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf80cd3d0 con 0x7f1bf806d200 2024-04-25T09:02:27.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1c00200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf80cd6d0 con 0x7f1bf815e120 2024-04-25T09:02:27.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1bfd800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf806d200 0x7f1bf80c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1bfe200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bf815e120 0x7f1bf81604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1bfd800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf806d200 0x7f1bf80c7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:39250/0 (socket says 172.21.15.194:39250) 2024-04-25T09:02:27.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1bfd800640 1 -- 172.21.15.194:0/1714112731 learned_addr learned my addr 172.21.15.194:0/1714112731 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-25T09:02:27.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.185+0000 7f1bfce00640 1 --2- 172.21.15.194:0/1714112731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bf809a160 0x7f1bf815ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.189+0000 7f1bfe200640 1 -- 172.21.15.194:0/1714112731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf806d200 msgr2=0x7f1bf80c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.189+0000 7f1bfe200640 1 --2- 172.21.15.194:0/1714112731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf806d200 0x7f1bf80c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.189+0000 7f1bfe200640 1 -- 172.21.15.194:0/1714112731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bf809a160 msgr2=0x7f1bf815ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.189+0000 7f1bfe200640 1 --2- 172.21.15.194:0/1714112731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bf809a160 0x7f1bf815ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.189+0000 7f1bfe200640 1 -- 172.21.15.194:0/1714112731 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf815e610 con 0x7f1bf815e120 2024-04-25T09:02:27.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.189+0000 7f1bfe200640 1 --2- 172.21.15.194:0/1714112731 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bf815e120 0x7f1bf81604b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00ab000 tx=0x7f1bf0019700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:27.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.189+0000 7f1bf5600640 1 -- 172.21.15.194:0/1714112731 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf00bc070 con 0x7f1bf815e120 2024-04-25T09:02:27.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.189+0000 7f1bf5600640 1 -- 172.21.15.194:0/1714112731 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf0003ba0 con 0x7f1bf815e120 2024-04-25T09:02:27.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.189+0000 7f1c00200640 1 -- 172.21.15.194:0/1714112731 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf815e8f0 con 0x7f1bf815e120 2024-04-25T09:02:27.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.189+0000 7f1bf5600640 1 -- 172.21.15.194:0/1714112731 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0009510 con 0x7f1bf815e120 2024-04-25T09:02:27.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.189+0000 7f1c00200640 1 -- 172.21.15.194:0/1714112731 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf80c5fd0 con 0x7f1bf815e120 2024-04-25T09:02:27.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.189+0000 7f1bf5600640 1 -- 172.21.15.194:0/1714112731 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f1bf00b8a10 con 0x7f1bf815e120 2024-04-25T09:02:27.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.189+0000 7f1bf5600640 1 -- 172.21.15.194:0/1714112731 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1bf00c1450 con 0x7f1bf815e120 2024-04-25T09:02:27.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.189+0000 7f1c00200640 1 -- 172.21.15.194:0/1714112731 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf8073ab0 con 0x7f1bf815e120 2024-04-25T09:02:27.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.193+0000 7f1bf5600640 1 -- 172.21.15.194:0/1714112731 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f1bf00165e0 con 0x7f1bf815e120 2024-04-25T09:02:27.200 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:27.209+0000 7fed389d0180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T09:02:27.244 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:27.252+0000 7f4e9e655180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T09:02:27.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.257+0000 7f1c00200640 1 -- 172.21.15.194:0/1714112731 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5eb61d40-d12c-4be7-8270-3cbf406bec4e", "id": 0} v 0) v1 -- 0x7f1bf806e420 con 0x7f1bf815e120 2024-04-25T09:02:27.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.265+0000 7f1bf5600640 1 -- 172.21.15.194:0/1714112731 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5eb61d40-d12c-4be7-8270-3cbf406bec4e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1bf00b8df0 con 0x7f1bf815e120 2024-04-25T09:02:27.257 INFO:teuthology.orchestra.run.smithi194.stdout:0 2024-04-25T09:02:27.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.265+0000 7f1c00200640 1 -- 172.21.15.194:0/1714112731 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bf815e120 msgr2=0x7f1bf81604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.265+0000 7f1c00200640 1 --2- 172.21.15.194:0/1714112731 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bf815e120 0x7f1bf81604b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00ab000 tx=0x7f1bf0019700 comp rx=0 tx=0).stop 2024-04-25T09:02:27.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.265+0000 7f1c00200640 1 -- 172.21.15.194:0/1714112731 shutdown_connections 2024-04-25T09:02:27.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.265+0000 7f1c00200640 1 --2- 172.21.15.194:0/1714112731 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bf815e120 0x7f1bf81604b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.265+0000 7f1c00200640 1 --2- 172.21.15.194:0/1714112731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bf809a160 0x7f1bf815ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.265+0000 7f1c00200640 1 --2- 172.21.15.194:0/1714112731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf806d200 0x7f1bf80c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.265+0000 7f1c00200640 1 -- 172.21.15.194:0/1714112731 >> 172.21.15.194:0/1714112731 conn(0x7f1bf80b32a0 msgr2=0x7f1bf80b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:27.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.265+0000 7f1c00200640 1 -- 172.21.15.194:0/1714112731 shutdown_connections 2024-04-25T09:02:27.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.265+0000 7f1c00200640 1 -- 172.21.15.194:0/1714112731 wait complete. 2024-04-25T09:02:27.277 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 7f4c7b25-46c1-451e-b31c-28ebc5f0fa72 1 2024-04-25T09:02:27.311 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:27.316+0000 7f4e9e655180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T09:02:27.367 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:27.376+0000 7f4e9e655180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T09:02:27.403 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:27.413+0000 7fed389d0180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T09:02:27.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.421+0000 7fb3c7600640 1 Processor -- start 2024-04-25T09:02:27.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.421+0000 7fb3c7600640 1 -- start start 2024-04-25T09:02:27.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.421+0000 7fb3c7600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb3c015bab0 0x7fb3c00d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.421+0000 7fb3c7600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb3c009a160 0x7fb3c00c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.421+0000 7fb3c7600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c00cc7a0 con 0x7fb3c00cd840 2024-04-25T09:02:27.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.421+0000 7fb3c7600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c00d07e0 con 0x7fb3c009a160 2024-04-25T09:02:27.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.421+0000 7fb3c7600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c00cca80 con 0x7fb3c015bab0 2024-04-25T09:02:27.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.421+0000 7fb3c4c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb3c015bab0 0x7fb3c00d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.421+0000 7fb3c4c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb3c015bab0 0x7fb3c00d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:39256/0 (socket says 172.21.15.194:39256) 2024-04-25T09:02:27.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.421+0000 7fb3c4c00640 1 -- 172.21.15.194:0/370436703 learned_addr learned my addr 172.21.15.194:0/370436703 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-25T09:02:27.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.421+0000 7fb3c5600640 1 --2- 172.21.15.194:0/370436703 >> v2:172.21.15.173:3300/0 conn(0x7fb3c009a160 0x7fb3c00c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.425+0000 7fb3c4c00640 1 -- 172.21.15.194:0/370436703 >> v2:172.21.15.173:3300/0 conn(0x7fb3c009a160 msgr2=0x7fb3c00c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:27.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.425+0000 7fb3c4c00640 1 --2- 172.21.15.194:0/370436703 >> v2:172.21.15.173:3300/0 conn(0x7fb3c009a160 0x7fb3c00c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.425+0000 7fb3c4c00640 1 -- 172.21.15.194:0/370436703 >> v1:172.21.15.194:6789/0 conn(0x7fb3c00cd840 legacy=0x7fb3c0099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.425+0000 7fb3c4c00640 1 -- 172.21.15.194:0/370436703 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c00ccd60 con 0x7fb3c015bab0 2024-04-25T09:02:27.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.425+0000 7fb3c4c00640 1 --2- 172.21.15.194:0/370436703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3c015bab0 0x7fb3c00d02a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0072b30 tx=0x7fb3b401c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f543e145a1e97c4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:27.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.425+0000 7fb3bf400640 1 -- 172.21.15.194:0/370436703 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40aa650 con 0x7fb3c015bab0 2024-04-25T09:02:27.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.425+0000 7fb3bf400640 1 -- 172.21.15.194:0/370436703 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b40af070 con 0x7fb3c015bab0 2024-04-25T09:02:27.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.425+0000 7fb3bf400640 1 -- 172.21.15.194:0/370436703 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40aaa10 con 0x7fb3c015bab0 2024-04-25T09:02:27.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.425+0000 7fb3c7600640 1 -- 172.21.15.194:0/370436703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3c015bab0 msgr2=0x7fb3c00d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.425+0000 7fb3c7600640 1 --2- 172.21.15.194:0/370436703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3c015bab0 0x7fb3c00d02a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0072b30 tx=0x7fb3b401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.425+0000 7fb3c7600640 1 -- 172.21.15.194:0/370436703 shutdown_connections 2024-04-25T09:02:27.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.425+0000 7fb3c7600640 1 --2- 172.21.15.194:0/370436703 >> v2:172.21.15.173:3300/0 conn(0x7fb3c009a160 0x7fb3c00c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.425+0000 7fb3c7600640 1 --2- 172.21.15.194:0/370436703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3c015bab0 0x7fb3c00d02a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.425+0000 7fb3c7600640 1 -- 172.21.15.194:0/370436703 >> 172.21.15.194:0/370436703 conn(0x7fb3c00b32a0 msgr2=0x7fb3c00b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:27.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c7600640 1 -- 172.21.15.194:0/370436703 shutdown_connections 2024-04-25T09:02:27.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c7600640 1 -- 172.21.15.194:0/370436703 wait complete. 2024-04-25T09:02:27.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c7600640 1 Processor -- start 2024-04-25T09:02:27.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c7600640 1 -- start start 2024-04-25T09:02:27.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c7600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3c009a160 0x7fb3c00c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c7600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3c00cd840 0x7fb3c00c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c7600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3c015bab0 0x7fb3c0151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c7600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00cc540 con 0x7fb3c00cd840 2024-04-25T09:02:27.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c7600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00cc3c0 con 0x7fb3c015bab0 2024-04-25T09:02:27.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c7600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00cf540 con 0x7fb3c009a160 2024-04-25T09:02:27.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c5600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3c015bab0 0x7fb3c0151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c4c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3c009a160 0x7fb3c00c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c4c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3c009a160 0x7fb3c00c5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:43868/0 (socket says 172.21.15.194:43868) 2024-04-25T09:02:27.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c4c00640 1 -- 172.21.15.194:0/1214852641 learned_addr learned my addr 172.21.15.194:0/1214852641 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-25T09:02:27.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3bfe00640 1 --2- 172.21.15.194:0/1214852641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3c00cd840 0x7fb3c00c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c4c00640 1 -- 172.21.15.194:0/1214852641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3c015bab0 msgr2=0x7fb3c0151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c4c00640 1 --2- 172.21.15.194:0/1214852641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3c015bab0 0x7fb3c0151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c4c00640 1 -- 172.21.15.194:0/1214852641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3c00cd840 msgr2=0x7fb3c00c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c4c00640 1 --2- 172.21.15.194:0/1214852641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3c00cd840 0x7fb3c00c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c4c00640 1 -- 172.21.15.194:0/1214852641 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c01f7100 con 0x7fb3c009a160 2024-04-25T09:02:27.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c5600640 1 --2- 172.21.15.194:0/1214852641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3c015bab0 0x7fb3c0151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:27.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3c4c00640 1 --2- 172.21.15.194:0/1214852641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3c009a160 0x7fb3c00c5c50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40ac040 tx=0x7fb3b401ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:27.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.429+0000 7fb3bcc00640 1 -- 172.21.15.194:0/1214852641 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40bd5f0 con 0x7fb3c009a160 2024-04-25T09:02:27.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.433+0000 7fb3bcc00640 1 -- 172.21.15.194:0/1214852641 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b40a6040 con 0x7fb3c009a160 2024-04-25T09:02:27.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.433+0000 7fb3c7600640 1 -- 172.21.15.194:0/1214852641 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c01f73e0 con 0x7fb3c009a160 2024-04-25T09:02:27.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.433+0000 7fb3c7600640 1 -- 172.21.15.194:0/1214852641 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c01f79a0 con 0x7fb3c009a160 2024-04-25T09:02:27.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.433+0000 7fb3bcc00640 1 -- 172.21.15.194:0/1214852641 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40bd9f0 con 0x7fb3c009a160 2024-04-25T09:02:27.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.433+0000 7fb3bcc00640 1 -- 172.21.15.194:0/1214852641 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fb3b40b33f0 con 0x7fb3c009a160 2024-04-25T09:02:27.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.433+0000 7fb3bcc00640 1 -- 172.21.15.194:0/1214852641 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fb3b40b24c0 con 0x7fb3c009a160 2024-04-25T09:02:27.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.433+0000 7fb3c7600640 1 -- 172.21.15.194:0/1214852641 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39c0052a0 con 0x7fb3c009a160 2024-04-25T09:02:27.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.433+0000 7fb3bcc00640 1 -- 172.21.15.194:0/1214852641 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fb3b40c3060 con 0x7fb3c009a160 2024-04-25T09:02:27.455 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:27.464+0000 7f4e9e655180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T09:02:27.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.501+0000 7fb3c7600640 1 -- 172.21.15.194:0/1214852641 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7f4c7b25-46c1-451e-b31c-28ebc5f0fa72", "id": 1} v 0) v1 -- 0x7fb39c005590 con 0x7fb3c009a160 2024-04-25T09:02:27.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.505+0000 7fb3bcc00640 1 -- 172.21.15.194:0/1214852641 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7f4c7b25-46c1-451e-b31c-28ebc5f0fa72", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb3b40cb020 con 0x7fb3c009a160 2024-04-25T09:02:27.498 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-04-25T09:02:27.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.505+0000 7fb3c7600640 1 -- 172.21.15.194:0/1214852641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3c009a160 msgr2=0x7fb3c00c5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.505+0000 7fb3c7600640 1 --2- 172.21.15.194:0/1214852641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3c009a160 0x7fb3c00c5c50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40ac040 tx=0x7fb3b401ad30 comp rx=0 tx=0).stop 2024-04-25T09:02:27.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.509+0000 7fb3c7600640 1 -- 172.21.15.194:0/1214852641 shutdown_connections 2024-04-25T09:02:27.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.509+0000 7fb3c7600640 1 --2- 172.21.15.194:0/1214852641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3c015bab0 0x7fb3c0151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.509+0000 7fb3c7600640 1 --2- 172.21.15.194:0/1214852641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3c00cd840 0x7fb3c00c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.509+0000 7fb3c7600640 1 --2- 172.21.15.194:0/1214852641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3c009a160 0x7fb3c00c5c50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.509+0000 7fb3c7600640 1 -- 172.21.15.194:0/1214852641 >> 172.21.15.194:0/1214852641 conn(0x7fb3c00b32a0 msgr2=0x7fb3c006d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:27.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.509+0000 7fb3c7600640 1 -- 172.21.15.194:0/1214852641 shutdown_connections 2024-04-25T09:02:27.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.509+0000 7fb3c7600640 1 -- 172.21.15.194:0/1214852641 wait complete. 2024-04-25T09:02:27.516 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:27.524+0000 7f4e9e655180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T09:02:27.517 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 7caf451e-2594-4ac7-a21f-b860c220f0fb 2 2024-04-25T09:02:27.603 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:27.612+0000 7f4e9e655180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T09:02:27.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.661+0000 7febc8600640 1 Processor -- start 2024-04-25T09:02:27.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.661+0000 7febc8600640 1 -- start start 2024-04-25T09:02:27.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.661+0000 7febc8600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7febc015bb00 0x7febc00cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.661+0000 7febc8600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7febc015c5f0 0x7febc00b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.661+0000 7febc8600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc015cc60 con 0x7febc00b16c0 2024-04-25T09:02:27.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.661+0000 7febc8600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc015cf40 con 0x7febc015bb00 2024-04-25T09:02:27.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.661+0000 7febc8600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc00b2090 con 0x7febc015c5f0 2024-04-25T09:02:27.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.661+0000 7febc6600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7febc015c5f0 0x7febc00b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.661+0000 7febc5200640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7febc00b16c0 0x7febc015bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:36304/0 (socket says 172.21.15.194:36304) 2024-04-25T09:02:27.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.661+0000 7febc5200640 1 -- 172.21.15.194:0/2819787226 learned_addr learned my addr 172.21.15.194:0/2819787226 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-04-25T09:02:27.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.661+0000 7febc5c00640 1 --2- 172.21.15.194:0/2819787226 >> v2:172.21.15.173:3300/0 conn(0x7febc015bb00 0x7febc00cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.661+0000 7febc6600640 1 -- 172.21.15.194:0/2819787226 >> v2:172.21.15.173:3300/0 conn(0x7febc015bb00 msgr2=0x7febc00cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:27.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.661+0000 7febc6600640 1 --2- 172.21.15.194:0/2819787226 >> v2:172.21.15.173:3300/0 conn(0x7febc015bb00 0x7febc00cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.661+0000 7febc6600640 1 -- 172.21.15.194:0/2819787226 >> v1:172.21.15.194:6789/0 conn(0x7febc00b16c0 legacy=0x7febc015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.661+0000 7febbfe00640 1 -- 172.21.15.194:0/2819787226 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79831572 0 0) 0x7febc015cc60 con 0x7febc00b16c0 2024-04-25T09:02:27.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.661+0000 7febc6600640 1 -- 172.21.15.194:0/2819787226 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc00cd050 con 0x7febc015c5f0 2024-04-25T09:02:27.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.665+0000 7febc6600640 1 --2- 172.21.15.194:0/2819787226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc015c5f0 0x7febc00b1b50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7febc00cf180 tx=0x7febb801c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=651ac2b26b5f0d67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:27.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.665+0000 7febbfe00640 1 -- 172.21.15.194:0/2819787226 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb80b2070 con 0x7febc015c5f0 2024-04-25T09:02:27.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.665+0000 7febbfe00640 1 -- 172.21.15.194:0/2819787226 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb80a57c0 con 0x7febc015c5f0 2024-04-25T09:02:27.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.665+0000 7febbfe00640 1 -- 172.21.15.194:0/2819787226 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb80a5b90 con 0x7febc015c5f0 2024-04-25T09:02:27.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.665+0000 7febc8600640 1 -- 172.21.15.194:0/2819787226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc015c5f0 msgr2=0x7febc00b1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.665+0000 7febc8600640 1 --2- 172.21.15.194:0/2819787226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc015c5f0 0x7febc00b1b50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7febc00cf180 tx=0x7febb801c810 comp rx=0 tx=0).stop 2024-04-25T09:02:27.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.665+0000 7febc8600640 1 -- 172.21.15.194:0/2819787226 shutdown_connections 2024-04-25T09:02:27.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.665+0000 7febc8600640 1 --2- 172.21.15.194:0/2819787226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc015c5f0 0x7febc00b1b50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.665+0000 7febc8600640 1 --2- 172.21.15.194:0/2819787226 >> v2:172.21.15.173:3300/0 conn(0x7febc015bb00 0x7febc00cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.665+0000 7febc8600640 1 -- 172.21.15.194:0/2819787226 >> 172.21.15.194:0/2819787226 conn(0x7febc00b23a0 msgr2=0x7febc00b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:27.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.665+0000 7febc8600640 1 -- 172.21.15.194:0/2819787226 shutdown_connections 2024-04-25T09:02:27.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.665+0000 7febc8600640 1 -- 172.21.15.194:0/2819787226 wait complete. 2024-04-25T09:02:27.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc8600640 1 Processor -- start 2024-04-25T09:02:27.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc8600640 1 -- start start 2024-04-25T09:02:27.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc8600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc00b16c0 0x7febc00b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc8600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc015bb00 0x7febc00b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc8600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febc015c5f0 0x7febc015e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc8600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc00cb9a0 con 0x7febc015bb00 2024-04-25T09:02:27.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc8600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc00cb820 con 0x7febc00b16c0 2024-04-25T09:02:27.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc8600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc0168570 con 0x7febc015c5f0 2024-04-25T09:02:27.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc5c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc00b16c0 0x7febc00b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc5c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc00b16c0 0x7febc00b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:39280/0 (socket says 172.21.15.194:39280) 2024-04-25T09:02:27.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc5c00640 1 -- 172.21.15.194:0/3961451202 learned_addr learned my addr 172.21.15.194:0/3961451202 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-25T09:02:27.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc5200640 1 --2- 172.21.15.194:0/3961451202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc015bb00 0x7febc00b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc6600640 1 --2- 172.21.15.194:0/3961451202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febc015c5f0 0x7febc015e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc5c00640 1 -- 172.21.15.194:0/3961451202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febc015c5f0 msgr2=0x7febc015e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc5c00640 1 --2- 172.21.15.194:0/3961451202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febc015c5f0 0x7febc015e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc5c00640 1 -- 172.21.15.194:0/3961451202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc015bb00 msgr2=0x7febc00b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc5c00640 1 --2- 172.21.15.194:0/3961451202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc015bb00 0x7febc00b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc5c00640 1 -- 172.21.15.194:0/3961451202 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc0154b40 con 0x7febc00b16c0 2024-04-25T09:02:27.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.669+0000 7febc5c00640 1 --2- 172.21.15.194:0/3961451202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc00b16c0 0x7febc00b5eb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7febb400e960 tx=0x7febb400ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:27.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.673+0000 7febbd600640 1 -- 172.21.15.194:0/3961451202 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb4017070 con 0x7febc00b16c0 2024-04-25T09:02:27.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.673+0000 7febbd600640 1 -- 172.21.15.194:0/3961451202 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb400ca00 con 0x7febc00b16c0 2024-04-25T09:02:27.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.673+0000 7febc8600640 1 -- 172.21.15.194:0/3961451202 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc0154e20 con 0x7febc00b16c0 2024-04-25T09:02:27.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.673+0000 7febbd600640 1 -- 172.21.15.194:0/3961451202 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb400cdb0 con 0x7febc00b16c0 2024-04-25T09:02:27.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.673+0000 7febc8600640 1 -- 172.21.15.194:0/3961451202 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc01553e0 con 0x7febc00b16c0 2024-04-25T09:02:27.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.673+0000 7febbd600640 1 -- 172.21.15.194:0/3961451202 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7febb401a070 con 0x7febc00b16c0 2024-04-25T09:02:27.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.673+0000 7febbd600640 1 -- 172.21.15.194:0/3961451202 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7febb4006020 con 0x7febc00b16c0 2024-04-25T09:02:27.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.673+0000 7febc8600640 1 -- 172.21.15.194:0/3961451202 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc006cd30 con 0x7febc00b16c0 2024-04-25T09:02:27.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.677+0000 7febbd600640 1 -- 172.21.15.194:0/3961451202 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7febb4006610 con 0x7febc00b16c0 2024-04-25T09:02:27.668 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:27.676+0000 7f4e9e655180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T09:02:27.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.741+0000 7febc8600640 1 -- 172.21.15.194:0/3961451202 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7caf451e-2594-4ac7-a21f-b860c220f0fb", "id": 2} v 0) v1 -- 0x7febc015c1c0 con 0x7febc00b16c0 2024-04-25T09:02:27.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.749+0000 7febbd600640 1 -- 172.21.15.194:0/3961451202 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7caf451e-2594-4ac7-a21f-b860c220f0fb", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7febb40059a0 con 0x7febc00b16c0 2024-04-25T09:02:27.740 INFO:teuthology.orchestra.run.smithi194.stdout:2 2024-04-25T09:02:27.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.749+0000 7febc8600640 1 -- 172.21.15.194:0/3961451202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc00b16c0 msgr2=0x7febc00b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.749+0000 7febc8600640 1 --2- 172.21.15.194:0/3961451202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc00b16c0 0x7febc00b5eb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7febb400e960 tx=0x7febb400ee20 comp rx=0 tx=0).stop 2024-04-25T09:02:27.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.749+0000 7febc8600640 1 -- 172.21.15.194:0/3961451202 shutdown_connections 2024-04-25T09:02:27.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.749+0000 7febc8600640 1 --2- 172.21.15.194:0/3961451202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febc015c5f0 0x7febc015e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.749+0000 7febc8600640 1 --2- 172.21.15.194:0/3961451202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc015bb00 0x7febc00b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.749+0000 7febc8600640 1 --2- 172.21.15.194:0/3961451202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc00b16c0 0x7febc00b5eb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.749+0000 7febc8600640 1 -- 172.21.15.194:0/3961451202 >> 172.21.15.194:0/3961451202 conn(0x7febc00b23a0 msgr2=0x7febc015a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:27.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.749+0000 7febc8600640 1 -- 172.21.15.194:0/3961451202 shutdown_connections 2024-04-25T09:02:27.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.749+0000 7febc8600640 1 -- 172.21.15.194:0/3961451202 wait complete. 2024-04-25T09:02:27.759 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new acaf3e24-f28d-430d-be7e-a83609b4b156 3 2024-04-25T09:02:27.832 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:27.840+0000 7f4e9e655180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T09:02:27.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.901+0000 7f1897600640 1 Processor -- start 2024-04-25T09:02:27.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.901+0000 7f1897600640 1 -- start start 2024-04-25T09:02:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.905+0000 7f1897600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f18900cbef0 0x7f18900cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.905+0000 7f1897600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f189006dc00 0x7f189006e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.905+0000 7f1897600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1890072b60 con 0x7f189015db40 2024-04-25T09:02:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.905+0000 7f1897600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18900cae50 con 0x7f189006dc00 2024-04-25T09:02:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.905+0000 7f1897600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18900cb130 con 0x7f18900cbef0 2024-04-25T09:02:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.905+0000 7f1894c00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f189015db40 0x7f189006ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:36314/0 (socket says 172.21.15.194:36314) 2024-04-25T09:02:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.905+0000 7f1894c00640 1 -- 172.21.15.194:0/2944450131 learned_addr learned my addr 172.21.15.194:0/2944450131 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-04-25T09:02:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.905+0000 7f188fe00640 1 --2- 172.21.15.194:0/2944450131 >> v2:172.21.15.194:3300/0 conn(0x7f18900cbef0 0x7f18900cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.905+0000 7f1895600640 1 --2- 172.21.15.194:0/2944450131 >> v2:172.21.15.173:3300/0 conn(0x7f189006dc00 0x7f189006e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.905+0000 7f188f400640 1 -- 172.21.15.194:0/2944450131 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803994954 0 0) 0x7f1890072b60 con 0x7f189015db40 2024-04-25T09:02:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.905+0000 7f188f400640 1 -- 172.21.15.194:0/2944450131 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1878003530 con 0x7f189015db40 2024-04-25T09:02:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.905+0000 7f188fe00640 1 -- 172.21.15.194:0/2944450131 >> v2:172.21.15.173:3300/0 conn(0x7f189006dc00 msgr2=0x7f189006e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:27.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.905+0000 7f188fe00640 1 --2- 172.21.15.194:0/2944450131 >> v2:172.21.15.173:3300/0 conn(0x7f189006dc00 0x7f189006e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.905+0000 7f188fe00640 1 -- 172.21.15.194:0/2944450131 >> v1:172.21.15.194:6789/0 conn(0x7f189015db40 legacy=0x7f189006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.905+0000 7f188fe00640 1 -- 172.21.15.194:0/2944450131 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18900cb410 con 0x7f18900cbef0 2024-04-25T09:02:27.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f188fe00640 1 --2- 172.21.15.194:0/2944450131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18900cbef0 0x7f18900cc360 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1890061910 tx=0x7f187c01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f34ae680279decb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:27.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f188f400640 1 -- 172.21.15.194:0/2944450131 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c0b5070 con 0x7f18900cbef0 2024-04-25T09:02:27.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f188f400640 1 -- 172.21.15.194:0/2944450131 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c0a8970 con 0x7f18900cbef0 2024-04-25T09:02:27.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f188f400640 1 -- 172.21.15.194:0/2944450131 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c0a8d40 con 0x7f18900cbef0 2024-04-25T09:02:27.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f1897600640 1 -- 172.21.15.194:0/2944450131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18900cbef0 msgr2=0x7f18900cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f1897600640 1 --2- 172.21.15.194:0/2944450131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18900cbef0 0x7f18900cc360 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1890061910 tx=0x7f187c01ec70 comp rx=0 tx=0).stop 2024-04-25T09:02:27.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f1897600640 1 -- 172.21.15.194:0/2944450131 shutdown_connections 2024-04-25T09:02:27.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f1897600640 1 --2- 172.21.15.194:0/2944450131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18900cbef0 0x7f18900cc360 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f1897600640 1 --2- 172.21.15.194:0/2944450131 >> v2:172.21.15.173:3300/0 conn(0x7f189006dc00 0x7f189006e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f1897600640 1 -- 172.21.15.194:0/2944450131 >> 172.21.15.194:0/2944450131 conn(0x7f1890071ba0 msgr2=0x7f1890071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:27.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f1897600640 1 -- 172.21.15.194:0/2944450131 shutdown_connections 2024-04-25T09:02:27.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f1897600640 1 -- 172.21.15.194:0/2944450131 wait complete. 2024-04-25T09:02:27.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f1897600640 1 Processor -- start 2024-04-25T09:02:27.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f1897600640 1 -- start start 2024-04-25T09:02:27.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f1897600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f189006dc00 0x7f18900c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f1897600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18900cbef0 0x7f18900c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f1897600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f189015db40 0x7f1890157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f1897600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189015df20 con 0x7f18900cbef0 2024-04-25T09:02:27.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f1897600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18900cb9d0 con 0x7f189015db40 2024-04-25T09:02:27.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.909+0000 7f1897600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189015e0a0 con 0x7f189006dc00 2024-04-25T09:02:27.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f1894c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f189006dc00 0x7f18900c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f1894c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f189006dc00 0x7f18900c7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:43886/0 (socket says 172.21.15.194:43886) 2024-04-25T09:02:27.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f1894c00640 1 -- 172.21.15.194:0/784711093 learned_addr learned my addr 172.21.15.194:0/784711093 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-25T09:02:27.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f188fe00640 1 --2- 172.21.15.194:0/784711093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18900cbef0 0x7f18900c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f1895600640 1 --2- 172.21.15.194:0/784711093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f189015db40 0x7f1890157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f1894c00640 1 -- 172.21.15.194:0/784711093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f189015db40 msgr2=0x7f1890157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f1894c00640 1 --2- 172.21.15.194:0/784711093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f189015db40 0x7f1890157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f1894c00640 1 -- 172.21.15.194:0/784711093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18900cbef0 msgr2=0x7f18900c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f1894c00640 1 --2- 172.21.15.194:0/784711093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18900cbef0 0x7f18900c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f1894c00640 1 -- 172.21.15.194:0/784711093 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18900c8370 con 0x7f189006dc00 2024-04-25T09:02:27.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f188fe00640 1 --2- 172.21.15.194:0/784711093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18900cbef0 0x7f18900c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:27.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f1894c00640 1 --2- 172.21.15.194:0/784711093 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f189006dc00 0x7f18900c7c20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f188400c480 tx=0x7f188400c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:27.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f188cc00640 1 -- 172.21.15.194:0/784711093 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1884017070 con 0x7f189006dc00 2024-04-25T09:02:27.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f188cc00640 1 -- 172.21.15.194:0/784711093 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1884005cf0 con 0x7f189006dc00 2024-04-25T09:02:27.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f188cc00640 1 -- 172.21.15.194:0/784711093 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1884007290 con 0x7f189006dc00 2024-04-25T09:02:27.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f1897600640 1 -- 172.21.15.194:0/784711093 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18900c8650 con 0x7f189006dc00 2024-04-25T09:02:27.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f1897600640 1 -- 172.21.15.194:0/784711093 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18900c8c10 con 0x7f189006dc00 2024-04-25T09:02:27.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f188cc00640 1 -- 172.21.15.194:0/784711093 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f188401a070 con 0x7f189006dc00 2024-04-25T09:02:27.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f188cc00640 1 -- 172.21.15.194:0/784711093 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f188401c440 con 0x7f189006dc00 2024-04-25T09:02:27.907 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:27.912+0000 7f4e9e655180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T09:02:27.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.913+0000 7f1897600640 1 -- 172.21.15.194:0/784711093 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1890073ab0 con 0x7f189006dc00 2024-04-25T09:02:27.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.917+0000 7f188cc00640 1 -- 172.21.15.194:0/784711093 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f1884021070 con 0x7f189006dc00 2024-04-25T09:02:27.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.981+0000 7f1897600640 1 -- 172.21.15.194:0/784711093 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "acaf3e24-f28d-430d-be7e-a83609b4b156", "id": 3} v 0) v1 -- 0x7f18900c5510 con 0x7f189006dc00 2024-04-25T09:02:27.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.985+0000 7f188cc00640 1 -- 172.21.15.194:0/784711093 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "acaf3e24-f28d-430d-be7e-a83609b4b156", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f188401c850 con 0x7f189006dc00 2024-04-25T09:02:27.977 INFO:teuthology.orchestra.run.smithi194.stdout:3 2024-04-25T09:02:27.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.985+0000 7f1897600640 1 -- 172.21.15.194:0/784711093 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f189006dc00 msgr2=0x7f18900c7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.985+0000 7f1897600640 1 --2- 172.21.15.194:0/784711093 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f189006dc00 0x7f18900c7c20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f188400c480 tx=0x7f188400c940 comp rx=0 tx=0).stop 2024-04-25T09:02:27.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.985+0000 7f1897600640 1 -- 172.21.15.194:0/784711093 shutdown_connections 2024-04-25T09:02:27.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.985+0000 7f1897600640 1 --2- 172.21.15.194:0/784711093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f189015db40 0x7f1890157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.985+0000 7f1897600640 1 --2- 172.21.15.194:0/784711093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18900cbef0 0x7f18900c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.985+0000 7f1897600640 1 --2- 172.21.15.194:0/784711093 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f189006dc00 0x7f18900c7c20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.985+0000 7f1897600640 1 -- 172.21.15.194:0/784711093 >> 172.21.15.194:0/784711093 conn(0x7f1890071ba0 msgr2=0x7f189015bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:27.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.985+0000 7f1897600640 1 -- 172.21.15.194:0/784711093 shutdown_connections 2024-04-25T09:02:27.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:27.985+0000 7f1897600640 1 -- 172.21.15.194:0/784711093 wait complete. 2024-04-25T09:02:27.996 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 84fb0c8f-5eba-4af1-a81c-65cc23168cf9 4 2024-04-25T09:02:28.034 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:28.041+0000 7fed389d0180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T09:02:28.098 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:28.105+0000 7fed389d0180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T09:02:28.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.141+0000 7f89de000640 1 Processor -- start 2024-04-25T09:02:28.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.141+0000 7f89de000640 1 -- start start 2024-04-25T09:02:28.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.141+0000 7f89de000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f89d815ba20 0x7f89d80cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.141+0000 7f89de000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f89d8099a50 0x7f89d8099ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.141+0000 7f89de000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d80cc6a0 con 0x7f89d80cfe20 2024-04-25T09:02:28.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.141+0000 7f89de000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d809a400 con 0x7f89d815ba20 2024-04-25T09:02:28.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.141+0000 7f89de000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d80cd2b0 con 0x7f89d8099a50 2024-04-25T09:02:28.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.141+0000 7f89cfe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f89d8099a50 0x7f89d8099ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.141+0000 7f89cfe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f89d8099a50 0x7f89d8099ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:39306/0 (socket says 172.21.15.194:39306) 2024-04-25T09:02:28.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.141+0000 7f89cfe00640 1 -- 172.21.15.194:0/2687287934 learned_addr learned my addr 172.21.15.194:0/2687287934 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-25T09:02:28.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.141+0000 7f89d7400640 1 --2- 172.21.15.194:0/2687287934 >> v2:172.21.15.173:3300/0 conn(0x7f89d815ba20 0x7f89d80cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.141+0000 7f89cfe00640 1 -- 172.21.15.194:0/2687287934 >> v2:172.21.15.173:3300/0 conn(0x7f89d815ba20 msgr2=0x7f89d80cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:28.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.141+0000 7f89cfe00640 1 --2- 172.21.15.194:0/2687287934 >> v2:172.21.15.173:3300/0 conn(0x7f89d815ba20 0x7f89d80cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.141+0000 7f89cfe00640 1 -- 172.21.15.194:0/2687287934 >> v1:172.21.15.173:6789/0 conn(0x7f89d80cfe20 legacy=0x7f89d80d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.141+0000 7f89cfe00640 1 -- 172.21.15.194:0/2687287934 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d80cc980 con 0x7f89d8099a50 2024-04-25T09:02:28.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.145+0000 7f89cfe00640 1 --2- 172.21.15.194:0/2687287934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89d8099a50 0x7f89d8099ec0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f89d815f580 tx=0x7f89c001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbfdb3e1ca65c56a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:28.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89d6a00640 1 -- 172.21.15.194:0/2687287934 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c00ab660 con 0x7f89d8099a50 2024-04-25T09:02:28.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89d6a00640 1 -- 172.21.15.194:0/2687287934 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c00b0070 con 0x7f89d8099a50 2024-04-25T09:02:28.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89d6a00640 1 -- 172.21.15.194:0/2687287934 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c00aba20 con 0x7f89d8099a50 2024-04-25T09:02:28.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89de000640 1 -- 172.21.15.194:0/2687287934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89d8099a50 msgr2=0x7f89d8099ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89de000640 1 --2- 172.21.15.194:0/2687287934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89d8099a50 0x7f89d8099ec0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f89d815f580 tx=0x7f89c001c460 comp rx=0 tx=0).stop 2024-04-25T09:02:28.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89de000640 1 -- 172.21.15.194:0/2687287934 shutdown_connections 2024-04-25T09:02:28.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89de000640 1 --2- 172.21.15.194:0/2687287934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89d8099a50 0x7f89d8099ec0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89de000640 1 --2- 172.21.15.194:0/2687287934 >> v2:172.21.15.173:3300/0 conn(0x7f89d815ba20 0x7f89d80cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89de000640 1 -- 172.21.15.194:0/2687287934 >> 172.21.15.194:0/2687287934 conn(0x7f89d80b32a0 msgr2=0x7f89d80b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:28.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89de000640 1 -- 172.21.15.194:0/2687287934 shutdown_connections 2024-04-25T09:02:28.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89de000640 1 -- 172.21.15.194:0/2687287934 wait complete. 2024-04-25T09:02:28.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89de000640 1 Processor -- start 2024-04-25T09:02:28.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89de000640 1 -- start start 2024-04-25T09:02:28.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89de000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89d8099a50 0x7f89d80b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89de000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89d80cfe20 0x7f89d815c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89de000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89d815ba20 0x7f89d80cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89de000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d815bf80 con 0x7f89d8099a50 2024-04-25T09:02:28.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89de000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d815be00 con 0x7f89d815ba20 2024-04-25T09:02:28.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89de000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d80cc2c0 con 0x7f89d80cfe20 2024-04-25T09:02:28.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89d7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89d8099a50 0x7f89d80b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89cfe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89d80cfe20 0x7f89d815c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89d7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89d815ba20 0x7f89d80cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89d7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89d8099a50 0x7f89d80b54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.194:33242/0 (socket says 172.21.15.194:33242) 2024-04-25T09:02:28.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.149+0000 7f89d7400640 1 -- 172.21.15.194:0/4105254148 learned_addr learned my addr 172.21.15.194:0/4105254148 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-25T09:02:28.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.153+0000 7f89d7400640 1 -- 172.21.15.194:0/4105254148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89d80cfe20 msgr2=0x7f89d815c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.153+0000 7f89d7400640 1 --2- 172.21.15.194:0/4105254148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89d80cfe20 0x7f89d815c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.153+0000 7f89d7400640 1 -- 172.21.15.194:0/4105254148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89d815ba20 msgr2=0x7f89d80cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.153+0000 7f89d7400640 1 --2- 172.21.15.194:0/4105254148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89d815ba20 0x7f89d80cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.153+0000 7f89d7400640 1 -- 172.21.15.194:0/4105254148 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d80c9d00 con 0x7f89d8099a50 2024-04-25T09:02:28.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.153+0000 7f89d7400640 1 --2- 172.21.15.194:0/4105254148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89d8099a50 0x7f89d80b54b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f89c800e960 tx=0x7f89c800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:28.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.153+0000 7f89cf400640 1 -- 172.21.15.194:0/4105254148 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c8017070 con 0x7f89d8099a50 2024-04-25T09:02:28.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.153+0000 7f89cf400640 1 -- 172.21.15.194:0/4105254148 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c800ca00 con 0x7f89d8099a50 2024-04-25T09:02:28.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.153+0000 7f89de000640 1 -- 172.21.15.194:0/4105254148 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d80c9fe0 con 0x7f89d8099a50 2024-04-25T09:02:28.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.153+0000 7f89cf400640 1 -- 172.21.15.194:0/4105254148 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c800cdb0 con 0x7f89d8099a50 2024-04-25T09:02:28.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.153+0000 7f89de000640 1 -- 172.21.15.194:0/4105254148 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d80ca5a0 con 0x7f89d8099a50 2024-04-25T09:02:28.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.153+0000 7f89cf400640 1 -- 172.21.15.194:0/4105254148 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f89c801a070 con 0x7f89d8099a50 2024-04-25T09:02:28.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.153+0000 7f89cf400640 1 -- 172.21.15.194:0/4105254148 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f89c801cad0 con 0x7f89d8099a50 2024-04-25T09:02:28.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.153+0000 7f89de000640 1 -- 172.21.15.194:0/4105254148 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d8073ab0 con 0x7f89d8099a50 2024-04-25T09:02:28.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.157+0000 7f89cf400640 1 -- 172.21.15.194:0/4105254148 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f89c801cd80 con 0x7f89d8099a50 2024-04-25T09:02:28.165 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:28.173+0000 7fed389d0180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T09:02:28.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.221+0000 7f89de000640 1 -- 172.21.15.194:0/4105254148 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "84fb0c8f-5eba-4af1-a81c-65cc23168cf9", "id": 4} v 0) v1 -- 0x7f89d80b4140 con 0x7f89d8099a50 2024-04-25T09:02:28.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.225+0000 7f89cf400640 1 -- 172.21.15.194:0/4105254148 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "84fb0c8f-5eba-4af1-a81c-65cc23168cf9", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f89c801c650 con 0x7f89d8099a50 2024-04-25T09:02:28.217 INFO:teuthology.orchestra.run.smithi194.stdout:4 2024-04-25T09:02:28.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.225+0000 7f89de000640 1 -- 172.21.15.194:0/4105254148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89d8099a50 msgr2=0x7f89d80b54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.225+0000 7f89de000640 1 --2- 172.21.15.194:0/4105254148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89d8099a50 0x7f89d80b54b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f89c800e960 tx=0x7f89c800ee20 comp rx=0 tx=0).stop 2024-04-25T09:02:28.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.225+0000 7f89de000640 1 -- 172.21.15.194:0/4105254148 shutdown_connections 2024-04-25T09:02:28.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.225+0000 7f89de000640 1 --2- 172.21.15.194:0/4105254148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89d815ba20 0x7f89d80cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.225+0000 7f89de000640 1 --2- 172.21.15.194:0/4105254148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89d80cfe20 0x7f89d815c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.225+0000 7f89de000640 1 --2- 172.21.15.194:0/4105254148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89d8099a50 0x7f89d80b54b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.225+0000 7f89de000640 1 -- 172.21.15.194:0/4105254148 >> 172.21.15.194:0/4105254148 conn(0x7f89d80b32a0 msgr2=0x7f89d806d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:28.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.225+0000 7f89de000640 1 -- 172.21.15.194:0/4105254148 shutdown_connections 2024-04-25T09:02:28.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.225+0000 7f89de000640 1 -- 172.21.15.194:0/4105254148 wait complete. 2024-04-25T09:02:28.238 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new f01be7f3-d7fd-43d9-b56e-6414e227a029 5 2024-04-25T09:02:28.257 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:28.265+0000 7fed389d0180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T09:02:28.320 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:28.329+0000 7fed389d0180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T09:02:28.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.401+0000 7fca4f000640 1 Processor -- start 2024-04-25T09:02:28.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.401+0000 7fca4f000640 1 -- start start 2024-04-25T09:02:28.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.401+0000 7fca4f000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca4815db40 0x7fca4806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.401+0000 7fca4f000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fca480cbef0 0x7fca480cc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.401+0000 7fca4f000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca48072b60 con 0x7fca4806dc00 2024-04-25T09:02:28.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.401+0000 7fca4f000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca480cae50 con 0x7fca480cbef0 2024-04-25T09:02:28.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.401+0000 7fca4f000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca480cb130 con 0x7fca4815db40 2024-04-25T09:02:28.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.401+0000 7fca47e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca4815db40 0x7fca4806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.401+0000 7fca47e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca4815db40 0x7fca4806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:43908/0 (socket says 172.21.15.194:43908) 2024-04-25T09:02:28.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.401+0000 7fca47e00640 1 -- 172.21.15.194:0/3032658915 learned_addr learned my addr 172.21.15.194:0/3032658915 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-25T09:02:28.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.401+0000 7fca47400640 1 --2- 172.21.15.194:0/3032658915 >> v2:172.21.15.173:3300/0 conn(0x7fca480cbef0 0x7fca480cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.405+0000 7fca47e00640 1 -- 172.21.15.194:0/3032658915 >> v2:172.21.15.173:3300/0 conn(0x7fca480cbef0 msgr2=0x7fca480cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:28.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.405+0000 7fca47e00640 1 --2- 172.21.15.194:0/3032658915 >> v2:172.21.15.173:3300/0 conn(0x7fca480cbef0 0x7fca480cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.405+0000 7fca47e00640 1 -- 172.21.15.194:0/3032658915 >> v1:172.21.15.173:6789/0 conn(0x7fca4806dc00 legacy=0x7fca4806bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.405+0000 7fca47e00640 1 -- 172.21.15.194:0/3032658915 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca480cb410 con 0x7fca4815db40 2024-04-25T09:02:28.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.405+0000 7fca47e00640 1 --2- 172.21.15.194:0/3032658915 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca4815db40 0x7fca4806ff50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fca38009870 tx=0x7fca3801ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d4c4499ff270238 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:28.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.405+0000 7fca46a00640 1 -- 172.21.15.194:0/3032658915 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca380b5070 con 0x7fca4815db40 2024-04-25T09:02:28.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.405+0000 7fca46a00640 1 -- 172.21.15.194:0/3032658915 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca380a8a50 con 0x7fca4815db40 2024-04-25T09:02:28.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.405+0000 7fca46a00640 1 -- 172.21.15.194:0/3032658915 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca380a8e20 con 0x7fca4815db40 2024-04-25T09:02:28.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca4f000640 1 -- 172.21.15.194:0/3032658915 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca4815db40 msgr2=0x7fca4806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca4f000640 1 --2- 172.21.15.194:0/3032658915 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca4815db40 0x7fca4806ff50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fca38009870 tx=0x7fca3801ed50 comp rx=0 tx=0).stop 2024-04-25T09:02:28.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca4f000640 1 -- 172.21.15.194:0/3032658915 shutdown_connections 2024-04-25T09:02:28.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca4f000640 1 --2- 172.21.15.194:0/3032658915 >> v2:172.21.15.173:3300/0 conn(0x7fca480cbef0 0x7fca480cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca4f000640 1 --2- 172.21.15.194:0/3032658915 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca4815db40 0x7fca4806ff50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca4f000640 1 -- 172.21.15.194:0/3032658915 >> 172.21.15.194:0/3032658915 conn(0x7fca48071ba0 msgr2=0x7fca48071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:28.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca4f000640 1 -- 172.21.15.194:0/3032658915 shutdown_connections 2024-04-25T09:02:28.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca4f000640 1 -- 172.21.15.194:0/3032658915 wait complete. 2024-04-25T09:02:28.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca4f000640 1 Processor -- start 2024-04-25T09:02:28.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca4f000640 1 -- start start 2024-04-25T09:02:28.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca4f000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca4806dc00 0x7fca480c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca4f000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca480cbef0 0x7fca480b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca4f000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca4815db40 0x7fca480b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca4f000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca48070490 con 0x7fca4815db40 2024-04-25T09:02:28.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca4f000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca480cb9d0 con 0x7fca480cbef0 2024-04-25T09:02:28.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca4f000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4815df20 con 0x7fca4806dc00 2024-04-25T09:02:28.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca47e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca4806dc00 0x7fca480c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca47400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca480cbef0 0x7fca480b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca47e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca4806dc00 0x7fca480c99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:43922/0 (socket says 172.21.15.194:43922) 2024-04-25T09:02:28.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca47e00640 1 -- 172.21.15.194:0/4290114788 learned_addr learned my addr 172.21.15.194:0/4290114788 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-25T09:02:28.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca4d000640 1 --2- 172.21.15.194:0/4290114788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca4815db40 0x7fca480b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca47400640 1 -- 172.21.15.194:0/4290114788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca4806dc00 msgr2=0x7fca480c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca47400640 1 --2- 172.21.15.194:0/4290114788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca4806dc00 0x7fca480c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca47400640 1 -- 172.21.15.194:0/4290114788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca4815db40 msgr2=0x7fca480b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca47400640 1 --2- 172.21.15.194:0/4290114788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca4815db40 0x7fca480b2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca47400640 1 -- 172.21.15.194:0/4290114788 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca480b3310 con 0x7fca480cbef0 2024-04-25T09:02:28.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.409+0000 7fca47400640 1 --2- 172.21.15.194:0/4290114788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca480cbef0 0x7fca480b43b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fca3400e870 tx=0x7fca3400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:28.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.413+0000 7fca3fe00640 1 -- 172.21.15.194:0/4290114788 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34017070 con 0x7fca480cbef0 2024-04-25T09:02:28.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.413+0000 7fca3fe00640 1 -- 172.21.15.194:0/4290114788 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3400ee60 con 0x7fca480cbef0 2024-04-25T09:02:28.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.413+0000 7fca3fe00640 1 -- 172.21.15.194:0/4290114788 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3400cb60 con 0x7fca480cbef0 2024-04-25T09:02:28.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.413+0000 7fca4f000640 1 -- 172.21.15.194:0/4290114788 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca480b35f0 con 0x7fca480cbef0 2024-04-25T09:02:28.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.413+0000 7fca4f000640 1 -- 172.21.15.194:0/4290114788 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca480b3bb0 con 0x7fca480cbef0 2024-04-25T09:02:28.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.413+0000 7fca3fe00640 1 -- 172.21.15.194:0/4290114788 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fca3401a070 con 0x7fca480cbef0 2024-04-25T09:02:28.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.413+0000 7fca3fe00640 1 -- 172.21.15.194:0/4290114788 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fca3400cd00 con 0x7fca480cbef0 2024-04-25T09:02:28.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.413+0000 7fca4f000640 1 -- 172.21.15.194:0/4290114788 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca48073ab0 con 0x7fca480cbef0 2024-04-25T09:02:28.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.417+0000 7fca3fe00640 1 -- 172.21.15.194:0/4290114788 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fca340063e0 con 0x7fca480cbef0 2024-04-25T09:02:28.414 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:28.421+0000 7fed389d0180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T09:02:28.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.481+0000 7fca4f000640 1 -- 172.21.15.194:0/4290114788 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f01be7f3-d7fd-43d9-b56e-6414e227a029", "id": 5} v 0) v1 -- 0x7fca48061be0 con 0x7fca480cbef0 2024-04-25T09:02:28.475 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:28.485+0000 7fed389d0180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T09:02:28.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.489+0000 7fca3fe00640 1 -- 172.21.15.194:0/4290114788 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f01be7f3-d7fd-43d9-b56e-6414e227a029", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fca34006690 con 0x7fca480cbef0 2024-04-25T09:02:28.479 INFO:teuthology.orchestra.run.smithi194.stdout:5 2024-04-25T09:02:28.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.489+0000 7fca4f000640 1 -- 172.21.15.194:0/4290114788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca480cbef0 msgr2=0x7fca480b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.489+0000 7fca4f000640 1 --2- 172.21.15.194:0/4290114788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca480cbef0 0x7fca480b43b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fca3400e870 tx=0x7fca3400ed30 comp rx=0 tx=0).stop 2024-04-25T09:02:28.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.489+0000 7fca4f000640 1 -- 172.21.15.194:0/4290114788 shutdown_connections 2024-04-25T09:02:28.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.489+0000 7fca4f000640 1 --2- 172.21.15.194:0/4290114788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca4815db40 0x7fca480b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.489+0000 7fca4f000640 1 --2- 172.21.15.194:0/4290114788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca480cbef0 0x7fca480b43b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.489+0000 7fca4f000640 1 --2- 172.21.15.194:0/4290114788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca4806dc00 0x7fca480c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.489+0000 7fca4f000640 1 -- 172.21.15.194:0/4290114788 >> 172.21.15.194:0/4290114788 conn(0x7fca48071ba0 msgr2=0x7fca4806bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:28.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.489+0000 7fca4f000640 1 -- 172.21.15.194:0/4290114788 shutdown_connections 2024-04-25T09:02:28.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.489+0000 7fca4f000640 1 -- 172.21.15.194:0/4290114788 wait complete. 2024-04-25T09:02:28.498 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 8d53ce00-6e97-445b-83e5-1a20e68c6729 6 2024-04-25T09:02:28.562 INFO:tasks.ceph.mgr.y.smithi173.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T09:02:28.563 INFO:tasks.ceph.mgr.y.smithi173.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T09:02:28.563 INFO:tasks.ceph.mgr.y.smithi173.stderr: from numpy import show_config as show_numpy_config 2024-04-25T09:02:28.602 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:28.612+0000 7f4e9e655180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T09:02:28.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.641+0000 7f62ae800640 1 Processor -- start 2024-04-25T09:02:28.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.641+0000 7f62ae800640 1 -- start start 2024-04-25T09:02:28.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.645+0000 7f62ae800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f62a8140760 0x7f62a80b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.645+0000 7f62ae800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62a806e510 0x7f62a80b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.645+0000 7f62ae800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a806e990 con 0x7f62a8071f70 2024-04-25T09:02:28.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.645+0000 7f62ae800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a80b3180 con 0x7f62a8140760 2024-04-25T09:02:28.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.645+0000 7f62ae800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a80b3460 con 0x7f62a806e510 2024-04-25T09:02:28.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.645+0000 7f629ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62a806e510 0x7f62a80b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.645+0000 7f62a7400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f62a8140760 0x7f62a80b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.645+0000 7f629ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62a806e510 0x7f62a80b4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:43932/0 (socket says 172.21.15.194:43932) 2024-04-25T09:02:28.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.645+0000 7f629ea00640 1 -- 172.21.15.194:0/2137624429 learned_addr learned my addr 172.21.15.194:0/2137624429 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-25T09:02:28.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.645+0000 7f62a7400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f62a8140760 0x7f62a80b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:39324/0 (socket says 172.21.15.194:39324) 2024-04-25T09:02:28.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.645+0000 7f629ea00640 1 -- 172.21.15.194:0/2137624429 >> v2:172.21.15.194:3300/0 conn(0x7f62a8140760 msgr2=0x7f62a80b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:28.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.645+0000 7f629ea00640 1 --2- 172.21.15.194:0/2137624429 >> v2:172.21.15.194:3300/0 conn(0x7f62a8140760 0x7f62a80b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.645+0000 7f629ea00640 1 -- 172.21.15.194:0/2137624429 >> v1:172.21.15.173:6789/0 conn(0x7f62a8071f70 legacy=0x7f62a80cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.645+0000 7f62a6a00640 1 -- 172.21.15.194:0/2137624429 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455245700 0 0) 0x7f62a806e990 con 0x7f62a8071f70 2024-04-25T09:02:28.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.645+0000 7f629ea00640 1 -- 172.21.15.194:0/2137624429 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a80b3740 con 0x7f62a806e510 2024-04-25T09:02:28.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.645+0000 7f62a7400640 1 --2- 172.21.15.194:0/2137624429 >> v2:172.21.15.194:3300/0 conn(0x7f62a8140760 0x7f62a80b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:28.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.649+0000 7f629ea00640 1 --2- 172.21.15.194:0/2137624429 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62a806e510 0x7f62a80b4220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6290009870 tx=0x7f629001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eed808cd9716c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:28.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.649+0000 7f62a6a00640 1 -- 172.21.15.194:0/2137624429 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62900ab620 con 0x7f62a806e510 2024-04-25T09:02:28.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.649+0000 7f62a6a00640 1 -- 172.21.15.194:0/2137624429 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62900b0070 con 0x7f62a806e510 2024-04-25T09:02:28.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.649+0000 7f62a6a00640 1 -- 172.21.15.194:0/2137624429 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62900ab9e0 con 0x7f62a806e510 2024-04-25T09:02:28.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.649+0000 7f62ae800640 1 -- 172.21.15.194:0/2137624429 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62a806e510 msgr2=0x7f62a80b4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.649+0000 7f62ae800640 1 --2- 172.21.15.194:0/2137624429 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62a806e510 0x7f62a80b4220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6290009870 tx=0x7f629001c530 comp rx=0 tx=0).stop 2024-04-25T09:02:28.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.649+0000 7f62ae800640 1 -- 172.21.15.194:0/2137624429 shutdown_connections 2024-04-25T09:02:28.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.649+0000 7f62ae800640 1 --2- 172.21.15.194:0/2137624429 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62a806e510 0x7f62a80b4220 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.649+0000 7f62ae800640 1 --2- 172.21.15.194:0/2137624429 >> v2:172.21.15.194:3300/0 conn(0x7f62a8140760 0x7f62a80b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.649+0000 7f62ae800640 1 -- 172.21.15.194:0/2137624429 >> 172.21.15.194:0/2137624429 conn(0x7f62a80b17a0 msgr2=0x7f62a80b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:28.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.649+0000 7f62ae800640 1 -- 172.21.15.194:0/2137624429 shutdown_connections 2024-04-25T09:02:28.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.649+0000 7f62ae800640 1 -- 172.21.15.194:0/2137624429 wait complete. 2024-04-25T09:02:28.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62ae800640 1 Processor -- start 2024-04-25T09:02:28.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62ae800640 1 -- start start 2024-04-25T09:02:28.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62ae800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62a806e510 0x7f62a813c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62ae800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62a8071f70 0x7f62a813ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62ae800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62a8140760 0x7f62a813dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62ae800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a80cdcd0 con 0x7f62a8071f70 2024-04-25T09:02:28.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62ae800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a80727e0 con 0x7f62a806e510 2024-04-25T09:02:28.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62ae800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a80cde50 con 0x7f62a8140760 2024-04-25T09:02:28.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62a7400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62a806e510 0x7f62a813c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62a7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62a8140760 0x7f62a813dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62a7400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62a806e510 0x7f62a813c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:39328/0 (socket says 172.21.15.194:39328) 2024-04-25T09:02:28.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62a7400640 1 -- 172.21.15.194:0/2447493488 learned_addr learned my addr 172.21.15.194:0/2447493488 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-25T09:02:28.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f629ea00640 1 --2- 172.21.15.194:0/2447493488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62a8071f70 0x7f62a813ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62a7e00640 1 -- 172.21.15.194:0/2447493488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62a806e510 msgr2=0x7f62a813c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62a7e00640 1 --2- 172.21.15.194:0/2447493488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62a806e510 0x7f62a813c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62a7e00640 1 -- 172.21.15.194:0/2447493488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62a8071f70 msgr2=0x7f62a813ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62a7e00640 1 --2- 172.21.15.194:0/2447493488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62a8071f70 0x7f62a813ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62a7e00640 1 -- 172.21.15.194:0/2447493488 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a80ae410 con 0x7f62a8140760 2024-04-25T09:02:28.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62a7400640 1 --2- 172.21.15.194:0/2447493488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62a806e510 0x7f62a813c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:28.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f62a7e00640 1 --2- 172.21.15.194:0/2447493488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62a8140760 0x7f62a813dd60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f62a806bf50 tx=0x7f62a000c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:28.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f629fe00640 1 -- 172.21.15.194:0/2447493488 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a0017070 con 0x7f62a8140760 2024-04-25T09:02:28.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.653+0000 7f629fe00640 1 -- 172.21.15.194:0/2447493488 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a0003600 con 0x7f62a8140760 2024-04-25T09:02:28.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.657+0000 7f629fe00640 1 -- 172.21.15.194:0/2447493488 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a00039f0 con 0x7f62a8140760 2024-04-25T09:02:28.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.657+0000 7f62ae800640 1 -- 172.21.15.194:0/2447493488 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a80ad370 con 0x7f62a8140760 2024-04-25T09:02:28.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.657+0000 7f62ae800640 1 -- 172.21.15.194:0/2447493488 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a80ad930 con 0x7f62a8140760 2024-04-25T09:02:28.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.657+0000 7f629fe00640 1 -- 172.21.15.194:0/2447493488 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f62a001a070 con 0x7f62a8140760 2024-04-25T09:02:28.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.657+0000 7f629fe00640 1 -- 172.21.15.194:0/2447493488 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f62a0003b90 con 0x7f62a8140760 2024-04-25T09:02:28.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.657+0000 7f62ae800640 1 -- 172.21.15.194:0/2447493488 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a8073ab0 con 0x7f62a8140760 2024-04-25T09:02:28.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.657+0000 7f629fe00640 1 -- 172.21.15.194:0/2447493488 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f62a0021020 con 0x7f62a8140760 2024-04-25T09:02:28.654 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:28.661+0000 7fed389d0180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T09:02:28.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.725+0000 7f62ae800640 1 -- 172.21.15.194:0/2447493488 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8d53ce00-6e97-445b-83e5-1a20e68c6729", "id": 6} v 0) v1 -- 0x7f62a8067ea0 con 0x7f62a8140760 2024-04-25T09:02:28.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.729+0000 7f629fe00640 1 -- 172.21.15.194:0/2447493488 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8d53ce00-6e97-445b-83e5-1a20e68c6729", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f62a001c440 con 0x7f62a8140760 2024-04-25T09:02:28.722 INFO:teuthology.orchestra.run.smithi194.stdout:6 2024-04-25T09:02:28.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.733+0000 7f62ae800640 1 -- 172.21.15.194:0/2447493488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62a8140760 msgr2=0x7f62a813dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.733+0000 7f62ae800640 1 --2- 172.21.15.194:0/2447493488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62a8140760 0x7f62a813dd60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f62a806bf50 tx=0x7f62a000c820 comp rx=0 tx=0).stop 2024-04-25T09:02:28.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.733+0000 7f62ae800640 1 -- 172.21.15.194:0/2447493488 shutdown_connections 2024-04-25T09:02:28.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.733+0000 7f62ae800640 1 --2- 172.21.15.194:0/2447493488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62a8140760 0x7f62a813dd60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.733+0000 7f62ae800640 1 --2- 172.21.15.194:0/2447493488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62a8071f70 0x7f62a813ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.733+0000 7f62ae800640 1 --2- 172.21.15.194:0/2447493488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62a806e510 0x7f62a813c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.733+0000 7f62ae800640 1 -- 172.21.15.194:0/2447493488 >> 172.21.15.194:0/2447493488 conn(0x7f62a80b17a0 msgr2=0x7f62a80cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:28.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.733+0000 7f62ae800640 1 -- 172.21.15.194:0/2447493488 shutdown_connections 2024-04-25T09:02:28.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.733+0000 7f62ae800640 1 -- 172.21.15.194:0/2447493488 wait complete. 2024-04-25T09:02:28.729 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:28.737+0000 7fed389d0180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T09:02:28.742 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 1f7e8a2f-6e91-4f65-898b-935b49e35deb 7 2024-04-25T09:02:28.750 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:28.760+0000 7f4e9e655180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:02:28.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.885+0000 7f7320a00640 1 Processor -- start 2024-04-25T09:02:28.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.885+0000 7f7320a00640 1 -- start start 2024-04-25T09:02:28.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.885+0000 7f7320a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f731c0cbef0 0x7f731c0cc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.885+0000 7f7320a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f731c06dc00 0x7f731c06e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.885+0000 7f7320a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731c072b60 con 0x7f731c15db40 2024-04-25T09:02:28.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.885+0000 7f7320a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731c0cae50 con 0x7f731c06dc00 2024-04-25T09:02:28.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.885+0000 7f7320a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c0cb130 con 0x7f731c0cbef0 2024-04-25T09:02:28.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.885+0000 7f7319400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f731c0cbef0 0x7f731c0cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.885+0000 7f7319400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f731c0cbef0 0x7f731c0cc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:43940/0 (socket says 172.21.15.194:43940) 2024-04-25T09:02:28.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.885+0000 7f7319400640 1 -- 172.21.15.194:0/55686487 learned_addr learned my addr 172.21.15.194:0/55686487 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-25T09:02:28.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.885+0000 7f731a800640 1 --2- 172.21.15.194:0/55686487 >> v2:172.21.15.173:3300/0 conn(0x7f731c06dc00 0x7f731c06e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.885+0000 7f7319400640 1 -- 172.21.15.194:0/55686487 >> v2:172.21.15.173:3300/0 conn(0x7f731c06dc00 msgr2=0x7f731c06e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:28.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.885+0000 7f7319400640 1 --2- 172.21.15.194:0/55686487 >> v2:172.21.15.173:3300/0 conn(0x7f731c06dc00 0x7f731c06e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.885+0000 7f7319400640 1 -- 172.21.15.194:0/55686487 >> v1:172.21.15.173:6789/0 conn(0x7f731c15db40 legacy=0x7f731c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:28.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.885+0000 7f7319400640 1 -- 172.21.15.194:0/55686487 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c0cb410 con 0x7f731c0cbef0 2024-04-25T09:02:28.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.885+0000 7f731a800640 1 --2- 172.21.15.194:0/55686487 >> v2:172.21.15.173:3300/0 conn(0x7f731c06dc00 0x7f731c06e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:28.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.889+0000 7f7319400640 1 --2- 172.21.15.194:0/55686487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f731c0cbef0 0x7f731c0cc330 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7308009870 tx=0x7f730801ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1353611fc0cdc8ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:28.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.889+0000 7f7318a00640 1 -- 172.21.15.194:0/55686487 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73080b5070 con 0x7f731c0cbef0 2024-04-25T09:02:28.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.889+0000 7f7318a00640 1 -- 172.21.15.194:0/55686487 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73080a89d0 con 0x7f731c0cbef0 2024-04-25T09:02:28.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.889+0000 7f7318a00640 1 -- 172.21.15.194:0/55686487 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73080a8da0 con 0x7f731c0cbef0 2024-04-25T09:02:28.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.889+0000 7f7320a00640 1 -- 172.21.15.194:0/55686487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f731c0cbef0 msgr2=0x7f731c0cc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.889+0000 7f7320a00640 1 --2- 172.21.15.194:0/55686487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f731c0cbef0 0x7f731c0cc330 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7308009870 tx=0x7f730801ed10 comp rx=0 tx=0).stop 2024-04-25T09:02:28.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.889+0000 7f7320a00640 1 -- 172.21.15.194:0/55686487 shutdown_connections 2024-04-25T09:02:28.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.889+0000 7f7320a00640 1 --2- 172.21.15.194:0/55686487 >> v2:172.21.15.173:3300/0 conn(0x7f731c06dc00 0x7f731c06e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.889+0000 7f7320a00640 1 --2- 172.21.15.194:0/55686487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f731c0cbef0 0x7f731c0cc330 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.889+0000 7f7320a00640 1 -- 172.21.15.194:0/55686487 >> 172.21.15.194:0/55686487 conn(0x7f731c071ba0 msgr2=0x7f731c071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:28.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.889+0000 7f7320a00640 1 -- 172.21.15.194:0/55686487 shutdown_connections 2024-04-25T09:02:28.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.889+0000 7f7320a00640 1 -- 172.21.15.194:0/55686487 wait complete. 2024-04-25T09:02:28.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7320a00640 1 Processor -- start 2024-04-25T09:02:28.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7320a00640 1 -- start start 2024-04-25T09:02:28.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7320a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f731c06dc00 0x7f731c15e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7320a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f731c0cbef0 0x7f731c15e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7320a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f731c15db40 0x7f731c0c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7320a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c15df20 con 0x7f731c15db40 2024-04-25T09:02:28.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7320a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c0cb9d0 con 0x7f731c0cbef0 2024-04-25T09:02:28.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7320a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c15e0a0 con 0x7f731c06dc00 2024-04-25T09:02:28.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7319e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f731c06dc00 0x7f731c15e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7319400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f731c0cbef0 0x7f731c15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7319e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f731c06dc00 0x7f731c15e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:43946/0 (socket says 172.21.15.194:43946) 2024-04-25T09:02:28.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7319e00640 1 -- 172.21.15.194:0/324477547 learned_addr learned my addr 172.21.15.194:0/324477547 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-25T09:02:28.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f731a800640 1 --2- 172.21.15.194:0/324477547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f731c15db40 0x7f731c0c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7319400640 1 -- 172.21.15.194:0/324477547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f731c06dc00 msgr2=0x7f731c15e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7319400640 1 --2- 172.21.15.194:0/324477547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f731c06dc00 0x7f731c15e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7319400640 1 -- 172.21.15.194:0/324477547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f731c15db40 msgr2=0x7f731c0c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7319400640 1 --2- 172.21.15.194:0/324477547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f731c15db40 0x7f731c0c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7319400640 1 -- 172.21.15.194:0/324477547 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c1507b0 con 0x7f731c0cbef0 2024-04-25T09:02:28.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7319e00640 1 --2- 172.21.15.194:0/324477547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f731c06dc00 0x7f731c15e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:28.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7319400640 1 --2- 172.21.15.194:0/324477547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f731c0cbef0 0x7f731c15e790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f73080af000 tx=0x7f730801bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:28.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7312000640 1 -- 172.21.15.194:0/324477547 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73080c0070 con 0x7f731c0cbef0 2024-04-25T09:02:28.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7312000640 1 -- 172.21.15.194:0/324477547 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73080b0b70 con 0x7f731c0cbef0 2024-04-25T09:02:28.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7312000640 1 -- 172.21.15.194:0/324477547 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73080b5070 con 0x7f731c0cbef0 2024-04-25T09:02:28.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7320a00640 1 -- 172.21.15.194:0/324477547 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731c0c90f0 con 0x7f731c0cbef0 2024-04-25T09:02:28.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7320a00640 1 -- 172.21.15.194:0/324477547 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731c0c96b0 con 0x7f731c0cbef0 2024-04-25T09:02:28.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7312000640 1 -- 172.21.15.194:0/324477547 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f73080bb440 con 0x7f731c0cbef0 2024-04-25T09:02:28.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.893+0000 7f7312000640 1 -- 172.21.15.194:0/324477547 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f73080bbd90 con 0x7f731c0cbef0 2024-04-25T09:02:28.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.897+0000 7f7320a00640 1 -- 172.21.15.194:0/324477547 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731c150980 con 0x7f731c0cbef0 2024-04-25T09:02:28.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.897+0000 7f7312000640 1 -- 172.21.15.194:0/324477547 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f73080ca080 con 0x7f731c0cbef0 2024-04-25T09:02:28.934 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:28.944+0000 7f4e9e655180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T09:02:28.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.965+0000 7f7320a00640 1 -- 172.21.15.194:0/324477547 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1f7e8a2f-6e91-4f65-898b-935b49e35deb", "id": 7} v 0) v1 -- 0x7f731c073ab0 con 0x7f731c0cbef0 2024-04-25T09:02:28.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.969+0000 7f7312000640 1 -- 172.21.15.194:0/324477547 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1f7e8a2f-6e91-4f65-898b-935b49e35deb", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7308018870 con 0x7f731c0cbef0 2024-04-25T09:02:28.960 INFO:teuthology.orchestra.run.smithi194.stdout:7 2024-04-25T09:02:28.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.969+0000 7f7320a00640 1 -- 172.21.15.194:0/324477547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f731c0cbef0 msgr2=0x7f731c15e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.969+0000 7f7320a00640 1 --2- 172.21.15.194:0/324477547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f731c0cbef0 0x7f731c15e790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f73080af000 tx=0x7f730801bab0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.969+0000 7f7320a00640 1 -- 172.21.15.194:0/324477547 shutdown_connections 2024-04-25T09:02:28.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.969+0000 7f7320a00640 1 --2- 172.21.15.194:0/324477547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f731c15db40 0x7f731c0c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.969+0000 7f7320a00640 1 --2- 172.21.15.194:0/324477547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f731c0cbef0 0x7f731c15e790 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.969+0000 7f7320a00640 1 --2- 172.21.15.194:0/324477547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f731c06dc00 0x7f731c15e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.969+0000 7f7320a00640 1 -- 172.21.15.194:0/324477547 >> 172.21.15.194:0/324477547 conn(0x7f731c071ba0 msgr2=0x7f731c06bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:28.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.969+0000 7f7320a00640 1 -- 172.21.15.194:0/324477547 shutdown_connections 2024-04-25T09:02:28.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-25T09:02:28.969+0000 7f7320a00640 1 -- 172.21.15.194:0/324477547 wait complete. 2024-04-25T09:02:28.978 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T09:02:28.978 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T09:02:28.982 INFO:tasks.ceph.osd.0:Started 2024-04-25T09:02:28.982 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T09:02:28.983 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T09:02:28.987 INFO:tasks.ceph.osd.1:Started 2024-04-25T09:02:28.987 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T09:02:28.987 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T09:02:28.991 INFO:tasks.ceph.osd.2:Started 2024-04-25T09:02:28.991 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T09:02:28.991 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T09:02:28.995 INFO:tasks.ceph.osd.3:Started 2024-04-25T09:02:28.995 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T09:02:28.995 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T09:02:28.998 INFO:tasks.ceph.osd.4:Started 2024-04-25T09:02:28.998 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T09:02:28.998 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T09:02:29.001 INFO:tasks.ceph.osd.5:Started 2024-04-25T09:02:29.001 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T09:02:29.001 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T09:02:29.004 INFO:tasks.ceph.osd.6:Started 2024-04-25T09:02:29.004 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T09:02:29.004 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T09:02:29.009 INFO:tasks.ceph.osd.7:Started 2024-04-25T09:02:29.009 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:29.015 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:29.024+0000 7f4e9e655180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T09:02:29.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.192+0000 7f5df4400640 1 Processor -- start 2024-04-25T09:02:29.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.192+0000 7f5df4400640 1 -- start start 2024-04-25T09:02:29.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.196+0000 7f5df4400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5dec15ba20 0x7f5dec15be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.196+0000 7f5df4400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dec070070 0x7f5dec0d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.196+0000 7f5df4400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dec15c460 con 0x7f5dec0b70f0 2024-04-25T09:02:29.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.196+0000 7f5df4400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dec15c740 con 0x7f5dec15ba20 2024-04-25T09:02:29.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.196+0000 7f5df4400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec15ca20 con 0x7f5dec070070 2024-04-25T09:02:29.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.196+0000 7f5df1a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5dec15ba20 0x7f5dec15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.196+0000 7f5df1000640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f5dec0b70f0 0x7f5dec06f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:43772/0 (socket says 172.21.15.173:43772) 2024-04-25T09:02:29.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.196+0000 7f5df2400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dec070070 0x7f5dec0d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.196+0000 7f5df1000640 1 -- 172.21.15.173:0/143566234 learned_addr learned my addr 172.21.15.173:0/143566234 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:02:29.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.196+0000 7f5debe00640 1 -- 172.21.15.173:0/143566234 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540141823 0 0) 0x7f5dec15c460 con 0x7f5dec0b70f0 2024-04-25T09:02:29.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.196+0000 7f5debe00640 1 -- 172.21.15.173:0/143566234 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dd4003530 con 0x7f5dec0b70f0 2024-04-25T09:02:29.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.196+0000 7f5df2400640 1 -- 172.21.15.173:0/143566234 >> v2:172.21.15.194:3300/0 conn(0x7f5dec15ba20 msgr2=0x7f5dec15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.196+0000 7f5df2400640 1 --2- 172.21.15.173:0/143566234 >> v2:172.21.15.194:3300/0 conn(0x7f5dec15ba20 0x7f5dec15be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.196+0000 7f5df2400640 1 -- 172.21.15.173:0/143566234 >> v1:172.21.15.194:6789/0 conn(0x7f5dec0b70f0 legacy=0x7f5dec06f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.196+0000 7f5df2400640 1 -- 172.21.15.173:0/143566234 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec15cd00 con 0x7f5dec070070 2024-04-25T09:02:29.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.196+0000 7f5df1a00640 1 --2- 172.21.15.173:0/143566234 >> v2:172.21.15.194:3300/0 conn(0x7f5dec15ba20 0x7f5dec15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:29.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.200+0000 7f5df2400640 1 --2- 172.21.15.173:0/143566234 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dec070070 0x7f5dec0d1a80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009dc0 tx=0x7f5de401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87ffc598b20e7ea0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.200+0000 7f5debe00640 1 -- 172.21.15.173:0/143566234 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40b2070 con 0x7f5dec070070 2024-04-25T09:02:29.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.200+0000 7f5debe00640 1 -- 172.21.15.173:0/143566234 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de40a5a00 con 0x7f5dec070070 2024-04-25T09:02:29.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.200+0000 7f5debe00640 1 -- 172.21.15.173:0/143566234 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40a5dd0 con 0x7f5dec070070 2024-04-25T09:02:29.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.200+0000 7f5df4400640 1 -- 172.21.15.173:0/143566234 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dec070070 msgr2=0x7f5dec0d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.200+0000 7f5df4400640 1 --2- 172.21.15.173:0/143566234 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dec070070 0x7f5dec0d1a80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009dc0 tx=0x7f5de401c920 comp rx=0 tx=0).stop 2024-04-25T09:02:29.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.200+0000 7f5df4400640 1 -- 172.21.15.173:0/143566234 shutdown_connections 2024-04-25T09:02:29.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.200+0000 7f5df4400640 1 --2- 172.21.15.173:0/143566234 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dec070070 0x7f5dec0d1a80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.200+0000 7f5df4400640 1 --2- 172.21.15.173:0/143566234 >> v2:172.21.15.194:3300/0 conn(0x7f5dec15ba20 0x7f5dec15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.200+0000 7f5df4400640 1 -- 172.21.15.173:0/143566234 >> 172.21.15.173:0/143566234 conn(0x7f5dec061880 msgr2=0x7f5dec061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.200+0000 7f5df4400640 1 -- 172.21.15.173:0/143566234 shutdown_connections 2024-04-25T09:02:29.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.200+0000 7f5df4400640 1 -- 172.21.15.173:0/143566234 wait complete. 2024-04-25T09:02:29.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df4400640 1 Processor -- start 2024-04-25T09:02:29.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df4400640 1 -- start start 2024-04-25T09:02:29.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df4400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dec070070 0x7f5dec0c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df4400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5dec0b70f0 0x7f5dec0c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df4400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dec15ba20 0x7f5dec14ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df4400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec15e2f0 con 0x7f5dec15ba20 2024-04-25T09:02:29.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df4400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec15e170 con 0x7f5dec0b70f0 2024-04-25T09:02:29.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df4400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec15e470 con 0x7f5dec070070 2024-04-25T09:02:29.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df2400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dec15ba20 0x7f5dec14ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df1000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5dec0b70f0 0x7f5dec0c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df1a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dec070070 0x7f5dec0c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df1000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5dec0b70f0 0x7f5dec0c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:59490/0 (socket says 172.21.15.173:59490) 2024-04-25T09:02:29.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df1000640 1 -- 172.21.15.173:0/4121929557 learned_addr learned my addr 172.21.15.173:0/4121929557 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:29.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df2400640 1 -- 172.21.15.173:0/4121929557 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dec070070 msgr2=0x7f5dec0c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df2400640 1 --2- 172.21.15.173:0/4121929557 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dec070070 0x7f5dec0c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df2400640 1 -- 172.21.15.173:0/4121929557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5dec0b70f0 msgr2=0x7f5dec0c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df2400640 1 --2- 172.21.15.173:0/4121929557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5dec0b70f0 0x7f5dec0c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df2400640 1 -- 172.21.15.173:0/4121929557 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec0c8e40 con 0x7f5dec15ba20 2024-04-25T09:02:29.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df2400640 1 --2- 172.21.15.173:0/4121929557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dec15ba20 0x7f5dec14ccd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5de40ac000 tx=0x7f5de40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5de9600640 1 -- 172.21.15.173:0/4121929557 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40b2050 con 0x7f5dec15ba20 2024-04-25T09:02:29.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5de9600640 1 -- 172.21.15.173:0/4121929557 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de40be070 con 0x7f5dec15ba20 2024-04-25T09:02:29.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5de9600640 1 -- 172.21.15.173:0/4121929557 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40adc00 con 0x7f5dec15ba20 2024-04-25T09:02:29.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df4400640 1 -- 172.21.15.173:0/4121929557 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dec0c9120 con 0x7f5dec15ba20 2024-04-25T09:02:29.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df4400640 1 -- 172.21.15.173:0/4121929557 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dec0c96e0 con 0x7f5dec15ba20 2024-04-25T09:02:29.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5de9600640 1 -- 172.21.15.173:0/4121929557 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5de40c3460 con 0x7f5dec15ba20 2024-04-25T09:02:29.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5de9600640 1 -- 172.21.15.173:0/4121929557 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5de40b9b20 con 0x7f5dec15ba20 2024-04-25T09:02:29.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.204+0000 7f5df4400640 1 -- 172.21.15.173:0/4121929557 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dec073a40 con 0x7f5dec15ba20 2024-04-25T09:02:29.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.208+0000 7f5de9600640 1 -- 172.21.15.173:0/4121929557 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5de4016540 con 0x7f5dec15ba20 2024-04-25T09:02:29.211 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:29.220+0000 7f4e9e655180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:02:29.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.268+0000 7f5df4400640 1 -- 172.21.15.173:0/4121929557 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5dec0cefc0 con 0x7f5dec15ba20 2024-04-25T09:02:29.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.268+0000 7f5de9600640 1 -- 172.21.15.173:0/4121929557 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f5de40b9450 con 0x7f5dec15ba20 2024-04-25T09:02:29.258 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:02:29.258 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":10,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:28.969921+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:29.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.268+0000 7f5df4400640 1 -- 172.21.15.173:0/4121929557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dec15ba20 msgr2=0x7f5dec14ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.268+0000 7f5df4400640 1 --2- 172.21.15.173:0/4121929557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dec15ba20 0x7f5dec14ccd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5de40ac000 tx=0x7f5de40196c0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.268+0000 7f5df4400640 1 -- 172.21.15.173:0/4121929557 shutdown_connections 2024-04-25T09:02:29.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.268+0000 7f5df4400640 1 --2- 172.21.15.173:0/4121929557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5dec15ba20 0x7f5dec14ccd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.268+0000 7f5df4400640 1 --2- 172.21.15.173:0/4121929557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5dec0b70f0 0x7f5dec0c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.268+0000 7f5df4400640 1 --2- 172.21.15.173:0/4121929557 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dec070070 0x7f5dec0c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.268+0000 7f5df4400640 1 -- 172.21.15.173:0/4121929557 >> 172.21.15.173:0/4121929557 conn(0x7f5dec061880 msgr2=0x7f5dec06f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.268+0000 7f5df4400640 1 -- 172.21.15.173:0/4121929557 shutdown_connections 2024-04-25T09:02:29.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:29.268+0000 7f5df4400640 1 -- 172.21.15.173:0/4121929557 wait complete. 2024-04-25T09:02:29.279 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T09:02:29.279 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T09:02:29.385 INFO:tasks.ceph.mgr.x.smithi194.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T09:02:29.385 INFO:tasks.ceph.mgr.x.smithi194.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T09:02:29.385 INFO:tasks.ceph.mgr.x.smithi194.stderr: from numpy import show_config as show_numpy_config 2024-04-25T09:02:29.436 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:29.445+0000 7fed389d0180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T09:02:29.583 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:29.593+0000 7fed389d0180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:02:29.659 INFO:tasks.ceph.osd.1.smithi173.stderr:2024-04-25T09:02:29.668+0000 7fe00f62b7c0 -1 Falling back to public interface 2024-04-25T09:02:29.659 INFO:tasks.ceph.osd.0.smithi173.stderr:2024-04-25T09:02:29.668+0000 7f43b11207c0 -1 Falling back to public interface 2024-04-25T09:02:29.660 INFO:tasks.ceph.osd.0.smithi173.stderr:2024-04-25T09:02:29.668+0000 7f43afc00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-04-25T09:02:29.660 INFO:tasks.ceph.osd.1.smithi173.stderr:2024-04-25T09:02:29.668+0000 7fe00d600640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6808/0: (98) Address already in use 2024-04-25T09:02:29.694 INFO:tasks.ceph.osd.2.smithi173.stderr:2024-04-25T09:02:29.704+0000 7f920d9887c0 -1 Falling back to public interface 2024-04-25T09:02:29.698 INFO:tasks.ceph.osd.3.smithi173.stderr:2024-04-25T09:02:29.708+0000 7fd6466f77c0 -1 Falling back to public interface 2024-04-25T09:02:29.700 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-04-25T09:02:29.709+0000 7fdcb78267c0 -1 Falling back to public interface 2024-04-25T09:02:29.700 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-04-25T09:02:29.709+0000 7f26e8eb47c0 -1 Falling back to public interface 2024-04-25T09:02:29.719 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-04-25T09:02:29.729+0000 7fe5cf64a7c0 -1 Falling back to public interface 2024-04-25T09:02:29.739 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-04-25T09:02:29.749+0000 7fa39c0727c0 -1 Falling back to public interface 2024-04-25T09:02:29.759 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:29.769+0000 7fed389d0180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T09:02:29.832 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:29.841+0000 7fed389d0180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T09:02:29.913 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:29.920+0000 7f4e9e655180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T09:02:29.980 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:29.989+0000 7fed389d0180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:02:29.999 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:30.008+0000 7f4e9e655180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T09:02:30.085 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:30.204 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:30.212+0000 7f4e9e655180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T09:02:30.214 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.224+0000 7f7f6a400640 1 Processor -- start 2024-04-25T09:02:30.214 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.224+0000 7f7f6a400640 1 -- start start 2024-04-25T09:02:30.215 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.224+0000 7f7f6a400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7f6415bf70 0x7f7f640b0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.215 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.224+0000 7f7f6a400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f640b0ac0 con 0x7f7f641452a0 2024-04-25T09:02:30.215 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.224+0000 7f7f6a400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f640b0da0 con 0x7f7f6406ac40 2024-04-25T09:02:30.215 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.224+0000 7f7f6a400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f640b1080 con 0x7f7f6415bf70 2024-04-25T09:02:30.215 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.224+0000 7f7f5be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7f6415bf70 0x7f7f640b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.215 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.224+0000 7f7f63400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f7f641452a0 0x7f7f640b1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60632/0 (socket says 172.21.15.173:60632) 2024-04-25T09:02:30.216 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.224+0000 7f7f63400640 1 -- 172.21.15.173:0/2210377600 learned_addr learned my addr 172.21.15.173:0/2210377600 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:02:30.216 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.224+0000 7f7f5be00640 1 -- 172.21.15.173:0/2210377600 >> v1:172.21.15.194:6789/0 conn(0x7f7f6406ac40 legacy=0x7f7f640cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.216 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.224+0000 7f7f5be00640 1 -- 172.21.15.173:0/2210377600 >> v1:172.21.15.173:6789/0 conn(0x7f7f641452a0 legacy=0x7f7f640b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.216 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.224+0000 7f7f5be00640 1 -- 172.21.15.173:0/2210377600 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f640b1360 con 0x7f7f6415bf70 2024-04-25T09:02:30.216 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.224+0000 7f7f62a00640 1 -- 172.21.15.173:0/2210377600 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528510252 0 0) 0x7f7f640b0ac0 con 0x7f7f641452a0 2024-04-25T09:02:30.220 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.228+0000 7f7f5be00640 1 --2- 172.21.15.173:0/2210377600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f6415bf70 0x7f7f640b0270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0097c0 tx=0x7f7f4c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f19c9e82fc8c573 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.221 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f62a00640 1 -- 172.21.15.173:0/2210377600 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0b0070 con 0x7f7f6415bf70 2024-04-25T09:02:30.221 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f62a00640 1 -- 172.21.15.173:0/2210377600 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c0ab600 con 0x7f7f6415bf70 2024-04-25T09:02:30.221 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f62a00640 1 -- 172.21.15.173:0/2210377600 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0ab9d0 con 0x7f7f6415bf70 2024-04-25T09:02:30.221 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f6a400640 1 -- 172.21.15.173:0/2210377600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f6415bf70 msgr2=0x7f7f640b0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.222 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f6a400640 1 --2- 172.21.15.173:0/2210377600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f6415bf70 0x7f7f640b0270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0097c0 tx=0x7f7f4c01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.222 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f6a400640 1 -- 172.21.15.173:0/2210377600 shutdown_connections 2024-04-25T09:02:30.222 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f6a400640 1 --2- 172.21.15.173:0/2210377600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f6415bf70 0x7f7f640b0270 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.222 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f6a400640 1 -- 172.21.15.173:0/2210377600 >> 172.21.15.173:0/2210377600 conn(0x7f7f64099a60 msgr2=0x7f7f640b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:30.222 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f6a400640 1 -- 172.21.15.173:0/2210377600 shutdown_connections 2024-04-25T09:02:30.222 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f6a400640 1 -- 172.21.15.173:0/2210377600 wait complete. 2024-04-25T09:02:30.223 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f6a400640 1 Processor -- start 2024-04-25T09:02:30.223 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f6a400640 1 -- start start 2024-04-25T09:02:30.226 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f6a400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f6406ac40 0x7f7f6415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.226 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f6a400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f641452a0 0x7f7f6415ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.226 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f6a400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f6415bf70 0x7f7f6413fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.226 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f6a400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6406b460 con 0x7f7f6406ac40 2024-04-25T09:02:30.226 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f6a400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f640ccb40 con 0x7f7f6415bf70 2024-04-25T09:02:30.226 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f6a400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f641410d0 con 0x7f7f641452a0 2024-04-25T09:02:30.226 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f63400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f6406ac40 0x7f7f6415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.226 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f63400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f6406ac40 0x7f7f6415ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36684/0 (socket says 172.21.15.173:36684) 2024-04-25T09:02:30.226 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f63400640 1 -- 172.21.15.173:0/2334427137 learned_addr learned my addr 172.21.15.173:0/2334427137 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:30.226 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f5be00640 1 --2- 172.21.15.173:0/2334427137 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f641452a0 0x7f7f6415ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.226 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.232+0000 7f7f63e00640 1 --2- 172.21.15.173:0/2334427137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f6415bf70 0x7f7f6413fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.227 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.236+0000 7f7f63400640 1 -- 172.21.15.173:0/2334427137 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f641452a0 msgr2=0x7f7f6415ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.227 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.236+0000 7f7f63400640 1 --2- 172.21.15.173:0/2334427137 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f641452a0 0x7f7f6415ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.227 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.236+0000 7f7f63400640 1 -- 172.21.15.173:0/2334427137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f6415bf70 msgr2=0x7f7f6413fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.227 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.236+0000 7f7f63400640 1 --2- 172.21.15.173:0/2334427137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f6415bf70 0x7f7f6413fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.227 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.236+0000 7f7f63400640 1 -- 172.21.15.173:0/2334427137 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6415dca0 con 0x7f7f6406ac40 2024-04-25T09:02:30.227 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.236+0000 7f7f63400640 1 --2- 172.21.15.173:0/2334427137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f6406ac40 0x7f7f6415ade0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400c4a0 tx=0x7f7f5400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.227 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.236+0000 7f7f5b400640 1 -- 172.21.15.173:0/2334427137 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54018070 con 0x7f7f6406ac40 2024-04-25T09:02:30.227 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.236+0000 7f7f5b400640 1 -- 172.21.15.173:0/2334427137 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f540074e0 con 0x7f7f6406ac40 2024-04-25T09:02:30.227 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.236+0000 7f7f5b400640 1 -- 172.21.15.173:0/2334427137 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54004a30 con 0x7f7f6406ac40 2024-04-25T09:02:30.227 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.236+0000 7f7f6a400640 1 -- 172.21.15.173:0/2334427137 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f6415df80 con 0x7f7f6406ac40 2024-04-25T09:02:30.227 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.236+0000 7f7f6a400640 1 -- 172.21.15.173:0/2334427137 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6415e540 con 0x7f7f6406ac40 2024-04-25T09:02:30.227 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.236+0000 7f7f5b400640 1 -- 172.21.15.173:0/2334427137 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7f5401b070 con 0x7f7f6406ac40 2024-04-25T09:02:30.227 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.236+0000 7f7f5b400640 1 -- 172.21.15.173:0/2334427137 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7f54012ad0 con 0x7f7f6406ac40 2024-04-25T09:02:30.228 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.236+0000 7f7f6a400640 1 -- 172.21.15.173:0/2334427137 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6404ef30 con 0x7f7f6406ac40 2024-04-25T09:02:30.228 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.236+0000 7f7f5b400640 1 -- 172.21.15.173:0/2334427137 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f7f54004bd0 con 0x7f7f6406ac40 2024-04-25T09:02:30.285 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.296+0000 7f7f6a400640 1 -- 172.21.15.173:0/2334427137 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f64070ce0 con 0x7f7f6406ac40 2024-04-25T09:02:30.286 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.296+0000 7f7f5b400640 1 -- 172.21.15.173:0/2334427137 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f7f54004dd0 con 0x7f7f6406ac40 2024-04-25T09:02:30.286 INFO:teuthology.misc.health.smithi173.stdout: 2024-04-25T09:02:30.286 INFO:teuthology.misc.health.smithi173.stdout:{"epoch":10,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:28.969921+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:30.287 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.296+0000 7f7f6a400640 1 -- 172.21.15.173:0/2334427137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f6406ac40 msgr2=0x7f7f6415ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.287 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.296+0000 7f7f6a400640 1 --2- 172.21.15.173:0/2334427137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f6406ac40 0x7f7f6415ade0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400c4a0 tx=0x7f7f5400c960 comp rx=0 tx=0).stop 2024-04-25T09:02:30.287 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.296+0000 7f7f6a400640 1 -- 172.21.15.173:0/2334427137 shutdown_connections 2024-04-25T09:02:30.287 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.296+0000 7f7f6a400640 1 --2- 172.21.15.173:0/2334427137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f6415bf70 0x7f7f6413fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.287 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.296+0000 7f7f6a400640 1 --2- 172.21.15.173:0/2334427137 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f641452a0 0x7f7f6415ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.287 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.296+0000 7f7f6a400640 1 --2- 172.21.15.173:0/2334427137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f6406ac40 0x7f7f6415ade0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.287 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.296+0000 7f7f6a400640 1 -- 172.21.15.173:0/2334427137 >> 172.21.15.173:0/2334427137 conn(0x7f7f64099a60 msgr2=0x7f7f640b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:30.287 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.296+0000 7f7f6a400640 1 -- 172.21.15.173:0/2334427137 shutdown_connections 2024-04-25T09:02:30.288 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:30.296+0000 7f7f6a400640 1 -- 172.21.15.173:0/2334427137 wait complete. 2024-04-25T09:02:30.295 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:30.304+0000 7f4e9e655180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T09:02:30.303 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T09:02:30.624 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:30.632+0000 7f4e9e655180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T09:02:30.687 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:30.697+0000 7fed389d0180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T09:02:30.696 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:30.704+0000 7f4e9e655180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T09:02:30.783 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:30.793+0000 7fed389d0180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T09:02:30.984 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:30.993+0000 7fed389d0180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T09:02:31.069 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:31.077+0000 7fed389d0180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T09:02:31.397 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:31.405+0000 7fed389d0180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T09:02:31.467 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-04-25T09:02:31.477+0000 7fed389d0180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T09:02:31.715 INFO:tasks.ceph.mgr.y.smithi173.stderr:2024-04-25T09:02:31.724+0000 7f4e44800640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T09:02:33.522 INFO:tasks.ceph.osd.1.smithi173.stderr:2024-04-25T09:02:33.532+0000 7fe00f62b7c0 -1 osd.1 0 log_to_monitors true 2024-04-25T09:02:33.641 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-04-25T09:02:33.649+0000 7fe5cf64a7c0 -1 osd.7 0 log_to_monitors true 2024-04-25T09:02:33.665 INFO:tasks.ceph.osd.3.smithi173.stderr:2024-04-25T09:02:33.672+0000 7fd6466f77c0 -1 osd.3 0 log_to_monitors true 2024-04-25T09:02:33.665 INFO:tasks.ceph.osd.0.smithi173.stderr:2024-04-25T09:02:33.676+0000 7f43b11207c0 -1 osd.0 0 log_to_monitors true 2024-04-25T09:02:33.665 INFO:tasks.ceph.osd.2.smithi173.stderr:2024-04-25T09:02:33.676+0000 7f920d9887c0 -1 osd.2 0 log_to_monitors true 2024-04-25T09:02:33.714 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-04-25T09:02:33.721+0000 7f26e8eb47c0 -1 osd.4 0 log_to_monitors true 2024-04-25T09:02:33.769 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-04-25T09:02:33.777+0000 7fdcb78267c0 -1 osd.5 0 log_to_monitors true 2024-04-25T09:02:33.820 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-04-25T09:02:33.829+0000 7fa39c0727c0 -1 osd.6 0 log_to_monitors true 2024-04-25T09:02:35.606 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-04-25T09:02:35.613+0000 7fe5cb000640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T09:02:35.623 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-04-25T09:02:35.633+0000 7fe5c0600640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:02:36.894 INFO:tasks.ceph.osd.1.smithi173.stderr:2024-04-25T09:02:36.900+0000 7fe009a00640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T09:02:36.925 INFO:tasks.ceph.osd.1.smithi173.stderr:2024-04-25T09:02:36.932+0000 7fdfffa00640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:02:36.960 INFO:tasks.ceph.osd.3.smithi173.stderr:2024-04-25T09:02:36.968+0000 7fd641600640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T09:02:36.998 INFO:tasks.ceph.osd.3.smithi173.stderr:2024-04-25T09:02:37.008+0000 7fd637600640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:02:37.072 INFO:tasks.ceph.osd.0.smithi173.stderr:2024-04-25T09:02:37.080+0000 7f43ac000640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T09:02:37.082 INFO:tasks.ceph.osd.2.smithi173.stderr:2024-04-25T09:02:37.092+0000 7f9209200640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T09:02:37.098 INFO:tasks.ceph.osd.0.smithi173.stderr:2024-04-25T09:02:37.108+0000 7f43a2000640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:02:37.110 INFO:tasks.ceph.osd.2.smithi173.stderr:2024-04-25T09:02:37.120+0000 7f91fe800640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:02:37.110 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:37.235 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.244+0000 7f91c7800640 1 Processor -- start 2024-04-25T09:02:37.235 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.244+0000 7f91c7800640 1 -- start start 2024-04-25T09:02:37.237 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.244+0000 7f91c7800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f91c00b3400 0x7f91c00b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:37.237 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.244+0000 7f91c7800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f91c00cbe10 0x7f91c00cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:37.238 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.244+0000 7f91c7800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c00b3d20 con 0x7f91c0070ce0 2024-04-25T09:02:37.238 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.244+0000 7f91c7800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c015f4d0 con 0x7f91c00cbe10 2024-04-25T09:02:37.238 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.244+0000 7f91c7800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c015f720 con 0x7f91c00b3400 2024-04-25T09:02:37.238 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.244+0000 7f91c5800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f91c0070ce0 0x7f91c0071130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54502/0 (socket says 172.21.15.173:54502) 2024-04-25T09:02:37.238 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.244+0000 7f91b7e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f91c00cbe10 0x7f91c00cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:37.238 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.248+0000 7f91c5800640 1 -- 172.21.15.173:0/1351223681 learned_addr learned my addr 172.21.15.173:0/1351223681 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:02:37.238 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.248+0000 7f91c4e00640 1 --2- 172.21.15.173:0/1351223681 >> v2:172.21.15.194:3300/0 conn(0x7f91c00b3400 0x7f91c00b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:37.238 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.248+0000 7f91b7e00640 1 -- 172.21.15.173:0/1351223681 >> v2:172.21.15.194:3300/0 conn(0x7f91c00b3400 msgr2=0x7f91c00b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:37.238 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.248+0000 7f91b7e00640 1 --2- 172.21.15.173:0/1351223681 >> v2:172.21.15.194:3300/0 conn(0x7f91c00b3400 0x7f91c00b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.238 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.248+0000 7f91b7e00640 1 -- 172.21.15.173:0/1351223681 >> v1:172.21.15.173:6789/0 conn(0x7f91c0070ce0 legacy=0x7f91c0071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:37.238 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.248+0000 7f91b7e00640 1 -- 172.21.15.173:0/1351223681 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c015fa00 con 0x7f91c00cbe10 2024-04-25T09:02:37.238 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.248+0000 7f91bfe00640 1 -- 172.21.15.173:0/1351223681 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842094206 0 0) 0x7f91c00b3d20 con 0x7f91c0070ce0 2024-04-25T09:02:37.240 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.248+0000 7f91b7e00640 1 --2- 172.21.15.173:0/1351223681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c00cbe10 0x7f91c00cc2c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f91c0072ef0 tx=0x7f91a801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbdd42a687144c1d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:37.240 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.248+0000 7f91bfe00640 1 -- 172.21.15.173:0/1351223681 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a80b1070 con 0x7f91c00cbe10 2024-04-25T09:02:37.240 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.248+0000 7f91bfe00640 1 -- 172.21.15.173:0/1351223681 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a80ac620 con 0x7f91c00cbe10 2024-04-25T09:02:37.240 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.248+0000 7f91bfe00640 1 -- 172.21.15.173:0/1351223681 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a80ac9f0 con 0x7f91c00cbe10 2024-04-25T09:02:37.241 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c7800640 1 -- 172.21.15.173:0/1351223681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c00cbe10 msgr2=0x7f91c00cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:37.241 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c7800640 1 --2- 172.21.15.173:0/1351223681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c00cbe10 0x7f91c00cc2c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f91c0072ef0 tx=0x7f91a801c3c0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.241 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c7800640 1 -- 172.21.15.173:0/1351223681 shutdown_connections 2024-04-25T09:02:37.241 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c7800640 1 --2- 172.21.15.173:0/1351223681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c00cbe10 0x7f91c00cc2c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.241 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c7800640 1 --2- 172.21.15.173:0/1351223681 >> v2:172.21.15.194:3300/0 conn(0x7f91c00b3400 0x7f91c00b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.241 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c7800640 1 -- 172.21.15.173:0/1351223681 >> 172.21.15.173:0/1351223681 conn(0x7f91c00d17c0 msgr2=0x7f91c00d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:37.242 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c7800640 1 -- 172.21.15.173:0/1351223681 shutdown_connections 2024-04-25T09:02:37.242 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c7800640 1 -- 172.21.15.173:0/1351223681 wait complete. 2024-04-25T09:02:37.242 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c7800640 1 Processor -- start 2024-04-25T09:02:37.243 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c7800640 1 -- start start 2024-04-25T09:02:37.245 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c7800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c0070ce0 0x7f91c00b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:37.245 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c7800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91c00b3400 0x7f91c015c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:37.245 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c7800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91c00cbe10 0x7f91c0151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:37.245 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c7800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00cc800 con 0x7f91c0070ce0 2024-04-25T09:02:37.245 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c7800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00d07e0 con 0x7f91c00b3400 2024-04-25T09:02:37.245 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c7800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00b5650 con 0x7f91c00cbe10 2024-04-25T09:02:37.245 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c4e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c0070ce0 0x7f91c00b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:37.245 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c4e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c0070ce0 0x7f91c00b66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33098/0 (socket says 172.21.15.173:33098) 2024-04-25T09:02:37.245 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c4e00640 1 -- 172.21.15.173:0/1229966606 learned_addr learned my addr 172.21.15.173:0/1229966606 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:37.246 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91b7e00640 1 --2- 172.21.15.173:0/1229966606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91c00b3400 0x7f91c015c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:37.246 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c5800640 1 --2- 172.21.15.173:0/1229966606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91c00cbe10 0x7f91c0151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:37.246 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c4e00640 1 -- 172.21.15.173:0/1229966606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91c00cbe10 msgr2=0x7f91c0151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:37.246 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c4e00640 1 --2- 172.21.15.173:0/1229966606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91c00cbe10 0x7f91c0151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.246 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c4e00640 1 -- 172.21.15.173:0/1229966606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91c00b3400 msgr2=0x7f91c015c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:37.246 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c4e00640 1 --2- 172.21.15.173:0/1229966606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91c00b3400 0x7f91c015c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.246 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c4e00640 1 -- 172.21.15.173:0/1229966606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c00b5930 con 0x7f91c0070ce0 2024-04-25T09:02:37.246 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.252+0000 7f91c4e00640 1 --2- 172.21.15.173:0/1229966606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c0070ce0 0x7f91c00b66f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f91b000e930 tx=0x7f91b000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:37.246 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.256+0000 7f91bd600640 1 -- 172.21.15.173:0/1229966606 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b0017070 con 0x7f91c0070ce0 2024-04-25T09:02:37.246 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.256+0000 7f91bd600640 1 -- 172.21.15.173:0/1229966606 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b000ca00 con 0x7f91c0070ce0 2024-04-25T09:02:37.246 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.256+0000 7f91bd600640 1 -- 172.21.15.173:0/1229966606 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b000cdb0 con 0x7f91c0070ce0 2024-04-25T09:02:37.246 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.256+0000 7f91c7800640 1 -- 172.21.15.173:0/1229966606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c00b5c10 con 0x7f91c0070ce0 2024-04-25T09:02:37.247 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.256+0000 7f91c7800640 1 -- 172.21.15.173:0/1229966606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c00b61d0 con 0x7f91c0070ce0 2024-04-25T09:02:37.247 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.256+0000 7f91c7800640 1 -- 172.21.15.173:0/1229966606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c00b6c90 con 0x7f91c0070ce0 2024-04-25T09:02:37.247 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.256+0000 7f91bd600640 1 -- 172.21.15.173:0/1229966606 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 4) v1 ==== 86671+0+0 (secure 0 0 0) 0x7f91b001a070 con 0x7f91c0070ce0 2024-04-25T09:02:37.248 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.256+0000 7f91bd600640 1 --2- 172.21.15.173:0/1229966606 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f919c066ed0 0x7f919c069390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:37.248 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.256+0000 7f91bd600640 1 -- 172.21.15.173:0/1229966606 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f91b00845f0 con 0x7f91c0070ce0 2024-04-25T09:02:37.248 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.256+0000 7f91b7e00640 1 --2- 172.21.15.173:0/1229966606 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f919c066ed0 0x7f919c069390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:37.248 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.256+0000 7f91b7e00640 1 --2- 172.21.15.173:0/1229966606 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f919c066ed0 0x7f919c069390 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f91a80ae000 tx=0x7f91a80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:37.252 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.260+0000 7f91bd600640 1 -- 172.21.15.173:0/1229966606 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f91b0055dc0 con 0x7f91c0070ce0 2024-04-25T09:02:37.407 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.416+0000 7f91c7800640 1 -- 172.21.15.173:0/1229966606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91c004ef30 con 0x7f91c0070ce0 2024-04-25T09:02:37.407 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.416+0000 7f91bd600640 1 -- 172.21.15.173:0/1229966606 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7590 (secure 0 0 0) 0x7f91b0059e60 con 0x7f91c0070ce0 2024-04-25T09:02:37.408 INFO:teuthology.misc.health.smithi173.stdout: 2024-04-25T09:02:37.408 INFO:teuthology.misc.health.smithi173.stdout:{"epoch":14,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:36.859758+0000","last_up_change":"2024-04-25T09:02:35.803396+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:37.410 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.420+0000 7f91c7800640 1 -- 172.21.15.173:0/1229966606 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f919c066ed0 msgr2=0x7f919c069390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:37.410 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.420+0000 7f91c7800640 1 --2- 172.21.15.173:0/1229966606 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f919c066ed0 0x7f919c069390 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f91a80ae000 tx=0x7f91a80a7000 comp rx=0 tx=0).stop 2024-04-25T09:02:37.410 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.420+0000 7f91c7800640 1 -- 172.21.15.173:0/1229966606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c0070ce0 msgr2=0x7f91c00b66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:37.410 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.420+0000 7f91c7800640 1 --2- 172.21.15.173:0/1229966606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c0070ce0 0x7f91c00b66f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f91b000e930 tx=0x7f91b000edf0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.410 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.420+0000 7f91c7800640 1 -- 172.21.15.173:0/1229966606 shutdown_connections 2024-04-25T09:02:37.410 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.420+0000 7f91c7800640 1 --2- 172.21.15.173:0/1229966606 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f919c066ed0 0x7f919c069390 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.410 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.420+0000 7f91c7800640 1 --2- 172.21.15.173:0/1229966606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91c00cbe10 0x7f91c0151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.410 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.420+0000 7f91c7800640 1 --2- 172.21.15.173:0/1229966606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91c00b3400 0x7f91c015c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.410 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.420+0000 7f91c7800640 1 --2- 172.21.15.173:0/1229966606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c0070ce0 0x7f91c00b66f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:37.410 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.420+0000 7f91c7800640 1 -- 172.21.15.173:0/1229966606 >> 172.21.15.173:0/1229966606 conn(0x7f91c00d17c0 msgr2=0x7f91c00cb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:37.410 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.420+0000 7f91c7800640 1 -- 172.21.15.173:0/1229966606 shutdown_connections 2024-04-25T09:02:37.410 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:37.420+0000 7f91c7800640 1 -- 172.21.15.173:0/1229966606 wait complete. 2024-04-25T09:02:37.426 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-04-25T09:02:37.679 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-04-25T09:02:37.685+0000 7fa397000640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T09:02:37.703 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-04-25T09:02:37.713+0000 7fa38d000640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:02:37.707 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-04-25T09:02:37.717+0000 7fdcb2600640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T09:02:37.714 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-04-25T09:02:37.721+0000 7f26e3e00640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T09:02:37.748 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-04-25T09:02:37.757+0000 7f26d9e00640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:02:37.748 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-04-25T09:02:37.757+0000 7fdca8600640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:02:43.937 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:02:43.941 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:02:44.234 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:44.370 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a32600640 1 Processor -- start 2024-04-25T09:02:44.370 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a32600640 1 -- start start 2024-04-25T09:02:44.371 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a32600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2c1475e0 0x7f7a2c0b3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.371 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a32600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7a2c0cb270 0x7f7a2c0d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.371 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a32600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2c0cb890 con 0x7f7a2c0b3940 2024-04-25T09:02:44.371 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a32600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a2c15e430 con 0x7f7a2c0cb270 2024-04-25T09:02:44.371 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a32600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c15e710 con 0x7f7a2c1475e0 2024-04-25T09:02:44.371 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2aa00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f7a2c0b3940 0x7f7a2c0cab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:37914/0 (socket says 172.21.15.173:37914) 2024-04-25T09:02:44.371 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2aa00640 1 -- 172.21.15.173:0/2052459710 learned_addr learned my addr 172.21.15.173:0/2052459710 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:02:44.373 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2b400640 1 --2- 172.21.15.173:0/2052459710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2c1475e0 0x7f7a2c0b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.373 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2a000640 1 -- 172.21.15.173:0/2052459710 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524506745 0 0) 0x7f7a2c0cb890 con 0x7f7a2c0b3940 2024-04-25T09:02:44.373 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2be00640 1 --2- 172.21.15.173:0/2052459710 >> v2:172.21.15.194:3300/0 conn(0x7f7a2c0cb270 0x7f7a2c0d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.373 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2a000640 1 -- 172.21.15.173:0/2052459710 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a10003530 con 0x7f7a2c0b3940 2024-04-25T09:02:44.373 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2a000640 1 -- 172.21.15.173:0/2052459710 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 784633916 0 0) 0x7f7a10003530 con 0x7f7a2c0b3940 2024-04-25T09:02:44.373 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2a000640 1 -- 172.21.15.173:0/2052459710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2c1475e0 msgr2=0x7f7a2c0b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:44.373 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2a000640 1 --2- 172.21.15.173:0/2052459710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2c1475e0 0x7f7a2c0b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.374 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2a000640 1 -- 172.21.15.173:0/2052459710 >> v2:172.21.15.194:3300/0 conn(0x7f7a2c0cb270 msgr2=0x7f7a2c0d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:44.374 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2a000640 1 --2- 172.21.15.173:0/2052459710 >> v2:172.21.15.194:3300/0 conn(0x7f7a2c0cb270 0x7f7a2c0d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.374 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2a000640 1 -- 172.21.15.173:0/2052459710 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c15e9f0 con 0x7f7a2c0b3940 2024-04-25T09:02:44.374 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2a000640 1 -- 172.21.15.173:0/2052459710 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f7a18001680 con 0x7f7a2c0b3940 2024-04-25T09:02:44.374 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2a000640 1 -- 172.21.15.173:0/2052459710 >> v1:172.21.15.173:6789/0 conn(0x7f7a2c0b3940 legacy=0x7f7a2c0cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.374 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2a000640 1 --2- 172.21.15.173:0/2052459710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a100039c0 0x7f7a10003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.374 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2a000640 1 --2- 172.21.15.173:0/2052459710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a10004810 0x7f7a10004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.374 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2a000640 1 --2- 172.21.15.173:0/2052459710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a10005190 0x7f7a1000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.374 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2a000640 1 -- 172.21.15.173:0/2052459710 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c15e430 con 0x7f7a100039c0 2024-04-25T09:02:44.374 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2a000640 1 -- 172.21.15.173:0/2052459710 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c15e710 con 0x7f7a10005190 2024-04-25T09:02:44.374 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2a000640 1 -- 172.21.15.173:0/2052459710 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a10004610 con 0x7f7a10004810 2024-04-25T09:02:44.374 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2b400640 1 --2- 172.21.15.173:0/2052459710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a100039c0 0x7f7a10003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.375 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2aa00640 1 --2- 172.21.15.173:0/2052459710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a10004810 0x7f7a10004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.375 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2be00640 1 --2- 172.21.15.173:0/2052459710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a10005190 0x7f7a1000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.375 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2b400640 1 -- 172.21.15.173:0/2052459710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a10004810 msgr2=0x7f7a10004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:44.375 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2b400640 1 --2- 172.21.15.173:0/2052459710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a10004810 0x7f7a10004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.375 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2b400640 1 -- 172.21.15.173:0/2052459710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a10005190 msgr2=0x7f7a1000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:44.375 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2b400640 1 --2- 172.21.15.173:0/2052459710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a10005190 0x7f7a1000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.375 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2b400640 1 -- 172.21.15.173:0/2052459710 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a10003530 con 0x7f7a100039c0 2024-04-25T09:02:44.375 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.379+0000 7f7a2aa00640 1 --2- 172.21.15.173:0/2052459710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a10004810 0x7f7a10004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:44.376 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.383+0000 7f7a2b400640 1 --2- 172.21.15.173:0/2052459710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a100039c0 0x7f7a10003de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c009ae0 tx=0x7f7a1c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe74a61a3ebb6a4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.376 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.383+0000 7f7a2a000640 1 -- 172.21.15.173:0/2052459710 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0096b0 con 0x7f7a100039c0 2024-04-25T09:02:44.376 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.383+0000 7f7a2a000640 1 -- 172.21.15.173:0/2052459710 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c0a6450 con 0x7f7a100039c0 2024-04-25T09:02:44.376 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.383+0000 7f7a2a000640 1 -- 172.21.15.173:0/2052459710 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0a6840 con 0x7f7a100039c0 2024-04-25T09:02:44.377 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.383+0000 7f7a32600640 1 -- 172.21.15.173:0/2052459710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a100039c0 msgr2=0x7f7a10003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.377 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.383+0000 7f7a32600640 1 --2- 172.21.15.173:0/2052459710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a100039c0 0x7f7a10003de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c009ae0 tx=0x7f7a1c01ca70 comp rx=0 tx=0).stop 2024-04-25T09:02:44.377 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.383+0000 7f7a2be00640 1 -- 172.21.15.173:0/2052459710 reap_dead start 2024-04-25T09:02:44.377 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.383+0000 7f7a32600640 1 -- 172.21.15.173:0/2052459710 shutdown_connections 2024-04-25T09:02:44.377 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.383+0000 7f7a32600640 1 -- 172.21.15.173:0/2052459710 >> 172.21.15.173:0/2052459710 conn(0x7f7a2c0d17c0 msgr2=0x7f7a2c0d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:44.377 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.383+0000 7f7a32600640 1 -- 172.21.15.173:0/2052459710 shutdown_connections 2024-04-25T09:02:44.377 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.383+0000 7f7a32600640 1 -- 172.21.15.173:0/2052459710 wait complete. 2024-04-25T09:02:44.378 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a32600640 1 Processor -- start 2024-04-25T09:02:44.378 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a32600640 1 -- start start 2024-04-25T09:02:44.380 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a32600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a100039c0 0x7f7a2c15caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.380 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a32600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a2c15d140 0x7f7a2c160840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.380 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a32600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2c15f2a0 0x7f7a2c15c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.381 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a32600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c0b3d40 con 0x7f7a100039c0 2024-04-25T09:02:44.381 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a32600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c0d14a0 con 0x7f7a2c15d140 2024-04-25T09:02:44.381 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a32600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c168710 con 0x7f7a2c15f2a0 2024-04-25T09:02:44.381 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a2b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a100039c0 0x7f7a2c15caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.381 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a2b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a100039c0 0x7f7a2c15caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57520/0 (socket says 172.21.15.173:57520) 2024-04-25T09:02:44.381 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a2b400640 1 -- 172.21.15.173:0/4055308016 learned_addr learned my addr 172.21.15.173:0/4055308016 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:44.381 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a2aa00640 1 --2- 172.21.15.173:0/4055308016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a2c15d140 0x7f7a2c160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.381 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a2be00640 1 --2- 172.21.15.173:0/4055308016 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2c15f2a0 0x7f7a2c15c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.381 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a2b400640 1 -- 172.21.15.173:0/4055308016 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2c15f2a0 msgr2=0x7f7a2c15c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.381 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a2b400640 1 --2- 172.21.15.173:0/4055308016 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2c15f2a0 0x7f7a2c15c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.381 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a2b400640 1 -- 172.21.15.173:0/4055308016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a2c15d140 msgr2=0x7f7a2c160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.381 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a2b400640 1 --2- 172.21.15.173:0/4055308016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a2c15d140 0x7f7a2c160840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.381 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a2b400640 1 -- 172.21.15.173:0/4055308016 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c15f7a0 con 0x7f7a100039c0 2024-04-25T09:02:44.381 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a2aa00640 1 --2- 172.21.15.173:0/4055308016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a2c15d140 0x7f7a2c160840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:44.381 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a2be00640 1 --2- 172.21.15.173:0/4055308016 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2c15f2a0 0x7f7a2c15c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:44.382 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a2b400640 1 --2- 172.21.15.173:0/4055308016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a100039c0 0x7f7a2c15caf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c009ae0 tx=0x7f7a10005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.382 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a23400640 1 -- 172.21.15.173:0/4055308016 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0be070 con 0x7f7a100039c0 2024-04-25T09:02:44.382 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a23400640 1 -- 172.21.15.173:0/4055308016 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c00f000 con 0x7f7a100039c0 2024-04-25T09:02:44.382 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a23400640 1 -- 172.21.15.173:0/4055308016 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0a7430 con 0x7f7a100039c0 2024-04-25T09:02:44.382 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a32600640 1 -- 172.21.15.173:0/4055308016 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2c15fa80 con 0x7f7a100039c0 2024-04-25T09:02:44.382 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.387+0000 7f7a32600640 1 -- 172.21.15.173:0/4055308016 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2c160040 con 0x7f7a100039c0 2024-04-25T09:02:44.383 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.391+0000 7f7a32600640 1 -- 172.21.15.173:0/4055308016 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a2c04ef30 con 0x7f7a100039c0 2024-04-25T09:02:44.383 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.391+0000 7f7a23400640 1 -- 172.21.15.173:0/4055308016 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7a1c0c1070 con 0x7f7a100039c0 2024-04-25T09:02:44.383 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.391+0000 7f7a23400640 1 --2- 172.21.15.173:0/4055308016 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7a0c066f60 0x7f7a0c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.383 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.391+0000 7f7a23400640 1 -- 172.21.15.173:0/4055308016 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7a1c11e580 con 0x7f7a100039c0 2024-04-25T09:02:44.383 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.391+0000 7f7a2aa00640 1 --2- 172.21.15.173:0/4055308016 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7a0c066f60 0x7f7a0c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.384 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.391+0000 7f7a2aa00640 1 --2- 172.21.15.173:0/4055308016 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7a0c066f60 0x7f7a0c069420 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a18001ec0 tx=0x7f7a18000f00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.388 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.395+0000 7f7a23400640 1 -- 172.21.15.173:0/4055308016 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7a1c0ac020 con 0x7f7a100039c0 2024-04-25T09:02:44.541 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.551+0000 7f7a32600640 1 -- 172.21.15.173:0/4055308016 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a2c0b1480 con 0x7f7a100039c0 2024-04-25T09:02:44.542 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.551+0000 7f7a23400640 1 -- 172.21.15.173:0/4055308016 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12944 (secure 0 0 0) 0x7f7a1c0f5030 con 0x7f7a100039c0 2024-04-25T09:02:44.542 INFO:teuthology.misc.health.smithi173.stdout: 2024-04-25T09:02:44.543 INFO:teuthology.misc.health.smithi173.stdout:{"epoch":18,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:40.956051+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:44.545 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.551+0000 7f7a32600640 1 -- 172.21.15.173:0/4055308016 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7a0c066f60 msgr2=0x7f7a0c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.545 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.551+0000 7f7a32600640 1 --2- 172.21.15.173:0/4055308016 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7a0c066f60 0x7f7a0c069420 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a18001ec0 tx=0x7f7a18000f00 comp rx=0 tx=0).stop 2024-04-25T09:02:44.545 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.551+0000 7f7a32600640 1 -- 172.21.15.173:0/4055308016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a100039c0 msgr2=0x7f7a2c15caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.545 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.551+0000 7f7a32600640 1 --2- 172.21.15.173:0/4055308016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a100039c0 0x7f7a2c15caf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c009ae0 tx=0x7f7a10005840 comp rx=0 tx=0).stop 2024-04-25T09:02:44.545 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.551+0000 7f7a32600640 1 -- 172.21.15.173:0/4055308016 shutdown_connections 2024-04-25T09:02:44.545 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.551+0000 7f7a32600640 1 --2- 172.21.15.173:0/4055308016 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7a0c066f60 0x7f7a0c069420 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.545 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.551+0000 7f7a32600640 1 --2- 172.21.15.173:0/4055308016 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2c15f2a0 0x7f7a2c15c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.545 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.551+0000 7f7a32600640 1 --2- 172.21.15.173:0/4055308016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a2c15d140 0x7f7a2c160840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.545 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.551+0000 7f7a32600640 1 --2- 172.21.15.173:0/4055308016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a100039c0 0x7f7a2c15caf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.545 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.551+0000 7f7a32600640 1 -- 172.21.15.173:0/4055308016 >> 172.21.15.173:0/4055308016 conn(0x7f7a2c0d17c0 msgr2=0x7f7a2c142a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:44.545 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.551+0000 7f7a32600640 1 -- 172.21.15.173:0/4055308016 shutdown_connections 2024-04-25T09:02:44.545 INFO:teuthology.misc.health.smithi173.stderr:2024-04-25T09:02:44.551+0000 7f7a32600640 1 -- 172.21.15.173:0/4055308016 wait complete. 2024-04-25T09:02:44.562 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T09:02:44.563 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T09:02:44.563 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:02:44.563 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:02:44.567 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:02:44.567 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:02:44.567 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:02:44.570 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:02:44.570 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:02:44.570 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:02:44.574 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:02:44.574 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:02:44.574 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:02:44.577 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:02:44.577 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T09:02:44.578 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:44.666 INFO:tasks.ceph.mds.a.smithi173.stdout:starting mds.a at 2024-04-25T09:02:44.667 INFO:tasks.ceph.mds.c.smithi173.stdout:starting mds.c at 2024-04-25T09:02:44.680 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-04-25T09:02:44.681 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-04-25T09:02:44.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.731+0000 7f8439400640 1 Processor -- start 2024-04-25T09:02:44.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.731+0000 7f8439400640 1 -- start start 2024-04-25T09:02:44.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.731+0000 7f8439400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f843415b850 0x7f843406ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.731+0000 7f8439400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843415c0f0 con 0x7f84340cc710 2024-04-25T09:02:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.731+0000 7f8439400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843415bc30 con 0x7f843406b1d0 2024-04-25T09:02:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.731+0000 7f8439400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843406b630 con 0x7f843415b850 2024-04-25T09:02:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.731+0000 7f8433e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f843415b850 0x7f843406ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.731+0000 7f8433e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f843415b850 0x7f843406ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57564/0 (socket says 172.21.15.173:57564) 2024-04-25T09:02:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.731+0000 7f8433e00640 1 -- 172.21.15.173:0/826796260 learned_addr learned my addr 172.21.15.173:0/826796260 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.731+0000 7f8438a00640 1 --1- 172.21.15.173:0/826796260 >> v1:172.21.15.173:6789/0 conn(0x7f84340cc710 0x7f84340cfb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:37940/0 (socket says 172.21.15.173:37940) 2024-04-25T09:02:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.731+0000 7f8433e00640 1 -- 172.21.15.173:0/826796260 >> v1:172.21.15.194:6789/0 conn(0x7f843406b1d0 legacy=0x7f84340cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.731+0000 7f8433e00640 1 -- 172.21.15.173:0/826796260 >> v1:172.21.15.173:6789/0 conn(0x7f84340cc710 legacy=0x7f84340cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.731+0000 7f8433e00640 1 -- 172.21.15.173:0/826796260 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84340ccc70 con 0x7f843415b850 2024-04-25T09:02:44.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.735+0000 7f8433e00640 1 --2- 172.21.15.173:0/826796260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f843415b850 0x7f843406ac90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8424009870 tx=0x7f842401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40bcfe0f6ca46656 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.735+0000 7f8432a00640 1 -- 172.21.15.173:0/826796260 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84240ab650 con 0x7f843415b850 2024-04-25T09:02:44.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.735+0000 7f8432a00640 1 -- 172.21.15.173:0/826796260 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84240b0070 con 0x7f843415b850 2024-04-25T09:02:44.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.735+0000 7f8432a00640 1 -- 172.21.15.173:0/826796260 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84240aba10 con 0x7f843415b850 2024-04-25T09:02:44.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.735+0000 7f8439400640 1 -- 172.21.15.173:0/826796260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f843415b850 msgr2=0x7f843406ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.735+0000 7f8439400640 1 --2- 172.21.15.173:0/826796260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f843415b850 0x7f843406ac90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8424009870 tx=0x7f842401c560 comp rx=0 tx=0).stop 2024-04-25T09:02:44.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.735+0000 7f8439400640 1 -- 172.21.15.173:0/826796260 shutdown_connections 2024-04-25T09:02:44.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.735+0000 7f8439400640 1 --2- 172.21.15.173:0/826796260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f843415b850 0x7f843406ac90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.735+0000 7f8439400640 1 -- 172.21.15.173:0/826796260 >> 172.21.15.173:0/826796260 conn(0x7f8434072710 msgr2=0x7f8434099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:44.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.735+0000 7f8439400640 1 -- 172.21.15.173:0/826796260 shutdown_connections 2024-04-25T09:02:44.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.735+0000 7f8439400640 1 -- 172.21.15.173:0/826796260 wait complete. 2024-04-25T09:02:44.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.735+0000 7f8439400640 1 Processor -- start 2024-04-25T09:02:44.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.735+0000 7f8439400640 1 -- start start 2024-04-25T09:02:44.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8439400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f843406b1d0 0x7f84341543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8439400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84340cc710 0x7f8434152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8439400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843415b850 0x7f843414d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8439400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84340d0bf0 con 0x7f843406b1d0 2024-04-25T09:02:44.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8439400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84340d0a70 con 0x7f843415b850 2024-04-25T09:02:44.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8439400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84340d0d70 con 0x7f84340cc710 2024-04-25T09:02:44.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8433e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f843406b1d0 0x7f84341543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8433e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f843406b1d0 0x7f84341543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57566/0 (socket says 172.21.15.173:57566) 2024-04-25T09:02:44.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8433e00640 1 -- 172.21.15.173:0/3969567587 learned_addr learned my addr 172.21.15.173:0/3969567587 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:44.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8433400640 1 --2- 172.21.15.173:0/3969567587 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84340cc710 0x7f8434152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8438a00640 1 --2- 172.21.15.173:0/3969567587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843415b850 0x7f843414d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8433e00640 1 -- 172.21.15.173:0/3969567587 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84340cc710 msgr2=0x7f8434152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8433e00640 1 --2- 172.21.15.173:0/3969567587 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84340cc710 0x7f8434152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8433e00640 1 -- 172.21.15.173:0/3969567587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843415b850 msgr2=0x7f843414d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8433e00640 1 --2- 172.21.15.173:0/3969567587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843415b850 0x7f843414d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8433e00640 1 -- 172.21.15.173:0/3969567587 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84341548f0 con 0x7f843406b1d0 2024-04-25T09:02:44.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8438a00640 1 --2- 172.21.15.173:0/3969567587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843415b850 0x7f843414d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:44.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8433e00640 1 --2- 172.21.15.173:0/3969567587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f843406b1d0 0x7f84341543b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f84240ad040 tx=0x7f842401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f842be00640 1 -- 172.21.15.173:0/3969567587 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84240b4800 con 0x7f843406b1d0 2024-04-25T09:02:44.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f842be00640 1 -- 172.21.15.173:0/3969567587 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84240b49c0 con 0x7f843406b1d0 2024-04-25T09:02:44.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f842be00640 1 -- 172.21.15.173:0/3969567587 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84240b4db0 con 0x7f843406b1d0 2024-04-25T09:02:44.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8439400640 1 -- 172.21.15.173:0/3969567587 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8434154bc0 con 0x7f843406b1d0 2024-04-25T09:02:44.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8439400640 1 -- 172.21.15.173:0/3969567587 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84340c8cc0 con 0x7f843406b1d0 2024-04-25T09:02:44.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.739+0000 7f8439400640 1 -- 172.21.15.173:0/3969567587 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8434073a40 con 0x7f843406b1d0 2024-04-25T09:02:44.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.743+0000 7f842be00640 1 -- 172.21.15.173:0/3969567587 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f84240b3380 con 0x7f843406b1d0 2024-04-25T09:02:44.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.743+0000 7f842be00640 1 --2- 172.21.15.173:0/3969567587 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8414066f60 0x7f8414069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.743+0000 7f842be00640 1 -- 172.21.15.173:0/3969567587 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f842411f190 con 0x7f843406b1d0 2024-04-25T09:02:44.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.743+0000 7f8433400640 1 --2- 172.21.15.173:0/3969567587 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8414066f60 0x7f8414069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.743+0000 7f8433400640 1 --2- 172.21.15.173:0/3969567587 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8414066f60 0x7f8414069420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f84340aebe0 tx=0x7f8420009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.747+0000 7f842be00640 1 -- 172.21.15.173:0/3969567587 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8424016150 con 0x7f843406b1d0 2024-04-25T09:02:44.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.899+0000 7f8439400640 1 -- 172.21.15.173:0/3969567587 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f843415deb0 con 0x7f843406b1d0 2024-04-25T09:02:44.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.899+0000 7f842be00640 1 -- 172.21.15.173:0/3969567587 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12944 (secure 0 0 0) 0x7f84240efea0 con 0x7f843406b1d0 2024-04-25T09:02:44.893 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:02:44.893 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":18,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:40.956051+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:44.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.903+0000 7f8439400640 1 -- 172.21.15.173:0/3969567587 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8414066f60 msgr2=0x7f8414069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.903+0000 7f8439400640 1 --2- 172.21.15.173:0/3969567587 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8414066f60 0x7f8414069420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f84340aebe0 tx=0x7f8420009040 comp rx=0 tx=0).stop 2024-04-25T09:02:44.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.903+0000 7f8439400640 1 -- 172.21.15.173:0/3969567587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f843406b1d0 msgr2=0x7f84341543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.903+0000 7f8439400640 1 --2- 172.21.15.173:0/3969567587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f843406b1d0 0x7f84341543b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f84240ad040 tx=0x7f842401ada0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.903+0000 7f8439400640 1 -- 172.21.15.173:0/3969567587 shutdown_connections 2024-04-25T09:02:44.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.903+0000 7f8439400640 1 --2- 172.21.15.173:0/3969567587 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8414066f60 0x7f8414069420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.903+0000 7f8439400640 1 --2- 172.21.15.173:0/3969567587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843415b850 0x7f843414d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.903+0000 7f8439400640 1 --2- 172.21.15.173:0/3969567587 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84340cc710 0x7f8434152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.903+0000 7f8439400640 1 --2- 172.21.15.173:0/3969567587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f843406b1d0 0x7f84341543b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.903+0000 7f8439400640 1 -- 172.21.15.173:0/3969567587 >> 172.21.15.173:0/3969567587 conn(0x7f8434072710 msgr2=0x7f84340af2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:44.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.903+0000 7f8439400640 1 -- 172.21.15.173:0/3969567587 shutdown_connections 2024-04-25T09:02:44.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:44.903+0000 7f8439400640 1 -- 172.21.15.173:0/3969567587 wait complete. 2024-04-25T09:02:44.914 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:02:44.914 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:45.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9e5c00640 1 Processor -- start 2024-04-25T09:02:45.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9e5c00640 1 -- start start 2024-04-25T09:02:45.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9e5c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e0145290 0x7fe9e015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9e5c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe9e00cc260 0x7fe9e00cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9e5c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e015c5f0 con 0x7fe9e00b3fe0 2024-04-25T09:02:45.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9e5c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e006d4b0 con 0x7fe9e00cc260 2024-04-25T09:02:45.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9e5c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e006d790 con 0x7fe9e0145290 2024-04-25T09:02:45.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9df400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe9e00cc260 0x7fe9e00cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9dea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e0145290 0x7fe9e015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9df400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe9e00cc260 0x7fe9e00cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:42652/0 (socket says 172.21.15.173:42652) 2024-04-25T09:02:45.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9de000640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fe9e00b3fe0 0x7fe9e00b4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:35796/0 (socket says 172.21.15.173:35796) 2024-04-25T09:02:45.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9df400640 1 -- 172.21.15.173:0/3054108070 learned_addr learned my addr 172.21.15.173:0/3054108070 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:45.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9dd600640 1 -- 172.21.15.173:0/3054108070 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360969589 0 0) 0x7fe9cc001120 con 0x7fe9e00b3fe0 2024-04-25T09:02:45.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9dd600640 1 -- 172.21.15.173:0/3054108070 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9c4003530 con 0x7fe9e00b3fe0 2024-04-25T09:02:45.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9dea00640 1 -- 172.21.15.173:0/3054108070 >> v2:172.21.15.194:3300/0 conn(0x7fe9e00cc260 msgr2=0x7fe9e00cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:45.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9dea00640 1 --2- 172.21.15.173:0/3054108070 >> v2:172.21.15.194:3300/0 conn(0x7fe9e00cc260 0x7fe9e00cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9dea00640 1 -- 172.21.15.173:0/3054108070 >> v1:172.21.15.194:6789/0 conn(0x7fe9e00b3fe0 legacy=0x7fe9e00b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9dea00640 1 -- 172.21.15.173:0/3054108070 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e006da70 con 0x7fe9e0145290 2024-04-25T09:02:45.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.063+0000 7fe9df400640 1 --2- 172.21.15.173:0/3054108070 >> v2:172.21.15.194:3300/0 conn(0x7fe9e00cc260 0x7fe9e00cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:45.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.067+0000 7fe9dea00640 1 --2- 172.21.15.173:0/3054108070 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e0145290 0x7fe9e015c0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00097c0 tx=0x7fe9d001c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dc55ddf5a184a5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:45.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.067+0000 7fe9dd600640 1 -- 172.21.15.173:0/3054108070 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d00b0070 con 0x7fe9e0145290 2024-04-25T09:02:45.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.067+0000 7fe9dd600640 1 -- 172.21.15.173:0/3054108070 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d00ab600 con 0x7fe9e0145290 2024-04-25T09:02:45.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.067+0000 7fe9dd600640 1 -- 172.21.15.173:0/3054108070 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d00ab9d0 con 0x7fe9e0145290 2024-04-25T09:02:45.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.067+0000 7fe9e5c00640 1 -- 172.21.15.173:0/3054108070 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e0145290 msgr2=0x7fe9e015c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.067+0000 7fe9e5c00640 1 --2- 172.21.15.173:0/3054108070 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e0145290 0x7fe9e015c0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00097c0 tx=0x7fe9d001c380 comp rx=0 tx=0).stop 2024-04-25T09:02:45.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.067+0000 7fe9e5c00640 1 -- 172.21.15.173:0/3054108070 shutdown_connections 2024-04-25T09:02:45.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.067+0000 7fe9e5c00640 1 --2- 172.21.15.173:0/3054108070 >> v2:172.21.15.194:3300/0 conn(0x7fe9e00cc260 0x7fe9e00cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.067+0000 7fe9e5c00640 1 --2- 172.21.15.173:0/3054108070 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e0145290 0x7fe9e015c0b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.067+0000 7fe9e5c00640 1 -- 172.21.15.173:0/3054108070 >> 172.21.15.173:0/3054108070 conn(0x7fe9e006ac90 msgr2=0x7fe9e006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:45.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.067+0000 7fe9e5c00640 1 -- 172.21.15.173:0/3054108070 shutdown_connections 2024-04-25T09:02:45.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.067+0000 7fe9e5c00640 1 -- 172.21.15.173:0/3054108070 wait complete. 2024-04-25T09:02:45.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9e5c00640 1 Processor -- start 2024-04-25T09:02:45.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9e5c00640 1 -- start start 2024-04-25T09:02:45.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9e5c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e00b3fe0 0x7fe9e00b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9e5c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e00cc260 0x7fe9e00ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9e5c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e0145290 0x7fe9e00cec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9e5c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e006eee0 con 0x7fe9e0145290 2024-04-25T09:02:45.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9e5c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e006ed60 con 0x7fe9e00cc260 2024-04-25T09:02:45.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9e5c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e006f060 con 0x7fe9e00b3fe0 2024-04-25T09:02:45.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9df400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e0145290 0x7fe9e00cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9df400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e0145290 0x7fe9e00cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57582/0 (socket says 172.21.15.173:57582) 2024-04-25T09:02:45.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9df400640 1 -- 172.21.15.173:0/1899319500 learned_addr learned my addr 172.21.15.173:0/1899319500 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:45.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9dea00640 1 --2- 172.21.15.173:0/1899319500 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e00b3fe0 0x7fe9e00b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9de000640 1 --2- 172.21.15.173:0/1899319500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e00cc260 0x7fe9e00ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9df400640 1 -- 172.21.15.173:0/1899319500 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e00b3fe0 msgr2=0x7fe9e00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9df400640 1 --2- 172.21.15.173:0/1899319500 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e00b3fe0 0x7fe9e00b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9df400640 1 -- 172.21.15.173:0/1899319500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e00cc260 msgr2=0x7fe9e00ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9df400640 1 --2- 172.21.15.173:0/1899319500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e00cc260 0x7fe9e00ce710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9df400640 1 -- 172.21.15.173:0/1899319500 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e00af830 con 0x7fe9e0145290 2024-04-25T09:02:45.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9df400640 1 --2- 172.21.15.173:0/1899319500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e0145290 0x7fe9e00cec50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800efc0 tx=0x7fe9d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:45.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9d6a00640 1 -- 172.21.15.173:0/1899319500 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d800cbe0 con 0x7fe9e0145290 2024-04-25T09:02:45.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9d6a00640 1 -- 172.21.15.173:0/1899319500 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d800cd80 con 0x7fe9e0145290 2024-04-25T09:02:45.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9d6a00640 1 -- 172.21.15.173:0/1899319500 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8003bc0 con 0x7fe9e0145290 2024-04-25T09:02:45.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9e5c00640 1 -- 172.21.15.173:0/1899319500 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e00afb10 con 0x7fe9e0145290 2024-04-25T09:02:45.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.071+0000 7fe9e5c00640 1 -- 172.21.15.173:0/1899319500 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e00b00d0 con 0x7fe9e0145290 2024-04-25T09:02:45.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.075+0000 7fe9e5c00640 1 -- 172.21.15.173:0/1899319500 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e0073ab0 con 0x7fe9e0145290 2024-04-25T09:02:45.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.075+0000 7fe9d6a00640 1 -- 172.21.15.173:0/1899319500 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe9d801b030 con 0x7fe9e0145290 2024-04-25T09:02:45.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.075+0000 7fe9d6a00640 1 --2- 172.21.15.173:0/1899319500 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe9c0066f60 0x7fe9c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.075+0000 7fe9d6a00640 1 -- 172.21.15.173:0/1899319500 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe9d8084f50 con 0x7fe9e0145290 2024-04-25T09:02:45.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.075+0000 7fe9dea00640 1 --2- 172.21.15.173:0/1899319500 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe9c0066f60 0x7fe9c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.075+0000 7fe9dea00640 1 --2- 172.21.15.173:0/1899319500 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe9c0066f60 0x7fe9c0069420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00ad000 tx=0x7fe9d00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:45.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.079+0000 7fe9d6a00640 1 -- 172.21.15.173:0/1899319500 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe9d8022020 con 0x7fe9e0145290 2024-04-25T09:02:45.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.235+0000 7fe9e5c00640 1 -- 172.21.15.173:0/1899319500 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe9e015b800 con 0x7fe9e0145290 2024-04-25T09:02:45.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.235+0000 7fe9d6a00640 1 -- 172.21.15.173:0/1899319500 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe9d8010040 con 0x7fe9e0145290 2024-04-25T09:02:45.226 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:02:45.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.235+0000 7fe9e5c00640 1 -- 172.21.15.173:0/1899319500 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe9c0066f60 msgr2=0x7fe9c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.235+0000 7fe9e5c00640 1 --2- 172.21.15.173:0/1899319500 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe9c0066f60 0x7fe9c0069420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00ad000 tx=0x7fe9d00a6000 comp rx=0 tx=0).stop 2024-04-25T09:02:45.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.235+0000 7fe9e5c00640 1 -- 172.21.15.173:0/1899319500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e0145290 msgr2=0x7fe9e00cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.235+0000 7fe9e5c00640 1 --2- 172.21.15.173:0/1899319500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e0145290 0x7fe9e00cec50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800efc0 tx=0x7fe9d800c490 comp rx=0 tx=0).stop 2024-04-25T09:02:45.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.235+0000 7fe9e5c00640 1 -- 172.21.15.173:0/1899319500 shutdown_connections 2024-04-25T09:02:45.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.235+0000 7fe9e5c00640 1 --2- 172.21.15.173:0/1899319500 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe9c0066f60 0x7fe9c0069420 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.235+0000 7fe9e5c00640 1 --2- 172.21.15.173:0/1899319500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e0145290 0x7fe9e00cec50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.235+0000 7fe9e5c00640 1 --2- 172.21.15.173:0/1899319500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e00cc260 0x7fe9e00ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.235+0000 7fe9e5c00640 1 --2- 172.21.15.173:0/1899319500 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e00b3fe0 0x7fe9e00b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.235+0000 7fe9e5c00640 1 -- 172.21.15.173:0/1899319500 >> 172.21.15.173:0/1899319500 conn(0x7fe9e006ac90 msgr2=0x7fe9e00cdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:45.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.235+0000 7fe9e5c00640 1 -- 172.21.15.173:0/1899319500 shutdown_connections 2024-04-25T09:02:45.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.235+0000 7fe9e5c00640 1 -- 172.21.15.173:0/1899319500 wait complete. 2024-04-25T09:02:45.247 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.391+0000 7f6f87a00640 1 Processor -- start 2024-04-25T09:02:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.391+0000 7f6f87a00640 1 -- start start 2024-04-25T09:02:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.391+0000 7f6f87a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6f800b3e70 0x7f6f800b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.391+0000 7f6f87a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f8015edd0 0x7f6f800b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.391+0000 7f6f87a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f800b4790 con 0x7f6f800aefa0 2024-04-25T09:02:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.391+0000 7f6f87a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8006dd50 con 0x7f6f800b3e70 2024-04-25T09:02:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.391+0000 7f6f87a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8015f320 con 0x7f6f8015edd0 2024-04-25T09:02:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.391+0000 7f6f85000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6f800b3e70 0x7f6f800b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.391+0000 7f6f85000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6f800b3e70 0x7f6f800b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57586/0 (socket says 172.21.15.173:57586) 2024-04-25T09:02:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.391+0000 7f6f85000640 1 -- 172.21.15.173:0/916928065 learned_addr learned my addr 172.21.15.173:0/916928065 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.391+0000 7f6f85a00640 1 --2- 172.21.15.173:0/916928065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f8015edd0 0x7f6f800b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.391+0000 7f6f85000640 1 -- 172.21.15.173:0/916928065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f8015edd0 msgr2=0x7f6f800b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.391+0000 7f6f85000640 1 --2- 172.21.15.173:0/916928065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f8015edd0 0x7f6f800b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.391+0000 7f6f85000640 1 -- 172.21.15.173:0/916928065 >> v1:172.21.15.194:6789/0 conn(0x7f6f800aefa0 legacy=0x7f6f800b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.395+0000 7f6f85000640 1 -- 172.21.15.173:0/916928065 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8006d420 con 0x7f6f800b3e70 2024-04-25T09:02:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.395+0000 7f6f85000640 1 --2- 172.21.15.173:0/916928065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f800b3e70 0x7f6f800b4250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400bb10 tx=0x7f6f7401ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e2e998af23ee21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.395+0000 7f6f7f400640 1 -- 172.21.15.173:0/916928065 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f740b4070 con 0x7f6f800b3e70 2024-04-25T09:02:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.395+0000 7f6f7f400640 1 -- 172.21.15.173:0/916928065 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f740a7bf0 con 0x7f6f800b3e70 2024-04-25T09:02:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.395+0000 7f6f7f400640 1 -- 172.21.15.173:0/916928065 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f740af440 con 0x7f6f800b3e70 2024-04-25T09:02:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.395+0000 7f6f87a00640 1 -- 172.21.15.173:0/916928065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f800b3e70 msgr2=0x7f6f800b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.395+0000 7f6f87a00640 1 --2- 172.21.15.173:0/916928065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f800b3e70 0x7f6f800b4250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400bb10 tx=0x7f6f7401ec00 comp rx=0 tx=0).stop 2024-04-25T09:02:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.395+0000 7f6f87a00640 1 -- 172.21.15.173:0/916928065 shutdown_connections 2024-04-25T09:02:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.395+0000 7f6f87a00640 1 --2- 172.21.15.173:0/916928065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f8015edd0 0x7f6f800b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.395+0000 7f6f87a00640 1 --2- 172.21.15.173:0/916928065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f800b3e70 0x7f6f800b4250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.395+0000 7f6f87a00640 1 -- 172.21.15.173:0/916928065 >> 172.21.15.173:0/916928065 conn(0x7f6f8006ac90 msgr2=0x7f6f8006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.395+0000 7f6f87a00640 1 -- 172.21.15.173:0/916928065 shutdown_connections 2024-04-25T09:02:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.395+0000 7f6f87a00640 1 -- 172.21.15.173:0/916928065 wait complete. 2024-04-25T09:02:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f87a00640 1 Processor -- start 2024-04-25T09:02:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f87a00640 1 -- start start 2024-04-25T09:02:45.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f87a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f800aefa0 0x7f6f800ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f87a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f800b3e70 0x7f6f801495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f87a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f8015edd0 0x7f6f8014fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f87a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8006e1e0 con 0x7f6f800b3e70 2024-04-25T09:02:45.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f87a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8015aba0 con 0x7f6f800aefa0 2024-04-25T09:02:45.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f87a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8006e360 con 0x7f6f8015edd0 2024-04-25T09:02:45.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f7fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f800b3e70 0x7f6f801495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f7fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f800b3e70 0x7f6f801495b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57596/0 (socket says 172.21.15.173:57596) 2024-04-25T09:02:45.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f7fe00640 1 -- 172.21.15.173:0/967143830 learned_addr learned my addr 172.21.15.173:0/967143830 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:45.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f85000640 1 --2- 172.21.15.173:0/967143830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f800aefa0 0x7f6f800ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f85a00640 1 --2- 172.21.15.173:0/967143830 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f8015edd0 0x7f6f8014fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f7fe00640 1 -- 172.21.15.173:0/967143830 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f8015edd0 msgr2=0x7f6f8014fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f7fe00640 1 --2- 172.21.15.173:0/967143830 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f8015edd0 0x7f6f8014fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f7fe00640 1 -- 172.21.15.173:0/967143830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f800aefa0 msgr2=0x7f6f800ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f7fe00640 1 --2- 172.21.15.173:0/967143830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f800aefa0 0x7f6f800ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f7fe00640 1 -- 172.21.15.173:0/967143830 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f80149af0 con 0x7f6f800b3e70 2024-04-25T09:02:45.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f7fe00640 1 --2- 172.21.15.173:0/967143830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f800b3e70 0x7f6f801495b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00c3a0 tx=0x7f6f6c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:45.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f7cc00640 1 -- 172.21.15.173:0/967143830 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c0052d0 con 0x7f6f800b3e70 2024-04-25T09:02:45.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f7cc00640 1 -- 172.21.15.173:0/967143830 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c005470 con 0x7f6f800b3e70 2024-04-25T09:02:45.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f87a00640 1 -- 172.21.15.173:0/967143830 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f800ad030 con 0x7f6f800b3e70 2024-04-25T09:02:45.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f7cc00640 1 -- 172.21.15.173:0/967143830 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c007260 con 0x7f6f800b3e70 2024-04-25T09:02:45.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.399+0000 7f6f87a00640 1 -- 172.21.15.173:0/967143830 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f800ad5f0 con 0x7f6f800b3e70 2024-04-25T09:02:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.403+0000 7f6f87a00640 1 -- 172.21.15.173:0/967143830 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f80073a40 con 0x7f6f800b3e70 2024-04-25T09:02:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.403+0000 7f6f7cc00640 1 -- 172.21.15.173:0/967143830 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6f6c007400 con 0x7f6f800b3e70 2024-04-25T09:02:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.403+0000 7f6f7cc00640 1 --2- 172.21.15.173:0/967143830 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f60066f60 0x7f6f60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.403+0000 7f6f7cc00640 1 -- 172.21.15.173:0/967143830 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6f6c0840d0 con 0x7f6f800b3e70 2024-04-25T09:02:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.403+0000 7f6f85000640 1 --2- 172.21.15.173:0/967143830 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f60066f60 0x7f6f60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.403+0000 7f6f85000640 1 --2- 172.21.15.173:0/967143830 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f60066f60 0x7f6f60069420 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6f740b1000 tx=0x7f6f740a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:45.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.407+0000 7f6f7cc00640 1 -- 172.21.15.173:0/967143830 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6f6c054dd0 con 0x7f6f800b3e70 2024-04-25T09:02:45.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.595+0000 7f6f87a00640 1 -- 172.21.15.173:0/967143830 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f8006e540 con 0x7f6f800b3e70 2024-04-25T09:02:45.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.595+0000 7f6f7cc00640 1 -- 172.21.15.173:0/967143830 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f6f6c058e70 con 0x7f6f800b3e70 2024-04-25T09:02:45.587 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:02:45.588 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3101502434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3101502434},{"type":"v1","addr":"172.21.15.173:6836","nonce":3101502434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-04-25T09:02:45.588 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 2 2024-04-25T09:02:45.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.599+0000 7f6f87a00640 1 -- 172.21.15.173:0/967143830 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f60066f60 msgr2=0x7f6f60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.599+0000 7f6f87a00640 1 --2- 172.21.15.173:0/967143830 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f60066f60 0x7f6f60069420 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6f740b1000 tx=0x7f6f740a9070 comp rx=0 tx=0).stop 2024-04-25T09:02:45.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.599+0000 7f6f87a00640 1 -- 172.21.15.173:0/967143830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f800b3e70 msgr2=0x7f6f801495b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.599+0000 7f6f87a00640 1 --2- 172.21.15.173:0/967143830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f800b3e70 0x7f6f801495b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00c3a0 tx=0x7f6f6c00c860 comp rx=0 tx=0).stop 2024-04-25T09:02:45.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.599+0000 7f6f87a00640 1 -- 172.21.15.173:0/967143830 shutdown_connections 2024-04-25T09:02:45.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.599+0000 7f6f87a00640 1 --2- 172.21.15.173:0/967143830 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f60066f60 0x7f6f60069420 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.599+0000 7f6f87a00640 1 --2- 172.21.15.173:0/967143830 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f8015edd0 0x7f6f8014fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.599+0000 7f6f87a00640 1 --2- 172.21.15.173:0/967143830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f800b3e70 0x7f6f801495b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.599+0000 7f6f87a00640 1 --2- 172.21.15.173:0/967143830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f800aefa0 0x7f6f800ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.599+0000 7f6f87a00640 1 -- 172.21.15.173:0/967143830 >> 172.21.15.173:0/967143830 conn(0x7f6f8006ac90 msgr2=0x7f6f800af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:45.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.599+0000 7f6f87a00640 1 -- 172.21.15.173:0/967143830 shutdown_connections 2024-04-25T09:02:45.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:45.599+0000 7f6f87a00640 1 -- 172.21.15.173:0/967143830 wait complete. 2024-04-25T09:02:47.609 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:47.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.763+0000 7ff198600640 1 Processor -- start 2024-04-25T09:02:47.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.763+0000 7ff198600640 1 -- start start 2024-04-25T09:02:47.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.767+0000 7ff198600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff19006dac0 0x7ff1900ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.767+0000 7ff198600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff190061d60 con 0x7ff19006bca0 2024-04-25T09:02:47.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.767+0000 7ff198600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19006dfa0 con 0x7ff190160fe0 2024-04-25T09:02:47.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.767+0000 7ff198600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1901613c0 con 0x7ff19006dac0 2024-04-25T09:02:47.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.767+0000 7ff195200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff19006dac0 0x7ff1900ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.767+0000 7ff196600640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ff19006bca0 0x7ff19006f040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:37950/0 (socket says 172.21.15.173:37950) 2024-04-25T09:02:47.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.767+0000 7ff196600640 1 -- 172.21.15.173:0/1391128357 learned_addr learned my addr 172.21.15.173:0/1391128357 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:02:47.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.767+0000 7ff195200640 1 -- 172.21.15.173:0/1391128357 >> v1:172.21.15.194:6789/0 conn(0x7ff190160fe0 legacy=0x7ff190161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.767+0000 7ff195200640 1 -- 172.21.15.173:0/1391128357 >> v1:172.21.15.173:6789/0 conn(0x7ff19006bca0 legacy=0x7ff19006f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.767+0000 7ff195200640 1 -- 172.21.15.173:0/1391128357 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19006e280 con 0x7ff19006dac0 2024-04-25T09:02:47.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.767+0000 7ff18fe00640 1 -- 172.21.15.173:0/1391128357 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433789435 0 0) 0x7ff1880014a0 con 0x7ff19006bca0 2024-04-25T09:02:47.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff195200640 1 --2- 172.21.15.173:0/1391128357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff19006dac0 0x7ff1900ace00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0097c0 tx=0x7ff17c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21557445dd33d214 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff18fe00640 1 -- 172.21.15.173:0/1391128357 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0b0070 con 0x7ff19006dac0 2024-04-25T09:02:47.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff18fe00640 1 -- 172.21.15.173:0/1391128357 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c0ab600 con 0x7ff19006dac0 2024-04-25T09:02:47.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff18fe00640 1 -- 172.21.15.173:0/1391128357 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0ab9d0 con 0x7ff19006dac0 2024-04-25T09:02:47.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff198600640 1 -- 172.21.15.173:0/1391128357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff19006dac0 msgr2=0x7ff1900ace00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff198600640 1 --2- 172.21.15.173:0/1391128357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff19006dac0 0x7ff1900ace00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0097c0 tx=0x7ff17c01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff198600640 1 -- 172.21.15.173:0/1391128357 shutdown_connections 2024-04-25T09:02:47.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff198600640 1 --2- 172.21.15.173:0/1391128357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff19006dac0 0x7ff1900ace00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff198600640 1 -- 172.21.15.173:0/1391128357 >> 172.21.15.173:0/1391128357 conn(0x7ff190071c20 msgr2=0x7ff190072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:47.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff198600640 1 -- 172.21.15.173:0/1391128357 shutdown_connections 2024-04-25T09:02:47.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff198600640 1 -- 172.21.15.173:0/1391128357 wait complete. 2024-04-25T09:02:47.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff198600640 1 Processor -- start 2024-04-25T09:02:47.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff198600640 1 -- start start 2024-04-25T09:02:47.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff198600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff19006bca0 0x7ff19015bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff198600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff19006dac0 0x7ff190155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff198600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff190160fe0 0x7ff190149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff198600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1900ad340 con 0x7ff19006dac0 2024-04-25T09:02:47.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff198600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19006c500 con 0x7ff19006bca0 2024-04-25T09:02:47.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff198600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1900ad4c0 con 0x7ff190160fe0 2024-04-25T09:02:47.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff195200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff19006dac0 0x7ff190155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff195200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff19006dac0 0x7ff190155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57622/0 (socket says 172.21.15.173:57622) 2024-04-25T09:02:47.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.771+0000 7ff195200640 1 -- 172.21.15.173:0/1872606335 learned_addr learned my addr 172.21.15.173:0/1872606335 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:47.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.775+0000 7ff196600640 1 --2- 172.21.15.173:0/1872606335 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff190160fe0 0x7ff190149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.775+0000 7ff195c00640 1 --2- 172.21.15.173:0/1872606335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff19006bca0 0x7ff19015bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.775+0000 7ff195200640 1 -- 172.21.15.173:0/1872606335 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff190160fe0 msgr2=0x7ff190149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.775+0000 7ff195200640 1 --2- 172.21.15.173:0/1872606335 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff190160fe0 0x7ff190149a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.775+0000 7ff195200640 1 -- 172.21.15.173:0/1872606335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff19006bca0 msgr2=0x7ff19015bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.775+0000 7ff195200640 1 --2- 172.21.15.173:0/1872606335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff19006bca0 0x7ff19015bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.775+0000 7ff195200640 1 -- 172.21.15.173:0/1872606335 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff190155f00 con 0x7ff19006dac0 2024-04-25T09:02:47.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.775+0000 7ff195200640 1 --2- 172.21.15.173:0/1872606335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff19006dac0 0x7ff190155780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff17c018ff0 tx=0x7ff17c019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.775+0000 7ff18d600640 1 -- 172.21.15.173:0/1872606335 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0b8020 con 0x7ff19006dac0 2024-04-25T09:02:47.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.775+0000 7ff18d600640 1 -- 172.21.15.173:0/1872606335 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c0b4630 con 0x7ff19006dac0 2024-04-25T09:02:47.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.775+0000 7ff198600640 1 -- 172.21.15.173:0/1872606335 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1901561e0 con 0x7ff19006dac0 2024-04-25T09:02:47.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.775+0000 7ff18d600640 1 -- 172.21.15.173:0/1872606335 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0b0040 con 0x7ff19006dac0 2024-04-25T09:02:47.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.775+0000 7ff198600640 1 -- 172.21.15.173:0/1872606335 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1901567a0 con 0x7ff19006dac0 2024-04-25T09:02:47.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.775+0000 7ff198600640 1 -- 172.21.15.173:0/1872606335 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff190073a40 con 0x7ff19006dac0 2024-04-25T09:02:47.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.775+0000 7ff18d600640 1 -- 172.21.15.173:0/1872606335 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff17c0bb020 con 0x7ff19006dac0 2024-04-25T09:02:47.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.775+0000 7ff18d600640 1 --2- 172.21.15.173:0/1872606335 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff170066f60 0x7ff170069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.775+0000 7ff18d600640 1 -- 172.21.15.173:0/1872606335 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff17c11e990 con 0x7ff19006dac0 2024-04-25T09:02:47.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.775+0000 7ff195c00640 1 --2- 172.21.15.173:0/1872606335 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff170066f60 0x7ff170069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.779+0000 7ff195c00640 1 --2- 172.21.15.173:0/1872606335 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff170066f60 0x7ff170069420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff1900b3180 tx=0x7ff184009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.779+0000 7ff18d600640 1 -- 172.21.15.173:0/1872606335 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff17c0c2030 con 0x7ff19006dac0 2024-04-25T09:02:47.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.967+0000 7ff198600640 1 -- 172.21.15.173:0/1872606335 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1900cf6c0 con 0x7ff19006dac0 2024-04-25T09:02:47.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.967+0000 7ff18d600640 1 -- 172.21.15.173:0/1872606335 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3706 (secure 0 0 0) 0x7ff17c016090 con 0x7ff19006dac0 2024-04-25T09:02:47.958 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:02:47.959 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2883565303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2883565303},{"type":"v1","addr":"172.21.15.194:6834","nonce":2883565303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2634963400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2634963400},{"type":"v1","addr":"172.21.15.173:6837","nonce":2634963400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3101502434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3101502434},{"type":"v1","addr":"172.21.15.173:6836","nonce":3101502434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4160663138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4160663138},{"type":"v1","addr":"172.21.15.194:6835","nonce":4160663138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-04-25T09:02:47.959 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 3 2024-04-25T09:02:47.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.967+0000 7ff198600640 1 -- 172.21.15.173:0/1872606335 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff170066f60 msgr2=0x7ff170069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.967+0000 7ff198600640 1 --2- 172.21.15.173:0/1872606335 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff170066f60 0x7ff170069420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff1900b3180 tx=0x7ff184009040 comp rx=0 tx=0).stop 2024-04-25T09:02:47.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.967+0000 7ff198600640 1 -- 172.21.15.173:0/1872606335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff19006dac0 msgr2=0x7ff190155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.967+0000 7ff198600640 1 --2- 172.21.15.173:0/1872606335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff19006dac0 0x7ff190155780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff17c018ff0 tx=0x7ff17c019180 comp rx=0 tx=0).stop 2024-04-25T09:02:47.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.967+0000 7ff198600640 1 -- 172.21.15.173:0/1872606335 shutdown_connections 2024-04-25T09:02:47.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.967+0000 7ff198600640 1 --2- 172.21.15.173:0/1872606335 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff170066f60 0x7ff170069420 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.967+0000 7ff198600640 1 --2- 172.21.15.173:0/1872606335 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff190160fe0 0x7ff190149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.967+0000 7ff198600640 1 --2- 172.21.15.173:0/1872606335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff19006dac0 0x7ff190155780 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.967+0000 7ff198600640 1 --2- 172.21.15.173:0/1872606335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff19006bca0 0x7ff19015bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.967+0000 7ff198600640 1 -- 172.21.15.173:0/1872606335 >> 172.21.15.173:0/1872606335 conn(0x7ff190071c20 msgr2=0x7ff1900b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:47.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.967+0000 7ff198600640 1 -- 172.21.15.173:0/1872606335 shutdown_connections 2024-04-25T09:02:47.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:47.967+0000 7ff198600640 1 -- 172.21.15.173:0/1872606335 wait complete. 2024-04-25T09:02:47.981 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:48.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.123+0000 7f4b3c400640 1 Processor -- start 2024-04-25T09:02:48.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.123+0000 7f4b3c400640 1 -- start start 2024-04-25T09:02:48.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.127+0000 7f4b3c400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4b340aefa0 0x7f4b340cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.127+0000 7f4b3c400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3415f320 con 0x7f4b340b3e70 2024-04-25T09:02:48.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.127+0000 7f4b3c400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3406d420 con 0x7f4b3415edd0 2024-04-25T09:02:48.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.127+0000 7f4b3c400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3406dd50 con 0x7f4b340aefa0 2024-04-25T09:02:48.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.127+0000 7f4b39000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4b340aefa0 0x7f4b340cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.127+0000 7f4b39000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4b340aefa0 0x7f4b340cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57624/0 (socket says 172.21.15.173:57624) 2024-04-25T09:02:48.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.127+0000 7f4b39a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4b340b3e70 0x7f4b340b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:37966/0 (socket says 172.21.15.173:37966) 2024-04-25T09:02:48.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.127+0000 7f4b39000640 1 -- 172.21.15.173:0/2855121660 learned_addr learned my addr 172.21.15.173:0/2855121660 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:48.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.127+0000 7f4b39000640 1 -- 172.21.15.173:0/2855121660 >> v1:172.21.15.194:6789/0 conn(0x7f4b3415edd0 legacy=0x7f4b340cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:48.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.127+0000 7f4b39000640 1 -- 172.21.15.173:0/2855121660 >> v1:172.21.15.173:6789/0 conn(0x7f4b340b3e70 legacy=0x7f4b340b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.127+0000 7f4b39000640 1 -- 172.21.15.173:0/2855121660 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3406d700 con 0x7f4b340aefa0 2024-04-25T09:02:48.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b39000640 1 --2- 172.21.15.173:0/2855121660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b340aefa0 0x7f4b340cd7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009870 tx=0x7f4b2001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b9b056f6ebd3e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:48.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b33e00640 1 -- 172.21.15.173:0/2855121660 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b200aa670 con 0x7f4b340aefa0 2024-04-25T09:02:48.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b33e00640 1 -- 172.21.15.173:0/2855121660 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b200af070 con 0x7f4b340aefa0 2024-04-25T09:02:48.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b33e00640 1 -- 172.21.15.173:0/2855121660 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b200aaa30 con 0x7f4b340aefa0 2024-04-25T09:02:48.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b3c400640 1 -- 172.21.15.173:0/2855121660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b340aefa0 msgr2=0x7f4b340cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b3c400640 1 --2- 172.21.15.173:0/2855121660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b340aefa0 0x7f4b340cd7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009870 tx=0x7f4b2001c4f0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b3c400640 1 -- 172.21.15.173:0/2855121660 shutdown_connections 2024-04-25T09:02:48.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b3c400640 1 --2- 172.21.15.173:0/2855121660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b340aefa0 0x7f4b340cd7a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b3c400640 1 -- 172.21.15.173:0/2855121660 >> 172.21.15.173:0/2855121660 conn(0x7f4b3406ac90 msgr2=0x7f4b3406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:48.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b3c400640 1 -- 172.21.15.173:0/2855121660 shutdown_connections 2024-04-25T09:02:48.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b3c400640 1 -- 172.21.15.173:0/2855121660 wait complete. 2024-04-25T09:02:48.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b3c400640 1 Processor -- start 2024-04-25T09:02:48.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b3c400640 1 -- start start 2024-04-25T09:02:48.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b3c400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b340aefa0 0x7f4b3415b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b3c400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b340b3e70 0x7f4b34152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b3c400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b3415edd0 0x7f4b3413dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b3c400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3406e340 con 0x7f4b340aefa0 2024-04-25T09:02:48.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b3c400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3406e1c0 con 0x7f4b3415edd0 2024-04-25T09:02:48.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.131+0000 7f4b3c400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b34168fd0 con 0x7f4b340b3e70 2024-04-25T09:02:48.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.135+0000 7f4b39a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b340aefa0 0x7f4b3415b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.135+0000 7f4b39a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b340aefa0 0x7f4b3415b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57630/0 (socket says 172.21.15.173:57630) 2024-04-25T09:02:48.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.135+0000 7f4b39a00640 1 -- 172.21.15.173:0/1119012619 learned_addr learned my addr 172.21.15.173:0/1119012619 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:48.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.135+0000 7f4b39000640 1 --2- 172.21.15.173:0/1119012619 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b340b3e70 0x7f4b34152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.135+0000 7f4b3a400640 1 --2- 172.21.15.173:0/1119012619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b3415edd0 0x7f4b3413dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.135+0000 7f4b39a00640 1 -- 172.21.15.173:0/1119012619 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b340b3e70 msgr2=0x7f4b34152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.135+0000 7f4b39a00640 1 --2- 172.21.15.173:0/1119012619 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b340b3e70 0x7f4b34152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.135+0000 7f4b39a00640 1 -- 172.21.15.173:0/1119012619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b3415edd0 msgr2=0x7f4b3413dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.135+0000 7f4b39a00640 1 --2- 172.21.15.173:0/1119012619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b3415edd0 0x7f4b3413dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.135+0000 7f4b39a00640 1 -- 172.21.15.173:0/1119012619 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b34151e50 con 0x7f4b340aefa0 2024-04-25T09:02:48.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.135+0000 7f4b39a00640 1 --2- 172.21.15.173:0/1119012619 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b340aefa0 0x7f4b3415b890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800c3a0 tx=0x7f4b2800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:48.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.135+0000 7f4b31600640 1 -- 172.21.15.173:0/1119012619 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b280074e0 con 0x7f4b340aefa0 2024-04-25T09:02:48.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.135+0000 7f4b31600640 1 -- 172.21.15.173:0/1119012619 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b28007680 con 0x7f4b340aefa0 2024-04-25T09:02:48.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.135+0000 7f4b3c400640 1 -- 172.21.15.173:0/1119012619 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b34152130 con 0x7f4b340aefa0 2024-04-25T09:02:48.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.135+0000 7f4b31600640 1 -- 172.21.15.173:0/1119012619 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28004a30 con 0x7f4b340aefa0 2024-04-25T09:02:48.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.135+0000 7f4b3c400640 1 -- 172.21.15.173:0/1119012619 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b341526f0 con 0x7f4b340aefa0 2024-04-25T09:02:48.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.135+0000 7f4b3c400640 1 -- 172.21.15.173:0/1119012619 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b34073a40 con 0x7f4b340aefa0 2024-04-25T09:02:48.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.135+0000 7f4b31600640 1 -- 172.21.15.173:0/1119012619 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4b2801a020 con 0x7f4b340aefa0 2024-04-25T09:02:48.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.139+0000 7f4b31600640 1 --2- 172.21.15.173:0/1119012619 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4b14066f90 0x7f4b14069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.139+0000 7f4b31600640 1 -- 172.21.15.173:0/1119012619 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4b28084480 con 0x7f4b340aefa0 2024-04-25T09:02:48.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.139+0000 7f4b39000640 1 --2- 172.21.15.173:0/1119012619 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4b14066f90 0x7f4b14069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.139+0000 7f4b39000640 1 --2- 172.21.15.173:0/1119012619 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4b14066f90 0x7f4b14069450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4b200ae000 tx=0x7f4b200a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:48.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.143+0000 7f4b31600640 1 -- 172.21.15.173:0/1119012619 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4b28055740 con 0x7f4b340aefa0 2024-04-25T09:02:48.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.299+0000 7f4b3c400640 1 -- 172.21.15.173:0/1119012619 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b34166560 con 0x7f4b340aefa0 2024-04-25T09:02:48.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.299+0000 7f4b31600640 1 -- 172.21.15.173:0/1119012619 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12944 (secure 0 0 0) 0x7f4b28055040 con 0x7f4b340aefa0 2024-04-25T09:02:48.290 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:02:48.290 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":18,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:40.956051+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:48.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.299+0000 7f4b3c400640 1 -- 172.21.15.173:0/1119012619 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4b14066f90 msgr2=0x7f4b14069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.299+0000 7f4b3c400640 1 --2- 172.21.15.173:0/1119012619 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4b14066f90 0x7f4b14069450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4b200ae000 tx=0x7f4b200a7000 comp rx=0 tx=0).stop 2024-04-25T09:02:48.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.299+0000 7f4b3c400640 1 -- 172.21.15.173:0/1119012619 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b340aefa0 msgr2=0x7f4b3415b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.299+0000 7f4b3c400640 1 --2- 172.21.15.173:0/1119012619 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b340aefa0 0x7f4b3415b890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800c3a0 tx=0x7f4b2800c860 comp rx=0 tx=0).stop 2024-04-25T09:02:48.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.299+0000 7f4b3c400640 1 -- 172.21.15.173:0/1119012619 shutdown_connections 2024-04-25T09:02:48.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.299+0000 7f4b3c400640 1 --2- 172.21.15.173:0/1119012619 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4b14066f90 0x7f4b14069450 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.299+0000 7f4b3c400640 1 --2- 172.21.15.173:0/1119012619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b3415edd0 0x7f4b3413dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.299+0000 7f4b3c400640 1 --2- 172.21.15.173:0/1119012619 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b340b3e70 0x7f4b34152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.299+0000 7f4b3c400640 1 --2- 172.21.15.173:0/1119012619 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b340aefa0 0x7f4b3415b890 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.299+0000 7f4b3c400640 1 -- 172.21.15.173:0/1119012619 >> 172.21.15.173:0/1119012619 conn(0x7f4b3406ac90 msgr2=0x7f4b340b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:48.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.299+0000 7f4b3c400640 1 -- 172.21.15.173:0/1119012619 shutdown_connections 2024-04-25T09:02:48.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.299+0000 7f4b3c400640 1 -- 172.21.15.173:0/1119012619 wait complete. 2024-04-25T09:02:48.311 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:02:48.311 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:48.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.459+0000 7f2a65400640 1 Processor -- start 2024-04-25T09:02:48.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.459+0000 7f2a65400640 1 -- start start 2024-04-25T09:02:48.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.459+0000 7f2a65400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2a600b0d70 0x7f2a6015ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.459+0000 7f2a65400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a600ccff0 0x7f2a600cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.459+0000 7f2a65400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a600cdaa0 con 0x7f2a600ce680 2024-04-25T09:02:48.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.459+0000 7f2a65400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6006d3d0 con 0x7f2a600b0d70 2024-04-25T09:02:48.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.459+0000 7f2a65400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6006d670 con 0x7f2a600ccff0 2024-04-25T09:02:48.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.459+0000 7f2a5fe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2a600b0d70 0x7f2a6015ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.459+0000 7f2a57400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a600ccff0 0x7f2a600cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.459+0000 7f2a57400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a600ccff0 0x7f2a600cd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:57802/0 (socket says 172.21.15.173:57802) 2024-04-25T09:02:48.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.459+0000 7f2a57400640 1 -- 172.21.15.173:0/150673041 learned_addr learned my addr 172.21.15.173:0/150673041 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:48.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.463+0000 7f2a57400640 1 -- 172.21.15.173:0/150673041 >> v2:172.21.15.194:3300/0 conn(0x7f2a600b0d70 msgr2=0x7f2a6015ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:48.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.463+0000 7f2a57400640 1 --2- 172.21.15.173:0/150673041 >> v2:172.21.15.194:3300/0 conn(0x7f2a600b0d70 0x7f2a6015ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.463+0000 7f2a57400640 1 -- 172.21.15.173:0/150673041 >> v1:172.21.15.194:6789/0 conn(0x7f2a600ce680 legacy=0x7f2a6006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.463+0000 7f2a57400640 1 -- 172.21.15.173:0/150673041 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6006d950 con 0x7f2a600ccff0 2024-04-25T09:02:48.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.463+0000 7f2a57400640 1 --2- 172.21.15.173:0/150673041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a600ccff0 0x7f2a600cd450 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009870 tx=0x7f2a4801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ca2d4e35a03bc5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:48.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.463+0000 7f2a5f400640 1 -- 172.21.15.173:0/150673041 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a480b1070 con 0x7f2a600ccff0 2024-04-25T09:02:48.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a5f400640 1 -- 172.21.15.173:0/150673041 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a480ac410 con 0x7f2a600ccff0 2024-04-25T09:02:48.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a5f400640 1 -- 172.21.15.173:0/150673041 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a480ac7e0 con 0x7f2a600ccff0 2024-04-25T09:02:48.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a65400640 1 -- 172.21.15.173:0/150673041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a600ccff0 msgr2=0x7f2a600cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a65400640 1 --2- 172.21.15.173:0/150673041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a600ccff0 0x7f2a600cd450 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009870 tx=0x7f2a4801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a65400640 1 -- 172.21.15.173:0/150673041 shutdown_connections 2024-04-25T09:02:48.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a65400640 1 --2- 172.21.15.173:0/150673041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a600ccff0 0x7f2a600cd450 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a65400640 1 --2- 172.21.15.173:0/150673041 >> v2:172.21.15.194:3300/0 conn(0x7f2a600b0d70 0x7f2a6015ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a65400640 1 -- 172.21.15.173:0/150673041 >> 172.21.15.173:0/150673041 conn(0x7f2a60061d40 msgr2=0x7f2a6006ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:48.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a65400640 1 -- 172.21.15.173:0/150673041 shutdown_connections 2024-04-25T09:02:48.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a65400640 1 -- 172.21.15.173:0/150673041 wait complete. 2024-04-25T09:02:48.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a65400640 1 Processor -- start 2024-04-25T09:02:48.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a65400640 1 -- start start 2024-04-25T09:02:48.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a65400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a600b0d70 0x7f2a6013b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a65400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a600ccff0 0x7f2a6015b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a65400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a600ce680 0x7f2a6013efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a65400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600ceea0 con 0x7f2a600ccff0 2024-04-25T09:02:48.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a65400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6015b1d0 con 0x7f2a600ce680 2024-04-25T09:02:48.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a65400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6015c5e0 con 0x7f2a600b0d70 2024-04-25T09:02:48.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a57400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a600ccff0 0x7f2a6015b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a57400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a600ccff0 0x7f2a6015b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57644/0 (socket says 172.21.15.173:57644) 2024-04-25T09:02:48.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a57400640 1 -- 172.21.15.173:0/4156036128 learned_addr learned my addr 172.21.15.173:0/4156036128 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:48.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a5fe00640 1 --2- 172.21.15.173:0/4156036128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a600b0d70 0x7f2a6013b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.467+0000 7f2a64a00640 1 --2- 172.21.15.173:0/4156036128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a600ce680 0x7f2a6013efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.471+0000 7f2a57400640 1 -- 172.21.15.173:0/4156036128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a600b0d70 msgr2=0x7f2a6013b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.471+0000 7f2a57400640 1 --2- 172.21.15.173:0/4156036128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a600b0d70 0x7f2a6013b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.471+0000 7f2a57400640 1 -- 172.21.15.173:0/4156036128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a600ce680 msgr2=0x7f2a6013efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.471+0000 7f2a57400640 1 --2- 172.21.15.173:0/4156036128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a600ce680 0x7f2a6013efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.471+0000 7f2a57400640 1 -- 172.21.15.173:0/4156036128 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6015c8c0 con 0x7f2a600ccff0 2024-04-25T09:02:48.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.471+0000 7f2a57400640 1 --2- 172.21.15.173:0/4156036128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a600ccff0 0x7f2a6015b780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2a480190b0 tx=0x7f2a48019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:48.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.471+0000 7f2a5cc00640 1 -- 172.21.15.173:0/4156036128 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a480b1040 con 0x7f2a600ccff0 2024-04-25T09:02:48.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.471+0000 7f2a5cc00640 1 -- 172.21.15.173:0/4156036128 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a480acc50 con 0x7f2a600ccff0 2024-04-25T09:02:48.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.471+0000 7f2a5cc00640 1 -- 172.21.15.173:0/4156036128 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a480b5420 con 0x7f2a600ccff0 2024-04-25T09:02:48.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.471+0000 7f2a65400640 1 -- 172.21.15.173:0/4156036128 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6015cba0 con 0x7f2a600ccff0 2024-04-25T09:02:48.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.471+0000 7f2a65400640 1 -- 172.21.15.173:0/4156036128 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6015c220 con 0x7f2a600ccff0 2024-04-25T09:02:48.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.471+0000 7f2a65400640 1 -- 172.21.15.173:0/4156036128 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a60073a40 con 0x7f2a600ccff0 2024-04-25T09:02:48.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.471+0000 7f2a5cc00640 1 -- 172.21.15.173:0/4156036128 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2a480b55c0 con 0x7f2a600ccff0 2024-04-25T09:02:48.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.471+0000 7f2a5cc00640 1 --2- 172.21.15.173:0/4156036128 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2a3c066f60 0x7f2a3c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.471+0000 7f2a5cc00640 1 -- 172.21.15.173:0/4156036128 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2a4811e610 con 0x7f2a600ccff0 2024-04-25T09:02:48.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.471+0000 7f2a5fe00640 1 --2- 172.21.15.173:0/4156036128 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2a3c066f60 0x7f2a3c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.475+0000 7f2a5fe00640 1 --2- 172.21.15.173:0/4156036128 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2a3c066f60 0x7f2a3c069420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2a50009ac0 tx=0x7f2a50009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:48.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.475+0000 7f2a5cc00640 1 -- 172.21.15.173:0/4156036128 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2a480c3020 con 0x7f2a600ccff0 2024-04-25T09:02:48.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.631+0000 7f2a65400640 1 -- 172.21.15.173:0/4156036128 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a600b46b0 con 0x7f2a600ccff0 2024-04-25T09:02:48.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.631+0000 7f2a5cc00640 1 -- 172.21.15.173:0/4156036128 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a48016150 con 0x7f2a600ccff0 2024-04-25T09:02:48.623 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:02:48.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.631+0000 7f2a65400640 1 -- 172.21.15.173:0/4156036128 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2a3c066f60 msgr2=0x7f2a3c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.631+0000 7f2a65400640 1 --2- 172.21.15.173:0/4156036128 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2a3c066f60 0x7f2a3c069420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2a50009ac0 tx=0x7f2a50009190 comp rx=0 tx=0).stop 2024-04-25T09:02:48.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.631+0000 7f2a65400640 1 -- 172.21.15.173:0/4156036128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a600ccff0 msgr2=0x7f2a6015b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.631+0000 7f2a65400640 1 --2- 172.21.15.173:0/4156036128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a600ccff0 0x7f2a6015b780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2a480190b0 tx=0x7f2a48019240 comp rx=0 tx=0).stop 2024-04-25T09:02:48.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.631+0000 7f2a65400640 1 -- 172.21.15.173:0/4156036128 shutdown_connections 2024-04-25T09:02:48.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.631+0000 7f2a65400640 1 --2- 172.21.15.173:0/4156036128 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2a3c066f60 0x7f2a3c069420 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.631+0000 7f2a65400640 1 --2- 172.21.15.173:0/4156036128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a600ce680 0x7f2a6013efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.631+0000 7f2a65400640 1 --2- 172.21.15.173:0/4156036128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a600ccff0 0x7f2a6015b780 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.631+0000 7f2a65400640 1 --2- 172.21.15.173:0/4156036128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a600b0d70 0x7f2a6013b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.631+0000 7f2a65400640 1 -- 172.21.15.173:0/4156036128 >> 172.21.15.173:0/4156036128 conn(0x7f2a60061d40 msgr2=0x7f2a600cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:48.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.631+0000 7f2a65400640 1 -- 172.21.15.173:0/4156036128 shutdown_connections 2024-04-25T09:02:48.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.631+0000 7f2a65400640 1 -- 172.21.15.173:0/4156036128 wait complete. 2024-04-25T09:02:48.644 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:02:48.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.791+0000 7fe64a800640 1 Processor -- start 2024-04-25T09:02:48.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.791+0000 7fe64a800640 1 -- start start 2024-04-25T09:02:48.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.791+0000 7fe64a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe64415dc60 0x7fe6440b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.791+0000 7fe64a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe64415e040 0x7fe6440ace10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.791+0000 7fe64a800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64415e8e0 con 0x7fe6440ad350 2024-04-25T09:02:48.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.791+0000 7fe64a800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe644071450 con 0x7fe64415dc60 2024-04-25T09:02:48.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.791+0000 7fe64a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64415ebc0 con 0x7fe64415e040 2024-04-25T09:02:48.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.791+0000 7fe643400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe64415dc60 0x7fe6440b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.791+0000 7fe643400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe64415dc60 0x7fe6440b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57660/0 (socket says 172.21.15.173:57660) 2024-04-25T09:02:48.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.791+0000 7fe643400640 1 -- 172.21.15.173:0/3118407725 learned_addr learned my addr 172.21.15.173:0/3118407725 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:48.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.791+0000 7fe642a00640 1 --2- 172.21.15.173:0/3118407725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe64415e040 0x7fe6440ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.791+0000 7fe643400640 1 -- 172.21.15.173:0/3118407725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe64415e040 msgr2=0x7fe6440ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:48.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.791+0000 7fe643400640 1 --2- 172.21.15.173:0/3118407725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe64415e040 0x7fe6440ace10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.791+0000 7fe643400640 1 -- 172.21.15.173:0/3118407725 >> v1:172.21.15.194:6789/0 conn(0x7fe6440ad350 legacy=0x7fe6440ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.791+0000 7fe643400640 1 -- 172.21.15.173:0/3118407725 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64415eea0 con 0x7fe64415dc60 2024-04-25T09:02:48.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.791+0000 7fe642a00640 1 --2- 172.21.15.173:0/3118407725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe64415e040 0x7fe6440ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:48.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.795+0000 7fe643400640 1 --2- 172.21.15.173:0/3118407725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe64415dc60 0x7fe6440b3710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe634009870 tx=0x7fe63401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad4e3beb214ef63 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:48.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.795+0000 7fe642000640 1 -- 172.21.15.173:0/3118407725 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6340b1070 con 0x7fe64415dc60 2024-04-25T09:02:48.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.795+0000 7fe642000640 1 -- 172.21.15.173:0/3118407725 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6340a8050 con 0x7fe64415dc60 2024-04-25T09:02:48.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.795+0000 7fe642000640 1 -- 172.21.15.173:0/3118407725 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6340ac860 con 0x7fe64415dc60 2024-04-25T09:02:48.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.795+0000 7fe64a800640 1 -- 172.21.15.173:0/3118407725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe64415dc60 msgr2=0x7fe6440b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.795+0000 7fe64a800640 1 --2- 172.21.15.173:0/3118407725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe64415dc60 0x7fe6440b3710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe634009870 tx=0x7fe63401c560 comp rx=0 tx=0).stop 2024-04-25T09:02:48.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.795+0000 7fe64a800640 1 -- 172.21.15.173:0/3118407725 shutdown_connections 2024-04-25T09:02:48.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.795+0000 7fe64a800640 1 --2- 172.21.15.173:0/3118407725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe64415e040 0x7fe6440ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.795+0000 7fe64a800640 1 --2- 172.21.15.173:0/3118407725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe64415dc60 0x7fe6440b3710 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.795+0000 7fe64a800640 1 -- 172.21.15.173:0/3118407725 >> 172.21.15.173:0/3118407725 conn(0x7fe64406ac90 msgr2=0x7fe64406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:48.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.795+0000 7fe64a800640 1 -- 172.21.15.173:0/3118407725 shutdown_connections 2024-04-25T09:02:48.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.795+0000 7fe64a800640 1 -- 172.21.15.173:0/3118407725 wait complete. 2024-04-25T09:02:48.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe64a800640 1 Processor -- start 2024-04-25T09:02:48.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe64a800640 1 -- start start 2024-04-25T09:02:48.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe64a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6440ad350 0x7fe644161850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe64a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe64415dc60 0x7fe64413fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe64a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe64415e040 0x7fe644140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe64a800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440720f0 con 0x7fe64415e040 2024-04-25T09:02:48.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe64a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64415e660 con 0x7fe6440ad350 2024-04-25T09:02:48.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe64a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe644072270 con 0x7fe64415dc60 2024-04-25T09:02:48.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe643e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe64415e040 0x7fe644140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe643e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe64415e040 0x7fe644140240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57662/0 (socket says 172.21.15.173:57662) 2024-04-25T09:02:48.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe643e00640 1 -- 172.21.15.173:0/3258354624 learned_addr learned my addr 172.21.15.173:0/3258354624 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:48.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe643400640 1 --2- 172.21.15.173:0/3258354624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6440ad350 0x7fe644161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe642a00640 1 --2- 172.21.15.173:0/3258354624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe64415dc60 0x7fe64413fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe643e00640 1 -- 172.21.15.173:0/3258354624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe64415dc60 msgr2=0x7fe64413fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe643e00640 1 --2- 172.21.15.173:0/3258354624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe64415dc60 0x7fe64413fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe643e00640 1 -- 172.21.15.173:0/3258354624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6440ad350 msgr2=0x7fe644161850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe643e00640 1 --2- 172.21.15.173:0/3258354624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6440ad350 0x7fe644161850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe643e00640 1 -- 172.21.15.173:0/3258354624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe644142a60 con 0x7fe64415e040 2024-04-25T09:02:48.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe642a00640 1 --2- 172.21.15.173:0/3258354624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe64415dc60 0x7fe64413fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:48.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe643400640 1 --2- 172.21.15.173:0/3258354624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6440ad350 0x7fe644161850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:48.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe643e00640 1 --2- 172.21.15.173:0/3258354624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe64415e040 0x7fe644140240 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00c730 tx=0x7fe63c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:48.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe63b400640 1 -- 172.21.15.173:0/3258354624 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c016020 con 0x7fe64415e040 2024-04-25T09:02:48.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe63b400640 1 -- 172.21.15.173:0/3258354624 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c006d80 con 0x7fe64415e040 2024-04-25T09:02:48.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe63b400640 1 -- 172.21.15.173:0/3258354624 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c003bc0 con 0x7fe64415e040 2024-04-25T09:02:48.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe64a800640 1 -- 172.21.15.173:0/3258354624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe644142d40 con 0x7fe64415e040 2024-04-25T09:02:48.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe64a800640 1 -- 172.21.15.173:0/3258354624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe644143820 con 0x7fe64415e040 2024-04-25T09:02:48.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.799+0000 7fe64a800640 1 -- 172.21.15.173:0/3258354624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe644073a40 con 0x7fe64415e040 2024-04-25T09:02:48.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.803+0000 7fe63b400640 1 -- 172.21.15.173:0/3258354624 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe63c00a850 con 0x7fe64415e040 2024-04-25T09:02:48.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.803+0000 7fe63b400640 1 --2- 172.21.15.173:0/3258354624 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe624066f90 0x7fe624069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.803+0000 7fe63b400640 1 -- 172.21.15.173:0/3258354624 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe63c084960 con 0x7fe64415e040 2024-04-25T09:02:48.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.803+0000 7fe643400640 1 --2- 172.21.15.173:0/3258354624 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe624066f90 0x7fe624069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.803+0000 7fe643400640 1 --2- 172.21.15.173:0/3258354624 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe624066f90 0x7fe624069450 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe6340ae000 tx=0x7fe6340a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:48.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.807+0000 7fe63b400640 1 -- 172.21.15.173:0/3258354624 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe63c020020 con 0x7fe64415e040 2024-04-25T09:02:48.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.963+0000 7fe64a800640 1 -- 172.21.15.173:0/3258354624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe64415f460 con 0x7fe64415e040 2024-04-25T09:02:48.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.963+0000 7fe63b400640 1 -- 172.21.15.173:0/3258354624 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe63c055cb0 con 0x7fe64415e040 2024-04-25T09:02:48.954 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:02:48.954 INFO:teuthology.orchestra.run.smithi173.stdout:[ 2024-04-25T09:02:48.954 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:02:48.955 INFO:teuthology.orchestra.run.smithi173.stdout: "poolnum": 1, 2024-04-25T09:02:48.955 INFO:teuthology.orchestra.run.smithi173.stdout: "poolname": ".mgr" 2024-04-25T09:02:48.955 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:02:48.955 INFO:teuthology.orchestra.run.smithi173.stdout:] 2024-04-25T09:02:48.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.963+0000 7fe64a800640 1 -- 172.21.15.173:0/3258354624 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe624066f90 msgr2=0x7fe624069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.963+0000 7fe64a800640 1 --2- 172.21.15.173:0/3258354624 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe624066f90 0x7fe624069450 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe6340ae000 tx=0x7fe6340a7000 comp rx=0 tx=0).stop 2024-04-25T09:02:48.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.963+0000 7fe64a800640 1 -- 172.21.15.173:0/3258354624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe64415e040 msgr2=0x7fe644140240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.963+0000 7fe64a800640 1 --2- 172.21.15.173:0/3258354624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe64415e040 0x7fe644140240 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00c730 tx=0x7fe63c00cbf0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.963+0000 7fe64a800640 1 -- 172.21.15.173:0/3258354624 shutdown_connections 2024-04-25T09:02:48.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.963+0000 7fe64a800640 1 --2- 172.21.15.173:0/3258354624 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe624066f90 0x7fe624069450 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.963+0000 7fe64a800640 1 --2- 172.21.15.173:0/3258354624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe64415e040 0x7fe644140240 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.963+0000 7fe64a800640 1 --2- 172.21.15.173:0/3258354624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe64415dc60 0x7fe64413fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.963+0000 7fe64a800640 1 --2- 172.21.15.173:0/3258354624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6440ad350 0x7fe644161850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.963+0000 7fe64a800640 1 -- 172.21.15.173:0/3258354624 >> 172.21.15.173:0/3258354624 conn(0x7fe64406ac90 msgr2=0x7fe64415f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:48.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.963+0000 7fe64a800640 1 -- 172.21.15.173:0/3258354624 shutdown_connections 2024-04-25T09:02:48.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:48.963+0000 7fe64a800640 1 -- 172.21.15.173:0/3258354624 wait complete. 2024-04-25T09:02:48.975 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:02:48.975 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:02:49.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.123+0000 7f4290a00640 1 Processor -- start 2024-04-25T09:02:49.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.123+0000 7f4290a00640 1 -- start start 2024-04-25T09:02:49.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.123+0000 7f4290a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f428c0b0d70 0x7f428c15ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:49.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.123+0000 7f4290a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f428c0ccff0 0x7f428c0cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:49.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.123+0000 7f4290a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f428c0cdaa0 con 0x7f428c0ce680 2024-04-25T09:02:49.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.123+0000 7f4290a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428c06d3d0 con 0x7f428c0ccff0 2024-04-25T09:02:49.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.123+0000 7f4290a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c06d670 con 0x7f428c0b0d70 2024-04-25T09:02:49.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.123+0000 7f4289e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f428c0ccff0 0x7f428c0cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:49.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.123+0000 7f4289e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f428c0ccff0 0x7f428c0cd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57674/0 (socket says 172.21.15.173:57674) 2024-04-25T09:02:49.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.123+0000 7f4289e00640 1 -- 172.21.15.173:0/1963987072 learned_addr learned my addr 172.21.15.173:0/1963987072 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:49.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.123+0000 7f428a800640 1 --2- 172.21.15.173:0/1963987072 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f428c0b0d70 0x7f428c15ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:49.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.123+0000 7f4289e00640 1 -- 172.21.15.173:0/1963987072 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f428c0b0d70 msgr2=0x7f428c15ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:49.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.123+0000 7f4289e00640 1 --2- 172.21.15.173:0/1963987072 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f428c0b0d70 0x7f428c15ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.123+0000 7f4289e00640 1 -- 172.21.15.173:0/1963987072 >> v1:172.21.15.194:6789/0 conn(0x7f428c0ce680 legacy=0x7f428c06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:49.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.123+0000 7f4289e00640 1 -- 172.21.15.173:0/1963987072 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c06d950 con 0x7f428c0ccff0 2024-04-25T09:02:49.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.127+0000 7f4289e00640 1 --2- 172.21.15.173:0/1963987072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f428c0ccff0 0x7f428c0cd450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4278009870 tx=0x7f427801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a8f1bff88bc85a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:49.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.127+0000 7f4289400640 1 -- 172.21.15.173:0/1963987072 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780b0070 con 0x7f428c0ccff0 2024-04-25T09:02:49.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.127+0000 7f4289400640 1 -- 172.21.15.173:0/1963987072 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42780ab600 con 0x7f428c0ccff0 2024-04-25T09:02:49.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.127+0000 7f4289400640 1 -- 172.21.15.173:0/1963987072 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780ab9d0 con 0x7f428c0ccff0 2024-04-25T09:02:49.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.127+0000 7f4290a00640 1 -- 172.21.15.173:0/1963987072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f428c0ccff0 msgr2=0x7f428c0cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:49.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.127+0000 7f4290a00640 1 --2- 172.21.15.173:0/1963987072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f428c0ccff0 0x7f428c0cd450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4278009870 tx=0x7f427801c460 comp rx=0 tx=0).stop 2024-04-25T09:02:49.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.127+0000 7f4290a00640 1 -- 172.21.15.173:0/1963987072 shutdown_connections 2024-04-25T09:02:49.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.127+0000 7f4290a00640 1 --2- 172.21.15.173:0/1963987072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f428c0ccff0 0x7f428c0cd450 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.127+0000 7f4290a00640 1 --2- 172.21.15.173:0/1963987072 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f428c0b0d70 0x7f428c15ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.127+0000 7f4290a00640 1 -- 172.21.15.173:0/1963987072 >> 172.21.15.173:0/1963987072 conn(0x7f428c061d40 msgr2=0x7f428c06ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:49.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.127+0000 7f4290a00640 1 -- 172.21.15.173:0/1963987072 shutdown_connections 2024-04-25T09:02:49.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.127+0000 7f4290a00640 1 -- 172.21.15.173:0/1963987072 wait complete. 2024-04-25T09:02:49.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f4290a00640 1 Processor -- start 2024-04-25T09:02:49.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f4290a00640 1 -- start start 2024-04-25T09:02:49.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f4290a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f428c0b0d70 0x7f428c158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:49.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f4290a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f428c0ccff0 0x7f428c071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:49.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f4290a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f428c0ce680 0x7f428c15c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:49.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f4290a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c15b1d0 con 0x7f428c0ce680 2024-04-25T09:02:49.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f4290a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c143d90 con 0x7f428c0b0d70 2024-04-25T09:02:49.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f4290a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c15b350 con 0x7f428c0ccff0 2024-04-25T09:02:49.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f428b200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f428c0ce680 0x7f428c15c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:49.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f428a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f428c0b0d70 0x7f428c158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:49.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f428b200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f428c0ce680 0x7f428c15c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57680/0 (socket says 172.21.15.173:57680) 2024-04-25T09:02:49.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f428b200640 1 -- 172.21.15.173:0/2225228282 learned_addr learned my addr 172.21.15.173:0/2225228282 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:49.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f4289e00640 1 --2- 172.21.15.173:0/2225228282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f428c0ccff0 0x7f428c071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:49.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f428b200640 1 -- 172.21.15.173:0/2225228282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f428c0ccff0 msgr2=0x7f428c071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:49.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f428b200640 1 --2- 172.21.15.173:0/2225228282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f428c0ccff0 0x7f428c071990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f428b200640 1 -- 172.21.15.173:0/2225228282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f428c0b0d70 msgr2=0x7f428c158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:49.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f428b200640 1 --2- 172.21.15.173:0/2225228282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f428c0b0d70 0x7f428c158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f428b200640 1 -- 172.21.15.173:0/2225228282 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c158760 con 0x7f428c0ce680 2024-04-25T09:02:49.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f428b200640 1 --2- 172.21.15.173:0/2225228282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f428c0ce680 0x7f428c15c8f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f428400b970 tx=0x7f428400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:49.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f4282a00640 1 -- 172.21.15.173:0/2225228282 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4284019070 con 0x7f428c0ce680 2024-04-25T09:02:49.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f4282a00640 1 -- 172.21.15.173:0/2225228282 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428400cb40 con 0x7f428c0ce680 2024-04-25T09:02:49.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f4282a00640 1 -- 172.21.15.173:0/2225228282 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4284014440 con 0x7f428c0ce680 2024-04-25T09:02:49.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f4290a00640 1 -- 172.21.15.173:0/2225228282 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428c071ed0 con 0x7f428c0ce680 2024-04-25T09:02:49.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.131+0000 7f4290a00640 1 -- 172.21.15.173:0/2225228282 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428c15b850 con 0x7f428c0ce680 2024-04-25T09:02:49.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.135+0000 7f4290a00640 1 -- 172.21.15.173:0/2225228282 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428c073a40 con 0x7f428c0ce680 2024-04-25T09:02:49.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.135+0000 7f4282a00640 1 -- 172.21.15.173:0/2225228282 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f428401c070 con 0x7f428c0ce680 2024-04-25T09:02:49.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.135+0000 7f4282a00640 1 --2- 172.21.15.173:0/2225228282 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f426c066f60 0x7f426c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:49.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.135+0000 7f4282a00640 1 -- 172.21.15.173:0/2225228282 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4284084860 con 0x7f428c0ce680 2024-04-25T09:02:49.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.135+0000 7f428a800640 1 --2- 172.21.15.173:0/2225228282 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f426c066f60 0x7f426c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:49.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.135+0000 7f428a800640 1 --2- 172.21.15.173:0/2225228282 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f426c066f60 0x7f426c069420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f427c0079c0 tx=0x7f427c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:49.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.139+0000 7f4282a00640 1 -- 172.21.15.173:0/2225228282 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4284055560 con 0x7f428c0ce680 2024-04-25T09:02:49.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.295+0000 7f4290a00640 1 -- 172.21.15.173:0/2225228282 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f428c06ba50 con 0x7f428c0ce680 2024-04-25T09:02:49.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.991+0000 7f4282a00640 1 -- 172.21.15.173:0/2225228282 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4284059600 con 0x7f428c0ce680 2024-04-25T09:02:49.983 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' created 2024-04-25T09:02:49.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.995+0000 7f4290a00640 1 -- 172.21.15.173:0/2225228282 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f426c066f60 msgr2=0x7f426c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:49.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.995+0000 7f4290a00640 1 --2- 172.21.15.173:0/2225228282 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f426c066f60 0x7f426c069420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f427c0079c0 tx=0x7f427c008040 comp rx=0 tx=0).stop 2024-04-25T09:02:49.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.995+0000 7f4290a00640 1 -- 172.21.15.173:0/2225228282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f428c0ce680 msgr2=0x7f428c15c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:49.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.995+0000 7f4290a00640 1 --2- 172.21.15.173:0/2225228282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f428c0ce680 0x7f428c15c8f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f428400b970 tx=0x7f428400be30 comp rx=0 tx=0).stop 2024-04-25T09:02:49.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.995+0000 7f4290a00640 1 -- 172.21.15.173:0/2225228282 shutdown_connections 2024-04-25T09:02:49.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.995+0000 7f4290a00640 1 --2- 172.21.15.173:0/2225228282 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f426c066f60 0x7f426c069420 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.995+0000 7f4290a00640 1 --2- 172.21.15.173:0/2225228282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f428c0ce680 0x7f428c15c8f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.995+0000 7f4290a00640 1 --2- 172.21.15.173:0/2225228282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f428c0ccff0 0x7f428c071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.995+0000 7f4290a00640 1 --2- 172.21.15.173:0/2225228282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f428c0b0d70 0x7f428c158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.995+0000 7f4290a00640 1 -- 172.21.15.173:0/2225228282 >> 172.21.15.173:0/2225228282 conn(0x7f428c061d40 msgr2=0x7f428c1637c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:49.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.995+0000 7f4290a00640 1 -- 172.21.15.173:0/2225228282 shutdown_connections 2024-04-25T09:02:49.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:49.995+0000 7f4290a00640 1 -- 172.21.15.173:0/2225228282 wait complete. 2024-04-25T09:02:50.013 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-25T09:02:50.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.163+0000 7fdea6600640 1 Processor -- start 2024-04-25T09:02:50.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.163+0000 7fdea6600640 1 -- start start 2024-04-25T09:02:50.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.167+0000 7fdea6600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdea0145290 0x7fdea015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.167+0000 7fdea6600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea00cc260 0x7fdea00cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.167+0000 7fdea6600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea015c5f0 con 0x7fdea00b3fe0 2024-04-25T09:02:50.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.167+0000 7fdea6600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea006d4b0 con 0x7fdea0145290 2024-04-25T09:02:50.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.167+0000 7fdea6600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea006d790 con 0x7fdea00cc260 2024-04-25T09:02:50.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.167+0000 7fde9ea00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fdea00b3fe0 0x7fdea00b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:37974/0 (socket says 172.21.15.173:37974) 2024-04-25T09:02:50.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.167+0000 7fde9ea00640 1 -- 172.21.15.173:0/3294248561 learned_addr learned my addr 172.21.15.173:0/3294248561 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:02:50.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.167+0000 7fde9f400640 1 --2- 172.21.15.173:0/3294248561 >> v2:172.21.15.194:3300/0 conn(0x7fdea0145290 0x7fdea015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.167+0000 7fde9fe00640 1 --2- 172.21.15.173:0/3294248561 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea00cc260 0x7fdea00cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.167+0000 7fde9e000640 1 -- 172.21.15.173:0/3294248561 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453316223 0 0) 0x7fde8c001120 con 0x7fdea00b3fe0 2024-04-25T09:02:50.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.167+0000 7fde9e000640 1 -- 172.21.15.173:0/3294248561 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde84003530 con 0x7fdea00b3fe0 2024-04-25T09:02:50.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.167+0000 7fde9fe00640 1 -- 172.21.15.173:0/3294248561 >> v2:172.21.15.194:3300/0 conn(0x7fdea0145290 msgr2=0x7fdea015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:50.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.167+0000 7fde9fe00640 1 --2- 172.21.15.173:0/3294248561 >> v2:172.21.15.194:3300/0 conn(0x7fdea0145290 0x7fdea015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.167+0000 7fde9fe00640 1 -- 172.21.15.173:0/3294248561 >> v1:172.21.15.173:6789/0 conn(0x7fdea00b3fe0 legacy=0x7fdea00b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.167+0000 7fde9fe00640 1 -- 172.21.15.173:0/3294248561 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea006da70 con 0x7fdea00cc260 2024-04-25T09:02:50.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.171+0000 7fde9fe00640 1 --2- 172.21.15.173:0/3294248561 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea00cc260 0x7fdea00cc6b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fde980097c0 tx=0x7fde9801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3170ee7f14d79e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:50.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.171+0000 7fde9e000640 1 -- 172.21.15.173:0/3294248561 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde980b0070 con 0x7fdea00cc260 2024-04-25T09:02:50.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.171+0000 7fde9e000640 1 -- 172.21.15.173:0/3294248561 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde980ab600 con 0x7fdea00cc260 2024-04-25T09:02:50.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.171+0000 7fde9e000640 1 -- 172.21.15.173:0/3294248561 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde980ab9d0 con 0x7fdea00cc260 2024-04-25T09:02:50.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.171+0000 7fdea6600640 1 -- 172.21.15.173:0/3294248561 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea00cc260 msgr2=0x7fdea00cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.171+0000 7fdea6600640 1 --2- 172.21.15.173:0/3294248561 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea00cc260 0x7fdea00cc6b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fde980097c0 tx=0x7fde9801c380 comp rx=0 tx=0).stop 2024-04-25T09:02:50.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.171+0000 7fdea6600640 1 -- 172.21.15.173:0/3294248561 shutdown_connections 2024-04-25T09:02:50.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.171+0000 7fdea6600640 1 --2- 172.21.15.173:0/3294248561 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea00cc260 0x7fdea00cc6b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.171+0000 7fdea6600640 1 --2- 172.21.15.173:0/3294248561 >> v2:172.21.15.194:3300/0 conn(0x7fdea0145290 0x7fdea015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.171+0000 7fdea6600640 1 -- 172.21.15.173:0/3294248561 >> 172.21.15.173:0/3294248561 conn(0x7fdea006ac90 msgr2=0x7fdea006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:50.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.171+0000 7fdea6600640 1 -- 172.21.15.173:0/3294248561 shutdown_connections 2024-04-25T09:02:50.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.171+0000 7fdea6600640 1 -- 172.21.15.173:0/3294248561 wait complete. 2024-04-25T09:02:50.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.171+0000 7fdea6600640 1 Processor -- start 2024-04-25T09:02:50.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.171+0000 7fdea6600640 1 -- start start 2024-04-25T09:02:50.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.171+0000 7fdea6600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdea00b3fe0 0x7fdea00ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fdea6600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdea00cc260 0x7fdea015b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fdea6600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea0145290 0x7fdea00b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fdea6600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea006eee0 con 0x7fdea00cc260 2024-04-25T09:02:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fdea6600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea006ed60 con 0x7fdea00b3fe0 2024-04-25T09:02:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fdea6600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea006f060 con 0x7fdea0145290 2024-04-25T09:02:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fde9ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdea00cc260 0x7fdea015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fde9f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdea00b3fe0 0x7fdea00ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fde9ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdea00cc260 0x7fdea015b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57690/0 (socket says 172.21.15.173:57690) 2024-04-25T09:02:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fde9ea00640 1 -- 172.21.15.173:0/505183543 learned_addr learned my addr 172.21.15.173:0/505183543 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fde9fe00640 1 --2- 172.21.15.173:0/505183543 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea0145290 0x7fdea00b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fde9ea00640 1 -- 172.21.15.173:0/505183543 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea0145290 msgr2=0x7fdea00b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fde9ea00640 1 --2- 172.21.15.173:0/505183543 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea0145290 0x7fdea00b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fde9ea00640 1 -- 172.21.15.173:0/505183543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdea00b3fe0 msgr2=0x7fdea00ad960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fde9ea00640 1 --2- 172.21.15.173:0/505183543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdea00b3fe0 0x7fdea00ad960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fde9ea00640 1 -- 172.21.15.173:0/505183543 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea00ac8c0 con 0x7fdea00cc260 2024-04-25T09:02:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fde9fe00640 1 --2- 172.21.15.173:0/505183543 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea0145290 0x7fdea00b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fde9ea00640 1 --2- 172.21.15.173:0/505183543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdea00cc260 0x7fdea015b340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00c3c0 tx=0x7fde8c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fde97400640 1 -- 172.21.15.173:0/505183543 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c017070 con 0x7fdea00cc260 2024-04-25T09:02:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fde97400640 1 -- 172.21.15.173:0/505183543 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c005cf0 con 0x7fdea00cc260 2024-04-25T09:02:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fdea6600640 1 -- 172.21.15.173:0/505183543 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea00acba0 con 0x7fdea00cc260 2024-04-25T09:02:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fde97400640 1 -- 172.21.15.173:0/505183543 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c007310 con 0x7fdea00cc260 2024-04-25T09:02:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fdea6600640 1 -- 172.21.15.173:0/505183543 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea00ad160 con 0x7fdea00cc260 2024-04-25T09:02:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fdea6600640 1 -- 172.21.15.173:0/505183543 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea0073ab0 con 0x7fdea00cc260 2024-04-25T09:02:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.175+0000 7fde97400640 1 -- 172.21.15.173:0/505183543 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fde8c01a070 con 0x7fdea00cc260 2024-04-25T09:02:50.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.179+0000 7fde97400640 1 --2- 172.21.15.173:0/505183543 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde80066f60 0x7fde80069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.179+0000 7fde97400640 1 -- 172.21.15.173:0/505183543 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fde8c0841a0 con 0x7fdea00cc260 2024-04-25T09:02:50.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.179+0000 7fde9f400640 1 --2- 172.21.15.173:0/505183543 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde80066f60 0x7fde80069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.179+0000 7fde9f400640 1 --2- 172.21.15.173:0/505183543 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde80066f60 0x7fde80069420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fde90011340 tx=0x7fde9000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:50.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.183+0000 7fde97400640 1 -- 172.21.15.173:0/505183543 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdea015c5f0 con 0x7fdea00cc260 2024-04-25T09:02:50.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.339+0000 7fdea6600640 1 -- 172.21.15.173:0/505183543 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fdea006b310 con 0x7fdea00cc260 2024-04-25T09:02:50.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.995+0000 7fde97400640 1 -- 172.21.15.173:0/505183543 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7fde8c054d30 con 0x7fdea00cc260 2024-04-25T09:02:50.989 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' created 2024-04-25T09:02:50.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.999+0000 7fdea6600640 1 -- 172.21.15.173:0/505183543 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde80066f60 msgr2=0x7fde80069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.999+0000 7fdea6600640 1 --2- 172.21.15.173:0/505183543 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde80066f60 0x7fde80069420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fde90011340 tx=0x7fde9000b040 comp rx=0 tx=0).stop 2024-04-25T09:02:50.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.999+0000 7fdea6600640 1 -- 172.21.15.173:0/505183543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdea00cc260 msgr2=0x7fdea015b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:50.999+0000 7fdea6600640 1 --2- 172.21.15.173:0/505183543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdea00cc260 0x7fdea015b340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00c3c0 tx=0x7fde8c00c880 comp rx=0 tx=0).stop 2024-04-25T09:02:50.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.003+0000 7fdea6600640 1 -- 172.21.15.173:0/505183543 shutdown_connections 2024-04-25T09:02:50.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.003+0000 7fdea6600640 1 --2- 172.21.15.173:0/505183543 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde80066f60 0x7fde80069420 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.003+0000 7fdea6600640 1 --2- 172.21.15.173:0/505183543 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea0145290 0x7fdea00b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.003+0000 7fdea6600640 1 --2- 172.21.15.173:0/505183543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdea00cc260 0x7fdea015b340 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.003+0000 7fdea6600640 1 --2- 172.21.15.173:0/505183543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdea00b3fe0 0x7fdea00ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.003+0000 7fdea6600640 1 -- 172.21.15.173:0/505183543 >> 172.21.15.173:0/505183543 conn(0x7fdea006ac90 msgr2=0x7fdea00cede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:50.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.003+0000 7fdea6600640 1 -- 172.21.15.173:0/505183543 shutdown_connections 2024-04-25T09:02:50.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.003+0000 7fdea6600640 1 -- 172.21.15.173:0/505183543 wait complete. 2024-04-25T09:02:51.030 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:02:51.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f35c00640 1 Processor -- start 2024-04-25T09:02:51.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f35c00640 1 -- start start 2024-04-25T09:02:51.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f35c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f300b3fe0 0x7f4f300b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f35c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4f300cc260 0x7f4f300cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f35c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3006d4b0 con 0x7f4f30145290 2024-04-25T09:02:51.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f35c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3006d790 con 0x7f4f300cc260 2024-04-25T09:02:51.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f35c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3006da70 con 0x7f4f300b3fe0 2024-04-25T09:02:51.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f2e000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f300b3fe0 0x7f4f300b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f2f400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4f300cc260 0x7f4f300cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f2ea00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f4f30145290 0x7f4f3015c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:35864/0 (socket says 172.21.15.173:35864) 2024-04-25T09:02:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f2e000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f300b3fe0 0x7f4f300b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:57878/0 (socket says 172.21.15.173:57878) 2024-04-25T09:02:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f2ea00640 1 -- 172.21.15.173:0/2567948355 learned_addr learned my addr 172.21.15.173:0/2567948355 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:02:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f2d600640 1 -- 172.21.15.173:0/2567948355 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3140607444 0 0) 0x7f4f3006d4b0 con 0x7f4f30145290 2024-04-25T09:02:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f2d600640 1 -- 172.21.15.173:0/2567948355 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f14003530 con 0x7f4f30145290 2024-04-25T09:02:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f2e000640 1 -- 172.21.15.173:0/2567948355 >> v2:172.21.15.194:3300/0 conn(0x7f4f300cc260 msgr2=0x7f4f300cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f2e000640 1 --2- 172.21.15.173:0/2567948355 >> v2:172.21.15.194:3300/0 conn(0x7f4f300cc260 0x7f4f300cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f2e000640 1 -- 172.21.15.173:0/2567948355 >> v1:172.21.15.194:6789/0 conn(0x7f4f30145290 legacy=0x7f4f3015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f2e000640 1 -- 172.21.15.173:0/2567948355 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3006dd50 con 0x7f4f300b3fe0 2024-04-25T09:02:51.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.179+0000 7f4f2f400640 1 --2- 172.21.15.173:0/2567948355 >> v2:172.21.15.194:3300/0 conn(0x7f4f300cc260 0x7f4f300cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:51.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.183+0000 7f4f2e000640 1 --2- 172.21.15.173:0/2567948355 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f300b3fe0 0x7f4f300b4420 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0097c0 tx=0x7f4f1c01c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfa48ef73abd1de0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:51.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.183+0000 7f4f2d600640 1 -- 172.21.15.173:0/2567948355 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0b0070 con 0x7f4f300b3fe0 2024-04-25T09:02:51.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.183+0000 7f4f2d600640 1 -- 172.21.15.173:0/2567948355 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1c0ab600 con 0x7f4f300b3fe0 2024-04-25T09:02:51.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.183+0000 7f4f2d600640 1 -- 172.21.15.173:0/2567948355 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0ab9d0 con 0x7f4f300b3fe0 2024-04-25T09:02:51.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.183+0000 7f4f35c00640 1 -- 172.21.15.173:0/2567948355 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f300b3fe0 msgr2=0x7f4f300b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.183+0000 7f4f35c00640 1 --2- 172.21.15.173:0/2567948355 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f300b3fe0 0x7f4f300b4420 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0097c0 tx=0x7f4f1c01c380 comp rx=0 tx=0).stop 2024-04-25T09:02:51.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.183+0000 7f4f35c00640 1 -- 172.21.15.173:0/2567948355 shutdown_connections 2024-04-25T09:02:51.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.183+0000 7f4f35c00640 1 --2- 172.21.15.173:0/2567948355 >> v2:172.21.15.194:3300/0 conn(0x7f4f300cc260 0x7f4f300cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.183+0000 7f4f35c00640 1 --2- 172.21.15.173:0/2567948355 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f300b3fe0 0x7f4f300b4420 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.183+0000 7f4f35c00640 1 -- 172.21.15.173:0/2567948355 >> 172.21.15.173:0/2567948355 conn(0x7f4f3006ac90 msgr2=0x7f4f3006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:51.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.183+0000 7f4f35c00640 1 -- 172.21.15.173:0/2567948355 shutdown_connections 2024-04-25T09:02:51.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.183+0000 7f4f35c00640 1 -- 172.21.15.173:0/2567948355 wait complete. 2024-04-25T09:02:51.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.183+0000 7f4f35c00640 1 Processor -- start 2024-04-25T09:02:51.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f35c00640 1 -- start start 2024-04-25T09:02:51.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f35c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f300b3fe0 0x7f4f300ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f35c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f300cc260 0x7f4f300cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f35c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f30145290 0x7f4f3015b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f35c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3006ed60 con 0x7f4f300b3fe0 2024-04-25T09:02:51.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f35c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3006eee0 con 0x7f4f300cc260 2024-04-25T09:02:51.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f35c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3006f060 con 0x7f4f30145290 2024-04-25T09:02:51.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f2ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f300b3fe0 0x7f4f300ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f2ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f300b3fe0 0x7f4f300ad2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57698/0 (socket says 172.21.15.173:57698) 2024-04-25T09:02:51.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f2ea00640 1 -- 172.21.15.173:0/3921091970 learned_addr learned my addr 172.21.15.173:0/3921091970 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:51.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f2e000640 1 --2- 172.21.15.173:0/3921091970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f300cc260 0x7f4f300cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f2f400640 1 --2- 172.21.15.173:0/3921091970 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f30145290 0x7f4f3015b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f2ea00640 1 -- 172.21.15.173:0/3921091970 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f30145290 msgr2=0x7f4f3015b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f2ea00640 1 --2- 172.21.15.173:0/3921091970 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f30145290 0x7f4f3015b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f2ea00640 1 -- 172.21.15.173:0/3921091970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f300cc260 msgr2=0x7f4f300cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f2ea00640 1 --2- 172.21.15.173:0/3921091970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f300cc260 0x7f4f300cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f2ea00640 1 -- 172.21.15.173:0/3921091970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f300ad9d0 con 0x7f4f300b3fe0 2024-04-25T09:02:51.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f2e000640 1 --2- 172.21.15.173:0/3921091970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f300cc260 0x7f4f300cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:51.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f2ea00640 1 --2- 172.21.15.173:0/3921091970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f300b3fe0 0x7f4f300ad2a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000c450 tx=0x7f4f2000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:51.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f26a00640 1 -- 172.21.15.173:0/3921091970 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20017070 con 0x7f4f300b3fe0 2024-04-25T09:02:51.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f26a00640 1 -- 172.21.15.173:0/3921091970 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f20005cf0 con 0x7f4f300b3fe0 2024-04-25T09:02:51.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f26a00640 1 -- 172.21.15.173:0/3921091970 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f200072f0 con 0x7f4f300b3fe0 2024-04-25T09:02:51.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f35c00640 1 -- 172.21.15.173:0/3921091970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f300adcb0 con 0x7f4f300b3fe0 2024-04-25T09:02:51.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f35c00640 1 -- 172.21.15.173:0/3921091970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3015b910 con 0x7f4f300b3fe0 2024-04-25T09:02:51.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.187+0000 7f4f35c00640 1 -- 172.21.15.173:0/3921091970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f301f6800 con 0x7f4f300b3fe0 2024-04-25T09:02:51.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.191+0000 7f4f26a00640 1 -- 172.21.15.173:0/3921091970 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4f2001a070 con 0x7f4f300b3fe0 2024-04-25T09:02:51.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.191+0000 7f4f26a00640 1 --2- 172.21.15.173:0/3921091970 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4f10066f60 0x7f4f10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.191+0000 7f4f26a00640 1 -- 172.21.15.173:0/3921091970 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f4f200842d0 con 0x7f4f300b3fe0 2024-04-25T09:02:51.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.191+0000 7f4f2e000640 1 --2- 172.21.15.173:0/3921091970 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4f10066f60 0x7f4f10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.191+0000 7f4f2e000640 1 --2- 172.21.15.173:0/3921091970 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4f10066f60 0x7f4f10069420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0ad000 tx=0x7f4f1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:51.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.195+0000 7f4f26a00640 1 -- 172.21.15.173:0/3921091970 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4f20054d80 con 0x7f4f300b3fe0 2024-04-25T09:02:51.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.383+0000 7f4f35c00640 1 -- 172.21.15.173:0/3921091970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4f30073ab0 con 0x7f4f300b3fe0 2024-04-25T09:02:51.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:51.999+0000 7f4f26a00640 1 -- 172.21.15.173:0/3921091970 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4f2005b0d0 con 0x7f4f300b3fe0 2024-04-25T09:02:51.992 INFO:teuthology.orchestra.run.smithi173.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T09:02:51.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.003+0000 7f4f35c00640 1 -- 172.21.15.173:0/3921091970 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4f10066f60 msgr2=0x7f4f10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.003+0000 7f4f35c00640 1 --2- 172.21.15.173:0/3921091970 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4f10066f60 0x7f4f10069420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0ad000 tx=0x7f4f1c008040 comp rx=0 tx=0).stop 2024-04-25T09:02:51.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.003+0000 7f4f35c00640 1 -- 172.21.15.173:0/3921091970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f300b3fe0 msgr2=0x7f4f300ad2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.003+0000 7f4f35c00640 1 --2- 172.21.15.173:0/3921091970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f300b3fe0 0x7f4f300ad2a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000c450 tx=0x7f4f2000c850 comp rx=0 tx=0).stop 2024-04-25T09:02:51.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.003+0000 7f4f35c00640 1 -- 172.21.15.173:0/3921091970 shutdown_connections 2024-04-25T09:02:51.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.003+0000 7f4f35c00640 1 --2- 172.21.15.173:0/3921091970 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4f10066f60 0x7f4f10069420 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.003+0000 7f4f35c00640 1 --2- 172.21.15.173:0/3921091970 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f30145290 0x7f4f3015b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.003+0000 7f4f35c00640 1 --2- 172.21.15.173:0/3921091970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f300cc260 0x7f4f300cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.003+0000 7f4f35c00640 1 --2- 172.21.15.173:0/3921091970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f300b3fe0 0x7f4f300ad2a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.003+0000 7f4f35c00640 1 -- 172.21.15.173:0/3921091970 >> 172.21.15.173:0/3921091970 conn(0x7f4f3006ac90 msgr2=0x7f4f3015da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:51.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.007+0000 7f4f35c00640 1 -- 172.21.15.173:0/3921091970 shutdown_connections 2024-04-25T09:02:51.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.007+0000 7f4f35c00640 1 -- 172.21.15.173:0/3921091970 wait complete. 2024-04-25T09:02:52.046 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-25T09:02:52.047 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-25T09:02:52.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.199+0000 7fc81d800640 1 Processor -- start 2024-04-25T09:02:52.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.199+0000 7fc81d800640 1 -- start start 2024-04-25T09:02:52.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.199+0000 7fc81d800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc8180cc260 0x7fc8180cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.199+0000 7fc81d800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81806d4b0 con 0x7fc818145290 2024-04-25T09:02:52.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.199+0000 7fc81d800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81806d790 con 0x7fc8180b3fe0 2024-04-25T09:02:52.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.199+0000 7fc81d800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81806da70 con 0x7fc8180cc260 2024-04-25T09:02:52.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.199+0000 7fc816a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc818145290 0x7fc81815c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:37986/0 (socket says 172.21.15.173:37986) 2024-04-25T09:02:52.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.199+0000 7fc816a00640 1 -- 172.21.15.173:0/207860597 learned_addr learned my addr 172.21.15.173:0/207860597 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:02:52.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.199+0000 7fc817400640 1 --2- 172.21.15.173:0/207860597 >> v2:172.21.15.194:3300/0 conn(0x7fc8180cc260 0x7fc8180cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.199+0000 7fc815600640 1 -- 172.21.15.173:0/207860597 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3140335424 0 0) 0x7fc81806d4b0 con 0x7fc818145290 2024-04-25T09:02:52.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.199+0000 7fc815600640 1 -- 172.21.15.173:0/207860597 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7fc003530 con 0x7fc818145290 2024-04-25T09:02:52.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.199+0000 7fc817400640 1 -- 172.21.15.173:0/207860597 >> v1:172.21.15.194:6789/0 conn(0x7fc8180b3fe0 legacy=0x7fc8180b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.199+0000 7fc815600640 1 -- 172.21.15.173:0/207860597 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4145156379 0 0) 0x7fc7fc003530 con 0x7fc818145290 2024-04-25T09:02:52.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.199+0000 7fc817400640 1 -- 172.21.15.173:0/207860597 >> v1:172.21.15.173:6789/0 conn(0x7fc818145290 legacy=0x7fc81815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.199+0000 7fc817400640 1 -- 172.21.15.173:0/207860597 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81806dd50 con 0x7fc8180cc260 2024-04-25T09:02:52.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.203+0000 7fc817400640 1 --2- 172.21.15.173:0/207860597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8180cc260 0x7fc8180cc670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc810009d90 tx=0x7fc81001c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97a366f2f2ec8254 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:52.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.203+0000 7fc815600640 1 -- 172.21.15.173:0/207860597 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8080016a0 con 0x7fc8180cc260 2024-04-25T09:02:52.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.203+0000 7fc815600640 1 -- 172.21.15.173:0/207860597 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8100a64d0 con 0x7fc8180cc260 2024-04-25T09:02:52.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.203+0000 7fc815600640 1 -- 172.21.15.173:0/207860597 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8100a68a0 con 0x7fc8180cc260 2024-04-25T09:02:52.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.203+0000 7fc81d800640 1 -- 172.21.15.173:0/207860597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8180cc260 msgr2=0x7fc8180cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.203+0000 7fc81d800640 1 --2- 172.21.15.173:0/207860597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8180cc260 0x7fc8180cc670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc810009d90 tx=0x7fc81001c770 comp rx=0 tx=0).stop 2024-04-25T09:02:52.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.203+0000 7fc81d800640 1 -- 172.21.15.173:0/207860597 shutdown_connections 2024-04-25T09:02:52.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.203+0000 7fc81d800640 1 --2- 172.21.15.173:0/207860597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8180cc260 0x7fc8180cc670 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.203+0000 7fc81d800640 1 -- 172.21.15.173:0/207860597 >> 172.21.15.173:0/207860597 conn(0x7fc81806ac90 msgr2=0x7fc81806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:52.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.203+0000 7fc81d800640 1 -- 172.21.15.173:0/207860597 shutdown_connections 2024-04-25T09:02:52.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.203+0000 7fc81d800640 1 -- 172.21.15.173:0/207860597 wait complete. 2024-04-25T09:02:52.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc81d800640 1 Processor -- start 2024-04-25T09:02:52.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc81d800640 1 -- start start 2024-04-25T09:02:52.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc81d800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8180b3fe0 0x7fc81813d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc81d800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8180cc260 0x7fc818141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc81d800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc818145290 0x7fc81815b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc81d800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81806f1b0 con 0x7fc818145290 2024-04-25T09:02:52.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc81d800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81806f030 con 0x7fc8180b3fe0 2024-04-25T09:02:52.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc81d800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc818141fe0 con 0x7fc8180cc260 2024-04-25T09:02:52.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc817400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc818145290 0x7fc81815b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc817400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc818145290 0x7fc81815b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57704/0 (socket says 172.21.15.173:57704) 2024-04-25T09:02:52.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc817400640 1 -- 172.21.15.173:0/3462241081 learned_addr learned my addr 172.21.15.173:0/3462241081 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:52.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc816a00640 1 --2- 172.21.15.173:0/3462241081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8180b3fe0 0x7fc81813d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc816000640 1 --2- 172.21.15.173:0/3462241081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8180cc260 0x7fc818141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc817400640 1 -- 172.21.15.173:0/3462241081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8180cc260 msgr2=0x7fc818141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc817400640 1 --2- 172.21.15.173:0/3462241081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8180cc260 0x7fc818141280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc817400640 1 -- 172.21.15.173:0/3462241081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8180b3fe0 msgr2=0x7fc81813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc817400640 1 --2- 172.21.15.173:0/3462241081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8180b3fe0 0x7fc81813d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc817400640 1 -- 172.21.15.173:0/3462241081 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc818141d00 con 0x7fc818145290 2024-04-25T09:02:52.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc817400640 1 --2- 172.21.15.173:0/3462241081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc818145290 0x7fc81815b020 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc8100b0040 tx=0x7fc810019510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:52.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc80ea00640 1 -- 172.21.15.173:0/3462241081 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8100a6e60 con 0x7fc818145290 2024-04-25T09:02:52.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc80ea00640 1 -- 172.21.15.173:0/3462241081 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc810003bc0 con 0x7fc818145290 2024-04-25T09:02:52.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc80ea00640 1 -- 172.21.15.173:0/3462241081 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810009450 con 0x7fc818145290 2024-04-25T09:02:52.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc81d800640 1 -- 172.21.15.173:0/3462241081 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8180cd420 con 0x7fc818145290 2024-04-25T09:02:52.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc81d800640 1 -- 172.21.15.173:0/3462241081 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8180cb950 con 0x7fc818145290 2024-04-25T09:02:52.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.207+0000 7fc81d800640 1 -- 172.21.15.173:0/3462241081 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc818073ab0 con 0x7fc818145290 2024-04-25T09:02:52.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.211+0000 7fc80ea00640 1 -- 172.21.15.173:0/3462241081 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc8100b8640 con 0x7fc818145290 2024-04-25T09:02:52.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.211+0000 7fc80ea00640 1 --2- 172.21.15.173:0/3462241081 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc7f8066f60 0x7fc7f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.211+0000 7fc80ea00640 1 -- 172.21.15.173:0/3462241081 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc810120120 con 0x7fc818145290 2024-04-25T09:02:52.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.211+0000 7fc816a00640 1 --2- 172.21.15.173:0/3462241081 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc7f8066f60 0x7fc7f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.211+0000 7fc816a00640 1 --2- 172.21.15.173:0/3462241081 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc7f8066f60 0x7fc7f8069420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc808000fc0 tx=0x7fc808001e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:52.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.215+0000 7fc80ea00640 1 -- 172.21.15.173:0/3462241081 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc8100c7030 con 0x7fc818145290 2024-04-25T09:02:52.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:52.379+0000 7fc81d800640 1 -- 172.21.15.173:0/3462241081 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fc818140ee0 con 0x7fc818145290 2024-04-25T09:02:52.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.003+0000 7fc80ea00640 1 -- 172.21.15.173:0/3462241081 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7fc8100be020 con 0x7fc818145290 2024-04-25T09:02:52.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.003+0000 7fc81d800640 1 -- 172.21.15.173:0/3462241081 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc7f8066f60 msgr2=0x7fc7f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.003+0000 7fc81d800640 1 --2- 172.21.15.173:0/3462241081 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc7f8066f60 0x7fc7f8069420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc808000fc0 tx=0x7fc808001e30 comp rx=0 tx=0).stop 2024-04-25T09:02:52.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.003+0000 7fc81d800640 1 -- 172.21.15.173:0/3462241081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc818145290 msgr2=0x7fc81815b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.003+0000 7fc81d800640 1 --2- 172.21.15.173:0/3462241081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc818145290 0x7fc81815b020 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc8100b0040 tx=0x7fc810019510 comp rx=0 tx=0).stop 2024-04-25T09:02:52.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.003+0000 7fc81d800640 1 -- 172.21.15.173:0/3462241081 shutdown_connections 2024-04-25T09:02:52.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.003+0000 7fc81d800640 1 --2- 172.21.15.173:0/3462241081 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc7f8066f60 0x7fc7f8069420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.003+0000 7fc81d800640 1 --2- 172.21.15.173:0/3462241081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc818145290 0x7fc81815b020 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.003+0000 7fc81d800640 1 --2- 172.21.15.173:0/3462241081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8180cc260 0x7fc818141280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.003+0000 7fc81d800640 1 --2- 172.21.15.173:0/3462241081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8180b3fe0 0x7fc81813d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.003+0000 7fc81d800640 1 -- 172.21.15.173:0/3462241081 >> 172.21.15.173:0/3462241081 conn(0x7fc81806ac90 msgr2=0x7fc81815cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:52.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.003+0000 7fc81d800640 1 -- 172.21.15.173:0/3462241081 shutdown_connections 2024-04-25T09:02:52.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.003+0000 7fc81d800640 1 -- 172.21.15.173:0/3462241081 wait complete. 2024-04-25T09:02:53.019 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:02:53.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.171+0000 7f059ee00640 1 Processor -- start 2024-04-25T09:02:53.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.171+0000 7f059ee00640 1 -- start start 2024-04-25T09:02:53.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.171+0000 7f059ee00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f059815d030 0x7f059806ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:53.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.171+0000 7f059ee00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f059806b1d0 0x7f059815c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:53.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.171+0000 7f059ee00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059815d4c0 con 0x7f05980aff70 2024-04-25T09:02:53.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.171+0000 7f059ee00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05980cbc10 con 0x7f059815d030 2024-04-25T09:02:53.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.171+0000 7f059ee00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059806b5e0 con 0x7f059806b1d0 2024-04-25T09:02:53.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.171+0000 7f0597400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f059815d030 0x7f059806ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:53.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.171+0000 7f0597400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f059815d030 0x7f059806ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57714/0 (socket says 172.21.15.173:57714) 2024-04-25T09:02:53.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.171+0000 7f0597400640 1 -- 172.21.15.173:0/992623333 learned_addr learned my addr 172.21.15.173:0/992623333 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:53.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.171+0000 7f059ce00640 1 --2- 172.21.15.173:0/992623333 >> v2:172.21.15.194:3300/0 conn(0x7f059806b1d0 0x7f059815c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:53.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.171+0000 7f0597400640 1 -- 172.21.15.173:0/992623333 >> v2:172.21.15.194:3300/0 conn(0x7f059806b1d0 msgr2=0x7f059815c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:53.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.171+0000 7f0597400640 1 --2- 172.21.15.173:0/992623333 >> v2:172.21.15.194:3300/0 conn(0x7f059806b1d0 0x7f059815c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.171+0000 7f0597400640 1 -- 172.21.15.173:0/992623333 >> v1:172.21.15.194:6789/0 conn(0x7f05980aff70 legacy=0x7f0598072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:53.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.171+0000 7f0597400640 1 -- 172.21.15.173:0/992623333 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05980cd380 con 0x7f059815d030 2024-04-25T09:02:53.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.175+0000 7f0597400640 1 --2- 172.21.15.173:0/992623333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f059815d030 0x7f059806ac90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05980724b0 tx=0x7f058401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f25ea3f280b567 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:53.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.175+0000 7f0596a00640 1 -- 172.21.15.173:0/992623333 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840aa610 con 0x7f059815d030 2024-04-25T09:02:53.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.175+0000 7f0596a00640 1 -- 172.21.15.173:0/992623333 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05840af070 con 0x7f059815d030 2024-04-25T09:02:53.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.175+0000 7f0596a00640 1 -- 172.21.15.173:0/992623333 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840aa9d0 con 0x7f059815d030 2024-04-25T09:02:53.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.175+0000 7f059ee00640 1 -- 172.21.15.173:0/992623333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f059815d030 msgr2=0x7f059806ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:53.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.175+0000 7f059ee00640 1 --2- 172.21.15.173:0/992623333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f059815d030 0x7f059806ac90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05980724b0 tx=0x7f058401c4b0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.175+0000 7f059ee00640 1 -- 172.21.15.173:0/992623333 shutdown_connections 2024-04-25T09:02:53.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.175+0000 7f059ee00640 1 --2- 172.21.15.173:0/992623333 >> v2:172.21.15.194:3300/0 conn(0x7f059806b1d0 0x7f059815c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.175+0000 7f059ee00640 1 --2- 172.21.15.173:0/992623333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f059815d030 0x7f059806ac90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.175+0000 7f059ee00640 1 -- 172.21.15.173:0/992623333 >> 172.21.15.173:0/992623333 conn(0x7f05980b23f0 msgr2=0x7f05980b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:53.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.175+0000 7f059ee00640 1 -- 172.21.15.173:0/992623333 shutdown_connections 2024-04-25T09:02:53.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.175+0000 7f059ee00640 1 -- 172.21.15.173:0/992623333 wait complete. 2024-04-25T09:02:53.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f059ee00640 1 Processor -- start 2024-04-25T09:02:53.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f059ee00640 1 -- start start 2024-04-25T09:02:53.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f059ee00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f059806b1d0 0x7f0598147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:53.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f059ee00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f059815d030 0x7f05981471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:53.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f059ee00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0598149470 0x7f059814e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:53.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f059ee00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05980cd030 con 0x7f059806b1d0 2024-04-25T09:02:53.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f059ee00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05980cdf00 con 0x7f0598149470 2024-04-25T09:02:53.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f059ee00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0598073140 con 0x7f059815d030 2024-04-25T09:02:53.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f0597e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f059806b1d0 0x7f0598147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:53.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f0597e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f059806b1d0 0x7f0598147ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57716/0 (socket says 172.21.15.173:57716) 2024-04-25T09:02:53.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f0597e00640 1 -- 172.21.15.173:0/3327149801 learned_addr learned my addr 172.21.15.173:0/3327149801 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f059ce00640 1 --2- 172.21.15.173:0/3327149801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0598149470 0x7f059814e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f0597400640 1 --2- 172.21.15.173:0/3327149801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f059815d030 0x7f05981471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f0597e00640 1 -- 172.21.15.173:0/3327149801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f059815d030 msgr2=0x7f05981471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f0597e00640 1 --2- 172.21.15.173:0/3327149801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f059815d030 0x7f05981471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f0597e00640 1 -- 172.21.15.173:0/3327149801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0598149470 msgr2=0x7f059814e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f0597e00640 1 --2- 172.21.15.173:0/3327149801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0598149470 0x7f059814e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f0597e00640 1 -- 172.21.15.173:0/3327149801 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05981483d0 con 0x7f059806b1d0 2024-04-25T09:02:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f0597e00640 1 --2- 172.21.15.173:0/3327149801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f059806b1d0 0x7f0598147ba0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f058800c7f0 tx=0x7f058800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f058fe00640 1 -- 172.21.15.173:0/3327149801 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588016020 con 0x7f059806b1d0 2024-04-25T09:02:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f058fe00640 1 -- 172.21.15.173:0/3327149801 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058800aa50 con 0x7f059806b1d0 2024-04-25T09:02:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f058fe00640 1 -- 172.21.15.173:0/3327149801 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058800ae40 con 0x7f059806b1d0 2024-04-25T09:02:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f059ee00640 1 -- 172.21.15.173:0/3327149801 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05981486b0 con 0x7f059806b1d0 2024-04-25T09:02:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.179+0000 7f059ee00640 1 -- 172.21.15.173:0/3327149801 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0598148c70 con 0x7f059806b1d0 2024-04-25T09:02:53.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.183+0000 7f059ee00640 1 -- 172.21.15.173:0/3327149801 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0598073ab0 con 0x7f059806b1d0 2024-04-25T09:02:53.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.183+0000 7f058fe00640 1 -- 172.21.15.173:0/3327149801 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0588019020 con 0x7f059806b1d0 2024-04-25T09:02:53.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.183+0000 7f058fe00640 1 --2- 172.21.15.173:0/3327149801 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0578066f60 0x7f0578069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:53.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.183+0000 7f058fe00640 1 -- 172.21.15.173:0/3327149801 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6007+0+0 (secure 0 0 0) 0x7f0588085050 con 0x7f059806b1d0 2024-04-25T09:02:53.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.187+0000 7f0597400640 1 --2- 172.21.15.173:0/3327149801 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0578066f60 0x7f0578069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:53.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.187+0000 7f0597400640 1 --2- 172.21.15.173:0/3327149801 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0578066f60 0x7f0578069420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f05840ae000 tx=0x7f05840a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:53.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.187+0000 7f058fe00640 1 -- 172.21.15.173:0/3327149801 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0588020030 con 0x7f059806b1d0 2024-04-25T09:02:53.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:53.347+0000 7f059ee00640 1 -- 172.21.15.173:0/3327149801 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0598072db0 con 0x7f059806b1d0 2024-04-25T09:02:55.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.031+0000 7f058fe00640 1 -- 172.21.15.173:0/3327149801 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7f05880558d0 con 0x7f059806b1d0 2024-04-25T09:02:55.024 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data_ec' created 2024-04-25T09:02:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.035+0000 7f059ee00640 1 -- 172.21.15.173:0/3327149801 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0578066f60 msgr2=0x7f0578069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.035+0000 7f059ee00640 1 --2- 172.21.15.173:0/3327149801 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0578066f60 0x7f0578069420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f05840ae000 tx=0x7f05840a7000 comp rx=0 tx=0).stop 2024-04-25T09:02:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.035+0000 7f059ee00640 1 -- 172.21.15.173:0/3327149801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f059806b1d0 msgr2=0x7f0598147ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.035+0000 7f059ee00640 1 --2- 172.21.15.173:0/3327149801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f059806b1d0 0x7f0598147ba0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f058800c7f0 tx=0x7f058800ccb0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.035+0000 7f059ee00640 1 -- 172.21.15.173:0/3327149801 shutdown_connections 2024-04-25T09:02:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.035+0000 7f059ee00640 1 --2- 172.21.15.173:0/3327149801 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0578066f60 0x7f0578069420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.035+0000 7f059ee00640 1 --2- 172.21.15.173:0/3327149801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0598149470 0x7f059814e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.035+0000 7f059ee00640 1 --2- 172.21.15.173:0/3327149801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f059815d030 0x7f05981471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.035+0000 7f059ee00640 1 --2- 172.21.15.173:0/3327149801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f059806b1d0 0x7f0598147ba0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.035+0000 7f059ee00640 1 -- 172.21.15.173:0/3327149801 >> 172.21.15.173:0/3327149801 conn(0x7f05980b23f0 msgr2=0x7f059815d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.039+0000 7f059ee00640 1 -- 172.21.15.173:0/3327149801 shutdown_connections 2024-04-25T09:02:55.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.039+0000 7f059ee00640 1 -- 172.21.15.173:0/3327149801 wait complete. 2024-04-25T09:02:55.060 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-25T09:02:55.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.211+0000 7f971de00640 1 Processor -- start 2024-04-25T09:02:55.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.211+0000 7f971de00640 1 -- start start 2024-04-25T09:02:55.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.211+0000 7f971de00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9718145290 0x7f971815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.211+0000 7f971de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f97180b3fe0 0x7f97180b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.211+0000 7f971de00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971815c5f0 con 0x7f97180cc260 2024-04-25T09:02:55.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.211+0000 7f971de00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97180ccd80 con 0x7f9718145290 2024-04-25T09:02:55.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.211+0000 7f971de00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971806d4b0 con 0x7f97180b3fe0 2024-04-25T09:02:55.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.211+0000 7f9716a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9718145290 0x7f971815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.211+0000 7f9716a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9718145290 0x7f971815c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35780/0 (socket says 172.21.15.173:35780) 2024-04-25T09:02:55.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.211+0000 7f9716a00640 1 -- 172.21.15.173:0/1914726279 learned_addr learned my addr 172.21.15.173:0/1914726279 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:55.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.215+0000 7f9716000640 1 --2- 172.21.15.173:0/1914726279 >> v2:172.21.15.194:3300/0 conn(0x7f97180b3fe0 0x7f97180b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.215+0000 7f9716a00640 1 -- 172.21.15.173:0/1914726279 >> v2:172.21.15.194:3300/0 conn(0x7f97180b3fe0 msgr2=0x7f97180b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:55.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.215+0000 7f9716a00640 1 --2- 172.21.15.173:0/1914726279 >> v2:172.21.15.194:3300/0 conn(0x7f97180b3fe0 0x7f97180b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.215+0000 7f9716a00640 1 -- 172.21.15.173:0/1914726279 >> v1:172.21.15.194:6789/0 conn(0x7f97180cc260 legacy=0x7f97180cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:55.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.215+0000 7f9716a00640 1 -- 172.21.15.173:0/1914726279 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971806d790 con 0x7f9718145290 2024-04-25T09:02:55.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.215+0000 7f9716000640 1 --2- 172.21.15.173:0/1914726279 >> v2:172.21.15.194:3300/0 conn(0x7f97180b3fe0 0x7f97180b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:55.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.215+0000 7f9716a00640 1 --2- 172.21.15.173:0/1914726279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9718145290 0x7f971815c0b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9718071100 tx=0x7f970801c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadbc1f2b7c8da3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:55.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.215+0000 7f9715600640 1 -- 172.21.15.173:0/1914726279 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97080ac020 con 0x7f9718145290 2024-04-25T09:02:55.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.215+0000 7f9715600640 1 -- 172.21.15.173:0/1914726279 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97080a6490 con 0x7f9718145290 2024-04-25T09:02:55.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.215+0000 7f9715600640 1 -- 172.21.15.173:0/1914726279 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97080a6860 con 0x7f9718145290 2024-04-25T09:02:55.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.215+0000 7f971de00640 1 -- 172.21.15.173:0/1914726279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9718145290 msgr2=0x7f971815c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.215+0000 7f971de00640 1 --2- 172.21.15.173:0/1914726279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9718145290 0x7f971815c0b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9718071100 tx=0x7f970801c6b0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.215+0000 7f971de00640 1 -- 172.21.15.173:0/1914726279 shutdown_connections 2024-04-25T09:02:55.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.215+0000 7f971de00640 1 --2- 172.21.15.173:0/1914726279 >> v2:172.21.15.194:3300/0 conn(0x7f97180b3fe0 0x7f97180b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.215+0000 7f971de00640 1 --2- 172.21.15.173:0/1914726279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9718145290 0x7f971815c0b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.215+0000 7f971de00640 1 -- 172.21.15.173:0/1914726279 >> 172.21.15.173:0/1914726279 conn(0x7f971806ac90 msgr2=0x7f971806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:55.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f971de00640 1 -- 172.21.15.173:0/1914726279 shutdown_connections 2024-04-25T09:02:55.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f971de00640 1 -- 172.21.15.173:0/1914726279 wait complete. 2024-04-25T09:02:55.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f971de00640 1 Processor -- start 2024-04-25T09:02:55.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f971de00640 1 -- start start 2024-04-25T09:02:55.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f971de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97180b3fe0 0x7f9718136d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f971de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97180cc260 0x7f971813c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f971de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9718145290 0x7f971813ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f971de00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97181457f0 con 0x7f9718145290 2024-04-25T09:02:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f971de00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9718145670 con 0x7f97180b3fe0 2024-04-25T09:02:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f971de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971806ed60 con 0x7f97180cc260 2024-04-25T09:02:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f9717400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9718145290 0x7f971813ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f9717400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9718145290 0x7f971813ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35786/0 (socket says 172.21.15.173:35786) 2024-04-25T09:02:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f9717400640 1 -- 172.21.15.173:0/2583149565 learned_addr learned my addr 172.21.15.173:0/2583149565 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f9716a00640 1 --2- 172.21.15.173:0/2583149565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97180b3fe0 0x7f9718136d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f9716000640 1 --2- 172.21.15.173:0/2583149565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97180cc260 0x7f971813c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f9717400640 1 -- 172.21.15.173:0/2583149565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97180cc260 msgr2=0x7f971813c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f9717400640 1 --2- 172.21.15.173:0/2583149565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97180cc260 0x7f971813c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f9717400640 1 -- 172.21.15.173:0/2583149565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97180b3fe0 msgr2=0x7f9718136d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f9717400640 1 --2- 172.21.15.173:0/2583149565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97180b3fe0 0x7f9718136d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f9717400640 1 -- 172.21.15.173:0/2583149565 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9718137260 con 0x7f9718145290 2024-04-25T09:02:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f9717400640 1 --2- 172.21.15.173:0/2583149565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9718145290 0x7f971813ce20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f971000c440 tx=0x7f971000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f970f400640 1 -- 172.21.15.173:0/2583149565 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710017070 con 0x7f9718145290 2024-04-25T09:02:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f970f400640 1 -- 172.21.15.173:0/2583149565 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9710003600 con 0x7f9718145290 2024-04-25T09:02:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.219+0000 7f970f400640 1 -- 172.21.15.173:0/2583149565 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97100039f0 con 0x7f9718145290 2024-04-25T09:02:55.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.223+0000 7f971de00640 1 -- 172.21.15.173:0/2583149565 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971813eeb0 con 0x7f9718145290 2024-04-25T09:02:55.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.223+0000 7f971de00640 1 -- 172.21.15.173:0/2583149565 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971813f470 con 0x7f9718145290 2024-04-25T09:02:55.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.223+0000 7f971de00640 1 -- 172.21.15.173:0/2583149565 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9718073ab0 con 0x7f9718145290 2024-04-25T09:02:55.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.223+0000 7f970f400640 1 -- 172.21.15.173:0/2583149565 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9710003b90 con 0x7f9718145290 2024-04-25T09:02:55.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.223+0000 7f970f400640 1 --2- 172.21.15.173:0/2583149565 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f96f8066f60 0x7f96f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.223+0000 7f970f400640 1 -- 172.21.15.173:0/2583149565 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f97100845b0 con 0x7f9718145290 2024-04-25T09:02:55.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.223+0000 7f9716a00640 1 --2- 172.21.15.173:0/2583149565 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f96f8066f60 0x7f96f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.223+0000 7f9716a00640 1 --2- 172.21.15.173:0/2583149565 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f96f8066f60 0x7f96f8069420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f97080ad000 tx=0x7f97080b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:55.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.227+0000 7f970f400640 1 -- 172.21.15.173:0/2583149565 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9710054c40 con 0x7f9718145290 2024-04-25T09:02:55.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:55.379+0000 7f971de00640 1 -- 172.21.15.173:0/2583149565 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f971813e860 con 0x7f9718145290 2024-04-25T09:02:55.685 INFO:tasks.ceph.mds.d.smithi194.stderr:2024-04-25T09:02:55.693+0000 7fbdb4200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:02:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.035+0000 7f970f400640 1 -- 172.21.15.173:0/2583149565 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9710058ce0 con 0x7f9718145290 2024-04-25T09:02:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:set pool 4 allow_ec_overwrites to true 2024-04-25T09:02:56.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.039+0000 7f971de00640 1 -- 172.21.15.173:0/2583149565 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f96f8066f60 msgr2=0x7f96f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:56.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.039+0000 7f971de00640 1 --2- 172.21.15.173:0/2583149565 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f96f8066f60 0x7f96f8069420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f97080ad000 tx=0x7f97080b3040 comp rx=0 tx=0).stop 2024-04-25T09:02:56.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.039+0000 7f971de00640 1 -- 172.21.15.173:0/2583149565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9718145290 msgr2=0x7f971813ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:56.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.039+0000 7f971de00640 1 --2- 172.21.15.173:0/2583149565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9718145290 0x7f971813ce20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f971000c440 tx=0x7f971000c900 comp rx=0 tx=0).stop 2024-04-25T09:02:56.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.039+0000 7f971de00640 1 -- 172.21.15.173:0/2583149565 shutdown_connections 2024-04-25T09:02:56.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.039+0000 7f971de00640 1 --2- 172.21.15.173:0/2583149565 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f96f8066f60 0x7f96f8069420 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.039+0000 7f971de00640 1 --2- 172.21.15.173:0/2583149565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9718145290 0x7f971813ce20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.039+0000 7f971de00640 1 --2- 172.21.15.173:0/2583149565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97180cc260 0x7f971813c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.039+0000 7f971de00640 1 --2- 172.21.15.173:0/2583149565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97180b3fe0 0x7f9718136d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.039+0000 7f971de00640 1 -- 172.21.15.173:0/2583149565 >> 172.21.15.173:0/2583149565 conn(0x7f971806ac90 msgr2=0x7f9718141820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:56.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.043+0000 7f971de00640 1 -- 172.21.15.173:0/2583149565 shutdown_connections 2024-04-25T09:02:56.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.047+0000 7f971de00640 1 -- 172.21.15.173:0/2583149565 wait complete. 2024-04-25T09:02:56.077 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-25T09:02:56.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.223+0000 7f95a0600640 1 Processor -- start 2024-04-25T09:02:56.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.223+0000 7f95a0600640 1 -- start start 2024-04-25T09:02:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.223+0000 7f95a0600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9598145290 0x7f959815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.223+0000 7f95a0600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95980cc260 0x7f95980cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.223+0000 7f95a0600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959815c5f0 con 0x7f95980b3fe0 2024-04-25T09:02:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.223+0000 7f95a0600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959806d4b0 con 0x7f9598145290 2024-04-25T09:02:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.223+0000 7f95a0600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959806d790 con 0x7f95980cc260 2024-04-25T09:02:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.223+0000 7f959d200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f95980b3fe0 0x7f95980b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:55964/0 (socket says 172.21.15.173:55964) 2024-04-25T09:02:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.223+0000 7f959d200640 1 -- 172.21.15.173:0/146692957 learned_addr learned my addr 172.21.15.173:0/146692957 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:02:56.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.227+0000 7f959e600640 1 --2- 172.21.15.173:0/146692957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95980cc260 0x7f95980cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:56.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.227+0000 7f959dc00640 1 --2- 172.21.15.173:0/146692957 >> v2:172.21.15.194:3300/0 conn(0x7f9598145290 0x7f959815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:56.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.227+0000 7f9597e00640 1 -- 172.21.15.173:0/146692957 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221345083 0 0) 0x7f9584001120 con 0x7f95980b3fe0 2024-04-25T09:02:56.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.227+0000 7f9597e00640 1 -- 172.21.15.173:0/146692957 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9580003530 con 0x7f95980b3fe0 2024-04-25T09:02:56.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.227+0000 7f959e600640 1 -- 172.21.15.173:0/146692957 >> v2:172.21.15.194:3300/0 conn(0x7f9598145290 msgr2=0x7f959815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:56.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.227+0000 7f959e600640 1 --2- 172.21.15.173:0/146692957 >> v2:172.21.15.194:3300/0 conn(0x7f9598145290 0x7f959815c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.227+0000 7f959e600640 1 -- 172.21.15.173:0/146692957 >> v1:172.21.15.173:6789/0 conn(0x7f95980b3fe0 legacy=0x7f95980b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:56.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.227+0000 7f959e600640 1 -- 172.21.15.173:0/146692957 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959806da70 con 0x7f95980cc260 2024-04-25T09:02:56.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.227+0000 7f959e600640 1 --2- 172.21.15.173:0/146692957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95980cc260 0x7f95980cc6b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9590009d90 tx=0x7f959001c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=576e137619c86263 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:56.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.227+0000 7f9597e00640 1 -- 172.21.15.173:0/146692957 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95900b2070 con 0x7f95980cc260 2024-04-25T09:02:56.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.227+0000 7f9597e00640 1 -- 172.21.15.173:0/146692957 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95900a5820 con 0x7f95980cc260 2024-04-25T09:02:56.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.227+0000 7f9597e00640 1 -- 172.21.15.173:0/146692957 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95900a5bd0 con 0x7f95980cc260 2024-04-25T09:02:56.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f95a0600640 1 -- 172.21.15.173:0/146692957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95980cc260 msgr2=0x7f95980cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f95a0600640 1 --2- 172.21.15.173:0/146692957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95980cc260 0x7f95980cc6b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9590009d90 tx=0x7f959001c850 comp rx=0 tx=0).stop 2024-04-25T09:02:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f95a0600640 1 -- 172.21.15.173:0/146692957 shutdown_connections 2024-04-25T09:02:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f95a0600640 1 --2- 172.21.15.173:0/146692957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95980cc260 0x7f95980cc6b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f95a0600640 1 --2- 172.21.15.173:0/146692957 >> v2:172.21.15.194:3300/0 conn(0x7f9598145290 0x7f959815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f95a0600640 1 -- 172.21.15.173:0/146692957 >> 172.21.15.173:0/146692957 conn(0x7f959806ac90 msgr2=0x7f959806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f95a0600640 1 -- 172.21.15.173:0/146692957 shutdown_connections 2024-04-25T09:02:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f95a0600640 1 -- 172.21.15.173:0/146692957 wait complete. 2024-04-25T09:02:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f95a0600640 1 Processor -- start 2024-04-25T09:02:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f95a0600640 1 -- start start 2024-04-25T09:02:56.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f95a0600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95980b3fe0 0x7f959813fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:56.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f95a0600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95980cc260 0x7f959813eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:56.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f95a0600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9598145290 0x7f959813f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:56.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f95a0600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959806eee0 con 0x7f95980cc260 2024-04-25T09:02:56.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f95a0600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959806ed60 con 0x7f95980b3fe0 2024-04-25T09:02:56.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f95a0600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959806f060 con 0x7f9598145290 2024-04-25T09:02:56.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f959d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95980cc260 0x7f959813eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:56.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f959d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95980cc260 0x7f959813eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35790/0 (socket says 172.21.15.173:35790) 2024-04-25T09:02:56.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f959d200640 1 -- 172.21.15.173:0/1966976683 learned_addr learned my addr 172.21.15.173:0/1966976683 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:56.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f959dc00640 1 --2- 172.21.15.173:0/1966976683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95980b3fe0 0x7f959813fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:56.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f959e600640 1 --2- 172.21.15.173:0/1966976683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9598145290 0x7f959813f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:56.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f959d200640 1 -- 172.21.15.173:0/1966976683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9598145290 msgr2=0x7f959813f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:56.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f959d200640 1 --2- 172.21.15.173:0/1966976683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9598145290 0x7f959813f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f959d200640 1 -- 172.21.15.173:0/1966976683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95980b3fe0 msgr2=0x7f959813fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:56.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f959d200640 1 --2- 172.21.15.173:0/1966976683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95980b3fe0 0x7f959813fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:56.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.231+0000 7f959d200640 1 -- 172.21.15.173:0/1966976683 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95980b0970 con 0x7f95980cc260 2024-04-25T09:02:56.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.235+0000 7f959d200640 1 --2- 172.21.15.173:0/1966976683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95980cc260 0x7f959813eda0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f958400c3c0 tx=0x7f958400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:56.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.235+0000 7f9595600640 1 -- 172.21.15.173:0/1966976683 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584017070 con 0x7f95980cc260 2024-04-25T09:02:56.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.235+0000 7f9595600640 1 -- 172.21.15.173:0/1966976683 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9584005cf0 con 0x7f95980cc260 2024-04-25T09:02:56.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.235+0000 7f9595600640 1 -- 172.21.15.173:0/1966976683 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584007310 con 0x7f95980cc260 2024-04-25T09:02:56.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.235+0000 7f95a0600640 1 -- 172.21.15.173:0/1966976683 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9598140870 con 0x7f95980cc260 2024-04-25T09:02:56.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.235+0000 7f95a0600640 1 -- 172.21.15.173:0/1966976683 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9598140e30 con 0x7f95980cc260 2024-04-25T09:02:56.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.235+0000 7f95a0600640 1 -- 172.21.15.173:0/1966976683 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9598073ab0 con 0x7f95980cc260 2024-04-25T09:02:56.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.235+0000 7f9595600640 1 -- 172.21.15.173:0/1966976683 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f958401a070 con 0x7f95980cc260 2024-04-25T09:02:56.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.235+0000 7f9595600640 1 --2- 172.21.15.173:0/1966976683 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9578066f60 0x7f9578069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:56.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.235+0000 7f9595600640 1 -- 172.21.15.173:0/1966976683 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f9584084700 con 0x7f95980cc260 2024-04-25T09:02:56.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.235+0000 7f959dc00640 1 --2- 172.21.15.173:0/1966976683 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9578066f60 0x7f9578069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:56.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.239+0000 7f959dc00640 1 --2- 172.21.15.173:0/1966976683 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9578066f60 0x7f9578069420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f958c009ac0 tx=0x7f958c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:56.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.239+0000 7f9595600640 1 -- 172.21.15.173:0/1966976683 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f959815c5f0 con 0x7f95980cc260 2024-04-25T09:02:56.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:56.435+0000 7f95a0600640 1 -- 172.21.15.173:0/1966976683 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f9598144110 con 0x7f95980cc260 2024-04-25T09:02:57.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.055+0000 7f9595600640 1 -- 172.21.15.173:0/1966976683 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f9584054d00 con 0x7f95980cc260 2024-04-25T09:02:57.047 INFO:teuthology.orchestra.run.smithi173.stderr:added data pool 4 to fsmap 2024-04-25T09:02:57.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.059+0000 7f95a0600640 1 -- 172.21.15.173:0/1966976683 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9578066f60 msgr2=0x7f9578069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.059+0000 7f95a0600640 1 --2- 172.21.15.173:0/1966976683 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9578066f60 0x7f9578069420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f958c009ac0 tx=0x7f958c009190 comp rx=0 tx=0).stop 2024-04-25T09:02:57.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.059+0000 7f95a0600640 1 -- 172.21.15.173:0/1966976683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95980cc260 msgr2=0x7f959813eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.059+0000 7f95a0600640 1 --2- 172.21.15.173:0/1966976683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95980cc260 0x7f959813eda0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f958400c3c0 tx=0x7f958400c880 comp rx=0 tx=0).stop 2024-04-25T09:02:57.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.059+0000 7f95a0600640 1 -- 172.21.15.173:0/1966976683 shutdown_connections 2024-04-25T09:02:57.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.059+0000 7f95a0600640 1 --2- 172.21.15.173:0/1966976683 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9578066f60 0x7f9578069420 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.059+0000 7f95a0600640 1 --2- 172.21.15.173:0/1966976683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9598145290 0x7f959813f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.059+0000 7f95a0600640 1 --2- 172.21.15.173:0/1966976683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95980cc260 0x7f959813eda0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.059+0000 7f95a0600640 1 --2- 172.21.15.173:0/1966976683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95980b3fe0 0x7f959813fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.059+0000 7f95a0600640 1 -- 172.21.15.173:0/1966976683 >> 172.21.15.173:0/1966976683 conn(0x7f959806ac90 msgr2=0x7f95980b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:57.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.059+0000 7f95a0600640 1 -- 172.21.15.173:0/1966976683 shutdown_connections 2024-04-25T09:02:57.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.059+0000 7f95a0600640 1 -- 172.21.15.173:0/1966976683 wait complete. 2024-04-25T09:02:57.070 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:57.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.215+0000 7fa491a00640 1 Processor -- start 2024-04-25T09:02:57.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.215+0000 7fa491a00640 1 -- start start 2024-04-25T09:02:57.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.215+0000 7fa491a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa48c145250 0x7fa48c15c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.215+0000 7fa491a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa48c0ccd30 0x7fa48c071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.215+0000 7fa491a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48c15cec0 con 0x7fa48c0cc8b0 2024-04-25T09:02:57.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.215+0000 7fa491a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48c06e7c0 con 0x7fa48c145250 2024-04-25T09:02:57.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.215+0000 7fa491a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c06d720 con 0x7fa48c0ccd30 2024-04-25T09:02:57.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.215+0000 7fa48aa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa48c145250 0x7fa48c15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.215+0000 7fa483e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa48c0cc8b0 0x7fa48c071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:55976/0 (socket says 172.21.15.173:55976) 2024-04-25T09:02:57.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.215+0000 7fa483e00640 1 -- 172.21.15.173:0/3814263218 learned_addr learned my addr 172.21.15.173:0/3814263218 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:02:57.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.215+0000 7fa48b400640 1 --2- 172.21.15.173:0/3814263218 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa48c0ccd30 0x7fa48c071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.215+0000 7fa48a000640 1 -- 172.21.15.173:0/3814263218 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839290869 0 0) 0x7fa474001120 con 0x7fa48c0cc8b0 2024-04-25T09:02:57.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.215+0000 7fa48a000640 1 -- 172.21.15.173:0/3814263218 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa470003530 con 0x7fa48c0cc8b0 2024-04-25T09:02:57.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.215+0000 7fa48aa00640 1 -- 172.21.15.173:0/3814263218 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa48c0ccd30 msgr2=0x7fa48c071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:57.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.215+0000 7fa48aa00640 1 --2- 172.21.15.173:0/3814263218 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa48c0ccd30 0x7fa48c071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.215+0000 7fa48aa00640 1 -- 172.21.15.173:0/3814263218 >> v1:172.21.15.173:6789/0 conn(0x7fa48c0cc8b0 legacy=0x7fa48c071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.215+0000 7fa48aa00640 1 -- 172.21.15.173:0/3814263218 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c06da00 con 0x7fa48c145250 2024-04-25T09:02:57.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.219+0000 7fa48aa00640 1 --2- 172.21.15.173:0/3814263218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa48c145250 0x7fa48c15c980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0097c0 tx=0x7fa47c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a2455f9e69af10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.219+0000 7fa48a000640 1 -- 172.21.15.173:0/3814263218 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0a7070 con 0x7fa48c145250 2024-04-25T09:02:57.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.219+0000 7fa48a000640 1 -- 172.21.15.173:0/3814263218 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c0b0070 con 0x7fa48c145250 2024-04-25T09:02:57.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.219+0000 7fa48a000640 1 -- 172.21.15.173:0/3814263218 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0ab870 con 0x7fa48c145250 2024-04-25T09:02:57.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.219+0000 7fa491a00640 1 -- 172.21.15.173:0/3814263218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa48c145250 msgr2=0x7fa48c15c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.219+0000 7fa491a00640 1 --2- 172.21.15.173:0/3814263218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa48c145250 0x7fa48c15c980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0097c0 tx=0x7fa47c01c470 comp rx=0 tx=0).stop 2024-04-25T09:02:57.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.219+0000 7fa491a00640 1 -- 172.21.15.173:0/3814263218 shutdown_connections 2024-04-25T09:02:57.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.219+0000 7fa491a00640 1 --2- 172.21.15.173:0/3814263218 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa48c0ccd30 0x7fa48c071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.219+0000 7fa491a00640 1 --2- 172.21.15.173:0/3814263218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa48c145250 0x7fa48c15c980 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.219+0000 7fa491a00640 1 -- 172.21.15.173:0/3814263218 >> 172.21.15.173:0/3814263218 conn(0x7fa48c06ac90 msgr2=0x7fa48c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:57.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.219+0000 7fa491a00640 1 -- 172.21.15.173:0/3814263218 shutdown_connections 2024-04-25T09:02:57.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.219+0000 7fa491a00640 1 -- 172.21.15.173:0/3814263218 wait complete. 2024-04-25T09:02:57.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa491a00640 1 Processor -- start 2024-04-25T09:02:57.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa491a00640 1 -- start start 2024-04-25T09:02:57.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa491a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa48c0cc8b0 0x7fa48c1f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa491a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa48c0ccd30 0x7fa48c1f6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa491a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa48c145250 0x7fa48c13a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa491a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c06ef80 con 0x7fa48c145250 2024-04-25T09:02:57.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa491a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c145630 con 0x7fa48c0cc8b0 2024-04-25T09:02:57.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa491a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c0cd140 con 0x7fa48c0ccd30 2024-04-25T09:02:57.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa48b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa48c145250 0x7fa48c13a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa48b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa48c145250 0x7fa48c13a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35798/0 (socket says 172.21.15.173:35798) 2024-04-25T09:02:57.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa48b400640 1 -- 172.21.15.173:0/3342066423 learned_addr learned my addr 172.21.15.173:0/3342066423 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:57.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa48aa00640 1 --2- 172.21.15.173:0/3342066423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa48c0cc8b0 0x7fa48c1f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa483e00640 1 --2- 172.21.15.173:0/3342066423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa48c0ccd30 0x7fa48c1f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa48b400640 1 -- 172.21.15.173:0/3342066423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa48c0ccd30 msgr2=0x7fa48c1f6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa48b400640 1 --2- 172.21.15.173:0/3342066423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa48c0ccd30 0x7fa48c1f6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa48b400640 1 -- 172.21.15.173:0/3342066423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa48c0cc8b0 msgr2=0x7fa48c1f3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa48b400640 1 --2- 172.21.15.173:0/3342066423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa48c0cc8b0 0x7fa48c1f3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa48b400640 1 -- 172.21.15.173:0/3342066423 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c1f4510 con 0x7fa48c145250 2024-04-25T09:02:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa483e00640 1 --2- 172.21.15.173:0/3342066423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa48c0ccd30 0x7fa48c1f6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa48b400640 1 --2- 172.21.15.173:0/3342066423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa48c145250 0x7fa48c13a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa484007e40 tx=0x7fa48400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa482a00640 1 -- 172.21.15.173:0/3342066423 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa484014620 con 0x7fa48c145250 2024-04-25T09:02:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa482a00640 1 -- 172.21.15.173:0/3342066423 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa484019070 con 0x7fa48c145250 2024-04-25T09:02:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa482a00640 1 -- 172.21.15.173:0/3342066423 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa484014a20 con 0x7fa48c145250 2024-04-25T09:02:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa491a00640 1 -- 172.21.15.173:0/3342066423 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48c139a80 con 0x7fa48c145250 2024-04-25T09:02:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa491a00640 1 -- 172.21.15.173:0/3342066423 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48c13a040 con 0x7fa48c145250 2024-04-25T09:02:57.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.223+0000 7fa491a00640 1 -- 172.21.15.173:0/3342066423 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48c073a40 con 0x7fa48c145250 2024-04-25T09:02:57.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.227+0000 7fa482a00640 1 -- 172.21.15.173:0/3342066423 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa484014bc0 con 0x7fa48c145250 2024-04-25T09:02:57.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.227+0000 7fa482a00640 1 --2- 172.21.15.173:0/3342066423 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa468066f60 0x7fa468069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.227+0000 7fa482a00640 1 -- 172.21.15.173:0/3342066423 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa484085c00 con 0x7fa48c145250 2024-04-25T09:02:57.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.227+0000 7fa48aa00640 1 --2- 172.21.15.173:0/3342066423 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa468066f60 0x7fa468069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.227+0000 7fa48aa00640 1 --2- 172.21.15.173:0/3342066423 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa468066f60 0x7fa468069420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0af000 tx=0x7fa47c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.231+0000 7fa482a00640 1 -- 172.21.15.173:0/3342066423 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa484056830 con 0x7fa48c145250 2024-04-25T09:02:57.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.415+0000 7fa491a00640 1 -- 172.21.15.173:0/3342066423 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa48c15c9e0 con 0x7fa48c145250 2024-04-25T09:02:57.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.415+0000 7fa482a00640 1 -- 172.21.15.173:0/3342066423 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4946 (secure 0 0 0) 0x7fa484056130 con 0x7fa48c145250 2024-04-25T09:02:57.409 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:02:57.409 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2883565303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2883565303},{"type":"v1","addr":"172.21.15.194:6834","nonce":2883565303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2634963400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2634963400},{"type":"v1","addr":"172.21.15.173:6837","nonce":2634963400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3101502434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3101502434},{"type":"v1","addr":"172.21.15.173:6836","nonce":3101502434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:51.389514+0000","modified":"2024-04-25T09:02:56.440807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/4160663138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4160663138},{"type":"v1","addr":"172.21.15.194:6835","nonce":4160663138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-25T09:02:57.409 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 7 2024-04-25T09:02:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.419+0000 7fa491a00640 1 -- 172.21.15.173:0/3342066423 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa468066f60 msgr2=0x7fa468069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.419+0000 7fa491a00640 1 --2- 172.21.15.173:0/3342066423 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa468066f60 0x7fa468069420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0af000 tx=0x7fa47c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:02:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.419+0000 7fa491a00640 1 -- 172.21.15.173:0/3342066423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa48c145250 msgr2=0x7fa48c13a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.419+0000 7fa491a00640 1 --2- 172.21.15.173:0/3342066423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa48c145250 0x7fa48c13a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa484007e40 tx=0x7fa48400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.419+0000 7fa491a00640 1 -- 172.21.15.173:0/3342066423 shutdown_connections 2024-04-25T09:02:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.419+0000 7fa491a00640 1 --2- 172.21.15.173:0/3342066423 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa468066f60 0x7fa468069420 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.419+0000 7fa491a00640 1 --2- 172.21.15.173:0/3342066423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa48c145250 0x7fa48c13a840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.419+0000 7fa491a00640 1 --2- 172.21.15.173:0/3342066423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa48c0ccd30 0x7fa48c1f6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.419+0000 7fa491a00640 1 --2- 172.21.15.173:0/3342066423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa48c0cc8b0 0x7fa48c1f3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.419+0000 7fa491a00640 1 -- 172.21.15.173:0/3342066423 >> 172.21.15.173:0/3342066423 conn(0x7fa48c06ac90 msgr2=0x7fa48c15d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.419+0000 7fa491a00640 1 -- 172.21.15.173:0/3342066423 shutdown_connections 2024-04-25T09:02:57.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.419+0000 7fa491a00640 1 -- 172.21.15.173:0/3342066423 wait complete. 2024-04-25T09:02:57.429 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:57.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.571+0000 7fd50ba00640 1 Processor -- start 2024-04-25T09:02:57.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.571+0000 7fd50ba00640 1 -- start start 2024-04-25T09:02:57.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.575+0000 7fd50ba00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd50406dac0 0x7fd5040ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.575+0000 7fd50ba00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd50406bca0 0x7fd50406c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.575+0000 7fd50ba00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd504061d60 con 0x7fd504160fe0 2024-04-25T09:02:57.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.575+0000 7fd50ba00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5041613c0 con 0x7fd50406bca0 2024-04-25T09:02:57.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.575+0000 7fd50ba00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd50406dfa0 con 0x7fd50406dac0 2024-04-25T09:02:57.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.575+0000 7fd509a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd50406bca0 0x7fd50406c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.575+0000 7fd509000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd504160fe0 0x7fd504161fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:55980/0 (socket says 172.21.15.173:55980) 2024-04-25T09:02:57.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.575+0000 7fd509000640 1 -- 172.21.15.173:0/666989623 learned_addr learned my addr 172.21.15.173:0/666989623 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:02:57.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.575+0000 7fd509a00640 1 -- 172.21.15.173:0/666989623 >> v2:172.21.15.194:3300/0 conn(0x7fd50406dac0 msgr2=0x7fd5040ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:57.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.575+0000 7fd503e00640 1 --2- 172.21.15.173:0/666989623 >> v2:172.21.15.194:3300/0 conn(0x7fd50406dac0 0x7fd5040ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.575+0000 7fd503400640 1 -- 172.21.15.173:0/666989623 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324832157 0 0) 0x7fd4f4001120 con 0x7fd504160fe0 2024-04-25T09:02:57.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.575+0000 7fd509a00640 1 --2- 172.21.15.173:0/666989623 >> v2:172.21.15.194:3300/0 conn(0x7fd50406dac0 0x7fd5040ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.575+0000 7fd509a00640 1 -- 172.21.15.173:0/666989623 >> v1:172.21.15.173:6789/0 conn(0x7fd504160fe0 legacy=0x7fd504161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.575+0000 7fd509a00640 1 -- 172.21.15.173:0/666989623 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50406e280 con 0x7fd50406bca0 2024-04-25T09:02:57.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.575+0000 7fd503e00640 1 --2- 172.21.15.173:0/666989623 >> v2:172.21.15.194:3300/0 conn(0x7fd50406dac0 0x7fd5040ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:57.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd509a00640 1 --2- 172.21.15.173:0/666989623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd50406bca0 0x7fd50406c130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd5040b52f0 tx=0x7fd4fc01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15650506e0f2bdd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd503400640 1 -- 172.21.15.173:0/666989623 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc0b2070 con 0x7fd50406bca0 2024-04-25T09:02:57.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd503400640 1 -- 172.21.15.173:0/666989623 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4fc0a5850 con 0x7fd50406bca0 2024-04-25T09:02:57.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd503400640 1 -- 172.21.15.173:0/666989623 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc0a5c20 con 0x7fd50406bca0 2024-04-25T09:02:57.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd50ba00640 1 -- 172.21.15.173:0/666989623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd50406bca0 msgr2=0x7fd50406c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd50ba00640 1 --2- 172.21.15.173:0/666989623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd50406bca0 0x7fd50406c130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd5040b52f0 tx=0x7fd4fc01c8a0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd50ba00640 1 -- 172.21.15.173:0/666989623 shutdown_connections 2024-04-25T09:02:57.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd50ba00640 1 --2- 172.21.15.173:0/666989623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd50406bca0 0x7fd50406c130 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd50ba00640 1 --2- 172.21.15.173:0/666989623 >> v2:172.21.15.194:3300/0 conn(0x7fd50406dac0 0x7fd5040ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd50ba00640 1 -- 172.21.15.173:0/666989623 >> 172.21.15.173:0/666989623 conn(0x7fd504071c20 msgr2=0x7fd504072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:57.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd50ba00640 1 -- 172.21.15.173:0/666989623 shutdown_connections 2024-04-25T09:02:57.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd50ba00640 1 -- 172.21.15.173:0/666989623 wait complete. 2024-04-25T09:02:57.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd50ba00640 1 Processor -- start 2024-04-25T09:02:57.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd50ba00640 1 -- start start 2024-04-25T09:02:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd50ba00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd50406bca0 0x7fd504152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd50ba00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd50406dac0 0x7fd50413b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd50ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd504160fe0 0x7fd504154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd50ba00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5040ad4c0 con 0x7fd50406dac0 2024-04-25T09:02:57.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd50ba00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5040ad340 con 0x7fd50406bca0 2024-04-25T09:02:57.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.579+0000 7fd50ba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50406f850 con 0x7fd504160fe0 2024-04-25T09:02:57.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.583+0000 7fd503e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd50406dac0 0x7fd50413b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.583+0000 7fd503e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd50406dac0 0x7fd50413b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35810/0 (socket says 172.21.15.173:35810) 2024-04-25T09:02:57.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.583+0000 7fd503e00640 1 -- 172.21.15.173:0/1451699381 learned_addr learned my addr 172.21.15.173:0/1451699381 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:57.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.583+0000 7fd509000640 1 --2- 172.21.15.173:0/1451699381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd50406bca0 0x7fd504152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.583+0000 7fd509a00640 1 --2- 172.21.15.173:0/1451699381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd504160fe0 0x7fd504154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.583+0000 7fd503e00640 1 -- 172.21.15.173:0/1451699381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd504160fe0 msgr2=0x7fd504154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.583+0000 7fd503e00640 1 --2- 172.21.15.173:0/1451699381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd504160fe0 0x7fd504154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.583+0000 7fd503e00640 1 -- 172.21.15.173:0/1451699381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd50406bca0 msgr2=0x7fd504152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.583+0000 7fd503e00640 1 --2- 172.21.15.173:0/1451699381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd50406bca0 0x7fd504152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.583+0000 7fd503e00640 1 -- 172.21.15.173:0/1451699381 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd504152810 con 0x7fd50406dac0 2024-04-25T09:02:57.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.583+0000 7fd503e00640 1 --2- 172.21.15.173:0/1451699381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd50406dac0 0x7fd50413b6d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd4f000c7f0 tx=0x7fd4f000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.583+0000 7fd500c00640 1 -- 172.21.15.173:0/1451699381 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0007a30 con 0x7fd50406dac0 2024-04-25T09:02:57.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.583+0000 7fd500c00640 1 -- 172.21.15.173:0/1451699381 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f0007bd0 con 0x7fd50406dac0 2024-04-25T09:02:57.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.583+0000 7fd500c00640 1 -- 172.21.15.173:0/1451699381 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f00113f0 con 0x7fd50406dac0 2024-04-25T09:02:57.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.583+0000 7fd50ba00640 1 -- 172.21.15.173:0/1451699381 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd504152af0 con 0x7fd50406dac0 2024-04-25T09:02:57.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.583+0000 7fd50ba00640 1 -- 172.21.15.173:0/1451699381 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5041530b0 con 0x7fd50406dac0 2024-04-25T09:02:57.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.583+0000 7fd50ba00640 1 -- 172.21.15.173:0/1451699381 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd504073a40 con 0x7fd50406dac0 2024-04-25T09:02:57.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.583+0000 7fd500c00640 1 -- 172.21.15.173:0/1451699381 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd4f0011590 con 0x7fd50406dac0 2024-04-25T09:02:57.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.587+0000 7fd500c00640 1 --2- 172.21.15.173:0/1451699381 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd4e4066f60 0x7fd4e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.587+0000 7fd500c00640 1 -- 172.21.15.173:0/1451699381 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd4f0085560 con 0x7fd50406dac0 2024-04-25T09:02:57.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.587+0000 7fd509000640 1 --2- 172.21.15.173:0/1451699381 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd4e4066f60 0x7fd4e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.587+0000 7fd509000640 1 --2- 172.21.15.173:0/1451699381 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd4e4066f60 0x7fd4e4069420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4000f70 tx=0x7fd4f4007df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.591+0000 7fd500c00640 1 -- 172.21.15.173:0/1451699381 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd4f0015020 con 0x7fd50406dac0 2024-04-25T09:02:57.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.743+0000 7fd50ba00640 1 -- 172.21.15.173:0/1451699381 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5040cf6c0 con 0x7fd50406dac0 2024-04-25T09:02:57.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.747+0000 7fd500c00640 1 -- 172.21.15.173:0/1451699381 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18574 (secure 0 0 0) 0x7fd4f0055b40 con 0x7fd50406dac0 2024-04-25T09:02:57.738 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:02:57.738 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:56.440593+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:57.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.747+0000 7fd50ba00640 1 -- 172.21.15.173:0/1451699381 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd4e4066f60 msgr2=0x7fd4e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.747+0000 7fd50ba00640 1 --2- 172.21.15.173:0/1451699381 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd4e4066f60 0x7fd4e4069420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4000f70 tx=0x7fd4f4007df0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.747+0000 7fd50ba00640 1 -- 172.21.15.173:0/1451699381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd50406dac0 msgr2=0x7fd50413b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.747+0000 7fd50ba00640 1 --2- 172.21.15.173:0/1451699381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd50406dac0 0x7fd50413b6d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd4f000c7f0 tx=0x7fd4f000ccb0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.747+0000 7fd50ba00640 1 -- 172.21.15.173:0/1451699381 shutdown_connections 2024-04-25T09:02:57.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.747+0000 7fd50ba00640 1 --2- 172.21.15.173:0/1451699381 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd4e4066f60 0x7fd4e4069420 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.747+0000 7fd50ba00640 1 --2- 172.21.15.173:0/1451699381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd504160fe0 0x7fd504154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.747+0000 7fd50ba00640 1 --2- 172.21.15.173:0/1451699381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd50406dac0 0x7fd50413b6d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.747+0000 7fd50ba00640 1 --2- 172.21.15.173:0/1451699381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd50406bca0 0x7fd504152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.747+0000 7fd50ba00640 1 -- 172.21.15.173:0/1451699381 >> 172.21.15.173:0/1451699381 conn(0x7fd504071c20 msgr2=0x7fd5040b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:57.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.747+0000 7fd50ba00640 1 -- 172.21.15.173:0/1451699381 shutdown_connections 2024-04-25T09:02:57.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.747+0000 7fd50ba00640 1 -- 172.21.15.173:0/1451699381 wait complete. 2024-04-25T09:02:57.760 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:57.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5b6a00640 1 Processor -- start 2024-04-25T09:02:57.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5b6a00640 1 -- start start 2024-04-25T09:02:57.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5b6a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc5b00b3e70 0x7fc5b00b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5b6a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc5b00aefa0 0x7fc5b00b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5b6a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5b015edd0 0x7fc5b00b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5b6a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b006dd50 con 0x7fc5b00b3e70 2024-04-25T09:02:57.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5b6a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b00b4790 con 0x7fc5b00aefa0 2024-04-25T09:02:57.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5b6a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b015f320 con 0x7fc5b015edd0 2024-04-25T09:02:57.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5afe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc5b00b3e70 0x7fc5b00b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5afe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc5b00b3e70 0x7fc5b00b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35812/0 (socket says 172.21.15.173:35812) 2024-04-25T09:02:57.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5afe00640 1 -- 172.21.15.173:0/3615805128 learned_addr learned my addr 172.21.15.173:0/3615805128 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:57.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5b4a00640 1 --2- 172.21.15.173:0/3615805128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5b015edd0 0x7fc5b00b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5af400640 1 --2- 172.21.15.173:0/3615805128 >> v2:172.21.15.194:3300/0 conn(0x7fc5b00aefa0 0x7fc5b00b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5afe00640 1 -- 172.21.15.173:0/3615805128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5b015edd0 msgr2=0x7fc5b00b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:57.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5afe00640 1 --2- 172.21.15.173:0/3615805128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5b015edd0 0x7fc5b00b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5afe00640 1 -- 172.21.15.173:0/3615805128 >> v2:172.21.15.194:3300/0 conn(0x7fc5b00aefa0 msgr2=0x7fc5b00b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:57.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5afe00640 1 --2- 172.21.15.173:0/3615805128 >> v2:172.21.15.194:3300/0 conn(0x7fc5b00aefa0 0x7fc5b00b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5afe00640 1 -- 172.21.15.173:0/3615805128 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b006d420 con 0x7fc5b00b3e70 2024-04-25T09:02:57.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.907+0000 7fc5af400640 1 --2- 172.21.15.173:0/3615805128 >> v2:172.21.15.194:3300/0 conn(0x7fc5b00aefa0 0x7fc5b00b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:57.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.911+0000 7fc5afe00640 1 --2- 172.21.15.173:0/3615805128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5b00b3e70 0x7fc5b00b4250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00d0650 tx=0x7fc5a001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa58e58cbb2bba7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.911+0000 7fc5aea00640 1 -- 172.21.15.173:0/3615805128 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a00aa430 con 0x7fc5b00b3e70 2024-04-25T09:02:57.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.911+0000 7fc5aea00640 1 -- 172.21.15.173:0/3615805128 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a00af070 con 0x7fc5b00b3e70 2024-04-25T09:02:57.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.911+0000 7fc5aea00640 1 -- 172.21.15.173:0/3615805128 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a00aa7f0 con 0x7fc5b00b3e70 2024-04-25T09:02:57.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.911+0000 7fc5b6a00640 1 -- 172.21.15.173:0/3615805128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5b00b3e70 msgr2=0x7fc5b00b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.911+0000 7fc5b6a00640 1 --2- 172.21.15.173:0/3615805128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5b00b3e70 0x7fc5b00b4250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00d0650 tx=0x7fc5a001c4f0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.911+0000 7fc5b6a00640 1 -- 172.21.15.173:0/3615805128 shutdown_connections 2024-04-25T09:02:57.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.911+0000 7fc5b6a00640 1 --2- 172.21.15.173:0/3615805128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5b015edd0 0x7fc5b00b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.911+0000 7fc5b6a00640 1 --2- 172.21.15.173:0/3615805128 >> v2:172.21.15.194:3300/0 conn(0x7fc5b00aefa0 0x7fc5b00b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.911+0000 7fc5b6a00640 1 --2- 172.21.15.173:0/3615805128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5b00b3e70 0x7fc5b00b4250 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.911+0000 7fc5b6a00640 1 -- 172.21.15.173:0/3615805128 >> 172.21.15.173:0/3615805128 conn(0x7fc5b006ac90 msgr2=0x7fc5b006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:57.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.911+0000 7fc5b6a00640 1 -- 172.21.15.173:0/3615805128 shutdown_connections 2024-04-25T09:02:57.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.911+0000 7fc5b6a00640 1 -- 172.21.15.173:0/3615805128 wait complete. 2024-04-25T09:02:57.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5b6a00640 1 Processor -- start 2024-04-25T09:02:57.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5b6a00640 1 -- start start 2024-04-25T09:02:57.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5b6a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b00aefa0 0x7fc5b0159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5b6a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5b00b3e70 0x7fc5b0151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5b6a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5b015edd0 0x7fc5b014a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5b6a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b006e1e0 con 0x7fc5b00b3e70 2024-04-25T09:02:57.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5b6a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b00b3600 con 0x7fc5b00aefa0 2024-04-25T09:02:57.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5b6a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b006e360 con 0x7fc5b015edd0 2024-04-25T09:02:57.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5af400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5b00b3e70 0x7fc5b0151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5afe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b00aefa0 0x7fc5b0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5af400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5b00b3e70 0x7fc5b0151140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35826/0 (socket says 172.21.15.173:35826) 2024-04-25T09:02:57.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5af400640 1 -- 172.21.15.173:0/3585502035 learned_addr learned my addr 172.21.15.173:0/3585502035 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:57.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5b4a00640 1 --2- 172.21.15.173:0/3585502035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5b015edd0 0x7fc5b014a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5afe00640 1 -- 172.21.15.173:0/3585502035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5b015edd0 msgr2=0x7fc5b014a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5afe00640 1 --2- 172.21.15.173:0/3585502035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5b015edd0 0x7fc5b014a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5afe00640 1 -- 172.21.15.173:0/3585502035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5b00b3e70 msgr2=0x7fc5b0151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:57.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5afe00640 1 --2- 172.21.15.173:0/3585502035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5b00b3e70 0x7fc5b0151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:57.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5afe00640 1 -- 172.21.15.173:0/3585502035 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b0151680 con 0x7fc5b00aefa0 2024-04-25T09:02:57.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5af400640 1 --2- 172.21.15.173:0/3585502035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5b00b3e70 0x7fc5b0151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:57.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5afe00640 1 --2- 172.21.15.173:0/3585502035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b00aefa0 0x7fc5b0159900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc5b006bff0 tx=0x7fc5a001ad30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5a7e00640 1 -- 172.21.15.173:0/3585502035 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a00bd5f0 con 0x7fc5b00aefa0 2024-04-25T09:02:57.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5a7e00640 1 -- 172.21.15.173:0/3585502035 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a00bd790 con 0x7fc5b00aefa0 2024-04-25T09:02:57.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5a7e00640 1 -- 172.21.15.173:0/3585502035 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a00bdb80 con 0x7fc5b00aefa0 2024-04-25T09:02:57.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5b6a00640 1 -- 172.21.15.173:0/3585502035 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b014a7f0 con 0x7fc5b00aefa0 2024-04-25T09:02:57.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.915+0000 7fc5b6a00640 1 -- 172.21.15.173:0/3585502035 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b0153470 con 0x7fc5b00aefa0 2024-04-25T09:02:57.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.919+0000 7fc5b6a00640 1 -- 172.21.15.173:0/3585502035 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b0073a40 con 0x7fc5b00aefa0 2024-04-25T09:02:57.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.919+0000 7fc5a7e00640 1 -- 172.21.15.173:0/3585502035 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc5a00c8430 con 0x7fc5b00aefa0 2024-04-25T09:02:57.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.919+0000 7fc5a7e00640 1 --2- 172.21.15.173:0/3585502035 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc590066f60 0x7fc590069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:57.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.919+0000 7fc5a7e00640 1 -- 172.21.15.173:0/3585502035 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc5a011fc00 con 0x7fc5b00aefa0 2024-04-25T09:02:57.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.919+0000 7fc5af400640 1 --2- 172.21.15.173:0/3585502035 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc590066f60 0x7fc590069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:57.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.919+0000 7fc5af400640 1 --2- 172.21.15.173:0/3585502035 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc590066f60 0x7fc590069420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0153eb0 tx=0x7fc59c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:57.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:57.947+0000 7fc5a7e00640 1 -- 172.21.15.173:0/3585502035 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc5b014a7f0 con 0x7fc5b00aefa0 2024-04-25T09:02:58.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.103+0000 7fc5b6a00640 1 -- 172.21.15.173:0/3585502035 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5b006f1c0 con 0x7fc5b00aefa0 2024-04-25T09:02:58.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.103+0000 7fc5a7e00640 1 -- 172.21.15.173:0/3585502035 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18574 (secure 0 0 0) 0x7fc5b0151680 con 0x7fc5b00aefa0 2024-04-25T09:02:58.096 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:02:58.096 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:56.440593+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:58.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.107+0000 7fc5b6a00640 1 -- 172.21.15.173:0/3585502035 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc590066f60 msgr2=0x7fc590069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:58.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.107+0000 7fc5b6a00640 1 --2- 172.21.15.173:0/3585502035 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc590066f60 0x7fc590069420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0153eb0 tx=0x7fc59c008040 comp rx=0 tx=0).stop 2024-04-25T09:02:58.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.107+0000 7fc5b6a00640 1 -- 172.21.15.173:0/3585502035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b00aefa0 msgr2=0x7fc5b0159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:58.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.107+0000 7fc5b6a00640 1 --2- 172.21.15.173:0/3585502035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b00aefa0 0x7fc5b0159900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc5b006bff0 tx=0x7fc5a001ad30 comp rx=0 tx=0).stop 2024-04-25T09:02:58.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.107+0000 7fc5b6a00640 1 -- 172.21.15.173:0/3585502035 shutdown_connections 2024-04-25T09:02:58.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.107+0000 7fc5b6a00640 1 --2- 172.21.15.173:0/3585502035 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc590066f60 0x7fc590069420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.107+0000 7fc5b6a00640 1 --2- 172.21.15.173:0/3585502035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5b015edd0 0x7fc5b014a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.107+0000 7fc5b6a00640 1 --2- 172.21.15.173:0/3585502035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5b00b3e70 0x7fc5b0151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.107+0000 7fc5b6a00640 1 --2- 172.21.15.173:0/3585502035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b00aefa0 0x7fc5b0159900 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.107+0000 7fc5b6a00640 1 -- 172.21.15.173:0/3585502035 >> 172.21.15.173:0/3585502035 conn(0x7fc5b006ac90 msgr2=0x7fc5b00b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:58.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.107+0000 7fc5b6a00640 1 -- 172.21.15.173:0/3585502035 shutdown_connections 2024-04-25T09:02:58.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.107+0000 7fc5b6a00640 1 -- 172.21.15.173:0/3585502035 wait complete. 2024-04-25T09:02:58.131 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:58.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.275+0000 7f0f81600640 1 Processor -- start 2024-04-25T09:02:58.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.275+0000 7f0f81600640 1 -- start start 2024-04-25T09:02:58.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.275+0000 7f0f81600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0f7c0b3b00 0x7f0f7c1618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:58.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.275+0000 7f0f81600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0f7c0d03d0 0x7f0f7c0c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:58.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.275+0000 7f0f81600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f7c0cf680 con 0x7f0f7c15de10 2024-04-25T09:02:58.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.275+0000 7f0f81600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7c0c7010 con 0x7f0f7c0b3b00 2024-04-25T09:02:58.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.275+0000 7f0f81600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7c0cc390 con 0x7f0f7c0d03d0 2024-04-25T09:02:58.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.275+0000 7f0f7a000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0f7c0b3b00 0x7f0f7c1618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:58.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.275+0000 7f0f7b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0f7c0d03d0 0x7f0f7c0c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:58.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.275+0000 7f0f7a000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0f7c0b3b00 0x7f0f7c1618f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35842/0 (socket says 172.21.15.173:35842) 2024-04-25T09:02:58.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.275+0000 7f0f7a000640 1 -- 172.21.15.173:0/3303963501 learned_addr learned my addr 172.21.15.173:0/3303963501 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:58.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.275+0000 7f0f7a000640 1 -- 172.21.15.173:0/3303963501 >> v2:172.21.15.194:3300/0 conn(0x7f0f7c0d03d0 msgr2=0x7f0f7c0c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:58.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.275+0000 7f0f7a000640 1 --2- 172.21.15.173:0/3303963501 >> v2:172.21.15.194:3300/0 conn(0x7f0f7c0d03d0 0x7f0f7c0c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.275+0000 7f0f7a000640 1 -- 172.21.15.173:0/3303963501 >> v1:172.21.15.194:6789/0 conn(0x7f0f7c15de10 legacy=0x7f0f7c0b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:58.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.275+0000 7f0f7a000640 1 -- 172.21.15.173:0/3303963501 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c15e1f0 con 0x7f0f7c0b3b00 2024-04-25T09:02:58.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.279+0000 7f0f7a000640 1 --2- 172.21.15.173:0/3303963501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f7c0b3b00 0x7f0f7c1618f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0b1340 tx=0x7f0f6801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3c78762f1fd66c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:58.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.279+0000 7f0f79600640 1 -- 172.21.15.173:0/3303963501 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f680ab610 con 0x7f0f7c0b3b00 2024-04-25T09:02:58.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.279+0000 7f0f79600640 1 -- 172.21.15.173:0/3303963501 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f680b0070 con 0x7f0f7c0b3b00 2024-04-25T09:02:58.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.279+0000 7f0f79600640 1 -- 172.21.15.173:0/3303963501 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f680ab9d0 con 0x7f0f7c0b3b00 2024-04-25T09:02:58.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.279+0000 7f0f81600640 1 -- 172.21.15.173:0/3303963501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f7c0b3b00 msgr2=0x7f0f7c1618f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:58.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.279+0000 7f0f81600640 1 --2- 172.21.15.173:0/3303963501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f7c0b3b00 0x7f0f7c1618f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0b1340 tx=0x7f0f6801c520 comp rx=0 tx=0).stop 2024-04-25T09:02:58.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.279+0000 7f0f81600640 1 -- 172.21.15.173:0/3303963501 shutdown_connections 2024-04-25T09:02:58.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.279+0000 7f0f81600640 1 --2- 172.21.15.173:0/3303963501 >> v2:172.21.15.194:3300/0 conn(0x7f0f7c0d03d0 0x7f0f7c0c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.279+0000 7f0f81600640 1 --2- 172.21.15.173:0/3303963501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f7c0b3b00 0x7f0f7c1618f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.279+0000 7f0f81600640 1 -- 172.21.15.173:0/3303963501 >> 172.21.15.173:0/3303963501 conn(0x7f0f7c0d1810 msgr2=0x7f0f7c0d1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:58.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.279+0000 7f0f81600640 1 -- 172.21.15.173:0/3303963501 shutdown_connections 2024-04-25T09:02:58.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.279+0000 7f0f81600640 1 -- 172.21.15.173:0/3303963501 wait complete. 2024-04-25T09:02:58.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f81600640 1 Processor -- start 2024-04-25T09:02:58.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f81600640 1 -- start start 2024-04-25T09:02:58.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f81600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f7c0b3b00 0x7f0f7c1490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:58.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f81600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f7c0d03d0 0x7f0f7c154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:58.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f81600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f7c15de10 0x7f0f7c0ce250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:58.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f81600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c0c81f0 con 0x7f0f7c0d03d0 2024-04-25T09:02:58.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f81600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c162770 con 0x7f0f7c0b3b00 2024-04-25T09:02:58.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f81600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c0c8370 con 0x7f0f7c15de10 2024-04-25T09:02:58.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f7a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f7c0d03d0 0x7f0f7c154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:58.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f7a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f7c0d03d0 0x7f0f7c154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35856/0 (socket says 172.21.15.173:35856) 2024-04-25T09:02:58.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f7a000640 1 -- 172.21.15.173:0/868652264 learned_addr learned my addr 172.21.15.173:0/868652264 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:58.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f7aa00640 1 --2- 172.21.15.173:0/868652264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f7c0b3b00 0x7f0f7c1490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:58.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f7b400640 1 --2- 172.21.15.173:0/868652264 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f7c15de10 0x7f0f7c0ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:58.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f7a000640 1 -- 172.21.15.173:0/868652264 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f7c15de10 msgr2=0x7f0f7c0ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:58.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f7a000640 1 --2- 172.21.15.173:0/868652264 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f7c15de10 0x7f0f7c0ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f7a000640 1 -- 172.21.15.173:0/868652264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f7c0b3b00 msgr2=0x7f0f7c1490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:58.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f7a000640 1 --2- 172.21.15.173:0/868652264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f7c0b3b00 0x7f0f7c1490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f7a000640 1 -- 172.21.15.173:0/868652264 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c155be0 con 0x7f0f7c0d03d0 2024-04-25T09:02:58.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f7a000640 1 --2- 172.21.15.173:0/868652264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f7c0d03d0 0x7f0f7c154c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0f68019130 tx=0x7f0f6801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:58.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f72a00640 1 -- 172.21.15.173:0/868652264 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f680abe60 con 0x7f0f7c0d03d0 2024-04-25T09:02:58.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f72a00640 1 -- 172.21.15.173:0/868652264 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f680be5f0 con 0x7f0f7c0d03d0 2024-04-25T09:02:58.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f72a00640 1 -- 172.21.15.173:0/868652264 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f680be9e0 con 0x7f0f7c0d03d0 2024-04-25T09:02:58.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f81600640 1 -- 172.21.15.173:0/868652264 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7c155620 con 0x7f0f7c0d03d0 2024-04-25T09:02:58.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f81600640 1 -- 172.21.15.173:0/868652264 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7c0c88f0 con 0x7f0f7c0d03d0 2024-04-25T09:02:58.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.283+0000 7f0f81600640 1 -- 172.21.15.173:0/868652264 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7c0b44d0 con 0x7f0f7c0d03d0 2024-04-25T09:02:58.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.287+0000 7f0f72a00640 1 -- 172.21.15.173:0/868652264 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0f680b43f0 con 0x7f0f7c0d03d0 2024-04-25T09:02:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.287+0000 7f0f72a00640 1 --2- 172.21.15.173:0/868652264 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0f5c066f90 0x7f0f5c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.287+0000 7f0f72a00640 1 -- 172.21.15.173:0/868652264 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0f6811f500 con 0x7f0f7c0d03d0 2024-04-25T09:02:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.287+0000 7f0f7aa00640 1 --2- 172.21.15.173:0/868652264 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0f5c066f90 0x7f0f5c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.287+0000 7f0f7aa00640 1 --2- 172.21.15.173:0/868652264 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0f5c066f90 0x7f0f5c069450 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c001770 tx=0x7f0f6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:58.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.291+0000 7f0f72a00640 1 -- 172.21.15.173:0/868652264 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0f680a8050 con 0x7f0f7c0d03d0 2024-04-25T09:02:58.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.475+0000 7f0f81600640 1 -- 172.21.15.173:0/868652264 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f7c0c6970 con 0x7f0f7c0d03d0 2024-04-25T09:02:58.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.475+0000 7f0f72a00640 1 -- 172.21.15.173:0/868652264 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4946 (secure 0 0 0) 0x7f0f68016110 con 0x7f0f7c0d03d0 2024-04-25T09:02:58.467 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:02:58.467 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2883565303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2883565303},{"type":"v1","addr":"172.21.15.194:6834","nonce":2883565303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2634963400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2634963400},{"type":"v1","addr":"172.21.15.173:6837","nonce":2634963400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3101502434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3101502434},{"type":"v1","addr":"172.21.15.173:6836","nonce":3101502434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:51.389514+0000","modified":"2024-04-25T09:02:56.440807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/4160663138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4160663138},{"type":"v1","addr":"172.21.15.194:6835","nonce":4160663138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-25T09:02:58.467 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 7 2024-04-25T09:02:58.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.475+0000 7f0f81600640 1 -- 172.21.15.173:0/868652264 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0f5c066f90 msgr2=0x7f0f5c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:58.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.475+0000 7f0f81600640 1 --2- 172.21.15.173:0/868652264 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0f5c066f90 0x7f0f5c069450 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c001770 tx=0x7f0f6c009040 comp rx=0 tx=0).stop 2024-04-25T09:02:58.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.475+0000 7f0f81600640 1 -- 172.21.15.173:0/868652264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f7c0d03d0 msgr2=0x7f0f7c154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:58.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.475+0000 7f0f81600640 1 --2- 172.21.15.173:0/868652264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f7c0d03d0 0x7f0f7c154c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0f68019130 tx=0x7f0f6801ad60 comp rx=0 tx=0).stop 2024-04-25T09:02:58.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.475+0000 7f0f81600640 1 -- 172.21.15.173:0/868652264 shutdown_connections 2024-04-25T09:02:58.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.475+0000 7f0f81600640 1 --2- 172.21.15.173:0/868652264 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0f5c066f90 0x7f0f5c069450 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.475+0000 7f0f81600640 1 --2- 172.21.15.173:0/868652264 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f7c15de10 0x7f0f7c0ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.475+0000 7f0f81600640 1 --2- 172.21.15.173:0/868652264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f7c0d03d0 0x7f0f7c154c80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.475+0000 7f0f81600640 1 --2- 172.21.15.173:0/868652264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f7c0b3b00 0x7f0f7c1490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.479+0000 7f0f81600640 1 -- 172.21.15.173:0/868652264 >> 172.21.15.173:0/868652264 conn(0x7f0f7c0d1810 msgr2=0x7f0f7c0d1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:58.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.479+0000 7f0f81600640 1 -- 172.21.15.173:0/868652264 shutdown_connections 2024-04-25T09:02:58.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.479+0000 7f0f81600640 1 -- 172.21.15.173:0/868652264 wait complete. 2024-04-25T09:02:58.490 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:58.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.631+0000 7f61bba00640 1 Processor -- start 2024-04-25T09:02:58.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.631+0000 7f61bba00640 1 -- start start 2024-04-25T09:02:58.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.635+0000 7f61bba00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f61b40b3e70 0x7f61b40b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:58.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.635+0000 7f61bba00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f61b40aefa0 0x7f61b40b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.635+0000 7f61bba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61b415edd0 0x7f61b40b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.635+0000 7f61bba00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b406dd50 con 0x7f61b40b3e70 2024-04-25T09:02:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.635+0000 7f61bba00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b40b4790 con 0x7f61b40aefa0 2024-04-25T09:02:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.635+0000 7f61bba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b415f320 con 0x7f61b415edd0 2024-04-25T09:02:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.635+0000 7f61b9000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f61b40b3e70 0x7f61b40b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.635+0000 7f61b9000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f61b40b3e70 0x7f61b40b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35860/0 (socket says 172.21.15.173:35860) 2024-04-25T09:02:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.635+0000 7f61b9000640 1 -- 172.21.15.173:0/3894863275 learned_addr learned my addr 172.21.15.173:0/3894863275 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.635+0000 7f61b3e00640 1 --2- 172.21.15.173:0/3894863275 >> v2:172.21.15.194:3300/0 conn(0x7f61b40aefa0 0x7f61b40b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.635+0000 7f61b9a00640 1 --2- 172.21.15.173:0/3894863275 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61b415edd0 0x7f61b40b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.635+0000 7f61b9000640 1 -- 172.21.15.173:0/3894863275 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61b415edd0 msgr2=0x7f61b40b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.635+0000 7f61b9000640 1 --2- 172.21.15.173:0/3894863275 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61b415edd0 0x7f61b40b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.635+0000 7f61b9000640 1 -- 172.21.15.173:0/3894863275 >> v2:172.21.15.194:3300/0 conn(0x7f61b40aefa0 msgr2=0x7f61b40b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.635+0000 7f61b9000640 1 --2- 172.21.15.173:0/3894863275 >> v2:172.21.15.194:3300/0 conn(0x7f61b40aefa0 0x7f61b40b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.635+0000 7f61b9000640 1 -- 172.21.15.173:0/3894863275 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b406d420 con 0x7f61b40b3e70 2024-04-25T09:02:58.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.635+0000 7f61b3e00640 1 --2- 172.21.15.173:0/3894863275 >> v2:172.21.15.194:3300/0 conn(0x7f61b40aefa0 0x7f61b40b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:58.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.635+0000 7f61b9a00640 1 --2- 172.21.15.173:0/3894863275 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61b415edd0 0x7f61b40b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:58.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.639+0000 7f61b9000640 1 --2- 172.21.15.173:0/3894863275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61b40b3e70 0x7f61b40b4250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f61b40d0650 tx=0x7f61a801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4f4325284816a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:58.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.639+0000 7f61b3400640 1 -- 172.21.15.173:0/3894863275 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a80aa430 con 0x7f61b40b3e70 2024-04-25T09:02:58.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.639+0000 7f61b3400640 1 -- 172.21.15.173:0/3894863275 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a80af070 con 0x7f61b40b3e70 2024-04-25T09:02:58.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.639+0000 7f61b3400640 1 -- 172.21.15.173:0/3894863275 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a80aa7f0 con 0x7f61b40b3e70 2024-04-25T09:02:58.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.639+0000 7f61bba00640 1 -- 172.21.15.173:0/3894863275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61b40b3e70 msgr2=0x7f61b40b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:58.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.639+0000 7f61bba00640 1 --2- 172.21.15.173:0/3894863275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61b40b3e70 0x7f61b40b4250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f61b40d0650 tx=0x7f61a801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.639+0000 7f61bba00640 1 -- 172.21.15.173:0/3894863275 shutdown_connections 2024-04-25T09:02:58.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.639+0000 7f61bba00640 1 --2- 172.21.15.173:0/3894863275 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61b415edd0 0x7f61b40b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.639+0000 7f61bba00640 1 --2- 172.21.15.173:0/3894863275 >> v2:172.21.15.194:3300/0 conn(0x7f61b40aefa0 0x7f61b40b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.639+0000 7f61bba00640 1 --2- 172.21.15.173:0/3894863275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61b40b3e70 0x7f61b40b4250 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.639+0000 7f61bba00640 1 -- 172.21.15.173:0/3894863275 >> 172.21.15.173:0/3894863275 conn(0x7f61b406ac90 msgr2=0x7f61b406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:58.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.639+0000 7f61bba00640 1 -- 172.21.15.173:0/3894863275 shutdown_connections 2024-04-25T09:02:58.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.639+0000 7f61bba00640 1 -- 172.21.15.173:0/3894863275 wait complete. 2024-04-25T09:02:58.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.639+0000 7f61bba00640 1 Processor -- start 2024-04-25T09:02:58.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.639+0000 7f61bba00640 1 -- start start 2024-04-25T09:02:58.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.639+0000 7f61bba00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61b40aefa0 0x7f61b415c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:58.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61bba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61b40b3e70 0x7f61b4156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:58.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61bba00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61b415edd0 0x7f61b4152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:58.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61bba00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b406e1e0 con 0x7f61b40aefa0 2024-04-25T09:02:58.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61bba00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b40b3600 con 0x7f61b415edd0 2024-04-25T09:02:58.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61bba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b406e360 con 0x7f61b40b3e70 2024-04-25T09:02:58.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61b9000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61b40aefa0 0x7f61b415c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:58.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61b9000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61b40aefa0 0x7f61b415c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35876/0 (socket says 172.21.15.173:35876) 2024-04-25T09:02:58.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61b9000640 1 -- 172.21.15.173:0/2704593152 learned_addr learned my addr 172.21.15.173:0/2704593152 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:58.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61b3e00640 1 --2- 172.21.15.173:0/2704593152 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61b40b3e70 0x7f61b4156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:58.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61b9a00640 1 --2- 172.21.15.173:0/2704593152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61b415edd0 0x7f61b4152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:58.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61b9000640 1 -- 172.21.15.173:0/2704593152 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61b40b3e70 msgr2=0x7f61b4156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:58.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61b9000640 1 --2- 172.21.15.173:0/2704593152 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61b40b3e70 0x7f61b4156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61b9000640 1 -- 172.21.15.173:0/2704593152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61b415edd0 msgr2=0x7f61b4152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:58.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61b9000640 1 --2- 172.21.15.173:0/2704593152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61b415edd0 0x7f61b4152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61b9000640 1 -- 172.21.15.173:0/2704593152 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b415adb0 con 0x7f61b40aefa0 2024-04-25T09:02:58.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61b9000640 1 --2- 172.21.15.173:0/2704593152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61b40aefa0 0x7f61b415c880 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f61a80ac040 tx=0x7f61a801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:58.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61b0c00640 1 -- 172.21.15.173:0/2704593152 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a80b3800 con 0x7f61b40aefa0 2024-04-25T09:02:58.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61b0c00640 1 -- 172.21.15.173:0/2704593152 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a80b39c0 con 0x7f61b40aefa0 2024-04-25T09:02:58.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61bba00640 1 -- 172.21.15.173:0/2704593152 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b4156bd0 con 0x7f61b40aefa0 2024-04-25T09:02:58.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61b0c00640 1 -- 172.21.15.173:0/2704593152 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a80b3db0 con 0x7f61b40aefa0 2024-04-25T09:02:58.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61bba00640 1 -- 172.21.15.173:0/2704593152 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b41f7b40 con 0x7f61b40aefa0 2024-04-25T09:02:58.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61bba00640 1 -- 172.21.15.173:0/2704593152 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b4073a40 con 0x7f61b40aefa0 2024-04-25T09:02:58.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61b0c00640 1 -- 172.21.15.173:0/2704593152 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f61a80b2380 con 0x7f61b40aefa0 2024-04-25T09:02:58.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61b0c00640 1 --2- 172.21.15.173:0/2704593152 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6194066f90 0x7f6194069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:58.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.643+0000 7f61b0c00640 1 -- 172.21.15.173:0/2704593152 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f61a811f5b0 con 0x7f61b40aefa0 2024-04-25T09:02:58.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.647+0000 7f61b3e00640 1 --2- 172.21.15.173:0/2704593152 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6194066f90 0x7f6194069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:58.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.647+0000 7f61b3e00640 1 --2- 172.21.15.173:0/2704593152 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6194066f90 0x7f6194069450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f61b4154980 tx=0x7f61a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:58.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.647+0000 7f61b0c00640 1 -- 172.21.15.173:0/2704593152 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f61a80c3060 con 0x7f61b40aefa0 2024-04-25T09:02:58.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.807+0000 7f61bba00640 1 -- 172.21.15.173:0/2704593152 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61b406f1c0 con 0x7f61b40aefa0 2024-04-25T09:02:58.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.807+0000 7f61b0c00640 1 -- 172.21.15.173:0/2704593152 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18574 (secure 0 0 0) 0x7f61b415adb0 con 0x7f61b40aefa0 2024-04-25T09:02:58.800 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:02:58.800 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:56.440593+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:58.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.811+0000 7f61bba00640 1 -- 172.21.15.173:0/2704593152 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6194066f90 msgr2=0x7f6194069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:58.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.811+0000 7f61bba00640 1 --2- 172.21.15.173:0/2704593152 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6194066f90 0x7f6194069450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f61b4154980 tx=0x7f61a0008040 comp rx=0 tx=0).stop 2024-04-25T09:02:58.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.811+0000 7f61bba00640 1 -- 172.21.15.173:0/2704593152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61b40aefa0 msgr2=0x7f61b415c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:58.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.811+0000 7f61bba00640 1 --2- 172.21.15.173:0/2704593152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61b40aefa0 0x7f61b415c880 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f61a80ac040 tx=0x7f61a801ad30 comp rx=0 tx=0).stop 2024-04-25T09:02:58.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.811+0000 7f61bba00640 1 -- 172.21.15.173:0/2704593152 shutdown_connections 2024-04-25T09:02:58.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.811+0000 7f61bba00640 1 --2- 172.21.15.173:0/2704593152 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6194066f90 0x7f6194069450 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.811+0000 7f61bba00640 1 --2- 172.21.15.173:0/2704593152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61b415edd0 0x7f61b4152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.811+0000 7f61bba00640 1 --2- 172.21.15.173:0/2704593152 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61b40b3e70 0x7f61b4156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.811+0000 7f61bba00640 1 --2- 172.21.15.173:0/2704593152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61b40aefa0 0x7f61b415c880 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:58.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.811+0000 7f61bba00640 1 -- 172.21.15.173:0/2704593152 >> 172.21.15.173:0/2704593152 conn(0x7f61b406ac90 msgr2=0x7f61b415e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:58.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.811+0000 7f61bba00640 1 -- 172.21.15.173:0/2704593152 shutdown_connections 2024-04-25T09:02:58.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:58.811+0000 7f61bba00640 1 -- 172.21.15.173:0/2704593152 wait complete. 2024-04-25T09:02:59.224 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:02:51.389514+0000', 'modified': '2024-04-25T09:02:56.440807+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.194:6835/4160663138', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6833', 'nonce': 4160663138}, {'type': 'v1', 'addr': '172.21.15.194:6835', 'nonce': 4160663138}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-04-25T09:02:59.224 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:02:59.224 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T09:02:59.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.367+0000 7f5807000640 1 Processor -- start 2024-04-25T09:02:59.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.367+0000 7f5807000640 1 -- start start 2024-04-25T09:02:59.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.371+0000 7f5807000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5800159f00 0x7f58000cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.371+0000 7f5807000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58000cff40 0x7f58000cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.371+0000 7f5807000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580015ddd0 con 0x7f580015a2e0 2024-04-25T09:02:59.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.371+0000 7f5807000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5800072330 con 0x7f5800159f00 2024-04-25T09:02:59.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.371+0000 7f5807000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580015e0b0 con 0x7f58000cff40 2024-04-25T09:02:59.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.371+0000 7f57ffe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5800159f00 0x7f58000cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.371+0000 7f57ffe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5800159f00 0x7f58000cb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35882/0 (socket says 172.21.15.173:35882) 2024-04-25T09:02:59.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.371+0000 7f57ffe00640 1 -- 172.21.15.173:0/3907627399 learned_addr learned my addr 172.21.15.173:0/3907627399 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:59.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.371+0000 7f57ff400640 1 --2- 172.21.15.173:0/3907627399 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58000cff40 0x7f58000cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.371+0000 7f57ffe00640 1 -- 172.21.15.173:0/3907627399 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58000cff40 msgr2=0x7f58000cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.371+0000 7f57ffe00640 1 --2- 172.21.15.173:0/3907627399 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58000cff40 0x7f58000cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.371+0000 7f57ffe00640 1 -- 172.21.15.173:0/3907627399 >> v1:172.21.15.194:6789/0 conn(0x7f580015a2e0 legacy=0x7f580006d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.371+0000 7f57ffe00640 1 -- 172.21.15.173:0/3907627399 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580015e390 con 0x7f5800159f00 2024-04-25T09:02:59.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.375+0000 7f57ffe00640 1 --2- 172.21.15.173:0/3907627399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5800159f00 0x7f58000cb960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f57f000bb10 tx=0x7f57f001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208cd23ef84b6640 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.375+0000 7f57fea00640 1 -- 172.21.15.173:0/3907627399 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f00b4070 con 0x7f5800159f00 2024-04-25T09:02:59.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.375+0000 7f57fea00640 1 -- 172.21.15.173:0/3907627399 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f00a7b00 con 0x7f5800159f00 2024-04-25T09:02:59.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.375+0000 7f57fea00640 1 -- 172.21.15.173:0/3907627399 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f00af440 con 0x7f5800159f00 2024-04-25T09:02:59.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.375+0000 7f5807000640 1 -- 172.21.15.173:0/3907627399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5800159f00 msgr2=0x7f58000cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.375+0000 7f5807000640 1 --2- 172.21.15.173:0/3907627399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5800159f00 0x7f58000cb960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f57f000bb10 tx=0x7f57f001ec30 comp rx=0 tx=0).stop 2024-04-25T09:02:59.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.375+0000 7f5807000640 1 -- 172.21.15.173:0/3907627399 shutdown_connections 2024-04-25T09:02:59.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.375+0000 7f5807000640 1 --2- 172.21.15.173:0/3907627399 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58000cff40 0x7f58000cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.375+0000 7f5807000640 1 --2- 172.21.15.173:0/3907627399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5800159f00 0x7f58000cb960 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.375+0000 7f5807000640 1 -- 172.21.15.173:0/3907627399 >> 172.21.15.173:0/3907627399 conn(0x7f580006ac90 msgr2=0x7f580006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:59.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.375+0000 7f5807000640 1 -- 172.21.15.173:0/3907627399 shutdown_connections 2024-04-25T09:02:59.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.375+0000 7f5807000640 1 -- 172.21.15.173:0/3907627399 wait complete. 2024-04-25T09:02:59.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.375+0000 7f5807000640 1 Processor -- start 2024-04-25T09:02:59.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.375+0000 7f5807000640 1 -- start start 2024-04-25T09:02:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f5807000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58000cff40 0x7f5800136430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f5807000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5800159f00 0x7f580015a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f5807000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f580015a2e0 0x7f5800147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f5807000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58000cc2b0 con 0x7f58000cff40 2024-04-25T09:02:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f5807000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58000cc130 con 0x7f580015a2e0 2024-04-25T09:02:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f5807000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58000cc430 con 0x7f5800159f00 2024-04-25T09:02:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f57ffe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58000cff40 0x7f5800136430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f57ffe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58000cff40 0x7f5800136430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35888/0 (socket says 172.21.15.173:35888) 2024-04-25T09:02:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f57ffe00640 1 -- 172.21.15.173:0/732057185 learned_addr learned my addr 172.21.15.173:0/732057185 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f5805000640 1 --2- 172.21.15.173:0/732057185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f580015a2e0 0x7f5800147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f57ff400640 1 --2- 172.21.15.173:0/732057185 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5800159f00 0x7f580015a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f57ffe00640 1 -- 172.21.15.173:0/732057185 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5800159f00 msgr2=0x7f580015a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f57ffe00640 1 --2- 172.21.15.173:0/732057185 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5800159f00 0x7f580015a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f57ffe00640 1 -- 172.21.15.173:0/732057185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f580015a2e0 msgr2=0x7f5800147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f57ffe00640 1 --2- 172.21.15.173:0/732057185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f580015a2e0 0x7f5800147f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f57ffe00640 1 -- 172.21.15.173:0/732057185 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580015acf0 con 0x7f58000cff40 2024-04-25T09:02:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f57ffe00640 1 --2- 172.21.15.173:0/732057185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58000cff40 0x7f5800136430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f57f001c860 tx=0x7f57f001d470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f57f7e00640 1 -- 172.21.15.173:0/732057185 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f00bf070 con 0x7f58000cff40 2024-04-25T09:02:59.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f57f7e00640 1 -- 172.21.15.173:0/732057185 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f00ba440 con 0x7f58000cff40 2024-04-25T09:02:59.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f5807000640 1 -- 172.21.15.173:0/732057185 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f580015d330 con 0x7f58000cff40 2024-04-25T09:02:59.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f57f7e00640 1 -- 172.21.15.173:0/732057185 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f00b4070 con 0x7f58000cff40 2024-04-25T09:02:59.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.379+0000 7f5807000640 1 -- 172.21.15.173:0/732057185 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5800147440 con 0x7f58000cff40 2024-04-25T09:02:59.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f57f7e00640 1 -- 172.21.15.173:0/732057185 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f57f00c2070 con 0x7f58000cff40 2024-04-25T09:02:59.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f57f7e00640 1 --2- 172.21.15.173:0/732057185 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f57e0066f60 0x7f57e0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f57f7e00640 1 -- 172.21.15.173:0/732057185 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f57f011f9b0 con 0x7f58000cff40 2024-04-25T09:02:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f57ff400640 1 --2- 172.21.15.173:0/732057185 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f57e0066f60 0x7f57e0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f580a4af000 1 Processor -- start 2024-04-25T09:02:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f580a4af000 1 -- start start 2024-04-25T09:02:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f57ff400640 1 --2- 172.21.15.173:0/732057185 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f57e0066f60 0x7f57e0069420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f580006f1e0 tx=0x7f57ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f580a4af000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedbe8920 0x561fedbe8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f580a4af000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedbe9240 0x561fedb9e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f580a4af000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedb9ef30 0x561fedb9f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f580a4af000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561feda865f0 con 0x561fedb9ef30 2024-04-25T09:02:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f580a4af000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fed9edda0 con 0x561fedbe8920 2024-04-25T09:02:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f580a4af000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fed976150 con 0x561fedbe9240 2024-04-25T09:02:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f5805000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedb9ef30 0x561fedb9f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f5805000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedb9ef30 0x561fedb9f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35900/0 (socket says 172.21.15.173:35900) 2024-04-25T09:02:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f5805000640 1 -- 172.21.15.173:0/618228846 learned_addr learned my addr 172.21.15.173:0/618228846 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f57ff400640 1 --2- 172.21.15.173:0/618228846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedbe9240 0x561fedb9e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f57ffe00640 1 --2- 172.21.15.173:0/618228846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedbe8920 0x561fedbe8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f5805000640 1 -- 172.21.15.173:0/618228846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedbe9240 msgr2=0x561fedb9e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f5805000640 1 --2- 172.21.15.173:0/618228846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedbe9240 0x561fedb9e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f5805000640 1 -- 172.21.15.173:0/618228846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedbe8920 msgr2=0x561fedbe8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f5805000640 1 --2- 172.21.15.173:0/618228846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedbe8920 0x561fedbe8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f5805000640 1 -- 172.21.15.173:0/618228846 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fed98fca0 con 0x561fedb9ef30 2024-04-25T09:02:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f57ffe00640 1 --2- 172.21.15.173:0/618228846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedbe8920 0x561fedbe8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f5805000640 1 --2- 172.21.15.173:0/618228846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedb9ef30 0x561fedb9f310 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f57f8001e80 tx=0x7f57f8001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96530573f003fb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f57f4c00640 1 -- 172.21.15.173:0/618228846 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8002090 con 0x561fedb9ef30 2024-04-25T09:02:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f57f4c00640 1 -- 172.21.15.173:0/618228846 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f8018070 con 0x561fedb9ef30 2024-04-25T09:02:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.383+0000 7f57f4c00640 1 -- 172.21.15.173:0/618228846 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8003b80 con 0x561fedb9ef30 2024-04-25T09:02:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 -- 172.21.15.173:0/618228846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedb9ef30 msgr2=0x561fedb9f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 --2- 172.21.15.173:0/618228846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedb9ef30 0x561fedb9f310 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f57f8001e80 tx=0x7f57f8001610 comp rx=0 tx=0).stop 2024-04-25T09:02:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 -- 172.21.15.173:0/618228846 shutdown_connections 2024-04-25T09:02:59.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 --2- 172.21.15.173:0/618228846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedb9ef30 0x561fedb9f310 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 --2- 172.21.15.173:0/618228846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedbe9240 0x561fedb9e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 --2- 172.21.15.173:0/618228846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedbe8920 0x561fedbe8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 -- 172.21.15.173:0/618228846 >> 172.21.15.173:0/618228846 conn(0x561fedba52a0 msgr2=0x561fedb9d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:59.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 -- 172.21.15.173:0/618228846 shutdown_connections 2024-04-25T09:02:59.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 -- 172.21.15.173:0/618228846 wait complete. 2024-04-25T09:02:59.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 -- start start 2024-04-25T09:02:59.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 Processor -- start 2024-04-25T09:02:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedb9ef30 0x561fedbefc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe8920 0x561fedbf01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedbe9240 0x561fedba2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fed9a8990 con 0x561fedbe8920 2024-04-25T09:02:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fed9e9e40 con 0x561fedbe9240 2024-04-25T09:02:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fed979900 con 0x561fedb9ef30 2024-04-25T09:02:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 10 client.0 _ll_register_callbacks cb 0x561fedaa11c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f57ff400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe8920 0x561fedbf01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f57ff400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe8920 0x561fedbf01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35908/0 (socket says 172.21.15.173:35908) 2024-04-25T09:02:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f57ff400640 1 -- 172.21.15.173:0/1323898456 learned_addr learned my addr 172.21.15.173:0/1323898456 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f57ffe00640 1 --2- 172.21.15.173:0/1323898456 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedb9ef30 0x561fedbefc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f5805000640 1 --2- 172.21.15.173:0/1323898456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedbe9240 0x561fedba2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f57ff400640 1 -- 172.21.15.173:0/1323898456 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedb9ef30 msgr2=0x561fedbefc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f57ff400640 1 --2- 172.21.15.173:0/1323898456 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedb9ef30 0x561fedbefc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f57ff400640 1 -- 172.21.15.173:0/1323898456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedbe9240 msgr2=0x561fedba2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f57ff400640 1 --2- 172.21.15.173:0/1323898456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedbe9240 0x561fedba2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f57ff400640 1 -- 172.21.15.173:0/1323898456 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561fed9a6630 con 0x561fedbe8920 2024-04-25T09:02:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f57ffe00640 1 --2- 172.21.15.173:0/1323898456 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedb9ef30 0x561fedbefc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:59.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f5805000640 1 --2- 172.21.15.173:0/1323898456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedbe9240 0x561fedba2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:59.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f57ff400640 1 --2- 172.21.15.173:0/1323898456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe8920 0x561fedbf01c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0167f0 tx=0x7f57ec0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be38eb281cf028b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f57e9600640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:02:59.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f57e9600640 1 -- 172.21.15.173:0/1323898456 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec026070 con 0x561fedbe8920 2024-04-25T09:02:59.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f57e9600640 1 -- 172.21.15.173:0/1323898456 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f57ec0149b0 con 0x561fedbe8920 2024-04-25T09:02:59.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 -- 172.21.15.173:0/1323898456 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f57f8018070 con 0x561fedbe8920 2024-04-25T09:02:59.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f57e9600640 1 -- 172.21.15.173:0/1323898456 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57ec031050 con 0x561fedbe8920 2024-04-25T09:02:59.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 10 client.4425 fetch_fsmap learned FSMap version 7 2024-04-25T09:02:59.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.387+0000 7f580a4af000 1 -- 172.21.15.173:0/1323898456 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x561fed9763a0 con 0x561fedbe8920 2024-04-25T09:02:59.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f57e9600640 1 -- 172.21.15.173:0/1323898456 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f8018070 con 0x561fedbe8920 2024-04-25T09:02:59.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f57e9600640 1 -- 172.21.15.173:0/1323898456 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f57ec034020 con 0x561fedbe8920 2024-04-25T09:02:59.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f580a4af000 10 client.4425 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T09:02:59.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f580a4af000 10 client.4425 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T09:02:59.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f580a4af000 20 client.4425 populate_metadata read hostname 'smithi173' 2024-04-25T09:02:59.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f580a4af000 1 --2- 172.21.15.173:0/1323898456 >> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] conn(0x561fedba4160 0x561fedbf9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f580a4af000 4 client.4425 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:02:59.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f580a4af000 1 -- 172.21.15.173:0/1323898456 --> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561fed989a50 con 0x561fedba4160 2024-04-25T09:02:59.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f57ffe00640 1 --2- 172.21.15.173:0/1323898456 >> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] conn(0x561fedba4160 0x561fedbf9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f57ffe00640 1 --2- 172.21.15.173:0/1323898456 >> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] conn(0x561fedba4160 0x561fedbf9c70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75e3312ed5d905c1 server_cookie=f950d5036e622f62 in_seq=0 out_seq=0 2024-04-25T09:02:59.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f57e9600640 10 client.4425 ms_handle_connect on v2:172.21.15.194:6833/4160663138 2024-04-25T09:02:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f57e9600640 1 -- 172.21.15.173:0/1323898456 <== mds.0 v2:172.21.15.194:6833/4160663138 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561fed989a50 con 0x561fedba4160 2024-04-25T09:02:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f57e9600640 10 client.4425 handle_command_reply: tid=0 2024-04-25T09:02:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f580a4af000 1 client.4425 shutdown 2024-04-25T09:02:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f580a4af000 1 -- 172.21.15.173:0/1323898456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe8920 msgr2=0x561fedbf01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f580a4af000 1 --2- 172.21.15.173:0/1323898456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe8920 0x561fedbf01c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0167f0 tx=0x7f57ec0046d0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f580a4af000 1 -- 172.21.15.173:0/1323898456 shutdown_connections 2024-04-25T09:02:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f580a4af000 1 --2- 172.21.15.173:0/1323898456 >> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] conn(0x561fedba4160 0x561fedbf9c70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f580a4af000 1 --2- 172.21.15.173:0/1323898456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedbe9240 0x561fedba2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f580a4af000 1 --2- 172.21.15.173:0/1323898456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe8920 0x561fedbf01c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f57e9600640 0 client.4425 ms_handle_reset on v2:172.21.15.194:6833/4160663138 2024-04-25T09:02:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f580a4af000 1 --2- 172.21.15.173:0/1323898456 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedb9ef30 0x561fedbefc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f580a4af000 1 -- 172.21.15.173:0/1323898456 >> 172.21.15.173:0/1323898456 conn(0x561fedba52a0 msgr2=0x561fedb9d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f580a4af000 1 -- 172.21.15.173:0/1323898456 shutdown_connections 2024-04-25T09:02:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f580a4af000 1 -- 172.21.15.173:0/1323898456 wait complete. 2024-04-25T09:02:59.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.391+0000 7f580a4af000 20 client.4425 trim_cache size 0 max 16384 2024-04-25T09:02:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f580a4af000 1 Processor -- start 2024-04-25T09:02:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f580a4af000 1 -- start start 2024-04-25T09:02:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f580a4af000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedb9ef30 0x561fedc44120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f580a4af000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe8920 0x561fedc44660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f580a4af000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedbe9240 0x561fedc44ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f580a4af000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5800203a80 con 0x561fedbe8920 2024-04-25T09:02:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f580a4af000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580014dee0 con 0x561fedb9ef30 2024-04-25T09:02:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f580a4af000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5800203480 con 0x561fedbe9240 2024-04-25T09:02:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f57ff400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe8920 0x561fedc44660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f57ff400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe8920 0x561fedc44660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35922/0 (socket says 172.21.15.173:35922) 2024-04-25T09:02:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f57ff400640 1 -- 172.21.15.173:0/4006678554 learned_addr learned my addr 172.21.15.173:0/4006678554 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f57ff400640 1 -- 172.21.15.173:0/4006678554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedbe9240 msgr2=0x561fedc44ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f5805000640 1 --2- 172.21.15.173:0/4006678554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedbe9240 0x561fedc44ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f57ffe00640 1 --2- 172.21.15.173:0/4006678554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedb9ef30 0x561fedc44120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f57ff400640 1 --2- 172.21.15.173:0/4006678554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedbe9240 0x561fedc44ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f57ff400640 1 -- 172.21.15.173:0/4006678554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedb9ef30 msgr2=0x561fedc44120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f57ff400640 1 --2- 172.21.15.173:0/4006678554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedb9ef30 0x561fedc44120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f57ff400640 1 -- 172.21.15.173:0/4006678554 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fedbe9070 con 0x561fedbe8920 2024-04-25T09:02:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f5805000640 1 --2- 172.21.15.173:0/4006678554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedbe9240 0x561fedc44ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f57ffe00640 1 --2- 172.21.15.173:0/4006678554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedb9ef30 0x561fedc44120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.407+0000 7f57ff400640 1 --2- 172.21.15.173:0/4006678554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe8920 0x561fedc44660 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f57ec010df0 tx=0x7f57ec023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b49a825d473027 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f57ebe00640 1 -- 172.21.15.173:0/4006678554 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec026070 con 0x561fedbe8920 2024-04-25T09:02:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f57ebe00640 1 -- 172.21.15.173:0/4006678554 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ec01d040 con 0x561fedbe8920 2024-04-25T09:02:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f57ebe00640 1 -- 172.21.15.173:0/4006678554 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec01c040 con 0x561fedbe8920 2024-04-25T09:02:59.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 1 -- 172.21.15.173:0/4006678554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe8920 msgr2=0x561fedc44660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 1 --2- 172.21.15.173:0/4006678554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe8920 0x561fedc44660 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f57ec010df0 tx=0x7f57ec023000 comp rx=0 tx=0).stop 2024-04-25T09:02:59.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 1 -- 172.21.15.173:0/4006678554 shutdown_connections 2024-04-25T09:02:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 1 --2- 172.21.15.173:0/4006678554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedbe9240 0x561fedc44ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 1 --2- 172.21.15.173:0/4006678554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe8920 0x561fedc44660 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 1 --2- 172.21.15.173:0/4006678554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedb9ef30 0x561fedc44120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 1 -- 172.21.15.173:0/4006678554 >> 172.21.15.173:0/4006678554 conn(0x561fedba52a0 msgr2=0x561fedba1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 1 -- 172.21.15.173:0/4006678554 shutdown_connections 2024-04-25T09:02:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 1 -- 172.21.15.173:0/4006678554 wait complete. 2024-04-25T09:02:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 1 -- start start 2024-04-25T09:02:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 1 Processor -- start 2024-04-25T09:02:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedb9ef30 0x561fedbf5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedbe8920 0x561fedbf5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe9240 0x561fedc2d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fed9f23d0 con 0x561fedbe9240 2024-04-25T09:02:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fedaa9d50 con 0x561fedbe8920 2024-04-25T09:02:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fed988980 con 0x561fedb9ef30 2024-04-25T09:02:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 10 client.0 _ll_register_callbacks cb 0x7f57f8001900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:02:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f5805000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe9240 0x561fedc2d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f5805000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe9240 0x561fedc2d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35934/0 (socket says 172.21.15.173:35934) 2024-04-25T09:02:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f5805000640 1 -- 172.21.15.173:0/2991487684 learned_addr learned my addr 172.21.15.173:0/2991487684 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f57ffe00640 1 --2- 172.21.15.173:0/2991487684 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedb9ef30 0x561fedbf5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f57ff400640 1 --2- 172.21.15.173:0/2991487684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedbe8920 0x561fedbf5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f5805000640 1 -- 172.21.15.173:0/2991487684 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedb9ef30 msgr2=0x561fedbf5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f5805000640 1 --2- 172.21.15.173:0/2991487684 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedb9ef30 0x561fedbf5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f5805000640 1 -- 172.21.15.173:0/2991487684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedbe8920 msgr2=0x561fedbf5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f5805000640 1 --2- 172.21.15.173:0/2991487684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedbe8920 0x561fedbf5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f5805000640 1 -- 172.21.15.173:0/2991487684 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561feda6f600 con 0x561fedbe9240 2024-04-25T09:02:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f5805000640 1 --2- 172.21.15.173:0/2991487684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe9240 0x561fedc2d1c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x561fed991200 tx=0x7f57f8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1a2246c9189d07 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f57e9600640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:02:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f57e9600640 1 -- 172.21.15.173:0/2991487684 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f80054e0 con 0x561fedbe9240 2024-04-25T09:02:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f57e9600640 1 -- 172.21.15.173:0/2991487684 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f57f8005680 con 0x561fedbe9240 2024-04-25T09:02:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.411+0000 7f580a4af000 1 -- 172.21.15.173:0/2991487684 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f57ec01d040 con 0x561fedbe9240 2024-04-25T09:02:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f57e9600640 1 -- 172.21.15.173:0/2991487684 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57f802e050 con 0x561fedbe9240 2024-04-25T09:02:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 10 client.4431 fetch_fsmap learned FSMap version 7 2024-04-25T09:02:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 1 -- 172.21.15.173:0/2991487684 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x561fed9829b0 con 0x561fedbe9240 2024-04-25T09:02:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f57e9600640 1 -- 172.21.15.173:0/2991487684 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ec01d040 con 0x561fedbe9240 2024-04-25T09:02:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f57e9600640 1 -- 172.21.15.173:0/2991487684 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f57f8031020 con 0x561fedbe9240 2024-04-25T09:02:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 10 client.4431 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T09:02:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 10 client.4431 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T09:02:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 20 client.4431 populate_metadata read hostname 'smithi173' 2024-04-25T09:02:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 1 --2- 172.21.15.173:0/2991487684 >> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] conn(0x561fedbf6510 0x561fedc2d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 4 client.4431 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:02:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 1 -- 172.21.15.173:0/2991487684 --> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561fed9fb2e0 con 0x561fedbf6510 2024-04-25T09:02:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f57ffe00640 1 --2- 172.21.15.173:0/2991487684 >> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] conn(0x561fedbf6510 0x561fedc2d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f57e9600640 10 client.4431 ms_handle_connect on v2:172.21.15.194:6833/4160663138 2024-04-25T09:02:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f57ffe00640 1 --2- 172.21.15.173:0/2991487684 >> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] conn(0x561fedbf6510 0x561fedc2d700 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a674a34fcd4b9b69 server_cookie=a7802a4700b3d71 in_seq=0 out_seq=0 2024-04-25T09:02:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f57e9600640 1 -- 172.21.15.173:0/2991487684 <== mds.0 v2:172.21.15.194:6833/4160663138 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x561fed9fb2e0 con 0x561fedbf6510 2024-04-25T09:02:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f57e9600640 10 client.4431 handle_command_reply: tid=0 2024-04-25T09:02:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 1 client.4431 shutdown 2024-04-25T09:02:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 1 -- 172.21.15.173:0/2991487684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe9240 msgr2=0x561fedc2d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 1 --2- 172.21.15.173:0/2991487684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe9240 0x561fedc2d1c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x561fed991200 tx=0x7f57f8001260 comp rx=0 tx=0).stop 2024-04-25T09:02:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 1 -- 172.21.15.173:0/2991487684 shutdown_connections 2024-04-25T09:02:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 1 --2- 172.21.15.173:0/2991487684 >> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] conn(0x561fedbf6510 0x561fedc2d700 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 1 --2- 172.21.15.173:0/2991487684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fedbe9240 0x561fedc2d1c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 1 --2- 172.21.15.173:0/2991487684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561fedbe8920 0x561fedbf5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 1 --2- 172.21.15.173:0/2991487684 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561fedb9ef30 0x561fedbf5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f57e9600640 0 client.4431 ms_handle_reset on v2:172.21.15.194:6833/4160663138 2024-04-25T09:02:59.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 1 -- 172.21.15.173:0/2991487684 >> 172.21.15.173:0/2991487684 conn(0x561fedba52a0 msgr2=0x561fedba1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:59.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 1 -- 172.21.15.173:0/2991487684 shutdown_connections 2024-04-25T09:02:59.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 1 -- 172.21.15.173:0/2991487684 wait complete. 2024-04-25T09:02:59.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f580a4af000 20 client.4431 trim_cache size 0 max 16384 2024-04-25T09:02:59.416 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:02:59.416 INFO:teuthology.orchestra.run.smithi173.stdout: "cluster_fsid": "ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6", 2024-04-25T09:02:59.416 INFO:teuthology.orchestra.run.smithi173.stdout: "whoami": 0, 2024-04-25T09:02:59.417 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 4285, 2024-04-25T09:02:59.417 INFO:teuthology.orchestra.run.smithi173.stdout: "want_state": "up:active", 2024-04-25T09:02:59.417 INFO:teuthology.orchestra.run.smithi173.stdout: "state": "up:active", 2024-04-25T09:02:59.417 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs", 2024-04-25T09:02:59.417 INFO:teuthology.orchestra.run.smithi173.stdout: "rank_uptime": 7.4137142699999998, 2024-04-25T09:02:59.417 INFO:teuthology.orchestra.run.smithi173.stdout: "mdsmap_epoch": 7, 2024-04-25T09:02:59.417 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch": 26, 2024-04-25T09:02:59.418 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T09:02:59.418 INFO:teuthology.orchestra.run.smithi173.stdout: "uptime": 14.722952412 2024-04-25T09:02:59.418 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:02:59.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f5807000640 1 -- 172.21.15.173:0/732057185 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f57e0066f60 msgr2=0x7f57e0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f5807000640 1 --2- 172.21.15.173:0/732057185 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f57e0066f60 0x7f57e0069420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f580006f1e0 tx=0x7f57ec008040 comp rx=0 tx=0).stop 2024-04-25T09:02:59.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f5807000640 1 -- 172.21.15.173:0/732057185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58000cff40 msgr2=0x7f5800136430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f5807000640 1 --2- 172.21.15.173:0/732057185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58000cff40 0x7f5800136430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f57f001c860 tx=0x7f57f001d470 comp rx=0 tx=0).stop 2024-04-25T09:02:59.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f5807000640 1 -- 172.21.15.173:0/732057185 shutdown_connections 2024-04-25T09:02:59.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f5807000640 1 --2- 172.21.15.173:0/732057185 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f57e0066f60 0x7f57e0069420 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f5807000640 1 --2- 172.21.15.173:0/732057185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f580015a2e0 0x7f5800147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f5807000640 1 --2- 172.21.15.173:0/732057185 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5800159f00 0x7f580015a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f5807000640 1 --2- 172.21.15.173:0/732057185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58000cff40 0x7f5800136430 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f5807000640 1 -- 172.21.15.173:0/732057185 >> 172.21.15.173:0/732057185 conn(0x7f580006ac90 msgr2=0x7f58000af5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:59.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f5807000640 1 -- 172.21.15.173:0/732057185 shutdown_connections 2024-04-25T09:02:59.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.415+0000 7f5807000640 1 -- 172.21.15.173:0/732057185 wait complete. 2024-04-25T09:02:59.427 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:02:59.427 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:02:59.428 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:02:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.571+0000 7f98cc600640 1 Processor -- start 2024-04-25T09:02:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.571+0000 7f98cc600640 1 -- start start 2024-04-25T09:02:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.571+0000 7f98cc600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98c40aefa0 0x7f98c40cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.571+0000 7f98cc600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c415f320 con 0x7f98c415edd0 2024-04-25T09:02:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.571+0000 7f98cc600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c406d420 con 0x7f98c40b3e70 2024-04-25T09:02:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.571+0000 7f98cc600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c406dd50 con 0x7f98c40aefa0 2024-04-25T09:02:59.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.571+0000 7f98ca600640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f98c415edd0 0x7f98c40cdce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:55986/0 (socket says 172.21.15.173:55986) 2024-04-25T09:02:59.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.571+0000 7f98ca600640 1 -- 172.21.15.173:0/1365730767 learned_addr learned my addr 172.21.15.173:0/1365730767 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:02:59.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.571+0000 7f98c9200640 1 --2- 172.21.15.173:0/1365730767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98c40aefa0 0x7f98c40cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.571+0000 7f98c3e00640 1 -- 172.21.15.173:0/1365730767 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959872196 0 0) 0x7f98c415f320 con 0x7f98c415edd0 2024-04-25T09:02:59.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.571+0000 7f98c3e00640 1 -- 172.21.15.173:0/1365730767 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98ac003530 con 0x7f98c415edd0 2024-04-25T09:02:59.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.571+0000 7f98c3e00640 1 -- 172.21.15.173:0/1365730767 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501885587 0 0) 0x7f98c406d420 con 0x7f98c40b3e70 2024-04-25T09:02:59.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.571+0000 7f98c9200640 1 -- 172.21.15.173:0/1365730767 >> v1:172.21.15.194:6789/0 conn(0x7f98c40b3e70 legacy=0x7f98c40b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.571+0000 7f98c9200640 1 -- 172.21.15.173:0/1365730767 >> v1:172.21.15.173:6789/0 conn(0x7f98c415edd0 legacy=0x7f98c40cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.571+0000 7f98c9200640 1 -- 172.21.15.173:0/1365730767 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c406d700 con 0x7f98c40aefa0 2024-04-25T09:02:59.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.575+0000 7f98c9200640 1 --2- 172.21.15.173:0/1365730767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98c40aefa0 0x7f98c40cd7a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f98b00097f0 tx=0x7f98b001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dbc9966db05d5fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.575+0000 7f98c3e00640 1 -- 172.21.15.173:0/1365730767 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b00aa430 con 0x7f98c40aefa0 2024-04-25T09:02:59.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.575+0000 7f98c3e00640 1 -- 172.21.15.173:0/1365730767 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b00af070 con 0x7f98c40aefa0 2024-04-25T09:02:59.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.575+0000 7f98c3e00640 1 -- 172.21.15.173:0/1365730767 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b00aa7f0 con 0x7f98c40aefa0 2024-04-25T09:02:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.575+0000 7f98cc600640 1 -- 172.21.15.173:0/1365730767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98c40aefa0 msgr2=0x7f98c40cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.575+0000 7f98cc600640 1 --2- 172.21.15.173:0/1365730767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98c40aefa0 0x7f98c40cd7a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f98b00097f0 tx=0x7f98b001c4b0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.575+0000 7f98cc600640 1 -- 172.21.15.173:0/1365730767 shutdown_connections 2024-04-25T09:02:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.575+0000 7f98cc600640 1 --2- 172.21.15.173:0/1365730767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98c40aefa0 0x7f98c40cd7a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.575+0000 7f98cc600640 1 -- 172.21.15.173:0/1365730767 >> 172.21.15.173:0/1365730767 conn(0x7f98c406ac90 msgr2=0x7f98c406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98cc600640 1 -- 172.21.15.173:0/1365730767 shutdown_connections 2024-04-25T09:02:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98cc600640 1 -- 172.21.15.173:0/1365730767 wait complete. 2024-04-25T09:02:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98cc600640 1 Processor -- start 2024-04-25T09:02:59.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98cc600640 1 -- start start 2024-04-25T09:02:59.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98cc600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98c40aefa0 0x7f98c4139f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98cc600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98c40b3e70 0x7f98c4152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98cc600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98c415edd0 0x7f98c4152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98cc600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c406e360 con 0x7f98c40aefa0 2024-04-25T09:02:59.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98cc600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c406e1e0 con 0x7f98c40b3e70 2024-04-25T09:02:59.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98cc600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c4168fd0 con 0x7f98c415edd0 2024-04-25T09:02:59.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98c9c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98c40aefa0 0x7f98c4139f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98c9c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98c40aefa0 0x7f98c4139f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35946/0 (socket says 172.21.15.173:35946) 2024-04-25T09:02:59.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98c9c00640 1 -- 172.21.15.173:0/1925487583 learned_addr learned my addr 172.21.15.173:0/1925487583 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:02:59.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98ca600640 1 --2- 172.21.15.173:0/1925487583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98c415edd0 0x7f98c4152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98c9200640 1 --2- 172.21.15.173:0/1925487583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98c40b3e70 0x7f98c4152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98c9c00640 1 -- 172.21.15.173:0/1925487583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98c415edd0 msgr2=0x7f98c4152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98c9c00640 1 --2- 172.21.15.173:0/1925487583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98c415edd0 0x7f98c4152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98c9c00640 1 -- 172.21.15.173:0/1925487583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98c40b3e70 msgr2=0x7f98c4152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98c9c00640 1 --2- 172.21.15.173:0/1925487583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98c40b3e70 0x7f98c4152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98c9c00640 1 -- 172.21.15.173:0/1925487583 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c4154b80 con 0x7f98c40aefa0 2024-04-25T09:02:59.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98c9c00640 1 --2- 172.21.15.173:0/1925487583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98c40aefa0 0x7f98c4139f00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f98b800c7a0 tx=0x7f98b800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98c1600640 1 -- 172.21.15.173:0/1925487583 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8017070 con 0x7f98c40aefa0 2024-04-25T09:02:59.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98c1600640 1 -- 172.21.15.173:0/1925487583 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b8003db0 con 0x7f98c40aefa0 2024-04-25T09:02:59.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.579+0000 7f98c1600640 1 -- 172.21.15.173:0/1925487583 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8005270 con 0x7f98c40aefa0 2024-04-25T09:02:59.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.583+0000 7f98cc600640 1 -- 172.21.15.173:0/1925487583 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c414cf60 con 0x7f98c40aefa0 2024-04-25T09:02:59.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.583+0000 7f98cc600640 1 -- 172.21.15.173:0/1925487583 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c41545c0 con 0x7f98c40aefa0 2024-04-25T09:02:59.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.583+0000 7f98cc600640 1 -- 172.21.15.173:0/1925487583 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c4073a40 con 0x7f98c40aefa0 2024-04-25T09:02:59.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.583+0000 7f98c1600640 1 -- 172.21.15.173:0/1925487583 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f98b801a070 con 0x7f98c40aefa0 2024-04-25T09:02:59.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.583+0000 7f98c1600640 1 --2- 172.21.15.173:0/1925487583 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f98a4066f60 0x7f98a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.583+0000 7f98c1600640 1 -- 172.21.15.173:0/1925487583 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f98b80849b0 con 0x7f98c40aefa0 2024-04-25T09:02:59.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.583+0000 7f98c9200640 1 --2- 172.21.15.173:0/1925487583 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f98a4066f60 0x7f98a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.583+0000 7f98c9200640 1 --2- 172.21.15.173:0/1925487583 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f98a4066f60 0x7f98a4069420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f98b00ae000 tx=0x7f98b00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.587+0000 7f98c1600640 1 -- 172.21.15.173:0/1925487583 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f98b8054f90 con 0x7f98c40aefa0 2024-04-25T09:02:59.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.775+0000 7f98cc600640 1 -- 172.21.15.173:0/1925487583 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f98c406f1c0 con 0x7f98c40aefa0 2024-04-25T09:02:59.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.779+0000 7f98c1600640 1 -- 172.21.15.173:0/1925487583 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f98b8059030 con 0x7f98c40aefa0 2024-04-25T09:02:59.770 INFO:teuthology.orchestra.run.smithi173.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T09:02:59.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.779+0000 7f98cc600640 1 -- 172.21.15.173:0/1925487583 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f98a4066f60 msgr2=0x7f98a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.779+0000 7f98cc600640 1 --2- 172.21.15.173:0/1925487583 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f98a4066f60 0x7f98a4069420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f98b00ae000 tx=0x7f98b00a7000 comp rx=0 tx=0).stop 2024-04-25T09:02:59.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.779+0000 7f98cc600640 1 -- 172.21.15.173:0/1925487583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98c40aefa0 msgr2=0x7f98c4139f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.779+0000 7f98cc600640 1 --2- 172.21.15.173:0/1925487583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98c40aefa0 0x7f98c4139f00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f98b800c7a0 tx=0x7f98b800cc60 comp rx=0 tx=0).stop 2024-04-25T09:02:59.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.779+0000 7f98cc600640 1 -- 172.21.15.173:0/1925487583 shutdown_connections 2024-04-25T09:02:59.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.779+0000 7f98cc600640 1 --2- 172.21.15.173:0/1925487583 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f98a4066f60 0x7f98a4069420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.779+0000 7f98cc600640 1 --2- 172.21.15.173:0/1925487583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98c415edd0 0x7f98c4152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.779+0000 7f98cc600640 1 --2- 172.21.15.173:0/1925487583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98c40b3e70 0x7f98c4152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.779+0000 7f98cc600640 1 --2- 172.21.15.173:0/1925487583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98c40aefa0 0x7f98c4139f00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.779+0000 7f98cc600640 1 -- 172.21.15.173:0/1925487583 >> 172.21.15.173:0/1925487583 conn(0x7f98c406ac90 msgr2=0x7f98c414fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:59.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.779+0000 7f98cc600640 1 -- 172.21.15.173:0/1925487583 shutdown_connections 2024-04-25T09:02:59.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:02:59.779+0000 7f98cc600640 1 -- 172.21.15.173:0/1925487583 wait complete. 2024-04-25T09:02:59.790 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:02:59.790 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:02:59.790 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2024-04-25T09:02:59.791 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-25T09:02:59.791 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:02:59.791 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:02:59.791 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:02:59.791 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:02:59.791 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T09:02:59.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:59.791 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2024-04-25T09:02:59.799 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:02:59.800 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:02:59.800 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:02:59.800 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:59.800 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-25T09:02:59.800 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:59.800 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:02:59.800 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:59.800 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2024-04-25T09:02:59.800 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:02:59.800 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:59.800 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2024-04-25T09:02:59.800 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:02:59.800 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:59.801 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:02:59.801 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:59.801 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:02:59.801 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 42438sec preferred_lft 42438sec 2024-04-25T09:02:59.801 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2024-04-25T09:02:59.802 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:59.802 INFO:teuthology.orchestra.run.smithi173.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:02:59.802 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 02:42:00:0e:60:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:59.802 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:02:59.802 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:59.803 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T09:02:59.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:59.803 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:02:59.803 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:02:59.803 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link add name ceph-brx type bridge 2024-04-25T09:02:59.803 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip addr flush dev ceph-brx 2024-04-25T09:02:59.803 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set ceph-brx up 2024-04-25T09:02:59.804 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T09:02:59.804 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:02:59.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:59.911 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:02:59.930 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-04-25T09:02:59.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:59.932 DEBUG:teuthology.orchestra.run.smithi173:> route 2024-04-25T09:03:00.006 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2024-04-25T09:03:00.006 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:03:00.007 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:03:00.007 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:03:00.007 INFO:teuthology.orchestra.run.smithi173.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:03:00.007 INFO:teuthology.orchestra.run.smithi173.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:03:00.007 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:03:00.007 INFO:teuthology.orchestra.run.smithi173.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:03:00.007 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:03:00.008 INFO:teuthology.orchestra.run.smithi173.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:03:00.008 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:03:00.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:00.008 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:03:00.009 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:03:00.009 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:03:00.009 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:03:00.009 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:03:00.009 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:03:00.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:00.099 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-25T09:03:00.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:00.108 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list-id 2024-04-25T09:03:00.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:00.158 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:03:00.158 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:03:00.158 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:03:00.158 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-25T09:03:00.158 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:03:00.240 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-25T09:03:00.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:00.241 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:03:00.241 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:03:00.241 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-25T09:03:00.241 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T09:03:00.241 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-25T09:03:00.241 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-25T09:03:00.241 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-25T09:03:00.241 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:03:00.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:00.402 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:03:00.402 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:03:00.402 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2024-04-25T09:03:00.402 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T09:03:00.402 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:03:00.442 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-25T09:03:00.442 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:00.442 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:03:00.493 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T09:03:00.493 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:00.493 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:03:00.544 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2024-04-25T09:03:00.605 DEBUG:teuthology.orchestra.run.smithi173:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T09:03:00.658 INFO:teuthology.orchestra.run.smithi173.stdout:/sys 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi173.stdout:/proc 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi173.stdout:/dev 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/pts 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi173.stdout:/run 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi173.stdout:/ 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/security 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/shm 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi173.stdout:/run/lock 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/cgroup 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/pstore 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/bpf 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi173.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/hugepages 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/mqueue 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/debug 2024-04-25T09:03:00.660 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/tracing 2024-04-25T09:03:00.660 INFO:teuthology.orchestra.run.smithi173.stdout:/proc/fs/nfsd 2024-04-25T09:03:00.660 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/fuse/connections 2024-04-25T09:03:00.660 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/config 2024-04-25T09:03:00.660 INFO:teuthology.orchestra.run.smithi173.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T09:03:00.660 INFO:teuthology.orchestra.run.smithi173.stdout:/run/rpc_pipefs 2024-04-25T09:03:00.660 INFO:teuthology.orchestra.run.smithi173.stdout:/run/user/1000 2024-04-25T09:03:00.660 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph 2024-04-25T09:03:00.660 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T09:03:00.660 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T09:03:00.660 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T09:03:00.660 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T09:03:00.660 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns 2024-04-25T09:03:00.660 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:03:00.660 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:03:00.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:00.661 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2024-04-25T09:03:00.717 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T09:03:00.718 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-25T09:03:00.768 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2024-04-25T09:03:00.788 DEBUG:teuthology.orchestra.run.smithi173:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T09:03:00.838 INFO:teuthology.orchestra.run.smithi173.stdout:/sys 2024-04-25T09:03:00.838 INFO:teuthology.orchestra.run.smithi173.stdout:/proc 2024-04-25T09:03:00.838 INFO:teuthology.orchestra.run.smithi173.stdout:/dev 2024-04-25T09:03:00.838 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/pts 2024-04-25T09:03:00.838 INFO:teuthology.orchestra.run.smithi173.stdout:/run 2024-04-25T09:03:00.838 INFO:teuthology.orchestra.run.smithi173.stdout:/ 2024-04-25T09:03:00.839 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/security 2024-04-25T09:03:00.839 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/shm 2024-04-25T09:03:00.839 INFO:teuthology.orchestra.run.smithi173.stdout:/run/lock 2024-04-25T09:03:00.839 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/cgroup 2024-04-25T09:03:00.839 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/pstore 2024-04-25T09:03:00.839 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/bpf 2024-04-25T09:03:00.839 INFO:teuthology.orchestra.run.smithi173.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T09:03:00.839 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/hugepages 2024-04-25T09:03:00.839 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/mqueue 2024-04-25T09:03:00.839 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/debug 2024-04-25T09:03:00.839 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/tracing 2024-04-25T09:03:00.839 INFO:teuthology.orchestra.run.smithi173.stdout:/proc/fs/nfsd 2024-04-25T09:03:00.839 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/fuse/connections 2024-04-25T09:03:00.839 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/config 2024-04-25T09:03:00.839 INFO:teuthology.orchestra.run.smithi173.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T09:03:00.840 INFO:teuthology.orchestra.run.smithi173.stdout:/run/rpc_pipefs 2024-04-25T09:03:00.840 INFO:teuthology.orchestra.run.smithi173.stdout:/run/user/1000 2024-04-25T09:03:00.840 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph 2024-04-25T09:03:00.840 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T09:03:00.840 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T09:03:00.840 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T09:03:00.840 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T09:03:00.840 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns 2024-04-25T09:03:00.840 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:03:00.841 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:03:00.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:00.841 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2024-04-25T09:03:00.863 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi173.stderr:2024-04-25T09:03:00.871+0000 7fb24545e580 -1 init, newargv = 0x564f408e9580 newargc=15 2024-04-25T09:03:00.863 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi173.stderr:ceph-fuse[34126]: starting ceph client 2024-04-25T09:03:00.873 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi173.stderr:ceph-fuse[34126]: starting fuse 2024-04-25T09:03:01.973 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2024-04-25T09:03:01.996 DEBUG:teuthology.orchestra.run.smithi173:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T09:03:02.047 INFO:teuthology.orchestra.run.smithi173.stdout:/sys 2024-04-25T09:03:02.048 INFO:teuthology.orchestra.run.smithi173.stdout:/proc 2024-04-25T09:03:02.048 INFO:teuthology.orchestra.run.smithi173.stdout:/dev 2024-04-25T09:03:02.048 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/pts 2024-04-25T09:03:02.048 INFO:teuthology.orchestra.run.smithi173.stdout:/run 2024-04-25T09:03:02.048 INFO:teuthology.orchestra.run.smithi173.stdout:/ 2024-04-25T09:03:02.048 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/security 2024-04-25T09:03:02.048 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/shm 2024-04-25T09:03:02.048 INFO:teuthology.orchestra.run.smithi173.stdout:/run/lock 2024-04-25T09:03:02.048 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/cgroup 2024-04-25T09:03:02.048 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/pstore 2024-04-25T09:03:02.048 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/bpf 2024-04-25T09:03:02.048 INFO:teuthology.orchestra.run.smithi173.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T09:03:02.048 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/hugepages 2024-04-25T09:03:02.049 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/mqueue 2024-04-25T09:03:02.049 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/debug 2024-04-25T09:03:02.049 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/tracing 2024-04-25T09:03:02.049 INFO:teuthology.orchestra.run.smithi173.stdout:/proc/fs/nfsd 2024-04-25T09:03:02.049 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/fuse/connections 2024-04-25T09:03:02.049 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/config 2024-04-25T09:03:02.049 INFO:teuthology.orchestra.run.smithi173.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T09:03:02.049 INFO:teuthology.orchestra.run.smithi173.stdout:/run/rpc_pipefs 2024-04-25T09:03:02.049 INFO:teuthology.orchestra.run.smithi173.stdout:/run/user/1000 2024-04-25T09:03:02.049 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph 2024-04-25T09:03:02.049 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T09:03:02.049 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T09:03:02.049 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T09:03:02.049 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T09:03:02.050 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns 2024-04-25T09:03:02.050 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:03:02.050 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:03:02.050 INFO:teuthology.orchestra.run.smithi173.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-25T09:03:02.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:02.051 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2024-04-25T09:03:02.102 INFO:teuthology.orchestra.run.smithi173.stdout:44 2024-04-25T09:03:02.102 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-25T09:03:02.102 DEBUG:teuthology.orchestra.run.smithi173:> sudo stdin-killer -- python3 -c ' 2024-04-25T09:03:02.102 DEBUG:teuthology.orchestra.run.smithi173:> import glob 2024-04-25T09:03:02.102 DEBUG:teuthology.orchestra.run.smithi173:> import re 2024-04-25T09:03:02.102 DEBUG:teuthology.orchestra.run.smithi173:> import os 2024-04-25T09:03:02.102 DEBUG:teuthology.orchestra.run.smithi173:> import subprocess 2024-04-25T09:03:02.103 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:03:02.103 DEBUG:teuthology.orchestra.run.smithi173:> def _find_admin_socket(client_name): 2024-04-25T09:03:02.103 DEBUG:teuthology.orchestra.run.smithi173:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-25T09:03:02.103 DEBUG:teuthology.orchestra.run.smithi173:> files = glob.glob(asok_path) 2024-04-25T09:03:02.103 DEBUG:teuthology.orchestra.run.smithi173:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-25T09:03:02.103 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:03:02.103 DEBUG:teuthology.orchestra.run.smithi173:> # Given a non-glob path, it better be there 2024-04-25T09:03:02.103 DEBUG:teuthology.orchestra.run.smithi173:> if "*" not in asok_path: 2024-04-25T09:03:02.103 DEBUG:teuthology.orchestra.run.smithi173:> assert(len(files) == 1) 2024-04-25T09:03:02.103 DEBUG:teuthology.orchestra.run.smithi173:> return files[0] 2024-04-25T09:03:02.103 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:03:02.103 DEBUG:teuthology.orchestra.run.smithi173:> for f in files: 2024-04-25T09:03:02.103 DEBUG:teuthology.orchestra.run.smithi173:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T09:03:02.103 DEBUG:teuthology.orchestra.run.smithi173:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T09:03:02.103 DEBUG:teuthology.orchestra.run.smithi173:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T09:03:02.103 DEBUG:teuthology.orchestra.run.smithi173:> contents = proc_f.read() 2024-04-25T09:03:02.104 DEBUG:teuthology.orchestra.run.smithi173:> if mountpoint in contents: 2024-04-25T09:03:02.104 DEBUG:teuthology.orchestra.run.smithi173:> return f 2024-04-25T09:03:02.104 DEBUG:teuthology.orchestra.run.smithi173:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T09:03:02.104 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:03:02.104 DEBUG:teuthology.orchestra.run.smithi173:> print(_find_admin_socket("client.admin")) 2024-04-25T09:03:02.104 DEBUG:teuthology.orchestra.run.smithi173:> ' 2024-04-25T09:03:02.232 INFO:teuthology.orchestra.run.smithi173.stdout:/var/run/ceph/ceph-client.admin.34126.asok 2024-04-25T09:03:02.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:02.245 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.34126.asok 2024-04-25T09:03:02.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:02.245 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.34126.asok status 2024-04-25T09:03:02.416 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:03:02.416 INFO:teuthology.orchestra.run.smithi173.stdout: "metadata": { 2024-04-25T09:03:02.416 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_sha1": "97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec", 2024-04-25T09:03:02.417 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 19.0.0-1628-g97ae6cc9 (97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec) squid (dev)", 2024-04-25T09:03:02.417 INFO:teuthology.orchestra.run.smithi173.stdout: "entity_id": "admin", 2024-04-25T09:03:02.417 INFO:teuthology.orchestra.run.smithi173.stdout: "hostname": "smithi173", 2024-04-25T09:03:02.417 INFO:teuthology.orchestra.run.smithi173.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-25T09:03:02.417 INFO:teuthology.orchestra.run.smithi173.stdout: "pid": "34126", 2024-04-25T09:03:02.417 INFO:teuthology.orchestra.run.smithi173.stdout: "root": "/" 2024-04-25T09:03:02.417 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:02.417 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_count": 0, 2024-04-25T09:03:02.417 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_pinned_count": 0, 2024-04-25T09:03:02.417 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 4446, 2024-04-25T09:03:02.417 INFO:teuthology.orchestra.run.smithi173.stdout: "inst": { 2024-04-25T09:03:02.417 INFO:teuthology.orchestra.run.smithi173.stdout: "name": { 2024-04-25T09:03:02.417 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "client", 2024-04-25T09:03:02.417 INFO:teuthology.orchestra.run.smithi173.stdout: "num": 4446 2024-04-25T09:03:02.417 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:02.418 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2024-04-25T09:03:02.418 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2024-04-25T09:03:02.418 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2024-04-25T09:03:02.418 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 1636184529 2024-04-25T09:03:02.418 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:02.418 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:02.418 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2024-04-25T09:03:02.418 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2024-04-25T09:03:02.418 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2024-04-25T09:03:02.418 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 1636184529 2024-04-25T09:03:02.418 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:02.418 INFO:teuthology.orchestra.run.smithi173.stdout: "inst_str": "client.4446 192.168.0.1:0/1636184529", 2024-04-25T09:03:02.418 INFO:teuthology.orchestra.run.smithi173.stdout: "addr_str": "192.168.0.1:0/1636184529", 2024-04-25T09:03:02.418 INFO:teuthology.orchestra.run.smithi173.stdout: "inode_count": 1, 2024-04-25T09:03:02.418 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_epoch": 7, 2024-04-25T09:03:02.419 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch": 26, 2024-04-25T09:03:02.419 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch_barrier": 0, 2024-04-25T09:03:02.419 INFO:teuthology.orchestra.run.smithi173.stdout: "blocklisted": false, 2024-04-25T09:03:02.419 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs" 2024-04-25T09:03:02.419 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:03:02.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:02.431 DEBUG:teuthology.orchestra.run.smithi173:> stat --file-system '--printf=%T 2024-04-25T09:03:02.431 DEBUG:teuthology.orchestra.run.smithi173:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:03:02.441 INFO:teuthology.orchestra.run.smithi173.stdout:fuseblk 2024-04-25T09:03:02.441 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:03:02.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:02.441 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:03:02.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:02.506 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-25T09:03:02.592 INFO:teuthology.orchestra.run.smithi173.stdout:# file: . 2024-04-25T09:03:02.593 INFO:teuthology.orchestra.run.smithi173.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-25T09:03:02.593 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:02.593 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:03:02.593 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:02.641 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:02.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.827+0000 7f32bdc00640 1 Processor -- start 2024-04-25T09:03:02.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.827+0000 7f32bdc00640 1 -- start start 2024-04-25T09:03:02.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.827+0000 7f32bdc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f32b8145250 0x7f32b815c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:02.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.827+0000 7f32bdc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f32b80cc8b0 0x7f32b80ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:02.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.827+0000 7f32bdc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b815cec0 con 0x7f32b8071320 2024-04-25T09:03:02.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.827+0000 7f32bdc00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b806e7c0 con 0x7f32b80cc8b0 2024-04-25T09:03:02.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.827+0000 7f32bdc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b806d720 con 0x7f32b8145250 2024-04-25T09:03:02.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.831+0000 7f32afe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f32b80cc8b0 0x7f32b80ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:02.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.831+0000 7f32afe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f32b80cc8b0 0x7f32b80ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35962/0 (socket says 172.21.15.173:35962) 2024-04-25T09:03:02.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.831+0000 7f32afe00640 1 -- 172.21.15.173:0/2969630984 learned_addr learned my addr 172.21.15.173:0/2969630984 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:02.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.831+0000 7f32b6a00640 1 --2- 172.21.15.173:0/2969630984 >> v2:172.21.15.194:3300/0 conn(0x7f32b8145250 0x7f32b815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:02.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.831+0000 7f32afe00640 1 -- 172.21.15.173:0/2969630984 >> v2:172.21.15.194:3300/0 conn(0x7f32b8145250 msgr2=0x7f32b815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:02.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.831+0000 7f32afe00640 1 --2- 172.21.15.173:0/2969630984 >> v2:172.21.15.194:3300/0 conn(0x7f32b8145250 0x7f32b815c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:02.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.831+0000 7f32afe00640 1 -- 172.21.15.173:0/2969630984 >> v1:172.21.15.194:6789/0 conn(0x7f32b8071320 legacy=0x7f32b8071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:02.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.831+0000 7f32afe00640 1 -- 172.21.15.173:0/2969630984 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b806da00 con 0x7f32b80cc8b0 2024-04-25T09:03:02.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.831+0000 7f32afe00640 1 --2- 172.21.15.173:0/2969630984 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b80cc8b0 0x7f32b80ccd30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f32b80d0420 tx=0x7f32a001c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a183901482c4d64a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:02.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.831+0000 7f32b6000640 1 -- 172.21.15.173:0/2969630984 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a00b0070 con 0x7f32b80cc8b0 2024-04-25T09:03:02.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.831+0000 7f32b6000640 1 -- 172.21.15.173:0/2969630984 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a00ab600 con 0x7f32b80cc8b0 2024-04-25T09:03:02.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.831+0000 7f32b6000640 1 -- 172.21.15.173:0/2969630984 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a00ab9d0 con 0x7f32b80cc8b0 2024-04-25T09:03:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32bdc00640 1 -- 172.21.15.173:0/2969630984 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b80cc8b0 msgr2=0x7f32b80ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32bdc00640 1 --2- 172.21.15.173:0/2969630984 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b80cc8b0 0x7f32b80ccd30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f32b80d0420 tx=0x7f32a001c300 comp rx=0 tx=0).stop 2024-04-25T09:03:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32bdc00640 1 -- 172.21.15.173:0/2969630984 shutdown_connections 2024-04-25T09:03:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32bdc00640 1 --2- 172.21.15.173:0/2969630984 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b80cc8b0 0x7f32b80ccd30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32bdc00640 1 --2- 172.21.15.173:0/2969630984 >> v2:172.21.15.194:3300/0 conn(0x7f32b8145250 0x7f32b815c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32bdc00640 1 -- 172.21.15.173:0/2969630984 >> 172.21.15.173:0/2969630984 conn(0x7f32b806ac90 msgr2=0x7f32b806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32bdc00640 1 -- 172.21.15.173:0/2969630984 shutdown_connections 2024-04-25T09:03:02.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32bdc00640 1 -- 172.21.15.173:0/2969630984 wait complete. 2024-04-25T09:03:02.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32bdc00640 1 Processor -- start 2024-04-25T09:03:02.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32bdc00640 1 -- start start 2024-04-25T09:03:02.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32bdc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32b8071320 0x7f32b813e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:02.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32bdc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b80cc8b0 0x7f32b80ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:02.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32bdc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32b8145250 0x7f32b815d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:02.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32bdc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b806ef80 con 0x7f32b80cc8b0 2024-04-25T09:03:02.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32bdc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b8145630 con 0x7f32b8145250 2024-04-25T09:03:02.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32bdc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b806d380 con 0x7f32b8071320 2024-04-25T09:03:02.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32afe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b80cc8b0 0x7f32b80ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:02.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32afe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b80cc8b0 0x7f32b80ad4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35966/0 (socket says 172.21.15.173:35966) 2024-04-25T09:03:02.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32afe00640 1 -- 172.21.15.173:0/2478228394 learned_addr learned my addr 172.21.15.173:0/2478228394 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:02.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32b6a00640 1 --2- 172.21.15.173:0/2478228394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32b8071320 0x7f32b813e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:02.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32b7400640 1 --2- 172.21.15.173:0/2478228394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32b8145250 0x7f32b815d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:02.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32afe00640 1 -- 172.21.15.173:0/2478228394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32b8071320 msgr2=0x7f32b813e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:02.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32afe00640 1 --2- 172.21.15.173:0/2478228394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32b8071320 0x7f32b813e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:02.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32afe00640 1 -- 172.21.15.173:0/2478228394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32b8145250 msgr2=0x7f32b815d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:02.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32afe00640 1 --2- 172.21.15.173:0/2478228394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32b8145250 0x7f32b815d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:02.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.835+0000 7f32afe00640 1 -- 172.21.15.173:0/2478228394 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b813e700 con 0x7f32b80cc8b0 2024-04-25T09:03:02.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.839+0000 7f32afe00640 1 --2- 172.21.15.173:0/2478228394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b80cc8b0 0x7f32b80ad4e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f32a001a9b0 tx=0x7f32a00190a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:02.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.839+0000 7f32aea00640 1 -- 172.21.15.173:0/2478228394 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a00ba070 con 0x7f32b80cc8b0 2024-04-25T09:03:02.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.839+0000 7f32aea00640 1 -- 172.21.15.173:0/2478228394 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a00b4420 con 0x7f32b80cc8b0 2024-04-25T09:03:02.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.839+0000 7f32bdc00640 1 -- 172.21.15.173:0/2478228394 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b80add50 con 0x7f32b80cc8b0 2024-04-25T09:03:02.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.839+0000 7f32aea00640 1 -- 172.21.15.173:0/2478228394 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a00b0040 con 0x7f32b80cc8b0 2024-04-25T09:03:02.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.839+0000 7f32bdc00640 1 -- 172.21.15.173:0/2478228394 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b80ae310 con 0x7f32b80cc8b0 2024-04-25T09:03:02.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.839+0000 7f32bdc00640 1 -- 172.21.15.173:0/2478228394 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b8073a40 con 0x7f32b80cc8b0 2024-04-25T09:03:02.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.839+0000 7f32aea00640 1 -- 172.21.15.173:0/2478228394 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f32a00bd070 con 0x7f32b80cc8b0 2024-04-25T09:03:02.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.839+0000 7f32aea00640 1 --2- 172.21.15.173:0/2478228394 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3294066f60 0x7f3294069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:02.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.839+0000 7f32aea00640 1 -- 172.21.15.173:0/2478228394 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f32a011e4d0 con 0x7f32b80cc8b0 2024-04-25T09:03:02.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.839+0000 7f32b6a00640 1 --2- 172.21.15.173:0/2478228394 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3294066f60 0x7f3294069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:02.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.843+0000 7f32b6a00640 1 --2- 172.21.15.173:0/2478228394 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3294066f60 0x7f3294069420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f32a800b9d0 tx=0x7f32a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:02.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.843+0000 7f32aea00640 1 -- 172.21.15.173:0/2478228394 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f32b815cec0 con 0x7f32b80cc8b0 2024-04-25T09:03:02.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.999+0000 7f32bdc00640 1 -- 172.21.15.173:0/2478228394 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32b80aeb00 con 0x7f32b80cc8b0 2024-04-25T09:03:02.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:02.999+0000 7f32aea00640 1 -- 172.21.15.173:0/2478228394 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18574 (secure 0 0 0) 0x7f32a00ef190 con 0x7f32b80cc8b0 2024-04-25T09:03:02.992 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:02.993 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:56.440593+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:02.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.003+0000 7f32bdc00640 1 -- 172.21.15.173:0/2478228394 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3294066f60 msgr2=0x7f3294069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:02.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.003+0000 7f32bdc00640 1 --2- 172.21.15.173:0/2478228394 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3294066f60 0x7f3294069420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f32a800b9d0 tx=0x7f32a8008040 comp rx=0 tx=0).stop 2024-04-25T09:03:02.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.003+0000 7f32bdc00640 1 -- 172.21.15.173:0/2478228394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b80cc8b0 msgr2=0x7f32b80ad4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:02.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.003+0000 7f32bdc00640 1 --2- 172.21.15.173:0/2478228394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b80cc8b0 0x7f32b80ad4e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f32a001a9b0 tx=0x7f32a00190a0 comp rx=0 tx=0).stop 2024-04-25T09:03:02.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.003+0000 7f32bdc00640 1 -- 172.21.15.173:0/2478228394 shutdown_connections 2024-04-25T09:03:02.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.003+0000 7f32bdc00640 1 --2- 172.21.15.173:0/2478228394 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3294066f60 0x7f3294069420 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:02.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.003+0000 7f32bdc00640 1 --2- 172.21.15.173:0/2478228394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32b8145250 0x7f32b815d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:02.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.003+0000 7f32bdc00640 1 --2- 172.21.15.173:0/2478228394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b80cc8b0 0x7f32b80ad4e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:02.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.003+0000 7f32bdc00640 1 --2- 172.21.15.173:0/2478228394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32b8071320 0x7f32b813e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:02.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.003+0000 7f32bdc00640 1 -- 172.21.15.173:0/2478228394 >> 172.21.15.173:0/2478228394 conn(0x7f32b806ac90 msgr2=0x7f32b815bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:02.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.003+0000 7f32bdc00640 1 -- 172.21.15.173:0/2478228394 shutdown_connections 2024-04-25T09:03:02.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.003+0000 7f32bdc00640 1 -- 172.21.15.173:0/2478228394 wait complete. 2024-04-25T09:03:03.013 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:02:49.342297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:02:50.386069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:02:54.077429+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:03:03.014 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:03.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.163+0000 7f068f800640 1 Processor -- start 2024-04-25T09:03:03.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.163+0000 7f068f800640 1 -- start start 2024-04-25T09:03:03.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.163+0000 7f068f800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0688070e70 0x7f0688071320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.163+0000 7f068f800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f06880b5a60 0x7f06880b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.163+0000 7f068f800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06880b0ec0 con 0x7f0688158210 2024-04-25T09:03:03.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.163+0000 7f068f800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0688071860 con 0x7f0688070e70 2024-04-25T09:03:03.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.163+0000 7f068f800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06880b1190 con 0x7f06880b5a60 2024-04-25T09:03:03.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.163+0000 7f0687e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0688070e70 0x7f0688071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.163+0000 7f068ce00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f0688158210 0x7f06880b07b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:55996/0 (socket says 172.21.15.173:55996) 2024-04-25T09:03:03.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.163+0000 7f068ce00640 1 -- 172.21.15.173:0/3016527505 learned_addr learned my addr 172.21.15.173:0/3016527505 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:03.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.163+0000 7f068d800640 1 --2- 172.21.15.173:0/3016527505 >> v2:172.21.15.194:3300/0 conn(0x7f06880b5a60 0x7f06880b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.163+0000 7f0687e00640 1 -- 172.21.15.173:0/3016527505 >> v2:172.21.15.194:3300/0 conn(0x7f06880b5a60 msgr2=0x7f06880b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:03.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.163+0000 7f0687e00640 1 --2- 172.21.15.173:0/3016527505 >> v2:172.21.15.194:3300/0 conn(0x7f06880b5a60 0x7f06880b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.163+0000 7f0687e00640 1 -- 172.21.15.173:0/3016527505 >> v1:172.21.15.173:6789/0 conn(0x7f0688158210 legacy=0x7f06880b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.163+0000 7f0687e00640 1 -- 172.21.15.173:0/3016527505 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068815e5d0 con 0x7f0688070e70 2024-04-25T09:03:03.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.163+0000 7f0687400640 1 -- 172.21.15.173:0/3016527505 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431516384 0 0) 0x7f06880b0ec0 con 0x7f0688158210 2024-04-25T09:03:03.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.167+0000 7f0687e00640 1 --2- 172.21.15.173:0/3016527505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0688070e70 0x7f0688071320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f06740097c0 tx=0x7f067401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3bed292baed2f1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:03.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.167+0000 7f0687400640 1 -- 172.21.15.173:0/3016527505 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06740b0070 con 0x7f0688070e70 2024-04-25T09:03:03.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.167+0000 7f0687400640 1 -- 172.21.15.173:0/3016527505 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06740ab600 con 0x7f0688070e70 2024-04-25T09:03:03.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.167+0000 7f0687400640 1 -- 172.21.15.173:0/3016527505 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06740ab9d0 con 0x7f0688070e70 2024-04-25T09:03:03.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.167+0000 7f068f800640 1 -- 172.21.15.173:0/3016527505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0688070e70 msgr2=0x7f0688071320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.167+0000 7f068f800640 1 --2- 172.21.15.173:0/3016527505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0688070e70 0x7f0688071320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f06740097c0 tx=0x7f067401c3a0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.167+0000 7f068f800640 1 -- 172.21.15.173:0/3016527505 shutdown_connections 2024-04-25T09:03:03.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.167+0000 7f068f800640 1 --2- 172.21.15.173:0/3016527505 >> v2:172.21.15.194:3300/0 conn(0x7f06880b5a60 0x7f06880b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.167+0000 7f068f800640 1 --2- 172.21.15.173:0/3016527505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0688070e70 0x7f0688071320 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.167+0000 7f068f800640 1 -- 172.21.15.173:0/3016527505 >> 172.21.15.173:0/3016527505 conn(0x7f06880b3540 msgr2=0x7f06880b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:03.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.167+0000 7f068f800640 1 -- 172.21.15.173:0/3016527505 shutdown_connections 2024-04-25T09:03:03.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.167+0000 7f068f800640 1 -- 172.21.15.173:0/3016527505 wait complete. 2024-04-25T09:03:03.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f068f800640 1 Processor -- start 2024-04-25T09:03:03.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f068f800640 1 -- start start 2024-04-25T09:03:03.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f068f800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0688070e70 0x7f068814dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f068f800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06880b5a60 0x7f06880cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f068f800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0688158210 0x7f06880cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f068f800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0688158770 con 0x7f06880b5a60 2024-04-25T09:03:03.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f068f800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06881585f0 con 0x7f0688070e70 2024-04-25T09:03:03.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f068f800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068815f0b0 con 0x7f0688158210 2024-04-25T09:03:03.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f0687e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06880b5a60 0x7f06880cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f0687e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06880b5a60 0x7f06880cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35998/0 (socket says 172.21.15.173:35998) 2024-04-25T09:03:03.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f0687e00640 1 -- 172.21.15.173:0/1652813985 learned_addr learned my addr 172.21.15.173:0/1652813985 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:03.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f0687e00640 1 -- 172.21.15.173:0/1652813985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0688158210 msgr2=0x7f06880cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f0687e00640 1 --2- 172.21.15.173:0/1652813985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0688158210 0x7f06880cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f0687e00640 1 -- 172.21.15.173:0/1652813985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0688070e70 msgr2=0x7f068814dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f068ce00640 1 --2- 172.21.15.173:0/1652813985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0688070e70 0x7f068814dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f0687e00640 1 --2- 172.21.15.173:0/1652813985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0688070e70 0x7f068814dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f0687e00640 1 -- 172.21.15.173:0/1652813985 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06880b1be0 con 0x7f06880b5a60 2024-04-25T09:03:03.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f068ce00640 1 --2- 172.21.15.173:0/1652813985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0688070e70 0x7f068814dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:03.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f0687e00640 1 --2- 172.21.15.173:0/1652813985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06880b5a60 0x7f06880cb5b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0674018fb0 tx=0x7f0674019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:03.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f0684c00640 1 -- 172.21.15.173:0/1652813985 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06740b8020 con 0x7f06880b5a60 2024-04-25T09:03:03.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f0684c00640 1 -- 172.21.15.173:0/1652813985 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06740b4410 con 0x7f06880b5a60 2024-04-25T09:03:03.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f068f800640 1 -- 172.21.15.173:0/1652813985 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0688156560 con 0x7f06880b5a60 2024-04-25T09:03:03.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f0684c00640 1 -- 172.21.15.173:0/1652813985 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06740b0040 con 0x7f06880b5a60 2024-04-25T09:03:03.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f068f800640 1 -- 172.21.15.173:0/1652813985 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0688156b20 con 0x7f06880b5a60 2024-04-25T09:03:03.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.171+0000 7f068f800640 1 -- 172.21.15.173:0/1652813985 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0688073ab0 con 0x7f06880b5a60 2024-04-25T09:03:03.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.175+0000 7f0684c00640 1 -- 172.21.15.173:0/1652813985 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f06740bb020 con 0x7f06880b5a60 2024-04-25T09:03:03.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.175+0000 7f0684c00640 1 --2- 172.21.15.173:0/1652813985 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0668066f60 0x7f0668069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.175+0000 7f0684c00640 1 -- 172.21.15.173:0/1652813985 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f067411f220 con 0x7f06880b5a60 2024-04-25T09:03:03.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.175+0000 7f068ce00640 1 --2- 172.21.15.173:0/1652813985 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0668066f60 0x7f0668069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.175+0000 7f068ce00640 1 --2- 172.21.15.173:0/1652813985 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0668066f60 0x7f0668069420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0678007fd0 tx=0x7f0678009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:03.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.179+0000 7f0684c00640 1 -- 172.21.15.173:0/1652813985 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f06740c2030 con 0x7f06880b5a60 2024-04-25T09:03:03.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.335+0000 7f068f800640 1 -- 172.21.15.173:0/1652813985 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0688161280 con 0x7f06880b5a60 2024-04-25T09:03:03.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.335+0000 7f0684c00640 1 -- 172.21.15.173:0/1652813985 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0674016050 con 0x7f06880b5a60 2024-04-25T09:03:03.327 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:03:03.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.335+0000 7f068f800640 1 -- 172.21.15.173:0/1652813985 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0668066f60 msgr2=0x7f0668069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.335+0000 7f068f800640 1 --2- 172.21.15.173:0/1652813985 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0668066f60 0x7f0668069420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0678007fd0 tx=0x7f0678009040 comp rx=0 tx=0).stop 2024-04-25T09:03:03.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.335+0000 7f068f800640 1 -- 172.21.15.173:0/1652813985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06880b5a60 msgr2=0x7f06880cb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.335+0000 7f068f800640 1 --2- 172.21.15.173:0/1652813985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06880b5a60 0x7f06880cb5b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0674018fb0 tx=0x7f0674019140 comp rx=0 tx=0).stop 2024-04-25T09:03:03.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.335+0000 7f068f800640 1 -- 172.21.15.173:0/1652813985 shutdown_connections 2024-04-25T09:03:03.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.335+0000 7f068f800640 1 --2- 172.21.15.173:0/1652813985 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0668066f60 0x7f0668069420 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.335+0000 7f068f800640 1 --2- 172.21.15.173:0/1652813985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0688158210 0x7f06880cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.335+0000 7f068f800640 1 --2- 172.21.15.173:0/1652813985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06880b5a60 0x7f06880cb5b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.335+0000 7f068f800640 1 --2- 172.21.15.173:0/1652813985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0688070e70 0x7f068814dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.335+0000 7f068f800640 1 -- 172.21.15.173:0/1652813985 >> 172.21.15.173:0/1652813985 conn(0x7f06880b3540 msgr2=0x7f06881692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:03.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.335+0000 7f068f800640 1 -- 172.21.15.173:0/1652813985 shutdown_connections 2024-04-25T09:03:03.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.335+0000 7f068f800640 1 -- 172.21.15.173:0/1652813985 wait complete. 2024-04-25T09:03:03.348 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:03.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.491+0000 7ff3faa00640 1 Processor -- start 2024-04-25T09:03:03.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.491+0000 7ff3faa00640 1 -- start start 2024-04-25T09:03:03.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3faa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff3f4145290 0x7ff3f415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3faa00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f415c5f0 con 0x7ff3f40b3fe0 2024-04-25T09:03:03.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3faa00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f406d4b0 con 0x7ff3f40cc260 2024-04-25T09:03:03.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3faa00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f40ccd80 con 0x7ff3f4145290 2024-04-25T09:03:03.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3eb400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ff3f40b3fe0 0x7ff3f40b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60380/0 (socket says 172.21.15.173:60380) 2024-04-25T09:03:03.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3eb400640 1 -- 172.21.15.173:0/1525047314 learned_addr learned my addr 172.21.15.173:0/1525047314 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:03.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f3e00640 1 --2- 172.21.15.173:0/1525047314 >> v2:172.21.15.194:3300/0 conn(0x7ff3f4145290 0x7ff3f415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f3400640 1 -- 172.21.15.173:0/1525047314 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762761858 0 0) 0x7ff3dc001120 con 0x7ff3f40b3fe0 2024-04-25T09:03:03.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f3400640 1 -- 172.21.15.173:0/1525047314 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3d8003530 con 0x7ff3f40b3fe0 2024-04-25T09:03:03.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f3400640 1 -- 172.21.15.173:0/1525047314 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3579106738 0 0) 0x7ff3d8003530 con 0x7ff3f40b3fe0 2024-04-25T09:03:03.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f3400640 1 -- 172.21.15.173:0/1525047314 >> v2:172.21.15.194:3300/0 conn(0x7ff3f4145290 msgr2=0x7ff3f415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:03.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f3400640 1 --2- 172.21.15.173:0/1525047314 >> v2:172.21.15.194:3300/0 conn(0x7ff3f4145290 0x7ff3f415c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f3400640 1 -- 172.21.15.173:0/1525047314 >> v1:172.21.15.194:6789/0 conn(0x7ff3f40cc260 legacy=0x7ff3f40cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f3400640 1 -- 172.21.15.173:0/1525047314 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f406d790 con 0x7ff3f40b3fe0 2024-04-25T09:03:03.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f3400640 1 -- 172.21.15.173:0/1525047314 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7ff3dc001870 con 0x7ff3f40b3fe0 2024-04-25T09:03:03.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f3400640 1 -- 172.21.15.173:0/1525047314 >> v1:172.21.15.173:6789/0 conn(0x7ff3f40b3fe0 legacy=0x7ff3f40b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f3400640 1 --2- 172.21.15.173:0/1525047314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3d80039c0 0x7ff3d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f3400640 1 --2- 172.21.15.173:0/1525047314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3d8004810 0x7ff3d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f3400640 1 --2- 172.21.15.173:0/1525047314 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3d80052f0 0x7ff3d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f3400640 1 -- 172.21.15.173:0/1525047314 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f40ccd80 con 0x7ff3d8004810 2024-04-25T09:03:03.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f3400640 1 -- 172.21.15.173:0/1525047314 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d800c1c0 con 0x7ff3d80039c0 2024-04-25T09:03:03.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f3400640 1 -- 172.21.15.173:0/1525047314 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d800c3c0 con 0x7ff3d80052f0 2024-04-25T09:03:03.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3eb400640 1 --2- 172.21.15.173:0/1525047314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3d8004810 0x7ff3d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f3e00640 1 --2- 172.21.15.173:0/1525047314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3d80039c0 0x7ff3d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f8a00640 1 --2- 172.21.15.173:0/1525047314 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3d80052f0 0x7ff3d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3eb400640 1 -- 172.21.15.173:0/1525047314 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3d80052f0 msgr2=0x7ff3d800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:03.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3eb400640 1 --2- 172.21.15.173:0/1525047314 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3d80052f0 0x7ff3d800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3eb400640 1 -- 172.21.15.173:0/1525047314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3d80039c0 msgr2=0x7ff3d8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:03.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3eb400640 1 --2- 172.21.15.173:0/1525047314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3d80039c0 0x7ff3d8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3eb400640 1 -- 172.21.15.173:0/1525047314 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d8003530 con 0x7ff3d8004810 2024-04-25T09:03:03.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f3e00640 1 --2- 172.21.15.173:0/1525047314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3d80039c0 0x7ff3d8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:03.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.495+0000 7ff3f8a00640 1 -- 172.21.15.173:0/1525047314 reap_dead start 2024-04-25T09:03:03.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.499+0000 7ff3eb400640 1 --2- 172.21.15.173:0/1525047314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3d8004810 0x7ff3d8004c90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40b4bc0 tx=0x7ff3dc01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aff67483faeb446 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:03.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.499+0000 7ff3f3400640 1 -- 172.21.15.173:0/1525047314 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc00c0e0 con 0x7ff3d8004810 2024-04-25T09:03:03.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.499+0000 7ff3f3400640 1 -- 172.21.15.173:0/1525047314 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc0a9070 con 0x7ff3d8004810 2024-04-25T09:03:03.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.499+0000 7ff3f3400640 1 -- 172.21.15.173:0/1525047314 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc005d20 con 0x7ff3d8004810 2024-04-25T09:03:03.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.499+0000 7ff3faa00640 1 -- 172.21.15.173:0/1525047314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3d8004810 msgr2=0x7ff3d8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.499+0000 7ff3faa00640 1 --2- 172.21.15.173:0/1525047314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3d8004810 0x7ff3d8004c90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40b4bc0 tx=0x7ff3dc01cc20 comp rx=0 tx=0).stop 2024-04-25T09:03:03.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.499+0000 7ff3faa00640 1 -- 172.21.15.173:0/1525047314 shutdown_connections 2024-04-25T09:03:03.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.499+0000 7ff3faa00640 1 --2- 172.21.15.173:0/1525047314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3d8004810 0x7ff3d8004c90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.499+0000 7ff3faa00640 1 -- 172.21.15.173:0/1525047314 >> 172.21.15.173:0/1525047314 conn(0x7ff3f406ac90 msgr2=0x7ff3f406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:03.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.499+0000 7ff3faa00640 1 -- 172.21.15.173:0/1525047314 shutdown_connections 2024-04-25T09:03:03.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.499+0000 7ff3faa00640 1 -- 172.21.15.173:0/1525047314 wait complete. 2024-04-25T09:03:03.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3faa00640 1 Processor -- start 2024-04-25T09:03:03.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3faa00640 1 -- start start 2024-04-25T09:03:03.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3faa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3d8004810 0x7ff3f41e9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3faa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3f41e8120 0x7ff3f41f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3faa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3f41f5250 0x7ff3f40add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3faa00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f41457f0 con 0x7ff3d8004810 2024-04-25T09:03:03.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3faa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f4145670 con 0x7ff3f41f5250 2024-04-25T09:03:03.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3faa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f406ed60 con 0x7ff3f41e8120 2024-04-25T09:03:03.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3f3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3d8004810 0x7ff3f41e9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3f3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3d8004810 0x7ff3f41e9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60906/0 (socket says 172.21.15.173:60906) 2024-04-25T09:03:03.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3f3e00640 1 -- 172.21.15.173:0/1445811235 learned_addr learned my addr 172.21.15.173:0/1445811235 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:03.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3eb400640 1 --2- 172.21.15.173:0/1445811235 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3f41e8120 0x7ff3f41f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3f8a00640 1 --2- 172.21.15.173:0/1445811235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3f41f5250 0x7ff3f40add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3f3e00640 1 -- 172.21.15.173:0/1445811235 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3f41e8120 msgr2=0x7ff3f41f6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3f3e00640 1 --2- 172.21.15.173:0/1445811235 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3f41e8120 0x7ff3f41f6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3f3e00640 1 -- 172.21.15.173:0/1445811235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3f41f5250 msgr2=0x7ff3f40add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3f3e00640 1 --2- 172.21.15.173:0/1445811235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3f41f5250 0x7ff3f40add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3f3e00640 1 -- 172.21.15.173:0/1445811235 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f413fb90 con 0x7ff3d8004810 2024-04-25T09:03:03.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3eb400640 1 --2- 172.21.15.173:0/1445811235 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3f41e8120 0x7ff3f41f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:03.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3f3e00640 1 --2- 172.21.15.173:0/1445811235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3d8004810 0x7ff3f41e9450 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40118d0 tx=0x7ff3e4011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:03.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3f0c00640 1 -- 172.21.15.173:0/1445811235 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4004220 con 0x7ff3d8004810 2024-04-25T09:03:03.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3f0c00640 1 -- 172.21.15.173:0/1445811235 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e40043c0 con 0x7ff3d8004810 2024-04-25T09:03:03.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3f0c00640 1 -- 172.21.15.173:0/1445811235 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e400fbd0 con 0x7ff3d8004810 2024-04-25T09:03:03.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3faa00640 1 -- 172.21.15.173:0/1445811235 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f413fe70 con 0x7ff3d8004810 2024-04-25T09:03:03.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3faa00640 1 -- 172.21.15.173:0/1445811235 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f41e8580 con 0x7ff3d8004810 2024-04-25T09:03:03.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.503+0000 7ff3faa00640 1 -- 172.21.15.173:0/1445811235 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f4140590 con 0x7ff3d8004810 2024-04-25T09:03:03.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.507+0000 7ff3f0c00640 1 -- 172.21.15.173:0/1445811235 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff3e4003620 con 0x7ff3d8004810 2024-04-25T09:03:03.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.507+0000 7ff3f0c00640 1 --2- 172.21.15.173:0/1445811235 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff3d0066f60 0x7ff3d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.507+0000 7ff3f0c00640 1 -- 172.21.15.173:0/1445811235 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff3e4085b60 con 0x7ff3d8004810 2024-04-25T09:03:03.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.507+0000 7ff3eb400640 1 --2- 172.21.15.173:0/1445811235 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff3d0066f60 0x7ff3d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.507+0000 7ff3eb400640 1 --2- 172.21.15.173:0/1445811235 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff3d0066f60 0x7ff3d0069420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0ab000 tx=0x7ff3dc0b0040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:03.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.511+0000 7ff3f0c00640 1 -- 172.21.15.173:0/1445811235 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff3e4019030 con 0x7ff3d8004810 2024-04-25T09:03:03.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.663+0000 7ff3faa00640 1 -- 172.21.15.173:0/1445811235 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3f4073ab0 con 0x7ff3d8004810 2024-04-25T09:03:03.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.663+0000 7ff3f0c00640 1 -- 172.21.15.173:0/1445811235 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff3e4009e20 con 0x7ff3d8004810 2024-04-25T09:03:03.656 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:03.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.663+0000 7ff3faa00640 1 -- 172.21.15.173:0/1445811235 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff3d0066f60 msgr2=0x7ff3d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.663+0000 7ff3faa00640 1 --2- 172.21.15.173:0/1445811235 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff3d0066f60 0x7ff3d0069420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0ab000 tx=0x7ff3dc0b0040 comp rx=0 tx=0).stop 2024-04-25T09:03:03.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.663+0000 7ff3faa00640 1 -- 172.21.15.173:0/1445811235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3d8004810 msgr2=0x7ff3f41e9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.663+0000 7ff3faa00640 1 --2- 172.21.15.173:0/1445811235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3d8004810 0x7ff3f41e9450 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40118d0 tx=0x7ff3e4011d90 comp rx=0 tx=0).stop 2024-04-25T09:03:03.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.663+0000 7ff3faa00640 1 -- 172.21.15.173:0/1445811235 shutdown_connections 2024-04-25T09:03:03.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.663+0000 7ff3faa00640 1 --2- 172.21.15.173:0/1445811235 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff3d0066f60 0x7ff3d0069420 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.663+0000 7ff3faa00640 1 --2- 172.21.15.173:0/1445811235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3f41f5250 0x7ff3f40add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.663+0000 7ff3faa00640 1 --2- 172.21.15.173:0/1445811235 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3f41e8120 0x7ff3f41f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.663+0000 7ff3faa00640 1 --2- 172.21.15.173:0/1445811235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3d8004810 0x7ff3f41e9450 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.663+0000 7ff3faa00640 1 -- 172.21.15.173:0/1445811235 >> 172.21.15.173:0/1445811235 conn(0x7ff3f406ac90 msgr2=0x7ff3f40b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:03.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.663+0000 7ff3faa00640 1 -- 172.21.15.173:0/1445811235 shutdown_connections 2024-04-25T09:03:03.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.663+0000 7ff3faa00640 1 -- 172.21.15.173:0/1445811235 wait complete. 2024-04-25T09:03:03.676 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:03.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.823+0000 7ffa77600640 1 Processor -- start 2024-04-25T09:03:03.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.823+0000 7ffa77600640 1 -- start start 2024-04-25T09:03:03.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.827+0000 7ffa77600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ffa7015b710 0x7ffa70071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.827+0000 7ffa77600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa700cd3d0 0x7ffa700cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.827+0000 7ffa77600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa700ccaa0 con 0x7ffa700cc670 2024-04-25T09:03:03.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.827+0000 7ffa77600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7015eea0 con 0x7ffa7015b710 2024-04-25T09:03:03.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.827+0000 7ffa77600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7015e2d0 con 0x7ffa700cd3d0 2024-04-25T09:03:03.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.827+0000 7ffa75600640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ffa700cc670 0x7ffa7006d380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60386/0 (socket says 172.21.15.173:60386) 2024-04-25T09:03:03.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.827+0000 7ffa75600640 1 -- 172.21.15.173:0/3603011259 learned_addr learned my addr 172.21.15.173:0/3603011259 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:03.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.827+0000 7ffa74c00640 1 --2- 172.21.15.173:0/3603011259 >> v2:172.21.15.173:3300/0 conn(0x7ffa7015b710 0x7ffa70071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.827+0000 7ffa6fe00640 1 --2- 172.21.15.173:0/3603011259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa700cd3d0 0x7ffa700cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.827+0000 7ffa6f400640 1 -- 172.21.15.173:0/3603011259 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289550245 0 0) 0x7ffa68001120 con 0x7ffa700cc670 2024-04-25T09:03:03.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.827+0000 7ffa74c00640 1 -- 172.21.15.173:0/3603011259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa700cd3d0 msgr2=0x7ffa700cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:03.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.827+0000 7ffa74c00640 1 --2- 172.21.15.173:0/3603011259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa700cd3d0 0x7ffa700cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.827+0000 7ffa74c00640 1 -- 172.21.15.173:0/3603011259 >> v1:172.21.15.173:6789/0 conn(0x7ffa700cc670 legacy=0x7ffa7006d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.827+0000 7ffa74c00640 1 -- 172.21.15.173:0/3603011259 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7015e570 con 0x7ffa7015b710 2024-04-25T09:03:03.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.827+0000 7ffa74c00640 1 --2- 172.21.15.173:0/3603011259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa7015b710 0x7ffa70071e80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009d90 tx=0x7ffa6001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05ca066e0dedb76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:03.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa6f400640 1 -- 172.21.15.173:0/3603011259 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa600b2070 con 0x7ffa7015b710 2024-04-25T09:03:03.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa6f400640 1 -- 172.21.15.173:0/3603011259 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa600a5910 con 0x7ffa7015b710 2024-04-25T09:03:03.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa6f400640 1 -- 172.21.15.173:0/3603011259 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa600a5ce0 con 0x7ffa7015b710 2024-04-25T09:03:03.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa77600640 1 -- 172.21.15.173:0/3603011259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa7015b710 msgr2=0x7ffa70071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa77600640 1 --2- 172.21.15.173:0/3603011259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa7015b710 0x7ffa70071e80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009d90 tx=0x7ffa6001c940 comp rx=0 tx=0).stop 2024-04-25T09:03:03.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa77600640 1 -- 172.21.15.173:0/3603011259 shutdown_connections 2024-04-25T09:03:03.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa77600640 1 --2- 172.21.15.173:0/3603011259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa700cd3d0 0x7ffa700cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa77600640 1 --2- 172.21.15.173:0/3603011259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa7015b710 0x7ffa70071e80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa77600640 1 -- 172.21.15.173:0/3603011259 >> 172.21.15.173:0/3603011259 conn(0x7ffa7006ac90 msgr2=0x7ffa7006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:03.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa77600640 1 -- 172.21.15.173:0/3603011259 shutdown_connections 2024-04-25T09:03:03.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa77600640 1 -- 172.21.15.173:0/3603011259 wait complete. 2024-04-25T09:03:03.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa77600640 1 Processor -- start 2024-04-25T09:03:03.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa77600640 1 -- start start 2024-04-25T09:03:03.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa77600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa700cc670 0x7ffa70152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa77600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa700cd3d0 0x7ffa701507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa77600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa7015b710 0x7ffa70150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa77600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa70072540 con 0x7ffa700cc670 2024-04-25T09:03:03.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa77600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa700723c0 con 0x7ffa7015b710 2024-04-25T09:03:03.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa77600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7016a800 con 0x7ffa700cd3d0 2024-04-25T09:03:03.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa74c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa700cc670 0x7ffa70152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa74c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa700cc670 0x7ffa70152de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60924/0 (socket says 172.21.15.173:60924) 2024-04-25T09:03:03.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa74c00640 1 -- 172.21.15.173:0/4069368738 learned_addr learned my addr 172.21.15.173:0/4069368738 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:03.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa6fe00640 1 --2- 172.21.15.173:0/4069368738 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa700cd3d0 0x7ffa701507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa75600640 1 --2- 172.21.15.173:0/4069368738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa7015b710 0x7ffa70150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa74c00640 1 -- 172.21.15.173:0/4069368738 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa700cd3d0 msgr2=0x7ffa701507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa74c00640 1 --2- 172.21.15.173:0/4069368738 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa700cd3d0 0x7ffa701507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa74c00640 1 -- 172.21.15.173:0/4069368738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa7015b710 msgr2=0x7ffa70150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa74c00640 1 --2- 172.21.15.173:0/4069368738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa7015b710 0x7ffa70150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.831+0000 7ffa74c00640 1 -- 172.21.15.173:0/4069368738 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa700b3050 con 0x7ffa700cc670 2024-04-25T09:03:03.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.835+0000 7ffa6fe00640 1 --2- 172.21.15.173:0/4069368738 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa700cd3d0 0x7ffa701507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:03.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.835+0000 7ffa74c00640 1 --2- 172.21.15.173:0/4069368738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa700cc670 0x7ffa70152de0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ffa600b0040 tx=0x7ffa600196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:03.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.835+0000 7ffa6cc00640 1 -- 172.21.15.173:0/4069368738 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa600b2050 con 0x7ffa700cc670 2024-04-25T09:03:03.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.835+0000 7ffa6cc00640 1 -- 172.21.15.173:0/4069368738 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa600be070 con 0x7ffa700cc670 2024-04-25T09:03:03.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.835+0000 7ffa6cc00640 1 -- 172.21.15.173:0/4069368738 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa600ada50 con 0x7ffa700cc670 2024-04-25T09:03:03.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.835+0000 7ffa77600640 1 -- 172.21.15.173:0/4069368738 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa700b3330 con 0x7ffa700cc670 2024-04-25T09:03:03.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.835+0000 7ffa77600640 1 -- 172.21.15.173:0/4069368738 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa700b38f0 con 0x7ffa700cc670 2024-04-25T09:03:03.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.835+0000 7ffa77600640 1 -- 172.21.15.173:0/4069368738 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa70073ab0 con 0x7ffa700cc670 2024-04-25T09:03:03.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.835+0000 7ffa6cc00640 1 -- 172.21.15.173:0/4069368738 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffa600adbf0 con 0x7ffa700cc670 2024-04-25T09:03:03.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.835+0000 7ffa6cc00640 1 --2- 172.21.15.173:0/4069368738 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa50066f60 0x7ffa50069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.839+0000 7ffa6cc00640 1 -- 172.21.15.173:0/4069368738 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ffa60120820 con 0x7ffa700cc670 2024-04-25T09:03:03.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.839+0000 7ffa6fe00640 1 --2- 172.21.15.173:0/4069368738 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa50066f60 0x7ffa50069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.839+0000 7ffa6fe00640 1 --2- 172.21.15.173:0/4069368738 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa50066f60 0x7ffa50069420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffa70158dc0 tx=0x7ffa5c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:03.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.839+0000 7ffa6cc00640 1 -- 172.21.15.173:0/4069368738 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffa60016560 con 0x7ffa700cc670 2024-04-25T09:03:03.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.999+0000 7ffa77600640 1 -- 172.21.15.173:0/4069368738 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffa7015ca80 con 0x7ffa700cc670 2024-04-25T09:03:03.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.999+0000 7ffa6cc00640 1 -- 172.21.15.173:0/4069368738 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffa600f1570 con 0x7ffa700cc670 2024-04-25T09:03:03.991 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:03:03.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.999+0000 7ffa77600640 1 -- 172.21.15.173:0/4069368738 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa50066f60 msgr2=0x7ffa50069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.999+0000 7ffa77600640 1 --2- 172.21.15.173:0/4069368738 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa50066f60 0x7ffa50069420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffa70158dc0 tx=0x7ffa5c008040 comp rx=0 tx=0).stop 2024-04-25T09:03:03.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.999+0000 7ffa77600640 1 -- 172.21.15.173:0/4069368738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa700cc670 msgr2=0x7ffa70152de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.999+0000 7ffa77600640 1 --2- 172.21.15.173:0/4069368738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa700cc670 0x7ffa70152de0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ffa600b0040 tx=0x7ffa600196e0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.999+0000 7ffa77600640 1 -- 172.21.15.173:0/4069368738 shutdown_connections 2024-04-25T09:03:03.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.999+0000 7ffa77600640 1 --2- 172.21.15.173:0/4069368738 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa50066f60 0x7ffa50069420 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.999+0000 7ffa77600640 1 --2- 172.21.15.173:0/4069368738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa7015b710 0x7ffa70150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.999+0000 7ffa77600640 1 --2- 172.21.15.173:0/4069368738 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa700cd3d0 0x7ffa701507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.999+0000 7ffa77600640 1 --2- 172.21.15.173:0/4069368738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa700cc670 0x7ffa70152de0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.999+0000 7ffa77600640 1 -- 172.21.15.173:0/4069368738 >> 172.21.15.173:0/4069368738 conn(0x7ffa7006ac90 msgr2=0x7ffa701590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:03.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:03.999+0000 7ffa77600640 1 -- 172.21.15.173:0/4069368738 shutdown_connections 2024-04-25T09:03:03.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.003+0000 7ffa77600640 1 -- 172.21.15.173:0/4069368738 wait complete. 2024-04-25T09:03:04.014 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:03:04.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.163+0000 7f181a800640 1 Processor -- start 2024-04-25T09:03:04.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.163+0000 7f181a800640 1 -- start start 2024-04-25T09:03:04.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.163+0000 7f181a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f181415e120 0x7f18140b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.163+0000 7f181a800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18140d1490 con 0x7f181406d200 2024-04-25T09:03:04.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.163+0000 7f181a800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18140d0bf0 con 0x7f181409a160 2024-04-25T09:03:04.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.163+0000 7f181a800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18140d0ed0 con 0x7f181415e120 2024-04-25T09:03:04.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.163+0000 7f180aa00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f181406d200 0x7f1814099a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60390/0 (socket says 172.21.15.173:60390) 2024-04-25T09:03:04.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.163+0000 7f180aa00640 1 -- 172.21.15.173:0/3720766035 learned_addr learned my addr 172.21.15.173:0/3720766035 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:04.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.163+0000 7f1813400640 1 --2- 172.21.15.173:0/3720766035 >> v2:172.21.15.194:3300/0 conn(0x7f181415e120 0x7f18140b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.163+0000 7f1812a00640 1 -- 172.21.15.173:0/3720766035 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010429153 0 0) 0x7f18140d1490 con 0x7f181406d200 2024-04-25T09:03:04.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.163+0000 7f1812a00640 1 -- 172.21.15.173:0/3720766035 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f8003530 con 0x7f181406d200 2024-04-25T09:03:04.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.163+0000 7f1813400640 1 -- 172.21.15.173:0/3720766035 >> v1:172.21.15.194:6789/0 conn(0x7f181409a160 legacy=0x7f18140cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.163+0000 7f1813400640 1 -- 172.21.15.173:0/3720766035 >> v1:172.21.15.173:6789/0 conn(0x7f181406d200 legacy=0x7f1814099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.163+0000 7f1813400640 1 -- 172.21.15.173:0/3720766035 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18140d11b0 con 0x7f181415e120 2024-04-25T09:03:04.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.167+0000 7f1813400640 1 --2- 172.21.15.173:0/3720766035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f181415e120 0x7f18140b2a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f18040097c0 tx=0x7f180401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d79fa4ee058ee476 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:04.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.167+0000 7f1812a00640 1 -- 172.21.15.173:0/3720766035 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040b0070 con 0x7f181415e120 2024-04-25T09:03:04.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.167+0000 7f1812a00640 1 -- 172.21.15.173:0/3720766035 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18040ab600 con 0x7f181415e120 2024-04-25T09:03:04.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.167+0000 7f1812a00640 1 -- 172.21.15.173:0/3720766035 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040ab9d0 con 0x7f181415e120 2024-04-25T09:03:04.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.167+0000 7f181a800640 1 -- 172.21.15.173:0/3720766035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f181415e120 msgr2=0x7f18140b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.167+0000 7f181a800640 1 --2- 172.21.15.173:0/3720766035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f181415e120 0x7f18140b2a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f18040097c0 tx=0x7f180401c410 comp rx=0 tx=0).stop 2024-04-25T09:03:04.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.167+0000 7f181a800640 1 -- 172.21.15.173:0/3720766035 shutdown_connections 2024-04-25T09:03:04.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.167+0000 7f181a800640 1 --2- 172.21.15.173:0/3720766035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f181415e120 0x7f18140b2a00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.167+0000 7f181a800640 1 -- 172.21.15.173:0/3720766035 >> 172.21.15.173:0/3720766035 conn(0x7f18140b32a0 msgr2=0x7f18140b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:04.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.167+0000 7f181a800640 1 -- 172.21.15.173:0/3720766035 shutdown_connections 2024-04-25T09:03:04.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.167+0000 7f181a800640 1 -- 172.21.15.173:0/3720766035 wait complete. 2024-04-25T09:03:04.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f181a800640 1 Processor -- start 2024-04-25T09:03:04.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f181a800640 1 -- start start 2024-04-25T09:03:04.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f181a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f181406d200 0x7f18140ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f181a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f181409a160 0x7f181414fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f181a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f181415e120 0x7f18140c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f181a800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18140cd760 con 0x7f181409a160 2024-04-25T09:03:04.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f181a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18140cd5e0 con 0x7f181406d200 2024-04-25T09:03:04.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f181a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181416bb70 con 0x7f181415e120 2024-04-25T09:03:04.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f180aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f181409a160 0x7f181414fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f180aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f181409a160 0x7f181414fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60938/0 (socket says 172.21.15.173:60938) 2024-04-25T09:03:04.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f180aa00640 1 -- 172.21.15.173:0/761135740 learned_addr learned my addr 172.21.15.173:0/761135740 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:04.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f1813400640 1 --2- 172.21.15.173:0/761135740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f181406d200 0x7f18140ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f1813e00640 1 --2- 172.21.15.173:0/761135740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f181415e120 0x7f18140c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f180aa00640 1 -- 172.21.15.173:0/761135740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f181415e120 msgr2=0x7f18140c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f180aa00640 1 --2- 172.21.15.173:0/761135740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f181415e120 0x7f18140c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f180aa00640 1 -- 172.21.15.173:0/761135740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f181406d200 msgr2=0x7f18140ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f180aa00640 1 --2- 172.21.15.173:0/761135740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f181406d200 0x7f18140ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f180aa00640 1 -- 172.21.15.173:0/761135740 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1814152cf0 con 0x7f181409a160 2024-04-25T09:03:04.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f180aa00640 1 --2- 172.21.15.173:0/761135740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f181409a160 0x7f181414fd20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00c420 tx=0x7f17fc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:04.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f180be00640 1 -- 172.21.15.173:0/761135740 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc017070 con 0x7f181409a160 2024-04-25T09:03:04.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f180be00640 1 -- 172.21.15.173:0/761135740 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc005cf0 con 0x7f181409a160 2024-04-25T09:03:04.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f180be00640 1 -- 172.21.15.173:0/761135740 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc0072d0 con 0x7f181409a160 2024-04-25T09:03:04.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f181a800640 1 -- 172.21.15.173:0/761135740 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18140c5e50 con 0x7f181409a160 2024-04-25T09:03:04.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.171+0000 7f181a800640 1 -- 172.21.15.173:0/761135740 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18140ca1d0 con 0x7f181409a160 2024-04-25T09:03:04.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.175+0000 7f181a800640 1 -- 172.21.15.173:0/761135740 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1814073ab0 con 0x7f181409a160 2024-04-25T09:03:04.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.175+0000 7f180be00640 1 -- 172.21.15.173:0/761135740 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f17fc01a070 con 0x7f181409a160 2024-04-25T09:03:04.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.175+0000 7f180be00640 1 --2- 172.21.15.173:0/761135740 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f17f0066f60 0x7f17f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.175+0000 7f180be00640 1 -- 172.21.15.173:0/761135740 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f17fc084650 con 0x7f181409a160 2024-04-25T09:03:04.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.175+0000 7f1813400640 1 --2- 172.21.15.173:0/761135740 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f17f0066f60 0x7f17f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.175+0000 7f1813400640 1 --2- 172.21.15.173:0/761135740 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f17f0066f60 0x7f17f0069420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f18040ad000 tx=0x7f1804008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:04.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.179+0000 7f180be00640 1 -- 172.21.15.173:0/761135740 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f17fc054cc0 con 0x7f181409a160 2024-04-25T09:03:04.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.335+0000 7f181a800640 1 -- 172.21.15.173:0/761135740 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f181409ab50 con 0x7f181409a160 2024-04-25T09:03:04.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.335+0000 7f180be00640 1 -- 172.21.15.173:0/761135740 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f17fc058d60 con 0x7f181409a160 2024-04-25T09:03:04.329 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.339+0000 7f181a800640 1 -- 172.21.15.173:0/761135740 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f17f0066f60 msgr2=0x7f17f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.339+0000 7f181a800640 1 --2- 172.21.15.173:0/761135740 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f17f0066f60 0x7f17f0069420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f18040ad000 tx=0x7f1804008040 comp rx=0 tx=0).stop 2024-04-25T09:03:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.339+0000 7f181a800640 1 -- 172.21.15.173:0/761135740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f181409a160 msgr2=0x7f181414fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.339+0000 7f181a800640 1 --2- 172.21.15.173:0/761135740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f181409a160 0x7f181414fd20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00c420 tx=0x7f17fc00c8e0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.339+0000 7f181a800640 1 -- 172.21.15.173:0/761135740 shutdown_connections 2024-04-25T09:03:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.339+0000 7f181a800640 1 --2- 172.21.15.173:0/761135740 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f17f0066f60 0x7f17f0069420 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.339+0000 7f181a800640 1 --2- 172.21.15.173:0/761135740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f181415e120 0x7f18140c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.339+0000 7f181a800640 1 --2- 172.21.15.173:0/761135740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f181409a160 0x7f181414fd20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.339+0000 7f181a800640 1 --2- 172.21.15.173:0/761135740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f181406d200 0x7f18140ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.339+0000 7f181a800640 1 -- 172.21.15.173:0/761135740 >> 172.21.15.173:0/761135740 conn(0x7f18140b32a0 msgr2=0x7f1814074110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.339+0000 7f181a800640 1 -- 172.21.15.173:0/761135740 shutdown_connections 2024-04-25T09:03:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.339+0000 7f181a800640 1 -- 172.21.15.173:0/761135740 wait complete. 2024-04-25T09:03:04.349 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:03:04.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.495+0000 7f45ce800640 1 Processor -- start 2024-04-25T09:03:04.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.495+0000 7f45ce800640 1 -- start start 2024-04-25T09:03:04.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.495+0000 7f45ce800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f45c80aeb90 0x7f45c80cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.495+0000 7f45ce800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45c80ce2b0 0x7f45c80cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.495+0000 7f45ce800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c8071570 con 0x7f45c80aef70 2024-04-25T09:03:04.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.495+0000 7f45ce800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c8071320 con 0x7f45c80aeb90 2024-04-25T09:03:04.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.495+0000 7f45ce800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c8072330 con 0x7f45c80ce2b0 2024-04-25T09:03:04.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.495+0000 7f45c7400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f45c80aeb90 0x7f45c80cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.495+0000 7f45c7400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f45c80aeb90 0x7f45c80cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60952/0 (socket says 172.21.15.173:60952) 2024-04-25T09:03:04.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.495+0000 7f45c7400640 1 -- 172.21.15.173:0/3237243559 learned_addr learned my addr 172.21.15.173:0/3237243559 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:04.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.495+0000 7f45c7e00640 1 --2- 172.21.15.173:0/3237243559 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45c80ce2b0 0x7f45c80cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.495+0000 7f45c7400640 1 -- 172.21.15.173:0/3237243559 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45c80ce2b0 msgr2=0x7f45c80cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:04.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.495+0000 7f45c7400640 1 --2- 172.21.15.173:0/3237243559 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45c80ce2b0 0x7f45c80cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.495+0000 7f45c7400640 1 -- 172.21.15.173:0/3237243559 >> v1:172.21.15.194:6789/0 conn(0x7f45c80aef70 legacy=0x7f45c80cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.495+0000 7f45c7400640 1 -- 172.21.15.173:0/3237243559 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c8071850 con 0x7f45c80aeb90 2024-04-25T09:03:04.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.499+0000 7f45c7400640 1 --2- 172.21.15.173:0/3237243559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45c80aeb90 0x7f45c80cc0d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f45b800bb10 tx=0x7f45b801eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b0869f8debd8bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:04.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.499+0000 7f45c6000640 1 -- 172.21.15.173:0/3237243559 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b80b4070 con 0x7f45c80aeb90 2024-04-25T09:03:04.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.499+0000 7f45c6000640 1 -- 172.21.15.173:0/3237243559 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b80a7b40 con 0x7f45c80aeb90 2024-04-25T09:03:04.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.499+0000 7f45c6000640 1 -- 172.21.15.173:0/3237243559 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b80af440 con 0x7f45c80aeb90 2024-04-25T09:03:04.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.499+0000 7f45ce800640 1 -- 172.21.15.173:0/3237243559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45c80aeb90 msgr2=0x7f45c80cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.499+0000 7f45ce800640 1 --2- 172.21.15.173:0/3237243559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45c80aeb90 0x7f45c80cc0d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f45b800bb10 tx=0x7f45b801eb70 comp rx=0 tx=0).stop 2024-04-25T09:03:04.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.499+0000 7f45ce800640 1 -- 172.21.15.173:0/3237243559 shutdown_connections 2024-04-25T09:03:04.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.499+0000 7f45ce800640 1 --2- 172.21.15.173:0/3237243559 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45c80ce2b0 0x7f45c80cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.499+0000 7f45ce800640 1 --2- 172.21.15.173:0/3237243559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45c80aeb90 0x7f45c80cc0d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.499+0000 7f45ce800640 1 -- 172.21.15.173:0/3237243559 >> 172.21.15.173:0/3237243559 conn(0x7f45c806ac90 msgr2=0x7f45c806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:04.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.499+0000 7f45ce800640 1 -- 172.21.15.173:0/3237243559 shutdown_connections 2024-04-25T09:03:04.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.499+0000 7f45ce800640 1 -- 172.21.15.173:0/3237243559 wait complete. 2024-04-25T09:03:04.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.499+0000 7f45ce800640 1 Processor -- start 2024-04-25T09:03:04.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45ce800640 1 -- start start 2024-04-25T09:03:04.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45ce800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45c80aeb90 0x7f45c80afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45ce800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45c80aef70 0x7f45c81541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45ce800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45c80ce2b0 0x7f45c813d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45ce800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c815bb30 con 0x7f45c80aeb90 2024-04-25T09:03:04.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45ce800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c815b9b0 con 0x7f45c80ce2b0 2024-04-25T09:03:04.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45ce800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c815bcb0 con 0x7f45c80aef70 2024-04-25T09:03:04.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45c7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45c80aeb90 0x7f45c80afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45c7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45c80aeb90 0x7f45c80afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60966/0 (socket says 172.21.15.173:60966) 2024-04-25T09:03:04.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45c7400640 1 -- 172.21.15.173:0/3958921642 learned_addr learned my addr 172.21.15.173:0/3958921642 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:04.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45c7e00640 1 --2- 172.21.15.173:0/3958921642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45c80ce2b0 0x7f45c813d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45c6a00640 1 --2- 172.21.15.173:0/3958921642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45c80aef70 0x7f45c81541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45c7400640 1 -- 172.21.15.173:0/3958921642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45c80aef70 msgr2=0x7f45c81541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45c7400640 1 --2- 172.21.15.173:0/3958921642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45c80aef70 0x7f45c81541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45c7400640 1 -- 172.21.15.173:0/3958921642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45c80ce2b0 msgr2=0x7f45c813d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45c7400640 1 --2- 172.21.15.173:0/3958921642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45c80ce2b0 0x7f45c813d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45c7400640 1 -- 172.21.15.173:0/3958921642 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c8153430 con 0x7f45c80aeb90 2024-04-25T09:03:04.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45c7e00640 1 --2- 172.21.15.173:0/3958921642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45c80ce2b0 0x7f45c813d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:04.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45c7400640 1 --2- 172.21.15.173:0/3958921642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45c80aeb90 0x7f45c80afdb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f45b800b2c0 tx=0x7f45b801b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:04.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45bf400640 1 -- 172.21.15.173:0/3958921642 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b80be070 con 0x7f45c80aeb90 2024-04-25T09:03:04.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45bf400640 1 -- 172.21.15.173:0/3958921642 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b80afc30 con 0x7f45c80aeb90 2024-04-25T09:03:04.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45bf400640 1 -- 172.21.15.173:0/3958921642 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b80b4040 con 0x7f45c80aeb90 2024-04-25T09:03:04.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45ce800640 1 -- 172.21.15.173:0/3958921642 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c8153710 con 0x7f45c80aeb90 2024-04-25T09:03:04.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45ce800640 1 -- 172.21.15.173:0/3958921642 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c8153cd0 con 0x7f45c80aeb90 2024-04-25T09:03:04.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.503+0000 7f45ce800640 1 -- 172.21.15.173:0/3958921642 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c8073ab0 con 0x7f45c80aeb90 2024-04-25T09:03:04.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.507+0000 7f45bf400640 1 -- 172.21.15.173:0/3958921642 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f45b80c1070 con 0x7f45c80aeb90 2024-04-25T09:03:04.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.507+0000 7f45bf400640 1 --2- 172.21.15.173:0/3958921642 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f45a8066f60 0x7f45a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.507+0000 7f45bf400640 1 -- 172.21.15.173:0/3958921642 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f45b8122910 con 0x7f45c80aeb90 2024-04-25T09:03:04.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.507+0000 7f45c6a00640 1 --2- 172.21.15.173:0/3958921642 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f45a8066f60 0x7f45a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.507+0000 7f45c6a00640 1 --2- 172.21.15.173:0/3958921642 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f45a8066f60 0x7f45a8069420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f45c80b4170 tx=0x7f45b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:04.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.511+0000 7f45bf400640 1 -- 172.21.15.173:0/3958921642 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f45b8018820 con 0x7f45c80aeb90 2024-04-25T09:03:04.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.675+0000 7f45ce800640 1 -- 172.21.15.173:0/3958921642 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f45c80724b0 con 0x7f45c80aeb90 2024-04-25T09:03:04.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.675+0000 7f45bf400640 1 -- 172.21.15.173:0/3958921642 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f45b80f35d0 con 0x7f45c80aeb90 2024-04-25T09:03:04.669 INFO:teuthology.orchestra.run.smithi173.stderr:listed 0 entries 2024-04-25T09:03:04.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.679+0000 7f45ce800640 1 -- 172.21.15.173:0/3958921642 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f45a8066f60 msgr2=0x7f45a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.679+0000 7f45ce800640 1 --2- 172.21.15.173:0/3958921642 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f45a8066f60 0x7f45a8069420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f45c80b4170 tx=0x7f45b4009040 comp rx=0 tx=0).stop 2024-04-25T09:03:04.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.679+0000 7f45ce800640 1 -- 172.21.15.173:0/3958921642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45c80aeb90 msgr2=0x7f45c80afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.679+0000 7f45ce800640 1 --2- 172.21.15.173:0/3958921642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45c80aeb90 0x7f45c80afdb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f45b800b2c0 tx=0x7f45b801b910 comp rx=0 tx=0).stop 2024-04-25T09:03:04.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.679+0000 7f45ce800640 1 -- 172.21.15.173:0/3958921642 shutdown_connections 2024-04-25T09:03:04.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.679+0000 7f45ce800640 1 --2- 172.21.15.173:0/3958921642 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f45a8066f60 0x7f45a8069420 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.679+0000 7f45ce800640 1 --2- 172.21.15.173:0/3958921642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45c80ce2b0 0x7f45c813d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.679+0000 7f45ce800640 1 --2- 172.21.15.173:0/3958921642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45c80aef70 0x7f45c81541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.679+0000 7f45ce800640 1 --2- 172.21.15.173:0/3958921642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45c80aeb90 0x7f45c80afdb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.679+0000 7f45ce800640 1 -- 172.21.15.173:0/3958921642 >> 172.21.15.173:0/3958921642 conn(0x7f45c806ac90 msgr2=0x7f45c80cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:04.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.679+0000 7f45ce800640 1 -- 172.21.15.173:0/3958921642 shutdown_connections 2024-04-25T09:03:04.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.679+0000 7f45ce800640 1 -- 172.21.15.173:0/3958921642 wait complete. 2024-04-25T09:03:04.690 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:03:04.690 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:04.699 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:04.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.882+0000 7f876a000640 1 Processor -- start 2024-04-25T09:03:04.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.882+0000 7f876a000640 1 -- start start 2024-04-25T09:03:04.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.886+0000 7f876a000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f87640d1ec0 0x7f8764161b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.886+0000 7f876a000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f87640cce20 0x7f8764162040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.886+0000 7f876a000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87640cc080 con 0x7f87641583f0 2024-04-25T09:03:04.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.886+0000 7f876a000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8764162870 con 0x7f87640d1ec0 2024-04-25T09:03:04.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.886+0000 7f876a000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87640cc340 con 0x7f87640cce20 2024-04-25T09:03:04.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.886+0000 7f875aa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f87640d1ec0 0x7f8764161b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.886+0000 7f875aa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f87640d1ec0 0x7f8764161b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60972/0 (socket says 172.21.15.173:60972) 2024-04-25T09:03:04.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.886+0000 7f875aa00640 1 -- 172.21.15.173:0/2264227512 learned_addr learned my addr 172.21.15.173:0/2264227512 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:04.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.886+0000 7f8763e00640 1 --2- 172.21.15.173:0/2264227512 >> v2:172.21.15.194:3300/0 conn(0x7f87640cce20 0x7f8764162040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.886+0000 7f875aa00640 1 -- 172.21.15.173:0/2264227512 >> v2:172.21.15.194:3300/0 conn(0x7f87640cce20 msgr2=0x7f8764162040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:04.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.886+0000 7f875aa00640 1 --2- 172.21.15.173:0/2264227512 >> v2:172.21.15.194:3300/0 conn(0x7f87640cce20 0x7f8764162040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.886+0000 7f875aa00640 1 -- 172.21.15.173:0/2264227512 >> v1:172.21.15.194:6789/0 conn(0x7f87641583f0 legacy=0x7f87640d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:04.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.886+0000 7f875aa00640 1 -- 172.21.15.173:0/2264227512 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87640cc620 con 0x7f87640d1ec0 2024-04-25T09:03:04.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.886+0000 7f8763e00640 1 --2- 172.21.15.173:0/2264227512 >> v2:172.21.15.194:3300/0 conn(0x7f87640cce20 0x7f8764162040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:04.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.886+0000 7f875aa00640 1 --2- 172.21.15.173:0/2264227512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87640d1ec0 0x7f8764161b00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f87640d0dc0 tx=0x7f874c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2141f4505d163489 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:04.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.886+0000 7f8762a00640 1 -- 172.21.15.173:0/2264227512 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c0aa5f0 con 0x7f87640d1ec0 2024-04-25T09:03:04.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.886+0000 7f8762a00640 1 -- 172.21.15.173:0/2264227512 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874c0af070 con 0x7f87640d1ec0 2024-04-25T09:03:04.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f8762a00640 1 -- 172.21.15.173:0/2264227512 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c0aa9b0 con 0x7f87640d1ec0 2024-04-25T09:03:04.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f876a000640 1 -- 172.21.15.173:0/2264227512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87640d1ec0 msgr2=0x7f8764161b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f876a000640 1 --2- 172.21.15.173:0/2264227512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87640d1ec0 0x7f8764161b00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f87640d0dc0 tx=0x7f874c01c4b0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f876a000640 1 -- 172.21.15.173:0/2264227512 shutdown_connections 2024-04-25T09:03:04.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f876a000640 1 --2- 172.21.15.173:0/2264227512 >> v2:172.21.15.194:3300/0 conn(0x7f87640cce20 0x7f8764162040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f876a000640 1 --2- 172.21.15.173:0/2264227512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87640d1ec0 0x7f8764161b00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f876a000640 1 -- 172.21.15.173:0/2264227512 >> 172.21.15.173:0/2264227512 conn(0x7f876406f600 msgr2=0x7f876406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:04.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f876a000640 1 -- 172.21.15.173:0/2264227512 shutdown_connections 2024-04-25T09:03:04.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f876a000640 1 -- 172.21.15.173:0/2264227512 wait complete. 2024-04-25T09:03:04.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f876a000640 1 Processor -- start 2024-04-25T09:03:04.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f876a000640 1 -- start start 2024-04-25T09:03:04.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f876a000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640cce20 0x7f876414a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f876a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87640d1ec0 0x7f87640c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f876a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87641583f0 0x7f8764156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f876a000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87640cea70 con 0x7f87640d1ec0 2024-04-25T09:03:04.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f876a000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87640ce8f0 con 0x7f87640cce20 2024-04-25T09:03:04.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f876a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87640cebf0 con 0x7f87641583f0 2024-04-25T09:03:04.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f875aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87640d1ec0 0x7f87640c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f875aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87640d1ec0 0x7f87640c7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60984/0 (socket says 172.21.15.173:60984) 2024-04-25T09:03:04.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f875aa00640 1 -- 172.21.15.173:0/464732266 learned_addr learned my addr 172.21.15.173:0/464732266 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:04.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f8763400640 1 --2- 172.21.15.173:0/464732266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640cce20 0x7f876414a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f8763e00640 1 --2- 172.21.15.173:0/464732266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87641583f0 0x7f8764156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f875aa00640 1 -- 172.21.15.173:0/464732266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87641583f0 msgr2=0x7f8764156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f875aa00640 1 --2- 172.21.15.173:0/464732266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87641583f0 0x7f8764156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f875aa00640 1 -- 172.21.15.173:0/464732266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640cce20 msgr2=0x7f876414a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f875aa00640 1 --2- 172.21.15.173:0/464732266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640cce20 0x7f876414a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f875aa00640 1 -- 172.21.15.173:0/464732266 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87641507c0 con 0x7f87640d1ec0 2024-04-25T09:03:04.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.890+0000 7f8763e00640 1 --2- 172.21.15.173:0/464732266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87641583f0 0x7f8764156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:04.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.894+0000 7f875aa00640 1 --2- 172.21.15.173:0/464732266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87640d1ec0 0x7f87640c7440 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f874c01a0e0 tx=0x7f874c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:04.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.894+0000 7f875be00640 1 -- 172.21.15.173:0/464732266 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c0bd5f0 con 0x7f87640d1ec0 2024-04-25T09:03:04.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.894+0000 7f875be00640 1 -- 172.21.15.173:0/464732266 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874c0bd790 con 0x7f87640d1ec0 2024-04-25T09:03:04.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.894+0000 7f875be00640 1 -- 172.21.15.173:0/464732266 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c0bdb80 con 0x7f87640d1ec0 2024-04-25T09:03:04.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.894+0000 7f876a000640 1 -- 172.21.15.173:0/464732266 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87640c6960 con 0x7f87640d1ec0 2024-04-25T09:03:04.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.894+0000 7f876a000640 1 -- 172.21.15.173:0/464732266 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87640c6f20 con 0x7f87640d1ec0 2024-04-25T09:03:04.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.894+0000 7f876a000640 1 -- 172.21.15.173:0/464732266 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8764073a40 con 0x7f87640d1ec0 2024-04-25T09:03:04.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.894+0000 7f875be00640 1 -- 172.21.15.173:0/464732266 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f874c0b3600 con 0x7f87640d1ec0 2024-04-25T09:03:04.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.894+0000 7f875be00640 1 --2- 172.21.15.173:0/464732266 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8740066f60 0x7f8740069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.894+0000 7f875be00640 1 -- 172.21.15.173:0/464732266 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f874c11fe30 con 0x7f87640d1ec0 2024-04-25T09:03:04.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.898+0000 7f8763400640 1 --2- 172.21.15.173:0/464732266 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8740066f60 0x7f8740069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.898+0000 7f8763400640 1 --2- 172.21.15.173:0/464732266 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8740066f60 0x7f8740069420 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f87640cdd80 tx=0x7f8754008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:04.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:04.898+0000 7f875be00640 1 -- 172.21.15.173:0/464732266 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f874c0160d0 con 0x7f87640d1ec0 2024-04-25T09:03:05.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.054+0000 7f876a000640 1 -- 172.21.15.173:0/464732266 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87640cf650 con 0x7f87640d1ec0 2024-04-25T09:03:05.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.058+0000 7f875be00640 1 -- 172.21.15.173:0/464732266 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18574 (secure 0 0 0) 0x7f874c0f04b0 con 0x7f87640d1ec0 2024-04-25T09:03:05.049 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:05.050 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:56.440593+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:05.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.058+0000 7f876a000640 1 -- 172.21.15.173:0/464732266 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8740066f60 msgr2=0x7f8740069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.058+0000 7f876a000640 1 --2- 172.21.15.173:0/464732266 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8740066f60 0x7f8740069420 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f87640cdd80 tx=0x7f8754008040 comp rx=0 tx=0).stop 2024-04-25T09:03:05.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.058+0000 7f876a000640 1 -- 172.21.15.173:0/464732266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87640d1ec0 msgr2=0x7f87640c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.058+0000 7f876a000640 1 --2- 172.21.15.173:0/464732266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87640d1ec0 0x7f87640c7440 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f874c01a0e0 tx=0x7f874c01acf0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.058+0000 7f876a000640 1 -- 172.21.15.173:0/464732266 shutdown_connections 2024-04-25T09:03:05.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.058+0000 7f876a000640 1 --2- 172.21.15.173:0/464732266 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8740066f60 0x7f8740069420 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.058+0000 7f876a000640 1 --2- 172.21.15.173:0/464732266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87641583f0 0x7f8764156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.058+0000 7f876a000640 1 --2- 172.21.15.173:0/464732266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87640d1ec0 0x7f87640c7440 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.058+0000 7f876a000640 1 --2- 172.21.15.173:0/464732266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640cce20 0x7f876414a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.058+0000 7f876a000640 1 -- 172.21.15.173:0/464732266 >> 172.21.15.173:0/464732266 conn(0x7f876406f600 msgr2=0x7f876414e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:05.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.058+0000 7f876a000640 1 -- 172.21.15.173:0/464732266 shutdown_connections 2024-04-25T09:03:05.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.058+0000 7f876a000640 1 -- 172.21.15.173:0/464732266 wait complete. 2024-04-25T09:03:05.070 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:02:49.342297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:02:50.386069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:02:54.077429+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:03:05.071 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:05.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.218+0000 7fc0df200640 1 Processor -- start 2024-04-25T09:03:05.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.218+0000 7fc0df200640 1 -- start start 2024-04-25T09:03:05.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.218+0000 7fc0df200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc0d80cda00 0x7fc0d81650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.218+0000 7fc0df200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d815ddd0 con 0x7fc0d80cff40 2024-04-25T09:03:05.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.218+0000 7fc0df200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d815e0b0 con 0x7fc0d8159f00 2024-04-25T09:03:05.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.218+0000 7fc0df200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d8072330 con 0x7fc0d80cda00 2024-04-25T09:03:05.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.218+0000 7fc0cf400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc0d80cff40 0x7fc0d80cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60404/0 (socket says 172.21.15.173:60404) 2024-04-25T09:03:05.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.218+0000 7fc0cf400640 1 -- 172.21.15.173:0/1588378855 learned_addr learned my addr 172.21.15.173:0/1588378855 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:05.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.218+0000 7fc0dd200640 1 --2- 172.21.15.173:0/1588378855 >> v2:172.21.15.173:3300/0 conn(0x7fc0d80cda00 0x7fc0d81650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.218+0000 7fc0d7400640 1 -- 172.21.15.173:0/1588378855 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582954851 0 0) 0x7fc0d815ddd0 con 0x7fc0d80cff40 2024-04-25T09:03:05.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.218+0000 7fc0d7400640 1 -- 172.21.15.173:0/1588378855 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0bc003450 con 0x7fc0d80cff40 2024-04-25T09:03:05.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.218+0000 7fc0dd200640 1 -- 172.21.15.173:0/1588378855 >> v1:172.21.15.194:6789/0 conn(0x7fc0d8159f00 legacy=0x7fc0d80cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.218+0000 7fc0dd200640 1 -- 172.21.15.173:0/1588378855 >> v1:172.21.15.173:6789/0 conn(0x7fc0d80cff40 legacy=0x7fc0d80cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.218+0000 7fc0dd200640 1 -- 172.21.15.173:0/1588378855 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d815e390 con 0x7fc0d80cda00 2024-04-25T09:03:05.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.222+0000 7fc0dd200640 1 --2- 172.21.15.173:0/1588378855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d80cda00 0x7fc0d81650c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc0d00097c0 tx=0x7fc0d001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4df933030f62ad6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:05.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.222+0000 7fc0d7400640 1 -- 172.21.15.173:0/1588378855 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d00b1070 con 0x7fc0d80cda00 2024-04-25T09:03:05.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.222+0000 7fc0d7400640 1 -- 172.21.15.173:0/1588378855 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d00ac410 con 0x7fc0d80cda00 2024-04-25T09:03:05.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.222+0000 7fc0d7400640 1 -- 172.21.15.173:0/1588378855 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d00ac7e0 con 0x7fc0d80cda00 2024-04-25T09:03:05.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.222+0000 7fc0df200640 1 -- 172.21.15.173:0/1588378855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d80cda00 msgr2=0x7fc0d81650c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.222+0000 7fc0df200640 1 --2- 172.21.15.173:0/1588378855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d80cda00 0x7fc0d81650c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc0d00097c0 tx=0x7fc0d001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.222+0000 7fc0df200640 1 -- 172.21.15.173:0/1588378855 shutdown_connections 2024-04-25T09:03:05.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.222+0000 7fc0df200640 1 --2- 172.21.15.173:0/1588378855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d80cda00 0x7fc0d81650c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.222+0000 7fc0df200640 1 -- 172.21.15.173:0/1588378855 >> 172.21.15.173:0/1588378855 conn(0x7fc0d806ac90 msgr2=0x7fc0d806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:05.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.222+0000 7fc0df200640 1 -- 172.21.15.173:0/1588378855 shutdown_connections 2024-04-25T09:03:05.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.222+0000 7fc0df200640 1 -- 172.21.15.173:0/1588378855 wait complete. 2024-04-25T09:03:05.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.222+0000 7fc0df200640 1 Processor -- start 2024-04-25T09:03:05.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.222+0000 7fc0df200640 1 -- start start 2024-04-25T09:03:05.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0df200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0d80cda00 0x7fc0d81f6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0df200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d80cff40 0x7fc0d814f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0df200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0d8159f00 0x7fc0d8158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0df200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d81679a0 con 0x7fc0d80cff40 2024-04-25T09:03:05.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0df200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d8167820 con 0x7fc0d80cda00 2024-04-25T09:03:05.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0df200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d8167b20 con 0x7fc0d8159f00 2024-04-25T09:03:05.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0cf400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d80cff40 0x7fc0d814f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0cf400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d80cff40 0x7fc0d814f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:32778/0 (socket says 172.21.15.173:32778) 2024-04-25T09:03:05.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0cf400640 1 -- 172.21.15.173:0/356424595 learned_addr learned my addr 172.21.15.173:0/356424595 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:05.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0dd200640 1 --2- 172.21.15.173:0/356424595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0d8159f00 0x7fc0d8158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0d7e00640 1 --2- 172.21.15.173:0/356424595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0d80cda00 0x7fc0d81f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0cf400640 1 -- 172.21.15.173:0/356424595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0d8159f00 msgr2=0x7fc0d8158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0cf400640 1 --2- 172.21.15.173:0/356424595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0d8159f00 0x7fc0d8158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0cf400640 1 -- 172.21.15.173:0/356424595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0d80cda00 msgr2=0x7fc0d81f6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0cf400640 1 --2- 172.21.15.173:0/356424595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0d80cda00 0x7fc0d81f6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0cf400640 1 -- 172.21.15.173:0/356424595 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d814fdc0 con 0x7fc0d80cff40 2024-04-25T09:03:05.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0d7e00640 1 --2- 172.21.15.173:0/356424595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0d80cda00 0x7fc0d81f6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:05.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0cf400640 1 --2- 172.21.15.173:0/356424595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d80cff40 0x7fc0d814f320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc0c000c4d0 tx=0x7fc0c000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:05.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0d4c00640 1 -- 172.21.15.173:0/356424595 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0017070 con 0x7fc0d80cff40 2024-04-25T09:03:05.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0d4c00640 1 -- 172.21.15.173:0/356424595 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c0005cf0 con 0x7fc0d80cff40 2024-04-25T09:03:05.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0d4c00640 1 -- 172.21.15.173:0/356424595 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0007270 con 0x7fc0d80cff40 2024-04-25T09:03:05.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0df200640 1 -- 172.21.15.173:0/356424595 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d8151580 con 0x7fc0d80cff40 2024-04-25T09:03:05.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0df200640 1 -- 172.21.15.173:0/356424595 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d8140f20 con 0x7fc0d80cff40 2024-04-25T09:03:05.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0df200640 1 -- 172.21.15.173:0/356424595 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d8073ab0 con 0x7fc0d80cff40 2024-04-25T09:03:05.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.226+0000 7fc0d4c00640 1 -- 172.21.15.173:0/356424595 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc0c001a070 con 0x7fc0d80cff40 2024-04-25T09:03:05.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.230+0000 7fc0d4c00640 1 --2- 172.21.15.173:0/356424595 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc0b4066f60 0x7fc0b4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.230+0000 7fc0d4c00640 1 -- 172.21.15.173:0/356424595 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc0c0084760 con 0x7fc0d80cff40 2024-04-25T09:03:05.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.230+0000 7fc0d7e00640 1 --2- 172.21.15.173:0/356424595 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc0b4066f60 0x7fc0b4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.230+0000 7fc0d7e00640 1 --2- 172.21.15.173:0/356424595 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc0b4066f60 0x7fc0b4069420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8007fd0 tx=0x7fc0c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:05.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.234+0000 7fc0d4c00640 1 -- 172.21.15.173:0/356424595 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc0c0054d40 con 0x7fc0d80cff40 2024-04-25T09:03:05.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.386+0000 7fc0df200640 1 -- 172.21.15.173:0/356424595 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc0d80ccb20 con 0x7fc0d80cff40 2024-04-25T09:03:05.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.386+0000 7fc0d4c00640 1 -- 172.21.15.173:0/356424595 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc0c0058de0 con 0x7fc0d80cff40 2024-04-25T09:03:05.381 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:03:05.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.390+0000 7fc0df200640 1 -- 172.21.15.173:0/356424595 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc0b4066f60 msgr2=0x7fc0b4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.390+0000 7fc0df200640 1 --2- 172.21.15.173:0/356424595 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc0b4066f60 0x7fc0b4069420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8007fd0 tx=0x7fc0c8009040 comp rx=0 tx=0).stop 2024-04-25T09:03:05.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.390+0000 7fc0df200640 1 -- 172.21.15.173:0/356424595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d80cff40 msgr2=0x7fc0d814f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.390+0000 7fc0df200640 1 --2- 172.21.15.173:0/356424595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d80cff40 0x7fc0d814f320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc0c000c4d0 tx=0x7fc0c000c990 comp rx=0 tx=0).stop 2024-04-25T09:03:05.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.390+0000 7fc0df200640 1 -- 172.21.15.173:0/356424595 shutdown_connections 2024-04-25T09:03:05.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.390+0000 7fc0df200640 1 --2- 172.21.15.173:0/356424595 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc0b4066f60 0x7fc0b4069420 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.390+0000 7fc0df200640 1 --2- 172.21.15.173:0/356424595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0d8159f00 0x7fc0d8158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.390+0000 7fc0df200640 1 --2- 172.21.15.173:0/356424595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d80cff40 0x7fc0d814f320 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.390+0000 7fc0df200640 1 --2- 172.21.15.173:0/356424595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0d80cda00 0x7fc0d81f6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.390+0000 7fc0df200640 1 -- 172.21.15.173:0/356424595 >> 172.21.15.173:0/356424595 conn(0x7fc0d806ac90 msgr2=0x7fc0d80ae9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:05.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.390+0000 7fc0df200640 1 -- 172.21.15.173:0/356424595 shutdown_connections 2024-04-25T09:03:05.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.390+0000 7fc0df200640 1 -- 172.21.15.173:0/356424595 wait complete. 2024-04-25T09:03:05.402 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:05.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f5346000640 1 Processor -- start 2024-04-25T09:03:05.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f5346000640 1 -- start start 2024-04-25T09:03:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f5346000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5340145290 0x7f534015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f5346000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f53400b3fe0 0x7f53400b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f5346000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f53400cc260 0x7f53400cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f5346000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534015c5f0 con 0x7f53400b3fe0 2024-04-25T09:03:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f5346000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534006d4b0 con 0x7f53400cc260 2024-04-25T09:03:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f5346000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534006d790 con 0x7f5340145290 2024-04-25T09:03:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f533ea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f53400b3fe0 0x7f53400b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f533ea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f53400b3fe0 0x7f53400b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:32792/0 (socket says 172.21.15.173:32792) 2024-04-25T09:03:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f533ea00640 1 -- 172.21.15.173:0/234251200 learned_addr learned my addr 172.21.15.173:0/234251200 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f533fe00640 1 --2- 172.21.15.173:0/234251200 >> v2:172.21.15.194:3300/0 conn(0x7f53400cc260 0x7f53400cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f533f400640 1 --2- 172.21.15.173:0/234251200 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5340145290 0x7f534015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f533ea00640 1 -- 172.21.15.173:0/234251200 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5340145290 msgr2=0x7f534015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:05.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f533ea00640 1 --2- 172.21.15.173:0/234251200 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5340145290 0x7f534015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f533ea00640 1 -- 172.21.15.173:0/234251200 >> v2:172.21.15.194:3300/0 conn(0x7f53400cc260 msgr2=0x7f53400cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:05.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f533ea00640 1 --2- 172.21.15.173:0/234251200 >> v2:172.21.15.194:3300/0 conn(0x7f53400cc260 0x7f53400cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f533ea00640 1 -- 172.21.15.173:0/234251200 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534006da70 con 0x7f53400b3fe0 2024-04-25T09:03:05.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f533ea00640 1 --2- 172.21.15.173:0/234251200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53400b3fe0 0x7f53400b4420 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f53400af390 tx=0x7f532c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47efd6f2868dc03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:05.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f533e000640 1 -- 172.21.15.173:0/234251200 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c0b0070 con 0x7f53400b3fe0 2024-04-25T09:03:05.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f533e000640 1 -- 172.21.15.173:0/234251200 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532c0ab600 con 0x7f53400b3fe0 2024-04-25T09:03:05.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.550+0000 7f533e000640 1 -- 172.21.15.173:0/234251200 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c0ab9d0 con 0x7f53400b3fe0 2024-04-25T09:03:05.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f5346000640 1 -- 172.21.15.173:0/234251200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53400b3fe0 msgr2=0x7f53400b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f5346000640 1 --2- 172.21.15.173:0/234251200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53400b3fe0 0x7f53400b4420 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f53400af390 tx=0x7f532c01c400 comp rx=0 tx=0).stop 2024-04-25T09:03:05.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f5346000640 1 -- 172.21.15.173:0/234251200 shutdown_connections 2024-04-25T09:03:05.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f5346000640 1 --2- 172.21.15.173:0/234251200 >> v2:172.21.15.194:3300/0 conn(0x7f53400cc260 0x7f53400cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f5346000640 1 --2- 172.21.15.173:0/234251200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53400b3fe0 0x7f53400b4420 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f5346000640 1 --2- 172.21.15.173:0/234251200 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5340145290 0x7f534015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f5346000640 1 -- 172.21.15.173:0/234251200 >> 172.21.15.173:0/234251200 conn(0x7f534006ac90 msgr2=0x7f534006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:05.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f5346000640 1 -- 172.21.15.173:0/234251200 shutdown_connections 2024-04-25T09:03:05.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f5346000640 1 -- 172.21.15.173:0/234251200 wait complete. 2024-04-25T09:03:05.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f5346000640 1 Processor -- start 2024-04-25T09:03:05.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f5346000640 1 -- start start 2024-04-25T09:03:05.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f5346000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53400b3fe0 0x7f534013ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f5346000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53400cc260 0x7f534013b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f5346000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5340145290 0x7f534013a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f5346000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53401457f0 con 0x7f5340145290 2024-04-25T09:03:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f5346000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5340145670 con 0x7f53400cc260 2024-04-25T09:03:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f5346000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534006ed60 con 0x7f53400b3fe0 2024-04-25T09:03:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f533fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5340145290 0x7f534013a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f533fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5340145290 0x7f534013a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:32794/0 (socket says 172.21.15.173:32794) 2024-04-25T09:03:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f533fe00640 1 -- 172.21.15.173:0/2473296212 learned_addr learned my addr 172.21.15.173:0/2473296212 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f533f400640 1 --2- 172.21.15.173:0/2473296212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53400b3fe0 0x7f534013ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f533ea00640 1 --2- 172.21.15.173:0/2473296212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53400cc260 0x7f534013b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f533fe00640 1 -- 172.21.15.173:0/2473296212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53400b3fe0 msgr2=0x7f534013ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f533fe00640 1 --2- 172.21.15.173:0/2473296212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53400b3fe0 0x7f534013ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f533fe00640 1 -- 172.21.15.173:0/2473296212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53400cc260 msgr2=0x7f534013b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f533fe00640 1 --2- 172.21.15.173:0/2473296212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53400cc260 0x7f534013b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f533fe00640 1 -- 172.21.15.173:0/2473296212 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534013bbb0 con 0x7f5340145290 2024-04-25T09:03:05.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f533f400640 1 --2- 172.21.15.173:0/2473296212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53400b3fe0 0x7f534013ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:05.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.554+0000 7f533fe00640 1 --2- 172.21.15.173:0/2473296212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5340145290 0x7f534013a960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f533800d800 tx=0x7f533800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:05.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.558+0000 7f5337400640 1 -- 172.21.15.173:0/2473296212 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338018020 con 0x7f5340145290 2024-04-25T09:03:05.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.558+0000 7f5337400640 1 -- 172.21.15.173:0/2473296212 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53380096c0 con 0x7f5340145290 2024-04-25T09:03:05.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.558+0000 7f5337400640 1 -- 172.21.15.173:0/2473296212 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338009ab0 con 0x7f5340145290 2024-04-25T09:03:05.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.558+0000 7f5346000640 1 -- 172.21.15.173:0/2473296212 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534013aea0 con 0x7f5340145290 2024-04-25T09:03:05.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.558+0000 7f5346000640 1 -- 172.21.15.173:0/2473296212 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534013c110 con 0x7f5340145290 2024-04-25T09:03:05.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.558+0000 7f5346000640 1 -- 172.21.15.173:0/2473296212 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5340073ab0 con 0x7f5340145290 2024-04-25T09:03:05.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.558+0000 7f5337400640 1 -- 172.21.15.173:0/2473296212 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f533801b020 con 0x7f5340145290 2024-04-25T09:03:05.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.558+0000 7f5337400640 1 --2- 172.21.15.173:0/2473296212 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5320066f60 0x7f5320069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.558+0000 7f5337400640 1 -- 172.21.15.173:0/2473296212 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5338085700 con 0x7f5340145290 2024-04-25T09:03:05.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.558+0000 7f533f400640 1 --2- 172.21.15.173:0/2473296212 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5320066f60 0x7f5320069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.558+0000 7f533f400640 1 --2- 172.21.15.173:0/2473296212 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5320066f60 0x7f5320069420 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5330003fd0 tx=0x7f53300039e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:05.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.562+0000 7f5337400640 1 -- 172.21.15.173:0/2473296212 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5338022020 con 0x7f5340145290 2024-04-25T09:03:05.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.722+0000 7f5346000640 1 -- 172.21.15.173:0/2473296212 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f534015d9c0 con 0x7f5340145290 2024-04-25T09:03:05.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.722+0000 7f5337400640 1 -- 172.21.15.173:0/2473296212 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f534013aea0 con 0x7f5340145290 2024-04-25T09:03:05.710 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:05.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.722+0000 7f5346000640 1 -- 172.21.15.173:0/2473296212 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5320066f60 msgr2=0x7f5320069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.722+0000 7f5346000640 1 --2- 172.21.15.173:0/2473296212 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5320066f60 0x7f5320069420 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5330003fd0 tx=0x7f53300039e0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.722+0000 7f5346000640 1 -- 172.21.15.173:0/2473296212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5340145290 msgr2=0x7f534013a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.722+0000 7f5346000640 1 --2- 172.21.15.173:0/2473296212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5340145290 0x7f534013a960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f533800d800 tx=0x7f533800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.722+0000 7f5346000640 1 -- 172.21.15.173:0/2473296212 shutdown_connections 2024-04-25T09:03:05.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.722+0000 7f5346000640 1 --2- 172.21.15.173:0/2473296212 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5320066f60 0x7f5320069420 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.722+0000 7f5346000640 1 --2- 172.21.15.173:0/2473296212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5340145290 0x7f534013a960 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.722+0000 7f5346000640 1 --2- 172.21.15.173:0/2473296212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53400cc260 0x7f534013b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.722+0000 7f5346000640 1 --2- 172.21.15.173:0/2473296212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53400b3fe0 0x7f534013ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.722+0000 7f5346000640 1 -- 172.21.15.173:0/2473296212 >> 172.21.15.173:0/2473296212 conn(0x7f534006ac90 msgr2=0x7f53400cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:05.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.722+0000 7f5346000640 1 -- 172.21.15.173:0/2473296212 shutdown_connections 2024-04-25T09:03:05.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.722+0000 7f5346000640 1 -- 172.21.15.173:0/2473296212 wait complete. 2024-04-25T09:03:05.732 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:05.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.882+0000 7fbfa7600640 1 Processor -- start 2024-04-25T09:03:05.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.882+0000 7fbfa7600640 1 -- start start 2024-04-25T09:03:05.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.882+0000 7fbfa7600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbfa006e1c0 0x7fbfa006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.882+0000 7fbfa7600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa006ae30 con 0x7fbfa006c410 2024-04-25T09:03:05.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.882+0000 7fbfa7600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa006b110 con 0x7fbfa00ad5c0 2024-04-25T09:03:05.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.882+0000 7fbfa7600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa00b3170 con 0x7fbfa006e1c0 2024-04-25T09:03:05.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.882+0000 7fbf9fe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fbfa006c410 0x7fbfa00aceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60406/0 (socket says 172.21.15.173:60406) 2024-04-25T09:03:05.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.882+0000 7fbf9fe00640 1 -- 172.21.15.173:0/3657306079 learned_addr learned my addr 172.21.15.173:0/3657306079 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:05.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.882+0000 7fbfa4c00640 1 --2- 172.21.15.173:0/3657306079 >> v2:172.21.15.194:3300/0 conn(0x7fbfa006e1c0 0x7fbfa006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.882+0000 7fbf9f400640 1 -- 172.21.15.173:0/3657306079 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827258482 0 0) 0x7fbfa006ae30 con 0x7fbfa006c410 2024-04-25T09:03:05.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.882+0000 7fbf9f400640 1 -- 172.21.15.173:0/3657306079 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf84003530 con 0x7fbfa006c410 2024-04-25T09:03:05.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.882+0000 7fbfa4c00640 1 -- 172.21.15.173:0/3657306079 >> v1:172.21.15.194:6789/0 conn(0x7fbfa00ad5c0 legacy=0x7fbfa01677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.882+0000 7fbfa4c00640 1 -- 172.21.15.173:0/3657306079 >> v1:172.21.15.173:6789/0 conn(0x7fbfa006c410 legacy=0x7fbfa00aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.882+0000 7fbfa4c00640 1 -- 172.21.15.173:0/3657306079 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa006b3f0 con 0x7fbfa006e1c0 2024-04-25T09:03:05.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.886+0000 7fbfa4c00640 1 --2- 172.21.15.173:0/3657306079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfa006e1c0 0x7fbfa006bed0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009d90 tx=0x7fbf9001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20af80acc1941c30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:05.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.886+0000 7fbf9f400640 1 -- 172.21.15.173:0/3657306079 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf900b2070 con 0x7fbfa006e1c0 2024-04-25T09:03:05.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.886+0000 7fbf9f400640 1 -- 172.21.15.173:0/3657306079 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf900a5830 con 0x7fbfa006e1c0 2024-04-25T09:03:05.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.886+0000 7fbf9f400640 1 -- 172.21.15.173:0/3657306079 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf900a5be0 con 0x7fbfa006e1c0 2024-04-25T09:03:05.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.886+0000 7fbfa7600640 1 -- 172.21.15.173:0/3657306079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfa006e1c0 msgr2=0x7fbfa006bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.886+0000 7fbfa7600640 1 --2- 172.21.15.173:0/3657306079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfa006e1c0 0x7fbfa006bed0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009d90 tx=0x7fbf9001c970 comp rx=0 tx=0).stop 2024-04-25T09:03:05.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.886+0000 7fbfa7600640 1 -- 172.21.15.173:0/3657306079 shutdown_connections 2024-04-25T09:03:05.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.886+0000 7fbfa7600640 1 --2- 172.21.15.173:0/3657306079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfa006e1c0 0x7fbfa006bed0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.886+0000 7fbfa7600640 1 -- 172.21.15.173:0/3657306079 >> 172.21.15.173:0/3657306079 conn(0x7fbfa00cfed0 msgr2=0x7fbfa00d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:05.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.886+0000 7fbfa7600640 1 -- 172.21.15.173:0/3657306079 shutdown_connections 2024-04-25T09:03:05.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.886+0000 7fbfa7600640 1 -- 172.21.15.173:0/3657306079 wait complete. 2024-04-25T09:03:05.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.886+0000 7fbfa7600640 1 Processor -- start 2024-04-25T09:03:05.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.886+0000 7fbfa7600640 1 -- start start 2024-04-25T09:03:05.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa7600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfa006c410 0x7fbfa014acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa7600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfa006e1c0 0x7fbfa0148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa7600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfa00ad5c0 0x7fbfa0146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa7600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa016b880 con 0x7fbfa00ad5c0 2024-04-25T09:03:05.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa7600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa016b700 con 0x7fbfa006e1c0 2024-04-25T09:03:05.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa7600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa016ba00 con 0x7fbfa006c410 2024-04-25T09:03:05.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa5600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfa00ad5c0 0x7fbfa0146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa5600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfa00ad5c0 0x7fbfa0146630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:32806/0 (socket says 172.21.15.173:32806) 2024-04-25T09:03:05.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa5600640 1 -- 172.21.15.173:0/356970545 learned_addr learned my addr 172.21.15.173:0/356970545 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:05.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa4c00640 1 --2- 172.21.15.173:0/356970545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfa006c410 0x7fbfa014acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbf9fe00640 1 --2- 172.21.15.173:0/356970545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfa006e1c0 0x7fbfa0148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa5600640 1 -- 172.21.15.173:0/356970545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfa006c410 msgr2=0x7fbfa014acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa5600640 1 --2- 172.21.15.173:0/356970545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfa006c410 0x7fbfa014acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa5600640 1 -- 172.21.15.173:0/356970545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfa006e1c0 msgr2=0x7fbfa0148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa5600640 1 --2- 172.21.15.173:0/356970545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfa006e1c0 0x7fbfa0148b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa5600640 1 -- 172.21.15.173:0/356970545 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa014fe10 con 0x7fbfa00ad5c0 2024-04-25T09:03:05.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa5600640 1 --2- 172.21.15.173:0/356970545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfa00ad5c0 0x7fbfa0146630 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800c340 tx=0x7fbf9800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:05.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbf9cc00640 1 -- 172.21.15.173:0/356970545 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98005220 con 0x7fbfa00ad5c0 2024-04-25T09:03:05.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbf9cc00640 1 -- 172.21.15.173:0/356970545 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf980053c0 con 0x7fbfa00ad5c0 2024-04-25T09:03:05.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa7600640 1 -- 172.21.15.173:0/356970545 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa014f850 con 0x7fbfa00ad5c0 2024-04-25T09:03:05.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbf9cc00640 1 -- 172.21.15.173:0/356970545 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98007270 con 0x7fbfa00ad5c0 2024-04-25T09:03:05.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa7600640 1 -- 172.21.15.173:0/356970545 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa014b560 con 0x7fbfa00ad5c0 2024-04-25T09:03:05.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.890+0000 7fbfa7600640 1 -- 172.21.15.173:0/356970545 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa0073ab0 con 0x7fbfa00ad5c0 2024-04-25T09:03:05.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.894+0000 7fbf9cc00640 1 -- 172.21.15.173:0/356970545 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbf98019020 con 0x7fbfa00ad5c0 2024-04-25T09:03:05.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.894+0000 7fbf9cc00640 1 --2- 172.21.15.173:0/356970545 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbf80066f90 0x7fbf80069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.894+0000 7fbf9cc00640 1 -- 172.21.15.173:0/356970545 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbf98084330 con 0x7fbfa00ad5c0 2024-04-25T09:03:05.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.894+0000 7fbfa4c00640 1 --2- 172.21.15.173:0/356970545 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbf80066f90 0x7fbf80069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.894+0000 7fbfa4c00640 1 --2- 172.21.15.173:0/356970545 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbf80066f90 0x7fbf80069450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf900af000 tx=0x7fbf900a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:05.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:05.898+0000 7fbf9cc00640 1 -- 172.21.15.173:0/356970545 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbf98054a40 con 0x7fbfa00ad5c0 2024-04-25T09:03:06.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.046+0000 7fbfa7600640 1 -- 172.21.15.173:0/356970545 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbfa0149320 con 0x7fbfa00ad5c0 2024-04-25T09:03:06.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.050+0000 7fbf9cc00640 1 -- 172.21.15.173:0/356970545 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf98058ae0 con 0x7fbfa00ad5c0 2024-04-25T09:03:06.038 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:03:06.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.050+0000 7fbfa7600640 1 -- 172.21.15.173:0/356970545 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbf80066f90 msgr2=0x7fbf80069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:06.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.050+0000 7fbfa7600640 1 --2- 172.21.15.173:0/356970545 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbf80066f90 0x7fbf80069450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf900af000 tx=0x7fbf900a7070 comp rx=0 tx=0).stop 2024-04-25T09:03:06.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.050+0000 7fbfa7600640 1 -- 172.21.15.173:0/356970545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfa00ad5c0 msgr2=0x7fbfa0146630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:06.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.050+0000 7fbfa7600640 1 --2- 172.21.15.173:0/356970545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfa00ad5c0 0x7fbfa0146630 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800c340 tx=0x7fbf9800c800 comp rx=0 tx=0).stop 2024-04-25T09:03:06.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.050+0000 7fbfa7600640 1 -- 172.21.15.173:0/356970545 shutdown_connections 2024-04-25T09:03:06.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.050+0000 7fbfa7600640 1 --2- 172.21.15.173:0/356970545 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbf80066f90 0x7fbf80069450 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.050+0000 7fbfa7600640 1 --2- 172.21.15.173:0/356970545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfa00ad5c0 0x7fbfa0146630 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.050+0000 7fbfa7600640 1 --2- 172.21.15.173:0/356970545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfa006e1c0 0x7fbfa0148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.050+0000 7fbfa7600640 1 --2- 172.21.15.173:0/356970545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfa006c410 0x7fbfa014acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.050+0000 7fbfa7600640 1 -- 172.21.15.173:0/356970545 >> 172.21.15.173:0/356970545 conn(0x7fbfa00cfed0 msgr2=0x7fbfa00b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:06.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.050+0000 7fbfa7600640 1 -- 172.21.15.173:0/356970545 shutdown_connections 2024-04-25T09:03:06.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.050+0000 7fbfa7600640 1 -- 172.21.15.173:0/356970545 wait complete. 2024-04-25T09:03:06.059 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:03:06.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.206+0000 7efd63200640 1 Processor -- start 2024-04-25T09:03:06.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.206+0000 7efd63200640 1 -- start start 2024-04-25T09:03:06.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd63200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd64099a50 0x7efd64099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:06.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd63200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efd6406c220 0x7efd6415e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:06.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd63200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6409a370 con 0x7efd6406bda0 2024-04-25T09:03:06.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd63200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd64161570 con 0x7efd6406c220 2024-04-25T09:03:06.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd63200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd64161850 con 0x7efd64099a50 2024-04-25T09:03:06.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd61400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7efd6406bda0 0x7efd6415dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60422/0 (socket says 172.21.15.173:60422) 2024-04-25T09:03:06.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd61400640 1 -- 172.21.15.173:0/2535791086 learned_addr learned my addr 172.21.15.173:0/2535791086 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd61e00640 1 --2- 172.21.15.173:0/2535791086 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd64099a50 0x7efd64099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd62800640 1 --2- 172.21.15.173:0/2535791086 >> v2:172.21.15.194:3300/0 conn(0x7efd6406c220 0x7efd6415e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd60a00640 1 -- 172.21.15.173:0/2535791086 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408162247 0 0) 0x7efd6409a370 con 0x7efd6406bda0 2024-04-25T09:03:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd60a00640 1 -- 172.21.15.173:0/2535791086 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd48003530 con 0x7efd6406bda0 2024-04-25T09:03:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd60a00640 1 -- 172.21.15.173:0/2535791086 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1911184730 0 0) 0x7efd48003530 con 0x7efd6406bda0 2024-04-25T09:03:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd60a00640 1 -- 172.21.15.173:0/2535791086 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd64099a50 msgr2=0x7efd64099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd60a00640 1 --2- 172.21.15.173:0/2535791086 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd64099a50 0x7efd64099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd60a00640 1 -- 172.21.15.173:0/2535791086 >> v2:172.21.15.194:3300/0 conn(0x7efd6406c220 msgr2=0x7efd6415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd60a00640 1 --2- 172.21.15.173:0/2535791086 >> v2:172.21.15.194:3300/0 conn(0x7efd6406c220 0x7efd6415e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd60a00640 1 -- 172.21.15.173:0/2535791086 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd64161b30 con 0x7efd6406bda0 2024-04-25T09:03:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd60a00640 1 -- 172.21.15.173:0/2535791086 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7efd50001680 con 0x7efd6406bda0 2024-04-25T09:03:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd60a00640 1 -- 172.21.15.173:0/2535791086 >> v1:172.21.15.173:6789/0 conn(0x7efd6406bda0 legacy=0x7efd6415dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd60a00640 1 --2- 172.21.15.173:0/2535791086 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd64099a50 0x7efd480039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd60a00640 1 --2- 172.21.15.173:0/2535791086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd48003f40 0x7efd48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd60a00640 1 --2- 172.21.15.173:0/2535791086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd48004d50 0x7efd480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd60a00640 1 -- 172.21.15.173:0/2535791086 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd64161570 con 0x7efd48004d50 2024-04-25T09:03:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd60a00640 1 -- 172.21.15.173:0/2535791086 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd64161850 con 0x7efd48003f40 2024-04-25T09:03:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd60a00640 1 -- 172.21.15.173:0/2535791086 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4800b9d0 con 0x7efd64099a50 2024-04-25T09:03:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd62800640 1 --2- 172.21.15.173:0/2535791086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd48004d50 0x7efd480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd61e00640 1 --2- 172.21.15.173:0/2535791086 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd64099a50 0x7efd480039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd61400640 1 --2- 172.21.15.173:0/2535791086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd48003f40 0x7efd48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd62800640 1 -- 172.21.15.173:0/2535791086 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd64099a50 msgr2=0x7efd480039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:06.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd62800640 1 --2- 172.21.15.173:0/2535791086 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd64099a50 0x7efd480039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd62800640 1 -- 172.21.15.173:0/2535791086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd48003f40 msgr2=0x7efd48004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:06.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd62800640 1 --2- 172.21.15.173:0/2535791086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd48003f40 0x7efd48004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd62800640 1 -- 172.21.15.173:0/2535791086 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd48003530 con 0x7efd48004d50 2024-04-25T09:03:06.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.210+0000 7efd61400640 1 --2- 172.21.15.173:0/2535791086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd48003f40 0x7efd48004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:06.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.214+0000 7efd62800640 1 --2- 172.21.15.173:0/2535791086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd48004d50 0x7efd480051d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009ae0 tx=0x7efd5c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfedfb2502523f87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:06.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.214+0000 7efd60a00640 1 -- 172.21.15.173:0/2535791086 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c0b2070 con 0x7efd48004d50 2024-04-25T09:03:06.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.214+0000 7efd60a00640 1 -- 172.21.15.173:0/2535791086 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c0a56a0 con 0x7efd48004d50 2024-04-25T09:03:06.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.214+0000 7efd60a00640 1 -- 172.21.15.173:0/2535791086 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c0096b0 con 0x7efd48004d50 2024-04-25T09:03:06.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.214+0000 7efd63200640 1 -- 172.21.15.173:0/2535791086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd48004d50 msgr2=0x7efd480051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:06.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.214+0000 7efd63200640 1 --2- 172.21.15.173:0/2535791086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd48004d50 0x7efd480051d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009ae0 tx=0x7efd5c01ca50 comp rx=0 tx=0).stop 2024-04-25T09:03:06.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.214+0000 7efd62800640 1 -- 172.21.15.173:0/2535791086 reap_dead start 2024-04-25T09:03:06.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.214+0000 7efd63200640 1 -- 172.21.15.173:0/2535791086 shutdown_connections 2024-04-25T09:03:06.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.214+0000 7efd63200640 1 -- 172.21.15.173:0/2535791086 >> 172.21.15.173:0/2535791086 conn(0x7efd640b31d0 msgr2=0x7efd640b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:06.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.214+0000 7efd63200640 1 -- 172.21.15.173:0/2535791086 shutdown_connections 2024-04-25T09:03:06.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.214+0000 7efd63200640 1 -- 172.21.15.173:0/2535791086 wait complete. 2024-04-25T09:03:06.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.214+0000 7efd63200640 1 Processor -- start 2024-04-25T09:03:06.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.214+0000 7efd63200640 1 -- start start 2024-04-25T09:03:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd63200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd64155b40 0x7efd641e94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd63200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd64160730 0x7efd641e78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd63200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd641e7de0 0x7efd641f7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd63200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6409acc0 con 0x7efd64160730 2024-04-25T09:03:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd63200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd641620f0 con 0x7efd641e7de0 2024-04-25T09:03:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd63200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6409ae40 con 0x7efd64155b40 2024-04-25T09:03:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd61400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd64160730 0x7efd641e78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd61400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd64160730 0x7efd641e78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:32834/0 (socket says 172.21.15.173:32834) 2024-04-25T09:03:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd61400640 1 -- 172.21.15.173:0/2672897033 learned_addr learned my addr 172.21.15.173:0/2672897033 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd61e00640 1 --2- 172.21.15.173:0/2672897033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd64155b40 0x7efd641e94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd62800640 1 --2- 172.21.15.173:0/2672897033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd641e7de0 0x7efd641f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd61400640 1 -- 172.21.15.173:0/2672897033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd64155b40 msgr2=0x7efd641e94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd61400640 1 --2- 172.21.15.173:0/2672897033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd64155b40 0x7efd641e94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd61400640 1 -- 172.21.15.173:0/2672897033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd641e7de0 msgr2=0x7efd641f7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:06.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd61400640 1 --2- 172.21.15.173:0/2672897033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd641e7de0 0x7efd641f7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd61400640 1 -- 172.21.15.173:0/2672897033 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd641e8720 con 0x7efd64160730 2024-04-25T09:03:06.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd61400640 1 --2- 172.21.15.173:0/2672897033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd64160730 0x7efd641e78a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efd5000e8f0 tx=0x7efd5000edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:06.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd5a000640 1 -- 172.21.15.173:0/2672897033 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5000c870 con 0x7efd64160730 2024-04-25T09:03:06.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd5a000640 1 -- 172.21.15.173:0/2672897033 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd50018070 con 0x7efd64160730 2024-04-25T09:03:06.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd5a000640 1 -- 172.21.15.173:0/2672897033 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5000cc10 con 0x7efd64160730 2024-04-25T09:03:06.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd63200640 1 -- 172.21.15.173:0/2672897033 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd641e9ad0 con 0x7efd64160730 2024-04-25T09:03:06.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd63200640 1 -- 172.21.15.173:0/2672897033 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd641ea090 con 0x7efd64160730 2024-04-25T09:03:06.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd63200640 1 -- 172.21.15.173:0/2672897033 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd64073a40 con 0x7efd64160730 2024-04-25T09:03:06.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.218+0000 7efd5a000640 1 -- 172.21.15.173:0/2672897033 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efd5001d460 con 0x7efd64160730 2024-04-25T09:03:06.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.222+0000 7efd5a000640 1 --2- 172.21.15.173:0/2672897033 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd44066f60 0x7efd44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:06.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.222+0000 7efd5a000640 1 -- 172.21.15.173:0/2672897033 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7efd50085230 con 0x7efd64160730 2024-04-25T09:03:06.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.222+0000 7efd61e00640 1 --2- 172.21.15.173:0/2672897033 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd44066f60 0x7efd44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:06.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.222+0000 7efd61e00640 1 --2- 172.21.15.173:0/2672897033 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd44066f60 0x7efd44069420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efd641562e0 tx=0x7efd5400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:06.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.226+0000 7efd5a000640 1 -- 172.21.15.173:0/2672897033 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efd50055810 con 0x7efd64160730 2024-04-25T09:03:06.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.378+0000 7efd63200640 1 -- 172.21.15.173:0/2672897033 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efd641e81c0 con 0x7efd64160730 2024-04-25T09:03:06.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.378+0000 7efd5a000640 1 -- 172.21.15.173:0/2672897033 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7efd500598b0 con 0x7efd64160730 2024-04-25T09:03:06.367 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:06.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.378+0000 7efd63200640 1 -- 172.21.15.173:0/2672897033 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd44066f60 msgr2=0x7efd44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:06.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.378+0000 7efd63200640 1 --2- 172.21.15.173:0/2672897033 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd44066f60 0x7efd44069420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efd641562e0 tx=0x7efd5400b040 comp rx=0 tx=0).stop 2024-04-25T09:03:06.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.378+0000 7efd63200640 1 -- 172.21.15.173:0/2672897033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd64160730 msgr2=0x7efd641e78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:06.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.378+0000 7efd63200640 1 --2- 172.21.15.173:0/2672897033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd64160730 0x7efd641e78a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efd5000e8f0 tx=0x7efd5000edb0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.378+0000 7efd63200640 1 -- 172.21.15.173:0/2672897033 shutdown_connections 2024-04-25T09:03:06.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.378+0000 7efd63200640 1 --2- 172.21.15.173:0/2672897033 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd44066f60 0x7efd44069420 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.378+0000 7efd63200640 1 --2- 172.21.15.173:0/2672897033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd641e7de0 0x7efd641f7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.378+0000 7efd63200640 1 --2- 172.21.15.173:0/2672897033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd64160730 0x7efd641e78a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.378+0000 7efd63200640 1 --2- 172.21.15.173:0/2672897033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd64155b40 0x7efd641e94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.378+0000 7efd63200640 1 -- 172.21.15.173:0/2672897033 >> 172.21.15.173:0/2672897033 conn(0x7efd640b31d0 msgr2=0x7efd6415bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:06.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.378+0000 7efd63200640 1 -- 172.21.15.173:0/2672897033 shutdown_connections 2024-04-25T09:03:06.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.378+0000 7efd63200640 1 -- 172.21.15.173:0/2672897033 wait complete. 2024-04-25T09:03:06.388 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:03:06.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.534+0000 7fc696000640 1 Processor -- start 2024-04-25T09:03:06.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.534+0000 7fc696000640 1 -- start start 2024-04-25T09:03:06.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.534+0000 7fc696000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc690159f00 0x7fc6900cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:06.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.534+0000 7fc696000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6900cff40 0x7fc6900cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:06.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.534+0000 7fc696000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69015ddd0 con 0x7fc69015a2e0 2024-04-25T09:03:06.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.534+0000 7fc696000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc690072330 con 0x7fc690159f00 2024-04-25T09:03:06.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.534+0000 7fc696000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69015e0b0 con 0x7fc6900cff40 2024-04-25T09:03:06.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.534+0000 7fc68f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc690159f00 0x7fc6900cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:06.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.534+0000 7fc68fe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc69015a2e0 0x7fc69006d380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60438/0 (socket says 172.21.15.173:60438) 2024-04-25T09:03:06.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.534+0000 7fc68fe00640 1 -- 172.21.15.173:0/3868494948 learned_addr learned my addr 172.21.15.173:0/3868494948 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:06.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.534+0000 7fc686a00640 1 --2- 172.21.15.173:0/3868494948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6900cff40 0x7fc6900cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:06.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.538+0000 7fc68f400640 1 -- 172.21.15.173:0/3868494948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6900cff40 msgr2=0x7fc6900cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:06.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.538+0000 7fc68f400640 1 --2- 172.21.15.173:0/3868494948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6900cff40 0x7fc6900cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.538+0000 7fc68f400640 1 -- 172.21.15.173:0/3868494948 >> v1:172.21.15.173:6789/0 conn(0x7fc69015a2e0 legacy=0x7fc69006d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:06.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.538+0000 7fc68f400640 1 -- 172.21.15.173:0/3868494948 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69015e390 con 0x7fc690159f00 2024-04-25T09:03:06.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.538+0000 7fc68ea00640 1 -- 172.21.15.173:0/3868494948 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241218249 0 0) 0x7fc69015ddd0 con 0x7fc69015a2e0 2024-04-25T09:03:06.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.538+0000 7fc686a00640 1 --2- 172.21.15.173:0/3868494948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6900cff40 0x7fc6900cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:06.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.538+0000 7fc68f400640 1 --2- 172.21.15.173:0/3868494948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc690159f00 0x7fc6900cb960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc6780097c0 tx=0x7fc67801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1cfacbe0b84600 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:06.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.538+0000 7fc68ea00640 1 -- 172.21.15.173:0/3868494948 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6780b0070 con 0x7fc690159f00 2024-04-25T09:03:06.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.538+0000 7fc68ea00640 1 -- 172.21.15.173:0/3868494948 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6780ab600 con 0x7fc690159f00 2024-04-25T09:03:06.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.538+0000 7fc68ea00640 1 -- 172.21.15.173:0/3868494948 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6780ab9d0 con 0x7fc690159f00 2024-04-25T09:03:06.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.538+0000 7fc696000640 1 -- 172.21.15.173:0/3868494948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc690159f00 msgr2=0x7fc6900cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:06.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.538+0000 7fc696000640 1 --2- 172.21.15.173:0/3868494948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc690159f00 0x7fc6900cb960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc6780097c0 tx=0x7fc67801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.538+0000 7fc696000640 1 -- 172.21.15.173:0/3868494948 shutdown_connections 2024-04-25T09:03:06.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.538+0000 7fc696000640 1 --2- 172.21.15.173:0/3868494948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6900cff40 0x7fc6900cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.538+0000 7fc696000640 1 --2- 172.21.15.173:0/3868494948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc690159f00 0x7fc6900cb960 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.538+0000 7fc696000640 1 -- 172.21.15.173:0/3868494948 >> 172.21.15.173:0/3868494948 conn(0x7fc69006ac90 msgr2=0x7fc69006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:06.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.538+0000 7fc696000640 1 -- 172.21.15.173:0/3868494948 shutdown_connections 2024-04-25T09:03:06.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc696000640 1 -- 172.21.15.173:0/3868494948 wait complete. 2024-04-25T09:03:06.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc696000640 1 Processor -- start 2024-04-25T09:03:06.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc696000640 1 -- start start 2024-04-25T09:03:06.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc696000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6900cff40 0x7fc690148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:06.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc696000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc690159f00 0x7fc69014eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:06.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc696000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc69015a2e0 0x7fc690149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:06.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc696000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900cc230 con 0x7fc6900cff40 2024-04-25T09:03:06.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc696000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900cc0b0 con 0x7fc69015a2e0 2024-04-25T09:03:06.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc696000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900cc3b0 con 0x7fc690159f00 2024-04-25T09:03:06.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc68f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6900cff40 0x7fc690148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:06.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc68f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6900cff40 0x7fc690148dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:32844/0 (socket says 172.21.15.173:32844) 2024-04-25T09:03:06.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc68f400640 1 -- 172.21.15.173:0/1129865124 learned_addr learned my addr 172.21.15.173:0/1129865124 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:06.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc68fe00640 1 --2- 172.21.15.173:0/1129865124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc69015a2e0 0x7fc690149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:06.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc686a00640 1 --2- 172.21.15.173:0/1129865124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc690159f00 0x7fc69014eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:06.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc68f400640 1 -- 172.21.15.173:0/1129865124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc690159f00 msgr2=0x7fc69014eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:06.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc68f400640 1 --2- 172.21.15.173:0/1129865124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc690159f00 0x7fc69014eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc68f400640 1 -- 172.21.15.173:0/1129865124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc69015a2e0 msgr2=0x7fc690149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:06.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc68f400640 1 --2- 172.21.15.173:0/1129865124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc69015a2e0 0x7fc690149540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc68f400640 1 -- 172.21.15.173:0/1129865124 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc690149cb0 con 0x7fc6900cff40 2024-04-25T09:03:06.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc68f400640 1 --2- 172.21.15.173:0/1129865124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6900cff40 0x7fc690148dd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc67801a0d0 tx=0x7fc67801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:06.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc687e00640 1 -- 172.21.15.173:0/1129865124 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6780b0050 con 0x7fc6900cff40 2024-04-25T09:03:06.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc687e00640 1 -- 172.21.15.173:0/1129865124 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6780bc070 con 0x7fc6900cff40 2024-04-25T09:03:06.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.542+0000 7fc687e00640 1 -- 172.21.15.173:0/1129865124 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6780b5830 con 0x7fc6900cff40 2024-04-25T09:03:06.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.546+0000 7fc696000640 1 -- 172.21.15.173:0/1129865124 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc690149f90 con 0x7fc6900cff40 2024-04-25T09:03:06.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.546+0000 7fc696000640 1 -- 172.21.15.173:0/1129865124 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69014db20 con 0x7fc6900cff40 2024-04-25T09:03:06.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.546+0000 7fc696000640 1 -- 172.21.15.173:0/1129865124 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc690073ab0 con 0x7fc6900cff40 2024-04-25T09:03:06.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.546+0000 7fc687e00640 1 -- 172.21.15.173:0/1129865124 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc6780b59d0 con 0x7fc6900cff40 2024-04-25T09:03:06.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.546+0000 7fc687e00640 1 --2- 172.21.15.173:0/1129865124 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc66c066f60 0x7fc66c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:06.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.546+0000 7fc687e00640 1 -- 172.21.15.173:0/1129865124 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc67811fc00 con 0x7fc6900cff40 2024-04-25T09:03:06.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.546+0000 7fc686a00640 1 --2- 172.21.15.173:0/1129865124 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc66c066f60 0x7fc66c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:06.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.546+0000 7fc686a00640 1 --2- 172.21.15.173:0/1129865124 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc66c066f60 0x7fc66c069420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc6901509b0 tx=0x7fc680008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:06.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.550+0000 7fc687e00640 1 -- 172.21.15.173:0/1129865124 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc678016090 con 0x7fc6900cff40 2024-04-25T09:03:06.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.718+0000 7fc696000640 1 -- 172.21.15.173:0/1129865124 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc69014d110 con 0x7fc6900cff40 2024-04-25T09:03:06.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.718+0000 7fc687e00640 1 -- 172.21.15.173:0/1129865124 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc6780f09e0 con 0x7fc6900cff40 2024-04-25T09:03:06.707 INFO:teuthology.orchestra.run.smithi173.stderr:listed 0 entries 2024-04-25T09:03:06.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.718+0000 7fc696000640 1 -- 172.21.15.173:0/1129865124 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc66c066f60 msgr2=0x7fc66c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:06.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.718+0000 7fc696000640 1 --2- 172.21.15.173:0/1129865124 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc66c066f60 0x7fc66c069420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc6901509b0 tx=0x7fc680008040 comp rx=0 tx=0).stop 2024-04-25T09:03:06.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.718+0000 7fc696000640 1 -- 172.21.15.173:0/1129865124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6900cff40 msgr2=0x7fc690148dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:06.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.718+0000 7fc696000640 1 --2- 172.21.15.173:0/1129865124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6900cff40 0x7fc690148dd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc67801a0d0 tx=0x7fc67801ace0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.718+0000 7fc696000640 1 -- 172.21.15.173:0/1129865124 shutdown_connections 2024-04-25T09:03:06.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.718+0000 7fc696000640 1 --2- 172.21.15.173:0/1129865124 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc66c066f60 0x7fc66c069420 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.718+0000 7fc696000640 1 --2- 172.21.15.173:0/1129865124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc69015a2e0 0x7fc690149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.718+0000 7fc696000640 1 --2- 172.21.15.173:0/1129865124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc690159f00 0x7fc69014eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.718+0000 7fc696000640 1 --2- 172.21.15.173:0/1129865124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6900cff40 0x7fc690148dd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:06.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.718+0000 7fc696000640 1 -- 172.21.15.173:0/1129865124 >> 172.21.15.173:0/1129865124 conn(0x7fc69006ac90 msgr2=0x7fc6900cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:06.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.718+0000 7fc696000640 1 -- 172.21.15.173:0/1129865124 shutdown_connections 2024-04-25T09:03:06.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:06.718+0000 7fc696000640 1 -- 172.21.15.173:0/1129865124 wait complete. 2024-04-25T09:03:06.728 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi173.front.sepia.ceph.com... 2024-04-25T09:03:06.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:06.728 DEBUG:teuthology.orchestra.run.smithi173:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:03:06.752 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi173.stderr:ceph-fuse[34126]: fuse finished with error 0 and tester_r 0 2024-04-25T09:03:06.755 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:03:06.849 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:03:06.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:06.849 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-25T09:03:06.864 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:07.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.050+0000 7f82f4e00640 1 Processor -- start 2024-04-25T09:03:07.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82f4e00640 1 -- start start 2024-04-25T09:03:07.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82f4e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f82f015dbb0 0x7f82f015df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82f4e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f006d870 con 0x7f82f006f830 2024-04-25T09:03:07.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82f4e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f0161690 con 0x7f82f00d2130 2024-04-25T09:03:07.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82f4e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f00d2590 con 0x7f82f015dbb0 2024-04-25T09:03:07.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ee800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f82f006f830 0x7f82f0161b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60444/0 (socket says 172.21.15.173:60444) 2024-04-25T09:03:07.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ee800640 1 -- 172.21.15.173:0/599010066 learned_addr learned my addr 172.21.15.173:0/599010066 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:07.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ede00640 1 --2- 172.21.15.173:0/599010066 >> v2:172.21.15.194:3300/0 conn(0x7f82f015dbb0 0x7f82f015df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:07.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ed400640 1 -- 172.21.15.173:0/599010066 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302274113 0 0) 0x7f82f006d870 con 0x7f82f006f830 2024-04-25T09:03:07.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ed400640 1 -- 172.21.15.173:0/599010066 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82d4003530 con 0x7f82f006f830 2024-04-25T09:03:07.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ed400640 1 -- 172.21.15.173:0/599010066 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1524436661 0 0) 0x7f82d4003530 con 0x7f82f006f830 2024-04-25T09:03:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ed400640 1 -- 172.21.15.173:0/599010066 >> v2:172.21.15.194:3300/0 conn(0x7f82f015dbb0 msgr2=0x7f82f015df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ed400640 1 --2- 172.21.15.173:0/599010066 >> v2:172.21.15.194:3300/0 conn(0x7f82f015dbb0 0x7f82f015df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ed400640 1 -- 172.21.15.173:0/599010066 >> v1:172.21.15.194:6789/0 conn(0x7f82f00d2130 legacy=0x7f82f006c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ed400640 1 -- 172.21.15.173:0/599010066 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f015e5c0 con 0x7f82f006f830 2024-04-25T09:03:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ed400640 1 -- 172.21.15.173:0/599010066 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f82e8001a00 con 0x7f82f006f830 2024-04-25T09:03:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ede00640 1 --2- 172.21.15.173:0/599010066 >> v2:172.21.15.194:3300/0 conn(0x7f82f015dbb0 0x7f82f015df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ed400640 1 -- 172.21.15.173:0/599010066 >> v1:172.21.15.173:6789/0 conn(0x7f82f006f830 legacy=0x7f82f0161b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ed400640 1 --2- 172.21.15.173:0/599010066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82d4003a10 0x7f82d4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ed400640 1 --2- 172.21.15.173:0/599010066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d4004810 0x7f82d4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ed400640 1 --2- 172.21.15.173:0/599010066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82d40051d0 0x7f82d400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ed400640 1 -- 172.21.15.173:0/599010066 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00d2590 con 0x7f82d40051d0 2024-04-25T09:03:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ed400640 1 -- 172.21.15.173:0/599010066 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d400c0d0 con 0x7f82d4004810 2024-04-25T09:03:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ed400640 1 -- 172.21.15.173:0/599010066 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d400c2d0 con 0x7f82d4003a10 2024-04-25T09:03:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ee800640 1 --2- 172.21.15.173:0/599010066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82d40051d0 0x7f82d400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82e5400640 1 --2- 172.21.15.173:0/599010066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d4004810 0x7f82d4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ede00640 1 --2- 172.21.15.173:0/599010066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82d4003a10 0x7f82d4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:07.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ee800640 1 -- 172.21.15.173:0/599010066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82d4003a10 msgr2=0x7f82d4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:07.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ee800640 1 --2- 172.21.15.173:0/599010066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82d4003a10 0x7f82d4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ee800640 1 -- 172.21.15.173:0/599010066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d4004810 msgr2=0x7f82d4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:07.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ee800640 1 --2- 172.21.15.173:0/599010066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d4004810 0x7f82d4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.054+0000 7f82ee800640 1 -- 172.21.15.173:0/599010066 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d4003530 con 0x7f82d40051d0 2024-04-25T09:03:07.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.058+0000 7f82ee800640 1 -- 172.21.15.173:0/599010066 reap_dead start 2024-04-25T09:03:07.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.058+0000 7f82ee800640 1 --2- 172.21.15.173:0/599010066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82d40051d0 0x7f82d400b9d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82e800a790 tx=0x7f82e801d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1c940e1e069942 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:07.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.058+0000 7f82ed400640 1 -- 172.21.15.173:0/599010066 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e800a3b0 con 0x7f82d40051d0 2024-04-25T09:03:07.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.058+0000 7f82ed400640 1 -- 172.21.15.173:0/599010066 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e80ad670 con 0x7f82d40051d0 2024-04-25T09:03:07.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.058+0000 7f82ed400640 1 -- 172.21.15.173:0/599010066 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e80ada60 con 0x7f82d40051d0 2024-04-25T09:03:07.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.058+0000 7f82f4e00640 1 -- 172.21.15.173:0/599010066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82d40051d0 msgr2=0x7f82d400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:07.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.058+0000 7f82f4e00640 1 --2- 172.21.15.173:0/599010066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82d40051d0 0x7f82d400b9d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82e800a790 tx=0x7f82e801d2c0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.058+0000 7f82f4e00640 1 -- 172.21.15.173:0/599010066 shutdown_connections 2024-04-25T09:03:07.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.058+0000 7f82f4e00640 1 --2- 172.21.15.173:0/599010066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82d40051d0 0x7f82d400b9d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.058+0000 7f82f4e00640 1 -- 172.21.15.173:0/599010066 >> 172.21.15.173:0/599010066 conn(0x7f82f0061880 msgr2=0x7f82f0061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:07.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.058+0000 7f82f4e00640 1 -- 172.21.15.173:0/599010066 shutdown_connections 2024-04-25T09:03:07.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.058+0000 7f82f4e00640 1 -- 172.21.15.173:0/599010066 wait complete. 2024-04-25T09:03:07.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82f4e00640 1 Processor -- start 2024-04-25T09:03:07.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82f4e00640 1 -- start start 2024-04-25T09:03:07.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82f4e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d40051d0 0x7f82f01f3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82f4e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82f00cb850 0x7f82f015cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82f4e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f01f4720 0x7f82f00ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82f4e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f015ee60 con 0x7f82f01f4720 2024-04-25T09:03:07.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82f4e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f015eb80 con 0x7f82d40051d0 2024-04-25T09:03:07.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82f4e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f015df90 con 0x7f82f00cb850 2024-04-25T09:03:07.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82ee800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f01f4720 0x7f82f00ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:07.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82ee800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f01f4720 0x7f82f00ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:32864/0 (socket says 172.21.15.173:32864) 2024-04-25T09:03:07.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82ee800640 1 -- 172.21.15.173:0/3370464372 learned_addr learned my addr 172.21.15.173:0/3370464372 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:07.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82ede00640 1 --2- 172.21.15.173:0/3370464372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d40051d0 0x7f82f01f3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:07.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82e5400640 1 --2- 172.21.15.173:0/3370464372 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82f00cb850 0x7f82f015cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:07.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82ee800640 1 -- 172.21.15.173:0/3370464372 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82f00cb850 msgr2=0x7f82f015cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:07.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82ee800640 1 --2- 172.21.15.173:0/3370464372 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82f00cb850 0x7f82f015cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82ee800640 1 -- 172.21.15.173:0/3370464372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d40051d0 msgr2=0x7f82f01f3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:07.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82ee800640 1 --2- 172.21.15.173:0/3370464372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d40051d0 0x7f82f01f3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82ee800640 1 -- 172.21.15.173:0/3370464372 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f00cbcd0 con 0x7f82f01f4720 2024-04-25T09:03:07.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82ede00640 1 --2- 172.21.15.173:0/3370464372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d40051d0 0x7f82f01f3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:07.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82ee800640 1 --2- 172.21.15.173:0/3370464372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f01f4720 0x7f82f00ccd70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f82e801d0f0 tx=0x7f82d4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:07.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82e6a00640 1 -- 172.21.15.173:0/3370464372 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e8001260 con 0x7f82f01f4720 2024-04-25T09:03:07.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82e6a00640 1 -- 172.21.15.173:0/3370464372 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e80b4070 con 0x7f82f01f4720 2024-04-25T09:03:07.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82e6a00640 1 -- 172.21.15.173:0/3370464372 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e80ad820 con 0x7f82f01f4720 2024-04-25T09:03:07.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82f4e00640 1 -- 172.21.15.173:0/3370464372 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f00cbfb0 con 0x7f82f01f4720 2024-04-25T09:03:07.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82f4e00640 1 -- 172.21.15.173:0/3370464372 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f00cc570 con 0x7f82f01f4720 2024-04-25T09:03:07.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.062+0000 7f82f4e00640 1 -- 172.21.15.173:0/3370464372 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f0073a40 con 0x7f82f01f4720 2024-04-25T09:03:07.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.066+0000 7f82e6a00640 1 -- 172.21.15.173:0/3370464372 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f82e80b6020 con 0x7f82f01f4720 2024-04-25T09:03:07.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.066+0000 7f82e6a00640 1 --2- 172.21.15.173:0/3370464372 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f82cc067100 0x7f82cc0695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.066+0000 7f82e6a00640 1 -- 172.21.15.173:0/3370464372 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f82e811ed10 con 0x7f82f01f4720 2024-04-25T09:03:07.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.066+0000 7f82ede00640 1 --2- 172.21.15.173:0/3370464372 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f82cc067100 0x7f82cc0695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:07.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.066+0000 7f82ede00640 1 --2- 172.21.15.173:0/3370464372 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f82cc067100 0x7f82cc0695c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82f00c8df0 tx=0x7f82e0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:07.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.070+0000 7f82e6a00640 1 -- 172.21.15.173:0/3370464372 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f82e8124020 con 0x7f82f01f4720 2024-04-25T09:03:07.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.226+0000 7f82f4e00640 1 -- 172.21.15.173:0/3370464372 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82f00cf7e0 con 0x7f82f01f4720 2024-04-25T09:03:07.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.226+0000 7f82e6a00640 1 -- 172.21.15.173:0/3370464372 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18574 (secure 0 0 0) 0x7f82e80bf030 con 0x7f82f01f4720 2024-04-25T09:03:07.217 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:07.217 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:56.440593+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:07.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.230+0000 7f82f4e00640 1 -- 172.21.15.173:0/3370464372 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f82cc067100 msgr2=0x7f82cc0695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:07.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.230+0000 7f82f4e00640 1 --2- 172.21.15.173:0/3370464372 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f82cc067100 0x7f82cc0695c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82f00c8df0 tx=0x7f82e0009190 comp rx=0 tx=0).stop 2024-04-25T09:03:07.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.230+0000 7f82f4e00640 1 -- 172.21.15.173:0/3370464372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f01f4720 msgr2=0x7f82f00ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:07.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.230+0000 7f82f4e00640 1 --2- 172.21.15.173:0/3370464372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f01f4720 0x7f82f00ccd70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f82e801d0f0 tx=0x7f82d4005840 comp rx=0 tx=0).stop 2024-04-25T09:03:07.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.230+0000 7f82f4e00640 1 -- 172.21.15.173:0/3370464372 shutdown_connections 2024-04-25T09:03:07.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.230+0000 7f82f4e00640 1 --2- 172.21.15.173:0/3370464372 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f82cc067100 0x7f82cc0695c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.230+0000 7f82f4e00640 1 --2- 172.21.15.173:0/3370464372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f01f4720 0x7f82f00ccd70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.230+0000 7f82f4e00640 1 --2- 172.21.15.173:0/3370464372 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82f00cb850 0x7f82f015cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.230+0000 7f82f4e00640 1 --2- 172.21.15.173:0/3370464372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d40051d0 0x7f82f01f3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.230+0000 7f82f4e00640 1 -- 172.21.15.173:0/3370464372 >> 172.21.15.173:0/3370464372 conn(0x7f82f0061880 msgr2=0x7f82f00b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:07.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.230+0000 7f82f4e00640 1 -- 172.21.15.173:0/3370464372 shutdown_connections 2024-04-25T09:03:07.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.230+0000 7f82f4e00640 1 -- 172.21.15.173:0/3370464372 wait complete. 2024-04-25T09:03:07.238 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:07.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.382+0000 7f9301400640 1 Processor -- start 2024-04-25T09:03:07.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.382+0000 7f9301400640 1 -- start start 2024-04-25T09:03:07.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.386+0000 7f9301400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f92fc15c590 0x7f92fc06edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.386+0000 7f9301400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92fc0af6c0 con 0x7f92fc06dac0 2024-04-25T09:03:07.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.386+0000 7f9301400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92fc15ca20 con 0x7f92fc0af230 2024-04-25T09:03:07.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.386+0000 7f9301400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92fc0cc010 con 0x7f92fc15c590 2024-04-25T09:03:07.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.386+0000 7f92fa800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f92fc15c590 0x7f92fc06edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:07.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.386+0000 7f92fa800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f92fc15c590 0x7f92fc06edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:32876/0 (socket says 172.21.15.173:32876) 2024-04-25T09:03:07.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.386+0000 7f92fa800640 1 -- 172.21.15.173:0/2869537077 learned_addr learned my addr 172.21.15.173:0/2869537077 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:07.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.386+0000 7f92fa800640 1 -- 172.21.15.173:0/2869537077 >> v1:172.21.15.194:6789/0 conn(0x7f92fc0af230 legacy=0x7f92fc06bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:07.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.386+0000 7f92fa800640 1 -- 172.21.15.173:0/2869537077 >> v1:172.21.15.173:6789/0 conn(0x7f92fc06dac0 legacy=0x7f92fc0ad480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:07.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.386+0000 7f92fa800640 1 -- 172.21.15.173:0/2869537077 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc15cd00 con 0x7f92fc15c590 2024-04-25T09:03:07.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.390+0000 7f92fa800640 1 --2- 172.21.15.173:0/2869537077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92fc15c590 0x7f92fc06edf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009e50 tx=0x7f92ec01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc842cca212a4d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:07.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.390+0000 7f92f9e00640 1 -- 172.21.15.173:0/2869537077 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0a5730 con 0x7f92fc15c590 2024-04-25T09:03:07.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.390+0000 7f92f9e00640 1 -- 172.21.15.173:0/2869537077 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec0a58d0 con 0x7f92fc15c590 2024-04-25T09:03:07.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.390+0000 7f92f9e00640 1 -- 172.21.15.173:0/2869537077 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0a5ca0 con 0x7f92fc15c590 2024-04-25T09:03:07.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.390+0000 7f9301400640 1 -- 172.21.15.173:0/2869537077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92fc15c590 msgr2=0x7f92fc06edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:07.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.390+0000 7f9301400640 1 --2- 172.21.15.173:0/2869537077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92fc15c590 0x7f92fc06edf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009e50 tx=0x7f92ec01c9a0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.390+0000 7f9301400640 1 -- 172.21.15.173:0/2869537077 shutdown_connections 2024-04-25T09:03:07.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.390+0000 7f9301400640 1 --2- 172.21.15.173:0/2869537077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92fc15c590 0x7f92fc06edf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.390+0000 7f9301400640 1 -- 172.21.15.173:0/2869537077 >> 172.21.15.173:0/2869537077 conn(0x7f92fc071c20 msgr2=0x7f92fc072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:07.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.390+0000 7f9301400640 1 -- 172.21.15.173:0/2869537077 shutdown_connections 2024-04-25T09:03:07.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.390+0000 7f9301400640 1 -- 172.21.15.173:0/2869537077 wait complete. 2024-04-25T09:03:07.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.390+0000 7f9301400640 1 Processor -- start 2024-04-25T09:03:07.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.390+0000 7f9301400640 1 -- start start 2024-04-25T09:03:07.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f9301400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92fc06dac0 0x7f92fc0c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f9301400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92fc0af230 0x7f92fc152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f9301400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92fc146a30 0x7f92fc152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f9301400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc06c3b0 con 0x7f92fc0af230 2024-04-25T09:03:07.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f9301400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc0adda0 con 0x7f92fc06dac0 2024-04-25T09:03:07.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f9301400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc06c530 con 0x7f92fc146a30 2024-04-25T09:03:07.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f92f1e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92fc0af230 0x7f92fc152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:07.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f92f1e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92fc0af230 0x7f92fc152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:32884/0 (socket says 172.21.15.173:32884) 2024-04-25T09:03:07.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f92f1e00640 1 -- 172.21.15.173:0/368059403 learned_addr learned my addr 172.21.15.173:0/368059403 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:07.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f92fa800640 1 --2- 172.21.15.173:0/368059403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92fc06dac0 0x7f92fc0c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:07.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f92fb200640 1 --2- 172.21.15.173:0/368059403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92fc146a30 0x7f92fc152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:07.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f92f1e00640 1 -- 172.21.15.173:0/368059403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92fc146a30 msgr2=0x7f92fc152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:07.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f92f1e00640 1 --2- 172.21.15.173:0/368059403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92fc146a30 0x7f92fc152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f92f1e00640 1 -- 172.21.15.173:0/368059403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92fc06dac0 msgr2=0x7f92fc0c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:07.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f92f1e00640 1 --2- 172.21.15.173:0/368059403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92fc06dac0 0x7f92fc0c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f92f1e00640 1 -- 172.21.15.173:0/368059403 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc151460 con 0x7f92fc0af230 2024-04-25T09:03:07.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f92f1e00640 1 --2- 172.21.15.173:0/368059403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92fc0af230 0x7f92fc152fe0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f92e400c390 tx=0x7f92e400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:07.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f92f3400640 1 -- 172.21.15.173:0/368059403 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4017070 con 0x7f92fc0af230 2024-04-25T09:03:07.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f92f3400640 1 -- 172.21.15.173:0/368059403 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e40052d0 con 0x7f92fc0af230 2024-04-25T09:03:07.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f9301400640 1 -- 172.21.15.173:0/368059403 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92fc151740 con 0x7f92fc0af230 2024-04-25T09:03:07.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f92f3400640 1 -- 172.21.15.173:0/368059403 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4003820 con 0x7f92fc0af230 2024-04-25T09:03:07.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f9301400640 1 -- 172.21.15.173:0/368059403 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92fc146ec0 con 0x7f92fc0af230 2024-04-25T09:03:07.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f9301400640 1 -- 172.21.15.173:0/368059403 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92fc073a40 con 0x7f92fc0af230 2024-04-25T09:03:07.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.394+0000 7f92f3400640 1 -- 172.21.15.173:0/368059403 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f92e401a070 con 0x7f92fc0af230 2024-04-25T09:03:07.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.398+0000 7f92f3400640 1 --2- 172.21.15.173:0/368059403 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92d8066f90 0x7f92d8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.398+0000 7f92f3400640 1 -- 172.21.15.173:0/368059403 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f92e4084580 con 0x7f92fc0af230 2024-04-25T09:03:07.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.398+0000 7f92fa800640 1 --2- 172.21.15.173:0/368059403 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92d8066f90 0x7f92d8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:07.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.398+0000 7f92fa800640 1 --2- 172.21.15.173:0/368059403 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92d8066f90 0x7f92d8069450 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0ae000 tx=0x7f92ec0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:07.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.402+0000 7f92f3400640 1 -- 172.21.15.173:0/368059403 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f92e4005480 con 0x7f92fc0af230 2024-04-25T09:03:07.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.558+0000 7f9301400640 1 -- 172.21.15.173:0/368059403 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92fc072a50 con 0x7f92fc0af230 2024-04-25T09:03:07.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.558+0000 7f92f3400640 1 -- 172.21.15.173:0/368059403 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18574 (secure 0 0 0) 0x7f92e4054c90 con 0x7f92fc0af230 2024-04-25T09:03:07.547 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:07.547 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:56.440593+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:07.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.558+0000 7f9301400640 1 -- 172.21.15.173:0/368059403 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92d8066f90 msgr2=0x7f92d8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:07.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.558+0000 7f9301400640 1 --2- 172.21.15.173:0/368059403 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92d8066f90 0x7f92d8069450 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0ae000 tx=0x7f92ec0a7070 comp rx=0 tx=0).stop 2024-04-25T09:03:07.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.558+0000 7f9301400640 1 -- 172.21.15.173:0/368059403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92fc0af230 msgr2=0x7f92fc152fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:07.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.558+0000 7f9301400640 1 --2- 172.21.15.173:0/368059403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92fc0af230 0x7f92fc152fe0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f92e400c390 tx=0x7f92e400c850 comp rx=0 tx=0).stop 2024-04-25T09:03:07.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.558+0000 7f9301400640 1 -- 172.21.15.173:0/368059403 shutdown_connections 2024-04-25T09:03:07.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.558+0000 7f9301400640 1 --2- 172.21.15.173:0/368059403 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92d8066f90 0x7f92d8069450 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.558+0000 7f9301400640 1 --2- 172.21.15.173:0/368059403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92fc146a30 0x7f92fc152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.558+0000 7f9301400640 1 --2- 172.21.15.173:0/368059403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92fc0af230 0x7f92fc152fe0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.558+0000 7f9301400640 1 --2- 172.21.15.173:0/368059403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92fc06dac0 0x7f92fc0c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.558+0000 7f9301400640 1 -- 172.21.15.173:0/368059403 >> 172.21.15.173:0/368059403 conn(0x7f92fc071c20 msgr2=0x7f92fc150a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.558+0000 7f9301400640 1 -- 172.21.15.173:0/368059403 shutdown_connections 2024-04-25T09:03:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.558+0000 7f9301400640 1 -- 172.21.15.173:0/368059403 wait complete. 2024-04-25T09:03:07.568 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:03:07.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc2b800640 1 Processor -- start 2024-04-25T09:03:07.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc2b800640 1 -- start start 2024-04-25T09:03:07.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc2b800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdc2415e120 0x7fdc240b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc2b800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc2406d200 0x7fdc24099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc2b800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdc240d0630 0x7fdc24099f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc2b800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc240d1490 con 0x7fdc240d0630 2024-04-25T09:03:07.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc2b800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc240d0bf0 con 0x7fdc2415e120 2024-04-25T09:03:07.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc2b800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240d0ed0 con 0x7fdc2406d200 2024-04-25T09:03:07.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc29800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdc240d0630 0x7fdc24099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:07.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc29800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdc240d0630 0x7fdc24099f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:32898/0 (socket says 172.21.15.173:32898) 2024-04-25T09:03:07.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc29800640 1 -- 172.21.15.173:0/476527305 learned_addr learned my addr 172.21.15.173:0/476527305 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:07.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc23e00640 1 --2- 172.21.15.173:0/476527305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc2406d200 0x7fdc24099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:07.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc28e00640 1 --2- 172.21.15.173:0/476527305 >> v2:172.21.15.194:3300/0 conn(0x7fdc2415e120 0x7fdc240b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:07.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc29800640 1 -- 172.21.15.173:0/476527305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc2406d200 msgr2=0x7fdc24099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:07.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc29800640 1 --2- 172.21.15.173:0/476527305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc2406d200 0x7fdc24099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc29800640 1 -- 172.21.15.173:0/476527305 >> v2:172.21.15.194:3300/0 conn(0x7fdc2415e120 msgr2=0x7fdc240b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:07.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc29800640 1 --2- 172.21.15.173:0/476527305 >> v2:172.21.15.194:3300/0 conn(0x7fdc2415e120 0x7fdc240b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc29800640 1 -- 172.21.15.173:0/476527305 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc240d11b0 con 0x7fdc240d0630 2024-04-25T09:03:07.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.718+0000 7fdc23e00640 1 --2- 172.21.15.173:0/476527305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc2406d200 0x7fdc24099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:07.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.722+0000 7fdc29800640 1 --2- 172.21.15.173:0/476527305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc240d0630 0x7fdc24099f90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdc24072b30 tx=0x7fdc1c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f794c516b1f8f0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:07.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.722+0000 7fdc23400640 1 -- 172.21.15.173:0/476527305 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0b2070 con 0x7fdc240d0630 2024-04-25T09:03:07.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.722+0000 7fdc23400640 1 -- 172.21.15.173:0/476527305 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c0a9070 con 0x7fdc240d0630 2024-04-25T09:03:07.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.722+0000 7fdc23400640 1 -- 172.21.15.173:0/476527305 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0ad880 con 0x7fdc240d0630 2024-04-25T09:03:07.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.722+0000 7fdc2b800640 1 -- 172.21.15.173:0/476527305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc240d0630 msgr2=0x7fdc24099f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:07.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.722+0000 7fdc2b800640 1 --2- 172.21.15.173:0/476527305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc240d0630 0x7fdc24099f90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdc24072b30 tx=0x7fdc1c01c490 comp rx=0 tx=0).stop 2024-04-25T09:03:07.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.722+0000 7fdc2b800640 1 -- 172.21.15.173:0/476527305 shutdown_connections 2024-04-25T09:03:07.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.722+0000 7fdc2b800640 1 --2- 172.21.15.173:0/476527305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc240d0630 0x7fdc24099f90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.722+0000 7fdc2b800640 1 --2- 172.21.15.173:0/476527305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc2406d200 0x7fdc24099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.722+0000 7fdc2b800640 1 --2- 172.21.15.173:0/476527305 >> v2:172.21.15.194:3300/0 conn(0x7fdc2415e120 0x7fdc240b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.722+0000 7fdc2b800640 1 -- 172.21.15.173:0/476527305 >> 172.21.15.173:0/476527305 conn(0x7fdc240b32a0 msgr2=0x7fdc240b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:07.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.722+0000 7fdc2b800640 1 -- 172.21.15.173:0/476527305 shutdown_connections 2024-04-25T09:03:07.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.722+0000 7fdc2b800640 1 -- 172.21.15.173:0/476527305 wait complete. 2024-04-25T09:03:07.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc2b800640 1 Processor -- start 2024-04-25T09:03:07.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc2b800640 1 -- start start 2024-04-25T09:03:07.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc2b800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc2406d200 0x7fdc2415ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc2b800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc240d0630 0x7fdc24156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc2b800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc2415e120 0x7fdc2414d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc2b800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2406cbe0 con 0x7fdc2406d200 2024-04-25T09:03:07.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc2b800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2406ca60 con 0x7fdc2415e120 2024-04-25T09:03:07.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc2b800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2406cd60 con 0x7fdc240d0630 2024-04-25T09:03:07.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc28e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc2406d200 0x7fdc2415ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:07.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc28e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc2406d200 0x7fdc2415ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:32914/0 (socket says 172.21.15.173:32914) 2024-04-25T09:03:07.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc28e00640 1 -- 172.21.15.173:0/2686032525 learned_addr learned my addr 172.21.15.173:0/2686032525 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:07.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc28e00640 1 -- 172.21.15.173:0/2686032525 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc240d0630 msgr2=0x7fdc24156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:07.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc28e00640 1 --2- 172.21.15.173:0/2686032525 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc240d0630 0x7fdc24156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc28e00640 1 -- 172.21.15.173:0/2686032525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc2415e120 msgr2=0x7fdc2414d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:07.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc28e00640 1 --2- 172.21.15.173:0/2686032525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc2415e120 0x7fdc2414d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:07.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc28e00640 1 -- 172.21.15.173:0/2686032525 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2414da10 con 0x7fdc2406d200 2024-04-25T09:03:07.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc28e00640 1 --2- 172.21.15.173:0/2686032525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc2406d200 0x7fdc2415ac00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdc14007f20 tx=0x7fdc1400e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:07.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc20c00640 1 -- 172.21.15.173:0/2686032525 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14014620 con 0x7fdc2406d200 2024-04-25T09:03:07.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc20c00640 1 -- 172.21.15.173:0/2686032525 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc14019070 con 0x7fdc2406d200 2024-04-25T09:03:07.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc2b800640 1 -- 172.21.15.173:0/2686032525 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2415b1e0 con 0x7fdc2406d200 2024-04-25T09:03:07.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc20c00640 1 -- 172.21.15.173:0/2686032525 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14014a00 con 0x7fdc2406d200 2024-04-25T09:03:07.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.726+0000 7fdc2b800640 1 -- 172.21.15.173:0/2686032525 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc24158b80 con 0x7fdc2406d200 2024-04-25T09:03:07.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.730+0000 7fdc2b800640 1 -- 172.21.15.173:0/2686032525 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc24073ab0 con 0x7fdc2406d200 2024-04-25T09:03:07.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.730+0000 7fdc20c00640 1 -- 172.21.15.173:0/2686032525 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdc14014ba0 con 0x7fdc2406d200 2024-04-25T09:03:07.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.730+0000 7fdc20c00640 1 --2- 172.21.15.173:0/2686032525 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdc04066f60 0x7fdc04069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:07.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.730+0000 7fdc20c00640 1 -- 172.21.15.173:0/2686032525 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fdc14085cd0 con 0x7fdc2406d200 2024-04-25T09:03:07.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.730+0000 7fdc23e00640 1 --2- 172.21.15.173:0/2686032525 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdc04066f60 0x7fdc04069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:07.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.730+0000 7fdc23e00640 1 --2- 172.21.15.173:0/2686032525 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdc04066f60 0x7fdc04069420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdc10006e90 tx=0x7fdc10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:07.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.734+0000 7fdc20c00640 1 -- 172.21.15.173:0/2686032525 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdc2414da10 con 0x7fdc2406d200 2024-04-25T09:03:07.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:07.922+0000 7fdc2b800640 1 -- 172.21.15.173:0/2686032525 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdc2414e180 con 0x7fdc2406d200 2024-04-25T09:03:08.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.098+0000 7fdc20c00640 1 -- 172.21.15.173:0/2686032525 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdc14056900 con 0x7fdc2406d200 2024-04-25T09:03:08.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.102+0000 7fdc2b800640 1 -- 172.21.15.173:0/2686032525 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdc04066f60 msgr2=0x7fdc04069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.102+0000 7fdc2b800640 1 --2- 172.21.15.173:0/2686032525 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdc04066f60 0x7fdc04069420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdc10006e90 tx=0x7fdc10008040 comp rx=0 tx=0).stop 2024-04-25T09:03:08.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.102+0000 7fdc2b800640 1 -- 172.21.15.173:0/2686032525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc2406d200 msgr2=0x7fdc2415ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.102+0000 7fdc2b800640 1 --2- 172.21.15.173:0/2686032525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc2406d200 0x7fdc2415ac00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdc14007f20 tx=0x7fdc1400e570 comp rx=0 tx=0).stop 2024-04-25T09:03:08.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.102+0000 7fdc2b800640 1 -- 172.21.15.173:0/2686032525 shutdown_connections 2024-04-25T09:03:08.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.102+0000 7fdc2b800640 1 --2- 172.21.15.173:0/2686032525 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdc04066f60 0x7fdc04069420 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.102+0000 7fdc2b800640 1 --2- 172.21.15.173:0/2686032525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc2415e120 0x7fdc2414d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.102+0000 7fdc2b800640 1 --2- 172.21.15.173:0/2686032525 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc240d0630 0x7fdc24156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.102+0000 7fdc2b800640 1 --2- 172.21.15.173:0/2686032525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc2406d200 0x7fdc2415ac00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.102+0000 7fdc2b800640 1 -- 172.21.15.173:0/2686032525 >> 172.21.15.173:0/2686032525 conn(0x7fdc240b32a0 msgr2=0x7fdc240cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.102+0000 7fdc2b800640 1 -- 172.21.15.173:0/2686032525 shutdown_connections 2024-04-25T09:03:08.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.102+0000 7fdc2b800640 1 -- 172.21.15.173:0/2686032525 wait complete. 2024-04-25T09:03:08.109 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-25T09:03:08.109 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:03:08.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.258+0000 7f58bf000640 1 Processor -- start 2024-04-25T09:03:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.258+0000 7f58bf000640 1 -- start start 2024-04-25T09:03:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.258+0000 7f58bf000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f58b81580c0 0x7f58b80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.258+0000 7f58bf000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b815f000 con 0x7f58b80d2450 2024-04-25T09:03:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.258+0000 7f58bf000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b815e770 con 0x7f58b806c090 2024-04-25T09:03:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.258+0000 7f58bf000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b815ea40 con 0x7f58b81580c0 2024-04-25T09:03:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.258+0000 7f58b7400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f58b80d2450 0x7f58b815e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60468/0 (socket says 172.21.15.173:60468) 2024-04-25T09:03:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.258+0000 7f58b7400640 1 -- 172.21.15.173:0/1537616167 learned_addr learned my addr 172.21.15.173:0/1537616167 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:08.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.262+0000 7f58b7e00640 1 --2- 172.21.15.173:0/1537616167 >> v2:172.21.15.194:3300/0 conn(0x7f58b81580c0 0x7f58b80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.262+0000 7f58b6a00640 1 -- 172.21.15.173:0/1537616167 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128246800 0 0) 0x7f58b815f000 con 0x7f58b80d2450 2024-04-25T09:03:08.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.262+0000 7f58b6a00640 1 -- 172.21.15.173:0/1537616167 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f589c003530 con 0x7f58b80d2450 2024-04-25T09:03:08.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.262+0000 7f58b7e00640 1 -- 172.21.15.173:0/1537616167 >> v1:172.21.15.194:6789/0 conn(0x7f58b806c090 legacy=0x7f58b806f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.262+0000 7f58b7e00640 1 -- 172.21.15.173:0/1537616167 >> v1:172.21.15.173:6789/0 conn(0x7f58b80d2450 legacy=0x7f58b815e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.262+0000 7f58b7e00640 1 -- 172.21.15.173:0/1537616167 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b815ed20 con 0x7f58b81580c0 2024-04-25T09:03:08.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.262+0000 7f58b7e00640 1 --2- 172.21.15.173:0/1537616167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58b81580c0 0x7f58b80d1f10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f58a8009d90 tx=0x7f58a801c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f6eb159dac105f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.262+0000 7f58b6a00640 1 -- 172.21.15.173:0/1537616167 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a80b2070 con 0x7f58b81580c0 2024-04-25T09:03:08.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.262+0000 7f58b6a00640 1 -- 172.21.15.173:0/1537616167 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a80a5970 con 0x7f58b81580c0 2024-04-25T09:03:08.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.262+0000 7f58b6a00640 1 -- 172.21.15.173:0/1537616167 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a80a5d40 con 0x7f58b81580c0 2024-04-25T09:03:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58bf000640 1 -- 172.21.15.173:0/1537616167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58b81580c0 msgr2=0x7f58b80d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58bf000640 1 --2- 172.21.15.173:0/1537616167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58b81580c0 0x7f58b80d1f10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f58a8009d90 tx=0x7f58a801c8b0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58bf000640 1 -- 172.21.15.173:0/1537616167 shutdown_connections 2024-04-25T09:03:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58bf000640 1 --2- 172.21.15.173:0/1537616167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58b81580c0 0x7f58b80d1f10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58bf000640 1 -- 172.21.15.173:0/1537616167 >> 172.21.15.173:0/1537616167 conn(0x7f58b80616b0 msgr2=0x7f58b8061ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58bf000640 1 -- 172.21.15.173:0/1537616167 shutdown_connections 2024-04-25T09:03:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58bf000640 1 -- 172.21.15.173:0/1537616167 wait complete. 2024-04-25T09:03:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58bf000640 1 Processor -- start 2024-04-25T09:03:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58bf000640 1 -- start start 2024-04-25T09:03:08.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58bf000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58b806c090 0x7f58b8155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58bf000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58b81580c0 0x7f58b8150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58bf000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58b8158720 0x7f58b8161780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58bf000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80b5720 con 0x7f58b81580c0 2024-04-25T09:03:08.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58bf000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80b55a0 con 0x7f58b806c090 2024-04-25T09:03:08.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58bf000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b806fc80 con 0x7f58b8158720 2024-04-25T09:03:08.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58b7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58b81580c0 0x7f58b8150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58b7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58b81580c0 0x7f58b8150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:32916/0 (socket says 172.21.15.173:32916) 2024-04-25T09:03:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58b7400640 1 -- 172.21.15.173:0/2172203447 learned_addr learned my addr 172.21.15.173:0/2172203447 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58b7e00640 1 --2- 172.21.15.173:0/2172203447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58b806c090 0x7f58b8155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58bd000640 1 --2- 172.21.15.173:0/2172203447 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58b8158720 0x7f58b8161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58b7400640 1 -- 172.21.15.173:0/2172203447 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58b8158720 msgr2=0x7f58b8161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58b7400640 1 --2- 172.21.15.173:0/2172203447 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58b8158720 0x7f58b8161780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58b7400640 1 -- 172.21.15.173:0/2172203447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58b806c090 msgr2=0x7f58b8155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58b7400640 1 --2- 172.21.15.173:0/2172203447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58b806c090 0x7f58b8155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.266+0000 7f58b7400640 1 -- 172.21.15.173:0/2172203447 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b8155b50 con 0x7f58b81580c0 2024-04-25T09:03:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.270+0000 7f58b7400640 1 --2- 172.21.15.173:0/2172203447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58b81580c0 0x7f58b8150400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f58a400c700 tx=0x7f58a400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.270+0000 7f58afe00640 1 -- 172.21.15.173:0/2172203447 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4017070 con 0x7f58b81580c0 2024-04-25T09:03:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.270+0000 7f58afe00640 1 -- 172.21.15.173:0/2172203447 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a4007270 con 0x7f58b81580c0 2024-04-25T09:03:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.270+0000 7f58afe00640 1 -- 172.21.15.173:0/2172203447 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40057b0 con 0x7f58b81580c0 2024-04-25T09:03:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.270+0000 7f58bf000640 1 -- 172.21.15.173:0/2172203447 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b8156a80 con 0x7f58b81580c0 2024-04-25T09:03:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.270+0000 7f58bf000640 1 -- 172.21.15.173:0/2172203447 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b8156d60 con 0x7f58b81580c0 2024-04-25T09:03:08.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.270+0000 7f58bf000640 1 -- 172.21.15.173:0/2172203447 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b8073ab0 con 0x7f58b81580c0 2024-04-25T09:03:08.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.270+0000 7f58afe00640 1 -- 172.21.15.173:0/2172203447 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f58a401a070 con 0x7f58b81580c0 2024-04-25T09:03:08.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.270+0000 7f58afe00640 1 --2- 172.21.15.173:0/2172203447 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5898066f90 0x7f5898069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:08.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.270+0000 7f58afe00640 1 -- 172.21.15.173:0/2172203447 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f58a40846a0 con 0x7f58b81580c0 2024-04-25T09:03:08.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.270+0000 7f58b7e00640 1 --2- 172.21.15.173:0/2172203447 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5898066f90 0x7f5898069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:08.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.274+0000 7f58b7e00640 1 --2- 172.21.15.173:0/2172203447 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5898066f90 0x7f5898069450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f58a80af000 tx=0x7f58a80a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:08.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.274+0000 7f58afe00640 1 -- 172.21.15.173:0/2172203447 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f58a4054dd0 con 0x7f58b81580c0 2024-04-25T09:03:08.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:08.470+0000 7f58bf000640 1 -- 172.21.15.173:0/2172203447 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f58b806bd10 con 0x7f58b81580c0 2024-04-25T09:03:09.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.102+0000 7f58afe00640 1 -- 172.21.15.173:0/2172203447 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f58a4058e70 con 0x7f58b81580c0 2024-04-25T09:03:09.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.106+0000 7f58bf000640 1 -- 172.21.15.173:0/2172203447 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5898066f90 msgr2=0x7f5898069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:09.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.106+0000 7f58bf000640 1 --2- 172.21.15.173:0/2172203447 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5898066f90 0x7f5898069450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f58a80af000 tx=0x7f58a80a7070 comp rx=0 tx=0).stop 2024-04-25T09:03:09.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.106+0000 7f58bf000640 1 -- 172.21.15.173:0/2172203447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58b81580c0 msgr2=0x7f58b8150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:09.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.106+0000 7f58bf000640 1 --2- 172.21.15.173:0/2172203447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58b81580c0 0x7f58b8150400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f58a400c700 tx=0x7f58a400cbc0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.106+0000 7f58bf000640 1 -- 172.21.15.173:0/2172203447 shutdown_connections 2024-04-25T09:03:09.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.106+0000 7f58bf000640 1 --2- 172.21.15.173:0/2172203447 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5898066f90 0x7f5898069450 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.106+0000 7f58bf000640 1 --2- 172.21.15.173:0/2172203447 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58b8158720 0x7f58b8161780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.106+0000 7f58bf000640 1 --2- 172.21.15.173:0/2172203447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58b81580c0 0x7f58b8150400 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.106+0000 7f58bf000640 1 --2- 172.21.15.173:0/2172203447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58b806c090 0x7f58b8155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.106+0000 7f58bf000640 1 -- 172.21.15.173:0/2172203447 >> 172.21.15.173:0/2172203447 conn(0x7f58b80616b0 msgr2=0x7f58b80b6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:09.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.106+0000 7f58bf000640 1 -- 172.21.15.173:0/2172203447 shutdown_connections 2024-04-25T09:03:09.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.106+0000 7f58bf000640 1 -- 172.21.15.173:0/2172203447 wait complete. 2024-04-25T09:03:09.116 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:03:09.116 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:09.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.262+0000 7f5d10000640 1 Processor -- start 2024-04-25T09:03:09.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.262+0000 7f5d10000640 1 -- start start 2024-04-25T09:03:09.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.266+0000 7f5d10000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d080cc8b0 0x7f5d080ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.266+0000 7f5d10000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5d080ce8f0 0x7f5d080ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.266+0000 7f5d10000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d0806e7c0 con 0x7f5d08145250 2024-04-25T09:03:09.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.266+0000 7f5d10000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0806d720 con 0x7f5d080ce8f0 2024-04-25T09:03:09.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.266+0000 7f5d10000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0806da00 con 0x7f5d080cc8b0 2024-04-25T09:03:09.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.266+0000 7f5d0e000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5d080ce8f0 0x7f5d080ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.266+0000 7f5d0d600640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f5d08145250 0x7f5d0815c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60484/0 (socket says 172.21.15.173:60484) 2024-04-25T09:03:09.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.266+0000 7f5d0d600640 1 -- 172.21.15.173:0/872464288 learned_addr learned my addr 172.21.15.173:0/872464288 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:09.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.266+0000 7f5d0e000640 1 -- 172.21.15.173:0/872464288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d080cc8b0 msgr2=0x7f5d080ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:09.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.266+0000 7f5d0e000640 1 --2- 172.21.15.173:0/872464288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d080cc8b0 0x7f5d080ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.266+0000 7f5d0e000640 1 -- 172.21.15.173:0/872464288 >> v1:172.21.15.173:6789/0 conn(0x7f5d08145250 legacy=0x7f5d0815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:09.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.266+0000 7f5d07e00640 1 -- 172.21.15.173:0/872464288 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291371596 0 0) 0x7f5d0806e7c0 con 0x7f5d08145250 2024-04-25T09:03:09.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.266+0000 7f5d0e000640 1 -- 172.21.15.173:0/872464288 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0806dce0 con 0x7f5d080ce8f0 2024-04-25T09:03:09.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.270+0000 7f5d0e000640 1 --2- 172.21.15.173:0/872464288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d080ce8f0 0x7f5d080ced60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5d00009d90 tx=0x7f5d0001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6958d6d6e99fd374 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:09.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.270+0000 7f5d07e00640 1 -- 172.21.15.173:0/872464288 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d000b2070 con 0x7f5d080ce8f0 2024-04-25T09:03:09.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.270+0000 7f5d07e00640 1 -- 172.21.15.173:0/872464288 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d000a5920 con 0x7f5d080ce8f0 2024-04-25T09:03:09.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.270+0000 7f5d07e00640 1 -- 172.21.15.173:0/872464288 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d000a5cf0 con 0x7f5d080ce8f0 2024-04-25T09:03:09.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.270+0000 7f5d10000640 1 -- 172.21.15.173:0/872464288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d080ce8f0 msgr2=0x7f5d080ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:09.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.270+0000 7f5d10000640 1 --2- 172.21.15.173:0/872464288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d080ce8f0 0x7f5d080ced60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5d00009d90 tx=0x7f5d0001c970 comp rx=0 tx=0).stop 2024-04-25T09:03:09.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.270+0000 7f5d10000640 1 -- 172.21.15.173:0/872464288 shutdown_connections 2024-04-25T09:03:09.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.270+0000 7f5d10000640 1 --2- 172.21.15.173:0/872464288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d080ce8f0 0x7f5d080ced60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.270+0000 7f5d10000640 1 --2- 172.21.15.173:0/872464288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d080cc8b0 0x7f5d080ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.270+0000 7f5d10000640 1 -- 172.21.15.173:0/872464288 >> 172.21.15.173:0/872464288 conn(0x7f5d0806ac90 msgr2=0x7f5d0806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:09.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.270+0000 7f5d10000640 1 -- 172.21.15.173:0/872464288 shutdown_connections 2024-04-25T09:03:09.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.270+0000 7f5d10000640 1 -- 172.21.15.173:0/872464288 wait complete. 2024-04-25T09:03:09.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.270+0000 7f5d10000640 1 Processor -- start 2024-04-25T09:03:09.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.270+0000 7f5d10000640 1 -- start start 2024-04-25T09:03:09.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d10000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d080cc8b0 0x7f5d08159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d10000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d080ce8f0 0x7f5d08159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d10000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d08145250 0x7f5d0813de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d10000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0806d380 con 0x7f5d080ce8f0 2024-04-25T09:03:09.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d10000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0806ef80 con 0x7f5d08145250 2024-04-25T09:03:09.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d10000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0806d500 con 0x7f5d080cc8b0 2024-04-25T09:03:09.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d0cc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d080ce8f0 0x7f5d08159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d0cc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d080ce8f0 0x7f5d08159de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:32938/0 (socket says 172.21.15.173:32938) 2024-04-25T09:03:09.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d0cc00640 1 -- 172.21.15.173:0/2709977814 learned_addr learned my addr 172.21.15.173:0/2709977814 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:09.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d0d600640 1 --2- 172.21.15.173:0/2709977814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d080cc8b0 0x7f5d08159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d0e000640 1 --2- 172.21.15.173:0/2709977814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d08145250 0x7f5d0813de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d0cc00640 1 -- 172.21.15.173:0/2709977814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d080cc8b0 msgr2=0x7f5d08159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:09.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d0cc00640 1 --2- 172.21.15.173:0/2709977814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d080cc8b0 0x7f5d08159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d0cc00640 1 -- 172.21.15.173:0/2709977814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d08145250 msgr2=0x7f5d0813de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:09.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d0cc00640 1 --2- 172.21.15.173:0/2709977814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d08145250 0x7f5d0813de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d0cc00640 1 -- 172.21.15.173:0/2709977814 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0815a7c0 con 0x7f5d080ce8f0 2024-04-25T09:03:09.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d0cc00640 1 --2- 172.21.15.173:0/2709977814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d080ce8f0 0x7f5d08159de0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400b550 tx=0x7f5cf400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:09.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d05600640 1 -- 172.21.15.173:0/2709977814 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4014070 con 0x7f5d080ce8f0 2024-04-25T09:03:09.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d05600640 1 -- 172.21.15.173:0/2709977814 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf4010890 con 0x7f5d080ce8f0 2024-04-25T09:03:09.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d05600640 1 -- 172.21.15.173:0/2709977814 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4010c80 con 0x7f5d080ce8f0 2024-04-25T09:03:09.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d10000640 1 -- 172.21.15.173:0/2709977814 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0815aaa0 con 0x7f5d080ce8f0 2024-04-25T09:03:09.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d10000640 1 -- 172.21.15.173:0/2709977814 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0815b060 con 0x7f5d080ce8f0 2024-04-25T09:03:09.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d10000640 1 -- 172.21.15.173:0/2709977814 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d08073a40 con 0x7f5d080ce8f0 2024-04-25T09:03:09.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.274+0000 7f5d05600640 1 -- 172.21.15.173:0/2709977814 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5cf4017070 con 0x7f5d080ce8f0 2024-04-25T09:03:09.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.278+0000 7f5d05600640 1 --2- 172.21.15.173:0/2709977814 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5ce8066f60 0x7f5ce8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.278+0000 7f5d05600640 1 -- 172.21.15.173:0/2709977814 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5cf40851e0 con 0x7f5d080ce8f0 2024-04-25T09:03:09.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.278+0000 7f5d0d600640 1 --2- 172.21.15.173:0/2709977814 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5ce8066f60 0x7f5ce8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.278+0000 7f5d0d600640 1 --2- 172.21.15.173:0/2709977814 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5ce8066f60 0x7f5ce8069420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc000f70 tx=0x7f5cfc007c10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:09.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.282+0000 7f5d05600640 1 -- 172.21.15.173:0/2709977814 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5cf4055e10 con 0x7f5d080ce8f0 2024-04-25T09:03:09.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.466+0000 7f5d10000640 1 -- 172.21.15.173:0/2709977814 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d080d0000 con 0x7f5d080ce8f0 2024-04-25T09:03:09.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.466+0000 7f5d05600640 1 -- 172.21.15.173:0/2709977814 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4946 (secure 0 0 0) 0x7f5cf4010e20 con 0x7f5d080ce8f0 2024-04-25T09:03:09.455 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:09.456 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2883565303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2883565303},{"type":"v1","addr":"172.21.15.194:6834","nonce":2883565303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2634963400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2634963400},{"type":"v1","addr":"172.21.15.173:6837","nonce":2634963400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3101502434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3101502434},{"type":"v1","addr":"172.21.15.173:6836","nonce":3101502434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:51.389514+0000","modified":"2024-04-25T09:03:08.473956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/4160663138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4160663138},{"type":"v1","addr":"172.21.15.194:6835","nonce":4160663138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:03:09.456 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 9 2024-04-25T09:03:09.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.466+0000 7f5d10000640 1 -- 172.21.15.173:0/2709977814 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5ce8066f60 msgr2=0x7f5ce8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:09.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.466+0000 7f5d10000640 1 --2- 172.21.15.173:0/2709977814 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5ce8066f60 0x7f5ce8069420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc000f70 tx=0x7f5cfc007c10 comp rx=0 tx=0).stop 2024-04-25T09:03:09.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.466+0000 7f5d10000640 1 -- 172.21.15.173:0/2709977814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d080ce8f0 msgr2=0x7f5d08159de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:09.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.466+0000 7f5d10000640 1 --2- 172.21.15.173:0/2709977814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d080ce8f0 0x7f5d08159de0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400b550 tx=0x7f5cf400ba10 comp rx=0 tx=0).stop 2024-04-25T09:03:09.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.470+0000 7f5d10000640 1 -- 172.21.15.173:0/2709977814 shutdown_connections 2024-04-25T09:03:09.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.470+0000 7f5d10000640 1 --2- 172.21.15.173:0/2709977814 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5ce8066f60 0x7f5ce8069420 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.470+0000 7f5d10000640 1 --2- 172.21.15.173:0/2709977814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d08145250 0x7f5d0813de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.470+0000 7f5d10000640 1 --2- 172.21.15.173:0/2709977814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d080ce8f0 0x7f5d08159de0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.470+0000 7f5d10000640 1 --2- 172.21.15.173:0/2709977814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d080cc8b0 0x7f5d08159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.470+0000 7f5d10000640 1 -- 172.21.15.173:0/2709977814 >> 172.21.15.173:0/2709977814 conn(0x7f5d0806ac90 msgr2=0x7f5d0806b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:09.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.470+0000 7f5d10000640 1 -- 172.21.15.173:0/2709977814 shutdown_connections 2024-04-25T09:03:09.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.470+0000 7f5d10000640 1 -- 172.21.15.173:0/2709977814 wait complete. 2024-04-25T09:03:09.477 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:09.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.622+0000 7f0004600640 1 Processor -- start 2024-04-25T09:03:09.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.622+0000 7f0004600640 1 -- start start 2024-04-25T09:03:09.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.622+0000 7f0004600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efffc15edd0 0x7efffc0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.622+0000 7f0004600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc15f320 con 0x7efffc0b3e70 2024-04-25T09:03:09.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.622+0000 7f0004600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc06d420 con 0x7efffc0aefa0 2024-04-25T09:03:09.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.622+0000 7f0004600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efffc06dd50 con 0x7efffc15edd0 2024-04-25T09:03:09.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7f0001c00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7efffc0b3e70 0x7efffc0b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60492/0 (socket says 172.21.15.173:60492) 2024-04-25T09:03:09.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7f0001c00640 1 -- 172.21.15.173:0/2645470306 learned_addr learned my addr 172.21.15.173:0/2645470306 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:09.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7f0002600640 1 --2- 172.21.15.173:0/2645470306 >> v2:172.21.15.194:3300/0 conn(0x7efffc15edd0 0x7efffc0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7efffbe00640 1 -- 172.21.15.173:0/2645470306 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797525743 0 0) 0x7efffc15f320 con 0x7efffc0b3e70 2024-04-25T09:03:09.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7efffbe00640 1 -- 172.21.15.173:0/2645470306 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effe4005740 con 0x7efffc0b3e70 2024-04-25T09:03:09.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7efffbe00640 1 -- 172.21.15.173:0/2645470306 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2376459421 0 0) 0x7effe4005740 con 0x7efffc0b3e70 2024-04-25T09:03:09.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7efffbe00640 1 -- 172.21.15.173:0/2645470306 >> v2:172.21.15.194:3300/0 conn(0x7efffc15edd0 msgr2=0x7efffc0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:09.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7efffbe00640 1 --2- 172.21.15.173:0/2645470306 >> v2:172.21.15.194:3300/0 conn(0x7efffc15edd0 0x7efffc0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7efffbe00640 1 -- 172.21.15.173:0/2645470306 >> v1:172.21.15.194:6789/0 conn(0x7efffc0aefa0 legacy=0x7efffc0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:09.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7efffbe00640 1 -- 172.21.15.173:0/2645470306 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc06d700 con 0x7efffc0b3e70 2024-04-25T09:03:09.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7efffbe00640 1 -- 172.21.15.173:0/2645470306 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7efff0001680 con 0x7efffc0b3e70 2024-04-25T09:03:09.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7efffbe00640 1 -- 172.21.15.173:0/2645470306 >> v1:172.21.15.173:6789/0 conn(0x7efffc0b3e70 legacy=0x7efffc0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:09.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7efffbe00640 1 --2- 172.21.15.173:0/2645470306 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effe4005bd0 0x7effe4005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7efffbe00640 1 --2- 172.21.15.173:0/2645470306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effe4006a20 0x7effe4006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7efffbe00640 1 --2- 172.21.15.173:0/2645470306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effe40073e0 0x7effe400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7efffbe00640 1 -- 172.21.15.173:0/2645470306 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc06dd50 con 0x7effe40073e0 2024-04-25T09:03:09.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7efffbe00640 1 -- 172.21.15.173:0/2645470306 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe400e280 con 0x7effe4006a20 2024-04-25T09:03:09.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7efffbe00640 1 -- 172.21.15.173:0/2645470306 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe400e480 con 0x7effe4005bd0 2024-04-25T09:03:09.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7f0002600640 1 --2- 172.21.15.173:0/2645470306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effe40073e0 0x7effe400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7f0001c00640 1 --2- 172.21.15.173:0/2645470306 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effe4005bd0 0x7effe4005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7f0001200640 1 --2- 172.21.15.173:0/2645470306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effe4006a20 0x7effe4006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7f0002600640 1 -- 172.21.15.173:0/2645470306 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effe4005bd0 msgr2=0x7effe4005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:09.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7f0002600640 1 --2- 172.21.15.173:0/2645470306 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effe4005bd0 0x7effe4005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7f0002600640 1 -- 172.21.15.173:0/2645470306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effe4006a20 msgr2=0x7effe4006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:09.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7f0002600640 1 --2- 172.21.15.173:0/2645470306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effe4006a20 0x7effe4006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7f0002600640 1 -- 172.21.15.173:0/2645470306 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe4005740 con 0x7effe40073e0 2024-04-25T09:03:09.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.626+0000 7f0001200640 1 --2- 172.21.15.173:0/2645470306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effe4006a20 0x7effe4006ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:09.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.630+0000 7f0002600640 1 -- 172.21.15.173:0/2645470306 reap_dead start 2024-04-25T09:03:09.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.630+0000 7f0002600640 1 --2- 172.21.15.173:0/2645470306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effe40073e0 0x7effe400dbe0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efff4009fc0 tx=0x7efff401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49def7b273370f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:09.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.630+0000 7efffbe00640 1 -- 172.21.15.173:0/2645470306 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4009c10 con 0x7effe40073e0 2024-04-25T09:03:09.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.630+0000 7efffbe00640 1 -- 172.21.15.173:0/2645470306 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff40a5cd0 con 0x7effe40073e0 2024-04-25T09:03:09.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.630+0000 7efffbe00640 1 -- 172.21.15.173:0/2645470306 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4003be0 con 0x7effe40073e0 2024-04-25T09:03:09.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.630+0000 7f0004600640 1 -- 172.21.15.173:0/2645470306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effe40073e0 msgr2=0x7effe400dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:09.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.630+0000 7f0004600640 1 --2- 172.21.15.173:0/2645470306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effe40073e0 0x7effe400dbe0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efff4009fc0 tx=0x7efff401ccc0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.630+0000 7f0004600640 1 -- 172.21.15.173:0/2645470306 shutdown_connections 2024-04-25T09:03:09.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.630+0000 7f0004600640 1 --2- 172.21.15.173:0/2645470306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effe40073e0 0x7effe400dbe0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.630+0000 7f0004600640 1 -- 172.21.15.173:0/2645470306 >> 172.21.15.173:0/2645470306 conn(0x7efffc06ac90 msgr2=0x7efffc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:09.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.630+0000 7f0004600640 1 -- 172.21.15.173:0/2645470306 shutdown_connections 2024-04-25T09:03:09.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.630+0000 7f0004600640 1 -- 172.21.15.173:0/2645470306 wait complete. 2024-04-25T09:03:09.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.630+0000 7f0004600640 1 Processor -- start 2024-04-25T09:03:09.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.630+0000 7f0004600640 1 -- start start 2024-04-25T09:03:09.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0004600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effe40073e0 0x7efffc15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0004600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efffc15b850 0x7efffc150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0004600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efffc152e70 0x7efffc1532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0004600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc06e1e0 con 0x7efffc152e70 2024-04-25T09:03:09.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0004600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc15aba0 con 0x7effe40073e0 2024-04-25T09:03:09.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0004600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efffc06e360 con 0x7efffc15b850 2024-04-25T09:03:09.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0002600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efffc152e70 0x7efffc1532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0002600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efffc152e70 0x7efffc1532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:32960/0 (socket says 172.21.15.173:32960) 2024-04-25T09:03:09.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0002600640 1 -- 172.21.15.173:0/1359971099 learned_addr learned my addr 172.21.15.173:0/1359971099 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:09.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0001c00640 1 --2- 172.21.15.173:0/1359971099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effe40073e0 0x7efffc15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0001200640 1 --2- 172.21.15.173:0/1359971099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efffc15b850 0x7efffc150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0002600640 1 -- 172.21.15.173:0/1359971099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efffc15b850 msgr2=0x7efffc150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:09.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0002600640 1 --2- 172.21.15.173:0/1359971099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efffc15b850 0x7efffc150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0002600640 1 -- 172.21.15.173:0/1359971099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effe40073e0 msgr2=0x7efffc15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:09.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0002600640 1 --2- 172.21.15.173:0/1359971099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effe40073e0 0x7efffc15adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0002600640 1 -- 172.21.15.173:0/1359971099 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc06e850 con 0x7efffc152e70 2024-04-25T09:03:09.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0002600640 1 --2- 172.21.15.173:0/1359971099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efffc152e70 0x7efffc1532f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efff401d1a0 tx=0x7efff4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:09.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7efff9600640 1 -- 172.21.15.173:0/1359971099 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4009c10 con 0x7efffc152e70 2024-04-25T09:03:09.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7efff9600640 1 -- 172.21.15.173:0/1359971099 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff40bd070 con 0x7efffc152e70 2024-04-25T09:03:09.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0004600640 1 -- 172.21.15.173:0/1359971099 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efffc15bfc0 con 0x7efffc152e70 2024-04-25T09:03:09.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7efff9600640 1 -- 172.21.15.173:0/1359971099 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff40039a0 con 0x7efffc152e70 2024-04-25T09:03:09.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0004600640 1 -- 172.21.15.173:0/1359971099 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efffc157ac0 con 0x7efffc152e70 2024-04-25T09:03:09.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7f0004600640 1 -- 172.21.15.173:0/1359971099 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efffc073a40 con 0x7efffc152e70 2024-04-25T09:03:09.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.634+0000 7efff9600640 1 -- 172.21.15.173:0/1359971099 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efff4003b40 con 0x7efffc152e70 2024-04-25T09:03:09.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.638+0000 7efff9600640 1 --2- 172.21.15.173:0/1359971099 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7effdc066f60 0x7effdc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.638+0000 7efff9600640 1 -- 172.21.15.173:0/1359971099 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7efff4120f60 con 0x7efffc152e70 2024-04-25T09:03:09.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.638+0000 7f0001c00640 1 --2- 172.21.15.173:0/1359971099 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7effdc066f60 0x7effdc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.638+0000 7f0001c00640 1 --2- 172.21.15.173:0/1359971099 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7effdc066f60 0x7effdc069420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efff0000c10 tx=0x7efff0007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:09.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.642+0000 7efff9600640 1 -- 172.21.15.173:0/1359971099 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efff40c7020 con 0x7efffc152e70 2024-04-25T09:03:09.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.798+0000 7f0004600640 1 -- 172.21.15.173:0/1359971099 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efffc06f1c0 con 0x7efffc152e70 2024-04-25T09:03:09.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.798+0000 7efff9600640 1 -- 172.21.15.173:0/1359971099 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18574 (secure 0 0 0) 0x7efff40169d0 con 0x7efffc152e70 2024-04-25T09:03:09.789 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:09.789 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:56.440593+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:09.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.802+0000 7f0004600640 1 -- 172.21.15.173:0/1359971099 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7effdc066f60 msgr2=0x7effdc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:09.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.802+0000 7f0004600640 1 --2- 172.21.15.173:0/1359971099 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7effdc066f60 0x7effdc069420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efff0000c10 tx=0x7efff0007900 comp rx=0 tx=0).stop 2024-04-25T09:03:09.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.802+0000 7f0004600640 1 -- 172.21.15.173:0/1359971099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efffc152e70 msgr2=0x7efffc1532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:09.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.802+0000 7f0004600640 1 --2- 172.21.15.173:0/1359971099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efffc152e70 0x7efffc1532f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efff401d1a0 tx=0x7efff4009750 comp rx=0 tx=0).stop 2024-04-25T09:03:09.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.802+0000 7f0004600640 1 -- 172.21.15.173:0/1359971099 shutdown_connections 2024-04-25T09:03:09.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.802+0000 7f0004600640 1 --2- 172.21.15.173:0/1359971099 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7effdc066f60 0x7effdc069420 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.802+0000 7f0004600640 1 --2- 172.21.15.173:0/1359971099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efffc152e70 0x7efffc1532f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.802+0000 7f0004600640 1 --2- 172.21.15.173:0/1359971099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efffc15b850 0x7efffc150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.802+0000 7f0004600640 1 --2- 172.21.15.173:0/1359971099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effe40073e0 0x7efffc15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.802+0000 7f0004600640 1 -- 172.21.15.173:0/1359971099 >> 172.21.15.173:0/1359971099 conn(0x7efffc06ac90 msgr2=0x7efffc154270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:09.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.802+0000 7f0004600640 1 -- 172.21.15.173:0/1359971099 shutdown_connections 2024-04-25T09:03:09.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.802+0000 7f0004600640 1 -- 172.21.15.173:0/1359971099 wait complete. 2024-04-25T09:03:09.810 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:03:09.810 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:03:09.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.954+0000 7ff787c00640 1 Processor -- start 2024-04-25T09:03:09.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.954+0000 7ff787c00640 1 -- start start 2024-04-25T09:03:09.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.958+0000 7ff787c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff780160fe0 0x7ff780161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.958+0000 7ff787c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff78006bca0 0x7ff78006c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.958+0000 7ff787c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff780061d60 con 0x7ff78006dac0 2024-04-25T09:03:09.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.958+0000 7ff787c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7800ad510 con 0x7ff780160fe0 2024-04-25T09:03:09.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.958+0000 7ff787c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7801613c0 con 0x7ff78006bca0 2024-04-25T09:03:09.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.958+0000 7ff785200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff780160fe0 0x7ff780161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.958+0000 7ff785200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff780160fe0 0x7ff780161fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:32966/0 (socket says 172.21.15.173:32966) 2024-04-25T09:03:09.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.958+0000 7ff785200640 1 -- 172.21.15.173:0/1350393547 learned_addr learned my addr 172.21.15.173:0/1350393547 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:09.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.958+0000 7ff785c00640 1 --2- 172.21.15.173:0/1350393547 >> v2:172.21.15.194:3300/0 conn(0x7ff78006bca0 0x7ff78006c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.958+0000 7ff785200640 1 -- 172.21.15.173:0/1350393547 >> v2:172.21.15.194:3300/0 conn(0x7ff78006bca0 msgr2=0x7ff78006c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:09.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.958+0000 7ff785200640 1 --2- 172.21.15.173:0/1350393547 >> v2:172.21.15.194:3300/0 conn(0x7ff78006bca0 0x7ff78006c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.958+0000 7ff785200640 1 -- 172.21.15.173:0/1350393547 >> v1:172.21.15.194:6789/0 conn(0x7ff78006dac0 legacy=0x7ff7800ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:09.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.958+0000 7ff785200640 1 -- 172.21.15.173:0/1350393547 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78006dfa0 con 0x7ff780160fe0 2024-04-25T09:03:09.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff785200640 1 --2- 172.21.15.173:0/1350393547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff780160fe0 0x7ff780161fb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff780062040 tx=0x7ff77001c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b21bf17dcc160c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:09.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff77fe00640 1 -- 172.21.15.173:0/1350393547 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7700b0070 con 0x7ff780160fe0 2024-04-25T09:03:09.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff77fe00640 1 -- 172.21.15.173:0/1350393547 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7700ab600 con 0x7ff780160fe0 2024-04-25T09:03:09.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff77fe00640 1 -- 172.21.15.173:0/1350393547 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7700ab9d0 con 0x7ff780160fe0 2024-04-25T09:03:09.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff787c00640 1 -- 172.21.15.173:0/1350393547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff780160fe0 msgr2=0x7ff780161fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:09.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff787c00640 1 --2- 172.21.15.173:0/1350393547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff780160fe0 0x7ff780161fb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff780062040 tx=0x7ff77001c270 comp rx=0 tx=0).stop 2024-04-25T09:03:09.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff787c00640 1 -- 172.21.15.173:0/1350393547 shutdown_connections 2024-04-25T09:03:09.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff787c00640 1 --2- 172.21.15.173:0/1350393547 >> v2:172.21.15.194:3300/0 conn(0x7ff78006bca0 0x7ff78006c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff787c00640 1 --2- 172.21.15.173:0/1350393547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff780160fe0 0x7ff780161fb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff787c00640 1 -- 172.21.15.173:0/1350393547 >> 172.21.15.173:0/1350393547 conn(0x7ff780071c20 msgr2=0x7ff780072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:09.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff787c00640 1 -- 172.21.15.173:0/1350393547 shutdown_connections 2024-04-25T09:03:09.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff787c00640 1 -- 172.21.15.173:0/1350393547 wait complete. 2024-04-25T09:03:09.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff787c00640 1 Processor -- start 2024-04-25T09:03:09.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff787c00640 1 -- start start 2024-04-25T09:03:09.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff787c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff78006bca0 0x7ff780144460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff787c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff78006dac0 0x7ff7801492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff787c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff780160fe0 0x7ff780149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff787c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7801624f0 con 0x7ff78006bca0 2024-04-25T09:03:09.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff787c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78006eb20 con 0x7ff78006dac0 2024-04-25T09:03:09.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.962+0000 7ff787c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78006f850 con 0x7ff780160fe0 2024-04-25T09:03:09.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff785200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff78006bca0 0x7ff780144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff785200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff78006bca0 0x7ff780144460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:32968/0 (socket says 172.21.15.173:32968) 2024-04-25T09:03:09.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff785200640 1 -- 172.21.15.173:0/1845483468 learned_addr learned my addr 172.21.15.173:0/1845483468 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:09.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff777e00640 1 --2- 172.21.15.173:0/1845483468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff78006dac0 0x7ff7801492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff785c00640 1 --2- 172.21.15.173:0/1845483468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff780160fe0 0x7ff780149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff785200640 1 -- 172.21.15.173:0/1845483468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff780160fe0 msgr2=0x7ff780149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:09.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff785200640 1 --2- 172.21.15.173:0/1845483468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff780160fe0 0x7ff780149830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff785200640 1 -- 172.21.15.173:0/1845483468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff78006dac0 msgr2=0x7ff7801492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:09.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff785200640 1 --2- 172.21.15.173:0/1845483468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff78006dac0 0x7ff7801492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:09.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff785200640 1 -- 172.21.15.173:0/1845483468 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780144bd0 con 0x7ff78006bca0 2024-04-25T09:03:09.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff785200640 1 --2- 172.21.15.173:0/1845483468 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff78006bca0 0x7ff780144460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff770019ea0 tx=0x7ff770019010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:09.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff77d600640 1 -- 172.21.15.173:0/1845483468 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7700b0040 con 0x7ff78006bca0 2024-04-25T09:03:09.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff77d600640 1 -- 172.21.15.173:0/1845483468 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7700ab400 con 0x7ff78006bca0 2024-04-25T09:03:09.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff787c00640 1 -- 172.21.15.173:0/1845483468 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff780144eb0 con 0x7ff78006bca0 2024-04-25T09:03:09.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff77d600640 1 -- 172.21.15.173:0/1845483468 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7700b4660 con 0x7ff78006bca0 2024-04-25T09:03:09.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff787c00640 1 -- 172.21.15.173:0/1845483468 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff780145470 con 0x7ff78006bca0 2024-04-25T09:03:09.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff787c00640 1 -- 172.21.15.173:0/1845483468 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff780073a40 con 0x7ff78006bca0 2024-04-25T09:03:09.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff77d600640 1 -- 172.21.15.173:0/1845483468 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff7700bb020 con 0x7ff78006bca0 2024-04-25T09:03:09.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.966+0000 7ff77d600640 1 --2- 172.21.15.173:0/1845483468 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff75c066f60 0x7ff75c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:09.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.970+0000 7ff77d600640 1 -- 172.21.15.173:0/1845483468 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff77011e690 con 0x7ff78006bca0 2024-04-25T09:03:09.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.970+0000 7ff777e00640 1 --2- 172.21.15.173:0/1845483468 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff75c066f60 0x7ff75c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:09.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.970+0000 7ff777e00640 1 --2- 172.21.15.173:0/1845483468 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff75c066f60 0x7ff75c069420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff7801405f0 tx=0x7ff768007e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:09.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:09.974+0000 7ff77d600640 1 -- 172.21.15.173:0/1845483468 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff7700c2020 con 0x7ff78006bca0 2024-04-25T09:03:10.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.126+0000 7ff787c00640 1 -- 172.21.15.173:0/1845483468 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7801457c0 con 0x7ff75c066f60 2024-04-25T09:03:10.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.134+0000 7ff77d600640 1 -- 172.21.15.173:0/1845483468 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332558 (secure 0 0 0) 0x7ff7801457c0 con 0x7ff75c066f60 2024-04-25T09:03:10.132 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:10.134 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:03:10.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.142+0000 7ff787c00640 1 -- 172.21.15.173:0/1845483468 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff75c066f60 msgr2=0x7ff75c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:10.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.142+0000 7ff787c00640 1 --2- 172.21.15.173:0/1845483468 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff75c066f60 0x7ff75c069420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff7801405f0 tx=0x7ff768007e40 comp rx=0 tx=0).stop 2024-04-25T09:03:10.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.142+0000 7ff787c00640 1 -- 172.21.15.173:0/1845483468 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff78006bca0 msgr2=0x7ff780144460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:10.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.142+0000 7ff787c00640 1 --2- 172.21.15.173:0/1845483468 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff78006bca0 0x7ff780144460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff770019ea0 tx=0x7ff770019010 comp rx=0 tx=0).stop 2024-04-25T09:03:10.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.142+0000 7ff787c00640 1 -- 172.21.15.173:0/1845483468 shutdown_connections 2024-04-25T09:03:10.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.142+0000 7ff787c00640 1 --2- 172.21.15.173:0/1845483468 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff75c066f60 0x7ff75c069420 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.142+0000 7ff787c00640 1 --2- 172.21.15.173:0/1845483468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff780160fe0 0x7ff780149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.142+0000 7ff787c00640 1 --2- 172.21.15.173:0/1845483468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff78006dac0 0x7ff7801492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.142+0000 7ff787c00640 1 --2- 172.21.15.173:0/1845483468 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff78006bca0 0x7ff780144460 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.142+0000 7ff787c00640 1 -- 172.21.15.173:0/1845483468 >> 172.21.15.173:0/1845483468 conn(0x7ff780071c20 msgr2=0x7ff7800b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:10.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.142+0000 7ff787c00640 1 -- 172.21.15.173:0/1845483468 shutdown_connections 2024-04-25T09:03:10.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.142+0000 7ff787c00640 1 -- 172.21.15.173:0/1845483468 wait complete. 2024-04-25T09:03:10.149 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-25T09:03:08.728756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219512,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755208,"statfs":{"total":773094113280,"available":772869332992,"internally_reserved":0,"allocated":3416064,"data_stored":2040950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.677154"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790824+0000","last_change":"2024-04-25T09:02:51.036766+0000","last_active":"2024-04-25T09:02:57.790824+0000","last_peered":"2024-04-25T09:02:57.790824+0000","last_clean":"2024-04-25T09:02:57.790824+0000","last_became_active":"2024-04-25T09:02:51.036485+0000","last_became_peered":"2024-04-25T09:02:51.036485+0000","last_unstale":"2024-04-25T09:02:57.790824+0000","last_undegraded":"2024-04-25T09:02:57.790824+0000","last_fullsized":"2024-04-25T09:02:57.790824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:41.333762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053869+0000","last_change":"2024-04-25T09:02:52.031373+0000","last_active":"2024-04-25T09:02:57.053869+0000","last_peered":"2024-04-25T09:02:57.053869+0000","last_clean":"2024-04-25T09:02:57.053869+0000","last_became_active":"2024-04-25T09:02:52.028004+0000","last_became_peered":"2024-04-25T09:02:52.028004+0000","last_unstale":"2024-04-25T09:02:57.053869+0000","last_undegraded":"2024-04-25T09:02:57.053869+0000","last_fullsized":"2024-04-25T09:02:57.053869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:45.007626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053347+0000","last_change":"2024-04-25T09:02:56.296066+0000","last_active":"2024-04-25T09:02:57.053347+0000","last_peered":"2024-04-25T09:02:57.053347+0000","last_clean":"2024-04-25T09:02:57.053347+0000","last_became_active":"2024-04-25T09:02:56.295657+0000","last_became_peered":"2024-04-25T09:02:56.295657+0000","last_unstale":"2024-04-25T09:02:57.053347+0000","last_undegraded":"2024-04-25T09:02:57.053347+0000","last_fullsized":"2024-04-25T09:02:57.053347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:42.494123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054215+0000","last_change":"2024-04-25T09:02:51.035936+0000","last_active":"2024-04-25T09:02:57.054215+0000","last_peered":"2024-04-25T09:02:57.054215+0000","last_clean":"2024-04-25T09:02:57.054215+0000","last_became_active":"2024-04-25T09:02:51.035632+0000","last_became_peered":"2024-04-25T09:02:51.035632+0000","last_unstale":"2024-04-25T09:02:57.054215+0000","last_undegraded":"2024-04-25T09:02:57.054215+0000","last_fullsized":"2024-04-25T09:02:57.054215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:47.372516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790632+0000","last_change":"2024-04-25T09:02:52.046727+0000","last_active":"2024-04-25T09:02:57.790632+0000","last_peered":"2024-04-25T09:02:57.790632+0000","last_clean":"2024-04-25T09:02:57.790632+0000","last_became_active":"2024-04-25T09:02:52.046423+0000","last_became_peered":"2024-04-25T09:02:52.046423+0000","last_unstale":"2024-04-25T09:02:57.790632+0000","last_undegraded":"2024-04-25T09:02:57.790632+0000","last_fullsized":"2024-04-25T09:02:57.790632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:17.240659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.055935+0000","last_change":"2024-04-25T09:02:56.072393+0000","last_active":"2024-04-25T09:02:57.055935+0000","last_peered":"2024-04-25T09:02:57.055935+0000","last_clean":"2024-04-25T09:02:57.055935+0000","last_became_active":"2024-04-25T09:02:56.071966+0000","last_became_peered":"2024-04-25T09:02:56.071966+0000","last_unstale":"2024-04-25T09:02:57.055935+0000","last_undegraded":"2024-04-25T09:02:57.055935+0000","last_fullsized":"2024-04-25T09:02:57.055935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:22.670550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.464060+0000","last_change":"2024-04-25T09:02:51.033004+0000","last_active":"2024-04-25T09:02:57.464060+0000","last_peered":"2024-04-25T09:02:57.464060+0000","last_clean":"2024-04-25T09:02:57.464060+0000","last_became_active":"2024-04-25T09:02:51.032475+0000","last_became_peered":"2024-04-25T09:02:51.032475+0000","last_unstale":"2024-04-25T09:02:57.464060+0000","last_undegraded":"2024-04-25T09:02:57.464060+0000","last_fullsized":"2024-04-25T09:02:57.464060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:44.553402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789504+0000","last_change":"2024-04-25T09:02:52.044192+0000","last_active":"2024-04-25T09:02:57.789504+0000","last_peered":"2024-04-25T09:02:57.789504+0000","last_clean":"2024-04-25T09:02:57.789504+0000","last_became_active":"2024-04-25T09:02:52.043910+0000","last_became_peered":"2024-04-25T09:02:52.043910+0000","last_unstale":"2024-04-25T09:02:57.789504+0000","last_undegraded":"2024-04-25T09:02:57.789504+0000","last_fullsized":"2024-04-25T09:02:57.789504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:48.414352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057118+0000","last_change":"2024-04-25T09:02:56.076524+0000","last_active":"2024-04-25T09:02:57.057118+0000","last_peered":"2024-04-25T09:02:57.057118+0000","last_clean":"2024-04-25T09:02:57.057118+0000","last_became_active":"2024-04-25T09:02:56.076082+0000","last_became_peered":"2024-04-25T09:02:56.076082+0000","last_unstale":"2024-04-25T09:02:57.057118+0000","last_undegraded":"2024-04-25T09:02:57.057118+0000","last_fullsized":"2024-04-25T09:02:57.057118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:46.299051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463579+0000","last_change":"2024-04-25T09:02:51.039297+0000","last_active":"2024-04-25T09:02:57.463579+0000","last_peered":"2024-04-25T09:02:57.463579+0000","last_clean":"2024-04-25T09:02:57.463579+0000","last_became_active":"2024-04-25T09:02:51.039060+0000","last_became_peered":"2024-04-25T09:02:51.039060+0000","last_unstale":"2024-04-25T09:02:57.463579+0000","last_undegraded":"2024-04-25T09:02:57.463579+0000","last_fullsized":"2024-04-25T09:02:57.463579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:10.816735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789576+0000","last_change":"2024-04-25T09:02:52.044042+0000","last_active":"2024-04-25T09:02:57.789576+0000","last_peered":"2024-04-25T09:02:57.789576+0000","last_clean":"2024-04-25T09:02:57.789576+0000","last_became_active":"2024-04-25T09:02:52.043778+0000","last_became_peered":"2024-04-25T09:02:52.043778+0000","last_unstale":"2024-04-25T09:02:57.789576+0000","last_undegraded":"2024-04-25T09:02:57.789576+0000","last_fullsized":"2024-04-25T09:02:57.789576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:26.546220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056862+0000","last_change":"2024-04-25T09:02:56.059675+0000","last_active":"2024-04-25T09:02:57.056862+0000","last_peered":"2024-04-25T09:02:57.056862+0000","last_clean":"2024-04-25T09:02:57.056862+0000","last_became_active":"2024-04-25T09:02:56.059072+0000","last_became_peered":"2024-04-25T09:02:56.059072+0000","last_unstale":"2024-04-25T09:02:57.056862+0000","last_undegraded":"2024-04-25T09:02:57.056862+0000","last_fullsized":"2024-04-25T09:02:57.056862+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:52.449268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056039+0000","last_change":"2024-04-25T09:02:52.039240+0000","last_active":"2024-04-25T09:02:57.056039+0000","last_peered":"2024-04-25T09:02:57.056039+0000","last_clean":"2024-04-25T09:02:57.056039+0000","last_became_active":"2024-04-25T09:02:52.038915+0000","last_became_peered":"2024-04-25T09:02:52.038915+0000","last_unstale":"2024-04-25T09:02:57.056039+0000","last_undegraded":"2024-04-25T09:02:57.056039+0000","last_fullsized":"2024-04-25T09:02:57.056039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:50.011705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463598+0000","last_change":"2024-04-25T09:02:51.035156+0000","last_active":"2024-04-25T09:02:57.463598+0000","last_peered":"2024-04-25T09:02:57.463598+0000","last_clean":"2024-04-25T09:02:57.463598+0000","last_became_active":"2024-04-25T09:02:51.034850+0000","last_became_peered":"2024-04-25T09:02:51.034850+0000","last_unstale":"2024-04-25T09:02:57.463598+0000","last_undegraded":"2024-04-25T09:02:57.463598+0000","last_fullsized":"2024-04-25T09:02:57.463598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:28.429925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057297+0000","last_change":"2024-04-25T09:02:56.072225+0000","last_active":"2024-04-25T09:02:57.057297+0000","last_peered":"2024-04-25T09:02:57.057297+0000","last_clean":"2024-04-25T09:02:57.057297+0000","last_became_active":"2024-04-25T09:02:56.071794+0000","last_became_peered":"2024-04-25T09:02:56.071794+0000","last_unstale":"2024-04-25T09:02:57.057297+0000","last_undegraded":"2024-04-25T09:02:57.057297+0000","last_fullsized":"2024-04-25T09:02:57.057297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:56.656194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053726+0000","last_change":"2024-04-25T09:02:52.043448+0000","last_active":"2024-04-25T09:02:57.053726+0000","last_peered":"2024-04-25T09:02:57.053726+0000","last_clean":"2024-04-25T09:02:57.053726+0000","last_became_active":"2024-04-25T09:02:52.033650+0000","last_became_peered":"2024-04-25T09:02:52.033650+0000","last_unstale":"2024-04-25T09:02:57.053726+0000","last_undegraded":"2024-04-25T09:02:57.053726+0000","last_fullsized":"2024-04-25T09:02:57.053726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:29.002911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790926+0000","last_change":"2024-04-25T09:02:51.026371+0000","last_active":"2024-04-25T09:02:57.790926+0000","last_peered":"2024-04-25T09:02:57.790926+0000","last_clean":"2024-04-25T09:02:57.790926+0000","last_became_active":"2024-04-25T09:02:51.025867+0000","last_became_peered":"2024-04-25T09:02:51.025867+0000","last_unstale":"2024-04-25T09:02:57.790926+0000","last_undegraded":"2024-04-25T09:02:57.790926+0000","last_fullsized":"2024-04-25T09:02:57.790926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:47.372516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057366+0000","last_change":"2024-04-25T09:02:56.076638+0000","last_active":"2024-04-25T09:02:57.057366+0000","last_peered":"2024-04-25T09:02:57.057366+0000","last_clean":"2024-04-25T09:02:57.057366+0000","last_became_active":"2024-04-25T09:02:56.076208+0000","last_became_peered":"2024-04-25T09:02:56.076208+0000","last_unstale":"2024-04-25T09:02:57.057366+0000","last_undegraded":"2024-04-25T09:02:57.057366+0000","last_fullsized":"2024-04-25T09:02:57.057366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:04.686109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053630+0000","last_change":"2024-04-25T09:02:52.043808+0000","last_active":"2024-04-25T09:02:57.053630+0000","last_peered":"2024-04-25T09:02:57.053630+0000","last_clean":"2024-04-25T09:02:57.053630+0000","last_became_active":"2024-04-25T09:02:52.033729+0000","last_became_peered":"2024-04-25T09:02:52.033729+0000","last_unstale":"2024-04-25T09:02:57.053630+0000","last_undegraded":"2024-04-25T09:02:57.053630+0000","last_fullsized":"2024-04-25T09:02:57.053630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:50.625187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790413+0000","last_change":"2024-04-25T09:02:51.025228+0000","last_active":"2024-04-25T09:02:57.790413+0000","last_peered":"2024-04-25T09:02:57.790413+0000","last_clean":"2024-04-25T09:02:57.790413+0000","last_became_active":"2024-04-25T09:02:51.024784+0000","last_became_peered":"2024-04-25T09:02:51.024784+0000","last_unstale":"2024-04-25T09:02:57.790413+0000","last_undegraded":"2024-04-25T09:02:57.790413+0000","last_fullsized":"2024-04-25T09:02:57.790413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:59.734686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791571+0000","last_change":"2024-04-25T09:02:56.299771+0000","last_active":"2024-04-25T09:02:57.791571+0000","last_peered":"2024-04-25T09:02:57.791571+0000","last_clean":"2024-04-25T09:02:57.791571+0000","last_became_active":"2024-04-25T09:02:56.299239+0000","last_became_peered":"2024-04-25T09:02:56.299239+0000","last_unstale":"2024-04-25T09:02:57.791571+0000","last_undegraded":"2024-04-25T09:02:57.791571+0000","last_fullsized":"2024-04-25T09:02:57.791571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:30.366155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056839+0000","last_change":"2024-04-25T09:02:52.027108+0000","last_active":"2024-04-25T09:02:57.056839+0000","last_peered":"2024-04-25T09:02:57.056839+0000","last_clean":"2024-04-25T09:02:57.056839+0000","last_became_active":"2024-04-25T09:02:52.026183+0000","last_became_peered":"2024-04-25T09:02:52.026183+0000","last_unstale":"2024-04-25T09:02:57.056839+0000","last_undegraded":"2024-04-25T09:02:57.056839+0000","last_fullsized":"2024-04-25T09:02:57.056839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:38.122849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463146+0000","last_change":"2024-04-25T09:02:51.040204+0000","last_active":"2024-04-25T09:02:57.463146+0000","last_peered":"2024-04-25T09:02:57.463146+0000","last_clean":"2024-04-25T09:02:57.463146+0000","last_became_active":"2024-04-25T09:02:51.039917+0000","last_became_peered":"2024-04-25T09:02:51.039917+0000","last_unstale":"2024-04-25T09:02:57.463146+0000","last_undegraded":"2024-04-25T09:02:57.463146+0000","last_fullsized":"2024-04-25T09:02:57.463146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057220+0000","last_change":"2024-04-25T09:02:56.072634+0000","last_active":"2024-04-25T09:02:57.057220+0000","last_peered":"2024-04-25T09:02:57.057220+0000","last_clean":"2024-04-25T09:02:57.057220+0000","last_became_active":"2024-04-25T09:02:56.072077+0000","last_became_peered":"2024-04-25T09:02:56.072077+0000","last_unstale":"2024-04-25T09:02:57.057220+0000","last_undegraded":"2024-04-25T09:02:57.057220+0000","last_fullsized":"2024-04-25T09:02:57.057220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:39.318314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790520+0000","last_change":"2024-04-25T09:02:52.024632+0000","last_active":"2024-04-25T09:02:57.790520+0000","last_peered":"2024-04-25T09:02:57.790520+0000","last_clean":"2024-04-25T09:02:57.790520+0000","last_became_active":"2024-04-25T09:02:52.024337+0000","last_became_peered":"2024-04-25T09:02:52.024337+0000","last_unstale":"2024-04-25T09:02:57.790520+0000","last_undegraded":"2024-04-25T09:02:57.790520+0000","last_fullsized":"2024-04-25T09:02:57.790520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:11.410261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057823+0000","last_change":"2024-04-25T09:02:51.024573+0000","last_active":"2024-04-25T09:02:57.057823+0000","last_peered":"2024-04-25T09:02:57.057823+0000","last_clean":"2024-04-25T09:02:57.057823+0000","last_became_active":"2024-04-25T09:02:51.024252+0000","last_became_peered":"2024-04-25T09:02:51.024252+0000","last_unstale":"2024-04-25T09:02:57.057823+0000","last_undegraded":"2024-04-25T09:02:57.057823+0000","last_fullsized":"2024-04-25T09:02:57.057823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:53.131752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056610+0000","last_change":"2024-04-25T09:02:56.295449+0000","last_active":"2024-04-25T09:02:57.056610+0000","last_peered":"2024-04-25T09:02:57.056610+0000","last_clean":"2024-04-25T09:02:57.056610+0000","last_became_active":"2024-04-25T09:02:56.294711+0000","last_became_peered":"2024-04-25T09:02:56.294711+0000","last_unstale":"2024-04-25T09:02:57.056610+0000","last_undegraded":"2024-04-25T09:02:57.056610+0000","last_fullsized":"2024-04-25T09:02:57.056610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:56.463100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054253+0000","last_change":"2024-04-25T09:02:52.046777+0000","last_active":"2024-04-25T09:02:57.054253+0000","last_peered":"2024-04-25T09:02:57.054253+0000","last_clean":"2024-04-25T09:02:57.054253+0000","last_became_active":"2024-04-25T09:02:52.046489+0000","last_became_peered":"2024-04-25T09:02:52.046489+0000","last_unstale":"2024-04-25T09:02:57.054253+0000","last_undegraded":"2024-04-25T09:02:57.054253+0000","last_fullsized":"2024-04-25T09:02:57.054253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:22.709330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791497+0000","last_change":"2024-04-25T09:02:51.027246+0000","last_active":"2024-04-25T09:02:57.791497+0000","last_peered":"2024-04-25T09:02:57.791497+0000","last_clean":"2024-04-25T09:02:57.791497+0000","last_became_active":"2024-04-25T09:02:51.026818+0000","last_became_peered":"2024-04-25T09:02:51.026818+0000","last_unstale":"2024-04-25T09:02:57.791497+0000","last_undegraded":"2024-04-25T09:02:57.791497+0000","last_fullsized":"2024-04-25T09:02:57.791497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:28.429925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053445+0000","last_change":"2024-04-25T09:02:56.295657+0000","last_active":"2024-04-25T09:02:57.053445+0000","last_peered":"2024-04-25T09:02:57.053445+0000","last_clean":"2024-04-25T09:02:57.053445+0000","last_became_active":"2024-04-25T09:02:56.295288+0000","last_became_peered":"2024-04-25T09:02:56.295288+0000","last_unstale":"2024-04-25T09:02:57.053445+0000","last_undegraded":"2024-04-25T09:02:57.053445+0000","last_fullsized":"2024-04-25T09:02:57.053445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:58.529283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791110+0000","last_change":"2024-04-25T09:02:52.024086+0000","last_active":"2024-04-25T09:02:57.791110+0000","last_peered":"2024-04-25T09:02:57.791110+0000","last_clean":"2024-04-25T09:02:57.791110+0000","last_became_active":"2024-04-25T09:02:52.023818+0000","last_became_peered":"2024-04-25T09:02:52.023818+0000","last_unstale":"2024-04-25T09:02:57.791110+0000","last_undegraded":"2024-04-25T09:02:57.791110+0000","last_fullsized":"2024-04-25T09:02:57.791110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:17.240659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463957+0000","last_change":"2024-04-25T09:02:51.040279+0000","last_active":"2024-04-25T09:02:57.463957+0000","last_peered":"2024-04-25T09:02:57.463957+0000","last_clean":"2024-04-25T09:02:57.463957+0000","last_became_active":"2024-04-25T09:02:51.039948+0000","last_became_peered":"2024-04-25T09:02:51.039948+0000","last_unstale":"2024-04-25T09:02:57.463957+0000","last_undegraded":"2024-04-25T09:02:57.463957+0000","last_fullsized":"2024-04-25T09:02:57.463957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:51.667591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789802+0000","last_change":"2024-04-25T09:02:56.293761+0000","last_active":"2024-04-25T09:02:57.789802+0000","last_peered":"2024-04-25T09:02:57.789802+0000","last_clean":"2024-04-25T09:02:57.789802+0000","last_became_active":"2024-04-25T09:02:56.293350+0000","last_became_peered":"2024-04-25T09:02:56.293350+0000","last_unstale":"2024-04-25T09:02:57.789802+0000","last_undegraded":"2024-04-25T09:02:57.789802+0000","last_fullsized":"2024-04-25T09:02:57.789802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:26.744246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789708+0000","last_change":"2024-04-25T09:02:52.052084+0000","last_active":"2024-04-25T09:02:57.789708+0000","last_peered":"2024-04-25T09:02:57.789708+0000","last_clean":"2024-04-25T09:02:57.789708+0000","last_became_active":"2024-04-25T09:02:52.051875+0000","last_became_peered":"2024-04-25T09:02:52.051875+0000","last_unstale":"2024-04-25T09:02:57.789708+0000","last_undegraded":"2024-04-25T09:02:57.789708+0000","last_fullsized":"2024-04-25T09:02:57.789708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:48.909107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791211+0000","last_change":"2024-04-25T09:02:51.032759+0000","last_active":"2024-04-25T09:02:57.791211+0000","last_peered":"2024-04-25T09:02:57.791211+0000","last_clean":"2024-04-25T09:02:57.791211+0000","last_became_active":"2024-04-25T09:02:51.032451+0000","last_became_peered":"2024-04-25T09:02:51.032451+0000","last_unstale":"2024-04-25T09:02:57.791211+0000","last_undegraded":"2024-04-25T09:02:57.791211+0000","last_fullsized":"2024-04-25T09:02:57.791211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:36.866575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790558+0000","last_change":"2024-04-25T09:02:56.070268+0000","last_active":"2024-04-25T09:02:57.790558+0000","last_peered":"2024-04-25T09:02:57.790558+0000","last_clean":"2024-04-25T09:02:57.790558+0000","last_became_active":"2024-04-25T09:02:56.069905+0000","last_became_peered":"2024-04-25T09:02:56.069905+0000","last_unstale":"2024-04-25T09:02:57.790558+0000","last_undegraded":"2024-04-25T09:02:57.790558+0000","last_fullsized":"2024-04-25T09:02:57.790558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:07.888490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057540+0000","last_change":"2024-04-25T09:02:52.034123+0000","last_active":"2024-04-25T09:02:57.057540+0000","last_peered":"2024-04-25T09:02:57.057540+0000","last_clean":"2024-04-25T09:02:57.057540+0000","last_became_active":"2024-04-25T09:02:52.033807+0000","last_became_peered":"2024-04-25T09:02:52.033807+0000","last_unstale":"2024-04-25T09:02:57.057540+0000","last_undegraded":"2024-04-25T09:02:57.057540+0000","last_fullsized":"2024-04-25T09:02:57.057540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:41.419260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789451+0000","last_change":"2024-04-25T09:02:51.026247+0000","last_active":"2024-04-25T09:02:57.789451+0000","last_peered":"2024-04-25T09:02:57.789451+0000","last_clean":"2024-04-25T09:02:57.789451+0000","last_became_active":"2024-04-25T09:02:51.025939+0000","last_became_peered":"2024-04-25T09:02:51.025939+0000","last_unstale":"2024-04-25T09:02:57.789451+0000","last_undegraded":"2024-04-25T09:02:57.789451+0000","last_fullsized":"2024-04-25T09:02:57.789451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:40.409805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791583+0000","last_change":"2024-04-25T09:02:56.076058+0000","last_active":"2024-04-25T09:02:57.791583+0000","last_peered":"2024-04-25T09:02:57.791583+0000","last_clean":"2024-04-25T09:02:57.791583+0000","last_became_active":"2024-04-25T09:02:56.075606+0000","last_became_peered":"2024-04-25T09:02:56.075606+0000","last_unstale":"2024-04-25T09:02:57.791583+0000","last_undegraded":"2024-04-25T09:02:57.791583+0000","last_fullsized":"2024-04-25T09:02:57.791583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:59.234505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790128+0000","last_change":"2024-04-25T09:02:52.024371+0000","last_active":"2024-04-25T09:02:57.790128+0000","last_peered":"2024-04-25T09:02:57.790128+0000","last_clean":"2024-04-25T09:02:57.790128+0000","last_became_active":"2024-04-25T09:02:52.023814+0000","last_became_peered":"2024-04-25T09:02:52.023814+0000","last_unstale":"2024-04-25T09:02:57.790128+0000","last_undegraded":"2024-04-25T09:02:57.790128+0000","last_fullsized":"2024-04-25T09:02:57.790128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:29.446381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789453+0000","last_change":"2024-04-25T09:02:51.027475+0000","last_active":"2024-04-25T09:02:57.789453+0000","last_peered":"2024-04-25T09:02:57.789453+0000","last_clean":"2024-04-25T09:02:57.789453+0000","last_became_active":"2024-04-25T09:02:51.027212+0000","last_became_peered":"2024-04-25T09:02:51.027212+0000","last_unstale":"2024-04-25T09:02:57.789453+0000","last_undegraded":"2024-04-25T09:02:57.789453+0000","last_fullsized":"2024-04-25T09:02:57.789453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:23.500507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791716+0000","last_change":"2024-04-25T09:02:56.066697+0000","last_active":"2024-04-25T09:02:57.791716+0000","last_peered":"2024-04-25T09:02:57.791716+0000","last_clean":"2024-04-25T09:02:57.791716+0000","last_became_active":"2024-04-25T09:02:56.063130+0000","last_became_peered":"2024-04-25T09:02:56.063130+0000","last_unstale":"2024-04-25T09:02:57.791716+0000","last_undegraded":"2024-04-25T09:02:57.791716+0000","last_fullsized":"2024-04-25T09:02:57.791716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:11.878208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789276+0000","last_change":"2024-04-25T09:02:52.037980+0000","last_active":"2024-04-25T09:02:57.789276+0000","last_peered":"2024-04-25T09:02:57.789276+0000","last_clean":"2024-04-25T09:02:57.789276+0000","last_became_active":"2024-04-25T09:02:52.037671+0000","last_became_peered":"2024-04-25T09:02:52.037671+0000","last_unstale":"2024-04-25T09:02:57.789276+0000","last_undegraded":"2024-04-25T09:02:57.789276+0000","last_fullsized":"2024-04-25T09:02:57.789276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:52.677046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463133+0000","last_change":"2024-04-25T09:02:51.032936+0000","last_active":"2024-04-25T09:02:57.463133+0000","last_peered":"2024-04-25T09:02:57.463133+0000","last_clean":"2024-04-25T09:02:57.463133+0000","last_became_active":"2024-04-25T09:02:51.032657+0000","last_became_peered":"2024-04-25T09:02:51.032657+0000","last_unstale":"2024-04-25T09:02:57.463133+0000","last_undegraded":"2024-04-25T09:02:57.463133+0000","last_fullsized":"2024-04-25T09:02:57.463133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:59.734686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790555+0000","last_change":"2024-04-25T09:02:56.297045+0000","last_active":"2024-04-25T09:02:57.790555+0000","last_peered":"2024-04-25T09:02:57.790555+0000","last_clean":"2024-04-25T09:02:57.790555+0000","last_became_active":"2024-04-25T09:02:56.295073+0000","last_became_peered":"2024-04-25T09:02:56.295073+0000","last_unstale":"2024-04-25T09:02:57.790555+0000","last_undegraded":"2024-04-25T09:02:57.790555+0000","last_fullsized":"2024-04-25T09:02:57.790555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:59.234505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053279+0000","last_change":"2024-04-25T09:02:52.038658+0000","last_active":"2024-04-25T09:02:57.053279+0000","last_peered":"2024-04-25T09:02:57.053279+0000","last_clean":"2024-04-25T09:02:57.053279+0000","last_became_active":"2024-04-25T09:02:52.033684+0000","last_became_peered":"2024-04-25T09:02:52.033684+0000","last_unstale":"2024-04-25T09:02:57.053279+0000","last_undegraded":"2024-04-25T09:02:57.053279+0000","last_fullsized":"2024-04-25T09:02:57.053279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:11.410261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789342+0000","last_change":"2024-04-25T09:02:51.023038+0000","last_active":"2024-04-25T09:02:57.789342+0000","last_peered":"2024-04-25T09:02:57.789342+0000","last_clean":"2024-04-25T09:02:57.789342+0000","last_became_active":"2024-04-25T09:02:51.019222+0000","last_became_peered":"2024-04-25T09:02:51.019222+0000","last_unstale":"2024-04-25T09:02:57.789342+0000","last_undegraded":"2024-04-25T09:02:57.789342+0000","last_fullsized":"2024-04-25T09:02:57.789342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:00.953314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463292+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:02:57.463292+0000","last_peered":"2024-04-25T09:02:57.463292+0000","last_clean":"2024-04-25T09:02:57.463292+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:02:57.463292+0000","last_undegraded":"2024-04-25T09:02:57.463292+0000","last_fullsized":"2024-04-25T09:02:57.463292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056417+0000","last_change":"2024-04-25T09:02:56.295692+0000","last_active":"2024-04-25T09:02:57.056417+0000","last_peered":"2024-04-25T09:02:57.056417+0000","last_clean":"2024-04-25T09:02:57.056417+0000","last_became_active":"2024-04-25T09:02:56.295209+0000","last_became_peered":"2024-04-25T09:02:56.295209+0000","last_unstale":"2024-04-25T09:02:57.056417+0000","last_undegraded":"2024-04-25T09:02:57.056417+0000","last_fullsized":"2024-04-25T09:02:57.056417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:52.944023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463642+0000","last_change":"2024-04-25T09:02:52.049009+0000","last_active":"2024-04-25T09:02:57.463642+0000","last_peered":"2024-04-25T09:02:57.463642+0000","last_clean":"2024-04-25T09:02:57.463642+0000","last_became_active":"2024-04-25T09:02:52.048541+0000","last_became_peered":"2024-04-25T09:02:52.048541+0000","last_unstale":"2024-04-25T09:02:57.463642+0000","last_undegraded":"2024-04-25T09:02:57.463642+0000","last_fullsized":"2024-04-25T09:02:57.463642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:03.853574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790093+0000","last_change":"2024-04-25T09:02:51.023326+0000","last_active":"2024-04-25T09:02:57.790093+0000","last_peered":"2024-04-25T09:02:57.790093+0000","last_clean":"2024-04-25T09:02:57.790093+0000","last_became_active":"2024-04-25T09:02:51.022096+0000","last_became_peered":"2024-04-25T09:02:51.022096+0000","last_unstale":"2024-04-25T09:02:57.790093+0000","last_undegraded":"2024-04-25T09:02:57.790093+0000","last_fullsized":"2024-04-25T09:02:57.790093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:47.372516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.055988+0000","last_change":"2024-04-25T09:02:56.295505+0000","last_active":"2024-04-25T09:02:57.055988+0000","last_peered":"2024-04-25T09:02:57.055988+0000","last_clean":"2024-04-25T09:02:57.055988+0000","last_became_active":"2024-04-25T09:02:56.295096+0000","last_became_peered":"2024-04-25T09:02:56.295096+0000","last_unstale":"2024-04-25T09:02:57.055988+0000","last_undegraded":"2024-04-25T09:02:57.055988+0000","last_fullsized":"2024-04-25T09:02:57.055988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:30.581136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789515+0000","last_change":"2024-04-25T09:02:52.036763+0000","last_active":"2024-04-25T09:02:57.789515+0000","last_peered":"2024-04-25T09:02:57.789515+0000","last_clean":"2024-04-25T09:02:57.789515+0000","last_became_active":"2024-04-25T09:02:52.035834+0000","last_became_peered":"2024-04-25T09:02:52.035834+0000","last_unstale":"2024-04-25T09:02:57.789515+0000","last_undegraded":"2024-04-25T09:02:57.789515+0000","last_fullsized":"2024-04-25T09:02:57.789515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:42.264135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791361+0000","last_change":"2024-04-25T09:02:51.016550+0000","last_active":"2024-04-25T09:02:57.791361+0000","last_peered":"2024-04-25T09:02:57.791361+0000","last_clean":"2024-04-25T09:02:57.791361+0000","last_became_active":"2024-04-25T09:02:51.016306+0000","last_became_peered":"2024-04-25T09:02:51.016306+0000","last_unstale":"2024-04-25T09:02:57.791361+0000","last_undegraded":"2024-04-25T09:02:57.791361+0000","last_fullsized":"2024-04-25T09:02:57.791361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789915+0000","last_change":"2024-04-25T09:02:56.072785+0000","last_active":"2024-04-25T09:02:57.789915+0000","last_peered":"2024-04-25T09:02:57.789915+0000","last_clean":"2024-04-25T09:02:57.789915+0000","last_became_active":"2024-04-25T09:02:56.072306+0000","last_became_peered":"2024-04-25T09:02:56.072306+0000","last_unstale":"2024-04-25T09:02:57.789915+0000","last_undegraded":"2024-04-25T09:02:57.789915+0000","last_fullsized":"2024-04-25T09:02:57.789915+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:07.888490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.464063+0000","last_change":"2024-04-25T09:02:52.056902+0000","last_active":"2024-04-25T09:02:57.464063+0000","last_peered":"2024-04-25T09:02:57.464063+0000","last_clean":"2024-04-25T09:02:57.464063+0000","last_became_active":"2024-04-25T09:02:52.056597+0000","last_became_peered":"2024-04-25T09:02:52.056597+0000","last_unstale":"2024-04-25T09:02:57.464063+0000","last_undegraded":"2024-04-25T09:02:57.464063+0000","last_fullsized":"2024-04-25T09:02:57.464063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:29.173421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790787+0000","last_change":"2024-04-25T09:02:51.028470+0000","last_active":"2024-04-25T09:02:57.790787+0000","last_peered":"2024-04-25T09:02:57.790787+0000","last_clean":"2024-04-25T09:02:57.790787+0000","last_became_active":"2024-04-25T09:02:51.028151+0000","last_became_peered":"2024-04-25T09:02:51.028151+0000","last_unstale":"2024-04-25T09:02:57.790787+0000","last_undegraded":"2024-04-25T09:02:57.790787+0000","last_fullsized":"2024-04-25T09:02:57.790787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:36.866575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789052+0000","last_change":"2024-04-25T09:02:56.295226+0000","last_active":"2024-04-25T09:02:57.789052+0000","last_peered":"2024-04-25T09:02:57.789052+0000","last_clean":"2024-04-25T09:02:57.789052+0000","last_became_active":"2024-04-25T09:02:56.294800+0000","last_became_peered":"2024-04-25T09:02:56.294800+0000","last_unstale":"2024-04-25T09:02:57.789052+0000","last_undegraded":"2024-04-25T09:02:57.789052+0000","last_fullsized":"2024-04-25T09:02:57.789052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:58.795884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463945+0000","last_change":"2024-04-25T09:02:52.052984+0000","last_active":"2024-04-25T09:02:57.463945+0000","last_peered":"2024-04-25T09:02:57.463945+0000","last_clean":"2024-04-25T09:02:57.463945+0000","last_became_active":"2024-04-25T09:02:52.051829+0000","last_became_peered":"2024-04-25T09:02:52.051829+0000","last_unstale":"2024-04-25T09:02:57.463945+0000","last_undegraded":"2024-04-25T09:02:57.463945+0000","last_fullsized":"2024-04-25T09:02:57.463945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:55.199589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057574+0000","last_change":"2024-04-25T09:02:51.031885+0000","last_active":"2024-04-25T09:02:57.057574+0000","last_peered":"2024-04-25T09:02:57.057574+0000","last_clean":"2024-04-25T09:02:57.057574+0000","last_became_active":"2024-04-25T09:02:51.031618+0000","last_became_peered":"2024-04-25T09:02:51.031618+0000","last_unstale":"2024-04-25T09:02:57.057574+0000","last_undegraded":"2024-04-25T09:02:57.057574+0000","last_fullsized":"2024-04-25T09:02:57.057574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:41.667025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056391+0000","last_change":"2024-04-25T09:02:56.076568+0000","last_active":"2024-04-25T09:02:57.056391+0000","last_peered":"2024-04-25T09:02:57.056391+0000","last_clean":"2024-04-25T09:02:57.056391+0000","last_became_active":"2024-04-25T09:02:56.076131+0000","last_became_peered":"2024-04-25T09:02:56.076131+0000","last_unstale":"2024-04-25T09:02:57.056391+0000","last_undegraded":"2024-04-25T09:02:57.056391+0000","last_fullsized":"2024-04-25T09:02:57.056391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:43.097216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463302+0000","last_change":"2024-04-25T09:02:52.045786+0000","last_active":"2024-04-25T09:02:57.463302+0000","last_peered":"2024-04-25T09:02:57.463302+0000","last_clean":"2024-04-25T09:02:57.463302+0000","last_became_active":"2024-04-25T09:02:52.045116+0000","last_became_peered":"2024-04-25T09:02:52.045116+0000","last_unstale":"2024-04-25T09:02:57.463302+0000","last_undegraded":"2024-04-25T09:02:57.463302+0000","last_fullsized":"2024-04-25T09:02:57.463302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:29.002911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790256+0000","last_change":"2024-04-25T09:02:51.010840+0000","last_active":"2024-04-25T09:02:57.790256+0000","last_peered":"2024-04-25T09:02:57.790256+0000","last_clean":"2024-04-25T09:02:57.790256+0000","last_became_active":"2024-04-25T09:02:51.010562+0000","last_became_peered":"2024-04-25T09:02:51.010562+0000","last_unstale":"2024-04-25T09:02:57.790256+0000","last_undegraded":"2024-04-25T09:02:57.790256+0000","last_fullsized":"2024-04-25T09:02:57.790256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:52.829970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790256+0000","last_change":"2024-04-25T09:02:56.062496+0000","last_active":"2024-04-25T09:02:57.790256+0000","last_peered":"2024-04-25T09:02:57.790256+0000","last_clean":"2024-04-25T09:02:57.790256+0000","last_became_active":"2024-04-25T09:02:56.061695+0000","last_became_peered":"2024-04-25T09:02:56.061695+0000","last_unstale":"2024-04-25T09:02:57.790256+0000","last_undegraded":"2024-04-25T09:02:57.790256+0000","last_fullsized":"2024-04-25T09:02:57.790256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:52.333199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056444+0000","last_change":"2024-04-25T09:02:52.035521+0000","last_active":"2024-04-25T09:02:57.056444+0000","last_peered":"2024-04-25T09:02:57.056444+0000","last_clean":"2024-04-25T09:02:57.056444+0000","last_became_active":"2024-04-25T09:02:52.035166+0000","last_became_peered":"2024-04-25T09:02:52.035166+0000","last_unstale":"2024-04-25T09:02:57.056444+0000","last_undegraded":"2024-04-25T09:02:57.056444+0000","last_fullsized":"2024-04-25T09:02:57.056444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:15.470271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.055747+0000","last_change":"2024-04-25T09:02:51.026637+0000","last_active":"2024-04-25T09:02:57.055747+0000","last_peered":"2024-04-25T09:02:57.055747+0000","last_clean":"2024-04-25T09:02:57.055747+0000","last_became_active":"2024-04-25T09:02:51.026370+0000","last_became_peered":"2024-04-25T09:02:51.026370+0000","last_unstale":"2024-04-25T09:02:57.055747+0000","last_undegraded":"2024-04-25T09:02:57.055747+0000","last_fullsized":"2024-04-25T09:02:57.055747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:00.953314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054223+0000","last_change":"2024-04-25T09:02:56.296384+0000","last_active":"2024-04-25T09:02:57.054223+0000","last_peered":"2024-04-25T09:02:57.054223+0000","last_clean":"2024-04-25T09:02:57.054223+0000","last_became_active":"2024-04-25T09:02:56.295883+0000","last_became_peered":"2024-04-25T09:02:56.295883+0000","last_unstale":"2024-04-25T09:02:57.054223+0000","last_undegraded":"2024-04-25T09:02:57.054223+0000","last_fullsized":"2024-04-25T09:02:57.054223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:00.209106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463590+0000","last_change":"2024-04-25T09:02:52.048294+0000","last_active":"2024-04-25T09:02:57.463590+0000","last_peered":"2024-04-25T09:02:57.463590+0000","last_clean":"2024-04-25T09:02:57.463590+0000","last_became_active":"2024-04-25T09:02:52.048002+0000","last_became_peered":"2024-04-25T09:02:52.048002+0000","last_unstale":"2024-04-25T09:02:57.463590+0000","last_undegraded":"2024-04-25T09:02:57.463590+0000","last_fullsized":"2024-04-25T09:02:57.463590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:09.375365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789346+0000","last_change":"2024-04-25T09:02:51.029612+0000","last_active":"2024-04-25T09:02:57.789346+0000","last_peered":"2024-04-25T09:02:57.789346+0000","last_clean":"2024-04-25T09:02:57.789346+0000","last_became_active":"2024-04-25T09:02:51.026917+0000","last_became_peered":"2024-04-25T09:02:51.026917+0000","last_unstale":"2024-04-25T09:02:57.789346+0000","last_undegraded":"2024-04-25T09:02:57.789346+0000","last_fullsized":"2024-04-25T09:02:57.789346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:37.113394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053975+0000","last_change":"2024-04-25T09:02:56.296436+0000","last_active":"2024-04-25T09:02:57.053975+0000","last_peered":"2024-04-25T09:02:57.053975+0000","last_clean":"2024-04-25T09:02:57.053975+0000","last_became_active":"2024-04-25T09:02:56.295723+0000","last_became_peered":"2024-04-25T09:02:56.295723+0000","last_unstale":"2024-04-25T09:02:57.053975+0000","last_undegraded":"2024-04-25T09:02:57.053975+0000","last_fullsized":"2024-04-25T09:02:57.053975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:23.747770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789579+0000","last_change":"2024-04-25T09:02:52.032064+0000","last_active":"2024-04-25T09:02:57.789579+0000","last_peered":"2024-04-25T09:02:57.789579+0000","last_clean":"2024-04-25T09:02:57.789579+0000","last_became_active":"2024-04-25T09:02:52.031817+0000","last_became_peered":"2024-04-25T09:02:52.031817+0000","last_unstale":"2024-04-25T09:02:57.789579+0000","last_undegraded":"2024-04-25T09:02:57.789579+0000","last_fullsized":"2024-04-25T09:02:57.789579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:30.389641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789972+0000","last_change":"2024-04-25T09:02:51.036904+0000","last_active":"2024-04-25T09:02:57.789972+0000","last_peered":"2024-04-25T09:02:57.789972+0000","last_clean":"2024-04-25T09:02:57.789972+0000","last_became_active":"2024-04-25T09:02:51.036647+0000","last_became_peered":"2024-04-25T09:02:51.036647+0000","last_unstale":"2024-04-25T09:02:57.789972+0000","last_undegraded":"2024-04-25T09:02:57.789972+0000","last_fullsized":"2024-04-25T09:02:57.789972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:53.609696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789625+0000","last_change":"2024-04-25T09:02:56.297201+0000","last_active":"2024-04-25T09:02:57.789625+0000","last_peered":"2024-04-25T09:02:57.789625+0000","last_clean":"2024-04-25T09:02:57.789625+0000","last_became_active":"2024-04-25T09:02:56.296775+0000","last_became_peered":"2024-04-25T09:02:56.296775+0000","last_unstale":"2024-04-25T09:02:57.789625+0000","last_undegraded":"2024-04-25T09:02:57.789625+0000","last_fullsized":"2024-04-25T09:02:57.789625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:27:21.244707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463541+0000","last_change":"2024-04-25T09:02:52.048354+0000","last_active":"2024-04-25T09:02:57.463541+0000","last_peered":"2024-04-25T09:02:57.463541+0000","last_clean":"2024-04-25T09:02:57.463541+0000","last_became_active":"2024-04-25T09:02:52.048051+0000","last_became_peered":"2024-04-25T09:02:52.048051+0000","last_unstale":"2024-04-25T09:02:57.463541+0000","last_undegraded":"2024-04-25T09:02:57.463541+0000","last_fullsized":"2024-04-25T09:02:57.463541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:22.709330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:03:00.883741+0000","last_change":"2024-04-25T09:02:51.025093+0000","last_active":"2024-04-25T09:03:00.883741+0000","last_peered":"2024-04-25T09:03:00.883741+0000","last_clean":"2024-04-25T09:03:00.883741+0000","last_became_active":"2024-04-25T09:02:51.024835+0000","last_became_peered":"2024-04-25T09:02:51.024835+0000","last_unstale":"2024-04-25T09:03:00.883741+0000","last_undegraded":"2024-04-25T09:03:00.883741+0000","last_fullsized":"2024-04-25T09:03:00.883741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:40.409805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790711+0000","last_change":"2024-04-25T09:02:56.072738+0000","last_active":"2024-04-25T09:02:57.790711+0000","last_peered":"2024-04-25T09:02:57.790711+0000","last_clean":"2024-04-25T09:02:57.790711+0000","last_became_active":"2024-04-25T09:02:56.072349+0000","last_became_peered":"2024-04-25T09:02:56.072349+0000","last_unstale":"2024-04-25T09:02:57.790711+0000","last_undegraded":"2024-04-25T09:02:57.790711+0000","last_fullsized":"2024-04-25T09:02:57.790711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:52.333199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057433+0000","last_change":"2024-04-25T09:02:52.030750+0000","last_active":"2024-04-25T09:02:57.057433+0000","last_peered":"2024-04-25T09:02:57.057433+0000","last_clean":"2024-04-25T09:02:57.057433+0000","last_became_active":"2024-04-25T09:02:52.030455+0000","last_became_peered":"2024-04-25T09:02:52.030455+0000","last_unstale":"2024-04-25T09:02:57.057433+0000","last_undegraded":"2024-04-25T09:02:57.057433+0000","last_fullsized":"2024-04-25T09:02:57.057433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:21.197671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791243+0000","last_change":"2024-04-25T09:02:51.020914+0000","last_active":"2024-04-25T09:02:57.791243+0000","last_peered":"2024-04-25T09:02:57.791243+0000","last_clean":"2024-04-25T09:02:57.791243+0000","last_became_active":"2024-04-25T09:02:51.020614+0000","last_became_peered":"2024-04-25T09:02:51.020614+0000","last_unstale":"2024-04-25T09:02:57.791243+0000","last_undegraded":"2024-04-25T09:02:57.791243+0000","last_fullsized":"2024-04-25T09:02:57.791243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:23.500507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057336+0000","last_change":"2024-04-25T09:02:56.072410+0000","last_active":"2024-04-25T09:02:57.057336+0000","last_peered":"2024-04-25T09:02:57.057336+0000","last_clean":"2024-04-25T09:02:57.057336+0000","last_became_active":"2024-04-25T09:02:56.071847+0000","last_became_peered":"2024-04-25T09:02:56.071847+0000","last_unstale":"2024-04-25T09:02:57.057336+0000","last_undegraded":"2024-04-25T09:02:57.057336+0000","last_fullsized":"2024-04-25T09:02:57.057336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:01.264766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790723+0000","last_change":"2024-04-25T09:02:52.045382+0000","last_active":"2024-04-25T09:02:57.790723+0000","last_peered":"2024-04-25T09:02:57.790723+0000","last_clean":"2024-04-25T09:02:57.790723+0000","last_became_active":"2024-04-25T09:02:52.045073+0000","last_became_peered":"2024-04-25T09:02:52.045073+0000","last_unstale":"2024-04-25T09:02:57.790723+0000","last_undegraded":"2024-04-25T09:02:57.790723+0000","last_fullsized":"2024-04-25T09:02:57.790723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:00.242892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789749+0000","last_change":"2024-04-25T09:02:51.030041+0000","last_active":"2024-04-25T09:02:57.789749+0000","last_peered":"2024-04-25T09:02:57.789749+0000","last_clean":"2024-04-25T09:02:57.789749+0000","last_became_active":"2024-04-25T09:02:51.028411+0000","last_became_peered":"2024-04-25T09:02:51.028411+0000","last_unstale":"2024-04-25T09:02:57.789749+0000","last_undegraded":"2024-04-25T09:02:57.789749+0000","last_fullsized":"2024-04-25T09:02:57.789749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:07.474980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053490+0000","last_change":"2024-04-25T09:02:56.077345+0000","last_active":"2024-04-25T09:02:57.053490+0000","last_peered":"2024-04-25T09:02:57.053490+0000","last_clean":"2024-04-25T09:02:57.053490+0000","last_became_active":"2024-04-25T09:02:56.076889+0000","last_became_peered":"2024-04-25T09:02:56.076889+0000","last_unstale":"2024-04-25T09:02:57.053490+0000","last_undegraded":"2024-04-25T09:02:57.053490+0000","last_fullsized":"2024-04-25T09:02:57.053490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:03.323090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789638+0000","last_change":"2024-04-25T09:02:52.057118+0000","last_active":"2024-04-25T09:02:57.789638+0000","last_peered":"2024-04-25T09:02:57.789638+0000","last_clean":"2024-04-25T09:02:57.789638+0000","last_became_active":"2024-04-25T09:02:52.056534+0000","last_became_peered":"2024-04-25T09:02:52.056534+0000","last_unstale":"2024-04-25T09:02:57.789638+0000","last_undegraded":"2024-04-25T09:02:57.789638+0000","last_fullsized":"2024-04-25T09:02:57.789638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:52.621278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057721+0000","last_change":"2024-04-25T09:02:51.031218+0000","last_active":"2024-04-25T09:02:57.057721+0000","last_peered":"2024-04-25T09:02:57.057721+0000","last_clean":"2024-04-25T09:02:57.057721+0000","last_became_active":"2024-04-25T09:02:51.030865+0000","last_became_peered":"2024-04-25T09:02:51.030865+0000","last_unstale":"2024-04-25T09:02:57.057721+0000","last_undegraded":"2024-04-25T09:02:57.057721+0000","last_fullsized":"2024-04-25T09:02:57.057721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:07.474980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053441+0000","last_change":"2024-04-25T09:02:56.299090+0000","last_active":"2024-04-25T09:02:57.053441+0000","last_peered":"2024-04-25T09:02:57.053441+0000","last_clean":"2024-04-25T09:02:57.053441+0000","last_became_active":"2024-04-25T09:02:56.298743+0000","last_became_peered":"2024-04-25T09:02:56.298743+0000","last_unstale":"2024-04-25T09:02:57.053441+0000","last_undegraded":"2024-04-25T09:02:57.053441+0000","last_fullsized":"2024-04-25T09:02:57.053441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:29.182136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790262+0000","last_change":"2024-04-25T09:02:56.295329+0000","last_active":"2024-04-25T09:02:57.790262+0000","last_peered":"2024-04-25T09:02:57.790262+0000","last_clean":"2024-04-25T09:02:57.790262+0000","last_became_active":"2024-04-25T09:02:56.294937+0000","last_became_peered":"2024-04-25T09:02:56.294937+0000","last_unstale":"2024-04-25T09:02:57.790262+0000","last_undegraded":"2024-04-25T09:02:57.790262+0000","last_fullsized":"2024-04-25T09:02:57.790262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:30.366155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790315+0000","last_change":"2024-04-25T09:02:52.025989+0000","last_active":"2024-04-25T09:02:57.790315+0000","last_peered":"2024-04-25T09:02:57.790315+0000","last_clean":"2024-04-25T09:02:57.790315+0000","last_became_active":"2024-04-25T09:02:52.025737+0000","last_became_peered":"2024-04-25T09:02:52.025737+0000","last_unstale":"2024-04-25T09:02:57.790315+0000","last_undegraded":"2024-04-25T09:02:57.790315+0000","last_fullsized":"2024-04-25T09:02:57.790315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:11.410261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789186+0000","last_change":"2024-04-25T09:02:51.024227+0000","last_active":"2024-04-25T09:02:57.789186+0000","last_peered":"2024-04-25T09:02:57.789186+0000","last_clean":"2024-04-25T09:02:57.789186+0000","last_became_active":"2024-04-25T09:02:51.023132+0000","last_became_peered":"2024-04-25T09:02:51.023132+0000","last_unstale":"2024-04-25T09:02:57.789186+0000","last_undegraded":"2024-04-25T09:02:57.789186+0000","last_fullsized":"2024-04-25T09:02:57.789186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:53.131752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057646+0000","last_change":"2024-04-25T09:02:56.067614+0000","last_active":"2024-04-25T09:02:57.057646+0000","last_peered":"2024-04-25T09:02:57.057646+0000","last_clean":"2024-04-25T09:02:57.057646+0000","last_became_active":"2024-04-25T09:02:56.067179+0000","last_became_peered":"2024-04-25T09:02:56.067179+0000","last_unstale":"2024-04-25T09:02:57.057646+0000","last_undegraded":"2024-04-25T09:02:57.057646+0000","last_fullsized":"2024-04-25T09:02:57.057646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:23.153554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053548+0000","last_change":"2024-04-25T09:02:52.043753+0000","last_active":"2024-04-25T09:02:57.053548+0000","last_peered":"2024-04-25T09:02:57.053548+0000","last_clean":"2024-04-25T09:02:57.053548+0000","last_became_active":"2024-04-25T09:02:52.033568+0000","last_became_peered":"2024-04-25T09:02:52.033568+0000","last_unstale":"2024-04-25T09:02:57.053548+0000","last_undegraded":"2024-04-25T09:02:57.053548+0000","last_fullsized":"2024-04-25T09:02:57.053548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:00.242892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053615+0000","last_change":"2024-04-25T09:02:51.025428+0000","last_active":"2024-04-25T09:02:57.053615+0000","last_peered":"2024-04-25T09:02:57.053615+0000","last_clean":"2024-04-25T09:02:57.053615+0000","last_became_active":"2024-04-25T09:02:51.025136+0000","last_became_peered":"2024-04-25T09:02:51.025136+0000","last_unstale":"2024-04-25T09:02:57.053615+0000","last_undegraded":"2024-04-25T09:02:57.053615+0000","last_fullsized":"2024-04-25T09:02:57.053615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:52.829970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056222+0000","last_change":"2024-04-25T09:02:51.022491+0000","last_active":"2024-04-25T09:02:57.056222+0000","last_peered":"2024-04-25T09:02:57.056222+0000","last_clean":"2024-04-25T09:02:57.056222+0000","last_became_active":"2024-04-25T09:02:51.022247+0000","last_became_peered":"2024-04-25T09:02:51.022247+0000","last_unstale":"2024-04-25T09:02:57.056222+0000","last_undegraded":"2024-04-25T09:02:57.056222+0000","last_fullsized":"2024-04-25T09:02:57.056222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:37.113394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789930+0000","last_change":"2024-04-25T09:02:52.038252+0000","last_active":"2024-04-25T09:02:57.789930+0000","last_peered":"2024-04-25T09:02:57.789930+0000","last_clean":"2024-04-25T09:02:57.789930+0000","last_became_active":"2024-04-25T09:02:52.037716+0000","last_became_peered":"2024-04-25T09:02:52.037716+0000","last_unstale":"2024-04-25T09:02:57.789930+0000","last_undegraded":"2024-04-25T09:02:57.789930+0000","last_fullsized":"2024-04-25T09:02:57.789930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:10.988897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789926+0000","last_change":"2024-04-25T09:02:56.069802+0000","last_active":"2024-04-25T09:02:57.789926+0000","last_peered":"2024-04-25T09:02:57.789926+0000","last_clean":"2024-04-25T09:02:57.789926+0000","last_became_active":"2024-04-25T09:02:56.069427+0000","last_became_peered":"2024-04-25T09:02:56.069427+0000","last_unstale":"2024-04-25T09:02:57.789926+0000","last_undegraded":"2024-04-25T09:02:57.789926+0000","last_fullsized":"2024-04-25T09:02:57.789926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:34.424557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053772+0000","last_change":"2024-04-25T09:02:51.036075+0000","last_active":"2024-04-25T09:02:57.053772+0000","last_peered":"2024-04-25T09:02:57.053772+0000","last_clean":"2024-04-25T09:02:57.053772+0000","last_became_active":"2024-04-25T09:02:51.035849+0000","last_became_peered":"2024-04-25T09:02:51.035849+0000","last_unstale":"2024-04-25T09:02:57.053772+0000","last_undegraded":"2024-04-25T09:02:57.053772+0000","last_fullsized":"2024-04-25T09:02:57.053772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:23.500507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056936+0000","last_change":"2024-04-25T09:02:52.036912+0000","last_active":"2024-04-25T09:02:57.056936+0000","last_peered":"2024-04-25T09:02:57.056936+0000","last_clean":"2024-04-25T09:02:57.056936+0000","last_became_active":"2024-04-25T09:02:52.036679+0000","last_became_peered":"2024-04-25T09:02:52.036679+0000","last_unstale":"2024-04-25T09:02:57.056936+0000","last_undegraded":"2024-04-25T09:02:57.056936+0000","last_fullsized":"2024-04-25T09:02:57.056936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:08.484435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054391+0000","last_change":"2024-04-25T09:02:56.066858+0000","last_active":"2024-04-25T09:02:57.054391+0000","last_peered":"2024-04-25T09:02:57.054391+0000","last_clean":"2024-04-25T09:02:57.054391+0000","last_became_active":"2024-04-25T09:02:56.066447+0000","last_became_peered":"2024-04-25T09:02:56.066447+0000","last_unstale":"2024-04-25T09:02:57.054391+0000","last_undegraded":"2024-04-25T09:02:57.054391+0000","last_fullsized":"2024-04-25T09:02:57.054391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:31.684064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.055569+0000","last_change":"2024-04-25T09:02:52.035312+0000","last_active":"2024-04-25T09:02:57.055569+0000","last_peered":"2024-04-25T09:02:57.055569+0000","last_clean":"2024-04-25T09:02:57.055569+0000","last_became_active":"2024-04-25T09:02:52.035070+0000","last_became_peered":"2024-04-25T09:02:52.035070+0000","last_unstale":"2024-04-25T09:02:57.055569+0000","last_undegraded":"2024-04-25T09:02:57.055569+0000","last_fullsized":"2024-04-25T09:02:57.055569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:31.078849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789359+0000","last_change":"2024-04-25T09:02:52.045821+0000","last_active":"2024-04-25T09:02:57.789359+0000","last_peered":"2024-04-25T09:02:57.789359+0000","last_clean":"2024-04-25T09:02:57.789359+0000","last_became_active":"2024-04-25T09:02:52.045314+0000","last_became_peered":"2024-04-25T09:02:52.045314+0000","last_unstale":"2024-04-25T09:02:57.789359+0000","last_undegraded":"2024-04-25T09:02:57.789359+0000","last_fullsized":"2024-04-25T09:02:57.789359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:45.562857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789433+0000","last_change":"2024-04-25T09:02:52.037128+0000","last_active":"2024-04-25T09:02:57.789433+0000","last_peered":"2024-04-25T09:02:57.789433+0000","last_clean":"2024-04-25T09:02:57.789433+0000","last_became_active":"2024-04-25T09:02:52.036844+0000","last_became_peered":"2024-04-25T09:02:52.036844+0000","last_unstale":"2024-04-25T09:02:57.789433+0000","last_undegraded":"2024-04-25T09:02:57.789433+0000","last_fullsized":"2024-04-25T09:02:57.789433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:00.651193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789850+0000","last_change":"2024-04-25T09:02:52.029120+0000","last_active":"2024-04-25T09:02:57.789850+0000","last_peered":"2024-04-25T09:02:57.789850+0000","last_clean":"2024-04-25T09:02:57.789850+0000","last_became_active":"2024-04-25T09:02:52.028407+0000","last_became_peered":"2024-04-25T09:02:52.028407+0000","last_unstale":"2024-04-25T09:02:57.789850+0000","last_undegraded":"2024-04-25T09:02:57.789850+0000","last_fullsized":"2024-04-25T09:02:57.789850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:02.471096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054070+0000","last_change":"2024-04-25T09:02:52.042602+0000","last_active":"2024-04-25T09:02:57.054070+0000","last_peered":"2024-04-25T09:02:57.054070+0000","last_clean":"2024-04-25T09:02:57.054070+0000","last_became_active":"2024-04-25T09:02:52.042283+0000","last_became_peered":"2024-04-25T09:02:52.042283+0000","last_unstale":"2024-04-25T09:02:57.054070+0000","last_undegraded":"2024-04-25T09:02:57.054070+0000","last_fullsized":"2024-04-25T09:02:57.054070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:17.240659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791085+0000","last_change":"2024-04-25T09:02:52.033453+0000","last_active":"2024-04-25T09:02:57.791085+0000","last_peered":"2024-04-25T09:02:57.791085+0000","last_clean":"2024-04-25T09:02:57.791085+0000","last_became_active":"2024-04-25T09:02:52.031389+0000","last_became_peered":"2024-04-25T09:02:52.031389+0000","last_unstale":"2024-04-25T09:02:57.791085+0000","last_undegraded":"2024-04-25T09:02:57.791085+0000","last_fullsized":"2024-04-25T09:02:57.791085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:50.625187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057375+0000","last_change":"2024-04-25T09:02:52.035491+0000","last_active":"2024-04-25T09:02:57.057375+0000","last_peered":"2024-04-25T09:02:57.057375+0000","last_clean":"2024-04-25T09:02:57.057375+0000","last_became_active":"2024-04-25T09:02:52.035187+0000","last_became_peered":"2024-04-25T09:02:52.035187+0000","last_unstale":"2024-04-25T09:02:57.057375+0000","last_undegraded":"2024-04-25T09:02:57.057375+0000","last_fullsized":"2024-04-25T09:02:57.057375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:48.414352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054153+0000","last_change":"2024-04-25T09:02:52.039762+0000","last_active":"2024-04-25T09:02:57.054153+0000","last_peered":"2024-04-25T09:02:57.054153+0000","last_clean":"2024-04-25T09:02:57.054153+0000","last_became_active":"2024-04-25T09:02:52.039488+0000","last_became_peered":"2024-04-25T09:02:52.039488+0000","last_unstale":"2024-04-25T09:02:57.054153+0000","last_undegraded":"2024-04-25T09:02:57.054153+0000","last_fullsized":"2024-04-25T09:02:57.054153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:09.375365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789087+0000","last_change":"2024-04-25T09:02:52.043692+0000","last_active":"2024-04-25T09:02:57.789087+0000","last_peered":"2024-04-25T09:02:57.789087+0000","last_clean":"2024-04-25T09:02:57.789087+0000","last_became_active":"2024-04-25T09:02:52.032307+0000","last_became_peered":"2024-04-25T09:02:52.032307+0000","last_unstale":"2024-04-25T09:02:57.789087+0000","last_undegraded":"2024-04-25T09:02:57.789087+0000","last_fullsized":"2024-04-25T09:02:57.789087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:19.118637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053487+0000","last_change":"2024-04-25T09:02:52.040184+0000","last_active":"2024-04-25T09:02:57.053487+0000","last_peered":"2024-04-25T09:02:57.053487+0000","last_clean":"2024-04-25T09:02:57.053487+0000","last_became_active":"2024-04-25T09:02:52.040040+0000","last_became_peered":"2024-04-25T09:02:52.040040+0000","last_unstale":"2024-04-25T09:02:57.053487+0000","last_undegraded":"2024-04-25T09:02:57.053487+0000","last_fullsized":"2024-04-25T09:02:57.053487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:29.446381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789190+0000","last_change":"2024-04-25T09:02:52.058066+0000","last_active":"2024-04-25T09:02:57.789190+0000","last_peered":"2024-04-25T09:02:57.789190+0000","last_clean":"2024-04-25T09:02:57.789190+0000","last_became_active":"2024-04-25T09:02:52.053807+0000","last_became_peered":"2024-04-25T09:02:52.053807+0000","last_unstale":"2024-04-25T09:02:57.789190+0000","last_undegraded":"2024-04-25T09:02:57.789190+0000","last_fullsized":"2024-04-25T09:02:57.789190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:57.229849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789717+0000","last_change":"2024-04-25T09:02:52.036032+0000","last_active":"2024-04-25T09:02:57.789717+0000","last_peered":"2024-04-25T09:02:57.789717+0000","last_clean":"2024-04-25T09:02:57.789717+0000","last_became_active":"2024-04-25T09:02:52.035736+0000","last_became_peered":"2024-04-25T09:02:52.035736+0000","last_unstale":"2024-04-25T09:02:57.789717+0000","last_undegraded":"2024-04-25T09:02:57.789717+0000","last_fullsized":"2024-04-25T09:02:57.789717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:31.710536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056126+0000","last_change":"2024-04-25T09:02:52.039101+0000","last_active":"2024-04-25T09:02:57.056126+0000","last_peered":"2024-04-25T09:02:57.056126+0000","last_clean":"2024-04-25T09:02:57.056126+0000","last_became_active":"2024-04-25T09:02:52.038805+0000","last_became_peered":"2024-04-25T09:02:52.038805+0000","last_unstale":"2024-04-25T09:02:57.056126+0000","last_undegraded":"2024-04-25T09:02:57.056126+0000","last_fullsized":"2024-04-25T09:02:57.056126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:39.062300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463830+0000","last_change":"2024-04-25T09:02:52.049274+0000","last_active":"2024-04-25T09:02:57.463830+0000","last_peered":"2024-04-25T09:02:57.463830+0000","last_clean":"2024-04-25T09:02:57.463830+0000","last_became_active":"2024-04-25T09:02:52.048624+0000","last_became_peered":"2024-04-25T09:02:52.048624+0000","last_unstale":"2024-04-25T09:02:57.463830+0000","last_undegraded":"2024-04-25T09:02:57.463830+0000","last_fullsized":"2024-04-25T09:02:57.463830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:48.298283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790702+0000","last_change":"2024-04-25T09:02:52.030094+0000","last_active":"2024-04-25T09:02:57.790702+0000","last_peered":"2024-04-25T09:02:57.790702+0000","last_clean":"2024-04-25T09:02:57.790702+0000","last_became_active":"2024-04-25T09:02:52.029404+0000","last_became_peered":"2024-04-25T09:02:52.029404+0000","last_unstale":"2024-04-25T09:02:57.790702+0000","last_undegraded":"2024-04-25T09:02:57.790702+0000","last_fullsized":"2024-04-25T09:02:57.790702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:11.826190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789936+0000","last_change":"2024-04-25T09:02:52.057482+0000","last_active":"2024-04-25T09:02:57.789936+0000","last_peered":"2024-04-25T09:02:57.789936+0000","last_clean":"2024-04-25T09:02:57.789936+0000","last_became_active":"2024-04-25T09:02:52.053761+0000","last_became_peered":"2024-04-25T09:02:52.053761+0000","last_unstale":"2024-04-25T09:02:57.789936+0000","last_undegraded":"2024-04-25T09:02:57.789936+0000","last_fullsized":"2024-04-25T09:02:57.789936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:41.457232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.788945+0000","last_change":"2024-04-25T09:02:52.038864+0000","last_active":"2024-04-25T09:02:57.788945+0000","last_peered":"2024-04-25T09:02:57.788945+0000","last_clean":"2024-04-25T09:02:57.788945+0000","last_became_active":"2024-04-25T09:02:52.038586+0000","last_became_peered":"2024-04-25T09:02:52.038586+0000","last_unstale":"2024-04-25T09:02:57.788945+0000","last_undegraded":"2024-04-25T09:02:57.788945+0000","last_fullsized":"2024-04-25T09:02:57.788945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:39.062300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790365+0000","last_change":"2024-04-25T09:02:52.021083+0000","last_active":"2024-04-25T09:02:57.790365+0000","last_peered":"2024-04-25T09:02:57.790365+0000","last_clean":"2024-04-25T09:02:57.790365+0000","last_became_active":"2024-04-25T09:02:52.019096+0000","last_became_peered":"2024-04-25T09:02:52.019096+0000","last_unstale":"2024-04-25T09:02:57.790365+0000","last_undegraded":"2024-04-25T09:02:57.790365+0000","last_fullsized":"2024-04-25T09:02:57.790365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:10.988897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789527+0000","last_change":"2024-04-25T09:02:52.025371+0000","last_active":"2024-04-25T09:02:57.789527+0000","last_peered":"2024-04-25T09:02:57.789527+0000","last_clean":"2024-04-25T09:02:57.789527+0000","last_became_active":"2024-04-25T09:02:52.024320+0000","last_became_peered":"2024-04-25T09:02:52.024320+0000","last_unstale":"2024-04-25T09:02:57.789527+0000","last_undegraded":"2024-04-25T09:02:57.789527+0000","last_fullsized":"2024-04-25T09:02:57.789527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:19.358216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053569+0000","last_change":"2024-04-25T09:02:52.033835+0000","last_active":"2024-04-25T09:02:57.053569+0000","last_peered":"2024-04-25T09:02:57.053569+0000","last_clean":"2024-04-25T09:02:57.053569+0000","last_became_active":"2024-04-25T09:02:52.033530+0000","last_became_peered":"2024-04-25T09:02:52.033530+0000","last_unstale":"2024-04-25T09:02:57.053569+0000","last_undegraded":"2024-04-25T09:02:57.053569+0000","last_fullsized":"2024-04-25T09:02:57.053569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:07.517265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057290+0000","last_change":"2024-04-25T09:02:52.027796+0000","last_active":"2024-04-25T09:02:57.057290+0000","last_peered":"2024-04-25T09:02:57.057290+0000","last_clean":"2024-04-25T09:02:57.057290+0000","last_became_active":"2024-04-25T09:02:52.027441+0000","last_became_peered":"2024-04-25T09:02:52.027441+0000","last_unstale":"2024-04-25T09:02:57.057290+0000","last_undegraded":"2024-04-25T09:02:57.057290+0000","last_fullsized":"2024-04-25T09:02:57.057290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:41.693114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056467+0000","last_change":"2024-04-25T09:02:52.051744+0000","last_active":"2024-04-25T09:02:57.056467+0000","last_peered":"2024-04-25T09:02:57.056467+0000","last_clean":"2024-04-25T09:02:57.056467+0000","last_became_active":"2024-04-25T09:02:52.051453+0000","last_became_peered":"2024-04-25T09:02:52.051453+0000","last_unstale":"2024-04-25T09:02:57.056467+0000","last_undegraded":"2024-04-25T09:02:57.056467+0000","last_fullsized":"2024-04-25T09:02:57.056467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:18.635634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057266+0000","last_change":"2024-04-25T09:02:52.051875+0000","last_active":"2024-04-25T09:02:57.057266+0000","last_peered":"2024-04-25T09:02:57.057266+0000","last_clean":"2024-04-25T09:02:57.057266+0000","last_became_active":"2024-04-25T09:02:52.051621+0000","last_became_peered":"2024-04-25T09:02:52.051621+0000","last_unstale":"2024-04-25T09:02:57.057266+0000","last_undegraded":"2024-04-25T09:02:57.057266+0000","last_fullsized":"2024-04-25T09:02:57.057266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:52.428184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.464024+0000","last_change":"2024-04-25T09:02:52.058460+0000","last_active":"2024-04-25T09:02:57.464024+0000","last_peered":"2024-04-25T09:02:57.464024+0000","last_clean":"2024-04-25T09:02:57.464024+0000","last_became_active":"2024-04-25T09:02:52.058164+0000","last_became_peered":"2024-04-25T09:02:52.058164+0000","last_unstale":"2024-04-25T09:02:57.464024+0000","last_undegraded":"2024-04-25T09:02:57.464024+0000","last_fullsized":"2024-04-25T09:02:57.464024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:07.843292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053224+0000","last_change":"2024-04-25T09:02:52.044000+0000","last_active":"2024-04-25T09:02:57.053224+0000","last_peered":"2024-04-25T09:02:57.053224+0000","last_clean":"2024-04-25T09:02:57.053224+0000","last_became_active":"2024-04-25T09:02:52.042814+0000","last_became_peered":"2024-04-25T09:02:52.042814+0000","last_unstale":"2024-04-25T09:02:57.053224+0000","last_undegraded":"2024-04-25T09:02:57.053224+0000","last_fullsized":"2024-04-25T09:02:57.053224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:12.756335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463194+0000","last_change":"2024-04-25T09:02:52.044961+0000","last_active":"2024-04-25T09:02:57.463194+0000","last_peered":"2024-04-25T09:02:57.463194+0000","last_clean":"2024-04-25T09:02:57.463194+0000","last_became_active":"2024-04-25T09:02:52.044611+0000","last_became_peered":"2024-04-25T09:02:52.044611+0000","last_unstale":"2024-04-25T09:02:57.463194+0000","last_undegraded":"2024-04-25T09:02:57.463194+0000","last_fullsized":"2024-04-25T09:02:57.463194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:07.517265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789201+0000","last_change":"2024-04-25T09:02:52.043640+0000","last_active":"2024-04-25T09:02:57.789201+0000","last_peered":"2024-04-25T09:02:57.789201+0000","last_clean":"2024-04-25T09:02:57.789201+0000","last_became_active":"2024-04-25T09:02:52.039228+0000","last_became_peered":"2024-04-25T09:02:52.039228+0000","last_unstale":"2024-04-25T09:02:57.789201+0000","last_undegraded":"2024-04-25T09:02:57.789201+0000","last_fullsized":"2024-04-25T09:02:57.789201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:35.283398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463393+0000","last_change":"2024-04-25T09:02:52.045074+0000","last_active":"2024-04-25T09:02:57.463393+0000","last_peered":"2024-04-25T09:02:57.463393+0000","last_clean":"2024-04-25T09:02:57.463393+0000","last_became_active":"2024-04-25T09:02:52.044803+0000","last_became_peered":"2024-04-25T09:02:52.044803+0000","last_unstale":"2024-04-25T09:02:57.463393+0000","last_undegraded":"2024-04-25T09:02:57.463393+0000","last_fullsized":"2024-04-25T09:02:57.463393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:45.007626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789370+0000","last_change":"2024-04-25T09:02:52.044897+0000","last_active":"2024-04-25T09:02:57.789370+0000","last_peered":"2024-04-25T09:02:57.789370+0000","last_clean":"2024-04-25T09:02:57.789370+0000","last_became_active":"2024-04-25T09:02:52.044582+0000","last_became_peered":"2024-04-25T09:02:52.044582+0000","last_unstale":"2024-04-25T09:02:57.789370+0000","last_undegraded":"2024-04-25T09:02:57.789370+0000","last_fullsized":"2024-04-25T09:02:57.789370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:52.428184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790225+0000","last_change":"2024-04-25T09:02:52.026796+0000","last_active":"2024-04-25T09:02:57.790225+0000","last_peered":"2024-04-25T09:02:57.790225+0000","last_clean":"2024-04-25T09:02:57.790225+0000","last_became_active":"2024-04-25T09:02:52.026522+0000","last_became_peered":"2024-04-25T09:02:52.026522+0000","last_unstale":"2024-04-25T09:02:57.790225+0000","last_undegraded":"2024-04-25T09:02:57.790225+0000","last_fullsized":"2024-04-25T09:02:57.790225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:29.446381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791477+0000","last_change":"2024-04-25T09:02:52.016990+0000","last_active":"2024-04-25T09:02:57.791477+0000","last_peered":"2024-04-25T09:02:57.791477+0000","last_clean":"2024-04-25T09:02:57.791477+0000","last_became_active":"2024-04-25T09:02:52.015451+0000","last_became_peered":"2024-04-25T09:02:52.015451+0000","last_unstale":"2024-04-25T09:02:57.791477+0000","last_undegraded":"2024-04-25T09:02:57.791477+0000","last_fullsized":"2024-04-25T09:02:57.791477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:00.242892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463935+0000","last_change":"2024-04-25T09:02:52.050256+0000","last_active":"2024-04-25T09:02:57.463935+0000","last_peered":"2024-04-25T09:02:57.463935+0000","last_clean":"2024-04-25T09:02:57.463935+0000","last_became_active":"2024-04-25T09:02:52.049994+0000","last_became_peered":"2024-04-25T09:02:52.049994+0000","last_unstale":"2024-04-25T09:02:57.463935+0000","last_undegraded":"2024-04-25T09:02:57.463935+0000","last_fullsized":"2024-04-25T09:02:57.463935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:26.331238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":106528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":106402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":697408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":697352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:03:10.155 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:03:10.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.338+0000 7f9006e00640 1 Processor -- start 2024-04-25T09:03:10.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.338+0000 7f9006e00640 1 -- start start 2024-04-25T09:03:10.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.338+0000 7f9006e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f900006dac0 0x7f90000ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:10.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.338+0000 7f9006e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f900006bca0 0x7f900006c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:10.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.338+0000 7f9006e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9000061d60 con 0x7f9000160fe0 2024-04-25T09:03:10.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.338+0000 7f9006e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f900006c640 con 0x7f900006bca0 2024-04-25T09:03:10.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.338+0000 7f9006e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90001613c0 con 0x7f900006dac0 2024-04-25T09:03:10.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.342+0000 7f8fffe00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f9000160fe0 0x7f9000161fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:44880/0 (socket says 172.21.15.173:44880) 2024-04-25T09:03:10.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.342+0000 7f8fffe00640 1 -- 172.21.15.173:0/1059576011 learned_addr learned my addr 172.21.15.173:0/1059576011 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:10.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.342+0000 7f9004e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f900006bca0 0x7f900006c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:10.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.342+0000 7f8ff7400640 1 --2- 172.21.15.173:0/1059576011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f900006dac0 0x7f90000ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:10.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.342+0000 7f8ff7400640 1 -- 172.21.15.173:0/1059576011 >> v2:172.21.15.194:3300/0 conn(0x7f900006bca0 msgr2=0x7f900006c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:10.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.342+0000 7f8ff7400640 1 --2- 172.21.15.173:0/1059576011 >> v2:172.21.15.194:3300/0 conn(0x7f900006bca0 0x7f900006c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.342+0000 7f8ff7400640 1 -- 172.21.15.173:0/1059576011 >> v1:172.21.15.194:6789/0 conn(0x7f9000160fe0 legacy=0x7f9000161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:10.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.342+0000 7f8ff7400640 1 -- 172.21.15.173:0/1059576011 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900006dfa0 con 0x7f900006dac0 2024-04-25T09:03:10.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.342+0000 7f8ff7400640 1 --2- 172.21.15.173:0/1059576011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f900006dac0 0x7f90000ace00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80097c0 tx=0x7f8fe801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3bec572b43203df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:10.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.342+0000 7f8fff400640 1 -- 172.21.15.173:0/1059576011 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe80b1070 con 0x7f900006dac0 2024-04-25T09:03:10.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.342+0000 7f8fff400640 1 -- 172.21.15.173:0/1059576011 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe80a8050 con 0x7f900006dac0 2024-04-25T09:03:10.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f8fff400640 1 -- 172.21.15.173:0/1059576011 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe80ac860 con 0x7f900006dac0 2024-04-25T09:03:10.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f9006e00640 1 -- 172.21.15.173:0/1059576011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f900006dac0 msgr2=0x7f90000ace00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:10.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f9006e00640 1 --2- 172.21.15.173:0/1059576011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f900006dac0 0x7f90000ace00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80097c0 tx=0x7f8fe801c3e0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f9006e00640 1 -- 172.21.15.173:0/1059576011 shutdown_connections 2024-04-25T09:03:10.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f9006e00640 1 --2- 172.21.15.173:0/1059576011 >> v2:172.21.15.194:3300/0 conn(0x7f900006bca0 0x7f900006c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f9006e00640 1 --2- 172.21.15.173:0/1059576011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f900006dac0 0x7f90000ace00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f9006e00640 1 -- 172.21.15.173:0/1059576011 >> 172.21.15.173:0/1059576011 conn(0x7f9000071c20 msgr2=0x7f9000072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:10.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f9006e00640 1 -- 172.21.15.173:0/1059576011 shutdown_connections 2024-04-25T09:03:10.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f9006e00640 1 -- 172.21.15.173:0/1059576011 wait complete. 2024-04-25T09:03:10.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f9006e00640 1 Processor -- start 2024-04-25T09:03:10.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f9006e00640 1 -- start start 2024-04-25T09:03:10.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f9006e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f900006bca0 0x7f900014a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:10.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f9006e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f900006dac0 0x7f900015e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:10.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f9006e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9000160fe0 0x7f900015d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:10.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f9006e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90000ad340 con 0x7f900006dac0 2024-04-25T09:03:10.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f9006e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900006eb20 con 0x7f9000160fe0 2024-04-25T09:03:10.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f9006e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90000ad4c0 con 0x7f900006bca0 2024-04-25T09:03:10.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f8ff7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f900006dac0 0x7f900015e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:10.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f8ff7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f900006dac0 0x7f900015e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:32984/0 (socket says 172.21.15.173:32984) 2024-04-25T09:03:10.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f8ff7400640 1 -- 172.21.15.173:0/818911047 learned_addr learned my addr 172.21.15.173:0/818911047 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:10.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f8fffe00640 1 --2- 172.21.15.173:0/818911047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f900006bca0 0x7f900014a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:10.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.346+0000 7f9004e00640 1 --2- 172.21.15.173:0/818911047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9000160fe0 0x7f900015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:10.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.350+0000 7f8ff7400640 1 -- 172.21.15.173:0/818911047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f900006bca0 msgr2=0x7f900014a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:10.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.350+0000 7f8ff7400640 1 --2- 172.21.15.173:0/818911047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f900006bca0 0x7f900014a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.350+0000 7f8ff7400640 1 -- 172.21.15.173:0/818911047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9000160fe0 msgr2=0x7f900015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:10.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.350+0000 7f8ff7400640 1 --2- 172.21.15.173:0/818911047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9000160fe0 0x7f900015d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.350+0000 7f8ff7400640 1 -- 172.21.15.173:0/818911047 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900015f030 con 0x7f900006dac0 2024-04-25T09:03:10.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.350+0000 7f8ff7400640 1 --2- 172.21.15.173:0/818911047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f900006dac0 0x7f900015e5e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80af040 tx=0x7f8fe8019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:10.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.350+0000 7f8ffcc00640 1 -- 172.21.15.173:0/818911047 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe80b1040 con 0x7f900006dac0 2024-04-25T09:03:10.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.350+0000 7f8ffcc00640 1 -- 172.21.15.173:0/818911047 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe80bb070 con 0x7f900006dac0 2024-04-25T09:03:10.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.350+0000 7f8ffcc00640 1 -- 172.21.15.173:0/818911047 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe80b5410 con 0x7f900006dac0 2024-04-25T09:03:10.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.350+0000 7f9006e00640 1 -- 172.21.15.173:0/818911047 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900015f310 con 0x7f900006dac0 2024-04-25T09:03:10.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.350+0000 7f9006e00640 1 -- 172.21.15.173:0/818911047 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900015f8d0 con 0x7f900006dac0 2024-04-25T09:03:10.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.350+0000 7f9006e00640 1 -- 172.21.15.173:0/818911047 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9000073a40 con 0x7f900006dac0 2024-04-25T09:03:10.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.350+0000 7f8ffcc00640 1 -- 172.21.15.173:0/818911047 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8fe80b55b0 con 0x7f900006dac0 2024-04-25T09:03:10.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.354+0000 7f8ffcc00640 1 --2- 172.21.15.173:0/818911047 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8fdc066f60 0x7f8fdc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:10.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.354+0000 7f8ffcc00640 1 -- 172.21.15.173:0/818911047 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8fe811efe0 con 0x7f900006dac0 2024-04-25T09:03:10.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.354+0000 7f8fffe00640 1 --2- 172.21.15.173:0/818911047 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8fdc066f60 0x7f8fdc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:10.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.354+0000 7f8fffe00640 1 --2- 172.21.15.173:0/818911047 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8fdc066f60 0x7f8fdc069420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0000f70 tx=0x7f8ff0007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:10.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.358+0000 7f8ffcc00640 1 -- 172.21.15.173:0/818911047 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8fe80c5020 con 0x7f900006dac0 2024-04-25T09:03:10.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.506+0000 7f9006e00640 1 -- 172.21.15.173:0/818911047 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f90000cfc10 con 0x7f8fdc066f60 2024-04-25T09:03:10.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.514+0000 7f8ffcc00640 1 -- 172.21.15.173:0/818911047 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332558 (secure 0 0 0) 0x7f90000cfc10 con 0x7f8fdc066f60 2024-04-25T09:03:10.507 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:10.509 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:03:10.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.518+0000 7f9006e00640 1 -- 172.21.15.173:0/818911047 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8fdc066f60 msgr2=0x7f8fdc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:10.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.518+0000 7f9006e00640 1 --2- 172.21.15.173:0/818911047 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8fdc066f60 0x7f8fdc069420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0000f70 tx=0x7f8ff0007e90 comp rx=0 tx=0).stop 2024-04-25T09:03:10.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.518+0000 7f9006e00640 1 -- 172.21.15.173:0/818911047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f900006dac0 msgr2=0x7f900015e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:10.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.518+0000 7f9006e00640 1 --2- 172.21.15.173:0/818911047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f900006dac0 0x7f900015e5e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80af040 tx=0x7f8fe8019180 comp rx=0 tx=0).stop 2024-04-25T09:03:10.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.518+0000 7f9006e00640 1 -- 172.21.15.173:0/818911047 shutdown_connections 2024-04-25T09:03:10.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.518+0000 7f9006e00640 1 --2- 172.21.15.173:0/818911047 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8fdc066f60 0x7f8fdc069420 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.518+0000 7f9006e00640 1 --2- 172.21.15.173:0/818911047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9000160fe0 0x7f900015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.518+0000 7f9006e00640 1 --2- 172.21.15.173:0/818911047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f900006dac0 0x7f900015e5e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.518+0000 7f9006e00640 1 --2- 172.21.15.173:0/818911047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f900006bca0 0x7f900014a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.518+0000 7f9006e00640 1 -- 172.21.15.173:0/818911047 >> 172.21.15.173:0/818911047 conn(0x7f9000071c20 msgr2=0x7f9000161540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:10.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.518+0000 7f9006e00640 1 -- 172.21.15.173:0/818911047 shutdown_connections 2024-04-25T09:03:10.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.518+0000 7f9006e00640 1 -- 172.21.15.173:0/818911047 wait complete. 2024-04-25T09:03:10.527 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-25T09:03:08.728756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219512,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755208,"statfs":{"total":773094113280,"available":772869332992,"internally_reserved":0,"allocated":3416064,"data_stored":2040950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.677154"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790824+0000","last_change":"2024-04-25T09:02:51.036766+0000","last_active":"2024-04-25T09:02:57.790824+0000","last_peered":"2024-04-25T09:02:57.790824+0000","last_clean":"2024-04-25T09:02:57.790824+0000","last_became_active":"2024-04-25T09:02:51.036485+0000","last_became_peered":"2024-04-25T09:02:51.036485+0000","last_unstale":"2024-04-25T09:02:57.790824+0000","last_undegraded":"2024-04-25T09:02:57.790824+0000","last_fullsized":"2024-04-25T09:02:57.790824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:41.333762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053869+0000","last_change":"2024-04-25T09:02:52.031373+0000","last_active":"2024-04-25T09:02:57.053869+0000","last_peered":"2024-04-25T09:02:57.053869+0000","last_clean":"2024-04-25T09:02:57.053869+0000","last_became_active":"2024-04-25T09:02:52.028004+0000","last_became_peered":"2024-04-25T09:02:52.028004+0000","last_unstale":"2024-04-25T09:02:57.053869+0000","last_undegraded":"2024-04-25T09:02:57.053869+0000","last_fullsized":"2024-04-25T09:02:57.053869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:45.007626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053347+0000","last_change":"2024-04-25T09:02:56.296066+0000","last_active":"2024-04-25T09:02:57.053347+0000","last_peered":"2024-04-25T09:02:57.053347+0000","last_clean":"2024-04-25T09:02:57.053347+0000","last_became_active":"2024-04-25T09:02:56.295657+0000","last_became_peered":"2024-04-25T09:02:56.295657+0000","last_unstale":"2024-04-25T09:02:57.053347+0000","last_undegraded":"2024-04-25T09:02:57.053347+0000","last_fullsized":"2024-04-25T09:02:57.053347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:42.494123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054215+0000","last_change":"2024-04-25T09:02:51.035936+0000","last_active":"2024-04-25T09:02:57.054215+0000","last_peered":"2024-04-25T09:02:57.054215+0000","last_clean":"2024-04-25T09:02:57.054215+0000","last_became_active":"2024-04-25T09:02:51.035632+0000","last_became_peered":"2024-04-25T09:02:51.035632+0000","last_unstale":"2024-04-25T09:02:57.054215+0000","last_undegraded":"2024-04-25T09:02:57.054215+0000","last_fullsized":"2024-04-25T09:02:57.054215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:47.372516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790632+0000","last_change":"2024-04-25T09:02:52.046727+0000","last_active":"2024-04-25T09:02:57.790632+0000","last_peered":"2024-04-25T09:02:57.790632+0000","last_clean":"2024-04-25T09:02:57.790632+0000","last_became_active":"2024-04-25T09:02:52.046423+0000","last_became_peered":"2024-04-25T09:02:52.046423+0000","last_unstale":"2024-04-25T09:02:57.790632+0000","last_undegraded":"2024-04-25T09:02:57.790632+0000","last_fullsized":"2024-04-25T09:02:57.790632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:17.240659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.055935+0000","last_change":"2024-04-25T09:02:56.072393+0000","last_active":"2024-04-25T09:02:57.055935+0000","last_peered":"2024-04-25T09:02:57.055935+0000","last_clean":"2024-04-25T09:02:57.055935+0000","last_became_active":"2024-04-25T09:02:56.071966+0000","last_became_peered":"2024-04-25T09:02:56.071966+0000","last_unstale":"2024-04-25T09:02:57.055935+0000","last_undegraded":"2024-04-25T09:02:57.055935+0000","last_fullsized":"2024-04-25T09:02:57.055935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:22.670550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.464060+0000","last_change":"2024-04-25T09:02:51.033004+0000","last_active":"2024-04-25T09:02:57.464060+0000","last_peered":"2024-04-25T09:02:57.464060+0000","last_clean":"2024-04-25T09:02:57.464060+0000","last_became_active":"2024-04-25T09:02:51.032475+0000","last_became_peered":"2024-04-25T09:02:51.032475+0000","last_unstale":"2024-04-25T09:02:57.464060+0000","last_undegraded":"2024-04-25T09:02:57.464060+0000","last_fullsized":"2024-04-25T09:02:57.464060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:44.553402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789504+0000","last_change":"2024-04-25T09:02:52.044192+0000","last_active":"2024-04-25T09:02:57.789504+0000","last_peered":"2024-04-25T09:02:57.789504+0000","last_clean":"2024-04-25T09:02:57.789504+0000","last_became_active":"2024-04-25T09:02:52.043910+0000","last_became_peered":"2024-04-25T09:02:52.043910+0000","last_unstale":"2024-04-25T09:02:57.789504+0000","last_undegraded":"2024-04-25T09:02:57.789504+0000","last_fullsized":"2024-04-25T09:02:57.789504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:48.414352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057118+0000","last_change":"2024-04-25T09:02:56.076524+0000","last_active":"2024-04-25T09:02:57.057118+0000","last_peered":"2024-04-25T09:02:57.057118+0000","last_clean":"2024-04-25T09:02:57.057118+0000","last_became_active":"2024-04-25T09:02:56.076082+0000","last_became_peered":"2024-04-25T09:02:56.076082+0000","last_unstale":"2024-04-25T09:02:57.057118+0000","last_undegraded":"2024-04-25T09:02:57.057118+0000","last_fullsized":"2024-04-25T09:02:57.057118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:46.299051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463579+0000","last_change":"2024-04-25T09:02:51.039297+0000","last_active":"2024-04-25T09:02:57.463579+0000","last_peered":"2024-04-25T09:02:57.463579+0000","last_clean":"2024-04-25T09:02:57.463579+0000","last_became_active":"2024-04-25T09:02:51.039060+0000","last_became_peered":"2024-04-25T09:02:51.039060+0000","last_unstale":"2024-04-25T09:02:57.463579+0000","last_undegraded":"2024-04-25T09:02:57.463579+0000","last_fullsized":"2024-04-25T09:02:57.463579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:10.816735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789576+0000","last_change":"2024-04-25T09:02:52.044042+0000","last_active":"2024-04-25T09:02:57.789576+0000","last_peered":"2024-04-25T09:02:57.789576+0000","last_clean":"2024-04-25T09:02:57.789576+0000","last_became_active":"2024-04-25T09:02:52.043778+0000","last_became_peered":"2024-04-25T09:02:52.043778+0000","last_unstale":"2024-04-25T09:02:57.789576+0000","last_undegraded":"2024-04-25T09:02:57.789576+0000","last_fullsized":"2024-04-25T09:02:57.789576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:26.546220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056862+0000","last_change":"2024-04-25T09:02:56.059675+0000","last_active":"2024-04-25T09:02:57.056862+0000","last_peered":"2024-04-25T09:02:57.056862+0000","last_clean":"2024-04-25T09:02:57.056862+0000","last_became_active":"2024-04-25T09:02:56.059072+0000","last_became_peered":"2024-04-25T09:02:56.059072+0000","last_unstale":"2024-04-25T09:02:57.056862+0000","last_undegraded":"2024-04-25T09:02:57.056862+0000","last_fullsized":"2024-04-25T09:02:57.056862+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:52.449268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056039+0000","last_change":"2024-04-25T09:02:52.039240+0000","last_active":"2024-04-25T09:02:57.056039+0000","last_peered":"2024-04-25T09:02:57.056039+0000","last_clean":"2024-04-25T09:02:57.056039+0000","last_became_active":"2024-04-25T09:02:52.038915+0000","last_became_peered":"2024-04-25T09:02:52.038915+0000","last_unstale":"2024-04-25T09:02:57.056039+0000","last_undegraded":"2024-04-25T09:02:57.056039+0000","last_fullsized":"2024-04-25T09:02:57.056039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:50.011705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463598+0000","last_change":"2024-04-25T09:02:51.035156+0000","last_active":"2024-04-25T09:02:57.463598+0000","last_peered":"2024-04-25T09:02:57.463598+0000","last_clean":"2024-04-25T09:02:57.463598+0000","last_became_active":"2024-04-25T09:02:51.034850+0000","last_became_peered":"2024-04-25T09:02:51.034850+0000","last_unstale":"2024-04-25T09:02:57.463598+0000","last_undegraded":"2024-04-25T09:02:57.463598+0000","last_fullsized":"2024-04-25T09:02:57.463598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:28.429925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057297+0000","last_change":"2024-04-25T09:02:56.072225+0000","last_active":"2024-04-25T09:02:57.057297+0000","last_peered":"2024-04-25T09:02:57.057297+0000","last_clean":"2024-04-25T09:02:57.057297+0000","last_became_active":"2024-04-25T09:02:56.071794+0000","last_became_peered":"2024-04-25T09:02:56.071794+0000","last_unstale":"2024-04-25T09:02:57.057297+0000","last_undegraded":"2024-04-25T09:02:57.057297+0000","last_fullsized":"2024-04-25T09:02:57.057297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:56.656194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053726+0000","last_change":"2024-04-25T09:02:52.043448+0000","last_active":"2024-04-25T09:02:57.053726+0000","last_peered":"2024-04-25T09:02:57.053726+0000","last_clean":"2024-04-25T09:02:57.053726+0000","last_became_active":"2024-04-25T09:02:52.033650+0000","last_became_peered":"2024-04-25T09:02:52.033650+0000","last_unstale":"2024-04-25T09:02:57.053726+0000","last_undegraded":"2024-04-25T09:02:57.053726+0000","last_fullsized":"2024-04-25T09:02:57.053726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:29.002911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790926+0000","last_change":"2024-04-25T09:02:51.026371+0000","last_active":"2024-04-25T09:02:57.790926+0000","last_peered":"2024-04-25T09:02:57.790926+0000","last_clean":"2024-04-25T09:02:57.790926+0000","last_became_active":"2024-04-25T09:02:51.025867+0000","last_became_peered":"2024-04-25T09:02:51.025867+0000","last_unstale":"2024-04-25T09:02:57.790926+0000","last_undegraded":"2024-04-25T09:02:57.790926+0000","last_fullsized":"2024-04-25T09:02:57.790926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:47.372516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057366+0000","last_change":"2024-04-25T09:02:56.076638+0000","last_active":"2024-04-25T09:02:57.057366+0000","last_peered":"2024-04-25T09:02:57.057366+0000","last_clean":"2024-04-25T09:02:57.057366+0000","last_became_active":"2024-04-25T09:02:56.076208+0000","last_became_peered":"2024-04-25T09:02:56.076208+0000","last_unstale":"2024-04-25T09:02:57.057366+0000","last_undegraded":"2024-04-25T09:02:57.057366+0000","last_fullsized":"2024-04-25T09:02:57.057366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:04.686109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053630+0000","last_change":"2024-04-25T09:02:52.043808+0000","last_active":"2024-04-25T09:02:57.053630+0000","last_peered":"2024-04-25T09:02:57.053630+0000","last_clean":"2024-04-25T09:02:57.053630+0000","last_became_active":"2024-04-25T09:02:52.033729+0000","last_became_peered":"2024-04-25T09:02:52.033729+0000","last_unstale":"2024-04-25T09:02:57.053630+0000","last_undegraded":"2024-04-25T09:02:57.053630+0000","last_fullsized":"2024-04-25T09:02:57.053630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:50.625187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790413+0000","last_change":"2024-04-25T09:02:51.025228+0000","last_active":"2024-04-25T09:02:57.790413+0000","last_peered":"2024-04-25T09:02:57.790413+0000","last_clean":"2024-04-25T09:02:57.790413+0000","last_became_active":"2024-04-25T09:02:51.024784+0000","last_became_peered":"2024-04-25T09:02:51.024784+0000","last_unstale":"2024-04-25T09:02:57.790413+0000","last_undegraded":"2024-04-25T09:02:57.790413+0000","last_fullsized":"2024-04-25T09:02:57.790413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:59.734686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791571+0000","last_change":"2024-04-25T09:02:56.299771+0000","last_active":"2024-04-25T09:02:57.791571+0000","last_peered":"2024-04-25T09:02:57.791571+0000","last_clean":"2024-04-25T09:02:57.791571+0000","last_became_active":"2024-04-25T09:02:56.299239+0000","last_became_peered":"2024-04-25T09:02:56.299239+0000","last_unstale":"2024-04-25T09:02:57.791571+0000","last_undegraded":"2024-04-25T09:02:57.791571+0000","last_fullsized":"2024-04-25T09:02:57.791571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:30.366155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056839+0000","last_change":"2024-04-25T09:02:52.027108+0000","last_active":"2024-04-25T09:02:57.056839+0000","last_peered":"2024-04-25T09:02:57.056839+0000","last_clean":"2024-04-25T09:02:57.056839+0000","last_became_active":"2024-04-25T09:02:52.026183+0000","last_became_peered":"2024-04-25T09:02:52.026183+0000","last_unstale":"2024-04-25T09:02:57.056839+0000","last_undegraded":"2024-04-25T09:02:57.056839+0000","last_fullsized":"2024-04-25T09:02:57.056839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:38.122849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463146+0000","last_change":"2024-04-25T09:02:51.040204+0000","last_active":"2024-04-25T09:02:57.463146+0000","last_peered":"2024-04-25T09:02:57.463146+0000","last_clean":"2024-04-25T09:02:57.463146+0000","last_became_active":"2024-04-25T09:02:51.039917+0000","last_became_peered":"2024-04-25T09:02:51.039917+0000","last_unstale":"2024-04-25T09:02:57.463146+0000","last_undegraded":"2024-04-25T09:02:57.463146+0000","last_fullsized":"2024-04-25T09:02:57.463146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057220+0000","last_change":"2024-04-25T09:02:56.072634+0000","last_active":"2024-04-25T09:02:57.057220+0000","last_peered":"2024-04-25T09:02:57.057220+0000","last_clean":"2024-04-25T09:02:57.057220+0000","last_became_active":"2024-04-25T09:02:56.072077+0000","last_became_peered":"2024-04-25T09:02:56.072077+0000","last_unstale":"2024-04-25T09:02:57.057220+0000","last_undegraded":"2024-04-25T09:02:57.057220+0000","last_fullsized":"2024-04-25T09:02:57.057220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:39.318314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790520+0000","last_change":"2024-04-25T09:02:52.024632+0000","last_active":"2024-04-25T09:02:57.790520+0000","last_peered":"2024-04-25T09:02:57.790520+0000","last_clean":"2024-04-25T09:02:57.790520+0000","last_became_active":"2024-04-25T09:02:52.024337+0000","last_became_peered":"2024-04-25T09:02:52.024337+0000","last_unstale":"2024-04-25T09:02:57.790520+0000","last_undegraded":"2024-04-25T09:02:57.790520+0000","last_fullsized":"2024-04-25T09:02:57.790520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:11.410261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057823+0000","last_change":"2024-04-25T09:02:51.024573+0000","last_active":"2024-04-25T09:02:57.057823+0000","last_peered":"2024-04-25T09:02:57.057823+0000","last_clean":"2024-04-25T09:02:57.057823+0000","last_became_active":"2024-04-25T09:02:51.024252+0000","last_became_peered":"2024-04-25T09:02:51.024252+0000","last_unstale":"2024-04-25T09:02:57.057823+0000","last_undegraded":"2024-04-25T09:02:57.057823+0000","last_fullsized":"2024-04-25T09:02:57.057823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:53.131752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056610+0000","last_change":"2024-04-25T09:02:56.295449+0000","last_active":"2024-04-25T09:02:57.056610+0000","last_peered":"2024-04-25T09:02:57.056610+0000","last_clean":"2024-04-25T09:02:57.056610+0000","last_became_active":"2024-04-25T09:02:56.294711+0000","last_became_peered":"2024-04-25T09:02:56.294711+0000","last_unstale":"2024-04-25T09:02:57.056610+0000","last_undegraded":"2024-04-25T09:02:57.056610+0000","last_fullsized":"2024-04-25T09:02:57.056610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:56.463100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054253+0000","last_change":"2024-04-25T09:02:52.046777+0000","last_active":"2024-04-25T09:02:57.054253+0000","last_peered":"2024-04-25T09:02:57.054253+0000","last_clean":"2024-04-25T09:02:57.054253+0000","last_became_active":"2024-04-25T09:02:52.046489+0000","last_became_peered":"2024-04-25T09:02:52.046489+0000","last_unstale":"2024-04-25T09:02:57.054253+0000","last_undegraded":"2024-04-25T09:02:57.054253+0000","last_fullsized":"2024-04-25T09:02:57.054253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:22.709330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791497+0000","last_change":"2024-04-25T09:02:51.027246+0000","last_active":"2024-04-25T09:02:57.791497+0000","last_peered":"2024-04-25T09:02:57.791497+0000","last_clean":"2024-04-25T09:02:57.791497+0000","last_became_active":"2024-04-25T09:02:51.026818+0000","last_became_peered":"2024-04-25T09:02:51.026818+0000","last_unstale":"2024-04-25T09:02:57.791497+0000","last_undegraded":"2024-04-25T09:02:57.791497+0000","last_fullsized":"2024-04-25T09:02:57.791497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:28.429925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053445+0000","last_change":"2024-04-25T09:02:56.295657+0000","last_active":"2024-04-25T09:02:57.053445+0000","last_peered":"2024-04-25T09:02:57.053445+0000","last_clean":"2024-04-25T09:02:57.053445+0000","last_became_active":"2024-04-25T09:02:56.295288+0000","last_became_peered":"2024-04-25T09:02:56.295288+0000","last_unstale":"2024-04-25T09:02:57.053445+0000","last_undegraded":"2024-04-25T09:02:57.053445+0000","last_fullsized":"2024-04-25T09:02:57.053445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:58.529283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791110+0000","last_change":"2024-04-25T09:02:52.024086+0000","last_active":"2024-04-25T09:02:57.791110+0000","last_peered":"2024-04-25T09:02:57.791110+0000","last_clean":"2024-04-25T09:02:57.791110+0000","last_became_active":"2024-04-25T09:02:52.023818+0000","last_became_peered":"2024-04-25T09:02:52.023818+0000","last_unstale":"2024-04-25T09:02:57.791110+0000","last_undegraded":"2024-04-25T09:02:57.791110+0000","last_fullsized":"2024-04-25T09:02:57.791110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:17.240659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463957+0000","last_change":"2024-04-25T09:02:51.040279+0000","last_active":"2024-04-25T09:02:57.463957+0000","last_peered":"2024-04-25T09:02:57.463957+0000","last_clean":"2024-04-25T09:02:57.463957+0000","last_became_active":"2024-04-25T09:02:51.039948+0000","last_became_peered":"2024-04-25T09:02:51.039948+0000","last_unstale":"2024-04-25T09:02:57.463957+0000","last_undegraded":"2024-04-25T09:02:57.463957+0000","last_fullsized":"2024-04-25T09:02:57.463957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:51.667591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789802+0000","last_change":"2024-04-25T09:02:56.293761+0000","last_active":"2024-04-25T09:02:57.789802+0000","last_peered":"2024-04-25T09:02:57.789802+0000","last_clean":"2024-04-25T09:02:57.789802+0000","last_became_active":"2024-04-25T09:02:56.293350+0000","last_became_peered":"2024-04-25T09:02:56.293350+0000","last_unstale":"2024-04-25T09:02:57.789802+0000","last_undegraded":"2024-04-25T09:02:57.789802+0000","last_fullsized":"2024-04-25T09:02:57.789802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:26.744246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789708+0000","last_change":"2024-04-25T09:02:52.052084+0000","last_active":"2024-04-25T09:02:57.789708+0000","last_peered":"2024-04-25T09:02:57.789708+0000","last_clean":"2024-04-25T09:02:57.789708+0000","last_became_active":"2024-04-25T09:02:52.051875+0000","last_became_peered":"2024-04-25T09:02:52.051875+0000","last_unstale":"2024-04-25T09:02:57.789708+0000","last_undegraded":"2024-04-25T09:02:57.789708+0000","last_fullsized":"2024-04-25T09:02:57.789708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:48.909107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791211+0000","last_change":"2024-04-25T09:02:51.032759+0000","last_active":"2024-04-25T09:02:57.791211+0000","last_peered":"2024-04-25T09:02:57.791211+0000","last_clean":"2024-04-25T09:02:57.791211+0000","last_became_active":"2024-04-25T09:02:51.032451+0000","last_became_peered":"2024-04-25T09:02:51.032451+0000","last_unstale":"2024-04-25T09:02:57.791211+0000","last_undegraded":"2024-04-25T09:02:57.791211+0000","last_fullsized":"2024-04-25T09:02:57.791211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:36.866575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790558+0000","last_change":"2024-04-25T09:02:56.070268+0000","last_active":"2024-04-25T09:02:57.790558+0000","last_peered":"2024-04-25T09:02:57.790558+0000","last_clean":"2024-04-25T09:02:57.790558+0000","last_became_active":"2024-04-25T09:02:56.069905+0000","last_became_peered":"2024-04-25T09:02:56.069905+0000","last_unstale":"2024-04-25T09:02:57.790558+0000","last_undegraded":"2024-04-25T09:02:57.790558+0000","last_fullsized":"2024-04-25T09:02:57.790558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:07.888490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057540+0000","last_change":"2024-04-25T09:02:52.034123+0000","last_active":"2024-04-25T09:02:57.057540+0000","last_peered":"2024-04-25T09:02:57.057540+0000","last_clean":"2024-04-25T09:02:57.057540+0000","last_became_active":"2024-04-25T09:02:52.033807+0000","last_became_peered":"2024-04-25T09:02:52.033807+0000","last_unstale":"2024-04-25T09:02:57.057540+0000","last_undegraded":"2024-04-25T09:02:57.057540+0000","last_fullsized":"2024-04-25T09:02:57.057540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:41.419260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789451+0000","last_change":"2024-04-25T09:02:51.026247+0000","last_active":"2024-04-25T09:02:57.789451+0000","last_peered":"2024-04-25T09:02:57.789451+0000","last_clean":"2024-04-25T09:02:57.789451+0000","last_became_active":"2024-04-25T09:02:51.025939+0000","last_became_peered":"2024-04-25T09:02:51.025939+0000","last_unstale":"2024-04-25T09:02:57.789451+0000","last_undegraded":"2024-04-25T09:02:57.789451+0000","last_fullsized":"2024-04-25T09:02:57.789451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:40.409805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791583+0000","last_change":"2024-04-25T09:02:56.076058+0000","last_active":"2024-04-25T09:02:57.791583+0000","last_peered":"2024-04-25T09:02:57.791583+0000","last_clean":"2024-04-25T09:02:57.791583+0000","last_became_active":"2024-04-25T09:02:56.075606+0000","last_became_peered":"2024-04-25T09:02:56.075606+0000","last_unstale":"2024-04-25T09:02:57.791583+0000","last_undegraded":"2024-04-25T09:02:57.791583+0000","last_fullsized":"2024-04-25T09:02:57.791583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:59.234505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790128+0000","last_change":"2024-04-25T09:02:52.024371+0000","last_active":"2024-04-25T09:02:57.790128+0000","last_peered":"2024-04-25T09:02:57.790128+0000","last_clean":"2024-04-25T09:02:57.790128+0000","last_became_active":"2024-04-25T09:02:52.023814+0000","last_became_peered":"2024-04-25T09:02:52.023814+0000","last_unstale":"2024-04-25T09:02:57.790128+0000","last_undegraded":"2024-04-25T09:02:57.790128+0000","last_fullsized":"2024-04-25T09:02:57.790128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:29.446381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789453+0000","last_change":"2024-04-25T09:02:51.027475+0000","last_active":"2024-04-25T09:02:57.789453+0000","last_peered":"2024-04-25T09:02:57.789453+0000","last_clean":"2024-04-25T09:02:57.789453+0000","last_became_active":"2024-04-25T09:02:51.027212+0000","last_became_peered":"2024-04-25T09:02:51.027212+0000","last_unstale":"2024-04-25T09:02:57.789453+0000","last_undegraded":"2024-04-25T09:02:57.789453+0000","last_fullsized":"2024-04-25T09:02:57.789453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:23.500507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791716+0000","last_change":"2024-04-25T09:02:56.066697+0000","last_active":"2024-04-25T09:02:57.791716+0000","last_peered":"2024-04-25T09:02:57.791716+0000","last_clean":"2024-04-25T09:02:57.791716+0000","last_became_active":"2024-04-25T09:02:56.063130+0000","last_became_peered":"2024-04-25T09:02:56.063130+0000","last_unstale":"2024-04-25T09:02:57.791716+0000","last_undegraded":"2024-04-25T09:02:57.791716+0000","last_fullsized":"2024-04-25T09:02:57.791716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:11.878208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789276+0000","last_change":"2024-04-25T09:02:52.037980+0000","last_active":"2024-04-25T09:02:57.789276+0000","last_peered":"2024-04-25T09:02:57.789276+0000","last_clean":"2024-04-25T09:02:57.789276+0000","last_became_active":"2024-04-25T09:02:52.037671+0000","last_became_peered":"2024-04-25T09:02:52.037671+0000","last_unstale":"2024-04-25T09:02:57.789276+0000","last_undegraded":"2024-04-25T09:02:57.789276+0000","last_fullsized":"2024-04-25T09:02:57.789276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:52.677046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463133+0000","last_change":"2024-04-25T09:02:51.032936+0000","last_active":"2024-04-25T09:02:57.463133+0000","last_peered":"2024-04-25T09:02:57.463133+0000","last_clean":"2024-04-25T09:02:57.463133+0000","last_became_active":"2024-04-25T09:02:51.032657+0000","last_became_peered":"2024-04-25T09:02:51.032657+0000","last_unstale":"2024-04-25T09:02:57.463133+0000","last_undegraded":"2024-04-25T09:02:57.463133+0000","last_fullsized":"2024-04-25T09:02:57.463133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:59.734686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790555+0000","last_change":"2024-04-25T09:02:56.297045+0000","last_active":"2024-04-25T09:02:57.790555+0000","last_peered":"2024-04-25T09:02:57.790555+0000","last_clean":"2024-04-25T09:02:57.790555+0000","last_became_active":"2024-04-25T09:02:56.295073+0000","last_became_peered":"2024-04-25T09:02:56.295073+0000","last_unstale":"2024-04-25T09:02:57.790555+0000","last_undegraded":"2024-04-25T09:02:57.790555+0000","last_fullsized":"2024-04-25T09:02:57.790555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:59.234505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053279+0000","last_change":"2024-04-25T09:02:52.038658+0000","last_active":"2024-04-25T09:02:57.053279+0000","last_peered":"2024-04-25T09:02:57.053279+0000","last_clean":"2024-04-25T09:02:57.053279+0000","last_became_active":"2024-04-25T09:02:52.033684+0000","last_became_peered":"2024-04-25T09:02:52.033684+0000","last_unstale":"2024-04-25T09:02:57.053279+0000","last_undegraded":"2024-04-25T09:02:57.053279+0000","last_fullsized":"2024-04-25T09:02:57.053279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:11.410261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789342+0000","last_change":"2024-04-25T09:02:51.023038+0000","last_active":"2024-04-25T09:02:57.789342+0000","last_peered":"2024-04-25T09:02:57.789342+0000","last_clean":"2024-04-25T09:02:57.789342+0000","last_became_active":"2024-04-25T09:02:51.019222+0000","last_became_peered":"2024-04-25T09:02:51.019222+0000","last_unstale":"2024-04-25T09:02:57.789342+0000","last_undegraded":"2024-04-25T09:02:57.789342+0000","last_fullsized":"2024-04-25T09:02:57.789342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:00.953314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463292+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:02:57.463292+0000","last_peered":"2024-04-25T09:02:57.463292+0000","last_clean":"2024-04-25T09:02:57.463292+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:02:57.463292+0000","last_undegraded":"2024-04-25T09:02:57.463292+0000","last_fullsized":"2024-04-25T09:02:57.463292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056417+0000","last_change":"2024-04-25T09:02:56.295692+0000","last_active":"2024-04-25T09:02:57.056417+0000","last_peered":"2024-04-25T09:02:57.056417+0000","last_clean":"2024-04-25T09:02:57.056417+0000","last_became_active":"2024-04-25T09:02:56.295209+0000","last_became_peered":"2024-04-25T09:02:56.295209+0000","last_unstale":"2024-04-25T09:02:57.056417+0000","last_undegraded":"2024-04-25T09:02:57.056417+0000","last_fullsized":"2024-04-25T09:02:57.056417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:52.944023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463642+0000","last_change":"2024-04-25T09:02:52.049009+0000","last_active":"2024-04-25T09:02:57.463642+0000","last_peered":"2024-04-25T09:02:57.463642+0000","last_clean":"2024-04-25T09:02:57.463642+0000","last_became_active":"2024-04-25T09:02:52.048541+0000","last_became_peered":"2024-04-25T09:02:52.048541+0000","last_unstale":"2024-04-25T09:02:57.463642+0000","last_undegraded":"2024-04-25T09:02:57.463642+0000","last_fullsized":"2024-04-25T09:02:57.463642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:03.853574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790093+0000","last_change":"2024-04-25T09:02:51.023326+0000","last_active":"2024-04-25T09:02:57.790093+0000","last_peered":"2024-04-25T09:02:57.790093+0000","last_clean":"2024-04-25T09:02:57.790093+0000","last_became_active":"2024-04-25T09:02:51.022096+0000","last_became_peered":"2024-04-25T09:02:51.022096+0000","last_unstale":"2024-04-25T09:02:57.790093+0000","last_undegraded":"2024-04-25T09:02:57.790093+0000","last_fullsized":"2024-04-25T09:02:57.790093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:47.372516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.055988+0000","last_change":"2024-04-25T09:02:56.295505+0000","last_active":"2024-04-25T09:02:57.055988+0000","last_peered":"2024-04-25T09:02:57.055988+0000","last_clean":"2024-04-25T09:02:57.055988+0000","last_became_active":"2024-04-25T09:02:56.295096+0000","last_became_peered":"2024-04-25T09:02:56.295096+0000","last_unstale":"2024-04-25T09:02:57.055988+0000","last_undegraded":"2024-04-25T09:02:57.055988+0000","last_fullsized":"2024-04-25T09:02:57.055988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:30.581136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789515+0000","last_change":"2024-04-25T09:02:52.036763+0000","last_active":"2024-04-25T09:02:57.789515+0000","last_peered":"2024-04-25T09:02:57.789515+0000","last_clean":"2024-04-25T09:02:57.789515+0000","last_became_active":"2024-04-25T09:02:52.035834+0000","last_became_peered":"2024-04-25T09:02:52.035834+0000","last_unstale":"2024-04-25T09:02:57.789515+0000","last_undegraded":"2024-04-25T09:02:57.789515+0000","last_fullsized":"2024-04-25T09:02:57.789515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:42.264135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791361+0000","last_change":"2024-04-25T09:02:51.016550+0000","last_active":"2024-04-25T09:02:57.791361+0000","last_peered":"2024-04-25T09:02:57.791361+0000","last_clean":"2024-04-25T09:02:57.791361+0000","last_became_active":"2024-04-25T09:02:51.016306+0000","last_became_peered":"2024-04-25T09:02:51.016306+0000","last_unstale":"2024-04-25T09:02:57.791361+0000","last_undegraded":"2024-04-25T09:02:57.791361+0000","last_fullsized":"2024-04-25T09:02:57.791361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789915+0000","last_change":"2024-04-25T09:02:56.072785+0000","last_active":"2024-04-25T09:02:57.789915+0000","last_peered":"2024-04-25T09:02:57.789915+0000","last_clean":"2024-04-25T09:02:57.789915+0000","last_became_active":"2024-04-25T09:02:56.072306+0000","last_became_peered":"2024-04-25T09:02:56.072306+0000","last_unstale":"2024-04-25T09:02:57.789915+0000","last_undegraded":"2024-04-25T09:02:57.789915+0000","last_fullsized":"2024-04-25T09:02:57.789915+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:07.888490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.464063+0000","last_change":"2024-04-25T09:02:52.056902+0000","last_active":"2024-04-25T09:02:57.464063+0000","last_peered":"2024-04-25T09:02:57.464063+0000","last_clean":"2024-04-25T09:02:57.464063+0000","last_became_active":"2024-04-25T09:02:52.056597+0000","last_became_peered":"2024-04-25T09:02:52.056597+0000","last_unstale":"2024-04-25T09:02:57.464063+0000","last_undegraded":"2024-04-25T09:02:57.464063+0000","last_fullsized":"2024-04-25T09:02:57.464063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:29.173421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790787+0000","last_change":"2024-04-25T09:02:51.028470+0000","last_active":"2024-04-25T09:02:57.790787+0000","last_peered":"2024-04-25T09:02:57.790787+0000","last_clean":"2024-04-25T09:02:57.790787+0000","last_became_active":"2024-04-25T09:02:51.028151+0000","last_became_peered":"2024-04-25T09:02:51.028151+0000","last_unstale":"2024-04-25T09:02:57.790787+0000","last_undegraded":"2024-04-25T09:02:57.790787+0000","last_fullsized":"2024-04-25T09:02:57.790787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:36.866575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789052+0000","last_change":"2024-04-25T09:02:56.295226+0000","last_active":"2024-04-25T09:02:57.789052+0000","last_peered":"2024-04-25T09:02:57.789052+0000","last_clean":"2024-04-25T09:02:57.789052+0000","last_became_active":"2024-04-25T09:02:56.294800+0000","last_became_peered":"2024-04-25T09:02:56.294800+0000","last_unstale":"2024-04-25T09:02:57.789052+0000","last_undegraded":"2024-04-25T09:02:57.789052+0000","last_fullsized":"2024-04-25T09:02:57.789052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:58.795884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463945+0000","last_change":"2024-04-25T09:02:52.052984+0000","last_active":"2024-04-25T09:02:57.463945+0000","last_peered":"2024-04-25T09:02:57.463945+0000","last_clean":"2024-04-25T09:02:57.463945+0000","last_became_active":"2024-04-25T09:02:52.051829+0000","last_became_peered":"2024-04-25T09:02:52.051829+0000","last_unstale":"2024-04-25T09:02:57.463945+0000","last_undegraded":"2024-04-25T09:02:57.463945+0000","last_fullsized":"2024-04-25T09:02:57.463945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:55.199589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057574+0000","last_change":"2024-04-25T09:02:51.031885+0000","last_active":"2024-04-25T09:02:57.057574+0000","last_peered":"2024-04-25T09:02:57.057574+0000","last_clean":"2024-04-25T09:02:57.057574+0000","last_became_active":"2024-04-25T09:02:51.031618+0000","last_became_peered":"2024-04-25T09:02:51.031618+0000","last_unstale":"2024-04-25T09:02:57.057574+0000","last_undegraded":"2024-04-25T09:02:57.057574+0000","last_fullsized":"2024-04-25T09:02:57.057574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:41.667025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056391+0000","last_change":"2024-04-25T09:02:56.076568+0000","last_active":"2024-04-25T09:02:57.056391+0000","last_peered":"2024-04-25T09:02:57.056391+0000","last_clean":"2024-04-25T09:02:57.056391+0000","last_became_active":"2024-04-25T09:02:56.076131+0000","last_became_peered":"2024-04-25T09:02:56.076131+0000","last_unstale":"2024-04-25T09:02:57.056391+0000","last_undegraded":"2024-04-25T09:02:57.056391+0000","last_fullsized":"2024-04-25T09:02:57.056391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:43.097216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463302+0000","last_change":"2024-04-25T09:02:52.045786+0000","last_active":"2024-04-25T09:02:57.463302+0000","last_peered":"2024-04-25T09:02:57.463302+0000","last_clean":"2024-04-25T09:02:57.463302+0000","last_became_active":"2024-04-25T09:02:52.045116+0000","last_became_peered":"2024-04-25T09:02:52.045116+0000","last_unstale":"2024-04-25T09:02:57.463302+0000","last_undegraded":"2024-04-25T09:02:57.463302+0000","last_fullsized":"2024-04-25T09:02:57.463302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:29.002911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790256+0000","last_change":"2024-04-25T09:02:51.010840+0000","last_active":"2024-04-25T09:02:57.790256+0000","last_peered":"2024-04-25T09:02:57.790256+0000","last_clean":"2024-04-25T09:02:57.790256+0000","last_became_active":"2024-04-25T09:02:51.010562+0000","last_became_peered":"2024-04-25T09:02:51.010562+0000","last_unstale":"2024-04-25T09:02:57.790256+0000","last_undegraded":"2024-04-25T09:02:57.790256+0000","last_fullsized":"2024-04-25T09:02:57.790256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:52.829970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790256+0000","last_change":"2024-04-25T09:02:56.062496+0000","last_active":"2024-04-25T09:02:57.790256+0000","last_peered":"2024-04-25T09:02:57.790256+0000","last_clean":"2024-04-25T09:02:57.790256+0000","last_became_active":"2024-04-25T09:02:56.061695+0000","last_became_peered":"2024-04-25T09:02:56.061695+0000","last_unstale":"2024-04-25T09:02:57.790256+0000","last_undegraded":"2024-04-25T09:02:57.790256+0000","last_fullsized":"2024-04-25T09:02:57.790256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:52.333199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056444+0000","last_change":"2024-04-25T09:02:52.035521+0000","last_active":"2024-04-25T09:02:57.056444+0000","last_peered":"2024-04-25T09:02:57.056444+0000","last_clean":"2024-04-25T09:02:57.056444+0000","last_became_active":"2024-04-25T09:02:52.035166+0000","last_became_peered":"2024-04-25T09:02:52.035166+0000","last_unstale":"2024-04-25T09:02:57.056444+0000","last_undegraded":"2024-04-25T09:02:57.056444+0000","last_fullsized":"2024-04-25T09:02:57.056444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:15.470271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.055747+0000","last_change":"2024-04-25T09:02:51.026637+0000","last_active":"2024-04-25T09:02:57.055747+0000","last_peered":"2024-04-25T09:02:57.055747+0000","last_clean":"2024-04-25T09:02:57.055747+0000","last_became_active":"2024-04-25T09:02:51.026370+0000","last_became_peered":"2024-04-25T09:02:51.026370+0000","last_unstale":"2024-04-25T09:02:57.055747+0000","last_undegraded":"2024-04-25T09:02:57.055747+0000","last_fullsized":"2024-04-25T09:02:57.055747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:00.953314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054223+0000","last_change":"2024-04-25T09:02:56.296384+0000","last_active":"2024-04-25T09:02:57.054223+0000","last_peered":"2024-04-25T09:02:57.054223+0000","last_clean":"2024-04-25T09:02:57.054223+0000","last_became_active":"2024-04-25T09:02:56.295883+0000","last_became_peered":"2024-04-25T09:02:56.295883+0000","last_unstale":"2024-04-25T09:02:57.054223+0000","last_undegraded":"2024-04-25T09:02:57.054223+0000","last_fullsized":"2024-04-25T09:02:57.054223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:00.209106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463590+0000","last_change":"2024-04-25T09:02:52.048294+0000","last_active":"2024-04-25T09:02:57.463590+0000","last_peered":"2024-04-25T09:02:57.463590+0000","last_clean":"2024-04-25T09:02:57.463590+0000","last_became_active":"2024-04-25T09:02:52.048002+0000","last_became_peered":"2024-04-25T09:02:52.048002+0000","last_unstale":"2024-04-25T09:02:57.463590+0000","last_undegraded":"2024-04-25T09:02:57.463590+0000","last_fullsized":"2024-04-25T09:02:57.463590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:09.375365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789346+0000","last_change":"2024-04-25T09:02:51.029612+0000","last_active":"2024-04-25T09:02:57.789346+0000","last_peered":"2024-04-25T09:02:57.789346+0000","last_clean":"2024-04-25T09:02:57.789346+0000","last_became_active":"2024-04-25T09:02:51.026917+0000","last_became_peered":"2024-04-25T09:02:51.026917+0000","last_unstale":"2024-04-25T09:02:57.789346+0000","last_undegraded":"2024-04-25T09:02:57.789346+0000","last_fullsized":"2024-04-25T09:02:57.789346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:37.113394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053975+0000","last_change":"2024-04-25T09:02:56.296436+0000","last_active":"2024-04-25T09:02:57.053975+0000","last_peered":"2024-04-25T09:02:57.053975+0000","last_clean":"2024-04-25T09:02:57.053975+0000","last_became_active":"2024-04-25T09:02:56.295723+0000","last_became_peered":"2024-04-25T09:02:56.295723+0000","last_unstale":"2024-04-25T09:02:57.053975+0000","last_undegraded":"2024-04-25T09:02:57.053975+0000","last_fullsized":"2024-04-25T09:02:57.053975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:23.747770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789579+0000","last_change":"2024-04-25T09:02:52.032064+0000","last_active":"2024-04-25T09:02:57.789579+0000","last_peered":"2024-04-25T09:02:57.789579+0000","last_clean":"2024-04-25T09:02:57.789579+0000","last_became_active":"2024-04-25T09:02:52.031817+0000","last_became_peered":"2024-04-25T09:02:52.031817+0000","last_unstale":"2024-04-25T09:02:57.789579+0000","last_undegraded":"2024-04-25T09:02:57.789579+0000","last_fullsized":"2024-04-25T09:02:57.789579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:30.389641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789972+0000","last_change":"2024-04-25T09:02:51.036904+0000","last_active":"2024-04-25T09:02:57.789972+0000","last_peered":"2024-04-25T09:02:57.789972+0000","last_clean":"2024-04-25T09:02:57.789972+0000","last_became_active":"2024-04-25T09:02:51.036647+0000","last_became_peered":"2024-04-25T09:02:51.036647+0000","last_unstale":"2024-04-25T09:02:57.789972+0000","last_undegraded":"2024-04-25T09:02:57.789972+0000","last_fullsized":"2024-04-25T09:02:57.789972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:53.609696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789625+0000","last_change":"2024-04-25T09:02:56.297201+0000","last_active":"2024-04-25T09:02:57.789625+0000","last_peered":"2024-04-25T09:02:57.789625+0000","last_clean":"2024-04-25T09:02:57.789625+0000","last_became_active":"2024-04-25T09:02:56.296775+0000","last_became_peered":"2024-04-25T09:02:56.296775+0000","last_unstale":"2024-04-25T09:02:57.789625+0000","last_undegraded":"2024-04-25T09:02:57.789625+0000","last_fullsized":"2024-04-25T09:02:57.789625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:27:21.244707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463541+0000","last_change":"2024-04-25T09:02:52.048354+0000","last_active":"2024-04-25T09:02:57.463541+0000","last_peered":"2024-04-25T09:02:57.463541+0000","last_clean":"2024-04-25T09:02:57.463541+0000","last_became_active":"2024-04-25T09:02:52.048051+0000","last_became_peered":"2024-04-25T09:02:52.048051+0000","last_unstale":"2024-04-25T09:02:57.463541+0000","last_undegraded":"2024-04-25T09:02:57.463541+0000","last_fullsized":"2024-04-25T09:02:57.463541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:22.709330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:03:00.883741+0000","last_change":"2024-04-25T09:02:51.025093+0000","last_active":"2024-04-25T09:03:00.883741+0000","last_peered":"2024-04-25T09:03:00.883741+0000","last_clean":"2024-04-25T09:03:00.883741+0000","last_became_active":"2024-04-25T09:02:51.024835+0000","last_became_peered":"2024-04-25T09:02:51.024835+0000","last_unstale":"2024-04-25T09:03:00.883741+0000","last_undegraded":"2024-04-25T09:03:00.883741+0000","last_fullsized":"2024-04-25T09:03:00.883741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:40.409805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790711+0000","last_change":"2024-04-25T09:02:56.072738+0000","last_active":"2024-04-25T09:02:57.790711+0000","last_peered":"2024-04-25T09:02:57.790711+0000","last_clean":"2024-04-25T09:02:57.790711+0000","last_became_active":"2024-04-25T09:02:56.072349+0000","last_became_peered":"2024-04-25T09:02:56.072349+0000","last_unstale":"2024-04-25T09:02:57.790711+0000","last_undegraded":"2024-04-25T09:02:57.790711+0000","last_fullsized":"2024-04-25T09:02:57.790711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:52.333199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057433+0000","last_change":"2024-04-25T09:02:52.030750+0000","last_active":"2024-04-25T09:02:57.057433+0000","last_peered":"2024-04-25T09:02:57.057433+0000","last_clean":"2024-04-25T09:02:57.057433+0000","last_became_active":"2024-04-25T09:02:52.030455+0000","last_became_peered":"2024-04-25T09:02:52.030455+0000","last_unstale":"2024-04-25T09:02:57.057433+0000","last_undegraded":"2024-04-25T09:02:57.057433+0000","last_fullsized":"2024-04-25T09:02:57.057433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:21.197671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791243+0000","last_change":"2024-04-25T09:02:51.020914+0000","last_active":"2024-04-25T09:02:57.791243+0000","last_peered":"2024-04-25T09:02:57.791243+0000","last_clean":"2024-04-25T09:02:57.791243+0000","last_became_active":"2024-04-25T09:02:51.020614+0000","last_became_peered":"2024-04-25T09:02:51.020614+0000","last_unstale":"2024-04-25T09:02:57.791243+0000","last_undegraded":"2024-04-25T09:02:57.791243+0000","last_fullsized":"2024-04-25T09:02:57.791243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:23.500507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057336+0000","last_change":"2024-04-25T09:02:56.072410+0000","last_active":"2024-04-25T09:02:57.057336+0000","last_peered":"2024-04-25T09:02:57.057336+0000","last_clean":"2024-04-25T09:02:57.057336+0000","last_became_active":"2024-04-25T09:02:56.071847+0000","last_became_peered":"2024-04-25T09:02:56.071847+0000","last_unstale":"2024-04-25T09:02:57.057336+0000","last_undegraded":"2024-04-25T09:02:57.057336+0000","last_fullsized":"2024-04-25T09:02:57.057336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:01.264766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790723+0000","last_change":"2024-04-25T09:02:52.045382+0000","last_active":"2024-04-25T09:02:57.790723+0000","last_peered":"2024-04-25T09:02:57.790723+0000","last_clean":"2024-04-25T09:02:57.790723+0000","last_became_active":"2024-04-25T09:02:52.045073+0000","last_became_peered":"2024-04-25T09:02:52.045073+0000","last_unstale":"2024-04-25T09:02:57.790723+0000","last_undegraded":"2024-04-25T09:02:57.790723+0000","last_fullsized":"2024-04-25T09:02:57.790723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:00.242892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789749+0000","last_change":"2024-04-25T09:02:51.030041+0000","last_active":"2024-04-25T09:02:57.789749+0000","last_peered":"2024-04-25T09:02:57.789749+0000","last_clean":"2024-04-25T09:02:57.789749+0000","last_became_active":"2024-04-25T09:02:51.028411+0000","last_became_peered":"2024-04-25T09:02:51.028411+0000","last_unstale":"2024-04-25T09:02:57.789749+0000","last_undegraded":"2024-04-25T09:02:57.789749+0000","last_fullsized":"2024-04-25T09:02:57.789749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:07.474980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053490+0000","last_change":"2024-04-25T09:02:56.077345+0000","last_active":"2024-04-25T09:02:57.053490+0000","last_peered":"2024-04-25T09:02:57.053490+0000","last_clean":"2024-04-25T09:02:57.053490+0000","last_became_active":"2024-04-25T09:02:56.076889+0000","last_became_peered":"2024-04-25T09:02:56.076889+0000","last_unstale":"2024-04-25T09:02:57.053490+0000","last_undegraded":"2024-04-25T09:02:57.053490+0000","last_fullsized":"2024-04-25T09:02:57.053490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:03.323090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789638+0000","last_change":"2024-04-25T09:02:52.057118+0000","last_active":"2024-04-25T09:02:57.789638+0000","last_peered":"2024-04-25T09:02:57.789638+0000","last_clean":"2024-04-25T09:02:57.789638+0000","last_became_active":"2024-04-25T09:02:52.056534+0000","last_became_peered":"2024-04-25T09:02:52.056534+0000","last_unstale":"2024-04-25T09:02:57.789638+0000","last_undegraded":"2024-04-25T09:02:57.789638+0000","last_fullsized":"2024-04-25T09:02:57.789638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:52.621278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057721+0000","last_change":"2024-04-25T09:02:51.031218+0000","last_active":"2024-04-25T09:02:57.057721+0000","last_peered":"2024-04-25T09:02:57.057721+0000","last_clean":"2024-04-25T09:02:57.057721+0000","last_became_active":"2024-04-25T09:02:51.030865+0000","last_became_peered":"2024-04-25T09:02:51.030865+0000","last_unstale":"2024-04-25T09:02:57.057721+0000","last_undegraded":"2024-04-25T09:02:57.057721+0000","last_fullsized":"2024-04-25T09:02:57.057721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:07.474980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053441+0000","last_change":"2024-04-25T09:02:56.299090+0000","last_active":"2024-04-25T09:02:57.053441+0000","last_peered":"2024-04-25T09:02:57.053441+0000","last_clean":"2024-04-25T09:02:57.053441+0000","last_became_active":"2024-04-25T09:02:56.298743+0000","last_became_peered":"2024-04-25T09:02:56.298743+0000","last_unstale":"2024-04-25T09:02:57.053441+0000","last_undegraded":"2024-04-25T09:02:57.053441+0000","last_fullsized":"2024-04-25T09:02:57.053441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:29.182136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790262+0000","last_change":"2024-04-25T09:02:56.295329+0000","last_active":"2024-04-25T09:02:57.790262+0000","last_peered":"2024-04-25T09:02:57.790262+0000","last_clean":"2024-04-25T09:02:57.790262+0000","last_became_active":"2024-04-25T09:02:56.294937+0000","last_became_peered":"2024-04-25T09:02:56.294937+0000","last_unstale":"2024-04-25T09:02:57.790262+0000","last_undegraded":"2024-04-25T09:02:57.790262+0000","last_fullsized":"2024-04-25T09:02:57.790262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:30.366155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790315+0000","last_change":"2024-04-25T09:02:52.025989+0000","last_active":"2024-04-25T09:02:57.790315+0000","last_peered":"2024-04-25T09:02:57.790315+0000","last_clean":"2024-04-25T09:02:57.790315+0000","last_became_active":"2024-04-25T09:02:52.025737+0000","last_became_peered":"2024-04-25T09:02:52.025737+0000","last_unstale":"2024-04-25T09:02:57.790315+0000","last_undegraded":"2024-04-25T09:02:57.790315+0000","last_fullsized":"2024-04-25T09:02:57.790315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:11.410261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789186+0000","last_change":"2024-04-25T09:02:51.024227+0000","last_active":"2024-04-25T09:02:57.789186+0000","last_peered":"2024-04-25T09:02:57.789186+0000","last_clean":"2024-04-25T09:02:57.789186+0000","last_became_active":"2024-04-25T09:02:51.023132+0000","last_became_peered":"2024-04-25T09:02:51.023132+0000","last_unstale":"2024-04-25T09:02:57.789186+0000","last_undegraded":"2024-04-25T09:02:57.789186+0000","last_fullsized":"2024-04-25T09:02:57.789186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:53.131752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057646+0000","last_change":"2024-04-25T09:02:56.067614+0000","last_active":"2024-04-25T09:02:57.057646+0000","last_peered":"2024-04-25T09:02:57.057646+0000","last_clean":"2024-04-25T09:02:57.057646+0000","last_became_active":"2024-04-25T09:02:56.067179+0000","last_became_peered":"2024-04-25T09:02:56.067179+0000","last_unstale":"2024-04-25T09:02:57.057646+0000","last_undegraded":"2024-04-25T09:02:57.057646+0000","last_fullsized":"2024-04-25T09:02:57.057646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:23.153554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053548+0000","last_change":"2024-04-25T09:02:52.043753+0000","last_active":"2024-04-25T09:02:57.053548+0000","last_peered":"2024-04-25T09:02:57.053548+0000","last_clean":"2024-04-25T09:02:57.053548+0000","last_became_active":"2024-04-25T09:02:52.033568+0000","last_became_peered":"2024-04-25T09:02:52.033568+0000","last_unstale":"2024-04-25T09:02:57.053548+0000","last_undegraded":"2024-04-25T09:02:57.053548+0000","last_fullsized":"2024-04-25T09:02:57.053548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:00.242892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053615+0000","last_change":"2024-04-25T09:02:51.025428+0000","last_active":"2024-04-25T09:02:57.053615+0000","last_peered":"2024-04-25T09:02:57.053615+0000","last_clean":"2024-04-25T09:02:57.053615+0000","last_became_active":"2024-04-25T09:02:51.025136+0000","last_became_peered":"2024-04-25T09:02:51.025136+0000","last_unstale":"2024-04-25T09:02:57.053615+0000","last_undegraded":"2024-04-25T09:02:57.053615+0000","last_fullsized":"2024-04-25T09:02:57.053615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:52.829970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056222+0000","last_change":"2024-04-25T09:02:51.022491+0000","last_active":"2024-04-25T09:02:57.056222+0000","last_peered":"2024-04-25T09:02:57.056222+0000","last_clean":"2024-04-25T09:02:57.056222+0000","last_became_active":"2024-04-25T09:02:51.022247+0000","last_became_peered":"2024-04-25T09:02:51.022247+0000","last_unstale":"2024-04-25T09:02:57.056222+0000","last_undegraded":"2024-04-25T09:02:57.056222+0000","last_fullsized":"2024-04-25T09:02:57.056222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:37.113394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789930+0000","last_change":"2024-04-25T09:02:52.038252+0000","last_active":"2024-04-25T09:02:57.789930+0000","last_peered":"2024-04-25T09:02:57.789930+0000","last_clean":"2024-04-25T09:02:57.789930+0000","last_became_active":"2024-04-25T09:02:52.037716+0000","last_became_peered":"2024-04-25T09:02:52.037716+0000","last_unstale":"2024-04-25T09:02:57.789930+0000","last_undegraded":"2024-04-25T09:02:57.789930+0000","last_fullsized":"2024-04-25T09:02:57.789930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:10.988897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789926+0000","last_change":"2024-04-25T09:02:56.069802+0000","last_active":"2024-04-25T09:02:57.789926+0000","last_peered":"2024-04-25T09:02:57.789926+0000","last_clean":"2024-04-25T09:02:57.789926+0000","last_became_active":"2024-04-25T09:02:56.069427+0000","last_became_peered":"2024-04-25T09:02:56.069427+0000","last_unstale":"2024-04-25T09:02:57.789926+0000","last_undegraded":"2024-04-25T09:02:57.789926+0000","last_fullsized":"2024-04-25T09:02:57.789926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:34.424557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053772+0000","last_change":"2024-04-25T09:02:51.036075+0000","last_active":"2024-04-25T09:02:57.053772+0000","last_peered":"2024-04-25T09:02:57.053772+0000","last_clean":"2024-04-25T09:02:57.053772+0000","last_became_active":"2024-04-25T09:02:51.035849+0000","last_became_peered":"2024-04-25T09:02:51.035849+0000","last_unstale":"2024-04-25T09:02:57.053772+0000","last_undegraded":"2024-04-25T09:02:57.053772+0000","last_fullsized":"2024-04-25T09:02:57.053772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:23.500507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056936+0000","last_change":"2024-04-25T09:02:52.036912+0000","last_active":"2024-04-25T09:02:57.056936+0000","last_peered":"2024-04-25T09:02:57.056936+0000","last_clean":"2024-04-25T09:02:57.056936+0000","last_became_active":"2024-04-25T09:02:52.036679+0000","last_became_peered":"2024-04-25T09:02:52.036679+0000","last_unstale":"2024-04-25T09:02:57.056936+0000","last_undegraded":"2024-04-25T09:02:57.056936+0000","last_fullsized":"2024-04-25T09:02:57.056936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:08.484435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054391+0000","last_change":"2024-04-25T09:02:56.066858+0000","last_active":"2024-04-25T09:02:57.054391+0000","last_peered":"2024-04-25T09:02:57.054391+0000","last_clean":"2024-04-25T09:02:57.054391+0000","last_became_active":"2024-04-25T09:02:56.066447+0000","last_became_peered":"2024-04-25T09:02:56.066447+0000","last_unstale":"2024-04-25T09:02:57.054391+0000","last_undegraded":"2024-04-25T09:02:57.054391+0000","last_fullsized":"2024-04-25T09:02:57.054391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:31.684064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.055569+0000","last_change":"2024-04-25T09:02:52.035312+0000","last_active":"2024-04-25T09:02:57.055569+0000","last_peered":"2024-04-25T09:02:57.055569+0000","last_clean":"2024-04-25T09:02:57.055569+0000","last_became_active":"2024-04-25T09:02:52.035070+0000","last_became_peered":"2024-04-25T09:02:52.035070+0000","last_unstale":"2024-04-25T09:02:57.055569+0000","last_undegraded":"2024-04-25T09:02:57.055569+0000","last_fullsized":"2024-04-25T09:02:57.055569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:31.078849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789359+0000","last_change":"2024-04-25T09:02:52.045821+0000","last_active":"2024-04-25T09:02:57.789359+0000","last_peered":"2024-04-25T09:02:57.789359+0000","last_clean":"2024-04-25T09:02:57.789359+0000","last_became_active":"2024-04-25T09:02:52.045314+0000","last_became_peered":"2024-04-25T09:02:52.045314+0000","last_unstale":"2024-04-25T09:02:57.789359+0000","last_undegraded":"2024-04-25T09:02:57.789359+0000","last_fullsized":"2024-04-25T09:02:57.789359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:45.562857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789433+0000","last_change":"2024-04-25T09:02:52.037128+0000","last_active":"2024-04-25T09:02:57.789433+0000","last_peered":"2024-04-25T09:02:57.789433+0000","last_clean":"2024-04-25T09:02:57.789433+0000","last_became_active":"2024-04-25T09:02:52.036844+0000","last_became_peered":"2024-04-25T09:02:52.036844+0000","last_unstale":"2024-04-25T09:02:57.789433+0000","last_undegraded":"2024-04-25T09:02:57.789433+0000","last_fullsized":"2024-04-25T09:02:57.789433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:00.651193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789850+0000","last_change":"2024-04-25T09:02:52.029120+0000","last_active":"2024-04-25T09:02:57.789850+0000","last_peered":"2024-04-25T09:02:57.789850+0000","last_clean":"2024-04-25T09:02:57.789850+0000","last_became_active":"2024-04-25T09:02:52.028407+0000","last_became_peered":"2024-04-25T09:02:52.028407+0000","last_unstale":"2024-04-25T09:02:57.789850+0000","last_undegraded":"2024-04-25T09:02:57.789850+0000","last_fullsized":"2024-04-25T09:02:57.789850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:02.471096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054070+0000","last_change":"2024-04-25T09:02:52.042602+0000","last_active":"2024-04-25T09:02:57.054070+0000","last_peered":"2024-04-25T09:02:57.054070+0000","last_clean":"2024-04-25T09:02:57.054070+0000","last_became_active":"2024-04-25T09:02:52.042283+0000","last_became_peered":"2024-04-25T09:02:52.042283+0000","last_unstale":"2024-04-25T09:02:57.054070+0000","last_undegraded":"2024-04-25T09:02:57.054070+0000","last_fullsized":"2024-04-25T09:02:57.054070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:17.240659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791085+0000","last_change":"2024-04-25T09:02:52.033453+0000","last_active":"2024-04-25T09:02:57.791085+0000","last_peered":"2024-04-25T09:02:57.791085+0000","last_clean":"2024-04-25T09:02:57.791085+0000","last_became_active":"2024-04-25T09:02:52.031389+0000","last_became_peered":"2024-04-25T09:02:52.031389+0000","last_unstale":"2024-04-25T09:02:57.791085+0000","last_undegraded":"2024-04-25T09:02:57.791085+0000","last_fullsized":"2024-04-25T09:02:57.791085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:50.625187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057375+0000","last_change":"2024-04-25T09:02:52.035491+0000","last_active":"2024-04-25T09:02:57.057375+0000","last_peered":"2024-04-25T09:02:57.057375+0000","last_clean":"2024-04-25T09:02:57.057375+0000","last_became_active":"2024-04-25T09:02:52.035187+0000","last_became_peered":"2024-04-25T09:02:52.035187+0000","last_unstale":"2024-04-25T09:02:57.057375+0000","last_undegraded":"2024-04-25T09:02:57.057375+0000","last_fullsized":"2024-04-25T09:02:57.057375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:48.414352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054153+0000","last_change":"2024-04-25T09:02:52.039762+0000","last_active":"2024-04-25T09:02:57.054153+0000","last_peered":"2024-04-25T09:02:57.054153+0000","last_clean":"2024-04-25T09:02:57.054153+0000","last_became_active":"2024-04-25T09:02:52.039488+0000","last_became_peered":"2024-04-25T09:02:52.039488+0000","last_unstale":"2024-04-25T09:02:57.054153+0000","last_undegraded":"2024-04-25T09:02:57.054153+0000","last_fullsized":"2024-04-25T09:02:57.054153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:09.375365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789087+0000","last_change":"2024-04-25T09:02:52.043692+0000","last_active":"2024-04-25T09:02:57.789087+0000","last_peered":"2024-04-25T09:02:57.789087+0000","last_clean":"2024-04-25T09:02:57.789087+0000","last_became_active":"2024-04-25T09:02:52.032307+0000","last_became_peered":"2024-04-25T09:02:52.032307+0000","last_unstale":"2024-04-25T09:02:57.789087+0000","last_undegraded":"2024-04-25T09:02:57.789087+0000","last_fullsized":"2024-04-25T09:02:57.789087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:19.118637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053487+0000","last_change":"2024-04-25T09:02:52.040184+0000","last_active":"2024-04-25T09:02:57.053487+0000","last_peered":"2024-04-25T09:02:57.053487+0000","last_clean":"2024-04-25T09:02:57.053487+0000","last_became_active":"2024-04-25T09:02:52.040040+0000","last_became_peered":"2024-04-25T09:02:52.040040+0000","last_unstale":"2024-04-25T09:02:57.053487+0000","last_undegraded":"2024-04-25T09:02:57.053487+0000","last_fullsized":"2024-04-25T09:02:57.053487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:29.446381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789190+0000","last_change":"2024-04-25T09:02:52.058066+0000","last_active":"2024-04-25T09:02:57.789190+0000","last_peered":"2024-04-25T09:02:57.789190+0000","last_clean":"2024-04-25T09:02:57.789190+0000","last_became_active":"2024-04-25T09:02:52.053807+0000","last_became_peered":"2024-04-25T09:02:52.053807+0000","last_unstale":"2024-04-25T09:02:57.789190+0000","last_undegraded":"2024-04-25T09:02:57.789190+0000","last_fullsized":"2024-04-25T09:02:57.789190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:57.229849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789717+0000","last_change":"2024-04-25T09:02:52.036032+0000","last_active":"2024-04-25T09:02:57.789717+0000","last_peered":"2024-04-25T09:02:57.789717+0000","last_clean":"2024-04-25T09:02:57.789717+0000","last_became_active":"2024-04-25T09:02:52.035736+0000","last_became_peered":"2024-04-25T09:02:52.035736+0000","last_unstale":"2024-04-25T09:02:57.789717+0000","last_undegraded":"2024-04-25T09:02:57.789717+0000","last_fullsized":"2024-04-25T09:02:57.789717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:31.710536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056126+0000","last_change":"2024-04-25T09:02:52.039101+0000","last_active":"2024-04-25T09:02:57.056126+0000","last_peered":"2024-04-25T09:02:57.056126+0000","last_clean":"2024-04-25T09:02:57.056126+0000","last_became_active":"2024-04-25T09:02:52.038805+0000","last_became_peered":"2024-04-25T09:02:52.038805+0000","last_unstale":"2024-04-25T09:02:57.056126+0000","last_undegraded":"2024-04-25T09:02:57.056126+0000","last_fullsized":"2024-04-25T09:02:57.056126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:39.062300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463830+0000","last_change":"2024-04-25T09:02:52.049274+0000","last_active":"2024-04-25T09:02:57.463830+0000","last_peered":"2024-04-25T09:02:57.463830+0000","last_clean":"2024-04-25T09:02:57.463830+0000","last_became_active":"2024-04-25T09:02:52.048624+0000","last_became_peered":"2024-04-25T09:02:52.048624+0000","last_unstale":"2024-04-25T09:02:57.463830+0000","last_undegraded":"2024-04-25T09:02:57.463830+0000","last_fullsized":"2024-04-25T09:02:57.463830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:48.298283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790702+0000","last_change":"2024-04-25T09:02:52.030094+0000","last_active":"2024-04-25T09:02:57.790702+0000","last_peered":"2024-04-25T09:02:57.790702+0000","last_clean":"2024-04-25T09:02:57.790702+0000","last_became_active":"2024-04-25T09:02:52.029404+0000","last_became_peered":"2024-04-25T09:02:52.029404+0000","last_unstale":"2024-04-25T09:02:57.790702+0000","last_undegraded":"2024-04-25T09:02:57.790702+0000","last_fullsized":"2024-04-25T09:02:57.790702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:11.826190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789936+0000","last_change":"2024-04-25T09:02:52.057482+0000","last_active":"2024-04-25T09:02:57.789936+0000","last_peered":"2024-04-25T09:02:57.789936+0000","last_clean":"2024-04-25T09:02:57.789936+0000","last_became_active":"2024-04-25T09:02:52.053761+0000","last_became_peered":"2024-04-25T09:02:52.053761+0000","last_unstale":"2024-04-25T09:02:57.789936+0000","last_undegraded":"2024-04-25T09:02:57.789936+0000","last_fullsized":"2024-04-25T09:02:57.789936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:41.457232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.788945+0000","last_change":"2024-04-25T09:02:52.038864+0000","last_active":"2024-04-25T09:02:57.788945+0000","last_peered":"2024-04-25T09:02:57.788945+0000","last_clean":"2024-04-25T09:02:57.788945+0000","last_became_active":"2024-04-25T09:02:52.038586+0000","last_became_peered":"2024-04-25T09:02:52.038586+0000","last_unstale":"2024-04-25T09:02:57.788945+0000","last_undegraded":"2024-04-25T09:02:57.788945+0000","last_fullsized":"2024-04-25T09:02:57.788945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:39.062300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790365+0000","last_change":"2024-04-25T09:02:52.021083+0000","last_active":"2024-04-25T09:02:57.790365+0000","last_peered":"2024-04-25T09:02:57.790365+0000","last_clean":"2024-04-25T09:02:57.790365+0000","last_became_active":"2024-04-25T09:02:52.019096+0000","last_became_peered":"2024-04-25T09:02:52.019096+0000","last_unstale":"2024-04-25T09:02:57.790365+0000","last_undegraded":"2024-04-25T09:02:57.790365+0000","last_fullsized":"2024-04-25T09:02:57.790365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:10.988897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789527+0000","last_change":"2024-04-25T09:02:52.025371+0000","last_active":"2024-04-25T09:02:57.789527+0000","last_peered":"2024-04-25T09:02:57.789527+0000","last_clean":"2024-04-25T09:02:57.789527+0000","last_became_active":"2024-04-25T09:02:52.024320+0000","last_became_peered":"2024-04-25T09:02:52.024320+0000","last_unstale":"2024-04-25T09:02:57.789527+0000","last_undegraded":"2024-04-25T09:02:57.789527+0000","last_fullsized":"2024-04-25T09:02:57.789527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:19.358216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053569+0000","last_change":"2024-04-25T09:02:52.033835+0000","last_active":"2024-04-25T09:02:57.053569+0000","last_peered":"2024-04-25T09:02:57.053569+0000","last_clean":"2024-04-25T09:02:57.053569+0000","last_became_active":"2024-04-25T09:02:52.033530+0000","last_became_peered":"2024-04-25T09:02:52.033530+0000","last_unstale":"2024-04-25T09:02:57.053569+0000","last_undegraded":"2024-04-25T09:02:57.053569+0000","last_fullsized":"2024-04-25T09:02:57.053569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:07.517265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057290+0000","last_change":"2024-04-25T09:02:52.027796+0000","last_active":"2024-04-25T09:02:57.057290+0000","last_peered":"2024-04-25T09:02:57.057290+0000","last_clean":"2024-04-25T09:02:57.057290+0000","last_became_active":"2024-04-25T09:02:52.027441+0000","last_became_peered":"2024-04-25T09:02:52.027441+0000","last_unstale":"2024-04-25T09:02:57.057290+0000","last_undegraded":"2024-04-25T09:02:57.057290+0000","last_fullsized":"2024-04-25T09:02:57.057290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:41.693114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056467+0000","last_change":"2024-04-25T09:02:52.051744+0000","last_active":"2024-04-25T09:02:57.056467+0000","last_peered":"2024-04-25T09:02:57.056467+0000","last_clean":"2024-04-25T09:02:57.056467+0000","last_became_active":"2024-04-25T09:02:52.051453+0000","last_became_peered":"2024-04-25T09:02:52.051453+0000","last_unstale":"2024-04-25T09:02:57.056467+0000","last_undegraded":"2024-04-25T09:02:57.056467+0000","last_fullsized":"2024-04-25T09:02:57.056467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:18.635634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057266+0000","last_change":"2024-04-25T09:02:52.051875+0000","last_active":"2024-04-25T09:02:57.057266+0000","last_peered":"2024-04-25T09:02:57.057266+0000","last_clean":"2024-04-25T09:02:57.057266+0000","last_became_active":"2024-04-25T09:02:52.051621+0000","last_became_peered":"2024-04-25T09:02:52.051621+0000","last_unstale":"2024-04-25T09:02:57.057266+0000","last_undegraded":"2024-04-25T09:02:57.057266+0000","last_fullsized":"2024-04-25T09:02:57.057266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:52.428184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.464024+0000","last_change":"2024-04-25T09:02:52.058460+0000","last_active":"2024-04-25T09:02:57.464024+0000","last_peered":"2024-04-25T09:02:57.464024+0000","last_clean":"2024-04-25T09:02:57.464024+0000","last_became_active":"2024-04-25T09:02:52.058164+0000","last_became_peered":"2024-04-25T09:02:52.058164+0000","last_unstale":"2024-04-25T09:02:57.464024+0000","last_undegraded":"2024-04-25T09:02:57.464024+0000","last_fullsized":"2024-04-25T09:02:57.464024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:07.843292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053224+0000","last_change":"2024-04-25T09:02:52.044000+0000","last_active":"2024-04-25T09:02:57.053224+0000","last_peered":"2024-04-25T09:02:57.053224+0000","last_clean":"2024-04-25T09:02:57.053224+0000","last_became_active":"2024-04-25T09:02:52.042814+0000","last_became_peered":"2024-04-25T09:02:52.042814+0000","last_unstale":"2024-04-25T09:02:57.053224+0000","last_undegraded":"2024-04-25T09:02:57.053224+0000","last_fullsized":"2024-04-25T09:02:57.053224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:12.756335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463194+0000","last_change":"2024-04-25T09:02:52.044961+0000","last_active":"2024-04-25T09:02:57.463194+0000","last_peered":"2024-04-25T09:02:57.463194+0000","last_clean":"2024-04-25T09:02:57.463194+0000","last_became_active":"2024-04-25T09:02:52.044611+0000","last_became_peered":"2024-04-25T09:02:52.044611+0000","last_unstale":"2024-04-25T09:02:57.463194+0000","last_undegraded":"2024-04-25T09:02:57.463194+0000","last_fullsized":"2024-04-25T09:02:57.463194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:07.517265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789201+0000","last_change":"2024-04-25T09:02:52.043640+0000","last_active":"2024-04-25T09:02:57.789201+0000","last_peered":"2024-04-25T09:02:57.789201+0000","last_clean":"2024-04-25T09:02:57.789201+0000","last_became_active":"2024-04-25T09:02:52.039228+0000","last_became_peered":"2024-04-25T09:02:52.039228+0000","last_unstale":"2024-04-25T09:02:57.789201+0000","last_undegraded":"2024-04-25T09:02:57.789201+0000","last_fullsized":"2024-04-25T09:02:57.789201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:35.283398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463393+0000","last_change":"2024-04-25T09:02:52.045074+0000","last_active":"2024-04-25T09:02:57.463393+0000","last_peered":"2024-04-25T09:02:57.463393+0000","last_clean":"2024-04-25T09:02:57.463393+0000","last_became_active":"2024-04-25T09:02:52.044803+0000","last_became_peered":"2024-04-25T09:02:52.044803+0000","last_unstale":"2024-04-25T09:02:57.463393+0000","last_undegraded":"2024-04-25T09:02:57.463393+0000","last_fullsized":"2024-04-25T09:02:57.463393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:45.007626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789370+0000","last_change":"2024-04-25T09:02:52.044897+0000","last_active":"2024-04-25T09:02:57.789370+0000","last_peered":"2024-04-25T09:02:57.789370+0000","last_clean":"2024-04-25T09:02:57.789370+0000","last_became_active":"2024-04-25T09:02:52.044582+0000","last_became_peered":"2024-04-25T09:02:52.044582+0000","last_unstale":"2024-04-25T09:02:57.789370+0000","last_undegraded":"2024-04-25T09:02:57.789370+0000","last_fullsized":"2024-04-25T09:02:57.789370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:52.428184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790225+0000","last_change":"2024-04-25T09:02:52.026796+0000","last_active":"2024-04-25T09:02:57.790225+0000","last_peered":"2024-04-25T09:02:57.790225+0000","last_clean":"2024-04-25T09:02:57.790225+0000","last_became_active":"2024-04-25T09:02:52.026522+0000","last_became_peered":"2024-04-25T09:02:52.026522+0000","last_unstale":"2024-04-25T09:02:57.790225+0000","last_undegraded":"2024-04-25T09:02:57.790225+0000","last_fullsized":"2024-04-25T09:02:57.790225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:29.446381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791477+0000","last_change":"2024-04-25T09:02:52.016990+0000","last_active":"2024-04-25T09:02:57.791477+0000","last_peered":"2024-04-25T09:02:57.791477+0000","last_clean":"2024-04-25T09:02:57.791477+0000","last_became_active":"2024-04-25T09:02:52.015451+0000","last_became_peered":"2024-04-25T09:02:52.015451+0000","last_unstale":"2024-04-25T09:02:57.791477+0000","last_undegraded":"2024-04-25T09:02:57.791477+0000","last_fullsized":"2024-04-25T09:02:57.791477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:00.242892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463935+0000","last_change":"2024-04-25T09:02:52.050256+0000","last_active":"2024-04-25T09:02:57.463935+0000","last_peered":"2024-04-25T09:02:57.463935+0000","last_clean":"2024-04-25T09:02:57.463935+0000","last_became_active":"2024-04-25T09:02:52.049994+0000","last_became_peered":"2024-04-25T09:02:52.049994+0000","last_unstale":"2024-04-25T09:02:57.463935+0000","last_undegraded":"2024-04-25T09:02:57.463935+0000","last_fullsized":"2024-04-25T09:02:57.463935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:26.331238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":106528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":106402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":697408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":697352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:03:10.532 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:03:10.532 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T09:03:10.532 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T09:03:10.532 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T09:03:10.533 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T09:03:10.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.714+0000 7fddd9200640 1 Processor -- start 2024-04-25T09:03:10.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.714+0000 7fddd9200640 1 -- start start 2024-04-25T09:03:10.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.718+0000 7fddd9200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd40d1ec0 0x7fddd4161b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:10.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.718+0000 7fddd9200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fddd40cce20 0x7fddd4162040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:10.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.718+0000 7fddd9200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd40cc080 con 0x7fddd41583f0 2024-04-25T09:03:10.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.718+0000 7fddd9200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd4162870 con 0x7fddd40cce20 2024-04-25T09:03:10.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.718+0000 7fddd9200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40cc340 con 0x7fddd40d1ec0 2024-04-25T09:03:10.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.718+0000 7fddd1e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fddd41583f0 0x7fddd40d17b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60496/0 (socket says 172.21.15.173:60496) 2024-04-25T09:03:10.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.718+0000 7fddd1e00640 1 -- 172.21.15.173:0/459142816 learned_addr learned my addr 172.21.15.173:0/459142816 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:10.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.718+0000 7fddd2800640 1 --2- 172.21.15.173:0/459142816 >> v2:172.21.15.194:3300/0 conn(0x7fddd40cce20 0x7fddd4162040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:10.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.718+0000 7fddd1400640 1 --2- 172.21.15.173:0/459142816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd40d1ec0 0x7fddd4161b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:10.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.718+0000 7fddd0a00640 1 -- 172.21.15.173:0/459142816 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312145522 0 0) 0x7fddd40cc080 con 0x7fddd41583f0 2024-04-25T09:03:10.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.718+0000 7fddd0a00640 1 -- 172.21.15.173:0/459142816 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddb8003530 con 0x7fddd41583f0 2024-04-25T09:03:10.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.718+0000 7fddd2800640 1 -- 172.21.15.173:0/459142816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd40d1ec0 msgr2=0x7fddd4161b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:10.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.718+0000 7fddd2800640 1 --2- 172.21.15.173:0/459142816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd40d1ec0 0x7fddd4161b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.718+0000 7fddd2800640 1 -- 172.21.15.173:0/459142816 >> v1:172.21.15.173:6789/0 conn(0x7fddd41583f0 legacy=0x7fddd40d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:10.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.718+0000 7fddd2800640 1 -- 172.21.15.173:0/459142816 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd40cc620 con 0x7fddd40cce20 2024-04-25T09:03:10.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.722+0000 7fddd2800640 1 --2- 172.21.15.173:0/459142816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd40cce20 0x7fddd4162040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009d90 tx=0x7fddcc01c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8efd15dc575a8574 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:10.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.722+0000 7fddd0a00640 1 -- 172.21.15.173:0/459142816 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc0b2070 con 0x7fddd40cce20 2024-04-25T09:03:10.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.722+0000 7fddd0a00640 1 -- 172.21.15.173:0/459142816 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc0a5950 con 0x7fddd40cce20 2024-04-25T09:03:10.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.722+0000 7fddd0a00640 1 -- 172.21.15.173:0/459142816 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc0a5d20 con 0x7fddd40cce20 2024-04-25T09:03:10.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.722+0000 7fddd9200640 1 -- 172.21.15.173:0/459142816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd40cce20 msgr2=0x7fddd4162040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:10.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.722+0000 7fddd9200640 1 --2- 172.21.15.173:0/459142816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd40cce20 0x7fddd4162040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009d90 tx=0x7fddcc01c8b0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.722+0000 7fddd9200640 1 -- 172.21.15.173:0/459142816 shutdown_connections 2024-04-25T09:03:10.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.722+0000 7fddd9200640 1 --2- 172.21.15.173:0/459142816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd40cce20 0x7fddd4162040 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.722+0000 7fddd9200640 1 --2- 172.21.15.173:0/459142816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd40d1ec0 0x7fddd4161b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.722+0000 7fddd9200640 1 -- 172.21.15.173:0/459142816 >> 172.21.15.173:0/459142816 conn(0x7fddd406f600 msgr2=0x7fddd406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:10.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.722+0000 7fddd9200640 1 -- 172.21.15.173:0/459142816 shutdown_connections 2024-04-25T09:03:10.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.722+0000 7fddd9200640 1 -- 172.21.15.173:0/459142816 wait complete. 2024-04-25T09:03:10.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.722+0000 7fddd9200640 1 Processor -- start 2024-04-25T09:03:10.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.722+0000 7fddd9200640 1 -- start start 2024-04-25T09:03:10.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd9200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd40cce20 0x7fddd414b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:10.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd9200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd40d1ec0 0x7fddd414b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:10.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd9200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd41583f0 0x7fddd40b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:10.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd9200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40cea70 con 0x7fddd40cce20 2024-04-25T09:03:10.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd9200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40ce8f0 con 0x7fddd40d1ec0 2024-04-25T09:03:10.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd9200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40cebf0 con 0x7fddd41583f0 2024-04-25T09:03:10.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd1e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd40cce20 0x7fddd414b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:10.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd1e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd40cce20 0x7fddd414b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:32986/0 (socket says 172.21.15.173:32986) 2024-04-25T09:03:10.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd1e00640 1 -- 172.21.15.173:0/1324496957 learned_addr learned my addr 172.21.15.173:0/1324496957 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:10.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd1400640 1 --2- 172.21.15.173:0/1324496957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd40d1ec0 0x7fddd414b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:10.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd2800640 1 --2- 172.21.15.173:0/1324496957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd41583f0 0x7fddd40b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:10.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd1e00640 1 -- 172.21.15.173:0/1324496957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd41583f0 msgr2=0x7fddd40b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:10.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd1e00640 1 --2- 172.21.15.173:0/1324496957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd41583f0 0x7fddd40b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd1e00640 1 -- 172.21.15.173:0/1324496957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd40d1ec0 msgr2=0x7fddd414b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:10.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd1e00640 1 --2- 172.21.15.173:0/1324496957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd40d1ec0 0x7fddd414b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd1e00640 1 -- 172.21.15.173:0/1324496957 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd4154ad0 con 0x7fddd40cce20 2024-04-25T09:03:10.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd1e00640 1 --2- 172.21.15.173:0/1324496957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd40cce20 0x7fddd414b370 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fddc400c3c0 tx=0x7fddc400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:10.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddca000640 1 -- 172.21.15.173:0/1324496957 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4017070 con 0x7fddd40cce20 2024-04-25T09:03:10.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddca000640 1 -- 172.21.15.173:0/1324496957 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc4005cf0 con 0x7fddd40cce20 2024-04-25T09:03:10.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd9200640 1 -- 172.21.15.173:0/1324496957 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd4154db0 con 0x7fddd40cce20 2024-04-25T09:03:10.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddca000640 1 -- 172.21.15.173:0/1324496957 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc40072f0 con 0x7fddd40cce20 2024-04-25T09:03:10.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd9200640 1 -- 172.21.15.173:0/1324496957 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd40b49c0 con 0x7fddd40cce20 2024-04-25T09:03:10.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddd9200640 1 -- 172.21.15.173:0/1324496957 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd4073a40 con 0x7fddd40cce20 2024-04-25T09:03:10.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.726+0000 7fddca000640 1 -- 172.21.15.173:0/1324496957 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fddc401a070 con 0x7fddd40cce20 2024-04-25T09:03:10.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.730+0000 7fddca000640 1 --2- 172.21.15.173:0/1324496957 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fddb4066f60 0x7fddb4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:10.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.730+0000 7fddca000640 1 -- 172.21.15.173:0/1324496957 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fddc4084760 con 0x7fddd40cce20 2024-04-25T09:03:10.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.730+0000 7fddd1400640 1 --2- 172.21.15.173:0/1324496957 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fddb4066f60 0x7fddb4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:10.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.730+0000 7fddd1400640 1 --2- 172.21.15.173:0/1324496957 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fddb4066f60 0x7fddb4069420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fddd4161f50 tx=0x7fddc0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:10.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.734+0000 7fddca000640 1 -- 172.21.15.173:0/1324496957 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fddc4054d40 con 0x7fddd40cce20 2024-04-25T09:03:10.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.922+0000 7fddd9200640 1 -- 172.21.15.173:0/1324496957 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fddd40cfb60 con 0x7fddd40cce20 2024-04-25T09:03:10.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.926+0000 7fddca000640 1 -- 172.21.15.173:0/1324496957 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+165739 (secure 0 0 0) 0x7fddc4058de0 con 0x7fddd40cce20 2024-04-25T09:03:10.918 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:10.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.930+0000 7fddd9200640 1 -- 172.21.15.173:0/1324496957 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fddb4066f60 msgr2=0x7fddb4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:10.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.930+0000 7fddd9200640 1 --2- 172.21.15.173:0/1324496957 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fddb4066f60 0x7fddb4069420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fddd4161f50 tx=0x7fddc0009190 comp rx=0 tx=0).stop 2024-04-25T09:03:10.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.930+0000 7fddd9200640 1 -- 172.21.15.173:0/1324496957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd40cce20 msgr2=0x7fddd414b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:10.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.930+0000 7fddd9200640 1 --2- 172.21.15.173:0/1324496957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd40cce20 0x7fddd414b370 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fddc400c3c0 tx=0x7fddc400c880 comp rx=0 tx=0).stop 2024-04-25T09:03:10.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.930+0000 7fddd9200640 1 -- 172.21.15.173:0/1324496957 shutdown_connections 2024-04-25T09:03:10.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.930+0000 7fddd9200640 1 --2- 172.21.15.173:0/1324496957 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fddb4066f60 0x7fddb4069420 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.930+0000 7fddd9200640 1 --2- 172.21.15.173:0/1324496957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd41583f0 0x7fddd40b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.930+0000 7fddd9200640 1 --2- 172.21.15.173:0/1324496957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd40d1ec0 0x7fddd414b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.930+0000 7fddd9200640 1 --2- 172.21.15.173:0/1324496957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd40cce20 0x7fddd414b370 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:10.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.930+0000 7fddd9200640 1 -- 172.21.15.173:0/1324496957 >> 172.21.15.173:0/1324496957 conn(0x7fddd406f600 msgr2=0x7fddd40b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:10.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.930+0000 7fddd9200640 1 -- 172.21.15.173:0/1324496957 shutdown_connections 2024-04-25T09:03:10.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:10.930+0000 7fddd9200640 1 -- 172.21.15.173:0/1324496957 wait complete. 2024-04-25T09:03:10.938 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":2040182084},{"type":"v1","addr":"172.21.15.173:6833","nonce":2040182084}]},"active_addr":"172.21.15.173:6833/2040182084","active_change":"2024-04-25T09:02:30.711737+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":2714736729}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":666516384}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":4118727968}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":3902734757}]}]} 2024-04-25T09:03:10.941 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T09:03:10.941 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T09:03:10.941 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:11.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.086+0000 7f381cc00640 1 Processor -- start 2024-04-25T09:03:11.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.086+0000 7f381cc00640 1 -- start start 2024-04-25T09:03:11.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.090+0000 7f381cc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f38180cf6c0 0x7f38180cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.090+0000 7f381cc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f38180c7d20 0x7f38180cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.090+0000 7f381cc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38180cd1b0 con 0x7f38180ccc60 2024-04-25T09:03:11.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.090+0000 7f381cc00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38180d0520 con 0x7f38180c7d20 2024-04-25T09:03:11.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.090+0000 7f381cc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38180c5230 con 0x7f38180cf6c0 2024-04-25T09:03:11.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.090+0000 7f3816a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f38180c7d20 0x7f38180cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.090+0000 7f3816a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f38180c7d20 0x7f38180cffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33002/0 (socket says 172.21.15.173:33002) 2024-04-25T09:03:11.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.090+0000 7f3816a00640 1 -- 172.21.15.173:0/2965207110 learned_addr learned my addr 172.21.15.173:0/2965207110 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:11.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.090+0000 7f3817400640 1 --2- 172.21.15.173:0/2965207110 >> v2:172.21.15.194:3300/0 conn(0x7f38180cf6c0 0x7f38180cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.090+0000 7f3816a00640 1 -- 172.21.15.173:0/2965207110 >> v2:172.21.15.194:3300/0 conn(0x7f38180cf6c0 msgr2=0x7f38180cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:11.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.090+0000 7f3816a00640 1 --2- 172.21.15.173:0/2965207110 >> v2:172.21.15.194:3300/0 conn(0x7f38180cf6c0 0x7f38180cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.090+0000 7f3816a00640 1 -- 172.21.15.173:0/2965207110 >> v1:172.21.15.194:6789/0 conn(0x7f38180ccc60 legacy=0x7f3818099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:11.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.090+0000 7f3816a00640 1 -- 172.21.15.173:0/2965207110 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38180c5510 con 0x7f38180c7d20 2024-04-25T09:03:11.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.090+0000 7f3817400640 1 --2- 172.21.15.173:0/2965207110 >> v2:172.21.15.194:3300/0 conn(0x7f38180cf6c0 0x7f38180cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:11.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.090+0000 7f3816a00640 1 --2- 172.21.15.173:0/2965207110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38180c7d20 0x7f38180cffe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3818072200 tx=0x7f380801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a4e6396d7b5898 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.090+0000 7f3816000640 1 -- 172.21.15.173:0/2965207110 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38080b0070 con 0x7f38180c7d20 2024-04-25T09:03:11.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f3816000640 1 -- 172.21.15.173:0/2965207110 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38080ab600 con 0x7f38180c7d20 2024-04-25T09:03:11.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f3816000640 1 -- 172.21.15.173:0/2965207110 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38080ab9d0 con 0x7f38180c7d20 2024-04-25T09:03:11.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f381cc00640 1 -- 172.21.15.173:0/2965207110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38180c7d20 msgr2=0x7f38180cffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f381cc00640 1 --2- 172.21.15.173:0/2965207110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38180c7d20 0x7f38180cffe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3818072200 tx=0x7f380801c4b0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f381cc00640 1 -- 172.21.15.173:0/2965207110 shutdown_connections 2024-04-25T09:03:11.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f381cc00640 1 --2- 172.21.15.173:0/2965207110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38180c7d20 0x7f38180cffe0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f381cc00640 1 --2- 172.21.15.173:0/2965207110 >> v2:172.21.15.194:3300/0 conn(0x7f38180cf6c0 0x7f38180cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f381cc00640 1 -- 172.21.15.173:0/2965207110 >> 172.21.15.173:0/2965207110 conn(0x7f38180b3130 msgr2=0x7f38180b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f381cc00640 1 -- 172.21.15.173:0/2965207110 shutdown_connections 2024-04-25T09:03:11.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f381cc00640 1 -- 172.21.15.173:0/2965207110 wait complete. 2024-04-25T09:03:11.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f381cc00640 1 Processor -- start 2024-04-25T09:03:11.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f381cc00640 1 -- start start 2024-04-25T09:03:11.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f381cc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38180c7d20 0x7f38181568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f381cc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38180ccc60 0x7f38180cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f381cc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38180cf6c0 0x7f3818070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f381cc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180cf4b0 con 0x7f38180cf6c0 2024-04-25T09:03:11.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f381cc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180cf330 con 0x7f38180ccc60 2024-04-25T09:03:11.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f381cc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3818168410 con 0x7f38180c7d20 2024-04-25T09:03:11.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f3817e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38180cf6c0 0x7f3818070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f3817e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38180cf6c0 0x7f3818070010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33012/0 (socket says 172.21.15.173:33012) 2024-04-25T09:03:11.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f3817e00640 1 -- 172.21.15.173:0/366146199 learned_addr learned my addr 172.21.15.173:0/366146199 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:11.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f3817400640 1 --2- 172.21.15.173:0/366146199 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38180c7d20 0x7f38181568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f3816a00640 1 --2- 172.21.15.173:0/366146199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38180ccc60 0x7f38180cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f3817e00640 1 -- 172.21.15.173:0/366146199 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38180c7d20 msgr2=0x7f38181568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f3817e00640 1 --2- 172.21.15.173:0/366146199 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38180c7d20 0x7f38181568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f3817e00640 1 -- 172.21.15.173:0/366146199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38180ccc60 msgr2=0x7f38180cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f3817e00640 1 --2- 172.21.15.173:0/366146199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38180ccc60 0x7f38180cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.094+0000 7f3817e00640 1 -- 172.21.15.173:0/366146199 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3818157c70 con 0x7f38180cf6c0 2024-04-25T09:03:11.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.098+0000 7f3817e00640 1 --2- 172.21.15.173:0/366146199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38180cf6c0 0x7f3818070010 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f381000b9c0 tx=0x7f381000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.098+0000 7f380f400640 1 -- 172.21.15.173:0/366146199 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810019070 con 0x7f38180cf6c0 2024-04-25T09:03:11.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.098+0000 7f380f400640 1 -- 172.21.15.173:0/366146199 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381000cba0 con 0x7f38180cf6c0 2024-04-25T09:03:11.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.098+0000 7f381cc00640 1 -- 172.21.15.173:0/366146199 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3818156e10 con 0x7f38180cf6c0 2024-04-25T09:03:11.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.098+0000 7f380f400640 1 -- 172.21.15.173:0/366146199 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810014440 con 0x7f38180cf6c0 2024-04-25T09:03:11.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.098+0000 7f381cc00640 1 -- 172.21.15.173:0/366146199 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38180cb960 con 0x7f38180cf6c0 2024-04-25T09:03:11.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.098+0000 7f381cc00640 1 -- 172.21.15.173:0/366146199 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3818073a40 con 0x7f38180cf6c0 2024-04-25T09:03:11.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.098+0000 7f380f400640 1 -- 172.21.15.173:0/366146199 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3810003980 con 0x7f38180cf6c0 2024-04-25T09:03:11.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.098+0000 7f380f400640 1 --2- 172.21.15.173:0/366146199 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f37f4066f90 0x7f37f4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.098+0000 7f380f400640 1 -- 172.21.15.173:0/366146199 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3810084ee0 con 0x7f38180cf6c0 2024-04-25T09:03:11.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.098+0000 7f3817400640 1 --2- 172.21.15.173:0/366146199 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f37f4066f90 0x7f37f4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.102+0000 7f3817400640 1 --2- 172.21.15.173:0/366146199 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f37f4066f90 0x7f37f4069450 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3818159b90 tx=0x7f3800008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.102+0000 7f380f400640 1 -- 172.21.15.173:0/366146199 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3810003c70 con 0x7f38180cf6c0 2024-04-25T09:03:11.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.262+0000 7f381cc00640 1 -- 172.21.15.173:0/366146199 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f381806d260 con 0x7f38180cf6c0 2024-04-25T09:03:11.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.262+0000 7f380f400640 1 -- 172.21.15.173:0/366146199 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18574 (secure 0 0 0) 0x7f3810055550 con 0x7f38180cf6c0 2024-04-25T09:03:11.251 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:11.252 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:56.440593+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:11.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.262+0000 7f381cc00640 1 -- 172.21.15.173:0/366146199 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f37f4066f90 msgr2=0x7f37f4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.262+0000 7f381cc00640 1 --2- 172.21.15.173:0/366146199 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f37f4066f90 0x7f37f4069450 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3818159b90 tx=0x7f3800008040 comp rx=0 tx=0).stop 2024-04-25T09:03:11.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.262+0000 7f381cc00640 1 -- 172.21.15.173:0/366146199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38180cf6c0 msgr2=0x7f3818070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.262+0000 7f381cc00640 1 --2- 172.21.15.173:0/366146199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38180cf6c0 0x7f3818070010 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f381000b9c0 tx=0x7f381000be80 comp rx=0 tx=0).stop 2024-04-25T09:03:11.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.262+0000 7f381cc00640 1 -- 172.21.15.173:0/366146199 shutdown_connections 2024-04-25T09:03:11.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.262+0000 7f381cc00640 1 --2- 172.21.15.173:0/366146199 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f37f4066f90 0x7f37f4069450 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.262+0000 7f381cc00640 1 --2- 172.21.15.173:0/366146199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38180cf6c0 0x7f3818070010 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.262+0000 7f381cc00640 1 --2- 172.21.15.173:0/366146199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38180ccc60 0x7f38180cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.262+0000 7f381cc00640 1 --2- 172.21.15.173:0/366146199 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38180c7d20 0x7f38181568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.262+0000 7f381cc00640 1 -- 172.21.15.173:0/366146199 >> 172.21.15.173:0/366146199 conn(0x7f38180b3130 msgr2=0x7f38180cfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.266+0000 7f381cc00640 1 -- 172.21.15.173:0/366146199 shutdown_connections 2024-04-25T09:03:11.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.266+0000 7f381cc00640 1 -- 172.21.15.173:0/366146199 wait complete. 2024-04-25T09:03:11.273 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T09:03:11.273 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:11.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.418+0000 7f681a000640 1 Processor -- start 2024-04-25T09:03:11.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.418+0000 7f681a000640 1 -- start start 2024-04-25T09:03:11.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.422+0000 7f681a000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f68140b3e70 0x7f68140b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.422+0000 7f681a000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f68140aefa0 0x7f68140b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.422+0000 7f681a000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68140b4790 con 0x7f681415edd0 2024-04-25T09:03:11.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.422+0000 7f681a000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f681406dd50 con 0x7f68140aefa0 2024-04-25T09:03:11.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.422+0000 7f681a000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f681415f320 con 0x7f68140b3e70 2024-04-25T09:03:11.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.422+0000 7f6812a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f68140aefa0 0x7f68140b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.422+0000 7f6812a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f68140aefa0 0x7f68140b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33016/0 (socket says 172.21.15.173:33016) 2024-04-25T09:03:11.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.422+0000 7f6812a00640 1 -- 172.21.15.173:0/929869834 learned_addr learned my addr 172.21.15.173:0/929869834 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:11.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.422+0000 7f6813400640 1 --2- 172.21.15.173:0/929869834 >> v2:172.21.15.194:3300/0 conn(0x7f68140b3e70 0x7f68140b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.422+0000 7f6812a00640 1 -- 172.21.15.173:0/929869834 >> v2:172.21.15.194:3300/0 conn(0x7f68140b3e70 msgr2=0x7f68140b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:11.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.422+0000 7f6812a00640 1 --2- 172.21.15.173:0/929869834 >> v2:172.21.15.194:3300/0 conn(0x7f68140b3e70 0x7f68140b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.422+0000 7f6812a00640 1 -- 172.21.15.173:0/929869834 >> v1:172.21.15.194:6789/0 conn(0x7f681415edd0 legacy=0x7f68140b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:11.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.422+0000 7f6812a00640 1 -- 172.21.15.173:0/929869834 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681406d420 con 0x7f68140aefa0 2024-04-25T09:03:11.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.426+0000 7f6812a00640 1 --2- 172.21.15.173:0/929869834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68140aefa0 0x7f68140b2770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f681406bca0 tx=0x7f680001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8d9c4a81e9ad00 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.426+0000 7f6812000640 1 -- 172.21.15.173:0/929869834 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000aa430 con 0x7f68140aefa0 2024-04-25T09:03:11.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.426+0000 7f6812000640 1 -- 172.21.15.173:0/929869834 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68000af070 con 0x7f68140aefa0 2024-04-25T09:03:11.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.426+0000 7f6812000640 1 -- 172.21.15.173:0/929869834 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000aa7f0 con 0x7f68140aefa0 2024-04-25T09:03:11.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.426+0000 7f681a000640 1 -- 172.21.15.173:0/929869834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68140aefa0 msgr2=0x7f68140b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.426+0000 7f681a000640 1 --2- 172.21.15.173:0/929869834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68140aefa0 0x7f68140b2770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f681406bca0 tx=0x7f680001c4b0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.426+0000 7f681a000640 1 -- 172.21.15.173:0/929869834 shutdown_connections 2024-04-25T09:03:11.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.426+0000 7f681a000640 1 --2- 172.21.15.173:0/929869834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68140aefa0 0x7f68140b2770 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.426+0000 7f681a000640 1 --2- 172.21.15.173:0/929869834 >> v2:172.21.15.194:3300/0 conn(0x7f68140b3e70 0x7f68140b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.426+0000 7f681a000640 1 -- 172.21.15.173:0/929869834 >> 172.21.15.173:0/929869834 conn(0x7f681406ac90 msgr2=0x7f681406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.426+0000 7f681a000640 1 -- 172.21.15.173:0/929869834 shutdown_connections 2024-04-25T09:03:11.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.426+0000 7f681a000640 1 -- 172.21.15.173:0/929869834 wait complete. 2024-04-25T09:03:11.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.426+0000 7f681a000640 1 Processor -- start 2024-04-25T09:03:11.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.426+0000 7f681a000640 1 -- start start 2024-04-25T09:03:11.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.426+0000 7f681a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68140aefa0 0x7f681415d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.426+0000 7f681a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68140b3e70 0x7f681413d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.426+0000 7f681a000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f681415edd0 0x7f681414add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f681a000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681406e1c0 con 0x7f68140b3e70 2024-04-25T09:03:11.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f681a000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681415aba0 con 0x7f681415edd0 2024-04-25T09:03:11.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f681a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681406e340 con 0x7f68140aefa0 2024-04-25T09:03:11.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f6812a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68140b3e70 0x7f681413d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f6812a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68140b3e70 0x7f681413d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33026/0 (socket says 172.21.15.173:33026) 2024-04-25T09:03:11.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f6812a00640 1 -- 172.21.15.173:0/4167272675 learned_addr learned my addr 172.21.15.173:0/4167272675 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:11.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f6813400640 1 --2- 172.21.15.173:0/4167272675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68140aefa0 0x7f681415d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f6813e00640 1 --2- 172.21.15.173:0/4167272675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f681415edd0 0x7f681414add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f6812a00640 1 -- 172.21.15.173:0/4167272675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68140aefa0 msgr2=0x7f681415d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f6812a00640 1 --2- 172.21.15.173:0/4167272675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68140aefa0 0x7f681415d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f6812a00640 1 -- 172.21.15.173:0/4167272675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f681415edd0 msgr2=0x7f681414add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f6812a00640 1 --2- 172.21.15.173:0/4167272675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f681415edd0 0x7f681414add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f6812a00640 1 -- 172.21.15.173:0/4167272675 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6814149d30 con 0x7f68140b3e70 2024-04-25T09:03:11.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f6813e00640 1 --2- 172.21.15.173:0/4167272675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f681415edd0 0x7f681414add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:11.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f6812a00640 1 --2- 172.21.15.173:0/4167272675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68140b3e70 0x7f681413d160 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f68000ac040 tx=0x7f680001acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f680b400640 1 -- 172.21.15.173:0/4167272675 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000bd5f0 con 0x7f68140b3e70 2024-04-25T09:03:11.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f680b400640 1 -- 172.21.15.173:0/4167272675 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68000bd790 con 0x7f68140b3e70 2024-04-25T09:03:11.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f680b400640 1 -- 172.21.15.173:0/4167272675 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000bdb80 con 0x7f68140b3e70 2024-04-25T09:03:11.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f681a000640 1 -- 172.21.15.173:0/4167272675 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f681414a010 con 0x7f68140b3e70 2024-04-25T09:03:11.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f681a000640 1 -- 172.21.15.173:0/4167272675 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f681414a5d0 con 0x7f68140b3e70 2024-04-25T09:03:11.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f681a000640 1 -- 172.21.15.173:0/4167272675 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6814073a40 con 0x7f68140b3e70 2024-04-25T09:03:11.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f680b400640 1 -- 172.21.15.173:0/4167272675 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f68000b33f0 con 0x7f68140b3e70 2024-04-25T09:03:11.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.430+0000 7f680b400640 1 --2- 172.21.15.173:0/4167272675 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f67f4066f60 0x7f67f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.434+0000 7f680b400640 1 -- 172.21.15.173:0/4167272675 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f680011f9c0 con 0x7f68140b3e70 2024-04-25T09:03:11.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.434+0000 7f6813400640 1 --2- 172.21.15.173:0/4167272675 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f67f4066f60 0x7f67f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.434+0000 7f6813400640 1 --2- 172.21.15.173:0/4167272675 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f67f4066f60 0x7f67f4069420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6804003ab0 tx=0x7f6804009830 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.438+0000 7f680b400640 1 -- 172.21.15.173:0/4167272675 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f68000160d0 con 0x7f68140b3e70 2024-04-25T09:03:11.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.590+0000 7f681a000640 1 -- 172.21.15.173:0/4167272675 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f681406f1c0 con 0x7f68140b3e70 2024-04-25T09:03:11.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.594+0000 7f680b400640 1 -- 172.21.15.173:0/4167272675 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18574 (secure 0 0 0) 0x7f68000f00c0 con 0x7f68140b3e70 2024-04-25T09:03:11.582 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:11.582 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:56.440593+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:11.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.594+0000 7f681a000640 1 -- 172.21.15.173:0/4167272675 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f67f4066f60 msgr2=0x7f67f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.594+0000 7f681a000640 1 --2- 172.21.15.173:0/4167272675 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f67f4066f60 0x7f67f4069420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6804003ab0 tx=0x7f6804009830 comp rx=0 tx=0).stop 2024-04-25T09:03:11.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.594+0000 7f681a000640 1 -- 172.21.15.173:0/4167272675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68140b3e70 msgr2=0x7f681413d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.594+0000 7f681a000640 1 --2- 172.21.15.173:0/4167272675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68140b3e70 0x7f681413d160 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f68000ac040 tx=0x7f680001acf0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.594+0000 7f681a000640 1 -- 172.21.15.173:0/4167272675 shutdown_connections 2024-04-25T09:03:11.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.594+0000 7f681a000640 1 --2- 172.21.15.173:0/4167272675 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f67f4066f60 0x7f67f4069420 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.594+0000 7f681a000640 1 --2- 172.21.15.173:0/4167272675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f681415edd0 0x7f681414add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.594+0000 7f681a000640 1 --2- 172.21.15.173:0/4167272675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68140b3e70 0x7f681413d160 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.594+0000 7f681a000640 1 --2- 172.21.15.173:0/4167272675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68140aefa0 0x7f681415d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.594+0000 7f681a000640 1 -- 172.21.15.173:0/4167272675 >> 172.21.15.173:0/4167272675 conn(0x7f681406ac90 msgr2=0x7f68140b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.594+0000 7f681a000640 1 -- 172.21.15.173:0/4167272675 shutdown_connections 2024-04-25T09:03:11.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.594+0000 7f681a000640 1 -- 172.21.15.173:0/4167272675 wait complete. 2024-04-25T09:03:11.603 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T09:03:11.604 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T09:03:11.604 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T09:03:11.604 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T09:03:11.605 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T09:03:11.605 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T09:03:11.606 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T09:03:11.606 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T09:03:11.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.854+0000 7fafc5800640 1 Processor -- start 2024-04-25T09:03:11.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.854+0000 7fafc5800640 1 -- start start 2024-04-25T09:03:11.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.854+0000 7fafc5800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafc006e4c0 0x7fafc0161d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.854+0000 7fafc5800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fafc0162290 0x7fafc015e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.854+0000 7fafc5800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc0071d30 con 0x7fafc00b0ac0 2024-04-25T09:03:11.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.854+0000 7fafc5800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc006e950 con 0x7fafc0162290 2024-04-25T09:03:11.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.854+0000 7fafc5800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc006ec30 con 0x7fafc006e4c0 2024-04-25T09:03:11.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.854+0000 7fafbfe00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fafc00b0ac0 0x7fafc0071620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:44904/0 (socket says 172.21.15.173:44904) 2024-04-25T09:03:11.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.854+0000 7fafbfe00640 1 -- 172.21.15.173:0/1976489583 learned_addr learned my addr 172.21.15.173:0/1976489583 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:11.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.854+0000 7fafbf400640 1 --2- 172.21.15.173:0/1976489583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafc006e4c0 0x7fafc0161d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.854+0000 7fafc4e00640 1 --2- 172.21.15.173:0/1976489583 >> v2:172.21.15.194:3300/0 conn(0x7fafc0162290 0x7fafc015e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.854+0000 7fafbf400640 1 -- 172.21.15.173:0/1976489583 >> v2:172.21.15.194:3300/0 conn(0x7fafc0162290 msgr2=0x7fafc015e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:11.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.854+0000 7fafbf400640 1 --2- 172.21.15.173:0/1976489583 >> v2:172.21.15.194:3300/0 conn(0x7fafc0162290 0x7fafc015e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.854+0000 7fafbf400640 1 -- 172.21.15.173:0/1976489583 >> v1:172.21.15.194:6789/0 conn(0x7fafc00b0ac0 legacy=0x7fafc0071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.854+0000 7fafbf400640 1 -- 172.21.15.173:0/1976489583 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc006ef10 con 0x7fafc006e4c0 2024-04-25T09:03:11.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.854+0000 7f6eae200640 1 Processor -- start 2024-04-25T09:03:11.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.854+0000 7f6eae200640 1 -- start start 2024-04-25T09:03:11.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.858+0000 7f6eae200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6ea8165630 0x7f6ea8099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.858+0000 7f6eae200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ea80c4dc0 0x7f6ea80cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.858+0000 7f6eae200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea809a2a0 con 0x7f6ea806bda0 2024-04-25T09:03:11.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.858+0000 7f6eae200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea80cf2b0 con 0x7f6ea8165630 2024-04-25T09:03:11.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.858+0000 7f6eae200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea80b1f90 con 0x7f6ea80c4dc0 2024-04-25T09:03:11.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.858+0000 7f6e9fe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f6ea806bda0 0x7f6ea80c46b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60504/0 (socket says 172.21.15.173:60504) 2024-04-25T09:03:11.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.858+0000 7f6e9fe00640 1 -- 172.21.15.173:0/638080313 learned_addr learned my addr 172.21.15.173:0/638080313 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:11.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.858+0000 7f6eace00640 1 --2- 172.21.15.173:0/638080313 >> v2:172.21.15.173:3300/0 conn(0x7f6ea8165630 0x7f6ea8099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.858+0000 7f6ead800640 1 --2- 172.21.15.173:0/638080313 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ea80c4dc0 0x7f6ea80cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.858+0000 7f6eace00640 1 -- 172.21.15.173:0/638080313 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ea80c4dc0 msgr2=0x7f6ea80cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:11.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.858+0000 7f6eace00640 1 --2- 172.21.15.173:0/638080313 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ea80c4dc0 0x7f6ea80cf740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.858+0000 7f6eace00640 1 -- 172.21.15.173:0/638080313 >> v1:172.21.15.173:6789/0 conn(0x7f6ea806bda0 legacy=0x7f6ea80c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.858+0000 7f6eace00640 1 -- 172.21.15.173:0/638080313 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea809a580 con 0x7f6ea8165630 2024-04-25T09:03:11.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.862+0000 7fafbf400640 1 --2- 172.21.15.173:0/1976489583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafc006e4c0 0x7fafc0161d50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fafb00097c0 tx=0x7fafb001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6bf7f795198ce44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.862+0000 7fafbea00640 1 -- 172.21.15.173:0/1976489583 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb00b0070 con 0x7fafc006e4c0 2024-04-25T09:03:11.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.862+0000 7fafbea00640 1 -- 172.21.15.173:0/1976489583 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb00ab600 con 0x7fafc006e4c0 2024-04-25T09:03:11.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.862+0000 7fafbea00640 1 -- 172.21.15.173:0/1976489583 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb00ab9d0 con 0x7fafc006e4c0 2024-04-25T09:03:11.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.862+0000 7f6eace00640 1 --2- 172.21.15.173:0/638080313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ea8165630 0x7f6ea8099a50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6e980097c0 tx=0x7f6e9801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9030ccf4aac813 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.862+0000 7f6ea7e00640 1 -- 172.21.15.173:0/638080313 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e980b2070 con 0x7f6ea8165630 2024-04-25T09:03:11.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7f6ea7e00640 1 -- 172.21.15.173:0/638080313 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e980ad640 con 0x7f6ea8165630 2024-04-25T09:03:11.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7f6ea7e00640 1 -- 172.21.15.173:0/638080313 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e980ada10 con 0x7f6ea8165630 2024-04-25T09:03:11.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7fafc5800640 1 -- 172.21.15.173:0/1976489583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafc006e4c0 msgr2=0x7fafc0161d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7fafc5800640 1 --2- 172.21.15.173:0/1976489583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafc006e4c0 0x7fafc0161d50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fafb00097c0 tx=0x7fafb001c430 comp rx=0 tx=0).stop 2024-04-25T09:03:11.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7fafc5800640 1 -- 172.21.15.173:0/1976489583 shutdown_connections 2024-04-25T09:03:11.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7fafc5800640 1 --2- 172.21.15.173:0/1976489583 >> v2:172.21.15.194:3300/0 conn(0x7fafc0162290 0x7fafc015e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7fafc5800640 1 --2- 172.21.15.173:0/1976489583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafc006e4c0 0x7fafc0161d50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7fafc5800640 1 -- 172.21.15.173:0/1976489583 >> 172.21.15.173:0/1976489583 conn(0x7fafc0061d40 msgr2=0x7fafc006ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7fafc5800640 1 -- 172.21.15.173:0/1976489583 shutdown_connections 2024-04-25T09:03:11.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7fafc5800640 1 -- 172.21.15.173:0/1976489583 wait complete. 2024-04-25T09:03:11.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7f6eae200640 1 -- 172.21.15.173:0/638080313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ea8165630 msgr2=0x7f6ea8099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7f6eae200640 1 --2- 172.21.15.173:0/638080313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ea8165630 0x7f6ea8099a50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6e980097c0 tx=0x7f6e9801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7f014f000640 1 Processor -- start 2024-04-25T09:03:11.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7fd815800640 1 Processor -- start 2024-04-25T09:03:11.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7f014f000640 1 -- start start 2024-04-25T09:03:11.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7fd815800640 1 -- start start 2024-04-25T09:03:11.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7fd815800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd8100adaf0 0x7fd8100b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7fd815800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8100affc0 con 0x7fd81015a9a0 2024-04-25T09:03:11.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7fd815800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8100adfb0 con 0x7fd81006f4b0 2024-04-25T09:03:11.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7fd815800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8100ae290 con 0x7fd8100adaf0 2024-04-25T09:03:11.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7fafc5800640 1 Processor -- start 2024-04-25T09:03:11.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7f6eae200640 1 -- 172.21.15.173:0/638080313 shutdown_connections 2024-04-25T09:03:11.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7f6eae200640 1 --2- 172.21.15.173:0/638080313 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ea80c4dc0 0x7f6ea80cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7f6eae200640 1 --2- 172.21.15.173:0/638080313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ea8165630 0x7f6ea8099a50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7f6eae200640 1 -- 172.21.15.173:0/638080313 >> 172.21.15.173:0/638080313 conn(0x7f6ea80b31d0 msgr2=0x7f6ea80b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7fd814e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fd81006f4b0 0x7fd810164400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:44918/0 (socket says 172.21.15.173:44918) 2024-04-25T09:03:11.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7fd814e00640 1 -- 172.21.15.173:0/1477347223 learned_addr learned my addr 172.21.15.173:0/1477347223 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:11.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7f6eae200640 1 -- 172.21.15.173:0/638080313 shutdown_connections 2024-04-25T09:03:11.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7fafc5800640 1 -- start start 2024-04-25T09:03:11.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7efc14400640 1 Processor -- start 2024-04-25T09:03:11.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80ea00640 1 -- 172.21.15.173:0/1477347223 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429518074 0 0) 0x7fd8100adfb0 con 0x7fd81006f4b0 2024-04-25T09:03:11.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7efc14400640 1 -- start start 2024-04-25T09:03:11.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80f400640 1 --2- 172.21.15.173:0/1477347223 >> v2:172.21.15.194:3300/0 conn(0x7fd8100adaf0 0x7fd8100b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80ea00640 1 -- 172.21.15.173:0/1477347223 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f4003530 con 0x7fd81006f4b0 2024-04-25T09:03:11.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7f014f000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f01480ce4c0 0x7f01480ce930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7f0147e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f0148159880 0x7f014815a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:44934/0 (socket says 172.21.15.173:44934) 2024-04-25T09:03:11.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7f0147e00640 1 -- 172.21.15.173:0/3729814647 learned_addr learned my addr 172.21.15.173:0/3729814647 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:11.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80ea00640 1 -- 172.21.15.173:0/1477347223 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2156159539 0 0) 0x7fd7f4003530 con 0x7fd81006f4b0 2024-04-25T09:03:11.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80ea00640 1 -- 172.21.15.173:0/1477347223 >> v2:172.21.15.194:3300/0 conn(0x7fd8100adaf0 msgr2=0x7fd8100b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:11.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80ea00640 1 --2- 172.21.15.173:0/1477347223 >> v2:172.21.15.194:3300/0 conn(0x7fd8100adaf0 0x7fd8100b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80ea00640 1 -- 172.21.15.173:0/1477347223 >> v1:172.21.15.173:6789/0 conn(0x7fd81015a9a0 legacy=0x7fd8100af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:11.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7f014f000640 1 -- 172.21.15.173:0/3729814647 --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01480cc980 con 0x7f01480cee70 2024-04-25T09:03:11.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7f0147400640 1 --2- 172.21.15.173:0/3729814647 >> v2:172.21.15.194:3300/0 conn(0x7f01480ce4c0 0x7f01480ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fafc5800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafc00b0ac0 0x7fafc0157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fafc5800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafc014db70 0x7fafc00cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fafc5800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafc01fbb50 0x7fafc01542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.866+0000 7f6eae200640 1 -- 172.21.15.173:0/638080313 wait complete. 2024-04-25T09:03:11.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7f6eae200640 1 Processor -- start 2024-04-25T09:03:11.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7efc14400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efc0c15dae0 0x7efc0c0b9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80ea00640 1 -- 172.21.15.173:0/1477347223 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8100ae570 con 0x7fd81006f4b0 2024-04-25T09:03:11.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80ea00640 1 -- 172.21.15.173:0/1477347223 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fd7fc001680 con 0x7fd81006f4b0 2024-04-25T09:03:11.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80ea00640 1 -- 172.21.15.173:0/1477347223 >> v1:172.21.15.194:6789/0 conn(0x7fd81006f4b0 legacy=0x7fd810164400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80ea00640 1 --2- 172.21.15.173:0/1477347223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7f40039c0 0x7fd7f4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80ea00640 1 --2- 172.21.15.173:0/1477347223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7f4004810 0x7fd7f4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80ea00640 1 --2- 172.21.15.173:0/1477347223 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7f40051d0 0x7fd7f400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80ea00640 1 -- 172.21.15.173:0/1477347223 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100ae290 con 0x7fd7f40039c0 2024-04-25T09:03:11.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80ea00640 1 -- 172.21.15.173:0/1477347223 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f400c070 con 0x7fd7f4004810 2024-04-25T09:03:11.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80ea00640 1 -- 172.21.15.173:0/1477347223 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f400c270 con 0x7fd7f40051d0 2024-04-25T09:03:11.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7f014f000640 1 -- 172.21.15.173:0/3729814647 --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01480ccc60 con 0x7f0148159880 2024-04-25T09:03:11.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7f6eae200640 1 -- start start 2024-04-25T09:03:11.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fafbf400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafc014db70 0x7fafc00cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fafbfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafc00b0ac0 0x7fafc0157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fafbfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafc00b0ac0 0x7fafc0157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:56688/0 (socket says 172.21.15.173:56688) 2024-04-25T09:03:11.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fafbf400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafc014db70 0x7fafc00cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:39872/0 (socket says 172.21.15.173:39872) 2024-04-25T09:03:11.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd814e00640 1 --2- 172.21.15.173:0/1477347223 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7f40051d0 0x7fd7f400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7f014f000640 1 -- 172.21.15.173:0/3729814647 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01480cc730 con 0x7f01480ce4c0 2024-04-25T09:03:11.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fafc4e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafc01fbb50 0x7fafc01542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fafc4e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafc01fbb50 0x7fafc01542d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33040/0 (socket says 172.21.15.173:33040) 2024-04-25T09:03:11.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7efc11a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efc0c15dae0 0x7efc0c0b9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7efc11a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efc0c15dae0 0x7efc0c0b9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:56696/0 (socket says 172.21.15.173:56696) 2024-04-25T09:03:11.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7efc11a00640 1 -- 172.21.15.173:0/4158626340 learned_addr learned my addr 172.21.15.173:0/4158626340 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:11.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80fe00640 1 --2- 172.21.15.173:0/1477347223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7f40039c0 0x7fd7f4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7efc14400640 1 --2- 172.21.15.173:0/4158626340 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc0c0cee10 0x7efc0c0d1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80f400640 1 --2- 172.21.15.173:0/1477347223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7f4004810 0x7fd7f4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fafc5800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc016abb0 con 0x7fafc01fbb50 2024-04-25T09:03:11.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fafc5800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc016aa30 con 0x7fafc00b0ac0 2024-04-25T09:03:11.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fafc5800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc016ad30 con 0x7fafc014db70 2024-04-25T09:03:11.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7f0146a00640 1 -- 172.21.15.173:0/3729814647 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052459965 0 0) 0x7f01480ccc60 con 0x7f0148159880 2024-04-25T09:03:11.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7f0146a00640 1 -- 172.21.15.173:0/3729814647 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0130003530 con 0x7f0148159880 2024-04-25T09:03:11.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fafbfe00640 1 -- 172.21.15.173:0/3959448827 learned_addr learned my addr 172.21.15.173:0/3959448827 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:11.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd814e00640 1 -- 172.21.15.173:0/1477347223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7f4004810 msgr2=0x7fd7f4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:11.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd814e00640 1 --2- 172.21.15.173:0/1477347223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7f4004810 0x7fd7f4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd814e00640 1 -- 172.21.15.173:0/1477347223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7f40039c0 msgr2=0x7fd7f4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:11.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd814e00640 1 --2- 172.21.15.173:0/1477347223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7f40039c0 0x7fd7f4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd814e00640 1 -- 172.21.15.173:0/1477347223 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8100ae570 con 0x7fd7f40051d0 2024-04-25T09:03:11.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7fd80f400640 1 --2- 172.21.15.173:0/1477347223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7f4004810 0x7fd7f4004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:11.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7f0147400640 1 -- 172.21.15.173:0/3729814647 >> v1:172.21.15.194:6789/0 conn(0x7f0148159880 legacy=0x7f014815a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7f0147400640 1 -- 172.21.15.173:0/3729814647 >> v1:172.21.15.173:6789/0 conn(0x7f01480cee70 legacy=0x7f014806d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7ff161e00640 1 Processor -- start 2024-04-25T09:03:11.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7efc12400640 1 --2- 172.21.15.173:0/4158626340 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc0c0cee10 0x7efc0c0d1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7f8110c00640 1 Processor -- start 2024-04-25T09:03:11.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.870+0000 7efc14400640 1 -- 172.21.15.173:0/4158626340 --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0c162630 con 0x7efc0c0b2b60 2024-04-25T09:03:11.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7efc14400640 1 -- 172.21.15.173:0/4158626340 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc0c0b9890 con 0x7efc0c15dae0 2024-04-25T09:03:11.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7efc14400640 1 -- 172.21.15.173:0/4158626340 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c161870 con 0x7efc0c0cee10 2024-04-25T09:03:11.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f0147400640 1 -- 172.21.15.173:0/3729814647 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01480ccf40 con 0x7f01480ce4c0 2024-04-25T09:03:11.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7efc0be00640 1 -- 172.21.15.173:0/4158626340 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329990993 0 0) 0x7efc0c162630 con 0x7efc0c0b2b60 2024-04-25T09:03:11.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7efc0be00640 1 -- 172.21.15.173:0/4158626340 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbf4003530 con 0x7efc0c0b2b60 2024-04-25T09:03:11.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f8110c00640 1 -- start start 2024-04-25T09:03:11.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7fafbfe00640 1 -- 172.21.15.173:0/3959448827 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafc014db70 msgr2=0x7fafc00cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7fafbfe00640 1 --2- 172.21.15.173:0/3959448827 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafc014db70 0x7fafc00cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7fafbfe00640 1 -- 172.21.15.173:0/3959448827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafc01fbb50 msgr2=0x7fafc01542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7fafbfe00640 1 --2- 172.21.15.173:0/3959448827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafc01fbb50 0x7fafc01542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7fafbfe00640 1 -- 172.21.15.173:0/3959448827 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc01fb3c0 con 0x7fafc00b0ac0 2024-04-25T09:03:11.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6eae200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ea806bda0 0x7f6ea8161440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7ff161e00640 1 -- start start 2024-04-25T09:03:11.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6eae200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ea80c4dc0 0x7f6ea8161980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7efc0be00640 1 -- 172.21.15.173:0/4158626340 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3797880189 0 0) 0x7efbf4003530 con 0x7efc0c0b2b60 2024-04-25T09:03:11.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7fafbfe00640 1 --2- 172.21.15.173:0/3959448827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafc00b0ac0 0x7fafc0157360 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fafa800c450 tx=0x7fafa800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6eae200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ea8165630 0x7f6ea80af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7efc11a00640 1 -- 172.21.15.173:0/4158626340 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc0c0cee10 msgr2=0x7efc0c0d1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:11.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7efc11a00640 1 --2- 172.21.15.173:0/4158626340 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc0c0cee10 0x7efc0c0d1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7efc11a00640 1 -- 172.21.15.173:0/4158626340 >> v1:172.21.15.194:6789/0 conn(0x7efc0c0b2b60 legacy=0x7efc0c0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6eae200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea80d0610 con 0x7f6ea806bda0 2024-04-25T09:03:11.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6eace00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ea806bda0 0x7f6ea8161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6eae200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea80d0490 con 0x7f6ea8165630 2024-04-25T09:03:11.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6e9fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ea80c4dc0 0x7f6ea8161980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6eace00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ea806bda0 0x7f6ea8161440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33062/0 (socket says 172.21.15.173:33062) 2024-04-25T09:03:11.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6eace00640 1 -- 172.21.15.173:0/2019205996 learned_addr learned my addr 172.21.15.173:0/2019205996 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:11.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6eae200640 1 -- 172.21.15.173:0/2019205996 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea80d0790 con 0x7f6ea80c4dc0 2024-04-25T09:03:11.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6ead800640 1 --2- 172.21.15.173:0/2019205996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ea8165630 0x7f6ea80af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7efc11a00640 1 -- 172.21.15.173:0/4158626340 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c161b50 con 0x7efc0c15dae0 2024-04-25T09:03:11.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7efc12400640 1 --2- 172.21.15.173:0/4158626340 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc0c0cee10 0x7efc0c0d1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:11.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7fafb7e00640 1 -- 172.21.15.173:0/3959448827 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa8017070 con 0x7fafc00b0ac0 2024-04-25T09:03:11.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7fafb7e00640 1 -- 172.21.15.173:0/3959448827 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa8005cf0 con 0x7fafc00b0ac0 2024-04-25T09:03:11.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7fafb7e00640 1 -- 172.21.15.173:0/3959448827 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa80072f0 con 0x7fafc00b0ac0 2024-04-25T09:03:11.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7fafc5800640 1 -- 172.21.15.173:0/3959448827 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc015eef0 con 0x7fafc00b0ac0 2024-04-25T09:03:11.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7fafc5800640 1 -- 172.21.15.173:0/3959448827 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc00cb080 con 0x7fafc00b0ac0 2024-04-25T09:03:11.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6ead800640 1 -- 172.21.15.173:0/2019205996 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ea80c4dc0 msgr2=0x7f6ea8161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6ead800640 1 --2- 172.21.15.173:0/2019205996 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ea80c4dc0 0x7f6ea8161980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6ead800640 1 -- 172.21.15.173:0/2019205996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ea806bda0 msgr2=0x7f6ea8161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6ead800640 1 --2- 172.21.15.173:0/2019205996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ea806bda0 0x7f6ea8161440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6ead800640 1 -- 172.21.15.173:0/2019205996 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea8161ec0 con 0x7f6ea8165630 2024-04-25T09:03:11.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6ead800640 1 --2- 172.21.15.173:0/2019205996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ea8165630 0x7f6ea80af8d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000cc80 tx=0x7f6ea000a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f8110c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f810c0cc800 0x7f810c0cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f8110c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f810c0aea40 0x7f810c0cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f8110c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810c0b2770 con 0x7f810c161f80 2024-04-25T09:03:11.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6ea5600640 1 -- 172.21.15.173:0/2019205996 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0003ba0 con 0x7f6ea8165630 2024-04-25T09:03:11.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f6eae200640 1 -- 172.21.15.173:0/2019205996 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea80af310 con 0x7f6ea8165630 2024-04-25T09:03:11.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f6eae200640 1 -- 172.21.15.173:0/2019205996 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea80c5340 con 0x7f6ea8165630 2024-04-25T09:03:11.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7fafc5800640 1 -- 172.21.15.173:0/3959448827 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fafc0073a40 con 0x7fafc00b0ac0 2024-04-25T09:03:11.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f8109400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f810c0cc800 0x7f810c0cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f8109400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f810c0cc800 0x7f810c0cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:39918/0 (socket says 172.21.15.173:39918) 2024-04-25T09:03:11.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f8109400640 1 -- 172.21.15.173:0/3293194832 learned_addr learned my addr 172.21.15.173:0/3293194832 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:11.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f810a800640 1 --2- 172.21.15.173:0/3293194832 >> v2:172.21.15.194:3300/0 conn(0x7f810c0aea40 0x7f810c0cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f8110c00640 1 -- 172.21.15.173:0/3293194832 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810c071e80 con 0x7f810c0aea40 2024-04-25T09:03:11.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7f8110c00640 1 -- 172.21.15.173:0/3293194832 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c072160 con 0x7f810c0cc800 2024-04-25T09:03:11.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8108a00640 1 -- 172.21.15.173:0/3293194832 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784153657 0 0) 0x7f81040014a0 con 0x7f810c161f80 2024-04-25T09:03:11.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.874+0000 7ff161e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff15c161f80 0x7ff15c0cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7ff161e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15c0b2770 con 0x7ff15c0cc800 2024-04-25T09:03:11.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7ff161e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15c071e80 con 0x7ff15c0aea40 2024-04-25T09:03:11.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7ff161e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c072160 con 0x7ff15c161f80 2024-04-25T09:03:11.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f6ea5600640 1 -- 172.21.15.173:0/2019205996 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea0003d40 con 0x7f6ea8165630 2024-04-25T09:03:11.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7ff15b400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ff15c0cc800 0x7ff15c0cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60530/0 (socket says 172.21.15.173:60530) 2024-04-25T09:03:11.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7ff15b400640 1 -- 172.21.15.173:0/2168614536 learned_addr learned my addr 172.21.15.173:0/2168614536 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:11.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8108a00640 1 -- 172.21.15.173:0/3293194832 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80f0003530 con 0x7f810c161f80 2024-04-25T09:03:11.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8108a00640 1 -- 172.21.15.173:0/3293194832 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1446894747 0 0) 0x7f80f0003530 con 0x7f810c161f80 2024-04-25T09:03:11.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8108a00640 1 -- 172.21.15.173:0/3293194832 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f810c0cc800 msgr2=0x7f810c0cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:11.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8108a00640 1 --2- 172.21.15.173:0/3293194832 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f810c0cc800 0x7f810c0cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8108a00640 1 -- 172.21.15.173:0/3293194832 >> v2:172.21.15.194:3300/0 conn(0x7f810c0aea40 msgr2=0x7f810c0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:11.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8108a00640 1 --2- 172.21.15.173:0/3293194832 >> v2:172.21.15.194:3300/0 conn(0x7f810c0aea40 0x7f810c0cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8108a00640 1 -- 172.21.15.173:0/3293194832 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c072440 con 0x7f810c161f80 2024-04-25T09:03:11.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8108a00640 1 -- 172.21.15.173:0/3293194832 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f8104001bd0 con 0x7f810c161f80 2024-04-25T09:03:11.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8108a00640 1 -- 172.21.15.173:0/3293194832 >> v1:172.21.15.194:6789/0 conn(0x7f810c161f80 legacy=0x7f810c0cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8108a00640 1 --2- 172.21.15.173:0/3293194832 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80f00039c0 0x7f80f0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8108a00640 1 --2- 172.21.15.173:0/3293194832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f00043b0 0x7f80f0004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8108a00640 1 --2- 172.21.15.173:0/3293194832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80f0005050 0x7f80f000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8108a00640 1 -- 172.21.15.173:0/3293194832 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c071e80 con 0x7f80f00043b0 2024-04-25T09:03:11.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8108a00640 1 -- 172.21.15.173:0/3293194832 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c072160 con 0x7f80f0005050 2024-04-25T09:03:11.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8108a00640 1 -- 172.21.15.173:0/3293194832 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f001d000 con 0x7f80f00039c0 2024-04-25T09:03:11.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8109400640 1 --2- 172.21.15.173:0/3293194832 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f810c0cc800 0x7f810c0cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:11.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8109e00640 1 --2- 172.21.15.173:0/3293194832 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80f00039c0 0x7f80f0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f0147400640 1 --2- 172.21.15.173:0/3729814647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01480ce4c0 0x7f01480ce930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f01380097c0 tx=0x7f013801c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=606ca29276995f5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7ff15aa00640 1 --2- 172.21.15.173:0/2168614536 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff15c161f80 0x7ff15c0cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f810a800640 1 --2- 172.21.15.173:0/3293194832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80f0005050 0x7f80f000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f6eae200640 1 -- 172.21.15.173:0/2019205996 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e80001040 con 0x7f6ea8165630 2024-04-25T09:03:11.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f6ea5600640 1 -- 172.21.15.173:0/2019205996 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0003ba0 con 0x7f6ea8165630 2024-04-25T09:03:11.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8109e00640 1 -- 172.21.15.173:0/3293194832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80f0005050 msgr2=0x7f80f000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:11.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8109e00640 1 --2- 172.21.15.173:0/3293194832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80f0005050 0x7f80f000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8109e00640 1 -- 172.21.15.173:0/3293194832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f00043b0 msgr2=0x7f80f0004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:11.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8109e00640 1 --2- 172.21.15.173:0/3293194832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f00043b0 0x7f80f0004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f8109e00640 1 -- 172.21.15.173:0/3293194832 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c072440 con 0x7f80f00039c0 2024-04-25T09:03:11.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f0146a00640 1 -- 172.21.15.173:0/3729814647 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01380b0070 con 0x7f01480ce4c0 2024-04-25T09:03:11.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f0146a00640 1 -- 172.21.15.173:0/3729814647 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01380ab600 con 0x7f01480ce4c0 2024-04-25T09:03:11.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f0146a00640 1 -- 172.21.15.173:0/3729814647 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01380ab9d0 con 0x7f01480ce4c0 2024-04-25T09:03:11.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f810a800640 1 --2- 172.21.15.173:0/3293194832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80f0005050 0x7f80f000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:11.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7ff15aa00640 1 -- 172.21.15.173:0/2168614536 >> v1:172.21.15.194:6789/0 conn(0x7ff15c0aea40 legacy=0x7ff15c0cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:11.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7ff15aa00640 1 -- 172.21.15.173:0/2168614536 >> v1:172.21.15.173:6789/0 conn(0x7ff15c0cc800 legacy=0x7ff15c0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7ff15aa00640 1 -- 172.21.15.173:0/2168614536 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c072440 con 0x7ff15c161f80 2024-04-25T09:03:11.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7efc11a00640 1 --2- 172.21.15.173:0/4158626340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc0c15dae0 0x7efc0c0b9350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009870 tx=0x7efbf801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae039887a41a2d5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7efc0be00640 1 -- 172.21.15.173:0/4158626340 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf80b0070 con 0x7efc0c15dae0 2024-04-25T09:03:11.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7efc0be00640 1 -- 172.21.15.173:0/4158626340 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf80ab400 con 0x7efc0c15dae0 2024-04-25T09:03:11.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7efc0be00640 1 -- 172.21.15.173:0/4158626340 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00001680 con 0x7efc0c15dae0 2024-04-25T09:03:11.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f014f000640 1 -- 172.21.15.173:0/3729814647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01480ce4c0 msgr2=0x7f01480ce930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7f014f000640 1 --2- 172.21.15.173:0/3729814647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01480ce4c0 0x7f01480ce930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f01380097c0 tx=0x7f013801c3d0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7efc14400640 1 -- 172.21.15.173:0/4158626340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc0c15dae0 msgr2=0x7efc0c0b9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7efc14400640 1 --2- 172.21.15.173:0/4158626340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc0c15dae0 0x7efc0c0b9350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009870 tx=0x7efbf801c480 comp rx=0 tx=0).stop 2024-04-25T09:03:11.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fd814e00640 1 -- 172.21.15.173:0/1477347223 reap_dead start 2024-04-25T09:03:11.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7efc14400640 1 -- 172.21.15.173:0/4158626340 shutdown_connections 2024-04-25T09:03:11.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7efc14400640 1 --2- 172.21.15.173:0/4158626340 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc0c0cee10 0x7efc0c0d1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7efc14400640 1 --2- 172.21.15.173:0/4158626340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc0c15dae0 0x7efc0c0b9350 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7efc14400640 1 -- 172.21.15.173:0/4158626340 >> 172.21.15.173:0/4158626340 conn(0x7efc0c0d04b0 msgr2=0x7efc0c0d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7efc14400640 1 -- 172.21.15.173:0/4158626340 shutdown_connections 2024-04-25T09:03:11.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7efc14400640 1 -- 172.21.15.173:0/4158626340 wait complete. 2024-04-25T09:03:11.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fd814e00640 1 --2- 172.21.15.173:0/1477347223 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7f40051d0 0x7fd7f400b9d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c290 tx=0x7fd7fc021090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f4b61dd9ee04c85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fe951600640 1 Processor -- start 2024-04-25T09:03:11.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.878+0000 7fafb7e00640 1 -- 172.21.15.173:0/3959448827 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fafa801a070 con 0x7fafc00b0ac0 2024-04-25T09:03:11.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fafb7e00640 1 --2- 172.21.15.173:0/3959448827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf9c067060 0x7faf9c069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7f6ea5600640 1 -- 172.21.15.173:0/2019205996 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6ea0003ef0 con 0x7f6ea8165630 2024-04-25T09:03:11.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7f014f000640 1 -- 172.21.15.173:0/3729814647 shutdown_connections 2024-04-25T09:03:11.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7f014f000640 1 --2- 172.21.15.173:0/3729814647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01480ce4c0 0x7f01480ce930 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7f014f000640 1 -- 172.21.15.173:0/3729814647 >> 172.21.15.173:0/3729814647 conn(0x7f014806b290 msgr2=0x7f01480b47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fd80ea00640 1 -- 172.21.15.173:0/1477347223 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc007d10 con 0x7fd7f40051d0 2024-04-25T09:03:11.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fe951600640 1 -- start start 2024-04-25T09:03:11.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fafbf400640 1 --2- 172.21.15.173:0/3959448827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf9c067060 0x7faf9c069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7f014f000640 1 -- 172.21.15.173:0/3729814647 shutdown_connections 2024-04-25T09:03:11.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fafb7e00640 1 -- 172.21.15.173:0/3959448827 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fafa8084720 con 0x7fafc00b0ac0 2024-04-25T09:03:11.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fafb7e00640 1 --2- 172.21.15.173:0/3959448827 >> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] conn(0x7faf9c070760 0x7faf9c072ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fafb7e00640 1 -- 172.21.15.173:0/3959448827 --> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf9c073270 con 0x7faf9c070760 2024-04-25T09:03:11.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fafb7e00640 1 -- 172.21.15.173:0/3959448827 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafa808b050 con 0x7fafc00b0ac0 2024-04-25T09:03:11.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fd80ea00640 1 -- 172.21.15.173:0/1477347223 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc0ad070 con 0x7fd7f40051d0 2024-04-25T09:03:11.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fd815800640 1 -- 172.21.15.173:0/1477347223 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7f40051d0 msgr2=0x7fd7f400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7f014f000640 1 -- 172.21.15.173:0/3729814647 wait complete. 2024-04-25T09:03:11.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fafc4e00640 1 --2- 172.21.15.173:0/3959448827 >> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] conn(0x7faf9c070760 0x7faf9c072ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fd80ea00640 1 -- 172.21.15.173:0/1477347223 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc007d10 con 0x7fd7f40051d0 2024-04-25T09:03:11.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fe951600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe94c161dd0 0x7fe94c06dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fe951600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe94c06e2a0 0x7fe94c1621b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7f8109e00640 1 --2- 172.21.15.173:0/3293194832 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80f00039c0 0x7f80f0003de0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f810400a660 tx=0x7f810401cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=766511797129fb4f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fe951600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94c06e6e0 con 0x7fe94c1626f0 2024-04-25T09:03:11.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fe951600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe94c06e970 con 0x7fe94c161dd0 2024-04-25T09:03:11.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fe951600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c06ec50 con 0x7fe94c06e2a0 2024-04-25T09:03:11.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7ff15aa00640 1 --2- 172.21.15.173:0/2168614536 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff15c161f80 0x7ff15c0cd2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0097f0 tx=0x7ff14c01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd2721643368e3c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7efc14400640 1 Processor -- start 2024-04-25T09:03:11.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fd815800640 1 --2- 172.21.15.173:0/1477347223 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7f40051d0 0x7fd7f400b9d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c290 tx=0x7fd7fc021090 comp rx=0 tx=0).stop 2024-04-25T09:03:11.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7f8108a00640 1 -- 172.21.15.173:0/3293194832 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810400a260 con 0x7f80f00039c0 2024-04-25T09:03:11.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fe94be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe94c161dd0 0x7fe94c06dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fd815800640 1 -- 172.21.15.173:0/1477347223 shutdown_connections 2024-04-25T09:03:11.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fd815800640 1 --2- 172.21.15.173:0/1477347223 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7f40051d0 0x7fd7f400b9d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fd815800640 1 -- 172.21.15.173:0/1477347223 >> 172.21.15.173:0/1477347223 conn(0x7fd8100b5a50 msgr2=0x7fd8100b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7efc14400640 1 -- start start 2024-04-25T09:03:11.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fe94be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe94c161dd0 0x7fe94c06dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:56734/0 (socket says 172.21.15.173:56734) 2024-04-25T09:03:11.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7fe94be00640 1 -- 172.21.15.173:0/3907213061 learned_addr learned my addr 172.21.15.173:0/3907213061 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:11.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7fafc4e00640 1 --2- 172.21.15.173:0/3959448827 >> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] conn(0x7faf9c070760 0x7faf9c072ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7f6ea5600640 1 --2- 172.21.15.173:0/2019205996 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6e84067390 0x7f6e84069850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7f6ea5600640 1 -- 172.21.15.173:0/2019205996 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6ea00039a0 con 0x7f6ea8165630 2024-04-25T09:03:11.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7f6ea5600640 1 --2- 172.21.15.173:0/2019205996 >> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] conn(0x7f6e84070a10 0x7f6e84072e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7f6ea5600640 1 -- 172.21.15.173:0/2019205996 --> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ea0022ec0 con 0x7f6e84070a10 2024-04-25T09:03:11.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7f8108a00640 1 -- 172.21.15.173:0/3293194832 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81040a9070 con 0x7f80f00039c0 2024-04-25T09:03:11.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.882+0000 7f6ea5600640 1 -- 172.21.15.173:0/2019205996 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ea0085df0 con 0x7f6ea8165630 2024-04-25T09:03:11.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7f8108a00640 1 -- 172.21.15.173:0/3293194832 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81040a5b00 con 0x7f80f00039c0 2024-04-25T09:03:11.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7ff159600640 1 -- 172.21.15.173:0/2168614536 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0b0070 con 0x7ff15c161f80 2024-04-25T09:03:11.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7ff159600640 1 -- 172.21.15.173:0/2168614536 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c0ab600 con 0x7ff15c161f80 2024-04-25T09:03:11.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7ff159600640 1 -- 172.21.15.173:0/2168614536 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0ab9d0 con 0x7ff15c161f80 2024-04-25T09:03:11.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7fd815800640 1 -- 172.21.15.173:0/1477347223 shutdown_connections 2024-04-25T09:03:11.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7f6e9fe00640 1 --2- 172.21.15.173:0/2019205996 >> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] conn(0x7f6e84070a10 0x7f6e84072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7f8110c00640 1 -- 172.21.15.173:0/3293194832 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80f00039c0 msgr2=0x7f80f0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7f8110c00640 1 --2- 172.21.15.173:0/3293194832 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80f00039c0 0x7f80f0003de0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f810400a660 tx=0x7f810401cf10 comp rx=0 tx=0).stop 2024-04-25T09:03:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7f810a800640 1 -- 172.21.15.173:0/3293194832 reap_dead start 2024-04-25T09:03:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7f8110c00640 1 -- 172.21.15.173:0/3293194832 shutdown_connections 2024-04-25T09:03:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7f8110c00640 1 -- 172.21.15.173:0/3293194832 >> 172.21.15.173:0/3293194832 conn(0x7f810c06ac90 msgr2=0x7f810c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7ff161e00640 1 -- 172.21.15.173:0/2168614536 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff15c161f80 msgr2=0x7ff15c0cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7ff161e00640 1 --2- 172.21.15.173:0/2168614536 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff15c161f80 0x7ff15c0cd2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0097f0 tx=0x7ff14c01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7fe94be00640 1 -- 172.21.15.173:0/3907213061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe94c06e2a0 msgr2=0x7fe94c1621b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T09:03:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7fe94be00640 1 --2- 172.21.15.173:0/3907213061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe94c06e2a0 0x7fe94c1621b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7fe94be00640 1 -- 172.21.15.173:0/3907213061 >> v1:172.21.15.173:6789/0 conn(0x7fe94c1626f0 legacy=0x7fe94c1657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:11.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7fe94be00640 1 -- 172.21.15.173:0/3907213061 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c0cd560 con 0x7fe94c161dd0 2024-04-25T09:03:11.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7f6eace00640 1 --2- 172.21.15.173:0/2019205996 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6e84067390 0x7f6e84069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7f8110c00640 1 -- 172.21.15.173:0/3293194832 shutdown_connections 2024-04-25T09:03:11.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7fafbf400640 1 --2- 172.21.15.173:0/3959448827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf9c067060 0x7faf9c069520 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fafb00ad000 tx=0x7fafb00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7f6e9fe00640 1 --2- 172.21.15.173:0/2019205996 >> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] conn(0x7f6e84070a10 0x7f6e84072e50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7f014f000640 1 Processor -- start 2024-04-25T09:03:11.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7efc14400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc0c0b2b60 0x7efc0c203bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7efc14400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc0c0cee10 0x7efc0c0c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7efc14400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc0c15dae0 0x7efc0c06ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7f014f000640 1 -- start start 2024-04-25T09:03:11.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7efc14400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c0d2cd0 con 0x7efc0c0b2b60 2024-04-25T09:03:11.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7efc14400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c0d2b50 con 0x7efc0c15dae0 2024-04-25T09:03:11.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7efc14400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c0d2e50 con 0x7efc0c0cee10 2024-04-25T09:03:11.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7fafb7e00640 1 -- 172.21.15.173:0/3959448827 <== osd.1 v2:172.21.15.173:6800/3130238007 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7faf9c073270 con 0x7faf9c070760 2024-04-25T09:03:11.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7f6eace00640 1 --2- 172.21.15.173:0/2019205996 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6e84067390 0x7f6e84069850 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e9801a0d0 tx=0x7f6e980a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7f8110c00640 1 -- 172.21.15.173:0/3293194832 wait complete. 2024-04-25T09:03:11.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7fd815800640 1 -- 172.21.15.173:0/1477347223 wait complete. 2024-04-25T09:03:11.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7fd815800640 1 Processor -- start 2024-04-25T09:03:11.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7f6ea5600640 1 -- 172.21.15.173:0/2019205996 <== osd.0 v2:172.21.15.173:6802/3393779300 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6ea0022ec0 con 0x7f6e84070a10 2024-04-25T09:03:11.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7fd815800640 1 -- start start 2024-04-25T09:03:11.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7efc11000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc0c0cee10 0x7efc0c0c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7efc11000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc0c0cee10 0x7efc0c0c9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:39960/0 (socket says 172.21.15.173:39960) 2024-04-25T09:03:11.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7efc11000640 1 -- 172.21.15.173:0/505119381 learned_addr learned my addr 172.21.15.173:0/505119381 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:11.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7efc12400640 1 --2- 172.21.15.173:0/505119381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc0c15dae0 0x7efc0c06ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7f014f000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01480ce4c0 0x7f0148152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7f014f000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01480cee70 0x7f014814fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f014f000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0148159880 0x7f01480b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f014f000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014806f4a0 con 0x7f01480ce4c0 2024-04-25T09:03:11.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f014f000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014806f320 con 0x7f0148159880 2024-04-25T09:03:11.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f014f000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014806e290 con 0x7f01480cee70 2024-04-25T09:03:11.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f0147400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01480cee70 0x7f014814fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f0147400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01480cee70 0x7f014814fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:39972/0 (socket says 172.21.15.173:39972) 2024-04-25T09:03:11.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7ff161e00640 1 -- 172.21.15.173:0/2168614536 shutdown_connections 2024-04-25T09:03:11.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7ff161e00640 1 --2- 172.21.15.173:0/2168614536 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff15c161f80 0x7ff15c0cd2f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.886+0000 7ff161e00640 1 -- 172.21.15.173:0/2168614536 >> 172.21.15.173:0/2168614536 conn(0x7ff15c06ac90 msgr2=0x7ff15c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f0147400640 1 -- 172.21.15.173:0/3833154955 learned_addr learned my addr 172.21.15.173:0/3833154955 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:11.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7ff161e00640 1 -- 172.21.15.173:0/2168614536 shutdown_connections 2024-04-25T09:03:11.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7ff161e00640 1 -- 172.21.15.173:0/2168614536 wait complete. 2024-04-25T09:03:11.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f014d000640 1 --2- 172.21.15.173:0/3833154955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0148159880 0x7f01480b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7efc11000640 1 -- 172.21.15.173:0/505119381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc0c15dae0 msgr2=0x7efc0c06ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7efc11000640 1 --2- 172.21.15.173:0/505119381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc0c15dae0 0x7efc0c06ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7efc11000640 1 -- 172.21.15.173:0/505119381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc0c0b2b60 msgr2=0x7efc0c203bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T09:03:11.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7efc11a00640 1 --2- 172.21.15.173:0/505119381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc0c0b2b60 0x7efc0c203bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7efc11000640 1 --2- 172.21.15.173:0/505119381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc0c0b2b60 0x7efc0c203bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7efc11000640 1 -- 172.21.15.173:0/505119381 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c0cdd80 con 0x7efc0c0cee10 2024-04-25T09:03:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7fd815800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7f40051d0 0x7fd81014d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7fd815800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8100cd8a0 0x7fd8100ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7fd815800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8100ce560 0x7fd8100cf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7fd815800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100b43d0 con 0x7fd7f40051d0 2024-04-25T09:03:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7fd815800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100b4250 con 0x7fd8100cd8a0 2024-04-25T09:03:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7fd815800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100af8b0 con 0x7fd8100ce560 2024-04-25T09:03:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f0147e00640 1 --2- 172.21.15.173:0/3833154955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01480ce4c0 0x7f0148152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f0147400640 1 -- 172.21.15.173:0/3833154955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0148159880 msgr2=0x7f01480b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f0147400640 1 --2- 172.21.15.173:0/3833154955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0148159880 0x7f01480b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f0147400640 1 -- 172.21.15.173:0/3833154955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01480ce4c0 msgr2=0x7f0148152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f0147400640 1 --2- 172.21.15.173:0/3833154955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01480ce4c0 0x7f0148152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f8110c00640 1 Processor -- start 2024-04-25T09:03:11.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f0147400640 1 -- 172.21.15.173:0/3833154955 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01481532c0 con 0x7f01480cee70 2024-04-25T09:03:11.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7fd80f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8100cd8a0 0x7fd8100ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7fd80f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8100cd8a0 0x7fd8100ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:56764/0 (socket says 172.21.15.173:56764) 2024-04-25T09:03:11.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7fd80f400640 1 -- 172.21.15.173:0/2217091590 learned_addr learned my addr 172.21.15.173:0/2217091590 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:11.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7efc11a00640 1 --2- 172.21.15.173:0/505119381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc0c0b2b60 0x7efc0c203bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:11.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7efc11000640 1 --2- 172.21.15.173:0/505119381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc0c0cee10 0x7efc0c0c9cd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efc0000c700 tx=0x7efc0000cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7fd814e00640 1 --2- 172.21.15.173:0/2217091590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8100ce560 0x7fd8100cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f0147400640 1 --2- 172.21.15.173:0/3833154955 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01480cee70 0x7f014814fea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f01380ae040 tx=0x7f013801ac10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7fd80fe00640 1 --2- 172.21.15.173:0/2217091590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7f40051d0 0x7fd81014d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7fd80f400640 1 -- 172.21.15.173:0/2217091590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8100ce560 msgr2=0x7fd8100cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7fd80f400640 1 --2- 172.21.15.173:0/2217091590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8100ce560 0x7fd8100cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7fd80f400640 1 -- 172.21.15.173:0/2217091590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7f40051d0 msgr2=0x7fd81014d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7fd80f400640 1 --2- 172.21.15.173:0/2217091590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7f40051d0 0x7fd81014d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7fd80f400640 1 -- 172.21.15.173:0/2217091590 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd810150930 con 0x7fd8100cd8a0 2024-04-25T09:03:11.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7fd80fe00640 1 --2- 172.21.15.173:0/2217091590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7f40051d0 0x7fd81014d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:11.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f8110c00640 1 -- start start 2024-04-25T09:03:11.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7efc09600640 1 -- 172.21.15.173:0/505119381 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00016020 con 0x7efc0c0cee10 2024-04-25T09:03:11.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7efc09600640 1 -- 172.21.15.173:0/505119381 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0000a840 con 0x7efc0c0cee10 2024-04-25T09:03:11.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7efc09600640 1 -- 172.21.15.173:0/505119381 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0000ac70 con 0x7efc0c0cee10 2024-04-25T09:03:11.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7efc14400640 1 -- 172.21.15.173:0/505119381 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0c204100 con 0x7efc0c0cee10 2024-04-25T09:03:11.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7efc14400640 1 -- 172.21.15.173:0/505119381 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0c06e750 con 0x7efc0c0cee10 2024-04-25T09:03:11.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7fd80f400640 1 --2- 172.21.15.173:0/2217091590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8100cd8a0 0x7fd8100ce020 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd800009160 tx=0x7fd800011f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7fd807e00640 1 -- 172.21.15.173:0/2217091590 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80000fc20 con 0x7fd8100cd8a0 2024-04-25T09:03:11.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7fd807e00640 1 -- 172.21.15.173:0/2217091590 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80000fdc0 con 0x7fd8100cd8a0 2024-04-25T09:03:11.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7fd807e00640 1 -- 172.21.15.173:0/2217091590 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800004240 con 0x7fd8100cd8a0 2024-04-25T09:03:11.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f0137e00640 1 -- 172.21.15.173:0/3833154955 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01380b0050 con 0x7f01480cee70 2024-04-25T09:03:11.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f0137e00640 1 -- 172.21.15.173:0/3833154955 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01380bc070 con 0x7f01480cee70 2024-04-25T09:03:11.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f0137e00640 1 -- 172.21.15.173:0/3833154955 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138006e20 con 0x7f01480cee70 2024-04-25T09:03:11.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f014f000640 1 -- 172.21.15.173:0/3833154955 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0148151ce0 con 0x7f01480cee70 2024-04-25T09:03:11.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.890+0000 7f014f000640 1 -- 172.21.15.173:0/3833154955 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01481522a0 con 0x7f01480cee70 2024-04-25T09:03:11.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7f8110c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80f00039c0 0x7f810c14f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7f8110c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f810c14fc10 0x7f810c15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7f8110c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f810c15bf40 0x7f810c162570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7f8110c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c071730 con 0x7f810c14fc10 2024-04-25T09:03:11.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7f8110c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c0715b0 con 0x7f80f00039c0 2024-04-25T09:03:11.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7f8110c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c0d0190 con 0x7f810c15bf40 2024-04-25T09:03:11.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7ff161e00640 1 Processor -- start 2024-04-25T09:03:11.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7fd815800640 1 -- 172.21.15.173:0/2217091590 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd810150c10 con 0x7fd8100cd8a0 2024-04-25T09:03:11.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7f014f000640 1 -- 172.21.15.173:0/3833154955 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0148073a40 con 0x7f01480cee70 2024-04-25T09:03:11.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7f8109400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f810c14fc10 0x7f810c15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7f810a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f810c15bf40 0x7f810c162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7f810a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f810c15bf40 0x7f810c162570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:39984/0 (socket says 172.21.15.173:39984) 2024-04-25T09:03:11.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7f810a800640 1 -- 172.21.15.173:0/3282053169 learned_addr learned my addr 172.21.15.173:0/3282053169 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:11.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7f8109e00640 1 --2- 172.21.15.173:0/3282053169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80f00039c0 0x7f810c14f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7fe94be00640 1 --2- 172.21.15.173:0/3907213061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe94c161dd0 0x7fe94c06dd60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009870 tx=0x7fe93c01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a653ce08f6c2fc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7fe94aa00640 1 -- 172.21.15.173:0/3907213061 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0ab5f0 con 0x7fe94c161dd0 2024-04-25T09:03:11.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7fe94aa00640 1 -- 172.21.15.173:0/3907213061 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c0b0070 con 0x7fe94c161dd0 2024-04-25T09:03:11.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7fe94aa00640 1 -- 172.21.15.173:0/3907213061 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0ab9b0 con 0x7fe94c161dd0 2024-04-25T09:03:11.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7ff161e00640 1 -- start start 2024-04-25T09:03:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7efc14400640 1 -- 172.21.15.173:0/505119381 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc0c073ab0 con 0x7efc0c0cee10 2024-04-25T09:03:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7efc09600640 1 -- 172.21.15.173:0/505119381 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efc00019020 con 0x7efc0c0cee10 2024-04-25T09:03:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7ff161e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff15c0aea40 0x7ff15c154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7ff161e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff15c0cc800 0x7ff15c163940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7fd815800640 1 -- 172.21.15.173:0/2217091590 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8101511d0 con 0x7fd8100cd8a0 2024-04-25T09:03:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7fd807e00640 1 -- 172.21.15.173:0/2217091590 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd800003620 con 0x7fd8100cd8a0 2024-04-25T09:03:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7fd815800640 1 -- 172.21.15.173:0/2217091590 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd8101506e0 con 0x7fd8100cd8a0 2024-04-25T09:03:11.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7f0137e00640 1 -- 172.21.15.173:0/3833154955 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f01380b5850 con 0x7f01480cee70 2024-04-25T09:03:11.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7ff161e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff15c161f80 0x7ff15c163e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7ff161e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c071730 con 0x7ff15c0cc800 2024-04-25T09:03:11.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7ff161e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c0715b0 con 0x7ff15c0aea40 2024-04-25T09:03:11.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7ff161e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c16fc00 con 0x7ff15c161f80 2024-04-25T09:03:11.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7ff15aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff15c0aea40 0x7ff15c154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7ff15aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff15c0aea40 0x7ff15c154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:56780/0 (socket says 172.21.15.173:56780) 2024-04-25T09:03:11.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.894+0000 7ff15aa00640 1 -- 172.21.15.173:0/1840463617 learned_addr learned my addr 172.21.15.173:0/1840463617 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:11.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7ff15aa00640 1 -- 172.21.15.173:0/1840463617 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff15c161f80 msgr2=0x7ff15c163e80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T09:03:11.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7ff15aa00640 1 --2- 172.21.15.173:0/1840463617 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff15c161f80 0x7ff15c163e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7ff15aa00640 1 -- 172.21.15.173:0/1840463617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff15c0cc800 msgr2=0x7ff15c163940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T09:03:11.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7ff15aa00640 1 --2- 172.21.15.173:0/1840463617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff15c0cc800 0x7ff15c163940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7ff15aa00640 1 -- 172.21.15.173:0/1840463617 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c14bd50 con 0x7ff15c0aea40 2024-04-25T09:03:11.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7ff15aa00640 1 --2- 172.21.15.173:0/1840463617 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff15c0aea40 0x7ff15c154140 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff14c01a010 tx=0x7ff14c019180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7fe951600640 1 -- 172.21.15.173:0/3907213061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe94c161dd0 msgr2=0x7fe94c06dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7fe951600640 1 --2- 172.21.15.173:0/3907213061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe94c161dd0 0x7fe94c06dd60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009870 tx=0x7fe93c01c540 comp rx=0 tx=0).stop 2024-04-25T09:03:11.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7f810a800640 1 -- 172.21.15.173:0/3282053169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80f00039c0 msgr2=0x7f810c14f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7f810a800640 1 --2- 172.21.15.173:0/3282053169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80f00039c0 0x7f810c14f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7f810a800640 1 -- 172.21.15.173:0/3282053169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f810c14fc10 msgr2=0x7f810c15ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7f810a800640 1 --2- 172.21.15.173:0/3282053169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f810c14fc10 0x7f810c15ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7f810a800640 1 -- 172.21.15.173:0/3282053169 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c15c500 con 0x7f810c15bf40 2024-04-25T09:03:11.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7efc09600640 1 --2- 172.21.15.173:0/505119381 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efbec066fb0 0x7efbec069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7ff153400640 1 -- 172.21.15.173:0/1840463617 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0bb070 con 0x7ff15c0aea40 2024-04-25T09:03:11.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7ff153400640 1 -- 172.21.15.173:0/1840463617 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c0b6640 con 0x7ff15c0aea40 2024-04-25T09:03:11.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7ff153400640 1 -- 172.21.15.173:0/1840463617 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0b0040 con 0x7ff15c0aea40 2024-04-25T09:03:11.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7f810a800640 1 --2- 172.21.15.173:0/3282053169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f810c15bf40 0x7f810c162570 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f810c0aee70 tx=0x7f80fc010c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7efc09600640 1 -- 172.21.15.173:0/505119381 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7efc00089060 con 0x7efc0c0cee10 2024-04-25T09:03:11.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7efc09600640 1 --2- 172.21.15.173:0/505119381 >> [v2:172.21.15.173:6816/3226999603,v1:172.21.15.173:6817/3226999603] conn(0x7efbec0706b0 0x7efbec072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7efc09600640 1 -- 172.21.15.173:0/505119381 --> [v2:172.21.15.173:6816/3226999603,v1:172.21.15.173:6817/3226999603] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efbec0731c0 con 0x7efbec0706b0 2024-04-25T09:03:11.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7fd807e00640 1 --2- 172.21.15.173:0/2217091590 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd7f0066fb0 0x7fd7f0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7fd807e00640 1 -- 172.21.15.173:0/2217091590 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd800053970 con 0x7fd8100cd8a0 2024-04-25T09:03:11.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7fd807e00640 1 --2- 172.21.15.173:0/2217091590 >> [v2:172.21.15.173:6822/4263773184,v1:172.21.15.173:6824/4263773184] conn(0x7fd7f00706b0 0x7fd7f0072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7fd807e00640 1 -- 172.21.15.173:0/2217091590 --> [v2:172.21.15.173:6822/4263773184,v1:172.21.15.173:6824/4263773184] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd800014e50 con 0x7fd7f00706b0 2024-04-25T09:03:11.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7fd807e00640 1 -- 172.21.15.173:0/2217091590 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd80008a060 con 0x7fd8100cd8a0 2024-04-25T09:03:11.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7fd814e00640 1 --2- 172.21.15.173:0/2217091590 >> [v2:172.21.15.173:6822/4263773184,v1:172.21.15.173:6824/4263773184] conn(0x7fd7f00706b0 0x7fd7f0072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7f0137e00640 1 --2- 172.21.15.173:0/3833154955 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f012c067030 0x7f012c0694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7f0137e00640 1 -- 172.21.15.173:0/3833154955 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f01381203a0 con 0x7f01480cee70 2024-04-25T09:03:11.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7f0137e00640 1 --2- 172.21.15.173:0/3833154955 >> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] conn(0x7f012c0707b0 0x7f012c072bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7f0137e00640 1 -- 172.21.15.173:0/3833154955 --> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0138006800 con 0x7f012c0707b0 2024-04-25T09:03:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7f0137e00640 1 -- 172.21.15.173:0/3833154955 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0138120790 con 0x7f01480cee70 2024-04-25T09:03:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7f8102000640 1 -- 172.21.15.173:0/3282053169 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc00f040 con 0x7f810c15bf40 2024-04-25T09:03:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7f8102000640 1 -- 172.21.15.173:0/3282053169 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc01c070 con 0x7f810c15bf40 2024-04-25T09:03:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7f8102000640 1 -- 172.21.15.173:0/3282053169 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc00ead0 con 0x7f810c15bf40 2024-04-25T09:03:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7f8110c00640 1 -- 172.21.15.173:0/3282053169 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c1500d0 con 0x7f810c15bf40 2024-04-25T09:03:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7f8110c00640 1 -- 172.21.15.173:0/3282053169 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c150690 con 0x7f810c15bf40 2024-04-25T09:03:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7ff161e00640 1 -- 172.21.15.173:0/1840463617 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff15c14c030 con 0x7ff15c0aea40 2024-04-25T09:03:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7ff161e00640 1 -- 172.21.15.173:0/1840463617 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15c15f160 con 0x7ff15c0aea40 2024-04-25T09:03:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7ff150c00640 1 -- 172.21.15.173:0/1840463617 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff130001040 con 0x7ff15c0aea40 2024-04-25T09:03:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7fe951600640 1 -- 172.21.15.173:0/3907213061 shutdown_connections 2024-04-25T09:03:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7fe951600640 1 --2- 172.21.15.173:0/3907213061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe94c06e2a0 0x7fe94c1621b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7fe951600640 1 --2- 172.21.15.173:0/3907213061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe94c161dd0 0x7fe94c06dd60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7fe951600640 1 -- 172.21.15.173:0/3907213061 >> 172.21.15.173:0/3907213061 conn(0x7fe94c06b290 msgr2=0x7fe94c0b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7fe951600640 1 -- 172.21.15.173:0/3907213061 shutdown_connections 2024-04-25T09:03:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7fe951600640 1 -- 172.21.15.173:0/3907213061 wait complete. 2024-04-25T09:03:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7f8110c00640 1 -- 172.21.15.173:0/3282053169 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f80e4001040 con 0x7f810c15bf40 2024-04-25T09:03:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7f014d000640 1 --2- 172.21.15.173:0/3833154955 >> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] conn(0x7f012c0707b0 0x7f012c072bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7f0147e00640 1 --2- 172.21.15.173:0/3833154955 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f012c067030 0x7f012c0694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7efc11a00640 1 --2- 172.21.15.173:0/505119381 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efbec066fb0 0x7efbec069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7efc09600640 1 -- 172.21.15.173:0/505119381 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc00051010 con 0x7efc0c0cee10 2024-04-25T09:03:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7efc11a00640 1 --2- 172.21.15.173:0/505119381 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efbec066fb0 0x7efbec069470 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efbf80ad000 tx=0x7efbf8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7efc12400640 1 --2- 172.21.15.173:0/505119381 >> [v2:172.21.15.173:6816/3226999603,v1:172.21.15.173:6817/3226999603] conn(0x7efbec0706b0 0x7efbec072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.898+0000 7fd814e00640 1 --2- 172.21.15.173:0/2217091590 >> [v2:172.21.15.173:6822/4263773184,v1:172.21.15.173:6824/4263773184] conn(0x7fd7f00706b0 0x7fd7f0072af0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7fd80fe00640 1 --2- 172.21.15.173:0/2217091590 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd7f0066fb0 0x7fd7f0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7fd80fe00640 1 --2- 172.21.15.173:0/2217091590 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd7f0066fb0 0x7fd7f0069470 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd8101f55b0 tx=0x7fd808009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7fd807e00640 1 -- 172.21.15.173:0/2217091590 <== osd.3 v2:172.21.15.173:6822/4263773184 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd800014e50 con 0x7fd7f00706b0 2024-04-25T09:03:11.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7f0147e00640 1 --2- 172.21.15.173:0/3833154955 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f012c067030 0x7f012c0694f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f013c000c10 tx=0x7f013c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7f014d000640 1 --2- 172.21.15.173:0/3833154955 >> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] conn(0x7f012c0707b0 0x7f012c072bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7f0137e00640 1 -- 172.21.15.173:0/3833154955 <== osd.4 v2:172.21.15.194:6805/3578285787 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0138006800 con 0x7f012c0707b0 2024-04-25T09:03:11.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7f8102000640 1 -- 172.21.15.173:0/3282053169 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f80fc00ec70 con 0x7f810c15bf40 2024-04-25T09:03:11.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7f8102000640 1 --2- 172.21.15.173:0/3282053169 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f80e8066f60 0x7f80e8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7f8102000640 1 -- 172.21.15.173:0/3282053169 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f80fc084e10 con 0x7f810c15bf40 2024-04-25T09:03:11.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7f8102000640 1 --2- 172.21.15.173:0/3282053169 >> [v2:172.21.15.194:6800/2762622538,v1:172.21.15.194:6801/2762622538] conn(0x7f80e8070660 0x7f80e8072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7f8102000640 1 -- 172.21.15.173:0/3282053169 --> [v2:172.21.15.194:6800/2762622538,v1:172.21.15.194:6801/2762622538] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80e8073170 con 0x7f80e8070660 2024-04-25T09:03:11.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7f8102000640 1 -- 172.21.15.173:0/3282053169 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80fc087430 con 0x7f810c15bf40 2024-04-25T09:03:11.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7ff153400640 1 -- 172.21.15.173:0/1840463617 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff14c0be070 con 0x7ff15c0aea40 2024-04-25T09:03:11.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7ff153400640 1 --2- 172.21.15.173:0/1840463617 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff13c066f60 0x7ff13c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7ff153400640 1 -- 172.21.15.173:0/1840463617 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff14c11f960 con 0x7ff15c0aea40 2024-04-25T09:03:11.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7ff15a000640 1 --2- 172.21.15.173:0/1840463617 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff13c066f60 0x7ff13c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7fe951600640 1 Processor -- start 2024-04-25T09:03:11.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7fe951600640 1 -- start start 2024-04-25T09:03:11.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7fe951600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe94c06e2a0 0x7fe94c151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7ff153400640 1 --2- 172.21.15.173:0/1840463617 >> [v2:172.21.15.194:6824/2953817121,v1:172.21.15.194:6825/2953817121] conn(0x7ff13c0706e0 0x7ff13c072b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7ff153400640 1 -- 172.21.15.173:0/1840463617 --> [v2:172.21.15.194:6824/2953817121,v1:172.21.15.194:6825/2953817121] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff14c0b2e90 con 0x7ff13c0706e0 2024-04-25T09:03:11.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7ff153400640 1 -- 172.21.15.173:0/1840463617 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff14c1242a0 con 0x7ff15c0aea40 2024-04-25T09:03:11.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7ff15b400640 1 --2- 172.21.15.173:0/1840463617 >> [v2:172.21.15.194:6824/2953817121,v1:172.21.15.194:6825/2953817121] conn(0x7ff13c0706e0 0x7ff13c072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.902+0000 7fe951600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe94c161dd0 0x7fe94c15ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe951600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe94c1626f0 0x7fe94c15b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe951600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c16ecf0 con 0x7fe94c06e2a0 2024-04-25T09:03:11.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe951600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c16eb70 con 0x7fe94c1626f0 2024-04-25T09:03:11.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe951600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c16ee70 con 0x7fe94c161dd0 2024-04-25T09:03:11.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7f8109400640 1 --2- 172.21.15.173:0/3282053169 >> [v2:172.21.15.194:6800/2762622538,v1:172.21.15.194:6801/2762622538] conn(0x7f80e8070660 0x7f80e8072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe950c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe94c1626f0 0x7fe94c15b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7ff15a000640 1 --2- 172.21.15.173:0/1840463617 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff13c066f60 0x7ff13c069420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff15c159a40 tx=0x7ff1480079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe950c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe94c1626f0 0x7fe94c15b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:56784/0 (socket says 172.21.15.173:56784) 2024-04-25T09:03:11.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe950c00640 1 -- 172.21.15.173:0/3906542759 learned_addr learned my addr 172.21.15.173:0/3906542759 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:11.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe94be00640 1 --2- 172.21.15.173:0/3906542759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe94c06e2a0 0x7fe94c151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7ff15b400640 1 --2- 172.21.15.173:0/1840463617 >> [v2:172.21.15.194:6824/2953817121,v1:172.21.15.194:6825/2953817121] conn(0x7ff13c0706e0 0x7ff13c072b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe94b400640 1 --2- 172.21.15.173:0/3906542759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe94c161dd0 0x7fe94c15ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe950c00640 1 -- 172.21.15.173:0/3906542759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe94c161dd0 msgr2=0x7fe94c15ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe950c00640 1 --2- 172.21.15.173:0/3906542759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe94c161dd0 0x7fe94c15ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe950c00640 1 -- 172.21.15.173:0/3906542759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe94c06e2a0 msgr2=0x7fe94c151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe950c00640 1 --2- 172.21.15.173:0/3906542759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe94c06e2a0 0x7fe94c151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe950c00640 1 -- 172.21.15.173:0/3906542759 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c0b0230 con 0x7fe94c1626f0 2024-04-25T09:03:11.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7efc12400640 1 --2- 172.21.15.173:0/505119381 >> [v2:172.21.15.173:6816/3226999603,v1:172.21.15.173:6817/3226999603] conn(0x7efbec0706b0 0x7efbec072af0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe94be00640 1 --2- 172.21.15.173:0/3906542759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe94c06e2a0 0x7fe94c151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:11.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe950c00640 1 --2- 172.21.15.173:0/3906542759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe94c1626f0 0x7fe94c15b0b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe94400b990 tx=0x7fe94400be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7ff153400640 1 -- 172.21.15.173:0/1840463617 <== osd.6 v2:172.21.15.194:6824/2953817121 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff14c0b2e90 con 0x7ff13c0706e0 2024-04-25T09:03:11.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe943e00640 1 -- 172.21.15.173:0/3906542759 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944019070 con 0x7fe94c1626f0 2024-04-25T09:03:11.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe943e00640 1 -- 172.21.15.173:0/3906542759 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94400cba0 con 0x7fe94c1626f0 2024-04-25T09:03:11.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7fe943e00640 1 -- 172.21.15.173:0/3906542759 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944014440 con 0x7fe94c1626f0 2024-04-25T09:03:11.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7f8109400640 1 --2- 172.21.15.173:0/3282053169 >> [v2:172.21.15.194:6800/2762622538,v1:172.21.15.194:6801/2762622538] conn(0x7f80e8070660 0x7f80e8072aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.906+0000 7f8109e00640 1 --2- 172.21.15.173:0/3282053169 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f80e8066f60 0x7f80e8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.910+0000 7fe951600640 1 -- 172.21.15.173:0/3906542759 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe94c204ac0 con 0x7fe94c1626f0 2024-04-25T09:03:11.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.910+0000 7fe951600640 1 -- 172.21.15.173:0/3906542759 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94c1515d0 con 0x7fe94c1626f0 2024-04-25T09:03:11.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.910+0000 7f8109e00640 1 --2- 172.21.15.173:0/3282053169 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f80e8066f60 0x7f80e8069420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f80f00057f0 tx=0x7f81040b0040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.910+0000 7fe951600640 1 -- 172.21.15.173:0/3906542759 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe94c15b5f0 con 0x7fe94c1626f0 2024-04-25T09:03:11.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.910+0000 7f8102000640 1 -- 172.21.15.173:0/3282053169 <== osd.5 v2:172.21.15.194:6800/2762622538 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f80e8073170 con 0x7f80e8070660 2024-04-25T09:03:11.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.910+0000 7efc09600640 1 -- 172.21.15.173:0/505119381 <== osd.2 v2:172.21.15.173:6816/3226999603 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7efbec0731c0 con 0x7efbec0706b0 2024-04-25T09:03:11.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.910+0000 7fe943e00640 1 -- 172.21.15.173:0/3906542759 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe94401c070 con 0x7fe94c1626f0 2024-04-25T09:03:11.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.914+0000 7fe943e00640 1 --2- 172.21.15.173:0/3906542759 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe92c067030 0x7fe92c0694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.914+0000 7fe943e00640 1 -- 172.21.15.173:0/3906542759 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe9440850f0 con 0x7fe94c1626f0 2024-04-25T09:03:11.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.914+0000 7fe943e00640 1 --2- 172.21.15.173:0/3906542759 >> [v2:172.21.15.194:6816/1567729259,v1:172.21.15.194:6817/1567729259] conn(0x7fe92c0707a0 0x7fe92c072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:11.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.914+0000 7fe943e00640 1 -- 172.21.15.173:0/3906542759 --> [v2:172.21.15.194:6816/1567729259,v1:172.21.15.194:6817/1567729259] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe94400cba0 con 0x7fe92c0707a0 2024-04-25T09:03:11.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.914+0000 7fe943e00640 1 -- 172.21.15.173:0/3906542759 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9440854e0 con 0x7fe94c1626f0 2024-04-25T09:03:11.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.914+0000 7fe94be00640 1 --2- 172.21.15.173:0/3906542759 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe92c067030 0x7fe92c0694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.914+0000 7fe94b400640 1 --2- 172.21.15.173:0/3906542759 >> [v2:172.21.15.194:6816/1567729259,v1:172.21.15.194:6817/1567729259] conn(0x7fe92c0707a0 0x7fe92c072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:11.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.914+0000 7f6eae200640 1 -- 172.21.15.173:0/2019205996 --> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6e80002de0 con 0x7f6e84070a10 2024-04-25T09:03:11.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.914+0000 7fe94be00640 1 --2- 172.21.15.173:0/3906542759 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe92c067030 0x7fe92c0694f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0af000 tx=0x7fe93c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.914+0000 7fe94b400640 1 --2- 172.21.15.173:0/3906542759 >> [v2:172.21.15.194:6816/1567729259,v1:172.21.15.194:6817/1567729259] conn(0x7fe92c0707a0 0x7fe92c072be0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:11.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.914+0000 7f6ea5600640 1 -- 172.21.15.173:0/2019205996 <== osd.0 v2:172.21.15.173:6802/3393779300 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6e80002de0 con 0x7f6e84070a10 2024-04-25T09:03:11.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.914+0000 7fafc5800640 1 -- 172.21.15.173:0/3959448827 --> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fafc0071840 con 0x7faf9c070760 2024-04-25T09:03:11.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7fe943e00640 1 -- 172.21.15.173:0/3906542759 <== osd.7 v2:172.21.15.194:6816/1567729259 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe94400cba0 con 0x7fe92c0707a0 2024-04-25T09:03:11.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7fafb7e00640 1 -- 172.21.15.173:0/3959448827 <== osd.1 v2:172.21.15.173:6800/3130238007 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fafc0071840 con 0x7faf9c070760 2024-04-25T09:03:11.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7f6eae200640 1 -- 172.21.15.173:0/2019205996 >> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] conn(0x7f6e84070a10 msgr2=0x7f6e84072e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7f6eae200640 1 --2- 172.21.15.173:0/2019205996 >> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] conn(0x7f6e84070a10 0x7f6e84072e50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7fafb5600640 1 -- 172.21.15.173:0/3959448827 >> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] conn(0x7faf9c070760 msgr2=0x7faf9c072ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7fafb5600640 1 --2- 172.21.15.173:0/3959448827 >> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] conn(0x7faf9c070760 0x7faf9c072ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7f6eae200640 1 -- 172.21.15.173:0/2019205996 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6e84067390 msgr2=0x7f6e84069850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7f6eae200640 1 --2- 172.21.15.173:0/2019205996 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6e84067390 0x7f6e84069850 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e9801a0d0 tx=0x7f6e980a7070 comp rx=0 tx=0).stop 2024-04-25T09:03:11.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7f6eae200640 1 -- 172.21.15.173:0/2019205996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ea8165630 msgr2=0x7f6ea80af8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7f6eae200640 1 --2- 172.21.15.173:0/2019205996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ea8165630 0x7f6ea80af8d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000cc80 tx=0x7f6ea000a660 comp rx=0 tx=0).stop 2024-04-25T09:03:11.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7f6ead800640 1 -- 172.21.15.173:0/2019205996 reap_dead start 2024-04-25T09:03:11.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7fafb5600640 1 -- 172.21.15.173:0/3959448827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf9c067060 msgr2=0x7faf9c069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7fafb5600640 1 --2- 172.21.15.173:0/3959448827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf9c067060 0x7faf9c069520 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fafb00ad000 tx=0x7fafb00a6000 comp rx=0 tx=0).stop 2024-04-25T09:03:11.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7fafb5600640 1 -- 172.21.15.173:0/3959448827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafc00b0ac0 msgr2=0x7fafc0157360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7fafb5600640 1 --2- 172.21.15.173:0/3959448827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafc00b0ac0 0x7fafc0157360 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fafa800c450 tx=0x7fafa800c910 comp rx=0 tx=0).stop 2024-04-25T09:03:11.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7f6eae200640 1 -- 172.21.15.173:0/2019205996 shutdown_connections 2024-04-25T09:03:11.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7f6eae200640 1 -- 172.21.15.173:0/2019205996 >> 172.21.15.173:0/2019205996 conn(0x7f6ea80b31d0 msgr2=0x7f6ea80c46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7fafc4e00640 1 -- 172.21.15.173:0/3959448827 reap_dead start 2024-04-25T09:03:11.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7fafb5600640 1 -- 172.21.15.173:0/3959448827 shutdown_connections 2024-04-25T09:03:11.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7fafb5600640 1 -- 172.21.15.173:0/3959448827 >> 172.21.15.173:0/3959448827 conn(0x7fafc0061d40 msgr2=0x7fafc00b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7f6eae200640 1 -- 172.21.15.173:0/2019205996 shutdown_connections 2024-04-25T09:03:11.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.918+0000 7fafb5600640 1 -- 172.21.15.173:0/3959448827 shutdown_connections 2024-04-25T09:03:11.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.922+0000 7f6eae200640 1 -- 172.21.15.173:0/2019205996 wait complete. 2024-04-25T09:03:11.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.922+0000 7fafb5600640 1 -- 172.21.15.173:0/3959448827 wait complete. 2024-04-25T09:03:11.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.930+0000 7f014f000640 1 -- 172.21.15.173:0/3833154955 --> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0148150630 con 0x7f012c0707b0 2024-04-25T09:03:11.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.930+0000 7ff150c00640 1 -- 172.21.15.173:0/1840463617 --> [v2:172.21.15.194:6824/2953817121,v1:172.21.15.194:6825/2953817121] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff130002de0 con 0x7ff13c0706e0 2024-04-25T09:03:11.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7f0137e00640 1 -- 172.21.15.173:0/3833154955 <== osd.4 v2:172.21.15.194:6805/3578285787 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0148150630 con 0x7f012c0707b0 2024-04-25T09:03:11.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7ff153400640 1 -- 172.21.15.173:0/1840463617 <== osd.6 v2:172.21.15.194:6824/2953817121 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff130002de0 con 0x7ff13c0706e0 2024-04-25T09:03:11.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7ff150c00640 1 -- 172.21.15.173:0/1840463617 >> [v2:172.21.15.194:6824/2953817121,v1:172.21.15.194:6825/2953817121] conn(0x7ff13c0706e0 msgr2=0x7ff13c072b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7ff150c00640 1 --2- 172.21.15.173:0/1840463617 >> [v2:172.21.15.194:6824/2953817121,v1:172.21.15.194:6825/2953817121] conn(0x7ff13c0706e0 0x7ff13c072b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7ff150c00640 1 -- 172.21.15.173:0/1840463617 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff13c066f60 msgr2=0x7ff13c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7ff150c00640 1 --2- 172.21.15.173:0/1840463617 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff13c066f60 0x7ff13c069420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff15c159a40 tx=0x7ff1480079c0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7ff150c00640 1 -- 172.21.15.173:0/1840463617 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff15c0aea40 msgr2=0x7ff15c154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7ff150c00640 1 --2- 172.21.15.173:0/1840463617 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff15c0aea40 0x7ff15c154140 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff14c01a010 tx=0x7ff14c019180 comp rx=0 tx=0).stop 2024-04-25T09:03:11.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7ff15b400640 1 -- 172.21.15.173:0/1840463617 reap_dead start 2024-04-25T09:03:11.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7ff150c00640 1 -- 172.21.15.173:0/1840463617 shutdown_connections 2024-04-25T09:03:11.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7ff150c00640 1 -- 172.21.15.173:0/1840463617 >> 172.21.15.173:0/1840463617 conn(0x7ff15c06ac90 msgr2=0x7ff15c0b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7f014f000640 1 -- 172.21.15.173:0/3833154955 >> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] conn(0x7f012c0707b0 msgr2=0x7f012c072bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7f014f000640 1 --2- 172.21.15.173:0/3833154955 >> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] conn(0x7f012c0707b0 0x7f012c072bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7ff150c00640 1 -- 172.21.15.173:0/1840463617 shutdown_connections 2024-04-25T09:03:11.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7ff150c00640 1 -- 172.21.15.173:0/1840463617 wait complete. 2024-04-25T09:03:11.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7f014f000640 1 -- 172.21.15.173:0/3833154955 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f012c067030 msgr2=0x7f012c0694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7f014f000640 1 --2- 172.21.15.173:0/3833154955 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f012c067030 0x7f012c0694f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f013c000c10 tx=0x7f013c009040 comp rx=0 tx=0).stop 2024-04-25T09:03:11.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7f014f000640 1 -- 172.21.15.173:0/3833154955 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01480cee70 msgr2=0x7f014814fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7f014f000640 1 --2- 172.21.15.173:0/3833154955 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01480cee70 0x7f014814fea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f01380ae040 tx=0x7f013801ac10 comp rx=0 tx=0).stop 2024-04-25T09:03:11.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7f014d000640 1 -- 172.21.15.173:0/3833154955 reap_dead start 2024-04-25T09:03:11.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7f014f000640 1 -- 172.21.15.173:0/3833154955 shutdown_connections 2024-04-25T09:03:11.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7f014f000640 1 -- 172.21.15.173:0/3833154955 >> 172.21.15.173:0/3833154955 conn(0x7f014806b290 msgr2=0x7f0148157e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7fd815800640 1 -- 172.21.15.173:0/2217091590 --> [v2:172.21.15.173:6822/4263773184,v1:172.21.15.173:6824/4263773184] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd810073a40 con 0x7fd7f00706b0 2024-04-25T09:03:11.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7f014f000640 1 -- 172.21.15.173:0/3833154955 shutdown_connections 2024-04-25T09:03:11.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7f014f000640 1 -- 172.21.15.173:0/3833154955 wait complete. 2024-04-25T09:03:11.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.934+0000 7fd807e00640 1 -- 172.21.15.173:0/2217091590 <== osd.3 v2:172.21.15.173:6822/4263773184 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd810073a40 con 0x7fd7f00706b0 2024-04-25T09:03:11.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.938+0000 7fd815800640 1 -- 172.21.15.173:0/2217091590 >> [v2:172.21.15.173:6822/4263773184,v1:172.21.15.173:6824/4263773184] conn(0x7fd7f00706b0 msgr2=0x7fd7f0072af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.938+0000 7fd815800640 1 --2- 172.21.15.173:0/2217091590 >> [v2:172.21.15.173:6822/4263773184,v1:172.21.15.173:6824/4263773184] conn(0x7fd7f00706b0 0x7fd7f0072af0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.938+0000 7fd815800640 1 -- 172.21.15.173:0/2217091590 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd7f0066fb0 msgr2=0x7fd7f0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.938+0000 7fd815800640 1 --2- 172.21.15.173:0/2217091590 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd7f0066fb0 0x7fd7f0069470 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd8101f55b0 tx=0x7fd808009040 comp rx=0 tx=0).stop 2024-04-25T09:03:11.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.938+0000 7fd815800640 1 -- 172.21.15.173:0/2217091590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8100cd8a0 msgr2=0x7fd8100ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.938+0000 7fd815800640 1 --2- 172.21.15.173:0/2217091590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8100cd8a0 0x7fd8100ce020 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd800009160 tx=0x7fd800011f50 comp rx=0 tx=0).stop 2024-04-25T09:03:11.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.938+0000 7fd814e00640 1 -- 172.21.15.173:0/2217091590 reap_dead start 2024-04-25T09:03:11.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.938+0000 7fd815800640 1 -- 172.21.15.173:0/2217091590 shutdown_connections 2024-04-25T09:03:11.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.938+0000 7fd815800640 1 -- 172.21.15.173:0/2217091590 >> 172.21.15.173:0/2217091590 conn(0x7fd8100b5a50 msgr2=0x7fd8100b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.938+0000 7fd815800640 1 -- 172.21.15.173:0/2217091590 shutdown_connections 2024-04-25T09:03:11.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.938+0000 7fd815800640 1 -- 172.21.15.173:0/2217091590 wait complete. 2024-04-25T09:03:11.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.938+0000 7f8110c00640 1 -- 172.21.15.173:0/3282053169 --> [v2:172.21.15.194:6800/2762622538,v1:172.21.15.194:6801/2762622538] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f80e4002de0 con 0x7f80e8070660 2024-04-25T09:03:11.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.938+0000 7f8102000640 1 -- 172.21.15.173:0/3282053169 <== osd.5 v2:172.21.15.194:6800/2762622538 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f80e4002de0 con 0x7f80e8070660 2024-04-25T09:03:11.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.938+0000 7f8110c00640 1 -- 172.21.15.173:0/3282053169 >> [v2:172.21.15.194:6800/2762622538,v1:172.21.15.194:6801/2762622538] conn(0x7f80e8070660 msgr2=0x7f80e8072aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.938+0000 7f8110c00640 1 --2- 172.21.15.173:0/3282053169 >> [v2:172.21.15.194:6800/2762622538,v1:172.21.15.194:6801/2762622538] conn(0x7f80e8070660 0x7f80e8072aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.942+0000 7f8110c00640 1 -- 172.21.15.173:0/3282053169 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f80e8066f60 msgr2=0x7f80e8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.942+0000 7f8110c00640 1 --2- 172.21.15.173:0/3282053169 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f80e8066f60 0x7f80e8069420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f80f00057f0 tx=0x7f81040b0040 comp rx=0 tx=0).stop 2024-04-25T09:03:11.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.942+0000 7f8110c00640 1 -- 172.21.15.173:0/3282053169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f810c15bf40 msgr2=0x7f810c162570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.942+0000 7f8110c00640 1 --2- 172.21.15.173:0/3282053169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f810c15bf40 0x7f810c162570 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f810c0aee70 tx=0x7f80fc010c20 comp rx=0 tx=0).stop 2024-04-25T09:03:11.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.942+0000 7efc14400640 1 -- 172.21.15.173:0/505119381 --> [v2:172.21.15.173:6816/3226999603,v1:172.21.15.173:6817/3226999603] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efc0c0d16d0 con 0x7efbec0706b0 2024-04-25T09:03:11.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.942+0000 7efc09600640 1 -- 172.21.15.173:0/505119381 <== osd.2 v2:172.21.15.173:6816/3226999603 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efc0c0d16d0 con 0x7efbec0706b0 2024-04-25T09:03:11.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.942+0000 7f810a800640 1 -- 172.21.15.173:0/3282053169 reap_dead start 2024-04-25T09:03:11.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7f8110c00640 1 -- 172.21.15.173:0/3282053169 shutdown_connections 2024-04-25T09:03:11.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7f8110c00640 1 -- 172.21.15.173:0/3282053169 >> 172.21.15.173:0/3282053169 conn(0x7f810c06ac90 msgr2=0x7f810c1610c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7fe951600640 1 -- 172.21.15.173:0/3906542759 --> [v2:172.21.15.194:6816/1567729259,v1:172.21.15.194:6817/1567729259] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe94c073a40 con 0x7fe92c0707a0 2024-04-25T09:03:11.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7efc14400640 1 -- 172.21.15.173:0/505119381 >> [v2:172.21.15.173:6816/3226999603,v1:172.21.15.173:6817/3226999603] conn(0x7efbec0706b0 msgr2=0x7efbec072af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7efc14400640 1 --2- 172.21.15.173:0/505119381 >> [v2:172.21.15.173:6816/3226999603,v1:172.21.15.173:6817/3226999603] conn(0x7efbec0706b0 0x7efbec072af0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7f8110c00640 1 -- 172.21.15.173:0/3282053169 shutdown_connections 2024-04-25T09:03:11.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7f8110c00640 1 -- 172.21.15.173:0/3282053169 wait complete. 2024-04-25T09:03:11.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7efc14400640 1 -- 172.21.15.173:0/505119381 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efbec066fb0 msgr2=0x7efbec069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7efc14400640 1 --2- 172.21.15.173:0/505119381 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efbec066fb0 0x7efbec069470 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efbf80ad000 tx=0x7efbf8008040 comp rx=0 tx=0).stop 2024-04-25T09:03:11.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7efc14400640 1 -- 172.21.15.173:0/505119381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc0c0cee10 msgr2=0x7efc0c0c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7efc14400640 1 --2- 172.21.15.173:0/505119381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc0c0cee10 0x7efc0c0c9cd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efc0000c700 tx=0x7efc0000cbc0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7efc12400640 1 -- 172.21.15.173:0/505119381 reap_dead start 2024-04-25T09:03:11.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7fe943e00640 1 -- 172.21.15.173:0/3906542759 <== osd.7 v2:172.21.15.194:6816/1567729259 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe94c073a40 con 0x7fe92c0707a0 2024-04-25T09:03:11.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7efc14400640 1 -- 172.21.15.173:0/505119381 shutdown_connections 2024-04-25T09:03:11.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7efc14400640 1 -- 172.21.15.173:0/505119381 >> 172.21.15.173:0/505119381 conn(0x7efc0c0d04b0 msgr2=0x7efc0c15e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7efc14400640 1 -- 172.21.15.173:0/505119381 shutdown_connections 2024-04-25T09:03:11.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7efc14400640 1 -- 172.21.15.173:0/505119381 wait complete. 2024-04-25T09:03:11.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7fe941600640 1 -- 172.21.15.173:0/3906542759 >> [v2:172.21.15.194:6816/1567729259,v1:172.21.15.194:6817/1567729259] conn(0x7fe92c0707a0 msgr2=0x7fe92c072be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7fe941600640 1 --2- 172.21.15.173:0/3906542759 >> [v2:172.21.15.194:6816/1567729259,v1:172.21.15.194:6817/1567729259] conn(0x7fe92c0707a0 0x7fe92c072be0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:11.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7fe941600640 1 -- 172.21.15.173:0/3906542759 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe92c067030 msgr2=0x7fe92c0694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7fe941600640 1 --2- 172.21.15.173:0/3906542759 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe92c067030 0x7fe92c0694f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0af000 tx=0x7fe93c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:03:11.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7fe941600640 1 -- 172.21.15.173:0/3906542759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe94c1626f0 msgr2=0x7fe94c15b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:11.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7fe941600640 1 --2- 172.21.15.173:0/3906542759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe94c1626f0 0x7fe94c15b0b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe94400b990 tx=0x7fe94400be50 comp rx=0 tx=0).stop 2024-04-25T09:03:11.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7fe950c00640 1 -- 172.21.15.173:0/3906542759 reap_dead start 2024-04-25T09:03:11.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7fe941600640 1 -- 172.21.15.173:0/3906542759 shutdown_connections 2024-04-25T09:03:11.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7fe941600640 1 -- 172.21.15.173:0/3906542759 >> 172.21.15.173:0/3906542759 conn(0x7fe94c06b290 msgr2=0x7fe94c157430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:11.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7fe941600640 1 -- 172.21.15.173:0/3906542759 shutdown_connections 2024-04-25T09:03:11.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:11.946+0000 7fe941600640 1 -- 172.21.15.173:0/3906542759 wait complete. 2024-04-25T09:03:11.957 INFO:teuthology.orchestra.run.smithi173.stdout:64424509450 2024-04-25T09:03:11.957 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T09:03:11.958 INFO:teuthology.orchestra.run.smithi173.stdout:64424509450 2024-04-25T09:03:11.959 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T09:03:11.971 INFO:teuthology.orchestra.run.smithi173.stdout:64424509449 2024-04-25T09:03:11.971 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T09:03:11.974 INFO:teuthology.orchestra.run.smithi173.stdout:64424509449 2024-04-25T09:03:11.974 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T09:03:11.975 INFO:teuthology.orchestra.run.smithi173.stdout:64424509449 2024-04-25T09:03:11.975 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T09:03:11.976 INFO:teuthology.orchestra.run.smithi173.stdout:64424509450 2024-04-25T09:03:11.976 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T09:03:11.982 INFO:teuthology.orchestra.run.smithi173.stdout:64424509449 2024-04-25T09:03:11.982 INFO:teuthology.orchestra.run.smithi173.stdout:55834574858 2024-04-25T09:03:11.983 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T09:03:11.983 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T09:03:12.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.182+0000 7fb848800640 1 Processor -- start 2024-04-25T09:03:12.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.186+0000 7fb848800640 1 -- start start 2024-04-25T09:03:12.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.186+0000 7fb848800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb83c052420 0x7fb83c0516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.186+0000 7fb848800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83c054880 con 0x7fb83c0e1300 2024-04-25T09:03:12.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.186+0000 7fb848800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83c054b60 con 0x7fb83c03a250 2024-04-25T09:03:12.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.186+0000 7fb848800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb83c055490 con 0x7fb83c052420 2024-04-25T09:03:12.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.186+0000 7fb845e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fb83c0e1300 0x7fb83c051d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60552/0 (socket says 172.21.15.173:60552) 2024-04-25T09:03:12.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.186+0000 7fb845e00640 1 -- 172.21.15.173:0/2839061417 learned_addr learned my addr 172.21.15.173:0/2839061417 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:12.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.186+0000 7fb845400640 1 --2- 172.21.15.173:0/2839061417 >> v2:172.21.15.173:3300/0 conn(0x7fb83c052420 0x7fb83c0516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.186+0000 7fb844a00640 1 -- 172.21.15.173:0/2839061417 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096558125 0 0) 0x7fb83c054880 con 0x7fb83c0e1300 2024-04-25T09:03:12.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.186+0000 7fb844a00640 1 -- 172.21.15.173:0/2839061417 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb828003530 con 0x7fb83c0e1300 2024-04-25T09:03:12.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb844a00640 1 -- 172.21.15.173:0/2839061417 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3687973649 0 0) 0x7fb828003530 con 0x7fb83c0e1300 2024-04-25T09:03:12.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb844a00640 1 -- 172.21.15.173:0/2839061417 >> v2:172.21.15.173:3300/0 conn(0x7fb83c052420 msgr2=0x7fb83c0516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:12.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb844a00640 1 --2- 172.21.15.173:0/2839061417 >> v2:172.21.15.173:3300/0 conn(0x7fb83c052420 0x7fb83c0516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb844a00640 1 -- 172.21.15.173:0/2839061417 >> v1:172.21.15.194:6789/0 conn(0x7fb83c03a250 legacy=0x7fb83c055920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb844a00640 1 -- 172.21.15.173:0/2839061417 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c054e40 con 0x7fb83c0e1300 2024-04-25T09:03:12.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb844a00640 1 -- 172.21.15.173:0/2839061417 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fb8340016d0 con 0x7fb83c0e1300 2024-04-25T09:03:12.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb844a00640 1 -- 172.21.15.173:0/2839061417 >> v1:172.21.15.173:6789/0 conn(0x7fb83c0e1300 legacy=0x7fb83c051d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb844a00640 1 --2- 172.21.15.173:0/2839061417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8280039c0 0x7fb828003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb844a00640 1 --2- 172.21.15.173:0/2839061417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb828004810 0x7fb828004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb844a00640 1 --2- 172.21.15.173:0/2839061417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8280051d0 0x7fb82800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb844a00640 1 -- 172.21.15.173:0/2839061417 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c055490 con 0x7fb8280039c0 2024-04-25T09:03:12.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb844a00640 1 -- 172.21.15.173:0/2839061417 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82800c050 con 0x7fb8280051d0 2024-04-25T09:03:12.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb844a00640 1 -- 172.21.15.173:0/2839061417 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb828010660 con 0x7fb828004810 2024-04-25T09:03:12.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb845400640 1 --2- 172.21.15.173:0/2839061417 >> v2:172.21.15.173:3300/0 conn(0x7fb83c052420 0x7fb83c0516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:12.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb846800640 1 --2- 172.21.15.173:0/2839061417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8280051d0 0x7fb82800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb845e00640 1 --2- 172.21.15.173:0/2839061417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8280039c0 0x7fb828003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb846800640 1 -- 172.21.15.173:0/2839061417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb828004810 msgr2=0x7fb828004c90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T09:03:12.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb846800640 1 --2- 172.21.15.173:0/2839061417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb828004810 0x7fb828004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb846800640 1 -- 172.21.15.173:0/2839061417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8280039c0 msgr2=0x7fb828003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:12.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb846800640 1 --2- 172.21.15.173:0/2839061417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8280039c0 0x7fb828003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.190+0000 7fb846800640 1 -- 172.21.15.173:0/2839061417 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c054e40 con 0x7fb8280051d0 2024-04-25T09:03:12.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.194+0000 7fb846800640 1 -- 172.21.15.173:0/2839061417 reap_dead start 2024-04-25T09:03:12.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.194+0000 7fb846800640 1 --2- 172.21.15.173:0/2839061417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8280051d0 0x7fb82800b9d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb840050870 tx=0x7fb840097230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35e70d29d08706bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.194+0000 7fb844a00640 1 -- 172.21.15.173:0/2839061417 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84004f4a0 con 0x7fb8280051d0 2024-04-25T09:03:12.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.194+0000 7fb844a00640 1 -- 172.21.15.173:0/2839061417 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb840126440 con 0x7fb8280051d0 2024-04-25T09:03:12.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.194+0000 7fb844a00640 1 -- 172.21.15.173:0/2839061417 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840126810 con 0x7fb8280051d0 2024-04-25T09:03:12.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.202+0000 7fb848800640 1 -- 172.21.15.173:0/2839061417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8280051d0 msgr2=0x7fb82800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.202+0000 7fb848800640 1 --2- 172.21.15.173:0/2839061417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8280051d0 0x7fb82800b9d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb840050870 tx=0x7fb840097230 comp rx=0 tx=0).stop 2024-04-25T09:03:12.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.202+0000 7fb848800640 1 -- 172.21.15.173:0/2839061417 shutdown_connections 2024-04-25T09:03:12.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.202+0000 7fb848800640 1 --2- 172.21.15.173:0/2839061417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8280051d0 0x7fb82800b9d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.202+0000 7fb848800640 1 -- 172.21.15.173:0/2839061417 >> 172.21.15.173:0/2839061417 conn(0x7fb83c0537c0 msgr2=0x7fb83c053bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:12.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.202+0000 7fb848800640 1 -- 172.21.15.173:0/2839061417 shutdown_connections 2024-04-25T09:03:12.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.202+0000 7fb848800640 1 -- 172.21.15.173:0/2839061417 wait complete. 2024-04-25T09:03:12.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.202+0000 7fb848800640 1 Processor -- start 2024-04-25T09:03:12.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.202+0000 7fb848800640 1 -- start start 2024-04-25T09:03:12.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.202+0000 7f934bc00640 1 Processor -- start 2024-04-25T09:03:12.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.202+0000 7f934bc00640 1 -- start start 2024-04-25T09:03:12.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fa612200640 1 Processor -- start 2024-04-25T09:03:12.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7f934bc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9344161ee0 0x7f934406ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7f934bc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f93440cb7f0 0x7f934406bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7f934bc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934406dc00 con 0x7f93441622c0 2024-04-25T09:03:12.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7f934bc00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93440cbd20 con 0x7f93440cb7f0 2024-04-25T09:03:12.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7f934bc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93440cc000 con 0x7f9344161ee0 2024-04-25T09:03:12.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fa612200640 1 -- start start 2024-04-25T09:03:12.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fa612200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c0c5a10 0x7fa60c165530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fb848800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8280051d0 0x7fb83c180440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fb848800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb83c03b160 0x7fb83c0dfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fb848800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb83c03d5e0 0x7fb83c03da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fb848800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c051a30 con 0x7fb8280051d0 2024-04-25T09:03:12.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fb848800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c0518b0 con 0x7fb83c03b160 2024-04-25T09:03:12.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fb848800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c051d10 con 0x7fb83c03d5e0 2024-04-25T09:03:12.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fb845400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb83c03b160 0x7fb83c0dfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fb845400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb83c03b160 0x7fb83c0dfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:56814/0 (socket says 172.21.15.173:56814) 2024-04-25T09:03:12.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fb845400640 1 -- 172.21.15.173:0/535148421 learned_addr learned my addr 172.21.15.173:0/535148421 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:12.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fb846800640 1 --2- 172.21.15.173:0/535148421 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb83c03d5e0 0x7fb83c03da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fb845400640 1 -- 172.21.15.173:0/535148421 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb83c03d5e0 msgr2=0x7fb83c03da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fb845400640 1 --2- 172.21.15.173:0/535148421 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb83c03d5e0 0x7fb83c03da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fb845400640 1 -- 172.21.15.173:0/535148421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8280051d0 msgr2=0x7fb83c180440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fb845400640 1 --2- 172.21.15.173:0/535148421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8280051d0 0x7fb83c180440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fb845400640 1 -- 172.21.15.173:0/535148421 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c0055f0 con 0x7fb83c03b160 2024-04-25T09:03:12.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fb846800640 1 --2- 172.21.15.173:0/535148421 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb83c03d5e0 0x7fb83c03da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:12.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fa612200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60c0ccea0 con 0x7fa60c15ab80 2024-04-25T09:03:12.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fa612200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60c0c6000 con 0x7fa60c0cd860 2024-04-25T09:03:12.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fa612200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0c68a0 con 0x7fa60c0c5a10 2024-04-25T09:03:12.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7f9343e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f93440cb7f0 0x7f934406bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7fb845400640 1 --2- 172.21.15.173:0/535148421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb83c03b160 0x7fb83c0dfa50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb83000d600 tx=0x7fb83000dac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7f9343e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f93440cb7f0 0x7f934406bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33130/0 (socket says 172.21.15.173:33130) 2024-04-25T09:03:12.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7f9349c00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f93441622c0 0x7f93440ce120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:44976/0 (socket says 172.21.15.173:44976) 2024-04-25T09:03:12.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7f9349c00640 1 -- 172.21.15.173:0/3623073438 learned_addr learned my addr 172.21.15.173:0/3623073438 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:12.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.206+0000 7f9349200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9344161ee0 0x7f934406ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7faf43000640 1 Processor -- start 2024-04-25T09:03:12.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7fa60aa00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa60c0cd860 0x7fa60c0ce7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:44980/0 (socket says 172.21.15.173:44980) 2024-04-25T09:03:12.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7fb83a000640 1 -- 172.21.15.173:0/535148421 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830004230 con 0x7fb83c03b160 2024-04-25T09:03:12.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7fb83a000640 1 -- 172.21.15.173:0/535148421 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8300043d0 con 0x7fb83c03b160 2024-04-25T09:03:12.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7fb83a000640 1 -- 172.21.15.173:0/535148421 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830003840 con 0x7fb83c03b160 2024-04-25T09:03:12.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7faf43000640 1 -- start start 2024-04-25T09:03:12.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7fa60aa00640 1 -- 172.21.15.173:0/4180550995 learned_addr learned my addr 172.21.15.173:0/4180550995 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:12.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7f9349200640 1 -- 172.21.15.173:0/3623073438 >> v2:172.21.15.173:3300/0 conn(0x7f93440cb7f0 msgr2=0x7f934406bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:12.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7fb848800640 1 -- 172.21.15.173:0/535148421 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83c03b9b0 con 0x7fb83c03b160 2024-04-25T09:03:12.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7fb848800640 1 -- 172.21.15.173:0/535148421 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83c03bf70 con 0x7fb83c03b160 2024-04-25T09:03:12.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7fa60be00640 1 --2- 172.21.15.173:0/4180550995 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c0c5a10 0x7fa60c165530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7fa60be00640 1 -- 172.21.15.173:0/4180550995 >> v1:172.21.15.194:6789/0 conn(0x7fa60c0cd860 legacy=0x7fa60c0ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7fa60be00640 1 -- 172.21.15.173:0/4180550995 >> v1:172.21.15.173:6789/0 conn(0x7fa60c15ab80 legacy=0x7fa60c0cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:12.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7fa60be00640 1 -- 172.21.15.173:0/4180550995 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c0c62e0 con 0x7fa60c0c5a10 2024-04-25T09:03:12.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7f9343400640 1 -- 172.21.15.173:0/3623073438 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185506112 0 0) 0x7f934406dc00 con 0x7f93441622c0 2024-04-25T09:03:12.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7faf43000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7faf3c159980 0x7faf3c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7faf43000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7faf3c0b08d0 0x7faf3c0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7faf43000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3c0b0d60 con 0x7faf3c071280 2024-04-25T09:03:12.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7faf43000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3c0cd160 con 0x7faf3c159980 2024-04-25T09:03:12.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7faf43000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3c0cd440 con 0x7faf3c0b08d0 2024-04-25T09:03:12.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7fb848800640 1 -- 172.21.15.173:0/535148421 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb81c0052a0 con 0x7fb83c03b160 2024-04-25T09:03:12.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7faf41200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7faf3c0b08d0 0x7faf3c0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7faf41200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7faf3c0b08d0 0x7faf3c0ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:56816/0 (socket says 172.21.15.173:56816) 2024-04-25T09:03:12.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7faf41200640 1 -- 172.21.15.173:0/4198959063 learned_addr learned my addr 172.21.15.173:0/4198959063 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:12.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7f9349200640 1 --2- 172.21.15.173:0/3623073438 >> v2:172.21.15.173:3300/0 conn(0x7f93440cb7f0 0x7f934406bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7f9349200640 1 -- 172.21.15.173:0/3623073438 >> v1:172.21.15.194:6789/0 conn(0x7f93441622c0 legacy=0x7f93440ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7f9349200640 1 -- 172.21.15.173:0/3623073438 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93440cc2e0 con 0x7f9344161ee0 2024-04-25T09:03:12.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.210+0000 7f9343e00640 1 --2- 172.21.15.173:0/3623073438 >> v2:172.21.15.173:3300/0 conn(0x7f93440cb7f0 0x7f934406bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:12.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7faf41c00640 1 --2- 172.21.15.173:0/4198959063 >> v2:172.21.15.173:3300/0 conn(0x7faf3c159980 0x7faf3c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7faf41200640 1 -- 172.21.15.173:0/4198959063 >> v2:172.21.15.173:3300/0 conn(0x7faf3c159980 msgr2=0x7faf3c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:12.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7faf41200640 1 --2- 172.21.15.173:0/4198959063 >> v2:172.21.15.173:3300/0 conn(0x7faf3c159980 0x7faf3c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7faf41200640 1 -- 172.21.15.173:0/4198959063 >> v1:172.21.15.194:6789/0 conn(0x7faf3c071280 legacy=0x7faf3c06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7fa60be00640 1 --2- 172.21.15.173:0/4180550995 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c0c5a10 0x7fa60c165530 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa60400b620 tx=0x7fa604020cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79e3c52449ba6f53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7fa60a000640 1 -- 172.21.15.173:0/4180550995 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60400b2d0 con 0x7fa60c0c5a10 2024-04-25T09:03:12.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7fa60a000640 1 -- 172.21.15.173:0/4180550995 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6040a98c0 con 0x7fa60c0c5a10 2024-04-25T09:03:12.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7fa60a000640 1 -- 172.21.15.173:0/4180550995 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6040a9c90 con 0x7fa60c0c5a10 2024-04-25T09:03:12.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7fb83a000640 1 -- 172.21.15.173:0/535148421 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb8300039e0 con 0x7fb83c03b160 2024-04-25T09:03:12.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7fb83a000640 1 --2- 172.21.15.173:0/535148421 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb824067060 0x7fb824069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7fb83a000640 1 -- 172.21.15.173:0/535148421 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb8300969e0 con 0x7fb83c03b160 2024-04-25T09:03:12.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7f9349200640 1 --2- 172.21.15.173:0/3623073438 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9344161ee0 0x7f934406ff30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f933c009d90 tx=0x7f933c01f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4064a9221fe003c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7fa612200640 1 -- 172.21.15.173:0/4180550995 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c0c5a10 msgr2=0x7fa60c165530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7fa612200640 1 --2- 172.21.15.173:0/4180550995 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c0c5a10 0x7fa60c165530 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa60400b620 tx=0x7fa604020cf0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7fb845e00640 1 --2- 172.21.15.173:0/535148421 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb824067060 0x7fb824069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7f9343400640 1 -- 172.21.15.173:0/3623073438 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c0b4070 con 0x7f9344161ee0 2024-04-25T09:03:12.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7f9343400640 1 -- 172.21.15.173:0/3623073438 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933c0af600 con 0x7f9344161ee0 2024-04-25T09:03:12.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7f9343400640 1 -- 172.21.15.173:0/3623073438 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c0b4070 con 0x7f9344161ee0 2024-04-25T09:03:12.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7fa612200640 1 -- 172.21.15.173:0/4180550995 shutdown_connections 2024-04-25T09:03:12.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7fa612200640 1 --2- 172.21.15.173:0/4180550995 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c0c5a10 0x7fa60c165530 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7fa612200640 1 -- 172.21.15.173:0/4180550995 >> 172.21.15.173:0/4180550995 conn(0x7fa60c0b23a0 msgr2=0x7fa60c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:12.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7fa612200640 1 -- 172.21.15.173:0/4180550995 shutdown_connections 2024-04-25T09:03:12.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7faf41200640 1 -- 172.21.15.173:0/4198959063 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c0cd720 con 0x7faf3c0b08d0 2024-04-25T09:03:12.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.214+0000 7fa612200640 1 -- 172.21.15.173:0/4180550995 wait complete. 2024-04-25T09:03:12.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.218+0000 7f934bc00640 1 -- 172.21.15.173:0/3623073438 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9344161ee0 msgr2=0x7f934406ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.218+0000 7f934bc00640 1 --2- 172.21.15.173:0/3623073438 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9344161ee0 0x7f934406ff30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f933c009d90 tx=0x7f933c01f150 comp rx=0 tx=0).stop 2024-04-25T09:03:12.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.218+0000 7fb845e00640 1 --2- 172.21.15.173:0/535148421 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb824067060 0x7fb824069520 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb83c04d050 tx=0x7fb834001c40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.218+0000 7f934bc00640 1 -- 172.21.15.173:0/3623073438 shutdown_connections 2024-04-25T09:03:12.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.218+0000 7f934bc00640 1 --2- 172.21.15.173:0/3623073438 >> v2:172.21.15.173:3300/0 conn(0x7f93440cb7f0 0x7f934406bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.218+0000 7f934bc00640 1 --2- 172.21.15.173:0/3623073438 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9344161ee0 0x7f934406ff30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.218+0000 7f934bc00640 1 -- 172.21.15.173:0/3623073438 >> 172.21.15.173:0/3623073438 conn(0x7f9344071ba0 msgr2=0x7f9344071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:12.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.218+0000 7faf41200640 1 --2- 172.21.15.173:0/4198959063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf3c0b08d0 0x7faf3c0ce200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0b1410 tx=0x7faf2801e830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb018ff45b218dc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.218+0000 7f934bc00640 1 -- 172.21.15.173:0/3623073438 shutdown_connections 2024-04-25T09:03:12.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.218+0000 7fa612200640 1 Processor -- start 2024-04-25T09:03:12.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.218+0000 7fa612200640 1 -- start start 2024-04-25T09:03:12.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.218+0000 7fb83a000640 1 -- 172.21.15.173:0/535148421 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb830022350 con 0x7fb83c03b160 2024-04-25T09:03:12.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7fa612200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c0c5a10 0x7fa60c149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7fa612200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa60c0cd860 0x7fa60c14a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7fa612200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa60c15ab80 0x7fa60c14aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7fa612200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c06b620 con 0x7fa60c15ab80 2024-04-25T09:03:12.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7fa612200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c06b4a0 con 0x7fa60c0cd860 2024-04-25T09:03:12.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7fa612200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c06b7a0 con 0x7fa60c0c5a10 2024-04-25T09:03:12.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.218+0000 7f934bc00640 1 -- 172.21.15.173:0/3623073438 wait complete. 2024-04-25T09:03:12.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.218+0000 7faf3be00640 1 -- 172.21.15.173:0/4198959063 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf280ad070 con 0x7faf3c0b08d0 2024-04-25T09:03:12.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.218+0000 7faf3be00640 1 -- 172.21.15.173:0/4198959063 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf280a7770 con 0x7faf3c0b08d0 2024-04-25T09:03:12.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.218+0000 7faf3be00640 1 -- 172.21.15.173:0/4198959063 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf280a7b40 con 0x7faf3c0b08d0 2024-04-25T09:03:12.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7f934bc00640 1 Processor -- start 2024-04-25T09:03:12.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7fa60b400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c0c5a10 0x7fa60c149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7fa60be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa60c15ab80 0x7fa60c14aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7fa60b400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c0c5a10 0x7fa60c149300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:40012/0 (socket says 172.21.15.173:40012) 2024-04-25T09:03:12.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7fa60b400640 1 -- 172.21.15.173:0/993163677 learned_addr learned my addr 172.21.15.173:0/993163677 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:12.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7faf43000640 1 -- 172.21.15.173:0/4198959063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf3c0b08d0 msgr2=0x7faf3c0ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7faf43000640 1 --2- 172.21.15.173:0/4198959063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf3c0b08d0 0x7faf3c0ce200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0b1410 tx=0x7faf2801e830 comp rx=0 tx=0).stop 2024-04-25T09:03:12.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7f934bc00640 1 -- start start 2024-04-25T09:03:12.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7faf43000640 1 -- 172.21.15.173:0/4198959063 shutdown_connections 2024-04-25T09:03:12.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7faf43000640 1 --2- 172.21.15.173:0/4198959063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf3c0b08d0 0x7faf3c0ce200 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7faf43000640 1 --2- 172.21.15.173:0/4198959063 >> v2:172.21.15.173:3300/0 conn(0x7faf3c159980 0x7faf3c0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7faf43000640 1 -- 172.21.15.173:0/4198959063 >> 172.21.15.173:0/4198959063 conn(0x7faf3c061ab0 msgr2=0x7faf3c06ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:12.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7faf43000640 1 -- 172.21.15.173:0/4198959063 shutdown_connections 2024-04-25T09:03:12.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7faf43000640 1 -- 172.21.15.173:0/4198959063 wait complete. 2024-04-25T09:03:12.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7f934bc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93440cb7f0 0x7f934414cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7f934bc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9344161ee0 0x7f93440c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7f934bc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93441622c0 0x7f93440c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7fa60aa00640 1 --2- 172.21.15.173:0/993163677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa60c0cd860 0x7fa60c14a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7f9343e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9344161ee0 0x7f93440c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7f9349200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93440cb7f0 0x7f934414cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7f9349200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93440cb7f0 0x7f934414cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:56836/0 (socket says 172.21.15.173:56836) 2024-04-25T09:03:12.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7f9349200640 1 -- 172.21.15.173:0/2409856566 learned_addr learned my addr 172.21.15.173:0/2409856566 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:12.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7fa60aa00640 1 -- 172.21.15.173:0/993163677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c0c5a10 msgr2=0x7fa60c149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7fa60aa00640 1 --2- 172.21.15.173:0/993163677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c0c5a10 0x7fa60c149300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7fa60aa00640 1 -- 172.21.15.173:0/993163677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa60c15ab80 msgr2=0x7fa60c14aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7fa60aa00640 1 --2- 172.21.15.173:0/993163677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa60c15ab80 0x7fa60c14aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7fa60aa00640 1 -- 172.21.15.173:0/993163677 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c157580 con 0x7fa60c0cd860 2024-04-25T09:03:12.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7f934bc00640 1 -- 172.21.15.173:0/2409856566 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9344070470 con 0x7f9344161ee0 2024-04-25T09:03:12.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7f934bc00640 1 -- 172.21.15.173:0/2409856566 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934406f0f0 con 0x7f93440cb7f0 2024-04-25T09:03:12.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7f934bc00640 1 -- 172.21.15.173:0/2409856566 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93440c9b90 con 0x7f93441622c0 2024-04-25T09:03:12.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7f9349c00640 1 --2- 172.21.15.173:0/2409856566 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93441622c0 0x7f93440c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7fa60aa00640 1 --2- 172.21.15.173:0/993163677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa60c0cd860 0x7fa60c14a590 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa5f800c460 tx=0x7fa5f800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7f9349c00640 1 -- 172.21.15.173:0/2409856566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93440cb7f0 msgr2=0x7f934414cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7f9349c00640 1 --2- 172.21.15.173:0/2409856566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93440cb7f0 0x7f934414cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7f9349c00640 1 -- 172.21.15.173:0/2409856566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9344161ee0 msgr2=0x7f93440c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7f9349c00640 1 --2- 172.21.15.173:0/2409856566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9344161ee0 0x7f93440c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.222+0000 7f9349c00640 1 -- 172.21.15.173:0/2409856566 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93440c8f80 con 0x7f93441622c0 2024-04-25T09:03:12.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7f9349c00640 1 --2- 172.21.15.173:0/2409856566 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93441622c0 0x7f93440c6270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f933400c440 tx=0x7f933400c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7fa603400640 1 -- 172.21.15.173:0/993163677 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8017070 con 0x7fa60c0cd860 2024-04-25T09:03:12.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7fa603400640 1 -- 172.21.15.173:0/993163677 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f8005cf0 con 0x7fa60c0cd860 2024-04-25T09:03:12.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7fa603400640 1 -- 172.21.15.173:0/993163677 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80072d0 con 0x7fa60c0cd860 2024-04-25T09:03:12.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7fa612200640 1 -- 172.21.15.173:0/993163677 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c157860 con 0x7fa60c0cd860 2024-04-25T09:03:12.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7fa612200640 1 -- 172.21.15.173:0/993163677 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60c1566c0 con 0x7fa60c0cd860 2024-04-25T09:03:12.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7faf43000640 1 Processor -- start 2024-04-25T09:03:12.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7faf43000640 1 -- start start 2024-04-25T09:03:12.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7f9340c00640 1 -- 172.21.15.173:0/2409856566 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93340074e0 con 0x7f93441622c0 2024-04-25T09:03:12.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7f934bc00640 1 -- 172.21.15.173:0/2409856566 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93440c9260 con 0x7f93441622c0 2024-04-25T09:03:12.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7f934bc00640 1 -- 172.21.15.173:0/2409856566 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93440c9820 con 0x7f93441622c0 2024-04-25T09:03:12.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7f9340c00640 1 -- 172.21.15.173:0/2409856566 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93340047f0 con 0x7f93441622c0 2024-04-25T09:03:12.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7f9340c00640 1 -- 172.21.15.173:0/2409856566 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9334004be0 con 0x7f93441622c0 2024-04-25T09:03:12.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7faf43000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf3c071280 0x7faf3c14aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7faf43000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf3c0b08d0 0x7faf3c1eb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7faf43000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf3c159980 0x7faf3c2037a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7faf43000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c071aa0 con 0x7faf3c0b08d0 2024-04-25T09:03:12.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7faf43000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c166710 con 0x7faf3c159980 2024-04-25T09:03:12.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7faf43000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c155830 con 0x7faf3c071280 2024-04-25T09:03:12.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7faf41200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf3c0b08d0 0x7faf3c1eb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7faf41200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf3c0b08d0 0x7faf3c1eb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33164/0 (socket says 172.21.15.173:33164) 2024-04-25T09:03:12.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7faf41200640 1 -- 172.21.15.173:0/4016291922 learned_addr learned my addr 172.21.15.173:0/4016291922 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:12.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7f934bc00640 1 -- 172.21.15.173:0/2409856566 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9344073ab0 con 0x7f93441622c0 2024-04-25T09:03:12.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7faf42600640 1 --2- 172.21.15.173:0/4016291922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf3c159980 0x7faf3c2037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7faf41200640 1 -- 172.21.15.173:0/4016291922 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf3c071280 msgr2=0x7faf3c14aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7faf41c00640 1 --2- 172.21.15.173:0/4016291922 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf3c071280 0x7faf3c14aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7faf41200640 1 --2- 172.21.15.173:0/4016291922 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf3c071280 0x7faf3c14aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7faf41200640 1 -- 172.21.15.173:0/4016291922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf3c159980 msgr2=0x7faf3c2037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7faf41200640 1 --2- 172.21.15.173:0/4016291922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf3c159980 0x7faf3c2037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7faf41200640 1 -- 172.21.15.173:0/4016291922 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c203ce0 con 0x7faf3c0b08d0 2024-04-25T09:03:12.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7faf42600640 1 --2- 172.21.15.173:0/4016291922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf3c159980 0x7faf3c2037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:12.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7faf41c00640 1 --2- 172.21.15.173:0/4016291922 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf3c071280 0x7faf3c14aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:12.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7faf41200640 1 --2- 172.21.15.173:0/4016291922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf3c0b08d0 0x7faf3c1eb5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faf2801cee0 tx=0x7faf2801d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.226+0000 7fa603400640 1 -- 172.21.15.173:0/993163677 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa5f801a070 con 0x7fa60c0cd860 2024-04-25T09:03:12.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7fa603400640 1 --2- 172.21.15.173:0/993163677 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa5ec066fe0 0x7fa5ec0694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7fa603400640 1 -- 172.21.15.173:0/993163677 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa5f8084590 con 0x7fa60c0cd860 2024-04-25T09:03:12.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7fa60b400640 1 --2- 172.21.15.173:0/993163677 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa5ec066fe0 0x7fa5ec0694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7fa612200640 1 -- 172.21.15.173:0/993163677 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60c06cd30 con 0x7fa60c0cd860 2024-04-25T09:03:12.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7faf39600640 1 -- 172.21.15.173:0/4016291922 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf280c0070 con 0x7faf3c0b08d0 2024-04-25T09:03:12.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7faf39600640 1 -- 172.21.15.173:0/4016291922 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf28008bf0 con 0x7faf3c0b08d0 2024-04-25T09:03:12.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.230+0000 7faf39600640 1 -- 172.21.15.173:0/4016291922 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf280ad040 con 0x7faf3c0b08d0 2024-04-25T09:03:12.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.234+0000 7fa60b400640 1 --2- 172.21.15.173:0/993163677 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa5ec066fe0 0x7fa5ec0694a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa60c149ff0 tx=0x7fa5fc009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.234+0000 7faf43000640 1 -- 172.21.15.173:0/4016291922 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3c1ebcf0 con 0x7faf3c0b08d0 2024-04-25T09:03:12.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.234+0000 7faf43000640 1 -- 172.21.15.173:0/4016291922 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3c1ec2b0 con 0x7faf3c0b08d0 2024-04-25T09:03:12.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.234+0000 7faf43000640 1 -- 172.21.15.173:0/4016291922 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3c06bc20 con 0x7faf3c0b08d0 2024-04-25T09:03:12.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.234+0000 7f9340c00640 1 -- 172.21.15.173:0/2409856566 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9334011070 con 0x7f93441622c0 2024-04-25T09:03:12.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.234+0000 7f9340c00640 1 --2- 172.21.15.173:0/2409856566 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9324067030 0x7f93240694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.234+0000 7f9340c00640 1 -- 172.21.15.173:0/2409856566 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9334084e30 con 0x7f93441622c0 2024-04-25T09:03:12.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.234+0000 7f9349200640 1 --2- 172.21.15.173:0/2409856566 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9324067030 0x7f93240694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.238+0000 7f9349200640 1 --2- 172.21.15.173:0/2409856566 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9324067030 0x7f93240694f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f933c009d90 tx=0x7f933c0aa000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.238+0000 7fa603400640 1 -- 172.21.15.173:0/993163677 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa5f8054bf0 con 0x7fa60c0cd860 2024-04-25T09:03:12.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.238+0000 7faf39600640 1 -- 172.21.15.173:0/4016291922 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faf2800b160 con 0x7faf3c0b08d0 2024-04-25T09:03:12.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.238+0000 7faf39600640 1 --2- 172.21.15.173:0/4016291922 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf1c066f60 0x7faf1c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.238+0000 7faf41c00640 1 --2- 172.21.15.173:0/4016291922 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf1c066f60 0x7faf1c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.238+0000 7faf39600640 1 -- 172.21.15.173:0/4016291922 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7faf2811ecb0 con 0x7faf3c0b08d0 2024-04-25T09:03:12.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.242+0000 7faf41c00640 1 --2- 172.21.15.173:0/4016291922 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf1c066f60 0x7faf1c069420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faf30009a40 tx=0x7faf30008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.242+0000 7f9340c00640 1 -- 172.21.15.173:0/2409856566 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9334055400 con 0x7f93441622c0 2024-04-25T09:03:12.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.246+0000 7faf39600640 1 -- 172.21.15.173:0/4016291922 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faf3c203ce0 con 0x7faf3c0b08d0 2024-04-25T09:03:12.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.282+0000 7f1215400640 1 Processor -- start 2024-04-25T09:03:12.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.282+0000 7f1215400640 1 -- start start 2024-04-25T09:03:12.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f1215400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f121016acc0 0x7f121016d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f1215400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12101632c0 con 0x7f121015c620 2024-04-25T09:03:12.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f1215400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121006e1e0 con 0x7f12100716c0 2024-04-25T09:03:12.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f1215400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121006edf0 con 0x7f121016acc0 2024-04-25T09:03:12.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120fe00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f12100716c0 0x7f1210071aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:44992/0 (socket says 172.21.15.173:44992) 2024-04-25T09:03:12.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120fe00640 1 -- 172.21.15.173:0/2943426089 learned_addr learned my addr 172.21.15.173:0/2943426089 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:12.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f1214a00640 1 --2- 172.21.15.173:0/2943426089 >> v2:172.21.15.194:3300/0 conn(0x7f121016acc0 0x7f121016d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120ea00640 1 -- 172.21.15.173:0/2943426089 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493618698 0 0) 0x7f121006e1e0 con 0x7f12100716c0 2024-04-25T09:03:12.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120ea00640 1 -- 172.21.15.173:0/2943426089 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11f4003530 con 0x7f12100716c0 2024-04-25T09:03:12.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120ea00640 1 -- 172.21.15.173:0/2943426089 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4005938346 0 0) 0x7f11f4003530 con 0x7f12100716c0 2024-04-25T09:03:12.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120ea00640 1 -- 172.21.15.173:0/2943426089 >> v2:172.21.15.194:3300/0 conn(0x7f121016acc0 msgr2=0x7f121016d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:12.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120ea00640 1 --2- 172.21.15.173:0/2943426089 >> v2:172.21.15.194:3300/0 conn(0x7f121016acc0 0x7f121016d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120ea00640 1 -- 172.21.15.173:0/2943426089 >> v1:172.21.15.173:6789/0 conn(0x7f121015c620 legacy=0x7f1210162bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120ea00640 1 -- 172.21.15.173:0/2943426089 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121006e4c0 con 0x7f12100716c0 2024-04-25T09:03:12.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120ea00640 1 -- 172.21.15.173:0/2943426089 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f1200001680 con 0x7f12100716c0 2024-04-25T09:03:12.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120ea00640 1 -- 172.21.15.173:0/2943426089 >> v1:172.21.15.194:6789/0 conn(0x7f12100716c0 legacy=0x7f1210071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120ea00640 1 --2- 172.21.15.173:0/2943426089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f40039c0 0x7f11f4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120ea00640 1 --2- 172.21.15.173:0/2943426089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11f4004810 0x7f11f4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120ea00640 1 --2- 172.21.15.173:0/2943426089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11f40051d0 0x7f11f400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120ea00640 1 -- 172.21.15.173:0/2943426089 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121006edf0 con 0x7f11f40051d0 2024-04-25T09:03:12.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120ea00640 1 -- 172.21.15.173:0/2943426089 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f400c170 con 0x7f11f4004810 2024-04-25T09:03:12.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120ea00640 1 -- 172.21.15.173:0/2943426089 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f400c370 con 0x7f11f40039c0 2024-04-25T09:03:12.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120fe00640 1 --2- 172.21.15.173:0/2943426089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f40039c0 0x7f11f4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f120f400640 1 --2- 172.21.15.173:0/2943426089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11f4004810 0x7f11f4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.286+0000 7f1214a00640 1 --2- 172.21.15.173:0/2943426089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11f40051d0 0x7f11f400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.290+0000 7f120fe00640 1 -- 172.21.15.173:0/2943426089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11f4004810 msgr2=0x7f11f4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:12.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.290+0000 7f120fe00640 1 --2- 172.21.15.173:0/2943426089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11f4004810 0x7f11f4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.290+0000 7f120fe00640 1 -- 172.21.15.173:0/2943426089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11f40051d0 msgr2=0x7f11f400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:12.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.290+0000 7f120fe00640 1 --2- 172.21.15.173:0/2943426089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11f40051d0 0x7f11f400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.290+0000 7f120fe00640 1 -- 172.21.15.173:0/2943426089 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121006e4c0 con 0x7f11f40039c0 2024-04-25T09:03:12.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.290+0000 7f1214a00640 1 -- 172.21.15.173:0/2943426089 reap_dead start 2024-04-25T09:03:12.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.298+0000 7f120fe00640 1 --2- 172.21.15.173:0/2943426089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f40039c0 0x7f11f4003de0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1200001060 tx=0x7f120001f3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8410612f0e797798 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.298+0000 7f120ea00640 1 -- 172.21.15.173:0/2943426089 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200007d20 con 0x7f11f40039c0 2024-04-25T09:03:12.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.298+0000 7f120ea00640 1 -- 172.21.15.173:0/2943426089 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1200005ae0 con 0x7f11f40039c0 2024-04-25T09:03:12.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.298+0000 7f120ea00640 1 -- 172.21.15.173:0/2943426089 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200007070 con 0x7f11f40039c0 2024-04-25T09:03:12.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.298+0000 7f1215400640 1 -- 172.21.15.173:0/2943426089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f40039c0 msgr2=0x7f11f4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.298+0000 7f1215400640 1 --2- 172.21.15.173:0/2943426089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f40039c0 0x7f11f4003de0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1200001060 tx=0x7f120001f3b0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.298+0000 7fd8b6000640 1 Processor -- start 2024-04-25T09:03:12.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.298+0000 7f1215400640 1 -- 172.21.15.173:0/2943426089 shutdown_connections 2024-04-25T09:03:12.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.298+0000 7f1215400640 1 --2- 172.21.15.173:0/2943426089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f40039c0 0x7f11f4003de0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.298+0000 7f1215400640 1 -- 172.21.15.173:0/2943426089 >> 172.21.15.173:0/2943426089 conn(0x7f12100b16c0 msgr2=0x7f12100b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:12.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.302+0000 7fb22fe00640 1 Processor -- start 2024-04-25T09:03:12.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.298+0000 7fd8b6000640 1 -- start start 2024-04-25T09:03:12.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.302+0000 7fd8b6000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd8b015c3b0 0x7fd8b006e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.302+0000 7fd8b6000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8b006ed20 0x7fd8b00ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.302+0000 7fd8b6000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b0163350 con 0x7fd8b00cd4e0 2024-04-25T09:03:12.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.302+0000 7fd8b6000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b00cdc20 con 0x7fd8b015c3b0 2024-04-25T09:03:12.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.302+0000 7fd8b6000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b0162590 con 0x7fd8b006ed20 2024-04-25T09:03:12.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.302+0000 7fb22fe00640 1 -- start start 2024-04-25T09:03:12.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.302+0000 7f1215400640 1 -- 172.21.15.173:0/2943426089 shutdown_connections 2024-04-25T09:03:12.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.302+0000 7f1215400640 1 -- 172.21.15.173:0/2943426089 wait complete. 2024-04-25T09:03:12.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.302+0000 7fd8afe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8b006ed20 0x7fd8b00ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.302+0000 7fd8b5600640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd8b00cd4e0 0x7fd8b006d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60576/0 (socket says 172.21.15.173:60576) 2024-04-25T09:03:12.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.302+0000 7fd8b5600640 1 -- 172.21.15.173:0/1856493247 learned_addr learned my addr 172.21.15.173:0/1856493247 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:12.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.302+0000 7fb22fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb23015fd70 0x7fb230099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.302+0000 7fd8b4c00640 1 --2- 172.21.15.173:0/1856493247 >> v2:172.21.15.173:3300/0 conn(0x7fd8b015c3b0 0x7fd8b006e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.302+0000 7f1215400640 1 Processor -- start 2024-04-25T09:03:12.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.302+0000 7fb22ea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb23015fd70 0x7fb230099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.302+0000 7fb22ea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb23015fd70 0x7fb230099a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33186/0 (socket says 172.21.15.173:33186) 2024-04-25T09:03:12.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fd8b4c00640 1 -- 172.21.15.173:0/1856493247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8b006ed20 msgr2=0x7fd8b00ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:12.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fd8b4c00640 1 --2- 172.21.15.173:0/1856493247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8b006ed20 0x7fd8b00ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22ea00640 1 -- 172.21.15.173:0/317223537 learned_addr learned my addr 172.21.15.173:0/317223537 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:12.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fd8b4c00640 1 -- 172.21.15.173:0/1856493247 >> v1:172.21.15.173:6789/0 conn(0x7fd8b00cd4e0 legacy=0x7fd8b006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fd8b4c00640 1 -- 172.21.15.173:0/1856493247 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b0162870 con 0x7fd8b015c3b0 2024-04-25T09:03:12.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22fe00640 1 -- 172.21.15.173:0/317223537 --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2300cf3e0 con 0x7fb230099f90 2024-04-25T09:03:12.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22fe00640 1 -- 172.21.15.173:0/317223537 --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2300cdd60 con 0x7fb23009a440 2024-04-25T09:03:12.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22fe00640 1 -- 172.21.15.173:0/317223537 --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2300b0fb0 con 0x7fb23015fd70 2024-04-25T09:03:12.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22d600640 1 -- 172.21.15.173:0/317223537 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3131933056 0 0) 0x7fb2300cf3e0 con 0x7fb230099f90 2024-04-25T09:03:12.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22d600640 1 -- 172.21.15.173:0/317223537 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb214003530 con 0x7fb230099f90 2024-04-25T09:03:12.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22d600640 1 -- 172.21.15.173:0/317223537 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 495934885 0 0) 0x7fb214003530 con 0x7fb230099f90 2024-04-25T09:03:12.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22d600640 1 -- 172.21.15.173:0/317223537 >> v2:172.21.15.173:3300/0 conn(0x7fb23015fd70 msgr2=0x7fb230099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:12.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22d600640 1 --2- 172.21.15.173:0/317223537 >> v2:172.21.15.173:3300/0 conn(0x7fb23015fd70 0x7fb230099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22d600640 1 -- 172.21.15.173:0/317223537 >> v1:172.21.15.194:6789/0 conn(0x7fb23009a440 legacy=0x7fb2300b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22d600640 1 -- 172.21.15.173:0/317223537 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2300b11e0 con 0x7fb230099f90 2024-04-25T09:03:12.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22d600640 1 -- 172.21.15.173:0/317223537 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fb21c001660 con 0x7fb230099f90 2024-04-25T09:03:12.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22d600640 1 -- 172.21.15.173:0/317223537 >> v1:172.21.15.173:6789/0 conn(0x7fb230099f90 legacy=0x7fb2300b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22d600640 1 --2- 172.21.15.173:0/317223537 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2140039c0 0x7fb214003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22d600640 1 --2- 172.21.15.173:0/317223537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2140043b0 0x7fb214004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22d600640 1 --2- 172.21.15.173:0/317223537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb214005090 0x7fb21400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7f1215400640 1 -- start start 2024-04-25T09:03:12.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f1215400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f40039c0 0x7f121015a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f1215400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1210159330 0x7f1210200340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f1215400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f121015ca10 0x7f121015ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f1215400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12101666a0 con 0x7f1210159330 2024-04-25T09:03:12.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f1215400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121006ea80 con 0x7f121015ca10 2024-04-25T09:03:12.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f1215400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1210166820 con 0x7f11f40039c0 2024-04-25T09:03:12.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f120fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f40039c0 0x7f121015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f120fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f40039c0 0x7f121015a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:40052/0 (socket says 172.21.15.173:40052) 2024-04-25T09:03:12.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f120fe00640 1 -- 172.21.15.173:0/673644710 learned_addr learned my addr 172.21.15.173:0/673644710 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:12.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22d600640 1 -- 172.21.15.173:0/317223537 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21400bfc0 con 0x7fb2140043b0 2024-04-25T09:03:12.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22d600640 1 -- 172.21.15.173:0/317223537 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21400c170 con 0x7fb214005090 2024-04-25T09:03:12.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22d600640 1 -- 172.21.15.173:0/317223537 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21400c370 con 0x7fb2140039c0 2024-04-25T09:03:12.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22ea00640 1 --2- 172.21.15.173:0/317223537 >> v2:172.21.15.173:3300/0 conn(0x7fb23015fd70 0x7fb230099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:12.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.306+0000 7fb22e000640 1 --2- 172.21.15.173:0/317223537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2140043b0 0x7fb214004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7fb22e000640 1 -- 172.21.15.173:0/317223537 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2140039c0 msgr2=0x7fb214003de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T09:03:12.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7fb22e000640 1 --2- 172.21.15.173:0/317223537 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2140039c0 0x7fb214003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7fb22e000640 1 -- 172.21.15.173:0/317223537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb214005090 msgr2=0x7fb21400b9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T09:03:12.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7fb22e000640 1 --2- 172.21.15.173:0/317223537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb214005090 0x7fb21400b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7fb22e000640 1 -- 172.21.15.173:0/317223537 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2300b11e0 con 0x7fb2140043b0 2024-04-25T09:03:12.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7fb22f400640 1 -- 172.21.15.173:0/317223537 reap_dead start 2024-04-25T09:03:12.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f120fe00640 1 -- 172.21.15.173:0/673644710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f121015ca10 msgr2=0x7f121015ce90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T09:03:12.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f120f400640 1 --2- 172.21.15.173:0/673644710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1210159330 0x7f1210200340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f120fe00640 1 --2- 172.21.15.173:0/673644710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f121015ca10 0x7f121015ce90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f120fe00640 1 -- 172.21.15.173:0/673644710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1210159330 msgr2=0x7f1210200340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f120fe00640 1 --2- 172.21.15.173:0/673644710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1210159330 0x7f1210200340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f120fe00640 1 -- 172.21.15.173:0/673644710 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121015b6e0 con 0x7f11f40039c0 2024-04-25T09:03:12.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7fd8b4c00640 1 --2- 172.21.15.173:0/1856493247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8b015c3b0 0x7fd8b006e7e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40097c0 tx=0x7fd8a401c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36686d1d2a065e23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f120f400640 1 --2- 172.21.15.173:0/673644710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1210159330 0x7f1210200340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:12.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f120fe00640 1 --2- 172.21.15.173:0/673644710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f40039c0 0x7f121015a630 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f120001f1e0 tx=0x7f11f4005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7fd8af400640 1 -- 172.21.15.173:0/1856493247 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a40b0070 con 0x7fd8b015c3b0 2024-04-25T09:03:12.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7fd8af400640 1 -- 172.21.15.173:0/1856493247 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a40ab600 con 0x7fd8b015c3b0 2024-04-25T09:03:12.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7fd8af400640 1 -- 172.21.15.173:0/1856493247 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a40b0070 con 0x7fd8b015c3b0 2024-04-25T09:03:12.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f1207e00640 1 -- 172.21.15.173:0/673644710 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200007d00 con 0x7f11f40039c0 2024-04-25T09:03:12.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.310+0000 7f1207e00640 1 -- 172.21.15.173:0/673644710 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1200001480 con 0x7f11f40039c0 2024-04-25T09:03:12.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.314+0000 7fd8b6000640 1 -- 172.21.15.173:0/1856493247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8b015c3b0 msgr2=0x7fd8b006e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.314+0000 7f1215400640 1 -- 172.21.15.173:0/673644710 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f121015ab70 con 0x7f11f40039c0 2024-04-25T09:03:12.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.314+0000 7f1215400640 1 -- 172.21.15.173:0/673644710 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121015b120 con 0x7f11f40039c0 2024-04-25T09:03:12.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.314+0000 7f1207e00640 1 -- 172.21.15.173:0/673644710 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12000049f0 con 0x7f11f40039c0 2024-04-25T09:03:12.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.314+0000 7fd8b6000640 1 --2- 172.21.15.173:0/1856493247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8b015c3b0 0x7fd8b006e7e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40097c0 tx=0x7fd8a401c350 comp rx=0 tx=0).stop 2024-04-25T09:03:12.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.314+0000 7fd8b6000640 1 -- 172.21.15.173:0/1856493247 shutdown_connections 2024-04-25T09:03:12.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.314+0000 7fd8b6000640 1 --2- 172.21.15.173:0/1856493247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8b006ed20 0x7fd8b00ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.314+0000 7fd8b6000640 1 --2- 172.21.15.173:0/1856493247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8b015c3b0 0x7fd8b006e7e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.314+0000 7fd8b6000640 1 -- 172.21.15.173:0/1856493247 >> 172.21.15.173:0/1856493247 conn(0x7fd8b0061d40 msgr2=0x7fd8b006ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:12.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.314+0000 7fd8b6000640 1 -- 172.21.15.173:0/1856493247 shutdown_connections 2024-04-25T09:03:12.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.314+0000 7fd8b6000640 1 -- 172.21.15.173:0/1856493247 wait complete. 2024-04-25T09:03:12.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.314+0000 7fb22e000640 1 --2- 172.21.15.173:0/317223537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2140043b0 0x7fb214004890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0149c0 tx=0x7fb21c0252f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbff62872740f1c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.314+0000 7fde97e00640 1 Processor -- start 2024-04-25T09:03:12.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fd8b6000640 1 Processor -- start 2024-04-25T09:03:12.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.314+0000 7fb22d600640 1 -- 172.21.15.173:0/317223537 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c007c90 con 0x7fb2140043b0 2024-04-25T09:03:12.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.314+0000 7fb22d600640 1 -- 172.21.15.173:0/317223537 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c005110 con 0x7fb2140043b0 2024-04-25T09:03:12.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.314+0000 7fb22d600640 1 -- 172.21.15.173:0/317223537 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c007030 con 0x7fb2140043b0 2024-04-25T09:03:12.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fb22fe00640 1 -- 172.21.15.173:0/317223537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2140043b0 msgr2=0x7fb214004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fb22fe00640 1 --2- 172.21.15.173:0/317223537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2140043b0 0x7fb214004890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0149c0 tx=0x7fb21c0252f0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fb22fe00640 1 -- 172.21.15.173:0/317223537 shutdown_connections 2024-04-25T09:03:12.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fb22fe00640 1 --2- 172.21.15.173:0/317223537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2140043b0 0x7fb214004890 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fb22fe00640 1 -- 172.21.15.173:0/317223537 >> 172.21.15.173:0/317223537 conn(0x7fb2300b3260 msgr2=0x7fb2300b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:12.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fb22fe00640 1 -- 172.21.15.173:0/317223537 shutdown_connections 2024-04-25T09:03:12.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fb22fe00640 1 -- 172.21.15.173:0/317223537 wait complete. 2024-04-25T09:03:12.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.314+0000 7fde97e00640 1 -- start start 2024-04-25T09:03:12.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fde97e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde900e7550 0x7fde90051820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fde97e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde900083c0 con 0x7fde900381b0 2024-04-25T09:03:12.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fde97e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde90050660 con 0x7fde90007f60 2024-04-25T09:03:12.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fde97e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde90050940 con 0x7fde900e7550 2024-04-25T09:03:12.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7f1207e00640 1 -- 172.21.15.173:0/673644710 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1200004b90 con 0x7f11f40039c0 2024-04-25T09:03:12.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fde96000640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fde90007f60 0x7fde90054040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:45010/0 (socket says 172.21.15.173:45010) 2024-04-25T09:03:12.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fde96000640 1 -- 172.21.15.173:0/3091049603 learned_addr learned my addr 172.21.15.173:0/3091049603 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:12.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fd8b6000640 1 -- start start 2024-04-25T09:03:12.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fd8b6000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8b006ed20 0x7fd8b014c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fd8b6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8b00cd4e0 0x7fd8b01424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fd8b6000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8b015c3b0 0x7fd8b0147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fd8b6000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b00cd920 con 0x7fd8b00cd4e0 2024-04-25T09:03:12.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fd8b6000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b0162e30 con 0x7fd8b015c3b0 2024-04-25T09:03:12.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fd8b6000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b015c790 con 0x7fd8b006ed20 2024-04-25T09:03:12.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fd8afe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8b00cd4e0 0x7fd8b01424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fde96a00640 1 --2- 172.21.15.173:0/3091049603 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde900e7550 0x7fde90051820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7f1207e00640 1 --2- 172.21.15.173:0/673644710 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f11f0067060 0x7f11f0069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fd8b4c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8b006ed20 0x7fd8b014c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fd8b5600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8b015c3b0 0x7fd8b0147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fd8b5600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8b015c3b0 0x7fd8b0147160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:56890/0 (socket says 172.21.15.173:56890) 2024-04-25T09:03:12.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fd8b5600640 1 -- 172.21.15.173:0/1162063019 learned_addr learned my addr 172.21.15.173:0/1162063019 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:12.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7f1207e00640 1 -- 172.21.15.173:0/673644710 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f12000b6020 con 0x7f11f40039c0 2024-04-25T09:03:12.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fde96a00640 1 -- 172.21.15.173:0/3091049603 >> v1:172.21.15.194:6789/0 conn(0x7fde90007f60 legacy=0x7fde90054040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fde96a00640 1 -- 172.21.15.173:0/3091049603 >> v1:172.21.15.173:6789/0 conn(0x7fde900381b0 legacy=0x7fde9004f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.318+0000 7fde96a00640 1 -- 172.21.15.173:0/3091049603 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde90048760 con 0x7fde900e7550 2024-04-25T09:03:12.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7f120f400640 1 --2- 172.21.15.173:0/673644710 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f11f0067060 0x7f11f0069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7f1215400640 1 -- 172.21.15.173:0/673644710 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e80052a0 con 0x7f11f40039c0 2024-04-25T09:03:12.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fd8b5600640 1 -- 172.21.15.173:0/1162063019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8b006ed20 msgr2=0x7fd8b014c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fd8b5600640 1 --2- 172.21.15.173:0/1162063019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8b006ed20 0x7fd8b014c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fd8b5600640 1 -- 172.21.15.173:0/1162063019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8b00cd4e0 msgr2=0x7fd8b01424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fd8b5600640 1 --2- 172.21.15.173:0/1162063019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8b00cd4e0 0x7fd8b01424f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fd8b5600640 1 -- 172.21.15.173:0/1162063019 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b014af60 con 0x7fd8b015c3b0 2024-04-25T09:03:12.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fb22fe00640 1 Processor -- start 2024-04-25T09:03:12.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fd8b5600640 1 --2- 172.21.15.173:0/1162063019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8b015c3b0 0x7fd8b0147160 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800e530 tx=0x7fd8a800e9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fd8b4c00640 1 --2- 172.21.15.173:0/1162063019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8b006ed20 0x7fd8b014c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:12.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fb22fe00640 1 -- start start 2024-04-25T09:03:12.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fd8acc00640 1 -- 172.21.15.173:0/1162063019 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8016020 con 0x7fd8b015c3b0 2024-04-25T09:03:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fd8acc00640 1 -- 172.21.15.173:0/1162063019 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a8012810 con 0x7fd8b015c3b0 2024-04-25T09:03:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fd8acc00640 1 -- 172.21.15.173:0/1162063019 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8012c00 con 0x7fd8b015c3b0 2024-04-25T09:03:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fd8b6000640 1 -- 172.21.15.173:0/1162063019 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b0140040 con 0x7fd8b015c3b0 2024-04-25T09:03:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fd8b6000640 1 -- 172.21.15.173:0/1162063019 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b0140600 con 0x7fd8b015c3b0 2024-04-25T09:03:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7f120f400640 1 --2- 172.21.15.173:0/673644710 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f11f0067060 0x7f11f0069520 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1210203f30 tx=0x7f11fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fb22fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2140043b0 0x7fb2300cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fb22fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb23015c8f0 0x7fb23009c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fb22fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2300b6420 0x7fb2300b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fb22fe00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2300ccb70 con 0x7fb2300b6420 2024-04-25T09:03:12.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fb22fe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2300cd570 con 0x7fb2140043b0 2024-04-25T09:03:12.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fb22fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2300cccf0 con 0x7fb23015c8f0 2024-04-25T09:03:12.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fb22ea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2140043b0 0x7fb2300cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.322+0000 7fb22f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2300b6420 0x7fb2300b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fde96a00640 1 --2- 172.21.15.173:0/3091049603 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde900e7550 0x7fde90051820 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fde88009770 tx=0x7fde8801c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a05f340193247ea0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fb22f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2300b6420 0x7fb2300b68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33234/0 (socket says 172.21.15.173:33234) 2024-04-25T09:03:12.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fb22f400640 1 -- 172.21.15.173:0/273004706 learned_addr learned my addr 172.21.15.173:0/273004706 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:12.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fb22e000640 1 --2- 172.21.15.173:0/273004706 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb23015c8f0 0x7fb23009c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fb22ea00640 1 -- 172.21.15.173:0/273004706 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb23015c8f0 msgr2=0x7fb23009c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fb22ea00640 1 --2- 172.21.15.173:0/273004706 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb23015c8f0 0x7fb23009c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fd8acc00640 1 -- 172.21.15.173:0/1162063019 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd8a8019020 con 0x7fd8b015c3b0 2024-04-25T09:03:12.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fb22ea00640 1 -- 172.21.15.173:0/273004706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2300b6420 msgr2=0x7fb2300b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fb22ea00640 1 --2- 172.21.15.173:0/273004706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2300b6420 0x7fb2300b68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fb22ea00640 1 -- 172.21.15.173:0/273004706 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2300cf7d0 con 0x7fb2140043b0 2024-04-25T09:03:12.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fb22f400640 1 --2- 172.21.15.173:0/273004706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2300b6420 0x7fb2300b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:12.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fb22ea00640 1 --2- 172.21.15.173:0/273004706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2140043b0 0x7fb2300cb1f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb22000e8b0 tx=0x7fb22000ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fb226a00640 1 -- 172.21.15.173:0/273004706 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb220017070 con 0x7fb2140043b0 2024-04-25T09:03:12.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fb226a00640 1 -- 172.21.15.173:0/273004706 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb220004020 con 0x7fb2140043b0 2024-04-25T09:03:12.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fb226a00640 1 -- 172.21.15.173:0/273004706 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2200043f0 con 0x7fb2140043b0 2024-04-25T09:03:12.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fb22fe00640 1 -- 172.21.15.173:0/273004706 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2300b41e0 con 0x7fb2140043b0 2024-04-25T09:03:12.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fb22fe00640 1 -- 172.21.15.173:0/273004706 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2300b47a0 con 0x7fb2140043b0 2024-04-25T09:03:12.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fd8acc00640 1 --2- 172.21.15.173:0/1162063019 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd890066f60 0x7fd890069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fd8acc00640 1 -- 172.21.15.173:0/1162063019 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd8a8087f20 con 0x7fd8b015c3b0 2024-04-25T09:03:12.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fd8b4c00640 1 --2- 172.21.15.173:0/1162063019 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd890066f60 0x7fd890069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fde95600640 1 -- 172.21.15.173:0/3091049603 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880b0070 con 0x7fde900e7550 2024-04-25T09:03:12.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fde95600640 1 -- 172.21.15.173:0/3091049603 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde880ab600 con 0x7fde900e7550 2024-04-25T09:03:12.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fde95600640 1 -- 172.21.15.173:0/3091049603 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880ab9d0 con 0x7fde900e7550 2024-04-25T09:03:12.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.326+0000 7fd8b6000640 1 -- 172.21.15.173:0/1162063019 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd88c0052a0 con 0x7fd8b015c3b0 2024-04-25T09:03:12.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.330+0000 7f1207e00640 1 -- 172.21.15.173:0/673644710 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f12000190c0 con 0x7f11f40039c0 2024-04-25T09:03:12.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.330+0000 7fd8b4c00640 1 --2- 172.21.15.173:0/1162063019 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd890066f60 0x7fd890069420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40ad000 tx=0x7fd8a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.330+0000 7fb22fe00640 1 -- 172.21.15.173:0/273004706 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2300cbc30 con 0x7fb2140043b0 2024-04-25T09:03:12.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.330+0000 7fde97e00640 1 -- 172.21.15.173:0/3091049603 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde900e7550 msgr2=0x7fde90051820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.330+0000 7fde97e00640 1 --2- 172.21.15.173:0/3091049603 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde900e7550 0x7fde90051820 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fde88009770 tx=0x7fde8801c310 comp rx=0 tx=0).stop 2024-04-25T09:03:12.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.330+0000 7fde97e00640 1 -- 172.21.15.173:0/3091049603 shutdown_connections 2024-04-25T09:03:12.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.330+0000 7fde97e00640 1 --2- 172.21.15.173:0/3091049603 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde900e7550 0x7fde90051820 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.330+0000 7fde97e00640 1 -- 172.21.15.173:0/3091049603 >> 172.21.15.173:0/3091049603 conn(0x7fde90055360 msgr2=0x7fde90055770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:12.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.330+0000 7fde97e00640 1 -- 172.21.15.173:0/3091049603 shutdown_connections 2024-04-25T09:03:12.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.330+0000 7fde97e00640 1 -- 172.21.15.173:0/3091049603 wait complete. 2024-04-25T09:03:12.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.330+0000 7fb226a00640 1 -- 172.21.15.173:0/273004706 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb22000c8e0 con 0x7fb2140043b0 2024-04-25T09:03:12.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.330+0000 7fb226a00640 1 --2- 172.21.15.173:0/273004706 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb210066f60 0x7fb210069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.330+0000 7fb226a00640 1 -- 172.21.15.173:0/273004706 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb2200851a0 con 0x7fb2140043b0 2024-04-25T09:03:12.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.330+0000 7fb22e000640 1 --2- 172.21.15.173:0/273004706 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb210066f60 0x7fb210069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.330+0000 7fde97e00640 1 Processor -- start 2024-04-25T09:03:12.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde97e00640 1 -- start start 2024-04-25T09:03:12.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fb22e000640 1 --2- 172.21.15.173:0/273004706 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb210066f60 0x7fb210069420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0b3000 tx=0x7fb21c0af000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde97e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde90007f60 0x7fde9017dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde97e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde900381b0 0x7fde900ea580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fd8acc00640 1 -- 172.21.15.173:0/1162063019 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd8a8020030 con 0x7fd8b015c3b0 2024-04-25T09:03:12.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde97e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde900e7550 0x7fde900372d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde97e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde900548d0 con 0x7fde900e7550 2024-04-25T09:03:12.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde97e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde90054750 con 0x7fde900381b0 2024-04-25T09:03:12.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde97e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde900e7930 con 0x7fde90007f60 2024-04-25T09:03:12.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde96a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde90007f60 0x7fde9017dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde97400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde900e7550 0x7fde900372d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde96a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde90007f60 0x7fde9017dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:40102/0 (socket says 172.21.15.173:40102) 2024-04-25T09:03:12.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde97400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde900e7550 0x7fde900372d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33242/0 (socket says 172.21.15.173:33242) 2024-04-25T09:03:12.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde96a00640 1 -- 172.21.15.173:0/4045829133 learned_addr learned my addr 172.21.15.173:0/4045829133 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:12.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde96000640 1 --2- 172.21.15.173:0/4045829133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde900381b0 0x7fde900ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde97400640 1 -- 172.21.15.173:0/4045829133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde90007f60 msgr2=0x7fde9017dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde97400640 1 --2- 172.21.15.173:0/4045829133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde90007f60 0x7fde9017dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde97400640 1 -- 172.21.15.173:0/4045829133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde900381b0 msgr2=0x7fde900ea580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde97400640 1 --2- 172.21.15.173:0/4045829133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde900381b0 0x7fde900ea580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde97400640 1 -- 172.21.15.173:0/4045829133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde900e2620 con 0x7fde900e7550 2024-04-25T09:03:12.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde97400640 1 --2- 172.21.15.173:0/4045829133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde900e7550 0x7fde900372d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fde98050870 tx=0x7fde98068770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.334+0000 7fde8ea00640 1 -- 172.21.15.173:0/4045829133 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde980731c0 con 0x7fde900e7550 2024-04-25T09:03:12.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.338+0000 7fde97e00640 1 -- 172.21.15.173:0/4045829133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde90036510 con 0x7fde900e7550 2024-04-25T09:03:12.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.338+0000 7fde97e00640 1 -- 172.21.15.173:0/4045829133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde90036ad0 con 0x7fde900e7550 2024-04-25T09:03:12.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.338+0000 7fde8ea00640 1 -- 172.21.15.173:0/4045829133 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde98092400 con 0x7fde900e7550 2024-04-25T09:03:12.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.338+0000 7fde8ea00640 1 -- 172.21.15.173:0/4045829133 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde980927f0 con 0x7fde900e7550 2024-04-25T09:03:12.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.338+0000 7fde97e00640 1 -- 172.21.15.173:0/4045829133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde900053a0 con 0x7fde900e7550 2024-04-25T09:03:12.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.338+0000 7fb226a00640 1 -- 172.21.15.173:0/273004706 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb220055820 con 0x7fb2140043b0 2024-04-25T09:03:12.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.346+0000 7fde8ea00640 1 -- 172.21.15.173:0/4045829133 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fde98092990 con 0x7fde900e7550 2024-04-25T09:03:12.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.346+0000 7fde8ea00640 1 --2- 172.21.15.173:0/4045829133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde78066f60 0x7fde78069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:12.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.346+0000 7fde8ea00640 1 -- 172.21.15.173:0/4045829133 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fde980cde10 con 0x7fde900e7550 2024-04-25T09:03:12.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.346+0000 7fde96a00640 1 --2- 172.21.15.173:0/4045829133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde78066f60 0x7fde78069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:12.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.350+0000 7fde96a00640 1 --2- 172.21.15.173:0/4045829133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde78066f60 0x7fde78069420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fde90051a10 tx=0x7fde880a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:12.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.354+0000 7fde8ea00640 1 -- 172.21.15.173:0/4045829133 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fde9808e030 con 0x7fde900e7550 2024-04-25T09:03:12.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.554+0000 7fb848800640 1 -- 172.21.15.173:0/535148421 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb81c005590 con 0x7fb83c03b160 2024-04-25T09:03:12.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.558+0000 7fb83a000640 1 -- 172.21.15.173:0/535148421 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb830067720 con 0x7fb83c03b160 2024-04-25T09:03:12.546 INFO:teuthology.orchestra.run.smithi173.stdout:64424509449 2024-04-25T09:03:12.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.562+0000 7fb848800640 1 -- 172.21.15.173:0/535148421 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb824067060 msgr2=0x7fb824069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.562+0000 7fb848800640 1 --2- 172.21.15.173:0/535148421 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb824067060 0x7fb824069520 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb83c04d050 tx=0x7fb834001c40 comp rx=0 tx=0).stop 2024-04-25T09:03:12.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.562+0000 7fb848800640 1 -- 172.21.15.173:0/535148421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb83c03b160 msgr2=0x7fb83c0dfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.562+0000 7fb848800640 1 --2- 172.21.15.173:0/535148421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb83c03b160 0x7fb83c0dfa50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb83000d600 tx=0x7fb83000dac0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.562+0000 7fb848800640 1 -- 172.21.15.173:0/535148421 shutdown_connections 2024-04-25T09:03:12.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.562+0000 7fb848800640 1 --2- 172.21.15.173:0/535148421 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb824067060 0x7fb824069520 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb83c04d050 tx=0x7fb834001c40 comp rx=0 tx=0).stop 2024-04-25T09:03:12.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.562+0000 7fb848800640 1 --2- 172.21.15.173:0/535148421 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb83c03d5e0 0x7fb83c03da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.562+0000 7fb848800640 1 --2- 172.21.15.173:0/535148421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb83c03b160 0x7fb83c0dfa50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.562+0000 7fb848800640 1 --2- 172.21.15.173:0/535148421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8280051d0 0x7fb83c180440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.562+0000 7fb848800640 1 -- 172.21.15.173:0/535148421 >> 172.21.15.173:0/535148421 conn(0x7fb83c0537c0 msgr2=0x7fb83c0e2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:12.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.566+0000 7fb848800640 1 -- 172.21.15.173:0/535148421 shutdown_connections 2024-04-25T09:03:12.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.566+0000 7fb848800640 1 -- 172.21.15.173:0/535148421 wait complete. 2024-04-25T09:03:12.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.578+0000 7fa612200640 1 -- 172.21.15.173:0/993163677 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa60c1518f0 con 0x7fa60c0cd860 2024-04-25T09:03:12.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.578+0000 7fa603400640 1 -- 172.21.15.173:0/993163677 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5f8058c90 con 0x7fa60c0cd860 2024-04-25T09:03:12.567 INFO:teuthology.orchestra.run.smithi173.stdout:64424509449 2024-04-25T09:03:12.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.582+0000 7fa612200640 1 -- 172.21.15.173:0/993163677 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa5ec066fe0 msgr2=0x7fa5ec0694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.582+0000 7fa612200640 1 --2- 172.21.15.173:0/993163677 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa5ec066fe0 0x7fa5ec0694a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa60c149ff0 tx=0x7fa5fc009110 comp rx=0 tx=0).stop 2024-04-25T09:03:12.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.582+0000 7fa612200640 1 -- 172.21.15.173:0/993163677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa60c0cd860 msgr2=0x7fa60c14a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.582+0000 7fa612200640 1 --2- 172.21.15.173:0/993163677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa60c0cd860 0x7fa60c14a590 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa5f800c460 tx=0x7fa5f800c860 comp rx=0 tx=0).stop 2024-04-25T09:03:12.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.582+0000 7fa612200640 1 -- 172.21.15.173:0/993163677 shutdown_connections 2024-04-25T09:03:12.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.582+0000 7fa612200640 1 --2- 172.21.15.173:0/993163677 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa5ec066fe0 0x7fa5ec0694a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.582+0000 7fa612200640 1 --2- 172.21.15.173:0/993163677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa60c15ab80 0x7fa60c14aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.582+0000 7fa612200640 1 --2- 172.21.15.173:0/993163677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa60c0cd860 0x7fa60c14a590 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.582+0000 7fa612200640 1 --2- 172.21.15.173:0/993163677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa60c0c5a10 0x7fa60c149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.582+0000 7fa612200640 1 -- 172.21.15.173:0/993163677 >> 172.21.15.173:0/993163677 conn(0x7fa60c0b23a0 msgr2=0x7fa60c0cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:12.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.586+0000 7fa612200640 1 -- 172.21.15.173:0/993163677 shutdown_connections 2024-04-25T09:03:12.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.586+0000 7fa612200640 1 -- 172.21.15.173:0/993163677 wait complete. 2024-04-25T09:03:12.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.590+0000 7f934bc00640 1 -- 172.21.15.173:0/2409856566 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f93440d0d70 con 0x7f93441622c0 2024-04-25T09:03:12.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.590+0000 7f9340c00640 1 -- 172.21.15.173:0/2409856566 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93340594a0 con 0x7f93441622c0 2024-04-25T09:03:12.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.594+0000 7faf43000640 1 -- 172.21.15.173:0/4016291922 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7faf3c073a40 con 0x7faf3c0b08d0 2024-04-25T09:03:12.582 INFO:teuthology.orchestra.run.smithi173.stdout:64424509448 2024-04-25T09:03:12.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.594+0000 7faf39600640 1 -- 172.21.15.173:0/4016291922 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf28018540 con 0x7faf3c0b08d0 2024-04-25T09:03:12.583 INFO:teuthology.orchestra.run.smithi173.stdout:64424509448 2024-04-25T09:03:12.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7f934bc00640 1 -- 172.21.15.173:0/2409856566 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9324067030 msgr2=0x7f93240694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7f934bc00640 1 --2- 172.21.15.173:0/2409856566 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9324067030 0x7f93240694f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f933c009d90 tx=0x7f933c0aa000 comp rx=0 tx=0).stop 2024-04-25T09:03:12.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7faf43000640 1 -- 172.21.15.173:0/4016291922 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf1c066f60 msgr2=0x7faf1c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7faf43000640 1 --2- 172.21.15.173:0/4016291922 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf1c066f60 0x7faf1c069420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faf30009a40 tx=0x7faf30008040 comp rx=0 tx=0).stop 2024-04-25T09:03:12.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7faf43000640 1 -- 172.21.15.173:0/4016291922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf3c0b08d0 msgr2=0x7faf3c1eb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7faf43000640 1 --2- 172.21.15.173:0/4016291922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf3c0b08d0 0x7faf3c1eb5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faf2801cee0 tx=0x7faf2801d070 comp rx=0 tx=0).stop 2024-04-25T09:03:12.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.0 2024-04-25T09:03:12.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7faf43000640 1 -- 172.21.15.173:0/4016291922 shutdown_connections 2024-04-25T09:03:12.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7faf43000640 1 --2- 172.21.15.173:0/4016291922 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf1c066f60 0x7faf1c069420 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faf30009a40 tx=0x7faf30008040 comp rx=0 tx=0).stop 2024-04-25T09:03:12.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7faf43000640 1 --2- 172.21.15.173:0/4016291922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf3c159980 0x7faf3c2037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7faf43000640 1 --2- 172.21.15.173:0/4016291922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf3c0b08d0 0x7faf3c1eb5a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7faf43000640 1 --2- 172.21.15.173:0/4016291922 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf3c071280 0x7faf3c14aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7faf43000640 1 -- 172.21.15.173:0/4016291922 >> 172.21.15.173:0/4016291922 conn(0x7faf3c061ab0 msgr2=0x7faf3c0cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:12.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7faf43000640 1 -- 172.21.15.173:0/4016291922 shutdown_connections 2024-04-25T09:03:12.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7f934bc00640 1 -- 172.21.15.173:0/2409856566 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93441622c0 msgr2=0x7f93440c6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7f934bc00640 1 --2- 172.21.15.173:0/2409856566 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93441622c0 0x7f93440c6270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f933400c440 tx=0x7f933400c900 comp rx=0 tx=0).stop 2024-04-25T09:03:12.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7faf43000640 1 -- 172.21.15.173:0/4016291922 wait complete. 2024-04-25T09:03:12.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7f934bc00640 1 -- 172.21.15.173:0/2409856566 shutdown_connections 2024-04-25T09:03:12.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7f934bc00640 1 --2- 172.21.15.173:0/2409856566 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9324067030 0x7f93240694f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7f934bc00640 1 --2- 172.21.15.173:0/2409856566 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93441622c0 0x7f93440c6270 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7f934bc00640 1 --2- 172.21.15.173:0/2409856566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9344161ee0 0x7f93440c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7f934bc00640 1 --2- 172.21.15.173:0/2409856566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93440cb7f0 0x7f934414cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7f934bc00640 1 -- 172.21.15.173:0/2409856566 >> 172.21.15.173:0/2409856566 conn(0x7f9344071ba0 msgr2=0x7f93440afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:12.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7f934bc00640 1 -- 172.21.15.173:0/2409856566 shutdown_connections 2024-04-25T09:03:12.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.598+0000 7f934bc00640 1 -- 172.21.15.173:0/2409856566 wait complete. 2024-04-25T09:03:12.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.1 2024-04-25T09:03:12.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.630+0000 7f1215400640 1 -- 172.21.15.173:0/673644710 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f11e8005590 con 0x7f11f40039c0 2024-04-25T09:03:12.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.630+0000 7f1207e00640 1 -- 172.21.15.173:0/673644710 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f12000190c0 con 0x7f11f40039c0 2024-04-25T09:03:12.619 INFO:teuthology.orchestra.run.smithi173.stdout:64424509448 2024-04-25T09:03:12.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.634+0000 7f1215400640 1 -- 172.21.15.173:0/673644710 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f11f0067060 msgr2=0x7f11f0069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.634+0000 7f1215400640 1 --2- 172.21.15.173:0/673644710 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f11f0067060 0x7f11f0069520 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1210203f30 tx=0x7f11fc009040 comp rx=0 tx=0).stop 2024-04-25T09:03:12.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.634+0000 7f1215400640 1 -- 172.21.15.173:0/673644710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f40039c0 msgr2=0x7f121015a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.634+0000 7f1215400640 1 --2- 172.21.15.173:0/673644710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f40039c0 0x7f121015a630 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f120001f1e0 tx=0x7f11f4005840 comp rx=0 tx=0).stop 2024-04-25T09:03:12.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.3 2024-04-25T09:03:12.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.634+0000 7f1215400640 1 -- 172.21.15.173:0/673644710 shutdown_connections 2024-04-25T09:03:12.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.634+0000 7f1215400640 1 --2- 172.21.15.173:0/673644710 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f11f0067060 0x7f11f0069520 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.634+0000 7f1215400640 1 --2- 172.21.15.173:0/673644710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f121015ca10 0x7f121015ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.634+0000 7f1215400640 1 --2- 172.21.15.173:0/673644710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1210159330 0x7f1210200340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.634+0000 7f1215400640 1 --2- 172.21.15.173:0/673644710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f40039c0 0x7f121015a630 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.634+0000 7f1215400640 1 -- 172.21.15.173:0/673644710 >> 172.21.15.173:0/673644710 conn(0x7f12100b16c0 msgr2=0x7f12100b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:12.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.634+0000 7f1215400640 1 -- 172.21.15.173:0/673644710 shutdown_connections 2024-04-25T09:03:12.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.634+0000 7f1215400640 1 -- 172.21.15.173:0/673644710 wait complete. 2024-04-25T09:03:12.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.6 2024-04-25T09:03:12.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.646+0000 7fd8b6000640 1 -- 172.21.15.173:0/1162063019 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd88c005860 con 0x7fd8b015c3b0 2024-04-25T09:03:12.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.646+0000 7fd8acc00640 1 -- 172.21.15.173:0/1162063019 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd8a8058bf0 con 0x7fd8b015c3b0 2024-04-25T09:03:12.637 INFO:teuthology.orchestra.run.smithi173.stdout:64424509449 2024-04-25T09:03:12.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.650+0000 7fd8b6000640 1 -- 172.21.15.173:0/1162063019 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd890066f60 msgr2=0x7fd890069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.650+0000 7fd8b6000640 1 --2- 172.21.15.173:0/1162063019 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd890066f60 0x7fd890069420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40ad000 tx=0x7fd8a4008040 comp rx=0 tx=0).stop 2024-04-25T09:03:12.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.650+0000 7fd8b6000640 1 -- 172.21.15.173:0/1162063019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8b015c3b0 msgr2=0x7fd8b0147160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.650+0000 7fd8b6000640 1 --2- 172.21.15.173:0/1162063019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8b015c3b0 0x7fd8b0147160 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800e530 tx=0x7fd8a800e9f0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.650+0000 7fd8b6000640 1 -- 172.21.15.173:0/1162063019 shutdown_connections 2024-04-25T09:03:12.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.650+0000 7fd8b6000640 1 --2- 172.21.15.173:0/1162063019 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd890066f60 0x7fd890069420 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.650+0000 7fd8b6000640 1 --2- 172.21.15.173:0/1162063019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8b015c3b0 0x7fd8b0147160 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.650+0000 7fd8b6000640 1 --2- 172.21.15.173:0/1162063019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8b00cd4e0 0x7fd8b01424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.650+0000 7fd8b6000640 1 --2- 172.21.15.173:0/1162063019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8b006ed20 0x7fd8b014c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.650+0000 7fd8b6000640 1 -- 172.21.15.173:0/1162063019 >> 172.21.15.173:0/1162063019 conn(0x7fd8b0061d40 msgr2=0x7fd8b00b3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:12.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.650+0000 7fd8b6000640 1 -- 172.21.15.173:0/1162063019 shutdown_connections 2024-04-25T09:03:12.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.650+0000 7fd8b6000640 1 -- 172.21.15.173:0/1162063019 wait complete. 2024-04-25T09:03:12.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.2 2024-04-25T09:03:12.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.662+0000 7fde97e00640 1 -- 172.21.15.173:0/4045829133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fde9003a5b0 con 0x7fde900e7550 2024-04-25T09:03:12.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.666+0000 7fde8ea00640 1 -- 172.21.15.173:0/4045829133 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde9806ce20 con 0x7fde900e7550 2024-04-25T09:03:12.654 INFO:teuthology.orchestra.run.smithi173.stdout:55834574856 2024-04-25T09:03:12.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.666+0000 7fb22fe00640 1 -- 172.21.15.173:0/273004706 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb2300b2690 con 0x7fb2140043b0 2024-04-25T09:03:12.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.666+0000 7fde97e00640 1 -- 172.21.15.173:0/4045829133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde78066f60 msgr2=0x7fde78069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.666+0000 7fde97e00640 1 --2- 172.21.15.173:0/4045829133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde78066f60 0x7fde78069420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fde90051a10 tx=0x7fde880a6000 comp rx=0 tx=0).stop 2024-04-25T09:03:12.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.666+0000 7fde97e00640 1 -- 172.21.15.173:0/4045829133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde900e7550 msgr2=0x7fde900372d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.666+0000 7fde97e00640 1 --2- 172.21.15.173:0/4045829133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde900e7550 0x7fde900372d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fde98050870 tx=0x7fde98068770 comp rx=0 tx=0).stop 2024-04-25T09:03:12.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.666+0000 7fb226a00640 1 -- 172.21.15.173:0/273004706 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb2200598c0 con 0x7fb2140043b0 2024-04-25T09:03:12.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.666+0000 7fde97e00640 1 -- 172.21.15.173:0/4045829133 shutdown_connections 2024-04-25T09:03:12.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.666+0000 7fde97e00640 1 --2- 172.21.15.173:0/4045829133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde78066f60 0x7fde78069420 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.666+0000 7fde97e00640 1 --2- 172.21.15.173:0/4045829133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde900e7550 0x7fde900372d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.666+0000 7fde97e00640 1 --2- 172.21.15.173:0/4045829133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde900381b0 0x7fde900ea580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.666+0000 7fde97e00640 1 --2- 172.21.15.173:0/4045829133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde90007f60 0x7fde9017dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.666+0000 7fde97e00640 1 -- 172.21.15.173:0/4045829133 >> 172.21.15.173:0/4045829133 conn(0x7fde90055360 msgr2=0x7fde90054040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:12.657 INFO:teuthology.orchestra.run.smithi173.stdout:64424509448 2024-04-25T09:03:12.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.666+0000 7fde97e00640 1 -- 172.21.15.173:0/4045829133 shutdown_connections 2024-04-25T09:03:12.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.666+0000 7fde97e00640 1 -- 172.21.15.173:0/4045829133 wait complete. 2024-04-25T09:03:12.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.670+0000 7fb22fe00640 1 -- 172.21.15.173:0/273004706 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb210066f60 msgr2=0x7fb210069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.670+0000 7fb22fe00640 1 --2- 172.21.15.173:0/273004706 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb210066f60 0x7fb210069420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0b3000 tx=0x7fb21c0af000 comp rx=0 tx=0).stop 2024-04-25T09:03:12.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.670+0000 7fb22fe00640 1 -- 172.21.15.173:0/273004706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2140043b0 msgr2=0x7fb2300cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:12.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.670+0000 7fb22fe00640 1 --2- 172.21.15.173:0/273004706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2140043b0 0x7fb2300cb1f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb22000e8b0 tx=0x7fb22000ed70 comp rx=0 tx=0).stop 2024-04-25T09:03:12.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.670+0000 7fb22fe00640 1 -- 172.21.15.173:0/273004706 shutdown_connections 2024-04-25T09:03:12.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.670+0000 7fb22fe00640 1 --2- 172.21.15.173:0/273004706 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb210066f60 0x7fb210069420 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.670+0000 7fb22fe00640 1 --2- 172.21.15.173:0/273004706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2300b6420 0x7fb2300b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.670+0000 7fb22fe00640 1 --2- 172.21.15.173:0/273004706 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb23015c8f0 0x7fb23009c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.670+0000 7fb22fe00640 1 --2- 172.21.15.173:0/273004706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2140043b0 0x7fb2300cb1f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:12.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.670+0000 7fb22fe00640 1 -- 172.21.15.173:0/273004706 >> 172.21.15.173:0/273004706 conn(0x7fb2300b3260 msgr2=0x7fb2300c72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:12.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.670+0000 7fb22fe00640 1 -- 172.21.15.173:0/273004706 shutdown_connections 2024-04-25T09:03:12.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:12.670+0000 7fb22fe00640 1 -- 172.21.15.173:0/273004706 wait complete. 2024-04-25T09:03:12.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.4 2024-04-25T09:03:12.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.7 2024-04-25T09:03:12.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.5 2024-04-25T09:03:13.590 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T09:03:13.610 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T09:03:13.623 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T09:03:13.627 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T09:03:13.653 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T09:03:13.667 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T09:03:13.682 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T09:03:13.683 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T09:03:13.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.802+0000 7f7fb6c00640 1 Processor -- start 2024-04-25T09:03:13.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.802+0000 7f7fb6c00640 1 -- start start 2024-04-25T09:03:13.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.806+0000 7f7fb6c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7fa804f3b0 0x7f7fa80533f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.806+0000 7f7fb6c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fa804f790 0x7f7fa804fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.806+0000 7f7fb6c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa8101150 con 0x7f7fa8054430 2024-04-25T09:03:13.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.806+0000 7f7fb6c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa8005e70 con 0x7f7fa804f3b0 2024-04-25T09:03:13.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.806+0000 7f7fb6c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa8006150 con 0x7f7fa804f790 2024-04-25T09:03:13.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.806+0000 7f7fb6200640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f7fa8054430 0x7f7fa8104820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:39222/0 (socket says 172.21.15.173:39222) 2024-04-25T09:03:13.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.806+0000 7f7fb6200640 1 -- 172.21.15.173:0/2980518502 learned_addr learned my addr 172.21.15.173:0/2980518502 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:13.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.806+0000 7f7fb5800640 1 --2- 172.21.15.173:0/2980518502 >> v2:172.21.15.194:3300/0 conn(0x7f7fa804f3b0 0x7f7fa80533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.806+0000 7f7fb4e00640 1 --2- 172.21.15.173:0/2980518502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fa804f790 0x7f7fa804fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.806+0000 7f7fafe00640 1 -- 172.21.15.173:0/2980518502 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373906559 0 0) 0x7f7fa8101150 con 0x7f7fa8054430 2024-04-25T09:03:13.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.806+0000 7f7fafe00640 1 -- 172.21.15.173:0/2980518502 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f98007940 con 0x7f7fa8054430 2024-04-25T09:03:13.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fafe00640 1 -- 172.21.15.173:0/2980518502 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4286320177 0 0) 0x7f7f98007940 con 0x7f7fa8054430 2024-04-25T09:03:13.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fafe00640 1 -- 172.21.15.173:0/2980518502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fa804f790 msgr2=0x7f7fa804fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:13.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fafe00640 1 --2- 172.21.15.173:0/2980518502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fa804f790 0x7f7fa804fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fafe00640 1 -- 172.21.15.173:0/2980518502 >> v2:172.21.15.194:3300/0 conn(0x7f7fa804f3b0 msgr2=0x7f7fa80533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:13.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fafe00640 1 --2- 172.21.15.173:0/2980518502 >> v2:172.21.15.194:3300/0 conn(0x7f7fa804f3b0 0x7f7fa80533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fafe00640 1 -- 172.21.15.173:0/2980518502 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa8053930 con 0x7f7fa8054430 2024-04-25T09:03:13.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fafe00640 1 -- 172.21.15.173:0/2980518502 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f7f9c001660 con 0x7f7fa8054430 2024-04-25T09:03:13.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fb5800640 1 --2- 172.21.15.173:0/2980518502 >> v2:172.21.15.194:3300/0 conn(0x7f7fa804f3b0 0x7f7fa80533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:13.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fafe00640 1 -- 172.21.15.173:0/2980518502 >> v1:172.21.15.194:6789/0 conn(0x7f7fa8054430 legacy=0x7f7fa8104820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fafe00640 1 --2- 172.21.15.173:0/2980518502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f98007dd0 0x7f7f98008210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fafe00640 1 --2- 172.21.15.173:0/2980518502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f98008c20 0x7f7f980090a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fafe00640 1 --2- 172.21.15.173:0/2980518502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f98007470 0x7f7f980095e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fafe00640 1 -- 172.21.15.173:0/2980518502 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa8005e70 con 0x7f7f98008c20 2024-04-25T09:03:13.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fafe00640 1 -- 172.21.15.173:0/2980518502 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa8006150 con 0x7f7f98007dd0 2024-04-25T09:03:13.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fafe00640 1 -- 172.21.15.173:0/2980518502 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9800c010 con 0x7f7f98007470 2024-04-25T09:03:13.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fb6200640 1 --2- 172.21.15.173:0/2980518502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f98007470 0x7f7f980095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fb6200640 1 -- 172.21.15.173:0/2980518502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f98007dd0 msgr2=0x7f7f98008210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T09:03:13.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fb6200640 1 --2- 172.21.15.173:0/2980518502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f98007dd0 0x7f7f98008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fb6200640 1 -- 172.21.15.173:0/2980518502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f98008c20 msgr2=0x7f7f980090a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:13.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fb6200640 1 --2- 172.21.15.173:0/2980518502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f98008c20 0x7f7f980090a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.810+0000 7f7fb6200640 1 -- 172.21.15.173:0/2980518502 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa8053930 con 0x7f7f98007470 2024-04-25T09:03:13.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.814+0000 7f7fb6200640 1 --2- 172.21.15.173:0/2980518502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f98007470 0x7f7f980095e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00c210 tx=0x7f7f9c01cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5481388f0d4ce39d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.814+0000 7f7fafe00640 1 -- 172.21.15.173:0/2980518502 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c007d00 con 0x7f7f98007470 2024-04-25T09:03:13.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.814+0000 7f7fafe00640 1 -- 172.21.15.173:0/2980518502 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c0a5b60 con 0x7f7f98007470 2024-04-25T09:03:13.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.818+0000 7f7fb6c00640 1 -- 172.21.15.173:0/2980518502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f98007470 msgr2=0x7f7f980095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.818+0000 7f7fafe00640 1 -- 172.21.15.173:0/2980518502 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c007d00 con 0x7f7f98007470 2024-04-25T09:03:13.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.818+0000 7f7fb6c00640 1 --2- 172.21.15.173:0/2980518502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f98007470 0x7f7f980095e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00c210 tx=0x7f7f9c01cc80 comp rx=0 tx=0).stop 2024-04-25T09:03:13.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.818+0000 7f7fb6200640 1 -- 172.21.15.173:0/2980518502 reap_dead start 2024-04-25T09:03:13.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.818+0000 7f7fb6c00640 1 -- 172.21.15.173:0/2980518502 shutdown_connections 2024-04-25T09:03:13.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.818+0000 7f7fb6c00640 1 -- 172.21.15.173:0/2980518502 >> 172.21.15.173:0/2980518502 conn(0x7f7fa8009f90 msgr2=0x7f7fa800a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:13.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.818+0000 7f7fb6c00640 1 -- 172.21.15.173:0/2980518502 shutdown_connections 2024-04-25T09:03:13.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.818+0000 7f7fb6c00640 1 -- 172.21.15.173:0/2980518502 wait complete. 2024-04-25T09:03:13.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.822+0000 7f7fb6c00640 1 Processor -- start 2024-04-25T09:03:13.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.822+0000 7f7fb6c00640 1 -- start start 2024-04-25T09:03:13.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.822+0000 7f7fb6c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fa81a74f0 0x7f7fa80f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fb6c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fa80f8910 0x7f7fa80fb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fb5800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fa81a74f0 0x7f7fa80f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fb5800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fa81a74f0 0x7f7fa80f55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42850/0 (socket says 172.21.15.173:42850) 2024-04-25T09:03:13.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fb5800640 1 -- 172.21.15.173:0/3699535649 learned_addr learned my addr 172.21.15.173:0/3699535649 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:13.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fb6c00640 1 --2- 172.21.15.173:0/3699535649 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fa80f5f80 0x7f7fa80fb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fb6c00640 1 -- 172.21.15.173:0/3699535649 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa8037b00 con 0x7f7fa81a74f0 2024-04-25T09:03:13.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fb6c00640 1 -- 172.21.15.173:0/3699535649 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa803a870 con 0x7f7fa80f5f80 2024-04-25T09:03:13.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fb6c00640 1 -- 172.21.15.173:0/3699535649 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa804fbf0 con 0x7f7fa80f8910 2024-04-25T09:03:13.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fb6200640 1 --2- 172.21.15.173:0/3699535649 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fa80f5f80 0x7f7fa80fb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fb4e00640 1 --2- 172.21.15.173:0/3699535649 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fa80f8910 0x7f7fa80fb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fb6200640 1 -- 172.21.15.173:0/3699535649 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fa80f8910 msgr2=0x7f7fa80fb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fb6200640 1 --2- 172.21.15.173:0/3699535649 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fa80f8910 0x7f7fa80fb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fb6200640 1 -- 172.21.15.173:0/3699535649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fa81a74f0 msgr2=0x7f7fa80f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fb6200640 1 --2- 172.21.15.173:0/3699535649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fa81a74f0 0x7f7fa80f55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fb6200640 1 -- 172.21.15.173:0/3699535649 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa80f7b50 con 0x7f7fa80f5f80 2024-04-25T09:03:13.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fb6200640 1 --2- 172.21.15.173:0/3699535649 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fa80f5f80 0x7f7fa80fb970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c005000 tx=0x7f7f98009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fad600640 1 -- 172.21.15.173:0/3699535649 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb00626c0 con 0x7f7fa80f5f80 2024-04-25T09:03:13.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fad600640 1 -- 172.21.15.173:0/3699535649 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c0b5070 con 0x7f7fa80f5f80 2024-04-25T09:03:13.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fad600640 1 -- 172.21.15.173:0/3699535649 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c007d00 con 0x7f7fa80f5f80 2024-04-25T09:03:13.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fb6c00640 1 -- 172.21.15.173:0/3699535649 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa80f7e30 con 0x7f7fa80f5f80 2024-04-25T09:03:13.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.826+0000 7f7fb6c00640 1 -- 172.21.15.173:0/3699535649 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa80f7820 con 0x7f7fa80f5f80 2024-04-25T09:03:13.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.830+0000 7f7fb6c00640 1 -- 172.21.15.173:0/3699535649 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa8005370 con 0x7f7fa80f5f80 2024-04-25T09:03:13.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.830+0000 7f7fad600640 1 -- 172.21.15.173:0/3699535649 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7f9c0047f0 con 0x7f7fa80f5f80 2024-04-25T09:03:13.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.830+0000 7f7fad600640 1 --2- 172.21.15.173:0/3699535649 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7f90066f60 0x7f7f90069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.834+0000 7f7fb5800640 1 --2- 172.21.15.173:0/3699535649 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7f90066f60 0x7f7f90069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.834+0000 7f7fad600640 1 -- 172.21.15.173:0/3699535649 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7f9c11fb90 con 0x7f7fa80f5f80 2024-04-25T09:03:13.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.834+0000 7f7fb5800640 1 --2- 172.21.15.173:0/3699535649 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7f90066f60 0x7f7f90069420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0068ce0 tx=0x7f7fb0073820 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.834+0000 7f7fad600640 1 -- 172.21.15.173:0/3699535649 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7f9c016990 con 0x7f7fa80f5f80 2024-04-25T09:03:13.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.862+0000 7f876ba00640 1 Processor -- start 2024-04-25T09:03:13.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.866+0000 7f876ba00640 1 -- start start 2024-04-25T09:03:13.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.866+0000 7ffa75000640 1 Processor -- start 2024-04-25T09:03:13.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.866+0000 7f876ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f876414b7b0 0x7f876406dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.866+0000 7f876ba00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f87640b5260 0x7f87640cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.866+0000 7f876ba00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876406e5d0 con 0x7f87640cbc30 2024-04-25T09:03:13.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.866+0000 7f876ba00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87640cd930 con 0x7f87640b5260 2024-04-25T09:03:13.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.866+0000 7f876ba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876406e8b0 con 0x7f876414b7b0 2024-04-25T09:03:13.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.866+0000 7f8763e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f87640cbc30 0x7f87640b4b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38914/0 (socket says 172.21.15.173:38914) 2024-04-25T09:03:13.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.866+0000 7f8763e00640 1 -- 172.21.15.173:0/3045299894 learned_addr learned my addr 172.21.15.173:0/3045299894 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:13.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7f8769000640 1 --2- 172.21.15.173:0/3045299894 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f876414b7b0 0x7f876406dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7f8769a00640 1 --2- 172.21.15.173:0/3045299894 >> v2:172.21.15.194:3300/0 conn(0x7f87640b5260 0x7f87640cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.866+0000 7ffa75000640 1 -- start start 2024-04-25T09:03:13.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa75000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ffa700cbc30 0x7ffa700b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa75000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7006e5d0 con 0x7ffa700b5090 2024-04-25T09:03:13.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa75000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7006e8b0 con 0x7ffa7014b7b0 2024-04-25T09:03:13.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa75000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa700b5500 con 0x7ffa700cbc30 2024-04-25T09:03:13.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7f8763400640 1 -- 172.21.15.173:0/3045299894 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672812495 0 0) 0x7f876406e5d0 con 0x7f87640cbc30 2024-04-25T09:03:13.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7f8763400640 1 -- 172.21.15.173:0/3045299894 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f874c003530 con 0x7f87640cbc30 2024-04-25T09:03:13.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6e800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ffa700b5090 0x7ffa700cddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38922/0 (socket says 172.21.15.173:38922) 2024-04-25T09:03:13.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6e800640 1 -- 172.21.15.173:0/3644522743 learned_addr learned my addr 172.21.15.173:0/3644522743 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:13.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7f8769a00640 1 -- 172.21.15.173:0/3045299894 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f876414b7b0 msgr2=0x7f876406dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:13.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7f8769a00640 1 --2- 172.21.15.173:0/3045299894 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f876414b7b0 0x7f876406dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7f8769a00640 1 -- 172.21.15.173:0/3045299894 >> v1:172.21.15.173:6789/0 conn(0x7f87640cbc30 legacy=0x7f87640b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7f8769a00640 1 -- 172.21.15.173:0/3045299894 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87640cd5c0 con 0x7f87640b5260 2024-04-25T09:03:13.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6d400640 1 --2- 172.21.15.173:0/3644522743 >> v2:172.21.15.173:3300/0 conn(0x7ffa700cbc30 0x7ffa700b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6ca00640 1 -- 172.21.15.173:0/3644522743 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928443050 0 0) 0x7ffa7006e5d0 con 0x7ffa700b5090 2024-04-25T09:03:13.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6ca00640 1 -- 172.21.15.173:0/3644522743 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa54003530 con 0x7ffa700b5090 2024-04-25T09:03:13.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6ca00640 1 -- 172.21.15.173:0/3644522743 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669230818 0 0) 0x7ffa7006e8b0 con 0x7ffa7014b7b0 2024-04-25T09:03:13.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6ca00640 1 -- 172.21.15.173:0/3644522743 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa7006e5d0 con 0x7ffa7014b7b0 2024-04-25T09:03:13.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6ca00640 1 -- 172.21.15.173:0/3644522743 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1089301821 0 0) 0x7ffa54003530 con 0x7ffa700b5090 2024-04-25T09:03:13.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6ca00640 1 -- 172.21.15.173:0/3644522743 >> v2:172.21.15.173:3300/0 conn(0x7ffa700cbc30 msgr2=0x7ffa700b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:13.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6ca00640 1 --2- 172.21.15.173:0/3644522743 >> v2:172.21.15.173:3300/0 conn(0x7ffa700cbc30 0x7ffa700b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6ca00640 1 -- 172.21.15.173:0/3644522743 >> v1:172.21.15.194:6789/0 conn(0x7ffa7014b7b0 legacy=0x7ffa7006dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6ca00640 1 -- 172.21.15.173:0/3644522743 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa700cd5c0 con 0x7ffa700b5090 2024-04-25T09:03:13.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6ca00640 1 -- 172.21.15.173:0/3644522743 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7ffa600016a0 con 0x7ffa700b5090 2024-04-25T09:03:13.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6ca00640 1 -- 172.21.15.173:0/3644522743 >> v1:172.21.15.173:6789/0 conn(0x7ffa700b5090 legacy=0x7ffa700cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6ca00640 1 --2- 172.21.15.173:0/3644522743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa54004bb0 0x7ffa54004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6ca00640 1 --2- 172.21.15.173:0/3644522743 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa540037b0 0x7ffa54003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6ca00640 1 --2- 172.21.15.173:0/3644522743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa54004290 0x7ffa5400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6ca00640 1 -- 172.21.15.173:0/3644522743 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa700b5500 con 0x7ffa54004290 2024-04-25T09:03:13.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6ca00640 1 -- 172.21.15.173:0/3644522743 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5400c1c0 con 0x7ffa54004bb0 2024-04-25T09:03:13.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6ca00640 1 -- 172.21.15.173:0/3644522743 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5400c3c0 con 0x7ffa540037b0 2024-04-25T09:03:13.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6d400640 1 --2- 172.21.15.173:0/3644522743 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa540037b0 0x7ffa54003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.870+0000 7ffa6de00640 1 --2- 172.21.15.173:0/3644522743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa54004bb0 0x7ffa54004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.874+0000 7ffa6e800640 1 --2- 172.21.15.173:0/3644522743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa54004290 0x7ffa5400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.874+0000 7ffa6d400640 1 -- 172.21.15.173:0/3644522743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa54004bb0 msgr2=0x7ffa54004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:13.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.874+0000 7ffa6d400640 1 --2- 172.21.15.173:0/3644522743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa54004bb0 0x7ffa54004f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.874+0000 7ffa6d400640 1 -- 172.21.15.173:0/3644522743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa54004290 msgr2=0x7ffa5400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:13.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.874+0000 7ffa6d400640 1 --2- 172.21.15.173:0/3644522743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa54004290 0x7ffa5400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.874+0000 7ffa6d400640 1 -- 172.21.15.173:0/3644522743 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa54003530 con 0x7ffa540037b0 2024-04-25T09:03:13.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.874+0000 7f8769000640 1 --2- 172.21.15.173:0/3045299894 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f876414b7b0 0x7f876406dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:13.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.874+0000 7ffa6e800640 1 --2- 172.21.15.173:0/3644522743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa54004290 0x7ffa5400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:13.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.874+0000 7ffa6e800640 1 -- 172.21.15.173:0/3644522743 reap_dead start 2024-04-25T09:03:13.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.874+0000 7f8769a00640 1 --2- 172.21.15.173:0/3045299894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640b5260 0x7f87640cddc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f875c009d90 tx=0x7f875c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2312b478b5c27b9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.874+0000 7f8763400640 1 -- 172.21.15.173:0/3045299894 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c0b2070 con 0x7f87640b5260 2024-04-25T09:03:13.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.874+0000 7f8763400640 1 -- 172.21.15.173:0/3045299894 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c0a57f0 con 0x7f87640b5260 2024-04-25T09:03:13.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.874+0000 7f8763400640 1 -- 172.21.15.173:0/3045299894 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c0a5c00 con 0x7f87640b5260 2024-04-25T09:03:13.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7f1d57e00640 1 Processor -- start 2024-04-25T09:03:13.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7f876ba00640 1 -- 172.21.15.173:0/3045299894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640b5260 msgr2=0x7f87640cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7f876ba00640 1 --2- 172.21.15.173:0/3045299894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640b5260 0x7f87640cddc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f875c009d90 tx=0x7f875c01c950 comp rx=0 tx=0).stop 2024-04-25T09:03:13.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7f1d57e00640 1 -- start start 2024-04-25T09:03:13.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7f876ba00640 1 -- 172.21.15.173:0/3045299894 shutdown_connections 2024-04-25T09:03:13.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7f876ba00640 1 --2- 172.21.15.173:0/3045299894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640b5260 0x7f87640cddc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7f876ba00640 1 --2- 172.21.15.173:0/3045299894 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f876414b7b0 0x7f876406dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7f876ba00640 1 -- 172.21.15.173:0/3045299894 >> 172.21.15.173:0/3045299894 conn(0x7f876406b290 msgr2=0x7f87640b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:13.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7f876ba00640 1 -- 172.21.15.173:0/3045299894 shutdown_connections 2024-04-25T09:03:13.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7f876ba00640 1 -- 172.21.15.173:0/3045299894 wait complete. 2024-04-25T09:03:13.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7ffa6d400640 1 --2- 172.21.15.173:0/3644522743 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa540037b0 0x7ffa54003c30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c006fd0 tx=0x7ffa5c01c590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fef7e1f28c5aa8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7ffa6ca00640 1 -- 172.21.15.173:0/3644522743 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00a590 con 0x7ffa540037b0 2024-04-25T09:03:13.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7ffa6ca00640 1 -- 172.21.15.173:0/3644522743 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c0af070 con 0x7ffa540037b0 2024-04-25T09:03:13.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7ffa6ca00640 1 -- 172.21.15.173:0/3644522743 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0aa880 con 0x7ffa540037b0 2024-04-25T09:03:13.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7ffa75000640 1 -- 172.21.15.173:0/3644522743 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa540037b0 msgr2=0x7ffa54003c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7ffa75000640 1 --2- 172.21.15.173:0/3644522743 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa540037b0 0x7ffa54003c30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c006fd0 tx=0x7ffa5c01c590 comp rx=0 tx=0).stop 2024-04-25T09:03:13.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7f1d57e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d5806c020 0x7f1d5806c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f876ba00640 1 Processor -- start 2024-04-25T09:03:13.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f876ba00640 1 -- start start 2024-04-25T09:03:13.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7f1d57e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d580b90d0 con 0x7f1d5815c500 2024-04-25T09:03:13.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7f1d57e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d580d3720 con 0x7f1d580cdfb0 2024-04-25T09:03:13.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7f1d57e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5815c8e0 con 0x7f1d5806c020 2024-04-25T09:03:13.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.878+0000 7f1d56a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f1d5815c500 0x7f1d580b89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38924/0 (socket says 172.21.15.173:38924) 2024-04-25T09:03:13.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f1d56a00640 1 -- 172.21.15.173:0/1842952788 learned_addr learned my addr 172.21.15.173:0/1842952788 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:13.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f1d56000640 1 --2- 172.21.15.173:0/1842952788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d5806c020 0x7f1d5806c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f1d56000640 1 -- 172.21.15.173:0/1842952788 >> v1:172.21.15.194:6789/0 conn(0x7f1d580cdfb0 legacy=0x7f1d580ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:13.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f1d56000640 1 -- 172.21.15.173:0/1842952788 >> v1:172.21.15.173:6789/0 conn(0x7f1d5815c500 legacy=0x7f1d580b89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f1d56000640 1 -- 172.21.15.173:0/1842952788 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d580b7c00 con 0x7f1d5806c020 2024-04-25T09:03:13.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7ffa75000640 1 -- 172.21.15.173:0/3644522743 shutdown_connections 2024-04-25T09:03:13.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7ffa75000640 1 --2- 172.21.15.173:0/3644522743 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa540037b0 0x7ffa54003c30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f876ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87640b5260 0x7f87641469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7ffa75000640 1 -- 172.21.15.173:0/3644522743 >> 172.21.15.173:0/3644522743 conn(0x7ffa7006b290 msgr2=0x7ffa700b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:13.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7ffa75000640 1 -- 172.21.15.173:0/3644522743 shutdown_connections 2024-04-25T09:03:13.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7ffa75000640 1 -- 172.21.15.173:0/3644522743 wait complete. 2024-04-25T09:03:13.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f876ba00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640cbc30 0x7f8764149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f8769000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87640b5260 0x7f87641469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f8769000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87640b5260 0x7f87641469f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:37420/0 (socket says 172.21.15.173:37420) 2024-04-25T09:03:13.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f876ba00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f876414b7b0 0x7f8764149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f8769000640 1 -- 172.21.15.173:0/2689273809 learned_addr learned my addr 172.21.15.173:0/2689273809 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:13.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f876ba00640 1 -- 172.21.15.173:0/2689273809 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87640ceea0 con 0x7f876414b7b0 2024-04-25T09:03:13.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f876ba00640 1 -- 172.21.15.173:0/2689273809 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87640ced20 con 0x7f87640cbc30 2024-04-25T09:03:13.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f876ba00640 1 -- 172.21.15.173:0/2689273809 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87640cf020 con 0x7f87640b5260 2024-04-25T09:03:13.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f8769000640 1 -- 172.21.15.173:0/2689273809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640cbc30 msgr2=0x7f8764149010 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T09:03:13.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f8769000640 1 --2- 172.21.15.173:0/2689273809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640cbc30 0x7f8764149010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f8769000640 1 -- 172.21.15.173:0/2689273809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f876414b7b0 msgr2=0x7f8764149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f8769000640 1 --2- 172.21.15.173:0/2689273809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f876414b7b0 0x7f8764149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f8769000640 1 -- 172.21.15.173:0/2689273809 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8764146f30 con 0x7f87640b5260 2024-04-25T09:03:13.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f8769000640 1 --2- 172.21.15.173:0/2689273809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87640b5260 0x7f87641469f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f875800ec10 tx=0x7f875800c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f8760c00640 1 -- 172.21.15.173:0/2689273809 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8758017070 con 0x7f87640b5260 2024-04-25T09:03:13.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f8760c00640 1 -- 172.21.15.173:0/2689273809 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875800cc30 con 0x7f87640b5260 2024-04-25T09:03:13.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.882+0000 7f8760c00640 1 -- 172.21.15.173:0/2689273809 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8758013470 con 0x7f87640b5260 2024-04-25T09:03:13.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.886+0000 7f876ba00640 1 -- 172.21.15.173:0/2689273809 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876415f420 con 0x7f87640b5260 2024-04-25T09:03:13.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.886+0000 7f876ba00640 1 -- 172.21.15.173:0/2689273809 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876415f9e0 con 0x7f87640b5260 2024-04-25T09:03:13.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.886+0000 7f876ba00640 1 -- 172.21.15.173:0/2689273809 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8764073a40 con 0x7f87640b5260 2024-04-25T09:03:13.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.886+0000 7ffa75000640 1 Processor -- start 2024-04-25T09:03:13.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.886+0000 7f1d56000640 1 --2- 172.21.15.173:0/1842952788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d5806c020 0x7f1d5806c4d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1d440097d0 tx=0x7f1d4401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79dc61ec7fd2191b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.886+0000 7f1d55600640 1 -- 172.21.15.173:0/1842952788 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d440b0070 con 0x7f1d5806c020 2024-04-25T09:03:13.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.886+0000 7f1d55600640 1 -- 172.21.15.173:0/1842952788 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d440ab600 con 0x7f1d5806c020 2024-04-25T09:03:13.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.886+0000 7f1d57e00640 1 -- 172.21.15.173:0/1842952788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d5806c020 msgr2=0x7f1d5806c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.886+0000 7f1d57e00640 1 --2- 172.21.15.173:0/1842952788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d5806c020 0x7f1d5806c4d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1d440097d0 tx=0x7f1d4401c430 comp rx=0 tx=0).stop 2024-04-25T09:03:13.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.886+0000 7ffa75000640 1 -- start start 2024-04-25T09:03:13.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.886+0000 7ffa75000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa540037b0 0x7ffa7015e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.886+0000 7ffa75000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa7014a0f0 0x7ffa701611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.886+0000 7ffa75000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa7014a550 0x7ffa701616f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.886+0000 7ffa75000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa700b4b50 con 0x7ffa7014a550 2024-04-25T09:03:13.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.886+0000 7ffa75000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa700cd930 con 0x7ffa7014a0f0 2024-04-25T09:03:13.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.886+0000 7ffa75000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa700b4cd0 con 0x7ffa540037b0 2024-04-25T09:03:13.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7ffa6d400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa7014a0f0 0x7ffa701611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7ffa6de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa540037b0 0x7ffa7015e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7ffa6de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa540037b0 0x7ffa7015e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:37436/0 (socket says 172.21.15.173:37436) 2024-04-25T09:03:13.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7ffa6de00640 1 -- 172.21.15.173:0/1966210380 learned_addr learned my addr 172.21.15.173:0/1966210380 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:13.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7ffa6e800640 1 --2- 172.21.15.173:0/1966210380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa7014a550 0x7ffa701616f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.886+0000 7f8760c00640 1 -- 172.21.15.173:0/2689273809 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f875801a070 con 0x7f87640b5260 2024-04-25T09:03:13.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7f8760c00640 1 --2- 172.21.15.173:0/2689273809 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8744066fe0 0x7f87440694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7f8760c00640 1 -- 172.21.15.173:0/2689273809 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f87580852a0 con 0x7f87640b5260 2024-04-25T09:03:13.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7f1d57e00640 1 -- 172.21.15.173:0/1842952788 shutdown_connections 2024-04-25T09:03:13.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7f1d57e00640 1 --2- 172.21.15.173:0/1842952788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d5806c020 0x7f1d5806c4d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7f1d57e00640 1 -- 172.21.15.173:0/1842952788 >> 172.21.15.173:0/1842952788 conn(0x7f1d580d3960 msgr2=0x7f1d580d3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:13.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7f8763e00640 1 --2- 172.21.15.173:0/2689273809 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8744066fe0 0x7f87440694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7ffa6d400640 1 -- 172.21.15.173:0/1966210380 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa540037b0 msgr2=0x7ffa7015e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7ffa6d400640 1 --2- 172.21.15.173:0/1966210380 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa540037b0 0x7ffa7015e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7ffa6d400640 1 -- 172.21.15.173:0/1966210380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa7014a550 msgr2=0x7ffa701616f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7ffa6d400640 1 --2- 172.21.15.173:0/1966210380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa7014a550 0x7ffa701616f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7ffa6d400640 1 -- 172.21.15.173:0/1966210380 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa70149050 con 0x7ffa7014a0f0 2024-04-25T09:03:13.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7ffa6d400640 1 --2- 172.21.15.173:0/1966210380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa7014a0f0 0x7ffa701611b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400c590 tx=0x7ffa54005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7ffa66000640 1 -- 172.21.15.173:0/1966210380 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0aaa50 con 0x7ffa7014a0f0 2024-04-25T09:03:13.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7ffa66000640 1 -- 172.21.15.173:0/1966210380 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c0aabf0 con 0x7ffa7014a0f0 2024-04-25T09:03:13.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7ffa66000640 1 -- 172.21.15.173:0/1966210380 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0bd400 con 0x7ffa7014a0f0 2024-04-25T09:03:13.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7ffa75000640 1 -- 172.21.15.173:0/1966210380 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa70149330 con 0x7ffa7014a0f0 2024-04-25T09:03:13.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.890+0000 7ffa75000640 1 -- 172.21.15.173:0/1966210380 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa701498f0 con 0x7ffa7014a0f0 2024-04-25T09:03:13.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.894+0000 7f1d57e00640 1 -- 172.21.15.173:0/1842952788 shutdown_connections 2024-04-25T09:03:13.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.894+0000 7ffa75000640 1 -- 172.21.15.173:0/1966210380 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa70073a40 con 0x7ffa7014a0f0 2024-04-25T09:03:13.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.894+0000 7f1d57e00640 1 -- 172.21.15.173:0/1842952788 wait complete. 2024-04-25T09:03:13.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.894+0000 7f8763e00640 1 --2- 172.21.15.173:0/2689273809 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8744066fe0 0x7f87440694a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8750000f70 tx=0x7f87500078f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.894+0000 7f8760c00640 1 -- 172.21.15.173:0/2689273809 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8758055fc0 con 0x7f87640b5260 2024-04-25T09:03:13.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.894+0000 7ffa66000640 1 -- 172.21.15.173:0/1966210380 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffa5c0a9070 con 0x7ffa7014a0f0 2024-04-25T09:03:13.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.898+0000 7ffa66000640 1 --2- 172.21.15.173:0/1966210380 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa50067060 0x7ffa50069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.898+0000 7f1d57e00640 1 Processor -- start 2024-04-25T09:03:13.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.898+0000 7ffa66000640 1 -- 172.21.15.173:0/1966210380 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ffa5c11f060 con 0x7ffa7014a0f0 2024-04-25T09:03:13.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.898+0000 7ffa6de00640 1 --2- 172.21.15.173:0/1966210380 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa50067060 0x7ffa50069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.898+0000 7f1d57e00640 1 -- start start 2024-04-25T09:03:13.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.898+0000 7f1d57e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d5806c020 0x7f1d581570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.898+0000 7f1d57e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d580cdfb0 0x7f1d58150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.898+0000 7f1d57e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d5815c500 0x7f1d58161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.898+0000 7f1d57e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5816f9f0 con 0x7f1d580cdfb0 2024-04-25T09:03:13.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.898+0000 7f1d57e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d580d3490 con 0x7f1d5815c500 2024-04-25T09:03:13.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.898+0000 7f1d57e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5816fb70 con 0x7f1d5806c020 2024-04-25T09:03:13.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.898+0000 7f1d56000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d580cdfb0 0x7f1d58150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.898+0000 7ffa6de00640 1 --2- 172.21.15.173:0/1966210380 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa50067060 0x7ffa50069520 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa68007be0 tx=0x7ffa68009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.902+0000 7ffa66000640 1 -- 172.21.15.173:0/1966210380 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffa5c0c2030 con 0x7ffa7014a0f0 2024-04-25T09:03:13.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.902+0000 7f1d57400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d5815c500 0x7f1d58161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.902+0000 7f1d56a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d5806c020 0x7f1d581570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.902+0000 7f1d57400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d5815c500 0x7f1d58161010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:60332/0 (socket says 172.21.15.173:60332) 2024-04-25T09:03:13.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.902+0000 7f1d57400640 1 -- 172.21.15.173:0/883409158 learned_addr learned my addr 172.21.15.173:0/883409158 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:13.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.902+0000 7f1d56000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d580cdfb0 0x7f1d58150e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42886/0 (socket says 172.21.15.173:42886) 2024-04-25T09:03:13.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.902+0000 7f1d57400640 1 -- 172.21.15.173:0/883409158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d5806c020 msgr2=0x7f1d581570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.902+0000 7f1d57400640 1 --2- 172.21.15.173:0/883409158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d5806c020 0x7f1d581570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.902+0000 7f1d57400640 1 -- 172.21.15.173:0/883409158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d580cdfb0 msgr2=0x7f1d58150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.902+0000 7f1d57400640 1 --2- 172.21.15.173:0/883409158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d580cdfb0 0x7f1d58150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.902+0000 7f1d57400640 1 -- 172.21.15.173:0/883409158 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d580d17c0 con 0x7f1d5815c500 2024-04-25T09:03:13.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.902+0000 7f1d57400640 1 --2- 172.21.15.173:0/883409158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d5815c500 0x7f1d58161010 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1d5000c7a0 tx=0x7f1d5000cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.902+0000 7f1d4ea00640 1 -- 172.21.15.173:0/883409158 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d50003b80 con 0x7f1d5815c500 2024-04-25T09:03:13.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.902+0000 7f1d4ea00640 1 -- 172.21.15.173:0/883409158 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d50003d20 con 0x7f1d5815c500 2024-04-25T09:03:13.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.902+0000 7f1d4ea00640 1 -- 172.21.15.173:0/883409158 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5000aa90 con 0x7f1d5815c500 2024-04-25T09:03:13.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.902+0000 7f1d57e00640 1 -- 172.21.15.173:0/883409158 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d58161be0 con 0x7f1d5815c500 2024-04-25T09:03:13.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.902+0000 7f1d57e00640 1 -- 172.21.15.173:0/883409158 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d58151390 con 0x7f1d5815c500 2024-04-25T09:03:13.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.906+0000 7f1d4ea00640 1 -- 172.21.15.173:0/883409158 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1d5000ac30 con 0x7f1d5815c500 2024-04-25T09:03:13.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.910+0000 7f1d57e00640 1 -- 172.21.15.173:0/883409158 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d580ca790 con 0x7f1d5815c500 2024-04-25T09:03:13.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.910+0000 7f1d4ea00640 1 --2- 172.21.15.173:0/883409158 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1d38066fe0 0x7f1d380694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.910+0000 7f1d4ea00640 1 -- 172.21.15.173:0/883409158 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1d500851a0 con 0x7f1d5815c500 2024-04-25T09:03:13.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.910+0000 7f1d56a00640 1 --2- 172.21.15.173:0/883409158 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1d38066fe0 0x7f1d380694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.914+0000 7f1d56a00640 1 --2- 172.21.15.173:0/883409158 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1d38066fe0 0x7f1d380694a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1d580b5120 tx=0x7f1d48007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.914+0000 7f1d4ea00640 1 -- 172.21.15.173:0/883409158 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1d50055800 con 0x7f1d5815c500 2024-04-25T09:03:13.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.950+0000 7fe762e00640 1 Processor -- start 2024-04-25T09:03:13.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.950+0000 7fe762e00640 1 -- start start 2024-04-25T09:03:13.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.950+0000 7fe762e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe75c161da0 0x7fe75c071280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.950+0000 7fe762e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe75c164750 0x7fe75c0717c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.950+0000 7fe762e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75c1626a0 con 0x7fe75c162180 2024-04-25T09:03:13.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.950+0000 7fe762e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75c1632b0 con 0x7fe75c161da0 2024-04-25T09:03:13.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.950+0000 7fe762e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c162980 con 0x7fe75c164750 2024-04-25T09:03:13.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.950+0000 7f9c6f200640 1 Processor -- start 2024-04-25T09:03:13.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.950+0000 7fe762400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe75c164750 0x7fe75c0717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.954+0000 7f9c6f200640 1 -- start start 2024-04-25T09:03:13.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.954+0000 7fe761000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe75c162180 0x7fe75c06d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38932/0 (socket says 172.21.15.173:38932) 2024-04-25T09:03:13.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.954+0000 7fe761000640 1 -- 172.21.15.173:0/3479573697 learned_addr learned my addr 172.21.15.173:0/3479573697 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:13.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.954+0000 7fe761a00640 1 --2- 172.21.15.173:0/3479573697 >> v2:172.21.15.173:3300/0 conn(0x7fe75c161da0 0x7fe75c071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.954+0000 7f9c6f200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9c60033e40 0x7f9c600eb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.954+0000 7f9c6f200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c60034220 con 0x7f9c60005ea0 2024-04-25T09:03:13.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.954+0000 7f9c6f200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6004fa30 con 0x7f9c60047c20 2024-04-25T09:03:13.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.954+0000 7f9c6f200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c60050210 con 0x7f9c60033e40 2024-04-25T09:03:13.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.954+0000 7f9c67400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f9c60047c20 0x7f9c600eb6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:39248/0 (socket says 172.21.15.173:39248) 2024-04-25T09:03:13.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.958+0000 7f9c67400640 1 -- 172.21.15.173:0/889000832 learned_addr learned my addr 172.21.15.173:0/889000832 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:13.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.958+0000 7f9c67e00640 1 --2- 172.21.15.173:0/889000832 >> v2:172.21.15.173:3300/0 conn(0x7f9c60033e40 0x7f9c600eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.958+0000 7f9c67e00640 1 -- 172.21.15.173:0/889000832 >> v1:172.21.15.194:6789/0 conn(0x7f9c60047c20 legacy=0x7f9c600eb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.958+0000 7f9c67e00640 1 -- 172.21.15.173:0/889000832 >> v1:172.21.15.173:6789/0 conn(0x7f9c60005ea0 legacy=0x7f9c600062b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T09:03:13.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.958+0000 7f9c67e00640 1 -- 172.21.15.173:0/889000832 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6004f2e0 con 0x7f9c60033e40 2024-04-25T09:03:13.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.954+0000 7fe761a00640 1 -- 172.21.15.173:0/3479573697 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe75c164750 msgr2=0x7fe75c0717c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:13.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.954+0000 7fe761a00640 1 --2- 172.21.15.173:0/3479573697 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe75c164750 0x7fe75c0717c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.954+0000 7fe761a00640 1 -- 172.21.15.173:0/3479573697 >> v1:172.21.15.173:6789/0 conn(0x7fe75c162180 legacy=0x7fe75c06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.954+0000 7fe761a00640 1 -- 172.21.15.173:0/3479573697 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c162c60 con 0x7fe75c161da0 2024-04-25T09:03:13.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7fe761a00640 1 --2- 172.21.15.173:0/3479573697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe75c161da0 0x7fe75c071280 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0097c0 tx=0x7fe74c01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69bcea203c6bc1f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7efe09400640 1 Processor -- start 2024-04-25T09:03:13.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7efe09400640 1 -- start start 2024-04-25T09:03:13.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7f9c67e00640 1 --2- 172.21.15.173:0/889000832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c60033e40 0x7f9c600eb180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9c6802d380 tx=0x7f9c68099a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a11d06f47071fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7fe75be00640 1 -- 172.21.15.173:0/3479573697 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c0b0070 con 0x7fe75c161da0 2024-04-25T09:03:13.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7fe75be00640 1 -- 172.21.15.173:0/3479573697 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c0ab600 con 0x7fe75c161da0 2024-04-25T09:03:13.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7fe75be00640 1 -- 172.21.15.173:0/3479573697 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c0ab9d0 con 0x7fe75c161da0 2024-04-25T09:03:13.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7f570b000640 1 Processor -- start 2024-04-25T09:03:13.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7f570b000640 1 -- start start 2024-04-25T09:03:13.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7f9c66a00640 1 -- 172.21.15.173:0/889000832 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c68124740 con 0x7f9c60033e40 2024-04-25T09:03:13.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7f9c66a00640 1 -- 172.21.15.173:0/889000832 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c681248e0 con 0x7f9c60033e40 2024-04-25T09:03:13.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7f9c66a00640 1 -- 172.21.15.173:0/889000832 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c68124d50 con 0x7f9c60033e40 2024-04-25T09:03:13.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7fe762e00640 1 -- 172.21.15.173:0/3479573697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe75c161da0 msgr2=0x7fe75c071280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7fe762e00640 1 --2- 172.21.15.173:0/3479573697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe75c161da0 0x7fe75c071280 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0097c0 tx=0x7fe74c01c350 comp rx=0 tx=0).stop 2024-04-25T09:03:13.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7efe09400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efe0415db10 0x7efe041621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7fe762e00640 1 -- 172.21.15.173:0/3479573697 shutdown_connections 2024-04-25T09:03:13.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7fe762e00640 1 --2- 172.21.15.173:0/3479573697 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe75c164750 0x7fe75c0717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7fe762e00640 1 --2- 172.21.15.173:0/3479573697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe75c161da0 0x7fe75c071280 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7fe762e00640 1 -- 172.21.15.173:0/3479573697 >> 172.21.15.173:0/3479573697 conn(0x7fe75c061ab0 msgr2=0x7fe75c06ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:13.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7fe762e00640 1 -- 172.21.15.173:0/3479573697 shutdown_connections 2024-04-25T09:03:13.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7fe762e00640 1 -- 172.21.15.173:0/3479573697 wait complete. 2024-04-25T09:03:13.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7efe09400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe0415def0 0x7efe040cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7f9c6f200640 1 -- 172.21.15.173:0/889000832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c60033e40 msgr2=0x7f9c600eb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7f9c6f200640 1 --2- 172.21.15.173:0/889000832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c60033e40 0x7f9c600eb180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9c6802d380 tx=0x7f9c68099a90 comp rx=0 tx=0).stop 2024-04-25T09:03:13.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7f570b000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f570415d7e0 0x7f57040cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7f9c6f200640 1 -- 172.21.15.173:0/889000832 shutdown_connections 2024-04-25T09:03:13.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7f9c6f200640 1 --2- 172.21.15.173:0/889000832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c60033e40 0x7f9c600eb180 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.962+0000 7f9c6f200640 1 -- 172.21.15.173:0/889000832 >> 172.21.15.173:0/889000832 conn(0x7f9c60009fc0 msgr2=0x7f9c6000a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:13.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7f570b000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5704072240 0x7f57040cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7efe03200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7efe040cc630 0x7efe04071bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38942/0 (socket says 172.21.15.173:38942) 2024-04-25T09:03:13.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7efe03200640 1 -- 172.21.15.173:0/2427801558 learned_addr learned my addr 172.21.15.173:0/2427801558 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:13.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7efe09400640 1 -- 172.21.15.173:0/2427801558 --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe040ccab0 con 0x7efe040cc630 2024-04-25T09:03:13.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7efe01e00640 1 --2- 172.21.15.173:0/2427801558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe0415def0 0x7efe040cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7f570b000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57040ccff0 con 0x7f570415dbc0 2024-04-25T09:03:13.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7f570b000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57040cca30 con 0x7f570415d7e0 2024-04-25T09:03:13.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7f570b000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57040ccd10 con 0x7f5704072240 2024-04-25T09:03:13.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7f5709c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f570415d7e0 0x7f57040cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7f9c6f200640 1 -- 172.21.15.173:0/889000832 shutdown_connections 2024-04-25T09:03:13.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7f5709c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f570415d7e0 0x7f57040cc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42938/0 (socket says 172.21.15.173:42938) 2024-04-25T09:03:13.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7f5709c00640 1 -- 172.21.15.173:0/2570307568 learned_addr learned my addr 172.21.15.173:0/2570307568 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:13.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7f5709200640 1 --2- 172.21.15.173:0/2570307568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5704072240 0x7f57040cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7efe09400640 1 -- 172.21.15.173:0/2427801558 --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe040ccd90 con 0x7efe0415db10 2024-04-25T09:03:13.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7f9c6f200640 1 -- 172.21.15.173:0/889000832 wait complete. 2024-04-25T09:03:13.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7f5709200640 1 -- 172.21.15.173:0/2570307568 >> v2:172.21.15.173:3300/0 conn(0x7f570415d7e0 msgr2=0x7f57040cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:13.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7f5709200640 1 --2- 172.21.15.173:0/2570307568 >> v2:172.21.15.173:3300/0 conn(0x7f570415d7e0 0x7f57040cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7f5709200640 1 -- 172.21.15.173:0/2570307568 >> v1:172.21.15.194:6789/0 conn(0x7f570415dbc0 legacy=0x7f5704071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7f5709200640 1 -- 172.21.15.173:0/2570307568 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57040cd4d0 con 0x7f5704072240 2024-04-25T09:03:13.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7fe762e00640 1 Processor -- start 2024-04-25T09:03:13.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7efe09400640 1 -- 172.21.15.173:0/2427801558 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe041619f0 con 0x7efe0415def0 2024-04-25T09:03:13.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7efe01400640 1 -- 172.21.15.173:0/2427801558 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629858705 0 0) 0x7efe040ccab0 con 0x7efe040cc630 2024-04-25T09:03:13.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7efe01400640 1 -- 172.21.15.173:0/2427801558 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde8003530 con 0x7efe040cc630 2024-04-25T09:03:13.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7efe01400640 1 -- 172.21.15.173:0/2427801558 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3565631811 0 0) 0x7efde8003530 con 0x7efe040cc630 2024-04-25T09:03:13.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7efe01400640 1 -- 172.21.15.173:0/2427801558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe0415def0 msgr2=0x7efe040cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:13.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7efe01400640 1 --2- 172.21.15.173:0/2427801558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe0415def0 0x7efe040cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7f9c6f200640 1 Processor -- start 2024-04-25T09:03:13.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7fe762e00640 1 -- start start 2024-04-25T09:03:13.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7efe01400640 1 -- 172.21.15.173:0/2427801558 >> v2:172.21.15.173:3300/0 conn(0x7efe0415db10 msgr2=0x7efe041621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:13.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7efe01400640 1 --2- 172.21.15.173:0/2427801558 >> v2:172.21.15.173:3300/0 conn(0x7efe0415db10 0x7efe041621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7efe01400640 1 -- 172.21.15.173:0/2427801558 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe04161cd0 con 0x7efe040cc630 2024-04-25T09:03:13.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7efe01400640 1 -- 172.21.15.173:0/2427801558 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7efdfc001a00 con 0x7efe040cc630 2024-04-25T09:03:13.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.966+0000 7efe01400640 1 -- 172.21.15.173:0/2427801558 >> v1:172.21.15.173:6789/0 conn(0x7efe040cc630 legacy=0x7efe04071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7efe01400640 1 --2- 172.21.15.173:0/2427801558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efde80039c0 0x7efde8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7efe01400640 1 --2- 172.21.15.173:0/2427801558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde8004810 0x7efde8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7efe01400640 1 --2- 172.21.15.173:0/2427801558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efde80052f0 0x7efde800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7efe01400640 1 -- 172.21.15.173:0/2427801558 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe040ccd90 con 0x7efde8004810 2024-04-25T09:03:13.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7efe01400640 1 -- 172.21.15.173:0/2427801558 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe041619f0 con 0x7efde80039c0 2024-04-25T09:03:13.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7efe01400640 1 -- 172.21.15.173:0/2427801558 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde800c200 con 0x7efde80052f0 2024-04-25T09:03:13.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f9c6f200640 1 -- start start 2024-04-25T09:03:13.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7efe01e00640 1 --2- 172.21.15.173:0/2427801558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe0415def0 0x7efe040cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:13.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f5709200640 1 --2- 172.21.15.173:0/2570307568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5704072240 0x7f57040cdcd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f56f00097f0 tx=0x7f56f001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7d484a0434eef97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7efe03200640 1 --2- 172.21.15.173:0/2427801558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efde80052f0 0x7efde800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7efe02800640 1 --2- 172.21.15.173:0/2427801558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efde80039c0 0x7efde8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7efe01e00640 1 --2- 172.21.15.173:0/2427801558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde8004810 0x7efde8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7efe02800640 1 -- 172.21.15.173:0/2427801558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efde80052f0 msgr2=0x7efde800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:13.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7efe02800640 1 --2- 172.21.15.173:0/2427801558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efde80052f0 0x7efde800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7efe02800640 1 -- 172.21.15.173:0/2427801558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde8004810 msgr2=0x7efde8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:13.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7efe02800640 1 --2- 172.21.15.173:0/2427801558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde8004810 0x7efde8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7efe02800640 1 -- 172.21.15.173:0/2427801558 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe04161cd0 con 0x7efde80039c0 2024-04-25T09:03:13.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7efe01e00640 1 --2- 172.21.15.173:0/2427801558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde8004810 0x7efde8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:13.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f9c6f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c60005ea0 0x7f9c600cef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f9c6f200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c60033e40 0x7f9c6004db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f9c6f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c60047c20 0x7f9c6004e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f5703e00640 1 -- 172.21.15.173:0/2570307568 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f00aa610 con 0x7f5704072240 2024-04-25T09:03:13.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f5703e00640 1 -- 172.21.15.173:0/2570307568 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f00af070 con 0x7f5704072240 2024-04-25T09:03:13.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f570b000640 1 -- 172.21.15.173:0/2570307568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5704072240 msgr2=0x7f57040cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f5703e00640 1 -- 172.21.15.173:0/2570307568 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f00aa610 con 0x7f5704072240 2024-04-25T09:03:13.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f570b000640 1 --2- 172.21.15.173:0/2570307568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5704072240 0x7f57040cdcd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f56f00097f0 tx=0x7f56f001c490 comp rx=0 tx=0).stop 2024-04-25T09:03:13.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f570b000640 1 -- 172.21.15.173:0/2570307568 shutdown_connections 2024-04-25T09:03:13.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f570b000640 1 --2- 172.21.15.173:0/2570307568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5704072240 0x7f57040cdcd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f570b000640 1 --2- 172.21.15.173:0/2570307568 >> v2:172.21.15.173:3300/0 conn(0x7f570415d7e0 0x7f57040cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f570b000640 1 -- 172.21.15.173:0/2570307568 >> 172.21.15.173:0/2570307568 conn(0x7f5704061ab0 msgr2=0x7f570406ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:13.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f9c67e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c60005ea0 0x7f9c600cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7fe762e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe75c161da0 0x7fe75c1520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f9c6d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c60047c20 0x7f9c6004e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f9c6d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c60047c20 0x7f9c6004e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:60344/0 (socket says 172.21.15.173:60344) 2024-04-25T09:03:13.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7fe762e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe75c162180 0x7fe75c158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f9c6d200640 1 -- 172.21.15.173:0/1778538748 learned_addr learned my addr 172.21.15.173:0/1778538748 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:13.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f9c6f200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6004f090 con 0x7f9c60033e40 2024-04-25T09:03:13.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f9c6f200640 1 -- 172.21.15.173:0/1778538748 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6004fd80 con 0x7f9c60047c20 2024-04-25T09:03:13.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f9c6f200640 1 -- 172.21.15.173:0/1778538748 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c600482c0 con 0x7f9c60005ea0 2024-04-25T09:03:13.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f570b000640 1 -- 172.21.15.173:0/2570307568 shutdown_connections 2024-04-25T09:03:13.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.970+0000 7f570b000640 1 -- 172.21.15.173:0/2570307568 wait complete. 2024-04-25T09:03:13.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7f9c67400640 1 --2- 172.21.15.173:0/1778538748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c60033e40 0x7f9c6004db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7fe761a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe75c161da0 0x7fe75c1520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7fe761a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe75c161da0 0x7fe75c1520a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:37494/0 (socket says 172.21.15.173:37494) 2024-04-25T09:03:13.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7fe761000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe75c162180 0x7fe75c158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7fe761000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe75c162180 0x7fe75c158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:60360/0 (socket says 172.21.15.173:60360) 2024-04-25T09:03:13.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7fe762e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe75c164750 0x7fe75c145e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7f9c6d200640 1 -- 172.21.15.173:0/1778538748 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c60005ea0 msgr2=0x7f9c600cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7f9c6d200640 1 --2- 172.21.15.173:0/1778538748 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c60005ea0 0x7f9c600cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7f9c6d200640 1 -- 172.21.15.173:0/1778538748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c60033e40 msgr2=0x7f9c6004db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7f9c6d200640 1 --2- 172.21.15.173:0/1778538748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c60033e40 0x7f9c6004db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7f9c6d200640 1 -- 172.21.15.173:0/1778538748 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c600cf440 con 0x7f9c60047c20 2024-04-25T09:03:13.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7f9c6d200640 1 --2- 172.21.15.173:0/1778538748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c60047c20 0x7f9c6004e050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400b410 tx=0x7f9c5400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7f9c5be00640 1 -- 172.21.15.173:0/1778538748 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c54015020 con 0x7f9c60047c20 2024-04-25T09:03:13.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7fe762e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c06e9a0 con 0x7fe75c164750 2024-04-25T09:03:13.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7fe761a00640 1 -- 172.21.15.173:0/2959673454 learned_addr learned my addr 172.21.15.173:0/2959673454 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:13.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7f9c5be00640 1 -- 172.21.15.173:0/1778538748 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c54011830 con 0x7f9c60047c20 2024-04-25T09:03:13.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7f9c5be00640 1 -- 172.21.15.173:0/1778538748 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c54011ca0 con 0x7f9c60047c20 2024-04-25T09:03:13.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7f9c6f200640 1 -- 172.21.15.173:0/1778538748 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c600dd060 con 0x7f9c60047c20 2024-04-25T09:03:13.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7fe762e00640 1 -- 172.21.15.173:0/2959673454 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c0cf410 con 0x7fe75c162180 2024-04-25T09:03:13.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7fe762e00640 1 -- 172.21.15.173:0/2959673454 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c06eb20 con 0x7fe75c161da0 2024-04-25T09:03:13.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7fe762400640 1 --2- 172.21.15.173:0/2959673454 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe75c164750 0x7fe75c145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7fe762400640 1 -- 172.21.15.173:0/2959673454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe75c161da0 msgr2=0x7fe75c1520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7fe762400640 1 --2- 172.21.15.173:0/2959673454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe75c161da0 0x7fe75c1520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7fe762400640 1 -- 172.21.15.173:0/2959673454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe75c162180 msgr2=0x7fe75c158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7f9c6f200640 1 -- 172.21.15.173:0/1778538748 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c600e2fe0 con 0x7f9c60047c20 2024-04-25T09:03:13.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7f9c6f200640 1 -- 172.21.15.173:0/1778538748 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c600053a0 con 0x7f9c60047c20 2024-04-25T09:03:13.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7efe02800640 1 --2- 172.21.15.173:0/2427801558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efde80039c0 0x7efde8003de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009890 tx=0x7efdf401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1a705ca3241c3fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7fe762400640 1 --2- 172.21.15.173:0/2959673454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe75c162180 0x7fe75c158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7fe762400640 1 -- 172.21.15.173:0/2959673454 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c152730 con 0x7fe75c164750 2024-04-25T09:03:13.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7fe761000640 1 --2- 172.21.15.173:0/2959673454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe75c162180 0x7fe75c158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:13.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7fe761a00640 1 --2- 172.21.15.173:0/2959673454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe75c161da0 0x7fe75c1520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:13.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7fe762400640 1 --2- 172.21.15.173:0/2959673454 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe75c164750 0x7fe75c145e90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe75400cc50 tx=0x7fe75400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7f570b000640 1 Processor -- start 2024-04-25T09:03:13.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.974+0000 7f570b000640 1 -- start start 2024-04-25T09:03:13.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7fe759600640 1 -- 172.21.15.173:0/2959673454 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75400ce00 con 0x7fe75c164750 2024-04-25T09:03:13.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7efe01400640 1 -- 172.21.15.173:0/2427801558 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf40b0070 con 0x7efde80039c0 2024-04-25T09:03:13.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7efe01400640 1 -- 172.21.15.173:0/2427801558 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf40ab620 con 0x7efde80039c0 2024-04-25T09:03:13.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7efe01400640 1 -- 172.21.15.173:0/2427801558 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4009460 con 0x7efde80039c0 2024-04-25T09:03:13.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7fe759600640 1 -- 172.21.15.173:0/2959673454 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7540039a0 con 0x7fe75c164750 2024-04-25T09:03:13.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7fe762e00640 1 -- 172.21.15.173:0/2959673454 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c154960 con 0x7fe75c164750 2024-04-25T09:03:13.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7fe759600640 1 -- 172.21.15.173:0/2959673454 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754003d70 con 0x7fe75c164750 2024-04-25T09:03:13.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7fe762e00640 1 -- 172.21.15.173:0/2959673454 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c154f20 con 0x7fe75c164750 2024-04-25T09:03:13.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f570b000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5704072240 0x7f57040cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f570b000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f570415d7e0 0x7f570414c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f9c5be00640 1 -- 172.21.15.173:0/1778538748 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9c54018020 con 0x7f9c60047c20 2024-04-25T09:03:13.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f570b000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f570415dbc0 0x7f57040cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f5709c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5704072240 0x7f57040cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f5709c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5704072240 0x7f57040cac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42976/0 (socket says 172.21.15.173:42976) 2024-04-25T09:03:13.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f5709200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f570415d7e0 0x7f570414c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f5709200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f570415d7e0 0x7f570414c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:60374/0 (socket says 172.21.15.173:60374) 2024-04-25T09:03:13.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f5709c00640 1 -- 172.21.15.173:0/1513223436 learned_addr learned my addr 172.21.15.173:0/1513223436 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:13.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f570b000640 1 -- 172.21.15.173:0/1513223436 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5704071b10 con 0x7f5704072240 2024-04-25T09:03:13.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f570b000640 1 -- 172.21.15.173:0/1513223436 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5704071990 con 0x7f570415d7e0 2024-04-25T09:03:13.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f570b000640 1 -- 172.21.15.173:0/1513223436 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57040c9530 con 0x7f570415dbc0 2024-04-25T09:03:13.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f570a600640 1 --2- 172.21.15.173:0/1513223436 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f570415dbc0 0x7f57040cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f5709c00640 1 -- 172.21.15.173:0/1513223436 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f570415dbc0 msgr2=0x7f57040cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f5709c00640 1 --2- 172.21.15.173:0/1513223436 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f570415dbc0 0x7f57040cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f9c5be00640 1 --2- 172.21.15.173:0/1778538748 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9c48067060 0x7f9c48069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7f9c5be00640 1 -- 172.21.15.173:0/1778538748 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9c54084490 con 0x7f9c60047c20 2024-04-25T09:03:13.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7efe09400640 1 -- 172.21.15.173:0/2427801558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efde80039c0 msgr2=0x7efde8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7efe09400640 1 --2- 172.21.15.173:0/2427801558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efde80039c0 0x7efde8003de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009890 tx=0x7efdf401c3c0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f5709c00640 1 -- 172.21.15.173:0/1513223436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f570415d7e0 msgr2=0x7f570414c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f5709c00640 1 --2- 172.21.15.173:0/1513223436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f570415d7e0 0x7f570414c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f5709c00640 1 -- 172.21.15.173:0/1513223436 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57040cc220 con 0x7f5704072240 2024-04-25T09:03:13.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f5709200640 1 --2- 172.21.15.173:0/1513223436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f570415d7e0 0x7f570414c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:13.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7f570a600640 1 --2- 172.21.15.173:0/1513223436 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f570415dbc0 0x7f57040cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:13.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7f5709c00640 1 --2- 172.21.15.173:0/1513223436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5704072240 0x7f57040cac60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f56f800e890 tx=0x7f56f800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.978+0000 7fe762e00640 1 -- 172.21.15.173:0/2959673454 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75c073a40 con 0x7fe75c164750 2024-04-25T09:03:13.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7fe759600640 1 -- 172.21.15.173:0/2959673454 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe754003f10 con 0x7fe75c164750 2024-04-25T09:03:13.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7efe03200640 1 -- 172.21.15.173:0/2427801558 reap_dead start 2024-04-25T09:03:13.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7efe09400640 1 -- 172.21.15.173:0/2427801558 shutdown_connections 2024-04-25T09:03:13.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7efe09400640 1 -- 172.21.15.173:0/2427801558 >> 172.21.15.173:0/2427801558 conn(0x7efe0406ac90 msgr2=0x7efe0406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:13.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7f9c67e00640 1 --2- 172.21.15.173:0/1778538748 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9c48067060 0x7f9c48069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7f5701600640 1 -- 172.21.15.173:0/1513223436 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f8017070 con 0x7f5704072240 2024-04-25T09:03:13.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7f570b000640 1 -- 172.21.15.173:0/1513223436 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57040ca180 con 0x7f5704072240 2024-04-25T09:03:13.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7f5701600640 1 -- 172.21.15.173:0/1513223436 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f800c940 con 0x7f5704072240 2024-04-25T09:03:13.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7f5701600640 1 -- 172.21.15.173:0/1513223436 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f8017070 con 0x7f5704072240 2024-04-25T09:03:13.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7f570b000640 1 -- 172.21.15.173:0/1513223436 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57040ca740 con 0x7f5704072240 2024-04-25T09:03:13.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7f9c67e00640 1 --2- 172.21.15.173:0/1778538748 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9c48067060 0x7f9c48069520 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000b520 tx=0x7f9c68130040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7efe09400640 1 -- 172.21.15.173:0/2427801558 shutdown_connections 2024-04-25T09:03:13.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7fe759600640 1 --2- 172.21.15.173:0/2959673454 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe740066fb0 0x7fe740069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7fe761a00640 1 --2- 172.21.15.173:0/2959673454 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe740066fb0 0x7fe740069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7f570b000640 1 -- 172.21.15.173:0/1513223436 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5704073a40 con 0x7f5704072240 2024-04-25T09:03:13.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7fe759600640 1 -- 172.21.15.173:0/2959673454 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe754085680 con 0x7fe75c164750 2024-04-25T09:03:13.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7f9c5be00640 1 -- 172.21.15.173:0/1778538748 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9c54055150 con 0x7f9c60047c20 2024-04-25T09:03:13.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.982+0000 7fe761a00640 1 --2- 172.21.15.173:0/2959673454 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe740066fb0 0x7fe740069470 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe74c01cbf0 tx=0x7fe74c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.986+0000 7efe09400640 1 -- 172.21.15.173:0/2427801558 wait complete. 2024-04-25T09:03:13.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.990+0000 7efe09400640 1 Processor -- start 2024-04-25T09:03:13.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.990+0000 7efe09400640 1 -- start start 2024-04-25T09:03:13.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.994+0000 7efe09400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe04150700 0x7efe04159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.990+0000 7fe759600640 1 -- 172.21.15.173:0/2959673454 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe75c152730 con 0x7fe75c164750 2024-04-25T09:03:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.994+0000 7efe09400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe04150ae0 0x7efe04154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.994+0000 7efe09400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe04155420 0x7efe041f9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.994+0000 7efe09400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe040724e0 con 0x7efe04150ae0 2024-04-25T09:03:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.994+0000 7efe09400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe040af170 con 0x7efe04155420 2024-04-25T09:03:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.994+0000 7efe09400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe040cc0f0 con 0x7efe04150700 2024-04-25T09:03:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.994+0000 7efe03200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe04155420 0x7efe041f9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.994+0000 7efe03200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe04155420 0x7efe041f9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:60380/0 (socket says 172.21.15.173:60380) 2024-04-25T09:03:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.994+0000 7efe03200640 1 -- 172.21.15.173:0/266532403 learned_addr learned my addr 172.21.15.173:0/266532403 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.994+0000 7efe01e00640 1 --2- 172.21.15.173:0/266532403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe04150ae0 0x7efe04154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.994+0000 7efe03200640 1 -- 172.21.15.173:0/266532403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe04150700 msgr2=0x7efe04159260 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T09:03:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.994+0000 7efe03200640 1 --2- 172.21.15.173:0/266532403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe04150700 0x7efe04159260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.994+0000 7efe03200640 1 -- 172.21.15.173:0/266532403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe04150ae0 msgr2=0x7efe04154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.994+0000 7efe03200640 1 --2- 172.21.15.173:0/266532403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe04150ae0 0x7efe04154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.994+0000 7efe03200640 1 -- 172.21.15.173:0/266532403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe040ad250 con 0x7efe04155420 2024-04-25T09:03:13.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.994+0000 7efe01e00640 1 --2- 172.21.15.173:0/266532403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe04150ae0 0x7efe04154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:13.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.998+0000 7efe03200640 1 --2- 172.21.15.173:0/266532403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe04155420 0x7efe041f9790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efe040ce040 tx=0x7efdfc00e530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.998+0000 7f5701600640 1 -- 172.21.15.173:0/1513223436 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f56f801a070 con 0x7f5704072240 2024-04-25T09:03:13.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.998+0000 7efdfaa00640 1 -- 172.21.15.173:0/266532403 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc013420 con 0x7efe04155420 2024-04-25T09:03:13.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.998+0000 7efdfaa00640 1 -- 172.21.15.173:0/266532403 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc0135c0 con 0x7efe04155420 2024-04-25T09:03:13.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.998+0000 7efdfaa00640 1 -- 172.21.15.173:0/266532403 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc013790 con 0x7efe04155420 2024-04-25T09:03:13.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.998+0000 7efe09400640 1 -- 172.21.15.173:0/266532403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe040ad530 con 0x7efe04155420 2024-04-25T09:03:13.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.998+0000 7efe09400640 1 -- 172.21.15.173:0/266532403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe040adaf0 con 0x7efe04155420 2024-04-25T09:03:13.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.998+0000 7f5701600640 1 --2- 172.21.15.173:0/1513223436 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f56e4067160 0x7f56e4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.998+0000 7f5709200640 1 --2- 172.21.15.173:0/1513223436 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f56e4067160 0x7f56e4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:13.998+0000 7efe09400640 1 -- 172.21.15.173:0/266532403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0406bc90 con 0x7efe04155420 2024-04-25T09:03:13.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.006+0000 7f5701600640 1 -- 172.21.15.173:0/1513223436 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f56f8085600 con 0x7f5704072240 2024-04-25T09:03:13.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.006+0000 7f5709200640 1 --2- 172.21.15.173:0/1513223436 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f56e4067160 0x7f56e4069620 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f56f00ae000 tx=0x7f56f00b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.006+0000 7f5701600640 1 -- 172.21.15.173:0/1513223436 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f56f8055c60 con 0x7f5704072240 2024-04-25T09:03:13.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.006+0000 7efdfaa00640 1 -- 172.21.15.173:0/266532403 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efdfc01a020 con 0x7efe04155420 2024-04-25T09:03:13.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.006+0000 7efdfaa00640 1 --2- 172.21.15.173:0/266532403 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efde4066fe0 0x7efde40694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:13.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.006+0000 7efdfaa00640 1 -- 172.21.15.173:0/266532403 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7efdfc0850b0 con 0x7efe04155420 2024-04-25T09:03:13.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.006+0000 7efe02800640 1 --2- 172.21.15.173:0/266532403 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efde4066fe0 0x7efde40694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:13.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.010+0000 7efe02800640 1 --2- 172.21.15.173:0/266532403 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efde4066fe0 0x7efde40694a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efdf40ad000 tx=0x7efdf4004850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:13.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.010+0000 7efdfaa00640 1 -- 172.21.15.173:0/266532403 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efdfc021020 con 0x7efe04155420 2024-04-25T09:03:14.001 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:14.005 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:14.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.190+0000 7f7fb6c00640 1 -- 172.21.15.173:0/3699535649 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7fa8038c20 con 0x7f7fa80f5f80 2024-04-25T09:03:14.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.190+0000 7f7fad600640 1 -- 172.21.15.173:0/3699535649 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f9c0f0210 con 0x7f7fa80f5f80 2024-04-25T09:03:14.179 INFO:teuthology.orchestra.run.smithi173.stdout:64424509450 2024-04-25T09:03:14.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.194+0000 7f7fb6c00640 1 -- 172.21.15.173:0/3699535649 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7f90066f60 msgr2=0x7f7f90069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.194+0000 7f7fb6c00640 1 --2- 172.21.15.173:0/3699535649 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7f90066f60 0x7f7f90069420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0068ce0 tx=0x7f7fb0073820 comp rx=0 tx=0).stop 2024-04-25T09:03:14.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.194+0000 7f7fb6c00640 1 -- 172.21.15.173:0/3699535649 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fa80f5f80 msgr2=0x7f7fa80fb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.194+0000 7f7fb6c00640 1 --2- 172.21.15.173:0/3699535649 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fa80f5f80 0x7f7fa80fb970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c005000 tx=0x7f7f98009c50 comp rx=0 tx=0).stop 2024-04-25T09:03:14.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.198+0000 7f7fb6c00640 1 -- 172.21.15.173:0/3699535649 shutdown_connections 2024-04-25T09:03:14.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.198+0000 7f7fb6c00640 1 --2- 172.21.15.173:0/3699535649 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7f90066f60 0x7f7f90069420 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.198+0000 7f7fb6c00640 1 --2- 172.21.15.173:0/3699535649 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fa80f5f80 0x7f7fa80fb970 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.198+0000 7f7fb6c00640 1 --2- 172.21.15.173:0/3699535649 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fa80f8910 0x7f7fa80fb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.198+0000 7f7fb6c00640 1 --2- 172.21.15.173:0/3699535649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fa81a74f0 0x7f7fa80f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.198+0000 7f7fb6c00640 1 -- 172.21.15.173:0/3699535649 >> 172.21.15.173:0/3699535649 conn(0x7f7fa8009f90 msgr2=0x7f7fa8039420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.198+0000 7f7fb6c00640 1 -- 172.21.15.173:0/3699535649 shutdown_connections 2024-04-25T09:03:14.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.198+0000 7f7fb6c00640 1 -- 172.21.15.173:0/3699535649 wait complete. 2024-04-25T09:03:14.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.0 2024-04-25T09:03:14.220 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:14.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.230+0000 7f876ba00640 1 -- 172.21.15.173:0/2689273809 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8764149bb0 con 0x7f87640b5260 2024-04-25T09:03:14.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.230+0000 7f8760c00640 1 -- 172.21.15.173:0/2689273809 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f87580558c0 con 0x7f87640b5260 2024-04-25T09:03:14.221 INFO:teuthology.orchestra.run.smithi173.stdout:64424509450 2024-04-25T09:03:14.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.234+0000 7f876ba00640 1 -- 172.21.15.173:0/2689273809 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8744066fe0 msgr2=0x7f87440694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.234+0000 7f876ba00640 1 --2- 172.21.15.173:0/2689273809 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8744066fe0 0x7f87440694a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8750000f70 tx=0x7f87500078f0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.234+0000 7f876ba00640 1 -- 172.21.15.173:0/2689273809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87640b5260 msgr2=0x7f87641469f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.234+0000 7f876ba00640 1 --2- 172.21.15.173:0/2689273809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87640b5260 0x7f87641469f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f875800ec10 tx=0x7f875800c520 comp rx=0 tx=0).stop 2024-04-25T09:03:14.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.234+0000 7f876ba00640 1 -- 172.21.15.173:0/2689273809 shutdown_connections 2024-04-25T09:03:14.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.234+0000 7f876ba00640 1 --2- 172.21.15.173:0/2689273809 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8744066fe0 0x7f87440694a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.234+0000 7f876ba00640 1 --2- 172.21.15.173:0/2689273809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f876414b7b0 0x7f8764149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.234+0000 7f876ba00640 1 --2- 172.21.15.173:0/2689273809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87640cbc30 0x7f8764149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.234+0000 7f876ba00640 1 --2- 172.21.15.173:0/2689273809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87640b5260 0x7f87641469f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.234+0000 7f876ba00640 1 -- 172.21.15.173:0/2689273809 >> 172.21.15.173:0/2689273809 conn(0x7f876406b290 msgr2=0x7f87640b4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.234+0000 7ffa75000640 1 -- 172.21.15.173:0/1966210380 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffa700b58d0 con 0x7ffa7014a0f0 2024-04-25T09:03:14.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.238+0000 7f876ba00640 1 -- 172.21.15.173:0/2689273809 shutdown_connections 2024-04-25T09:03:14.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.238+0000 7f876ba00640 1 -- 172.21.15.173:0/2689273809 wait complete. 2024-04-25T09:03:14.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.238+0000 7ffa66000640 1 -- 172.21.15.173:0/1966210380 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa5c0162a0 con 0x7ffa7014a0f0 2024-04-25T09:03:14.227 INFO:teuthology.orchestra.run.smithi173.stdout:64424509449 2024-04-25T09:03:14.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.242+0000 7ffa75000640 1 -- 172.21.15.173:0/1966210380 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa50067060 msgr2=0x7ffa50069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.242+0000 7ffa75000640 1 --2- 172.21.15.173:0/1966210380 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa50067060 0x7ffa50069520 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa68007be0 tx=0x7ffa68009040 comp rx=0 tx=0).stop 2024-04-25T09:03:14.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.242+0000 7ffa75000640 1 -- 172.21.15.173:0/1966210380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa7014a0f0 msgr2=0x7ffa701611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.242+0000 7ffa75000640 1 --2- 172.21.15.173:0/1966210380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa7014a0f0 0x7ffa701611b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400c590 tx=0x7ffa54005840 comp rx=0 tx=0).stop 2024-04-25T09:03:14.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.242+0000 7ffa75000640 1 -- 172.21.15.173:0/1966210380 shutdown_connections 2024-04-25T09:03:14.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.242+0000 7ffa75000640 1 --2- 172.21.15.173:0/1966210380 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa50067060 0x7ffa50069520 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.242+0000 7ffa75000640 1 --2- 172.21.15.173:0/1966210380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa7014a550 0x7ffa701616f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.242+0000 7ffa75000640 1 --2- 172.21.15.173:0/1966210380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa7014a0f0 0x7ffa701611b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.242+0000 7ffa75000640 1 --2- 172.21.15.173:0/1966210380 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa540037b0 0x7ffa7015e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.242+0000 7ffa75000640 1 -- 172.21.15.173:0/1966210380 >> 172.21.15.173:0/1966210380 conn(0x7ffa7006b290 msgr2=0x7ffa700af2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.242+0000 7ffa75000640 1 -- 172.21.15.173:0/1966210380 shutdown_connections 2024-04-25T09:03:14.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.242+0000 7ffa75000640 1 -- 172.21.15.173:0/1966210380 wait complete. 2024-04-25T09:03:14.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.262+0000 7f1d57e00640 1 -- 172.21.15.173:0/883409158 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1d58162850 con 0x7f1d5815c500 2024-04-25T09:03:14.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.262+0000 7f1d4ea00640 1 -- 172.21.15.173:0/883409158 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1d500598a0 con 0x7f1d5815c500 2024-04-25T09:03:14.251 INFO:teuthology.orchestra.run.smithi173.stdout:64424509449 2024-04-25T09:03:14.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.266+0000 7f1d57e00640 1 -- 172.21.15.173:0/883409158 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1d38066fe0 msgr2=0x7f1d380694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.266+0000 7f1d57e00640 1 --2- 172.21.15.173:0/883409158 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1d38066fe0 0x7f1d380694a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1d580b5120 tx=0x7f1d48007e90 comp rx=0 tx=0).stop 2024-04-25T09:03:14.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.266+0000 7f1d57e00640 1 -- 172.21.15.173:0/883409158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d5815c500 msgr2=0x7f1d58161010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.266+0000 7f1d57e00640 1 --2- 172.21.15.173:0/883409158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d5815c500 0x7f1d58161010 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1d5000c7a0 tx=0x7f1d5000cc60 comp rx=0 tx=0).stop 2024-04-25T09:03:14.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.266+0000 7f1d57e00640 1 -- 172.21.15.173:0/883409158 shutdown_connections 2024-04-25T09:03:14.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.266+0000 7f1d57e00640 1 --2- 172.21.15.173:0/883409158 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1d38066fe0 0x7f1d380694a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.266+0000 7f1d57e00640 1 --2- 172.21.15.173:0/883409158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d5815c500 0x7f1d58161010 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.266+0000 7f1d57e00640 1 --2- 172.21.15.173:0/883409158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d580cdfb0 0x7f1d58150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.266+0000 7f1d57e00640 1 --2- 172.21.15.173:0/883409158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d5806c020 0x7f1d581570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.266+0000 7f1d57e00640 1 -- 172.21.15.173:0/883409158 >> 172.21.15.173:0/883409158 conn(0x7f1d580d3960 msgr2=0x7f1d580d1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.266+0000 7f1d57e00640 1 -- 172.21.15.173:0/883409158 shutdown_connections 2024-04-25T09:03:14.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.266+0000 7f1d57e00640 1 -- 172.21.15.173:0/883409158 wait complete. 2024-04-25T09:03:14.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.1 2024-04-25T09:03:14.260 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:14.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2024-04-25T09:03:14.268 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:14.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.294+0000 7fe762e00640 1 -- 172.21.15.173:0/2959673454 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe75c0b1260 con 0x7fe75c164750 2024-04-25T09:03:14.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.294+0000 7fe759600640 1 -- 172.21.15.173:0/2959673454 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe754014030 con 0x7fe75c164750 2024-04-25T09:03:14.285 INFO:teuthology.orchestra.run.smithi173.stdout:55834574858 2024-04-25T09:03:14.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.6 2024-04-25T09:03:14.286 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:14.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.298+0000 7fe762e00640 1 -- 172.21.15.173:0/2959673454 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe740066fb0 msgr2=0x7fe740069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.298+0000 7fe762e00640 1 --2- 172.21.15.173:0/2959673454 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe740066fb0 0x7fe740069470 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe74c01cbf0 tx=0x7fe74c008040 comp rx=0 tx=0).stop 2024-04-25T09:03:14.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.298+0000 7fe762e00640 1 -- 172.21.15.173:0/2959673454 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe75c164750 msgr2=0x7fe75c145e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.298+0000 7fe762e00640 1 --2- 172.21.15.173:0/2959673454 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe75c164750 0x7fe75c145e90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe75400cc50 tx=0x7fe75400a5c0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.298+0000 7fe762e00640 1 -- 172.21.15.173:0/2959673454 shutdown_connections 2024-04-25T09:03:14.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.298+0000 7fe762e00640 1 --2- 172.21.15.173:0/2959673454 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe740066fb0 0x7fe740069470 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.298+0000 7fe762e00640 1 --2- 172.21.15.173:0/2959673454 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe75c164750 0x7fe75c145e90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.298+0000 7fe762e00640 1 --2- 172.21.15.173:0/2959673454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe75c162180 0x7fe75c158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.298+0000 7fe762e00640 1 --2- 172.21.15.173:0/2959673454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe75c161da0 0x7fe75c1520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.298+0000 7fe762e00640 1 -- 172.21.15.173:0/2959673454 >> 172.21.15.173:0/2959673454 conn(0x7fe75c061ab0 msgr2=0x7fe75c071280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.298+0000 7fe762e00640 1 -- 172.21.15.173:0/2959673454 shutdown_connections 2024-04-25T09:03:14.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.298+0000 7fe762e00640 1 -- 172.21.15.173:0/2959673454 wait complete. 2024-04-25T09:03:14.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.298+0000 7f9c6f200640 1 -- 172.21.15.173:0/1778538748 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9c60052830 con 0x7f9c60047c20 2024-04-25T09:03:14.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.298+0000 7f9c5be00640 1 -- 172.21.15.173:0/1778538748 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c54054a50 con 0x7f9c60047c20 2024-04-25T09:03:14.289 INFO:teuthology.orchestra.run.smithi173.stdout:64424509449 2024-04-25T09:03:14.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.302+0000 7f9c6f200640 1 -- 172.21.15.173:0/1778538748 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9c48067060 msgr2=0x7f9c48069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.302+0000 7f9c6f200640 1 --2- 172.21.15.173:0/1778538748 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9c48067060 0x7f9c48069520 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000b520 tx=0x7f9c68130040 comp rx=0 tx=0).stop 2024-04-25T09:03:14.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.302+0000 7f9c6f200640 1 -- 172.21.15.173:0/1778538748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c60047c20 msgr2=0x7f9c6004e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.302+0000 7f9c6f200640 1 --2- 172.21.15.173:0/1778538748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c60047c20 0x7f9c6004e050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400b410 tx=0x7f9c5400b8d0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.302+0000 7f9c6f200640 1 -- 172.21.15.173:0/1778538748 shutdown_connections 2024-04-25T09:03:14.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.302+0000 7f9c6f200640 1 --2- 172.21.15.173:0/1778538748 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9c48067060 0x7f9c48069520 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.302+0000 7f9c6f200640 1 --2- 172.21.15.173:0/1778538748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c60047c20 0x7f9c6004e050 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.302+0000 7f9c6f200640 1 --2- 172.21.15.173:0/1778538748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c60033e40 0x7f9c6004db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.302+0000 7f9c6f200640 1 --2- 172.21.15.173:0/1778538748 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c60005ea0 0x7f9c600cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.302+0000 7f9c6f200640 1 -- 172.21.15.173:0/1778538748 >> 172.21.15.173:0/1778538748 conn(0x7f9c60009fc0 msgr2=0x7f9c6004bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.302+0000 7f9c6f200640 1 -- 172.21.15.173:0/1778538748 shutdown_connections 2024-04-25T09:03:14.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.302+0000 7f9c6f200640 1 -- 172.21.15.173:0/1778538748 wait complete. 2024-04-25T09:03:14.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.310+0000 7efe09400640 1 -- 172.21.15.173:0/266532403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7efe040adcc0 con 0x7efe04155420 2024-04-25T09:03:14.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.310+0000 7efdfaa00640 1 -- 172.21.15.173:0/266532403 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efdfc055d60 con 0x7efe04155420 2024-04-25T09:03:14.301 INFO:teuthology.orchestra.run.smithi173.stdout:64424509450 2024-04-25T09:03:14.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.314+0000 7efe09400640 1 -- 172.21.15.173:0/266532403 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efde4066fe0 msgr2=0x7efde40694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.314+0000 7efe09400640 1 --2- 172.21.15.173:0/266532403 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efde4066fe0 0x7efde40694a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efdf40ad000 tx=0x7efdf4004850 comp rx=0 tx=0).stop 2024-04-25T09:03:14.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.314+0000 7efe09400640 1 -- 172.21.15.173:0/266532403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe04155420 msgr2=0x7efe041f9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.314+0000 7efe09400640 1 --2- 172.21.15.173:0/266532403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe04155420 0x7efe041f9790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efe040ce040 tx=0x7efdfc00e530 comp rx=0 tx=0).stop 2024-04-25T09:03:14.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.314+0000 7efe09400640 1 -- 172.21.15.173:0/266532403 shutdown_connections 2024-04-25T09:03:14.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.314+0000 7efe09400640 1 --2- 172.21.15.173:0/266532403 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efde4066fe0 0x7efde40694a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.314+0000 7efe09400640 1 --2- 172.21.15.173:0/266532403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe04155420 0x7efe041f9790 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.314+0000 7efe09400640 1 --2- 172.21.15.173:0/266532403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe04150ae0 0x7efe04154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.314+0000 7efe09400640 1 --2- 172.21.15.173:0/266532403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe04150700 0x7efe04159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.314+0000 7efe09400640 1 -- 172.21.15.173:0/266532403 >> 172.21.15.173:0/266532403 conn(0x7efe0406ac90 msgr2=0x7efe04163cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.314+0000 7efe09400640 1 -- 172.21.15.173:0/266532403 shutdown_connections 2024-04-25T09:03:14.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.314+0000 7efe09400640 1 -- 172.21.15.173:0/266532403 wait complete. 2024-04-25T09:03:14.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-04-25T09:03:14.309 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:14.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.334+0000 7f570b000640 1 -- 172.21.15.173:0/1513223436 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f570406e5f0 con 0x7f5704072240 2024-04-25T09:03:14.323 INFO:teuthology.orchestra.run.smithi173.stdout:64424509449 2024-04-25T09:03:14.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.334+0000 7f5701600640 1 -- 172.21.15.173:0/1513223436 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f56f8059d00 con 0x7f5704072240 2024-04-25T09:03:14.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.4 2024-04-25T09:03:14.324 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:14.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.334+0000 7f570b000640 1 -- 172.21.15.173:0/1513223436 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f56e4067160 msgr2=0x7f56e4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.334+0000 7f570b000640 1 --2- 172.21.15.173:0/1513223436 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f56e4067160 0x7f56e4069620 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f56f00ae000 tx=0x7f56f00b5040 comp rx=0 tx=0).stop 2024-04-25T09:03:14.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.334+0000 7f570b000640 1 -- 172.21.15.173:0/1513223436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5704072240 msgr2=0x7f57040cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.334+0000 7f570b000640 1 --2- 172.21.15.173:0/1513223436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5704072240 0x7f57040cac60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f56f800e890 tx=0x7f56f800ed50 comp rx=0 tx=0).stop 2024-04-25T09:03:14.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.334+0000 7f570b000640 1 -- 172.21.15.173:0/1513223436 shutdown_connections 2024-04-25T09:03:14.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.334+0000 7f570b000640 1 --2- 172.21.15.173:0/1513223436 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f56e4067160 0x7f56e4069620 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.334+0000 7f570b000640 1 --2- 172.21.15.173:0/1513223436 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f570415dbc0 0x7f57040cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.334+0000 7f570b000640 1 --2- 172.21.15.173:0/1513223436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f570415d7e0 0x7f570414c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.334+0000 7f570b000640 1 --2- 172.21.15.173:0/1513223436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5704072240 0x7f57040cac60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.334+0000 7f570b000640 1 -- 172.21.15.173:0/1513223436 >> 172.21.15.173:0/1513223436 conn(0x7f5704061ab0 msgr2=0x7f570406d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.334+0000 7f570b000640 1 -- 172.21.15.173:0/1513223436 shutdown_connections 2024-04-25T09:03:14.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.334+0000 7f570b000640 1 -- 172.21.15.173:0/1513223436 wait complete. 2024-04-25T09:03:14.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2024-04-25T09:03:14.329 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:14.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.5 2024-04-25T09:03:14.346 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:14.346 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T09:03:14.347 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:03:14.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.538+0000 7fa5f9a00640 1 Processor -- start 2024-04-25T09:03:14.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.538+0000 7fa5f9a00640 1 -- start start 2024-04-25T09:03:14.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f9a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa5f40b3e70 0x7fa5f40b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5f40aefa0 0x7fa5f40b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f9a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f40b4790 con 0x7fa5f415edd0 2024-04-25T09:03:14.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f9a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f406dd50 con 0x7fa5f40b3e70 2024-04-25T09:03:14.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f415f320 con 0x7fa5f40aefa0 2024-04-25T09:03:14.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f3400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa5f415edd0 0x7fa5f40b2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38950/0 (socket says 172.21.15.173:38950) 2024-04-25T09:03:14.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f3400640 1 -- 172.21.15.173:0/1990971008 learned_addr learned my addr 172.21.15.173:0/1990971008 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:14.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2a00640 1 --2- 172.21.15.173:0/1990971008 >> v2:172.21.15.194:3300/0 conn(0x7fa5f40b3e70 0x7fa5f40b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5ea000640 1 --2- 172.21.15.173:0/1990971008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5f40aefa0 0x7fa5f40b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2000640 1 -- 172.21.15.173:0/1990971008 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1445771433 0 0) 0x7fa5f40b4790 con 0x7fa5f415edd0 2024-04-25T09:03:14.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2000640 1 -- 172.21.15.173:0/1990971008 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5d8003530 con 0x7fa5f415edd0 2024-04-25T09:03:14.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2000640 1 -- 172.21.15.173:0/1990971008 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4195707972 0 0) 0x7fa5d8003530 con 0x7fa5f415edd0 2024-04-25T09:03:14.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2000640 1 -- 172.21.15.173:0/1990971008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5f40aefa0 msgr2=0x7fa5f40b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:14.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2000640 1 --2- 172.21.15.173:0/1990971008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5f40aefa0 0x7fa5f40b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2000640 1 -- 172.21.15.173:0/1990971008 >> v2:172.21.15.194:3300/0 conn(0x7fa5f40b3e70 msgr2=0x7fa5f40b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:14.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2000640 1 --2- 172.21.15.173:0/1990971008 >> v2:172.21.15.194:3300/0 conn(0x7fa5f40b3e70 0x7fa5f40b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2000640 1 -- 172.21.15.173:0/1990971008 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f406d420 con 0x7fa5f415edd0 2024-04-25T09:03:14.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2000640 1 -- 172.21.15.173:0/1990971008 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fa5ec001a00 con 0x7fa5f415edd0 2024-04-25T09:03:14.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2000640 1 -- 172.21.15.173:0/1990971008 >> v1:172.21.15.173:6789/0 conn(0x7fa5f415edd0 legacy=0x7fa5f40b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2000640 1 --2- 172.21.15.173:0/1990971008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5d80039c0 0x7fa5d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2000640 1 --2- 172.21.15.173:0/1990971008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5f40aefa0 0x7fa5d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2000640 1 --2- 172.21.15.173:0/1990971008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5d8004d50 0x7fa5d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2000640 1 -- 172.21.15.173:0/1990971008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f406dd50 con 0x7fa5d80039c0 2024-04-25T09:03:14.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2000640 1 -- 172.21.15.173:0/1990971008 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f415f320 con 0x7fa5d8004d50 2024-04-25T09:03:14.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2000640 1 -- 172.21.15.173:0/1990971008 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d800b9d0 con 0x7fa5f40aefa0 2024-04-25T09:03:14.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2a00640 1 --2- 172.21.15.173:0/1990971008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5d80039c0 0x7fa5d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5ea000640 1 --2- 172.21.15.173:0/1990971008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5f40aefa0 0x7fa5d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f3400640 1 --2- 172.21.15.173:0/1990971008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5d8004d50 0x7fa5d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2a00640 1 -- 172.21.15.173:0/1990971008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5f40aefa0 msgr2=0x7fa5d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:14.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2a00640 1 --2- 172.21.15.173:0/1990971008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5f40aefa0 0x7fa5d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2a00640 1 -- 172.21.15.173:0/1990971008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5d8004d50 msgr2=0x7fa5d80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:14.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2a00640 1 --2- 172.21.15.173:0/1990971008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5d8004d50 0x7fa5d80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f2a00640 1 -- 172.21.15.173:0/1990971008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d8003530 con 0x7fa5d80039c0 2024-04-25T09:03:14.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.542+0000 7fa5f3400640 1 --2- 172.21.15.173:0/1990971008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5d8004d50 0x7fa5d80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:14.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.546+0000 7fa5f2a00640 1 --2- 172.21.15.173:0/1990971008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5d80039c0 0x7fa5d8003de0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009ae0 tx=0x7fa5e401ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a382ed994389cfb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.546+0000 7fa5f2000640 1 -- 172.21.15.173:0/1990971008 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e40b2070 con 0x7fa5d80039c0 2024-04-25T09:03:14.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.546+0000 7fa5f2000640 1 -- 172.21.15.173:0/1990971008 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e40a5570 con 0x7fa5d80039c0 2024-04-25T09:03:14.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.546+0000 7fa5f2000640 1 -- 172.21.15.173:0/1990971008 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e40096b0 con 0x7fa5d80039c0 2024-04-25T09:03:14.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.546+0000 7fa5f9a00640 1 -- 172.21.15.173:0/1990971008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5d80039c0 msgr2=0x7fa5d8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.546+0000 7fa5f9a00640 1 --2- 172.21.15.173:0/1990971008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5d80039c0 0x7fa5d8003de0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009ae0 tx=0x7fa5e401ca80 comp rx=0 tx=0).stop 2024-04-25T09:03:14.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.546+0000 7fa5f3400640 1 -- 172.21.15.173:0/1990971008 reap_dead start 2024-04-25T09:03:14.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.546+0000 7fa5f9a00640 1 -- 172.21.15.173:0/1990971008 shutdown_connections 2024-04-25T09:03:14.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.546+0000 7fa5f9a00640 1 -- 172.21.15.173:0/1990971008 >> 172.21.15.173:0/1990971008 conn(0x7fa5f406ac90 msgr2=0x7fa5f406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.546+0000 7fa5f9a00640 1 -- 172.21.15.173:0/1990971008 shutdown_connections 2024-04-25T09:03:14.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.546+0000 7fa5f9a00640 1 -- 172.21.15.173:0/1990971008 wait complete. 2024-04-25T09:03:14.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.546+0000 7fa5f9a00640 1 Processor -- start 2024-04-25T09:03:14.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.546+0000 7fa5f9a00640 1 -- start start 2024-04-25T09:03:14.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5f9a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5d80039c0 0x7fa5f41519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5f9a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5f41f6f30 0x7fa5f415cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5f9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5f41f2540 0x7fa5f41f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5f9a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f406e1c0 con 0x7fa5f41f6f30 2024-04-25T09:03:14.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5f9a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f415aba0 con 0x7fa5d80039c0 2024-04-25T09:03:14.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5f9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f406e340 con 0x7fa5f41f2540 2024-04-25T09:03:14.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5ea000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5f41f6f30 0x7fa5f415cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5ea000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5f41f6f30 0x7fa5f415cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42998/0 (socket says 172.21.15.173:42998) 2024-04-25T09:03:14.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5ea000640 1 -- 172.21.15.173:0/1521220100 learned_addr learned my addr 172.21.15.173:0/1521220100 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:14.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5f2a00640 1 --2- 172.21.15.173:0/1521220100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5d80039c0 0x7fa5f41519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5f3400640 1 --2- 172.21.15.173:0/1521220100 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5f41f2540 0x7fa5f41f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5ea000640 1 -- 172.21.15.173:0/1521220100 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5f41f2540 msgr2=0x7fa5f41f29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5ea000640 1 --2- 172.21.15.173:0/1521220100 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5f41f2540 0x7fa5f41f29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5ea000640 1 -- 172.21.15.173:0/1521220100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5d80039c0 msgr2=0x7fa5f41519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5ea000640 1 --2- 172.21.15.173:0/1521220100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5d80039c0 0x7fa5f41519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5ea000640 1 -- 172.21.15.173:0/1521220100 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f4151ff0 con 0x7fa5f41f6f30 2024-04-25T09:03:14.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5f2a00640 1 --2- 172.21.15.173:0/1521220100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5d80039c0 0x7fa5f41519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:14.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5ea000640 1 --2- 172.21.15.173:0/1521220100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5f41f6f30 0x7fa5f415cb50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc011ae0 tx=0x7fa5dc010440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5eb400640 1 -- 172.21.15.173:0/1521220100 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc01f070 con 0x7fa5f41f6f30 2024-04-25T09:03:14.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5eb400640 1 -- 172.21.15.173:0/1521220100 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc010e20 con 0x7fa5f41f6f30 2024-04-25T09:03:14.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5eb400640 1 -- 172.21.15.173:0/1521220100 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc01a630 con 0x7fa5f41f6f30 2024-04-25T09:03:14.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5f9a00640 1 -- 172.21.15.173:0/1521220100 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f415c070 con 0x7fa5f41f6f30 2024-04-25T09:03:14.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5f9a00640 1 -- 172.21.15.173:0/1521220100 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f41f73b0 con 0x7fa5f41f6f30 2024-04-25T09:03:14.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5f9a00640 1 -- 172.21.15.173:0/1521220100 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f415d8c0 con 0x7fa5f41f6f30 2024-04-25T09:03:14.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.550+0000 7fa5eb400640 1 -- 172.21.15.173:0/1521220100 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa5dc022070 con 0x7fa5f41f6f30 2024-04-25T09:03:14.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.554+0000 7fa5eb400640 1 --2- 172.21.15.173:0/1521220100 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa5d0066f90 0x7fa5d0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.554+0000 7fa5eb400640 1 -- 172.21.15.173:0/1521220100 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa5dc087640 con 0x7fa5f41f6f30 2024-04-25T09:03:14.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.554+0000 7fa5f2a00640 1 --2- 172.21.15.173:0/1521220100 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa5d0066f90 0x7fa5d0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.554+0000 7fa5f2a00640 1 --2- 172.21.15.173:0/1521220100 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa5d0066f90 0x7fa5d0069450 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40af000 tx=0x7fa5e40046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.558+0000 7fa5eb400640 1 -- 172.21.15.173:0/1521220100 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa5dc057d70 con 0x7fa5f41f6f30 2024-04-25T09:03:14.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.706+0000 7fa5f9a00640 1 -- 172.21.15.173:0/1521220100 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5f41522d0 con 0x7fa5d0066f90 2024-04-25T09:03:14.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.714+0000 7fa5eb400640 1 -- 172.21.15.173:0/1521220100 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332534 (secure 0 0 0) 0x7fa5e410e310 con 0x7fa5d0066f90 2024-04-25T09:03:14.708 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:14.710 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:03:14.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.722+0000 7fa5f9a00640 1 -- 172.21.15.173:0/1521220100 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa5d0066f90 msgr2=0x7fa5d0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.722+0000 7fa5f9a00640 1 --2- 172.21.15.173:0/1521220100 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa5d0066f90 0x7fa5d0069450 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40af000 tx=0x7fa5e40046d0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.722+0000 7fa5f9a00640 1 -- 172.21.15.173:0/1521220100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5f41f6f30 msgr2=0x7fa5f415cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.722+0000 7fa5f9a00640 1 --2- 172.21.15.173:0/1521220100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5f41f6f30 0x7fa5f415cb50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc011ae0 tx=0x7fa5dc010440 comp rx=0 tx=0).stop 2024-04-25T09:03:14.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.722+0000 7fa5f9a00640 1 -- 172.21.15.173:0/1521220100 shutdown_connections 2024-04-25T09:03:14.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.722+0000 7fa5f9a00640 1 --2- 172.21.15.173:0/1521220100 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa5d0066f90 0x7fa5d0069450 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.722+0000 7fa5f9a00640 1 --2- 172.21.15.173:0/1521220100 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5f41f2540 0x7fa5f41f29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.722+0000 7fa5f9a00640 1 --2- 172.21.15.173:0/1521220100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5f41f6f30 0x7fa5f415cb50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.722+0000 7fa5f9a00640 1 --2- 172.21.15.173:0/1521220100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5d80039c0 0x7fa5f41519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.722+0000 7fa5f9a00640 1 -- 172.21.15.173:0/1521220100 >> 172.21.15.173:0/1521220100 conn(0x7fa5f406ac90 msgr2=0x7fa5f40b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.722+0000 7fa5f9a00640 1 -- 172.21.15.173:0/1521220100 shutdown_connections 2024-04-25T09:03:14.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.722+0000 7fa5f9a00640 1 -- 172.21.15.173:0/1521220100 wait complete. 2024-04-25T09:03:14.729 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-25T09:03:12.729911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219512,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755208,"statfs":{"total":773094113280,"available":772869332992,"internally_reserved":0,"allocated":3416064,"data_stored":2041232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003210"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790824+0000","last_change":"2024-04-25T09:02:51.036766+0000","last_active":"2024-04-25T09:02:57.790824+0000","last_peered":"2024-04-25T09:02:57.790824+0000","last_clean":"2024-04-25T09:02:57.790824+0000","last_became_active":"2024-04-25T09:02:51.036485+0000","last_became_peered":"2024-04-25T09:02:51.036485+0000","last_unstale":"2024-04-25T09:02:57.790824+0000","last_undegraded":"2024-04-25T09:02:57.790824+0000","last_fullsized":"2024-04-25T09:02:57.790824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:41.333762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053869+0000","last_change":"2024-04-25T09:02:52.031373+0000","last_active":"2024-04-25T09:02:57.053869+0000","last_peered":"2024-04-25T09:02:57.053869+0000","last_clean":"2024-04-25T09:02:57.053869+0000","last_became_active":"2024-04-25T09:02:52.028004+0000","last_became_peered":"2024-04-25T09:02:52.028004+0000","last_unstale":"2024-04-25T09:02:57.053869+0000","last_undegraded":"2024-04-25T09:02:57.053869+0000","last_fullsized":"2024-04-25T09:02:57.053869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:45.007626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053347+0000","last_change":"2024-04-25T09:02:56.296066+0000","last_active":"2024-04-25T09:02:57.053347+0000","last_peered":"2024-04-25T09:02:57.053347+0000","last_clean":"2024-04-25T09:02:57.053347+0000","last_became_active":"2024-04-25T09:02:56.295657+0000","last_became_peered":"2024-04-25T09:02:56.295657+0000","last_unstale":"2024-04-25T09:02:57.053347+0000","last_undegraded":"2024-04-25T09:02:57.053347+0000","last_fullsized":"2024-04-25T09:02:57.053347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:42.494123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054215+0000","last_change":"2024-04-25T09:02:51.035936+0000","last_active":"2024-04-25T09:02:57.054215+0000","last_peered":"2024-04-25T09:02:57.054215+0000","last_clean":"2024-04-25T09:02:57.054215+0000","last_became_active":"2024-04-25T09:02:51.035632+0000","last_became_peered":"2024-04-25T09:02:51.035632+0000","last_unstale":"2024-04-25T09:02:57.054215+0000","last_undegraded":"2024-04-25T09:02:57.054215+0000","last_fullsized":"2024-04-25T09:02:57.054215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:47.372516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790632+0000","last_change":"2024-04-25T09:02:52.046727+0000","last_active":"2024-04-25T09:02:57.790632+0000","last_peered":"2024-04-25T09:02:57.790632+0000","last_clean":"2024-04-25T09:02:57.790632+0000","last_became_active":"2024-04-25T09:02:52.046423+0000","last_became_peered":"2024-04-25T09:02:52.046423+0000","last_unstale":"2024-04-25T09:02:57.790632+0000","last_undegraded":"2024-04-25T09:02:57.790632+0000","last_fullsized":"2024-04-25T09:02:57.790632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:17.240659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.055935+0000","last_change":"2024-04-25T09:02:56.072393+0000","last_active":"2024-04-25T09:02:57.055935+0000","last_peered":"2024-04-25T09:02:57.055935+0000","last_clean":"2024-04-25T09:02:57.055935+0000","last_became_active":"2024-04-25T09:02:56.071966+0000","last_became_peered":"2024-04-25T09:02:56.071966+0000","last_unstale":"2024-04-25T09:02:57.055935+0000","last_undegraded":"2024-04-25T09:02:57.055935+0000","last_fullsized":"2024-04-25T09:02:57.055935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:22.670550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.464060+0000","last_change":"2024-04-25T09:02:51.033004+0000","last_active":"2024-04-25T09:02:57.464060+0000","last_peered":"2024-04-25T09:02:57.464060+0000","last_clean":"2024-04-25T09:02:57.464060+0000","last_became_active":"2024-04-25T09:02:51.032475+0000","last_became_peered":"2024-04-25T09:02:51.032475+0000","last_unstale":"2024-04-25T09:02:57.464060+0000","last_undegraded":"2024-04-25T09:02:57.464060+0000","last_fullsized":"2024-04-25T09:02:57.464060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:44.553402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789504+0000","last_change":"2024-04-25T09:02:52.044192+0000","last_active":"2024-04-25T09:02:57.789504+0000","last_peered":"2024-04-25T09:02:57.789504+0000","last_clean":"2024-04-25T09:02:57.789504+0000","last_became_active":"2024-04-25T09:02:52.043910+0000","last_became_peered":"2024-04-25T09:02:52.043910+0000","last_unstale":"2024-04-25T09:02:57.789504+0000","last_undegraded":"2024-04-25T09:02:57.789504+0000","last_fullsized":"2024-04-25T09:02:57.789504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:48.414352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057118+0000","last_change":"2024-04-25T09:02:56.076524+0000","last_active":"2024-04-25T09:02:57.057118+0000","last_peered":"2024-04-25T09:02:57.057118+0000","last_clean":"2024-04-25T09:02:57.057118+0000","last_became_active":"2024-04-25T09:02:56.076082+0000","last_became_peered":"2024-04-25T09:02:56.076082+0000","last_unstale":"2024-04-25T09:02:57.057118+0000","last_undegraded":"2024-04-25T09:02:57.057118+0000","last_fullsized":"2024-04-25T09:02:57.057118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:46.299051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463579+0000","last_change":"2024-04-25T09:02:51.039297+0000","last_active":"2024-04-25T09:02:57.463579+0000","last_peered":"2024-04-25T09:02:57.463579+0000","last_clean":"2024-04-25T09:02:57.463579+0000","last_became_active":"2024-04-25T09:02:51.039060+0000","last_became_peered":"2024-04-25T09:02:51.039060+0000","last_unstale":"2024-04-25T09:02:57.463579+0000","last_undegraded":"2024-04-25T09:02:57.463579+0000","last_fullsized":"2024-04-25T09:02:57.463579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:10.816735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789576+0000","last_change":"2024-04-25T09:02:52.044042+0000","last_active":"2024-04-25T09:02:57.789576+0000","last_peered":"2024-04-25T09:02:57.789576+0000","last_clean":"2024-04-25T09:02:57.789576+0000","last_became_active":"2024-04-25T09:02:52.043778+0000","last_became_peered":"2024-04-25T09:02:52.043778+0000","last_unstale":"2024-04-25T09:02:57.789576+0000","last_undegraded":"2024-04-25T09:02:57.789576+0000","last_fullsized":"2024-04-25T09:02:57.789576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:26.546220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056862+0000","last_change":"2024-04-25T09:02:56.059675+0000","last_active":"2024-04-25T09:02:57.056862+0000","last_peered":"2024-04-25T09:02:57.056862+0000","last_clean":"2024-04-25T09:02:57.056862+0000","last_became_active":"2024-04-25T09:02:56.059072+0000","last_became_peered":"2024-04-25T09:02:56.059072+0000","last_unstale":"2024-04-25T09:02:57.056862+0000","last_undegraded":"2024-04-25T09:02:57.056862+0000","last_fullsized":"2024-04-25T09:02:57.056862+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:52.449268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056039+0000","last_change":"2024-04-25T09:02:52.039240+0000","last_active":"2024-04-25T09:02:57.056039+0000","last_peered":"2024-04-25T09:02:57.056039+0000","last_clean":"2024-04-25T09:02:57.056039+0000","last_became_active":"2024-04-25T09:02:52.038915+0000","last_became_peered":"2024-04-25T09:02:52.038915+0000","last_unstale":"2024-04-25T09:02:57.056039+0000","last_undegraded":"2024-04-25T09:02:57.056039+0000","last_fullsized":"2024-04-25T09:02:57.056039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:50.011705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463598+0000","last_change":"2024-04-25T09:02:51.035156+0000","last_active":"2024-04-25T09:02:57.463598+0000","last_peered":"2024-04-25T09:02:57.463598+0000","last_clean":"2024-04-25T09:02:57.463598+0000","last_became_active":"2024-04-25T09:02:51.034850+0000","last_became_peered":"2024-04-25T09:02:51.034850+0000","last_unstale":"2024-04-25T09:02:57.463598+0000","last_undegraded":"2024-04-25T09:02:57.463598+0000","last_fullsized":"2024-04-25T09:02:57.463598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:28.429925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057297+0000","last_change":"2024-04-25T09:02:56.072225+0000","last_active":"2024-04-25T09:02:57.057297+0000","last_peered":"2024-04-25T09:02:57.057297+0000","last_clean":"2024-04-25T09:02:57.057297+0000","last_became_active":"2024-04-25T09:02:56.071794+0000","last_became_peered":"2024-04-25T09:02:56.071794+0000","last_unstale":"2024-04-25T09:02:57.057297+0000","last_undegraded":"2024-04-25T09:02:57.057297+0000","last_fullsized":"2024-04-25T09:02:57.057297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:56.656194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053726+0000","last_change":"2024-04-25T09:02:52.043448+0000","last_active":"2024-04-25T09:02:57.053726+0000","last_peered":"2024-04-25T09:02:57.053726+0000","last_clean":"2024-04-25T09:02:57.053726+0000","last_became_active":"2024-04-25T09:02:52.033650+0000","last_became_peered":"2024-04-25T09:02:52.033650+0000","last_unstale":"2024-04-25T09:02:57.053726+0000","last_undegraded":"2024-04-25T09:02:57.053726+0000","last_fullsized":"2024-04-25T09:02:57.053726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:29.002911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790926+0000","last_change":"2024-04-25T09:02:51.026371+0000","last_active":"2024-04-25T09:02:57.790926+0000","last_peered":"2024-04-25T09:02:57.790926+0000","last_clean":"2024-04-25T09:02:57.790926+0000","last_became_active":"2024-04-25T09:02:51.025867+0000","last_became_peered":"2024-04-25T09:02:51.025867+0000","last_unstale":"2024-04-25T09:02:57.790926+0000","last_undegraded":"2024-04-25T09:02:57.790926+0000","last_fullsized":"2024-04-25T09:02:57.790926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:47.372516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057366+0000","last_change":"2024-04-25T09:02:56.076638+0000","last_active":"2024-04-25T09:02:57.057366+0000","last_peered":"2024-04-25T09:02:57.057366+0000","last_clean":"2024-04-25T09:02:57.057366+0000","last_became_active":"2024-04-25T09:02:56.076208+0000","last_became_peered":"2024-04-25T09:02:56.076208+0000","last_unstale":"2024-04-25T09:02:57.057366+0000","last_undegraded":"2024-04-25T09:02:57.057366+0000","last_fullsized":"2024-04-25T09:02:57.057366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:04.686109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053630+0000","last_change":"2024-04-25T09:02:52.043808+0000","last_active":"2024-04-25T09:02:57.053630+0000","last_peered":"2024-04-25T09:02:57.053630+0000","last_clean":"2024-04-25T09:02:57.053630+0000","last_became_active":"2024-04-25T09:02:52.033729+0000","last_became_peered":"2024-04-25T09:02:52.033729+0000","last_unstale":"2024-04-25T09:02:57.053630+0000","last_undegraded":"2024-04-25T09:02:57.053630+0000","last_fullsized":"2024-04-25T09:02:57.053630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:50.625187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790413+0000","last_change":"2024-04-25T09:02:51.025228+0000","last_active":"2024-04-25T09:02:57.790413+0000","last_peered":"2024-04-25T09:02:57.790413+0000","last_clean":"2024-04-25T09:02:57.790413+0000","last_became_active":"2024-04-25T09:02:51.024784+0000","last_became_peered":"2024-04-25T09:02:51.024784+0000","last_unstale":"2024-04-25T09:02:57.790413+0000","last_undegraded":"2024-04-25T09:02:57.790413+0000","last_fullsized":"2024-04-25T09:02:57.790413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:59.734686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791571+0000","last_change":"2024-04-25T09:02:56.299771+0000","last_active":"2024-04-25T09:02:57.791571+0000","last_peered":"2024-04-25T09:02:57.791571+0000","last_clean":"2024-04-25T09:02:57.791571+0000","last_became_active":"2024-04-25T09:02:56.299239+0000","last_became_peered":"2024-04-25T09:02:56.299239+0000","last_unstale":"2024-04-25T09:02:57.791571+0000","last_undegraded":"2024-04-25T09:02:57.791571+0000","last_fullsized":"2024-04-25T09:02:57.791571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:30.366155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056839+0000","last_change":"2024-04-25T09:02:52.027108+0000","last_active":"2024-04-25T09:02:57.056839+0000","last_peered":"2024-04-25T09:02:57.056839+0000","last_clean":"2024-04-25T09:02:57.056839+0000","last_became_active":"2024-04-25T09:02:52.026183+0000","last_became_peered":"2024-04-25T09:02:52.026183+0000","last_unstale":"2024-04-25T09:02:57.056839+0000","last_undegraded":"2024-04-25T09:02:57.056839+0000","last_fullsized":"2024-04-25T09:02:57.056839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:38.122849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463146+0000","last_change":"2024-04-25T09:02:51.040204+0000","last_active":"2024-04-25T09:02:57.463146+0000","last_peered":"2024-04-25T09:02:57.463146+0000","last_clean":"2024-04-25T09:02:57.463146+0000","last_became_active":"2024-04-25T09:02:51.039917+0000","last_became_peered":"2024-04-25T09:02:51.039917+0000","last_unstale":"2024-04-25T09:02:57.463146+0000","last_undegraded":"2024-04-25T09:02:57.463146+0000","last_fullsized":"2024-04-25T09:02:57.463146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057220+0000","last_change":"2024-04-25T09:02:56.072634+0000","last_active":"2024-04-25T09:02:57.057220+0000","last_peered":"2024-04-25T09:02:57.057220+0000","last_clean":"2024-04-25T09:02:57.057220+0000","last_became_active":"2024-04-25T09:02:56.072077+0000","last_became_peered":"2024-04-25T09:02:56.072077+0000","last_unstale":"2024-04-25T09:02:57.057220+0000","last_undegraded":"2024-04-25T09:02:57.057220+0000","last_fullsized":"2024-04-25T09:02:57.057220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:39.318314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790520+0000","last_change":"2024-04-25T09:02:52.024632+0000","last_active":"2024-04-25T09:02:57.790520+0000","last_peered":"2024-04-25T09:02:57.790520+0000","last_clean":"2024-04-25T09:02:57.790520+0000","last_became_active":"2024-04-25T09:02:52.024337+0000","last_became_peered":"2024-04-25T09:02:52.024337+0000","last_unstale":"2024-04-25T09:02:57.790520+0000","last_undegraded":"2024-04-25T09:02:57.790520+0000","last_fullsized":"2024-04-25T09:02:57.790520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:11.410261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057823+0000","last_change":"2024-04-25T09:02:51.024573+0000","last_active":"2024-04-25T09:02:57.057823+0000","last_peered":"2024-04-25T09:02:57.057823+0000","last_clean":"2024-04-25T09:02:57.057823+0000","last_became_active":"2024-04-25T09:02:51.024252+0000","last_became_peered":"2024-04-25T09:02:51.024252+0000","last_unstale":"2024-04-25T09:02:57.057823+0000","last_undegraded":"2024-04-25T09:02:57.057823+0000","last_fullsized":"2024-04-25T09:02:57.057823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:53.131752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056610+0000","last_change":"2024-04-25T09:02:56.295449+0000","last_active":"2024-04-25T09:02:57.056610+0000","last_peered":"2024-04-25T09:02:57.056610+0000","last_clean":"2024-04-25T09:02:57.056610+0000","last_became_active":"2024-04-25T09:02:56.294711+0000","last_became_peered":"2024-04-25T09:02:56.294711+0000","last_unstale":"2024-04-25T09:02:57.056610+0000","last_undegraded":"2024-04-25T09:02:57.056610+0000","last_fullsized":"2024-04-25T09:02:57.056610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:56.463100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054253+0000","last_change":"2024-04-25T09:02:52.046777+0000","last_active":"2024-04-25T09:02:57.054253+0000","last_peered":"2024-04-25T09:02:57.054253+0000","last_clean":"2024-04-25T09:02:57.054253+0000","last_became_active":"2024-04-25T09:02:52.046489+0000","last_became_peered":"2024-04-25T09:02:52.046489+0000","last_unstale":"2024-04-25T09:02:57.054253+0000","last_undegraded":"2024-04-25T09:02:57.054253+0000","last_fullsized":"2024-04-25T09:02:57.054253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:22.709330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791497+0000","last_change":"2024-04-25T09:02:51.027246+0000","last_active":"2024-04-25T09:02:57.791497+0000","last_peered":"2024-04-25T09:02:57.791497+0000","last_clean":"2024-04-25T09:02:57.791497+0000","last_became_active":"2024-04-25T09:02:51.026818+0000","last_became_peered":"2024-04-25T09:02:51.026818+0000","last_unstale":"2024-04-25T09:02:57.791497+0000","last_undegraded":"2024-04-25T09:02:57.791497+0000","last_fullsized":"2024-04-25T09:02:57.791497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:28.429925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053445+0000","last_change":"2024-04-25T09:02:56.295657+0000","last_active":"2024-04-25T09:02:57.053445+0000","last_peered":"2024-04-25T09:02:57.053445+0000","last_clean":"2024-04-25T09:02:57.053445+0000","last_became_active":"2024-04-25T09:02:56.295288+0000","last_became_peered":"2024-04-25T09:02:56.295288+0000","last_unstale":"2024-04-25T09:02:57.053445+0000","last_undegraded":"2024-04-25T09:02:57.053445+0000","last_fullsized":"2024-04-25T09:02:57.053445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:58.529283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791110+0000","last_change":"2024-04-25T09:02:52.024086+0000","last_active":"2024-04-25T09:02:57.791110+0000","last_peered":"2024-04-25T09:02:57.791110+0000","last_clean":"2024-04-25T09:02:57.791110+0000","last_became_active":"2024-04-25T09:02:52.023818+0000","last_became_peered":"2024-04-25T09:02:52.023818+0000","last_unstale":"2024-04-25T09:02:57.791110+0000","last_undegraded":"2024-04-25T09:02:57.791110+0000","last_fullsized":"2024-04-25T09:02:57.791110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:17.240659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463957+0000","last_change":"2024-04-25T09:02:51.040279+0000","last_active":"2024-04-25T09:02:57.463957+0000","last_peered":"2024-04-25T09:02:57.463957+0000","last_clean":"2024-04-25T09:02:57.463957+0000","last_became_active":"2024-04-25T09:02:51.039948+0000","last_became_peered":"2024-04-25T09:02:51.039948+0000","last_unstale":"2024-04-25T09:02:57.463957+0000","last_undegraded":"2024-04-25T09:02:57.463957+0000","last_fullsized":"2024-04-25T09:02:57.463957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:51.667591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789802+0000","last_change":"2024-04-25T09:02:56.293761+0000","last_active":"2024-04-25T09:02:57.789802+0000","last_peered":"2024-04-25T09:02:57.789802+0000","last_clean":"2024-04-25T09:02:57.789802+0000","last_became_active":"2024-04-25T09:02:56.293350+0000","last_became_peered":"2024-04-25T09:02:56.293350+0000","last_unstale":"2024-04-25T09:02:57.789802+0000","last_undegraded":"2024-04-25T09:02:57.789802+0000","last_fullsized":"2024-04-25T09:02:57.789802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:26.744246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789708+0000","last_change":"2024-04-25T09:02:52.052084+0000","last_active":"2024-04-25T09:02:57.789708+0000","last_peered":"2024-04-25T09:02:57.789708+0000","last_clean":"2024-04-25T09:02:57.789708+0000","last_became_active":"2024-04-25T09:02:52.051875+0000","last_became_peered":"2024-04-25T09:02:52.051875+0000","last_unstale":"2024-04-25T09:02:57.789708+0000","last_undegraded":"2024-04-25T09:02:57.789708+0000","last_fullsized":"2024-04-25T09:02:57.789708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:48.909107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791211+0000","last_change":"2024-04-25T09:02:51.032759+0000","last_active":"2024-04-25T09:02:57.791211+0000","last_peered":"2024-04-25T09:02:57.791211+0000","last_clean":"2024-04-25T09:02:57.791211+0000","last_became_active":"2024-04-25T09:02:51.032451+0000","last_became_peered":"2024-04-25T09:02:51.032451+0000","last_unstale":"2024-04-25T09:02:57.791211+0000","last_undegraded":"2024-04-25T09:02:57.791211+0000","last_fullsized":"2024-04-25T09:02:57.791211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:36.866575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790558+0000","last_change":"2024-04-25T09:02:56.070268+0000","last_active":"2024-04-25T09:02:57.790558+0000","last_peered":"2024-04-25T09:02:57.790558+0000","last_clean":"2024-04-25T09:02:57.790558+0000","last_became_active":"2024-04-25T09:02:56.069905+0000","last_became_peered":"2024-04-25T09:02:56.069905+0000","last_unstale":"2024-04-25T09:02:57.790558+0000","last_undegraded":"2024-04-25T09:02:57.790558+0000","last_fullsized":"2024-04-25T09:02:57.790558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:07.888490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057540+0000","last_change":"2024-04-25T09:02:52.034123+0000","last_active":"2024-04-25T09:02:57.057540+0000","last_peered":"2024-04-25T09:02:57.057540+0000","last_clean":"2024-04-25T09:02:57.057540+0000","last_became_active":"2024-04-25T09:02:52.033807+0000","last_became_peered":"2024-04-25T09:02:52.033807+0000","last_unstale":"2024-04-25T09:02:57.057540+0000","last_undegraded":"2024-04-25T09:02:57.057540+0000","last_fullsized":"2024-04-25T09:02:57.057540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:41.419260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789451+0000","last_change":"2024-04-25T09:02:51.026247+0000","last_active":"2024-04-25T09:02:57.789451+0000","last_peered":"2024-04-25T09:02:57.789451+0000","last_clean":"2024-04-25T09:02:57.789451+0000","last_became_active":"2024-04-25T09:02:51.025939+0000","last_became_peered":"2024-04-25T09:02:51.025939+0000","last_unstale":"2024-04-25T09:02:57.789451+0000","last_undegraded":"2024-04-25T09:02:57.789451+0000","last_fullsized":"2024-04-25T09:02:57.789451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:40.409805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791583+0000","last_change":"2024-04-25T09:02:56.076058+0000","last_active":"2024-04-25T09:02:57.791583+0000","last_peered":"2024-04-25T09:02:57.791583+0000","last_clean":"2024-04-25T09:02:57.791583+0000","last_became_active":"2024-04-25T09:02:56.075606+0000","last_became_peered":"2024-04-25T09:02:56.075606+0000","last_unstale":"2024-04-25T09:02:57.791583+0000","last_undegraded":"2024-04-25T09:02:57.791583+0000","last_fullsized":"2024-04-25T09:02:57.791583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:59.234505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790128+0000","last_change":"2024-04-25T09:02:52.024371+0000","last_active":"2024-04-25T09:02:57.790128+0000","last_peered":"2024-04-25T09:02:57.790128+0000","last_clean":"2024-04-25T09:02:57.790128+0000","last_became_active":"2024-04-25T09:02:52.023814+0000","last_became_peered":"2024-04-25T09:02:52.023814+0000","last_unstale":"2024-04-25T09:02:57.790128+0000","last_undegraded":"2024-04-25T09:02:57.790128+0000","last_fullsized":"2024-04-25T09:02:57.790128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:29.446381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789453+0000","last_change":"2024-04-25T09:02:51.027475+0000","last_active":"2024-04-25T09:02:57.789453+0000","last_peered":"2024-04-25T09:02:57.789453+0000","last_clean":"2024-04-25T09:02:57.789453+0000","last_became_active":"2024-04-25T09:02:51.027212+0000","last_became_peered":"2024-04-25T09:02:51.027212+0000","last_unstale":"2024-04-25T09:02:57.789453+0000","last_undegraded":"2024-04-25T09:02:57.789453+0000","last_fullsized":"2024-04-25T09:02:57.789453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:23.500507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791716+0000","last_change":"2024-04-25T09:02:56.066697+0000","last_active":"2024-04-25T09:02:57.791716+0000","last_peered":"2024-04-25T09:02:57.791716+0000","last_clean":"2024-04-25T09:02:57.791716+0000","last_became_active":"2024-04-25T09:02:56.063130+0000","last_became_peered":"2024-04-25T09:02:56.063130+0000","last_unstale":"2024-04-25T09:02:57.791716+0000","last_undegraded":"2024-04-25T09:02:57.791716+0000","last_fullsized":"2024-04-25T09:02:57.791716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:11.878208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789276+0000","last_change":"2024-04-25T09:02:52.037980+0000","last_active":"2024-04-25T09:02:57.789276+0000","last_peered":"2024-04-25T09:02:57.789276+0000","last_clean":"2024-04-25T09:02:57.789276+0000","last_became_active":"2024-04-25T09:02:52.037671+0000","last_became_peered":"2024-04-25T09:02:52.037671+0000","last_unstale":"2024-04-25T09:02:57.789276+0000","last_undegraded":"2024-04-25T09:02:57.789276+0000","last_fullsized":"2024-04-25T09:02:57.789276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:52.677046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463133+0000","last_change":"2024-04-25T09:02:51.032936+0000","last_active":"2024-04-25T09:02:57.463133+0000","last_peered":"2024-04-25T09:02:57.463133+0000","last_clean":"2024-04-25T09:02:57.463133+0000","last_became_active":"2024-04-25T09:02:51.032657+0000","last_became_peered":"2024-04-25T09:02:51.032657+0000","last_unstale":"2024-04-25T09:02:57.463133+0000","last_undegraded":"2024-04-25T09:02:57.463133+0000","last_fullsized":"2024-04-25T09:02:57.463133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:59.734686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790555+0000","last_change":"2024-04-25T09:02:56.297045+0000","last_active":"2024-04-25T09:02:57.790555+0000","last_peered":"2024-04-25T09:02:57.790555+0000","last_clean":"2024-04-25T09:02:57.790555+0000","last_became_active":"2024-04-25T09:02:56.295073+0000","last_became_peered":"2024-04-25T09:02:56.295073+0000","last_unstale":"2024-04-25T09:02:57.790555+0000","last_undegraded":"2024-04-25T09:02:57.790555+0000","last_fullsized":"2024-04-25T09:02:57.790555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:59.234505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053279+0000","last_change":"2024-04-25T09:02:52.038658+0000","last_active":"2024-04-25T09:02:57.053279+0000","last_peered":"2024-04-25T09:02:57.053279+0000","last_clean":"2024-04-25T09:02:57.053279+0000","last_became_active":"2024-04-25T09:02:52.033684+0000","last_became_peered":"2024-04-25T09:02:52.033684+0000","last_unstale":"2024-04-25T09:02:57.053279+0000","last_undegraded":"2024-04-25T09:02:57.053279+0000","last_fullsized":"2024-04-25T09:02:57.053279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:11.410261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789342+0000","last_change":"2024-04-25T09:02:51.023038+0000","last_active":"2024-04-25T09:02:57.789342+0000","last_peered":"2024-04-25T09:02:57.789342+0000","last_clean":"2024-04-25T09:02:57.789342+0000","last_became_active":"2024-04-25T09:02:51.019222+0000","last_became_peered":"2024-04-25T09:02:51.019222+0000","last_unstale":"2024-04-25T09:02:57.789342+0000","last_undegraded":"2024-04-25T09:02:57.789342+0000","last_fullsized":"2024-04-25T09:02:57.789342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:00.953314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463292+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:02:57.463292+0000","last_peered":"2024-04-25T09:02:57.463292+0000","last_clean":"2024-04-25T09:02:57.463292+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:02:57.463292+0000","last_undegraded":"2024-04-25T09:02:57.463292+0000","last_fullsized":"2024-04-25T09:02:57.463292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056417+0000","last_change":"2024-04-25T09:02:56.295692+0000","last_active":"2024-04-25T09:02:57.056417+0000","last_peered":"2024-04-25T09:02:57.056417+0000","last_clean":"2024-04-25T09:02:57.056417+0000","last_became_active":"2024-04-25T09:02:56.295209+0000","last_became_peered":"2024-04-25T09:02:56.295209+0000","last_unstale":"2024-04-25T09:02:57.056417+0000","last_undegraded":"2024-04-25T09:02:57.056417+0000","last_fullsized":"2024-04-25T09:02:57.056417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:52.944023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463642+0000","last_change":"2024-04-25T09:02:52.049009+0000","last_active":"2024-04-25T09:02:57.463642+0000","last_peered":"2024-04-25T09:02:57.463642+0000","last_clean":"2024-04-25T09:02:57.463642+0000","last_became_active":"2024-04-25T09:02:52.048541+0000","last_became_peered":"2024-04-25T09:02:52.048541+0000","last_unstale":"2024-04-25T09:02:57.463642+0000","last_undegraded":"2024-04-25T09:02:57.463642+0000","last_fullsized":"2024-04-25T09:02:57.463642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:03.853574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790093+0000","last_change":"2024-04-25T09:02:51.023326+0000","last_active":"2024-04-25T09:02:57.790093+0000","last_peered":"2024-04-25T09:02:57.790093+0000","last_clean":"2024-04-25T09:02:57.790093+0000","last_became_active":"2024-04-25T09:02:51.022096+0000","last_became_peered":"2024-04-25T09:02:51.022096+0000","last_unstale":"2024-04-25T09:02:57.790093+0000","last_undegraded":"2024-04-25T09:02:57.790093+0000","last_fullsized":"2024-04-25T09:02:57.790093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:47.372516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.055988+0000","last_change":"2024-04-25T09:02:56.295505+0000","last_active":"2024-04-25T09:02:57.055988+0000","last_peered":"2024-04-25T09:02:57.055988+0000","last_clean":"2024-04-25T09:02:57.055988+0000","last_became_active":"2024-04-25T09:02:56.295096+0000","last_became_peered":"2024-04-25T09:02:56.295096+0000","last_unstale":"2024-04-25T09:02:57.055988+0000","last_undegraded":"2024-04-25T09:02:57.055988+0000","last_fullsized":"2024-04-25T09:02:57.055988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:30.581136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789515+0000","last_change":"2024-04-25T09:02:52.036763+0000","last_active":"2024-04-25T09:02:57.789515+0000","last_peered":"2024-04-25T09:02:57.789515+0000","last_clean":"2024-04-25T09:02:57.789515+0000","last_became_active":"2024-04-25T09:02:52.035834+0000","last_became_peered":"2024-04-25T09:02:52.035834+0000","last_unstale":"2024-04-25T09:02:57.789515+0000","last_undegraded":"2024-04-25T09:02:57.789515+0000","last_fullsized":"2024-04-25T09:02:57.789515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:42.264135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791361+0000","last_change":"2024-04-25T09:02:51.016550+0000","last_active":"2024-04-25T09:02:57.791361+0000","last_peered":"2024-04-25T09:02:57.791361+0000","last_clean":"2024-04-25T09:02:57.791361+0000","last_became_active":"2024-04-25T09:02:51.016306+0000","last_became_peered":"2024-04-25T09:02:51.016306+0000","last_unstale":"2024-04-25T09:02:57.791361+0000","last_undegraded":"2024-04-25T09:02:57.791361+0000","last_fullsized":"2024-04-25T09:02:57.791361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789915+0000","last_change":"2024-04-25T09:02:56.072785+0000","last_active":"2024-04-25T09:02:57.789915+0000","last_peered":"2024-04-25T09:02:57.789915+0000","last_clean":"2024-04-25T09:02:57.789915+0000","last_became_active":"2024-04-25T09:02:56.072306+0000","last_became_peered":"2024-04-25T09:02:56.072306+0000","last_unstale":"2024-04-25T09:02:57.789915+0000","last_undegraded":"2024-04-25T09:02:57.789915+0000","last_fullsized":"2024-04-25T09:02:57.789915+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:07.888490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.464063+0000","last_change":"2024-04-25T09:02:52.056902+0000","last_active":"2024-04-25T09:02:57.464063+0000","last_peered":"2024-04-25T09:02:57.464063+0000","last_clean":"2024-04-25T09:02:57.464063+0000","last_became_active":"2024-04-25T09:02:52.056597+0000","last_became_peered":"2024-04-25T09:02:52.056597+0000","last_unstale":"2024-04-25T09:02:57.464063+0000","last_undegraded":"2024-04-25T09:02:57.464063+0000","last_fullsized":"2024-04-25T09:02:57.464063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:29.173421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790787+0000","last_change":"2024-04-25T09:02:51.028470+0000","last_active":"2024-04-25T09:02:57.790787+0000","last_peered":"2024-04-25T09:02:57.790787+0000","last_clean":"2024-04-25T09:02:57.790787+0000","last_became_active":"2024-04-25T09:02:51.028151+0000","last_became_peered":"2024-04-25T09:02:51.028151+0000","last_unstale":"2024-04-25T09:02:57.790787+0000","last_undegraded":"2024-04-25T09:02:57.790787+0000","last_fullsized":"2024-04-25T09:02:57.790787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:36.866575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789052+0000","last_change":"2024-04-25T09:02:56.295226+0000","last_active":"2024-04-25T09:02:57.789052+0000","last_peered":"2024-04-25T09:02:57.789052+0000","last_clean":"2024-04-25T09:02:57.789052+0000","last_became_active":"2024-04-25T09:02:56.294800+0000","last_became_peered":"2024-04-25T09:02:56.294800+0000","last_unstale":"2024-04-25T09:02:57.789052+0000","last_undegraded":"2024-04-25T09:02:57.789052+0000","last_fullsized":"2024-04-25T09:02:57.789052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:58.795884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463945+0000","last_change":"2024-04-25T09:02:52.052984+0000","last_active":"2024-04-25T09:02:57.463945+0000","last_peered":"2024-04-25T09:02:57.463945+0000","last_clean":"2024-04-25T09:02:57.463945+0000","last_became_active":"2024-04-25T09:02:52.051829+0000","last_became_peered":"2024-04-25T09:02:52.051829+0000","last_unstale":"2024-04-25T09:02:57.463945+0000","last_undegraded":"2024-04-25T09:02:57.463945+0000","last_fullsized":"2024-04-25T09:02:57.463945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:55.199589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057574+0000","last_change":"2024-04-25T09:02:51.031885+0000","last_active":"2024-04-25T09:02:57.057574+0000","last_peered":"2024-04-25T09:02:57.057574+0000","last_clean":"2024-04-25T09:02:57.057574+0000","last_became_active":"2024-04-25T09:02:51.031618+0000","last_became_peered":"2024-04-25T09:02:51.031618+0000","last_unstale":"2024-04-25T09:02:57.057574+0000","last_undegraded":"2024-04-25T09:02:57.057574+0000","last_fullsized":"2024-04-25T09:02:57.057574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:41.667025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056391+0000","last_change":"2024-04-25T09:02:56.076568+0000","last_active":"2024-04-25T09:02:57.056391+0000","last_peered":"2024-04-25T09:02:57.056391+0000","last_clean":"2024-04-25T09:02:57.056391+0000","last_became_active":"2024-04-25T09:02:56.076131+0000","last_became_peered":"2024-04-25T09:02:56.076131+0000","last_unstale":"2024-04-25T09:02:57.056391+0000","last_undegraded":"2024-04-25T09:02:57.056391+0000","last_fullsized":"2024-04-25T09:02:57.056391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:43.097216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463302+0000","last_change":"2024-04-25T09:02:52.045786+0000","last_active":"2024-04-25T09:02:57.463302+0000","last_peered":"2024-04-25T09:02:57.463302+0000","last_clean":"2024-04-25T09:02:57.463302+0000","last_became_active":"2024-04-25T09:02:52.045116+0000","last_became_peered":"2024-04-25T09:02:52.045116+0000","last_unstale":"2024-04-25T09:02:57.463302+0000","last_undegraded":"2024-04-25T09:02:57.463302+0000","last_fullsized":"2024-04-25T09:02:57.463302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:29.002911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790256+0000","last_change":"2024-04-25T09:02:51.010840+0000","last_active":"2024-04-25T09:02:57.790256+0000","last_peered":"2024-04-25T09:02:57.790256+0000","last_clean":"2024-04-25T09:02:57.790256+0000","last_became_active":"2024-04-25T09:02:51.010562+0000","last_became_peered":"2024-04-25T09:02:51.010562+0000","last_unstale":"2024-04-25T09:02:57.790256+0000","last_undegraded":"2024-04-25T09:02:57.790256+0000","last_fullsized":"2024-04-25T09:02:57.790256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:52.829970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790256+0000","last_change":"2024-04-25T09:02:56.062496+0000","last_active":"2024-04-25T09:02:57.790256+0000","last_peered":"2024-04-25T09:02:57.790256+0000","last_clean":"2024-04-25T09:02:57.790256+0000","last_became_active":"2024-04-25T09:02:56.061695+0000","last_became_peered":"2024-04-25T09:02:56.061695+0000","last_unstale":"2024-04-25T09:02:57.790256+0000","last_undegraded":"2024-04-25T09:02:57.790256+0000","last_fullsized":"2024-04-25T09:02:57.790256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:52.333199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056444+0000","last_change":"2024-04-25T09:02:52.035521+0000","last_active":"2024-04-25T09:02:57.056444+0000","last_peered":"2024-04-25T09:02:57.056444+0000","last_clean":"2024-04-25T09:02:57.056444+0000","last_became_active":"2024-04-25T09:02:52.035166+0000","last_became_peered":"2024-04-25T09:02:52.035166+0000","last_unstale":"2024-04-25T09:02:57.056444+0000","last_undegraded":"2024-04-25T09:02:57.056444+0000","last_fullsized":"2024-04-25T09:02:57.056444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:15.470271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.055747+0000","last_change":"2024-04-25T09:02:51.026637+0000","last_active":"2024-04-25T09:02:57.055747+0000","last_peered":"2024-04-25T09:02:57.055747+0000","last_clean":"2024-04-25T09:02:57.055747+0000","last_became_active":"2024-04-25T09:02:51.026370+0000","last_became_peered":"2024-04-25T09:02:51.026370+0000","last_unstale":"2024-04-25T09:02:57.055747+0000","last_undegraded":"2024-04-25T09:02:57.055747+0000","last_fullsized":"2024-04-25T09:02:57.055747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:00.953314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054223+0000","last_change":"2024-04-25T09:02:56.296384+0000","last_active":"2024-04-25T09:02:57.054223+0000","last_peered":"2024-04-25T09:02:57.054223+0000","last_clean":"2024-04-25T09:02:57.054223+0000","last_became_active":"2024-04-25T09:02:56.295883+0000","last_became_peered":"2024-04-25T09:02:56.295883+0000","last_unstale":"2024-04-25T09:02:57.054223+0000","last_undegraded":"2024-04-25T09:02:57.054223+0000","last_fullsized":"2024-04-25T09:02:57.054223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:00.209106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463590+0000","last_change":"2024-04-25T09:02:52.048294+0000","last_active":"2024-04-25T09:02:57.463590+0000","last_peered":"2024-04-25T09:02:57.463590+0000","last_clean":"2024-04-25T09:02:57.463590+0000","last_became_active":"2024-04-25T09:02:52.048002+0000","last_became_peered":"2024-04-25T09:02:52.048002+0000","last_unstale":"2024-04-25T09:02:57.463590+0000","last_undegraded":"2024-04-25T09:02:57.463590+0000","last_fullsized":"2024-04-25T09:02:57.463590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:09.375365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789346+0000","last_change":"2024-04-25T09:02:51.029612+0000","last_active":"2024-04-25T09:02:57.789346+0000","last_peered":"2024-04-25T09:02:57.789346+0000","last_clean":"2024-04-25T09:02:57.789346+0000","last_became_active":"2024-04-25T09:02:51.026917+0000","last_became_peered":"2024-04-25T09:02:51.026917+0000","last_unstale":"2024-04-25T09:02:57.789346+0000","last_undegraded":"2024-04-25T09:02:57.789346+0000","last_fullsized":"2024-04-25T09:02:57.789346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:37.113394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053975+0000","last_change":"2024-04-25T09:02:56.296436+0000","last_active":"2024-04-25T09:02:57.053975+0000","last_peered":"2024-04-25T09:02:57.053975+0000","last_clean":"2024-04-25T09:02:57.053975+0000","last_became_active":"2024-04-25T09:02:56.295723+0000","last_became_peered":"2024-04-25T09:02:56.295723+0000","last_unstale":"2024-04-25T09:02:57.053975+0000","last_undegraded":"2024-04-25T09:02:57.053975+0000","last_fullsized":"2024-04-25T09:02:57.053975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:23.747770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789579+0000","last_change":"2024-04-25T09:02:52.032064+0000","last_active":"2024-04-25T09:02:57.789579+0000","last_peered":"2024-04-25T09:02:57.789579+0000","last_clean":"2024-04-25T09:02:57.789579+0000","last_became_active":"2024-04-25T09:02:52.031817+0000","last_became_peered":"2024-04-25T09:02:52.031817+0000","last_unstale":"2024-04-25T09:02:57.789579+0000","last_undegraded":"2024-04-25T09:02:57.789579+0000","last_fullsized":"2024-04-25T09:02:57.789579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:30.389641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789972+0000","last_change":"2024-04-25T09:02:51.036904+0000","last_active":"2024-04-25T09:02:57.789972+0000","last_peered":"2024-04-25T09:02:57.789972+0000","last_clean":"2024-04-25T09:02:57.789972+0000","last_became_active":"2024-04-25T09:02:51.036647+0000","last_became_peered":"2024-04-25T09:02:51.036647+0000","last_unstale":"2024-04-25T09:02:57.789972+0000","last_undegraded":"2024-04-25T09:02:57.789972+0000","last_fullsized":"2024-04-25T09:02:57.789972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:53.609696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789625+0000","last_change":"2024-04-25T09:02:56.297201+0000","last_active":"2024-04-25T09:02:57.789625+0000","last_peered":"2024-04-25T09:02:57.789625+0000","last_clean":"2024-04-25T09:02:57.789625+0000","last_became_active":"2024-04-25T09:02:56.296775+0000","last_became_peered":"2024-04-25T09:02:56.296775+0000","last_unstale":"2024-04-25T09:02:57.789625+0000","last_undegraded":"2024-04-25T09:02:57.789625+0000","last_fullsized":"2024-04-25T09:02:57.789625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:27:21.244707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463541+0000","last_change":"2024-04-25T09:02:52.048354+0000","last_active":"2024-04-25T09:02:57.463541+0000","last_peered":"2024-04-25T09:02:57.463541+0000","last_clean":"2024-04-25T09:02:57.463541+0000","last_became_active":"2024-04-25T09:02:52.048051+0000","last_became_peered":"2024-04-25T09:02:52.048051+0000","last_unstale":"2024-04-25T09:02:57.463541+0000","last_undegraded":"2024-04-25T09:02:57.463541+0000","last_fullsized":"2024-04-25T09:02:57.463541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:22.709330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:03:02.599373+0000","last_change":"2024-04-25T09:02:51.025093+0000","last_active":"2024-04-25T09:03:02.599373+0000","last_peered":"2024-04-25T09:03:02.599373+0000","last_clean":"2024-04-25T09:03:02.599373+0000","last_became_active":"2024-04-25T09:02:51.024835+0000","last_became_peered":"2024-04-25T09:02:51.024835+0000","last_unstale":"2024-04-25T09:03:02.599373+0000","last_undegraded":"2024-04-25T09:03:02.599373+0000","last_fullsized":"2024-04-25T09:03:02.599373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:40.409805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790711+0000","last_change":"2024-04-25T09:02:56.072738+0000","last_active":"2024-04-25T09:02:57.790711+0000","last_peered":"2024-04-25T09:02:57.790711+0000","last_clean":"2024-04-25T09:02:57.790711+0000","last_became_active":"2024-04-25T09:02:56.072349+0000","last_became_peered":"2024-04-25T09:02:56.072349+0000","last_unstale":"2024-04-25T09:02:57.790711+0000","last_undegraded":"2024-04-25T09:02:57.790711+0000","last_fullsized":"2024-04-25T09:02:57.790711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:52.333199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057433+0000","last_change":"2024-04-25T09:02:52.030750+0000","last_active":"2024-04-25T09:02:57.057433+0000","last_peered":"2024-04-25T09:02:57.057433+0000","last_clean":"2024-04-25T09:02:57.057433+0000","last_became_active":"2024-04-25T09:02:52.030455+0000","last_became_peered":"2024-04-25T09:02:52.030455+0000","last_unstale":"2024-04-25T09:02:57.057433+0000","last_undegraded":"2024-04-25T09:02:57.057433+0000","last_fullsized":"2024-04-25T09:02:57.057433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:21.197671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791243+0000","last_change":"2024-04-25T09:02:51.020914+0000","last_active":"2024-04-25T09:02:57.791243+0000","last_peered":"2024-04-25T09:02:57.791243+0000","last_clean":"2024-04-25T09:02:57.791243+0000","last_became_active":"2024-04-25T09:02:51.020614+0000","last_became_peered":"2024-04-25T09:02:51.020614+0000","last_unstale":"2024-04-25T09:02:57.791243+0000","last_undegraded":"2024-04-25T09:02:57.791243+0000","last_fullsized":"2024-04-25T09:02:57.791243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:23.500507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057336+0000","last_change":"2024-04-25T09:02:56.072410+0000","last_active":"2024-04-25T09:02:57.057336+0000","last_peered":"2024-04-25T09:02:57.057336+0000","last_clean":"2024-04-25T09:02:57.057336+0000","last_became_active":"2024-04-25T09:02:56.071847+0000","last_became_peered":"2024-04-25T09:02:56.071847+0000","last_unstale":"2024-04-25T09:02:57.057336+0000","last_undegraded":"2024-04-25T09:02:57.057336+0000","last_fullsized":"2024-04-25T09:02:57.057336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:01.264766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790723+0000","last_change":"2024-04-25T09:02:52.045382+0000","last_active":"2024-04-25T09:02:57.790723+0000","last_peered":"2024-04-25T09:02:57.790723+0000","last_clean":"2024-04-25T09:02:57.790723+0000","last_became_active":"2024-04-25T09:02:52.045073+0000","last_became_peered":"2024-04-25T09:02:52.045073+0000","last_unstale":"2024-04-25T09:02:57.790723+0000","last_undegraded":"2024-04-25T09:02:57.790723+0000","last_fullsized":"2024-04-25T09:02:57.790723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:00.242892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789749+0000","last_change":"2024-04-25T09:02:51.030041+0000","last_active":"2024-04-25T09:02:57.789749+0000","last_peered":"2024-04-25T09:02:57.789749+0000","last_clean":"2024-04-25T09:02:57.789749+0000","last_became_active":"2024-04-25T09:02:51.028411+0000","last_became_peered":"2024-04-25T09:02:51.028411+0000","last_unstale":"2024-04-25T09:02:57.789749+0000","last_undegraded":"2024-04-25T09:02:57.789749+0000","last_fullsized":"2024-04-25T09:02:57.789749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:07.474980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053490+0000","last_change":"2024-04-25T09:02:56.077345+0000","last_active":"2024-04-25T09:02:57.053490+0000","last_peered":"2024-04-25T09:02:57.053490+0000","last_clean":"2024-04-25T09:02:57.053490+0000","last_became_active":"2024-04-25T09:02:56.076889+0000","last_became_peered":"2024-04-25T09:02:56.076889+0000","last_unstale":"2024-04-25T09:02:57.053490+0000","last_undegraded":"2024-04-25T09:02:57.053490+0000","last_fullsized":"2024-04-25T09:02:57.053490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:03.323090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789638+0000","last_change":"2024-04-25T09:02:52.057118+0000","last_active":"2024-04-25T09:02:57.789638+0000","last_peered":"2024-04-25T09:02:57.789638+0000","last_clean":"2024-04-25T09:02:57.789638+0000","last_became_active":"2024-04-25T09:02:52.056534+0000","last_became_peered":"2024-04-25T09:02:52.056534+0000","last_unstale":"2024-04-25T09:02:57.789638+0000","last_undegraded":"2024-04-25T09:02:57.789638+0000","last_fullsized":"2024-04-25T09:02:57.789638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:52.621278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057721+0000","last_change":"2024-04-25T09:02:51.031218+0000","last_active":"2024-04-25T09:02:57.057721+0000","last_peered":"2024-04-25T09:02:57.057721+0000","last_clean":"2024-04-25T09:02:57.057721+0000","last_became_active":"2024-04-25T09:02:51.030865+0000","last_became_peered":"2024-04-25T09:02:51.030865+0000","last_unstale":"2024-04-25T09:02:57.057721+0000","last_undegraded":"2024-04-25T09:02:57.057721+0000","last_fullsized":"2024-04-25T09:02:57.057721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:07.474980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053441+0000","last_change":"2024-04-25T09:02:56.299090+0000","last_active":"2024-04-25T09:02:57.053441+0000","last_peered":"2024-04-25T09:02:57.053441+0000","last_clean":"2024-04-25T09:02:57.053441+0000","last_became_active":"2024-04-25T09:02:56.298743+0000","last_became_peered":"2024-04-25T09:02:56.298743+0000","last_unstale":"2024-04-25T09:02:57.053441+0000","last_undegraded":"2024-04-25T09:02:57.053441+0000","last_fullsized":"2024-04-25T09:02:57.053441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:29.182136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790262+0000","last_change":"2024-04-25T09:02:56.295329+0000","last_active":"2024-04-25T09:02:57.790262+0000","last_peered":"2024-04-25T09:02:57.790262+0000","last_clean":"2024-04-25T09:02:57.790262+0000","last_became_active":"2024-04-25T09:02:56.294937+0000","last_became_peered":"2024-04-25T09:02:56.294937+0000","last_unstale":"2024-04-25T09:02:57.790262+0000","last_undegraded":"2024-04-25T09:02:57.790262+0000","last_fullsized":"2024-04-25T09:02:57.790262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:30.366155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790315+0000","last_change":"2024-04-25T09:02:52.025989+0000","last_active":"2024-04-25T09:02:57.790315+0000","last_peered":"2024-04-25T09:02:57.790315+0000","last_clean":"2024-04-25T09:02:57.790315+0000","last_became_active":"2024-04-25T09:02:52.025737+0000","last_became_peered":"2024-04-25T09:02:52.025737+0000","last_unstale":"2024-04-25T09:02:57.790315+0000","last_undegraded":"2024-04-25T09:02:57.790315+0000","last_fullsized":"2024-04-25T09:02:57.790315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:11.410261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789186+0000","last_change":"2024-04-25T09:02:51.024227+0000","last_active":"2024-04-25T09:02:57.789186+0000","last_peered":"2024-04-25T09:02:57.789186+0000","last_clean":"2024-04-25T09:02:57.789186+0000","last_became_active":"2024-04-25T09:02:51.023132+0000","last_became_peered":"2024-04-25T09:02:51.023132+0000","last_unstale":"2024-04-25T09:02:57.789186+0000","last_undegraded":"2024-04-25T09:02:57.789186+0000","last_fullsized":"2024-04-25T09:02:57.789186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:53.131752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057646+0000","last_change":"2024-04-25T09:02:56.067614+0000","last_active":"2024-04-25T09:02:57.057646+0000","last_peered":"2024-04-25T09:02:57.057646+0000","last_clean":"2024-04-25T09:02:57.057646+0000","last_became_active":"2024-04-25T09:02:56.067179+0000","last_became_peered":"2024-04-25T09:02:56.067179+0000","last_unstale":"2024-04-25T09:02:57.057646+0000","last_undegraded":"2024-04-25T09:02:57.057646+0000","last_fullsized":"2024-04-25T09:02:57.057646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:23.153554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053548+0000","last_change":"2024-04-25T09:02:52.043753+0000","last_active":"2024-04-25T09:02:57.053548+0000","last_peered":"2024-04-25T09:02:57.053548+0000","last_clean":"2024-04-25T09:02:57.053548+0000","last_became_active":"2024-04-25T09:02:52.033568+0000","last_became_peered":"2024-04-25T09:02:52.033568+0000","last_unstale":"2024-04-25T09:02:57.053548+0000","last_undegraded":"2024-04-25T09:02:57.053548+0000","last_fullsized":"2024-04-25T09:02:57.053548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:00.242892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053615+0000","last_change":"2024-04-25T09:02:51.025428+0000","last_active":"2024-04-25T09:02:57.053615+0000","last_peered":"2024-04-25T09:02:57.053615+0000","last_clean":"2024-04-25T09:02:57.053615+0000","last_became_active":"2024-04-25T09:02:51.025136+0000","last_became_peered":"2024-04-25T09:02:51.025136+0000","last_unstale":"2024-04-25T09:02:57.053615+0000","last_undegraded":"2024-04-25T09:02:57.053615+0000","last_fullsized":"2024-04-25T09:02:57.053615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:52.829970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056222+0000","last_change":"2024-04-25T09:02:51.022491+0000","last_active":"2024-04-25T09:02:57.056222+0000","last_peered":"2024-04-25T09:02:57.056222+0000","last_clean":"2024-04-25T09:02:57.056222+0000","last_became_active":"2024-04-25T09:02:51.022247+0000","last_became_peered":"2024-04-25T09:02:51.022247+0000","last_unstale":"2024-04-25T09:02:57.056222+0000","last_undegraded":"2024-04-25T09:02:57.056222+0000","last_fullsized":"2024-04-25T09:02:57.056222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:37.113394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789930+0000","last_change":"2024-04-25T09:02:52.038252+0000","last_active":"2024-04-25T09:02:57.789930+0000","last_peered":"2024-04-25T09:02:57.789930+0000","last_clean":"2024-04-25T09:02:57.789930+0000","last_became_active":"2024-04-25T09:02:52.037716+0000","last_became_peered":"2024-04-25T09:02:52.037716+0000","last_unstale":"2024-04-25T09:02:57.789930+0000","last_undegraded":"2024-04-25T09:02:57.789930+0000","last_fullsized":"2024-04-25T09:02:57.789930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:10.988897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789926+0000","last_change":"2024-04-25T09:02:56.069802+0000","last_active":"2024-04-25T09:02:57.789926+0000","last_peered":"2024-04-25T09:02:57.789926+0000","last_clean":"2024-04-25T09:02:57.789926+0000","last_became_active":"2024-04-25T09:02:56.069427+0000","last_became_peered":"2024-04-25T09:02:56.069427+0000","last_unstale":"2024-04-25T09:02:57.789926+0000","last_undegraded":"2024-04-25T09:02:57.789926+0000","last_fullsized":"2024-04-25T09:02:57.789926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:34.424557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053772+0000","last_change":"2024-04-25T09:02:51.036075+0000","last_active":"2024-04-25T09:02:57.053772+0000","last_peered":"2024-04-25T09:02:57.053772+0000","last_clean":"2024-04-25T09:02:57.053772+0000","last_became_active":"2024-04-25T09:02:51.035849+0000","last_became_peered":"2024-04-25T09:02:51.035849+0000","last_unstale":"2024-04-25T09:02:57.053772+0000","last_undegraded":"2024-04-25T09:02:57.053772+0000","last_fullsized":"2024-04-25T09:02:57.053772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:23.500507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056936+0000","last_change":"2024-04-25T09:02:52.036912+0000","last_active":"2024-04-25T09:02:57.056936+0000","last_peered":"2024-04-25T09:02:57.056936+0000","last_clean":"2024-04-25T09:02:57.056936+0000","last_became_active":"2024-04-25T09:02:52.036679+0000","last_became_peered":"2024-04-25T09:02:52.036679+0000","last_unstale":"2024-04-25T09:02:57.056936+0000","last_undegraded":"2024-04-25T09:02:57.056936+0000","last_fullsized":"2024-04-25T09:02:57.056936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:08.484435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054391+0000","last_change":"2024-04-25T09:02:56.066858+0000","last_active":"2024-04-25T09:02:57.054391+0000","last_peered":"2024-04-25T09:02:57.054391+0000","last_clean":"2024-04-25T09:02:57.054391+0000","last_became_active":"2024-04-25T09:02:56.066447+0000","last_became_peered":"2024-04-25T09:02:56.066447+0000","last_unstale":"2024-04-25T09:02:57.054391+0000","last_undegraded":"2024-04-25T09:02:57.054391+0000","last_fullsized":"2024-04-25T09:02:57.054391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:31.684064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.055569+0000","last_change":"2024-04-25T09:02:52.035312+0000","last_active":"2024-04-25T09:02:57.055569+0000","last_peered":"2024-04-25T09:02:57.055569+0000","last_clean":"2024-04-25T09:02:57.055569+0000","last_became_active":"2024-04-25T09:02:52.035070+0000","last_became_peered":"2024-04-25T09:02:52.035070+0000","last_unstale":"2024-04-25T09:02:57.055569+0000","last_undegraded":"2024-04-25T09:02:57.055569+0000","last_fullsized":"2024-04-25T09:02:57.055569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:31.078849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789359+0000","last_change":"2024-04-25T09:02:52.045821+0000","last_active":"2024-04-25T09:02:57.789359+0000","last_peered":"2024-04-25T09:02:57.789359+0000","last_clean":"2024-04-25T09:02:57.789359+0000","last_became_active":"2024-04-25T09:02:52.045314+0000","last_became_peered":"2024-04-25T09:02:52.045314+0000","last_unstale":"2024-04-25T09:02:57.789359+0000","last_undegraded":"2024-04-25T09:02:57.789359+0000","last_fullsized":"2024-04-25T09:02:57.789359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:45.562857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789433+0000","last_change":"2024-04-25T09:02:52.037128+0000","last_active":"2024-04-25T09:02:57.789433+0000","last_peered":"2024-04-25T09:02:57.789433+0000","last_clean":"2024-04-25T09:02:57.789433+0000","last_became_active":"2024-04-25T09:02:52.036844+0000","last_became_peered":"2024-04-25T09:02:52.036844+0000","last_unstale":"2024-04-25T09:02:57.789433+0000","last_undegraded":"2024-04-25T09:02:57.789433+0000","last_fullsized":"2024-04-25T09:02:57.789433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:00.651193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789850+0000","last_change":"2024-04-25T09:02:52.029120+0000","last_active":"2024-04-25T09:02:57.789850+0000","last_peered":"2024-04-25T09:02:57.789850+0000","last_clean":"2024-04-25T09:02:57.789850+0000","last_became_active":"2024-04-25T09:02:52.028407+0000","last_became_peered":"2024-04-25T09:02:52.028407+0000","last_unstale":"2024-04-25T09:02:57.789850+0000","last_undegraded":"2024-04-25T09:02:57.789850+0000","last_fullsized":"2024-04-25T09:02:57.789850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:02.471096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054070+0000","last_change":"2024-04-25T09:02:52.042602+0000","last_active":"2024-04-25T09:02:57.054070+0000","last_peered":"2024-04-25T09:02:57.054070+0000","last_clean":"2024-04-25T09:02:57.054070+0000","last_became_active":"2024-04-25T09:02:52.042283+0000","last_became_peered":"2024-04-25T09:02:52.042283+0000","last_unstale":"2024-04-25T09:02:57.054070+0000","last_undegraded":"2024-04-25T09:02:57.054070+0000","last_fullsized":"2024-04-25T09:02:57.054070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:17.240659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791085+0000","last_change":"2024-04-25T09:02:52.033453+0000","last_active":"2024-04-25T09:02:57.791085+0000","last_peered":"2024-04-25T09:02:57.791085+0000","last_clean":"2024-04-25T09:02:57.791085+0000","last_became_active":"2024-04-25T09:02:52.031389+0000","last_became_peered":"2024-04-25T09:02:52.031389+0000","last_unstale":"2024-04-25T09:02:57.791085+0000","last_undegraded":"2024-04-25T09:02:57.791085+0000","last_fullsized":"2024-04-25T09:02:57.791085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:50.625187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057375+0000","last_change":"2024-04-25T09:02:52.035491+0000","last_active":"2024-04-25T09:02:57.057375+0000","last_peered":"2024-04-25T09:02:57.057375+0000","last_clean":"2024-04-25T09:02:57.057375+0000","last_became_active":"2024-04-25T09:02:52.035187+0000","last_became_peered":"2024-04-25T09:02:52.035187+0000","last_unstale":"2024-04-25T09:02:57.057375+0000","last_undegraded":"2024-04-25T09:02:57.057375+0000","last_fullsized":"2024-04-25T09:02:57.057375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:48.414352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054153+0000","last_change":"2024-04-25T09:02:52.039762+0000","last_active":"2024-04-25T09:02:57.054153+0000","last_peered":"2024-04-25T09:02:57.054153+0000","last_clean":"2024-04-25T09:02:57.054153+0000","last_became_active":"2024-04-25T09:02:52.039488+0000","last_became_peered":"2024-04-25T09:02:52.039488+0000","last_unstale":"2024-04-25T09:02:57.054153+0000","last_undegraded":"2024-04-25T09:02:57.054153+0000","last_fullsized":"2024-04-25T09:02:57.054153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:09.375365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789087+0000","last_change":"2024-04-25T09:02:52.043692+0000","last_active":"2024-04-25T09:02:57.789087+0000","last_peered":"2024-04-25T09:02:57.789087+0000","last_clean":"2024-04-25T09:02:57.789087+0000","last_became_active":"2024-04-25T09:02:52.032307+0000","last_became_peered":"2024-04-25T09:02:52.032307+0000","last_unstale":"2024-04-25T09:02:57.789087+0000","last_undegraded":"2024-04-25T09:02:57.789087+0000","last_fullsized":"2024-04-25T09:02:57.789087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:19.118637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053487+0000","last_change":"2024-04-25T09:02:52.040184+0000","last_active":"2024-04-25T09:02:57.053487+0000","last_peered":"2024-04-25T09:02:57.053487+0000","last_clean":"2024-04-25T09:02:57.053487+0000","last_became_active":"2024-04-25T09:02:52.040040+0000","last_became_peered":"2024-04-25T09:02:52.040040+0000","last_unstale":"2024-04-25T09:02:57.053487+0000","last_undegraded":"2024-04-25T09:02:57.053487+0000","last_fullsized":"2024-04-25T09:02:57.053487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:29.446381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789190+0000","last_change":"2024-04-25T09:02:52.058066+0000","last_active":"2024-04-25T09:02:57.789190+0000","last_peered":"2024-04-25T09:02:57.789190+0000","last_clean":"2024-04-25T09:02:57.789190+0000","last_became_active":"2024-04-25T09:02:52.053807+0000","last_became_peered":"2024-04-25T09:02:52.053807+0000","last_unstale":"2024-04-25T09:02:57.789190+0000","last_undegraded":"2024-04-25T09:02:57.789190+0000","last_fullsized":"2024-04-25T09:02:57.789190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:57.229849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789717+0000","last_change":"2024-04-25T09:02:52.036032+0000","last_active":"2024-04-25T09:02:57.789717+0000","last_peered":"2024-04-25T09:02:57.789717+0000","last_clean":"2024-04-25T09:02:57.789717+0000","last_became_active":"2024-04-25T09:02:52.035736+0000","last_became_peered":"2024-04-25T09:02:52.035736+0000","last_unstale":"2024-04-25T09:02:57.789717+0000","last_undegraded":"2024-04-25T09:02:57.789717+0000","last_fullsized":"2024-04-25T09:02:57.789717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:31.710536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056126+0000","last_change":"2024-04-25T09:02:52.039101+0000","last_active":"2024-04-25T09:02:57.056126+0000","last_peered":"2024-04-25T09:02:57.056126+0000","last_clean":"2024-04-25T09:02:57.056126+0000","last_became_active":"2024-04-25T09:02:52.038805+0000","last_became_peered":"2024-04-25T09:02:52.038805+0000","last_unstale":"2024-04-25T09:02:57.056126+0000","last_undegraded":"2024-04-25T09:02:57.056126+0000","last_fullsized":"2024-04-25T09:02:57.056126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:39.062300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463830+0000","last_change":"2024-04-25T09:02:52.049274+0000","last_active":"2024-04-25T09:02:57.463830+0000","last_peered":"2024-04-25T09:02:57.463830+0000","last_clean":"2024-04-25T09:02:57.463830+0000","last_became_active":"2024-04-25T09:02:52.048624+0000","last_became_peered":"2024-04-25T09:02:52.048624+0000","last_unstale":"2024-04-25T09:02:57.463830+0000","last_undegraded":"2024-04-25T09:02:57.463830+0000","last_fullsized":"2024-04-25T09:02:57.463830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:48.298283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790702+0000","last_change":"2024-04-25T09:02:52.030094+0000","last_active":"2024-04-25T09:02:57.790702+0000","last_peered":"2024-04-25T09:02:57.790702+0000","last_clean":"2024-04-25T09:02:57.790702+0000","last_became_active":"2024-04-25T09:02:52.029404+0000","last_became_peered":"2024-04-25T09:02:52.029404+0000","last_unstale":"2024-04-25T09:02:57.790702+0000","last_undegraded":"2024-04-25T09:02:57.790702+0000","last_fullsized":"2024-04-25T09:02:57.790702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:11.826190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789936+0000","last_change":"2024-04-25T09:02:52.057482+0000","last_active":"2024-04-25T09:02:57.789936+0000","last_peered":"2024-04-25T09:02:57.789936+0000","last_clean":"2024-04-25T09:02:57.789936+0000","last_became_active":"2024-04-25T09:02:52.053761+0000","last_became_peered":"2024-04-25T09:02:52.053761+0000","last_unstale":"2024-04-25T09:02:57.789936+0000","last_undegraded":"2024-04-25T09:02:57.789936+0000","last_fullsized":"2024-04-25T09:02:57.789936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:41.457232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.788945+0000","last_change":"2024-04-25T09:02:52.038864+0000","last_active":"2024-04-25T09:02:57.788945+0000","last_peered":"2024-04-25T09:02:57.788945+0000","last_clean":"2024-04-25T09:02:57.788945+0000","last_became_active":"2024-04-25T09:02:52.038586+0000","last_became_peered":"2024-04-25T09:02:52.038586+0000","last_unstale":"2024-04-25T09:02:57.788945+0000","last_undegraded":"2024-04-25T09:02:57.788945+0000","last_fullsized":"2024-04-25T09:02:57.788945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:39.062300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790365+0000","last_change":"2024-04-25T09:02:52.021083+0000","last_active":"2024-04-25T09:02:57.790365+0000","last_peered":"2024-04-25T09:02:57.790365+0000","last_clean":"2024-04-25T09:02:57.790365+0000","last_became_active":"2024-04-25T09:02:52.019096+0000","last_became_peered":"2024-04-25T09:02:52.019096+0000","last_unstale":"2024-04-25T09:02:57.790365+0000","last_undegraded":"2024-04-25T09:02:57.790365+0000","last_fullsized":"2024-04-25T09:02:57.790365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:10.988897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789527+0000","last_change":"2024-04-25T09:02:52.025371+0000","last_active":"2024-04-25T09:02:57.789527+0000","last_peered":"2024-04-25T09:02:57.789527+0000","last_clean":"2024-04-25T09:02:57.789527+0000","last_became_active":"2024-04-25T09:02:52.024320+0000","last_became_peered":"2024-04-25T09:02:52.024320+0000","last_unstale":"2024-04-25T09:02:57.789527+0000","last_undegraded":"2024-04-25T09:02:57.789527+0000","last_fullsized":"2024-04-25T09:02:57.789527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:19.358216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053569+0000","last_change":"2024-04-25T09:02:52.033835+0000","last_active":"2024-04-25T09:02:57.053569+0000","last_peered":"2024-04-25T09:02:57.053569+0000","last_clean":"2024-04-25T09:02:57.053569+0000","last_became_active":"2024-04-25T09:02:52.033530+0000","last_became_peered":"2024-04-25T09:02:52.033530+0000","last_unstale":"2024-04-25T09:02:57.053569+0000","last_undegraded":"2024-04-25T09:02:57.053569+0000","last_fullsized":"2024-04-25T09:02:57.053569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:07.517265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057290+0000","last_change":"2024-04-25T09:02:52.027796+0000","last_active":"2024-04-25T09:02:57.057290+0000","last_peered":"2024-04-25T09:02:57.057290+0000","last_clean":"2024-04-25T09:02:57.057290+0000","last_became_active":"2024-04-25T09:02:52.027441+0000","last_became_peered":"2024-04-25T09:02:52.027441+0000","last_unstale":"2024-04-25T09:02:57.057290+0000","last_undegraded":"2024-04-25T09:02:57.057290+0000","last_fullsized":"2024-04-25T09:02:57.057290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:41.693114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056467+0000","last_change":"2024-04-25T09:02:52.051744+0000","last_active":"2024-04-25T09:02:57.056467+0000","last_peered":"2024-04-25T09:02:57.056467+0000","last_clean":"2024-04-25T09:02:57.056467+0000","last_became_active":"2024-04-25T09:02:52.051453+0000","last_became_peered":"2024-04-25T09:02:52.051453+0000","last_unstale":"2024-04-25T09:02:57.056467+0000","last_undegraded":"2024-04-25T09:02:57.056467+0000","last_fullsized":"2024-04-25T09:02:57.056467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:18.635634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057266+0000","last_change":"2024-04-25T09:02:52.051875+0000","last_active":"2024-04-25T09:02:57.057266+0000","last_peered":"2024-04-25T09:02:57.057266+0000","last_clean":"2024-04-25T09:02:57.057266+0000","last_became_active":"2024-04-25T09:02:52.051621+0000","last_became_peered":"2024-04-25T09:02:52.051621+0000","last_unstale":"2024-04-25T09:02:57.057266+0000","last_undegraded":"2024-04-25T09:02:57.057266+0000","last_fullsized":"2024-04-25T09:02:57.057266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:52.428184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.464024+0000","last_change":"2024-04-25T09:02:52.058460+0000","last_active":"2024-04-25T09:02:57.464024+0000","last_peered":"2024-04-25T09:02:57.464024+0000","last_clean":"2024-04-25T09:02:57.464024+0000","last_became_active":"2024-04-25T09:02:52.058164+0000","last_became_peered":"2024-04-25T09:02:52.058164+0000","last_unstale":"2024-04-25T09:02:57.464024+0000","last_undegraded":"2024-04-25T09:02:57.464024+0000","last_fullsized":"2024-04-25T09:02:57.464024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:07.843292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053224+0000","last_change":"2024-04-25T09:02:52.044000+0000","last_active":"2024-04-25T09:02:57.053224+0000","last_peered":"2024-04-25T09:02:57.053224+0000","last_clean":"2024-04-25T09:02:57.053224+0000","last_became_active":"2024-04-25T09:02:52.042814+0000","last_became_peered":"2024-04-25T09:02:52.042814+0000","last_unstale":"2024-04-25T09:02:57.053224+0000","last_undegraded":"2024-04-25T09:02:57.053224+0000","last_fullsized":"2024-04-25T09:02:57.053224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:12.756335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463194+0000","last_change":"2024-04-25T09:02:52.044961+0000","last_active":"2024-04-25T09:02:57.463194+0000","last_peered":"2024-04-25T09:02:57.463194+0000","last_clean":"2024-04-25T09:02:57.463194+0000","last_became_active":"2024-04-25T09:02:52.044611+0000","last_became_peered":"2024-04-25T09:02:52.044611+0000","last_unstale":"2024-04-25T09:02:57.463194+0000","last_undegraded":"2024-04-25T09:02:57.463194+0000","last_fullsized":"2024-04-25T09:02:57.463194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:07.517265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789201+0000","last_change":"2024-04-25T09:02:52.043640+0000","last_active":"2024-04-25T09:02:57.789201+0000","last_peered":"2024-04-25T09:02:57.789201+0000","last_clean":"2024-04-25T09:02:57.789201+0000","last_became_active":"2024-04-25T09:02:52.039228+0000","last_became_peered":"2024-04-25T09:02:52.039228+0000","last_unstale":"2024-04-25T09:02:57.789201+0000","last_undegraded":"2024-04-25T09:02:57.789201+0000","last_fullsized":"2024-04-25T09:02:57.789201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:35.283398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463393+0000","last_change":"2024-04-25T09:02:52.045074+0000","last_active":"2024-04-25T09:02:57.463393+0000","last_peered":"2024-04-25T09:02:57.463393+0000","last_clean":"2024-04-25T09:02:57.463393+0000","last_became_active":"2024-04-25T09:02:52.044803+0000","last_became_peered":"2024-04-25T09:02:52.044803+0000","last_unstale":"2024-04-25T09:02:57.463393+0000","last_undegraded":"2024-04-25T09:02:57.463393+0000","last_fullsized":"2024-04-25T09:02:57.463393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:45.007626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789370+0000","last_change":"2024-04-25T09:02:52.044897+0000","last_active":"2024-04-25T09:02:57.789370+0000","last_peered":"2024-04-25T09:02:57.789370+0000","last_clean":"2024-04-25T09:02:57.789370+0000","last_became_active":"2024-04-25T09:02:52.044582+0000","last_became_peered":"2024-04-25T09:02:52.044582+0000","last_unstale":"2024-04-25T09:02:57.789370+0000","last_undegraded":"2024-04-25T09:02:57.789370+0000","last_fullsized":"2024-04-25T09:02:57.789370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:52.428184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790225+0000","last_change":"2024-04-25T09:02:52.026796+0000","last_active":"2024-04-25T09:02:57.790225+0000","last_peered":"2024-04-25T09:02:57.790225+0000","last_clean":"2024-04-25T09:02:57.790225+0000","last_became_active":"2024-04-25T09:02:52.026522+0000","last_became_peered":"2024-04-25T09:02:52.026522+0000","last_unstale":"2024-04-25T09:02:57.790225+0000","last_undegraded":"2024-04-25T09:02:57.790225+0000","last_fullsized":"2024-04-25T09:02:57.790225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:29.446381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791477+0000","last_change":"2024-04-25T09:02:52.016990+0000","last_active":"2024-04-25T09:02:57.791477+0000","last_peered":"2024-04-25T09:02:57.791477+0000","last_clean":"2024-04-25T09:02:57.791477+0000","last_became_active":"2024-04-25T09:02:52.015451+0000","last_became_peered":"2024-04-25T09:02:52.015451+0000","last_unstale":"2024-04-25T09:02:57.791477+0000","last_undegraded":"2024-04-25T09:02:57.791477+0000","last_fullsized":"2024-04-25T09:02:57.791477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:00.242892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463935+0000","last_change":"2024-04-25T09:02:52.050256+0000","last_active":"2024-04-25T09:02:57.463935+0000","last_peered":"2024-04-25T09:02:57.463935+0000","last_clean":"2024-04-25T09:02:57.463935+0000","last_became_active":"2024-04-25T09:02:52.049994+0000","last_became_peered":"2024-04-25T09:02:52.049994+0000","last_unstale":"2024-04-25T09:02:57.463935+0000","last_undegraded":"2024-04-25T09:02:57.463935+0000","last_fullsized":"2024-04-25T09:02:57.463935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:26.331238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":106528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":106402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":697408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":697352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:03:14.734 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:03:14.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.918+0000 7f65d1800640 1 Processor -- start 2024-04-25T09:03:14.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.918+0000 7f65d1800640 1 -- start start 2024-04-25T09:03:14.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.918+0000 7f65d1800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f65cc06c270 0x7f65cc06c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.918+0000 7f65d1800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f65cc06ccf0 0x7f65cc0b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.918+0000 7f65d1800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65cc09ad60 con 0x7f65cc15da60 2024-04-25T09:03:14.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.918+0000 7f65d1800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65cc09ab40 con 0x7f65cc06ccf0 2024-04-25T09:03:14.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.918+0000 7f65d1800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65cc06d140 con 0x7f65cc06c270 2024-04-25T09:03:14.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.918+0000 7f65d0e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f65cc06ccf0 0x7f65cc0b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.922+0000 7f65d0e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f65cc06ccf0 0x7f65cc0b22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43012/0 (socket says 172.21.15.173:43012) 2024-04-25T09:03:14.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.922+0000 7f65cbe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f65cc15da60 0x7f65cc09a430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38966/0 (socket says 172.21.15.173:38966) 2024-04-25T09:03:14.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.922+0000 7f65d0e00640 1 -- 172.21.15.173:0/1235276120 learned_addr learned my addr 172.21.15.173:0/1235276120 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:14.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.922+0000 7f65c3400640 1 --2- 172.21.15.173:0/1235276120 >> v2:172.21.15.194:3300/0 conn(0x7f65cc06c270 0x7f65cc06c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.922+0000 7f65d0e00640 1 -- 172.21.15.173:0/1235276120 >> v2:172.21.15.194:3300/0 conn(0x7f65cc06c270 msgr2=0x7f65cc06c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:14.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.922+0000 7f65d0e00640 1 --2- 172.21.15.173:0/1235276120 >> v2:172.21.15.194:3300/0 conn(0x7f65cc06c270 0x7f65cc06c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.922+0000 7f65d0e00640 1 -- 172.21.15.173:0/1235276120 >> v1:172.21.15.173:6789/0 conn(0x7f65cc15da60 legacy=0x7f65cc09a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.922+0000 7f65d0e00640 1 -- 172.21.15.173:0/1235276120 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc0cbd30 con 0x7f65cc06ccf0 2024-04-25T09:03:14.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.922+0000 7f65cb400640 1 -- 172.21.15.173:0/1235276120 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3558562031 0 0) 0x7f65cc09ad60 con 0x7f65cc15da60 2024-04-25T09:03:14.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.922+0000 7f65d0e00640 1 --2- 172.21.15.173:0/1235276120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65cc06ccf0 0x7f65cc0b22c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0c8680 tx=0x7f65c401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4347da9d37cc51e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.922+0000 7f65cb400640 1 -- 172.21.15.173:0/1235276120 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c40a57a0 con 0x7f65cc06ccf0 2024-04-25T09:03:14.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.922+0000 7f65cb400640 1 -- 172.21.15.173:0/1235276120 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c40a5940 con 0x7f65cc06ccf0 2024-04-25T09:03:14.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.922+0000 7f65cb400640 1 -- 172.21.15.173:0/1235276120 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c40a5d10 con 0x7f65cc06ccf0 2024-04-25T09:03:14.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d1800640 1 -- 172.21.15.173:0/1235276120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65cc06ccf0 msgr2=0x7f65cc0b22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d1800640 1 --2- 172.21.15.173:0/1235276120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65cc06ccf0 0x7f65cc0b22c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0c8680 tx=0x7f65c401c9f0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d1800640 1 -- 172.21.15.173:0/1235276120 shutdown_connections 2024-04-25T09:03:14.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d1800640 1 --2- 172.21.15.173:0/1235276120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65cc06ccf0 0x7f65cc0b22c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d1800640 1 --2- 172.21.15.173:0/1235276120 >> v2:172.21.15.194:3300/0 conn(0x7f65cc06c270 0x7f65cc06c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d1800640 1 -- 172.21.15.173:0/1235276120 >> 172.21.15.173:0/1235276120 conn(0x7f65cc0b3130 msgr2=0x7f65cc0b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:14.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d1800640 1 -- 172.21.15.173:0/1235276120 shutdown_connections 2024-04-25T09:03:14.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d1800640 1 -- 172.21.15.173:0/1235276120 wait complete. 2024-04-25T09:03:14.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d1800640 1 Processor -- start 2024-04-25T09:03:14.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d1800640 1 -- start start 2024-04-25T09:03:14.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d1800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65cc06c270 0x7f65cc0b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d1800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65cc06ccf0 0x7f65cc153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d1800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65cc15da60 0x7f65cc0b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d1800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc15dfc0 con 0x7f65cc15da60 2024-04-25T09:03:14.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d1800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc15de40 con 0x7f65cc06c270 2024-04-25T09:03:14.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d1800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc0ccaf0 con 0x7f65cc06ccf0 2024-04-25T09:03:14.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d0e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65cc15da60 0x7f65cc0b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d0e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65cc15da60 0x7f65cc0b1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43022/0 (socket says 172.21.15.173:43022) 2024-04-25T09:03:14.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d0e00640 1 -- 172.21.15.173:0/4025251767 learned_addr learned my addr 172.21.15.173:0/4025251767 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:14.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65c3400640 1 --2- 172.21.15.173:0/4025251767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65cc06ccf0 0x7f65cc153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65cbe00640 1 --2- 172.21.15.173:0/4025251767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65cc06c270 0x7f65cc0b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d0e00640 1 -- 172.21.15.173:0/4025251767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65cc06ccf0 msgr2=0x7f65cc153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d0e00640 1 --2- 172.21.15.173:0/4025251767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65cc06ccf0 0x7f65cc153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d0e00640 1 -- 172.21.15.173:0/4025251767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65cc06c270 msgr2=0x7f65cc0b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:14.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d0e00640 1 --2- 172.21.15.173:0/4025251767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65cc06c270 0x7f65cc0b6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:14.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d0e00640 1 -- 172.21.15.173:0/4025251767 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc0caa60 con 0x7f65cc15da60 2024-04-25T09:03:14.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.926+0000 7f65d0e00640 1 --2- 172.21.15.173:0/4025251767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65cc15da60 0x7f65cc0b1b60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f65c4019600 tx=0x7f65c4019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.930+0000 7f65c8c00640 1 -- 172.21.15.173:0/4025251767 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c40bc020 con 0x7f65cc15da60 2024-04-25T09:03:14.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.930+0000 7f65c8c00640 1 -- 172.21.15.173:0/4025251767 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c40b8670 con 0x7f65cc15da60 2024-04-25T09:03:14.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.930+0000 7f65c8c00640 1 -- 172.21.15.173:0/4025251767 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c40b8a60 con 0x7f65cc15da60 2024-04-25T09:03:14.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.930+0000 7f65d1800640 1 -- 172.21.15.173:0/4025251767 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65cc158930 con 0x7f65cc15da60 2024-04-25T09:03:14.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.930+0000 7f65d1800640 1 -- 172.21.15.173:0/4025251767 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65cc0cafb0 con 0x7f65cc15da60 2024-04-25T09:03:14.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.930+0000 7f65d1800640 1 -- 172.21.15.173:0/4025251767 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65cc0cb1b0 con 0x7f65cc15da60 2024-04-25T09:03:14.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.930+0000 7f65c8c00640 1 -- 172.21.15.173:0/4025251767 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f65c40bf020 con 0x7f65cc15da60 2024-04-25T09:03:14.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.930+0000 7f65c8c00640 1 --2- 172.21.15.173:0/4025251767 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f65a8066f60 0x7f65a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:14.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.930+0000 7f65c8c00640 1 -- 172.21.15.173:0/4025251767 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f65c4120210 con 0x7f65cc15da60 2024-04-25T09:03:14.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.930+0000 7f65cbe00640 1 --2- 172.21.15.173:0/4025251767 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f65a8066f60 0x7f65a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:14.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.930+0000 7f65cbe00640 1 --2- 172.21.15.173:0/4025251767 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f65a8066f60 0x7f65a8069420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f65bc000f70 tx=0x7f65bc007c10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:14.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:14.934+0000 7f65c8c00640 1 -- 172.21.15.173:0/4025251767 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f65c40c6030 con 0x7f65cc15da60 2024-04-25T09:03:15.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.090+0000 7f65d1800640 1 -- 172.21.15.173:0/4025251767 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65cc073a40 con 0x7f65a8066f60 2024-04-25T09:03:15.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.098+0000 7f65c8c00640 1 -- 172.21.15.173:0/4025251767 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332534 (secure 0 0 0) 0x7f65cc073a40 con 0x7f65a8066f60 2024-04-25T09:03:15.089 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:15.091 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:03:15.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.102+0000 7f65d1800640 1 -- 172.21.15.173:0/4025251767 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f65a8066f60 msgr2=0x7f65a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.102+0000 7f65d1800640 1 --2- 172.21.15.173:0/4025251767 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f65a8066f60 0x7f65a8069420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f65bc000f70 tx=0x7f65bc007c10 comp rx=0 tx=0).stop 2024-04-25T09:03:15.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.102+0000 7f65d1800640 1 -- 172.21.15.173:0/4025251767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65cc15da60 msgr2=0x7f65cc0b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.102+0000 7f65d1800640 1 --2- 172.21.15.173:0/4025251767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65cc15da60 0x7f65cc0b1b60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f65c4019600 tx=0x7f65c4019790 comp rx=0 tx=0).stop 2024-04-25T09:03:15.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.102+0000 7f65d1800640 1 -- 172.21.15.173:0/4025251767 shutdown_connections 2024-04-25T09:03:15.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.102+0000 7f65d1800640 1 --2- 172.21.15.173:0/4025251767 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f65a8066f60 0x7f65a8069420 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.102+0000 7f65d1800640 1 --2- 172.21.15.173:0/4025251767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65cc15da60 0x7f65cc0b1b60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.102+0000 7f65d1800640 1 --2- 172.21.15.173:0/4025251767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65cc06ccf0 0x7f65cc153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.102+0000 7f65d1800640 1 --2- 172.21.15.173:0/4025251767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65cc06c270 0x7f65cc0b6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.102+0000 7f65d1800640 1 -- 172.21.15.173:0/4025251767 >> 172.21.15.173:0/4025251767 conn(0x7f65cc0b3130 msgr2=0x7f65cc0d0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:15.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.102+0000 7f65d1800640 1 -- 172.21.15.173:0/4025251767 shutdown_connections 2024-04-25T09:03:15.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.102+0000 7f65d1800640 1 -- 172.21.15.173:0/4025251767 wait complete. 2024-04-25T09:03:15.108 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-25T09:03:14.730443+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219512,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755208,"statfs":{"total":773094113280,"available":772869332992,"internally_reserved":0,"allocated":3416064,"data_stored":2041232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003109"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790824+0000","last_change":"2024-04-25T09:02:51.036766+0000","last_active":"2024-04-25T09:02:57.790824+0000","last_peered":"2024-04-25T09:02:57.790824+0000","last_clean":"2024-04-25T09:02:57.790824+0000","last_became_active":"2024-04-25T09:02:51.036485+0000","last_became_peered":"2024-04-25T09:02:51.036485+0000","last_unstale":"2024-04-25T09:02:57.790824+0000","last_undegraded":"2024-04-25T09:02:57.790824+0000","last_fullsized":"2024-04-25T09:02:57.790824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:41.333762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053869+0000","last_change":"2024-04-25T09:02:52.031373+0000","last_active":"2024-04-25T09:02:57.053869+0000","last_peered":"2024-04-25T09:02:57.053869+0000","last_clean":"2024-04-25T09:02:57.053869+0000","last_became_active":"2024-04-25T09:02:52.028004+0000","last_became_peered":"2024-04-25T09:02:52.028004+0000","last_unstale":"2024-04-25T09:02:57.053869+0000","last_undegraded":"2024-04-25T09:02:57.053869+0000","last_fullsized":"2024-04-25T09:02:57.053869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:45.007626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053347+0000","last_change":"2024-04-25T09:02:56.296066+0000","last_active":"2024-04-25T09:02:57.053347+0000","last_peered":"2024-04-25T09:02:57.053347+0000","last_clean":"2024-04-25T09:02:57.053347+0000","last_became_active":"2024-04-25T09:02:56.295657+0000","last_became_peered":"2024-04-25T09:02:56.295657+0000","last_unstale":"2024-04-25T09:02:57.053347+0000","last_undegraded":"2024-04-25T09:02:57.053347+0000","last_fullsized":"2024-04-25T09:02:57.053347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:42.494123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054215+0000","last_change":"2024-04-25T09:02:51.035936+0000","last_active":"2024-04-25T09:02:57.054215+0000","last_peered":"2024-04-25T09:02:57.054215+0000","last_clean":"2024-04-25T09:02:57.054215+0000","last_became_active":"2024-04-25T09:02:51.035632+0000","last_became_peered":"2024-04-25T09:02:51.035632+0000","last_unstale":"2024-04-25T09:02:57.054215+0000","last_undegraded":"2024-04-25T09:02:57.054215+0000","last_fullsized":"2024-04-25T09:02:57.054215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:47.372516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790632+0000","last_change":"2024-04-25T09:02:52.046727+0000","last_active":"2024-04-25T09:02:57.790632+0000","last_peered":"2024-04-25T09:02:57.790632+0000","last_clean":"2024-04-25T09:02:57.790632+0000","last_became_active":"2024-04-25T09:02:52.046423+0000","last_became_peered":"2024-04-25T09:02:52.046423+0000","last_unstale":"2024-04-25T09:02:57.790632+0000","last_undegraded":"2024-04-25T09:02:57.790632+0000","last_fullsized":"2024-04-25T09:02:57.790632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:17.240659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.055935+0000","last_change":"2024-04-25T09:02:56.072393+0000","last_active":"2024-04-25T09:02:57.055935+0000","last_peered":"2024-04-25T09:02:57.055935+0000","last_clean":"2024-04-25T09:02:57.055935+0000","last_became_active":"2024-04-25T09:02:56.071966+0000","last_became_peered":"2024-04-25T09:02:56.071966+0000","last_unstale":"2024-04-25T09:02:57.055935+0000","last_undegraded":"2024-04-25T09:02:57.055935+0000","last_fullsized":"2024-04-25T09:02:57.055935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:22.670550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.464060+0000","last_change":"2024-04-25T09:02:51.033004+0000","last_active":"2024-04-25T09:02:57.464060+0000","last_peered":"2024-04-25T09:02:57.464060+0000","last_clean":"2024-04-25T09:02:57.464060+0000","last_became_active":"2024-04-25T09:02:51.032475+0000","last_became_peered":"2024-04-25T09:02:51.032475+0000","last_unstale":"2024-04-25T09:02:57.464060+0000","last_undegraded":"2024-04-25T09:02:57.464060+0000","last_fullsized":"2024-04-25T09:02:57.464060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:44.553402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789504+0000","last_change":"2024-04-25T09:02:52.044192+0000","last_active":"2024-04-25T09:02:57.789504+0000","last_peered":"2024-04-25T09:02:57.789504+0000","last_clean":"2024-04-25T09:02:57.789504+0000","last_became_active":"2024-04-25T09:02:52.043910+0000","last_became_peered":"2024-04-25T09:02:52.043910+0000","last_unstale":"2024-04-25T09:02:57.789504+0000","last_undegraded":"2024-04-25T09:02:57.789504+0000","last_fullsized":"2024-04-25T09:02:57.789504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:48.414352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057118+0000","last_change":"2024-04-25T09:02:56.076524+0000","last_active":"2024-04-25T09:02:57.057118+0000","last_peered":"2024-04-25T09:02:57.057118+0000","last_clean":"2024-04-25T09:02:57.057118+0000","last_became_active":"2024-04-25T09:02:56.076082+0000","last_became_peered":"2024-04-25T09:02:56.076082+0000","last_unstale":"2024-04-25T09:02:57.057118+0000","last_undegraded":"2024-04-25T09:02:57.057118+0000","last_fullsized":"2024-04-25T09:02:57.057118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:46.299051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463579+0000","last_change":"2024-04-25T09:02:51.039297+0000","last_active":"2024-04-25T09:02:57.463579+0000","last_peered":"2024-04-25T09:02:57.463579+0000","last_clean":"2024-04-25T09:02:57.463579+0000","last_became_active":"2024-04-25T09:02:51.039060+0000","last_became_peered":"2024-04-25T09:02:51.039060+0000","last_unstale":"2024-04-25T09:02:57.463579+0000","last_undegraded":"2024-04-25T09:02:57.463579+0000","last_fullsized":"2024-04-25T09:02:57.463579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:10.816735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789576+0000","last_change":"2024-04-25T09:02:52.044042+0000","last_active":"2024-04-25T09:02:57.789576+0000","last_peered":"2024-04-25T09:02:57.789576+0000","last_clean":"2024-04-25T09:02:57.789576+0000","last_became_active":"2024-04-25T09:02:52.043778+0000","last_became_peered":"2024-04-25T09:02:52.043778+0000","last_unstale":"2024-04-25T09:02:57.789576+0000","last_undegraded":"2024-04-25T09:02:57.789576+0000","last_fullsized":"2024-04-25T09:02:57.789576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:26.546220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056862+0000","last_change":"2024-04-25T09:02:56.059675+0000","last_active":"2024-04-25T09:02:57.056862+0000","last_peered":"2024-04-25T09:02:57.056862+0000","last_clean":"2024-04-25T09:02:57.056862+0000","last_became_active":"2024-04-25T09:02:56.059072+0000","last_became_peered":"2024-04-25T09:02:56.059072+0000","last_unstale":"2024-04-25T09:02:57.056862+0000","last_undegraded":"2024-04-25T09:02:57.056862+0000","last_fullsized":"2024-04-25T09:02:57.056862+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:52.449268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056039+0000","last_change":"2024-04-25T09:02:52.039240+0000","last_active":"2024-04-25T09:02:57.056039+0000","last_peered":"2024-04-25T09:02:57.056039+0000","last_clean":"2024-04-25T09:02:57.056039+0000","last_became_active":"2024-04-25T09:02:52.038915+0000","last_became_peered":"2024-04-25T09:02:52.038915+0000","last_unstale":"2024-04-25T09:02:57.056039+0000","last_undegraded":"2024-04-25T09:02:57.056039+0000","last_fullsized":"2024-04-25T09:02:57.056039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:50.011705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463598+0000","last_change":"2024-04-25T09:02:51.035156+0000","last_active":"2024-04-25T09:02:57.463598+0000","last_peered":"2024-04-25T09:02:57.463598+0000","last_clean":"2024-04-25T09:02:57.463598+0000","last_became_active":"2024-04-25T09:02:51.034850+0000","last_became_peered":"2024-04-25T09:02:51.034850+0000","last_unstale":"2024-04-25T09:02:57.463598+0000","last_undegraded":"2024-04-25T09:02:57.463598+0000","last_fullsized":"2024-04-25T09:02:57.463598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:28.429925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057297+0000","last_change":"2024-04-25T09:02:56.072225+0000","last_active":"2024-04-25T09:02:57.057297+0000","last_peered":"2024-04-25T09:02:57.057297+0000","last_clean":"2024-04-25T09:02:57.057297+0000","last_became_active":"2024-04-25T09:02:56.071794+0000","last_became_peered":"2024-04-25T09:02:56.071794+0000","last_unstale":"2024-04-25T09:02:57.057297+0000","last_undegraded":"2024-04-25T09:02:57.057297+0000","last_fullsized":"2024-04-25T09:02:57.057297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:56.656194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053726+0000","last_change":"2024-04-25T09:02:52.043448+0000","last_active":"2024-04-25T09:02:57.053726+0000","last_peered":"2024-04-25T09:02:57.053726+0000","last_clean":"2024-04-25T09:02:57.053726+0000","last_became_active":"2024-04-25T09:02:52.033650+0000","last_became_peered":"2024-04-25T09:02:52.033650+0000","last_unstale":"2024-04-25T09:02:57.053726+0000","last_undegraded":"2024-04-25T09:02:57.053726+0000","last_fullsized":"2024-04-25T09:02:57.053726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:29.002911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790926+0000","last_change":"2024-04-25T09:02:51.026371+0000","last_active":"2024-04-25T09:02:57.790926+0000","last_peered":"2024-04-25T09:02:57.790926+0000","last_clean":"2024-04-25T09:02:57.790926+0000","last_became_active":"2024-04-25T09:02:51.025867+0000","last_became_peered":"2024-04-25T09:02:51.025867+0000","last_unstale":"2024-04-25T09:02:57.790926+0000","last_undegraded":"2024-04-25T09:02:57.790926+0000","last_fullsized":"2024-04-25T09:02:57.790926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:47.372516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057366+0000","last_change":"2024-04-25T09:02:56.076638+0000","last_active":"2024-04-25T09:02:57.057366+0000","last_peered":"2024-04-25T09:02:57.057366+0000","last_clean":"2024-04-25T09:02:57.057366+0000","last_became_active":"2024-04-25T09:02:56.076208+0000","last_became_peered":"2024-04-25T09:02:56.076208+0000","last_unstale":"2024-04-25T09:02:57.057366+0000","last_undegraded":"2024-04-25T09:02:57.057366+0000","last_fullsized":"2024-04-25T09:02:57.057366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:04.686109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053630+0000","last_change":"2024-04-25T09:02:52.043808+0000","last_active":"2024-04-25T09:02:57.053630+0000","last_peered":"2024-04-25T09:02:57.053630+0000","last_clean":"2024-04-25T09:02:57.053630+0000","last_became_active":"2024-04-25T09:02:52.033729+0000","last_became_peered":"2024-04-25T09:02:52.033729+0000","last_unstale":"2024-04-25T09:02:57.053630+0000","last_undegraded":"2024-04-25T09:02:57.053630+0000","last_fullsized":"2024-04-25T09:02:57.053630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:50.625187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790413+0000","last_change":"2024-04-25T09:02:51.025228+0000","last_active":"2024-04-25T09:02:57.790413+0000","last_peered":"2024-04-25T09:02:57.790413+0000","last_clean":"2024-04-25T09:02:57.790413+0000","last_became_active":"2024-04-25T09:02:51.024784+0000","last_became_peered":"2024-04-25T09:02:51.024784+0000","last_unstale":"2024-04-25T09:02:57.790413+0000","last_undegraded":"2024-04-25T09:02:57.790413+0000","last_fullsized":"2024-04-25T09:02:57.790413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:59.734686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791571+0000","last_change":"2024-04-25T09:02:56.299771+0000","last_active":"2024-04-25T09:02:57.791571+0000","last_peered":"2024-04-25T09:02:57.791571+0000","last_clean":"2024-04-25T09:02:57.791571+0000","last_became_active":"2024-04-25T09:02:56.299239+0000","last_became_peered":"2024-04-25T09:02:56.299239+0000","last_unstale":"2024-04-25T09:02:57.791571+0000","last_undegraded":"2024-04-25T09:02:57.791571+0000","last_fullsized":"2024-04-25T09:02:57.791571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:30.366155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056839+0000","last_change":"2024-04-25T09:02:52.027108+0000","last_active":"2024-04-25T09:02:57.056839+0000","last_peered":"2024-04-25T09:02:57.056839+0000","last_clean":"2024-04-25T09:02:57.056839+0000","last_became_active":"2024-04-25T09:02:52.026183+0000","last_became_peered":"2024-04-25T09:02:52.026183+0000","last_unstale":"2024-04-25T09:02:57.056839+0000","last_undegraded":"2024-04-25T09:02:57.056839+0000","last_fullsized":"2024-04-25T09:02:57.056839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:38.122849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463146+0000","last_change":"2024-04-25T09:02:51.040204+0000","last_active":"2024-04-25T09:02:57.463146+0000","last_peered":"2024-04-25T09:02:57.463146+0000","last_clean":"2024-04-25T09:02:57.463146+0000","last_became_active":"2024-04-25T09:02:51.039917+0000","last_became_peered":"2024-04-25T09:02:51.039917+0000","last_unstale":"2024-04-25T09:02:57.463146+0000","last_undegraded":"2024-04-25T09:02:57.463146+0000","last_fullsized":"2024-04-25T09:02:57.463146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057220+0000","last_change":"2024-04-25T09:02:56.072634+0000","last_active":"2024-04-25T09:02:57.057220+0000","last_peered":"2024-04-25T09:02:57.057220+0000","last_clean":"2024-04-25T09:02:57.057220+0000","last_became_active":"2024-04-25T09:02:56.072077+0000","last_became_peered":"2024-04-25T09:02:56.072077+0000","last_unstale":"2024-04-25T09:02:57.057220+0000","last_undegraded":"2024-04-25T09:02:57.057220+0000","last_fullsized":"2024-04-25T09:02:57.057220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:39.318314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790520+0000","last_change":"2024-04-25T09:02:52.024632+0000","last_active":"2024-04-25T09:02:57.790520+0000","last_peered":"2024-04-25T09:02:57.790520+0000","last_clean":"2024-04-25T09:02:57.790520+0000","last_became_active":"2024-04-25T09:02:52.024337+0000","last_became_peered":"2024-04-25T09:02:52.024337+0000","last_unstale":"2024-04-25T09:02:57.790520+0000","last_undegraded":"2024-04-25T09:02:57.790520+0000","last_fullsized":"2024-04-25T09:02:57.790520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:11.410261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057823+0000","last_change":"2024-04-25T09:02:51.024573+0000","last_active":"2024-04-25T09:02:57.057823+0000","last_peered":"2024-04-25T09:02:57.057823+0000","last_clean":"2024-04-25T09:02:57.057823+0000","last_became_active":"2024-04-25T09:02:51.024252+0000","last_became_peered":"2024-04-25T09:02:51.024252+0000","last_unstale":"2024-04-25T09:02:57.057823+0000","last_undegraded":"2024-04-25T09:02:57.057823+0000","last_fullsized":"2024-04-25T09:02:57.057823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:53.131752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056610+0000","last_change":"2024-04-25T09:02:56.295449+0000","last_active":"2024-04-25T09:02:57.056610+0000","last_peered":"2024-04-25T09:02:57.056610+0000","last_clean":"2024-04-25T09:02:57.056610+0000","last_became_active":"2024-04-25T09:02:56.294711+0000","last_became_peered":"2024-04-25T09:02:56.294711+0000","last_unstale":"2024-04-25T09:02:57.056610+0000","last_undegraded":"2024-04-25T09:02:57.056610+0000","last_fullsized":"2024-04-25T09:02:57.056610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:56.463100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054253+0000","last_change":"2024-04-25T09:02:52.046777+0000","last_active":"2024-04-25T09:02:57.054253+0000","last_peered":"2024-04-25T09:02:57.054253+0000","last_clean":"2024-04-25T09:02:57.054253+0000","last_became_active":"2024-04-25T09:02:52.046489+0000","last_became_peered":"2024-04-25T09:02:52.046489+0000","last_unstale":"2024-04-25T09:02:57.054253+0000","last_undegraded":"2024-04-25T09:02:57.054253+0000","last_fullsized":"2024-04-25T09:02:57.054253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:22.709330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791497+0000","last_change":"2024-04-25T09:02:51.027246+0000","last_active":"2024-04-25T09:02:57.791497+0000","last_peered":"2024-04-25T09:02:57.791497+0000","last_clean":"2024-04-25T09:02:57.791497+0000","last_became_active":"2024-04-25T09:02:51.026818+0000","last_became_peered":"2024-04-25T09:02:51.026818+0000","last_unstale":"2024-04-25T09:02:57.791497+0000","last_undegraded":"2024-04-25T09:02:57.791497+0000","last_fullsized":"2024-04-25T09:02:57.791497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:28.429925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053445+0000","last_change":"2024-04-25T09:02:56.295657+0000","last_active":"2024-04-25T09:02:57.053445+0000","last_peered":"2024-04-25T09:02:57.053445+0000","last_clean":"2024-04-25T09:02:57.053445+0000","last_became_active":"2024-04-25T09:02:56.295288+0000","last_became_peered":"2024-04-25T09:02:56.295288+0000","last_unstale":"2024-04-25T09:02:57.053445+0000","last_undegraded":"2024-04-25T09:02:57.053445+0000","last_fullsized":"2024-04-25T09:02:57.053445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:58.529283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791110+0000","last_change":"2024-04-25T09:02:52.024086+0000","last_active":"2024-04-25T09:02:57.791110+0000","last_peered":"2024-04-25T09:02:57.791110+0000","last_clean":"2024-04-25T09:02:57.791110+0000","last_became_active":"2024-04-25T09:02:52.023818+0000","last_became_peered":"2024-04-25T09:02:52.023818+0000","last_unstale":"2024-04-25T09:02:57.791110+0000","last_undegraded":"2024-04-25T09:02:57.791110+0000","last_fullsized":"2024-04-25T09:02:57.791110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:17.240659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463957+0000","last_change":"2024-04-25T09:02:51.040279+0000","last_active":"2024-04-25T09:02:57.463957+0000","last_peered":"2024-04-25T09:02:57.463957+0000","last_clean":"2024-04-25T09:02:57.463957+0000","last_became_active":"2024-04-25T09:02:51.039948+0000","last_became_peered":"2024-04-25T09:02:51.039948+0000","last_unstale":"2024-04-25T09:02:57.463957+0000","last_undegraded":"2024-04-25T09:02:57.463957+0000","last_fullsized":"2024-04-25T09:02:57.463957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:51.667591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789802+0000","last_change":"2024-04-25T09:02:56.293761+0000","last_active":"2024-04-25T09:02:57.789802+0000","last_peered":"2024-04-25T09:02:57.789802+0000","last_clean":"2024-04-25T09:02:57.789802+0000","last_became_active":"2024-04-25T09:02:56.293350+0000","last_became_peered":"2024-04-25T09:02:56.293350+0000","last_unstale":"2024-04-25T09:02:57.789802+0000","last_undegraded":"2024-04-25T09:02:57.789802+0000","last_fullsized":"2024-04-25T09:02:57.789802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:26.744246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789708+0000","last_change":"2024-04-25T09:02:52.052084+0000","last_active":"2024-04-25T09:02:57.789708+0000","last_peered":"2024-04-25T09:02:57.789708+0000","last_clean":"2024-04-25T09:02:57.789708+0000","last_became_active":"2024-04-25T09:02:52.051875+0000","last_became_peered":"2024-04-25T09:02:52.051875+0000","last_unstale":"2024-04-25T09:02:57.789708+0000","last_undegraded":"2024-04-25T09:02:57.789708+0000","last_fullsized":"2024-04-25T09:02:57.789708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:48.909107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791211+0000","last_change":"2024-04-25T09:02:51.032759+0000","last_active":"2024-04-25T09:02:57.791211+0000","last_peered":"2024-04-25T09:02:57.791211+0000","last_clean":"2024-04-25T09:02:57.791211+0000","last_became_active":"2024-04-25T09:02:51.032451+0000","last_became_peered":"2024-04-25T09:02:51.032451+0000","last_unstale":"2024-04-25T09:02:57.791211+0000","last_undegraded":"2024-04-25T09:02:57.791211+0000","last_fullsized":"2024-04-25T09:02:57.791211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:36.866575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790558+0000","last_change":"2024-04-25T09:02:56.070268+0000","last_active":"2024-04-25T09:02:57.790558+0000","last_peered":"2024-04-25T09:02:57.790558+0000","last_clean":"2024-04-25T09:02:57.790558+0000","last_became_active":"2024-04-25T09:02:56.069905+0000","last_became_peered":"2024-04-25T09:02:56.069905+0000","last_unstale":"2024-04-25T09:02:57.790558+0000","last_undegraded":"2024-04-25T09:02:57.790558+0000","last_fullsized":"2024-04-25T09:02:57.790558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:07.888490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057540+0000","last_change":"2024-04-25T09:02:52.034123+0000","last_active":"2024-04-25T09:02:57.057540+0000","last_peered":"2024-04-25T09:02:57.057540+0000","last_clean":"2024-04-25T09:02:57.057540+0000","last_became_active":"2024-04-25T09:02:52.033807+0000","last_became_peered":"2024-04-25T09:02:52.033807+0000","last_unstale":"2024-04-25T09:02:57.057540+0000","last_undegraded":"2024-04-25T09:02:57.057540+0000","last_fullsized":"2024-04-25T09:02:57.057540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:41.419260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789451+0000","last_change":"2024-04-25T09:02:51.026247+0000","last_active":"2024-04-25T09:02:57.789451+0000","last_peered":"2024-04-25T09:02:57.789451+0000","last_clean":"2024-04-25T09:02:57.789451+0000","last_became_active":"2024-04-25T09:02:51.025939+0000","last_became_peered":"2024-04-25T09:02:51.025939+0000","last_unstale":"2024-04-25T09:02:57.789451+0000","last_undegraded":"2024-04-25T09:02:57.789451+0000","last_fullsized":"2024-04-25T09:02:57.789451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:40.409805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791583+0000","last_change":"2024-04-25T09:02:56.076058+0000","last_active":"2024-04-25T09:02:57.791583+0000","last_peered":"2024-04-25T09:02:57.791583+0000","last_clean":"2024-04-25T09:02:57.791583+0000","last_became_active":"2024-04-25T09:02:56.075606+0000","last_became_peered":"2024-04-25T09:02:56.075606+0000","last_unstale":"2024-04-25T09:02:57.791583+0000","last_undegraded":"2024-04-25T09:02:57.791583+0000","last_fullsized":"2024-04-25T09:02:57.791583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:59.234505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790128+0000","last_change":"2024-04-25T09:02:52.024371+0000","last_active":"2024-04-25T09:02:57.790128+0000","last_peered":"2024-04-25T09:02:57.790128+0000","last_clean":"2024-04-25T09:02:57.790128+0000","last_became_active":"2024-04-25T09:02:52.023814+0000","last_became_peered":"2024-04-25T09:02:52.023814+0000","last_unstale":"2024-04-25T09:02:57.790128+0000","last_undegraded":"2024-04-25T09:02:57.790128+0000","last_fullsized":"2024-04-25T09:02:57.790128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:29.446381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789453+0000","last_change":"2024-04-25T09:02:51.027475+0000","last_active":"2024-04-25T09:02:57.789453+0000","last_peered":"2024-04-25T09:02:57.789453+0000","last_clean":"2024-04-25T09:02:57.789453+0000","last_became_active":"2024-04-25T09:02:51.027212+0000","last_became_peered":"2024-04-25T09:02:51.027212+0000","last_unstale":"2024-04-25T09:02:57.789453+0000","last_undegraded":"2024-04-25T09:02:57.789453+0000","last_fullsized":"2024-04-25T09:02:57.789453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:23.500507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791716+0000","last_change":"2024-04-25T09:02:56.066697+0000","last_active":"2024-04-25T09:02:57.791716+0000","last_peered":"2024-04-25T09:02:57.791716+0000","last_clean":"2024-04-25T09:02:57.791716+0000","last_became_active":"2024-04-25T09:02:56.063130+0000","last_became_peered":"2024-04-25T09:02:56.063130+0000","last_unstale":"2024-04-25T09:02:57.791716+0000","last_undegraded":"2024-04-25T09:02:57.791716+0000","last_fullsized":"2024-04-25T09:02:57.791716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:11.878208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789276+0000","last_change":"2024-04-25T09:02:52.037980+0000","last_active":"2024-04-25T09:02:57.789276+0000","last_peered":"2024-04-25T09:02:57.789276+0000","last_clean":"2024-04-25T09:02:57.789276+0000","last_became_active":"2024-04-25T09:02:52.037671+0000","last_became_peered":"2024-04-25T09:02:52.037671+0000","last_unstale":"2024-04-25T09:02:57.789276+0000","last_undegraded":"2024-04-25T09:02:57.789276+0000","last_fullsized":"2024-04-25T09:02:57.789276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:52.677046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463133+0000","last_change":"2024-04-25T09:02:51.032936+0000","last_active":"2024-04-25T09:02:57.463133+0000","last_peered":"2024-04-25T09:02:57.463133+0000","last_clean":"2024-04-25T09:02:57.463133+0000","last_became_active":"2024-04-25T09:02:51.032657+0000","last_became_peered":"2024-04-25T09:02:51.032657+0000","last_unstale":"2024-04-25T09:02:57.463133+0000","last_undegraded":"2024-04-25T09:02:57.463133+0000","last_fullsized":"2024-04-25T09:02:57.463133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:59.734686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790555+0000","last_change":"2024-04-25T09:02:56.297045+0000","last_active":"2024-04-25T09:02:57.790555+0000","last_peered":"2024-04-25T09:02:57.790555+0000","last_clean":"2024-04-25T09:02:57.790555+0000","last_became_active":"2024-04-25T09:02:56.295073+0000","last_became_peered":"2024-04-25T09:02:56.295073+0000","last_unstale":"2024-04-25T09:02:57.790555+0000","last_undegraded":"2024-04-25T09:02:57.790555+0000","last_fullsized":"2024-04-25T09:02:57.790555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:59.234505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053279+0000","last_change":"2024-04-25T09:02:52.038658+0000","last_active":"2024-04-25T09:02:57.053279+0000","last_peered":"2024-04-25T09:02:57.053279+0000","last_clean":"2024-04-25T09:02:57.053279+0000","last_became_active":"2024-04-25T09:02:52.033684+0000","last_became_peered":"2024-04-25T09:02:52.033684+0000","last_unstale":"2024-04-25T09:02:57.053279+0000","last_undegraded":"2024-04-25T09:02:57.053279+0000","last_fullsized":"2024-04-25T09:02:57.053279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:11.410261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789342+0000","last_change":"2024-04-25T09:02:51.023038+0000","last_active":"2024-04-25T09:02:57.789342+0000","last_peered":"2024-04-25T09:02:57.789342+0000","last_clean":"2024-04-25T09:02:57.789342+0000","last_became_active":"2024-04-25T09:02:51.019222+0000","last_became_peered":"2024-04-25T09:02:51.019222+0000","last_unstale":"2024-04-25T09:02:57.789342+0000","last_undegraded":"2024-04-25T09:02:57.789342+0000","last_fullsized":"2024-04-25T09:02:57.789342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:00.953314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463292+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:02:57.463292+0000","last_peered":"2024-04-25T09:02:57.463292+0000","last_clean":"2024-04-25T09:02:57.463292+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:02:57.463292+0000","last_undegraded":"2024-04-25T09:02:57.463292+0000","last_fullsized":"2024-04-25T09:02:57.463292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056417+0000","last_change":"2024-04-25T09:02:56.295692+0000","last_active":"2024-04-25T09:02:57.056417+0000","last_peered":"2024-04-25T09:02:57.056417+0000","last_clean":"2024-04-25T09:02:57.056417+0000","last_became_active":"2024-04-25T09:02:56.295209+0000","last_became_peered":"2024-04-25T09:02:56.295209+0000","last_unstale":"2024-04-25T09:02:57.056417+0000","last_undegraded":"2024-04-25T09:02:57.056417+0000","last_fullsized":"2024-04-25T09:02:57.056417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:52.944023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463642+0000","last_change":"2024-04-25T09:02:52.049009+0000","last_active":"2024-04-25T09:02:57.463642+0000","last_peered":"2024-04-25T09:02:57.463642+0000","last_clean":"2024-04-25T09:02:57.463642+0000","last_became_active":"2024-04-25T09:02:52.048541+0000","last_became_peered":"2024-04-25T09:02:52.048541+0000","last_unstale":"2024-04-25T09:02:57.463642+0000","last_undegraded":"2024-04-25T09:02:57.463642+0000","last_fullsized":"2024-04-25T09:02:57.463642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:03.853574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790093+0000","last_change":"2024-04-25T09:02:51.023326+0000","last_active":"2024-04-25T09:02:57.790093+0000","last_peered":"2024-04-25T09:02:57.790093+0000","last_clean":"2024-04-25T09:02:57.790093+0000","last_became_active":"2024-04-25T09:02:51.022096+0000","last_became_peered":"2024-04-25T09:02:51.022096+0000","last_unstale":"2024-04-25T09:02:57.790093+0000","last_undegraded":"2024-04-25T09:02:57.790093+0000","last_fullsized":"2024-04-25T09:02:57.790093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:47.372516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.055988+0000","last_change":"2024-04-25T09:02:56.295505+0000","last_active":"2024-04-25T09:02:57.055988+0000","last_peered":"2024-04-25T09:02:57.055988+0000","last_clean":"2024-04-25T09:02:57.055988+0000","last_became_active":"2024-04-25T09:02:56.295096+0000","last_became_peered":"2024-04-25T09:02:56.295096+0000","last_unstale":"2024-04-25T09:02:57.055988+0000","last_undegraded":"2024-04-25T09:02:57.055988+0000","last_fullsized":"2024-04-25T09:02:57.055988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:30.581136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789515+0000","last_change":"2024-04-25T09:02:52.036763+0000","last_active":"2024-04-25T09:02:57.789515+0000","last_peered":"2024-04-25T09:02:57.789515+0000","last_clean":"2024-04-25T09:02:57.789515+0000","last_became_active":"2024-04-25T09:02:52.035834+0000","last_became_peered":"2024-04-25T09:02:52.035834+0000","last_unstale":"2024-04-25T09:02:57.789515+0000","last_undegraded":"2024-04-25T09:02:57.789515+0000","last_fullsized":"2024-04-25T09:02:57.789515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:42.264135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791361+0000","last_change":"2024-04-25T09:02:51.016550+0000","last_active":"2024-04-25T09:02:57.791361+0000","last_peered":"2024-04-25T09:02:57.791361+0000","last_clean":"2024-04-25T09:02:57.791361+0000","last_became_active":"2024-04-25T09:02:51.016306+0000","last_became_peered":"2024-04-25T09:02:51.016306+0000","last_unstale":"2024-04-25T09:02:57.791361+0000","last_undegraded":"2024-04-25T09:02:57.791361+0000","last_fullsized":"2024-04-25T09:02:57.791361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:09.906967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789915+0000","last_change":"2024-04-25T09:02:56.072785+0000","last_active":"2024-04-25T09:02:57.789915+0000","last_peered":"2024-04-25T09:02:57.789915+0000","last_clean":"2024-04-25T09:02:57.789915+0000","last_became_active":"2024-04-25T09:02:56.072306+0000","last_became_peered":"2024-04-25T09:02:56.072306+0000","last_unstale":"2024-04-25T09:02:57.789915+0000","last_undegraded":"2024-04-25T09:02:57.789915+0000","last_fullsized":"2024-04-25T09:02:57.789915+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:07.888490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.464063+0000","last_change":"2024-04-25T09:02:52.056902+0000","last_active":"2024-04-25T09:02:57.464063+0000","last_peered":"2024-04-25T09:02:57.464063+0000","last_clean":"2024-04-25T09:02:57.464063+0000","last_became_active":"2024-04-25T09:02:52.056597+0000","last_became_peered":"2024-04-25T09:02:52.056597+0000","last_unstale":"2024-04-25T09:02:57.464063+0000","last_undegraded":"2024-04-25T09:02:57.464063+0000","last_fullsized":"2024-04-25T09:02:57.464063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:29.173421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790787+0000","last_change":"2024-04-25T09:02:51.028470+0000","last_active":"2024-04-25T09:02:57.790787+0000","last_peered":"2024-04-25T09:02:57.790787+0000","last_clean":"2024-04-25T09:02:57.790787+0000","last_became_active":"2024-04-25T09:02:51.028151+0000","last_became_peered":"2024-04-25T09:02:51.028151+0000","last_unstale":"2024-04-25T09:02:57.790787+0000","last_undegraded":"2024-04-25T09:02:57.790787+0000","last_fullsized":"2024-04-25T09:02:57.790787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:36.866575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789052+0000","last_change":"2024-04-25T09:02:56.295226+0000","last_active":"2024-04-25T09:02:57.789052+0000","last_peered":"2024-04-25T09:02:57.789052+0000","last_clean":"2024-04-25T09:02:57.789052+0000","last_became_active":"2024-04-25T09:02:56.294800+0000","last_became_peered":"2024-04-25T09:02:56.294800+0000","last_unstale":"2024-04-25T09:02:57.789052+0000","last_undegraded":"2024-04-25T09:02:57.789052+0000","last_fullsized":"2024-04-25T09:02:57.789052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:58.795884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463945+0000","last_change":"2024-04-25T09:02:52.052984+0000","last_active":"2024-04-25T09:02:57.463945+0000","last_peered":"2024-04-25T09:02:57.463945+0000","last_clean":"2024-04-25T09:02:57.463945+0000","last_became_active":"2024-04-25T09:02:52.051829+0000","last_became_peered":"2024-04-25T09:02:52.051829+0000","last_unstale":"2024-04-25T09:02:57.463945+0000","last_undegraded":"2024-04-25T09:02:57.463945+0000","last_fullsized":"2024-04-25T09:02:57.463945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:55.199589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057574+0000","last_change":"2024-04-25T09:02:51.031885+0000","last_active":"2024-04-25T09:02:57.057574+0000","last_peered":"2024-04-25T09:02:57.057574+0000","last_clean":"2024-04-25T09:02:57.057574+0000","last_became_active":"2024-04-25T09:02:51.031618+0000","last_became_peered":"2024-04-25T09:02:51.031618+0000","last_unstale":"2024-04-25T09:02:57.057574+0000","last_undegraded":"2024-04-25T09:02:57.057574+0000","last_fullsized":"2024-04-25T09:02:57.057574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:41.667025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056391+0000","last_change":"2024-04-25T09:02:56.076568+0000","last_active":"2024-04-25T09:02:57.056391+0000","last_peered":"2024-04-25T09:02:57.056391+0000","last_clean":"2024-04-25T09:02:57.056391+0000","last_became_active":"2024-04-25T09:02:56.076131+0000","last_became_peered":"2024-04-25T09:02:56.076131+0000","last_unstale":"2024-04-25T09:02:57.056391+0000","last_undegraded":"2024-04-25T09:02:57.056391+0000","last_fullsized":"2024-04-25T09:02:57.056391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:43.097216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463302+0000","last_change":"2024-04-25T09:02:52.045786+0000","last_active":"2024-04-25T09:02:57.463302+0000","last_peered":"2024-04-25T09:02:57.463302+0000","last_clean":"2024-04-25T09:02:57.463302+0000","last_became_active":"2024-04-25T09:02:52.045116+0000","last_became_peered":"2024-04-25T09:02:52.045116+0000","last_unstale":"2024-04-25T09:02:57.463302+0000","last_undegraded":"2024-04-25T09:02:57.463302+0000","last_fullsized":"2024-04-25T09:02:57.463302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:29.002911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790256+0000","last_change":"2024-04-25T09:02:51.010840+0000","last_active":"2024-04-25T09:02:57.790256+0000","last_peered":"2024-04-25T09:02:57.790256+0000","last_clean":"2024-04-25T09:02:57.790256+0000","last_became_active":"2024-04-25T09:02:51.010562+0000","last_became_peered":"2024-04-25T09:02:51.010562+0000","last_unstale":"2024-04-25T09:02:57.790256+0000","last_undegraded":"2024-04-25T09:02:57.790256+0000","last_fullsized":"2024-04-25T09:02:57.790256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:52.829970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790256+0000","last_change":"2024-04-25T09:02:56.062496+0000","last_active":"2024-04-25T09:02:57.790256+0000","last_peered":"2024-04-25T09:02:57.790256+0000","last_clean":"2024-04-25T09:02:57.790256+0000","last_became_active":"2024-04-25T09:02:56.061695+0000","last_became_peered":"2024-04-25T09:02:56.061695+0000","last_unstale":"2024-04-25T09:02:57.790256+0000","last_undegraded":"2024-04-25T09:02:57.790256+0000","last_fullsized":"2024-04-25T09:02:57.790256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:52.333199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056444+0000","last_change":"2024-04-25T09:02:52.035521+0000","last_active":"2024-04-25T09:02:57.056444+0000","last_peered":"2024-04-25T09:02:57.056444+0000","last_clean":"2024-04-25T09:02:57.056444+0000","last_became_active":"2024-04-25T09:02:52.035166+0000","last_became_peered":"2024-04-25T09:02:52.035166+0000","last_unstale":"2024-04-25T09:02:57.056444+0000","last_undegraded":"2024-04-25T09:02:57.056444+0000","last_fullsized":"2024-04-25T09:02:57.056444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:15.470271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.055747+0000","last_change":"2024-04-25T09:02:51.026637+0000","last_active":"2024-04-25T09:02:57.055747+0000","last_peered":"2024-04-25T09:02:57.055747+0000","last_clean":"2024-04-25T09:02:57.055747+0000","last_became_active":"2024-04-25T09:02:51.026370+0000","last_became_peered":"2024-04-25T09:02:51.026370+0000","last_unstale":"2024-04-25T09:02:57.055747+0000","last_undegraded":"2024-04-25T09:02:57.055747+0000","last_fullsized":"2024-04-25T09:02:57.055747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:00.953314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054223+0000","last_change":"2024-04-25T09:02:56.296384+0000","last_active":"2024-04-25T09:02:57.054223+0000","last_peered":"2024-04-25T09:02:57.054223+0000","last_clean":"2024-04-25T09:02:57.054223+0000","last_became_active":"2024-04-25T09:02:56.295883+0000","last_became_peered":"2024-04-25T09:02:56.295883+0000","last_unstale":"2024-04-25T09:02:57.054223+0000","last_undegraded":"2024-04-25T09:02:57.054223+0000","last_fullsized":"2024-04-25T09:02:57.054223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:00.209106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463590+0000","last_change":"2024-04-25T09:02:52.048294+0000","last_active":"2024-04-25T09:02:57.463590+0000","last_peered":"2024-04-25T09:02:57.463590+0000","last_clean":"2024-04-25T09:02:57.463590+0000","last_became_active":"2024-04-25T09:02:52.048002+0000","last_became_peered":"2024-04-25T09:02:52.048002+0000","last_unstale":"2024-04-25T09:02:57.463590+0000","last_undegraded":"2024-04-25T09:02:57.463590+0000","last_fullsized":"2024-04-25T09:02:57.463590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:09.375365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789346+0000","last_change":"2024-04-25T09:02:51.029612+0000","last_active":"2024-04-25T09:02:57.789346+0000","last_peered":"2024-04-25T09:02:57.789346+0000","last_clean":"2024-04-25T09:02:57.789346+0000","last_became_active":"2024-04-25T09:02:51.026917+0000","last_became_peered":"2024-04-25T09:02:51.026917+0000","last_unstale":"2024-04-25T09:02:57.789346+0000","last_undegraded":"2024-04-25T09:02:57.789346+0000","last_fullsized":"2024-04-25T09:02:57.789346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:37.113394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053975+0000","last_change":"2024-04-25T09:02:56.296436+0000","last_active":"2024-04-25T09:02:57.053975+0000","last_peered":"2024-04-25T09:02:57.053975+0000","last_clean":"2024-04-25T09:02:57.053975+0000","last_became_active":"2024-04-25T09:02:56.295723+0000","last_became_peered":"2024-04-25T09:02:56.295723+0000","last_unstale":"2024-04-25T09:02:57.053975+0000","last_undegraded":"2024-04-25T09:02:57.053975+0000","last_fullsized":"2024-04-25T09:02:57.053975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:23.747770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789579+0000","last_change":"2024-04-25T09:02:52.032064+0000","last_active":"2024-04-25T09:02:57.789579+0000","last_peered":"2024-04-25T09:02:57.789579+0000","last_clean":"2024-04-25T09:02:57.789579+0000","last_became_active":"2024-04-25T09:02:52.031817+0000","last_became_peered":"2024-04-25T09:02:52.031817+0000","last_unstale":"2024-04-25T09:02:57.789579+0000","last_undegraded":"2024-04-25T09:02:57.789579+0000","last_fullsized":"2024-04-25T09:02:57.789579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:30.389641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789972+0000","last_change":"2024-04-25T09:02:51.036904+0000","last_active":"2024-04-25T09:02:57.789972+0000","last_peered":"2024-04-25T09:02:57.789972+0000","last_clean":"2024-04-25T09:02:57.789972+0000","last_became_active":"2024-04-25T09:02:51.036647+0000","last_became_peered":"2024-04-25T09:02:51.036647+0000","last_unstale":"2024-04-25T09:02:57.789972+0000","last_undegraded":"2024-04-25T09:02:57.789972+0000","last_fullsized":"2024-04-25T09:02:57.789972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:53.609696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789625+0000","last_change":"2024-04-25T09:02:56.297201+0000","last_active":"2024-04-25T09:02:57.789625+0000","last_peered":"2024-04-25T09:02:57.789625+0000","last_clean":"2024-04-25T09:02:57.789625+0000","last_became_active":"2024-04-25T09:02:56.296775+0000","last_became_peered":"2024-04-25T09:02:56.296775+0000","last_unstale":"2024-04-25T09:02:57.789625+0000","last_undegraded":"2024-04-25T09:02:57.789625+0000","last_fullsized":"2024-04-25T09:02:57.789625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:27:21.244707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463541+0000","last_change":"2024-04-25T09:02:52.048354+0000","last_active":"2024-04-25T09:02:57.463541+0000","last_peered":"2024-04-25T09:02:57.463541+0000","last_clean":"2024-04-25T09:02:57.463541+0000","last_became_active":"2024-04-25T09:02:52.048051+0000","last_became_peered":"2024-04-25T09:02:52.048051+0000","last_unstale":"2024-04-25T09:02:57.463541+0000","last_undegraded":"2024-04-25T09:02:57.463541+0000","last_fullsized":"2024-04-25T09:02:57.463541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:22.709330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:03:02.599373+0000","last_change":"2024-04-25T09:02:51.025093+0000","last_active":"2024-04-25T09:03:02.599373+0000","last_peered":"2024-04-25T09:03:02.599373+0000","last_clean":"2024-04-25T09:03:02.599373+0000","last_became_active":"2024-04-25T09:02:51.024835+0000","last_became_peered":"2024-04-25T09:02:51.024835+0000","last_unstale":"2024-04-25T09:03:02.599373+0000","last_undegraded":"2024-04-25T09:03:02.599373+0000","last_fullsized":"2024-04-25T09:03:02.599373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:40.409805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790711+0000","last_change":"2024-04-25T09:02:56.072738+0000","last_active":"2024-04-25T09:02:57.790711+0000","last_peered":"2024-04-25T09:02:57.790711+0000","last_clean":"2024-04-25T09:02:57.790711+0000","last_became_active":"2024-04-25T09:02:56.072349+0000","last_became_peered":"2024-04-25T09:02:56.072349+0000","last_unstale":"2024-04-25T09:02:57.790711+0000","last_undegraded":"2024-04-25T09:02:57.790711+0000","last_fullsized":"2024-04-25T09:02:57.790711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:52.333199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057433+0000","last_change":"2024-04-25T09:02:52.030750+0000","last_active":"2024-04-25T09:02:57.057433+0000","last_peered":"2024-04-25T09:02:57.057433+0000","last_clean":"2024-04-25T09:02:57.057433+0000","last_became_active":"2024-04-25T09:02:52.030455+0000","last_became_peered":"2024-04-25T09:02:52.030455+0000","last_unstale":"2024-04-25T09:02:57.057433+0000","last_undegraded":"2024-04-25T09:02:57.057433+0000","last_fullsized":"2024-04-25T09:02:57.057433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:21.197671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791243+0000","last_change":"2024-04-25T09:02:51.020914+0000","last_active":"2024-04-25T09:02:57.791243+0000","last_peered":"2024-04-25T09:02:57.791243+0000","last_clean":"2024-04-25T09:02:57.791243+0000","last_became_active":"2024-04-25T09:02:51.020614+0000","last_became_peered":"2024-04-25T09:02:51.020614+0000","last_unstale":"2024-04-25T09:02:57.791243+0000","last_undegraded":"2024-04-25T09:02:57.791243+0000","last_fullsized":"2024-04-25T09:02:57.791243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:23.500507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057336+0000","last_change":"2024-04-25T09:02:56.072410+0000","last_active":"2024-04-25T09:02:57.057336+0000","last_peered":"2024-04-25T09:02:57.057336+0000","last_clean":"2024-04-25T09:02:57.057336+0000","last_became_active":"2024-04-25T09:02:56.071847+0000","last_became_peered":"2024-04-25T09:02:56.071847+0000","last_unstale":"2024-04-25T09:02:57.057336+0000","last_undegraded":"2024-04-25T09:02:57.057336+0000","last_fullsized":"2024-04-25T09:02:57.057336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:01.264766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790723+0000","last_change":"2024-04-25T09:02:52.045382+0000","last_active":"2024-04-25T09:02:57.790723+0000","last_peered":"2024-04-25T09:02:57.790723+0000","last_clean":"2024-04-25T09:02:57.790723+0000","last_became_active":"2024-04-25T09:02:52.045073+0000","last_became_peered":"2024-04-25T09:02:52.045073+0000","last_unstale":"2024-04-25T09:02:57.790723+0000","last_undegraded":"2024-04-25T09:02:57.790723+0000","last_fullsized":"2024-04-25T09:02:57.790723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:00.242892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789749+0000","last_change":"2024-04-25T09:02:51.030041+0000","last_active":"2024-04-25T09:02:57.789749+0000","last_peered":"2024-04-25T09:02:57.789749+0000","last_clean":"2024-04-25T09:02:57.789749+0000","last_became_active":"2024-04-25T09:02:51.028411+0000","last_became_peered":"2024-04-25T09:02:51.028411+0000","last_unstale":"2024-04-25T09:02:57.789749+0000","last_undegraded":"2024-04-25T09:02:57.789749+0000","last_fullsized":"2024-04-25T09:02:57.789749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:07.474980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053490+0000","last_change":"2024-04-25T09:02:56.077345+0000","last_active":"2024-04-25T09:02:57.053490+0000","last_peered":"2024-04-25T09:02:57.053490+0000","last_clean":"2024-04-25T09:02:57.053490+0000","last_became_active":"2024-04-25T09:02:56.076889+0000","last_became_peered":"2024-04-25T09:02:56.076889+0000","last_unstale":"2024-04-25T09:02:57.053490+0000","last_undegraded":"2024-04-25T09:02:57.053490+0000","last_fullsized":"2024-04-25T09:02:57.053490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:03.323090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789638+0000","last_change":"2024-04-25T09:02:52.057118+0000","last_active":"2024-04-25T09:02:57.789638+0000","last_peered":"2024-04-25T09:02:57.789638+0000","last_clean":"2024-04-25T09:02:57.789638+0000","last_became_active":"2024-04-25T09:02:52.056534+0000","last_became_peered":"2024-04-25T09:02:52.056534+0000","last_unstale":"2024-04-25T09:02:57.789638+0000","last_undegraded":"2024-04-25T09:02:57.789638+0000","last_fullsized":"2024-04-25T09:02:57.789638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:52.621278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057721+0000","last_change":"2024-04-25T09:02:51.031218+0000","last_active":"2024-04-25T09:02:57.057721+0000","last_peered":"2024-04-25T09:02:57.057721+0000","last_clean":"2024-04-25T09:02:57.057721+0000","last_became_active":"2024-04-25T09:02:51.030865+0000","last_became_peered":"2024-04-25T09:02:51.030865+0000","last_unstale":"2024-04-25T09:02:57.057721+0000","last_undegraded":"2024-04-25T09:02:57.057721+0000","last_fullsized":"2024-04-25T09:02:57.057721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:07.474980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053441+0000","last_change":"2024-04-25T09:02:56.299090+0000","last_active":"2024-04-25T09:02:57.053441+0000","last_peered":"2024-04-25T09:02:57.053441+0000","last_clean":"2024-04-25T09:02:57.053441+0000","last_became_active":"2024-04-25T09:02:56.298743+0000","last_became_peered":"2024-04-25T09:02:56.298743+0000","last_unstale":"2024-04-25T09:02:57.053441+0000","last_undegraded":"2024-04-25T09:02:57.053441+0000","last_fullsized":"2024-04-25T09:02:57.053441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:29.182136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790262+0000","last_change":"2024-04-25T09:02:56.295329+0000","last_active":"2024-04-25T09:02:57.790262+0000","last_peered":"2024-04-25T09:02:57.790262+0000","last_clean":"2024-04-25T09:02:57.790262+0000","last_became_active":"2024-04-25T09:02:56.294937+0000","last_became_peered":"2024-04-25T09:02:56.294937+0000","last_unstale":"2024-04-25T09:02:57.790262+0000","last_undegraded":"2024-04-25T09:02:57.790262+0000","last_fullsized":"2024-04-25T09:02:57.790262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:30.366155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790315+0000","last_change":"2024-04-25T09:02:52.025989+0000","last_active":"2024-04-25T09:02:57.790315+0000","last_peered":"2024-04-25T09:02:57.790315+0000","last_clean":"2024-04-25T09:02:57.790315+0000","last_became_active":"2024-04-25T09:02:52.025737+0000","last_became_peered":"2024-04-25T09:02:52.025737+0000","last_unstale":"2024-04-25T09:02:57.790315+0000","last_undegraded":"2024-04-25T09:02:57.790315+0000","last_fullsized":"2024-04-25T09:02:57.790315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:11.410261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789186+0000","last_change":"2024-04-25T09:02:51.024227+0000","last_active":"2024-04-25T09:02:57.789186+0000","last_peered":"2024-04-25T09:02:57.789186+0000","last_clean":"2024-04-25T09:02:57.789186+0000","last_became_active":"2024-04-25T09:02:51.023132+0000","last_became_peered":"2024-04-25T09:02:51.023132+0000","last_unstale":"2024-04-25T09:02:57.789186+0000","last_undegraded":"2024-04-25T09:02:57.789186+0000","last_fullsized":"2024-04-25T09:02:57.789186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:53.131752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057646+0000","last_change":"2024-04-25T09:02:56.067614+0000","last_active":"2024-04-25T09:02:57.057646+0000","last_peered":"2024-04-25T09:02:57.057646+0000","last_clean":"2024-04-25T09:02:57.057646+0000","last_became_active":"2024-04-25T09:02:56.067179+0000","last_became_peered":"2024-04-25T09:02:56.067179+0000","last_unstale":"2024-04-25T09:02:57.057646+0000","last_undegraded":"2024-04-25T09:02:57.057646+0000","last_fullsized":"2024-04-25T09:02:57.057646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:23.153554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053548+0000","last_change":"2024-04-25T09:02:52.043753+0000","last_active":"2024-04-25T09:02:57.053548+0000","last_peered":"2024-04-25T09:02:57.053548+0000","last_clean":"2024-04-25T09:02:57.053548+0000","last_became_active":"2024-04-25T09:02:52.033568+0000","last_became_peered":"2024-04-25T09:02:52.033568+0000","last_unstale":"2024-04-25T09:02:57.053548+0000","last_undegraded":"2024-04-25T09:02:57.053548+0000","last_fullsized":"2024-04-25T09:02:57.053548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:00.242892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053615+0000","last_change":"2024-04-25T09:02:51.025428+0000","last_active":"2024-04-25T09:02:57.053615+0000","last_peered":"2024-04-25T09:02:57.053615+0000","last_clean":"2024-04-25T09:02:57.053615+0000","last_became_active":"2024-04-25T09:02:51.025136+0000","last_became_peered":"2024-04-25T09:02:51.025136+0000","last_unstale":"2024-04-25T09:02:57.053615+0000","last_undegraded":"2024-04-25T09:02:57.053615+0000","last_fullsized":"2024-04-25T09:02:57.053615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:52.829970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056222+0000","last_change":"2024-04-25T09:02:51.022491+0000","last_active":"2024-04-25T09:02:57.056222+0000","last_peered":"2024-04-25T09:02:57.056222+0000","last_clean":"2024-04-25T09:02:57.056222+0000","last_became_active":"2024-04-25T09:02:51.022247+0000","last_became_peered":"2024-04-25T09:02:51.022247+0000","last_unstale":"2024-04-25T09:02:57.056222+0000","last_undegraded":"2024-04-25T09:02:57.056222+0000","last_fullsized":"2024-04-25T09:02:57.056222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:37.113394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789930+0000","last_change":"2024-04-25T09:02:52.038252+0000","last_active":"2024-04-25T09:02:57.789930+0000","last_peered":"2024-04-25T09:02:57.789930+0000","last_clean":"2024-04-25T09:02:57.789930+0000","last_became_active":"2024-04-25T09:02:52.037716+0000","last_became_peered":"2024-04-25T09:02:52.037716+0000","last_unstale":"2024-04-25T09:02:57.789930+0000","last_undegraded":"2024-04-25T09:02:57.789930+0000","last_fullsized":"2024-04-25T09:02:57.789930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:10.988897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789926+0000","last_change":"2024-04-25T09:02:56.069802+0000","last_active":"2024-04-25T09:02:57.789926+0000","last_peered":"2024-04-25T09:02:57.789926+0000","last_clean":"2024-04-25T09:02:57.789926+0000","last_became_active":"2024-04-25T09:02:56.069427+0000","last_became_peered":"2024-04-25T09:02:56.069427+0000","last_unstale":"2024-04-25T09:02:57.789926+0000","last_undegraded":"2024-04-25T09:02:57.789926+0000","last_fullsized":"2024-04-25T09:02:57.789926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:34.424557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053772+0000","last_change":"2024-04-25T09:02:51.036075+0000","last_active":"2024-04-25T09:02:57.053772+0000","last_peered":"2024-04-25T09:02:57.053772+0000","last_clean":"2024-04-25T09:02:57.053772+0000","last_became_active":"2024-04-25T09:02:51.035849+0000","last_became_peered":"2024-04-25T09:02:51.035849+0000","last_unstale":"2024-04-25T09:02:57.053772+0000","last_undegraded":"2024-04-25T09:02:57.053772+0000","last_fullsized":"2024-04-25T09:02:57.053772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.987767+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.987767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:23.500507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056936+0000","last_change":"2024-04-25T09:02:52.036912+0000","last_active":"2024-04-25T09:02:57.056936+0000","last_peered":"2024-04-25T09:02:57.056936+0000","last_clean":"2024-04-25T09:02:57.056936+0000","last_became_active":"2024-04-25T09:02:52.036679+0000","last_became_peered":"2024-04-25T09:02:52.036679+0000","last_unstale":"2024-04-25T09:02:57.056936+0000","last_undegraded":"2024-04-25T09:02:57.056936+0000","last_fullsized":"2024-04-25T09:02:57.056936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:08.484435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054391+0000","last_change":"2024-04-25T09:02:56.066858+0000","last_active":"2024-04-25T09:02:57.054391+0000","last_peered":"2024-04-25T09:02:57.054391+0000","last_clean":"2024-04-25T09:02:57.054391+0000","last_became_active":"2024-04-25T09:02:56.066447+0000","last_became_peered":"2024-04-25T09:02:56.066447+0000","last_unstale":"2024-04-25T09:02:57.054391+0000","last_undegraded":"2024-04-25T09:02:57.054391+0000","last_fullsized":"2024-04-25T09:02:57.054391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:55.032138+0000","last_clean_scrub_stamp":"2024-04-25T09:02:55.032138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:31.684064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.055569+0000","last_change":"2024-04-25T09:02:52.035312+0000","last_active":"2024-04-25T09:02:57.055569+0000","last_peered":"2024-04-25T09:02:57.055569+0000","last_clean":"2024-04-25T09:02:57.055569+0000","last_became_active":"2024-04-25T09:02:52.035070+0000","last_became_peered":"2024-04-25T09:02:52.035070+0000","last_unstale":"2024-04-25T09:02:57.055569+0000","last_undegraded":"2024-04-25T09:02:57.055569+0000","last_fullsized":"2024-04-25T09:02:57.055569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:31.078849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789359+0000","last_change":"2024-04-25T09:02:52.045821+0000","last_active":"2024-04-25T09:02:57.789359+0000","last_peered":"2024-04-25T09:02:57.789359+0000","last_clean":"2024-04-25T09:02:57.789359+0000","last_became_active":"2024-04-25T09:02:52.045314+0000","last_became_peered":"2024-04-25T09:02:52.045314+0000","last_unstale":"2024-04-25T09:02:57.789359+0000","last_undegraded":"2024-04-25T09:02:57.789359+0000","last_fullsized":"2024-04-25T09:02:57.789359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:45.562857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789433+0000","last_change":"2024-04-25T09:02:52.037128+0000","last_active":"2024-04-25T09:02:57.789433+0000","last_peered":"2024-04-25T09:02:57.789433+0000","last_clean":"2024-04-25T09:02:57.789433+0000","last_became_active":"2024-04-25T09:02:52.036844+0000","last_became_peered":"2024-04-25T09:02:52.036844+0000","last_unstale":"2024-04-25T09:02:57.789433+0000","last_undegraded":"2024-04-25T09:02:57.789433+0000","last_fullsized":"2024-04-25T09:02:57.789433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:00.651193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789850+0000","last_change":"2024-04-25T09:02:52.029120+0000","last_active":"2024-04-25T09:02:57.789850+0000","last_peered":"2024-04-25T09:02:57.789850+0000","last_clean":"2024-04-25T09:02:57.789850+0000","last_became_active":"2024-04-25T09:02:52.028407+0000","last_became_peered":"2024-04-25T09:02:52.028407+0000","last_unstale":"2024-04-25T09:02:57.789850+0000","last_undegraded":"2024-04-25T09:02:57.789850+0000","last_fullsized":"2024-04-25T09:02:57.789850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:02.471096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054070+0000","last_change":"2024-04-25T09:02:52.042602+0000","last_active":"2024-04-25T09:02:57.054070+0000","last_peered":"2024-04-25T09:02:57.054070+0000","last_clean":"2024-04-25T09:02:57.054070+0000","last_became_active":"2024-04-25T09:02:52.042283+0000","last_became_peered":"2024-04-25T09:02:52.042283+0000","last_unstale":"2024-04-25T09:02:57.054070+0000","last_undegraded":"2024-04-25T09:02:57.054070+0000","last_fullsized":"2024-04-25T09:02:57.054070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:17.240659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791085+0000","last_change":"2024-04-25T09:02:52.033453+0000","last_active":"2024-04-25T09:02:57.791085+0000","last_peered":"2024-04-25T09:02:57.791085+0000","last_clean":"2024-04-25T09:02:57.791085+0000","last_became_active":"2024-04-25T09:02:52.031389+0000","last_became_peered":"2024-04-25T09:02:52.031389+0000","last_unstale":"2024-04-25T09:02:57.791085+0000","last_undegraded":"2024-04-25T09:02:57.791085+0000","last_fullsized":"2024-04-25T09:02:57.791085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:50.625187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057375+0000","last_change":"2024-04-25T09:02:52.035491+0000","last_active":"2024-04-25T09:02:57.057375+0000","last_peered":"2024-04-25T09:02:57.057375+0000","last_clean":"2024-04-25T09:02:57.057375+0000","last_became_active":"2024-04-25T09:02:52.035187+0000","last_became_peered":"2024-04-25T09:02:52.035187+0000","last_unstale":"2024-04-25T09:02:57.057375+0000","last_undegraded":"2024-04-25T09:02:57.057375+0000","last_fullsized":"2024-04-25T09:02:57.057375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:48.414352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.054153+0000","last_change":"2024-04-25T09:02:52.039762+0000","last_active":"2024-04-25T09:02:57.054153+0000","last_peered":"2024-04-25T09:02:57.054153+0000","last_clean":"2024-04-25T09:02:57.054153+0000","last_became_active":"2024-04-25T09:02:52.039488+0000","last_became_peered":"2024-04-25T09:02:52.039488+0000","last_unstale":"2024-04-25T09:02:57.054153+0000","last_undegraded":"2024-04-25T09:02:57.054153+0000","last_fullsized":"2024-04-25T09:02:57.054153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:09.375365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789087+0000","last_change":"2024-04-25T09:02:52.043692+0000","last_active":"2024-04-25T09:02:57.789087+0000","last_peered":"2024-04-25T09:02:57.789087+0000","last_clean":"2024-04-25T09:02:57.789087+0000","last_became_active":"2024-04-25T09:02:52.032307+0000","last_became_peered":"2024-04-25T09:02:52.032307+0000","last_unstale":"2024-04-25T09:02:57.789087+0000","last_undegraded":"2024-04-25T09:02:57.789087+0000","last_fullsized":"2024-04-25T09:02:57.789087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:19.118637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053487+0000","last_change":"2024-04-25T09:02:52.040184+0000","last_active":"2024-04-25T09:02:57.053487+0000","last_peered":"2024-04-25T09:02:57.053487+0000","last_clean":"2024-04-25T09:02:57.053487+0000","last_became_active":"2024-04-25T09:02:52.040040+0000","last_became_peered":"2024-04-25T09:02:52.040040+0000","last_unstale":"2024-04-25T09:02:57.053487+0000","last_undegraded":"2024-04-25T09:02:57.053487+0000","last_fullsized":"2024-04-25T09:02:57.053487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:29.446381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789190+0000","last_change":"2024-04-25T09:02:52.058066+0000","last_active":"2024-04-25T09:02:57.789190+0000","last_peered":"2024-04-25T09:02:57.789190+0000","last_clean":"2024-04-25T09:02:57.789190+0000","last_became_active":"2024-04-25T09:02:52.053807+0000","last_became_peered":"2024-04-25T09:02:52.053807+0000","last_unstale":"2024-04-25T09:02:57.789190+0000","last_undegraded":"2024-04-25T09:02:57.789190+0000","last_fullsized":"2024-04-25T09:02:57.789190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:57.229849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789717+0000","last_change":"2024-04-25T09:02:52.036032+0000","last_active":"2024-04-25T09:02:57.789717+0000","last_peered":"2024-04-25T09:02:57.789717+0000","last_clean":"2024-04-25T09:02:57.789717+0000","last_became_active":"2024-04-25T09:02:52.035736+0000","last_became_peered":"2024-04-25T09:02:52.035736+0000","last_unstale":"2024-04-25T09:02:57.789717+0000","last_undegraded":"2024-04-25T09:02:57.789717+0000","last_fullsized":"2024-04-25T09:02:57.789717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:31.710536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056126+0000","last_change":"2024-04-25T09:02:52.039101+0000","last_active":"2024-04-25T09:02:57.056126+0000","last_peered":"2024-04-25T09:02:57.056126+0000","last_clean":"2024-04-25T09:02:57.056126+0000","last_became_active":"2024-04-25T09:02:52.038805+0000","last_became_peered":"2024-04-25T09:02:52.038805+0000","last_unstale":"2024-04-25T09:02:57.056126+0000","last_undegraded":"2024-04-25T09:02:57.056126+0000","last_fullsized":"2024-04-25T09:02:57.056126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:39.062300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463830+0000","last_change":"2024-04-25T09:02:52.049274+0000","last_active":"2024-04-25T09:02:57.463830+0000","last_peered":"2024-04-25T09:02:57.463830+0000","last_clean":"2024-04-25T09:02:57.463830+0000","last_became_active":"2024-04-25T09:02:52.048624+0000","last_became_peered":"2024-04-25T09:02:52.048624+0000","last_unstale":"2024-04-25T09:02:57.463830+0000","last_undegraded":"2024-04-25T09:02:57.463830+0000","last_fullsized":"2024-04-25T09:02:57.463830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:48.298283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790702+0000","last_change":"2024-04-25T09:02:52.030094+0000","last_active":"2024-04-25T09:02:57.790702+0000","last_peered":"2024-04-25T09:02:57.790702+0000","last_clean":"2024-04-25T09:02:57.790702+0000","last_became_active":"2024-04-25T09:02:52.029404+0000","last_became_peered":"2024-04-25T09:02:52.029404+0000","last_unstale":"2024-04-25T09:02:57.790702+0000","last_undegraded":"2024-04-25T09:02:57.790702+0000","last_fullsized":"2024-04-25T09:02:57.790702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:11.826190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789936+0000","last_change":"2024-04-25T09:02:52.057482+0000","last_active":"2024-04-25T09:02:57.789936+0000","last_peered":"2024-04-25T09:02:57.789936+0000","last_clean":"2024-04-25T09:02:57.789936+0000","last_became_active":"2024-04-25T09:02:52.053761+0000","last_became_peered":"2024-04-25T09:02:52.053761+0000","last_unstale":"2024-04-25T09:02:57.789936+0000","last_undegraded":"2024-04-25T09:02:57.789936+0000","last_fullsized":"2024-04-25T09:02:57.789936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:41.457232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.788945+0000","last_change":"2024-04-25T09:02:52.038864+0000","last_active":"2024-04-25T09:02:57.788945+0000","last_peered":"2024-04-25T09:02:57.788945+0000","last_clean":"2024-04-25T09:02:57.788945+0000","last_became_active":"2024-04-25T09:02:52.038586+0000","last_became_peered":"2024-04-25T09:02:52.038586+0000","last_unstale":"2024-04-25T09:02:57.788945+0000","last_undegraded":"2024-04-25T09:02:57.788945+0000","last_fullsized":"2024-04-25T09:02:57.788945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:39.062300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790365+0000","last_change":"2024-04-25T09:02:52.021083+0000","last_active":"2024-04-25T09:02:57.790365+0000","last_peered":"2024-04-25T09:02:57.790365+0000","last_clean":"2024-04-25T09:02:57.790365+0000","last_became_active":"2024-04-25T09:02:52.019096+0000","last_became_peered":"2024-04-25T09:02:52.019096+0000","last_unstale":"2024-04-25T09:02:57.790365+0000","last_undegraded":"2024-04-25T09:02:57.790365+0000","last_fullsized":"2024-04-25T09:02:57.790365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:10.988897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789527+0000","last_change":"2024-04-25T09:02:52.025371+0000","last_active":"2024-04-25T09:02:57.789527+0000","last_peered":"2024-04-25T09:02:57.789527+0000","last_clean":"2024-04-25T09:02:57.789527+0000","last_became_active":"2024-04-25T09:02:52.024320+0000","last_became_peered":"2024-04-25T09:02:52.024320+0000","last_unstale":"2024-04-25T09:02:57.789527+0000","last_undegraded":"2024-04-25T09:02:57.789527+0000","last_fullsized":"2024-04-25T09:02:57.789527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:19.358216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053569+0000","last_change":"2024-04-25T09:02:52.033835+0000","last_active":"2024-04-25T09:02:57.053569+0000","last_peered":"2024-04-25T09:02:57.053569+0000","last_clean":"2024-04-25T09:02:57.053569+0000","last_became_active":"2024-04-25T09:02:52.033530+0000","last_became_peered":"2024-04-25T09:02:52.033530+0000","last_unstale":"2024-04-25T09:02:57.053569+0000","last_undegraded":"2024-04-25T09:02:57.053569+0000","last_fullsized":"2024-04-25T09:02:57.053569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:07.517265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057290+0000","last_change":"2024-04-25T09:02:52.027796+0000","last_active":"2024-04-25T09:02:57.057290+0000","last_peered":"2024-04-25T09:02:57.057290+0000","last_clean":"2024-04-25T09:02:57.057290+0000","last_became_active":"2024-04-25T09:02:52.027441+0000","last_became_peered":"2024-04-25T09:02:52.027441+0000","last_unstale":"2024-04-25T09:02:57.057290+0000","last_undegraded":"2024-04-25T09:02:57.057290+0000","last_fullsized":"2024-04-25T09:02:57.057290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:41.693114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.056467+0000","last_change":"2024-04-25T09:02:52.051744+0000","last_active":"2024-04-25T09:02:57.056467+0000","last_peered":"2024-04-25T09:02:57.056467+0000","last_clean":"2024-04-25T09:02:57.056467+0000","last_became_active":"2024-04-25T09:02:52.051453+0000","last_became_peered":"2024-04-25T09:02:52.051453+0000","last_unstale":"2024-04-25T09:02:57.056467+0000","last_undegraded":"2024-04-25T09:02:57.056467+0000","last_fullsized":"2024-04-25T09:02:57.056467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:18.635634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.057266+0000","last_change":"2024-04-25T09:02:52.051875+0000","last_active":"2024-04-25T09:02:57.057266+0000","last_peered":"2024-04-25T09:02:57.057266+0000","last_clean":"2024-04-25T09:02:57.057266+0000","last_became_active":"2024-04-25T09:02:52.051621+0000","last_became_peered":"2024-04-25T09:02:52.051621+0000","last_unstale":"2024-04-25T09:02:57.057266+0000","last_undegraded":"2024-04-25T09:02:57.057266+0000","last_fullsized":"2024-04-25T09:02:57.057266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:52.428184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.464024+0000","last_change":"2024-04-25T09:02:52.058460+0000","last_active":"2024-04-25T09:02:57.464024+0000","last_peered":"2024-04-25T09:02:57.464024+0000","last_clean":"2024-04-25T09:02:57.464024+0000","last_became_active":"2024-04-25T09:02:52.058164+0000","last_became_peered":"2024-04-25T09:02:52.058164+0000","last_unstale":"2024-04-25T09:02:57.464024+0000","last_undegraded":"2024-04-25T09:02:57.464024+0000","last_fullsized":"2024-04-25T09:02:57.464024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:07.843292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.053224+0000","last_change":"2024-04-25T09:02:52.044000+0000","last_active":"2024-04-25T09:02:57.053224+0000","last_peered":"2024-04-25T09:02:57.053224+0000","last_clean":"2024-04-25T09:02:57.053224+0000","last_became_active":"2024-04-25T09:02:52.042814+0000","last_became_peered":"2024-04-25T09:02:52.042814+0000","last_unstale":"2024-04-25T09:02:57.053224+0000","last_undegraded":"2024-04-25T09:02:57.053224+0000","last_fullsized":"2024-04-25T09:02:57.053224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:12.756335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463194+0000","last_change":"2024-04-25T09:02:52.044961+0000","last_active":"2024-04-25T09:02:57.463194+0000","last_peered":"2024-04-25T09:02:57.463194+0000","last_clean":"2024-04-25T09:02:57.463194+0000","last_became_active":"2024-04-25T09:02:52.044611+0000","last_became_peered":"2024-04-25T09:02:52.044611+0000","last_unstale":"2024-04-25T09:02:57.463194+0000","last_undegraded":"2024-04-25T09:02:57.463194+0000","last_fullsized":"2024-04-25T09:02:57.463194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:07.517265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789201+0000","last_change":"2024-04-25T09:02:52.043640+0000","last_active":"2024-04-25T09:02:57.789201+0000","last_peered":"2024-04-25T09:02:57.789201+0000","last_clean":"2024-04-25T09:02:57.789201+0000","last_became_active":"2024-04-25T09:02:52.039228+0000","last_became_peered":"2024-04-25T09:02:52.039228+0000","last_unstale":"2024-04-25T09:02:57.789201+0000","last_undegraded":"2024-04-25T09:02:57.789201+0000","last_fullsized":"2024-04-25T09:02:57.789201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:35.283398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463393+0000","last_change":"2024-04-25T09:02:52.045074+0000","last_active":"2024-04-25T09:02:57.463393+0000","last_peered":"2024-04-25T09:02:57.463393+0000","last_clean":"2024-04-25T09:02:57.463393+0000","last_became_active":"2024-04-25T09:02:52.044803+0000","last_became_peered":"2024-04-25T09:02:52.044803+0000","last_unstale":"2024-04-25T09:02:57.463393+0000","last_undegraded":"2024-04-25T09:02:57.463393+0000","last_fullsized":"2024-04-25T09:02:57.463393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:45.007626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.789370+0000","last_change":"2024-04-25T09:02:52.044897+0000","last_active":"2024-04-25T09:02:57.789370+0000","last_peered":"2024-04-25T09:02:57.789370+0000","last_clean":"2024-04-25T09:02:57.789370+0000","last_became_active":"2024-04-25T09:02:52.044582+0000","last_became_peered":"2024-04-25T09:02:52.044582+0000","last_unstale":"2024-04-25T09:02:57.789370+0000","last_undegraded":"2024-04-25T09:02:57.789370+0000","last_fullsized":"2024-04-25T09:02:57.789370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:52.428184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.790225+0000","last_change":"2024-04-25T09:02:52.026796+0000","last_active":"2024-04-25T09:02:57.790225+0000","last_peered":"2024-04-25T09:02:57.790225+0000","last_clean":"2024-04-25T09:02:57.790225+0000","last_became_active":"2024-04-25T09:02:52.026522+0000","last_became_peered":"2024-04-25T09:02:52.026522+0000","last_unstale":"2024-04-25T09:02:57.790225+0000","last_undegraded":"2024-04-25T09:02:57.790225+0000","last_fullsized":"2024-04-25T09:02:57.790225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:29.446381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.791477+0000","last_change":"2024-04-25T09:02:52.016990+0000","last_active":"2024-04-25T09:02:57.791477+0000","last_peered":"2024-04-25T09:02:57.791477+0000","last_clean":"2024-04-25T09:02:57.791477+0000","last_became_active":"2024-04-25T09:02:52.015451+0000","last_became_peered":"2024-04-25T09:02:52.015451+0000","last_unstale":"2024-04-25T09:02:57.791477+0000","last_undegraded":"2024-04-25T09:02:57.791477+0000","last_fullsized":"2024-04-25T09:02:57.791477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:00.242892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T09:02:57.463935+0000","last_change":"2024-04-25T09:02:52.050256+0000","last_active":"2024-04-25T09:02:57.463935+0000","last_peered":"2024-04-25T09:02:57.463935+0000","last_clean":"2024-04-25T09:02:57.463935+0000","last_became_active":"2024-04-25T09:02:52.049994+0000","last_became_peered":"2024-04-25T09:02:52.049994+0000","last_unstale":"2024-04-25T09:02:57.463935+0000","last_undegraded":"2024-04-25T09:02:57.463935+0000","last_fullsized":"2024-04-25T09:02:57.463935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:50.997222+0000","last_clean_scrub_stamp":"2024-04-25T09:02:50.997222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:26.331238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":106528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":106402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":697408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":697352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:03:15.113 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T09:03:15.113 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T09:03:15.113 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T09:03:15.114 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:03:15.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.294+0000 7fb937400640 1 Processor -- start 2024-04-25T09:03:15.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.294+0000 7fb937400640 1 -- start start 2024-04-25T09:03:15.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.294+0000 7fb937400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb930145250 0x7fb93015c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.294+0000 7fb937400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb9300cc8b0 0x7fb9300ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.294+0000 7fb937400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93015cec0 con 0x7fb930071320 2024-04-25T09:03:15.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.294+0000 7fb937400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93006e7c0 con 0x7fb9300cc8b0 2024-04-25T09:03:15.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.294+0000 7fb937400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93006d720 con 0x7fb930145250 2024-04-25T09:03:15.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.298+0000 7fb927e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb9300cc8b0 0x7fb9300ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.298+0000 7fb927e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb9300cc8b0 0x7fb9300ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43038/0 (socket says 172.21.15.173:43038) 2024-04-25T09:03:15.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.298+0000 7fb927e00640 1 -- 172.21.15.173:0/1587062880 learned_addr learned my addr 172.21.15.173:0/1587062880 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:15.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.298+0000 7fb934a00640 1 --2- 172.21.15.173:0/1587062880 >> v2:172.21.15.194:3300/0 conn(0x7fb930145250 0x7fb93015c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.298+0000 7fb927e00640 1 -- 172.21.15.173:0/1587062880 >> v2:172.21.15.194:3300/0 conn(0x7fb930145250 msgr2=0x7fb93015c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:15.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.298+0000 7fb927e00640 1 --2- 172.21.15.173:0/1587062880 >> v2:172.21.15.194:3300/0 conn(0x7fb930145250 0x7fb93015c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.298+0000 7fb927e00640 1 -- 172.21.15.173:0/1587062880 >> v1:172.21.15.194:6789/0 conn(0x7fb930071320 legacy=0x7fb930071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:15.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.298+0000 7fb927e00640 1 -- 172.21.15.173:0/1587062880 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93006da00 con 0x7fb9300cc8b0 2024-04-25T09:03:15.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.298+0000 7fb927e00640 1 --2- 172.21.15.173:0/1587062880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9300cc8b0 0x7fb9300ccd30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb9300d0420 tx=0x7fb91801c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b8379a09b71e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.298+0000 7fb92fe00640 1 -- 172.21.15.173:0/1587062880 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9180b0070 con 0x7fb9300cc8b0 2024-04-25T09:03:15.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.298+0000 7fb92fe00640 1 -- 172.21.15.173:0/1587062880 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9180ab600 con 0x7fb9300cc8b0 2024-04-25T09:03:15.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.298+0000 7fb92fe00640 1 -- 172.21.15.173:0/1587062880 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9180ab9d0 con 0x7fb9300cc8b0 2024-04-25T09:03:15.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb937400640 1 -- 172.21.15.173:0/1587062880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9300cc8b0 msgr2=0x7fb9300ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb937400640 1 --2- 172.21.15.173:0/1587062880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9300cc8b0 0x7fb9300ccd30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb9300d0420 tx=0x7fb91801c300 comp rx=0 tx=0).stop 2024-04-25T09:03:15.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb937400640 1 -- 172.21.15.173:0/1587062880 shutdown_connections 2024-04-25T09:03:15.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb937400640 1 --2- 172.21.15.173:0/1587062880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9300cc8b0 0x7fb9300ccd30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb937400640 1 --2- 172.21.15.173:0/1587062880 >> v2:172.21.15.194:3300/0 conn(0x7fb930145250 0x7fb93015c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb937400640 1 -- 172.21.15.173:0/1587062880 >> 172.21.15.173:0/1587062880 conn(0x7fb93006ac90 msgr2=0x7fb93006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:15.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb937400640 1 -- 172.21.15.173:0/1587062880 shutdown_connections 2024-04-25T09:03:15.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb937400640 1 -- 172.21.15.173:0/1587062880 wait complete. 2024-04-25T09:03:15.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb937400640 1 Processor -- start 2024-04-25T09:03:15.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb937400640 1 -- start start 2024-04-25T09:03:15.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb937400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb930071320 0x7fb9300b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb937400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9300cc8b0 0x7fb9300acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb937400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb930145250 0x7fb9300ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb937400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93006ef80 con 0x7fb930145250 2024-04-25T09:03:15.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb937400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb930145630 con 0x7fb930071320 2024-04-25T09:03:15.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb937400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93006d380 con 0x7fb9300cc8b0 2024-04-25T09:03:15.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb935400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb930145250 0x7fb9300ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb935400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb930145250 0x7fb9300ad060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43054/0 (socket says 172.21.15.173:43054) 2024-04-25T09:03:15.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb935400640 1 -- 172.21.15.173:0/1115320102 learned_addr learned my addr 172.21.15.173:0/1115320102 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:15.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb934a00640 1 --2- 172.21.15.173:0/1115320102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb930071320 0x7fb9300b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb927e00640 1 --2- 172.21.15.173:0/1115320102 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9300cc8b0 0x7fb9300acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb935400640 1 -- 172.21.15.173:0/1115320102 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9300cc8b0 msgr2=0x7fb9300acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb935400640 1 --2- 172.21.15.173:0/1115320102 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9300cc8b0 0x7fb9300acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb935400640 1 -- 172.21.15.173:0/1115320102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb930071320 msgr2=0x7fb9300b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb935400640 1 --2- 172.21.15.173:0/1115320102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb930071320 0x7fb9300b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.302+0000 7fb935400640 1 -- 172.21.15.173:0/1115320102 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9300ad770 con 0x7fb930145250 2024-04-25T09:03:15.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.306+0000 7fb935400640 1 --2- 172.21.15.173:0/1115320102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb930145250 0x7fb9300ad060 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb92800b9a0 tx=0x7fb92800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.306+0000 7fb92d600640 1 -- 172.21.15.173:0/1115320102 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928019070 con 0x7fb930145250 2024-04-25T09:03:15.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.306+0000 7fb92d600640 1 -- 172.21.15.173:0/1115320102 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92800cba0 con 0x7fb930145250 2024-04-25T09:03:15.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.306+0000 7fb937400640 1 -- 172.21.15.173:0/1115320102 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9300ada50 con 0x7fb930145250 2024-04-25T09:03:15.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.306+0000 7fb92d600640 1 -- 172.21.15.173:0/1115320102 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928014440 con 0x7fb930145250 2024-04-25T09:03:15.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.306+0000 7fb937400640 1 -- 172.21.15.173:0/1115320102 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9300ae010 con 0x7fb930145250 2024-04-25T09:03:15.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.306+0000 7fb937400640 1 -- 172.21.15.173:0/1115320102 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb930073a40 con 0x7fb930145250 2024-04-25T09:03:15.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.306+0000 7fb92d600640 1 -- 172.21.15.173:0/1115320102 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb92801c070 con 0x7fb930145250 2024-04-25T09:03:15.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.306+0000 7fb92d600640 1 --2- 172.21.15.173:0/1115320102 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb90c066f60 0x7fb90c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.306+0000 7fb92d600640 1 -- 172.21.15.173:0/1115320102 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb928084fe0 con 0x7fb930145250 2024-04-25T09:03:15.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.306+0000 7fb934a00640 1 --2- 172.21.15.173:0/1115320102 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb90c066f60 0x7fb90c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.310+0000 7fb934a00640 1 --2- 172.21.15.173:0/1115320102 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb90c066f60 0x7fb90c069420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb920007a60 tx=0x7fb920008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.310+0000 7fb92d600640 1 -- 172.21.15.173:0/1115320102 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb9280555b0 con 0x7fb930145250 2024-04-25T09:03:15.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.498+0000 7fb937400640 1 -- 172.21.15.173:0/1115320102 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb93006c300 con 0x7fb930145250 2024-04-25T09:03:15.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.498+0000 7fb92d600640 1 -- 172.21.15.173:0/1115320102 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb928059650 con 0x7fb930145250 2024-04-25T09:03:15.486 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:15.486 INFO:teuthology.orchestra.run.smithi173.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T09:03:15.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.498+0000 7fb937400640 1 -- 172.21.15.173:0/1115320102 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb90c066f60 msgr2=0x7fb90c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.498+0000 7fb937400640 1 --2- 172.21.15.173:0/1115320102 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb90c066f60 0x7fb90c069420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb920007a60 tx=0x7fb920008040 comp rx=0 tx=0).stop 2024-04-25T09:03:15.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.498+0000 7fb937400640 1 -- 172.21.15.173:0/1115320102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb930145250 msgr2=0x7fb9300ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.498+0000 7fb937400640 1 --2- 172.21.15.173:0/1115320102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb930145250 0x7fb9300ad060 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb92800b9a0 tx=0x7fb92800be60 comp rx=0 tx=0).stop 2024-04-25T09:03:15.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.498+0000 7fb937400640 1 -- 172.21.15.173:0/1115320102 shutdown_connections 2024-04-25T09:03:15.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.498+0000 7fb937400640 1 --2- 172.21.15.173:0/1115320102 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb90c066f60 0x7fb90c069420 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.498+0000 7fb937400640 1 --2- 172.21.15.173:0/1115320102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb930145250 0x7fb9300ad060 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.498+0000 7fb937400640 1 --2- 172.21.15.173:0/1115320102 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9300cc8b0 0x7fb9300acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.498+0000 7fb937400640 1 --2- 172.21.15.173:0/1115320102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb930071320 0x7fb9300b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.498+0000 7fb937400640 1 -- 172.21.15.173:0/1115320102 >> 172.21.15.173:0/1115320102 conn(0x7fb93006ac90 msgr2=0x7fb93015e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:15.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.498+0000 7fb937400640 1 -- 172.21.15.173:0/1115320102 shutdown_connections 2024-04-25T09:03:15.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.498+0000 7fb937400640 1 -- 172.21.15.173:0/1115320102 wait complete. 2024-04-25T09:03:15.506 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T09:03:15.507 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:15.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.654+0000 7f16a3200640 1 Processor -- start 2024-04-25T09:03:15.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.654+0000 7f16a3200640 1 -- start start 2024-04-25T09:03:15.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.654+0000 7f16a3200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f16a406ffa0 0x7f16a40616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.654+0000 7f16a3200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f16a40cf850 0x7f16a415f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.654+0000 7f16a3200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a4061c90 con 0x7f16a40af3c0 2024-04-25T09:03:15.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.654+0000 7f16a3200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a40ad0e0 con 0x7f16a406ffa0 2024-04-25T09:03:15.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.654+0000 7f16a3200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a40af870 con 0x7f16a40cf850 2024-04-25T09:03:15.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.654+0000 7f16a1e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f16a406ffa0 0x7f16a40616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.654+0000 7f16a1e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f16a406ffa0 0x7f16a40616b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43068/0 (socket says 172.21.15.173:43068) 2024-04-25T09:03:15.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.654+0000 7f16a1e00640 1 -- 172.21.15.173:0/2400460719 learned_addr learned my addr 172.21.15.173:0/2400460719 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:15.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.654+0000 7f16a2800640 1 --2- 172.21.15.173:0/2400460719 >> v2:172.21.15.194:3300/0 conn(0x7f16a40cf850 0x7f16a415f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.654+0000 7f16a1e00640 1 -- 172.21.15.173:0/2400460719 >> v2:172.21.15.194:3300/0 conn(0x7f16a40cf850 msgr2=0x7f16a415f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:15.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.654+0000 7f16a1e00640 1 --2- 172.21.15.173:0/2400460719 >> v2:172.21.15.194:3300/0 conn(0x7f16a40cf850 0x7f16a415f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.654+0000 7f16a1e00640 1 -- 172.21.15.173:0/2400460719 >> v1:172.21.15.194:6789/0 conn(0x7f16a40af3c0 legacy=0x7f16a40cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:15.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.654+0000 7f16a1e00640 1 -- 172.21.15.173:0/2400460719 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a415bf10 con 0x7f16a406ffa0 2024-04-25T09:03:15.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.658+0000 7f16a1e00640 1 --2- 172.21.15.173:0/2400460719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a406ffa0 0x7f16a40616b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f16a40cd890 tx=0x7f169401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9cf6224752e6b8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.658+0000 7f16a1400640 1 -- 172.21.15.173:0/2400460719 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16940ab610 con 0x7f16a406ffa0 2024-04-25T09:03:15.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.658+0000 7f16a1400640 1 -- 172.21.15.173:0/2400460719 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16940b0070 con 0x7f16a406ffa0 2024-04-25T09:03:15.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.658+0000 7f16a1400640 1 -- 172.21.15.173:0/2400460719 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16940ab9d0 con 0x7f16a406ffa0 2024-04-25T09:03:15.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.658+0000 7f16a3200640 1 -- 172.21.15.173:0/2400460719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a406ffa0 msgr2=0x7f16a40616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.658+0000 7f16a3200640 1 --2- 172.21.15.173:0/2400460719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a406ffa0 0x7f16a40616b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f16a40cd890 tx=0x7f169401c520 comp rx=0 tx=0).stop 2024-04-25T09:03:15.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.658+0000 7f16a3200640 1 -- 172.21.15.173:0/2400460719 shutdown_connections 2024-04-25T09:03:15.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.658+0000 7f16a3200640 1 --2- 172.21.15.173:0/2400460719 >> v2:172.21.15.194:3300/0 conn(0x7f16a40cf850 0x7f16a415f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.658+0000 7f16a3200640 1 --2- 172.21.15.173:0/2400460719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a406ffa0 0x7f16a40616b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.658+0000 7f16a3200640 1 -- 172.21.15.173:0/2400460719 >> 172.21.15.173:0/2400460719 conn(0x7f16a40cc800 msgr2=0x7f16a40ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:15.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.658+0000 7f16a3200640 1 -- 172.21.15.173:0/2400460719 shutdown_connections 2024-04-25T09:03:15.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.658+0000 7f16a3200640 1 -- 172.21.15.173:0/2400460719 wait complete. 2024-04-25T09:03:15.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f16a3200640 1 Processor -- start 2024-04-25T09:03:15.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f16a3200640 1 -- start start 2024-04-25T09:03:15.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f16a3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16a406ffa0 0x7f16a4155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f16a3200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a40af3c0 0x7f16a414b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f16a3200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16a40cf850 0x7f16a41fa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f16a3200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a4168790 con 0x7f16a40af3c0 2024-04-25T09:03:15.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f16a3200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a415ccd0 con 0x7f16a40cf850 2024-04-25T09:03:15.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f16a3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a4168910 con 0x7f16a406ffa0 2024-04-25T09:03:15.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f1699400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a40af3c0 0x7f16a414b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f1699400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a40af3c0 0x7f16a414b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43072/0 (socket says 172.21.15.173:43072) 2024-04-25T09:03:15.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f1699400640 1 -- 172.21.15.173:0/3045221171 learned_addr learned my addr 172.21.15.173:0/3045221171 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:15.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f16a2800640 1 --2- 172.21.15.173:0/3045221171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16a40cf850 0x7f16a41fa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f16a1e00640 1 --2- 172.21.15.173:0/3045221171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16a406ffa0 0x7f16a4155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f1699400640 1 -- 172.21.15.173:0/3045221171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16a406ffa0 msgr2=0x7f16a4155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f1699400640 1 --2- 172.21.15.173:0/3045221171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16a406ffa0 0x7f16a4155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f1699400640 1 -- 172.21.15.173:0/3045221171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16a40cf850 msgr2=0x7f16a41fa6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f1699400640 1 --2- 172.21.15.173:0/3045221171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16a40cf850 0x7f16a41fa6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f1699400640 1 -- 172.21.15.173:0/3045221171 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a40b4a60 con 0x7f16a40af3c0 2024-04-25T09:03:15.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f1699400640 1 --2- 172.21.15.173:0/3045221171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a40af3c0 0x7f16a414b600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f168c00c420 tx=0x7f168c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f169aa00640 1 -- 172.21.15.173:0/3045221171 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c0052d0 con 0x7f16a40af3c0 2024-04-25T09:03:15.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f169aa00640 1 -- 172.21.15.173:0/3045221171 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c005470 con 0x7f16a40af3c0 2024-04-25T09:03:15.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f169aa00640 1 -- 172.21.15.173:0/3045221171 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c007260 con 0x7f16a40af3c0 2024-04-25T09:03:15.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f16a3200640 1 -- 172.21.15.173:0/3045221171 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a40b4d40 con 0x7f16a40af3c0 2024-04-25T09:03:15.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f16a3200640 1 -- 172.21.15.173:0/3045221171 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a415d7a0 con 0x7f16a40af3c0 2024-04-25T09:03:15.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.662+0000 7f16a3200640 1 -- 172.21.15.173:0/3045221171 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a4073a40 con 0x7f16a40af3c0 2024-04-25T09:03:15.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.666+0000 7f169aa00640 1 -- 172.21.15.173:0/3045221171 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f168c007400 con 0x7f16a40af3c0 2024-04-25T09:03:15.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.666+0000 7f169aa00640 1 --2- 172.21.15.173:0/3045221171 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1680066f90 0x7f1680069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.666+0000 7f169aa00640 1 -- 172.21.15.173:0/3045221171 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f168c084780 con 0x7f16a40af3c0 2024-04-25T09:03:15.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.666+0000 7f16a1e00640 1 --2- 172.21.15.173:0/3045221171 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1680066f90 0x7f1680069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.666+0000 7f16a1e00640 1 --2- 172.21.15.173:0/3045221171 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1680066f90 0x7f1680069450 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f16940af000 tx=0x7f16940a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.670+0000 7f169aa00640 1 -- 172.21.15.173:0/3045221171 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f168c054df0 con 0x7f16a40af3c0 2024-04-25T09:03:15.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.826+0000 7f16a3200640 1 -- 172.21.15.173:0/3045221171 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16a406bfe0 con 0x7f16a40af3c0 2024-04-25T09:03:15.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.826+0000 7f169aa00640 1 -- 172.21.15.173:0/3045221171 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18574 (secure 0 0 0) 0x7f168c058e90 con 0x7f16a40af3c0 2024-04-25T09:03:15.818 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:15.818 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:56.440593+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:15.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.830+0000 7f16a3200640 1 -- 172.21.15.173:0/3045221171 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1680066f90 msgr2=0x7f1680069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.830+0000 7f16a3200640 1 --2- 172.21.15.173:0/3045221171 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1680066f90 0x7f1680069450 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f16940af000 tx=0x7f16940a7000 comp rx=0 tx=0).stop 2024-04-25T09:03:15.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.830+0000 7f16a3200640 1 -- 172.21.15.173:0/3045221171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a40af3c0 msgr2=0x7f16a414b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.830+0000 7f16a3200640 1 --2- 172.21.15.173:0/3045221171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a40af3c0 0x7f16a414b600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f168c00c420 tx=0x7f168c00c8e0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.830+0000 7f16a3200640 1 -- 172.21.15.173:0/3045221171 shutdown_connections 2024-04-25T09:03:15.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.830+0000 7f16a3200640 1 --2- 172.21.15.173:0/3045221171 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1680066f90 0x7f1680069450 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.830+0000 7f16a3200640 1 --2- 172.21.15.173:0/3045221171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16a40cf850 0x7f16a41fa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.830+0000 7f16a3200640 1 --2- 172.21.15.173:0/3045221171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a40af3c0 0x7f16a414b600 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.830+0000 7f16a3200640 1 --2- 172.21.15.173:0/3045221171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16a406ffa0 0x7f16a4155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.830+0000 7f16a3200640 1 -- 172.21.15.173:0/3045221171 >> 172.21.15.173:0/3045221171 conn(0x7f16a40cc800 msgr2=0x7f16a414e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:15.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.830+0000 7f16a3200640 1 -- 172.21.15.173:0/3045221171 shutdown_connections 2024-04-25T09:03:15.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.830+0000 7f16a3200640 1 -- 172.21.15.173:0/3045221171 wait complete. 2024-04-25T09:03:15.839 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:02:49.342297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:02:50.386069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:02:54.077429+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:03:15.839 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:15.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.986+0000 7f6331600640 1 Processor -- start 2024-04-25T09:03:15.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.986+0000 7f6331600640 1 -- start start 2024-04-25T09:03:15.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.990+0000 7f6331600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f632c0cc7e0 0x7f632c0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.990+0000 7f6331600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f632c0aef70 0x7f632c0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.990+0000 7f6331600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f632c071570 con 0x7f632c0aeb90 2024-04-25T09:03:15.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.990+0000 7f6331600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f632c071320 con 0x7f632c0aef70 2024-04-25T09:03:15.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.990+0000 7f6331600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632c072330 con 0x7f632c0cc7e0 2024-04-25T09:03:15.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.990+0000 7f632aa00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f632c0aeb90 0x7f632c0cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38968/0 (socket says 172.21.15.173:38968) 2024-04-25T09:03:15.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.990+0000 7f632aa00640 1 -- 172.21.15.173:0/478052935 learned_addr learned my addr 172.21.15.173:0/478052935 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:15.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.990+0000 7f632b400640 1 --2- 172.21.15.173:0/478052935 >> v2:172.21.15.173:3300/0 conn(0x7f632c0aef70 0x7f632c0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.990+0000 7f6322000640 1 --2- 172.21.15.173:0/478052935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f632c0cc7e0 0x7f632c0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.990+0000 7f632a000640 1 -- 172.21.15.173:0/478052935 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429483589 0 0) 0x7f632c071570 con 0x7f632c0aeb90 2024-04-25T09:03:15.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.990+0000 7f632a000640 1 -- 172.21.15.173:0/478052935 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6310003530 con 0x7f632c0aeb90 2024-04-25T09:03:15.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.990+0000 7f632b400640 1 -- 172.21.15.173:0/478052935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f632c0cc7e0 msgr2=0x7f632c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:15.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.990+0000 7f632b400640 1 --2- 172.21.15.173:0/478052935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f632c0cc7e0 0x7f632c0cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.990+0000 7f632b400640 1 -- 172.21.15.173:0/478052935 >> v1:172.21.15.173:6789/0 conn(0x7f632c0aeb90 legacy=0x7f632c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.990+0000 7f632b400640 1 -- 172.21.15.173:0/478052935 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c071850 con 0x7f632c0aef70 2024-04-25T09:03:15.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.994+0000 7f632b400640 1 --2- 172.21.15.173:0/478052935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f632c0aef70 0x7f632c0ce0e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6324009d90 tx=0x7f632401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf688636d0e7c26d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.994+0000 7f632a000640 1 -- 172.21.15.173:0/478052935 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63240b2070 con 0x7f632c0aef70 2024-04-25T09:03:15.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.994+0000 7f632a000640 1 -- 172.21.15.173:0/478052935 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63240a5790 con 0x7f632c0aef70 2024-04-25T09:03:15.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.994+0000 7f632a000640 1 -- 172.21.15.173:0/478052935 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63240a5b60 con 0x7f632c0aef70 2024-04-25T09:03:15.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.994+0000 7f6331600640 1 -- 172.21.15.173:0/478052935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f632c0aef70 msgr2=0x7f632c0ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.994+0000 7f6331600640 1 --2- 172.21.15.173:0/478052935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f632c0aef70 0x7f632c0ce0e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6324009d90 tx=0x7f632401c8e0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.994+0000 7f6331600640 1 -- 172.21.15.173:0/478052935 shutdown_connections 2024-04-25T09:03:15.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.994+0000 7f6331600640 1 --2- 172.21.15.173:0/478052935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f632c0aef70 0x7f632c0ce0e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.994+0000 7f6331600640 1 --2- 172.21.15.173:0/478052935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f632c0cc7e0 0x7f632c0cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.994+0000 7f6331600640 1 -- 172.21.15.173:0/478052935 >> 172.21.15.173:0/478052935 conn(0x7f632c06ac90 msgr2=0x7f632c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:15.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.994+0000 7f6331600640 1 -- 172.21.15.173:0/478052935 shutdown_connections 2024-04-25T09:03:15.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.994+0000 7f6331600640 1 -- 172.21.15.173:0/478052935 wait complete. 2024-04-25T09:03:15.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.994+0000 7f6331600640 1 Processor -- start 2024-04-25T09:03:15.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.994+0000 7f6331600640 1 -- start start 2024-04-25T09:03:15.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6331600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f632c0aeb90 0x7f632c0b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6331600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f632c0aef70 0x7f632c14bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6331600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f632c0cc7e0 0x7f632c14c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6331600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c15bb30 con 0x7f632c0aef70 2024-04-25T09:03:15.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6331600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c15b9b0 con 0x7f632c0aeb90 2024-04-25T09:03:15.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6331600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632c15bcb0 con 0x7f632c0cc7e0 2024-04-25T09:03:15.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6322000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f632c0aef70 0x7f632c14bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f632aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f632c0aeb90 0x7f632c0b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6322000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f632c0aef70 0x7f632c14bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43094/0 (socket says 172.21.15.173:43094) 2024-04-25T09:03:15.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6322000640 1 -- 172.21.15.173:0/903882441 learned_addr learned my addr 172.21.15.173:0/903882441 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:15.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f632b400640 1 --2- 172.21.15.173:0/903882441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f632c0cc7e0 0x7f632c14c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6322000640 1 -- 172.21.15.173:0/903882441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f632c0cc7e0 msgr2=0x7f632c14c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6322000640 1 --2- 172.21.15.173:0/903882441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f632c0cc7e0 0x7f632c14c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6322000640 1 -- 172.21.15.173:0/903882441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f632c0aeb90 msgr2=0x7f632c0b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6322000640 1 --2- 172.21.15.173:0/903882441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f632c0aeb90 0x7f632c0b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6322000640 1 -- 172.21.15.173:0/903882441 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c14e490 con 0x7f632c0aef70 2024-04-25T09:03:15.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6322000640 1 --2- 172.21.15.173:0/903882441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f632c0aef70 0x7f632c14bf40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f631400d830 tx=0x7f631400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6323400640 1 -- 172.21.15.173:0/903882441 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631400b6c0 con 0x7f632c0aef70 2024-04-25T09:03:15.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6323400640 1 -- 172.21.15.173:0/903882441 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6314019070 con 0x7f632c0aef70 2024-04-25T09:03:15.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6323400640 1 -- 172.21.15.173:0/903882441 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631400ba60 con 0x7f632c0aef70 2024-04-25T09:03:15.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6331600640 1 -- 172.21.15.173:0/903882441 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632c0b0d50 con 0x7f632c0aef70 2024-04-25T09:03:15.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6331600640 1 -- 172.21.15.173:0/903882441 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632c0b12e0 con 0x7f632c0aef70 2024-04-25T09:03:15.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6331600640 1 -- 172.21.15.173:0/903882441 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632c145340 con 0x7f632c0aef70 2024-04-25T09:03:15.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:15.998+0000 7f6323400640 1 -- 172.21.15.173:0/903882441 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f631401e460 con 0x7f632c0aef70 2024-04-25T09:03:15.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.002+0000 7f6323400640 1 --2- 172.21.15.173:0/903882441 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6308066f60 0x7f6308069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.002+0000 7f6323400640 1 -- 172.21.15.173:0/903882441 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6314085820 con 0x7f632c0aef70 2024-04-25T09:03:15.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.002+0000 7f632aa00640 1 --2- 172.21.15.173:0/903882441 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6308066f60 0x7f6308069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.002+0000 7f632aa00640 1 --2- 172.21.15.173:0/903882441 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6308066f60 0x7f6308069420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f631c007fd0 tx=0x7f631c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.006+0000 7f6323400640 1 -- 172.21.15.173:0/903882441 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f632c14e490 con 0x7f632c0aef70 2024-04-25T09:03:16.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.162+0000 7f6331600640 1 -- 172.21.15.173:0/903882441 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f632c073ab0 con 0x7f632c0aef70 2024-04-25T09:03:16.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.162+0000 7f6323400640 1 -- 172.21.15.173:0/903882441 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6314055f30 con 0x7f632c0aef70 2024-04-25T09:03:16.153 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:03:16.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.166+0000 7f6331600640 1 -- 172.21.15.173:0/903882441 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6308066f60 msgr2=0x7f6308069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.166+0000 7f6331600640 1 --2- 172.21.15.173:0/903882441 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6308066f60 0x7f6308069420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f631c007fd0 tx=0x7f631c009040 comp rx=0 tx=0).stop 2024-04-25T09:03:16.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.166+0000 7f6331600640 1 -- 172.21.15.173:0/903882441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f632c0aef70 msgr2=0x7f632c14bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.166+0000 7f6331600640 1 --2- 172.21.15.173:0/903882441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f632c0aef70 0x7f632c14bf40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f631400d830 tx=0x7f631400dcf0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.166+0000 7f6331600640 1 -- 172.21.15.173:0/903882441 shutdown_connections 2024-04-25T09:03:16.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.166+0000 7f6331600640 1 --2- 172.21.15.173:0/903882441 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6308066f60 0x7f6308069420 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.166+0000 7f6331600640 1 --2- 172.21.15.173:0/903882441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f632c0cc7e0 0x7f632c14c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.166+0000 7f6331600640 1 --2- 172.21.15.173:0/903882441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f632c0aef70 0x7f632c14bf40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.166+0000 7f6331600640 1 --2- 172.21.15.173:0/903882441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f632c0aeb90 0x7f632c0b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.166+0000 7f6331600640 1 -- 172.21.15.173:0/903882441 >> 172.21.15.173:0/903882441 conn(0x7f632c06ac90 msgr2=0x7f632c06e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.166+0000 7f6331600640 1 -- 172.21.15.173:0/903882441 shutdown_connections 2024-04-25T09:03:16.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.166+0000 7f6331600640 1 -- 172.21.15.173:0/903882441 wait complete. 2024-04-25T09:03:16.174 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:16.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.322+0000 7f7146400640 1 Processor -- start 2024-04-25T09:03:16.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.322+0000 7f7146400640 1 -- start start 2024-04-25T09:03:16.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.326+0000 7f7146400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7140099a50 0x7f7140099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.326+0000 7f7146400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f714006bda0 0x7f714015dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.326+0000 7f7146400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714009a370 con 0x7f714006c220 2024-04-25T09:03:16.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.326+0000 7f7146400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7140161570 con 0x7f714006bda0 2024-04-25T09:03:16.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.326+0000 7f7146400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7140161850 con 0x7f7140099a50 2024-04-25T09:03:16.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.326+0000 7f713fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f714006bda0 0x7f714015dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.326+0000 7f713fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f714006bda0 0x7f714015dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43102/0 (socket says 172.21.15.173:43102) 2024-04-25T09:03:16.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.326+0000 7f713fe00640 1 -- 172.21.15.173:0/4266602179 learned_addr learned my addr 172.21.15.173:0/4266602179 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:16.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.326+0000 7f7145000640 1 --2- 172.21.15.173:0/4266602179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7140099a50 0x7f7140099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.326+0000 7f713fe00640 1 -- 172.21.15.173:0/4266602179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7140099a50 msgr2=0x7f7140099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:16.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.326+0000 7f713fe00640 1 --2- 172.21.15.173:0/4266602179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7140099a50 0x7f7140099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.326+0000 7f713fe00640 1 -- 172.21.15.173:0/4266602179 >> v1:172.21.15.194:6789/0 conn(0x7f714006c220 legacy=0x7f714015e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:16.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.326+0000 7f713fe00640 1 -- 172.21.15.173:0/4266602179 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7140161b30 con 0x7f714006bda0 2024-04-25T09:03:16.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.326+0000 7f7145000640 1 --2- 172.21.15.173:0/4266602179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7140099a50 0x7f7140099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:16.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.326+0000 7f713fe00640 1 --2- 172.21.15.173:0/4266602179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f714006bda0 0x7f714015dd30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f712c009870 tx=0x7f712c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f6019cf3f2e42e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f713f400640 1 -- 172.21.15.173:0/4266602179 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c0b1070 con 0x7f714006bda0 2024-04-25T09:03:16.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f713f400640 1 -- 172.21.15.173:0/4266602179 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712c0ac620 con 0x7f714006bda0 2024-04-25T09:03:16.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f713f400640 1 -- 172.21.15.173:0/4266602179 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c0ac9f0 con 0x7f714006bda0 2024-04-25T09:03:16.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7146400640 1 -- 172.21.15.173:0/4266602179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f714006bda0 msgr2=0x7f714015dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7146400640 1 --2- 172.21.15.173:0/4266602179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f714006bda0 0x7f714015dd30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f712c009870 tx=0x7f712c01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7146400640 1 -- 172.21.15.173:0/4266602179 shutdown_connections 2024-04-25T09:03:16.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7146400640 1 --2- 172.21.15.173:0/4266602179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f714006bda0 0x7f714015dd30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7146400640 1 --2- 172.21.15.173:0/4266602179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7140099a50 0x7f7140099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7146400640 1 -- 172.21.15.173:0/4266602179 >> 172.21.15.173:0/4266602179 conn(0x7f71400b31d0 msgr2=0x7f71400b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7146400640 1 -- 172.21.15.173:0/4266602179 shutdown_connections 2024-04-25T09:03:16.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7146400640 1 -- 172.21.15.173:0/4266602179 wait complete. 2024-04-25T09:03:16.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7146400640 1 Processor -- start 2024-04-25T09:03:16.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7146400640 1 -- start start 2024-04-25T09:03:16.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7146400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f714006bda0 0x7f714014fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7146400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f714006c220 0x7f714015c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7146400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7140099a50 0x7f7140153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7146400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714009ae40 con 0x7f714006bda0 2024-04-25T09:03:16.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7146400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714009acc0 con 0x7f7140099a50 2024-04-25T09:03:16.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7146400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714016b120 con 0x7f714006c220 2024-04-25T09:03:16.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7145000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f714006bda0 0x7f714014fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7145000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f714006bda0 0x7f714014fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43108/0 (socket says 172.21.15.173:43108) 2024-04-25T09:03:16.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7145000640 1 -- 172.21.15.173:0/391125304 learned_addr learned my addr 172.21.15.173:0/391125304 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:16.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f713fe00640 1 --2- 172.21.15.173:0/391125304 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f714006c220 0x7f714015c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.330+0000 7f7145a00640 1 --2- 172.21.15.173:0/391125304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7140099a50 0x7f7140153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.334+0000 7f7145000640 1 -- 172.21.15.173:0/391125304 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f714006c220 msgr2=0x7f714015c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.334+0000 7f7145000640 1 --2- 172.21.15.173:0/391125304 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f714006c220 0x7f714015c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.334+0000 7f7145000640 1 -- 172.21.15.173:0/391125304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7140099a50 msgr2=0x7f7140153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.334+0000 7f7145000640 1 --2- 172.21.15.173:0/391125304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7140099a50 0x7f7140153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.334+0000 7f7145000640 1 -- 172.21.15.173:0/391125304 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7140150310 con 0x7f714006bda0 2024-04-25T09:03:16.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.334+0000 7f7145000640 1 --2- 172.21.15.173:0/391125304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f714006bda0 0x7f714014fa50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f713000c7c0 tx=0x7f713000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.334+0000 7f713cc00640 1 -- 172.21.15.173:0/391125304 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130007a30 con 0x7f714006bda0 2024-04-25T09:03:16.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.334+0000 7f713cc00640 1 -- 172.21.15.173:0/391125304 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7130007bd0 con 0x7f714006bda0 2024-04-25T09:03:16.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.334+0000 7f7146400640 1 -- 172.21.15.173:0/391125304 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714015cec0 con 0x7f714006bda0 2024-04-25T09:03:16.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.334+0000 7f713cc00640 1 -- 172.21.15.173:0/391125304 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71300113f0 con 0x7f714006bda0 2024-04-25T09:03:16.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.334+0000 7f7146400640 1 -- 172.21.15.173:0/391125304 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714015d480 con 0x7f714006bda0 2024-04-25T09:03:16.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.334+0000 7f7146400640 1 -- 172.21.15.173:0/391125304 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7140073a40 con 0x7f714006bda0 2024-04-25T09:03:16.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.334+0000 7f713cc00640 1 -- 172.21.15.173:0/391125304 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7130011590 con 0x7f714006bda0 2024-04-25T09:03:16.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.334+0000 7f713cc00640 1 --2- 172.21.15.173:0/391125304 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7120066f60 0x7f7120069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.334+0000 7f713cc00640 1 -- 172.21.15.173:0/391125304 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7130085560 con 0x7f714006bda0 2024-04-25T09:03:16.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.338+0000 7f713fe00640 1 --2- 172.21.15.173:0/391125304 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7120066f60 0x7f7120069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.338+0000 7f713fe00640 1 --2- 172.21.15.173:0/391125304 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7120066f60 0x7f7120069420 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f712c0ae000 tx=0x7f712c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.338+0000 7f713cc00640 1 -- 172.21.15.173:0/391125304 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7130015020 con 0x7f714006bda0 2024-04-25T09:03:16.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.494+0000 7f7146400640 1 -- 172.21.15.173:0/391125304 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f71400d10a0 con 0x7f714006bda0 2024-04-25T09:03:16.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.494+0000 7f713cc00640 1 -- 172.21.15.173:0/391125304 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7130055b40 con 0x7f714006bda0 2024-04-25T09:03:16.485 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:16.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.498+0000 7f7146400640 1 -- 172.21.15.173:0/391125304 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7120066f60 msgr2=0x7f7120069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.498+0000 7f7146400640 1 --2- 172.21.15.173:0/391125304 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7120066f60 0x7f7120069420 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f712c0ae000 tx=0x7f712c008040 comp rx=0 tx=0).stop 2024-04-25T09:03:16.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.498+0000 7f7146400640 1 -- 172.21.15.173:0/391125304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f714006bda0 msgr2=0x7f714014fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.498+0000 7f7146400640 1 --2- 172.21.15.173:0/391125304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f714006bda0 0x7f714014fa50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f713000c7c0 tx=0x7f713000cc80 comp rx=0 tx=0).stop 2024-04-25T09:03:16.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.498+0000 7f7146400640 1 -- 172.21.15.173:0/391125304 shutdown_connections 2024-04-25T09:03:16.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.498+0000 7f7146400640 1 --2- 172.21.15.173:0/391125304 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7120066f60 0x7f7120069420 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.498+0000 7f7146400640 1 --2- 172.21.15.173:0/391125304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7140099a50 0x7f7140153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.498+0000 7f7146400640 1 --2- 172.21.15.173:0/391125304 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f714006c220 0x7f714015c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.498+0000 7f7146400640 1 --2- 172.21.15.173:0/391125304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f714006bda0 0x7f714014fa50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.498+0000 7f7146400640 1 -- 172.21.15.173:0/391125304 >> 172.21.15.173:0/391125304 conn(0x7f71400b31d0 msgr2=0x7f714015ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.498+0000 7f7146400640 1 -- 172.21.15.173:0/391125304 shutdown_connections 2024-04-25T09:03:16.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.498+0000 7f7146400640 1 -- 172.21.15.173:0/391125304 wait complete. 2024-04-25T09:03:16.506 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:16.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.654+0000 7fc013600640 1 Processor -- start 2024-04-25T09:03:16.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.654+0000 7fc013600640 1 -- start start 2024-04-25T09:03:16.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.658+0000 7fc013600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc00c0aeb90 0x7fc00c0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.658+0000 7fc013600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc00c0aef70 0x7fc00c0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.658+0000 7fc013600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00c071570 con 0x7fc00c0cdba0 2024-04-25T09:03:16.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.658+0000 7fc013600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00c071320 con 0x7fc00c0aef70 2024-04-25T09:03:16.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.658+0000 7fc013600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c072330 con 0x7fc00c0aeb90 2024-04-25T09:03:16.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.658+0000 7fc011600640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc00c0cdba0 0x7fc00c0ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38984/0 (socket says 172.21.15.173:38984) 2024-04-25T09:03:16.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.658+0000 7fc011600640 1 -- 172.21.15.173:0/810452533 learned_addr learned my addr 172.21.15.173:0/810452533 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:16.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.658+0000 7fc00be00640 1 --2- 172.21.15.173:0/810452533 >> v2:172.21.15.194:3300/0 conn(0x7fc00c0aef70 0x7fc00c0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.658+0000 7fc010c00640 1 --2- 172.21.15.173:0/810452533 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc00c0aeb90 0x7fc00c0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.658+0000 7fc00b400640 1 -- 172.21.15.173:0/810452533 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435818828 0 0) 0x7fc00c071570 con 0x7fc00c0cdba0 2024-04-25T09:03:16.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.658+0000 7fc00b400640 1 -- 172.21.15.173:0/810452533 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff4003530 con 0x7fc00c0cdba0 2024-04-25T09:03:16.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.658+0000 7fc00be00640 1 -- 172.21.15.173:0/810452533 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc00c0aeb90 msgr2=0x7fc00c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:16.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.658+0000 7fc00be00640 1 --2- 172.21.15.173:0/810452533 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc00c0aeb90 0x7fc00c0cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.658+0000 7fc00be00640 1 -- 172.21.15.173:0/810452533 >> v1:172.21.15.173:6789/0 conn(0x7fc00c0cdba0 legacy=0x7fc00c0ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.658+0000 7fc00be00640 1 -- 172.21.15.173:0/810452533 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c071850 con 0x7fc00c0aef70 2024-04-25T09:03:16.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.658+0000 7fc00be00640 1 --2- 172.21.15.173:0/810452533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc00c0aef70 0x7fc00c0cc610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbff80097c0 tx=0x7fbff801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abec7792338d03be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc00b400640 1 -- 172.21.15.173:0/810452533 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff80b0070 con 0x7fc00c0aef70 2024-04-25T09:03:16.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc00b400640 1 -- 172.21.15.173:0/810452533 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff80ab600 con 0x7fc00c0aef70 2024-04-25T09:03:16.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc00b400640 1 -- 172.21.15.173:0/810452533 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff80ab9d0 con 0x7fc00c0aef70 2024-04-25T09:03:16.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc013600640 1 -- 172.21.15.173:0/810452533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc00c0aef70 msgr2=0x7fc00c0cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc013600640 1 --2- 172.21.15.173:0/810452533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc00c0aef70 0x7fc00c0cc610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbff80097c0 tx=0x7fbff801c3e0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc013600640 1 -- 172.21.15.173:0/810452533 shutdown_connections 2024-04-25T09:03:16.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc013600640 1 --2- 172.21.15.173:0/810452533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc00c0aef70 0x7fc00c0cc610 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc013600640 1 --2- 172.21.15.173:0/810452533 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc00c0aeb90 0x7fc00c0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc013600640 1 -- 172.21.15.173:0/810452533 >> 172.21.15.173:0/810452533 conn(0x7fc00c06ac90 msgr2=0x7fc00c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc013600640 1 -- 172.21.15.173:0/810452533 shutdown_connections 2024-04-25T09:03:16.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc013600640 1 -- 172.21.15.173:0/810452533 wait complete. 2024-04-25T09:03:16.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc013600640 1 Processor -- start 2024-04-25T09:03:16.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc013600640 1 -- start start 2024-04-25T09:03:16.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc013600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc00c0aeb90 0x7fc00c1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc013600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc00c0aef70 0x7fc00c157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc013600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc00c0cdba0 0x7fc00c13d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc013600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c15bb30 con 0x7fc00c0aef70 2024-04-25T09:03:16.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc013600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c15b9b0 con 0x7fc00c0cdba0 2024-04-25T09:03:16.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc013600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c15bcb0 con 0x7fc00c0aeb90 2024-04-25T09:03:16.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc00be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc00c0aef70 0x7fc00c157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc00be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc00c0aef70 0x7fc00c157fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43120/0 (socket says 172.21.15.173:43120) 2024-04-25T09:03:16.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc00be00640 1 -- 172.21.15.173:0/3887020899 learned_addr learned my addr 172.21.15.173:0/3887020899 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:16.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc010c00640 1 --2- 172.21.15.173:0/3887020899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc00c0aeb90 0x7fc00c1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.662+0000 7fc011600640 1 --2- 172.21.15.173:0/3887020899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc00c0cdba0 0x7fc00c13d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.666+0000 7fc00be00640 1 -- 172.21.15.173:0/3887020899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc00c0aeb90 msgr2=0x7fc00c1555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.666+0000 7fc00be00640 1 --2- 172.21.15.173:0/3887020899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc00c0aeb90 0x7fc00c1555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.666+0000 7fc00be00640 1 -- 172.21.15.173:0/3887020899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc00c0cdba0 msgr2=0x7fc00c13d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.666+0000 7fc00be00640 1 --2- 172.21.15.173:0/3887020899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc00c0cdba0 0x7fc00c13d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.666+0000 7fc00be00640 1 -- 172.21.15.173:0/3887020899 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c13d650 con 0x7fc00c0aef70 2024-04-25T09:03:16.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.666+0000 7fc00be00640 1 --2- 172.21.15.173:0/3887020899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc00c0aef70 0x7fc00c157fb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbff80ae040 tx=0x7fbff8019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.666+0000 7fc008c00640 1 -- 172.21.15.173:0/3887020899 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff80b0040 con 0x7fc00c0aef70 2024-04-25T09:03:16.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.666+0000 7fc008c00640 1 -- 172.21.15.173:0/3887020899 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff80b9070 con 0x7fc00c0aef70 2024-04-25T09:03:16.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.666+0000 7fc008c00640 1 -- 172.21.15.173:0/3887020899 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff80b4690 con 0x7fc00c0aef70 2024-04-25T09:03:16.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.666+0000 7fc013600640 1 -- 172.21.15.173:0/3887020899 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00c156000 con 0x7fc00c0aef70 2024-04-25T09:03:16.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.666+0000 7fc013600640 1 -- 172.21.15.173:0/3887020899 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00c1565c0 con 0x7fc00c0aef70 2024-04-25T09:03:16.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.666+0000 7fc013600640 1 -- 172.21.15.173:0/3887020899 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc00c073ab0 con 0x7fc00c0aef70 2024-04-25T09:03:16.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.666+0000 7fc008c00640 1 -- 172.21.15.173:0/3887020899 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbff80b4830 con 0x7fc00c0aef70 2024-04-25T09:03:16.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.666+0000 7fc008c00640 1 --2- 172.21.15.173:0/3887020899 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbfec066f60 0x7fbfec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.666+0000 7fc008c00640 1 -- 172.21.15.173:0/3887020899 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbff811f0f0 con 0x7fc00c0aef70 2024-04-25T09:03:16.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.666+0000 7fc010c00640 1 --2- 172.21.15.173:0/3887020899 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbfec066f60 0x7fbfec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.670+0000 7fc010c00640 1 --2- 172.21.15.173:0/3887020899 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbfec066f60 0x7fbfec069420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc000009a50 tx=0x7fc000008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.670+0000 7fc008c00640 1 -- 172.21.15.173:0/3887020899 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbff8016090 con 0x7fc00c0aef70 2024-04-25T09:03:16.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.826+0000 7fc013600640 1 -- 172.21.15.173:0/3887020899 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc00c14dff0 con 0x7fc00c0aef70 2024-04-25T09:03:16.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.826+0000 7fc008c00640 1 -- 172.21.15.173:0/3887020899 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbff80efd20 con 0x7fc00c0aef70 2024-04-25T09:03:16.816 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:03:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.830+0000 7fc013600640 1 -- 172.21.15.173:0/3887020899 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbfec066f60 msgr2=0x7fbfec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.830+0000 7fc013600640 1 --2- 172.21.15.173:0/3887020899 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbfec066f60 0x7fbfec069420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc000009a50 tx=0x7fc000008040 comp rx=0 tx=0).stop 2024-04-25T09:03:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.830+0000 7fc013600640 1 -- 172.21.15.173:0/3887020899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc00c0aef70 msgr2=0x7fc00c157fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.830+0000 7fc013600640 1 --2- 172.21.15.173:0/3887020899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc00c0aef70 0x7fc00c157fb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbff80ae040 tx=0x7fbff8019180 comp rx=0 tx=0).stop 2024-04-25T09:03:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.830+0000 7fc013600640 1 -- 172.21.15.173:0/3887020899 shutdown_connections 2024-04-25T09:03:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.830+0000 7fc013600640 1 --2- 172.21.15.173:0/3887020899 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbfec066f60 0x7fbfec069420 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.830+0000 7fc013600640 1 --2- 172.21.15.173:0/3887020899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc00c0cdba0 0x7fc00c13d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.830+0000 7fc013600640 1 --2- 172.21.15.173:0/3887020899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc00c0aef70 0x7fc00c157fb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.830+0000 7fc013600640 1 --2- 172.21.15.173:0/3887020899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc00c0aeb90 0x7fc00c1555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.830+0000 7fc013600640 1 -- 172.21.15.173:0/3887020899 >> 172.21.15.173:0/3887020899 conn(0x7fc00c06ac90 msgr2=0x7fc00c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.830+0000 7fc013600640 1 -- 172.21.15.173:0/3887020899 shutdown_connections 2024-04-25T09:03:16.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.830+0000 7fc013600640 1 -- 172.21.15.173:0/3887020899 wait complete. 2024-04-25T09:03:16.837 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:03:16.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.986+0000 7f4063200640 1 Processor -- start 2024-04-25T09:03:16.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.986+0000 7f4063200640 1 -- start start 2024-04-25T09:03:16.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.986+0000 7f4063200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f405c15bab0 0x7f405c0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.986+0000 7f4063200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f405c0cd840 0x7f405c099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.986+0000 7f4063200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f405c099f90 0x7f405c0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.986+0000 7f4063200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405c0d07e0 con 0x7f405c0cd840 2024-04-25T09:03:16.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.986+0000 7f4063200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405c0cc7a0 con 0x7f405c15bab0 2024-04-25T09:03:16.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.986+0000 7f4063200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0cca80 con 0x7f405c099f90 2024-04-25T09:03:16.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.986+0000 7f4053400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f405c0cd840 0x7f405c099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.986+0000 7f4053400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f405c0cd840 0x7f405c099a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43134/0 (socket says 172.21.15.173:43134) 2024-04-25T09:03:16.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.986+0000 7f4053400640 1 -- 172.21.15.173:0/3626810081 learned_addr learned my addr 172.21.15.173:0/3626810081 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:16.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.986+0000 7f405be00640 1 --2- 172.21.15.173:0/3626810081 >> v2:172.21.15.194:3300/0 conn(0x7f405c15bab0 0x7f405c0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.986+0000 7f4061200640 1 --2- 172.21.15.173:0/3626810081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f405c099f90 0x7f405c0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.986+0000 7f4053400640 1 -- 172.21.15.173:0/3626810081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f405c099f90 msgr2=0x7f405c0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:16.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.986+0000 7f4053400640 1 --2- 172.21.15.173:0/3626810081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f405c099f90 0x7f405c0c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.986+0000 7f4053400640 1 -- 172.21.15.173:0/3626810081 >> v2:172.21.15.194:3300/0 conn(0x7f405c15bab0 msgr2=0x7f405c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:16.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.986+0000 7f4053400640 1 --2- 172.21.15.173:0/3626810081 >> v2:172.21.15.194:3300/0 conn(0x7f405c15bab0 0x7f405c0d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.986+0000 7f4053400640 1 -- 172.21.15.173:0/3626810081 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c0ccd60 con 0x7f405c0cd840 2024-04-25T09:03:16.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.990+0000 7f4053400640 1 --2- 172.21.15.173:0/3626810081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f405c0cd840 0x7f405c099a50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f405c072b30 tx=0x7f404c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d39353ff8deedd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.990+0000 7f405b400640 1 -- 172.21.15.173:0/3626810081 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c0b1070 con 0x7f405c0cd840 2024-04-25T09:03:16.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.990+0000 7f405b400640 1 -- 172.21.15.173:0/3626810081 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c0ac630 con 0x7f405c0cd840 2024-04-25T09:03:16.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.990+0000 7f405b400640 1 -- 172.21.15.173:0/3626810081 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c0a8050 con 0x7f405c0cd840 2024-04-25T09:03:16.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.990+0000 7f4063200640 1 -- 172.21.15.173:0/3626810081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f405c0cd840 msgr2=0x7f405c099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.990+0000 7f4063200640 1 --2- 172.21.15.173:0/3626810081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f405c0cd840 0x7f405c099a50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f405c072b30 tx=0x7f404c01c520 comp rx=0 tx=0).stop 2024-04-25T09:03:16.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.990+0000 7f4063200640 1 -- 172.21.15.173:0/3626810081 shutdown_connections 2024-04-25T09:03:16.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.990+0000 7f4063200640 1 --2- 172.21.15.173:0/3626810081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f405c099f90 0x7f405c0c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.990+0000 7f4063200640 1 --2- 172.21.15.173:0/3626810081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f405c0cd840 0x7f405c099a50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.990+0000 7f4063200640 1 --2- 172.21.15.173:0/3626810081 >> v2:172.21.15.194:3300/0 conn(0x7f405c15bab0 0x7f405c0d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.990+0000 7f4063200640 1 -- 172.21.15.173:0/3626810081 >> 172.21.15.173:0/3626810081 conn(0x7f405c0b32a0 msgr2=0x7f405c0b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.990+0000 7f4063200640 1 -- 172.21.15.173:0/3626810081 shutdown_connections 2024-04-25T09:03:16.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.990+0000 7f4063200640 1 -- 172.21.15.173:0/3626810081 wait complete. 2024-04-25T09:03:16.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f4063200640 1 Processor -- start 2024-04-25T09:03:16.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f4063200640 1 -- start start 2024-04-25T09:03:16.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f4063200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f405c099f90 0x7f405c0cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f4063200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f405c0cd840 0x7f405c0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f4063200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f405c15bab0 0x7f405c1559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f4063200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0cc540 con 0x7f405c099f90 2024-04-25T09:03:16.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f4063200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0cc3c0 con 0x7f405c0cd840 2024-04-25T09:03:16.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f4063200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0cf540 con 0x7f405c15bab0 2024-04-25T09:03:16.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f405be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f405c099f90 0x7f405c0cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f405be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f405c099f90 0x7f405c0cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43136/0 (socket says 172.21.15.173:43136) 2024-04-25T09:03:16.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f405be00640 1 -- 172.21.15.173:0/2610749665 learned_addr learned my addr 172.21.15.173:0/2610749665 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:16.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f405be00640 1 -- 172.21.15.173:0/2610749665 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f405c15bab0 msgr2=0x7f405c1559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f405be00640 1 --2- 172.21.15.173:0/2610749665 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f405c15bab0 0x7f405c1559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f405be00640 1 -- 172.21.15.173:0/2610749665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f405c0cd840 msgr2=0x7f405c0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f4053400640 1 --2- 172.21.15.173:0/2610749665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f405c0cd840 0x7f405c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f405be00640 1 --2- 172.21.15.173:0/2610749665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f405c0cd840 0x7f405c0ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f405be00640 1 -- 172.21.15.173:0/2610749665 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c1589d0 con 0x7f405c099f90 2024-04-25T09:03:16.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f4053400640 1 --2- 172.21.15.173:0/2610749665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f405c0cd840 0x7f405c0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:16.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f405be00640 1 --2- 172.21.15.173:0/2610749665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f405c099f90 0x7f405c0cac10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f404400e7f0 tx=0x7f404400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f4058c00640 1 -- 172.21.15.173:0/2610749665 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4044017070 con 0x7f405c099f90 2024-04-25T09:03:16.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f4058c00640 1 -- 172.21.15.173:0/2610749665 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404400ee40 con 0x7f405c099f90 2024-04-25T09:03:16.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f4058c00640 1 -- 172.21.15.173:0/2610749665 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404400cb40 con 0x7f405c099f90 2024-04-25T09:03:16.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f4063200640 1 -- 172.21.15.173:0/2610749665 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405c158430 con 0x7f405c099f90 2024-04-25T09:03:16.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.994+0000 7f4063200640 1 -- 172.21.15.173:0/2610749665 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405c0b44e0 con 0x7f405c099f90 2024-04-25T09:03:16.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.998+0000 7f4063200640 1 -- 172.21.15.173:0/2610749665 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405c073ab0 con 0x7f405c099f90 2024-04-25T09:03:16.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.998+0000 7f4058c00640 1 -- 172.21.15.173:0/2610749665 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f404401a070 con 0x7f405c099f90 2024-04-25T09:03:16.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.998+0000 7f4058c00640 1 --2- 172.21.15.173:0/2610749665 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4038066f60 0x7f4038069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.998+0000 7f4058c00640 1 -- 172.21.15.173:0/2610749665 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4044085270 con 0x7f405c099f90 2024-04-25T09:03:16.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.998+0000 7f4053400640 1 --2- 172.21.15.173:0/2610749665 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4038066f60 0x7f4038069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:16.998+0000 7f4053400640 1 --2- 172.21.15.173:0/2610749665 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4038066f60 0x7f4038069420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f404c0ae000 tx=0x7f404c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.002+0000 7f4058c00640 1 -- 172.21.15.173:0/2610749665 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4044055e10 con 0x7f405c099f90 2024-04-25T09:03:17.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.158+0000 7f4063200640 1 -- 172.21.15.173:0/2610749665 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f405c070ed0 con 0x7f405c099f90 2024-04-25T09:03:17.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.158+0000 7f4058c00640 1 -- 172.21.15.173:0/2610749665 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4044055710 con 0x7f405c099f90 2024-04-25T09:03:17.147 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:17.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.158+0000 7f4063200640 1 -- 172.21.15.173:0/2610749665 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4038066f60 msgr2=0x7f4038069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.158+0000 7f4063200640 1 --2- 172.21.15.173:0/2610749665 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4038066f60 0x7f4038069420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f404c0ae000 tx=0x7f404c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:03:17.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.158+0000 7f4063200640 1 -- 172.21.15.173:0/2610749665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f405c099f90 msgr2=0x7f405c0cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.158+0000 7f4063200640 1 --2- 172.21.15.173:0/2610749665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f405c099f90 0x7f405c0cac10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f404400e7f0 tx=0x7f404400ebf0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.158+0000 7f4063200640 1 -- 172.21.15.173:0/2610749665 shutdown_connections 2024-04-25T09:03:17.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.158+0000 7f4063200640 1 --2- 172.21.15.173:0/2610749665 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4038066f60 0x7f4038069420 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.158+0000 7f4063200640 1 --2- 172.21.15.173:0/2610749665 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f405c15bab0 0x7f405c1559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.158+0000 7f4063200640 1 --2- 172.21.15.173:0/2610749665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f405c0cd840 0x7f405c0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.158+0000 7f4063200640 1 --2- 172.21.15.173:0/2610749665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f405c099f90 0x7f405c0cac10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.158+0000 7f4063200640 1 -- 172.21.15.173:0/2610749665 >> 172.21.15.173:0/2610749665 conn(0x7f405c0b32a0 msgr2=0x7f405c0d0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.158+0000 7f4063200640 1 -- 172.21.15.173:0/2610749665 shutdown_connections 2024-04-25T09:03:17.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.158+0000 7f4063200640 1 -- 172.21.15.173:0/2610749665 wait complete. 2024-04-25T09:03:17.168 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:17.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.314+0000 7fc4e4a00640 1 Processor -- start 2024-04-25T09:03:17.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.314+0000 7fc4e4a00640 1 -- start start 2024-04-25T09:03:17.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.314+0000 7fc4e4a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc4e00b27b0 0x7fc4e00cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.314+0000 7fc4e4a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e00cc100 0x7fc4e00cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.314+0000 7fc4e4a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e00cbc20 con 0x7fc4e015dd40 2024-04-25T09:03:17.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.314+0000 7fc4e4a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e015e120 con 0x7fc4e00b27b0 2024-04-25T09:03:17.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.314+0000 7fc4e4a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e006d390 con 0x7fc4e00cc100 2024-04-25T09:03:17.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.314+0000 7fc4dde00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc4e00b27b0 0x7fc4e00cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.314+0000 7fc4de800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc4e015dd40 0x7fc4e00cf6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38994/0 (socket says 172.21.15.173:38994) 2024-04-25T09:03:17.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.314+0000 7fc4de800640 1 -- 172.21.15.173:0/2563766510 learned_addr learned my addr 172.21.15.173:0/2563766510 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:17.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.314+0000 7fc4dde00640 1 --2- 172.21.15.173:0/2563766510 >> v2:172.21.15.173:3300/0 conn(0x7fc4e00b27b0 0x7fc4e00cfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43142/0 (socket says 172.21.15.173:43142) 2024-04-25T09:03:17.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.318+0000 7fc4df200640 1 --2- 172.21.15.173:0/2563766510 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e00cc100 0x7fc4e00cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.318+0000 7fc4dde00640 1 -- 172.21.15.173:0/2563766510 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e00cc100 msgr2=0x7fc4e00cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.318+0000 7fc4dde00640 1 --2- 172.21.15.173:0/2563766510 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e00cc100 0x7fc4e00cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.318+0000 7fc4dde00640 1 -- 172.21.15.173:0/2563766510 >> v1:172.21.15.173:6789/0 conn(0x7fc4e015dd40 legacy=0x7fc4e00cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.318+0000 7fc4dde00640 1 -- 172.21.15.173:0/2563766510 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e006d670 con 0x7fc4e00b27b0 2024-04-25T09:03:17.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.318+0000 7fc4dd400640 1 -- 172.21.15.173:0/2563766510 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089285710 0 0) 0x7fc4e00cbc20 con 0x7fc4e015dd40 2024-04-25T09:03:17.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.318+0000 7fc4dde00640 1 --2- 172.21.15.173:0/2563766510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4e00b27b0 0x7fc4e00cfdf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc0097c0 tx=0x7fc4cc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a08ca82066fe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.318+0000 7fc4dd400640 1 -- 172.21.15.173:0/2563766510 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc0a7070 con 0x7fc4e00b27b0 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.318+0000 7fc4dd400640 1 -- 172.21.15.173:0/2563766510 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc0b0070 con 0x7fc4e00b27b0 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.318+0000 7fc4dd400640 1 -- 172.21.15.173:0/2563766510 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc0ab890 con 0x7fc4e00b27b0 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.318+0000 7fc4e4a00640 1 -- 172.21.15.173:0/2563766510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4e00b27b0 msgr2=0x7fc4e00cfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.318+0000 7fc4e4a00640 1 --2- 172.21.15.173:0/2563766510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4e00b27b0 0x7fc4e00cfdf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc0097c0 tx=0x7fc4cc01c470 comp rx=0 tx=0).stop 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4e4a00640 1 -- 172.21.15.173:0/2563766510 shutdown_connections 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4e4a00640 1 --2- 172.21.15.173:0/2563766510 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e00cc100 0x7fc4e00cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4e4a00640 1 --2- 172.21.15.173:0/2563766510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4e00b27b0 0x7fc4e00cfdf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4e4a00640 1 -- 172.21.15.173:0/2563766510 >> 172.21.15.173:0/2563766510 conn(0x7fc4e00b30c0 msgr2=0x7fc4e00b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4e4a00640 1 -- 172.21.15.173:0/2563766510 shutdown_connections 2024-04-25T09:03:17.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4e4a00640 1 -- 172.21.15.173:0/2563766510 wait complete. 2024-04-25T09:03:17.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4e4a00640 1 Processor -- start 2024-04-25T09:03:17.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4e4a00640 1 -- start start 2024-04-25T09:03:17.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4e4a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e00b27b0 0x7fc4e015b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4e4a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e00cc100 0x7fc4e00c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4e4a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4e015dd40 0x7fc4e00c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4e4a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e006d130 con 0x7fc4e015dd40 2024-04-25T09:03:17.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4e4a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e006cfb0 con 0x7fc4e00cc100 2024-04-25T09:03:17.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4e4a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e016a880 con 0x7fc4e00b27b0 2024-04-25T09:03:17.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4df200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4e015dd40 0x7fc4e00c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4df200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4e015dd40 0x7fc4e00c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43150/0 (socket says 172.21.15.173:43150) 2024-04-25T09:03:17.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4df200640 1 -- 172.21.15.173:0/1142780470 learned_addr learned my addr 172.21.15.173:0/1142780470 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:17.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4de800640 1 --2- 172.21.15.173:0/1142780470 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e00b27b0 0x7fc4e015b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4df200640 1 -- 172.21.15.173:0/1142780470 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e00b27b0 msgr2=0x7fc4e015b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4df200640 1 --2- 172.21.15.173:0/1142780470 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e00b27b0 0x7fc4e015b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4dde00640 1 --2- 172.21.15.173:0/1142780470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e00cc100 0x7fc4e00c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4df200640 1 -- 172.21.15.173:0/1142780470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e00cc100 msgr2=0x7fc4e00c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4df200640 1 --2- 172.21.15.173:0/1142780470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e00cc100 0x7fc4e00c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4df200640 1 -- 172.21.15.173:0/1142780470 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e015acd0 con 0x7fc4e015dd40 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4dde00640 1 --2- 172.21.15.173:0/1142780470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e00cc100 0x7fc4e00c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.322+0000 7fc4df200640 1 --2- 172.21.15.173:0/1142780470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4e015dd40 0x7fc4e00c8be0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800d560 tx=0x7fc4d800da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.326+0000 7fc4d6a00640 1 -- 172.21.15.173:0/1142780470 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d80125f0 con 0x7fc4e015dd40 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.326+0000 7fc4d6a00640 1 -- 172.21.15.173:0/1142780470 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d8019070 con 0x7fc4e015dd40 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.326+0000 7fc4d6a00640 1 -- 172.21.15.173:0/1142780470 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d80129f0 con 0x7fc4e015dd40 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.326+0000 7fc4e4a00640 1 -- 172.21.15.173:0/1142780470 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e00cb000 con 0x7fc4e015dd40 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.326+0000 7fc4e4a00640 1 -- 172.21.15.173:0/1142780470 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e015af70 con 0x7fc4e015dd40 2024-04-25T09:03:17.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.326+0000 7fc4e4a00640 1 -- 172.21.15.173:0/1142780470 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e0073a40 con 0x7fc4e015dd40 2024-04-25T09:03:17.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.326+0000 7fc4d6a00640 1 -- 172.21.15.173:0/1142780470 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc4d8012b90 con 0x7fc4e015dd40 2024-04-25T09:03:17.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.326+0000 7fc4d6a00640 1 --2- 172.21.15.173:0/1142780470 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc4c0066f60 0x7fc4c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.326+0000 7fc4d6a00640 1 -- 172.21.15.173:0/1142780470 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc4d8085770 con 0x7fc4e015dd40 2024-04-25T09:03:17.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.326+0000 7fc4de800640 1 --2- 172.21.15.173:0/1142780470 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc4c0066f60 0x7fc4c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.326+0000 7fc4de800640 1 --2- 172.21.15.173:0/1142780470 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc4c0066f60 0x7fc4c0069420 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00012f0 tx=0x7fc4d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.330+0000 7fc4d6a00640 1 -- 172.21.15.173:0/1142780470 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc4d8056430 con 0x7fc4e015dd40 2024-04-25T09:03:17.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.518+0000 7fc4e4a00640 1 -- 172.21.15.173:0/1142780470 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4e00cb520 con 0x7fc4e015dd40 2024-04-25T09:03:17.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.518+0000 7fc4d6a00640 1 -- 172.21.15.173:0/1142780470 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4946 (secure 0 0 0) 0x7fc4d8055d30 con 0x7fc4e015dd40 2024-04-25T09:03:17.507 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:17.507 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2883565303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2883565303},{"type":"v1","addr":"172.21.15.194:6834","nonce":2883565303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2634963400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2634963400},{"type":"v1","addr":"172.21.15.173:6837","nonce":2634963400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3101502434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3101502434},{"type":"v1","addr":"172.21.15.173:6836","nonce":3101502434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:51.389514+0000","modified":"2024-04-25T09:03:08.473956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/4160663138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4160663138},{"type":"v1","addr":"172.21.15.194:6835","nonce":4160663138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:03:17.507 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 9 2024-04-25T09:03:17.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.518+0000 7fc4e4a00640 1 -- 172.21.15.173:0/1142780470 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc4c0066f60 msgr2=0x7fc4c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.518+0000 7fc4e4a00640 1 --2- 172.21.15.173:0/1142780470 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc4c0066f60 0x7fc4c0069420 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00012f0 tx=0x7fc4d0009040 comp rx=0 tx=0).stop 2024-04-25T09:03:17.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.518+0000 7fc4e4a00640 1 -- 172.21.15.173:0/1142780470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4e015dd40 msgr2=0x7fc4e00c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.518+0000 7fc4e4a00640 1 --2- 172.21.15.173:0/1142780470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4e015dd40 0x7fc4e00c8be0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800d560 tx=0x7fc4d800da20 comp rx=0 tx=0).stop 2024-04-25T09:03:17.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.518+0000 7fc4e4a00640 1 -- 172.21.15.173:0/1142780470 shutdown_connections 2024-04-25T09:03:17.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.518+0000 7fc4e4a00640 1 --2- 172.21.15.173:0/1142780470 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc4c0066f60 0x7fc4c0069420 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.518+0000 7fc4e4a00640 1 --2- 172.21.15.173:0/1142780470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4e015dd40 0x7fc4e00c8be0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.518+0000 7fc4e4a00640 1 --2- 172.21.15.173:0/1142780470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e00cc100 0x7fc4e00c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.518+0000 7fc4e4a00640 1 --2- 172.21.15.173:0/1142780470 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e00b27b0 0x7fc4e015b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.518+0000 7fc4e4a00640 1 -- 172.21.15.173:0/1142780470 >> 172.21.15.173:0/1142780470 conn(0x7fc4e00b30c0 msgr2=0x7fc4e00cf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.518+0000 7fc4e4a00640 1 -- 172.21.15.173:0/1142780470 shutdown_connections 2024-04-25T09:03:17.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.518+0000 7fc4e4a00640 1 -- 172.21.15.173:0/1142780470 wait complete. 2024-04-25T09:03:17.528 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:17.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.674+0000 7fc74c200640 1 Processor -- start 2024-04-25T09:03:17.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.674+0000 7fc74c200640 1 -- start start 2024-04-25T09:03:17.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.674+0000 7fc74c200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc74415ba20 0x7fc74415be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.674+0000 7fc74c200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc7440b7550 0x7fc7440d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.674+0000 7fc74c200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74415c460 con 0x7fc7440b70f0 2024-04-25T09:03:17.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.674+0000 7fc74c200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74415c740 con 0x7fc7440b7550 2024-04-25T09:03:17.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.674+0000 7fc74c200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74415ca20 con 0x7fc74415ba20 2024-04-25T09:03:17.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.674+0000 7fc74a200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc7440b7550 0x7fc7440d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.674+0000 7fc749800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc74415ba20 0x7fc74415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.674+0000 7fc749800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc74415ba20 0x7fc74415be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:37674/0 (socket says 172.21.15.173:37674) 2024-04-25T09:03:17.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.674+0000 7fc74a200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc7440b7550 0x7fc7440d1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:60552/0 (socket says 172.21.15.173:60552) 2024-04-25T09:03:17.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.674+0000 7fc749800640 1 -- 172.21.15.173:0/1704247289 learned_addr learned my addr 172.21.15.173:0/1704247289 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:17.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.674+0000 7fc748e00640 1 --1- 172.21.15.173:0/1704247289 >> v1:172.21.15.194:6789/0 conn(0x7fc7440b70f0 0x7fc74406f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:39298/0 (socket says 172.21.15.173:39298) 2024-04-25T09:03:17.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.674+0000 7fc749800640 1 -- 172.21.15.173:0/1704247289 >> v2:172.21.15.194:3300/0 conn(0x7fc7440b7550 msgr2=0x7fc7440d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.674+0000 7fc749800640 1 --2- 172.21.15.173:0/1704247289 >> v2:172.21.15.194:3300/0 conn(0x7fc7440b7550 0x7fc7440d1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.674+0000 7fc749800640 1 -- 172.21.15.173:0/1704247289 >> v1:172.21.15.194:6789/0 conn(0x7fc7440b70f0 legacy=0x7fc74406f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.674+0000 7fc749800640 1 -- 172.21.15.173:0/1704247289 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74415cd00 con 0x7fc74415ba20 2024-04-25T09:03:17.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.678+0000 7fc749800640 1 --2- 172.21.15.173:0/1704247289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc74415ba20 0x7fc74415be00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc738009870 tx=0x7fc73801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c559b405f313073 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.678+0000 7fc743e00640 1 -- 172.21.15.173:0/1704247289 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7380a9610 con 0x7fc74415ba20 2024-04-25T09:03:17.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.678+0000 7fc743e00640 1 -- 172.21.15.173:0/1704247289 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7380a97b0 con 0x7fc74415ba20 2024-04-25T09:03:17.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.678+0000 7fc743e00640 1 -- 172.21.15.173:0/1704247289 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7380a9b80 con 0x7fc74415ba20 2024-04-25T09:03:17.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.678+0000 7fc74c200640 1 -- 172.21.15.173:0/1704247289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc74415ba20 msgr2=0x7fc74415be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.678+0000 7fc74c200640 1 --2- 172.21.15.173:0/1704247289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc74415ba20 0x7fc74415be00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc738009870 tx=0x7fc73801c530 comp rx=0 tx=0).stop 2024-04-25T09:03:17.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.678+0000 7fc74c200640 1 -- 172.21.15.173:0/1704247289 shutdown_connections 2024-04-25T09:03:17.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.678+0000 7fc74c200640 1 --2- 172.21.15.173:0/1704247289 >> v2:172.21.15.194:3300/0 conn(0x7fc7440b7550 0x7fc7440d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.678+0000 7fc74c200640 1 --2- 172.21.15.173:0/1704247289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc74415ba20 0x7fc74415be00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.678+0000 7fc74c200640 1 -- 172.21.15.173:0/1704247289 >> 172.21.15.173:0/1704247289 conn(0x7fc744061880 msgr2=0x7fc744061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.678+0000 7fc74c200640 1 -- 172.21.15.173:0/1704247289 shutdown_connections 2024-04-25T09:03:17.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.678+0000 7fc74c200640 1 -- 172.21.15.173:0/1704247289 wait complete. 2024-04-25T09:03:17.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74c200640 1 Processor -- start 2024-04-25T09:03:17.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74c200640 1 -- start start 2024-04-25T09:03:17.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74c200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7440b70f0 0x7fc74414de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74c200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc74415ba20 0x7fc74406d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74c200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc74415a5a0 0x7fc7440b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74c200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74415df20 con 0x7fc74415a5a0 2024-04-25T09:03:17.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74c200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7440d25e0 con 0x7fc7440b70f0 2024-04-25T09:03:17.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74c200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74415e0a0 con 0x7fc74415ba20 2024-04-25T09:03:17.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74a200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc74415a5a0 0x7fc7440b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74a200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc74415a5a0 0x7fc7440b4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43162/0 (socket says 172.21.15.173:43162) 2024-04-25T09:03:17.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74a200640 1 -- 172.21.15.173:0/749050211 learned_addr learned my addr 172.21.15.173:0/749050211 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:17.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc749800640 1 --2- 172.21.15.173:0/749050211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7440b70f0 0x7fc74414de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc748e00640 1 --2- 172.21.15.173:0/749050211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc74415ba20 0x7fc74406d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74a200640 1 -- 172.21.15.173:0/749050211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc74415ba20 msgr2=0x7fc74406d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74a200640 1 --2- 172.21.15.173:0/749050211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc74415ba20 0x7fc74406d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74a200640 1 -- 172.21.15.173:0/749050211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7440b70f0 msgr2=0x7fc74414de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74a200640 1 --2- 172.21.15.173:0/749050211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7440b70f0 0x7fc74414de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74a200640 1 -- 172.21.15.173:0/749050211 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7441586c0 con 0x7fc74415a5a0 2024-04-25T09:03:17.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74a200640 1 --2- 172.21.15.173:0/749050211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc74415a5a0 0x7fc7440b4b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00efc0 tx=0x7fc73c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc741600640 1 -- 172.21.15.173:0/749050211 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c018020 con 0x7fc74415a5a0 2024-04-25T09:03:17.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc741600640 1 -- 172.21.15.173:0/749050211 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c014480 con 0x7fc74415a5a0 2024-04-25T09:03:17.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74c200640 1 -- 172.21.15.173:0/749050211 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7441589a0 con 0x7fc74415a5a0 2024-04-25T09:03:17.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc741600640 1 -- 172.21.15.173:0/749050211 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c014870 con 0x7fc74415a5a0 2024-04-25T09:03:17.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.682+0000 7fc74c200640 1 -- 172.21.15.173:0/749050211 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc744158f60 con 0x7fc74415a5a0 2024-04-25T09:03:17.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.686+0000 7fc74c200640 1 -- 172.21.15.173:0/749050211 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7440cefc0 con 0x7fc74415a5a0 2024-04-25T09:03:17.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.686+0000 7fc741600640 1 -- 172.21.15.173:0/749050211 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc73c01b020 con 0x7fc74415a5a0 2024-04-25T09:03:17.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.686+0000 7fc741600640 1 --2- 172.21.15.173:0/749050211 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc724066f60 0x7fc724069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.686+0000 7fc741600640 1 -- 172.21.15.173:0/749050211 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc73c0860d0 con 0x7fc74415a5a0 2024-04-25T09:03:17.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.686+0000 7fc749800640 1 --2- 172.21.15.173:0/749050211 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc724066f60 0x7fc724069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.686+0000 7fc749800640 1 --2- 172.21.15.173:0/749050211 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc724066f60 0x7fc724069420 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc7380ae000 tx=0x7fc7380b4040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.690+0000 7fc741600640 1 -- 172.21.15.173:0/749050211 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc73c022030 con 0x7fc74415a5a0 2024-04-25T09:03:17.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.846+0000 7fc74c200640 1 -- 172.21.15.173:0/749050211 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7440d0630 con 0x7fc74415a5a0 2024-04-25T09:03:17.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.846+0000 7fc741600640 1 -- 172.21.15.173:0/749050211 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18574 (secure 0 0 0) 0x7fc73c010040 con 0x7fc74415a5a0 2024-04-25T09:03:17.835 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:17.836 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:56.440593+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:17.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.846+0000 7fc74c200640 1 -- 172.21.15.173:0/749050211 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc724066f60 msgr2=0x7fc724069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.846+0000 7fc74c200640 1 --2- 172.21.15.173:0/749050211 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc724066f60 0x7fc724069420 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc7380ae000 tx=0x7fc7380b4040 comp rx=0 tx=0).stop 2024-04-25T09:03:17.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.846+0000 7fc74c200640 1 -- 172.21.15.173:0/749050211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc74415a5a0 msgr2=0x7fc7440b4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.846+0000 7fc74c200640 1 --2- 172.21.15.173:0/749050211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc74415a5a0 0x7fc7440b4b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00efc0 tx=0x7fc73c00c490 comp rx=0 tx=0).stop 2024-04-25T09:03:17.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.846+0000 7fc74c200640 1 -- 172.21.15.173:0/749050211 shutdown_connections 2024-04-25T09:03:17.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.846+0000 7fc74c200640 1 --2- 172.21.15.173:0/749050211 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc724066f60 0x7fc724069420 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.846+0000 7fc74c200640 1 --2- 172.21.15.173:0/749050211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc74415a5a0 0x7fc7440b4b10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.846+0000 7fc74c200640 1 --2- 172.21.15.173:0/749050211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc74415ba20 0x7fc74406d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.846+0000 7fc74c200640 1 --2- 172.21.15.173:0/749050211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7440b70f0 0x7fc74414de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.846+0000 7fc74c200640 1 -- 172.21.15.173:0/749050211 >> 172.21.15.173:0/749050211 conn(0x7fc744061880 msgr2=0x7fc7440cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.846+0000 7fc74c200640 1 -- 172.21.15.173:0/749050211 shutdown_connections 2024-04-25T09:03:17.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:17.846+0000 7fc74c200640 1 -- 172.21.15.173:0/749050211 wait complete. 2024-04-25T09:03:17.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:02:49.342297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:02:50.386069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:02:54.077429+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:03:17.858 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:17.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.006+0000 7f64aba00640 1 Processor -- start 2024-04-25T09:03:17.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.006+0000 7f64aba00640 1 -- start start 2024-04-25T09:03:17.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.006+0000 7f64aba00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f64a4145290 0x7f64a415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.006+0000 7f64aba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a40cc260 0x7f64a40cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.006+0000 7f64aba00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a415c5f0 con 0x7f64a40b3fe0 2024-04-25T09:03:17.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.006+0000 7f64aba00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a406d4b0 con 0x7f64a4145290 2024-04-25T09:03:17.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.006+0000 7f64aba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a406d790 con 0x7f64a40cc260 2024-04-25T09:03:17.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.006+0000 7f64a3e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f64a40b3fe0 0x7f64a40b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38996/0 (socket says 172.21.15.173:38996) 2024-04-25T09:03:17.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.006+0000 7f64a3e00640 1 -- 172.21.15.173:0/1890586401 learned_addr learned my addr 172.21.15.173:0/1890586401 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:17.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.010+0000 7f64a9000640 1 --2- 172.21.15.173:0/1890586401 >> v2:172.21.15.194:3300/0 conn(0x7f64a4145290 0x7f64a415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.010+0000 7f64a9a00640 1 --2- 172.21.15.173:0/1890586401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a40cc260 0x7f64a40cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.010+0000 7f64a3400640 1 -- 172.21.15.173:0/1890586401 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233750115 0 0) 0x7f6490001120 con 0x7f64a40b3fe0 2024-04-25T09:03:17.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.010+0000 7f64a3400640 1 -- 172.21.15.173:0/1890586401 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6488003530 con 0x7f64a40b3fe0 2024-04-25T09:03:17.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.010+0000 7f64a9000640 1 -- 172.21.15.173:0/1890586401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a40cc260 msgr2=0x7f64a40cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.010+0000 7f64a9000640 1 --2- 172.21.15.173:0/1890586401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a40cc260 0x7f64a40cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.010+0000 7f64a9000640 1 -- 172.21.15.173:0/1890586401 >> v1:172.21.15.173:6789/0 conn(0x7f64a40b3fe0 legacy=0x7f64a40b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.010+0000 7f64a9000640 1 -- 172.21.15.173:0/1890586401 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a406da70 con 0x7f64a4145290 2024-04-25T09:03:18.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.010+0000 7f64a9000640 1 --2- 172.21.15.173:0/1890586401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a4145290 0x7f64a415c0b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6494009d90 tx=0x7f649401c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f51b1b34b8c5c9e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.010+0000 7f64a3400640 1 -- 172.21.15.173:0/1890586401 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64940b2070 con 0x7f64a4145290 2024-04-25T09:03:18.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.010+0000 7f64a3400640 1 -- 172.21.15.173:0/1890586401 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64940a5820 con 0x7f64a4145290 2024-04-25T09:03:18.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.010+0000 7f64a3400640 1 -- 172.21.15.173:0/1890586401 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64940a5bf0 con 0x7f64a4145290 2024-04-25T09:03:18.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64aba00640 1 -- 172.21.15.173:0/1890586401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a4145290 msgr2=0x7f64a415c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64aba00640 1 --2- 172.21.15.173:0/1890586401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a4145290 0x7f64a415c0b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6494009d90 tx=0x7f649401c850 comp rx=0 tx=0).stop 2024-04-25T09:03:18.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64aba00640 1 -- 172.21.15.173:0/1890586401 shutdown_connections 2024-04-25T09:03:18.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64aba00640 1 --2- 172.21.15.173:0/1890586401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a40cc260 0x7f64a40cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64aba00640 1 --2- 172.21.15.173:0/1890586401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a4145290 0x7f64a415c0b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64aba00640 1 -- 172.21.15.173:0/1890586401 >> 172.21.15.173:0/1890586401 conn(0x7f64a406ac90 msgr2=0x7f64a406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64aba00640 1 -- 172.21.15.173:0/1890586401 shutdown_connections 2024-04-25T09:03:18.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64aba00640 1 -- 172.21.15.173:0/1890586401 wait complete. 2024-04-25T09:03:18.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64aba00640 1 Processor -- start 2024-04-25T09:03:18.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64aba00640 1 -- start start 2024-04-25T09:03:18.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64aba00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a40b3fe0 0x7f64a415b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64aba00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a40cc260 0x7f64a4140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64aba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a4145290 0x7f64a41411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64aba00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a406ed60 con 0x7f64a40cc260 2024-04-25T09:03:18.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64aba00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a406eee0 con 0x7f64a40b3fe0 2024-04-25T09:03:18.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64aba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a406f060 con 0x7f64a4145290 2024-04-25T09:03:18.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64a3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a40cc260 0x7f64a4140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64a3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a40cc260 0x7f64a4140b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43164/0 (socket says 172.21.15.173:43164) 2024-04-25T09:03:18.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64a9000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a40b3fe0 0x7f64a415b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64a3e00640 1 -- 172.21.15.173:0/282439964 learned_addr learned my addr 172.21.15.173:0/282439964 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:18.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.014+0000 7f64a9a00640 1 --2- 172.21.15.173:0/282439964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a4145290 0x7f64a41411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.018+0000 7f64a9000640 1 -- 172.21.15.173:0/282439964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a4145290 msgr2=0x7f64a41411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.018+0000 7f64a9000640 1 --2- 172.21.15.173:0/282439964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a4145290 0x7f64a41411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.018+0000 7f64a9000640 1 -- 172.21.15.173:0/282439964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a40cc260 msgr2=0x7f64a4140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.018+0000 7f64a9000640 1 --2- 172.21.15.173:0/282439964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a40cc260 0x7f64a4140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.018+0000 7f64a9000640 1 -- 172.21.15.173:0/282439964 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a41416f0 con 0x7f64a40b3fe0 2024-04-25T09:03:18.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.018+0000 7f64a9000640 1 --2- 172.21.15.173:0/282439964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a40b3fe0 0x7f64a415b080 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f64a406baa0 tx=0x7f64940195f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.018+0000 7f64a0c00640 1 -- 172.21.15.173:0/282439964 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64940bd030 con 0x7f64a40b3fe0 2024-04-25T09:03:18.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.018+0000 7f64a0c00640 1 -- 172.21.15.173:0/282439964 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64940a5620 con 0x7f64a40b3fe0 2024-04-25T09:03:18.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.018+0000 7f64a0c00640 1 -- 172.21.15.173:0/282439964 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64940b2040 con 0x7f64a40b3fe0 2024-04-25T09:03:18.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.018+0000 7f64aba00640 1 -- 172.21.15.173:0/282439964 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a4141990 con 0x7f64a40b3fe0 2024-04-25T09:03:18.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.018+0000 7f64aba00640 1 -- 172.21.15.173:0/282439964 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a4140350 con 0x7f64a40b3fe0 2024-04-25T09:03:18.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.018+0000 7f64aba00640 1 -- 172.21.15.173:0/282439964 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a4073ab0 con 0x7f64a40b3fe0 2024-04-25T09:03:18.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.018+0000 7f64a0c00640 1 -- 172.21.15.173:0/282439964 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f64940c0070 con 0x7f64a40b3fe0 2024-04-25T09:03:18.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.018+0000 7f64a0c00640 1 --2- 172.21.15.173:0/282439964 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6484066f60 0x7f6484069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.018+0000 7f64a0c00640 1 -- 172.21.15.173:0/282439964 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f649411fb90 con 0x7f64a40b3fe0 2024-04-25T09:03:18.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.018+0000 7f64a3e00640 1 --2- 172.21.15.173:0/282439964 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6484066f60 0x7f6484069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.022+0000 7f64a3e00640 1 --2- 172.21.15.173:0/282439964 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6484066f60 0x7f6484069420 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6490007fd0 tx=0x7f6490007be0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.022+0000 7f64a0c00640 1 -- 172.21.15.173:0/282439964 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f64940c7070 con 0x7f64a40b3fe0 2024-04-25T09:03:18.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.178+0000 7f64aba00640 1 -- 172.21.15.173:0/282439964 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f64a415be20 con 0x7f64a40b3fe0 2024-04-25T09:03:18.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.178+0000 7f64a0c00640 1 -- 172.21.15.173:0/282439964 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6494016560 con 0x7f64a40b3fe0 2024-04-25T09:03:18.169 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:03:18.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.182+0000 7f64aba00640 1 -- 172.21.15.173:0/282439964 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6484066f60 msgr2=0x7f6484069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.182+0000 7f64aba00640 1 --2- 172.21.15.173:0/282439964 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6484066f60 0x7f6484069420 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6490007fd0 tx=0x7f6490007be0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.182+0000 7f64aba00640 1 -- 172.21.15.173:0/282439964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a40b3fe0 msgr2=0x7f64a415b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.182+0000 7f64aba00640 1 --2- 172.21.15.173:0/282439964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a40b3fe0 0x7f64a415b080 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f64a406baa0 tx=0x7f64940195f0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.182+0000 7f64aba00640 1 -- 172.21.15.173:0/282439964 shutdown_connections 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.182+0000 7f64aba00640 1 --2- 172.21.15.173:0/282439964 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6484066f60 0x7f6484069420 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.182+0000 7f64aba00640 1 --2- 172.21.15.173:0/282439964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a4145290 0x7f64a41411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.182+0000 7f64aba00640 1 --2- 172.21.15.173:0/282439964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a40cc260 0x7f64a4140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.182+0000 7f64aba00640 1 --2- 172.21.15.173:0/282439964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a40b3fe0 0x7f64a415b080 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.182+0000 7f64aba00640 1 -- 172.21.15.173:0/282439964 >> 172.21.15.173:0/282439964 conn(0x7f64a406ac90 msgr2=0x7f64a40cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.182+0000 7f64aba00640 1 -- 172.21.15.173:0/282439964 shutdown_connections 2024-04-25T09:03:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.182+0000 7f64aba00640 1 -- 172.21.15.173:0/282439964 wait complete. 2024-04-25T09:03:18.191 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:18.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.338+0000 7f0156e00640 1 Processor -- start 2024-04-25T09:03:18.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.338+0000 7f0156e00640 1 -- start start 2024-04-25T09:03:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.342+0000 7f0156e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0150145290 0x7f015015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.342+0000 7f0156e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f01500b3fe0 0x7f01500b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.342+0000 7f0156e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01500cc260 0x7f01500cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.342+0000 7f0156e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015015c5f0 con 0x7f0150145290 2024-04-25T09:03:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.342+0000 7f0156e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015006d4b0 con 0x7f01500b3fe0 2024-04-25T09:03:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.342+0000 7f0156e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015006d790 con 0x7f01500cc260 2024-04-25T09:03:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.342+0000 7f014fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0150145290 0x7f015015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.342+0000 7f014fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0150145290 0x7f015015c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43170/0 (socket says 172.21.15.173:43170) 2024-04-25T09:03:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.342+0000 7f014fe00640 1 -- 172.21.15.173:0/3128550982 learned_addr learned my addr 172.21.15.173:0/3128550982 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.342+0000 7f014f400640 1 --2- 172.21.15.173:0/3128550982 >> v2:172.21.15.194:3300/0 conn(0x7f01500b3fe0 0x7f01500b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.342+0000 7f0154e00640 1 --2- 172.21.15.173:0/3128550982 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01500cc260 0x7f01500cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.342+0000 7f014fe00640 1 -- 172.21.15.173:0/3128550982 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01500cc260 msgr2=0x7f01500cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.342+0000 7f014fe00640 1 --2- 172.21.15.173:0/3128550982 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01500cc260 0x7f01500cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.342+0000 7f014fe00640 1 -- 172.21.15.173:0/3128550982 >> v2:172.21.15.194:3300/0 conn(0x7f01500b3fe0 msgr2=0x7f01500b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.342+0000 7f014fe00640 1 --2- 172.21.15.173:0/3128550982 >> v2:172.21.15.194:3300/0 conn(0x7f01500b3fe0 0x7f01500b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.342+0000 7f014fe00640 1 -- 172.21.15.173:0/3128550982 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015006da70 con 0x7f0150145290 2024-04-25T09:03:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.342+0000 7f0154e00640 1 --2- 172.21.15.173:0/3128550982 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01500cc260 0x7f01500cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:18.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f014fe00640 1 --2- 172.21.15.173:0/3128550982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0150145290 0x7f015015c0b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0150071100 tx=0x7f014001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5b5ad8c7e8cfa2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f014ea00640 1 -- 172.21.15.173:0/3128550982 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400a5660 con 0x7f0150145290 2024-04-25T09:03:18.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f014ea00640 1 -- 172.21.15.173:0/3128550982 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01400a5800 con 0x7f0150145290 2024-04-25T09:03:18.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f014ea00640 1 -- 172.21.15.173:0/3128550982 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400a5bd0 con 0x7f0150145290 2024-04-25T09:03:18.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0156e00640 1 -- 172.21.15.173:0/3128550982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0150145290 msgr2=0x7f015015c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0156e00640 1 --2- 172.21.15.173:0/3128550982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0150145290 0x7f015015c0b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0150071100 tx=0x7f014001c8d0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0156e00640 1 -- 172.21.15.173:0/3128550982 shutdown_connections 2024-04-25T09:03:18.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0156e00640 1 --2- 172.21.15.173:0/3128550982 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01500cc260 0x7f01500cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0156e00640 1 --2- 172.21.15.173:0/3128550982 >> v2:172.21.15.194:3300/0 conn(0x7f01500b3fe0 0x7f01500b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0156e00640 1 --2- 172.21.15.173:0/3128550982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0150145290 0x7f015015c0b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0156e00640 1 -- 172.21.15.173:0/3128550982 >> 172.21.15.173:0/3128550982 conn(0x7f015006ac90 msgr2=0x7f015006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0156e00640 1 -- 172.21.15.173:0/3128550982 shutdown_connections 2024-04-25T09:03:18.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0156e00640 1 -- 172.21.15.173:0/3128550982 wait complete. 2024-04-25T09:03:18.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0156e00640 1 Processor -- start 2024-04-25T09:03:18.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0156e00640 1 -- start start 2024-04-25T09:03:18.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0156e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01500b3fe0 0x7f0150143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0156e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01500cc260 0x7f015013f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0156e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0150145290 0x7f01500c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0156e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01501457f0 con 0x7f0150145290 2024-04-25T09:03:18.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0156e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0150145670 con 0x7f01500b3fe0 2024-04-25T09:03:18.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0156e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015006ed60 con 0x7f01500cc260 2024-04-25T09:03:18.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0154e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0150145290 0x7f01500c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0154e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0150145290 0x7f01500c46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43176/0 (socket says 172.21.15.173:43176) 2024-04-25T09:03:18.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f0154e00640 1 -- 172.21.15.173:0/1054160291 learned_addr learned my addr 172.21.15.173:0/1054160291 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:18.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f014f400640 1 --2- 172.21.15.173:0/1054160291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01500cc260 0x7f015013f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.346+0000 7f014fe00640 1 --2- 172.21.15.173:0/1054160291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01500b3fe0 0x7f0150143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.350+0000 7f0154e00640 1 -- 172.21.15.173:0/1054160291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01500cc260 msgr2=0x7f015013f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.350+0000 7f0154e00640 1 --2- 172.21.15.173:0/1054160291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01500cc260 0x7f015013f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.350+0000 7f0154e00640 1 -- 172.21.15.173:0/1054160291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01500b3fe0 msgr2=0x7f0150143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.350+0000 7f0154e00640 1 --2- 172.21.15.173:0/1054160291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01500b3fe0 0x7f0150143d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.350+0000 7f0154e00640 1 -- 172.21.15.173:0/1054160291 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01500c4c20 con 0x7f0150145290 2024-04-25T09:03:18.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.350+0000 7f0154e00640 1 --2- 172.21.15.173:0/1054160291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0150145290 0x7f01500c46e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f014800c7f0 tx=0x7f014800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.350+0000 7f0147e00640 1 -- 172.21.15.173:0/1054160291 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148015070 con 0x7f0150145290 2024-04-25T09:03:18.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.350+0000 7f0147e00640 1 -- 172.21.15.173:0/1054160291 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0148007860 con 0x7f0150145290 2024-04-25T09:03:18.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.350+0000 7f0147e00640 1 -- 172.21.15.173:0/1054160291 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148007c50 con 0x7f0150145290 2024-04-25T09:03:18.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.350+0000 7f0156e00640 1 -- 172.21.15.173:0/1054160291 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01501420e0 con 0x7f0150145290 2024-04-25T09:03:18.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.350+0000 7f0156e00640 1 -- 172.21.15.173:0/1054160291 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01501426a0 con 0x7f0150145290 2024-04-25T09:03:18.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.350+0000 7f0156e00640 1 -- 172.21.15.173:0/1054160291 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0150073ab0 con 0x7f0150145290 2024-04-25T09:03:18.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.350+0000 7f0147e00640 1 -- 172.21.15.173:0/1054160291 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0148018070 con 0x7f0150145290 2024-04-25T09:03:18.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.350+0000 7f0147e00640 1 --2- 172.21.15.173:0/1054160291 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0130066f60 0x7f0130069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.350+0000 7f0147e00640 1 -- 172.21.15.173:0/1054160291 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0148085470 con 0x7f0150145290 2024-04-25T09:03:18.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.350+0000 7f014fe00640 1 --2- 172.21.15.173:0/1054160291 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0130066f60 0x7f0130069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.354+0000 7f014fe00640 1 --2- 172.21.15.173:0/1054160291 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0130066f60 0x7f0130069420 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f01400ae000 tx=0x7f01400a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.354+0000 7f0147e00640 1 -- 172.21.15.173:0/1054160291 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f01500c4c20 con 0x7f0150145290 2024-04-25T09:03:18.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.506+0000 7f0156e00640 1 -- 172.21.15.173:0/1054160291 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f01500ceed0 con 0x7f0150145290 2024-04-25T09:03:18.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.506+0000 7f0147e00640 1 -- 172.21.15.173:0/1054160291 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0148055ae0 con 0x7f0150145290 2024-04-25T09:03:18.498 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:18.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.510+0000 7f0156e00640 1 -- 172.21.15.173:0/1054160291 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0130066f60 msgr2=0x7f0130069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.510+0000 7f0156e00640 1 --2- 172.21.15.173:0/1054160291 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0130066f60 0x7f0130069420 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f01400ae000 tx=0x7f01400a7070 comp rx=0 tx=0).stop 2024-04-25T09:03:18.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.510+0000 7f0156e00640 1 -- 172.21.15.173:0/1054160291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0150145290 msgr2=0x7f01500c46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.510+0000 7f0156e00640 1 --2- 172.21.15.173:0/1054160291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0150145290 0x7f01500c46e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f014800c7f0 tx=0x7f014800ccb0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.510+0000 7f0156e00640 1 -- 172.21.15.173:0/1054160291 shutdown_connections 2024-04-25T09:03:18.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.510+0000 7f0156e00640 1 --2- 172.21.15.173:0/1054160291 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0130066f60 0x7f0130069420 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.510+0000 7f0156e00640 1 --2- 172.21.15.173:0/1054160291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0150145290 0x7f01500c46e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.510+0000 7f0156e00640 1 --2- 172.21.15.173:0/1054160291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01500cc260 0x7f015013f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.510+0000 7f0156e00640 1 --2- 172.21.15.173:0/1054160291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01500b3fe0 0x7f0150143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.510+0000 7f0156e00640 1 -- 172.21.15.173:0/1054160291 >> 172.21.15.173:0/1054160291 conn(0x7f015006ac90 msgr2=0x7f01500ce430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.510+0000 7f0156e00640 1 -- 172.21.15.173:0/1054160291 shutdown_connections 2024-04-25T09:03:18.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.510+0000 7f0156e00640 1 -- 172.21.15.173:0/1054160291 wait complete. 2024-04-25T09:03:18.519 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:18.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.666+0000 7fdd2e000640 1 Processor -- start 2024-04-25T09:03:18.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.666+0000 7fdd2e000640 1 -- start start 2024-04-25T09:03:18.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.670+0000 7fdd2e000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdd280b3fe0 0x7fdd280b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.670+0000 7fdd2e000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd280cc260 0x7fdd280cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.670+0000 7fdd2e000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2806d4b0 con 0x7fdd28145290 2024-04-25T09:03:18.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.670+0000 7fdd2e000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd2806d790 con 0x7fdd280b3fe0 2024-04-25T09:03:18.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.670+0000 7fdd2e000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2806da70 con 0x7fdd280cc260 2024-04-25T09:03:18.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.670+0000 7fdd26a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdd280b3fe0 0x7fdd280b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.670+0000 7fdd26a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdd280b3fe0 0x7fdd280b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43192/0 (socket says 172.21.15.173:43192) 2024-04-25T09:03:18.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.670+0000 7fdd26a00640 1 -- 172.21.15.173:0/1527450293 learned_addr learned my addr 172.21.15.173:0/1527450293 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:18.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.670+0000 7fdd27e00640 1 --2- 172.21.15.173:0/1527450293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd280cc260 0x7fdd280cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.670+0000 7fdd26a00640 1 -- 172.21.15.173:0/1527450293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd280cc260 msgr2=0x7fdd280cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:18.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.670+0000 7fdd26a00640 1 --2- 172.21.15.173:0/1527450293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd280cc260 0x7fdd280cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.670+0000 7fdd26a00640 1 -- 172.21.15.173:0/1527450293 >> v1:172.21.15.194:6789/0 conn(0x7fdd28145290 legacy=0x7fdd2815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:18.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.670+0000 7fdd26a00640 1 -- 172.21.15.173:0/1527450293 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2806dd50 con 0x7fdd280b3fe0 2024-04-25T09:03:18.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.670+0000 7fdd27e00640 1 --2- 172.21.15.173:0/1527450293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd280cc260 0x7fdd280cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:18.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.670+0000 7fdd26a00640 1 --2- 172.21.15.173:0/1527450293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd280b3fe0 0x7fdd280b4450 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009870 tx=0x7fdd1401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f431b042039e0fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.670+0000 7fdd26000640 1 -- 172.21.15.173:0/1527450293 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd140b0070 con 0x7fdd280b3fe0 2024-04-25T09:03:18.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.670+0000 7fdd26000640 1 -- 172.21.15.173:0/1527450293 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd140ab600 con 0x7fdd280b3fe0 2024-04-25T09:03:18.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.670+0000 7fdd26000640 1 -- 172.21.15.173:0/1527450293 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd140ab9d0 con 0x7fdd280b3fe0 2024-04-25T09:03:18.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd2e000640 1 -- 172.21.15.173:0/1527450293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd280b3fe0 msgr2=0x7fdd280b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd2e000640 1 --2- 172.21.15.173:0/1527450293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd280b3fe0 0x7fdd280b4450 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009870 tx=0x7fdd1401c400 comp rx=0 tx=0).stop 2024-04-25T09:03:18.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd2e000640 1 -- 172.21.15.173:0/1527450293 shutdown_connections 2024-04-25T09:03:18.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd2e000640 1 --2- 172.21.15.173:0/1527450293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd280cc260 0x7fdd280cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd2e000640 1 --2- 172.21.15.173:0/1527450293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd280b3fe0 0x7fdd280b4450 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd2e000640 1 -- 172.21.15.173:0/1527450293 >> 172.21.15.173:0/1527450293 conn(0x7fdd2806ac90 msgr2=0x7fdd2806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd2e000640 1 -- 172.21.15.173:0/1527450293 shutdown_connections 2024-04-25T09:03:18.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd2e000640 1 -- 172.21.15.173:0/1527450293 wait complete. 2024-04-25T09:03:18.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd2e000640 1 Processor -- start 2024-04-25T09:03:18.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd2e000640 1 -- start start 2024-04-25T09:03:18.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd2e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd280b3fe0 0x7fdd2813b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd2e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd280cc260 0x7fdd28139610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd2e000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd28145290 0x7fdd2815b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd2e000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2806ed60 con 0x7fdd280cc260 2024-04-25T09:03:18.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd2e000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2806eee0 con 0x7fdd280b3fe0 2024-04-25T09:03:18.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd2e000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2806f060 con 0x7fdd28145290 2024-04-25T09:03:18.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd26a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd280cc260 0x7fdd28139610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd26a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd280cc260 0x7fdd28139610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43206/0 (socket says 172.21.15.173:43206) 2024-04-25T09:03:18.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd26a00640 1 -- 172.21.15.173:0/3103292278 learned_addr learned my addr 172.21.15.173:0/3103292278 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:18.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd27e00640 1 --2- 172.21.15.173:0/3103292278 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd28145290 0x7fdd2815b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd27400640 1 --2- 172.21.15.173:0/3103292278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd280b3fe0 0x7fdd2813b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd26a00640 1 -- 172.21.15.173:0/3103292278 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd28145290 msgr2=0x7fdd2815b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd26a00640 1 --2- 172.21.15.173:0/3103292278 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd28145290 0x7fdd2815b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd26a00640 1 -- 172.21.15.173:0/3103292278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd280b3fe0 msgr2=0x7fdd2813b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd26a00640 1 --2- 172.21.15.173:0/3103292278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd280b3fe0 0x7fdd2813b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.674+0000 7fdd26a00640 1 -- 172.21.15.173:0/3103292278 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2813b850 con 0x7fdd280cc260 2024-04-25T09:03:18.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.678+0000 7fdd26a00640 1 --2- 172.21.15.173:0/3103292278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd280cc260 0x7fdd28139610 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdd140ae040 tx=0x7fdd1401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.678+0000 7fdd1f400640 1 -- 172.21.15.173:0/3103292278 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd140ba020 con 0x7fdd280cc260 2024-04-25T09:03:18.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.678+0000 7fdd1f400640 1 -- 172.21.15.173:0/3103292278 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd140b6640 con 0x7fdd280cc260 2024-04-25T09:03:18.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.678+0000 7fdd2e000640 1 -- 172.21.15.173:0/3103292278 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd281426c0 con 0x7fdd280cc260 2024-04-25T09:03:18.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.678+0000 7fdd1f400640 1 -- 172.21.15.173:0/3103292278 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd140b0040 con 0x7fdd280cc260 2024-04-25T09:03:18.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.678+0000 7fdd2e000640 1 -- 172.21.15.173:0/3103292278 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd28142c80 con 0x7fdd280cc260 2024-04-25T09:03:18.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.678+0000 7fdd2e000640 1 -- 172.21.15.173:0/3103292278 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd28073ab0 con 0x7fdd280cc260 2024-04-25T09:03:18.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.678+0000 7fdd1f400640 1 -- 172.21.15.173:0/3103292278 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdd140bd020 con 0x7fdd280cc260 2024-04-25T09:03:18.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.678+0000 7fdd1f400640 1 --2- 172.21.15.173:0/3103292278 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdd08066f60 0x7fdd08069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.678+0000 7fdd1f400640 1 -- 172.21.15.173:0/3103292278 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fdd1411f550 con 0x7fdd280cc260 2024-04-25T09:03:18.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.678+0000 7fdd27400640 1 --2- 172.21.15.173:0/3103292278 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdd08066f60 0x7fdd08069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.682+0000 7fdd27400640 1 --2- 172.21.15.173:0/3103292278 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdd08066f60 0x7fdd08069420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800b450 tx=0x7fdd1800d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.682+0000 7fdd1f400640 1 -- 172.21.15.173:0/3103292278 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdd140c4030 con 0x7fdd280cc260 2024-04-25T09:03:18.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.838+0000 7fdd2e000640 1 -- 172.21.15.173:0/3103292278 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdd2813e640 con 0x7fdd280cc260 2024-04-25T09:03:18.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.838+0000 7fdd1f400640 1 -- 172.21.15.173:0/3103292278 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdd14016110 con 0x7fdd280cc260 2024-04-25T09:03:18.828 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:03:18.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.842+0000 7fdd2e000640 1 -- 172.21.15.173:0/3103292278 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdd08066f60 msgr2=0x7fdd08069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.842+0000 7fdd2e000640 1 --2- 172.21.15.173:0/3103292278 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdd08066f60 0x7fdd08069420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800b450 tx=0x7fdd1800d040 comp rx=0 tx=0).stop 2024-04-25T09:03:18.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.842+0000 7fdd2e000640 1 -- 172.21.15.173:0/3103292278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd280cc260 msgr2=0x7fdd28139610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.842+0000 7fdd2e000640 1 --2- 172.21.15.173:0/3103292278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd280cc260 0x7fdd28139610 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdd140ae040 tx=0x7fdd1401ac40 comp rx=0 tx=0).stop 2024-04-25T09:03:18.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.842+0000 7fdd2e000640 1 -- 172.21.15.173:0/3103292278 shutdown_connections 2024-04-25T09:03:18.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.842+0000 7fdd2e000640 1 --2- 172.21.15.173:0/3103292278 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdd08066f60 0x7fdd08069420 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.842+0000 7fdd2e000640 1 --2- 172.21.15.173:0/3103292278 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd28145290 0x7fdd2815b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.842+0000 7fdd2e000640 1 --2- 172.21.15.173:0/3103292278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd280cc260 0x7fdd28139610 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.842+0000 7fdd2e000640 1 --2- 172.21.15.173:0/3103292278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd280b3fe0 0x7fdd2813b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.842+0000 7fdd2e000640 1 -- 172.21.15.173:0/3103292278 >> 172.21.15.173:0/3103292278 conn(0x7fdd2806ac90 msgr2=0x7fdd2815dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.842+0000 7fdd2e000640 1 -- 172.21.15.173:0/3103292278 shutdown_connections 2024-04-25T09:03:18.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.842+0000 7fdd2e000640 1 -- 172.21.15.173:0/3103292278 wait complete. 2024-04-25T09:03:18.850 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:03:18.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.998+0000 7fe262e00640 1 Processor -- start 2024-04-25T09:03:18.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.998+0000 7fe262e00640 1 -- start start 2024-04-25T09:03:18.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.998+0000 7fe262e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe25c145290 0x7fe25c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.998+0000 7fe262e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe25c0cc260 0x7fe25c0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:18.998+0000 7fe262e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe25c15c5f0 con 0x7fe25c0b3fe0 2024-04-25T09:03:18.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.002+0000 7fe262e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe25c06d4b0 con 0x7fe25c0cc260 2024-04-25T09:03:18.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.002+0000 7fe262e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c06d790 con 0x7fe25c145290 2024-04-25T09:03:18.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.002+0000 7fe253400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe25c0b3fe0 0x7fe25c0b4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39012/0 (socket says 172.21.15.173:39012) 2024-04-25T09:03:18.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.002+0000 7fe253400640 1 -- 172.21.15.173:0/3347913316 learned_addr learned my addr 172.21.15.173:0/3347913316 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:18.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.002+0000 7fe260e00640 1 --2- 172.21.15.173:0/3347913316 >> v2:172.21.15.173:3300/0 conn(0x7fe25c0cc260 0x7fe25c0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.002+0000 7fe25be00640 1 --2- 172.21.15.173:0/3347913316 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe25c145290 0x7fe25c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.002+0000 7fe25b400640 1 -- 172.21.15.173:0/3347913316 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67825870 0 0) 0x7fe244001120 con 0x7fe25c0b3fe0 2024-04-25T09:03:18.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.002+0000 7fe25b400640 1 -- 172.21.15.173:0/3347913316 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe240003530 con 0x7fe25c0b3fe0 2024-04-25T09:03:18.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.002+0000 7fe260e00640 1 -- 172.21.15.173:0/3347913316 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe25c145290 msgr2=0x7fe25c15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:18.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.002+0000 7fe260e00640 1 --2- 172.21.15.173:0/3347913316 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe25c145290 0x7fe25c15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.002+0000 7fe260e00640 1 -- 172.21.15.173:0/3347913316 >> v1:172.21.15.173:6789/0 conn(0x7fe25c0b3fe0 legacy=0x7fe25c0b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.002+0000 7fe260e00640 1 -- 172.21.15.173:0/3347913316 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c06da70 con 0x7fe25c0cc260 2024-04-25T09:03:18.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.002+0000 7fe25be00640 1 --2- 172.21.15.173:0/3347913316 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe25c145290 0x7fe25c15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:18.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.002+0000 7fe260e00640 1 --2- 172.21.15.173:0/3347913316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe25c0cc260 0x7fe25c0cc6b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe254009d90 tx=0x7fe25401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92b22d4794d89a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.002+0000 7fe25b400640 1 -- 172.21.15.173:0/3347913316 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2540b2070 con 0x7fe25c0cc260 2024-04-25T09:03:18.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.002+0000 7fe25b400640 1 -- 172.21.15.173:0/3347913316 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2540a5820 con 0x7fe25c0cc260 2024-04-25T09:03:18.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.002+0000 7fe25b400640 1 -- 172.21.15.173:0/3347913316 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2540a5bf0 con 0x7fe25c0cc260 2024-04-25T09:03:18.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe262e00640 1 -- 172.21.15.173:0/3347913316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe25c0cc260 msgr2=0x7fe25c0cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe262e00640 1 --2- 172.21.15.173:0/3347913316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe25c0cc260 0x7fe25c0cc6b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe254009d90 tx=0x7fe25401c850 comp rx=0 tx=0).stop 2024-04-25T09:03:18.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe262e00640 1 -- 172.21.15.173:0/3347913316 shutdown_connections 2024-04-25T09:03:18.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe262e00640 1 --2- 172.21.15.173:0/3347913316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe25c0cc260 0x7fe25c0cc6b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe262e00640 1 --2- 172.21.15.173:0/3347913316 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe25c145290 0x7fe25c15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe262e00640 1 -- 172.21.15.173:0/3347913316 >> 172.21.15.173:0/3347913316 conn(0x7fe25c06ac90 msgr2=0x7fe25c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe262e00640 1 -- 172.21.15.173:0/3347913316 shutdown_connections 2024-04-25T09:03:18.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe262e00640 1 -- 172.21.15.173:0/3347913316 wait complete. 2024-04-25T09:03:18.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe262e00640 1 Processor -- start 2024-04-25T09:03:18.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe262e00640 1 -- start start 2024-04-25T09:03:18.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe262e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe25c0b3fe0 0x7fe25c133410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe262e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe25c0cc260 0x7fe25c160a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe262e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe25c145290 0x7fe25c160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe262e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c06eee0 con 0x7fe25c0b3fe0 2024-04-25T09:03:18.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe262e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c06ed60 con 0x7fe25c145290 2024-04-25T09:03:18.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe262e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c06f060 con 0x7fe25c0cc260 2024-04-25T09:03:18.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe25be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe25c0b3fe0 0x7fe25c133410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe25be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe25c0b3fe0 0x7fe25c133410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43226/0 (socket says 172.21.15.173:43226) 2024-04-25T09:03:18.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe25be00640 1 -- 172.21.15.173:0/3233173097 learned_addr learned my addr 172.21.15.173:0/3233173097 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:18.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe253400640 1 --2- 172.21.15.173:0/3233173097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe25c0cc260 0x7fe25c160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe260e00640 1 --2- 172.21.15.173:0/3233173097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe25c145290 0x7fe25c160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe25be00640 1 -- 172.21.15.173:0/3233173097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe25c0cc260 msgr2=0x7fe25c160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe25be00640 1 --2- 172.21.15.173:0/3233173097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe25c0cc260 0x7fe25c160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe25be00640 1 -- 172.21.15.173:0/3233173097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe25c145290 msgr2=0x7fe25c160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe25be00640 1 --2- 172.21.15.173:0/3233173097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe25c145290 0x7fe25c160fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe25be00640 1 -- 172.21.15.173:0/3233173097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c12ff00 con 0x7fe25c0b3fe0 2024-04-25T09:03:19.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe253400640 1 --2- 172.21.15.173:0/3233173097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe25c0cc260 0x7fe25c160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:19.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.006+0000 7fe260e00640 1 --2- 172.21.15.173:0/3233173097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe25c145290 0x7fe25c160fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:19.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.010+0000 7fe25be00640 1 --2- 172.21.15.173:0/3233173097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe25c0b3fe0 0x7fe25c133410 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00e840 tx=0x7fe24c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.010+0000 7fe258c00640 1 -- 172.21.15.173:0/3233173097 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c017070 con 0x7fe25c0b3fe0 2024-04-25T09:03:19.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.010+0000 7fe258c00640 1 -- 172.21.15.173:0/3233173097 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24c00c8d0 con 0x7fe25c0b3fe0 2024-04-25T09:03:19.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.010+0000 7fe258c00640 1 -- 172.21.15.173:0/3233173097 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c00f040 con 0x7fe25c0b3fe0 2024-04-25T09:03:19.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.010+0000 7fe262e00640 1 -- 172.21.15.173:0/3233173097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25c1301e0 con 0x7fe25c0b3fe0 2024-04-25T09:03:19.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.010+0000 7fe262e00640 1 -- 172.21.15.173:0/3233173097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25c1307a0 con 0x7fe25c0b3fe0 2024-04-25T09:03:19.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.010+0000 7fe262e00640 1 -- 172.21.15.173:0/3233173097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25c073ab0 con 0x7fe25c0b3fe0 2024-04-25T09:03:19.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.010+0000 7fe258c00640 1 -- 172.21.15.173:0/3233173097 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe24c01a070 con 0x7fe25c0b3fe0 2024-04-25T09:03:19.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.010+0000 7fe258c00640 1 --2- 172.21.15.173:0/3233173097 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe238066f60 0x7fe238069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.010+0000 7fe258c00640 1 -- 172.21.15.173:0/3233173097 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe24c084fa0 con 0x7fe25c0b3fe0 2024-04-25T09:03:19.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.010+0000 7fe253400640 1 --2- 172.21.15.173:0/3233173097 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe238066f60 0x7fe238069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.014+0000 7fe253400640 1 --2- 172.21.15.173:0/3233173097 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe238066f60 0x7fe238069420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe2440012c0 tx=0x7fe244009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.014+0000 7fe258c00640 1 -- 172.21.15.173:0/3233173097 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe24c055bd0 con 0x7fe25c0b3fe0 2024-04-25T09:03:19.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.174+0000 7fe262e00640 1 -- 172.21.15.173:0/3233173097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe25c06c300 con 0x7fe25c0b3fe0 2024-04-25T09:03:19.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.174+0000 7fe258c00640 1 -- 172.21.15.173:0/3233173097 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe24c0554d0 con 0x7fe25c0b3fe0 2024-04-25T09:03:19.163 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:19.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.174+0000 7fe262e00640 1 -- 172.21.15.173:0/3233173097 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe238066f60 msgr2=0x7fe238069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.174+0000 7fe262e00640 1 --2- 172.21.15.173:0/3233173097 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe238066f60 0x7fe238069420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe2440012c0 tx=0x7fe244009040 comp rx=0 tx=0).stop 2024-04-25T09:03:19.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.174+0000 7fe262e00640 1 -- 172.21.15.173:0/3233173097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe25c0b3fe0 msgr2=0x7fe25c133410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.174+0000 7fe262e00640 1 --2- 172.21.15.173:0/3233173097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe25c0b3fe0 0x7fe25c133410 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00e840 tx=0x7fe24c00ed00 comp rx=0 tx=0).stop 2024-04-25T09:03:19.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.174+0000 7fe262e00640 1 -- 172.21.15.173:0/3233173097 shutdown_connections 2024-04-25T09:03:19.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.174+0000 7fe262e00640 1 --2- 172.21.15.173:0/3233173097 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe238066f60 0x7fe238069420 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.174+0000 7fe262e00640 1 --2- 172.21.15.173:0/3233173097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe25c145290 0x7fe25c160fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.174+0000 7fe262e00640 1 --2- 172.21.15.173:0/3233173097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe25c0cc260 0x7fe25c160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.174+0000 7fe262e00640 1 --2- 172.21.15.173:0/3233173097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe25c0b3fe0 0x7fe25c133410 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.174+0000 7fe262e00640 1 -- 172.21.15.173:0/3233173097 >> 172.21.15.173:0/3233173097 conn(0x7fe25c06ac90 msgr2=0x7fe25c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.174+0000 7fe262e00640 1 -- 172.21.15.173:0/3233173097 shutdown_connections 2024-04-25T09:03:19.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.174+0000 7fe262e00640 1 -- 172.21.15.173:0/3233173097 wait complete. 2024-04-25T09:03:19.184 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:19.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.330+0000 7ff08ae00640 1 Processor -- start 2024-04-25T09:03:19.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.330+0000 7ff08ae00640 1 -- start start 2024-04-25T09:03:19.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.330+0000 7ff08ae00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff0840b3e70 0x7ff0840b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.330+0000 7ff08ae00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0840b3590 con 0x7ff0840aefa0 2024-04-25T09:03:19.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.330+0000 7ff08ae00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0840b4790 con 0x7ff08415edd0 2024-04-25T09:03:19.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.330+0000 7ff08ae00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff08406dd50 con 0x7ff0840b3e70 2024-04-25T09:03:19.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.330+0000 7ff07b400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ff0840aefa0 0x7ff0840b2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39014/0 (socket says 172.21.15.173:39014) 2024-04-25T09:03:19.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.330+0000 7ff07b400640 1 -- 172.21.15.173:0/702450458 learned_addr learned my addr 172.21.15.173:0/702450458 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:19.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.330+0000 7ff083400640 1 -- 172.21.15.173:0/702450458 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734186329 0 0) 0x7ff0840b3590 con 0x7ff0840aefa0 2024-04-25T09:03:19.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.330+0000 7ff083400640 1 -- 172.21.15.173:0/702450458 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff068003530 con 0x7ff0840aefa0 2024-04-25T09:03:19.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.330+0000 7ff083e00640 1 --2- 172.21.15.173:0/702450458 >> v2:172.21.15.194:3300/0 conn(0x7ff0840b3e70 0x7ff0840b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083400640 1 -- 172.21.15.173:0/702450458 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 921088449 0 0) 0x7ff068003530 con 0x7ff0840aefa0 2024-04-25T09:03:19.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083400640 1 -- 172.21.15.173:0/702450458 >> v2:172.21.15.194:3300/0 conn(0x7ff0840b3e70 msgr2=0x7ff0840b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:19.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083400640 1 --2- 172.21.15.173:0/702450458 >> v2:172.21.15.194:3300/0 conn(0x7ff0840b3e70 0x7ff0840b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083400640 1 -- 172.21.15.173:0/702450458 >> v1:172.21.15.194:6789/0 conn(0x7ff08415edd0 legacy=0x7ff0840b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083400640 1 -- 172.21.15.173:0/702450458 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08415f320 con 0x7ff0840aefa0 2024-04-25T09:03:19.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083400640 1 -- 172.21.15.173:0/702450458 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7ff06c001680 con 0x7ff0840aefa0 2024-04-25T09:03:19.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083400640 1 -- 172.21.15.173:0/702450458 >> v1:172.21.15.173:6789/0 conn(0x7ff0840aefa0 legacy=0x7ff0840b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083400640 1 --2- 172.21.15.173:0/702450458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff068003a10 0x7ff068003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083400640 1 --2- 172.21.15.173:0/702450458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff068004810 0x7ff068004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083400640 1 --2- 172.21.15.173:0/702450458 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0680051d0 0x7ff06800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083400640 1 -- 172.21.15.173:0/702450458 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08406dd50 con 0x7ff068003a10 2024-04-25T09:03:19.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083400640 1 -- 172.21.15.173:0/702450458 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06800c0d0 con 0x7ff068004810 2024-04-25T09:03:19.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083400640 1 -- 172.21.15.173:0/702450458 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06800c2d0 con 0x7ff0680051d0 2024-04-25T09:03:19.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083e00640 1 --2- 172.21.15.173:0/702450458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff068003a10 0x7ff068003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff07b400640 1 --2- 172.21.15.173:0/702450458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff068004810 0x7ff068004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff088e00640 1 --2- 172.21.15.173:0/702450458 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0680051d0 0x7ff06800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083e00640 1 -- 172.21.15.173:0/702450458 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0680051d0 msgr2=0x7ff06800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:19.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083e00640 1 --2- 172.21.15.173:0/702450458 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0680051d0 0x7ff06800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083e00640 1 -- 172.21.15.173:0/702450458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff068004810 msgr2=0x7ff068004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:19.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083e00640 1 --2- 172.21.15.173:0/702450458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff068004810 0x7ff068004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083e00640 1 -- 172.21.15.173:0/702450458 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff068003530 con 0x7ff068003a10 2024-04-25T09:03:19.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff07b400640 1 --2- 172.21.15.173:0/702450458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff068004810 0x7ff068004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:19.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff088e00640 1 --2- 172.21.15.173:0/702450458 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0680051d0 0x7ff06800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:19.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff088e00640 1 -- 172.21.15.173:0/702450458 reap_dead start 2024-04-25T09:03:19.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.334+0000 7ff083e00640 1 --2- 172.21.15.173:0/702450458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff068003a10 0x7ff068003e30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff074009fc0 tx=0x7ff07401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a316d709d768b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff083400640 1 -- 172.21.15.173:0/702450458 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0740b2070 con 0x7ff068003a10 2024-04-25T09:03:19.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff083400640 1 -- 172.21.15.173:0/702450458 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0740a5cf0 con 0x7ff068003a10 2024-04-25T09:03:19.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff083400640 1 -- 172.21.15.173:0/702450458 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff074009c10 con 0x7ff068003a10 2024-04-25T09:03:19.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff08ae00640 1 -- 172.21.15.173:0/702450458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff068003a10 msgr2=0x7ff068003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff08ae00640 1 --2- 172.21.15.173:0/702450458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff068003a10 0x7ff068003e30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff074009fc0 tx=0x7ff07401cc50 comp rx=0 tx=0).stop 2024-04-25T09:03:19.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff08ae00640 1 -- 172.21.15.173:0/702450458 shutdown_connections 2024-04-25T09:03:19.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff08ae00640 1 --2- 172.21.15.173:0/702450458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff068003a10 0x7ff068003e30 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff08ae00640 1 -- 172.21.15.173:0/702450458 >> 172.21.15.173:0/702450458 conn(0x7ff08406ac90 msgr2=0x7ff08406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff08ae00640 1 -- 172.21.15.173:0/702450458 shutdown_connections 2024-04-25T09:03:19.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff08ae00640 1 -- 172.21.15.173:0/702450458 wait complete. 2024-04-25T09:03:19.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff08ae00640 1 Processor -- start 2024-04-25T09:03:19.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff08ae00640 1 -- start start 2024-04-25T09:03:19.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff08ae00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff068003a10 0x7ff08414edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff08ae00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0840b1450 0x7ff08414f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff08ae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff084149b20 0x7ff084149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff08ae00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08415aba0 con 0x7ff068003a10 2024-04-25T09:03:19.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff08ae00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08406d9e0 con 0x7ff0840b1450 2024-04-25T09:03:19.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff08ae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08406e1c0 con 0x7ff084149b20 2024-04-25T09:03:19.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff083e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff068003a10 0x7ff08414edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff083e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff068003a10 0x7ff08414edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43234/0 (socket says 172.21.15.173:43234) 2024-04-25T09:03:19.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff083e00640 1 -- 172.21.15.173:0/4005297631 learned_addr learned my addr 172.21.15.173:0/4005297631 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:19.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff07b400640 1 --2- 172.21.15.173:0/4005297631 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0840b1450 0x7ff08414f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff088e00640 1 --2- 172.21.15.173:0/4005297631 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff084149b20 0x7ff084149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff083e00640 1 -- 172.21.15.173:0/4005297631 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff084149b20 msgr2=0x7ff084149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff083e00640 1 --2- 172.21.15.173:0/4005297631 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff084149b20 0x7ff084149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff083e00640 1 -- 172.21.15.173:0/4005297631 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0840b1450 msgr2=0x7ff08414f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff083e00640 1 --2- 172.21.15.173:0/4005297631 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0840b1450 0x7ff08414f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.338+0000 7ff083e00640 1 -- 172.21.15.173:0/4005297631 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0840b1910 con 0x7ff068003a10 2024-04-25T09:03:19.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.342+0000 7ff083e00640 1 --2- 172.21.15.173:0/4005297631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff068003a10 0x7ff08414edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff0740b0040 tx=0x7ff074009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.342+0000 7ff080c00640 1 -- 172.21.15.173:0/4005297631 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0740ba070 con 0x7ff068003a10 2024-04-25T09:03:19.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.342+0000 7ff080c00640 1 -- 172.21.15.173:0/4005297631 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0740ada40 con 0x7ff068003a10 2024-04-25T09:03:19.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.342+0000 7ff080c00640 1 -- 172.21.15.173:0/4005297631 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0740b2040 con 0x7ff068003a10 2024-04-25T09:03:19.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.342+0000 7ff08ae00640 1 -- 172.21.15.173:0/4005297631 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0840b1bf0 con 0x7ff068003a10 2024-04-25T09:03:19.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.342+0000 7ff08ae00640 1 -- 172.21.15.173:0/4005297631 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0840b21b0 con 0x7ff068003a10 2024-04-25T09:03:19.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.342+0000 7ff08ae00640 1 -- 172.21.15.173:0/4005297631 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff084073a40 con 0x7ff068003a10 2024-04-25T09:03:19.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.342+0000 7ff080c00640 1 -- 172.21.15.173:0/4005297631 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff0740b6410 con 0x7ff068003a10 2024-04-25T09:03:19.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.342+0000 7ff080c00640 1 --2- 172.21.15.173:0/4005297631 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff060066f60 0x7ff060069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.342+0000 7ff080c00640 1 -- 172.21.15.173:0/4005297631 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff07411fad0 con 0x7ff068003a10 2024-04-25T09:03:19.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.342+0000 7ff07b400640 1 --2- 172.21.15.173:0/4005297631 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff060066f60 0x7ff060069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.346+0000 7ff07b400640 1 --2- 172.21.15.173:0/4005297631 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff060066f60 0x7ff060069420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff06c001000 tx=0x7ff06c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.346+0000 7ff080c00640 1 -- 172.21.15.173:0/4005297631 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff074016990 con 0x7ff068003a10 2024-04-25T09:03:19.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.530+0000 7ff08ae00640 1 -- 172.21.15.173:0/4005297631 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff08406f1c0 con 0x7ff068003a10 2024-04-25T09:03:19.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.534+0000 7ff080c00640 1 -- 172.21.15.173:0/4005297631 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4946 (secure 0 0 0) 0x7ff0740f00b0 con 0x7ff068003a10 2024-04-25T09:03:19.522 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:19.522 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2883565303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2883565303},{"type":"v1","addr":"172.21.15.194:6834","nonce":2883565303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2634963400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2634963400},{"type":"v1","addr":"172.21.15.173:6837","nonce":2634963400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3101502434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3101502434},{"type":"v1","addr":"172.21.15.173:6836","nonce":3101502434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:51.389514+0000","modified":"2024-04-25T09:03:08.473956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/4160663138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4160663138},{"type":"v1","addr":"172.21.15.194:6835","nonce":4160663138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:03:19.522 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 9 2024-04-25T09:03:19.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.534+0000 7ff08ae00640 1 -- 172.21.15.173:0/4005297631 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff060066f60 msgr2=0x7ff060069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.534+0000 7ff08ae00640 1 --2- 172.21.15.173:0/4005297631 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff060066f60 0x7ff060069420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff06c001000 tx=0x7ff06c009040 comp rx=0 tx=0).stop 2024-04-25T09:03:19.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.534+0000 7ff08ae00640 1 -- 172.21.15.173:0/4005297631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff068003a10 msgr2=0x7ff08414edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.534+0000 7ff08ae00640 1 --2- 172.21.15.173:0/4005297631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff068003a10 0x7ff08414edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff0740b0040 tx=0x7ff074009750 comp rx=0 tx=0).stop 2024-04-25T09:03:19.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.534+0000 7ff08ae00640 1 -- 172.21.15.173:0/4005297631 shutdown_connections 2024-04-25T09:03:19.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.534+0000 7ff08ae00640 1 --2- 172.21.15.173:0/4005297631 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff060066f60 0x7ff060069420 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.534+0000 7ff08ae00640 1 --2- 172.21.15.173:0/4005297631 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff084149b20 0x7ff084149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.534+0000 7ff08ae00640 1 --2- 172.21.15.173:0/4005297631 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0840b1450 0x7ff08414f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.534+0000 7ff08ae00640 1 --2- 172.21.15.173:0/4005297631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff068003a10 0x7ff08414edb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.534+0000 7ff08ae00640 1 -- 172.21.15.173:0/4005297631 >> 172.21.15.173:0/4005297631 conn(0x7ff08406ac90 msgr2=0x7ff0840afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.534+0000 7ff08ae00640 1 -- 172.21.15.173:0/4005297631 shutdown_connections 2024-04-25T09:03:19.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.534+0000 7ff08ae00640 1 -- 172.21.15.173:0/4005297631 wait complete. 2024-04-25T09:03:19.543 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:19.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.686+0000 7f84cb800640 1 Processor -- start 2024-04-25T09:03:19.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.686+0000 7f84cb800640 1 -- start start 2024-04-25T09:03:19.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.690+0000 7f84cb800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f84c40b5070 0x7f84c406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.690+0000 7f84cb800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84c406ac90 0x7f84c406b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.690+0000 7f84cb800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c415e010 con 0x7f84c4157f00 2024-04-25T09:03:19.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.690+0000 7f84cb800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c406b640 con 0x7f84c40b5070 2024-04-25T09:03:19.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.690+0000 7f84cb800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c40b57e0 con 0x7f84c406ac90 2024-04-25T09:03:19.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.690+0000 7f84bbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f84c40b5070 0x7f84c406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.690+0000 7f84bbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f84c40b5070 0x7f84c406e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43242/0 (socket says 172.21.15.173:43242) 2024-04-25T09:03:19.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.690+0000 7f84bbe00640 1 -- 172.21.15.173:0/3217598657 learned_addr learned my addr 172.21.15.173:0/3217598657 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:19.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.690+0000 7f84c9800640 1 --2- 172.21.15.173:0/3217598657 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84c406ac90 0x7f84c406b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.690+0000 7f84bbe00640 1 -- 172.21.15.173:0/3217598657 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84c406ac90 msgr2=0x7f84c406b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:19.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.690+0000 7f84bbe00640 1 --2- 172.21.15.173:0/3217598657 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84c406ac90 0x7f84c406b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.690+0000 7f84bbe00640 1 -- 172.21.15.173:0/3217598657 >> v1:172.21.15.194:6789/0 conn(0x7f84c4157f00 legacy=0x7f84c40b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.690+0000 7f84bbe00640 1 -- 172.21.15.173:0/3217598657 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c406fe90 con 0x7f84c40b5070 2024-04-25T09:03:19.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.694+0000 7f84bbe00640 1 --2- 172.21.15.173:0/3217598657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84c40b5070 0x7f84c406e4d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009870 tx=0x7f84ac01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98360c3027debf32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.694+0000 7f84c3e00640 1 -- 172.21.15.173:0/3217598657 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0a95f0 con 0x7f84c40b5070 2024-04-25T09:03:19.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.694+0000 7f84c3e00640 1 -- 172.21.15.173:0/3217598657 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac0a9790 con 0x7f84c40b5070 2024-04-25T09:03:19.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.694+0000 7f84c3e00640 1 -- 172.21.15.173:0/3217598657 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0a9b60 con 0x7f84c40b5070 2024-04-25T09:03:19.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.694+0000 7f84cb800640 1 -- 172.21.15.173:0/3217598657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84c40b5070 msgr2=0x7f84c406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.694+0000 7f84cb800640 1 --2- 172.21.15.173:0/3217598657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84c40b5070 0x7f84c406e4d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009870 tx=0x7f84ac01c530 comp rx=0 tx=0).stop 2024-04-25T09:03:19.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.694+0000 7f84cb800640 1 -- 172.21.15.173:0/3217598657 shutdown_connections 2024-04-25T09:03:19.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.694+0000 7f84cb800640 1 --2- 172.21.15.173:0/3217598657 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84c406ac90 0x7f84c406b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.694+0000 7f84cb800640 1 --2- 172.21.15.173:0/3217598657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84c40b5070 0x7f84c406e4d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.694+0000 7f84cb800640 1 -- 172.21.15.173:0/3217598657 >> 172.21.15.173:0/3217598657 conn(0x7f84c4099a50 msgr2=0x7f84c40b5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.694+0000 7f84cb800640 1 -- 172.21.15.173:0/3217598657 shutdown_connections 2024-04-25T09:03:19.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.694+0000 7f84cb800640 1 -- 172.21.15.173:0/3217598657 wait complete. 2024-04-25T09:03:19.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.694+0000 7f84cb800640 1 Processor -- start 2024-04-25T09:03:19.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.694+0000 7f84cb800640 1 -- start start 2024-04-25T09:03:19.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84cb800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84c406ac90 0x7f84c40b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84cb800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84c40b5070 0x7f84c4153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84cb800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84c4157f00 0x7f84c4138e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84cb800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c4158460 con 0x7f84c40b5070 2024-04-25T09:03:19.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84cb800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c41582e0 con 0x7f84c406ac90 2024-04-25T09:03:19.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84cb800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c406ea10 con 0x7f84c4157f00 2024-04-25T09:03:19.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84bbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84c40b5070 0x7f84c4153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84bbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84c40b5070 0x7f84c4153f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43256/0 (socket says 172.21.15.173:43256) 2024-04-25T09:03:19.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84bbe00640 1 -- 172.21.15.173:0/1395811195 learned_addr learned my addr 172.21.15.173:0/1395811195 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:19.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84c8e00640 1 --2- 172.21.15.173:0/1395811195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84c406ac90 0x7f84c40b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84c9800640 1 --2- 172.21.15.173:0/1395811195 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84c4157f00 0x7f84c4138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84bbe00640 1 -- 172.21.15.173:0/1395811195 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84c4157f00 msgr2=0x7f84c4138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84bbe00640 1 --2- 172.21.15.173:0/1395811195 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84c4157f00 0x7f84c4138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84bbe00640 1 -- 172.21.15.173:0/1395811195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84c406ac90 msgr2=0x7f84c40b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84bbe00640 1 --2- 172.21.15.173:0/1395811195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84c406ac90 0x7f84c40b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84bbe00640 1 -- 172.21.15.173:0/1395811195 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c40af2d0 con 0x7f84c40b5070 2024-04-25T09:03:19.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84c8e00640 1 --2- 172.21.15.173:0/1395811195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84c406ac90 0x7f84c40b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:19.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84bbe00640 1 --2- 172.21.15.173:0/1395811195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84c40b5070 0x7f84c4153f80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0ab040 tx=0x7f84ac01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84c1600640 1 -- 172.21.15.173:0/1395811195 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0a95f0 con 0x7f84c40b5070 2024-04-25T09:03:19.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84c1600640 1 -- 172.21.15.173:0/1395811195 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac0b1820 con 0x7f84c40b5070 2024-04-25T09:03:19.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84c1600640 1 -- 172.21.15.173:0/1395811195 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0b1c10 con 0x7f84c40b5070 2024-04-25T09:03:19.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84cb800640 1 -- 172.21.15.173:0/1395811195 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c40af5b0 con 0x7f84c40b5070 2024-04-25T09:03:19.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84cb800640 1 -- 172.21.15.173:0/1395811195 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c40afb70 con 0x7f84c40b5070 2024-04-25T09:03:19.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.698+0000 7f84cb800640 1 -- 172.21.15.173:0/1395811195 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c4073a40 con 0x7f84c40b5070 2024-04-25T09:03:19.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.702+0000 7f84c1600640 1 -- 172.21.15.173:0/1395811195 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f84ac0c53f0 con 0x7f84c40b5070 2024-04-25T09:03:19.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.702+0000 7f84c1600640 1 --2- 172.21.15.173:0/1395811195 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84a0066f60 0x7f84a0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.702+0000 7f84c1600640 1 -- 172.21.15.173:0/1395811195 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f84ac11fd70 con 0x7f84c40b5070 2024-04-25T09:03:19.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.702+0000 7f84c8e00640 1 --2- 172.21.15.173:0/1395811195 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84a0066f60 0x7f84a0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.702+0000 7f84c8e00640 1 --2- 172.21.15.173:0/1395811195 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84a0066f60 0x7f84a0069420 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f84c41560c0 tx=0x7f84b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.706+0000 7f84c1600640 1 -- 172.21.15.173:0/1395811195 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f84ac0ad020 con 0x7f84c40b5070 2024-04-25T09:03:19.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.862+0000 7f84cb800640 1 -- 172.21.15.173:0/1395811195 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84c415b930 con 0x7f84c40b5070 2024-04-25T09:03:19.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.862+0000 7f84c1600640 1 -- 172.21.15.173:0/1395811195 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18574 (secure 0 0 0) 0x7f84ac016150 con 0x7f84c40b5070 2024-04-25T09:03:19.852 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:19.852 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:56.440593+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:19.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.866+0000 7f84cb800640 1 -- 172.21.15.173:0/1395811195 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84a0066f60 msgr2=0x7f84a0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.866+0000 7f84cb800640 1 --2- 172.21.15.173:0/1395811195 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84a0066f60 0x7f84a0069420 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f84c41560c0 tx=0x7f84b4009040 comp rx=0 tx=0).stop 2024-04-25T09:03:19.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.866+0000 7f84cb800640 1 -- 172.21.15.173:0/1395811195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84c40b5070 msgr2=0x7f84c4153f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.866+0000 7f84cb800640 1 --2- 172.21.15.173:0/1395811195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84c40b5070 0x7f84c4153f80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0ab040 tx=0x7f84ac01ad70 comp rx=0 tx=0).stop 2024-04-25T09:03:19.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.866+0000 7f84cb800640 1 -- 172.21.15.173:0/1395811195 shutdown_connections 2024-04-25T09:03:19.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.866+0000 7f84cb800640 1 --2- 172.21.15.173:0/1395811195 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84a0066f60 0x7f84a0069420 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.866+0000 7f84cb800640 1 --2- 172.21.15.173:0/1395811195 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84c4157f00 0x7f84c4138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.866+0000 7f84cb800640 1 --2- 172.21.15.173:0/1395811195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84c40b5070 0x7f84c4153f80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.866+0000 7f84cb800640 1 --2- 172.21.15.173:0/1395811195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84c406ac90 0x7f84c40b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.866+0000 7f84cb800640 1 -- 172.21.15.173:0/1395811195 >> 172.21.15.173:0/1395811195 conn(0x7f84c4099a50 msgr2=0x7f84c415d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.866+0000 7f84cb800640 1 -- 172.21.15.173:0/1395811195 shutdown_connections 2024-04-25T09:03:19.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:19.866+0000 7f84cb800640 1 -- 172.21.15.173:0/1395811195 wait complete. 2024-04-25T09:03:19.873 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:20.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.018+0000 7f97f9400640 1 Processor -- start 2024-04-25T09:03:20.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.018+0000 7f97f9400640 1 -- start start 2024-04-25T09:03:20.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.018+0000 7f97f9400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f97f41583f0 0x7f97f40d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.018+0000 7f97f9400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f97f40cce20 0x7f97f40d1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.018+0000 7f97f9400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f40cc080 con 0x7f97f4161b00 2024-04-25T09:03:20.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.018+0000 7f97f9400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f4162870 con 0x7f97f41583f0 2024-04-25T09:03:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.018+0000 7f97f9400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f40cc340 con 0x7f97f40cce20 2024-04-25T09:03:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.022+0000 7f97f2800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f97f41583f0 0x7f97f40d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.022+0000 7f97f2800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f97f41583f0 0x7f97f40d17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43264/0 (socket says 172.21.15.173:43264) 2024-04-25T09:03:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.022+0000 7f97f2800640 1 -- 172.21.15.173:0/3728588287 learned_addr learned my addr 172.21.15.173:0/3728588287 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.022+0000 7f97f2800640 1 -- 172.21.15.173:0/3728588287 >> v2:172.21.15.194:3300/0 conn(0x7f97f40cce20 msgr2=0x7f97f40d1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.022+0000 7f97f2800640 1 --2- 172.21.15.173:0/3728588287 >> v2:172.21.15.194:3300/0 conn(0x7f97f40cce20 0x7f97f40d1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.022+0000 7f97f2800640 1 -- 172.21.15.173:0/3728588287 >> v1:172.21.15.194:6789/0 conn(0x7f97f4161b00 legacy=0x7f97f4161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.022+0000 7f97f2800640 1 -- 172.21.15.173:0/3728588287 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f40cc620 con 0x7f97f41583f0 2024-04-25T09:03:20.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.022+0000 7f97f2800640 1 --2- 172.21.15.173:0/3728588287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97f41583f0 0x7f97f40d17b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f97f40cf340 tx=0x7f97e401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9943a33fea43a94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.022+0000 7f97f1e00640 1 -- 172.21.15.173:0/3728588287 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e40b0070 con 0x7f97f41583f0 2024-04-25T09:03:20.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.022+0000 7f97f1e00640 1 -- 172.21.15.173:0/3728588287 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e40ab600 con 0x7f97f41583f0 2024-04-25T09:03:20.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.022+0000 7f97f1e00640 1 -- 172.21.15.173:0/3728588287 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e40ab9d0 con 0x7f97f41583f0 2024-04-25T09:03:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f9400640 1 -- 172.21.15.173:0/3728588287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97f41583f0 msgr2=0x7f97f40d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f9400640 1 --2- 172.21.15.173:0/3728588287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97f41583f0 0x7f97f40d17b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f97f40cf340 tx=0x7f97e401c520 comp rx=0 tx=0).stop 2024-04-25T09:03:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f9400640 1 -- 172.21.15.173:0/3728588287 shutdown_connections 2024-04-25T09:03:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f9400640 1 --2- 172.21.15.173:0/3728588287 >> v2:172.21.15.194:3300/0 conn(0x7f97f40cce20 0x7f97f40d1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f9400640 1 --2- 172.21.15.173:0/3728588287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97f41583f0 0x7f97f40d17b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f9400640 1 -- 172.21.15.173:0/3728588287 >> 172.21.15.173:0/3728588287 conn(0x7f97f406f600 msgr2=0x7f97f406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f9400640 1 -- 172.21.15.173:0/3728588287 shutdown_connections 2024-04-25T09:03:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f9400640 1 -- 172.21.15.173:0/3728588287 wait complete. 2024-04-25T09:03:20.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f9400640 1 Processor -- start 2024-04-25T09:03:20.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f9400640 1 -- start start 2024-04-25T09:03:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f9400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97f40cce20 0x7f97f4152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f9400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97f41583f0 0x7f97f40c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f9400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97f4161b00 0x7f97f40cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f9400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f40ced00 con 0x7f97f40cce20 2024-04-25T09:03:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f9400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f40ceb80 con 0x7f97f41583f0 2024-04-25T09:03:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f9400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f40cee80 con 0x7f97f4161b00 2024-04-25T09:03:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f2800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97f40cce20 0x7f97f4152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f2800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97f40cce20 0x7f97f4152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43278/0 (socket says 172.21.15.173:43278) 2024-04-25T09:03:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f2800640 1 -- 172.21.15.173:0/1855421917 learned_addr learned my addr 172.21.15.173:0/1855421917 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97e9e00640 1 --2- 172.21.15.173:0/1855421917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97f41583f0 0x7f97f40c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f3200640 1 --2- 172.21.15.173:0/1855421917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97f4161b00 0x7f97f40cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f2800640 1 -- 172.21.15.173:0/1855421917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97f4161b00 msgr2=0x7f97f40cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f2800640 1 --2- 172.21.15.173:0/1855421917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97f4161b00 0x7f97f40cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f2800640 1 -- 172.21.15.173:0/1855421917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97f41583f0 msgr2=0x7f97f40c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f2800640 1 --2- 172.21.15.173:0/1855421917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97f41583f0 0x7f97f40c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f2800640 1 -- 172.21.15.173:0/1855421917 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f4153040 con 0x7f97f40cce20 2024-04-25T09:03:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.026+0000 7f97f2800640 1 --2- 172.21.15.173:0/1855421917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97f40cce20 0x7f97f4152b00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f97e401abd0 tx=0x7f97e401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.030+0000 7f97eb400640 1 -- 172.21.15.173:0/1855421917 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e40b0040 con 0x7f97f40cce20 2024-04-25T09:03:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.030+0000 7f97eb400640 1 -- 172.21.15.173:0/1855421917 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e40bc070 con 0x7f97f40cce20 2024-04-25T09:03:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.030+0000 7f97eb400640 1 -- 172.21.15.173:0/1855421917 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e40b6880 con 0x7f97f40cce20 2024-04-25T09:03:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.030+0000 7f97f9400640 1 -- 172.21.15.173:0/1855421917 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f4153500 con 0x7f97f40cce20 2024-04-25T09:03:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.030+0000 7f97f9400640 1 -- 172.21.15.173:0/1855421917 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f41f7460 con 0x7f97f40cce20 2024-04-25T09:03:20.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.030+0000 7f97f9400640 1 -- 172.21.15.173:0/1855421917 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f41f7e00 con 0x7f97f40cce20 2024-04-25T09:03:20.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.030+0000 7f97eb400640 1 -- 172.21.15.173:0/1855421917 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f97e40b6a20 con 0x7f97f40cce20 2024-04-25T09:03:20.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.030+0000 7f97eb400640 1 --2- 172.21.15.173:0/1855421917 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f97d0066f60 0x7f97d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.030+0000 7f97eb400640 1 -- 172.21.15.173:0/1855421917 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f97e411f800 con 0x7f97f40cce20 2024-04-25T09:03:20.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.030+0000 7f97e9e00640 1 --2- 172.21.15.173:0/1855421917 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f97d0066f60 0x7f97d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.030+0000 7f97e9e00640 1 --2- 172.21.15.173:0/1855421917 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f97d0066f60 0x7f97d0069420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f97f40cabe0 tx=0x7f97dc0094f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.034+0000 7f97eb400640 1 -- 172.21.15.173:0/1855421917 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f97f41f7e00 con 0x7f97f40cce20 2024-04-25T09:03:20.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.226+0000 7f97f9400640 1 -- 172.21.15.173:0/1855421917 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97f40cf650 con 0x7f97f40cce20 2024-04-25T09:03:20.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.226+0000 7f97eb400640 1 -- 172.21.15.173:0/1855421917 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4946 (secure 0 0 0) 0x7f97e4016110 con 0x7f97f40cce20 2024-04-25T09:03:20.217 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:20.217 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2883565303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2883565303},{"type":"v1","addr":"172.21.15.194:6834","nonce":2883565303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2634963400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2634963400},{"type":"v1","addr":"172.21.15.173:6837","nonce":2634963400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3101502434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3101502434},{"type":"v1","addr":"172.21.15.173:6836","nonce":3101502434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:51.389514+0000","modified":"2024-04-25T09:03:08.473956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/4160663138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4160663138},{"type":"v1","addr":"172.21.15.194:6835","nonce":4160663138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:03:20.217 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 9 2024-04-25T09:03:20.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.230+0000 7f97f9400640 1 -- 172.21.15.173:0/1855421917 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f97d0066f60 msgr2=0x7f97d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.230+0000 7f97f9400640 1 --2- 172.21.15.173:0/1855421917 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f97d0066f60 0x7f97d0069420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f97f40cabe0 tx=0x7f97dc0094f0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.230+0000 7f97f9400640 1 -- 172.21.15.173:0/1855421917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97f40cce20 msgr2=0x7f97f4152b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.230+0000 7f97f9400640 1 --2- 172.21.15.173:0/1855421917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97f40cce20 0x7f97f4152b00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f97e401abd0 tx=0x7f97e401ad60 comp rx=0 tx=0).stop 2024-04-25T09:03:20.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.230+0000 7f97f9400640 1 -- 172.21.15.173:0/1855421917 shutdown_connections 2024-04-25T09:03:20.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.230+0000 7f97f9400640 1 --2- 172.21.15.173:0/1855421917 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f97d0066f60 0x7f97d0069420 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.230+0000 7f97f9400640 1 --2- 172.21.15.173:0/1855421917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97f4161b00 0x7f97f40cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.230+0000 7f97f9400640 1 --2- 172.21.15.173:0/1855421917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97f41583f0 0x7f97f40c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.230+0000 7f97f9400640 1 --2- 172.21.15.173:0/1855421917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97f40cce20 0x7f97f4152b00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.230+0000 7f97f9400640 1 -- 172.21.15.173:0/1855421917 >> 172.21.15.173:0/1855421917 conn(0x7f97f406f600 msgr2=0x7f97f406d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.230+0000 7f97f9400640 1 -- 172.21.15.173:0/1855421917 shutdown_connections 2024-04-25T09:03:20.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.230+0000 7f97f9400640 1 -- 172.21.15.173:0/1855421917 wait complete. 2024-04-25T09:03:20.642 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:02:51.389514+0000', 'modified': '2024-04-25T09:03:08.473956+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.194:6835/4160663138', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6833', 'nonce': 4160663138}, {'type': 'v1', 'addr': '172.21.15.194:6835', 'nonce': 4160663138}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:03:20.642 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:03:20.642 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T09:03:20.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.790+0000 7f8270e00640 1 Processor -- start 2024-04-25T09:03:20.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.790+0000 7f8270e00640 1 -- start start 2024-04-25T09:03:20.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.794+0000 7f8270e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f826c15f060 0x7f826c0b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.794+0000 7f8270e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f826c09aa60 0x7f826c15f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.794+0000 7f8270e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826c0b1530 con 0x7f826c0b2910 2024-04-25T09:03:20.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.794+0000 7f8270e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f826c0cfd60 con 0x7f826c15f060 2024-04-25T09:03:20.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.794+0000 7f8270e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f826c0d0040 con 0x7f826c09aa60 2024-04-25T09:03:20.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.794+0000 7f826b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f826c15f060 0x7f826c0b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.794+0000 7f826b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f826c15f060 0x7f826c0b0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43294/0 (socket says 172.21.15.173:43294) 2024-04-25T09:03:20.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.794+0000 7f826b400640 1 -- 172.21.15.173:0/1257890134 learned_addr learned my addr 172.21.15.173:0/1257890134 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:20.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.794+0000 7f826be00640 1 --2- 172.21.15.173:0/1257890134 >> v2:172.21.15.194:3300/0 conn(0x7f826c09aa60 0x7f826c15f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.794+0000 7f826b400640 1 -- 172.21.15.173:0/1257890134 >> v2:172.21.15.194:3300/0 conn(0x7f826c09aa60 msgr2=0x7f826c15f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.794+0000 7f826b400640 1 --2- 172.21.15.173:0/1257890134 >> v2:172.21.15.194:3300/0 conn(0x7f826c09aa60 0x7f826c15f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.794+0000 7f826b400640 1 -- 172.21.15.173:0/1257890134 >> v1:172.21.15.194:6789/0 conn(0x7f826c0b2910 legacy=0x7f826c0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.794+0000 7f826b400640 1 -- 172.21.15.173:0/1257890134 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c0cf350 con 0x7f826c15f060 2024-04-25T09:03:20.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.794+0000 7f826be00640 1 --2- 172.21.15.173:0/1257890134 >> v2:172.21.15.194:3300/0 conn(0x7f826c09aa60 0x7f826c15f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:20.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.794+0000 7f826b400640 1 --2- 172.21.15.173:0/1257890134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f826c15f060 0x7f826c0b0ff0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f826c0c8730 tx=0x7f825c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aeb91fa33cc73b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f826a000640 1 -- 172.21.15.173:0/1257890134 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c0ab430 con 0x7f826c15f060 2024-04-25T09:03:20.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f826a000640 1 -- 172.21.15.173:0/1257890134 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c0b0070 con 0x7f826c15f060 2024-04-25T09:03:20.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f826a000640 1 -- 172.21.15.173:0/1257890134 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c0ab7f0 con 0x7f826c15f060 2024-04-25T09:03:20.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f8270e00640 1 -- 172.21.15.173:0/1257890134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f826c15f060 msgr2=0x7f826c0b0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f8270e00640 1 --2- 172.21.15.173:0/1257890134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f826c15f060 0x7f826c0b0ff0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f826c0c8730 tx=0x7f825c01c450 comp rx=0 tx=0).stop 2024-04-25T09:03:20.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f8270e00640 1 -- 172.21.15.173:0/1257890134 shutdown_connections 2024-04-25T09:03:20.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f8270e00640 1 --2- 172.21.15.173:0/1257890134 >> v2:172.21.15.194:3300/0 conn(0x7f826c09aa60 0x7f826c15f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f8270e00640 1 --2- 172.21.15.173:0/1257890134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f826c15f060 0x7f826c0b0ff0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f8270e00640 1 -- 172.21.15.173:0/1257890134 >> 172.21.15.173:0/1257890134 conn(0x7f826c0b31d0 msgr2=0x7f826c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f8270e00640 1 -- 172.21.15.173:0/1257890134 shutdown_connections 2024-04-25T09:03:20.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f8270e00640 1 -- 172.21.15.173:0/1257890134 wait complete. 2024-04-25T09:03:20.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f8270e00640 1 Processor -- start 2024-04-25T09:03:20.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f8270e00640 1 -- start start 2024-04-25T09:03:20.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f8270e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f826c09aa60 0x7f826c0b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f8270e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f826c0b2910 0x7f826c0cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f8270e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f826c15f060 0x7f826c0cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f8270e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c0cf870 con 0x7f826c15f060 2024-04-25T09:03:20.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f8270e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c15fe30 con 0x7f826c0b2910 2024-04-25T09:03:20.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f8270e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826c0b5630 con 0x7f826c09aa60 2024-04-25T09:03:20.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f826be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f826c15f060 0x7f826c0cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f826be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f826c15f060 0x7f826c0cd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43302/0 (socket says 172.21.15.173:43302) 2024-04-25T09:03:20.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f826be00640 1 -- 172.21.15.173:0/3422377867 learned_addr learned my addr 172.21.15.173:0/3422377867 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:20.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f826b400640 1 --2- 172.21.15.173:0/3422377867 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f826c09aa60 0x7f826c0b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.798+0000 7f826aa00640 1 --2- 172.21.15.173:0/3422377867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f826c0b2910 0x7f826c0cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.802+0000 7f826be00640 1 -- 172.21.15.173:0/3422377867 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f826c09aa60 msgr2=0x7f826c0b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.802+0000 7f826be00640 1 --2- 172.21.15.173:0/3422377867 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f826c09aa60 0x7f826c0b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.802+0000 7f826be00640 1 -- 172.21.15.173:0/3422377867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f826c0b2910 msgr2=0x7f826c0cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.802+0000 7f826be00640 1 --2- 172.21.15.173:0/3422377867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f826c0b2910 0x7f826c0cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.802+0000 7f826be00640 1 -- 172.21.15.173:0/3422377867 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c0b0050 con 0x7f826c15f060 2024-04-25T09:03:20.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.802+0000 7f826be00640 1 --2- 172.21.15.173:0/3422377867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f826c15f060 0x7f826c0cd4f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f826400cef0 tx=0x7f826400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.802+0000 7f8263400640 1 -- 172.21.15.173:0/3422377867 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826401a070 con 0x7f826c15f060 2024-04-25T09:03:20.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.802+0000 7f8263400640 1 -- 172.21.15.173:0/3422377867 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826400d860 con 0x7f826c15f060 2024-04-25T09:03:20.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.802+0000 7f8263400640 1 -- 172.21.15.173:0/3422377867 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826400dc50 con 0x7f826c15f060 2024-04-25T09:03:20.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.802+0000 7f8270e00640 1 -- 172.21.15.173:0/3422377867 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f826c0afd70 con 0x7f826c15f060 2024-04-25T09:03:20.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.802+0000 7f8270e00640 1 -- 172.21.15.173:0/3422377867 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f826c0b52c0 con 0x7f826c15f060 2024-04-25T09:03:20.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.802+0000 7f8263400640 1 -- 172.21.15.173:0/3422377867 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f826401d070 con 0x7f826c15f060 2024-04-25T09:03:20.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.802+0000 7f8263400640 1 --2- 172.21.15.173:0/3422377867 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f824c066f60 0x7f824c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.802+0000 7f8263400640 1 -- 172.21.15.173:0/3422377867 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8264085c20 con 0x7f826c15f060 2024-04-25T09:03:20.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.802+0000 7f826b400640 1 --2- 172.21.15.173:0/3422377867 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f824c066f60 0x7f824c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f82757b4000 1 Processor -- start 2024-04-25T09:03:20.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f82757b4000 1 -- start start 2024-04-25T09:03:20.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f826b400640 1 --2- 172.21.15.173:0/3422377867 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f824c066f60 0x7f824c069420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f825c0af000 tx=0x7f825c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f82757b4000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742fd920 0x55be742fdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f82757b4000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742fe240 0x55be742b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f82757b4000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742b3f30 0x55be742b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f82757b4000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be7419b5f0 con 0x55be742fe240 2024-04-25T09:03:20.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f82757b4000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be74102da0 con 0x55be742fd920 2024-04-25T09:03:20.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f82757b4000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be7408b150 con 0x55be742b3f30 2024-04-25T09:03:20.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f826aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742fe240 0x55be742b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f826b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742fd920 0x55be742fdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f826aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742fe240 0x55be742b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43304/0 (socket says 172.21.15.173:43304) 2024-04-25T09:03:20.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f826aa00640 1 -- 172.21.15.173:0/2641774197 learned_addr learned my addr 172.21.15.173:0/2641774197 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:20.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f826b400640 1 --2- 172.21.15.173:0/2641774197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742fd920 0x55be742fdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:60680/0 (socket says 172.21.15.173:60680) 2024-04-25T09:03:20.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f826be00640 1 --2- 172.21.15.173:0/2641774197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742b3f30 0x55be742b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f826aa00640 1 -- 172.21.15.173:0/2641774197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742b3f30 msgr2=0x55be742b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f826aa00640 1 --2- 172.21.15.173:0/2641774197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742b3f30 0x55be742b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f826aa00640 1 -- 172.21.15.173:0/2641774197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742fd920 msgr2=0x55be742fdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f826aa00640 1 --2- 172.21.15.173:0/2641774197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742fd920 0x55be742fdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f826aa00640 1 -- 172.21.15.173:0/2641774197 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be740a4ca0 con 0x55be742fe240 2024-04-25T09:03:20.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f826aa00640 1 --2- 172.21.15.173:0/2641774197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742fe240 0x55be742b39f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8258001820 tx=0x7f8258007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1bfbe9c7fffd83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f8257e00640 1 -- 172.21.15.173:0/2641774197 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82580052e0 con 0x55be742fe240 2024-04-25T09:03:20.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f8257e00640 1 -- 172.21.15.173:0/2641774197 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8258018070 con 0x55be742fe240 2024-04-25T09:03:20.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f8257e00640 1 -- 172.21.15.173:0/2641774197 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258005480 con 0x55be742fe240 2024-04-25T09:03:20.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f82757b4000 1 -- 172.21.15.173:0/2641774197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742fe240 msgr2=0x55be742b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f82757b4000 1 --2- 172.21.15.173:0/2641774197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742fe240 0x55be742b39f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8258001820 tx=0x7f8258007e20 comp rx=0 tx=0).stop 2024-04-25T09:03:20.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f82757b4000 1 -- 172.21.15.173:0/2641774197 shutdown_connections 2024-04-25T09:03:20.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f82757b4000 1 --2- 172.21.15.173:0/2641774197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742b3f30 0x55be742b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f82757b4000 1 --2- 172.21.15.173:0/2641774197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742fe240 0x55be742b39f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f82757b4000 1 --2- 172.21.15.173:0/2641774197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742fd920 0x55be742fdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f82757b4000 1 -- 172.21.15.173:0/2641774197 >> 172.21.15.173:0/2641774197 conn(0x55be742ba2a0 msgr2=0x55be742b22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f82757b4000 1 -- 172.21.15.173:0/2641774197 shutdown_connections 2024-04-25T09:03:20.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f82757b4000 1 -- 172.21.15.173:0/2641774197 wait complete. 2024-04-25T09:03:20.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.806+0000 7f82757b4000 1 -- start start 2024-04-25T09:03:20.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f82757b4000 1 Processor -- start 2024-04-25T09:03:20.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f82757b4000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742b3f30 0x55be742ee8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f82757b4000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742fd920 0x55be7430bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f82757b4000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742fe240 0x55be7430e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f82757b4000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be740bd990 con 0x55be742fe240 2024-04-25T09:03:20.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f82757b4000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be740fee40 con 0x55be742b3f30 2024-04-25T09:03:20.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f82757b4000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be7408e900 con 0x55be742fd920 2024-04-25T09:03:20.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f82757b4000 10 client.0 _ll_register_callbacks cb 0x55be741b61c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:20.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f826be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742fe240 0x55be7430e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f826be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742fe240 0x55be7430e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43320/0 (socket says 172.21.15.173:43320) 2024-04-25T09:03:20.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f826be00640 1 -- 172.21.15.173:0/51312441 learned_addr learned my addr 172.21.15.173:0/51312441 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:20.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f826b400640 1 --2- 172.21.15.173:0/51312441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742b3f30 0x55be742ee8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f826aa00640 1 --2- 172.21.15.173:0/51312441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742fd920 0x55be7430bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f826be00640 1 -- 172.21.15.173:0/51312441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742fd920 msgr2=0x55be7430bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f826be00640 1 --2- 172.21.15.173:0/51312441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742fd920 0x55be7430bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f826be00640 1 -- 172.21.15.173:0/51312441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742b3f30 msgr2=0x55be742ee8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f826be00640 1 --2- 172.21.15.173:0/51312441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742b3f30 0x55be742ee8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f826be00640 1 -- 172.21.15.173:0/51312441 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be740bb630 con 0x55be742fe240 2024-04-25T09:03:20.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f826b400640 1 --2- 172.21.15.173:0/51312441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742b3f30 0x55be742ee8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:20.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f826aa00640 1 --2- 172.21.15.173:0/51312441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742fd920 0x55be7430bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:20.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f826be00640 1 --2- 172.21.15.173:0/51312441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742fe240 0x55be7430e2a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8264083d70 tx=0x7f826405e920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c8e3389858f66c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f8254c00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:03:20.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f8254c00640 1 -- 172.21.15.173:0/51312441 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8264081070 con 0x55be742fe240 2024-04-25T09:03:20.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f8254c00640 1 -- 172.21.15.173:0/51312441 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f826405e490 con 0x55be742fe240 2024-04-25T09:03:20.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f82757b4000 1 -- 172.21.15.173:0/51312441 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8258018070 con 0x55be742fe240 2024-04-25T09:03:20.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f8254c00640 1 -- 172.21.15.173:0/51312441 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f826405e690 con 0x55be742fe240 2024-04-25T09:03:20.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f82757b4000 10 client.4833 fetch_fsmap learned FSMap version 9 2024-04-25T09:03:20.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f82757b4000 1 -- 172.21.15.173:0/51312441 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55be7408b3a0 con 0x55be742fe240 2024-04-25T09:03:20.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f8254c00640 1 -- 172.21.15.173:0/51312441 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8258018070 con 0x55be742fe240 2024-04-25T09:03:20.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f8254c00640 1 -- 172.21.15.173:0/51312441 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f8264074120 con 0x55be742fe240 2024-04-25T09:03:20.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f82757b4000 10 client.4833 fetch_fsmap finished waiting for FSMap version 9 2024-04-25T09:03:20.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f82757b4000 10 client.4833 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T09:03:20.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f82757b4000 20 client.4833 populate_metadata read hostname 'smithi173' 2024-04-25T09:03:20.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f82757b4000 1 --2- 172.21.15.173:0/51312441 >> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] conn(0x55be74310fb0 0x55be743133a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f82757b4000 4 client.4833 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:20.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f82757b4000 1 -- 172.21.15.173:0/51312441 --> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be7409ea50 con 0x55be74310fb0 2024-04-25T09:03:20.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f826b400640 1 --2- 172.21.15.173:0/51312441 >> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] conn(0x55be74310fb0 0x55be743133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f826b400640 1 --2- 172.21.15.173:0/51312441 >> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] conn(0x55be74310fb0 0x55be743133a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=feefb548db1299bd server_cookie=6ddec9ffc3c5db4c in_seq=0 out_seq=0 2024-04-25T09:03:20.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.810+0000 7f8254c00640 10 client.4833 ms_handle_connect on v2:172.21.15.194:6833/4160663138 2024-04-25T09:03:20.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.814+0000 7f8254c00640 1 -- 172.21.15.173:0/51312441 <== mds.0 v2:172.21.15.194:6833/4160663138 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55be7409ea50 con 0x55be74310fb0 2024-04-25T09:03:20.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.814+0000 7f8254c00640 10 client.4833 handle_command_reply: tid=0 2024-04-25T09:03:20.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.814+0000 7f82757b4000 1 client.4833 shutdown 2024-04-25T09:03:20.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.814+0000 7f82757b4000 1 -- 172.21.15.173:0/51312441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742fe240 msgr2=0x55be7430e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.814+0000 7f82757b4000 1 --2- 172.21.15.173:0/51312441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742fe240 0x55be7430e2a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8264083d70 tx=0x7f826405e920 comp rx=0 tx=0).stop 2024-04-25T09:03:20.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.814+0000 7f82757b4000 1 -- 172.21.15.173:0/51312441 shutdown_connections 2024-04-25T09:03:20.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.814+0000 7f82757b4000 1 --2- 172.21.15.173:0/51312441 >> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] conn(0x55be74310fb0 0x55be743133a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.814+0000 7f82757b4000 1 --2- 172.21.15.173:0/51312441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742fe240 0x55be7430e2a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.814+0000 7f82757b4000 1 --2- 172.21.15.173:0/51312441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742fd920 0x55be7430bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.814+0000 7f82757b4000 1 --2- 172.21.15.173:0/51312441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742b3f30 0x55be742ee8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.814+0000 7f82757b4000 1 -- 172.21.15.173:0/51312441 >> 172.21.15.173:0/51312441 conn(0x55be742ba2a0 msgr2=0x55be742b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.814+0000 7f8254c00640 0 client.4833 ms_handle_reset on v2:172.21.15.194:6833/4160663138 2024-04-25T09:03:20.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.814+0000 7f82757b4000 1 -- 172.21.15.173:0/51312441 shutdown_connections 2024-04-25T09:03:20.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.814+0000 7f82757b4000 1 -- 172.21.15.173:0/51312441 wait complete. 2024-04-25T09:03:20.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.814+0000 7f82757b4000 20 client.4833 trim_cache size 0 max 16384 2024-04-25T09:03:20.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.826+0000 7f82757b4000 1 Processor -- start 2024-04-25T09:03:20.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.826+0000 7f82757b4000 1 -- start start 2024-04-25T09:03:20.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f82757b4000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742b3f30 0x55be74359810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f82757b4000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742fd920 0x55be742e9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f82757b4000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742fe240 0x55be742ea190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f82757b4000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c14a0a0 con 0x55be742b3f30 2024-04-25T09:03:20.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f82757b4000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c0c9520 con 0x55be742fe240 2024-04-25T09:03:20.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f82757b4000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826c06dbf0 con 0x55be742fd920 2024-04-25T09:03:20.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f826b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742b3f30 0x55be74359810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f826b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742b3f30 0x55be74359810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43324/0 (socket says 172.21.15.173:43324) 2024-04-25T09:03:20.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f826b400640 1 -- 172.21.15.173:0/2106223409 learned_addr learned my addr 172.21.15.173:0/2106223409 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:20.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f826aa00640 1 --2- 172.21.15.173:0/2106223409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742fd920 0x55be742e9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f826be00640 1 --2- 172.21.15.173:0/2106223409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742fe240 0x55be742ea190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f826b400640 1 -- 172.21.15.173:0/2106223409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742fd920 msgr2=0x55be742e9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f826b400640 1 --2- 172.21.15.173:0/2106223409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742fd920 0x55be742e9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f826b400640 1 -- 172.21.15.173:0/2106223409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742fe240 msgr2=0x55be742ea190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f826b400640 1 --2- 172.21.15.173:0/2106223409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742fe240 0x55be742ea190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f826b400640 1 -- 172.21.15.173:0/2106223409 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be742fe070 con 0x55be742b3f30 2024-04-25T09:03:20.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f826b400640 1 --2- 172.21.15.173:0/2106223409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742b3f30 0x55be74359810 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f825c008010 tx=0x7f825c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995394f417645359 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f8257400640 1 -- 172.21.15.173:0/2106223409 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c0b58d0 con 0x55be742b3f30 2024-04-25T09:03:20.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f8257400640 1 -- 172.21.15.173:0/2106223409 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c0c8e50 con 0x55be742b3f30 2024-04-25T09:03:20.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f8257400640 1 -- 172.21.15.173:0/2106223409 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c0b5a70 con 0x55be742b3f30 2024-04-25T09:03:20.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f82757b4000 1 -- 172.21.15.173:0/2106223409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742b3f30 msgr2=0x55be74359810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f82757b4000 1 --2- 172.21.15.173:0/2106223409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742b3f30 0x55be74359810 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f825c008010 tx=0x7f825c004740 comp rx=0 tx=0).stop 2024-04-25T09:03:20.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f82757b4000 1 -- 172.21.15.173:0/2106223409 shutdown_connections 2024-04-25T09:03:20.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f82757b4000 1 --2- 172.21.15.173:0/2106223409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742fe240 0x55be742ea190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f82757b4000 1 --2- 172.21.15.173:0/2106223409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742fd920 0x55be742e9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f82757b4000 1 --2- 172.21.15.173:0/2106223409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742b3f30 0x55be74359810 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f82757b4000 1 -- 172.21.15.173:0/2106223409 >> 172.21.15.173:0/2106223409 conn(0x55be742ba2a0 msgr2=0x55be743148e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f82757b4000 1 -- 172.21.15.173:0/2106223409 shutdown_connections 2024-04-25T09:03:20.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f82757b4000 1 -- 172.21.15.173:0/2106223409 wait complete. 2024-04-25T09:03:20.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f82757b4000 1 -- start start 2024-04-25T09:03:20.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.830+0000 7f82757b4000 1 Processor -- start 2024-04-25T09:03:20.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742b3f30 0x55be742ed820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742fd920 0x55be74348770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742fe240 0x55be74348cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be741073d0 con 0x55be742b3f30 2024-04-25T09:03:20.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be741bed50 con 0x55be742fd920 2024-04-25T09:03:20.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be7409d980 con 0x55be742fe240 2024-04-25T09:03:20.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 10 client.0 _ll_register_callbacks cb 0x7f8258001270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:20.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f826b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742b3f30 0x55be742ed820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f826b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742b3f30 0x55be742ed820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43336/0 (socket says 172.21.15.173:43336) 2024-04-25T09:03:20.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f826b400640 1 -- 172.21.15.173:0/34602463 learned_addr learned my addr 172.21.15.173:0/34602463 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:20.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f826aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742fd920 0x55be74348770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f826be00640 1 --2- 172.21.15.173:0/34602463 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742fe240 0x55be74348cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f826b400640 1 -- 172.21.15.173:0/34602463 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742fe240 msgr2=0x55be74348cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f826b400640 1 --2- 172.21.15.173:0/34602463 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742fe240 0x55be74348cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f826b400640 1 -- 172.21.15.173:0/34602463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742fd920 msgr2=0x55be74348770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f826b400640 1 --2- 172.21.15.173:0/34602463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742fd920 0x55be74348770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f826b400640 1 -- 172.21.15.173:0/34602463 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be74184600 con 0x55be742b3f30 2024-04-25T09:03:20.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f826b400640 1 --2- 172.21.15.173:0/34602463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742b3f30 0x55be742ed820 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f825c0cb040 tx=0x7f825c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e786a2e8524b8eaf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f8254c00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:03:20.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f8254c00640 1 -- 172.21.15.173:0/34602463 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c0b5990 con 0x55be742b3f30 2024-04-25T09:03:20.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f8254c00640 1 -- 172.21.15.173:0/34602463 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f825c0a8040 con 0x55be742b3f30 2024-04-25T09:03:20.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 -- 172.21.15.173:0/34602463 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f825c0c8e50 con 0x55be742b3f30 2024-04-25T09:03:20.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f8254c00640 1 -- 172.21.15.173:0/34602463 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f825c0b5b30 con 0x55be742b3f30 2024-04-25T09:03:20.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 10 client.4839 fetch_fsmap learned FSMap version 9 2024-04-25T09:03:20.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 -- 172.21.15.173:0/34602463 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55be740979b0 con 0x55be742b3f30 2024-04-25T09:03:20.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f8254c00640 1 -- 172.21.15.173:0/34602463 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c0c8e50 con 0x55be742b3f30 2024-04-25T09:03:20.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f8254c00640 1 -- 172.21.15.173:0/34602463 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f825c0aa070 con 0x55be742b3f30 2024-04-25T09:03:20.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 10 client.4839 fetch_fsmap finished waiting for FSMap version 9 2024-04-25T09:03:20.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 10 client.4839 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T09:03:20.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 20 client.4839 populate_metadata read hostname 'smithi173' 2024-04-25T09:03:20.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 --2- 172.21.15.173:0/34602463 >> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] conn(0x55be742b9e80 0x55be7435a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 4 client.4839 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:03:20.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 -- 172.21.15.173:0/34602463 --> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55be741102e0 con 0x55be742b9e80 2024-04-25T09:03:20.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f826aa00640 1 --2- 172.21.15.173:0/34602463 >> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] conn(0x55be742b9e80 0x55be7435a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f826aa00640 1 --2- 172.21.15.173:0/34602463 >> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] conn(0x55be742b9e80 0x55be7435a050 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ea7a1d76447d8f4 server_cookie=fa750b1b4a881b7e in_seq=0 out_seq=0 2024-04-25T09:03:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f8254c00640 10 client.4839 ms_handle_connect on v2:172.21.15.194:6833/4160663138 2024-04-25T09:03:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f8254c00640 1 -- 172.21.15.173:0/34602463 <== mds.0 v2:172.21.15.194:6833/4160663138 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55be741102e0 con 0x55be742b9e80 2024-04-25T09:03:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f8254c00640 10 client.4839 handle_command_reply: tid=0 2024-04-25T09:03:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 client.4839 shutdown 2024-04-25T09:03:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 -- 172.21.15.173:0/34602463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742b3f30 msgr2=0x55be742ed820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 --2- 172.21.15.173:0/34602463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742b3f30 0x55be742ed820 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f825c0cb040 tx=0x7f825c01ac90 comp rx=0 tx=0).stop 2024-04-25T09:03:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 -- 172.21.15.173:0/34602463 shutdown_connections 2024-04-25T09:03:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 --2- 172.21.15.173:0/34602463 >> [v2:172.21.15.194:6833/4160663138,v1:172.21.15.194:6835/4160663138] conn(0x55be742b9e80 0x55be7435a050 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 --2- 172.21.15.173:0/34602463 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55be742fe240 0x55be74348cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 --2- 172.21.15.173:0/34602463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55be742fd920 0x55be74348770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f8254c00640 0 client.4839 ms_handle_reset on v2:172.21.15.194:6833/4160663138 2024-04-25T09:03:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 --2- 172.21.15.173:0/34602463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be742b3f30 0x55be742ed820 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 -- 172.21.15.173:0/34602463 >> 172.21.15.173:0/34602463 conn(0x55be742ba2a0 msgr2=0x55be74314ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 -- 172.21.15.173:0/34602463 shutdown_connections 2024-04-25T09:03:20.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.834+0000 7f82757b4000 1 -- 172.21.15.173:0/34602463 wait complete. 2024-04-25T09:03:20.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.838+0000 7f82757b4000 20 client.4839 trim_cache size 0 max 16384 2024-04-25T09:03:20.830 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:03:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: "cluster_fsid": "ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6", 2024-04-25T09:03:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: "whoami": 0, 2024-04-25T09:03:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 4285, 2024-04-25T09:03:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: "want_state": "up:active", 2024-04-25T09:03:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: "state": "up:active", 2024-04-25T09:03:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs", 2024-04-25T09:03:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: "rank_uptime": 28.831605557, 2024-04-25T09:03:20.831 INFO:teuthology.orchestra.run.smithi173.stdout: "mdsmap_epoch": 9, 2024-04-25T09:03:20.831 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch": 26, 2024-04-25T09:03:20.831 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T09:03:20.831 INFO:teuthology.orchestra.run.smithi173.stdout: "uptime": 36.140842835999997 2024-04-25T09:03:20.831 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:03:20.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.838+0000 7f8270e00640 1 -- 172.21.15.173:0/3422377867 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f824c066f60 msgr2=0x7f824c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.838+0000 7f8270e00640 1 --2- 172.21.15.173:0/3422377867 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f824c066f60 0x7f824c069420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f825c0af000 tx=0x7f825c008040 comp rx=0 tx=0).stop 2024-04-25T09:03:20.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.838+0000 7f8270e00640 1 -- 172.21.15.173:0/3422377867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f826c15f060 msgr2=0x7f826c0cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.838+0000 7f8270e00640 1 --2- 172.21.15.173:0/3422377867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f826c15f060 0x7f826c0cd4f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f826400cef0 tx=0x7f826400a710 comp rx=0 tx=0).stop 2024-04-25T09:03:20.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.838+0000 7f8270e00640 1 -- 172.21.15.173:0/3422377867 shutdown_connections 2024-04-25T09:03:20.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.838+0000 7f8270e00640 1 --2- 172.21.15.173:0/3422377867 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f824c066f60 0x7f824c069420 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.838+0000 7f8270e00640 1 --2- 172.21.15.173:0/3422377867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f826c15f060 0x7f826c0cd4f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.838+0000 7f8270e00640 1 --2- 172.21.15.173:0/3422377867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f826c0b2910 0x7f826c0cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.838+0000 7f8270e00640 1 --2- 172.21.15.173:0/3422377867 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f826c09aa60 0x7f826c0b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.838+0000 7f8270e00640 1 -- 172.21.15.173:0/3422377867 >> 172.21.15.173:0/3422377867 conn(0x7f826c0b31d0 msgr2=0x7f826c15ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.838+0000 7f8270e00640 1 -- 172.21.15.173:0/3422377867 shutdown_connections 2024-04-25T09:03:20.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:20.838+0000 7f8270e00640 1 -- 172.21.15.173:0/3422377867 wait complete. 2024-04-25T09:03:20.844 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T09:03:20.857 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T09:03:20.857 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-25T09:03:20.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:20.857 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-25T09:03:20.865 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-25T09:03:20.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:20.867 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:03:20.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:20.934 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link delete ceph-brx 2024-04-25T09:03:21.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:21.085 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-25T09:03:21.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:21.094 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link delete ceph-brx 2024-04-25T09:03:21.159 INFO:teuthology.orchestra.run.smithi173.stderr:Cannot find device "ceph-brx" 2024-04-25T09:03:21.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:03:21.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:21.162 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-04-25T09:03:21.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:21.171 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2024-04-25T09:03:21.239 INFO:teuthology.orchestra.run.smithi194.stderr:Cannot find device "ceph-brx" 2024-04-25T09:03:21.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:03:21.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:21.242 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-04-25T09:03:21.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:21.291 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2024-04-25T09:03:21.363 INFO:teuthology.orchestra.run.smithi194.stderr:Cannot find device "ceph-brx" 2024-04-25T09:03:21.365 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:03:21.365 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-25T09:03:21.365 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:03:21.365 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:21.365 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:03:21.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.510+0000 7f584f200640 1 Processor -- start 2024-04-25T09:03:21.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.510+0000 7f584f200640 1 -- start start 2024-04-25T09:03:21.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.514+0000 7f584f200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f584815a180 0x7f58480b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.514+0000 7f584f200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584806e860 con 0x7f5848071a30 2024-04-25T09:03:21.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.514+0000 7f584f200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584806eb20 con 0x7f58480b2ca0 2024-04-25T09:03:21.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.514+0000 7f584f200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58480af230 con 0x7f584815a180 2024-04-25T09:03:21.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.514+0000 7f584d200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f5848071a30 0x7f584806d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39030/0 (socket says 172.21.15.173:39030) 2024-04-25T09:03:21.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.514+0000 7f584d200640 1 -- 172.21.15.173:0/3148160704 learned_addr learned my addr 172.21.15.173:0/3148160704 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:21.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.514+0000 7f5847e00640 1 --2- 172.21.15.173:0/3148160704 >> v2:172.21.15.194:3300/0 conn(0x7f584815a180 0x7f58480b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.514+0000 7f5847400640 1 -- 172.21.15.173:0/3148160704 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869214374 0 0) 0x7f584806e860 con 0x7f5848071a30 2024-04-25T09:03:21.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.514+0000 7f5847400640 1 -- 172.21.15.173:0/3148160704 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f582c003530 con 0x7f5848071a30 2024-04-25T09:03:21.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.514+0000 7f5847e00640 1 -- 172.21.15.173:0/3148160704 >> v1:172.21.15.194:6789/0 conn(0x7f58480b2ca0 legacy=0x7f5848071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.514+0000 7f5847400640 1 -- 172.21.15.173:0/3148160704 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 480748780 0 0) 0x7f582c003530 con 0x7f5848071a30 2024-04-25T09:03:21.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.514+0000 7f5847e00640 1 -- 172.21.15.173:0/3148160704 >> v1:172.21.15.173:6789/0 conn(0x7f5848071a30 legacy=0x7f584806d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.514+0000 7f5847e00640 1 -- 172.21.15.173:0/3148160704 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58480aebe0 con 0x7f584815a180 2024-04-25T09:03:21.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.518+0000 7f5847e00640 1 --2- 172.21.15.173:0/3148160704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f584815a180 0x7f58480b40e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5838009d90 tx=0x7f583801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe8ec7d2258a5199 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:21.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.518+0000 7f5847400640 1 -- 172.21.15.173:0/3148160704 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58380b2070 con 0x7f584815a180 2024-04-25T09:03:21.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.518+0000 7f5847400640 1 -- 172.21.15.173:0/3148160704 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58380a55b0 con 0x7f584815a180 2024-04-25T09:03:21.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.518+0000 7f5847400640 1 -- 172.21.15.173:0/3148160704 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5840001680 con 0x7f584815a180 2024-04-25T09:03:21.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.518+0000 7f584f200640 1 -- 172.21.15.173:0/3148160704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f584815a180 msgr2=0x7f58480b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.518+0000 7f584f200640 1 --2- 172.21.15.173:0/3148160704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f584815a180 0x7f58480b40e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5838009d90 tx=0x7f583801c890 comp rx=0 tx=0).stop 2024-04-25T09:03:21.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.518+0000 7f584f200640 1 -- 172.21.15.173:0/3148160704 shutdown_connections 2024-04-25T09:03:21.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.518+0000 7f584f200640 1 --2- 172.21.15.173:0/3148160704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f584815a180 0x7f58480b40e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.518+0000 7f584f200640 1 -- 172.21.15.173:0/3148160704 >> 172.21.15.173:0/3148160704 conn(0x7f584806ac90 msgr2=0x7f584806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:21.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.518+0000 7f584f200640 1 -- 172.21.15.173:0/3148160704 shutdown_connections 2024-04-25T09:03:21.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.518+0000 7f584f200640 1 -- 172.21.15.173:0/3148160704 wait complete. 2024-04-25T09:03:21.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.518+0000 7f584f200640 1 Processor -- start 2024-04-25T09:03:21.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.518+0000 7f584f200640 1 -- start start 2024-04-25T09:03:21.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f584f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5848071a30 0x7f58481f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f584f200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58480b2ca0 0x7f584815b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f584f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f584815a180 0x7f58481fabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f584f200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58480cfb30 con 0x7f58480b2ca0 2024-04-25T09:03:21.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f584f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58480cf9b0 con 0x7f5848071a30 2024-04-25T09:03:21.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f584f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58480cfcb0 con 0x7f584815a180 2024-04-25T09:03:21.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f583f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58480b2ca0 0x7f584815b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f5847e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5848071a30 0x7f58481f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f583f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58480b2ca0 0x7f584815b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43342/0 (socket says 172.21.15.173:43342) 2024-04-25T09:03:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f583f400640 1 -- 172.21.15.173:0/3819139421 learned_addr learned my addr 172.21.15.173:0/3819139421 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f584d200640 1 --2- 172.21.15.173:0/3819139421 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f584815a180 0x7f58481fabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f583f400640 1 -- 172.21.15.173:0/3819139421 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f584815a180 msgr2=0x7f58481fabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f583f400640 1 --2- 172.21.15.173:0/3819139421 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f584815a180 0x7f58481fabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f583f400640 1 -- 172.21.15.173:0/3819139421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5848071a30 msgr2=0x7f58481f6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f583f400640 1 --2- 172.21.15.173:0/3819139421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5848071a30 0x7f58481f6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f583f400640 1 -- 172.21.15.173:0/3819139421 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58481fb130 con 0x7f58480b2ca0 2024-04-25T09:03:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f584d200640 1 --2- 172.21.15.173:0/3819139421 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f584815a180 0x7f58481fabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f583f400640 1 --2- 172.21.15.173:0/3819139421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58480b2ca0 0x7f584815b100 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f583000c3c0 tx=0x7f583000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f5844c00640 1 -- 172.21.15.173:0/3819139421 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5830017070 con 0x7f58480b2ca0 2024-04-25T09:03:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f5844c00640 1 -- 172.21.15.173:0/3819139421 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58300052d0 con 0x7f58480b2ca0 2024-04-25T09:03:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f5844c00640 1 -- 172.21.15.173:0/3819139421 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5830003840 con 0x7f58480b2ca0 2024-04-25T09:03:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f584f200640 1 -- 172.21.15.173:0/3819139421 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58480ade10 con 0x7f58480b2ca0 2024-04-25T09:03:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f584f200640 1 -- 172.21.15.173:0/3819139421 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5848151e50 con 0x7f58480b2ca0 2024-04-25T09:03:21.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.522+0000 7f584f200640 1 -- 172.21.15.173:0/3819139421 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5848073a40 con 0x7f58480b2ca0 2024-04-25T09:03:21.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.526+0000 7f5844c00640 1 -- 172.21.15.173:0/3819139421 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f583001a070 con 0x7f58480b2ca0 2024-04-25T09:03:21.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.526+0000 7f5844c00640 1 --2- 172.21.15.173:0/3819139421 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5824066f90 0x7f5824069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.526+0000 7f5844c00640 1 -- 172.21.15.173:0/3819139421 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5830084770 con 0x7f58480b2ca0 2024-04-25T09:03:21.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.526+0000 7f5847e00640 1 --2- 172.21.15.173:0/3819139421 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5824066f90 0x7f5824069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.526+0000 7f5847e00640 1 --2- 172.21.15.173:0/3819139421 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5824066f90 0x7f5824069450 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f58380af000 tx=0x7f58380a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:21.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.530+0000 7f5844c00640 1 -- 172.21.15.173:0/3819139421 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5830021080 con 0x7f58480b2ca0 2024-04-25T09:03:21.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.718+0000 7f584f200640 1 -- 172.21.15.173:0/3819139421 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f584806e640 con 0x7f58480b2ca0 2024-04-25T09:03:21.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.718+0000 7f5844c00640 1 -- 172.21.15.173:0/3819139421 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f58481fb130 con 0x7f58480b2ca0 2024-04-25T09:03:21.707 INFO:teuthology.orchestra.run.smithi173.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T09:03:21.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.718+0000 7f584f200640 1 -- 172.21.15.173:0/3819139421 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5824066f90 msgr2=0x7f5824069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.718+0000 7f584f200640 1 --2- 172.21.15.173:0/3819139421 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5824066f90 0x7f5824069450 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f58380af000 tx=0x7f58380a7070 comp rx=0 tx=0).stop 2024-04-25T09:03:21.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.718+0000 7f584f200640 1 -- 172.21.15.173:0/3819139421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58480b2ca0 msgr2=0x7f584815b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.718+0000 7f584f200640 1 --2- 172.21.15.173:0/3819139421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58480b2ca0 0x7f584815b100 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f583000c3c0 tx=0x7f583000c880 comp rx=0 tx=0).stop 2024-04-25T09:03:21.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.718+0000 7f584f200640 1 -- 172.21.15.173:0/3819139421 shutdown_connections 2024-04-25T09:03:21.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.718+0000 7f584f200640 1 --2- 172.21.15.173:0/3819139421 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5824066f90 0x7f5824069450 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.718+0000 7f584f200640 1 --2- 172.21.15.173:0/3819139421 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f584815a180 0x7f58481fabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.718+0000 7f584f200640 1 --2- 172.21.15.173:0/3819139421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58480b2ca0 0x7f584815b100 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.718+0000 7f584f200640 1 --2- 172.21.15.173:0/3819139421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5848071a30 0x7f58481f6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.718+0000 7f584f200640 1 -- 172.21.15.173:0/3819139421 >> 172.21.15.173:0/3819139421 conn(0x7f584806ac90 msgr2=0x7f584806b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:21.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.718+0000 7f584f200640 1 -- 172.21.15.173:0/3819139421 shutdown_connections 2024-04-25T09:03:21.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:21.718+0000 7f584f200640 1 -- 172.21.15.173:0/3819139421 wait complete. 2024-04-25T09:03:21.728 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T09:03:21.728 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:03:21.728 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2024-04-25T09:03:21.728 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:03:21.728 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:21.728 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T09:03:21.728 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:03:21.728 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:03:21.728 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:21.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:21.728 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2024-04-25T09:03:21.737 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:03:21.737 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:03:21.737 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:03:21.737 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:21.737 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-25T09:03:21.737 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:21.737 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:03:21.737 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:21.737 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2024-04-25T09:03:21.737 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:03:21.737 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:21.737 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2024-04-25T09:03:21.737 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:03:21.738 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:21.738 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:03:21.738 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:21.738 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:03:21.738 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 42416sec preferred_lft 42416sec 2024-04-25T09:03:21.738 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2024-04-25T09:03:21.738 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:21.738 INFO:teuthology.orchestra.run.smithi173.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:03:21.738 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 02:42:00:0e:60:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:21.738 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:03:21.738 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:21.739 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T09:03:21.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:21.739 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:03:21.739 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:03:21.739 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link add name ceph-brx type bridge 2024-04-25T09:03:21.740 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip addr flush dev ceph-brx 2024-04-25T09:03:21.740 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set ceph-brx up 2024-04-25T09:03:21.740 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T09:03:21.740 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:03:21.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:21.848 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:03:21.866 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-04-25T09:03:21.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:21.868 DEBUG:teuthology.orchestra.run.smithi173:> route 2024-04-25T09:03:21.920 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2024-04-25T09:03:21.921 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:03:21.921 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:03:21.921 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:03:21.921 INFO:teuthology.orchestra.run.smithi173.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:03:21.921 INFO:teuthology.orchestra.run.smithi173.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:03:21.921 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:03:21.921 INFO:teuthology.orchestra.run.smithi173.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:03:21.921 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:03:21.921 INFO:teuthology.orchestra.run.smithi173.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:03:21.921 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:03:21.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:21.922 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:03:21.922 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:03:21.922 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:03:21.922 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:03:21.922 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:03:21.922 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:03:22.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:22.010 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-25T09:03:22.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:22.020 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list-id 2024-04-25T09:03:22.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:22.073 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:03:22.074 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:03:22.074 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:03:22.074 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T09:03:22.074 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:03:22.154 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T09:03:22.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:22.154 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:03:22.155 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:03:22.155 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T09:03:22.155 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T09:03:22.155 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T09:03:22.155 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T09:03:22.155 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T09:03:22.155 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:03:22.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:22.291 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:03:22.291 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:03:22.291 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2024-04-25T09:03:22.291 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T09:03:22.291 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:03:22.330 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:22.330 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:22.385 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:22.385 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:22.385 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:22.437 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:03:22.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:22.437 DEBUG:teuthology.orchestra.run.smithi173:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:22.528 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:22.528 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:03:22.529 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:03:23.169 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:23.169 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:03:23.169 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:03:23.169 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:03:23.169 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:03:23.182 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:23.182 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:03:23.182 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:03:23.182 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:03:23.183 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:03:23.183 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-04-25T09:03:23.183 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-04-25T09:03:23.183 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6" will pass to kernel 2024-04-25T09:03:23.186 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:03:23.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:23.187 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:23.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:23.207 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:03:23.260 INFO:teuthology.orchestra.run.smithi173.stdout:client4610 2024-04-25T09:03:23.261 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:03:23.261 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:23.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:23.309 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:03:23.360 INFO:teuthology.orchestra.run.smithi173.stdout:client4610 2024-04-25T09:03:23.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:23.360 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:03:23.416 INFO:teuthology.orchestra.run.smithi173.stdout:client4610 2024-04-25T09:03:23.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:23.416 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6.client4610/status') 2024-04-25T09:03:23.476 INFO:teuthology.orchestra.run.smithi173.stdout:instance: client.4610 (3)172.21.15.173:0/3906980262 2024-04-25T09:03:23.476 INFO:teuthology.orchestra.run.smithi173.stdout:blocklisted: false 2024-04-25T09:03:23.476 INFO:teuthology.orchestra.run.smithi173.stderr:0+1 records in 2024-04-25T09:03:23.476 INFO:teuthology.orchestra.run.smithi173.stderr:0+1 records out 2024-04-25T09:03:23.477 INFO:teuthology.orchestra.run.smithi173.stderr:71 bytes copied, 4.8696e-05 s, 1.5 MB/s 2024-04-25T09:03:23.478 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-25T09:03:23.479 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:03:23.479 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T09:03:23.479 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:03:23.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.666+0000 7f96a1600640 1 Processor -- start 2024-04-25T09:03:23.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.666+0000 7f96a1600640 1 -- start start 2024-04-25T09:03:23.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.666+0000 7f96a1600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f969c0b3e70 0x7f969c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.666+0000 7f96a1600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f969c0aefa0 0x7f969c0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.666+0000 7f96a1600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969c0b4790 con 0x7f969c15edd0 2024-04-25T09:03:23.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.666+0000 7f96a1600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969c06dd50 con 0x7f969c0aefa0 2024-04-25T09:03:23.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.666+0000 7f96a1600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969c15f320 con 0x7f969c0b3e70 2024-04-25T09:03:23.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.666+0000 7f9692000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f969c0aefa0 0x7f969c0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.666+0000 7f9692000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f969c0aefa0 0x7f969c0b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49958/0 (socket says 172.21.15.173:49958) 2024-04-25T09:03:23.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.666+0000 7f9692000640 1 -- 172.21.15.173:0/3931562211 learned_addr learned my addr 172.21.15.173:0/3931562211 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:23.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.666+0000 7f969aa00640 1 --2- 172.21.15.173:0/3931562211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f969c0b3e70 0x7f969c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.670+0000 7f9692000640 1 -- 172.21.15.173:0/3931562211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f969c0b3e70 msgr2=0x7f969c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:23.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.670+0000 7f9692000640 1 --2- 172.21.15.173:0/3931562211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f969c0b3e70 0x7f969c0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.670+0000 7f9692000640 1 -- 172.21.15.173:0/3931562211 >> v1:172.21.15.194:6789/0 conn(0x7f969c15edd0 legacy=0x7f969c0b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.670+0000 7f9692000640 1 -- 172.21.15.173:0/3931562211 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c06d420 con 0x7f969c0aefa0 2024-04-25T09:03:23.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.670+0000 7f9692000640 1 --2- 172.21.15.173:0/3931562211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f969c0aefa0 0x7f969c0b2770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9684009870 tx=0x7f968401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcd1cc0930486cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:23.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.670+0000 7f969a000640 1 -- 172.21.15.173:0/3931562211 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840a9610 con 0x7f969c0aefa0 2024-04-25T09:03:23.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.670+0000 7f969a000640 1 -- 172.21.15.173:0/3931562211 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96840a97b0 con 0x7f969c0aefa0 2024-04-25T09:03:23.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.670+0000 7f969a000640 1 -- 172.21.15.173:0/3931562211 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840a9b80 con 0x7f969c0aefa0 2024-04-25T09:03:23.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.670+0000 7f96a1600640 1 -- 172.21.15.173:0/3931562211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f969c0aefa0 msgr2=0x7f969c0b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.670+0000 7f96a1600640 1 --2- 172.21.15.173:0/3931562211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f969c0aefa0 0x7f969c0b2770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9684009870 tx=0x7f968401c530 comp rx=0 tx=0).stop 2024-04-25T09:03:23.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f96a1600640 1 -- 172.21.15.173:0/3931562211 shutdown_connections 2024-04-25T09:03:23.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f96a1600640 1 --2- 172.21.15.173:0/3931562211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f969c0aefa0 0x7f969c0b2770 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f96a1600640 1 --2- 172.21.15.173:0/3931562211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f969c0b3e70 0x7f969c0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f96a1600640 1 -- 172.21.15.173:0/3931562211 >> 172.21.15.173:0/3931562211 conn(0x7f969c06ac90 msgr2=0x7f969c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:23.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f96a1600640 1 -- 172.21.15.173:0/3931562211 shutdown_connections 2024-04-25T09:03:23.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f96a1600640 1 -- 172.21.15.173:0/3931562211 wait complete. 2024-04-25T09:03:23.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f96a1600640 1 Processor -- start 2024-04-25T09:03:23.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f96a1600640 1 -- start start 2024-04-25T09:03:23.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f96a1600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f969c0aefa0 0x7f969c1f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f96a1600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f969c0b3e70 0x7f969c14bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f96a1600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f969c15edd0 0x7f969c14cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f96a1600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c06e1c0 con 0x7f969c0b3e70 2024-04-25T09:03:23.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f96a1600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c15aba0 con 0x7f969c0aefa0 2024-04-25T09:03:23.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f96a1600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969c06e340 con 0x7f969c15edd0 2024-04-25T09:03:23.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f9692000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f969c0b3e70 0x7f969c14bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f9692000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f969c0b3e70 0x7f969c14bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49974/0 (socket says 172.21.15.173:49974) 2024-04-25T09:03:23.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f9692000640 1 -- 172.21.15.173:0/1848583279 learned_addr learned my addr 172.21.15.173:0/1848583279 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:23.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f969b400640 1 --2- 172.21.15.173:0/1848583279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f969c15edd0 0x7f969c14cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f969aa00640 1 --2- 172.21.15.173:0/1848583279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f969c0aefa0 0x7f969c1f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f9692000640 1 -- 172.21.15.173:0/1848583279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f969c15edd0 msgr2=0x7f969c14cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f9692000640 1 --2- 172.21.15.173:0/1848583279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f969c15edd0 0x7f969c14cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f9692000640 1 -- 172.21.15.173:0/1848583279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f969c0aefa0 msgr2=0x7f969c1f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f9692000640 1 --2- 172.21.15.173:0/1848583279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f969c0aefa0 0x7f969c1f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f9692000640 1 -- 172.21.15.173:0/1848583279 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c14f1d0 con 0x7f969c0b3e70 2024-04-25T09:03:23.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.674+0000 7f9692000640 1 --2- 172.21.15.173:0/1848583279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f969c0b3e70 0x7f969c14bc30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f968401abe0 tx=0x7f96840192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:23.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.678+0000 7f9693400640 1 -- 172.21.15.173:0/1848583279 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840a9610 con 0x7f969c0b3e70 2024-04-25T09:03:23.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.678+0000 7f9693400640 1 -- 172.21.15.173:0/1848583279 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96840b9620 con 0x7f969c0b3e70 2024-04-25T09:03:23.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.678+0000 7f96a1600640 1 -- 172.21.15.173:0/1848583279 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969c14f4b0 con 0x7f969c0b3e70 2024-04-25T09:03:23.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.678+0000 7f9693400640 1 -- 172.21.15.173:0/1848583279 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840b99f0 con 0x7f969c0b3e70 2024-04-25T09:03:23.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.678+0000 7f96a1600640 1 -- 172.21.15.173:0/1848583279 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969c14fa70 con 0x7f969c0b3e70 2024-04-25T09:03:23.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.678+0000 7f96a1600640 1 -- 172.21.15.173:0/1848583279 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f969c073a40 con 0x7f969c0b3e70 2024-04-25T09:03:23.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.678+0000 7f9693400640 1 -- 172.21.15.173:0/1848583279 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f96840b9b90 con 0x7f969c0b3e70 2024-04-25T09:03:23.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.678+0000 7f9693400640 1 --2- 172.21.15.173:0/1848583279 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9678066f60 0x7f9678069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.678+0000 7f9693400640 1 -- 172.21.15.173:0/1848583279 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f968411eec0 con 0x7f969c0b3e70 2024-04-25T09:03:23.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.678+0000 7f969aa00640 1 --2- 172.21.15.173:0/1848583279 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9678066f60 0x7f9678069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.678+0000 7f969aa00640 1 --2- 172.21.15.173:0/1848583279 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9678066f60 0x7f9678069420 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f968c0073f0 tx=0x7f968c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:23.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.682+0000 7f9693400640 1 -- 172.21.15.173:0/1848583279 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f96840ad020 con 0x7f969c0b3e70 2024-04-25T09:03:23.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.874+0000 7f96a1600640 1 -- 172.21.15.173:0/1848583279 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f969c06f1c0 con 0x7f969c0b3e70 2024-04-25T09:03:23.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.874+0000 7f9693400640 1 -- 172.21.15.173:0/1848583279 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9684016150 con 0x7f969c0b3e70 2024-04-25T09:03:23.865 INFO:teuthology.orchestra.run.smithi173.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T09:03:23.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.878+0000 7f96a1600640 1 -- 172.21.15.173:0/1848583279 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9678066f60 msgr2=0x7f9678069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.878+0000 7f96a1600640 1 --2- 172.21.15.173:0/1848583279 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9678066f60 0x7f9678069420 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f968c0073f0 tx=0x7f968c00b040 comp rx=0 tx=0).stop 2024-04-25T09:03:23.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.878+0000 7f96a1600640 1 -- 172.21.15.173:0/1848583279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f969c0b3e70 msgr2=0x7f969c14bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.878+0000 7f96a1600640 1 --2- 172.21.15.173:0/1848583279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f969c0b3e70 0x7f969c14bc30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f968401abe0 tx=0x7f96840192d0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.878+0000 7f96a1600640 1 -- 172.21.15.173:0/1848583279 shutdown_connections 2024-04-25T09:03:23.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.878+0000 7f96a1600640 1 --2- 172.21.15.173:0/1848583279 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9678066f60 0x7f9678069420 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.878+0000 7f96a1600640 1 --2- 172.21.15.173:0/1848583279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f969c15edd0 0x7f969c14cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.878+0000 7f96a1600640 1 --2- 172.21.15.173:0/1848583279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f969c0b3e70 0x7f969c14bc30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.878+0000 7f96a1600640 1 --2- 172.21.15.173:0/1848583279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f969c0aefa0 0x7f969c1f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.878+0000 7f96a1600640 1 -- 172.21.15.173:0/1848583279 >> 172.21.15.173:0/1848583279 conn(0x7f969c06ac90 msgr2=0x7f969c15e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:23.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.878+0000 7f96a1600640 1 -- 172.21.15.173:0/1848583279 shutdown_connections 2024-04-25T09:03:23.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:23.878+0000 7f96a1600640 1 -- 172.21.15.173:0/1848583279 wait complete. 2024-04-25T09:03:23.886 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T09:03:23.886 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:03:23.886 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2024-04-25T09:03:23.886 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-25T09:03:23.886 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T09:03:23.886 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T09:03:23.886 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:03:23.886 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:03:23.886 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-25T09:03:23.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:23.887 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2024-04-25T09:03:23.896 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:03:23.896 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:03:23.896 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:03:23.896 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:23.896 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-25T09:03:23.896 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:23.896 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:03:23.896 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:23.896 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2024-04-25T09:03:23.896 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:03:23.896 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:23.896 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2024-04-25T09:03:23.896 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:03:23.897 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:23.897 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:03:23.897 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:23.897 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:03:23.897 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 42414sec preferred_lft 42414sec 2024-04-25T09:03:23.897 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2024-04-25T09:03:23.897 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:23.897 INFO:teuthology.orchestra.run.smithi173.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:03:23.897 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 02:42:00:0e:60:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:23.897 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:03:23.897 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:23.898 INFO:teuthology.orchestra.run.smithi173.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:03:23.898 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:23.898 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:03:23.898 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:23.898 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:03:23.898 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:23.898 INFO:teuthology.orchestra.run.smithi173.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:03:23.898 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:03:23.898 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-04-25T09:03:23.898 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:23.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:23.899 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:03:23.963 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-04-25T09:03:23.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:23.965 DEBUG:teuthology.orchestra.run.smithi173:> route 2024-04-25T09:03:24.021 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2024-04-25T09:03:24.021 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:03:24.021 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:03:24.021 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:03:24.022 INFO:teuthology.orchestra.run.smithi173.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:03:24.022 INFO:teuthology.orchestra.run.smithi173.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:03:24.022 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:03:24.022 INFO:teuthology.orchestra.run.smithi173.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:03:24.022 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:03:24.022 INFO:teuthology.orchestra.run.smithi173.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:03:24.022 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:03:24.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:24.022 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:03:24.022 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:03:24.022 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:03:24.023 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:03:24.023 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:03:24.023 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:03:24.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:24.117 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-25T09:03:24.125 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:03:24.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:24.127 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list-id 2024-04-25T09:03:24.177 INFO:teuthology.orchestra.run.smithi173.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-25T09:03:24.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:24.178 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:03:24.178 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:03:24.178 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:03:24.178 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-25T09:03:24.178 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:03:24.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:24.259 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T09:03:24.325 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:03:24.325 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:03:24.325 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:03:24.325 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:24.325 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-25T09:03:24.325 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:24.325 INFO:teuthology.orchestra.run.smithi173.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:03:24.326 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 92:cb:66:b7:61:df brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T09:03:24.326 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T09:03:24.326 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:24.326 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::90cb:66ff:feb7:61df/64 scope link tentative 2024-04-25T09:03:24.326 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:24.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:24.327 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T09:03:24.388 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:03:24.389 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:03:24.389 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:03:24.389 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:24.389 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-25T09:03:24.389 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:24.389 INFO:teuthology.orchestra.run.smithi173.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:03:24.389 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 92:cb:66:b7:61:df brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T09:03:24.389 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T09:03:24.389 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:24.389 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::90cb:66ff:feb7:61df/64 scope link 2024-04-25T09:03:24.389 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:24.391 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-25T09:03:24.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:24.391 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:03:24.391 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:03:24.391 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-25T09:03:24.391 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T09:03:24.391 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-25T09:03:24.391 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-25T09:03:24.391 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-25T09:03:24.391 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:03:24.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:24.528 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:03:24.528 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:03:24.529 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.1 up 2024-04-25T09:03:24.529 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T09:03:24.529 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:03:24.568 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:24.568 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-25T09:03:24.621 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-25T09:03:24.621 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:24.621 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-25T09:03:24.677 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:03:24.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:24.677 DEBUG:teuthology.orchestra.run.smithi173:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T09:03:24.771 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T09:03:24.771 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T09:03:24.771 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:03:24.786 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T09:03:24.786 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T09:03:24.786 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:03:24.786 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:03:24.786 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:03:24.795 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T09:03:24.795 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T09:03:24.795 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:03:24.795 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:03:24.795 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:03:24.795 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-04-25T09:03:24.796 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-04-25T09:03:24.796 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6" will pass to kernel 2024-04-25T09:03:24.799 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:03:24.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:24.799 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-25T09:03:24.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:24.819 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:03:24.876 INFO:teuthology.orchestra.run.smithi173.stdout:client4795 2024-04-25T09:03:24.876 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:03:24.876 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:24.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:24.925 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:03:24.980 INFO:teuthology.orchestra.run.smithi173.stdout:client4795 2024-04-25T09:03:24.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:24.981 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:03:25.031 INFO:teuthology.orchestra.run.smithi173.stdout:client4795 2024-04-25T09:03:25.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:25.032 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6.client4795/status') 2024-04-25T09:03:25.092 INFO:teuthology.orchestra.run.smithi173.stdout:instance: client.4795 (3)172.21.15.173:0/981932672 2024-04-25T09:03:25.092 INFO:teuthology.orchestra.run.smithi173.stdout:blocklisted: false 2024-04-25T09:03:25.092 INFO:teuthology.orchestra.run.smithi173.stderr:0+1 records in 2024-04-25T09:03:25.092 INFO:teuthology.orchestra.run.smithi173.stderr:0+1 records out 2024-04-25T09:03:25.092 INFO:teuthology.orchestra.run.smithi173.stderr:70 bytes copied, 4.9487e-05 s, 1.4 MB/s 2024-04-25T09:03:25.094 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-25T09:03:25.094 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:03:25.094 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T09:03:25.094 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:03:25.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.286+0000 7fd41f800640 1 Processor -- start 2024-04-25T09:03:25.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.286+0000 7fd41f800640 1 -- start start 2024-04-25T09:03:25.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.290+0000 7fd41f800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd4180cc8b0 0x7fd4180ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.290+0000 7fd41f800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41806e7c0 con 0x7fd4180ce8f0 2024-04-25T09:03:25.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.290+0000 7fd41f800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41806d720 con 0x7fd418145250 2024-04-25T09:03:25.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.290+0000 7fd41f800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41806da00 con 0x7fd4180cc8b0 2024-04-25T09:03:25.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.290+0000 7fd40fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd4180cc8b0 0x7fd4180ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.290+0000 7fd41d800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd4180ce8f0 0x7fd4180ced00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46974/0 (socket says 172.21.15.173:46974) 2024-04-25T09:03:25.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.290+0000 7fd41d800640 1 -- 172.21.15.173:0/907978711 learned_addr learned my addr 172.21.15.173:0/907978711 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:25.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.290+0000 7fd40fe00640 1 -- 172.21.15.173:0/907978711 >> v1:172.21.15.194:6789/0 conn(0x7fd418145250 legacy=0x7fd41815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:25.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.290+0000 7fd40fe00640 1 -- 172.21.15.173:0/907978711 >> v1:172.21.15.173:6789/0 conn(0x7fd4180ce8f0 legacy=0x7fd4180ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.290+0000 7fd417e00640 1 -- 172.21.15.173:0/907978711 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528626045 0 0) 0x7fd41806e7c0 con 0x7fd4180ce8f0 2024-04-25T09:03:25.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.290+0000 7fd40fe00640 1 -- 172.21.15.173:0/907978711 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41806dce0 con 0x7fd4180cc8b0 2024-04-25T09:03:25.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.290+0000 7fd40fe00640 1 --2- 172.21.15.173:0/907978711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4180cc8b0 0x7fd4180ccd30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd4000097c0 tx=0x7fd40001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280e303656c63dfe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.290+0000 7fd417e00640 1 -- 172.21.15.173:0/907978711 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4000b1070 con 0x7fd4180cc8b0 2024-04-25T09:03:25.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd417e00640 1 -- 172.21.15.173:0/907978711 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4000ac5f0 con 0x7fd4180cc8b0 2024-04-25T09:03:25.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd417e00640 1 -- 172.21.15.173:0/907978711 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4000ac9c0 con 0x7fd4180cc8b0 2024-04-25T09:03:25.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41f800640 1 -- 172.21.15.173:0/907978711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4180cc8b0 msgr2=0x7fd4180ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41f800640 1 --2- 172.21.15.173:0/907978711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4180cc8b0 0x7fd4180ccd30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd4000097c0 tx=0x7fd40001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41f800640 1 -- 172.21.15.173:0/907978711 shutdown_connections 2024-04-25T09:03:25.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41f800640 1 --2- 172.21.15.173:0/907978711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4180cc8b0 0x7fd4180ccd30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41f800640 1 -- 172.21.15.173:0/907978711 >> 172.21.15.173:0/907978711 conn(0x7fd41806ac90 msgr2=0x7fd41806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:25.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41f800640 1 -- 172.21.15.173:0/907978711 shutdown_connections 2024-04-25T09:03:25.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41f800640 1 -- 172.21.15.173:0/907978711 wait complete. 2024-04-25T09:03:25.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41f800640 1 Processor -- start 2024-04-25T09:03:25.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41f800640 1 -- start start 2024-04-25T09:03:25.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41f800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4180cc8b0 0x7fd4181583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41f800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4180ce8f0 0x7fd41815d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41f800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd418145250 0x7fd41813ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41f800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41806d380 con 0x7fd418145250 2024-04-25T09:03:25.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41f800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41806ef80 con 0x7fd4180cc8b0 2024-04-25T09:03:25.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41f800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41806d500 con 0x7fd4180ce8f0 2024-04-25T09:03:25.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41d800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd418145250 0x7fd41813ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41d800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd418145250 0x7fd41813ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49984/0 (socket says 172.21.15.173:49984) 2024-04-25T09:03:25.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41d800640 1 -- 172.21.15.173:0/1392679165 learned_addr learned my addr 172.21.15.173:0/1392679165 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:25.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd41ce00640 1 --2- 172.21.15.173:0/1392679165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4180cc8b0 0x7fd4181583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.294+0000 7fd40fe00640 1 --2- 172.21.15.173:0/1392679165 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4180ce8f0 0x7fd41815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.298+0000 7fd41d800640 1 -- 172.21.15.173:0/1392679165 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4180ce8f0 msgr2=0x7fd41815d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.298+0000 7fd41d800640 1 --2- 172.21.15.173:0/1392679165 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4180ce8f0 0x7fd41815d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.298+0000 7fd41d800640 1 -- 172.21.15.173:0/1392679165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4180cc8b0 msgr2=0x7fd4181583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.298+0000 7fd41d800640 1 --2- 172.21.15.173:0/1392679165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4180cc8b0 0x7fd4181583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.298+0000 7fd41d800640 1 -- 172.21.15.173:0/1392679165 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4181440f0 con 0x7fd418145250 2024-04-25T09:03:25.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.298+0000 7fd41ce00640 1 --2- 172.21.15.173:0/1392679165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4180cc8b0 0x7fd4181583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:25.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.298+0000 7fd41d800640 1 --2- 172.21.15.173:0/1392679165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd418145250 0x7fd41813ec40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd41000c7d0 tx=0x7fd41000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.298+0000 7fd415600640 1 -- 172.21.15.173:0/1392679165 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd410018070 con 0x7fd418145250 2024-04-25T09:03:25.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.298+0000 7fd415600640 1 -- 172.21.15.173:0/1392679165 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41000a640 con 0x7fd418145250 2024-04-25T09:03:25.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.298+0000 7fd41f800640 1 -- 172.21.15.173:0/1392679165 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd41815d860 con 0x7fd418145250 2024-04-25T09:03:25.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.298+0000 7fd415600640 1 -- 172.21.15.173:0/1392679165 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41000aa70 con 0x7fd418145250 2024-04-25T09:03:25.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.298+0000 7fd41f800640 1 -- 172.21.15.173:0/1392679165 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd41815db00 con 0x7fd418145250 2024-04-25T09:03:25.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.298+0000 7fd41f800640 1 -- 172.21.15.173:0/1392679165 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd418073a40 con 0x7fd418145250 2024-04-25T09:03:25.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.298+0000 7fd415600640 1 -- 172.21.15.173:0/1392679165 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd41001b070 con 0x7fd418145250 2024-04-25T09:03:25.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.298+0000 7fd415600640 1 --2- 172.21.15.173:0/1392679165 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd3f4066f60 0x7fd3f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.298+0000 7fd415600640 1 -- 172.21.15.173:0/1392679165 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd410084970 con 0x7fd418145250 2024-04-25T09:03:25.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.302+0000 7fd41ce00640 1 --2- 172.21.15.173:0/1392679165 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd3f4066f60 0x7fd3f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.302+0000 7fd41ce00640 1 --2- 172.21.15.173:0/1392679165 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd3f4066f60 0x7fd3f4069420 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd408000f70 tx=0x7fd408009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.306+0000 7fd415600640 1 -- 172.21.15.173:0/1392679165 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd410054f60 con 0x7fd418145250 2024-04-25T09:03:25.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.494+0000 7fd41f800640 1 -- 172.21.15.173:0/1392679165 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd41806c300 con 0x7fd418145250 2024-04-25T09:03:25.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.494+0000 7fd415600640 1 -- 172.21.15.173:0/1392679165 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd410059000 con 0x7fd418145250 2024-04-25T09:03:25.484 INFO:teuthology.orchestra.run.smithi173.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T09:03:25.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.494+0000 7fd41f800640 1 -- 172.21.15.173:0/1392679165 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd3f4066f60 msgr2=0x7fd3f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.494+0000 7fd41f800640 1 --2- 172.21.15.173:0/1392679165 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd3f4066f60 0x7fd3f4069420 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd408000f70 tx=0x7fd408009040 comp rx=0 tx=0).stop 2024-04-25T09:03:25.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.494+0000 7fd41f800640 1 -- 172.21.15.173:0/1392679165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd418145250 msgr2=0x7fd41813ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.494+0000 7fd41f800640 1 --2- 172.21.15.173:0/1392679165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd418145250 0x7fd41813ec40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd41000c7d0 tx=0x7fd41000cc90 comp rx=0 tx=0).stop 2024-04-25T09:03:25.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.498+0000 7fd41f800640 1 -- 172.21.15.173:0/1392679165 shutdown_connections 2024-04-25T09:03:25.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.498+0000 7fd41f800640 1 --2- 172.21.15.173:0/1392679165 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd3f4066f60 0x7fd3f4069420 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.498+0000 7fd41f800640 1 --2- 172.21.15.173:0/1392679165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd418145250 0x7fd41813ec40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.498+0000 7fd41f800640 1 --2- 172.21.15.173:0/1392679165 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4180ce8f0 0x7fd41815d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.498+0000 7fd41f800640 1 --2- 172.21.15.173:0/1392679165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4180cc8b0 0x7fd4181583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.498+0000 7fd41f800640 1 -- 172.21.15.173:0/1392679165 >> 172.21.15.173:0/1392679165 conn(0x7fd41806ac90 msgr2=0x7fd4180cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:25.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.498+0000 7fd41f800640 1 -- 172.21.15.173:0/1392679165 shutdown_connections 2024-04-25T09:03:25.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:25.498+0000 7fd41f800640 1 -- 172.21.15.173:0/1392679165 wait complete. 2024-04-25T09:03:25.505 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T09:03:25.505 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:03:25.505 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-04-25T09:03:25.505 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T09:03:25.505 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T09:03:25.505 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T09:03:25.505 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:03:25.505 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:03:25.506 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T09:03:25.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:25.506 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-04-25T09:03:25.516 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:03:25.517 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:03:25.517 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:03:25.517 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:25.517 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-04-25T09:03:25.517 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:25.517 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:03:25.517 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:25.517 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-04-25T09:03:25.517 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:03:25.517 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:25.517 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-04-25T09:03:25.517 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:03:25.517 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:25.518 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:03:25.518 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:25.518 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:03:25.518 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42415sec preferred_lft 42415sec 2024-04-25T09:03:25.518 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link 2024-04-25T09:03:25.518 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:25.518 INFO:teuthology.orchestra.run.smithi194.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:03:25.518 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:42:bf:07:10:52 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:25.518 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:03:25.518 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:25.518 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T09:03:25.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:25.519 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-04-25T09:03:25.519 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-04-25T09:03:25.519 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add name ceph-brx type bridge 2024-04-25T09:03:25.519 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr flush dev ceph-brx 2024-04-25T09:03:25.519 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set ceph-brx up 2024-04-25T09:03:25.519 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T09:03:25.519 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-04-25T09:03:25.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:25.633 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:03:25.652 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-04-25T09:03:25.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:25.654 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-04-25T09:03:25.735 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-04-25T09:03:25.736 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:03:25.736 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:03:25.736 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:03:25.736 INFO:teuthology.orchestra.run.smithi194.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:03:25.736 INFO:teuthology.orchestra.run.smithi194.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:03:25.736 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:03:25.736 INFO:teuthology.orchestra.run.smithi194.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:03:25.736 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:03:25.736 INFO:teuthology.orchestra.run.smithi194.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:03:25.736 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:03:25.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:25.737 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-04-25T09:03:25.737 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-04-25T09:03:25.737 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:03:25.737 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:03:25.737 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:03:25.737 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-04-25T09:03:25.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:25.827 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-04-25T09:03:25.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:25.836 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list-id 2024-04-25T09:03:25.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:25.887 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-04-25T09:03:25.887 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-04-25T09:03:25.887 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T09:03:25.887 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T09:03:25.887 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-04-25T09:03:25.968 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T09:03:25.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:25.969 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-04-25T09:03:25.969 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-04-25T09:03:25.969 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T09:03:25.969 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T09:03:25.969 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T09:03:25.969 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T09:03:25.969 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T09:03:25.969 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-04-25T09:03:26.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:26.127 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-04-25T09:03:26.127 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-04-25T09:03:26.127 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2024-04-25T09:03:26.127 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T09:03:26.127 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-04-25T09:03:26.167 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:26.167 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T09:03:26.222 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T09:03:26.222 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:26.222 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T09:03:26.277 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:03:26.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:26.277 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T09:03:26.365 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T09:03:26.365 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T09:03:26.365 INFO:teuthology.orchestra.run.smithi194.stdout:invalid new device string format 2024-04-25T09:03:26.946 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T09:03:26.946 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T09:03:26.946 INFO:teuthology.orchestra.run.smithi194.stdout:invalid new device string format 2024-04-25T09:03:26.946 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:03:26.946 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:03:26.959 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T09:03:26.959 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T09:03:26.959 INFO:teuthology.orchestra.run.smithi194.stdout:invalid new device string format 2024-04-25T09:03:26.959 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:03:26.959 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:03:26.959 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-04-25T09:03:26.959 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-04-25T09:03:26.959 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6" will pass to kernel 2024-04-25T09:03:26.963 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:03:26.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:26.963 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T09:03:26.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:26.983 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:03:27.041 INFO:teuthology.orchestra.run.smithi194.stdout:client4863 2024-04-25T09:03:27.041 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:03:27.041 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:27.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:27.090 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:03:27.140 INFO:teuthology.orchestra.run.smithi194.stdout:client4863 2024-04-25T09:03:27.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:27.141 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:03:27.193 INFO:teuthology.orchestra.run.smithi194.stdout:client4863 2024-04-25T09:03:27.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:27.193 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6.client4863/status') 2024-04-25T09:03:27.257 INFO:teuthology.orchestra.run.smithi194.stdout:instance: client.4863 (3)172.21.15.194:0/4256141184 2024-04-25T09:03:27.257 INFO:teuthology.orchestra.run.smithi194.stdout:blocklisted: false 2024-04-25T09:03:27.257 INFO:teuthology.orchestra.run.smithi194.stderr:0+1 records in 2024-04-25T09:03:27.257 INFO:teuthology.orchestra.run.smithi194.stderr:0+1 records out 2024-04-25T09:03:27.257 INFO:teuthology.orchestra.run.smithi194.stderr:71 bytes copied, 5.4846e-05 s, 1.3 MB/s 2024-04-25T09:03:27.259 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-25T09:03:27.259 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:03:27.259 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T09:03:27.259 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:03:27.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.414+0000 7fa6c3000640 1 Processor -- start 2024-04-25T09:03:27.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.414+0000 7fa6c3000640 1 -- start start 2024-04-25T09:03:27.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.418+0000 7fa6c3000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6bc15da60 0x7fa6bc09a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.418+0000 7fa6c3000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa6bc06c270 0x7fa6bc06c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.418+0000 7fa6c3000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa6bc06ccf0 0x7fa6bc0b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.418+0000 7fa6c3000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6bc0cc660 con 0x7fa6bc06c270 2024-04-25T09:03:27.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.418+0000 7fa6c3000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6bc09ad60 con 0x7fa6bc06ccf0 2024-04-25T09:03:27.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.418+0000 7fa6c3000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc0cbd30 con 0x7fa6bc15da60 2024-04-25T09:03:27.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.418+0000 7fa6c1200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa6bc06c270 0x7fa6bc06c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.418+0000 7fa6c1200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa6bc06c270 0x7fa6bc06c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49994/0 (socket says 172.21.15.173:49994) 2024-04-25T09:03:27.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.418+0000 7fa6c1200640 1 -- 172.21.15.173:0/3747114279 learned_addr learned my addr 172.21.15.173:0/3747114279 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:27.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.418+0000 7fa6c1200640 1 -- 172.21.15.173:0/3747114279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6bc15da60 msgr2=0x7fa6bc09a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:27.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.418+0000 7fa6c1200640 1 --2- 172.21.15.173:0/3747114279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6bc15da60 0x7fa6bc09a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.418+0000 7fa6c1200640 1 -- 172.21.15.173:0/3747114279 >> v2:172.21.15.194:3300/0 conn(0x7fa6bc06ccf0 msgr2=0x7fa6bc0b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:27.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.418+0000 7fa6c1200640 1 --2- 172.21.15.173:0/3747114279 >> v2:172.21.15.194:3300/0 conn(0x7fa6bc06ccf0 0x7fa6bc0b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.418+0000 7fa6c1200640 1 -- 172.21.15.173:0/3747114279 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6bc0cc010 con 0x7fa6bc06c270 2024-04-25T09:03:27.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c1200640 1 --2- 172.21.15.173:0/3747114279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6bc06c270 0x7fa6bc06c7b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0c5120 tx=0x7fa6a801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44ab6fc393f9526 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6bbe00640 1 -- 172.21.15.173:0/3747114279 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80b0070 con 0x7fa6bc06c270 2024-04-25T09:03:27.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6bbe00640 1 -- 172.21.15.173:0/3747114279 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a80ab600 con 0x7fa6bc06c270 2024-04-25T09:03:27.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6bbe00640 1 -- 172.21.15.173:0/3747114279 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80ab9d0 con 0x7fa6bc06c270 2024-04-25T09:03:27.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c3000640 1 -- 172.21.15.173:0/3747114279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6bc06c270 msgr2=0x7fa6bc06c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c3000640 1 --2- 172.21.15.173:0/3747114279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6bc06c270 0x7fa6bc06c7b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0c5120 tx=0x7fa6a801c520 comp rx=0 tx=0).stop 2024-04-25T09:03:27.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c3000640 1 -- 172.21.15.173:0/3747114279 shutdown_connections 2024-04-25T09:03:27.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c3000640 1 --2- 172.21.15.173:0/3747114279 >> v2:172.21.15.194:3300/0 conn(0x7fa6bc06ccf0 0x7fa6bc0b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c3000640 1 --2- 172.21.15.173:0/3747114279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6bc06c270 0x7fa6bc06c7b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c3000640 1 --2- 172.21.15.173:0/3747114279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6bc15da60 0x7fa6bc09a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c3000640 1 -- 172.21.15.173:0/3747114279 >> 172.21.15.173:0/3747114279 conn(0x7fa6bc0b3130 msgr2=0x7fa6bc0b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:27.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c3000640 1 -- 172.21.15.173:0/3747114279 shutdown_connections 2024-04-25T09:03:27.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c3000640 1 -- 172.21.15.173:0/3747114279 wait complete. 2024-04-25T09:03:27.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c3000640 1 Processor -- start 2024-04-25T09:03:27.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c3000640 1 -- start start 2024-04-25T09:03:27.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c3000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6bc06c270 0x7fa6bc157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c3000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6bc06ccf0 0x7fa6bc160960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c3000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6bc15da60 0x7fa6bc1f9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c3000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc09aaf0 con 0x7fa6bc06c270 2024-04-25T09:03:27.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c3000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc09a970 con 0x7fa6bc15da60 2024-04-25T09:03:27.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c3000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc0cf880 con 0x7fa6bc06ccf0 2024-04-25T09:03:27.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c1c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6bc06c270 0x7fa6bc157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c1c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6bc06c270 0x7fa6bc157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49998/0 (socket says 172.21.15.173:49998) 2024-04-25T09:03:27.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c1c00640 1 -- 172.21.15.173:0/3236107788 learned_addr learned my addr 172.21.15.173:0/3236107788 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:27.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c2600640 1 --2- 172.21.15.173:0/3236107788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6bc15da60 0x7fa6bc1f9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.422+0000 7fa6c1200640 1 --2- 172.21.15.173:0/3236107788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6bc06ccf0 0x7fa6bc160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.426+0000 7fa6c1c00640 1 -- 172.21.15.173:0/3236107788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6bc06ccf0 msgr2=0x7fa6bc160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.426+0000 7fa6c1c00640 1 --2- 172.21.15.173:0/3236107788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6bc06ccf0 0x7fa6bc160960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.426+0000 7fa6c1c00640 1 -- 172.21.15.173:0/3236107788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6bc15da60 msgr2=0x7fa6bc1f9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.426+0000 7fa6c1c00640 1 --2- 172.21.15.173:0/3236107788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6bc15da60 0x7fa6bc1f9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.426+0000 7fa6c1c00640 1 -- 172.21.15.173:0/3236107788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6bc157810 con 0x7fa6bc06c270 2024-04-25T09:03:27.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.426+0000 7fa6c1c00640 1 --2- 172.21.15.173:0/3236107788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6bc06c270 0x7fa6bc157210 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000ba80 tx=0x7fa6b000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.426+0000 7fa6b9600640 1 -- 172.21.15.173:0/3236107788 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0019070 con 0x7fa6bc06c270 2024-04-25T09:03:27.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.426+0000 7fa6b9600640 1 -- 172.21.15.173:0/3236107788 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b000cbc0 con 0x7fa6bc06c270 2024-04-25T09:03:27.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.426+0000 7fa6b9600640 1 -- 172.21.15.173:0/3236107788 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0014440 con 0x7fa6bc06c270 2024-04-25T09:03:27.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.426+0000 7fa6c3000640 1 -- 172.21.15.173:0/3236107788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6bc157af0 con 0x7fa6bc06c270 2024-04-25T09:03:27.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.426+0000 7fa6c3000640 1 -- 172.21.15.173:0/3236107788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6bc1580b0 con 0x7fa6bc06c270 2024-04-25T09:03:27.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.426+0000 7fa6c3000640 1 -- 172.21.15.173:0/3236107788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6bc073a40 con 0x7fa6bc06c270 2024-04-25T09:03:27.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.426+0000 7fa6b9600640 1 -- 172.21.15.173:0/3236107788 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa6b001c070 con 0x7fa6bc06c270 2024-04-25T09:03:27.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.426+0000 7fa6b9600640 1 --2- 172.21.15.173:0/3236107788 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa69c066f90 0x7fa69c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.426+0000 7fa6b9600640 1 -- 172.21.15.173:0/3236107788 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa6b0084fe0 con 0x7fa6bc06c270 2024-04-25T09:03:27.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.426+0000 7fa6c1200640 1 --2- 172.21.15.173:0/3236107788 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa69c066f90 0x7fa69c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.430+0000 7fa6c1200640 1 --2- 172.21.15.173:0/3236107788 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa69c066f90 0x7fa69c069450 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80ad000 tx=0x7fa6a80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.434+0000 7fa6b9600640 1 -- 172.21.15.173:0/3236107788 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa6b0055690 con 0x7fa6bc06c270 2024-04-25T09:03:27.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.622+0000 7fa6c3000640 1 -- 172.21.15.173:0/3236107788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa6bc0b22c0 con 0x7fa6bc06c270 2024-04-25T09:03:27.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.622+0000 7fa6b9600640 1 -- 172.21.15.173:0/3236107788 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa6b0059730 con 0x7fa6bc06c270 2024-04-25T09:03:27.610 INFO:teuthology.orchestra.run.smithi173.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T09:03:27.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.622+0000 7fa6c3000640 1 -- 172.21.15.173:0/3236107788 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa69c066f90 msgr2=0x7fa69c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.622+0000 7fa6c3000640 1 --2- 172.21.15.173:0/3236107788 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa69c066f90 0x7fa69c069450 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80ad000 tx=0x7fa6a80a6000 comp rx=0 tx=0).stop 2024-04-25T09:03:27.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.622+0000 7fa6c3000640 1 -- 172.21.15.173:0/3236107788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6bc06c270 msgr2=0x7fa6bc157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.622+0000 7fa6c3000640 1 --2- 172.21.15.173:0/3236107788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6bc06c270 0x7fa6bc157210 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000ba80 tx=0x7fa6b000bf40 comp rx=0 tx=0).stop 2024-04-25T09:03:27.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.622+0000 7fa6c3000640 1 -- 172.21.15.173:0/3236107788 shutdown_connections 2024-04-25T09:03:27.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.622+0000 7fa6c3000640 1 --2- 172.21.15.173:0/3236107788 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa69c066f90 0x7fa69c069450 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.622+0000 7fa6c3000640 1 --2- 172.21.15.173:0/3236107788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6bc15da60 0x7fa6bc1f9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.622+0000 7fa6c3000640 1 --2- 172.21.15.173:0/3236107788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6bc06ccf0 0x7fa6bc160960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.622+0000 7fa6c3000640 1 --2- 172.21.15.173:0/3236107788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6bc06c270 0x7fa6bc157210 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.622+0000 7fa6c3000640 1 -- 172.21.15.173:0/3236107788 >> 172.21.15.173:0/3236107788 conn(0x7fa6bc0b3130 msgr2=0x7fa6bc06f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:27.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.622+0000 7fa6c3000640 1 -- 172.21.15.173:0/3236107788 shutdown_connections 2024-04-25T09:03:27.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:27.622+0000 7fa6c3000640 1 -- 172.21.15.173:0/3236107788 wait complete. 2024-04-25T09:03:27.631 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T09:03:27.631 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:03:27.632 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-04-25T09:03:27.632 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-25T09:03:27.632 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T09:03:27.632 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T09:03:27.632 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:03:27.632 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:03:27.632 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-25T09:03:27.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:27.632 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-04-25T09:03:27.642 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:03:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:03:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:03:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-04-25T09:03:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:27.642 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:03:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:27.642 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-04-25T09:03:27.643 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:03:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-04-25T09:03:27.643 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:03:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:27.643 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:03:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:03:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42412sec preferred_lft 42412sec 2024-04-25T09:03:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link 2024-04-25T09:03:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:27.643 INFO:teuthology.orchestra.run.smithi194.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:03:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:42:bf:07:10:52 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:03:27.643 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:27.644 INFO:teuthology.orchestra.run.smithi194.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:03:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:03:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-04-25T09:03:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:27.644 INFO:teuthology.orchestra.run.smithi194.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:03:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T09:03:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-04-25T09:03:27.644 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:27.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:27.645 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:03:27.704 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-04-25T09:03:27.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:27.706 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-04-25T09:03:27.762 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-04-25T09:03:27.762 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:03:27.762 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:03:27.763 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:03:27.763 INFO:teuthology.orchestra.run.smithi194.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:03:27.765 INFO:teuthology.orchestra.run.smithi194.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:03:27.766 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:03:27.766 INFO:teuthology.orchestra.run.smithi194.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:03:27.766 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:03:27.766 INFO:teuthology.orchestra.run.smithi194.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:03:27.766 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:03:27.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:27.766 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-04-25T09:03:27.766 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-04-25T09:03:27.766 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:03:27.766 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:03:27.767 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:03:27.767 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-04-25T09:03:27.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:27.856 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-04-25T09:03:27.866 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T09:03:27.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:27.866 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list-id 2024-04-25T09:03:27.918 INFO:teuthology.orchestra.run.smithi194.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-25T09:03:27.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:27.919 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-04-25T09:03:27.919 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-04-25T09:03:27.919 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T09:03:27.919 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-25T09:03:27.919 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-04-25T09:03:28.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:28.001 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T09:03:28.063 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:03:28.063 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:03:28.064 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:03:28.064 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:28.064 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-04-25T09:03:28.064 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:28.064 INFO:teuthology.orchestra.run.smithi194.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:03:28.064 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 86:72:ad:ea:22:dc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T09:03:28.064 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T09:03:28.064 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:28.064 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::8472:adff:feea:22dc/64 scope link 2024-04-25T09:03:28.064 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:28.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:28.066 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T09:03:28.126 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:03:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:03:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:03:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-04-25T09:03:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:28.127 INFO:teuthology.orchestra.run.smithi194.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:03:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 86:72:ad:ea:22:dc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T09:03:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T09:03:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::8472:adff:feea:22dc/64 scope link 2024-04-25T09:03:28.127 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:28.128 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-25T09:03:28.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:28.128 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-04-25T09:03:28.128 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-04-25T09:03:28.128 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-25T09:03:28.128 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T09:03:28.129 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-25T09:03:28.129 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-25T09:03:28.129 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-25T09:03:28.129 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-04-25T09:03:28.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:28.261 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-04-25T09:03:28.261 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-04-25T09:03:28.261 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.1 up 2024-04-25T09:03:28.261 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T09:03:28.261 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-04-25T09:03:28.301 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:28.301 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-25T09:03:28.354 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-25T09:03:28.354 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:28.354 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-25T09:03:28.409 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:03:28.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:28.409 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T09:03:28.501 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T09:03:28.501 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T09:03:28.501 INFO:teuthology.orchestra.run.smithi194.stdout:invalid new device string format 2024-04-25T09:03:28.516 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T09:03:28.516 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T09:03:28.516 INFO:teuthology.orchestra.run.smithi194.stdout:invalid new device string format 2024-04-25T09:03:28.516 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:03:28.516 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:03:28.525 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T09:03:28.525 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T09:03:28.525 INFO:teuthology.orchestra.run.smithi194.stdout:invalid new device string format 2024-04-25T09:03:28.525 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:03:28.526 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:03:28.526 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-04-25T09:03:28.526 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-04-25T09:03:28.526 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6" will pass to kernel 2024-04-25T09:03:28.530 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:03:28.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:28.530 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-25T09:03:28.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:28.597 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:03:28.652 INFO:teuthology.orchestra.run.smithi194.stdout:client4625 2024-04-25T09:03:28.653 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:03:28.653 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:28.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:28.706 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:03:28.761 INFO:teuthology.orchestra.run.smithi194.stdout:client4625 2024-04-25T09:03:28.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:28.761 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:03:28.813 INFO:teuthology.orchestra.run.smithi194.stdout:client4625 2024-04-25T09:03:28.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:28.813 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6.client4625/status') 2024-04-25T09:03:28.872 INFO:teuthology.orchestra.run.smithi194.stdout:instance: client.4625 (3)192.168.0.2:0/2822595606 2024-04-25T09:03:28.873 INFO:teuthology.orchestra.run.smithi194.stdout:blocklisted: false 2024-04-25T09:03:28.873 INFO:teuthology.orchestra.run.smithi194.stderr:0+1 records in 2024-04-25T09:03:28.873 INFO:teuthology.orchestra.run.smithi194.stderr:0+1 records out 2024-04-25T09:03:28.873 INFO:teuthology.orchestra.run.smithi194.stderr:69 bytes copied, 4.9317e-05 s, 1.4 MB/s 2024-04-25T09:03:28.875 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-25T09:03:28.889 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:29.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.046+0000 7fe2fcc00640 1 Processor -- start 2024-04-25T09:03:29.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.046+0000 7fe2fcc00640 1 -- start start 2024-04-25T09:03:29.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.046+0000 7fe2fcc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f80b3e70 0x7fe2f80b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.046+0000 7fe2fcc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe2f80aefa0 0x7fe2f80b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.046+0000 7fe2fcc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe2f815edd0 0x7fe2f80b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.046+0000 7fe2fcc00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f806dd50 con 0x7fe2f80aefa0 2024-04-25T09:03:29.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.046+0000 7fe2fcc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f80b4790 con 0x7fe2f815edd0 2024-04-25T09:03:29.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.046+0000 7fe2fcc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f815f320 con 0x7fe2f80b3e70 2024-04-25T09:03:29.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.046+0000 7fe2f5400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe2f80aefa0 0x7fe2f80b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.046+0000 7fe2f5400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe2f80aefa0 0x7fe2f80b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50006/0 (socket says 172.21.15.173:50006) 2024-04-25T09:03:29.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.046+0000 7fe2f5400640 1 -- 172.21.15.173:0/2961684670 learned_addr learned my addr 172.21.15.173:0/2961684670 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:29.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.046+0000 7fe2f5e00640 1 --2- 172.21.15.173:0/2961684670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f80b3e70 0x7fe2f80b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.046+0000 7fe2f6800640 1 --2- 172.21.15.173:0/2961684670 >> v2:172.21.15.194:3300/0 conn(0x7fe2f815edd0 0x7fe2f80b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.050+0000 7fe2f5400640 1 -- 172.21.15.173:0/2961684670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f80b3e70 msgr2=0x7fe2f80b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:29.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.050+0000 7fe2f5400640 1 --2- 172.21.15.173:0/2961684670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f80b3e70 0x7fe2f80b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.050+0000 7fe2f5400640 1 -- 172.21.15.173:0/2961684670 >> v2:172.21.15.194:3300/0 conn(0x7fe2f815edd0 msgr2=0x7fe2f80b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:29.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.050+0000 7fe2f5400640 1 --2- 172.21.15.173:0/2961684670 >> v2:172.21.15.194:3300/0 conn(0x7fe2f815edd0 0x7fe2f80b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.050+0000 7fe2f5400640 1 -- 172.21.15.173:0/2961684670 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f806d420 con 0x7fe2f80aefa0 2024-04-25T09:03:29.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.050+0000 7fe2f5e00640 1 --2- 172.21.15.173:0/2961684670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f80b3e70 0x7fe2f80b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:29.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.050+0000 7fe2f5400640 1 --2- 172.21.15.173:0/2961684670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2f80aefa0 0x7fe2f80b2770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe2f806bbf0 tx=0x7fe2e401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3ca2261c81f5ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.050+0000 7fe2f4a00640 1 -- 172.21.15.173:0/2961684670 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e40aa430 con 0x7fe2f80aefa0 2024-04-25T09:03:29.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.050+0000 7fe2f4a00640 1 -- 172.21.15.173:0/2961684670 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e40af070 con 0x7fe2f80aefa0 2024-04-25T09:03:29.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.050+0000 7fe2f4a00640 1 -- 172.21.15.173:0/2961684670 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e40aa7f0 con 0x7fe2f80aefa0 2024-04-25T09:03:29.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.050+0000 7fe2fcc00640 1 -- 172.21.15.173:0/2961684670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2f80aefa0 msgr2=0x7fe2f80b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.050+0000 7fe2fcc00640 1 --2- 172.21.15.173:0/2961684670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2f80aefa0 0x7fe2f80b2770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe2f806bbf0 tx=0x7fe2e401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.050+0000 7fe2fcc00640 1 -- 172.21.15.173:0/2961684670 shutdown_connections 2024-04-25T09:03:29.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.050+0000 7fe2fcc00640 1 --2- 172.21.15.173:0/2961684670 >> v2:172.21.15.194:3300/0 conn(0x7fe2f815edd0 0x7fe2f80b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.050+0000 7fe2fcc00640 1 --2- 172.21.15.173:0/2961684670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2f80aefa0 0x7fe2f80b2770 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.050+0000 7fe2fcc00640 1 --2- 172.21.15.173:0/2961684670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f80b3e70 0x7fe2f80b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.050+0000 7fe2fcc00640 1 -- 172.21.15.173:0/2961684670 >> 172.21.15.173:0/2961684670 conn(0x7fe2f806ac90 msgr2=0x7fe2f806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:29.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2fcc00640 1 -- 172.21.15.173:0/2961684670 shutdown_connections 2024-04-25T09:03:29.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2fcc00640 1 -- 172.21.15.173:0/2961684670 wait complete. 2024-04-25T09:03:29.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2fcc00640 1 Processor -- start 2024-04-25T09:03:29.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2fcc00640 1 -- start start 2024-04-25T09:03:29.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2fcc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2f80aefa0 0x7fe2f814e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2fcc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f80b3e70 0x7fe2f814c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2fcc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2f815edd0 0x7fe2f814cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2fcc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f806e1c0 con 0x7fe2f80aefa0 2024-04-25T09:03:29.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2fcc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f80b3600 con 0x7fe2f815edd0 2024-04-25T09:03:29.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2fcc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f806e340 con 0x7fe2f80b3e70 2024-04-25T09:03:29.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2f5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2f80aefa0 0x7fe2f814e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2f5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2f80aefa0 0x7fe2f814e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50022/0 (socket says 172.21.15.173:50022) 2024-04-25T09:03:29.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2f5e00640 1 -- 172.21.15.173:0/3778255756 learned_addr learned my addr 172.21.15.173:0/3778255756 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:29.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2f5400640 1 --2- 172.21.15.173:0/3778255756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f80b3e70 0x7fe2f814c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2f6800640 1 --2- 172.21.15.173:0/3778255756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2f815edd0 0x7fe2f814cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2f5e00640 1 -- 172.21.15.173:0/3778255756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f80b3e70 msgr2=0x7fe2f814c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2f5e00640 1 --2- 172.21.15.173:0/3778255756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f80b3e70 0x7fe2f814c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2f5e00640 1 -- 172.21.15.173:0/3778255756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2f815edd0 msgr2=0x7fe2f814cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2f5e00640 1 --2- 172.21.15.173:0/3778255756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2f815edd0 0x7fe2f814cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2f5e00640 1 -- 172.21.15.173:0/3778255756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f815dcb0 con 0x7fe2f80aefa0 2024-04-25T09:03:29.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2f5e00640 1 --2- 172.21.15.173:0/3778255756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2f80aefa0 0x7fe2f814e080 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8007e10 tx=0x7fe2e800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2ee000640 1 -- 172.21.15.173:0/3778255756 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e801a070 con 0x7fe2f80aefa0 2024-04-25T09:03:29.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2ee000640 1 -- 172.21.15.173:0/3778255756 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e8003ba0 con 0x7fe2f80aefa0 2024-04-25T09:03:29.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2ee000640 1 -- 172.21.15.173:0/3778255756 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8004030 con 0x7fe2f80aefa0 2024-04-25T09:03:29.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.054+0000 7fe2fcc00640 1 -- 172.21.15.173:0/3778255756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f81f7a90 con 0x7fe2f80aefa0 2024-04-25T09:03:29.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.058+0000 7fe2fcc00640 1 -- 172.21.15.173:0/3778255756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f81f8050 con 0x7fe2f80aefa0 2024-04-25T09:03:29.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.058+0000 7fe2fcc00640 1 -- 172.21.15.173:0/3778255756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f8073a40 con 0x7fe2f80aefa0 2024-04-25T09:03:29.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.058+0000 7fe2ee000640 1 -- 172.21.15.173:0/3778255756 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe2e801d070 con 0x7fe2f80aefa0 2024-04-25T09:03:29.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.058+0000 7fe2ee000640 1 --2- 172.21.15.173:0/3778255756 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe2d8066f90 0x7fe2d8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.058+0000 7fe2ee000640 1 -- 172.21.15.173:0/3778255756 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe2e80854d0 con 0x7fe2f80aefa0 2024-04-25T09:03:29.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.058+0000 7fe2f5400640 1 --2- 172.21.15.173:0/3778255756 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe2d8066f90 0x7fe2d8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.058+0000 7fe2f5400640 1 --2- 172.21.15.173:0/3778255756 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe2d8066f90 0x7fe2d8069450 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40ae000 tx=0x7fe2e40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.062+0000 7fe2ee000640 1 -- 172.21.15.173:0/3778255756 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe2f815dcb0 con 0x7fe2f80aefa0 2024-04-25T09:03:29.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.218+0000 7fe2fcc00640 1 -- 172.21.15.173:0/3778255756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2f80b0e80 con 0x7fe2f80aefa0 2024-04-25T09:03:29.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.218+0000 7fe2ee000640 1 -- 172.21.15.173:0/3778255756 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18574 (secure 0 0 0) 0x7fe2e8010070 con 0x7fe2f80aefa0 2024-04-25T09:03:29.209 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:29.209 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:56.440593+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:29.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.222+0000 7fe2fcc00640 1 -- 172.21.15.173:0/3778255756 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe2d8066f90 msgr2=0x7fe2d8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.222+0000 7fe2fcc00640 1 --2- 172.21.15.173:0/3778255756 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe2d8066f90 0x7fe2d8069450 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40ae000 tx=0x7fe2e40a7000 comp rx=0 tx=0).stop 2024-04-25T09:03:29.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.222+0000 7fe2fcc00640 1 -- 172.21.15.173:0/3778255756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2f80aefa0 msgr2=0x7fe2f814e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.222+0000 7fe2fcc00640 1 --2- 172.21.15.173:0/3778255756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2f80aefa0 0x7fe2f814e080 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8007e10 tx=0x7fe2e800d4a0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.222+0000 7fe2fcc00640 1 -- 172.21.15.173:0/3778255756 shutdown_connections 2024-04-25T09:03:29.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.222+0000 7fe2fcc00640 1 --2- 172.21.15.173:0/3778255756 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe2d8066f90 0x7fe2d8069450 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.222+0000 7fe2fcc00640 1 --2- 172.21.15.173:0/3778255756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2f815edd0 0x7fe2f814cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.222+0000 7fe2fcc00640 1 --2- 172.21.15.173:0/3778255756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f80b3e70 0x7fe2f814c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.222+0000 7fe2fcc00640 1 --2- 172.21.15.173:0/3778255756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2f80aefa0 0x7fe2f814e080 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.222+0000 7fe2fcc00640 1 -- 172.21.15.173:0/3778255756 >> 172.21.15.173:0/3778255756 conn(0x7fe2f806ac90 msgr2=0x7fe2f80aca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:29.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.222+0000 7fe2fcc00640 1 -- 172.21.15.173:0/3778255756 shutdown_connections 2024-04-25T09:03:29.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.222+0000 7fe2fcc00640 1 -- 172.21.15.173:0/3778255756 wait complete. 2024-04-25T09:03:29.231 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:02:49.342297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:02:50.386069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:02:54.077429+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:03:29.232 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:29.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.378+0000 7f91a6400640 1 Processor -- start 2024-04-25T09:03:29.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.382+0000 7f91a6400640 1 -- start start 2024-04-25T09:03:29.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.382+0000 7f91a6400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f91a0145290 0x7f91a015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.382+0000 7f91a6400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f91a00b3fe0 0x7f91a00b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.382+0000 7f91a6400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a00cc260 0x7f91a00cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.382+0000 7f91a6400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a015c5f0 con 0x7f91a0145290 2024-04-25T09:03:29.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.382+0000 7f91a6400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a006d4b0 con 0x7f91a00b3fe0 2024-04-25T09:03:29.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.382+0000 7f91a6400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a006d790 con 0x7f91a00cc260 2024-04-25T09:03:29.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.382+0000 7f919f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f91a0145290 0x7f91a015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.382+0000 7f919f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f91a0145290 0x7f91a015c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50036/0 (socket says 172.21.15.173:50036) 2024-04-25T09:03:29.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.382+0000 7f919f400640 1 -- 172.21.15.173:0/3219626186 learned_addr learned my addr 172.21.15.173:0/3219626186 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:29.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.382+0000 7f9196a00640 1 --2- 172.21.15.173:0/3219626186 >> v2:172.21.15.194:3300/0 conn(0x7f91a00b3fe0 0x7f91a00b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.382+0000 7f919fe00640 1 --2- 172.21.15.173:0/3219626186 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a00cc260 0x7f91a00cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.382+0000 7f919f400640 1 -- 172.21.15.173:0/3219626186 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a00cc260 msgr2=0x7f91a00cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:29.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.382+0000 7f919f400640 1 --2- 172.21.15.173:0/3219626186 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a00cc260 0x7f91a00cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.382+0000 7f919f400640 1 -- 172.21.15.173:0/3219626186 >> v2:172.21.15.194:3300/0 conn(0x7f91a00b3fe0 msgr2=0x7f91a00b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:29.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.382+0000 7f919f400640 1 --2- 172.21.15.173:0/3219626186 >> v2:172.21.15.194:3300/0 conn(0x7f91a00b3fe0 0x7f91a00b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.382+0000 7f919f400640 1 -- 172.21.15.173:0/3219626186 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a006da70 con 0x7f91a0145290 2024-04-25T09:03:29.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.382+0000 7f9196a00640 1 --2- 172.21.15.173:0/3219626186 >> v2:172.21.15.194:3300/0 conn(0x7f91a00b3fe0 0x7f91a00b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:29.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.386+0000 7f919f400640 1 --2- 172.21.15.173:0/3219626186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a0145290 0x7f91a015c0b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f91a0071100 tx=0x7f919001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec971333b2beadf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.386+0000 7f919ea00640 1 -- 172.21.15.173:0/3219626186 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91900a5660 con 0x7f91a0145290 2024-04-25T09:03:29.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.386+0000 7f919ea00640 1 -- 172.21.15.173:0/3219626186 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91900a5800 con 0x7f91a0145290 2024-04-25T09:03:29.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.386+0000 7f919ea00640 1 -- 172.21.15.173:0/3219626186 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91900a5bd0 con 0x7f91a0145290 2024-04-25T09:03:29.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.386+0000 7f91a6400640 1 -- 172.21.15.173:0/3219626186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a0145290 msgr2=0x7f91a015c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.386+0000 7f91a6400640 1 --2- 172.21.15.173:0/3219626186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a0145290 0x7f91a015c0b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f91a0071100 tx=0x7f919001c8d0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.386+0000 7f91a6400640 1 -- 172.21.15.173:0/3219626186 shutdown_connections 2024-04-25T09:03:29.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.386+0000 7f91a6400640 1 --2- 172.21.15.173:0/3219626186 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a00cc260 0x7f91a00cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.386+0000 7f91a6400640 1 --2- 172.21.15.173:0/3219626186 >> v2:172.21.15.194:3300/0 conn(0x7f91a00b3fe0 0x7f91a00b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.386+0000 7f91a6400640 1 --2- 172.21.15.173:0/3219626186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a0145290 0x7f91a015c0b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.386+0000 7f91a6400640 1 -- 172.21.15.173:0/3219626186 >> 172.21.15.173:0/3219626186 conn(0x7f91a006ac90 msgr2=0x7f91a006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:29.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.386+0000 7f91a6400640 1 -- 172.21.15.173:0/3219626186 shutdown_connections 2024-04-25T09:03:29.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.386+0000 7f91a6400640 1 -- 172.21.15.173:0/3219626186 wait complete. 2024-04-25T09:03:29.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.386+0000 7f91a6400640 1 Processor -- start 2024-04-25T09:03:29.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.386+0000 7f91a6400640 1 -- start start 2024-04-25T09:03:29.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f91a6400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91a00b3fe0 0x7f91a01f9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f91a6400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a00cc260 0x7f91a0131bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f91a6400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a0145290 0x7f91a0132110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f91a6400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a01457f0 con 0x7f91a00cc260 2024-04-25T09:03:29.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f91a6400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a0145670 con 0x7f91a00b3fe0 2024-04-25T09:03:29.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f91a6400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a006ed60 con 0x7f91a0145290 2024-04-25T09:03:29.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f9196a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a00cc260 0x7f91a0131bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f9196a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a00cc260 0x7f91a0131bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50048/0 (socket says 172.21.15.173:50048) 2024-04-25T09:03:29.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f9196a00640 1 -- 172.21.15.173:0/614214999 learned_addr learned my addr 172.21.15.173:0/614214999 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:29.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f919f400640 1 --2- 172.21.15.173:0/614214999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91a00b3fe0 0x7f91a01f9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f919fe00640 1 --2- 172.21.15.173:0/614214999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a0145290 0x7f91a0132110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f9196a00640 1 -- 172.21.15.173:0/614214999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a0145290 msgr2=0x7f91a0132110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f9196a00640 1 --2- 172.21.15.173:0/614214999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a0145290 0x7f91a0132110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f9196a00640 1 -- 172.21.15.173:0/614214999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91a00b3fe0 msgr2=0x7f91a01f9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f9196a00640 1 --2- 172.21.15.173:0/614214999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91a00b3fe0 0x7f91a01f9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f9196a00640 1 -- 172.21.15.173:0/614214999 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a00ac8c0 con 0x7f91a00cc260 2024-04-25T09:03:29.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f9196a00640 1 --2- 172.21.15.173:0/614214999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a00cc260 0x7f91a0131bd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f918800e9e0 tx=0x7f918800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f9197e00640 1 -- 172.21.15.173:0/614214999 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9188017070 con 0x7f91a00cc260 2024-04-25T09:03:29.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f9197e00640 1 -- 172.21.15.173:0/614214999 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918800ca30 con 0x7f91a00cc260 2024-04-25T09:03:29.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f9197e00640 1 -- 172.21.15.173:0/614214999 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918800ce00 con 0x7f91a00cc260 2024-04-25T09:03:29.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f91a6400640 1 -- 172.21.15.173:0/614214999 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a01fa300 con 0x7f91a00cc260 2024-04-25T09:03:29.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f91a6400640 1 -- 172.21.15.173:0/614214999 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a01fa8b0 con 0x7f91a00cc260 2024-04-25T09:03:29.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.390+0000 7f91a6400640 1 -- 172.21.15.173:0/614214999 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a0073ab0 con 0x7f91a00cc260 2024-04-25T09:03:29.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.394+0000 7f9197e00640 1 -- 172.21.15.173:0/614214999 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f918801a070 con 0x7f91a00cc260 2024-04-25T09:03:29.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.394+0000 7f9197e00640 1 --2- 172.21.15.173:0/614214999 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f917c066f60 0x7f917c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.394+0000 7f9197e00640 1 -- 172.21.15.173:0/614214999 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9188085270 con 0x7f91a00cc260 2024-04-25T09:03:29.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.394+0000 7f919f400640 1 --2- 172.21.15.173:0/614214999 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f917c066f60 0x7f917c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.394+0000 7f919f400640 1 --2- 172.21.15.173:0/614214999 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f917c066f60 0x7f917c069420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f91900ae000 tx=0x7f91900a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.398+0000 7f9197e00640 1 -- 172.21.15.173:0/614214999 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9188055850 con 0x7f91a00cc260 2024-04-25T09:03:29.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.550+0000 7f91a6400640 1 -- 172.21.15.173:0/614214999 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f91a00b1f40 con 0x7f91a00cc260 2024-04-25T09:03:29.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.554+0000 7f9197e00640 1 -- 172.21.15.173:0/614214999 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91880598f0 con 0x7f91a00cc260 2024-04-25T09:03:29.542 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:03:29.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.554+0000 7f91a6400640 1 -- 172.21.15.173:0/614214999 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f917c066f60 msgr2=0x7f917c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.554+0000 7f91a6400640 1 --2- 172.21.15.173:0/614214999 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f917c066f60 0x7f917c069420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f91900ae000 tx=0x7f91900a7070 comp rx=0 tx=0).stop 2024-04-25T09:03:29.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.554+0000 7f91a6400640 1 -- 172.21.15.173:0/614214999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a00cc260 msgr2=0x7f91a0131bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.554+0000 7f91a6400640 1 --2- 172.21.15.173:0/614214999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a00cc260 0x7f91a0131bd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f918800e9e0 tx=0x7f918800eea0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.554+0000 7f91a6400640 1 -- 172.21.15.173:0/614214999 shutdown_connections 2024-04-25T09:03:29.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.554+0000 7f91a6400640 1 --2- 172.21.15.173:0/614214999 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f917c066f60 0x7f917c069420 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.554+0000 7f91a6400640 1 --2- 172.21.15.173:0/614214999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a0145290 0x7f91a0132110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.554+0000 7f91a6400640 1 --2- 172.21.15.173:0/614214999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a00cc260 0x7f91a0131bd0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.554+0000 7f91a6400640 1 --2- 172.21.15.173:0/614214999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91a00b3fe0 0x7f91a01f9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.554+0000 7f91a6400640 1 -- 172.21.15.173:0/614214999 >> 172.21.15.173:0/614214999 conn(0x7f91a006ac90 msgr2=0x7f91a00ce530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:29.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.554+0000 7f91a6400640 1 -- 172.21.15.173:0/614214999 shutdown_connections 2024-04-25T09:03:29.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.554+0000 7f91a6400640 1 -- 172.21.15.173:0/614214999 wait complete. 2024-04-25T09:03:29.563 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:29.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.714+0000 7fb212e00640 1 Processor -- start 2024-04-25T09:03:29.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.714+0000 7fb212e00640 1 -- start start 2024-04-25T09:03:29.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.714+0000 7fb212e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb20c0aeb90 0x7fb20c0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.714+0000 7fb212e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb20c0ce2b0 0x7fb20c0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.714+0000 7fb212e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20c071570 con 0x7fb20c0aef70 2024-04-25T09:03:29.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.714+0000 7fb212e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20c071320 con 0x7fb20c0ce2b0 2024-04-25T09:03:29.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.714+0000 7fb212e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c072330 con 0x7fb20c0aeb90 2024-04-25T09:03:29.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.714+0000 7fb210e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb20c0ce2b0 0x7fb20c0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.714+0000 7fb210e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb20c0ce2b0 0x7fb20c0cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50054/0 (socket says 172.21.15.173:50054) 2024-04-25T09:03:29.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.714+0000 7fb210e00640 1 -- 172.21.15.173:0/2951986593 learned_addr learned my addr 172.21.15.173:0/2951986593 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:29.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.714+0000 7fb20be00640 1 --2- 172.21.15.173:0/2951986593 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb20c0aeb90 0x7fb20c0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.714+0000 7fb210e00640 1 -- 172.21.15.173:0/2951986593 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb20c0aeb90 msgr2=0x7fb20c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:29.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.714+0000 7fb210e00640 1 --2- 172.21.15.173:0/2951986593 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb20c0aeb90 0x7fb20c0cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.714+0000 7fb210e00640 1 -- 172.21.15.173:0/2951986593 >> v1:172.21.15.194:6789/0 conn(0x7fb20c0aef70 legacy=0x7fb20c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.714+0000 7fb210e00640 1 -- 172.21.15.173:0/2951986593 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c071850 con 0x7fb20c0ce2b0 2024-04-25T09:03:29.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.714+0000 7fb20be00640 1 --2- 172.21.15.173:0/2951986593 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb20c0aeb90 0x7fb20c0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:29.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.718+0000 7fb210e00640 1 --2- 172.21.15.173:0/2951986593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb20c0ce2b0 0x7fb20c0cc610 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb204009870 tx=0x7fb20401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54105e04acd99ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.718+0000 7fb20b400640 1 -- 172.21.15.173:0/2951986593 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2040b1070 con 0x7fb20c0ce2b0 2024-04-25T09:03:29.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.718+0000 7fb20b400640 1 -- 172.21.15.173:0/2951986593 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2040ac600 con 0x7fb20c0ce2b0 2024-04-25T09:03:29.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.718+0000 7fb20b400640 1 -- 172.21.15.173:0/2951986593 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2040ac9d0 con 0x7fb20c0ce2b0 2024-04-25T09:03:29.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.718+0000 7fb212e00640 1 -- 172.21.15.173:0/2951986593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb20c0ce2b0 msgr2=0x7fb20c0cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.718+0000 7fb212e00640 1 --2- 172.21.15.173:0/2951986593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb20c0ce2b0 0x7fb20c0cc610 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb204009870 tx=0x7fb20401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.718+0000 7fb212e00640 1 -- 172.21.15.173:0/2951986593 shutdown_connections 2024-04-25T09:03:29.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.718+0000 7fb212e00640 1 --2- 172.21.15.173:0/2951986593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb20c0ce2b0 0x7fb20c0cc610 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.718+0000 7fb212e00640 1 --2- 172.21.15.173:0/2951986593 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb20c0aeb90 0x7fb20c0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.718+0000 7fb212e00640 1 -- 172.21.15.173:0/2951986593 >> 172.21.15.173:0/2951986593 conn(0x7fb20c06ac90 msgr2=0x7fb20c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:29.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.718+0000 7fb212e00640 1 -- 172.21.15.173:0/2951986593 shutdown_connections 2024-04-25T09:03:29.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.718+0000 7fb212e00640 1 -- 172.21.15.173:0/2951986593 wait complete. 2024-04-25T09:03:29.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb212e00640 1 Processor -- start 2024-04-25T09:03:29.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb212e00640 1 -- start start 2024-04-25T09:03:29.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb212e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb20c0aeb90 0x7fb20c149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb212e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb20c0aef70 0x7fb20c14f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb212e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb20c0ce2b0 0x7fb20c0ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb212e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c15bb30 con 0x7fb20c0aef70 2024-04-25T09:03:29.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb212e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c15b9b0 con 0x7fb20c0ce2b0 2024-04-25T09:03:29.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb212e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c15bcb0 con 0x7fb20c0aeb90 2024-04-25T09:03:29.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb203400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb20c0aef70 0x7fb20c14f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb203400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb20c0aef70 0x7fb20c14f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50070/0 (socket says 172.21.15.173:50070) 2024-04-25T09:03:29.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb203400640 1 -- 172.21.15.173:0/2793878151 learned_addr learned my addr 172.21.15.173:0/2793878151 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:29.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb210e00640 1 --2- 172.21.15.173:0/2793878151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb20c0ce2b0 0x7fb20c0ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb20be00640 1 --2- 172.21.15.173:0/2793878151 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb20c0aeb90 0x7fb20c149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb203400640 1 -- 172.21.15.173:0/2793878151 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb20c0aeb90 msgr2=0x7fb20c149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb203400640 1 --2- 172.21.15.173:0/2793878151 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb20c0aeb90 0x7fb20c149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb203400640 1 -- 172.21.15.173:0/2793878151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb20c0ce2b0 msgr2=0x7fb20c0ada40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb203400640 1 --2- 172.21.15.173:0/2793878151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb20c0ce2b0 0x7fb20c0ada40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb203400640 1 -- 172.21.15.173:0/2793878151 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c151450 con 0x7fb20c0aef70 2024-04-25T09:03:29.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb203400640 1 --2- 172.21.15.173:0/2793878151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb20c0aef70 0x7fb20c14f9d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400c430 tx=0x7fb1f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb208c00640 1 -- 172.21.15.173:0/2793878151 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40052d0 con 0x7fb20c0aef70 2024-04-25T09:03:29.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb208c00640 1 -- 172.21.15.173:0/2793878151 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f4005470 con 0x7fb20c0aef70 2024-04-25T09:03:29.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb208c00640 1 -- 172.21.15.173:0/2793878151 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4007260 con 0x7fb20c0aef70 2024-04-25T09:03:29.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb212e00640 1 -- 172.21.15.173:0/2793878151 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20c14a140 con 0x7fb20c0aef70 2024-04-25T09:03:29.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb212e00640 1 -- 172.21.15.173:0/2793878151 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20c150690 con 0x7fb20c0aef70 2024-04-25T09:03:29.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.722+0000 7fb212e00640 1 -- 172.21.15.173:0/2793878151 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20c073ab0 con 0x7fb20c0aef70 2024-04-25T09:03:29.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.726+0000 7fb208c00640 1 -- 172.21.15.173:0/2793878151 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb1f4007400 con 0x7fb20c0aef70 2024-04-25T09:03:29.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.726+0000 7fb208c00640 1 --2- 172.21.15.173:0/2793878151 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb1e8066f90 0x7fb1e8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.726+0000 7fb208c00640 1 -- 172.21.15.173:0/2793878151 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb1f4084830 con 0x7fb20c0aef70 2024-04-25T09:03:29.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.726+0000 7fb20be00640 1 --2- 172.21.15.173:0/2793878151 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb1e8066f90 0x7fb1e8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.726+0000 7fb20be00640 1 --2- 172.21.15.173:0/2793878151 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb1e8066f90 0x7fb1e8069450 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb20c15cbd0 tx=0x7fb1fc0097f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.730+0000 7fb208c00640 1 -- 172.21.15.173:0/2793878151 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb1f4054e10 con 0x7fb20c0aef70 2024-04-25T09:03:29.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.882+0000 7fb212e00640 1 -- 172.21.15.173:0/2793878151 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb20c15a9b0 con 0x7fb20c0aef70 2024-04-25T09:03:29.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.882+0000 7fb208c00640 1 -- 172.21.15.173:0/2793878151 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1f4058eb0 con 0x7fb20c0aef70 2024-04-25T09:03:29.871 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:29.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.882+0000 7fb212e00640 1 -- 172.21.15.173:0/2793878151 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb1e8066f90 msgr2=0x7fb1e8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.882+0000 7fb212e00640 1 --2- 172.21.15.173:0/2793878151 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb1e8066f90 0x7fb1e8069450 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb20c15cbd0 tx=0x7fb1fc0097f0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.882+0000 7fb212e00640 1 -- 172.21.15.173:0/2793878151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb20c0aef70 msgr2=0x7fb20c14f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.882+0000 7fb212e00640 1 --2- 172.21.15.173:0/2793878151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb20c0aef70 0x7fb20c14f9d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400c430 tx=0x7fb1f400c8f0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.882+0000 7fb212e00640 1 -- 172.21.15.173:0/2793878151 shutdown_connections 2024-04-25T09:03:29.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.882+0000 7fb212e00640 1 --2- 172.21.15.173:0/2793878151 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb1e8066f90 0x7fb1e8069450 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.882+0000 7fb212e00640 1 --2- 172.21.15.173:0/2793878151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb20c0ce2b0 0x7fb20c0ada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.882+0000 7fb212e00640 1 --2- 172.21.15.173:0/2793878151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb20c0aef70 0x7fb20c14f9d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.882+0000 7fb212e00640 1 --2- 172.21.15.173:0/2793878151 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb20c0aeb90 0x7fb20c149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.882+0000 7fb212e00640 1 -- 172.21.15.173:0/2793878151 >> 172.21.15.173:0/2793878151 conn(0x7fb20c06ac90 msgr2=0x7fb20c15d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:29.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.882+0000 7fb212e00640 1 -- 172.21.15.173:0/2793878151 shutdown_connections 2024-04-25T09:03:29.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:29.882+0000 7fb212e00640 1 -- 172.21.15.173:0/2793878151 wait complete. 2024-04-25T09:03:29.893 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:30.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.042+0000 7f0164c00640 1 Processor -- start 2024-04-25T09:03:30.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.042+0000 7f0164c00640 1 -- start start 2024-04-25T09:03:30.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.042+0000 7f0164c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0160145290 0x7f016015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.042+0000 7f0164c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016015c5f0 con 0x7f01600cc260 2024-04-25T09:03:30.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.042+0000 7f0164c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016006d4b0 con 0x7f01600b3fe0 2024-04-25T09:03:30.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.042+0000 7f0164c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01600ccd80 con 0x7f0160145290 2024-04-25T09:03:30.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.042+0000 7f015de00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0160145290 0x7f016015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.042+0000 7f015de00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0160145290 0x7f016015c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50076/0 (socket says 172.21.15.173:50076) 2024-04-25T09:03:30.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.042+0000 7f015de00640 1 -- 172.21.15.173:0/2246545316 learned_addr learned my addr 172.21.15.173:0/2246545316 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:30.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.042+0000 7f015de00640 1 -- 172.21.15.173:0/2246545316 >> v1:172.21.15.194:6789/0 conn(0x7f01600b3fe0 legacy=0x7f01600b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:30.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.042+0000 7f015de00640 1 -- 172.21.15.173:0/2246545316 >> v1:172.21.15.173:6789/0 conn(0x7f01600cc260 legacy=0x7f01600cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.042+0000 7f015de00640 1 -- 172.21.15.173:0/2246545316 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016006d790 con 0x7f0160145290 2024-04-25T09:03:30.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.046+0000 7f015de00640 1 --2- 172.21.15.173:0/2246545316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0160145290 0x7f016015c0b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0150009870 tx=0x7f015001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd25e44710c868f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.046+0000 7f015d400640 1 -- 172.21.15.173:0/2246545316 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01500b1070 con 0x7f0160145290 2024-04-25T09:03:30.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.046+0000 7f015d400640 1 -- 172.21.15.173:0/2246545316 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01500ac640 con 0x7f0160145290 2024-04-25T09:03:30.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.046+0000 7f015d400640 1 -- 172.21.15.173:0/2246545316 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01500aca10 con 0x7f0160145290 2024-04-25T09:03:30.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.046+0000 7f0164c00640 1 -- 172.21.15.173:0/2246545316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0160145290 msgr2=0x7f016015c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.046+0000 7f0164c00640 1 --2- 172.21.15.173:0/2246545316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0160145290 0x7f016015c0b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0150009870 tx=0x7f015001c400 comp rx=0 tx=0).stop 2024-04-25T09:03:30.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.046+0000 7f0164c00640 1 -- 172.21.15.173:0/2246545316 shutdown_connections 2024-04-25T09:03:30.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.046+0000 7f0164c00640 1 --2- 172.21.15.173:0/2246545316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0160145290 0x7f016015c0b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.046+0000 7f0164c00640 1 -- 172.21.15.173:0/2246545316 >> 172.21.15.173:0/2246545316 conn(0x7f016006ac90 msgr2=0x7f016006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:30.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.046+0000 7f0164c00640 1 -- 172.21.15.173:0/2246545316 shutdown_connections 2024-04-25T09:03:30.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.046+0000 7f0164c00640 1 -- 172.21.15.173:0/2246545316 wait complete. 2024-04-25T09:03:30.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.046+0000 7f0164c00640 1 Processor -- start 2024-04-25T09:03:30.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.046+0000 7f0164c00640 1 -- start start 2024-04-25T09:03:30.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0164c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01600b3fe0 0x7f01600ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0164c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01600cc260 0x7f0160155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0164c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0160145290 0x7f01600aa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0164c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016006eee0 con 0x7f01600cc260 2024-04-25T09:03:30.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0164c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016006ed60 con 0x7f0160145290 2024-04-25T09:03:30.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0164c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016006f060 con 0x7f01600b3fe0 2024-04-25T09:03:30.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0157e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01600cc260 0x7f0160155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0157e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01600cc260 0x7f0160155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50088/0 (socket says 172.21.15.173:50088) 2024-04-25T09:03:30.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0157e00640 1 -- 172.21.15.173:0/2121376492 learned_addr learned my addr 172.21.15.173:0/2121376492 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:30.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f015de00640 1 --2- 172.21.15.173:0/2121376492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01600b3fe0 0x7f01600ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f015e800640 1 --2- 172.21.15.173:0/2121376492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0160145290 0x7f01600aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0157e00640 1 -- 172.21.15.173:0/2121376492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01600b3fe0 msgr2=0x7f01600ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0157e00640 1 --2- 172.21.15.173:0/2121376492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01600b3fe0 0x7f01600ac920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0157e00640 1 -- 172.21.15.173:0/2121376492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0160145290 msgr2=0x7f01600aa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0157e00640 1 --2- 172.21.15.173:0/2121376492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0160145290 0x7f01600aa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0157e00640 1 -- 172.21.15.173:0/2121376492 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01600a9480 con 0x7f01600cc260 2024-04-25T09:03:30.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f015de00640 1 --2- 172.21.15.173:0/2121376492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01600b3fe0 0x7f01600ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:30.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0157e00640 1 --2- 172.21.15.173:0/2121376492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01600cc260 0x7f0160155fb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f014800b410 tx=0x7f014800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0156000640 1 -- 172.21.15.173:0/2121376492 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148015030 con 0x7f01600cc260 2024-04-25T09:03:30.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0156000640 1 -- 172.21.15.173:0/2121376492 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0148004020 con 0x7f01600cc260 2024-04-25T09:03:30.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0164c00640 1 -- 172.21.15.173:0/2121376492 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01600a9760 con 0x7f01600cc260 2024-04-25T09:03:30.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0156000640 1 -- 172.21.15.173:0/2121376492 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148004410 con 0x7f01600cc260 2024-04-25T09:03:30.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0164c00640 1 -- 172.21.15.173:0/2121376492 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0160141660 con 0x7f01600cc260 2024-04-25T09:03:30.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0164c00640 1 -- 172.21.15.173:0/2121376492 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0160073ab0 con 0x7f01600cc260 2024-04-25T09:03:30.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.050+0000 7f0156000640 1 -- 172.21.15.173:0/2121376492 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0148018070 con 0x7f01600cc260 2024-04-25T09:03:30.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.054+0000 7f0156000640 1 --2- 172.21.15.173:0/2121376492 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f013c066f60 0x7f013c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.054+0000 7f0156000640 1 -- 172.21.15.173:0/2121376492 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0148084f10 con 0x7f01600cc260 2024-04-25T09:03:30.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.054+0000 7f015de00640 1 --2- 172.21.15.173:0/2121376492 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f013c066f60 0x7f013c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.054+0000 7f015de00640 1 --2- 172.21.15.173:0/2121376492 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f013c066f60 0x7f013c069420 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f01500ae000 tx=0x7f0150008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.058+0000 7f0156000640 1 -- 172.21.15.173:0/2121376492 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0148055bd0 con 0x7f01600cc260 2024-04-25T09:03:30.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.214+0000 7f0164c00640 1 -- 172.21.15.173:0/2121376492 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f016013d920 con 0x7f01600cc260 2024-04-25T09:03:30.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.214+0000 7f0156000640 1 -- 172.21.15.173:0/2121376492 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f01480554d0 con 0x7f01600cc260 2024-04-25T09:03:30.203 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:03:30.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.214+0000 7f0164c00640 1 -- 172.21.15.173:0/2121376492 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f013c066f60 msgr2=0x7f013c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.214+0000 7f0164c00640 1 --2- 172.21.15.173:0/2121376492 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f013c066f60 0x7f013c069420 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f01500ae000 tx=0x7f0150008040 comp rx=0 tx=0).stop 2024-04-25T09:03:30.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.214+0000 7f0164c00640 1 -- 172.21.15.173:0/2121376492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01600cc260 msgr2=0x7f0160155fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.214+0000 7f0164c00640 1 --2- 172.21.15.173:0/2121376492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01600cc260 0x7f0160155fb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f014800b410 tx=0x7f014800b8d0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.214+0000 7f0164c00640 1 -- 172.21.15.173:0/2121376492 shutdown_connections 2024-04-25T09:03:30.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.214+0000 7f0164c00640 1 --2- 172.21.15.173:0/2121376492 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f013c066f60 0x7f013c069420 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.214+0000 7f0164c00640 1 --2- 172.21.15.173:0/2121376492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0160145290 0x7f01600aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.214+0000 7f0164c00640 1 --2- 172.21.15.173:0/2121376492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01600cc260 0x7f0160155fb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.214+0000 7f0164c00640 1 --2- 172.21.15.173:0/2121376492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01600b3fe0 0x7f01600ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.214+0000 7f0164c00640 1 -- 172.21.15.173:0/2121376492 >> 172.21.15.173:0/2121376492 conn(0x7f016006ac90 msgr2=0x7f01600cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:30.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.214+0000 7f0164c00640 1 -- 172.21.15.173:0/2121376492 shutdown_connections 2024-04-25T09:03:30.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.214+0000 7f0164c00640 1 -- 172.21.15.173:0/2121376492 wait complete. 2024-04-25T09:03:30.227 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:03:30.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.374+0000 7f7ac2000640 1 Processor -- start 2024-04-25T09:03:30.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.374+0000 7f7ac2000640 1 -- start start 2024-04-25T09:03:30.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.378+0000 7f7ac2000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7abc144f10 0x7f7abc15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.378+0000 7f7ac2000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7abc1452f0 0x7f7abc06ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.378+0000 7f7ac2000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7abc0720a0 con 0x7f7abc0ce420 2024-04-25T09:03:30.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.378+0000 7f7ac2000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7abc15fa40 con 0x7f7abc1452f0 2024-04-25T09:03:30.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.378+0000 7f7ac2000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7abc071490 con 0x7f7abc144f10 2024-04-25T09:03:30.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.378+0000 7f7abbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7abc1452f0 0x7f7abc06ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.378+0000 7f7ac1600640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f7abc0ce420 0x7f7abc15c220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46994/0 (socket says 172.21.15.173:46994) 2024-04-25T09:03:30.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.378+0000 7f7ac1600640 1 -- 172.21.15.173:0/1968748334 learned_addr learned my addr 172.21.15.173:0/1968748334 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:30.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.378+0000 7f7ac0c00640 1 --2- 172.21.15.173:0/1968748334 >> v2:172.21.15.194:3300/0 conn(0x7f7abc144f10 0x7f7abc15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.378+0000 7f7abbe00640 1 -- 172.21.15.173:0/1968748334 >> v2:172.21.15.194:3300/0 conn(0x7f7abc144f10 msgr2=0x7f7abc15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:30.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.378+0000 7f7abbe00640 1 --2- 172.21.15.173:0/1968748334 >> v2:172.21.15.194:3300/0 conn(0x7f7abc144f10 0x7f7abc15f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.378+0000 7f7abbe00640 1 -- 172.21.15.173:0/1968748334 >> v1:172.21.15.173:6789/0 conn(0x7f7abc0ce420 legacy=0x7f7abc15c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.378+0000 7f7abbe00640 1 -- 172.21.15.173:0/1968748334 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc071770 con 0x7f7abc1452f0 2024-04-25T09:03:30.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.378+0000 7f7abb400640 1 -- 172.21.15.173:0/1968748334 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016058055 0 0) 0x7f7abc0720a0 con 0x7f7abc0ce420 2024-04-25T09:03:30.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.378+0000 7f7abbe00640 1 --2- 172.21.15.173:0/1968748334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7abc1452f0 0x7f7abc06ea80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7abc072630 tx=0x7f7aa801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06bcf6aea511c35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.378+0000 7f7abb400640 1 -- 172.21.15.173:0/1968748334 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa80b0070 con 0x7f7abc1452f0 2024-04-25T09:03:30.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7abb400640 1 -- 172.21.15.173:0/1968748334 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa80ab600 con 0x7f7abc1452f0 2024-04-25T09:03:30.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7abb400640 1 -- 172.21.15.173:0/1968748334 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa80ab9d0 con 0x7f7abc1452f0 2024-04-25T09:03:30.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7ac2000640 1 -- 172.21.15.173:0/1968748334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7abc1452f0 msgr2=0x7f7abc06ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7ac2000640 1 --2- 172.21.15.173:0/1968748334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7abc1452f0 0x7f7abc06ea80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7abc072630 tx=0x7f7aa801c480 comp rx=0 tx=0).stop 2024-04-25T09:03:30.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7ac2000640 1 -- 172.21.15.173:0/1968748334 shutdown_connections 2024-04-25T09:03:30.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7ac2000640 1 --2- 172.21.15.173:0/1968748334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7abc1452f0 0x7f7abc06ea80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7ac2000640 1 --2- 172.21.15.173:0/1968748334 >> v2:172.21.15.194:3300/0 conn(0x7f7abc144f10 0x7f7abc15f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7ac2000640 1 -- 172.21.15.173:0/1968748334 >> 172.21.15.173:0/1968748334 conn(0x7f7abc061d40 msgr2=0x7f7abc06ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:30.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7ac2000640 1 -- 172.21.15.173:0/1968748334 shutdown_connections 2024-04-25T09:03:30.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7ac2000640 1 -- 172.21.15.173:0/1968748334 wait complete. 2024-04-25T09:03:30.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7ac2000640 1 Processor -- start 2024-04-25T09:03:30.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7ac2000640 1 -- start start 2024-04-25T09:03:30.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7ac2000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7abc0ce420 0x7f7abc12efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7ac2000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7abc144f10 0x7f7abc15d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7ac2000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7abc1452f0 0x7f7abc0caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7ac2000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc15cd40 con 0x7f7abc144f10 2024-04-25T09:03:30.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7ac2000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0cec60 con 0x7f7abc1452f0 2024-04-25T09:03:30.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7ac2000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc15cec0 con 0x7f7abc0ce420 2024-04-25T09:03:30.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7abbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7abc144f10 0x7f7abc15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7abbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7abc144f10 0x7f7abc15d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50114/0 (socket says 172.21.15.173:50114) 2024-04-25T09:03:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7abbe00640 1 -- 172.21.15.173:0/1301910464 learned_addr learned my addr 172.21.15.173:0/1301910464 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7ac0c00640 1 --2- 172.21.15.173:0/1301910464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7abc0ce420 0x7f7abc12efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7ac1600640 1 --2- 172.21.15.173:0/1301910464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7abc1452f0 0x7f7abc0caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7abbe00640 1 -- 172.21.15.173:0/1301910464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7abc0ce420 msgr2=0x7f7abc12efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7abbe00640 1 --2- 172.21.15.173:0/1301910464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7abc0ce420 0x7f7abc12efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7abbe00640 1 -- 172.21.15.173:0/1301910464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7abc1452f0 msgr2=0x7f7abc0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7abbe00640 1 --2- 172.21.15.173:0/1301910464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7abc1452f0 0x7f7abc0caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.382+0000 7f7abbe00640 1 -- 172.21.15.173:0/1301910464 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc141150 con 0x7f7abc144f10 2024-04-25T09:03:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.386+0000 7f7abbe00640 1 --2- 172.21.15.173:0/1301910464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7abc144f10 0x7f7abc15d630 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7aa801a0b0 tx=0x7f7aa8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.386+0000 7f7ab8c00640 1 -- 172.21.15.173:0/1301910464 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa80b0040 con 0x7f7abc144f10 2024-04-25T09:03:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.386+0000 7f7ab8c00640 1 -- 172.21.15.173:0/1301910464 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa80bd070 con 0x7f7abc144f10 2024-04-25T09:03:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.386+0000 7f7ac2000640 1 -- 172.21.15.173:0/1301910464 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc141410 con 0x7f7abc144f10 2024-04-25T09:03:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.386+0000 7f7ab8c00640 1 -- 172.21.15.173:0/1301910464 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa80b56a0 con 0x7f7abc144f10 2024-04-25T09:03:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.386+0000 7f7ac2000640 1 -- 172.21.15.173:0/1301910464 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc1419d0 con 0x7f7abc144f10 2024-04-25T09:03:30.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.386+0000 7f7ac2000640 1 -- 172.21.15.173:0/1301910464 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7abc073a40 con 0x7f7abc144f10 2024-04-25T09:03:30.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.386+0000 7f7ab8c00640 1 -- 172.21.15.173:0/1301910464 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7aa80b3070 con 0x7f7abc144f10 2024-04-25T09:03:30.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.386+0000 7f7ab8c00640 1 --2- 172.21.15.173:0/1301910464 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7a9c066f60 0x7f7a9c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.386+0000 7f7ab8c00640 1 -- 172.21.15.173:0/1301910464 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7aa811f680 con 0x7f7abc144f10 2024-04-25T09:03:30.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.386+0000 7f7ac0c00640 1 --2- 172.21.15.173:0/1301910464 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7a9c066f60 0x7f7a9c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.390+0000 7f7ac0c00640 1 --2- 172.21.15.173:0/1301910464 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7a9c066f60 0x7f7a9c069420 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000b930 tx=0x7f7ab0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.390+0000 7f7ab8c00640 1 -- 172.21.15.173:0/1301910464 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7aa8016070 con 0x7f7abc144f10 2024-04-25T09:03:30.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.546+0000 7f7ac2000640 1 -- 172.21.15.173:0/1301910464 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7abc1423b0 con 0x7f7abc144f10 2024-04-25T09:03:30.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.546+0000 7f7ab8c00640 1 -- 172.21.15.173:0/1301910464 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7aa80f0340 con 0x7f7abc144f10 2024-04-25T09:03:30.534 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:30.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.546+0000 7f7ac2000640 1 -- 172.21.15.173:0/1301910464 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7a9c066f60 msgr2=0x7f7a9c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.546+0000 7f7ac2000640 1 --2- 172.21.15.173:0/1301910464 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7a9c066f60 0x7f7a9c069420 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000b930 tx=0x7f7ab0008040 comp rx=0 tx=0).stop 2024-04-25T09:03:30.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.546+0000 7f7ac2000640 1 -- 172.21.15.173:0/1301910464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7abc144f10 msgr2=0x7f7abc15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.546+0000 7f7ac2000640 1 --2- 172.21.15.173:0/1301910464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7abc144f10 0x7f7abc15d630 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7aa801a0b0 tx=0x7f7aa8019220 comp rx=0 tx=0).stop 2024-04-25T09:03:30.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.546+0000 7f7ac2000640 1 -- 172.21.15.173:0/1301910464 shutdown_connections 2024-04-25T09:03:30.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.546+0000 7f7ac2000640 1 --2- 172.21.15.173:0/1301910464 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7a9c066f60 0x7f7a9c069420 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.546+0000 7f7ac2000640 1 --2- 172.21.15.173:0/1301910464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7abc1452f0 0x7f7abc0caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.546+0000 7f7ac2000640 1 --2- 172.21.15.173:0/1301910464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7abc144f10 0x7f7abc15d630 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.546+0000 7f7ac2000640 1 --2- 172.21.15.173:0/1301910464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7abc0ce420 0x7f7abc12efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.546+0000 7f7ac2000640 1 -- 172.21.15.173:0/1301910464 >> 172.21.15.173:0/1301910464 conn(0x7f7abc061d40 msgr2=0x7f7abc0b3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:30.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.546+0000 7f7ac2000640 1 -- 172.21.15.173:0/1301910464 shutdown_connections 2024-04-25T09:03:30.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.546+0000 7f7ac2000640 1 -- 172.21.15.173:0/1301910464 wait complete. 2024-04-25T09:03:30.555 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:30.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.702+0000 7fae29600640 1 Processor -- start 2024-04-25T09:03:30.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.702+0000 7fae29600640 1 -- start start 2024-04-25T09:03:30.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.702+0000 7fae29600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae240b3e70 0x7fae240b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.702+0000 7fae29600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fae240aefa0 0x7fae240b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.702+0000 7fae29600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae240b4790 con 0x7fae2415edd0 2024-04-25T09:03:30.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.702+0000 7fae29600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2406dd50 con 0x7fae240aefa0 2024-04-25T09:03:30.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.702+0000 7fae29600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2415f320 con 0x7fae240b3e70 2024-04-25T09:03:30.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.702+0000 7fae22000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fae240aefa0 0x7fae240b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.702+0000 7fae22000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fae240aefa0 0x7fae240b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50120/0 (socket says 172.21.15.173:50120) 2024-04-25T09:03:30.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.702+0000 7fae22000640 1 -- 172.21.15.173:0/681948448 learned_addr learned my addr 172.21.15.173:0/681948448 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:30.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.702+0000 7fae22a00640 1 --2- 172.21.15.173:0/681948448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae240b3e70 0x7fae240b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.706+0000 7fae22000640 1 -- 172.21.15.173:0/681948448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae240b3e70 msgr2=0x7fae240b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:30.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.706+0000 7fae22000640 1 --2- 172.21.15.173:0/681948448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae240b3e70 0x7fae240b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.706+0000 7fae22000640 1 -- 172.21.15.173:0/681948448 >> v1:172.21.15.194:6789/0 conn(0x7fae2415edd0 legacy=0x7fae240b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.706+0000 7fae22000640 1 -- 172.21.15.173:0/681948448 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2406d420 con 0x7fae240aefa0 2024-04-25T09:03:30.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.706+0000 7fae22000640 1 --2- 172.21.15.173:0/681948448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae240aefa0 0x7fae240b2770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fae10009870 tx=0x7fae1001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d157cd1a75147d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.706+0000 7fae21600640 1 -- 172.21.15.173:0/681948448 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae100a9610 con 0x7fae240aefa0 2024-04-25T09:03:30.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.706+0000 7fae21600640 1 -- 172.21.15.173:0/681948448 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae100a97b0 con 0x7fae240aefa0 2024-04-25T09:03:30.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.706+0000 7fae21600640 1 -- 172.21.15.173:0/681948448 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae100a9b80 con 0x7fae240aefa0 2024-04-25T09:03:30.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.706+0000 7fae29600640 1 -- 172.21.15.173:0/681948448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae240aefa0 msgr2=0x7fae240b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.706+0000 7fae29600640 1 --2- 172.21.15.173:0/681948448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae240aefa0 0x7fae240b2770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fae10009870 tx=0x7fae1001c530 comp rx=0 tx=0).stop 2024-04-25T09:03:30.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.706+0000 7fae29600640 1 -- 172.21.15.173:0/681948448 shutdown_connections 2024-04-25T09:03:30.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.706+0000 7fae29600640 1 --2- 172.21.15.173:0/681948448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae240aefa0 0x7fae240b2770 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.706+0000 7fae29600640 1 --2- 172.21.15.173:0/681948448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae240b3e70 0x7fae240b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.706+0000 7fae29600640 1 -- 172.21.15.173:0/681948448 >> 172.21.15.173:0/681948448 conn(0x7fae2406ac90 msgr2=0x7fae2406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:30.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae29600640 1 -- 172.21.15.173:0/681948448 shutdown_connections 2024-04-25T09:03:30.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae29600640 1 -- 172.21.15.173:0/681948448 wait complete. 2024-04-25T09:03:30.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae29600640 1 Processor -- start 2024-04-25T09:03:30.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae29600640 1 -- start start 2024-04-25T09:03:30.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae29600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae240aefa0 0x7fae240ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae29600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae240b3e70 0x7fae24150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae29600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae2415edd0 0x7fae240adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae29600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2406e1c0 con 0x7fae2415edd0 2024-04-25T09:03:30.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae29600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2415aba0 con 0x7fae240b3e70 2024-04-25T09:03:30.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae29600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2406e340 con 0x7fae240aefa0 2024-04-25T09:03:30.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae23400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae2415edd0 0x7fae240adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae23400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae2415edd0 0x7fae240adbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50134/0 (socket says 172.21.15.173:50134) 2024-04-25T09:03:30.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae23400640 1 -- 172.21.15.173:0/2085195806 learned_addr learned my addr 172.21.15.173:0/2085195806 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:30.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae22a00640 1 --2- 172.21.15.173:0/2085195806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae240aefa0 0x7fae240ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae22000640 1 --2- 172.21.15.173:0/2085195806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae240b3e70 0x7fae24150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae23400640 1 -- 172.21.15.173:0/2085195806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae240aefa0 msgr2=0x7fae240ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae23400640 1 --2- 172.21.15.173:0/2085195806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae240aefa0 0x7fae240ac120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae23400640 1 -- 172.21.15.173:0/2085195806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae240b3e70 msgr2=0x7fae24150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae23400640 1 --2- 172.21.15.173:0/2085195806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae240b3e70 0x7fae24150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae23400640 1 -- 172.21.15.173:0/2085195806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae240b1830 con 0x7fae2415edd0 2024-04-25T09:03:30.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae22000640 1 --2- 172.21.15.173:0/2085195806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae240b3e70 0x7fae24150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:30.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.710+0000 7fae23400640 1 --2- 172.21.15.173:0/2085195806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae2415edd0 0x7fae240adbb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00c460 tx=0x7fae1c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.714+0000 7fae1aa00640 1 -- 172.21.15.173:0/2085195806 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c005220 con 0x7fae2415edd0 2024-04-25T09:03:30.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.714+0000 7fae1aa00640 1 -- 172.21.15.173:0/2085195806 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1c0053c0 con 0x7fae2415edd0 2024-04-25T09:03:30.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.714+0000 7fae29600640 1 -- 172.21.15.173:0/2085195806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae240b1b10 con 0x7fae2415edd0 2024-04-25T09:03:30.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.714+0000 7fae1aa00640 1 -- 172.21.15.173:0/2085195806 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c007270 con 0x7fae2415edd0 2024-04-25T09:03:30.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.714+0000 7fae29600640 1 -- 172.21.15.173:0/2085195806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae240b20d0 con 0x7fae2415edd0 2024-04-25T09:03:30.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.714+0000 7fae29600640 1 -- 172.21.15.173:0/2085195806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae24073a40 con 0x7fae2415edd0 2024-04-25T09:03:30.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.714+0000 7fae1aa00640 1 -- 172.21.15.173:0/2085195806 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fae1c019020 con 0x7fae2415edd0 2024-04-25T09:03:30.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.714+0000 7fae1aa00640 1 --2- 172.21.15.173:0/2085195806 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fae04066f60 0x7fae04069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.714+0000 7fae1aa00640 1 -- 172.21.15.173:0/2085195806 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fae1c084770 con 0x7fae2415edd0 2024-04-25T09:03:30.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.714+0000 7fae22a00640 1 --2- 172.21.15.173:0/2085195806 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fae04066f60 0x7fae04069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.714+0000 7fae22a00640 1 --2- 172.21.15.173:0/2085195806 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fae04066f60 0x7fae04069420 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fae14009f60 tx=0x7fae1400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.718+0000 7fae1aa00640 1 -- 172.21.15.173:0/2085195806 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fae1c0553a0 con 0x7fae2415edd0 2024-04-25T09:03:30.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.878+0000 7fae29600640 1 -- 172.21.15.173:0/2085195806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae2406f1c0 con 0x7fae2415edd0 2024-04-25T09:03:30.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.878+0000 7fae1aa00640 1 -- 172.21.15.173:0/2085195806 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18574 (secure 0 0 0) 0x7fae1c054ca0 con 0x7fae2415edd0 2024-04-25T09:03:30.868 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:30.868 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:02:56.440593+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:30.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.882+0000 7fae29600640 1 -- 172.21.15.173:0/2085195806 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fae04066f60 msgr2=0x7fae04069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.882+0000 7fae29600640 1 --2- 172.21.15.173:0/2085195806 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fae04066f60 0x7fae04069420 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fae14009f60 tx=0x7fae1400b040 comp rx=0 tx=0).stop 2024-04-25T09:03:30.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.882+0000 7fae29600640 1 -- 172.21.15.173:0/2085195806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae2415edd0 msgr2=0x7fae240adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.882+0000 7fae29600640 1 --2- 172.21.15.173:0/2085195806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae2415edd0 0x7fae240adbb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00c460 tx=0x7fae1c00c920 comp rx=0 tx=0).stop 2024-04-25T09:03:30.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.882+0000 7fae29600640 1 -- 172.21.15.173:0/2085195806 shutdown_connections 2024-04-25T09:03:30.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.882+0000 7fae29600640 1 --2- 172.21.15.173:0/2085195806 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fae04066f60 0x7fae04069420 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.882+0000 7fae29600640 1 --2- 172.21.15.173:0/2085195806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae2415edd0 0x7fae240adbb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.882+0000 7fae29600640 1 --2- 172.21.15.173:0/2085195806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae240b3e70 0x7fae24150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.882+0000 7fae29600640 1 --2- 172.21.15.173:0/2085195806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae240aefa0 0x7fae240ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.882+0000 7fae29600640 1 -- 172.21.15.173:0/2085195806 >> 172.21.15.173:0/2085195806 conn(0x7fae2406ac90 msgr2=0x7fae240cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:30.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.882+0000 7fae29600640 1 -- 172.21.15.173:0/2085195806 shutdown_connections 2024-04-25T09:03:30.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:30.882+0000 7fae29600640 1 -- 172.21.15.173:0/2085195806 wait complete. 2024-04-25T09:03:30.890 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:02:49.342297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:02:50.386069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:02:54.077429+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:03:30.890 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:31.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.042+0000 7fd461600640 1 Processor -- start 2024-04-25T09:03:31.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.042+0000 7fd461600640 1 -- start start 2024-04-25T09:03:31.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.042+0000 7fd461600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd45c15b730 0x7fd45c0ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.042+0000 7fd461600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd45c06b3a0 0x7fd45c0cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.042+0000 7fd461600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45c073100 con 0x7fd45c0ca950 2024-04-25T09:03:31.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.042+0000 7fd461600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45c15f060 con 0x7fd45c06b3a0 2024-04-25T09:03:31.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.042+0000 7fd461600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45c15e450 con 0x7fd45c15b730 2024-04-25T09:03:31.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.042+0000 7fd45a000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd45c0ca950 0x7fd45c06ac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47002/0 (socket says 172.21.15.173:47002) 2024-04-25T09:03:31.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.042+0000 7fd45a000640 1 -- 172.21.15.173:0/844158 learned_addr learned my addr 172.21.15.173:0/844158 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:31.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.042+0000 7fd45b400640 1 --2- 172.21.15.173:0/844158 >> v2:172.21.15.173:3300/0 conn(0x7fd45c06b3a0 0x7fd45c0cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.042+0000 7fd45aa00640 1 --2- 172.21.15.173:0/844158 >> v2:172.21.15.194:3300/0 conn(0x7fd45c15b730 0x7fd45c0ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.042+0000 7fd459600640 1 -- 172.21.15.173:0/844158 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582030480 0 0) 0x7fd45c073100 con 0x7fd45c0ca950 2024-04-25T09:03:31.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.042+0000 7fd45b400640 1 -- 172.21.15.173:0/844158 >> v2:172.21.15.194:3300/0 conn(0x7fd45c15b730 msgr2=0x7fd45c0ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:31.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.042+0000 7fd45b400640 1 --2- 172.21.15.173:0/844158 >> v2:172.21.15.194:3300/0 conn(0x7fd45c15b730 0x7fd45c0ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.042+0000 7fd45b400640 1 -- 172.21.15.173:0/844158 >> v1:172.21.15.173:6789/0 conn(0x7fd45c0ca950 legacy=0x7fd45c06ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.042+0000 7fd45b400640 1 -- 172.21.15.173:0/844158 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c15e730 con 0x7fd45c06b3a0 2024-04-25T09:03:31.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.046+0000 7fd45b400640 1 --2- 172.21.15.173:0/844158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd45c06b3a0 0x7fd45c0cf700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd45c06d730 tx=0x7fd45401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6756282ff579e01e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.046+0000 7fd459600640 1 -- 172.21.15.173:0/844158 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540b2070 con 0x7fd45c06b3a0 2024-04-25T09:03:31.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.046+0000 7fd459600640 1 -- 172.21.15.173:0/844158 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4540a59c0 con 0x7fd45c06b3a0 2024-04-25T09:03:31.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.046+0000 7fd459600640 1 -- 172.21.15.173:0/844158 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540a5d90 con 0x7fd45c06b3a0 2024-04-25T09:03:31.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.046+0000 7fd461600640 1 -- 172.21.15.173:0/844158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd45c06b3a0 msgr2=0x7fd45c0cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.046+0000 7fd461600640 1 --2- 172.21.15.173:0/844158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd45c06b3a0 0x7fd45c0cf700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd45c06d730 tx=0x7fd45401c900 comp rx=0 tx=0).stop 2024-04-25T09:03:31.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.046+0000 7fd461600640 1 -- 172.21.15.173:0/844158 shutdown_connections 2024-04-25T09:03:31.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.046+0000 7fd461600640 1 --2- 172.21.15.173:0/844158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd45c06b3a0 0x7fd45c0cf700 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.046+0000 7fd461600640 1 --2- 172.21.15.173:0/844158 >> v2:172.21.15.194:3300/0 conn(0x7fd45c15b730 0x7fd45c0ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.046+0000 7fd461600640 1 -- 172.21.15.173:0/844158 >> 172.21.15.173:0/844158 conn(0x7fd45c0b23f0 msgr2=0x7fd45c0b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:31.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.046+0000 7fd461600640 1 -- 172.21.15.173:0/844158 shutdown_connections 2024-04-25T09:03:31.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.046+0000 7fd461600640 1 -- 172.21.15.173:0/844158 wait complete. 2024-04-25T09:03:31.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.046+0000 7fd461600640 1 Processor -- start 2024-04-25T09:03:31.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.046+0000 7fd461600640 1 -- start start 2024-04-25T09:03:31.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd461600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd45c06b3a0 0x7fd45c14eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd461600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd45c0ca950 0x7fd45c159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd461600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd45c15b730 0x7fd45c15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd461600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c16ab40 con 0x7fd45c15b730 2024-04-25T09:03:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd461600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c15bb10 con 0x7fd45c06b3a0 2024-04-25T09:03:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd461600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c16acc0 con 0x7fd45c0ca950 2024-04-25T09:03:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd45b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd45c15b730 0x7fd45c15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd45b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd45c15b730 0x7fd45c15a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50154/0 (socket says 172.21.15.173:50154) 2024-04-25T09:03:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd45b400640 1 -- 172.21.15.173:0/1549453033 learned_addr learned my addr 172.21.15.173:0/1549453033 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd45aa00640 1 --2- 172.21.15.173:0/1549453033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd45c06b3a0 0x7fd45c14eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd45a000640 1 --2- 172.21.15.173:0/1549453033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd45c0ca950 0x7fd45c159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd45b400640 1 -- 172.21.15.173:0/1549453033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd45c0ca950 msgr2=0x7fd45c159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd45b400640 1 --2- 172.21.15.173:0/1549453033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd45c0ca950 0x7fd45c159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd45b400640 1 -- 172.21.15.173:0/1549453033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd45c06b3a0 msgr2=0x7fd45c14eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd45b400640 1 --2- 172.21.15.173:0/1549453033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd45c06b3a0 0x7fd45c14eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd45b400640 1 -- 172.21.15.173:0/1549453033 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c0726f0 con 0x7fd45c15b730 2024-04-25T09:03:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd45b400640 1 --2- 172.21.15.173:0/1549453033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd45c15b730 0x7fd45c15a280 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd45401a530 tx=0x7fd4540196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd452a00640 1 -- 172.21.15.173:0/1549453033 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540b2050 con 0x7fd45c15b730 2024-04-25T09:03:31.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd452a00640 1 -- 172.21.15.173:0/1549453033 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4540be070 con 0x7fd45c15b730 2024-04-25T09:03:31.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd452a00640 1 -- 172.21.15.173:0/1549453033 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540ada90 con 0x7fd45c15b730 2024-04-25T09:03:31.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd461600640 1 -- 172.21.15.173:0/1549453033 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45c0cce90 con 0x7fd45c15b730 2024-04-25T09:03:31.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd461600640 1 -- 172.21.15.173:0/1549453033 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45c0cd450 con 0x7fd45c15b730 2024-04-25T09:03:31.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd461600640 1 -- 172.21.15.173:0/1549453033 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45c073ab0 con 0x7fd45c15b730 2024-04-25T09:03:31.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.050+0000 7fd452a00640 1 -- 172.21.15.173:0/1549453033 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd4540adc30 con 0x7fd45c15b730 2024-04-25T09:03:31.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.054+0000 7fd452a00640 1 --2- 172.21.15.173:0/1549453033 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd43c066f60 0x7fd43c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.054+0000 7fd452a00640 1 -- 172.21.15.173:0/1549453033 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd454120400 con 0x7fd45c15b730 2024-04-25T09:03:31.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.054+0000 7fd45aa00640 1 --2- 172.21.15.173:0/1549453033 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd43c066f60 0x7fd43c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.054+0000 7fd45aa00640 1 --2- 172.21.15.173:0/1549453033 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd43c066f60 0x7fd43c069420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0079c0 tx=0x7fd44c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.058+0000 7fd452a00640 1 -- 172.21.15.173:0/1549453033 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd454016520 con 0x7fd45c15b730 2024-04-25T09:03:31.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.222+0000 7fd461600640 1 -- 172.21.15.173:0/1549453033 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd45c0b69d0 con 0x7fd45c15b730 2024-04-25T09:03:31.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.222+0000 7fd452a00640 1 -- 172.21.15.173:0/1549453033 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd4540f0b10 con 0x7fd45c15b730 2024-04-25T09:03:31.211 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:03:31.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.222+0000 7fd461600640 1 -- 172.21.15.173:0/1549453033 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd43c066f60 msgr2=0x7fd43c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.222+0000 7fd461600640 1 --2- 172.21.15.173:0/1549453033 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd43c066f60 0x7fd43c069420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0079c0 tx=0x7fd44c008040 comp rx=0 tx=0).stop 2024-04-25T09:03:31.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.222+0000 7fd461600640 1 -- 172.21.15.173:0/1549453033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd45c15b730 msgr2=0x7fd45c15a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.222+0000 7fd461600640 1 --2- 172.21.15.173:0/1549453033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd45c15b730 0x7fd45c15a280 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd45401a530 tx=0x7fd4540196a0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.222+0000 7fd461600640 1 -- 172.21.15.173:0/1549453033 shutdown_connections 2024-04-25T09:03:31.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.222+0000 7fd461600640 1 --2- 172.21.15.173:0/1549453033 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd43c066f60 0x7fd43c069420 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.222+0000 7fd461600640 1 --2- 172.21.15.173:0/1549453033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd45c15b730 0x7fd45c15a280 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.222+0000 7fd461600640 1 --2- 172.21.15.173:0/1549453033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd45c0ca950 0x7fd45c159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.222+0000 7fd461600640 1 --2- 172.21.15.173:0/1549453033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd45c06b3a0 0x7fd45c14eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.222+0000 7fd461600640 1 -- 172.21.15.173:0/1549453033 >> 172.21.15.173:0/1549453033 conn(0x7fd45c0b23f0 msgr2=0x7fd45c160300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:31.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.222+0000 7fd461600640 1 -- 172.21.15.173:0/1549453033 shutdown_connections 2024-04-25T09:03:31.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.222+0000 7fd461600640 1 -- 172.21.15.173:0/1549453033 wait complete. 2024-04-25T09:03:31.232 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:31.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.382+0000 7f040b000640 1 Processor -- start 2024-04-25T09:03:31.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.382+0000 7f040b000640 1 -- start start 2024-04-25T09:03:31.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.382+0000 7f040b000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f040406f5b0 0x7f04040aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.382+0000 7f040b000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f04040ad3f0 0x7f04041677c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.382+0000 7f040b000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f040406f9f0 con 0x7f040406e1c0 2024-04-25T09:03:31.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.382+0000 7f040b000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04040b3170 con 0x7f04040ad3f0 2024-04-25T09:03:31.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.382+0000 7f040b000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040415e070 con 0x7f040406f5b0 2024-04-25T09:03:31.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.382+0000 7f0403e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f040406e1c0 0x7f040406bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47006/0 (socket says 172.21.15.173:47006) 2024-04-25T09:03:31.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.382+0000 7f0403e00640 1 -- 172.21.15.173:0/3663483043 learned_addr learned my addr 172.21.15.173:0/3663483043 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.382+0000 7f0409000640 1 --2- 172.21.15.173:0/3663483043 >> v2:172.21.15.173:3300/0 conn(0x7f04040ad3f0 0x7f04041677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.382+0000 7f0403400640 1 --2- 172.21.15.173:0/3663483043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f040406f5b0 0x7f04040aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.382+0000 7f0402a00640 1 -- 172.21.15.173:0/3663483043 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309674873 0 0) 0x7f040406f9f0 con 0x7f040406e1c0 2024-04-25T09:03:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.382+0000 7f0402a00640 1 -- 172.21.15.173:0/3663483043 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03e8003530 con 0x7f040406e1c0 2024-04-25T09:03:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.382+0000 7f0409000640 1 -- 172.21.15.173:0/3663483043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f040406f5b0 msgr2=0x7f04040aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.382+0000 7f0409000640 1 --2- 172.21.15.173:0/3663483043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f040406f5b0 0x7f04040aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.382+0000 7f0409000640 1 -- 172.21.15.173:0/3663483043 >> v1:172.21.15.173:6789/0 conn(0x7f040406e1c0 legacy=0x7f040406bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.382+0000 7f0409000640 1 -- 172.21.15.173:0/3663483043 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040406ae30 con 0x7f04040ad3f0 2024-04-25T09:03:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.382+0000 7f0403400640 1 --2- 172.21.15.173:0/3663483043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f040406f5b0 0x7f04040aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:31.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.386+0000 7f0409000640 1 --2- 172.21.15.173:0/3663483043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04040ad3f0 0x7f04041677c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f03fc009dc0 tx=0x7f03fc01f140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31c1367440ea965 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.386+0000 7f0402a00640 1 -- 172.21.15.173:0/3663483043 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc0b4070 con 0x7f04040ad3f0 2024-04-25T09:03:31.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.386+0000 7f0402a00640 1 -- 172.21.15.173:0/3663483043 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03fc0af600 con 0x7f04040ad3f0 2024-04-25T09:03:31.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.386+0000 7f0402a00640 1 -- 172.21.15.173:0/3663483043 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc0af9b0 con 0x7f04040ad3f0 2024-04-25T09:03:31.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.386+0000 7f040b000640 1 -- 172.21.15.173:0/3663483043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04040ad3f0 msgr2=0x7f04041677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.386+0000 7f040b000640 1 --2- 172.21.15.173:0/3663483043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04040ad3f0 0x7f04041677c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f03fc009dc0 tx=0x7f03fc01f140 comp rx=0 tx=0).stop 2024-04-25T09:03:31.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.386+0000 7f040b000640 1 -- 172.21.15.173:0/3663483043 shutdown_connections 2024-04-25T09:03:31.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.386+0000 7f040b000640 1 --2- 172.21.15.173:0/3663483043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04040ad3f0 0x7f04041677c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.386+0000 7f040b000640 1 --2- 172.21.15.173:0/3663483043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f040406f5b0 0x7f04040aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.386+0000 7f040b000640 1 -- 172.21.15.173:0/3663483043 >> 172.21.15.173:0/3663483043 conn(0x7f04040cfed0 msgr2=0x7f04040d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:31.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.386+0000 7f040b000640 1 -- 172.21.15.173:0/3663483043 shutdown_connections 2024-04-25T09:03:31.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.386+0000 7f040b000640 1 -- 172.21.15.173:0/3663483043 wait complete. 2024-04-25T09:03:31.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f040b000640 1 Processor -- start 2024-04-25T09:03:31.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f040b000640 1 -- start start 2024-04-25T09:03:31.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f040b000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f040406e1c0 0x7f040415ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f040b000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f040406f5b0 0x7f040415b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f040b000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04040ad3f0 0x7f0404145170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f040b000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040406b6d0 con 0x7f040406f5b0 2024-04-25T09:03:31.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f040b000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040406b3f0 con 0x7f04040ad3f0 2024-04-25T09:03:31.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f040b000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040406b9b0 con 0x7f040406e1c0 2024-04-25T09:03:31.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f0403400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f040406f5b0 0x7f040415b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f0403400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f040406f5b0 0x7f040415b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50166/0 (socket says 172.21.15.173:50166) 2024-04-25T09:03:31.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f0403400640 1 -- 172.21.15.173:0/569077871 learned_addr learned my addr 172.21.15.173:0/569077871 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:31.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f0403e00640 1 --2- 172.21.15.173:0/569077871 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f040406e1c0 0x7f040415ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f0409000640 1 --2- 172.21.15.173:0/569077871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04040ad3f0 0x7f0404145170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f0403400640 1 -- 172.21.15.173:0/569077871 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f040406e1c0 msgr2=0x7f040415ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f0403400640 1 --2- 172.21.15.173:0/569077871 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f040406e1c0 0x7f040415ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f0403400640 1 -- 172.21.15.173:0/569077871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04040ad3f0 msgr2=0x7f0404145170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f0403400640 1 --2- 172.21.15.173:0/569077871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04040ad3f0 0x7f0404145170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f0403400640 1 -- 172.21.15.173:0/569077871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040415b700 con 0x7f040406f5b0 2024-04-25T09:03:31.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f0403400640 1 --2- 172.21.15.173:0/569077871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f040406f5b0 0x7f040415b0d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f03f000e840 tx=0x7f03f000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f03fbe00640 1 -- 172.21.15.173:0/569077871 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f0017070 con 0x7f040406f5b0 2024-04-25T09:03:31.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f03fbe00640 1 -- 172.21.15.173:0/569077871 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f000c8d0 con 0x7f040406f5b0 2024-04-25T09:03:31.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f03fbe00640 1 -- 172.21.15.173:0/569077871 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f000f040 con 0x7f040406f5b0 2024-04-25T09:03:31.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f040b000640 1 -- 172.21.15.173:0/569077871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040415b9e0 con 0x7f040406f5b0 2024-04-25T09:03:31.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f040b000640 1 -- 172.21.15.173:0/569077871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04041544b0 con 0x7f040406f5b0 2024-04-25T09:03:31.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.390+0000 7f040b000640 1 -- 172.21.15.173:0/569077871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0404073ab0 con 0x7f040406f5b0 2024-04-25T09:03:31.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.394+0000 7f03fbe00640 1 -- 172.21.15.173:0/569077871 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f03f001a070 con 0x7f040406f5b0 2024-04-25T09:03:31.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.394+0000 7f03fbe00640 1 --2- 172.21.15.173:0/569077871 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f03e4066f60 0x7f03e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.394+0000 7f03fbe00640 1 -- 172.21.15.173:0/569077871 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f03f0084fe0 con 0x7f040406f5b0 2024-04-25T09:03:31.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.394+0000 7f0403e00640 1 --2- 172.21.15.173:0/569077871 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f03e4066f60 0x7f03e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.394+0000 7f0403e00640 1 --2- 172.21.15.173:0/569077871 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f03e4066f60 0x7f03e4069420 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f03f4007fd0 tx=0x7f03f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.398+0000 7f03fbe00640 1 -- 172.21.15.173:0/569077871 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f03f00510c0 con 0x7f040406f5b0 2024-04-25T09:03:31.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.550+0000 7f040b000640 1 -- 172.21.15.173:0/569077871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04040acfe0 con 0x7f040406f5b0 2024-04-25T09:03:31.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.550+0000 7f03fbe00640 1 -- 172.21.15.173:0/569077871 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f03f0055590 con 0x7f040406f5b0 2024-04-25T09:03:31.540 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.554+0000 7f040b000640 1 -- 172.21.15.173:0/569077871 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f03e4066f60 msgr2=0x7f03e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.554+0000 7f040b000640 1 --2- 172.21.15.173:0/569077871 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f03e4066f60 0x7f03e4069420 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f03f4007fd0 tx=0x7f03f4009040 comp rx=0 tx=0).stop 2024-04-25T09:03:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.554+0000 7f040b000640 1 -- 172.21.15.173:0/569077871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f040406f5b0 msgr2=0x7f040415b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.554+0000 7f040b000640 1 --2- 172.21.15.173:0/569077871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f040406f5b0 0x7f040415b0d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f03f000e840 tx=0x7f03f000ed00 comp rx=0 tx=0).stop 2024-04-25T09:03:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.554+0000 7f040b000640 1 -- 172.21.15.173:0/569077871 shutdown_connections 2024-04-25T09:03:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.554+0000 7f040b000640 1 --2- 172.21.15.173:0/569077871 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f03e4066f60 0x7f03e4069420 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.554+0000 7f040b000640 1 --2- 172.21.15.173:0/569077871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04040ad3f0 0x7f0404145170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.554+0000 7f040b000640 1 --2- 172.21.15.173:0/569077871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f040406f5b0 0x7f040415b0d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.554+0000 7f040b000640 1 --2- 172.21.15.173:0/569077871 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f040406e1c0 0x7f040415ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.554+0000 7f040b000640 1 -- 172.21.15.173:0/569077871 >> 172.21.15.173:0/569077871 conn(0x7f04040cfed0 msgr2=0x7f04040b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:31.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.554+0000 7f040b000640 1 -- 172.21.15.173:0/569077871 shutdown_connections 2024-04-25T09:03:31.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.554+0000 7f040b000640 1 -- 172.21.15.173:0/569077871 wait complete. 2024-04-25T09:03:31.561 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:31.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.710+0000 7efd4e400640 1 Processor -- start 2024-04-25T09:03:31.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.710+0000 7efd4e400640 1 -- start start 2024-04-25T09:03:31.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.710+0000 7efd4e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd480aeb90 0x7efd480cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.710+0000 7efd4e400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd48071570 con 0x7efd480aef70 2024-04-25T09:03:31.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.710+0000 7efd4e400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd48071850 con 0x7efd480ce2b0 2024-04-25T09:03:31.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.710+0000 7efd4e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd48071320 con 0x7efd480aeb90 2024-04-25T09:03:31.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.710+0000 7efd3ea00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7efd480aef70 0x7efd480cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47018/0 (socket says 172.21.15.173:47018) 2024-04-25T09:03:31.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.710+0000 7efd3ea00640 1 -- 172.21.15.173:0/903110761 learned_addr learned my addr 172.21.15.173:0/903110761 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:31.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.714+0000 7efd47400640 1 --2- 172.21.15.173:0/903110761 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd480aeb90 0x7efd480cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.714+0000 7efd46a00640 1 -- 172.21.15.173:0/903110761 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316728561 0 0) 0x7efd48071570 con 0x7efd480aef70 2024-04-25T09:03:31.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.714+0000 7efd46a00640 1 -- 172.21.15.173:0/903110761 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd2c003530 con 0x7efd480aef70 2024-04-25T09:03:31.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.714+0000 7efd47400640 1 -- 172.21.15.173:0/903110761 >> v1:172.21.15.194:6789/0 conn(0x7efd480ce2b0 legacy=0x7efd4815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.714+0000 7efd47400640 1 -- 172.21.15.173:0/903110761 >> v1:172.21.15.173:6789/0 conn(0x7efd480aef70 legacy=0x7efd480cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.714+0000 7efd46a00640 1 -- 172.21.15.173:0/903110761 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894643328 0 0) 0x7efd48071850 con 0x7efd480ce2b0 2024-04-25T09:03:31.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.714+0000 7efd47400640 1 -- 172.21.15.173:0/903110761 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd48071b30 con 0x7efd480aeb90 2024-04-25T09:03:31.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.714+0000 7efd47400640 1 --2- 172.21.15.173:0/903110761 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd480aeb90 0x7efd480cc0d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efd380097f0 tx=0x7efd3801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2942920c7dfb4abc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.714+0000 7efd46a00640 1 -- 172.21.15.173:0/903110761 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd380b0070 con 0x7efd480aeb90 2024-04-25T09:03:31.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.714+0000 7efd46a00640 1 -- 172.21.15.173:0/903110761 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd380ab600 con 0x7efd480aeb90 2024-04-25T09:03:31.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.714+0000 7efd46a00640 1 -- 172.21.15.173:0/903110761 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd380ab9b0 con 0x7efd480aeb90 2024-04-25T09:03:31.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd4e400640 1 -- 172.21.15.173:0/903110761 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd480aeb90 msgr2=0x7efd480cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd4e400640 1 --2- 172.21.15.173:0/903110761 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd480aeb90 0x7efd480cc0d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efd380097f0 tx=0x7efd3801c450 comp rx=0 tx=0).stop 2024-04-25T09:03:31.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd4e400640 1 -- 172.21.15.173:0/903110761 shutdown_connections 2024-04-25T09:03:31.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd4e400640 1 --2- 172.21.15.173:0/903110761 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd480aeb90 0x7efd480cc0d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd4e400640 1 -- 172.21.15.173:0/903110761 >> 172.21.15.173:0/903110761 conn(0x7efd4806ac90 msgr2=0x7efd4806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:31.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd4e400640 1 -- 172.21.15.173:0/903110761 shutdown_connections 2024-04-25T09:03:31.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd4e400640 1 -- 172.21.15.173:0/903110761 wait complete. 2024-04-25T09:03:31.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd4e400640 1 Processor -- start 2024-04-25T09:03:31.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd4e400640 1 -- start start 2024-04-25T09:03:31.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd4e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd480aeb90 0x7efd480cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd4e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd480aef70 0x7efd4814d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd4e400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd480ce2b0 0x7efd480adf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd4e400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd48168ac0 con 0x7efd480ce2b0 2024-04-25T09:03:31.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd4e400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd48168940 con 0x7efd480aeb90 2024-04-25T09:03:31.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd4e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd48168c40 con 0x7efd480aef70 2024-04-25T09:03:31.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd47e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd480ce2b0 0x7efd480adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd47e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd480ce2b0 0x7efd480adf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50172/0 (socket says 172.21.15.173:50172) 2024-04-25T09:03:31.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd47e00640 1 -- 172.21.15.173:0/3790695267 learned_addr learned my addr 172.21.15.173:0/3790695267 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:31.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd47e00640 1 -- 172.21.15.173:0/3790695267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd480aef70 msgr2=0x7efd4814d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd47e00640 1 --2- 172.21.15.173:0/3790695267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd480aef70 0x7efd4814d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd47e00640 1 -- 172.21.15.173:0/3790695267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd480aeb90 msgr2=0x7efd480cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd47e00640 1 --2- 172.21.15.173:0/3790695267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd480aeb90 0x7efd480cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd47e00640 1 -- 172.21.15.173:0/3790695267 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4814d8e0 con 0x7efd480ce2b0 2024-04-25T09:03:31.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.718+0000 7efd47e00640 1 --2- 172.21.15.173:0/3790695267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd480ce2b0 0x7efd480adf00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efd4000c780 tx=0x7efd4000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.722+0000 7efd3fe00640 1 -- 172.21.15.173:0/3790695267 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40003db0 con 0x7efd480ce2b0 2024-04-25T09:03:31.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.722+0000 7efd3fe00640 1 -- 172.21.15.173:0/3790695267 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd40005070 con 0x7efd480ce2b0 2024-04-25T09:03:31.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.722+0000 7efd4e400640 1 -- 172.21.15.173:0/3790695267 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd480ae440 con 0x7efd480ce2b0 2024-04-25T09:03:31.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.722+0000 7efd3fe00640 1 -- 172.21.15.173:0/3790695267 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40005460 con 0x7efd480ce2b0 2024-04-25T09:03:31.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.722+0000 7efd4e400640 1 -- 172.21.15.173:0/3790695267 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd480b1e00 con 0x7efd480ce2b0 2024-04-25T09:03:31.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.722+0000 7efd4e400640 1 -- 172.21.15.173:0/3790695267 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd48073ab0 con 0x7efd480ce2b0 2024-04-25T09:03:31.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.722+0000 7efd3fe00640 1 -- 172.21.15.173:0/3790695267 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efd40005600 con 0x7efd480ce2b0 2024-04-25T09:03:31.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.722+0000 7efd3fe00640 1 --2- 172.21.15.173:0/3790695267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd24066f60 0x7efd24069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.722+0000 7efd3fe00640 1 -- 172.21.15.173:0/3790695267 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7efd400853e0 con 0x7efd480ce2b0 2024-04-25T09:03:31.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.722+0000 7efd47400640 1 --2- 172.21.15.173:0/3790695267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd24066f60 0x7efd24069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.722+0000 7efd47400640 1 --2- 172.21.15.173:0/3790695267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd24066f60 0x7efd24069420 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd380ad000 tx=0x7efd38008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.726+0000 7efd3fe00640 1 -- 172.21.15.173:0/3790695267 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efd40055fe0 con 0x7efd480ce2b0 2024-04-25T09:03:31.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.878+0000 7efd4e400640 1 -- 172.21.15.173:0/3790695267 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efd4806c300 con 0x7efd480ce2b0 2024-04-25T09:03:31.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.878+0000 7efd3fe00640 1 -- 172.21.15.173:0/3790695267 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7efd400558e0 con 0x7efd480ce2b0 2024-04-25T09:03:31.872 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:03:31.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.882+0000 7efd4e400640 1 -- 172.21.15.173:0/3790695267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd24066f60 msgr2=0x7efd24069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.882+0000 7efd4e400640 1 --2- 172.21.15.173:0/3790695267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd24066f60 0x7efd24069420 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd380ad000 tx=0x7efd38008040 comp rx=0 tx=0).stop 2024-04-25T09:03:31.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.882+0000 7efd4e400640 1 -- 172.21.15.173:0/3790695267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd480ce2b0 msgr2=0x7efd480adf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.882+0000 7efd4e400640 1 --2- 172.21.15.173:0/3790695267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd480ce2b0 0x7efd480adf00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efd4000c780 tx=0x7efd4000cc40 comp rx=0 tx=0).stop 2024-04-25T09:03:31.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.882+0000 7efd4e400640 1 -- 172.21.15.173:0/3790695267 shutdown_connections 2024-04-25T09:03:31.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.882+0000 7efd4e400640 1 --2- 172.21.15.173:0/3790695267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd24066f60 0x7efd24069420 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.882+0000 7efd4e400640 1 --2- 172.21.15.173:0/3790695267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd480ce2b0 0x7efd480adf00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.882+0000 7efd4e400640 1 --2- 172.21.15.173:0/3790695267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd480aef70 0x7efd4814d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.882+0000 7efd4e400640 1 --2- 172.21.15.173:0/3790695267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd480aeb90 0x7efd480cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.882+0000 7efd4e400640 1 -- 172.21.15.173:0/3790695267 >> 172.21.15.173:0/3790695267 conn(0x7efd4806ac90 msgr2=0x7efd480b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:31.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.882+0000 7efd4e400640 1 -- 172.21.15.173:0/3790695267 shutdown_connections 2024-04-25T09:03:31.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:31.882+0000 7efd4e400640 1 -- 172.21.15.173:0/3790695267 wait complete. 2024-04-25T09:03:31.890 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:03:32.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f6472600640 1 Processor -- start 2024-04-25T09:03:32.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f6472600640 1 -- start start 2024-04-25T09:03:32.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f6472600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f646c0b2710 0x7f646c09a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f6472600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f646c0cc150 0x7f646c0cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f6472600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646c0cf3e0 con 0x7f646c15fd70 2024-04-25T09:03:32.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f6472600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646c0b0fb0 con 0x7f646c0b2710 2024-04-25T09:03:32.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f6472600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646c0cdd60 con 0x7f646c0cc150 2024-04-25T09:03:32.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f6471200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f646c15fd70 0x7f646c099a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47028/0 (socket says 172.21.15.173:47028) 2024-04-25T09:03:32.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f6471200640 1 -- 172.21.15.173:0/4277175006 learned_addr learned my addr 172.21.15.173:0/4277175006 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:32.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f6471c00640 1 --2- 172.21.15.173:0/4277175006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f646c0cc150 0x7f646c0cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646be00640 1 --2- 172.21.15.173:0/4277175006 >> v2:172.21.15.194:3300/0 conn(0x7f646c0b2710 0x7f646c09a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646b400640 1 -- 172.21.15.173:0/4277175006 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565671467 0 0) 0x7f646c0cf3e0 con 0x7f646c15fd70 2024-04-25T09:03:32.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646b400640 1 -- 172.21.15.173:0/4277175006 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6454003530 con 0x7f646c15fd70 2024-04-25T09:03:32.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646b400640 1 -- 172.21.15.173:0/4277175006 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1359391399 0 0) 0x7f6454003530 con 0x7f646c15fd70 2024-04-25T09:03:32.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646b400640 1 -- 172.21.15.173:0/4277175006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f646c0cc150 msgr2=0x7f646c0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:32.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646b400640 1 --2- 172.21.15.173:0/4277175006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f646c0cc150 0x7f646c0cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646b400640 1 -- 172.21.15.173:0/4277175006 >> v2:172.21.15.194:3300/0 conn(0x7f646c0b2710 msgr2=0x7f646c09a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:32.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646b400640 1 --2- 172.21.15.173:0/4277175006 >> v2:172.21.15.194:3300/0 conn(0x7f646c0b2710 0x7f646c09a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646b400640 1 -- 172.21.15.173:0/4277175006 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c0b11e0 con 0x7f646c15fd70 2024-04-25T09:03:32.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646b400640 1 -- 172.21.15.173:0/4277175006 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f64600016a0 con 0x7f646c15fd70 2024-04-25T09:03:32.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646b400640 1 -- 172.21.15.173:0/4277175006 >> v1:172.21.15.173:6789/0 conn(0x7f646c15fd70 legacy=0x7f646c099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646b400640 1 --2- 172.21.15.173:0/4277175006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f646c0cc150 0x7f64540039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646b400640 1 --2- 172.21.15.173:0/4277175006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6454003f90 0x7f6454004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646b400640 1 --2- 172.21.15.173:0/4277175006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6454004d50 0x7f64540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646b400640 1 -- 172.21.15.173:0/4277175006 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c0cdd60 con 0x7f6454003f90 2024-04-25T09:03:32.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646b400640 1 -- 172.21.15.173:0/4277175006 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645400b9d0 con 0x7f6454004d50 2024-04-25T09:03:32.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646b400640 1 -- 172.21.15.173:0/4277175006 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645400bb50 con 0x7f646c0cc150 2024-04-25T09:03:32.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f6471200640 1 --2- 172.21.15.173:0/4277175006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f646c0cc150 0x7f64540039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646be00640 1 --2- 172.21.15.173:0/4277175006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6454003f90 0x7f6454004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f6471c00640 1 --2- 172.21.15.173:0/4277175006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6454004d50 0x7f64540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646be00640 1 -- 172.21.15.173:0/4277175006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f646c0cc150 msgr2=0x7f64540039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:32.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646be00640 1 --2- 172.21.15.173:0/4277175006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f646c0cc150 0x7f64540039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646be00640 1 -- 172.21.15.173:0/4277175006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6454004d50 msgr2=0x7f64540051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:32.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646be00640 1 --2- 172.21.15.173:0/4277175006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6454004d50 0x7f64540051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.042+0000 7f646be00640 1 -- 172.21.15.173:0/4277175006 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6454003530 con 0x7f6454003f90 2024-04-25T09:03:32.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.046+0000 7f646be00640 1 --2- 172.21.15.173:0/4277175006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6454003f90 0x7f6454004810 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6458010b00 tx=0x7f6458020af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02d6299a696d55e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:32.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.046+0000 7f646b400640 1 -- 172.21.15.173:0/4277175006 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64580b6070 con 0x7f6454003f90 2024-04-25T09:03:32.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.046+0000 7f646b400640 1 -- 172.21.15.173:0/4277175006 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64580a98f0 con 0x7f6454003f90 2024-04-25T09:03:32.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.046+0000 7f646b400640 1 -- 172.21.15.173:0/4277175006 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6458010750 con 0x7f6454003f90 2024-04-25T09:03:32.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.046+0000 7f6472600640 1 -- 172.21.15.173:0/4277175006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6454003f90 msgr2=0x7f6454004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.046+0000 7f6472600640 1 --2- 172.21.15.173:0/4277175006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6454003f90 0x7f6454004810 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6458010b00 tx=0x7f6458020af0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.046+0000 7f6471c00640 1 -- 172.21.15.173:0/4277175006 reap_dead start 2024-04-25T09:03:32.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.046+0000 7f6472600640 1 -- 172.21.15.173:0/4277175006 shutdown_connections 2024-04-25T09:03:32.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.046+0000 7f6472600640 1 -- 172.21.15.173:0/4277175006 >> 172.21.15.173:0/4277175006 conn(0x7f646c0b3260 msgr2=0x7f646c0b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:32.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.046+0000 7f6472600640 1 -- 172.21.15.173:0/4277175006 shutdown_connections 2024-04-25T09:03:32.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.046+0000 7f6472600640 1 -- 172.21.15.173:0/4277175006 wait complete. 2024-04-25T09:03:32.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6472600640 1 Processor -- start 2024-04-25T09:03:32.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6472600640 1 -- start start 2024-04-25T09:03:32.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6472600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6454003f90 0x7f646c0af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6472600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f646c14ba70 0x7f646c159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6472600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f646c15a220 0x7f646c0afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6472600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c1602d0 con 0x7f646c15a220 2024-04-25T09:03:32.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6472600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c160150 con 0x7f6454003f90 2024-04-25T09:03:32.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6472600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646c09af20 con 0x7f646c14ba70 2024-04-25T09:03:32.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6471c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f646c15a220 0x7f646c0afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6471c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f646c15a220 0x7f646c0afee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50184/0 (socket says 172.21.15.173:50184) 2024-04-25T09:03:32.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6471c00640 1 -- 172.21.15.173:0/594201434 learned_addr learned my addr 172.21.15.173:0/594201434 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:32.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6471200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6454003f90 0x7f646c0af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f646be00640 1 --2- 172.21.15.173:0/594201434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f646c14ba70 0x7f646c159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6471c00640 1 -- 172.21.15.173:0/594201434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f646c14ba70 msgr2=0x7f646c159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6471c00640 1 --2- 172.21.15.173:0/594201434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f646c14ba70 0x7f646c159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6471c00640 1 -- 172.21.15.173:0/594201434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6454003f90 msgr2=0x7f646c0af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6471c00640 1 --2- 172.21.15.173:0/594201434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6454003f90 0x7f646c0af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6471c00640 1 -- 172.21.15.173:0/594201434 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c0b0af0 con 0x7f646c15a220 2024-04-25T09:03:32.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6471c00640 1 --2- 172.21.15.173:0/594201434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f646c15a220 0x7f646c0afee0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f646c072b20 tx=0x7f646400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:32.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6468c00640 1 -- 172.21.15.173:0/594201434 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646400fd80 con 0x7f646c15a220 2024-04-25T09:03:32.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6468c00640 1 -- 172.21.15.173:0/594201434 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6464015430 con 0x7f646c15a220 2024-04-25T09:03:32.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6468c00640 1 -- 172.21.15.173:0/594201434 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6464015820 con 0x7f646c15a220 2024-04-25T09:03:32.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6472600640 1 -- 172.21.15.173:0/594201434 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646c0ae4a0 con 0x7f646c15a220 2024-04-25T09:03:32.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.050+0000 7f6472600640 1 -- 172.21.15.173:0/594201434 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646c0aea60 con 0x7f646c15a220 2024-04-25T09:03:32.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.054+0000 7f6472600640 1 -- 172.21.15.173:0/594201434 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646c0b3fc0 con 0x7f646c15a220 2024-04-25T09:03:32.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.054+0000 7f6468c00640 1 -- 172.21.15.173:0/594201434 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f64640159c0 con 0x7f646c15a220 2024-04-25T09:03:32.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.054+0000 7f6468c00640 1 --2- 172.21.15.173:0/594201434 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f644c066f90 0x7f644c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.054+0000 7f6468c00640 1 -- 172.21.15.173:0/594201434 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6464085fc0 con 0x7f646c15a220 2024-04-25T09:03:32.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.054+0000 7f6471200640 1 --2- 172.21.15.173:0/594201434 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f644c066f90 0x7f644c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.054+0000 7f6471200640 1 --2- 172.21.15.173:0/594201434 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f644c066f90 0x7f644c069450 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6460001c60 tx=0x7f6460001e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:32.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.058+0000 7f6468c00640 1 -- 172.21.15.173:0/594201434 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6464019030 con 0x7f646c15a220 2024-04-25T09:03:32.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.218+0000 7f6472600640 1 -- 172.21.15.173:0/594201434 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f646c15c250 con 0x7f646c15a220 2024-04-25T09:03:32.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.218+0000 7f6468c00640 1 -- 172.21.15.173:0/594201434 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6464010040 con 0x7f646c15a220 2024-04-25T09:03:32.209 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:32.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.222+0000 7f6472600640 1 -- 172.21.15.173:0/594201434 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f644c066f90 msgr2=0x7f644c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.222+0000 7f6472600640 1 --2- 172.21.15.173:0/594201434 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f644c066f90 0x7f644c069450 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6460001c60 tx=0x7f6460001e40 comp rx=0 tx=0).stop 2024-04-25T09:03:32.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.222+0000 7f6472600640 1 -- 172.21.15.173:0/594201434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f646c15a220 msgr2=0x7f646c0afee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.222+0000 7f6472600640 1 --2- 172.21.15.173:0/594201434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f646c15a220 0x7f646c0afee0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f646c072b20 tx=0x7f646400f580 comp rx=0 tx=0).stop 2024-04-25T09:03:32.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.222+0000 7f6472600640 1 -- 172.21.15.173:0/594201434 shutdown_connections 2024-04-25T09:03:32.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.222+0000 7f6472600640 1 --2- 172.21.15.173:0/594201434 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f644c066f90 0x7f644c069450 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.222+0000 7f6472600640 1 --2- 172.21.15.173:0/594201434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f646c15a220 0x7f646c0afee0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.222+0000 7f6472600640 1 --2- 172.21.15.173:0/594201434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f646c14ba70 0x7f646c159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.222+0000 7f6472600640 1 --2- 172.21.15.173:0/594201434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6454003f90 0x7f646c0af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.222+0000 7f6472600640 1 -- 172.21.15.173:0/594201434 >> 172.21.15.173:0/594201434 conn(0x7f646c0b3260 msgr2=0x7f646c0b2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:32.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.222+0000 7f6472600640 1 -- 172.21.15.173:0/594201434 shutdown_connections 2024-04-25T09:03:32.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.222+0000 7f6472600640 1 -- 172.21.15.173:0/594201434 wait complete. 2024-04-25T09:03:32.230 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:32.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.374+0000 7f9d7de00640 1 Processor -- start 2024-04-25T09:03:32.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.374+0000 7f9d7de00640 1 -- start start 2024-04-25T09:03:32.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.378+0000 7f9d7de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9d780b3e70 0x7f9d780b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.378+0000 7f9d7de00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9d7815edd0 0x7f9d780b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.378+0000 7f9d7de00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d780b4790 con 0x7f9d780aefa0 2024-04-25T09:03:32.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.378+0000 7f9d7de00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7806dd50 con 0x7f9d7815edd0 2024-04-25T09:03:32.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.378+0000 7f9d7de00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7815f320 con 0x7f9d780b3e70 2024-04-25T09:03:32.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.378+0000 7f9d77400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9d7815edd0 0x7f9d780b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.378+0000 7f9d77400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9d7815edd0 0x7f9d780b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50192/0 (socket says 172.21.15.173:50192) 2024-04-25T09:03:32.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.378+0000 7f9d77400640 1 -- 172.21.15.173:0/3059898502 learned_addr learned my addr 172.21.15.173:0/3059898502 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:32.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.378+0000 7f9d76a00640 1 --2- 172.21.15.173:0/3059898502 >> v2:172.21.15.194:3300/0 conn(0x7f9d780b3e70 0x7f9d780b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.378+0000 7f9d77400640 1 -- 172.21.15.173:0/3059898502 >> v2:172.21.15.194:3300/0 conn(0x7f9d780b3e70 msgr2=0x7f9d780b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:32.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.378+0000 7f9d77400640 1 --2- 172.21.15.173:0/3059898502 >> v2:172.21.15.194:3300/0 conn(0x7f9d780b3e70 0x7f9d780b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.378+0000 7f9d77400640 1 -- 172.21.15.173:0/3059898502 >> v1:172.21.15.194:6789/0 conn(0x7f9d780aefa0 legacy=0x7f9d780b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:32.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.378+0000 7f9d77400640 1 -- 172.21.15.173:0/3059898502 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7806d420 con 0x7f9d7815edd0 2024-04-25T09:03:32.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d77400640 1 --2- 172.21.15.173:0/3059898502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d7815edd0 0x7f9d780b2e80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9d7806bca0 tx=0x7f9d7001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf1ac43a9030769 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:32.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d76000640 1 -- 172.21.15.173:0/3059898502 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700a5860 con 0x7f9d7815edd0 2024-04-25T09:03:32.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d76000640 1 -- 172.21.15.173:0/3059898502 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d700a5a00 con 0x7f9d7815edd0 2024-04-25T09:03:32.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d76000640 1 -- 172.21.15.173:0/3059898502 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700a5dd0 con 0x7f9d7815edd0 2024-04-25T09:03:32.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d7de00640 1 -- 172.21.15.173:0/3059898502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d7815edd0 msgr2=0x7f9d780b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d7de00640 1 --2- 172.21.15.173:0/3059898502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d7815edd0 0x7f9d780b2e80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9d7806bca0 tx=0x7f9d7001c980 comp rx=0 tx=0).stop 2024-04-25T09:03:32.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d7de00640 1 -- 172.21.15.173:0/3059898502 shutdown_connections 2024-04-25T09:03:32.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d7de00640 1 --2- 172.21.15.173:0/3059898502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d7815edd0 0x7f9d780b2e80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d7de00640 1 --2- 172.21.15.173:0/3059898502 >> v2:172.21.15.194:3300/0 conn(0x7f9d780b3e70 0x7f9d780b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d7de00640 1 -- 172.21.15.173:0/3059898502 >> 172.21.15.173:0/3059898502 conn(0x7f9d7806ac90 msgr2=0x7f9d7806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:32.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d7de00640 1 -- 172.21.15.173:0/3059898502 shutdown_connections 2024-04-25T09:03:32.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d7de00640 1 -- 172.21.15.173:0/3059898502 wait complete. 2024-04-25T09:03:32.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d7de00640 1 Processor -- start 2024-04-25T09:03:32.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d7de00640 1 -- start start 2024-04-25T09:03:32.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d7de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d780aefa0 0x7f9d78149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d7de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d780b3e70 0x7f9d7815b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d7de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d7815edd0 0x7f9d781677a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d7de00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7806e1c0 con 0x7f9d7815edd0 2024-04-25T09:03:32.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d7de00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7815aba0 con 0x7f9d780aefa0 2024-04-25T09:03:32.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.382+0000 7f9d7de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7806e340 con 0x7f9d780b3e70 2024-04-25T09:03:32.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d77400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d7815edd0 0x7f9d781677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d77400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d7815edd0 0x7f9d781677a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50200/0 (socket says 172.21.15.173:50200) 2024-04-25T09:03:32.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d77400640 1 -- 172.21.15.173:0/739813669 learned_addr learned my addr 172.21.15.173:0/739813669 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:32.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d76a00640 1 --2- 172.21.15.173:0/739813669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d780aefa0 0x7f9d78149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d6e000640 1 --2- 172.21.15.173:0/739813669 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d780b3e70 0x7f9d7815b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d77400640 1 -- 172.21.15.173:0/739813669 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d780b3e70 msgr2=0x7f9d7815b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d77400640 1 --2- 172.21.15.173:0/739813669 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d780b3e70 0x7f9d7815b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d77400640 1 -- 172.21.15.173:0/739813669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d780aefa0 msgr2=0x7f9d78149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d77400640 1 --2- 172.21.15.173:0/739813669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d780aefa0 0x7f9d78149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d77400640 1 -- 172.21.15.173:0/739813669 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d78149580 con 0x7f9d7815edd0 2024-04-25T09:03:32.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d6e000640 1 --2- 172.21.15.173:0/739813669 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d780b3e70 0x7f9d7815b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:32.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d77400640 1 --2- 172.21.15.173:0/739813669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d7815edd0 0x7f9d781677a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9d7001b030 tx=0x7f9d70019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:32.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d6fe00640 1 -- 172.21.15.173:0/739813669 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700b8880 con 0x7f9d7815edd0 2024-04-25T09:03:32.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d6fe00640 1 -- 172.21.15.173:0/739813669 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d700be070 con 0x7f9d7815edd0 2024-04-25T09:03:32.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d7de00640 1 -- 172.21.15.173:0/739813669 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d781669e0 con 0x7f9d7815edd0 2024-04-25T09:03:32.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d6fe00640 1 -- 172.21.15.173:0/739813669 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700b8c60 con 0x7f9d7815edd0 2024-04-25T09:03:32.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d7de00640 1 -- 172.21.15.173:0/739813669 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d78166fa0 con 0x7f9d7815edd0 2024-04-25T09:03:32.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d7de00640 1 -- 172.21.15.173:0/739813669 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d78073a40 con 0x7f9d7815edd0 2024-04-25T09:03:32.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.386+0000 7f9d6fe00640 1 -- 172.21.15.173:0/739813669 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9d700c3460 con 0x7f9d7815edd0 2024-04-25T09:03:32.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.390+0000 7f9d6fe00640 1 --2- 172.21.15.173:0/739813669 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9d54066f60 0x7f9d54069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.390+0000 7f9d6fe00640 1 -- 172.21.15.173:0/739813669 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f9d70120410 con 0x7f9d7815edd0 2024-04-25T09:03:32.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.390+0000 7f9d76a00640 1 --2- 172.21.15.173:0/739813669 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9d54066f60 0x7f9d54069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.390+0000 7f9d76a00640 1 --2- 172.21.15.173:0/739813669 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9d54066f60 0x7f9d54069420 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9d680079c0 tx=0x7f9d68008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:32.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.394+0000 7f9d6fe00640 1 -- 172.21.15.173:0/739813669 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9d700c8020 con 0x7f9d7815edd0 2024-04-25T09:03:32.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.550+0000 7f9d7de00640 1 -- 172.21.15.173:0/739813669 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d7814f500 con 0x7f9d7815edd0 2024-04-25T09:03:32.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.550+0000 7f9d6fe00640 1 -- 172.21.15.173:0/739813669 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18906 (secure 0 0 0) 0x7f9d78149580 con 0x7f9d7815edd0 2024-04-25T09:03:32.540 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:32.541 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":28,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:03:32.190313+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:32.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.554+0000 7f9d7de00640 1 -- 172.21.15.173:0/739813669 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9d54066f60 msgr2=0x7f9d54069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.554+0000 7f9d7de00640 1 --2- 172.21.15.173:0/739813669 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9d54066f60 0x7f9d54069420 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9d680079c0 tx=0x7f9d68008040 comp rx=0 tx=0).stop 2024-04-25T09:03:32.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.554+0000 7f9d7de00640 1 -- 172.21.15.173:0/739813669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d7815edd0 msgr2=0x7f9d781677a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.554+0000 7f9d7de00640 1 --2- 172.21.15.173:0/739813669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d7815edd0 0x7f9d781677a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9d7001b030 tx=0x7f9d70019720 comp rx=0 tx=0).stop 2024-04-25T09:03:32.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.554+0000 7f9d7de00640 1 -- 172.21.15.173:0/739813669 shutdown_connections 2024-04-25T09:03:32.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.554+0000 7f9d7de00640 1 --2- 172.21.15.173:0/739813669 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9d54066f60 0x7f9d54069420 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.554+0000 7f9d7de00640 1 --2- 172.21.15.173:0/739813669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d7815edd0 0x7f9d781677a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.554+0000 7f9d7de00640 1 --2- 172.21.15.173:0/739813669 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d780b3e70 0x7f9d7815b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.554+0000 7f9d7de00640 1 --2- 172.21.15.173:0/739813669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d780aefa0 0x7f9d78149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.554+0000 7f9d7de00640 1 -- 172.21.15.173:0/739813669 >> 172.21.15.173:0/739813669 conn(0x7f9d7806ac90 msgr2=0x7f9d781508f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:32.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.554+0000 7f9d7de00640 1 -- 172.21.15.173:0/739813669 shutdown_connections 2024-04-25T09:03:32.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.554+0000 7f9d7de00640 1 -- 172.21.15.173:0/739813669 wait complete. 2024-04-25T09:03:32.563 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:02:49.342297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:02:50.386069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:02:54.077429+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:03:32.564 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:32.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa31d400640 1 Processor -- start 2024-04-25T09:03:32.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa31d400640 1 -- start start 2024-04-25T09:03:32.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa31d400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa3180aeb90 0x7fa3180cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa31d400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3180aef70 0x7fa3180cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa31d400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa3180cdba0 0x7fa3180ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa31d400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa318071320 con 0x7fa3180aeb90 2024-04-25T09:03:32.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa31d400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa318072330 con 0x7fa3180cdba0 2024-04-25T09:03:32.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa31d400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180ce550 con 0x7fa3180aef70 2024-04-25T09:03:32.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa316800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa3180aeb90 0x7fa3180cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa316800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa3180aeb90 0x7fa3180cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50210/0 (socket says 172.21.15.173:50210) 2024-04-25T09:03:32.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa316800640 1 -- 172.21.15.173:0/3136270187 learned_addr learned my addr 172.21.15.173:0/3136270187 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:32.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa317200640 1 --2- 172.21.15.173:0/3136270187 >> v2:172.21.15.194:3300/0 conn(0x7fa3180cdba0 0x7fa3180ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa30de00640 1 --2- 172.21.15.173:0/3136270187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3180aef70 0x7fa3180cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa316800640 1 -- 172.21.15.173:0/3136270187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3180aef70 msgr2=0x7fa3180cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:32.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa316800640 1 --2- 172.21.15.173:0/3136270187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3180aef70 0x7fa3180cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa316800640 1 -- 172.21.15.173:0/3136270187 >> v2:172.21.15.194:3300/0 conn(0x7fa3180cdba0 msgr2=0x7fa3180ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:32.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa316800640 1 --2- 172.21.15.173:0/3136270187 >> v2:172.21.15.194:3300/0 conn(0x7fa3180cdba0 0x7fa3180ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa316800640 1 -- 172.21.15.173:0/3136270187 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa318071570 con 0x7fa3180aeb90 2024-04-25T09:03:32.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.714+0000 7fa30de00640 1 --2- 172.21.15.173:0/3136270187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3180aef70 0x7fa3180cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:32.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.718+0000 7fa316800640 1 --2- 172.21.15.173:0/3136270187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3180aeb90 0x7fa3180cc0d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa3180712b0 tx=0x7fa30801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8acbf09a7c0a1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:32.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.718+0000 7fa315e00640 1 -- 172.21.15.173:0/3136270187 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3080ab620 con 0x7fa3180aeb90 2024-04-25T09:03:32.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.718+0000 7fa315e00640 1 -- 172.21.15.173:0/3136270187 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3080b0070 con 0x7fa3180aeb90 2024-04-25T09:03:32.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.718+0000 7fa315e00640 1 -- 172.21.15.173:0/3136270187 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3080ab9e0 con 0x7fa3180aeb90 2024-04-25T09:03:32.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.718+0000 7fa31d400640 1 -- 172.21.15.173:0/3136270187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3180aeb90 msgr2=0x7fa3180cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.718+0000 7fa31d400640 1 --2- 172.21.15.173:0/3136270187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3180aeb90 0x7fa3180cc0d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa3180712b0 tx=0x7fa30801c460 comp rx=0 tx=0).stop 2024-04-25T09:03:32.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.718+0000 7fa31d400640 1 -- 172.21.15.173:0/3136270187 shutdown_connections 2024-04-25T09:03:32.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.718+0000 7fa31d400640 1 --2- 172.21.15.173:0/3136270187 >> v2:172.21.15.194:3300/0 conn(0x7fa3180cdba0 0x7fa3180ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.718+0000 7fa31d400640 1 --2- 172.21.15.173:0/3136270187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3180aef70 0x7fa3180cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.718+0000 7fa31d400640 1 --2- 172.21.15.173:0/3136270187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3180aeb90 0x7fa3180cc0d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.718+0000 7fa31d400640 1 -- 172.21.15.173:0/3136270187 >> 172.21.15.173:0/3136270187 conn(0x7fa31806ac90 msgr2=0x7fa31806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:32.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.718+0000 7fa31d400640 1 -- 172.21.15.173:0/3136270187 shutdown_connections 2024-04-25T09:03:32.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.718+0000 7fa31d400640 1 -- 172.21.15.173:0/3136270187 wait complete. 2024-04-25T09:03:32.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa31d400640 1 Processor -- start 2024-04-25T09:03:32.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa31d400640 1 -- start start 2024-04-25T09:03:32.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa31d400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3180aeb90 0x7fa3180b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa31d400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3180aef70 0x7fa318149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa31d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3180cdba0 0x7fa318149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa31d400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31815ef40 con 0x7fa3180cdba0 2024-04-25T09:03:32.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa31d400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31815edc0 con 0x7fa3180aeb90 2024-04-25T09:03:32.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa31d400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31815f0c0 con 0x7fa3180aef70 2024-04-25T09:03:32.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa317200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3180cdba0 0x7fa318149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa317200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3180cdba0 0x7fa318149360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50222/0 (socket says 172.21.15.173:50222) 2024-04-25T09:03:32.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa317200640 1 -- 172.21.15.173:0/2349281687 learned_addr learned my addr 172.21.15.173:0/2349281687 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:32.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa316800640 1 --2- 172.21.15.173:0/2349281687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3180aeb90 0x7fa3180b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa30de00640 1 --2- 172.21.15.173:0/2349281687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3180aef70 0x7fa318149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa317200640 1 -- 172.21.15.173:0/2349281687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3180aef70 msgr2=0x7fa318149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa317200640 1 --2- 172.21.15.173:0/2349281687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3180aef70 0x7fa318149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa317200640 1 -- 172.21.15.173:0/2349281687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3180aeb90 msgr2=0x7fa3180b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa317200640 1 --2- 172.21.15.173:0/2349281687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3180aeb90 0x7fa3180b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa317200640 1 -- 172.21.15.173:0/2349281687 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3181498a0 con 0x7fa3180cdba0 2024-04-25T09:03:32.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa316800640 1 --2- 172.21.15.173:0/2349281687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3180aeb90 0x7fa3180b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:32.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa317200640 1 --2- 172.21.15.173:0/2349281687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3180cdba0 0x7fa318149360 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa31000efc0 tx=0x7fa31000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:32.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa30f400640 1 -- 172.21.15.173:0/2349281687 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310018020 con 0x7fa3180cdba0 2024-04-25T09:03:32.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa30f400640 1 -- 172.21.15.173:0/2349281687 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa310014480 con 0x7fa3180cdba0 2024-04-25T09:03:32.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa31d400640 1 -- 172.21.15.173:0/2349281687 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31814c6c0 con 0x7fa3180cdba0 2024-04-25T09:03:32.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa30f400640 1 -- 172.21.15.173:0/2349281687 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310014870 con 0x7fa3180cdba0 2024-04-25T09:03:32.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.722+0000 7fa31d400640 1 -- 172.21.15.173:0/2349281687 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31814cc40 con 0x7fa3180cdba0 2024-04-25T09:03:32.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.726+0000 7fa31d400640 1 -- 172.21.15.173:0/2349281687 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa318073ab0 con 0x7fa3180cdba0 2024-04-25T09:03:32.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.726+0000 7fa30f400640 1 -- 172.21.15.173:0/2349281687 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa31001b020 con 0x7fa3180cdba0 2024-04-25T09:03:32.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.726+0000 7fa30f400640 1 --2- 172.21.15.173:0/2349281687 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2f4066f60 0x7fa2f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.726+0000 7fa30f400640 1 -- 172.21.15.173:0/2349281687 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fa310086250 con 0x7fa3180cdba0 2024-04-25T09:03:32.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.726+0000 7fa316800640 1 --2- 172.21.15.173:0/2349281687 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2f4066f60 0x7fa2f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.726+0000 7fa316800640 1 --2- 172.21.15.173:0/2349281687 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2f4066f60 0x7fa2f4069420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa3080af000 tx=0x7fa3080a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:32.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.730+0000 7fa30f400640 1 -- 172.21.15.173:0/2349281687 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa310022030 con 0x7fa3180cdba0 2024-04-25T09:03:32.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.886+0000 7fa31d400640 1 -- 172.21.15.173:0/2349281687 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa31806da70 con 0x7fa3180cdba0 2024-04-25T09:03:32.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.886+0000 7fa30f400640 1 -- 172.21.15.173:0/2349281687 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa310010040 con 0x7fa3180cdba0 2024-04-25T09:03:32.877 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:03:32.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.890+0000 7fa31d400640 1 -- 172.21.15.173:0/2349281687 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2f4066f60 msgr2=0x7fa2f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.890+0000 7fa31d400640 1 --2- 172.21.15.173:0/2349281687 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2f4066f60 0x7fa2f4069420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa3080af000 tx=0x7fa3080a7000 comp rx=0 tx=0).stop 2024-04-25T09:03:32.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.890+0000 7fa31d400640 1 -- 172.21.15.173:0/2349281687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3180cdba0 msgr2=0x7fa318149360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.890+0000 7fa31d400640 1 --2- 172.21.15.173:0/2349281687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3180cdba0 0x7fa318149360 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa31000efc0 tx=0x7fa31000c490 comp rx=0 tx=0).stop 2024-04-25T09:03:32.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.890+0000 7fa31d400640 1 -- 172.21.15.173:0/2349281687 shutdown_connections 2024-04-25T09:03:32.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.890+0000 7fa31d400640 1 --2- 172.21.15.173:0/2349281687 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2f4066f60 0x7fa2f4069420 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.890+0000 7fa31d400640 1 --2- 172.21.15.173:0/2349281687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3180cdba0 0x7fa318149360 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.890+0000 7fa31d400640 1 --2- 172.21.15.173:0/2349281687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3180aef70 0x7fa318149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.890+0000 7fa31d400640 1 --2- 172.21.15.173:0/2349281687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3180aeb90 0x7fa3180b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.890+0000 7fa31d400640 1 -- 172.21.15.173:0/2349281687 >> 172.21.15.173:0/2349281687 conn(0x7fa31806ac90 msgr2=0x7fa31815d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:32.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.890+0000 7fa31d400640 1 -- 172.21.15.173:0/2349281687 shutdown_connections 2024-04-25T09:03:32.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:32.890+0000 7fa31d400640 1 -- 172.21.15.173:0/2349281687 wait complete. 2024-04-25T09:03:32.898 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:33.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.046+0000 7f04b2a00640 1 Processor -- start 2024-04-25T09:03:33.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.046+0000 7f04b2a00640 1 -- start start 2024-04-25T09:03:33.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.046+0000 7f04b2a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f04ac06c3b0 0x7f04ac06db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.046+0000 7f04b2a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04ac061870 con 0x7f04ac0ade10 2024-04-25T09:03:33.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.046+0000 7f04b2a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04ac061b50 con 0x7f04ac15dc70 2024-04-25T09:03:33.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.046+0000 7f04b2a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04ac072da0 con 0x7f04ac06c3b0 2024-04-25T09:03:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.046+0000 7f04ab400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f04ac06c3b0 0x7f04ac06db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.046+0000 7f04b0a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f04ac0ade10 0x7f04ac06e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47036/0 (socket says 172.21.15.173:47036) 2024-04-25T09:03:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.046+0000 7f04b0a00640 1 -- 172.21.15.173:0/113015684 learned_addr learned my addr 172.21.15.173:0/113015684 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.050+0000 7f04ab400640 1 -- 172.21.15.173:0/113015684 >> v1:172.21.15.194:6789/0 conn(0x7f04ac15dc70 legacy=0x7f04ac06bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.050+0000 7f04ab400640 1 -- 172.21.15.173:0/113015684 >> v1:172.21.15.173:6789/0 conn(0x7f04ac0ade10 legacy=0x7f04ac06e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.050+0000 7f04ab400640 1 -- 172.21.15.173:0/113015684 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac072880 con 0x7f04ac06c3b0 2024-04-25T09:03:33.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.050+0000 7f04ab400640 1 --2- 172.21.15.173:0/113015684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04ac06c3b0 0x7f04ac06db50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f04980097c0 tx=0x7f049801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a66b374afb7e20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.050+0000 7f04aaa00640 1 -- 172.21.15.173:0/113015684 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04980ab5f0 con 0x7f04ac06c3b0 2024-04-25T09:03:33.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.050+0000 7f04aaa00640 1 -- 172.21.15.173:0/113015684 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04980b0070 con 0x7f04ac06c3b0 2024-04-25T09:03:33.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.050+0000 7f04aaa00640 1 -- 172.21.15.173:0/113015684 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04980ab9b0 con 0x7f04ac06c3b0 2024-04-25T09:03:33.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.050+0000 7f04b2a00640 1 -- 172.21.15.173:0/113015684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04ac06c3b0 msgr2=0x7f04ac06db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.050+0000 7f04b2a00640 1 --2- 172.21.15.173:0/113015684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04ac06c3b0 0x7f04ac06db50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f04980097c0 tx=0x7f049801c3d0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.050+0000 7f04b2a00640 1 -- 172.21.15.173:0/113015684 shutdown_connections 2024-04-25T09:03:33.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.050+0000 7f04b2a00640 1 --2- 172.21.15.173:0/113015684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04ac06c3b0 0x7f04ac06db50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.050+0000 7f04b2a00640 1 -- 172.21.15.173:0/113015684 >> 172.21.15.173:0/113015684 conn(0x7f04ac071b10 msgr2=0x7f04ac071f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:33.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04b2a00640 1 -- 172.21.15.173:0/113015684 shutdown_connections 2024-04-25T09:03:33.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04b2a00640 1 -- 172.21.15.173:0/113015684 wait complete. 2024-04-25T09:03:33.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04b2a00640 1 Processor -- start 2024-04-25T09:03:33.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04b2a00640 1 -- start start 2024-04-25T09:03:33.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04b2a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04ac06c3b0 0x7f04ac153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04b2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04ac0ade10 0x7f04ac14db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04b2a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04ac15dc70 0x7f04ac146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04b2a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac16b8e0 con 0x7f04ac0ade10 2024-04-25T09:03:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04b2a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac072630 con 0x7f04ac06c3b0 2024-04-25T09:03:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04b2a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac16ba60 con 0x7f04ac15dc70 2024-04-25T09:03:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04ab400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04ac0ade10 0x7f04ac14db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04ab400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04ac0ade10 0x7f04ac14db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50252/0 (socket says 172.21.15.173:50252) 2024-04-25T09:03:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04ab400640 1 -- 172.21.15.173:0/3840302340 learned_addr learned my addr 172.21.15.173:0/3840302340 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04ab400640 1 -- 172.21.15.173:0/3840302340 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04ac15dc70 msgr2=0x7f04ac146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04ab400640 1 --2- 172.21.15.173:0/3840302340 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04ac15dc70 0x7f04ac146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04ab400640 1 -- 172.21.15.173:0/3840302340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04ac06c3b0 msgr2=0x7f04ac153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04ab400640 1 --2- 172.21.15.173:0/3840302340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04ac06c3b0 0x7f04ac153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04ab400640 1 -- 172.21.15.173:0/3840302340 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac147500 con 0x7f04ac0ade10 2024-04-25T09:03:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04ab400640 1 --2- 172.21.15.173:0/3840302340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04ac0ade10 0x7f04ac14db00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f04980ad040 tx=0x7f049801ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04a3e00640 1 -- 172.21.15.173:0/3840302340 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04980b5810 con 0x7f04ac0ade10 2024-04-25T09:03:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04a3e00640 1 -- 172.21.15.173:0/3840302340 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04980b59b0 con 0x7f04ac0ade10 2024-04-25T09:03:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04b2a00640 1 -- 172.21.15.173:0/3840302340 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ac154230 con 0x7f04ac0ade10 2024-04-25T09:03:33.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04a3e00640 1 -- 172.21.15.173:0/3840302340 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04980b5da0 con 0x7f04ac0ade10 2024-04-25T09:03:33.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.054+0000 7f04b2a00640 1 -- 172.21.15.173:0/3840302340 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ac14b570 con 0x7f04ac0ade10 2024-04-25T09:03:33.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.058+0000 7f04b2a00640 1 -- 172.21.15.173:0/3840302340 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ac073ab0 con 0x7f04ac0ade10 2024-04-25T09:03:33.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.058+0000 7f04a3e00640 1 -- 172.21.15.173:0/3840302340 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f04980b3420 con 0x7f04ac0ade10 2024-04-25T09:03:33.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.058+0000 7f04a3e00640 1 --2- 172.21.15.173:0/3840302340 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f048c066f90 0x7f048c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.058+0000 7f04a3e00640 1 -- 172.21.15.173:0/3840302340 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f049811fdb0 con 0x7f04ac0ade10 2024-04-25T09:03:33.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.058+0000 7f04abe00640 1 --2- 172.21.15.173:0/3840302340 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f048c066f90 0x7f048c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.058+0000 7f04abe00640 1 --2- 172.21.15.173:0/3840302340 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f048c066f90 0x7f048c069450 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0cf540 tx=0x7f049c009230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.062+0000 7f04a3e00640 1 -- 172.21.15.173:0/3840302340 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f04980c5060 con 0x7f04ac0ade10 2024-04-25T09:03:33.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.222+0000 7f04b2a00640 1 -- 172.21.15.173:0/3840302340 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04ac15ad10 con 0x7f04ac0ade10 2024-04-25T09:03:33.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.222+0000 7f04a3e00640 1 -- 172.21.15.173:0/3840302340 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0498016050 con 0x7f04ac0ade10 2024-04-25T09:03:33.211 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:33.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.222+0000 7f04b2a00640 1 -- 172.21.15.173:0/3840302340 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f048c066f90 msgr2=0x7f048c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.222+0000 7f04b2a00640 1 --2- 172.21.15.173:0/3840302340 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f048c066f90 0x7f048c069450 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0cf540 tx=0x7f049c009230 comp rx=0 tx=0).stop 2024-04-25T09:03:33.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.222+0000 7f04b2a00640 1 -- 172.21.15.173:0/3840302340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04ac0ade10 msgr2=0x7f04ac14db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.222+0000 7f04b2a00640 1 --2- 172.21.15.173:0/3840302340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04ac0ade10 0x7f04ac14db00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f04980ad040 tx=0x7f049801ac10 comp rx=0 tx=0).stop 2024-04-25T09:03:33.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.222+0000 7f04b2a00640 1 -- 172.21.15.173:0/3840302340 shutdown_connections 2024-04-25T09:03:33.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.222+0000 7f04b2a00640 1 --2- 172.21.15.173:0/3840302340 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f048c066f90 0x7f048c069450 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.222+0000 7f04b2a00640 1 --2- 172.21.15.173:0/3840302340 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04ac15dc70 0x7f04ac146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.222+0000 7f04b2a00640 1 --2- 172.21.15.173:0/3840302340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04ac0ade10 0x7f04ac14db00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.222+0000 7f04b2a00640 1 --2- 172.21.15.173:0/3840302340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04ac06c3b0 0x7f04ac153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.222+0000 7f04b2a00640 1 -- 172.21.15.173:0/3840302340 >> 172.21.15.173:0/3840302340 conn(0x7f04ac071b10 msgr2=0x7f04ac071ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:33.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.222+0000 7f04b2a00640 1 -- 172.21.15.173:0/3840302340 shutdown_connections 2024-04-25T09:03:33.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.222+0000 7f04b2a00640 1 -- 172.21.15.173:0/3840302340 wait complete. 2024-04-25T09:03:33.232 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:33.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.382+0000 7f929f800640 1 Processor -- start 2024-04-25T09:03:33.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.382+0000 7f929f800640 1 -- start start 2024-04-25T09:03:33.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.382+0000 7f929f800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f92980aeb90 0x7f92980cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.382+0000 7f929f800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f92980ce2b0 0x7f92980cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.382+0000 7f929f800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9298071570 con 0x7f92980aef70 2024-04-25T09:03:33.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.382+0000 7f929f800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9298071320 con 0x7f92980ce2b0 2024-04-25T09:03:33.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.382+0000 7f929f800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9298072330 con 0x7f92980aeb90 2024-04-25T09:03:33.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.382+0000 7f929d800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f92980ce2b0 0x7f92980cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.382+0000 7f929d800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f92980ce2b0 0x7f92980cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55980/0 (socket says 172.21.15.173:55980) 2024-04-25T09:03:33.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.382+0000 7f929d800640 1 -- 172.21.15.173:0/2608208813 learned_addr learned my addr 172.21.15.173:0/2608208813 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:33.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.382+0000 7f929ce00640 1 --2- 172.21.15.173:0/2608208813 >> v2:172.21.15.194:3300/0 conn(0x7f92980aeb90 0x7f92980cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.382+0000 7f929d800640 1 -- 172.21.15.173:0/2608208813 >> v2:172.21.15.194:3300/0 conn(0x7f92980aeb90 msgr2=0x7f92980cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:33.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.382+0000 7f929d800640 1 --2- 172.21.15.173:0/2608208813 >> v2:172.21.15.194:3300/0 conn(0x7f92980aeb90 0x7f92980cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.382+0000 7f929d800640 1 -- 172.21.15.173:0/2608208813 >> v1:172.21.15.194:6789/0 conn(0x7f92980aef70 legacy=0x7f92980cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.382+0000 7f929d800640 1 -- 172.21.15.173:0/2608208813 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9298071850 con 0x7f92980ce2b0 2024-04-25T09:03:33.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.382+0000 7f929ce00640 1 --2- 172.21.15.173:0/2608208813 >> v2:172.21.15.194:3300/0 conn(0x7f92980aeb90 0x7f92980cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:33.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.386+0000 7f929d800640 1 --2- 172.21.15.173:0/2608208813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92980ce2b0 0x7f92980cc610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f92980cd220 tx=0x7f929001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e405b189538228a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.386+0000 7f9297e00640 1 -- 172.21.15.173:0/2608208813 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92900a56f0 con 0x7f92980ce2b0 2024-04-25T09:03:33.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.386+0000 7f9297e00640 1 -- 172.21.15.173:0/2608208813 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92900a5890 con 0x7f92980ce2b0 2024-04-25T09:03:33.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.386+0000 7f9297e00640 1 -- 172.21.15.173:0/2608208813 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92900a5c60 con 0x7f92980ce2b0 2024-04-25T09:03:33.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.386+0000 7f929f800640 1 -- 172.21.15.173:0/2608208813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92980ce2b0 msgr2=0x7f92980cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.386+0000 7f929f800640 1 --2- 172.21.15.173:0/2608208813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92980ce2b0 0x7f92980cc610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f92980cd220 tx=0x7f929001c930 comp rx=0 tx=0).stop 2024-04-25T09:03:33.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.386+0000 7f929f800640 1 -- 172.21.15.173:0/2608208813 shutdown_connections 2024-04-25T09:03:33.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.386+0000 7f929f800640 1 --2- 172.21.15.173:0/2608208813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92980ce2b0 0x7f92980cc610 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.386+0000 7f929f800640 1 --2- 172.21.15.173:0/2608208813 >> v2:172.21.15.194:3300/0 conn(0x7f92980aeb90 0x7f92980cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.386+0000 7f929f800640 1 -- 172.21.15.173:0/2608208813 >> 172.21.15.173:0/2608208813 conn(0x7f929806ac90 msgr2=0x7f929806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:33.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.386+0000 7f929f800640 1 -- 172.21.15.173:0/2608208813 shutdown_connections 2024-04-25T09:03:33.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.386+0000 7f929f800640 1 -- 172.21.15.173:0/2608208813 wait complete. 2024-04-25T09:03:33.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f929f800640 1 Processor -- start 2024-04-25T09:03:33.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f929f800640 1 -- start start 2024-04-25T09:03:33.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f929f800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92980aeb90 0x7f929814a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f929f800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92980aef70 0x7f929814dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f929f800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92980ce2b0 0x7f929814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f929f800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929815bb30 con 0x7f92980aef70 2024-04-25T09:03:33.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f929f800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929815b9b0 con 0x7f92980aeb90 2024-04-25T09:03:33.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f929f800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929815bcb0 con 0x7f92980ce2b0 2024-04-25T09:03:33.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f928fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92980aef70 0x7f929814dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f928fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92980aef70 0x7f929814dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55982/0 (socket says 172.21.15.173:55982) 2024-04-25T09:03:33.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f928fe00640 1 -- 172.21.15.173:0/2072661541 learned_addr learned my addr 172.21.15.173:0/2072661541 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:33.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f929ce00640 1 --2- 172.21.15.173:0/2072661541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92980aeb90 0x7f929814a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f929d800640 1 --2- 172.21.15.173:0/2072661541 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92980ce2b0 0x7f929814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f928fe00640 1 -- 172.21.15.173:0/2072661541 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92980ce2b0 msgr2=0x7f929814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f928fe00640 1 --2- 172.21.15.173:0/2072661541 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92980ce2b0 0x7f929814e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f928fe00640 1 -- 172.21.15.173:0/2072661541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92980aeb90 msgr2=0x7f929814a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f928fe00640 1 --2- 172.21.15.173:0/2072661541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92980aeb90 0x7f929814a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f928fe00640 1 -- 172.21.15.173:0/2072661541 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92980b0b20 con 0x7f92980aef70 2024-04-25T09:03:33.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f928fe00640 1 --2- 172.21.15.173:0/2072661541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92980aef70 0x7f929814dce0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f928000c450 tx=0x7f928000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f9295600640 1 -- 172.21.15.173:0/2072661541 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280016020 con 0x7f92980aef70 2024-04-25T09:03:33.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f9295600640 1 -- 172.21.15.173:0/2072661541 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92800052d0 con 0x7f92980aef70 2024-04-25T09:03:33.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f929f800640 1 -- 172.21.15.173:0/2072661541 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92980aff30 con 0x7f92980aef70 2024-04-25T09:03:33.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f9295600640 1 -- 172.21.15.173:0/2072661541 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280007260 con 0x7f92980aef70 2024-04-25T09:03:33.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.390+0000 7f929f800640 1 -- 172.21.15.173:0/2072661541 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92980b04d0 con 0x7f92980aef70 2024-04-25T09:03:33.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.394+0000 7f929f800640 1 -- 172.21.15.173:0/2072661541 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9298073ab0 con 0x7f92980aef70 2024-04-25T09:03:33.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.394+0000 7f9295600640 1 -- 172.21.15.173:0/2072661541 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9280007400 con 0x7f92980aef70 2024-04-25T09:03:33.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.394+0000 7f9295600640 1 --2- 172.21.15.173:0/2072661541 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9274066f60 0x7f9274069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.394+0000 7f9295600640 1 -- 172.21.15.173:0/2072661541 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f9280084cb0 con 0x7f92980aef70 2024-04-25T09:03:33.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.394+0000 7f929ce00640 1 --2- 172.21.15.173:0/2072661541 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9274066f60 0x7f9274069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.394+0000 7f929ce00640 1 --2- 172.21.15.173:0/2072661541 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9274066f60 0x7f9274069420 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f92880045f0 tx=0x7f9288008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.398+0000 7f9295600640 1 -- 172.21.15.173:0/2072661541 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9280020020 con 0x7f92980aef70 2024-04-25T09:03:33.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.558+0000 7f929f800640 1 -- 172.21.15.173:0/2072661541 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f929815cf50 con 0x7f92980aef70 2024-04-25T09:03:33.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.558+0000 7f9295600640 1 -- 172.21.15.173:0/2072661541 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9280005480 con 0x7f92980aef70 2024-04-25T09:03:33.546 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:03:33.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.558+0000 7f929f800640 1 -- 172.21.15.173:0/2072661541 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9274066f60 msgr2=0x7f9274069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.558+0000 7f929f800640 1 --2- 172.21.15.173:0/2072661541 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9274066f60 0x7f9274069420 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f92880045f0 tx=0x7f9288008040 comp rx=0 tx=0).stop 2024-04-25T09:03:33.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.558+0000 7f929f800640 1 -- 172.21.15.173:0/2072661541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92980aef70 msgr2=0x7f929814dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.558+0000 7f929f800640 1 --2- 172.21.15.173:0/2072661541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92980aef70 0x7f929814dce0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f928000c450 tx=0x7f928000c910 comp rx=0 tx=0).stop 2024-04-25T09:03:33.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.558+0000 7f929f800640 1 -- 172.21.15.173:0/2072661541 shutdown_connections 2024-04-25T09:03:33.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.558+0000 7f929f800640 1 --2- 172.21.15.173:0/2072661541 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9274066f60 0x7f9274069420 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.558+0000 7f929f800640 1 --2- 172.21.15.173:0/2072661541 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92980ce2b0 0x7f929814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.558+0000 7f929f800640 1 --2- 172.21.15.173:0/2072661541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92980aef70 0x7f929814dce0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.558+0000 7f929f800640 1 --2- 172.21.15.173:0/2072661541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92980aeb90 0x7f929814a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.558+0000 7f929f800640 1 -- 172.21.15.173:0/2072661541 >> 172.21.15.173:0/2072661541 conn(0x7f929806ac90 msgr2=0x7f92980b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:33.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.558+0000 7f929f800640 1 -- 172.21.15.173:0/2072661541 shutdown_connections 2024-04-25T09:03:33.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.558+0000 7f929f800640 1 -- 172.21.15.173:0/2072661541 wait complete. 2024-04-25T09:03:33.567 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:03:33.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.714+0000 7f7955200640 1 Processor -- start 2024-04-25T09:03:33.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.718+0000 7f7955200640 1 -- start start 2024-04-25T09:03:33.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.718+0000 7f7955200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7950145290 0x7f795015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.718+0000 7f7955200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79500cc260 0x7f79500cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.718+0000 7f7955200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795015c5f0 con 0x7f79500b3fe0 2024-04-25T09:03:33.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.718+0000 7f7955200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795006d4b0 con 0x7f7950145290 2024-04-25T09:03:33.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.718+0000 7f7955200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795006d790 con 0x7f79500cc260 2024-04-25T09:03:33.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.718+0000 7f794e800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79500cc260 0x7f79500cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.718+0000 7f794de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7950145290 0x7f795015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.718+0000 7f794de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7950145290 0x7f795015c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:41416/0 (socket says 172.21.15.173:41416) 2024-04-25T09:03:33.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.718+0000 7f794de00640 1 -- 172.21.15.173:0/159429219 learned_addr learned my addr 172.21.15.173:0/159429219 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:33.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.718+0000 7f7945400640 1 --1- 172.21.15.173:0/159429219 >> v1:172.21.15.194:6789/0 conn(0x7f79500b3fe0 0x7f79500b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:52868/0 (socket says 172.21.15.173:52868) 2024-04-25T09:03:33.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.718+0000 7f794e800640 1 -- 172.21.15.173:0/159429219 >> v2:172.21.15.194:3300/0 conn(0x7f7950145290 msgr2=0x7f795015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:33.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.718+0000 7f794e800640 1 --2- 172.21.15.173:0/159429219 >> v2:172.21.15.194:3300/0 conn(0x7f7950145290 0x7f795015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.718+0000 7f794e800640 1 -- 172.21.15.173:0/159429219 >> v1:172.21.15.194:6789/0 conn(0x7f79500b3fe0 legacy=0x7f79500b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.718+0000 7f794e800640 1 -- 172.21.15.173:0/159429219 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795006da70 con 0x7f79500cc260 2024-04-25T09:03:33.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.722+0000 7f794e800640 1 --2- 172.21.15.173:0/159429219 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79500cc260 0x7f79500cc6b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7948009d90 tx=0x7f794801c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b67f8c7a05eacc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.722+0000 7f794d400640 1 -- 172.21.15.173:0/159429219 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79480b2070 con 0x7f79500cc260 2024-04-25T09:03:33.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.722+0000 7f794d400640 1 -- 172.21.15.173:0/159429219 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79480a5820 con 0x7f79500cc260 2024-04-25T09:03:33.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.722+0000 7f794d400640 1 -- 172.21.15.173:0/159429219 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79480a5bf0 con 0x7f79500cc260 2024-04-25T09:03:33.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.722+0000 7f7955200640 1 -- 172.21.15.173:0/159429219 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79500cc260 msgr2=0x7f79500cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.722+0000 7f7955200640 1 --2- 172.21.15.173:0/159429219 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79500cc260 0x7f79500cc6b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7948009d90 tx=0x7f794801c850 comp rx=0 tx=0).stop 2024-04-25T09:03:33.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.722+0000 7f7955200640 1 -- 172.21.15.173:0/159429219 shutdown_connections 2024-04-25T09:03:33.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.722+0000 7f7955200640 1 --2- 172.21.15.173:0/159429219 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79500cc260 0x7f79500cc6b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.722+0000 7f7955200640 1 --2- 172.21.15.173:0/159429219 >> v2:172.21.15.194:3300/0 conn(0x7f7950145290 0x7f795015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.722+0000 7f7955200640 1 -- 172.21.15.173:0/159429219 >> 172.21.15.173:0/159429219 conn(0x7f795006ac90 msgr2=0x7f795006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:33.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.722+0000 7f7955200640 1 -- 172.21.15.173:0/159429219 shutdown_connections 2024-04-25T09:03:33.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.722+0000 7f7955200640 1 -- 172.21.15.173:0/159429219 wait complete. 2024-04-25T09:03:33.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.722+0000 7f7955200640 1 Processor -- start 2024-04-25T09:03:33.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f7955200640 1 -- start start 2024-04-25T09:03:33.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f7955200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79500b3fe0 0x7f795014e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f7955200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79500cc260 0x7f79500ce150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f7955200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7950145290 0x7f79500ce690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f7955200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795006eee0 con 0x7f7950145290 2024-04-25T09:03:33.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f7955200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795006ed60 con 0x7f79500b3fe0 2024-04-25T09:03:33.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f7955200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795006f060 con 0x7f79500cc260 2024-04-25T09:03:33.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f794de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79500b3fe0 0x7f795014e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f794e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7950145290 0x7f79500ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f794de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79500b3fe0 0x7f795014e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:41430/0 (socket says 172.21.15.173:41430) 2024-04-25T09:03:33.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f794de00640 1 -- 172.21.15.173:0/3937935885 learned_addr learned my addr 172.21.15.173:0/3937935885 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:33.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f7945400640 1 --2- 172.21.15.173:0/3937935885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79500cc260 0x7f79500ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f794de00640 1 -- 172.21.15.173:0/3937935885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79500cc260 msgr2=0x7f79500ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f794de00640 1 --2- 172.21.15.173:0/3937935885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79500cc260 0x7f79500ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f794de00640 1 -- 172.21.15.173:0/3937935885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7950145290 msgr2=0x7f79500ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f794de00640 1 --2- 172.21.15.173:0/3937935885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7950145290 0x7f79500ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f794de00640 1 -- 172.21.15.173:0/3937935885 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795014e620 con 0x7f79500b3fe0 2024-04-25T09:03:33.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f794e800640 1 --2- 172.21.15.173:0/3937935885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7950145290 0x7f79500ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:33.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f794de00640 1 --2- 172.21.15.173:0/3937935885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79500b3fe0 0x7f795014e0e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f794000e7f0 tx=0x7f794000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f7946a00640 1 -- 172.21.15.173:0/3937935885 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940017070 con 0x7f79500b3fe0 2024-04-25T09:03:33.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f7946a00640 1 -- 172.21.15.173:0/3937935885 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794000c940 con 0x7f79500b3fe0 2024-04-25T09:03:33.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f7946a00640 1 -- 172.21.15.173:0/3937935885 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794000cd30 con 0x7f79500b3fe0 2024-04-25T09:03:33.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f7955200640 1 -- 172.21.15.173:0/3937935885 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79500ad400 con 0x7f79500b3fe0 2024-04-25T09:03:33.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f7955200640 1 -- 172.21.15.173:0/3937935885 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79500ad9c0 con 0x7f79500b3fe0 2024-04-25T09:03:33.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.726+0000 7f7955200640 1 -- 172.21.15.173:0/3937935885 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7950073ab0 con 0x7f79500b3fe0 2024-04-25T09:03:33.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.730+0000 7f7946a00640 1 -- 172.21.15.173:0/3937935885 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f794001a070 con 0x7f79500b3fe0 2024-04-25T09:03:33.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.730+0000 7f7946a00640 1 --2- 172.21.15.173:0/3937935885 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f792c066f60 0x7f792c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.730+0000 7f7946a00640 1 -- 172.21.15.173:0/3937935885 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7940085110 con 0x7f79500b3fe0 2024-04-25T09:03:33.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.730+0000 7f7945400640 1 --2- 172.21.15.173:0/3937935885 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f792c066f60 0x7f792c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.730+0000 7f7945400640 1 --2- 172.21.15.173:0/3937935885 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f792c066f60 0x7f792c069420 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f795015b9f0 tx=0x7f7938007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.734+0000 7f7946a00640 1 -- 172.21.15.173:0/3937935885 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7940055840 con 0x7f79500b3fe0 2024-04-25T09:03:33.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.886+0000 7f7955200640 1 -- 172.21.15.173:0/3937935885 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f795006b480 con 0x7f79500b3fe0 2024-04-25T09:03:33.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.886+0000 7f7946a00640 1 -- 172.21.15.173:0/3937935885 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f79400598e0 con 0x7f79500b3fe0 2024-04-25T09:03:33.877 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:33.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.890+0000 7f7955200640 1 -- 172.21.15.173:0/3937935885 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f792c066f60 msgr2=0x7f792c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.890+0000 7f7955200640 1 --2- 172.21.15.173:0/3937935885 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f792c066f60 0x7f792c069420 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f795015b9f0 tx=0x7f7938007e90 comp rx=0 tx=0).stop 2024-04-25T09:03:33.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.890+0000 7f7955200640 1 -- 172.21.15.173:0/3937935885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79500b3fe0 msgr2=0x7f795014e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.890+0000 7f7955200640 1 --2- 172.21.15.173:0/3937935885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79500b3fe0 0x7f795014e0e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f794000e7f0 tx=0x7f794000ecb0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.890+0000 7f7955200640 1 -- 172.21.15.173:0/3937935885 shutdown_connections 2024-04-25T09:03:33.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.890+0000 7f7955200640 1 --2- 172.21.15.173:0/3937935885 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f792c066f60 0x7f792c069420 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.890+0000 7f7955200640 1 --2- 172.21.15.173:0/3937935885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7950145290 0x7f79500ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.890+0000 7f7955200640 1 --2- 172.21.15.173:0/3937935885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79500cc260 0x7f79500ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.890+0000 7f7955200640 1 --2- 172.21.15.173:0/3937935885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79500b3fe0 0x7f795014e0e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.890+0000 7f7955200640 1 -- 172.21.15.173:0/3937935885 >> 172.21.15.173:0/3937935885 conn(0x7f795006ac90 msgr2=0x7f795015cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:33.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.890+0000 7f7955200640 1 -- 172.21.15.173:0/3937935885 shutdown_connections 2024-04-25T09:03:33.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:33.890+0000 7f7955200640 1 -- 172.21.15.173:0/3937935885 wait complete. 2024-04-25T09:03:33.899 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:34.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.046+0000 7fc0eee00640 1 Processor -- start 2024-04-25T09:03:34.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.046+0000 7fc0eee00640 1 -- start start 2024-04-25T09:03:34.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.046+0000 7fc0eee00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc0e815ba20 0x7fc0e815be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.046+0000 7fc0eee00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0e80b70f0 0x7fc0e806f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.046+0000 7fc0eee00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc0e80b7550 0x7fc0e806fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.046+0000 7fc0eee00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e815c460 con 0x7fc0e815ba20 2024-04-25T09:03:34.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.046+0000 7fc0eee00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e815c740 con 0x7fc0e80b7550 2024-04-25T09:03:34.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.046+0000 7fc0eee00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e815ca20 con 0x7fc0e80b70f0 2024-04-25T09:03:34.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.046+0000 7fc0e7e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc0e815ba20 0x7fc0e815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.046+0000 7fc0e7e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc0e815ba20 0x7fc0e815be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56008/0 (socket says 172.21.15.173:56008) 2024-04-25T09:03:34.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.046+0000 7fc0e7e00640 1 -- 172.21.15.173:0/1243364218 learned_addr learned my addr 172.21.15.173:0/1243364218 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:34.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.046+0000 7fc0e7e00640 1 -- 172.21.15.173:0/1243364218 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0e80b70f0 msgr2=0x7fc0e806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:34.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.046+0000 7fc0e7e00640 1 --2- 172.21.15.173:0/1243364218 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0e80b70f0 0x7fc0e806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.046+0000 7fc0e7e00640 1 -- 172.21.15.173:0/1243364218 >> v2:172.21.15.194:3300/0 conn(0x7fc0e80b7550 msgr2=0x7fc0e806fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:34.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.046+0000 7fc0e7e00640 1 --2- 172.21.15.173:0/1243364218 >> v2:172.21.15.194:3300/0 conn(0x7fc0e80b7550 0x7fc0e806fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.046+0000 7fc0e7e00640 1 -- 172.21.15.173:0/1243364218 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e815cd00 con 0x7fc0e815ba20 2024-04-25T09:03:34.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.050+0000 7fc0e7e00640 1 --2- 172.21.15.173:0/1243364218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0e815ba20 0x7fc0e815be00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80b6bf0 tx=0x7fc0d801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68de02936b7fecf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:34.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.050+0000 7fc0e7400640 1 -- 172.21.15.173:0/1243364218 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80aa430 con 0x7fc0e815ba20 2024-04-25T09:03:34.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.050+0000 7fc0e7400640 1 -- 172.21.15.173:0/1243364218 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d80af070 con 0x7fc0e815ba20 2024-04-25T09:03:34.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.050+0000 7fc0e7400640 1 -- 172.21.15.173:0/1243364218 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80aa7f0 con 0x7fc0e815ba20 2024-04-25T09:03:34.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.050+0000 7fc0eee00640 1 -- 172.21.15.173:0/1243364218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0e815ba20 msgr2=0x7fc0e815be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.050+0000 7fc0eee00640 1 --2- 172.21.15.173:0/1243364218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0e815ba20 0x7fc0e815be00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80b6bf0 tx=0x7fc0d801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.050+0000 7fc0eee00640 1 -- 172.21.15.173:0/1243364218 shutdown_connections 2024-04-25T09:03:34.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.050+0000 7fc0eee00640 1 --2- 172.21.15.173:0/1243364218 >> v2:172.21.15.194:3300/0 conn(0x7fc0e80b7550 0x7fc0e806fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.050+0000 7fc0eee00640 1 --2- 172.21.15.173:0/1243364218 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0e80b70f0 0x7fc0e806f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.050+0000 7fc0eee00640 1 --2- 172.21.15.173:0/1243364218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0e815ba20 0x7fc0e815be00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.050+0000 7fc0eee00640 1 -- 172.21.15.173:0/1243364218 >> 172.21.15.173:0/1243364218 conn(0x7fc0e8061880 msgr2=0x7fc0e8061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:34.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.050+0000 7fc0eee00640 1 -- 172.21.15.173:0/1243364218 shutdown_connections 2024-04-25T09:03:34.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.050+0000 7fc0eee00640 1 -- 172.21.15.173:0/1243364218 wait complete. 2024-04-25T09:03:34.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.050+0000 7fc0eee00640 1 Processor -- start 2024-04-25T09:03:34.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0eee00640 1 -- start start 2024-04-25T09:03:34.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0eee00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0e80b70f0 0x7fc0e814e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0eee00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0e815ba20 0x7fc0e81575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0eee00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0e815a690 0x7fc0e81529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0eee00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80d2620 con 0x7fc0e815ba20 2024-04-25T09:03:34.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0eee00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80d24a0 con 0x7fc0e815a690 2024-04-25T09:03:34.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0eee00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e815f3f0 con 0x7fc0e80b70f0 2024-04-25T09:03:34.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0df400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0e815ba20 0x7fc0e81575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0df400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0e815ba20 0x7fc0e81575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56014/0 (socket says 172.21.15.173:56014) 2024-04-25T09:03:34.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0df400640 1 -- 172.21.15.173:0/30136933 learned_addr learned my addr 172.21.15.173:0/30136933 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:34.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0e7e00640 1 --2- 172.21.15.173:0/30136933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0e80b70f0 0x7fc0e814e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0ece00640 1 --2- 172.21.15.173:0/30136933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0e815a690 0x7fc0e81529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0df400640 1 -- 172.21.15.173:0/30136933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0e80b70f0 msgr2=0x7fc0e814e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0df400640 1 --2- 172.21.15.173:0/30136933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0e80b70f0 0x7fc0e814e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0df400640 1 -- 172.21.15.173:0/30136933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0e815a690 msgr2=0x7fc0e81529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0df400640 1 --2- 172.21.15.173:0/30136933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0e815a690 0x7fc0e81529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0df400640 1 -- 172.21.15.173:0/30136933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e8156550 con 0x7fc0e815ba20 2024-04-25T09:03:34.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0df400640 1 --2- 172.21.15.173:0/30136933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0e815ba20 0x7fc0e81575f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000b580 tx=0x7fc0d000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:34.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0e4c00640 1 -- 172.21.15.173:0/30136933 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0014070 con 0x7fc0e815ba20 2024-04-25T09:03:34.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0e4c00640 1 -- 172.21.15.173:0/30136933 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d0010890 con 0x7fc0e815ba20 2024-04-25T09:03:34.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0e4c00640 1 -- 172.21.15.173:0/30136933 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0010c80 con 0x7fc0e815ba20 2024-04-25T09:03:34.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0eee00640 1 -- 172.21.15.173:0/30136933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e8156830 con 0x7fc0e815ba20 2024-04-25T09:03:34.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0eee00640 1 -- 172.21.15.173:0/30136933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e8156df0 con 0x7fc0e815ba20 2024-04-25T09:03:34.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.054+0000 7fc0eee00640 1 -- 172.21.15.173:0/30136933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e8073a40 con 0x7fc0e815ba20 2024-04-25T09:03:34.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.058+0000 7fc0e4c00640 1 -- 172.21.15.173:0/30136933 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc0d0017070 con 0x7fc0e815ba20 2024-04-25T09:03:34.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.058+0000 7fc0e4c00640 1 --2- 172.21.15.173:0/30136933 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc0c4066f90 0x7fc0c4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.058+0000 7fc0e4c00640 1 -- 172.21.15.173:0/30136933 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc0d00851e0 con 0x7fc0e815ba20 2024-04-25T09:03:34.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.058+0000 7fc0e7e00640 1 --2- 172.21.15.173:0/30136933 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc0c4066f90 0x7fc0c4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.058+0000 7fc0e7e00640 1 --2- 172.21.15.173:0/30136933 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc0c4066f90 0x7fc0c4069450 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80ae000 tx=0x7fc0d80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:34.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.062+0000 7fc0e4c00640 1 -- 172.21.15.173:0/30136933 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc0d0055710 con 0x7fc0e815ba20 2024-04-25T09:03:34.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.218+0000 7fc0eee00640 1 -- 172.21.15.173:0/30136933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0e80cefc0 con 0x7fc0e815ba20 2024-04-25T09:03:34.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.218+0000 7fc0e4c00640 1 -- 172.21.15.173:0/30136933 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18906 (secure 0 0 0) 0x7fc0d0010e20 con 0x7fc0e815ba20 2024-04-25T09:03:34.208 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:34.209 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":28,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:03:32.190313+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:34.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.222+0000 7fc0eee00640 1 -- 172.21.15.173:0/30136933 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc0c4066f90 msgr2=0x7fc0c4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.222+0000 7fc0eee00640 1 --2- 172.21.15.173:0/30136933 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc0c4066f90 0x7fc0c4069450 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80ae000 tx=0x7fc0d80a7000 comp rx=0 tx=0).stop 2024-04-25T09:03:34.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.222+0000 7fc0eee00640 1 -- 172.21.15.173:0/30136933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0e815ba20 msgr2=0x7fc0e81575f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.222+0000 7fc0eee00640 1 --2- 172.21.15.173:0/30136933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0e815ba20 0x7fc0e81575f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000b580 tx=0x7fc0d000ba40 comp rx=0 tx=0).stop 2024-04-25T09:03:34.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.222+0000 7fc0eee00640 1 -- 172.21.15.173:0/30136933 shutdown_connections 2024-04-25T09:03:34.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.222+0000 7fc0eee00640 1 --2- 172.21.15.173:0/30136933 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc0c4066f90 0x7fc0c4069450 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.222+0000 7fc0eee00640 1 --2- 172.21.15.173:0/30136933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0e815a690 0x7fc0e81529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.222+0000 7fc0eee00640 1 --2- 172.21.15.173:0/30136933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0e815ba20 0x7fc0e81575f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.222+0000 7fc0eee00640 1 --2- 172.21.15.173:0/30136933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0e80b70f0 0x7fc0e814e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.222+0000 7fc0eee00640 1 -- 172.21.15.173:0/30136933 >> 172.21.15.173:0/30136933 conn(0x7fc0e8061880 msgr2=0x7fc0e806f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:34.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.222+0000 7fc0eee00640 1 -- 172.21.15.173:0/30136933 shutdown_connections 2024-04-25T09:03:34.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.222+0000 7fc0eee00640 1 -- 172.21.15.173:0/30136933 wait complete. 2024-04-25T09:03:34.231 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:02:49.342297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:02:50.386069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:02:54.077429+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:03:34.232 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:34.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.382+0000 7fe166800640 1 Processor -- start 2024-04-25T09:03:34.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.382+0000 7fe166800640 1 -- start start 2024-04-25T09:03:34.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.382+0000 7fe166800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe16015b710 0x7fe160071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.382+0000 7fe166800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe1600cd3d0 0x7fe1600cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.382+0000 7fe166800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16015e2d0 con 0x7fe1600cc670 2024-04-25T09:03:34.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.382+0000 7fe166800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1600ccae0 con 0x7fe1600cd3d0 2024-04-25T09:03:34.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.382+0000 7fe166800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16015eea0 con 0x7fe16015b710 2024-04-25T09:03:34.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.382+0000 7fe15ea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe1600cd3d0 0x7fe1600cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.382+0000 7fe15fe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe1600cc670 0x7fe16006d380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46448/0 (socket says 172.21.15.173:46448) 2024-04-25T09:03:34.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.382+0000 7fe15fe00640 1 -- 172.21.15.173:0/2551890571 learned_addr learned my addr 172.21.15.173:0/2551890571 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:34.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.382+0000 7fe15f400640 1 --2- 172.21.15.173:0/2551890571 >> v2:172.21.15.194:3300/0 conn(0x7fe16015b710 0x7fe160071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.382+0000 7fe15ea00640 1 -- 172.21.15.173:0/2551890571 >> v2:172.21.15.194:3300/0 conn(0x7fe16015b710 msgr2=0x7fe160071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:34.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.382+0000 7fe15ea00640 1 --2- 172.21.15.173:0/2551890571 >> v2:172.21.15.194:3300/0 conn(0x7fe16015b710 0x7fe160071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.382+0000 7fe15ea00640 1 -- 172.21.15.173:0/2551890571 >> v1:172.21.15.173:6789/0 conn(0x7fe1600cc670 legacy=0x7fe16006d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.382+0000 7fe15ea00640 1 -- 172.21.15.173:0/2551890571 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16015e570 con 0x7fe1600cd3d0 2024-04-25T09:03:34.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.382+0000 7fe15e000640 1 -- 172.21.15.173:0/2551890571 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228308559 0 0) 0x7fe16015e2d0 con 0x7fe1600cc670 2024-04-25T09:03:34.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.386+0000 7fe15ea00640 1 --2- 172.21.15.173:0/2551890571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1600cd3d0 0x7fe1600cc130 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe1600ccfa0 tx=0x7fe14c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3d02cf3616d567 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:34.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.386+0000 7fe15e000640 1 -- 172.21.15.173:0/2551890571 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0b0070 con 0x7fe1600cd3d0 2024-04-25T09:03:34.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.386+0000 7fe15e000640 1 -- 172.21.15.173:0/2551890571 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c0ab600 con 0x7fe1600cd3d0 2024-04-25T09:03:34.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.386+0000 7fe15e000640 1 -- 172.21.15.173:0/2551890571 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0ab9d0 con 0x7fe1600cd3d0 2024-04-25T09:03:34.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.386+0000 7fe166800640 1 -- 172.21.15.173:0/2551890571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1600cd3d0 msgr2=0x7fe1600cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.386+0000 7fe166800640 1 --2- 172.21.15.173:0/2551890571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1600cd3d0 0x7fe1600cc130 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe1600ccfa0 tx=0x7fe14c01c3c0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.386+0000 7fe166800640 1 -- 172.21.15.173:0/2551890571 shutdown_connections 2024-04-25T09:03:34.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.386+0000 7fe166800640 1 --2- 172.21.15.173:0/2551890571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1600cd3d0 0x7fe1600cc130 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.386+0000 7fe166800640 1 --2- 172.21.15.173:0/2551890571 >> v2:172.21.15.194:3300/0 conn(0x7fe16015b710 0x7fe160071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.386+0000 7fe166800640 1 -- 172.21.15.173:0/2551890571 >> 172.21.15.173:0/2551890571 conn(0x7fe16006ac90 msgr2=0x7fe16006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:34.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.386+0000 7fe166800640 1 -- 172.21.15.173:0/2551890571 shutdown_connections 2024-04-25T09:03:34.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.386+0000 7fe166800640 1 -- 172.21.15.173:0/2551890571 wait complete. 2024-04-25T09:03:34.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.386+0000 7fe166800640 1 Processor -- start 2024-04-25T09:03:34.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.386+0000 7fe166800640 1 -- start start 2024-04-25T09:03:34.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe166800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1600cc670 0x7fe160146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe166800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1600cd3d0 0x7fe160146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe166800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe16015b710 0x7fe16014d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe166800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe160072540 con 0x7fe16015b710 2024-04-25T09:03:34.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe166800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600723c0 con 0x7fe1600cc670 2024-04-25T09:03:34.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe166800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16016a800 con 0x7fe1600cd3d0 2024-04-25T09:03:34.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe15fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe16015b710 0x7fe16014d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe15fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe16015b710 0x7fe16014d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56032/0 (socket says 172.21.15.173:56032) 2024-04-25T09:03:34.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe15fe00640 1 -- 172.21.15.173:0/1804114660 learned_addr learned my addr 172.21.15.173:0/1804114660 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:34.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe15f400640 1 --2- 172.21.15.173:0/1804114660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1600cc670 0x7fe160146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe15ea00640 1 --2- 172.21.15.173:0/1804114660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1600cd3d0 0x7fe160146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe15fe00640 1 -- 172.21.15.173:0/1804114660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1600cd3d0 msgr2=0x7fe160146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe15fe00640 1 --2- 172.21.15.173:0/1804114660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1600cd3d0 0x7fe160146880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe15fe00640 1 -- 172.21.15.173:0/1804114660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1600cc670 msgr2=0x7fe160146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe15fe00640 1 --2- 172.21.15.173:0/1804114660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1600cc670 0x7fe160146fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe15fe00640 1 -- 172.21.15.173:0/1804114660 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe160147640 con 0x7fe16015b710 2024-04-25T09:03:34.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe15fe00640 1 --2- 172.21.15.173:0/1804114660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe16015b710 0x7fe16014d250 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe15800c7a0 tx=0x7fe15800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:34.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe157400640 1 -- 172.21.15.173:0/1804114660 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158018070 con 0x7fe16015b710 2024-04-25T09:03:34.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe157400640 1 -- 172.21.15.173:0/1804114660 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15800a640 con 0x7fe16015b710 2024-04-25T09:03:34.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe166800640 1 -- 172.21.15.173:0/1804114660 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe160147920 con 0x7fe16015b710 2024-04-25T09:03:34.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe157400640 1 -- 172.21.15.173:0/1804114660 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15800aab0 con 0x7fe16015b710 2024-04-25T09:03:34.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe166800640 1 -- 172.21.15.173:0/1804114660 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe160147ee0 con 0x7fe16015b710 2024-04-25T09:03:34.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.390+0000 7fe166800640 1 -- 172.21.15.173:0/1804114660 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe160073ab0 con 0x7fe16015b710 2024-04-25T09:03:34.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.394+0000 7fe157400640 1 -- 172.21.15.173:0/1804114660 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe15801b070 con 0x7fe16015b710 2024-04-25T09:03:34.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.394+0000 7fe157400640 1 --2- 172.21.15.173:0/1804114660 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe140066f60 0x7fe140069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.394+0000 7fe157400640 1 -- 172.21.15.173:0/1804114660 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe158084a70 con 0x7fe16015b710 2024-04-25T09:03:34.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.394+0000 7fe15f400640 1 --2- 172.21.15.173:0/1804114660 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe140066f60 0x7fe140069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.394+0000 7fe15f400640 1 --2- 172.21.15.173:0/1804114660 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe140066f60 0x7fe140069420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe1500079c0 tx=0x7fe150008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:34.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.398+0000 7fe157400640 1 -- 172.21.15.173:0/1804114660 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe158054f90 con 0x7fe16015b710 2024-04-25T09:03:34.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.550+0000 7fe166800640 1 -- 172.21.15.173:0/1804114660 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe16015fb40 con 0x7fe16015b710 2024-04-25T09:03:34.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.550+0000 7fe157400640 1 -- 172.21.15.173:0/1804114660 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe158059030 con 0x7fe16015b710 2024-04-25T09:03:34.541 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:03:34.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.554+0000 7fe166800640 1 -- 172.21.15.173:0/1804114660 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe140066f60 msgr2=0x7fe140069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.554+0000 7fe166800640 1 --2- 172.21.15.173:0/1804114660 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe140066f60 0x7fe140069420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe1500079c0 tx=0x7fe150008040 comp rx=0 tx=0).stop 2024-04-25T09:03:34.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.554+0000 7fe166800640 1 -- 172.21.15.173:0/1804114660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe16015b710 msgr2=0x7fe16014d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.554+0000 7fe166800640 1 --2- 172.21.15.173:0/1804114660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe16015b710 0x7fe16014d250 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe15800c7a0 tx=0x7fe15800cc60 comp rx=0 tx=0).stop 2024-04-25T09:03:34.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.554+0000 7fe166800640 1 -- 172.21.15.173:0/1804114660 shutdown_connections 2024-04-25T09:03:34.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.554+0000 7fe166800640 1 --2- 172.21.15.173:0/1804114660 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe140066f60 0x7fe140069420 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.554+0000 7fe166800640 1 --2- 172.21.15.173:0/1804114660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe16015b710 0x7fe16014d250 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.554+0000 7fe166800640 1 --2- 172.21.15.173:0/1804114660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1600cd3d0 0x7fe160146880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.554+0000 7fe166800640 1 --2- 172.21.15.173:0/1804114660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1600cc670 0x7fe160146fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.554+0000 7fe166800640 1 -- 172.21.15.173:0/1804114660 >> 172.21.15.173:0/1804114660 conn(0x7fe16006ac90 msgr2=0x7fe16015bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:34.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.554+0000 7fe166800640 1 -- 172.21.15.173:0/1804114660 shutdown_connections 2024-04-25T09:03:34.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.554+0000 7fe166800640 1 -- 172.21.15.173:0/1804114660 wait complete. 2024-04-25T09:03:34.562 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:34.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.710+0000 7f3538400640 1 Processor -- start 2024-04-25T09:03:34.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.710+0000 7f3538400640 1 -- start start 2024-04-25T09:03:34.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.710+0000 7f3538400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35300cc260 0x7f35300cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.710+0000 7f3538400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353006d4b0 con 0x7f35300b3fe0 2024-04-25T09:03:34.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.710+0000 7f3538400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353006d790 con 0x7f3530145290 2024-04-25T09:03:34.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.710+0000 7f3538400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353006da70 con 0x7f35300cc260 2024-04-25T09:03:34.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.710+0000 7f3535000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f35300b3fe0 0x7f35300b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46464/0 (socket says 172.21.15.173:46464) 2024-04-25T09:03:34.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.710+0000 7f3535000640 1 -- 172.21.15.173:0/2271566675 learned_addr learned my addr 172.21.15.173:0/2271566675 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:34.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.714+0000 7f3536400640 1 --2- 172.21.15.173:0/2271566675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35300cc260 0x7f35300cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.714+0000 7f352fe00640 1 -- 172.21.15.173:0/2271566675 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905900751 0 0) 0x7f353006d4b0 con 0x7f35300b3fe0 2024-04-25T09:03:34.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.714+0000 7f352fe00640 1 -- 172.21.15.173:0/2271566675 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3518003530 con 0x7f35300b3fe0 2024-04-25T09:03:34.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.714+0000 7f3536400640 1 -- 172.21.15.173:0/2271566675 >> v1:172.21.15.194:6789/0 conn(0x7f3530145290 legacy=0x7f353015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.714+0000 7f352fe00640 1 -- 172.21.15.173:0/2271566675 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230098961 0 0) 0x7f353006d790 con 0x7f3530145290 2024-04-25T09:03:34.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.714+0000 7f3536400640 1 -- 172.21.15.173:0/2271566675 >> v1:172.21.15.173:6789/0 conn(0x7f35300b3fe0 legacy=0x7f35300b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.714+0000 7f3536400640 1 -- 172.21.15.173:0/2271566675 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353006dd50 con 0x7f35300cc260 2024-04-25T09:03:34.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.714+0000 7f3536400640 1 --2- 172.21.15.173:0/2271566675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35300cc260 0x7f35300cc6b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3528009dc0 tx=0x7f352801c6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5697a4eea1795b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:34.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.714+0000 7f352fe00640 1 -- 172.21.15.173:0/2271566675 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35280b2070 con 0x7f35300cc260 2024-04-25T09:03:34.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.714+0000 7f352fe00640 1 -- 172.21.15.173:0/2271566675 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35280a5550 con 0x7f35300cc260 2024-04-25T09:03:34.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.714+0000 7f352fe00640 1 -- 172.21.15.173:0/2271566675 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c001600 con 0x7f35300cc260 2024-04-25T09:03:34.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3538400640 1 -- 172.21.15.173:0/2271566675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35300cc260 msgr2=0x7f35300cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3538400640 1 --2- 172.21.15.173:0/2271566675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35300cc260 0x7f35300cc6b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3528009dc0 tx=0x7f352801c6b0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3538400640 1 -- 172.21.15.173:0/2271566675 shutdown_connections 2024-04-25T09:03:34.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3538400640 1 --2- 172.21.15.173:0/2271566675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35300cc260 0x7f35300cc6b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3538400640 1 -- 172.21.15.173:0/2271566675 >> 172.21.15.173:0/2271566675 conn(0x7f353006ac90 msgr2=0x7f353006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:34.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3538400640 1 -- 172.21.15.173:0/2271566675 shutdown_connections 2024-04-25T09:03:34.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3538400640 1 -- 172.21.15.173:0/2271566675 wait complete. 2024-04-25T09:03:34.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3538400640 1 Processor -- start 2024-04-25T09:03:34.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3538400640 1 -- start start 2024-04-25T09:03:34.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3538400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35300b3fe0 0x7f35301385b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3538400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35300cc260 0x7f353015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3538400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3530145290 0x7f3530135320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3538400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353006f170 con 0x7f3530145290 2024-04-25T09:03:34.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3538400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353006eff0 con 0x7f35300cc260 2024-04-25T09:03:34.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3538400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35301360e0 con 0x7f35300b3fe0 2024-04-25T09:03:34.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3536400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3530145290 0x7f3530135320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3536400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3530145290 0x7f3530135320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56036/0 (socket says 172.21.15.173:56036) 2024-04-25T09:03:34.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3536400640 1 -- 172.21.15.173:0/3950649831 learned_addr learned my addr 172.21.15.173:0/3950649831 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:34.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3535000640 1 --2- 172.21.15.173:0/3950649831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35300cc260 0x7f353015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3535a00640 1 --2- 172.21.15.173:0/3950649831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35300b3fe0 0x7f35301385b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3536400640 1 -- 172.21.15.173:0/3950649831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35300b3fe0 msgr2=0x7f35301385b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3536400640 1 --2- 172.21.15.173:0/3950649831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35300b3fe0 0x7f35301385b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3536400640 1 -- 172.21.15.173:0/3950649831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35300cc260 msgr2=0x7f353015b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3536400640 1 --2- 172.21.15.173:0/3950649831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35300cc260 0x7f353015b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.718+0000 7f3536400640 1 -- 172.21.15.173:0/3950649831 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3530138af0 con 0x7f3530145290 2024-04-25T09:03:34.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.722+0000 7f3536400640 1 --2- 172.21.15.173:0/3950649831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3530145290 0x7f3530135320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f35280b0040 tx=0x7f3528019450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:34.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.722+0000 7f352d600640 1 -- 172.21.15.173:0/3950649831 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35280bd020 con 0x7f3530145290 2024-04-25T09:03:34.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.722+0000 7f352d600640 1 -- 172.21.15.173:0/3950649831 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35280b8670 con 0x7f3530145290 2024-04-25T09:03:34.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.722+0000 7f3538400640 1 -- 172.21.15.173:0/3950649831 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3530136330 con 0x7f3530145290 2024-04-25T09:03:34.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.722+0000 7f352d600640 1 -- 172.21.15.173:0/3950649831 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35280b2040 con 0x7f3530145290 2024-04-25T09:03:34.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.722+0000 7f3538400640 1 -- 172.21.15.173:0/3950649831 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3530133ad0 con 0x7f3530145290 2024-04-25T09:03:34.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.722+0000 7f3538400640 1 -- 172.21.15.173:0/3950649831 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3530073ab0 con 0x7f3530145290 2024-04-25T09:03:34.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.722+0000 7f352d600640 1 -- 172.21.15.173:0/3950649831 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f35280c0020 con 0x7f3530145290 2024-04-25T09:03:34.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.722+0000 7f352d600640 1 --2- 172.21.15.173:0/3950649831 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3510066f90 0x7f3510069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.722+0000 7f352d600640 1 -- 172.21.15.173:0/3950649831 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f352811fb90 con 0x7f3530145290 2024-04-25T09:03:34.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.722+0000 7f3535a00640 1 --2- 172.21.15.173:0/3950649831 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3510066f90 0x7f3510069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.726+0000 7f3535a00640 1 --2- 172.21.15.173:0/3950649831 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3510066f90 0x7f3510069450 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3524007fd0 tx=0x7f3524009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:34.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.726+0000 7f352d600640 1 -- 172.21.15.173:0/3950649831 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f35280c7070 con 0x7f3530145290 2024-04-25T09:03:34.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.882+0000 7f3538400640 1 -- 172.21.15.173:0/3950649831 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3530135ec0 con 0x7f3530145290 2024-04-25T09:03:34.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.882+0000 7f352d600640 1 -- 172.21.15.173:0/3950649831 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3528016480 con 0x7f3530145290 2024-04-25T09:03:34.870 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:34.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.882+0000 7f3538400640 1 -- 172.21.15.173:0/3950649831 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3510066f90 msgr2=0x7f3510069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.882+0000 7f3538400640 1 --2- 172.21.15.173:0/3950649831 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3510066f90 0x7f3510069450 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3524007fd0 tx=0x7f3524009040 comp rx=0 tx=0).stop 2024-04-25T09:03:34.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.882+0000 7f3538400640 1 -- 172.21.15.173:0/3950649831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3530145290 msgr2=0x7f3530135320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.882+0000 7f3538400640 1 --2- 172.21.15.173:0/3950649831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3530145290 0x7f3530135320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f35280b0040 tx=0x7f3528019450 comp rx=0 tx=0).stop 2024-04-25T09:03:34.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.882+0000 7f3538400640 1 -- 172.21.15.173:0/3950649831 shutdown_connections 2024-04-25T09:03:34.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.882+0000 7f3538400640 1 --2- 172.21.15.173:0/3950649831 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3510066f90 0x7f3510069450 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.882+0000 7f3538400640 1 --2- 172.21.15.173:0/3950649831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3530145290 0x7f3530135320 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.882+0000 7f3538400640 1 --2- 172.21.15.173:0/3950649831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35300cc260 0x7f353015b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.882+0000 7f3538400640 1 --2- 172.21.15.173:0/3950649831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35300b3fe0 0x7f35301385b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.882+0000 7f3538400640 1 -- 172.21.15.173:0/3950649831 >> 172.21.15.173:0/3950649831 conn(0x7f353006ac90 msgr2=0x7f353015df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:34.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.882+0000 7f3538400640 1 -- 172.21.15.173:0/3950649831 shutdown_connections 2024-04-25T09:03:34.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:34.882+0000 7f3538400640 1 -- 172.21.15.173:0/3950649831 wait complete. 2024-04-25T09:03:34.891 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:35.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.038+0000 7fcf5f800640 1 Processor -- start 2024-04-25T09:03:35.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.038+0000 7fcf5f800640 1 -- start start 2024-04-25T09:03:35.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.042+0000 7fcf5f800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcf58145290 0x7fcf5815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.042+0000 7fcf5f800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf580cc260 0x7fcf580cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.042+0000 7fcf5f800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5815c5f0 con 0x7fcf580b3fe0 2024-04-25T09:03:35.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.042+0000 7fcf5f800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5806d4b0 con 0x7fcf58145290 2024-04-25T09:03:35.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.042+0000 7fcf5f800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5806d790 con 0x7fcf580cc260 2024-04-25T09:03:35.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.042+0000 7fcf5ce00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcf58145290 0x7fcf5815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.042+0000 7fcf5ce00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcf58145290 0x7fcf5815c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56038/0 (socket says 172.21.15.173:56038) 2024-04-25T09:03:35.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.042+0000 7fcf5ce00640 1 -- 172.21.15.173:0/1504408215 learned_addr learned my addr 172.21.15.173:0/1504408215 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:35.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.042+0000 7fcf5d800640 1 --2- 172.21.15.173:0/1504408215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf580cc260 0x7fcf580cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.042+0000 7fcf5ce00640 1 -- 172.21.15.173:0/1504408215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf580cc260 msgr2=0x7fcf580cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:35.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.042+0000 7fcf5ce00640 1 --2- 172.21.15.173:0/1504408215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf580cc260 0x7fcf580cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.042+0000 7fcf5ce00640 1 -- 172.21.15.173:0/1504408215 >> v1:172.21.15.194:6789/0 conn(0x7fcf580b3fe0 legacy=0x7fcf580b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.042+0000 7fcf5ce00640 1 -- 172.21.15.173:0/1504408215 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5806da70 con 0x7fcf58145290 2024-04-25T09:03:35.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.046+0000 7fcf5ce00640 1 --2- 172.21.15.173:0/1504408215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf58145290 0x7fcf5815c0b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009870 tx=0x7fcf4801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413372122c3f78ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.046+0000 7fcf57e00640 1 -- 172.21.15.173:0/1504408215 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf480b0070 con 0x7fcf58145290 2024-04-25T09:03:35.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.046+0000 7fcf57e00640 1 -- 172.21.15.173:0/1504408215 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf48004230 con 0x7fcf58145290 2024-04-25T09:03:35.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.046+0000 7fcf57e00640 1 -- 172.21.15.173:0/1504408215 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48003620 con 0x7fcf58145290 2024-04-25T09:03:35.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.046+0000 7fcf5f800640 1 -- 172.21.15.173:0/1504408215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf58145290 msgr2=0x7fcf5815c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.046+0000 7fcf5f800640 1 --2- 172.21.15.173:0/1504408215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf58145290 0x7fcf5815c0b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009870 tx=0x7fcf4801c440 comp rx=0 tx=0).stop 2024-04-25T09:03:35.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.046+0000 7fcf5f800640 1 -- 172.21.15.173:0/1504408215 shutdown_connections 2024-04-25T09:03:35.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.046+0000 7fcf5f800640 1 --2- 172.21.15.173:0/1504408215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf580cc260 0x7fcf580cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.046+0000 7fcf5f800640 1 --2- 172.21.15.173:0/1504408215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf58145290 0x7fcf5815c0b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.046+0000 7fcf5f800640 1 -- 172.21.15.173:0/1504408215 >> 172.21.15.173:0/1504408215 conn(0x7fcf5806ac90 msgr2=0x7fcf5806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:35.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.046+0000 7fcf5f800640 1 -- 172.21.15.173:0/1504408215 shutdown_connections 2024-04-25T09:03:35.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.046+0000 7fcf5f800640 1 -- 172.21.15.173:0/1504408215 wait complete. 2024-04-25T09:03:35.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.046+0000 7fcf5f800640 1 Processor -- start 2024-04-25T09:03:35.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.046+0000 7fcf5f800640 1 -- start start 2024-04-25T09:03:35.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf5f800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf580b3fe0 0x7fcf58158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf5f800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf580cc260 0x7fcf580b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf5f800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf58145290 0x7fcf580b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf5f800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5806ed60 con 0x7fcf580cc260 2024-04-25T09:03:35.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf5f800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5806eee0 con 0x7fcf58145290 2024-04-25T09:03:35.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf5f800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5806f060 con 0x7fcf580b3fe0 2024-04-25T09:03:35.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf4fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf580cc260 0x7fcf580b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf4fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf580cc260 0x7fcf580b07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56042/0 (socket says 172.21.15.173:56042) 2024-04-25T09:03:35.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf4fe00640 1 -- 172.21.15.173:0/1447081833 learned_addr learned my addr 172.21.15.173:0/1447081833 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:35.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf5d800640 1 --2- 172.21.15.173:0/1447081833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf58145290 0x7fcf580b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf5ce00640 1 --2- 172.21.15.173:0/1447081833 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf580b3fe0 0x7fcf58158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf4fe00640 1 -- 172.21.15.173:0/1447081833 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf580b3fe0 msgr2=0x7fcf58158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf4fe00640 1 --2- 172.21.15.173:0/1447081833 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf580b3fe0 0x7fcf58158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf4fe00640 1 -- 172.21.15.173:0/1447081833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf58145290 msgr2=0x7fcf580b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf4fe00640 1 --2- 172.21.15.173:0/1447081833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf58145290 0x7fcf580b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf4fe00640 1 -- 172.21.15.173:0/1447081833 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf58159080 con 0x7fcf580cc260 2024-04-25T09:03:35.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf5ce00640 1 --2- 172.21.15.173:0/1447081833 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf580b3fe0 0x7fcf58158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:35.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf4fe00640 1 --2- 172.21.15.173:0/1447081833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf580cc260 0x7fcf580b07b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000c370 tx=0x7fcf4000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf55600640 1 -- 172.21.15.173:0/1447081833 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf400052d0 con 0x7fcf580cc260 2024-04-25T09:03:35.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf55600640 1 -- 172.21.15.173:0/1447081833 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf40005470 con 0x7fcf580cc260 2024-04-25T09:03:35.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf5f800640 1 -- 172.21.15.173:0/1447081833 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf58142800 con 0x7fcf580cc260 2024-04-25T09:03:35.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf55600640 1 -- 172.21.15.173:0/1447081833 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40007260 con 0x7fcf580cc260 2024-04-25T09:03:35.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf5f800640 1 -- 172.21.15.173:0/1447081833 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf58142dc0 con 0x7fcf580cc260 2024-04-25T09:03:35.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf5f800640 1 -- 172.21.15.173:0/1447081833 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf58073ab0 con 0x7fcf580cc260 2024-04-25T09:03:35.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.050+0000 7fcf55600640 1 -- 172.21.15.173:0/1447081833 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcf40007400 con 0x7fcf580cc260 2024-04-25T09:03:35.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.054+0000 7fcf55600640 1 --2- 172.21.15.173:0/1447081833 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcf34066f60 0x7fcf34069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.054+0000 7fcf55600640 1 -- 172.21.15.173:0/1447081833 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fcf400848b0 con 0x7fcf580cc260 2024-04-25T09:03:35.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.054+0000 7fcf5ce00640 1 --2- 172.21.15.173:0/1447081833 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcf34066f60 0x7fcf34069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.054+0000 7fcf5ce00640 1 --2- 172.21.15.173:0/1447081833 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcf34066f60 0x7fcf34069420 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcf480ad000 tx=0x7fcf48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.058+0000 7fcf55600640 1 -- 172.21.15.173:0/1447081833 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcf5815c5f0 con 0x7fcf580cc260 2024-04-25T09:03:35.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.210+0000 7fcf5f800640 1 -- 172.21.15.173:0/1447081833 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcf5813e680 con 0x7fcf580cc260 2024-04-25T09:03:35.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.210+0000 7fcf55600640 1 -- 172.21.15.173:0/1447081833 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcf40054dd0 con 0x7fcf580cc260 2024-04-25T09:03:35.201 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:03:35.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.214+0000 7fcf5f800640 1 -- 172.21.15.173:0/1447081833 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcf34066f60 msgr2=0x7fcf34069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.214+0000 7fcf5f800640 1 --2- 172.21.15.173:0/1447081833 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcf34066f60 0x7fcf34069420 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcf480ad000 tx=0x7fcf48008040 comp rx=0 tx=0).stop 2024-04-25T09:03:35.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.214+0000 7fcf5f800640 1 -- 172.21.15.173:0/1447081833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf580cc260 msgr2=0x7fcf580b07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.214+0000 7fcf5f800640 1 --2- 172.21.15.173:0/1447081833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf580cc260 0x7fcf580b07b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000c370 tx=0x7fcf4000c830 comp rx=0 tx=0).stop 2024-04-25T09:03:35.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.214+0000 7fcf5f800640 1 -- 172.21.15.173:0/1447081833 shutdown_connections 2024-04-25T09:03:35.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.214+0000 7fcf5f800640 1 --2- 172.21.15.173:0/1447081833 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcf34066f60 0x7fcf34069420 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.214+0000 7fcf5f800640 1 --2- 172.21.15.173:0/1447081833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf58145290 0x7fcf580b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.214+0000 7fcf5f800640 1 --2- 172.21.15.173:0/1447081833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf580cc260 0x7fcf580b07b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.214+0000 7fcf5f800640 1 --2- 172.21.15.173:0/1447081833 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf580b3fe0 0x7fcf58158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.214+0000 7fcf5f800640 1 -- 172.21.15.173:0/1447081833 >> 172.21.15.173:0/1447081833 conn(0x7fcf5806ac90 msgr2=0x7fcf5815dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:35.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.214+0000 7fcf5f800640 1 -- 172.21.15.173:0/1447081833 shutdown_connections 2024-04-25T09:03:35.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.214+0000 7fcf5f800640 1 -- 172.21.15.173:0/1447081833 wait complete. 2024-04-25T09:03:35.223 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:03:35.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.374+0000 7f164d000640 1 Processor -- start 2024-04-25T09:03:35.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.374+0000 7f164d000640 1 -- start start 2024-04-25T09:03:35.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.374+0000 7f164d000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1648145290 0x7f164815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.374+0000 7f164d000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f16480cc260 0x7f16480cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.374+0000 7f164d000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164815c5f0 con 0x7f16480b3fe0 2024-04-25T09:03:35.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.374+0000 7f164d000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164806d4b0 con 0x7f16480cc260 2024-04-25T09:03:35.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.374+0000 7f164d000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164806d790 con 0x7f1648145290 2024-04-25T09:03:35.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.374+0000 7f1646800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f16480cc260 0x7f16480cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.374+0000 7f1646800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f16480cc260 0x7f16480cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56046/0 (socket says 172.21.15.173:56046) 2024-04-25T09:03:35.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.374+0000 7f1646800640 1 -- 172.21.15.173:0/478609331 learned_addr learned my addr 172.21.15.173:0/478609331 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:35.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.374+0000 7f1645e00640 1 --2- 172.21.15.173:0/478609331 >> v2:172.21.15.194:3300/0 conn(0x7f1648145290 0x7f164815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.374+0000 7f1646800640 1 -- 172.21.15.173:0/478609331 >> v2:172.21.15.194:3300/0 conn(0x7f1648145290 msgr2=0x7f164815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:35.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.374+0000 7f1646800640 1 --2- 172.21.15.173:0/478609331 >> v2:172.21.15.194:3300/0 conn(0x7f1648145290 0x7f164815c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.374+0000 7f1646800640 1 -- 172.21.15.173:0/478609331 >> v1:172.21.15.194:6789/0 conn(0x7f16480b3fe0 legacy=0x7f16480b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:35.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.374+0000 7f1646800640 1 -- 172.21.15.173:0/478609331 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164806da70 con 0x7f16480cc260 2024-04-25T09:03:35.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.378+0000 7f1646800640 1 --2- 172.21.15.173:0/478609331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16480cc260 0x7f16480cc670 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f164815f5b0 tx=0x7f164001c1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a40185a82ff0ee4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.378+0000 7f1645400640 1 -- 172.21.15.173:0/478609331 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16400b0070 con 0x7f16480cc260 2024-04-25T09:03:35.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.378+0000 7f1645400640 1 -- 172.21.15.173:0/478609331 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16400ab600 con 0x7f16480cc260 2024-04-25T09:03:35.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.378+0000 7f1645400640 1 -- 172.21.15.173:0/478609331 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16400ab9d0 con 0x7f16480cc260 2024-04-25T09:03:35.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.378+0000 7f164d000640 1 -- 172.21.15.173:0/478609331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16480cc260 msgr2=0x7f16480cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.378+0000 7f164d000640 1 --2- 172.21.15.173:0/478609331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16480cc260 0x7f16480cc670 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f164815f5b0 tx=0x7f164001c1c0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.378+0000 7f164d000640 1 -- 172.21.15.173:0/478609331 shutdown_connections 2024-04-25T09:03:35.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.378+0000 7f164d000640 1 --2- 172.21.15.173:0/478609331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16480cc260 0x7f16480cc670 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.378+0000 7f164d000640 1 --2- 172.21.15.173:0/478609331 >> v2:172.21.15.194:3300/0 conn(0x7f1648145290 0x7f164815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.378+0000 7f164d000640 1 -- 172.21.15.173:0/478609331 >> 172.21.15.173:0/478609331 conn(0x7f164806ac90 msgr2=0x7f164806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:35.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.378+0000 7f164d000640 1 -- 172.21.15.173:0/478609331 shutdown_connections 2024-04-25T09:03:35.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.378+0000 7f164d000640 1 -- 172.21.15.173:0/478609331 wait complete. 2024-04-25T09:03:35.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.378+0000 7f164d000640 1 Processor -- start 2024-04-25T09:03:35.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.378+0000 7f164d000640 1 -- start start 2024-04-25T09:03:35.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f164d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16480b3fe0 0x7f16480ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f164d000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16480cc260 0x7f16480adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f164d000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1648145290 0x7f164815ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f164d000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164806eee0 con 0x7f16480cc260 2024-04-25T09:03:35.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f164d000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164806ed60 con 0x7f1648145290 2024-04-25T09:03:35.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f164d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164806f060 con 0x7f16480b3fe0 2024-04-25T09:03:35.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f163d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16480cc260 0x7f16480adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f163d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16480cc260 0x7f16480adb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56056/0 (socket says 172.21.15.173:56056) 2024-04-25T09:03:35.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f163d400640 1 -- 172.21.15.173:0/2576445841 learned_addr learned my addr 172.21.15.173:0/2576445841 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:35.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f1646800640 1 --2- 172.21.15.173:0/2576445841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1648145290 0x7f164815ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f1645e00640 1 --2- 172.21.15.173:0/2576445841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16480b3fe0 0x7f16480ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f163d400640 1 -- 172.21.15.173:0/2576445841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16480b3fe0 msgr2=0x7f16480ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f163d400640 1 --2- 172.21.15.173:0/2576445841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16480b3fe0 0x7f16480ad5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f163d400640 1 -- 172.21.15.173:0/2576445841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1648145290 msgr2=0x7f164815ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f163d400640 1 --2- 172.21.15.173:0/2576445841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1648145290 0x7f164815ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f163d400640 1 -- 172.21.15.173:0/2576445841 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164813e610 con 0x7f16480cc260 2024-04-25T09:03:35.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f1645e00640 1 --2- 172.21.15.173:0/2576445841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16480b3fe0 0x7f16480ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:35.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f163d400640 1 --2- 172.21.15.173:0/2576445841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16480cc260 0x7f16480adb20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f163000b410 tx=0x7f163000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f163ea00640 1 -- 172.21.15.173:0/2576445841 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1630015030 con 0x7f16480cc260 2024-04-25T09:03:35.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f163ea00640 1 -- 172.21.15.173:0/2576445841 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1630004020 con 0x7f16480cc260 2024-04-25T09:03:35.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f163ea00640 1 -- 172.21.15.173:0/2576445841 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1630004450 con 0x7f16480cc260 2024-04-25T09:03:35.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f164d000640 1 -- 172.21.15.173:0/2576445841 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164813e8b0 con 0x7f16480cc260 2024-04-25T09:03:35.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f164d000640 1 -- 172.21.15.173:0/2576445841 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164813ee70 con 0x7f16480cc260 2024-04-25T09:03:35.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f164d000640 1 -- 172.21.15.173:0/2576445841 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1648073ab0 con 0x7f16480cc260 2024-04-25T09:03:35.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.382+0000 7f163ea00640 1 -- 172.21.15.173:0/2576445841 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1630018070 con 0x7f16480cc260 2024-04-25T09:03:35.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.386+0000 7f163ea00640 1 --2- 172.21.15.173:0/2576445841 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1624066f60 0x7f1624069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.386+0000 7f163ea00640 1 -- 172.21.15.173:0/2576445841 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f1630084f30 con 0x7f16480cc260 2024-04-25T09:03:35.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.386+0000 7f1645e00640 1 --2- 172.21.15.173:0/2576445841 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1624066f60 0x7f1624069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.386+0000 7f1645e00640 1 --2- 172.21.15.173:0/2576445841 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1624066f60 0x7f1624069420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1638003fd0 tx=0x7f1638003a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.390+0000 7f163ea00640 1 -- 172.21.15.173:0/2576445841 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1630055b30 con 0x7f16480cc260 2024-04-25T09:03:35.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.542+0000 7f164d000640 1 -- 172.21.15.173:0/2576445841 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f164806c300 con 0x7f16480cc260 2024-04-25T09:03:35.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.542+0000 7f163ea00640 1 -- 172.21.15.173:0/2576445841 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1630055430 con 0x7f16480cc260 2024-04-25T09:03:35.532 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:35.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.546+0000 7f164d000640 1 -- 172.21.15.173:0/2576445841 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1624066f60 msgr2=0x7f1624069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.546+0000 7f164d000640 1 --2- 172.21.15.173:0/2576445841 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1624066f60 0x7f1624069420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1638003fd0 tx=0x7f1638003a00 comp rx=0 tx=0).stop 2024-04-25T09:03:35.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.546+0000 7f164d000640 1 -- 172.21.15.173:0/2576445841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16480cc260 msgr2=0x7f16480adb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.546+0000 7f164d000640 1 --2- 172.21.15.173:0/2576445841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16480cc260 0x7f16480adb20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f163000b410 tx=0x7f163000b8d0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.546+0000 7f164d000640 1 -- 172.21.15.173:0/2576445841 shutdown_connections 2024-04-25T09:03:35.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.546+0000 7f164d000640 1 --2- 172.21.15.173:0/2576445841 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1624066f60 0x7f1624069420 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.546+0000 7f164d000640 1 --2- 172.21.15.173:0/2576445841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1648145290 0x7f164815ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.546+0000 7f164d000640 1 --2- 172.21.15.173:0/2576445841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16480cc260 0x7f16480adb20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.546+0000 7f164d000640 1 --2- 172.21.15.173:0/2576445841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16480b3fe0 0x7f16480ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.546+0000 7f164d000640 1 -- 172.21.15.173:0/2576445841 >> 172.21.15.173:0/2576445841 conn(0x7f164806ac90 msgr2=0x7f164806b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:35.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.546+0000 7f164d000640 1 -- 172.21.15.173:0/2576445841 shutdown_connections 2024-04-25T09:03:35.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.546+0000 7f164d000640 1 -- 172.21.15.173:0/2576445841 wait complete. 2024-04-25T09:03:35.563 INFO:tasks.cephfs_test_runner:Starting test: test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) test flag scrub_mdsdir 2024-04-25T09:03:35.564 INFO:tasks.cephfs_test_runner:test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-04-25T09:03:35.564 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:35.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.710+0000 7f9578200640 1 Processor -- start 2024-04-25T09:03:35.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.710+0000 7f9578200640 1 -- start start 2024-04-25T09:03:35.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.710+0000 7f9578200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f957015e040 0x7f95700ace10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.710+0000 7f9578200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f95700ad350 0x7f95700ae810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.710+0000 7f9578200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f957015e8e0 con 0x7f957015dc60 2024-04-25T09:03:35.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.710+0000 7f9578200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9570071450 con 0x7f95700ad350 2024-04-25T09:03:35.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.710+0000 7f9578200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957015ebc0 con 0x7f957015e040 2024-04-25T09:03:35.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.710+0000 7f9576200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f95700ad350 0x7f95700ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.710+0000 7f9576200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f95700ad350 0x7f95700ae810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:41522/0 (socket says 172.21.15.173:41522) 2024-04-25T09:03:35.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.710+0000 7f9576200640 1 -- 172.21.15.173:0/1742989501 learned_addr learned my addr 172.21.15.173:0/1742989501 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:35.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.710+0000 7f9575800640 1 --1- 172.21.15.173:0/1742989501 >> v1:172.21.15.194:6789/0 conn(0x7f957015dc60 0x7f95700b3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:52912/0 (socket says 172.21.15.173:52912) 2024-04-25T09:03:35.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.710+0000 7f9574e00640 1 --2- 172.21.15.173:0/1742989501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f957015e040 0x7f95700ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.714+0000 7f9576200640 1 -- 172.21.15.173:0/1742989501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f957015e040 msgr2=0x7f95700ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:35.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.714+0000 7f9576200640 1 --2- 172.21.15.173:0/1742989501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f957015e040 0x7f95700ace10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.714+0000 7f9576200640 1 -- 172.21.15.173:0/1742989501 >> v1:172.21.15.194:6789/0 conn(0x7f957015dc60 legacy=0x7f95700b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.714+0000 7f9576200640 1 -- 172.21.15.173:0/1742989501 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957015eea0 con 0x7f95700ad350 2024-04-25T09:03:35.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.714+0000 7f956fe00640 1 -- 172.21.15.173:0/1742989501 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933456746 0 0) 0x7f957015e8e0 con 0x7f957015dc60 2024-04-25T09:03:35.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.714+0000 7f9576200640 1 --2- 172.21.15.173:0/1742989501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95700ad350 0x7f95700ae810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9568009e50 tx=0x7f956801ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db07e964dcbb975b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.714+0000 7f956fe00640 1 -- 172.21.15.173:0/1742989501 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95680a5700 con 0x7f95700ad350 2024-04-25T09:03:35.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.714+0000 7f956fe00640 1 -- 172.21.15.173:0/1742989501 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95680a58a0 con 0x7f95700ad350 2024-04-25T09:03:35.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.714+0000 7f956fe00640 1 -- 172.21.15.173:0/1742989501 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95680a5c70 con 0x7f95700ad350 2024-04-25T09:03:35.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9578200640 1 -- 172.21.15.173:0/1742989501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95700ad350 msgr2=0x7f95700ae810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9578200640 1 --2- 172.21.15.173:0/1742989501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95700ad350 0x7f95700ae810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9568009e50 tx=0x7f956801ca30 comp rx=0 tx=0).stop 2024-04-25T09:03:35.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9578200640 1 -- 172.21.15.173:0/1742989501 shutdown_connections 2024-04-25T09:03:35.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9578200640 1 --2- 172.21.15.173:0/1742989501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95700ad350 0x7f95700ae810 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9578200640 1 --2- 172.21.15.173:0/1742989501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f957015e040 0x7f95700ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9578200640 1 -- 172.21.15.173:0/1742989501 >> 172.21.15.173:0/1742989501 conn(0x7f957006ac90 msgr2=0x7f957006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:35.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9578200640 1 -- 172.21.15.173:0/1742989501 shutdown_connections 2024-04-25T09:03:35.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9578200640 1 -- 172.21.15.173:0/1742989501 wait complete. 2024-04-25T09:03:35.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9578200640 1 Processor -- start 2024-04-25T09:03:35.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9578200640 1 -- start start 2024-04-25T09:03:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9578200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95700ad350 0x7f95700b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9578200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f957015dc60 0x7f95700cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9578200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f957015e040 0x7f95701552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9578200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957016ab90 con 0x7f957015dc60 2024-04-25T09:03:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9578200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957015e660 con 0x7f957015e040 2024-04-25T09:03:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9578200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957016ad10 con 0x7f95700ad350 2024-04-25T09:03:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9574e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f957015dc60 0x7f95700cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9574e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f957015dc60 0x7f95700cc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56060/0 (socket says 172.21.15.173:56060) 2024-04-25T09:03:35.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9574e00640 1 -- 172.21.15.173:0/325527087 learned_addr learned my addr 172.21.15.173:0/325527087 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:35.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9575800640 1 --2- 172.21.15.173:0/325527087 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95700ad350 0x7f95700b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9576200640 1 --2- 172.21.15.173:0/325527087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f957015e040 0x7f95701552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9574e00640 1 -- 172.21.15.173:0/325527087 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95700ad350 msgr2=0x7f95700b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9574e00640 1 --2- 172.21.15.173:0/325527087 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95700ad350 0x7f95700b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9574e00640 1 -- 172.21.15.173:0/325527087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f957015e040 msgr2=0x7f95701552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9574e00640 1 --2- 172.21.15.173:0/325527087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f957015e040 0x7f95701552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.718+0000 7f9574e00640 1 -- 172.21.15.173:0/325527087 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957015b6d0 con 0x7f957015dc60 2024-04-25T09:03:35.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.722+0000 7f9574e00640 1 --2- 172.21.15.173:0/325527087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f957015dc60 0x7f95700cc480 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f955c00e870 tx=0x7f955c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.722+0000 7f956d600640 1 -- 172.21.15.173:0/325527087 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c017070 con 0x7f957015dc60 2024-04-25T09:03:35.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.722+0000 7f956d600640 1 -- 172.21.15.173:0/325527087 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955c00c940 con 0x7f957015dc60 2024-04-25T09:03:35.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.722+0000 7f956d600640 1 -- 172.21.15.173:0/325527087 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c00ccf0 con 0x7f957015dc60 2024-04-25T09:03:35.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.722+0000 7f9578200640 1 -- 172.21.15.173:0/325527087 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95700cd1b0 con 0x7f957015dc60 2024-04-25T09:03:35.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.722+0000 7f9578200640 1 -- 172.21.15.173:0/325527087 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957015bc50 con 0x7f957015dc60 2024-04-25T09:03:35.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.722+0000 7f9578200640 1 -- 172.21.15.173:0/325527087 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95700ccf30 con 0x7f957015dc60 2024-04-25T09:03:35.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.722+0000 7f956d600640 1 -- 172.21.15.173:0/325527087 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f955c01a070 con 0x7f957015dc60 2024-04-25T09:03:35.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.722+0000 7f956d600640 1 --2- 172.21.15.173:0/325527087 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9550066f60 0x7f9550069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.722+0000 7f956d600640 1 -- 172.21.15.173:0/325527087 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f955c0852d0 con 0x7f957015dc60 2024-04-25T09:03:35.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.722+0000 7f9575800640 1 --2- 172.21.15.173:0/325527087 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9550066f60 0x7f9550069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.726+0000 7f9575800640 1 --2- 172.21.15.173:0/325527087 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9550066f60 0x7f9550069420 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9564007fd0 tx=0x7f9564007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.726+0000 7f956d600640 1 -- 172.21.15.173:0/325527087 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f95700ccf30 con 0x7f957015dc60 2024-04-25T09:03:35.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.882+0000 7f9578200640 1 -- 172.21.15.173:0/325527087 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9570073a40 con 0x7f957015dc60 2024-04-25T09:03:35.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.886+0000 7f956d600640 1 -- 172.21.15.173:0/325527087 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18906 (secure 0 0 0) 0x7f955c055800 con 0x7f957015dc60 2024-04-25T09:03:35.874 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:35.874 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":28,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:03:32.190313+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:35.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.886+0000 7f9578200640 1 -- 172.21.15.173:0/325527087 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9550066f60 msgr2=0x7f9550069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.886+0000 7f9578200640 1 --2- 172.21.15.173:0/325527087 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9550066f60 0x7f9550069420 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9564007fd0 tx=0x7f9564007d60 comp rx=0 tx=0).stop 2024-04-25T09:03:35.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.886+0000 7f9578200640 1 -- 172.21.15.173:0/325527087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f957015dc60 msgr2=0x7f95700cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.886+0000 7f9578200640 1 --2- 172.21.15.173:0/325527087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f957015dc60 0x7f95700cc480 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f955c00e870 tx=0x7f955c00ec70 comp rx=0 tx=0).stop 2024-04-25T09:03:35.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.886+0000 7f9578200640 1 -- 172.21.15.173:0/325527087 shutdown_connections 2024-04-25T09:03:35.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.886+0000 7f9578200640 1 --2- 172.21.15.173:0/325527087 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9550066f60 0x7f9550069420 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.886+0000 7f9578200640 1 --2- 172.21.15.173:0/325527087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f957015e040 0x7f95701552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.886+0000 7f9578200640 1 --2- 172.21.15.173:0/325527087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f957015dc60 0x7f95700cc480 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.886+0000 7f9578200640 1 --2- 172.21.15.173:0/325527087 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95700ad350 0x7f95700b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.886+0000 7f9578200640 1 -- 172.21.15.173:0/325527087 >> 172.21.15.173:0/325527087 conn(0x7f957006ac90 msgr2=0x7f95700b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:35.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.886+0000 7f9578200640 1 -- 172.21.15.173:0/325527087 shutdown_connections 2024-04-25T09:03:35.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:35.886+0000 7f9578200640 1 -- 172.21.15.173:0/325527087 wait complete. 2024-04-25T09:03:35.895 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:02:49.342297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:02:50.386069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:02:54.077429+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:03:35.896 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:36.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.046+0000 7f0d7c400640 1 Processor -- start 2024-04-25T09:03:36.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.046+0000 7f0d7c400640 1 -- start start 2024-04-25T09:03:36.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.046+0000 7f0d7c400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0d740cc7e0 0x7f0d740cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.046+0000 7f0d7c400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d74071570 con 0x7f0d740aef70 2024-04-25T09:03:36.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.046+0000 7f0d7c400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d74071850 con 0x7f0d740aeb90 2024-04-25T09:03:36.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.046+0000 7f0d7c400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d74071320 con 0x7f0d740cc7e0 2024-04-25T09:03:36.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.046+0000 7f0d7a400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f0d740aef70 0x7f0d7415af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46466/0 (socket says 172.21.15.173:46466) 2024-04-25T09:03:36.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.046+0000 7f0d7a400640 1 -- 172.21.15.173:0/878899824 learned_addr learned my addr 172.21.15.173:0/878899824 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:36.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d73e00640 1 -- 172.21.15.173:0/878899824 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620749320 0 0) 0x7f0d74071570 con 0x7f0d740aef70 2024-04-25T09:03:36.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d73e00640 1 -- 172.21.15.173:0/878899824 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d5c003530 con 0x7f0d740aef70 2024-04-25T09:03:36.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d79000640 1 --2- 172.21.15.173:0/878899824 >> v2:172.21.15.194:3300/0 conn(0x7f0d740cc7e0 0x7f0d740cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d73e00640 1 -- 172.21.15.173:0/878899824 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4131035571 0 0) 0x7f0d5c003530 con 0x7f0d740aef70 2024-04-25T09:03:36.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d73e00640 1 -- 172.21.15.173:0/878899824 >> v2:172.21.15.194:3300/0 conn(0x7f0d740cc7e0 msgr2=0x7f0d740cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d73e00640 1 --2- 172.21.15.173:0/878899824 >> v2:172.21.15.194:3300/0 conn(0x7f0d740cc7e0 0x7f0d740cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d73e00640 1 -- 172.21.15.173:0/878899824 >> v1:172.21.15.194:6789/0 conn(0x7f0d740aeb90 legacy=0x7f0d740cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d73e00640 1 -- 172.21.15.173:0/878899824 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d74071b30 con 0x7f0d740aef70 2024-04-25T09:03:36.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d73e00640 1 -- 172.21.15.173:0/878899824 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f0d6c001a20 con 0x7f0d740aef70 2024-04-25T09:03:36.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d73e00640 1 -- 172.21.15.173:0/878899824 >> v1:172.21.15.173:6789/0 conn(0x7f0d740aef70 legacy=0x7f0d7415af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d73e00640 1 --2- 172.21.15.173:0/878899824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d5c0039c0 0x7f0d5c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d73e00640 1 --2- 172.21.15.173:0/878899824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d5c004810 0x7f0d5c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d73e00640 1 --2- 172.21.15.173:0/878899824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d5c0051d0 0x7f0d5c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d73e00640 1 -- 172.21.15.173:0/878899824 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d74071320 con 0x7f0d5c004810 2024-04-25T09:03:36.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d73e00640 1 -- 172.21.15.173:0/878899824 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c00c170 con 0x7f0d5c0051d0 2024-04-25T09:03:36.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d73e00640 1 -- 172.21.15.173:0/878899824 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c00c370 con 0x7f0d5c0039c0 2024-04-25T09:03:36.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d79000640 1 --2- 172.21.15.173:0/878899824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d5c004810 0x7f0d5c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d7a400640 1 --2- 172.21.15.173:0/878899824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d5c0051d0 0x7f0d5c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d79a00640 1 --2- 172.21.15.173:0/878899824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d5c0039c0 0x7f0d5c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d79000640 1 -- 172.21.15.173:0/878899824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d5c0039c0 msgr2=0x7f0d5c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d79000640 1 --2- 172.21.15.173:0/878899824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d5c0039c0 0x7f0d5c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d79000640 1 -- 172.21.15.173:0/878899824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d5c0051d0 msgr2=0x7f0d5c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d79000640 1 --2- 172.21.15.173:0/878899824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d5c0051d0 0x7f0d5c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d7a400640 1 -- 172.21.15.173:0/878899824 reap_dead start 2024-04-25T09:03:36.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.050+0000 7f0d79000640 1 -- 172.21.15.173:0/878899824 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c003530 con 0x7f0d5c004810 2024-04-25T09:03:36.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d79000640 1 --2- 172.21.15.173:0/878899824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d5c004810 0x7f0d5c004c90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009670 tx=0x7f0d6001eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0cbf8515b0bb82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d73e00640 1 -- 172.21.15.173:0/878899824 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d600b4070 con 0x7f0d5c004810 2024-04-25T09:03:36.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d73e00640 1 -- 172.21.15.173:0/878899824 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d600a7790 con 0x7f0d5c004810 2024-04-25T09:03:36.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d73e00640 1 -- 172.21.15.173:0/878899824 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d600096b0 con 0x7f0d5c004810 2024-04-25T09:03:36.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d7c400640 1 -- 172.21.15.173:0/878899824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d5c004810 msgr2=0x7f0d5c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d7c400640 1 --2- 172.21.15.173:0/878899824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d5c004810 0x7f0d5c004c90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009670 tx=0x7f0d6001eca0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d7c400640 1 -- 172.21.15.173:0/878899824 shutdown_connections 2024-04-25T09:03:36.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d7c400640 1 --2- 172.21.15.173:0/878899824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d5c004810 0x7f0d5c004c90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d7c400640 1 -- 172.21.15.173:0/878899824 >> 172.21.15.173:0/878899824 conn(0x7f0d7406ac90 msgr2=0x7f0d7406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d7c400640 1 -- 172.21.15.173:0/878899824 shutdown_connections 2024-04-25T09:03:36.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d7c400640 1 -- 172.21.15.173:0/878899824 wait complete. 2024-04-25T09:03:36.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d7c400640 1 Processor -- start 2024-04-25T09:03:36.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d7c400640 1 -- start start 2024-04-25T09:03:36.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d7c400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d5c004810 0x7f0d7415ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d7c400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d74150a40 0x7f0d741e9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d7c400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d7415c9d0 0x7f0d7415ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d7c400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7415e980 con 0x7f0d74150a40 2024-04-25T09:03:36.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d7c400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7415e800 con 0x7f0d5c004810 2024-04-25T09:03:36.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d7c400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7415eb00 con 0x7f0d7415c9d0 2024-04-25T09:03:36.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.054+0000 7f0d79000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d74150a40 0x7f0d741e9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.058+0000 7f0d79000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d74150a40 0x7f0d741e9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56082/0 (socket says 172.21.15.173:56082) 2024-04-25T09:03:36.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.058+0000 7f0d79000640 1 -- 172.21.15.173:0/385403210 learned_addr learned my addr 172.21.15.173:0/385403210 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:36.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.058+0000 7f0d79000640 1 -- 172.21.15.173:0/385403210 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d7415c9d0 msgr2=0x7f0d7415ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.058+0000 7f0d79000640 1 --2- 172.21.15.173:0/385403210 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d7415c9d0 0x7f0d7415ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.058+0000 7f0d79000640 1 -- 172.21.15.173:0/385403210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d5c004810 msgr2=0x7f0d7415ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.058+0000 7f0d79000640 1 --2- 172.21.15.173:0/385403210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d5c004810 0x7f0d7415ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.058+0000 7f0d79000640 1 -- 172.21.15.173:0/385403210 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7415b500 con 0x7f0d74150a40 2024-04-25T09:03:36.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.058+0000 7f0d79000640 1 --2- 172.21.15.173:0/385403210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d74150a40 0x7f0d741e9cf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0d600251d0 tx=0x7f0d6001ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.058+0000 7f0d71600640 1 -- 172.21.15.173:0/385403210 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d600b4030 con 0x7f0d74150a40 2024-04-25T09:03:36.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.058+0000 7f0d71600640 1 -- 172.21.15.173:0/385403210 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d600b6070 con 0x7f0d74150a40 2024-04-25T09:03:36.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.058+0000 7f0d71600640 1 -- 172.21.15.173:0/385403210 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d600096b0 con 0x7f0d74150a40 2024-04-25T09:03:36.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.058+0000 7f0d7c400640 1 -- 172.21.15.173:0/385403210 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7415b7e0 con 0x7f0d74150a40 2024-04-25T09:03:36.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.058+0000 7f0d7c400640 1 -- 172.21.15.173:0/385403210 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7415bda0 con 0x7f0d74150a40 2024-04-25T09:03:36.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.058+0000 7f0d7c400640 1 -- 172.21.15.173:0/385403210 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d74073ab0 con 0x7f0d74150a40 2024-04-25T09:03:36.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.058+0000 7f0d71600640 1 -- 172.21.15.173:0/385403210 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0d600b8070 con 0x7f0d74150a40 2024-04-25T09:03:36.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.058+0000 7f0d71600640 1 --2- 172.21.15.173:0/385403210 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d54066f60 0x7f0d54069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.058+0000 7f0d71600640 1 -- 172.21.15.173:0/385403210 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f0d6011e4f0 con 0x7f0d74150a40 2024-04-25T09:03:36.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.062+0000 7f0d79a00640 1 --2- 172.21.15.173:0/385403210 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d54066f60 0x7f0d54069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.062+0000 7f0d79a00640 1 --2- 172.21.15.173:0/385403210 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d54066f60 0x7f0d54069420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0d74068ce0 tx=0x7f0d68009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.062+0000 7f0d71600640 1 -- 172.21.15.173:0/385403210 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0d600189b0 con 0x7f0d74150a40 2024-04-25T09:03:36.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.222+0000 7f0d7c400640 1 -- 172.21.15.173:0/385403210 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d74160110 con 0x7f0d74150a40 2024-04-25T09:03:36.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.222+0000 7f0d71600640 1 -- 172.21.15.173:0/385403210 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d600ee980 con 0x7f0d74150a40 2024-04-25T09:03:36.211 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:03:36.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.222+0000 7f0d7c400640 1 -- 172.21.15.173:0/385403210 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d54066f60 msgr2=0x7f0d54069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.222+0000 7f0d7c400640 1 --2- 172.21.15.173:0/385403210 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d54066f60 0x7f0d54069420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0d74068ce0 tx=0x7f0d68009040 comp rx=0 tx=0).stop 2024-04-25T09:03:36.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.222+0000 7f0d7c400640 1 -- 172.21.15.173:0/385403210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d74150a40 msgr2=0x7f0d741e9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.222+0000 7f0d7c400640 1 --2- 172.21.15.173:0/385403210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d74150a40 0x7f0d741e9cf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0d600251d0 tx=0x7f0d6001ba40 comp rx=0 tx=0).stop 2024-04-25T09:03:36.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.222+0000 7f0d7c400640 1 -- 172.21.15.173:0/385403210 shutdown_connections 2024-04-25T09:03:36.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.222+0000 7f0d7c400640 1 --2- 172.21.15.173:0/385403210 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d54066f60 0x7f0d54069420 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.222+0000 7f0d7c400640 1 --2- 172.21.15.173:0/385403210 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d7415c9d0 0x7f0d7415ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.222+0000 7f0d7c400640 1 --2- 172.21.15.173:0/385403210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d74150a40 0x7f0d741e9cf0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.222+0000 7f0d7c400640 1 --2- 172.21.15.173:0/385403210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d5c004810 0x7f0d7415ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.222+0000 7f0d7c400640 1 -- 172.21.15.173:0/385403210 >> 172.21.15.173:0/385403210 conn(0x7f0d7406ac90 msgr2=0x7f0d7406d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.222+0000 7f0d7c400640 1 -- 172.21.15.173:0/385403210 shutdown_connections 2024-04-25T09:03:36.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.222+0000 7f0d7c400640 1 -- 172.21.15.173:0/385403210 wait complete. 2024-04-25T09:03:36.232 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:36.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.382+0000 7fe461a00640 1 Processor -- start 2024-04-25T09:03:36.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.382+0000 7fe461a00640 1 -- start start 2024-04-25T09:03:36.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.382+0000 7fe461a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe45c06e1c0 0x7fe45c06bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.382+0000 7fe461a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe45c06c410 0x7fe45c0aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.382+0000 7fe461a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe45c06ae30 con 0x7fe45c0ad3f0 2024-04-25T09:03:36.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.382+0000 7fe461a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45c0b3170 con 0x7fe45c06c410 2024-04-25T09:03:36.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.382+0000 7fe461a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c15e070 con 0x7fe45c06e1c0 2024-04-25T09:03:36.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45b400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe45c0ad3f0 0x7fe45c06e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46482/0 (socket says 172.21.15.173:46482) 2024-04-25T09:03:36.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45b400640 1 -- 172.21.15.173:0/4080789341 learned_addr learned my addr 172.21.15.173:0/4080789341 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:36.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45aa00640 1 --2- 172.21.15.173:0/4080789341 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe45c06e1c0 0x7fe45c06bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe452000640 1 --2- 172.21.15.173:0/4080789341 >> v2:172.21.15.194:3300/0 conn(0x7fe45c06c410 0x7fe45c0aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45a000640 1 -- 172.21.15.173:0/4080789341 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190600829 0 0) 0x7fe45c06ae30 con 0x7fe45c0ad3f0 2024-04-25T09:03:36.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45a000640 1 -- 172.21.15.173:0/4080789341 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe440003530 con 0x7fe45c0ad3f0 2024-04-25T09:03:36.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45a000640 1 -- 172.21.15.173:0/4080789341 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3047805079 0 0) 0x7fe440003530 con 0x7fe45c0ad3f0 2024-04-25T09:03:36.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45a000640 1 -- 172.21.15.173:0/4080789341 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe45c06e1c0 msgr2=0x7fe45c06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45a000640 1 --2- 172.21.15.173:0/4080789341 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe45c06e1c0 0x7fe45c06bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45a000640 1 -- 172.21.15.173:0/4080789341 >> v2:172.21.15.194:3300/0 conn(0x7fe45c06c410 msgr2=0x7fe45c0aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45a000640 1 --2- 172.21.15.173:0/4080789341 >> v2:172.21.15.194:3300/0 conn(0x7fe45c06c410 0x7fe45c0aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45a000640 1 -- 172.21.15.173:0/4080789341 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c06b110 con 0x7fe45c0ad3f0 2024-04-25T09:03:36.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45a000640 1 -- 172.21.15.173:0/4080789341 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fe454001a00 con 0x7fe45c0ad3f0 2024-04-25T09:03:36.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45a000640 1 -- 172.21.15.173:0/4080789341 >> v1:172.21.15.173:6789/0 conn(0x7fe45c0ad3f0 legacy=0x7fe45c06e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45a000640 1 --2- 172.21.15.173:0/4080789341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4400039c0 0x7fe440003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45a000640 1 --2- 172.21.15.173:0/4080789341 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe45c06e1c0 0x7fe440004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45a000640 1 --2- 172.21.15.173:0/4080789341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe440004d50 0x7fe4400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45a000640 1 -- 172.21.15.173:0/4080789341 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c15e070 con 0x7fe440004d50 2024-04-25T09:03:36.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45a000640 1 -- 172.21.15.173:0/4080789341 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44000b9d0 con 0x7fe4400039c0 2024-04-25T09:03:36.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45a000640 1 -- 172.21.15.173:0/4080789341 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44000bb50 con 0x7fe45c06e1c0 2024-04-25T09:03:36.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45b400640 1 --2- 172.21.15.173:0/4080789341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe440004d50 0x7fe4400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45aa00640 1 --2- 172.21.15.173:0/4080789341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4400039c0 0x7fe440003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe452000640 1 --2- 172.21.15.173:0/4080789341 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe45c06e1c0 0x7fe440004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45b400640 1 -- 172.21.15.173:0/4080789341 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe45c06e1c0 msgr2=0x7fe440004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45b400640 1 --2- 172.21.15.173:0/4080789341 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe45c06e1c0 0x7fe440004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45b400640 1 -- 172.21.15.173:0/4080789341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4400039c0 msgr2=0x7fe440003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45b400640 1 --2- 172.21.15.173:0/4080789341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4400039c0 0x7fe440003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe45b400640 1 -- 172.21.15.173:0/4080789341 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe440003530 con 0x7fe440004d50 2024-04-25T09:03:36.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.386+0000 7fe452000640 1 --2- 172.21.15.173:0/4080789341 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe45c06e1c0 0x7fe440004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:36.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe45b400640 1 --2- 172.21.15.173:0/4080789341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe440004d50 0x7fe4400051d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe45400a860 tx=0x7fe45401d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cebd1f3889aaa34 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe45a000640 1 -- 172.21.15.173:0/4080789341 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45400a480 con 0x7fe440004d50 2024-04-25T09:03:36.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe45a000640 1 -- 172.21.15.173:0/4080789341 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4540ad630 con 0x7fe440004d50 2024-04-25T09:03:36.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe45a000640 1 -- 172.21.15.173:0/4080789341 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4540ada40 con 0x7fe440004d50 2024-04-25T09:03:36.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe461a00640 1 -- 172.21.15.173:0/4080789341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe440004d50 msgr2=0x7fe4400051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe461a00640 1 --2- 172.21.15.173:0/4080789341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe440004d50 0x7fe4400051d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe45400a860 tx=0x7fe45401d380 comp rx=0 tx=0).stop 2024-04-25T09:03:36.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe45b400640 1 -- 172.21.15.173:0/4080789341 reap_dead start 2024-04-25T09:03:36.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe461a00640 1 -- 172.21.15.173:0/4080789341 shutdown_connections 2024-04-25T09:03:36.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe461a00640 1 -- 172.21.15.173:0/4080789341 >> 172.21.15.173:0/4080789341 conn(0x7fe45c0cfed0 msgr2=0x7fe45c0d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe461a00640 1 -- 172.21.15.173:0/4080789341 shutdown_connections 2024-04-25T09:03:36.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe461a00640 1 -- 172.21.15.173:0/4080789341 wait complete. 2024-04-25T09:03:36.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe461a00640 1 Processor -- start 2024-04-25T09:03:36.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe461a00640 1 -- start start 2024-04-25T09:03:36.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe461a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe440004d50 0x7fe45c14bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe461a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe45c157cf0 0x7fe45c158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe461a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe45c1f4840 0x7fe45c1f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe461a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c06b9b0 con 0x7fe440004d50 2024-04-25T09:03:36.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe461a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c06b6d0 con 0x7fe45c1f4840 2024-04-25T09:03:36.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.390+0000 7fe461a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c0ad8a0 con 0x7fe45c157cf0 2024-04-25T09:03:36.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe45aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe440004d50 0x7fe45c14bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe45aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe440004d50 0x7fe45c14bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56106/0 (socket says 172.21.15.173:56106) 2024-04-25T09:03:36.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe45aa00640 1 -- 172.21.15.173:0/1704975389 learned_addr learned my addr 172.21.15.173:0/1704975389 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:36.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe452000640 1 --2- 172.21.15.173:0/1704975389 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe45c157cf0 0x7fe45c158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe45b400640 1 --2- 172.21.15.173:0/1704975389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe45c1f4840 0x7fe45c1f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe45aa00640 1 -- 172.21.15.173:0/1704975389 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe45c157cf0 msgr2=0x7fe45c158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe45aa00640 1 --2- 172.21.15.173:0/1704975389 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe45c157cf0 0x7fe45c158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe45aa00640 1 -- 172.21.15.173:0/1704975389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe45c1f4840 msgr2=0x7fe45c1f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe45aa00640 1 --2- 172.21.15.173:0/1704975389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe45c1f4840 0x7fe45c1f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe45aa00640 1 -- 172.21.15.173:0/1704975389 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c1e72d0 con 0x7fe440004d50 2024-04-25T09:03:36.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe452000640 1 --2- 172.21.15.173:0/1704975389 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe45c157cf0 0x7fe45c158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:36.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe45aa00640 1 --2- 172.21.15.173:0/1704975389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe440004d50 0x7fe45c14bc40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe44c011990 tx=0x7fe44c011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe453400640 1 -- 172.21.15.173:0/1704975389 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c00fad0 con 0x7fe440004d50 2024-04-25T09:03:36.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe453400640 1 -- 172.21.15.173:0/1704975389 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c00fc70 con 0x7fe440004d50 2024-04-25T09:03:36.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe453400640 1 -- 172.21.15.173:0/1704975389 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c014440 con 0x7fe440004d50 2024-04-25T09:03:36.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe461a00640 1 -- 172.21.15.173:0/1704975389 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45c157210 con 0x7fe440004d50 2024-04-25T09:03:36.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe461a00640 1 -- 172.21.15.173:0/1704975389 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45c1577d0 con 0x7fe440004d50 2024-04-25T09:03:36.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe461a00640 1 -- 172.21.15.173:0/1704975389 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45c073ab0 con 0x7fe440004d50 2024-04-25T09:03:36.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe453400640 1 -- 172.21.15.173:0/1704975389 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe44c012040 con 0x7fe440004d50 2024-04-25T09:03:36.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe453400640 1 --2- 172.21.15.173:0/1704975389 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe438066f90 0x7fe438069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.394+0000 7fe453400640 1 -- 172.21.15.173:0/1704975389 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe44c085a30 con 0x7fe440004d50 2024-04-25T09:03:36.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.398+0000 7fe452000640 1 --2- 172.21.15.173:0/1704975389 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe438066f90 0x7fe438069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.398+0000 7fe452000640 1 --2- 172.21.15.173:0/1704975389 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe438066f90 0x7fe438069450 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe45c1f6bd0 tx=0x7fe444008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.398+0000 7fe453400640 1 -- 172.21.15.173:0/1704975389 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe44c019030 con 0x7fe440004d50 2024-04-25T09:03:36.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.554+0000 7fe461a00640 1 -- 172.21.15.173:0/1704975389 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe45c0cf740 con 0x7fe440004d50 2024-04-25T09:03:36.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.554+0000 7fe453400640 1 -- 172.21.15.173:0/1704975389 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe44c01c360 con 0x7fe440004d50 2024-04-25T09:03:36.544 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:36.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.558+0000 7fe461a00640 1 -- 172.21.15.173:0/1704975389 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe438066f90 msgr2=0x7fe438069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.558+0000 7fe461a00640 1 --2- 172.21.15.173:0/1704975389 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe438066f90 0x7fe438069450 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe45c1f6bd0 tx=0x7fe444008040 comp rx=0 tx=0).stop 2024-04-25T09:03:36.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.558+0000 7fe461a00640 1 -- 172.21.15.173:0/1704975389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe440004d50 msgr2=0x7fe45c14bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.558+0000 7fe461a00640 1 --2- 172.21.15.173:0/1704975389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe440004d50 0x7fe45c14bc40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe44c011990 tx=0x7fe44c011e50 comp rx=0 tx=0).stop 2024-04-25T09:03:36.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.558+0000 7fe461a00640 1 -- 172.21.15.173:0/1704975389 shutdown_connections 2024-04-25T09:03:36.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.558+0000 7fe461a00640 1 --2- 172.21.15.173:0/1704975389 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe438066f90 0x7fe438069450 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.558+0000 7fe461a00640 1 --2- 172.21.15.173:0/1704975389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe45c1f4840 0x7fe45c1f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.558+0000 7fe461a00640 1 --2- 172.21.15.173:0/1704975389 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe45c157cf0 0x7fe45c158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.558+0000 7fe461a00640 1 --2- 172.21.15.173:0/1704975389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe440004d50 0x7fe45c14bc40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.558+0000 7fe461a00640 1 -- 172.21.15.173:0/1704975389 >> 172.21.15.173:0/1704975389 conn(0x7fe45c0cfed0 msgr2=0x7fe45c160fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.558+0000 7fe461a00640 1 -- 172.21.15.173:0/1704975389 shutdown_connections 2024-04-25T09:03:36.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.558+0000 7fe461a00640 1 -- 172.21.15.173:0/1704975389 wait complete. 2024-04-25T09:03:36.565 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:36.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.714+0000 7fcdb8400640 1 Processor -- start 2024-04-25T09:03:36.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.714+0000 7fcdb8400640 1 -- start start 2024-04-25T09:03:36.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.714+0000 7fcdb8400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcdb006e1c0 0x7fcdb006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.714+0000 7fcdb8400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdb006c410 0x7fcdb00aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.714+0000 7fcdb8400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb006ae30 con 0x7fcdb00ad3f0 2024-04-25T09:03:36.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.714+0000 7fcdb8400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb00b3170 con 0x7fcdb006e1c0 2024-04-25T09:03:36.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.714+0000 7fcdb8400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb015e070 con 0x7fcdb006c410 2024-04-25T09:03:36.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.714+0000 7fcdb5a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcdb006e1c0 0x7fcdb006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.714+0000 7fcdb6400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fcdb00ad3f0 0x7fcdb006e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46492/0 (socket says 172.21.15.173:46492) 2024-04-25T09:03:36.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.714+0000 7fcdb6400640 1 -- 172.21.15.173:0/1613474087 learned_addr learned my addr 172.21.15.173:0/1613474087 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:36.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.714+0000 7fcdb5a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcdb006e1c0 0x7fcdb006bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56116/0 (socket says 172.21.15.173:56116) 2024-04-25T09:03:36.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.714+0000 7fcdb5000640 1 --2- 172.21.15.173:0/1613474087 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdb006c410 0x7fcdb00aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.714+0000 7fcdb5a00640 1 -- 172.21.15.173:0/1613474087 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdb006c410 msgr2=0x7fcdb00aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.714+0000 7fcdb5a00640 1 --2- 172.21.15.173:0/1613474087 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdb006c410 0x7fcdb00aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.714+0000 7fcdb5a00640 1 -- 172.21.15.173:0/1613474087 >> v1:172.21.15.173:6789/0 conn(0x7fcdb00ad3f0 legacy=0x7fcdb006e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.714+0000 7fcdb5a00640 1 -- 172.21.15.173:0/1613474087 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb006b110 con 0x7fcdb006e1c0 2024-04-25T09:03:36.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.714+0000 7fcdafe00640 1 -- 172.21.15.173:0/1613474087 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947582533 0 0) 0x7fcdb006ae30 con 0x7fcdb00ad3f0 2024-04-25T09:03:36.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.718+0000 7fcdb5a00640 1 --2- 172.21.15.173:0/1613474087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdb006e1c0 0x7fcdb006bed0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcda40097f0 tx=0x7fcda401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c3623c5dc3251d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.718+0000 7fcdafe00640 1 -- 172.21.15.173:0/1613474087 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda40b5070 con 0x7fcdb006e1c0 2024-04-25T09:03:36.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.718+0000 7fcdafe00640 1 -- 172.21.15.173:0/1613474087 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda40a8990 con 0x7fcdb006e1c0 2024-04-25T09:03:36.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.718+0000 7fcdafe00640 1 -- 172.21.15.173:0/1613474087 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda40a8d60 con 0x7fcdb006e1c0 2024-04-25T09:03:36.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.718+0000 7fcdb8400640 1 -- 172.21.15.173:0/1613474087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdb006e1c0 msgr2=0x7fcdb006bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.718+0000 7fcdb8400640 1 --2- 172.21.15.173:0/1613474087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdb006e1c0 0x7fcdb006bed0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcda40097f0 tx=0x7fcda401ec90 comp rx=0 tx=0).stop 2024-04-25T09:03:36.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.718+0000 7fcdb8400640 1 -- 172.21.15.173:0/1613474087 shutdown_connections 2024-04-25T09:03:36.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.718+0000 7fcdb8400640 1 --2- 172.21.15.173:0/1613474087 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdb006c410 0x7fcdb00aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.718+0000 7fcdb8400640 1 --2- 172.21.15.173:0/1613474087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdb006e1c0 0x7fcdb006bed0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.718+0000 7fcdb8400640 1 -- 172.21.15.173:0/1613474087 >> 172.21.15.173:0/1613474087 conn(0x7fcdb00cfed0 msgr2=0x7fcdb00d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.718+0000 7fcdb8400640 1 -- 172.21.15.173:0/1613474087 shutdown_connections 2024-04-25T09:03:36.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.718+0000 7fcdb8400640 1 -- 172.21.15.173:0/1613474087 wait complete. 2024-04-25T09:03:36.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb8400640 1 Processor -- start 2024-04-25T09:03:36.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb8400640 1 -- start start 2024-04-25T09:03:36.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb8400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdb006c410 0x7fcdb01553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb8400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdb006e1c0 0x7fcdb0156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb8400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdb00ad3f0 0x7fcdb015c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb8400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb006b9b0 con 0x7fcdb00ad3f0 2024-04-25T09:03:36.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb8400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb006b6d0 con 0x7fcdb006c410 2024-04-25T09:03:36.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb8400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00ad8a0 con 0x7fcdb006e1c0 2024-04-25T09:03:36.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb6400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdb00ad3f0 0x7fcdb015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb6400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdb00ad3f0 0x7fcdb015c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56120/0 (socket says 172.21.15.173:56120) 2024-04-25T09:03:36.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb6400640 1 -- 172.21.15.173:0/154049359 learned_addr learned my addr 172.21.15.173:0/154049359 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:36.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb5000640 1 --2- 172.21.15.173:0/154049359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdb006e1c0 0x7fcdb0156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb5a00640 1 --2- 172.21.15.173:0/154049359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdb006c410 0x7fcdb01553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb6400640 1 -- 172.21.15.173:0/154049359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdb006e1c0 msgr2=0x7fcdb0156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb6400640 1 --2- 172.21.15.173:0/154049359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdb006e1c0 0x7fcdb0156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb6400640 1 -- 172.21.15.173:0/154049359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdb006c410 msgr2=0x7fcdb01553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb6400640 1 --2- 172.21.15.173:0/154049359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdb006c410 0x7fcdb01553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb6400640 1 -- 172.21.15.173:0/154049359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb0153290 con 0x7fcdb00ad3f0 2024-04-25T09:03:36.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb6400640 1 --2- 172.21.15.173:0/154049359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdb00ad3f0 0x7fcdb015c180 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcda800c700 tx=0x7fcda800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdad600640 1 -- 172.21.15.173:0/154049359 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8018070 con 0x7fcdb00ad3f0 2024-04-25T09:03:36.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdad600640 1 -- 172.21.15.173:0/154049359 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda800ce10 con 0x7fcdb00ad3f0 2024-04-25T09:03:36.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb8400640 1 -- 172.21.15.173:0/154049359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb01559f0 con 0x7fcdb00ad3f0 2024-04-25T09:03:36.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdad600640 1 -- 172.21.15.173:0/154049359 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda800a860 con 0x7fcdb00ad3f0 2024-04-25T09:03:36.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.722+0000 7fcdb8400640 1 -- 172.21.15.173:0/154049359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb0156290 con 0x7fcdb00ad3f0 2024-04-25T09:03:36.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.726+0000 7fcdb8400640 1 -- 172.21.15.173:0/154049359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb0073ab0 con 0x7fcdb00ad3f0 2024-04-25T09:03:36.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.726+0000 7fcdad600640 1 -- 172.21.15.173:0/154049359 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcda801b070 con 0x7fcdb00ad3f0 2024-04-25T09:03:36.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.726+0000 7fcdad600640 1 --2- 172.21.15.173:0/154049359 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd90066f60 0x7fcd90069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.726+0000 7fcdad600640 1 -- 172.21.15.173:0/154049359 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fcda80849e0 con 0x7fcdb00ad3f0 2024-04-25T09:03:36.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.726+0000 7fcdb5a00640 1 --2- 172.21.15.173:0/154049359 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd90066f60 0x7fcd90069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.726+0000 7fcdb5a00640 1 --2- 172.21.15.173:0/154049359 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd90066f60 0x7fcd90069420 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcda40b2000 tx=0x7fcda4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.730+0000 7fcdad600640 1 -- 172.21.15.173:0/154049359 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcda80555e0 con 0x7fcdb00ad3f0 2024-04-25T09:03:36.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.886+0000 7fcdb8400640 1 -- 172.21.15.173:0/154049359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcdb00b1790 con 0x7fcdb00ad3f0 2024-04-25T09:03:36.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.886+0000 7fcdad600640 1 -- 172.21.15.173:0/154049359 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcda8054ee0 con 0x7fcdb00ad3f0 2024-04-25T09:03:36.874 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:03:36.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.886+0000 7fcdb8400640 1 -- 172.21.15.173:0/154049359 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd90066f60 msgr2=0x7fcd90069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.886+0000 7fcdb8400640 1 --2- 172.21.15.173:0/154049359 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd90066f60 0x7fcd90069420 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcda40b2000 tx=0x7fcda4008040 comp rx=0 tx=0).stop 2024-04-25T09:03:36.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.886+0000 7fcdb8400640 1 -- 172.21.15.173:0/154049359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdb00ad3f0 msgr2=0x7fcdb015c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.886+0000 7fcdb8400640 1 --2- 172.21.15.173:0/154049359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdb00ad3f0 0x7fcdb015c180 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcda800c700 tx=0x7fcda800cbc0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.886+0000 7fcdb8400640 1 -- 172.21.15.173:0/154049359 shutdown_connections 2024-04-25T09:03:36.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.886+0000 7fcdb8400640 1 --2- 172.21.15.173:0/154049359 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd90066f60 0x7fcd90069420 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.886+0000 7fcdb8400640 1 --2- 172.21.15.173:0/154049359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdb00ad3f0 0x7fcdb015c180 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.886+0000 7fcdb8400640 1 --2- 172.21.15.173:0/154049359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdb006e1c0 0x7fcdb0156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.886+0000 7fcdb8400640 1 --2- 172.21.15.173:0/154049359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdb006c410 0x7fcdb01553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.886+0000 7fcdb8400640 1 -- 172.21.15.173:0/154049359 >> 172.21.15.173:0/154049359 conn(0x7fcdb00cfed0 msgr2=0x7fcdb006e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.886+0000 7fcdb8400640 1 -- 172.21.15.173:0/154049359 shutdown_connections 2024-04-25T09:03:36.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:36.886+0000 7fcdb8400640 1 -- 172.21.15.173:0/154049359 wait complete. 2024-04-25T09:03:36.896 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:03:37.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8ff0600640 1 Processor -- start 2024-04-25T09:03:37.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8ff0600640 1 -- start start 2024-04-25T09:03:37.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8ff0600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe80aeb90 0x7f8fe80cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8ff0600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe8071570 con 0x7f8fe80ce2b0 2024-04-25T09:03:37.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8ff0600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe8071850 con 0x7f8fe80aef70 2024-04-25T09:03:37.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8ff0600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe8071320 con 0x7f8fe80aeb90 2024-04-25T09:03:37.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fee600640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f8fe80ce2b0 0x7f8fe815af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46500/0 (socket says 172.21.15.173:46500) 2024-04-25T09:03:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fee600640 1 -- 172.21.15.173:0/1313990683 learned_addr learned my addr 172.21.15.173:0/1313990683 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fedc00640 1 --2- 172.21.15.173:0/1313990683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe80aeb90 0x7f8fe80cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fe7e00640 1 -- 172.21.15.173:0/1313990683 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037860563 0 0) 0x7f8fe8071570 con 0x7f8fe80ce2b0 2024-04-25T09:03:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fe7e00640 1 -- 172.21.15.173:0/1313990683 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fd0005740 con 0x7f8fe80ce2b0 2024-04-25T09:03:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fe7e00640 1 -- 172.21.15.173:0/1313990683 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2774076792 0 0) 0x7f8fd0005740 con 0x7f8fe80ce2b0 2024-04-25T09:03:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fe7e00640 1 -- 172.21.15.173:0/1313990683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe80aeb90 msgr2=0x7f8fe80cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fe7e00640 1 --2- 172.21.15.173:0/1313990683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe80aeb90 0x7f8fe80cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fe7e00640 1 -- 172.21.15.173:0/1313990683 >> v1:172.21.15.194:6789/0 conn(0x7f8fe80aef70 legacy=0x7f8fe80cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fe7e00640 1 -- 172.21.15.173:0/1313990683 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe8071b30 con 0x7f8fe80ce2b0 2024-04-25T09:03:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fe7e00640 1 -- 172.21.15.173:0/1313990683 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f8fe0001a00 con 0x7f8fe80ce2b0 2024-04-25T09:03:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fe7e00640 1 -- 172.21.15.173:0/1313990683 >> v1:172.21.15.173:6789/0 conn(0x7f8fe80ce2b0 legacy=0x7f8fe815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fe7e00640 1 --2- 172.21.15.173:0/1313990683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fd0005c00 0x7f8fd0006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fe7e00640 1 --2- 172.21.15.173:0/1313990683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8fd0006a20 0x7f8fd0006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fe7e00640 1 --2- 172.21.15.173:0/1313990683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe80aeb90 0x7f8fd0007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fe7e00640 1 -- 172.21.15.173:0/1313990683 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe8071320 con 0x7f8fd0006a20 2024-04-25T09:03:37.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fe7e00640 1 -- 172.21.15.173:0/1313990683 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd000dd10 con 0x7f8fd0005c00 2024-04-25T09:03:37.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fe7e00640 1 -- 172.21.15.173:0/1313990683 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd000df10 con 0x7f8fe80aeb90 2024-04-25T09:03:37.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fed200640 1 --2- 172.21.15.173:0/1313990683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8fd0006a20 0x7f8fd0006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fedc00640 1 --2- 172.21.15.173:0/1313990683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fd0005c00 0x7f8fd0006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fee600640 1 --2- 172.21.15.173:0/1313990683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe80aeb90 0x7f8fd0007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fed200640 1 -- 172.21.15.173:0/1313990683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe80aeb90 msgr2=0x7f8fd0007420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:37.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fed200640 1 --2- 172.21.15.173:0/1313990683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe80aeb90 0x7f8fd0007420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fed200640 1 -- 172.21.15.173:0/1313990683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fd0005c00 msgr2=0x7f8fd0006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:37.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fed200640 1 --2- 172.21.15.173:0/1313990683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fd0005c00 0x7f8fd0006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fed200640 1 -- 172.21.15.173:0/1313990683 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd0005740 con 0x7f8fd0006a20 2024-04-25T09:03:37.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.046+0000 7f8fee600640 1 --2- 172.21.15.173:0/1313990683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe80aeb90 0x7f8fd0007420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:37.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.050+0000 7f8fed200640 1 --2- 172.21.15.173:0/1313990683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8fd0006a20 0x7f8fd0006ea0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4001750 tx=0x7f8fd401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665d112ab6b16707 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.050+0000 7f8fe7e00640 1 -- 172.21.15.173:0/1313990683 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd40013a0 con 0x7f8fd0006a20 2024-04-25T09:03:37.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.050+0000 7f8fe7e00640 1 -- 172.21.15.173:0/1313990683 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd40052f0 con 0x7f8fd0006a20 2024-04-25T09:03:37.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.050+0000 7f8fe7e00640 1 -- 172.21.15.173:0/1313990683 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4003840 con 0x7f8fd0006a20 2024-04-25T09:03:37.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.050+0000 7f8ff0600640 1 -- 172.21.15.173:0/1313990683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8fd0006a20 msgr2=0x7f8fd0006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.050+0000 7f8ff0600640 1 --2- 172.21.15.173:0/1313990683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8fd0006a20 0x7f8fd0006ea0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4001750 tx=0x7f8fd401c3e0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.050+0000 7f8fee600640 1 -- 172.21.15.173:0/1313990683 reap_dead start 2024-04-25T09:03:37.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.050+0000 7f8ff0600640 1 -- 172.21.15.173:0/1313990683 shutdown_connections 2024-04-25T09:03:37.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.050+0000 7f8ff0600640 1 -- 172.21.15.173:0/1313990683 >> 172.21.15.173:0/1313990683 conn(0x7f8fe806ac90 msgr2=0x7f8fe806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:37.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.050+0000 7f8ff0600640 1 -- 172.21.15.173:0/1313990683 shutdown_connections 2024-04-25T09:03:37.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.050+0000 7f8ff0600640 1 -- 172.21.15.173:0/1313990683 wait complete. 2024-04-25T09:03:37.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8ff0600640 1 Processor -- start 2024-04-25T09:03:37.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8ff0600640 1 -- start start 2024-04-25T09:03:37.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8ff0600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8fd0006a20 0x7f8fe8149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8ff0600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe81555d0 0x7f8fe80ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8ff0600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fe80ace00 0x7f8fe81fa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8ff0600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe80cc4e0 con 0x7f8fd0006a20 2024-04-25T09:03:37.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8ff0600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe80cc360 con 0x7f8fe80ace00 2024-04-25T09:03:37.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8ff0600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe80cc660 con 0x7f8fe81555d0 2024-04-25T09:03:37.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8fedc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8fd0006a20 0x7f8fe8149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8fedc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8fd0006a20 0x7f8fe8149140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56140/0 (socket says 172.21.15.173:56140) 2024-04-25T09:03:37.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8fedc00640 1 -- 172.21.15.173:0/167134843 learned_addr learned my addr 172.21.15.173:0/167134843 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:37.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8fed200640 1 --2- 172.21.15.173:0/167134843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe81555d0 0x7f8fe80ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8fee600640 1 --2- 172.21.15.173:0/167134843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fe80ace00 0x7f8fe81fa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8fedc00640 1 -- 172.21.15.173:0/167134843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe81555d0 msgr2=0x7f8fe80ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8fedc00640 1 --2- 172.21.15.173:0/167134843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe81555d0 0x7f8fe80ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8fedc00640 1 -- 172.21.15.173:0/167134843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fe80ace00 msgr2=0x7f8fe81fa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8fedc00640 1 --2- 172.21.15.173:0/167134843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fe80ace00 0x7f8fe81fa040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8fedc00640 1 -- 172.21.15.173:0/167134843 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe8151fa0 con 0x7f8fd0006a20 2024-04-25T09:03:37.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8fedc00640 1 --2- 172.21.15.173:0/167134843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8fd0006a20 0x7f8fe8149140 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc011a30 tx=0x7f8fdc011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8fe5600640 1 -- 172.21.15.173:0/167134843 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc00fb50 con 0x7f8fd0006a20 2024-04-25T09:03:37.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8fe5600640 1 -- 172.21.15.173:0/167134843 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc00fcf0 con 0x7f8fd0006a20 2024-04-25T09:03:37.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8fe5600640 1 -- 172.21.15.173:0/167134843 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc00fea0 con 0x7f8fd0006a20 2024-04-25T09:03:37.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8ff0600640 1 -- 172.21.15.173:0/167134843 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe8152280 con 0x7f8fd0006a20 2024-04-25T09:03:37.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8ff0600640 1 -- 172.21.15.173:0/167134843 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe8152840 con 0x7f8fd0006a20 2024-04-25T09:03:37.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.054+0000 7f8ff0600640 1 -- 172.21.15.173:0/167134843 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe8073ab0 con 0x7f8fd0006a20 2024-04-25T09:03:37.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.058+0000 7f8fe5600640 1 -- 172.21.15.173:0/167134843 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8fdc012040 con 0x7f8fd0006a20 2024-04-25T09:03:37.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.058+0000 7f8fe5600640 1 --2- 172.21.15.173:0/167134843 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8fc8066f60 0x7f8fc8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.058+0000 7f8fe5600640 1 -- 172.21.15.173:0/167134843 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f8fdc085a40 con 0x7f8fd0006a20 2024-04-25T09:03:37.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.058+0000 7f8fed200640 1 --2- 172.21.15.173:0/167134843 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8fc8066f60 0x7f8fc8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.058+0000 7f8fed200640 1 --2- 172.21.15.173:0/167134843 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8fc8066f60 0x7f8fc8069420 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80af3b0 tx=0x7f8fd40011a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.062+0000 7f8fe5600640 1 -- 172.21.15.173:0/167134843 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8fdc019030 con 0x7f8fd0006a20 2024-04-25T09:03:37.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.218+0000 7f8ff0600640 1 -- 172.21.15.173:0/167134843 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8fe80ad1e0 con 0x7f8fd0006a20 2024-04-25T09:03:37.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.218+0000 7f8fe5600640 1 -- 172.21.15.173:0/167134843 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8fdc056670 con 0x7f8fd0006a20 2024-04-25T09:03:37.210 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.222+0000 7f8ff0600640 1 -- 172.21.15.173:0/167134843 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8fc8066f60 msgr2=0x7f8fc8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.222+0000 7f8ff0600640 1 --2- 172.21.15.173:0/167134843 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8fc8066f60 0x7f8fc8069420 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80af3b0 tx=0x7f8fd40011a0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.222+0000 7f8ff0600640 1 -- 172.21.15.173:0/167134843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8fd0006a20 msgr2=0x7f8fe8149140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.222+0000 7f8ff0600640 1 --2- 172.21.15.173:0/167134843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8fd0006a20 0x7f8fe8149140 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc011a30 tx=0x7f8fdc011ef0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.222+0000 7f8ff0600640 1 -- 172.21.15.173:0/167134843 shutdown_connections 2024-04-25T09:03:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.222+0000 7f8ff0600640 1 --2- 172.21.15.173:0/167134843 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8fc8066f60 0x7f8fc8069420 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.222+0000 7f8ff0600640 1 --2- 172.21.15.173:0/167134843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fe80ace00 0x7f8fe81fa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.222+0000 7f8ff0600640 1 --2- 172.21.15.173:0/167134843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe81555d0 0x7f8fe80ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.222+0000 7f8ff0600640 1 --2- 172.21.15.173:0/167134843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8fd0006a20 0x7f8fe8149140 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.222+0000 7f8ff0600640 1 -- 172.21.15.173:0/167134843 >> 172.21.15.173:0/167134843 conn(0x7f8fe806ac90 msgr2=0x7f8fe8158b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:37.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.222+0000 7f8ff0600640 1 -- 172.21.15.173:0/167134843 shutdown_connections 2024-04-25T09:03:37.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.222+0000 7f8ff0600640 1 -- 172.21.15.173:0/167134843 wait complete. 2024-04-25T09:03:37.231 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-04-25T09:03:37.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.378+0000 7f2235800640 1 Processor -- start 2024-04-25T09:03:37.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.378+0000 7f2235800640 1 -- start start 2024-04-25T09:03:37.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.378+0000 7f2235800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f223015df90 0x7f22300d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.378+0000 7f2235800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f223006f830 0x7f223006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.378+0000 7f2235800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223006d870 con 0x7f223015dbb0 2024-04-25T09:03:37.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.378+0000 7f2235800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223015e5c0 con 0x7f223006f830 2024-04-25T09:03:37.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.378+0000 7f2235800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223015e8a0 con 0x7f223015df90 2024-04-25T09:03:37.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.378+0000 7f222f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f223006f830 0x7f223006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.378+0000 7f222f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f223006f830 0x7f223006fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56156/0 (socket says 172.21.15.173:56156) 2024-04-25T09:03:37.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.378+0000 7f222f400640 1 -- 172.21.15.173:0/2067398693 learned_addr learned my addr 172.21.15.173:0/2067398693 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:37.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.378+0000 7f2226000640 1 --2- 172.21.15.173:0/2067398693 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f223015df90 0x7f22300d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.378+0000 7f222f400640 1 -- 172.21.15.173:0/2067398693 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f223015df90 msgr2=0x7f22300d2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:37.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.378+0000 7f222f400640 1 --2- 172.21.15.173:0/2067398693 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f223015df90 0x7f22300d2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.378+0000 7f222f400640 1 -- 172.21.15.173:0/2067398693 >> v1:172.21.15.194:6789/0 conn(0x7f223015dbb0 legacy=0x7f223006c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.378+0000 7f222f400640 1 -- 172.21.15.173:0/2067398693 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2230161690 con 0x7f223006f830 2024-04-25T09:03:37.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.382+0000 7f222f400640 1 --2- 172.21.15.173:0/2067398693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f223006f830 0x7f223006fcc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2228009e50 tx=0x7f222801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72987d712880866 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.382+0000 7f222e000640 1 -- 172.21.15.173:0/2067398693 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22280a5700 con 0x7f223006f830 2024-04-25T09:03:37.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.382+0000 7f222e000640 1 -- 172.21.15.173:0/2067398693 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22280a58a0 con 0x7f223006f830 2024-04-25T09:03:37.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.382+0000 7f222e000640 1 -- 172.21.15.173:0/2067398693 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22280a5c70 con 0x7f223006f830 2024-04-25T09:03:37.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.382+0000 7f2235800640 1 -- 172.21.15.173:0/2067398693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f223006f830 msgr2=0x7f223006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.382+0000 7f2235800640 1 --2- 172.21.15.173:0/2067398693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f223006f830 0x7f223006fcc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2228009e50 tx=0x7f222801ca30 comp rx=0 tx=0).stop 2024-04-25T09:03:37.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.382+0000 7f2235800640 1 -- 172.21.15.173:0/2067398693 shutdown_connections 2024-04-25T09:03:37.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.382+0000 7f2235800640 1 --2- 172.21.15.173:0/2067398693 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f223015df90 0x7f22300d2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.382+0000 7f2235800640 1 --2- 172.21.15.173:0/2067398693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f223006f830 0x7f223006fcc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.382+0000 7f2235800640 1 -- 172.21.15.173:0/2067398693 >> 172.21.15.173:0/2067398693 conn(0x7f2230061880 msgr2=0x7f2230061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:37.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.382+0000 7f2235800640 1 -- 172.21.15.173:0/2067398693 shutdown_connections 2024-04-25T09:03:37.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.382+0000 7f2235800640 1 -- 172.21.15.173:0/2067398693 wait complete. 2024-04-25T09:03:37.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2235800640 1 Processor -- start 2024-04-25T09:03:37.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2235800640 1 -- start start 2024-04-25T09:03:37.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2235800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f223006f830 0x7f2230159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2235800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f223015dbb0 0x7f22300ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2235800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f223015df90 0x7f22300b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2235800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223016ab10 con 0x7f223015dbb0 2024-04-25T09:03:37.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2235800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223016a990 con 0x7f223006f830 2024-04-25T09:03:37.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2235800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223016ac90 con 0x7f223015df90 2024-04-25T09:03:37.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2226000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f223015dbb0 0x7f22300ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2226000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f223015dbb0 0x7f22300ad2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56168/0 (socket says 172.21.15.173:56168) 2024-04-25T09:03:37.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2226000640 1 -- 172.21.15.173:0/2091224660 learned_addr learned my addr 172.21.15.173:0/2091224660 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:37.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f222f400640 1 --2- 172.21.15.173:0/2091224660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f223015df90 0x7f22300b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f222ea00640 1 --2- 172.21.15.173:0/2091224660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f223006f830 0x7f2230159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2226000640 1 -- 172.21.15.173:0/2091224660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f223015df90 msgr2=0x7f22300b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2226000640 1 --2- 172.21.15.173:0/2091224660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f223015df90 0x7f22300b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2226000640 1 -- 172.21.15.173:0/2091224660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f223006f830 msgr2=0x7f2230159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2226000640 1 --2- 172.21.15.173:0/2091224660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f223006f830 0x7f2230159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2226000640 1 -- 172.21.15.173:0/2091224660 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2230159a40 con 0x7f223015dbb0 2024-04-25T09:03:37.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2226000640 1 --2- 172.21.15.173:0/2091224660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f223015dbb0 0x7f22300ad2e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f221800e8a0 tx=0x7f221800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2227400640 1 -- 172.21.15.173:0/2091224660 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2218017070 con 0x7f223015dbb0 2024-04-25T09:03:37.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2227400640 1 -- 172.21.15.173:0/2091224660 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221800c940 con 0x7f223015dbb0 2024-04-25T09:03:37.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2227400640 1 -- 172.21.15.173:0/2091224660 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221800ccf0 con 0x7f223015dbb0 2024-04-25T09:03:37.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2235800640 1 -- 172.21.15.173:0/2091224660 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22300add80 con 0x7f223015dbb0 2024-04-25T09:03:37.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.386+0000 7f2235800640 1 -- 172.21.15.173:0/2091224660 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22300ae340 con 0x7f223015dbb0 2024-04-25T09:03:37.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.390+0000 7f2235800640 1 -- 172.21.15.173:0/2091224660 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2230073a40 con 0x7f223015dbb0 2024-04-25T09:03:37.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.390+0000 7f2227400640 1 -- 172.21.15.173:0/2091224660 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f221801a070 con 0x7f223015dbb0 2024-04-25T09:03:37.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.390+0000 7f2227400640 1 --2- 172.21.15.173:0/2091224660 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f220c066f90 0x7f220c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.390+0000 7f2227400640 1 -- 172.21.15.173:0/2091224660 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f2218085200 con 0x7f223015dbb0 2024-04-25T09:03:37.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.390+0000 7f222ea00640 1 --2- 172.21.15.173:0/2091224660 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f220c066f90 0x7f220c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.390+0000 7f222ea00640 1 --2- 172.21.15.173:0/2091224660 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f220c066f90 0x7f220c069450 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2220001770 tx=0x7f2220009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.394+0000 7f2227400640 1 -- 172.21.15.173:0/2091224660 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f22180557b0 con 0x7f223015dbb0 2024-04-25T09:03:37.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:37.606+0000 7f2235800640 1 -- 172.21.15.173:0/2091224660 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) v1 -- 0x7f223006e620 con 0x7f223015dbb0 2024-04-25T09:03:38.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.218+0000 7f2227400640 1 -- 172.21.15.173:0/2091224660 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v67) v1 ==== 151+0+0 (secure 0 0 0) 0x7f2218059850 con 0x7f223015dbb0 2024-04-25T09:03:38.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.222+0000 7f2235800640 1 -- 172.21.15.173:0/2091224660 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f220c066f90 msgr2=0x7f220c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.222+0000 7f2235800640 1 --2- 172.21.15.173:0/2091224660 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f220c066f90 0x7f220c069450 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2220001770 tx=0x7f2220009040 comp rx=0 tx=0).stop 2024-04-25T09:03:38.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.222+0000 7f2235800640 1 -- 172.21.15.173:0/2091224660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f223015dbb0 msgr2=0x7f22300ad2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.222+0000 7f2235800640 1 --2- 172.21.15.173:0/2091224660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f223015dbb0 0x7f22300ad2e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f221800e8a0 tx=0x7f221800eca0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.222+0000 7f2235800640 1 -- 172.21.15.173:0/2091224660 shutdown_connections 2024-04-25T09:03:38.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.222+0000 7f2235800640 1 --2- 172.21.15.173:0/2091224660 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f220c066f90 0x7f220c069450 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.222+0000 7f2235800640 1 --2- 172.21.15.173:0/2091224660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f223015df90 0x7f22300b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.222+0000 7f2235800640 1 --2- 172.21.15.173:0/2091224660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f223015dbb0 0x7f22300ad2e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.222+0000 7f2235800640 1 --2- 172.21.15.173:0/2091224660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f223006f830 0x7f2230159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.222+0000 7f2235800640 1 -- 172.21.15.173:0/2091224660 >> 172.21.15.173:0/2091224660 conn(0x7f2230061880 msgr2=0x7f223015f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.222+0000 7f2235800640 1 -- 172.21.15.173:0/2091224660 shutdown_connections 2024-04-25T09:03:38.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.222+0000 7f2235800640 1 -- 172.21.15.173:0/2091224660 wait complete. 2024-04-25T09:03:38.233 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:03:38.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.386+0000 7fe020e00640 1 Processor -- start 2024-04-25T09:03:38.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.386+0000 7fe020e00640 1 -- start start 2024-04-25T09:03:38.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.386+0000 7fe020e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe01c070310 0x7fe01c0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.386+0000 7fe020e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe01c0cd9d0 0x7fe01c0cc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.386+0000 7fe020e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01c0cf6b0 con 0x7fe01c0706f0 2024-04-25T09:03:38.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.386+0000 7fe020e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01c0d02c0 con 0x7fe01c070310 2024-04-25T09:03:38.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.386+0000 7fe020e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01c0cf990 con 0x7fe01c0cd9d0 2024-04-25T09:03:38.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.386+0000 7fe019e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe01c070310 0x7fe01c0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.386+0000 7fe011400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe01c0706f0 0x7fe01c0cd2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46516/0 (socket says 172.21.15.173:46516) 2024-04-25T09:03:38.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.386+0000 7fe019e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe01c070310 0x7fe01c0b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56178/0 (socket says 172.21.15.173:56178) 2024-04-25T09:03:38.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.386+0000 7fe011400640 1 -- 172.21.15.173:0/2222538238 learned_addr learned my addr 172.21.15.173:0/2222538238 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:38.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.390+0000 7fe01a800640 1 --2- 172.21.15.173:0/2222538238 >> v2:172.21.15.194:3300/0 conn(0x7fe01c0cd9d0 0x7fe01c0cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.390+0000 7fe019e00640 1 -- 172.21.15.173:0/2222538238 >> v2:172.21.15.194:3300/0 conn(0x7fe01c0cd9d0 msgr2=0x7fe01c0cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.390+0000 7fe019e00640 1 --2- 172.21.15.173:0/2222538238 >> v2:172.21.15.194:3300/0 conn(0x7fe01c0cd9d0 0x7fe01c0cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.390+0000 7fe019e00640 1 -- 172.21.15.173:0/2222538238 >> v1:172.21.15.173:6789/0 conn(0x7fe01c0706f0 legacy=0x7fe01c0cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.390+0000 7fe019e00640 1 -- 172.21.15.173:0/2222538238 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c0cfc70 con 0x7fe01c070310 2024-04-25T09:03:38.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.390+0000 7fe019400640 1 -- 172.21.15.173:0/2222538238 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675582713 0 0) 0x7fe01c0cf6b0 con 0x7fe01c0706f0 2024-04-25T09:03:38.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.390+0000 7fe019e00640 1 --2- 172.21.15.173:0/2222538238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c070310 0x7fe01c0b36f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe01c06fe60 tx=0x7fe00c01ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4a12adfefa28a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.390+0000 7fe019400640 1 -- 172.21.15.173:0/2222538238 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0b4070 con 0x7fe01c070310 2024-04-25T09:03:38.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.390+0000 7fe019400640 1 -- 172.21.15.173:0/2222538238 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c0a7b80 con 0x7fe01c070310 2024-04-25T09:03:38.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.390+0000 7fe019400640 1 -- 172.21.15.173:0/2222538238 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0af440 con 0x7fe01c070310 2024-04-25T09:03:38.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.390+0000 7fe020e00640 1 -- 172.21.15.173:0/2222538238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c070310 msgr2=0x7fe01c0b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.390+0000 7fe020e00640 1 --2- 172.21.15.173:0/2222538238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c070310 0x7fe01c0b36f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe01c06fe60 tx=0x7fe00c01ea90 comp rx=0 tx=0).stop 2024-04-25T09:03:38.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe020e00640 1 -- 172.21.15.173:0/2222538238 shutdown_connections 2024-04-25T09:03:38.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe020e00640 1 --2- 172.21.15.173:0/2222538238 >> v2:172.21.15.194:3300/0 conn(0x7fe01c0cd9d0 0x7fe01c0cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe020e00640 1 --2- 172.21.15.173:0/2222538238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c070310 0x7fe01c0b36f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe020e00640 1 -- 172.21.15.173:0/2222538238 >> 172.21.15.173:0/2222538238 conn(0x7fe01c0b23f0 msgr2=0x7fe01c0b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe020e00640 1 -- 172.21.15.173:0/2222538238 shutdown_connections 2024-04-25T09:03:38.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe020e00640 1 -- 172.21.15.173:0/2222538238 wait complete. 2024-04-25T09:03:38.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe020e00640 1 Processor -- start 2024-04-25T09:03:38.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe020e00640 1 -- start start 2024-04-25T09:03:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe020e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c070310 0x7fe01c154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe020e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe01c0706f0 0x7fe01c0c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe020e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe01c0cd9d0 0x7fe01c14ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe020e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c06ae10 con 0x7fe01c070310 2024-04-25T09:03:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe020e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c06ac90 con 0x7fe01c0706f0 2024-04-25T09:03:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe020e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c06af90 con 0x7fe01c0cd9d0 2024-04-25T09:03:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe019e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c070310 0x7fe01c154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe019e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c070310 0x7fe01c154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56192/0 (socket says 172.21.15.173:56192) 2024-04-25T09:03:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe019e00640 1 -- 172.21.15.173:0/2417066273 learned_addr learned my addr 172.21.15.173:0/2417066273 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe011400640 1 --2- 172.21.15.173:0/2417066273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe01c0706f0 0x7fe01c0c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe019e00640 1 -- 172.21.15.173:0/2417066273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe01c0cd9d0 msgr2=0x7fe01c14ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe019e00640 1 --2- 172.21.15.173:0/2417066273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe01c0cd9d0 0x7fe01c14ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe019e00640 1 -- 172.21.15.173:0/2417066273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe01c0706f0 msgr2=0x7fe01c0c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe019e00640 1 --2- 172.21.15.173:0/2417066273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe01c0706f0 0x7fe01c0c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe019e00640 1 -- 172.21.15.173:0/2417066273 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c155530 con 0x7fe01c070310 2024-04-25T09:03:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe011400640 1 --2- 172.21.15.173:0/2417066273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe01c0706f0 0x7fe01c0c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe019e00640 1 --2- 172.21.15.173:0/2417066273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c070310 0x7fe01c154ff0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0b2040 tx=0x7fe00c01b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe012a00640 1 -- 172.21.15.173:0/2417066273 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0bf070 con 0x7fe01c070310 2024-04-25T09:03:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe012a00640 1 -- 172.21.15.173:0/2417066273 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c0afc20 con 0x7fe01c070310 2024-04-25T09:03:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe020e00640 1 -- 172.21.15.173:0/2417066273 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01c155f20 con 0x7fe01c070310 2024-04-25T09:03:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.394+0000 7fe012a00640 1 -- 172.21.15.173:0/2417066273 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0b4040 con 0x7fe01c070310 2024-04-25T09:03:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.398+0000 7fe020e00640 1 -- 172.21.15.173:0/2417066273 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c1567c0 con 0x7fe01c070310 2024-04-25T09:03:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.398+0000 7fe020e00640 1 -- 172.21.15.173:0/2417066273 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01c073ab0 con 0x7fe01c070310 2024-04-25T09:03:38.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.398+0000 7fe012a00640 1 -- 172.21.15.173:0/2417066273 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe00c0c2070 con 0x7fe01c070310 2024-04-25T09:03:38.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.398+0000 7fe012a00640 1 --2- 172.21.15.173:0/2417066273 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdff8066f60 0x7fdff8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.398+0000 7fe012a00640 1 -- 172.21.15.173:0/2417066273 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe00c11fb80 con 0x7fe01c070310 2024-04-25T09:03:38.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.398+0000 7fe011400640 1 --2- 172.21.15.173:0/2417066273 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdff8066f60 0x7fdff8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.398+0000 7fe011400640 1 --2- 172.21.15.173:0/2417066273 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdff8066f60 0x7fdff8069420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe01c15d940 tx=0x7fe004009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.402+0000 7fe012a00640 1 -- 172.21.15.173:0/2417066273 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe00c018740 con 0x7fe01c070310 2024-04-25T09:03:38.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.558+0000 7fe020e00640 1 -- 172.21.15.173:0/2417066273 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe01c0cace0 con 0x7fe01c070310 2024-04-25T09:03:38.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.562+0000 7fe012a00640 1 -- 172.21.15.173:0/2417066273 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe00c0f06f0 con 0x7fe01c070310 2024-04-25T09:03:38.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.562+0000 7fe020e00640 1 -- 172.21.15.173:0/2417066273 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdff8066f60 msgr2=0x7fdff8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.562+0000 7fe020e00640 1 --2- 172.21.15.173:0/2417066273 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdff8066f60 0x7fdff8069420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe01c15d940 tx=0x7fe004009040 comp rx=0 tx=0).stop 2024-04-25T09:03:38.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.562+0000 7fe020e00640 1 -- 172.21.15.173:0/2417066273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c070310 msgr2=0x7fe01c154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.562+0000 7fe020e00640 1 --2- 172.21.15.173:0/2417066273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c070310 0x7fe01c154ff0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0b2040 tx=0x7fe00c01b830 comp rx=0 tx=0).stop 2024-04-25T09:03:38.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.566+0000 7fe020e00640 1 -- 172.21.15.173:0/2417066273 shutdown_connections 2024-04-25T09:03:38.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.566+0000 7fe020e00640 1 --2- 172.21.15.173:0/2417066273 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdff8066f60 0x7fdff8069420 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.566+0000 7fe020e00640 1 --2- 172.21.15.173:0/2417066273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe01c0cd9d0 0x7fe01c14ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.566+0000 7fe020e00640 1 --2- 172.21.15.173:0/2417066273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe01c0706f0 0x7fe01c0c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.566+0000 7fe020e00640 1 --2- 172.21.15.173:0/2417066273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01c070310 0x7fe01c154ff0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.566+0000 7fe020e00640 1 -- 172.21.15.173:0/2417066273 >> 172.21.15.173:0/2417066273 conn(0x7fe01c0b23f0 msgr2=0x7fe01c0cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.566+0000 7fe020e00640 1 -- 172.21.15.173:0/2417066273 shutdown_connections 2024-04-25T09:03:38.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:38.566+0000 7fe020e00640 1 -- 172.21.15.173:0/2417066273 wait complete. 2024-04-25T09:03:38.574 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:03:38.574 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:03:38.660 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:03:38.749 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:03:38.749 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:03:38.750 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:38.759 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:03:38.759 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:38.810 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:03:38.810 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:38.861 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:39.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.054+0000 7f831c800640 1 Processor -- start 2024-04-25T09:03:39.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.054+0000 7f831c800640 1 -- start start 2024-04-25T09:03:39.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.054+0000 7f831c800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f831406ff40 0x7f83140d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.054+0000 7f831c800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831406d870 con 0x7f831415dbb0 2024-04-25T09:03:39.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.054+0000 7f831c800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8314161690 con 0x7f831415df90 2024-04-25T09:03:39.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.054+0000 7f831c800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831415e5c0 con 0x7f831406ff40 2024-04-25T09:03:39.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.054+0000 7f8319e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f831415dbb0 0x7f831406c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46532/0 (socket says 172.21.15.173:46532) 2024-04-25T09:03:39.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.054+0000 7f8319e00640 1 -- 172.21.15.173:0/2422209568 learned_addr learned my addr 172.21.15.173:0/2422209568 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:39.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.054+0000 7f831a800640 1 --2- 172.21.15.173:0/2422209568 >> v2:172.21.15.173:3300/0 conn(0x7f831406ff40 0x7f83140d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.054+0000 7f831a800640 1 -- 172.21.15.173:0/2422209568 >> v1:172.21.15.194:6789/0 conn(0x7f831415df90 legacy=0x7f831406f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:39.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.054+0000 7f8318a00640 1 -- 172.21.15.173:0/2422209568 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436286392 0 0) 0x7f831406d870 con 0x7f831415dbb0 2024-04-25T09:03:39.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.054+0000 7f831a800640 1 -- 172.21.15.173:0/2422209568 >> v1:172.21.15.173:6789/0 conn(0x7f831415dbb0 legacy=0x7f831406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.054+0000 7f831a800640 1 -- 172.21.15.173:0/2422209568 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831415e8a0 con 0x7f831406ff40 2024-04-25T09:03:39.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.058+0000 7f831a800640 1 --2- 172.21.15.173:0/2422209568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831406ff40 0x7f83140d2130 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8310009d90 tx=0x7f831001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1767108781407753 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:39.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.058+0000 7f8318a00640 1 -- 172.21.15.173:0/2422209568 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100b2070 con 0x7f831406ff40 2024-04-25T09:03:39.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.058+0000 7f8318a00640 1 -- 172.21.15.173:0/2422209568 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83100a5830 con 0x7f831406ff40 2024-04-25T09:03:39.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.058+0000 7f8318a00640 1 -- 172.21.15.173:0/2422209568 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100a5c00 con 0x7f831406ff40 2024-04-25T09:03:39.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.058+0000 7f831c800640 1 -- 172.21.15.173:0/2422209568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831406ff40 msgr2=0x7f83140d2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.058+0000 7f831c800640 1 --2- 172.21.15.173:0/2422209568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831406ff40 0x7f83140d2130 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8310009d90 tx=0x7f831001c970 comp rx=0 tx=0).stop 2024-04-25T09:03:39.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.058+0000 7f831c800640 1 -- 172.21.15.173:0/2422209568 shutdown_connections 2024-04-25T09:03:39.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.058+0000 7f831c800640 1 --2- 172.21.15.173:0/2422209568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831406ff40 0x7f83140d2130 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.058+0000 7f831c800640 1 -- 172.21.15.173:0/2422209568 >> 172.21.15.173:0/2422209568 conn(0x7f8314061880 msgr2=0x7f8314061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:39.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.058+0000 7f831c800640 1 -- 172.21.15.173:0/2422209568 shutdown_connections 2024-04-25T09:03:39.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.058+0000 7f831c800640 1 -- 172.21.15.173:0/2422209568 wait complete. 2024-04-25T09:03:39.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831c800640 1 Processor -- start 2024-04-25T09:03:39.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831c800640 1 -- start start 2024-04-25T09:03:39.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831c800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f831406ff40 0x7f8314153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831c800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f831415dbb0 0x7f831415f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831c800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831415df90 0x7f831415f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831c800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831416bb20 con 0x7f831415df90 2024-04-25T09:03:39.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831c800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831416b9a0 con 0x7f831415dbb0 2024-04-25T09:03:39.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831c800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831416bca0 con 0x7f831406ff40 2024-04-25T09:03:39.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831415df90 0x7f831415f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831415df90 0x7f831415f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56210/0 (socket says 172.21.15.173:56210) 2024-04-25T09:03:39.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831a800640 1 -- 172.21.15.173:0/3834796518 learned_addr learned my addr 172.21.15.173:0/3834796518 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:39.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f8319e00640 1 --2- 172.21.15.173:0/3834796518 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f831406ff40 0x7f8314153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f8319400640 1 --2- 172.21.15.173:0/3834796518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f831415dbb0 0x7f831415f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831a800640 1 -- 172.21.15.173:0/3834796518 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f831406ff40 msgr2=0x7f8314153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831a800640 1 --2- 172.21.15.173:0/3834796518 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f831406ff40 0x7f8314153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831a800640 1 -- 172.21.15.173:0/3834796518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f831415dbb0 msgr2=0x7f831415f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831a800640 1 --2- 172.21.15.173:0/3834796518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f831415dbb0 0x7f831415f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831a800640 1 -- 172.21.15.173:0/3834796518 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83140c7780 con 0x7f831415df90 2024-04-25T09:03:39.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831a800640 1 --2- 172.21.15.173:0/3834796518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831415df90 0x7f831415f650 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f83100b0040 tx=0x7f8310019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:39.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f830e000640 1 -- 172.21.15.173:0/3834796518 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100b2050 con 0x7f831415df90 2024-04-25T09:03:39.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f830e000640 1 -- 172.21.15.173:0/3834796518 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83100b3040 con 0x7f831415df90 2024-04-25T09:03:39.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831c800640 1 -- 172.21.15.173:0/3834796518 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83140c7a60 con 0x7f831415df90 2024-04-25T09:03:39.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f830e000640 1 -- 172.21.15.173:0/3834796518 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310003dc0 con 0x7f831415df90 2024-04-25T09:03:39.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831c800640 1 -- 172.21.15.173:0/3834796518 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8314154c40 con 0x7f831415df90 2024-04-25T09:03:39.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.062+0000 7f831c800640 1 -- 172.21.15.173:0/3834796518 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8314073a40 con 0x7f831415df90 2024-04-25T09:03:39.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.066+0000 7f830e000640 1 -- 172.21.15.173:0/3834796518 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f83100c1060 con 0x7f831415df90 2024-04-25T09:03:39.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.066+0000 7f830e000640 1 --2- 172.21.15.173:0/3834796518 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f82f8066f60 0x7f82f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.066+0000 7f830e000640 1 -- 172.21.15.173:0/3834796518 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f831011f3c0 con 0x7f831415df90 2024-04-25T09:03:39.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.066+0000 7f8319e00640 1 --2- 172.21.15.173:0/3834796518 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f82f8066f60 0x7f82f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.066+0000 7f8319e00640 1 --2- 172.21.15.173:0/3834796518 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f82f8066f60 0x7f82f8069420 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8308000f70 tx=0x7f8308007240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:39.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.070+0000 7f830e000640 1 -- 172.21.15.173:0/3834796518 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8310016560 con 0x7f831415df90 2024-04-25T09:03:39.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.226+0000 7f831c800640 1 -- 172.21.15.173:0/3834796518 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83140c7c30 con 0x7f831415df90 2024-04-25T09:03:39.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.226+0000 7f830e000640 1 -- 172.21.15.173:0/3834796518 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18906 (secure 0 0 0) 0x7f83100ef8e0 con 0x7f831415df90 2024-04-25T09:03:39.215 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:39.216 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":28,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:03:32.190313+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:39.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.226+0000 7f831c800640 1 -- 172.21.15.173:0/3834796518 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f82f8066f60 msgr2=0x7f82f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.226+0000 7f831c800640 1 --2- 172.21.15.173:0/3834796518 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f82f8066f60 0x7f82f8069420 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8308000f70 tx=0x7f8308007240 comp rx=0 tx=0).stop 2024-04-25T09:03:39.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.226+0000 7f831c800640 1 -- 172.21.15.173:0/3834796518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831415df90 msgr2=0x7f831415f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.226+0000 7f831c800640 1 --2- 172.21.15.173:0/3834796518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831415df90 0x7f831415f650 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f83100b0040 tx=0x7f8310019710 comp rx=0 tx=0).stop 2024-04-25T09:03:39.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.226+0000 7f831c800640 1 -- 172.21.15.173:0/3834796518 shutdown_connections 2024-04-25T09:03:39.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.226+0000 7f831c800640 1 --2- 172.21.15.173:0/3834796518 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f82f8066f60 0x7f82f8069420 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.226+0000 7f831c800640 1 --2- 172.21.15.173:0/3834796518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831415df90 0x7f831415f650 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.226+0000 7f831c800640 1 --2- 172.21.15.173:0/3834796518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f831415dbb0 0x7f831415f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.226+0000 7f831c800640 1 --2- 172.21.15.173:0/3834796518 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f831406ff40 0x7f8314153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.226+0000 7f831c800640 1 -- 172.21.15.173:0/3834796518 >> 172.21.15.173:0/3834796518 conn(0x7f8314061880 msgr2=0x7f831406c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:39.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.226+0000 7f831c800640 1 -- 172.21.15.173:0/3834796518 shutdown_connections 2024-04-25T09:03:39.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.226+0000 7f831c800640 1 -- 172.21.15.173:0/3834796518 wait complete. 2024-04-25T09:03:39.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:02:49.342297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:02:50.386069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:02:54.077429+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:03:39.237 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:39.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.386+0000 7f9994600640 1 Processor -- start 2024-04-25T09:03:39.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.386+0000 7f9994600640 1 -- start start 2024-04-25T09:03:39.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.386+0000 7f9994600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f998c0aff70 0x7f998c15d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.386+0000 7f9994600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f998c06b3a0 0x7f998c072ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.386+0000 7f9994600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998c0cd380 con 0x7f998c072a30 2024-04-25T09:03:39.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.386+0000 7f9994600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998c0cbc10 con 0x7f998c0aff70 2024-04-25T09:03:39.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.386+0000 7f9994600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0cd660 con 0x7f998c06b3a0 2024-04-25T09:03:39.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.386+0000 7f9991c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f998c0aff70 0x7f998c15d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.386+0000 7f9991c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f998c0aff70 0x7f998c15d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56226/0 (socket says 172.21.15.173:56226) 2024-04-25T09:03:39.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.386+0000 7f9991c00640 1 -- 172.21.15.173:0/763231686 learned_addr learned my addr 172.21.15.173:0/763231686 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:39.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.386+0000 7f9992600640 1 --2- 172.21.15.173:0/763231686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f998c06b3a0 0x7f998c072ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.386+0000 7f9991c00640 1 -- 172.21.15.173:0/763231686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f998c06b3a0 msgr2=0x7f998c072ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:39.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.386+0000 7f9991c00640 1 --2- 172.21.15.173:0/763231686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f998c06b3a0 0x7f998c072ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.386+0000 7f9991c00640 1 -- 172.21.15.173:0/763231686 >> v1:172.21.15.194:6789/0 conn(0x7f998c072a30 legacy=0x7f998c06ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:39.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.386+0000 7f9991c00640 1 -- 172.21.15.173:0/763231686 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c0cd940 con 0x7f998c0aff70 2024-04-25T09:03:39.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.386+0000 7f9992600640 1 --2- 172.21.15.173:0/763231686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f998c06b3a0 0x7f998c072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:39.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.390+0000 7f9991c00640 1 --2- 172.21.15.173:0/763231686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f998c0aff70 0x7f998c15d030 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9980009870 tx=0x7f998001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80af6bcaf70818c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:39.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.390+0000 7f998be00640 1 -- 172.21.15.173:0/763231686 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99800a6040 con 0x7f998c0aff70 2024-04-25T09:03:39.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.390+0000 7f998be00640 1 -- 172.21.15.173:0/763231686 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99800af070 con 0x7f998c0aff70 2024-04-25T09:03:39.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.390+0000 7f998be00640 1 -- 172.21.15.173:0/763231686 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99800aa860 con 0x7f998c0aff70 2024-04-25T09:03:39.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.390+0000 7f9994600640 1 -- 172.21.15.173:0/763231686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f998c0aff70 msgr2=0x7f998c15d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.390+0000 7f9994600640 1 --2- 172.21.15.173:0/763231686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f998c0aff70 0x7f998c15d030 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9980009870 tx=0x7f998001c520 comp rx=0 tx=0).stop 2024-04-25T09:03:39.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.390+0000 7f9994600640 1 -- 172.21.15.173:0/763231686 shutdown_connections 2024-04-25T09:03:39.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.390+0000 7f9994600640 1 --2- 172.21.15.173:0/763231686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f998c06b3a0 0x7f998c072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.390+0000 7f9994600640 1 --2- 172.21.15.173:0/763231686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f998c0aff70 0x7f998c15d030 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.390+0000 7f9994600640 1 -- 172.21.15.173:0/763231686 >> 172.21.15.173:0/763231686 conn(0x7f998c0b23f0 msgr2=0x7f998c0b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:39.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.390+0000 7f9994600640 1 -- 172.21.15.173:0/763231686 shutdown_connections 2024-04-25T09:03:39.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.390+0000 7f9994600640 1 -- 172.21.15.173:0/763231686 wait complete. 2024-04-25T09:03:39.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9994600640 1 Processor -- start 2024-04-25T09:03:39.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9994600640 1 -- start start 2024-04-25T09:03:39.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9994600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f998c06b3a0 0x7f998c154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9994600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f998c072a30 0x7f998c0ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9994600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f998c1495c0 0x7f998c0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9994600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c15cb20 con 0x7f998c06b3a0 2024-04-25T09:03:39.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9994600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c15c9a0 con 0x7f998c1495c0 2024-04-25T09:03:39.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9994600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c15cca0 con 0x7f998c072a30 2024-04-25T09:03:39.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9991c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f998c06b3a0 0x7f998c154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9991c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f998c06b3a0 0x7f998c154120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56232/0 (socket says 172.21.15.173:56232) 2024-04-25T09:03:39.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9991c00640 1 -- 172.21.15.173:0/2548245425 learned_addr learned my addr 172.21.15.173:0/2548245425 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:39.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9992600640 1 --2- 172.21.15.173:0/2548245425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f998c1495c0 0x7f998c0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9991200640 1 --2- 172.21.15.173:0/2548245425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f998c072a30 0x7f998c0ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9991c00640 1 -- 172.21.15.173:0/2548245425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f998c072a30 msgr2=0x7f998c0ceaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9991c00640 1 --2- 172.21.15.173:0/2548245425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f998c072a30 0x7f998c0ceaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9991c00640 1 -- 172.21.15.173:0/2548245425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f998c1495c0 msgr2=0x7f998c0c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9991c00640 1 --2- 172.21.15.173:0/2548245425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f998c1495c0 0x7f998c0c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9991c00640 1 -- 172.21.15.173:0/2548245425 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c0cf1f0 con 0x7f998c06b3a0 2024-04-25T09:03:39.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9991200640 1 --2- 172.21.15.173:0/2548245425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f998c072a30 0x7f998c0ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:39.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9991c00640 1 --2- 172.21.15.173:0/2548245425 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f998c06b3a0 0x7f998c154120 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f998001abd0 tx=0x7f998001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:39.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9989600640 1 -- 172.21.15.173:0/2548245425 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99800bd630 con 0x7f998c06b3a0 2024-04-25T09:03:39.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9989600640 1 -- 172.21.15.173:0/2548245425 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99800bd7d0 con 0x7f998c06b3a0 2024-04-25T09:03:39.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9994600640 1 -- 172.21.15.173:0/2548245425 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998c0cf4d0 con 0x7f998c06b3a0 2024-04-25T09:03:39.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9989600640 1 -- 172.21.15.173:0/2548245425 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99800bdb80 con 0x7f998c06b3a0 2024-04-25T09:03:39.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.394+0000 7f9994600640 1 -- 172.21.15.173:0/2548245425 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998c0cfa90 con 0x7f998c06b3a0 2024-04-25T09:03:39.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.398+0000 7f9994600640 1 -- 172.21.15.173:0/2548245425 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998c073ab0 con 0x7f998c06b3a0 2024-04-25T09:03:39.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.398+0000 7f9989600640 1 -- 172.21.15.173:0/2548245425 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f99800b33f0 con 0x7f998c06b3a0 2024-04-25T09:03:39.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.398+0000 7f9989600640 1 --2- 172.21.15.173:0/2548245425 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f996c066f60 0x7f996c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.398+0000 7f9989600640 1 -- 172.21.15.173:0/2548245425 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f998011f920 con 0x7f998c06b3a0 2024-04-25T09:03:39.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.398+0000 7f9991200640 1 --2- 172.21.15.173:0/2548245425 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f996c066f60 0x7f996c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.398+0000 7f9991200640 1 --2- 172.21.15.173:0/2548245425 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f996c066f60 0x7f996c069420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f998c154980 tx=0x7f9978009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:39.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.402+0000 7f9989600640 1 -- 172.21.15.173:0/2548245425 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9980016110 con 0x7f998c06b3a0 2024-04-25T09:03:39.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.554+0000 7f9994600640 1 -- 172.21.15.173:0/2548245425 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f998c15e420 con 0x7f998c06b3a0 2024-04-25T09:03:39.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.558+0000 7f9989600640 1 -- 172.21.15.173:0/2548245425 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f99800eff60 con 0x7f998c06b3a0 2024-04-25T09:03:39.546 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:03:39.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.558+0000 7f9994600640 1 -- 172.21.15.173:0/2548245425 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f996c066f60 msgr2=0x7f996c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.558+0000 7f9994600640 1 --2- 172.21.15.173:0/2548245425 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f996c066f60 0x7f996c069420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f998c154980 tx=0x7f9978009040 comp rx=0 tx=0).stop 2024-04-25T09:03:39.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.558+0000 7f9994600640 1 -- 172.21.15.173:0/2548245425 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f998c06b3a0 msgr2=0x7f998c154120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.558+0000 7f9994600640 1 --2- 172.21.15.173:0/2548245425 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f998c06b3a0 0x7f998c154120 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f998001abd0 tx=0x7f998001ad60 comp rx=0 tx=0).stop 2024-04-25T09:03:39.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.558+0000 7f9994600640 1 -- 172.21.15.173:0/2548245425 shutdown_connections 2024-04-25T09:03:39.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.558+0000 7f9994600640 1 --2- 172.21.15.173:0/2548245425 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f996c066f60 0x7f996c069420 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.558+0000 7f9994600640 1 --2- 172.21.15.173:0/2548245425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f998c1495c0 0x7f998c0c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.558+0000 7f9994600640 1 --2- 172.21.15.173:0/2548245425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f998c072a30 0x7f998c0ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.558+0000 7f9994600640 1 --2- 172.21.15.173:0/2548245425 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f998c06b3a0 0x7f998c154120 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.558+0000 7f9994600640 1 -- 172.21.15.173:0/2548245425 >> 172.21.15.173:0/2548245425 conn(0x7f998c0b23f0 msgr2=0x7f998c154e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:39.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.558+0000 7f9994600640 1 -- 172.21.15.173:0/2548245425 shutdown_connections 2024-04-25T09:03:39.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.558+0000 7f9994600640 1 -- 172.21.15.173:0/2548245425 wait complete. 2024-04-25T09:03:39.568 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:39.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.718+0000 7f3f4d000640 1 Processor -- start 2024-04-25T09:03:39.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.718+0000 7f3f4d000640 1 -- start start 2024-04-25T09:03:39.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.718+0000 7f3f4d000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3f480b95c0 0x7f3f480b5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.718+0000 7f3f4d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f480b58a0 0x7f3f480d24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.718+0000 7f3f4d000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f480b6a10 con 0x7f3f4815da50 2024-04-25T09:03:39.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.718+0000 7f3f4d000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f4806c7f0 con 0x7f3f480b95c0 2024-04-25T09:03:39.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.718+0000 7f3f4d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4806d010 con 0x7f3f480b58a0 2024-04-25T09:03:39.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.722+0000 7f3f47400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f3f4815da50 0x7f3f4806c0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46546/0 (socket says 172.21.15.173:46546) 2024-04-25T09:03:39.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.722+0000 7f3f47400640 1 -- 172.21.15.173:0/270673398 learned_addr learned my addr 172.21.15.173:0/270673398 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:39.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.722+0000 7f3f3ea00640 1 --2- 172.21.15.173:0/270673398 >> v2:172.21.15.194:3300/0 conn(0x7f3f480b95c0 0x7f3f480b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.722+0000 7f3f47e00640 1 --2- 172.21.15.173:0/270673398 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f480b58a0 0x7f3f480d24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.722+0000 7f3f46a00640 1 -- 172.21.15.173:0/270673398 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235401753 0 0) 0x7f3f38001120 con 0x7f3f4815da50 2024-04-25T09:03:39.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.722+0000 7f3f46a00640 1 -- 172.21.15.173:0/270673398 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f2c003530 con 0x7f3f4815da50 2024-04-25T09:03:39.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.722+0000 7f3f47e00640 1 -- 172.21.15.173:0/270673398 >> v2:172.21.15.194:3300/0 conn(0x7f3f480b95c0 msgr2=0x7f3f480b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:39.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.722+0000 7f3f47e00640 1 --2- 172.21.15.173:0/270673398 >> v2:172.21.15.194:3300/0 conn(0x7f3f480b95c0 0x7f3f480b5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.722+0000 7f3f47e00640 1 -- 172.21.15.173:0/270673398 >> v1:172.21.15.173:6789/0 conn(0x7f3f4815da50 legacy=0x7f3f4806c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.722+0000 7f3f47e00640 1 -- 172.21.15.173:0/270673398 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4806ca50 con 0x7f3f480b58a0 2024-04-25T09:03:39.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.722+0000 7f3f47e00640 1 --2- 172.21.15.173:0/270673398 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f480b58a0 0x7f3f480d24e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009d90 tx=0x7f3f4001f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef68b002c6583194 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:39.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f46a00640 1 -- 172.21.15.173:0/270673398 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f400b4070 con 0x7f3f480b58a0 2024-04-25T09:03:39.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f46a00640 1 -- 172.21.15.173:0/270673398 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f400af600 con 0x7f3f480b58a0 2024-04-25T09:03:39.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f46a00640 1 -- 172.21.15.173:0/270673398 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f400af9b0 con 0x7f3f480b58a0 2024-04-25T09:03:39.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f4d000640 1 -- 172.21.15.173:0/270673398 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f480b58a0 msgr2=0x7f3f480d24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f4d000640 1 --2- 172.21.15.173:0/270673398 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f480b58a0 0x7f3f480d24e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009d90 tx=0x7f3f4001f150 comp rx=0 tx=0).stop 2024-04-25T09:03:39.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f4d000640 1 -- 172.21.15.173:0/270673398 shutdown_connections 2024-04-25T09:03:39.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f4d000640 1 --2- 172.21.15.173:0/270673398 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f480b58a0 0x7f3f480d24e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f4d000640 1 --2- 172.21.15.173:0/270673398 >> v2:172.21.15.194:3300/0 conn(0x7f3f480b95c0 0x7f3f480b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f4d000640 1 -- 172.21.15.173:0/270673398 >> 172.21.15.173:0/270673398 conn(0x7f3f480d0530 msgr2=0x7f3f480d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:39.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f4d000640 1 -- 172.21.15.173:0/270673398 shutdown_connections 2024-04-25T09:03:39.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f4d000640 1 -- 172.21.15.173:0/270673398 wait complete. 2024-04-25T09:03:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f4d000640 1 Processor -- start 2024-04-25T09:03:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f4d000640 1 -- start start 2024-04-25T09:03:39.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f4d000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f480b58a0 0x7f3f480cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f4d000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f480b95c0 0x7f3f481f7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f4d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f4815da50 0x7f3f4814fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f4d000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f480d1fc0 con 0x7f3f480b95c0 2024-04-25T09:03:39.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f4d000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f480d1ce0 con 0x7f3f480b58a0 2024-04-25T09:03:39.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f4d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4815de30 con 0x7f3f4815da50 2024-04-25T09:03:39.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f3ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f480b95c0 0x7f3f481f7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f3ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f480b95c0 0x7f3f481f7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56240/0 (socket says 172.21.15.173:56240) 2024-04-25T09:03:39.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.726+0000 7f3f3ea00640 1 -- 172.21.15.173:0/1276042985 learned_addr learned my addr 172.21.15.173:0/1276042985 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:39.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f47400640 1 --2- 172.21.15.173:0/1276042985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f480b58a0 0x7f3f480cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f47e00640 1 --2- 172.21.15.173:0/1276042985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f4815da50 0x7f3f4814fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f3ea00640 1 -- 172.21.15.173:0/1276042985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f4815da50 msgr2=0x7f3f4814fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f3ea00640 1 --2- 172.21.15.173:0/1276042985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f4815da50 0x7f3f4814fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f3ea00640 1 -- 172.21.15.173:0/1276042985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f480b58a0 msgr2=0x7f3f480cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f3ea00640 1 --2- 172.21.15.173:0/1276042985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f480b58a0 0x7f3f480cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f3ea00640 1 -- 172.21.15.173:0/1276042985 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f480cca20 con 0x7f3f480b95c0 2024-04-25T09:03:39.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f47e00640 1 --2- 172.21.15.173:0/1276042985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f4815da50 0x7f3f4814fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:39.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f47400640 1 --2- 172.21.15.173:0/1276042985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f480b58a0 0x7f3f480cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:39.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f3ea00640 1 --2- 172.21.15.173:0/1276042985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f480b95c0 0x7f3f481f7ae0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000e930 tx=0x7f3f3000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:39.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f3fe00640 1 -- 172.21.15.173:0/1276042985 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f30017070 con 0x7f3f480b95c0 2024-04-25T09:03:39.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f3fe00640 1 -- 172.21.15.173:0/1276042985 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3000ca00 con 0x7f3f480b95c0 2024-04-25T09:03:39.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f4d000640 1 -- 172.21.15.173:0/1276042985 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f480ccd00 con 0x7f3f480b95c0 2024-04-25T09:03:39.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f3fe00640 1 -- 172.21.15.173:0/1276042985 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3000cdb0 con 0x7f3f480b95c0 2024-04-25T09:03:39.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f4d000640 1 -- 172.21.15.173:0/1276042985 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f480cd2c0 con 0x7f3f480b95c0 2024-04-25T09:03:39.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f4d000640 1 -- 172.21.15.173:0/1276042985 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f48073a40 con 0x7f3f480b95c0 2024-04-25T09:03:39.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f3fe00640 1 -- 172.21.15.173:0/1276042985 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3f3001a070 con 0x7f3f480b95c0 2024-04-25T09:03:39.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f3fe00640 1 --2- 172.21.15.173:0/1276042985 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f24066f60 0x7f3f24069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f3fe00640 1 -- 172.21.15.173:0/1276042985 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f3f300853d0 con 0x7f3f480b95c0 2024-04-25T09:03:39.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.730+0000 7f3f47400640 1 --2- 172.21.15.173:0/1276042985 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f24066f60 0x7f3f24069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.734+0000 7f3f47400640 1 --2- 172.21.15.173:0/1276042985 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f24066f60 0x7f3f24069420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3f38005890 tx=0x7f3f38009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:39.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.734+0000 7f3f3fe00640 1 -- 172.21.15.173:0/1276042985 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3f30056130 con 0x7f3f480b95c0 2024-04-25T09:03:39.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.890+0000 7f3f4d000640 1 -- 172.21.15.173:0/1276042985 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f48067fc0 con 0x7f3f480b95c0 2024-04-25T09:03:39.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.890+0000 7f3f3fe00640 1 -- 172.21.15.173:0/1276042985 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3f30055a30 con 0x7f3f480b95c0 2024-04-25T09:03:39.880 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:39.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.894+0000 7f3f4d000640 1 -- 172.21.15.173:0/1276042985 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f24066f60 msgr2=0x7f3f24069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.894+0000 7f3f4d000640 1 --2- 172.21.15.173:0/1276042985 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f24066f60 0x7f3f24069420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3f38005890 tx=0x7f3f38009040 comp rx=0 tx=0).stop 2024-04-25T09:03:39.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.894+0000 7f3f4d000640 1 -- 172.21.15.173:0/1276042985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f480b95c0 msgr2=0x7f3f481f7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.894+0000 7f3f4d000640 1 --2- 172.21.15.173:0/1276042985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f480b95c0 0x7f3f481f7ae0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000e930 tx=0x7f3f3000edf0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.894+0000 7f3f4d000640 1 -- 172.21.15.173:0/1276042985 shutdown_connections 2024-04-25T09:03:39.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.894+0000 7f3f4d000640 1 --2- 172.21.15.173:0/1276042985 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f24066f60 0x7f3f24069420 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.894+0000 7f3f4d000640 1 --2- 172.21.15.173:0/1276042985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f4815da50 0x7f3f4814fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.894+0000 7f3f4d000640 1 --2- 172.21.15.173:0/1276042985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f480b95c0 0x7f3f481f7ae0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.894+0000 7f3f4d000640 1 --2- 172.21.15.173:0/1276042985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f480b58a0 0x7f3f480cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.894+0000 7f3f4d000640 1 -- 172.21.15.173:0/1276042985 >> 172.21.15.173:0/1276042985 conn(0x7f3f480d0530 msgr2=0x7f3f480b7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:39.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.894+0000 7f3f4d000640 1 -- 172.21.15.173:0/1276042985 shutdown_connections 2024-04-25T09:03:39.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:39.894+0000 7f3f4d000640 1 -- 172.21.15.173:0/1276042985 wait complete. 2024-04-25T09:03:39.901 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:40.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.054+0000 7f84d9600640 1 Processor -- start 2024-04-25T09:03:40.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.054+0000 7f84d9600640 1 -- start start 2024-04-25T09:03:40.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.054+0000 7f84d9600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d40b4ba0 0x7f84d40adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.054+0000 7f84d9600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f84d40ae4c0 0x7f84d406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.054+0000 7f84d9600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d40aed20 con 0x7f84d415a730 2024-04-25T09:03:40.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.054+0000 7f84d9600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d40af000 con 0x7f84d40ae4c0 2024-04-25T09:03:40.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.054+0000 7f84d9600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d40af2e0 con 0x7f84d40b4ba0 2024-04-25T09:03:40.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.054+0000 7f84d3400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d40b4ba0 0x7f84d40adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.054+0000 7f84d8c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f84d40ae4c0 0x7f84d406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.054+0000 7f84d8c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f84d40ae4c0 0x7f84d406e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:41702/0 (socket says 172.21.15.173:41702) 2024-04-25T09:03:40.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.054+0000 7f84d8c00640 1 -- 172.21.15.173:0/2316602542 learned_addr learned my addr 172.21.15.173:0/2316602542 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:40.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.054+0000 7f84d3400640 1 -- 172.21.15.173:0/2316602542 >> v2:172.21.15.194:3300/0 conn(0x7f84d40ae4c0 msgr2=0x7f84d406e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:40.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.054+0000 7f84d3400640 1 --2- 172.21.15.173:0/2316602542 >> v2:172.21.15.194:3300/0 conn(0x7f84d40ae4c0 0x7f84d406e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.054+0000 7f84d3400640 1 -- 172.21.15.173:0/2316602542 >> v1:172.21.15.194:6789/0 conn(0x7f84d415a730 legacy=0x7f84d40b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.054+0000 7f84d3400640 1 -- 172.21.15.173:0/2316602542 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d406daa0 con 0x7f84d40b4ba0 2024-04-25T09:03:40.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.054+0000 7f84d8c00640 1 --2- 172.21.15.173:0/2316602542 >> v2:172.21.15.194:3300/0 conn(0x7f84d40ae4c0 0x7f84d406e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:40.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.058+0000 7f84d3400640 1 --2- 172.21.15.173:0/2316602542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d40b4ba0 0x7f84d40adf80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f84c00097c0 tx=0x7f84c001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff41e2b0000f6ed7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.058+0000 7f84d2a00640 1 -- 172.21.15.173:0/2316602542 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c00b1070 con 0x7f84d40b4ba0 2024-04-25T09:03:40.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.058+0000 7f84d2a00640 1 -- 172.21.15.173:0/2316602542 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c00ac410 con 0x7f84d40b4ba0 2024-04-25T09:03:40.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.058+0000 7f84d2a00640 1 -- 172.21.15.173:0/2316602542 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d40aeae0 con 0x7f84d40b4ba0 2024-04-25T09:03:40.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.058+0000 7f84d9600640 1 -- 172.21.15.173:0/2316602542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d40b4ba0 msgr2=0x7f84d40adf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.058+0000 7f84d9600640 1 --2- 172.21.15.173:0/2316602542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d40b4ba0 0x7f84d40adf80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f84c00097c0 tx=0x7f84c001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.058+0000 7f84d9600640 1 -- 172.21.15.173:0/2316602542 shutdown_connections 2024-04-25T09:03:40.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.058+0000 7f84d9600640 1 --2- 172.21.15.173:0/2316602542 >> v2:172.21.15.194:3300/0 conn(0x7f84d40ae4c0 0x7f84d406e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.058+0000 7f84d9600640 1 --2- 172.21.15.173:0/2316602542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d40b4ba0 0x7f84d40adf80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.058+0000 7f84d9600640 1 -- 172.21.15.173:0/2316602542 >> 172.21.15.173:0/2316602542 conn(0x7f84d40b2200 msgr2=0x7f84d40cfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.058+0000 7f84d9600640 1 -- 172.21.15.173:0/2316602542 shutdown_connections 2024-04-25T09:03:40.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.058+0000 7f84d9600640 1 -- 172.21.15.173:0/2316602542 wait complete. 2024-04-25T09:03:40.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d9600640 1 Processor -- start 2024-04-25T09:03:40.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d9600640 1 -- start start 2024-04-25T09:03:40.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d9600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d40ae4c0 0x7f84d41573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d9600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d40b4ba0 0x7f84d406b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d9600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d415a730 0x7f84d414b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d9600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d406eff0 con 0x7f84d40ae4c0 2024-04-25T09:03:40.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d9600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d415ad20 con 0x7f84d415a730 2024-04-25T09:03:40.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d9600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d406f170 con 0x7f84d40b4ba0 2024-04-25T09:03:40.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d40ae4c0 0x7f84d41573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d40ae4c0 0x7f84d41573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56250/0 (socket says 172.21.15.173:56250) 2024-04-25T09:03:40.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d3e00640 1 -- 172.21.15.173:0/1314498506 learned_addr learned my addr 172.21.15.173:0/1314498506 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:40.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d3400640 1 --2- 172.21.15.173:0/1314498506 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d40b4ba0 0x7f84d406b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d8c00640 1 --2- 172.21.15.173:0/1314498506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d415a730 0x7f84d414b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d3e00640 1 -- 172.21.15.173:0/1314498506 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d40b4ba0 msgr2=0x7f84d406b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d3e00640 1 --2- 172.21.15.173:0/1314498506 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d40b4ba0 0x7f84d406b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d3e00640 1 -- 172.21.15.173:0/1314498506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d415a730 msgr2=0x7f84d414b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d3e00640 1 --2- 172.21.15.173:0/1314498506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d415a730 0x7f84d414b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d3e00640 1 -- 172.21.15.173:0/1314498506 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d40cbda0 con 0x7f84d40ae4c0 2024-04-25T09:03:40.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d3400640 1 --2- 172.21.15.173:0/1314498506 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d40b4ba0 0x7f84d406b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:40.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d3e00640 1 --2- 172.21.15.173:0/1314498506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d40ae4c0 0x7f84d41573a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f84c400c760 tx=0x7f84c400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84cbe00640 1 -- 172.21.15.173:0/1314498506 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4016020 con 0x7f84d40ae4c0 2024-04-25T09:03:40.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84cbe00640 1 -- 172.21.15.173:0/1314498506 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c4006d60 con 0x7f84d40ae4c0 2024-04-25T09:03:40.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84cbe00640 1 -- 172.21.15.173:0/1314498506 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4003bc0 con 0x7f84d40ae4c0 2024-04-25T09:03:40.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d9600640 1 -- 172.21.15.173:0/1314498506 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d4156900 con 0x7f84d40ae4c0 2024-04-25T09:03:40.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.062+0000 7f84d9600640 1 -- 172.21.15.173:0/1314498506 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d4156ba0 con 0x7f84d40ae4c0 2024-04-25T09:03:40.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.066+0000 7f84d9600640 1 -- 172.21.15.173:0/1314498506 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d4073a40 con 0x7f84d40ae4c0 2024-04-25T09:03:40.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.066+0000 7f84cbe00640 1 -- 172.21.15.173:0/1314498506 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f84c400a850 con 0x7f84d40ae4c0 2024-04-25T09:03:40.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.066+0000 7f84cbe00640 1 --2- 172.21.15.173:0/1314498506 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84b4066f90 0x7f84b4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.066+0000 7f84cbe00640 1 -- 172.21.15.173:0/1314498506 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f84c4084ed0 con 0x7f84d40ae4c0 2024-04-25T09:03:40.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.066+0000 7f84d3400640 1 --2- 172.21.15.173:0/1314498506 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84b4066f90 0x7f84b4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.066+0000 7f84d3400640 1 --2- 172.21.15.173:0/1314498506 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84b4066f90 0x7f84b4069450 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f84c00ae000 tx=0x7f84c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.070+0000 7f84cbe00640 1 -- 172.21.15.173:0/1314498506 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f84c4020020 con 0x7f84d40ae4c0 2024-04-25T09:03:40.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.226+0000 7f84d9600640 1 -- 172.21.15.173:0/1314498506 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f84d40b2cb0 con 0x7f84d40ae4c0 2024-04-25T09:03:40.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.226+0000 7f84cbe00640 1 -- 172.21.15.173:0/1314498506 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f84c4055520 con 0x7f84d40ae4c0 2024-04-25T09:03:40.216 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:03:40.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.230+0000 7f84d9600640 1 -- 172.21.15.173:0/1314498506 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84b4066f90 msgr2=0x7f84b4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.230+0000 7f84d9600640 1 --2- 172.21.15.173:0/1314498506 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84b4066f90 0x7f84b4069450 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f84c00ae000 tx=0x7f84c0008040 comp rx=0 tx=0).stop 2024-04-25T09:03:40.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.230+0000 7f84d9600640 1 -- 172.21.15.173:0/1314498506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d40ae4c0 msgr2=0x7f84d41573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.230+0000 7f84d9600640 1 --2- 172.21.15.173:0/1314498506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d40ae4c0 0x7f84d41573a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f84c400c760 tx=0x7f84c400cc20 comp rx=0 tx=0).stop 2024-04-25T09:03:40.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.230+0000 7f84d9600640 1 -- 172.21.15.173:0/1314498506 shutdown_connections 2024-04-25T09:03:40.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.230+0000 7f84d9600640 1 --2- 172.21.15.173:0/1314498506 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84b4066f90 0x7f84b4069450 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.230+0000 7f84d9600640 1 --2- 172.21.15.173:0/1314498506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d415a730 0x7f84d414b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.230+0000 7f84d9600640 1 --2- 172.21.15.173:0/1314498506 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d40b4ba0 0x7f84d406b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.230+0000 7f84d9600640 1 --2- 172.21.15.173:0/1314498506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d40ae4c0 0x7f84d41573a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.230+0000 7f84d9600640 1 -- 172.21.15.173:0/1314498506 >> 172.21.15.173:0/1314498506 conn(0x7f84d40b2200 msgr2=0x7f84d414c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.230+0000 7f84d9600640 1 -- 172.21.15.173:0/1314498506 shutdown_connections 2024-04-25T09:03:40.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.230+0000 7f84d9600640 1 -- 172.21.15.173:0/1314498506 wait complete. 2024-04-25T09:03:40.238 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:03:40.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.386+0000 7f5dabc00640 1 Processor -- start 2024-04-25T09:03:40.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.386+0000 7f5dabc00640 1 -- start start 2024-04-25T09:03:40.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.390+0000 7f5dabc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5da40b3fe0 0x7f5da40b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.390+0000 7f5dabc00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da406d4b0 con 0x7f5da4145290 2024-04-25T09:03:40.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.390+0000 7f5dabc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da406d790 con 0x7f5da40cc260 2024-04-25T09:03:40.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.390+0000 7f5dabc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da40ccd80 con 0x7f5da40b3fe0 2024-04-25T09:03:40.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.390+0000 7f5da9200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f5da4145290 0x7f5da415c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46556/0 (socket says 172.21.15.173:46556) 2024-04-25T09:03:40.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.390+0000 7f5da9200640 1 -- 172.21.15.173:0/1340242314 learned_addr learned my addr 172.21.15.173:0/1340242314 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:40.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.390+0000 7f5d9be00640 1 --2- 172.21.15.173:0/1340242314 >> v2:172.21.15.194:3300/0 conn(0x7f5da40b3fe0 0x7f5da40b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.390+0000 7f5da3e00640 1 -- 172.21.15.173:0/1340242314 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987234403 0 0) 0x7f5da406d4b0 con 0x7f5da4145290 2024-04-25T09:03:40.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.390+0000 7f5da3e00640 1 -- 172.21.15.173:0/1340242314 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d88003530 con 0x7f5da4145290 2024-04-25T09:03:40.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.390+0000 7f5da3e00640 1 -- 172.21.15.173:0/1340242314 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426738793 0 0) 0x7f5da406d790 con 0x7f5da40cc260 2024-04-25T09:03:40.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.390+0000 7f5da3e00640 1 -- 172.21.15.173:0/1340242314 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5da406d4b0 con 0x7f5da40cc260 2024-04-25T09:03:40.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.390+0000 7f5d9be00640 1 -- 172.21.15.173:0/1340242314 >> v1:172.21.15.194:6789/0 conn(0x7f5da40cc260 legacy=0x7f5da40cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.390+0000 7f5d9be00640 1 -- 172.21.15.173:0/1340242314 >> v1:172.21.15.173:6789/0 conn(0x7f5da4145290 legacy=0x7f5da415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.390+0000 7f5d9be00640 1 -- 172.21.15.173:0/1340242314 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da406da70 con 0x7f5da40b3fe0 2024-04-25T09:03:40.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.394+0000 7f5d9be00640 1 --2- 172.21.15.173:0/1340242314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5da40b3fe0 0x7f5da40b4450 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0097c0 tx=0x7f5d8c01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be16768bf12ab8a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.394+0000 7f5da3e00640 1 -- 172.21.15.173:0/1340242314 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c0b0070 con 0x7f5da40b3fe0 2024-04-25T09:03:40.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.394+0000 7f5da3e00640 1 -- 172.21.15.173:0/1340242314 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8c0ab600 con 0x7f5da40b3fe0 2024-04-25T09:03:40.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.394+0000 7f5da3e00640 1 -- 172.21.15.173:0/1340242314 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c0ab9d0 con 0x7f5da40b3fe0 2024-04-25T09:03:40.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.394+0000 7f5dabc00640 1 -- 172.21.15.173:0/1340242314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5da40b3fe0 msgr2=0x7f5da40b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.394+0000 7f5dabc00640 1 --2- 172.21.15.173:0/1340242314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5da40b3fe0 0x7f5da40b4450 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0097c0 tx=0x7f5d8c01c380 comp rx=0 tx=0).stop 2024-04-25T09:03:40.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.394+0000 7f5dabc00640 1 -- 172.21.15.173:0/1340242314 shutdown_connections 2024-04-25T09:03:40.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.394+0000 7f5dabc00640 1 --2- 172.21.15.173:0/1340242314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5da40b3fe0 0x7f5da40b4450 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.394+0000 7f5dabc00640 1 -- 172.21.15.173:0/1340242314 >> 172.21.15.173:0/1340242314 conn(0x7f5da406ac90 msgr2=0x7f5da406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.394+0000 7f5dabc00640 1 -- 172.21.15.173:0/1340242314 shutdown_connections 2024-04-25T09:03:40.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.394+0000 7f5dabc00640 1 -- 172.21.15.173:0/1340242314 wait complete. 2024-04-25T09:03:40.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.394+0000 7f5dabc00640 1 Processor -- start 2024-04-25T09:03:40.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.394+0000 7f5dabc00640 1 -- start start 2024-04-25T09:03:40.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5dabc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5da40b3fe0 0x7f5da413f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5dabc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5da40cc260 0x7f5da413c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5dabc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5da4145290 0x7f5da415a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5dabc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da406eee0 con 0x7f5da40b3fe0 2024-04-25T09:03:40.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5dabc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da406ed60 con 0x7f5da40cc260 2024-04-25T09:03:40.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5dabc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da406f060 con 0x7f5da4145290 2024-04-25T09:03:40.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5da9200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5da40b3fe0 0x7f5da413f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5da9200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5da40b3fe0 0x7f5da413f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56262/0 (socket says 172.21.15.173:56262) 2024-04-25T09:03:40.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5da9200640 1 -- 172.21.15.173:0/2577301721 learned_addr learned my addr 172.21.15.173:0/2577301721 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:40.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5d9be00640 1 --2- 172.21.15.173:0/2577301721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5da40cc260 0x7f5da413c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5da9c00640 1 --2- 172.21.15.173:0/2577301721 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5da4145290 0x7f5da415a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5da9200640 1 -- 172.21.15.173:0/2577301721 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5da4145290 msgr2=0x7f5da415a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5da9200640 1 --2- 172.21.15.173:0/2577301721 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5da4145290 0x7f5da415a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5da9200640 1 -- 172.21.15.173:0/2577301721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5da40cc260 msgr2=0x7f5da413c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5da9200640 1 --2- 172.21.15.173:0/2577301721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5da40cc260 0x7f5da413c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5da9200640 1 -- 172.21.15.173:0/2577301721 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da40ae340 con 0x7f5da40b3fe0 2024-04-25T09:03:40.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5da9200640 1 --2- 172.21.15.173:0/2577301721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5da40b3fe0 0x7f5da413f3f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400c4d0 tx=0x7f5d9400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5da1600640 1 -- 172.21.15.173:0/2577301721 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94017070 con 0x7f5da40b3fe0 2024-04-25T09:03:40.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5da1600640 1 -- 172.21.15.173:0/2577301721 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d94005cf0 con 0x7f5da40b3fe0 2024-04-25T09:03:40.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5dabc00640 1 -- 172.21.15.173:0/2577301721 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da40ae620 con 0x7f5da40b3fe0 2024-04-25T09:03:40.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5da1600640 1 -- 172.21.15.173:0/2577301721 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d940072b0 con 0x7f5da40b3fe0 2024-04-25T09:03:40.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5dabc00640 1 -- 172.21.15.173:0/2577301721 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da4159da0 con 0x7f5da40b3fe0 2024-04-25T09:03:40.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5dabc00640 1 -- 172.21.15.173:0/2577301721 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da4073ab0 con 0x7f5da40b3fe0 2024-04-25T09:03:40.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.398+0000 7f5da1600640 1 -- 172.21.15.173:0/2577301721 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5d9401a070 con 0x7f5da40b3fe0 2024-04-25T09:03:40.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.402+0000 7f5da1600640 1 --2- 172.21.15.173:0/2577301721 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5d80066f60 0x7f5d80069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.402+0000 7f5da1600640 1 -- 172.21.15.173:0/2577301721 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f5d94084900 con 0x7f5da40b3fe0 2024-04-25T09:03:40.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.402+0000 7f5d9be00640 1 --2- 172.21.15.173:0/2577301721 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5d80066f60 0x7f5d80069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.402+0000 7f5d9be00640 1 --2- 172.21.15.173:0/2577301721 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5d80066f60 0x7f5d80069420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0ad000 tx=0x7f5d8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.405+0000 7f5da1600640 1 -- 172.21.15.173:0/2577301721 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5d94054da0 con 0x7f5da40b3fe0 2024-04-25T09:03:40.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.557+0000 7f5dabc00640 1 -- 172.21.15.173:0/2577301721 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5da406b3c0 con 0x7f5da40b3fe0 2024-04-25T09:03:40.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.557+0000 7f5da1600640 1 -- 172.21.15.173:0/2577301721 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5d94058e40 con 0x7f5da40b3fe0 2024-04-25T09:03:40.549 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:40.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.561+0000 7f5dabc00640 1 -- 172.21.15.173:0/2577301721 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5d80066f60 msgr2=0x7f5d80069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.561+0000 7f5dabc00640 1 --2- 172.21.15.173:0/2577301721 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5d80066f60 0x7f5d80069420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0ad000 tx=0x7f5d8c008040 comp rx=0 tx=0).stop 2024-04-25T09:03:40.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.561+0000 7f5dabc00640 1 -- 172.21.15.173:0/2577301721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5da40b3fe0 msgr2=0x7f5da413f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.561+0000 7f5dabc00640 1 --2- 172.21.15.173:0/2577301721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5da40b3fe0 0x7f5da413f3f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400c4d0 tx=0x7f5d9400c990 comp rx=0 tx=0).stop 2024-04-25T09:03:40.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.561+0000 7f5dabc00640 1 -- 172.21.15.173:0/2577301721 shutdown_connections 2024-04-25T09:03:40.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.561+0000 7f5dabc00640 1 --2- 172.21.15.173:0/2577301721 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5d80066f60 0x7f5d80069420 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.561+0000 7f5dabc00640 1 --2- 172.21.15.173:0/2577301721 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5da4145290 0x7f5da415a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.561+0000 7f5dabc00640 1 --2- 172.21.15.173:0/2577301721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5da40cc260 0x7f5da413c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.561+0000 7f5dabc00640 1 --2- 172.21.15.173:0/2577301721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5da40b3fe0 0x7f5da413f3f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.561+0000 7f5dabc00640 1 -- 172.21.15.173:0/2577301721 >> 172.21.15.173:0/2577301721 conn(0x7f5da406ac90 msgr2=0x7f5da415d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.561+0000 7f5dabc00640 1 -- 172.21.15.173:0/2577301721 shutdown_connections 2024-04-25T09:03:40.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.561+0000 7f5dabc00640 1 -- 172.21.15.173:0/2577301721 wait complete. 2024-04-25T09:03:40.571 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:03:40.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.717+0000 7ff2dcc00640 1 Processor -- start 2024-04-25T09:03:40.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.717+0000 7ff2dcc00640 1 -- start start 2024-04-25T09:03:40.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.717+0000 7ff2dcc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2d815dbc0 0x7ff2d8099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.721+0000 7ff2dcc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff2d8099f90 0x7ff2d806bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.721+0000 7ff2dcc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d80b1040 con 0x7ff2d806c2e0 2024-04-25T09:03:40.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.721+0000 7ff2dcc00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d80cfce0 con 0x7ff2d8099f90 2024-04-25T09:03:40.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.721+0000 7ff2dcc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d809a3d0 con 0x7ff2d815dbc0 2024-04-25T09:03:40.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.721+0000 7ff2cfe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff2d8099f90 0x7ff2d806bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.721+0000 7ff2cfe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff2d8099f90 0x7ff2d806bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56266/0 (socket says 172.21.15.173:56266) 2024-04-25T09:03:40.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.721+0000 7ff2cfe00640 1 -- 172.21.15.173:0/2098020290 learned_addr learned my addr 172.21.15.173:0/2098020290 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:40.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.721+0000 7ff2d7400640 1 --2- 172.21.15.173:0/2098020290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2d815dbc0 0x7ff2d8099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.721+0000 7ff2cfe00640 1 -- 172.21.15.173:0/2098020290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2d815dbc0 msgr2=0x7ff2d8099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:40.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.721+0000 7ff2cfe00640 1 --2- 172.21.15.173:0/2098020290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2d815dbc0 0x7ff2d8099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.721+0000 7ff2cfe00640 1 -- 172.21.15.173:0/2098020290 >> v1:172.21.15.194:6789/0 conn(0x7ff2d806c2e0 legacy=0x7ff2d8161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.721+0000 7ff2cfe00640 1 -- 172.21.15.173:0/2098020290 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d806cab0 con 0x7ff2d8099f90 2024-04-25T09:03:40.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.721+0000 7ff2cfe00640 1 --2- 172.21.15.173:0/2098020290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d8099f90 0x7ff2d806bda0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009870 tx=0x7ff2c001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fdb44c3c993852b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.721+0000 7ff2d6a00640 1 -- 172.21.15.173:0/2098020290 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c00b2070 con 0x7ff2d8099f90 2024-04-25T09:03:40.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.721+0000 7ff2d6a00640 1 -- 172.21.15.173:0/2098020290 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c00ad640 con 0x7ff2d8099f90 2024-04-25T09:03:40.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.721+0000 7ff2d6a00640 1 -- 172.21.15.173:0/2098020290 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c00ada10 con 0x7ff2d8099f90 2024-04-25T09:03:40.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2dcc00640 1 -- 172.21.15.173:0/2098020290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d8099f90 msgr2=0x7ff2d806bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2dcc00640 1 --2- 172.21.15.173:0/2098020290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d8099f90 0x7ff2d806bda0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009870 tx=0x7ff2c001c560 comp rx=0 tx=0).stop 2024-04-25T09:03:40.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2dcc00640 1 -- 172.21.15.173:0/2098020290 shutdown_connections 2024-04-25T09:03:40.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2dcc00640 1 --2- 172.21.15.173:0/2098020290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d8099f90 0x7ff2d806bda0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2dcc00640 1 --2- 172.21.15.173:0/2098020290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2d815dbc0 0x7ff2d8099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2dcc00640 1 -- 172.21.15.173:0/2098020290 >> 172.21.15.173:0/2098020290 conn(0x7ff2d80b31d0 msgr2=0x7ff2d80b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2dcc00640 1 -- 172.21.15.173:0/2098020290 shutdown_connections 2024-04-25T09:03:40.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2dcc00640 1 -- 172.21.15.173:0/2098020290 wait complete. 2024-04-25T09:03:40.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2dcc00640 1 Processor -- start 2024-04-25T09:03:40.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2dcc00640 1 -- start start 2024-04-25T09:03:40.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2dcc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2d806c2e0 0x7ff2d81562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2dcc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d8099f90 0x7ff2d80cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2dcc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2d815dbc0 0x7ff2d80b6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2dcc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d806c6f0 con 0x7ff2d8099f90 2024-04-25T09:03:40.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2dcc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d80d1180 con 0x7ff2d806c2e0 2024-04-25T09:03:40.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2dcc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d806c870 con 0x7ff2d815dbc0 2024-04-25T09:03:40.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2cfe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d8099f90 0x7ff2d80cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2cfe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d8099f90 0x7ff2d80cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56282/0 (socket says 172.21.15.173:56282) 2024-04-25T09:03:40.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2cfe00640 1 -- 172.21.15.173:0/51416292 learned_addr learned my addr 172.21.15.173:0/51416292 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:40.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2d7400640 1 --2- 172.21.15.173:0/51416292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2d806c2e0 0x7ff2d81562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2d7e00640 1 --2- 172.21.15.173:0/51416292 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2d815dbc0 0x7ff2d80b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2cfe00640 1 -- 172.21.15.173:0/51416292 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2d815dbc0 msgr2=0x7ff2d80b6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2cfe00640 1 --2- 172.21.15.173:0/51416292 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2d815dbc0 0x7ff2d80b6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2cfe00640 1 -- 172.21.15.173:0/51416292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2d806c2e0 msgr2=0x7ff2d81562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2cfe00640 1 --2- 172.21.15.173:0/51416292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2d806c2e0 0x7ff2d81562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.725+0000 7ff2cfe00640 1 -- 172.21.15.173:0/51416292 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d80ca750 con 0x7ff2d8099f90 2024-04-25T09:03:40.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.729+0000 7ff2cfe00640 1 --2- 172.21.15.173:0/51416292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d8099f90 0x7ff2d80cb2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00b0040 tx=0x7ff2c0019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.729+0000 7ff2cf400640 1 -- 172.21.15.173:0/51416292 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c00bd070 con 0x7ff2d8099f90 2024-04-25T09:03:40.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.729+0000 7ff2cf400640 1 -- 172.21.15.173:0/51416292 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c00b6770 con 0x7ff2d8099f90 2024-04-25T09:03:40.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.729+0000 7ff2cf400640 1 -- 172.21.15.173:0/51416292 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c00b2070 con 0x7ff2d8099f90 2024-04-25T09:03:40.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.729+0000 7ff2dcc00640 1 -- 172.21.15.173:0/51416292 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d80caa30 con 0x7ff2d8099f90 2024-04-25T09:03:40.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.729+0000 7ff2dcc00640 1 -- 172.21.15.173:0/51416292 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d80ae5e0 con 0x7ff2d8099f90 2024-04-25T09:03:40.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.729+0000 7ff2dcc00640 1 -- 172.21.15.173:0/51416292 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d8073a40 con 0x7ff2d8099f90 2024-04-25T09:03:40.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.729+0000 7ff2cf400640 1 -- 172.21.15.173:0/51416292 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff2c00c0070 con 0x7ff2d8099f90 2024-04-25T09:03:40.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.729+0000 7ff2cf400640 1 --2- 172.21.15.173:0/51416292 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff2b4066f60 0x7ff2b4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.729+0000 7ff2cf400640 1 -- 172.21.15.173:0/51416292 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ff2c011eff0 con 0x7ff2d8099f90 2024-04-25T09:03:40.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.729+0000 7ff2d7400640 1 --2- 172.21.15.173:0/51416292 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff2b4066f60 0x7ff2b4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.733+0000 7ff2d7400640 1 --2- 172.21.15.173:0/51416292 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff2b4066f60 0x7ff2b4069420 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800b9d0 tx=0x7ff2c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.733+0000 7ff2cf400640 1 -- 172.21.15.173:0/51416292 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff2c0016150 con 0x7ff2d8099f90 2024-04-25T09:03:40.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.897+0000 7ff2dcc00640 1 -- 172.21.15.173:0/51416292 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff2d80b4030 con 0x7ff2d8099f90 2024-04-25T09:03:40.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.901+0000 7ff2cf400640 1 -- 172.21.15.173:0/51416292 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff2c00efbf0 con 0x7ff2d8099f90 2024-04-25T09:03:40.890 INFO:teuthology.orchestra.run.smithi173.stderr:listed 0 entries 2024-04-25T09:03:40.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.901+0000 7ff2dcc00640 1 -- 172.21.15.173:0/51416292 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff2b4066f60 msgr2=0x7ff2b4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.901+0000 7ff2dcc00640 1 --2- 172.21.15.173:0/51416292 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff2b4066f60 0x7ff2b4069420 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800b9d0 tx=0x7ff2c8008040 comp rx=0 tx=0).stop 2024-04-25T09:03:40.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.901+0000 7ff2dcc00640 1 -- 172.21.15.173:0/51416292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d8099f90 msgr2=0x7ff2d80cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.901+0000 7ff2dcc00640 1 --2- 172.21.15.173:0/51416292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d8099f90 0x7ff2d80cb2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00b0040 tx=0x7ff2c0019300 comp rx=0 tx=0).stop 2024-04-25T09:03:40.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.901+0000 7ff2dcc00640 1 -- 172.21.15.173:0/51416292 shutdown_connections 2024-04-25T09:03:40.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.901+0000 7ff2dcc00640 1 --2- 172.21.15.173:0/51416292 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff2b4066f60 0x7ff2b4069420 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.901+0000 7ff2dcc00640 1 --2- 172.21.15.173:0/51416292 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2d815dbc0 0x7ff2d80b6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.901+0000 7ff2dcc00640 1 --2- 172.21.15.173:0/51416292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2d8099f90 0x7ff2d80cb2f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.901+0000 7ff2dcc00640 1 --2- 172.21.15.173:0/51416292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2d806c2e0 0x7ff2d81562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.901+0000 7ff2dcc00640 1 -- 172.21.15.173:0/51416292 >> 172.21.15.173:0/51416292 conn(0x7ff2d80b31d0 msgr2=0x7ff2d8070550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.901+0000 7ff2dcc00640 1 -- 172.21.15.173:0/51416292 shutdown_connections 2024-04-25T09:03:40.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:40.901+0000 7ff2dcc00640 1 -- 172.21.15.173:0/51416292 wait complete. 2024-04-25T09:03:40.910 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:03:40.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:40.911 DEBUG:teuthology.orchestra.run.smithi173:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-25T09:03:40.953 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:03:40.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:40.954 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:03:41.005 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:03:41.006 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:41.015 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:03:41.015 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:41.066 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:03:41.066 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:41.123 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:41.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.269+0000 7fd474600640 1 Processor -- start 2024-04-25T09:03:41.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.269+0000 7fd474600640 1 -- start start 2024-04-25T09:03:41.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.273+0000 7fd474600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd46c0b2ca0 0x7fd46c0b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.273+0000 7fd474600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46c06e860 con 0x7fd46c15a180 2024-04-25T09:03:41.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.273+0000 7fd474600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46c06eb20 con 0x7fd46c071a30 2024-04-25T09:03:41.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.273+0000 7fd474600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46c0af230 con 0x7fd46c0b2ca0 2024-04-25T09:03:41.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.273+0000 7fd471c00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd46c15a180 0x7fd46c071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46572/0 (socket says 172.21.15.173:46572) 2024-04-25T09:03:41.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.273+0000 7fd471c00640 1 -- 172.21.15.173:0/695961672 learned_addr learned my addr 172.21.15.173:0/695961672 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:41.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.273+0000 7fd472600640 1 --2- 172.21.15.173:0/695961672 >> v2:172.21.15.173:3300/0 conn(0x7fd46c0b2ca0 0x7fd46c0b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.273+0000 7fd472600640 1 -- 172.21.15.173:0/695961672 >> v1:172.21.15.194:6789/0 conn(0x7fd46c071a30 legacy=0x7fd46c06d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.273+0000 7fd472600640 1 -- 172.21.15.173:0/695961672 >> v1:172.21.15.173:6789/0 conn(0x7fd46c15a180 legacy=0x7fd46c071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.273+0000 7fd472600640 1 -- 172.21.15.173:0/695961672 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c0aebe0 con 0x7fd46c0b2ca0 2024-04-25T09:03:41.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.273+0000 7fd46be00640 1 -- 172.21.15.173:0/695961672 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567259937 0 0) 0x7fd46c06e860 con 0x7fd46c15a180 2024-04-25T09:03:41.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd472600640 1 --2- 172.21.15.173:0/695961672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46c0b2ca0 0x7fd46c0b40e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd464009d90 tx=0x7fd46401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f4e6112a88e184 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd46be00640 1 -- 172.21.15.173:0/695961672 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4640b2070 con 0x7fd46c0b2ca0 2024-04-25T09:03:41.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd46be00640 1 -- 172.21.15.173:0/695961672 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4640a5910 con 0x7fd46c0b2ca0 2024-04-25T09:03:41.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd46be00640 1 -- 172.21.15.173:0/695961672 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4640a5ce0 con 0x7fd46c0b2ca0 2024-04-25T09:03:41.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd474600640 1 -- 172.21.15.173:0/695961672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46c0b2ca0 msgr2=0x7fd46c0b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd474600640 1 --2- 172.21.15.173:0/695961672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46c0b2ca0 0x7fd46c0b40e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd464009d90 tx=0x7fd46401c970 comp rx=0 tx=0).stop 2024-04-25T09:03:41.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd474600640 1 -- 172.21.15.173:0/695961672 shutdown_connections 2024-04-25T09:03:41.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd474600640 1 --2- 172.21.15.173:0/695961672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46c0b2ca0 0x7fd46c0b40e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd474600640 1 -- 172.21.15.173:0/695961672 >> 172.21.15.173:0/695961672 conn(0x7fd46c06ac90 msgr2=0x7fd46c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:41.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd474600640 1 -- 172.21.15.173:0/695961672 shutdown_connections 2024-04-25T09:03:41.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd474600640 1 -- 172.21.15.173:0/695961672 wait complete. 2024-04-25T09:03:41.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd474600640 1 Processor -- start 2024-04-25T09:03:41.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd474600640 1 -- start start 2024-04-25T09:03:41.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd474600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd46c071a30 0x7fd46c158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd474600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46c0b2ca0 0x7fd46c1435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd474600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd46c15a180 0x7fd46c1539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd474600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c0cfaf0 con 0x7fd46c0b2ca0 2024-04-25T09:03:41.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd474600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c0cf970 con 0x7fd46c071a30 2024-04-25T09:03:41.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd474600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c0cfc70 con 0x7fd46c15a180 2024-04-25T09:03:41.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.277+0000 7fd471200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46c0b2ca0 0x7fd46c1435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd471200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46c0b2ca0 0x7fd46c1435b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56292/0 (socket says 172.21.15.173:56292) 2024-04-25T09:03:41.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd471200640 1 -- 172.21.15.173:0/3401796314 learned_addr learned my addr 172.21.15.173:0/3401796314 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:41.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd471c00640 1 --2- 172.21.15.173:0/3401796314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd46c071a30 0x7fd46c158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd472600640 1 --2- 172.21.15.173:0/3401796314 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd46c15a180 0x7fd46c1539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd471200640 1 -- 172.21.15.173:0/3401796314 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd46c15a180 msgr2=0x7fd46c1539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd471200640 1 --2- 172.21.15.173:0/3401796314 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd46c15a180 0x7fd46c1539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd471200640 1 -- 172.21.15.173:0/3401796314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd46c071a30 msgr2=0x7fd46c158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd471200640 1 --2- 172.21.15.173:0/3401796314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd46c071a30 0x7fd46c158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd471200640 1 -- 172.21.15.173:0/3401796314 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c143af0 con 0x7fd46c0b2ca0 2024-04-25T09:03:41.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd471200640 1 --2- 172.21.15.173:0/3401796314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46c0b2ca0 0x7fd46c1435b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd45800c3c0 tx=0x7fd45800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd469600640 1 -- 172.21.15.173:0/3401796314 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458017070 con 0x7fd46c0b2ca0 2024-04-25T09:03:41.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd469600640 1 -- 172.21.15.173:0/3401796314 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4580052d0 con 0x7fd46c0b2ca0 2024-04-25T09:03:41.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd474600640 1 -- 172.21.15.173:0/3401796314 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46c158b10 con 0x7fd46c0b2ca0 2024-04-25T09:03:41.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd469600640 1 -- 172.21.15.173:0/3401796314 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458003840 con 0x7fd46c0b2ca0 2024-04-25T09:03:41.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd474600640 1 -- 172.21.15.173:0/3401796314 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46c140e20 con 0x7fd46c0b2ca0 2024-04-25T09:03:41.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd474600640 1 -- 172.21.15.173:0/3401796314 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46c073a40 con 0x7fd46c0b2ca0 2024-04-25T09:03:41.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd469600640 1 -- 172.21.15.173:0/3401796314 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd45801a070 con 0x7fd46c0b2ca0 2024-04-25T09:03:41.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd469600640 1 --2- 172.21.15.173:0/3401796314 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd44c066f60 0x7fd44c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.281+0000 7fd469600640 1 -- 172.21.15.173:0/3401796314 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd458084730 con 0x7fd46c0b2ca0 2024-04-25T09:03:41.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.285+0000 7fd471c00640 1 --2- 172.21.15.173:0/3401796314 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd44c066f60 0x7fd44c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.285+0000 7fd471c00640 1 --2- 172.21.15.173:0/3401796314 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd44c066f60 0x7fd44c069420 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd460007a90 tx=0x7fd4600079e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.285+0000 7fd469600640 1 -- 172.21.15.173:0/3401796314 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd458005480 con 0x7fd46c0b2ca0 2024-04-25T09:03:41.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.441+0000 7fd474600640 1 -- 172.21.15.173:0/3401796314 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd46c0720f0 con 0x7fd46c0b2ca0 2024-04-25T09:03:41.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.445+0000 7fd469600640 1 -- 172.21.15.173:0/3401796314 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18906 (secure 0 0 0) 0x7fd458054c50 con 0x7fd46c0b2ca0 2024-04-25T09:03:41.434 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:41.434 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":28,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:03:32.190313+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:41.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.445+0000 7fd474600640 1 -- 172.21.15.173:0/3401796314 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd44c066f60 msgr2=0x7fd44c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.445+0000 7fd474600640 1 --2- 172.21.15.173:0/3401796314 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd44c066f60 0x7fd44c069420 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd460007a90 tx=0x7fd4600079e0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.445+0000 7fd474600640 1 -- 172.21.15.173:0/3401796314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46c0b2ca0 msgr2=0x7fd46c1435b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.445+0000 7fd474600640 1 --2- 172.21.15.173:0/3401796314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46c0b2ca0 0x7fd46c1435b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd45800c3c0 tx=0x7fd45800c880 comp rx=0 tx=0).stop 2024-04-25T09:03:41.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.445+0000 7fd474600640 1 -- 172.21.15.173:0/3401796314 shutdown_connections 2024-04-25T09:03:41.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.445+0000 7fd474600640 1 --2- 172.21.15.173:0/3401796314 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd44c066f60 0x7fd44c069420 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.445+0000 7fd474600640 1 --2- 172.21.15.173:0/3401796314 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd46c15a180 0x7fd46c1539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.445+0000 7fd474600640 1 --2- 172.21.15.173:0/3401796314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46c0b2ca0 0x7fd46c1435b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.445+0000 7fd474600640 1 --2- 172.21.15.173:0/3401796314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd46c071a30 0x7fd46c158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.445+0000 7fd474600640 1 -- 172.21.15.173:0/3401796314 >> 172.21.15.173:0/3401796314 conn(0x7fd46c06ac90 msgr2=0x7fd46c06d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:41.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.445+0000 7fd474600640 1 -- 172.21.15.173:0/3401796314 shutdown_connections 2024-04-25T09:03:41.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.445+0000 7fd474600640 1 -- 172.21.15.173:0/3401796314 wait complete. 2024-04-25T09:03:41.455 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:02:49.342297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:02:50.386069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:02:54.077429+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:03:41.455 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:41.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.601+0000 7f31fe800640 1 Processor -- start 2024-04-25T09:03:41.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.601+0000 7f31fe800640 1 -- start start 2024-04-25T09:03:41.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.605+0000 7f31fe800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f31f8159f00 0x7f31f80cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.605+0000 7f31fe800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31f80cff40 0x7f31f80cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.605+0000 7f31fe800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f31f815a2e0 0x7f31f80cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.605+0000 7f31fe800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f815ddd0 con 0x7f31f8159f00 2024-04-25T09:03:41.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.605+0000 7f31fe800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f815e0b0 con 0x7f31f815a2e0 2024-04-25T09:03:41.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.605+0000 7f31fe800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f815e390 con 0x7f31f80cff40 2024-04-25T09:03:41.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.605+0000 7f31f7400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f31f8159f00 0x7f31f80cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.605+0000 7f31f7400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f31f8159f00 0x7f31f80cb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56296/0 (socket says 172.21.15.173:56296) 2024-04-25T09:03:41.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.605+0000 7f31f7400640 1 -- 172.21.15.173:0/3041196513 learned_addr learned my addr 172.21.15.173:0/3041196513 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:41.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.605+0000 7f31eea00640 1 --2- 172.21.15.173:0/3041196513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31f80cff40 0x7f31f80cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.605+0000 7f31f7e00640 1 --2- 172.21.15.173:0/3041196513 >> v2:172.21.15.194:3300/0 conn(0x7f31f815a2e0 0x7f31f80cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.605+0000 7f31f7400640 1 -- 172.21.15.173:0/3041196513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31f80cff40 msgr2=0x7f31f80cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:41.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.605+0000 7f31f7400640 1 --2- 172.21.15.173:0/3041196513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31f80cff40 0x7f31f80cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.605+0000 7f31f7400640 1 -- 172.21.15.173:0/3041196513 >> v2:172.21.15.194:3300/0 conn(0x7f31f815a2e0 msgr2=0x7f31f80cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:41.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.605+0000 7f31f7400640 1 --2- 172.21.15.173:0/3041196513 >> v2:172.21.15.194:3300/0 conn(0x7f31f815a2e0 0x7f31f80cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.605+0000 7f31f7400640 1 -- 172.21.15.173:0/3041196513 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f815e670 con 0x7f31f8159f00 2024-04-25T09:03:41.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.609+0000 7f31f7400640 1 --2- 172.21.15.173:0/3041196513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31f8159f00 0x7f31f80cb960 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f31f80cf130 tx=0x7f31e801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594002cb0df011d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.609+0000 7f31f6a00640 1 -- 172.21.15.173:0/3041196513 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e80ab5f0 con 0x7f31f8159f00 2024-04-25T09:03:41.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.609+0000 7f31f6a00640 1 -- 172.21.15.173:0/3041196513 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e80b0070 con 0x7f31f8159f00 2024-04-25T09:03:41.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.609+0000 7f31f6a00640 1 -- 172.21.15.173:0/3041196513 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e80ab9b0 con 0x7f31f8159f00 2024-04-25T09:03:41.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.609+0000 7f31fe800640 1 -- 172.21.15.173:0/3041196513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31f8159f00 msgr2=0x7f31f80cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.609+0000 7f31fe800640 1 --2- 172.21.15.173:0/3041196513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31f8159f00 0x7f31f80cb960 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f31f80cf130 tx=0x7f31e801c520 comp rx=0 tx=0).stop 2024-04-25T09:03:41.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.609+0000 7f31fe800640 1 -- 172.21.15.173:0/3041196513 shutdown_connections 2024-04-25T09:03:41.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.609+0000 7f31fe800640 1 --2- 172.21.15.173:0/3041196513 >> v2:172.21.15.194:3300/0 conn(0x7f31f815a2e0 0x7f31f80cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.609+0000 7f31fe800640 1 --2- 172.21.15.173:0/3041196513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31f80cff40 0x7f31f80cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.609+0000 7f31fe800640 1 --2- 172.21.15.173:0/3041196513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31f8159f00 0x7f31f80cb960 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.609+0000 7f31fe800640 1 -- 172.21.15.173:0/3041196513 >> 172.21.15.173:0/3041196513 conn(0x7f31f806ac90 msgr2=0x7f31f806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:41.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.609+0000 7f31fe800640 1 -- 172.21.15.173:0/3041196513 shutdown_connections 2024-04-25T09:03:41.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.609+0000 7f31fe800640 1 -- 172.21.15.173:0/3041196513 wait complete. 2024-04-25T09:03:41.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.609+0000 7f31fe800640 1 Processor -- start 2024-04-25T09:03:41.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.609+0000 7f31fe800640 1 -- start start 2024-04-25T09:03:41.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31fe800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31f80cff40 0x7f31f81fa700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31fe800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f8159f00 0x7f31f814c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31fe800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31f815a2e0 0x7f31f815b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31fe800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f806df60 con 0x7f31f80cff40 2024-04-25T09:03:41.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31fe800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f806dde0 con 0x7f31f8159f00 2024-04-25T09:03:41.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31fe800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f806e0e0 con 0x7f31f815a2e0 2024-04-25T09:03:41.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31f7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31f80cff40 0x7f31f81fa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31f7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31f80cff40 0x7f31f81fa700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56308/0 (socket says 172.21.15.173:56308) 2024-04-25T09:03:41.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31f7400640 1 -- 172.21.15.173:0/88809775 learned_addr learned my addr 172.21.15.173:0/88809775 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:41.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31eea00640 1 --2- 172.21.15.173:0/88809775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f8159f00 0x7f31f814c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31f7e00640 1 --2- 172.21.15.173:0/88809775 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31f815a2e0 0x7f31f815b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31f7400640 1 -- 172.21.15.173:0/88809775 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31f815a2e0 msgr2=0x7f31f815b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31f7400640 1 --2- 172.21.15.173:0/88809775 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31f815a2e0 0x7f31f815b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31f7400640 1 -- 172.21.15.173:0/88809775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f8159f00 msgr2=0x7f31f814c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31f7400640 1 --2- 172.21.15.173:0/88809775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f8159f00 0x7f31f814c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31f7400640 1 -- 172.21.15.173:0/88809775 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f814d2f0 con 0x7f31f80cff40 2024-04-25T09:03:41.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31f7e00640 1 --2- 172.21.15.173:0/88809775 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31f815a2e0 0x7f31f815b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:41.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31f7400640 1 --2- 172.21.15.173:0/88809775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31f80cff40 0x7f31f81fa700 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f31e801abd0 tx=0x7f31e801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31efe00640 1 -- 172.21.15.173:0/88809775 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e80be5f0 con 0x7f31f80cff40 2024-04-25T09:03:41.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31efe00640 1 -- 172.21.15.173:0/88809775 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e80be790 con 0x7f31f80cff40 2024-04-25T09:03:41.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31fe800640 1 -- 172.21.15.173:0/88809775 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f814d5d0 con 0x7f31f80cff40 2024-04-25T09:03:41.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31efe00640 1 -- 172.21.15.173:0/88809775 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e80beb80 con 0x7f31f80cff40 2024-04-25T09:03:41.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31fe800640 1 -- 172.21.15.173:0/88809775 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f814db90 con 0x7f31f80cff40 2024-04-25T09:03:41.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31fe800640 1 -- 172.21.15.173:0/88809775 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f8073ab0 con 0x7f31f80cff40 2024-04-25T09:03:41.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.613+0000 7f31efe00640 1 -- 172.21.15.173:0/88809775 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f31e80b43f0 con 0x7f31f80cff40 2024-04-25T09:03:41.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.617+0000 7f31efe00640 1 --2- 172.21.15.173:0/88809775 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31d4066f60 0x7f31d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.617+0000 7f31efe00640 1 -- 172.21.15.173:0/88809775 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f31e811fc10 con 0x7f31f80cff40 2024-04-25T09:03:41.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.617+0000 7f31eea00640 1 --2- 172.21.15.173:0/88809775 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31d4066f60 0x7f31d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.617+0000 7f31eea00640 1 --2- 172.21.15.173:0/88809775 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31d4066f60 0x7f31d4069420 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f31f8167190 tx=0x7f31e0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.621+0000 7f31efe00640 1 -- 172.21.15.173:0/88809775 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f31e80c4060 con 0x7f31f80cff40 2024-04-25T09:03:41.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.777+0000 7f31fe800640 1 -- 172.21.15.173:0/88809775 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f31f80ccb20 con 0x7f31f80cff40 2024-04-25T09:03:41.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.777+0000 7f31efe00640 1 -- 172.21.15.173:0/88809775 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f31e8016110 con 0x7f31f80cff40 2024-04-25T09:03:41.767 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:03:41.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.777+0000 7f31fe800640 1 -- 172.21.15.173:0/88809775 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31d4066f60 msgr2=0x7f31d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.777+0000 7f31fe800640 1 --2- 172.21.15.173:0/88809775 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31d4066f60 0x7f31d4069420 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f31f8167190 tx=0x7f31e0009190 comp rx=0 tx=0).stop 2024-04-25T09:03:41.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.777+0000 7f31fe800640 1 -- 172.21.15.173:0/88809775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31f80cff40 msgr2=0x7f31f81fa700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.777+0000 7f31fe800640 1 --2- 172.21.15.173:0/88809775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31f80cff40 0x7f31f81fa700 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f31e801abd0 tx=0x7f31e801ad60 comp rx=0 tx=0).stop 2024-04-25T09:03:41.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.777+0000 7f31fe800640 1 -- 172.21.15.173:0/88809775 shutdown_connections 2024-04-25T09:03:41.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.777+0000 7f31fe800640 1 --2- 172.21.15.173:0/88809775 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31d4066f60 0x7f31d4069420 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.777+0000 7f31fe800640 1 --2- 172.21.15.173:0/88809775 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31f815a2e0 0x7f31f815b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.777+0000 7f31fe800640 1 --2- 172.21.15.173:0/88809775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f8159f00 0x7f31f814c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.777+0000 7f31fe800640 1 --2- 172.21.15.173:0/88809775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31f80cff40 0x7f31f81fa700 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.777+0000 7f31fe800640 1 -- 172.21.15.173:0/88809775 >> 172.21.15.173:0/88809775 conn(0x7f31f806ac90 msgr2=0x7f31f80b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:41.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.777+0000 7f31fe800640 1 -- 172.21.15.173:0/88809775 shutdown_connections 2024-04-25T09:03:41.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.777+0000 7f31fe800640 1 -- 172.21.15.173:0/88809775 wait complete. 2024-04-25T09:03:41.788 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:41.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.933+0000 7f9907400640 1 Processor -- start 2024-04-25T09:03:41.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.937+0000 7f9907400640 1 -- start start 2024-04-25T09:03:41.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.937+0000 7f9907400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f99000b3fe0 0x7f99000b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.937+0000 7f9907400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990006d4b0 con 0x7f99000cc260 2024-04-25T09:03:41.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.937+0000 7f9907400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990006d790 con 0x7f9900145290 2024-04-25T09:03:41.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.937+0000 7f9907400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99000ccd80 con 0x7f99000b3fe0 2024-04-25T09:03:41.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.937+0000 7f9905400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f99000cc260 0x7f99000cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46578/0 (socket says 172.21.15.173:46578) 2024-04-25T09:03:41.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.937+0000 7f9905400640 1 -- 172.21.15.173:0/2603620793 learned_addr learned my addr 172.21.15.173:0/2603620793 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:41.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.937+0000 7f98ffe00640 1 --2- 172.21.15.173:0/2603620793 >> v2:172.21.15.194:3300/0 conn(0x7f99000b3fe0 0x7f99000b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.937+0000 7f98ff400640 1 -- 172.21.15.173:0/2603620793 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8306424 0 0) 0x7f990006d4b0 con 0x7f99000cc260 2024-04-25T09:03:41.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.937+0000 7f98ff400640 1 -- 172.21.15.173:0/2603620793 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98e8003530 con 0x7f99000cc260 2024-04-25T09:03:41.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.937+0000 7f98ffe00640 1 -- 172.21.15.173:0/2603620793 >> v1:172.21.15.194:6789/0 conn(0x7f9900145290 legacy=0x7f990015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.937+0000 7f98ffe00640 1 -- 172.21.15.173:0/2603620793 >> v1:172.21.15.173:6789/0 conn(0x7f99000cc260 legacy=0x7f99000cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.937+0000 7f98ffe00640 1 -- 172.21.15.173:0/2603620793 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990006da70 con 0x7f99000b3fe0 2024-04-25T09:03:41.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.941+0000 7f98ffe00640 1 --2- 172.21.15.173:0/2603620793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99000b3fe0 0x7f99000b4450 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0097c0 tx=0x7f98ec01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf02cbb1250d86ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.941+0000 7f98ff400640 1 -- 172.21.15.173:0/2603620793 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec0b0070 con 0x7f99000b3fe0 2024-04-25T09:03:41.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.941+0000 7f98ff400640 1 -- 172.21.15.173:0/2603620793 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ec0ab600 con 0x7f99000b3fe0 2024-04-25T09:03:41.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.941+0000 7f98ff400640 1 -- 172.21.15.173:0/2603620793 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec0ab9d0 con 0x7f99000b3fe0 2024-04-25T09:03:41.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.941+0000 7f9907400640 1 -- 172.21.15.173:0/2603620793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99000b3fe0 msgr2=0x7f99000b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.941+0000 7f9907400640 1 --2- 172.21.15.173:0/2603620793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99000b3fe0 0x7f99000b4450 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0097c0 tx=0x7f98ec01c380 comp rx=0 tx=0).stop 2024-04-25T09:03:41.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.941+0000 7f9907400640 1 -- 172.21.15.173:0/2603620793 shutdown_connections 2024-04-25T09:03:41.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.941+0000 7f9907400640 1 --2- 172.21.15.173:0/2603620793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99000b3fe0 0x7f99000b4450 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.941+0000 7f9907400640 1 -- 172.21.15.173:0/2603620793 >> 172.21.15.173:0/2603620793 conn(0x7f990006ac90 msgr2=0x7f990006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:41.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.941+0000 7f9907400640 1 -- 172.21.15.173:0/2603620793 shutdown_connections 2024-04-25T09:03:41.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.941+0000 7f9907400640 1 -- 172.21.15.173:0/2603620793 wait complete. 2024-04-25T09:03:41.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.941+0000 7f9907400640 1 Processor -- start 2024-04-25T09:03:41.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9907400640 1 -- start start 2024-04-25T09:03:41.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9907400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99000b3fe0 0x7f99000ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9907400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99000cc260 0x7f990013a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9907400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9900145290 0x7f9900145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9907400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990006eee0 con 0x7f99000b3fe0 2024-04-25T09:03:41.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9907400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990006ed60 con 0x7f9900145290 2024-04-25T09:03:41.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9907400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990006f060 con 0x7f99000cc260 2024-04-25T09:03:41.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9904a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99000b3fe0 0x7f99000ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9904a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99000b3fe0 0x7f99000ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56312/0 (socket says 172.21.15.173:56312) 2024-04-25T09:03:41.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9904a00640 1 -- 172.21.15.173:0/1888101251 learned_addr learned my addr 172.21.15.173:0/1888101251 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:41.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9904a00640 1 -- 172.21.15.173:0/1888101251 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99000cc260 msgr2=0x7f990013a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9904a00640 1 --2- 172.21.15.173:0/1888101251 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99000cc260 0x7f990013a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9904a00640 1 -- 172.21.15.173:0/1888101251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9900145290 msgr2=0x7f9900145990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9904a00640 1 --2- 172.21.15.173:0/1888101251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9900145290 0x7f9900145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9904a00640 1 -- 172.21.15.173:0/1888101251 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9900146450 con 0x7f99000b3fe0 2024-04-25T09:03:41.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9904a00640 1 --2- 172.21.15.173:0/1888101251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99000b3fe0 0x7f99000ac8c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f98f400c500 tx=0x7f98f400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f98fcc00640 1 -- 172.21.15.173:0/1888101251 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f4016020 con 0x7f99000b3fe0 2024-04-25T09:03:41.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f98fcc00640 1 -- 172.21.15.173:0/1888101251 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f4005220 con 0x7f99000b3fe0 2024-04-25T09:03:41.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9907400640 1 -- 172.21.15.173:0/1888101251 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9900146730 con 0x7f99000b3fe0 2024-04-25T09:03:41.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f98fcc00640 1 -- 172.21.15.173:0/1888101251 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f4007030 con 0x7f99000b3fe0 2024-04-25T09:03:41.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9907400640 1 -- 172.21.15.173:0/1888101251 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990015b530 con 0x7f99000b3fe0 2024-04-25T09:03:41.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.945+0000 7f9907400640 1 -- 172.21.15.173:0/1888101251 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9900073ab0 con 0x7f99000b3fe0 2024-04-25T09:03:41.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.949+0000 7f98fcc00640 1 -- 172.21.15.173:0/1888101251 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f98f40071f0 con 0x7f99000b3fe0 2024-04-25T09:03:41.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.949+0000 7f98fcc00640 1 --2- 172.21.15.173:0/1888101251 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f98e0066f60 0x7f98e0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.949+0000 7f98fcc00640 1 -- 172.21.15.173:0/1888101251 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f98f40848c0 con 0x7f99000b3fe0 2024-04-25T09:03:41.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.949+0000 7f98ffe00640 1 --2- 172.21.15.173:0/1888101251 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f98e0066f60 0x7f98e0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.949+0000 7f98ffe00640 1 --2- 172.21.15.173:0/1888101251 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f98e0066f60 0x7f98e0069420 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0ad000 tx=0x7f98ec004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:41.953+0000 7f98fcc00640 1 -- 172.21.15.173:0/1888101251 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f98f40554e0 con 0x7f99000b3fe0 2024-04-25T09:03:42.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.105+0000 7f9907400640 1 -- 172.21.15.173:0/1888101251 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f99000aed60 con 0x7f99000b3fe0 2024-04-25T09:03:42.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.105+0000 7f98fcc00640 1 -- 172.21.15.173:0/1888101251 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f98f4054de0 con 0x7f99000b3fe0 2024-04-25T09:03:42.098 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:42.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.109+0000 7f9907400640 1 -- 172.21.15.173:0/1888101251 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f98e0066f60 msgr2=0x7f98e0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.109+0000 7f9907400640 1 --2- 172.21.15.173:0/1888101251 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f98e0066f60 0x7f98e0069420 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0ad000 tx=0x7f98ec004740 comp rx=0 tx=0).stop 2024-04-25T09:03:42.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.109+0000 7f9907400640 1 -- 172.21.15.173:0/1888101251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99000b3fe0 msgr2=0x7f99000ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.109+0000 7f9907400640 1 --2- 172.21.15.173:0/1888101251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99000b3fe0 0x7f99000ac8c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f98f400c500 tx=0x7f98f400c9c0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.109+0000 7f9907400640 1 -- 172.21.15.173:0/1888101251 shutdown_connections 2024-04-25T09:03:42.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.109+0000 7f9907400640 1 --2- 172.21.15.173:0/1888101251 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f98e0066f60 0x7f98e0069420 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.109+0000 7f9907400640 1 --2- 172.21.15.173:0/1888101251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9900145290 0x7f9900145990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.109+0000 7f9907400640 1 --2- 172.21.15.173:0/1888101251 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99000cc260 0x7f990013a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.109+0000 7f9907400640 1 --2- 172.21.15.173:0/1888101251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99000b3fe0 0x7f99000ac8c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.109+0000 7f9907400640 1 -- 172.21.15.173:0/1888101251 >> 172.21.15.173:0/1888101251 conn(0x7f990006ac90 msgr2=0x7f99000cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:42.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.109+0000 7f9907400640 1 -- 172.21.15.173:0/1888101251 shutdown_connections 2024-04-25T09:03:42.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.109+0000 7f9907400640 1 -- 172.21.15.173:0/1888101251 wait complete. 2024-04-25T09:03:42.119 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:42.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.269+0000 7f7416200640 1 Processor -- start 2024-04-25T09:03:42.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.269+0000 7f7416200640 1 -- start start 2024-04-25T09:03:42.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.269+0000 7f7416200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f74100b3fe0 0x7f74100b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.269+0000 7f7416200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74100cc260 0x7f74100cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.269+0000 7f7416200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741006d4b0 con 0x7f7410145290 2024-04-25T09:03:42.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.269+0000 7f7416200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741006d790 con 0x7f74100b3fe0 2024-04-25T09:03:42.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.269+0000 7f7416200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741006da70 con 0x7f74100cc260 2024-04-25T09:03:42.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.269+0000 7f740ea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f74100b3fe0 0x7f74100b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.269+0000 7f740f400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f7410145290 0x7f741015c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:53002/0 (socket says 172.21.15.173:53002) 2024-04-25T09:03:42.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.269+0000 7f740f400640 1 -- 172.21.15.173:0/1633824619 learned_addr learned my addr 172.21.15.173:0/1633824619 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:42.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.269+0000 7f740fe00640 1 --2- 172.21.15.173:0/1633824619 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74100cc260 0x7f74100cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.269+0000 7f740e000640 1 -- 172.21.15.173:0/1633824619 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 647815814 0 0) 0x7f741006d4b0 con 0x7f7410145290 2024-04-25T09:03:42.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.269+0000 7f740e000640 1 -- 172.21.15.173:0/1633824619 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73f4003530 con 0x7f7410145290 2024-04-25T09:03:42.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.269+0000 7f740ea00640 1 -- 172.21.15.173:0/1633824619 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74100cc260 msgr2=0x7f74100cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:42.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.269+0000 7f740ea00640 1 --2- 172.21.15.173:0/1633824619 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74100cc260 0x7f74100cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.269+0000 7f740ea00640 1 -- 172.21.15.173:0/1633824619 >> v1:172.21.15.194:6789/0 conn(0x7f7410145290 legacy=0x7f741015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.269+0000 7f740ea00640 1 -- 172.21.15.173:0/1633824619 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741006dd50 con 0x7f74100b3fe0 2024-04-25T09:03:42.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.269+0000 7f740fe00640 1 --2- 172.21.15.173:0/1633824619 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74100cc260 0x7f74100cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:42.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.273+0000 7f740ea00640 1 --2- 172.21.15.173:0/1633824619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74100b3fe0 0x7f74100b4450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f74000097c0 tx=0x7f740001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7846faf896f378f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.273+0000 7f740e000640 1 -- 172.21.15.173:0/1633824619 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74000b0070 con 0x7f74100b3fe0 2024-04-25T09:03:42.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.273+0000 7f740e000640 1 -- 172.21.15.173:0/1633824619 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74000ab600 con 0x7f74100b3fe0 2024-04-25T09:03:42.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.273+0000 7f740e000640 1 -- 172.21.15.173:0/1633824619 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74000ab9d0 con 0x7f74100b3fe0 2024-04-25T09:03:42.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.273+0000 7f7416200640 1 -- 172.21.15.173:0/1633824619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74100b3fe0 msgr2=0x7f74100b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.273+0000 7f7416200640 1 --2- 172.21.15.173:0/1633824619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74100b3fe0 0x7f74100b4450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f74000097c0 tx=0x7f740001c380 comp rx=0 tx=0).stop 2024-04-25T09:03:42.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.273+0000 7f7416200640 1 -- 172.21.15.173:0/1633824619 shutdown_connections 2024-04-25T09:03:42.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.273+0000 7f7416200640 1 --2- 172.21.15.173:0/1633824619 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74100cc260 0x7f74100cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.273+0000 7f7416200640 1 --2- 172.21.15.173:0/1633824619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74100b3fe0 0x7f74100b4450 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.273+0000 7f7416200640 1 -- 172.21.15.173:0/1633824619 >> 172.21.15.173:0/1633824619 conn(0x7f741006ac90 msgr2=0x7f741006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:42.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.273+0000 7f7416200640 1 -- 172.21.15.173:0/1633824619 shutdown_connections 2024-04-25T09:03:42.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.273+0000 7f7416200640 1 -- 172.21.15.173:0/1633824619 wait complete. 2024-04-25T09:03:42.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f7416200640 1 Processor -- start 2024-04-25T09:03:42.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f7416200640 1 -- start start 2024-04-25T09:03:42.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f7416200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74100b3fe0 0x7f74101439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f7416200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74100cc260 0x7f7410161a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f7416200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7410145290 0x7f74100cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f7416200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741006ed60 con 0x7f7410145290 2024-04-25T09:03:42.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f7416200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741006eee0 con 0x7f74100cc260 2024-04-25T09:03:42.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f7416200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741006f060 con 0x7f74100b3fe0 2024-04-25T09:03:42.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f740fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7410145290 0x7f74100cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f740fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7410145290 0x7f74100cd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56314/0 (socket says 172.21.15.173:56314) 2024-04-25T09:03:42.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f740fe00640 1 -- 172.21.15.173:0/822177949 learned_addr learned my addr 172.21.15.173:0/822177949 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:42.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f740ea00640 1 --2- 172.21.15.173:0/822177949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74100cc260 0x7f7410161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f740f400640 1 --2- 172.21.15.173:0/822177949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74100b3fe0 0x7f74101439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f740fe00640 1 -- 172.21.15.173:0/822177949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74100b3fe0 msgr2=0x7f74101439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f740fe00640 1 --2- 172.21.15.173:0/822177949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74100b3fe0 0x7f74101439c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f740fe00640 1 -- 172.21.15.173:0/822177949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74100cc260 msgr2=0x7f7410161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f740fe00640 1 --2- 172.21.15.173:0/822177949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74100cc260 0x7f7410161a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f740fe00640 1 -- 172.21.15.173:0/822177949 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7410162330 con 0x7f7410145290 2024-04-25T09:03:42.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f740fe00640 1 --2- 172.21.15.173:0/822177949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7410145290 0x7f74100cd5d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f740800efc0 tx=0x7f740800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f7407400640 1 -- 172.21.15.173:0/822177949 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408018030 con 0x7f7410145290 2024-04-25T09:03:42.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f7407400640 1 -- 172.21.15.173:0/822177949 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740800cdf0 con 0x7f7410145290 2024-04-25T09:03:42.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f7407400640 1 -- 172.21.15.173:0/822177949 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408003bc0 con 0x7f7410145290 2024-04-25T09:03:42.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f7416200640 1 -- 172.21.15.173:0/822177949 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7410162610 con 0x7f7410145290 2024-04-25T09:03:42.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.277+0000 7f7416200640 1 -- 172.21.15.173:0/822177949 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7410162eb0 con 0x7f7410145290 2024-04-25T09:03:42.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.281+0000 7f7416200640 1 -- 172.21.15.173:0/822177949 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74101627e0 con 0x7f7410145290 2024-04-25T09:03:42.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.281+0000 7f7407400640 1 -- 172.21.15.173:0/822177949 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f740801b070 con 0x7f7410145290 2024-04-25T09:03:42.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.281+0000 7f7407400640 1 --2- 172.21.15.173:0/822177949 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f73ec066f60 0x7f73ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.281+0000 7f7407400640 1 -- 172.21.15.173:0/822177949 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7408085c90 con 0x7f7410145290 2024-04-25T09:03:42.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.281+0000 7f740f400640 1 --2- 172.21.15.173:0/822177949 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f73ec066f60 0x7f73ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.281+0000 7f740f400640 1 --2- 172.21.15.173:0/822177949 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f73ec066f60 0x7f73ec069420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f73f8007fd0 tx=0x7f73f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.285+0000 7f7407400640 1 -- 172.21.15.173:0/822177949 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7408010040 con 0x7f7410145290 2024-04-25T09:03:42.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.437+0000 7f7416200640 1 -- 172.21.15.173:0/822177949 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f74101630b0 con 0x7f7410145290 2024-04-25T09:03:42.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.437+0000 7f7407400640 1 -- 172.21.15.173:0/822177949 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f74101630b0 con 0x7f7410145290 2024-04-25T09:03:42.430 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:03:42.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.441+0000 7f7416200640 1 -- 172.21.15.173:0/822177949 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f73ec066f60 msgr2=0x7f73ec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.441+0000 7f7416200640 1 --2- 172.21.15.173:0/822177949 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f73ec066f60 0x7f73ec069420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f73f8007fd0 tx=0x7f73f8009040 comp rx=0 tx=0).stop 2024-04-25T09:03:42.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.441+0000 7f7416200640 1 -- 172.21.15.173:0/822177949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7410145290 msgr2=0x7f74100cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.441+0000 7f7416200640 1 --2- 172.21.15.173:0/822177949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7410145290 0x7f74100cd5d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f740800efc0 tx=0x7f740800c490 comp rx=0 tx=0).stop 2024-04-25T09:03:42.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.441+0000 7f7416200640 1 -- 172.21.15.173:0/822177949 shutdown_connections 2024-04-25T09:03:42.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.441+0000 7f7416200640 1 --2- 172.21.15.173:0/822177949 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f73ec066f60 0x7f73ec069420 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.441+0000 7f7416200640 1 --2- 172.21.15.173:0/822177949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7410145290 0x7f74100cd5d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.441+0000 7f7416200640 1 --2- 172.21.15.173:0/822177949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74100cc260 0x7f7410161a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.441+0000 7f7416200640 1 --2- 172.21.15.173:0/822177949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74100b3fe0 0x7f74101439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.441+0000 7f7416200640 1 -- 172.21.15.173:0/822177949 >> 172.21.15.173:0/822177949 conn(0x7f741006ac90 msgr2=0x7f74100b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:42.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.441+0000 7f7416200640 1 -- 172.21.15.173:0/822177949 shutdown_connections 2024-04-25T09:03:42.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.441+0000 7f7416200640 1 -- 172.21.15.173:0/822177949 wait complete. 2024-04-25T09:03:42.452 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:03:42.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.597+0000 7fc506a00640 1 Processor -- start 2024-04-25T09:03:42.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.597+0000 7fc506a00640 1 -- start start 2024-04-25T09:03:42.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.601+0000 7fc506a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc5000aeb90 0x7fc5000cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.601+0000 7fc506a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc5000ce2b0 0x7fc5000cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.601+0000 7fc506a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc500071570 con 0x7fc5000aef70 2024-04-25T09:03:42.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.601+0000 7fc506a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc500071320 con 0x7fc5000aeb90 2024-04-25T09:03:42.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.601+0000 7fc506a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc500072330 con 0x7fc5000ce2b0 2024-04-25T09:03:42.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.601+0000 7fc4ffe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc5000aeb90 0x7fc5000cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.601+0000 7fc4ffe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc5000aeb90 0x7fc5000cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56326/0 (socket says 172.21.15.173:56326) 2024-04-25T09:03:42.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.601+0000 7fc4ffe00640 1 -- 172.21.15.173:0/2521181410 learned_addr learned my addr 172.21.15.173:0/2521181410 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:42.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.601+0000 7fc4f7400640 1 --1- 172.21.15.173:0/2521181410 >> v1:172.21.15.173:6789/0 conn(0x7fc5000aef70 0x7fc5000cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46590/0 (socket says 172.21.15.173:46590) 2024-04-25T09:03:42.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.601+0000 7fc504a00640 1 --2- 172.21.15.173:0/2521181410 >> v2:172.21.15.194:3300/0 conn(0x7fc5000ce2b0 0x7fc5000cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.601+0000 7fc4ffe00640 1 -- 172.21.15.173:0/2521181410 >> v2:172.21.15.194:3300/0 conn(0x7fc5000ce2b0 msgr2=0x7fc5000cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:42.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.601+0000 7fc4ffe00640 1 --2- 172.21.15.173:0/2521181410 >> v2:172.21.15.194:3300/0 conn(0x7fc5000ce2b0 0x7fc5000cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.601+0000 7fc4ffe00640 1 -- 172.21.15.173:0/2521181410 >> v1:172.21.15.173:6789/0 conn(0x7fc5000aef70 legacy=0x7fc5000cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.601+0000 7fc4ffe00640 1 -- 172.21.15.173:0/2521181410 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc500071850 con 0x7fc5000aeb90 2024-04-25T09:03:42.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.601+0000 7fc4ff400640 1 -- 172.21.15.173:0/2521181410 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803259059 0 0) 0x7fc500071570 con 0x7fc5000aef70 2024-04-25T09:03:42.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc4ffe00640 1 --2- 172.21.15.173:0/2521181410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5000aeb90 0x7fc5000cc0d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc50015e4f0 tx=0x7fc4f001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f75c2777a99599 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc4ff400640 1 -- 172.21.15.173:0/2521181410 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00b2070 con 0x7fc5000aeb90 2024-04-25T09:03:42.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc4ff400640 1 -- 172.21.15.173:0/2521181410 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f00a9070 con 0x7fc5000aeb90 2024-04-25T09:03:42.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc4ff400640 1 -- 172.21.15.173:0/2521181410 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00ad880 con 0x7fc5000aeb90 2024-04-25T09:03:42.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc506a00640 1 -- 172.21.15.173:0/2521181410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5000aeb90 msgr2=0x7fc5000cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc506a00640 1 --2- 172.21.15.173:0/2521181410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5000aeb90 0x7fc5000cc0d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc50015e4f0 tx=0x7fc4f001c460 comp rx=0 tx=0).stop 2024-04-25T09:03:42.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc506a00640 1 -- 172.21.15.173:0/2521181410 shutdown_connections 2024-04-25T09:03:42.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc506a00640 1 --2- 172.21.15.173:0/2521181410 >> v2:172.21.15.194:3300/0 conn(0x7fc5000ce2b0 0x7fc5000cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc506a00640 1 --2- 172.21.15.173:0/2521181410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5000aeb90 0x7fc5000cc0d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc506a00640 1 -- 172.21.15.173:0/2521181410 >> 172.21.15.173:0/2521181410 conn(0x7fc50006ac90 msgr2=0x7fc50006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:42.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc506a00640 1 -- 172.21.15.173:0/2521181410 shutdown_connections 2024-04-25T09:03:42.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc506a00640 1 -- 172.21.15.173:0/2521181410 wait complete. 2024-04-25T09:03:42.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc506a00640 1 Processor -- start 2024-04-25T09:03:42.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc506a00640 1 -- start start 2024-04-25T09:03:42.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc506a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5000aeb90 0x7fc50014c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc506a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5000aef70 0x7fc500145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc506a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5000ce2b0 0x7fc50014a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc506a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50015bb30 con 0x7fc5000ce2b0 2024-04-25T09:03:42.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc506a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50015b9b0 con 0x7fc5000aef70 2024-04-25T09:03:42.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.605+0000 7fc506a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50015bcb0 con 0x7fc5000aeb90 2024-04-25T09:03:42.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc504a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5000ce2b0 0x7fc50014a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc504a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5000ce2b0 0x7fc50014a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56338/0 (socket says 172.21.15.173:56338) 2024-04-25T09:03:42.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc504a00640 1 -- 172.21.15.173:0/2322602860 learned_addr learned my addr 172.21.15.173:0/2322602860 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:42.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc4ffe00640 1 --2- 172.21.15.173:0/2322602860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5000aeb90 0x7fc50014c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc4f7400640 1 --2- 172.21.15.173:0/2322602860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5000aef70 0x7fc500145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc504a00640 1 -- 172.21.15.173:0/2322602860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5000aeb90 msgr2=0x7fc50014c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc504a00640 1 --2- 172.21.15.173:0/2322602860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5000aeb90 0x7fc50014c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc504a00640 1 -- 172.21.15.173:0/2322602860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5000aef70 msgr2=0x7fc500145fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc504a00640 1 --2- 172.21.15.173:0/2322602860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5000aef70 0x7fc500145fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc504a00640 1 -- 172.21.15.173:0/2322602860 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5001464e0 con 0x7fc5000ce2b0 2024-04-25T09:03:42.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc4ffe00640 1 --2- 172.21.15.173:0/2322602860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5000aeb90 0x7fc50014c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:42.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc4f7400640 1 --2- 172.21.15.173:0/2322602860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5000aef70 0x7fc500145fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc504a00640 1 --2- 172.21.15.173:0/2322602860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5000ce2b0 0x7fc50014a320 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800efc0 tx=0x7fc4f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc4fcc00640 1 -- 172.21.15.173:0/2322602860 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8018020 con 0x7fc5000ce2b0 2024-04-25T09:03:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc4fcc00640 1 -- 172.21.15.173:0/2322602860 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f8014480 con 0x7fc5000ce2b0 2024-04-25T09:03:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc506a00640 1 -- 172.21.15.173:0/2322602860 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc50014d440 con 0x7fc5000ce2b0 2024-04-25T09:03:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc4fcc00640 1 -- 172.21.15.173:0/2322602860 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8014870 con 0x7fc5000ce2b0 2024-04-25T09:03:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc506a00640 1 -- 172.21.15.173:0/2322602860 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50014ce80 con 0x7fc5000ce2b0 2024-04-25T09:03:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc506a00640 1 -- 172.21.15.173:0/2322602860 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc500073ab0 con 0x7fc5000ce2b0 2024-04-25T09:03:42.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.609+0000 7fc4fcc00640 1 -- 172.21.15.173:0/2322602860 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc4f801b020 con 0x7fc5000ce2b0 2024-04-25T09:03:42.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.613+0000 7fc4fcc00640 1 --2- 172.21.15.173:0/2322602860 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc4dc066f60 0x7fc4dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.613+0000 7fc4fcc00640 1 -- 172.21.15.173:0/2322602860 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc4f8085ff0 con 0x7fc5000ce2b0 2024-04-25T09:03:42.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.613+0000 7fc4ffe00640 1 --2- 172.21.15.173:0/2322602860 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc4dc066f60 0x7fc4dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.613+0000 7fc4ffe00640 1 --2- 172.21.15.173:0/2322602860 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc4dc066f60 0x7fc4dc069420 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00af000 tx=0x7fc4f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.617+0000 7fc4fcc00640 1 -- 172.21.15.173:0/2322602860 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc4f8022070 con 0x7fc5000ce2b0 2024-04-25T09:03:42.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.769+0000 7fc506a00640 1 -- 172.21.15.173:0/2322602860 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc5000b18d0 con 0x7fc5000ce2b0 2024-04-25T09:03:42.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.769+0000 7fc4fcc00640 1 -- 172.21.15.173:0/2322602860 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc4f8010040 con 0x7fc5000ce2b0 2024-04-25T09:03:42.761 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:42.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.773+0000 7fc506a00640 1 -- 172.21.15.173:0/2322602860 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc4dc066f60 msgr2=0x7fc4dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.773+0000 7fc506a00640 1 --2- 172.21.15.173:0/2322602860 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc4dc066f60 0x7fc4dc069420 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00af000 tx=0x7fc4f0008040 comp rx=0 tx=0).stop 2024-04-25T09:03:42.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.773+0000 7fc506a00640 1 -- 172.21.15.173:0/2322602860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5000ce2b0 msgr2=0x7fc50014a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.773+0000 7fc506a00640 1 --2- 172.21.15.173:0/2322602860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5000ce2b0 0x7fc50014a320 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800efc0 tx=0x7fc4f800c490 comp rx=0 tx=0).stop 2024-04-25T09:03:42.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.773+0000 7fc506a00640 1 -- 172.21.15.173:0/2322602860 shutdown_connections 2024-04-25T09:03:42.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.773+0000 7fc506a00640 1 --2- 172.21.15.173:0/2322602860 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc4dc066f60 0x7fc4dc069420 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.773+0000 7fc506a00640 1 --2- 172.21.15.173:0/2322602860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5000ce2b0 0x7fc50014a320 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.773+0000 7fc506a00640 1 --2- 172.21.15.173:0/2322602860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5000aef70 0x7fc500145fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.773+0000 7fc506a00640 1 --2- 172.21.15.173:0/2322602860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5000aeb90 0x7fc50014c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.773+0000 7fc506a00640 1 -- 172.21.15.173:0/2322602860 >> 172.21.15.173:0/2322602860 conn(0x7fc50006ac90 msgr2=0x7fc50006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:42.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.773+0000 7fc506a00640 1 -- 172.21.15.173:0/2322602860 shutdown_connections 2024-04-25T09:03:42.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.773+0000 7fc506a00640 1 -- 172.21.15.173:0/2322602860 wait complete. 2024-04-25T09:03:42.782 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:03:42.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.929+0000 7fbd1be00640 1 Processor -- start 2024-04-25T09:03:42.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.929+0000 7fbd1be00640 1 -- start start 2024-04-25T09:03:42.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.929+0000 7fbd1be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbd14161300 0x7fbd1415f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.929+0000 7fbd1be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbd1415ec70 0x7fbd140b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.929+0000 7fbd1be00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1406ba70 con 0x7fbd140b44d0 2024-04-25T09:03:42.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.929+0000 7fbd1be00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd140b2ef0 con 0x7fbd1415ec70 2024-04-25T09:03:42.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.929+0000 7fbd1be00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd140b31d0 con 0x7fbd14161300 2024-04-25T09:03:42.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.929+0000 7fbd18a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbd1415ec70 0x7fbd140b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.929+0000 7fbd19e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fbd140b44d0 0x7fbd1406d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46606/0 (socket says 172.21.15.173:46606) 2024-04-25T09:03:42.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.929+0000 7fbd19e00640 1 -- 172.21.15.173:0/1993408351 learned_addr learned my addr 172.21.15.173:0/1993408351 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:42.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.929+0000 7fbd19400640 1 --2- 172.21.15.173:0/1993408351 >> v2:172.21.15.194:3300/0 conn(0x7fbd14161300 0x7fbd1415f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.929+0000 7fbd18a00640 1 -- 172.21.15.173:0/1993408351 >> v2:172.21.15.194:3300/0 conn(0x7fbd14161300 msgr2=0x7fbd1415f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:42.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.929+0000 7fbd18a00640 1 --2- 172.21.15.173:0/1993408351 >> v2:172.21.15.194:3300/0 conn(0x7fbd14161300 0x7fbd1415f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.929+0000 7fbd18a00640 1 -- 172.21.15.173:0/1993408351 >> v1:172.21.15.173:6789/0 conn(0x7fbd140b44d0 legacy=0x7fbd1406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.929+0000 7fbd18a00640 1 -- 172.21.15.173:0/1993408351 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd140b34b0 con 0x7fbd1415ec70 2024-04-25T09:03:42.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.929+0000 7fbd19400640 1 --2- 172.21.15.173:0/1993408351 >> v2:172.21.15.194:3300/0 conn(0x7fbd14161300 0x7fbd1415f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:42.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.929+0000 7fbd13e00640 1 -- 172.21.15.173:0/1993408351 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888073746 0 0) 0x7fbd1406ba70 con 0x7fbd140b44d0 2024-04-25T09:03:42.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.933+0000 7fbd18a00640 1 --2- 172.21.15.173:0/1993408351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd1415ec70 0x7fbd140b3f90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbd140629d0 tx=0x7fbd0001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171b264a92718a63 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.933+0000 7fbd13e00640 1 -- 172.21.15.173:0/1993408351 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd000ab5f0 con 0x7fbd1415ec70 2024-04-25T09:03:42.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.933+0000 7fbd13e00640 1 -- 172.21.15.173:0/1993408351 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd000b0070 con 0x7fbd1415ec70 2024-04-25T09:03:42.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.933+0000 7fbd13e00640 1 -- 172.21.15.173:0/1993408351 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd000ab9b0 con 0x7fbd1415ec70 2024-04-25T09:03:42.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.933+0000 7fbd1be00640 1 -- 172.21.15.173:0/1993408351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd1415ec70 msgr2=0x7fbd140b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.933+0000 7fbd1be00640 1 --2- 172.21.15.173:0/1993408351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd1415ec70 0x7fbd140b3f90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbd140629d0 tx=0x7fbd0001c3f0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.933+0000 7fbd1be00640 1 -- 172.21.15.173:0/1993408351 shutdown_connections 2024-04-25T09:03:42.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.933+0000 7fbd1be00640 1 --2- 172.21.15.173:0/1993408351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd1415ec70 0x7fbd140b3f90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.933+0000 7fbd1be00640 1 --2- 172.21.15.173:0/1993408351 >> v2:172.21.15.194:3300/0 conn(0x7fbd14161300 0x7fbd1415f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.933+0000 7fbd1be00640 1 -- 172.21.15.173:0/1993408351 >> 172.21.15.173:0/1993408351 conn(0x7fbd1406ac90 msgr2=0x7fbd1406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:42.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.933+0000 7fbd1be00640 1 -- 172.21.15.173:0/1993408351 shutdown_connections 2024-04-25T09:03:42.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.933+0000 7fbd1be00640 1 -- 172.21.15.173:0/1993408351 wait complete. 2024-04-25T09:03:42.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.933+0000 7fbd1be00640 1 Processor -- start 2024-04-25T09:03:42.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.933+0000 7fbd1be00640 1 -- start start 2024-04-25T09:03:42.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd1be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd140b44d0 0x7fbd1415b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd1be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd1415ec70 0x7fbd14150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd1be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd14161300 0x7fbd140ad440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd1be00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd140b2c20 con 0x7fbd140b44d0 2024-04-25T09:03:42.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd1be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd140b2aa0 con 0x7fbd1415ec70 2024-04-25T09:03:42.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd1be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1416b040 con 0x7fbd14161300 2024-04-25T09:03:42.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd19400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd140b44d0 0x7fbd1415b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd19400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd140b44d0 0x7fbd1415b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56344/0 (socket says 172.21.15.173:56344) 2024-04-25T09:03:42.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd19400640 1 -- 172.21.15.173:0/2221330536 learned_addr learned my addr 172.21.15.173:0/2221330536 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:42.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd19e00640 1 --2- 172.21.15.173:0/2221330536 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd14161300 0x7fbd140ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd18a00640 1 --2- 172.21.15.173:0/2221330536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd1415ec70 0x7fbd14150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd19400640 1 -- 172.21.15.173:0/2221330536 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd14161300 msgr2=0x7fbd140ad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd19400640 1 --2- 172.21.15.173:0/2221330536 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd14161300 0x7fbd140ad440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd19400640 1 -- 172.21.15.173:0/2221330536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd1415ec70 msgr2=0x7fbd14150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:42.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd19400640 1 --2- 172.21.15.173:0/2221330536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd1415ec70 0x7fbd14150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:42.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd19400640 1 -- 172.21.15.173:0/2221330536 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd14156b00 con 0x7fbd140b44d0 2024-04-25T09:03:42.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd19400640 1 --2- 172.21.15.173:0/2221330536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd140b44d0 0x7fbd1415b450 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbd08007f20 tx=0x7fbd0800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd11600640 1 -- 172.21.15.173:0/2221330536 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0801a070 con 0x7fbd140b44d0 2024-04-25T09:03:42.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd11600640 1 -- 172.21.15.173:0/2221330536 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd08003ba0 con 0x7fbd140b44d0 2024-04-25T09:03:42.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd1be00640 1 -- 172.21.15.173:0/2221330536 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd14156de0 con 0x7fbd140b44d0 2024-04-25T09:03:42.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd11600640 1 -- 172.21.15.173:0/2221330536 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd08004030 con 0x7fbd140b44d0 2024-04-25T09:03:42.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd1be00640 1 -- 172.21.15.173:0/2221330536 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd14158b70 con 0x7fbd140b44d0 2024-04-25T09:03:42.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd1be00640 1 -- 172.21.15.173:0/2221330536 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd14073ab0 con 0x7fbd140b44d0 2024-04-25T09:03:42.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.937+0000 7fbd11600640 1 -- 172.21.15.173:0/2221330536 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbd0801d070 con 0x7fbd140b44d0 2024-04-25T09:03:42.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.941+0000 7fbd11600640 1 --2- 172.21.15.173:0/2221330536 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbcf4066f60 0x7fbcf4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:42.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.941+0000 7fbd11600640 1 -- 172.21.15.173:0/2221330536 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fbd080855e0 con 0x7fbd140b44d0 2024-04-25T09:03:42.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.941+0000 7fbd18a00640 1 --2- 172.21.15.173:0/2221330536 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbcf4066f60 0x7fbcf4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:42.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.941+0000 7fbd18a00640 1 --2- 172.21.15.173:0/2221330536 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbcf4066f60 0x7fbcf4069420 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbd000af000 tx=0x7fbd000a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:42.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:42.945+0000 7fbd11600640 1 -- 172.21.15.173:0/2221330536 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbd08010070 con 0x7fbd140b44d0 2024-04-25T09:03:43.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.109+0000 7fbd1be00640 1 -- 172.21.15.173:0/2221330536 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbd140008e0 con 0x7fbd140b44d0 2024-04-25T09:03:43.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.109+0000 7fbd11600640 1 -- 172.21.15.173:0/2221330536 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbd08055ba0 con 0x7fbd140b44d0 2024-04-25T09:03:43.100 INFO:teuthology.orchestra.run.smithi173.stderr:listed 0 entries 2024-04-25T09:03:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.113+0000 7fbd1be00640 1 -- 172.21.15.173:0/2221330536 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbcf4066f60 msgr2=0x7fbcf4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.113+0000 7fbd1be00640 1 --2- 172.21.15.173:0/2221330536 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbcf4066f60 0x7fbcf4069420 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbd000af000 tx=0x7fbd000a7000 comp rx=0 tx=0).stop 2024-04-25T09:03:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.113+0000 7fbd1be00640 1 -- 172.21.15.173:0/2221330536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd140b44d0 msgr2=0x7fbd1415b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.113+0000 7fbd1be00640 1 --2- 172.21.15.173:0/2221330536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd140b44d0 0x7fbd1415b450 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbd08007f20 tx=0x7fbd0800d560 comp rx=0 tx=0).stop 2024-04-25T09:03:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.113+0000 7fbd1be00640 1 -- 172.21.15.173:0/2221330536 shutdown_connections 2024-04-25T09:03:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.113+0000 7fbd1be00640 1 --2- 172.21.15.173:0/2221330536 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbcf4066f60 0x7fbcf4069420 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.113+0000 7fbd1be00640 1 --2- 172.21.15.173:0/2221330536 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd14161300 0x7fbd140ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.113+0000 7fbd1be00640 1 --2- 172.21.15.173:0/2221330536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd1415ec70 0x7fbd14150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.113+0000 7fbd1be00640 1 --2- 172.21.15.173:0/2221330536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd140b44d0 0x7fbd1415b450 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.113+0000 7fbd1be00640 1 -- 172.21.15.173:0/2221330536 >> 172.21.15.173:0/2221330536 conn(0x7fbd1406ac90 msgr2=0x7fbd140af710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:43.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.113+0000 7fbd1be00640 1 -- 172.21.15.173:0/2221330536 shutdown_connections 2024-04-25T09:03:43.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.113+0000 7fbd1be00640 1 -- 172.21.15.173:0/2221330536 wait complete. 2024-04-25T09:03:43.122 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T09:03:43.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:43.122 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-25T09:03:43.165 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2024-04-25T09:03:43.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:43.165 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T09:03:43.220 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:03:43.220 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:43.229 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:03:43.229 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:43.281 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:03:43.281 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:43.333 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:43.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.517+0000 7f6050400640 1 Processor -- start 2024-04-25T09:03:43.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.517+0000 7f6050400640 1 -- start start 2024-04-25T09:03:43.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.517+0000 7f6050400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f604815edd0 0x7f60480cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:43.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.517+0000 7f6050400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f604815f320 con 0x7f60480aefa0 2024-04-25T09:03:43.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.517+0000 7f6050400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f604806d420 con 0x7f60480b3e70 2024-04-25T09:03:43.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.517+0000 7f6050400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604806dd50 con 0x7f604815edd0 2024-04-25T09:03:43.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.517+0000 7f604d000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f60480aefa0 0x7f60480cd7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34004/0 (socket says 172.21.15.173:34004) 2024-04-25T09:03:43.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.517+0000 7f604d000640 1 -- 172.21.15.173:0/2265979465 learned_addr learned my addr 172.21.15.173:0/2265979465 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:43.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.517+0000 7f604e400640 1 --2- 172.21.15.173:0/2265979465 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f604815edd0 0x7f60480cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:43.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.521+0000 7f6047e00640 1 -- 172.21.15.173:0/2265979465 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085280194 0 0) 0x7f604815f320 con 0x7f60480aefa0 2024-04-25T09:03:43.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.521+0000 7f6047e00640 1 -- 172.21.15.173:0/2265979465 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6030003530 con 0x7f60480aefa0 2024-04-25T09:03:43.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.521+0000 7f6047e00640 1 -- 172.21.15.173:0/2265979465 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707283900 0 0) 0x7f604806d420 con 0x7f60480b3e70 2024-04-25T09:03:43.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.521+0000 7f6047e00640 1 -- 172.21.15.173:0/2265979465 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f604815f320 con 0x7f60480b3e70 2024-04-25T09:03:43.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.521+0000 7f604e400640 1 -- 172.21.15.173:0/2265979465 >> v1:172.21.15.194:6789/0 conn(0x7f60480b3e70 legacy=0x7f60480b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.521+0000 7f604e400640 1 -- 172.21.15.173:0/2265979465 >> v1:172.21.15.173:6789/0 conn(0x7f60480aefa0 legacy=0x7f60480cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.521+0000 7f604e400640 1 -- 172.21.15.173:0/2265979465 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604806d700 con 0x7f604815edd0 2024-04-25T09:03:43.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.521+0000 7f604e400640 1 --2- 172.21.15.173:0/2265979465 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f604815edd0 0x7f60480cdeb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f604806ded0 tx=0x7f604001c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60d801bd0755e337 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:43.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.521+0000 7f6047e00640 1 -- 172.21.15.173:0/2265979465 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60400b2070 con 0x7f604815edd0 2024-04-25T09:03:43.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.521+0000 7f6047e00640 1 -- 172.21.15.173:0/2265979465 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60400a5a40 con 0x7f604815edd0 2024-04-25T09:03:43.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.521+0000 7f6047e00640 1 -- 172.21.15.173:0/2265979465 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60400a5e10 con 0x7f604815edd0 2024-04-25T09:03:43.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f6050400640 1 -- 172.21.15.173:0/2265979465 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f604815edd0 msgr2=0x7f60480cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f6050400640 1 --2- 172.21.15.173:0/2265979465 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f604815edd0 0x7f60480cdeb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f604806ded0 tx=0x7f604001c960 comp rx=0 tx=0).stop 2024-04-25T09:03:43.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f6050400640 1 -- 172.21.15.173:0/2265979465 shutdown_connections 2024-04-25T09:03:43.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f6050400640 1 --2- 172.21.15.173:0/2265979465 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f604815edd0 0x7f60480cdeb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f6050400640 1 -- 172.21.15.173:0/2265979465 >> 172.21.15.173:0/2265979465 conn(0x7f604806ac90 msgr2=0x7f604806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:43.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f6050400640 1 -- 172.21.15.173:0/2265979465 shutdown_connections 2024-04-25T09:03:43.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f6050400640 1 -- 172.21.15.173:0/2265979465 wait complete. 2024-04-25T09:03:43.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f6050400640 1 Processor -- start 2024-04-25T09:03:43.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f6050400640 1 -- start start 2024-04-25T09:03:43.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f6050400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60480aefa0 0x7f6048159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:43.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f6050400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60480b3e70 0x7f604815d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:43.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f6050400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f604815edd0 0x7f60481476c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:43.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f6050400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604806e340 con 0x7f60480aefa0 2024-04-25T09:03:43.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f6050400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604806e1c0 con 0x7f604815edd0 2024-04-25T09:03:43.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f6050400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6048168fd0 con 0x7f60480b3e70 2024-04-25T09:03:43.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f604da00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60480aefa0 0x7f6048159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:43.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f604da00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60480aefa0 0x7f6048159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59224/0 (socket says 172.21.15.173:59224) 2024-04-25T09:03:43.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f604da00640 1 -- 172.21.15.173:0/3016300104 learned_addr learned my addr 172.21.15.173:0/3016300104 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:43.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f604d000640 1 --2- 172.21.15.173:0/3016300104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60480b3e70 0x7f604815d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:43.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f604e400640 1 --2- 172.21.15.173:0/3016300104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f604815edd0 0x7f60481476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:43.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f604da00640 1 -- 172.21.15.173:0/3016300104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60480b3e70 msgr2=0x7f604815d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f604da00640 1 --2- 172.21.15.173:0/3016300104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60480b3e70 0x7f604815d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f604da00640 1 -- 172.21.15.173:0/3016300104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f604815edd0 msgr2=0x7f60481476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f604da00640 1 --2- 172.21.15.173:0/3016300104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f604815edd0 0x7f60481476c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f604da00640 1 -- 172.21.15.173:0/3016300104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604815db90 con 0x7f60480aefa0 2024-04-25T09:03:43.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f604d000640 1 --2- 172.21.15.173:0/3016300104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60480b3e70 0x7f604815d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:43.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.525+0000 7f604e400640 1 --2- 172.21.15.173:0/3016300104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f604815edd0 0x7f60481476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:43.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.529+0000 7f604da00640 1 --2- 172.21.15.173:0/3016300104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60480aefa0 0x7f6048159b90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f603c00c430 tx=0x7f603c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:43.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.529+0000 7f6045600640 1 -- 172.21.15.173:0/3016300104 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c017070 con 0x7f60480aefa0 2024-04-25T09:03:43.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.529+0000 7f6045600640 1 -- 172.21.15.173:0/3016300104 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603c0052f0 con 0x7f60480aefa0 2024-04-25T09:03:43.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.529+0000 7f6050400640 1 -- 172.21.15.173:0/3016300104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f604815bbc0 con 0x7f60480aefa0 2024-04-25T09:03:43.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.529+0000 7f6045600640 1 -- 172.21.15.173:0/3016300104 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c003840 con 0x7f60480aefa0 2024-04-25T09:03:43.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.529+0000 7f6050400640 1 -- 172.21.15.173:0/3016300104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60480b1b00 con 0x7f60480aefa0 2024-04-25T09:03:43.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.529+0000 7f6050400640 1 -- 172.21.15.173:0/3016300104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6048073a40 con 0x7f60480aefa0 2024-04-25T09:03:43.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.529+0000 7f6045600640 1 -- 172.21.15.173:0/3016300104 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f603c01a070 con 0x7f60480aefa0 2024-04-25T09:03:43.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.529+0000 7f6045600640 1 --2- 172.21.15.173:0/3016300104 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6028066f60 0x7f6028069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:43.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.529+0000 7f6045600640 1 -- 172.21.15.173:0/3016300104 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f603c084830 con 0x7f60480aefa0 2024-04-25T09:03:43.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.529+0000 7f604d000640 1 --2- 172.21.15.173:0/3016300104 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6028066f60 0x7f6028069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:43.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.533+0000 7f604d000640 1 --2- 172.21.15.173:0/3016300104 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6028066f60 0x7f6028069420 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6048071950 tx=0x7f6034009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:43.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.533+0000 7f6045600640 1 -- 172.21.15.173:0/3016300104 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f603c055430 con 0x7f60480aefa0 2024-04-25T09:03:43.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.689+0000 7f6050400640 1 -- 172.21.15.173:0/3016300104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f604806e540 con 0x7f60480aefa0 2024-04-25T09:03:43.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.689+0000 7f6045600640 1 -- 172.21.15.173:0/3016300104 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18906 (secure 0 0 0) 0x7f603c054d30 con 0x7f60480aefa0 2024-04-25T09:03:43.680 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:43.680 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":28,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:03:32.190313+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:43.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.693+0000 7f6050400640 1 -- 172.21.15.173:0/3016300104 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6028066f60 msgr2=0x7f6028069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.693+0000 7f6050400640 1 --2- 172.21.15.173:0/3016300104 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6028066f60 0x7f6028069420 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6048071950 tx=0x7f6034009040 comp rx=0 tx=0).stop 2024-04-25T09:03:43.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.693+0000 7f6050400640 1 -- 172.21.15.173:0/3016300104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60480aefa0 msgr2=0x7f6048159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.693+0000 7f6050400640 1 --2- 172.21.15.173:0/3016300104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60480aefa0 0x7f6048159b90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f603c00c430 tx=0x7f603c00c8f0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.693+0000 7f6050400640 1 -- 172.21.15.173:0/3016300104 shutdown_connections 2024-04-25T09:03:43.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.693+0000 7f6050400640 1 --2- 172.21.15.173:0/3016300104 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6028066f60 0x7f6028069420 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.693+0000 7f6050400640 1 --2- 172.21.15.173:0/3016300104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f604815edd0 0x7f60481476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.693+0000 7f6050400640 1 --2- 172.21.15.173:0/3016300104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60480b3e70 0x7f604815d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.693+0000 7f6050400640 1 --2- 172.21.15.173:0/3016300104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60480aefa0 0x7f6048159b90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.693+0000 7f6050400640 1 -- 172.21.15.173:0/3016300104 >> 172.21.15.173:0/3016300104 conn(0x7f604806ac90 msgr2=0x7f6048148a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:43.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.693+0000 7f6050400640 1 -- 172.21.15.173:0/3016300104 shutdown_connections 2024-04-25T09:03:43.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.693+0000 7f6050400640 1 -- 172.21.15.173:0/3016300104 wait complete. 2024-04-25T09:03:43.702 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:02:49.342297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:02:50.386069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:02:54.077429+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:03:43.702 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:43.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.849+0000 7f19b1600640 1 Processor -- start 2024-04-25T09:03:43.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.849+0000 7f19b1600640 1 -- start start 2024-04-25T09:03:43.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.853+0000 7f19b1600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19ac0ccff0 0x7f19ac0cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:43.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.853+0000 7f19b1600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f19ac0ce680 0x7f19ac0ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:43.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.853+0000 7f19b1600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ac0cdaa0 con 0x7f19ac0b0d70 2024-04-25T09:03:43.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.853+0000 7f19b1600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19ac15b3a0 con 0x7f19ac0ce680 2024-04-25T09:03:43.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.853+0000 7f19b1600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac06d3d0 con 0x7f19ac0ccff0 2024-04-25T09:03:43.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.853+0000 7f19b0c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f19ac0ce680 0x7f19ac0ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:43.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.853+0000 7f19b0c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f19ac0ce680 0x7f19ac0ceb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59240/0 (socket says 172.21.15.173:59240) 2024-04-25T09:03:43.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.853+0000 7f19abe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f19ac0b0d70 0x7f19ac15ac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34018/0 (socket says 172.21.15.173:34018) 2024-04-25T09:03:43.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.853+0000 7f19b0c00640 1 -- 172.21.15.173:0/2209796091 learned_addr learned my addr 172.21.15.173:0/2209796091 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:43.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.853+0000 7f19ab400640 1 --2- 172.21.15.173:0/2209796091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19ac0ccff0 0x7f19ac0cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:43.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.853+0000 7f19b0c00640 1 -- 172.21.15.173:0/2209796091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19ac0ccff0 msgr2=0x7f19ac0cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:43.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.853+0000 7f19b0c00640 1 --2- 172.21.15.173:0/2209796091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19ac0ccff0 0x7f19ac0cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.853+0000 7f19b0c00640 1 -- 172.21.15.173:0/2209796091 >> v1:172.21.15.173:6789/0 conn(0x7f19ac0b0d70 legacy=0x7f19ac15ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.853+0000 7f19b0c00640 1 -- 172.21.15.173:0/2209796091 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac06d670 con 0x7f19ac0ce680 2024-04-25T09:03:43.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.853+0000 7f19aaa00640 1 -- 172.21.15.173:0/2209796091 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639772570 0 0) 0x7f19ac0cdaa0 con 0x7f19ac0b0d70 2024-04-25T09:03:43.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.853+0000 7f19b0c00640 1 --2- 172.21.15.173:0/2209796091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19ac0ce680 0x7f19ac0ceb10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009e50 tx=0x7f19a401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c1d69618d786e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:43.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19aaa00640 1 -- 172.21.15.173:0/2209796091 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a40a5750 con 0x7f19ac0ce680 2024-04-25T09:03:43.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19aaa00640 1 -- 172.21.15.173:0/2209796091 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a40a58f0 con 0x7f19ac0ce680 2024-04-25T09:03:43.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19aaa00640 1 -- 172.21.15.173:0/2209796091 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a40a5cc0 con 0x7f19ac0ce680 2024-04-25T09:03:43.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19b1600640 1 -- 172.21.15.173:0/2209796091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19ac0ce680 msgr2=0x7f19ac0ceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19b1600640 1 --2- 172.21.15.173:0/2209796091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19ac0ce680 0x7f19ac0ceb10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009e50 tx=0x7f19a401c9a0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19b1600640 1 -- 172.21.15.173:0/2209796091 shutdown_connections 2024-04-25T09:03:43.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19b1600640 1 --2- 172.21.15.173:0/2209796091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19ac0ce680 0x7f19ac0ceb10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19b1600640 1 --2- 172.21.15.173:0/2209796091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19ac0ccff0 0x7f19ac0cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19b1600640 1 -- 172.21.15.173:0/2209796091 >> 172.21.15.173:0/2209796091 conn(0x7f19ac061d40 msgr2=0x7f19ac06ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:43.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19b1600640 1 -- 172.21.15.173:0/2209796091 shutdown_connections 2024-04-25T09:03:43.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19b1600640 1 -- 172.21.15.173:0/2209796091 wait complete. 2024-04-25T09:03:43.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19b1600640 1 Processor -- start 2024-04-25T09:03:43.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19b1600640 1 -- start start 2024-04-25T09:03:43.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19b1600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19ac0b0d70 0x7f19ac15d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:43.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19b1600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19ac0ccff0 0x7f19ac14dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:43.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19b1600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19ac0ce680 0x7f19ac0c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:43.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19b1600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac06e960 con 0x7f19ac0ce680 2024-04-25T09:03:43.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19b1600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac143d90 con 0x7f19ac0b0d70 2024-04-25T09:03:43.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19b1600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac06eae0 con 0x7f19ac0ccff0 2024-04-25T09:03:43.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19b0c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19ac0ce680 0x7f19ac0c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:43.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.857+0000 7f19b0c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19ac0ce680 0x7f19ac0c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59244/0 (socket says 172.21.15.173:59244) 2024-04-25T09:03:43.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.861+0000 7f19b0c00640 1 -- 172.21.15.173:0/1652116606 learned_addr learned my addr 172.21.15.173:0/1652116606 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:43.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.861+0000 7f19abe00640 1 --2- 172.21.15.173:0/1652116606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19ac0b0d70 0x7f19ac15d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:43.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.861+0000 7f19ab400640 1 --2- 172.21.15.173:0/1652116606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19ac0ccff0 0x7f19ac14dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:43.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.861+0000 7f19b0c00640 1 -- 172.21.15.173:0/1652116606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19ac0ccff0 msgr2=0x7f19ac14dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.861+0000 7f19b0c00640 1 --2- 172.21.15.173:0/1652116606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19ac0ccff0 0x7f19ac14dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.861+0000 7f19b0c00640 1 -- 172.21.15.173:0/1652116606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19ac0b0d70 msgr2=0x7f19ac15d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:43.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.861+0000 7f19b0c00640 1 --2- 172.21.15.173:0/1652116606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19ac0b0d70 0x7f19ac15d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:43.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.861+0000 7f19b0c00640 1 -- 172.21.15.173:0/1652116606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac15d760 con 0x7f19ac0ce680 2024-04-25T09:03:43.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.861+0000 7f19b0c00640 1 --2- 172.21.15.173:0/1652116606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19ac0ce680 0x7f19ac0c62e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f19a40af040 tx=0x7f19a4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:43.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.861+0000 7f19a3e00640 1 -- 172.21.15.173:0/1652116606 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a40bc070 con 0x7f19ac0ce680 2024-04-25T09:03:43.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.861+0000 7f19a3e00640 1 -- 172.21.15.173:0/1652116606 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a40b8640 con 0x7f19ac0ce680 2024-04-25T09:03:43.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.861+0000 7f19b1600640 1 -- 172.21.15.173:0/1652116606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ac15c180 con 0x7f19ac0ce680 2024-04-25T09:03:43.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.861+0000 7f19a3e00640 1 -- 172.21.15.173:0/1652116606 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a40b89f0 con 0x7f19ac0ce680 2024-04-25T09:03:43.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.861+0000 7f19b1600640 1 -- 172.21.15.173:0/1652116606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ac15c740 con 0x7f19ac0ce680 2024-04-25T09:03:43.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.861+0000 7f19b1600640 1 -- 172.21.15.173:0/1652116606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ac073a40 con 0x7f19ac0ce680 2024-04-25T09:03:43.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.861+0000 7f19a3e00640 1 -- 172.21.15.173:0/1652116606 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f19a40b8b90 con 0x7f19ac0ce680 2024-04-25T09:03:43.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.865+0000 7f19a3e00640 1 --2- 172.21.15.173:0/1652116606 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f198c066f90 0x7f198c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:43.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.865+0000 7f19a3e00640 1 -- 172.21.15.173:0/1652116606 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f19a4120480 con 0x7f19ac0ce680 2024-04-25T09:03:43.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.865+0000 7f19abe00640 1 --2- 172.21.15.173:0/1652116606 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f198c066f90 0x7f198c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:43.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.865+0000 7f19abe00640 1 --2- 172.21.15.173:0/1652116606 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f198c066f90 0x7f198c069450 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f199c000f70 tx=0x7f199c007df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:43.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:43.869+0000 7f19a3e00640 1 -- 172.21.15.173:0/1652116606 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f19a4016620 con 0x7f19ac0ce680 2024-04-25T09:03:44.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.021+0000 7f19b1600640 1 -- 172.21.15.173:0/1652116606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19ac15ea90 con 0x7f19ac0ce680 2024-04-25T09:03:44.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.021+0000 7f19a3e00640 1 -- 172.21.15.173:0/1652116606 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19a40f0ad0 con 0x7f19ac0ce680 2024-04-25T09:03:44.014 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:03:44.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.025+0000 7f19b1600640 1 -- 172.21.15.173:0/1652116606 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f198c066f90 msgr2=0x7f198c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.025+0000 7f19b1600640 1 --2- 172.21.15.173:0/1652116606 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f198c066f90 0x7f198c069450 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f199c000f70 tx=0x7f199c007df0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.025+0000 7f19b1600640 1 -- 172.21.15.173:0/1652116606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19ac0ce680 msgr2=0x7f19ac0c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.025+0000 7f19b1600640 1 --2- 172.21.15.173:0/1652116606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19ac0ce680 0x7f19ac0c62e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f19a40af040 tx=0x7f19a4019740 comp rx=0 tx=0).stop 2024-04-25T09:03:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.025+0000 7f19b1600640 1 -- 172.21.15.173:0/1652116606 shutdown_connections 2024-04-25T09:03:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.025+0000 7f19b1600640 1 --2- 172.21.15.173:0/1652116606 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f198c066f90 0x7f198c069450 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.025+0000 7f19b1600640 1 --2- 172.21.15.173:0/1652116606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19ac0ce680 0x7f19ac0c62e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.025+0000 7f19b1600640 1 --2- 172.21.15.173:0/1652116606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19ac0ccff0 0x7f19ac14dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.025+0000 7f19b1600640 1 --2- 172.21.15.173:0/1652116606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19ac0b0d70 0x7f19ac15d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.025+0000 7f19b1600640 1 -- 172.21.15.173:0/1652116606 >> 172.21.15.173:0/1652116606 conn(0x7f19ac061d40 msgr2=0x7f19ac06ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.025+0000 7f19b1600640 1 -- 172.21.15.173:0/1652116606 shutdown_connections 2024-04-25T09:03:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.025+0000 7f19b1600640 1 -- 172.21.15.173:0/1652116606 wait complete. 2024-04-25T09:03:44.034 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:44.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f328fe00640 1 Processor -- start 2024-04-25T09:03:44.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f328fe00640 1 -- start start 2024-04-25T09:03:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f328fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3288158340 0x7f32880b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f328fe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f32880af810 0x7f32880d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f328fe00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32880b5120 con 0x7f32880af3b0 2024-04-25T09:03:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f328fe00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32880b53c0 con 0x7f32880af810 2024-04-25T09:03:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f328fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32880b56a0 con 0x7f3288158340 2024-04-25T09:03:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f328ca00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f32880af3b0 0x7f32880d06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34020/0 (socket says 172.21.15.173:34020) 2024-04-25T09:03:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f328ca00640 1 -- 172.21.15.173:0/2502138373 learned_addr learned my addr 172.21.15.173:0/2502138373 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f328de00640 1 --2- 172.21.15.173:0/2502138373 >> v2:172.21.15.194:3300/0 conn(0x7f32880af810 0x7f32880d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f328d400640 1 --2- 172.21.15.173:0/2502138373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3288158340 0x7f32880b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f3287e00640 1 -- 172.21.15.173:0/2502138373 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985691424 0 0) 0x7f32880b5120 con 0x7f32880af3b0 2024-04-25T09:03:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f3287e00640 1 -- 172.21.15.173:0/2502138373 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3270003530 con 0x7f32880af3b0 2024-04-25T09:03:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f3287e00640 1 -- 172.21.15.173:0/2502138373 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2491075325 0 0) 0x7f3270003530 con 0x7f32880af3b0 2024-04-25T09:03:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f3287e00640 1 -- 172.21.15.173:0/2502138373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3288158340 msgr2=0x7f32880b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f3287e00640 1 --2- 172.21.15.173:0/2502138373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3288158340 0x7f32880b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f3287e00640 1 -- 172.21.15.173:0/2502138373 >> v2:172.21.15.194:3300/0 conn(0x7f32880af810 msgr2=0x7f32880d0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f3287e00640 1 --2- 172.21.15.173:0/2502138373 >> v2:172.21.15.194:3300/0 conn(0x7f32880af810 0x7f32880d0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f3287e00640 1 -- 172.21.15.173:0/2502138373 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328806ff60 con 0x7f32880af3b0 2024-04-25T09:03:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f3287e00640 1 -- 172.21.15.173:0/2502138373 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f3274001680 con 0x7f32880af3b0 2024-04-25T09:03:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f3287e00640 1 -- 172.21.15.173:0/2502138373 >> v1:172.21.15.173:6789/0 conn(0x7f32880af3b0 legacy=0x7f32880d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f3287e00640 1 --2- 172.21.15.173:0/2502138373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3288158340 0x7f32700039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f3287e00640 1 --2- 172.21.15.173:0/2502138373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3270003f40 0x7f3270004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f3287e00640 1 --2- 172.21.15.173:0/2502138373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3270004d50 0x7f32700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f3287e00640 1 -- 172.21.15.173:0/2502138373 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32880b53c0 con 0x7f3270003f40 2024-04-25T09:03:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f3287e00640 1 -- 172.21.15.173:0/2502138373 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32880b56a0 con 0x7f3270004d50 2024-04-25T09:03:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f3287e00640 1 -- 172.21.15.173:0/2502138373 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327000b9d0 con 0x7f3288158340 2024-04-25T09:03:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f328ca00640 1 --2- 172.21.15.173:0/2502138373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3270003f40 0x7f3270004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f328de00640 1 --2- 172.21.15.173:0/2502138373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3270004d50 0x7f32700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.185+0000 7f328d400640 1 --2- 172.21.15.173:0/2502138373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3288158340 0x7f32700039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.189+0000 7f328ca00640 1 -- 172.21.15.173:0/2502138373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3288158340 msgr2=0x7f32700039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.189+0000 7f328ca00640 1 --2- 172.21.15.173:0/2502138373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3288158340 0x7f32700039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.189+0000 7f328ca00640 1 -- 172.21.15.173:0/2502138373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3270004d50 msgr2=0x7f32700051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.189+0000 7f328ca00640 1 --2- 172.21.15.173:0/2502138373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3270004d50 0x7f32700051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.189+0000 7f328ca00640 1 -- 172.21.15.173:0/2502138373 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270003530 con 0x7f3270003f40 2024-04-25T09:03:44.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.189+0000 7f328ca00640 1 --2- 172.21.15.173:0/2502138373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3270003f40 0x7f3270004810 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f327400c240 tx=0x7f327401f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8799914a47bf3406 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:44.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.189+0000 7f3287e00640 1 -- 172.21.15.173:0/2502138373 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3274007d60 con 0x7f3270003f40 2024-04-25T09:03:44.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.189+0000 7f3287e00640 1 -- 172.21.15.173:0/2502138373 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3274005b00 con 0x7f3270003f40 2024-04-25T09:03:44.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.189+0000 7f3287e00640 1 -- 172.21.15.173:0/2502138373 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3274007070 con 0x7f3270003f40 2024-04-25T09:03:44.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.189+0000 7f328fe00640 1 -- 172.21.15.173:0/2502138373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3270003f40 msgr2=0x7f3270004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.189+0000 7f328fe00640 1 --2- 172.21.15.173:0/2502138373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3270003f40 0x7f3270004810 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f327400c240 tx=0x7f327401f3d0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.189+0000 7f328de00640 1 -- 172.21.15.173:0/2502138373 reap_dead start 2024-04-25T09:03:44.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.189+0000 7f328fe00640 1 -- 172.21.15.173:0/2502138373 shutdown_connections 2024-04-25T09:03:44.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.189+0000 7f328fe00640 1 -- 172.21.15.173:0/2502138373 >> 172.21.15.173:0/2502138373 conn(0x7f32880b5b00 msgr2=0x7f32880b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:44.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.189+0000 7f328fe00640 1 -- 172.21.15.173:0/2502138373 shutdown_connections 2024-04-25T09:03:44.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.189+0000 7f328fe00640 1 -- 172.21.15.173:0/2502138373 wait complete. 2024-04-25T09:03:44.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328fe00640 1 Processor -- start 2024-04-25T09:03:44.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328fe00640 1 -- start start 2024-04-25T09:03:44.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3270003f40 0x7f32881f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32881519c0 0x7f3288153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32880b0b30 0x7f328814df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328fe00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328806ba30 con 0x7f32881519c0 2024-04-25T09:03:44.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328fe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32880afc60 con 0x7f3270003f40 2024-04-25T09:03:44.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328806bbb0 con 0x7f32880b0b30 2024-04-25T09:03:44.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328ca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32881519c0 0x7f3288153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328ca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32881519c0 0x7f3288153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59270/0 (socket says 172.21.15.173:59270) 2024-04-25T09:03:44.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328ca00640 1 -- 172.21.15.173:0/2663750025 learned_addr learned my addr 172.21.15.173:0/2663750025 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:44.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328d400640 1 --2- 172.21.15.173:0/2663750025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3270003f40 0x7f32881f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328de00640 1 --2- 172.21.15.173:0/2663750025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32880b0b30 0x7f328814df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328ca00640 1 -- 172.21.15.173:0/2663750025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32880b0b30 msgr2=0x7f328814df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328ca00640 1 --2- 172.21.15.173:0/2663750025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32880b0b30 0x7f328814df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328ca00640 1 -- 172.21.15.173:0/2663750025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3270003f40 msgr2=0x7f32881f35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328ca00640 1 --2- 172.21.15.173:0/2663750025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3270003f40 0x7f32881f35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328ca00640 1 -- 172.21.15.173:0/2663750025 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3288152110 con 0x7f32881519c0 2024-04-25T09:03:44.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328de00640 1 --2- 172.21.15.173:0/2663750025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32880b0b30 0x7f328814df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:44.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f328ca00640 1 --2- 172.21.15.173:0/2663750025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32881519c0 0x7f3288153490 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f327401fc70 tx=0x7f3270005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:44.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.193+0000 7f3285600640 1 -- 172.21.15.173:0/2663750025 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3274001ca0 con 0x7f32881519c0 2024-04-25T09:03:44.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.197+0000 7f3285600640 1 -- 172.21.15.173:0/2663750025 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3274005cb0 con 0x7f32881519c0 2024-04-25T09:03:44.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.197+0000 7f3285600640 1 -- 172.21.15.173:0/2663750025 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3274005e60 con 0x7f32881519c0 2024-04-25T09:03:44.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.197+0000 7f328fe00640 1 -- 172.21.15.173:0/2663750025 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3288151e40 con 0x7f32881519c0 2024-04-25T09:03:44.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.197+0000 7f328fe00640 1 -- 172.21.15.173:0/2663750025 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32881f3ee0 con 0x7f32881519c0 2024-04-25T09:03:44.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.197+0000 7f328fe00640 1 -- 172.21.15.173:0/2663750025 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3288073ab0 con 0x7f32881519c0 2024-04-25T09:03:44.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.197+0000 7f3285600640 1 -- 172.21.15.173:0/2663750025 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f32740ba030 con 0x7f32881519c0 2024-04-25T09:03:44.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.197+0000 7f3285600640 1 --2- 172.21.15.173:0/2663750025 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3268066fb0 0x7f3268069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.197+0000 7f3285600640 1 -- 172.21.15.173:0/2663750025 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f3274121f40 con 0x7f32881519c0 2024-04-25T09:03:44.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.197+0000 7f328d400640 1 --2- 172.21.15.173:0/2663750025 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3268066fb0 0x7f3268069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.197+0000 7f328d400640 1 --2- 172.21.15.173:0/2663750025 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3268066fb0 0x7f3268069470 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f32881f6b00 tx=0x7f327c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:44.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.201+0000 7f3285600640 1 -- 172.21.15.173:0/2663750025 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3274019140 con 0x7f32881519c0 2024-04-25T09:03:44.209 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:44.212 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:44.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.361+0000 7f328fe00640 1 -- 172.21.15.173:0/2663750025 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f328806e940 con 0x7f32881519c0 2024-04-25T09:03:44.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.361+0000 7f3285600640 1 -- 172.21.15.173:0/2663750025 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f32740f2b30 con 0x7f32881519c0 2024-04-25T09:03:44.351 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:44.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.361+0000 7f328fe00640 1 -- 172.21.15.173:0/2663750025 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3268066fb0 msgr2=0x7f3268069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.361+0000 7f328fe00640 1 --2- 172.21.15.173:0/2663750025 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3268066fb0 0x7f3268069470 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f32881f6b00 tx=0x7f327c009190 comp rx=0 tx=0).stop 2024-04-25T09:03:44.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.361+0000 7f328fe00640 1 -- 172.21.15.173:0/2663750025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32881519c0 msgr2=0x7f3288153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.361+0000 7f328fe00640 1 --2- 172.21.15.173:0/2663750025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32881519c0 0x7f3288153490 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f327401fc70 tx=0x7f3270005840 comp rx=0 tx=0).stop 2024-04-25T09:03:44.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.361+0000 7f328fe00640 1 -- 172.21.15.173:0/2663750025 shutdown_connections 2024-04-25T09:03:44.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.361+0000 7f328fe00640 1 --2- 172.21.15.173:0/2663750025 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3268066fb0 0x7f3268069470 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.361+0000 7f328fe00640 1 --2- 172.21.15.173:0/2663750025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32880b0b30 0x7f328814df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.361+0000 7f328fe00640 1 --2- 172.21.15.173:0/2663750025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32881519c0 0x7f3288153490 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.361+0000 7f328fe00640 1 --2- 172.21.15.173:0/2663750025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3270003f40 0x7f32881f35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.361+0000 7f328fe00640 1 -- 172.21.15.173:0/2663750025 >> 172.21.15.173:0/2663750025 conn(0x7f32880b5b00 msgr2=0x7f328806f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:44.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.361+0000 7f328fe00640 1 -- 172.21.15.173:0/2663750025 shutdown_connections 2024-04-25T09:03:44.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.361+0000 7f328fe00640 1 -- 172.21.15.173:0/2663750025 wait complete. 2024-04-25T09:03:44.372 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:44.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.521+0000 7fde69000640 1 Processor -- start 2024-04-25T09:03:44.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.521+0000 7fde69000640 1 -- start start 2024-04-25T09:03:44.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.521+0000 7fde69000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fde6406e1c0 0x7fde6406bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.521+0000 7fde69000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fde6406c410 0x7fde640aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.521+0000 7fde69000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde640ad3f0 0x7fde6406e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.521+0000 7fde69000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde640b3170 con 0x7fde6406c410 2024-04-25T09:03:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.521+0000 7fde69000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde6415e070 con 0x7fde6406e1c0 2024-04-25T09:03:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.521+0000 7fde69000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6406ae30 con 0x7fde640ad3f0 2024-04-25T09:03:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.521+0000 7fde61400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fde6406c410 0x7fde640aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.521+0000 7fde61400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fde6406c410 0x7fde640aceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59284/0 (socket says 172.21.15.173:59284) 2024-04-25T09:03:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.521+0000 7fde61400640 1 -- 172.21.15.173:0/953427948 learned_addr learned my addr 172.21.15.173:0/953427948 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.521+0000 7fde62800640 1 --2- 172.21.15.173:0/953427948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde640ad3f0 0x7fde6406e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.521+0000 7fde61e00640 1 --2- 172.21.15.173:0/953427948 >> v2:172.21.15.194:3300/0 conn(0x7fde6406e1c0 0x7fde6406bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.521+0000 7fde61400640 1 -- 172.21.15.173:0/953427948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde640ad3f0 msgr2=0x7fde6406e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.521+0000 7fde61400640 1 --2- 172.21.15.173:0/953427948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde640ad3f0 0x7fde6406e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.521+0000 7fde61400640 1 -- 172.21.15.173:0/953427948 >> v2:172.21.15.194:3300/0 conn(0x7fde6406e1c0 msgr2=0x7fde6406bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:44.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.521+0000 7fde61400640 1 --2- 172.21.15.173:0/953427948 >> v2:172.21.15.194:3300/0 conn(0x7fde6406e1c0 0x7fde6406bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.521+0000 7fde61400640 1 -- 172.21.15.173:0/953427948 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6406b110 con 0x7fde6406c410 2024-04-25T09:03:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.525+0000 7fde61400640 1 --2- 172.21.15.173:0/953427948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde6406c410 0x7fde640aceb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fde64071b60 tx=0x7fde5001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3457bf4c0841e8f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.525+0000 7fde60a00640 1 -- 172.21.15.173:0/953427948 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500b5070 con 0x7fde6406c410 2024-04-25T09:03:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.525+0000 7fde60a00640 1 -- 172.21.15.173:0/953427948 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde500a89d0 con 0x7fde6406c410 2024-04-25T09:03:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.525+0000 7fde60a00640 1 -- 172.21.15.173:0/953427948 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500a8da0 con 0x7fde6406c410 2024-04-25T09:03:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.525+0000 7fde69000640 1 -- 172.21.15.173:0/953427948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde6406c410 msgr2=0x7fde640aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.525+0000 7fde69000640 1 --2- 172.21.15.173:0/953427948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde6406c410 0x7fde640aceb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fde64071b60 tx=0x7fde5001ed10 comp rx=0 tx=0).stop 2024-04-25T09:03:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.525+0000 7fde69000640 1 -- 172.21.15.173:0/953427948 shutdown_connections 2024-04-25T09:03:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.525+0000 7fde69000640 1 --2- 172.21.15.173:0/953427948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde640ad3f0 0x7fde6406e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.525+0000 7fde69000640 1 --2- 172.21.15.173:0/953427948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde6406c410 0x7fde640aceb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.525+0000 7fde69000640 1 --2- 172.21.15.173:0/953427948 >> v2:172.21.15.194:3300/0 conn(0x7fde6406e1c0 0x7fde6406bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.525+0000 7fde69000640 1 -- 172.21.15.173:0/953427948 >> 172.21.15.173:0/953427948 conn(0x7fde640cfed0 msgr2=0x7fde640d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.525+0000 7fde69000640 1 -- 172.21.15.173:0/953427948 shutdown_connections 2024-04-25T09:03:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.525+0000 7fde69000640 1 -- 172.21.15.173:0/953427948 wait complete. 2024-04-25T09:03:44.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde69000640 1 Processor -- start 2024-04-25T09:03:44.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde69000640 1 -- start start 2024-04-25T09:03:44.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde69000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde6406c410 0x7fde64147170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde69000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde6406e1c0 0x7fde64146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde69000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde640ad3f0 0x7fde640c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde69000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6406b9b0 con 0x7fde6406e1c0 2024-04-25T09:03:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde69000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6406b6d0 con 0x7fde6406c410 2024-04-25T09:03:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde69000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde640ad840 con 0x7fde640ad3f0 2024-04-25T09:03:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde61400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde6406e1c0 0x7fde64146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde61400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde6406e1c0 0x7fde64146940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59294/0 (socket says 172.21.15.173:59294) 2024-04-25T09:03:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde61400640 1 -- 172.21.15.173:0/557948205 learned_addr learned my addr 172.21.15.173:0/557948205 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde61e00640 1 --2- 172.21.15.173:0/557948205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde6406c410 0x7fde64147170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde62800640 1 --2- 172.21.15.173:0/557948205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde640ad3f0 0x7fde640c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde61400640 1 -- 172.21.15.173:0/557948205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde640ad3f0 msgr2=0x7fde640c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde61400640 1 --2- 172.21.15.173:0/557948205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde640ad3f0 0x7fde640c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde61400640 1 -- 172.21.15.173:0/557948205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde6406c410 msgr2=0x7fde64147170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde61400640 1 --2- 172.21.15.173:0/557948205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde6406c410 0x7fde64147170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde61400640 1 -- 172.21.15.173:0/557948205 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde64146e80 con 0x7fde6406e1c0 2024-04-25T09:03:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde61400640 1 --2- 172.21.15.173:0/557948205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde6406e1c0 0x7fde64146940 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fde5001d3c0 tx=0x7fde5001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:44.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde5a000640 1 -- 172.21.15.173:0/557948205 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500b5070 con 0x7fde6406e1c0 2024-04-25T09:03:44.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde5a000640 1 -- 172.21.15.173:0/557948205 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde500b0950 con 0x7fde6406e1c0 2024-04-25T09:03:44.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde69000640 1 -- 172.21.15.173:0/557948205 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde640c6190 con 0x7fde6406e1c0 2024-04-25T09:03:44.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde5a000640 1 -- 172.21.15.173:0/557948205 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500b0d40 con 0x7fde6406e1c0 2024-04-25T09:03:44.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde69000640 1 -- 172.21.15.173:0/557948205 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde64147b30 con 0x7fde6406e1c0 2024-04-25T09:03:44.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.529+0000 7fde69000640 1 -- 172.21.15.173:0/557948205 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde64073ab0 con 0x7fde6406e1c0 2024-04-25T09:03:44.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.533+0000 7fde5a000640 1 -- 172.21.15.173:0/557948205 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fde500c2060 con 0x7fde6406e1c0 2024-04-25T09:03:44.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.533+0000 7fde5a000640 1 --2- 172.21.15.173:0/557948205 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde44066f60 0x7fde44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.533+0000 7fde5a000640 1 -- 172.21.15.173:0/557948205 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fde501223f0 con 0x7fde6406e1c0 2024-04-25T09:03:44.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.533+0000 7fde61e00640 1 --2- 172.21.15.173:0/557948205 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde44066f60 0x7fde44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.533+0000 7fde61e00640 1 --2- 172.21.15.173:0/557948205 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde44066f60 0x7fde44069420 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fde54009b60 tx=0x7fde54009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:44.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.537+0000 7fde5a000640 1 -- 172.21.15.173:0/557948205 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fde50018870 con 0x7fde6406e1c0 2024-04-25T09:03:44.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.689+0000 7fde69000640 1 -- 172.21.15.173:0/557948205 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde640ae670 con 0x7fde6406e1c0 2024-04-25T09:03:44.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.693+0000 7fde5a000640 1 -- 172.21.15.173:0/557948205 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fde500f2910 con 0x7fde6406e1c0 2024-04-25T09:03:44.682 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:03:44.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.693+0000 7fde69000640 1 -- 172.21.15.173:0/557948205 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde44066f60 msgr2=0x7fde44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.693+0000 7fde69000640 1 --2- 172.21.15.173:0/557948205 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde44066f60 0x7fde44069420 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fde54009b60 tx=0x7fde54009190 comp rx=0 tx=0).stop 2024-04-25T09:03:44.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.693+0000 7fde69000640 1 -- 172.21.15.173:0/557948205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde6406e1c0 msgr2=0x7fde64146940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.693+0000 7fde69000640 1 --2- 172.21.15.173:0/557948205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde6406e1c0 0x7fde64146940 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fde5001d3c0 tx=0x7fde5001bab0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.693+0000 7fde69000640 1 -- 172.21.15.173:0/557948205 shutdown_connections 2024-04-25T09:03:44.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.693+0000 7fde69000640 1 --2- 172.21.15.173:0/557948205 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde44066f60 0x7fde44069420 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.693+0000 7fde69000640 1 --2- 172.21.15.173:0/557948205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde640ad3f0 0x7fde640c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.693+0000 7fde69000640 1 --2- 172.21.15.173:0/557948205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde6406e1c0 0x7fde64146940 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.693+0000 7fde69000640 1 --2- 172.21.15.173:0/557948205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde6406c410 0x7fde64147170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.693+0000 7fde69000640 1 -- 172.21.15.173:0/557948205 >> 172.21.15.173:0/557948205 conn(0x7fde640cfed0 msgr2=0x7fde640b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:44.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.693+0000 7fde69000640 1 -- 172.21.15.173:0/557948205 shutdown_connections 2024-04-25T09:03:44.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.693+0000 7fde69000640 1 -- 172.21.15.173:0/557948205 wait complete. 2024-04-25T09:03:44.703 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:03:44.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.853+0000 7f7ba0c00640 1 Processor -- start 2024-04-25T09:03:44.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.853+0000 7f7ba0c00640 1 -- start start 2024-04-25T09:03:44.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.853+0000 7f7ba0c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7b9c15b710 0x7f7b9c071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.853+0000 7f7ba0c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7b9c0cc840 0x7f7b9c0ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.853+0000 7f7ba0c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9c15e2d0 con 0x7f7b9c0cd3d0 2024-04-25T09:03:44.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.853+0000 7f7ba0c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9c15eea0 con 0x7f7b9c15b710 2024-04-25T09:03:44.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.853+0000 7f7ba0c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9c15e570 con 0x7f7b9c0cc840 2024-04-25T09:03:44.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.853+0000 7f7b99e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7b9c15b710 0x7f7b9c071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.853+0000 7f7b99e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7b9c15b710 0x7f7b9c071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59300/0 (socket says 172.21.15.173:59300) 2024-04-25T09:03:44.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.853+0000 7f7b99e00640 1 -- 172.21.15.173:0/4066912527 learned_addr learned my addr 172.21.15.173:0/4066912527 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:44.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.853+0000 7f7b9a800640 1 --2- 172.21.15.173:0/4066912527 >> v2:172.21.15.194:3300/0 conn(0x7f7b9c0cc840 0x7f7b9c0ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.853+0000 7f7b99e00640 1 -- 172.21.15.173:0/4066912527 >> v2:172.21.15.194:3300/0 conn(0x7f7b9c0cc840 msgr2=0x7f7b9c0ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:44.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.853+0000 7f7b99e00640 1 --2- 172.21.15.173:0/4066912527 >> v2:172.21.15.194:3300/0 conn(0x7f7b9c0cc840 0x7f7b9c0ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.853+0000 7f7b99e00640 1 -- 172.21.15.173:0/4066912527 >> v1:172.21.15.194:6789/0 conn(0x7f7b9c0cd3d0 legacy=0x7f7b9c0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:44.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.853+0000 7f7b99e00640 1 -- 172.21.15.173:0/4066912527 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c15e850 con 0x7f7b9c15b710 2024-04-25T09:03:44.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.853+0000 7f7b9a800640 1 --2- 172.21.15.173:0/4066912527 >> v2:172.21.15.194:3300/0 conn(0x7f7b9c0cc840 0x7f7b9c0ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:44.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.857+0000 7f7b99e00640 1 --2- 172.21.15.173:0/4066912527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9c15b710 0x7f7b9c071e80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0ccfa0 tx=0x7f7b8c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3402529738f01ef1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:44.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.857+0000 7f7b98a00640 1 -- 172.21.15.173:0/4066912527 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c0ab600 con 0x7f7b9c15b710 2024-04-25T09:03:44.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.857+0000 7f7b98a00640 1 -- 172.21.15.173:0/4066912527 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c0b0070 con 0x7f7b9c15b710 2024-04-25T09:03:44.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.857+0000 7f7b98a00640 1 -- 172.21.15.173:0/4066912527 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c0ab9c0 con 0x7f7b9c15b710 2024-04-25T09:03:44.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.857+0000 7f7ba0c00640 1 -- 172.21.15.173:0/4066912527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9c15b710 msgr2=0x7f7b9c071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.857+0000 7f7ba0c00640 1 --2- 172.21.15.173:0/4066912527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9c15b710 0x7f7b9c071e80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0ccfa0 tx=0x7f7b8c01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.857+0000 7f7ba0c00640 1 -- 172.21.15.173:0/4066912527 shutdown_connections 2024-04-25T09:03:44.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.857+0000 7f7ba0c00640 1 --2- 172.21.15.173:0/4066912527 >> v2:172.21.15.194:3300/0 conn(0x7f7b9c0cc840 0x7f7b9c0ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.857+0000 7f7ba0c00640 1 --2- 172.21.15.173:0/4066912527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9c15b710 0x7f7b9c071e80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.857+0000 7f7ba0c00640 1 -- 172.21.15.173:0/4066912527 >> 172.21.15.173:0/4066912527 conn(0x7f7b9c06ac90 msgr2=0x7f7b9c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:44.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.857+0000 7f7ba0c00640 1 -- 172.21.15.173:0/4066912527 shutdown_connections 2024-04-25T09:03:44.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.857+0000 7f7ba0c00640 1 -- 172.21.15.173:0/4066912527 wait complete. 2024-04-25T09:03:44.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.857+0000 7f7ba0c00640 1 Processor -- start 2024-04-25T09:03:44.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7ba0c00640 1 -- start start 2024-04-25T09:03:44.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7ba0c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9c0cc840 0x7f7b9c151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7ba0c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b9c0cd3d0 0x7f7b9c0b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7ba0c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b9c15b710 0x7f7b9c14f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7ba0c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0cf890 con 0x7f7b9c0cc840 2024-04-25T09:03:44.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7ba0c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0725d0 con 0x7f7b9c15b710 2024-04-25T09:03:44.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7ba0c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0cfa10 con 0x7f7b9c0cd3d0 2024-04-25T09:03:44.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7b99e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9c0cc840 0x7f7b9c151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7b99e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9c0cc840 0x7f7b9c151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59310/0 (socket says 172.21.15.173:59310) 2024-04-25T09:03:44.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7b99e00640 1 -- 172.21.15.173:0/2754058162 learned_addr learned my addr 172.21.15.173:0/2754058162 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:44.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7b9a800640 1 --2- 172.21.15.173:0/2754058162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b9c15b710 0x7f7b9c14f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7b99400640 1 --2- 172.21.15.173:0/2754058162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b9c0cd3d0 0x7f7b9c0b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7b99e00640 1 -- 172.21.15.173:0/2754058162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b9c0cd3d0 msgr2=0x7f7b9c0b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7b99e00640 1 --2- 172.21.15.173:0/2754058162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b9c0cd3d0 0x7f7b9c0b4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7b99e00640 1 -- 172.21.15.173:0/2754058162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b9c15b710 msgr2=0x7f7b9c14f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7b99e00640 1 --2- 172.21.15.173:0/2754058162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b9c15b710 0x7f7b9c14f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7b99e00640 1 -- 172.21.15.173:0/2754058162 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c0acb30 con 0x7f7b9c0cc840 2024-04-25T09:03:44.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7b99e00640 1 --2- 172.21.15.173:0/2754058162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9c0cc840 0x7f7b9c151100 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c0ad040 tx=0x7f7b8c01ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:44.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7b92000640 1 -- 172.21.15.173:0/2754058162 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c0be5f0 con 0x7f7b9c0cc840 2024-04-25T09:03:44.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7b92000640 1 -- 172.21.15.173:0/2754058162 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c0be7b0 con 0x7f7b9c0cc840 2024-04-25T09:03:44.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7ba0c00640 1 -- 172.21.15.173:0/2754058162 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9c158520 con 0x7f7b9c0cc840 2024-04-25T09:03:44.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7b92000640 1 -- 172.21.15.173:0/2754058162 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c0beba0 con 0x7f7b9c0cc840 2024-04-25T09:03:44.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7ba0c00640 1 -- 172.21.15.173:0/2754058162 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9c1507a0 con 0x7f7b9c0cc840 2024-04-25T09:03:44.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.861+0000 7f7ba0c00640 1 -- 172.21.15.173:0/2754058162 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9c073ab0 con 0x7f7b9c0cc840 2024-04-25T09:03:44.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.865+0000 7f7b92000640 1 -- 172.21.15.173:0/2754058162 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7b8c0aa070 con 0x7f7b9c0cc840 2024-04-25T09:03:44.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.865+0000 7f7b92000640 1 --2- 172.21.15.173:0/2754058162 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7b7c066f60 0x7f7b7c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.865+0000 7f7b92000640 1 -- 172.21.15.173:0/2754058162 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7b8c11fbf0 con 0x7f7b9c0cc840 2024-04-25T09:03:44.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.865+0000 7f7b99400640 1 --2- 172.21.15.173:0/2754058162 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7b7c066f60 0x7f7b7c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.865+0000 7f7b99400640 1 --2- 172.21.15.173:0/2754058162 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7b7c066f60 0x7f7b7c069420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0b40e0 tx=0x7f7b88007e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:44.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:44.869+0000 7f7b92000640 1 -- 172.21.15.173:0/2754058162 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7b8c016090 con 0x7f7b9c0cc840 2024-04-25T09:03:45.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.021+0000 7f7ba0c00640 1 -- 172.21.15.173:0/2754058162 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7b9c073ab0 con 0x7f7b9c0cc840 2024-04-25T09:03:45.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.021+0000 7f7b92000640 1 -- 172.21.15.173:0/2754058162 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7b8c0f01a0 con 0x7f7b9c0cc840 2024-04-25T09:03:45.013 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:45.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.025+0000 7f7ba0c00640 1 -- 172.21.15.173:0/2754058162 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7b7c066f60 msgr2=0x7f7b7c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.025+0000 7f7ba0c00640 1 --2- 172.21.15.173:0/2754058162 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7b7c066f60 0x7f7b7c069420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0b40e0 tx=0x7f7b88007e40 comp rx=0 tx=0).stop 2024-04-25T09:03:45.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.025+0000 7f7ba0c00640 1 -- 172.21.15.173:0/2754058162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9c0cc840 msgr2=0x7f7b9c151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.025+0000 7f7ba0c00640 1 --2- 172.21.15.173:0/2754058162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9c0cc840 0x7f7b9c151100 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c0ad040 tx=0x7f7b8c01ac20 comp rx=0 tx=0).stop 2024-04-25T09:03:45.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.025+0000 7f7ba0c00640 1 -- 172.21.15.173:0/2754058162 shutdown_connections 2024-04-25T09:03:45.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.025+0000 7f7ba0c00640 1 --2- 172.21.15.173:0/2754058162 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7b7c066f60 0x7f7b7c069420 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.025+0000 7f7ba0c00640 1 --2- 172.21.15.173:0/2754058162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b9c15b710 0x7f7b9c14f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.025+0000 7f7ba0c00640 1 --2- 172.21.15.173:0/2754058162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b9c0cd3d0 0x7f7b9c0b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.025+0000 7f7ba0c00640 1 --2- 172.21.15.173:0/2754058162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9c0cc840 0x7f7b9c151100 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.025+0000 7f7ba0c00640 1 -- 172.21.15.173:0/2754058162 >> 172.21.15.173:0/2754058162 conn(0x7f7b9c06ac90 msgr2=0x7f7b9c152260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:45.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.025+0000 7f7ba0c00640 1 -- 172.21.15.173:0/2754058162 shutdown_connections 2024-04-25T09:03:45.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.025+0000 7f7ba0c00640 1 -- 172.21.15.173:0/2754058162 wait complete. 2024-04-25T09:03:45.033 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:03:45.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.177+0000 7f184a200640 1 Processor -- start 2024-04-25T09:03:45.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.181+0000 7f184a200640 1 -- start start 2024-04-25T09:03:45.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.181+0000 7f184a200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18440aeb90 0x7f18440cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.181+0000 7f184a200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f18440ce2b0 0x7f18440cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.181+0000 7f184a200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1844071570 con 0x7f18440aef70 2024-04-25T09:03:45.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.181+0000 7f184a200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1844071320 con 0x7f18440ce2b0 2024-04-25T09:03:45.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.181+0000 7f184a200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1844072330 con 0x7f18440aeb90 2024-04-25T09:03:45.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.181+0000 7f1843e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f18440ce2b0 0x7f18440cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.181+0000 7f183aa00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f18440aef70 0x7f18440cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34022/0 (socket says 172.21.15.173:34022) 2024-04-25T09:03:45.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.181+0000 7f183aa00640 1 -- 172.21.15.173:0/1572021438 learned_addr learned my addr 172.21.15.173:0/1572021438 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:45.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.181+0000 7f1843400640 1 --2- 172.21.15.173:0/1572021438 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18440aeb90 0x7f18440cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.181+0000 7f1843e00640 1 -- 172.21.15.173:0/1572021438 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18440aeb90 msgr2=0x7f18440cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:45.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.181+0000 7f1843e00640 1 --2- 172.21.15.173:0/1572021438 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18440aeb90 0x7f18440cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.181+0000 7f1843e00640 1 -- 172.21.15.173:0/1572021438 >> v1:172.21.15.173:6789/0 conn(0x7f18440aef70 legacy=0x7f18440cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.181+0000 7f1843e00640 1 -- 172.21.15.173:0/1572021438 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1844071850 con 0x7f18440ce2b0 2024-04-25T09:03:45.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.181+0000 7f1842a00640 1 -- 172.21.15.173:0/1572021438 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045785947 0 0) 0x7f1844071570 con 0x7f18440aef70 2024-04-25T09:03:45.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.185+0000 7f1843e00640 1 --2- 172.21.15.173:0/1572021438 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18440ce2b0 0x7f18440cc610 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f183c009d90 tx=0x7f183c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdefff57370c65d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.185+0000 7f1842a00640 1 -- 172.21.15.173:0/1572021438 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c0b2070 con 0x7f18440ce2b0 2024-04-25T09:03:45.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.185+0000 7f1842a00640 1 -- 172.21.15.173:0/1572021438 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c0a5870 con 0x7f18440ce2b0 2024-04-25T09:03:45.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.185+0000 7f1842a00640 1 -- 172.21.15.173:0/1572021438 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c0a5c40 con 0x7f18440ce2b0 2024-04-25T09:03:45.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.185+0000 7f184a200640 1 -- 172.21.15.173:0/1572021438 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18440ce2b0 msgr2=0x7f18440cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.185+0000 7f184a200640 1 --2- 172.21.15.173:0/1572021438 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18440ce2b0 0x7f18440cc610 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f183c009d90 tx=0x7f183c01c8b0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.185+0000 7f184a200640 1 -- 172.21.15.173:0/1572021438 shutdown_connections 2024-04-25T09:03:45.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.185+0000 7f184a200640 1 --2- 172.21.15.173:0/1572021438 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18440ce2b0 0x7f18440cc610 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.185+0000 7f184a200640 1 --2- 172.21.15.173:0/1572021438 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18440aeb90 0x7f18440cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.185+0000 7f184a200640 1 -- 172.21.15.173:0/1572021438 >> 172.21.15.173:0/1572021438 conn(0x7f184406ac90 msgr2=0x7f184406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:45.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.185+0000 7f184a200640 1 -- 172.21.15.173:0/1572021438 shutdown_connections 2024-04-25T09:03:45.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.185+0000 7f184a200640 1 -- 172.21.15.173:0/1572021438 wait complete. 2024-04-25T09:03:45.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.185+0000 7f184a200640 1 Processor -- start 2024-04-25T09:03:45.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.185+0000 7f184a200640 1 -- start start 2024-04-25T09:03:45.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f184a200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18440aeb90 0x7f1844148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f184a200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18440aef70 0x7f1844145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f184a200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18440ce2b0 0x7f1844147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f184a200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184415bb30 con 0x7f18440aeb90 2024-04-25T09:03:45.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f184a200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184415b9b0 con 0x7f18440ce2b0 2024-04-25T09:03:45.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f184a200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184415bcb0 con 0x7f18440aef70 2024-04-25T09:03:45.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f1843400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18440aeb90 0x7f1844148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f1843400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18440aeb90 0x7f1844148af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59334/0 (socket says 172.21.15.173:59334) 2024-04-25T09:03:45.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f1843400640 1 -- 172.21.15.173:0/1768258694 learned_addr learned my addr 172.21.15.173:0/1768258694 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:45.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f1843e00640 1 --2- 172.21.15.173:0/1768258694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18440ce2b0 0x7f1844147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f183aa00640 1 --2- 172.21.15.173:0/1768258694 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18440aef70 0x7f1844145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f1843400640 1 -- 172.21.15.173:0/1768258694 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18440aef70 msgr2=0x7f1844145750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f1843400640 1 --2- 172.21.15.173:0/1768258694 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18440aef70 0x7f1844145750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f1843400640 1 -- 172.21.15.173:0/1768258694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18440ce2b0 msgr2=0x7f1844147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f1843400640 1 --2- 172.21.15.173:0/1768258694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18440ce2b0 0x7f1844147870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f1843400640 1 -- 172.21.15.173:0/1768258694 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1844152410 con 0x7f18440aeb90 2024-04-25T09:03:45.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f183aa00640 1 --2- 172.21.15.173:0/1768258694 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18440aef70 0x7f1844145750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:45.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f1843400640 1 --2- 172.21.15.173:0/1768258694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18440aeb90 0x7f1844148af0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f183400e870 tx=0x7f183400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f183be00640 1 -- 172.21.15.173:0/1768258694 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834017070 con 0x7f18440aeb90 2024-04-25T09:03:45.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f183be00640 1 -- 172.21.15.173:0/1768258694 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183400c940 con 0x7f18440aeb90 2024-04-25T09:03:45.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f183be00640 1 -- 172.21.15.173:0/1768258694 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183400ccf0 con 0x7f18440aeb90 2024-04-25T09:03:45.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f184a200640 1 -- 172.21.15.173:0/1768258694 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18441526f0 con 0x7f18440aeb90 2024-04-25T09:03:45.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f184a200640 1 -- 172.21.15.173:0/1768258694 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1844147070 con 0x7f18440aeb90 2024-04-25T09:03:45.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f184a200640 1 -- 172.21.15.173:0/1768258694 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1844073ab0 con 0x7f18440aeb90 2024-04-25T09:03:45.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.189+0000 7f183be00640 1 -- 172.21.15.173:0/1768258694 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f183401a070 con 0x7f18440aeb90 2024-04-25T09:03:45.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.193+0000 7f183be00640 1 --2- 172.21.15.173:0/1768258694 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1820066f60 0x7f1820069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.193+0000 7f183be00640 1 -- 172.21.15.173:0/1768258694 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f18340855b0 con 0x7f18440aeb90 2024-04-25T09:03:45.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.193+0000 7f183aa00640 1 --2- 172.21.15.173:0/1768258694 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1820066f60 0x7f1820069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.193+0000 7f183aa00640 1 --2- 172.21.15.173:0/1768258694 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1820066f60 0x7f1820069420 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f182c007fd0 tx=0x7f182c007c20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.197+0000 7f183be00640 1 -- 172.21.15.173:0/1768258694 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1834055b60 con 0x7f18440aeb90 2024-04-25T09:03:45.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.361+0000 7f184a200640 1 -- 172.21.15.173:0/1768258694 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f18441488d0 con 0x7f18440aeb90 2024-04-25T09:03:45.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.361+0000 7f183be00640 1 -- 172.21.15.173:0/1768258694 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1834059c00 con 0x7f18440aeb90 2024-04-25T09:03:45.352 INFO:teuthology.orchestra.run.smithi173.stderr:listed 0 entries 2024-04-25T09:03:45.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.365+0000 7f184a200640 1 -- 172.21.15.173:0/1768258694 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1820066f60 msgr2=0x7f1820069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.365+0000 7f184a200640 1 --2- 172.21.15.173:0/1768258694 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1820066f60 0x7f1820069420 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f182c007fd0 tx=0x7f182c007c20 comp rx=0 tx=0).stop 2024-04-25T09:03:45.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.365+0000 7f184a200640 1 -- 172.21.15.173:0/1768258694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18440aeb90 msgr2=0x7f1844148af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.365+0000 7f184a200640 1 --2- 172.21.15.173:0/1768258694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18440aeb90 0x7f1844148af0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f183400e870 tx=0x7f183400ec70 comp rx=0 tx=0).stop 2024-04-25T09:03:45.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.365+0000 7f184a200640 1 -- 172.21.15.173:0/1768258694 shutdown_connections 2024-04-25T09:03:45.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.365+0000 7f184a200640 1 --2- 172.21.15.173:0/1768258694 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1820066f60 0x7f1820069420 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.365+0000 7f184a200640 1 --2- 172.21.15.173:0/1768258694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18440ce2b0 0x7f1844147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.365+0000 7f184a200640 1 --2- 172.21.15.173:0/1768258694 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18440aef70 0x7f1844145750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.365+0000 7f184a200640 1 --2- 172.21.15.173:0/1768258694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18440aeb90 0x7f1844148af0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.365+0000 7f184a200640 1 -- 172.21.15.173:0/1768258694 >> 172.21.15.173:0/1768258694 conn(0x7f184406ac90 msgr2=0x7f18441512a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:45.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.365+0000 7f184a200640 1 -- 172.21.15.173:0/1768258694 shutdown_connections 2024-04-25T09:03:45.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.365+0000 7f184a200640 1 -- 172.21.15.173:0/1768258694 wait complete. 2024-04-25T09:03:45.374 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-25T09:03:45.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:45.374 DEBUG:teuthology.orchestra.run.smithi173:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-25T09:03:45.397 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:03:45.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:45.397 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-25T09:03:45.450 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:03:45.450 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:45.459 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:03:45.459 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:45.511 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:03:45.511 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:45.563 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:45.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.709+0000 7f854b000640 1 Processor -- start 2024-04-25T09:03:45.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.709+0000 7f854b000640 1 -- start start 2024-04-25T09:03:45.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.709+0000 7f854b000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f854415dbb0 0x7f854415df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.709+0000 7f854b000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f854406d870 con 0x7f854406f830 2024-04-25T09:03:45.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.709+0000 7f854b000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8544161690 con 0x7f85440d2130 2024-04-25T09:03:45.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.709+0000 7f854b000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85440d2590 con 0x7f854415dbb0 2024-04-25T09:03:45.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.709+0000 7f8543e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f854415dbb0 0x7f854415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.709+0000 7f8549000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f854406f830 0x7f8544161b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34032/0 (socket says 172.21.15.173:34032) 2024-04-25T09:03:45.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.709+0000 7f8549000640 1 -- 172.21.15.173:0/2537489791 learned_addr learned my addr 172.21.15.173:0/2537489791 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:45.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.709+0000 7f8543e00640 1 -- 172.21.15.173:0/2537489791 >> v1:172.21.15.194:6789/0 conn(0x7f85440d2130 legacy=0x7f854406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:45.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.709+0000 7f8542a00640 1 -- 172.21.15.173:0/2537489791 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142903801 0 0) 0x7f854406d870 con 0x7f854406f830 2024-04-25T09:03:45.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.709+0000 7f8543e00640 1 -- 172.21.15.173:0/2537489791 >> v1:172.21.15.173:6789/0 conn(0x7f854406f830 legacy=0x7f8544161b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.709+0000 7f8543e00640 1 -- 172.21.15.173:0/2537489791 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854415e5c0 con 0x7f854415dbb0 2024-04-25T09:03:45.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.713+0000 7f8543e00640 1 --2- 172.21.15.173:0/2537489791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f854415dbb0 0x7f854415df90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f85340097c0 tx=0x7f853401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97c05b814caa13b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.713+0000 7f8542a00640 1 -- 172.21.15.173:0/2537489791 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85340ab430 con 0x7f854415dbb0 2024-04-25T09:03:45.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.713+0000 7f8542a00640 1 -- 172.21.15.173:0/2537489791 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85340b0070 con 0x7f854415dbb0 2024-04-25T09:03:45.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.713+0000 7f8542a00640 1 -- 172.21.15.173:0/2537489791 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85340ab7f0 con 0x7f854415dbb0 2024-04-25T09:03:45.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.713+0000 7f854b000640 1 -- 172.21.15.173:0/2537489791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f854415dbb0 msgr2=0x7f854415df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.713+0000 7f854b000640 1 --2- 172.21.15.173:0/2537489791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f854415dbb0 0x7f854415df90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f85340097c0 tx=0x7f853401c430 comp rx=0 tx=0).stop 2024-04-25T09:03:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.713+0000 7f854b000640 1 -- 172.21.15.173:0/2537489791 shutdown_connections 2024-04-25T09:03:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.713+0000 7f854b000640 1 --2- 172.21.15.173:0/2537489791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f854415dbb0 0x7f854415df90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.713+0000 7f854b000640 1 -- 172.21.15.173:0/2537489791 >> 172.21.15.173:0/2537489791 conn(0x7f8544061880 msgr2=0x7f8544061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.713+0000 7f854b000640 1 -- 172.21.15.173:0/2537489791 shutdown_connections 2024-04-25T09:03:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.713+0000 7f854b000640 1 -- 172.21.15.173:0/2537489791 wait complete. 2024-04-25T09:03:45.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f854b000640 1 Processor -- start 2024-04-25T09:03:45.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f854b000640 1 -- start start 2024-04-25T09:03:45.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f854b000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f854406f830 0x7f85440b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f854b000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85440d2130 0x7f8544156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f854b000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f854415dbb0 0x7f85441605a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f854b000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8544070070 con 0x7f85440d2130 2024-04-25T09:03:45.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f854b000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854415ee60 con 0x7f854406f830 2024-04-25T09:03:45.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f854b000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854416c1b0 con 0x7f854415dbb0 2024-04-25T09:03:45.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f8543400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85440d2130 0x7f8544156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f8543400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85440d2130 0x7f8544156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59354/0 (socket says 172.21.15.173:59354) 2024-04-25T09:03:45.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f8543400640 1 -- 172.21.15.173:0/3781896293 learned_addr learned my addr 172.21.15.173:0/3781896293 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:45.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f8543e00640 1 --2- 172.21.15.173:0/3781896293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f854406f830 0x7f85440b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f8549000640 1 --2- 172.21.15.173:0/3781896293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f854415dbb0 0x7f85441605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f8543400640 1 -- 172.21.15.173:0/3781896293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f854415dbb0 msgr2=0x7f85441605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f8543400640 1 --2- 172.21.15.173:0/3781896293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f854415dbb0 0x7f85441605a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f8543400640 1 -- 172.21.15.173:0/3781896293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f854406f830 msgr2=0x7f85440b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f8543400640 1 --2- 172.21.15.173:0/3781896293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f854406f830 0x7f85440b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f8543400640 1 -- 172.21.15.173:0/3781896293 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8544155d80 con 0x7f85440d2130 2024-04-25T09:03:45.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f8543400640 1 --2- 172.21.15.173:0/3781896293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85440d2130 0x7f8544156500 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f852c00c480 tx=0x7f852c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f853be00640 1 -- 172.21.15.173:0/3781896293 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c012830 con 0x7f85440d2130 2024-04-25T09:03:45.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f853be00640 1 -- 172.21.15.173:0/3781896293 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852c017070 con 0x7f85440d2130 2024-04-25T09:03:45.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f854b000640 1 -- 172.21.15.173:0/3781896293 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85441590e0 con 0x7f85440d2130 2024-04-25T09:03:45.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f853be00640 1 -- 172.21.15.173:0/3781896293 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c012c30 con 0x7f85440d2130 2024-04-25T09:03:45.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.717+0000 7f854b000640 1 -- 172.21.15.173:0/3781896293 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85441596a0 con 0x7f85440d2130 2024-04-25T09:03:45.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.721+0000 7f854b000640 1 -- 172.21.15.173:0/3781896293 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8544073a40 con 0x7f85440d2130 2024-04-25T09:03:45.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.721+0000 7f853be00640 1 -- 172.21.15.173:0/3781896293 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f852c01c460 con 0x7f85440d2130 2024-04-25T09:03:45.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.721+0000 7f853be00640 1 --2- 172.21.15.173:0/3781896293 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8520066f60 0x7f8520069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.721+0000 7f853be00640 1 -- 172.21.15.173:0/3781896293 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f852c085120 con 0x7f85440d2130 2024-04-25T09:03:45.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.721+0000 7f8543e00640 1 --2- 172.21.15.173:0/3781896293 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8520066f60 0x7f8520069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.721+0000 7f8543e00640 1 --2- 172.21.15.173:0/3781896293 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8520066f60 0x7f8520069420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f85340af000 tx=0x7f85340a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.725+0000 7f853be00640 1 -- 172.21.15.173:0/3781896293 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f852c0556d0 con 0x7f85440d2130 2024-04-25T09:03:45.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.881+0000 7f854b000640 1 -- 172.21.15.173:0/3781896293 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85440cf020 con 0x7f85440d2130 2024-04-25T09:03:45.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.881+0000 7f853be00640 1 -- 172.21.15.173:0/3781896293 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18906 (secure 0 0 0) 0x7f852c059770 con 0x7f85440d2130 2024-04-25T09:03:45.873 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:45.873 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":28,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:03:32.190313+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.885+0000 7f854b000640 1 -- 172.21.15.173:0/3781896293 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8520066f60 msgr2=0x7f8520069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.885+0000 7f854b000640 1 --2- 172.21.15.173:0/3781896293 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8520066f60 0x7f8520069420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f85340af000 tx=0x7f85340a7000 comp rx=0 tx=0).stop 2024-04-25T09:03:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.885+0000 7f854b000640 1 -- 172.21.15.173:0/3781896293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85440d2130 msgr2=0x7f8544156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.885+0000 7f854b000640 1 --2- 172.21.15.173:0/3781896293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85440d2130 0x7f8544156500 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f852c00c480 tx=0x7f852c00c940 comp rx=0 tx=0).stop 2024-04-25T09:03:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.885+0000 7f854b000640 1 -- 172.21.15.173:0/3781896293 shutdown_connections 2024-04-25T09:03:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.885+0000 7f854b000640 1 --2- 172.21.15.173:0/3781896293 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8520066f60 0x7f8520069420 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.885+0000 7f854b000640 1 --2- 172.21.15.173:0/3781896293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f854415dbb0 0x7f85441605a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.885+0000 7f854b000640 1 --2- 172.21.15.173:0/3781896293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85440d2130 0x7f8544156500 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.885+0000 7f854b000640 1 --2- 172.21.15.173:0/3781896293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f854406f830 0x7f85440b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.885+0000 7f854b000640 1 -- 172.21.15.173:0/3781896293 >> 172.21.15.173:0/3781896293 conn(0x7f8544061880 msgr2=0x7f8544061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.885+0000 7f854b000640 1 -- 172.21.15.173:0/3781896293 shutdown_connections 2024-04-25T09:03:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:45.885+0000 7f854b000640 1 -- 172.21.15.173:0/3781896293 wait complete. 2024-04-25T09:03:45.894 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:02:49.342297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:02:50.386069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:02:54.077429+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:03:45.895 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:46.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.041+0000 7f9e0bc00640 1 Processor -- start 2024-04-25T09:03:46.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.041+0000 7f9e0bc00640 1 -- start start 2024-04-25T09:03:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.045+0000 7f9e0bc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040aeb90 0x7f9e040cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.045+0000 7f9e0bc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9e040ce2b0 0x7f9e040cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.045+0000 7f9e0bc00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e04071570 con 0x7f9e040aef70 2024-04-25T09:03:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.045+0000 7f9e0bc00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e04071320 con 0x7f9e040ce2b0 2024-04-25T09:03:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.045+0000 7f9e0bc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e04072330 con 0x7f9e040aeb90 2024-04-25T09:03:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.045+0000 7f9e09c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9e040ce2b0 0x7f9e040cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.045+0000 7f9e03e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f9e040aef70 0x7f9e040cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34042/0 (socket says 172.21.15.173:34042) 2024-04-25T09:03:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.045+0000 7f9e03e00640 1 -- 172.21.15.173:0/1526102331 learned_addr learned my addr 172.21.15.173:0/1526102331 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.045+0000 7f9e09200640 1 --2- 172.21.15.173:0/1526102331 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040aeb90 0x7f9e040cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.045+0000 7f9e09c00640 1 -- 172.21.15.173:0/1526102331 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040aeb90 msgr2=0x7f9e040cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.045+0000 7f9e09c00640 1 --2- 172.21.15.173:0/1526102331 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040aeb90 0x7f9e040cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.045+0000 7f9e09c00640 1 -- 172.21.15.173:0/1526102331 >> v1:172.21.15.173:6789/0 conn(0x7f9e040aef70 legacy=0x7f9e040cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.045+0000 7f9e09c00640 1 -- 172.21.15.173:0/1526102331 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e04071850 con 0x7f9e040ce2b0 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.045+0000 7f9e03400640 1 -- 172.21.15.173:0/1526102331 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556004948 0 0) 0x7f9e04071570 con 0x7f9e040aef70 2024-04-25T09:03:46.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.049+0000 7f9e09c00640 1 --2- 172.21.15.173:0/1526102331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e040ce2b0 0x7f9e040cc610 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0097c0 tx=0x7f9dfc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2842ceadd313f84 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.049+0000 7f9e03400640 1 -- 172.21.15.173:0/1526102331 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc0b0070 con 0x7f9e040ce2b0 2024-04-25T09:03:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.049+0000 7f9e03400640 1 -- 172.21.15.173:0/1526102331 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc0ab600 con 0x7f9e040ce2b0 2024-04-25T09:03:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.049+0000 7f9e03400640 1 -- 172.21.15.173:0/1526102331 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc0ab9d0 con 0x7f9e040ce2b0 2024-04-25T09:03:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.049+0000 7f9e0bc00640 1 -- 172.21.15.173:0/1526102331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e040ce2b0 msgr2=0x7f9e040cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.049+0000 7f9e0bc00640 1 --2- 172.21.15.173:0/1526102331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e040ce2b0 0x7f9e040cc610 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0097c0 tx=0x7f9dfc01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.049+0000 7f9e0bc00640 1 -- 172.21.15.173:0/1526102331 shutdown_connections 2024-04-25T09:03:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.049+0000 7f9e0bc00640 1 --2- 172.21.15.173:0/1526102331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e040ce2b0 0x7f9e040cc610 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.049+0000 7f9e0bc00640 1 --2- 172.21.15.173:0/1526102331 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040aeb90 0x7f9e040cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.049+0000 7f9e0bc00640 1 -- 172.21.15.173:0/1526102331 >> 172.21.15.173:0/1526102331 conn(0x7f9e0406ac90 msgr2=0x7f9e0406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.049+0000 7f9e0bc00640 1 -- 172.21.15.173:0/1526102331 shutdown_connections 2024-04-25T09:03:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.049+0000 7f9e0bc00640 1 -- 172.21.15.173:0/1526102331 wait complete. 2024-04-25T09:03:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.049+0000 7f9e0bc00640 1 Processor -- start 2024-04-25T09:03:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.049+0000 7f9e0bc00640 1 -- start start 2024-04-25T09:03:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e0bc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e040aeb90 0x7f9e0415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e0bc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040aef70 0x7f9e041419a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e0bc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e040ce2b0 0x7f9e04156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e0bc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0415bb30 con 0x7f9e040aeb90 2024-04-25T09:03:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e0bc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0415b9b0 con 0x7f9e040ce2b0 2024-04-25T09:03:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e0bc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0415bcb0 con 0x7f9e040aef70 2024-04-25T09:03:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e09200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e040aeb90 0x7f9e0415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e09200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e040aeb90 0x7f9e0415a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59372/0 (socket says 172.21.15.173:59372) 2024-04-25T09:03:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e09200640 1 -- 172.21.15.173:0/2542119018 learned_addr learned my addr 172.21.15.173:0/2542119018 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e03e00640 1 --2- 172.21.15.173:0/2542119018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040aef70 0x7f9e041419a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e09200640 1 -- 172.21.15.173:0/2542119018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040aef70 msgr2=0x7f9e041419a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e09200640 1 --2- 172.21.15.173:0/2542119018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040aef70 0x7f9e041419a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e09200640 1 -- 172.21.15.173:0/2542119018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e040ce2b0 msgr2=0x7f9e04156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e09200640 1 --2- 172.21.15.173:0/2542119018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e040ce2b0 0x7f9e04156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e09200640 1 -- 172.21.15.173:0/2542119018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e04142460 con 0x7f9e040aeb90 2024-04-25T09:03:46.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e09200640 1 --2- 172.21.15.173:0/2542119018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e040aeb90 0x7f9e0415a1a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9df4007e40 tx=0x7f9df400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e00c00640 1 -- 172.21.15.173:0/2542119018 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4014620 con 0x7f9e040aeb90 2024-04-25T09:03:46.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e00c00640 1 -- 172.21.15.173:0/2542119018 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df4019070 con 0x7f9e040aeb90 2024-04-25T09:03:46.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e0bc00640 1 -- 172.21.15.173:0/2542119018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e04142740 con 0x7f9e040aeb90 2024-04-25T09:03:46.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e00c00640 1 -- 172.21.15.173:0/2542119018 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4014a00 con 0x7f9e040aeb90 2024-04-25T09:03:46.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e0bc00640 1 -- 172.21.15.173:0/2542119018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e04140fa0 con 0x7f9e040aeb90 2024-04-25T09:03:46.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e0bc00640 1 -- 172.21.15.173:0/2542119018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e04073ab0 con 0x7f9e040aeb90 2024-04-25T09:03:46.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.053+0000 7f9e00c00640 1 -- 172.21.15.173:0/2542119018 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9df4014ba0 con 0x7f9e040aeb90 2024-04-25T09:03:46.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.057+0000 7f9e00c00640 1 --2- 172.21.15.173:0/2542119018 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9de4066f60 0x7f9de4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.057+0000 7f9e00c00640 1 -- 172.21.15.173:0/2542119018 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f9df4085c90 con 0x7f9e040aeb90 2024-04-25T09:03:46.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.057+0000 7f9e03e00640 1 --2- 172.21.15.173:0/2542119018 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9de4066f60 0x7f9de4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.057+0000 7f9e03e00640 1 --2- 172.21.15.173:0/2542119018 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9de4066f60 0x7f9de4069420 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9e04072ad0 tx=0x7f9df0007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.061+0000 7f9e00c00640 1 -- 172.21.15.173:0/2542119018 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9df40568a0 con 0x7f9e040aeb90 2024-04-25T09:03:46.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.213+0000 7f9e0bc00640 1 -- 172.21.15.173:0/2542119018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e0406b480 con 0x7f9e040aeb90 2024-04-25T09:03:46.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.213+0000 7f9e00c00640 1 -- 172.21.15.173:0/2542119018 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9df40561a0 con 0x7f9e040aeb90 2024-04-25T09:03:46.203 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:03:46.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.213+0000 7f9e0bc00640 1 -- 172.21.15.173:0/2542119018 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9de4066f60 msgr2=0x7f9de4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.213+0000 7f9e0bc00640 1 --2- 172.21.15.173:0/2542119018 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9de4066f60 0x7f9de4069420 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9e04072ad0 tx=0x7f9df0007b60 comp rx=0 tx=0).stop 2024-04-25T09:03:46.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.213+0000 7f9e0bc00640 1 -- 172.21.15.173:0/2542119018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e040aeb90 msgr2=0x7f9e0415a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.213+0000 7f9e0bc00640 1 --2- 172.21.15.173:0/2542119018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e040aeb90 0x7f9e0415a1a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9df4007e40 tx=0x7f9df400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.213+0000 7f9e0bc00640 1 -- 172.21.15.173:0/2542119018 shutdown_connections 2024-04-25T09:03:46.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.213+0000 7f9e0bc00640 1 --2- 172.21.15.173:0/2542119018 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9de4066f60 0x7f9de4069420 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.213+0000 7f9e0bc00640 1 --2- 172.21.15.173:0/2542119018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e040ce2b0 0x7f9e04156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.213+0000 7f9e0bc00640 1 --2- 172.21.15.173:0/2542119018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040aef70 0x7f9e041419a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.213+0000 7f9e0bc00640 1 --2- 172.21.15.173:0/2542119018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e040aeb90 0x7f9e0415a1a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.213+0000 7f9e0bc00640 1 -- 172.21.15.173:0/2542119018 >> 172.21.15.173:0/2542119018 conn(0x7f9e0406ac90 msgr2=0x7f9e0406e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.213+0000 7f9e0bc00640 1 -- 172.21.15.173:0/2542119018 shutdown_connections 2024-04-25T09:03:46.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.213+0000 7f9e0bc00640 1 -- 172.21.15.173:0/2542119018 wait complete. 2024-04-25T09:03:46.224 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:46.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.373+0000 7f9b6e600640 1 Processor -- start 2024-04-25T09:03:46.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.373+0000 7f9b6e600640 1 -- start start 2024-04-25T09:03:46.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.373+0000 7f9b6e600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9b680aeb90 0x7f9b680cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.373+0000 7f9b6e600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9b680ce2b0 0x7f9b680cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.373+0000 7f9b6e600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b68071570 con 0x7f9b680aef70 2024-04-25T09:03:46.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.373+0000 7f9b6e600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b68071320 con 0x7f9b680aeb90 2024-04-25T09:03:46.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.373+0000 7f9b6e600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b68072330 con 0x7f9b680ce2b0 2024-04-25T09:03:46.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.373+0000 7f9b67400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9b680aeb90 0x7f9b680cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.377+0000 7f9b67400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9b680aeb90 0x7f9b680cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59382/0 (socket says 172.21.15.173:59382) 2024-04-25T09:03:46.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.377+0000 7f9b67400640 1 -- 172.21.15.173:0/2280950458 learned_addr learned my addr 172.21.15.173:0/2280950458 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:46.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.377+0000 7f9b67e00640 1 --2- 172.21.15.173:0/2280950458 >> v2:172.21.15.194:3300/0 conn(0x7f9b680ce2b0 0x7f9b680cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.377+0000 7f9b67400640 1 -- 172.21.15.173:0/2280950458 >> v2:172.21.15.194:3300/0 conn(0x7f9b680ce2b0 msgr2=0x7f9b680cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:46.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.377+0000 7f9b67400640 1 --2- 172.21.15.173:0/2280950458 >> v2:172.21.15.194:3300/0 conn(0x7f9b680ce2b0 0x7f9b680cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.377+0000 7f9b67400640 1 -- 172.21.15.173:0/2280950458 >> v1:172.21.15.194:6789/0 conn(0x7f9b680aef70 legacy=0x7f9b680cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:46.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.377+0000 7f9b67400640 1 -- 172.21.15.173:0/2280950458 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b68071850 con 0x7f9b680aeb90 2024-04-25T09:03:46.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.377+0000 7f9b67400640 1 --2- 172.21.15.173:0/2280950458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b680aeb90 0x7f9b680cc0d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9b6815e4f0 tx=0x7f9b5801eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f39a99608a56c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.377+0000 7f9b66a00640 1 -- 172.21.15.173:0/2280950458 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b580b4070 con 0x7f9b680aeb90 2024-04-25T09:03:46.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.377+0000 7f9b66a00640 1 -- 172.21.15.173:0/2280950458 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b580a7ac0 con 0x7f9b680aeb90 2024-04-25T09:03:46.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.377+0000 7f9b66a00640 1 -- 172.21.15.173:0/2280950458 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b580af440 con 0x7f9b680aeb90 2024-04-25T09:03:46.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b6e600640 1 -- 172.21.15.173:0/2280950458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b680aeb90 msgr2=0x7f9b680cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b6e600640 1 --2- 172.21.15.173:0/2280950458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b680aeb90 0x7f9b680cc0d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9b6815e4f0 tx=0x7f9b5801eaf0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b6e600640 1 -- 172.21.15.173:0/2280950458 shutdown_connections 2024-04-25T09:03:46.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b6e600640 1 --2- 172.21.15.173:0/2280950458 >> v2:172.21.15.194:3300/0 conn(0x7f9b680ce2b0 0x7f9b680cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b6e600640 1 --2- 172.21.15.173:0/2280950458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b680aeb90 0x7f9b680cc0d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b6e600640 1 -- 172.21.15.173:0/2280950458 >> 172.21.15.173:0/2280950458 conn(0x7f9b6806ac90 msgr2=0x7f9b6806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b6e600640 1 -- 172.21.15.173:0/2280950458 shutdown_connections 2024-04-25T09:03:46.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b6e600640 1 -- 172.21.15.173:0/2280950458 wait complete. 2024-04-25T09:03:46.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b6e600640 1 Processor -- start 2024-04-25T09:03:46.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b6e600640 1 -- start start 2024-04-25T09:03:46.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b6e600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b680aeb90 0x7f9b680c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b6e600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b680aef70 0x7f9b6813f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b6e600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b680ce2b0 0x7f9b6814fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b6e600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6815bb30 con 0x7f9b680ce2b0 2024-04-25T09:03:46.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b6e600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6815b9b0 con 0x7f9b680aeb90 2024-04-25T09:03:46.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b6e600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6815bcb0 con 0x7f9b680aef70 2024-04-25T09:03:46.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b67e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b680ce2b0 0x7f9b6814fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b67e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b680ce2b0 0x7f9b6814fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59394/0 (socket says 172.21.15.173:59394) 2024-04-25T09:03:46.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b67e00640 1 -- 172.21.15.173:0/369249903 learned_addr learned my addr 172.21.15.173:0/369249903 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:46.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b67400640 1 --2- 172.21.15.173:0/369249903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b680aeb90 0x7f9b680c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b5ea00640 1 --2- 172.21.15.173:0/369249903 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b680aef70 0x7f9b6813f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b67e00640 1 -- 172.21.15.173:0/369249903 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b680aef70 msgr2=0x7f9b6813f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b67e00640 1 --2- 172.21.15.173:0/369249903 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b680aef70 0x7f9b6813f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b67e00640 1 -- 172.21.15.173:0/369249903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b680aeb90 msgr2=0x7f9b680c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b67e00640 1 --2- 172.21.15.173:0/369249903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b680aeb90 0x7f9b680c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b67e00640 1 -- 172.21.15.173:0/369249903 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b680ae710 con 0x7f9b680ce2b0 2024-04-25T09:03:46.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b5ea00640 1 --2- 172.21.15.173:0/369249903 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b680aef70 0x7f9b6813f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:46.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.381+0000 7f9b67e00640 1 --2- 172.21.15.173:0/369249903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b680ce2b0 0x7f9b6814fde0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9b60007e70 tx=0x7f9b6000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.385+0000 7f9b5fe00640 1 -- 172.21.15.173:0/369249903 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b60014620 con 0x7f9b680ce2b0 2024-04-25T09:03:46.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.385+0000 7f9b5fe00640 1 -- 172.21.15.173:0/369249903 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b60019070 con 0x7f9b680ce2b0 2024-04-25T09:03:46.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.385+0000 7f9b6e600640 1 -- 172.21.15.173:0/369249903 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b680c48c0 con 0x7f9b680ce2b0 2024-04-25T09:03:46.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.385+0000 7f9b5fe00640 1 -- 172.21.15.173:0/369249903 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b60014a20 con 0x7f9b680ce2b0 2024-04-25T09:03:46.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.385+0000 7f9b6e600640 1 -- 172.21.15.173:0/369249903 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6813f540 con 0x7f9b680ce2b0 2024-04-25T09:03:46.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.385+0000 7f9b6e600640 1 -- 172.21.15.173:0/369249903 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b680c46e0 con 0x7f9b680ce2b0 2024-04-25T09:03:46.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.385+0000 7f9b5fe00640 1 -- 172.21.15.173:0/369249903 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9b60014bc0 con 0x7f9b680ce2b0 2024-04-25T09:03:46.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.385+0000 7f9b5fe00640 1 --2- 172.21.15.173:0/369249903 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9b44066f60 0x7f9b44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.385+0000 7f9b5fe00640 1 -- 172.21.15.173:0/369249903 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f9b60085be0 con 0x7f9b680ce2b0 2024-04-25T09:03:46.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.385+0000 7f9b67400640 1 --2- 172.21.15.173:0/369249903 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9b44066f60 0x7f9b44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.385+0000 7f9b67400640 1 --2- 172.21.15.173:0/369249903 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9b44066f60 0x7f9b44069420 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9b580b1000 tx=0x7f9b580a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.389+0000 7f9b5fe00640 1 -- 172.21.15.173:0/369249903 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9b680c46e0 con 0x7f9b680ce2b0 2024-04-25T09:03:46.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.541+0000 7f9b6e600640 1 -- 172.21.15.173:0/369249903 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9b68073ab0 con 0x7f9b680ce2b0 2024-04-25T09:03:46.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.541+0000 7f9b5fe00640 1 -- 172.21.15.173:0/369249903 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9b60056880 con 0x7f9b680ce2b0 2024-04-25T09:03:46.533 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:46.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.545+0000 7f9b6e600640 1 -- 172.21.15.173:0/369249903 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9b44066f60 msgr2=0x7f9b44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.545+0000 7f9b6e600640 1 --2- 172.21.15.173:0/369249903 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9b44066f60 0x7f9b44069420 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9b580b1000 tx=0x7f9b580a9070 comp rx=0 tx=0).stop 2024-04-25T09:03:46.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.545+0000 7f9b6e600640 1 -- 172.21.15.173:0/369249903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b680ce2b0 msgr2=0x7f9b6814fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.545+0000 7f9b6e600640 1 --2- 172.21.15.173:0/369249903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b680ce2b0 0x7f9b6814fde0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9b60007e70 tx=0x7f9b6000e4b0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.545+0000 7f9b6e600640 1 -- 172.21.15.173:0/369249903 shutdown_connections 2024-04-25T09:03:46.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.545+0000 7f9b6e600640 1 --2- 172.21.15.173:0/369249903 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9b44066f60 0x7f9b44069420 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.545+0000 7f9b6e600640 1 --2- 172.21.15.173:0/369249903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b680ce2b0 0x7f9b6814fde0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.545+0000 7f9b6e600640 1 --2- 172.21.15.173:0/369249903 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b680aef70 0x7f9b6813f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.545+0000 7f9b6e600640 1 --2- 172.21.15.173:0/369249903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b680aeb90 0x7f9b680c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.545+0000 7f9b6e600640 1 -- 172.21.15.173:0/369249903 >> 172.21.15.173:0/369249903 conn(0x7f9b6806ac90 msgr2=0x7f9b6815c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.545+0000 7f9b6e600640 1 -- 172.21.15.173:0/369249903 shutdown_connections 2024-04-25T09:03:46.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.545+0000 7f9b6e600640 1 -- 172.21.15.173:0/369249903 wait complete. 2024-04-25T09:03:46.554 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:46.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.701+0000 7f3e8a600640 1 Processor -- start 2024-04-25T09:03:46.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.701+0000 7f3e8a600640 1 -- start start 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.701+0000 7f3e8a600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e840aeb90 0x7f3e840cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.701+0000 7f3e8a600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3e840aef70 0x7f3e840cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.701+0000 7f3e8a600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3e840cdba0 0x7f3e840ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.701+0000 7f3e8a600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e84071320 con 0x7f3e840cdba0 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.701+0000 7f3e8a600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e84072330 con 0x7f3e840aef70 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.701+0000 7f3e8a600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e840ce550 con 0x7f3e840aeb90 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.701+0000 7f3e83e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3e840cdba0 0x7f3e840ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.701+0000 7f3e83e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3e840cdba0 0x7f3e840ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59406/0 (socket says 172.21.15.173:59406) 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.701+0000 7f3e83e00640 1 -- 172.21.15.173:0/3581284582 learned_addr learned my addr 172.21.15.173:0/3581284582 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:46.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.701+0000 7f3e83e00640 1 -- 172.21.15.173:0/3581284582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e840aeb90 msgr2=0x7f3e840cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.701+0000 7f3e83e00640 1 --2- 172.21.15.173:0/3581284582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e840aeb90 0x7f3e840cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.701+0000 7f3e83e00640 1 -- 172.21.15.173:0/3581284582 >> v2:172.21.15.194:3300/0 conn(0x7f3e840aef70 msgr2=0x7f3e840cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.701+0000 7f3e7be00640 1 --2- 172.21.15.173:0/3581284582 >> v2:172.21.15.194:3300/0 conn(0x7f3e840aef70 0x7f3e840cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.701+0000 7f3e83e00640 1 --2- 172.21.15.173:0/3581284582 >> v2:172.21.15.194:3300/0 conn(0x7f3e840aef70 0x7f3e840cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.701+0000 7f3e83e00640 1 -- 172.21.15.173:0/3581284582 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e84071570 con 0x7f3e840cdba0 2024-04-25T09:03:46.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.701+0000 7f3e7be00640 1 --2- 172.21.15.173:0/3581284582 >> v2:172.21.15.194:3300/0 conn(0x7f3e840aef70 0x7f3e840cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:46.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.705+0000 7f3e83e00640 1 --2- 172.21.15.173:0/3581284582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e840cdba0 0x7f3e840ce010 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3e8406b9e0 tx=0x7f3e7c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7437079cc0cf49d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.705+0000 7f3e82a00640 1 -- 172.21.15.173:0/3581284582 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c0a57b0 con 0x7f3e840cdba0 2024-04-25T09:03:46.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.705+0000 7f3e82a00640 1 -- 172.21.15.173:0/3581284582 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c0a5950 con 0x7f3e840cdba0 2024-04-25T09:03:46.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.705+0000 7f3e82a00640 1 -- 172.21.15.173:0/3581284582 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c0a5d20 con 0x7f3e840cdba0 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.705+0000 7f3e8a600640 1 -- 172.21.15.173:0/3581284582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e840cdba0 msgr2=0x7f3e840ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.705+0000 7f3e8a600640 1 --2- 172.21.15.173:0/3581284582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e840cdba0 0x7f3e840ce010 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3e8406b9e0 tx=0x7f3e7c01c930 comp rx=0 tx=0).stop 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.705+0000 7f3e8a600640 1 -- 172.21.15.173:0/3581284582 shutdown_connections 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.705+0000 7f3e8a600640 1 --2- 172.21.15.173:0/3581284582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e840cdba0 0x7f3e840ce010 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.705+0000 7f3e8a600640 1 --2- 172.21.15.173:0/3581284582 >> v2:172.21.15.194:3300/0 conn(0x7f3e840aef70 0x7f3e840cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.705+0000 7f3e8a600640 1 --2- 172.21.15.173:0/3581284582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e840aeb90 0x7f3e840cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.705+0000 7f3e8a600640 1 -- 172.21.15.173:0/3581284582 >> 172.21.15.173:0/3581284582 conn(0x7f3e8406ac90 msgr2=0x7f3e8406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.705+0000 7f3e8a600640 1 -- 172.21.15.173:0/3581284582 shutdown_connections 2024-04-25T09:03:46.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.705+0000 7f3e8a600640 1 -- 172.21.15.173:0/3581284582 wait complete. 2024-04-25T09:03:46.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e8a600640 1 Processor -- start 2024-04-25T09:03:46.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e8a600640 1 -- start start 2024-04-25T09:03:46.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e8a600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e840aeb90 0x7f3e8413bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e8a600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e840aef70 0x7f3e84158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e8a600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e840cdba0 0x7f3e8413ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e8a600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8415ef40 con 0x7f3e840aef70 2024-04-25T09:03:46.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e8a600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8415edc0 con 0x7f3e840cdba0 2024-04-25T09:03:46.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e8a600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8415f0c0 con 0x7f3e840aeb90 2024-04-25T09:03:46.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e7be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e840aef70 0x7f3e84158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e7be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e840aef70 0x7f3e84158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59422/0 (socket says 172.21.15.173:59422) 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e7be00640 1 -- 172.21.15.173:0/4028121805 learned_addr learned my addr 172.21.15.173:0/4028121805 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e83e00640 1 --2- 172.21.15.173:0/4028121805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e840cdba0 0x7f3e8413ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e83400640 1 --2- 172.21.15.173:0/4028121805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e840aeb90 0x7f3e8413bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e7be00640 1 -- 172.21.15.173:0/4028121805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e840aeb90 msgr2=0x7f3e8413bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e7be00640 1 --2- 172.21.15.173:0/4028121805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e840aeb90 0x7f3e8413bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e7be00640 1 -- 172.21.15.173:0/4028121805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e840cdba0 msgr2=0x7f3e8413ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e7be00640 1 --2- 172.21.15.173:0/4028121805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e840cdba0 0x7f3e8413ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e7be00640 1 -- 172.21.15.173:0/4028121805 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e84153480 con 0x7f3e840aef70 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e83400640 1 --2- 172.21.15.173:0/4028121805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e840aeb90 0x7f3e8413bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:46.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e7be00640 1 --2- 172.21.15.173:0/4028121805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e840aef70 0x7f3e84158db0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00c7f0 tx=0x7f3e6c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e7b400640 1 -- 172.21.15.173:0/4028121805 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c015070 con 0x7f3e840aef70 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e7b400640 1 -- 172.21.15.173:0/4028121805 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c007a30 con 0x7f3e840aef70 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e7b400640 1 -- 172.21.15.173:0/4028121805 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c007e00 con 0x7f3e840aef70 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e8a600640 1 -- 172.21.15.173:0/4028121805 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e84153740 con 0x7f3e840aef70 2024-04-25T09:03:46.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.709+0000 7f3e8a600640 1 -- 172.21.15.173:0/4028121805 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e84153d00 con 0x7f3e840aef70 2024-04-25T09:03:46.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.713+0000 7f3e8a600640 1 -- 172.21.15.173:0/4028121805 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e84073ab0 con 0x7f3e840aef70 2024-04-25T09:03:46.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.713+0000 7f3e7b400640 1 -- 172.21.15.173:0/4028121805 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3e6c018070 con 0x7f3e840aef70 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.713+0000 7f3e7b400640 1 --2- 172.21.15.173:0/4028121805 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3e60066f60 0x7f3e60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.713+0000 7f3e7b400640 1 -- 172.21.15.173:0/4028121805 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f3e6c085390 con 0x7f3e840aef70 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.713+0000 7f3e83400640 1 --2- 172.21.15.173:0/4028121805 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3e60066f60 0x7f3e60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.713+0000 7f3e83400640 1 --2- 172.21.15.173:0/4028121805 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3e60066f60 0x7f3e60069420 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3e74006fd0 tx=0x7f3e74008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.717+0000 7f3e7b400640 1 -- 172.21.15.173:0/4028121805 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3e6c0558b0 con 0x7f3e840aef70 2024-04-25T09:03:46.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.873+0000 7f3e8a600640 1 -- 172.21.15.173:0/4028121805 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e8414c6b0 con 0x7f3e840aef70 2024-04-25T09:03:46.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.873+0000 7f3e7b400640 1 -- 172.21.15.173:0/4028121805 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e6c059950 con 0x7f3e840aef70 2024-04-25T09:03:46.864 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:03:46.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.877+0000 7f3e8a600640 1 -- 172.21.15.173:0/4028121805 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3e60066f60 msgr2=0x7f3e60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.877+0000 7f3e8a600640 1 --2- 172.21.15.173:0/4028121805 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3e60066f60 0x7f3e60069420 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3e74006fd0 tx=0x7f3e74008040 comp rx=0 tx=0).stop 2024-04-25T09:03:46.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.877+0000 7f3e8a600640 1 -- 172.21.15.173:0/4028121805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e840aef70 msgr2=0x7f3e84158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.877+0000 7f3e8a600640 1 --2- 172.21.15.173:0/4028121805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e840aef70 0x7f3e84158db0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00c7f0 tx=0x7f3e6c00ccb0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.877+0000 7f3e8a600640 1 -- 172.21.15.173:0/4028121805 shutdown_connections 2024-04-25T09:03:46.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.877+0000 7f3e8a600640 1 --2- 172.21.15.173:0/4028121805 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3e60066f60 0x7f3e60069420 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.877+0000 7f3e8a600640 1 --2- 172.21.15.173:0/4028121805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e840cdba0 0x7f3e8413ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.877+0000 7f3e8a600640 1 --2- 172.21.15.173:0/4028121805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e840aef70 0x7f3e84158db0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.877+0000 7f3e8a600640 1 --2- 172.21.15.173:0/4028121805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e840aeb90 0x7f3e8413bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.877+0000 7f3e8a600640 1 -- 172.21.15.173:0/4028121805 >> 172.21.15.173:0/4028121805 conn(0x7f3e8406ac90 msgr2=0x7f3e84151300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.877+0000 7f3e8a600640 1 -- 172.21.15.173:0/4028121805 shutdown_connections 2024-04-25T09:03:46.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:46.877+0000 7f3e8a600640 1 -- 172.21.15.173:0/4028121805 wait complete. 2024-04-25T09:03:46.886 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:03:47.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.033+0000 7fe39f200640 1 Processor -- start 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.033+0000 7fe39f200640 1 -- start start 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.037+0000 7fe39f200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe39815db90 0x7fe398072bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.037+0000 7fe39f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe39806fba0 0x7fe398070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.037+0000 7fe39f200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39806b070 con 0x7fe39815df70 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.037+0000 7fe39f200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe398070550 con 0x7fe39815db90 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.037+0000 7fe39f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe398161bd0 con 0x7fe39806fba0 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.037+0000 7fe39de00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe39815db90 0x7fe398072bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.037+0000 7fe39de00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe39815db90 0x7fe398072bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59436/0 (socket says 172.21.15.173:59436) 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.037+0000 7fe39de00640 1 -- 172.21.15.173:0/694284736 learned_addr learned my addr 172.21.15.173:0/694284736 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.037+0000 7fe39e800640 1 --2- 172.21.15.173:0/694284736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe39806fba0 0x7fe398070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.037+0000 7fe39de00640 1 -- 172.21.15.173:0/694284736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe39806fba0 msgr2=0x7fe398070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.037+0000 7fe39de00640 1 --2- 172.21.15.173:0/694284736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe39806fba0 0x7fe398070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.037+0000 7fe39de00640 1 -- 172.21.15.173:0/694284736 >> v1:172.21.15.194:6789/0 conn(0x7fe39815df70 legacy=0x7fe398162060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.037+0000 7fe39de00640 1 -- 172.21.15.173:0/694284736 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39806b350 con 0x7fe39815db90 2024-04-25T09:03:47.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39de00640 1 --2- 172.21.15.173:0/694284736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe39815db90 0x7fe398072bf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009870 tx=0x7fe38c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b3d32b4b0cb22d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39ca00640 1 -- 172.21.15.173:0/694284736 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0b2070 con 0x7fe39815db90 2024-04-25T09:03:47.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39ca00640 1 -- 172.21.15.173:0/694284736 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c0a9070 con 0x7fe39815db90 2024-04-25T09:03:47.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39ca00640 1 -- 172.21.15.173:0/694284736 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0ad880 con 0x7fe39815db90 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39f200640 1 -- 172.21.15.173:0/694284736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe39815db90 msgr2=0x7fe398072bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39f200640 1 --2- 172.21.15.173:0/694284736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe39815db90 0x7fe398072bf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009870 tx=0x7fe38c01c560 comp rx=0 tx=0).stop 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39f200640 1 -- 172.21.15.173:0/694284736 shutdown_connections 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39f200640 1 --2- 172.21.15.173:0/694284736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe39806fba0 0x7fe398070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39f200640 1 --2- 172.21.15.173:0/694284736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe39815db90 0x7fe398072bf0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39f200640 1 -- 172.21.15.173:0/694284736 >> 172.21.15.173:0/694284736 conn(0x7fe39806e460 msgr2=0x7fe39806e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39f200640 1 -- 172.21.15.173:0/694284736 shutdown_connections 2024-04-25T09:03:47.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39f200640 1 -- 172.21.15.173:0/694284736 wait complete. 2024-04-25T09:03:47.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39f200640 1 Processor -- start 2024-04-25T09:03:47.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39f200640 1 -- start start 2024-04-25T09:03:47.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39f200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe39806fba0 0x7fe398155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39815db90 0x7fe3981579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe398157f20 0x7fe398156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39f200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3980732b0 con 0x7fe39806fba0 2024-04-25T09:03:47.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe398073130 con 0x7fe39815db90 2024-04-25T09:03:47.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.041+0000 7fe39f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39816aba0 con 0x7fe398157f20 2024-04-25T09:03:47.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe39de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe39806fba0 0x7fe398155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe39de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe39806fba0 0x7fe398155760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59450/0 (socket says 172.21.15.173:59450) 2024-04-25T09:03:47.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe39de00640 1 -- 172.21.15.173:0/1851876035 learned_addr learned my addr 172.21.15.173:0/1851876035 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:47.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe39e800640 1 --2- 172.21.15.173:0/1851876035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe398157f20 0x7fe398156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe39de00640 1 -- 172.21.15.173:0/1851876035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe398157f20 msgr2=0x7fe398156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe39d400640 1 --2- 172.21.15.173:0/1851876035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39815db90 0x7fe3981579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe39de00640 1 --2- 172.21.15.173:0/1851876035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe398157f20 0x7fe398156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe39de00640 1 -- 172.21.15.173:0/1851876035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39815db90 msgr2=0x7fe3981579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe39de00640 1 --2- 172.21.15.173:0/1851876035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39815db90 0x7fe3981579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe39de00640 1 -- 172.21.15.173:0/1851876035 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe398156df0 con 0x7fe39806fba0 2024-04-25T09:03:47.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe39e800640 1 --2- 172.21.15.173:0/1851876035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe398157f20 0x7fe398156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:47.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe39d400640 1 --2- 172.21.15.173:0/1851876035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39815db90 0x7fe3981579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:47.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe39de00640 1 --2- 172.21.15.173:0/1851876035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe39806fba0 0x7fe398155760 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0b0040 tx=0x7fe38c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe392000640 1 -- 172.21.15.173:0/1851876035 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0bc020 con 0x7fe39806fba0 2024-04-25T09:03:47.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe392000640 1 -- 172.21.15.173:0/1851876035 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c0adda0 con 0x7fe39806fba0 2024-04-25T09:03:47.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe39f200640 1 -- 172.21.15.173:0/1851876035 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3981570d0 con 0x7fe39806fba0 2024-04-25T09:03:47.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe392000640 1 -- 172.21.15.173:0/1851876035 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0b2040 con 0x7fe39806fba0 2024-04-25T09:03:47.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe39f200640 1 -- 172.21.15.173:0/1851876035 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3980b0890 con 0x7fe39806fba0 2024-04-25T09:03:47.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe39f200640 1 -- 172.21.15.173:0/1851876035 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe398158330 con 0x7fe39806fba0 2024-04-25T09:03:47.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.045+0000 7fe392000640 1 -- 172.21.15.173:0/1851876035 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe38c0bf020 con 0x7fe39806fba0 2024-04-25T09:03:47.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.049+0000 7fe392000640 1 --2- 172.21.15.173:0/1851876035 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe37c066f90 0x7fe37c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.049+0000 7fe392000640 1 -- 172.21.15.173:0/1851876035 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe38c11f5c0 con 0x7fe39806fba0 2024-04-25T09:03:47.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.049+0000 7fe39d400640 1 --2- 172.21.15.173:0/1851876035 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe37c066f90 0x7fe37c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.049+0000 7fe39d400640 1 --2- 172.21.15.173:0/1851876035 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe37c066f90 0x7fe37c069450 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe3980b00f0 tx=0x7fe388009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.053+0000 7fe392000640 1 -- 172.21.15.173:0/1851876035 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe398158330 con 0x7fe39806fba0 2024-04-25T09:03:47.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.205+0000 7fe39f200640 1 -- 172.21.15.173:0/1851876035 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe398073a40 con 0x7fe39806fba0 2024-04-25T09:03:47.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.205+0000 7fe392000640 1 -- 172.21.15.173:0/1851876035 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe38c0c6030 con 0x7fe39806fba0 2024-04-25T09:03:47.195 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:47.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.205+0000 7fe39f200640 1 -- 172.21.15.173:0/1851876035 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe37c066f90 msgr2=0x7fe37c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.205+0000 7fe39f200640 1 --2- 172.21.15.173:0/1851876035 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe37c066f90 0x7fe37c069450 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe3980b00f0 tx=0x7fe388009040 comp rx=0 tx=0).stop 2024-04-25T09:03:47.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.205+0000 7fe39f200640 1 -- 172.21.15.173:0/1851876035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe39806fba0 msgr2=0x7fe398155760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.205+0000 7fe39f200640 1 --2- 172.21.15.173:0/1851876035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe39806fba0 0x7fe398155760 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0b0040 tx=0x7fe38c01ada0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.205+0000 7fe39f200640 1 -- 172.21.15.173:0/1851876035 shutdown_connections 2024-04-25T09:03:47.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.205+0000 7fe39f200640 1 --2- 172.21.15.173:0/1851876035 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe37c066f90 0x7fe37c069450 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.205+0000 7fe39f200640 1 --2- 172.21.15.173:0/1851876035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe398157f20 0x7fe398156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.205+0000 7fe39f200640 1 --2- 172.21.15.173:0/1851876035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39815db90 0x7fe3981579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.205+0000 7fe39f200640 1 --2- 172.21.15.173:0/1851876035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe39806fba0 0x7fe398155760 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.205+0000 7fe39f200640 1 -- 172.21.15.173:0/1851876035 >> 172.21.15.173:0/1851876035 conn(0x7fe39806e460 msgr2=0x7fe3980ce6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:47.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.205+0000 7fe39f200640 1 -- 172.21.15.173:0/1851876035 shutdown_connections 2024-04-25T09:03:47.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.205+0000 7fe39f200640 1 -- 172.21.15.173:0/1851876035 wait complete. 2024-04-25T09:03:47.215 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:03:47.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.361+0000 7f4783200640 1 Processor -- start 2024-04-25T09:03:47.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.361+0000 7f4783200640 1 -- start start 2024-04-25T09:03:47.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.361+0000 7f4783200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f477c0aeb90 0x7f477c0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.361+0000 7f4783200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f477c0ce2b0 0x7f477c0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.361+0000 7f4783200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477c071570 con 0x7f477c0aef70 2024-04-25T09:03:47.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.361+0000 7f4783200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477c071320 con 0x7f477c0aeb90 2024-04-25T09:03:47.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.361+0000 7f4783200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c072330 con 0x7f477c0ce2b0 2024-04-25T09:03:47.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.365+0000 7f477be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f477c0aeb90 0x7f477c0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.365+0000 7f477be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f477c0aeb90 0x7f477c0cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59454/0 (socket says 172.21.15.173:59454) 2024-04-25T09:03:47.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.365+0000 7f477be00640 1 -- 172.21.15.173:0/2804060847 learned_addr learned my addr 172.21.15.173:0/2804060847 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:47.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.365+0000 7f4781200640 1 --2- 172.21.15.173:0/2804060847 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f477c0ce2b0 0x7f477c0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.365+0000 7f477be00640 1 -- 172.21.15.173:0/2804060847 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f477c0ce2b0 msgr2=0x7f477c0cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:47.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.365+0000 7f477be00640 1 --2- 172.21.15.173:0/2804060847 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f477c0ce2b0 0x7f477c0cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.365+0000 7f477be00640 1 -- 172.21.15.173:0/2804060847 >> v1:172.21.15.194:6789/0 conn(0x7f477c0aef70 legacy=0x7f477c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.365+0000 7f477be00640 1 -- 172.21.15.173:0/2804060847 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c071850 con 0x7f477c0aeb90 2024-04-25T09:03:47.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.365+0000 7f477be00640 1 --2- 172.21.15.173:0/2804060847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f477c0aeb90 0x7f477c0cc0d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f476c009870 tx=0x7f476c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55435b499d305dcd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.365+0000 7f477b400640 1 -- 172.21.15.173:0/2804060847 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c0b1070 con 0x7f477c0aeb90 2024-04-25T09:03:47.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.365+0000 7f477b400640 1 -- 172.21.15.173:0/2804060847 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476c0ac600 con 0x7f477c0aeb90 2024-04-25T09:03:47.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.365+0000 7f477b400640 1 -- 172.21.15.173:0/2804060847 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c0ac9d0 con 0x7f477c0aeb90 2024-04-25T09:03:47.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4783200640 1 -- 172.21.15.173:0/2804060847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f477c0aeb90 msgr2=0x7f477c0cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4783200640 1 --2- 172.21.15.173:0/2804060847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f477c0aeb90 0x7f477c0cc0d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f476c009870 tx=0x7f476c01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4783200640 1 -- 172.21.15.173:0/2804060847 shutdown_connections 2024-04-25T09:03:47.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4783200640 1 --2- 172.21.15.173:0/2804060847 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f477c0ce2b0 0x7f477c0cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4783200640 1 --2- 172.21.15.173:0/2804060847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f477c0aeb90 0x7f477c0cc0d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4783200640 1 -- 172.21.15.173:0/2804060847 >> 172.21.15.173:0/2804060847 conn(0x7f477c06ac90 msgr2=0x7f477c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:47.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4783200640 1 -- 172.21.15.173:0/2804060847 shutdown_connections 2024-04-25T09:03:47.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4783200640 1 -- 172.21.15.173:0/2804060847 wait complete. 2024-04-25T09:03:47.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4783200640 1 Processor -- start 2024-04-25T09:03:47.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4783200640 1 -- start start 2024-04-25T09:03:47.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4783200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f477c0aeb90 0x7f477c152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4783200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f477c0aef70 0x7f477c1385a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4783200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f477c0ce2b0 0x7f477c13ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4783200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c15bb30 con 0x7f477c0aef70 2024-04-25T09:03:47.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4783200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c15b9b0 con 0x7f477c0ce2b0 2024-04-25T09:03:47.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4783200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c15bcb0 con 0x7f477c0aeb90 2024-04-25T09:03:47.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4773400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f477c0aef70 0x7f477c1385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4773400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f477c0aef70 0x7f477c1385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59456/0 (socket says 172.21.15.173:59456) 2024-04-25T09:03:47.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4773400640 1 -- 172.21.15.173:0/945438753 learned_addr learned my addr 172.21.15.173:0/945438753 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:47.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f477be00640 1 --2- 172.21.15.173:0/945438753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f477c0aeb90 0x7f477c152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4781200640 1 --2- 172.21.15.173:0/945438753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f477c0ce2b0 0x7f477c13ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4773400640 1 -- 172.21.15.173:0/945438753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f477c0aeb90 msgr2=0x7f477c152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4773400640 1 --2- 172.21.15.173:0/945438753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f477c0aeb90 0x7f477c152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4773400640 1 -- 172.21.15.173:0/945438753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f477c0ce2b0 msgr2=0x7f477c13ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4773400640 1 --2- 172.21.15.173:0/945438753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f477c0ce2b0 0x7f477c13ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.369+0000 7f4773400640 1 -- 172.21.15.173:0/945438753 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c0b22b0 con 0x7f477c0aef70 2024-04-25T09:03:47.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.373+0000 7f4773400640 1 --2- 172.21.15.173:0/945438753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f477c0aef70 0x7f477c1385a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f476400c370 tx=0x7f476400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.373+0000 7f4778c00640 1 -- 172.21.15.173:0/945438753 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640052d0 con 0x7f477c0aef70 2024-04-25T09:03:47.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.373+0000 7f4778c00640 1 -- 172.21.15.173:0/945438753 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4764005470 con 0x7f477c0aef70 2024-04-25T09:03:47.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.373+0000 7f4778c00640 1 -- 172.21.15.173:0/945438753 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764007260 con 0x7f477c0aef70 2024-04-25T09:03:47.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.373+0000 7f4783200640 1 -- 172.21.15.173:0/945438753 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477c138ae0 con 0x7f477c0aef70 2024-04-25T09:03:47.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.373+0000 7f4783200640 1 -- 172.21.15.173:0/945438753 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c0b1fd0 con 0x7f477c0aef70 2024-04-25T09:03:47.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.373+0000 7f4783200640 1 -- 172.21.15.173:0/945438753 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477c073ab0 con 0x7f477c0aef70 2024-04-25T09:03:47.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.373+0000 7f4778c00640 1 -- 172.21.15.173:0/945438753 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4764007400 con 0x7f477c0aef70 2024-04-25T09:03:47.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.373+0000 7f4778c00640 1 --2- 172.21.15.173:0/945438753 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4758066f60 0x7f4758069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.373+0000 7f4778c00640 1 -- 172.21.15.173:0/945438753 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f4764084820 con 0x7f477c0aef70 2024-04-25T09:03:47.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.373+0000 7f477be00640 1 --2- 172.21.15.173:0/945438753 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4758066f60 0x7f4758069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.377+0000 7f477be00640 1 --2- 172.21.15.173:0/945438753 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4758066f60 0x7f4758069420 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f476c0ae000 tx=0x7f476c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.377+0000 7f4778c00640 1 -- 172.21.15.173:0/945438753 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4764054dd0 con 0x7f477c0aef70 2024-04-25T09:03:47.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.541+0000 7f4783200640 1 -- 172.21.15.173:0/945438753 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f477c15a970 con 0x7f477c0aef70 2024-04-25T09:03:47.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.541+0000 7f4778c00640 1 -- 172.21.15.173:0/945438753 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4764058e70 con 0x7f477c0aef70 2024-04-25T09:03:47.533 INFO:teuthology.orchestra.run.smithi173.stderr:listed 0 entries 2024-04-25T09:03:47.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.545+0000 7f4783200640 1 -- 172.21.15.173:0/945438753 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4758066f60 msgr2=0x7f4758069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.545+0000 7f4783200640 1 --2- 172.21.15.173:0/945438753 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4758066f60 0x7f4758069420 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f476c0ae000 tx=0x7f476c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:03:47.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.545+0000 7f4783200640 1 -- 172.21.15.173:0/945438753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f477c0aef70 msgr2=0x7f477c1385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.545+0000 7f4783200640 1 --2- 172.21.15.173:0/945438753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f477c0aef70 0x7f477c1385a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f476400c370 tx=0x7f476400c830 comp rx=0 tx=0).stop 2024-04-25T09:03:47.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.545+0000 7f4783200640 1 -- 172.21.15.173:0/945438753 shutdown_connections 2024-04-25T09:03:47.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.545+0000 7f4783200640 1 --2- 172.21.15.173:0/945438753 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4758066f60 0x7f4758069420 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.545+0000 7f4783200640 1 --2- 172.21.15.173:0/945438753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f477c0ce2b0 0x7f477c13ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.545+0000 7f4783200640 1 --2- 172.21.15.173:0/945438753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f477c0aef70 0x7f477c1385a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.545+0000 7f4783200640 1 --2- 172.21.15.173:0/945438753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f477c0aeb90 0x7f477c152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.545+0000 7f4783200640 1 -- 172.21.15.173:0/945438753 >> 172.21.15.173:0/945438753 conn(0x7f477c06ac90 msgr2=0x7f477c0b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:47.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.545+0000 7f4783200640 1 -- 172.21.15.173:0/945438753 shutdown_connections 2024-04-25T09:03:47.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.545+0000 7f4783200640 1 -- 172.21.15.173:0/945438753 wait complete. 2024-04-25T09:03:47.554 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-25T09:03:47.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:47.555 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-25T09:03:47.578 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2024-04-25T09:03:47.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:47.579 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-25T09:03:47.631 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:03:47.632 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:47.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.777+0000 7f5512600640 1 Processor -- start 2024-04-25T09:03:47.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.777+0000 7f5512600640 1 -- start start 2024-04-25T09:03:47.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.777+0000 7f5512600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f550c0ccd30 0x7f550c0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.777+0000 7f5512600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550c06e7c0 con 0x7f550c145250 2024-04-25T09:03:47.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.777+0000 7f5512600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550c06d720 con 0x7f550c0cc8b0 2024-04-25T09:03:47.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.777+0000 7f5512600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550c06da00 con 0x7f550c0ccd30 2024-04-25T09:03:47.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.777+0000 7f550be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f550c0ccd30 0x7f550c0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.777+0000 7f550b400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f550c145250 0x7f550c15c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34058/0 (socket says 172.21.15.173:34058) 2024-04-25T09:03:47.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.777+0000 7f550b400640 1 -- 172.21.15.173:0/3119315034 learned_addr learned my addr 172.21.15.173:0/3119315034 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:47.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.777+0000 7f550be00640 1 -- 172.21.15.173:0/3119315034 >> v1:172.21.15.194:6789/0 conn(0x7f550c0cc8b0 legacy=0x7f550c0ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:47.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.777+0000 7f550be00640 1 -- 172.21.15.173:0/3119315034 >> v1:172.21.15.173:6789/0 conn(0x7f550c145250 legacy=0x7f550c15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.777+0000 7f550be00640 1 -- 172.21.15.173:0/3119315034 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c06dce0 con 0x7f550c0ccd30 2024-04-25T09:03:47.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.777+0000 7f550aa00640 1 -- 172.21.15.173:0/3119315034 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170621907 0 0) 0x7f550c06e7c0 con 0x7f550c145250 2024-04-25T09:03:47.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.781+0000 7f550be00640 1 --2- 172.21.15.173:0/3119315034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f550c0ccd30 0x7f550c0cf000 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5504009d90 tx=0x7f550401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5c3324ead68db7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.781+0000 7f550aa00640 1 -- 172.21.15.173:0/3119315034 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55040b2070 con 0x7f550c0ccd30 2024-04-25T09:03:47.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.781+0000 7f550aa00640 1 -- 172.21.15.173:0/3119315034 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55040a59c0 con 0x7f550c0ccd30 2024-04-25T09:03:47.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.781+0000 7f550aa00640 1 -- 172.21.15.173:0/3119315034 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55040a5d90 con 0x7f550c0ccd30 2024-04-25T09:03:47.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.781+0000 7f5512600640 1 -- 172.21.15.173:0/3119315034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f550c0ccd30 msgr2=0x7f550c0cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.781+0000 7f5512600640 1 --2- 172.21.15.173:0/3119315034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f550c0ccd30 0x7f550c0cf000 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5504009d90 tx=0x7f550401c900 comp rx=0 tx=0).stop 2024-04-25T09:03:47.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.781+0000 7f5512600640 1 -- 172.21.15.173:0/3119315034 shutdown_connections 2024-04-25T09:03:47.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.781+0000 7f5512600640 1 --2- 172.21.15.173:0/3119315034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f550c0ccd30 0x7f550c0cf000 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.781+0000 7f5512600640 1 -- 172.21.15.173:0/3119315034 >> 172.21.15.173:0/3119315034 conn(0x7f550c06ac90 msgr2=0x7f550c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:47.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.781+0000 7f5512600640 1 -- 172.21.15.173:0/3119315034 shutdown_connections 2024-04-25T09:03:47.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.781+0000 7f5512600640 1 -- 172.21.15.173:0/3119315034 wait complete. 2024-04-25T09:03:47.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f5512600640 1 Processor -- start 2024-04-25T09:03:47.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f5512600640 1 -- start start 2024-04-25T09:03:47.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f5512600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f550c0cc8b0 0x7f550c15b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f5512600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f550c0ccd30 0x7f550c0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f5512600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f550c145250 0x7f550c0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f5512600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0cd140 con 0x7f550c0cc8b0 2024-04-25T09:03:47.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f5512600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c06ef80 con 0x7f550c0ccd30 2024-04-25T09:03:47.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f5512600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550c06d380 con 0x7f550c145250 2024-04-25T09:03:47.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f550b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f550c0cc8b0 0x7f550c15b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f550b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f550c0cc8b0 0x7f550c15b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59488/0 (socket says 172.21.15.173:59488) 2024-04-25T09:03:47.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f550b400640 1 -- 172.21.15.173:0/57048031 learned_addr learned my addr 172.21.15.173:0/57048031 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:47.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f5502a00640 1 --2- 172.21.15.173:0/57048031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f550c0ccd30 0x7f550c0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f550be00640 1 --2- 172.21.15.173:0/57048031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f550c145250 0x7f550c0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f550b400640 1 -- 172.21.15.173:0/57048031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f550c145250 msgr2=0x7f550c0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f550b400640 1 --2- 172.21.15.173:0/57048031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f550c145250 0x7f550c0b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f550b400640 1 -- 172.21.15.173:0/57048031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f550c0ccd30 msgr2=0x7f550c0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f550b400640 1 --2- 172.21.15.173:0/57048031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f550c0ccd30 0x7f550c0b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f550b400640 1 -- 172.21.15.173:0/57048031 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c142840 con 0x7f550c0cc8b0 2024-04-25T09:03:47.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f550be00640 1 --2- 172.21.15.173:0/57048031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f550c145250 0x7f550c0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:47.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f550b400640 1 --2- 172.21.15.173:0/57048031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f550c0cc8b0 0x7f550c15b1e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00c480 tx=0x7f54fc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f5503e00640 1 -- 172.21.15.173:0/57048031 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc018070 con 0x7f550c0cc8b0 2024-04-25T09:03:47.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f5503e00640 1 -- 172.21.15.173:0/57048031 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54fc007500 con 0x7f550c0cc8b0 2024-04-25T09:03:47.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f5512600640 1 -- 172.21.15.173:0/57048031 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550c0b4560 con 0x7f550c0cc8b0 2024-04-25T09:03:47.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f5503e00640 1 -- 172.21.15.173:0/57048031 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc004a30 con 0x7f550c0cc8b0 2024-04-25T09:03:47.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.785+0000 7f5512600640 1 -- 172.21.15.173:0/57048031 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550c15a9e0 con 0x7f550c0cc8b0 2024-04-25T09:03:47.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.789+0000 7f5512600640 1 -- 172.21.15.173:0/57048031 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550c073a40 con 0x7f550c0cc8b0 2024-04-25T09:03:47.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.789+0000 7f5503e00640 1 -- 172.21.15.173:0/57048031 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f54fc01b070 con 0x7f550c0cc8b0 2024-04-25T09:03:47.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.789+0000 7f5503e00640 1 --2- 172.21.15.173:0/57048031 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54e8066f60 0x7f54e8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.789+0000 7f5503e00640 1 -- 172.21.15.173:0/57048031 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f54fc084620 con 0x7f550c0cc8b0 2024-04-25T09:03:47.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.789+0000 7f5502a00640 1 --2- 172.21.15.173:0/57048031 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54e8066f60 0x7f54e8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.789+0000 7f5502a00640 1 --2- 172.21.15.173:0/57048031 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54e8066f60 0x7f54e8069420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f550c1fa9d0 tx=0x7f54f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.793+0000 7f5503e00640 1 -- 172.21.15.173:0/57048031 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f54fc054c70 con 0x7f550c0cc8b0 2024-04-25T09:03:47.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.981+0000 7f5512600640 1 -- 172.21.15.173:0/57048031 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f550c06b3d0 con 0x7f550c0cc8b0 2024-04-25T09:03:47.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.981+0000 7f5503e00640 1 -- 172.21.15.173:0/57048031 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4946 (secure 0 0 0) 0x7f54fc058d10 con 0x7f550c0cc8b0 2024-04-25T09:03:47.970 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:47.970 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2883565303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2883565303},{"type":"v1","addr":"172.21.15.194:6834","nonce":2883565303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2634963400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2634963400},{"type":"v1","addr":"172.21.15.173:6837","nonce":2634963400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3101502434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3101502434},{"type":"v1","addr":"172.21.15.173:6836","nonce":3101502434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:51.389514+0000","modified":"2024-04-25T09:03:08.473956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/4160663138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4160663138},{"type":"v1","addr":"172.21.15.194:6835","nonce":4160663138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:03:47.971 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 9 2024-04-25T09:03:47.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.981+0000 7f5512600640 1 -- 172.21.15.173:0/57048031 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54e8066f60 msgr2=0x7f54e8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.981+0000 7f5512600640 1 --2- 172.21.15.173:0/57048031 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54e8066f60 0x7f54e8069420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f550c1fa9d0 tx=0x7f54f4009040 comp rx=0 tx=0).stop 2024-04-25T09:03:47.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.981+0000 7f5512600640 1 -- 172.21.15.173:0/57048031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f550c0cc8b0 msgr2=0x7f550c15b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.981+0000 7f5512600640 1 --2- 172.21.15.173:0/57048031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f550c0cc8b0 0x7f550c15b1e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00c480 tx=0x7f54fc00c940 comp rx=0 tx=0).stop 2024-04-25T09:03:47.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.981+0000 7f5512600640 1 -- 172.21.15.173:0/57048031 shutdown_connections 2024-04-25T09:03:47.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.981+0000 7f5512600640 1 --2- 172.21.15.173:0/57048031 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54e8066f60 0x7f54e8069420 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.981+0000 7f5512600640 1 --2- 172.21.15.173:0/57048031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f550c145250 0x7f550c0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.981+0000 7f5512600640 1 --2- 172.21.15.173:0/57048031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f550c0ccd30 0x7f550c0b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.981+0000 7f5512600640 1 --2- 172.21.15.173:0/57048031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f550c0cc8b0 0x7f550c15b1e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.981+0000 7f5512600640 1 -- 172.21.15.173:0/57048031 >> 172.21.15.173:0/57048031 conn(0x7f550c06ac90 msgr2=0x7f550c15e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:47.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.981+0000 7f5512600640 1 -- 172.21.15.173:0/57048031 shutdown_connections 2024-04-25T09:03:47.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:47.981+0000 7f5512600640 1 -- 172.21.15.173:0/57048031 wait complete. 2024-04-25T09:03:47.993 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:48.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.141+0000 7fe7ee000640 1 Processor -- start 2024-04-25T09:03:48.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.141+0000 7fe7ee000640 1 -- start start 2024-04-25T09:03:48.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.141+0000 7fe7ee000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7e806dac0 0x7fe7e80ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.141+0000 7fe7ee000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe7e806bca0 0x7fe7e806c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.141+0000 7fe7ee000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e8061d60 con 0x7fe7e8160fe0 2024-04-25T09:03:48.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.141+0000 7fe7ee000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e806c640 con 0x7fe7e806bca0 2024-04-25T09:03:48.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.141+0000 7fe7ee000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e81613c0 con 0x7fe7e806dac0 2024-04-25T09:03:48.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.141+0000 7fe7e7e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe7e806bca0 0x7fe7e806c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.141+0000 7fe7e7e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe7e806bca0 0x7fe7e806c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59498/0 (socket says 172.21.15.173:59498) 2024-04-25T09:03:48.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.141+0000 7fe7e7e00640 1 -- 172.21.15.173:0/3476180749 learned_addr learned my addr 172.21.15.173:0/3476180749 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:48.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.141+0000 7fe7dea00640 1 --2- 172.21.15.173:0/3476180749 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7e806dac0 0x7fe7e80ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.145+0000 7fe7e7e00640 1 -- 172.21.15.173:0/3476180749 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7e806dac0 msgr2=0x7fe7e80ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:48.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.145+0000 7fe7e7e00640 1 --2- 172.21.15.173:0/3476180749 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7e806dac0 0x7fe7e80ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.145+0000 7fe7e7e00640 1 -- 172.21.15.173:0/3476180749 >> v1:172.21.15.194:6789/0 conn(0x7fe7e8160fe0 legacy=0x7fe7e8161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.145+0000 7fe7e7e00640 1 -- 172.21.15.173:0/3476180749 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e806dfa0 con 0x7fe7e806bca0 2024-04-25T09:03:48.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.145+0000 7fe7e7e00640 1 --2- 172.21.15.173:0/3476180749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7e806bca0 0x7fe7e806c100 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00098a0 tx=0x7fe7e001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f514df848a220b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:48.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.145+0000 7fe7e6a00640 1 -- 172.21.15.173:0/3476180749 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e00ab680 con 0x7fe7e806bca0 2024-04-25T09:03:48.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.145+0000 7fe7e6a00640 1 -- 172.21.15.173:0/3476180749 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e00b0070 con 0x7fe7e806bca0 2024-04-25T09:03:48.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.145+0000 7fe7e6a00640 1 -- 172.21.15.173:0/3476180749 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e00aba40 con 0x7fe7e806bca0 2024-04-25T09:03:48.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.145+0000 7fe7ee000640 1 -- 172.21.15.173:0/3476180749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7e806bca0 msgr2=0x7fe7e806c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.145+0000 7fe7ee000640 1 --2- 172.21.15.173:0/3476180749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7e806bca0 0x7fe7e806c100 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00098a0 tx=0x7fe7e001c480 comp rx=0 tx=0).stop 2024-04-25T09:03:48.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.145+0000 7fe7ee000640 1 -- 172.21.15.173:0/3476180749 shutdown_connections 2024-04-25T09:03:48.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.145+0000 7fe7ee000640 1 --2- 172.21.15.173:0/3476180749 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7e806dac0 0x7fe7e80ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.145+0000 7fe7ee000640 1 --2- 172.21.15.173:0/3476180749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7e806bca0 0x7fe7e806c100 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.145+0000 7fe7ee000640 1 -- 172.21.15.173:0/3476180749 >> 172.21.15.173:0/3476180749 conn(0x7fe7e8071c20 msgr2=0x7fe7e8072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:48.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7ee000640 1 -- 172.21.15.173:0/3476180749 shutdown_connections 2024-04-25T09:03:48.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7ee000640 1 -- 172.21.15.173:0/3476180749 wait complete. 2024-04-25T09:03:48.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7ee000640 1 Processor -- start 2024-04-25T09:03:48.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7ee000640 1 -- start start 2024-04-25T09:03:48.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7ee000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7e806bca0 0x7fe7e8155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7ee000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7e806dac0 0x7fe7e81fa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7ee000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7e8160fe0 0x7fe7e81513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7ee000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e80ad340 con 0x7fe7e806dac0 2024-04-25T09:03:48.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7ee000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e806eb20 con 0x7fe7e806bca0 2024-04-25T09:03:48.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7ee000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e80ad4c0 con 0x7fe7e8160fe0 2024-04-25T09:03:48.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7dea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7e806dac0 0x7fe7e81fa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7dea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7e806dac0 0x7fe7e81fa810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59502/0 (socket says 172.21.15.173:59502) 2024-04-25T09:03:48.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7dea00640 1 -- 172.21.15.173:0/2032855767 learned_addr learned my addr 172.21.15.173:0/2032855767 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:48.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7e7e00640 1 --2- 172.21.15.173:0/2032855767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7e8160fe0 0x7fe7e81513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7e7400640 1 --2- 172.21.15.173:0/2032855767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7e806bca0 0x7fe7e8155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7dea00640 1 -- 172.21.15.173:0/2032855767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7e8160fe0 msgr2=0x7fe7e81513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7dea00640 1 --2- 172.21.15.173:0/2032855767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7e8160fe0 0x7fe7e81513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7dea00640 1 -- 172.21.15.173:0/2032855767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7e806bca0 msgr2=0x7fe7e8155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7dea00640 1 --2- 172.21.15.173:0/2032855767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7e806bca0 0x7fe7e8155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7dea00640 1 -- 172.21.15.173:0/2032855767 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e8150620 con 0x7fe7e806dac0 2024-04-25T09:03:48.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7e7e00640 1 --2- 172.21.15.173:0/2032855767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7e8160fe0 0x7fe7e81513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:48.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7e7400640 1 --2- 172.21.15.173:0/2032855767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7e806bca0 0x7fe7e8155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:48.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7dea00640 1 --2- 172.21.15.173:0/2032855767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7e806dac0 0x7fe7e81fa810 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe7d000d800 tx=0x7fe7d000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:48.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7dfe00640 1 -- 172.21.15.173:0/2032855767 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d000b6c0 con 0x7fe7e806dac0 2024-04-25T09:03:48.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7dfe00640 1 -- 172.21.15.173:0/2032855767 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d0019070 con 0x7fe7e806dac0 2024-04-25T09:03:48.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7dfe00640 1 -- 172.21.15.173:0/2032855767 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d000ba60 con 0x7fe7e806dac0 2024-04-25T09:03:48.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7ee000640 1 -- 172.21.15.173:0/2032855767 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e8150900 con 0x7fe7e806dac0 2024-04-25T09:03:48.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.149+0000 7fe7ee000640 1 -- 172.21.15.173:0/2032855767 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e8150ec0 con 0x7fe7e806dac0 2024-04-25T09:03:48.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.153+0000 7fe7ee000640 1 -- 172.21.15.173:0/2032855767 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e8073a40 con 0x7fe7e806dac0 2024-04-25T09:03:48.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.153+0000 7fe7dfe00640 1 -- 172.21.15.173:0/2032855767 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe7d000bc00 con 0x7fe7e806dac0 2024-04-25T09:03:48.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.153+0000 7fe7dfe00640 1 --2- 172.21.15.173:0/2032855767 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe7c4066f60 0x7fe7c4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.153+0000 7fe7dfe00640 1 -- 172.21.15.173:0/2032855767 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe7d00859b0 con 0x7fe7e806dac0 2024-04-25T09:03:48.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.153+0000 7fe7e7400640 1 --2- 172.21.15.173:0/2032855767 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe7c4066f60 0x7fe7c4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.153+0000 7fe7e7400640 1 --2- 172.21.15.173:0/2032855767 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe7c4066f60 0x7fe7c4069420 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8001d70 tx=0x7fe7d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:48.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.157+0000 7fe7dfe00640 1 -- 172.21.15.173:0/2032855767 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe7d0056520 con 0x7fe7e806dac0 2024-04-25T09:03:48.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.313+0000 7fe7ee000640 1 -- 172.21.15.173:0/2032855767 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7e8157590 con 0x7fe7e806dac0 2024-04-25T09:03:48.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.313+0000 7fe7dfe00640 1 -- 172.21.15.173:0/2032855767 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18906 (secure 0 0 0) 0x7fe7d0055e20 con 0x7fe7e806dac0 2024-04-25T09:03:48.304 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:48.304 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":28,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:03:32.190313+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:48.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.317+0000 7fe7ee000640 1 -- 172.21.15.173:0/2032855767 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe7c4066f60 msgr2=0x7fe7c4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.317+0000 7fe7ee000640 1 --2- 172.21.15.173:0/2032855767 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe7c4066f60 0x7fe7c4069420 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8001d70 tx=0x7fe7d8009040 comp rx=0 tx=0).stop 2024-04-25T09:03:48.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.317+0000 7fe7ee000640 1 -- 172.21.15.173:0/2032855767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7e806dac0 msgr2=0x7fe7e81fa810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.317+0000 7fe7ee000640 1 --2- 172.21.15.173:0/2032855767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7e806dac0 0x7fe7e81fa810 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe7d000d800 tx=0x7fe7d000dcc0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.317+0000 7fe7ee000640 1 -- 172.21.15.173:0/2032855767 shutdown_connections 2024-04-25T09:03:48.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.317+0000 7fe7ee000640 1 --2- 172.21.15.173:0/2032855767 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe7c4066f60 0x7fe7c4069420 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.317+0000 7fe7ee000640 1 --2- 172.21.15.173:0/2032855767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7e8160fe0 0x7fe7e81513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.317+0000 7fe7ee000640 1 --2- 172.21.15.173:0/2032855767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7e806dac0 0x7fe7e81fa810 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.317+0000 7fe7ee000640 1 --2- 172.21.15.173:0/2032855767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7e806bca0 0x7fe7e8155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.317+0000 7fe7ee000640 1 -- 172.21.15.173:0/2032855767 >> 172.21.15.173:0/2032855767 conn(0x7fe7e8071c20 msgr2=0x7fe7e80b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:48.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.317+0000 7fe7ee000640 1 -- 172.21.15.173:0/2032855767 shutdown_connections 2024-04-25T09:03:48.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.317+0000 7fe7ee000640 1 -- 172.21.15.173:0/2032855767 wait complete. 2024-04-25T09:03:48.326 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:02:49.342297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:02:50.386069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:02:54.077429+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:03:48.327 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:48.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.473+0000 7ff25ce00640 1 Processor -- start 2024-04-25T09:03:48.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.473+0000 7ff25ce00640 1 -- start start 2024-04-25T09:03:48.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.477+0000 7ff25ce00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2580aeb90 0x7ff2580cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.477+0000 7ff25ce00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff2580ce2b0 0x7ff2580cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.477+0000 7ff25ce00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff258071570 con 0x7ff2580aef70 2024-04-25T09:03:48.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.477+0000 7ff25ce00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff258071320 con 0x7ff2580ce2b0 2024-04-25T09:03:48.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.477+0000 7ff25ce00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff258072330 con 0x7ff2580aeb90 2024-04-25T09:03:48.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.477+0000 7ff255e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2580aeb90 0x7ff2580cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.477+0000 7ff256800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff2580ce2b0 0x7ff2580cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.477+0000 7ff255e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2580aeb90 0x7ff2580cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:41906/0 (socket says 172.21.15.173:41906) 2024-04-25T09:03:48.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.477+0000 7ff255e00640 1 -- 172.21.15.173:0/2431540402 learned_addr learned my addr 172.21.15.173:0/2431540402 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:48.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.477+0000 7ff256800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff2580ce2b0 0x7ff2580cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:38534/0 (socket says 172.21.15.173:38534) 2024-04-25T09:03:48.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.477+0000 7ff256800640 1 -- 172.21.15.173:0/2431540402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2580aeb90 msgr2=0x7ff2580cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:48.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.477+0000 7ff256800640 1 --2- 172.21.15.173:0/2431540402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2580aeb90 0x7ff2580cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.477+0000 7ff256800640 1 -- 172.21.15.173:0/2431540402 >> v1:172.21.15.194:6789/0 conn(0x7ff2580aef70 legacy=0x7ff2580cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.477+0000 7ff256800640 1 -- 172.21.15.173:0/2431540402 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff258071850 con 0x7ff2580ce2b0 2024-04-25T09:03:48.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.477+0000 7ff255e00640 1 --2- 172.21.15.173:0/2431540402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2580aeb90 0x7ff2580cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:48.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.481+0000 7ff256800640 1 --2- 172.21.15.173:0/2431540402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2580ce2b0 0x7ff2580cc610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff250009d90 tx=0x7ff25001c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8471b33277d0832 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:48.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.481+0000 7ff254a00640 1 -- 172.21.15.173:0/2431540402 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2500b2070 con 0x7ff2580ce2b0 2024-04-25T09:03:48.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.481+0000 7ff254a00640 1 -- 172.21.15.173:0/2431540402 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2500a5870 con 0x7ff2580ce2b0 2024-04-25T09:03:48.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.481+0000 7ff254a00640 1 -- 172.21.15.173:0/2431540402 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2500a5c40 con 0x7ff2580ce2b0 2024-04-25T09:03:48.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.481+0000 7ff25ce00640 1 -- 172.21.15.173:0/2431540402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2580ce2b0 msgr2=0x7ff2580cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.481+0000 7ff25ce00640 1 --2- 172.21.15.173:0/2431540402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2580ce2b0 0x7ff2580cc610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff250009d90 tx=0x7ff25001c8b0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.481+0000 7ff25ce00640 1 -- 172.21.15.173:0/2431540402 shutdown_connections 2024-04-25T09:03:48.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.481+0000 7ff25ce00640 1 --2- 172.21.15.173:0/2431540402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2580ce2b0 0x7ff2580cc610 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.481+0000 7ff25ce00640 1 --2- 172.21.15.173:0/2431540402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2580aeb90 0x7ff2580cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.481+0000 7ff25ce00640 1 -- 172.21.15.173:0/2431540402 >> 172.21.15.173:0/2431540402 conn(0x7ff25806ac90 msgr2=0x7ff25806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:48.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.481+0000 7ff25ce00640 1 -- 172.21.15.173:0/2431540402 shutdown_connections 2024-04-25T09:03:48.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.481+0000 7ff25ce00640 1 -- 172.21.15.173:0/2431540402 wait complete. 2024-04-25T09:03:48.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff25ce00640 1 Processor -- start 2024-04-25T09:03:48.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff25ce00640 1 -- start start 2024-04-25T09:03:48.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff25ce00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2580aeb90 0x7ff25814bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff25ce00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2580aef70 0x7ff2580af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff25ce00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2580ce2b0 0x7ff2580b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff25ce00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25815bb30 con 0x7ff2580aeb90 2024-04-25T09:03:48.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff25ce00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25815b9b0 con 0x7ff2580aef70 2024-04-25T09:03:48.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff25ce00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25815bcb0 con 0x7ff2580ce2b0 2024-04-25T09:03:48.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff255e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2580aeb90 0x7ff25814bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff255e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2580aeb90 0x7ff25814bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59512/0 (socket says 172.21.15.173:59512) 2024-04-25T09:03:48.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff255e00640 1 -- 172.21.15.173:0/3471696479 learned_addr learned my addr 172.21.15.173:0/3471696479 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:48.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff255400640 1 --2- 172.21.15.173:0/3471696479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2580aef70 0x7ff2580af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff256800640 1 --2- 172.21.15.173:0/3471696479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2580ce2b0 0x7ff2580b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff255e00640 1 -- 172.21.15.173:0/3471696479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2580ce2b0 msgr2=0x7ff2580b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff255e00640 1 --2- 172.21.15.173:0/3471696479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2580ce2b0 0x7ff2580b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff255e00640 1 -- 172.21.15.173:0/3471696479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2580aef70 msgr2=0x7ff2580af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff255e00640 1 --2- 172.21.15.173:0/3471696479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2580aef70 0x7ff2580af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff255e00640 1 -- 172.21.15.173:0/3471696479 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2580b1af0 con 0x7ff2580aeb90 2024-04-25T09:03:48.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff255e00640 1 --2- 172.21.15.173:0/3471696479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2580aeb90 0x7ff25814bc90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff24800e930 tx=0x7ff24800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:48.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff24e000640 1 -- 172.21.15.173:0/3471696479 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff248017070 con 0x7ff2580aeb90 2024-04-25T09:03:48.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff24e000640 1 -- 172.21.15.173:0/3471696479 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24800ca00 con 0x7ff2580aeb90 2024-04-25T09:03:48.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff24e000640 1 -- 172.21.15.173:0/3471696479 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24800cdd0 con 0x7ff2580aeb90 2024-04-25T09:03:48.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff25ce00640 1 -- 172.21.15.173:0/3471696479 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2580b1dd0 con 0x7ff2580aeb90 2024-04-25T09:03:48.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff25ce00640 1 -- 172.21.15.173:0/3471696479 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2580af920 con 0x7ff2580aeb90 2024-04-25T09:03:48.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.485+0000 7ff25ce00640 1 -- 172.21.15.173:0/3471696479 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff258073ab0 con 0x7ff2580aeb90 2024-04-25T09:03:48.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.489+0000 7ff24e000640 1 -- 172.21.15.173:0/3471696479 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff24801a070 con 0x7ff2580aeb90 2024-04-25T09:03:48.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.489+0000 7ff24e000640 1 --2- 172.21.15.173:0/3471696479 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff238066f60 0x7ff238069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.489+0000 7ff24e000640 1 -- 172.21.15.173:0/3471696479 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ff2480856d0 con 0x7ff2580aeb90 2024-04-25T09:03:48.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.489+0000 7ff255400640 1 --2- 172.21.15.173:0/3471696479 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff238066f60 0x7ff238069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.489+0000 7ff255400640 1 --2- 172.21.15.173:0/3471696479 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff238066f60 0x7ff238069420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff258150a80 tx=0x7ff244009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:48.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.493+0000 7ff24e000640 1 -- 172.21.15.173:0/3471696479 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff2480562d0 con 0x7ff2580aeb90 2024-04-25T09:03:48.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.649+0000 7ff25ce00640 1 -- 172.21.15.173:0/3471696479 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff258151490 con 0x7ff2580aeb90 2024-04-25T09:03:48.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.649+0000 7ff24e000640 1 -- 172.21.15.173:0/3471696479 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff248055bd0 con 0x7ff2580aeb90 2024-04-25T09:03:48.639 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:03:48.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.649+0000 7ff25ce00640 1 -- 172.21.15.173:0/3471696479 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff238066f60 msgr2=0x7ff238069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.649+0000 7ff25ce00640 1 --2- 172.21.15.173:0/3471696479 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff238066f60 0x7ff238069420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff258150a80 tx=0x7ff244009040 comp rx=0 tx=0).stop 2024-04-25T09:03:48.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.649+0000 7ff25ce00640 1 -- 172.21.15.173:0/3471696479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2580aeb90 msgr2=0x7ff25814bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.649+0000 7ff25ce00640 1 --2- 172.21.15.173:0/3471696479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2580aeb90 0x7ff25814bc90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff24800e930 tx=0x7ff24800edf0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.649+0000 7ff25ce00640 1 -- 172.21.15.173:0/3471696479 shutdown_connections 2024-04-25T09:03:48.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.649+0000 7ff25ce00640 1 --2- 172.21.15.173:0/3471696479 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff238066f60 0x7ff238069420 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.649+0000 7ff25ce00640 1 --2- 172.21.15.173:0/3471696479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2580ce2b0 0x7ff2580b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.649+0000 7ff25ce00640 1 --2- 172.21.15.173:0/3471696479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2580aef70 0x7ff2580af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.649+0000 7ff25ce00640 1 --2- 172.21.15.173:0/3471696479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2580aeb90 0x7ff25814bc90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.649+0000 7ff25ce00640 1 -- 172.21.15.173:0/3471696479 >> 172.21.15.173:0/3471696479 conn(0x7ff25806ac90 msgr2=0x7ff2580ad770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:48.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.649+0000 7ff25ce00640 1 -- 172.21.15.173:0/3471696479 shutdown_connections 2024-04-25T09:03:48.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.649+0000 7ff25ce00640 1 -- 172.21.15.173:0/3471696479 wait complete. 2024-04-25T09:03:48.660 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:48.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.809+0000 7fb35b600640 1 Processor -- start 2024-04-25T09:03:48.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.809+0000 7fb35b600640 1 -- start start 2024-04-25T09:03:48.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.809+0000 7fb35b600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb35409a160 0x7fb3540b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.809+0000 7fb35b600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3540d1490 con 0x7fb35406d200 2024-04-25T09:03:48.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.809+0000 7fb35b600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3540d0bf0 con 0x7fb35415e120 2024-04-25T09:03:48.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.809+0000 7fb35b600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3540d0ed0 con 0x7fb35409a160 2024-04-25T09:03:48.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.809+0000 7fb359600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb35409a160 0x7fb3540b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.809+0000 7fb353e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fb35406d200 0x7fb3540cc430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34074/0 (socket says 172.21.15.173:34074) 2024-04-25T09:03:48.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.809+0000 7fb359600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb35409a160 0x7fb3540b2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59520/0 (socket says 172.21.15.173:59520) 2024-04-25T09:03:48.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.809+0000 7fb353e00640 1 -- 172.21.15.173:0/3245033255 learned_addr learned my addr 172.21.15.173:0/3245033255 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:48.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.809+0000 7fb359600640 1 -- 172.21.15.173:0/3245033255 >> v1:172.21.15.194:6789/0 conn(0x7fb35415e120 legacy=0x7fb354099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:48.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.809+0000 7fb359600640 1 -- 172.21.15.173:0/3245033255 >> v1:172.21.15.173:6789/0 conn(0x7fb35406d200 legacy=0x7fb3540cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.809+0000 7fb359600640 1 -- 172.21.15.173:0/3245033255 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3540d11b0 con 0x7fb35409a160 2024-04-25T09:03:48.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.809+0000 7fb353400640 1 -- 172.21.15.173:0/3245033255 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069936540 0 0) 0x7fb3540d1490 con 0x7fb35406d200 2024-04-25T09:03:48.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.813+0000 7fb359600640 1 --2- 172.21.15.173:0/3245033255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb35409a160 0x7fb3540b2a00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0097c0 tx=0x7fb34c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae911d1637d76a9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:48.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.813+0000 7fb353400640 1 -- 172.21.15.173:0/3245033255 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c0b0070 con 0x7fb35409a160 2024-04-25T09:03:48.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.813+0000 7fb353400640 1 -- 172.21.15.173:0/3245033255 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c0ab600 con 0x7fb35409a160 2024-04-25T09:03:48.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.813+0000 7fb353400640 1 -- 172.21.15.173:0/3245033255 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c0ab9d0 con 0x7fb35409a160 2024-04-25T09:03:48.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.813+0000 7fb35b600640 1 -- 172.21.15.173:0/3245033255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb35409a160 msgr2=0x7fb3540b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.813+0000 7fb35b600640 1 --2- 172.21.15.173:0/3245033255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb35409a160 0x7fb3540b2a00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0097c0 tx=0x7fb34c01c410 comp rx=0 tx=0).stop 2024-04-25T09:03:48.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.813+0000 7fb35b600640 1 -- 172.21.15.173:0/3245033255 shutdown_connections 2024-04-25T09:03:48.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.813+0000 7fb35b600640 1 --2- 172.21.15.173:0/3245033255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb35409a160 0x7fb3540b2a00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.813+0000 7fb35b600640 1 -- 172.21.15.173:0/3245033255 >> 172.21.15.173:0/3245033255 conn(0x7fb3540b32a0 msgr2=0x7fb3540b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:48.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.813+0000 7fb35b600640 1 -- 172.21.15.173:0/3245033255 shutdown_connections 2024-04-25T09:03:48.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.813+0000 7fb35b600640 1 -- 172.21.15.173:0/3245033255 wait complete. 2024-04-25T09:03:48.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb35b600640 1 Processor -- start 2024-04-25T09:03:48.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb35b600640 1 -- start start 2024-04-25T09:03:48.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb35b600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb35406d200 0x7fb354152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb35b600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb35409a160 0x7fb3540c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb35b600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb35415e120 0x7fb3540c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb35b600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540cd760 con 0x7fb35415e120 2024-04-25T09:03:48.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb35b600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540cd5e0 con 0x7fb35406d200 2024-04-25T09:03:48.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb35b600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35416bb70 con 0x7fb35409a160 2024-04-25T09:03:48.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb359600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb35415e120 0x7fb3540c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb359600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb35415e120 0x7fb3540c6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59534/0 (socket says 172.21.15.173:59534) 2024-04-25T09:03:48.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb359600640 1 -- 172.21.15.173:0/3105047281 learned_addr learned my addr 172.21.15.173:0/3105047281 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:48.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb358c00640 1 --2- 172.21.15.173:0/3105047281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb35406d200 0x7fb354152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb353e00640 1 --2- 172.21.15.173:0/3105047281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb35409a160 0x7fb3540c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb359600640 1 -- 172.21.15.173:0/3105047281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb35409a160 msgr2=0x7fb3540c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb359600640 1 --2- 172.21.15.173:0/3105047281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb35409a160 0x7fb3540c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb359600640 1 -- 172.21.15.173:0/3105047281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb35406d200 msgr2=0x7fb354152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb359600640 1 --2- 172.21.15.173:0/3105047281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb35406d200 0x7fb354152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb359600640 1 -- 172.21.15.173:0/3105047281 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb354150b90 con 0x7fb35415e120 2024-04-25T09:03:48.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb359600640 1 --2- 172.21.15.173:0/3105047281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb35415e120 0x7fb3540c6140 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb34c019020 tx=0x7fb34c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:48.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb350c00640 1 -- 172.21.15.173:0/3105047281 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c0b8020 con 0x7fb35415e120 2024-04-25T09:03:48.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb350c00640 1 -- 172.21.15.173:0/3105047281 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c0b46d0 con 0x7fb35415e120 2024-04-25T09:03:48.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb350c00640 1 -- 172.21.15.173:0/3105047281 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c0b0040 con 0x7fb35415e120 2024-04-25T09:03:48.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb35b600640 1 -- 172.21.15.173:0/3105047281 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3540c8150 con 0x7fb35415e120 2024-04-25T09:03:48.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.817+0000 7fb35b600640 1 -- 172.21.15.173:0/3105047281 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3540c5660 con 0x7fb35415e120 2024-04-25T09:03:48.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.821+0000 7fb35b600640 1 -- 172.21.15.173:0/3105047281 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb354073ab0 con 0x7fb35415e120 2024-04-25T09:03:48.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.821+0000 7fb350c00640 1 -- 172.21.15.173:0/3105047281 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb34c0bb020 con 0x7fb35415e120 2024-04-25T09:03:48.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.821+0000 7fb350c00640 1 --2- 172.21.15.173:0/3105047281 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb334066f60 0x7fb334069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.821+0000 7fb350c00640 1 -- 172.21.15.173:0/3105047281 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb34c11f390 con 0x7fb35415e120 2024-04-25T09:03:48.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.821+0000 7fb358c00640 1 --2- 172.21.15.173:0/3105047281 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb334066f60 0x7fb334069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.821+0000 7fb358c00640 1 --2- 172.21.15.173:0/3105047281 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb334066f60 0x7fb334069420 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb3440012f0 tx=0x7fb344009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:48.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.825+0000 7fb350c00640 1 -- 172.21.15.173:0/3105047281 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb34c0c2030 con 0x7fb35415e120 2024-04-25T09:03:48.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.977+0000 7fb35b600640 1 -- 172.21.15.173:0/3105047281 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb35406e420 con 0x7fb35415e120 2024-04-25T09:03:48.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.981+0000 7fb350c00640 1 -- 172.21.15.173:0/3105047281 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb34c016090 con 0x7fb35415e120 2024-04-25T09:03:48.970 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:48.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.981+0000 7fb35b600640 1 -- 172.21.15.173:0/3105047281 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb334066f60 msgr2=0x7fb334069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.981+0000 7fb35b600640 1 --2- 172.21.15.173:0/3105047281 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb334066f60 0x7fb334069420 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb3440012f0 tx=0x7fb344009040 comp rx=0 tx=0).stop 2024-04-25T09:03:48.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.981+0000 7fb35b600640 1 -- 172.21.15.173:0/3105047281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb35415e120 msgr2=0x7fb3540c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.981+0000 7fb35b600640 1 --2- 172.21.15.173:0/3105047281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb35415e120 0x7fb3540c6140 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb34c019020 tx=0x7fb34c0191b0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.981+0000 7fb35b600640 1 -- 172.21.15.173:0/3105047281 shutdown_connections 2024-04-25T09:03:48.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.981+0000 7fb35b600640 1 --2- 172.21.15.173:0/3105047281 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb334066f60 0x7fb334069420 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.981+0000 7fb35b600640 1 --2- 172.21.15.173:0/3105047281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb35415e120 0x7fb3540c6140 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.981+0000 7fb35b600640 1 --2- 172.21.15.173:0/3105047281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb35409a160 0x7fb3540c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.981+0000 7fb35b600640 1 --2- 172.21.15.173:0/3105047281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb35406d200 0x7fb354152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.981+0000 7fb35b600640 1 -- 172.21.15.173:0/3105047281 >> 172.21.15.173:0/3105047281 conn(0x7fb3540b32a0 msgr2=0x7fb35406f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:48.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.981+0000 7fb35b600640 1 -- 172.21.15.173:0/3105047281 shutdown_connections 2024-04-25T09:03:48.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:48.981+0000 7fb35b600640 1 -- 172.21.15.173:0/3105047281 wait complete. 2024-04-25T09:03:48.991 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:49.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.137+0000 7f525ac00640 1 Processor -- start 2024-04-25T09:03:49.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.137+0000 7f525ac00640 1 -- start start 2024-04-25T09:03:49.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.141+0000 7f525ac00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f525406e1c0 0x7f525406bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.141+0000 7f525ac00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525406c410 0x7f52540aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.141+0000 7f525ac00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f525406ae30 con 0x7f52540ad3f0 2024-04-25T09:03:49.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.141+0000 7f525ac00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52540b3170 con 0x7f525406e1c0 2024-04-25T09:03:49.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.141+0000 7f525ac00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525415e070 con 0x7f525406c410 2024-04-25T09:03:49.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.141+0000 7f5253e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f525406e1c0 0x7f525406bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.141+0000 7f5253e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f525406e1c0 0x7f525406bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59542/0 (socket says 172.21.15.173:59542) 2024-04-25T09:03:49.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.141+0000 7f5253e00640 1 -- 172.21.15.173:0/91538221 learned_addr learned my addr 172.21.15.173:0/91538221 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:49.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.141+0000 7f5258c00640 1 --1- 172.21.15.173:0/91538221 >> v1:172.21.15.173:6789/0 conn(0x7f52540ad3f0 0x7f525406e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34082/0 (socket says 172.21.15.173:34082) 2024-04-25T09:03:49.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.141+0000 7f524b400640 1 --2- 172.21.15.173:0/91538221 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525406c410 0x7f52540aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.141+0000 7f5253e00640 1 -- 172.21.15.173:0/91538221 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525406c410 msgr2=0x7f52540aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:49.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.141+0000 7f5253e00640 1 --2- 172.21.15.173:0/91538221 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525406c410 0x7f52540aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.141+0000 7f5253e00640 1 -- 172.21.15.173:0/91538221 >> v1:172.21.15.173:6789/0 conn(0x7f52540ad3f0 legacy=0x7f525406e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.141+0000 7f5253e00640 1 -- 172.21.15.173:0/91538221 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525406b110 con 0x7f525406e1c0 2024-04-25T09:03:49.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f5253e00640 1 --2- 172.21.15.173:0/91538221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f525406e1c0 0x7f525406bed0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f52440098a0 tx=0x7f524401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed007247bcbfb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:49.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f5253400640 1 -- 172.21.15.173:0/91538221 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52440b5070 con 0x7f525406e1c0 2024-04-25T09:03:49.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f5253400640 1 -- 172.21.15.173:0/91538221 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52440a8a30 con 0x7f525406e1c0 2024-04-25T09:03:49.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f5253400640 1 -- 172.21.15.173:0/91538221 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52440a8e00 con 0x7f525406e1c0 2024-04-25T09:03:49.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f525ac00640 1 -- 172.21.15.173:0/91538221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f525406e1c0 msgr2=0x7f525406bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f525ac00640 1 --2- 172.21.15.173:0/91538221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f525406e1c0 0x7f525406bed0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f52440098a0 tx=0x7f524401ed30 comp rx=0 tx=0).stop 2024-04-25T09:03:49.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f525ac00640 1 -- 172.21.15.173:0/91538221 shutdown_connections 2024-04-25T09:03:49.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f525ac00640 1 --2- 172.21.15.173:0/91538221 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525406c410 0x7f52540aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f525ac00640 1 --2- 172.21.15.173:0/91538221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f525406e1c0 0x7f525406bed0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f525ac00640 1 -- 172.21.15.173:0/91538221 >> 172.21.15.173:0/91538221 conn(0x7f52540cfed0 msgr2=0x7f52540d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:49.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f525ac00640 1 -- 172.21.15.173:0/91538221 shutdown_connections 2024-04-25T09:03:49.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f525ac00640 1 -- 172.21.15.173:0/91538221 wait complete. 2024-04-25T09:03:49.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f525ac00640 1 Processor -- start 2024-04-25T09:03:49.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f525ac00640 1 -- start start 2024-04-25T09:03:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f525ac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f525406c410 0x7f5254145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f525ac00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f525406e1c0 0x7f525415aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f525ac00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52540ad3f0 0x7f525415ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f525ac00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525406b9b0 con 0x7f525406e1c0 2024-04-25T09:03:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f525ac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525406b6d0 con 0x7f525406c410 2024-04-25T09:03:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.145+0000 7f525ac00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52540ad8a0 con 0x7f52540ad3f0 2024-04-25T09:03:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f524b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f525406e1c0 0x7f525415aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f524b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f525406e1c0 0x7f525415aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59550/0 (socket says 172.21.15.173:59550) 2024-04-25T09:03:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f524b400640 1 -- 172.21.15.173:0/2467450058 learned_addr learned my addr 172.21.15.173:0/2467450058 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f5258c00640 1 --2- 172.21.15.173:0/2467450058 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52540ad3f0 0x7f525415ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f5253e00640 1 --2- 172.21.15.173:0/2467450058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f525406c410 0x7f5254145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f524b400640 1 -- 172.21.15.173:0/2467450058 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52540ad3f0 msgr2=0x7f525415ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f524b400640 1 --2- 172.21.15.173:0/2467450058 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52540ad3f0 0x7f525415ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f524b400640 1 -- 172.21.15.173:0/2467450058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f525406c410 msgr2=0x7f5254145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f524b400640 1 --2- 172.21.15.173:0/2467450058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f525406c410 0x7f5254145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f524b400640 1 -- 172.21.15.173:0/2467450058 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525415b900 con 0x7f525406e1c0 2024-04-25T09:03:49.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f5253e00640 1 --2- 172.21.15.173:0/2467450058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f525406c410 0x7f5254145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:49.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f524b400640 1 --2- 172.21.15.173:0/2467450058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f525406e1c0 0x7f525415aed0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f523c00d7d0 tx=0x7f523c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:49.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f5250c00640 1 -- 172.21.15.173:0/2467450058 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c00b660 con 0x7f525406e1c0 2024-04-25T09:03:49.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f5250c00640 1 -- 172.21.15.173:0/2467450058 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c019070 con 0x7f525406e1c0 2024-04-25T09:03:49.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f5250c00640 1 -- 172.21.15.173:0/2467450058 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c00ba40 con 0x7f525406e1c0 2024-04-25T09:03:49.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f525ac00640 1 -- 172.21.15.173:0/2467450058 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525415bbe0 con 0x7f525406e1c0 2024-04-25T09:03:49.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f525ac00640 1 -- 172.21.15.173:0/2467450058 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525415c1a0 con 0x7f525406e1c0 2024-04-25T09:03:49.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f525ac00640 1 -- 172.21.15.173:0/2467450058 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5254073ab0 con 0x7f525406e1c0 2024-04-25T09:03:49.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.149+0000 7f5250c00640 1 -- 172.21.15.173:0/2467450058 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f523c00bbe0 con 0x7f525406e1c0 2024-04-25T09:03:49.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.153+0000 7f5250c00640 1 --2- 172.21.15.173:0/2467450058 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5230066f60 0x7f5230069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.153+0000 7f5250c00640 1 -- 172.21.15.173:0/2467450058 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f523c085860 con 0x7f525406e1c0 2024-04-25T09:03:49.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.153+0000 7f5253e00640 1 --2- 172.21.15.173:0/2467450058 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5230066f60 0x7f5230069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.153+0000 7f5253e00640 1 --2- 172.21.15.173:0/2467450058 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5230066f60 0x7f5230069420 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f52440b2000 tx=0x7f5244008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:49.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.157+0000 7f5250c00640 1 -- 172.21.15.173:0/2467450058 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f523c056460 con 0x7f525406e1c0 2024-04-25T09:03:49.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.309+0000 7f525ac00640 1 -- 172.21.15.173:0/2467450058 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f52540afb30 con 0x7f525406e1c0 2024-04-25T09:03:49.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.309+0000 7f5250c00640 1 -- 172.21.15.173:0/2467450058 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f523c055d60 con 0x7f525406e1c0 2024-04-25T09:03:49.301 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:03:49.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.313+0000 7f525ac00640 1 -- 172.21.15.173:0/2467450058 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5230066f60 msgr2=0x7f5230069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.313+0000 7f525ac00640 1 --2- 172.21.15.173:0/2467450058 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5230066f60 0x7f5230069420 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f52440b2000 tx=0x7f5244008040 comp rx=0 tx=0).stop 2024-04-25T09:03:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.313+0000 7f525ac00640 1 -- 172.21.15.173:0/2467450058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f525406e1c0 msgr2=0x7f525415aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.313+0000 7f525ac00640 1 --2- 172.21.15.173:0/2467450058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f525406e1c0 0x7f525415aed0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f523c00d7d0 tx=0x7f523c00dc90 comp rx=0 tx=0).stop 2024-04-25T09:03:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.313+0000 7f525ac00640 1 -- 172.21.15.173:0/2467450058 shutdown_connections 2024-04-25T09:03:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.313+0000 7f525ac00640 1 --2- 172.21.15.173:0/2467450058 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5230066f60 0x7f5230069420 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.313+0000 7f525ac00640 1 --2- 172.21.15.173:0/2467450058 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52540ad3f0 0x7f525415ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.313+0000 7f525ac00640 1 --2- 172.21.15.173:0/2467450058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f525406e1c0 0x7f525415aed0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.313+0000 7f525ac00640 1 --2- 172.21.15.173:0/2467450058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f525406c410 0x7f5254145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.313+0000 7f525ac00640 1 -- 172.21.15.173:0/2467450058 >> 172.21.15.173:0/2467450058 conn(0x7f52540cfed0 msgr2=0x7f5254157530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.313+0000 7f525ac00640 1 -- 172.21.15.173:0/2467450058 shutdown_connections 2024-04-25T09:03:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.313+0000 7f525ac00640 1 -- 172.21.15.173:0/2467450058 wait complete. 2024-04-25T09:03:49.322 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:03:49.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.469+0000 7f60fa000640 1 Processor -- start 2024-04-25T09:03:49.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.469+0000 7f60fa000640 1 -- start start 2024-04-25T09:03:49.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.473+0000 7f60fa000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60f40aeb90 0x7f60f40cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.473+0000 7f60fa000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f60f40aef70 0x7f60f40cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.473+0000 7f60fa000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f4071570 con 0x7f60f40cdba0 2024-04-25T09:03:49.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.473+0000 7f60fa000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f4071320 con 0x7f60f40aef70 2024-04-25T09:03:49.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.473+0000 7f60fa000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f4072330 con 0x7f60f40aeb90 2024-04-25T09:03:49.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.473+0000 7f60eaa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f60f40aef70 0x7f60f40cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.473+0000 7f60f3e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f60f40cdba0 0x7f60f40ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34098/0 (socket says 172.21.15.173:34098) 2024-04-25T09:03:49.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.473+0000 7f60eaa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f60f40aef70 0x7f60f40cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59558/0 (socket says 172.21.15.173:59558) 2024-04-25T09:03:49.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.473+0000 7f60f3e00640 1 -- 172.21.15.173:0/1920076882 learned_addr learned my addr 172.21.15.173:0/1920076882 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:49.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.473+0000 7f60f3400640 1 --2- 172.21.15.173:0/1920076882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60f40aeb90 0x7f60f40cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.473+0000 7f60eaa00640 1 -- 172.21.15.173:0/1920076882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60f40aeb90 msgr2=0x7f60f40cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:49.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.473+0000 7f60eaa00640 1 --2- 172.21.15.173:0/1920076882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60f40aeb90 0x7f60f40cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.473+0000 7f60eaa00640 1 -- 172.21.15.173:0/1920076882 >> v1:172.21.15.173:6789/0 conn(0x7f60f40cdba0 legacy=0x7f60f40ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.473+0000 7f60eaa00640 1 -- 172.21.15.173:0/1920076882 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f4071850 con 0x7f60f40aef70 2024-04-25T09:03:49.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.473+0000 7f60f3400640 1 --2- 172.21.15.173:0/1920076882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60f40aeb90 0x7f60f40cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:49.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.477+0000 7f60eaa00640 1 --2- 172.21.15.173:0/1920076882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60f40aef70 0x7f60f40cc610 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0097c0 tx=0x7f60dc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece5ba5b88c87615 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:49.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.477+0000 7f60f2a00640 1 -- 172.21.15.173:0/1920076882 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc0b0070 con 0x7f60f40aef70 2024-04-25T09:03:49.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.477+0000 7f60f2a00640 1 -- 172.21.15.173:0/1920076882 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc0ab600 con 0x7f60f40aef70 2024-04-25T09:03:49.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.477+0000 7f60f2a00640 1 -- 172.21.15.173:0/1920076882 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc0ab9d0 con 0x7f60f40aef70 2024-04-25T09:03:49.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.477+0000 7f60fa000640 1 -- 172.21.15.173:0/1920076882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60f40aef70 msgr2=0x7f60f40cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.477+0000 7f60fa000640 1 --2- 172.21.15.173:0/1920076882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60f40aef70 0x7f60f40cc610 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0097c0 tx=0x7f60dc01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.477+0000 7f60fa000640 1 -- 172.21.15.173:0/1920076882 shutdown_connections 2024-04-25T09:03:49.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.477+0000 7f60fa000640 1 --2- 172.21.15.173:0/1920076882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60f40aef70 0x7f60f40cc610 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.477+0000 7f60fa000640 1 --2- 172.21.15.173:0/1920076882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60f40aeb90 0x7f60f40cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.477+0000 7f60fa000640 1 -- 172.21.15.173:0/1920076882 >> 172.21.15.173:0/1920076882 conn(0x7f60f406ac90 msgr2=0x7f60f406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:49.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.477+0000 7f60fa000640 1 -- 172.21.15.173:0/1920076882 shutdown_connections 2024-04-25T09:03:49.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.477+0000 7f60fa000640 1 -- 172.21.15.173:0/1920076882 wait complete. 2024-04-25T09:03:49.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.477+0000 7f60fa000640 1 Processor -- start 2024-04-25T09:03:49.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.477+0000 7f60fa000640 1 -- start start 2024-04-25T09:03:49.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60fa000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60f40aeb90 0x7f60f4167780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60fa000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60f40aef70 0x7f60f4159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60fa000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60f40cdba0 0x7f60f41f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60fa000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f415bb30 con 0x7f60f40cdba0 2024-04-25T09:03:49.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60fa000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f415b9b0 con 0x7f60f40aef70 2024-04-25T09:03:49.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60fa000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f415bcb0 con 0x7f60f40aeb90 2024-04-25T09:03:49.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60f3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60f40cdba0 0x7f60f41f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60f3400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60f40aeb90 0x7f60f4167780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60f3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60f40cdba0 0x7f60f41f67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59562/0 (socket says 172.21.15.173:59562) 2024-04-25T09:03:49.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60f3e00640 1 -- 172.21.15.173:0/3808793195 learned_addr learned my addr 172.21.15.173:0/3808793195 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:49.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60eaa00640 1 --2- 172.21.15.173:0/3808793195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60f40aef70 0x7f60f4159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60f3e00640 1 -- 172.21.15.173:0/3808793195 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60f40aeb90 msgr2=0x7f60f4167780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60f3e00640 1 --2- 172.21.15.173:0/3808793195 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60f40aeb90 0x7f60f4167780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60f3e00640 1 -- 172.21.15.173:0/3808793195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60f40aef70 msgr2=0x7f60f4159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60f3e00640 1 --2- 172.21.15.173:0/3808793195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60f40aef70 0x7f60f4159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60f3e00640 1 -- 172.21.15.173:0/3808793195 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f4167cc0 con 0x7f60f40cdba0 2024-04-25T09:03:49.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60f3e00640 1 --2- 172.21.15.173:0/3808793195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60f40cdba0 0x7f60f41f67c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00c400 tx=0x7f60ec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:49.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60ebe00640 1 -- 172.21.15.173:0/3808793195 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec017070 con 0x7f60f40cdba0 2024-04-25T09:03:49.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60ebe00640 1 -- 172.21.15.173:0/3808793195 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec005cf0 con 0x7f60f40cdba0 2024-04-25T09:03:49.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60ebe00640 1 -- 172.21.15.173:0/3808793195 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec0072f0 con 0x7f60f40cdba0 2024-04-25T09:03:49.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60fa000640 1 -- 172.21.15.173:0/3808793195 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f40ae490 con 0x7f60f40cdba0 2024-04-25T09:03:49.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60fa000640 1 -- 172.21.15.173:0/3808793195 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f4166f80 con 0x7f60f40cdba0 2024-04-25T09:03:49.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60fa000640 1 -- 172.21.15.173:0/3808793195 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f4073ab0 con 0x7f60f40cdba0 2024-04-25T09:03:49.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.481+0000 7f60ebe00640 1 -- 172.21.15.173:0/3808793195 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f60ec01a070 con 0x7f60f40cdba0 2024-04-25T09:03:49.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.485+0000 7f60ebe00640 1 --2- 172.21.15.173:0/3808793195 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f60d0066f90 0x7f60d0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.485+0000 7f60ebe00640 1 -- 172.21.15.173:0/3808793195 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f60ec084700 con 0x7f60f40cdba0 2024-04-25T09:03:49.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.485+0000 7f60f3400640 1 --2- 172.21.15.173:0/3808793195 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f60d0066f90 0x7f60d0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.485+0000 7f60f3400640 1 --2- 172.21.15.173:0/3808793195 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f60d0066f90 0x7f60d0069450 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f60f414bd20 tx=0x7f60e4007770 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:49.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.489+0000 7f60ebe00640 1 -- 172.21.15.173:0/3808793195 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f60ec054cc0 con 0x7f60f40cdba0 2024-04-25T09:03:49.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.641+0000 7f60fa000640 1 -- 172.21.15.173:0/3808793195 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f60f40cf060 con 0x7f60f40cdba0 2024-04-25T09:03:49.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.641+0000 7f60ebe00640 1 -- 172.21.15.173:0/3808793195 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f60ec058d60 con 0x7f60f40cdba0 2024-04-25T09:03:49.632 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:03:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.645+0000 7f60fa000640 1 -- 172.21.15.173:0/3808793195 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f60d0066f90 msgr2=0x7f60d0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.645+0000 7f60fa000640 1 --2- 172.21.15.173:0/3808793195 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f60d0066f90 0x7f60d0069450 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f60f414bd20 tx=0x7f60e4007770 comp rx=0 tx=0).stop 2024-04-25T09:03:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.645+0000 7f60fa000640 1 -- 172.21.15.173:0/3808793195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60f40cdba0 msgr2=0x7f60f41f67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.645+0000 7f60fa000640 1 --2- 172.21.15.173:0/3808793195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60f40cdba0 0x7f60f41f67c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00c400 tx=0x7f60ec00c8c0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.645+0000 7f60fa000640 1 -- 172.21.15.173:0/3808793195 shutdown_connections 2024-04-25T09:03:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.645+0000 7f60fa000640 1 --2- 172.21.15.173:0/3808793195 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f60d0066f90 0x7f60d0069450 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.645+0000 7f60fa000640 1 --2- 172.21.15.173:0/3808793195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60f40cdba0 0x7f60f41f67c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.645+0000 7f60fa000640 1 --2- 172.21.15.173:0/3808793195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60f40aef70 0x7f60f4159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.645+0000 7f60fa000640 1 --2- 172.21.15.173:0/3808793195 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60f40aeb90 0x7f60f4167780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.645+0000 7f60fa000640 1 -- 172.21.15.173:0/3808793195 >> 172.21.15.173:0/3808793195 conn(0x7f60f406ac90 msgr2=0x7f60f406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:49.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.645+0000 7f60fa000640 1 -- 172.21.15.173:0/3808793195 shutdown_connections 2024-04-25T09:03:49.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.645+0000 7f60fa000640 1 -- 172.21.15.173:0/3808793195 wait complete. 2024-04-25T09:03:49.653 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:49.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e2a00640 1 Processor -- start 2024-04-25T09:03:49.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e2a00640 1 -- start start 2024-04-25T09:03:49.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e2a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32dc06b3a0 0x7f32dc0cc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e2a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f32dc0cc540 0x7f32dc0cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e2a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32dc15c0f0 con 0x7f32dc15b850 2024-04-25T09:03:49.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e2a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32dc0cf6c0 con 0x7f32dc0cc540 2024-04-25T09:03:49.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e2a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc15bc30 con 0x7f32dc06b3a0 2024-04-25T09:03:49.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e1600640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f32dc15b850 0x7f32dc06ac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34100/0 (socket says 172.21.15.173:34100) 2024-04-25T09:03:49.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e1600640 1 -- 172.21.15.173:0/2557969943 learned_addr learned my addr 172.21.15.173:0/2557969943 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:49.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e0c00640 1 --2- 172.21.15.173:0/2557969943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32dc06b3a0 0x7f32dc0cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e2000640 1 --2- 172.21.15.173:0/2557969943 >> v2:172.21.15.194:3300/0 conn(0x7f32dc0cc540 0x7f32dc0cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32dbe00640 1 -- 172.21.15.173:0/2557969943 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541437217 0 0) 0x7f32dc15c0f0 con 0x7f32dc15b850 2024-04-25T09:03:49.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32dbe00640 1 -- 172.21.15.173:0/2557969943 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32c4003530 con 0x7f32dc15b850 2024-04-25T09:03:49.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32dbe00640 1 -- 172.21.15.173:0/2557969943 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 591496957 0 0) 0x7f32c4003530 con 0x7f32dc15b850 2024-04-25T09:03:49.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32dbe00640 1 -- 172.21.15.173:0/2557969943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32dc06b3a0 msgr2=0x7f32dc0cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:49.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32dbe00640 1 --2- 172.21.15.173:0/2557969943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32dc06b3a0 0x7f32dc0cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32dbe00640 1 -- 172.21.15.173:0/2557969943 >> v2:172.21.15.194:3300/0 conn(0x7f32dc0cc540 msgr2=0x7f32dc0cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:49.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32dbe00640 1 --2- 172.21.15.173:0/2557969943 >> v2:172.21.15.194:3300/0 conn(0x7f32dc0cc540 0x7f32dc0cfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32dbe00640 1 -- 172.21.15.173:0/2557969943 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc0ccc70 con 0x7f32dc15b850 2024-04-25T09:03:49.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32dbe00640 1 -- 172.21.15.173:0/2557969943 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f32d0001680 con 0x7f32dc15b850 2024-04-25T09:03:49.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32dbe00640 1 -- 172.21.15.173:0/2557969943 >> v1:172.21.15.173:6789/0 conn(0x7f32dc15b850 legacy=0x7f32dc06ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32dbe00640 1 --2- 172.21.15.173:0/2557969943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c40039c0 0x7f32c4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32dbe00640 1 --2- 172.21.15.173:0/2557969943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c4004810 0x7f32c4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32dbe00640 1 --2- 172.21.15.173:0/2557969943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32dc06b3a0 0x7f32c40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32dbe00640 1 -- 172.21.15.173:0/2557969943 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc0cf6c0 con 0x7f32c40039c0 2024-04-25T09:03:49.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32dbe00640 1 -- 172.21.15.173:0/2557969943 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc15bc30 con 0x7f32c4004810 2024-04-25T09:03:49.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32dbe00640 1 -- 172.21.15.173:0/2557969943 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c400b9d0 con 0x7f32dc06b3a0 2024-04-25T09:03:49.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e1600640 1 --2- 172.21.15.173:0/2557969943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c40039c0 0x7f32c4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e0c00640 1 --2- 172.21.15.173:0/2557969943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c4004810 0x7f32c4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e2000640 1 --2- 172.21.15.173:0/2557969943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32dc06b3a0 0x7f32c40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e1600640 1 -- 172.21.15.173:0/2557969943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32dc06b3a0 msgr2=0x7f32c40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:49.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e1600640 1 --2- 172.21.15.173:0/2557969943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32dc06b3a0 0x7f32c40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e1600640 1 -- 172.21.15.173:0/2557969943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c4004810 msgr2=0x7f32c4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:49.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e1600640 1 --2- 172.21.15.173:0/2557969943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c4004810 0x7f32c4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e1600640 1 -- 172.21.15.173:0/2557969943 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c4003530 con 0x7f32c40039c0 2024-04-25T09:03:49.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e0c00640 1 --2- 172.21.15.173:0/2557969943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32c4004810 0x7f32c4004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:49.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.801+0000 7f32e2000640 1 --2- 172.21.15.173:0/2557969943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32dc06b3a0 0x7f32c40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:49.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.805+0000 7f32e1600640 1 --2- 172.21.15.173:0/2557969943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c40039c0 0x7f32c4003de0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f32d000c190 tx=0x7f32d001cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412ce04fcdc2ceee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:49.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.805+0000 7f32dbe00640 1 -- 172.21.15.173:0/2557969943 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0007c90 con 0x7f32c40039c0 2024-04-25T09:03:49.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.805+0000 7f32dbe00640 1 -- 172.21.15.173:0/2557969943 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d00a9020 con 0x7f32c40039c0 2024-04-25T09:03:49.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.805+0000 7f32dbe00640 1 -- 172.21.15.173:0/2557969943 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0005ae0 con 0x7f32c40039c0 2024-04-25T09:03:49.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.805+0000 7f32e2a00640 1 -- 172.21.15.173:0/2557969943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c40039c0 msgr2=0x7f32c4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.805+0000 7f32e2a00640 1 --2- 172.21.15.173:0/2557969943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32c40039c0 0x7f32c4003de0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f32d000c190 tx=0x7f32d001cb70 comp rx=0 tx=0).stop 2024-04-25T09:03:49.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.805+0000 7f32e2000640 1 -- 172.21.15.173:0/2557969943 reap_dead start 2024-04-25T09:03:49.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.805+0000 7f32e2a00640 1 -- 172.21.15.173:0/2557969943 shutdown_connections 2024-04-25T09:03:49.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.805+0000 7f32e2a00640 1 -- 172.21.15.173:0/2557969943 >> 172.21.15.173:0/2557969943 conn(0x7f32dc072710 msgr2=0x7f32dc099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:49.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.805+0000 7f32e2a00640 1 -- 172.21.15.173:0/2557969943 shutdown_connections 2024-04-25T09:03:49.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.805+0000 7f32e2a00640 1 -- 172.21.15.173:0/2557969943 wait complete. 2024-04-25T09:03:49.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e2a00640 1 Processor -- start 2024-04-25T09:03:49.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e2a00640 1 -- start start 2024-04-25T09:03:49.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e2a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32c40039c0 0x7f32dc0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32dc14bb90 0x7f32dc147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e2a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32dc148520 0x7f32dc0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e2a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc0d08a0 con 0x7f32dc14bb90 2024-04-25T09:03:49.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e2a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc0cc950 con 0x7f32dc148520 2024-04-25T09:03:49.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e2a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc0d0a20 con 0x7f32c40039c0 2024-04-25T09:03:49.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e0c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32dc14bb90 0x7f32dc147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e0c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32dc14bb90 0x7f32dc147fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59582/0 (socket says 172.21.15.173:59582) 2024-04-25T09:03:49.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e0c00640 1 -- 172.21.15.173:0/3460983325 learned_addr learned my addr 172.21.15.173:0/3460983325 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:49.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e1600640 1 --2- 172.21.15.173:0/3460983325 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32c40039c0 0x7f32dc0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e2000640 1 --2- 172.21.15.173:0/3460983325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32dc148520 0x7f32dc0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e0c00640 1 -- 172.21.15.173:0/3460983325 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32c40039c0 msgr2=0x7f32dc0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e0c00640 1 --2- 172.21.15.173:0/3460983325 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32c40039c0 0x7f32dc0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e0c00640 1 -- 172.21.15.173:0/3460983325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32dc148520 msgr2=0x7f32dc0b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:49.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e0c00640 1 --2- 172.21.15.173:0/3460983325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32dc148520 0x7f32dc0b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:49.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e0c00640 1 -- 172.21.15.173:0/3460983325 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc1f6b60 con 0x7f32dc14bb90 2024-04-25T09:03:49.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e2000640 1 --2- 172.21.15.173:0/3460983325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32dc148520 0x7f32dc0b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:49.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e0c00640 1 --2- 172.21.15.173:0/3460983325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32dc14bb90 0x7f32dc147fe0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f32c80115d0 tx=0x7f32c8011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:49.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32d9600640 1 -- 172.21.15.173:0/3460983325 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8004220 con 0x7f32dc14bb90 2024-04-25T09:03:49.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32d9600640 1 -- 172.21.15.173:0/3460983325 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c80043c0 con 0x7f32dc14bb90 2024-04-25T09:03:49.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32d9600640 1 -- 172.21.15.173:0/3460983325 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8015890 con 0x7f32dc14bb90 2024-04-25T09:03:49.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e2a00640 1 -- 172.21.15.173:0/3460983325 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32dc160e40 con 0x7f32dc14bb90 2024-04-25T09:03:49.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.809+0000 7f32e2a00640 1 -- 172.21.15.173:0/3460983325 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32dc161400 con 0x7f32dc14bb90 2024-04-25T09:03:49.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.813+0000 7f32e2a00640 1 -- 172.21.15.173:0/3460983325 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32dc073a40 con 0x7f32dc14bb90 2024-04-25T09:03:49.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.813+0000 7f32d9600640 1 -- 172.21.15.173:0/3460983325 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f32c8015a30 con 0x7f32dc14bb90 2024-04-25T09:03:49.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.813+0000 7f32d9600640 1 --2- 172.21.15.173:0/3460983325 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f32bc066f90 0x7f32bc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:49.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.813+0000 7f32d9600640 1 -- 172.21.15.173:0/3460983325 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f32c8085960 con 0x7f32dc14bb90 2024-04-25T09:03:49.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.813+0000 7f32e1600640 1 --2- 172.21.15.173:0/3460983325 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f32bc066f90 0x7f32bc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:49.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.813+0000 7f32e1600640 1 --2- 172.21.15.173:0/3460983325 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f32bc066f90 0x7f32bc069450 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f32d00aa000 tx=0x7f32d00019f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:49.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:49.817+0000 7f32d9600640 1 -- 172.21.15.173:0/3460983325 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f32dc1f6b60 con 0x7f32dc14bb90 2024-04-25T09:03:49.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.009+0000 7f32e2a00640 1 -- 172.21.15.173:0/3460983325 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32dc15e970 con 0x7f32dc14bb90 2024-04-25T09:03:49.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.009+0000 7f32d9600640 1 -- 172.21.15.173:0/3460983325 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4946 (secure 0 0 0) 0x7f32c8019030 con 0x7f32dc14bb90 2024-04-25T09:03:49.999 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:50.000 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2883565303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2883565303},{"type":"v1","addr":"172.21.15.194:6834","nonce":2883565303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2634963400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2634963400},{"type":"v1","addr":"172.21.15.173:6837","nonce":2634963400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3101502434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3101502434},{"type":"v1","addr":"172.21.15.173:6836","nonce":3101502434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:51.389514+0000","modified":"2024-04-25T09:03:08.473956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/4160663138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4160663138},{"type":"v1","addr":"172.21.15.194:6835","nonce":4160663138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:03:50.000 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 9 2024-04-25T09:03:50.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.009+0000 7f32e2a00640 1 -- 172.21.15.173:0/3460983325 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f32bc066f90 msgr2=0x7f32bc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.009+0000 7f32e2a00640 1 --2- 172.21.15.173:0/3460983325 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f32bc066f90 0x7f32bc069450 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f32d00aa000 tx=0x7f32d00019f0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.009+0000 7f32e2a00640 1 -- 172.21.15.173:0/3460983325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32dc14bb90 msgr2=0x7f32dc147fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.009+0000 7f32e2a00640 1 --2- 172.21.15.173:0/3460983325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32dc14bb90 0x7f32dc147fe0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f32c80115d0 tx=0x7f32c8011a90 comp rx=0 tx=0).stop 2024-04-25T09:03:50.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.013+0000 7f32e2a00640 1 -- 172.21.15.173:0/3460983325 shutdown_connections 2024-04-25T09:03:50.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.013+0000 7f32e2a00640 1 --2- 172.21.15.173:0/3460983325 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f32bc066f90 0x7f32bc069450 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.013+0000 7f32e2a00640 1 --2- 172.21.15.173:0/3460983325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32dc148520 0x7f32dc0b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.013+0000 7f32e2a00640 1 --2- 172.21.15.173:0/3460983325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32dc14bb90 0x7f32dc147fe0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.013+0000 7f32e2a00640 1 --2- 172.21.15.173:0/3460983325 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32c40039c0 0x7f32dc0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.013+0000 7f32e2a00640 1 -- 172.21.15.173:0/3460983325 >> 172.21.15.173:0/3460983325 conn(0x7f32dc072710 msgr2=0x7f32dc15dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.013+0000 7f32e2a00640 1 -- 172.21.15.173:0/3460983325 shutdown_connections 2024-04-25T09:03:50.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.013+0000 7f32e2a00640 1 -- 172.21.15.173:0/3460983325 wait complete. 2024-04-25T09:03:50.020 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:50.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.165+0000 7f7d2f000640 1 Processor -- start 2024-04-25T09:03:50.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.165+0000 7f7d2f000640 1 -- start start 2024-04-25T09:03:50.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.165+0000 7f7d2f000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7d280cc8b0 0x7f7d280ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.165+0000 7f7d2f000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d2806e7c0 con 0x7f7d28145250 2024-04-25T09:03:50.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.165+0000 7f7d2f000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d2806d720 con 0x7f7d280ce8f0 2024-04-25T09:03:50.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.165+0000 7f7d2f000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2806da00 con 0x7f7d280cc8b0 2024-04-25T09:03:50.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.165+0000 7f7d1f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7d280cc8b0 0x7f7d280ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.165+0000 7f7d27e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f7d28145250 0x7f7d2815c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34116/0 (socket says 172.21.15.173:34116) 2024-04-25T09:03:50.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.165+0000 7f7d27e00640 1 -- 172.21.15.173:0/2686831156 learned_addr learned my addr 172.21.15.173:0/2686831156 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:50.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.165+0000 7f7d1f400640 1 -- 172.21.15.173:0/2686831156 >> v1:172.21.15.194:6789/0 conn(0x7f7d280ce8f0 legacy=0x7f7d280ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.165+0000 7f7d1f400640 1 -- 172.21.15.173:0/2686831156 >> v1:172.21.15.173:6789/0 conn(0x7f7d28145250 legacy=0x7f7d2815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.169+0000 7f7d1f400640 1 -- 172.21.15.173:0/2686831156 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2806dce0 con 0x7f7d280cc8b0 2024-04-25T09:03:50.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.169+0000 7f7d1f400640 1 --2- 172.21.15.173:0/2686831156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d280cc8b0 0x7f7d280ccd30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7d100097c0 tx=0x7f7d1001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63a40635bcbfd50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.169+0000 7f7d27400640 1 -- 172.21.15.173:0/2686831156 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d100b1070 con 0x7f7d280cc8b0 2024-04-25T09:03:50.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.169+0000 7f7d27400640 1 -- 172.21.15.173:0/2686831156 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d100ac5f0 con 0x7f7d280cc8b0 2024-04-25T09:03:50.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.169+0000 7f7d27400640 1 -- 172.21.15.173:0/2686831156 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d100ac9c0 con 0x7f7d280cc8b0 2024-04-25T09:03:50.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.169+0000 7f7d2f000640 1 -- 172.21.15.173:0/2686831156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d280cc8b0 msgr2=0x7f7d280ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.169+0000 7f7d2f000640 1 --2- 172.21.15.173:0/2686831156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d280cc8b0 0x7f7d280ccd30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7d100097c0 tx=0x7f7d1001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.169+0000 7f7d2f000640 1 -- 172.21.15.173:0/2686831156 shutdown_connections 2024-04-25T09:03:50.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.169+0000 7f7d2f000640 1 --2- 172.21.15.173:0/2686831156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d280cc8b0 0x7f7d280ccd30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.169+0000 7f7d2f000640 1 -- 172.21.15.173:0/2686831156 >> 172.21.15.173:0/2686831156 conn(0x7f7d2806ac90 msgr2=0x7f7d2806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.169+0000 7f7d2f000640 1 -- 172.21.15.173:0/2686831156 shutdown_connections 2024-04-25T09:03:50.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.169+0000 7f7d2f000640 1 -- 172.21.15.173:0/2686831156 wait complete. 2024-04-25T09:03:50.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d2f000640 1 Processor -- start 2024-04-25T09:03:50.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d2f000640 1 -- start start 2024-04-25T09:03:50.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d2f000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d280cc8b0 0x7f7d2815b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d2f000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d280ce8f0 0x7f7d28142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d2f000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d28145250 0x7f7d2813e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d2f000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2806d380 con 0x7f7d280ce8f0 2024-04-25T09:03:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d2f000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2806ef80 con 0x7f7d280cc8b0 2024-04-25T09:03:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d2f000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2806d500 con 0x7f7d28145250 2024-04-25T09:03:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d1f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d280ce8f0 0x7f7d28142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d1f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d280ce8f0 0x7f7d28142b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59602/0 (socket says 172.21.15.173:59602) 2024-04-25T09:03:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d27e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d280cc8b0 0x7f7d2815b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d1f400640 1 -- 172.21.15.173:0/3821235959 learned_addr learned my addr 172.21.15.173:0/3821235959 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d2d000640 1 --2- 172.21.15.173:0/3821235959 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d28145250 0x7f7d2813e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d1f400640 1 -- 172.21.15.173:0/3821235959 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d28145250 msgr2=0x7f7d2813e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d1f400640 1 --2- 172.21.15.173:0/3821235959 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d28145250 0x7f7d2813e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d1f400640 1 -- 172.21.15.173:0/3821235959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d280cc8b0 msgr2=0x7f7d2815b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d1f400640 1 --2- 172.21.15.173:0/3821235959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d280cc8b0 0x7f7d2815b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d1f400640 1 -- 172.21.15.173:0/3821235959 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2814d700 con 0x7f7d280ce8f0 2024-04-25T09:03:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d2d000640 1 --2- 172.21.15.173:0/3821235959 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d28145250 0x7f7d2813e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d1f400640 1 --2- 172.21.15.173:0/3821235959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d280ce8f0 0x7f7d28142b90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7d1001ab50 tx=0x7f7d10019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d24c00640 1 -- 172.21.15.173:0/3821235959 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d100b1040 con 0x7f7d280ce8f0 2024-04-25T09:03:50.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d24c00640 1 -- 172.21.15.173:0/3821235959 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d100bb070 con 0x7f7d280ce8f0 2024-04-25T09:03:50.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d2f000640 1 -- 172.21.15.173:0/3821235959 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d2813d910 con 0x7f7d280ce8f0 2024-04-25T09:03:50.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d24c00640 1 -- 172.21.15.173:0/3821235959 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d100b5650 con 0x7f7d280ce8f0 2024-04-25T09:03:50.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.173+0000 7f7d2f000640 1 -- 172.21.15.173:0/3821235959 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d2813ded0 con 0x7f7d280ce8f0 2024-04-25T09:03:50.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.177+0000 7f7d2f000640 1 -- 172.21.15.173:0/3821235959 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d28073a40 con 0x7f7d280ce8f0 2024-04-25T09:03:50.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.177+0000 7f7d24c00640 1 -- 172.21.15.173:0/3821235959 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7d100b57f0 con 0x7f7d280ce8f0 2024-04-25T09:03:50.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.177+0000 7f7d24c00640 1 --2- 172.21.15.173:0/3821235959 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7d04066f60 0x7f7d04069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.177+0000 7f7d24c00640 1 -- 172.21.15.173:0/3821235959 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7d1011f1c0 con 0x7f7d280ce8f0 2024-04-25T09:03:50.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.177+0000 7f7d27e00640 1 --2- 172.21.15.173:0/3821235959 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7d04066f60 0x7f7d04069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.177+0000 7f7d27e00640 1 --2- 172.21.15.173:0/3821235959 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7d04066f60 0x7f7d04069420 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7d18005890 tx=0x7f7d18009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.181+0000 7f7d24c00640 1 -- 172.21.15.173:0/3821235959 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7d100a9070 con 0x7f7d280ce8f0 2024-04-25T09:03:50.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.341+0000 7f7d2f000640 1 -- 172.21.15.173:0/3821235959 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d2813ff10 con 0x7f7d280ce8f0 2024-04-25T09:03:50.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.345+0000 7f7d24c00640 1 -- 172.21.15.173:0/3821235959 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18906 (secure 0 0 0) 0x7f7d10016090 con 0x7f7d280ce8f0 2024-04-25T09:03:50.334 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:50.334 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":28,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:03:32.190313+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:50.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.345+0000 7f7d2f000640 1 -- 172.21.15.173:0/3821235959 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7d04066f60 msgr2=0x7f7d04069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.345+0000 7f7d2f000640 1 --2- 172.21.15.173:0/3821235959 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7d04066f60 0x7f7d04069420 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7d18005890 tx=0x7f7d18009040 comp rx=0 tx=0).stop 2024-04-25T09:03:50.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.345+0000 7f7d2f000640 1 -- 172.21.15.173:0/3821235959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d280ce8f0 msgr2=0x7f7d28142b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.345+0000 7f7d2f000640 1 --2- 172.21.15.173:0/3821235959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d280ce8f0 0x7f7d28142b90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7d1001ab50 tx=0x7f7d10019240 comp rx=0 tx=0).stop 2024-04-25T09:03:50.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.345+0000 7f7d2f000640 1 -- 172.21.15.173:0/3821235959 shutdown_connections 2024-04-25T09:03:50.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.345+0000 7f7d2f000640 1 --2- 172.21.15.173:0/3821235959 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7d04066f60 0x7f7d04069420 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.345+0000 7f7d2f000640 1 --2- 172.21.15.173:0/3821235959 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d28145250 0x7f7d2813e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.345+0000 7f7d2f000640 1 --2- 172.21.15.173:0/3821235959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d280ce8f0 0x7f7d28142b90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.345+0000 7f7d2f000640 1 --2- 172.21.15.173:0/3821235959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d280cc8b0 0x7f7d2815b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.345+0000 7f7d2f000640 1 -- 172.21.15.173:0/3821235959 >> 172.21.15.173:0/3821235959 conn(0x7f7d2806ac90 msgr2=0x7f7d2815bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.345+0000 7f7d2f000640 1 -- 172.21.15.173:0/3821235959 shutdown_connections 2024-04-25T09:03:50.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.345+0000 7f7d2f000640 1 -- 172.21.15.173:0/3821235959 wait complete. 2024-04-25T09:03:50.355 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:03:50.355 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:50.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.501+0000 7f3219e00640 1 Processor -- start 2024-04-25T09:03:50.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.501+0000 7f3219e00640 1 -- start start 2024-04-25T09:03:50.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.501+0000 7f3219e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32140cc8b0 0x7f32140ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.501+0000 7f3219e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321406e7c0 con 0x7f3214145250 2024-04-25T09:03:50.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.501+0000 7f3219e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321406d720 con 0x7f32140ce8f0 2024-04-25T09:03:50.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.501+0000 7f3219e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321406da00 con 0x7f32140cc8b0 2024-04-25T09:03:50.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.501+0000 7f3212a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f3214145250 0x7f321415c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34132/0 (socket says 172.21.15.173:34132) 2024-04-25T09:03:50.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.501+0000 7f3212a00640 1 -- 172.21.15.173:0/2073730753 learned_addr learned my addr 172.21.15.173:0/2073730753 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.501+0000 7f3212000640 1 -- 172.21.15.173:0/2073730753 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485078008 0 0) 0x7f321406e7c0 con 0x7f3214145250 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.501+0000 7f320a000640 1 --2- 172.21.15.173:0/2073730753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32140cc8b0 0x7f32140ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212000640 1 -- 172.21.15.173:0/2073730753 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31f8003530 con 0x7f3214145250 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212000640 1 -- 172.21.15.173:0/2073730753 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2367168837 0 0) 0x7f31f8003530 con 0x7f3214145250 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212000640 1 -- 172.21.15.173:0/2073730753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32140cc8b0 msgr2=0x7f32140ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212000640 1 --2- 172.21.15.173:0/2073730753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32140cc8b0 0x7f32140ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212000640 1 -- 172.21.15.173:0/2073730753 >> v1:172.21.15.194:6789/0 conn(0x7f32140ce8f0 legacy=0x7f32140ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212000640 1 -- 172.21.15.173:0/2073730753 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321406dce0 con 0x7f3214145250 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212000640 1 -- 172.21.15.173:0/2073730753 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f3204001680 con 0x7f3214145250 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212000640 1 -- 172.21.15.173:0/2073730753 >> v1:172.21.15.173:6789/0 conn(0x7f3214145250 legacy=0x7f321415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212000640 1 --2- 172.21.15.173:0/2073730753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31f80039f0 0x7f31f8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212000640 1 --2- 172.21.15.173:0/2073730753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32140cc8b0 0x7f31f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212000640 1 --2- 172.21.15.173:0/2073730753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f8004d50 0x7f31f80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212000640 1 -- 172.21.15.173:0/2073730753 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321406da00 con 0x7f31f80039f0 2024-04-25T09:03:50.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212000640 1 -- 172.21.15.173:0/2073730753 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f800ba80 con 0x7f31f8004d50 2024-04-25T09:03:50.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212000640 1 -- 172.21.15.173:0/2073730753 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f800bc80 con 0x7f32140cc8b0 2024-04-25T09:03:50.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212a00640 1 --2- 172.21.15.173:0/2073730753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31f80039f0 0x7f31f8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f320a000640 1 --2- 172.21.15.173:0/2073730753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32140cc8b0 0x7f31f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3213400640 1 --2- 172.21.15.173:0/2073730753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f8004d50 0x7f31f80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212a00640 1 -- 172.21.15.173:0/2073730753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32140cc8b0 msgr2=0x7f31f8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212a00640 1 --2- 172.21.15.173:0/2073730753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32140cc8b0 0x7f31f8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212a00640 1 -- 172.21.15.173:0/2073730753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f8004d50 msgr2=0x7f31f80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212a00640 1 --2- 172.21.15.173:0/2073730753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f8004d50 0x7f31f80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.505+0000 7f3212a00640 1 -- 172.21.15.173:0/2073730753 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f8003530 con 0x7f31f80039f0 2024-04-25T09:03:50.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3212a00640 1 --2- 172.21.15.173:0/2073730753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31f80039f0 0x7f31f8003e10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f320400c190 tx=0x7f320401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297f7fb83d36c10d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3212000640 1 -- 172.21.15.173:0/2073730753 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3204007d00 con 0x7f31f80039f0 2024-04-25T09:03:50.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3212000640 1 -- 172.21.15.173:0/2073730753 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32040a9020 con 0x7f31f80039f0 2024-04-25T09:03:50.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3212000640 1 -- 172.21.15.173:0/2073730753 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32040a5af0 con 0x7f31f80039f0 2024-04-25T09:03:50.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3219e00640 1 -- 172.21.15.173:0/2073730753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31f80039f0 msgr2=0x7f31f8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3219e00640 1 --2- 172.21.15.173:0/2073730753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31f80039f0 0x7f31f8003e10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f320400c190 tx=0x7f320401cc10 comp rx=0 tx=0).stop 2024-04-25T09:03:50.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3213400640 1 -- 172.21.15.173:0/2073730753 reap_dead start 2024-04-25T09:03:50.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3219e00640 1 -- 172.21.15.173:0/2073730753 shutdown_connections 2024-04-25T09:03:50.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3219e00640 1 -- 172.21.15.173:0/2073730753 >> 172.21.15.173:0/2073730753 conn(0x7f321406ac90 msgr2=0x7f321406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3219e00640 1 -- 172.21.15.173:0/2073730753 shutdown_connections 2024-04-25T09:03:50.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3219e00640 1 -- 172.21.15.173:0/2073730753 wait complete. 2024-04-25T09:03:50.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3219e00640 1 Processor -- start 2024-04-25T09:03:50.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3219e00640 1 -- start start 2024-04-25T09:03:50.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3219e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f80039f0 0x7f321415b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3219e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32141f6b00 0x7f32141f6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3219e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321415d800 0x7f321415dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3219e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321406d380 con 0x7f321415d800 2024-04-25T09:03:50.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3219e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321406ef80 con 0x7f31f80039f0 2024-04-25T09:03:50.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3219e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321406d500 con 0x7f32141f6b00 2024-04-25T09:03:50.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3213400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321415d800 0x7f321415dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3213400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321415d800 0x7f321415dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59622/0 (socket says 172.21.15.173:59622) 2024-04-25T09:03:50.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3213400640 1 -- 172.21.15.173:0/182096038 learned_addr learned my addr 172.21.15.173:0/182096038 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:50.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f3212a00640 1 --2- 172.21.15.173:0/182096038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f80039f0 0x7f321415b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.509+0000 7f320a000640 1 --2- 172.21.15.173:0/182096038 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32141f6b00 0x7f32141f6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.513+0000 7f3213400640 1 -- 172.21.15.173:0/182096038 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32141f6b00 msgr2=0x7f32141f6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.513+0000 7f3213400640 1 --2- 172.21.15.173:0/182096038 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32141f6b00 0x7f32141f6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.513+0000 7f3213400640 1 -- 172.21.15.173:0/182096038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f80039f0 msgr2=0x7f321415b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.513+0000 7f3213400640 1 --2- 172.21.15.173:0/182096038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f80039f0 0x7f321415b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.513+0000 7f3213400640 1 -- 172.21.15.173:0/182096038 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32140b0930 con 0x7f321415d800 2024-04-25T09:03:50.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.513+0000 7f3213400640 1 --2- 172.21.15.173:0/182096038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321415d800 0x7f321415dc80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3214062690 tx=0x7f320c00fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.513+0000 7f320be00640 1 -- 172.21.15.173:0/182096038 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c01a070 con 0x7f321415d800 2024-04-25T09:03:50.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.513+0000 7f320be00640 1 -- 172.21.15.173:0/182096038 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320c00fe60 con 0x7f321415d800 2024-04-25T09:03:50.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.513+0000 7f320be00640 1 -- 172.21.15.173:0/182096038 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c003980 con 0x7f321415d800 2024-04-25T09:03:50.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.513+0000 7f3219e00640 1 -- 172.21.15.173:0/182096038 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32140b0ba0 con 0x7f321415d800 2024-04-25T09:03:50.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.513+0000 7f3219e00640 1 -- 172.21.15.173:0/182096038 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32140b1160 con 0x7f321415d800 2024-04-25T09:03:50.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.513+0000 7f3219e00640 1 -- 172.21.15.173:0/182096038 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3214073a40 con 0x7f321415d800 2024-04-25T09:03:50.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.513+0000 7f320be00640 1 -- 172.21.15.173:0/182096038 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f320c003b20 con 0x7f321415d800 2024-04-25T09:03:50.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.513+0000 7f320be00640 1 --2- 172.21.15.173:0/182096038 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31f0066f90 0x7f31f0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.513+0000 7f320be00640 1 -- 172.21.15.173:0/182096038 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f320c084b00 con 0x7f321415d800 2024-04-25T09:03:50.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.513+0000 7f3212a00640 1 --2- 172.21.15.173:0/182096038 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31f0066f90 0x7f31f0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.517+0000 7f3212a00640 1 --2- 172.21.15.173:0/182096038 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31f0066f90 0x7f31f0069450 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f32040aa000 tx=0x7f32140d0250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.517+0000 7f320be00640 1 -- 172.21.15.173:0/182096038 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f320c055030 con 0x7f321415d800 2024-04-25T09:03:50.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.705+0000 7f3219e00640 1 -- 172.21.15.173:0/182096038 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f321415bd80 con 0x7f321415d800 2024-04-25T09:03:50.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.705+0000 7f320be00640 1 -- 172.21.15.173:0/182096038 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4946 (secure 0 0 0) 0x7f320c0590d0 con 0x7f321415d800 2024-04-25T09:03:50.695 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:50.695 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2883565303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2883565303},{"type":"v1","addr":"172.21.15.194:6834","nonce":2883565303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2634963400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2634963400},{"type":"v1","addr":"172.21.15.173:6837","nonce":2634963400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3101502434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3101502434},{"type":"v1","addr":"172.21.15.173:6836","nonce":3101502434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:51.389514+0000","modified":"2024-04-25T09:03:08.473956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/4160663138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4160663138},{"type":"v1","addr":"172.21.15.194:6835","nonce":4160663138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:03:50.695 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 9 2024-04-25T09:03:50.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.705+0000 7f3219e00640 1 -- 172.21.15.173:0/182096038 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31f0066f90 msgr2=0x7f31f0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.705+0000 7f3219e00640 1 --2- 172.21.15.173:0/182096038 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31f0066f90 0x7f31f0069450 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f32040aa000 tx=0x7f32140d0250 comp rx=0 tx=0).stop 2024-04-25T09:03:50.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.705+0000 7f3219e00640 1 -- 172.21.15.173:0/182096038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321415d800 msgr2=0x7f321415dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.705+0000 7f3219e00640 1 --2- 172.21.15.173:0/182096038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321415d800 0x7f321415dc80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3214062690 tx=0x7f320c00fc10 comp rx=0 tx=0).stop 2024-04-25T09:03:50.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.705+0000 7f3219e00640 1 -- 172.21.15.173:0/182096038 shutdown_connections 2024-04-25T09:03:50.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.705+0000 7f3219e00640 1 --2- 172.21.15.173:0/182096038 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31f0066f90 0x7f31f0069450 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.705+0000 7f3219e00640 1 --2- 172.21.15.173:0/182096038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321415d800 0x7f321415dc80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.705+0000 7f3219e00640 1 --2- 172.21.15.173:0/182096038 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32141f6b00 0x7f32141f6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.705+0000 7f3219e00640 1 --2- 172.21.15.173:0/182096038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f80039f0 0x7f321415b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.705+0000 7f3219e00640 1 -- 172.21.15.173:0/182096038 >> 172.21.15.173:0/182096038 conn(0x7f321406ac90 msgr2=0x7f32140ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.705+0000 7f3219e00640 1 -- 172.21.15.173:0/182096038 shutdown_connections 2024-04-25T09:03:50.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.705+0000 7f3219e00640 1 -- 172.21.15.173:0/182096038 wait complete. 2024-04-25T09:03:50.716 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:50.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.861+0000 7f2be9800640 1 Processor -- start 2024-04-25T09:03:50.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.861+0000 7f2be9800640 1 -- start start 2024-04-25T09:03:50.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.865+0000 7f2be9800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2be4160fe0 0x7f2be4161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.865+0000 7f2be9800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be4061d60 con 0x7f2be406dac0 2024-04-25T09:03:50.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.865+0000 7f2be9800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be406dfa0 con 0x7f2be406bca0 2024-04-25T09:03:50.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.865+0000 7f2be9800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be40ad510 con 0x7f2be4160fe0 2024-04-25T09:03:50.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.865+0000 7f2be2a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2be4160fe0 0x7f2be4161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.865+0000 7f2be2a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2be4160fe0 0x7f2be4161fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59634/0 (socket says 172.21.15.173:59634) 2024-04-25T09:03:50.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.865+0000 7f2be2a00640 1 -- 172.21.15.173:0/806613641 learned_addr learned my addr 172.21.15.173:0/806613641 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:50.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.865+0000 7f2bda000640 1 --1- 172.21.15.173:0/806613641 >> v1:172.21.15.173:6789/0 conn(0x7f2be406dac0 0x7f2be40ace00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34144/0 (socket says 172.21.15.173:34144) 2024-04-25T09:03:50.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.865+0000 7f2be2a00640 1 -- 172.21.15.173:0/806613641 >> v1:172.21.15.194:6789/0 conn(0x7f2be406bca0 legacy=0x7f2be406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:50.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.865+0000 7f2be2a00640 1 -- 172.21.15.173:0/806613641 >> v1:172.21.15.173:6789/0 conn(0x7f2be406dac0 legacy=0x7f2be40ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.865+0000 7f2be2a00640 1 -- 172.21.15.173:0/806613641 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be406e280 con 0x7f2be4160fe0 2024-04-25T09:03:50.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.865+0000 7f2be2000640 1 -- 172.21.15.173:0/806613641 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358678824 0 0) 0x7f2bcc001120 con 0x7f2be406dac0 2024-04-25T09:03:50.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.865+0000 7f2be2a00640 1 --2- 172.21.15.173:0/806613641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2be4160fe0 0x7f2be4161fb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4009e50 tx=0x7f2bd401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873af051400540ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.865+0000 7f2be2000640 1 -- 172.21.15.173:0/806613641 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40a5660 con 0x7f2be4160fe0 2024-04-25T09:03:50.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be2000640 1 -- 172.21.15.173:0/806613641 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd40a5800 con 0x7f2be4160fe0 2024-04-25T09:03:50.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be2000640 1 -- 172.21.15.173:0/806613641 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40a5bd0 con 0x7f2be4160fe0 2024-04-25T09:03:50.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be9800640 1 -- 172.21.15.173:0/806613641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2be4160fe0 msgr2=0x7f2be4161fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be9800640 1 --2- 172.21.15.173:0/806613641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2be4160fe0 0x7f2be4161fb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4009e50 tx=0x7f2bd401c9a0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be9800640 1 -- 172.21.15.173:0/806613641 shutdown_connections 2024-04-25T09:03:50.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be9800640 1 --2- 172.21.15.173:0/806613641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2be4160fe0 0x7f2be4161fb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be9800640 1 -- 172.21.15.173:0/806613641 >> 172.21.15.173:0/806613641 conn(0x7f2be4071c20 msgr2=0x7f2be4072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:50.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be9800640 1 -- 172.21.15.173:0/806613641 shutdown_connections 2024-04-25T09:03:50.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be9800640 1 -- 172.21.15.173:0/806613641 wait complete. 2024-04-25T09:03:50.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be9800640 1 Processor -- start 2024-04-25T09:03:50.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be9800640 1 -- start start 2024-04-25T09:03:50.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be9800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2be406bca0 0x7f2be4154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be9800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2be406dac0 0x7f2be4136120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be9800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2be4160fe0 0x7f2be4157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be9800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be406c4c0 con 0x7f2be406bca0 2024-04-25T09:03:50.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be9800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be41624f0 con 0x7f2be406dac0 2024-04-25T09:03:50.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be9800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be4136660 con 0x7f2be4160fe0 2024-04-25T09:03:50.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2be406bca0 0x7f2be4154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2be406bca0 0x7f2be4154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59640/0 (socket says 172.21.15.173:59640) 2024-04-25T09:03:50.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be2a00640 1 -- 172.21.15.173:0/3400547275 learned_addr learned my addr 172.21.15.173:0/3400547275 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:50.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2bda000640 1 --2- 172.21.15.173:0/3400547275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2be406dac0 0x7f2be4136120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be3400640 1 --2- 172.21.15.173:0/3400547275 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2be4160fe0 0x7f2be4157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be2a00640 1 -- 172.21.15.173:0/3400547275 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2be4160fe0 msgr2=0x7f2be4157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be2a00640 1 --2- 172.21.15.173:0/3400547275 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2be4160fe0 0x7f2be4157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be2a00640 1 -- 172.21.15.173:0/3400547275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2be406dac0 msgr2=0x7f2be4136120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:50.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be2a00640 1 --2- 172.21.15.173:0/3400547275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2be406dac0 0x7f2be4136120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:50.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be2a00640 1 -- 172.21.15.173:0/3400547275 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be40ae7a0 con 0x7f2be406bca0 2024-04-25T09:03:50.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2bda000640 1 --2- 172.21.15.173:0/3400547275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2be406dac0 0x7f2be4136120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:50.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.869+0000 7f2be3400640 1 --2- 172.21.15.173:0/3400547275 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2be4160fe0 0x7f2be4157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:50.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.873+0000 7f2be2a00640 1 --2- 172.21.15.173:0/3400547275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2be406bca0 0x7f2be4154580 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40195b0 tx=0x7f2bd4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.873+0000 7f2bdb400640 1 -- 172.21.15.173:0/3400547275 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40bc020 con 0x7f2be406bca0 2024-04-25T09:03:50.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.873+0000 7f2bdb400640 1 -- 172.21.15.173:0/3400547275 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd40b8670 con 0x7f2be406bca0 2024-04-25T09:03:50.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.873+0000 7f2be9800640 1 -- 172.21.15.173:0/3400547275 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be41578b0 con 0x7f2be406bca0 2024-04-25T09:03:50.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.873+0000 7f2bdb400640 1 -- 172.21.15.173:0/3400547275 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40b8a40 con 0x7f2be406bca0 2024-04-25T09:03:50.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.873+0000 7f2be9800640 1 -- 172.21.15.173:0/3400547275 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be415e480 con 0x7f2be406bca0 2024-04-25T09:03:50.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.873+0000 7f2be9800640 1 -- 172.21.15.173:0/3400547275 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be4073a40 con 0x7f2be406bca0 2024-04-25T09:03:50.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.873+0000 7f2bdb400640 1 -- 172.21.15.173:0/3400547275 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2bd40bf020 con 0x7f2be406bca0 2024-04-25T09:03:50.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.873+0000 7f2bdb400640 1 --2- 172.21.15.173:0/3400547275 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2bc0066f60 0x7f2bc0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:50.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.873+0000 7f2bdb400640 1 -- 172.21.15.173:0/3400547275 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f2bd4120580 con 0x7f2be406bca0 2024-04-25T09:03:50.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.873+0000 7f2bda000640 1 --2- 172.21.15.173:0/3400547275 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2bc0066f60 0x7f2bc0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:50.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.877+0000 7f2bda000640 1 --2- 172.21.15.173:0/3400547275 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2bc0066f60 0x7f2bc0069420 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc007fd0 tx=0x7f2bcc007a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:50.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:50.881+0000 7f2bdb400640 1 -- 172.21.15.173:0/3400547275 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2bd40c6030 con 0x7f2be406bca0 2024-04-25T09:03:51.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.065+0000 7f2be9800640 1 -- 172.21.15.173:0/3400547275 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2be40cf6c0 con 0x7f2be406bca0 2024-04-25T09:03:51.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.065+0000 7f2bdb400640 1 -- 172.21.15.173:0/3400547275 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4946 (secure 0 0 0) 0x7f2bd4016620 con 0x7f2be406bca0 2024-04-25T09:03:51.055 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:51.055 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2883565303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2883565303},{"type":"v1","addr":"172.21.15.194:6834","nonce":2883565303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2634963400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2634963400},{"type":"v1","addr":"172.21.15.173:6837","nonce":2634963400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3101502434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3101502434},{"type":"v1","addr":"172.21.15.173:6836","nonce":3101502434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:51.389514+0000","modified":"2024-04-25T09:03:08.473956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/4160663138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4160663138},{"type":"v1","addr":"172.21.15.194:6835","nonce":4160663138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:03:51.055 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 9 2024-04-25T09:03:51.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.065+0000 7f2be9800640 1 -- 172.21.15.173:0/3400547275 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2bc0066f60 msgr2=0x7f2bc0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.065+0000 7f2be9800640 1 --2- 172.21.15.173:0/3400547275 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2bc0066f60 0x7f2bc0069420 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc007fd0 tx=0x7f2bcc007a20 comp rx=0 tx=0).stop 2024-04-25T09:03:51.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.065+0000 7f2be9800640 1 -- 172.21.15.173:0/3400547275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2be406bca0 msgr2=0x7f2be4154580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.065+0000 7f2be9800640 1 --2- 172.21.15.173:0/3400547275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2be406bca0 0x7f2be4154580 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40195b0 tx=0x7f2bd4019740 comp rx=0 tx=0).stop 2024-04-25T09:03:51.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.065+0000 7f2be9800640 1 -- 172.21.15.173:0/3400547275 shutdown_connections 2024-04-25T09:03:51.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.065+0000 7f2be9800640 1 --2- 172.21.15.173:0/3400547275 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2bc0066f60 0x7f2bc0069420 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.065+0000 7f2be9800640 1 --2- 172.21.15.173:0/3400547275 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2be4160fe0 0x7f2be4157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.065+0000 7f2be9800640 1 --2- 172.21.15.173:0/3400547275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2be406dac0 0x7f2be4136120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.065+0000 7f2be9800640 1 --2- 172.21.15.173:0/3400547275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2be406bca0 0x7f2be4154580 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.065+0000 7f2be9800640 1 -- 172.21.15.173:0/3400547275 >> 172.21.15.173:0/3400547275 conn(0x7f2be4071c20 msgr2=0x7f2be40b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:51.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.065+0000 7f2be9800640 1 -- 172.21.15.173:0/3400547275 shutdown_connections 2024-04-25T09:03:51.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.065+0000 7f2be9800640 1 -- 172.21.15.173:0/3400547275 wait complete. 2024-04-25T09:03:51.076 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:51.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.221+0000 7f6df3800640 1 Processor -- start 2024-04-25T09:03:51.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.221+0000 7f6df3800640 1 -- start start 2024-04-25T09:03:51.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.221+0000 7f6df3800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6dec15df90 0x7f6dec0d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.221+0000 7f6df3800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dec06d870 con 0x7f6dec15dbb0 2024-04-25T09:03:51.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.221+0000 7f6df3800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dec161690 con 0x7f6dec06f830 2024-04-25T09:03:51.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.221+0000 7f6df3800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dec15e5c0 con 0x7f6dec15df90 2024-04-25T09:03:51.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.221+0000 7f6df0e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f6dec15dbb0 0x7f6dec06c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34160/0 (socket says 172.21.15.173:34160) 2024-04-25T09:03:51.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.221+0000 7f6df0e00640 1 -- 172.21.15.173:0/207606008 learned_addr learned my addr 172.21.15.173:0/207606008 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:51.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.221+0000 7f6de3e00640 1 --2- 172.21.15.173:0/207606008 >> v2:172.21.15.173:3300/0 conn(0x7f6dec15df90 0x7f6dec0d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.221+0000 7f6debe00640 1 -- 172.21.15.173:0/207606008 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464951124 0 0) 0x7f6dec06d870 con 0x7f6dec15dbb0 2024-04-25T09:03:51.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.221+0000 7f6debe00640 1 -- 172.21.15.173:0/207606008 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dd0003530 con 0x7f6dec15dbb0 2024-04-25T09:03:51.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.221+0000 7f6de3e00640 1 -- 172.21.15.173:0/207606008 >> v1:172.21.15.194:6789/0 conn(0x7f6dec06f830 legacy=0x7f6dec161b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:51.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.221+0000 7f6de3e00640 1 -- 172.21.15.173:0/207606008 >> v1:172.21.15.173:6789/0 conn(0x7f6dec15dbb0 legacy=0x7f6dec06c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.221+0000 7f6de3e00640 1 -- 172.21.15.173:0/207606008 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec15e8a0 con 0x7f6dec15df90 2024-04-25T09:03:51.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.225+0000 7f6de3e00640 1 --2- 172.21.15.173:0/207606008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dec15df90 0x7f6dec0d2130 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40097c0 tx=0x7f6dd401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346da64743c9603f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:51.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.225+0000 7f6debe00640 1 -- 172.21.15.173:0/207606008 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd40b0070 con 0x7f6dec15df90 2024-04-25T09:03:51.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.225+0000 7f6debe00640 1 -- 172.21.15.173:0/207606008 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd40ab600 con 0x7f6dec15df90 2024-04-25T09:03:51.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.225+0000 7f6debe00640 1 -- 172.21.15.173:0/207606008 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd40ab9d0 con 0x7f6dec15df90 2024-04-25T09:03:51.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.225+0000 7f6df3800640 1 -- 172.21.15.173:0/207606008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dec15df90 msgr2=0x7f6dec0d2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.225+0000 7f6df3800640 1 --2- 172.21.15.173:0/207606008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dec15df90 0x7f6dec0d2130 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40097c0 tx=0x7f6dd401c460 comp rx=0 tx=0).stop 2024-04-25T09:03:51.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.225+0000 7f6df3800640 1 -- 172.21.15.173:0/207606008 shutdown_connections 2024-04-25T09:03:51.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.225+0000 7f6df3800640 1 --2- 172.21.15.173:0/207606008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dec15df90 0x7f6dec0d2130 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.225+0000 7f6df3800640 1 -- 172.21.15.173:0/207606008 >> 172.21.15.173:0/207606008 conn(0x7f6dec061880 msgr2=0x7f6dec061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:51.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.225+0000 7f6df3800640 1 -- 172.21.15.173:0/207606008 shutdown_connections 2024-04-25T09:03:51.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.225+0000 7f6df3800640 1 -- 172.21.15.173:0/207606008 wait complete. 2024-04-25T09:03:51.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6df3800640 1 Processor -- start 2024-04-25T09:03:51.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6df3800640 1 -- start start 2024-04-25T09:03:51.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6df3800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dec06f830 0x7f6dec0c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6df3800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dec15dbb0 0x7f6dec0cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6df3800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dec15df90 0x7f6dec157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6df3800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec16c1b0 con 0x7f6dec15dbb0 2024-04-25T09:03:51.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6df3800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec15ee60 con 0x7f6dec06f830 2024-04-25T09:03:51.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6df3800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec16c330 con 0x7f6dec15df90 2024-04-25T09:03:51.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6de3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dec15dbb0 0x7f6dec0cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6de3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dec15dbb0 0x7f6dec0cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59660/0 (socket says 172.21.15.173:59660) 2024-04-25T09:03:51.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6de3e00640 1 -- 172.21.15.173:0/1640713479 learned_addr learned my addr 172.21.15.173:0/1640713479 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:51.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6df0e00640 1 --2- 172.21.15.173:0/1640713479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dec06f830 0x7f6dec0c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6df1800640 1 --2- 172.21.15.173:0/1640713479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dec15df90 0x7f6dec157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6de3e00640 1 -- 172.21.15.173:0/1640713479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dec15df90 msgr2=0x7f6dec157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6de3e00640 1 --2- 172.21.15.173:0/1640713479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dec15df90 0x7f6dec157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6de3e00640 1 -- 172.21.15.173:0/1640713479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dec06f830 msgr2=0x7f6dec0c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6de3e00640 1 --2- 172.21.15.173:0/1640713479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dec06f830 0x7f6dec0c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6de3e00640 1 -- 172.21.15.173:0/1640713479 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec158720 con 0x7f6dec15dbb0 2024-04-25T09:03:51.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6df1800640 1 --2- 172.21.15.173:0/1640713479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dec15df90 0x7f6dec157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:51.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6de3e00640 1 --2- 172.21.15.173:0/1640713479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dec15dbb0 0x7f6dec0cf4a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6dd401a090 tx=0x7f6dd4019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:51.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6de9600640 1 -- 172.21.15.173:0/1640713479 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd40b0040 con 0x7f6dec15dbb0 2024-04-25T09:03:51.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6de9600640 1 -- 172.21.15.173:0/1640713479 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd40bb070 con 0x7f6dec15dbb0 2024-04-25T09:03:51.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6df3800640 1 -- 172.21.15.173:0/1640713479 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dec158a00 con 0x7f6dec15dbb0 2024-04-25T09:03:51.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6de9600640 1 -- 172.21.15.173:0/1640713479 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd40b6670 con 0x7f6dec15dbb0 2024-04-25T09:03:51.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.229+0000 7f6df3800640 1 -- 172.21.15.173:0/1640713479 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dec0c6ef0 con 0x7f6dec15dbb0 2024-04-25T09:03:51.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.233+0000 7f6df3800640 1 -- 172.21.15.173:0/1640713479 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dec073a40 con 0x7f6dec15dbb0 2024-04-25T09:03:51.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.233+0000 7f6de9600640 1 -- 172.21.15.173:0/1640713479 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6dd40b3070 con 0x7f6dec15dbb0 2024-04-25T09:03:51.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.233+0000 7f6de9600640 1 --2- 172.21.15.173:0/1640713479 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6dc8066f60 0x7f6dc8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.233+0000 7f6de9600640 1 -- 172.21.15.173:0/1640713479 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6dd411f2f0 con 0x7f6dec15dbb0 2024-04-25T09:03:51.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.233+0000 7f6df0e00640 1 --2- 172.21.15.173:0/1640713479 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6dc8066f60 0x7f6dc8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.233+0000 7f6df0e00640 1 --2- 172.21.15.173:0/1640713479 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6dc8066f60 0x7f6dc8069420 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc007fd0 tx=0x7f6ddc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:51.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.237+0000 7f6de9600640 1 -- 172.21.15.173:0/1640713479 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6dd4016050 con 0x7f6dec15dbb0 2024-04-25T09:03:51.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.393+0000 7f6df3800640 1 -- 172.21.15.173:0/1640713479 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6dec0cf020 con 0x7f6dec15dbb0 2024-04-25T09:03:51.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.393+0000 7f6de9600640 1 -- 172.21.15.173:0/1640713479 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18906 (secure 0 0 0) 0x7f6dd40eff80 con 0x7f6dec15dbb0 2024-04-25T09:03:51.384 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:51.385 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":28,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:03:32.190313+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:49.342297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:50.386069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:02:54.077429+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:51.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.397+0000 7f6df3800640 1 -- 172.21.15.173:0/1640713479 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6dc8066f60 msgr2=0x7f6dc8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.397+0000 7f6df3800640 1 --2- 172.21.15.173:0/1640713479 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6dc8066f60 0x7f6dc8069420 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc007fd0 tx=0x7f6ddc009040 comp rx=0 tx=0).stop 2024-04-25T09:03:51.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.397+0000 7f6df3800640 1 -- 172.21.15.173:0/1640713479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dec15dbb0 msgr2=0x7f6dec0cf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.397+0000 7f6df3800640 1 --2- 172.21.15.173:0/1640713479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dec15dbb0 0x7f6dec0cf4a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6dd401a090 tx=0x7f6dd4019200 comp rx=0 tx=0).stop 2024-04-25T09:03:51.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.397+0000 7f6df3800640 1 -- 172.21.15.173:0/1640713479 shutdown_connections 2024-04-25T09:03:51.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.397+0000 7f6df3800640 1 --2- 172.21.15.173:0/1640713479 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6dc8066f60 0x7f6dc8069420 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.397+0000 7f6df3800640 1 --2- 172.21.15.173:0/1640713479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dec15df90 0x7f6dec157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.397+0000 7f6df3800640 1 --2- 172.21.15.173:0/1640713479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dec15dbb0 0x7f6dec0cf4a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.397+0000 7f6df3800640 1 --2- 172.21.15.173:0/1640713479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dec06f830 0x7f6dec0c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.397+0000 7f6df3800640 1 -- 172.21.15.173:0/1640713479 >> 172.21.15.173:0/1640713479 conn(0x7f6dec061880 msgr2=0x7f6dec06c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:51.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.397+0000 7f6df3800640 1 -- 172.21.15.173:0/1640713479 shutdown_connections 2024-04-25T09:03:51.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.397+0000 7f6df3800640 1 -- 172.21.15.173:0/1640713479 wait complete. 2024-04-25T09:03:51.406 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:03:51.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.553+0000 7f4b2c000640 1 Processor -- start 2024-04-25T09:03:51.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.553+0000 7f4b2c000640 1 -- start start 2024-04-25T09:03:51.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.553+0000 7f4b2c000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b24145290 0x7f4b2415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.553+0000 7f4b2c000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4b240cc260 0x7f4b240cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.553+0000 7f4b2c000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2415c5f0 con 0x7f4b240b3fe0 2024-04-25T09:03:51.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.553+0000 7f4b2c000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2406d4b0 con 0x7f4b240cc260 2024-04-25T09:03:51.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.553+0000 7f4b2c000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2406d790 con 0x7f4b24145290 2024-04-25T09:03:51.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.553+0000 7f4b28c00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4b240b3fe0 0x7f4b240b4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34172/0 (socket says 172.21.15.173:34172) 2024-04-25T09:03:51.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.553+0000 7f4b28c00640 1 -- 172.21.15.173:0/2492680372 learned_addr learned my addr 172.21.15.173:0/2492680372 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:51.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.553+0000 7f4b29600640 1 --2- 172.21.15.173:0/2492680372 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b24145290 0x7f4b2415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.553+0000 7f4b2a000640 1 --2- 172.21.15.173:0/2492680372 >> v2:172.21.15.194:3300/0 conn(0x7f4b240cc260 0x7f4b240cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.553+0000 7f4b23e00640 1 -- 172.21.15.173:0/2492680372 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954956294 0 0) 0x7f4b10001120 con 0x7f4b240b3fe0 2024-04-25T09:03:51.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.553+0000 7f4b23e00640 1 -- 172.21.15.173:0/2492680372 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b0c003530 con 0x7f4b240b3fe0 2024-04-25T09:03:51.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.553+0000 7f4b29600640 1 -- 172.21.15.173:0/2492680372 >> v2:172.21.15.194:3300/0 conn(0x7f4b240cc260 msgr2=0x7f4b240cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:51.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.553+0000 7f4b29600640 1 --2- 172.21.15.173:0/2492680372 >> v2:172.21.15.194:3300/0 conn(0x7f4b240cc260 0x7f4b240cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.553+0000 7f4b23e00640 1 -- 172.21.15.173:0/2492680372 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3387277381 0 0) 0x7f4b0c003530 con 0x7f4b240b3fe0 2024-04-25T09:03:51.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.553+0000 7f4b29600640 1 -- 172.21.15.173:0/2492680372 >> v1:172.21.15.173:6789/0 conn(0x7f4b240b3fe0 legacy=0x7f4b240b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.553+0000 7f4b29600640 1 -- 172.21.15.173:0/2492680372 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2406da70 con 0x7f4b24145290 2024-04-25T09:03:51.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.557+0000 7f4b29600640 1 --2- 172.21.15.173:0/2492680372 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b24145290 0x7f4b2415c0b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4b180097c0 tx=0x7f4b1801c2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8324f9b254789584 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:51.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.557+0000 7f4b23e00640 1 -- 172.21.15.173:0/2492680372 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b180b0070 con 0x7f4b24145290 2024-04-25T09:03:51.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.557+0000 7f4b23e00640 1 -- 172.21.15.173:0/2492680372 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b180ab400 con 0x7f4b24145290 2024-04-25T09:03:51.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.557+0000 7f4b23e00640 1 -- 172.21.15.173:0/2492680372 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b10001850 con 0x7f4b24145290 2024-04-25T09:03:51.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.557+0000 7f4b2c000640 1 -- 172.21.15.173:0/2492680372 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b24145290 msgr2=0x7f4b2415c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.557+0000 7f4b2c000640 1 --2- 172.21.15.173:0/2492680372 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b24145290 0x7f4b2415c0b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4b180097c0 tx=0x7f4b1801c2a0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.557+0000 7f4b2c000640 1 -- 172.21.15.173:0/2492680372 shutdown_connections 2024-04-25T09:03:51.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.557+0000 7f4b2c000640 1 --2- 172.21.15.173:0/2492680372 >> v2:172.21.15.194:3300/0 conn(0x7f4b240cc260 0x7f4b240cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.557+0000 7f4b2c000640 1 --2- 172.21.15.173:0/2492680372 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b24145290 0x7f4b2415c0b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.557+0000 7f4b2c000640 1 -- 172.21.15.173:0/2492680372 >> 172.21.15.173:0/2492680372 conn(0x7f4b2406ac90 msgr2=0x7f4b2406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:51.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.557+0000 7f4b2c000640 1 -- 172.21.15.173:0/2492680372 shutdown_connections 2024-04-25T09:03:51.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.557+0000 7f4b2c000640 1 -- 172.21.15.173:0/2492680372 wait complete. 2024-04-25T09:03:51.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2c000640 1 Processor -- start 2024-04-25T09:03:51.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2c000640 1 -- start start 2024-04-25T09:03:51.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2c000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b240b3fe0 0x7f4b2415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2c000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b240cc260 0x7f4b2413e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2c000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b24145290 0x7f4b2413e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2c000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2406ed60 con 0x7f4b24145290 2024-04-25T09:03:51.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2c000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2406eee0 con 0x7f4b240cc260 2024-04-25T09:03:51.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2c000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2406f060 con 0x7f4b240b3fe0 2024-04-25T09:03:51.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b24145290 0x7f4b2413e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b24145290 0x7f4b2413e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59664/0 (socket says 172.21.15.173:59664) 2024-04-25T09:03:51.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2a000640 1 -- 172.21.15.173:0/882421099 learned_addr learned my addr 172.21.15.173:0/882421099 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:51.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b29600640 1 --2- 172.21.15.173:0/882421099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b240b3fe0 0x7f4b2415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b28c00640 1 --2- 172.21.15.173:0/882421099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b240cc260 0x7f4b2413e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2a000640 1 -- 172.21.15.173:0/882421099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b240b3fe0 msgr2=0x7f4b2415abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2a000640 1 --2- 172.21.15.173:0/882421099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b240b3fe0 0x7f4b2415abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2a000640 1 -- 172.21.15.173:0/882421099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b240cc260 msgr2=0x7f4b2413e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2a000640 1 --2- 172.21.15.173:0/882421099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b240cc260 0x7f4b2413e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2a000640 1 -- 172.21.15.173:0/882421099 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2413fcc0 con 0x7f4b24145290 2024-04-25T09:03:51.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b28c00640 1 --2- 172.21.15.173:0/882421099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b240cc260 0x7f4b2413e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:51.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2a000640 1 --2- 172.21.15.173:0/882421099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b24145290 0x7f4b2413e5f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00efc0 tx=0x7f4b1c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:51.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b21600640 1 -- 172.21.15.173:0/882421099 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c018020 con 0x7f4b24145290 2024-04-25T09:03:51.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b21600640 1 -- 172.21.15.173:0/882421099 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c014480 con 0x7f4b24145290 2024-04-25T09:03:51.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2c000640 1 -- 172.21.15.173:0/882421099 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2413ec20 con 0x7f4b24145290 2024-04-25T09:03:51.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b21600640 1 -- 172.21.15.173:0/882421099 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c014870 con 0x7f4b24145290 2024-04-25T09:03:51.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.561+0000 7f4b2c000640 1 -- 172.21.15.173:0/882421099 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2413f4c0 con 0x7f4b24145290 2024-04-25T09:03:51.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.565+0000 7f4b2c000640 1 -- 172.21.15.173:0/882421099 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b240c6170 con 0x7f4b24145290 2024-04-25T09:03:51.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.565+0000 7f4b21600640 1 -- 172.21.15.173:0/882421099 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4b1c01b020 con 0x7f4b24145290 2024-04-25T09:03:51.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.565+0000 7f4b21600640 1 --2- 172.21.15.173:0/882421099 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4b04066f60 0x7f4b04069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.565+0000 7f4b21600640 1 -- 172.21.15.173:0/882421099 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f4b1c086370 con 0x7f4b24145290 2024-04-25T09:03:51.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.565+0000 7f4b29600640 1 --2- 172.21.15.173:0/882421099 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4b04066f60 0x7f4b04069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.565+0000 7f4b29600640 1 --2- 172.21.15.173:0/882421099 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4b04066f60 0x7f4b04069420 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4b180ad000 tx=0x7f4b180a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:51.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.569+0000 7f4b21600640 1 -- 172.21.15.173:0/882421099 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4b1c022030 con 0x7f4b24145290 2024-04-25T09:03:51.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.757+0000 7f4b2c000640 1 -- 172.21.15.173:0/882421099 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4b24073ab0 con 0x7f4b24145290 2024-04-25T09:03:51.749 INFO:tasks.ceph.mon.a.smithi173.stderr:2024-04-25T09:03:51.757+0000 7f537be00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:03:51.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.761+0000 7f4b21600640 1 -- 172.21.15.173:0/882421099 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4b1c010040 con 0x7f4b24145290 2024-04-25T09:03:51.751 INFO:teuthology.orchestra.run.smithi173.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:03:51.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.765+0000 7f4b2c000640 1 -- 172.21.15.173:0/882421099 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4b04066f60 msgr2=0x7f4b04069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.765+0000 7f4b2c000640 1 --2- 172.21.15.173:0/882421099 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4b04066f60 0x7f4b04069420 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4b180ad000 tx=0x7f4b180a6000 comp rx=0 tx=0).stop 2024-04-25T09:03:51.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.765+0000 7f4b2c000640 1 -- 172.21.15.173:0/882421099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b24145290 msgr2=0x7f4b2413e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.765+0000 7f4b2c000640 1 --2- 172.21.15.173:0/882421099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b24145290 0x7f4b2413e5f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00efc0 tx=0x7f4b1c00c490 comp rx=0 tx=0).stop 2024-04-25T09:03:51.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.765+0000 7f4b2c000640 1 -- 172.21.15.173:0/882421099 shutdown_connections 2024-04-25T09:03:51.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.765+0000 7f4b2c000640 1 --2- 172.21.15.173:0/882421099 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4b04066f60 0x7f4b04069420 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.765+0000 7f4b2c000640 1 --2- 172.21.15.173:0/882421099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b24145290 0x7f4b2413e5f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.765+0000 7f4b2c000640 1 --2- 172.21.15.173:0/882421099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b240cc260 0x7f4b2413e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.765+0000 7f4b2c000640 1 --2- 172.21.15.173:0/882421099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b240b3fe0 0x7f4b2415abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.765+0000 7f4b2c000640 1 -- 172.21.15.173:0/882421099 >> 172.21.15.173:0/882421099 conn(0x7f4b2406ac90 msgr2=0x7f4b240b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:51.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.765+0000 7f4b2c000640 1 -- 172.21.15.173:0/882421099 shutdown_connections 2024-04-25T09:03:51.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.765+0000 7f4b2c000640 1 -- 172.21.15.173:0/882421099 wait complete. 2024-04-25T09:03:51.764 INFO:tasks.ceph.mds.d.smithi194.stderr: -5077> 2024-04-25T09:02:55.693+0000 7fbdb4200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:03:51.775 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:03:51.815 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-04-25T09:03:51.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.921+0000 7f6d47800640 1 Processor -- start 2024-04-25T09:03:51.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.921+0000 7f6d47800640 1 -- start start 2024-04-25T09:03:51.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d47800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d400aeb90 0x7f6d400cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d47800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6d400aef70 0x7f6d400cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d47800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d40071570 con 0x7f6d400cdba0 2024-04-25T09:03:51.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d47800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d40071320 con 0x7f6d400aef70 2024-04-25T09:03:51.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d47800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d40072330 con 0x7f6d400aeb90 2024-04-25T09:03:51.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d45800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f6d400cdba0 0x7f6d400ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34182/0 (socket says 172.21.15.173:34182) 2024-04-25T09:03:51.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d45800640 1 -- 172.21.15.173:0/3888097624 learned_addr learned my addr 172.21.15.173:0/3888097624 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:51.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d44e00640 1 --2- 172.21.15.173:0/3888097624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d400aeb90 0x7f6d400cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d37e00640 1 --2- 172.21.15.173:0/3888097624 >> v2:172.21.15.194:3300/0 conn(0x7f6d400aef70 0x7f6d400cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d3fe00640 1 -- 172.21.15.173:0/3888097624 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041300303 0 0) 0x7f6d40071570 con 0x7f6d400cdba0 2024-04-25T09:03:51.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d3fe00640 1 -- 172.21.15.173:0/3888097624 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d24003530 con 0x7f6d400cdba0 2024-04-25T09:03:51.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d3fe00640 1 -- 172.21.15.173:0/3888097624 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3409565024 0 0) 0x7f6d24003530 con 0x7f6d400cdba0 2024-04-25T09:03:51.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d3fe00640 1 -- 172.21.15.173:0/3888097624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d400aeb90 msgr2=0x7f6d400cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:51.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d3fe00640 1 --2- 172.21.15.173:0/3888097624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d400aeb90 0x7f6d400cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d3fe00640 1 -- 172.21.15.173:0/3888097624 >> v2:172.21.15.194:3300/0 conn(0x7f6d400aef70 msgr2=0x7f6d400cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:51.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d3fe00640 1 --2- 172.21.15.173:0/3888097624 >> v2:172.21.15.194:3300/0 conn(0x7f6d400aef70 0x7f6d400cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d3fe00640 1 -- 172.21.15.173:0/3888097624 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d40071850 con 0x7f6d400cdba0 2024-04-25T09:03:51.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d3fe00640 1 -- 172.21.15.173:0/3888097624 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f6d38001a00 con 0x7f6d400cdba0 2024-04-25T09:03:51.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d37e00640 1 --2- 172.21.15.173:0/3888097624 >> v2:172.21.15.194:3300/0 conn(0x7f6d400aef70 0x7f6d400cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:51.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d3fe00640 1 -- 172.21.15.173:0/3888097624 >> v1:172.21.15.173:6789/0 conn(0x7f6d400cdba0 legacy=0x7f6d400ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d3fe00640 1 --2- 172.21.15.173:0/3888097624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d240039c0 0x7f6d24003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d3fe00640 1 --2- 172.21.15.173:0/3888097624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d24004810 0x7f6d24004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d3fe00640 1 --2- 172.21.15.173:0/3888097624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d400aeb90 0x7f6d240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d3fe00640 1 -- 172.21.15.173:0/3888097624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d40071320 con 0x7f6d24004810 2024-04-25T09:03:51.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d3fe00640 1 -- 172.21.15.173:0/3888097624 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d40072330 con 0x7f6d240039c0 2024-04-25T09:03:51.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d3fe00640 1 -- 172.21.15.173:0/3888097624 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2400dbe0 con 0x7f6d400aeb90 2024-04-25T09:03:51.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d37e00640 1 --2- 172.21.15.173:0/3888097624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d24004810 0x7f6d24004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d45800640 1 --2- 172.21.15.173:0/3888097624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d400aeb90 0x7f6d240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d44e00640 1 --2- 172.21.15.173:0/3888097624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d240039c0 0x7f6d24003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d37e00640 1 -- 172.21.15.173:0/3888097624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d400aeb90 msgr2=0x7f6d240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:51.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d37e00640 1 --2- 172.21.15.173:0/3888097624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d400aeb90 0x7f6d240051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d37e00640 1 -- 172.21.15.173:0/3888097624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d240039c0 msgr2=0x7f6d24003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:51.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d37e00640 1 --2- 172.21.15.173:0/3888097624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d240039c0 0x7f6d24003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.925+0000 7f6d37e00640 1 -- 172.21.15.173:0/3888097624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d24003530 con 0x7f6d24004810 2024-04-25T09:03:51.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.929+0000 7f6d37e00640 1 --2- 172.21.15.173:0/3888097624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d24004810 0x7f6d24004c90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6d28009cb0 tx=0x7f6d2801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff2e507876ab555 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:51.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.929+0000 7f6d3fe00640 1 -- 172.21.15.173:0/3888097624 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d280b2070 con 0x7f6d24004810 2024-04-25T09:03:51.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.929+0000 7f6d3fe00640 1 -- 172.21.15.173:0/3888097624 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d280a55f0 con 0x7f6d24004810 2024-04-25T09:03:51.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.929+0000 7f6d3fe00640 1 -- 172.21.15.173:0/3888097624 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d28009880 con 0x7f6d24004810 2024-04-25T09:03:51.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.929+0000 7f6d47800640 1 -- 172.21.15.173:0/3888097624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d24004810 msgr2=0x7f6d24004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.929+0000 7f6d47800640 1 --2- 172.21.15.173:0/3888097624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d24004810 0x7f6d24004c90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6d28009cb0 tx=0x7f6d2801cc20 comp rx=0 tx=0).stop 2024-04-25T09:03:51.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.929+0000 7f6d45800640 1 -- 172.21.15.173:0/3888097624 reap_dead start 2024-04-25T09:03:51.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.929+0000 7f6d47800640 1 -- 172.21.15.173:0/3888097624 shutdown_connections 2024-04-25T09:03:51.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.929+0000 7f6d47800640 1 -- 172.21.15.173:0/3888097624 >> 172.21.15.173:0/3888097624 conn(0x7f6d4006ac90 msgr2=0x7f6d4006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:51.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.929+0000 7f6d47800640 1 -- 172.21.15.173:0/3888097624 shutdown_connections 2024-04-25T09:03:51.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.929+0000 7f6d47800640 1 -- 172.21.15.173:0/3888097624 wait complete. 2024-04-25T09:03:51.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.929+0000 7f6d47800640 1 Processor -- start 2024-04-25T09:03:51.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.929+0000 7f6d47800640 1 -- start start 2024-04-25T09:03:51.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d47800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d24004810 0x7f6d400b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d47800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d4014e640 0x7f6d400ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d47800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d400ad9a0 0x7f6d4014eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d47800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d400d02c0 con 0x7f6d24004810 2024-04-25T09:03:51.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d47800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d400d0140 con 0x7f6d4014e640 2024-04-25T09:03:51.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d47800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d400d0440 con 0x7f6d400ad9a0 2024-04-25T09:03:51.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d44e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d24004810 0x7f6d400b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d44e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d24004810 0x7f6d400b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59688/0 (socket says 172.21.15.173:59688) 2024-04-25T09:03:51.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d44e00640 1 -- 172.21.15.173:0/4049814572 learned_addr learned my addr 172.21.15.173:0/4049814572 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:51.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d45800640 1 --2- 172.21.15.173:0/4049814572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d400ad9a0 0x7f6d4014eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d37e00640 1 --2- 172.21.15.173:0/4049814572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d4014e640 0x7f6d400ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d44e00640 1 -- 172.21.15.173:0/4049814572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d400ad9a0 msgr2=0x7f6d4014eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d44e00640 1 --2- 172.21.15.173:0/4049814572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d400ad9a0 0x7f6d4014eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d44e00640 1 -- 172.21.15.173:0/4049814572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d4014e640 msgr2=0x7f6d400ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:51.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d44e00640 1 --2- 172.21.15.173:0/4049814572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d4014e640 0x7f6d400ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:51.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d44e00640 1 -- 172.21.15.173:0/4049814572 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d40152410 con 0x7f6d24004810 2024-04-25T09:03:51.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d44e00640 1 --2- 172.21.15.173:0/4049814572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d24004810 0x7f6d400b2040 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6d30011990 tx=0x7f6d30011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:51.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d3d600640 1 -- 172.21.15.173:0/4049814572 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3000fad0 con 0x7f6d24004810 2024-04-25T09:03:51.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d3d600640 1 -- 172.21.15.173:0/4049814572 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3000fc70 con 0x7f6d24004810 2024-04-25T09:03:51.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d47800640 1 -- 172.21.15.173:0/4049814572 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d401526f0 con 0x7f6d24004810 2024-04-25T09:03:51.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d3d600640 1 -- 172.21.15.173:0/4049814572 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d30014440 con 0x7f6d24004810 2024-04-25T09:03:51.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d47800640 1 -- 172.21.15.173:0/4049814572 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d40152cb0 con 0x7f6d24004810 2024-04-25T09:03:51.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d47800640 1 -- 172.21.15.173:0/4049814572 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d40073ab0 con 0x7f6d24004810 2024-04-25T09:03:51.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.933+0000 7f6d3d600640 1 -- 172.21.15.173:0/4049814572 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6d30012040 con 0x7f6d24004810 2024-04-25T09:03:51.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.937+0000 7f6d3d600640 1 --2- 172.21.15.173:0/4049814572 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d1c066f90 0x7f6d1c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:51.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.937+0000 7f6d3d600640 1 -- 172.21.15.173:0/4049814572 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f6d30085a30 con 0x7f6d24004810 2024-04-25T09:03:51.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.937+0000 7f6d37e00640 1 --2- 172.21.15.173:0/4049814572 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d1c066f90 0x7f6d1c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:51.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.937+0000 7f6d37e00640 1 --2- 172.21.15.173:0/4049814572 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d1c066f90 0x7f6d1c069450 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6d280af000 tx=0x7f6d280046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:51.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:51.941+0000 7f6d3d600640 1 -- 172.21.15.173:0/4049814572 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6d30019030 con 0x7f6d24004810 2024-04-25T09:03:52.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.129+0000 7f6d47800640 1 -- 172.21.15.173:0/4049814572 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6d400add80 con 0x7f6d24004810 2024-04-25T09:03:52.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.765+0000 7f6d3d600640 1 -- 172.21.15.173:0/4049814572 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6d300565e0 con 0x7f6d24004810 2024-04-25T09:03:52.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.765+0000 7f6d47800640 1 -- 172.21.15.173:0/4049814572 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d1c066f90 msgr2=0x7f6d1c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.765+0000 7f6d47800640 1 --2- 172.21.15.173:0/4049814572 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d1c066f90 0x7f6d1c069450 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6d280af000 tx=0x7f6d280046d0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.765+0000 7f6d47800640 1 -- 172.21.15.173:0/4049814572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d24004810 msgr2=0x7f6d400b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.765+0000 7f6d47800640 1 --2- 172.21.15.173:0/4049814572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d24004810 0x7f6d400b2040 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6d30011990 tx=0x7f6d30011e50 comp rx=0 tx=0).stop 2024-04-25T09:03:52.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.765+0000 7f6d47800640 1 -- 172.21.15.173:0/4049814572 shutdown_connections 2024-04-25T09:03:52.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.765+0000 7f6d47800640 1 --2- 172.21.15.173:0/4049814572 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d1c066f90 0x7f6d1c069450 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.765+0000 7f6d47800640 1 --2- 172.21.15.173:0/4049814572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d400ad9a0 0x7f6d4014eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.765+0000 7f6d47800640 1 --2- 172.21.15.173:0/4049814572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d4014e640 0x7f6d400ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.765+0000 7f6d47800640 1 --2- 172.21.15.173:0/4049814572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d24004810 0x7f6d400b2040 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.765+0000 7f6d47800640 1 -- 172.21.15.173:0/4049814572 >> 172.21.15.173:0/4049814572 conn(0x7f6d4006ac90 msgr2=0x7f6d4006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:52.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.765+0000 7f6d47800640 1 -- 172.21.15.173:0/4049814572 shutdown_connections 2024-04-25T09:03:52.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.765+0000 7f6d47800640 1 -- 172.21.15.173:0/4049814572 wait complete. 2024-04-25T09:03:52.777 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:03:52.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.925+0000 7f27f3000640 1 Processor -- start 2024-04-25T09:03:52.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.925+0000 7f27f3000640 1 -- start start 2024-04-25T09:03:52.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.929+0000 7f27f3000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f27ec06e1c0 0x7f27ec06bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.929+0000 7f27f3000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ec06ae30 con 0x7f27ec0ad5c0 2024-04-25T09:03:52.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.929+0000 7f27f3000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ec06b110 con 0x7f27ec06c410 2024-04-25T09:03:52.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.929+0000 7f27f3000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27ec0b3170 con 0x7f27ec06e1c0 2024-04-25T09:03:52.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.929+0000 7f27f1000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f27ec0ad5c0 0x7f27ec1677c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34188/0 (socket says 172.21.15.173:34188) 2024-04-25T09:03:52.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.929+0000 7f27f1000640 1 -- 172.21.15.173:0/3185622944 learned_addr learned my addr 172.21.15.173:0/3185622944 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:52.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.929+0000 7f27ebe00640 1 --2- 172.21.15.173:0/3185622944 >> v2:172.21.15.194:3300/0 conn(0x7f27ec06e1c0 0x7f27ec06bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.929+0000 7f27eaa00640 1 -- 172.21.15.173:0/3185622944 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606978297 0 0) 0x7f27ec06ae30 con 0x7f27ec0ad5c0 2024-04-25T09:03:52.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.929+0000 7f27eaa00640 1 -- 172.21.15.173:0/3185622944 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d0003530 con 0x7f27ec0ad5c0 2024-04-25T09:03:52.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.929+0000 7f27ebe00640 1 -- 172.21.15.173:0/3185622944 >> v1:172.21.15.194:6789/0 conn(0x7f27ec06c410 legacy=0x7f27ec0aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.929+0000 7f27ebe00640 1 -- 172.21.15.173:0/3185622944 >> v1:172.21.15.173:6789/0 conn(0x7f27ec0ad5c0 legacy=0x7f27ec1677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.929+0000 7f27ebe00640 1 -- 172.21.15.173:0/3185622944 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec06b3f0 con 0x7f27ec06e1c0 2024-04-25T09:03:52.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.933+0000 7f27ebe00640 1 --2- 172.21.15.173:0/3185622944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27ec06e1c0 0x7f27ec06bed0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0097c0 tx=0x7f27dc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1b1b8bb4eea1c29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.933+0000 7f27eaa00640 1 -- 172.21.15.173:0/3185622944 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc0b0070 con 0x7f27ec06e1c0 2024-04-25T09:03:52.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.933+0000 7f27eaa00640 1 -- 172.21.15.173:0/3185622944 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc0ab600 con 0x7f27ec06e1c0 2024-04-25T09:03:52.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.933+0000 7f27eaa00640 1 -- 172.21.15.173:0/3185622944 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc0ab9b0 con 0x7f27ec06e1c0 2024-04-25T09:03:52.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.933+0000 7f27f3000640 1 -- 172.21.15.173:0/3185622944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27ec06e1c0 msgr2=0x7f27ec06bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.933+0000 7f27f3000640 1 --2- 172.21.15.173:0/3185622944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27ec06e1c0 0x7f27ec06bed0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0097c0 tx=0x7f27dc01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.933+0000 7f27f3000640 1 -- 172.21.15.173:0/3185622944 shutdown_connections 2024-04-25T09:03:52.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.933+0000 7f27f3000640 1 --2- 172.21.15.173:0/3185622944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27ec06e1c0 0x7f27ec06bed0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.933+0000 7f27f3000640 1 -- 172.21.15.173:0/3185622944 >> 172.21.15.173:0/3185622944 conn(0x7f27ec0cfed0 msgr2=0x7f27ec0d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:52.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.933+0000 7f27f3000640 1 -- 172.21.15.173:0/3185622944 shutdown_connections 2024-04-25T09:03:52.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.933+0000 7f27f3000640 1 -- 172.21.15.173:0/3185622944 wait complete. 2024-04-25T09:03:52.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.933+0000 7f27f3000640 1 Processor -- start 2024-04-25T09:03:52.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.933+0000 7f27f3000640 1 -- start start 2024-04-25T09:03:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27f3000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27ec06c410 0x7f27ec138960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27f3000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27ec06e1c0 0x7f27ec156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27f3000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27ec0ad5c0 0x7f27ec14a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27f3000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec16b880 con 0x7f27ec06e1c0 2024-04-25T09:03:52.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27f3000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec16b700 con 0x7f27ec06c410 2024-04-25T09:03:52.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27f3000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec16ba00 con 0x7f27ec0ad5c0 2024-04-25T09:03:52.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27eb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27ec06e1c0 0x7f27ec156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27ebe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27ec06c410 0x7f27ec138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27eb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27ec06e1c0 0x7f27ec156c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59702/0 (socket says 172.21.15.173:59702) 2024-04-25T09:03:52.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27eb400640 1 -- 172.21.15.173:0/1559490448 learned_addr learned my addr 172.21.15.173:0/1559490448 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:52.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27f1000640 1 --2- 172.21.15.173:0/1559490448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27ec0ad5c0 0x7f27ec14a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27eb400640 1 -- 172.21.15.173:0/1559490448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27ec0ad5c0 msgr2=0x7f27ec14a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27eb400640 1 --2- 172.21.15.173:0/1559490448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27ec0ad5c0 0x7f27ec14a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27eb400640 1 -- 172.21.15.173:0/1559490448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27ec06c410 msgr2=0x7f27ec138960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:52.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27eb400640 1 --2- 172.21.15.173:0/1559490448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27ec06c410 0x7f27ec138960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:52.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27eb400640 1 -- 172.21.15.173:0/1559490448 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec14ae90 con 0x7f27ec06e1c0 2024-04-25T09:03:52.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27ebe00640 1 --2- 172.21.15.173:0/1559490448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27ec06c410 0x7f27ec138960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:52.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27eb400640 1 --2- 172.21.15.173:0/1559490448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27ec06e1c0 0x7f27ec156c70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f27d800c420 tx=0x7f27d800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27e3e00640 1 -- 172.21.15.173:0/1559490448 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d80052d0 con 0x7f27ec06e1c0 2024-04-25T09:03:52.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27e3e00640 1 -- 172.21.15.173:0/1559490448 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d8005470 con 0x7f27ec06e1c0 2024-04-25T09:03:52.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27f3000640 1 -- 172.21.15.173:0/1559490448 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ec14b130 con 0x7f27ec06e1c0 2024-04-25T09:03:52.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27e3e00640 1 -- 172.21.15.173:0/1559490448 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8007260 con 0x7f27ec06e1c0 2024-04-25T09:03:52.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27f3000640 1 -- 172.21.15.173:0/1559490448 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ec14b6f0 con 0x7f27ec06e1c0 2024-04-25T09:03:52.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27f3000640 1 -- 172.21.15.173:0/1559490448 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ec073ab0 con 0x7f27ec06e1c0 2024-04-25T09:03:52.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.937+0000 7f27e3e00640 1 -- 172.21.15.173:0/1559490448 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f27d8007400 con 0x7f27ec06e1c0 2024-04-25T09:03:52.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.941+0000 7f27e3e00640 1 --2- 172.21.15.173:0/1559490448 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f27cc066f60 0x7f27cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:52.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.941+0000 7f27e3e00640 1 -- 172.21.15.173:0/1559490448 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f27d8084980 con 0x7f27ec06e1c0 2024-04-25T09:03:52.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.941+0000 7f27ebe00640 1 --2- 172.21.15.173:0/1559490448 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f27cc066f60 0x7f27cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:52.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.941+0000 7f27ebe00640 1 --2- 172.21.15.173:0/1559490448 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f27cc066f60 0x7f27cc069420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0ad000 tx=0x7f27dc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:52.945+0000 7f27e3e00640 1 -- 172.21.15.173:0/1559490448 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f27d8054e40 con 0x7f27ec06e1c0 2024-04-25T09:03:53.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.097+0000 7f27f3000640 1 -- 172.21.15.173:0/1559490448 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f27ec155be0 con 0x7f27ec06e1c0 2024-04-25T09:03:53.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.765+0000 7f27e3e00640 1 -- 172.21.15.173:0/1559490448 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7f27d8058ee0 con 0x7f27ec06e1c0 2024-04-25T09:03:53.756 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:03:53.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.769+0000 7f27f3000640 1 -- 172.21.15.173:0/1559490448 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f27cc066f60 msgr2=0x7f27cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:53.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.769+0000 7f27f3000640 1 --2- 172.21.15.173:0/1559490448 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f27cc066f60 0x7f27cc069420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0ad000 tx=0x7f27dc0a6000 comp rx=0 tx=0).stop 2024-04-25T09:03:53.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.769+0000 7f27f3000640 1 -- 172.21.15.173:0/1559490448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27ec06e1c0 msgr2=0x7f27ec156c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:53.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.769+0000 7f27f3000640 1 --2- 172.21.15.173:0/1559490448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27ec06e1c0 0x7f27ec156c70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f27d800c420 tx=0x7f27d800c8e0 comp rx=0 tx=0).stop 2024-04-25T09:03:53.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.769+0000 7f27f3000640 1 -- 172.21.15.173:0/1559490448 shutdown_connections 2024-04-25T09:03:53.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.769+0000 7f27f3000640 1 --2- 172.21.15.173:0/1559490448 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f27cc066f60 0x7f27cc069420 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:53.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.769+0000 7f27f3000640 1 --2- 172.21.15.173:0/1559490448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27ec0ad5c0 0x7f27ec14a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:53.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.769+0000 7f27f3000640 1 --2- 172.21.15.173:0/1559490448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27ec06e1c0 0x7f27ec156c70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:53.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.769+0000 7f27f3000640 1 --2- 172.21.15.173:0/1559490448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27ec06c410 0x7f27ec138960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:53.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.769+0000 7f27f3000640 1 -- 172.21.15.173:0/1559490448 >> 172.21.15.173:0/1559490448 conn(0x7f27ec0cfed0 msgr2=0x7f27ec0b0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:53.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.769+0000 7f27f3000640 1 -- 172.21.15.173:0/1559490448 shutdown_connections 2024-04-25T09:03:53.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.769+0000 7f27f3000640 1 -- 172.21.15.173:0/1559490448 wait complete. 2024-04-25T09:03:53.782 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:03:53.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.933+0000 7f5a20400640 1 Processor -- start 2024-04-25T09:03:53.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.933+0000 7f5a20400640 1 -- start start 2024-04-25T09:03:53.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.937+0000 7f5a20400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a180aeb90 0x7f5a180cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:53.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.937+0000 7f5a20400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5a180aef70 0x7f5a180cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:53.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.937+0000 7f5a20400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5a180cdba0 0x7f5a180ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:53.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.937+0000 7f5a20400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a18071320 con 0x7f5a180cdba0 2024-04-25T09:03:53.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.937+0000 7f5a20400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a18072330 con 0x7f5a180aef70 2024-04-25T09:03:53.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.937+0000 7f5a20400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a180ce550 con 0x7f5a180aeb90 2024-04-25T09:03:53.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.937+0000 7f5a1e400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5a180cdba0 0x7f5a180ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:53.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.937+0000 7f5a1e400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5a180cdba0 0x7f5a180ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53356/0 (socket says 172.21.15.173:53356) 2024-04-25T09:03:53.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.937+0000 7f5a1e400640 1 -- 172.21.15.173:0/3661679362 learned_addr learned my addr 172.21.15.173:0/3661679362 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:53.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.937+0000 7f5a1e400640 1 -- 172.21.15.173:0/3661679362 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a180aeb90 msgr2=0x7f5a180cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:53.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.937+0000 7f5a1e400640 1 --2- 172.21.15.173:0/3661679362 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a180aeb90 0x7f5a180cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:53.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.937+0000 7f5a1e400640 1 -- 172.21.15.173:0/3661679362 >> v2:172.21.15.194:3300/0 conn(0x7f5a180aef70 msgr2=0x7f5a180cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:53.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.937+0000 7f5a1e400640 1 --2- 172.21.15.173:0/3661679362 >> v2:172.21.15.194:3300/0 conn(0x7f5a180aef70 0x7f5a180cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:53.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.937+0000 7f5a1e400640 1 -- 172.21.15.173:0/3661679362 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a18071570 con 0x7f5a180cdba0 2024-04-25T09:03:53.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.937+0000 7f5a1e400640 1 --2- 172.21.15.173:0/3661679362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a180cdba0 0x7f5a180ce010 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5a1806b9e0 tx=0x7f5a1001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b767ec8934db8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:53.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a17e00640 1 -- 172.21.15.173:0/3661679362 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a100a57b0 con 0x7f5a180cdba0 2024-04-25T09:03:53.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a17e00640 1 -- 172.21.15.173:0/3661679362 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a100a5950 con 0x7f5a180cdba0 2024-04-25T09:03:53.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a17e00640 1 -- 172.21.15.173:0/3661679362 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a100a5d20 con 0x7f5a180cdba0 2024-04-25T09:03:53.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a20400640 1 -- 172.21.15.173:0/3661679362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a180cdba0 msgr2=0x7f5a180ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:53.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a20400640 1 --2- 172.21.15.173:0/3661679362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a180cdba0 0x7f5a180ce010 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5a1806b9e0 tx=0x7f5a1001c930 comp rx=0 tx=0).stop 2024-04-25T09:03:53.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a20400640 1 -- 172.21.15.173:0/3661679362 shutdown_connections 2024-04-25T09:03:53.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a20400640 1 --2- 172.21.15.173:0/3661679362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a180cdba0 0x7f5a180ce010 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:53.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a20400640 1 --2- 172.21.15.173:0/3661679362 >> v2:172.21.15.194:3300/0 conn(0x7f5a180aef70 0x7f5a180cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:53.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a20400640 1 --2- 172.21.15.173:0/3661679362 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a180aeb90 0x7f5a180cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:53.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a20400640 1 -- 172.21.15.173:0/3661679362 >> 172.21.15.173:0/3661679362 conn(0x7f5a1806ac90 msgr2=0x7f5a1806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:53.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a20400640 1 -- 172.21.15.173:0/3661679362 shutdown_connections 2024-04-25T09:03:53.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a20400640 1 -- 172.21.15.173:0/3661679362 wait complete. 2024-04-25T09:03:53.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a20400640 1 Processor -- start 2024-04-25T09:03:53.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a20400640 1 -- start start 2024-04-25T09:03:53.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a20400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a180aeb90 0x7f5a1814eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:53.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a20400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a180aef70 0x7f5a18159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:53.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a20400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a180cdba0 0x7f5a180ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:53.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a20400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1815ef40 con 0x7f5a180aef70 2024-04-25T09:03:53.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a20400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1815edc0 con 0x7f5a180cdba0 2024-04-25T09:03:53.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a20400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1815f0c0 con 0x7f5a180aeb90 2024-04-25T09:03:53.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a1d000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a180aef70 0x7f5a18159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:53.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a1d000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a180aef70 0x7f5a18159740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53370/0 (socket says 172.21.15.173:53370) 2024-04-25T09:03:53.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a1d000640 1 -- 172.21.15.173:0/3934399948 learned_addr learned my addr 172.21.15.173:0/3934399948 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a1e400640 1 --2- 172.21.15.173:0/3934399948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a180cdba0 0x7f5a180ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.941+0000 7f5a1da00640 1 --2- 172.21.15.173:0/3934399948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a180aeb90 0x7f5a1814eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.945+0000 7f5a1d000640 1 -- 172.21.15.173:0/3934399948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a180aeb90 msgr2=0x7f5a1814eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.945+0000 7f5a1d000640 1 --2- 172.21.15.173:0/3934399948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a180aeb90 0x7f5a1814eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.945+0000 7f5a1d000640 1 -- 172.21.15.173:0/3934399948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a180cdba0 msgr2=0x7f5a180ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.945+0000 7f5a1d000640 1 --2- 172.21.15.173:0/3934399948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a180cdba0 0x7f5a180ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.945+0000 7f5a1d000640 1 -- 172.21.15.173:0/3934399948 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a180af630 con 0x7f5a180aef70 2024-04-25T09:03:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.945+0000 7f5a1da00640 1 --2- 172.21.15.173:0/3934399948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a180aeb90 0x7f5a1814eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.945+0000 7f5a1d000640 1 --2- 172.21.15.173:0/3934399948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a180aef70 0x7f5a18159740 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400b4b0 tx=0x7f5a0400b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.945+0000 7f5a15600640 1 -- 172.21.15.173:0/3934399948 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04014070 con 0x7f5a180aef70 2024-04-25T09:03:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.945+0000 7f5a15600640 1 -- 172.21.15.173:0/3934399948 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a04010610 con 0x7f5a180aef70 2024-04-25T09:03:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.945+0000 7f5a15600640 1 -- 172.21.15.173:0/3934399948 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04010a00 con 0x7f5a180aef70 2024-04-25T09:03:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.945+0000 7f5a20400640 1 -- 172.21.15.173:0/3934399948 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a180af910 con 0x7f5a180aef70 2024-04-25T09:03:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.945+0000 7f5a20400640 1 -- 172.21.15.173:0/3934399948 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a18159c80 con 0x7f5a180aef70 2024-04-25T09:03:53.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.945+0000 7f5a20400640 1 -- 172.21.15.173:0/3934399948 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a18073ab0 con 0x7f5a180aef70 2024-04-25T09:03:53.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.945+0000 7f5a15600640 1 -- 172.21.15.173:0/3934399948 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5a04017070 con 0x7f5a180aef70 2024-04-25T09:03:53.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.945+0000 7f5a15600640 1 --2- 172.21.15.173:0/3934399948 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59f8066f60 0x7f59f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:53.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.945+0000 7f5a15600640 1 -- 172.21.15.173:0/3934399948 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6383+0+0 (secure 0 0 0) 0x7f5a04084bb0 con 0x7f5a180aef70 2024-04-25T09:03:53.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.945+0000 7f5a1da00640 1 --2- 172.21.15.173:0/3934399948 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59f8066f60 0x7f59f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:53.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.949+0000 7f5a1da00640 1 --2- 172.21.15.173:0/3934399948 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59f8066f60 0x7f59f8069420 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c006fd0 tx=0x7f5a0c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:53.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:53.949+0000 7f5a15600640 1 -- 172.21.15.173:0/3934399948 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5a04055360 con 0x7f5a180aef70 2024-04-25T09:03:54.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.105+0000 7f5a20400640 1 -- 172.21.15.173:0/3934399948 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5a18151860 con 0x7f5a180aef70 2024-04-25T09:03:54.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.769+0000 7f5a15600640 1 -- 172.21.15.173:0/3934399948 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5a04059400 con 0x7f5a180aef70 2024-04-25T09:03:54.758 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' removed 2024-04-25T09:03:54.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.773+0000 7f5a20400640 1 -- 172.21.15.173:0/3934399948 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59f8066f60 msgr2=0x7f59f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.773+0000 7f5a20400640 1 --2- 172.21.15.173:0/3934399948 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59f8066f60 0x7f59f8069420 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c006fd0 tx=0x7f5a0c008040 comp rx=0 tx=0).stop 2024-04-25T09:03:54.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.773+0000 7f5a20400640 1 -- 172.21.15.173:0/3934399948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a180aef70 msgr2=0x7f5a18159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.773+0000 7f5a20400640 1 --2- 172.21.15.173:0/3934399948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a180aef70 0x7f5a18159740 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400b4b0 tx=0x7f5a0400b970 comp rx=0 tx=0).stop 2024-04-25T09:03:54.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.773+0000 7f5a20400640 1 -- 172.21.15.173:0/3934399948 shutdown_connections 2024-04-25T09:03:54.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.773+0000 7f5a20400640 1 --2- 172.21.15.173:0/3934399948 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59f8066f60 0x7f59f8069420 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.773+0000 7f5a20400640 1 --2- 172.21.15.173:0/3934399948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a180cdba0 0x7f5a180ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.773+0000 7f5a20400640 1 --2- 172.21.15.173:0/3934399948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a180aef70 0x7f5a18159740 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.773+0000 7f5a20400640 1 --2- 172.21.15.173:0/3934399948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a180aeb90 0x7f5a1814eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.773+0000 7f5a20400640 1 -- 172.21.15.173:0/3934399948 >> 172.21.15.173:0/3934399948 conn(0x7f5a1806ac90 msgr2=0x7f5a1806e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:54.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.773+0000 7f5a20400640 1 -- 172.21.15.173:0/3934399948 shutdown_connections 2024-04-25T09:03:54.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.773+0000 7f5a20400640 1 -- 172.21.15.173:0/3934399948 wait complete. 2024-04-25T09:03:54.789 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-25T09:03:54.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f35000640 1 Processor -- start 2024-04-25T09:03:54.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f35000640 1 -- start start 2024-04-25T09:03:54.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f35000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6f300aeb90 0x7f6f300cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f35000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f30071570 con 0x7f6f300aef70 2024-04-25T09:03:54.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f35000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f30071850 con 0x7f6f300ce2b0 2024-04-25T09:03:54.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f35000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f30071320 con 0x7f6f300aeb90 2024-04-25T09:03:54.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f25400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f6f300aef70 0x7f6f300cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45080/0 (socket says 172.21.15.173:45080) 2024-04-25T09:03:54.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f25400640 1 -- 172.21.15.173:0/3031314361 learned_addr learned my addr 172.21.15.173:0/3031314361 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2de00640 1 --2- 172.21.15.173:0/3031314361 >> v2:172.21.15.194:3300/0 conn(0x7f6f300aeb90 0x7f6f300cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2d400640 1 -- 172.21.15.173:0/3031314361 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030301448 0 0) 0x7f6f30071570 con 0x7f6f300aef70 2024-04-25T09:03:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2d400640 1 -- 172.21.15.173:0/3031314361 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f14003530 con 0x7f6f300aef70 2024-04-25T09:03:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2d400640 1 -- 172.21.15.173:0/3031314361 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 602513494 0 0) 0x7f6f14003530 con 0x7f6f300aef70 2024-04-25T09:03:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2d400640 1 -- 172.21.15.173:0/3031314361 >> v2:172.21.15.194:3300/0 conn(0x7f6f300aeb90 msgr2=0x7f6f300cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2d400640 1 --2- 172.21.15.173:0/3031314361 >> v2:172.21.15.194:3300/0 conn(0x7f6f300aeb90 0x7f6f300cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2d400640 1 -- 172.21.15.173:0/3031314361 >> v1:172.21.15.194:6789/0 conn(0x7f6f300ce2b0 legacy=0x7f6f3015af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2d400640 1 -- 172.21.15.173:0/3031314361 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f30071b30 con 0x7f6f300aef70 2024-04-25T09:03:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2d400640 1 -- 172.21.15.173:0/3031314361 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f6f18001680 con 0x7f6f300aef70 2024-04-25T09:03:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2d400640 1 -- 172.21.15.173:0/3031314361 >> v1:172.21.15.173:6789/0 conn(0x7f6f300aef70 legacy=0x7f6f300cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2d400640 1 --2- 172.21.15.173:0/3031314361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f14003a10 0x7f6f14003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2d400640 1 --2- 172.21.15.173:0/3031314361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f14004810 0x7f6f14004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2d400640 1 --2- 172.21.15.173:0/3031314361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f14005220 0x7f6f1400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2d400640 1 -- 172.21.15.173:0/3031314361 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f30071320 con 0x7f6f14004810 2024-04-25T09:03:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2d400640 1 -- 172.21.15.173:0/3031314361 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1400c170 con 0x7f6f14003a10 2024-04-25T09:03:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2d400640 1 -- 172.21.15.173:0/3031314361 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1400c370 con 0x7f6f14005220 2024-04-25T09:03:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f25400640 1 --2- 172.21.15.173:0/3031314361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f14004810 0x7f6f14004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2de00640 1 --2- 172.21.15.173:0/3031314361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f14003a10 0x7f6f14003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2e800640 1 --2- 172.21.15.173:0/3031314361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f14005220 0x7f6f1400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f25400640 1 -- 172.21.15.173:0/3031314361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f14005220 msgr2=0x7f6f1400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f25400640 1 --2- 172.21.15.173:0/3031314361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f14005220 0x7f6f1400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f25400640 1 -- 172.21.15.173:0/3031314361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f14003a10 msgr2=0x7f6f14003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f25400640 1 --2- 172.21.15.173:0/3031314361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f14003a10 0x7f6f14003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f25400640 1 -- 172.21.15.173:0/3031314361 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f14003530 con 0x7f6f14004810 2024-04-25T09:03:54.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.941+0000 7f6f2e800640 1 -- 172.21.15.173:0/3031314361 reap_dead start 2024-04-25T09:03:54.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.945+0000 7f6f25400640 1 --2- 172.21.15.173:0/3031314361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f14004810 0x7f6f14004c90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800c0e0 tx=0x7f6f1801cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8dc1862301c90d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:54.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.945+0000 7f6f2d400640 1 -- 172.21.15.173:0/3031314361 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f18007c50 con 0x7f6f14004810 2024-04-25T09:03:54.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.945+0000 7f6f2d400640 1 -- 172.21.15.173:0/3031314361 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f180a9070 con 0x7f6f14004810 2024-04-25T09:03:54.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.945+0000 7f6f2d400640 1 -- 172.21.15.173:0/3031314361 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f18005d80 con 0x7f6f14004810 2024-04-25T09:03:54.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.945+0000 7f6f35000640 1 -- 172.21.15.173:0/3031314361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f14004810 msgr2=0x7f6f14004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.945+0000 7f6f35000640 1 --2- 172.21.15.173:0/3031314361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f14004810 0x7f6f14004c90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800c0e0 tx=0x7f6f1801cb40 comp rx=0 tx=0).stop 2024-04-25T09:03:54.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.945+0000 7f6f35000640 1 -- 172.21.15.173:0/3031314361 shutdown_connections 2024-04-25T09:03:54.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.945+0000 7f6f35000640 1 --2- 172.21.15.173:0/3031314361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f14004810 0x7f6f14004c90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.945+0000 7f6f35000640 1 -- 172.21.15.173:0/3031314361 >> 172.21.15.173:0/3031314361 conn(0x7f6f3006ac90 msgr2=0x7f6f3006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:54.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.945+0000 7f6f35000640 1 -- 172.21.15.173:0/3031314361 shutdown_connections 2024-04-25T09:03:54.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f35000640 1 -- 172.21.15.173:0/3031314361 wait complete. 2024-04-25T09:03:54.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f35000640 1 Processor -- start 2024-04-25T09:03:54.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f35000640 1 -- start start 2024-04-25T09:03:54.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f35000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f14004810 0x7f6f30158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f35000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f3014dcb0 0x7f6f300cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f35000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f3014d0b0 0x7f6f3014d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f35000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3015e940 con 0x7f6f3014dcb0 2024-04-25T09:03:54.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f35000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3015e7c0 con 0x7f6f3014d0b0 2024-04-25T09:03:54.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f35000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3015eac0 con 0x7f6f14004810 2024-04-25T09:03:54.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f25400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f3014dcb0 0x7f6f300cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f25400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f3014dcb0 0x7f6f300cebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53402/0 (socket says 172.21.15.173:53402) 2024-04-25T09:03:54.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f25400640 1 -- 172.21.15.173:0/2375498579 learned_addr learned my addr 172.21.15.173:0/2375498579 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:54.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f2e800640 1 --2- 172.21.15.173:0/2375498579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f3014d0b0 0x7f6f3014d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f2de00640 1 --2- 172.21.15.173:0/2375498579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f14004810 0x7f6f30158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f25400640 1 -- 172.21.15.173:0/2375498579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f14004810 msgr2=0x7f6f30158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f25400640 1 --2- 172.21.15.173:0/2375498579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f14004810 0x7f6f30158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f25400640 1 -- 172.21.15.173:0/2375498579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f3014d0b0 msgr2=0x7f6f3014d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:54.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f25400640 1 --2- 172.21.15.173:0/2375498579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f3014d0b0 0x7f6f3014d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:54.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f25400640 1 -- 172.21.15.173:0/2375498579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3014da50 con 0x7f6f3014dcb0 2024-04-25T09:03:54.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f25400640 1 --2- 172.21.15.173:0/2375498579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f3014dcb0 0x7f6f300cebd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6f1801c5b0 tx=0x7f6f14005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:54.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f26a00640 1 -- 172.21.15.173:0/2375498579 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f18000ee0 con 0x7f6f3014dcb0 2024-04-25T09:03:54.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f26a00640 1 -- 172.21.15.173:0/2375498579 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f18004e50 con 0x7f6f3014dcb0 2024-04-25T09:03:54.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f26a00640 1 -- 172.21.15.173:0/2375498579 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f18007140 con 0x7f6f3014dcb0 2024-04-25T09:03:54.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.949+0000 7f6f35000640 1 -- 172.21.15.173:0/2375498579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f301568b0 con 0x7f6f3014dcb0 2024-04-25T09:03:54.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.953+0000 7f6f35000640 1 -- 172.21.15.173:0/2375498579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f300b08f0 con 0x7f6f3014dcb0 2024-04-25T09:03:54.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.953+0000 7f6f35000640 1 -- 172.21.15.173:0/2375498579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f30073ab0 con 0x7f6f3014dcb0 2024-04-25T09:03:54.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.953+0000 7f6f26a00640 1 -- 172.21.15.173:0/2375498579 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6f180b6030 con 0x7f6f3014dcb0 2024-04-25T09:03:54.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.953+0000 7f6f26a00640 1 --2- 172.21.15.173:0/2375498579 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f0c0670a0 0x7f6f0c069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:54.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.953+0000 7f6f26a00640 1 -- 172.21.15.173:0/2375498579 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f6f1811e0d0 con 0x7f6f3014dcb0 2024-04-25T09:03:54.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.953+0000 7f6f2de00640 1 --2- 172.21.15.173:0/2375498579 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f0c0670a0 0x7f6f0c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:54.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.953+0000 7f6f2de00640 1 --2- 172.21.15.173:0/2375498579 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f0c0670a0 0x7f6f0c069560 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6f30068ce0 tx=0x7f6f20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:54.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:54.957+0000 7f6f26a00640 1 -- 172.21.15.173:0/2375498579 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6f18016850 con 0x7f6f3014dcb0 2024-04-25T09:03:55.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:55.125+0000 7f6f35000640 1 -- 172.21.15.173:0/2375498579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6f300cba70 con 0x7f6f3014dcb0 2024-04-25T09:03:55.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:55.777+0000 7f6f26a00640 1 -- 172.21.15.173:0/2375498579 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7f6f180ef040 con 0x7f6f3014dcb0 2024-04-25T09:03:55.769 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data_ec' removed 2024-04-25T09:03:55.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:55.781+0000 7f6f35000640 1 -- 172.21.15.173:0/2375498579 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f0c0670a0 msgr2=0x7f6f0c069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:55.781+0000 7f6f35000640 1 --2- 172.21.15.173:0/2375498579 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f0c0670a0 0x7f6f0c069560 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6f30068ce0 tx=0x7f6f20008040 comp rx=0 tx=0).stop 2024-04-25T09:03:55.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:55.781+0000 7f6f35000640 1 -- 172.21.15.173:0/2375498579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f3014dcb0 msgr2=0x7f6f300cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:55.781+0000 7f6f35000640 1 --2- 172.21.15.173:0/2375498579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f3014dcb0 0x7f6f300cebd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6f1801c5b0 tx=0x7f6f14005840 comp rx=0 tx=0).stop 2024-04-25T09:03:55.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:55.781+0000 7f6f35000640 1 -- 172.21.15.173:0/2375498579 shutdown_connections 2024-04-25T09:03:55.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:55.781+0000 7f6f35000640 1 --2- 172.21.15.173:0/2375498579 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f0c0670a0 0x7f6f0c069560 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:55.781+0000 7f6f35000640 1 --2- 172.21.15.173:0/2375498579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f3014d0b0 0x7f6f3014d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:55.781+0000 7f6f35000640 1 --2- 172.21.15.173:0/2375498579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f3014dcb0 0x7f6f300cebd0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:55.781+0000 7f6f35000640 1 --2- 172.21.15.173:0/2375498579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f14004810 0x7f6f30158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:55.781+0000 7f6f35000640 1 -- 172.21.15.173:0/2375498579 >> 172.21.15.173:0/2375498579 conn(0x7f6f3006ac90 msgr2=0x7f6f3015c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:55.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:55.781+0000 7f6f35000640 1 -- 172.21.15.173:0/2375498579 shutdown_connections 2024-04-25T09:03:55.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:55.781+0000 7f6f35000640 1 -- 172.21.15.173:0/2375498579 wait complete. 2024-04-25T09:03:55.798 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:03:55.798 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:03:55.798 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:03:55.798 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:03:55.798 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:03:55.798 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:03:55.799 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:03:55.799 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:03:55.799 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:03:55.799 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:03:55.799 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:03:55.799 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:03:55.799 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:03:55.799 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:03:55.800 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:03:55.800 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:03:55.813 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:03:55.813 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:03:55.814 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:03:55.814 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:03:55.815 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:03:55.816 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:03:55.816 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:03:55.816 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:03:55.864 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:03:55.864 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:55.865 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:03:55.865 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:55.866 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:03:55.866 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:55.866 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:03:55.867 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:55.867 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:03:55.952 INFO:tasks.ceph.mds.c.smithi173.stdout:starting mds.c at 2024-04-25T09:03:55.953 INFO:tasks.ceph.mds.a.smithi173.stdout:starting mds.a at 2024-04-25T09:03:55.958 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-04-25T09:03:55.958 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-04-25T09:03:55.960 INFO:tasks.ceph.mds.d.smithi194.stderr:2024-04-25T09:03:55.967+0000 7f59b1000640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-04-25T09:03:56.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.025+0000 7f7e86800640 1 Processor -- start 2024-04-25T09:03:56.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.025+0000 7f7e86800640 1 -- start start 2024-04-25T09:03:56.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.025+0000 7f7e86800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7e800b5050 0x7f7e8015fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.025+0000 7f7e86800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e8006b120 0x7f7e8006b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.025+0000 7f7e86800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8015f3c0 con 0x7f7e8015efe0 2024-04-25T09:03:56.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.025+0000 7f7e86800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8006ac90 con 0x7f7e800b5050 2024-04-25T09:03:56.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.025+0000 7f7e86800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e800ad780 con 0x7f7e8006b120 2024-04-25T09:03:56.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.025+0000 7f7e7ea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7e800b5050 0x7f7e8015fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.025+0000 7f7e7ea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7e800b5050 0x7f7e8015fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:35522/0 (socket says 172.21.15.173:35522) 2024-04-25T09:03:56.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.025+0000 7f7e7f400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f7e8015efe0 0x7f7e8015f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:42920/0 (socket says 172.21.15.173:42920) 2024-04-25T09:03:56.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.025+0000 7f7e7ea00640 1 -- 172.21.15.173:0/2978073037 learned_addr learned my addr 172.21.15.173:0/2978073037 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:56.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.025+0000 7f7e7fe00640 1 --2- 172.21.15.173:0/2978073037 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e8006b120 0x7f7e8006b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.025+0000 7f7e7ea00640 1 -- 172.21.15.173:0/2978073037 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e8006b120 msgr2=0x7f7e8006b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.025+0000 7f7e7ea00640 1 --2- 172.21.15.173:0/2978073037 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e8006b120 0x7f7e8006b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.025+0000 7f7e7ea00640 1 -- 172.21.15.173:0/2978073037 >> v1:172.21.15.194:6789/0 conn(0x7f7e8015efe0 legacy=0x7f7e8015f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.025+0000 7f7e7ea00640 1 -- 172.21.15.173:0/2978073037 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e800af730 con 0x7f7e800b5050 2024-04-25T09:03:56.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.025+0000 7f7e7e000640 1 -- 172.21.15.173:0/2978073037 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554959550 0 0) 0x7f7e8015f3c0 con 0x7f7e8015efe0 2024-04-25T09:03:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.029+0000 7f7e7ea00640 1 --2- 172.21.15.173:0/2978073037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e800b5050 0x7f7e8015fd10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009870 tx=0x7f7e6c01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9adac3e4357cf7f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.029+0000 7f7e7e000640 1 -- 172.21.15.173:0/2978073037 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0a9620 con 0x7f7e800b5050 2024-04-25T09:03:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.029+0000 7f7e7e000640 1 -- 172.21.15.173:0/2978073037 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c0a97c0 con 0x7f7e800b5050 2024-04-25T09:03:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.029+0000 7f7e7e000640 1 -- 172.21.15.173:0/2978073037 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0a9b90 con 0x7f7e800b5050 2024-04-25T09:03:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.029+0000 7f7e86800640 1 -- 172.21.15.173:0/2978073037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e800b5050 msgr2=0x7f7e8015fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.029+0000 7f7e86800640 1 --2- 172.21.15.173:0/2978073037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e800b5050 0x7f7e8015fd10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009870 tx=0x7f7e6c01c560 comp rx=0 tx=0).stop 2024-04-25T09:03:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.029+0000 7f7e86800640 1 -- 172.21.15.173:0/2978073037 shutdown_connections 2024-04-25T09:03:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.029+0000 7f7e86800640 1 --2- 172.21.15.173:0/2978073037 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e8006b120 0x7f7e8006b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.029+0000 7f7e86800640 1 --2- 172.21.15.173:0/2978073037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e800b5050 0x7f7e8015fd10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.029+0000 7f7e86800640 1 -- 172.21.15.173:0/2978073037 >> 172.21.15.173:0/2978073037 conn(0x7f7e800cfed0 msgr2=0x7f7e800d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.029+0000 7f7e86800640 1 -- 172.21.15.173:0/2978073037 shutdown_connections 2024-04-25T09:03:56.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.029+0000 7f7e86800640 1 -- 172.21.15.173:0/2978073037 wait complete. 2024-04-25T09:03:56.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e86800640 1 Processor -- start 2024-04-25T09:03:56.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e86800640 1 -- start start 2024-04-25T09:03:56.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e86800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e8006b120 0x7f7e80155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e86800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e800b5050 0x7f7e800cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e86800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e8015efe0 0x7f7e8013b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e86800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e801603d0 con 0x7f7e800b5050 2024-04-25T09:03:56.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e86800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80160250 con 0x7f7e8006b120 2024-04-25T09:03:56.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e86800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e801689a0 con 0x7f7e8015efe0 2024-04-25T09:03:56.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e7ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e800b5050 0x7f7e800cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e7ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e800b5050 0x7f7e800cf1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53432/0 (socket says 172.21.15.173:53432) 2024-04-25T09:03:56.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e7ea00640 1 -- 172.21.15.173:0/4023781352 learned_addr learned my addr 172.21.15.173:0/4023781352 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:56.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e7f400640 1 --2- 172.21.15.173:0/4023781352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e8006b120 0x7f7e80155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e7fe00640 1 --2- 172.21.15.173:0/4023781352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e8015efe0 0x7f7e8013b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e7ea00640 1 -- 172.21.15.173:0/4023781352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e8015efe0 msgr2=0x7f7e8013b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e7ea00640 1 --2- 172.21.15.173:0/4023781352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e8015efe0 0x7f7e8013b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e7ea00640 1 -- 172.21.15.173:0/4023781352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e8006b120 msgr2=0x7f7e80155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e7ea00640 1 --2- 172.21.15.173:0/4023781352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e8006b120 0x7f7e80155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e7ea00640 1 -- 172.21.15.173:0/4023781352 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8014cfc0 con 0x7f7e800b5050 2024-04-25T09:03:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e7f400640 1 --2- 172.21.15.173:0/4023781352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e8006b120 0x7f7e80155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e7ea00640 1 --2- 172.21.15.173:0/4023781352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e800b5050 0x7f7e800cf1d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0ab040 tx=0x7f7e6c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e77400640 1 -- 172.21.15.173:0/4023781352 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0bc450 con 0x7f7e800b5050 2024-04-25T09:03:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e77400640 1 -- 172.21.15.173:0/4023781352 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c0bc5f0 con 0x7f7e800b5050 2024-04-25T09:03:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e77400640 1 -- 172.21.15.173:0/4023781352 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0bc9e0 con 0x7f7e800b5050 2024-04-25T09:03:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e86800640 1 -- 172.21.15.173:0/4023781352 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8015b2d0 con 0x7f7e800b5050 2024-04-25T09:03:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e86800640 1 -- 172.21.15.173:0/4023781352 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e80155030 con 0x7f7e800b5050 2024-04-25T09:03:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.033+0000 7f7e86800640 1 -- 172.21.15.173:0/4023781352 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e80073ab0 con 0x7f7e800b5050 2024-04-25T09:03:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.037+0000 7f7e77400640 1 -- 172.21.15.173:0/4023781352 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7e8006c300 con 0x7f7e800b5050 2024-04-25T09:03:56.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.037+0000 7f7e77400640 1 --2- 172.21.15.173:0/4023781352 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7e60066f60 0x7f7e60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.037+0000 7f7e77400640 1 -- 172.21.15.173:0/4023781352 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f7e6c11eb10 con 0x7f7e800b5050 2024-04-25T09:03:56.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.037+0000 7f7e7f400640 1 --2- 172.21.15.173:0/4023781352 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7e60066f60 0x7f7e60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.037+0000 7f7e7f400640 1 --2- 172.21.15.173:0/4023781352 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7e60066f60 0x7f7e60069420 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7e70000f70 tx=0x7f7e70007df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.041+0000 7f7e77400640 1 -- 172.21.15.173:0/4023781352 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7e6c0c3070 con 0x7f7e800b5050 2024-04-25T09:03:56.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.205+0000 7f7e86800640 1 -- 172.21.15.173:0/4023781352 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7e800b4390 con 0x7f7e800b5050 2024-04-25T09:03:56.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.793+0000 7f7e77400640 1 -- 172.21.15.173:0/4023781352 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7e6c0ad020 con 0x7f7e800b5050 2024-04-25T09:03:56.785 INFO:teuthology.orchestra.run.smithi173.stderr: removed all blocklist entries 2024-04-25T09:03:56.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.797+0000 7f7e86800640 1 -- 172.21.15.173:0/4023781352 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7e60066f60 msgr2=0x7f7e60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.797+0000 7f7e86800640 1 --2- 172.21.15.173:0/4023781352 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7e60066f60 0x7f7e60069420 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7e70000f70 tx=0x7f7e70007df0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.797+0000 7f7e86800640 1 -- 172.21.15.173:0/4023781352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e800b5050 msgr2=0x7f7e800cf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.797+0000 7f7e86800640 1 --2- 172.21.15.173:0/4023781352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e800b5050 0x7f7e800cf1d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0ab040 tx=0x7f7e6c01ada0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.797+0000 7f7e86800640 1 -- 172.21.15.173:0/4023781352 shutdown_connections 2024-04-25T09:03:56.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.797+0000 7f7e86800640 1 --2- 172.21.15.173:0/4023781352 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7e60066f60 0x7f7e60069420 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.797+0000 7f7e86800640 1 --2- 172.21.15.173:0/4023781352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e8015efe0 0x7f7e8013b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.797+0000 7f7e86800640 1 --2- 172.21.15.173:0/4023781352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e800b5050 0x7f7e800cf1d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.797+0000 7f7e86800640 1 --2- 172.21.15.173:0/4023781352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e8006b120 0x7f7e80155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.797+0000 7f7e86800640 1 -- 172.21.15.173:0/4023781352 >> 172.21.15.173:0/4023781352 conn(0x7f7e800cfed0 msgr2=0x7f7e800d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.797+0000 7f7e86800640 1 -- 172.21.15.173:0/4023781352 shutdown_connections 2024-04-25T09:03:56.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.797+0000 7f7e86800640 1 -- 172.21.15.173:0/4023781352 wait complete. 2024-04-25T09:03:56.812 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:03:56.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.961+0000 7ff857000640 1 Processor -- start 2024-04-25T09:03:56.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.961+0000 7ff857000640 1 -- start start 2024-04-25T09:03:56.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.961+0000 7ff857000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff85015ba60 0x7ff8500cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.961+0000 7ff857000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff8500d00a0 0x7ff8500b6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.961+0000 7ff857000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8500cd460 con 0x7ff85015b680 2024-04-25T09:03:56.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.961+0000 7ff857000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8500d0510 con 0x7ff8500d00a0 2024-04-25T09:03:56.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.961+0000 7ff857000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8500cc3c0 con 0x7ff85015ba60 2024-04-25T09:03:56.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.961+0000 7ff856600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff8500d00a0 0x7ff8500b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.961+0000 7ff855c00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ff85015b680 0x7ff85009a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45092/0 (socket says 172.21.15.173:45092) 2024-04-25T09:03:56.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.961+0000 7ff855c00640 1 -- 172.21.15.173:0/766973369 learned_addr learned my addr 172.21.15.173:0/766973369 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:56.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.961+0000 7ff855200640 1 --2- 172.21.15.173:0/766973369 >> v2:172.21.15.194:3300/0 conn(0x7ff85015ba60 0x7ff8500cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.961+0000 7ff856600640 1 -- 172.21.15.173:0/766973369 >> v2:172.21.15.194:3300/0 conn(0x7ff85015ba60 msgr2=0x7ff8500cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:56.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.961+0000 7ff856600640 1 --2- 172.21.15.173:0/766973369 >> v2:172.21.15.194:3300/0 conn(0x7ff85015ba60 0x7ff8500cfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.961+0000 7ff856600640 1 -- 172.21.15.173:0/766973369 >> v1:172.21.15.173:6789/0 conn(0x7ff85015b680 legacy=0x7ff85009a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.961+0000 7ff856600640 1 -- 172.21.15.173:0/766973369 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8500cc6a0 con 0x7ff8500d00a0 2024-04-25T09:03:56.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.961+0000 7ff84fe00640 1 -- 172.21.15.173:0/766973369 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171806410 0 0) 0x7ff844001120 con 0x7ff85015b680 2024-04-25T09:03:56.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.965+0000 7ff856600640 1 --2- 172.21.15.173:0/766973369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8500d00a0 0x7ff8500b6750 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff85006bd70 tx=0x7ff84801c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d4f9d2ed688b8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.965+0000 7ff84fe00640 1 -- 172.21.15.173:0/766973369 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8480b2070 con 0x7ff8500d00a0 2024-04-25T09:03:56.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.965+0000 7ff84fe00640 1 -- 172.21.15.173:0/766973369 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8480a57e0 con 0x7ff8500d00a0 2024-04-25T09:03:56.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.965+0000 7ff84fe00640 1 -- 172.21.15.173:0/766973369 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8480a5bb0 con 0x7ff8500d00a0 2024-04-25T09:03:56.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.965+0000 7ff857000640 1 -- 172.21.15.173:0/766973369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8500d00a0 msgr2=0x7ff8500b6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.965+0000 7ff857000640 1 --2- 172.21.15.173:0/766973369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8500d00a0 0x7ff8500b6750 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff85006bd70 tx=0x7ff84801c720 comp rx=0 tx=0).stop 2024-04-25T09:03:56.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.965+0000 7ff857000640 1 -- 172.21.15.173:0/766973369 shutdown_connections 2024-04-25T09:03:56.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.965+0000 7ff857000640 1 --2- 172.21.15.173:0/766973369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8500d00a0 0x7ff8500b6750 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.965+0000 7ff857000640 1 --2- 172.21.15.173:0/766973369 >> v2:172.21.15.194:3300/0 conn(0x7ff85015ba60 0x7ff8500cfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.965+0000 7ff857000640 1 -- 172.21.15.173:0/766973369 >> 172.21.15.173:0/766973369 conn(0x7ff8500b3090 msgr2=0x7ff8500b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.965+0000 7ff857000640 1 -- 172.21.15.173:0/766973369 shutdown_connections 2024-04-25T09:03:56.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.965+0000 7ff857000640 1 -- 172.21.15.173:0/766973369 wait complete. 2024-04-25T09:03:56.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.965+0000 7ff857000640 1 Processor -- start 2024-04-25T09:03:56.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.965+0000 7ff857000640 1 -- start start 2024-04-25T09:03:56.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff857000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8500d00a0 0x7ff85015ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff857000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff85015b680 0x7ff8500ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff857000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff85015ba60 0x7ff8500ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff857000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85009ab70 con 0x7ff85015ba60 2024-04-25T09:03:56.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff857000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500cc070 con 0x7ff8500d00a0 2024-04-25T09:03:56.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff857000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85009acf0 con 0x7ff85015b680 2024-04-25T09:03:56.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff856600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff85015ba60 0x7ff8500ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff856600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff85015ba60 0x7ff8500ae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53446/0 (socket says 172.21.15.173:53446) 2024-04-25T09:03:56.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff856600640 1 -- 172.21.15.173:0/2238111512 learned_addr learned my addr 172.21.15.173:0/2238111512 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:56.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff855c00640 1 --2- 172.21.15.173:0/2238111512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8500d00a0 0x7ff85015ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff855200640 1 --2- 172.21.15.173:0/2238111512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff85015b680 0x7ff8500ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff856600640 1 -- 172.21.15.173:0/2238111512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff85015b680 msgr2=0x7ff8500ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff856600640 1 --2- 172.21.15.173:0/2238111512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff85015b680 0x7ff8500ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff856600640 1 -- 172.21.15.173:0/2238111512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8500d00a0 msgr2=0x7ff85015ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff856600640 1 --2- 172.21.15.173:0/2238111512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8500d00a0 0x7ff85015ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff856600640 1 -- 172.21.15.173:0/2238111512 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8500cab50 con 0x7ff85015ba60 2024-04-25T09:03:56.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff855c00640 1 --2- 172.21.15.173:0/2238111512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8500d00a0 0x7ff85015ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:56.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff855200640 1 --2- 172.21.15.173:0/2238111512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff85015b680 0x7ff8500ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:56.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff856600640 1 --2- 172.21.15.173:0/2238111512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff85015ba60 0x7ff8500ae7f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff848019330 tx=0x7ff8480194c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff84d600640 1 -- 172.21.15.173:0/2238111512 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8480b2040 con 0x7ff85015ba60 2024-04-25T09:03:56.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff84d600640 1 -- 172.21.15.173:0/2238111512 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8480a55e0 con 0x7ff85015ba60 2024-04-25T09:03:56.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff84d600640 1 -- 172.21.15.173:0/2238111512 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8480b8670 con 0x7ff85015ba60 2024-04-25T09:03:56.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff857000640 1 -- 172.21.15.173:0/2238111512 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8500cae30 con 0x7ff85015ba60 2024-04-25T09:03:56.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff857000640 1 -- 172.21.15.173:0/2238111512 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8500b17e0 con 0x7ff85015ba60 2024-04-25T09:03:56.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff857000640 1 -- 172.21.15.173:0/2238111512 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff850073a40 con 0x7ff85015ba60 2024-04-25T09:03:56.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.969+0000 7ff84d600640 1 -- 172.21.15.173:0/2238111512 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff8480c1020 con 0x7ff85015ba60 2024-04-25T09:03:56.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.973+0000 7ff84d600640 1 --2- 172.21.15.173:0/2238111512 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff830066f60 0x7ff830069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:56.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.973+0000 7ff84d600640 1 -- 172.21.15.173:0/2238111512 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5249+0+0 (secure 0 0 0) 0x7ff84811f9d0 con 0x7ff85015ba60 2024-04-25T09:03:56.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.973+0000 7ff855c00640 1 --2- 172.21.15.173:0/2238111512 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff830066f60 0x7ff830069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:56.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.973+0000 7ff855c00640 1 --2- 172.21.15.173:0/2238111512 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff830066f60 0x7ff830069420 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff844000f70 tx=0x7ff844007a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:56.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:56.977+0000 7ff84d600640 1 -- 172.21.15.173:0/2238111512 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff8500b74a0 con 0x7ff85015ba60 2024-04-25T09:03:57.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.181+0000 7ff857000640 1 -- 172.21.15.173:0/2238111512 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff8500b3cc0 con 0x7ff85015ba60 2024-04-25T09:03:57.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.181+0000 7ff84d600640 1 -- 172.21.15.173:0/2238111512 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7ff8480a57b0 con 0x7ff85015ba60 2024-04-25T09:03:57.173 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:57.173 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:03:57.173 INFO:teuthology.orchestra.run.smithi173.stdout: "auth_dump": [ 2024-04-25T09:03:57.173 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.173 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.a", 2024-04-25T09:03:57.173 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmnVr3EhAAn+C0Mb/MrYSZuQyr5QTXig==", 2024-04-25T09:03:57.173 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.173 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:03:57.173 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:03:57.173 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:03:57.174 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:03:57.174 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.174 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.174 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.174 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.b", 2024-04-25T09:03:57.174 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6Gypm0QfFHhAAuP8xE/8pvSZMcP8N33OB9Q==", 2024-04-25T09:03:57.174 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.174 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:03:57.174 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:03:57.174 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:03:57.174 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:03:57.174 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.174 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.175 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.175 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.c", 2024-04-25T09:03:57.175 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmQsv4GRAATNiD7udOvl8xRDIx64O5jg==", 2024-04-25T09:03:57.175 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.175 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:03:57.175 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:03:57.175 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:03:57.175 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:03:57.175 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.175 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.175 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.175 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.d", 2024-04-25T09:03:57.175 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmtGMSJhAAonqLeuSsNrgyZks1eoJ1Gg==", 2024-04-25T09:03:57.175 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.175 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:03:57.175 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:03:57.176 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:03:57.176 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:03:57.176 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.176 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.176 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.176 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.0", 2024-04-25T09:03:57.176 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD9Gypm+Yw7LBAAnOFUKU3w1ltre7aHMWZ/SQ==", 2024-04-25T09:03:57.176 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.176 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:57.176 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:03:57.176 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:03:57.176 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.176 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.176 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.177 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.1", 2024-04-25T09:03:57.177 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAAHCpm4BUIOBAAmbfWUWCun/una5WoemhL6Q==", 2024-04-25T09:03:57.177 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.177 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:57.177 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:03:57.177 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:03:57.177 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.178 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.178 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.178 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.2", 2024-04-25T09:03:57.178 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAEHCpmFXIaBRAA0cN2GdLSS3jJC+x4RVUUlw==", 2024-04-25T09:03:57.178 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.178 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:57.178 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:03:57.178 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:03:57.178 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.179 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.179 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.179 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.3", 2024-04-25T09:03:57.179 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAHHCpmUD+YDxAALPvf1wLzhuQmFPo3/vJkdQ==", 2024-04-25T09:03:57.179 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.179 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:57.179 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:03:57.179 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:03:57.179 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.179 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.179 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.179 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.4", 2024-04-25T09:03:57.179 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQANHCpmLQ0fCBAA1Shz0Pfns+rj5r601hzOnQ==", 2024-04-25T09:03:57.179 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.179 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:57.180 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:03:57.180 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:03:57.180 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.180 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.180 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.180 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.5", 2024-04-25T09:03:57.180 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAQHCpmyMj1ERAAMRvZ3PFQa9oe6oGemLvfxw==", 2024-04-25T09:03:57.180 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.180 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:57.180 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:03:57.180 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:03:57.180 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.180 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.180 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.180 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.6", 2024-04-25T09:03:57.181 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQATHCpmKha6GxAAF4zfdFDlylGHHhGI5tVpGA==", 2024-04-25T09:03:57.181 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.181 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:57.181 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:03:57.181 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:03:57.181 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.181 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.181 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.181 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.7", 2024-04-25T09:03:57.181 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAWHCpmB2lFJhAA3sYYsjS5DIC5fCDz6ur0tA==", 2024-04-25T09:03:57.181 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.181 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:57.181 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:03:57.181 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:03:57.181 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.181 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.182 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.182 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.0", 2024-04-25T09:03:57.182 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w==", 2024-04-25T09:03:57.182 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.182 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:03:57.182 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:03:57.182 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:03:57.182 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:03:57.182 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.182 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.182 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.182 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.1", 2024-04-25T09:03:57.182 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6Gypm1PbHMxAAXMrgpR/xgzfQuuNrculQxA==", 2024-04-25T09:03:57.182 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.183 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:03:57.183 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:03:57.183 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:03:57.183 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:03:57.183 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.183 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.183 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.183 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.2", 2024-04-25T09:03:57.183 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmrTxjMBAAaqwDl5uiLxhaDIk7m6oDIw==", 2024-04-25T09:03:57.183 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.183 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:03:57.183 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:03:57.183 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:03:57.183 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:03:57.183 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.183 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.184 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.184 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.3", 2024-04-25T09:03:57.184 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmlAS9ORAAvYbwLnUaDHXOqvEBwJJJcQ==", 2024-04-25T09:03:57.184 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.184 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:03:57.184 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:03:57.184 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:03:57.184 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:03:57.184 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.184 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.184 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.184 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.admin", 2024-04-25T09:03:57.184 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD5GypmYFhkMhAACwSsE+B9l263vnlJ0LjFkQ==", 2024-04-25T09:03:57.184 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.184 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:03:57.185 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:03:57.185 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:03:57.185 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:03:57.185 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.185 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.185 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.185 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.bootstrap-mds", 2024-04-25T09:03:57.185 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAhHCpmuEYDJxAABkTnDHcmu41d3YNG7wzJKQ==", 2024-04-25T09:03:57.185 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.185 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile bootstrap-mds" 2024-04-25T09:03:57.185 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.185 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.185 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.185 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.bootstrap-mgr", 2024-04-25T09:03:57.185 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAhHCpmXVEDJxAAzpIX20kyCUUPJTJe7i/0gA==", 2024-04-25T09:03:57.185 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.186 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-25T09:03:57.186 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.186 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.186 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.186 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.bootstrap-osd", 2024-04-25T09:03:57.186 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAhHCpm/lkDJxAAjxNDE6RtmpMGlfFMl1GP6w==", 2024-04-25T09:03:57.186 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.186 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile bootstrap-osd" 2024-04-25T09:03:57.186 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.186 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.186 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.186 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.bootstrap-rbd", 2024-04-25T09:03:57.186 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAhHCpmbmIDJxAAT0tJi3dDzmXpLHqOnZ/dng==", 2024-04-25T09:03:57.186 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.187 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-25T09:03:57.187 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.187 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.187 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.187 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-25T09:03:57.187 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAhHCpmWmsDJxAApGDmAffnkt8GIy3XNcoVeg==", 2024-04-25T09:03:57.187 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.187 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-25T09:03:57.187 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.187 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.187 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.187 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.bootstrap-rgw", 2024-04-25T09:03:57.187 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAhHCpmvHQDJxAARnR9xhEMb020dKCKFQzy8g==", 2024-04-25T09:03:57.187 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.187 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-25T09:03:57.187 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.188 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.188 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.188 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mgr.x", 2024-04-25T09:03:57.188 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmMSqHDhAAe0nkrXbT7dBbAbI89ExUmw==", 2024-04-25T09:03:57.188 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.188 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:03:57.188 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile mgr", 2024-04-25T09:03:57.188 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:03:57.189 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.189 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:03:57.189 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:03:57.189 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mgr.y", 2024-04-25T09:03:57.189 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmjCuzChAAomjH5vLVICqSFpyDVQeB4w==", 2024-04-25T09:03:57.189 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:03:57.189 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:03:57.189 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile mgr", 2024-04-25T09:03:57.190 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:03:57.190 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.190 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:03:57.190 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-04-25T09:03:57.190 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:03:57.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.185+0000 7ff857000640 1 -- 172.21.15.173:0/2238111512 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff830066f60 msgr2=0x7ff830069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.185+0000 7ff857000640 1 --2- 172.21.15.173:0/2238111512 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff830066f60 0x7ff830069420 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff844000f70 tx=0x7ff844007a20 comp rx=0 tx=0).stop 2024-04-25T09:03:57.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.185+0000 7ff857000640 1 -- 172.21.15.173:0/2238111512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff85015ba60 msgr2=0x7ff8500ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.185+0000 7ff857000640 1 --2- 172.21.15.173:0/2238111512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff85015ba60 0x7ff8500ae7f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff848019330 tx=0x7ff8480194c0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.185+0000 7ff857000640 1 -- 172.21.15.173:0/2238111512 shutdown_connections 2024-04-25T09:03:57.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.185+0000 7ff857000640 1 --2- 172.21.15.173:0/2238111512 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff830066f60 0x7ff830069420 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.185+0000 7ff857000640 1 --2- 172.21.15.173:0/2238111512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff85015ba60 0x7ff8500ae7f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.185+0000 7ff857000640 1 --2- 172.21.15.173:0/2238111512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff85015b680 0x7ff8500ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.185+0000 7ff857000640 1 --2- 172.21.15.173:0/2238111512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8500d00a0 0x7ff85015ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.185+0000 7ff857000640 1 -- 172.21.15.173:0/2238111512 >> 172.21.15.173:0/2238111512 conn(0x7ff8500b3090 msgr2=0x7ff8500b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.185+0000 7ff857000640 1 -- 172.21.15.173:0/2238111512 shutdown_connections 2024-04-25T09:03:57.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.185+0000 7ff857000640 1 -- 172.21.15.173:0/2238111512 wait complete. 2024-04-25T09:03:57.195 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-25T09:03:57.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.341+0000 7f7346600640 1 Processor -- start 2024-04-25T09:03:57.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.341+0000 7f7346600640 1 -- start start 2024-04-25T09:03:57.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.345+0000 7f7346600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7340145290 0x7f734015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.345+0000 7f7346600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f73400b3fe0 0x7f73400b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.345+0000 7f7346600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734015c5f0 con 0x7f73400cc260 2024-04-25T09:03:57.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.345+0000 7f7346600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73400ccd80 con 0x7f7340145290 2024-04-25T09:03:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.345+0000 7f7346600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f734006d4b0 con 0x7f73400b3fe0 2024-04-25T09:03:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.345+0000 7f733f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7340145290 0x7f734015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.345+0000 7f733f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7340145290 0x7f734015c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53454/0 (socket says 172.21.15.173:53454) 2024-04-25T09:03:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.345+0000 7f733f400640 1 -- 172.21.15.173:0/415673131 learned_addr learned my addr 172.21.15.173:0/415673131 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.345+0000 7f733ea00640 1 --2- 172.21.15.173:0/415673131 >> v2:172.21.15.194:3300/0 conn(0x7f73400b3fe0 0x7f73400b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.345+0000 7f733f400640 1 -- 172.21.15.173:0/415673131 >> v2:172.21.15.194:3300/0 conn(0x7f73400b3fe0 msgr2=0x7f73400b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.345+0000 7f733f400640 1 --2- 172.21.15.173:0/415673131 >> v2:172.21.15.194:3300/0 conn(0x7f73400b3fe0 0x7f73400b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.345+0000 7f733f400640 1 -- 172.21.15.173:0/415673131 >> v1:172.21.15.194:6789/0 conn(0x7f73400cc260 legacy=0x7f73400cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.345+0000 7f733f400640 1 -- 172.21.15.173:0/415673131 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734006d790 con 0x7f7340145290 2024-04-25T09:03:57.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.345+0000 7f733f400640 1 --2- 172.21.15.173:0/415673131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7340145290 0x7f734015c0b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7340071100 tx=0x7f733001c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38ba0c7d9a5972c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f733e000640 1 -- 172.21.15.173:0/415673131 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73300ac020 con 0x7f7340145290 2024-04-25T09:03:57.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f733e000640 1 -- 172.21.15.173:0/415673131 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73300a6490 con 0x7f7340145290 2024-04-25T09:03:57.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f733e000640 1 -- 172.21.15.173:0/415673131 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73300a6860 con 0x7f7340145290 2024-04-25T09:03:57.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f7346600640 1 -- 172.21.15.173:0/415673131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7340145290 msgr2=0x7f734015c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f7346600640 1 --2- 172.21.15.173:0/415673131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7340145290 0x7f734015c0b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7340071100 tx=0x7f733001c6b0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f7346600640 1 -- 172.21.15.173:0/415673131 shutdown_connections 2024-04-25T09:03:57.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f7346600640 1 --2- 172.21.15.173:0/415673131 >> v2:172.21.15.194:3300/0 conn(0x7f73400b3fe0 0x7f73400b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f7346600640 1 --2- 172.21.15.173:0/415673131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7340145290 0x7f734015c0b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f7346600640 1 -- 172.21.15.173:0/415673131 >> 172.21.15.173:0/415673131 conn(0x7f734006ac90 msgr2=0x7f734006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f7346600640 1 -- 172.21.15.173:0/415673131 shutdown_connections 2024-04-25T09:03:57.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f7346600640 1 -- 172.21.15.173:0/415673131 wait complete. 2024-04-25T09:03:57.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f7346600640 1 Processor -- start 2024-04-25T09:03:57.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f7346600640 1 -- start start 2024-04-25T09:03:57.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f7346600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73400b3fe0 0x7f73400b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f7346600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73400cc260 0x7f73401597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f7346600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7340145290 0x7f7340159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f7346600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73401457f0 con 0x7f7340145290 2024-04-25T09:03:57.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f7346600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7340145670 con 0x7f73400cc260 2024-04-25T09:03:57.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f7346600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734006ed60 con 0x7f73400b3fe0 2024-04-25T09:03:57.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f733fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7340145290 0x7f7340159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f733ea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73400cc260 0x7f73401597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f733fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7340145290 0x7f7340159d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53460/0 (socket says 172.21.15.173:53460) 2024-04-25T09:03:57.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f733fe00640 1 -- 172.21.15.173:0/2837830786 learned_addr learned my addr 172.21.15.173:0/2837830786 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:57.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.349+0000 7f733f400640 1 --2- 172.21.15.173:0/2837830786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73400b3fe0 0x7f73400b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.353+0000 7f733fe00640 1 -- 172.21.15.173:0/2837830786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73400b3fe0 msgr2=0x7f73400b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.353+0000 7f733fe00640 1 --2- 172.21.15.173:0/2837830786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73400b3fe0 0x7f73400b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.353+0000 7f733fe00640 1 -- 172.21.15.173:0/2837830786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73400cc260 msgr2=0x7f73401597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.353+0000 7f733fe00640 1 --2- 172.21.15.173:0/2837830786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73400cc260 0x7f73401597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.353+0000 7f733fe00640 1 -- 172.21.15.173:0/2837830786 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734015a690 con 0x7f7340145290 2024-04-25T09:03:57.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.353+0000 7f733fe00640 1 --2- 172.21.15.173:0/2837830786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7340145290 0x7f7340159d20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f733800c3c0 tx=0x7f733800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.353+0000 7f7337400640 1 -- 172.21.15.173:0/2837830786 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7338011790 con 0x7f7340145290 2024-04-25T09:03:57.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.353+0000 7f7337400640 1 -- 172.21.15.173:0/2837830786 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7338017070 con 0x7f7340145290 2024-04-25T09:03:57.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.353+0000 7f7346600640 1 -- 172.21.15.173:0/2837830786 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734015a970 con 0x7f7340145290 2024-04-25T09:03:57.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.353+0000 7f7337400640 1 -- 172.21.15.173:0/2837830786 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7338011b70 con 0x7f7340145290 2024-04-25T09:03:57.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.353+0000 7f7346600640 1 -- 172.21.15.173:0/2837830786 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734015af30 con 0x7f7340145290 2024-04-25T09:03:57.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.353+0000 7f7346600640 1 -- 172.21.15.173:0/2837830786 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734015b130 con 0x7f7340145290 2024-04-25T09:03:57.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.353+0000 7f7337400640 1 -- 172.21.15.173:0/2837830786 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7338011d10 con 0x7f7340145290 2024-04-25T09:03:57.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.353+0000 7f7337400640 1 --2- 172.21.15.173:0/2837830786 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7320066f60 0x7f7320069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.353+0000 7f7337400640 1 -- 172.21.15.173:0/2837830786 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f7338084b70 con 0x7f7340145290 2024-04-25T09:03:57.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.357+0000 7f733f400640 1 --2- 172.21.15.173:0/2837830786 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7320066f60 0x7f7320069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.357+0000 7f733f400640 1 --2- 172.21.15.173:0/2837830786 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7320066f60 0x7f7320069420 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f73300ad000 tx=0x7f73300b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.361+0000 7f7337400640 1 -- 172.21.15.173:0/2837830786 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f734015b130 con 0x7f7340145290 2024-04-25T09:03:57.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.565+0000 7f7346600640 1 -- 172.21.15.173:0/2837830786 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f7340073ab0 con 0x7f7340145290 2024-04-25T09:03:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.569+0000 7f7337400640 1 -- 172.21.15.173:0/2837830786 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7338055650 con 0x7f7340145290 2024-04-25T09:03:57.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.569+0000 7f7346600640 1 -- 172.21.15.173:0/2837830786 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7320066f60 msgr2=0x7f7320069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.569+0000 7f7346600640 1 --2- 172.21.15.173:0/2837830786 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7320066f60 0x7f7320069420 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f73300ad000 tx=0x7f73300b3040 comp rx=0 tx=0).stop 2024-04-25T09:03:57.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.569+0000 7f7346600640 1 -- 172.21.15.173:0/2837830786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7340145290 msgr2=0x7f7340159d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.569+0000 7f7346600640 1 --2- 172.21.15.173:0/2837830786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7340145290 0x7f7340159d20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f733800c3c0 tx=0x7f733800c880 comp rx=0 tx=0).stop 2024-04-25T09:03:57.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.569+0000 7f7346600640 1 -- 172.21.15.173:0/2837830786 shutdown_connections 2024-04-25T09:03:57.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.569+0000 7f7346600640 1 --2- 172.21.15.173:0/2837830786 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7320066f60 0x7f7320069420 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.569+0000 7f7346600640 1 --2- 172.21.15.173:0/2837830786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7340145290 0x7f7340159d20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.569+0000 7f7346600640 1 --2- 172.21.15.173:0/2837830786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73400cc260 0x7f73401597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.569+0000 7f7346600640 1 --2- 172.21.15.173:0/2837830786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73400b3fe0 0x7f73400b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.569+0000 7f7346600640 1 -- 172.21.15.173:0/2837830786 >> 172.21.15.173:0/2837830786 conn(0x7f734006ac90 msgr2=0x7f73400cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.569+0000 7f7346600640 1 -- 172.21.15.173:0/2837830786 shutdown_connections 2024-04-25T09:03:57.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.569+0000 7f7346600640 1 -- 172.21.15.173:0/2837830786 wait complete. 2024-04-25T09:03:57.581 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-25T09:03:57.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14b3800640 1 Processor -- start 2024-04-25T09:03:57.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14b3800640 1 -- start start 2024-04-25T09:03:57.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14b3800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f14ac0aef70 0x7f14ac06d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14b3800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ac071570 con 0x7f14ac0aeb90 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14b3800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ac071850 con 0x7f14ac0cc7e0 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14b3800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ac071320 con 0x7f14ac0aef70 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14b0e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f14ac0aeb90 0x7f14ac0cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45106/0 (socket says 172.21.15.173:45106) 2024-04-25T09:03:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14b0e00640 1 -- 172.21.15.173:0/3688674154 learned_addr learned my addr 172.21.15.173:0/3688674154 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:57.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14ab400640 1 -- 172.21.15.173:0/3688674154 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858169090 0 0) 0x7f14ac071570 con 0x7f14ac0aeb90 2024-04-25T09:03:57.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14b1800640 1 --2- 172.21.15.173:0/3688674154 >> v2:172.21.15.194:3300/0 conn(0x7f14ac0aef70 0x7f14ac06d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14ab400640 1 -- 172.21.15.173:0/3688674154 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1490003530 con 0x7f14ac0aeb90 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14ab400640 1 -- 172.21.15.173:0/3688674154 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3983549728 0 0) 0x7f1490003530 con 0x7f14ac0aeb90 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14ab400640 1 -- 172.21.15.173:0/3688674154 >> v2:172.21.15.194:3300/0 conn(0x7f14ac0aef70 msgr2=0x7f14ac06d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14ab400640 1 --2- 172.21.15.173:0/3688674154 >> v2:172.21.15.194:3300/0 conn(0x7f14ac0aef70 0x7f14ac06d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14ab400640 1 -- 172.21.15.173:0/3688674154 >> v1:172.21.15.194:6789/0 conn(0x7f14ac0cc7e0 legacy=0x7f14ac0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14ab400640 1 -- 172.21.15.173:0/3688674154 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac071b30 con 0x7f14ac0aeb90 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14ab400640 1 -- 172.21.15.173:0/3688674154 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f149c0016a0 con 0x7f14ac0aeb90 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14ab400640 1 -- 172.21.15.173:0/3688674154 >> v1:172.21.15.173:6789/0 conn(0x7f14ac0aeb90 legacy=0x7f14ac0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14ab400640 1 --2- 172.21.15.173:0/3688674154 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14900039c0 0x7f1490003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14ab400640 1 --2- 172.21.15.173:0/3688674154 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1490004810 0x7f1490004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14ab400640 1 --2- 172.21.15.173:0/3688674154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14900051d0 0x7f149000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14ab400640 1 -- 172.21.15.173:0/3688674154 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac071320 con 0x7f14900051d0 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14ab400640 1 -- 172.21.15.173:0/3688674154 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149000c170 con 0x7f1490004810 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14ab400640 1 -- 172.21.15.173:0/3688674154 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149000e580 con 0x7f14900039c0 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14b1800640 1 --2- 172.21.15.173:0/3688674154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14900051d0 0x7f149000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14abe00640 1 --2- 172.21.15.173:0/3688674154 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1490004810 0x7f1490004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.729+0000 7f14b0e00640 1 --2- 172.21.15.173:0/3688674154 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14900039c0 0x7f1490003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.733+0000 7f14b1800640 1 -- 172.21.15.173:0/3688674154 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14900039c0 msgr2=0x7f1490003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.733+0000 7f14b1800640 1 --2- 172.21.15.173:0/3688674154 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14900039c0 0x7f1490003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.733+0000 7f14b1800640 1 -- 172.21.15.173:0/3688674154 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1490004810 msgr2=0x7f1490004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.733+0000 7f14b1800640 1 --2- 172.21.15.173:0/3688674154 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1490004810 0x7f1490004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.733+0000 7f14b1800640 1 -- 172.21.15.173:0/3688674154 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1490003530 con 0x7f14900051d0 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.733+0000 7f14b0e00640 1 --2- 172.21.15.173:0/3688674154 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14900039c0 0x7f1490003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.733+0000 7f14b1800640 1 -- 172.21.15.173:0/3688674154 reap_dead start 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.733+0000 7f14b1800640 1 --2- 172.21.15.173:0/3688674154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14900051d0 0x7f149000b9d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009fc0 tx=0x7f14a401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b4a850225c4f50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.733+0000 7f14ab400640 1 -- 172.21.15.173:0/3688674154 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4009c10 con 0x7f14900051d0 2024-04-25T09:03:57.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.733+0000 7f14ab400640 1 -- 172.21.15.173:0/3688674154 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a40a5d10 con 0x7f14900051d0 2024-04-25T09:03:57.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.733+0000 7f14ab400640 1 -- 172.21.15.173:0/3688674154 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4003be0 con 0x7f14900051d0 2024-04-25T09:03:57.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.733+0000 7f14b3800640 1 -- 172.21.15.173:0/3688674154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14900051d0 msgr2=0x7f149000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.733+0000 7f14b3800640 1 --2- 172.21.15.173:0/3688674154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14900051d0 0x7f149000b9d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009fc0 tx=0x7f14a401ccc0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.733+0000 7f14b3800640 1 -- 172.21.15.173:0/3688674154 shutdown_connections 2024-04-25T09:03:57.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.733+0000 7f14b3800640 1 --2- 172.21.15.173:0/3688674154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14900051d0 0x7f149000b9d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.733+0000 7f14b3800640 1 -- 172.21.15.173:0/3688674154 >> 172.21.15.173:0/3688674154 conn(0x7f14ac06ac90 msgr2=0x7f14ac06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.733+0000 7f14b3800640 1 -- 172.21.15.173:0/3688674154 shutdown_connections 2024-04-25T09:03:57.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.733+0000 7f14b3800640 1 -- 172.21.15.173:0/3688674154 wait complete. 2024-04-25T09:03:57.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b3800640 1 Processor -- start 2024-04-25T09:03:57.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b3800640 1 -- start start 2024-04-25T09:03:57.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b3800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14900051d0 0x7f14ac1eea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b3800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14ac13eec0 0x7f14ac154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b3800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14ac154640 0x7f14ac0b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b3800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0cc0d0 con 0x7f14900051d0 2024-04-25T09:03:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b3800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac072330 con 0x7f14ac154640 2024-04-25T09:03:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b3800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0cc250 con 0x7f14ac13eec0 2024-04-25T09:03:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b0e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14900051d0 0x7f14ac1eea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b0e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14900051d0 0x7f14ac1eea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53490/0 (socket says 172.21.15.173:53490) 2024-04-25T09:03:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b0e00640 1 -- 172.21.15.173:0/2730701092 learned_addr learned my addr 172.21.15.173:0/2730701092 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b1800640 1 --2- 172.21.15.173:0/2730701092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14ac154640 0x7f14ac0b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14abe00640 1 --2- 172.21.15.173:0/2730701092 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14ac13eec0 0x7f14ac154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b0e00640 1 -- 172.21.15.173:0/2730701092 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14ac13eec0 msgr2=0x7f14ac154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b0e00640 1 --2- 172.21.15.173:0/2730701092 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14ac13eec0 0x7f14ac154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b0e00640 1 -- 172.21.15.173:0/2730701092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14ac154640 msgr2=0x7f14ac0b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b0e00640 1 --2- 172.21.15.173:0/2730701092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14ac154640 0x7f14ac0b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b0e00640 1 -- 172.21.15.173:0/2730701092 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac0b1ef0 con 0x7f14900051d0 2024-04-25T09:03:57.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14abe00640 1 --2- 172.21.15.173:0/2730701092 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14ac13eec0 0x7f14ac154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:57.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b1800640 1 --2- 172.21.15.173:0/2730701092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14ac154640 0x7f14ac0b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:57.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b0e00640 1 --2- 172.21.15.173:0/2730701092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14900051d0 0x7f14ac1eea00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f149c011810 tx=0x7f149c011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14a8c00640 1 -- 172.21.15.173:0/2730701092 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c010040 con 0x7f14900051d0 2024-04-25T09:03:57.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14a8c00640 1 -- 172.21.15.173:0/2730701092 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c01a070 con 0x7f14900051d0 2024-04-25T09:03:57.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14a8c00640 1 -- 172.21.15.173:0/2730701092 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c00fb60 con 0x7f14900051d0 2024-04-25T09:03:57.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b3800640 1 -- 172.21.15.173:0/2730701092 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ac1562b0 con 0x7f14900051d0 2024-04-25T09:03:57.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.737+0000 7f14b3800640 1 -- 172.21.15.173:0/2730701092 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ac156870 con 0x7f14900051d0 2024-04-25T09:03:57.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.741+0000 7f14b3800640 1 -- 172.21.15.173:0/2730701092 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ac073ab0 con 0x7f14900051d0 2024-04-25T09:03:57.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.741+0000 7f14a8c00640 1 -- 172.21.15.173:0/2730701092 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f149c00fd00 con 0x7f14900051d0 2024-04-25T09:03:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.741+0000 7f14a8c00640 1 --2- 172.21.15.173:0/2730701092 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f148c066f60 0x7f148c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.741+0000 7f14a8c00640 1 -- 172.21.15.173:0/2730701092 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f149c087f70 con 0x7f14900051d0 2024-04-25T09:03:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.741+0000 7f14abe00640 1 --2- 172.21.15.173:0/2730701092 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f148c066f60 0x7f148c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.741+0000 7f14abe00640 1 --2- 172.21.15.173:0/2730701092 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f148c066f60 0x7f148c069420 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1498000c10 tx=0x7f1498009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:57.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.745+0000 7f14a8c00640 1 -- 172.21.15.173:0/2730701092 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f149c059130 con 0x7f14900051d0 2024-04-25T09:03:57.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.957+0000 7f14b3800640 1 -- 172.21.15.173:0/2730701092 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f14ac154a20 con 0x7f14900051d0 2024-04-25T09:03:57.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.961+0000 7f14a8c00640 1 -- 172.21.15.173:0/2730701092 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f149c058a30 con 0x7f14900051d0 2024-04-25T09:03:57.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.961+0000 7f14b3800640 1 -- 172.21.15.173:0/2730701092 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f148c066f60 msgr2=0x7f148c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.961+0000 7f14b3800640 1 --2- 172.21.15.173:0/2730701092 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f148c066f60 0x7f148c069420 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1498000c10 tx=0x7f1498009040 comp rx=0 tx=0).stop 2024-04-25T09:03:57.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.961+0000 7f14b3800640 1 -- 172.21.15.173:0/2730701092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14900051d0 msgr2=0x7f14ac1eea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:57.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.961+0000 7f14b3800640 1 --2- 172.21.15.173:0/2730701092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14900051d0 0x7f14ac1eea00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f149c011810 tx=0x7f149c011cd0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.961+0000 7f14b3800640 1 -- 172.21.15.173:0/2730701092 shutdown_connections 2024-04-25T09:03:57.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.961+0000 7f14b3800640 1 --2- 172.21.15.173:0/2730701092 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f148c066f60 0x7f148c069420 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.961+0000 7f14b3800640 1 --2- 172.21.15.173:0/2730701092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14ac154640 0x7f14ac0b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.961+0000 7f14b3800640 1 --2- 172.21.15.173:0/2730701092 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14ac13eec0 0x7f14ac154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.961+0000 7f14b3800640 1 --2- 172.21.15.173:0/2730701092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14900051d0 0x7f14ac1eea00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:57.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.961+0000 7f14b3800640 1 -- 172.21.15.173:0/2730701092 >> 172.21.15.173:0/2730701092 conn(0x7f14ac06ac90 msgr2=0x7f14ac15c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:57.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.961+0000 7f14b3800640 1 -- 172.21.15.173:0/2730701092 shutdown_connections 2024-04-25T09:03:57.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:57.961+0000 7f14b3800640 1 -- 172.21.15.173:0/2730701092 wait complete. 2024-04-25T09:03:57.973 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-25T09:03:58.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.121+0000 7f678a800640 1 Processor -- start 2024-04-25T09:03:58.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.121+0000 7f678a800640 1 -- start start 2024-04-25T09:03:58.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.121+0000 7f678a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f67840aeb90 0x7f67840cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.121+0000 7f678a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67840ce2b0 0x7f67840cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.121+0000 7f678a800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6784071570 con 0x7f67840aef70 2024-04-25T09:03:58.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.121+0000 7f678a800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6784071320 con 0x7f67840aeb90 2024-04-25T09:03:58.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.121+0000 7f678a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6784072330 con 0x7f67840ce2b0 2024-04-25T09:03:58.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.121+0000 7f677aa00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f67840aef70 0x7f67840cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45116/0 (socket says 172.21.15.173:45116) 2024-04-25T09:03:58.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.121+0000 7f677aa00640 1 -- 172.21.15.173:0/761020588 learned_addr learned my addr 172.21.15.173:0/761020588 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:58.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.121+0000 7f6783e00640 1 --2- 172.21.15.173:0/761020588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67840ce2b0 0x7f67840cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.121+0000 7f6783400640 1 --2- 172.21.15.173:0/761020588 >> v2:172.21.15.194:3300/0 conn(0x7f67840aeb90 0x7f67840cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.121+0000 7f6782a00640 1 -- 172.21.15.173:0/761020588 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587832097 0 0) 0x7f6784071570 con 0x7f67840aef70 2024-04-25T09:03:58.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.121+0000 7f6782a00640 1 -- 172.21.15.173:0/761020588 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6768003530 con 0x7f67840aef70 2024-04-25T09:03:58.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.125+0000 7f6783e00640 1 -- 172.21.15.173:0/761020588 >> v2:172.21.15.194:3300/0 conn(0x7f67840aeb90 msgr2=0x7f67840cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.125+0000 7f6783e00640 1 --2- 172.21.15.173:0/761020588 >> v2:172.21.15.194:3300/0 conn(0x7f67840aeb90 0x7f67840cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.125+0000 7f6783e00640 1 -- 172.21.15.173:0/761020588 >> v1:172.21.15.173:6789/0 conn(0x7f67840aef70 legacy=0x7f67840cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.125+0000 7f6783e00640 1 -- 172.21.15.173:0/761020588 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6784071850 con 0x7f67840ce2b0 2024-04-25T09:03:58.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.125+0000 7f6783400640 1 --2- 172.21.15.173:0/761020588 >> v2:172.21.15.194:3300/0 conn(0x7f67840aeb90 0x7f67840cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:58.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.125+0000 7f6783e00640 1 --2- 172.21.15.173:0/761020588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67840ce2b0 0x7f67840cc610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f677c0097c0 tx=0x7f677c01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c64581c061801d5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.125+0000 7f6782a00640 1 -- 172.21.15.173:0/761020588 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c0b0070 con 0x7f67840ce2b0 2024-04-25T09:03:58.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.125+0000 7f6782a00640 1 -- 172.21.15.173:0/761020588 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c0ab600 con 0x7f67840ce2b0 2024-04-25T09:03:58.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.125+0000 7f6782a00640 1 -- 172.21.15.173:0/761020588 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c0ab9d0 con 0x7f67840ce2b0 2024-04-25T09:03:58.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.125+0000 7f678a800640 1 -- 172.21.15.173:0/761020588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67840ce2b0 msgr2=0x7f67840cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.125+0000 7f678a800640 1 --2- 172.21.15.173:0/761020588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67840ce2b0 0x7f67840cc610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f677c0097c0 tx=0x7f677c01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.125+0000 7f678a800640 1 -- 172.21.15.173:0/761020588 shutdown_connections 2024-04-25T09:03:58.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f678a800640 1 --2- 172.21.15.173:0/761020588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67840ce2b0 0x7f67840cc610 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f678a800640 1 --2- 172.21.15.173:0/761020588 >> v2:172.21.15.194:3300/0 conn(0x7f67840aeb90 0x7f67840cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f678a800640 1 -- 172.21.15.173:0/761020588 >> 172.21.15.173:0/761020588 conn(0x7f678406ac90 msgr2=0x7f678406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f678a800640 1 -- 172.21.15.173:0/761020588 shutdown_connections 2024-04-25T09:03:58.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f678a800640 1 -- 172.21.15.173:0/761020588 wait complete. 2024-04-25T09:03:58.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f678a800640 1 Processor -- start 2024-04-25T09:03:58.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f678a800640 1 -- start start 2024-04-25T09:03:58.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f678a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67840aeb90 0x7f678413c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f678a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67840aef70 0x7f6784154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f678a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67840ce2b0 0x7f678414c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f678a800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678415bb30 con 0x7f67840ce2b0 2024-04-25T09:03:58.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f678a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678415b9b0 con 0x7f67840aef70 2024-04-25T09:03:58.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f678a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678415bcb0 con 0x7f67840aeb90 2024-04-25T09:03:58.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f6783e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67840ce2b0 0x7f678414c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f6783e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67840ce2b0 0x7f678414c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53498/0 (socket says 172.21.15.173:53498) 2024-04-25T09:03:58.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f6783e00640 1 -- 172.21.15.173:0/3849033172 learned_addr learned my addr 172.21.15.173:0/3849033172 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:58.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f6783400640 1 --2- 172.21.15.173:0/3849033172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67840aeb90 0x7f678413c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f677aa00640 1 --2- 172.21.15.173:0/3849033172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67840aef70 0x7f6784154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f6783e00640 1 -- 172.21.15.173:0/3849033172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67840aeb90 msgr2=0x7f678413c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f6783e00640 1 --2- 172.21.15.173:0/3849033172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67840aeb90 0x7f678413c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f6783e00640 1 -- 172.21.15.173:0/3849033172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67840aef70 msgr2=0x7f6784154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f6783e00640 1 --2- 172.21.15.173:0/3849033172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67840aef70 0x7f6784154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f6783e00640 1 -- 172.21.15.173:0/3849033172 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6784149b60 con 0x7f67840ce2b0 2024-04-25T09:03:58.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.129+0000 7f6783e00640 1 --2- 172.21.15.173:0/3849033172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67840ce2b0 0x7f678414c3a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f677c01a010 tx=0x7f677c019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.133+0000 7f677be00640 1 -- 172.21.15.173:0/3849033172 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c0b0040 con 0x7f67840ce2b0 2024-04-25T09:03:58.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.133+0000 7f677be00640 1 -- 172.21.15.173:0/3849033172 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c0b9070 con 0x7f67840ce2b0 2024-04-25T09:03:58.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.133+0000 7f678a800640 1 -- 172.21.15.173:0/3849033172 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6784149e40 con 0x7f67840ce2b0 2024-04-25T09:03:58.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.133+0000 7f677be00640 1 -- 172.21.15.173:0/3849033172 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c0b4650 con 0x7f67840ce2b0 2024-04-25T09:03:58.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.133+0000 7f678a800640 1 -- 172.21.15.173:0/3849033172 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678414aba0 con 0x7f67840ce2b0 2024-04-25T09:03:58.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.133+0000 7f678a800640 1 -- 172.21.15.173:0/3849033172 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678414a6b0 con 0x7f67840ce2b0 2024-04-25T09:03:58.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.133+0000 7f677be00640 1 -- 172.21.15.173:0/3849033172 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f677c0b47f0 con 0x7f67840ce2b0 2024-04-25T09:03:58.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.133+0000 7f677be00640 1 --2- 172.21.15.173:0/3849033172 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6760066f60 0x7f6760069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.133+0000 7f677be00640 1 -- 172.21.15.173:0/3849033172 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f677c11ebe0 con 0x7f67840ce2b0 2024-04-25T09:03:58.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.133+0000 7f6783400640 1 --2- 172.21.15.173:0/3849033172 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6760066f60 0x7f6760069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.137+0000 7f6783400640 1 --2- 172.21.15.173:0/3849033172 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6760066f60 0x7f6760069420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6774009bd0 tx=0x7f677400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.137+0000 7f677be00640 1 -- 172.21.15.173:0/3849033172 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f677c016090 con 0x7f67840ce2b0 2024-04-25T09:03:58.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.345+0000 7f678a800640 1 -- 172.21.15.173:0/3849033172 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f6784073ab0 con 0x7f67840ce2b0 2024-04-25T09:03:58.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.349+0000 7f677be00640 1 -- 172.21.15.173:0/3849033172 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f677c0ef6c0 con 0x7f67840ce2b0 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.349+0000 7f678a800640 1 -- 172.21.15.173:0/3849033172 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6760066f60 msgr2=0x7f6760069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.349+0000 7f678a800640 1 --2- 172.21.15.173:0/3849033172 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6760066f60 0x7f6760069420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6774009bd0 tx=0x7f677400b040 comp rx=0 tx=0).stop 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.349+0000 7f678a800640 1 -- 172.21.15.173:0/3849033172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67840ce2b0 msgr2=0x7f678414c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.349+0000 7f678a800640 1 --2- 172.21.15.173:0/3849033172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67840ce2b0 0x7f678414c3a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f677c01a010 tx=0x7f677c019180 comp rx=0 tx=0).stop 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.349+0000 7f678a800640 1 -- 172.21.15.173:0/3849033172 shutdown_connections 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.349+0000 7f678a800640 1 --2- 172.21.15.173:0/3849033172 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6760066f60 0x7f6760069420 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.349+0000 7f678a800640 1 --2- 172.21.15.173:0/3849033172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67840ce2b0 0x7f678414c3a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.349+0000 7f678a800640 1 --2- 172.21.15.173:0/3849033172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67840aef70 0x7f6784154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.349+0000 7f678a800640 1 --2- 172.21.15.173:0/3849033172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67840aeb90 0x7f678413c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.349+0000 7f678a800640 1 -- 172.21.15.173:0/3849033172 >> 172.21.15.173:0/3849033172 conn(0x7f678406ac90 msgr2=0x7f678406e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.349+0000 7f678a800640 1 -- 172.21.15.173:0/3849033172 shutdown_connections 2024-04-25T09:03:58.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.349+0000 7f678a800640 1 -- 172.21.15.173:0/3849033172 wait complete. 2024-04-25T09:03:58.360 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-25T09:03:58.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.505+0000 7fa308000640 1 Processor -- start 2024-04-25T09:03:58.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.505+0000 7fa308000640 1 -- start start 2024-04-25T09:03:58.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.505+0000 7fa308000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa3000ad5c0 0x7fa3001687d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.505+0000 7fa308000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30006fa20 con 0x7fa30006f5b0 2024-04-25T09:03:58.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.505+0000 7fa308000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30006ae30 con 0x7fa30006e1c0 2024-04-25T09:03:58.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.505+0000 7fa308000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3000b3170 con 0x7fa3000ad5c0 2024-04-25T09:03:58.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.505+0000 7fa306000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa3000ad5c0 0x7fa3001687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.505+0000 7fa304c00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa30006f5b0 0x7fa3000aceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45124/0 (socket says 172.21.15.173:45124) 2024-04-25T09:03:58.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.509+0000 7fa304c00640 1 -- 172.21.15.173:0/2618884793 learned_addr learned my addr 172.21.15.173:0/2618884793 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:58.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.509+0000 7fa306000640 1 -- 172.21.15.173:0/2618884793 >> v1:172.21.15.194:6789/0 conn(0x7fa30006e1c0 legacy=0x7fa30006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.509+0000 7fa306000640 1 -- 172.21.15.173:0/2618884793 >> v1:172.21.15.173:6789/0 conn(0x7fa30006f5b0 legacy=0x7fa3000aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.509+0000 7fa306000640 1 -- 172.21.15.173:0/2618884793 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30006b110 con 0x7fa3000ad5c0 2024-04-25T09:03:58.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.509+0000 7fa306000640 1 --2- 172.21.15.173:0/2618884793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3000ad5c0 0x7fa3001687d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009d90 tx=0x7fa2f801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569af51b54394be2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.509+0000 7fa2ffe00640 1 -- 172.21.15.173:0/2618884793 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f80b4070 con 0x7fa3000ad5c0 2024-04-25T09:03:58.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.509+0000 7fa2ffe00640 1 -- 172.21.15.173:0/2618884793 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f80af600 con 0x7fa3000ad5c0 2024-04-25T09:03:58.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.509+0000 7fa2ffe00640 1 -- 172.21.15.173:0/2618884793 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f80af9d0 con 0x7fa3000ad5c0 2024-04-25T09:03:58.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa308000640 1 -- 172.21.15.173:0/2618884793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3000ad5c0 msgr2=0x7fa3001687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa308000640 1 --2- 172.21.15.173:0/2618884793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3000ad5c0 0x7fa3001687d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009d90 tx=0x7fa2f801f150 comp rx=0 tx=0).stop 2024-04-25T09:03:58.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa308000640 1 -- 172.21.15.173:0/2618884793 shutdown_connections 2024-04-25T09:03:58.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa308000640 1 --2- 172.21.15.173:0/2618884793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3000ad5c0 0x7fa3001687d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa308000640 1 -- 172.21.15.173:0/2618884793 >> 172.21.15.173:0/2618884793 conn(0x7fa3000cfed0 msgr2=0x7fa3000d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa308000640 1 -- 172.21.15.173:0/2618884793 shutdown_connections 2024-04-25T09:03:58.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa308000640 1 -- 172.21.15.173:0/2618884793 wait complete. 2024-04-25T09:03:58.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa308000640 1 Processor -- start 2024-04-25T09:03:58.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa308000640 1 -- start start 2024-04-25T09:03:58.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa308000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa30006e1c0 0x7fa3001e50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa308000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa30006f5b0 0x7fa300142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa308000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3000ad5c0 0x7fa3001428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa308000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30006b6d0 con 0x7fa30006e1c0 2024-04-25T09:03:58.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa308000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30015e070 con 0x7fa30006f5b0 2024-04-25T09:03:58.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa308000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30006b9b0 con 0x7fa3000ad5c0 2024-04-25T09:03:58.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa305600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa30006e1c0 0x7fa3001e50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa305600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa30006e1c0 0x7fa3001e50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53508/0 (socket says 172.21.15.173:53508) 2024-04-25T09:03:58.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa305600640 1 -- 172.21.15.173:0/4165427383 learned_addr learned my addr 172.21.15.173:0/4165427383 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:58.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa304c00640 1 --2- 172.21.15.173:0/4165427383 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa30006f5b0 0x7fa300142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa306000640 1 --2- 172.21.15.173:0/4165427383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3000ad5c0 0x7fa3001428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa305600640 1 -- 172.21.15.173:0/4165427383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3000ad5c0 msgr2=0x7fa3001428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa305600640 1 --2- 172.21.15.173:0/4165427383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3000ad5c0 0x7fa3001428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa305600640 1 -- 172.21.15.173:0/4165427383 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa30006f5b0 msgr2=0x7fa300142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa305600640 1 --2- 172.21.15.173:0/4165427383 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa30006f5b0 0x7fa300142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa305600640 1 -- 172.21.15.173:0/4165427383 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa300156120 con 0x7fa30006e1c0 2024-04-25T09:03:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa306000640 1 --2- 172.21.15.173:0/4165427383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3000ad5c0 0x7fa3001428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa305600640 1 --2- 172.21.15.173:0/4165427383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa30006e1c0 0x7fa3001e50f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400c420 tx=0x7fa2f400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa2fd600640 1 -- 172.21.15.173:0/4165427383 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f40052d0 con 0x7fa30006e1c0 2024-04-25T09:03:58.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa2fd600640 1 -- 172.21.15.173:0/4165427383 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f4005470 con 0x7fa30006e1c0 2024-04-25T09:03:58.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.513+0000 7fa308000640 1 -- 172.21.15.173:0/4165427383 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa300155b60 con 0x7fa30006e1c0 2024-04-25T09:03:58.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.517+0000 7fa2fd600640 1 -- 172.21.15.173:0/4165427383 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4007260 con 0x7fa30006e1c0 2024-04-25T09:03:58.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.517+0000 7fa308000640 1 -- 172.21.15.173:0/4165427383 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3001e3010 con 0x7fa30006e1c0 2024-04-25T09:03:58.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.517+0000 7fa308000640 1 -- 172.21.15.173:0/4165427383 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa300073ab0 con 0x7fa30006e1c0 2024-04-25T09:03:58.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.517+0000 7fa2fd600640 1 -- 172.21.15.173:0/4165427383 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa2f4007400 con 0x7fa30006e1c0 2024-04-25T09:03:58.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.517+0000 7fa2fd600640 1 --2- 172.21.15.173:0/4165427383 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2e0066f60 0x7fa2e0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.517+0000 7fa2fd600640 1 -- 172.21.15.173:0/4165427383 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fa2f40842f0 con 0x7fa30006e1c0 2024-04-25T09:03:58.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.517+0000 7fa304c00640 1 --2- 172.21.15.173:0/4165427383 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2e0066f60 0x7fa2e0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.517+0000 7fa304c00640 1 --2- 172.21.15.173:0/4165427383 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2e0066f60 0x7fa2e0069420 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa300154150 tx=0x7fa2ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.521+0000 7fa2fd600640 1 -- 172.21.15.173:0/4165427383 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa2f4054e70 con 0x7fa30006e1c0 2024-04-25T09:03:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.729+0000 7fa308000640 1 -- 172.21.15.173:0/4165427383 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fa300142df0 con 0x7fa30006e1c0 2024-04-25T09:03:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.733+0000 7fa2fd600640 1 -- 172.21.15.173:0/4165427383 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa2f4058f10 con 0x7fa30006e1c0 2024-04-25T09:03:58.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.733+0000 7fa308000640 1 -- 172.21.15.173:0/4165427383 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2e0066f60 msgr2=0x7fa2e0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.733+0000 7fa308000640 1 --2- 172.21.15.173:0/4165427383 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2e0066f60 0x7fa2e0069420 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa300154150 tx=0x7fa2ec009040 comp rx=0 tx=0).stop 2024-04-25T09:03:58.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.733+0000 7fa308000640 1 -- 172.21.15.173:0/4165427383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa30006e1c0 msgr2=0x7fa3001e50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.733+0000 7fa308000640 1 --2- 172.21.15.173:0/4165427383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa30006e1c0 0x7fa3001e50f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400c420 tx=0x7fa2f400c8e0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.733+0000 7fa308000640 1 -- 172.21.15.173:0/4165427383 shutdown_connections 2024-04-25T09:03:58.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.733+0000 7fa308000640 1 --2- 172.21.15.173:0/4165427383 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2e0066f60 0x7fa2e0069420 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.733+0000 7fa308000640 1 --2- 172.21.15.173:0/4165427383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3000ad5c0 0x7fa3001428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.733+0000 7fa308000640 1 --2- 172.21.15.173:0/4165427383 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa30006f5b0 0x7fa300142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.733+0000 7fa308000640 1 --2- 172.21.15.173:0/4165427383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa30006e1c0 0x7fa3001e50f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.733+0000 7fa308000640 1 -- 172.21.15.173:0/4165427383 >> 172.21.15.173:0/4165427383 conn(0x7fa3000cfed0 msgr2=0x7fa3000b35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.733+0000 7fa308000640 1 -- 172.21.15.173:0/4165427383 shutdown_connections 2024-04-25T09:03:58.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.733+0000 7fa308000640 1 -- 172.21.15.173:0/4165427383 wait complete. 2024-04-25T09:03:58.744 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-25T09:03:58.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.893+0000 7ff66f800640 1 Processor -- start 2024-04-25T09:03:58.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.893+0000 7ff66f800640 1 -- start start 2024-04-25T09:03:58.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.893+0000 7ff66f800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff66815bab0 0x7ff6680d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.893+0000 7ff66f800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff6680cd840 0x7ff668099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.893+0000 7ff66f800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6680cc7a0 con 0x7ff668099f90 2024-04-25T09:03:58.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.893+0000 7ff66f800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6680d07e0 con 0x7ff6680cd840 2024-04-25T09:03:58.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.893+0000 7ff66f800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6680cca80 con 0x7ff66815bab0 2024-04-25T09:03:58.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.893+0000 7ff667e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff6680cd840 0x7ff668099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.893+0000 7ff667e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff6680cd840 0x7ff668099a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53516/0 (socket says 172.21.15.173:53516) 2024-04-25T09:03:58.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.893+0000 7ff667e00640 1 -- 172.21.15.173:0/206710506 learned_addr learned my addr 172.21.15.173:0/206710506 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:58.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.893+0000 7ff667e00640 1 -- 172.21.15.173:0/206710506 >> v2:172.21.15.194:3300/0 conn(0x7ff66815bab0 msgr2=0x7ff6680d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.893+0000 7ff667e00640 1 --2- 172.21.15.173:0/206710506 >> v2:172.21.15.194:3300/0 conn(0x7ff66815bab0 0x7ff6680d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.893+0000 7ff667e00640 1 -- 172.21.15.173:0/206710506 >> v1:172.21.15.194:6789/0 conn(0x7ff668099f90 legacy=0x7ff6680c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:58.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.893+0000 7ff667e00640 1 -- 172.21.15.173:0/206710506 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6680ccd60 con 0x7ff6680cd840 2024-04-25T09:03:58.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.897+0000 7ff667e00640 1 --2- 172.21.15.173:0/206710506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6680cd840 0x7ff668099a50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff668072b30 tx=0x7ff65401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13bf28db072a3636 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.897+0000 7ff667400640 1 -- 172.21.15.173:0/206710506 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6540ab5f0 con 0x7ff6680cd840 2024-04-25T09:03:58.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.897+0000 7ff667400640 1 -- 172.21.15.173:0/206710506 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6540b0070 con 0x7ff6680cd840 2024-04-25T09:03:58.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.897+0000 7ff667400640 1 -- 172.21.15.173:0/206710506 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6540ab9b0 con 0x7ff6680cd840 2024-04-25T09:03:58.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.897+0000 7ff66f800640 1 -- 172.21.15.173:0/206710506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6680cd840 msgr2=0x7ff668099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.897+0000 7ff66f800640 1 --2- 172.21.15.173:0/206710506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6680cd840 0x7ff668099a50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff668072b30 tx=0x7ff65401c4e0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.897+0000 7ff66f800640 1 -- 172.21.15.173:0/206710506 shutdown_connections 2024-04-25T09:03:58.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.897+0000 7ff66f800640 1 --2- 172.21.15.173:0/206710506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6680cd840 0x7ff668099a50 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.897+0000 7ff66f800640 1 --2- 172.21.15.173:0/206710506 >> v2:172.21.15.194:3300/0 conn(0x7ff66815bab0 0x7ff6680d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.897+0000 7ff66f800640 1 -- 172.21.15.173:0/206710506 >> 172.21.15.173:0/206710506 conn(0x7ff6680b32a0 msgr2=0x7ff6680b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:58.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.897+0000 7ff66f800640 1 -- 172.21.15.173:0/206710506 shutdown_connections 2024-04-25T09:03:58.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.897+0000 7ff66f800640 1 -- 172.21.15.173:0/206710506 wait complete. 2024-04-25T09:03:58.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66f800640 1 Processor -- start 2024-04-25T09:03:58.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66f800640 1 -- start start 2024-04-25T09:03:58.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66f800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff668099f90 0x7ff668158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66f800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6680cd840 0x7ff668152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66f800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff66815bab0 0x7ff66814d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66f800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66815c010 con 0x7ff668099f90 2024-04-25T09:03:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66f800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66815be90 con 0x7ff66815bab0 2024-04-25T09:03:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66f800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6680cc3c0 con 0x7ff6680cd840 2024-04-25T09:03:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66ce00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff668099f90 0x7ff668158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66ce00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff668099f90 0x7ff668158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53526/0 (socket says 172.21.15.173:53526) 2024-04-25T09:03:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66ce00640 1 -- 172.21.15.173:0/4195316371 learned_addr learned my addr 172.21.15.173:0/4195316371 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff667e00640 1 --2- 172.21.15.173:0/4195316371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6680cd840 0x7ff668152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66d800640 1 --2- 172.21.15.173:0/4195316371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff66815bab0 0x7ff66814d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66ce00640 1 -- 172.21.15.173:0/4195316371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6680cd840 msgr2=0x7ff668152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66ce00640 1 --2- 172.21.15.173:0/4195316371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6680cd840 0x7ff668152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66ce00640 1 -- 172.21.15.173:0/4195316371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff66815bab0 msgr2=0x7ff66814d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66ce00640 1 --2- 172.21.15.173:0/4195316371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff66815bab0 0x7ff66814d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66ce00640 1 -- 172.21.15.173:0/4195316371 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66806dca0 con 0x7ff668099f90 2024-04-25T09:03:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66d800640 1 --2- 172.21.15.173:0/4195316371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff66815bab0 0x7ff66814d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66ce00640 1 --2- 172.21.15.173:0/4195316371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff668099f90 0x7ff668158560 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff65800ba50 tx=0x7ff65800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff664c00640 1 -- 172.21.15.173:0/4195316371 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658019070 con 0x7ff668099f90 2024-04-25T09:03:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff664c00640 1 -- 172.21.15.173:0/4195316371 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65800cc00 con 0x7ff668099f90 2024-04-25T09:03:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff664c00640 1 -- 172.21.15.173:0/4195316371 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658014440 con 0x7ff668099f90 2024-04-25T09:03:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66f800640 1 -- 172.21.15.173:0/4195316371 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff668164b90 con 0x7ff668099f90 2024-04-25T09:03:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66f800640 1 -- 172.21.15.173:0/4195316371 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff668165150 con 0x7ff668099f90 2024-04-25T09:03:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.901+0000 7ff66f800640 1 -- 172.21.15.173:0/4195316371 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff668073ab0 con 0x7ff668099f90 2024-04-25T09:03:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.905+0000 7ff664c00640 1 -- 172.21.15.173:0/4195316371 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff65801c070 con 0x7ff668099f90 2024-04-25T09:03:58.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.905+0000 7ff664c00640 1 --2- 172.21.15.173:0/4195316371 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff648066f60 0x7ff648069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:58.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.905+0000 7ff664c00640 1 -- 172.21.15.173:0/4195316371 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5249+0+0 (secure 0 0 0) 0x7ff658084b00 con 0x7ff668099f90 2024-04-25T09:03:58.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.905+0000 7ff667e00640 1 --2- 172.21.15.173:0/4195316371 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff648066f60 0x7ff648069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:58.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.905+0000 7ff667e00640 1 --2- 172.21.15.173:0/4195316371 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff648066f60 0x7ff648069420 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff6540af000 tx=0x7ff6540a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:58.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:58.909+0000 7ff664c00640 1 -- 172.21.15.173:0/4195316371 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff6580556f0 con 0x7ff668099f90 2024-04-25T09:03:59.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.121+0000 7ff66f800640 1 -- 172.21.15.173:0/4195316371 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7ff668070d10 con 0x7ff668099f90 2024-04-25T09:03:59.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.121+0000 7ff664c00640 1 -- 172.21.15.173:0/4195316371 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff658059790 con 0x7ff668099f90 2024-04-25T09:03:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.125+0000 7ff66f800640 1 -- 172.21.15.173:0/4195316371 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff648066f60 msgr2=0x7ff648069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.125+0000 7ff66f800640 1 --2- 172.21.15.173:0/4195316371 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff648066f60 0x7ff648069420 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff6540af000 tx=0x7ff6540a7000 comp rx=0 tx=0).stop 2024-04-25T09:03:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.125+0000 7ff66f800640 1 -- 172.21.15.173:0/4195316371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff668099f90 msgr2=0x7ff668158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.125+0000 7ff66f800640 1 --2- 172.21.15.173:0/4195316371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff668099f90 0x7ff668158560 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff65800ba50 tx=0x7ff65800bf10 comp rx=0 tx=0).stop 2024-04-25T09:03:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.125+0000 7ff66f800640 1 -- 172.21.15.173:0/4195316371 shutdown_connections 2024-04-25T09:03:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.125+0000 7ff66f800640 1 --2- 172.21.15.173:0/4195316371 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff648066f60 0x7ff648069420 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.125+0000 7ff66f800640 1 --2- 172.21.15.173:0/4195316371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff66815bab0 0x7ff66814d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.125+0000 7ff66f800640 1 --2- 172.21.15.173:0/4195316371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6680cd840 0x7ff668152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.125+0000 7ff66f800640 1 --2- 172.21.15.173:0/4195316371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff668099f90 0x7ff668158560 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.125+0000 7ff66f800640 1 -- 172.21.15.173:0/4195316371 >> 172.21.15.173:0/4195316371 conn(0x7ff6680b32a0 msgr2=0x7ff6680c4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.125+0000 7ff66f800640 1 -- 172.21.15.173:0/4195316371 shutdown_connections 2024-04-25T09:03:59.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.125+0000 7ff66f800640 1 -- 172.21.15.173:0/4195316371 wait complete. 2024-04-25T09:03:59.134 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-25T09:03:59.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.277+0000 7fb494600640 1 Processor -- start 2024-04-25T09:03:59.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.277+0000 7fb494600640 1 -- start start 2024-04-25T09:03:59.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.281+0000 7fb494600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb48c145290 0x7fb48c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.281+0000 7fb494600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb48c15c5f0 con 0x7fb48c0cc260 2024-04-25T09:03:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.281+0000 7fb494600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb48c06d4b0 con 0x7fb48c0b3fe0 2024-04-25T09:03:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.281+0000 7fb494600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48c0ccd80 con 0x7fb48c145290 2024-04-25T09:03:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.281+0000 7fb492600640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fb48c0cc260 0x7fb48c0cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45138/0 (socket says 172.21.15.173:45138) 2024-04-25T09:03:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.281+0000 7fb492600640 1 -- 172.21.15.173:0/1617835355 learned_addr learned my addr 172.21.15.173:0/1617835355 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:03:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.281+0000 7fb491c00640 1 --2- 172.21.15.173:0/1617835355 >> v2:172.21.15.194:3300/0 conn(0x7fb48c145290 0x7fb48c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.281+0000 7fb48be00640 1 -- 172.21.15.173:0/1617835355 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055489214 0 0) 0x7fb4840014a0 con 0x7fb48c0cc260 2024-04-25T09:03:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.281+0000 7fb48be00640 1 -- 172.21.15.173:0/1617835355 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb474003530 con 0x7fb48c0cc260 2024-04-25T09:03:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.281+0000 7fb48be00640 1 -- 172.21.15.173:0/1617835355 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988977061 0 0) 0x7fb48c06d4b0 con 0x7fb48c0b3fe0 2024-04-25T09:03:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.281+0000 7fb48be00640 1 -- 172.21.15.173:0/1617835355 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4840014a0 con 0x7fb48c0b3fe0 2024-04-25T09:03:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.281+0000 7fb491c00640 1 -- 172.21.15.173:0/1617835355 >> v1:172.21.15.194:6789/0 conn(0x7fb48c0b3fe0 legacy=0x7fb48c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.281+0000 7fb491c00640 1 -- 172.21.15.173:0/1617835355 >> v1:172.21.15.173:6789/0 conn(0x7fb48c0cc260 legacy=0x7fb48c0cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.281+0000 7fb491c00640 1 -- 172.21.15.173:0/1617835355 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c06d790 con 0x7fb48c145290 2024-04-25T09:03:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.281+0000 7fb48be00640 1 -- 172.21.15.173:0/1617835355 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 288627388 0 0) 0x7fb474003530 con 0x7fb48c0cc260 2024-04-25T09:03:59.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.285+0000 7fb491c00640 1 --2- 172.21.15.173:0/1617835355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb48c145290 0x7fb48c15c0b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb4800097c0 tx=0x7fb48001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4e2d39e3bdec296 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:59.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.285+0000 7fb48be00640 1 -- 172.21.15.173:0/1617835355 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800b0070 con 0x7fb48c145290 2024-04-25T09:03:59.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.285+0000 7fb48be00640 1 -- 172.21.15.173:0/1617835355 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4800ab600 con 0x7fb48c145290 2024-04-25T09:03:59.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.285+0000 7fb48be00640 1 -- 172.21.15.173:0/1617835355 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800ab9d0 con 0x7fb48c145290 2024-04-25T09:03:59.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.285+0000 7fb494600640 1 -- 172.21.15.173:0/1617835355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb48c145290 msgr2=0x7fb48c15c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.285+0000 7fb494600640 1 --2- 172.21.15.173:0/1617835355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb48c145290 0x7fb48c15c0b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb4800097c0 tx=0x7fb48001c380 comp rx=0 tx=0).stop 2024-04-25T09:03:59.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.285+0000 7fb494600640 1 -- 172.21.15.173:0/1617835355 shutdown_connections 2024-04-25T09:03:59.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.285+0000 7fb494600640 1 --2- 172.21.15.173:0/1617835355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb48c145290 0x7fb48c15c0b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.285+0000 7fb494600640 1 -- 172.21.15.173:0/1617835355 >> 172.21.15.173:0/1617835355 conn(0x7fb48c06ac90 msgr2=0x7fb48c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:59.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.285+0000 7fb494600640 1 -- 172.21.15.173:0/1617835355 shutdown_connections 2024-04-25T09:03:59.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.285+0000 7fb494600640 1 -- 172.21.15.173:0/1617835355 wait complete. 2024-04-25T09:03:59.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.285+0000 7fb494600640 1 Processor -- start 2024-04-25T09:03:59.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.285+0000 7fb494600640 1 -- start start 2024-04-25T09:03:59.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb494600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb48c0b3fe0 0x7fb48c140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb494600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb48c0cc260 0x7fb48c15a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb494600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb48c145290 0x7fb48c13f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb494600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c06eee0 con 0x7fb48c0b3fe0 2024-04-25T09:03:59.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb494600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c06ed60 con 0x7fb48c0cc260 2024-04-25T09:03:59.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb494600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c06f060 con 0x7fb48c145290 2024-04-25T09:03:59.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb491c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb48c0b3fe0 0x7fb48c140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb491c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb48c0b3fe0 0x7fb48c140d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53536/0 (socket says 172.21.15.173:53536) 2024-04-25T09:03:59.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb491c00640 1 -- 172.21.15.173:0/2351100432 learned_addr learned my addr 172.21.15.173:0/2351100432 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:59.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb491200640 1 --2- 172.21.15.173:0/2351100432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb48c0cc260 0x7fb48c15a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb492600640 1 --2- 172.21.15.173:0/2351100432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb48c145290 0x7fb48c13f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb491c00640 1 -- 172.21.15.173:0/2351100432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb48c145290 msgr2=0x7fb48c13f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb491c00640 1 --2- 172.21.15.173:0/2351100432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb48c145290 0x7fb48c13f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb491c00640 1 -- 172.21.15.173:0/2351100432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb48c0cc260 msgr2=0x7fb48c15a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb491c00640 1 --2- 172.21.15.173:0/2351100432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb48c0cc260 0x7fb48c15a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb491c00640 1 -- 172.21.15.173:0/2351100432 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c1413f0 con 0x7fb48c0b3fe0 2024-04-25T09:03:59.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb491200640 1 --2- 172.21.15.173:0/2351100432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb48c0cc260 0x7fb48c15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:59.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb491c00640 1 --2- 172.21.15.173:0/2351100432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb48c0b3fe0 0x7fb48c140d60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb4800ae040 tx=0x7fb480019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:59.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb489600640 1 -- 172.21.15.173:0/2351100432 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800b8070 con 0x7fb48c0b3fe0 2024-04-25T09:03:59.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb489600640 1 -- 172.21.15.173:0/2351100432 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb480004020 con 0x7fb48c0b3fe0 2024-04-25T09:03:59.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb489600640 1 -- 172.21.15.173:0/2351100432 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800b0040 con 0x7fb48c0b3fe0 2024-04-25T09:03:59.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb494600640 1 -- 172.21.15.173:0/2351100432 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48c1416d0 con 0x7fb48c0b3fe0 2024-04-25T09:03:59.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb494600640 1 -- 172.21.15.173:0/2351100432 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48c13f440 con 0x7fb48c0b3fe0 2024-04-25T09:03:59.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.289+0000 7fb494600640 1 -- 172.21.15.173:0/2351100432 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48c073ab0 con 0x7fb48c0b3fe0 2024-04-25T09:03:59.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.293+0000 7fb489600640 1 -- 172.21.15.173:0/2351100432 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb480003620 con 0x7fb48c0b3fe0 2024-04-25T09:03:59.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.293+0000 7fb489600640 1 --2- 172.21.15.173:0/2351100432 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb46c066f60 0x7fb46c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.293+0000 7fb489600640 1 -- 172.21.15.173:0/2351100432 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fb48011e810 con 0x7fb48c0b3fe0 2024-04-25T09:03:59.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.293+0000 7fb491200640 1 --2- 172.21.15.173:0/2351100432 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb46c066f60 0x7fb46c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.293+0000 7fb491200640 1 --2- 172.21.15.173:0/2351100432 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb46c066f60 0x7fb46c069420 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb48c1f7810 tx=0x7fb478009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:59.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.297+0000 7fb489600640 1 -- 172.21.15.173:0/2351100432 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb480016090 con 0x7fb48c0b3fe0 2024-04-25T09:03:59.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.501+0000 7fb494600640 1 -- 172.21.15.173:0/2351100432 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fb48c1418a0 con 0x7fb48c0b3fe0 2024-04-25T09:03:59.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.505+0000 7fb489600640 1 -- 172.21.15.173:0/2351100432 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb4800ef9d0 con 0x7fb48c0b3fe0 2024-04-25T09:03:59.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.505+0000 7fb494600640 1 -- 172.21.15.173:0/2351100432 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb46c066f60 msgr2=0x7fb46c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.505+0000 7fb494600640 1 --2- 172.21.15.173:0/2351100432 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb46c066f60 0x7fb46c069420 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb48c1f7810 tx=0x7fb478009040 comp rx=0 tx=0).stop 2024-04-25T09:03:59.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.505+0000 7fb494600640 1 -- 172.21.15.173:0/2351100432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb48c0b3fe0 msgr2=0x7fb48c140d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.505+0000 7fb494600640 1 --2- 172.21.15.173:0/2351100432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb48c0b3fe0 0x7fb48c140d60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb4800ae040 tx=0x7fb480019120 comp rx=0 tx=0).stop 2024-04-25T09:03:59.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.505+0000 7fb494600640 1 -- 172.21.15.173:0/2351100432 shutdown_connections 2024-04-25T09:03:59.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.505+0000 7fb494600640 1 --2- 172.21.15.173:0/2351100432 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb46c066f60 0x7fb46c069420 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.505+0000 7fb494600640 1 --2- 172.21.15.173:0/2351100432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb48c145290 0x7fb48c13f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.505+0000 7fb494600640 1 --2- 172.21.15.173:0/2351100432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb48c0cc260 0x7fb48c15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.505+0000 7fb494600640 1 --2- 172.21.15.173:0/2351100432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb48c0b3fe0 0x7fb48c140d60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.505+0000 7fb494600640 1 -- 172.21.15.173:0/2351100432 >> 172.21.15.173:0/2351100432 conn(0x7fb48c06ac90 msgr2=0x7fb48c0ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:59.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.505+0000 7fb494600640 1 -- 172.21.15.173:0/2351100432 shutdown_connections 2024-04-25T09:03:59.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.505+0000 7fb494600640 1 -- 172.21.15.173:0/2351100432 wait complete. 2024-04-25T09:03:59.517 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:59.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.661+0000 7f1e2e200640 1 Processor -- start 2024-04-25T09:03:59.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.661+0000 7f1e2e200640 1 -- start start 2024-04-25T09:03:59.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.665+0000 7f1e2e200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1e280b3e70 0x7f1e280b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.665+0000 7f1e2e200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1e280aefa0 0x7f1e280b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.665+0000 7f1e2e200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e280b4790 con 0x7f1e2815edd0 2024-04-25T09:03:59.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.665+0000 7f1e2e200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2806dd50 con 0x7f1e280aefa0 2024-04-25T09:03:59.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.665+0000 7f1e2e200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2815f320 con 0x7f1e280b3e70 2024-04-25T09:03:59.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.665+0000 7f1e1ea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1e280aefa0 0x7f1e280b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.665+0000 7f1e1ea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1e280aefa0 0x7f1e280b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53552/0 (socket says 172.21.15.173:53552) 2024-04-25T09:03:59.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.665+0000 7f1e1ea00640 1 -- 172.21.15.173:0/1793022607 learned_addr learned my addr 172.21.15.173:0/1793022607 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:59.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.665+0000 7f1e27400640 1 --2- 172.21.15.173:0/1793022607 >> v2:172.21.15.194:3300/0 conn(0x7f1e280b3e70 0x7f1e280b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.665+0000 7f1e1ea00640 1 -- 172.21.15.173:0/1793022607 >> v2:172.21.15.194:3300/0 conn(0x7f1e280b3e70 msgr2=0x7f1e280b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:59.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.665+0000 7f1e1ea00640 1 --2- 172.21.15.173:0/1793022607 >> v2:172.21.15.194:3300/0 conn(0x7f1e280b3e70 0x7f1e280b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.665+0000 7f1e1ea00640 1 -- 172.21.15.173:0/1793022607 >> v1:172.21.15.194:6789/0 conn(0x7f1e2815edd0 legacy=0x7f1e280b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.665+0000 7f1e1ea00640 1 -- 172.21.15.173:0/1793022607 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2806d420 con 0x7f1e280aefa0 2024-04-25T09:03:59.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.669+0000 7f1e1ea00640 1 --2- 172.21.15.173:0/1793022607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e280aefa0 0x7f1e280b2770 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1e2806bca0 tx=0x7f1e1001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6895f8caf9de040 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:59.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.669+0000 7f1e26a00640 1 -- 172.21.15.173:0/1793022607 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e100aa670 con 0x7f1e280aefa0 2024-04-25T09:03:59.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.669+0000 7f1e26a00640 1 -- 172.21.15.173:0/1793022607 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e100af070 con 0x7f1e280aefa0 2024-04-25T09:03:59.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.669+0000 7f1e26a00640 1 -- 172.21.15.173:0/1793022607 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e100aaa30 con 0x7f1e280aefa0 2024-04-25T09:03:59.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.669+0000 7f1e2e200640 1 -- 172.21.15.173:0/1793022607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e280aefa0 msgr2=0x7f1e280b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.669+0000 7f1e2e200640 1 --2- 172.21.15.173:0/1793022607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e280aefa0 0x7f1e280b2770 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1e2806bca0 tx=0x7f1e1001c4f0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.669+0000 7f1e2e200640 1 -- 172.21.15.173:0/1793022607 shutdown_connections 2024-04-25T09:03:59.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.669+0000 7f1e2e200640 1 --2- 172.21.15.173:0/1793022607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e280aefa0 0x7f1e280b2770 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.669+0000 7f1e2e200640 1 --2- 172.21.15.173:0/1793022607 >> v2:172.21.15.194:3300/0 conn(0x7f1e280b3e70 0x7f1e280b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.669+0000 7f1e2e200640 1 -- 172.21.15.173:0/1793022607 >> 172.21.15.173:0/1793022607 conn(0x7f1e2806ac90 msgr2=0x7f1e2806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:59.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.669+0000 7f1e2e200640 1 -- 172.21.15.173:0/1793022607 shutdown_connections 2024-04-25T09:03:59.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.669+0000 7f1e2e200640 1 -- 172.21.15.173:0/1793022607 wait complete. 2024-04-25T09:03:59.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.669+0000 7f1e2e200640 1 Processor -- start 2024-04-25T09:03:59.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.669+0000 7f1e2e200640 1 -- start start 2024-04-25T09:03:59.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.669+0000 7f1e2e200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e280aefa0 0x7f1e2815adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e2e200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e280b3e70 0x7f1e2815d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e2e200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e2815edd0 0x7f1e280b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e2e200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2806e1c0 con 0x7f1e280aefa0 2024-04-25T09:03:59.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e2e200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2815aba0 con 0x7f1e2815edd0 2024-04-25T09:03:59.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e2e200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2806e340 con 0x7f1e280b3e70 2024-04-25T09:03:59.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e27400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e280aefa0 0x7f1e2815adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e27400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e280aefa0 0x7f1e2815adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53556/0 (socket says 172.21.15.173:53556) 2024-04-25T09:03:59.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e27400640 1 -- 172.21.15.173:0/330718489 learned_addr learned my addr 172.21.15.173:0/330718489 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:59.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e1ea00640 1 --2- 172.21.15.173:0/330718489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e280b3e70 0x7f1e2815d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e27e00640 1 --2- 172.21.15.173:0/330718489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e2815edd0 0x7f1e280b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e27400640 1 -- 172.21.15.173:0/330718489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e280b3e70 msgr2=0x7f1e2815d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e27400640 1 --2- 172.21.15.173:0/330718489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e280b3e70 0x7f1e2815d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e27400640 1 -- 172.21.15.173:0/330718489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e2815edd0 msgr2=0x7f1e280b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e27400640 1 --2- 172.21.15.173:0/330718489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e2815edd0 0x7f1e280b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e27400640 1 -- 172.21.15.173:0/330718489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e28151cc0 con 0x7f1e280aefa0 2024-04-25T09:03:59.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e27400640 1 --2- 172.21.15.173:0/330718489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e280aefa0 0x7f1e2815adb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800e8a0 tx=0x7f1e1800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:59.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e1fe00640 1 -- 172.21.15.173:0/330718489 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e18017070 con 0x7f1e280aefa0 2024-04-25T09:03:59.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e1fe00640 1 -- 172.21.15.173:0/330718489 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1800c940 con 0x7f1e280aefa0 2024-04-25T09:03:59.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e1fe00640 1 -- 172.21.15.173:0/330718489 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1800ccf0 con 0x7f1e280aefa0 2024-04-25T09:03:59.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e2e200640 1 -- 172.21.15.173:0/330718489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e280b1810 con 0x7f1e280aefa0 2024-04-25T09:03:59.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e2e200640 1 -- 172.21.15.173:0/330718489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e280b1dd0 con 0x7f1e280aefa0 2024-04-25T09:03:59.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e2e200640 1 -- 172.21.15.173:0/330718489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e28073a40 con 0x7f1e280aefa0 2024-04-25T09:03:59.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.673+0000 7f1e1fe00640 1 -- 172.21.15.173:0/330718489 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1e1801a070 con 0x7f1e280aefa0 2024-04-25T09:03:59.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.677+0000 7f1e1fe00640 1 --2- 172.21.15.173:0/330718489 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1e04066f60 0x7f1e04069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.677+0000 7f1e1fe00640 1 -- 172.21.15.173:0/330718489 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f1e18084cd0 con 0x7f1e280aefa0 2024-04-25T09:03:59.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.677+0000 7f1e1ea00640 1 --2- 172.21.15.173:0/330718489 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1e04066f60 0x7f1e04069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.677+0000 7f1e1ea00640 1 --2- 172.21.15.173:0/330718489 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1e04066f60 0x7f1e04069420 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1e100ae000 tx=0x7f1e100a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:59.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.681+0000 7f1e1fe00640 1 -- 172.21.15.173:0/330718489 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1e18055840 con 0x7f1e280aefa0 2024-04-25T09:03:59.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.837+0000 7f1e2e200640 1 -- 172.21.15.173:0/330718489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e2806f1c0 con 0x7f1e280aefa0 2024-04-25T09:03:59.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.837+0000 7f1e1fe00640 1 -- 172.21.15.173:0/330718489 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13224 (secure 0 0 0) 0x7f1e180598e0 con 0x7f1e280aefa0 2024-04-25T09:03:59.828 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:03:59.828 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":36,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:03:56.807498+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.837+0000 7f1e2e200640 1 -- 172.21.15.173:0/330718489 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1e04066f60 msgr2=0x7f1e04069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.837+0000 7f1e2e200640 1 --2- 172.21.15.173:0/330718489 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1e04066f60 0x7f1e04069420 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1e100ae000 tx=0x7f1e100a7000 comp rx=0 tx=0).stop 2024-04-25T09:03:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.837+0000 7f1e2e200640 1 -- 172.21.15.173:0/330718489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e280aefa0 msgr2=0x7f1e2815adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.837+0000 7f1e2e200640 1 --2- 172.21.15.173:0/330718489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e280aefa0 0x7f1e2815adb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800e8a0 tx=0x7f1e1800eca0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.841+0000 7f1e2e200640 1 -- 172.21.15.173:0/330718489 shutdown_connections 2024-04-25T09:03:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.841+0000 7f1e2e200640 1 --2- 172.21.15.173:0/330718489 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1e04066f60 0x7f1e04069420 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.841+0000 7f1e2e200640 1 --2- 172.21.15.173:0/330718489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e2815edd0 0x7f1e280b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.841+0000 7f1e2e200640 1 --2- 172.21.15.173:0/330718489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e280b3e70 0x7f1e2815d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.841+0000 7f1e2e200640 1 --2- 172.21.15.173:0/330718489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e280aefa0 0x7f1e2815adb0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.841+0000 7f1e2e200640 1 -- 172.21.15.173:0/330718489 >> 172.21.15.173:0/330718489 conn(0x7f1e2806ac90 msgr2=0x7f1e2814f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.841+0000 7f1e2e200640 1 -- 172.21.15.173:0/330718489 shutdown_connections 2024-04-25T09:03:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.841+0000 7f1e2e200640 1 -- 172.21.15.173:0/330718489 wait complete. 2024-04-25T09:03:59.848 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:03:59.849 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:59.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.997+0000 7fd227a00640 1 Processor -- start 2024-04-25T09:03:59.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.997+0000 7fd227a00640 1 -- start start 2024-04-25T09:03:59.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.997+0000 7fd227a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd2200aeb90 0x7fd2200cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.997+0000 7fd227a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd2200aef70 0x7fd2200cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.997+0000 7fd227a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2200cdba0 0x7fd2200ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:59.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.997+0000 7fd227a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd220071320 con 0x7fd2200aef70 2024-04-25T09:03:59.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.997+0000 7fd227a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd220072330 con 0x7fd2200aeb90 2024-04-25T09:03:59.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.997+0000 7fd227a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200ce570 con 0x7fd2200cdba0 2024-04-25T09:03:59.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.997+0000 7fd21fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd2200aef70 0x7fd2200cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.997+0000 7fd21fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd2200aef70 0x7fd2200cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53560/0 (socket says 172.21.15.173:53560) 2024-04-25T09:03:59.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.997+0000 7fd21fe00640 1 -- 172.21.15.173:0/2282618911 learned_addr learned my addr 172.21.15.173:0/2282618911 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:03:59.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.997+0000 7fd225a00640 1 --2- 172.21.15.173:0/2282618911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2200cdba0 0x7fd2200ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:03:59.997+0000 7fd225000640 1 --2- 172.21.15.173:0/2282618911 >> v2:172.21.15.194:3300/0 conn(0x7fd2200aeb90 0x7fd2200cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:59.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.001+0000 7fd21fe00640 1 -- 172.21.15.173:0/2282618911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2200cdba0 msgr2=0x7fd2200ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:59.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.001+0000 7fd21fe00640 1 --2- 172.21.15.173:0/2282618911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2200cdba0 0x7fd2200ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.001+0000 7fd21fe00640 1 -- 172.21.15.173:0/2282618911 >> v2:172.21.15.194:3300/0 conn(0x7fd2200aeb90 msgr2=0x7fd2200cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:59.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.001+0000 7fd21fe00640 1 --2- 172.21.15.173:0/2282618911 >> v2:172.21.15.194:3300/0 conn(0x7fd2200aeb90 0x7fd2200cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.001+0000 7fd21fe00640 1 -- 172.21.15.173:0/2282618911 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd220071570 con 0x7fd2200aef70 2024-04-25T09:03:59.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.005+0000 7fd21fe00640 1 --2- 172.21.15.173:0/2282618911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2200aef70 0x7fd2200cc610 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd2200cd220 tx=0x7fd20c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51db93fe06351bfc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:59.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.005+0000 7fd21f400640 1 -- 172.21.15.173:0/2282618911 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0ab620 con 0x7fd2200aef70 2024-04-25T09:03:59.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.005+0000 7fd21f400640 1 -- 172.21.15.173:0/2282618911 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c0b0070 con 0x7fd2200aef70 2024-04-25T09:03:59.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.005+0000 7fd21f400640 1 -- 172.21.15.173:0/2282618911 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0ab9e0 con 0x7fd2200aef70 2024-04-25T09:03:59.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.005+0000 7fd227a00640 1 -- 172.21.15.173:0/2282618911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2200aef70 msgr2=0x7fd2200cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:59.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.005+0000 7fd227a00640 1 --2- 172.21.15.173:0/2282618911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2200aef70 0x7fd2200cc610 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd2200cd220 tx=0x7fd20c01c460 comp rx=0 tx=0).stop 2024-04-25T09:03:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.005+0000 7fd227a00640 1 -- 172.21.15.173:0/2282618911 shutdown_connections 2024-04-25T09:03:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.005+0000 7fd227a00640 1 --2- 172.21.15.173:0/2282618911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2200cdba0 0x7fd2200ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.005+0000 7fd227a00640 1 --2- 172.21.15.173:0/2282618911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2200aef70 0x7fd2200cc610 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.005+0000 7fd227a00640 1 --2- 172.21.15.173:0/2282618911 >> v2:172.21.15.194:3300/0 conn(0x7fd2200aeb90 0x7fd2200cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.005+0000 7fd227a00640 1 -- 172.21.15.173:0/2282618911 >> 172.21.15.173:0/2282618911 conn(0x7fd22006ac90 msgr2=0x7fd22006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.005+0000 7fd227a00640 1 -- 172.21.15.173:0/2282618911 shutdown_connections 2024-04-25T09:03:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.005+0000 7fd227a00640 1 -- 172.21.15.173:0/2282618911 wait complete. 2024-04-25T09:03:59.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.005+0000 7fd227a00640 1 Processor -- start 2024-04-25T09:03:59.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.005+0000 7fd227a00640 1 -- start start 2024-04-25T09:03:59.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd227a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2200aeb90 0x7fd22014c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd227a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2200aef70 0x7fd2200b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd227a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2200cdba0 0x7fd2200b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd227a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22015ef40 con 0x7fd2200aef70 2024-04-25T09:04:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd227a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22015edc0 con 0x7fd2200cdba0 2024-04-25T09:04:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd227a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22015f0c0 con 0x7fd2200aeb90 2024-04-25T09:04:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd21fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2200aef70 0x7fd2200b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd21fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2200aef70 0x7fd2200b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53562/0 (socket says 172.21.15.173:53562) 2024-04-25T09:04:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd21fe00640 1 -- 172.21.15.173:0/2921761120 learned_addr learned my addr 172.21.15.173:0/2921761120 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd225000640 1 --2- 172.21.15.173:0/2921761120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2200aeb90 0x7fd22014c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd225a00640 1 --2- 172.21.15.173:0/2921761120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2200cdba0 0x7fd2200b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd21fe00640 1 -- 172.21.15.173:0/2921761120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2200aeb90 msgr2=0x7fd22014c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd21fe00640 1 --2- 172.21.15.173:0/2921761120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2200aeb90 0x7fd22014c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd21fe00640 1 -- 172.21.15.173:0/2921761120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2200cdba0 msgr2=0x7fd2200b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd21fe00640 1 --2- 172.21.15.173:0/2921761120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2200cdba0 0x7fd2200b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd21fe00640 1 -- 172.21.15.173:0/2921761120 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2201536e0 con 0x7fd2200aef70 2024-04-25T09:04:00.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd225a00640 1 --2- 172.21.15.173:0/2921761120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2200cdba0 0x7fd2200b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:00.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd21fe00640 1 --2- 172.21.15.173:0/2921761120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2200aef70 0x7fd2200b34c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd20c01ab10 tx=0x7fd20c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:00.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd21cc00640 1 -- 172.21.15.173:0/2921761120 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0abc10 con 0x7fd2200aef70 2024-04-25T09:04:00.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd21cc00640 1 -- 172.21.15.173:0/2921761120 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c0abdb0 con 0x7fd2200aef70 2024-04-25T09:04:00.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd21cc00640 1 -- 172.21.15.173:0/2921761120 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0be630 con 0x7fd2200aef70 2024-04-25T09:04:00.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd227a00640 1 -- 172.21.15.173:0/2921761120 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2201539c0 con 0x7fd2200aef70 2024-04-25T09:04:00.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd227a00640 1 -- 172.21.15.173:0/2921761120 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2200afa50 con 0x7fd2200aef70 2024-04-25T09:04:00.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.009+0000 7fd227a00640 1 -- 172.21.15.173:0/2921761120 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd220073ab0 con 0x7fd2200aef70 2024-04-25T09:04:00.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.013+0000 7fd21cc00640 1 -- 172.21.15.173:0/2921761120 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd20c0b43f0 con 0x7fd2200aef70 2024-04-25T09:04:00.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.013+0000 7fd21cc00640 1 --2- 172.21.15.173:0/2921761120 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd200066f60 0x7fd200069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.013+0000 7fd21cc00640 1 -- 172.21.15.173:0/2921761120 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fd20c11f0a0 con 0x7fd2200aef70 2024-04-25T09:04:00.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.013+0000 7fd225000640 1 --2- 172.21.15.173:0/2921761120 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd200066f60 0x7fd200069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.013+0000 7fd225000640 1 --2- 172.21.15.173:0/2921761120 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd200066f60 0x7fd200069420 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd210009a40 tx=0x7fd210009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:00.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.017+0000 7fd21cc00640 1 -- 172.21.15.173:0/2921761120 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd20c0c4060 con 0x7fd2200aef70 2024-04-25T09:04:00.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.173+0000 7fd227a00640 1 -- 172.21.15.173:0/2921761120 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2200cd400 con 0x7fd2200aef70 2024-04-25T09:04:00.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.173+0000 7fd21cc00640 1 -- 172.21.15.173:0/2921761120 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd20c016110 con 0x7fd2200aef70 2024-04-25T09:04:00.164 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:04:00.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.177+0000 7fd227a00640 1 -- 172.21.15.173:0/2921761120 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd200066f60 msgr2=0x7fd200069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.177+0000 7fd227a00640 1 --2- 172.21.15.173:0/2921761120 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd200066f60 0x7fd200069420 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd210009a40 tx=0x7fd210009190 comp rx=0 tx=0).stop 2024-04-25T09:04:00.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.177+0000 7fd227a00640 1 -- 172.21.15.173:0/2921761120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2200aef70 msgr2=0x7fd2200b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.177+0000 7fd227a00640 1 --2- 172.21.15.173:0/2921761120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2200aef70 0x7fd2200b34c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd20c01ab10 tx=0x7fd20c01aca0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.177+0000 7fd227a00640 1 -- 172.21.15.173:0/2921761120 shutdown_connections 2024-04-25T09:04:00.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.177+0000 7fd227a00640 1 --2- 172.21.15.173:0/2921761120 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd200066f60 0x7fd200069420 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.177+0000 7fd227a00640 1 --2- 172.21.15.173:0/2921761120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2200cdba0 0x7fd2200b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.177+0000 7fd227a00640 1 --2- 172.21.15.173:0/2921761120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2200aef70 0x7fd2200b34c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.177+0000 7fd227a00640 1 --2- 172.21.15.173:0/2921761120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2200aeb90 0x7fd22014c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.177+0000 7fd227a00640 1 -- 172.21.15.173:0/2921761120 >> 172.21.15.173:0/2921761120 conn(0x7fd22006ac90 msgr2=0x7fd22015ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:00.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.177+0000 7fd227a00640 1 -- 172.21.15.173:0/2921761120 shutdown_connections 2024-04-25T09:04:00.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.177+0000 7fd227a00640 1 -- 172.21.15.173:0/2921761120 wait complete. 2024-04-25T09:04:00.185 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:04:00.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.329+0000 7fce85000640 1 Processor -- start 2024-04-25T09:04:00.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.329+0000 7fce85000640 1 -- start start 2024-04-25T09:04:00.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.333+0000 7fce85000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce801597d0 0x7fce8015ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.333+0000 7fce85000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8015c0c0 con 0x7fce8006b3a0 2024-04-25T09:04:00.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.333+0000 7fce85000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce801604b0 con 0x7fce800cc270 2024-04-25T09:04:00.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.333+0000 7fce85000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce800cfbe0 con 0x7fce801597d0 2024-04-25T09:04:00.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.333+0000 7fce7e800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fce8006b3a0 0x7fce8015c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45152/0 (socket says 172.21.15.173:45152) 2024-04-25T09:04:00.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.333+0000 7fce7e800640 1 -- 172.21.15.173:0/2862888187 learned_addr learned my addr 172.21.15.173:0/2862888187 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:04:00.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.333+0000 7fce7de00640 1 --2- 172.21.15.173:0/2862888187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce801597d0 0x7fce8015ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.333+0000 7fce7d400640 1 -- 172.21.15.173:0/2862888187 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547657217 0 0) 0x7fce8015c0c0 con 0x7fce8006b3a0 2024-04-25T09:04:00.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.333+0000 7fce7d400640 1 -- 172.21.15.173:0/2862888187 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce64003530 con 0x7fce8006b3a0 2024-04-25T09:04:00.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.333+0000 7fce7d400640 1 -- 172.21.15.173:0/2862888187 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231909644 0 0) 0x7fce801604b0 con 0x7fce800cc270 2024-04-25T09:04:00.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.333+0000 7fce7de00640 1 -- 172.21.15.173:0/2862888187 >> v1:172.21.15.194:6789/0 conn(0x7fce800cc270 legacy=0x7fce8006ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.333+0000 7fce7de00640 1 -- 172.21.15.173:0/2862888187 >> v1:172.21.15.173:6789/0 conn(0x7fce8006b3a0 legacy=0x7fce8015c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.333+0000 7fce7de00640 1 -- 172.21.15.173:0/2862888187 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce800cfec0 con 0x7fce801597d0 2024-04-25T09:04:00.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.337+0000 7fce7de00640 1 --2- 172.21.15.173:0/2862888187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce801597d0 0x7fce8015ff70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fce700097f0 tx=0x7fce7001cf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2900407efb6245 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:00.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.337+0000 7fce7d400640 1 -- 172.21.15.173:0/2862888187 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700ab5f0 con 0x7fce801597d0 2024-04-25T09:04:00.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.337+0000 7fce7d400640 1 -- 172.21.15.173:0/2862888187 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce700b0070 con 0x7fce801597d0 2024-04-25T09:04:00.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.337+0000 7fce7d400640 1 -- 172.21.15.173:0/2862888187 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700ab9b0 con 0x7fce801597d0 2024-04-25T09:04:00.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.337+0000 7fce85000640 1 -- 172.21.15.173:0/2862888187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce801597d0 msgr2=0x7fce8015ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.337+0000 7fce85000640 1 --2- 172.21.15.173:0/2862888187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce801597d0 0x7fce8015ff70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fce700097f0 tx=0x7fce7001cf40 comp rx=0 tx=0).stop 2024-04-25T09:04:00.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.337+0000 7fce85000640 1 -- 172.21.15.173:0/2862888187 shutdown_connections 2024-04-25T09:04:00.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.337+0000 7fce85000640 1 --2- 172.21.15.173:0/2862888187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce801597d0 0x7fce8015ff70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.337+0000 7fce85000640 1 -- 172.21.15.173:0/2862888187 >> 172.21.15.173:0/2862888187 conn(0x7fce800b2230 msgr2=0x7fce800b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:00.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.337+0000 7fce85000640 1 -- 172.21.15.173:0/2862888187 shutdown_connections 2024-04-25T09:04:00.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.337+0000 7fce85000640 1 -- 172.21.15.173:0/2862888187 wait complete. 2024-04-25T09:04:00.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.341+0000 7fce85000640 1 Processor -- start 2024-04-25T09:04:00.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.341+0000 7fce85000640 1 -- start start 2024-04-25T09:04:00.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.341+0000 7fce85000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce8006b3a0 0x7fce80152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.341+0000 7fce85000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce800cc270 0x7fce800b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.341+0000 7fce85000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce801597d0 0x7fce8013c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.341+0000 7fce85000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce800b2e30 con 0x7fce8006b3a0 2024-04-25T09:04:00.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.341+0000 7fce85000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce800cf8b0 con 0x7fce801597d0 2024-04-25T09:04:00.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.341+0000 7fce85000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce800b2fb0 con 0x7fce800cc270 2024-04-25T09:04:00.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.341+0000 7fce7de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce8006b3a0 0x7fce80152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.341+0000 7fce7de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce8006b3a0 0x7fce80152720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53566/0 (socket says 172.21.15.173:53566) 2024-04-25T09:04:00.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.341+0000 7fce7de00640 1 -- 172.21.15.173:0/1363289176 learned_addr learned my addr 172.21.15.173:0/1363289176 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:00.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.341+0000 7fce77e00640 1 --2- 172.21.15.173:0/1363289176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce800cc270 0x7fce800b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.341+0000 7fce7e800640 1 --2- 172.21.15.173:0/1363289176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce801597d0 0x7fce8013c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.345+0000 7fce7de00640 1 -- 172.21.15.173:0/1363289176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce800cc270 msgr2=0x7fce800b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.345+0000 7fce7de00640 1 --2- 172.21.15.173:0/1363289176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce800cc270 0x7fce800b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.345+0000 7fce7de00640 1 -- 172.21.15.173:0/1363289176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce801597d0 msgr2=0x7fce8013c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.345+0000 7fce7de00640 1 --2- 172.21.15.173:0/1363289176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce801597d0 0x7fce8013c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.345+0000 7fce7de00640 1 -- 172.21.15.173:0/1363289176 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce80152f70 con 0x7fce8006b3a0 2024-04-25T09:04:00.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.345+0000 7fce7e800640 1 --2- 172.21.15.173:0/1363289176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce801597d0 0x7fce8013c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:00.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.345+0000 7fce7de00640 1 --2- 172.21.15.173:0/1363289176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce8006b3a0 0x7fce80152720 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fce70009740 tx=0x7fce70019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:00.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.345+0000 7fce76000640 1 -- 172.21.15.173:0/1363289176 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70004220 con 0x7fce8006b3a0 2024-04-25T09:04:00.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.345+0000 7fce76000640 1 -- 172.21.15.173:0/1363289176 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce700043c0 con 0x7fce8006b3a0 2024-04-25T09:04:00.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.345+0000 7fce85000640 1 -- 172.21.15.173:0/1363289176 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce80153250 con 0x7fce8006b3a0 2024-04-25T09:04:00.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.345+0000 7fce76000640 1 -- 172.21.15.173:0/1363289176 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700b4920 con 0x7fce8006b3a0 2024-04-25T09:04:00.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.345+0000 7fce85000640 1 -- 172.21.15.173:0/1363289176 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce80153810 con 0x7fce8006b3a0 2024-04-25T09:04:00.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.345+0000 7fce85000640 1 -- 172.21.15.173:0/1363289176 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8006cd30 con 0x7fce8006b3a0 2024-04-25T09:04:00.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.345+0000 7fce76000640 1 -- 172.21.15.173:0/1363289176 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fce700c5060 con 0x7fce8006b3a0 2024-04-25T09:04:00.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.349+0000 7fce76000640 1 --2- 172.21.15.173:0/1363289176 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce5c066f90 0x7fce5c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.349+0000 7fce76000640 1 -- 172.21.15.173:0/1363289176 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fce7011e990 con 0x7fce8006b3a0 2024-04-25T09:04:00.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.349+0000 7fce77e00640 1 --2- 172.21.15.173:0/1363289176 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce5c066f90 0x7fce5c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.349+0000 7fce77e00640 1 --2- 172.21.15.173:0/1363289176 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce5c066f90 0x7fce5c069450 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fce801f84a0 tx=0x7fce68009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:00.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.349+0000 7fce76000640 1 -- 172.21.15.173:0/1363289176 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fce700b9070 con 0x7fce8006b3a0 2024-04-25T09:04:00.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.509+0000 7fce85000640 1 -- 172.21.15.173:0/1363289176 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fce800b6680 con 0x7fce8006b3a0 2024-04-25T09:04:00.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.509+0000 7fce76000640 1 -- 172.21.15.173:0/1363289176 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+65 (secure 0 0 0) 0x7fce700160d0 con 0x7fce8006b3a0 2024-04-25T09:04:00.498 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:04:00.499 INFO:teuthology.orchestra.run.smithi173.stdout:[ 2024-04-25T09:04:00.499 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:04:00.499 INFO:teuthology.orchestra.run.smithi173.stdout: "poolnum": 1, 2024-04-25T09:04:00.499 INFO:teuthology.orchestra.run.smithi173.stdout: "poolname": ".mgr" 2024-04-25T09:04:00.499 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:04:00.499 INFO:teuthology.orchestra.run.smithi173.stdout:] 2024-04-25T09:04:00.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.509+0000 7fce85000640 1 -- 172.21.15.173:0/1363289176 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce5c066f90 msgr2=0x7fce5c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.509+0000 7fce85000640 1 --2- 172.21.15.173:0/1363289176 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce5c066f90 0x7fce5c069450 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fce801f84a0 tx=0x7fce68009040 comp rx=0 tx=0).stop 2024-04-25T09:04:00.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.509+0000 7fce85000640 1 -- 172.21.15.173:0/1363289176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce8006b3a0 msgr2=0x7fce80152720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.509+0000 7fce85000640 1 --2- 172.21.15.173:0/1363289176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce8006b3a0 0x7fce80152720 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fce70009740 tx=0x7fce70019280 comp rx=0 tx=0).stop 2024-04-25T09:04:00.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.509+0000 7fce85000640 1 -- 172.21.15.173:0/1363289176 shutdown_connections 2024-04-25T09:04:00.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.509+0000 7fce85000640 1 --2- 172.21.15.173:0/1363289176 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce5c066f90 0x7fce5c069450 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.509+0000 7fce85000640 1 --2- 172.21.15.173:0/1363289176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce801597d0 0x7fce8013c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.509+0000 7fce85000640 1 --2- 172.21.15.173:0/1363289176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce800cc270 0x7fce800b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.509+0000 7fce85000640 1 --2- 172.21.15.173:0/1363289176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce8006b3a0 0x7fce80152720 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.509+0000 7fce85000640 1 -- 172.21.15.173:0/1363289176 >> 172.21.15.173:0/1363289176 conn(0x7fce800b2230 msgr2=0x7fce8015c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:00.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.509+0000 7fce85000640 1 -- 172.21.15.173:0/1363289176 shutdown_connections 2024-04-25T09:04:00.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.509+0000 7fce85000640 1 -- 172.21.15.173:0/1363289176 wait complete. 2024-04-25T09:04:00.519 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:04:00.520 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:04:00.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.669+0000 7feabea00640 1 Processor -- start 2024-04-25T09:04:00.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.669+0000 7feabea00640 1 -- start start 2024-04-25T09:04:00.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.669+0000 7feabea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feab80aeb90 0x7feab80cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.669+0000 7feabea00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab8071570 con 0x7feab80ce2b0 2024-04-25T09:04:00.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.669+0000 7feabea00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab8071850 con 0x7feab80aef70 2024-04-25T09:04:00.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.669+0000 7feabea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab8071320 con 0x7feab80aeb90 2024-04-25T09:04:00.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.669+0000 7feabca00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7feab80ce2b0 0x7feab815af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45168/0 (socket says 172.21.15.173:45168) 2024-04-25T09:04:00.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.669+0000 7feabca00640 1 -- 172.21.15.173:0/3999482873 learned_addr learned my addr 172.21.15.173:0/3999482873 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:04:00.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.673+0000 7feab7e00640 1 --2- 172.21.15.173:0/3999482873 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feab80aeb90 0x7feab80cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.673+0000 7feab7400640 1 -- 172.21.15.173:0/3999482873 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200712117 0 0) 0x7feab8071570 con 0x7feab80ce2b0 2024-04-25T09:04:00.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.673+0000 7feab7400640 1 -- 172.21.15.173:0/3999482873 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea9c003530 con 0x7feab80ce2b0 2024-04-25T09:04:00.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.673+0000 7feab7e00640 1 -- 172.21.15.173:0/3999482873 >> v1:172.21.15.194:6789/0 conn(0x7feab80aef70 legacy=0x7feab80cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.673+0000 7feab7e00640 1 -- 172.21.15.173:0/3999482873 >> v1:172.21.15.173:6789/0 conn(0x7feab80ce2b0 legacy=0x7feab815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.673+0000 7feab7400640 1 -- 172.21.15.173:0/3999482873 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1688660637 0 0) 0x7fea9c003530 con 0x7feab80ce2b0 2024-04-25T09:04:00.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.673+0000 7feab7e00640 1 -- 172.21.15.173:0/3999482873 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab8071b30 con 0x7feab80aeb90 2024-04-25T09:04:00.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.673+0000 7feab7e00640 1 --2- 172.21.15.173:0/3999482873 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feab80aeb90 0x7feab80cc0d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7feaa80097f0 tx=0x7feaa801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e644cf0b45da3883 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:00.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.673+0000 7feab7400640 1 -- 172.21.15.173:0/3999482873 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa80b0070 con 0x7feab80aeb90 2024-04-25T09:04:00.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.673+0000 7feab7400640 1 -- 172.21.15.173:0/3999482873 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa80ab400 con 0x7feab80aeb90 2024-04-25T09:04:00.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.673+0000 7feab7400640 1 -- 172.21.15.173:0/3999482873 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab0001a00 con 0x7feab80aeb90 2024-04-25T09:04:00.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feabea00640 1 -- 172.21.15.173:0/3999482873 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feab80aeb90 msgr2=0x7feab80cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feabea00640 1 --2- 172.21.15.173:0/3999482873 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feab80aeb90 0x7feab80cc0d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7feaa80097f0 tx=0x7feaa801c370 comp rx=0 tx=0).stop 2024-04-25T09:04:00.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feabea00640 1 -- 172.21.15.173:0/3999482873 shutdown_connections 2024-04-25T09:04:00.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feabea00640 1 --2- 172.21.15.173:0/3999482873 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feab80aeb90 0x7feab80cc0d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feabea00640 1 -- 172.21.15.173:0/3999482873 >> 172.21.15.173:0/3999482873 conn(0x7feab806ac90 msgr2=0x7feab806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:00.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feabea00640 1 -- 172.21.15.173:0/3999482873 shutdown_connections 2024-04-25T09:04:00.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feabea00640 1 -- 172.21.15.173:0/3999482873 wait complete. 2024-04-25T09:04:00.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feabea00640 1 Processor -- start 2024-04-25T09:04:00.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feabea00640 1 -- start start 2024-04-25T09:04:00.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feabea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feab80aeb90 0x7feab813b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feabea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feab80aef70 0x7feab8153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feabea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feab80ce2b0 0x7feab8153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feabea00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab8168ac0 con 0x7feab80aeb90 2024-04-25T09:04:00.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feabea00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab8168940 con 0x7feab80aef70 2024-04-25T09:04:00.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feabea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab8168c40 con 0x7feab80ce2b0 2024-04-25T09:04:00.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feab7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feab80aeb90 0x7feab813b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feab7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feab80aeb90 0x7feab813b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53582/0 (socket says 172.21.15.173:53582) 2024-04-25T09:04:00.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feab7e00640 1 -- 172.21.15.173:0/3864221370 learned_addr learned my addr 172.21.15.173:0/3864221370 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:00.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feaaf400640 1 --2- 172.21.15.173:0/3864221370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feab80aef70 0x7feab8153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feabca00640 1 --2- 172.21.15.173:0/3864221370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feab80ce2b0 0x7feab8153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feab7e00640 1 -- 172.21.15.173:0/3864221370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feab80ce2b0 msgr2=0x7feab8153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feab7e00640 1 --2- 172.21.15.173:0/3864221370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feab80ce2b0 0x7feab8153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feab7e00640 1 -- 172.21.15.173:0/3864221370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feab80aef70 msgr2=0x7feab8153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:00.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feab7e00640 1 --2- 172.21.15.173:0/3864221370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feab80aef70 0x7feab8153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:00.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feab7e00640 1 -- 172.21.15.173:0/3864221370 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab8153dc0 con 0x7feab80aeb90 2024-04-25T09:04:00.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.677+0000 7feabca00640 1 --2- 172.21.15.173:0/3864221370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feab80ce2b0 0x7feab8153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:00.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.681+0000 7feab7e00640 1 --2- 172.21.15.173:0/3864221370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feab80aeb90 0x7feab813b040 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7feaa80ae040 tx=0x7feaa801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:00.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.681+0000 7feab4c00640 1 -- 172.21.15.173:0/3864221370 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa80b0050 con 0x7feab80aeb90 2024-04-25T09:04:00.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.681+0000 7feab4c00640 1 -- 172.21.15.173:0/3864221370 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa80b1040 con 0x7feab80aeb90 2024-04-25T09:04:00.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.681+0000 7feab4c00640 1 -- 172.21.15.173:0/3864221370 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8004280 con 0x7feab80aeb90 2024-04-25T09:04:00.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.681+0000 7feabea00640 1 -- 172.21.15.173:0/3864221370 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab81540a0 con 0x7feab80aeb90 2024-04-25T09:04:00.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.681+0000 7feabea00640 1 -- 172.21.15.173:0/3864221370 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab8154660 con 0x7feab80aeb90 2024-04-25T09:04:00.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.681+0000 7feabea00640 1 -- 172.21.15.173:0/3864221370 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab8073ab0 con 0x7feab80aeb90 2024-04-25T09:04:00.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.681+0000 7feab4c00640 1 -- 172.21.15.173:0/3864221370 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feaa80be020 con 0x7feab80aeb90 2024-04-25T09:04:00.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.681+0000 7feab4c00640 1 --2- 172.21.15.173:0/3864221370 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fea94066f60 0x7fea94069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:00.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.681+0000 7feab4c00640 1 -- 172.21.15.173:0/3864221370 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5249+0+0 (secure 0 0 0) 0x7feaa811ec50 con 0x7feab80aeb90 2024-04-25T09:04:00.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.681+0000 7feaaf400640 1 --2- 172.21.15.173:0/3864221370 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fea94066f60 0x7fea94069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:00.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.681+0000 7feaaf400640 1 --2- 172.21.15.173:0/3864221370 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fea94066f60 0x7fea94069420 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7feab80b2590 tx=0x7feaa0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:00.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.685+0000 7feab4c00640 1 -- 172.21.15.173:0/3864221370 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feaa8124020 con 0x7feab80aeb90 2024-04-25T09:04:00.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:00.841+0000 7feabea00640 1 -- 172.21.15.173:0/3864221370 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7feab8155290 con 0x7feab80aeb90 2024-04-25T09:04:01.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.813+0000 7feab4c00640 1 -- 172.21.15.173:0/3864221370 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) v1 ==== 138+0+0 (secure 0 0 0) 0x7feaa8015ff0 con 0x7feab80aeb90 2024-04-25T09:04:01.802 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' created 2024-04-25T09:04:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.813+0000 7feabea00640 1 -- 172.21.15.173:0/3864221370 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fea94066f60 msgr2=0x7fea94069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.813+0000 7feabea00640 1 --2- 172.21.15.173:0/3864221370 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fea94066f60 0x7fea94069420 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7feab80b2590 tx=0x7feaa0009040 comp rx=0 tx=0).stop 2024-04-25T09:04:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.813+0000 7feabea00640 1 -- 172.21.15.173:0/3864221370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feab80aeb90 msgr2=0x7feab813b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.813+0000 7feabea00640 1 --2- 172.21.15.173:0/3864221370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feab80aeb90 0x7feab813b040 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7feaa80ae040 tx=0x7feaa801abb0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.817+0000 7feabea00640 1 -- 172.21.15.173:0/3864221370 shutdown_connections 2024-04-25T09:04:01.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.817+0000 7feabea00640 1 --2- 172.21.15.173:0/3864221370 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fea94066f60 0x7fea94069420 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.817+0000 7feabea00640 1 --2- 172.21.15.173:0/3864221370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feab80ce2b0 0x7feab8153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.817+0000 7feabea00640 1 --2- 172.21.15.173:0/3864221370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feab80aef70 0x7feab8153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.817+0000 7feabea00640 1 --2- 172.21.15.173:0/3864221370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feab80aeb90 0x7feab813b040 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.817+0000 7feabea00640 1 -- 172.21.15.173:0/3864221370 >> 172.21.15.173:0/3864221370 conn(0x7feab806ac90 msgr2=0x7feab80cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:01.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.817+0000 7feabea00640 1 -- 172.21.15.173:0/3864221370 shutdown_connections 2024-04-25T09:04:01.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.817+0000 7feabea00640 1 -- 172.21.15.173:0/3864221370 wait complete. 2024-04-25T09:04:01.831 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:04:01.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.985+0000 7ffa2dc00640 1 Processor -- start 2024-04-25T09:04:01.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.985+0000 7ffa2dc00640 1 -- start start 2024-04-25T09:04:01.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.985+0000 7ffa2dc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ffa2806e1c0 0x7ffa2806bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:01.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.985+0000 7ffa2dc00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2806ae30 con 0x7ffa280ad5c0 2024-04-25T09:04:01.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.985+0000 7ffa2dc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2806b110 con 0x7ffa2806c410 2024-04-25T09:04:01.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.985+0000 7ffa2dc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa280b3170 con 0x7ffa2806e1c0 2024-04-25T09:04:01.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.985+0000 7ffa27400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ffa280ad5c0 0x7ffa281677c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45172/0 (socket says 172.21.15.173:45172) 2024-04-25T09:04:01.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.985+0000 7ffa27400640 1 -- 172.21.15.173:0/2313342350 learned_addr learned my addr 172.21.15.173:0/2313342350 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:04:01.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.985+0000 7ffa26a00640 1 --2- 172.21.15.173:0/2313342350 >> v2:172.21.15.194:3300/0 conn(0x7ffa2806e1c0 0x7ffa2806bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:01.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.985+0000 7ffa26000640 1 -- 172.21.15.173:0/2313342350 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733814999 0 0) 0x7ffa2806ae30 con 0x7ffa280ad5c0 2024-04-25T09:04:01.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.985+0000 7ffa26000640 1 -- 172.21.15.173:0/2313342350 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa0c003530 con 0x7ffa280ad5c0 2024-04-25T09:04:01.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.985+0000 7ffa26000640 1 -- 172.21.15.173:0/2313342350 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582970877 0 0) 0x7ffa2806b110 con 0x7ffa2806c410 2024-04-25T09:04:01.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.985+0000 7ffa26000640 1 -- 172.21.15.173:0/2313342350 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa2806ae30 con 0x7ffa2806c410 2024-04-25T09:04:01.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.985+0000 7ffa26000640 1 -- 172.21.15.173:0/2313342350 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3332593165 0 0) 0x7ffa0c003530 con 0x7ffa280ad5c0 2024-04-25T09:04:01.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.985+0000 7ffa26a00640 1 -- 172.21.15.173:0/2313342350 >> v1:172.21.15.194:6789/0 conn(0x7ffa2806c410 legacy=0x7ffa280aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:01.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.985+0000 7ffa26a00640 1 -- 172.21.15.173:0/2313342350 >> v1:172.21.15.173:6789/0 conn(0x7ffa280ad5c0 legacy=0x7ffa281677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:01.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.985+0000 7ffa26a00640 1 -- 172.21.15.173:0/2313342350 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2806b3f0 con 0x7ffa2806e1c0 2024-04-25T09:04:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.989+0000 7ffa26a00640 1 --2- 172.21.15.173:0/2313342350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa2806e1c0 0x7ffa2806bed0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffa180097c0 tx=0x7ffa1801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbf15d8116a1be08 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.989+0000 7ffa26000640 1 -- 172.21.15.173:0/2313342350 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180b0070 con 0x7ffa2806e1c0 2024-04-25T09:04:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.989+0000 7ffa26000640 1 -- 172.21.15.173:0/2313342350 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa180ab400 con 0x7ffa2806e1c0 2024-04-25T09:04:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.989+0000 7ffa26000640 1 -- 172.21.15.173:0/2313342350 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa20001a00 con 0x7ffa2806e1c0 2024-04-25T09:04:01.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.989+0000 7ffa2dc00640 1 -- 172.21.15.173:0/2313342350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa2806e1c0 msgr2=0x7ffa2806bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:01.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.989+0000 7ffa2dc00640 1 --2- 172.21.15.173:0/2313342350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa2806e1c0 0x7ffa2806bed0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffa180097c0 tx=0x7ffa1801c3c0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.989+0000 7ffa2dc00640 1 -- 172.21.15.173:0/2313342350 shutdown_connections 2024-04-25T09:04:01.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.989+0000 7ffa2dc00640 1 --2- 172.21.15.173:0/2313342350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa2806e1c0 0x7ffa2806bed0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.989+0000 7ffa2dc00640 1 -- 172.21.15.173:0/2313342350 >> 172.21.15.173:0/2313342350 conn(0x7ffa280cfed0 msgr2=0x7ffa280d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:01.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.989+0000 7ffa2dc00640 1 -- 172.21.15.173:0/2313342350 shutdown_connections 2024-04-25T09:04:01.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.989+0000 7ffa2dc00640 1 -- 172.21.15.173:0/2313342350 wait complete. 2024-04-25T09:04:01.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa2dc00640 1 Processor -- start 2024-04-25T09:04:01.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa2dc00640 1 -- start start 2024-04-25T09:04:01.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa2dc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa2806c410 0x7ffa2814f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:01.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa2dc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa2806e1c0 0x7ffa281f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:01.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa2dc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa280ad5c0 0x7ffa2814d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:01.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa2dc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2816b880 con 0x7ffa280ad5c0 2024-04-25T09:04:01.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa2dc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2816b700 con 0x7ffa2806c410 2024-04-25T09:04:01.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa2dc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2816ba00 con 0x7ffa2806e1c0 2024-04-25T09:04:01.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa27400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa280ad5c0 0x7ffa2814d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:01.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa27400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa280ad5c0 0x7ffa2814d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53590/0 (socket says 172.21.15.173:53590) 2024-04-25T09:04:01.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa27400640 1 -- 172.21.15.173:0/3118896506 learned_addr learned my addr 172.21.15.173:0/3118896506 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:01.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa26a00640 1 --2- 172.21.15.173:0/3118896506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa2806c410 0x7ffa2814f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:01.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa1e000640 1 --2- 172.21.15.173:0/3118896506 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa2806e1c0 0x7ffa281f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:01.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa27400640 1 -- 172.21.15.173:0/3118896506 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa2806e1c0 msgr2=0x7ffa281f7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:01.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa27400640 1 --2- 172.21.15.173:0/3118896506 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa2806e1c0 0x7ffa281f7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa27400640 1 -- 172.21.15.173:0/3118896506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa2806c410 msgr2=0x7ffa2814f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:01.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa27400640 1 --2- 172.21.15.173:0/3118896506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa2806c410 0x7ffa2814f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:01.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa27400640 1 -- 172.21.15.173:0/3118896506 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa280b0630 con 0x7ffa280ad5c0 2024-04-25T09:04:01.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa27400640 1 --2- 172.21.15.173:0/3118896506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa280ad5c0 0x7ffa2814d870 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ffa20001f40 tx=0x7ffa2000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:01.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa1f400640 1 -- 172.21.15.173:0/3118896506 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa20017070 con 0x7ffa280ad5c0 2024-04-25T09:04:01.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa1f400640 1 -- 172.21.15.173:0/3118896506 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa20012400 con 0x7ffa280ad5c0 2024-04-25T09:04:01.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa1f400640 1 -- 172.21.15.173:0/3118896506 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa20012830 con 0x7ffa280ad5c0 2024-04-25T09:04:01.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa2dc00640 1 -- 172.21.15.173:0/3118896506 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa281f82e0 con 0x7ffa280ad5c0 2024-04-25T09:04:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.993+0000 7ffa2dc00640 1 -- 172.21.15.173:0/3118896506 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2814ab70 con 0x7ffa280ad5c0 2024-04-25T09:04:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.997+0000 7ffa2dc00640 1 -- 172.21.15.173:0/3118896506 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa28073ab0 con 0x7ffa280ad5c0 2024-04-25T09:04:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.997+0000 7ffa1f400640 1 -- 172.21.15.173:0/3118896506 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffa2001a070 con 0x7ffa280ad5c0 2024-04-25T09:04:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.997+0000 7ffa1f400640 1 --2- 172.21.15.173:0/3118896506 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa04066f60 0x7ffa04069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:01.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.997+0000 7ffa1f400640 1 -- 172.21.15.173:0/3118896506 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5619+0+0 (secure 0 0 0) 0x7ffa20084f20 con 0x7ffa280ad5c0 2024-04-25T09:04:01.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.997+0000 7ffa26a00640 1 --2- 172.21.15.173:0/3118896506 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa04066f60 0x7ffa04069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:01.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:01.997+0000 7ffa26a00640 1 --2- 172.21.15.173:0/3118896506 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa04066f60 0x7ffa04069420 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffa180ad000 tx=0x7ffa180a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:01.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.001+0000 7ffa1f400640 1 -- 172.21.15.173:0/3118896506 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffa20055920 con 0x7ffa280ad5c0 2024-04-25T09:04:02.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.161+0000 7ffa2dc00640 1 -- 172.21.15.173:0/3118896506 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ffa28152f50 con 0x7ffa280ad5c0 2024-04-25T09:04:02.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.817+0000 7ffa1f400640 1 -- 172.21.15.173:0/3118896506 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) v1 ==== 170+0+0 (secure 0 0 0) 0x7ffa200599c0 con 0x7ffa280ad5c0 2024-04-25T09:04:02.809 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' created 2024-04-25T09:04:02.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.821+0000 7ffa2dc00640 1 -- 172.21.15.173:0/3118896506 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa04066f60 msgr2=0x7ffa04069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.821+0000 7ffa2dc00640 1 --2- 172.21.15.173:0/3118896506 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa04066f60 0x7ffa04069420 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffa180ad000 tx=0x7ffa180a6000 comp rx=0 tx=0).stop 2024-04-25T09:04:02.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.821+0000 7ffa2dc00640 1 -- 172.21.15.173:0/3118896506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa280ad5c0 msgr2=0x7ffa2814d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.821+0000 7ffa2dc00640 1 --2- 172.21.15.173:0/3118896506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa280ad5c0 0x7ffa2814d870 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ffa20001f40 tx=0x7ffa2000a430 comp rx=0 tx=0).stop 2024-04-25T09:04:02.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.821+0000 7ffa2dc00640 1 -- 172.21.15.173:0/3118896506 shutdown_connections 2024-04-25T09:04:02.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.821+0000 7ffa2dc00640 1 --2- 172.21.15.173:0/3118896506 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa04066f60 0x7ffa04069420 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.821+0000 7ffa2dc00640 1 --2- 172.21.15.173:0/3118896506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa280ad5c0 0x7ffa2814d870 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.821+0000 7ffa2dc00640 1 --2- 172.21.15.173:0/3118896506 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa2806e1c0 0x7ffa281f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.821+0000 7ffa2dc00640 1 --2- 172.21.15.173:0/3118896506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa2806c410 0x7ffa2814f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.821+0000 7ffa2dc00640 1 -- 172.21.15.173:0/3118896506 >> 172.21.15.173:0/3118896506 conn(0x7ffa280cfed0 msgr2=0x7ffa280aff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:02.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.821+0000 7ffa2dc00640 1 -- 172.21.15.173:0/3118896506 shutdown_connections 2024-04-25T09:04:02.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.821+0000 7ffa2dc00640 1 -- 172.21.15.173:0/3118896506 wait complete. 2024-04-25T09:04:02.850 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:04:02.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.997+0000 7f6c25a00640 1 Processor -- start 2024-04-25T09:04:02.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.997+0000 7f6c25a00640 1 -- start start 2024-04-25T09:04:02.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.997+0000 7f6c25a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c200cff40 0x7f6c200cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:02.997+0000 7f6c25a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2015ddd0 con 0x7f6c20159f00 2024-04-25T09:04:02.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.001+0000 7f6c25a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2015e0b0 con 0x7f6c2015a2e0 2024-04-25T09:04:02.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.001+0000 7f6c25a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2015e390 con 0x7f6c200cff40 2024-04-25T09:04:02.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.001+0000 7f6c1ea00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f6c20159f00 0x7f6c200cb960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45178/0 (socket says 172.21.15.173:45178) 2024-04-25T09:04:02.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.001+0000 7f6c1ea00640 1 -- 172.21.15.173:0/2296288145 learned_addr learned my addr 172.21.15.173:0/2296288145 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:04:02.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.001+0000 7f6c16000640 1 --2- 172.21.15.173:0/2296288145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c200cff40 0x7f6c200cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.001+0000 7f6c1e000640 1 -- 172.21.15.173:0/2296288145 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527437514 0 0) 0x7f6c2015ddd0 con 0x7f6c20159f00 2024-04-25T09:04:02.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.001+0000 7f6c1e000640 1 -- 172.21.15.173:0/2296288145 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c04003530 con 0x7f6c20159f00 2024-04-25T09:04:02.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.001+0000 7f6c16000640 1 -- 172.21.15.173:0/2296288145 >> v1:172.21.15.194:6789/0 conn(0x7f6c2015a2e0 legacy=0x7f6c20071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.001+0000 7f6c1e000640 1 -- 172.21.15.173:0/2296288145 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1013438841 0 0) 0x7f6c2015e0b0 con 0x7f6c2015a2e0 2024-04-25T09:04:02.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.001+0000 7f6c16000640 1 -- 172.21.15.173:0/2296288145 >> v1:172.21.15.173:6789/0 conn(0x7f6c20159f00 legacy=0x7f6c200cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.001+0000 7f6c16000640 1 -- 172.21.15.173:0/2296288145 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2015e670 con 0x7f6c200cff40 2024-04-25T09:04:02.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.001+0000 7f6c16000640 1 --2- 172.21.15.173:0/2296288145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c200cff40 0x7f6c200cd2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6c080097f0 tx=0x7f6c0801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f11ee86b03e1b965 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:02.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c1e000640 1 -- 172.21.15.173:0/2296288145 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c080ab5f0 con 0x7f6c200cff40 2024-04-25T09:04:02.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c1e000640 1 -- 172.21.15.173:0/2296288145 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c080b0070 con 0x7f6c200cff40 2024-04-25T09:04:02.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c1e000640 1 -- 172.21.15.173:0/2296288145 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c080ab9b0 con 0x7f6c200cff40 2024-04-25T09:04:02.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c25a00640 1 -- 172.21.15.173:0/2296288145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c200cff40 msgr2=0x7f6c200cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c25a00640 1 --2- 172.21.15.173:0/2296288145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c200cff40 0x7f6c200cd2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6c080097f0 tx=0x7f6c0801c4e0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c25a00640 1 -- 172.21.15.173:0/2296288145 shutdown_connections 2024-04-25T09:04:02.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c25a00640 1 --2- 172.21.15.173:0/2296288145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c200cff40 0x7f6c200cd2f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c25a00640 1 -- 172.21.15.173:0/2296288145 >> 172.21.15.173:0/2296288145 conn(0x7f6c2006ac90 msgr2=0x7f6c2006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:02.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c25a00640 1 -- 172.21.15.173:0/2296288145 shutdown_connections 2024-04-25T09:04:02.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c25a00640 1 -- 172.21.15.173:0/2296288145 wait complete. 2024-04-25T09:04:02.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c25a00640 1 Processor -- start 2024-04-25T09:04:02.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c25a00640 1 -- start start 2024-04-25T09:04:02.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c25a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c200cff40 0x7f6c20146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c25a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c20159f00 0x7f6c2015cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c25a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c2015a2e0 0x7f6c2015cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:02.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c25a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c20071e00 con 0x7f6c2015a2e0 2024-04-25T09:04:02.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c25a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c20071c80 con 0x7f6c20159f00 2024-04-25T09:04:02.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c25a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c20071f80 con 0x7f6c200cff40 2024-04-25T09:04:02.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c1f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c2015a2e0 0x7f6c2015cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c1ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c200cff40 0x7f6c20146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c1f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c2015a2e0 0x7f6c2015cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53592/0 (socket says 172.21.15.173:53592) 2024-04-25T09:04:02.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c1f400640 1 -- 172.21.15.173:0/165110717 learned_addr learned my addr 172.21.15.173:0/165110717 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:02.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.005+0000 7f6c16000640 1 --2- 172.21.15.173:0/165110717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c20159f00 0x7f6c2015cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:02.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.009+0000 7f6c1f400640 1 -- 172.21.15.173:0/165110717 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c200cff40 msgr2=0x7f6c20146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.009+0000 7f6c1f400640 1 --2- 172.21.15.173:0/165110717 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c200cff40 0x7f6c20146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.009+0000 7f6c1f400640 1 -- 172.21.15.173:0/165110717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c20159f00 msgr2=0x7f6c2015cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:02.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.009+0000 7f6c1f400640 1 --2- 172.21.15.173:0/165110717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c20159f00 0x7f6c2015cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:02.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.009+0000 7f6c1f400640 1 -- 172.21.15.173:0/165110717 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c20169030 con 0x7f6c2015a2e0 2024-04-25T09:04:02.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.009+0000 7f6c1f400640 1 --2- 172.21.15.173:0/165110717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c2015a2e0 0x7f6c2015cff0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800c780 tx=0x7f6c1800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:02.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.009+0000 7f6c17400640 1 -- 172.21.15.173:0/165110717 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c18003db0 con 0x7f6c2015a2e0 2024-04-25T09:04:03.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.009+0000 7f6c17400640 1 -- 172.21.15.173:0/165110717 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1800ce30 con 0x7f6c2015a2e0 2024-04-25T09:04:03.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.009+0000 7f6c25a00640 1 -- 172.21.15.173:0/165110717 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c2015d670 con 0x7f6c2015a2e0 2024-04-25T09:04:03.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.009+0000 7f6c17400640 1 -- 172.21.15.173:0/165110717 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c18005290 con 0x7f6c2015a2e0 2024-04-25T09:04:03.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.009+0000 7f6c25a00640 1 -- 172.21.15.173:0/165110717 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2015aeb0 con 0x7f6c2015a2e0 2024-04-25T09:04:03.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.009+0000 7f6c25a00640 1 -- 172.21.15.173:0/165110717 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c20073ab0 con 0x7f6c2015a2e0 2024-04-25T09:04:03.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.009+0000 7f6c17400640 1 -- 172.21.15.173:0/165110717 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6c18005430 con 0x7f6c2015a2e0 2024-04-25T09:04:03.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.009+0000 7f6c17400640 1 --2- 172.21.15.173:0/165110717 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6bfc066f60 0x7f6bfc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.009+0000 7f6c17400640 1 -- 172.21.15.173:0/165110717 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f6c18085880 con 0x7f6c2015a2e0 2024-04-25T09:04:03.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.013+0000 7f6c1ea00640 1 --2- 172.21.15.173:0/165110717 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6bfc066f60 0x7f6bfc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.013+0000 7f6c1ea00640 1 --2- 172.21.15.173:0/165110717 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6bfc066f60 0x7f6bfc069420 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6c10007fd0 tx=0x7f6c10009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.013+0000 7f6c17400640 1 -- 172.21.15.173:0/165110717 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6c2015d670 con 0x7f6c2015a2e0 2024-04-25T09:04:03.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.201+0000 7f6c25a00640 1 -- 172.21.15.173:0/165110717 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6c200ccb20 con 0x7f6c2015a2e0 2024-04-25T09:04:03.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.821+0000 7f6c17400640 1 -- 172.21.15.173:0/165110717 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6c18056280 con 0x7f6c2015a2e0 2024-04-25T09:04:03.811 INFO:teuthology.orchestra.run.smithi173.stderr:new fs with metadata pool 5 and data pool 6 2024-04-25T09:04:03.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.825+0000 7f6c25a00640 1 -- 172.21.15.173:0/165110717 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6bfc066f60 msgr2=0x7f6bfc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.825+0000 7f6c25a00640 1 --2- 172.21.15.173:0/165110717 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6bfc066f60 0x7f6bfc069420 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6c10007fd0 tx=0x7f6c10009040 comp rx=0 tx=0).stop 2024-04-25T09:04:03.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.825+0000 7f6c25a00640 1 -- 172.21.15.173:0/165110717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c2015a2e0 msgr2=0x7f6c2015cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.825+0000 7f6c25a00640 1 --2- 172.21.15.173:0/165110717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c2015a2e0 0x7f6c2015cff0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800c780 tx=0x7f6c1800cc40 comp rx=0 tx=0).stop 2024-04-25T09:04:03.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.825+0000 7f6c25a00640 1 -- 172.21.15.173:0/165110717 shutdown_connections 2024-04-25T09:04:03.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.825+0000 7f6c25a00640 1 --2- 172.21.15.173:0/165110717 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6bfc066f60 0x7f6bfc069420 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.825+0000 7f6c25a00640 1 --2- 172.21.15.173:0/165110717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c2015a2e0 0x7f6c2015cff0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.825+0000 7f6c25a00640 1 --2- 172.21.15.173:0/165110717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c20159f00 0x7f6c2015cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.825+0000 7f6c25a00640 1 --2- 172.21.15.173:0/165110717 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c200cff40 0x7f6c20146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.825+0000 7f6c25a00640 1 -- 172.21.15.173:0/165110717 >> 172.21.15.173:0/165110717 conn(0x7f6c2006ac90 msgr2=0x7f6c200cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.825+0000 7f6c25a00640 1 -- 172.21.15.173:0/165110717 shutdown_connections 2024-04-25T09:04:03.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:03.825+0000 7f6c25a00640 1 -- 172.21.15.173:0/165110717 wait complete. 2024-04-25T09:04:03.861 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:03.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.009+0000 7f6931c00640 1 Processor -- start 2024-04-25T09:04:03.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.009+0000 7f6931c00640 1 -- start start 2024-04-25T09:04:04.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.009+0000 7f6931c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f692c160fe0 0x7f692c161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.009+0000 7f6931c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f692c06dac0 0x7f692c0ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.009+0000 7f6931c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692c061d60 con 0x7f692c06bca0 2024-04-25T09:04:04.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.009+0000 7f6931c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692c1613c0 con 0x7f692c160fe0 2024-04-25T09:04:04.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.009+0000 7f6931c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692c06dfa0 con 0x7f692c06dac0 2024-04-25T09:04:04.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.009+0000 7f692aa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f692c160fe0 0x7f692c161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.009+0000 7f692b400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f692c06bca0 0x7f692c06f040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:43056/0 (socket says 172.21.15.173:43056) 2024-04-25T09:04:04.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.009+0000 7f692b400640 1 -- 172.21.15.173:0/1936404212 learned_addr learned my addr 172.21.15.173:0/1936404212 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:04:04.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.009+0000 7f692a000640 1 --2- 172.21.15.173:0/1936404212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f692c06dac0 0x7f692c0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.009+0000 7f692aa00640 1 -- 172.21.15.173:0/1936404212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f692c06dac0 msgr2=0x7f692c0ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:04.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.009+0000 7f692aa00640 1 --2- 172.21.15.173:0/1936404212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f692c06dac0 0x7f692c0ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.009+0000 7f692aa00640 1 -- 172.21.15.173:0/1936404212 >> v1:172.21.15.173:6789/0 conn(0x7f692c06bca0 legacy=0x7f692c06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.009+0000 7f692aa00640 1 -- 172.21.15.173:0/1936404212 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c06e280 con 0x7f692c160fe0 2024-04-25T09:04:04.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.013+0000 7f692aa00640 1 --2- 172.21.15.173:0/1936404212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692c160fe0 0x7f692c161fb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f691c009d90 tx=0x7f691c01c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6e7f4d77193b9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:04.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.013+0000 7f6929600640 1 -- 172.21.15.173:0/1936404212 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c0b2070 con 0x7f692c160fe0 2024-04-25T09:04:04.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.013+0000 7f6929600640 1 -- 172.21.15.173:0/1936404212 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c0a5790 con 0x7f692c160fe0 2024-04-25T09:04:04.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.013+0000 7f6929600640 1 -- 172.21.15.173:0/1936404212 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c0a5b60 con 0x7f692c160fe0 2024-04-25T09:04:04.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.013+0000 7f6931c00640 1 -- 172.21.15.173:0/1936404212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692c160fe0 msgr2=0x7f692c161fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.013+0000 7f6931c00640 1 --2- 172.21.15.173:0/1936404212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692c160fe0 0x7f692c161fb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f691c009d90 tx=0x7f691c01c770 comp rx=0 tx=0).stop 2024-04-25T09:04:04.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.013+0000 7f6931c00640 1 -- 172.21.15.173:0/1936404212 shutdown_connections 2024-04-25T09:04:04.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.013+0000 7f6931c00640 1 --2- 172.21.15.173:0/1936404212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f692c06dac0 0x7f692c0ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.013+0000 7f6931c00640 1 --2- 172.21.15.173:0/1936404212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692c160fe0 0x7f692c161fb0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.013+0000 7f6931c00640 1 -- 172.21.15.173:0/1936404212 >> 172.21.15.173:0/1936404212 conn(0x7f692c071c20 msgr2=0x7f692c072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:04.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.013+0000 7f6931c00640 1 -- 172.21.15.173:0/1936404212 shutdown_connections 2024-04-25T09:04:04.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.013+0000 7f6931c00640 1 -- 172.21.15.173:0/1936404212 wait complete. 2024-04-25T09:04:04.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f6931c00640 1 Processor -- start 2024-04-25T09:04:04.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f6931c00640 1 -- start start 2024-04-25T09:04:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f6931c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692c06bca0 0x7f692c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f6931c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f692c06dac0 0x7f692c1484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f6931c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f692c160fe0 0x7f692c148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f6931c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c06eb20 con 0x7f692c06bca0 2024-04-25T09:04:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f6931c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c06e840 con 0x7f692c06dac0 2024-04-25T09:04:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f6931c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692c1624f0 con 0x7f692c160fe0 2024-04-25T09:04:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f692aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692c06bca0 0x7f692c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f692aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692c06bca0 0x7f692c15ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50302/0 (socket says 172.21.15.173:50302) 2024-04-25T09:04:04.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f692aa00640 1 -- 172.21.15.173:0/4191944368 learned_addr learned my addr 172.21.15.173:0/4191944368 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:04.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f692a000640 1 --2- 172.21.15.173:0/4191944368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f692c06dac0 0x7f692c1484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f692b400640 1 --2- 172.21.15.173:0/4191944368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f692c160fe0 0x7f692c148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f692aa00640 1 -- 172.21.15.173:0/4191944368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f692c160fe0 msgr2=0x7f692c148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f692aa00640 1 --2- 172.21.15.173:0/4191944368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f692c160fe0 0x7f692c148a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f692aa00640 1 -- 172.21.15.173:0/4191944368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f692c06dac0 msgr2=0x7f692c1484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f692aa00640 1 --2- 172.21.15.173:0/4191944368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f692c06dac0 0x7f692c1484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f692aa00640 1 -- 172.21.15.173:0/4191944368 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c160390 con 0x7f692c06bca0 2024-04-25T09:04:04.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f692a000640 1 --2- 172.21.15.173:0/4191944368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f692c06dac0 0x7f692c1484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:04.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f692aa00640 1 --2- 172.21.15.173:0/4191944368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692c06bca0 0x7f692c15ca30 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f691c01ae20 tx=0x7f691c019510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:04.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f6922a00640 1 -- 172.21.15.173:0/4191944368 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c0b2050 con 0x7f692c06bca0 2024-04-25T09:04:04.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f6922a00640 1 -- 172.21.15.173:0/4191944368 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c0be070 con 0x7f692c06bca0 2024-04-25T09:04:04.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f6922a00640 1 -- 172.21.15.173:0/4191944368 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c009450 con 0x7f692c06bca0 2024-04-25T09:04:04.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f6931c00640 1 -- 172.21.15.173:0/4191944368 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692c160670 con 0x7f692c06bca0 2024-04-25T09:04:04.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f6931c00640 1 -- 172.21.15.173:0/4191944368 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692c157e60 con 0x7f692c06bca0 2024-04-25T09:04:04.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.017+0000 7f6931c00640 1 -- 172.21.15.173:0/4191944368 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692c073a40 con 0x7f692c06bca0 2024-04-25T09:04:04.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.021+0000 7f6922a00640 1 -- 172.21.15.173:0/4191944368 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f691c0c3460 con 0x7f692c06bca0 2024-04-25T09:04:04.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.021+0000 7f6922a00640 1 --2- 172.21.15.173:0/4191944368 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6908066f60 0x7f6908069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.021+0000 7f6922a00640 1 -- 172.21.15.173:0/4191944368 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f691c1206f0 con 0x7f692c06bca0 2024-04-25T09:04:04.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.021+0000 7f692a000640 1 --2- 172.21.15.173:0/4191944368 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6908066f60 0x7f6908069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.021+0000 7f692a000640 1 --2- 172.21.15.173:0/4191944368 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6908066f60 0x7f6908069420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f692c156220 tx=0x7f6914008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:04.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.025+0000 7f6922a00640 1 -- 172.21.15.173:0/4191944368 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f691c016480 con 0x7f692c06bca0 2024-04-25T09:04:04.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.189+0000 7f6931c00640 1 -- 172.21.15.173:0/4191944368 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f692c0cfc10 con 0x7f692c06bca0 2024-04-25T09:04:04.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.189+0000 7f6922a00640 1 -- 172.21.15.173:0/4191944368 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+17015 (secure 0 0 0) 0x7f691c0f14d0 con 0x7f692c06bca0 2024-04-25T09:04:04.181 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:04:04.181 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":39,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:04:03.205538+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:00.889429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:02.209182+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:04.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.193+0000 7f6931c00640 1 -- 172.21.15.173:0/4191944368 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6908066f60 msgr2=0x7f6908069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.193+0000 7f6931c00640 1 --2- 172.21.15.173:0/4191944368 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6908066f60 0x7f6908069420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f692c156220 tx=0x7f6914008040 comp rx=0 tx=0).stop 2024-04-25T09:04:04.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.193+0000 7f6931c00640 1 -- 172.21.15.173:0/4191944368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692c06bca0 msgr2=0x7f692c15ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.193+0000 7f6931c00640 1 --2- 172.21.15.173:0/4191944368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692c06bca0 0x7f692c15ca30 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f691c01ae20 tx=0x7f691c019510 comp rx=0 tx=0).stop 2024-04-25T09:04:04.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.193+0000 7f6931c00640 1 -- 172.21.15.173:0/4191944368 shutdown_connections 2024-04-25T09:04:04.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.193+0000 7f6931c00640 1 --2- 172.21.15.173:0/4191944368 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6908066f60 0x7f6908069420 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.193+0000 7f6931c00640 1 --2- 172.21.15.173:0/4191944368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f692c160fe0 0x7f692c148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.193+0000 7f6931c00640 1 --2- 172.21.15.173:0/4191944368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f692c06dac0 0x7f692c1484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.193+0000 7f6931c00640 1 --2- 172.21.15.173:0/4191944368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692c06bca0 0x7f692c15ca30 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.193+0000 7f6931c00640 1 -- 172.21.15.173:0/4191944368 >> 172.21.15.173:0/4191944368 conn(0x7f692c071c20 msgr2=0x7f692c0b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:04.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.193+0000 7f6931c00640 1 -- 172.21.15.173:0/4191944368 shutdown_connections 2024-04-25T09:04:04.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.193+0000 7f6931c00640 1 -- 172.21.15.173:0/4191944368 wait complete. 2024-04-25T09:04:04.202 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:04.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.349+0000 7faee0600640 1 Processor -- start 2024-04-25T09:04:04.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.349+0000 7faee0600640 1 -- start start 2024-04-25T09:04:04.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.349+0000 7faee0600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faed81583f0 0x7faed80d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.349+0000 7faee0600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7faed8162210 0x7faed80d1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.349+0000 7faee0600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed80cc080 con 0x7faed80cce20 2024-04-25T09:04:04.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.349+0000 7faee0600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed8162650 con 0x7faed8162210 2024-04-25T09:04:04.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.349+0000 7faee0600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed8162870 con 0x7faed81583f0 2024-04-25T09:04:04.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.349+0000 7faede600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7faed8162210 0x7faed80d1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.349+0000 7faede600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7faed8162210 0x7faed80d1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50318/0 (socket says 172.21.15.173:50318) 2024-04-25T09:04:04.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.349+0000 7faede600640 1 -- 172.21.15.173:0/1899347677 learned_addr learned my addr 172.21.15.173:0/1899347677 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:04.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.349+0000 7faeddc00640 1 --2- 172.21.15.173:0/1899347677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faed81583f0 0x7faed80d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.349+0000 7faede600640 1 -- 172.21.15.173:0/1899347677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faed81583f0 msgr2=0x7faed80d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:04.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.349+0000 7faede600640 1 --2- 172.21.15.173:0/1899347677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faed81583f0 0x7faed80d17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.349+0000 7faede600640 1 -- 172.21.15.173:0/1899347677 >> v1:172.21.15.194:6789/0 conn(0x7faed80cce20 legacy=0x7faed8161b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.349+0000 7faede600640 1 -- 172.21.15.173:0/1899347677 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed80cc340 con 0x7faed8162210 2024-04-25T09:04:04.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.353+0000 7faede600640 1 --2- 172.21.15.173:0/1899347677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faed8162210 0x7faed80d1cf0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7faed0009870 tx=0x7faed001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3fa47cf194f484 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:04.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.353+0000 7faed7e00640 1 -- 172.21.15.173:0/1899347677 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed00a9610 con 0x7faed8162210 2024-04-25T09:04:04.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.353+0000 7faed7e00640 1 -- 172.21.15.173:0/1899347677 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed00a97b0 con 0x7faed8162210 2024-04-25T09:04:04.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.353+0000 7faed7e00640 1 -- 172.21.15.173:0/1899347677 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed00a9b80 con 0x7faed8162210 2024-04-25T09:04:04.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.353+0000 7faee0600640 1 -- 172.21.15.173:0/1899347677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faed8162210 msgr2=0x7faed80d1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.353+0000 7faee0600640 1 --2- 172.21.15.173:0/1899347677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faed8162210 0x7faed80d1cf0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7faed0009870 tx=0x7faed001c530 comp rx=0 tx=0).stop 2024-04-25T09:04:04.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.353+0000 7faee0600640 1 -- 172.21.15.173:0/1899347677 shutdown_connections 2024-04-25T09:04:04.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.353+0000 7faee0600640 1 --2- 172.21.15.173:0/1899347677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faed8162210 0x7faed80d1cf0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.353+0000 7faee0600640 1 --2- 172.21.15.173:0/1899347677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faed81583f0 0x7faed80d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.353+0000 7faee0600640 1 -- 172.21.15.173:0/1899347677 >> 172.21.15.173:0/1899347677 conn(0x7faed806f600 msgr2=0x7faed806fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:04.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.353+0000 7faee0600640 1 -- 172.21.15.173:0/1899347677 shutdown_connections 2024-04-25T09:04:04.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.353+0000 7faee0600640 1 -- 172.21.15.173:0/1899347677 wait complete. 2024-04-25T09:04:04.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faee0600640 1 Processor -- start 2024-04-25T09:04:04.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faee0600640 1 -- start start 2024-04-25T09:04:04.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faee0600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faed80cce20 0x7faed814fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faee0600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faed81583f0 0x7faed815ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faee0600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed8162210 0x7faed8160b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faee0600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed80cea70 con 0x7faed81583f0 2024-04-25T09:04:04.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faee0600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed80ce8f0 con 0x7faed8162210 2024-04-25T09:04:04.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faee0600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed80cebf0 con 0x7faed80cce20 2024-04-25T09:04:04.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faedd200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faed81583f0 0x7faed815ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faedd200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faed81583f0 0x7faed815ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50324/0 (socket says 172.21.15.173:50324) 2024-04-25T09:04:04.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faedd200640 1 -- 172.21.15.173:0/227403634 learned_addr learned my addr 172.21.15.173:0/227403634 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faeddc00640 1 --2- 172.21.15.173:0/227403634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faed80cce20 0x7faed814fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faede600640 1 --2- 172.21.15.173:0/227403634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed8162210 0x7faed8160b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faedd200640 1 -- 172.21.15.173:0/227403634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faed80cce20 msgr2=0x7faed814fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faedd200640 1 --2- 172.21.15.173:0/227403634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faed80cce20 0x7faed814fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faedd200640 1 -- 172.21.15.173:0/227403634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed8162210 msgr2=0x7faed8160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faedd200640 1 --2- 172.21.15.173:0/227403634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed8162210 0x7faed8160b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faedd200640 1 -- 172.21.15.173:0/227403634 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed81502b0 con 0x7faed81583f0 2024-04-25T09:04:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faedd200640 1 --2- 172.21.15.173:0/227403634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faed81583f0 0x7faed815ef20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7faec400c420 tx=0x7faec400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faed5600640 1 -- 172.21.15.173:0/227403634 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec40052d0 con 0x7faed81583f0 2024-04-25T09:04:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faed5600640 1 -- 172.21.15.173:0/227403634 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec4005470 con 0x7faed81583f0 2024-04-25T09:04:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faee0600640 1 -- 172.21.15.173:0/227403634 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed80c6a90 con 0x7faed81583f0 2024-04-25T09:04:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faed5600640 1 -- 172.21.15.173:0/227403634 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4007260 con 0x7faed81583f0 2024-04-25T09:04:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faee0600640 1 -- 172.21.15.173:0/227403634 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed80c7050 con 0x7faed81583f0 2024-04-25T09:04:04.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.357+0000 7faee0600640 1 -- 172.21.15.173:0/227403634 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed8073a40 con 0x7faed81583f0 2024-04-25T09:04:04.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.361+0000 7faed5600640 1 -- 172.21.15.173:0/227403634 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faec4007400 con 0x7faed81583f0 2024-04-25T09:04:04.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.361+0000 7faed5600640 1 --2- 172.21.15.173:0/227403634 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faeb8066f60 0x7faeb8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.361+0000 7faed5600640 1 -- 172.21.15.173:0/227403634 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faec40846c0 con 0x7faed81583f0 2024-04-25T09:04:04.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.361+0000 7faeddc00640 1 --2- 172.21.15.173:0/227403634 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faeb8066f60 0x7faeb8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.361+0000 7faeddc00640 1 --2- 172.21.15.173:0/227403634 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faeb8066f60 0x7faeb8069420 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faed8168d80 tx=0x7faecc0098a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:04.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.365+0000 7faed5600640 1 -- 172.21.15.173:0/227403634 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faec4054e50 con 0x7faed81583f0 2024-04-25T09:04:04.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.517+0000 7faee0600640 1 -- 172.21.15.173:0/227403634 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faed80cf650 con 0x7faed81583f0 2024-04-25T09:04:04.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.521+0000 7faed5600640 1 -- 172.21.15.173:0/227403634 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+17015 (secure 0 0 0) 0x7faec4082e20 con 0x7faed81583f0 2024-04-25T09:04:04.511 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:04:04.511 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":39,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:04:03.205538+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:00.889429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:02.209182+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:04.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.521+0000 7faee0600640 1 -- 172.21.15.173:0/227403634 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faeb8066f60 msgr2=0x7faeb8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.521+0000 7faee0600640 1 --2- 172.21.15.173:0/227403634 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faeb8066f60 0x7faeb8069420 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faed8168d80 tx=0x7faecc0098a0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.521+0000 7faee0600640 1 -- 172.21.15.173:0/227403634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faed81583f0 msgr2=0x7faed815ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.521+0000 7faee0600640 1 --2- 172.21.15.173:0/227403634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faed81583f0 0x7faed815ef20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7faec400c420 tx=0x7faec400c8e0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.521+0000 7faee0600640 1 -- 172.21.15.173:0/227403634 shutdown_connections 2024-04-25T09:04:04.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.521+0000 7faee0600640 1 --2- 172.21.15.173:0/227403634 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faeb8066f60 0x7faeb8069420 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.521+0000 7faee0600640 1 --2- 172.21.15.173:0/227403634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed8162210 0x7faed8160b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.521+0000 7faee0600640 1 --2- 172.21.15.173:0/227403634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faed81583f0 0x7faed815ef20 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.521+0000 7faee0600640 1 --2- 172.21.15.173:0/227403634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faed80cce20 0x7faed814fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.521+0000 7faee0600640 1 -- 172.21.15.173:0/227403634 >> 172.21.15.173:0/227403634 conn(0x7faed806f600 msgr2=0x7faed80b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:04.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.521+0000 7faee0600640 1 -- 172.21.15.173:0/227403634 shutdown_connections 2024-04-25T09:04:04.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.521+0000 7faee0600640 1 -- 172.21.15.173:0/227403634 wait complete. 2024-04-25T09:04:04.532 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:04:04.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.681+0000 7f34c5600640 1 Processor -- start 2024-04-25T09:04:04.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.681+0000 7f34c5600640 1 -- start start 2024-04-25T09:04:04.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.681+0000 7f34c5600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f34c00b3fe0 0x7f34c00b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.681+0000 7f34c5600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f34c00cc260 0x7f34c00cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.681+0000 7f34c5600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c006d4b0 con 0x7f34c0145290 2024-04-25T09:04:04.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.681+0000 7f34c5600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c006d790 con 0x7f34c00cc260 2024-04-25T09:04:04.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.681+0000 7f34c5600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c006da70 con 0x7f34c00b3fe0 2024-04-25T09:04:04.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.681+0000 7f34bf400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f34c00cc260 0x7f34c00cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.681+0000 7f34bf400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f34c00cc260 0x7f34c00cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50332/0 (socket says 172.21.15.173:50332) 2024-04-25T09:04:04.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.681+0000 7f34bf400640 1 -- 172.21.15.173:0/1140960926 learned_addr learned my addr 172.21.15.173:0/1140960926 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:04.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.681+0000 7f34bf400640 1 -- 172.21.15.173:0/1140960926 >> v2:172.21.15.194:3300/0 conn(0x7f34c00b3fe0 msgr2=0x7f34c00b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:04.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.681+0000 7f34b6000640 1 --2- 172.21.15.173:0/1140960926 >> v2:172.21.15.194:3300/0 conn(0x7f34c00b3fe0 0x7f34c00b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.681+0000 7f34bf400640 1 --2- 172.21.15.173:0/1140960926 >> v2:172.21.15.194:3300/0 conn(0x7f34c00b3fe0 0x7f34c00b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.681+0000 7f34bf400640 1 -- 172.21.15.173:0/1140960926 >> v1:172.21.15.194:6789/0 conn(0x7f34c0145290 legacy=0x7f34c015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:04.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.681+0000 7f34bf400640 1 -- 172.21.15.173:0/1140960926 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c006dd50 con 0x7f34c00cc260 2024-04-25T09:04:04.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.681+0000 7f34b6000640 1 --2- 172.21.15.173:0/1140960926 >> v2:172.21.15.194:3300/0 conn(0x7f34c00b3fe0 0x7f34c00b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:04.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.685+0000 7f34bf400640 1 --2- 172.21.15.173:0/1140960926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34c00cc260 0x7f34c00cc670 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f34c0071100 tx=0x7f34b801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32694af273ca789b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:04.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.685+0000 7f34be000640 1 -- 172.21.15.173:0/1140960926 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b80a5660 con 0x7f34c00cc260 2024-04-25T09:04:04.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.685+0000 7f34be000640 1 -- 172.21.15.173:0/1140960926 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b80a5800 con 0x7f34c00cc260 2024-04-25T09:04:04.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.685+0000 7f34be000640 1 -- 172.21.15.173:0/1140960926 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b80a5bd0 con 0x7f34c00cc260 2024-04-25T09:04:04.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.685+0000 7f34c5600640 1 -- 172.21.15.173:0/1140960926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34c00cc260 msgr2=0x7f34c00cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.685+0000 7f34c5600640 1 --2- 172.21.15.173:0/1140960926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34c00cc260 0x7f34c00cc670 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f34c0071100 tx=0x7f34b801c890 comp rx=0 tx=0).stop 2024-04-25T09:04:04.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.685+0000 7f34c5600640 1 -- 172.21.15.173:0/1140960926 shutdown_connections 2024-04-25T09:04:04.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.685+0000 7f34c5600640 1 --2- 172.21.15.173:0/1140960926 >> v2:172.21.15.194:3300/0 conn(0x7f34c00b3fe0 0x7f34c00b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.685+0000 7f34c5600640 1 --2- 172.21.15.173:0/1140960926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34c00cc260 0x7f34c00cc670 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.685+0000 7f34c5600640 1 -- 172.21.15.173:0/1140960926 >> 172.21.15.173:0/1140960926 conn(0x7f34c006ac90 msgr2=0x7f34c006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:04.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.685+0000 7f34c5600640 1 -- 172.21.15.173:0/1140960926 shutdown_connections 2024-04-25T09:04:04.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.685+0000 7f34c5600640 1 -- 172.21.15.173:0/1140960926 wait complete. 2024-04-25T09:04:04.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34c5600640 1 Processor -- start 2024-04-25T09:04:04.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34c5600640 1 -- start start 2024-04-25T09:04:04.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34c5600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34c00b3fe0 0x7f34c015b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34c5600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34c00cc260 0x7f34c013fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34c5600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34c0145290 0x7f34c00ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34c5600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c006eee0 con 0x7f34c0145290 2024-04-25T09:04:04.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34c5600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c006ed60 con 0x7f34c00b3fe0 2024-04-25T09:04:04.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34c5600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c006f060 con 0x7f34c00cc260 2024-04-25T09:04:04.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34bf400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34c0145290 0x7f34c00ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34bf400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34c0145290 0x7f34c00ada40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50338/0 (socket says 172.21.15.173:50338) 2024-04-25T09:04:04.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34bf400640 1 -- 172.21.15.173:0/3416566645 learned_addr learned my addr 172.21.15.173:0/3416566645 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:04.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34b6000640 1 --2- 172.21.15.173:0/3416566645 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34c00cc260 0x7f34c013fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34bea00640 1 --2- 172.21.15.173:0/3416566645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34c00b3fe0 0x7f34c015b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34bf400640 1 -- 172.21.15.173:0/3416566645 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34c00cc260 msgr2=0x7f34c013fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34bf400640 1 --2- 172.21.15.173:0/3416566645 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34c00cc260 0x7f34c013fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34bf400640 1 -- 172.21.15.173:0/3416566645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34c00b3fe0 msgr2=0x7f34c015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34bf400640 1 --2- 172.21.15.173:0/3416566645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34c00b3fe0 0x7f34c015b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34bf400640 1 -- 172.21.15.173:0/3416566645 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c015bec0 con 0x7f34c0145290 2024-04-25T09:04:04.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34bf400640 1 --2- 172.21.15.173:0/3416566645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34c0145290 0x7f34c00ada40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f34b801a4c0 tx=0x7f34b8019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:04.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34b7400640 1 -- 172.21.15.173:0/3416566645 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b80bc020 con 0x7f34c0145290 2024-04-25T09:04:04.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34b7400640 1 -- 172.21.15.173:0/3416566645 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b80b8670 con 0x7f34c0145290 2024-04-25T09:04:04.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34c5600640 1 -- 172.21.15.173:0/3416566645 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c0140660 con 0x7f34c0145290 2024-04-25T09:04:04.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34b7400640 1 -- 172.21.15.173:0/3416566645 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b80b8a60 con 0x7f34c0145290 2024-04-25T09:04:04.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.689+0000 7f34c5600640 1 -- 172.21.15.173:0/3416566645 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c0140c20 con 0x7f34c0145290 2024-04-25T09:04:04.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.693+0000 7f34c5600640 1 -- 172.21.15.173:0/3416566645 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c0073ab0 con 0x7f34c0145290 2024-04-25T09:04:04.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.693+0000 7f34b7400640 1 -- 172.21.15.173:0/3416566645 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f34b80bf020 con 0x7f34c0145290 2024-04-25T09:04:04.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.693+0000 7f34b7400640 1 --2- 172.21.15.173:0/3416566645 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f349c066f60 0x7f349c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.693+0000 7f34b7400640 1 -- 172.21.15.173:0/3416566645 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f34b811ffc0 con 0x7f34c0145290 2024-04-25T09:04:04.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.693+0000 7f34bea00640 1 --2- 172.21.15.173:0/3416566645 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f349c066f60 0x7f349c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.693+0000 7f34bea00640 1 --2- 172.21.15.173:0/3416566645 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f349c066f60 0x7f349c069420 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f34b00098e0 tx=0x7f34b0009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:04.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.697+0000 7f34b7400640 1 -- 172.21.15.173:0/3416566645 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f34b80c6030 con 0x7f34c0145290 2024-04-25T09:04:04.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:04.889+0000 7f34c5600640 1 -- 172.21.15.173:0/3416566645 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f34c0140e60 con 0x7f34c0145290 2024-04-25T09:04:05.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:05.841+0000 7f34b7400640 1 -- 172.21.15.173:0/3416566645 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f34b80165a0 con 0x7f34c0145290 2024-04-25T09:04:05.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:05.845+0000 7f34c5600640 1 -- 172.21.15.173:0/3416566645 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f349c066f60 msgr2=0x7f349c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:05.845+0000 7f34c5600640 1 --2- 172.21.15.173:0/3416566645 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f349c066f60 0x7f349c069420 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f34b00098e0 tx=0x7f34b0009060 comp rx=0 tx=0).stop 2024-04-25T09:04:05.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:05.845+0000 7f34c5600640 1 -- 172.21.15.173:0/3416566645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34c0145290 msgr2=0x7f34c00ada40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:05.845+0000 7f34c5600640 1 --2- 172.21.15.173:0/3416566645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34c0145290 0x7f34c00ada40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f34b801a4c0 tx=0x7f34b8019630 comp rx=0 tx=0).stop 2024-04-25T09:04:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:05.845+0000 7f34c5600640 1 -- 172.21.15.173:0/3416566645 shutdown_connections 2024-04-25T09:04:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:05.845+0000 7f34c5600640 1 --2- 172.21.15.173:0/3416566645 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f349c066f60 0x7f349c069420 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:05.845+0000 7f34c5600640 1 --2- 172.21.15.173:0/3416566645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34c0145290 0x7f34c00ada40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:05.845+0000 7f34c5600640 1 --2- 172.21.15.173:0/3416566645 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34c00cc260 0x7f34c013fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:05.845+0000 7f34c5600640 1 --2- 172.21.15.173:0/3416566645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34c00b3fe0 0x7f34c015b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:05.845+0000 7f34c5600640 1 -- 172.21.15.173:0/3416566645 >> 172.21.15.173:0/3416566645 conn(0x7f34c006ac90 msgr2=0x7f34c00cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:05.845+0000 7f34c5600640 1 -- 172.21.15.173:0/3416566645 shutdown_connections 2024-04-25T09:04:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:05.845+0000 7f34c5600640 1 -- 172.21.15.173:0/3416566645 wait complete. 2024-04-25T09:04:05.858 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:04:05.858 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:04:06.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.009+0000 7fed14e00640 1 Processor -- start 2024-04-25T09:04:06.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.009+0000 7fed14e00640 1 -- start start 2024-04-25T09:04:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.009+0000 7fed14e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed10144f10 0x7fed1015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.009+0000 7fed14e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fed101452f0 0x7fed1006ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.009+0000 7fed14e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed100720a0 con 0x7fed100ce420 2024-04-25T09:04:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.009+0000 7fed14e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1015fa40 con 0x7fed101452f0 2024-04-25T09:04:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.009+0000 7fed14e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed10071490 con 0x7fed10144f10 2024-04-25T09:04:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.013+0000 7fed0ea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fed101452f0 0x7fed1006ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.013+0000 7fed0ea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fed101452f0 0x7fed1006ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50340/0 (socket says 172.21.15.173:50340) 2024-04-25T09:04:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.013+0000 7fed0ea00640 1 -- 172.21.15.173:0/634771121 learned_addr learned my addr 172.21.15.173:0/634771121 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.013+0000 7fed0f400640 1 --2- 172.21.15.173:0/634771121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed10144f10 0x7fed1015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.013+0000 7fed0ea00640 1 -- 172.21.15.173:0/634771121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed10144f10 msgr2=0x7fed1015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:06.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.013+0000 7fed0ea00640 1 --2- 172.21.15.173:0/634771121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed10144f10 0x7fed1015f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.013+0000 7fed0ea00640 1 -- 172.21.15.173:0/634771121 >> v1:172.21.15.194:6789/0 conn(0x7fed100ce420 legacy=0x7fed1015c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.013+0000 7fed0ea00640 1 -- 172.21.15.173:0/634771121 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed10071770 con 0x7fed101452f0 2024-04-25T09:04:06.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.013+0000 7fed0ea00640 1 --2- 172.21.15.173:0/634771121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed101452f0 0x7fed1006ea80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009870 tx=0x7fecfc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d1faa0cdf64fb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.013+0000 7fed0e000640 1 -- 172.21.15.173:0/634771121 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc0ab650 con 0x7fed101452f0 2024-04-25T09:04:06.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.013+0000 7fed0e000640 1 -- 172.21.15.173:0/634771121 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc0b0070 con 0x7fed101452f0 2024-04-25T09:04:06.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.013+0000 7fed0e000640 1 -- 172.21.15.173:0/634771121 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc0aba10 con 0x7fed101452f0 2024-04-25T09:04:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed14e00640 1 -- 172.21.15.173:0/634771121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed101452f0 msgr2=0x7fed1006ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed14e00640 1 --2- 172.21.15.173:0/634771121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed101452f0 0x7fed1006ea80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009870 tx=0x7fecfc01c560 comp rx=0 tx=0).stop 2024-04-25T09:04:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed14e00640 1 -- 172.21.15.173:0/634771121 shutdown_connections 2024-04-25T09:04:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed14e00640 1 --2- 172.21.15.173:0/634771121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed101452f0 0x7fed1006ea80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed14e00640 1 --2- 172.21.15.173:0/634771121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed10144f10 0x7fed1015f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed14e00640 1 -- 172.21.15.173:0/634771121 >> 172.21.15.173:0/634771121 conn(0x7fed10061d40 msgr2=0x7fed1006ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed14e00640 1 -- 172.21.15.173:0/634771121 shutdown_connections 2024-04-25T09:04:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed14e00640 1 -- 172.21.15.173:0/634771121 wait complete. 2024-04-25T09:04:06.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed14e00640 1 Processor -- start 2024-04-25T09:04:06.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed14e00640 1 -- start start 2024-04-25T09:04:06.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed14e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed100ce420 0x7fed100c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed14e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed10144f10 0x7fed100b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed14e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed101452f0 0x7fed100b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed14e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1015cd40 con 0x7fed10144f10 2024-04-25T09:04:06.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed14e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed100cec60 con 0x7fed100ce420 2024-04-25T09:04:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed14e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1015cec0 con 0x7fed101452f0 2024-04-25T09:04:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed0ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed10144f10 0x7fed100b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed0ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed10144f10 0x7fed100b39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50342/0 (socket says 172.21.15.173:50342) 2024-04-25T09:04:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed0ea00640 1 -- 172.21.15.173:0/3966948197 learned_addr learned my addr 172.21.15.173:0/3966948197 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed0f400640 1 --2- 172.21.15.173:0/3966948197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed100ce420 0x7fed100c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed0fe00640 1 --2- 172.21.15.173:0/3966948197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed101452f0 0x7fed100b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed0ea00640 1 -- 172.21.15.173:0/3966948197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed101452f0 msgr2=0x7fed100b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed0ea00640 1 --2- 172.21.15.173:0/3966948197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed101452f0 0x7fed100b3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed0ea00640 1 -- 172.21.15.173:0/3966948197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed100ce420 msgr2=0x7fed100c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed0ea00640 1 --2- 172.21.15.173:0/3966948197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed100ce420 0x7fed100c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.017+0000 7fed0ea00640 1 -- 172.21.15.173:0/3966948197 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed10130960 con 0x7fed10144f10 2024-04-25T09:04:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.021+0000 7fed0ea00640 1 --2- 172.21.15.173:0/3966948197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed10144f10 0x7fed100b39d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fecfc01a190 tx=0x7fecfc01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.021+0000 7fed07400640 1 -- 172.21.15.173:0/3966948197 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc0be5f0 con 0x7fed10144f10 2024-04-25T09:04:06.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.021+0000 7fed07400640 1 -- 172.21.15.173:0/3966948197 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc0be790 con 0x7fed10144f10 2024-04-25T09:04:06.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.021+0000 7fed07400640 1 -- 172.21.15.173:0/3966948197 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc0beb80 con 0x7fed10144f10 2024-04-25T09:04:06.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.021+0000 7fed14e00640 1 -- 172.21.15.173:0/3966948197 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed10130c40 con 0x7fed10144f10 2024-04-25T09:04:06.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.021+0000 7fed14e00640 1 -- 172.21.15.173:0/3966948197 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed100ce170 con 0x7fed10144f10 2024-04-25T09:04:06.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.021+0000 7fed14e00640 1 -- 172.21.15.173:0/3966948197 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed10073a40 con 0x7fed10144f10 2024-04-25T09:04:06.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.021+0000 7fed07400640 1 -- 172.21.15.173:0/3966948197 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fecfc0b43f0 con 0x7fed10144f10 2024-04-25T09:04:06.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.021+0000 7fed07400640 1 --2- 172.21.15.173:0/3966948197 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fecf0066f60 0x7fecf0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.021+0000 7fed07400640 1 -- 172.21.15.173:0/3966948197 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fecfc11fcf0 con 0x7fed10144f10 2024-04-25T09:04:06.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.021+0000 7fed0f400640 1 --2- 172.21.15.173:0/3966948197 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fecf0066f60 0x7fecf0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.025+0000 7fed0f400640 1 --2- 172.21.15.173:0/3966948197 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fecf0066f60 0x7fecf0069420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fed100b0ba0 tx=0x7fed00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.029+0000 7fed07400640 1 -- 172.21.15.173:0/3966948197 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fecfc016150 con 0x7fed10144f10 2024-04-25T09:04:06.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.213+0000 7fed14e00640 1 -- 172.21.15.173:0/3966948197 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fed100b1a10 con 0x7fed10144f10 2024-04-25T09:04:06.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.849+0000 7fed07400640 1 -- 172.21.15.173:0/3966948197 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fecfc0f0510 con 0x7fed10144f10 2024-04-25T09:04:06.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.853+0000 7fed14e00640 1 -- 172.21.15.173:0/3966948197 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fecf0066f60 msgr2=0x7fecf0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.853+0000 7fed14e00640 1 --2- 172.21.15.173:0/3966948197 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fecf0066f60 0x7fecf0069420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fed100b0ba0 tx=0x7fed00008040 comp rx=0 tx=0).stop 2024-04-25T09:04:06.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.853+0000 7fed14e00640 1 -- 172.21.15.173:0/3966948197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed10144f10 msgr2=0x7fed100b39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.853+0000 7fed14e00640 1 --2- 172.21.15.173:0/3966948197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed10144f10 0x7fed100b39d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fecfc01a190 tx=0x7fecfc01ada0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.853+0000 7fed14e00640 1 -- 172.21.15.173:0/3966948197 shutdown_connections 2024-04-25T09:04:06.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.853+0000 7fed14e00640 1 --2- 172.21.15.173:0/3966948197 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fecf0066f60 0x7fecf0069420 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.853+0000 7fed14e00640 1 --2- 172.21.15.173:0/3966948197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed101452f0 0x7fed100b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.853+0000 7fed14e00640 1 --2- 172.21.15.173:0/3966948197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed10144f10 0x7fed100b39d0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.853+0000 7fed14e00640 1 --2- 172.21.15.173:0/3966948197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed100ce420 0x7fed100c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.853+0000 7fed14e00640 1 -- 172.21.15.173:0/3966948197 >> 172.21.15.173:0/3966948197 conn(0x7fed10061d40 msgr2=0x7fed1015d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:06.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.853+0000 7fed14e00640 1 -- 172.21.15.173:0/3966948197 shutdown_connections 2024-04-25T09:04:06.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:06.853+0000 7fed14e00640 1 -- 172.21.15.173:0/3966948197 wait complete. 2024-04-25T09:04:06.862 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:04:06.862 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.005+0000 7f59efe00640 1 Processor -- start 2024-04-25T09:04:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.005+0000 7f59efe00640 1 -- start start 2024-04-25T09:04:06.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.009+0000 7f59efe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f59e815dc60 0x7f59e80b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.009+0000 7f59efe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59e815e040 0x7f59e80ace10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.009+0000 7f59efe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f59e80ad350 0x7f59e80ae810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.009+0000 7f59efe00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e8071450 con 0x7f59e815dc60 2024-04-25T09:04:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.009+0000 7f59efe00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e815e8e0 con 0x7f59e80ad350 2024-04-25T09:04:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.009+0000 7f59efe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e815ebc0 con 0x7f59e815e040 2024-04-25T09:04:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.009+0000 7f59ed400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f59e815dc60 0x7f59e80b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.009+0000 7f59ed400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f59e815dc60 0x7f59e80b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50346/0 (socket says 172.21.15.173:50346) 2024-04-25T09:04:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.009+0000 7f59ed400640 1 -- 172.21.15.173:0/3785629341 learned_addr learned my addr 172.21.15.173:0/3785629341 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.009+0000 7f59eca00640 1 --2- 172.21.15.173:0/3785629341 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59e815e040 0x7f59e80ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.009+0000 7f59ede00640 1 --2- 172.21.15.173:0/3785629341 >> v2:172.21.15.194:3300/0 conn(0x7f59e80ad350 0x7f59e80ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.009+0000 7f59ed400640 1 -- 172.21.15.173:0/3785629341 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59e815e040 msgr2=0x7f59e80ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.009+0000 7f59ed400640 1 --2- 172.21.15.173:0/3785629341 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59e815e040 0x7f59e80ace10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.009+0000 7f59ed400640 1 -- 172.21.15.173:0/3785629341 >> v2:172.21.15.194:3300/0 conn(0x7f59e80ad350 msgr2=0x7f59e80ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.009+0000 7f59ed400640 1 --2- 172.21.15.173:0/3785629341 >> v2:172.21.15.194:3300/0 conn(0x7f59e80ad350 0x7f59e80ae810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.009+0000 7f59ed400640 1 -- 172.21.15.173:0/3785629341 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e815eea0 con 0x7f59e815dc60 2024-04-25T09:04:07.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.013+0000 7f59ed400640 1 --2- 172.21.15.173:0/3785629341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59e815dc60 0x7f59e80b3710 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f59e80625d0 tx=0x7f59dc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc1ddcbba8c6fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.013+0000 7f59e7e00640 1 -- 172.21.15.173:0/3785629341 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0a5670 con 0x7f59e815dc60 2024-04-25T09:04:07.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.013+0000 7f59e7e00640 1 -- 172.21.15.173:0/3785629341 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59dc0a5810 con 0x7f59e815dc60 2024-04-25T09:04:07.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.013+0000 7f59e7e00640 1 -- 172.21.15.173:0/3785629341 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0a5be0 con 0x7f59e815dc60 2024-04-25T09:04:07.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.013+0000 7f59efe00640 1 -- 172.21.15.173:0/3785629341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59e815dc60 msgr2=0x7f59e80b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.013+0000 7f59efe00640 1 --2- 172.21.15.173:0/3785629341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59e815dc60 0x7f59e80b3710 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f59e80625d0 tx=0x7f59dc01c9f0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.013+0000 7f59efe00640 1 -- 172.21.15.173:0/3785629341 shutdown_connections 2024-04-25T09:04:07.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.013+0000 7f59efe00640 1 --2- 172.21.15.173:0/3785629341 >> v2:172.21.15.194:3300/0 conn(0x7f59e80ad350 0x7f59e80ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.013+0000 7f59efe00640 1 --2- 172.21.15.173:0/3785629341 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59e815e040 0x7f59e80ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.013+0000 7f59efe00640 1 --2- 172.21.15.173:0/3785629341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59e815dc60 0x7f59e80b3710 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.013+0000 7f59efe00640 1 -- 172.21.15.173:0/3785629341 >> 172.21.15.173:0/3785629341 conn(0x7f59e806ac90 msgr2=0x7f59e806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.013+0000 7f59efe00640 1 -- 172.21.15.173:0/3785629341 shutdown_connections 2024-04-25T09:04:07.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.013+0000 7f59efe00640 1 -- 172.21.15.173:0/3785629341 wait complete. 2024-04-25T09:04:07.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.013+0000 7f59efe00640 1 Processor -- start 2024-04-25T09:04:07.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.013+0000 7f59efe00640 1 -- start start 2024-04-25T09:04:07.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59efe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59e80ad350 0x7f59e81529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59efe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59e815dc60 0x7f59e814e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59efe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59e815e040 0x7f59e815ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59efe00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e8161810 con 0x7f59e815dc60 2024-04-25T09:04:07.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59efe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e815e660 con 0x7f59e80ad350 2024-04-25T09:04:07.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59efe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e8161990 con 0x7f59e815e040 2024-04-25T09:04:07.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59eca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59e815dc60 0x7f59e814e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59eca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59e815dc60 0x7f59e814e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50360/0 (socket says 172.21.15.173:50360) 2024-04-25T09:04:07.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59eca00640 1 -- 172.21.15.173:0/1307565897 learned_addr learned my addr 172.21.15.173:0/1307565897 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:07.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59ede00640 1 --2- 172.21.15.173:0/1307565897 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59e815e040 0x7f59e815ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59ed400640 1 --2- 172.21.15.173:0/1307565897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59e80ad350 0x7f59e81529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59eca00640 1 -- 172.21.15.173:0/1307565897 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59e815e040 msgr2=0x7f59e815ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59eca00640 1 --2- 172.21.15.173:0/1307565897 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59e815e040 0x7f59e815ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59eca00640 1 -- 172.21.15.173:0/1307565897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59e80ad350 msgr2=0x7f59e81529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59eca00640 1 --2- 172.21.15.173:0/1307565897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59e80ad350 0x7f59e81529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59eca00640 1 -- 172.21.15.173:0/1307565897 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e8154840 con 0x7f59e815dc60 2024-04-25T09:04:07.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59ed400640 1 --2- 172.21.15.173:0/1307565897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59e80ad350 0x7f59e81529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:07.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59eca00640 1 --2- 172.21.15.173:0/1307565897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59e815dc60 0x7f59e814e4f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f59d400e870 tx=0x7f59d400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59e5600640 1 -- 172.21.15.173:0/1307565897 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4017070 con 0x7f59e815dc60 2024-04-25T09:04:07.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59e5600640 1 -- 172.21.15.173:0/1307565897 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d400c940 con 0x7f59e815dc60 2024-04-25T09:04:07.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59efe00640 1 -- 172.21.15.173:0/1307565897 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e8154b20 con 0x7f59e815dc60 2024-04-25T09:04:07.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59e5600640 1 -- 172.21.15.173:0/1307565897 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d400ccf0 con 0x7f59e815dc60 2024-04-25T09:04:07.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59efe00640 1 -- 172.21.15.173:0/1307565897 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e81550e0 con 0x7f59e815dc60 2024-04-25T09:04:07.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59efe00640 1 -- 172.21.15.173:0/1307565897 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e8073a40 con 0x7f59e815dc60 2024-04-25T09:04:07.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.017+0000 7f59e5600640 1 -- 172.21.15.173:0/1307565897 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f59d401a070 con 0x7f59e815dc60 2024-04-25T09:04:07.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.021+0000 7f59e5600640 1 --2- 172.21.15.173:0/1307565897 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59c8066f60 0x7f59c8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.021+0000 7f59e5600640 1 -- 172.21.15.173:0/1307565897 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f59d40853a0 con 0x7f59e815dc60 2024-04-25T09:04:07.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.021+0000 7f59ed400640 1 --2- 172.21.15.173:0/1307565897 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59c8066f60 0x7f59c8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.021+0000 7f59ed400640 1 --2- 172.21.15.173:0/1307565897 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59c8066f60 0x7f59c8069420 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0ae000 tx=0x7f59dc0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.025+0000 7f59e5600640 1 -- 172.21.15.173:0/1307565897 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f59d4055bd0 con 0x7f59e815dc60 2024-04-25T09:04:07.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.205+0000 7f59efe00640 1 -- 172.21.15.173:0/1307565897 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59e806c300 con 0x7f59e815dc60 2024-04-25T09:04:07.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.209+0000 7f59e5600640 1 -- 172.21.15.173:0/1307565897 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f59d4059c70 con 0x7f59e815dc60 2024-04-25T09:04:07.198 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:04:07.198 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2065115729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2065115729},{"type":"v1","addr":"172.21.15.194:6834","nonce":2065115729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4121705012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4121705012},{"type":"v1","addr":"172.21.15.194:6835","nonce":4121705012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3839820980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3839820980},{"type":"v1","addr":"172.21.15.173:6836","nonce":3839820980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:03.205878+0000","modified":"2024-04-25T09:04:06.217297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/960880761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":960880761},{"type":"v1","addr":"172.21.15.173:6837","nonce":960880761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:04:07.198 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 18 2024-04-25T09:04:07.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.209+0000 7f59efe00640 1 -- 172.21.15.173:0/1307565897 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59c8066f60 msgr2=0x7f59c8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.209+0000 7f59efe00640 1 --2- 172.21.15.173:0/1307565897 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59c8066f60 0x7f59c8069420 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0ae000 tx=0x7f59dc0a7070 comp rx=0 tx=0).stop 2024-04-25T09:04:07.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.209+0000 7f59efe00640 1 -- 172.21.15.173:0/1307565897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59e815dc60 msgr2=0x7f59e814e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.209+0000 7f59efe00640 1 --2- 172.21.15.173:0/1307565897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59e815dc60 0x7f59e814e4f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f59d400e870 tx=0x7f59d400ec70 comp rx=0 tx=0).stop 2024-04-25T09:04:07.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.209+0000 7f59efe00640 1 -- 172.21.15.173:0/1307565897 shutdown_connections 2024-04-25T09:04:07.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.209+0000 7f59efe00640 1 --2- 172.21.15.173:0/1307565897 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59c8066f60 0x7f59c8069420 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.209+0000 7f59efe00640 1 --2- 172.21.15.173:0/1307565897 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59e815e040 0x7f59e815ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.209+0000 7f59efe00640 1 --2- 172.21.15.173:0/1307565897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59e815dc60 0x7f59e814e4f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.209+0000 7f59efe00640 1 --2- 172.21.15.173:0/1307565897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59e80ad350 0x7f59e81529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.209+0000 7f59efe00640 1 -- 172.21.15.173:0/1307565897 >> 172.21.15.173:0/1307565897 conn(0x7f59e806ac90 msgr2=0x7f59e80af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.209+0000 7f59efe00640 1 -- 172.21.15.173:0/1307565897 shutdown_connections 2024-04-25T09:04:07.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.209+0000 7f59efe00640 1 -- 172.21.15.173:0/1307565897 wait complete. 2024-04-25T09:04:07.218 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:07.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.365+0000 7f80dd400640 1 Processor -- start 2024-04-25T09:04:07.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.365+0000 7f80dd400640 1 -- start start 2024-04-25T09:04:07.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.365+0000 7f80dd400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f80d806fd80 0x7f80d80cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.365+0000 7f80dd400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d80cf6d0 con 0x7f80d806e270 2024-04-25T09:04:07.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.365+0000 7f80dd400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d80cbf60 con 0x7f80d806b3a0 2024-04-25T09:04:07.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.365+0000 7f80dd400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d80cf970 con 0x7f80d806fd80 2024-04-25T09:04:07.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.365+0000 7f80cf400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f80d806e270 0x7f80d806ac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:43062/0 (socket says 172.21.15.173:43062) 2024-04-25T09:04:07.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.365+0000 7f80cf400640 1 -- 172.21.15.173:0/2736312140 learned_addr learned my addr 172.21.15.173:0/2736312140 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:04:07.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.365+0000 7f80d7e00640 1 --2- 172.21.15.173:0/2736312140 >> v2:172.21.15.194:3300/0 conn(0x7f80d806fd80 0x7f80d80cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.365+0000 7f80d7400640 1 -- 172.21.15.173:0/2736312140 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206586230 0 0) 0x7f80d80cf6d0 con 0x7f80d806e270 2024-04-25T09:04:07.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.365+0000 7f80d7400640 1 -- 172.21.15.173:0/2736312140 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80bc003530 con 0x7f80d806e270 2024-04-25T09:04:07.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.365+0000 7f80d7e00640 1 -- 172.21.15.173:0/2736312140 >> v1:172.21.15.194:6789/0 conn(0x7f80d806b3a0 legacy=0x7f80d815d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.365+0000 7f80d7e00640 1 -- 172.21.15.173:0/2736312140 >> v1:172.21.15.173:6789/0 conn(0x7f80d806e270 legacy=0x7f80d806ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.365+0000 7f80d7e00640 1 -- 172.21.15.173:0/2736312140 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d80cfc50 con 0x7f80d806fd80 2024-04-25T09:04:07.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.369+0000 7f80d7e00640 1 --2- 172.21.15.173:0/2736312140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80d806fd80 0x7f80d80cb4e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f80c80097c0 tx=0x7f80c801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f6ba9fccd1d54ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.369+0000 7f80d7400640 1 -- 172.21.15.173:0/2736312140 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c80b0070 con 0x7f80d806fd80 2024-04-25T09:04:07.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.369+0000 7f80d7400640 1 -- 172.21.15.173:0/2736312140 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c80ab600 con 0x7f80d806fd80 2024-04-25T09:04:07.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.369+0000 7f80d7400640 1 -- 172.21.15.173:0/2736312140 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c80ab9d0 con 0x7f80d806fd80 2024-04-25T09:04:07.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.369+0000 7f80dd400640 1 -- 172.21.15.173:0/2736312140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80d806fd80 msgr2=0x7f80d80cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.369+0000 7f80dd400640 1 --2- 172.21.15.173:0/2736312140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80d806fd80 0x7f80d80cb4e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f80c80097c0 tx=0x7f80c801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.369+0000 7f80dd400640 1 -- 172.21.15.173:0/2736312140 shutdown_connections 2024-04-25T09:04:07.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.369+0000 7f80dd400640 1 --2- 172.21.15.173:0/2736312140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80d806fd80 0x7f80d80cb4e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.369+0000 7f80dd400640 1 -- 172.21.15.173:0/2736312140 >> 172.21.15.173:0/2736312140 conn(0x7f80d8072710 msgr2=0x7f80d8099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.369+0000 7f80dd400640 1 -- 172.21.15.173:0/2736312140 shutdown_connections 2024-04-25T09:04:07.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.369+0000 7f80dd400640 1 -- 172.21.15.173:0/2736312140 wait complete. 2024-04-25T09:04:07.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dd400640 1 Processor -- start 2024-04-25T09:04:07.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dd400640 1 -- start start 2024-04-25T09:04:07.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dd400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80d806b3a0 0x7f80d80b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dd400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80d806e270 0x7f80d815aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dd400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80d806fd80 0x7f80d815b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dd400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d816bb00 con 0x7f80d806fd80 2024-04-25T09:04:07.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dd400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d816b980 con 0x7f80d806e270 2024-04-25T09:04:07.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dd400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d816bc80 con 0x7f80d806b3a0 2024-04-25T09:04:07.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80d806fd80 0x7f80d815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80d806fd80 0x7f80d815b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50376/0 (socket says 172.21.15.173:50376) 2024-04-25T09:04:07.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dca00640 1 -- 172.21.15.173:0/1797016547 learned_addr learned my addr 172.21.15.173:0/1797016547 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:07.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80d7e00640 1 --2- 172.21.15.173:0/1797016547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80d806b3a0 0x7f80d80b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80cf400640 1 --2- 172.21.15.173:0/1797016547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80d806e270 0x7f80d815aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dca00640 1 -- 172.21.15.173:0/1797016547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80d806b3a0 msgr2=0x7f80d80b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dca00640 1 --2- 172.21.15.173:0/1797016547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80d806b3a0 0x7f80d80b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dca00640 1 -- 172.21.15.173:0/1797016547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80d806e270 msgr2=0x7f80d815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dca00640 1 --2- 172.21.15.173:0/1797016547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80d806e270 0x7f80d815aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dca00640 1 -- 172.21.15.173:0/1797016547 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d80c7ad0 con 0x7f80d806fd80 2024-04-25T09:04:07.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80d7e00640 1 --2- 172.21.15.173:0/1797016547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80d806b3a0 0x7f80d80b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:07.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80cf400640 1 --2- 172.21.15.173:0/1797016547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80d806e270 0x7f80d815aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:07.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dca00640 1 --2- 172.21.15.173:0/1797016547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80d806fd80 0x7f80d815b410 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f80d000c770 tx=0x7f80d000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80d4c00640 1 -- 172.21.15.173:0/1797016547 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d0003b80 con 0x7f80d806fd80 2024-04-25T09:04:07.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80d4c00640 1 -- 172.21.15.173:0/1797016547 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d0003d20 con 0x7f80d806fd80 2024-04-25T09:04:07.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80d4c00640 1 -- 172.21.15.173:0/1797016547 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d000aa90 con 0x7f80d806fd80 2024-04-25T09:04:07.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dd400640 1 -- 172.21.15.173:0/1797016547 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d80c7db0 con 0x7f80d806fd80 2024-04-25T09:04:07.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dd400640 1 -- 172.21.15.173:0/1797016547 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d80c8370 con 0x7f80d806fd80 2024-04-25T09:04:07.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.373+0000 7f80dd400640 1 -- 172.21.15.173:0/1797016547 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d8073a40 con 0x7f80d806fd80 2024-04-25T09:04:07.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.377+0000 7f80d4c00640 1 -- 172.21.15.173:0/1797016547 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f80d000ac30 con 0x7f80d806fd80 2024-04-25T09:04:07.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.377+0000 7f80d4c00640 1 --2- 172.21.15.173:0/1797016547 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f80b4066f90 0x7f80b4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.377+0000 7f80d4c00640 1 -- 172.21.15.173:0/1797016547 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f80d0085120 con 0x7f80d806fd80 2024-04-25T09:04:07.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.377+0000 7f80d7e00640 1 --2- 172.21.15.173:0/1797016547 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f80b4066f90 0x7f80b4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.377+0000 7f80d7e00640 1 --2- 172.21.15.173:0/1797016547 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f80b4066f90 0x7f80b4069450 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f80c80ad000 tx=0x7f80c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.381+0000 7f80d4c00640 1 -- 172.21.15.173:0/1797016547 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f80d0055f90 con 0x7f80d806fd80 2024-04-25T09:04:07.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.533+0000 7f80dd400640 1 -- 172.21.15.173:0/1797016547 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80d806af30 con 0x7f80d806fd80 2024-04-25T09:04:07.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.537+0000 7f80d4c00640 1 -- 172.21.15.173:0/1797016547 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17002 (secure 0 0 0) 0x7f80d0055890 con 0x7f80d806fd80 2024-04-25T09:04:07.526 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:04:07.526 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":40,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:04:04.834272+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:00.889429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:02.209182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:07.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.537+0000 7f80dd400640 1 -- 172.21.15.173:0/1797016547 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f80b4066f90 msgr2=0x7f80b4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.537+0000 7f80dd400640 1 --2- 172.21.15.173:0/1797016547 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f80b4066f90 0x7f80b4069450 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f80c80ad000 tx=0x7f80c8008040 comp rx=0 tx=0).stop 2024-04-25T09:04:07.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.537+0000 7f80dd400640 1 -- 172.21.15.173:0/1797016547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80d806fd80 msgr2=0x7f80d815b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.537+0000 7f80dd400640 1 --2- 172.21.15.173:0/1797016547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80d806fd80 0x7f80d815b410 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f80d000c770 tx=0x7f80d000cc30 comp rx=0 tx=0).stop 2024-04-25T09:04:07.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.537+0000 7f80dd400640 1 -- 172.21.15.173:0/1797016547 shutdown_connections 2024-04-25T09:04:07.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.537+0000 7f80dd400640 1 --2- 172.21.15.173:0/1797016547 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f80b4066f90 0x7f80b4069450 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.537+0000 7f80dd400640 1 --2- 172.21.15.173:0/1797016547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80d806fd80 0x7f80d815b410 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.537+0000 7f80dd400640 1 --2- 172.21.15.173:0/1797016547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80d806e270 0x7f80d815aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.537+0000 7f80dd400640 1 --2- 172.21.15.173:0/1797016547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80d806b3a0 0x7f80d80b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.537+0000 7f80dd400640 1 -- 172.21.15.173:0/1797016547 >> 172.21.15.173:0/1797016547 conn(0x7f80d8072710 msgr2=0x7f80d8099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.537+0000 7f80dd400640 1 -- 172.21.15.173:0/1797016547 shutdown_connections 2024-04-25T09:04:07.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.537+0000 7f80dd400640 1 -- 172.21.15.173:0/1797016547 wait complete. 2024-04-25T09:04:07.547 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:04:07.548 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:04:07.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.693+0000 7f31da200640 1 Processor -- start 2024-04-25T09:04:07.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.693+0000 7f31da200640 1 -- start start 2024-04-25T09:04:07.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.693+0000 7f31da200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f31d4145250 0x7f31d415c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.693+0000 7f31da200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f31d40ccd30 0x7f31d4071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.693+0000 7f31da200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d415cec0 con 0x7f31d40cc8b0 2024-04-25T09:04:07.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.693+0000 7f31da200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d406e7c0 con 0x7f31d40ccd30 2024-04-25T09:04:07.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.693+0000 7f31da200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d406d720 con 0x7f31d4145250 2024-04-25T09:04:07.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.693+0000 7f31d3e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f31d40ccd30 0x7f31d4071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.693+0000 7f31d3e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f31d40ccd30 0x7f31d4071a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50386/0 (socket says 172.21.15.173:50386) 2024-04-25T09:04:07.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.693+0000 7f31d3e00640 1 -- 172.21.15.173:0/555349889 learned_addr learned my addr 172.21.15.173:0/555349889 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:07.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.693+0000 7f31d3400640 1 --2- 172.21.15.173:0/555349889 >> v2:172.21.15.194:3300/0 conn(0x7f31d4145250 0x7f31d415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.693+0000 7f31d3e00640 1 -- 172.21.15.173:0/555349889 >> v2:172.21.15.194:3300/0 conn(0x7f31d4145250 msgr2=0x7f31d415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.693+0000 7f31d3e00640 1 --2- 172.21.15.173:0/555349889 >> v2:172.21.15.194:3300/0 conn(0x7f31d4145250 0x7f31d415c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.693+0000 7f31d3e00640 1 -- 172.21.15.173:0/555349889 >> v1:172.21.15.194:6789/0 conn(0x7f31d40cc8b0 legacy=0x7f31d4071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.693+0000 7f31d3e00640 1 -- 172.21.15.173:0/555349889 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d406da00 con 0x7f31d40ccd30 2024-04-25T09:04:07.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.693+0000 7f31d3400640 1 --2- 172.21.15.173:0/555349889 >> v2:172.21.15.194:3300/0 conn(0x7f31d4145250 0x7f31d415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:07.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.697+0000 7f31d3e00640 1 --2- 172.21.15.173:0/555349889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31d40ccd30 0x7f31d4071a30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f31d40d0420 tx=0x7f31cc01c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ea975a6b43cb4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.697+0000 7f31d2000640 1 -- 172.21.15.173:0/555349889 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc0a5660 con 0x7f31d40ccd30 2024-04-25T09:04:07.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.697+0000 7f31d2000640 1 -- 172.21.15.173:0/555349889 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc0a5800 con 0x7f31d40ccd30 2024-04-25T09:04:07.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.697+0000 7f31d2000640 1 -- 172.21.15.173:0/555349889 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc0a5bd0 con 0x7f31d40ccd30 2024-04-25T09:04:07.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.697+0000 7f31da200640 1 -- 172.21.15.173:0/555349889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31d40ccd30 msgr2=0x7f31d4071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.697+0000 7f31da200640 1 --2- 172.21.15.173:0/555349889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31d40ccd30 0x7f31d4071a30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f31d40d0420 tx=0x7f31cc01c7a0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.697+0000 7f31da200640 1 -- 172.21.15.173:0/555349889 shutdown_connections 2024-04-25T09:04:07.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.697+0000 7f31da200640 1 --2- 172.21.15.173:0/555349889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31d40ccd30 0x7f31d4071a30 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.697+0000 7f31da200640 1 --2- 172.21.15.173:0/555349889 >> v2:172.21.15.194:3300/0 conn(0x7f31d4145250 0x7f31d415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.697+0000 7f31da200640 1 -- 172.21.15.173:0/555349889 >> 172.21.15.173:0/555349889 conn(0x7f31d406ac90 msgr2=0x7f31d406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.697+0000 7f31da200640 1 -- 172.21.15.173:0/555349889 shutdown_connections 2024-04-25T09:04:07.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.697+0000 7f31da200640 1 -- 172.21.15.173:0/555349889 wait complete. 2024-04-25T09:04:07.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31da200640 1 Processor -- start 2024-04-25T09:04:07.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31da200640 1 -- start start 2024-04-25T09:04:07.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31da200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31d40cc8b0 0x7f31d41f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31da200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31d40ccd30 0x7f31d4142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31da200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31d4145250 0x7f31d4142560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31da200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d406ef80 con 0x7f31d40ccd30 2024-04-25T09:04:07.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31da200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d4145630 con 0x7f31d4145250 2024-04-25T09:04:07.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31da200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40cd140 con 0x7f31d40cc8b0 2024-04-25T09:04:07.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31d2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31d40ccd30 0x7f31d4142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31d2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31d40ccd30 0x7f31d4142020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50402/0 (socket says 172.21.15.173:50402) 2024-04-25T09:04:07.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31d2a00640 1 -- 172.21.15.173:0/542814545 learned_addr learned my addr 172.21.15.173:0/542814545 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:07.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31d3400640 1 --2- 172.21.15.173:0/542814545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31d40cc8b0 0x7f31d41f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31d3e00640 1 --2- 172.21.15.173:0/542814545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31d4145250 0x7f31d4142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31d2a00640 1 -- 172.21.15.173:0/542814545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31d40cc8b0 msgr2=0x7f31d41f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31d2a00640 1 --2- 172.21.15.173:0/542814545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31d40cc8b0 0x7f31d41f6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31d2a00640 1 -- 172.21.15.173:0/542814545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31d4145250 msgr2=0x7f31d4142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31d2a00640 1 --2- 172.21.15.173:0/542814545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31d4145250 0x7f31d4142560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31d2a00640 1 -- 172.21.15.173:0/542814545 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d413fab0 con 0x7f31d40ccd30 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31d2a00640 1 --2- 172.21.15.173:0/542814545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31d40ccd30 0x7f31d4142020 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f31c000c490 tx=0x7f31c0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31cb400640 1 -- 172.21.15.173:0/542814545 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0017070 con 0x7f31d40ccd30 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31cb400640 1 -- 172.21.15.173:0/542814545 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c0003600 con 0x7f31d40ccd30 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31cb400640 1 -- 172.21.15.173:0/542814545 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0003a30 con 0x7f31d40ccd30 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31da200640 1 -- 172.21.15.173:0/542814545 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d413fd50 con 0x7f31d40ccd30 2024-04-25T09:04:07.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31da200640 1 -- 172.21.15.173:0/542814545 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d4140310 con 0x7f31d40ccd30 2024-04-25T09:04:07.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.701+0000 7f31da200640 1 -- 172.21.15.173:0/542814545 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d4073a40 con 0x7f31d40ccd30 2024-04-25T09:04:07.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.705+0000 7f31cb400640 1 -- 172.21.15.173:0/542814545 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f31c0003bd0 con 0x7f31d40ccd30 2024-04-25T09:04:07.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.705+0000 7f31cb400640 1 --2- 172.21.15.173:0/542814545 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31b4066f60 0x7f31b4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.705+0000 7f31cb400640 1 -- 172.21.15.173:0/542814545 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f31c0084570 con 0x7f31d40ccd30 2024-04-25T09:04:07.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.705+0000 7f31d3400640 1 --2- 172.21.15.173:0/542814545 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31b4066f60 0x7f31b4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.705+0000 7f31d3400640 1 --2- 172.21.15.173:0/542814545 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31b4066f60 0x7f31b4069420 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f31c4006fd0 tx=0x7f31c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.709+0000 7f31cb400640 1 -- 172.21.15.173:0/542814545 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f31c0055350 con 0x7f31d40ccd30 2024-04-25T09:04:07.791 INFO:tasks.ceph.mds.c.smithi173.stderr:2024-04-25T09:04:07.801+0000 7f714f600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:04:07.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.861+0000 7f31da200640 1 -- 172.21.15.173:0/542814545 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f31d4071a70 con 0x7f31b4066f60 2024-04-25T09:04:07.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.869+0000 7f31cb400640 1 -- 172.21.15.173:0/542814545 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247366 (secure 0 0 0) 0x7f31d4071a70 con 0x7f31b4066f60 2024-04-25T09:04:07.860 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:04:07.862 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:04:07.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.869+0000 7f31da200640 1 -- 172.21.15.173:0/542814545 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31b4066f60 msgr2=0x7f31b4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.869+0000 7f31da200640 1 --2- 172.21.15.173:0/542814545 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31b4066f60 0x7f31b4069420 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f31c4006fd0 tx=0x7f31c4008040 comp rx=0 tx=0).stop 2024-04-25T09:04:07.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.869+0000 7f31da200640 1 -- 172.21.15.173:0/542814545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31d40ccd30 msgr2=0x7f31d4142020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.869+0000 7f31da200640 1 --2- 172.21.15.173:0/542814545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31d40ccd30 0x7f31d4142020 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f31c000c490 tx=0x7f31c0001e80 comp rx=0 tx=0).stop 2024-04-25T09:04:07.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.869+0000 7f31da200640 1 -- 172.21.15.173:0/542814545 shutdown_connections 2024-04-25T09:04:07.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.869+0000 7f31da200640 1 --2- 172.21.15.173:0/542814545 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31b4066f60 0x7f31b4069420 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.869+0000 7f31da200640 1 --2- 172.21.15.173:0/542814545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31d4145250 0x7f31d4142560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.869+0000 7f31da200640 1 --2- 172.21.15.173:0/542814545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31d40ccd30 0x7f31d4142020 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.869+0000 7f31da200640 1 --2- 172.21.15.173:0/542814545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31d40cc8b0 0x7f31d41f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.869+0000 7f31da200640 1 -- 172.21.15.173:0/542814545 >> 172.21.15.173:0/542814545 conn(0x7f31d406ac90 msgr2=0x7f31d406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.873+0000 7f31da200640 1 -- 172.21.15.173:0/542814545 shutdown_connections 2024-04-25T09:04:07.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:07.873+0000 7f31da200640 1 -- 172.21.15.173:0/542814545 wait complete. 2024-04-25T09:04:07.881 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-04-25T09:04:06.741359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":177,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220688,"kb_used_data":4496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754032,"statfs":{"total":773094113280,"available":772868128768,"internally_reserved":0,"allocated":4603904,"data_stored":2626380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.925810"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.834554+0000","last_change":"2024-04-25T09:04:02.834554+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.834554+0000","last_undegraded":"2024-04-25T09:04:02.834554+0000","last_fullsized":"2024-04-25T09:04:02.834554+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829079+0000","last_change":"2024-04-25T09:04:02.829079+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829079+0000","last_undegraded":"2024-04-25T09:04:02.829079+0000","last_fullsized":"2024-04-25T09:04:02.829079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.835681+0000","last_change":"2024-04-25T09:04:02.835681+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.835681+0000","last_undegraded":"2024-04-25T09:04:02.835681+0000","last_fullsized":"2024-04-25T09:04:02.835681+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.840377+0000","last_change":"2024-04-25T09:04:02.840377+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.840377+0000","last_undegraded":"2024-04-25T09:04:02.840377+0000","last_fullsized":"2024-04-25T09:04:02.840377+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839449+0000","last_change":"2024-04-25T09:04:02.839449+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839449+0000","last_undegraded":"2024-04-25T09:04:02.839449+0000","last_fullsized":"2024-04-25T09:04:02.839449+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.830875+0000","last_change":"2024-04-25T09:04:02.830875+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.830875+0000","last_undegraded":"2024-04-25T09:04:02.830875+0000","last_fullsized":"2024-04-25T09:04:02.830875+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867714+0000","last_change":"2024-04-25T09:04:03.863689+0000","last_active":"2024-04-25T09:04:03.867714+0000","last_peered":"2024-04-25T09:04:03.867714+0000","last_clean":"2024-04-25T09:04:03.867714+0000","last_became_active":"2024-04-25T09:04:03.863414+0000","last_became_peered":"2024-04-25T09:04:03.863414+0000","last_unstale":"2024-04-25T09:04:03.867714+0000","last_undegraded":"2024-04-25T09:04:03.867714+0000","last_fullsized":"2024-04-25T09:04:03.867714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:03.240175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829132+0000","last_change":"2024-04-25T09:04:02.829132+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829132+0000","last_undegraded":"2024-04-25T09:04:02.829132+0000","last_fullsized":"2024-04-25T09:04:02.829132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.832626+0000","last_change":"2024-04-25T09:04:02.832626+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.832626+0000","last_undegraded":"2024-04-25T09:04:02.832626+0000","last_fullsized":"2024-04-25T09:04:02.832626+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.866842+0000","last_change":"2024-04-25T09:04:03.861826+0000","last_active":"2024-04-25T09:04:03.866842+0000","last_peered":"2024-04-25T09:04:03.866842+0000","last_clean":"2024-04-25T09:04:03.866842+0000","last_became_active":"2024-04-25T09:04:03.861513+0000","last_became_peered":"2024-04-25T09:04:03.861513+0000","last_unstale":"2024-04-25T09:04:03.866842+0000","last_undegraded":"2024-04-25T09:04:03.866842+0000","last_fullsized":"2024-04-25T09:04:03.866842+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:51:43.190968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.865253+0000","last_change":"2024-04-25T09:04:03.853007+0000","last_active":"2024-04-25T09:04:03.865253+0000","last_peered":"2024-04-25T09:04:03.865253+0000","last_clean":"2024-04-25T09:04:03.865253+0000","last_became_active":"2024-04-25T09:04:03.852718+0000","last_became_peered":"2024-04-25T09:04:03.852718+0000","last_unstale":"2024-04-25T09:04:03.865253+0000","last_undegraded":"2024-04-25T09:04:03.865253+0000","last_fullsized":"2024-04-25T09:04:03.865253+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:07.579563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.836150+0000","last_change":"2024-04-25T09:04:02.836150+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.836150+0000","last_undegraded":"2024-04-25T09:04:02.836150+0000","last_fullsized":"2024-04-25T09:04:02.836150+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867148+0000","last_change":"2024-04-25T09:04:03.861338+0000","last_active":"2024-04-25T09:04:03.867148+0000","last_peered":"2024-04-25T09:04:03.867148+0000","last_clean":"2024-04-25T09:04:03.867148+0000","last_became_active":"2024-04-25T09:04:03.856730+0000","last_became_peered":"2024-04-25T09:04:03.856730+0000","last_unstale":"2024-04-25T09:04:03.867148+0000","last_undegraded":"2024-04-25T09:04:03.867148+0000","last_fullsized":"2024-04-25T09:04:03.867148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:05.560039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.842833+0000","last_change":"2024-04-25T09:04:03.834273+0000","last_active":"2024-04-25T09:04:03.842833+0000","last_peered":"2024-04-25T09:04:03.842833+0000","last_clean":"2024-04-25T09:04:03.842833+0000","last_became_active":"2024-04-25T09:04:03.833918+0000","last_became_peered":"2024-04-25T09:04:03.833918+0000","last_unstale":"2024-04-25T09:04:03.842833+0000","last_undegraded":"2024-04-25T09:04:03.842833+0000","last_fullsized":"2024-04-25T09:04:03.842833+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:56.270822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.864760+0000","last_change":"2024-04-25T09:04:03.848586+0000","last_active":"2024-04-25T09:04:03.864760+0000","last_peered":"2024-04-25T09:04:03.864760+0000","last_clean":"2024-04-25T09:04:03.864760+0000","last_became_active":"2024-04-25T09:04:03.848329+0000","last_became_peered":"2024-04-25T09:04:03.848329+0000","last_unstale":"2024-04-25T09:04:03.864760+0000","last_undegraded":"2024-04-25T09:04:03.864760+0000","last_fullsized":"2024-04-25T09:04:03.864760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:20.275314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.841856+0000","last_change":"2024-04-25T09:04:03.835873+0000","last_active":"2024-04-25T09:04:03.841856+0000","last_peered":"2024-04-25T09:04:03.841856+0000","last_clean":"2024-04-25T09:04:03.841856+0000","last_became_active":"2024-04-25T09:04:03.835526+0000","last_became_peered":"2024-04-25T09:04:03.835526+0000","last_unstale":"2024-04-25T09:04:03.841856+0000","last_undegraded":"2024-04-25T09:04:03.841856+0000","last_fullsized":"2024-04-25T09:04:03.841856+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:58.449231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839943+0000","last_change":"2024-04-25T09:04:02.839943+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839943+0000","last_undegraded":"2024-04-25T09:04:02.839943+0000","last_fullsized":"2024-04-25T09:04:02.839943+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.840918+0000","last_change":"2024-04-25T09:04:03.836238+0000","last_active":"2024-04-25T09:04:03.840918+0000","last_peered":"2024-04-25T09:04:03.840918+0000","last_clean":"2024-04-25T09:04:03.840918+0000","last_became_active":"2024-04-25T09:04:03.835915+0000","last_became_peered":"2024-04-25T09:04:03.835915+0000","last_unstale":"2024-04-25T09:04:03.840918+0000","last_undegraded":"2024-04-25T09:04:03.840918+0000","last_fullsized":"2024-04-25T09:04:03.840918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:56.270822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867169+0000","last_change":"2024-04-25T09:04:03.861860+0000","last_active":"2024-04-25T09:04:03.867169+0000","last_peered":"2024-04-25T09:04:03.867169+0000","last_clean":"2024-04-25T09:04:03.867169+0000","last_became_active":"2024-04-25T09:04:03.861534+0000","last_became_peered":"2024-04-25T09:04:03.861534+0000","last_unstale":"2024-04-25T09:04:03.867169+0000","last_undegraded":"2024-04-25T09:04:03.867169+0000","last_fullsized":"2024-04-25T09:04:03.867169+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:15.372975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.863606+0000","last_change":"2024-04-25T09:04:03.858775+0000","last_active":"2024-04-25T09:04:03.863606+0000","last_peered":"2024-04-25T09:04:03.863606+0000","last_clean":"2024-04-25T09:04:03.863606+0000","last_became_active":"2024-04-25T09:04:03.858487+0000","last_became_peered":"2024-04-25T09:04:03.858487+0000","last_unstale":"2024-04-25T09:04:03.863606+0000","last_undegraded":"2024-04-25T09:04:03.863606+0000","last_fullsized":"2024-04-25T09:04:03.863606+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:46.311120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839364+0000","last_change":"2024-04-25T09:04:02.839364+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839364+0000","last_undegraded":"2024-04-25T09:04:02.839364+0000","last_fullsized":"2024-04-25T09:04:02.839364+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.854865+0000","last_change":"2024-04-25T09:04:03.846114+0000","last_active":"2024-04-25T09:04:03.854865+0000","last_peered":"2024-04-25T09:04:03.854865+0000","last_clean":"2024-04-25T09:04:03.854865+0000","last_became_active":"2024-04-25T09:04:03.845818+0000","last_became_peered":"2024-04-25T09:04:03.845818+0000","last_unstale":"2024-04-25T09:04:03.854865+0000","last_undegraded":"2024-04-25T09:04:03.854865+0000","last_fullsized":"2024-04-25T09:04:03.854865+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:42.547375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.831333+0000","last_change":"2024-04-25T09:04:02.831333+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.831333+0000","last_undegraded":"2024-04-25T09:04:02.831333+0000","last_fullsized":"2024-04-25T09:04:02.831333+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.859057+0000","last_change":"2024-04-25T09:04:03.853632+0000","last_active":"2024-04-25T09:04:03.859057+0000","last_peered":"2024-04-25T09:04:03.859057+0000","last_clean":"2024-04-25T09:04:03.859057+0000","last_became_active":"2024-04-25T09:04:03.851999+0000","last_became_peered":"2024-04-25T09:04:03.851999+0000","last_unstale":"2024-04-25T09:04:03.859057+0000","last_undegraded":"2024-04-25T09:04:03.859057+0000","last_fullsized":"2024-04-25T09:04:03.859057+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:24.458554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867848+0000","last_change":"2024-04-25T09:04:03.863349+0000","last_active":"2024-04-25T09:04:03.867848+0000","last_peered":"2024-04-25T09:04:03.867848+0000","last_clean":"2024-04-25T09:04:03.867848+0000","last_became_active":"2024-04-25T09:04:03.863038+0000","last_became_peered":"2024-04-25T09:04:03.863038+0000","last_unstale":"2024-04-25T09:04:03.867848+0000","last_undegraded":"2024-04-25T09:04:03.867848+0000","last_fullsized":"2024-04-25T09:04:03.867848+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:51.065910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.847063+0000","last_change":"2024-04-25T09:04:03.842430+0000","last_active":"2024-04-25T09:04:03.847063+0000","last_peered":"2024-04-25T09:04:03.847063+0000","last_clean":"2024-04-25T09:04:03.847063+0000","last_became_active":"2024-04-25T09:04:03.841747+0000","last_became_peered":"2024-04-25T09:04:03.841747+0000","last_unstale":"2024-04-25T09:04:03.847063+0000","last_undegraded":"2024-04-25T09:04:03.847063+0000","last_fullsized":"2024-04-25T09:04:03.847063+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:48.909240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.848074+0000","last_change":"2024-04-25T09:04:03.841707+0000","last_active":"2024-04-25T09:04:03.848074+0000","last_peered":"2024-04-25T09:04:03.848074+0000","last_clean":"2024-04-25T09:04:03.848074+0000","last_became_active":"2024-04-25T09:04:03.841445+0000","last_became_peered":"2024-04-25T09:04:03.841445+0000","last_unstale":"2024-04-25T09:04:03.848074+0000","last_undegraded":"2024-04-25T09:04:03.848074+0000","last_fullsized":"2024-04-25T09:04:03.848074+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:45.371612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.831186+0000","last_change":"2024-04-25T09:04:02.831186+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.831186+0000","last_undegraded":"2024-04-25T09:04:02.831186+0000","last_fullsized":"2024-04-25T09:04:02.831186+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.863490+0000","last_change":"2024-04-25T09:04:02.834352+0000","last_active":"2024-04-25T09:04:03.863490+0000","last_peered":"2024-04-25T09:04:03.863490+0000","last_clean":"2024-04-25T09:04:03.863490+0000","last_became_active":"2024-04-25T09:04:02.833884+0000","last_became_peered":"2024-04-25T09:04:02.833884+0000","last_unstale":"2024-04-25T09:04:03.863490+0000","last_undegraded":"2024-04-25T09:04:03.863490+0000","last_fullsized":"2024-04-25T09:04:03.863490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:16.243545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.830022+0000","last_change":"2024-04-25T09:04:02.830022+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.830022+0000","last_undegraded":"2024-04-25T09:04:02.830022+0000","last_fullsized":"2024-04-25T09:04:02.830022+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.850403+0000","last_change":"2024-04-25T09:04:02.844968+0000","last_active":"2024-04-25T09:04:02.850403+0000","last_peered":"2024-04-25T09:04:02.850403+0000","last_clean":"2024-04-25T09:04:02.850403+0000","last_became_active":"2024-04-25T09:04:02.844639+0000","last_became_peered":"2024-04-25T09:04:02.844639+0000","last_unstale":"2024-04-25T09:04:02.850403+0000","last_undegraded":"2024-04-25T09:04:02.850403+0000","last_fullsized":"2024-04-25T09:04:02.850403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:17.911042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.841900+0000","last_change":"2024-04-25T09:04:03.836889+0000","last_active":"2024-04-25T09:04:03.841900+0000","last_peered":"2024-04-25T09:04:03.841900+0000","last_clean":"2024-04-25T09:04:03.841900+0000","last_became_active":"2024-04-25T09:04:03.836621+0000","last_became_peered":"2024-04-25T09:04:03.836621+0000","last_unstale":"2024-04-25T09:04:03.841900+0000","last_undegraded":"2024-04-25T09:04:03.841900+0000","last_fullsized":"2024-04-25T09:04:03.841900+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:45.371612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.846214+0000","last_change":"2024-04-25T09:04:02.842347+0000","last_active":"2024-04-25T09:04:02.846214+0000","last_peered":"2024-04-25T09:04:02.846214+0000","last_clean":"2024-04-25T09:04:02.846214+0000","last_became_active":"2024-04-25T09:04:02.842050+0000","last_became_peered":"2024-04-25T09:04:02.842050+0000","last_unstale":"2024-04-25T09:04:02.846214+0000","last_undegraded":"2024-04-25T09:04:02.846214+0000","last_fullsized":"2024-04-25T09:04:02.846214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:09.975591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829413+0000","last_change":"2024-04-25T09:04:02.829413+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829413+0000","last_undegraded":"2024-04-25T09:04:02.829413+0000","last_fullsized":"2024-04-25T09:04:02.829413+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.863494+0000","last_change":"2024-04-25T09:04:02.837853+0000","last_active":"2024-04-25T09:04:03.863494+0000","last_peered":"2024-04-25T09:04:03.863494+0000","last_clean":"2024-04-25T09:04:03.863494+0000","last_became_active":"2024-04-25T09:04:02.837463+0000","last_became_peered":"2024-04-25T09:04:02.837463+0000","last_unstale":"2024-04-25T09:04:03.863494+0000","last_undegraded":"2024-04-25T09:04:03.863494+0000","last_fullsized":"2024-04-25T09:04:03.863494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.352305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.833468+0000","last_change":"2024-04-25T09:04:02.833468+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.833468+0000","last_undegraded":"2024-04-25T09:04:02.833468+0000","last_fullsized":"2024-04-25T09:04:02.833468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867065+0000","last_change":"2024-04-25T09:04:02.843213+0000","last_active":"2024-04-25T09:04:03.867065+0000","last_peered":"2024-04-25T09:04:03.867065+0000","last_clean":"2024-04-25T09:04:03.867065+0000","last_became_active":"2024-04-25T09:04:02.842911+0000","last_became_peered":"2024-04-25T09:04:02.842911+0000","last_unstale":"2024-04-25T09:04:03.867065+0000","last_undegraded":"2024-04-25T09:04:03.867065+0000","last_fullsized":"2024-04-25T09:04:03.867065+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:49.664471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.866078+0000","last_change":"2024-04-25T09:04:03.855154+0000","last_active":"2024-04-25T09:04:03.866078+0000","last_peered":"2024-04-25T09:04:03.866078+0000","last_clean":"2024-04-25T09:04:03.866078+0000","last_became_active":"2024-04-25T09:04:03.854659+0000","last_became_peered":"2024-04-25T09:04:03.854659+0000","last_unstale":"2024-04-25T09:04:03.866078+0000","last_undegraded":"2024-04-25T09:04:03.866078+0000","last_fullsized":"2024-04-25T09:04:03.866078+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:02.049425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:01.808788+0000","last_change":"2024-04-25T09:04:01.808788+0000","last_active":"2024-04-25T09:04:01.808788+0000","last_peered":"2024-04-25T09:04:01.808788+0000","last_clean":"2024-04-25T09:04:01.808788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:01.808788+0000","last_undegraded":"2024-04-25T09:04:01.808788+0000","last_fullsized":"2024-04-25T09:04:01.808788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.858918+0000","last_change":"2024-04-25T09:04:03.852928+0000","last_active":"2024-04-25T09:04:03.858918+0000","last_peered":"2024-04-25T09:04:03.858918+0000","last_clean":"2024-04-25T09:04:03.858918+0000","last_became_active":"2024-04-25T09:04:03.852667+0000","last_became_peered":"2024-04-25T09:04:03.852667+0000","last_unstale":"2024-04-25T09:04:03.858918+0000","last_undegraded":"2024-04-25T09:04:03.858918+0000","last_fullsized":"2024-04-25T09:04:03.858918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:42.513233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.853743+0000","last_change":"2024-04-25T09:04:02.850909+0000","last_active":"2024-04-25T09:04:02.853743+0000","last_peered":"2024-04-25T09:04:02.853743+0000","last_clean":"2024-04-25T09:04:02.853743+0000","last_became_active":"2024-04-25T09:04:02.850644+0000","last_became_peered":"2024-04-25T09:04:02.850644+0000","last_unstale":"2024-04-25T09:04:02.853743+0000","last_undegraded":"2024-04-25T09:04:02.853743+0000","last_fullsized":"2024-04-25T09:04:02.853743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:47.981260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.830685+0000","last_change":"2024-04-25T09:04:02.830685+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.830685+0000","last_undegraded":"2024-04-25T09:04:02.830685+0000","last_fullsized":"2024-04-25T09:04:02.830685+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.829142+0000","last_change":"2024-04-25T09:04:02.842246+0000","last_active":"2024-04-25T09:04:03.829142+0000","last_peered":"2024-04-25T09:04:03.829142+0000","last_clean":"2024-04-25T09:04:03.829142+0000","last_became_active":"2024-04-25T09:04:02.838163+0000","last_became_peered":"2024-04-25T09:04:02.838163+0000","last_unstale":"2024-04-25T09:04:03.829142+0000","last_undegraded":"2024-04-25T09:04:03.829142+0000","last_fullsized":"2024-04-25T09:04:03.829142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:21.893561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839954+0000","last_change":"2024-04-25T09:04:02.839954+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839954+0000","last_undegraded":"2024-04-25T09:04:02.839954+0000","last_fullsized":"2024-04-25T09:04:02.839954+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.840232+0000","last_change":"2024-04-25T09:04:02.837904+0000","last_active":"2024-04-25T09:04:02.840232+0000","last_peered":"2024-04-25T09:04:02.840232+0000","last_clean":"2024-04-25T09:04:02.840232+0000","last_became_active":"2024-04-25T09:04:02.837467+0000","last_became_peered":"2024-04-25T09:04:02.837467+0000","last_unstale":"2024-04-25T09:04:02.840232+0000","last_undegraded":"2024-04-25T09:04:02.840232+0000","last_fullsized":"2024-04-25T09:04:02.840232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:38.669973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.844372+0000","last_change":"2024-04-25T09:04:02.845952+0000","last_active":"2024-04-25T09:04:03.844372+0000","last_peered":"2024-04-25T09:04:03.844372+0000","last_clean":"2024-04-25T09:04:03.844372+0000","last_became_active":"2024-04-25T09:04:02.845536+0000","last_became_peered":"2024-04-25T09:04:02.845536+0000","last_unstale":"2024-04-25T09:04:03.844372+0000","last_undegraded":"2024-04-25T09:04:03.844372+0000","last_fullsized":"2024-04-25T09:04:03.844372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:25.532613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.834873+0000","last_change":"2024-04-25T09:04:02.834873+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.834873+0000","last_undegraded":"2024-04-25T09:04:02.834873+0000","last_fullsized":"2024-04-25T09:04:02.834873+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867131+0000","last_change":"2024-04-25T09:04:02.846311+0000","last_active":"2024-04-25T09:04:03.867131+0000","last_peered":"2024-04-25T09:04:03.867131+0000","last_clean":"2024-04-25T09:04:03.867131+0000","last_became_active":"2024-04-25T09:04:02.845983+0000","last_became_peered":"2024-04-25T09:04:02.845983+0000","last_unstale":"2024-04-25T09:04:03.867131+0000","last_undegraded":"2024-04-25T09:04:03.867131+0000","last_fullsized":"2024-04-25T09:04:03.867131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:23.451902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.857465+0000","last_change":"2024-04-25T09:04:03.849902+0000","last_active":"2024-04-25T09:04:03.857465+0000","last_peered":"2024-04-25T09:04:03.857465+0000","last_clean":"2024-04-25T09:04:03.857465+0000","last_became_active":"2024-04-25T09:04:03.849674+0000","last_became_peered":"2024-04-25T09:04:03.849674+0000","last_unstale":"2024-04-25T09:04:03.857465+0000","last_undegraded":"2024-04-25T09:04:03.857465+0000","last_fullsized":"2024-04-25T09:04:03.857465+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:24.458554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852108+0000","last_change":"2024-04-25T09:04:02.841438+0000","last_active":"2024-04-25T09:04:02.852108+0000","last_peered":"2024-04-25T09:04:02.852108+0000","last_clean":"2024-04-25T09:04:02.852108+0000","last_became_active":"2024-04-25T09:04:02.841168+0000","last_became_peered":"2024-04-25T09:04:02.841168+0000","last_unstale":"2024-04-25T09:04:02.852108+0000","last_undegraded":"2024-04-25T09:04:02.852108+0000","last_fullsized":"2024-04-25T09:04:02.852108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:58.258528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.833043+0000","last_change":"2024-04-25T09:04:02.833043+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.833043+0000","last_undegraded":"2024-04-25T09:04:02.833043+0000","last_fullsized":"2024-04-25T09:04:02.833043+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852156+0000","last_change":"2024-04-25T09:04:02.843180+0000","last_active":"2024-04-25T09:04:02.852156+0000","last_peered":"2024-04-25T09:04:02.852156+0000","last_clean":"2024-04-25T09:04:02.852156+0000","last_became_active":"2024-04-25T09:04:02.842871+0000","last_became_peered":"2024-04-25T09:04:02.842871+0000","last_unstale":"2024-04-25T09:04:02.852156+0000","last_undegraded":"2024-04-25T09:04:02.852156+0000","last_fullsized":"2024-04-25T09:04:02.852156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:54.157193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.828875+0000","last_change":"2024-04-25T09:04:02.828875+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.828875+0000","last_undegraded":"2024-04-25T09:04:02.828875+0000","last_fullsized":"2024-04-25T09:04:02.828875+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852804+0000","last_change":"2024-04-25T09:04:02.848772+0000","last_active":"2024-04-25T09:04:02.852804+0000","last_peered":"2024-04-25T09:04:02.852804+0000","last_clean":"2024-04-25T09:04:02.852804+0000","last_became_active":"2024-04-25T09:04:02.848498+0000","last_became_peered":"2024-04-25T09:04:02.848498+0000","last_unstale":"2024-04-25T09:04:02.852804+0000","last_undegraded":"2024-04-25T09:04:02.852804+0000","last_fullsized":"2024-04-25T09:04:02.852804+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:51.913902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.832663+0000","last_change":"2024-04-25T09:04:02.832388+0000","last_active":"2024-04-25T09:04:03.832663+0000","last_peered":"2024-04-25T09:04:03.832663+0000","last_clean":"2024-04-25T09:04:03.832663+0000","last_became_active":"2024-04-25T09:04:02.831918+0000","last_became_peered":"2024-04-25T09:04:02.831918+0000","last_unstale":"2024-04-25T09:04:03.832663+0000","last_undegraded":"2024-04-25T09:04:03.832663+0000","last_fullsized":"2024-04-25T09:04:03.832663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:21.893561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.830204+0000","last_change":"2024-04-25T09:04:02.830204+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.830204+0000","last_undegraded":"2024-04-25T09:04:02.830204+0000","last_fullsized":"2024-04-25T09:04:02.830204+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:01.808788+0000","last_change":"2024-04-25T09:04:01.808788+0000","last_active":"2024-04-25T09:04:01.808788+0000","last_peered":"2024-04-25T09:04:01.808788+0000","last_clean":"2024-04-25T09:04:01.808788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:01.808788+0000","last_undegraded":"2024-04-25T09:04:01.808788+0000","last_fullsized":"2024-04-25T09:04:01.808788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.828767+0000","last_change":"2024-04-25T09:04:02.828767+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.828767+0000","last_undegraded":"2024-04-25T09:04:02.828767+0000","last_fullsized":"2024-04-25T09:04:02.828767+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.866931+0000","last_change":"2024-04-25T09:04:02.849353+0000","last_active":"2024-04-25T09:04:03.866931+0000","last_peered":"2024-04-25T09:04:03.866931+0000","last_clean":"2024-04-25T09:04:03.866931+0000","last_became_active":"2024-04-25T09:04:02.849106+0000","last_became_peered":"2024-04-25T09:04:02.849106+0000","last_unstale":"2024-04-25T09:04:03.866931+0000","last_undegraded":"2024-04-25T09:04:03.866931+0000","last_fullsized":"2024-04-25T09:04:03.866931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:41.506582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.865263+0000","last_change":"2024-04-25T09:04:03.854450+0000","last_active":"2024-04-25T09:04:03.865263+0000","last_peered":"2024-04-25T09:04:03.865263+0000","last_clean":"2024-04-25T09:04:03.865263+0000","last_became_active":"2024-04-25T09:04:03.854184+0000","last_became_peered":"2024-04-25T09:04:03.854184+0000","last_unstale":"2024-04-25T09:04:03.865263+0000","last_undegraded":"2024-04-25T09:04:03.865263+0000","last_fullsized":"2024-04-25T09:04:03.865263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:29.586676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867227+0000","last_change":"2024-04-25T09:04:02.849282+0000","last_active":"2024-04-25T09:04:03.867227+0000","last_peered":"2024-04-25T09:04:03.867227+0000","last_clean":"2024-04-25T09:04:03.867227+0000","last_became_active":"2024-04-25T09:04:02.848992+0000","last_became_peered":"2024-04-25T09:04:02.848992+0000","last_unstale":"2024-04-25T09:04:03.867227+0000","last_undegraded":"2024-04-25T09:04:03.867227+0000","last_fullsized":"2024-04-25T09:04:03.867227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:16.243545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.847132+0000","last_change":"2024-04-25T09:04:03.843605+0000","last_active":"2024-04-25T09:04:03.847132+0000","last_peered":"2024-04-25T09:04:03.847132+0000","last_clean":"2024-04-25T09:04:03.847132+0000","last_became_active":"2024-04-25T09:04:03.840559+0000","last_became_peered":"2024-04-25T09:04:03.840559+0000","last_unstale":"2024-04-25T09:04:03.847132+0000","last_undegraded":"2024-04-25T09:04:03.847132+0000","last_fullsized":"2024-04-25T09:04:03.847132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:42.547375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.849804+0000","last_change":"2024-04-25T09:04:02.846278+0000","last_active":"2024-04-25T09:04:02.849804+0000","last_peered":"2024-04-25T09:04:02.849804+0000","last_clean":"2024-04-25T09:04:02.849804+0000","last_became_active":"2024-04-25T09:04:02.845737+0000","last_became_peered":"2024-04-25T09:04:02.845737+0000","last_unstale":"2024-04-25T09:04:02.849804+0000","last_undegraded":"2024-04-25T09:04:02.849804+0000","last_fullsized":"2024-04-25T09:04:02.849804+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:05.305933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839671+0000","last_change":"2024-04-25T09:04:02.839671+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839671+0000","last_undegraded":"2024-04-25T09:04:02.839671+0000","last_fullsized":"2024-04-25T09:04:02.839671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.847248+0000","last_change":"2024-04-25T09:04:02.842942+0000","last_active":"2024-04-25T09:04:02.847248+0000","last_peered":"2024-04-25T09:04:02.847248+0000","last_clean":"2024-04-25T09:04:02.847248+0000","last_became_active":"2024-04-25T09:04:02.842698+0000","last_became_peered":"2024-04-25T09:04:02.842698+0000","last_unstale":"2024-04-25T09:04:02.847248+0000","last_undegraded":"2024-04-25T09:04:02.847248+0000","last_fullsized":"2024-04-25T09:04:02.847248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:17.911042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.853387+0000","last_change":"2024-04-25T09:04:02.850799+0000","last_active":"2024-04-25T09:04:02.853387+0000","last_peered":"2024-04-25T09:04:02.853387+0000","last_clean":"2024-04-25T09:04:02.853387+0000","last_became_active":"2024-04-25T09:04:02.850539+0000","last_became_peered":"2024-04-25T09:04:02.850539+0000","last_unstale":"2024-04-25T09:04:02.853387+0000","last_undegraded":"2024-04-25T09:04:02.853387+0000","last_fullsized":"2024-04-25T09:04:02.853387+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:06.985756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.832567+0000","last_change":"2024-04-25T09:04:02.832567+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.832567+0000","last_undegraded":"2024-04-25T09:04:02.832567+0000","last_fullsized":"2024-04-25T09:04:02.832567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852945+0000","last_change":"2024-04-25T09:04:02.848548+0000","last_active":"2024-04-25T09:04:02.852945+0000","last_peered":"2024-04-25T09:04:02.852945+0000","last_clean":"2024-04-25T09:04:02.852945+0000","last_became_active":"2024-04-25T09:04:02.848233+0000","last_became_peered":"2024-04-25T09:04:02.848233+0000","last_unstale":"2024-04-25T09:04:02.852945+0000","last_undegraded":"2024-04-25T09:04:02.852945+0000","last_fullsized":"2024-04-25T09:04:02.852945+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:30.524420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867903+0000","last_change":"2024-04-25T09:04:03.864573+0000","last_active":"2024-04-25T09:04:03.867903+0000","last_peered":"2024-04-25T09:04:03.867903+0000","last_clean":"2024-04-25T09:04:03.867903+0000","last_became_active":"2024-04-25T09:04:03.863608+0000","last_became_peered":"2024-04-25T09:04:03.863608+0000","last_unstale":"2024-04-25T09:04:03.867903+0000","last_undegraded":"2024-04-25T09:04:03.867903+0000","last_fullsized":"2024-04-25T09:04:03.867903+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:01.044810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:01.808788+0000","last_change":"2024-04-25T09:04:01.808788+0000","last_active":"2024-04-25T09:04:01.808788+0000","last_peered":"2024-04-25T09:04:01.808788+0000","last_clean":"2024-04-25T09:04:01.808788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:01.808788+0000","last_undegraded":"2024-04-25T09:04:01.808788+0000","last_fullsized":"2024-04-25T09:04:01.808788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.828305+0000","last_change":"2024-04-25T09:04:02.828305+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.828305+0000","last_undegraded":"2024-04-25T09:04:02.828305+0000","last_fullsized":"2024-04-25T09:04:02.828305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.853416+0000","last_change":"2024-04-25T09:04:02.851466+0000","last_active":"2024-04-25T09:04:02.853416+0000","last_peered":"2024-04-25T09:04:02.853416+0000","last_clean":"2024-04-25T09:04:02.853416+0000","last_became_active":"2024-04-25T09:04:02.851149+0000","last_became_peered":"2024-04-25T09:04:02.851149+0000","last_unstale":"2024-04-25T09:04:02.853416+0000","last_undegraded":"2024-04-25T09:04:02.853416+0000","last_fullsized":"2024-04-25T09:04:02.853416+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:38.460713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829258+0000","last_change":"2024-04-25T09:04:02.829258+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829258+0000","last_undegraded":"2024-04-25T09:04:02.829258+0000","last_fullsized":"2024-04-25T09:04:02.829258+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.866817+0000","last_change":"2024-04-25T09:04:02.846991+0000","last_active":"2024-04-25T09:04:03.866817+0000","last_peered":"2024-04-25T09:04:03.866817+0000","last_clean":"2024-04-25T09:04:03.866817+0000","last_became_active":"2024-04-25T09:04:02.846719+0000","last_became_peered":"2024-04-25T09:04:02.846719+0000","last_unstale":"2024-04-25T09:04:03.866817+0000","last_undegraded":"2024-04-25T09:04:03.866817+0000","last_fullsized":"2024-04-25T09:04:03.866817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:45.304468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852914+0000","last_change":"2024-04-25T09:04:02.848506+0000","last_active":"2024-04-25T09:04:02.852914+0000","last_peered":"2024-04-25T09:04:02.852914+0000","last_clean":"2024-04-25T09:04:02.852914+0000","last_became_active":"2024-04-25T09:04:02.848199+0000","last_became_peered":"2024-04-25T09:04:02.848199+0000","last_unstale":"2024-04-25T09:04:02.852914+0000","last_undegraded":"2024-04-25T09:04:02.852914+0000","last_fullsized":"2024-04-25T09:04:02.852914+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:10.099740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.827837+0000","last_change":"2024-04-25T09:04:02.827837+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.827837+0000","last_undegraded":"2024-04-25T09:04:02.827837+0000","last_fullsized":"2024-04-25T09:04:02.827837+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.850155+0000","last_change":"2024-04-25T09:04:02.842312+0000","last_active":"2024-04-25T09:04:02.850155+0000","last_peered":"2024-04-25T09:04:02.850155+0000","last_clean":"2024-04-25T09:04:02.850155+0000","last_became_active":"2024-04-25T09:04:02.842050+0000","last_became_peered":"2024-04-25T09:04:02.842050+0000","last_unstale":"2024-04-25T09:04:02.850155+0000","last_undegraded":"2024-04-25T09:04:02.850155+0000","last_fullsized":"2024-04-25T09:04:02.850155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:09.975591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.832541+0000","last_change":"2024-04-25T09:04:02.832541+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.832541+0000","last_undegraded":"2024-04-25T09:04:02.832541+0000","last_fullsized":"2024-04-25T09:04:02.832541+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.850379+0000","last_change":"2024-04-25T09:04:02.846007+0000","last_active":"2024-04-25T09:04:02.850379+0000","last_peered":"2024-04-25T09:04:02.850379+0000","last_clean":"2024-04-25T09:04:02.850379+0000","last_became_active":"2024-04-25T09:04:02.844376+0000","last_became_peered":"2024-04-25T09:04:02.844376+0000","last_unstale":"2024-04-25T09:04:02.850379+0000","last_undegraded":"2024-04-25T09:04:02.850379+0000","last_fullsized":"2024-04-25T09:04:02.850379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:51.913902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829279+0000","last_change":"2024-04-25T09:04:02.829279+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829279+0000","last_undegraded":"2024-04-25T09:04:02.829279+0000","last_fullsized":"2024-04-25T09:04:02.829279+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.833069+0000","last_change":"2024-04-25T09:04:02.844380+0000","last_active":"2024-04-25T09:04:03.833069+0000","last_peered":"2024-04-25T09:04:03.833069+0000","last_clean":"2024-04-25T09:04:03.833069+0000","last_became_active":"2024-04-25T09:04:02.843215+0000","last_became_peered":"2024-04-25T09:04:02.843215+0000","last_unstale":"2024-04-25T09:04:03.833069+0000","last_undegraded":"2024-04-25T09:04:03.833069+0000","last_fullsized":"2024-04-25T09:04:03.833069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.352305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.847033+0000","last_change":"2024-04-25T09:04:03.840896+0000","last_active":"2024-04-25T09:04:03.847033+0000","last_peered":"2024-04-25T09:04:03.847033+0000","last_clean":"2024-04-25T09:04:03.847033+0000","last_became_active":"2024-04-25T09:04:03.840575+0000","last_became_peered":"2024-04-25T09:04:03.840575+0000","last_unstale":"2024-04-25T09:04:03.847033+0000","last_undegraded":"2024-04-25T09:04:03.847033+0000","last_fullsized":"2024-04-25T09:04:03.847033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:48.909240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.829569+0000","last_change":"2024-04-25T09:04:02.837823+0000","last_active":"2024-04-25T09:04:03.829569+0000","last_peered":"2024-04-25T09:04:03.829569+0000","last_clean":"2024-04-25T09:04:03.829569+0000","last_became_active":"2024-04-25T09:04:02.837539+0000","last_became_peered":"2024-04-25T09:04:02.837539+0000","last_unstale":"2024-04-25T09:04:03.829569+0000","last_undegraded":"2024-04-25T09:04:03.829569+0000","last_fullsized":"2024-04-25T09:04:03.829569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:57.442579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.838697+0000","last_change":"2024-04-25T09:04:02.837731+0000","last_active":"2024-04-25T09:04:02.838697+0000","last_peered":"2024-04-25T09:04:02.838697+0000","last_clean":"2024-04-25T09:04:02.838697+0000","last_became_active":"2024-04-25T09:04:02.837436+0000","last_became_peered":"2024-04-25T09:04:02.837436+0000","last_unstale":"2024-04-25T09:04:02.838697+0000","last_undegraded":"2024-04-25T09:04:02.838697+0000","last_fullsized":"2024-04-25T09:04:02.838697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:06.695209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867812+0000","last_change":"2024-04-25T09:04:03.864362+0000","last_active":"2024-04-25T09:04:03.867812+0000","last_peered":"2024-04-25T09:04:03.867812+0000","last_clean":"2024-04-25T09:04:03.867812+0000","last_became_active":"2024-04-25T09:04:03.863013+0000","last_became_peered":"2024-04-25T09:04:03.863013+0000","last_unstale":"2024-04-25T09:04:03.867812+0000","last_undegraded":"2024-04-25T09:04:03.867812+0000","last_fullsized":"2024-04-25T09:04:03.867812+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:08.778151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:01.808788+0000","last_change":"2024-04-25T09:04:01.808788+0000","last_active":"2024-04-25T09:04:01.808788+0000","last_peered":"2024-04-25T09:04:01.808788+0000","last_clean":"2024-04-25T09:04:01.808788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:01.808788+0000","last_undegraded":"2024-04-25T09:04:01.808788+0000","last_fullsized":"2024-04-25T09:04:01.808788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":194,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:03:57.298266+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:03:57.298266+0000","last_peered":"2024-04-25T09:03:57.298266+0000","last_clean":"2024-04-25T09:03:57.298266+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:03:57.298266+0000","last_undegraded":"2024-04-25T09:03:57.298266+0000","last_fullsized":"2024-04-25T09:03:57.298266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":56,"acting":56,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1024000,"data_stored":772683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":999424,"data_stored":759807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:04:07.886 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:04:08.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.073+0000 7f80fde00640 1 Processor -- start 2024-04-25T09:04:08.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.073+0000 7f80fde00640 1 -- start start 2024-04-25T09:04:08.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80fde00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f80f80ccd30 0x7f80f80cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80fde00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f806e7c0 con 0x7f80f80cc8b0 2024-04-25T09:04:08.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80fde00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f806d720 con 0x7f80f8145250 2024-04-25T09:04:08.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80fde00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f806da00 con 0x7f80f80ccd30 2024-04-25T09:04:08.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80ee000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f80f80cc8b0 0x7f80f80ce8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:43074/0 (socket says 172.21.15.173:43074) 2024-04-25T09:04:08.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80ee000640 1 -- 172.21.15.173:0/1638232157 learned_addr learned my addr 172.21.15.173:0/1638232157 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:04:08.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f7400640 1 --2- 172.21.15.173:0/1638232157 >> v2:172.21.15.194:3300/0 conn(0x7f80f80ccd30 0x7f80f80cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f6000640 1 -- 172.21.15.173:0/1638232157 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743543779 0 0) 0x7f80f806e7c0 con 0x7f80f80cc8b0 2024-04-25T09:04:08.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f6000640 1 -- 172.21.15.173:0/1638232157 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80dc007940 con 0x7f80f80cc8b0 2024-04-25T09:04:08.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f6000640 1 -- 172.21.15.173:0/1638232157 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1741382754 0 0) 0x7f80dc007940 con 0x7f80f80cc8b0 2024-04-25T09:04:08.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f6000640 1 -- 172.21.15.173:0/1638232157 >> v2:172.21.15.194:3300/0 conn(0x7f80f80ccd30 msgr2=0x7f80f80cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f6000640 1 --2- 172.21.15.173:0/1638232157 >> v2:172.21.15.194:3300/0 conn(0x7f80f80ccd30 0x7f80f80cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f6000640 1 -- 172.21.15.173:0/1638232157 >> v1:172.21.15.194:6789/0 conn(0x7f80f8145250 legacy=0x7f80f815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f6000640 1 -- 172.21.15.173:0/1638232157 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f806dce0 con 0x7f80f80cc8b0 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f6000640 1 -- 172.21.15.173:0/1638232157 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f80e0001680 con 0x7f80f80cc8b0 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f6000640 1 -- 172.21.15.173:0/1638232157 >> v1:172.21.15.173:6789/0 conn(0x7f80f80cc8b0 legacy=0x7f80f80ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f6000640 1 --2- 172.21.15.173:0/1638232157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80dc007e20 0x7f80dc008240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f6000640 1 --2- 172.21.15.173:0/1638232157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80dc008c20 0x7f80dc0090a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f6000640 1 --2- 172.21.15.173:0/1638232157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80dc0095e0 0x7f80dc00fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f6000640 1 -- 172.21.15.173:0/1638232157 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f806da00 con 0x7f80dc008c20 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f6000640 1 -- 172.21.15.173:0/1638232157 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc0104e0 con 0x7f80dc007e20 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f6000640 1 -- 172.21.15.173:0/1638232157 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc0106e0 con 0x7f80dc0095e0 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80ee000640 1 --2- 172.21.15.173:0/1638232157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80dc008c20 0x7f80dc0090a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f6a00640 1 --2- 172.21.15.173:0/1638232157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80dc007e20 0x7f80dc008240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f7400640 1 --2- 172.21.15.173:0/1638232157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80dc0095e0 0x7f80dc00fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80ee000640 1 -- 172.21.15.173:0/1638232157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80dc0095e0 msgr2=0x7f80dc00fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80ee000640 1 --2- 172.21.15.173:0/1638232157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80dc0095e0 0x7f80dc00fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80ee000640 1 -- 172.21.15.173:0/1638232157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80dc007e20 msgr2=0x7f80dc008240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80ee000640 1 --2- 172.21.15.173:0/1638232157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80dc007e20 0x7f80dc008240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80ee000640 1 -- 172.21.15.173:0/1638232157 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc007940 con 0x7f80dc008c20 2024-04-25T09:04:08.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.077+0000 7f80f7400640 1 -- 172.21.15.173:0/1638232157 reap_dead start 2024-04-25T09:04:08.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.081+0000 7f80ee000640 1 --2- 172.21.15.173:0/1638232157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80dc008c20 0x7f80dc0090a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f80e000c110 tx=0x7f80e001f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a4cceb8c817e77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.081+0000 7f80f6000640 1 -- 172.21.15.173:0/1638232157 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0007c30 con 0x7f80dc008c20 2024-04-25T09:04:08.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.081+0000 7f80f6000640 1 -- 172.21.15.173:0/1638232157 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e00ac020 con 0x7f80dc008c20 2024-04-25T09:04:08.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.081+0000 7f80f6000640 1 -- 172.21.15.173:0/1638232157 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e00058e0 con 0x7f80dc008c20 2024-04-25T09:04:08.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.081+0000 7f80fde00640 1 -- 172.21.15.173:0/1638232157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80dc008c20 msgr2=0x7f80dc0090a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.081+0000 7f80fde00640 1 --2- 172.21.15.173:0/1638232157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80dc008c20 0x7f80dc0090a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f80e000c110 tx=0x7f80e001f270 comp rx=0 tx=0).stop 2024-04-25T09:04:08.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.081+0000 7f80fde00640 1 -- 172.21.15.173:0/1638232157 shutdown_connections 2024-04-25T09:04:08.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.081+0000 7f80fde00640 1 --2- 172.21.15.173:0/1638232157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80dc008c20 0x7f80dc0090a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.081+0000 7f80fde00640 1 -- 172.21.15.173:0/1638232157 >> 172.21.15.173:0/1638232157 conn(0x7f80f806ac90 msgr2=0x7f80f806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.081+0000 7f80fde00640 1 -- 172.21.15.173:0/1638232157 shutdown_connections 2024-04-25T09:04:08.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.081+0000 7f80fde00640 1 -- 172.21.15.173:0/1638232157 wait complete. 2024-04-25T09:04:08.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.081+0000 7f80fde00640 1 Processor -- start 2024-04-25T09:04:08.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.081+0000 7f80fde00640 1 -- start start 2024-04-25T09:04:08.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80fde00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80dc008c20 0x7f80f813f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80fde00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80f813fef0 0x7f80f80aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80fde00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80f80ab400 0x7f80f80a85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80fde00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f8145630 con 0x7f80dc008c20 2024-04-25T09:04:08.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80fde00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f806e2a0 con 0x7f80f813fef0 2024-04-25T09:04:08.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80fde00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f806ef80 con 0x7f80f80ab400 2024-04-25T09:04:08.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80f6a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80dc008c20 0x7f80f813f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80f6a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80dc008c20 0x7f80f813f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50418/0 (socket says 172.21.15.173:50418) 2024-04-25T09:04:08.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80f6a00640 1 -- 172.21.15.173:0/3287823246 learned_addr learned my addr 172.21.15.173:0/3287823246 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:08.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80f7400640 1 --2- 172.21.15.173:0/3287823246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80f80ab400 0x7f80f80a85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80ee000640 1 --2- 172.21.15.173:0/3287823246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80f813fef0 0x7f80f80aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80f6a00640 1 -- 172.21.15.173:0/3287823246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80f80ab400 msgr2=0x7f80f80a85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80f6a00640 1 --2- 172.21.15.173:0/3287823246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80f80ab400 0x7f80f80a85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80f6a00640 1 -- 172.21.15.173:0/3287823246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80f813fef0 msgr2=0x7f80f80aaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80f6a00640 1 --2- 172.21.15.173:0/3287823246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80f813fef0 0x7f80f80aaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80f6a00640 1 -- 172.21.15.173:0/3287823246 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f815e3f0 con 0x7f80dc008c20 2024-04-25T09:04:08.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80f6a00640 1 --2- 172.21.15.173:0/3287823246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80dc008c20 0x7f80f813f640 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f80e800f7a0 tx=0x7f80e800fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80efe00640 1 -- 172.21.15.173:0/3287823246 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80050d0 con 0x7f80dc008c20 2024-04-25T09:04:08.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80efe00640 1 -- 172.21.15.173:0/3287823246 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e8018070 con 0x7f80dc008c20 2024-04-25T09:04:08.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80efe00640 1 -- 172.21.15.173:0/3287823246 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8005490 con 0x7f80dc008c20 2024-04-25T09:04:08.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80fde00640 1 -- 172.21.15.173:0/3287823246 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f815e6d0 con 0x7f80dc008c20 2024-04-25T09:04:08.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80fde00640 1 -- 172.21.15.173:0/3287823246 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f815ec90 con 0x7f80dc008c20 2024-04-25T09:04:08.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80fde00640 1 -- 172.21.15.173:0/3287823246 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f8073a40 con 0x7f80dc008c20 2024-04-25T09:04:08.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.085+0000 7f80efe00640 1 -- 172.21.15.173:0/3287823246 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f80e800d730 con 0x7f80dc008c20 2024-04-25T09:04:08.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.089+0000 7f80efe00640 1 --2- 172.21.15.173:0/3287823246 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f80d4067130 0x7f80d40695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.089+0000 7f80efe00640 1 -- 172.21.15.173:0/3287823246 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f80e8084ed0 con 0x7f80dc008c20 2024-04-25T09:04:08.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.089+0000 7f80ee000640 1 --2- 172.21.15.173:0/3287823246 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f80d4067130 0x7f80d40695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.089+0000 7f80ee000640 1 --2- 172.21.15.173:0/3287823246 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f80d4067130 0x7f80d40695f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f80e00ad000 tx=0x7f80f815bf00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.093+0000 7f80efe00640 1 -- 172.21.15.173:0/3287823246 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f80e8055d50 con 0x7f80dc008c20 2024-04-25T09:04:08.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.245+0000 7f80fde00640 1 -- 172.21.15.173:0/3287823246 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80f80ab7e0 con 0x7f80d4067130 2024-04-25T09:04:08.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.249+0000 7f80efe00640 1 -- 172.21.15.173:0/3287823246 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247366 (secure 0 0 0) 0x7f80f80ab7e0 con 0x7f80d4067130 2024-04-25T09:04:08.243 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:04:08.244 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:04:08.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.253+0000 7f80fde00640 1 -- 172.21.15.173:0/3287823246 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f80d4067130 msgr2=0x7f80d40695f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.253+0000 7f80fde00640 1 --2- 172.21.15.173:0/3287823246 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f80d4067130 0x7f80d40695f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f80e00ad000 tx=0x7f80f815bf00 comp rx=0 tx=0).stop 2024-04-25T09:04:08.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.253+0000 7f80fde00640 1 -- 172.21.15.173:0/3287823246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80dc008c20 msgr2=0x7f80f813f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.253+0000 7f80fde00640 1 --2- 172.21.15.173:0/3287823246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80dc008c20 0x7f80f813f640 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f80e800f7a0 tx=0x7f80e800fc60 comp rx=0 tx=0).stop 2024-04-25T09:04:08.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.253+0000 7f80fde00640 1 -- 172.21.15.173:0/3287823246 shutdown_connections 2024-04-25T09:04:08.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.253+0000 7f80fde00640 1 --2- 172.21.15.173:0/3287823246 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f80d4067130 0x7f80d40695f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.253+0000 7f80fde00640 1 --2- 172.21.15.173:0/3287823246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80f80ab400 0x7f80f80a85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.253+0000 7f80fde00640 1 --2- 172.21.15.173:0/3287823246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80f813fef0 0x7f80f80aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.253+0000 7f80fde00640 1 --2- 172.21.15.173:0/3287823246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80dc008c20 0x7f80f813f640 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.253+0000 7f80fde00640 1 -- 172.21.15.173:0/3287823246 >> 172.21.15.173:0/3287823246 conn(0x7f80f806ac90 msgr2=0x7f80f80b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.253+0000 7f80fde00640 1 -- 172.21.15.173:0/3287823246 shutdown_connections 2024-04-25T09:04:08.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.253+0000 7f80fde00640 1 -- 172.21.15.173:0/3287823246 wait complete. 2024-04-25T09:04:08.264 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-04-25T09:04:06.741359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":177,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220688,"kb_used_data":4496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754032,"statfs":{"total":773094113280,"available":772868128768,"internally_reserved":0,"allocated":4603904,"data_stored":2626380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.925810"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.834554+0000","last_change":"2024-04-25T09:04:02.834554+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.834554+0000","last_undegraded":"2024-04-25T09:04:02.834554+0000","last_fullsized":"2024-04-25T09:04:02.834554+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829079+0000","last_change":"2024-04-25T09:04:02.829079+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829079+0000","last_undegraded":"2024-04-25T09:04:02.829079+0000","last_fullsized":"2024-04-25T09:04:02.829079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.835681+0000","last_change":"2024-04-25T09:04:02.835681+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.835681+0000","last_undegraded":"2024-04-25T09:04:02.835681+0000","last_fullsized":"2024-04-25T09:04:02.835681+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.840377+0000","last_change":"2024-04-25T09:04:02.840377+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.840377+0000","last_undegraded":"2024-04-25T09:04:02.840377+0000","last_fullsized":"2024-04-25T09:04:02.840377+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839449+0000","last_change":"2024-04-25T09:04:02.839449+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839449+0000","last_undegraded":"2024-04-25T09:04:02.839449+0000","last_fullsized":"2024-04-25T09:04:02.839449+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.830875+0000","last_change":"2024-04-25T09:04:02.830875+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.830875+0000","last_undegraded":"2024-04-25T09:04:02.830875+0000","last_fullsized":"2024-04-25T09:04:02.830875+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867714+0000","last_change":"2024-04-25T09:04:03.863689+0000","last_active":"2024-04-25T09:04:03.867714+0000","last_peered":"2024-04-25T09:04:03.867714+0000","last_clean":"2024-04-25T09:04:03.867714+0000","last_became_active":"2024-04-25T09:04:03.863414+0000","last_became_peered":"2024-04-25T09:04:03.863414+0000","last_unstale":"2024-04-25T09:04:03.867714+0000","last_undegraded":"2024-04-25T09:04:03.867714+0000","last_fullsized":"2024-04-25T09:04:03.867714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:03.240175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829132+0000","last_change":"2024-04-25T09:04:02.829132+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829132+0000","last_undegraded":"2024-04-25T09:04:02.829132+0000","last_fullsized":"2024-04-25T09:04:02.829132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.832626+0000","last_change":"2024-04-25T09:04:02.832626+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.832626+0000","last_undegraded":"2024-04-25T09:04:02.832626+0000","last_fullsized":"2024-04-25T09:04:02.832626+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.866842+0000","last_change":"2024-04-25T09:04:03.861826+0000","last_active":"2024-04-25T09:04:03.866842+0000","last_peered":"2024-04-25T09:04:03.866842+0000","last_clean":"2024-04-25T09:04:03.866842+0000","last_became_active":"2024-04-25T09:04:03.861513+0000","last_became_peered":"2024-04-25T09:04:03.861513+0000","last_unstale":"2024-04-25T09:04:03.866842+0000","last_undegraded":"2024-04-25T09:04:03.866842+0000","last_fullsized":"2024-04-25T09:04:03.866842+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:51:43.190968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.865253+0000","last_change":"2024-04-25T09:04:03.853007+0000","last_active":"2024-04-25T09:04:03.865253+0000","last_peered":"2024-04-25T09:04:03.865253+0000","last_clean":"2024-04-25T09:04:03.865253+0000","last_became_active":"2024-04-25T09:04:03.852718+0000","last_became_peered":"2024-04-25T09:04:03.852718+0000","last_unstale":"2024-04-25T09:04:03.865253+0000","last_undegraded":"2024-04-25T09:04:03.865253+0000","last_fullsized":"2024-04-25T09:04:03.865253+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:07.579563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.836150+0000","last_change":"2024-04-25T09:04:02.836150+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.836150+0000","last_undegraded":"2024-04-25T09:04:02.836150+0000","last_fullsized":"2024-04-25T09:04:02.836150+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867148+0000","last_change":"2024-04-25T09:04:03.861338+0000","last_active":"2024-04-25T09:04:03.867148+0000","last_peered":"2024-04-25T09:04:03.867148+0000","last_clean":"2024-04-25T09:04:03.867148+0000","last_became_active":"2024-04-25T09:04:03.856730+0000","last_became_peered":"2024-04-25T09:04:03.856730+0000","last_unstale":"2024-04-25T09:04:03.867148+0000","last_undegraded":"2024-04-25T09:04:03.867148+0000","last_fullsized":"2024-04-25T09:04:03.867148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:05.560039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.842833+0000","last_change":"2024-04-25T09:04:03.834273+0000","last_active":"2024-04-25T09:04:03.842833+0000","last_peered":"2024-04-25T09:04:03.842833+0000","last_clean":"2024-04-25T09:04:03.842833+0000","last_became_active":"2024-04-25T09:04:03.833918+0000","last_became_peered":"2024-04-25T09:04:03.833918+0000","last_unstale":"2024-04-25T09:04:03.842833+0000","last_undegraded":"2024-04-25T09:04:03.842833+0000","last_fullsized":"2024-04-25T09:04:03.842833+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:56.270822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.864760+0000","last_change":"2024-04-25T09:04:03.848586+0000","last_active":"2024-04-25T09:04:03.864760+0000","last_peered":"2024-04-25T09:04:03.864760+0000","last_clean":"2024-04-25T09:04:03.864760+0000","last_became_active":"2024-04-25T09:04:03.848329+0000","last_became_peered":"2024-04-25T09:04:03.848329+0000","last_unstale":"2024-04-25T09:04:03.864760+0000","last_undegraded":"2024-04-25T09:04:03.864760+0000","last_fullsized":"2024-04-25T09:04:03.864760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:20.275314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.841856+0000","last_change":"2024-04-25T09:04:03.835873+0000","last_active":"2024-04-25T09:04:03.841856+0000","last_peered":"2024-04-25T09:04:03.841856+0000","last_clean":"2024-04-25T09:04:03.841856+0000","last_became_active":"2024-04-25T09:04:03.835526+0000","last_became_peered":"2024-04-25T09:04:03.835526+0000","last_unstale":"2024-04-25T09:04:03.841856+0000","last_undegraded":"2024-04-25T09:04:03.841856+0000","last_fullsized":"2024-04-25T09:04:03.841856+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:58.449231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839943+0000","last_change":"2024-04-25T09:04:02.839943+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839943+0000","last_undegraded":"2024-04-25T09:04:02.839943+0000","last_fullsized":"2024-04-25T09:04:02.839943+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.840918+0000","last_change":"2024-04-25T09:04:03.836238+0000","last_active":"2024-04-25T09:04:03.840918+0000","last_peered":"2024-04-25T09:04:03.840918+0000","last_clean":"2024-04-25T09:04:03.840918+0000","last_became_active":"2024-04-25T09:04:03.835915+0000","last_became_peered":"2024-04-25T09:04:03.835915+0000","last_unstale":"2024-04-25T09:04:03.840918+0000","last_undegraded":"2024-04-25T09:04:03.840918+0000","last_fullsized":"2024-04-25T09:04:03.840918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:56.270822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867169+0000","last_change":"2024-04-25T09:04:03.861860+0000","last_active":"2024-04-25T09:04:03.867169+0000","last_peered":"2024-04-25T09:04:03.867169+0000","last_clean":"2024-04-25T09:04:03.867169+0000","last_became_active":"2024-04-25T09:04:03.861534+0000","last_became_peered":"2024-04-25T09:04:03.861534+0000","last_unstale":"2024-04-25T09:04:03.867169+0000","last_undegraded":"2024-04-25T09:04:03.867169+0000","last_fullsized":"2024-04-25T09:04:03.867169+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:15.372975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.863606+0000","last_change":"2024-04-25T09:04:03.858775+0000","last_active":"2024-04-25T09:04:03.863606+0000","last_peered":"2024-04-25T09:04:03.863606+0000","last_clean":"2024-04-25T09:04:03.863606+0000","last_became_active":"2024-04-25T09:04:03.858487+0000","last_became_peered":"2024-04-25T09:04:03.858487+0000","last_unstale":"2024-04-25T09:04:03.863606+0000","last_undegraded":"2024-04-25T09:04:03.863606+0000","last_fullsized":"2024-04-25T09:04:03.863606+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:46.311120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839364+0000","last_change":"2024-04-25T09:04:02.839364+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839364+0000","last_undegraded":"2024-04-25T09:04:02.839364+0000","last_fullsized":"2024-04-25T09:04:02.839364+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.854865+0000","last_change":"2024-04-25T09:04:03.846114+0000","last_active":"2024-04-25T09:04:03.854865+0000","last_peered":"2024-04-25T09:04:03.854865+0000","last_clean":"2024-04-25T09:04:03.854865+0000","last_became_active":"2024-04-25T09:04:03.845818+0000","last_became_peered":"2024-04-25T09:04:03.845818+0000","last_unstale":"2024-04-25T09:04:03.854865+0000","last_undegraded":"2024-04-25T09:04:03.854865+0000","last_fullsized":"2024-04-25T09:04:03.854865+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:42.547375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.831333+0000","last_change":"2024-04-25T09:04:02.831333+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.831333+0000","last_undegraded":"2024-04-25T09:04:02.831333+0000","last_fullsized":"2024-04-25T09:04:02.831333+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.859057+0000","last_change":"2024-04-25T09:04:03.853632+0000","last_active":"2024-04-25T09:04:03.859057+0000","last_peered":"2024-04-25T09:04:03.859057+0000","last_clean":"2024-04-25T09:04:03.859057+0000","last_became_active":"2024-04-25T09:04:03.851999+0000","last_became_peered":"2024-04-25T09:04:03.851999+0000","last_unstale":"2024-04-25T09:04:03.859057+0000","last_undegraded":"2024-04-25T09:04:03.859057+0000","last_fullsized":"2024-04-25T09:04:03.859057+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:24.458554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867848+0000","last_change":"2024-04-25T09:04:03.863349+0000","last_active":"2024-04-25T09:04:03.867848+0000","last_peered":"2024-04-25T09:04:03.867848+0000","last_clean":"2024-04-25T09:04:03.867848+0000","last_became_active":"2024-04-25T09:04:03.863038+0000","last_became_peered":"2024-04-25T09:04:03.863038+0000","last_unstale":"2024-04-25T09:04:03.867848+0000","last_undegraded":"2024-04-25T09:04:03.867848+0000","last_fullsized":"2024-04-25T09:04:03.867848+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:51.065910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.847063+0000","last_change":"2024-04-25T09:04:03.842430+0000","last_active":"2024-04-25T09:04:03.847063+0000","last_peered":"2024-04-25T09:04:03.847063+0000","last_clean":"2024-04-25T09:04:03.847063+0000","last_became_active":"2024-04-25T09:04:03.841747+0000","last_became_peered":"2024-04-25T09:04:03.841747+0000","last_unstale":"2024-04-25T09:04:03.847063+0000","last_undegraded":"2024-04-25T09:04:03.847063+0000","last_fullsized":"2024-04-25T09:04:03.847063+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:48.909240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.848074+0000","last_change":"2024-04-25T09:04:03.841707+0000","last_active":"2024-04-25T09:04:03.848074+0000","last_peered":"2024-04-25T09:04:03.848074+0000","last_clean":"2024-04-25T09:04:03.848074+0000","last_became_active":"2024-04-25T09:04:03.841445+0000","last_became_peered":"2024-04-25T09:04:03.841445+0000","last_unstale":"2024-04-25T09:04:03.848074+0000","last_undegraded":"2024-04-25T09:04:03.848074+0000","last_fullsized":"2024-04-25T09:04:03.848074+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:45.371612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.831186+0000","last_change":"2024-04-25T09:04:02.831186+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.831186+0000","last_undegraded":"2024-04-25T09:04:02.831186+0000","last_fullsized":"2024-04-25T09:04:02.831186+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.863490+0000","last_change":"2024-04-25T09:04:02.834352+0000","last_active":"2024-04-25T09:04:03.863490+0000","last_peered":"2024-04-25T09:04:03.863490+0000","last_clean":"2024-04-25T09:04:03.863490+0000","last_became_active":"2024-04-25T09:04:02.833884+0000","last_became_peered":"2024-04-25T09:04:02.833884+0000","last_unstale":"2024-04-25T09:04:03.863490+0000","last_undegraded":"2024-04-25T09:04:03.863490+0000","last_fullsized":"2024-04-25T09:04:03.863490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:16.243545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.830022+0000","last_change":"2024-04-25T09:04:02.830022+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.830022+0000","last_undegraded":"2024-04-25T09:04:02.830022+0000","last_fullsized":"2024-04-25T09:04:02.830022+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.850403+0000","last_change":"2024-04-25T09:04:02.844968+0000","last_active":"2024-04-25T09:04:02.850403+0000","last_peered":"2024-04-25T09:04:02.850403+0000","last_clean":"2024-04-25T09:04:02.850403+0000","last_became_active":"2024-04-25T09:04:02.844639+0000","last_became_peered":"2024-04-25T09:04:02.844639+0000","last_unstale":"2024-04-25T09:04:02.850403+0000","last_undegraded":"2024-04-25T09:04:02.850403+0000","last_fullsized":"2024-04-25T09:04:02.850403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:17.911042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.841900+0000","last_change":"2024-04-25T09:04:03.836889+0000","last_active":"2024-04-25T09:04:03.841900+0000","last_peered":"2024-04-25T09:04:03.841900+0000","last_clean":"2024-04-25T09:04:03.841900+0000","last_became_active":"2024-04-25T09:04:03.836621+0000","last_became_peered":"2024-04-25T09:04:03.836621+0000","last_unstale":"2024-04-25T09:04:03.841900+0000","last_undegraded":"2024-04-25T09:04:03.841900+0000","last_fullsized":"2024-04-25T09:04:03.841900+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:45.371612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.846214+0000","last_change":"2024-04-25T09:04:02.842347+0000","last_active":"2024-04-25T09:04:02.846214+0000","last_peered":"2024-04-25T09:04:02.846214+0000","last_clean":"2024-04-25T09:04:02.846214+0000","last_became_active":"2024-04-25T09:04:02.842050+0000","last_became_peered":"2024-04-25T09:04:02.842050+0000","last_unstale":"2024-04-25T09:04:02.846214+0000","last_undegraded":"2024-04-25T09:04:02.846214+0000","last_fullsized":"2024-04-25T09:04:02.846214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:09.975591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829413+0000","last_change":"2024-04-25T09:04:02.829413+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829413+0000","last_undegraded":"2024-04-25T09:04:02.829413+0000","last_fullsized":"2024-04-25T09:04:02.829413+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.863494+0000","last_change":"2024-04-25T09:04:02.837853+0000","last_active":"2024-04-25T09:04:03.863494+0000","last_peered":"2024-04-25T09:04:03.863494+0000","last_clean":"2024-04-25T09:04:03.863494+0000","last_became_active":"2024-04-25T09:04:02.837463+0000","last_became_peered":"2024-04-25T09:04:02.837463+0000","last_unstale":"2024-04-25T09:04:03.863494+0000","last_undegraded":"2024-04-25T09:04:03.863494+0000","last_fullsized":"2024-04-25T09:04:03.863494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.352305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.833468+0000","last_change":"2024-04-25T09:04:02.833468+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.833468+0000","last_undegraded":"2024-04-25T09:04:02.833468+0000","last_fullsized":"2024-04-25T09:04:02.833468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867065+0000","last_change":"2024-04-25T09:04:02.843213+0000","last_active":"2024-04-25T09:04:03.867065+0000","last_peered":"2024-04-25T09:04:03.867065+0000","last_clean":"2024-04-25T09:04:03.867065+0000","last_became_active":"2024-04-25T09:04:02.842911+0000","last_became_peered":"2024-04-25T09:04:02.842911+0000","last_unstale":"2024-04-25T09:04:03.867065+0000","last_undegraded":"2024-04-25T09:04:03.867065+0000","last_fullsized":"2024-04-25T09:04:03.867065+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:49.664471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.866078+0000","last_change":"2024-04-25T09:04:03.855154+0000","last_active":"2024-04-25T09:04:03.866078+0000","last_peered":"2024-04-25T09:04:03.866078+0000","last_clean":"2024-04-25T09:04:03.866078+0000","last_became_active":"2024-04-25T09:04:03.854659+0000","last_became_peered":"2024-04-25T09:04:03.854659+0000","last_unstale":"2024-04-25T09:04:03.866078+0000","last_undegraded":"2024-04-25T09:04:03.866078+0000","last_fullsized":"2024-04-25T09:04:03.866078+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:02.049425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:01.808788+0000","last_change":"2024-04-25T09:04:01.808788+0000","last_active":"2024-04-25T09:04:01.808788+0000","last_peered":"2024-04-25T09:04:01.808788+0000","last_clean":"2024-04-25T09:04:01.808788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:01.808788+0000","last_undegraded":"2024-04-25T09:04:01.808788+0000","last_fullsized":"2024-04-25T09:04:01.808788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.858918+0000","last_change":"2024-04-25T09:04:03.852928+0000","last_active":"2024-04-25T09:04:03.858918+0000","last_peered":"2024-04-25T09:04:03.858918+0000","last_clean":"2024-04-25T09:04:03.858918+0000","last_became_active":"2024-04-25T09:04:03.852667+0000","last_became_peered":"2024-04-25T09:04:03.852667+0000","last_unstale":"2024-04-25T09:04:03.858918+0000","last_undegraded":"2024-04-25T09:04:03.858918+0000","last_fullsized":"2024-04-25T09:04:03.858918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:42.513233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.853743+0000","last_change":"2024-04-25T09:04:02.850909+0000","last_active":"2024-04-25T09:04:02.853743+0000","last_peered":"2024-04-25T09:04:02.853743+0000","last_clean":"2024-04-25T09:04:02.853743+0000","last_became_active":"2024-04-25T09:04:02.850644+0000","last_became_peered":"2024-04-25T09:04:02.850644+0000","last_unstale":"2024-04-25T09:04:02.853743+0000","last_undegraded":"2024-04-25T09:04:02.853743+0000","last_fullsized":"2024-04-25T09:04:02.853743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:47.981260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.830685+0000","last_change":"2024-04-25T09:04:02.830685+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.830685+0000","last_undegraded":"2024-04-25T09:04:02.830685+0000","last_fullsized":"2024-04-25T09:04:02.830685+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.829142+0000","last_change":"2024-04-25T09:04:02.842246+0000","last_active":"2024-04-25T09:04:03.829142+0000","last_peered":"2024-04-25T09:04:03.829142+0000","last_clean":"2024-04-25T09:04:03.829142+0000","last_became_active":"2024-04-25T09:04:02.838163+0000","last_became_peered":"2024-04-25T09:04:02.838163+0000","last_unstale":"2024-04-25T09:04:03.829142+0000","last_undegraded":"2024-04-25T09:04:03.829142+0000","last_fullsized":"2024-04-25T09:04:03.829142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:21.893561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839954+0000","last_change":"2024-04-25T09:04:02.839954+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839954+0000","last_undegraded":"2024-04-25T09:04:02.839954+0000","last_fullsized":"2024-04-25T09:04:02.839954+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.840232+0000","last_change":"2024-04-25T09:04:02.837904+0000","last_active":"2024-04-25T09:04:02.840232+0000","last_peered":"2024-04-25T09:04:02.840232+0000","last_clean":"2024-04-25T09:04:02.840232+0000","last_became_active":"2024-04-25T09:04:02.837467+0000","last_became_peered":"2024-04-25T09:04:02.837467+0000","last_unstale":"2024-04-25T09:04:02.840232+0000","last_undegraded":"2024-04-25T09:04:02.840232+0000","last_fullsized":"2024-04-25T09:04:02.840232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:38.669973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.844372+0000","last_change":"2024-04-25T09:04:02.845952+0000","last_active":"2024-04-25T09:04:03.844372+0000","last_peered":"2024-04-25T09:04:03.844372+0000","last_clean":"2024-04-25T09:04:03.844372+0000","last_became_active":"2024-04-25T09:04:02.845536+0000","last_became_peered":"2024-04-25T09:04:02.845536+0000","last_unstale":"2024-04-25T09:04:03.844372+0000","last_undegraded":"2024-04-25T09:04:03.844372+0000","last_fullsized":"2024-04-25T09:04:03.844372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:25.532613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.834873+0000","last_change":"2024-04-25T09:04:02.834873+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.834873+0000","last_undegraded":"2024-04-25T09:04:02.834873+0000","last_fullsized":"2024-04-25T09:04:02.834873+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867131+0000","last_change":"2024-04-25T09:04:02.846311+0000","last_active":"2024-04-25T09:04:03.867131+0000","last_peered":"2024-04-25T09:04:03.867131+0000","last_clean":"2024-04-25T09:04:03.867131+0000","last_became_active":"2024-04-25T09:04:02.845983+0000","last_became_peered":"2024-04-25T09:04:02.845983+0000","last_unstale":"2024-04-25T09:04:03.867131+0000","last_undegraded":"2024-04-25T09:04:03.867131+0000","last_fullsized":"2024-04-25T09:04:03.867131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:23.451902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.857465+0000","last_change":"2024-04-25T09:04:03.849902+0000","last_active":"2024-04-25T09:04:03.857465+0000","last_peered":"2024-04-25T09:04:03.857465+0000","last_clean":"2024-04-25T09:04:03.857465+0000","last_became_active":"2024-04-25T09:04:03.849674+0000","last_became_peered":"2024-04-25T09:04:03.849674+0000","last_unstale":"2024-04-25T09:04:03.857465+0000","last_undegraded":"2024-04-25T09:04:03.857465+0000","last_fullsized":"2024-04-25T09:04:03.857465+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:24.458554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852108+0000","last_change":"2024-04-25T09:04:02.841438+0000","last_active":"2024-04-25T09:04:02.852108+0000","last_peered":"2024-04-25T09:04:02.852108+0000","last_clean":"2024-04-25T09:04:02.852108+0000","last_became_active":"2024-04-25T09:04:02.841168+0000","last_became_peered":"2024-04-25T09:04:02.841168+0000","last_unstale":"2024-04-25T09:04:02.852108+0000","last_undegraded":"2024-04-25T09:04:02.852108+0000","last_fullsized":"2024-04-25T09:04:02.852108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:58.258528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.833043+0000","last_change":"2024-04-25T09:04:02.833043+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.833043+0000","last_undegraded":"2024-04-25T09:04:02.833043+0000","last_fullsized":"2024-04-25T09:04:02.833043+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852156+0000","last_change":"2024-04-25T09:04:02.843180+0000","last_active":"2024-04-25T09:04:02.852156+0000","last_peered":"2024-04-25T09:04:02.852156+0000","last_clean":"2024-04-25T09:04:02.852156+0000","last_became_active":"2024-04-25T09:04:02.842871+0000","last_became_peered":"2024-04-25T09:04:02.842871+0000","last_unstale":"2024-04-25T09:04:02.852156+0000","last_undegraded":"2024-04-25T09:04:02.852156+0000","last_fullsized":"2024-04-25T09:04:02.852156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:54.157193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.828875+0000","last_change":"2024-04-25T09:04:02.828875+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.828875+0000","last_undegraded":"2024-04-25T09:04:02.828875+0000","last_fullsized":"2024-04-25T09:04:02.828875+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852804+0000","last_change":"2024-04-25T09:04:02.848772+0000","last_active":"2024-04-25T09:04:02.852804+0000","last_peered":"2024-04-25T09:04:02.852804+0000","last_clean":"2024-04-25T09:04:02.852804+0000","last_became_active":"2024-04-25T09:04:02.848498+0000","last_became_peered":"2024-04-25T09:04:02.848498+0000","last_unstale":"2024-04-25T09:04:02.852804+0000","last_undegraded":"2024-04-25T09:04:02.852804+0000","last_fullsized":"2024-04-25T09:04:02.852804+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:51.913902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.832663+0000","last_change":"2024-04-25T09:04:02.832388+0000","last_active":"2024-04-25T09:04:03.832663+0000","last_peered":"2024-04-25T09:04:03.832663+0000","last_clean":"2024-04-25T09:04:03.832663+0000","last_became_active":"2024-04-25T09:04:02.831918+0000","last_became_peered":"2024-04-25T09:04:02.831918+0000","last_unstale":"2024-04-25T09:04:03.832663+0000","last_undegraded":"2024-04-25T09:04:03.832663+0000","last_fullsized":"2024-04-25T09:04:03.832663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:21.893561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.830204+0000","last_change":"2024-04-25T09:04:02.830204+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.830204+0000","last_undegraded":"2024-04-25T09:04:02.830204+0000","last_fullsized":"2024-04-25T09:04:02.830204+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:01.808788+0000","last_change":"2024-04-25T09:04:01.808788+0000","last_active":"2024-04-25T09:04:01.808788+0000","last_peered":"2024-04-25T09:04:01.808788+0000","last_clean":"2024-04-25T09:04:01.808788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:01.808788+0000","last_undegraded":"2024-04-25T09:04:01.808788+0000","last_fullsized":"2024-04-25T09:04:01.808788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.828767+0000","last_change":"2024-04-25T09:04:02.828767+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.828767+0000","last_undegraded":"2024-04-25T09:04:02.828767+0000","last_fullsized":"2024-04-25T09:04:02.828767+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.866931+0000","last_change":"2024-04-25T09:04:02.849353+0000","last_active":"2024-04-25T09:04:03.866931+0000","last_peered":"2024-04-25T09:04:03.866931+0000","last_clean":"2024-04-25T09:04:03.866931+0000","last_became_active":"2024-04-25T09:04:02.849106+0000","last_became_peered":"2024-04-25T09:04:02.849106+0000","last_unstale":"2024-04-25T09:04:03.866931+0000","last_undegraded":"2024-04-25T09:04:03.866931+0000","last_fullsized":"2024-04-25T09:04:03.866931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:41.506582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.865263+0000","last_change":"2024-04-25T09:04:03.854450+0000","last_active":"2024-04-25T09:04:03.865263+0000","last_peered":"2024-04-25T09:04:03.865263+0000","last_clean":"2024-04-25T09:04:03.865263+0000","last_became_active":"2024-04-25T09:04:03.854184+0000","last_became_peered":"2024-04-25T09:04:03.854184+0000","last_unstale":"2024-04-25T09:04:03.865263+0000","last_undegraded":"2024-04-25T09:04:03.865263+0000","last_fullsized":"2024-04-25T09:04:03.865263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:29.586676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867227+0000","last_change":"2024-04-25T09:04:02.849282+0000","last_active":"2024-04-25T09:04:03.867227+0000","last_peered":"2024-04-25T09:04:03.867227+0000","last_clean":"2024-04-25T09:04:03.867227+0000","last_became_active":"2024-04-25T09:04:02.848992+0000","last_became_peered":"2024-04-25T09:04:02.848992+0000","last_unstale":"2024-04-25T09:04:03.867227+0000","last_undegraded":"2024-04-25T09:04:03.867227+0000","last_fullsized":"2024-04-25T09:04:03.867227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:16.243545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.847132+0000","last_change":"2024-04-25T09:04:03.843605+0000","last_active":"2024-04-25T09:04:03.847132+0000","last_peered":"2024-04-25T09:04:03.847132+0000","last_clean":"2024-04-25T09:04:03.847132+0000","last_became_active":"2024-04-25T09:04:03.840559+0000","last_became_peered":"2024-04-25T09:04:03.840559+0000","last_unstale":"2024-04-25T09:04:03.847132+0000","last_undegraded":"2024-04-25T09:04:03.847132+0000","last_fullsized":"2024-04-25T09:04:03.847132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:42.547375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.849804+0000","last_change":"2024-04-25T09:04:02.846278+0000","last_active":"2024-04-25T09:04:02.849804+0000","last_peered":"2024-04-25T09:04:02.849804+0000","last_clean":"2024-04-25T09:04:02.849804+0000","last_became_active":"2024-04-25T09:04:02.845737+0000","last_became_peered":"2024-04-25T09:04:02.845737+0000","last_unstale":"2024-04-25T09:04:02.849804+0000","last_undegraded":"2024-04-25T09:04:02.849804+0000","last_fullsized":"2024-04-25T09:04:02.849804+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:05.305933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839671+0000","last_change":"2024-04-25T09:04:02.839671+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839671+0000","last_undegraded":"2024-04-25T09:04:02.839671+0000","last_fullsized":"2024-04-25T09:04:02.839671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.847248+0000","last_change":"2024-04-25T09:04:02.842942+0000","last_active":"2024-04-25T09:04:02.847248+0000","last_peered":"2024-04-25T09:04:02.847248+0000","last_clean":"2024-04-25T09:04:02.847248+0000","last_became_active":"2024-04-25T09:04:02.842698+0000","last_became_peered":"2024-04-25T09:04:02.842698+0000","last_unstale":"2024-04-25T09:04:02.847248+0000","last_undegraded":"2024-04-25T09:04:02.847248+0000","last_fullsized":"2024-04-25T09:04:02.847248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:17.911042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.853387+0000","last_change":"2024-04-25T09:04:02.850799+0000","last_active":"2024-04-25T09:04:02.853387+0000","last_peered":"2024-04-25T09:04:02.853387+0000","last_clean":"2024-04-25T09:04:02.853387+0000","last_became_active":"2024-04-25T09:04:02.850539+0000","last_became_peered":"2024-04-25T09:04:02.850539+0000","last_unstale":"2024-04-25T09:04:02.853387+0000","last_undegraded":"2024-04-25T09:04:02.853387+0000","last_fullsized":"2024-04-25T09:04:02.853387+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:06.985756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.832567+0000","last_change":"2024-04-25T09:04:02.832567+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.832567+0000","last_undegraded":"2024-04-25T09:04:02.832567+0000","last_fullsized":"2024-04-25T09:04:02.832567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852945+0000","last_change":"2024-04-25T09:04:02.848548+0000","last_active":"2024-04-25T09:04:02.852945+0000","last_peered":"2024-04-25T09:04:02.852945+0000","last_clean":"2024-04-25T09:04:02.852945+0000","last_became_active":"2024-04-25T09:04:02.848233+0000","last_became_peered":"2024-04-25T09:04:02.848233+0000","last_unstale":"2024-04-25T09:04:02.852945+0000","last_undegraded":"2024-04-25T09:04:02.852945+0000","last_fullsized":"2024-04-25T09:04:02.852945+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:30.524420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867903+0000","last_change":"2024-04-25T09:04:03.864573+0000","last_active":"2024-04-25T09:04:03.867903+0000","last_peered":"2024-04-25T09:04:03.867903+0000","last_clean":"2024-04-25T09:04:03.867903+0000","last_became_active":"2024-04-25T09:04:03.863608+0000","last_became_peered":"2024-04-25T09:04:03.863608+0000","last_unstale":"2024-04-25T09:04:03.867903+0000","last_undegraded":"2024-04-25T09:04:03.867903+0000","last_fullsized":"2024-04-25T09:04:03.867903+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:01.044810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:01.808788+0000","last_change":"2024-04-25T09:04:01.808788+0000","last_active":"2024-04-25T09:04:01.808788+0000","last_peered":"2024-04-25T09:04:01.808788+0000","last_clean":"2024-04-25T09:04:01.808788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:01.808788+0000","last_undegraded":"2024-04-25T09:04:01.808788+0000","last_fullsized":"2024-04-25T09:04:01.808788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.828305+0000","last_change":"2024-04-25T09:04:02.828305+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.828305+0000","last_undegraded":"2024-04-25T09:04:02.828305+0000","last_fullsized":"2024-04-25T09:04:02.828305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.853416+0000","last_change":"2024-04-25T09:04:02.851466+0000","last_active":"2024-04-25T09:04:02.853416+0000","last_peered":"2024-04-25T09:04:02.853416+0000","last_clean":"2024-04-25T09:04:02.853416+0000","last_became_active":"2024-04-25T09:04:02.851149+0000","last_became_peered":"2024-04-25T09:04:02.851149+0000","last_unstale":"2024-04-25T09:04:02.853416+0000","last_undegraded":"2024-04-25T09:04:02.853416+0000","last_fullsized":"2024-04-25T09:04:02.853416+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:38.460713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829258+0000","last_change":"2024-04-25T09:04:02.829258+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829258+0000","last_undegraded":"2024-04-25T09:04:02.829258+0000","last_fullsized":"2024-04-25T09:04:02.829258+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.866817+0000","last_change":"2024-04-25T09:04:02.846991+0000","last_active":"2024-04-25T09:04:03.866817+0000","last_peered":"2024-04-25T09:04:03.866817+0000","last_clean":"2024-04-25T09:04:03.866817+0000","last_became_active":"2024-04-25T09:04:02.846719+0000","last_became_peered":"2024-04-25T09:04:02.846719+0000","last_unstale":"2024-04-25T09:04:03.866817+0000","last_undegraded":"2024-04-25T09:04:03.866817+0000","last_fullsized":"2024-04-25T09:04:03.866817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:45.304468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852914+0000","last_change":"2024-04-25T09:04:02.848506+0000","last_active":"2024-04-25T09:04:02.852914+0000","last_peered":"2024-04-25T09:04:02.852914+0000","last_clean":"2024-04-25T09:04:02.852914+0000","last_became_active":"2024-04-25T09:04:02.848199+0000","last_became_peered":"2024-04-25T09:04:02.848199+0000","last_unstale":"2024-04-25T09:04:02.852914+0000","last_undegraded":"2024-04-25T09:04:02.852914+0000","last_fullsized":"2024-04-25T09:04:02.852914+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:10.099740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.827837+0000","last_change":"2024-04-25T09:04:02.827837+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.827837+0000","last_undegraded":"2024-04-25T09:04:02.827837+0000","last_fullsized":"2024-04-25T09:04:02.827837+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.850155+0000","last_change":"2024-04-25T09:04:02.842312+0000","last_active":"2024-04-25T09:04:02.850155+0000","last_peered":"2024-04-25T09:04:02.850155+0000","last_clean":"2024-04-25T09:04:02.850155+0000","last_became_active":"2024-04-25T09:04:02.842050+0000","last_became_peered":"2024-04-25T09:04:02.842050+0000","last_unstale":"2024-04-25T09:04:02.850155+0000","last_undegraded":"2024-04-25T09:04:02.850155+0000","last_fullsized":"2024-04-25T09:04:02.850155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:09.975591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.832541+0000","last_change":"2024-04-25T09:04:02.832541+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.832541+0000","last_undegraded":"2024-04-25T09:04:02.832541+0000","last_fullsized":"2024-04-25T09:04:02.832541+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.850379+0000","last_change":"2024-04-25T09:04:02.846007+0000","last_active":"2024-04-25T09:04:02.850379+0000","last_peered":"2024-04-25T09:04:02.850379+0000","last_clean":"2024-04-25T09:04:02.850379+0000","last_became_active":"2024-04-25T09:04:02.844376+0000","last_became_peered":"2024-04-25T09:04:02.844376+0000","last_unstale":"2024-04-25T09:04:02.850379+0000","last_undegraded":"2024-04-25T09:04:02.850379+0000","last_fullsized":"2024-04-25T09:04:02.850379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:51.913902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829279+0000","last_change":"2024-04-25T09:04:02.829279+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829279+0000","last_undegraded":"2024-04-25T09:04:02.829279+0000","last_fullsized":"2024-04-25T09:04:02.829279+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.833069+0000","last_change":"2024-04-25T09:04:02.844380+0000","last_active":"2024-04-25T09:04:03.833069+0000","last_peered":"2024-04-25T09:04:03.833069+0000","last_clean":"2024-04-25T09:04:03.833069+0000","last_became_active":"2024-04-25T09:04:02.843215+0000","last_became_peered":"2024-04-25T09:04:02.843215+0000","last_unstale":"2024-04-25T09:04:03.833069+0000","last_undegraded":"2024-04-25T09:04:03.833069+0000","last_fullsized":"2024-04-25T09:04:03.833069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.352305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.847033+0000","last_change":"2024-04-25T09:04:03.840896+0000","last_active":"2024-04-25T09:04:03.847033+0000","last_peered":"2024-04-25T09:04:03.847033+0000","last_clean":"2024-04-25T09:04:03.847033+0000","last_became_active":"2024-04-25T09:04:03.840575+0000","last_became_peered":"2024-04-25T09:04:03.840575+0000","last_unstale":"2024-04-25T09:04:03.847033+0000","last_undegraded":"2024-04-25T09:04:03.847033+0000","last_fullsized":"2024-04-25T09:04:03.847033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:48.909240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.829569+0000","last_change":"2024-04-25T09:04:02.837823+0000","last_active":"2024-04-25T09:04:03.829569+0000","last_peered":"2024-04-25T09:04:03.829569+0000","last_clean":"2024-04-25T09:04:03.829569+0000","last_became_active":"2024-04-25T09:04:02.837539+0000","last_became_peered":"2024-04-25T09:04:02.837539+0000","last_unstale":"2024-04-25T09:04:03.829569+0000","last_undegraded":"2024-04-25T09:04:03.829569+0000","last_fullsized":"2024-04-25T09:04:03.829569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:57.442579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.838697+0000","last_change":"2024-04-25T09:04:02.837731+0000","last_active":"2024-04-25T09:04:02.838697+0000","last_peered":"2024-04-25T09:04:02.838697+0000","last_clean":"2024-04-25T09:04:02.838697+0000","last_became_active":"2024-04-25T09:04:02.837436+0000","last_became_peered":"2024-04-25T09:04:02.837436+0000","last_unstale":"2024-04-25T09:04:02.838697+0000","last_undegraded":"2024-04-25T09:04:02.838697+0000","last_fullsized":"2024-04-25T09:04:02.838697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:06.695209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867812+0000","last_change":"2024-04-25T09:04:03.864362+0000","last_active":"2024-04-25T09:04:03.867812+0000","last_peered":"2024-04-25T09:04:03.867812+0000","last_clean":"2024-04-25T09:04:03.867812+0000","last_became_active":"2024-04-25T09:04:03.863013+0000","last_became_peered":"2024-04-25T09:04:03.863013+0000","last_unstale":"2024-04-25T09:04:03.867812+0000","last_undegraded":"2024-04-25T09:04:03.867812+0000","last_fullsized":"2024-04-25T09:04:03.867812+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:08.778151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:01.808788+0000","last_change":"2024-04-25T09:04:01.808788+0000","last_active":"2024-04-25T09:04:01.808788+0000","last_peered":"2024-04-25T09:04:01.808788+0000","last_clean":"2024-04-25T09:04:01.808788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:01.808788+0000","last_undegraded":"2024-04-25T09:04:01.808788+0000","last_fullsized":"2024-04-25T09:04:01.808788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":194,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:03:57.298266+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:03:57.298266+0000","last_peered":"2024-04-25T09:03:57.298266+0000","last_clean":"2024-04-25T09:03:57.298266+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:03:57.298266+0000","last_undegraded":"2024-04-25T09:03:57.298266+0000","last_fullsized":"2024-04-25T09:03:57.298266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":56,"acting":56,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1024000,"data_stored":772683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":999424,"data_stored":759807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:04:08.268 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:04:08.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.457+0000 7f220d800640 1 Processor -- start 2024-04-25T09:04:08.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.457+0000 7f220d800640 1 -- start start 2024-04-25T09:04:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.457+0000 7f220d800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f220815da60 0x7f220809a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.457+0000 7f220d800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f220806c270 0x7f220806c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.457+0000 7f220d800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f220806ccf0 0x7f22080b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.457+0000 7f220d800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22080cc660 con 0x7f220806ccf0 2024-04-25T09:04:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.457+0000 7f220d800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220809ad60 con 0x7f220806c270 2024-04-25T09:04:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.457+0000 7f220d800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22080cbd30 con 0x7f220815da60 2024-04-25T09:04:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.457+0000 7f220ce00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f220806ccf0 0x7f22080b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.457+0000 7f220ce00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f220806ccf0 0x7f22080b22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50426/0 (socket says 172.21.15.173:50426) 2024-04-25T09:04:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.457+0000 7f220ce00640 1 -- 172.21.15.173:0/4054540905 learned_addr learned my addr 172.21.15.173:0/4054540905 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.457+0000 7f2207400640 1 --2- 172.21.15.173:0/4054540905 >> v2:172.21.15.194:3300/0 conn(0x7f220806c270 0x7f220806c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.457+0000 7f2207e00640 1 --2- 172.21.15.173:0/4054540905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f220815da60 0x7f220809a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.457+0000 7f220ce00640 1 -- 172.21.15.173:0/4054540905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f220815da60 msgr2=0x7f220809a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.457+0000 7f220ce00640 1 --2- 172.21.15.173:0/4054540905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f220815da60 0x7f220809a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.457+0000 7f220ce00640 1 -- 172.21.15.173:0/4054540905 >> v2:172.21.15.194:3300/0 conn(0x7f220806c270 msgr2=0x7f220806c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.457+0000 7f220ce00640 1 --2- 172.21.15.173:0/4054540905 >> v2:172.21.15.194:3300/0 conn(0x7f220806c270 0x7f220806c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.457+0000 7f220ce00640 1 -- 172.21.15.173:0/4054540905 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22080cc010 con 0x7f220806ccf0 2024-04-25T09:04:08.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.461+0000 7f220ce00640 1 --2- 172.21.15.173:0/4054540905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f220806ccf0 0x7f22080b22c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2208072520 tx=0x7f220001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24c07c751f8cec8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.461+0000 7f2206a00640 1 -- 172.21.15.173:0/4054540905 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22000a5680 con 0x7f220806ccf0 2024-04-25T09:04:08.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.461+0000 7f2206a00640 1 -- 172.21.15.173:0/4054540905 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22000a5820 con 0x7f220806ccf0 2024-04-25T09:04:08.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.461+0000 7f2206a00640 1 -- 172.21.15.173:0/4054540905 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22000a5bf0 con 0x7f220806ccf0 2024-04-25T09:04:08.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.461+0000 7f220d800640 1 -- 172.21.15.173:0/4054540905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f220806ccf0 msgr2=0x7f22080b22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.461+0000 7f220d800640 1 --2- 172.21.15.173:0/4054540905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f220806ccf0 0x7f22080b22c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2208072520 tx=0x7f220001c9f0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.461+0000 7f220d800640 1 -- 172.21.15.173:0/4054540905 shutdown_connections 2024-04-25T09:04:08.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.461+0000 7f220d800640 1 --2- 172.21.15.173:0/4054540905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f220806ccf0 0x7f22080b22c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.461+0000 7f220d800640 1 --2- 172.21.15.173:0/4054540905 >> v2:172.21.15.194:3300/0 conn(0x7f220806c270 0x7f220806c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.461+0000 7f220d800640 1 --2- 172.21.15.173:0/4054540905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f220815da60 0x7f220809a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.461+0000 7f220d800640 1 -- 172.21.15.173:0/4054540905 >> 172.21.15.173:0/4054540905 conn(0x7f22080b3130 msgr2=0x7f22080b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.461+0000 7f220d800640 1 -- 172.21.15.173:0/4054540905 shutdown_connections 2024-04-25T09:04:08.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.461+0000 7f220d800640 1 -- 172.21.15.173:0/4054540905 wait complete. 2024-04-25T09:04:08.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.461+0000 7f220d800640 1 Processor -- start 2024-04-25T09:04:08.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.461+0000 7f220d800640 1 -- start start 2024-04-25T09:04:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f220d800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f220806c270 0x7f22081546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f220d800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f220806ccf0 0x7f22080c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f220d800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f220815da60 0x7f22080c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f220d800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220809aaf0 con 0x7f220806ccf0 2024-04-25T09:04:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f220d800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220809a970 con 0x7f220806c270 2024-04-25T09:04:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f220d800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22080cf880 con 0x7f220815da60 2024-04-25T09:04:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f2207400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f220806ccf0 0x7f22080c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f2207400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f220806ccf0 0x7f22080c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50438/0 (socket says 172.21.15.173:50438) 2024-04-25T09:04:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f2207400640 1 -- 172.21.15.173:0/2881568027 learned_addr learned my addr 172.21.15.173:0/2881568027 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f2207e00640 1 --2- 172.21.15.173:0/2881568027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f220806c270 0x7f22081546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f220ce00640 1 --2- 172.21.15.173:0/2881568027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f220815da60 0x7f22080c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f2207e00640 1 -- 172.21.15.173:0/2881568027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f220815da60 msgr2=0x7f22080c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f2207e00640 1 --2- 172.21.15.173:0/2881568027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f220815da60 0x7f22080c7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f2207e00640 1 -- 172.21.15.173:0/2881568027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f220806ccf0 msgr2=0x7f22080c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f2207e00640 1 --2- 172.21.15.173:0/2881568027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f220806ccf0 0x7f22080c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f2207e00640 1 -- 172.21.15.173:0/2881568027 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22080b43e0 con 0x7f220806c270 2024-04-25T09:04:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f2207400640 1 --2- 172.21.15.173:0/2881568027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f220806ccf0 0x7f22080c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f2207e00640 1 --2- 172.21.15.173:0/2881568027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f220806c270 0x7f22081546b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f21f800e870 tx=0x7f21f800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f21ffe00640 1 -- 172.21.15.173:0/2881568027 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f8017070 con 0x7f220806c270 2024-04-25T09:04:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f21ffe00640 1 -- 172.21.15.173:0/2881568027 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f800ee60 con 0x7f220806c270 2024-04-25T09:04:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f220d800640 1 -- 172.21.15.173:0/2881568027 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22080b46c0 con 0x7f220806c270 2024-04-25T09:04:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f21ffe00640 1 -- 172.21.15.173:0/2881568027 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f800cb60 con 0x7f220806c270 2024-04-25T09:04:08.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f220d800640 1 -- 172.21.15.173:0/2881568027 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22080b4c80 con 0x7f220806c270 2024-04-25T09:04:08.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.465+0000 7f220d800640 1 -- 172.21.15.173:0/2881568027 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2208073a40 con 0x7f220806c270 2024-04-25T09:04:08.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.469+0000 7f21ffe00640 1 -- 172.21.15.173:0/2881568027 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f21f801a070 con 0x7f220806c270 2024-04-25T09:04:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.469+0000 7f21ffe00640 1 --2- 172.21.15.173:0/2881568027 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f21e8066f90 0x7f21e8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.469+0000 7f21ffe00640 1 -- 172.21.15.173:0/2881568027 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f21f8085720 con 0x7f220806c270 2024-04-25T09:04:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.469+0000 7f2207400640 1 --2- 172.21.15.173:0/2881568027 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f21e8066f90 0x7f21e8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.469+0000 7f2207400640 1 --2- 172.21.15.173:0/2881568027 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f21e8066f90 0x7f21e8069450 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f22080ccaf0 tx=0x7f21f4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.473+0000 7f21ffe00640 1 -- 172.21.15.173:0/2881568027 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f21f8055f30 con 0x7f220806c270 2024-04-25T09:04:08.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.621+0000 7f220d800640 1 -- 172.21.15.173:0/2881568027 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22080c8390 con 0x7f21e8066f90 2024-04-25T09:04:08.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.629+0000 7f21ffe00640 1 -- 172.21.15.173:0/2881568027 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247366 (secure 0 0 0) 0x7f22080c8390 con 0x7f21e8066f90 2024-04-25T09:04:08.622 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:04:08.623 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:04:08.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.633+0000 7f220d800640 1 -- 172.21.15.173:0/2881568027 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f21e8066f90 msgr2=0x7f21e8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.633+0000 7f220d800640 1 --2- 172.21.15.173:0/2881568027 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f21e8066f90 0x7f21e8069450 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f22080ccaf0 tx=0x7f21f4009190 comp rx=0 tx=0).stop 2024-04-25T09:04:08.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.633+0000 7f220d800640 1 -- 172.21.15.173:0/2881568027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f220806c270 msgr2=0x7f22081546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.633+0000 7f220d800640 1 --2- 172.21.15.173:0/2881568027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f220806c270 0x7f22081546b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f21f800e870 tx=0x7f21f800ed30 comp rx=0 tx=0).stop 2024-04-25T09:04:08.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.633+0000 7f220d800640 1 -- 172.21.15.173:0/2881568027 shutdown_connections 2024-04-25T09:04:08.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.633+0000 7f220d800640 1 --2- 172.21.15.173:0/2881568027 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f21e8066f90 0x7f21e8069450 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.633+0000 7f220d800640 1 --2- 172.21.15.173:0/2881568027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f220815da60 0x7f22080c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.633+0000 7f220d800640 1 --2- 172.21.15.173:0/2881568027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f220806ccf0 0x7f22080c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.633+0000 7f220d800640 1 --2- 172.21.15.173:0/2881568027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f220806c270 0x7f22081546b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.633+0000 7f220d800640 1 -- 172.21.15.173:0/2881568027 >> 172.21.15.173:0/2881568027 conn(0x7f22080b3130 msgr2=0x7f220806ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.633+0000 7f220d800640 1 -- 172.21.15.173:0/2881568027 shutdown_connections 2024-04-25T09:04:08.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.633+0000 7f220d800640 1 -- 172.21.15.173:0/2881568027 wait complete. 2024-04-25T09:04:08.645 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-04-25T09:04:06.741359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":177,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220688,"kb_used_data":4496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754032,"statfs":{"total":773094113280,"available":772868128768,"internally_reserved":0,"allocated":4603904,"data_stored":2626380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.925810"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.834554+0000","last_change":"2024-04-25T09:04:02.834554+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.834554+0000","last_undegraded":"2024-04-25T09:04:02.834554+0000","last_fullsized":"2024-04-25T09:04:02.834554+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829079+0000","last_change":"2024-04-25T09:04:02.829079+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829079+0000","last_undegraded":"2024-04-25T09:04:02.829079+0000","last_fullsized":"2024-04-25T09:04:02.829079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.835681+0000","last_change":"2024-04-25T09:04:02.835681+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.835681+0000","last_undegraded":"2024-04-25T09:04:02.835681+0000","last_fullsized":"2024-04-25T09:04:02.835681+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.840377+0000","last_change":"2024-04-25T09:04:02.840377+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.840377+0000","last_undegraded":"2024-04-25T09:04:02.840377+0000","last_fullsized":"2024-04-25T09:04:02.840377+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839449+0000","last_change":"2024-04-25T09:04:02.839449+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839449+0000","last_undegraded":"2024-04-25T09:04:02.839449+0000","last_fullsized":"2024-04-25T09:04:02.839449+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.830875+0000","last_change":"2024-04-25T09:04:02.830875+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.830875+0000","last_undegraded":"2024-04-25T09:04:02.830875+0000","last_fullsized":"2024-04-25T09:04:02.830875+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867714+0000","last_change":"2024-04-25T09:04:03.863689+0000","last_active":"2024-04-25T09:04:03.867714+0000","last_peered":"2024-04-25T09:04:03.867714+0000","last_clean":"2024-04-25T09:04:03.867714+0000","last_became_active":"2024-04-25T09:04:03.863414+0000","last_became_peered":"2024-04-25T09:04:03.863414+0000","last_unstale":"2024-04-25T09:04:03.867714+0000","last_undegraded":"2024-04-25T09:04:03.867714+0000","last_fullsized":"2024-04-25T09:04:03.867714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:03.240175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829132+0000","last_change":"2024-04-25T09:04:02.829132+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829132+0000","last_undegraded":"2024-04-25T09:04:02.829132+0000","last_fullsized":"2024-04-25T09:04:02.829132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.832626+0000","last_change":"2024-04-25T09:04:02.832626+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.832626+0000","last_undegraded":"2024-04-25T09:04:02.832626+0000","last_fullsized":"2024-04-25T09:04:02.832626+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.866842+0000","last_change":"2024-04-25T09:04:03.861826+0000","last_active":"2024-04-25T09:04:03.866842+0000","last_peered":"2024-04-25T09:04:03.866842+0000","last_clean":"2024-04-25T09:04:03.866842+0000","last_became_active":"2024-04-25T09:04:03.861513+0000","last_became_peered":"2024-04-25T09:04:03.861513+0000","last_unstale":"2024-04-25T09:04:03.866842+0000","last_undegraded":"2024-04-25T09:04:03.866842+0000","last_fullsized":"2024-04-25T09:04:03.866842+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:51:43.190968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.865253+0000","last_change":"2024-04-25T09:04:03.853007+0000","last_active":"2024-04-25T09:04:03.865253+0000","last_peered":"2024-04-25T09:04:03.865253+0000","last_clean":"2024-04-25T09:04:03.865253+0000","last_became_active":"2024-04-25T09:04:03.852718+0000","last_became_peered":"2024-04-25T09:04:03.852718+0000","last_unstale":"2024-04-25T09:04:03.865253+0000","last_undegraded":"2024-04-25T09:04:03.865253+0000","last_fullsized":"2024-04-25T09:04:03.865253+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:07.579563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.836150+0000","last_change":"2024-04-25T09:04:02.836150+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.836150+0000","last_undegraded":"2024-04-25T09:04:02.836150+0000","last_fullsized":"2024-04-25T09:04:02.836150+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867148+0000","last_change":"2024-04-25T09:04:03.861338+0000","last_active":"2024-04-25T09:04:03.867148+0000","last_peered":"2024-04-25T09:04:03.867148+0000","last_clean":"2024-04-25T09:04:03.867148+0000","last_became_active":"2024-04-25T09:04:03.856730+0000","last_became_peered":"2024-04-25T09:04:03.856730+0000","last_unstale":"2024-04-25T09:04:03.867148+0000","last_undegraded":"2024-04-25T09:04:03.867148+0000","last_fullsized":"2024-04-25T09:04:03.867148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:05.560039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.842833+0000","last_change":"2024-04-25T09:04:03.834273+0000","last_active":"2024-04-25T09:04:03.842833+0000","last_peered":"2024-04-25T09:04:03.842833+0000","last_clean":"2024-04-25T09:04:03.842833+0000","last_became_active":"2024-04-25T09:04:03.833918+0000","last_became_peered":"2024-04-25T09:04:03.833918+0000","last_unstale":"2024-04-25T09:04:03.842833+0000","last_undegraded":"2024-04-25T09:04:03.842833+0000","last_fullsized":"2024-04-25T09:04:03.842833+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:56.270822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.864760+0000","last_change":"2024-04-25T09:04:03.848586+0000","last_active":"2024-04-25T09:04:03.864760+0000","last_peered":"2024-04-25T09:04:03.864760+0000","last_clean":"2024-04-25T09:04:03.864760+0000","last_became_active":"2024-04-25T09:04:03.848329+0000","last_became_peered":"2024-04-25T09:04:03.848329+0000","last_unstale":"2024-04-25T09:04:03.864760+0000","last_undegraded":"2024-04-25T09:04:03.864760+0000","last_fullsized":"2024-04-25T09:04:03.864760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:20.275314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.841856+0000","last_change":"2024-04-25T09:04:03.835873+0000","last_active":"2024-04-25T09:04:03.841856+0000","last_peered":"2024-04-25T09:04:03.841856+0000","last_clean":"2024-04-25T09:04:03.841856+0000","last_became_active":"2024-04-25T09:04:03.835526+0000","last_became_peered":"2024-04-25T09:04:03.835526+0000","last_unstale":"2024-04-25T09:04:03.841856+0000","last_undegraded":"2024-04-25T09:04:03.841856+0000","last_fullsized":"2024-04-25T09:04:03.841856+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:58.449231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839943+0000","last_change":"2024-04-25T09:04:02.839943+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839943+0000","last_undegraded":"2024-04-25T09:04:02.839943+0000","last_fullsized":"2024-04-25T09:04:02.839943+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.840918+0000","last_change":"2024-04-25T09:04:03.836238+0000","last_active":"2024-04-25T09:04:03.840918+0000","last_peered":"2024-04-25T09:04:03.840918+0000","last_clean":"2024-04-25T09:04:03.840918+0000","last_became_active":"2024-04-25T09:04:03.835915+0000","last_became_peered":"2024-04-25T09:04:03.835915+0000","last_unstale":"2024-04-25T09:04:03.840918+0000","last_undegraded":"2024-04-25T09:04:03.840918+0000","last_fullsized":"2024-04-25T09:04:03.840918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:56.270822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867169+0000","last_change":"2024-04-25T09:04:03.861860+0000","last_active":"2024-04-25T09:04:03.867169+0000","last_peered":"2024-04-25T09:04:03.867169+0000","last_clean":"2024-04-25T09:04:03.867169+0000","last_became_active":"2024-04-25T09:04:03.861534+0000","last_became_peered":"2024-04-25T09:04:03.861534+0000","last_unstale":"2024-04-25T09:04:03.867169+0000","last_undegraded":"2024-04-25T09:04:03.867169+0000","last_fullsized":"2024-04-25T09:04:03.867169+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:15.372975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.863606+0000","last_change":"2024-04-25T09:04:03.858775+0000","last_active":"2024-04-25T09:04:03.863606+0000","last_peered":"2024-04-25T09:04:03.863606+0000","last_clean":"2024-04-25T09:04:03.863606+0000","last_became_active":"2024-04-25T09:04:03.858487+0000","last_became_peered":"2024-04-25T09:04:03.858487+0000","last_unstale":"2024-04-25T09:04:03.863606+0000","last_undegraded":"2024-04-25T09:04:03.863606+0000","last_fullsized":"2024-04-25T09:04:03.863606+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:46.311120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839364+0000","last_change":"2024-04-25T09:04:02.839364+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839364+0000","last_undegraded":"2024-04-25T09:04:02.839364+0000","last_fullsized":"2024-04-25T09:04:02.839364+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.854865+0000","last_change":"2024-04-25T09:04:03.846114+0000","last_active":"2024-04-25T09:04:03.854865+0000","last_peered":"2024-04-25T09:04:03.854865+0000","last_clean":"2024-04-25T09:04:03.854865+0000","last_became_active":"2024-04-25T09:04:03.845818+0000","last_became_peered":"2024-04-25T09:04:03.845818+0000","last_unstale":"2024-04-25T09:04:03.854865+0000","last_undegraded":"2024-04-25T09:04:03.854865+0000","last_fullsized":"2024-04-25T09:04:03.854865+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:42.547375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.831333+0000","last_change":"2024-04-25T09:04:02.831333+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.831333+0000","last_undegraded":"2024-04-25T09:04:02.831333+0000","last_fullsized":"2024-04-25T09:04:02.831333+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.859057+0000","last_change":"2024-04-25T09:04:03.853632+0000","last_active":"2024-04-25T09:04:03.859057+0000","last_peered":"2024-04-25T09:04:03.859057+0000","last_clean":"2024-04-25T09:04:03.859057+0000","last_became_active":"2024-04-25T09:04:03.851999+0000","last_became_peered":"2024-04-25T09:04:03.851999+0000","last_unstale":"2024-04-25T09:04:03.859057+0000","last_undegraded":"2024-04-25T09:04:03.859057+0000","last_fullsized":"2024-04-25T09:04:03.859057+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:24.458554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867848+0000","last_change":"2024-04-25T09:04:03.863349+0000","last_active":"2024-04-25T09:04:03.867848+0000","last_peered":"2024-04-25T09:04:03.867848+0000","last_clean":"2024-04-25T09:04:03.867848+0000","last_became_active":"2024-04-25T09:04:03.863038+0000","last_became_peered":"2024-04-25T09:04:03.863038+0000","last_unstale":"2024-04-25T09:04:03.867848+0000","last_undegraded":"2024-04-25T09:04:03.867848+0000","last_fullsized":"2024-04-25T09:04:03.867848+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:51.065910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.847063+0000","last_change":"2024-04-25T09:04:03.842430+0000","last_active":"2024-04-25T09:04:03.847063+0000","last_peered":"2024-04-25T09:04:03.847063+0000","last_clean":"2024-04-25T09:04:03.847063+0000","last_became_active":"2024-04-25T09:04:03.841747+0000","last_became_peered":"2024-04-25T09:04:03.841747+0000","last_unstale":"2024-04-25T09:04:03.847063+0000","last_undegraded":"2024-04-25T09:04:03.847063+0000","last_fullsized":"2024-04-25T09:04:03.847063+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:48.909240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.848074+0000","last_change":"2024-04-25T09:04:03.841707+0000","last_active":"2024-04-25T09:04:03.848074+0000","last_peered":"2024-04-25T09:04:03.848074+0000","last_clean":"2024-04-25T09:04:03.848074+0000","last_became_active":"2024-04-25T09:04:03.841445+0000","last_became_peered":"2024-04-25T09:04:03.841445+0000","last_unstale":"2024-04-25T09:04:03.848074+0000","last_undegraded":"2024-04-25T09:04:03.848074+0000","last_fullsized":"2024-04-25T09:04:03.848074+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:45.371612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.831186+0000","last_change":"2024-04-25T09:04:02.831186+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.831186+0000","last_undegraded":"2024-04-25T09:04:02.831186+0000","last_fullsized":"2024-04-25T09:04:02.831186+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.863490+0000","last_change":"2024-04-25T09:04:02.834352+0000","last_active":"2024-04-25T09:04:03.863490+0000","last_peered":"2024-04-25T09:04:03.863490+0000","last_clean":"2024-04-25T09:04:03.863490+0000","last_became_active":"2024-04-25T09:04:02.833884+0000","last_became_peered":"2024-04-25T09:04:02.833884+0000","last_unstale":"2024-04-25T09:04:03.863490+0000","last_undegraded":"2024-04-25T09:04:03.863490+0000","last_fullsized":"2024-04-25T09:04:03.863490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:16.243545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.830022+0000","last_change":"2024-04-25T09:04:02.830022+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.830022+0000","last_undegraded":"2024-04-25T09:04:02.830022+0000","last_fullsized":"2024-04-25T09:04:02.830022+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.850403+0000","last_change":"2024-04-25T09:04:02.844968+0000","last_active":"2024-04-25T09:04:02.850403+0000","last_peered":"2024-04-25T09:04:02.850403+0000","last_clean":"2024-04-25T09:04:02.850403+0000","last_became_active":"2024-04-25T09:04:02.844639+0000","last_became_peered":"2024-04-25T09:04:02.844639+0000","last_unstale":"2024-04-25T09:04:02.850403+0000","last_undegraded":"2024-04-25T09:04:02.850403+0000","last_fullsized":"2024-04-25T09:04:02.850403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:17.911042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.841900+0000","last_change":"2024-04-25T09:04:03.836889+0000","last_active":"2024-04-25T09:04:03.841900+0000","last_peered":"2024-04-25T09:04:03.841900+0000","last_clean":"2024-04-25T09:04:03.841900+0000","last_became_active":"2024-04-25T09:04:03.836621+0000","last_became_peered":"2024-04-25T09:04:03.836621+0000","last_unstale":"2024-04-25T09:04:03.841900+0000","last_undegraded":"2024-04-25T09:04:03.841900+0000","last_fullsized":"2024-04-25T09:04:03.841900+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:45.371612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.846214+0000","last_change":"2024-04-25T09:04:02.842347+0000","last_active":"2024-04-25T09:04:02.846214+0000","last_peered":"2024-04-25T09:04:02.846214+0000","last_clean":"2024-04-25T09:04:02.846214+0000","last_became_active":"2024-04-25T09:04:02.842050+0000","last_became_peered":"2024-04-25T09:04:02.842050+0000","last_unstale":"2024-04-25T09:04:02.846214+0000","last_undegraded":"2024-04-25T09:04:02.846214+0000","last_fullsized":"2024-04-25T09:04:02.846214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:09.975591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829413+0000","last_change":"2024-04-25T09:04:02.829413+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829413+0000","last_undegraded":"2024-04-25T09:04:02.829413+0000","last_fullsized":"2024-04-25T09:04:02.829413+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.863494+0000","last_change":"2024-04-25T09:04:02.837853+0000","last_active":"2024-04-25T09:04:03.863494+0000","last_peered":"2024-04-25T09:04:03.863494+0000","last_clean":"2024-04-25T09:04:03.863494+0000","last_became_active":"2024-04-25T09:04:02.837463+0000","last_became_peered":"2024-04-25T09:04:02.837463+0000","last_unstale":"2024-04-25T09:04:03.863494+0000","last_undegraded":"2024-04-25T09:04:03.863494+0000","last_fullsized":"2024-04-25T09:04:03.863494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.352305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.833468+0000","last_change":"2024-04-25T09:04:02.833468+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.833468+0000","last_undegraded":"2024-04-25T09:04:02.833468+0000","last_fullsized":"2024-04-25T09:04:02.833468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867065+0000","last_change":"2024-04-25T09:04:02.843213+0000","last_active":"2024-04-25T09:04:03.867065+0000","last_peered":"2024-04-25T09:04:03.867065+0000","last_clean":"2024-04-25T09:04:03.867065+0000","last_became_active":"2024-04-25T09:04:02.842911+0000","last_became_peered":"2024-04-25T09:04:02.842911+0000","last_unstale":"2024-04-25T09:04:03.867065+0000","last_undegraded":"2024-04-25T09:04:03.867065+0000","last_fullsized":"2024-04-25T09:04:03.867065+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:49.664471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.866078+0000","last_change":"2024-04-25T09:04:03.855154+0000","last_active":"2024-04-25T09:04:03.866078+0000","last_peered":"2024-04-25T09:04:03.866078+0000","last_clean":"2024-04-25T09:04:03.866078+0000","last_became_active":"2024-04-25T09:04:03.854659+0000","last_became_peered":"2024-04-25T09:04:03.854659+0000","last_unstale":"2024-04-25T09:04:03.866078+0000","last_undegraded":"2024-04-25T09:04:03.866078+0000","last_fullsized":"2024-04-25T09:04:03.866078+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:02.049425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:01.808788+0000","last_change":"2024-04-25T09:04:01.808788+0000","last_active":"2024-04-25T09:04:01.808788+0000","last_peered":"2024-04-25T09:04:01.808788+0000","last_clean":"2024-04-25T09:04:01.808788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:01.808788+0000","last_undegraded":"2024-04-25T09:04:01.808788+0000","last_fullsized":"2024-04-25T09:04:01.808788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.858918+0000","last_change":"2024-04-25T09:04:03.852928+0000","last_active":"2024-04-25T09:04:03.858918+0000","last_peered":"2024-04-25T09:04:03.858918+0000","last_clean":"2024-04-25T09:04:03.858918+0000","last_became_active":"2024-04-25T09:04:03.852667+0000","last_became_peered":"2024-04-25T09:04:03.852667+0000","last_unstale":"2024-04-25T09:04:03.858918+0000","last_undegraded":"2024-04-25T09:04:03.858918+0000","last_fullsized":"2024-04-25T09:04:03.858918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:42.513233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.853743+0000","last_change":"2024-04-25T09:04:02.850909+0000","last_active":"2024-04-25T09:04:02.853743+0000","last_peered":"2024-04-25T09:04:02.853743+0000","last_clean":"2024-04-25T09:04:02.853743+0000","last_became_active":"2024-04-25T09:04:02.850644+0000","last_became_peered":"2024-04-25T09:04:02.850644+0000","last_unstale":"2024-04-25T09:04:02.853743+0000","last_undegraded":"2024-04-25T09:04:02.853743+0000","last_fullsized":"2024-04-25T09:04:02.853743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:47.981260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.830685+0000","last_change":"2024-04-25T09:04:02.830685+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.830685+0000","last_undegraded":"2024-04-25T09:04:02.830685+0000","last_fullsized":"2024-04-25T09:04:02.830685+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.829142+0000","last_change":"2024-04-25T09:04:02.842246+0000","last_active":"2024-04-25T09:04:03.829142+0000","last_peered":"2024-04-25T09:04:03.829142+0000","last_clean":"2024-04-25T09:04:03.829142+0000","last_became_active":"2024-04-25T09:04:02.838163+0000","last_became_peered":"2024-04-25T09:04:02.838163+0000","last_unstale":"2024-04-25T09:04:03.829142+0000","last_undegraded":"2024-04-25T09:04:03.829142+0000","last_fullsized":"2024-04-25T09:04:03.829142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:21.893561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839954+0000","last_change":"2024-04-25T09:04:02.839954+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839954+0000","last_undegraded":"2024-04-25T09:04:02.839954+0000","last_fullsized":"2024-04-25T09:04:02.839954+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.840232+0000","last_change":"2024-04-25T09:04:02.837904+0000","last_active":"2024-04-25T09:04:02.840232+0000","last_peered":"2024-04-25T09:04:02.840232+0000","last_clean":"2024-04-25T09:04:02.840232+0000","last_became_active":"2024-04-25T09:04:02.837467+0000","last_became_peered":"2024-04-25T09:04:02.837467+0000","last_unstale":"2024-04-25T09:04:02.840232+0000","last_undegraded":"2024-04-25T09:04:02.840232+0000","last_fullsized":"2024-04-25T09:04:02.840232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:38.669973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.844372+0000","last_change":"2024-04-25T09:04:02.845952+0000","last_active":"2024-04-25T09:04:03.844372+0000","last_peered":"2024-04-25T09:04:03.844372+0000","last_clean":"2024-04-25T09:04:03.844372+0000","last_became_active":"2024-04-25T09:04:02.845536+0000","last_became_peered":"2024-04-25T09:04:02.845536+0000","last_unstale":"2024-04-25T09:04:03.844372+0000","last_undegraded":"2024-04-25T09:04:03.844372+0000","last_fullsized":"2024-04-25T09:04:03.844372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:25.532613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.834873+0000","last_change":"2024-04-25T09:04:02.834873+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.834873+0000","last_undegraded":"2024-04-25T09:04:02.834873+0000","last_fullsized":"2024-04-25T09:04:02.834873+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867131+0000","last_change":"2024-04-25T09:04:02.846311+0000","last_active":"2024-04-25T09:04:03.867131+0000","last_peered":"2024-04-25T09:04:03.867131+0000","last_clean":"2024-04-25T09:04:03.867131+0000","last_became_active":"2024-04-25T09:04:02.845983+0000","last_became_peered":"2024-04-25T09:04:02.845983+0000","last_unstale":"2024-04-25T09:04:03.867131+0000","last_undegraded":"2024-04-25T09:04:03.867131+0000","last_fullsized":"2024-04-25T09:04:03.867131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:23.451902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.857465+0000","last_change":"2024-04-25T09:04:03.849902+0000","last_active":"2024-04-25T09:04:03.857465+0000","last_peered":"2024-04-25T09:04:03.857465+0000","last_clean":"2024-04-25T09:04:03.857465+0000","last_became_active":"2024-04-25T09:04:03.849674+0000","last_became_peered":"2024-04-25T09:04:03.849674+0000","last_unstale":"2024-04-25T09:04:03.857465+0000","last_undegraded":"2024-04-25T09:04:03.857465+0000","last_fullsized":"2024-04-25T09:04:03.857465+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:24.458554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852108+0000","last_change":"2024-04-25T09:04:02.841438+0000","last_active":"2024-04-25T09:04:02.852108+0000","last_peered":"2024-04-25T09:04:02.852108+0000","last_clean":"2024-04-25T09:04:02.852108+0000","last_became_active":"2024-04-25T09:04:02.841168+0000","last_became_peered":"2024-04-25T09:04:02.841168+0000","last_unstale":"2024-04-25T09:04:02.852108+0000","last_undegraded":"2024-04-25T09:04:02.852108+0000","last_fullsized":"2024-04-25T09:04:02.852108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:58.258528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.833043+0000","last_change":"2024-04-25T09:04:02.833043+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.833043+0000","last_undegraded":"2024-04-25T09:04:02.833043+0000","last_fullsized":"2024-04-25T09:04:02.833043+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852156+0000","last_change":"2024-04-25T09:04:02.843180+0000","last_active":"2024-04-25T09:04:02.852156+0000","last_peered":"2024-04-25T09:04:02.852156+0000","last_clean":"2024-04-25T09:04:02.852156+0000","last_became_active":"2024-04-25T09:04:02.842871+0000","last_became_peered":"2024-04-25T09:04:02.842871+0000","last_unstale":"2024-04-25T09:04:02.852156+0000","last_undegraded":"2024-04-25T09:04:02.852156+0000","last_fullsized":"2024-04-25T09:04:02.852156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:54.157193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.828875+0000","last_change":"2024-04-25T09:04:02.828875+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.828875+0000","last_undegraded":"2024-04-25T09:04:02.828875+0000","last_fullsized":"2024-04-25T09:04:02.828875+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852804+0000","last_change":"2024-04-25T09:04:02.848772+0000","last_active":"2024-04-25T09:04:02.852804+0000","last_peered":"2024-04-25T09:04:02.852804+0000","last_clean":"2024-04-25T09:04:02.852804+0000","last_became_active":"2024-04-25T09:04:02.848498+0000","last_became_peered":"2024-04-25T09:04:02.848498+0000","last_unstale":"2024-04-25T09:04:02.852804+0000","last_undegraded":"2024-04-25T09:04:02.852804+0000","last_fullsized":"2024-04-25T09:04:02.852804+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:51.913902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.832663+0000","last_change":"2024-04-25T09:04:02.832388+0000","last_active":"2024-04-25T09:04:03.832663+0000","last_peered":"2024-04-25T09:04:03.832663+0000","last_clean":"2024-04-25T09:04:03.832663+0000","last_became_active":"2024-04-25T09:04:02.831918+0000","last_became_peered":"2024-04-25T09:04:02.831918+0000","last_unstale":"2024-04-25T09:04:03.832663+0000","last_undegraded":"2024-04-25T09:04:03.832663+0000","last_fullsized":"2024-04-25T09:04:03.832663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:21.893561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.830204+0000","last_change":"2024-04-25T09:04:02.830204+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.830204+0000","last_undegraded":"2024-04-25T09:04:02.830204+0000","last_fullsized":"2024-04-25T09:04:02.830204+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:01.808788+0000","last_change":"2024-04-25T09:04:01.808788+0000","last_active":"2024-04-25T09:04:01.808788+0000","last_peered":"2024-04-25T09:04:01.808788+0000","last_clean":"2024-04-25T09:04:01.808788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:01.808788+0000","last_undegraded":"2024-04-25T09:04:01.808788+0000","last_fullsized":"2024-04-25T09:04:01.808788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.828767+0000","last_change":"2024-04-25T09:04:02.828767+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.828767+0000","last_undegraded":"2024-04-25T09:04:02.828767+0000","last_fullsized":"2024-04-25T09:04:02.828767+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.866931+0000","last_change":"2024-04-25T09:04:02.849353+0000","last_active":"2024-04-25T09:04:03.866931+0000","last_peered":"2024-04-25T09:04:03.866931+0000","last_clean":"2024-04-25T09:04:03.866931+0000","last_became_active":"2024-04-25T09:04:02.849106+0000","last_became_peered":"2024-04-25T09:04:02.849106+0000","last_unstale":"2024-04-25T09:04:03.866931+0000","last_undegraded":"2024-04-25T09:04:03.866931+0000","last_fullsized":"2024-04-25T09:04:03.866931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:41.506582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.865263+0000","last_change":"2024-04-25T09:04:03.854450+0000","last_active":"2024-04-25T09:04:03.865263+0000","last_peered":"2024-04-25T09:04:03.865263+0000","last_clean":"2024-04-25T09:04:03.865263+0000","last_became_active":"2024-04-25T09:04:03.854184+0000","last_became_peered":"2024-04-25T09:04:03.854184+0000","last_unstale":"2024-04-25T09:04:03.865263+0000","last_undegraded":"2024-04-25T09:04:03.865263+0000","last_fullsized":"2024-04-25T09:04:03.865263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:29.586676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867227+0000","last_change":"2024-04-25T09:04:02.849282+0000","last_active":"2024-04-25T09:04:03.867227+0000","last_peered":"2024-04-25T09:04:03.867227+0000","last_clean":"2024-04-25T09:04:03.867227+0000","last_became_active":"2024-04-25T09:04:02.848992+0000","last_became_peered":"2024-04-25T09:04:02.848992+0000","last_unstale":"2024-04-25T09:04:03.867227+0000","last_undegraded":"2024-04-25T09:04:03.867227+0000","last_fullsized":"2024-04-25T09:04:03.867227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:16.243545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.847132+0000","last_change":"2024-04-25T09:04:03.843605+0000","last_active":"2024-04-25T09:04:03.847132+0000","last_peered":"2024-04-25T09:04:03.847132+0000","last_clean":"2024-04-25T09:04:03.847132+0000","last_became_active":"2024-04-25T09:04:03.840559+0000","last_became_peered":"2024-04-25T09:04:03.840559+0000","last_unstale":"2024-04-25T09:04:03.847132+0000","last_undegraded":"2024-04-25T09:04:03.847132+0000","last_fullsized":"2024-04-25T09:04:03.847132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:42.547375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.849804+0000","last_change":"2024-04-25T09:04:02.846278+0000","last_active":"2024-04-25T09:04:02.849804+0000","last_peered":"2024-04-25T09:04:02.849804+0000","last_clean":"2024-04-25T09:04:02.849804+0000","last_became_active":"2024-04-25T09:04:02.845737+0000","last_became_peered":"2024-04-25T09:04:02.845737+0000","last_unstale":"2024-04-25T09:04:02.849804+0000","last_undegraded":"2024-04-25T09:04:02.849804+0000","last_fullsized":"2024-04-25T09:04:02.849804+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:05.305933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839671+0000","last_change":"2024-04-25T09:04:02.839671+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839671+0000","last_undegraded":"2024-04-25T09:04:02.839671+0000","last_fullsized":"2024-04-25T09:04:02.839671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.847248+0000","last_change":"2024-04-25T09:04:02.842942+0000","last_active":"2024-04-25T09:04:02.847248+0000","last_peered":"2024-04-25T09:04:02.847248+0000","last_clean":"2024-04-25T09:04:02.847248+0000","last_became_active":"2024-04-25T09:04:02.842698+0000","last_became_peered":"2024-04-25T09:04:02.842698+0000","last_unstale":"2024-04-25T09:04:02.847248+0000","last_undegraded":"2024-04-25T09:04:02.847248+0000","last_fullsized":"2024-04-25T09:04:02.847248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:17.911042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.853387+0000","last_change":"2024-04-25T09:04:02.850799+0000","last_active":"2024-04-25T09:04:02.853387+0000","last_peered":"2024-04-25T09:04:02.853387+0000","last_clean":"2024-04-25T09:04:02.853387+0000","last_became_active":"2024-04-25T09:04:02.850539+0000","last_became_peered":"2024-04-25T09:04:02.850539+0000","last_unstale":"2024-04-25T09:04:02.853387+0000","last_undegraded":"2024-04-25T09:04:02.853387+0000","last_fullsized":"2024-04-25T09:04:02.853387+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:06.985756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.832567+0000","last_change":"2024-04-25T09:04:02.832567+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.832567+0000","last_undegraded":"2024-04-25T09:04:02.832567+0000","last_fullsized":"2024-04-25T09:04:02.832567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852945+0000","last_change":"2024-04-25T09:04:02.848548+0000","last_active":"2024-04-25T09:04:02.852945+0000","last_peered":"2024-04-25T09:04:02.852945+0000","last_clean":"2024-04-25T09:04:02.852945+0000","last_became_active":"2024-04-25T09:04:02.848233+0000","last_became_peered":"2024-04-25T09:04:02.848233+0000","last_unstale":"2024-04-25T09:04:02.852945+0000","last_undegraded":"2024-04-25T09:04:02.852945+0000","last_fullsized":"2024-04-25T09:04:02.852945+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:30.524420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867903+0000","last_change":"2024-04-25T09:04:03.864573+0000","last_active":"2024-04-25T09:04:03.867903+0000","last_peered":"2024-04-25T09:04:03.867903+0000","last_clean":"2024-04-25T09:04:03.867903+0000","last_became_active":"2024-04-25T09:04:03.863608+0000","last_became_peered":"2024-04-25T09:04:03.863608+0000","last_unstale":"2024-04-25T09:04:03.867903+0000","last_undegraded":"2024-04-25T09:04:03.867903+0000","last_fullsized":"2024-04-25T09:04:03.867903+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:01.044810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:01.808788+0000","last_change":"2024-04-25T09:04:01.808788+0000","last_active":"2024-04-25T09:04:01.808788+0000","last_peered":"2024-04-25T09:04:01.808788+0000","last_clean":"2024-04-25T09:04:01.808788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:01.808788+0000","last_undegraded":"2024-04-25T09:04:01.808788+0000","last_fullsized":"2024-04-25T09:04:01.808788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.828305+0000","last_change":"2024-04-25T09:04:02.828305+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.828305+0000","last_undegraded":"2024-04-25T09:04:02.828305+0000","last_fullsized":"2024-04-25T09:04:02.828305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.853416+0000","last_change":"2024-04-25T09:04:02.851466+0000","last_active":"2024-04-25T09:04:02.853416+0000","last_peered":"2024-04-25T09:04:02.853416+0000","last_clean":"2024-04-25T09:04:02.853416+0000","last_became_active":"2024-04-25T09:04:02.851149+0000","last_became_peered":"2024-04-25T09:04:02.851149+0000","last_unstale":"2024-04-25T09:04:02.853416+0000","last_undegraded":"2024-04-25T09:04:02.853416+0000","last_fullsized":"2024-04-25T09:04:02.853416+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:38.460713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829258+0000","last_change":"2024-04-25T09:04:02.829258+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829258+0000","last_undegraded":"2024-04-25T09:04:02.829258+0000","last_fullsized":"2024-04-25T09:04:02.829258+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.866817+0000","last_change":"2024-04-25T09:04:02.846991+0000","last_active":"2024-04-25T09:04:03.866817+0000","last_peered":"2024-04-25T09:04:03.866817+0000","last_clean":"2024-04-25T09:04:03.866817+0000","last_became_active":"2024-04-25T09:04:02.846719+0000","last_became_peered":"2024-04-25T09:04:02.846719+0000","last_unstale":"2024-04-25T09:04:03.866817+0000","last_undegraded":"2024-04-25T09:04:03.866817+0000","last_fullsized":"2024-04-25T09:04:03.866817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:45.304468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852914+0000","last_change":"2024-04-25T09:04:02.848506+0000","last_active":"2024-04-25T09:04:02.852914+0000","last_peered":"2024-04-25T09:04:02.852914+0000","last_clean":"2024-04-25T09:04:02.852914+0000","last_became_active":"2024-04-25T09:04:02.848199+0000","last_became_peered":"2024-04-25T09:04:02.848199+0000","last_unstale":"2024-04-25T09:04:02.852914+0000","last_undegraded":"2024-04-25T09:04:02.852914+0000","last_fullsized":"2024-04-25T09:04:02.852914+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:10.099740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.827837+0000","last_change":"2024-04-25T09:04:02.827837+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.827837+0000","last_undegraded":"2024-04-25T09:04:02.827837+0000","last_fullsized":"2024-04-25T09:04:02.827837+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.850155+0000","last_change":"2024-04-25T09:04:02.842312+0000","last_active":"2024-04-25T09:04:02.850155+0000","last_peered":"2024-04-25T09:04:02.850155+0000","last_clean":"2024-04-25T09:04:02.850155+0000","last_became_active":"2024-04-25T09:04:02.842050+0000","last_became_peered":"2024-04-25T09:04:02.842050+0000","last_unstale":"2024-04-25T09:04:02.850155+0000","last_undegraded":"2024-04-25T09:04:02.850155+0000","last_fullsized":"2024-04-25T09:04:02.850155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:09.975591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.832541+0000","last_change":"2024-04-25T09:04:02.832541+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.832541+0000","last_undegraded":"2024-04-25T09:04:02.832541+0000","last_fullsized":"2024-04-25T09:04:02.832541+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.850379+0000","last_change":"2024-04-25T09:04:02.846007+0000","last_active":"2024-04-25T09:04:02.850379+0000","last_peered":"2024-04-25T09:04:02.850379+0000","last_clean":"2024-04-25T09:04:02.850379+0000","last_became_active":"2024-04-25T09:04:02.844376+0000","last_became_peered":"2024-04-25T09:04:02.844376+0000","last_unstale":"2024-04-25T09:04:02.850379+0000","last_undegraded":"2024-04-25T09:04:02.850379+0000","last_fullsized":"2024-04-25T09:04:02.850379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:51.913902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829279+0000","last_change":"2024-04-25T09:04:02.829279+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829279+0000","last_undegraded":"2024-04-25T09:04:02.829279+0000","last_fullsized":"2024-04-25T09:04:02.829279+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.833069+0000","last_change":"2024-04-25T09:04:02.844380+0000","last_active":"2024-04-25T09:04:03.833069+0000","last_peered":"2024-04-25T09:04:03.833069+0000","last_clean":"2024-04-25T09:04:03.833069+0000","last_became_active":"2024-04-25T09:04:02.843215+0000","last_became_peered":"2024-04-25T09:04:02.843215+0000","last_unstale":"2024-04-25T09:04:03.833069+0000","last_undegraded":"2024-04-25T09:04:03.833069+0000","last_fullsized":"2024-04-25T09:04:03.833069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.352305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.847033+0000","last_change":"2024-04-25T09:04:03.840896+0000","last_active":"2024-04-25T09:04:03.847033+0000","last_peered":"2024-04-25T09:04:03.847033+0000","last_clean":"2024-04-25T09:04:03.847033+0000","last_became_active":"2024-04-25T09:04:03.840575+0000","last_became_peered":"2024-04-25T09:04:03.840575+0000","last_unstale":"2024-04-25T09:04:03.847033+0000","last_undegraded":"2024-04-25T09:04:03.847033+0000","last_fullsized":"2024-04-25T09:04:03.847033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:48.909240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.829569+0000","last_change":"2024-04-25T09:04:02.837823+0000","last_active":"2024-04-25T09:04:03.829569+0000","last_peered":"2024-04-25T09:04:03.829569+0000","last_clean":"2024-04-25T09:04:03.829569+0000","last_became_active":"2024-04-25T09:04:02.837539+0000","last_became_peered":"2024-04-25T09:04:02.837539+0000","last_unstale":"2024-04-25T09:04:03.829569+0000","last_undegraded":"2024-04-25T09:04:03.829569+0000","last_fullsized":"2024-04-25T09:04:03.829569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:57.442579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:02.815440+0000","last_change":"2024-04-25T09:04:02.815440+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.815440+0000","last_undegraded":"2024-04-25T09:04:02.815440+0000","last_fullsized":"2024-04-25T09:04:02.815440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.838697+0000","last_change":"2024-04-25T09:04:02.837731+0000","last_active":"2024-04-25T09:04:02.838697+0000","last_peered":"2024-04-25T09:04:02.838697+0000","last_clean":"2024-04-25T09:04:02.838697+0000","last_became_active":"2024-04-25T09:04:02.837436+0000","last_became_peered":"2024-04-25T09:04:02.837436+0000","last_unstale":"2024-04-25T09:04:02.838697+0000","last_undegraded":"2024-04-25T09:04:02.838697+0000","last_fullsized":"2024-04-25T09:04:02.838697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:06.695209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867812+0000","last_change":"2024-04-25T09:04:03.864362+0000","last_active":"2024-04-25T09:04:03.867812+0000","last_peered":"2024-04-25T09:04:03.867812+0000","last_clean":"2024-04-25T09:04:03.867812+0000","last_became_active":"2024-04-25T09:04:03.863013+0000","last_became_peered":"2024-04-25T09:04:03.863013+0000","last_unstale":"2024-04-25T09:04:03.867812+0000","last_undegraded":"2024-04-25T09:04:03.867812+0000","last_fullsized":"2024-04-25T09:04:03.867812+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:08.778151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:01.808788+0000","last_change":"2024-04-25T09:04:01.808788+0000","last_active":"2024-04-25T09:04:01.808788+0000","last_peered":"2024-04-25T09:04:01.808788+0000","last_clean":"2024-04-25T09:04:01.808788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:01.808788+0000","last_undegraded":"2024-04-25T09:04:01.808788+0000","last_fullsized":"2024-04-25T09:04:01.808788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":194,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:03:57.298266+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:03:57.298266+0000","last_peered":"2024-04-25T09:03:57.298266+0000","last_clean":"2024-04-25T09:03:57.298266+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:03:57.298266+0000","last_undegraded":"2024-04-25T09:03:57.298266+0000","last_fullsized":"2024-04-25T09:03:57.298266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":56,"acting":56,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1024000,"data_stored":772683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":999424,"data_stored":759807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:04:08.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2024-04-25T09:04:08.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.834554+0000', 'last_change': '2024-04-25T09:04:02.834554+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.834554+0000', 'last_undegraded': '2024-04-25T09:04:02.834554+0000', 'last_fullsized': '2024-04-25T09:04:02.834554+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:04:08.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2024-04-25T09:04:08.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.829079+0000', 'last_change': '2024-04-25T09:04:02.829079+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.829079+0000', 'last_undegraded': '2024-04-25T09:04:02.829079+0000', 'last_fullsized': '2024-04-25T09:04:02.829079+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:04:08.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2024-04-25T09:04:08.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.835681+0000', 'last_change': '2024-04-25T09:04:02.835681+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.835681+0000', 'last_undegraded': '2024-04-25T09:04:02.835681+0000', 'last_fullsized': '2024-04-25T09:04:02.835681+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:04:08.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2024-04-25T09:04:08.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.840377+0000', 'last_change': '2024-04-25T09:04:02.840377+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.840377+0000', 'last_undegraded': '2024-04-25T09:04:02.840377+0000', 'last_fullsized': '2024-04-25T09:04:02.840377+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:04:08.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2024-04-25T09:04:08.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.839449+0000', 'last_change': '2024-04-25T09:04:02.839449+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.839449+0000', 'last_undegraded': '2024-04-25T09:04:02.839449+0000', 'last_fullsized': '2024-04-25T09:04:02.839449+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:04:08.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2024-04-25T09:04:08.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.830875+0000', 'last_change': '2024-04-25T09:04:02.830875+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.830875+0000', 'last_undegraded': '2024-04-25T09:04:02.830875+0000', 'last_fullsized': '2024-04-25T09:04:02.830875+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:04:08.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2024-04-25T09:04:08.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.829132+0000', 'last_change': '2024-04-25T09:04:02.829132+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.829132+0000', 'last_undegraded': '2024-04-25T09:04:02.829132+0000', 'last_fullsized': '2024-04-25T09:04:02.829132+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:04:08.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2024-04-25T09:04:08.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.832626+0000', 'last_change': '2024-04-25T09:04:02.832626+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.832626+0000', 'last_undegraded': '2024-04-25T09:04:02.832626+0000', 'last_fullsized': '2024-04-25T09:04:02.832626+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:04:08.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2024-04-25T09:04:08.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.836150+0000', 'last_change': '2024-04-25T09:04:02.836150+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.836150+0000', 'last_undegraded': '2024-04-25T09:04:02.836150+0000', 'last_fullsized': '2024-04-25T09:04:02.836150+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:04:08.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2024-04-25T09:04:08.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:04:02.815440+0000', 'last_change': '2024-04-25T09:04:02.815440+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.815440+0000', 'last_undegraded': '2024-04-25T09:04:02.815440+0000', 'last_fullsized': '2024-04-25T09:04:02.815440+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:04:08.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2024-04-25T09:04:08.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:04:02.815440+0000', 'last_change': '2024-04-25T09:04:02.815440+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.815440+0000', 'last_undegraded': '2024-04-25T09:04:02.815440+0000', 'last_fullsized': '2024-04-25T09:04:02.815440+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:04:08.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2024-04-25T09:04:08.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.839943+0000', 'last_change': '2024-04-25T09:04:02.839943+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.839943+0000', 'last_undegraded': '2024-04-25T09:04:02.839943+0000', 'last_fullsized': '2024-04-25T09:04:02.839943+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:04:08.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2024-04-25T09:04:08.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:04:02.815440+0000', 'last_change': '2024-04-25T09:04:02.815440+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.815440+0000', 'last_undegraded': '2024-04-25T09:04:02.815440+0000', 'last_fullsized': '2024-04-25T09:04:02.815440+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:04:08.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2024-04-25T09:04:08.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.839364+0000', 'last_change': '2024-04-25T09:04:02.839364+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.839364+0000', 'last_undegraded': '2024-04-25T09:04:02.839364+0000', 'last_fullsized': '2024-04-25T09:04:02.839364+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:04:08.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2024-04-25T09:04:08.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.831333+0000', 'last_change': '2024-04-25T09:04:02.831333+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.831333+0000', 'last_undegraded': '2024-04-25T09:04:02.831333+0000', 'last_fullsized': '2024-04-25T09:04:02.831333+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:04:08.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2024-04-25T09:04:08.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:04:02.815440+0000', 'last_change': '2024-04-25T09:04:02.815440+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.815440+0000', 'last_undegraded': '2024-04-25T09:04:02.815440+0000', 'last_fullsized': '2024-04-25T09:04:02.815440+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:04:08.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2024-04-25T09:04:08.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.831186+0000', 'last_change': '2024-04-25T09:04:02.831186+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.831186+0000', 'last_undegraded': '2024-04-25T09:04:02.831186+0000', 'last_fullsized': '2024-04-25T09:04:02.831186+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:04:08.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-04-25T09:04:08.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:04:02.815440+0000', 'last_change': '2024-04-25T09:04:02.815440+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.815440+0000', 'last_undegraded': '2024-04-25T09:04:02.815440+0000', 'last_fullsized': '2024-04-25T09:04:02.815440+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:04:08.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-04-25T09:04:08.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.830022+0000', 'last_change': '2024-04-25T09:04:02.830022+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.830022+0000', 'last_undegraded': '2024-04-25T09:04:02.830022+0000', 'last_fullsized': '2024-04-25T09:04:02.830022+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:04:08.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-04-25T09:04:08.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.829413+0000', 'last_change': '2024-04-25T09:04:02.829413+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.829413+0000', 'last_undegraded': '2024-04-25T09:04:02.829413+0000', 'last_fullsized': '2024-04-25T09:04:02.829413+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:04:08.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-04-25T09:04:08.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.833468+0000', 'last_change': '2024-04-25T09:04:02.833468+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.833468+0000', 'last_undegraded': '2024-04-25T09:04:02.833468+0000', 'last_fullsized': '2024-04-25T09:04:02.833468+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:04:08.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-04-25T09:04:08.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:04:01.808788+0000', 'last_change': '2024-04-25T09:04:01.808788+0000', 'last_active': '2024-04-25T09:04:01.808788+0000', 'last_peered': '2024-04-25T09:04:01.808788+0000', 'last_clean': '2024-04-25T09:04:01.808788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:01.808788+0000', 'last_undegraded': '2024-04-25T09:04:01.808788+0000', 'last_fullsized': '2024-04-25T09:04:01.808788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:01.808788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:01.808788+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:01.808788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:04:08.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-04-25T09:04:08.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.830685+0000', 'last_change': '2024-04-25T09:04:02.830685+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.830685+0000', 'last_undegraded': '2024-04-25T09:04:02.830685+0000', 'last_fullsized': '2024-04-25T09:04:02.830685+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:04:08.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-04-25T09:04:08.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.839954+0000', 'last_change': '2024-04-25T09:04:02.839954+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.839954+0000', 'last_undegraded': '2024-04-25T09:04:02.839954+0000', 'last_fullsized': '2024-04-25T09:04:02.839954+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:04:08.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-04-25T09:04:08.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:04:02.815440+0000', 'last_change': '2024-04-25T09:04:02.815440+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.815440+0000', 'last_undegraded': '2024-04-25T09:04:02.815440+0000', 'last_fullsized': '2024-04-25T09:04:02.815440+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:04:08.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-04-25T09:04:08.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.834873+0000', 'last_change': '2024-04-25T09:04:02.834873+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.834873+0000', 'last_undegraded': '2024-04-25T09:04:02.834873+0000', 'last_fullsized': '2024-04-25T09:04:02.834873+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:04:08.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-04-25T09:04:08.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.833043+0000', 'last_change': '2024-04-25T09:04:02.833043+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.833043+0000', 'last_undegraded': '2024-04-25T09:04:02.833043+0000', 'last_fullsized': '2024-04-25T09:04:02.833043+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:04:08.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-04-25T09:04:08.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.828875+0000', 'last_change': '2024-04-25T09:04:02.828875+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.828875+0000', 'last_undegraded': '2024-04-25T09:04:02.828875+0000', 'last_fullsized': '2024-04-25T09:04:02.828875+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:04:08.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-04-25T09:04:08.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:04:02.815440+0000', 'last_change': '2024-04-25T09:04:02.815440+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.815440+0000', 'last_undegraded': '2024-04-25T09:04:02.815440+0000', 'last_fullsized': '2024-04-25T09:04:02.815440+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:04:08.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-04-25T09:04:08.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.830204+0000', 'last_change': '2024-04-25T09:04:02.830204+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.830204+0000', 'last_undegraded': '2024-04-25T09:04:02.830204+0000', 'last_fullsized': '2024-04-25T09:04:02.830204+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:04:08.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-04-25T09:04:08.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:04:01.808788+0000', 'last_change': '2024-04-25T09:04:01.808788+0000', 'last_active': '2024-04-25T09:04:01.808788+0000', 'last_peered': '2024-04-25T09:04:01.808788+0000', 'last_clean': '2024-04-25T09:04:01.808788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:01.808788+0000', 'last_undegraded': '2024-04-25T09:04:01.808788+0000', 'last_fullsized': '2024-04-25T09:04:01.808788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:01.808788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:01.808788+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:01.808788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:04:08.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-04-25T09:04:08.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.828767+0000', 'last_change': '2024-04-25T09:04:02.828767+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.828767+0000', 'last_undegraded': '2024-04-25T09:04:02.828767+0000', 'last_fullsized': '2024-04-25T09:04:02.828767+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:04:08.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-04-25T09:04:08.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.839671+0000', 'last_change': '2024-04-25T09:04:02.839671+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.839671+0000', 'last_undegraded': '2024-04-25T09:04:02.839671+0000', 'last_fullsized': '2024-04-25T09:04:02.839671+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:04:08.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-04-25T09:04:08.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:04:02.815440+0000', 'last_change': '2024-04-25T09:04:02.815440+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.815440+0000', 'last_undegraded': '2024-04-25T09:04:02.815440+0000', 'last_fullsized': '2024-04-25T09:04:02.815440+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:04:08.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-04-25T09:04:08.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.832567+0000', 'last_change': '2024-04-25T09:04:02.832567+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.832567+0000', 'last_undegraded': '2024-04-25T09:04:02.832567+0000', 'last_fullsized': '2024-04-25T09:04:02.832567+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:04:08.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-04-25T09:04:08.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:04:01.808788+0000', 'last_change': '2024-04-25T09:04:01.808788+0000', 'last_active': '2024-04-25T09:04:01.808788+0000', 'last_peered': '2024-04-25T09:04:01.808788+0000', 'last_clean': '2024-04-25T09:04:01.808788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:01.808788+0000', 'last_undegraded': '2024-04-25T09:04:01.808788+0000', 'last_fullsized': '2024-04-25T09:04:01.808788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:01.808788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:01.808788+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:01.808788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:04:08.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-04-25T09:04:08.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.828305+0000', 'last_change': '2024-04-25T09:04:02.828305+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.828305+0000', 'last_undegraded': '2024-04-25T09:04:02.828305+0000', 'last_fullsized': '2024-04-25T09:04:02.828305+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:04:08.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-04-25T09:04:08.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.829258+0000', 'last_change': '2024-04-25T09:04:02.829258+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.829258+0000', 'last_undegraded': '2024-04-25T09:04:02.829258+0000', 'last_fullsized': '2024-04-25T09:04:02.829258+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:04:08.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-04-25T09:04:08.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:04:02.815440+0000', 'last_change': '2024-04-25T09:04:02.815440+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.815440+0000', 'last_undegraded': '2024-04-25T09:04:02.815440+0000', 'last_fullsized': '2024-04-25T09:04:02.815440+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:04:08.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-04-25T09:04:08.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.827837+0000', 'last_change': '2024-04-25T09:04:02.827837+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.827837+0000', 'last_undegraded': '2024-04-25T09:04:02.827837+0000', 'last_fullsized': '2024-04-25T09:04:02.827837+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:04:08.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-04-25T09:04:08.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.832541+0000', 'last_change': '2024-04-25T09:04:02.832541+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.832541+0000', 'last_undegraded': '2024-04-25T09:04:02.832541+0000', 'last_fullsized': '2024-04-25T09:04:02.832541+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:04:08.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-04-25T09:04:08.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:04:02.829279+0000', 'last_change': '2024-04-25T09:04:02.829279+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.829279+0000', 'last_undegraded': '2024-04-25T09:04:02.829279+0000', 'last_fullsized': '2024-04-25T09:04:02.829279+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:04:08.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-04-25T09:04:08.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:04:02.815440+0000', 'last_change': '2024-04-25T09:04:02.815440+0000', 'last_active': '2024-04-25T09:04:02.815440+0000', 'last_peered': '2024-04-25T09:04:02.815440+0000', 'last_clean': '2024-04-25T09:04:02.815440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:02.815440+0000', 'last_undegraded': '2024-04-25T09:04:02.815440+0000', 'last_fullsized': '2024-04-25T09:04:02.815440+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:02.815440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:04:08.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-04-25T09:04:08.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:04:01.808788+0000', 'last_change': '2024-04-25T09:04:01.808788+0000', 'last_active': '2024-04-25T09:04:01.808788+0000', 'last_peered': '2024-04-25T09:04:01.808788+0000', 'last_clean': '2024-04-25T09:04:01.808788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:04:01.808788+0000', 'last_undegraded': '2024-04-25T09:04:01.808788+0000', 'last_fullsized': '2024-04-25T09:04:01.808788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:04:01.808788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:04:01.808788+0000', 'last_clean_scrub_stamp': '2024-04-25T09:04:01.808788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:04:08.657 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:04:08.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.833+0000 7fcdd1600640 1 Processor -- start 2024-04-25T09:04:08.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.833+0000 7fcdd1600640 1 -- start start 2024-04-25T09:04:08.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.837+0000 7fcdd1600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcdcc0c7d20 0x7fcdcc1633e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.837+0000 7fcdd1600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcdcc0ccc60 0x7fcdcc165930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.837+0000 7fcdd1600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdcc0cd1b0 con 0x7fcdcc0cf6c0 2024-04-25T09:04:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.837+0000 7fcdd1600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc0c5230 con 0x7fcdcc0ccc60 2024-04-25T09:04:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.837+0000 7fcdd1600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc0c5510 con 0x7fcdcc0c7d20 2024-04-25T09:04:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.837+0000 7fcdd0c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcdcc0ccc60 0x7fcdcc165930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.837+0000 7fcdd0c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcdcc0ccc60 0x7fcdcc165930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50442/0 (socket says 172.21.15.173:50442) 2024-04-25T09:04:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.837+0000 7fcdd0c00640 1 -- 172.21.15.173:0/409206474 learned_addr learned my addr 172.21.15.173:0/409206474 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.837+0000 7fcdc3400640 1 --2- 172.21.15.173:0/409206474 >> v2:172.21.15.194:3300/0 conn(0x7fcdcc0c7d20 0x7fcdcc1633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.837+0000 7fcdd0c00640 1 -- 172.21.15.173:0/409206474 >> v2:172.21.15.194:3300/0 conn(0x7fcdcc0c7d20 msgr2=0x7fcdcc1633e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.837+0000 7fcdd0c00640 1 --2- 172.21.15.173:0/409206474 >> v2:172.21.15.194:3300/0 conn(0x7fcdcc0c7d20 0x7fcdcc1633e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.837+0000 7fcdd0c00640 1 -- 172.21.15.173:0/409206474 >> v1:172.21.15.194:6789/0 conn(0x7fcdcc0cf6c0 legacy=0x7fcdcc0cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.837+0000 7fcdd0c00640 1 -- 172.21.15.173:0/409206474 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc0c57f0 con 0x7fcdcc0ccc60 2024-04-25T09:04:08.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.837+0000 7fcdd0c00640 1 --2- 172.21.15.173:0/409206474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdcc0ccc60 0x7fcdcc165930 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc072550 tx=0x7fcdc401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fc7d13dcfe1954 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.837+0000 7fcdcb400640 1 -- 172.21.15.173:0/409206474 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc40a5750 con 0x7fcdcc0ccc60 2024-04-25T09:04:08.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdcb400640 1 -- 172.21.15.173:0/409206474 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc40a58f0 con 0x7fcdcc0ccc60 2024-04-25T09:04:08.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdcb400640 1 -- 172.21.15.173:0/409206474 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc40a5cc0 con 0x7fcdcc0ccc60 2024-04-25T09:04:08.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdd1600640 1 -- 172.21.15.173:0/409206474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdcc0ccc60 msgr2=0x7fcdcc165930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdd1600640 1 --2- 172.21.15.173:0/409206474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdcc0ccc60 0x7fcdcc165930 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc072550 tx=0x7fcdc401c9f0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdd1600640 1 -- 172.21.15.173:0/409206474 shutdown_connections 2024-04-25T09:04:08.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdd1600640 1 --2- 172.21.15.173:0/409206474 >> v2:172.21.15.194:3300/0 conn(0x7fcdcc0c7d20 0x7fcdcc1633e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdd1600640 1 --2- 172.21.15.173:0/409206474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdcc0ccc60 0x7fcdcc165930 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdd1600640 1 -- 172.21.15.173:0/409206474 >> 172.21.15.173:0/409206474 conn(0x7fcdcc0b3130 msgr2=0x7fcdcc0b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdd1600640 1 -- 172.21.15.173:0/409206474 shutdown_connections 2024-04-25T09:04:08.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdd1600640 1 -- 172.21.15.173:0/409206474 wait complete. 2024-04-25T09:04:08.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdd1600640 1 Processor -- start 2024-04-25T09:04:08.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdd1600640 1 -- start start 2024-04-25T09:04:08.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdd1600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdcc0c7d20 0x7fcdcc164bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdd1600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdcc0ccc60 0x7fcdcc156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdd1600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdcc0cf6c0 0x7fcdcc156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdd1600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc168810 con 0x7fcdcc0ccc60 2024-04-25T09:04:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdd1600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc168690 con 0x7fcdcc0cf6c0 2024-04-25T09:04:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdd1600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc168990 con 0x7fcdcc0c7d20 2024-04-25T09:04:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdc3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdcc0ccc60 0x7fcdcc156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdc3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdcc0ccc60 0x7fcdcc156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50448/0 (socket says 172.21.15.173:50448) 2024-04-25T09:04:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdc3400640 1 -- 172.21.15.173:0/1831882756 learned_addr learned my addr 172.21.15.173:0/1831882756 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdcbe00640 1 --2- 172.21.15.173:0/1831882756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdcc0c7d20 0x7fcdcc164bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdd0c00640 1 --2- 172.21.15.173:0/1831882756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdcc0cf6c0 0x7fcdcc156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdc3400640 1 -- 172.21.15.173:0/1831882756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdcc0c7d20 msgr2=0x7fcdcc164bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdc3400640 1 --2- 172.21.15.173:0/1831882756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdcc0c7d20 0x7fcdcc164bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdc3400640 1 -- 172.21.15.173:0/1831882756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdcc0cf6c0 msgr2=0x7fcdcc156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdc3400640 1 --2- 172.21.15.173:0/1831882756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdcc0cf6c0 0x7fcdcc156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdc3400640 1 -- 172.21.15.173:0/1831882756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc156aa0 con 0x7fcdcc0ccc60 2024-04-25T09:04:08.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.841+0000 7fcdd0c00640 1 --2- 172.21.15.173:0/1831882756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdcc0cf6c0 0x7fcdcc156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:08.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.845+0000 7fcdc3400640 1 --2- 172.21.15.173:0/1831882756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdcc0ccc60 0x7fcdcc156020 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400e840 tx=0x7fcdb400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.845+0000 7fcdc8c00640 1 -- 172.21.15.173:0/1831882756 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4017070 con 0x7fcdcc0ccc60 2024-04-25T09:04:08.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.845+0000 7fcdc8c00640 1 -- 172.21.15.173:0/1831882756 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb400ee90 con 0x7fcdcc0ccc60 2024-04-25T09:04:08.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.845+0000 7fcdc8c00640 1 -- 172.21.15.173:0/1831882756 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb400cb80 con 0x7fcdcc0ccc60 2024-04-25T09:04:08.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.845+0000 7fcdd1600640 1 -- 172.21.15.173:0/1831882756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc156d50 con 0x7fcdcc0ccc60 2024-04-25T09:04:08.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.845+0000 7fcdd1600640 1 -- 172.21.15.173:0/1831882756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc157310 con 0x7fcdcc0ccc60 2024-04-25T09:04:08.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.845+0000 7fcdd1600640 1 -- 172.21.15.173:0/1831882756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdcc073a40 con 0x7fcdcc0ccc60 2024-04-25T09:04:08.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.845+0000 7fcdc8c00640 1 -- 172.21.15.173:0/1831882756 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcdb401a070 con 0x7fcdcc0ccc60 2024-04-25T09:04:08.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.845+0000 7fcdc8c00640 1 --2- 172.21.15.173:0/1831882756 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcda8066f60 0x7fcda8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.845+0000 7fcdc8c00640 1 -- 172.21.15.173:0/1831882756 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcdb4085140 con 0x7fcdcc0ccc60 2024-04-25T09:04:08.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.845+0000 7fcdcbe00640 1 --2- 172.21.15.173:0/1831882756 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcda8066f60 0x7fcda8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.849+0000 7fcdcbe00640 1 --2- 172.21.15.173:0/1831882756 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcda8066f60 0x7fcda8069420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc000f70 tx=0x7fcdbc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:08.849+0000 7fcdc8c00640 1 -- 172.21.15.173:0/1831882756 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcdb4055f20 con 0x7fcdcc0ccc60 2024-04-25T09:04:09.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.061+0000 7fcdd1600640 1 -- 172.21.15.173:0/1831882756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fcdcc0b7500 con 0x7fcdcc0ccc60 2024-04-25T09:04:09.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.061+0000 7fcdc8c00640 1 -- 172.21.15.173:0/1831882756 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1098 (secure 0 0 0) 0x7fcdb4055820 con 0x7fcdcc0ccc60 2024-04-25T09:04:09.051 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:04:09.051 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":103,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":40,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":67},{"state_name":"creating+peering","count":30}],"num_pgs":97,"num_pools":3,"num_objects":14,"data_bytes":591062,"bytes_used":226041856,"bytes_avail":772868071424,"bytes_total":773094113280,"inactive_pgs_ratio":0.30927833914756775,"write_bytes_sec":511,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":18,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5346}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-04-25T09:03:52.738924+0000","services":{}},"progress_events":{}} 2024-04-25T09:04:09.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.061+0000 7fcdd1600640 1 -- 172.21.15.173:0/1831882756 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcda8066f60 msgr2=0x7fcda8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.061+0000 7fcdd1600640 1 --2- 172.21.15.173:0/1831882756 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcda8066f60 0x7fcda8069420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc000f70 tx=0x7fcdbc009040 comp rx=0 tx=0).stop 2024-04-25T09:04:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.061+0000 7fcdd1600640 1 -- 172.21.15.173:0/1831882756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdcc0ccc60 msgr2=0x7fcdcc156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.061+0000 7fcdd1600640 1 --2- 172.21.15.173:0/1831882756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdcc0ccc60 0x7fcdcc156020 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400e840 tx=0x7fcdb400ec40 comp rx=0 tx=0).stop 2024-04-25T09:04:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.061+0000 7fcdd1600640 1 -- 172.21.15.173:0/1831882756 shutdown_connections 2024-04-25T09:04:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.061+0000 7fcdd1600640 1 --2- 172.21.15.173:0/1831882756 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcda8066f60 0x7fcda8069420 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.061+0000 7fcdd1600640 1 --2- 172.21.15.173:0/1831882756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdcc0cf6c0 0x7fcdcc156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.061+0000 7fcdd1600640 1 --2- 172.21.15.173:0/1831882756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdcc0ccc60 0x7fcdcc156020 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.061+0000 7fcdd1600640 1 --2- 172.21.15.173:0/1831882756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdcc0c7d20 0x7fcdcc164bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.061+0000 7fcdd1600640 1 -- 172.21.15.173:0/1831882756 >> 172.21.15.173:0/1831882756 conn(0x7fcdcc0b3130 msgr2=0x7fcdcc15acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.061+0000 7fcdd1600640 1 -- 172.21.15.173:0/1831882756 shutdown_connections 2024-04-25T09:04:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.061+0000 7fcdd1600640 1 -- 172.21.15.173:0/1831882756 wait complete. 2024-04-25T09:04:09.072 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:04:09.072 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:04:09.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.217+0000 7f45a2600640 1 Processor -- start 2024-04-25T09:04:09.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.217+0000 7f45a2600640 1 -- start start 2024-04-25T09:04:09.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.217+0000 7f45a2600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f459c15df90 0x7f459c0d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.217+0000 7f45a2600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f459c06f830 0x7f459c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.217+0000 7f45a2600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459c06d870 con 0x7f459c15dbb0 2024-04-25T09:04:09.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.217+0000 7f45a2600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459c0701e0 con 0x7f459c06f830 2024-04-25T09:04:09.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.217+0000 7f45a2600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459c15e5c0 con 0x7f459c15df90 2024-04-25T09:04:09.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.217+0000 7f459be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f459c06f830 0x7f459c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.217+0000 7f459b400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f459c15dbb0 0x7f459c06c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:43076/0 (socket says 172.21.15.173:43076) 2024-04-25T09:04:09.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.217+0000 7f459b400640 1 -- 172.21.15.173:0/3751063458 learned_addr learned my addr 172.21.15.173:0/3751063458 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:04:09.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.217+0000 7f459aa00640 1 --2- 172.21.15.173:0/3751063458 >> v2:172.21.15.194:3300/0 conn(0x7f459c15df90 0x7f459c0d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.217+0000 7f459be00640 1 -- 172.21.15.173:0/3751063458 >> v2:172.21.15.194:3300/0 conn(0x7f459c15df90 msgr2=0x7f459c0d2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:09.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.217+0000 7f459be00640 1 --2- 172.21.15.173:0/3751063458 >> v2:172.21.15.194:3300/0 conn(0x7f459c15df90 0x7f459c0d2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.217+0000 7f459be00640 1 -- 172.21.15.173:0/3751063458 >> v1:172.21.15.173:6789/0 conn(0x7f459c15dbb0 legacy=0x7f459c06c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.217+0000 7f459be00640 1 -- 172.21.15.173:0/3751063458 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c161690 con 0x7f459c06f830 2024-04-25T09:04:09.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.217+0000 7f459a000640 1 -- 172.21.15.173:0/3751063458 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614451936 0 0) 0x7f459c06d870 con 0x7f459c15dbb0 2024-04-25T09:04:09.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.217+0000 7f459aa00640 1 --2- 172.21.15.173:0/3751063458 >> v2:172.21.15.194:3300/0 conn(0x7f459c15df90 0x7f459c0d2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:09.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.221+0000 7f459be00640 1 --2- 172.21.15.173:0/3751063458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f459c06f830 0x7f459c06fca0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f459c070590 tx=0x7f459401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e376749f5e116d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:09.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.221+0000 7f459a000640 1 -- 172.21.15.173:0/3751063458 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45940b2070 con 0x7f459c06f830 2024-04-25T09:04:09.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.221+0000 7f459a000640 1 -- 172.21.15.173:0/3751063458 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45940a57f0 con 0x7f459c06f830 2024-04-25T09:04:09.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.221+0000 7f459a000640 1 -- 172.21.15.173:0/3751063458 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45940a5bc0 con 0x7f459c06f830 2024-04-25T09:04:09.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.221+0000 7f45a2600640 1 -- 172.21.15.173:0/3751063458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f459c06f830 msgr2=0x7f459c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.221+0000 7f45a2600640 1 --2- 172.21.15.173:0/3751063458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f459c06f830 0x7f459c06fca0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f459c070590 tx=0x7f459401c930 comp rx=0 tx=0).stop 2024-04-25T09:04:09.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.221+0000 7f45a2600640 1 -- 172.21.15.173:0/3751063458 shutdown_connections 2024-04-25T09:04:09.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.221+0000 7f45a2600640 1 --2- 172.21.15.173:0/3751063458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f459c06f830 0x7f459c06fca0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.221+0000 7f45a2600640 1 --2- 172.21.15.173:0/3751063458 >> v2:172.21.15.194:3300/0 conn(0x7f459c15df90 0x7f459c0d2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.221+0000 7f45a2600640 1 -- 172.21.15.173:0/3751063458 >> 172.21.15.173:0/3751063458 conn(0x7f459c061880 msgr2=0x7f459c061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:09.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.221+0000 7f45a2600640 1 -- 172.21.15.173:0/3751063458 shutdown_connections 2024-04-25T09:04:09.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.221+0000 7f45a2600640 1 -- 172.21.15.173:0/3751063458 wait complete. 2024-04-25T09:04:09.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f45a2600640 1 Processor -- start 2024-04-25T09:04:09.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f45a2600640 1 -- start start 2024-04-25T09:04:09.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f45a2600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f459c06f830 0x7f459c153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f45a2600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c15dbb0 0x7f459c0c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f45a2600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c15df90 0x7f459c0c6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f45a2600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c16a990 con 0x7f459c06f830 2024-04-25T09:04:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f45a2600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c15ee60 con 0x7f459c15dbb0 2024-04-25T09:04:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f45a2600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459c16ab10 con 0x7f459c15df90 2024-04-25T09:04:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f459b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f459c06f830 0x7f459c153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f459b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f459c06f830 0x7f459c153f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50466/0 (socket says 172.21.15.173:50466) 2024-04-25T09:04:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f459b400640 1 -- 172.21.15.173:0/1527425478 learned_addr learned my addr 172.21.15.173:0/1527425478 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f459aa00640 1 --2- 172.21.15.173:0/1527425478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c15dbb0 0x7f459c0c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f459be00640 1 --2- 172.21.15.173:0/1527425478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c15df90 0x7f459c0c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f459b400640 1 -- 172.21.15.173:0/1527425478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c15df90 msgr2=0x7f459c0c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f459b400640 1 --2- 172.21.15.173:0/1527425478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c15df90 0x7f459c0c6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f459b400640 1 -- 172.21.15.173:0/1527425478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c15dbb0 msgr2=0x7f459c0c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f459b400640 1 --2- 172.21.15.173:0/1527425478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c15dbb0 0x7f459c0c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f459b400640 1 -- 172.21.15.173:0/1527425478 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c158190 con 0x7f459c06f830 2024-04-25T09:04:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f459be00640 1 --2- 172.21.15.173:0/1527425478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c15df90 0x7f459c0c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f459b400640 1 --2- 172.21.15.173:0/1527425478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f459c06f830 0x7f459c153f60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f458c00c520 tx=0x7f458c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f4593400640 1 -- 172.21.15.173:0/1527425478 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c018070 con 0x7f459c06f830 2024-04-25T09:04:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f4593400640 1 -- 172.21.15.173:0/1527425478 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c0074e0 con 0x7f459c06f830 2024-04-25T09:04:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f4593400640 1 -- 172.21.15.173:0/1527425478 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c0049f0 con 0x7f459c06f830 2024-04-25T09:04:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f45a2600640 1 -- 172.21.15.173:0/1527425478 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459c158470 con 0x7f459c06f830 2024-04-25T09:04:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f45a2600640 1 -- 172.21.15.173:0/1527425478 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459c158a30 con 0x7f459c06f830 2024-04-25T09:04:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.225+0000 7f45a2600640 1 -- 172.21.15.173:0/1527425478 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459c073a40 con 0x7f459c06f830 2024-04-25T09:04:09.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.229+0000 7f4593400640 1 -- 172.21.15.173:0/1527425478 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f458c01b070 con 0x7f459c06f830 2024-04-25T09:04:09.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.229+0000 7f4593400640 1 --2- 172.21.15.173:0/1527425478 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f457c066f60 0x7f457c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.229+0000 7f4593400640 1 -- 172.21.15.173:0/1527425478 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f458c084700 con 0x7f459c06f830 2024-04-25T09:04:09.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.229+0000 7f459aa00640 1 --2- 172.21.15.173:0/1527425478 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f457c066f60 0x7f457c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.229+0000 7f459aa00640 1 --2- 172.21.15.173:0/1527425478 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f457c066f60 0x7f457c069420 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f459c0ce3e0 tx=0x7f4588008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:09.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.233+0000 7f4593400640 1 -- 172.21.15.173:0/1527425478 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f458c0554e0 con 0x7f459c06f830 2024-04-25T09:04:09.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.381+0000 7f45a2600640 1 -- 172.21.15.173:0/1527425478 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f459c1544a0 con 0x7f457c066f60 2024-04-25T09:04:09.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.389+0000 7f4593400640 1 -- 172.21.15.173:0/1527425478 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249445 (secure 0 0 0) 0x7f459c1544a0 con 0x7f457c066f60 2024-04-25T09:04:09.381 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:04:09.383 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:04:09.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.393+0000 7f45a2600640 1 -- 172.21.15.173:0/1527425478 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f457c066f60 msgr2=0x7f457c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.393+0000 7f45a2600640 1 --2- 172.21.15.173:0/1527425478 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f457c066f60 0x7f457c069420 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f459c0ce3e0 tx=0x7f4588008040 comp rx=0 tx=0).stop 2024-04-25T09:04:09.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.393+0000 7f45a2600640 1 -- 172.21.15.173:0/1527425478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f459c06f830 msgr2=0x7f459c153f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.393+0000 7f45a2600640 1 --2- 172.21.15.173:0/1527425478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f459c06f830 0x7f459c153f60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f458c00c520 tx=0x7f458c00c9e0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.393+0000 7f45a2600640 1 -- 172.21.15.173:0/1527425478 shutdown_connections 2024-04-25T09:04:09.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.393+0000 7f45a2600640 1 --2- 172.21.15.173:0/1527425478 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f457c066f60 0x7f457c069420 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.393+0000 7f45a2600640 1 --2- 172.21.15.173:0/1527425478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c15df90 0x7f459c0c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.393+0000 7f45a2600640 1 --2- 172.21.15.173:0/1527425478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c15dbb0 0x7f459c0c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.393+0000 7f45a2600640 1 --2- 172.21.15.173:0/1527425478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f459c06f830 0x7f459c153f60 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.393+0000 7f45a2600640 1 -- 172.21.15.173:0/1527425478 >> 172.21.15.173:0/1527425478 conn(0x7f459c061880 msgr2=0x7f459c06d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:09.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.393+0000 7f45a2600640 1 -- 172.21.15.173:0/1527425478 shutdown_connections 2024-04-25T09:04:09.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:09.393+0000 7f45a2600640 1 -- 172.21.15.173:0/1527425478 wait complete. 2024-04-25T09:04:09.402 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-04-25T09:04:08.741658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220744,"kb_used_data":4560,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753976,"statfs":{"total":773094113280,"available":772868071424,"internally_reserved":0,"allocated":4669440,"data_stored":2654797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001094"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.834554+0000","last_change":"2024-04-25T09:04:02.834554+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.834554+0000","last_undegraded":"2024-04-25T09:04:02.834554+0000","last_fullsized":"2024-04-25T09:04:02.834554+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829079+0000","last_change":"2024-04-25T09:04:02.829079+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829079+0000","last_undegraded":"2024-04-25T09:04:02.829079+0000","last_fullsized":"2024-04-25T09:04:02.829079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.835681+0000","last_change":"2024-04-25T09:04:02.835681+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.835681+0000","last_undegraded":"2024-04-25T09:04:02.835681+0000","last_fullsized":"2024-04-25T09:04:02.835681+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.840377+0000","last_change":"2024-04-25T09:04:02.840377+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.840377+0000","last_undegraded":"2024-04-25T09:04:02.840377+0000","last_fullsized":"2024-04-25T09:04:02.840377+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839449+0000","last_change":"2024-04-25T09:04:02.839449+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839449+0000","last_undegraded":"2024-04-25T09:04:02.839449+0000","last_fullsized":"2024-04-25T09:04:02.839449+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.830875+0000","last_change":"2024-04-25T09:04:02.830875+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.830875+0000","last_undegraded":"2024-04-25T09:04:02.830875+0000","last_fullsized":"2024-04-25T09:04:02.830875+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867714+0000","last_change":"2024-04-25T09:04:03.863689+0000","last_active":"2024-04-25T09:04:03.867714+0000","last_peered":"2024-04-25T09:04:03.867714+0000","last_clean":"2024-04-25T09:04:03.867714+0000","last_became_active":"2024-04-25T09:04:03.863414+0000","last_became_peered":"2024-04-25T09:04:03.863414+0000","last_unstale":"2024-04-25T09:04:03.867714+0000","last_undegraded":"2024-04-25T09:04:03.867714+0000","last_fullsized":"2024-04-25T09:04:03.867714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:03.240175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829132+0000","last_change":"2024-04-25T09:04:02.829132+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829132+0000","last_undegraded":"2024-04-25T09:04:02.829132+0000","last_fullsized":"2024-04-25T09:04:02.829132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.832626+0000","last_change":"2024-04-25T09:04:02.832626+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.832626+0000","last_undegraded":"2024-04-25T09:04:02.832626+0000","last_fullsized":"2024-04-25T09:04:02.832626+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.866842+0000","last_change":"2024-04-25T09:04:03.861826+0000","last_active":"2024-04-25T09:04:03.866842+0000","last_peered":"2024-04-25T09:04:03.866842+0000","last_clean":"2024-04-25T09:04:03.866842+0000","last_became_active":"2024-04-25T09:04:03.861513+0000","last_became_peered":"2024-04-25T09:04:03.861513+0000","last_unstale":"2024-04-25T09:04:03.866842+0000","last_undegraded":"2024-04-25T09:04:03.866842+0000","last_fullsized":"2024-04-25T09:04:03.866842+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:51:43.190968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.865253+0000","last_change":"2024-04-25T09:04:03.853007+0000","last_active":"2024-04-25T09:04:03.865253+0000","last_peered":"2024-04-25T09:04:03.865253+0000","last_clean":"2024-04-25T09:04:03.865253+0000","last_became_active":"2024-04-25T09:04:03.852718+0000","last_became_peered":"2024-04-25T09:04:03.852718+0000","last_unstale":"2024-04-25T09:04:03.865253+0000","last_undegraded":"2024-04-25T09:04:03.865253+0000","last_fullsized":"2024-04-25T09:04:03.865253+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:07.579563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.836150+0000","last_change":"2024-04-25T09:04:02.836150+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.836150+0000","last_undegraded":"2024-04-25T09:04:02.836150+0000","last_fullsized":"2024-04-25T09:04:02.836150+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867148+0000","last_change":"2024-04-25T09:04:03.861338+0000","last_active":"2024-04-25T09:04:03.867148+0000","last_peered":"2024-04-25T09:04:03.867148+0000","last_clean":"2024-04-25T09:04:03.867148+0000","last_became_active":"2024-04-25T09:04:03.856730+0000","last_became_peered":"2024-04-25T09:04:03.856730+0000","last_unstale":"2024-04-25T09:04:03.867148+0000","last_undegraded":"2024-04-25T09:04:03.867148+0000","last_fullsized":"2024-04-25T09:04:03.867148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:05.560039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.842833+0000","last_change":"2024-04-25T09:04:03.834273+0000","last_active":"2024-04-25T09:04:03.842833+0000","last_peered":"2024-04-25T09:04:03.842833+0000","last_clean":"2024-04-25T09:04:03.842833+0000","last_became_active":"2024-04-25T09:04:03.833918+0000","last_became_peered":"2024-04-25T09:04:03.833918+0000","last_unstale":"2024-04-25T09:04:03.842833+0000","last_undegraded":"2024-04-25T09:04:03.842833+0000","last_fullsized":"2024-04-25T09:04:03.842833+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:56.270822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.864760+0000","last_change":"2024-04-25T09:04:03.848586+0000","last_active":"2024-04-25T09:04:03.864760+0000","last_peered":"2024-04-25T09:04:03.864760+0000","last_clean":"2024-04-25T09:04:03.864760+0000","last_became_active":"2024-04-25T09:04:03.848329+0000","last_became_peered":"2024-04-25T09:04:03.848329+0000","last_unstale":"2024-04-25T09:04:03.864760+0000","last_undegraded":"2024-04-25T09:04:03.864760+0000","last_fullsized":"2024-04-25T09:04:03.864760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:20.275314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558558+0000","last_change":"2024-04-25T09:04:03.863714+0000","last_active":"2024-04-25T09:04:05.558558+0000","last_peered":"2024-04-25T09:04:05.558558+0000","last_clean":"2024-04-25T09:04:05.558558+0000","last_became_active":"2024-04-25T09:04:03.862022+0000","last_became_peered":"2024-04-25T09:04:03.862022+0000","last_unstale":"2024-04-25T09:04:05.558558+0000","last_undegraded":"2024-04-25T09:04:05.558558+0000","last_fullsized":"2024-04-25T09:04:05.558558+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:53.829534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.559201+0000","last_change":"2024-04-25T09:04:03.867767+0000","last_active":"2024-04-25T09:04:05.559201+0000","last_peered":"2024-04-25T09:04:05.559201+0000","last_clean":"2024-04-25T09:04:05.559201+0000","last_became_active":"2024-04-25T09:04:03.866893+0000","last_became_peered":"2024-04-25T09:04:03.866893+0000","last_unstale":"2024-04-25T09:04:05.559201+0000","last_undegraded":"2024-04-25T09:04:05.559201+0000","last_fullsized":"2024-04-25T09:04:05.559201+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:41.859118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.841856+0000","last_change":"2024-04-25T09:04:03.835873+0000","last_active":"2024-04-25T09:04:03.841856+0000","last_peered":"2024-04-25T09:04:03.841856+0000","last_clean":"2024-04-25T09:04:03.841856+0000","last_became_active":"2024-04-25T09:04:03.835526+0000","last_became_peered":"2024-04-25T09:04:03.835526+0000","last_unstale":"2024-04-25T09:04:03.841856+0000","last_undegraded":"2024-04-25T09:04:03.841856+0000","last_fullsized":"2024-04-25T09:04:03.841856+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:58.449231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839943+0000","last_change":"2024-04-25T09:04:02.839943+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839943+0000","last_undegraded":"2024-04-25T09:04:02.839943+0000","last_fullsized":"2024-04-25T09:04:02.839943+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.840918+0000","last_change":"2024-04-25T09:04:03.836238+0000","last_active":"2024-04-25T09:04:03.840918+0000","last_peered":"2024-04-25T09:04:03.840918+0000","last_clean":"2024-04-25T09:04:03.840918+0000","last_became_active":"2024-04-25T09:04:03.835915+0000","last_became_peered":"2024-04-25T09:04:03.835915+0000","last_unstale":"2024-04-25T09:04:03.840918+0000","last_undegraded":"2024-04-25T09:04:03.840918+0000","last_fullsized":"2024-04-25T09:04:03.840918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:56.270822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867169+0000","last_change":"2024-04-25T09:04:03.861860+0000","last_active":"2024-04-25T09:04:03.867169+0000","last_peered":"2024-04-25T09:04:03.867169+0000","last_clean":"2024-04-25T09:04:03.867169+0000","last_became_active":"2024-04-25T09:04:03.861534+0000","last_became_peered":"2024-04-25T09:04:03.861534+0000","last_unstale":"2024-04-25T09:04:03.867169+0000","last_undegraded":"2024-04-25T09:04:03.867169+0000","last_fullsized":"2024-04-25T09:04:03.867169+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:15.372975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.863606+0000","last_change":"2024-04-25T09:04:03.858775+0000","last_active":"2024-04-25T09:04:03.863606+0000","last_peered":"2024-04-25T09:04:03.863606+0000","last_clean":"2024-04-25T09:04:03.863606+0000","last_became_active":"2024-04-25T09:04:03.858487+0000","last_became_peered":"2024-04-25T09:04:03.858487+0000","last_unstale":"2024-04-25T09:04:03.863606+0000","last_undegraded":"2024-04-25T09:04:03.863606+0000","last_fullsized":"2024-04-25T09:04:03.863606+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:46.311120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558634+0000","last_change":"2024-04-25T09:04:03.851704+0000","last_active":"2024-04-25T09:04:05.558634+0000","last_peered":"2024-04-25T09:04:05.558634+0000","last_clean":"2024-04-25T09:04:05.558634+0000","last_became_active":"2024-04-25T09:04:03.851333+0000","last_became_peered":"2024-04-25T09:04:03.851333+0000","last_unstale":"2024-04-25T09:04:05.558634+0000","last_undegraded":"2024-04-25T09:04:05.558634+0000","last_fullsized":"2024-04-25T09:04:05.558634+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:13:28.232520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839364+0000","last_change":"2024-04-25T09:04:02.839364+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839364+0000","last_undegraded":"2024-04-25T09:04:02.839364+0000","last_fullsized":"2024-04-25T09:04:02.839364+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.854865+0000","last_change":"2024-04-25T09:04:03.846114+0000","last_active":"2024-04-25T09:04:03.854865+0000","last_peered":"2024-04-25T09:04:03.854865+0000","last_clean":"2024-04-25T09:04:03.854865+0000","last_became_active":"2024-04-25T09:04:03.845818+0000","last_became_peered":"2024-04-25T09:04:03.845818+0000","last_unstale":"2024-04-25T09:04:03.854865+0000","last_undegraded":"2024-04-25T09:04:03.854865+0000","last_fullsized":"2024-04-25T09:04:03.854865+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:42.547375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.831333+0000","last_change":"2024-04-25T09:04:02.831333+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.831333+0000","last_undegraded":"2024-04-25T09:04:02.831333+0000","last_fullsized":"2024-04-25T09:04:02.831333+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.859057+0000","last_change":"2024-04-25T09:04:03.853632+0000","last_active":"2024-04-25T09:04:03.859057+0000","last_peered":"2024-04-25T09:04:03.859057+0000","last_clean":"2024-04-25T09:04:03.859057+0000","last_became_active":"2024-04-25T09:04:03.851999+0000","last_became_peered":"2024-04-25T09:04:03.851999+0000","last_unstale":"2024-04-25T09:04:03.859057+0000","last_undegraded":"2024-04-25T09:04:03.859057+0000","last_fullsized":"2024-04-25T09:04:03.859057+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:24.458554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867848+0000","last_change":"2024-04-25T09:04:03.863349+0000","last_active":"2024-04-25T09:04:03.867848+0000","last_peered":"2024-04-25T09:04:03.867848+0000","last_clean":"2024-04-25T09:04:03.867848+0000","last_became_active":"2024-04-25T09:04:03.863038+0000","last_became_peered":"2024-04-25T09:04:03.863038+0000","last_unstale":"2024-04-25T09:04:03.867848+0000","last_undegraded":"2024-04-25T09:04:03.867848+0000","last_fullsized":"2024-04-25T09:04:03.867848+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:51.065910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.847063+0000","last_change":"2024-04-25T09:04:03.842430+0000","last_active":"2024-04-25T09:04:03.847063+0000","last_peered":"2024-04-25T09:04:03.847063+0000","last_clean":"2024-04-25T09:04:03.847063+0000","last_became_active":"2024-04-25T09:04:03.841747+0000","last_became_peered":"2024-04-25T09:04:03.841747+0000","last_unstale":"2024-04-25T09:04:03.847063+0000","last_undegraded":"2024-04-25T09:04:03.847063+0000","last_fullsized":"2024-04-25T09:04:03.847063+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:48.909240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.848074+0000","last_change":"2024-04-25T09:04:03.841707+0000","last_active":"2024-04-25T09:04:03.848074+0000","last_peered":"2024-04-25T09:04:03.848074+0000","last_clean":"2024-04-25T09:04:03.848074+0000","last_became_active":"2024-04-25T09:04:03.841445+0000","last_became_peered":"2024-04-25T09:04:03.841445+0000","last_unstale":"2024-04-25T09:04:03.848074+0000","last_undegraded":"2024-04-25T09:04:03.848074+0000","last_fullsized":"2024-04-25T09:04:03.848074+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:45.371612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558779+0000","last_change":"2024-04-25T09:04:03.857368+0000","last_active":"2024-04-25T09:04:05.558779+0000","last_peered":"2024-04-25T09:04:05.558779+0000","last_clean":"2024-04-25T09:04:05.558779+0000","last_became_active":"2024-04-25T09:04:03.857049+0000","last_became_peered":"2024-04-25T09:04:03.857049+0000","last_unstale":"2024-04-25T09:04:05.558779+0000","last_undegraded":"2024-04-25T09:04:05.558779+0000","last_fullsized":"2024-04-25T09:04:05.558779+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:13.093147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.831186+0000","last_change":"2024-04-25T09:04:02.831186+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.831186+0000","last_undegraded":"2024-04-25T09:04:02.831186+0000","last_fullsized":"2024-04-25T09:04:02.831186+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558735+0000","last_change":"2024-04-25T09:04:03.867408+0000","last_active":"2024-04-25T09:04:05.558735+0000","last_peered":"2024-04-25T09:04:05.558735+0000","last_clean":"2024-04-25T09:04:05.558735+0000","last_became_active":"2024-04-25T09:04:03.867117+0000","last_became_peered":"2024-04-25T09:04:03.867117+0000","last_unstale":"2024-04-25T09:04:05.558735+0000","last_undegraded":"2024-04-25T09:04:05.558735+0000","last_fullsized":"2024-04-25T09:04:05.558735+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:36.771358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.863490+0000","last_change":"2024-04-25T09:04:02.834352+0000","last_active":"2024-04-25T09:04:03.863490+0000","last_peered":"2024-04-25T09:04:03.863490+0000","last_clean":"2024-04-25T09:04:03.863490+0000","last_became_active":"2024-04-25T09:04:02.833884+0000","last_became_peered":"2024-04-25T09:04:02.833884+0000","last_unstale":"2024-04-25T09:04:03.863490+0000","last_undegraded":"2024-04-25T09:04:03.863490+0000","last_fullsized":"2024-04-25T09:04:03.863490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:16.243545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.830022+0000","last_change":"2024-04-25T09:04:02.830022+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.830022+0000","last_undegraded":"2024-04-25T09:04:02.830022+0000","last_fullsized":"2024-04-25T09:04:02.830022+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.850403+0000","last_change":"2024-04-25T09:04:02.844968+0000","last_active":"2024-04-25T09:04:02.850403+0000","last_peered":"2024-04-25T09:04:02.850403+0000","last_clean":"2024-04-25T09:04:02.850403+0000","last_became_active":"2024-04-25T09:04:02.844639+0000","last_became_peered":"2024-04-25T09:04:02.844639+0000","last_unstale":"2024-04-25T09:04:02.850403+0000","last_undegraded":"2024-04-25T09:04:02.850403+0000","last_fullsized":"2024-04-25T09:04:02.850403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:17.911042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.841900+0000","last_change":"2024-04-25T09:04:03.836889+0000","last_active":"2024-04-25T09:04:03.841900+0000","last_peered":"2024-04-25T09:04:03.841900+0000","last_clean":"2024-04-25T09:04:03.841900+0000","last_became_active":"2024-04-25T09:04:03.836621+0000","last_became_peered":"2024-04-25T09:04:03.836621+0000","last_unstale":"2024-04-25T09:04:03.841900+0000","last_undegraded":"2024-04-25T09:04:03.841900+0000","last_fullsized":"2024-04-25T09:04:03.841900+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:45.371612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.846214+0000","last_change":"2024-04-25T09:04:02.842347+0000","last_active":"2024-04-25T09:04:02.846214+0000","last_peered":"2024-04-25T09:04:02.846214+0000","last_clean":"2024-04-25T09:04:02.846214+0000","last_became_active":"2024-04-25T09:04:02.842050+0000","last_became_peered":"2024-04-25T09:04:02.842050+0000","last_unstale":"2024-04-25T09:04:02.846214+0000","last_undegraded":"2024-04-25T09:04:02.846214+0000","last_fullsized":"2024-04-25T09:04:02.846214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:09.975591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829413+0000","last_change":"2024-04-25T09:04:02.829413+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829413+0000","last_undegraded":"2024-04-25T09:04:02.829413+0000","last_fullsized":"2024-04-25T09:04:02.829413+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.863494+0000","last_change":"2024-04-25T09:04:02.837853+0000","last_active":"2024-04-25T09:04:03.863494+0000","last_peered":"2024-04-25T09:04:03.863494+0000","last_clean":"2024-04-25T09:04:03.863494+0000","last_became_active":"2024-04-25T09:04:02.837463+0000","last_became_peered":"2024-04-25T09:04:02.837463+0000","last_unstale":"2024-04-25T09:04:03.863494+0000","last_undegraded":"2024-04-25T09:04:03.863494+0000","last_fullsized":"2024-04-25T09:04:03.863494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.352305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.833468+0000","last_change":"2024-04-25T09:04:02.833468+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.833468+0000","last_undegraded":"2024-04-25T09:04:02.833468+0000","last_fullsized":"2024-04-25T09:04:02.833468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867065+0000","last_change":"2024-04-25T09:04:02.843213+0000","last_active":"2024-04-25T09:04:03.867065+0000","last_peered":"2024-04-25T09:04:03.867065+0000","last_clean":"2024-04-25T09:04:03.867065+0000","last_became_active":"2024-04-25T09:04:02.842911+0000","last_became_peered":"2024-04-25T09:04:02.842911+0000","last_unstale":"2024-04-25T09:04:03.867065+0000","last_undegraded":"2024-04-25T09:04:03.867065+0000","last_fullsized":"2024-04-25T09:04:03.867065+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:49.664471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.866078+0000","last_change":"2024-04-25T09:04:03.855154+0000","last_active":"2024-04-25T09:04:03.866078+0000","last_peered":"2024-04-25T09:04:03.866078+0000","last_clean":"2024-04-25T09:04:03.866078+0000","last_became_active":"2024-04-25T09:04:03.854659+0000","last_became_peered":"2024-04-25T09:04:03.854659+0000","last_unstale":"2024-04-25T09:04:03.866078+0000","last_undegraded":"2024-04-25T09:04:03.866078+0000","last_fullsized":"2024-04-25T09:04:03.866078+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:02.049425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558668+0000","last_change":"2024-04-25T09:04:02.851363+0000","last_active":"2024-04-25T09:04:05.558668+0000","last_peered":"2024-04-25T09:04:05.558668+0000","last_clean":"2024-04-25T09:04:05.558668+0000","last_became_active":"2024-04-25T09:04:02.850949+0000","last_became_peered":"2024-04-25T09:04:02.850949+0000","last_unstale":"2024-04-25T09:04:05.558668+0000","last_undegraded":"2024-04-25T09:04:05.558668+0000","last_fullsized":"2024-04-25T09:04:05.558668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:24.439155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.858918+0000","last_change":"2024-04-25T09:04:03.852928+0000","last_active":"2024-04-25T09:04:03.858918+0000","last_peered":"2024-04-25T09:04:03.858918+0000","last_clean":"2024-04-25T09:04:03.858918+0000","last_became_active":"2024-04-25T09:04:03.852667+0000","last_became_peered":"2024-04-25T09:04:03.852667+0000","last_unstale":"2024-04-25T09:04:03.858918+0000","last_undegraded":"2024-04-25T09:04:03.858918+0000","last_fullsized":"2024-04-25T09:04:03.858918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:42.513233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.853743+0000","last_change":"2024-04-25T09:04:02.850909+0000","last_active":"2024-04-25T09:04:02.853743+0000","last_peered":"2024-04-25T09:04:02.853743+0000","last_clean":"2024-04-25T09:04:02.853743+0000","last_became_active":"2024-04-25T09:04:02.850644+0000","last_became_peered":"2024-04-25T09:04:02.850644+0000","last_unstale":"2024-04-25T09:04:02.853743+0000","last_undegraded":"2024-04-25T09:04:02.853743+0000","last_fullsized":"2024-04-25T09:04:02.853743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:47.981260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.830685+0000","last_change":"2024-04-25T09:04:02.830685+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.830685+0000","last_undegraded":"2024-04-25T09:04:02.830685+0000","last_fullsized":"2024-04-25T09:04:02.830685+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.829142+0000","last_change":"2024-04-25T09:04:02.842246+0000","last_active":"2024-04-25T09:04:03.829142+0000","last_peered":"2024-04-25T09:04:03.829142+0000","last_clean":"2024-04-25T09:04:03.829142+0000","last_became_active":"2024-04-25T09:04:02.838163+0000","last_became_peered":"2024-04-25T09:04:02.838163+0000","last_unstale":"2024-04-25T09:04:03.829142+0000","last_undegraded":"2024-04-25T09:04:03.829142+0000","last_fullsized":"2024-04-25T09:04:03.829142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:21.893561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839954+0000","last_change":"2024-04-25T09:04:02.839954+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839954+0000","last_undegraded":"2024-04-25T09:04:02.839954+0000","last_fullsized":"2024-04-25T09:04:02.839954+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.840232+0000","last_change":"2024-04-25T09:04:02.837904+0000","last_active":"2024-04-25T09:04:02.840232+0000","last_peered":"2024-04-25T09:04:02.840232+0000","last_clean":"2024-04-25T09:04:02.840232+0000","last_became_active":"2024-04-25T09:04:02.837467+0000","last_became_peered":"2024-04-25T09:04:02.837467+0000","last_unstale":"2024-04-25T09:04:02.840232+0000","last_undegraded":"2024-04-25T09:04:02.840232+0000","last_fullsized":"2024-04-25T09:04:02.840232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:38.669973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.559116+0000","last_change":"2024-04-25T09:04:03.856619+0000","last_active":"2024-04-25T09:04:05.559116+0000","last_peered":"2024-04-25T09:04:05.559116+0000","last_clean":"2024-04-25T09:04:05.559116+0000","last_became_active":"2024-04-25T09:04:03.856368+0000","last_became_peered":"2024-04-25T09:04:03.856368+0000","last_unstale":"2024-04-25T09:04:05.559116+0000","last_undegraded":"2024-04-25T09:04:05.559116+0000","last_fullsized":"2024-04-25T09:04:05.559116+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:29.195400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.844372+0000","last_change":"2024-04-25T09:04:02.845952+0000","last_active":"2024-04-25T09:04:03.844372+0000","last_peered":"2024-04-25T09:04:03.844372+0000","last_clean":"2024-04-25T09:04:03.844372+0000","last_became_active":"2024-04-25T09:04:02.845536+0000","last_became_peered":"2024-04-25T09:04:02.845536+0000","last_unstale":"2024-04-25T09:04:03.844372+0000","last_undegraded":"2024-04-25T09:04:03.844372+0000","last_fullsized":"2024-04-25T09:04:03.844372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:25.532613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.834873+0000","last_change":"2024-04-25T09:04:02.834873+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.834873+0000","last_undegraded":"2024-04-25T09:04:02.834873+0000","last_fullsized":"2024-04-25T09:04:02.834873+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867131+0000","last_change":"2024-04-25T09:04:02.846311+0000","last_active":"2024-04-25T09:04:03.867131+0000","last_peered":"2024-04-25T09:04:03.867131+0000","last_clean":"2024-04-25T09:04:03.867131+0000","last_became_active":"2024-04-25T09:04:02.845983+0000","last_became_peered":"2024-04-25T09:04:02.845983+0000","last_unstale":"2024-04-25T09:04:03.867131+0000","last_undegraded":"2024-04-25T09:04:03.867131+0000","last_fullsized":"2024-04-25T09:04:03.867131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:23.451902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.857465+0000","last_change":"2024-04-25T09:04:03.849902+0000","last_active":"2024-04-25T09:04:03.857465+0000","last_peered":"2024-04-25T09:04:03.857465+0000","last_clean":"2024-04-25T09:04:03.857465+0000","last_became_active":"2024-04-25T09:04:03.849674+0000","last_became_peered":"2024-04-25T09:04:03.849674+0000","last_unstale":"2024-04-25T09:04:03.857465+0000","last_undegraded":"2024-04-25T09:04:03.857465+0000","last_fullsized":"2024-04-25T09:04:03.857465+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:24.458554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852108+0000","last_change":"2024-04-25T09:04:02.841438+0000","last_active":"2024-04-25T09:04:02.852108+0000","last_peered":"2024-04-25T09:04:02.852108+0000","last_clean":"2024-04-25T09:04:02.852108+0000","last_became_active":"2024-04-25T09:04:02.841168+0000","last_became_peered":"2024-04-25T09:04:02.841168+0000","last_unstale":"2024-04-25T09:04:02.852108+0000","last_undegraded":"2024-04-25T09:04:02.852108+0000","last_fullsized":"2024-04-25T09:04:02.852108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:58.258528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.833043+0000","last_change":"2024-04-25T09:04:02.833043+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.833043+0000","last_undegraded":"2024-04-25T09:04:02.833043+0000","last_fullsized":"2024-04-25T09:04:02.833043+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852156+0000","last_change":"2024-04-25T09:04:02.843180+0000","last_active":"2024-04-25T09:04:02.852156+0000","last_peered":"2024-04-25T09:04:02.852156+0000","last_clean":"2024-04-25T09:04:02.852156+0000","last_became_active":"2024-04-25T09:04:02.842871+0000","last_became_peered":"2024-04-25T09:04:02.842871+0000","last_unstale":"2024-04-25T09:04:02.852156+0000","last_undegraded":"2024-04-25T09:04:02.852156+0000","last_fullsized":"2024-04-25T09:04:02.852156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:54.157193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.828875+0000","last_change":"2024-04-25T09:04:02.828875+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.828875+0000","last_undegraded":"2024-04-25T09:04:02.828875+0000","last_fullsized":"2024-04-25T09:04:02.828875+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852804+0000","last_change":"2024-04-25T09:04:02.848772+0000","last_active":"2024-04-25T09:04:02.852804+0000","last_peered":"2024-04-25T09:04:02.852804+0000","last_clean":"2024-04-25T09:04:02.852804+0000","last_became_active":"2024-04-25T09:04:02.848498+0000","last_became_peered":"2024-04-25T09:04:02.848498+0000","last_unstale":"2024-04-25T09:04:02.852804+0000","last_undegraded":"2024-04-25T09:04:02.852804+0000","last_fullsized":"2024-04-25T09:04:02.852804+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:51.913902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558642+0000","last_change":"2024-04-25T09:04:03.859312+0000","last_active":"2024-04-25T09:04:05.558642+0000","last_peered":"2024-04-25T09:04:05.558642+0000","last_clean":"2024-04-25T09:04:05.558642+0000","last_became_active":"2024-04-25T09:04:03.858980+0000","last_became_peered":"2024-04-25T09:04:03.858980+0000","last_unstale":"2024-04-25T09:04:05.558642+0000","last_undegraded":"2024-04-25T09:04:05.558642+0000","last_fullsized":"2024-04-25T09:04:05.558642+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:18.750007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.832663+0000","last_change":"2024-04-25T09:04:02.832388+0000","last_active":"2024-04-25T09:04:03.832663+0000","last_peered":"2024-04-25T09:04:03.832663+0000","last_clean":"2024-04-25T09:04:03.832663+0000","last_became_active":"2024-04-25T09:04:02.831918+0000","last_became_peered":"2024-04-25T09:04:02.831918+0000","last_unstale":"2024-04-25T09:04:03.832663+0000","last_undegraded":"2024-04-25T09:04:03.832663+0000","last_fullsized":"2024-04-25T09:04:03.832663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:21.893561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.830204+0000","last_change":"2024-04-25T09:04:02.830204+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.830204+0000","last_undegraded":"2024-04-25T09:04:02.830204+0000","last_fullsized":"2024-04-25T09:04:02.830204+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558470+0000","last_change":"2024-04-25T09:04:02.852288+0000","last_active":"2024-04-25T09:04:05.558470+0000","last_peered":"2024-04-25T09:04:05.558470+0000","last_clean":"2024-04-25T09:04:05.558470+0000","last_became_active":"2024-04-25T09:04:02.851978+0000","last_became_peered":"2024-04-25T09:04:02.851978+0000","last_unstale":"2024-04-25T09:04:05.558470+0000","last_undegraded":"2024-04-25T09:04:05.558470+0000","last_fullsized":"2024-04-25T09:04:05.558470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:55.027343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.828767+0000","last_change":"2024-04-25T09:04:02.828767+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.828767+0000","last_undegraded":"2024-04-25T09:04:02.828767+0000","last_fullsized":"2024-04-25T09:04:02.828767+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.866931+0000","last_change":"2024-04-25T09:04:02.849353+0000","last_active":"2024-04-25T09:04:03.866931+0000","last_peered":"2024-04-25T09:04:03.866931+0000","last_clean":"2024-04-25T09:04:03.866931+0000","last_became_active":"2024-04-25T09:04:02.849106+0000","last_became_peered":"2024-04-25T09:04:02.849106+0000","last_unstale":"2024-04-25T09:04:03.866931+0000","last_undegraded":"2024-04-25T09:04:03.866931+0000","last_fullsized":"2024-04-25T09:04:03.866931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:41.506582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.865263+0000","last_change":"2024-04-25T09:04:03.854450+0000","last_active":"2024-04-25T09:04:03.865263+0000","last_peered":"2024-04-25T09:04:03.865263+0000","last_clean":"2024-04-25T09:04:03.865263+0000","last_became_active":"2024-04-25T09:04:03.854184+0000","last_became_peered":"2024-04-25T09:04:03.854184+0000","last_unstale":"2024-04-25T09:04:03.865263+0000","last_undegraded":"2024-04-25T09:04:03.865263+0000","last_fullsized":"2024-04-25T09:04:03.865263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:29.586676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867227+0000","last_change":"2024-04-25T09:04:02.849282+0000","last_active":"2024-04-25T09:04:03.867227+0000","last_peered":"2024-04-25T09:04:03.867227+0000","last_clean":"2024-04-25T09:04:03.867227+0000","last_became_active":"2024-04-25T09:04:02.848992+0000","last_became_peered":"2024-04-25T09:04:02.848992+0000","last_unstale":"2024-04-25T09:04:03.867227+0000","last_undegraded":"2024-04-25T09:04:03.867227+0000","last_fullsized":"2024-04-25T09:04:03.867227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:16.243545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.847132+0000","last_change":"2024-04-25T09:04:03.843605+0000","last_active":"2024-04-25T09:04:03.847132+0000","last_peered":"2024-04-25T09:04:03.847132+0000","last_clean":"2024-04-25T09:04:03.847132+0000","last_became_active":"2024-04-25T09:04:03.840559+0000","last_became_peered":"2024-04-25T09:04:03.840559+0000","last_unstale":"2024-04-25T09:04:03.847132+0000","last_undegraded":"2024-04-25T09:04:03.847132+0000","last_fullsized":"2024-04-25T09:04:03.847132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:42.547375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.849804+0000","last_change":"2024-04-25T09:04:02.846278+0000","last_active":"2024-04-25T09:04:02.849804+0000","last_peered":"2024-04-25T09:04:02.849804+0000","last_clean":"2024-04-25T09:04:02.849804+0000","last_became_active":"2024-04-25T09:04:02.845737+0000","last_became_peered":"2024-04-25T09:04:02.845737+0000","last_unstale":"2024-04-25T09:04:02.849804+0000","last_undegraded":"2024-04-25T09:04:02.849804+0000","last_fullsized":"2024-04-25T09:04:02.849804+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:05.305933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.839671+0000","last_change":"2024-04-25T09:04:02.839671+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.839671+0000","last_undegraded":"2024-04-25T09:04:02.839671+0000","last_fullsized":"2024-04-25T09:04:02.839671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.847248+0000","last_change":"2024-04-25T09:04:02.842942+0000","last_active":"2024-04-25T09:04:02.847248+0000","last_peered":"2024-04-25T09:04:02.847248+0000","last_clean":"2024-04-25T09:04:02.847248+0000","last_became_active":"2024-04-25T09:04:02.842698+0000","last_became_peered":"2024-04-25T09:04:02.842698+0000","last_unstale":"2024-04-25T09:04:02.847248+0000","last_undegraded":"2024-04-25T09:04:02.847248+0000","last_fullsized":"2024-04-25T09:04:02.847248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:17.911042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558685+0000","last_change":"2024-04-25T09:04:03.852716+0000","last_active":"2024-04-25T09:04:05.558685+0000","last_peered":"2024-04-25T09:04:05.558685+0000","last_clean":"2024-04-25T09:04:05.558685+0000","last_became_active":"2024-04-25T09:04:03.852413+0000","last_became_peered":"2024-04-25T09:04:03.852413+0000","last_unstale":"2024-04-25T09:04:05.558685+0000","last_undegraded":"2024-04-25T09:04:05.558685+0000","last_fullsized":"2024-04-25T09:04:05.558685+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:18.168955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.853387+0000","last_change":"2024-04-25T09:04:02.850799+0000","last_active":"2024-04-25T09:04:02.853387+0000","last_peered":"2024-04-25T09:04:02.853387+0000","last_clean":"2024-04-25T09:04:02.853387+0000","last_became_active":"2024-04-25T09:04:02.850539+0000","last_became_peered":"2024-04-25T09:04:02.850539+0000","last_unstale":"2024-04-25T09:04:02.853387+0000","last_undegraded":"2024-04-25T09:04:02.853387+0000","last_fullsized":"2024-04-25T09:04:02.853387+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:06.985756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.832567+0000","last_change":"2024-04-25T09:04:02.832567+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.832567+0000","last_undegraded":"2024-04-25T09:04:02.832567+0000","last_fullsized":"2024-04-25T09:04:02.832567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852945+0000","last_change":"2024-04-25T09:04:02.848548+0000","last_active":"2024-04-25T09:04:02.852945+0000","last_peered":"2024-04-25T09:04:02.852945+0000","last_clean":"2024-04-25T09:04:02.852945+0000","last_became_active":"2024-04-25T09:04:02.848233+0000","last_became_peered":"2024-04-25T09:04:02.848233+0000","last_unstale":"2024-04-25T09:04:02.852945+0000","last_undegraded":"2024-04-25T09:04:02.852945+0000","last_fullsized":"2024-04-25T09:04:02.852945+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:30.524420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867903+0000","last_change":"2024-04-25T09:04:03.864573+0000","last_active":"2024-04-25T09:04:03.867903+0000","last_peered":"2024-04-25T09:04:03.867903+0000","last_clean":"2024-04-25T09:04:03.867903+0000","last_became_active":"2024-04-25T09:04:03.863608+0000","last_became_peered":"2024-04-25T09:04:03.863608+0000","last_unstale":"2024-04-25T09:04:03.867903+0000","last_undegraded":"2024-04-25T09:04:03.867903+0000","last_fullsized":"2024-04-25T09:04:03.867903+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:01.044810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558762+0000","last_change":"2024-04-25T09:04:02.845146+0000","last_active":"2024-04-25T09:04:05.558762+0000","last_peered":"2024-04-25T09:04:05.558762+0000","last_clean":"2024-04-25T09:04:05.558762+0000","last_became_active":"2024-04-25T09:04:02.844871+0000","last_became_peered":"2024-04-25T09:04:02.844871+0000","last_unstale":"2024-04-25T09:04:05.558762+0000","last_undegraded":"2024-04-25T09:04:05.558762+0000","last_fullsized":"2024-04-25T09:04:05.558762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:28.980143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.828305+0000","last_change":"2024-04-25T09:04:02.828305+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.828305+0000","last_undegraded":"2024-04-25T09:04:02.828305+0000","last_fullsized":"2024-04-25T09:04:02.828305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.853416+0000","last_change":"2024-04-25T09:04:02.851466+0000","last_active":"2024-04-25T09:04:02.853416+0000","last_peered":"2024-04-25T09:04:02.853416+0000","last_clean":"2024-04-25T09:04:02.853416+0000","last_became_active":"2024-04-25T09:04:02.851149+0000","last_became_peered":"2024-04-25T09:04:02.851149+0000","last_unstale":"2024-04-25T09:04:02.853416+0000","last_undegraded":"2024-04-25T09:04:02.853416+0000","last_fullsized":"2024-04-25T09:04:02.853416+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:38.460713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829258+0000","last_change":"2024-04-25T09:04:02.829258+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829258+0000","last_undegraded":"2024-04-25T09:04:02.829258+0000","last_fullsized":"2024-04-25T09:04:02.829258+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.866817+0000","last_change":"2024-04-25T09:04:02.846991+0000","last_active":"2024-04-25T09:04:03.866817+0000","last_peered":"2024-04-25T09:04:03.866817+0000","last_clean":"2024-04-25T09:04:03.866817+0000","last_became_active":"2024-04-25T09:04:02.846719+0000","last_became_peered":"2024-04-25T09:04:02.846719+0000","last_unstale":"2024-04-25T09:04:03.866817+0000","last_undegraded":"2024-04-25T09:04:03.866817+0000","last_fullsized":"2024-04-25T09:04:03.866817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:45.304468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.559094+0000","last_change":"2024-04-25T09:04:03.860899+0000","last_active":"2024-04-25T09:04:05.559094+0000","last_peered":"2024-04-25T09:04:05.559094+0000","last_clean":"2024-04-25T09:04:05.559094+0000","last_became_active":"2024-04-25T09:04:03.860613+0000","last_became_peered":"2024-04-25T09:04:03.860613+0000","last_unstale":"2024-04-25T09:04:05.559094+0000","last_undegraded":"2024-04-25T09:04:05.559094+0000","last_fullsized":"2024-04-25T09:04:05.559094+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:44.938141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.852914+0000","last_change":"2024-04-25T09:04:02.848506+0000","last_active":"2024-04-25T09:04:02.852914+0000","last_peered":"2024-04-25T09:04:02.852914+0000","last_clean":"2024-04-25T09:04:02.852914+0000","last_became_active":"2024-04-25T09:04:02.848199+0000","last_became_peered":"2024-04-25T09:04:02.848199+0000","last_unstale":"2024-04-25T09:04:02.852914+0000","last_undegraded":"2024-04-25T09:04:02.852914+0000","last_fullsized":"2024-04-25T09:04:02.852914+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:10.099740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.827837+0000","last_change":"2024-04-25T09:04:02.827837+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.827837+0000","last_undegraded":"2024-04-25T09:04:02.827837+0000","last_fullsized":"2024-04-25T09:04:02.827837+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.850155+0000","last_change":"2024-04-25T09:04:02.842312+0000","last_active":"2024-04-25T09:04:02.850155+0000","last_peered":"2024-04-25T09:04:02.850155+0000","last_clean":"2024-04-25T09:04:02.850155+0000","last_became_active":"2024-04-25T09:04:02.842050+0000","last_became_peered":"2024-04-25T09:04:02.842050+0000","last_unstale":"2024-04-25T09:04:02.850155+0000","last_undegraded":"2024-04-25T09:04:02.850155+0000","last_fullsized":"2024-04-25T09:04:02.850155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:09.975591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.832541+0000","last_change":"2024-04-25T09:04:02.832541+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.832541+0000","last_undegraded":"2024-04-25T09:04:02.832541+0000","last_fullsized":"2024-04-25T09:04:02.832541+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.850379+0000","last_change":"2024-04-25T09:04:02.846007+0000","last_active":"2024-04-25T09:04:02.850379+0000","last_peered":"2024-04-25T09:04:02.850379+0000","last_clean":"2024-04-25T09:04:02.850379+0000","last_became_active":"2024-04-25T09:04:02.844376+0000","last_became_peered":"2024-04-25T09:04:02.844376+0000","last_unstale":"2024-04-25T09:04:02.850379+0000","last_undegraded":"2024-04-25T09:04:02.850379+0000","last_fullsized":"2024-04-25T09:04:02.850379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:51.913902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-25T09:04:02.829279+0000","last_change":"2024-04-25T09:04:02.829279+0000","last_active":"2024-04-25T09:04:02.815440+0000","last_peered":"2024-04-25T09:04:02.815440+0000","last_clean":"2024-04-25T09:04:02.815440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:02.829279+0000","last_undegraded":"2024-04-25T09:04:02.829279+0000","last_fullsized":"2024-04-25T09:04:02.829279+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.833069+0000","last_change":"2024-04-25T09:04:02.844380+0000","last_active":"2024-04-25T09:04:03.833069+0000","last_peered":"2024-04-25T09:04:03.833069+0000","last_clean":"2024-04-25T09:04:03.833069+0000","last_became_active":"2024-04-25T09:04:02.843215+0000","last_became_peered":"2024-04-25T09:04:02.843215+0000","last_unstale":"2024-04-25T09:04:03.833069+0000","last_undegraded":"2024-04-25T09:04:03.833069+0000","last_fullsized":"2024-04-25T09:04:03.833069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.352305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.847033+0000","last_change":"2024-04-25T09:04:03.840896+0000","last_active":"2024-04-25T09:04:03.847033+0000","last_peered":"2024-04-25T09:04:03.847033+0000","last_clean":"2024-04-25T09:04:03.847033+0000","last_became_active":"2024-04-25T09:04:03.840575+0000","last_became_peered":"2024-04-25T09:04:03.840575+0000","last_unstale":"2024-04-25T09:04:03.847033+0000","last_undegraded":"2024-04-25T09:04:03.847033+0000","last_fullsized":"2024-04-25T09:04:03.847033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:48.909240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.829569+0000","last_change":"2024-04-25T09:04:02.837823+0000","last_active":"2024-04-25T09:04:03.829569+0000","last_peered":"2024-04-25T09:04:03.829569+0000","last_clean":"2024-04-25T09:04:03.829569+0000","last_became_active":"2024-04-25T09:04:02.837539+0000","last_became_peered":"2024-04-25T09:04:02.837539+0000","last_unstale":"2024-04-25T09:04:03.829569+0000","last_undegraded":"2024-04-25T09:04:03.829569+0000","last_fullsized":"2024-04-25T09:04:03.829569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:57.442579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558998+0000","last_change":"2024-04-25T09:04:03.855895+0000","last_active":"2024-04-25T09:04:05.558998+0000","last_peered":"2024-04-25T09:04:05.558998+0000","last_clean":"2024-04-25T09:04:05.558998+0000","last_became_active":"2024-04-25T09:04:03.855578+0000","last_became_peered":"2024-04-25T09:04:03.855578+0000","last_unstale":"2024-04-25T09:04:05.558998+0000","last_undegraded":"2024-04-25T09:04:05.558998+0000","last_fullsized":"2024-04-25T09:04:05.558998+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:51.754005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:04:02.838697+0000","last_change":"2024-04-25T09:04:02.837731+0000","last_active":"2024-04-25T09:04:02.838697+0000","last_peered":"2024-04-25T09:04:02.838697+0000","last_clean":"2024-04-25T09:04:02.838697+0000","last_became_active":"2024-04-25T09:04:02.837436+0000","last_became_peered":"2024-04-25T09:04:02.837436+0000","last_unstale":"2024-04-25T09:04:02.838697+0000","last_undegraded":"2024-04-25T09:04:02.838697+0000","last_fullsized":"2024-04-25T09:04:02.838697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:06.695209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:04:03.867812+0000","last_change":"2024-04-25T09:04:03.864362+0000","last_active":"2024-04-25T09:04:03.867812+0000","last_peered":"2024-04-25T09:04:03.867812+0000","last_clean":"2024-04-25T09:04:03.867812+0000","last_became_active":"2024-04-25T09:04:03.863013+0000","last_became_peered":"2024-04-25T09:04:03.863013+0000","last_unstale":"2024-04-25T09:04:03.867812+0000","last_undegraded":"2024-04-25T09:04:03.867812+0000","last_fullsized":"2024-04-25T09:04:03.867812+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:08.778151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.559080+0000","last_change":"2024-04-25T09:04:02.853471+0000","last_active":"2024-04-25T09:04:05.559080+0000","last_peered":"2024-04-25T09:04:05.559080+0000","last_clean":"2024-04-25T09:04:05.559080+0000","last_became_active":"2024-04-25T09:04:02.853275+0000","last_became_peered":"2024-04-25T09:04:02.853275+0000","last_unstale":"2024-04-25T09:04:05.559080+0000","last_undegraded":"2024-04-25T09:04:05.559080+0000","last_fullsized":"2024-04-25T09:04:05.559080+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:33.203542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":202,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558755+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:04:05.558755+0000","last_peered":"2024-04-25T09:04:05.558755+0000","last_clean":"2024-04-25T09:04:05.558755+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:04:05.558755+0000","last_undegraded":"2024-04-25T09:04:05.558755+0000","last_fullsized":"2024-04-25T09:04:05.558755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":182315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1024000,"data_stored":772683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1064960,"data_stored":788224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:04:12.407 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:04:12.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.561+0000 7f8c80600640 1 Processor -- start 2024-04-25T09:04:12.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.561+0000 7f8c80600640 1 -- start start 2024-04-25T09:04:12.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.565+0000 7f8c80600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c780b3e70 0x7f8c780b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.565+0000 7f8c80600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8c780aefa0 0x7f8c780b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.565+0000 7f8c80600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c780b4790 con 0x7f8c7815edd0 2024-04-25T09:04:12.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.565+0000 7f8c80600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7806dd50 con 0x7f8c780aefa0 2024-04-25T09:04:12.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.565+0000 7f8c80600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7815f320 con 0x7f8c780b3e70 2024-04-25T09:04:12.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.565+0000 7f8c7d200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8c780aefa0 0x7f8c780b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.565+0000 7f8c7d200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8c780aefa0 0x7f8c780b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50468/0 (socket says 172.21.15.173:50468) 2024-04-25T09:04:12.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.565+0000 7f8c7d200640 1 -- 172.21.15.173:0/2583592103 learned_addr learned my addr 172.21.15.173:0/2583592103 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:12.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.565+0000 7f8c7e600640 1 --1- 172.21.15.173:0/2583592103 >> v1:172.21.15.173:6789/0 conn(0x7f8c7815edd0 0x7f8c780b2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:43082/0 (socket says 172.21.15.173:43082) 2024-04-25T09:04:12.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.565+0000 7f8c7dc00640 1 --2- 172.21.15.173:0/2583592103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c780b3e70 0x7f8c780b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.565+0000 7f8c7d200640 1 -- 172.21.15.173:0/2583592103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c780b3e70 msgr2=0x7f8c780b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:12.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.565+0000 7f8c7d200640 1 --2- 172.21.15.173:0/2583592103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c780b3e70 0x7f8c780b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.565+0000 7f8c7d200640 1 -- 172.21.15.173:0/2583592103 >> v1:172.21.15.173:6789/0 conn(0x7f8c7815edd0 legacy=0x7f8c780b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.565+0000 7f8c7d200640 1 -- 172.21.15.173:0/2583592103 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7806d420 con 0x7f8c780aefa0 2024-04-25T09:04:12.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.569+0000 7f8c7d200640 1 --2- 172.21.15.173:0/2583592103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c780aefa0 0x7f8c780b2770 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009870 tx=0x7f8c6401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe878279eaf3fc7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.569+0000 7f8c77e00640 1 -- 172.21.15.173:0/2583592103 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c640a9610 con 0x7f8c780aefa0 2024-04-25T09:04:12.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.569+0000 7f8c77e00640 1 -- 172.21.15.173:0/2583592103 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c640a97b0 con 0x7f8c780aefa0 2024-04-25T09:04:12.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.569+0000 7f8c77e00640 1 -- 172.21.15.173:0/2583592103 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c640a9b80 con 0x7f8c780aefa0 2024-04-25T09:04:12.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.569+0000 7f8c80600640 1 -- 172.21.15.173:0/2583592103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c780aefa0 msgr2=0x7f8c780b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.569+0000 7f8c80600640 1 --2- 172.21.15.173:0/2583592103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c780aefa0 0x7f8c780b2770 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009870 tx=0x7f8c6401c530 comp rx=0 tx=0).stop 2024-04-25T09:04:12.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.569+0000 7f8c80600640 1 -- 172.21.15.173:0/2583592103 shutdown_connections 2024-04-25T09:04:12.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.569+0000 7f8c80600640 1 --2- 172.21.15.173:0/2583592103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c780aefa0 0x7f8c780b2770 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.569+0000 7f8c80600640 1 --2- 172.21.15.173:0/2583592103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c780b3e70 0x7f8c780b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.569+0000 7f8c80600640 1 -- 172.21.15.173:0/2583592103 >> 172.21.15.173:0/2583592103 conn(0x7f8c7806ac90 msgr2=0x7f8c7806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:12.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.569+0000 7f8c80600640 1 -- 172.21.15.173:0/2583592103 shutdown_connections 2024-04-25T09:04:12.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.569+0000 7f8c80600640 1 -- 172.21.15.173:0/2583592103 wait complete. 2024-04-25T09:04:12.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.569+0000 7f8c80600640 1 Processor -- start 2024-04-25T09:04:12.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.569+0000 7f8c80600640 1 -- start start 2024-04-25T09:04:12.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c80600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c780aefa0 0x7f8c780ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c80600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c780b3e70 0x7f8c78150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c80600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c7815edd0 0x7f8c780adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c80600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7806e1c0 con 0x7f8c7815edd0 2024-04-25T09:04:12.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c80600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7815aba0 con 0x7f8c780b3e70 2024-04-25T09:04:12.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c80600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7806e340 con 0x7f8c780aefa0 2024-04-25T09:04:12.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c7e600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c7815edd0 0x7f8c780adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c7e600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c7815edd0 0x7f8c780adbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50478/0 (socket says 172.21.15.173:50478) 2024-04-25T09:04:12.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c7e600640 1 -- 172.21.15.173:0/1877387209 learned_addr learned my addr 172.21.15.173:0/1877387209 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:12.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c7dc00640 1 --2- 172.21.15.173:0/1877387209 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c780aefa0 0x7f8c780ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c7d200640 1 --2- 172.21.15.173:0/1877387209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c780b3e70 0x7f8c78150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c7e600640 1 -- 172.21.15.173:0/1877387209 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c780aefa0 msgr2=0x7f8c780ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c7e600640 1 --2- 172.21.15.173:0/1877387209 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c780aefa0 0x7f8c780ac120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c7e600640 1 -- 172.21.15.173:0/1877387209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c780b3e70 msgr2=0x7f8c78150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c7e600640 1 --2- 172.21.15.173:0/1877387209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c780b3e70 0x7f8c78150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c7e600640 1 -- 172.21.15.173:0/1877387209 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c780b1830 con 0x7f8c7815edd0 2024-04-25T09:04:12.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c7e600640 1 --2- 172.21.15.173:0/1877387209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c7815edd0 0x7f8c780adbb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000c440 tx=0x7f8c7000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c75600640 1 -- 172.21.15.173:0/1877387209 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c700074e0 con 0x7f8c7815edd0 2024-04-25T09:04:12.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c75600640 1 -- 172.21.15.173:0/1877387209 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c70007680 con 0x7f8c7815edd0 2024-04-25T09:04:12.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c75600640 1 -- 172.21.15.173:0/1877387209 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c70004a10 con 0x7f8c7815edd0 2024-04-25T09:04:12.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c80600640 1 -- 172.21.15.173:0/1877387209 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c780b1b10 con 0x7f8c7815edd0 2024-04-25T09:04:12.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c80600640 1 -- 172.21.15.173:0/1877387209 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c780b20d0 con 0x7f8c7815edd0 2024-04-25T09:04:12.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.573+0000 7f8c80600640 1 -- 172.21.15.173:0/1877387209 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c78073a40 con 0x7f8c7815edd0 2024-04-25T09:04:12.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.577+0000 7f8c75600640 1 -- 172.21.15.173:0/1877387209 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8c7001a020 con 0x7f8c7815edd0 2024-04-25T09:04:12.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.577+0000 7f8c75600640 1 --2- 172.21.15.173:0/1877387209 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8c58066f60 0x7f8c58069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.577+0000 7f8c75600640 1 -- 172.21.15.173:0/1877387209 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8c70084890 con 0x7f8c7815edd0 2024-04-25T09:04:12.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.577+0000 7f8c7dc00640 1 --2- 172.21.15.173:0/1877387209 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8c58066f60 0x7f8c58069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.577+0000 7f8c7dc00640 1 --2- 172.21.15.173:0/1877387209 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8c58066f60 0x7f8c58069420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c003ab0 tx=0x7f8c6c009830 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.581+0000 7f8c75600640 1 -- 172.21.15.173:0/1877387209 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8c70055020 con 0x7f8c7815edd0 2024-04-25T09:04:12.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.733+0000 7f8c80600640 1 -- 172.21.15.173:0/1877387209 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c780b2310 con 0x7f8c58066f60 2024-04-25T09:04:12.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.737+0000 7f8c75600640 1 -- 172.21.15.173:0/1877387209 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251959 (secure 0 0 0) 0x7f8c6c004700 con 0x7f8c58066f60 2024-04-25T09:04:12.733 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:04:12.734 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:04:12.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.741+0000 7f8c80600640 1 -- 172.21.15.173:0/1877387209 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8c58066f60 msgr2=0x7f8c58069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.741+0000 7f8c80600640 1 --2- 172.21.15.173:0/1877387209 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8c58066f60 0x7f8c58069420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c003ab0 tx=0x7f8c6c009830 comp rx=0 tx=0).stop 2024-04-25T09:04:12.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.741+0000 7f8c80600640 1 -- 172.21.15.173:0/1877387209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c7815edd0 msgr2=0x7f8c780adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.741+0000 7f8c80600640 1 --2- 172.21.15.173:0/1877387209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c7815edd0 0x7f8c780adbb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000c440 tx=0x7f8c7000c900 comp rx=0 tx=0).stop 2024-04-25T09:04:12.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.741+0000 7f8c80600640 1 -- 172.21.15.173:0/1877387209 shutdown_connections 2024-04-25T09:04:12.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.741+0000 7f8c80600640 1 --2- 172.21.15.173:0/1877387209 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8c58066f60 0x7f8c58069420 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.741+0000 7f8c80600640 1 --2- 172.21.15.173:0/1877387209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c7815edd0 0x7f8c780adbb0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.741+0000 7f8c80600640 1 --2- 172.21.15.173:0/1877387209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c780b3e70 0x7f8c78150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.741+0000 7f8c80600640 1 --2- 172.21.15.173:0/1877387209 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c780aefa0 0x7f8c780ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.741+0000 7f8c80600640 1 -- 172.21.15.173:0/1877387209 >> 172.21.15.173:0/1877387209 conn(0x7f8c7806ac90 msgr2=0x7f8c780cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:12.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.741+0000 7f8c80600640 1 -- 172.21.15.173:0/1877387209 shutdown_connections 2024-04-25T09:04:12.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.741+0000 7f8c80600640 1 -- 172.21.15.173:0/1877387209 wait complete. 2024-04-25T09:04:12.754 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-04-25T09:04:10.742051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220956,"kb_used_data":4776,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753764,"statfs":{"total":773094113280,"available":772867854336,"internally_reserved":0,"allocated":4890624,"data_stored":2754948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.919471"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.841819+0000","last_change":"2024-04-25T09:04:03.843892+0000","last_active":"2024-04-25T09:04:04.841819+0000","last_peered":"2024-04-25T09:04:04.841819+0000","last_clean":"2024-04-25T09:04:04.841819+0000","last_became_active":"2024-04-25T09:04:03.843123+0000","last_became_peered":"2024-04-25T09:04:03.843123+0000","last_unstale":"2024-04-25T09:04:04.841819+0000","last_undegraded":"2024-04-25T09:04:04.841819+0000","last_fullsized":"2024-04-25T09:04:04.841819+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:56:29.448399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.841634+0000","last_change":"2024-04-25T09:04:03.858185+0000","last_active":"2024-04-25T09:04:04.841634+0000","last_peered":"2024-04-25T09:04:04.841634+0000","last_clean":"2024-04-25T09:04:04.841634+0000","last_became_active":"2024-04-25T09:04:03.857818+0000","last_became_peered":"2024-04-25T09:04:03.857818+0000","last_unstale":"2024-04-25T09:04:04.841634+0000","last_undegraded":"2024-04-25T09:04:04.841634+0000","last_fullsized":"2024-04-25T09:04:04.841634+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:50.342354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558233+0000","last_change":"2024-04-25T09:04:03.863772+0000","last_active":"2024-04-25T09:04:05.558233+0000","last_peered":"2024-04-25T09:04:05.558233+0000","last_clean":"2024-04-25T09:04:05.558233+0000","last_became_active":"2024-04-25T09:04:03.863135+0000","last_became_peered":"2024-04-25T09:04:03.863135+0000","last_unstale":"2024-04-25T09:04:05.558233+0000","last_undegraded":"2024-04-25T09:04:05.558233+0000","last_fullsized":"2024-04-25T09:04:05.558233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:59.265180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558526+0000","last_change":"2024-04-25T09:04:03.854228+0000","last_active":"2024-04-25T09:04:05.558526+0000","last_peered":"2024-04-25T09:04:05.558526+0000","last_clean":"2024-04-25T09:04:05.558526+0000","last_became_active":"2024-04-25T09:04:03.853989+0000","last_became_peered":"2024-04-25T09:04:03.853989+0000","last_unstale":"2024-04-25T09:04:05.558526+0000","last_undegraded":"2024-04-25T09:04:05.558526+0000","last_fullsized":"2024-04-25T09:04:05.558526+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:20.699999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558197+0000","last_change":"2024-04-25T09:04:03.853473+0000","last_active":"2024-04-25T09:04:05.558197+0000","last_peered":"2024-04-25T09:04:05.558197+0000","last_clean":"2024-04-25T09:04:05.558197+0000","last_became_active":"2024-04-25T09:04:03.853195+0000","last_became_peered":"2024-04-25T09:04:03.853195+0000","last_unstale":"2024-04-25T09:04:05.558197+0000","last_undegraded":"2024-04-25T09:04:05.558197+0000","last_fullsized":"2024-04-25T09:04:05.558197+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:12.928097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.057762+0000","last_change":"2024-04-25T09:04:03.852366+0000","last_active":"2024-04-25T09:04:05.057762+0000","last_peered":"2024-04-25T09:04:05.057762+0000","last_clean":"2024-04-25T09:04:05.057762+0000","last_became_active":"2024-04-25T09:04:03.852100+0000","last_became_peered":"2024-04-25T09:04:03.852100+0000","last_unstale":"2024-04-25T09:04:05.057762+0000","last_undegraded":"2024-04-25T09:04:05.057762+0000","last_fullsized":"2024-04-25T09:04:05.057762+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:02.762325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.304299+0000","last_change":"2024-04-25T09:04:03.863689+0000","last_active":"2024-04-25T09:04:05.304299+0000","last_peered":"2024-04-25T09:04:05.304299+0000","last_clean":"2024-04-25T09:04:05.304299+0000","last_became_active":"2024-04-25T09:04:03.863414+0000","last_became_peered":"2024-04-25T09:04:03.863414+0000","last_unstale":"2024-04-25T09:04:05.304299+0000","last_undegraded":"2024-04-25T09:04:05.304299+0000","last_fullsized":"2024-04-25T09:04:05.304299+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:59.088787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.841231+0000","last_change":"2024-04-25T09:04:03.847719+0000","last_active":"2024-04-25T09:04:04.841231+0000","last_peered":"2024-04-25T09:04:04.841231+0000","last_clean":"2024-04-25T09:04:04.841231+0000","last_became_active":"2024-04-25T09:04:03.847426+0000","last_became_peered":"2024-04-25T09:04:03.847426+0000","last_unstale":"2024-04-25T09:04:04.841231+0000","last_undegraded":"2024-04-25T09:04:04.841231+0000","last_fullsized":"2024-04-25T09:04:04.841231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:29.195400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558538+0000","last_change":"2024-04-25T09:04:03.865130+0000","last_active":"2024-04-25T09:04:05.558538+0000","last_peered":"2024-04-25T09:04:05.558538+0000","last_clean":"2024-04-25T09:04:05.558538+0000","last_became_active":"2024-04-25T09:04:03.864912+0000","last_became_peered":"2024-04-25T09:04:03.864912+0000","last_unstale":"2024-04-25T09:04:05.558538+0000","last_undegraded":"2024-04-25T09:04:05.558538+0000","last_fullsized":"2024-04-25T09:04:05.558538+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:13.826622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.304593+0000","last_change":"2024-04-25T09:04:03.861826+0000","last_active":"2024-04-25T09:04:05.304593+0000","last_peered":"2024-04-25T09:04:05.304593+0000","last_clean":"2024-04-25T09:04:05.304593+0000","last_became_active":"2024-04-25T09:04:03.861513+0000","last_became_peered":"2024-04-25T09:04:03.861513+0000","last_unstale":"2024-04-25T09:04:05.304593+0000","last_undegraded":"2024-04-25T09:04:05.304593+0000","last_fullsized":"2024-04-25T09:04:05.304593+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:43.943194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.304930+0000","last_change":"2024-04-25T09:04:03.853007+0000","last_active":"2024-04-25T09:04:05.304930+0000","last_peered":"2024-04-25T09:04:05.304930+0000","last_clean":"2024-04-25T09:04:05.304930+0000","last_became_active":"2024-04-25T09:04:03.852718+0000","last_became_peered":"2024-04-25T09:04:03.852718+0000","last_unstale":"2024-04-25T09:04:05.304930+0000","last_undegraded":"2024-04-25T09:04:05.304930+0000","last_fullsized":"2024-04-25T09:04:05.304930+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:44.570252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558369+0000","last_change":"2024-04-25T09:04:03.856633+0000","last_active":"2024-04-25T09:04:05.558369+0000","last_peered":"2024-04-25T09:04:05.558369+0000","last_clean":"2024-04-25T09:04:05.558369+0000","last_became_active":"2024-04-25T09:04:03.856319+0000","last_became_peered":"2024-04-25T09:04:03.856319+0000","last_unstale":"2024-04-25T09:04:05.558369+0000","last_undegraded":"2024-04-25T09:04:05.558369+0000","last_fullsized":"2024-04-25T09:04:05.558369+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:55.163845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.304358+0000","last_change":"2024-04-25T09:04:03.861338+0000","last_active":"2024-04-25T09:04:05.304358+0000","last_peered":"2024-04-25T09:04:05.304358+0000","last_clean":"2024-04-25T09:04:05.304358+0000","last_became_active":"2024-04-25T09:04:03.856730+0000","last_became_peered":"2024-04-25T09:04:03.856730+0000","last_unstale":"2024-04-25T09:04:05.304358+0000","last_undegraded":"2024-04-25T09:04:05.304358+0000","last_fullsized":"2024-04-25T09:04:05.304358+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:48.399697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.842825+0000","last_change":"2024-04-25T09:04:03.834273+0000","last_active":"2024-04-25T09:04:04.842825+0000","last_peered":"2024-04-25T09:04:04.842825+0000","last_clean":"2024-04-25T09:04:04.842825+0000","last_became_active":"2024-04-25T09:04:03.833918+0000","last_became_peered":"2024-04-25T09:04:03.833918+0000","last_unstale":"2024-04-25T09:04:04.842825+0000","last_undegraded":"2024-04-25T09:04:04.842825+0000","last_fullsized":"2024-04-25T09:04:04.842825+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:50.671123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.304451+0000","last_change":"2024-04-25T09:04:03.848586+0000","last_active":"2024-04-25T09:04:05.304451+0000","last_peered":"2024-04-25T09:04:05.304451+0000","last_clean":"2024-04-25T09:04:05.304451+0000","last_became_active":"2024-04-25T09:04:03.848329+0000","last_became_peered":"2024-04-25T09:04:03.848329+0000","last_unstale":"2024-04-25T09:04:05.304451+0000","last_undegraded":"2024-04-25T09:04:05.304451+0000","last_fullsized":"2024-04-25T09:04:05.304451+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:08.367229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558558+0000","last_change":"2024-04-25T09:04:03.863714+0000","last_active":"2024-04-25T09:04:05.558558+0000","last_peered":"2024-04-25T09:04:05.558558+0000","last_clean":"2024-04-25T09:04:05.558558+0000","last_became_active":"2024-04-25T09:04:03.862022+0000","last_became_peered":"2024-04-25T09:04:03.862022+0000","last_unstale":"2024-04-25T09:04:05.558558+0000","last_undegraded":"2024-04-25T09:04:05.558558+0000","last_fullsized":"2024-04-25T09:04:05.558558+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:53.829534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.559201+0000","last_change":"2024-04-25T09:04:03.867767+0000","last_active":"2024-04-25T09:04:05.559201+0000","last_peered":"2024-04-25T09:04:05.559201+0000","last_clean":"2024-04-25T09:04:05.559201+0000","last_became_active":"2024-04-25T09:04:03.866893+0000","last_became_peered":"2024-04-25T09:04:03.866893+0000","last_unstale":"2024-04-25T09:04:05.559201+0000","last_undegraded":"2024-04-25T09:04:05.559201+0000","last_fullsized":"2024-04-25T09:04:05.559201+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:41.859118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.843853+0000","last_change":"2024-04-25T09:04:03.835873+0000","last_active":"2024-04-25T09:04:04.843853+0000","last_peered":"2024-04-25T09:04:04.843853+0000","last_clean":"2024-04-25T09:04:04.843853+0000","last_became_active":"2024-04-25T09:04:03.835526+0000","last_became_peered":"2024-04-25T09:04:03.835526+0000","last_unstale":"2024-04-25T09:04:04.843853+0000","last_undegraded":"2024-04-25T09:04:04.843853+0000","last_fullsized":"2024-04-25T09:04:04.843853+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:26.539265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558461+0000","last_change":"2024-04-25T09:04:03.853863+0000","last_active":"2024-04-25T09:04:05.558461+0000","last_peered":"2024-04-25T09:04:05.558461+0000","last_clean":"2024-04-25T09:04:05.558461+0000","last_became_active":"2024-04-25T09:04:03.853503+0000","last_became_peered":"2024-04-25T09:04:03.853503+0000","last_unstale":"2024-04-25T09:04:05.558461+0000","last_undegraded":"2024-04-25T09:04:05.558461+0000","last_fullsized":"2024-04-25T09:04:05.558461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:11.298697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.843442+0000","last_change":"2024-04-25T09:04:03.836238+0000","last_active":"2024-04-25T09:04:04.843442+0000","last_peered":"2024-04-25T09:04:04.843442+0000","last_clean":"2024-04-25T09:04:04.843442+0000","last_became_active":"2024-04-25T09:04:03.835915+0000","last_became_peered":"2024-04-25T09:04:03.835915+0000","last_unstale":"2024-04-25T09:04:04.843442+0000","last_undegraded":"2024-04-25T09:04:04.843442+0000","last_fullsized":"2024-04-25T09:04:04.843442+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:50.671123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.304334+0000","last_change":"2024-04-25T09:04:03.861860+0000","last_active":"2024-04-25T09:04:05.304334+0000","last_peered":"2024-04-25T09:04:05.304334+0000","last_clean":"2024-04-25T09:04:05.304334+0000","last_became_active":"2024-04-25T09:04:03.861534+0000","last_became_peered":"2024-04-25T09:04:03.861534+0000","last_unstale":"2024-04-25T09:04:05.304334+0000","last_undegraded":"2024-04-25T09:04:05.304334+0000","last_fullsized":"2024-04-25T09:04:05.304334+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:48.282456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.843303+0000","last_change":"2024-04-25T09:04:03.858775+0000","last_active":"2024-04-25T09:04:04.843303+0000","last_peered":"2024-04-25T09:04:04.843303+0000","last_clean":"2024-04-25T09:04:04.843303+0000","last_became_active":"2024-04-25T09:04:03.858487+0000","last_became_peered":"2024-04-25T09:04:03.858487+0000","last_unstale":"2024-04-25T09:04:04.843303+0000","last_undegraded":"2024-04-25T09:04:04.843303+0000","last_fullsized":"2024-04-25T09:04:04.843303+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:02.049425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558634+0000","last_change":"2024-04-25T09:04:03.851704+0000","last_active":"2024-04-25T09:04:05.558634+0000","last_peered":"2024-04-25T09:04:05.558634+0000","last_clean":"2024-04-25T09:04:05.558634+0000","last_became_active":"2024-04-25T09:04:03.851333+0000","last_became_peered":"2024-04-25T09:04:03.851333+0000","last_unstale":"2024-04-25T09:04:05.558634+0000","last_undegraded":"2024-04-25T09:04:05.558634+0000","last_fullsized":"2024-04-25T09:04:05.558634+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:13:28.232520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558046+0000","last_change":"2024-04-25T09:04:03.861024+0000","last_active":"2024-04-25T09:04:05.558046+0000","last_peered":"2024-04-25T09:04:05.558046+0000","last_clean":"2024-04-25T09:04:05.558046+0000","last_became_active":"2024-04-25T09:04:03.860766+0000","last_became_peered":"2024-04-25T09:04:03.860766+0000","last_unstale":"2024-04-25T09:04:05.558046+0000","last_undegraded":"2024-04-25T09:04:05.558046+0000","last_fullsized":"2024-04-25T09:04:05.558046+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:48.987912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.844051+0000","last_change":"2024-04-25T09:04:03.846114+0000","last_active":"2024-04-25T09:04:04.844051+0000","last_peered":"2024-04-25T09:04:04.844051+0000","last_clean":"2024-04-25T09:04:04.844051+0000","last_became_active":"2024-04-25T09:04:03.845818+0000","last_became_peered":"2024-04-25T09:04:03.845818+0000","last_unstale":"2024-04-25T09:04:04.844051+0000","last_undegraded":"2024-04-25T09:04:04.844051+0000","last_fullsized":"2024-04-25T09:04:04.844051+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:07.579563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.058023+0000","last_change":"2024-04-25T09:04:03.867330+0000","last_active":"2024-04-25T09:04:05.058023+0000","last_peered":"2024-04-25T09:04:05.058023+0000","last_clean":"2024-04-25T09:04:05.058023+0000","last_became_active":"2024-04-25T09:04:03.866938+0000","last_became_peered":"2024-04-25T09:04:03.866938+0000","last_unstale":"2024-04-25T09:04:05.058023+0000","last_undegraded":"2024-04-25T09:04:05.058023+0000","last_fullsized":"2024-04-25T09:04:05.058023+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:07.939272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.843853+0000","last_change":"2024-04-25T09:04:03.853632+0000","last_active":"2024-04-25T09:04:04.843853+0000","last_peered":"2024-04-25T09:04:04.843853+0000","last_clean":"2024-04-25T09:04:04.843853+0000","last_became_active":"2024-04-25T09:04:03.851999+0000","last_became_peered":"2024-04-25T09:04:03.851999+0000","last_unstale":"2024-04-25T09:04:04.843853+0000","last_undegraded":"2024-04-25T09:04:04.843853+0000","last_fullsized":"2024-04-25T09:04:04.843853+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:20.275314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.304715+0000","last_change":"2024-04-25T09:04:03.863349+0000","last_active":"2024-04-25T09:04:05.304715+0000","last_peered":"2024-04-25T09:04:05.304715+0000","last_clean":"2024-04-25T09:04:05.304715+0000","last_became_active":"2024-04-25T09:04:03.863038+0000","last_became_peered":"2024-04-25T09:04:03.863038+0000","last_unstale":"2024-04-25T09:04:05.304715+0000","last_undegraded":"2024-04-25T09:04:05.304715+0000","last_fullsized":"2024-04-25T09:04:05.304715+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:04.001019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.842810+0000","last_change":"2024-04-25T09:04:03.842430+0000","last_active":"2024-04-25T09:04:04.842810+0000","last_peered":"2024-04-25T09:04:04.842810+0000","last_clean":"2024-04-25T09:04:04.842810+0000","last_became_active":"2024-04-25T09:04:03.841747+0000","last_became_peered":"2024-04-25T09:04:03.841747+0000","last_unstale":"2024-04-25T09:04:04.842810+0000","last_undegraded":"2024-04-25T09:04:04.842810+0000","last_fullsized":"2024-04-25T09:04:04.842810+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:46.311120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.842568+0000","last_change":"2024-04-25T09:04:03.841707+0000","last_active":"2024-04-25T09:04:04.842568+0000","last_peered":"2024-04-25T09:04:04.842568+0000","last_clean":"2024-04-25T09:04:04.842568+0000","last_became_active":"2024-04-25T09:04:03.841445+0000","last_became_peered":"2024-04-25T09:04:03.841445+0000","last_unstale":"2024-04-25T09:04:04.842568+0000","last_undegraded":"2024-04-25T09:04:04.842568+0000","last_fullsized":"2024-04-25T09:04:04.842568+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:42.513233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558779+0000","last_change":"2024-04-25T09:04:03.857368+0000","last_active":"2024-04-25T09:04:05.558779+0000","last_peered":"2024-04-25T09:04:05.558779+0000","last_clean":"2024-04-25T09:04:05.558779+0000","last_became_active":"2024-04-25T09:04:03.857049+0000","last_became_peered":"2024-04-25T09:04:03.857049+0000","last_unstale":"2024-04-25T09:04:05.558779+0000","last_undegraded":"2024-04-25T09:04:05.558779+0000","last_fullsized":"2024-04-25T09:04:05.558779+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:13.093147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.057642+0000","last_change":"2024-04-25T09:04:03.850009+0000","last_active":"2024-04-25T09:04:05.057642+0000","last_peered":"2024-04-25T09:04:05.057642+0000","last_clean":"2024-04-25T09:04:05.057642+0000","last_became_active":"2024-04-25T09:04:03.849754+0000","last_became_peered":"2024-04-25T09:04:03.849754+0000","last_unstale":"2024-04-25T09:04:05.057642+0000","last_undegraded":"2024-04-25T09:04:05.057642+0000","last_fullsized":"2024-04-25T09:04:05.057642+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:55.163845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558735+0000","last_change":"2024-04-25T09:04:03.867408+0000","last_active":"2024-04-25T09:04:05.558735+0000","last_peered":"2024-04-25T09:04:05.558735+0000","last_clean":"2024-04-25T09:04:05.558735+0000","last_became_active":"2024-04-25T09:04:03.867117+0000","last_became_peered":"2024-04-25T09:04:03.867117+0000","last_unstale":"2024-04-25T09:04:05.558735+0000","last_undegraded":"2024-04-25T09:04:05.558735+0000","last_fullsized":"2024-04-25T09:04:05.558735+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:36.771358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.843945+0000","last_change":"2024-04-25T09:04:02.834352+0000","last_active":"2024-04-25T09:04:04.843945+0000","last_peered":"2024-04-25T09:04:04.843945+0000","last_clean":"2024-04-25T09:04:04.843945+0000","last_became_active":"2024-04-25T09:04:02.833884+0000","last_became_peered":"2024-04-25T09:04:02.833884+0000","last_unstale":"2024-04-25T09:04:04.843945+0000","last_undegraded":"2024-04-25T09:04:04.843945+0000","last_fullsized":"2024-04-25T09:04:04.843945+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:16.243545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.057975+0000","last_change":"2024-04-25T09:04:03.863255+0000","last_active":"2024-04-25T09:04:05.057975+0000","last_peered":"2024-04-25T09:04:05.057975+0000","last_clean":"2024-04-25T09:04:05.057975+0000","last_became_active":"2024-04-25T09:04:03.863006+0000","last_became_peered":"2024-04-25T09:04:03.863006+0000","last_unstale":"2024-04-25T09:04:05.057975+0000","last_undegraded":"2024-04-25T09:04:05.057975+0000","last_fullsized":"2024-04-25T09:04:05.057975+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:42.542233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558759+0000","last_change":"2024-04-25T09:04:02.844968+0000","last_active":"2024-04-25T09:04:05.558759+0000","last_peered":"2024-04-25T09:04:05.558759+0000","last_clean":"2024-04-25T09:04:05.558759+0000","last_became_active":"2024-04-25T09:04:02.844639+0000","last_became_peered":"2024-04-25T09:04:02.844639+0000","last_unstale":"2024-04-25T09:04:05.558759+0000","last_undegraded":"2024-04-25T09:04:05.558759+0000","last_fullsized":"2024-04-25T09:04:05.558759+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:47.981260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.843008+0000","last_change":"2024-04-25T09:04:03.836889+0000","last_active":"2024-04-25T09:04:04.843008+0000","last_peered":"2024-04-25T09:04:04.843008+0000","last_clean":"2024-04-25T09:04:04.843008+0000","last_became_active":"2024-04-25T09:04:03.836621+0000","last_became_peered":"2024-04-25T09:04:03.836621+0000","last_unstale":"2024-04-25T09:04:04.843008+0000","last_undegraded":"2024-04-25T09:04:04.843008+0000","last_fullsized":"2024-04-25T09:04:04.843008+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:29.586676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.058029+0000","last_change":"2024-04-25T09:04:02.842347+0000","last_active":"2024-04-25T09:04:05.058029+0000","last_peered":"2024-04-25T09:04:05.058029+0000","last_clean":"2024-04-25T09:04:05.058029+0000","last_became_active":"2024-04-25T09:04:02.842050+0000","last_became_peered":"2024-04-25T09:04:02.842050+0000","last_unstale":"2024-04-25T09:04:05.058029+0000","last_undegraded":"2024-04-25T09:04:05.058029+0000","last_fullsized":"2024-04-25T09:04:05.058029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:07.593085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.841754+0000","last_change":"2024-04-25T09:04:03.848474+0000","last_active":"2024-04-25T09:04:04.841754+0000","last_peered":"2024-04-25T09:04:04.841754+0000","last_clean":"2024-04-25T09:04:04.841754+0000","last_became_active":"2024-04-25T09:04:03.848033+0000","last_became_peered":"2024-04-25T09:04:03.848033+0000","last_unstale":"2024-04-25T09:04:04.841754+0000","last_undegraded":"2024-04-25T09:04:04.841754+0000","last_fullsized":"2024-04-25T09:04:04.841754+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:56.126652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.843315+0000","last_change":"2024-04-25T09:04:02.837853+0000","last_active":"2024-04-25T09:04:04.843315+0000","last_peered":"2024-04-25T09:04:04.843315+0000","last_clean":"2024-04-25T09:04:04.843315+0000","last_became_active":"2024-04-25T09:04:02.837463+0000","last_became_peered":"2024-04-25T09:04:02.837463+0000","last_unstale":"2024-04-25T09:04:04.843315+0000","last_undegraded":"2024-04-25T09:04:04.843315+0000","last_fullsized":"2024-04-25T09:04:04.843315+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.352305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558192+0000","last_change":"2024-04-25T09:04:03.843352+0000","last_active":"2024-04-25T09:04:05.558192+0000","last_peered":"2024-04-25T09:04:05.558192+0000","last_clean":"2024-04-25T09:04:05.558192+0000","last_became_active":"2024-04-25T09:04:03.843096+0000","last_became_peered":"2024-04-25T09:04:03.843096+0000","last_unstale":"2024-04-25T09:04:05.558192+0000","last_undegraded":"2024-04-25T09:04:05.558192+0000","last_fullsized":"2024-04-25T09:04:05.558192+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:39.676625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.304538+0000","last_change":"2024-04-25T09:04:02.843213+0000","last_active":"2024-04-25T09:04:05.304538+0000","last_peered":"2024-04-25T09:04:05.304538+0000","last_clean":"2024-04-25T09:04:05.304538+0000","last_became_active":"2024-04-25T09:04:02.842911+0000","last_became_peered":"2024-04-25T09:04:02.842911+0000","last_unstale":"2024-04-25T09:04:05.304538+0000","last_undegraded":"2024-04-25T09:04:05.304538+0000","last_fullsized":"2024-04-25T09:04:05.304538+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:49.664471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.304518+0000","last_change":"2024-04-25T09:04:03.855154+0000","last_active":"2024-04-25T09:04:05.304518+0000","last_peered":"2024-04-25T09:04:05.304518+0000","last_clean":"2024-04-25T09:04:05.304518+0000","last_became_active":"2024-04-25T09:04:03.854659+0000","last_became_peered":"2024-04-25T09:04:03.854659+0000","last_unstale":"2024-04-25T09:04:05.304518+0000","last_undegraded":"2024-04-25T09:04:05.304518+0000","last_fullsized":"2024-04-25T09:04:05.304518+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:47.579302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558668+0000","last_change":"2024-04-25T09:04:02.851363+0000","last_active":"2024-04-25T09:04:05.558668+0000","last_peered":"2024-04-25T09:04:05.558668+0000","last_clean":"2024-04-25T09:04:05.558668+0000","last_became_active":"2024-04-25T09:04:02.850949+0000","last_became_peered":"2024-04-25T09:04:02.850949+0000","last_unstale":"2024-04-25T09:04:05.558668+0000","last_undegraded":"2024-04-25T09:04:05.558668+0000","last_fullsized":"2024-04-25T09:04:05.558668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:24.439155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.843520+0000","last_change":"2024-04-25T09:04:03.852928+0000","last_active":"2024-04-25T09:04:04.843520+0000","last_peered":"2024-04-25T09:04:04.843520+0000","last_clean":"2024-04-25T09:04:04.843520+0000","last_became_active":"2024-04-25T09:04:03.852667+0000","last_became_peered":"2024-04-25T09:04:03.852667+0000","last_unstale":"2024-04-25T09:04:04.843520+0000","last_undegraded":"2024-04-25T09:04:04.843520+0000","last_fullsized":"2024-04-25T09:04:04.843520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:05.560039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.057696+0000","last_change":"2024-04-25T09:04:02.850909+0000","last_active":"2024-04-25T09:04:05.057696+0000","last_peered":"2024-04-25T09:04:05.057696+0000","last_clean":"2024-04-25T09:04:05.057696+0000","last_became_active":"2024-04-25T09:04:02.850644+0000","last_became_peered":"2024-04-25T09:04:02.850644+0000","last_unstale":"2024-04-25T09:04:05.057696+0000","last_undegraded":"2024-04-25T09:04:05.057696+0000","last_fullsized":"2024-04-25T09:04:05.057696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:10.292045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.841470+0000","last_change":"2024-04-25T09:04:03.849733+0000","last_active":"2024-04-25T09:04:04.841470+0000","last_peered":"2024-04-25T09:04:04.841470+0000","last_clean":"2024-04-25T09:04:04.841470+0000","last_became_active":"2024-04-25T09:04:03.849498+0000","last_became_peered":"2024-04-25T09:04:03.849498+0000","last_unstale":"2024-04-25T09:04:04.841470+0000","last_undegraded":"2024-04-25T09:04:04.841470+0000","last_fullsized":"2024-04-25T09:04:04.841470+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:31.110613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.842391+0000","last_change":"2024-04-25T09:04:02.842246+0000","last_active":"2024-04-25T09:04:04.842391+0000","last_peered":"2024-04-25T09:04:04.842391+0000","last_clean":"2024-04-25T09:04:04.842391+0000","last_became_active":"2024-04-25T09:04:02.838163+0000","last_became_peered":"2024-04-25T09:04:02.838163+0000","last_unstale":"2024-04-25T09:04:04.842391+0000","last_undegraded":"2024-04-25T09:04:04.842391+0000","last_fullsized":"2024-04-25T09:04:04.842391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:21.893561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558557+0000","last_change":"2024-04-25T09:04:03.854786+0000","last_active":"2024-04-25T09:04:05.558557+0000","last_peered":"2024-04-25T09:04:05.558557+0000","last_clean":"2024-04-25T09:04:05.558557+0000","last_became_active":"2024-04-25T09:04:03.854483+0000","last_became_peered":"2024-04-25T09:04:03.854483+0000","last_unstale":"2024-04-25T09:04:05.558557+0000","last_undegraded":"2024-04-25T09:04:05.558557+0000","last_fullsized":"2024-04-25T09:04:05.558557+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:25.784448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.841850+0000","last_change":"2024-04-25T09:04:02.837904+0000","last_active":"2024-04-25T09:04:04.841850+0000","last_peered":"2024-04-25T09:04:04.841850+0000","last_clean":"2024-04-25T09:04:04.841850+0000","last_became_active":"2024-04-25T09:04:02.837467+0000","last_became_peered":"2024-04-25T09:04:02.837467+0000","last_unstale":"2024-04-25T09:04:04.841850+0000","last_undegraded":"2024-04-25T09:04:04.841850+0000","last_fullsized":"2024-04-25T09:04:04.841850+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:41.535581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.559116+0000","last_change":"2024-04-25T09:04:03.856619+0000","last_active":"2024-04-25T09:04:05.559116+0000","last_peered":"2024-04-25T09:04:05.559116+0000","last_clean":"2024-04-25T09:04:05.559116+0000","last_became_active":"2024-04-25T09:04:03.856368+0000","last_became_peered":"2024-04-25T09:04:03.856368+0000","last_unstale":"2024-04-25T09:04:05.559116+0000","last_undegraded":"2024-04-25T09:04:05.559116+0000","last_fullsized":"2024-04-25T09:04:05.559116+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:29.195400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.304814+0000","last_change":"2024-04-25T09:04:02.845952+0000","last_active":"2024-04-25T09:04:05.304814+0000","last_peered":"2024-04-25T09:04:05.304814+0000","last_clean":"2024-04-25T09:04:05.304814+0000","last_became_active":"2024-04-25T09:04:02.845536+0000","last_became_peered":"2024-04-25T09:04:02.845536+0000","last_unstale":"2024-04-25T09:04:05.304814+0000","last_undegraded":"2024-04-25T09:04:05.304814+0000","last_fullsized":"2024-04-25T09:04:05.304814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:25.532613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558899+0000","last_change":"2024-04-25T09:04:03.852772+0000","last_active":"2024-04-25T09:04:05.558899+0000","last_peered":"2024-04-25T09:04:05.558899+0000","last_clean":"2024-04-25T09:04:05.558899+0000","last_became_active":"2024-04-25T09:04:03.852537+0000","last_became_peered":"2024-04-25T09:04:03.852537+0000","last_unstale":"2024-04-25T09:04:05.558899+0000","last_undegraded":"2024-04-25T09:04:05.558899+0000","last_fullsized":"2024-04-25T09:04:05.558899+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:07.939272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.304998+0000","last_change":"2024-04-25T09:04:02.846311+0000","last_active":"2024-04-25T09:04:05.304998+0000","last_peered":"2024-04-25T09:04:05.304998+0000","last_clean":"2024-04-25T09:04:05.304998+0000","last_became_active":"2024-04-25T09:04:02.845983+0000","last_became_peered":"2024-04-25T09:04:02.845983+0000","last_unstale":"2024-04-25T09:04:05.304998+0000","last_undegraded":"2024-04-25T09:04:05.304998+0000","last_fullsized":"2024-04-25T09:04:05.304998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:23.451902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.842969+0000","last_change":"2024-04-25T09:04:03.849902+0000","last_active":"2024-04-25T09:04:04.842969+0000","last_peered":"2024-04-25T09:04:04.842969+0000","last_clean":"2024-04-25T09:04:04.842969+0000","last_became_active":"2024-04-25T09:04:03.849674+0000","last_became_peered":"2024-04-25T09:04:03.849674+0000","last_unstale":"2024-04-25T09:04:04.842969+0000","last_undegraded":"2024-04-25T09:04:04.842969+0000","last_fullsized":"2024-04-25T09:04:04.842969+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:20.275314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.841841+0000","last_change":"2024-04-25T09:04:02.841438+0000","last_active":"2024-04-25T09:04:04.841841+0000","last_peered":"2024-04-25T09:04:04.841841+0000","last_clean":"2024-04-25T09:04:04.841841+0000","last_became_active":"2024-04-25T09:04:02.841168+0000","last_became_peered":"2024-04-25T09:04:02.841168+0000","last_unstale":"2024-04-25T09:04:04.841841+0000","last_undegraded":"2024-04-25T09:04:04.841841+0000","last_fullsized":"2024-04-25T09:04:04.841841+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:01.755673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558658+0000","last_change":"2024-04-25T09:04:03.853673+0000","last_active":"2024-04-25T09:04:05.558658+0000","last_peered":"2024-04-25T09:04:05.558658+0000","last_clean":"2024-04-25T09:04:05.558658+0000","last_became_active":"2024-04-25T09:04:03.853424+0000","last_became_peered":"2024-04-25T09:04:03.853424+0000","last_unstale":"2024-04-25T09:04:05.558658+0000","last_undegraded":"2024-04-25T09:04:05.558658+0000","last_fullsized":"2024-04-25T09:04:05.558658+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:02.762325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.841724+0000","last_change":"2024-04-25T09:04:02.843180+0000","last_active":"2024-04-25T09:04:04.841724+0000","last_peered":"2024-04-25T09:04:04.841724+0000","last_clean":"2024-04-25T09:04:04.841724+0000","last_became_active":"2024-04-25T09:04:02.842871+0000","last_became_peered":"2024-04-25T09:04:02.842871+0000","last_unstale":"2024-04-25T09:04:04.841724+0000","last_undegraded":"2024-04-25T09:04:04.841724+0000","last_fullsized":"2024-04-25T09:04:04.841724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:02.448145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.841329+0000","last_change":"2024-04-25T09:04:03.839476+0000","last_active":"2024-04-25T09:04:04.841329+0000","last_peered":"2024-04-25T09:04:04.841329+0000","last_clean":"2024-04-25T09:04:04.841329+0000","last_became_active":"2024-04-25T09:04:03.839231+0000","last_became_peered":"2024-04-25T09:04:03.839231+0000","last_unstale":"2024-04-25T09:04:04.841329+0000","last_undegraded":"2024-04-25T09:04:04.841329+0000","last_fullsized":"2024-04-25T09:04:04.841329+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:41.859118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.057673+0000","last_change":"2024-04-25T09:04:02.848772+0000","last_active":"2024-04-25T09:04:05.057673+0000","last_peered":"2024-04-25T09:04:05.057673+0000","last_clean":"2024-04-25T09:04:05.057673+0000","last_became_active":"2024-04-25T09:04:02.848498+0000","last_became_peered":"2024-04-25T09:04:02.848498+0000","last_unstale":"2024-04-25T09:04:05.057673+0000","last_undegraded":"2024-04-25T09:04:05.057673+0000","last_fullsized":"2024-04-25T09:04:05.057673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:19.693347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558642+0000","last_change":"2024-04-25T09:04:03.859312+0000","last_active":"2024-04-25T09:04:05.558642+0000","last_peered":"2024-04-25T09:04:05.558642+0000","last_clean":"2024-04-25T09:04:05.558642+0000","last_became_active":"2024-04-25T09:04:03.858980+0000","last_became_peered":"2024-04-25T09:04:03.858980+0000","last_unstale":"2024-04-25T09:04:05.558642+0000","last_undegraded":"2024-04-25T09:04:05.558642+0000","last_fullsized":"2024-04-25T09:04:05.558642+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:18.750007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.842252+0000","last_change":"2024-04-25T09:04:02.832388+0000","last_active":"2024-04-25T09:04:04.842252+0000","last_peered":"2024-04-25T09:04:04.842252+0000","last_clean":"2024-04-25T09:04:04.842252+0000","last_became_active":"2024-04-25T09:04:02.831918+0000","last_became_peered":"2024-04-25T09:04:02.831918+0000","last_unstale":"2024-04-25T09:04:04.842252+0000","last_undegraded":"2024-04-25T09:04:04.842252+0000","last_fullsized":"2024-04-25T09:04:04.842252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:21.893561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.841477+0000","last_change":"2024-04-25T09:04:03.844551+0000","last_active":"2024-04-25T09:04:04.841477+0000","last_peered":"2024-04-25T09:04:04.841477+0000","last_clean":"2024-04-25T09:04:04.841477+0000","last_became_active":"2024-04-25T09:04:03.844014+0000","last_became_peered":"2024-04-25T09:04:03.844014+0000","last_unstale":"2024-04-25T09:04:04.841477+0000","last_undegraded":"2024-04-25T09:04:04.841477+0000","last_fullsized":"2024-04-25T09:04:04.841477+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:39.308057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558470+0000","last_change":"2024-04-25T09:04:02.852288+0000","last_active":"2024-04-25T09:04:05.558470+0000","last_peered":"2024-04-25T09:04:05.558470+0000","last_clean":"2024-04-25T09:04:05.558470+0000","last_became_active":"2024-04-25T09:04:02.851978+0000","last_became_peered":"2024-04-25T09:04:02.851978+0000","last_unstale":"2024-04-25T09:04:05.558470+0000","last_undegraded":"2024-04-25T09:04:05.558470+0000","last_fullsized":"2024-04-25T09:04:05.558470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:55.027343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.841669+0000","last_change":"2024-04-25T09:04:03.841832+0000","last_active":"2024-04-25T09:04:04.841669+0000","last_peered":"2024-04-25T09:04:04.841669+0000","last_clean":"2024-04-25T09:04:04.841669+0000","last_became_active":"2024-04-25T09:04:03.841585+0000","last_became_peered":"2024-04-25T09:04:03.841585+0000","last_unstale":"2024-04-25T09:04:04.841669+0000","last_undegraded":"2024-04-25T09:04:04.841669+0000","last_fullsized":"2024-04-25T09:04:04.841669+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:02.277045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.304887+0000","last_change":"2024-04-25T09:04:02.849353+0000","last_active":"2024-04-25T09:04:05.304887+0000","last_peered":"2024-04-25T09:04:05.304887+0000","last_clean":"2024-04-25T09:04:05.304887+0000","last_became_active":"2024-04-25T09:04:02.849106+0000","last_became_peered":"2024-04-25T09:04:02.849106+0000","last_unstale":"2024-04-25T09:04:05.304887+0000","last_undegraded":"2024-04-25T09:04:05.304887+0000","last_fullsized":"2024-04-25T09:04:05.304887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:41.506582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.304920+0000","last_change":"2024-04-25T09:04:03.854450+0000","last_active":"2024-04-25T09:04:05.304920+0000","last_peered":"2024-04-25T09:04:05.304920+0000","last_clean":"2024-04-25T09:04:05.304920+0000","last_became_active":"2024-04-25T09:04:03.854184+0000","last_became_peered":"2024-04-25T09:04:03.854184+0000","last_unstale":"2024-04-25T09:04:05.304920+0000","last_undegraded":"2024-04-25T09:04:05.304920+0000","last_fullsized":"2024-04-25T09:04:05.304920+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:37.398575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.842962+0000","last_change":"2024-04-25T09:04:02.849282+0000","last_active":"2024-04-25T09:04:04.842962+0000","last_peered":"2024-04-25T09:04:04.842962+0000","last_clean":"2024-04-25T09:04:04.842962+0000","last_became_active":"2024-04-25T09:04:02.848992+0000","last_became_peered":"2024-04-25T09:04:02.848992+0000","last_unstale":"2024-04-25T09:04:04.842962+0000","last_undegraded":"2024-04-25T09:04:04.842962+0000","last_fullsized":"2024-04-25T09:04:04.842962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:16.243545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.842847+0000","last_change":"2024-04-25T09:04:03.843605+0000","last_active":"2024-04-25T09:04:04.842847+0000","last_peered":"2024-04-25T09:04:04.842847+0000","last_clean":"2024-04-25T09:04:04.842847+0000","last_became_active":"2024-04-25T09:04:03.840559+0000","last_became_peered":"2024-04-25T09:04:03.840559+0000","last_unstale":"2024-04-25T09:04:04.842847+0000","last_undegraded":"2024-04-25T09:04:04.842847+0000","last_fullsized":"2024-04-25T09:04:04.842847+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:26.539265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558677+0000","last_change":"2024-04-25T09:04:02.846278+0000","last_active":"2024-04-25T09:04:05.558677+0000","last_peered":"2024-04-25T09:04:05.558677+0000","last_clean":"2024-04-25T09:04:05.558677+0000","last_became_active":"2024-04-25T09:04:02.845737+0000","last_became_peered":"2024-04-25T09:04:02.845737+0000","last_unstale":"2024-04-25T09:04:05.558677+0000","last_undegraded":"2024-04-25T09:04:05.558677+0000","last_fullsized":"2024-04-25T09:04:05.558677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:49.934587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558861+0000","last_change":"2024-04-25T09:04:03.866201+0000","last_active":"2024-04-25T09:04:05.558861+0000","last_peered":"2024-04-25T09:04:05.558861+0000","last_clean":"2024-04-25T09:04:05.558861+0000","last_became_active":"2024-04-25T09:04:03.865879+0000","last_became_peered":"2024-04-25T09:04:03.865879+0000","last_unstale":"2024-04-25T09:04:05.558861+0000","last_undegraded":"2024-04-25T09:04:05.558861+0000","last_fullsized":"2024-04-25T09:04:05.558861+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:08.599737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.057797+0000","last_change":"2024-04-25T09:04:02.842942+0000","last_active":"2024-04-25T09:04:05.057797+0000","last_peered":"2024-04-25T09:04:05.057797+0000","last_clean":"2024-04-25T09:04:05.057797+0000","last_became_active":"2024-04-25T09:04:02.842698+0000","last_became_peered":"2024-04-25T09:04:02.842698+0000","last_unstale":"2024-04-25T09:04:05.057797+0000","last_undegraded":"2024-04-25T09:04:05.057797+0000","last_fullsized":"2024-04-25T09:04:05.057797+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:24.777797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558685+0000","last_change":"2024-04-25T09:04:03.852716+0000","last_active":"2024-04-25T09:04:05.558685+0000","last_peered":"2024-04-25T09:04:05.558685+0000","last_clean":"2024-04-25T09:04:05.558685+0000","last_became_active":"2024-04-25T09:04:03.852413+0000","last_became_peered":"2024-04-25T09:04:03.852413+0000","last_unstale":"2024-04-25T09:04:05.558685+0000","last_undegraded":"2024-04-25T09:04:05.558685+0000","last_fullsized":"2024-04-25T09:04:05.558685+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:18.168955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558322+0000","last_change":"2024-04-25T09:04:02.850799+0000","last_active":"2024-04-25T09:04:05.558322+0000","last_peered":"2024-04-25T09:04:05.558322+0000","last_clean":"2024-04-25T09:04:05.558322+0000","last_became_active":"2024-04-25T09:04:02.850539+0000","last_became_peered":"2024-04-25T09:04:02.850539+0000","last_unstale":"2024-04-25T09:04:05.558322+0000","last_undegraded":"2024-04-25T09:04:05.558322+0000","last_fullsized":"2024-04-25T09:04:05.558322+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:26.148209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558696+0000","last_change":"2024-04-25T09:04:03.845728+0000","last_active":"2024-04-25T09:04:05.558696+0000","last_peered":"2024-04-25T09:04:05.558696+0000","last_clean":"2024-04-25T09:04:05.558696+0000","last_became_active":"2024-04-25T09:04:03.845485+0000","last_became_peered":"2024-04-25T09:04:03.845485+0000","last_unstale":"2024-04-25T09:04:05.558696+0000","last_undegraded":"2024-04-25T09:04:05.558696+0000","last_fullsized":"2024-04-25T09:04:05.558696+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:03.454797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558989+0000","last_change":"2024-04-25T09:04:02.848548+0000","last_active":"2024-04-25T09:04:05.558989+0000","last_peered":"2024-04-25T09:04:05.558989+0000","last_clean":"2024-04-25T09:04:05.558989+0000","last_became_active":"2024-04-25T09:04:02.848233+0000","last_became_peered":"2024-04-25T09:04:02.848233+0000","last_unstale":"2024-04-25T09:04:05.558989+0000","last_undegraded":"2024-04-25T09:04:05.558989+0000","last_fullsized":"2024-04-25T09:04:05.558989+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:47.699050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.304348+0000","last_change":"2024-04-25T09:04:03.864573+0000","last_active":"2024-04-25T09:04:05.304348+0000","last_peered":"2024-04-25T09:04:05.304348+0000","last_clean":"2024-04-25T09:04:05.304348+0000","last_became_active":"2024-04-25T09:04:03.863608+0000","last_became_peered":"2024-04-25T09:04:03.863608+0000","last_unstale":"2024-04-25T09:04:05.304348+0000","last_undegraded":"2024-04-25T09:04:05.304348+0000","last_fullsized":"2024-04-25T09:04:05.304348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:42.798516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558762+0000","last_change":"2024-04-25T09:04:02.845146+0000","last_active":"2024-04-25T09:04:05.558762+0000","last_peered":"2024-04-25T09:04:05.558762+0000","last_clean":"2024-04-25T09:04:05.558762+0000","last_became_active":"2024-04-25T09:04:02.844871+0000","last_became_peered":"2024-04-25T09:04:02.844871+0000","last_unstale":"2024-04-25T09:04:05.558762+0000","last_undegraded":"2024-04-25T09:04:05.558762+0000","last_fullsized":"2024-04-25T09:04:05.558762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:28.980143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.841812+0000","last_change":"2024-04-25T09:04:03.844724+0000","last_active":"2024-04-25T09:04:04.841812+0000","last_peered":"2024-04-25T09:04:04.841812+0000","last_clean":"2024-04-25T09:04:04.841812+0000","last_became_active":"2024-04-25T09:04:03.844296+0000","last_became_peered":"2024-04-25T09:04:03.844296+0000","last_unstale":"2024-04-25T09:04:04.841812+0000","last_undegraded":"2024-04-25T09:04:04.841812+0000","last_fullsized":"2024-04-25T09:04:04.841812+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:42.213726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558149+0000","last_change":"2024-04-25T09:04:02.851466+0000","last_active":"2024-04-25T09:04:05.558149+0000","last_peered":"2024-04-25T09:04:05.558149+0000","last_clean":"2024-04-25T09:04:05.558149+0000","last_became_active":"2024-04-25T09:04:02.851149+0000","last_became_peered":"2024-04-25T09:04:02.851149+0000","last_unstale":"2024-04-25T09:04:05.558149+0000","last_undegraded":"2024-04-25T09:04:05.558149+0000","last_fullsized":"2024-04-25T09:04:05.558149+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:09.916838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.057847+0000","last_change":"2024-04-25T09:04:03.863226+0000","last_active":"2024-04-25T09:04:05.057847+0000","last_peered":"2024-04-25T09:04:05.057847+0000","last_clean":"2024-04-25T09:04:05.057847+0000","last_became_active":"2024-04-25T09:04:03.862855+0000","last_became_peered":"2024-04-25T09:04:03.862855+0000","last_unstale":"2024-04-25T09:04:05.057847+0000","last_undegraded":"2024-04-25T09:04:05.057847+0000","last_fullsized":"2024-04-25T09:04:05.057847+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:03.454797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.305040+0000","last_change":"2024-04-25T09:04:02.846991+0000","last_active":"2024-04-25T09:04:05.305040+0000","last_peered":"2024-04-25T09:04:05.305040+0000","last_clean":"2024-04-25T09:04:05.305040+0000","last_became_active":"2024-04-25T09:04:02.846719+0000","last_became_peered":"2024-04-25T09:04:02.846719+0000","last_unstale":"2024-04-25T09:04:05.305040+0000","last_undegraded":"2024-04-25T09:04:05.305040+0000","last_fullsized":"2024-04-25T09:04:05.305040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:45.304468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.559094+0000","last_change":"2024-04-25T09:04:03.860899+0000","last_active":"2024-04-25T09:04:05.559094+0000","last_peered":"2024-04-25T09:04:05.559094+0000","last_clean":"2024-04-25T09:04:05.559094+0000","last_became_active":"2024-04-25T09:04:03.860613+0000","last_became_peered":"2024-04-25T09:04:03.860613+0000","last_unstale":"2024-04-25T09:04:05.559094+0000","last_undegraded":"2024-04-25T09:04:05.559094+0000","last_fullsized":"2024-04-25T09:04:05.559094+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:44.938141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558820+0000","last_change":"2024-04-25T09:04:02.848506+0000","last_active":"2024-04-25T09:04:05.558820+0000","last_peered":"2024-04-25T09:04:05.558820+0000","last_clean":"2024-04-25T09:04:05.558820+0000","last_became_active":"2024-04-25T09:04:02.848199+0000","last_became_peered":"2024-04-25T09:04:02.848199+0000","last_unstale":"2024-04-25T09:04:05.558820+0000","last_undegraded":"2024-04-25T09:04:05.558820+0000","last_fullsized":"2024-04-25T09:04:05.558820+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:29.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.841649+0000","last_change":"2024-04-25T09:04:03.837757+0000","last_active":"2024-04-25T09:04:04.841649+0000","last_peered":"2024-04-25T09:04:04.841649+0000","last_clean":"2024-04-25T09:04:04.841649+0000","last_became_active":"2024-04-25T09:04:03.837060+0000","last_became_peered":"2024-04-25T09:04:03.837060+0000","last_unstale":"2024-04-25T09:04:04.841649+0000","last_undegraded":"2024-04-25T09:04:04.841649+0000","last_fullsized":"2024-04-25T09:04:04.841649+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:48.995172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558335+0000","last_change":"2024-04-25T09:04:02.842312+0000","last_active":"2024-04-25T09:04:05.558335+0000","last_peered":"2024-04-25T09:04:05.558335+0000","last_clean":"2024-04-25T09:04:05.558335+0000","last_became_active":"2024-04-25T09:04:02.842050+0000","last_became_peered":"2024-04-25T09:04:02.842050+0000","last_unstale":"2024-04-25T09:04:05.558335+0000","last_undegraded":"2024-04-25T09:04:05.558335+0000","last_fullsized":"2024-04-25T09:04:05.558335+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:11.921445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558849+0000","last_change":"2024-04-25T09:04:03.850515+0000","last_active":"2024-04-25T09:04:05.558849+0000","last_peered":"2024-04-25T09:04:05.558849+0000","last_clean":"2024-04-25T09:04:05.558849+0000","last_became_active":"2024-04-25T09:04:03.850251+0000","last_became_peered":"2024-04-25T09:04:03.850251+0000","last_unstale":"2024-04-25T09:04:05.558849+0000","last_undegraded":"2024-04-25T09:04:05.558849+0000","last_fullsized":"2024-04-25T09:04:05.558849+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:42.542233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558548+0000","last_change":"2024-04-25T09:04:02.846007+0000","last_active":"2024-04-25T09:04:05.558548+0000","last_peered":"2024-04-25T09:04:05.558548+0000","last_clean":"2024-04-25T09:04:05.558548+0000","last_became_active":"2024-04-25T09:04:02.844376+0000","last_became_peered":"2024-04-25T09:04:02.844376+0000","last_unstale":"2024-04-25T09:04:05.558548+0000","last_undegraded":"2024-04-25T09:04:05.558548+0000","last_fullsized":"2024-04-25T09:04:05.558548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:10.292045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.057698+0000","last_change":"2024-04-25T09:04:03.847359+0000","last_active":"2024-04-25T09:04:05.057698+0000","last_peered":"2024-04-25T09:04:05.057698+0000","last_clean":"2024-04-25T09:04:05.057698+0000","last_became_active":"2024-04-25T09:04:03.846870+0000","last_became_peered":"2024-04-25T09:04:03.846870+0000","last_unstale":"2024-04-25T09:04:05.057698+0000","last_undegraded":"2024-04-25T09:04:05.057698+0000","last_fullsized":"2024-04-25T09:04:05.057698+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:13.826622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.842685+0000","last_change":"2024-04-25T09:04:02.844380+0000","last_active":"2024-04-25T09:04:04.842685+0000","last_peered":"2024-04-25T09:04:04.842685+0000","last_clean":"2024-04-25T09:04:04.842685+0000","last_became_active":"2024-04-25T09:04:02.843215+0000","last_became_peered":"2024-04-25T09:04:02.843215+0000","last_unstale":"2024-04-25T09:04:04.842685+0000","last_undegraded":"2024-04-25T09:04:04.842685+0000","last_fullsized":"2024-04-25T09:04:04.842685+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.352305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.843011+0000","last_change":"2024-04-25T09:04:03.840896+0000","last_active":"2024-04-25T09:04:04.843011+0000","last_peered":"2024-04-25T09:04:04.843011+0000","last_clean":"2024-04-25T09:04:04.843011+0000","last_became_active":"2024-04-25T09:04:03.840575+0000","last_became_peered":"2024-04-25T09:04:03.840575+0000","last_unstale":"2024-04-25T09:04:04.843011+0000","last_undegraded":"2024-04-25T09:04:04.843011+0000","last_fullsized":"2024-04-25T09:04:04.843011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:07.579563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.842613+0000","last_change":"2024-04-25T09:04:02.837823+0000","last_active":"2024-04-25T09:04:04.842613+0000","last_peered":"2024-04-25T09:04:04.842613+0000","last_clean":"2024-04-25T09:04:04.842613+0000","last_became_active":"2024-04-25T09:04:02.837539+0000","last_became_peered":"2024-04-25T09:04:02.837539+0000","last_unstale":"2024-04-25T09:04:04.842613+0000","last_undegraded":"2024-04-25T09:04:04.842613+0000","last_fullsized":"2024-04-25T09:04:04.842613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:57.442579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558998+0000","last_change":"2024-04-25T09:04:03.855895+0000","last_active":"2024-04-25T09:04:05.558998+0000","last_peered":"2024-04-25T09:04:05.558998+0000","last_clean":"2024-04-25T09:04:05.558998+0000","last_became_active":"2024-04-25T09:04:03.855578+0000","last_became_peered":"2024-04-25T09:04:03.855578+0000","last_unstale":"2024-04-25T09:04:05.558998+0000","last_undegraded":"2024-04-25T09:04:05.558998+0000","last_fullsized":"2024-04-25T09:04:05.558998+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:51.754005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:04.841228+0000","last_change":"2024-04-25T09:04:02.837731+0000","last_active":"2024-04-25T09:04:04.841228+0000","last_peered":"2024-04-25T09:04:04.841228+0000","last_clean":"2024-04-25T09:04:04.841228+0000","last_became_active":"2024-04-25T09:04:02.837436+0000","last_became_peered":"2024-04-25T09:04:02.837436+0000","last_unstale":"2024-04-25T09:04:04.841228+0000","last_undegraded":"2024-04-25T09:04:04.841228+0000","last_fullsized":"2024-04-25T09:04:04.841228+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:12.819970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.304703+0000","last_change":"2024-04-25T09:04:03.864362+0000","last_active":"2024-04-25T09:04:05.304703+0000","last_peered":"2024-04-25T09:04:05.304703+0000","last_clean":"2024-04-25T09:04:05.304703+0000","last_became_active":"2024-04-25T09:04:03.863013+0000","last_became_peered":"2024-04-25T09:04:03.863013+0000","last_unstale":"2024-04-25T09:04:05.304703+0000","last_undegraded":"2024-04-25T09:04:05.304703+0000","last_fullsized":"2024-04-25T09:04:05.304703+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:02.815440+0000","last_clean_scrub_stamp":"2024-04-25T09:04:02.815440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:02.014079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.559080+0000","last_change":"2024-04-25T09:04:02.853471+0000","last_active":"2024-04-25T09:04:05.559080+0000","last_peered":"2024-04-25T09:04:05.559080+0000","last_clean":"2024-04-25T09:04:05.559080+0000","last_became_active":"2024-04-25T09:04:02.853275+0000","last_became_peered":"2024-04-25T09:04:02.853275+0000","last_unstale":"2024-04-25T09:04:05.559080+0000","last_undegraded":"2024-04-25T09:04:05.559080+0000","last_fullsized":"2024-04-25T09:04:05.559080+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:01.808788+0000","last_clean_scrub_stamp":"2024-04-25T09:04:01.808788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:33.203542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":202,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:04:05.558755+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:04:05.558755+0000","last_peered":"2024-04-25T09:04:05.558755+0000","last_clean":"2024-04-25T09:04:05.558755+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:04:05.558755+0000","last_undegraded":"2024-04-25T09:04:05.558755+0000","last_fullsized":"2024-04-25T09:04:05.558755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":196756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":196286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":196778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":197820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":196244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":196264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1052672,"data_stored":786576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1064960,"data_stored":788224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:04:12.758 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:04:12.758 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:04:12.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.949+0000 7fce03000640 1 Processor -- start 2024-04-25T09:04:12.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.949+0000 7fce03000640 1 -- start start 2024-04-25T09:04:12.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.949+0000 7fce03000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdfc159f00 0x7fcdfc0cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.949+0000 7fce03000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdfc15ddd0 con 0x7fcdfc0cff40 2024-04-25T09:04:12.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.949+0000 7fce03000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdfc15e0b0 con 0x7fcdfc0cda00 2024-04-25T09:04:12.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.949+0000 7fce03000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc15e390 con 0x7fcdfc159f00 2024-04-25T09:04:12.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.949+0000 7fcdfb400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fcdfc0cff40 0x7fcdfc0cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:43094/0 (socket says 172.21.15.173:43094) 2024-04-25T09:04:12.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.949+0000 7fcdfb400640 1 -- 172.21.15.173:0/3892259058 learned_addr learned my addr 172.21.15.173:0/3892259058 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:04:12.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.949+0000 7fcdfbe00640 1 --2- 172.21.15.173:0/3892259058 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdfc159f00 0x7fcdfc0cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.949+0000 7fcdfaa00640 1 -- 172.21.15.173:0/3892259058 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609191388 0 0) 0x7fcdfc15ddd0 con 0x7fcdfc0cff40 2024-04-25T09:04:12.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.949+0000 7fcdfaa00640 1 -- 172.21.15.173:0/3892259058 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcde0003530 con 0x7fcdfc0cff40 2024-04-25T09:04:12.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.949+0000 7fcdfaa00640 1 -- 172.21.15.173:0/3892259058 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3716711278 0 0) 0x7fcde0003530 con 0x7fcdfc0cff40 2024-04-25T09:04:12.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.949+0000 7fcdfaa00640 1 -- 172.21.15.173:0/3892259058 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdfc159f00 msgr2=0x7fcdfc0cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:12.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.949+0000 7fcdfaa00640 1 --2- 172.21.15.173:0/3892259058 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdfc159f00 0x7fcdfc0cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.949+0000 7fcdfaa00640 1 -- 172.21.15.173:0/3892259058 >> v1:172.21.15.194:6789/0 conn(0x7fcdfc0cda00 legacy=0x7fcdfc071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.949+0000 7fcdfaa00640 1 -- 172.21.15.173:0/3892259058 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc15e670 con 0x7fcdfc0cff40 2024-04-25T09:04:12.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.949+0000 7fcdfaa00640 1 -- 172.21.15.173:0/3892259058 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fcdec0016a0 con 0x7fcdfc0cff40 2024-04-25T09:04:12.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.949+0000 7fcdfaa00640 1 -- 172.21.15.173:0/3892259058 >> v1:172.21.15.173:6789/0 conn(0x7fcdfc0cff40 legacy=0x7fcdfc0cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.953+0000 7fcdfaa00640 1 --2- 172.21.15.173:0/3892259058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcde00039f0 0x7fcde0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.953+0000 7fcdfaa00640 1 --2- 172.21.15.173:0/3892259058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcde0004810 0x7fcde0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.953+0000 7fcdfaa00640 1 --2- 172.21.15.173:0/3892259058 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdfc159f00 0x7fcde00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.953+0000 7fcdfaa00640 1 -- 172.21.15.173:0/3892259058 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc15e390 con 0x7fcde0004810 2024-04-25T09:04:12.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.953+0000 7fcdfaa00640 1 -- 172.21.15.173:0/3892259058 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde000ba80 con 0x7fcde00039f0 2024-04-25T09:04:12.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.953+0000 7fcdfaa00640 1 -- 172.21.15.173:0/3892259058 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde000de90 con 0x7fcdfc159f00 2024-04-25T09:04:12.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.953+0000 7fcdfb400640 1 --2- 172.21.15.173:0/3892259058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcde0004810 0x7fcde0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.953+0000 7fcdfbe00640 1 --2- 172.21.15.173:0/3892259058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcde00039f0 0x7fcde0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.953+0000 7fce01000640 1 --2- 172.21.15.173:0/3892259058 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdfc159f00 0x7fcde00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.953+0000 7fcdfb400640 1 -- 172.21.15.173:0/3892259058 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdfc159f00 msgr2=0x7fcde00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:12.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.953+0000 7fcdfb400640 1 --2- 172.21.15.173:0/3892259058 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdfc159f00 0x7fcde00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.953+0000 7fcdfb400640 1 -- 172.21.15.173:0/3892259058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcde00039f0 msgr2=0x7fcde0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:12.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.953+0000 7fcdfb400640 1 --2- 172.21.15.173:0/3892259058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcde00039f0 0x7fcde0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.953+0000 7fcdfb400640 1 -- 172.21.15.173:0/3892259058 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde0003530 con 0x7fcde0004810 2024-04-25T09:04:12.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.953+0000 7fcdfb400640 1 --2- 172.21.15.173:0/3892259058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcde0004810 0x7fcde0004c90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0d0380 tx=0x7fcdec01f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea08c20821f9126 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.953+0000 7fcdfaa00640 1 -- 172.21.15.173:0/3892259058 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec007d20 con 0x7fcde0004810 2024-04-25T09:04:12.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.953+0000 7fcdfaa00640 1 -- 172.21.15.173:0/3892259058 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec005b00 con 0x7fcde0004810 2024-04-25T09:04:12.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.953+0000 7fcdfaa00640 1 -- 172.21.15.173:0/3892259058 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec007070 con 0x7fcde0004810 2024-04-25T09:04:12.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fce03000640 1 -- 172.21.15.173:0/3892259058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcde0004810 msgr2=0x7fcde0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fce03000640 1 --2- 172.21.15.173:0/3892259058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcde0004810 0x7fcde0004c90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0d0380 tx=0x7fcdec01f330 comp rx=0 tx=0).stop 2024-04-25T09:04:12.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fce01000640 1 -- 172.21.15.173:0/3892259058 reap_dead start 2024-04-25T09:04:12.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fce03000640 1 -- 172.21.15.173:0/3892259058 shutdown_connections 2024-04-25T09:04:12.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fce03000640 1 -- 172.21.15.173:0/3892259058 >> 172.21.15.173:0/3892259058 conn(0x7fcdfc06ac90 msgr2=0x7fcdfc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:12.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fce03000640 1 -- 172.21.15.173:0/3892259058 shutdown_connections 2024-04-25T09:04:12.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fce03000640 1 -- 172.21.15.173:0/3892259058 wait complete. 2024-04-25T09:04:12.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fce03000640 1 Processor -- start 2024-04-25T09:04:12.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fce03000640 1 -- start start 2024-04-25T09:04:12.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fce03000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcde0004810 0x7fcdfc153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fce03000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdfc1efa00 0x7fcdfc0b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fce03000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdfc1efe80 0x7fcdfc0a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fce03000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc15a460 con 0x7fcdfc1efa00 2024-04-25T09:04:12.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fce03000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc15a2e0 con 0x7fcdfc1efe80 2024-04-25T09:04:12.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fce03000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc15a5e0 con 0x7fcde0004810 2024-04-25T09:04:12.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fcdfb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdfc1efa00 0x7fcdfc0b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fcdfb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdfc1efa00 0x7fcdfc0b1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50494/0 (socket says 172.21.15.173:50494) 2024-04-25T09:04:12.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fcdfb400640 1 -- 172.21.15.173:0/1115322814 learned_addr learned my addr 172.21.15.173:0/1115322814 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:12.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fcdfbe00640 1 --2- 172.21.15.173:0/1115322814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcde0004810 0x7fcdfc153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fce01000640 1 --2- 172.21.15.173:0/1115322814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdfc1efe80 0x7fcdfc0a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fcdfb400640 1 -- 172.21.15.173:0/1115322814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcde0004810 msgr2=0x7fcdfc153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fcdfb400640 1 --2- 172.21.15.173:0/1115322814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcde0004810 0x7fcdfc153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fcdfb400640 1 -- 172.21.15.173:0/1115322814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdfc1efe80 msgr2=0x7fcdfc0a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fcdfb400640 1 --2- 172.21.15.173:0/1115322814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdfc1efe80 0x7fcdfc0a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fcdfb400640 1 -- 172.21.15.173:0/1115322814 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc15b020 con 0x7fcdfc1efa00 2024-04-25T09:04:12.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.957+0000 7fcdfbe00640 1 --2- 172.21.15.173:0/1115322814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcde0004810 0x7fcdfc153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:12.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.961+0000 7fcdfb400640 1 --2- 172.21.15.173:0/1115322814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdfc1efa00 0x7fcdfc0b1830 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fcdec0019a0 tx=0x7fcde0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.961+0000 7fcdf3e00640 1 -- 172.21.15.173:0/1115322814 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec005cb0 con 0x7fcdfc1efa00 2024-04-25T09:04:12.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.961+0000 7fcdf3e00640 1 -- 172.21.15.173:0/1115322814 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec005e50 con 0x7fcdfc1efa00 2024-04-25T09:04:12.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.961+0000 7fcdf3e00640 1 -- 172.21.15.173:0/1115322814 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec004a10 con 0x7fcdfc1efa00 2024-04-25T09:04:12.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.961+0000 7fce03000640 1 -- 172.21.15.173:0/1115322814 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdfc15b300 con 0x7fcdfc1efa00 2024-04-25T09:04:12.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.961+0000 7fce03000640 1 -- 172.21.15.173:0/1115322814 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdfc0b0b90 con 0x7fcdfc1efa00 2024-04-25T09:04:12.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.961+0000 7fce03000640 1 -- 172.21.15.173:0/1115322814 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdfc073ab0 con 0x7fcdfc1efa00 2024-04-25T09:04:12.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.961+0000 7fcdf3e00640 1 -- 172.21.15.173:0/1115322814 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcdec004bb0 con 0x7fcdfc1efa00 2024-04-25T09:04:12.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.961+0000 7fcdf3e00640 1 --2- 172.21.15.173:0/1115322814 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcdd8066f90 0x7fcdd8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.961+0000 7fcdf3e00640 1 -- 172.21.15.173:0/1115322814 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcdec121b10 con 0x7fcdfc1efa00 2024-04-25T09:04:12.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.961+0000 7fcdfbe00640 1 --2- 172.21.15.173:0/1115322814 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcdd8066f90 0x7fcdd8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.961+0000 7fcdfbe00640 1 --2- 172.21.15.173:0/1115322814 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcdd8066f90 0x7fcdd8069450 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009be0 tx=0x7fcde4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:12.965+0000 7fcdf3e00640 1 -- 172.21.15.173:0/1115322814 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcdec0c3070 con 0x7fcdfc1efa00 2024-04-25T09:04:13.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.177+0000 7fce03000640 1 -- 172.21.15.173:0/1115322814 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fcdfc0ccb20 con 0x7fcdfc1efa00 2024-04-25T09:04:13.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.177+0000 7fcdf3e00640 1 -- 172.21.15.173:0/1115322814 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+147 (secure 0 0 0) 0x7fcdec019040 con 0x7fcdfc1efa00 2024-04-25T09:04:13.169 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2024-04-25T09:04:13.169 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w== 2024-04-25T09:04:13.169 INFO:teuthology.orchestra.run.smithi173.stdout: caps mds = "allow" 2024-04-25T09:04:13.169 INFO:teuthology.orchestra.run.smithi173.stdout: caps mon = "allow r" 2024-04-25T09:04:13.169 INFO:teuthology.orchestra.run.smithi173.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:04:13.169 INFO:teuthology.orchestra.run.smithi173.stderr:updated caps for client.0 2024-04-25T09:04:13.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.181+0000 7fce03000640 1 -- 172.21.15.173:0/1115322814 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcdd8066f90 msgr2=0x7fcdd8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.181+0000 7fce03000640 1 --2- 172.21.15.173:0/1115322814 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcdd8066f90 0x7fcdd8069450 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009be0 tx=0x7fcde4008040 comp rx=0 tx=0).stop 2024-04-25T09:04:13.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.181+0000 7fce03000640 1 -- 172.21.15.173:0/1115322814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdfc1efa00 msgr2=0x7fcdfc0b1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.181+0000 7fce03000640 1 --2- 172.21.15.173:0/1115322814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdfc1efa00 0x7fcdfc0b1830 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fcdec0019a0 tx=0x7fcde0005840 comp rx=0 tx=0).stop 2024-04-25T09:04:13.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.181+0000 7fce03000640 1 -- 172.21.15.173:0/1115322814 shutdown_connections 2024-04-25T09:04:13.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.181+0000 7fce03000640 1 --2- 172.21.15.173:0/1115322814 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcdd8066f90 0x7fcdd8069450 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.181+0000 7fce03000640 1 --2- 172.21.15.173:0/1115322814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdfc1efe80 0x7fcdfc0a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.181+0000 7fce03000640 1 --2- 172.21.15.173:0/1115322814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdfc1efa00 0x7fcdfc0b1830 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.181+0000 7fce03000640 1 --2- 172.21.15.173:0/1115322814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcde0004810 0x7fcdfc153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.181+0000 7fce03000640 1 -- 172.21.15.173:0/1115322814 >> 172.21.15.173:0/1115322814 conn(0x7fcdfc06ac90 msgr2=0x7fcdfc154340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.181+0000 7fce03000640 1 -- 172.21.15.173:0/1115322814 shutdown_connections 2024-04-25T09:04:13.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.181+0000 7fce03000640 1 -- 172.21.15.173:0/1115322814 wait complete. 2024-04-25T09:04:13.191 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:13.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.333+0000 7f920d000640 1 Processor -- start 2024-04-25T09:04:13.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.333+0000 7f920d000640 1 -- start start 2024-04-25T09:04:13.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f920d000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f92080cc8b0 0x7f92080ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f920d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92080ce8f0 0x7f92080ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f920d000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920806e7c0 con 0x7f9208145250 2024-04-25T09:04:13.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f920d000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f920806d720 con 0x7f92080cc8b0 2024-04-25T09:04:13.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f920d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920806da00 con 0x7f92080ce8f0 2024-04-25T09:04:13.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f9205400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f92080cc8b0 0x7f92080ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f9205400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f92080cc8b0 0x7f92080ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33036/0 (socket says 172.21.15.173:33036) 2024-04-25T09:04:13.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f9205400640 1 -- 172.21.15.173:0/736367598 learned_addr learned my addr 172.21.15.173:0/736367598 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:13.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f9205e00640 1 --1- 172.21.15.173:0/736367598 >> v1:172.21.15.173:6789/0 conn(0x7f9208145250 0x7f920815c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:55922/0 (socket says 172.21.15.173:55922) 2024-04-25T09:04:13.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f9206800640 1 --2- 172.21.15.173:0/736367598 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92080ce8f0 0x7f92080ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f9205400640 1 -- 172.21.15.173:0/736367598 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92080ce8f0 msgr2=0x7f92080ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f9205400640 1 --2- 172.21.15.173:0/736367598 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92080ce8f0 0x7f92080ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f9205400640 1 -- 172.21.15.173:0/736367598 >> v1:172.21.15.173:6789/0 conn(0x7f9208145250 legacy=0x7f920815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f9205400640 1 -- 172.21.15.173:0/736367598 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920806dce0 con 0x7f92080cc8b0 2024-04-25T09:04:13.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f9204a00640 1 -- 172.21.15.173:0/736367598 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836843633 0 0) 0x7f920806e7c0 con 0x7f9208145250 2024-04-25T09:04:13.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f9205400640 1 --2- 172.21.15.173:0/736367598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92080cc8b0 0x7f92080ccd30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f91f8009870 tx=0x7f91f801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57eca2f001c94a29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f9204a00640 1 -- 172.21.15.173:0/736367598 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f80b0070 con 0x7f92080cc8b0 2024-04-25T09:04:13.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f9204a00640 1 -- 172.21.15.173:0/736367598 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f80ab600 con 0x7f92080cc8b0 2024-04-25T09:04:13.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.337+0000 7f9204a00640 1 -- 172.21.15.173:0/736367598 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f80ab9d0 con 0x7f92080cc8b0 2024-04-25T09:04:13.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f920d000640 1 -- 172.21.15.173:0/736367598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92080cc8b0 msgr2=0x7f92080ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f920d000640 1 --2- 172.21.15.173:0/736367598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92080cc8b0 0x7f92080ccd30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f91f8009870 tx=0x7f91f801c380 comp rx=0 tx=0).stop 2024-04-25T09:04:13.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f920d000640 1 -- 172.21.15.173:0/736367598 shutdown_connections 2024-04-25T09:04:13.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f920d000640 1 --2- 172.21.15.173:0/736367598 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92080ce8f0 0x7f92080ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f920d000640 1 --2- 172.21.15.173:0/736367598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92080cc8b0 0x7f92080ccd30 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f920d000640 1 -- 172.21.15.173:0/736367598 >> 172.21.15.173:0/736367598 conn(0x7f920806ac90 msgr2=0x7f920806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f920d000640 1 -- 172.21.15.173:0/736367598 shutdown_connections 2024-04-25T09:04:13.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f920d000640 1 -- 172.21.15.173:0/736367598 wait complete. 2024-04-25T09:04:13.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f920d000640 1 Processor -- start 2024-04-25T09:04:13.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f920d000640 1 -- start start 2024-04-25T09:04:13.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f920d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92080cc8b0 0x7f9208143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f920d000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92080ce8f0 0x7f920806b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f920d000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9208145250 0x7f920813ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f920d000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920806d380 con 0x7f9208145250 2024-04-25T09:04:13.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f920d000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920806ef80 con 0x7f92080ce8f0 2024-04-25T09:04:13.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f920d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920806d500 con 0x7f92080cc8b0 2024-04-25T09:04:13.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f9206800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9208145250 0x7f920813ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f9206800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9208145250 0x7f920813ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33052/0 (socket says 172.21.15.173:33052) 2024-04-25T09:04:13.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f9206800640 1 -- 172.21.15.173:0/682692605 learned_addr learned my addr 172.21.15.173:0/682692605 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:13.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f9205e00640 1 --2- 172.21.15.173:0/682692605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92080cc8b0 0x7f9208143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f9205400640 1 --2- 172.21.15.173:0/682692605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92080ce8f0 0x7f920806b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f9206800640 1 -- 172.21.15.173:0/682692605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92080cc8b0 msgr2=0x7f9208143b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f9206800640 1 --2- 172.21.15.173:0/682692605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92080cc8b0 0x7f9208143b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f9206800640 1 -- 172.21.15.173:0/682692605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92080ce8f0 msgr2=0x7f920806b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f9206800640 1 --2- 172.21.15.173:0/682692605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92080ce8f0 0x7f920806b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.341+0000 7f9206800640 1 -- 172.21.15.173:0/682692605 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92080b4390 con 0x7f9208145250 2024-04-25T09:04:13.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.345+0000 7f9206800640 1 --2- 172.21.15.173:0/682692605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9208145250 0x7f920813ee90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9200007e40 tx=0x7f920000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.345+0000 7f91fe000640 1 -- 172.21.15.173:0/682692605 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9200014620 con 0x7f9208145250 2024-04-25T09:04:13.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.345+0000 7f91fe000640 1 -- 172.21.15.173:0/682692605 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9200019070 con 0x7f9208145250 2024-04-25T09:04:13.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.345+0000 7f91fe000640 1 -- 172.21.15.173:0/682692605 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9200014a20 con 0x7f9208145250 2024-04-25T09:04:13.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.345+0000 7f920d000640 1 -- 172.21.15.173:0/682692605 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92080b35d0 con 0x7f9208145250 2024-04-25T09:04:13.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.345+0000 7f920d000640 1 -- 172.21.15.173:0/682692605 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92080b3b90 con 0x7f9208145250 2024-04-25T09:04:13.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.345+0000 7f920d000640 1 -- 172.21.15.173:0/682692605 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9208073a40 con 0x7f9208145250 2024-04-25T09:04:13.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.345+0000 7f91fe000640 1 -- 172.21.15.173:0/682692605 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9200014bc0 con 0x7f9208145250 2024-04-25T09:04:13.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.345+0000 7f91fe000640 1 --2- 172.21.15.173:0/682692605 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f91e4066f60 0x7f91e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.345+0000 7f91fe000640 1 -- 172.21.15.173:0/682692605 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9200085b40 con 0x7f9208145250 2024-04-25T09:04:13.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.345+0000 7f9205e00640 1 --2- 172.21.15.173:0/682692605 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f91e4066f60 0x7f91e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.349+0000 7f9205e00640 1 --2- 172.21.15.173:0/682692605 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f91e4066f60 0x7f91e4069420 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f91f0000f70 tx=0x7f91f0007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.349+0000 7f91fe000640 1 -- 172.21.15.173:0/682692605 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9200056920 con 0x7f9208145250 2024-04-25T09:04:13.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.533+0000 7f920d000640 1 -- 172.21.15.173:0/682692605 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9208144810 con 0x7f9208145250 2024-04-25T09:04:13.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.537+0000 7f91fe000640 1 -- 172.21.15.173:0/682692605 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f9200056220 con 0x7f9208145250 2024-04-25T09:04:13.526 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:04:13.526 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2065115729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2065115729},{"type":"v1","addr":"172.21.15.194:6834","nonce":2065115729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4121705012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4121705012},{"type":"v1","addr":"172.21.15.194:6835","nonce":4121705012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3839820980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3839820980},{"type":"v1","addr":"172.21.15.173:6836","nonce":3839820980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:03.205878+0000","modified":"2024-04-25T09:04:06.217297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/960880761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":960880761},{"type":"v1","addr":"172.21.15.173:6837","nonce":960880761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:04:13.526 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 18 2024-04-25T09:04:13.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.537+0000 7f920d000640 1 -- 172.21.15.173:0/682692605 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f91e4066f60 msgr2=0x7f91e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.537+0000 7f920d000640 1 --2- 172.21.15.173:0/682692605 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f91e4066f60 0x7f91e4069420 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f91f0000f70 tx=0x7f91f0007b60 comp rx=0 tx=0).stop 2024-04-25T09:04:13.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.537+0000 7f920d000640 1 -- 172.21.15.173:0/682692605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9208145250 msgr2=0x7f920813ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.537+0000 7f920d000640 1 --2- 172.21.15.173:0/682692605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9208145250 0x7f920813ee90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9200007e40 tx=0x7f920000e4b0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.537+0000 7f920d000640 1 -- 172.21.15.173:0/682692605 shutdown_connections 2024-04-25T09:04:13.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.537+0000 7f920d000640 1 --2- 172.21.15.173:0/682692605 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f91e4066f60 0x7f91e4069420 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.537+0000 7f920d000640 1 --2- 172.21.15.173:0/682692605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9208145250 0x7f920813ee90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.537+0000 7f920d000640 1 --2- 172.21.15.173:0/682692605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92080ce8f0 0x7f920806b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.537+0000 7f920d000640 1 --2- 172.21.15.173:0/682692605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92080cc8b0 0x7f9208143b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.537+0000 7f920d000640 1 -- 172.21.15.173:0/682692605 >> 172.21.15.173:0/682692605 conn(0x7f920806ac90 msgr2=0x7f920815bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.537+0000 7f920d000640 1 -- 172.21.15.173:0/682692605 shutdown_connections 2024-04-25T09:04:13.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:13.537+0000 7f920d000640 1 -- 172.21.15.173:0/682692605 wait complete. 2024-04-25T09:04:13.950 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:04:03.205878+0000', 'modified': '2024-04-25T09:04:06.217297+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5346}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5346': {'gid': 5346, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.173:6837/960880761', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6834', 'nonce': 960880761}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 960880761}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:04:13.950 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:04:13.950 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:04:14.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.097+0000 7f3687000640 1 Processor -- start 2024-04-25T09:04:14.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.097+0000 7f3687000640 1 -- start start 2024-04-25T09:04:14.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.097+0000 7f3687000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f368015b710 0x7f3680071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.097+0000 7f3687000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36800cd3d0 0x7f36800cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.097+0000 7f3687000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36800ccaa0 con 0x7f36800cc670 2024-04-25T09:04:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.097+0000 7f3687000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368015eea0 con 0x7f368015b710 2024-04-25T09:04:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.097+0000 7f3687000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368015e2d0 con 0x7f36800cd3d0 2024-04-25T09:04:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.097+0000 7f367fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f368015b710 0x7f3680071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.097+0000 7f3685000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f36800cc670 0x7f368006d380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:55928/0 (socket says 172.21.15.173:55928) 2024-04-25T09:04:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.097+0000 7f3685000640 1 -- 172.21.15.173:0/4279433729 learned_addr learned my addr 172.21.15.173:0/4279433729 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:04:14.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.097+0000 7f3677400640 1 --2- 172.21.15.173:0/4279433729 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36800cd3d0 0x7f36800cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.097+0000 7f367fe00640 1 -- 172.21.15.173:0/4279433729 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36800cd3d0 msgr2=0x7f36800cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.097+0000 7f367fe00640 1 --2- 172.21.15.173:0/4279433729 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36800cd3d0 0x7f36800cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.097+0000 7f367fe00640 1 -- 172.21.15.173:0/4279433729 >> v1:172.21.15.173:6789/0 conn(0x7f36800cc670 legacy=0x7f368006d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.097+0000 7f367fe00640 1 -- 172.21.15.173:0/4279433729 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368015e570 con 0x7f368015b710 2024-04-25T09:04:14.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.101+0000 7f367fe00640 1 --2- 172.21.15.173:0/4279433729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f368015b710 0x7f3680071e80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f36700097c0 tx=0x7f367001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c31cf28a36a489d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.101+0000 7f367f400640 1 -- 172.21.15.173:0/4279433729 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36700b2070 con 0x7f368015b710 2024-04-25T09:04:14.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.101+0000 7f367f400640 1 -- 172.21.15.173:0/4279433729 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36700ad680 con 0x7f368015b710 2024-04-25T09:04:14.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.101+0000 7f367f400640 1 -- 172.21.15.173:0/4279433729 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36700ada50 con 0x7f368015b710 2024-04-25T09:04:14.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.101+0000 7f3687000640 1 -- 172.21.15.173:0/4279433729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f368015b710 msgr2=0x7f3680071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.101+0000 7f3687000640 1 --2- 172.21.15.173:0/4279433729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f368015b710 0x7f3680071e80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f36700097c0 tx=0x7f367001c470 comp rx=0 tx=0).stop 2024-04-25T09:04:14.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.101+0000 7f3687000640 1 -- 172.21.15.173:0/4279433729 shutdown_connections 2024-04-25T09:04:14.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.101+0000 7f3687000640 1 --2- 172.21.15.173:0/4279433729 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36800cd3d0 0x7f36800cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.101+0000 7f3687000640 1 --2- 172.21.15.173:0/4279433729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f368015b710 0x7f3680071e80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.101+0000 7f3687000640 1 -- 172.21.15.173:0/4279433729 >> 172.21.15.173:0/4279433729 conn(0x7f368006ac90 msgr2=0x7f368006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.101+0000 7f3687000640 1 -- 172.21.15.173:0/4279433729 shutdown_connections 2024-04-25T09:04:14.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.101+0000 7f3687000640 1 -- 172.21.15.173:0/4279433729 wait complete. 2024-04-25T09:04:14.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3687000640 1 Processor -- start 2024-04-25T09:04:14.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3687000640 1 -- start start 2024-04-25T09:04:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3687000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36800cc670 0x7f3680151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3687000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36800cd3d0 0x7f3680152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3687000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f368015b710 0x7f3680159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3687000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3680072540 con 0x7f368015b710 2024-04-25T09:04:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3687000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36800723c0 con 0x7f36800cd3d0 2024-04-25T09:04:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3687000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368016a800 con 0x7f36800cc670 2024-04-25T09:04:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3685000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f368015b710 0x7f3680159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3685000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f368015b710 0x7f3680159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33070/0 (socket says 172.21.15.173:33070) 2024-04-25T09:04:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3685000640 1 -- 172.21.15.173:0/2843483656 learned_addr learned my addr 172.21.15.173:0/2843483656 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f367fe00640 1 --2- 172.21.15.173:0/2843483656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36800cc670 0x7f3680151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3677400640 1 --2- 172.21.15.173:0/2843483656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36800cd3d0 0x7f3680152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3685000640 1 -- 172.21.15.173:0/2843483656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36800cc670 msgr2=0x7f3680151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3685000640 1 --2- 172.21.15.173:0/2843483656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36800cc670 0x7f3680151f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3685000640 1 -- 172.21.15.173:0/2843483656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36800cd3d0 msgr2=0x7f3680152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3685000640 1 --2- 172.21.15.173:0/2843483656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36800cd3d0 0x7f3680152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3685000640 1 -- 172.21.15.173:0/2843483656 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36801532b0 con 0x7f368015b710 2024-04-25T09:04:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3677400640 1 --2- 172.21.15.173:0/2843483656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36800cd3d0 0x7f3680152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3685000640 1 --2- 172.21.15.173:0/2843483656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f368015b710 0x7f3680159730 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f367800cbc0 tx=0x7f367800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f367cc00640 1 -- 172.21.15.173:0/2843483656 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3678017070 con 0x7f368015b710 2024-04-25T09:04:14.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f367cc00640 1 -- 172.21.15.173:0/2843483656 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367800ad40 con 0x7f368015b710 2024-04-25T09:04:14.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3687000640 1 -- 172.21.15.173:0/2843483656 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3680151430 con 0x7f368015b710 2024-04-25T09:04:14.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f367cc00640 1 -- 172.21.15.173:0/2843483656 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3678012600 con 0x7f368015b710 2024-04-25T09:04:14.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.105+0000 7f3687000640 1 -- 172.21.15.173:0/2843483656 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36801519f0 con 0x7f368015b710 2024-04-25T09:04:14.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f367cc00640 1 -- 172.21.15.173:0/2843483656 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f367801a070 con 0x7f368015b710 2024-04-25T09:04:14.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f367cc00640 1 --2- 172.21.15.173:0/2843483656 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f365c066f60 0x7f365c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f367cc00640 1 -- 172.21.15.173:0/2843483656 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3678084ef0 con 0x7f368015b710 2024-04-25T09:04:14.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f367fe00640 1 --2- 172.21.15.173:0/2843483656 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f365c066f60 0x7f365c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f368a527000 1 Processor -- start 2024-04-25T09:04:14.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f368a527000 1 -- start start 2024-04-25T09:04:14.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f367fe00640 1 --2- 172.21.15.173:0/2843483656 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f365c066f60 0x7f365c069420 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f36700af000 tx=0x7f36700a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f368a527000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f1bf920 0x56124f1bfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f368a527000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1c0240 0x56124f1759f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f368a527000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f175f30 0x56124f176310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f368a527000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56124f05d5f0 con 0x56124f1c0240 2024-04-25T09:04:14.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f368a527000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56124efc4da0 con 0x56124f1bf920 2024-04-25T09:04:14.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f368a527000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56124ef4d150 con 0x56124f175f30 2024-04-25T09:04:14.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f3677400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1c0240 0x56124f1759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f3677400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1c0240 0x56124f1759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33076/0 (socket says 172.21.15.173:33076) 2024-04-25T09:04:14.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f3677400640 1 -- 172.21.15.173:0/144476654 learned_addr learned my addr 172.21.15.173:0/144476654 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:14.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f3685000640 1 --2- 172.21.15.173:0/144476654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f175f30 0x56124f176310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f367fe00640 1 --2- 172.21.15.173:0/144476654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f1bf920 0x56124f1bfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f3677400640 1 -- 172.21.15.173:0/144476654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f175f30 msgr2=0x56124f176310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f3677400640 1 --2- 172.21.15.173:0/144476654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f175f30 0x56124f176310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f3677400640 1 -- 172.21.15.173:0/144476654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f1bf920 msgr2=0x56124f1bfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f3677400640 1 --2- 172.21.15.173:0/144476654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f1bf920 0x56124f1bfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f3677400640 1 -- 172.21.15.173:0/144476654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56124ef66ca0 con 0x56124f1c0240 2024-04-25T09:04:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.109+0000 7f3685000640 1 --2- 172.21.15.173:0/144476654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f175f30 0x56124f176310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f3677400640 1 --2- 172.21.15.173:0/144476654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1c0240 0x56124f1759f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3668007960 tx=0x7f3668007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61910462692b16a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f3674c00640 1 -- 172.21.15.173:0/144476654 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668018020 con 0x56124f1c0240 2024-04-25T09:04:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f3674c00640 1 -- 172.21.15.173:0/144476654 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366800fa80 con 0x56124f1c0240 2024-04-25T09:04:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f3674c00640 1 -- 172.21.15.173:0/144476654 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366800fe50 con 0x56124f1c0240 2024-04-25T09:04:14.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f368a527000 1 -- 172.21.15.173:0/144476654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1c0240 msgr2=0x56124f1759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f368a527000 1 --2- 172.21.15.173:0/144476654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1c0240 0x56124f1759f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3668007960 tx=0x7f3668007e20 comp rx=0 tx=0).stop 2024-04-25T09:04:14.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f368a527000 1 -- 172.21.15.173:0/144476654 shutdown_connections 2024-04-25T09:04:14.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f368a527000 1 --2- 172.21.15.173:0/144476654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f175f30 0x56124f176310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f368a527000 1 --2- 172.21.15.173:0/144476654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1c0240 0x56124f1759f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f368a527000 1 --2- 172.21.15.173:0/144476654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f1bf920 0x56124f1bfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f368a527000 1 -- 172.21.15.173:0/144476654 >> 172.21.15.173:0/144476654 conn(0x56124f17c2a0 msgr2=0x56124f1742d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f368a527000 1 -- 172.21.15.173:0/144476654 shutdown_connections 2024-04-25T09:04:14.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f368a527000 1 -- 172.21.15.173:0/144476654 wait complete. 2024-04-25T09:04:14.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f368a527000 1 -- start start 2024-04-25T09:04:14.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f368a527000 1 Processor -- start 2024-04-25T09:04:14.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f368a527000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f175f30 0x56124f1c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f368a527000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1bf920 0x56124f1c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f368a527000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f1c0240 0x56124f179aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f368a527000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56124ef7f990 con 0x56124f1bf920 2024-04-25T09:04:14.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f368a527000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56124efc0e40 con 0x56124f1c0240 2024-04-25T09:04:14.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f368a527000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56124ef50900 con 0x56124f175f30 2024-04-25T09:04:14.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f368a527000 10 client.0 _ll_register_callbacks cb 0x56124f0781c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:14.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f3677400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1bf920 0x56124f1c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f3677400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1bf920 0x56124f1c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33088/0 (socket says 172.21.15.173:33088) 2024-04-25T09:04:14.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f3677400640 1 -- 172.21.15.173:0/2768893670 learned_addr learned my addr 172.21.15.173:0/2768893670 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:14.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f367fe00640 1 --2- 172.21.15.173:0/2768893670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f175f30 0x56124f1c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f3685000640 1 --2- 172.21.15.173:0/2768893670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f1c0240 0x56124f179aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f3677400640 1 -- 172.21.15.173:0/2768893670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f175f30 msgr2=0x56124f1c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f3677400640 1 --2- 172.21.15.173:0/2768893670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f175f30 0x56124f1c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f3677400640 1 -- 172.21.15.173:0/2768893670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f1c0240 msgr2=0x56124f179aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f3677400640 1 --2- 172.21.15.173:0/2768893670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f1c0240 0x56124f179aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f3677400640 1 -- 172.21.15.173:0/2768893670 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56124ef7d630 con 0x56124f1bf920 2024-04-25T09:04:14.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f3677400640 1 --2- 172.21.15.173:0/2768893670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1bf920 0x56124f1c71c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3668017040 tx=0x7f3668004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc3bb6197791ba1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.113+0000 7f366d600640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:04:14.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f366d600640 1 -- 172.21.15.173:0/2768893670 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366802b060 con 0x56124f1bf920 2024-04-25T09:04:14.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f366d600640 1 -- 172.21.15.173:0/2768893670 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f366800f880 con 0x56124f1bf920 2024-04-25T09:04:14.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 1 -- 172.21.15.173:0/2768893670 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f366800fa80 con 0x56124f1bf920 2024-04-25T09:04:14.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f366d600640 1 -- 172.21.15.173:0/2768893670 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3668031050 con 0x56124f1bf920 2024-04-25T09:04:14.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 10 client.5550 fetch_fsmap learned FSMap version 18 2024-04-25T09:04:14.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 1 -- 172.21.15.173:0/2768893670 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x56124ef4d3a0 con 0x56124f1bf920 2024-04-25T09:04:14.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f366d600640 1 -- 172.21.15.173:0/2768893670 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366800fa80 con 0x56124f1bf920 2024-04-25T09:04:14.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f366d600640 1 -- 172.21.15.173:0/2768893670 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3668025070 con 0x56124f1bf920 2024-04-25T09:04:14.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 10 client.5550 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T09:04:14.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 10 client.5550 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:04:14.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 20 client.5550 populate_metadata read hostname 'smithi173' 2024-04-25T09:04:14.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 1 --2- 172.21.15.173:0/2768893670 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x56124f17b160 0x56124f1d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 4 client.5550 mds_command: new command op to 5346 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:04:14.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 1 -- 172.21.15.173:0/2768893670 --> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56124ef60a50 con 0x56124f17b160 2024-04-25T09:04:14.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f367fe00640 1 --2- 172.21.15.173:0/2768893670 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x56124f17b160 0x56124f1d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f367fe00640 1 --2- 172.21.15.173:0/2768893670 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x56124f17b160 0x56124f1d0ce0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddc3bfb345b1b85a server_cookie=a8d1d950aedfbd20 in_seq=0 out_seq=0 2024-04-25T09:04:14.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f366d600640 10 client.5550 ms_handle_connect on v2:172.21.15.173:6834/960880761 2024-04-25T09:04:14.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f366d600640 1 -- 172.21.15.173:0/2768893670 <== mds.0 v2:172.21.15.173:6834/960880761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56124ef60a50 con 0x56124f17b160 2024-04-25T09:04:14.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f366d600640 10 client.5550 handle_command_reply: tid=0 2024-04-25T09:04:14.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 1 client.5550 shutdown 2024-04-25T09:04:14.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 1 -- 172.21.15.173:0/2768893670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1bf920 msgr2=0x56124f1c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 1 --2- 172.21.15.173:0/2768893670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1bf920 0x56124f1c71c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3668017040 tx=0x7f3668004740 comp rx=0 tx=0).stop 2024-04-25T09:04:14.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 1 -- 172.21.15.173:0/2768893670 shutdown_connections 2024-04-25T09:04:14.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 1 --2- 172.21.15.173:0/2768893670 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x56124f17b160 0x56124f1d0ce0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 1 --2- 172.21.15.173:0/2768893670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f1c0240 0x56124f179aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 1 --2- 172.21.15.173:0/2768893670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1bf920 0x56124f1c71c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 1 --2- 172.21.15.173:0/2768893670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f175f30 0x56124f1c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f366d600640 0 client.5550 ms_handle_reset on v2:172.21.15.173:6834/960880761 2024-04-25T09:04:14.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 1 -- 172.21.15.173:0/2768893670 >> 172.21.15.173:0/2768893670 conn(0x56124f17c2a0 msgr2=0x56124f1749e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 1 -- 172.21.15.173:0/2768893670 shutdown_connections 2024-04-25T09:04:14.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 1 -- 172.21.15.173:0/2768893670 wait complete. 2024-04-25T09:04:14.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.117+0000 7f368a527000 20 client.5550 trim_cache size 0 max 16384 2024-04-25T09:04:14.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f368a527000 1 Processor -- start 2024-04-25T09:04:14.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f368a527000 1 -- start start 2024-04-25T09:04:14.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f368a527000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f17c2a0 0x56124f2239a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f368a527000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f175f30 0x56124f223ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f368a527000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f1bf920 0x56124f224420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f368a527000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3680202840 con 0x56124f175f30 2024-04-25T09:04:14.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f368a527000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3680155070 con 0x56124f1bf920 2024-04-25T09:04:14.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f368a527000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3680202390 con 0x56124f17c2a0 2024-04-25T09:04:14.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f3677400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f175f30 0x56124f223ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f3677400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f175f30 0x56124f223ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33098/0 (socket says 172.21.15.173:33098) 2024-04-25T09:04:14.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f3677400640 1 -- 172.21.15.173:0/285459342 learned_addr learned my addr 172.21.15.173:0/285459342 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:14.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f3685000640 1 --2- 172.21.15.173:0/285459342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f1bf920 0x56124f224420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f367fe00640 1 --2- 172.21.15.173:0/285459342 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f17c2a0 0x56124f2239a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f3677400640 1 -- 172.21.15.173:0/285459342 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f17c2a0 msgr2=0x56124f2239a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f3677400640 1 --2- 172.21.15.173:0/285459342 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f17c2a0 0x56124f2239a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f3677400640 1 -- 172.21.15.173:0/285459342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f1bf920 msgr2=0x56124f224420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f3677400640 1 --2- 172.21.15.173:0/285459342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f1bf920 0x56124f224420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f3677400640 1 -- 172.21.15.173:0/285459342 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56124f1c0070 con 0x56124f175f30 2024-04-25T09:04:14.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.133+0000 7f3677400640 1 --2- 172.21.15.173:0/285459342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f175f30 0x56124f223ee0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3668007960 tx=0x7f3668022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd2a40a5ed79969 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f366fe00640 1 -- 172.21.15.173:0/285459342 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668018040 con 0x56124f175f30 2024-04-25T09:04:14.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f366fe00640 1 -- 172.21.15.173:0/285459342 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3668000e50 con 0x56124f175f30 2024-04-25T09:04:14.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f366fe00640 1 -- 172.21.15.173:0/285459342 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668004030 con 0x56124f175f30 2024-04-25T09:04:14.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 -- 172.21.15.173:0/285459342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f175f30 msgr2=0x56124f223ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 --2- 172.21.15.173:0/285459342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f175f30 0x56124f223ee0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3668007960 tx=0x7f3668022000 comp rx=0 tx=0).stop 2024-04-25T09:04:14.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 -- 172.21.15.173:0/285459342 shutdown_connections 2024-04-25T09:04:14.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 --2- 172.21.15.173:0/285459342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f1bf920 0x56124f224420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 --2- 172.21.15.173:0/285459342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f175f30 0x56124f223ee0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 --2- 172.21.15.173:0/285459342 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f17c2a0 0x56124f2239a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 -- 172.21.15.173:0/285459342 >> 172.21.15.173:0/285459342 conn(0x56124f179510 msgr2=0x56124f1be0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 -- 172.21.15.173:0/285459342 shutdown_connections 2024-04-25T09:04:14.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 -- 172.21.15.173:0/285459342 wait complete. 2024-04-25T09:04:14.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 -- start start 2024-04-25T09:04:14.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 Processor -- start 2024-04-25T09:04:14.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f175f30 0x56124f1d5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f17c2a0 0x56124f20bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1bf920 0x56124f20c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56124efc93d0 con 0x56124f1bf920 2024-04-25T09:04:14.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56124f080d50 con 0x56124f17c2a0 2024-04-25T09:04:14.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56124ef5f980 con 0x56124f175f30 2024-04-25T09:04:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 10 client.0 _ll_register_callbacks cb 0x7f3668007380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f3685000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1bf920 0x56124f20c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f3685000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1bf920 0x56124f20c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33110/0 (socket says 172.21.15.173:33110) 2024-04-25T09:04:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f3685000640 1 -- 172.21.15.173:0/2072968405 learned_addr learned my addr 172.21.15.173:0/2072968405 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f367fe00640 1 --2- 172.21.15.173:0/2072968405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f175f30 0x56124f1d5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f3677400640 1 --2- 172.21.15.173:0/2072968405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f17c2a0 0x56124f20bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f3685000640 1 -- 172.21.15.173:0/2072968405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f175f30 msgr2=0x56124f1d5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f3685000640 1 --2- 172.21.15.173:0/2072968405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f175f30 0x56124f1d5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f3685000640 1 -- 172.21.15.173:0/2072968405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f17c2a0 msgr2=0x56124f20bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f3685000640 1 --2- 172.21.15.173:0/2072968405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f17c2a0 0x56124f20bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f3685000640 1 -- 172.21.15.173:0/2072968405 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56124f046600 con 0x56124f1bf920 2024-04-25T09:04:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f3685000640 1 --2- 172.21.15.173:0/2072968405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1bf920 0x56124f20c2a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3678055610 tx=0x7f36780597e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91d27444d88e6e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f366d600640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:04:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f366d600640 1 -- 172.21.15.173:0/2072968405 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367805da50 con 0x56124f1bf920 2024-04-25T09:04:14.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f366d600640 1 -- 172.21.15.173:0/2072968405 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3678004b70 con 0x56124f1bf920 2024-04-25T09:04:14.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 -- 172.21.15.173:0/2072968405 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3668000e50 con 0x56124f1bf920 2024-04-25T09:04:14.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f366d600640 1 -- 172.21.15.173:0/2072968405 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3678004d90 con 0x56124f1bf920 2024-04-25T09:04:14.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 10 client.5556 fetch_fsmap learned FSMap version 18 2024-04-25T09:04:14.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.137+0000 7f368a527000 1 -- 172.21.15.173:0/2072968405 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x56124ef599b0 con 0x56124f1bf920 2024-04-25T09:04:14.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f366d600640 1 -- 172.21.15.173:0/2072968405 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3668000e50 con 0x56124f1bf920 2024-04-25T09:04:14.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f366d600640 1 -- 172.21.15.173:0/2072968405 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f367807cb50 con 0x56124f1bf920 2024-04-25T09:04:14.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f368a527000 10 client.5556 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T09:04:14.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f368a527000 10 client.5556 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:04:14.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f368a527000 20 client.5556 populate_metadata read hostname 'smithi173' 2024-04-25T09:04:14.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f368a527000 1 --2- 172.21.15.173:0/2072968405 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x56124f1c0240 0x56124f20cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f368a527000 4 client.5556 mds_command: new command op to 5346 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:04:14.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f368a527000 1 -- 172.21.15.173:0/2072968405 --> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56124efd22e0 con 0x56124f1c0240 2024-04-25T09:04:14.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f367fe00640 1 --2- 172.21.15.173:0/2072968405 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x56124f1c0240 0x56124f20cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f367fe00640 1 --2- 172.21.15.173:0/2072968405 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x56124f1c0240 0x56124f20cbd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b8c8be122369aa9 server_cookie=22dd219cbc1f73cc in_seq=0 out_seq=0 2024-04-25T09:04:14.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f366d600640 10 client.5556 ms_handle_connect on v2:172.21.15.173:6834/960880761 2024-04-25T09:04:14.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f366d600640 1 -- 172.21.15.173:0/2072968405 <== mds.0 v2:172.21.15.173:6834/960880761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x56124efd22e0 con 0x56124f1c0240 2024-04-25T09:04:14.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f366d600640 10 client.5556 handle_command_reply: tid=0 2024-04-25T09:04:14.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f368a527000 1 client.5556 shutdown 2024-04-25T09:04:14.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f368a527000 1 -- 172.21.15.173:0/2072968405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1bf920 msgr2=0x56124f20c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f368a527000 1 --2- 172.21.15.173:0/2072968405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1bf920 0x56124f20c2a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3678055610 tx=0x7f36780597e0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f368a527000 1 -- 172.21.15.173:0/2072968405 shutdown_connections 2024-04-25T09:04:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f368a527000 1 --2- 172.21.15.173:0/2072968405 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x56124f1c0240 0x56124f20cbd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f368a527000 1 --2- 172.21.15.173:0/2072968405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56124f1bf920 0x56124f20c2a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f368a527000 1 --2- 172.21.15.173:0/2072968405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56124f17c2a0 0x56124f20bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f368a527000 1 --2- 172.21.15.173:0/2072968405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56124f175f30 0x56124f1d5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f366d600640 0 client.5556 ms_handle_reset on v2:172.21.15.173:6834/960880761 2024-04-25T09:04:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f368a527000 1 -- 172.21.15.173:0/2072968405 >> 172.21.15.173:0/2072968405 conn(0x56124f179510 msgr2=0x56124f1be7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f368a527000 1 -- 172.21.15.173:0/2072968405 shutdown_connections 2024-04-25T09:04:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f368a527000 1 -- 172.21.15.173:0/2072968405 wait complete. 2024-04-25T09:04:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f368a527000 20 client.5556 trim_cache size 0 max 16384 2024-04-25T09:04:14.136 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:04:14.136 INFO:teuthology.orchestra.run.smithi173.stdout: "cluster_fsid": "ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6", 2024-04-25T09:04:14.136 INFO:teuthology.orchestra.run.smithi173.stdout: "whoami": 0, 2024-04-25T09:04:14.136 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 5346, 2024-04-25T09:04:14.136 INFO:teuthology.orchestra.run.smithi173.stdout: "want_state": "up:active", 2024-04-25T09:04:14.136 INFO:teuthology.orchestra.run.smithi173.stdout: "state": "up:active", 2024-04-25T09:04:14.136 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs", 2024-04-25T09:04:14.136 INFO:teuthology.orchestra.run.smithi173.stdout: "rank_uptime": 10.318890004, 2024-04-25T09:04:14.136 INFO:teuthology.orchestra.run.smithi173.stdout: "mdsmap_epoch": 18, 2024-04-25T09:04:14.136 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch": 40, 2024-04-25T09:04:14.137 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch_barrier": 40, 2024-04-25T09:04:14.137 INFO:teuthology.orchestra.run.smithi173.stdout: "uptime": 18.173573546 2024-04-25T09:04:14.137 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:04:14.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f3687000640 1 -- 172.21.15.173:0/2843483656 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f365c066f60 msgr2=0x7f365c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f3687000640 1 --2- 172.21.15.173:0/2843483656 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f365c066f60 0x7f365c069420 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f36700af000 tx=0x7f36700a7000 comp rx=0 tx=0).stop 2024-04-25T09:04:14.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f3687000640 1 -- 172.21.15.173:0/2843483656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f368015b710 msgr2=0x7f3680159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f3687000640 1 --2- 172.21.15.173:0/2843483656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f368015b710 0x7f3680159730 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f367800cbc0 tx=0x7f367800a430 comp rx=0 tx=0).stop 2024-04-25T09:04:14.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f3687000640 1 -- 172.21.15.173:0/2843483656 shutdown_connections 2024-04-25T09:04:14.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f3687000640 1 --2- 172.21.15.173:0/2843483656 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f365c066f60 0x7f365c069420 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f3687000640 1 --2- 172.21.15.173:0/2843483656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f368015b710 0x7f3680159730 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f3687000640 1 --2- 172.21.15.173:0/2843483656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36800cd3d0 0x7f3680152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f3687000640 1 --2- 172.21.15.173:0/2843483656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36800cc670 0x7f3680151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f3687000640 1 -- 172.21.15.173:0/2843483656 >> 172.21.15.173:0/2843483656 conn(0x7f368006ac90 msgr2=0x7f368015f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f3687000640 1 -- 172.21.15.173:0/2843483656 shutdown_connections 2024-04-25T09:04:14.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.141+0000 7f3687000640 1 -- 172.21.15.173:0/2843483656 wait complete. 2024-04-25T09:04:14.150 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:04:14.265 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:14.268 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:14.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.293+0000 7f5b9ba00640 1 Processor -- start 2024-04-25T09:04:14.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.293+0000 7f5b9ba00640 1 -- start start 2024-04-25T09:04:14.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.297+0000 7f5b9ba00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5b940ce300 0x7f5b9415c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.297+0000 7f5b9ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b9406d810 0x7f5b9406dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.297+0000 7f5b9ba00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b940af330 con 0x7f5b940aef50 2024-04-25T09:04:14.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.297+0000 7f5b9ba00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b94152d40 con 0x7f5b940ce300 2024-04-25T09:04:14.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.297+0000 7f5b9ba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b940cc750 con 0x7f5b9406d810 2024-04-25T09:04:14.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.297+0000 7f5b99a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b9406d810 0x7f5b9406dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.297+0000 7f5b99000640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f5b940aef50 0x7f5b940cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:56552/0 (socket says 172.21.15.173:56552) 2024-04-25T09:04:14.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.297+0000 7f5b99000640 1 -- 172.21.15.173:0/1636251125 learned_addr learned my addr 172.21.15.173:0/1636251125 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:04:14.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.297+0000 7f5b93e00640 1 --2- 172.21.15.173:0/1636251125 >> v2:172.21.15.194:3300/0 conn(0x7f5b940ce300 0x7f5b9415c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.297+0000 7f5b93400640 1 -- 172.21.15.173:0/1636251125 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130040904 0 0) 0x7f5b88001120 con 0x7f5b940aef50 2024-04-25T09:04:14.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.297+0000 7f5b99a00640 1 -- 172.21.15.173:0/1636251125 >> v2:172.21.15.194:3300/0 conn(0x7f5b940ce300 msgr2=0x7f5b9415c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.297+0000 7f5b99a00640 1 --2- 172.21.15.173:0/1636251125 >> v2:172.21.15.194:3300/0 conn(0x7f5b940ce300 0x7f5b9415c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.297+0000 7f5b99a00640 1 -- 172.21.15.173:0/1636251125 >> v1:172.21.15.194:6789/0 conn(0x7f5b940aef50 legacy=0x7f5b940cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.297+0000 7f5b99a00640 1 -- 172.21.15.173:0/1636251125 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b940cca30 con 0x7f5b9406d810 2024-04-25T09:04:14.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.297+0000 7f5b93e00640 1 --2- 172.21.15.173:0/1636251125 >> v2:172.21.15.194:3300/0 conn(0x7f5b940ce300 0x7f5b9415c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:14.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.301+0000 7f5b99a00640 1 --2- 172.21.15.173:0/1636251125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b9406d810 0x7f5b9406dca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009d90 tx=0x7f5b8c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23a01c473ac1295d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.301+0000 7f5b93400640 1 -- 172.21.15.173:0/1636251125 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c0b2070 con 0x7f5b9406d810 2024-04-25T09:04:14.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.301+0000 7f5b93400640 1 -- 172.21.15.173:0/1636251125 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c0a5940 con 0x7f5b9406d810 2024-04-25T09:04:14.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.301+0000 7f5b93400640 1 -- 172.21.15.173:0/1636251125 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c0a5d10 con 0x7f5b9406d810 2024-04-25T09:04:14.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.301+0000 7f5b9ba00640 1 -- 172.21.15.173:0/1636251125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b9406d810 msgr2=0x7f5b9406dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.301+0000 7f5b9ba00640 1 --2- 172.21.15.173:0/1636251125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b9406d810 0x7f5b9406dca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009d90 tx=0x7f5b8c01c970 comp rx=0 tx=0).stop 2024-04-25T09:04:14.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.301+0000 7f5b9ba00640 1 -- 172.21.15.173:0/1636251125 shutdown_connections 2024-04-25T09:04:14.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.301+0000 7f5b9ba00640 1 --2- 172.21.15.173:0/1636251125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b9406d810 0x7f5b9406dca0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.301+0000 7f5b9ba00640 1 --2- 172.21.15.173:0/1636251125 >> v2:172.21.15.194:3300/0 conn(0x7f5b940ce300 0x7f5b9415c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.301+0000 7f5b9ba00640 1 -- 172.21.15.173:0/1636251125 >> 172.21.15.173:0/1636251125 conn(0x7f5b9406ac90 msgr2=0x7f5b9406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.301+0000 7f5b9ba00640 1 -- 172.21.15.173:0/1636251125 shutdown_connections 2024-04-25T09:04:14.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.301+0000 7f5b9ba00640 1 -- 172.21.15.173:0/1636251125 wait complete. 2024-04-25T09:04:14.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.301+0000 7f5b9ba00640 1 Processor -- start 2024-04-25T09:04:14.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b9ba00640 1 -- start start 2024-04-25T09:04:14.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b9ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b9406d810 0x7f5b940b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b9ba00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b940aef50 0x7f5b941559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b9ba00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b940ce300 0x7f5b9415a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b9ba00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9406baa0 con 0x7f5b940ce300 2024-04-25T09:04:14.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b9ba00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9406b920 con 0x7f5b940aef50 2024-04-25T09:04:14.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b9ba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9406e5f0 con 0x7f5b9406d810 2024-04-25T09:04:14.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b99a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b940ce300 0x7f5b9415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b99a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b940ce300 0x7f5b9415a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33116/0 (socket says 172.21.15.173:33116) 2024-04-25T09:04:14.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b99a00640 1 -- 172.21.15.173:0/4169462704 learned_addr learned my addr 172.21.15.173:0/4169462704 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:14.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b99000640 1 --2- 172.21.15.173:0/4169462704 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b9406d810 0x7f5b940b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b93e00640 1 --2- 172.21.15.173:0/4169462704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b940aef50 0x7f5b941559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b99a00640 1 -- 172.21.15.173:0/4169462704 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b9406d810 msgr2=0x7f5b940b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b99a00640 1 --2- 172.21.15.173:0/4169462704 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b9406d810 0x7f5b940b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b99a00640 1 -- 172.21.15.173:0/4169462704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b940aef50 msgr2=0x7f5b941559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b99a00640 1 --2- 172.21.15.173:0/4169462704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b940aef50 0x7f5b941559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b99a00640 1 -- 172.21.15.173:0/4169462704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b940b40e0 con 0x7f5b940ce300 2024-04-25T09:04:14.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b99a00640 1 --2- 172.21.15.173:0/4169462704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b940ce300 0x7f5b9415a890 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c01a5a0 tx=0x7f5b8c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b90c00640 1 -- 172.21.15.173:0/4169462704 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c0b2040 con 0x7f5b940ce300 2024-04-25T09:04:14.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b90c00640 1 -- 172.21.15.173:0/4169462704 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c0bd070 con 0x7f5b940ce300 2024-04-25T09:04:14.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b9ba00640 1 -- 172.21.15.173:0/4169462704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b940b43c0 con 0x7f5b940ce300 2024-04-25T09:04:14.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b90c00640 1 -- 172.21.15.173:0/4169462704 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c0ad860 con 0x7f5b940ce300 2024-04-25T09:04:14.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b9ba00640 1 -- 172.21.15.173:0/4169462704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b940b4980 con 0x7f5b940ce300 2024-04-25T09:04:14.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.305+0000 7f5b9ba00640 1 -- 172.21.15.173:0/4169462704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b94073a40 con 0x7f5b940ce300 2024-04-25T09:04:14.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.309+0000 7f5b90c00640 1 -- 172.21.15.173:0/4169462704 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5b8c0ada00 con 0x7f5b940ce300 2024-04-25T09:04:14.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.309+0000 7f5b90c00640 1 --2- 172.21.15.173:0/4169462704 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5b74066f60 0x7f5b74069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.309+0000 7f5b90c00640 1 -- 172.21.15.173:0/4169462704 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5b8c002020 con 0x7f5b940ce300 2024-04-25T09:04:14.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.309+0000 7f5b99000640 1 --2- 172.21.15.173:0/4169462704 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5b74066f60 0x7f5b74069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.309+0000 7f5b99000640 1 --2- 172.21.15.173:0/4169462704 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5b74066f60 0x7f5b74069420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5b88000f70 tx=0x7f5b88007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.313+0000 7f5b90c00640 1 -- 172.21.15.173:0/4169462704 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5b8c016560 con 0x7f5b940ce300 2024-04-25T09:04:14.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.497+0000 7f5b9ba00640 1 -- 172.21.15.173:0/4169462704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5b940cbf40 con 0x7f5b940ce300 2024-04-25T09:04:14.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.497+0000 7f5b90c00640 1 -- 172.21.15.173:0/4169462704 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5b8c0efef0 con 0x7f5b940ce300 2024-04-25T09:04:14.490 INFO:teuthology.orchestra.run.smithi173.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:04:14.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.501+0000 7f5b9ba00640 1 -- 172.21.15.173:0/4169462704 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5b74066f60 msgr2=0x7f5b74069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.501+0000 7f5b9ba00640 1 --2- 172.21.15.173:0/4169462704 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5b74066f60 0x7f5b74069420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5b88000f70 tx=0x7f5b88007b60 comp rx=0 tx=0).stop 2024-04-25T09:04:14.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.501+0000 7f5b9ba00640 1 -- 172.21.15.173:0/4169462704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b940ce300 msgr2=0x7f5b9415a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.501+0000 7f5b9ba00640 1 --2- 172.21.15.173:0/4169462704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b940ce300 0x7f5b9415a890 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c01a5a0 tx=0x7f5b8c019710 comp rx=0 tx=0).stop 2024-04-25T09:04:14.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.501+0000 7f5b9ba00640 1 -- 172.21.15.173:0/4169462704 shutdown_connections 2024-04-25T09:04:14.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.501+0000 7f5b9ba00640 1 --2- 172.21.15.173:0/4169462704 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5b74066f60 0x7f5b74069420 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.501+0000 7f5b9ba00640 1 --2- 172.21.15.173:0/4169462704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b940ce300 0x7f5b9415a890 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.501+0000 7f5b9ba00640 1 --2- 172.21.15.173:0/4169462704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b940aef50 0x7f5b941559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.501+0000 7f5b9ba00640 1 --2- 172.21.15.173:0/4169462704 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b9406d810 0x7f5b940b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.501+0000 7f5b9ba00640 1 -- 172.21.15.173:0/4169462704 >> 172.21.15.173:0/4169462704 conn(0x7f5b9406ac90 msgr2=0x7f5b9415f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.501+0000 7f5b9ba00640 1 -- 172.21.15.173:0/4169462704 shutdown_connections 2024-04-25T09:04:14.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:14.501+0000 7f5b9ba00640 1 -- 172.21.15.173:0/4169462704 wait complete. 2024-04-25T09:04:14.511 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:04:14.511 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:04:14.511 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2024-04-25T09:04:14.511 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:04:14.511 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:14.511 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:04:14.511 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:04:14.511 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:04:14.511 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:04:14.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:14.512 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2024-04-25T09:04:14.521 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:04:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:04:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:04:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-25T09:04:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:14.521 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:04:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2024-04-25T09:04:14.521 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:04:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2024-04-25T09:04:14.522 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:04:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:14.522 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:04:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:04:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 42363sec preferred_lft 42363sec 2024-04-25T09:04:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2024-04-25T09:04:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:14.522 INFO:teuthology.orchestra.run.smithi173.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:04:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 02:42:00:0e:60:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:04:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:14.522 INFO:teuthology.orchestra.run.smithi173.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:04:14.523 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:14.523 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:04:14.523 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:14.523 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:04:14.523 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:14.523 INFO:teuthology.orchestra.run.smithi173.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:04:14.523 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:04:14.523 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:04:14.523 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:14.523 INFO:teuthology.orchestra.run.smithi173.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:04:14.523 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:04:14.523 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:04:14.523 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:14.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:14.524 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:04:14.582 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-04-25T09:04:14.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:14.585 DEBUG:teuthology.orchestra.run.smithi173:> route 2024-04-25T09:04:14.643 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2024-04-25T09:04:14.643 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:04:14.643 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:04:14.643 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:04:14.643 INFO:teuthology.orchestra.run.smithi173.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:04:14.643 INFO:teuthology.orchestra.run.smithi173.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:04:14.643 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:04:14.643 INFO:teuthology.orchestra.run.smithi173.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:04:14.643 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:04:14.643 INFO:teuthology.orchestra.run.smithi173.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:04:14.643 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:04:14.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:14.644 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:04:14.644 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:04:14.644 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:04:14.644 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:04:14.644 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:04:14.644 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:04:14.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:14.734 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-25T09:04:14.742 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:04:14.742 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:04:14.743 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:04:14.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:14.743 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2024-04-25T09:04:14.809 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:04:14.809 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:14.862 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:04:14.862 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:04:14.862 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:14.913 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:04:14.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:14.914 DEBUG:teuthology.orchestra.run.smithi173:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:04:15.004 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:04:15.005 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:04:15.005 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:04:15.019 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:04:15.020 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:04:15.020 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:04:15.020 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:04:15.020 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:04:15.029 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:04:15.029 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:04:15.029 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:04:15.029 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:04:15.029 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:04:15.029 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-04-25T09:04:15.030 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-04-25T09:04:15.030 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6" will pass to kernel 2024-04-25T09:04:15.033 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:04:15.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:15.033 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:15.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:15.054 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:04:15.113 INFO:teuthology.orchestra.run.smithi173.stdout:client5377 2024-04-25T09:04:15.113 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:04:15.113 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:15.161 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-04-25T09:04:15.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.353+0000 7f76b1600640 1 Processor -- start 2024-04-25T09:04:15.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.353+0000 7f76b1600640 1 -- start start 2024-04-25T09:04:15.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.353+0000 7f76b1600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f76ac145290 0x7f76ac15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.353+0000 7f76b1600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f76ac0cc260 0x7f76ac0cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.353+0000 7f76b1600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ac15c5f0 con 0x7f76ac0b3fe0 2024-04-25T09:04:15.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.353+0000 7f76b1600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ac06d4b0 con 0x7f76ac0cc260 2024-04-25T09:04:15.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.353+0000 7f76b1600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ac06d790 con 0x7f76ac145290 2024-04-25T09:04:15.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.357+0000 7f76ab400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f76ac0cc260 0x7f76ac0cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.357+0000 7f76ab400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f76ac0cc260 0x7f76ac0cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33132/0 (socket says 172.21.15.173:33132) 2024-04-25T09:04:15.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.357+0000 7f76ab400640 1 -- 172.21.15.173:0/1479962845 learned_addr learned my addr 172.21.15.173:0/1479962845 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:15.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.357+0000 7f76aaa00640 1 --2- 172.21.15.173:0/1479962845 >> v2:172.21.15.194:3300/0 conn(0x7f76ac145290 0x7f76ac15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.357+0000 7f76ab400640 1 -- 172.21.15.173:0/1479962845 >> v2:172.21.15.194:3300/0 conn(0x7f76ac145290 msgr2=0x7f76ac15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:15.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.357+0000 7f76ab400640 1 --2- 172.21.15.173:0/1479962845 >> v2:172.21.15.194:3300/0 conn(0x7f76ac145290 0x7f76ac15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.357+0000 7f76ab400640 1 -- 172.21.15.173:0/1479962845 >> v1:172.21.15.194:6789/0 conn(0x7f76ac0b3fe0 legacy=0x7f76ac0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.357+0000 7f76ab400640 1 -- 172.21.15.173:0/1479962845 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac06da70 con 0x7f76ac0cc260 2024-04-25T09:04:15.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.357+0000 7f76ab400640 1 --2- 172.21.15.173:0/1479962845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76ac0cc260 0x7f76ac0cc670 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0d0800 tx=0x7f76a401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd63514bd152d78c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.357+0000 7f76aa000640 1 -- 172.21.15.173:0/1479962845 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a40a56a0 con 0x7f76ac0cc260 2024-04-25T09:04:15.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.357+0000 7f76aa000640 1 -- 172.21.15.173:0/1479962845 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a40a5840 con 0x7f76ac0cc260 2024-04-25T09:04:15.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.357+0000 7f76aa000640 1 -- 172.21.15.173:0/1479962845 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a40a5c10 con 0x7f76ac0cc260 2024-04-25T09:04:15.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76b1600640 1 -- 172.21.15.173:0/1479962845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76ac0cc260 msgr2=0x7f76ac0cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76b1600640 1 --2- 172.21.15.173:0/1479962845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76ac0cc260 0x7f76ac0cc670 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0d0800 tx=0x7f76a401c8d0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76b1600640 1 -- 172.21.15.173:0/1479962845 shutdown_connections 2024-04-25T09:04:15.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76b1600640 1 --2- 172.21.15.173:0/1479962845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76ac0cc260 0x7f76ac0cc670 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76b1600640 1 --2- 172.21.15.173:0/1479962845 >> v2:172.21.15.194:3300/0 conn(0x7f76ac145290 0x7f76ac15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76b1600640 1 -- 172.21.15.173:0/1479962845 >> 172.21.15.173:0/1479962845 conn(0x7f76ac06ac90 msgr2=0x7f76ac06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:15.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76b1600640 1 -- 172.21.15.173:0/1479962845 shutdown_connections 2024-04-25T09:04:15.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76b1600640 1 -- 172.21.15.173:0/1479962845 wait complete. 2024-04-25T09:04:15.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76b1600640 1 Processor -- start 2024-04-25T09:04:15.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76b1600640 1 -- start start 2024-04-25T09:04:15.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76b1600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76ac0b3fe0 0x7f76ac0aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76b1600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76ac0cc260 0x7f76ac1f54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76b1600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76ac145290 0x7f76ac15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76b1600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac06eee0 con 0x7f76ac0b3fe0 2024-04-25T09:04:15.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76b1600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac06ed60 con 0x7f76ac0cc260 2024-04-25T09:04:15.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76b1600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac06f060 con 0x7f76ac145290 2024-04-25T09:04:15.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76aaa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76ac0b3fe0 0x7f76ac0aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76aaa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76ac0b3fe0 0x7f76ac0aae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33144/0 (socket says 172.21.15.173:33144) 2024-04-25T09:04:15.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76aaa00640 1 -- 172.21.15.173:0/1716421591 learned_addr learned my addr 172.21.15.173:0/1716421591 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:04:15.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76a2000640 1 --2- 172.21.15.173:0/1716421591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76ac0cc260 0x7f76ac1f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76ab400640 1 --2- 172.21.15.173:0/1716421591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76ac145290 0x7f76ac15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76aaa00640 1 -- 172.21.15.173:0/1716421591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76ac145290 msgr2=0x7f76ac15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76aaa00640 1 --2- 172.21.15.173:0/1716421591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76ac145290 0x7f76ac15adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76aaa00640 1 -- 172.21.15.173:0/1716421591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76ac0cc260 msgr2=0x7f76ac1f54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76aaa00640 1 --2- 172.21.15.173:0/1716421591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76ac0cc260 0x7f76ac1f54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.361+0000 7f76aaa00640 1 -- 172.21.15.173:0/1716421591 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac0ab580 con 0x7f76ac0b3fe0 2024-04-25T09:04:15.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.365+0000 7f76aaa00640 1 --2- 172.21.15.173:0/1716421591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76ac0b3fe0 0x7f76ac0aae80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f769c00e870 tx=0x7f769c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.365+0000 7f76a3400640 1 -- 172.21.15.173:0/1716421591 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c017070 con 0x7f76ac0b3fe0 2024-04-25T09:04:15.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.365+0000 7f76a3400640 1 -- 172.21.15.173:0/1716421591 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769c00c940 con 0x7f76ac0b3fe0 2024-04-25T09:04:15.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.365+0000 7f76a3400640 1 -- 172.21.15.173:0/1716421591 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c00ccf0 con 0x7f76ac0b3fe0 2024-04-25T09:04:15.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.365+0000 7f76b1600640 1 -- 172.21.15.173:0/1716421591 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ac0ab860 con 0x7f76ac0b3fe0 2024-04-25T09:04:15.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.365+0000 7f76b1600640 1 -- 172.21.15.173:0/1716421591 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ac15b2f0 con 0x7f76ac0b3fe0 2024-04-25T09:04:15.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.365+0000 7f76b1600640 1 -- 172.21.15.173:0/1716421591 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ac073ab0 con 0x7f76ac0b3fe0 2024-04-25T09:04:15.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.365+0000 7f76a3400640 1 -- 172.21.15.173:0/1716421591 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f769c01a070 con 0x7f76ac0b3fe0 2024-04-25T09:04:15.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.365+0000 7f76a3400640 1 --2- 172.21.15.173:0/1716421591 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7688066f60 0x7f7688069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.365+0000 7f76a3400640 1 -- 172.21.15.173:0/1716421591 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f769c085430 con 0x7f76ac0b3fe0 2024-04-25T09:04:15.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.365+0000 7f76a2000640 1 --2- 172.21.15.173:0/1716421591 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7688066f60 0x7f7688069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.365+0000 7f76a2000640 1 --2- 172.21.15.173:0/1716421591 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7688066f60 0x7f7688069420 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0b4570 tx=0x7f7694009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.369+0000 7f76a3400640 1 -- 172.21.15.173:0/1716421591 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f769c055bc0 con 0x7f76ac0b3fe0 2024-04-25T09:04:15.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.557+0000 7f76b1600640 1 -- 172.21.15.173:0/1716421591 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f76ac0b1fc0 con 0x7f76ac0b3fe0 2024-04-25T09:04:15.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.877+0000 7f76a3400640 1 -- 172.21.15.173:0/1716421591 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v19) v1 ==== 167+0+0 (secure 0 0 0) 0x7f769c059c60 con 0x7f76ac0b3fe0 2024-04-25T09:04:15.866 INFO:teuthology.orchestra.run.smithi173.stderr:enabled new snapshots 2024-04-25T09:04:15.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.877+0000 7f76b1600640 1 -- 172.21.15.173:0/1716421591 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7688066f60 msgr2=0x7f7688069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.877+0000 7f76b1600640 1 --2- 172.21.15.173:0/1716421591 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7688066f60 0x7f7688069420 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0b4570 tx=0x7f7694009040 comp rx=0 tx=0).stop 2024-04-25T09:04:15.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.877+0000 7f76b1600640 1 -- 172.21.15.173:0/1716421591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76ac0b3fe0 msgr2=0x7f76ac0aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.877+0000 7f76b1600640 1 --2- 172.21.15.173:0/1716421591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76ac0b3fe0 0x7f76ac0aae80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f769c00e870 tx=0x7f769c00ec70 comp rx=0 tx=0).stop 2024-04-25T09:04:15.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.877+0000 7f76b1600640 1 -- 172.21.15.173:0/1716421591 shutdown_connections 2024-04-25T09:04:15.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.877+0000 7f76b1600640 1 --2- 172.21.15.173:0/1716421591 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7688066f60 0x7f7688069420 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.877+0000 7f76b1600640 1 --2- 172.21.15.173:0/1716421591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76ac145290 0x7f76ac15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.877+0000 7f76b1600640 1 --2- 172.21.15.173:0/1716421591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76ac0cc260 0x7f76ac1f54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.877+0000 7f76b1600640 1 --2- 172.21.15.173:0/1716421591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76ac0b3fe0 0x7f76ac0aae80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.877+0000 7f76b1600640 1 -- 172.21.15.173:0/1716421591 >> 172.21.15.173:0/1716421591 conn(0x7f76ac06ac90 msgr2=0x7f76ac06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:15.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.877+0000 7f76b1600640 1 -- 172.21.15.173:0/1716421591 shutdown_connections 2024-04-25T09:04:15.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:15.877+0000 7f76b1600640 1 -- 172.21.15.173:0/1716421591 wait complete. 2024-04-25T09:04:15.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:15.890 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-04-25T09:04:15.906 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:04:15.906 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:15.958 DEBUG:teuthology.orchestra.run.smithi173:> stdin-killer -- python3 -c ' 2024-04-25T09:04:15.958 DEBUG:teuthology.orchestra.run.smithi173:> import os 2024-04-25T09:04:15.958 DEBUG:teuthology.orchestra.run.smithi173:> import uuid 2024-04-25T09:04:15.958 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:04:15.958 DEBUG:teuthology.orchestra.run.smithi173:> n = 2000 2024-04-25T09:04:15.958 DEBUG:teuthology.orchestra.run.smithi173:> create_hard_links = False 2024-04-25T09:04:15.958 DEBUG:teuthology.orchestra.run.smithi173:> if 3 > 0: 2024-04-25T09:04:15.958 DEBUG:teuthology.orchestra.run.smithi173:> create_hard_links = True 2024-04-25T09:04:15.958 DEBUG:teuthology.orchestra.run.smithi173:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-04-25T09:04:15.958 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:04:15.958 DEBUG:teuthology.orchestra.run.smithi173:> dpath = os.path.dirname(path) 2024-04-25T09:04:15.958 DEBUG:teuthology.orchestra.run.smithi173:> fnameprefix = os.path.basename(path) 2024-04-25T09:04:15.958 DEBUG:teuthology.orchestra.run.smithi173:> os.makedirs(dpath, exist_ok=True) 2024-04-25T09:04:15.958 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:04:15.958 DEBUG:teuthology.orchestra.run.smithi173:> try: 2024-04-25T09:04:15.959 DEBUG:teuthology.orchestra.run.smithi173:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-04-25T09:04:15.959 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:04:15.959 DEBUG:teuthology.orchestra.run.smithi173:> for i in range(n): 2024-04-25T09:04:15.959 DEBUG:teuthology.orchestra.run.smithi173:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-04-25T09:04:15.959 DEBUG:teuthology.orchestra.run.smithi173:> with open(fpath, '"'"'w'"'"') as f: 2024-04-25T09:04:15.959 DEBUG:teuthology.orchestra.run.smithi173:> f.write(f"{i}") 2024-04-25T09:04:15.959 DEBUG:teuthology.orchestra.run.smithi173:> if False: 2024-04-25T09:04:15.959 DEBUG:teuthology.orchestra.run.smithi173:> f.flush() 2024-04-25T09:04:15.959 DEBUG:teuthology.orchestra.run.smithi173:> os.fsync(f.fileno()) 2024-04-25T09:04:15.959 DEBUG:teuthology.orchestra.run.smithi173:> if False: 2024-04-25T09:04:15.959 DEBUG:teuthology.orchestra.run.smithi173:> os.unlink(fpath) 2024-04-25T09:04:15.959 DEBUG:teuthology.orchestra.run.smithi173:> if False: 2024-04-25T09:04:15.959 DEBUG:teuthology.orchestra.run.smithi173:> os.fsync(dirfd) 2024-04-25T09:04:15.959 DEBUG:teuthology.orchestra.run.smithi173:> if create_hard_links: 2024-04-25T09:04:15.959 DEBUG:teuthology.orchestra.run.smithi173:> for j in range(3): 2024-04-25T09:04:15.959 DEBUG:teuthology.orchestra.run.smithi173:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-04-25T09:04:15.960 DEBUG:teuthology.orchestra.run.smithi173:> if False: 2024-04-25T09:04:15.960 DEBUG:teuthology.orchestra.run.smithi173:> os.fsync(dirfd) 2024-04-25T09:04:15.960 DEBUG:teuthology.orchestra.run.smithi173:> finally: 2024-04-25T09:04:15.960 DEBUG:teuthology.orchestra.run.smithi173:> os.close(dirfd) 2024-04-25T09:04:15.960 DEBUG:teuthology.orchestra.run.smithi173:> ' 2024-04-25T09:04:37.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:04:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:04:37.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:37.359 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-04-25T09:04:37.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:37.425 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-04-25T09:04:44.327 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:44.331 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:05:04.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:04.535 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-04-25T09:05:04.555 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:05:04.556 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-04-25T09:05:05.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:04.748+0000 7eff4cc00640 1 Processor -- start 2024-04-25T09:05:05.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:04.748+0000 7eff4cc00640 1 -- start start 2024-04-25T09:05:05.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:04.748+0000 7eff4cc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff4816a900 0x7eff48071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:04.748+0000 7eff4cc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7eff4806e5a0 0x7eff4806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:04.748+0000 7eff4cc00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff480724f0 con 0x7eff4808a8b0 2024-04-25T09:05:05.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:04.748+0000 7eff4cc00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4806ef30 con 0x7eff4806e5a0 2024-04-25T09:05:05.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:04.748+0000 7eff4cc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff480cef00 con 0x7eff4816a900 2024-04-25T09:05:05.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:04.752+0000 7eff46800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7eff4806e5a0 0x7eff4806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:04.752+0000 7eff3d400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7eff4808a8b0 0x7eff480b2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46694/0 (socket says 172.21.15.173:46694) 2024-04-25T09:05:05.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:04.752+0000 7eff3d400640 1 -- 172.21.15.173:0/3647367079 learned_addr learned my addr 172.21.15.173:0/3647367079 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:05.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:04.752+0000 7eff45e00640 1 --2- 172.21.15.173:0/3647367079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff4816a900 0x7eff48071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:04.752+0000 7eff45400640 1 -- 172.21.15.173:0/3647367079 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652696490 0 0) 0x7eff480724f0 con 0x7eff4808a8b0 2024-04-25T09:05:05.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.104+0000 7eff45400640 1 -- 172.21.15.173:0/3647367079 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff2c005740 con 0x7eff4808a8b0 2024-04-25T09:05:05.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.104+0000 7eff46800640 1 -- 172.21.15.173:0/3647367079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff4816a900 msgr2=0x7eff48071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.104+0000 7eff46800640 1 --2- 172.21.15.173:0/3647367079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff4816a900 0x7eff48071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.104+0000 7eff46800640 1 -- 172.21.15.173:0/3647367079 >> v1:172.21.15.173:6789/0 conn(0x7eff4808a8b0 legacy=0x7eff480b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.104+0000 7eff46800640 1 -- 172.21.15.173:0/3647367079 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff480cf1e0 con 0x7eff4806e5a0 2024-04-25T09:05:05.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.108+0000 7eff46800640 1 --2- 172.21.15.173:0/3647367079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4806e5a0 0x7eff4806e9f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7eff4000b250 tx=0x7eff4001f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323eb7121dcfd80a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.108+0000 7eff45400640 1 -- 172.21.15.173:0/3647367079 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff400b5070 con 0x7eff4806e5a0 2024-04-25T09:05:05.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.108+0000 7eff45400640 1 -- 172.21.15.173:0/3647367079 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4000a2d0 con 0x7eff4806e5a0 2024-04-25T09:05:05.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.108+0000 7eff45400640 1 -- 172.21.15.173:0/3647367079 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4000a6a0 con 0x7eff4806e5a0 2024-04-25T09:05:05.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.108+0000 7eff4cc00640 1 -- 172.21.15.173:0/3647367079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4806e5a0 msgr2=0x7eff4806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.108+0000 7eff4cc00640 1 --2- 172.21.15.173:0/3647367079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4806e5a0 0x7eff4806e9f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7eff4000b250 tx=0x7eff4001f5a0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.108+0000 7eff4cc00640 1 -- 172.21.15.173:0/3647367079 shutdown_connections 2024-04-25T09:05:05.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.108+0000 7eff4cc00640 1 --2- 172.21.15.173:0/3647367079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4806e5a0 0x7eff4806e9f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.108+0000 7eff4cc00640 1 --2- 172.21.15.173:0/3647367079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff4816a900 0x7eff48071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.108+0000 7eff4cc00640 1 -- 172.21.15.173:0/3647367079 >> 172.21.15.173:0/3647367079 conn(0x7eff4806ac90 msgr2=0x7eff4806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.108+0000 7eff4cc00640 1 -- 172.21.15.173:0/3647367079 shutdown_connections 2024-04-25T09:05:05.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.108+0000 7eff4cc00640 1 -- 172.21.15.173:0/3647367079 wait complete. 2024-04-25T09:05:05.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff4cc00640 1 Processor -- start 2024-04-25T09:05:05.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff4cc00640 1 -- start start 2024-04-25T09:05:05.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff4cc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff4806e5a0 0x7eff4815e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff4cc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff4808a8b0 0x7eff4816d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff4cc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4816a900 0x7eff4816d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff4cc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff480cecc0 con 0x7eff4816a900 2024-04-25T09:05:05.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff4cc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff480ceb40 con 0x7eff4806e5a0 2024-04-25T09:05:05.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff4cc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4816ace0 con 0x7eff4808a8b0 2024-04-25T09:05:05.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff46800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4816a900 0x7eff4816d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff46800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4816a900 0x7eff4816d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43074/0 (socket says 172.21.15.173:43074) 2024-04-25T09:05:05.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff46800640 1 -- 172.21.15.173:0/3869050541 learned_addr learned my addr 172.21.15.173:0/3869050541 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:05.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff45e00640 1 --2- 172.21.15.173:0/3869050541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff4806e5a0 0x7eff4815e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff3d400640 1 --2- 172.21.15.173:0/3869050541 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff4808a8b0 0x7eff4816d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff46800640 1 -- 172.21.15.173:0/3869050541 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff4808a8b0 msgr2=0x7eff4816d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff46800640 1 --2- 172.21.15.173:0/3869050541 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff4808a8b0 0x7eff4816d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff46800640 1 -- 172.21.15.173:0/3869050541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff4806e5a0 msgr2=0x7eff4815e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff46800640 1 --2- 172.21.15.173:0/3869050541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff4806e5a0 0x7eff4815e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff46800640 1 -- 172.21.15.173:0/3869050541 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff48160a00 con 0x7eff4816a900 2024-04-25T09:05:05.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff46800640 1 --2- 172.21.15.173:0/3869050541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4816a900 0x7eff4816d760 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7eff4001d1d0 tx=0x7eff40008740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff3ea00640 1 -- 172.21.15.173:0/3869050541 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff400b5040 con 0x7eff4816a900 2024-04-25T09:05:05.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff3ea00640 1 -- 172.21.15.173:0/3869050541 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff400b0470 con 0x7eff4816a900 2024-04-25T09:05:05.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff3ea00640 1 -- 172.21.15.173:0/3869050541 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40007430 con 0x7eff4816a900 2024-04-25T09:05:05.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff4cc00640 1 -- 172.21.15.173:0/3869050541 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff481f6800 con 0x7eff4816a900 2024-04-25T09:05:05.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.112+0000 7eff4cc00640 1 -- 172.21.15.173:0/3869050541 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff481f6dc0 con 0x7eff4816a900 2024-04-25T09:05:05.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.116+0000 7eff3ea00640 1 -- 172.21.15.173:0/3869050541 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7eff400b0840 con 0x7eff4816a900 2024-04-25T09:05:05.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.116+0000 7eff3ea00640 1 --2- 172.21.15.173:0/3869050541 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7eff24066f60 0x7eff24069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.116+0000 7eff3ea00640 1 -- 172.21.15.173:0/3869050541 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6130+0+0 (secure 0 0 0) 0x7eff401231f0 con 0x7eff4816a900 2024-04-25T09:05:05.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.116+0000 7eff45e00640 1 --2- 172.21.15.173:0/3869050541 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7eff24066f60 0x7eff24069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.116+0000 7eff45e00640 1 --2- 172.21.15.173:0/3869050541 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7eff24066f60 0x7eff24069420 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7eff38005dc0 tx=0x7eff38009330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff50065000 1 Processor -- start 2024-04-25T09:05:05.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff50065000 1 -- start start 2024-04-25T09:05:05.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff50065000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d53a40 0x563ed6d53e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff50065000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d54360 0x563ed6d0e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff50065000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d0ed90 0x563ed6d0f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff50065000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ed6bf11f0 con 0x563ed6d54360 2024-04-25T09:05:05.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff50065000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ed6b57e90 con 0x563ed6d53a40 2024-04-25T09:05:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff50065000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ed6adff50 con 0x563ed6d0ed90 2024-04-25T09:05:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff3d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d54360 0x563ed6d0e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff46800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d0ed90 0x563ed6d0f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff45e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d53a40 0x563ed6d53e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff3d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d54360 0x563ed6d0e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43076/0 (socket says 172.21.15.173:43076) 2024-04-25T09:05:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff3d400640 1 -- 172.21.15.173:0/660208000 learned_addr learned my addr 172.21.15.173:0/660208000 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff45e00640 1 -- 172.21.15.173:0/660208000 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d0ed90 msgr2=0x563ed6d0f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff45e00640 1 --2- 172.21.15.173:0/660208000 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d0ed90 0x563ed6d0f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff45e00640 1 -- 172.21.15.173:0/660208000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d54360 msgr2=0x563ed6d0e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff45e00640 1 --2- 172.21.15.173:0/660208000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d54360 0x563ed6d0e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff45e00640 1 -- 172.21.15.173:0/660208000 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ed6b2f8b0 con 0x563ed6d53a40 2024-04-25T09:05:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff46800640 1 --2- 172.21.15.173:0/660208000 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d0ed90 0x563ed6d0f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff3d400640 1 --2- 172.21.15.173:0/660208000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d54360 0x563ed6d0e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:05.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff45e00640 1 --2- 172.21.15.173:0/660208000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d53a40 0x563ed6d53e20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7eff38011bc0 tx=0x7eff38014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3046b94b2543a57f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff36a00640 1 -- 172.21.15.173:0/660208000 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3800b040 con 0x563ed6d53a40 2024-04-25T09:05:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff36a00640 1 -- 172.21.15.173:0/660208000 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff38026070 con 0x563ed6d53a40 2024-04-25T09:05:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.120+0000 7eff36a00640 1 -- 172.21.15.173:0/660208000 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff380216a0 con 0x563ed6d53a40 2024-04-25T09:05:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.124+0000 7eff50065000 1 -- 172.21.15.173:0/660208000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d53a40 msgr2=0x563ed6d53e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.124+0000 7eff50065000 1 --2- 172.21.15.173:0/660208000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d53a40 0x563ed6d53e20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7eff38011bc0 tx=0x7eff38014000 comp rx=0 tx=0).stop 2024-04-25T09:05:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.124+0000 7eff50065000 1 -- 172.21.15.173:0/660208000 shutdown_connections 2024-04-25T09:05:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.124+0000 7eff50065000 1 --2- 172.21.15.173:0/660208000 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d0ed90 0x563ed6d0f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.124+0000 7eff50065000 1 --2- 172.21.15.173:0/660208000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d54360 0x563ed6d0e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.124+0000 7eff50065000 1 --2- 172.21.15.173:0/660208000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d53a40 0x563ed6d53e20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.124+0000 7eff50065000 1 -- 172.21.15.173:0/660208000 >> 172.21.15.173:0/660208000 conn(0x563ed6d0ad40 msgr2=0x563ed6d0d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.124+0000 7eff50065000 1 -- 172.21.15.173:0/660208000 shutdown_connections 2024-04-25T09:05:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.124+0000 7eff50065000 1 -- 172.21.15.173:0/660208000 wait complete. 2024-04-25T09:05:05.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.124+0000 7eff50065000 1 -- start start 2024-04-25T09:05:05.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.124+0000 7eff50065000 1 Processor -- start 2024-04-25T09:05:05.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff50065000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d0ed90 0x563ed6d5b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff50065000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d53a40 0x563ed6d5b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff50065000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d54360 0x563ed6d14dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff50065000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ed6b12540 con 0x563ed6d0ed90 2024-04-25T09:05:05.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff50065000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ed6b53f30 con 0x563ed6d53a40 2024-04-25T09:05:05.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff50065000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ed6b03260 con 0x563ed6d54360 2024-04-25T09:05:05.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff50065000 10 client.0 _ll_register_callbacks cb 0x563ed6c0c180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:05.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff3d400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d53a40 0x563ed6d5b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff3d400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d53a40 0x563ed6d5b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:57884/0 (socket says 172.21.15.173:57884) 2024-04-25T09:05:05.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff3d400640 1 -- 172.21.15.173:0/2243106485 learned_addr learned my addr 172.21.15.173:0/2243106485 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:05.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff45e00640 1 --2- 172.21.15.173:0/2243106485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d0ed90 0x563ed6d5b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff46800640 1 --2- 172.21.15.173:0/2243106485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d54360 0x563ed6d14dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff46800640 1 -- 172.21.15.173:0/2243106485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d53a40 msgr2=0x563ed6d5b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff46800640 1 --2- 172.21.15.173:0/2243106485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d53a40 0x563ed6d5b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff46800640 1 -- 172.21.15.173:0/2243106485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d0ed90 msgr2=0x563ed6d5b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff46800640 1 --2- 172.21.15.173:0/2243106485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d0ed90 0x563ed6d5b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff46800640 1 -- 172.21.15.173:0/2243106485 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ed6ae01a0 con 0x563ed6d54360 2024-04-25T09:05:05.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff3d400640 1 --2- 172.21.15.173:0/2243106485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d53a40 0x563ed6d5b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:05.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff46800640 1 --2- 172.21.15.173:0/2243106485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d54360 0x563ed6d14dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7eff400262f0 tx=0x7eff400f33d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0858249d84791f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff2b400640 10 client.0 ms_handle_connect on v2:172.21.15.194:3301/0 2024-04-25T09:05:05.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff2b400640 1 -- 172.21.15.173:0/2243106485 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff400fc050 con 0x563ed6d54360 2024-04-25T09:05:05.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff2b400640 1 -- 172.21.15.173:0/2243106485 <== mon.2 v2:172.21.15.194:3301/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6130+0+0 (secure 0 0 0) 0x7eff400fbbc0 con 0x563ed6d54360 2024-04-25T09:05:05.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff50065000 1 -- 172.21.15.173:0/2243106485 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff38026070 con 0x563ed6d54360 2024-04-25T09:05:05.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff2b400640 1 -- 172.21.15.173:0/2243106485 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff400fbde0 con 0x563ed6d54360 2024-04-25T09:05:05.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff50065000 10 client.5093 fetch_fsmap learned FSMap version 19 2024-04-25T09:05:05.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff50065000 1 -- 172.21.15.173:0/2243106485 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x563ed6bda840 con 0x563ed6d54360 2024-04-25T09:05:05.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff2b400640 1 -- 172.21.15.173:0/2243106485 <== mon.2 v2:172.21.15.194:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff38026070 con 0x563ed6d54360 2024-04-25T09:05:05.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff2b400640 1 -- 172.21.15.173:0/2243106485 <== mon.2 v2:172.21.15.194:3301/0 5 ==== fsmap(e 19) v1 ==== 3294+0+0 (secure 0 0 0) 0x7eff400b8070 con 0x563ed6d54360 2024-04-25T09:05:05.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff50065000 10 client.5093 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T09:05:05.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff50065000 10 client.5093 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-04-25T09:05:05.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff50065000 20 client.5093 populate_metadata read hostname 'smithi173' 2024-04-25T09:05:05.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff50065000 1 --2- 172.21.15.173:0/2243106485 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x563ed6d15b30 0x563ed6d15f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff50065000 4 client.5093 mds_command: new command op to 5346 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:05.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff50065000 1 -- 172.21.15.173:0/2243106485 --> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563ed6af3be0 con 0x563ed6d15b30 2024-04-25T09:05:05.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff45e00640 1 --2- 172.21.15.173:0/2243106485 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x563ed6d15b30 0x563ed6d15f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff45e00640 1 --2- 172.21.15.173:0/2243106485 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x563ed6d15b30 0x563ed6d15f10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=636589ba30d5abf7 server_cookie=3f3f7b4fc474594d in_seq=0 out_seq=0 2024-04-25T09:05:05.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.128+0000 7eff2b400640 10 client.5093 ms_handle_connect on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:05.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.132+0000 7eff2b400640 1 -- 172.21.15.173:0/2243106485 <== mds.0 v2:172.21.15.173:6834/960880761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563ed6af3be0 con 0x563ed6d15b30 2024-04-25T09:05:05.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.132+0000 7eff2b400640 10 client.5093 handle_command_reply: tid=0 2024-04-25T09:05:05.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.132+0000 7eff50065000 1 client.5093 shutdown 2024-04-25T09:05:05.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.132+0000 7eff50065000 1 -- 172.21.15.173:0/2243106485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d54360 msgr2=0x563ed6d14dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.132+0000 7eff50065000 1 --2- 172.21.15.173:0/2243106485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d54360 0x563ed6d14dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7eff400262f0 tx=0x7eff400f33d0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.132+0000 7eff50065000 1 -- 172.21.15.173:0/2243106485 shutdown_connections 2024-04-25T09:05:05.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.132+0000 7eff50065000 1 --2- 172.21.15.173:0/2243106485 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x563ed6d15b30 0x563ed6d15f10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.132+0000 7eff50065000 1 --2- 172.21.15.173:0/2243106485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d54360 0x563ed6d14dc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.132+0000 7eff50065000 1 --2- 172.21.15.173:0/2243106485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d53a40 0x563ed6d5b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.132+0000 7eff50065000 1 --2- 172.21.15.173:0/2243106485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d0ed90 0x563ed6d5b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.132+0000 7eff2b400640 0 client.5093 ms_handle_reset on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:05.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.132+0000 7eff50065000 1 -- 172.21.15.173:0/2243106485 >> 172.21.15.173:0/2243106485 conn(0x563ed6d0ad40 msgr2=0x563ed6d0d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.132+0000 7eff50065000 1 -- 172.21.15.173:0/2243106485 shutdown_connections 2024-04-25T09:05:05.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.132+0000 7eff50065000 1 -- 172.21.15.173:0/2243106485 wait complete. 2024-04-25T09:05:05.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.132+0000 7eff50065000 20 client.5093 trim_cache size 0 max 16384 2024-04-25T09:05:05.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff50065000 1 Processor -- start 2024-04-25T09:05:05.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff50065000 1 -- start start 2024-04-25T09:05:05.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff50065000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d0ed90 0x563ed6db0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff50065000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d53a40 0x563ed6db05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff50065000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d54360 0x563ed6db0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff50065000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff48211370 con 0x563ed6d53a40 2024-04-25T09:05:05.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff50065000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff48210690 con 0x563ed6d0ed90 2024-04-25T09:05:05.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff50065000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff481f7eb0 con 0x563ed6d54360 2024-04-25T09:05:05.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff3d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d53a40 0x563ed6db05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff3d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d53a40 0x563ed6db05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43098/0 (socket says 172.21.15.173:43098) 2024-04-25T09:05:05.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff3d400640 1 -- 172.21.15.173:0/106037375 learned_addr learned my addr 172.21.15.173:0/106037375 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:05.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff45e00640 1 --2- 172.21.15.173:0/106037375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d0ed90 0x563ed6db0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff46800640 1 --2- 172.21.15.173:0/106037375 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d54360 0x563ed6db0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff3d400640 1 -- 172.21.15.173:0/106037375 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d54360 msgr2=0x563ed6db0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff3d400640 1 --2- 172.21.15.173:0/106037375 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d54360 0x563ed6db0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff3d400640 1 -- 172.21.15.173:0/106037375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d0ed90 msgr2=0x563ed6db0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff3d400640 1 --2- 172.21.15.173:0/106037375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d0ed90 0x563ed6db0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff3d400640 1 -- 172.21.15.173:0/106037375 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ed6d54190 con 0x563ed6d53a40 2024-04-25T09:05:05.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff45e00640 1 --2- 172.21.15.173:0/106037375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d0ed90 0x563ed6db0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:05.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff3d400640 1 --2- 172.21.15.173:0/106037375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d53a40 0x563ed6db05c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7eff30001c40 tx=0x7eff30000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d893efd64e818626 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff36000640 1 -- 172.21.15.173:0/106037375 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30005890 con 0x563ed6d53a40 2024-04-25T09:05:05.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff36000640 1 -- 172.21.15.173:0/106037375 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3001a030 con 0x563ed6d53a40 2024-04-25T09:05:05.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff36000640 1 -- 172.21.15.173:0/106037375 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30005c70 con 0x563ed6d53a40 2024-04-25T09:05:05.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff50065000 1 -- 172.21.15.173:0/106037375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d53a40 msgr2=0x563ed6db05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff50065000 1 --2- 172.21.15.173:0/106037375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d53a40 0x563ed6db05c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7eff30001c40 tx=0x7eff30000bd0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff50065000 1 -- 172.21.15.173:0/106037375 shutdown_connections 2024-04-25T09:05:05.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff50065000 1 --2- 172.21.15.173:0/106037375 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d54360 0x563ed6db0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff50065000 1 --2- 172.21.15.173:0/106037375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d53a40 0x563ed6db05c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff50065000 1 --2- 172.21.15.173:0/106037375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d0ed90 0x563ed6db0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff50065000 1 -- 172.21.15.173:0/106037375 >> 172.21.15.173:0/106037375 conn(0x563ed6d0ad40 msgr2=0x563ed6d520f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff50065000 1 -- 172.21.15.173:0/106037375 shutdown_connections 2024-04-25T09:05:05.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.148+0000 7eff50065000 1 -- 172.21.15.173:0/106037375 wait complete. 2024-04-25T09:05:05.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff50065000 1 -- start start 2024-04-25T09:05:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff50065000 1 Processor -- start 2024-04-25T09:05:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff50065000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d0ed90 0x563ed6db44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff50065000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d53a40 0x563ed6db49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff50065000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d54360 0x563ed6d58ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff50065000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ed6d0abc0 con 0x563ed6d54360 2024-04-25T09:05:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff50065000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff481f84b0 con 0x563ed6d0ed90 2024-04-25T09:05:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff50065000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ed6b0ccb0 con 0x563ed6d53a40 2024-04-25T09:05:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff50065000 10 client.0 _ll_register_callbacks cb 0x563ed6b1aa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff46800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d54360 0x563ed6d58ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff46800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d54360 0x563ed6d58ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43114/0 (socket says 172.21.15.173:43114) 2024-04-25T09:05:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff46800640 1 -- 172.21.15.173:0/2460984567 learned_addr learned my addr 172.21.15.173:0/2460984567 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff45e00640 1 --2- 172.21.15.173:0/2460984567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d0ed90 0x563ed6db44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff3d400640 1 --2- 172.21.15.173:0/2460984567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d53a40 0x563ed6db49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff46800640 1 -- 172.21.15.173:0/2460984567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d53a40 msgr2=0x563ed6db49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff46800640 1 --2- 172.21.15.173:0/2460984567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d53a40 0x563ed6db49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff46800640 1 -- 172.21.15.173:0/2460984567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d0ed90 msgr2=0x563ed6db44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff46800640 1 --2- 172.21.15.173:0/2460984567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d0ed90 0x563ed6db44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff46800640 1 -- 172.21.15.173:0/2460984567 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ed6bb1a10 con 0x563ed6d54360 2024-04-25T09:05:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff45e00640 1 --2- 172.21.15.173:0/2460984567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d0ed90 0x563ed6db44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff46800640 1 --2- 172.21.15.173:0/2460984567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d54360 0x563ed6d58ed0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7eff400efe00 tx=0x7eff40121430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab3074b547c1b5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff2b400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:05:05.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff2b400640 1 -- 172.21.15.173:0/2460984567 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff400f3530 con 0x563ed6d54360 2024-04-25T09:05:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff2b400640 1 -- 172.21.15.173:0/2460984567 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6130+0+0 (secure 0 0 0) 0x7eff4011ac50 con 0x563ed6d54360 2024-04-25T09:05:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff50065000 1 -- 172.21.15.173:0/2460984567 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff3001a030 con 0x563ed6d54360 2024-04-25T09:05:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff2b400640 1 -- 172.21.15.173:0/2460984567 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff400f3350 con 0x563ed6d54360 2024-04-25T09:05:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff50065000 10 client.5586 fetch_fsmap learned FSMap version 19 2024-04-25T09:05:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff50065000 1 -- 172.21.15.173:0/2460984567 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x563ed6aecb00 con 0x563ed6d54360 2024-04-25T09:05:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff2b400640 1 -- 172.21.15.173:0/2460984567 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3001a030 con 0x563ed6d54360 2024-04-25T09:05:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff2b400640 1 -- 172.21.15.173:0/2460984567 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 19) v1 ==== 3294+0+0 (secure 0 0 0) 0x7eff400fe030 con 0x563ed6d54360 2024-04-25T09:05:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff50065000 10 client.5586 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T09:05:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff50065000 10 client.5586 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-04-25T09:05:05.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff50065000 20 client.5586 populate_metadata read hostname 'smithi173' 2024-04-25T09:05:05.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff50065000 1 --2- 172.21.15.173:0/2460984567 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x563ed6d59800 0x563ed6d59c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff50065000 4 client.5586 mds_command: new command op to 5346 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-04-25T09:05:05.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.152+0000 7eff50065000 1 -- 172.21.15.173:0/2460984567 --> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x563ed6b653d0 con 0x563ed6d59800 2024-04-25T09:05:05.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff45e00640 1 --2- 172.21.15.173:0/2460984567 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x563ed6d59800 0x563ed6d59c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff45e00640 1 --2- 172.21.15.173:0/2460984567 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x563ed6d59800 0x563ed6d59c10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68497050b9b55bfc server_cookie=ba5b524b198538ac in_seq=0 out_seq=0 2024-04-25T09:05:05.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff2b400640 10 client.5586 ms_handle_connect on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:05.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff2b400640 1 -- 172.21.15.173:0/2460984567 <== mds.0 v2:172.21.15.173:6834/960880761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17919 (crc 0 0 0) 0x563ed6b653d0 con 0x563ed6d59800 2024-04-25T09:05:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff2b400640 10 client.5586 handle_command_reply: tid=0 2024-04-25T09:05:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff50065000 1 client.5586 shutdown 2024-04-25T09:05:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff50065000 1 -- 172.21.15.173:0/2460984567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d54360 msgr2=0x563ed6d58ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff50065000 1 --2- 172.21.15.173:0/2460984567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d54360 0x563ed6d58ed0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7eff400efe00 tx=0x7eff40121430 comp rx=0 tx=0).stop 2024-04-25T09:05:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff50065000 1 -- 172.21.15.173:0/2460984567 shutdown_connections 2024-04-25T09:05:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff50065000 1 --2- 172.21.15.173:0/2460984567 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x563ed6d59800 0x563ed6d59c10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff50065000 1 --2- 172.21.15.173:0/2460984567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ed6d54360 0x563ed6d58ed0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff50065000 1 --2- 172.21.15.173:0/2460984567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563ed6d53a40 0x563ed6db49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff50065000 1 --2- 172.21.15.173:0/2460984567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563ed6d0ed90 0x563ed6db44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff2b400640 0 client.5586 ms_handle_reset on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:05.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff50065000 1 -- 172.21.15.173:0/2460984567 >> 172.21.15.173:0/2460984567 conn(0x563ed6d0ad40 msgr2=0x563ed6d52980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff50065000 1 -- 172.21.15.173:0/2460984567 shutdown_connections 2024-04-25T09:05:05.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff50065000 1 -- 172.21.15.173:0/2460984567 wait complete. 2024-04-25T09:05:05.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff50065000 20 client.5586 trim_cache size 0 max 16384 2024-04-25T09:05:05.153 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:05:05.153 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T09:05:05.153 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 2462, 2024-04-25T09:05:05.154 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 2463, 2024-04-25T09:05:05.154 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 614730, 2024-04-25T09:05:05.154 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 38183568, 2024-04-25T09:05:05.154 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 9, 2024-04-25T09:05:05.154 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 3, 2024-04-25T09:05:05.154 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.307179043, 2024-04-25T09:05:05.154 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.155625614, 2024-04-25T09:05:05.154 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.056931845, 2024-04-25T09:05:05.154 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.069882793, 2024-04-25T09:05:05.154 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T09:05:05.154 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2461, 2024-04-25T09:05:05.154 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.419917549, 2024-04-25T09:05:05.155 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000170628 2024-04-25T09:05:05.155 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.155 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-04-25T09:05:05.155 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2, 2024-04-25T09:05:05.155 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000245, 2024-04-25T09:05:05.155 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000122 2024-04-25T09:05:05.155 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.155 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T09:05:05.155 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T09:05:05.155 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.155 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T09:05:05.155 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 1676, 2024-04-25T09:05:05.155 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 1692, 2024-04-25T09:05:05.156 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 418262, 2024-04-25T09:05:05.156 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 21547488, 2024-04-25T09:05:05.156 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 6, 2024-04-25T09:05:05.156 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 4, 2024-04-25T09:05:05.156 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.207580095, 2024-04-25T09:05:05.156 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.105115883, 2024-04-25T09:05:05.156 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.038180590, 2024-04-25T09:05:05.156 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.052884068, 2024-04-25T09:05:05.156 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T09:05:05.156 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1690, 2024-04-25T09:05:05.156 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.261347605, 2024-04-25T09:05:05.156 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000154643 2024-04-25T09:05:05.156 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.157 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-04-25T09:05:05.157 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.157 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.157 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.157 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.157 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-25T09:05:05.157 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 108544 2024-04-25T09:05:05.157 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.157 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T09:05:05.157 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 30647, 2024-04-25T09:05:05.157 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 51584, 2024-04-25T09:05:05.157 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 10781968, 2024-04-25T09:05:05.157 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 54496083, 2024-04-25T09:05:05.157 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 7, 2024-04-25T09:05:05.158 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 4, 2024-04-25T09:05:05.158 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 3.954207870, 2024-04-25T09:05:05.158 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 2.674027854, 2024-04-25T09:05:05.158 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 1.096881779, 2024-04-25T09:05:05.158 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.379883889, 2024-04-25T09:05:05.158 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T09:05:05.158 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 51584, 2024-04-25T09:05:05.158 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.656110369, 2024-04-25T09:05:05.158 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000032105 2024-04-25T09:05:05.158 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.158 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-04-25T09:05:05.159 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 47464, 2024-04-25T09:05:05.159 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.009108539, 2024-04-25T09:05:05.159 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000191 2024-04-25T09:05:05.159 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.159 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 116880, 2024-04-25T09:05:05.159 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 19920 2024-04-25T09:05:05.159 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.159 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-04-25T09:05:05.159 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-04-25T09:05:05.159 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-04-25T09:05:05.159 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.159 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-04-25T09:05:05.159 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-04-25T09:05:05.160 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-04-25T09:05:05.160 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4289, 2024-04-25T09:05:05.160 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 13.036016152, 2024-04-25T09:05:05.160 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.003039406 2024-04-25T09:05:05.160 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:05.160 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.160 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-04-25T09:05:05.160 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-04-25T09:05:05.160 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-04-25T09:05:05.160 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2001, 2024-04-25T09:05:05.160 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.719172581, 2024-04-25T09:05:05.160 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000359406 2024-04-25T09:05:05.160 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:05.161 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.161 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-04-25T09:05:05.161 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 26223, 2024-04-25T09:05:05.161 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 26223, 2024-04-25T09:05:05.161 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-04-25T09:05:05.161 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 26223, 2024-04-25T09:05:05.161 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 261.042580101, 2024-04-25T09:05:05.161 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.009954718 2024-04-25T09:05:05.161 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.161 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-04-25T09:05:05.161 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 0, 2024-04-25T09:05:05.161 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-04-25T09:05:05.161 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-04-25T09:05:05.162 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 12, 2024-04-25T09:05:05.162 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 0, 2024-04-25T09:05:05.162 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-04-25T09:05:05.162 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 19702, 2024-04-25T09:05:05.162 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 0, 2024-04-25T09:05:05.162 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 19702, 2024-04-25T09:05:05.162 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 0, 2024-04-25T09:05:05.162 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 19702, 2024-04-25T09:05:05.162 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 0, 2024-04-25T09:05:05.162 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 56, 2024-04-25T09:05:05.162 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 56, 2024-04-25T09:05:05.162 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 2, 2024-04-25T09:05:05.163 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 48845, 2024-04-25T09:05:05.163 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 48339, 2024-04-25T09:05:05.163 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 0, 2024-04-25T09:05:05.163 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 0, 2024-04-25T09:05:05.163 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-04-25T09:05:05.163 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-04-25T09:05:05.163 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 145, 2024-04-25T09:05:05.163 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 0, 2024-04-25T09:05:05.163 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 0, 2024-04-25T09:05:05.163 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 0, 2024-04-25T09:05:05.163 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 0, 2024-04-25T09:05:05.163 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 0, 2024-04-25T09:05:05.164 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 0, 2024-04-25T09:05:05.164 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-04-25T09:05:05.164 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 0, 2024-04-25T09:05:05.164 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-04-25T09:05:05.164 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 0, 2024-04-25T09:05:05.164 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 0, 2024-04-25T09:05:05.164 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 0, 2024-04-25T09:05:05.164 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T09:05:05.164 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-04-25T09:05:05.164 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T09:05:05.164 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-04-25T09:05:05.164 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2024-04-25T09:05:05.164 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T09:05:05.165 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T09:05:05.165 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 0, 2024-04-25T09:05:05.165 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 0, 2024-04-25T09:05:05.165 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 1505, 2024-04-25T09:05:05.165 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 4057, 2024-04-25T09:05:05.165 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T09:05:05.165 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T09:05:05.165 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T09:05:05.165 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 4541, 2024-04-25T09:05:05.165 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 2000, 2024-04-25T09:05:05.165 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 32, 2024-04-25T09:05:05.165 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 14085 2024-04-25T09:05:05.166 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.166 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-04-25T09:05:05.166 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 0, 2024-04-25T09:05:05.166 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 0, 2024-04-25T09:05:05.166 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 0, 2024-04-25T09:05:05.166 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 0, 2024-04-25T09:05:05.166 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 0, 2024-04-25T09:05:05.166 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 2000, 2024-04-25T09:05:05.166 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 164, 2024-04-25T09:05:05.166 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-04-25T09:05:05.166 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 4098, 2024-04-25T09:05:05.167 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 1784, 2024-04-25T09:05:05.167 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 2198, 2024-04-25T09:05:05.167 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-04-25T09:05:05.167 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-04-25T09:05:05.167 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-04-25T09:05:05.167 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-04-25T09:05:05.167 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-04-25T09:05:05.167 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-04-25T09:05:05.167 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T09:05:05.167 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 0, 2024-04-25T09:05:05.167 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-04-25T09:05:05.167 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 0, 2024-04-25T09:05:05.167 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-04-25T09:05:05.167 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2024-04-25T09:05:05.168 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.168 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-04-25T09:05:05.168 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-04-25T09:05:05.168 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 27808, 2024-04-25T09:05:05.168 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-04-25T09:05:05.168 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-04-25T09:05:05.168 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 27808, 2024-04-25T09:05:05.168 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-04-25T09:05:05.168 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-04-25T09:05:05.169 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 44, 2024-04-25T09:05:05.169 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-04-25T09:05:05.169 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-04-25T09:05:05.169 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 44, 2024-04-25T09:05:05.169 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 4, 2024-04-25T09:05:05.169 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-04-25T09:05:05.169 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-04-25T09:05:05.169 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-04-25T09:05:05.170 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 94206611, 2024-04-25T09:05:05.170 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 0, 2024-04-25T09:05:05.170 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-04-25T09:05:05.170 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4036, 2024-04-25T09:05:05.170 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 78.311998021, 2024-04-25T09:05:05.170 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.019403369 2024-04-25T09:05:05.170 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.170 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 0 2024-04-25T09:05:05.171 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.171 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-04-25T09:05:05.171 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 2014, 2024-04-25T09:05:05.171 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 2014, 2024-04-25T09:05:05.171 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 0, 2024-04-25T09:05:05.171 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 13, 2024-04-25T09:05:05.171 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 13, 2024-04-25T09:05:05.171 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 0, 2024-04-25T09:05:05.172 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 19702, 2024-04-25T09:05:05.172 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 19703, 2024-04-25T09:05:05.172 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 1, 2024-04-25T09:05:05.172 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 56, 2024-04-25T09:05:05.172 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 4246, 2024-04-25T09:05:05.172 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 4190, 2024-04-25T09:05:05.172 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 110308, 2024-04-25T09:05:05.172 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 215340 2024-04-25T09:05:05.172 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.172 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-04-25T09:05:05.173 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 29706, 2024-04-25T09:05:05.173 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 0, 2024-04-25T09:05:05.173 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 26223, 2024-04-25T09:05:05.173 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 4, 2024-04-25T09:05:05.173 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 0, 2024-04-25T09:05:05.173 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-04-25T09:05:05.173 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2000, 2024-04-25T09:05:05.173 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.563032377, 2024-04-25T09:05:05.173 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000781516 2024-04-25T09:05:05.173 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.173 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-04-25T09:05:05.173 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 28, 2024-04-25T09:05:05.173 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.003836368, 2024-04-25T09:05:05.174 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000137013 2024-04-25T09:05:05.174 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.174 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-04-25T09:05:05.174 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.174 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.174 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.174 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.174 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-04-25T09:05:05.174 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 6000, 2024-04-25T09:05:05.174 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 6.975819789, 2024-04-25T09:05:05.174 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001162636 2024-04-25T09:05:05.174 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.174 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-04-25T09:05:05.175 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 7984, 2024-04-25T09:05:05.175 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 6.729171664, 2024-04-25T09:05:05.175 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000842832 2024-04-25T09:05:05.175 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.175 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-04-25T09:05:05.175 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.175 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.175 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.175 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.175 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-04-25T09:05:05.175 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.176 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.176 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.176 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.176 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-04-25T09:05:05.176 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.176 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.176 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.176 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.176 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-04-25T09:05:05.176 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.176 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.176 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.177 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.177 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-04-25T09:05:05.177 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:05:05.177 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000095606, 2024-04-25T09:05:05.177 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000095606 2024-04-25T09:05:05.177 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.177 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-04-25T09:05:05.177 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.177 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.177 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.177 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.177 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-04-25T09:05:05.178 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:05:05.178 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.003596449, 2024-04-25T09:05:05.178 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.003596449 2024-04-25T09:05:05.178 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.178 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-04-25T09:05:05.178 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.178 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.178 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.178 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.178 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-04-25T09:05:05.179 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:05:05.179 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.006353185, 2024-04-25T09:05:05.179 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.006353185 2024-04-25T09:05:05.179 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.179 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-04-25T09:05:05.179 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.179 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.179 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.179 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.179 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-04-25T09:05:05.179 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 8, 2024-04-25T09:05:05.179 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.092922705, 2024-04-25T09:05:05.180 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.011615338 2024-04-25T09:05:05.180 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.180 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-04-25T09:05:05.180 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2198, 2024-04-25T09:05:05.180 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 229.099545519, 2024-04-25T09:05:05.180 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.104230912 2024-04-25T09:05:05.180 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.180 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-04-25T09:05:05.180 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.180 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.180 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.180 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.181 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-04-25T09:05:05.181 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.181 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.181 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.181 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.181 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-04-25T09:05:05.181 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.181 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.181 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.181 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.181 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-04-25T09:05:05.181 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:05:05.182 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.009876617, 2024-04-25T09:05:05.182 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.009876617 2024-04-25T09:05:05.182 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.182 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-04-25T09:05:05.182 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.182 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.182 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.182 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.182 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-04-25T09:05:05.182 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:05:05.182 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000274790, 2024-04-25T09:05:05.182 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000274790 2024-04-25T09:05:05.183 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.183 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-04-25T09:05:05.183 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.183 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.183 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.183 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.183 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-04-25T09:05:05.183 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.183 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.183 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.183 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.183 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-04-25T09:05:05.184 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.184 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.184 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.184 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.184 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-04-25T09:05:05.184 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.184 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.184 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.184 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.184 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-04-25T09:05:05.184 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.185 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.185 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.185 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.185 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-04-25T09:05:05.185 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 8000, 2024-04-25T09:05:05.185 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 16.558055032, 2024-04-25T09:05:05.185 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.002069756 2024-04-25T09:05:05.185 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.185 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-04-25T09:05:05.185 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-04-25T09:05:05.185 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-04-25T09:05:05.185 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.185 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.185 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.186 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:05.186 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.186 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-04-25T09:05:05.186 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 1, 2024-04-25T09:05:05.186 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 1, 2024-04-25T09:05:05.186 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 0, 2024-04-25T09:05:05.186 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 1, 2024-04-25T09:05:05.186 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-04-25T09:05:05.186 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 18899, 2024-04-25T09:05:05.186 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 18899, 2024-04-25T09:05:05.186 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 46, 2024-04-25T09:05:05.186 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-04-25T09:05:05.187 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.187 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-04-25T09:05:05.187 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-04-25T09:05:05.187 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-04-25T09:05:05.187 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T09:05:05.187 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-04-25T09:05:05.187 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T09:05:05.187 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-04-25T09:05:05.187 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T09:05:05.187 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T09:05:05.188 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T09:05:05.188 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T09:05:05.188 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T09:05:05.188 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-04-25T09:05:05.188 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T09:05:05.188 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T09:05:05.188 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-04-25T09:05:05.188 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-04-25T09:05:05.188 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-04-25T09:05:05.189 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-04-25T09:05:05.189 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T09:05:05.189 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T09:05:05.189 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T09:05:05.189 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T09:05:05.189 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T09:05:05.189 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-04-25T09:05:05.189 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-04-25T09:05:05.190 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-04-25T09:05:05.190 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T09:05:05.190 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T09:05:05.190 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-04-25T09:05:05.190 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-04-25T09:05:05.190 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-04-25T09:05:05.190 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-04-25T09:05:05.191 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T09:05:05.191 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-04-25T09:05:05.191 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T09:05:05.191 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-04-25T09:05:05.191 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 18945304, 2024-04-25T09:05:05.191 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 4847, 2024-04-25T09:05:05.191 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-04-25T09:05:05.191 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-04-25T09:05:05.192 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-04-25T09:05:05.192 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-04-25T09:05:05.192 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-04-25T09:05:05.192 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-04-25T09:05:05.192 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-04-25T09:05:05.192 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-04-25T09:05:05.192 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 5520, 2024-04-25T09:05:05.192 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 78, 2024-04-25T09:05:05.192 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T09:05:05.192 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-04-25T09:05:05.192 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-04-25T09:05:05.192 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-04-25T09:05:05.192 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 20209772, 2024-04-25T09:05:05.193 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 797932, 2024-04-25T09:05:05.193 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-04-25T09:05:05.193 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-04-25T09:05:05.193 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-04-25T09:05:05.193 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-04-25T09:05:05.193 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.193 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-04-25T09:05:05.193 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-04-25T09:05:05.193 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-04-25T09:05:05.193 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 6008, 2024-04-25T09:05:05.193 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 90427621, 2024-04-25T09:05:05.193 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 37, 2024-04-25T09:05:05.193 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 6008, 2024-04-25T09:05:05.194 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-04-25T09:05:05.194 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 6008, 2024-04-25T09:05:05.194 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 29.983415177, 2024-04-25T09:05:05.194 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.004990581 2024-04-25T09:05:05.194 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.194 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-04-25T09:05:05.194 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-04-25T09:05:05.194 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 6008, 2024-04-25T09:05:05.194 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 6102 2024-04-25T09:05:05.194 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.194 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 6008, 2024-04-25T09:05:05.194 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 30, 2024-04-25T09:05:05.194 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 5978, 2024-04-25T09:05:05.195 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-04-25T09:05:05.195 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-04-25T09:05:05.195 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 0, 2024-04-25T09:05:05.195 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 11, 2024-04-25T09:05:05.195 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 30, 2024-04-25T09:05:05.195 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 4066, 2024-04-25T09:05:05.195 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 22, 2024-04-25T09:05:05.195 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-04-25T09:05:05.195 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-04-25T09:05:05.195 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 1784, 2024-04-25T09:05:05.195 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 0, 2024-04-25T09:05:05.195 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 33, 2024-04-25T09:05:05.195 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-04-25T09:05:05.196 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-04-25T09:05:05.196 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-04-25T09:05:05.196 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 0, 2024-04-25T09:05:05.196 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 22, 2024-04-25T09:05:05.196 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-04-25T09:05:05.196 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-04-25T09:05:05.196 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-04-25T09:05:05.196 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-04-25T09:05:05.196 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-04-25T09:05:05.196 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-04-25T09:05:05.196 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T09:05:05.196 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-04-25T09:05:05.196 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-04-25T09:05:05.197 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-04-25T09:05:05.197 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-04-25T09:05:05.197 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-04-25T09:05:05.197 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-04-25T09:05:05.197 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-04-25T09:05:05.197 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-04-25T09:05:05.197 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-04-25T09:05:05.197 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-04-25T09:05:05.197 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-04-25T09:05:05.197 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-04-25T09:05:05.197 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-04-25T09:05:05.197 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-04-25T09:05:05.198 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-04-25T09:05:05.198 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-04-25T09:05:05.198 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-04-25T09:05:05.198 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-04-25T09:05:05.198 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-04-25T09:05:05.198 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 42, 2024-04-25T09:05:05.198 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-04-25T09:05:05.198 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 3, 2024-04-25T09:05:05.198 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 8, 2024-04-25T09:05:05.198 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 8, 2024-04-25T09:05:05.198 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-04-25T09:05:05.198 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-04-25T09:05:05.198 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 105, 2024-04-25T09:05:05.199 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 0, 2024-04-25T09:05:05.199 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 29 2024-04-25T09:05:05.199 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.199 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-04-25T09:05:05.199 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 1, 2024-04-25T09:05:05.199 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-04-25T09:05:05.199 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-04-25T09:05:05.199 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-04-25T09:05:05.199 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.199 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2024-04-25T09:05:05.199 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 0 2024-04-25T09:05:05.199 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.199 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-04-25T09:05:05.200 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-04-25T09:05:05.200 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 32, 2024-04-25T09:05:05.200 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-04-25T09:05:05.200 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 32, 2024-04-25T09:05:05.200 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 1784, 2024-04-25T09:05:05.200 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 1784, 2024-04-25T09:05:05.200 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-04-25T09:05:05.200 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.200 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T09:05:05.200 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-04-25T09:05:05.200 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-04-25T09:05:05.200 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:05:05.201 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 34781, 2024-04-25T09:05:05.201 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 9138765, 2024-04-25T09:05:05.201 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:05:05.201 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 34781, 2024-04-25T09:05:05.201 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-04-25T09:05:05.201 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-04-25T09:05:05.201 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 34781, 2024-04-25T09:05:05.201 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 9138765, 2024-04-25T09:05:05.201 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:05:05.201 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.201 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.201 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.201 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:05.202 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.202 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-04-25T09:05:05.202 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-04-25T09:05:05.202 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-04-25T09:05:05.202 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:05:05.202 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-04-25T09:05:05.202 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-04-25T09:05:05.202 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:05:05.202 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-04-25T09:05:05.202 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 6008, 2024-04-25T09:05:05.202 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 90622077, 2024-04-25T09:05:05.202 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 6008, 2024-04-25T09:05:05.203 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 90622077, 2024-04-25T09:05:05.203 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:05:05.203 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.203 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.203 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.203 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:05.203 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.203 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-04-25T09:05:05.203 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-04-25T09:05:05.203 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-04-25T09:05:05.203 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:05:05.203 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-04-25T09:05:05.203 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-04-25T09:05:05.204 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:05:05.204 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-04-25T09:05:05.204 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 6008, 2024-04-25T09:05:05.204 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 6008, 2024-04-25T09:05:05.204 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 6008, 2024-04-25T09:05:05.204 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 6008, 2024-04-25T09:05:05.204 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:05:05.204 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.204 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.204 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.204 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:05.204 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.204 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-04-25T09:05:05.204 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-04-25T09:05:05.205 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-04-25T09:05:05.205 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:05:05.205 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 1784, 2024-04-25T09:05:05.205 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 194456, 2024-04-25T09:05:05.205 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:05:05.205 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 1784, 2024-04-25T09:05:05.205 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-04-25T09:05:05.205 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-04-25T09:05:05.206 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 30, 2024-04-25T09:05:05.206 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 194456, 2024-04-25T09:05:05.206 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:05:05.206 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.206 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.206 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.206 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:05.206 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:05.207 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x555b9eb2aa00": { 2024-04-25T09:05:05.207 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 84, 2024-04-25T09:05:05.207 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-04-25T09:05:05.207 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:05:05.207 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 27808, 2024-04-25T09:05:05.207 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 90012307, 2024-04-25T09:05:05.207 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:05:05.207 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 27808, 2024-04-25T09:05:05.208 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-04-25T09:05:05.208 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-04-25T09:05:05.208 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 4036, 2024-04-25T09:05:05.208 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 90012223, 2024-04-25T09:05:05.208 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:05:05.208 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:05.208 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:05.208 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:05.208 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:05.209 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:05.209 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:05:05.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff4cc00640 1 -- 172.21.15.173:0/3869050541 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7eff24066f60 msgr2=0x7eff24069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff4cc00640 1 --2- 172.21.15.173:0/3869050541 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7eff24066f60 0x7eff24069420 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7eff38005dc0 tx=0x7eff38009330 comp rx=0 tx=0).stop 2024-04-25T09:05:05.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff4cc00640 1 -- 172.21.15.173:0/3869050541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4816a900 msgr2=0x7eff4816d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff4cc00640 1 --2- 172.21.15.173:0/3869050541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4816a900 0x7eff4816d760 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7eff4001d1d0 tx=0x7eff40008740 comp rx=0 tx=0).stop 2024-04-25T09:05:05.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff4cc00640 1 -- 172.21.15.173:0/3869050541 shutdown_connections 2024-04-25T09:05:05.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff4cc00640 1 --2- 172.21.15.173:0/3869050541 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7eff24066f60 0x7eff24069420 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff4cc00640 1 --2- 172.21.15.173:0/3869050541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4816a900 0x7eff4816d760 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff4cc00640 1 --2- 172.21.15.173:0/3869050541 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff4808a8b0 0x7eff4816d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff4cc00640 1 --2- 172.21.15.173:0/3869050541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff4806e5a0 0x7eff4815e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff4cc00640 1 -- 172.21.15.173:0/3869050541 >> 172.21.15.173:0/3869050541 conn(0x7eff4806ac90 msgr2=0x7eff48161190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff4cc00640 1 -- 172.21.15.173:0/3869050541 shutdown_connections 2024-04-25T09:05:05.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.156+0000 7eff4cc00640 1 -- 172.21.15.173:0/3869050541 wait complete. 2024-04-25T09:05:05.213 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-04-25T09:05:05.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:05.213 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive,scrub_mdsdir 2024-04-25T09:05:05.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb96a200640 1 Processor -- start 2024-04-25T09:05:05.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb96a200640 1 -- start start 2024-04-25T09:05:05.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb96a200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb96415f060 0x7fb9640b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb96a200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9640b1530 con 0x7fb9640b2910 2024-04-25T09:05:05.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb96a200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9640cfd60 con 0x7fb96409aa60 2024-04-25T09:05:05.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb96a200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9640d0040 con 0x7fb96415f060 2024-04-25T09:05:05.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb95be00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fb9640b2910 0x7fb9640ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46704/0 (socket says 172.21.15.173:46704) 2024-04-25T09:05:05.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb95be00640 1 -- 172.21.15.173:0/1610975667 learned_addr learned my addr 172.21.15.173:0/1610975667 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:05.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb968e00640 1 --2- 172.21.15.173:0/1610975667 >> v2:172.21.15.194:3300/0 conn(0x7fb96415f060 0x7fb9640b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb963e00640 1 -- 172.21.15.173:0/1610975667 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562429333 0 0) 0x7fb9640b1530 con 0x7fb9640b2910 2024-04-25T09:05:05.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb963e00640 1 -- 172.21.15.173:0/1610975667 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb948003530 con 0x7fb9640b2910 2024-04-25T09:05:05.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb963e00640 1 -- 172.21.15.173:0/1610975667 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3756489961 0 0) 0x7fb948003530 con 0x7fb9640b2910 2024-04-25T09:05:05.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb963e00640 1 -- 172.21.15.173:0/1610975667 >> v2:172.21.15.194:3300/0 conn(0x7fb96415f060 msgr2=0x7fb9640b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb963e00640 1 --2- 172.21.15.173:0/1610975667 >> v2:172.21.15.194:3300/0 conn(0x7fb96415f060 0x7fb9640b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb963e00640 1 -- 172.21.15.173:0/1610975667 >> v1:172.21.15.194:6789/0 conn(0x7fb96409aa60 legacy=0x7fb96415f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb963e00640 1 -- 172.21.15.173:0/1610975667 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9640cf350 con 0x7fb9640b2910 2024-04-25T09:05:05.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb963e00640 1 -- 172.21.15.173:0/1610975667 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fb94c001680 con 0x7fb9640b2910 2024-04-25T09:05:05.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb963e00640 1 -- 172.21.15.173:0/1610975667 >> v1:172.21.15.173:6789/0 conn(0x7fb9640b2910 legacy=0x7fb9640ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb963e00640 1 --2- 172.21.15.173:0/1610975667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb948003a10 0x7fb948003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb963e00640 1 --2- 172.21.15.173:0/1610975667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb948004810 0x7fb948004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb963e00640 1 --2- 172.21.15.173:0/1610975667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb948005220 0x7fb94800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb963e00640 1 -- 172.21.15.173:0/1610975667 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640d0040 con 0x7fb948005220 2024-04-25T09:05:05.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb963e00640 1 -- 172.21.15.173:0/1610975667 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94800c170 con 0x7fb948003a10 2024-04-25T09:05:05.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb963e00640 1 -- 172.21.15.173:0/1610975667 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94800c370 con 0x7fb948004810 2024-04-25T09:05:05.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb969800640 1 --2- 172.21.15.173:0/1610975667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb948005220 0x7fb94800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb968e00640 1 --2- 172.21.15.173:0/1610975667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb948003a10 0x7fb948003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb95be00640 1 --2- 172.21.15.173:0/1610975667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb948004810 0x7fb948004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb969800640 1 -- 172.21.15.173:0/1610975667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb948004810 msgr2=0x7fb948004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb969800640 1 --2- 172.21.15.173:0/1610975667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb948004810 0x7fb948004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb969800640 1 -- 172.21.15.173:0/1610975667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb948003a10 msgr2=0x7fb948003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb969800640 1 --2- 172.21.15.173:0/1610975667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb948003a10 0x7fb948003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.384+0000 7fb969800640 1 -- 172.21.15.173:0/1610975667 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb948003530 con 0x7fb948005220 2024-04-25T09:05:05.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.388+0000 7fb969800640 1 -- 172.21.15.173:0/1610975667 reap_dead start 2024-04-25T09:05:05.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.388+0000 7fb969800640 1 --2- 172.21.15.173:0/1610975667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb948005220 0x7fb94800b9d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb95c001e40 tx=0x7fb95c01c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ef622d6e7373f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.388+0000 7fb963e00640 1 -- 172.21.15.173:0/1610975667 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c001a90 con 0x7fb948005220 2024-04-25T09:05:05.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.388+0000 7fb963e00640 1 -- 172.21.15.173:0/1610975667 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c003b80 con 0x7fb948005220 2024-04-25T09:05:05.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.388+0000 7fb963e00640 1 -- 172.21.15.173:0/1610975667 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0050d0 con 0x7fb948005220 2024-04-25T09:05:05.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.388+0000 7fb96a200640 1 -- 172.21.15.173:0/1610975667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb948005220 msgr2=0x7fb94800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.388+0000 7fb96a200640 1 --2- 172.21.15.173:0/1610975667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb948005220 0x7fb94800b9d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb95c001e40 tx=0x7fb95c01c740 comp rx=0 tx=0).stop 2024-04-25T09:05:05.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.388+0000 7fb96a200640 1 -- 172.21.15.173:0/1610975667 shutdown_connections 2024-04-25T09:05:05.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.388+0000 7fb96a200640 1 --2- 172.21.15.173:0/1610975667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb948005220 0x7fb94800b9d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.388+0000 7fb96a200640 1 -- 172.21.15.173:0/1610975667 >> 172.21.15.173:0/1610975667 conn(0x7fb9640b31d0 msgr2=0x7fb9640b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.388+0000 7fb96a200640 1 -- 172.21.15.173:0/1610975667 shutdown_connections 2024-04-25T09:05:05.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.388+0000 7fb96a200640 1 -- 172.21.15.173:0/1610975667 wait complete. 2024-04-25T09:05:05.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb96a200640 1 Processor -- start 2024-04-25T09:05:05.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb96a200640 1 -- start start 2024-04-25T09:05:05.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb96a200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb948005220 0x7fb9641f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb96a200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9640b5260 0x7fb9640b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb96a200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9641e6b20 0x7fb9641e6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb96a200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640cf870 con 0x7fb9641e6b20 2024-04-25T09:05:05.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb96a200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640b2ed0 con 0x7fb948005220 2024-04-25T09:05:05.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb96a200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640c5b70 con 0x7fb9640b5260 2024-04-25T09:05:05.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb969800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9641e6b20 0x7fb9641e6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb969800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9641e6b20 0x7fb9641e6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43124/0 (socket says 172.21.15.173:43124) 2024-04-25T09:05:05.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb969800640 1 -- 172.21.15.173:0/3974802252 learned_addr learned my addr 172.21.15.173:0/3974802252 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:05.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb95be00640 1 --2- 172.21.15.173:0/3974802252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9640b5260 0x7fb9640b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb968e00640 1 --2- 172.21.15.173:0/3974802252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb948005220 0x7fb9641f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb969800640 1 -- 172.21.15.173:0/3974802252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9640b5260 msgr2=0x7fb9640b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb969800640 1 --2- 172.21.15.173:0/3974802252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9640b5260 0x7fb9640b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb969800640 1 -- 172.21.15.173:0/3974802252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb948005220 msgr2=0x7fb9641f14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb969800640 1 --2- 172.21.15.173:0/3974802252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb948005220 0x7fb9641f14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb969800640 1 -- 172.21.15.173:0/3974802252 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9640c6bd0 con 0x7fb9641e6b20 2024-04-25T09:05:05.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb969800640 1 --2- 172.21.15.173:0/3974802252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9641e6b20 0x7fb9641e6fb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb95c01cfe0 tx=0x7fb948005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb961600640 1 -- 172.21.15.173:0/3974802252 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c007dc0 con 0x7fb9641e6b20 2024-04-25T09:05:05.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb961600640 1 -- 172.21.15.173:0/3974802252 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c0012e0 con 0x7fb9641e6b20 2024-04-25T09:05:05.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb961600640 1 -- 172.21.15.173:0/3974802252 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c006d60 con 0x7fb9641e6b20 2024-04-25T09:05:05.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb96a200640 1 -- 172.21.15.173:0/3974802252 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9640c5e10 con 0x7fb9641e6b20 2024-04-25T09:05:05.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.392+0000 7fb96a200640 1 -- 172.21.15.173:0/3974802252 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9640c63d0 con 0x7fb9641e6b20 2024-04-25T09:05:05.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.396+0000 7fb961600640 1 -- 172.21.15.173:0/3974802252 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb95c0bb060 con 0x7fb9641e6b20 2024-04-25T09:05:05.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.396+0000 7fb961600640 1 --2- 172.21.15.173:0/3974802252 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb940066f60 0x7fb940069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.396+0000 7fb961600640 1 -- 172.21.15.173:0/3974802252 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fb95c11e820 con 0x7fb9641e6b20 2024-04-25T09:05:05.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.396+0000 7fb968e00640 1 --2- 172.21.15.173:0/3974802252 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb940066f60 0x7fb940069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.396+0000 7fb96ec75000 1 Processor -- start 2024-04-25T09:05:05.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.396+0000 7fb96ec75000 1 -- start start 2024-04-25T09:05:05.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.396+0000 7fb968e00640 1 --2- 172.21.15.173:0/3974802252 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb940066f60 0x7fb940069420 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb954009aa0 tx=0x7fb954008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c8b20 0x5623cc7c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc7c9440 0x5623cc77f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc77fd80 0x5623cc780160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623cc5c8d00 con 0x5623cc7c8b20 2024-04-25T09:05:05.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623cc550df0 con 0x5623cc7c9440 2024-04-25T09:05:05.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623cc5c4da0 con 0x5623cc77fd80 2024-04-25T09:05:05.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb968e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c8b20 0x5623cc7c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb968e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c8b20 0x5623cc7c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43130/0 (socket says 172.21.15.173:43130) 2024-04-25T09:05:05.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb968e00640 1 -- 172.21.15.173:0/4132907520 learned_addr learned my addr 172.21.15.173:0/4132907520 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:05.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb95be00640 1 --2- 172.21.15.173:0/4132907520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc7c9440 0x5623cc77f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb969800640 1 --2- 172.21.15.173:0/4132907520 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc77fd80 0x5623cc780160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb968e00640 1 -- 172.21.15.173:0/4132907520 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc77fd80 msgr2=0x5623cc780160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb968e00640 1 --2- 172.21.15.173:0/4132907520 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc77fd80 0x5623cc780160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb968e00640 1 -- 172.21.15.173:0/4132907520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc7c9440 msgr2=0x5623cc77f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb968e00640 1 --2- 172.21.15.173:0/4132907520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc7c9440 0x5623cc77f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb968e00640 1 -- 172.21.15.173:0/4132907520 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623cc583580 con 0x5623cc7c8b20 2024-04-25T09:05:05.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb968e00640 1 --2- 172.21.15.173:0/4132907520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c8b20 0x5623cc7c8f00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb954014de0 tx=0x7fb954017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebddd7c4b38db060 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb959600640 1 -- 172.21.15.173:0/4132907520 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954027070 con 0x5623cc7c8b20 2024-04-25T09:05:05.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb959600640 1 -- 172.21.15.173:0/4132907520 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb954023450 con 0x5623cc7c8b20 2024-04-25T09:05:05.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb959600640 1 -- 172.21.15.173:0/4132907520 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954009710 con 0x5623cc7c8b20 2024-04-25T09:05:05.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 -- 172.21.15.173:0/4132907520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c8b20 msgr2=0x5623cc7c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 --2- 172.21.15.173:0/4132907520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c8b20 0x5623cc7c8f00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb954014de0 tx=0x7fb954017000 comp rx=0 tx=0).stop 2024-04-25T09:05:05.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 -- 172.21.15.173:0/4132907520 shutdown_connections 2024-04-25T09:05:05.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 --2- 172.21.15.173:0/4132907520 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc77fd80 0x5623cc780160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 --2- 172.21.15.173:0/4132907520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc7c9440 0x5623cc77f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 --2- 172.21.15.173:0/4132907520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c8b20 0x5623cc7c8f00 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 -- 172.21.15.173:0/4132907520 >> 172.21.15.173:0/4132907520 conn(0x5623cc662c10 msgr2=0x5623cc779d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 -- 172.21.15.173:0/4132907520 shutdown_connections 2024-04-25T09:05:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 -- 172.21.15.173:0/4132907520 wait complete. 2024-04-25T09:05:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 -- start start 2024-04-25T09:05:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 Processor -- start 2024-04-25T09:05:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc77fd80 0x5623cc7cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc7c8b20 0x5623cc7cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c9440 0x5623cc788600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.400+0000 7fb96ec75000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623cc5616d0 con 0x5623cc7c9440 2024-04-25T09:05:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623cc583950 con 0x5623cc7c8b20 2024-04-25T09:05:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623cc56f8c0 con 0x5623cc77fd80 2024-04-25T09:05:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 10 client.0 _ll_register_callbacks cb 0x5623cc767030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb969800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c9440 0x5623cc788600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb969800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c9440 0x5623cc788600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43138/0 (socket says 172.21.15.173:43138) 2024-04-25T09:05:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb969800640 1 -- 172.21.15.173:0/1590566172 learned_addr learned my addr 172.21.15.173:0/1590566172 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:05.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb968e00640 1 --2- 172.21.15.173:0/1590566172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc77fd80 0x5623cc7cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb95be00640 1 --2- 172.21.15.173:0/1590566172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc7c8b20 0x5623cc7cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb969800640 1 -- 172.21.15.173:0/1590566172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc77fd80 msgr2=0x5623cc7cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb969800640 1 --2- 172.21.15.173:0/1590566172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc77fd80 0x5623cc7cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb969800640 1 -- 172.21.15.173:0/1590566172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc7c8b20 msgr2=0x5623cc7cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb969800640 1 --2- 172.21.15.173:0/1590566172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc7c8b20 0x5623cc7cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb969800640 1 -- 172.21.15.173:0/1590566172 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5623cc565d40 con 0x5623cc7c9440 2024-04-25T09:05:05.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb968e00640 1 --2- 172.21.15.173:0/1590566172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc77fd80 0x5623cc7cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:05.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb969800640 1 --2- 172.21.15.173:0/1590566172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c9440 0x5623cc788600 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb95c11cba0 tx=0x7fb95c0bb410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ddcf7f5f4da664 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb952000640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:05:05.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb952000640 1 -- 172.21.15.173:0/1590566172 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0f30d0 con 0x5623cc7c9440 2024-04-25T09:05:05.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb952000640 1 -- 172.21.15.173:0/1590566172 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fb95c0ee3d0 con 0x5623cc7c9440 2024-04-25T09:05:05.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 1 -- 172.21.15.173:0/1590566172 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb954023450 con 0x5623cc7c9440 2024-04-25T09:05:05.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb952000640 1 -- 172.21.15.173:0/1590566172 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb95c0f7690 con 0x5623cc7c9440 2024-04-25T09:05:05.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 10 client.5598 fetch_fsmap learned FSMap version 19 2024-04-25T09:05:05.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 1 -- 172.21.15.173:0/1590566172 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x5623cc5c3cf0 con 0x5623cc7c9440 2024-04-25T09:05:05.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb952000640 1 -- 172.21.15.173:0/1590566172 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb954023450 con 0x5623cc7c9440 2024-04-25T09:05:05.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb952000640 1 -- 172.21.15.173:0/1590566172 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 19) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb95c0f5060 con 0x5623cc7c9440 2024-04-25T09:05:05.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 10 client.5598 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T09:05:05.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 10 client.5598 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-04-25T09:05:05.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 20 client.5598 populate_metadata read hostname 'smithi173' 2024-04-25T09:05:05.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 1 --2- 172.21.15.173:0/1590566172 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x5623cc789370 0x5623cc789780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 4 client.5598 mds_command: new command op to 5346 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:05.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 1 -- 172.21.15.173:0/1590566172 --> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5623cc5649d0 con 0x5623cc789370 2024-04-25T09:05:05.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb968e00640 1 --2- 172.21.15.173:0/1590566172 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x5623cc789370 0x5623cc789780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb952000640 10 client.5598 ms_handle_connect on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:05.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb968e00640 1 --2- 172.21.15.173:0/1590566172 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x5623cc789370 0x5623cc789780 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4973c28e78067aa2 server_cookie=acb706b61559d0f6 in_seq=0 out_seq=0 2024-04-25T09:05:05.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb952000640 1 -- 172.21.15.173:0/1590566172 <== mds.0 v2:172.21.15.173:6834/960880761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5623cc5649d0 con 0x5623cc789370 2024-04-25T09:05:05.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb952000640 10 client.5598 handle_command_reply: tid=0 2024-04-25T09:05:05.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 1 client.5598 shutdown 2024-04-25T09:05:05.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 1 -- 172.21.15.173:0/1590566172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c9440 msgr2=0x5623cc788600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 1 --2- 172.21.15.173:0/1590566172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c9440 0x5623cc788600 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb95c11cba0 tx=0x7fb95c0bb410 comp rx=0 tx=0).stop 2024-04-25T09:05:05.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 1 -- 172.21.15.173:0/1590566172 shutdown_connections 2024-04-25T09:05:05.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 1 --2- 172.21.15.173:0/1590566172 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x5623cc789370 0x5623cc789780 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 1 --2- 172.21.15.173:0/1590566172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c9440 0x5623cc788600 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 1 --2- 172.21.15.173:0/1590566172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc7c8b20 0x5623cc7cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb952000640 0 client.5598 ms_handle_reset on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:05.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 1 --2- 172.21.15.173:0/1590566172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc77fd80 0x5623cc7cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 1 -- 172.21.15.173:0/1590566172 >> 172.21.15.173:0/1590566172 conn(0x5623cc662c10 msgr2=0x5623cc781100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 1 -- 172.21.15.173:0/1590566172 shutdown_connections 2024-04-25T09:05:05.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 1 -- 172.21.15.173:0/1590566172 wait complete. 2024-04-25T09:05:05.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.404+0000 7fb96ec75000 20 client.5598 trim_cache size 0 max 16384 2024-04-25T09:05:05.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.420+0000 7fb96ec75000 1 Processor -- start 2024-04-25T09:05:05.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.420+0000 7fb96ec75000 1 -- start start 2024-04-25T09:05:05.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.420+0000 7fb96ec75000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc77fd80 0x5623cc77a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.420+0000 7fb96ec75000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc7c8b20 0x5623cc77a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.420+0000 7fb96ec75000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c9440 0x5623cc7cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.420+0000 7fb96ec75000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9641fc520 con 0x5623cc7c9440 2024-04-25T09:05:05.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.420+0000 7fb96ec75000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96406d2e0 con 0x5623cc77fd80 2024-04-25T09:05:05.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.420+0000 7fb96ec75000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640b6490 con 0x5623cc7c8b20 2024-04-25T09:05:05.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.420+0000 7fb969800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c9440 0x5623cc7cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.420+0000 7fb969800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c9440 0x5623cc7cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43154/0 (socket says 172.21.15.173:43154) 2024-04-25T09:05:05.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.420+0000 7fb969800640 1 -- 172.21.15.173:0/2814336201 learned_addr learned my addr 172.21.15.173:0/2814336201 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:05.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb968e00640 1 --2- 172.21.15.173:0/2814336201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc77fd80 0x5623cc77a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb95be00640 1 --2- 172.21.15.173:0/2814336201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc7c8b20 0x5623cc77a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb969800640 1 -- 172.21.15.173:0/2814336201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc7c8b20 msgr2=0x5623cc77a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb969800640 1 --2- 172.21.15.173:0/2814336201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc7c8b20 0x5623cc77a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb969800640 1 -- 172.21.15.173:0/2814336201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc77fd80 msgr2=0x5623cc77a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb969800640 1 --2- 172.21.15.173:0/2814336201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc77fd80 0x5623cc77a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb969800640 1 -- 172.21.15.173:0/2814336201 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623cc7c9270 con 0x5623cc7c9440 2024-04-25T09:05:05.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb968e00640 1 --2- 172.21.15.173:0/2814336201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc77fd80 0x5623cc77a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:05.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb969800640 1 --2- 172.21.15.173:0/2814336201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c9440 0x5623cc7cb830 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb95c11eb40 tx=0x7fb95c103000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e542a5bb61419b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb958c00640 1 -- 172.21.15.173:0/2814336201 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0f30d0 con 0x5623cc7c9440 2024-04-25T09:05:05.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb958c00640 1 -- 172.21.15.173:0/2814336201 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c0f5060 con 0x5623cc7c9440 2024-04-25T09:05:05.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb958c00640 1 -- 172.21.15.173:0/2814336201 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0ee630 con 0x5623cc7c9440 2024-04-25T09:05:05.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb96ec75000 1 -- 172.21.15.173:0/2814336201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c9440 msgr2=0x5623cc7cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb96ec75000 1 --2- 172.21.15.173:0/2814336201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c9440 0x5623cc7cb830 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb95c11eb40 tx=0x7fb95c103000 comp rx=0 tx=0).stop 2024-04-25T09:05:05.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb96ec75000 1 -- 172.21.15.173:0/2814336201 shutdown_connections 2024-04-25T09:05:05.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb96ec75000 1 --2- 172.21.15.173:0/2814336201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc7c9440 0x5623cc7cb830 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb96ec75000 1 --2- 172.21.15.173:0/2814336201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc7c8b20 0x5623cc77a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb96ec75000 1 --2- 172.21.15.173:0/2814336201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc77fd80 0x5623cc77a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb96ec75000 1 -- 172.21.15.173:0/2814336201 >> 172.21.15.173:0/2814336201 conn(0x5623cc662c10 msgr2=0x5623cc7812a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb96ec75000 1 -- 172.21.15.173:0/2814336201 shutdown_connections 2024-04-25T09:05:05.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb96ec75000 1 -- 172.21.15.173:0/2814336201 wait complete. 2024-04-25T09:05:05.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb96ec75000 1 -- start start 2024-04-25T09:05:05.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb96ec75000 1 Processor -- start 2024-04-25T09:05:05.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb96ec75000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc77fd80 0x5623cc829be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb96ec75000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc7c8b20 0x5623cc82c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb96ec75000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc7c9440 0x5623cc82e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb96ec75000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623cc5c8010 con 0x5623cc77fd80 2024-04-25T09:05:05.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb96ec75000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640b6a90 con 0x5623cc7c8b20 2024-04-25T09:05:05.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb96ec75000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623cc784aa0 con 0x5623cc7c9440 2024-04-25T09:05:05.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb96ec75000 10 client.0 _ll_register_callbacks cb 0x7fb95401a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:05.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb968e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc77fd80 0x5623cc829be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb95be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc7c8b20 0x5623cc82c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb968e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc77fd80 0x5623cc829be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43160/0 (socket says 172.21.15.173:43160) 2024-04-25T09:05:05.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb968e00640 1 -- 172.21.15.173:0/1358312482 learned_addr learned my addr 172.21.15.173:0/1358312482 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:05.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb969800640 1 --2- 172.21.15.173:0/1358312482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc7c9440 0x5623cc82e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb95be00640 1 -- 172.21.15.173:0/1358312482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc7c9440 msgr2=0x5623cc82e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb95be00640 1 --2- 172.21.15.173:0/1358312482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc7c9440 0x5623cc82e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb95be00640 1 -- 172.21.15.173:0/1358312482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc77fd80 msgr2=0x5623cc829be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb95be00640 1 --2- 172.21.15.173:0/1358312482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc77fd80 0x5623cc829be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb95be00640 1 -- 172.21.15.173:0/1358312482 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5623cc77fbb0 con 0x5623cc7c8b20 2024-04-25T09:05:05.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.424+0000 7fb968e00640 1 --2- 172.21.15.173:0/1358312482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc77fd80 0x5623cc829be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:05.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb95be00640 1 --2- 172.21.15.173:0/1358312482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc7c8b20 0x5623cc82c130 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb96415a1c0 tx=0x7fb94c005780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=494567c8322ca991 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb952000640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-04-25T09:05:05.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb952000640 1 -- 172.21.15.173:0/1358312482 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c018e20 con 0x5623cc7c8b20 2024-04-25T09:05:05.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb952000640 1 -- 172.21.15.173:0/1358312482 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fb94c024c60 con 0x5623cc7c8b20 2024-04-25T09:05:05.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb96ec75000 1 -- 172.21.15.173:0/1358312482 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb95c0f5060 con 0x5623cc7c8b20 2024-04-25T09:05:05.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb952000640 1 -- 172.21.15.173:0/1358312482 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb94c024e60 con 0x5623cc7c8b20 2024-04-25T09:05:05.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb96ec75000 10 client.5422 fetch_fsmap learned FSMap version 19 2024-04-25T09:05:05.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb96ec75000 1 -- 172.21.15.173:0/1358312482 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x5623cc64bd30 con 0x5623cc7c8b20 2024-04-25T09:05:05.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb952000640 1 -- 172.21.15.173:0/1358312482 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c0f5060 con 0x5623cc7c8b20 2024-04-25T09:05:05.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb952000640 1 -- 172.21.15.173:0/1358312482 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 19) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb94c02b050 con 0x5623cc7c8b20 2024-04-25T09:05:05.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb96ec75000 10 client.5422 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T09:05:05.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb96ec75000 10 client.5422 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-04-25T09:05:05.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb96ec75000 20 client.5422 populate_metadata read hostname 'smithi173' 2024-04-25T09:05:05.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb96ec75000 1 --2- 172.21.15.173:0/1358312482 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x5623cc82ebc0 0x5623cc830fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb96ec75000 4 client.5422 mds_command: new command op to 5346 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}] 2024-04-25T09:05:05.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb96ec75000 1 -- 172.21.15.173:0/1358312482 --> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}) v1 -- 0x5623cc5a5610 con 0x5623cc82ebc0 2024-04-25T09:05:05.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb968e00640 1 --2- 172.21.15.173:0/1358312482 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x5623cc82ebc0 0x5623cc830fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb968e00640 1 --2- 172.21.15.173:0/1358312482 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x5623cc82ebc0 0x5623cc830fb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63974f69b7619f65 server_cookie=b120c797799efb2c in_seq=0 out_seq=0 2024-04-25T09:05:05.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.428+0000 7fb952000640 10 client.5422 ms_handle_connect on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:05.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.432+0000 7fb952000640 1 -- 172.21.15.173:0/1358312482 <== mds.0 v2:172.21.15.173:6834/960880761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5623cc5a5610 con 0x5623cc82ebc0 2024-04-25T09:05:05.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.432+0000 7fb952000640 10 client.5422 handle_command_reply: tid=0 2024-04-25T09:05:05.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.432+0000 7fb96ec75000 1 client.5422 shutdown 2024-04-25T09:05:05.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.432+0000 7fb96ec75000 1 -- 172.21.15.173:0/1358312482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc7c8b20 msgr2=0x5623cc82c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.432+0000 7fb96ec75000 1 --2- 172.21.15.173:0/1358312482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc7c8b20 0x5623cc82c130 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb96415a1c0 tx=0x7fb94c005780 comp rx=0 tx=0).stop 2024-04-25T09:05:05.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.432+0000 7fb96ec75000 1 -- 172.21.15.173:0/1358312482 shutdown_connections 2024-04-25T09:05:05.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.432+0000 7fb96ec75000 1 --2- 172.21.15.173:0/1358312482 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x5623cc82ebc0 0x5623cc830fb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.432+0000 7fb96ec75000 1 --2- 172.21.15.173:0/1358312482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5623cc7c9440 0x5623cc82e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.432+0000 7fb96ec75000 1 --2- 172.21.15.173:0/1358312482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5623cc7c8b20 0x5623cc82c130 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.432+0000 7fb952000640 0 client.5422 ms_handle_reset on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:05.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.432+0000 7fb96ec75000 1 --2- 172.21.15.173:0/1358312482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623cc77fd80 0x5623cc829be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.432+0000 7fb96ec75000 1 -- 172.21.15.173:0/1358312482 >> 172.21.15.173:0/1358312482 conn(0x5623cc662c10 msgr2=0x5623cc779480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.432+0000 7fb96ec75000 1 -- 172.21.15.173:0/1358312482 shutdown_connections 2024-04-25T09:05:05.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.432+0000 7fb96ec75000 1 -- 172.21.15.173:0/1358312482 wait complete. 2024-04-25T09:05:05.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.432+0000 7fb96ec75000 20 client.5422 trim_cache size 0 max 16384 2024-04-25T09:05:05.426 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:05:05.426 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0, 2024-04-25T09:05:05.426 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_tag": "40a0235b-489f-4e6b-9872-d78b11679fa5", 2024-04-25T09:05:05.426 INFO:teuthology.orchestra.run.smithi173.stdout: "mode": "asynchronous" 2024-04-25T09:05:05.426 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:05:05.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.436+0000 7fb96a200640 1 -- 172.21.15.173:0/3974802252 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb940066f60 msgr2=0x7fb940069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.436+0000 7fb96a200640 1 --2- 172.21.15.173:0/3974802252 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb940066f60 0x7fb940069420 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb954009aa0 tx=0x7fb954008040 comp rx=0 tx=0).stop 2024-04-25T09:05:05.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.436+0000 7fb96a200640 1 -- 172.21.15.173:0/3974802252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9641e6b20 msgr2=0x7fb9641e6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.436+0000 7fb96a200640 1 --2- 172.21.15.173:0/3974802252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9641e6b20 0x7fb9641e6fb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb95c01cfe0 tx=0x7fb948005840 comp rx=0 tx=0).stop 2024-04-25T09:05:05.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.436+0000 7fb96a200640 1 -- 172.21.15.173:0/3974802252 shutdown_connections 2024-04-25T09:05:05.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.436+0000 7fb96a200640 1 --2- 172.21.15.173:0/3974802252 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb940066f60 0x7fb940069420 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.436+0000 7fb96a200640 1 --2- 172.21.15.173:0/3974802252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9641e6b20 0x7fb9641e6fb0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.436+0000 7fb96a200640 1 --2- 172.21.15.173:0/3974802252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9640b5260 0x7fb9640b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.436+0000 7fb96a200640 1 --2- 172.21.15.173:0/3974802252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb948005220 0x7fb9641f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.436+0000 7fb96a200640 1 -- 172.21.15.173:0/3974802252 >> 172.21.15.173:0/3974802252 conn(0x7fb9640b31d0 msgr2=0x7fb96415a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.436+0000 7fb96a200640 1 -- 172.21.15.173:0/3974802252 shutdown_connections 2024-04-25T09:05:05.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.436+0000 7fb96a200640 1 -- 172.21.15.173:0/3974802252 wait complete. 2024-04-25T09:05:05.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:05.446 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-04-25T09:05:05.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.644+0000 7f3a63200640 1 Processor -- start 2024-04-25T09:05:05.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.644+0000 7f3a63200640 1 -- start start 2024-04-25T09:05:05.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.644+0000 7f3a63200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3a5c0aef70 0x7f3a5c06d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.644+0000 7f3a63200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5c071570 con 0x7f3a5c0cc7e0 2024-04-25T09:05:05.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.644+0000 7f3a63200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5c071850 con 0x7f3a5c0aeb90 2024-04-25T09:05:05.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.644+0000 7f3a63200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5c071320 con 0x7f3a5c0aef70 2024-04-25T09:05:05.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.644+0000 7f3a61200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3a5c0aef70 0x7f3a5c06d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.644+0000 7f3a61200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3a5c0aef70 0x7f3a5c06d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:57986/0 (socket says 172.21.15.173:57986) 2024-04-25T09:05:05.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.644+0000 7f3a5b400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f3a5c0cc7e0 0x7f3a5c0cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46712/0 (socket says 172.21.15.173:46712) 2024-04-25T09:05:05.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.644+0000 7f3a61200640 1 -- 172.21.15.173:0/3929796105 learned_addr learned my addr 172.21.15.173:0/3929796105 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.648+0000 7f3a61200640 1 -- 172.21.15.173:0/3929796105 >> v1:172.21.15.194:6789/0 conn(0x7f3a5c0aeb90 legacy=0x7f3a5c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.648+0000 7f3a61200640 1 -- 172.21.15.173:0/3929796105 >> v1:172.21.15.173:6789/0 conn(0x7f3a5c0cc7e0 legacy=0x7f3a5c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.648+0000 7f3a61200640 1 -- 172.21.15.173:0/3929796105 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c071b30 con 0x7f3a5c0aef70 2024-04-25T09:05:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.652+0000 7f3a61200640 1 --2- 172.21.15.173:0/3929796105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5c0aef70 0x7f3a5c06d940 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3a54009e50 tx=0x7f3a5401c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d4460de93579424 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.652+0000 7f3a5aa00640 1 -- 172.21.15.173:0/3929796105 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a540a5580 con 0x7f3a5c0aef70 2024-04-25T09:05:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.652+0000 7f3a5aa00640 1 -- 172.21.15.173:0/3929796105 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a540a5720 con 0x7f3a5c0aef70 2024-04-25T09:05:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.652+0000 7f3a5aa00640 1 -- 172.21.15.173:0/3929796105 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a540a5af0 con 0x7f3a5c0aef70 2024-04-25T09:05:05.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.652+0000 7f3a63200640 1 -- 172.21.15.173:0/3929796105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5c0aef70 msgr2=0x7f3a5c06d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.652+0000 7f3a63200640 1 --2- 172.21.15.173:0/3929796105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5c0aef70 0x7f3a5c06d940 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3a54009e50 tx=0x7f3a5401c830 comp rx=0 tx=0).stop 2024-04-25T09:05:05.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.652+0000 7f3a63200640 1 -- 172.21.15.173:0/3929796105 shutdown_connections 2024-04-25T09:05:05.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.652+0000 7f3a63200640 1 --2- 172.21.15.173:0/3929796105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5c0aef70 0x7f3a5c06d940 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.652+0000 7f3a63200640 1 -- 172.21.15.173:0/3929796105 >> 172.21.15.173:0/3929796105 conn(0x7f3a5c06ac90 msgr2=0x7f3a5c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.652+0000 7f3a63200640 1 -- 172.21.15.173:0/3929796105 shutdown_connections 2024-04-25T09:05:05.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.652+0000 7f3a63200640 1 -- 172.21.15.173:0/3929796105 wait complete. 2024-04-25T09:05:05.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a63200640 1 Processor -- start 2024-04-25T09:05:05.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a63200640 1 -- start start 2024-04-25T09:05:05.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a63200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a5c0aeb90 0x7f3a5c143dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a63200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5c0aef70 0x7f3a5c0b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a63200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a5c0cc7e0 0x7f3a5c14dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a63200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c06ea60 con 0x7f3a5c0cc7e0 2024-04-25T09:05:05.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a63200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c06e8e0 con 0x7f3a5c0aef70 2024-04-25T09:05:05.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a63200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c168730 con 0x7f3a5c0aeb90 2024-04-25T09:05:05.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a61200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a5c0cc7e0 0x7f3a5c14dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a61200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a5c0cc7e0 0x7f3a5c14dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43162/0 (socket says 172.21.15.173:43162) 2024-04-25T09:05:05.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a61200640 1 -- 172.21.15.173:0/4272690315 learned_addr learned my addr 172.21.15.173:0/4272690315 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:05.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a5be00640 1 --2- 172.21.15.173:0/4272690315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a5c0aeb90 0x7f3a5c143dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a5b400640 1 --2- 172.21.15.173:0/4272690315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5c0aef70 0x7f3a5c0b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a61200640 1 -- 172.21.15.173:0/4272690315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a5c0aeb90 msgr2=0x7f3a5c143dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a61200640 1 --2- 172.21.15.173:0/4272690315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a5c0aeb90 0x7f3a5c143dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a61200640 1 -- 172.21.15.173:0/4272690315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5c0aef70 msgr2=0x7f3a5c0b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a61200640 1 --2- 172.21.15.173:0/4272690315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5c0aef70 0x7f3a5c0b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a61200640 1 -- 172.21.15.173:0/4272690315 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c14ec70 con 0x7f3a5c0cc7e0 2024-04-25T09:05:05.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a5b400640 1 --2- 172.21.15.173:0/4272690315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5c0aef70 0x7f3a5c0b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:05.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a61200640 1 --2- 172.21.15.173:0/4272690315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a5c0cc7e0 0x7f3a5c14dd90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3a540af040 tx=0x7f3a540195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a53e00640 1 -- 172.21.15.173:0/4272690315 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a540bc020 con 0x7f3a5c0cc7e0 2024-04-25T09:05:05.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a53e00640 1 -- 172.21.15.173:0/4272690315 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a540b8880 con 0x7f3a5c0cc7e0 2024-04-25T09:05:05.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a53e00640 1 -- 172.21.15.173:0/4272690315 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a540a5580 con 0x7f3a5c0cc7e0 2024-04-25T09:05:05.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a63200640 1 -- 172.21.15.173:0/4272690315 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5c0b0200 con 0x7f3a5c0cc7e0 2024-04-25T09:05:05.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.656+0000 7f3a63200640 1 -- 172.21.15.173:0/4272690315 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5c148460 con 0x7f3a5c0cc7e0 2024-04-25T09:05:05.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.660+0000 7f3a53e00640 1 -- 172.21.15.173:0/4272690315 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3a540bf020 con 0x7f3a5c0cc7e0 2024-04-25T09:05:05.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.660+0000 7f3a53e00640 1 --2- 172.21.15.173:0/4272690315 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3a38066f60 0x7f3a38069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.660+0000 7f3a53e00640 1 -- 172.21.15.173:0/4272690315 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f3a541204f0 con 0x7f3a5c0cc7e0 2024-04-25T09:05:05.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a5be00640 1 --2- 172.21.15.173:0/4272690315 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3a38066f60 0x7f3a38069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a66651000 1 Processor -- start 2024-04-25T09:05:05.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a66651000 1 -- start start 2024-04-25T09:05:05.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a5be00640 1 --2- 172.21.15.173:0/4272690315 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3a38066f60 0x7f3a38069420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c1f9ea0 tx=0x7f3a44009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a66651000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628deab69d0 0x5628deab6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a66651000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab72f0 0x5628dea6cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a66651000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628dea6d0a0 0x5628dea6d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a66651000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628de8b9ff0 con 0x5628deab72f0 2024-04-25T09:05:05.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a66651000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628de842150 con 0x5628deab69d0 2024-04-25T09:05:05.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a66651000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628de8b6090 con 0x5628dea6d0a0 2024-04-25T09:05:05.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a61200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628dea6d0a0 0x5628dea6d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a5b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab72f0 0x5628dea6cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a61200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628dea6d0a0 0x5628dea6d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:40392/0 (socket says 172.21.15.173:40392) 2024-04-25T09:05:05.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a61200640 1 -- 172.21.15.173:0/2282557495 learned_addr learned my addr 172.21.15.173:0/2282557495 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:05.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a5be00640 1 --2- 172.21.15.173:0/2282557495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628deab69d0 0x5628deab6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a61200640 1 -- 172.21.15.173:0/2282557495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628deab69d0 msgr2=0x5628deab6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a61200640 1 --2- 172.21.15.173:0/2282557495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628deab69d0 0x5628deab6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a61200640 1 -- 172.21.15.173:0/2282557495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab72f0 msgr2=0x5628dea6cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a61200640 1 --2- 172.21.15.173:0/2282557495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab72f0 0x5628dea6cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a61200640 1 -- 172.21.15.173:0/2282557495 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628dea500d0 con 0x5628dea6d0a0 2024-04-25T09:05:05.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a61200640 1 --2- 172.21.15.173:0/2282557495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628dea6d0a0 0x5628dea6d480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a540f0cb0 tx=0x7f3a540f0990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afd8844520484c82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a50c00640 1 -- 172.21.15.173:0/2282557495 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a540f0d20 con 0x5628dea6d0a0 2024-04-25T09:05:05.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a50c00640 1 -- 172.21.15.173:0/2282557495 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a540f4e70 con 0x5628dea6d0a0 2024-04-25T09:05:05.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.664+0000 7f3a50c00640 1 -- 172.21.15.173:0/2282557495 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a540f9430 con 0x5628dea6d0a0 2024-04-25T09:05:05.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.668+0000 7f3a66651000 1 -- 172.21.15.173:0/2282557495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628dea6d0a0 msgr2=0x5628dea6d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.668+0000 7f3a66651000 1 --2- 172.21.15.173:0/2282557495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628dea6d0a0 0x5628dea6d480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a540f0cb0 tx=0x7f3a540f0990 comp rx=0 tx=0).stop 2024-04-25T09:05:05.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.668+0000 7f3a66651000 1 -- 172.21.15.173:0/2282557495 shutdown_connections 2024-04-25T09:05:05.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.668+0000 7f3a66651000 1 --2- 172.21.15.173:0/2282557495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628dea6d0a0 0x5628dea6d480 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.668+0000 7f3a66651000 1 --2- 172.21.15.173:0/2282557495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab72f0 0x5628dea6cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.668+0000 7f3a66651000 1 --2- 172.21.15.173:0/2282557495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628deab69d0 0x5628deab6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.668+0000 7f3a66651000 1 -- 172.21.15.173:0/2282557495 >> 172.21.15.173:0/2282557495 conn(0x5628dea69020 msgr2=0x5628dea6b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.668+0000 7f3a66651000 1 -- 172.21.15.173:0/2282557495 shutdown_connections 2024-04-25T09:05:05.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.668+0000 7f3a66651000 1 -- 172.21.15.173:0/2282557495 wait complete. 2024-04-25T09:05:05.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.668+0000 7f3a66651000 1 -- start start 2024-04-25T09:05:05.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.668+0000 7f3a66651000 1 Processor -- start 2024-04-25T09:05:05.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.668+0000 7f3a66651000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628dea6d0a0 0x5628dea9b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.668+0000 7f3a66651000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628deab69d0 0x5628dea9bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.668+0000 7f3a66651000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab72f0 0x5628dea9c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.668+0000 7f3a66651000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628de87e250 con 0x5628deab72f0 2024-04-25T09:05:05.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.668+0000 7f3a66651000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628de874690 con 0x5628deab69d0 2024-04-25T09:05:05.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.668+0000 7f3a66651000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628de842a40 con 0x5628dea6d0a0 2024-04-25T09:05:05.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a66651000 10 client.0 _ll_register_callbacks cb 0x5628dea57e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:05.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a5be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628dea6d0a0 0x5628dea9b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a5b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628deab69d0 0x5628dea9bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a5b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628deab69d0 0x5628dea9bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:58022/0 (socket says 172.21.15.173:58022) 2024-04-25T09:05:05.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a5b400640 1 -- 172.21.15.173:0/1846166863 learned_addr learned my addr 172.21.15.173:0/1846166863 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:05.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a61200640 1 --2- 172.21.15.173:0/1846166863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab72f0 0x5628dea9c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a5b400640 1 -- 172.21.15.173:0/1846166863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628dea6d0a0 msgr2=0x5628dea9b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a5b400640 1 --2- 172.21.15.173:0/1846166863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628dea6d0a0 0x5628dea9b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a5b400640 1 -- 172.21.15.173:0/1846166863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab72f0 msgr2=0x5628dea9c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a5b400640 1 --2- 172.21.15.173:0/1846166863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab72f0 0x5628dea9c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a5b400640 1 -- 172.21.15.173:0/1846166863 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5628de9671c0 con 0x5628deab69d0 2024-04-25T09:05:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a61200640 1 --2- 172.21.15.173:0/1846166863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab72f0 0x5628dea9c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a5b400640 1 --2- 172.21.15.173:0/1846166863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628deab69d0 0x5628dea9bd30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c001350 tx=0x7f3a4c001750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63d1720707e639a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a49600640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-04-25T09:05:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a49600640 1 -- 172.21.15.173:0/1846166863 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c013600 con 0x5628deab69d0 2024-04-25T09:05:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a49600640 1 -- 172.21.15.173:0/1846166863 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f3a4c0137a0 con 0x5628deab69d0 2024-04-25T09:05:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a66651000 1 -- 172.21.15.173:0/1846166863 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3a540f4e70 con 0x5628deab69d0 2024-04-25T09:05:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a49600640 1 -- 172.21.15.173:0/1846166863 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a4c0139c0 con 0x5628deab69d0 2024-04-25T09:05:05.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a66651000 10 client.5437 fetch_fsmap learned FSMap version 19 2024-04-25T09:05:05.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a66651000 1 -- 172.21.15.173:0/1846166863 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x5628de963170 con 0x5628deab69d0 2024-04-25T09:05:05.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a49600640 1 -- 172.21.15.173:0/1846166863 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a540f4e70 con 0x5628deab69d0 2024-04-25T09:05:05.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a49600640 1 -- 172.21.15.173:0/1846166863 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 19) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3a4c013b60 con 0x5628deab69d0 2024-04-25T09:05:05.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a66651000 10 client.5437 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T09:05:05.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a66651000 10 client.5437 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-04-25T09:05:05.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a66651000 20 client.5437 populate_metadata read hostname 'smithi173' 2024-04-25T09:05:05.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a66651000 1 --2- 172.21.15.173:0/1846166863 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x5628deac6c80 0x5628deac9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a66651000 4 client.5437 mds_command: new command op to 5346 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:05.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a66651000 1 -- 172.21.15.173:0/1846166863 --> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5628de855c60 con 0x5628deac6c80 2024-04-25T09:05:05.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.672+0000 7f3a5be00640 1 --2- 172.21.15.173:0/1846166863 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x5628deac6c80 0x5628deac9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.676+0000 7f3a5be00640 1 --2- 172.21.15.173:0/1846166863 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x5628deac6c80 0x5628deac9070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34ea179d15c0e3f5 server_cookie=70e4ee8f48422007 in_seq=0 out_seq=0 2024-04-25T09:05:05.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.676+0000 7f3a49600640 10 client.5437 ms_handle_connect on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:05.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.676+0000 7f3a49600640 1 -- 172.21.15.173:0/1846166863 <== mds.0 v2:172.21.15.173:6834/960880761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5628de855c60 con 0x5628deac6c80 2024-04-25T09:05:05.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.676+0000 7f3a49600640 10 client.5437 handle_command_reply: tid=0 2024-04-25T09:05:05.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.676+0000 7f3a66651000 1 client.5437 shutdown 2024-04-25T09:05:05.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.676+0000 7f3a66651000 1 -- 172.21.15.173:0/1846166863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628deab69d0 msgr2=0x5628dea9bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.676+0000 7f3a66651000 1 --2- 172.21.15.173:0/1846166863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628deab69d0 0x5628dea9bd30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c001350 tx=0x7f3a4c001750 comp rx=0 tx=0).stop 2024-04-25T09:05:05.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.676+0000 7f3a66651000 1 -- 172.21.15.173:0/1846166863 shutdown_connections 2024-04-25T09:05:05.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.676+0000 7f3a66651000 1 --2- 172.21.15.173:0/1846166863 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x5628deac6c80 0x5628deac9070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.676+0000 7f3a66651000 1 --2- 172.21.15.173:0/1846166863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab72f0 0x5628dea9c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.676+0000 7f3a66651000 1 --2- 172.21.15.173:0/1846166863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628deab69d0 0x5628dea9bd30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.676+0000 7f3a49600640 0 client.5437 ms_handle_reset on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:05.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.676+0000 7f3a66651000 1 --2- 172.21.15.173:0/1846166863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628dea6d0a0 0x5628dea9b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.676+0000 7f3a66651000 1 -- 172.21.15.173:0/1846166863 >> 172.21.15.173:0/1846166863 conn(0x5628dea69020 msgr2=0x5628dea6bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.676+0000 7f3a66651000 1 -- 172.21.15.173:0/1846166863 shutdown_connections 2024-04-25T09:05:05.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.676+0000 7f3a66651000 1 -- 172.21.15.173:0/1846166863 wait complete. 2024-04-25T09:05:05.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.676+0000 7f3a66651000 20 client.5437 trim_cache size 0 max 16384 2024-04-25T09:05:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.700+0000 7f3a66651000 1 Processor -- start 2024-04-25T09:05:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.700+0000 7f3a66651000 1 -- start start 2024-04-25T09:05:05.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.700+0000 7f3a66651000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628dea6d0a0 0x5628dea6ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.700+0000 7f3a66651000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628deab69d0 0x5628deac3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.700+0000 7f3a5be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628dea6d0a0 0x5628dea6ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.700+0000 7f3a66651000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab72f0 0x5628deac4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.700+0000 7f3a66651000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c0aaae0 con 0x5628deab72f0 2024-04-25T09:05:05.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.700+0000 7f3a5be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628dea6d0a0 0x5628dea6ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:58028/0 (socket says 172.21.15.173:58028) 2024-04-25T09:05:05.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.700+0000 7f3a66651000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c0a9cc0 con 0x5628dea6d0a0 2024-04-25T09:05:05.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.700+0000 7f3a66651000 1 -- 172.21.15.173:0/2291989177 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c150b30 con 0x5628deab69d0 2024-04-25T09:05:05.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.700+0000 7f3a5be00640 1 -- 172.21.15.173:0/2291989177 learned_addr learned my addr 172.21.15.173:0/2291989177 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:05.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.700+0000 7f3a61200640 1 --2- 172.21.15.173:0/2291989177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab72f0 0x5628deac4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a5b400640 1 --2- 172.21.15.173:0/2291989177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628deab69d0 0x5628deac3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a5be00640 1 -- 172.21.15.173:0/2291989177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628deab69d0 msgr2=0x5628deac3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a5be00640 1 --2- 172.21.15.173:0/2291989177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628deab69d0 0x5628deac3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a5be00640 1 -- 172.21.15.173:0/2291989177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab72f0 msgr2=0x5628deac4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a5be00640 1 --2- 172.21.15.173:0/2291989177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab72f0 0x5628deac4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a5be00640 1 -- 172.21.15.173:0/2291989177 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628de900de0 con 0x5628dea6d0a0 2024-04-25T09:05:05.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a5be00640 1 --2- 172.21.15.173:0/2291989177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628dea6d0a0 0x5628dea6ca50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3a44005230 tx=0x7f3a44012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3746ef59c6fcfa04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a4be00640 1 -- 172.21.15.173:0/2291989177 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44005260 con 0x5628dea6d0a0 2024-04-25T09:05:05.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a4be00640 1 -- 172.21.15.173:0/2291989177 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a44003b80 con 0x5628dea6d0a0 2024-04-25T09:05:05.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a4be00640 1 -- 172.21.15.173:0/2291989177 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44003d50 con 0x5628dea6d0a0 2024-04-25T09:05:05.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a66651000 1 -- 172.21.15.173:0/2291989177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628dea6d0a0 msgr2=0x5628dea6ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a66651000 1 --2- 172.21.15.173:0/2291989177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628dea6d0a0 0x5628dea6ca50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3a44005230 tx=0x7f3a44012000 comp rx=0 tx=0).stop 2024-04-25T09:05:05.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a66651000 1 -- 172.21.15.173:0/2291989177 shutdown_connections 2024-04-25T09:05:05.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a66651000 1 --2- 172.21.15.173:0/2291989177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab72f0 0x5628deac4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a66651000 1 --2- 172.21.15.173:0/2291989177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628deab69d0 0x5628deac3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a66651000 1 --2- 172.21.15.173:0/2291989177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628dea6d0a0 0x5628dea6ca50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a66651000 1 -- 172.21.15.173:0/2291989177 >> 172.21.15.173:0/2291989177 conn(0x5628dea69020 msgr2=0x5628deac3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a66651000 1 -- 172.21.15.173:0/2291989177 shutdown_connections 2024-04-25T09:05:05.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a66651000 1 -- 172.21.15.173:0/2291989177 wait complete. 2024-04-25T09:05:05.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.704+0000 7f3a66651000 1 -- start start 2024-04-25T09:05:05.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a66651000 1 Processor -- start 2024-04-25T09:05:05.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a66651000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628dea6d0a0 0x5628deb16800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a66651000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab69d0 0x5628deb16d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a66651000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628deab72f0 0x5628deac8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a66651000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628de854e00 con 0x5628deab69d0 2024-04-25T09:05:05.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a66651000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c0a96c0 con 0x5628deab72f0 2024-04-25T09:05:05.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a66651000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628de8b9300 con 0x5628dea6d0a0 2024-04-25T09:05:05.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a66651000 10 client.0 _ll_register_callbacks cb 0x5628dea38040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:05.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a5b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab69d0 0x5628deb16d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a5b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab69d0 0x5628deb16d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:43186/0 (socket says 172.21.15.173:43186) 2024-04-25T09:05:05.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a5b400640 1 -- 172.21.15.173:0/473593608 learned_addr learned my addr 172.21.15.173:0/473593608 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:05.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a5be00640 1 --2- 172.21.15.173:0/473593608 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628dea6d0a0 0x5628deb16800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a61200640 1 --2- 172.21.15.173:0/473593608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628deab72f0 0x5628deac8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a5be00640 1 -- 172.21.15.173:0/473593608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628deab72f0 msgr2=0x5628deac8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a5be00640 1 --2- 172.21.15.173:0/473593608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628deab72f0 0x5628deac8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a5be00640 1 -- 172.21.15.173:0/473593608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab69d0 msgr2=0x5628deb16d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a5be00640 1 --2- 172.21.15.173:0/473593608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab69d0 0x5628deb16d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a5be00640 1 -- 172.21.15.173:0/473593608 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5628de85b8e0 con 0x5628dea6d0a0 2024-04-25T09:05:05.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a61200640 1 --2- 172.21.15.173:0/473593608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628deab72f0 0x5628deac8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:05.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a5be00640 1 --2- 172.21.15.173:0/473593608 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628dea6d0a0 0x5628deb16800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3a44005630 tx=0x7f3a44000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b37af73cce1273ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a49600640 10 client.0 ms_handle_connect on v2:172.21.15.194:3301/0 2024-04-25T09:05:05.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a49600640 1 -- 172.21.15.173:0/473593608 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44034070 con 0x5628dea6d0a0 2024-04-25T09:05:05.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a49600640 1 -- 172.21.15.173:0/473593608 <== mon.2 v2:172.21.15.194:3301/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f3a44003d30 con 0x5628dea6d0a0 2024-04-25T09:05:05.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a66651000 1 -- 172.21.15.173:0/473593608 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3a44003b80 con 0x5628dea6d0a0 2024-04-25T09:05:05.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a49600640 1 -- 172.21.15.173:0/473593608 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a4400e4a0 con 0x5628dea6d0a0 2024-04-25T09:05:05.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a66651000 10 client.5129 fetch_fsmap learned FSMap version 19 2024-04-25T09:05:05.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.708+0000 7f3a66651000 1 -- 172.21.15.173:0/473593608 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x5628de9138f0 con 0x5628dea6d0a0 2024-04-25T09:05:05.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a49600640 1 -- 172.21.15.173:0/473593608 <== mon.2 v2:172.21.15.194:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a44003b80 con 0x5628dea6d0a0 2024-04-25T09:05:05.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a49600640 1 -- 172.21.15.173:0/473593608 <== mon.2 v2:172.21.15.194:3301/0 5 ==== fsmap(e 19) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3a4400e640 con 0x5628dea6d0a0 2024-04-25T09:05:05.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a66651000 10 client.5129 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T09:05:05.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a66651000 10 client.5129 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-04-25T09:05:05.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a66651000 20 client.5129 populate_metadata read hostname 'smithi173' 2024-04-25T09:05:05.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a66651000 1 --2- 172.21.15.173:0/473593608 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x5628deac9620 0x5628deac9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a66651000 4 client.5129 mds_command: new command op to 5346 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:05:05.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a66651000 1 -- 172.21.15.173:0/473593608 --> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5628de8c7530 con 0x5628deac9620 2024-04-25T09:05:05.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a5b400640 1 --2- 172.21.15.173:0/473593608 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x5628deac9620 0x5628deac9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a5b400640 1 --2- 172.21.15.173:0/473593608 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x5628deac9620 0x5628deac9a30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e14500796d5a802 server_cookie=2204046f636ebb46 in_seq=0 out_seq=0 2024-04-25T09:05:05.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a49600640 10 client.5129 ms_handle_connect on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:05.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a49600640 1 -- 172.21.15.173:0/473593608 <== mds.0 v2:172.21.15.173:6834/960880761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+274 (crc 0 0 0) 0x5628de8c7530 con 0x5628deac9620 2024-04-25T09:05:05.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a49600640 10 client.5129 handle_command_reply: tid=0 2024-04-25T09:05:05.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a66651000 1 client.5129 shutdown 2024-04-25T09:05:05.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a66651000 1 -- 172.21.15.173:0/473593608 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628dea6d0a0 msgr2=0x5628deb16800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a66651000 1 --2- 172.21.15.173:0/473593608 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628dea6d0a0 0x5628deb16800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3a44005630 tx=0x7f3a44000ee0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a66651000 1 -- 172.21.15.173:0/473593608 shutdown_connections 2024-04-25T09:05:05.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a66651000 1 --2- 172.21.15.173:0/473593608 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x5628deac9620 0x5628deac9a30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a66651000 1 --2- 172.21.15.173:0/473593608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628deab72f0 0x5628deac8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a66651000 1 --2- 172.21.15.173:0/473593608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628deab69d0 0x5628deb16d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a66651000 1 --2- 172.21.15.173:0/473593608 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5628dea6d0a0 0x5628deb16800 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a66651000 1 -- 172.21.15.173:0/473593608 >> 172.21.15.173:0/473593608 conn(0x5628dea69020 msgr2=0x5628deac3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a49600640 0 client.5129 ms_handle_reset on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:05.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a66651000 1 -- 172.21.15.173:0/473593608 shutdown_connections 2024-04-25T09:05:05.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a66651000 1 -- 172.21.15.173:0/473593608 wait complete. 2024-04-25T09:05:05.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.712+0000 7f3a66651000 20 client.5129 trim_cache size 0 max 16384 2024-04-25T09:05:05.707 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:05:05.707 INFO:teuthology.orchestra.run.smithi173.stdout: "status": "scrub active (130 inodes in the stack)", 2024-04-25T09:05:05.707 INFO:teuthology.orchestra.run.smithi173.stdout: "scrubs": { 2024-04-25T09:05:05.707 INFO:teuthology.orchestra.run.smithi173.stdout: "40a0235b-489f-4e6b-9872-d78b11679fa5": { 2024-04-25T09:05:05.707 INFO:teuthology.orchestra.run.smithi173.stdout: "path": "/", 2024-04-25T09:05:05.707 INFO:teuthology.orchestra.run.smithi173.stdout: "tag": "40a0235b-489f-4e6b-9872-d78b11679fa5", 2024-04-25T09:05:05.707 INFO:teuthology.orchestra.run.smithi173.stdout: "options": "recursive,scrub_mdsdir" 2024-04-25T09:05:05.707 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:05.708 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:05.708 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:05:05.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.716+0000 7f3a63200640 1 -- 172.21.15.173:0/4272690315 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3a38066f60 msgr2=0x7f3a38069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.716+0000 7f3a63200640 1 --2- 172.21.15.173:0/4272690315 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3a38066f60 0x7f3a38069420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c1f9ea0 tx=0x7f3a44009040 comp rx=0 tx=0).stop 2024-04-25T09:05:05.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.716+0000 7f3a63200640 1 -- 172.21.15.173:0/4272690315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a5c0cc7e0 msgr2=0x7f3a5c14dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.716+0000 7f3a63200640 1 --2- 172.21.15.173:0/4272690315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a5c0cc7e0 0x7f3a5c14dd90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3a540af040 tx=0x7f3a540195d0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.716+0000 7f3a63200640 1 -- 172.21.15.173:0/4272690315 shutdown_connections 2024-04-25T09:05:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.716+0000 7f3a63200640 1 --2- 172.21.15.173:0/4272690315 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3a38066f60 0x7f3a38069420 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.716+0000 7f3a63200640 1 --2- 172.21.15.173:0/4272690315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a5c0cc7e0 0x7f3a5c14dd90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.716+0000 7f3a63200640 1 --2- 172.21.15.173:0/4272690315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5c0aef70 0x7f3a5c0b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.716+0000 7f3a63200640 1 --2- 172.21.15.173:0/4272690315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a5c0aeb90 0x7f3a5c143dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.716+0000 7f3a63200640 1 -- 172.21.15.173:0/4272690315 >> 172.21.15.173:0/4272690315 conn(0x7f3a5c06ac90 msgr2=0x7f3a5c0ad2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.716+0000 7f3a63200640 1 -- 172.21.15.173:0/4272690315 shutdown_connections 2024-04-25T09:05:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:05.716+0000 7f3a63200640 1 -- 172.21.15.173:0/4272690315 wait complete. 2024-04-25T09:05:05.732 INFO:tasks.cephfs.filesystem:scrub status for tag:40a0235b-489f-4e6b-9872-d78b11679fa5 - {'path': '/', 'tag': '40a0235b-489f-4e6b-9872-d78b11679fa5', 'options': 'recursive,scrub_mdsdir'} 2024-04-25T09:05:14.391 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:05:14.394 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:05:35.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:35.733 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-04-25T09:05:35.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.891+0000 7f95fda00640 1 Processor -- start 2024-04-25T09:05:35.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.891+0000 7f95fda00640 1 -- start start 2024-04-25T09:05:35.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.891+0000 7f95fda00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f95f80cc030 0x7f95f815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.891+0000 7f95fda00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f80b11b0 con 0x7f95f80d22f0 2024-04-25T09:05:35.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.891+0000 7f95fda00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f8070f80 con 0x7f95f8163460 2024-04-25T09:05:35.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.891+0000 7f95fda00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f8071d40 con 0x7f95f80cc030 2024-04-25T09:05:35.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.891+0000 7f95f6a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f95f80cc030 0x7f95f815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.891+0000 7f95ee000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f95f80d22f0 0x7f95f80cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47022/0 (socket says 172.21.15.173:47022) 2024-04-25T09:05:35.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.891+0000 7f95ee000640 1 -- 172.21.15.173:0/558979616 learned_addr learned my addr 172.21.15.173:0/558979616 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:35.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.891+0000 7f95f6a00640 1 -- 172.21.15.173:0/558979616 >> v1:172.21.15.194:6789/0 conn(0x7f95f8163460 legacy=0x7f95f8165850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:35.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.891+0000 7f95f6a00640 1 -- 172.21.15.173:0/558979616 >> v1:172.21.15.173:6789/0 conn(0x7f95f80d22f0 legacy=0x7f95f80cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.891+0000 7f95f6a00640 1 -- 172.21.15.173:0/558979616 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f8071260 con 0x7f95f80cc030 2024-04-25T09:05:35.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.891+0000 7f95f6000640 1 -- 172.21.15.173:0/558979616 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963155876 0 0) 0x7f95f80b11b0 con 0x7f95f80d22f0 2024-04-25T09:05:35.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.895+0000 7f95f6a00640 1 --2- 172.21.15.173:0/558979616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f80cc030 0x7f95f815c8d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009d90 tx=0x7f95e801c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee59e8a0e843913 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:35.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.895+0000 7f95f6000640 1 -- 172.21.15.173:0/558979616 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e80a66e0 con 0x7f95f80cc030 2024-04-25T09:05:35.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.895+0000 7f95f6000640 1 -- 172.21.15.173:0/558979616 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e80a6880 con 0x7f95f80cc030 2024-04-25T09:05:35.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.895+0000 7f95f6000640 1 -- 172.21.15.173:0/558979616 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e80a6c50 con 0x7f95f80cc030 2024-04-25T09:05:35.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.895+0000 7f95fda00640 1 -- 172.21.15.173:0/558979616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f80cc030 msgr2=0x7f95f815c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.895+0000 7f95fda00640 1 --2- 172.21.15.173:0/558979616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f80cc030 0x7f95f815c8d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009d90 tx=0x7f95e801c810 comp rx=0 tx=0).stop 2024-04-25T09:05:35.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.895+0000 7f95fda00640 1 -- 172.21.15.173:0/558979616 shutdown_connections 2024-04-25T09:05:35.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.895+0000 7f95fda00640 1 --2- 172.21.15.173:0/558979616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f80cc030 0x7f95f815c8d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.895+0000 7f95fda00640 1 -- 172.21.15.173:0/558979616 >> 172.21.15.173:0/558979616 conn(0x7f95f80d17d0 msgr2=0x7f95f80d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:35.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.895+0000 7f95fda00640 1 -- 172.21.15.173:0/558979616 shutdown_connections 2024-04-25T09:05:35.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.895+0000 7f95fda00640 1 -- 172.21.15.173:0/558979616 wait complete. 2024-04-25T09:05:35.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95fda00640 1 Processor -- start 2024-04-25T09:05:35.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95fda00640 1 -- start start 2024-04-25T09:05:35.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95fda00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f80cc030 0x7f95f814ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95fda00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f80d22f0 0x7f95f8153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95fda00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95f8163460 0x7f95f815ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95fda00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f8169910 con 0x7f95f80d22f0 2024-04-25T09:05:35.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95fda00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f8169790 con 0x7f95f8163460 2024-04-25T09:05:35.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95fda00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f8169a90 con 0x7f95f80cc030 2024-04-25T09:05:35.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95ee000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f80d22f0 0x7f95f8153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95ee000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f80d22f0 0x7f95f8153100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59102/0 (socket says 172.21.15.173:59102) 2024-04-25T09:05:35.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95ee000640 1 -- 172.21.15.173:0/2726577190 learned_addr learned my addr 172.21.15.173:0/2726577190 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:35.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95f6a00640 1 --2- 172.21.15.173:0/2726577190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f80cc030 0x7f95f814ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95f7400640 1 --2- 172.21.15.173:0/2726577190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95f8163460 0x7f95f815ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95ee000640 1 -- 172.21.15.173:0/2726577190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f80cc030 msgr2=0x7f95f814ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95ee000640 1 --2- 172.21.15.173:0/2726577190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f80cc030 0x7f95f814ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95ee000640 1 -- 172.21.15.173:0/2726577190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95f8163460 msgr2=0x7f95f815ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95ee000640 1 --2- 172.21.15.173:0/2726577190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95f8163460 0x7f95f815ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95ee000640 1 -- 172.21.15.173:0/2726577190 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f815b340 con 0x7f95f80d22f0 2024-04-25T09:05:35.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95f6a00640 1 --2- 172.21.15.173:0/2726577190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f80cc030 0x7f95f814ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:35.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95f7400640 1 --2- 172.21.15.173:0/2726577190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95f8163460 0x7f95f815ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:35.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95ee000640 1 --2- 172.21.15.173:0/2726577190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f80d22f0 0x7f95f8153100 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f95e000c480 tx=0x7f95e000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:35.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95ef400640 1 -- 172.21.15.173:0/2726577190 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0018070 con 0x7f95f80d22f0 2024-04-25T09:05:35.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95ef400640 1 -- 172.21.15.173:0/2726577190 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e0007500 con 0x7f95f80d22f0 2024-04-25T09:05:35.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95ef400640 1 -- 172.21.15.173:0/2726577190 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0004a30 con 0x7f95f80d22f0 2024-04-25T09:05:35.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95fda00640 1 -- 172.21.15.173:0/2726577190 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f8153790 con 0x7f95f80d22f0 2024-04-25T09:05:35.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.899+0000 7f95fda00640 1 -- 172.21.15.173:0/2726577190 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f8153e10 con 0x7f95f80d22f0 2024-04-25T09:05:35.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f95ef400640 1 -- 172.21.15.173:0/2726577190 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f95e001b070 con 0x7f95f80d22f0 2024-04-25T09:05:35.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f95ef400640 1 --2- 172.21.15.173:0/2726577190 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f95d4066f60 0x7f95d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f95ef400640 1 -- 172.21.15.173:0/2726577190 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f95e0084530 con 0x7f95f80d22f0 2024-04-25T09:05:35.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f95f6a00640 1 --2- 172.21.15.173:0/2726577190 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f95d4066f60 0x7f95d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f9600dd5000 1 Processor -- start 2024-04-25T09:05:35.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f9600dd5000 1 -- start start 2024-04-25T09:05:35.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f95f6a00640 1 --2- 172.21.15.173:0/2726577190 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f95d4066f60 0x7f95d4069420 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f95e80af000 tx=0x7f95e80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:35.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f9600dd5000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578131329d0 0x557813132db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f9600dd5000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578131332f0 0x5578130e8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f9600dd5000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578130e90a0 0x5578130e9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f9600dd5000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557812f35ff0 con 0x5578130e90a0 2024-04-25T09:05:35.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f9600dd5000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x557812ebe150 con 0x5578131329d0 2024-04-25T09:05:35.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f9600dd5000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x557812f32090 con 0x5578131332f0 2024-04-25T09:05:35.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f95f7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578130e90a0 0x5578130e9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f95f7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578130e90a0 0x5578130e9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59118/0 (socket says 172.21.15.173:59118) 2024-04-25T09:05:35.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f95f7400640 1 -- 172.21.15.173:0/510938921 learned_addr learned my addr 172.21.15.173:0/510938921 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:35.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f95f6a00640 1 --2- 172.21.15.173:0/510938921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578131329d0 0x557813132db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f95ee000640 1 --2- 172.21.15.173:0/510938921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578131332f0 0x5578130e8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f95f7400640 1 -- 172.21.15.173:0/510938921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578131332f0 msgr2=0x5578130e8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:35.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f95f7400640 1 --2- 172.21.15.173:0/510938921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578131332f0 0x5578130e8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f95f7400640 1 -- 172.21.15.173:0/510938921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578131329d0 msgr2=0x557813132db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:35.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f95f7400640 1 --2- 172.21.15.173:0/510938921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578131329d0 0x557813132db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.903+0000 7f95f7400640 1 -- 172.21.15.173:0/510938921 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578130cc0d0 con 0x5578130e90a0 2024-04-25T09:05:35.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95f7400640 1 --2- 172.21.15.173:0/510938921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578130e90a0 0x5578130e9480 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f95f0003e60 tx=0x7f95f0004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b902d163ec0f086 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:35.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95e7400640 1 -- 172.21.15.173:0/510938921 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f000db40 con 0x5578130e90a0 2024-04-25T09:05:35.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95e7400640 1 -- 172.21.15.173:0/510938921 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f000dce0 con 0x5578130e90a0 2024-04-25T09:05:35.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95e7400640 1 -- 172.21.15.173:0/510938921 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0007270 con 0x5578130e90a0 2024-04-25T09:05:35.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f9600dd5000 1 -- 172.21.15.173:0/510938921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578130e90a0 msgr2=0x5578130e9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f9600dd5000 1 --2- 172.21.15.173:0/510938921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578130e90a0 0x5578130e9480 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f95f0003e60 tx=0x7f95f0004320 comp rx=0 tx=0).stop 2024-04-25T09:05:35.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f9600dd5000 1 -- 172.21.15.173:0/510938921 shutdown_connections 2024-04-25T09:05:35.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f9600dd5000 1 --2- 172.21.15.173:0/510938921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578130e90a0 0x5578130e9480 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f9600dd5000 1 --2- 172.21.15.173:0/510938921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578131332f0 0x5578130e8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f9600dd5000 1 --2- 172.21.15.173:0/510938921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578131329d0 0x557813132db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f9600dd5000 1 -- 172.21.15.173:0/510938921 >> 172.21.15.173:0/510938921 conn(0x5578130e5020 msgr2=0x5578130e7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:35.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f9600dd5000 1 -- 172.21.15.173:0/510938921 shutdown_connections 2024-04-25T09:05:35.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f9600dd5000 1 -- 172.21.15.173:0/510938921 wait complete. 2024-04-25T09:05:35.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f9600dd5000 1 -- start start 2024-04-25T09:05:35.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f9600dd5000 1 Processor -- start 2024-04-25T09:05:35.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f9600dd5000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578130e90a0 0x5578131177f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f9600dd5000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578131329d0 0x557813117d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f9600dd5000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578131332f0 0x557813118270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f9600dd5000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557812efa250 con 0x5578131329d0 2024-04-25T09:05:35.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f9600dd5000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x557812ef0690 con 0x5578130e90a0 2024-04-25T09:05:35.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f9600dd5000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x557812ebea40 con 0x5578131332f0 2024-04-25T09:05:35.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f9600dd5000 10 client.0 _ll_register_callbacks cb 0x5578130d3e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:35.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95ee000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578131329d0 0x557813117d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95ee000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578131329d0 0x557813117d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59128/0 (socket says 172.21.15.173:59128) 2024-04-25T09:05:35.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95ee000640 1 -- 172.21.15.173:0/2361914627 learned_addr learned my addr 172.21.15.173:0/2361914627 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:35.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95f6a00640 1 --2- 172.21.15.173:0/2361914627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578130e90a0 0x5578131177f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95f7400640 1 --2- 172.21.15.173:0/2361914627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578131332f0 0x557813118270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95ee000640 1 -- 172.21.15.173:0/2361914627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578131332f0 msgr2=0x557813118270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:35.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95ee000640 1 --2- 172.21.15.173:0/2361914627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578131332f0 0x557813118270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95ee000640 1 -- 172.21.15.173:0/2361914627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578130e90a0 msgr2=0x5578131177f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:35.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95ee000640 1 --2- 172.21.15.173:0/2361914627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578130e90a0 0x5578131177f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95ee000640 1 -- 172.21.15.173:0/2361914627 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557812fe31c0 con 0x5578131329d0 2024-04-25T09:05:35.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95f6a00640 1 --2- 172.21.15.173:0/2361914627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578130e90a0 0x5578131177f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:35.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95ee000640 1 --2- 172.21.15.173:0/2361914627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578131329d0 0x557813117d30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f95e000ce40 tx=0x7f95e005d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3440f3bfd7826e66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:35.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95dbe00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:05:35.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95dbe00640 1 -- 172.21.15.173:0/2361914627 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e00842c0 con 0x5578131329d0 2024-04-25T09:05:35.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.907+0000 7f95dbe00640 1 -- 172.21.15.173:0/2361914627 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f95e005cef0 con 0x5578131329d0 2024-04-25T09:05:35.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 1 -- 172.21.15.173:0/2361914627 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f95f000dce0 con 0x5578131329d0 2024-04-25T09:05:35.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f95dbe00640 1 -- 172.21.15.173:0/2361914627 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95e005d0f0 con 0x5578131329d0 2024-04-25T09:05:35.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 10 client.5637 fetch_fsmap learned FSMap version 19 2024-04-25T09:05:35.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 1 -- 172.21.15.173:0/2361914627 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x557812fdf170 con 0x5578131329d0 2024-04-25T09:05:35.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f95dbe00640 1 -- 172.21.15.173:0/2361914627 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f000dce0 con 0x5578131329d0 2024-04-25T09:05:35.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f95dbe00640 1 -- 172.21.15.173:0/2361914627 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 19) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f95e0059ce0 con 0x5578131329d0 2024-04-25T09:05:35.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 10 client.5637 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T09:05:35.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 10 client.5637 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-04-25T09:05:35.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 20 client.5637 populate_metadata read hostname 'smithi173' 2024-04-25T09:05:35.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 1 --2- 172.21.15.173:0/2361914627 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x557813142c80 0x557813145070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 4 client.5637 mds_command: new command op to 5346 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:35.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 1 -- 172.21.15.173:0/2361914627 --> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557812ed1c60 con 0x557813142c80 2024-04-25T09:05:35.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f95f6a00640 1 --2- 172.21.15.173:0/2361914627 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x557813142c80 0x557813145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f95f6a00640 1 --2- 172.21.15.173:0/2361914627 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x557813142c80 0x557813145070 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6443576f713703d2 server_cookie=ce26d5eaf6b47ae1 in_seq=0 out_seq=0 2024-04-25T09:05:35.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f95dbe00640 10 client.5637 ms_handle_connect on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:35.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f95dbe00640 1 -- 172.21.15.173:0/2361914627 <== mds.0 v2:172.21.15.173:6834/960880761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557812ed1c60 con 0x557813142c80 2024-04-25T09:05:35.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f95dbe00640 10 client.5637 handle_command_reply: tid=0 2024-04-25T09:05:35.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 1 client.5637 shutdown 2024-04-25T09:05:35.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 1 -- 172.21.15.173:0/2361914627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578131329d0 msgr2=0x557813117d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 1 --2- 172.21.15.173:0/2361914627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578131329d0 0x557813117d30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f95e000ce40 tx=0x7f95e005d440 comp rx=0 tx=0).stop 2024-04-25T09:05:35.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 1 -- 172.21.15.173:0/2361914627 shutdown_connections 2024-04-25T09:05:35.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 1 --2- 172.21.15.173:0/2361914627 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x557813142c80 0x557813145070 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 1 --2- 172.21.15.173:0/2361914627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578131332f0 0x557813118270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 1 --2- 172.21.15.173:0/2361914627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578131329d0 0x557813117d30 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f95dbe00640 0 client.5637 ms_handle_reset on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:35.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 1 --2- 172.21.15.173:0/2361914627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578130e90a0 0x5578131177f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 1 -- 172.21.15.173:0/2361914627 >> 172.21.15.173:0/2361914627 conn(0x5578130e5020 msgr2=0x5578130e7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:35.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 1 -- 172.21.15.173:0/2361914627 shutdown_connections 2024-04-25T09:05:35.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 1 -- 172.21.15.173:0/2361914627 wait complete. 2024-04-25T09:05:35.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.911+0000 7f9600dd5000 20 client.5637 trim_cache size 0 max 16384 2024-04-25T09:05:35.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f9600dd5000 1 Processor -- start 2024-04-25T09:05:35.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f9600dd5000 1 -- start start 2024-04-25T09:05:35.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f9600dd5000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578130e90a0 0x557813131e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f9600dd5000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578131329d0 0x5578130e8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f9600dd5000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578131332f0 0x5578130e8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f9600dd5000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f82032a0 con 0x5578131329d0 2024-04-25T09:05:35.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f9600dd5000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f82024c0 con 0x5578131332f0 2024-04-25T09:05:35.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f9600dd5000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80b6800 con 0x5578130e90a0 2024-04-25T09:05:35.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f95ee000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578131329d0 0x5578130e8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f95ee000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578131329d0 0x5578130e8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59134/0 (socket says 172.21.15.173:59134) 2024-04-25T09:05:35.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f95ee000640 1 -- 172.21.15.173:0/328612706 learned_addr learned my addr 172.21.15.173:0/328612706 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:35.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f95f6a00640 1 --2- 172.21.15.173:0/328612706 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578130e90a0 0x557813131e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f95ee000640 1 -- 172.21.15.173:0/328612706 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578130e90a0 msgr2=0x557813131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:35.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f95ee000640 1 --2- 172.21.15.173:0/328612706 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578130e90a0 0x557813131e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f95ee000640 1 -- 172.21.15.173:0/328612706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578131332f0 msgr2=0x5578130e8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:35.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f95ee000640 1 --2- 172.21.15.173:0/328612706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578131332f0 0x5578130e8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f95ee000640 1 -- 172.21.15.173:0/328612706 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557812f7cde0 con 0x5578131329d0 2024-04-25T09:05:35.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f95ee000640 1 --2- 172.21.15.173:0/328612706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578131329d0 0x5578130e8420 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f95e0054c00 tx=0x7f95e0057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e621c6854e5d2fa3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:35.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f95e6a00640 1 -- 172.21.15.173:0/328612706 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0054a40 con 0x5578131329d0 2024-04-25T09:05:35.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f95e6a00640 1 -- 172.21.15.173:0/328612706 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e0054110 con 0x5578131329d0 2024-04-25T09:05:35.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f95e6a00640 1 -- 172.21.15.173:0/328612706 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e00547b0 con 0x5578131329d0 2024-04-25T09:05:35.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f9600dd5000 1 -- 172.21.15.173:0/328612706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578131329d0 msgr2=0x5578130e8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f9600dd5000 1 --2- 172.21.15.173:0/328612706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578131329d0 0x5578130e8420 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f95e0054c00 tx=0x7f95e0057000 comp rx=0 tx=0).stop 2024-04-25T09:05:35.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f9600dd5000 1 -- 172.21.15.173:0/328612706 shutdown_connections 2024-04-25T09:05:35.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f9600dd5000 1 --2- 172.21.15.173:0/328612706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578131332f0 0x5578130e8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f9600dd5000 1 --2- 172.21.15.173:0/328612706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578131329d0 0x5578130e8420 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f9600dd5000 1 --2- 172.21.15.173:0/328612706 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578130e90a0 0x557813131e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f9600dd5000 1 -- 172.21.15.173:0/328612706 >> 172.21.15.173:0/328612706 conn(0x5578130e5020 msgr2=0x5578131310d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:35.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f9600dd5000 1 -- 172.21.15.173:0/328612706 shutdown_connections 2024-04-25T09:05:35.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.927+0000 7f9600dd5000 1 -- 172.21.15.173:0/328612706 wait complete. 2024-04-25T09:05:35.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f9600dd5000 1 -- start start 2024-04-25T09:05:35.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f9600dd5000 1 Processor -- start 2024-04-25T09:05:35.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f9600dd5000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578130e90a0 0x557813193310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f9600dd5000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578131329d0 0x557813193850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f9600dd5000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578131332f0 0x557813145380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f9600dd5000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557812ed0e00 con 0x5578130e90a0 2024-04-25T09:05:35.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f9600dd5000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80b6dd0 con 0x5578131329d0 2024-04-25T09:05:35.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f9600dd5000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x557812f35300 con 0x5578131332f0 2024-04-25T09:05:35.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f9600dd5000 10 client.0 _ll_register_callbacks cb 0x5578130b4040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:35.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95f6a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578130e90a0 0x557813193310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95f6a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578130e90a0 0x557813193310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59136/0 (socket says 172.21.15.173:59136) 2024-04-25T09:05:35.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95f6a00640 1 -- 172.21.15.173:0/1801537795 learned_addr learned my addr 172.21.15.173:0/1801537795 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:35.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95ee000640 1 --2- 172.21.15.173:0/1801537795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578131329d0 0x557813193850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95f7400640 1 --2- 172.21.15.173:0/1801537795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578131332f0 0x557813145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95f6a00640 1 -- 172.21.15.173:0/1801537795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578131332f0 msgr2=0x557813145380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:35.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95f6a00640 1 --2- 172.21.15.173:0/1801537795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578131332f0 0x557813145380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95f6a00640 1 -- 172.21.15.173:0/1801537795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578131329d0 msgr2=0x557813193850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:35.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95f6a00640 1 --2- 172.21.15.173:0/1801537795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578131329d0 0x557813193850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95f6a00640 1 -- 172.21.15.173:0/1801537795 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557812ed78e0 con 0x5578130e90a0 2024-04-25T09:05:35.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95ee000640 1 --2- 172.21.15.173:0/1801537795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578131329d0 0x557813193850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:35.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95f6a00640 1 --2- 172.21.15.173:0/1801537795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578130e90a0 0x557813193310 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f95e8000f90 tx=0x7f95e8004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b37eb813bb12bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:35.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95dbe00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:05:35.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95dbe00640 1 -- 172.21.15.173:0/1801537795 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e80ccdc0 con 0x5578130e90a0 2024-04-25T09:05:35.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95dbe00640 1 -- 172.21.15.173:0/1801537795 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f95e80cc300 con 0x5578130e90a0 2024-04-25T09:05:35.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f9600dd5000 1 -- 172.21.15.173:0/1801537795 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557812f43530 con 0x5578130e90a0 2024-04-25T09:05:35.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95dbe00640 1 -- 172.21.15.173:0/1801537795 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95e80cc500 con 0x5578130e90a0 2024-04-25T09:05:35.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f9600dd5000 10 client.5643 fetch_fsmap learned FSMap version 19 2024-04-25T09:05:35.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f9600dd5000 1 -- 172.21.15.173:0/1801537795 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x557812f8f8f0 con 0x5578130e90a0 2024-04-25T09:05:35.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95dbe00640 1 -- 172.21.15.173:0/1801537795 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557812f43530 con 0x5578130e90a0 2024-04-25T09:05:35.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95dbe00640 1 -- 172.21.15.173:0/1801537795 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 19) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f95e80cc6a0 con 0x5578130e90a0 2024-04-25T09:05:35.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f9600dd5000 10 client.5643 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T09:05:35.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f9600dd5000 10 client.5643 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-04-25T09:05:35.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f9600dd5000 20 client.5643 populate_metadata read hostname 'smithi173' 2024-04-25T09:05:35.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f9600dd5000 1 --2- 172.21.15.173:0/1801537795 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x557813146030 0x557813146440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f9600dd5000 4 client.5643 mds_command: new command op to 5346 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:05:35.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f9600dd5000 1 -- 172.21.15.173:0/1801537795 --> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557812f3d880 con 0x557813146030 2024-04-25T09:05:35.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95ee000640 1 --2- 172.21.15.173:0/1801537795 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x557813146030 0x557813146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95ee000640 1 --2- 172.21.15.173:0/1801537795 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x557813146030 0x557813146440 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeb695c46f71b32 server_cookie=60fd8ac9c750e67a in_seq=0 out_seq=0 2024-04-25T09:05:35.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.931+0000 7f95dbe00640 10 client.5643 ms_handle_connect on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:35.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f95dbe00640 1 -- 172.21.15.173:0/1801537795 <== mds.0 v2:172.21.15.173:6834/960880761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x557812f3d880 con 0x557813146030 2024-04-25T09:05:35.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f95dbe00640 10 client.5643 handle_command_reply: tid=0 2024-04-25T09:05:35.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f9600dd5000 1 client.5643 shutdown 2024-04-25T09:05:35.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f9600dd5000 1 -- 172.21.15.173:0/1801537795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578130e90a0 msgr2=0x557813193310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f9600dd5000 1 --2- 172.21.15.173:0/1801537795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578130e90a0 0x557813193310 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f95e8000f90 tx=0x7f95e8004a50 comp rx=0 tx=0).stop 2024-04-25T09:05:35.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f9600dd5000 1 -- 172.21.15.173:0/1801537795 shutdown_connections 2024-04-25T09:05:35.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f9600dd5000 1 --2- 172.21.15.173:0/1801537795 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x557813146030 0x557813146440 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f9600dd5000 1 --2- 172.21.15.173:0/1801537795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5578131332f0 0x557813145380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f9600dd5000 1 --2- 172.21.15.173:0/1801537795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578131329d0 0x557813193850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f9600dd5000 1 --2- 172.21.15.173:0/1801537795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578130e90a0 0x557813193310 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f95dbe00640 0 client.5643 ms_handle_reset on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:35.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f9600dd5000 1 -- 172.21.15.173:0/1801537795 >> 172.21.15.173:0/1801537795 conn(0x5578130e5020 msgr2=0x557813131960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:35.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f9600dd5000 1 -- 172.21.15.173:0/1801537795 shutdown_connections 2024-04-25T09:05:35.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f9600dd5000 1 -- 172.21.15.173:0/1801537795 wait complete. 2024-04-25T09:05:35.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f9600dd5000 20 client.5643 trim_cache size 0 max 16384 2024-04-25T09:05:35.930 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:05:35.930 INFO:teuthology.orchestra.run.smithi173.stdout: "status": "no active scrubs running", 2024-04-25T09:05:35.931 INFO:teuthology.orchestra.run.smithi173.stdout: "scrubs": {} 2024-04-25T09:05:35.931 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:05:35.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f95fda00640 1 -- 172.21.15.173:0/2726577190 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f95d4066f60 msgr2=0x7f95d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f95fda00640 1 --2- 172.21.15.173:0/2726577190 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f95d4066f60 0x7f95d4069420 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f95e80af000 tx=0x7f95e80a7000 comp rx=0 tx=0).stop 2024-04-25T09:05:35.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f95fda00640 1 -- 172.21.15.173:0/2726577190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f80d22f0 msgr2=0x7f95f8153100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f95fda00640 1 --2- 172.21.15.173:0/2726577190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f80d22f0 0x7f95f8153100 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f95e000c480 tx=0x7f95e000c940 comp rx=0 tx=0).stop 2024-04-25T09:05:35.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f95fda00640 1 -- 172.21.15.173:0/2726577190 shutdown_connections 2024-04-25T09:05:35.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f95fda00640 1 --2- 172.21.15.173:0/2726577190 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f95d4066f60 0x7f95d4069420 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f95fda00640 1 --2- 172.21.15.173:0/2726577190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95f8163460 0x7f95f815ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f95fda00640 1 --2- 172.21.15.173:0/2726577190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95f80d22f0 0x7f95f8153100 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f95fda00640 1 --2- 172.21.15.173:0/2726577190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f80cc030 0x7f95f814ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f95fda00640 1 -- 172.21.15.173:0/2726577190 >> 172.21.15.173:0/2726577190 conn(0x7f95f80d17d0 msgr2=0x7f95f80b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:35.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f95fda00640 1 -- 172.21.15.173:0/2726577190 shutdown_connections 2024-04-25T09:05:35.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:35.935+0000 7f95fda00640 1 -- 172.21.15.173:0/2726577190 wait complete. 2024-04-25T09:05:35.945 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:05:35.945 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:05:35.945 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-04-25T09:05:36.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.091+0000 7f1f51200640 1 Processor -- start 2024-04-25T09:05:36.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.091+0000 7f1f51200640 1 -- start start 2024-04-25T09:05:36.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.091+0000 7f1f51200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1f4c145290 0x7f1f4c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.091+0000 7f1f51200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f4c0b3fe0 0x7f1f4c0b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.091+0000 7f1f51200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1f4c0cc260 0x7f1f4c0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.091+0000 7f1f51200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4c15c5f0 con 0x7f1f4c0cc260 2024-04-25T09:05:36.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.091+0000 7f1f51200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4c06d4b0 con 0x7f1f4c145290 2024-04-25T09:05:36.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.091+0000 7f1f51200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c06d790 con 0x7f1f4c0b3fe0 2024-04-25T09:05:36.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.095+0000 7f1f4a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1f4c0cc260 0x7f1f4c0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.095+0000 7f1f4a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1f4c0cc260 0x7f1f4c0cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59138/0 (socket says 172.21.15.173:59138) 2024-04-25T09:05:36.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.095+0000 7f1f4a800640 1 -- 172.21.15.173:0/3141106487 learned_addr learned my addr 172.21.15.173:0/3141106487 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:36.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.095+0000 7f1f41400640 1 --2- 172.21.15.173:0/3141106487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f4c0b3fe0 0x7f1f4c0b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.095+0000 7f1f49e00640 1 --2- 172.21.15.173:0/3141106487 >> v2:172.21.15.194:3300/0 conn(0x7f1f4c145290 0x7f1f4c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.095+0000 7f1f4a800640 1 -- 172.21.15.173:0/3141106487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f4c0b3fe0 msgr2=0x7f1f4c0b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:36.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.095+0000 7f1f4a800640 1 --2- 172.21.15.173:0/3141106487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f4c0b3fe0 0x7f1f4c0b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.095+0000 7f1f4a800640 1 -- 172.21.15.173:0/3141106487 >> v2:172.21.15.194:3300/0 conn(0x7f1f4c145290 msgr2=0x7f1f4c15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:36.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.095+0000 7f1f4a800640 1 --2- 172.21.15.173:0/3141106487 >> v2:172.21.15.194:3300/0 conn(0x7f1f4c145290 0x7f1f4c15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.095+0000 7f1f4a800640 1 -- 172.21.15.173:0/3141106487 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c06da70 con 0x7f1f4c0cc260 2024-04-25T09:05:36.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.095+0000 7f1f49e00640 1 --2- 172.21.15.173:0/3141106487 >> v2:172.21.15.194:3300/0 conn(0x7f1f4c145290 0x7f1f4c15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:36.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.095+0000 7f1f4a800640 1 --2- 172.21.15.173:0/3141106487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f4c0cc260 0x7f1f4c0cc6b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0d0800 tx=0x7f1f4401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e061de1af3aae5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.095+0000 7f1f49400640 1 -- 172.21.15.173:0/3141106487 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f440a5660 con 0x7f1f4c0cc260 2024-04-25T09:05:36.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.095+0000 7f1f49400640 1 -- 172.21.15.173:0/3141106487 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f440a5800 con 0x7f1f4c0cc260 2024-04-25T09:05:36.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.095+0000 7f1f49400640 1 -- 172.21.15.173:0/3141106487 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f440a5bd0 con 0x7f1f4c0cc260 2024-04-25T09:05:36.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f51200640 1 -- 172.21.15.173:0/3141106487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f4c0cc260 msgr2=0x7f1f4c0cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f51200640 1 --2- 172.21.15.173:0/3141106487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f4c0cc260 0x7f1f4c0cc6b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0d0800 tx=0x7f1f4401c8d0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f51200640 1 -- 172.21.15.173:0/3141106487 shutdown_connections 2024-04-25T09:05:36.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f51200640 1 --2- 172.21.15.173:0/3141106487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f4c0cc260 0x7f1f4c0cc6b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f51200640 1 --2- 172.21.15.173:0/3141106487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f4c0b3fe0 0x7f1f4c0b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f51200640 1 --2- 172.21.15.173:0/3141106487 >> v2:172.21.15.194:3300/0 conn(0x7f1f4c145290 0x7f1f4c15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f51200640 1 -- 172.21.15.173:0/3141106487 >> 172.21.15.173:0/3141106487 conn(0x7f1f4c06ac90 msgr2=0x7f1f4c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:36.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f51200640 1 -- 172.21.15.173:0/3141106487 shutdown_connections 2024-04-25T09:05:36.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f51200640 1 -- 172.21.15.173:0/3141106487 wait complete. 2024-04-25T09:05:36.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f51200640 1 Processor -- start 2024-04-25T09:05:36.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f51200640 1 -- start start 2024-04-25T09:05:36.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f51200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f4c0b3fe0 0x7f1f4c15b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f51200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f4c0cc260 0x7f1f4c0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f51200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f4c145290 0x7f1f4c0b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f51200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c1457f0 con 0x7f1f4c0b3fe0 2024-04-25T09:05:36.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f51200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c145670 con 0x7f1f4c0cc260 2024-04-25T09:05:36.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f51200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c06ed60 con 0x7f1f4c145290 2024-04-25T09:05:36.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f49e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f4c0b3fe0 0x7f1f4c15b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f49e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f4c0b3fe0 0x7f1f4c15b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59140/0 (socket says 172.21.15.173:59140) 2024-04-25T09:05:36.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f49e00640 1 -- 172.21.15.173:0/3966156213 learned_addr learned my addr 172.21.15.173:0/3966156213 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:36.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f41400640 1 --2- 172.21.15.173:0/3966156213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f4c0cc260 0x7f1f4c0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f4a800640 1 --2- 172.21.15.173:0/3966156213 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f4c145290 0x7f1f4c0b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f49e00640 1 -- 172.21.15.173:0/3966156213 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f4c145290 msgr2=0x7f1f4c0b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f49e00640 1 --2- 172.21.15.173:0/3966156213 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f4c145290 0x7f1f4c0b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f49e00640 1 -- 172.21.15.173:0/3966156213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f4c0cc260 msgr2=0x7f1f4c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f49e00640 1 --2- 172.21.15.173:0/3966156213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f4c0cc260 0x7f1f4c0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.099+0000 7f1f49e00640 1 -- 172.21.15.173:0/3966156213 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c0ad4a0 con 0x7f1f4c0b3fe0 2024-04-25T09:05:36.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.103+0000 7f1f49e00640 1 --2- 172.21.15.173:0/3966156213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f4c0b3fe0 0x7f1f4c15b270 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00d830 tx=0x7f1f3c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.103+0000 7f1f42a00640 1 -- 172.21.15.173:0/3966156213 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c018020 con 0x7f1f4c0b3fe0 2024-04-25T09:05:36.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.103+0000 7f1f42a00640 1 -- 172.21.15.173:0/3966156213 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c0096c0 con 0x7f1f4c0b3fe0 2024-04-25T09:05:36.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.103+0000 7f1f42a00640 1 -- 172.21.15.173:0/3966156213 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c009ab0 con 0x7f1f4c0b3fe0 2024-04-25T09:05:36.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.103+0000 7f1f51200640 1 -- 172.21.15.173:0/3966156213 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4c0ad780 con 0x7f1f4c0b3fe0 2024-04-25T09:05:36.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.103+0000 7f1f51200640 1 -- 172.21.15.173:0/3966156213 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4c0add40 con 0x7f1f4c0b3fe0 2024-04-25T09:05:36.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.103+0000 7f1f42a00640 1 -- 172.21.15.173:0/3966156213 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1f3c01b020 con 0x7f1f4c0b3fe0 2024-04-25T09:05:36.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.103+0000 7f1f42a00640 1 --2- 172.21.15.173:0/3966156213 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1f28066f60 0x7f1f28069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.103+0000 7f1f42a00640 1 -- 172.21.15.173:0/3966156213 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f1f3c085920 con 0x7f1f4c0b3fe0 2024-04-25T09:05:36.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.103+0000 7f1f41400640 1 --2- 172.21.15.173:0/3966156213 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1f28066f60 0x7f1f28069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.103+0000 7f1f54753000 1 Processor -- start 2024-04-25T09:05:36.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f41400640 1 --2- 172.21.15.173:0/3966156213 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1f28066f60 0x7f1f28069420 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0cc1f0 tx=0x7f1f34009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f54753000 1 -- start start 2024-04-25T09:05:36.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f54753000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f4906b6a40 0x55f4906b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f54753000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f4906b7360 0x55f490671850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f54753000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f490671d90 0x55f490672170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f54753000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4905541f0 con 0x55f490671d90 2024-04-25T09:05:36.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f54753000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4904bae90 con 0x55f4906b6a40 2024-04-25T09:05:36.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f54753000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f490442f50 con 0x55f4906b7360 2024-04-25T09:05:36.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f4a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f490671d90 0x55f490672170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f4a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f490671d90 0x55f490672170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59142/0 (socket says 172.21.15.173:59142) 2024-04-25T09:05:36.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f4a800640 1 -- 172.21.15.173:0/4105169737 learned_addr learned my addr 172.21.15.173:0/4105169737 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:36.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f49e00640 1 --2- 172.21.15.173:0/4105169737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f4906b6a40 0x55f4906b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f41400640 1 --2- 172.21.15.173:0/4105169737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f4906b7360 0x55f490671850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f4a800640 1 -- 172.21.15.173:0/4105169737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f4906b7360 msgr2=0x55f490671850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:36.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f4a800640 1 --2- 172.21.15.173:0/4105169737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f4906b7360 0x55f490671850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f4a800640 1 -- 172.21.15.173:0/4105169737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f4906b6a40 msgr2=0x55f4906b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:36.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f4a800640 1 --2- 172.21.15.173:0/4105169737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f4906b6a40 0x55f4906b6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f4a800640 1 -- 172.21.15.173:0/4105169737 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4904928b0 con 0x55f490671d90 2024-04-25T09:05:36.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f41400640 1 --2- 172.21.15.173:0/4105169737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f4906b7360 0x55f490671850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:36.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f4a800640 1 --2- 172.21.15.173:0/4105169737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f490671d90 0x55f490672170 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1f440af040 tx=0x7f1f44004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591682aac560a869 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f3aa00640 1 -- 172.21.15.173:0/4105169737 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f440a5660 con 0x55f490671d90 2024-04-25T09:05:36.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f3aa00640 1 -- 172.21.15.173:0/4105169737 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f440a5800 con 0x55f490671d90 2024-04-25T09:05:36.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f3aa00640 1 -- 172.21.15.173:0/4105169737 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f440a5bf0 con 0x55f490671d90 2024-04-25T09:05:36.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f54753000 1 -- 172.21.15.173:0/4105169737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f490671d90 msgr2=0x55f490672170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f54753000 1 --2- 172.21.15.173:0/4105169737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f490671d90 0x55f490672170 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1f440af040 tx=0x7f1f44004ac0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f54753000 1 -- 172.21.15.173:0/4105169737 shutdown_connections 2024-04-25T09:05:36.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f54753000 1 --2- 172.21.15.173:0/4105169737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f490671d90 0x55f490672170 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f54753000 1 --2- 172.21.15.173:0/4105169737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f4906b7360 0x55f490671850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f54753000 1 --2- 172.21.15.173:0/4105169737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f4906b6a40 0x55f4906b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f54753000 1 -- 172.21.15.173:0/4105169737 >> 172.21.15.173:0/4105169737 conn(0x55f49066dd40 msgr2=0x55f490670130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:36.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f54753000 1 -- 172.21.15.173:0/4105169737 shutdown_connections 2024-04-25T09:05:36.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f54753000 1 -- 172.21.15.173:0/4105169737 wait complete. 2024-04-25T09:05:36.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.107+0000 7f1f54753000 1 -- start start 2024-04-25T09:05:36.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f54753000 1 Processor -- start 2024-04-25T09:05:36.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f54753000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f490671d90 0x55f4906be1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f54753000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f4906b6a40 0x55f4906be700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f54753000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f4906b7360 0x55f490677e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f54753000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f490475540 con 0x55f490671d90 2024-04-25T09:05:36.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f54753000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4904b6f30 con 0x55f4906b7360 2024-04-25T09:05:36.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f54753000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f49047ce50 con 0x55f4906b6a40 2024-04-25T09:05:36.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f54753000 10 client.0 _ll_register_callbacks cb 0x55f49056f180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:36.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f49e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f490671d90 0x55f4906be1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f49e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f490671d90 0x55f4906be1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59144/0 (socket says 172.21.15.173:59144) 2024-04-25T09:05:36.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f49e00640 1 -- 172.21.15.173:0/3177258486 learned_addr learned my addr 172.21.15.173:0/3177258486 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:36.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f4a800640 1 --2- 172.21.15.173:0/3177258486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f4906b7360 0x55f490677e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f41400640 1 --2- 172.21.15.173:0/3177258486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f4906b6a40 0x55f4906be700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f49e00640 1 -- 172.21.15.173:0/3177258486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f4906b6a40 msgr2=0x55f4906be700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:36.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f49e00640 1 --2- 172.21.15.173:0/3177258486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f4906b6a40 0x55f4906be700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f49e00640 1 -- 172.21.15.173:0/3177258486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f4906b7360 msgr2=0x55f490677e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:36.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f49e00640 1 --2- 172.21.15.173:0/3177258486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f4906b7360 0x55f490677e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f49e00640 1 -- 172.21.15.173:0/3177258486 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f4904431a0 con 0x55f490671d90 2024-04-25T09:05:36.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f4a800640 1 --2- 172.21.15.173:0/3177258486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f4906b7360 0x55f490677e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:36.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f49e00640 1 --2- 172.21.15.173:0/3177258486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f490671d90 0x55f4906be1c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c083bf0 tx=0x7f1f3c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73718889f7b1d48d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f2f400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:05:36.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f2f400640 1 -- 172.21.15.173:0/3177258486 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c05e6e0 con 0x55f490671d90 2024-04-25T09:05:36.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f2f400640 1 -- 172.21.15.173:0/3177258486 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f1f3c0554d0 con 0x55f490671d90 2024-04-25T09:05:36.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f54753000 1 -- 172.21.15.173:0/3177258486 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1f440a5800 con 0x55f490671d90 2024-04-25T09:05:36.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f2f400640 1 -- 172.21.15.173:0/3177258486 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f3c074050 con 0x55f490671d90 2024-04-25T09:05:36.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f54753000 10 client.5655 fetch_fsmap learned FSMap version 19 2024-04-25T09:05:36.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f54753000 1 -- 172.21.15.173:0/3177258486 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55f49053d840 con 0x55f490671d90 2024-04-25T09:05:36.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f2f400640 1 -- 172.21.15.173:0/3177258486 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f440a5800 con 0x55f490671d90 2024-04-25T09:05:36.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f2f400640 1 -- 172.21.15.173:0/3177258486 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 19) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1f3c013050 con 0x55f490671d90 2024-04-25T09:05:36.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f54753000 10 client.5655 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T09:05:36.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f54753000 10 client.5655 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-04-25T09:05:36.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f54753000 20 client.5655 populate_metadata read hostname 'smithi173' 2024-04-25T09:05:36.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f54753000 1 --2- 172.21.15.173:0/3177258486 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x55f490678bf0 0x55f490679000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f54753000 4 client.5655 mds_command: new command op to 5346 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:36.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f54753000 1 -- 172.21.15.173:0/3177258486 --> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f490456be0 con 0x55f490678bf0 2024-04-25T09:05:36.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f41400640 1 --2- 172.21.15.173:0/3177258486 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x55f490678bf0 0x55f490679000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f41400640 1 --2- 172.21.15.173:0/3177258486 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x55f490678bf0 0x55f490679000 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=942072c76c1fa7a7 server_cookie=51490c7860809e4f in_seq=0 out_seq=0 2024-04-25T09:05:36.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.111+0000 7f1f2f400640 10 client.5655 ms_handle_connect on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:36.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.115+0000 7f1f2f400640 1 -- 172.21.15.173:0/3177258486 <== mds.0 v2:172.21.15.173:6834/960880761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f490456be0 con 0x55f490678bf0 2024-04-25T09:05:36.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.115+0000 7f1f2f400640 10 client.5655 handle_command_reply: tid=0 2024-04-25T09:05:36.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.115+0000 7f1f54753000 1 client.5655 shutdown 2024-04-25T09:05:36.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.115+0000 7f1f54753000 1 -- 172.21.15.173:0/3177258486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f490671d90 msgr2=0x55f4906be1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.115+0000 7f1f54753000 1 --2- 172.21.15.173:0/3177258486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f490671d90 0x55f4906be1c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c083bf0 tx=0x7f1f3c000bd0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.115+0000 7f1f54753000 1 -- 172.21.15.173:0/3177258486 shutdown_connections 2024-04-25T09:05:36.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.115+0000 7f1f54753000 1 --2- 172.21.15.173:0/3177258486 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x55f490678bf0 0x55f490679000 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.115+0000 7f1f54753000 1 --2- 172.21.15.173:0/3177258486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f4906b7360 0x55f490677e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.115+0000 7f1f54753000 1 --2- 172.21.15.173:0/3177258486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f4906b6a40 0x55f4906be700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.115+0000 7f1f54753000 1 --2- 172.21.15.173:0/3177258486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f490671d90 0x55f4906be1c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.115+0000 7f1f2f400640 0 client.5655 ms_handle_reset on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:36.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.115+0000 7f1f54753000 1 -- 172.21.15.173:0/3177258486 >> 172.21.15.173:0/3177258486 conn(0x55f49066dd40 msgr2=0x55f4906709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:36.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.115+0000 7f1f54753000 1 -- 172.21.15.173:0/3177258486 shutdown_connections 2024-04-25T09:05:36.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.115+0000 7f1f54753000 1 -- 172.21.15.173:0/3177258486 wait complete. 2024-04-25T09:05:36.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.115+0000 7f1f54753000 20 client.5655 trim_cache size 0 max 16384 2024-04-25T09:05:36.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.127+0000 7f1f54753000 1 Processor -- start 2024-04-25T09:05:36.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.127+0000 7f1f54753000 1 -- start start 2024-04-25T09:05:36.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.127+0000 7f1f54753000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f490671d90 0x55f490713290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.127+0000 7f1f54753000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4906b6a40 0x55f4907137d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.127+0000 7f1f54753000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f4906b7360 0x55f490713d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.127+0000 7f1f54753000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c2032e0 con 0x55f4906b6a40 2024-04-25T09:05:36.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.127+0000 7f1f54753000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c2024e0 con 0x55f4906b7360 2024-04-25T09:05:36.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.127+0000 7f1f54753000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c15d4d0 con 0x55f490671d90 2024-04-25T09:05:36.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f41400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4906b6a40 0x55f4907137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f41400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4906b6a40 0x55f4907137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59158/0 (socket says 172.21.15.173:59158) 2024-04-25T09:05:36.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f41400640 1 -- 172.21.15.173:0/4173998700 learned_addr learned my addr 172.21.15.173:0/4173998700 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:36.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f4a800640 1 --2- 172.21.15.173:0/4173998700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f4906b7360 0x55f490713d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f49e00640 1 --2- 172.21.15.173:0/4173998700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f490671d90 0x55f490713290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f41400640 1 -- 172.21.15.173:0/4173998700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f490671d90 msgr2=0x55f490713290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:36.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f41400640 1 --2- 172.21.15.173:0/4173998700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f490671d90 0x55f490713290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f41400640 1 -- 172.21.15.173:0/4173998700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f4906b7360 msgr2=0x55f490713d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:36.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f41400640 1 --2- 172.21.15.173:0/4173998700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f4906b7360 0x55f490713d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f41400640 1 -- 172.21.15.173:0/4173998700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f490514a10 con 0x55f4906b6a40 2024-04-25T09:05:36.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f41400640 1 --2- 172.21.15.173:0/4173998700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4906b6a40 0x55f4907137d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c15dbc0 tx=0x7f1f34018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04b946382ca80e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f3a000640 1 -- 172.21.15.173:0/4173998700 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3402f070 con 0x55f4906b6a40 2024-04-25T09:05:36.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f3a000640 1 -- 172.21.15.173:0/4173998700 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3401b070 con 0x55f4906b6a40 2024-04-25T09:05:36.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f3a000640 1 -- 172.21.15.173:0/4173998700 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f34011e20 con 0x55f4906b6a40 2024-04-25T09:05:36.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f54753000 1 -- 172.21.15.173:0/4173998700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4906b6a40 msgr2=0x55f4907137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f54753000 1 --2- 172.21.15.173:0/4173998700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4906b6a40 0x55f4907137d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c15dbc0 tx=0x7f1f34018000 comp rx=0 tx=0).stop 2024-04-25T09:05:36.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f54753000 1 -- 172.21.15.173:0/4173998700 shutdown_connections 2024-04-25T09:05:36.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f54753000 1 --2- 172.21.15.173:0/4173998700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f4906b7360 0x55f490713d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f54753000 1 --2- 172.21.15.173:0/4173998700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4906b6a40 0x55f4907137d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f54753000 1 --2- 172.21.15.173:0/4173998700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f490671d90 0x55f490713290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f54753000 1 -- 172.21.15.173:0/4173998700 >> 172.21.15.173:0/4173998700 conn(0x55f49066dd40 msgr2=0x55f4906b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:36.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f54753000 1 -- 172.21.15.173:0/4173998700 shutdown_connections 2024-04-25T09:05:36.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f54753000 1 -- 172.21.15.173:0/4173998700 wait complete. 2024-04-25T09:05:36.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f54753000 1 -- start start 2024-04-25T09:05:36.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f54753000 1 Processor -- start 2024-04-25T09:05:36.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f54753000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f490671d90 0x55f4907174b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f54753000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f4906b6a40 0x55f4907179f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f54753000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4906b7360 0x55f4906bbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f54753000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f490499010 con 0x55f4906b7360 2024-04-25T09:05:36.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f54753000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c1f78a0 con 0x55f490671d90 2024-04-25T09:05:36.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f54753000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4904b6f30 con 0x55f4906b6a40 2024-04-25T09:05:36.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f54753000 10 client.0 _ll_register_callbacks cb 0x55f49047da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:36.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f4a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4906b7360 0x55f4906bbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f4a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4906b7360 0x55f4906bbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59162/0 (socket says 172.21.15.173:59162) 2024-04-25T09:05:36.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f4a800640 1 -- 172.21.15.173:0/2622227881 learned_addr learned my addr 172.21.15.173:0/2622227881 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:36.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f49e00640 1 --2- 172.21.15.173:0/2622227881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f490671d90 0x55f4907174b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.131+0000 7f1f41400640 1 --2- 172.21.15.173:0/2622227881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f4906b6a40 0x55f4907179f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f4a800640 1 -- 172.21.15.173:0/2622227881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f4906b6a40 msgr2=0x55f4907179f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:36.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f4a800640 1 --2- 172.21.15.173:0/2622227881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f4906b6a40 0x55f4907179f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f4a800640 1 -- 172.21.15.173:0/2622227881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f490671d90 msgr2=0x55f4907174b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:36.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f4a800640 1 --2- 172.21.15.173:0/2622227881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f490671d90 0x55f4907174b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f4a800640 1 -- 172.21.15.173:0/2622227881 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f49044fb00 con 0x55f4906b7360 2024-04-25T09:05:36.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f4a800640 1 --2- 172.21.15.173:0/2622227881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4906b7360 0x55f4906bbed0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1f4401c700 tx=0x7f1f4401b110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2945ab769598b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f2f400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:05:36.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f2f400640 1 -- 172.21.15.173:0/2622227881 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f440cf060 con 0x55f4906b7360 2024-04-25T09:05:36.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f2f400640 1 -- 172.21.15.173:0/2622227881 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f1f44003a60 con 0x55f4906b7360 2024-04-25T09:05:36.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 1 -- 172.21.15.173:0/2622227881 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1f3401b070 con 0x55f4906b7360 2024-04-25T09:05:36.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f2f400640 1 -- 172.21.15.173:0/2622227881 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f44003c60 con 0x55f4906b7360 2024-04-25T09:05:36.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 10 client.5661 fetch_fsmap learned FSMap version 19 2024-04-25T09:05:36.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 1 -- 172.21.15.173:0/2622227881 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55f490461f80 con 0x55f4906b7360 2024-04-25T09:05:36.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f2f400640 1 -- 172.21.15.173:0/2622227881 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3401b070 con 0x55f4906b7360 2024-04-25T09:05:36.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f2f400640 1 -- 172.21.15.173:0/2622227881 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 19) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1f44008040 con 0x55f4906b7360 2024-04-25T09:05:36.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 10 client.5661 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T09:05:36.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 10 client.5661 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-04-25T09:05:36.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 20 client.5661 populate_metadata read hostname 'smithi173' 2024-04-25T09:05:36.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 1 --2- 172.21.15.173:0/2622227881 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x55f4906bc860 0x55f4906bcc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 4 client.5661 mds_command: new command op to 5346 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-04-25T09:05:36.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 1 -- 172.21.15.173:0/2622227881 --> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x55f4904c83d0 con 0x55f4906bc860 2024-04-25T09:05:36.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f49e00640 1 --2- 172.21.15.173:0/2622227881 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x55f4906bc860 0x55f4906bcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f49e00640 1 --2- 172.21.15.173:0/2622227881 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x55f4906bc860 0x55f4906bcc40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af7fc5c21d243149 server_cookie=46fb74f6318b0084 in_seq=0 out_seq=0 2024-04-25T09:05:36.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f2f400640 10 client.5661 ms_handle_connect on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:36.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f2f400640 1 -- 172.21.15.173:0/2622227881 <== mds.0 v2:172.21.15.173:6834/960880761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17930 (crc 0 0 0) 0x55f4904c83d0 con 0x55f4906bc860 2024-04-25T09:05:36.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f2f400640 10 client.5661 handle_command_reply: tid=0 2024-04-25T09:05:36.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 1 client.5661 shutdown 2024-04-25T09:05:36.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 1 -- 172.21.15.173:0/2622227881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4906b7360 msgr2=0x55f4906bbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 1 --2- 172.21.15.173:0/2622227881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4906b7360 0x55f4906bbed0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1f4401c700 tx=0x7f1f4401b110 comp rx=0 tx=0).stop 2024-04-25T09:05:36.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 1 -- 172.21.15.173:0/2622227881 shutdown_connections 2024-04-25T09:05:36.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 1 --2- 172.21.15.173:0/2622227881 >> [v2:172.21.15.173:6834/960880761,v1:172.21.15.173:6837/960880761] conn(0x55f4906bc860 0x55f4906bcc40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 1 --2- 172.21.15.173:0/2622227881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4906b7360 0x55f4906bbed0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 1 --2- 172.21.15.173:0/2622227881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f4906b6a40 0x55f4907179f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 1 --2- 172.21.15.173:0/2622227881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f490671d90 0x55f4907174b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f2f400640 0 client.5661 ms_handle_reset on v2:172.21.15.173:6834/960880761 2024-04-25T09:05:36.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 1 -- 172.21.15.173:0/2622227881 >> 172.21.15.173:0/2622227881 conn(0x55f49066dd40 msgr2=0x55f4906b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:36.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 1 -- 172.21.15.173:0/2622227881 shutdown_connections 2024-04-25T09:05:36.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 1 -- 172.21.15.173:0/2622227881 wait complete. 2024-04-25T09:05:36.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f54753000 20 client.5661 trim_cache size 0 max 16384 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 4019, 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 4020, 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 1010292, 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 38788782, 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 17, 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 6, 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.448819835, 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.208717896, 2024-04-25T09:05:36.133 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.093664921, 2024-04-25T09:05:36.134 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.108982722, 2024-04-25T09:05:36.134 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T09:05:36.134 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4018, 2024-04-25T09:05:36.134 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.695422786, 2024-04-25T09:05:36.134 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000173076 2024-04-25T09:05:36.134 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.134 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-04-25T09:05:36.134 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 10, 2024-04-25T09:05:36.134 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000001157, 2024-04-25T09:05:36.134 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000115 2024-04-25T09:05:36.134 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.134 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T09:05:36.134 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T09:05:36.134 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.135 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T09:05:36.135 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 3236, 2024-04-25T09:05:36.135 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 3258, 2024-04-25T09:05:36.135 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 814600, 2024-04-25T09:05:36.135 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 23275574, 2024-04-25T09:05:36.135 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 6, 2024-04-25T09:05:36.135 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 4, 2024-04-25T09:05:36.135 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.341099015, 2024-04-25T09:05:36.135 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.163807176, 2024-04-25T09:05:36.135 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.066532741, 2024-04-25T09:05:36.135 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.090185976, 2024-04-25T09:05:36.135 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T09:05:36.135 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3256, 2024-04-25T09:05:36.136 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.517451968, 2024-04-25T09:05:36.136 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000158922 2024-04-25T09:05:36.136 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.136 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-04-25T09:05:36.136 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.136 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.136 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.136 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.136 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-25T09:05:36.136 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 119344 2024-04-25T09:05:36.136 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.136 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T09:05:36.136 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 31470, 2024-04-25T09:05:36.136 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 52375, 2024-04-25T09:05:36.136 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 11199863, 2024-04-25T09:05:36.137 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 54960023, 2024-04-25T09:05:36.137 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 7, 2024-04-25T09:05:36.137 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 4, 2024-04-25T09:05:36.137 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 4.028830462, 2024-04-25T09:05:36.137 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 2.701167684, 2024-04-25T09:05:36.137 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 1.114087845, 2024-04-25T09:05:36.137 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.401723397, 2024-04-25T09:05:36.137 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T09:05:36.137 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 52375, 2024-04-25T09:05:36.137 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.782979483, 2024-04-25T09:05:36.137 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000034042 2024-04-25T09:05:36.137 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.137 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-04-25T09:05:36.137 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 47465, 2024-04-25T09:05:36.138 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.009109094, 2024-04-25T09:05:36.138 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000191 2024-04-25T09:05:36.138 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.138 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 121024, 2024-04-25T09:05:36.138 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 26768 2024-04-25T09:05:36.138 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.138 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-04-25T09:05:36.138 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-04-25T09:05:36.138 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-04-25T09:05:36.138 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.138 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-04-25T09:05:36.138 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-04-25T09:05:36.138 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-04-25T09:05:36.139 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 5672, 2024-04-25T09:05:36.139 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 13.390670015, 2024-04-25T09:05:36.139 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.002360837 2024-04-25T09:05:36.139 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:36.139 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.139 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-04-25T09:05:36.139 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-04-25T09:05:36.139 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-04-25T09:05:36.139 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3696, 2024-04-25T09:05:36.139 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.948361564, 2024-04-25T09:05:36.139 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000256591 2024-04-25T09:05:36.139 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:36.139 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.139 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-04-25T09:05:36.139 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 26223, 2024-04-25T09:05:36.139 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 26223, 2024-04-25T09:05:36.140 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-04-25T09:05:36.140 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 26223, 2024-04-25T09:05:36.140 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 261.042580101, 2024-04-25T09:05:36.140 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.009954718 2024-04-25T09:05:36.140 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.140 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-04-25T09:05:36.140 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 0, 2024-04-25T09:05:36.140 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-04-25T09:05:36.140 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-04-25T09:05:36.140 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 12, 2024-04-25T09:05:36.140 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 0, 2024-04-25T09:05:36.140 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-04-25T09:05:36.140 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 17702, 2024-04-25T09:05:36.140 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 0, 2024-04-25T09:05:36.140 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 17702, 2024-04-25T09:05:36.140 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 0, 2024-04-25T09:05:36.141 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 17702, 2024-04-25T09:05:36.141 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 0, 2024-04-25T09:05:36.141 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 2, 2024-04-25T09:05:36.141 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 2, 2024-04-25T09:05:36.141 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 2, 2024-04-25T09:05:36.141 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 48846, 2024-04-25T09:05:36.141 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 48340, 2024-04-25T09:05:36.141 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 0, 2024-04-25T09:05:36.141 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 0, 2024-04-25T09:05:36.141 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-04-25T09:05:36.141 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-04-25T09:05:36.141 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 145, 2024-04-25T09:05:36.141 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 0, 2024-04-25T09:05:36.141 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 0, 2024-04-25T09:05:36.141 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 0, 2024-04-25T09:05:36.142 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 0, 2024-04-25T09:05:36.142 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 0, 2024-04-25T09:05:36.142 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 0, 2024-04-25T09:05:36.142 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-04-25T09:05:36.142 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 1851, 2024-04-25T09:05:36.142 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-04-25T09:05:36.142 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 0, 2024-04-25T09:05:36.142 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 0, 2024-04-25T09:05:36.142 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 0, 2024-04-25T09:05:36.142 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 1851, 2024-04-25T09:05:36.142 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-04-25T09:05:36.142 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T09:05:36.142 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-04-25T09:05:36.142 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 13, 2024-04-25T09:05:36.142 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 2, 2024-04-25T09:05:36.143 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 11, 2024-04-25T09:05:36.143 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 1838, 2024-04-25T09:05:36.143 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 0, 2024-04-25T09:05:36.143 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 1505, 2024-04-25T09:05:36.143 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 4057, 2024-04-25T09:05:36.143 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T09:05:36.143 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T09:05:36.143 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T09:05:36.143 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 4541, 2024-04-25T09:05:36.143 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 2000, 2024-04-25T09:05:36.143 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 33, 2024-04-25T09:05:36.143 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 14085 2024-04-25T09:05:36.143 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.143 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-04-25T09:05:36.144 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 0, 2024-04-25T09:05:36.144 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 0, 2024-04-25T09:05:36.144 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 0, 2024-04-25T09:05:36.144 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 0, 2024-04-25T09:05:36.144 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 0, 2024-04-25T09:05:36.144 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 0, 2024-04-25T09:05:36.144 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-04-25T09:05:36.144 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-04-25T09:05:36.144 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 4098, 2024-04-25T09:05:36.144 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 3784, 2024-04-25T09:05:36.144 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 2198, 2024-04-25T09:05:36.144 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-04-25T09:05:36.144 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-04-25T09:05:36.144 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-04-25T09:05:36.145 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-04-25T09:05:36.145 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-04-25T09:05:36.145 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-04-25T09:05:36.145 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 1, 2024-04-25T09:05:36.145 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 0, 2024-04-25T09:05:36.145 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-04-25T09:05:36.145 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 0, 2024-04-25T09:05:36.145 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-04-25T09:05:36.145 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2024-04-25T09:05:36.145 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.145 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-04-25T09:05:36.145 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-04-25T09:05:36.145 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 29815, 2024-04-25T09:05:36.145 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-04-25T09:05:36.145 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-04-25T09:05:36.145 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 29815, 2024-04-25T09:05:36.146 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-04-25T09:05:36.146 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-04-25T09:05:36.146 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 46, 2024-04-25T09:05:36.146 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-04-25T09:05:36.146 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-04-25T09:05:36.146 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 46, 2024-04-25T09:05:36.146 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 4, 2024-04-25T09:05:36.146 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-04-25T09:05:36.146 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-04-25T09:05:36.146 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-04-25T09:05:36.146 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 95410493, 2024-04-25T09:05:36.146 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 0, 2024-04-25T09:05:36.146 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-04-25T09:05:36.146 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4040, 2024-04-25T09:05:36.146 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 78.345671080, 2024-04-25T09:05:36.147 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.019392492 2024-04-25T09:05:36.147 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.147 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 0 2024-04-25T09:05:36.147 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.147 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-04-25T09:05:36.147 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 14, 2024-04-25T09:05:36.147 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 2016, 2024-04-25T09:05:36.147 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 2002, 2024-04-25T09:05:36.147 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 13, 2024-04-25T09:05:36.147 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 13, 2024-04-25T09:05:36.147 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 0, 2024-04-25T09:05:36.147 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 17702, 2024-04-25T09:05:36.147 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 19703, 2024-04-25T09:05:36.147 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 2001, 2024-04-25T09:05:36.147 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 2, 2024-04-25T09:05:36.147 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 4246, 2024-04-25T09:05:36.148 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 4244, 2024-04-25T09:05:36.148 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 97172, 2024-04-25T09:05:36.148 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 215340 2024-04-25T09:05:36.148 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.148 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-04-25T09:05:36.148 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 29706, 2024-04-25T09:05:36.148 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 0, 2024-04-25T09:05:36.148 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 26223, 2024-04-25T09:05:36.148 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 5, 2024-04-25T09:05:36.148 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 0, 2024-04-25T09:05:36.148 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-04-25T09:05:36.148 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2000, 2024-04-25T09:05:36.148 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.563032377, 2024-04-25T09:05:36.148 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000781516 2024-04-25T09:05:36.148 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.148 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-04-25T09:05:36.149 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 28, 2024-04-25T09:05:36.149 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.003836368, 2024-04-25T09:05:36.149 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000137013 2024-04-25T09:05:36.149 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.149 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-04-25T09:05:36.149 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.149 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.149 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.149 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.149 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-04-25T09:05:36.149 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 6000, 2024-04-25T09:05:36.149 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 6.975819789, 2024-04-25T09:05:36.149 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001162636 2024-04-25T09:05:36.149 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.149 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-04-25T09:05:36.149 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 7984, 2024-04-25T09:05:36.150 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 6.729171664, 2024-04-25T09:05:36.150 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000842832 2024-04-25T09:05:36.150 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.150 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-04-25T09:05:36.150 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.150 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.150 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.150 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.150 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-04-25T09:05:36.150 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.150 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.150 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.150 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.151 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-04-25T09:05:36.151 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.151 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.151 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.151 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.151 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-04-25T09:05:36.151 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.151 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.151 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.151 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.151 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-04-25T09:05:36.151 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:05:36.151 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000095606, 2024-04-25T09:05:36.151 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000095606 2024-04-25T09:05:36.152 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.152 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-04-25T09:05:36.152 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.152 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.152 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.152 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.152 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-04-25T09:05:36.152 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:05:36.152 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.003596449, 2024-04-25T09:05:36.152 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.003596449 2024-04-25T09:05:36.152 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.152 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-04-25T09:05:36.152 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.153 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.153 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.153 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.153 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-04-25T09:05:36.153 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:05:36.153 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.006353185, 2024-04-25T09:05:36.153 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.006353185 2024-04-25T09:05:36.153 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.153 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-04-25T09:05:36.153 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.153 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.153 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.154 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.154 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-04-25T09:05:36.154 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 8, 2024-04-25T09:05:36.154 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.092922705, 2024-04-25T09:05:36.154 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.011615338 2024-04-25T09:05:36.154 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.154 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-04-25T09:05:36.154 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2198, 2024-04-25T09:05:36.154 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 229.099545519, 2024-04-25T09:05:36.154 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.104230912 2024-04-25T09:05:36.154 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.154 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-04-25T09:05:36.155 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.155 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.155 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.155 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.155 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-04-25T09:05:36.155 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.155 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.155 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.155 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.155 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-04-25T09:05:36.155 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.155 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.155 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.155 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.155 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-04-25T09:05:36.155 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:05:36.156 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.009876617, 2024-04-25T09:05:36.156 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.009876617 2024-04-25T09:05:36.156 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.156 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-04-25T09:05:36.156 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.156 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.156 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.156 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.156 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-04-25T09:05:36.156 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:05:36.156 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000274790, 2024-04-25T09:05:36.156 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000274790 2024-04-25T09:05:36.156 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.157 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-04-25T09:05:36.157 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.157 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.157 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.157 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.157 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-04-25T09:05:36.157 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.157 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.157 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.157 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.157 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-04-25T09:05:36.157 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.157 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.157 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.157 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.157 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-04-25T09:05:36.158 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.158 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.158 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.158 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.158 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-04-25T09:05:36.158 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.158 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.158 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.158 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.158 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-04-25T09:05:36.158 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 8000, 2024-04-25T09:05:36.158 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 16.558055032, 2024-04-25T09:05:36.158 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.002069756 2024-04-25T09:05:36.158 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.159 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-04-25T09:05:36.159 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-04-25T09:05:36.159 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-04-25T09:05:36.159 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.159 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.159 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.159 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:36.159 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.159 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-04-25T09:05:36.159 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 1, 2024-04-25T09:05:36.159 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 1, 2024-04-25T09:05:36.159 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 0, 2024-04-25T09:05:36.159 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 1, 2024-04-25T09:05:36.159 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-04-25T09:05:36.159 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 18899, 2024-04-25T09:05:36.160 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 18899, 2024-04-25T09:05:36.160 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 81, 2024-04-25T09:05:36.160 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-04-25T09:05:36.160 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.160 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-04-25T09:05:36.160 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-04-25T09:05:36.160 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-04-25T09:05:36.160 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T09:05:36.160 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-04-25T09:05:36.160 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T09:05:36.160 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-04-25T09:05:36.160 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T09:05:36.160 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T09:05:36.160 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T09:05:36.161 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T09:05:36.161 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T09:05:36.161 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-04-25T09:05:36.161 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T09:05:36.161 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T09:05:36.161 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-04-25T09:05:36.161 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-04-25T09:05:36.161 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-04-25T09:05:36.161 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-04-25T09:05:36.161 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T09:05:36.161 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T09:05:36.161 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T09:05:36.161 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T09:05:36.161 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T09:05:36.161 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-04-25T09:05:36.162 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-04-25T09:05:36.162 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-04-25T09:05:36.162 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T09:05:36.162 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T09:05:36.162 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-04-25T09:05:36.162 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-04-25T09:05:36.162 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-04-25T09:05:36.162 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-04-25T09:05:36.162 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T09:05:36.162 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-04-25T09:05:36.162 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T09:05:36.162 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-04-25T09:05:36.162 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 250898, 2024-04-25T09:05:36.162 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 90, 2024-04-25T09:05:36.163 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-04-25T09:05:36.163 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-04-25T09:05:36.163 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-04-25T09:05:36.163 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-04-25T09:05:36.163 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-04-25T09:05:36.163 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-04-25T09:05:36.163 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-04-25T09:05:36.163 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-04-25T09:05:36.163 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 5624, 2024-04-25T09:05:36.163 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 80, 2024-04-25T09:05:36.163 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T09:05:36.163 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-04-25T09:05:36.163 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-04-25T09:05:36.163 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-04-25T09:05:36.164 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 13331996, 2024-04-25T09:05:36.164 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 659866, 2024-04-25T09:05:36.164 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-04-25T09:05:36.164 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-04-25T09:05:36.164 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-04-25T09:05:36.164 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-04-25T09:05:36.164 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.164 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-04-25T09:05:36.164 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-04-25T09:05:36.164 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-04-25T09:05:36.164 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 9893, 2024-04-25T09:05:36.164 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 91845432, 2024-04-25T09:05:36.164 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 37, 2024-04-25T09:05:36.164 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 9893, 2024-04-25T09:05:36.164 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-04-25T09:05:36.164 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 9893, 2024-04-25T09:05:36.165 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 44.050976809, 2024-04-25T09:05:36.165 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.004452742 2024-04-25T09:05:36.165 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.165 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-04-25T09:05:36.165 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-04-25T09:05:36.165 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 9893, 2024-04-25T09:05:36.165 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 9989 2024-04-25T09:05:36.165 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.165 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 9893, 2024-04-25T09:05:36.165 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 1894, 2024-04-25T09:05:36.165 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 7999, 2024-04-25T09:05:36.165 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-04-25T09:05:36.165 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-04-25T09:05:36.165 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 0, 2024-04-25T09:05:36.165 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 11, 2024-04-25T09:05:36.165 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 41, 2024-04-25T09:05:36.165 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 4079, 2024-04-25T09:05:36.166 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 27, 2024-04-25T09:05:36.166 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-04-25T09:05:36.166 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-04-25T09:05:36.166 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 1784, 2024-04-25T09:05:36.166 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 0, 2024-04-25T09:05:36.166 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 2033, 2024-04-25T09:05:36.166 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-04-25T09:05:36.166 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-04-25T09:05:36.166 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-04-25T09:05:36.166 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 1853, 2024-04-25T09:05:36.166 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 22, 2024-04-25T09:05:36.166 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-04-25T09:05:36.166 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-04-25T09:05:36.166 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-04-25T09:05:36.167 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-04-25T09:05:36.167 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-04-25T09:05:36.167 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-04-25T09:05:36.167 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T09:05:36.167 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-04-25T09:05:36.167 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-04-25T09:05:36.167 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-04-25T09:05:36.167 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-04-25T09:05:36.167 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-04-25T09:05:36.167 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-04-25T09:05:36.167 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-04-25T09:05:36.167 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-04-25T09:05:36.167 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-04-25T09:05:36.167 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-04-25T09:05:36.167 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-04-25T09:05:36.167 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-04-25T09:05:36.168 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-04-25T09:05:36.168 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-04-25T09:05:36.168 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-04-25T09:05:36.168 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-04-25T09:05:36.168 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-04-25T09:05:36.168 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-04-25T09:05:36.168 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-04-25T09:05:36.168 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 44, 2024-04-25T09:05:36.168 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-04-25T09:05:36.168 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 5, 2024-04-25T09:05:36.168 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 8, 2024-04-25T09:05:36.168 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 8, 2024-04-25T09:05:36.168 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-04-25T09:05:36.168 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-04-25T09:05:36.168 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 109, 2024-04-25T09:05:36.168 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 0, 2024-04-25T09:05:36.168 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 30 2024-04-25T09:05:36.168 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.169 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-04-25T09:05:36.169 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 1, 2024-04-25T09:05:36.169 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-04-25T09:05:36.169 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-04-25T09:05:36.169 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-04-25T09:05:36.169 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.169 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2024-04-25T09:05:36.169 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 0 2024-04-25T09:05:36.169 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.169 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-04-25T09:05:36.169 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-04-25T09:05:36.169 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 32, 2024-04-25T09:05:36.169 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-04-25T09:05:36.169 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 32, 2024-04-25T09:05:36.169 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 3784, 2024-04-25T09:05:36.169 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 3784, 2024-04-25T09:05:36.170 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-04-25T09:05:36.170 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.170 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T09:05:36.170 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-04-25T09:05:36.170 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-04-25T09:05:36.170 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:05:36.170 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 38721, 2024-04-25T09:05:36.170 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 9993815, 2024-04-25T09:05:36.170 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:05:36.170 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 38721, 2024-04-25T09:05:36.170 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-04-25T09:05:36.170 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-04-25T09:05:36.170 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 38721, 2024-04-25T09:05:36.170 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 9993815, 2024-04-25T09:05:36.170 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:05:36.170 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.171 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.171 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.171 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:36.171 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.171 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-04-25T09:05:36.171 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-04-25T09:05:36.171 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-04-25T09:05:36.171 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:05:36.171 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-04-25T09:05:36.171 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-04-25T09:05:36.171 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:05:36.171 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-04-25T09:05:36.171 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 9893, 2024-04-25T09:05:36.171 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 92241888, 2024-04-25T09:05:36.171 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 9893, 2024-04-25T09:05:36.171 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 92241888, 2024-04-25T09:05:36.171 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:05:36.171 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.172 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.172 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.172 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:36.172 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.172 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-04-25T09:05:36.172 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-04-25T09:05:36.172 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-04-25T09:05:36.172 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:05:36.172 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-04-25T09:05:36.172 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-04-25T09:05:36.172 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:05:36.172 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-04-25T09:05:36.172 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 9893, 2024-04-25T09:05:36.172 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 9893, 2024-04-25T09:05:36.172 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 9893, 2024-04-25T09:05:36.172 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 9893, 2024-04-25T09:05:36.172 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:05:36.173 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.173 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.173 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.173 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:36.173 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.173 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-04-25T09:05:36.173 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-04-25T09:05:36.173 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-04-25T09:05:36.173 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:05:36.173 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 3784, 2024-04-25T09:05:36.173 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 396456, 2024-04-25T09:05:36.173 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:05:36.173 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 3784, 2024-04-25T09:05:36.173 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-04-25T09:05:36.173 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-04-25T09:05:36.173 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 39, 2024-04-25T09:05:36.173 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 396456, 2024-04-25T09:05:36.173 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:05:36.174 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.174 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.174 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.174 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:36.174 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:36.174 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x555b9eb2aa00": { 2024-04-25T09:05:36.174 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-04-25T09:05:36.174 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-04-25T09:05:36.174 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:05:36.174 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 29815, 2024-04-25T09:05:36.174 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 91216189, 2024-04-25T09:05:36.174 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:05:36.174 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 29815, 2024-04-25T09:05:36.174 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-04-25T09:05:36.174 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-04-25T09:05:36.174 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 4040, 2024-04-25T09:05:36.175 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 91216189, 2024-04-25T09:05:36.175 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:05:36.175 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:05:36.175 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:05:36.175 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:05:36.175 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:36.175 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:36.175 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:05:36.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f51200640 1 -- 172.21.15.173:0/3966156213 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1f28066f60 msgr2=0x7f1f28069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f51200640 1 --2- 172.21.15.173:0/3966156213 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1f28066f60 0x7f1f28069420 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0cc1f0 tx=0x7f1f34009190 comp rx=0 tx=0).stop 2024-04-25T09:05:36.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f51200640 1 -- 172.21.15.173:0/3966156213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f4c0b3fe0 msgr2=0x7f1f4c15b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.135+0000 7f1f51200640 1 --2- 172.21.15.173:0/3966156213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f4c0b3fe0 0x7f1f4c15b270 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00d830 tx=0x7f1f3c00dcf0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.139+0000 7f1f51200640 1 -- 172.21.15.173:0/3966156213 shutdown_connections 2024-04-25T09:05:36.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.139+0000 7f1f51200640 1 --2- 172.21.15.173:0/3966156213 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1f28066f60 0x7f1f28069420 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.139+0000 7f1f51200640 1 --2- 172.21.15.173:0/3966156213 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f4c145290 0x7f1f4c0b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.139+0000 7f1f51200640 1 --2- 172.21.15.173:0/3966156213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f4c0cc260 0x7f1f4c0b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.139+0000 7f1f51200640 1 --2- 172.21.15.173:0/3966156213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f4c0b3fe0 0x7f1f4c15b270 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.139+0000 7f1f51200640 1 -- 172.21.15.173:0/3966156213 >> 172.21.15.173:0/3966156213 conn(0x7f1f4c06ac90 msgr2=0x7f1f4c0af3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:36.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.139+0000 7f1f51200640 1 -- 172.21.15.173:0/3966156213 shutdown_connections 2024-04-25T09:05:36.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.139+0000 7f1f51200640 1 -- 172.21.15.173:0/3966156213 wait complete. 2024-04-25T09:05:36.178 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:05:36.178 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:05:36.240 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:05:36.329 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:05:36.329 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:05:36.329 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:36.337 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:05:36.338 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:36.388 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:36.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.575+0000 7f9de8c00640 1 Processor -- start 2024-04-25T09:05:36.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.575+0000 7f9de8c00640 1 -- start start 2024-04-25T09:05:36.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.575+0000 7f9de8c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9de415d940 0x7f9de4099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.575+0000 7f9de8c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9de406c0b0 0x7f9de406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.575+0000 7f9de8c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de415dd20 con 0x7f9de40b0de0 2024-04-25T09:05:36.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.575+0000 7f9de8c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de40b13a0 con 0x7f9de415d940 2024-04-25T09:05:36.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.575+0000 7f9de8c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de40b1680 con 0x7f9de406c0b0 2024-04-25T09:05:36.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.575+0000 7f9de3400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9de415d940 0x7f9de4099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.575+0000 7f9de3400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9de415d940 0x7f9de4099a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59176/0 (socket says 172.21.15.173:59176) 2024-04-25T09:05:36.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.575+0000 7f9de3400640 1 -- 172.21.15.173:0/65188978 learned_addr learned my addr 172.21.15.173:0/65188978 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:36.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.575+0000 7f9de3e00640 1 --2- 172.21.15.173:0/65188978 >> v2:172.21.15.194:3300/0 conn(0x7f9de406c0b0 0x7f9de406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.575+0000 7f9de3400640 1 -- 172.21.15.173:0/65188978 >> v2:172.21.15.194:3300/0 conn(0x7f9de406c0b0 msgr2=0x7f9de406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:36.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.575+0000 7f9de3400640 1 --2- 172.21.15.173:0/65188978 >> v2:172.21.15.194:3300/0 conn(0x7f9de406c0b0 0x7f9de406c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.575+0000 7f9de3400640 1 -- 172.21.15.173:0/65188978 >> v1:172.21.15.194:6789/0 conn(0x7f9de40b0de0 legacy=0x7f9de4099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.575+0000 7f9de3400640 1 -- 172.21.15.173:0/65188978 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de40b1960 con 0x7f9de415d940 2024-04-25T09:05:36.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.579+0000 7f9de3400640 1 --2- 172.21.15.173:0/65188978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de415d940 0x7f9de4099a50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9de40cbc00 tx=0x7f9dd401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e0c3c5f92a5208 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.579+0000 7f9de2a00640 1 -- 172.21.15.173:0/65188978 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd40ab660 con 0x7f9de415d940 2024-04-25T09:05:36.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.579+0000 7f9de2a00640 1 -- 172.21.15.173:0/65188978 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd40b0070 con 0x7f9de415d940 2024-04-25T09:05:36.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.579+0000 7f9de2a00640 1 -- 172.21.15.173:0/65188978 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd40aba20 con 0x7f9de415d940 2024-04-25T09:05:36.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.579+0000 7f9de8c00640 1 -- 172.21.15.173:0/65188978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de415d940 msgr2=0x7f9de4099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.579+0000 7f9de8c00640 1 --2- 172.21.15.173:0/65188978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de415d940 0x7f9de4099a50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9de40cbc00 tx=0x7f9dd401c460 comp rx=0 tx=0).stop 2024-04-25T09:05:36.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.579+0000 7f9de8c00640 1 -- 172.21.15.173:0/65188978 shutdown_connections 2024-04-25T09:05:36.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.579+0000 7f9de8c00640 1 --2- 172.21.15.173:0/65188978 >> v2:172.21.15.194:3300/0 conn(0x7f9de406c0b0 0x7f9de406c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.579+0000 7f9de8c00640 1 --2- 172.21.15.173:0/65188978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de415d940 0x7f9de4099a50 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.579+0000 7f9de8c00640 1 -- 172.21.15.173:0/65188978 >> 172.21.15.173:0/65188978 conn(0x7f9de40d1620 msgr2=0x7f9de40d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:36.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.579+0000 7f9de8c00640 1 -- 172.21.15.173:0/65188978 shutdown_connections 2024-04-25T09:05:36.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.579+0000 7f9de8c00640 1 -- 172.21.15.173:0/65188978 wait complete. 2024-04-25T09:05:36.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.579+0000 7f9de8c00640 1 Processor -- start 2024-04-25T09:05:36.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.579+0000 7f9de8c00640 1 -- start start 2024-04-25T09:05:36.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de8c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9de406c0b0 0x7f9de40702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de8c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9de40b0de0 0x7f9de40b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de8c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de415d940 0x7f9de40b6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de8c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de409a6a0 con 0x7f9de415d940 2024-04-25T09:05:36.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de8c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de40b2440 con 0x7f9de40b0de0 2024-04-25T09:05:36.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de8c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de409a820 con 0x7f9de406c0b0 2024-04-25T09:05:36.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de415d940 0x7f9de40b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de415d940 0x7f9de40b6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59184/0 (socket says 172.21.15.173:59184) 2024-04-25T09:05:36.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de3e00640 1 -- 172.21.15.173:0/3550323481 learned_addr learned my addr 172.21.15.173:0/3550323481 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:36.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de3400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9de406c0b0 0x7f9de40702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9ddbe00640 1 --2- 172.21.15.173:0/3550323481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9de40b0de0 0x7f9de40b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de3e00640 1 -- 172.21.15.173:0/3550323481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9de406c0b0 msgr2=0x7f9de40702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de3e00640 1 --2- 172.21.15.173:0/3550323481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9de406c0b0 0x7f9de40702d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de3e00640 1 -- 172.21.15.173:0/3550323481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9de40b0de0 msgr2=0x7f9de40b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de3e00640 1 --2- 172.21.15.173:0/3550323481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9de40b0de0 0x7f9de40b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de3e00640 1 -- 172.21.15.173:0/3550323481 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de41f9cb0 con 0x7f9de415d940 2024-04-25T09:05:36.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de3e00640 1 --2- 172.21.15.173:0/3550323481 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de415d940 0x7f9de40b6890 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00efc0 tx=0x7f9ddc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9ddb400640 1 -- 172.21.15.173:0/3550323481 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc018020 con 0x7f9de415d940 2024-04-25T09:05:36.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9ddb400640 1 -- 172.21.15.173:0/3550323481 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ddc014480 con 0x7f9de415d940 2024-04-25T09:05:36.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de8c00640 1 -- 172.21.15.173:0/3550323481 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de41f9f90 con 0x7f9de415d940 2024-04-25T09:05:36.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9ddb400640 1 -- 172.21.15.173:0/3550323481 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc014870 con 0x7f9de415d940 2024-04-25T09:05:36.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de8c00640 1 -- 172.21.15.173:0/3550323481 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de41fa550 con 0x7f9de415d940 2024-04-25T09:05:36.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.583+0000 7f9de8c00640 1 -- 172.21.15.173:0/3550323481 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de4073a40 con 0x7f9de415d940 2024-04-25T09:05:36.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.587+0000 7f9ddb400640 1 -- 172.21.15.173:0/3550323481 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9ddc01b020 con 0x7f9de415d940 2024-04-25T09:05:36.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.587+0000 7f9ddb400640 1 --2- 172.21.15.173:0/3550323481 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9dc0066f90 0x7f9dc0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.587+0000 7f9ddb400640 1 -- 172.21.15.173:0/3550323481 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f9ddc085f30 con 0x7f9de415d940 2024-04-25T09:05:36.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.587+0000 7f9de3400640 1 --2- 172.21.15.173:0/3550323481 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9dc0066f90 0x7f9dc0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.587+0000 7f9de3400640 1 --2- 172.21.15.173:0/3550323481 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9dc0066f90 0x7f9dc0069450 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40af000 tx=0x7f9dd40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.591+0000 7f9ddb400640 1 -- 172.21.15.173:0/3550323481 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9ddc022020 con 0x7f9de415d940 2024-04-25T09:05:36.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.747+0000 7f9de8c00640 1 -- 172.21.15.173:0/3550323481 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9de41fa720 con 0x7f9de415d940 2024-04-25T09:05:36.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.747+0000 7f9ddb400640 1 -- 172.21.15.173:0/3550323481 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+17059 (secure 0 0 0) 0x7f9ddc010040 con 0x7f9de415d940 2024-04-25T09:05:36.741 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:36.741 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":44,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:05:15.433778+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:00.889429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:02.209182+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:36.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.751+0000 7f9de8c00640 1 -- 172.21.15.173:0/3550323481 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9dc0066f90 msgr2=0x7f9dc0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.751+0000 7f9de8c00640 1 --2- 172.21.15.173:0/3550323481 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9dc0066f90 0x7f9dc0069450 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40af000 tx=0x7f9dd40a7000 comp rx=0 tx=0).stop 2024-04-25T09:05:36.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.751+0000 7f9de8c00640 1 -- 172.21.15.173:0/3550323481 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de415d940 msgr2=0x7f9de40b6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.751+0000 7f9de8c00640 1 --2- 172.21.15.173:0/3550323481 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de415d940 0x7f9de40b6890 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00efc0 tx=0x7f9ddc00c490 comp rx=0 tx=0).stop 2024-04-25T09:05:36.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.751+0000 7f9de8c00640 1 -- 172.21.15.173:0/3550323481 shutdown_connections 2024-04-25T09:05:36.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.751+0000 7f9de8c00640 1 --2- 172.21.15.173:0/3550323481 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9dc0066f90 0x7f9dc0069450 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.751+0000 7f9de8c00640 1 --2- 172.21.15.173:0/3550323481 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9de415d940 0x7f9de40b6890 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.751+0000 7f9de8c00640 1 --2- 172.21.15.173:0/3550323481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9de40b0de0 0x7f9de40b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.751+0000 7f9de8c00640 1 --2- 172.21.15.173:0/3550323481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9de406c0b0 0x7f9de40702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.751+0000 7f9de8c00640 1 -- 172.21.15.173:0/3550323481 >> 172.21.15.173:0/3550323481 conn(0x7f9de40d1620 msgr2=0x7f9de40af490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:36.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.751+0000 7f9de8c00640 1 -- 172.21.15.173:0/3550323481 shutdown_connections 2024-04-25T09:05:36.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.751+0000 7f9de8c00640 1 -- 172.21.15.173:0/3550323481 wait complete. 2024-04-25T09:05:36.763 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:00.889429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:04:02.209182+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 43, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:05:36.764 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:05:36.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.911+0000 7fccc1e00640 1 Processor -- start 2024-04-25T09:05:36.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.911+0000 7fccc1e00640 1 -- start start 2024-04-25T09:05:36.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.911+0000 7fccc1e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fccbc0b3fe0 0x7fccbc0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.911+0000 7fccc1e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fccbc0cc260 0x7fccbc0cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.911+0000 7fccc1e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccbc06d4b0 con 0x7fccbc145290 2024-04-25T09:05:36.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.911+0000 7fccc1e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccbc06d790 con 0x7fccbc0b3fe0 2024-04-25T09:05:36.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.911+0000 7fccc1e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccbc06da70 con 0x7fccbc0cc260 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.911+0000 7fccba000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fccbc0b3fe0 0x7fccbc0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.911+0000 7fccba000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fccbc0b3fe0 0x7fccbc0b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59190/0 (socket says 172.21.15.173:59190) 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.911+0000 7fccba000640 1 -- 172.21.15.173:0/1266506025 learned_addr learned my addr 172.21.15.173:0/1266506025 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.911+0000 7fccbb400640 1 --2- 172.21.15.173:0/1266506025 >> v2:172.21.15.194:3300/0 conn(0x7fccbc0cc260 0x7fccbc0cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.911+0000 7fccba000640 1 -- 172.21.15.173:0/1266506025 >> v2:172.21.15.194:3300/0 conn(0x7fccbc0cc260 msgr2=0x7fccbc0cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.911+0000 7fccba000640 1 --2- 172.21.15.173:0/1266506025 >> v2:172.21.15.194:3300/0 conn(0x7fccbc0cc260 0x7fccbc0cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.911+0000 7fccba000640 1 -- 172.21.15.173:0/1266506025 >> v1:172.21.15.194:6789/0 conn(0x7fccbc145290 legacy=0x7fccbc15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.911+0000 7fccba000640 1 -- 172.21.15.173:0/1266506025 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccbc06dd50 con 0x7fccbc0b3fe0 2024-04-25T09:05:36.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.915+0000 7fccba000640 1 --2- 172.21.15.173:0/1266506025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccbc0b3fe0 0x7fccbc0b4450 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fccbc15f5b0 tx=0x7fcca801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11badfb7407fe562 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.915+0000 7fccb9600640 1 -- 172.21.15.173:0/1266506025 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca80b0070 con 0x7fccbc0b3fe0 2024-04-25T09:05:36.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.915+0000 7fccb9600640 1 -- 172.21.15.173:0/1266506025 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca80ab600 con 0x7fccbc0b3fe0 2024-04-25T09:05:36.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.915+0000 7fccb9600640 1 -- 172.21.15.173:0/1266506025 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca80ab9d0 con 0x7fccbc0b3fe0 2024-04-25T09:05:36.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.915+0000 7fccc1e00640 1 -- 172.21.15.173:0/1266506025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccbc0b3fe0 msgr2=0x7fccbc0b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.915+0000 7fccc1e00640 1 --2- 172.21.15.173:0/1266506025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccbc0b3fe0 0x7fccbc0b4450 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fccbc15f5b0 tx=0x7fcca801c3c0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.915+0000 7fccc1e00640 1 -- 172.21.15.173:0/1266506025 shutdown_connections 2024-04-25T09:05:36.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.915+0000 7fccc1e00640 1 --2- 172.21.15.173:0/1266506025 >> v2:172.21.15.194:3300/0 conn(0x7fccbc0cc260 0x7fccbc0cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.915+0000 7fccc1e00640 1 --2- 172.21.15.173:0/1266506025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccbc0b3fe0 0x7fccbc0b4450 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.915+0000 7fccc1e00640 1 -- 172.21.15.173:0/1266506025 >> 172.21.15.173:0/1266506025 conn(0x7fccbc06ac90 msgr2=0x7fccbc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:36.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.915+0000 7fccc1e00640 1 -- 172.21.15.173:0/1266506025 shutdown_connections 2024-04-25T09:05:36.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.915+0000 7fccc1e00640 1 -- 172.21.15.173:0/1266506025 wait complete. 2024-04-25T09:05:36.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccc1e00640 1 Processor -- start 2024-04-25T09:05:36.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccc1e00640 1 -- start start 2024-04-25T09:05:36.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccc1e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccbc0b3fe0 0x7fccbc15c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccc1e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccbc0cc260 0x7fccbc134480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccc1e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fccbc145290 0x7fccbc13c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccc1e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc06eee0 con 0x7fccbc0cc260 2024-04-25T09:05:36.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccc1e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc06ed60 con 0x7fccbc0b3fe0 2024-04-25T09:05:36.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccc1e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc06f060 con 0x7fccbc145290 2024-04-25T09:05:36.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccba000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccbc0cc260 0x7fccbc134480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccba000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccbc0cc260 0x7fccbc134480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59198/0 (socket says 172.21.15.173:59198) 2024-04-25T09:05:36.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccba000640 1 -- 172.21.15.173:0/2704125628 learned_addr learned my addr 172.21.15.173:0/2704125628 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:36.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccba000640 1 -- 172.21.15.173:0/2704125628 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fccbc145290 msgr2=0x7fccbc13c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccba000640 1 --2- 172.21.15.173:0/2704125628 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fccbc145290 0x7fccbc13c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccba000640 1 -- 172.21.15.173:0/2704125628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccbc0b3fe0 msgr2=0x7fccbc15c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccbaa00640 1 --2- 172.21.15.173:0/2704125628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccbc0b3fe0 0x7fccbc15c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccba000640 1 --2- 172.21.15.173:0/2704125628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccbc0b3fe0 0x7fccbc15c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccba000640 1 -- 172.21.15.173:0/2704125628 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccbc142700 con 0x7fccbc0cc260 2024-04-25T09:05:36.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccbaa00640 1 --2- 172.21.15.173:0/2704125628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccbc0b3fe0 0x7fccbc15c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:36.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccba000640 1 --2- 172.21.15.173:0/2704125628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccbc0cc260 0x7fccbc134480 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcca80ae040 tx=0x7fcca8019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccb3400640 1 -- 172.21.15.173:0/2704125628 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca80bb070 con 0x7fccbc0cc260 2024-04-25T09:05:36.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccb3400640 1 -- 172.21.15.173:0/2704125628 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca80b6430 con 0x7fccbc0cc260 2024-04-25T09:05:36.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccb3400640 1 -- 172.21.15.173:0/2704125628 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca80b0040 con 0x7fccbc0cc260 2024-04-25T09:05:36.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccc1e00640 1 -- 172.21.15.173:0/2704125628 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccbc1429e0 con 0x7fccbc0cc260 2024-04-25T09:05:36.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.919+0000 7fccc1e00640 1 -- 172.21.15.173:0/2704125628 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccbc0acba0 con 0x7fccbc0cc260 2024-04-25T09:05:36.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.923+0000 7fccc1e00640 1 -- 172.21.15.173:0/2704125628 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccbc073ab0 con 0x7fccbc0cc260 2024-04-25T09:05:36.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.923+0000 7fccb3400640 1 -- 172.21.15.173:0/2704125628 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcca80b53d0 con 0x7fccbc0cc260 2024-04-25T09:05:36.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.923+0000 7fccb3400640 1 --2- 172.21.15.173:0/2704125628 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcc9c066f60 0x7fcc9c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.923+0000 7fccb3400640 1 -- 172.21.15.173:0/2704125628 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7fcca811e860 con 0x7fccbc0cc260 2024-04-25T09:05:36.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.923+0000 7fccbaa00640 1 --2- 172.21.15.173:0/2704125628 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcc9c066f60 0x7fcc9c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.923+0000 7fccbaa00640 1 --2- 172.21.15.173:0/2704125628 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcc9c066f60 0x7fcc9c069420 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fccac00a850 tx=0x7fccac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:36.927+0000 7fccb3400640 1 -- 172.21.15.173:0/2704125628 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcca80160d0 con 0x7fccbc0cc260 2024-04-25T09:05:37.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.083+0000 7fccc1e00640 1 -- 172.21.15.173:0/2704125628 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fccbc13e900 con 0x7fccbc0cc260 2024-04-25T09:05:37.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.083+0000 7fccb3400640 1 -- 172.21.15.173:0/2704125628 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcca80ef7d0 con 0x7fccbc0cc260 2024-04-25T09:05:37.074 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:05:37.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.083+0000 7fccc1e00640 1 -- 172.21.15.173:0/2704125628 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcc9c066f60 msgr2=0x7fcc9c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.083+0000 7fccc1e00640 1 --2- 172.21.15.173:0/2704125628 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcc9c066f60 0x7fcc9c069420 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fccac00a850 tx=0x7fccac008040 comp rx=0 tx=0).stop 2024-04-25T09:05:37.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.083+0000 7fccc1e00640 1 -- 172.21.15.173:0/2704125628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccbc0cc260 msgr2=0x7fccbc134480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.083+0000 7fccc1e00640 1 --2- 172.21.15.173:0/2704125628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccbc0cc260 0x7fccbc134480 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcca80ae040 tx=0x7fcca8019160 comp rx=0 tx=0).stop 2024-04-25T09:05:37.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.083+0000 7fccc1e00640 1 -- 172.21.15.173:0/2704125628 shutdown_connections 2024-04-25T09:05:37.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.083+0000 7fccc1e00640 1 --2- 172.21.15.173:0/2704125628 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcc9c066f60 0x7fcc9c069420 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.083+0000 7fccc1e00640 1 --2- 172.21.15.173:0/2704125628 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fccbc145290 0x7fccbc13c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.083+0000 7fccc1e00640 1 --2- 172.21.15.173:0/2704125628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccbc0cc260 0x7fccbc134480 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.083+0000 7fccc1e00640 1 --2- 172.21.15.173:0/2704125628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccbc0b3fe0 0x7fccbc15c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.083+0000 7fccc1e00640 1 -- 172.21.15.173:0/2704125628 >> 172.21.15.173:0/2704125628 conn(0x7fccbc06ac90 msgr2=0x7fccbc13dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:37.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.083+0000 7fccc1e00640 1 -- 172.21.15.173:0/2704125628 shutdown_connections 2024-04-25T09:05:37.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.083+0000 7fccc1e00640 1 -- 172.21.15.173:0/2704125628 wait complete. 2024-04-25T09:05:37.094 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:05:37.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.239+0000 7fbf8ca00640 1 Processor -- start 2024-04-25T09:05:37.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.239+0000 7fbf8ca00640 1 -- start start 2024-04-25T09:05:37.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.243+0000 7fbf8ca00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbf880aeb90 0x7fbf880cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.243+0000 7fbf8ca00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbf880ce2b0 0x7fbf880cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.243+0000 7fbf8ca00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf88071570 con 0x7fbf880aef70 2024-04-25T09:05:37.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.243+0000 7fbf8ca00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf88071320 con 0x7fbf880aeb90 2024-04-25T09:05:37.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.243+0000 7fbf8ca00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf88072330 con 0x7fbf880ce2b0 2024-04-25T09:05:37.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.243+0000 7fbf85e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbf880aeb90 0x7fbf880cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.243+0000 7fbf85e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbf880aeb90 0x7fbf880cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59202/0 (socket says 172.21.15.173:59202) 2024-04-25T09:05:37.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.243+0000 7fbf85e00640 1 -- 172.21.15.173:0/3121254557 learned_addr learned my addr 172.21.15.173:0/3121254557 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:37.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.243+0000 7fbf86800640 1 --2- 172.21.15.173:0/3121254557 >> v2:172.21.15.194:3300/0 conn(0x7fbf880ce2b0 0x7fbf880cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.243+0000 7fbf85e00640 1 -- 172.21.15.173:0/3121254557 >> v2:172.21.15.194:3300/0 conn(0x7fbf880ce2b0 msgr2=0x7fbf880cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:37.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.243+0000 7fbf85e00640 1 --2- 172.21.15.173:0/3121254557 >> v2:172.21.15.194:3300/0 conn(0x7fbf880ce2b0 0x7fbf880cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.243+0000 7fbf85e00640 1 -- 172.21.15.173:0/3121254557 >> v1:172.21.15.194:6789/0 conn(0x7fbf880aef70 legacy=0x7fbf880cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:37.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.243+0000 7fbf85e00640 1 -- 172.21.15.173:0/3121254557 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf88071850 con 0x7fbf880aeb90 2024-04-25T09:05:37.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.247+0000 7fbf85e00640 1 --2- 172.21.15.173:0/3121254557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf880aeb90 0x7fbf880cc0d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbf8815e4f0 tx=0x7fbf7801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0823066c469c715 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:37.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.247+0000 7fbf85400640 1 -- 172.21.15.173:0/3121254557 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf780b0070 con 0x7fbf880aeb90 2024-04-25T09:05:37.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.247+0000 7fbf85400640 1 -- 172.21.15.173:0/3121254557 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf780ab600 con 0x7fbf880aeb90 2024-04-25T09:05:37.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.247+0000 7fbf85400640 1 -- 172.21.15.173:0/3121254557 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf780ab9d0 con 0x7fbf880aeb90 2024-04-25T09:05:37.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.247+0000 7fbf8ca00640 1 -- 172.21.15.173:0/3121254557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf880aeb90 msgr2=0x7fbf880cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.247+0000 7fbf8ca00640 1 --2- 172.21.15.173:0/3121254557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf880aeb90 0x7fbf880cc0d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbf8815e4f0 tx=0x7fbf7801c420 comp rx=0 tx=0).stop 2024-04-25T09:05:37.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.247+0000 7fbf8ca00640 1 -- 172.21.15.173:0/3121254557 shutdown_connections 2024-04-25T09:05:37.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.247+0000 7fbf8ca00640 1 --2- 172.21.15.173:0/3121254557 >> v2:172.21.15.194:3300/0 conn(0x7fbf880ce2b0 0x7fbf880cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.247+0000 7fbf8ca00640 1 --2- 172.21.15.173:0/3121254557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf880aeb90 0x7fbf880cc0d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.247+0000 7fbf8ca00640 1 -- 172.21.15.173:0/3121254557 >> 172.21.15.173:0/3121254557 conn(0x7fbf8806ac90 msgr2=0x7fbf8806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:37.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.247+0000 7fbf8ca00640 1 -- 172.21.15.173:0/3121254557 shutdown_connections 2024-04-25T09:05:37.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.247+0000 7fbf8ca00640 1 -- 172.21.15.173:0/3121254557 wait complete. 2024-04-25T09:05:37.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.247+0000 7fbf8ca00640 1 Processor -- start 2024-04-25T09:05:37.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.247+0000 7fbf8ca00640 1 -- start start 2024-04-25T09:05:37.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf8ca00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf880aeb90 0x7fbf8815e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf8ca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf880aef70 0x7fbf880afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf8ca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf880ce2b0 0x7fbf88149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf8ca00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8815bb30 con 0x7fbf880ce2b0 2024-04-25T09:05:37.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf8ca00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8815b9b0 con 0x7fbf880aef70 2024-04-25T09:05:37.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf8ca00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8815bcb0 con 0x7fbf880aeb90 2024-04-25T09:05:37.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf86800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf880ce2b0 0x7fbf88149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf86800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf880ce2b0 0x7fbf88149900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59204/0 (socket says 172.21.15.173:59204) 2024-04-25T09:05:37.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf86800640 1 -- 172.21.15.173:0/273668532 learned_addr learned my addr 172.21.15.173:0/273668532 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:37.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf85e00640 1 --2- 172.21.15.173:0/273668532 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf880aeb90 0x7fbf8815e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf7d400640 1 --2- 172.21.15.173:0/273668532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf880aef70 0x7fbf880afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf86800640 1 -- 172.21.15.173:0/273668532 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf880aeb90 msgr2=0x7fbf8815e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf86800640 1 --2- 172.21.15.173:0/273668532 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf880aeb90 0x7fbf8815e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf86800640 1 -- 172.21.15.173:0/273668532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf880aef70 msgr2=0x7fbf880afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf86800640 1 --2- 172.21.15.173:0/273668532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf880aef70 0x7fbf880afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf86800640 1 -- 172.21.15.173:0/273668532 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8815d2c0 con 0x7fbf880ce2b0 2024-04-25T09:05:37.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf85e00640 1 --2- 172.21.15.173:0/273668532 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf880aeb90 0x7fbf8815e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:37.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf7d400640 1 --2- 172.21.15.173:0/273668532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf880aef70 0x7fbf880afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:37.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf86800640 1 --2- 172.21.15.173:0/273668532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf880ce2b0 0x7fbf88149900 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbf80007e40 tx=0x7fbf8000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:37.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf7ea00640 1 -- 172.21.15.173:0/273668532 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80014620 con 0x7fbf880ce2b0 2024-04-25T09:05:37.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf7ea00640 1 -- 172.21.15.173:0/273668532 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf80019070 con 0x7fbf880ce2b0 2024-04-25T09:05:37.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf8ca00640 1 -- 172.21.15.173:0/273668532 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf880cccb0 con 0x7fbf880ce2b0 2024-04-25T09:05:37.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf7ea00640 1 -- 172.21.15.173:0/273668532 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80014a20 con 0x7fbf880ce2b0 2024-04-25T09:05:37.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf8ca00640 1 -- 172.21.15.173:0/273668532 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf88149e40 con 0x7fbf880ce2b0 2024-04-25T09:05:37.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf8ca00640 1 -- 172.21.15.173:0/273668532 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf88073ab0 con 0x7fbf880ce2b0 2024-04-25T09:05:37.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf7ea00640 1 -- 172.21.15.173:0/273668532 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbf80014bc0 con 0x7fbf880ce2b0 2024-04-25T09:05:37.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.251+0000 7fbf7ea00640 1 --2- 172.21.15.173:0/273668532 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbf64066f60 0x7fbf64069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.255+0000 7fbf7ea00640 1 -- 172.21.15.173:0/273668532 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7fbf80085b70 con 0x7fbf880ce2b0 2024-04-25T09:05:37.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.255+0000 7fbf85e00640 1 --2- 172.21.15.173:0/273668532 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbf64066f60 0x7fbf64069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.255+0000 7fbf85e00640 1 --2- 172.21.15.173:0/273668532 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbf64066f60 0x7fbf64069420 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbf780ad000 tx=0x7fbf78008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:37.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.255+0000 7fbf7ea00640 1 -- 172.21.15.173:0/273668532 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbf80056920 con 0x7fbf880ce2b0 2024-04-25T09:05:37.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.475+0000 7fbf8ca00640 1 -- 172.21.15.173:0/273668532 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf88072520 con 0x7fbf880ce2b0 2024-04-25T09:05:37.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.475+0000 7fbf7ea00640 1 -- 172.21.15.173:0/273668532 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf80056220 con 0x7fbf880ce2b0 2024-04-25T09:05:37.468 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:05:37.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.479+0000 7fbf8ca00640 1 -- 172.21.15.173:0/273668532 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbf64066f60 msgr2=0x7fbf64069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.479+0000 7fbf8ca00640 1 --2- 172.21.15.173:0/273668532 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbf64066f60 0x7fbf64069420 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbf780ad000 tx=0x7fbf78008040 comp rx=0 tx=0).stop 2024-04-25T09:05:37.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.479+0000 7fbf8ca00640 1 -- 172.21.15.173:0/273668532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf880ce2b0 msgr2=0x7fbf88149900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.479+0000 7fbf8ca00640 1 --2- 172.21.15.173:0/273668532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf880ce2b0 0x7fbf88149900 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbf80007e40 tx=0x7fbf8000e4b0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.479+0000 7fbf8ca00640 1 -- 172.21.15.173:0/273668532 shutdown_connections 2024-04-25T09:05:37.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.479+0000 7fbf8ca00640 1 --2- 172.21.15.173:0/273668532 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbf64066f60 0x7fbf64069420 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.479+0000 7fbf8ca00640 1 --2- 172.21.15.173:0/273668532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf880ce2b0 0x7fbf88149900 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.479+0000 7fbf8ca00640 1 --2- 172.21.15.173:0/273668532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf880aef70 0x7fbf880afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.479+0000 7fbf8ca00640 1 --2- 172.21.15.173:0/273668532 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf880aeb90 0x7fbf8815e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.479+0000 7fbf8ca00640 1 -- 172.21.15.173:0/273668532 >> 172.21.15.173:0/273668532 conn(0x7fbf8806ac90 msgr2=0x7fbf8815d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:37.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.479+0000 7fbf8ca00640 1 -- 172.21.15.173:0/273668532 shutdown_connections 2024-04-25T09:05:37.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.479+0000 7fbf8ca00640 1 -- 172.21.15.173:0/273668532 wait complete. 2024-04-25T09:05:37.491 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:05:37.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.639+0000 7f071e400640 1 Processor -- start 2024-04-25T09:05:37.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.639+0000 7f071e400640 1 -- start start 2024-04-25T09:05:37.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.639+0000 7f071e400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f071815da50 0x7f071806c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.639+0000 7f071e400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f07180b5a70 0x7f07180d24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.639+0000 7f071e400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07180b6a10 con 0x7f07180b95c0 2024-04-25T09:05:37.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.639+0000 7f071e400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071806d010 con 0x7f071815da50 2024-04-25T09:05:37.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.639+0000 7f071e400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071806ca50 con 0x7f07180b5a70 2024-04-25T09:05:37.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.639+0000 7f071d000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f071815da50 0x7f071806c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.639+0000 7f071d000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f071815da50 0x7f071806c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59218/0 (socket says 172.21.15.173:59218) 2024-04-25T09:05:37.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.639+0000 7f071d000640 1 -- 172.21.15.173:0/4032604659 learned_addr learned my addr 172.21.15.173:0/4032604659 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:37.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.639+0000 7f071da00640 1 --2- 172.21.15.173:0/4032604659 >> v2:172.21.15.194:3300/0 conn(0x7f07180b5a70 0x7f07180d24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.639+0000 7f071d000640 1 -- 172.21.15.173:0/4032604659 >> v2:172.21.15.194:3300/0 conn(0x7f07180b5a70 msgr2=0x7f07180d24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:37.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.639+0000 7f071d000640 1 --2- 172.21.15.173:0/4032604659 >> v2:172.21.15.194:3300/0 conn(0x7f07180b5a70 0x7f07180d24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.639+0000 7f071d000640 1 -- 172.21.15.173:0/4032604659 >> v1:172.21.15.194:6789/0 conn(0x7f07180b95c0 legacy=0x7f07180b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:37.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.639+0000 7f071d000640 1 -- 172.21.15.173:0/4032604659 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071806cd30 con 0x7f071815da50 2024-04-25T09:05:37.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.639+0000 7f071da00640 1 --2- 172.21.15.173:0/4032604659 >> v2:172.21.15.194:3300/0 conn(0x7f07180b5a70 0x7f07180d24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:37.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.643+0000 7f071d000640 1 --2- 172.21.15.173:0/4032604659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f071815da50 0x7f071806c0e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f07180b9a50 tx=0x7f070c01eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39a44e57bdcb3f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:37.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.643+0000 7f0717400640 1 -- 172.21.15.173:0/4032604659 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c0b5070 con 0x7f071815da50 2024-04-25T09:05:37.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.643+0000 7f0717400640 1 -- 172.21.15.173:0/4032604659 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c0a87f0 con 0x7f071815da50 2024-04-25T09:05:37.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.643+0000 7f0717400640 1 -- 172.21.15.173:0/4032604659 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c0a8bc0 con 0x7f071815da50 2024-04-25T09:05:37.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.643+0000 7f071e400640 1 -- 172.21.15.173:0/4032604659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f071815da50 msgr2=0x7f071806c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.643+0000 7f071e400640 1 --2- 172.21.15.173:0/4032604659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f071815da50 0x7f071806c0e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f07180b9a50 tx=0x7f070c01eaf0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.643+0000 7f071e400640 1 -- 172.21.15.173:0/4032604659 shutdown_connections 2024-04-25T09:05:37.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.643+0000 7f071e400640 1 --2- 172.21.15.173:0/4032604659 >> v2:172.21.15.194:3300/0 conn(0x7f07180b5a70 0x7f07180d24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.643+0000 7f071e400640 1 --2- 172.21.15.173:0/4032604659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f071815da50 0x7f071806c0e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.643+0000 7f071e400640 1 -- 172.21.15.173:0/4032604659 >> 172.21.15.173:0/4032604659 conn(0x7f07180d0530 msgr2=0x7f07180d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:37.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.643+0000 7f071e400640 1 -- 172.21.15.173:0/4032604659 shutdown_connections 2024-04-25T09:05:37.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.643+0000 7f071e400640 1 -- 172.21.15.173:0/4032604659 wait complete. 2024-04-25T09:05:37.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071e400640 1 Processor -- start 2024-04-25T09:05:37.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071e400640 1 -- start start 2024-04-25T09:05:37.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07180b5a70 0x7f0718154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07180b95c0 0x7f07180ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071e400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f071815da50 0x7f0718143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071e400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071815de30 con 0x7f071815da50 2024-04-25T09:05:37.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071e400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07180d1fc0 con 0x7f07180b5a70 2024-04-25T09:05:37.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071815dfb0 con 0x7f07180b95c0 2024-04-25T09:05:37.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071da00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f071815da50 0x7f0718143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071da00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f071815da50 0x7f0718143d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59220/0 (socket says 172.21.15.173:59220) 2024-04-25T09:05:37.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071da00640 1 -- 172.21.15.173:0/2919825812 learned_addr learned my addr 172.21.15.173:0/2919825812 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071d000640 1 --2- 172.21.15.173:0/2919825812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07180b5a70 0x7f0718154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f0717e00640 1 --2- 172.21.15.173:0/2919825812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07180b95c0 0x7f07180ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071da00640 1 -- 172.21.15.173:0/2919825812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07180b95c0 msgr2=0x7f07180ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071da00640 1 --2- 172.21.15.173:0/2919825812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07180b95c0 0x7f07180ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071da00640 1 -- 172.21.15.173:0/2919825812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07180b5a70 msgr2=0x7f0718154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071da00640 1 --2- 172.21.15.173:0/2919825812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07180b5a70 0x7f0718154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071da00640 1 -- 172.21.15.173:0/2919825812 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071815b3f0 con 0x7f071815da50 2024-04-25T09:05:37.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071da00640 1 --2- 172.21.15.173:0/2919825812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f071815da50 0x7f0718143d60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f071000ce80 tx=0x7f071000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:37.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f0714c00640 1 -- 172.21.15.173:0/2919825812 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071001a070 con 0x7f071815da50 2024-04-25T09:05:37.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f0714c00640 1 -- 172.21.15.173:0/2919825812 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071000d880 con 0x7f071815da50 2024-04-25T09:05:37.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071e400640 1 -- 172.21.15.173:0/2919825812 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071815b730 con 0x7f071815da50 2024-04-25T09:05:37.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f0714c00640 1 -- 172.21.15.173:0/2919825812 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071000dc70 con 0x7f071815da50 2024-04-25T09:05:37.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071e400640 1 -- 172.21.15.173:0/2919825812 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071815bf70 con 0x7f071815da50 2024-04-25T09:05:37.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.647+0000 7f071e400640 1 -- 172.21.15.173:0/2919825812 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0718155150 con 0x7f071815da50 2024-04-25T09:05:37.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.651+0000 7f0714c00640 1 -- 172.21.15.173:0/2919825812 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f071001d070 con 0x7f071815da50 2024-04-25T09:05:37.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.651+0000 7f0714c00640 1 --2- 172.21.15.173:0/2919825812 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f06f8066f90 0x7f06f8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.651+0000 7f0714c00640 1 -- 172.21.15.173:0/2919825812 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f07100859a0 con 0x7f071815da50 2024-04-25T09:05:37.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.651+0000 7f071d000640 1 --2- 172.21.15.173:0/2919825812 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f06f8066f90 0x7f06f8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.651+0000 7f071d000640 1 --2- 172.21.15.173:0/2919825812 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f06f8066f90 0x7f06f8069450 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f070c0b2000 tx=0x7f070c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:37.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.655+0000 7f0714c00640 1 -- 172.21.15.173:0/2919825812 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f071815b730 con 0x7f071815da50 2024-04-25T09:05:37.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.807+0000 7f071e400640 1 -- 172.21.15.173:0/2919825812 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0718073a40 con 0x7f071815da50 2024-04-25T09:05:37.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.811+0000 7f0714c00640 1 -- 172.21.15.173:0/2919825812 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0710056100 con 0x7f071815da50 2024-04-25T09:05:37.801 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:05:37.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.811+0000 7f071e400640 1 -- 172.21.15.173:0/2919825812 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f06f8066f90 msgr2=0x7f06f8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.811+0000 7f071e400640 1 --2- 172.21.15.173:0/2919825812 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f06f8066f90 0x7f06f8069450 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f070c0b2000 tx=0x7f070c009040 comp rx=0 tx=0).stop 2024-04-25T09:05:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.811+0000 7f071e400640 1 -- 172.21.15.173:0/2919825812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f071815da50 msgr2=0x7f0718143d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.811+0000 7f071e400640 1 --2- 172.21.15.173:0/2919825812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f071815da50 0x7f0718143d60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f071000ce80 tx=0x7f071000a710 comp rx=0 tx=0).stop 2024-04-25T09:05:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.811+0000 7f071e400640 1 -- 172.21.15.173:0/2919825812 shutdown_connections 2024-04-25T09:05:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.811+0000 7f071e400640 1 --2- 172.21.15.173:0/2919825812 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f06f8066f90 0x7f06f8069450 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.811+0000 7f071e400640 1 --2- 172.21.15.173:0/2919825812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f071815da50 0x7f0718143d60 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.811+0000 7f071e400640 1 --2- 172.21.15.173:0/2919825812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07180b95c0 0x7f07180ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.811+0000 7f071e400640 1 --2- 172.21.15.173:0/2919825812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07180b5a70 0x7f0718154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.811+0000 7f071e400640 1 -- 172.21.15.173:0/2919825812 >> 172.21.15.173:0/2919825812 conn(0x7f07180d0530 msgr2=0x7f0718158c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.811+0000 7f071e400640 1 -- 172.21.15.173:0/2919825812 shutdown_connections 2024-04-25T09:05:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.811+0000 7f071e400640 1 -- 172.21.15.173:0/2919825812 wait complete. 2024-04-25T09:05:37.822 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:05:37.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.967+0000 7f33f5a00640 1 Processor -- start 2024-04-25T09:05:37.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.967+0000 7f33f5a00640 1 -- start start 2024-04-25T09:05:37.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.967+0000 7f33f5a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33f00cc7e0 0x7f33f00cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.967+0000 7f33f5a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f33f00aef70 0x7f33f00ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.967+0000 7f33f5a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f0071570 con 0x7f33f00aeb90 2024-04-25T09:05:37.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.967+0000 7f33f5a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f0071320 con 0x7f33f00aef70 2024-04-25T09:05:37.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.967+0000 7f33f5a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0072330 con 0x7f33f00cc7e0 2024-04-25T09:05:37.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.967+0000 7f33ef400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f33f00aef70 0x7f33f00ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.967+0000 7f33e6000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33f00cc7e0 0x7f33f00cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.967+0000 7f33ef400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f33f00aef70 0x7f33f00ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:46616/0 (socket says 172.21.15.173:46616) 2024-04-25T09:05:37.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.967+0000 7f33ef400640 1 -- 172.21.15.173:0/2757782220 learned_addr learned my addr 172.21.15.173:0/2757782220 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:37.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.967+0000 7f33e6000640 1 -- 172.21.15.173:0/2757782220 >> v2:172.21.15.194:3300/0 conn(0x7f33f00aef70 msgr2=0x7f33f00ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:37.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.967+0000 7f33e6000640 1 --2- 172.21.15.173:0/2757782220 >> v2:172.21.15.194:3300/0 conn(0x7f33f00aef70 0x7f33f00ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.967+0000 7f33e6000640 1 -- 172.21.15.173:0/2757782220 >> v1:172.21.15.194:6789/0 conn(0x7f33f00aeb90 legacy=0x7f33f00cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.967+0000 7f33e6000640 1 -- 172.21.15.173:0/2757782220 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f0071850 con 0x7f33f00cc7e0 2024-04-25T09:05:37.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.971+0000 7f33e6000640 1 --2- 172.21.15.173:0/2757782220 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33f00cc7e0 0x7f33f00cdba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f33d80097c0 tx=0x7f33d801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e35fdcf347c9f29b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:37.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.971+0000 7f33ee000640 1 -- 172.21.15.173:0/2757782220 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d80b0070 con 0x7f33f00cc7e0 2024-04-25T09:05:37.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.971+0000 7f33ee000640 1 -- 172.21.15.173:0/2757782220 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d80ab600 con 0x7f33f00cc7e0 2024-04-25T09:05:37.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.971+0000 7f33ee000640 1 -- 172.21.15.173:0/2757782220 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d80ab9d0 con 0x7f33f00cc7e0 2024-04-25T09:05:37.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.971+0000 7f33f5a00640 1 -- 172.21.15.173:0/2757782220 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33f00cc7e0 msgr2=0x7f33f00cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.971+0000 7f33f5a00640 1 --2- 172.21.15.173:0/2757782220 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33f00cc7e0 0x7f33f00cdba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f33d80097c0 tx=0x7f33d801c410 comp rx=0 tx=0).stop 2024-04-25T09:05:37.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.971+0000 7f33f5a00640 1 -- 172.21.15.173:0/2757782220 shutdown_connections 2024-04-25T09:05:37.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.971+0000 7f33f5a00640 1 --2- 172.21.15.173:0/2757782220 >> v2:172.21.15.194:3300/0 conn(0x7f33f00aef70 0x7f33f00ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.971+0000 7f33f5a00640 1 --2- 172.21.15.173:0/2757782220 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33f00cc7e0 0x7f33f00cdba0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.971+0000 7f33f5a00640 1 -- 172.21.15.173:0/2757782220 >> 172.21.15.173:0/2757782220 conn(0x7f33f006ac90 msgr2=0x7f33f006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:37.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.971+0000 7f33f5a00640 1 -- 172.21.15.173:0/2757782220 shutdown_connections 2024-04-25T09:05:37.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.971+0000 7f33f5a00640 1 -- 172.21.15.173:0/2757782220 wait complete. 2024-04-25T09:05:37.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33f5a00640 1 Processor -- start 2024-04-25T09:05:37.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33f5a00640 1 -- start start 2024-04-25T09:05:37.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33f5a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33f00aeb90 0x7f33f01548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33f5a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33f00aef70 0x7f33f014cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33f5a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33f00cc7e0 0x7f33f01387f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33f5a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f015bb30 con 0x7f33f00aef70 2024-04-25T09:05:37.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33f5a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f015b9b0 con 0x7f33f00cc7e0 2024-04-25T09:05:37.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33f5a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f015bcb0 con 0x7f33f00aeb90 2024-04-25T09:05:37.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33e6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33f00aef70 0x7f33f014cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33e6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33f00aef70 0x7f33f014cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59234/0 (socket says 172.21.15.173:59234) 2024-04-25T09:05:37.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33e6000640 1 -- 172.21.15.173:0/3334514203 learned_addr learned my addr 172.21.15.173:0/3334514203 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:37.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33ef400640 1 --2- 172.21.15.173:0/3334514203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33f00cc7e0 0x7f33f01387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33eea00640 1 --2- 172.21.15.173:0/3334514203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33f00aeb90 0x7f33f01548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33e6000640 1 -- 172.21.15.173:0/3334514203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33f00aeb90 msgr2=0x7f33f01548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33e6000640 1 --2- 172.21.15.173:0/3334514203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33f00aeb90 0x7f33f01548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33e6000640 1 -- 172.21.15.173:0/3334514203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33f00cc7e0 msgr2=0x7f33f01387f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33e6000640 1 --2- 172.21.15.173:0/3334514203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33f00cc7e0 0x7f33f01387f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33e6000640 1 -- 172.21.15.173:0/3334514203 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f0139090 con 0x7f33f00aef70 2024-04-25T09:05:37.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33e6000640 1 --2- 172.21.15.173:0/3334514203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33f00aef70 0x7f33f014cdf0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f33d801a040 tx=0x7f33d80191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:37.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33e7400640 1 -- 172.21.15.173:0/3334514203 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d80ba070 con 0x7f33f00aef70 2024-04-25T09:05:37.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33e7400640 1 -- 172.21.15.173:0/3334514203 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d80b43f0 con 0x7f33f00aef70 2024-04-25T09:05:37.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33e7400640 1 -- 172.21.15.173:0/3334514203 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d80b0040 con 0x7f33f00aef70 2024-04-25T09:05:37.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33f5a00640 1 -- 172.21.15.173:0/3334514203 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f0139370 con 0x7f33f00aef70 2024-04-25T09:05:37.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.975+0000 7f33f5a00640 1 -- 172.21.15.173:0/3334514203 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f0139930 con 0x7f33f00aef70 2024-04-25T09:05:37.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.979+0000 7f33f5a00640 1 -- 172.21.15.173:0/3334514203 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f0073ab0 con 0x7f33f00aef70 2024-04-25T09:05:37.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.979+0000 7f33e7400640 1 -- 172.21.15.173:0/3334514203 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f33d80b47c0 con 0x7f33f00aef70 2024-04-25T09:05:37.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.979+0000 7f33e7400640 1 --2- 172.21.15.173:0/3334514203 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f33cc066f90 0x7f33cc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.979+0000 7f33e7400640 1 -- 172.21.15.173:0/3334514203 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f33d811e360 con 0x7f33f00aef70 2024-04-25T09:05:37.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.979+0000 7f33eea00640 1 --2- 172.21.15.173:0/3334514203 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f33cc066f90 0x7f33cc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.979+0000 7f33eea00640 1 --2- 172.21.15.173:0/3334514203 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f33cc066f90 0x7f33cc069450 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f33e0001770 tx=0x7f33e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:37.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:37.983+0000 7f33e7400640 1 -- 172.21.15.173:0/3334514203 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f33d8016090 con 0x7f33f00aef70 2024-04-25T09:05:38.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.147+0000 7f33f5a00640 1 -- 172.21.15.173:0/3334514203 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f33f00cbbf0 con 0x7f33f00aef70 2024-04-25T09:05:38.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.147+0000 7f33e7400640 1 -- 172.21.15.173:0/3334514203 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7f33d80eeac0 con 0x7f33f00aef70 2024-04-25T09:05:38.141 INFO:teuthology.orchestra.run.smithi173.stderr:listed 0 entries 2024-04-25T09:05:38.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.151+0000 7f33f5a00640 1 -- 172.21.15.173:0/3334514203 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f33cc066f90 msgr2=0x7f33cc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:38.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.151+0000 7f33f5a00640 1 --2- 172.21.15.173:0/3334514203 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f33cc066f90 0x7f33cc069450 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f33e0001770 tx=0x7f33e0009040 comp rx=0 tx=0).stop 2024-04-25T09:05:38.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.151+0000 7f33f5a00640 1 -- 172.21.15.173:0/3334514203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33f00aef70 msgr2=0x7f33f014cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:38.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.151+0000 7f33f5a00640 1 --2- 172.21.15.173:0/3334514203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33f00aef70 0x7f33f014cdf0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f33d801a040 tx=0x7f33d80191b0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.151+0000 7f33f5a00640 1 -- 172.21.15.173:0/3334514203 shutdown_connections 2024-04-25T09:05:38.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.151+0000 7f33f5a00640 1 --2- 172.21.15.173:0/3334514203 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f33cc066f90 0x7f33cc069450 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.151+0000 7f33f5a00640 1 --2- 172.21.15.173:0/3334514203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33f00cc7e0 0x7f33f01387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.151+0000 7f33f5a00640 1 --2- 172.21.15.173:0/3334514203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33f00aef70 0x7f33f014cdf0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.151+0000 7f33f5a00640 1 --2- 172.21.15.173:0/3334514203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33f00aeb90 0x7f33f01548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.151+0000 7f33f5a00640 1 -- 172.21.15.173:0/3334514203 >> 172.21.15.173:0/3334514203 conn(0x7f33f006ac90 msgr2=0x7f33f015cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:38.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.151+0000 7f33f5a00640 1 -- 172.21.15.173:0/3334514203 shutdown_connections 2024-04-25T09:05:38.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.151+0000 7f33f5a00640 1 -- 172.21.15.173:0/3334514203 wait complete. 2024-04-25T09:05:38.161 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:05:38.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:38.162 DEBUG:teuthology.orchestra.run.smithi173:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:05:38.204 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:05:38.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:38.204 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:05:38.254 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:05:38.254 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:38.263 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:05:38.263 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:05:38.264 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:38.305 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:05:38.305 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:05:38.305 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:38.314 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:05:38.314 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:38.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.491+0000 7f386aa00640 1 Processor -- start 2024-04-25T09:05:38.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.491+0000 7f386aa00640 1 -- start start 2024-04-25T09:05:38.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f386aa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f38640aefa0 0x7f38640cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:38.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f386aa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f386415edd0 0x7f38640cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:38.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f386aa00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386415f320 con 0x7f38640b3e70 2024-04-25T09:05:38.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f386aa00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386406dd50 con 0x7f38640aefa0 2024-04-25T09:05:38.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f386aa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386406d420 con 0x7f386415edd0 2024-04-25T09:05:38.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3863e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f38640b3e70 0x7f38640b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47038/0 (socket says 172.21.15.173:47038) 2024-04-25T09:05:38.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3863e00640 1 -- 172.21.15.173:0/201020288 learned_addr learned my addr 172.21.15.173:0/201020288 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:38.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3863400640 1 --2- 172.21.15.173:0/201020288 >> v2:172.21.15.194:3300/0 conn(0x7f38640aefa0 0x7f38640cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:38.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3868a00640 1 --2- 172.21.15.173:0/201020288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f386415edd0 0x7f38640cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:38.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3862a00640 1 -- 172.21.15.173:0/201020288 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446211183 0 0) 0x7f386415f320 con 0x7f38640b3e70 2024-04-25T09:05:38.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3862a00640 1 -- 172.21.15.173:0/201020288 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3848005740 con 0x7f38640b3e70 2024-04-25T09:05:38.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3862a00640 1 -- 172.21.15.173:0/201020288 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 812478563 0 0) 0x7f3848005740 con 0x7f38640b3e70 2024-04-25T09:05:38.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3862a00640 1 -- 172.21.15.173:0/201020288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f386415edd0 msgr2=0x7f38640cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:38.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3862a00640 1 --2- 172.21.15.173:0/201020288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f386415edd0 0x7f38640cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3862a00640 1 -- 172.21.15.173:0/201020288 >> v2:172.21.15.194:3300/0 conn(0x7f38640aefa0 msgr2=0x7f38640cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:38.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3862a00640 1 --2- 172.21.15.173:0/201020288 >> v2:172.21.15.194:3300/0 conn(0x7f38640aefa0 0x7f38640cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3862a00640 1 -- 172.21.15.173:0/201020288 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386406d700 con 0x7f38640b3e70 2024-04-25T09:05:38.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3862a00640 1 -- 172.21.15.173:0/201020288 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f3854001680 con 0x7f38640b3e70 2024-04-25T09:05:38.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3862a00640 1 -- 172.21.15.173:0/201020288 >> v1:172.21.15.173:6789/0 conn(0x7f38640b3e70 legacy=0x7f38640b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:38.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3862a00640 1 --2- 172.21.15.173:0/201020288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f386415edd0 0x7f3848005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:38.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3862a00640 1 --2- 172.21.15.173:0/201020288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3848006150 0x7f3848006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:38.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3862a00640 1 --2- 172.21.15.173:0/201020288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3848006f60 0x7f38480073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:38.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3862a00640 1 -- 172.21.15.173:0/201020288 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386406dd50 con 0x7f3848006f60 2024-04-25T09:05:38.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3862a00640 1 -- 172.21.15.173:0/201020288 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386406d420 con 0x7f3848006150 2024-04-25T09:05:38.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3862a00640 1 -- 172.21.15.173:0/201020288 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384800dbe0 con 0x7f386415edd0 2024-04-25T09:05:38.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3868a00640 1 --2- 172.21.15.173:0/201020288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3848006f60 0x7f38480073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:38.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3863e00640 1 --2- 172.21.15.173:0/201020288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f386415edd0 0x7f3848005bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:38.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3863400640 1 --2- 172.21.15.173:0/201020288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3848006150 0x7f3848006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:38.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3868a00640 1 -- 172.21.15.173:0/201020288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f386415edd0 msgr2=0x7f3848005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:38.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3868a00640 1 --2- 172.21.15.173:0/201020288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f386415edd0 0x7f3848005bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3868a00640 1 -- 172.21.15.173:0/201020288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3848006150 msgr2=0x7f3848006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:38.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3868a00640 1 --2- 172.21.15.173:0/201020288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3848006150 0x7f3848006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.495+0000 7f3868a00640 1 -- 172.21.15.173:0/201020288 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3848005740 con 0x7f3848006f60 2024-04-25T09:05:38.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.499+0000 7f3868a00640 1 --2- 172.21.15.173:0/201020288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3848006f60 0x7f38480073e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f385c009fc0 tx=0x7f385c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1527347e2d323f6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:38.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.499+0000 7f3862a00640 1 -- 172.21.15.173:0/201020288 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c0b2070 con 0x7f3848006f60 2024-04-25T09:05:38.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.499+0000 7f3862a00640 1 -- 172.21.15.173:0/201020288 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c0a5c90 con 0x7f3848006f60 2024-04-25T09:05:38.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.499+0000 7f3862a00640 1 -- 172.21.15.173:0/201020288 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c009c10 con 0x7f3848006f60 2024-04-25T09:05:38.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.499+0000 7f386aa00640 1 -- 172.21.15.173:0/201020288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3848006f60 msgr2=0x7f38480073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:38.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.499+0000 7f386aa00640 1 --2- 172.21.15.173:0/201020288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3848006f60 0x7f38480073e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f385c009fc0 tx=0x7f385c01cc20 comp rx=0 tx=0).stop 2024-04-25T09:05:38.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.499+0000 7f3868a00640 1 -- 172.21.15.173:0/201020288 reap_dead start 2024-04-25T09:05:38.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.499+0000 7f386aa00640 1 -- 172.21.15.173:0/201020288 shutdown_connections 2024-04-25T09:05:38.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.499+0000 7f386aa00640 1 -- 172.21.15.173:0/201020288 >> 172.21.15.173:0/201020288 conn(0x7f386406ac90 msgr2=0x7f386406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:38.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.499+0000 7f386aa00640 1 -- 172.21.15.173:0/201020288 shutdown_connections 2024-04-25T09:05:38.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.499+0000 7f386aa00640 1 -- 172.21.15.173:0/201020288 wait complete. 2024-04-25T09:05:38.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.499+0000 7f386aa00640 1 Processor -- start 2024-04-25T09:05:38.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.499+0000 7f386aa00640 1 -- start start 2024-04-25T09:05:38.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f386aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3848006f60 0x7f38640afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:38.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f386aa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38640b0430 0x7f386415be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:38.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f386aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f386415c340 0x7f386415c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:38.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f386aa00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386406e1e0 con 0x7f386415c340 2024-04-25T09:05:38.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f386aa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386415aba0 con 0x7f3848006f60 2024-04-25T09:05:38.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f386aa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386406e360 con 0x7f38640b0430 2024-04-25T09:05:38.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f3868a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f386415c340 0x7f386415c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:38.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f3868a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f386415c340 0x7f386415c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59258/0 (socket says 172.21.15.173:59258) 2024-04-25T09:05:38.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f3868a00640 1 -- 172.21.15.173:0/3562909855 learned_addr learned my addr 172.21.15.173:0/3562909855 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:38.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f3863e00640 1 --2- 172.21.15.173:0/3562909855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3848006f60 0x7f38640afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:38.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f3863400640 1 --2- 172.21.15.173:0/3562909855 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38640b0430 0x7f386415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:38.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f3868a00640 1 -- 172.21.15.173:0/3562909855 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38640b0430 msgr2=0x7f386415be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:38.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f3868a00640 1 --2- 172.21.15.173:0/3562909855 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38640b0430 0x7f386415be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f3868a00640 1 -- 172.21.15.173:0/3562909855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3848006f60 msgr2=0x7f38640afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:38.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f3868a00640 1 --2- 172.21.15.173:0/3562909855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3848006f60 0x7f38640afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f3868a00640 1 -- 172.21.15.173:0/3562909855 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38641548b0 con 0x7f386415c340 2024-04-25T09:05:38.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f3863e00640 1 --2- 172.21.15.173:0/3562909855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3848006f60 0x7f38640afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:38.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f3868a00640 1 --2- 172.21.15.173:0/3562909855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f386415c340 0x7f386415c7c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f385c0b0040 tx=0x7f385c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:38.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f385be00640 1 -- 172.21.15.173:0/3562909855 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c0bd070 con 0x7f386415c340 2024-04-25T09:05:38.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f385be00640 1 -- 172.21.15.173:0/3562909855 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c0a5a90 con 0x7f386415c340 2024-04-25T09:05:38.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f386aa00640 1 -- 172.21.15.173:0/3562909855 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3864154b90 con 0x7f386415c340 2024-04-25T09:05:38.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f385be00640 1 -- 172.21.15.173:0/3562909855 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c0b2040 con 0x7f386415c340 2024-04-25T09:05:38.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f386aa00640 1 -- 172.21.15.173:0/3562909855 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386414b430 con 0x7f386415c340 2024-04-25T09:05:38.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f386aa00640 1 -- 172.21.15.173:0/3562909855 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386414b630 con 0x7f386415c340 2024-04-25T09:05:38.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.503+0000 7f385be00640 1 -- 172.21.15.173:0/3562909855 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f385c0aecd0 con 0x7f386415c340 2024-04-25T09:05:38.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.507+0000 7f385be00640 1 --2- 172.21.15.173:0/3562909855 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3844066f60 0x7f3844069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:38.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.507+0000 7f385be00640 1 -- 172.21.15.173:0/3562909855 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f385c11f1d0 con 0x7f386415c340 2024-04-25T09:05:38.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.507+0000 7f3863e00640 1 --2- 172.21.15.173:0/3562909855 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3844066f60 0x7f3844069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:38.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.507+0000 7f3863e00640 1 --2- 172.21.15.173:0/3562909855 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3844066f60 0x7f3844069420 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3854001060 tx=0x7f3854009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:38.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.511+0000 7f385be00640 1 -- 172.21.15.173:0/3562909855 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f386414b630 con 0x7f386415c340 2024-04-25T09:05:38.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.695+0000 7f386aa00640 1 -- 172.21.15.173:0/3562909855 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3864073a40 con 0x7f386415c340 2024-04-25T09:05:38.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.695+0000 7f385be00640 1 -- 172.21.15.173:0/3562909855 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f385c016990 con 0x7f386415c340 2024-04-25T09:05:38.689 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:38.689 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2065115729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2065115729},{"type":"v1","addr":"172.21.15.194:6834","nonce":2065115729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4121705012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4121705012},{"type":"v1","addr":"172.21.15.194:6835","nonce":4121705012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3839820980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3839820980},{"type":"v1","addr":"172.21.15.173:6836","nonce":3839820980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T09:04:03.205878+0000","modified":"2024-04-25T09:04:15.561642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/960880761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":960880761},{"type":"v1","addr":"172.21.15.173:6837","nonce":960880761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:05:38.689 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 19 2024-04-25T09:05:38.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.699+0000 7f386aa00640 1 -- 172.21.15.173:0/3562909855 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3844066f60 msgr2=0x7f3844069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:38.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.699+0000 7f386aa00640 1 --2- 172.21.15.173:0/3562909855 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3844066f60 0x7f3844069420 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3854001060 tx=0x7f3854009040 comp rx=0 tx=0).stop 2024-04-25T09:05:38.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.699+0000 7f386aa00640 1 -- 172.21.15.173:0/3562909855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f386415c340 msgr2=0x7f386415c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:38.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.699+0000 7f386aa00640 1 --2- 172.21.15.173:0/3562909855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f386415c340 0x7f386415c7c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f385c0b0040 tx=0x7f385c009750 comp rx=0 tx=0).stop 2024-04-25T09:05:38.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.699+0000 7f386aa00640 1 -- 172.21.15.173:0/3562909855 shutdown_connections 2024-04-25T09:05:38.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.699+0000 7f386aa00640 1 --2- 172.21.15.173:0/3562909855 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3844066f60 0x7f3844069420 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.699+0000 7f386aa00640 1 --2- 172.21.15.173:0/3562909855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f386415c340 0x7f386415c7c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.699+0000 7f386aa00640 1 --2- 172.21.15.173:0/3562909855 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38640b0430 0x7f386415be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.699+0000 7f386aa00640 1 --2- 172.21.15.173:0/3562909855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3848006f60 0x7f38640afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.699+0000 7f386aa00640 1 -- 172.21.15.173:0/3562909855 >> 172.21.15.173:0/3562909855 conn(0x7f386406ac90 msgr2=0x7f38640adae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:38.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.699+0000 7f386aa00640 1 -- 172.21.15.173:0/3562909855 shutdown_connections 2024-04-25T09:05:38.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.699+0000 7f386aa00640 1 -- 172.21.15.173:0/3562909855 wait complete. 2024-04-25T09:05:38.710 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:38.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.855+0000 7efe03200640 1 Processor -- start 2024-04-25T09:05:38.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.855+0000 7efe03200640 1 -- start start 2024-04-25T09:05:38.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.855+0000 7efe03200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efdfc0b2aa0 0x7efdfc0b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:38.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.855+0000 7efe03200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efdfc15ec10 0x7efdfc072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:38.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.855+0000 7efe03200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdfc0cdd30 con 0x7efdfc0af0f0 2024-04-25T09:05:38.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.855+0000 7efe03200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc0b33c0 con 0x7efdfc15ec10 2024-04-25T09:05:38.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.855+0000 7efe03200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc162140 con 0x7efdfc0b2aa0 2024-04-25T09:05:38.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.855+0000 7efe01200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efdfc15ec10 0x7efdfc072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:38.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.859+0000 7efe01200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efdfc15ec10 0x7efdfc072030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59272/0 (socket says 172.21.15.173:59272) 2024-04-25T09:05:38.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.859+0000 7efe01200640 1 -- 172.21.15.173:0/3953148752 learned_addr learned my addr 172.21.15.173:0/3953148752 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:38.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.859+0000 7efdfb400640 1 --1- 172.21.15.173:0/3953148752 >> v1:172.21.15.173:6789/0 conn(0x7efdfc0af0f0 0x7efdfc0cd620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47042/0 (socket says 172.21.15.173:47042) 2024-04-25T09:05:38.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.859+0000 7efdfbe00640 1 --2- 172.21.15.173:0/3953148752 >> v2:172.21.15.194:3300/0 conn(0x7efdfc0b2aa0 0x7efdfc0b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:38.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.859+0000 7efe01200640 1 -- 172.21.15.173:0/3953148752 >> v2:172.21.15.194:3300/0 conn(0x7efdfc0b2aa0 msgr2=0x7efdfc0b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:38.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.859+0000 7efe01200640 1 --2- 172.21.15.173:0/3953148752 >> v2:172.21.15.194:3300/0 conn(0x7efdfc0b2aa0 0x7efdfc0b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.859+0000 7efe01200640 1 -- 172.21.15.173:0/3953148752 >> v1:172.21.15.173:6789/0 conn(0x7efdfc0af0f0 legacy=0x7efdfc0cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:38.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.859+0000 7efe01200640 1 -- 172.21.15.173:0/3953148752 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc162420 con 0x7efdfc15ec10 2024-04-25T09:05:38.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.859+0000 7efdfbe00640 1 --2- 172.21.15.173:0/3953148752 >> v2:172.21.15.194:3300/0 conn(0x7efdfc0b2aa0 0x7efdfc0b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:38.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.859+0000 7efe01200640 1 --2- 172.21.15.173:0/3953148752 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdfc15ec10 0x7efdfc072030 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7efdfc06d080 tx=0x7efdf401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29120eca9cca9376 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:38.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.859+0000 7efdfaa00640 1 -- 172.21.15.173:0/3953148752 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf40b4070 con 0x7efdfc15ec10 2024-04-25T09:05:38.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.859+0000 7efdfaa00640 1 -- 172.21.15.173:0/3953148752 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf40af400 con 0x7efdfc15ec10 2024-04-25T09:05:38.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.859+0000 7efdfaa00640 1 -- 172.21.15.173:0/3953148752 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf40af7d0 con 0x7efdfc15ec10 2024-04-25T09:05:38.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efe03200640 1 -- 172.21.15.173:0/3953148752 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdfc15ec10 msgr2=0x7efdfc072030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:38.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efe03200640 1 --2- 172.21.15.173:0/3953148752 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdfc15ec10 0x7efdfc072030 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7efdfc06d080 tx=0x7efdf401f1e0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efe03200640 1 -- 172.21.15.173:0/3953148752 shutdown_connections 2024-04-25T09:05:38.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efe03200640 1 --2- 172.21.15.173:0/3953148752 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdfc15ec10 0x7efdfc072030 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efe03200640 1 --2- 172.21.15.173:0/3953148752 >> v2:172.21.15.194:3300/0 conn(0x7efdfc0b2aa0 0x7efdfc0b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efe03200640 1 -- 172.21.15.173:0/3953148752 >> 172.21.15.173:0/3953148752 conn(0x7efdfc0cfa50 msgr2=0x7efdfc0cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:38.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efe03200640 1 -- 172.21.15.173:0/3953148752 shutdown_connections 2024-04-25T09:05:38.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efe03200640 1 -- 172.21.15.173:0/3953148752 wait complete. 2024-04-25T09:05:38.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efe03200640 1 Processor -- start 2024-04-25T09:05:38.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efe03200640 1 -- start start 2024-04-25T09:05:38.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efe03200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdfc0af0f0 0x7efdfc148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:38.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efe03200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efdfc0b2aa0 0x7efdfc14b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:38.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efe03200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdfc15ec10 0x7efdfc1f73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:38.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efe03200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0616b0 con 0x7efdfc0af0f0 2024-04-25T09:05:38.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efe03200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc071b10 con 0x7efdfc15ec10 2024-04-25T09:05:38.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efe03200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc061830 con 0x7efdfc0b2aa0 2024-04-25T09:05:38.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efdfbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdfc0af0f0 0x7efdfc148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:38.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efdfbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdfc0af0f0 0x7efdfc148780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59288/0 (socket says 172.21.15.173:59288) 2024-04-25T09:05:38.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efdfbe00640 1 -- 172.21.15.173:0/2374630875 learned_addr learned my addr 172.21.15.173:0/2374630875 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:38.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efdfbe00640 1 -- 172.21.15.173:0/2374630875 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efdfc0b2aa0 msgr2=0x7efdfc14b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:38.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efdfbe00640 1 --2- 172.21.15.173:0/2374630875 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efdfc0b2aa0 0x7efdfc14b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efdfbe00640 1 -- 172.21.15.173:0/2374630875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdfc15ec10 msgr2=0x7efdfc1f73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:38.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efdfbe00640 1 --2- 172.21.15.173:0/2374630875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdfc15ec10 0x7efdfc1f73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efdfbe00640 1 -- 172.21.15.173:0/2374630875 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc14b9e0 con 0x7efdfc0af0f0 2024-04-25T09:05:38.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efdfbe00640 1 --2- 172.21.15.173:0/2374630875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdfc0af0f0 0x7efdfc148780 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efdec00c7c0 tx=0x7efdec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:38.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.863+0000 7efdf3e00640 1 -- 172.21.15.173:0/2374630875 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec007a30 con 0x7efdfc0af0f0 2024-04-25T09:05:38.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.867+0000 7efdf3e00640 1 -- 172.21.15.173:0/2374630875 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec007bd0 con 0x7efdfc0af0f0 2024-04-25T09:05:38.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.867+0000 7efdf3e00640 1 -- 172.21.15.173:0/2374630875 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec0113f0 con 0x7efdfc0af0f0 2024-04-25T09:05:38.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.867+0000 7efe03200640 1 -- 172.21.15.173:0/2374630875 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc14bcc0 con 0x7efdfc0af0f0 2024-04-25T09:05:38.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.867+0000 7efe03200640 1 -- 172.21.15.173:0/2374630875 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc1f6be0 con 0x7efdfc0af0f0 2024-04-25T09:05:38.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.867+0000 7efe03200640 1 -- 172.21.15.173:0/2374630875 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdfc073a40 con 0x7efdfc0af0f0 2024-04-25T09:05:38.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.867+0000 7efdf3e00640 1 -- 172.21.15.173:0/2374630875 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efdec011590 con 0x7efdfc0af0f0 2024-04-25T09:05:38.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.867+0000 7efdf3e00640 1 --2- 172.21.15.173:0/2374630875 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efddc066f60 0x7efddc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:38.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.867+0000 7efdf3e00640 1 -- 172.21.15.173:0/2374630875 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7efdec085490 con 0x7efdfc0af0f0 2024-04-25T09:05:38.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.867+0000 7efdfb400640 1 --2- 172.21.15.173:0/2374630875 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efddc066f60 0x7efddc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:38.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.867+0000 7efdfb400640 1 --2- 172.21.15.173:0/2374630875 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efddc066f60 0x7efddc069420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efde8000f70 tx=0x7efde8007a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:38.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:38.871+0000 7efdf3e00640 1 -- 172.21.15.173:0/2374630875 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efdec015020 con 0x7efdfc0af0f0 2024-04-25T09:05:39.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.027+0000 7efe03200640 1 -- 172.21.15.173:0/2374630875 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdfc15e9f0 con 0x7efdfc0af0f0 2024-04-25T09:05:39.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.031+0000 7efdf3e00640 1 -- 172.21.15.173:0/2374630875 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+17059 (secure 0 0 0) 0x7efdec056240 con 0x7efdfc0af0f0 2024-04-25T09:05:39.022 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:39.022 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":44,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:05:15.433778+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:00.889429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:02.209182+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:39.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.031+0000 7efe03200640 1 -- 172.21.15.173:0/2374630875 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efddc066f60 msgr2=0x7efddc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.031+0000 7efe03200640 1 --2- 172.21.15.173:0/2374630875 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efddc066f60 0x7efddc069420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efde8000f70 tx=0x7efde8007a10 comp rx=0 tx=0).stop 2024-04-25T09:05:39.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.031+0000 7efe03200640 1 -- 172.21.15.173:0/2374630875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdfc0af0f0 msgr2=0x7efdfc148780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.031+0000 7efe03200640 1 --2- 172.21.15.173:0/2374630875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdfc0af0f0 0x7efdfc148780 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efdec00c7c0 tx=0x7efdec00cc80 comp rx=0 tx=0).stop 2024-04-25T09:05:39.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.031+0000 7efe03200640 1 -- 172.21.15.173:0/2374630875 shutdown_connections 2024-04-25T09:05:39.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.031+0000 7efe03200640 1 --2- 172.21.15.173:0/2374630875 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efddc066f60 0x7efddc069420 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.031+0000 7efe03200640 1 --2- 172.21.15.173:0/2374630875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdfc15ec10 0x7efdfc1f73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.031+0000 7efe03200640 1 --2- 172.21.15.173:0/2374630875 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efdfc0b2aa0 0x7efdfc14b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.031+0000 7efe03200640 1 --2- 172.21.15.173:0/2374630875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdfc0af0f0 0x7efdfc148780 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.031+0000 7efe03200640 1 -- 172.21.15.173:0/2374630875 >> 172.21.15.173:0/2374630875 conn(0x7efdfc0cfa50 msgr2=0x7efdfc0cd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:39.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.031+0000 7efe03200640 1 -- 172.21.15.173:0/2374630875 shutdown_connections 2024-04-25T09:05:39.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.031+0000 7efe03200640 1 -- 172.21.15.173:0/2374630875 wait complete. 2024-04-25T09:05:39.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:00.889429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:04:02.209182+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 43, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:05:39.045 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:05:39.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.191+0000 7f0492600640 1 Processor -- start 2024-04-25T09:05:39.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.191+0000 7f0492600640 1 -- start start 2024-04-25T09:05:39.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.191+0000 7f0492600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f048c145290 0x7f048c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.191+0000 7f0492600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f048c0cc260 0x7f048c0cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.191+0000 7f0492600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f048c15c5f0 con 0x7f048c0b3fe0 2024-04-25T09:05:39.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.191+0000 7f0492600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f048c06d4b0 con 0x7f048c145290 2024-04-25T09:05:39.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.191+0000 7f0492600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f048c06d790 con 0x7f048c0cc260 2024-04-25T09:05:39.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.191+0000 7f048b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f048c145290 0x7f048c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.191+0000 7f048aa00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f048c0b3fe0 0x7f048c0b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47056/0 (socket says 172.21.15.173:47056) 2024-04-25T09:05:39.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.195+0000 7f048aa00640 1 -- 172.21.15.173:0/1069558185 learned_addr learned my addr 172.21.15.173:0/1069558185 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:39.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.195+0000 7f048be00640 1 --2- 172.21.15.173:0/1069558185 >> v2:172.21.15.194:3300/0 conn(0x7f048c0cc260 0x7f048c0cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.195+0000 7f048b400640 1 -- 172.21.15.173:0/1069558185 >> v2:172.21.15.194:3300/0 conn(0x7f048c0cc260 msgr2=0x7f048c0cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:39.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.195+0000 7f048b400640 1 --2- 172.21.15.173:0/1069558185 >> v2:172.21.15.194:3300/0 conn(0x7f048c0cc260 0x7f048c0cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.195+0000 7f048b400640 1 -- 172.21.15.173:0/1069558185 >> v1:172.21.15.173:6789/0 conn(0x7f048c0b3fe0 legacy=0x7f048c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.195+0000 7f048b400640 1 -- 172.21.15.173:0/1069558185 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048c06da70 con 0x7f048c145290 2024-04-25T09:05:39.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.195+0000 7f048b400640 1 --2- 172.21.15.173:0/1069558185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f048c145290 0x7f048c15c0b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f048c15f5b0 tx=0x7f047401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a32b2b6e4326cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:39.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.195+0000 7f048a000640 1 -- 172.21.15.173:0/1069558185 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04740b0070 con 0x7f048c145290 2024-04-25T09:05:39.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.195+0000 7f048a000640 1 -- 172.21.15.173:0/1069558185 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04740ab600 con 0x7f048c145290 2024-04-25T09:05:39.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.195+0000 7f048a000640 1 -- 172.21.15.173:0/1069558185 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04740ab9d0 con 0x7f048c145290 2024-04-25T09:05:39.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.195+0000 7f0492600640 1 -- 172.21.15.173:0/1069558185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f048c145290 msgr2=0x7f048c15c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.195+0000 7f0492600640 1 --2- 172.21.15.173:0/1069558185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f048c145290 0x7f048c15c0b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f048c15f5b0 tx=0x7f047401c360 comp rx=0 tx=0).stop 2024-04-25T09:05:39.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f0492600640 1 -- 172.21.15.173:0/1069558185 shutdown_connections 2024-04-25T09:05:39.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f0492600640 1 --2- 172.21.15.173:0/1069558185 >> v2:172.21.15.194:3300/0 conn(0x7f048c0cc260 0x7f048c0cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f0492600640 1 --2- 172.21.15.173:0/1069558185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f048c145290 0x7f048c15c0b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f0492600640 1 -- 172.21.15.173:0/1069558185 >> 172.21.15.173:0/1069558185 conn(0x7f048c06ac90 msgr2=0x7f048c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:39.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f0492600640 1 -- 172.21.15.173:0/1069558185 shutdown_connections 2024-04-25T09:05:39.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f0492600640 1 -- 172.21.15.173:0/1069558185 wait complete. 2024-04-25T09:05:39.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f0492600640 1 Processor -- start 2024-04-25T09:05:39.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f0492600640 1 -- start start 2024-04-25T09:05:39.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f0492600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f048c0b3fe0 0x7f048c0a8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f0492600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f048c0cc260 0x7f048c15a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f0492600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f048c145290 0x7f048c15b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f0492600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048c06eee0 con 0x7f048c145290 2024-04-25T09:05:39.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f0492600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048c06ed60 con 0x7f048c0b3fe0 2024-04-25T09:05:39.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f0492600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048c06f060 con 0x7f048c0cc260 2024-04-25T09:05:39.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f048be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f048c145290 0x7f048c15b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f048be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f048c145290 0x7f048c15b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59310/0 (socket says 172.21.15.173:59310) 2024-04-25T09:05:39.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f048be00640 1 -- 172.21.15.173:0/344436553 learned_addr learned my addr 172.21.15.173:0/344436553 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:39.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f048b400640 1 --2- 172.21.15.173:0/344436553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f048c0b3fe0 0x7f048c0a8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f048aa00640 1 --2- 172.21.15.173:0/344436553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f048c0cc260 0x7f048c15a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f048be00640 1 -- 172.21.15.173:0/344436553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f048c0cc260 msgr2=0x7f048c15a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f048be00640 1 --2- 172.21.15.173:0/344436553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f048c0cc260 0x7f048c15a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f048be00640 1 -- 172.21.15.173:0/344436553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f048c0b3fe0 msgr2=0x7f048c0a8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f048be00640 1 --2- 172.21.15.173:0/344436553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f048c0b3fe0 0x7f048c0a8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f048be00640 1 -- 172.21.15.173:0/344436553 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048c15a620 con 0x7f048c145290 2024-04-25T09:05:39.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f048aa00640 1 --2- 172.21.15.173:0/344436553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f048c0cc260 0x7f048c15a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:39.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.199+0000 7f048be00640 1 --2- 172.21.15.173:0/344436553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f048c145290 0x7f048c15b630 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0484007e90 tx=0x7f048400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:39.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.203+0000 7f0483400640 1 -- 172.21.15.173:0/344436553 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0484014420 con 0x7f048c145290 2024-04-25T09:05:39.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.203+0000 7f0483400640 1 -- 172.21.15.173:0/344436553 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0484019070 con 0x7f048c145290 2024-04-25T09:05:39.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.203+0000 7f0483400640 1 -- 172.21.15.173:0/344436553 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0484014800 con 0x7f048c145290 2024-04-25T09:05:39.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.203+0000 7f0492600640 1 -- 172.21.15.173:0/344436553 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f048c15bb70 con 0x7f048c145290 2024-04-25T09:05:39.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.203+0000 7f0492600640 1 -- 172.21.15.173:0/344436553 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f048c0a91a0 con 0x7f048c145290 2024-04-25T09:05:39.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.203+0000 7f0492600640 1 -- 172.21.15.173:0/344436553 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f048c0a9a90 con 0x7f048c145290 2024-04-25T09:05:39.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.203+0000 7f0483400640 1 -- 172.21.15.173:0/344436553 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f04840149a0 con 0x7f048c145290 2024-04-25T09:05:39.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.203+0000 7f0483400640 1 --2- 172.21.15.173:0/344436553 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0468066f60 0x7f0468069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.203+0000 7f0483400640 1 -- 172.21.15.173:0/344436553 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f0484085a10 con 0x7f048c145290 2024-04-25T09:05:39.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.203+0000 7f048b400640 1 --2- 172.21.15.173:0/344436553 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0468066f60 0x7f0468069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.203+0000 7f048b400640 1 --2- 172.21.15.173:0/344436553 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0468066f60 0x7f0468069420 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f04740ad000 tx=0x7f0474008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:39.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.207+0000 7f0483400640 1 -- 172.21.15.173:0/344436553 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f04840567c0 con 0x7f048c145290 2024-04-25T09:05:39.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.359+0000 7f0492600640 1 -- 172.21.15.173:0/344436553 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f048c0af960 con 0x7f048c145290 2024-04-25T09:05:39.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.363+0000 7f0483400640 1 -- 172.21.15.173:0/344436553 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04840560c0 con 0x7f048c145290 2024-04-25T09:05:39.354 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:05:39.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.363+0000 7f0492600640 1 -- 172.21.15.173:0/344436553 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0468066f60 msgr2=0x7f0468069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.363+0000 7f0492600640 1 --2- 172.21.15.173:0/344436553 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0468066f60 0x7f0468069420 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f04740ad000 tx=0x7f0474008040 comp rx=0 tx=0).stop 2024-04-25T09:05:39.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.363+0000 7f0492600640 1 -- 172.21.15.173:0/344436553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f048c145290 msgr2=0x7f048c15b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.363+0000 7f0492600640 1 --2- 172.21.15.173:0/344436553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f048c145290 0x7f048c15b630 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0484007e90 tx=0x7f048400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.363+0000 7f0492600640 1 -- 172.21.15.173:0/344436553 shutdown_connections 2024-04-25T09:05:39.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.363+0000 7f0492600640 1 --2- 172.21.15.173:0/344436553 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0468066f60 0x7f0468069420 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.363+0000 7f0492600640 1 --2- 172.21.15.173:0/344436553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f048c145290 0x7f048c15b630 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.363+0000 7f0492600640 1 --2- 172.21.15.173:0/344436553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f048c0cc260 0x7f048c15a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.363+0000 7f0492600640 1 --2- 172.21.15.173:0/344436553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f048c0b3fe0 0x7f048c0a8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.363+0000 7f0492600640 1 -- 172.21.15.173:0/344436553 >> 172.21.15.173:0/344436553 conn(0x7f048c06ac90 msgr2=0x7f048c0b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:39.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.363+0000 7f0492600640 1 -- 172.21.15.173:0/344436553 shutdown_connections 2024-04-25T09:05:39.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.363+0000 7f0492600640 1 -- 172.21.15.173:0/344436553 wait complete. 2024-04-25T09:05:39.375 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:05:39.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.523+0000 7f8a5c400640 1 Processor -- start 2024-04-25T09:05:39.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.523+0000 7f8a5c400640 1 -- start start 2024-04-25T09:05:39.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.523+0000 7f8a5c400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8a54145290 0x7f8a5415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.523+0000 7f8a5c400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8a540b3fe0 0x7f8a540b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.523+0000 7f8a5c400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a540cc260 0x7f8a540cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.523+0000 7f8a5c400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a5415c5f0 con 0x7f8a54145290 2024-04-25T09:05:39.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.523+0000 7f8a5c400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a5406d4b0 con 0x7f8a540b3fe0 2024-04-25T09:05:39.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.523+0000 7f8a5c400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5406d790 con 0x7f8a540cc260 2024-04-25T09:05:39.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.523+0000 7f8a59a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8a54145290 0x7f8a5415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.523+0000 7f8a59a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8a54145290 0x7f8a5415c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59326/0 (socket says 172.21.15.173:59326) 2024-04-25T09:05:39.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.523+0000 7f8a59a00640 1 -- 172.21.15.173:0/1027679650 learned_addr learned my addr 172.21.15.173:0/1027679650 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:39.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.523+0000 7f8a5a400640 1 --2- 172.21.15.173:0/1027679650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a540cc260 0x7f8a540cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.523+0000 7f8a59000640 1 --2- 172.21.15.173:0/1027679650 >> v2:172.21.15.194:3300/0 conn(0x7f8a540b3fe0 0x7f8a540b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.523+0000 7f8a59a00640 1 -- 172.21.15.173:0/1027679650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a540cc260 msgr2=0x7f8a540cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:39.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.523+0000 7f8a59a00640 1 --2- 172.21.15.173:0/1027679650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a540cc260 0x7f8a540cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.523+0000 7f8a59a00640 1 -- 172.21.15.173:0/1027679650 >> v2:172.21.15.194:3300/0 conn(0x7f8a540b3fe0 msgr2=0x7f8a540b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:39.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.523+0000 7f8a59a00640 1 --2- 172.21.15.173:0/1027679650 >> v2:172.21.15.194:3300/0 conn(0x7f8a540b3fe0 0x7f8a540b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.523+0000 7f8a59a00640 1 -- 172.21.15.173:0/1027679650 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5406da70 con 0x7f8a54145290 2024-04-25T09:05:39.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.527+0000 7f8a59a00640 1 --2- 172.21.15.173:0/1027679650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a54145290 0x7f8a5415c0b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8a54071100 tx=0x7f8a4801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c84686dffe3b93 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:39.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.527+0000 7f8a53e00640 1 -- 172.21.15.173:0/1027679650 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a480b0070 con 0x7f8a54145290 2024-04-25T09:05:39.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.527+0000 7f8a53e00640 1 -- 172.21.15.173:0/1027679650 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a480ab600 con 0x7f8a54145290 2024-04-25T09:05:39.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.527+0000 7f8a53e00640 1 -- 172.21.15.173:0/1027679650 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a480ab9d0 con 0x7f8a54145290 2024-04-25T09:05:39.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.527+0000 7f8a5c400640 1 -- 172.21.15.173:0/1027679650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a54145290 msgr2=0x7f8a5415c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.527+0000 7f8a5c400640 1 --2- 172.21.15.173:0/1027679650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a54145290 0x7f8a5415c0b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8a54071100 tx=0x7f8a4801c400 comp rx=0 tx=0).stop 2024-04-25T09:05:39.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.527+0000 7f8a5c400640 1 -- 172.21.15.173:0/1027679650 shutdown_connections 2024-04-25T09:05:39.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.527+0000 7f8a5c400640 1 --2- 172.21.15.173:0/1027679650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a540cc260 0x7f8a540cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.527+0000 7f8a5c400640 1 --2- 172.21.15.173:0/1027679650 >> v2:172.21.15.194:3300/0 conn(0x7f8a540b3fe0 0x7f8a540b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.527+0000 7f8a5c400640 1 --2- 172.21.15.173:0/1027679650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a54145290 0x7f8a5415c0b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.527+0000 7f8a5c400640 1 -- 172.21.15.173:0/1027679650 >> 172.21.15.173:0/1027679650 conn(0x7f8a5406ac90 msgr2=0x7f8a5406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:39.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.527+0000 7f8a5c400640 1 -- 172.21.15.173:0/1027679650 shutdown_connections 2024-04-25T09:05:39.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.527+0000 7f8a5c400640 1 -- 172.21.15.173:0/1027679650 wait complete. 2024-04-25T09:05:39.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a5c400640 1 Processor -- start 2024-04-25T09:05:39.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a5c400640 1 -- start start 2024-04-25T09:05:39.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a5c400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a540b3fe0 0x7f8a54143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a5c400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a540cc260 0x7f8a5413d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a5c400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a54145290 0x7f8a5413df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a5c400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a541457f0 con 0x7f8a540b3fe0 2024-04-25T09:05:39.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a5c400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a54145670 con 0x7f8a540cc260 2024-04-25T09:05:39.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a5c400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5406ed60 con 0x7f8a54145290 2024-04-25T09:05:39.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a59a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a540b3fe0 0x7f8a54143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a59a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a540b3fe0 0x7f8a54143b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59338/0 (socket says 172.21.15.173:59338) 2024-04-25T09:05:39.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a59a00640 1 -- 172.21.15.173:0/3211509739 learned_addr learned my addr 172.21.15.173:0/3211509739 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:39.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a5a400640 1 --2- 172.21.15.173:0/3211509739 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a54145290 0x7f8a5413df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a59000640 1 --2- 172.21.15.173:0/3211509739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a540cc260 0x7f8a5413d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a59a00640 1 -- 172.21.15.173:0/3211509739 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a54145290 msgr2=0x7f8a5413df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a59a00640 1 --2- 172.21.15.173:0/3211509739 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a54145290 0x7f8a5413df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a59a00640 1 -- 172.21.15.173:0/3211509739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a540cc260 msgr2=0x7f8a5413d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a59a00640 1 --2- 172.21.15.173:0/3211509739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a540cc260 0x7f8a5413d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a59a00640 1 -- 172.21.15.173:0/3211509739 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a540ac960 con 0x7f8a540b3fe0 2024-04-25T09:05:39.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a59a00640 1 --2- 172.21.15.173:0/3211509739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a540b3fe0 0x7f8a54143b10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8a480ae040 tx=0x7f8a480191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:39.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a51600640 1 -- 172.21.15.173:0/3211509739 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a480bb070 con 0x7f8a540b3fe0 2024-04-25T09:05:39.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a51600640 1 -- 172.21.15.173:0/3211509739 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a480abe10 con 0x7f8a540b3fe0 2024-04-25T09:05:39.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a5c400640 1 -- 172.21.15.173:0/3211509739 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a540acc00 con 0x7f8a540b3fe0 2024-04-25T09:05:39.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a51600640 1 -- 172.21.15.173:0/3211509739 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a480b0040 con 0x7f8a540b3fe0 2024-04-25T09:05:39.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a5c400640 1 -- 172.21.15.173:0/3211509739 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a540ad1c0 con 0x7f8a540b3fe0 2024-04-25T09:05:39.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.531+0000 7f8a5c400640 1 -- 172.21.15.173:0/3211509739 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a54073ab0 con 0x7f8a540b3fe0 2024-04-25T09:05:39.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.535+0000 7f8a51600640 1 -- 172.21.15.173:0/3211509739 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8a480be070 con 0x7f8a540b3fe0 2024-04-25T09:05:39.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.535+0000 7f8a51600640 1 --2- 172.21.15.173:0/3211509739 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8a34066f60 0x7f8a34069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.535+0000 7f8a51600640 1 -- 172.21.15.173:0/3211509739 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f8a4811e6a0 con 0x7f8a540b3fe0 2024-04-25T09:05:39.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.535+0000 7f8a59000640 1 --2- 172.21.15.173:0/3211509739 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8a34066f60 0x7f8a34069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.535+0000 7f8a59000640 1 --2- 172.21.15.173:0/3211509739 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8a34066f60 0x7f8a34069420 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8a5415dca0 tx=0x7f8a40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:39.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.539+0000 7f8a51600640 1 -- 172.21.15.173:0/3211509739 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8a48016110 con 0x7f8a540b3fe0 2024-04-25T09:05:39.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.691+0000 7f8a5c400640 1 -- 172.21.15.173:0/3211509739 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8a54144830 con 0x7f8a540b3fe0 2024-04-25T09:05:39.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.691+0000 7f8a51600640 1 -- 172.21.15.173:0/3211509739 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8a480ef6a0 con 0x7f8a540b3fe0 2024-04-25T09:05:39.685 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:05:39.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.695+0000 7f8a5c400640 1 -- 172.21.15.173:0/3211509739 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8a34066f60 msgr2=0x7f8a34069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.695+0000 7f8a5c400640 1 --2- 172.21.15.173:0/3211509739 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8a34066f60 0x7f8a34069420 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8a5415dca0 tx=0x7f8a40008040 comp rx=0 tx=0).stop 2024-04-25T09:05:39.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.695+0000 7f8a5c400640 1 -- 172.21.15.173:0/3211509739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a540b3fe0 msgr2=0x7f8a54143b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.695+0000 7f8a5c400640 1 --2- 172.21.15.173:0/3211509739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a540b3fe0 0x7f8a54143b10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8a480ae040 tx=0x7f8a480191a0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.695+0000 7f8a5c400640 1 -- 172.21.15.173:0/3211509739 shutdown_connections 2024-04-25T09:05:39.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.695+0000 7f8a5c400640 1 --2- 172.21.15.173:0/3211509739 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8a34066f60 0x7f8a34069420 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.695+0000 7f8a5c400640 1 --2- 172.21.15.173:0/3211509739 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a54145290 0x7f8a5413df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.695+0000 7f8a5c400640 1 --2- 172.21.15.173:0/3211509739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a540cc260 0x7f8a5413d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.695+0000 7f8a5c400640 1 --2- 172.21.15.173:0/3211509739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a540b3fe0 0x7f8a54143b10 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.695+0000 7f8a5c400640 1 -- 172.21.15.173:0/3211509739 >> 172.21.15.173:0/3211509739 conn(0x7f8a5406ac90 msgr2=0x7f8a540b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:39.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.695+0000 7f8a5c400640 1 -- 172.21.15.173:0/3211509739 shutdown_connections 2024-04-25T09:05:39.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.695+0000 7f8a5c400640 1 -- 172.21.15.173:0/3211509739 wait complete. 2024-04-25T09:05:39.706 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:05:39.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.855+0000 7f524a000640 1 Processor -- start 2024-04-25T09:05:39.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.855+0000 7f524a000640 1 -- start start 2024-04-25T09:05:39.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.855+0000 7f524a000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f524406c3b0 0x7f52440616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.855+0000 7f524a000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52440727f0 0x7f524406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.855+0000 7f524a000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524415b930 con 0x7f524415b550 2024-04-25T09:05:39.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.855+0000 7f524a000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524415eea0 con 0x7f52440727f0 2024-04-25T09:05:39.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.855+0000 7f524a000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524415e320 con 0x7f524406c3b0 2024-04-25T09:05:39.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.855+0000 7f5249600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52440727f0 0x7f524406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.855+0000 7f5249600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52440727f0 0x7f524406dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59354/0 (socket says 172.21.15.173:59354) 2024-04-25T09:05:39.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.855+0000 7f5249600640 1 -- 172.21.15.173:0/471041181 learned_addr learned my addr 172.21.15.173:0/471041181 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:39.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.855+0000 7f5243e00640 1 --2- 172.21.15.173:0/471041181 >> v2:172.21.15.194:3300/0 conn(0x7f524406c3b0 0x7f52440616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.855+0000 7f5249600640 1 -- 172.21.15.173:0/471041181 >> v2:172.21.15.194:3300/0 conn(0x7f524406c3b0 msgr2=0x7f52440616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:39.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.855+0000 7f5249600640 1 --2- 172.21.15.173:0/471041181 >> v2:172.21.15.194:3300/0 conn(0x7f524406c3b0 0x7f52440616b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.855+0000 7f5249600640 1 -- 172.21.15.173:0/471041181 >> v1:172.21.15.194:6789/0 conn(0x7f524415b550 legacy=0x7f524406bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.855+0000 7f5249600640 1 -- 172.21.15.173:0/471041181 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524415e600 con 0x7f52440727f0 2024-04-25T09:05:39.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.859+0000 7f5249600640 1 --2- 172.21.15.173:0/471041181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52440727f0 0x7f524406dd50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5244062360 tx=0x7f523c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5935fb0de9141e27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:39.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.859+0000 7f5243400640 1 -- 172.21.15.173:0/471041181 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c0a5710 con 0x7f52440727f0 2024-04-25T09:05:39.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.859+0000 7f5243400640 1 -- 172.21.15.173:0/471041181 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c0a58b0 con 0x7f52440727f0 2024-04-25T09:05:39.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.859+0000 7f5243400640 1 -- 172.21.15.173:0/471041181 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c0a5c80 con 0x7f52440727f0 2024-04-25T09:05:39.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.859+0000 7f524a000640 1 -- 172.21.15.173:0/471041181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52440727f0 msgr2=0x7f524406dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.859+0000 7f524a000640 1 --2- 172.21.15.173:0/471041181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52440727f0 0x7f524406dd50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5244062360 tx=0x7f523c01c960 comp rx=0 tx=0).stop 2024-04-25T09:05:39.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.859+0000 7f524a000640 1 -- 172.21.15.173:0/471041181 shutdown_connections 2024-04-25T09:05:39.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.859+0000 7f524a000640 1 --2- 172.21.15.173:0/471041181 >> v2:172.21.15.194:3300/0 conn(0x7f524406c3b0 0x7f52440616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.859+0000 7f524a000640 1 --2- 172.21.15.173:0/471041181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52440727f0 0x7f524406dd50 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.859+0000 7f524a000640 1 -- 172.21.15.173:0/471041181 >> 172.21.15.173:0/471041181 conn(0x7f5244071b80 msgr2=0x7f5244071f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:39.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.859+0000 7f524a000640 1 -- 172.21.15.173:0/471041181 shutdown_connections 2024-04-25T09:05:39.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.859+0000 7f524a000640 1 -- 172.21.15.173:0/471041181 wait complete. 2024-04-25T09:05:39.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f524a000640 1 Processor -- start 2024-04-25T09:05:39.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f524a000640 1 -- start start 2024-04-25T09:05:39.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f524a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f524406c3b0 0x7f524414dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f524a000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52440727f0 0x7f524414e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f524a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f524415b550 0x7f5244159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f524a000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524406ec20 con 0x7f524406c3b0 2024-04-25T09:05:39.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f524a000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524406eaa0 con 0x7f52440727f0 2024-04-25T09:05:39.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f524a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524406eda0 con 0x7f524415b550 2024-04-25T09:05:39.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f5248c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f524406c3b0 0x7f524414dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f5248c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f524406c3b0 0x7f524414dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59362/0 (socket says 172.21.15.173:59362) 2024-04-25T09:05:39.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f5248c00640 1 -- 172.21.15.173:0/3775618685 learned_addr learned my addr 172.21.15.173:0/3775618685 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:39.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f5248c00640 1 -- 172.21.15.173:0/3775618685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f524415b550 msgr2=0x7f5244159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f5248c00640 1 --2- 172.21.15.173:0/3775618685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f524415b550 0x7f5244159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f5248c00640 1 -- 172.21.15.173:0/3775618685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52440727f0 msgr2=0x7f524414e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f5248c00640 1 --2- 172.21.15.173:0/3775618685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52440727f0 0x7f524414e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f5248c00640 1 -- 172.21.15.173:0/3775618685 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524414ee40 con 0x7f524406c3b0 2024-04-25T09:05:39.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f5248c00640 1 --2- 172.21.15.173:0/3775618685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f524406c3b0 0x7f524414dc70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f523800c370 tx=0x7f523800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:39.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f5240c00640 1 -- 172.21.15.173:0/3775618685 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52380052d0 con 0x7f524406c3b0 2024-04-25T09:05:39.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f5240c00640 1 -- 172.21.15.173:0/3775618685 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5238005470 con 0x7f524406c3b0 2024-04-25T09:05:39.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f524a000640 1 -- 172.21.15.173:0/3775618685 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524414f120 con 0x7f524406c3b0 2024-04-25T09:05:39.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f5240c00640 1 -- 172.21.15.173:0/3775618685 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238007240 con 0x7f524406c3b0 2024-04-25T09:05:39.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f524a000640 1 -- 172.21.15.173:0/3775618685 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524414fb10 con 0x7f524406c3b0 2024-04-25T09:05:39.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.863+0000 7f524a000640 1 -- 172.21.15.173:0/3775618685 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5244073a40 con 0x7f524406c3b0 2024-04-25T09:05:39.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.867+0000 7f5240c00640 1 -- 172.21.15.173:0/3775618685 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f52380073e0 con 0x7f524406c3b0 2024-04-25T09:05:39.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.867+0000 7f5240c00640 1 --2- 172.21.15.173:0/3775618685 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5224066f60 0x7f5224069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.867+0000 7f5240c00640 1 -- 172.21.15.173:0/3775618685 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f5238084690 con 0x7f524406c3b0 2024-04-25T09:05:39.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.867+0000 7f5243e00640 1 --2- 172.21.15.173:0/3775618685 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5224066f60 0x7f5224069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.867+0000 7f5243e00640 1 --2- 172.21.15.173:0/3775618685 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5224066f60 0x7f5224069420 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5230006aa0 tx=0x7f5230006a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:39.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:39.871+0000 7f5240c00640 1 -- 172.21.15.173:0/3775618685 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f524415b930 con 0x7f524406c3b0 2024-04-25T09:05:40.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.027+0000 7f524a000640 1 -- 172.21.15.173:0/3775618685 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f52440b4cd0 con 0x7f524406c3b0 2024-04-25T09:05:40.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.027+0000 7f5240c00640 1 -- 172.21.15.173:0/3775618685 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f52380554d0 con 0x7f524406c3b0 2024-04-25T09:05:40.018 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:05:40.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.027+0000 7f524a000640 1 -- 172.21.15.173:0/3775618685 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5224066f60 msgr2=0x7f5224069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.027+0000 7f524a000640 1 --2- 172.21.15.173:0/3775618685 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5224066f60 0x7f5224069420 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5230006aa0 tx=0x7f5230006a30 comp rx=0 tx=0).stop 2024-04-25T09:05:40.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.027+0000 7f524a000640 1 -- 172.21.15.173:0/3775618685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f524406c3b0 msgr2=0x7f524414dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.027+0000 7f524a000640 1 --2- 172.21.15.173:0/3775618685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f524406c3b0 0x7f524414dc70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f523800c370 tx=0x7f523800c830 comp rx=0 tx=0).stop 2024-04-25T09:05:40.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.027+0000 7f524a000640 1 -- 172.21.15.173:0/3775618685 shutdown_connections 2024-04-25T09:05:40.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.027+0000 7f524a000640 1 --2- 172.21.15.173:0/3775618685 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5224066f60 0x7f5224069420 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.027+0000 7f524a000640 1 --2- 172.21.15.173:0/3775618685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f524415b550 0x7f5244159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.027+0000 7f524a000640 1 --2- 172.21.15.173:0/3775618685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52440727f0 0x7f524414e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.027+0000 7f524a000640 1 --2- 172.21.15.173:0/3775618685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f524406c3b0 0x7f524414dc70 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.027+0000 7f524a000640 1 -- 172.21.15.173:0/3775618685 >> 172.21.15.173:0/3775618685 conn(0x7f5244071b80 msgr2=0x7f52440b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:40.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.027+0000 7f524a000640 1 -- 172.21.15.173:0/3775618685 shutdown_connections 2024-04-25T09:05:40.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.027+0000 7f524a000640 1 -- 172.21.15.173:0/3775618685 wait complete. 2024-04-25T09:05:40.039 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:40.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.183+0000 7fc32f600640 1 Processor -- start 2024-04-25T09:05:40.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.183+0000 7fc32f600640 1 -- start start 2024-04-25T09:05:40.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.183+0000 7fc32f600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc328070070 0x7fc3280d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.183+0000 7fc32f600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32815c460 con 0x7fc32815ba20 2024-04-25T09:05:40.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.183+0000 7fc32f600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32815c740 con 0x7fc32815be00 2024-04-25T09:05:40.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.183+0000 7fc32f600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32815ca20 con 0x7fc328070070 2024-04-25T09:05:40.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.183+0000 7fc32cc00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc32815ba20 0x7fc3280b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47066/0 (socket says 172.21.15.173:47066) 2024-04-25T09:05:40.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.183+0000 7fc32cc00640 1 -- 172.21.15.173:0/459291395 learned_addr learned my addr 172.21.15.173:0/459291395 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:40.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.183+0000 7fc32d600640 1 --2- 172.21.15.173:0/459291395 >> v2:172.21.15.194:3300/0 conn(0x7fc328070070 0x7fc3280d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.183+0000 7fc327400640 1 -- 172.21.15.173:0/459291395 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411783359 0 0) 0x7fc32815c460 con 0x7fc32815ba20 2024-04-25T09:05:40.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.183+0000 7fc327400640 1 -- 172.21.15.173:0/459291395 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc30c003530 con 0x7fc32815ba20 2024-04-25T09:05:40.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.183+0000 7fc32d600640 1 -- 172.21.15.173:0/459291395 >> v1:172.21.15.194:6789/0 conn(0x7fc32815be00 legacy=0x7fc32806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.183+0000 7fc32d600640 1 -- 172.21.15.173:0/459291395 >> v1:172.21.15.173:6789/0 conn(0x7fc32815ba20 legacy=0x7fc3280b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.183+0000 7fc32d600640 1 -- 172.21.15.173:0/459291395 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32815cd00 con 0x7fc328070070 2024-04-25T09:05:40.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.187+0000 7fc32d600640 1 --2- 172.21.15.173:0/459291395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc328070070 0x7fc3280d1a80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc3200097f0 tx=0x7fc32001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5115477353e57f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:40.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.187+0000 7fc327400640 1 -- 172.21.15.173:0/459291395 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3200b0070 con 0x7fc328070070 2024-04-25T09:05:40.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.187+0000 7fc327400640 1 -- 172.21.15.173:0/459291395 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3200ab600 con 0x7fc328070070 2024-04-25T09:05:40.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.187+0000 7fc327400640 1 -- 172.21.15.173:0/459291395 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3200ab9b0 con 0x7fc328070070 2024-04-25T09:05:40.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.187+0000 7fc32f600640 1 -- 172.21.15.173:0/459291395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc328070070 msgr2=0x7fc3280d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.187+0000 7fc32f600640 1 --2- 172.21.15.173:0/459291395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc328070070 0x7fc3280d1a80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc3200097f0 tx=0x7fc32001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.187+0000 7fc32f600640 1 -- 172.21.15.173:0/459291395 shutdown_connections 2024-04-25T09:05:40.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.187+0000 7fc32f600640 1 --2- 172.21.15.173:0/459291395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc328070070 0x7fc3280d1a80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.187+0000 7fc32f600640 1 -- 172.21.15.173:0/459291395 >> 172.21.15.173:0/459291395 conn(0x7fc328061880 msgr2=0x7fc328061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:40.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.187+0000 7fc32f600640 1 -- 172.21.15.173:0/459291395 shutdown_connections 2024-04-25T09:05:40.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.187+0000 7fc32f600640 1 -- 172.21.15.173:0/459291395 wait complete. 2024-04-25T09:05:40.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc32f600640 1 Processor -- start 2024-04-25T09:05:40.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc32f600640 1 -- start start 2024-04-25T09:05:40.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc32f600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc328070070 0x7fc328150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc32f600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc32815ba20 0x7fc3280b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc32f600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc32815be00 0x7fc328165c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc32f600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32816a2e0 con 0x7fc32815ba20 2024-04-25T09:05:40.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc32f600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32816a160 con 0x7fc32815be00 2024-04-25T09:05:40.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc32f600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32816a460 con 0x7fc328070070 2024-04-25T09:05:40.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc327e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc32815ba20 0x7fc3280b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc327e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc32815ba20 0x7fc3280b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59370/0 (socket says 172.21.15.173:59370) 2024-04-25T09:05:40.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc327e00640 1 -- 172.21.15.173:0/2124227763 learned_addr learned my addr 172.21.15.173:0/2124227763 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:40.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc32cc00640 1 --2- 172.21.15.173:0/2124227763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc328070070 0x7fc328150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc32d600640 1 --2- 172.21.15.173:0/2124227763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc32815be00 0x7fc328165c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc327e00640 1 -- 172.21.15.173:0/2124227763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc328070070 msgr2=0x7fc328150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc327e00640 1 --2- 172.21.15.173:0/2124227763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc328070070 0x7fc328150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc327e00640 1 -- 172.21.15.173:0/2124227763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc32815be00 msgr2=0x7fc328165c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc327e00640 1 --2- 172.21.15.173:0/2124227763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc32815be00 0x7fc328165c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc327e00640 1 -- 172.21.15.173:0/2124227763 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc328150670 con 0x7fc32815ba20 2024-04-25T09:05:40.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc32cc00640 1 --2- 172.21.15.173:0/2124227763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc328070070 0x7fc328150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:40.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc327e00640 1 --2- 172.21.15.173:0/2124227763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc32815ba20 0x7fc3280b4d90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc31400c3a0 tx=0x7fc31400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:40.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc324c00640 1 -- 172.21.15.173:0/2124227763 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3140052d0 con 0x7fc32815ba20 2024-04-25T09:05:40.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc324c00640 1 -- 172.21.15.173:0/2124227763 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc314005470 con 0x7fc32815ba20 2024-04-25T09:05:40.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc32f600640 1 -- 172.21.15.173:0/2124227763 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3280b55e0 con 0x7fc32815ba20 2024-04-25T09:05:40.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc324c00640 1 -- 172.21.15.173:0/2124227763 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314007260 con 0x7fc32815ba20 2024-04-25T09:05:40.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.191+0000 7fc32f600640 1 -- 172.21.15.173:0/2124227763 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc328154ea0 con 0x7fc32815ba20 2024-04-25T09:05:40.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.195+0000 7fc32f600640 1 -- 172.21.15.173:0/2124227763 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32806df30 con 0x7fc32815ba20 2024-04-25T09:05:40.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.195+0000 7fc324c00640 1 -- 172.21.15.173:0/2124227763 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc314007400 con 0x7fc32815ba20 2024-04-25T09:05:40.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.195+0000 7fc324c00640 1 --2- 172.21.15.173:0/2124227763 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc308066f60 0x7fc308069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.195+0000 7fc324c00640 1 -- 172.21.15.173:0/2124227763 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7fc314084690 con 0x7fc32815ba20 2024-04-25T09:05:40.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.195+0000 7fc32cc00640 1 --2- 172.21.15.173:0/2124227763 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc308066f60 0x7fc308069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.195+0000 7fc32cc00640 1 --2- 172.21.15.173:0/2124227763 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc308066f60 0x7fc308069420 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc318001570 tx=0x7fc318009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:40.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.199+0000 7fc324c00640 1 -- 172.21.15.173:0/2124227763 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc3140554d0 con 0x7fc32815ba20 2024-04-25T09:05:40.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.387+0000 7fc32f600640 1 -- 172.21.15.173:0/2124227763 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc32815b230 con 0x7fc32815ba20 2024-04-25T09:05:40.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.387+0000 7fc324c00640 1 -- 172.21.15.173:0/2124227763 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fc314054dd0 con 0x7fc32815ba20 2024-04-25T09:05:40.380 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:40.380 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2065115729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2065115729},{"type":"v1","addr":"172.21.15.194:6834","nonce":2065115729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4121705012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4121705012},{"type":"v1","addr":"172.21.15.194:6835","nonce":4121705012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3839820980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3839820980},{"type":"v1","addr":"172.21.15.173:6836","nonce":3839820980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T09:04:03.205878+0000","modified":"2024-04-25T09:04:15.561642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/960880761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":960880761},{"type":"v1","addr":"172.21.15.173:6837","nonce":960880761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:05:40.380 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 19 2024-04-25T09:05:40.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.391+0000 7fc32f600640 1 -- 172.21.15.173:0/2124227763 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc308066f60 msgr2=0x7fc308069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.391+0000 7fc32f600640 1 --2- 172.21.15.173:0/2124227763 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc308066f60 0x7fc308069420 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc318001570 tx=0x7fc318009040 comp rx=0 tx=0).stop 2024-04-25T09:05:40.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.391+0000 7fc32f600640 1 -- 172.21.15.173:0/2124227763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc32815ba20 msgr2=0x7fc3280b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.391+0000 7fc32f600640 1 --2- 172.21.15.173:0/2124227763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc32815ba20 0x7fc3280b4d90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc31400c3a0 tx=0x7fc31400c860 comp rx=0 tx=0).stop 2024-04-25T09:05:40.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.391+0000 7fc32f600640 1 -- 172.21.15.173:0/2124227763 shutdown_connections 2024-04-25T09:05:40.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.391+0000 7fc32f600640 1 --2- 172.21.15.173:0/2124227763 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc308066f60 0x7fc308069420 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.391+0000 7fc32f600640 1 --2- 172.21.15.173:0/2124227763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc32815be00 0x7fc328165c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.391+0000 7fc32f600640 1 --2- 172.21.15.173:0/2124227763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc32815ba20 0x7fc3280b4d90 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.391+0000 7fc32f600640 1 --2- 172.21.15.173:0/2124227763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc328070070 0x7fc328150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.391+0000 7fc32f600640 1 -- 172.21.15.173:0/2124227763 >> 172.21.15.173:0/2124227763 conn(0x7fc328061880 msgr2=0x7fc32806d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:40.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.391+0000 7fc32f600640 1 -- 172.21.15.173:0/2124227763 shutdown_connections 2024-04-25T09:05:40.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.391+0000 7fc32f600640 1 -- 172.21.15.173:0/2124227763 wait complete. 2024-04-25T09:05:40.401 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:40.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.543+0000 7f7bf6000640 1 Processor -- start 2024-04-25T09:05:40.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.547+0000 7f7bf6000640 1 -- start start 2024-04-25T09:05:40.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.547+0000 7f7bf6000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bf0159380 0x7f7bf015bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.547+0000 7f7bf6000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7bf015c260 0x7f7bf00cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.547+0000 7f7bf6000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf0159760 con 0x7f7bf00ccc20 2024-04-25T09:05:40.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.547+0000 7f7bf6000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf015ccc0 con 0x7f7bf015c260 2024-04-25T09:05:40.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.547+0000 7f7bf6000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf015c700 con 0x7f7bf0159380 2024-04-25T09:05:40.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.547+0000 7f7bf5600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7bf015c260 0x7f7bf00cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.547+0000 7f7bf5600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7bf015c260 0x7f7bf00cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59382/0 (socket says 172.21.15.173:59382) 2024-04-25T09:05:40.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.547+0000 7f7bf5600640 1 -- 172.21.15.173:0/3588466767 learned_addr learned my addr 172.21.15.173:0/3588466767 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:40.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.547+0000 7f7bf4c00640 1 --2- 172.21.15.173:0/3588466767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bf0159380 0x7f7bf015bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.547+0000 7f7bf5600640 1 -- 172.21.15.173:0/3588466767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bf0159380 msgr2=0x7f7bf015bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:40.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.547+0000 7f7bf5600640 1 --2- 172.21.15.173:0/3588466767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bf0159380 0x7f7bf015bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.547+0000 7f7bf5600640 1 -- 172.21.15.173:0/3588466767 >> v1:172.21.15.194:6789/0 conn(0x7f7bf00ccc20 legacy=0x7f7bf00cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.547+0000 7f7bf5600640 1 -- 172.21.15.173:0/3588466767 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf015c9e0 con 0x7f7bf015c260 2024-04-25T09:05:40.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.551+0000 7f7bf5600640 1 --2- 172.21.15.173:0/3588466767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bf015c260 0x7f7bf00cf5b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009e50 tx=0x7f7be801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5a5f7b30fd9400 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:40.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.551+0000 7f7bef400640 1 -- 172.21.15.173:0/3588466767 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be80a5660 con 0x7f7bf015c260 2024-04-25T09:05:40.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.551+0000 7f7bef400640 1 -- 172.21.15.173:0/3588466767 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be80a5800 con 0x7f7bf015c260 2024-04-25T09:05:40.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.551+0000 7f7bef400640 1 -- 172.21.15.173:0/3588466767 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be80a5bd0 con 0x7f7bf015c260 2024-04-25T09:05:40.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.551+0000 7f7bf6000640 1 -- 172.21.15.173:0/3588466767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bf015c260 msgr2=0x7f7bf00cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.551+0000 7f7bf6000640 1 --2- 172.21.15.173:0/3588466767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bf015c260 0x7f7bf00cf5b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009e50 tx=0x7f7be801c9a0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.551+0000 7f7bf6000640 1 -- 172.21.15.173:0/3588466767 shutdown_connections 2024-04-25T09:05:40.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.551+0000 7f7bf6000640 1 --2- 172.21.15.173:0/3588466767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bf015c260 0x7f7bf00cf5b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.551+0000 7f7bf6000640 1 --2- 172.21.15.173:0/3588466767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bf0159380 0x7f7bf015bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.551+0000 7f7bf6000640 1 -- 172.21.15.173:0/3588466767 >> 172.21.15.173:0/3588466767 conn(0x7f7bf00726a0 msgr2=0x7f7bf0099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:40.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.551+0000 7f7bf6000640 1 -- 172.21.15.173:0/3588466767 shutdown_connections 2024-04-25T09:05:40.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.551+0000 7f7bf6000640 1 -- 172.21.15.173:0/3588466767 wait complete. 2024-04-25T09:05:40.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.551+0000 7f7bf6000640 1 Processor -- start 2024-04-25T09:05:40.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.551+0000 7f7bf6000640 1 -- start start 2024-04-25T09:05:40.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7bf6000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bf0159380 0x7f7bf0146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7bf6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bf015c260 0x7f7bf0156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7bf6000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bf0150ce0 0x7f7bf0151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7bf6000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf0168a40 con 0x7f7bf015c260 2024-04-25T09:05:40.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7bf6000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf01688c0 con 0x7f7bf0159380 2024-04-25T09:05:40.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7bf6000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf0168bc0 con 0x7f7bf0150ce0 2024-04-25T09:05:40.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7befe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bf015c260 0x7f7bf0156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7befe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bf015c260 0x7f7bf0156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59398/0 (socket says 172.21.15.173:59398) 2024-04-25T09:05:40.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7befe00640 1 -- 172.21.15.173:0/807382928 learned_addr learned my addr 172.21.15.173:0/807382928 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:40.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7bf4c00640 1 --2- 172.21.15.173:0/807382928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bf0159380 0x7f7bf0146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7bf5600640 1 --2- 172.21.15.173:0/807382928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bf0150ce0 0x7f7bf0151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7befe00640 1 -- 172.21.15.173:0/807382928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bf0150ce0 msgr2=0x7f7bf0151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7befe00640 1 --2- 172.21.15.173:0/807382928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bf0150ce0 0x7f7bf0151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7befe00640 1 -- 172.21.15.173:0/807382928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bf0159380 msgr2=0x7f7bf0146250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7befe00640 1 --2- 172.21.15.173:0/807382928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bf0159380 0x7f7bf0146250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7befe00640 1 -- 172.21.15.173:0/807382928 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf00aea50 con 0x7f7bf015c260 2024-04-25T09:05:40.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7befe00640 1 --2- 172.21.15.173:0/807382928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bf015c260 0x7f7bf0156ba0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00c3a0 tx=0x7f7bdc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:40.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7becc00640 1 -- 172.21.15.173:0/807382928 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc0052d0 con 0x7f7bf015c260 2024-04-25T09:05:40.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7becc00640 1 -- 172.21.15.173:0/807382928 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc005470 con 0x7f7bf015c260 2024-04-25T09:05:40.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7bf6000640 1 -- 172.21.15.173:0/807382928 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf00aed30 con 0x7f7bf015c260 2024-04-25T09:05:40.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7becc00640 1 -- 172.21.15.173:0/807382928 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc007260 con 0x7f7bf015c260 2024-04-25T09:05:40.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7bf6000640 1 -- 172.21.15.173:0/807382928 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf00af2f0 con 0x7f7bf015c260 2024-04-25T09:05:40.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7bf6000640 1 -- 172.21.15.173:0/807382928 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf0073a40 con 0x7f7bf015c260 2024-04-25T09:05:40.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.555+0000 7f7becc00640 1 -- 172.21.15.173:0/807382928 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7bdc007400 con 0x7f7bf015c260 2024-04-25T09:05:40.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.559+0000 7f7becc00640 1 --2- 172.21.15.173:0/807382928 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7bd0066f60 0x7f7bd0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.559+0000 7f7becc00640 1 -- 172.21.15.173:0/807382928 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f7bdc084680 con 0x7f7bf015c260 2024-04-25T09:05:40.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.559+0000 7f7bf4c00640 1 --2- 172.21.15.173:0/807382928 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7bd0066f60 0x7f7bd0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.559+0000 7f7bf4c00640 1 --2- 172.21.15.173:0/807382928 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7bd0066f60 0x7f7bd0069420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7be400b9d0 tx=0x7f7be4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:40.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.563+0000 7f7becc00640 1 -- 172.21.15.173:0/807382928 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7bf0159760 con 0x7f7bf015c260 2024-04-25T09:05:40.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.715+0000 7f7bf6000640 1 -- 172.21.15.173:0/807382928 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bf00cd060 con 0x7f7bf015c260 2024-04-25T09:05:40.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.715+0000 7f7becc00640 1 -- 172.21.15.173:0/807382928 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+17059 (secure 0 0 0) 0x7f7bdc0554d0 con 0x7f7bf015c260 2024-04-25T09:05:40.709 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:40.709 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":44,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:05:15.433778+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:00.889429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:02.209182+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:40.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.719+0000 7f7bf6000640 1 -- 172.21.15.173:0/807382928 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7bd0066f60 msgr2=0x7f7bd0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.719+0000 7f7bf6000640 1 --2- 172.21.15.173:0/807382928 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7bd0066f60 0x7f7bd0069420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7be400b9d0 tx=0x7f7be4008040 comp rx=0 tx=0).stop 2024-04-25T09:05:40.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.719+0000 7f7bf6000640 1 -- 172.21.15.173:0/807382928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bf015c260 msgr2=0x7f7bf0156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.719+0000 7f7bf6000640 1 --2- 172.21.15.173:0/807382928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bf015c260 0x7f7bf0156ba0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00c3a0 tx=0x7f7bdc00c860 comp rx=0 tx=0).stop 2024-04-25T09:05:40.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.719+0000 7f7bf6000640 1 -- 172.21.15.173:0/807382928 shutdown_connections 2024-04-25T09:05:40.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.719+0000 7f7bf6000640 1 --2- 172.21.15.173:0/807382928 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7bd0066f60 0x7f7bd0069420 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.719+0000 7f7bf6000640 1 --2- 172.21.15.173:0/807382928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bf0150ce0 0x7f7bf0151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.719+0000 7f7bf6000640 1 --2- 172.21.15.173:0/807382928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bf015c260 0x7f7bf0156ba0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.719+0000 7f7bf6000640 1 --2- 172.21.15.173:0/807382928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bf0159380 0x7f7bf0146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.719+0000 7f7bf6000640 1 -- 172.21.15.173:0/807382928 >> 172.21.15.173:0/807382928 conn(0x7f7bf00726a0 msgr2=0x7f7bf00cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:40.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.719+0000 7f7bf6000640 1 -- 172.21.15.173:0/807382928 shutdown_connections 2024-04-25T09:05:40.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.719+0000 7f7bf6000640 1 -- 172.21.15.173:0/807382928 wait complete. 2024-04-25T09:05:40.731 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:05:40.731 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:40.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.875+0000 7f7738800640 1 Processor -- start 2024-04-25T09:05:40.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.875+0000 7f7738800640 1 -- start start 2024-04-25T09:05:40.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.875+0000 7f7738800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f773015ba20 0x7f773015be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.875+0000 7f7738800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7730070070 0x7f77300d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.875+0000 7f7738800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773015c460 con 0x7f77300b70f0 2024-04-25T09:05:40.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.875+0000 7f7738800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773015c740 con 0x7f773015ba20 2024-04-25T09:05:40.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.875+0000 7f7738800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773015ca20 con 0x7f7730070070 2024-04-25T09:05:40.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.875+0000 7f7735400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f77300b70f0 0x7f773006f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47080/0 (socket says 172.21.15.173:47080) 2024-04-25T09:05:40.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.875+0000 7f7735400640 1 -- 172.21.15.173:0/601058643 learned_addr learned my addr 172.21.15.173:0/601058643 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:40.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.875+0000 7f7735e00640 1 --2- 172.21.15.173:0/601058643 >> v2:172.21.15.194:3300/0 conn(0x7f773015ba20 0x7f773015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.875+0000 7f7736800640 1 --2- 172.21.15.173:0/601058643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7730070070 0x7f77300d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.875+0000 7f7734a00640 1 -- 172.21.15.173:0/601058643 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93581662 0 0) 0x7f773015c460 con 0x7f77300b70f0 2024-04-25T09:05:40.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.875+0000 7f7734a00640 1 -- 172.21.15.173:0/601058643 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7718003530 con 0x7f77300b70f0 2024-04-25T09:05:40.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.875+0000 7f7736800640 1 -- 172.21.15.173:0/601058643 >> v2:172.21.15.194:3300/0 conn(0x7f773015ba20 msgr2=0x7f773015be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:40.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.875+0000 7f7736800640 1 --2- 172.21.15.173:0/601058643 >> v2:172.21.15.194:3300/0 conn(0x7f773015ba20 0x7f773015be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.875+0000 7f7736800640 1 -- 172.21.15.173:0/601058643 >> v1:172.21.15.173:6789/0 conn(0x7f77300b70f0 legacy=0x7f773006f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.875+0000 7f7734a00640 1 -- 172.21.15.173:0/601058643 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3846010187 0 0) 0x7f7718003530 con 0x7f77300b70f0 2024-04-25T09:05:40.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.875+0000 7f7736800640 1 -- 172.21.15.173:0/601058643 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773015cd00 con 0x7f7730070070 2024-04-25T09:05:40.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.879+0000 7f7736800640 1 --2- 172.21.15.173:0/601058643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7730070070 0x7f77300d1a80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f772c009dc0 tx=0x7f772c01c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83589295ca9f31fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:40.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.879+0000 7f7734a00640 1 -- 172.21.15.173:0/601058643 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c0b2070 con 0x7f7730070070 2024-04-25T09:05:40.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.879+0000 7f7734a00640 1 -- 172.21.15.173:0/601058643 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77300b7790 con 0x7f7730070070 2024-04-25T09:05:40.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.879+0000 7f7734a00640 1 -- 172.21.15.173:0/601058643 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77200016a0 con 0x7f7730070070 2024-04-25T09:05:40.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.879+0000 7f7738800640 1 -- 172.21.15.173:0/601058643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7730070070 msgr2=0x7f77300d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.879+0000 7f7738800640 1 --2- 172.21.15.173:0/601058643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7730070070 0x7f77300d1a80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f772c009dc0 tx=0x7f772c01c840 comp rx=0 tx=0).stop 2024-04-25T09:05:40.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.879+0000 7f7738800640 1 -- 172.21.15.173:0/601058643 shutdown_connections 2024-04-25T09:05:40.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.879+0000 7f7738800640 1 --2- 172.21.15.173:0/601058643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7730070070 0x7f77300d1a80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.879+0000 7f7738800640 1 --2- 172.21.15.173:0/601058643 >> v2:172.21.15.194:3300/0 conn(0x7f773015ba20 0x7f773015be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.879+0000 7f7738800640 1 -- 172.21.15.173:0/601058643 >> 172.21.15.173:0/601058643 conn(0x7f7730061880 msgr2=0x7f7730061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:40.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.879+0000 7f7738800640 1 -- 172.21.15.173:0/601058643 shutdown_connections 2024-04-25T09:05:40.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.879+0000 7f7738800640 1 -- 172.21.15.173:0/601058643 wait complete. 2024-04-25T09:05:40.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7738800640 1 Processor -- start 2024-04-25T09:05:40.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7738800640 1 -- start start 2024-04-25T09:05:40.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7738800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7730070070 0x7f7730154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7738800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77300b70f0 0x7f773014e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7738800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f773015ba20 0x7f77301576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7738800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773015df20 con 0x7f773015ba20 2024-04-25T09:05:40.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7738800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77300d25e0 con 0x7f7730070070 2024-04-25T09:05:40.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7738800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773015e0a0 con 0x7f77300b70f0 2024-04-25T09:05:40.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7736800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f773015ba20 0x7f77301576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7736800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f773015ba20 0x7f77301576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59404/0 (socket says 172.21.15.173:59404) 2024-04-25T09:05:40.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7736800640 1 -- 172.21.15.173:0/2294570227 learned_addr learned my addr 172.21.15.173:0/2294570227 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:40.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7735400640 1 --2- 172.21.15.173:0/2294570227 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77300b70f0 0x7f773014e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7735e00640 1 --2- 172.21.15.173:0/2294570227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7730070070 0x7f7730154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7736800640 1 -- 172.21.15.173:0/2294570227 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77300b70f0 msgr2=0x7f773014e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7736800640 1 --2- 172.21.15.173:0/2294570227 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77300b70f0 0x7f773014e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7736800640 1 -- 172.21.15.173:0/2294570227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7730070070 msgr2=0x7f7730154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7736800640 1 --2- 172.21.15.173:0/2294570227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7730070070 0x7f7730154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7736800640 1 -- 172.21.15.173:0/2294570227 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7730158300 con 0x7f773015ba20 2024-04-25T09:05:40.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7735e00640 1 --2- 172.21.15.173:0/2294570227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7730070070 0x7f7730154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:40.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7736800640 1 --2- 172.21.15.173:0/2294570227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f773015ba20 0x7f77301576b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f772c0b0040 tx=0x7f772c0195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:40.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f772a000640 1 -- 172.21.15.173:0/2294570227 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c0b2050 con 0x7f773015ba20 2024-04-25T09:05:40.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f772a000640 1 -- 172.21.15.173:0/2294570227 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772c0be070 con 0x7f773015ba20 2024-04-25T09:05:40.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7738800640 1 -- 172.21.15.173:0/2294570227 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77301585e0 con 0x7f773015ba20 2024-04-25T09:05:40.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f772a000640 1 -- 172.21.15.173:0/2294570227 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c009450 con 0x7f773015ba20 2024-04-25T09:05:40.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7738800640 1 -- 172.21.15.173:0/2294570227 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7730158ba0 con 0x7f773015ba20 2024-04-25T09:05:40.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.883+0000 7f7738800640 1 -- 172.21.15.173:0/2294570227 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7730073a40 con 0x7f773015ba20 2024-04-25T09:05:40.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.887+0000 7f772a000640 1 -- 172.21.15.173:0/2294570227 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f772c0b9850 con 0x7f773015ba20 2024-04-25T09:05:40.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.887+0000 7f772a000640 1 --2- 172.21.15.173:0/2294570227 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7714066f60 0x7f7714069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.887+0000 7f772a000640 1 -- 172.21.15.173:0/2294570227 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f772c120300 con 0x7f773015ba20 2024-04-25T09:05:40.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.887+0000 7f7735e00640 1 --2- 172.21.15.173:0/2294570227 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7714066f60 0x7f7714069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.887+0000 7f7735e00640 1 --2- 172.21.15.173:0/2294570227 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7714066f60 0x7f7714069420 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f77300b1bb0 tx=0x7f7724008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:40.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:40.891+0000 7f772a000640 1 -- 172.21.15.173:0/2294570227 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f772c0164a0 con 0x7f773015ba20 2024-04-25T09:05:41.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.079+0000 7f7738800640 1 -- 172.21.15.173:0/2294570227 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77300cefc0 con 0x7f773015ba20 2024-04-25T09:05:41.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.079+0000 7f772a000640 1 -- 172.21.15.173:0/2294570227 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f772c0f1140 con 0x7f773015ba20 2024-04-25T09:05:41.070 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:41.070 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2065115729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2065115729},{"type":"v1","addr":"172.21.15.194:6834","nonce":2065115729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4121705012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4121705012},{"type":"v1","addr":"172.21.15.194:6835","nonce":4121705012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3839820980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3839820980},{"type":"v1","addr":"172.21.15.173:6836","nonce":3839820980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T09:04:03.205878+0000","modified":"2024-04-25T09:04:15.561642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/960880761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":960880761},{"type":"v1","addr":"172.21.15.173:6837","nonce":960880761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:05:41.070 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 19 2024-04-25T09:05:41.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.079+0000 7f7738800640 1 -- 172.21.15.173:0/2294570227 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7714066f60 msgr2=0x7f7714069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.079+0000 7f7738800640 1 --2- 172.21.15.173:0/2294570227 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7714066f60 0x7f7714069420 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f77300b1bb0 tx=0x7f7724008040 comp rx=0 tx=0).stop 2024-04-25T09:05:41.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.079+0000 7f7738800640 1 -- 172.21.15.173:0/2294570227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f773015ba20 msgr2=0x7f77301576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.079+0000 7f7738800640 1 --2- 172.21.15.173:0/2294570227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f773015ba20 0x7f77301576b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f772c0b0040 tx=0x7f772c0195e0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.079+0000 7f7738800640 1 -- 172.21.15.173:0/2294570227 shutdown_connections 2024-04-25T09:05:41.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.079+0000 7f7738800640 1 --2- 172.21.15.173:0/2294570227 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7714066f60 0x7f7714069420 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.079+0000 7f7738800640 1 --2- 172.21.15.173:0/2294570227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f773015ba20 0x7f77301576b0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.079+0000 7f7738800640 1 --2- 172.21.15.173:0/2294570227 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77300b70f0 0x7f773014e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.079+0000 7f7738800640 1 --2- 172.21.15.173:0/2294570227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7730070070 0x7f7730154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.079+0000 7f7738800640 1 -- 172.21.15.173:0/2294570227 >> 172.21.15.173:0/2294570227 conn(0x7f7730061880 msgr2=0x7f77300b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:41.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.079+0000 7f7738800640 1 -- 172.21.15.173:0/2294570227 shutdown_connections 2024-04-25T09:05:41.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.079+0000 7f7738800640 1 -- 172.21.15.173:0/2294570227 wait complete. 2024-04-25T09:05:41.091 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:41.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.235+0000 7f7785e00640 1 Processor -- start 2024-04-25T09:05:41.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.235+0000 7f7785e00640 1 -- start start 2024-04-25T09:05:41.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.235+0000 7f7785e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f77800b3e70 0x7f77800b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.235+0000 7f7785e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f77800aefa0 0x7f77800b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.235+0000 7f7785e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f778015edd0 0x7f77800b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.235+0000 7f7785e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778006dd50 con 0x7f77800b3e70 2024-04-25T09:05:41.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.235+0000 7f7785e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77800b4790 con 0x7f77800aefa0 2024-04-25T09:05:41.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.235+0000 7f7785e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778015f320 con 0x7f778015edd0 2024-04-25T09:05:41.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.235+0000 7f777ea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f77800b3e70 0x7f77800b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.235+0000 7f777ea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f77800b3e70 0x7f77800b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59416/0 (socket says 172.21.15.173:59416) 2024-04-25T09:05:41.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.235+0000 7f777ea00640 1 -- 172.21.15.173:0/3616599742 learned_addr learned my addr 172.21.15.173:0/3616599742 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:41.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.235+0000 7f777f400640 1 --2- 172.21.15.173:0/3616599742 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f778015edd0 0x7f77800b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.235+0000 7f777e000640 1 --2- 172.21.15.173:0/3616599742 >> v2:172.21.15.194:3300/0 conn(0x7f77800aefa0 0x7f77800b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.235+0000 7f777ea00640 1 -- 172.21.15.173:0/3616599742 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f778015edd0 msgr2=0x7f77800b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:41.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.235+0000 7f777ea00640 1 --2- 172.21.15.173:0/3616599742 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f778015edd0 0x7f77800b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.235+0000 7f777ea00640 1 -- 172.21.15.173:0/3616599742 >> v2:172.21.15.194:3300/0 conn(0x7f77800aefa0 msgr2=0x7f77800b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:41.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.235+0000 7f777ea00640 1 --2- 172.21.15.173:0/3616599742 >> v2:172.21.15.194:3300/0 conn(0x7f77800aefa0 0x7f77800b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.235+0000 7f777ea00640 1 -- 172.21.15.173:0/3616599742 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778006d420 con 0x7f77800b3e70 2024-04-25T09:05:41.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.239+0000 7f777ea00640 1 --2- 172.21.15.173:0/3616599742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77800b3e70 0x7f77800b4250 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f77800d0650 tx=0x7f776801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63857b6512bc0886 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:41.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.239+0000 7f777d600640 1 -- 172.21.15.173:0/3616599742 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77680aa430 con 0x7f77800b3e70 2024-04-25T09:05:41.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.239+0000 7f777d600640 1 -- 172.21.15.173:0/3616599742 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77680af070 con 0x7f77800b3e70 2024-04-25T09:05:41.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.239+0000 7f777d600640 1 -- 172.21.15.173:0/3616599742 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77680aa7f0 con 0x7f77800b3e70 2024-04-25T09:05:41.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.239+0000 7f7785e00640 1 -- 172.21.15.173:0/3616599742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77800b3e70 msgr2=0x7f77800b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.239+0000 7f7785e00640 1 --2- 172.21.15.173:0/3616599742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77800b3e70 0x7f77800b4250 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f77800d0650 tx=0x7f776801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.239+0000 7f7785e00640 1 -- 172.21.15.173:0/3616599742 shutdown_connections 2024-04-25T09:05:41.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.239+0000 7f7785e00640 1 --2- 172.21.15.173:0/3616599742 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f778015edd0 0x7f77800b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.239+0000 7f7785e00640 1 --2- 172.21.15.173:0/3616599742 >> v2:172.21.15.194:3300/0 conn(0x7f77800aefa0 0x7f77800b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.239+0000 7f7785e00640 1 --2- 172.21.15.173:0/3616599742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77800b3e70 0x7f77800b4250 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.239+0000 7f7785e00640 1 -- 172.21.15.173:0/3616599742 >> 172.21.15.173:0/3616599742 conn(0x7f778006ac90 msgr2=0x7f778006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:41.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.239+0000 7f7785e00640 1 -- 172.21.15.173:0/3616599742 shutdown_connections 2024-04-25T09:05:41.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.239+0000 7f7785e00640 1 -- 172.21.15.173:0/3616599742 wait complete. 2024-04-25T09:05:41.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f7785e00640 1 Processor -- start 2024-04-25T09:05:41.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f7785e00640 1 -- start start 2024-04-25T09:05:41.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f7785e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77800aefa0 0x7f778015c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f7785e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77800b3e70 0x7f778014efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f7785e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f778015edd0 0x7f77801454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f7785e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778006e1e0 con 0x7f778015edd0 2024-04-25T09:05:41.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f7785e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77800b3600 con 0x7f77800aefa0 2024-04-25T09:05:41.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f7785e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778006e360 con 0x7f77800b3e70 2024-04-25T09:05:41.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f777f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f778015edd0 0x7f77801454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f777f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f778015edd0 0x7f77801454e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59424/0 (socket says 172.21.15.173:59424) 2024-04-25T09:05:41.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f777f400640 1 -- 172.21.15.173:0/557361066 learned_addr learned my addr 172.21.15.173:0/557361066 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:41.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f777e000640 1 --2- 172.21.15.173:0/557361066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77800b3e70 0x7f778014efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f777ea00640 1 --2- 172.21.15.173:0/557361066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77800aefa0 0x7f778015c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f777f400640 1 -- 172.21.15.173:0/557361066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77800b3e70 msgr2=0x7f778014efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f777f400640 1 --2- 172.21.15.173:0/557361066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77800b3e70 0x7f778014efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f777f400640 1 -- 172.21.15.173:0/557361066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77800aefa0 msgr2=0x7f778015c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f777f400640 1 --2- 172.21.15.173:0/557361066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77800aefa0 0x7f778015c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f777f400640 1 -- 172.21.15.173:0/557361066 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778015cbb0 con 0x7f778015edd0 2024-04-25T09:05:41.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f777e000640 1 --2- 172.21.15.173:0/557361066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77800b3e70 0x7f778014efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:41.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f777ea00640 1 --2- 172.21.15.173:0/557361066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77800aefa0 0x7f778015c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:41.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f777f400640 1 --2- 172.21.15.173:0/557361066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f778015edd0 0x7f77801454e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7778009d30 tx=0x7f777800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:41.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f7777400640 1 -- 172.21.15.173:0/557361066 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7778018020 con 0x7f778015edd0 2024-04-25T09:05:41.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f7777400640 1 -- 172.21.15.173:0/557361066 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7778014480 con 0x7f778015edd0 2024-04-25T09:05:41.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f7785e00640 1 -- 172.21.15.173:0/557361066 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778015ce90 con 0x7f778015edd0 2024-04-25T09:05:41.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f7777400640 1 -- 172.21.15.173:0/557361066 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7778014870 con 0x7f778015edd0 2024-04-25T09:05:41.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f7785e00640 1 -- 172.21.15.173:0/557361066 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778015d170 con 0x7f778015edd0 2024-04-25T09:05:41.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.243+0000 7f7785e00640 1 -- 172.21.15.173:0/557361066 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7780073a40 con 0x7f778015edd0 2024-04-25T09:05:41.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.247+0000 7f7777400640 1 -- 172.21.15.173:0/557361066 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f777801b020 con 0x7f778015edd0 2024-04-25T09:05:41.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.247+0000 7f7777400640 1 --2- 172.21.15.173:0/557361066 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f775c066f60 0x7f775c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.247+0000 7f7777400640 1 -- 172.21.15.173:0/557361066 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f7778085c70 con 0x7f778015edd0 2024-04-25T09:05:41.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.247+0000 7f777ea00640 1 --2- 172.21.15.173:0/557361066 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f775c066f60 0x7f775c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.247+0000 7f777ea00640 1 --2- 172.21.15.173:0/557361066 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f775c066f60 0x7f775c069420 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f77680ae000 tx=0x7f77680a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:41.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.251+0000 7f7777400640 1 -- 172.21.15.173:0/557361066 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7778022070 con 0x7f778015edd0 2024-04-25T09:05:41.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.439+0000 7f7785e00640 1 -- 172.21.15.173:0/557361066 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f778006f1c0 con 0x7f778015edd0 2024-04-25T09:05:41.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.439+0000 7f7777400640 1 -- 172.21.15.173:0/557361066 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f7778010040 con 0x7f778015edd0 2024-04-25T09:05:41.431 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:41.432 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2065115729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2065115729},{"type":"v1","addr":"172.21.15.194:6834","nonce":2065115729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4121705012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4121705012},{"type":"v1","addr":"172.21.15.194:6835","nonce":4121705012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3839820980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3839820980},{"type":"v1","addr":"172.21.15.173:6836","nonce":3839820980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T09:04:03.205878+0000","modified":"2024-04-25T09:04:15.561642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/960880761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":960880761},{"type":"v1","addr":"172.21.15.173:6837","nonce":960880761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:05:41.432 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 19 2024-04-25T09:05:41.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.443+0000 7f7785e00640 1 -- 172.21.15.173:0/557361066 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f775c066f60 msgr2=0x7f775c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.443+0000 7f7785e00640 1 --2- 172.21.15.173:0/557361066 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f775c066f60 0x7f775c069420 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f77680ae000 tx=0x7f77680a7000 comp rx=0 tx=0).stop 2024-04-25T09:05:41.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.443+0000 7f7785e00640 1 -- 172.21.15.173:0/557361066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f778015edd0 msgr2=0x7f77801454e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.443+0000 7f7785e00640 1 --2- 172.21.15.173:0/557361066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f778015edd0 0x7f77801454e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7778009d30 tx=0x7f777800c490 comp rx=0 tx=0).stop 2024-04-25T09:05:41.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.443+0000 7f7785e00640 1 -- 172.21.15.173:0/557361066 shutdown_connections 2024-04-25T09:05:41.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.443+0000 7f7785e00640 1 --2- 172.21.15.173:0/557361066 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f775c066f60 0x7f775c069420 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.443+0000 7f7785e00640 1 --2- 172.21.15.173:0/557361066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f778015edd0 0x7f77801454e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.443+0000 7f7785e00640 1 --2- 172.21.15.173:0/557361066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77800b3e70 0x7f778014efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.443+0000 7f7785e00640 1 --2- 172.21.15.173:0/557361066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77800aefa0 0x7f778015c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.443+0000 7f7785e00640 1 -- 172.21.15.173:0/557361066 >> 172.21.15.173:0/557361066 conn(0x7f778006ac90 msgr2=0x7f77800cbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:41.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.443+0000 7f7785e00640 1 -- 172.21.15.173:0/557361066 shutdown_connections 2024-04-25T09:05:41.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.443+0000 7f7785e00640 1 -- 172.21.15.173:0/557361066 wait complete. 2024-04-25T09:05:41.453 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:41.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.599+0000 7fba2be00640 1 Processor -- start 2024-04-25T09:05:41.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.599+0000 7fba2be00640 1 -- start start 2024-04-25T09:05:41.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.599+0000 7fba2be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fba24160fe0 0x7fba24161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.599+0000 7fba2be00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba24061d60 con 0x7fba2406dac0 2024-04-25T09:05:41.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.599+0000 7fba2be00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2406dfa0 con 0x7fba2406bca0 2024-04-25T09:05:41.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.599+0000 7fba2be00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba240ad510 con 0x7fba24160fe0 2024-04-25T09:05:41.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.599+0000 7fba28a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fba2406dac0 0x7fba240ace00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47082/0 (socket says 172.21.15.173:47082) 2024-04-25T09:05:41.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.599+0000 7fba28a00640 1 -- 172.21.15.173:0/1368652490 learned_addr learned my addr 172.21.15.173:0/1368652490 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:41.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.599+0000 7fba29400640 1 --2- 172.21.15.173:0/1368652490 >> v2:172.21.15.194:3300/0 conn(0x7fba24160fe0 0x7fba24161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.599+0000 7fba23e00640 1 -- 172.21.15.173:0/1368652490 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203657226 0 0) 0x7fba10001120 con 0x7fba2406dac0 2024-04-25T09:05:41.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.599+0000 7fba23e00640 1 -- 172.21.15.173:0/1368652490 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba0c003530 con 0x7fba2406dac0 2024-04-25T09:05:41.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.599+0000 7fba23e00640 1 -- 172.21.15.173:0/1368652490 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010178660 0 0) 0x7fba2406dfa0 con 0x7fba2406bca0 2024-04-25T09:05:41.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.599+0000 7fba23e00640 1 -- 172.21.15.173:0/1368652490 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba10001120 con 0x7fba2406bca0 2024-04-25T09:05:41.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.599+0000 7fba23e00640 1 -- 172.21.15.173:0/1368652490 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3483272918 0 0) 0x7fba0c003530 con 0x7fba2406dac0 2024-04-25T09:05:41.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.599+0000 7fba29400640 1 -- 172.21.15.173:0/1368652490 >> v1:172.21.15.194:6789/0 conn(0x7fba2406bca0 legacy=0x7fba2406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.603+0000 7fba29400640 1 -- 172.21.15.173:0/1368652490 >> v1:172.21.15.173:6789/0 conn(0x7fba2406dac0 legacy=0x7fba240ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.603+0000 7fba29400640 1 -- 172.21.15.173:0/1368652490 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2406e280 con 0x7fba24160fe0 2024-04-25T09:05:41.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.603+0000 7fba29400640 1 --2- 172.21.15.173:0/1368652490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba24160fe0 0x7fba24161fb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fba180097c0 tx=0x7fba1801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=852cad535b9de723 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:41.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.603+0000 7fba23e00640 1 -- 172.21.15.173:0/1368652490 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba180b0070 con 0x7fba24160fe0 2024-04-25T09:05:41.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.603+0000 7fba23e00640 1 -- 172.21.15.173:0/1368652490 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba180ab400 con 0x7fba24160fe0 2024-04-25T09:05:41.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.603+0000 7fba23e00640 1 -- 172.21.15.173:0/1368652490 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba10001850 con 0x7fba24160fe0 2024-04-25T09:05:41.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.603+0000 7fba2be00640 1 -- 172.21.15.173:0/1368652490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba24160fe0 msgr2=0x7fba24161fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.603+0000 7fba2be00640 1 --2- 172.21.15.173:0/1368652490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba24160fe0 0x7fba24161fb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fba180097c0 tx=0x7fba1801c330 comp rx=0 tx=0).stop 2024-04-25T09:05:41.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.603+0000 7fba2be00640 1 -- 172.21.15.173:0/1368652490 shutdown_connections 2024-04-25T09:05:41.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.603+0000 7fba2be00640 1 --2- 172.21.15.173:0/1368652490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba24160fe0 0x7fba24161fb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.603+0000 7fba2be00640 1 -- 172.21.15.173:0/1368652490 >> 172.21.15.173:0/1368652490 conn(0x7fba24071c20 msgr2=0x7fba24072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:41.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.603+0000 7fba2be00640 1 -- 172.21.15.173:0/1368652490 shutdown_connections 2024-04-25T09:05:41.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.603+0000 7fba2be00640 1 -- 172.21.15.173:0/1368652490 wait complete. 2024-04-25T09:05:41.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba2be00640 1 Processor -- start 2024-04-25T09:05:41.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba2be00640 1 -- start start 2024-04-25T09:05:41.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba2be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba2406bca0 0x7fba2414faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba2be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba2406dac0 0x7fba24156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba2be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba24160fe0 0x7fba24156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba2be00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2406c4c0 con 0x7fba24160fe0 2024-04-25T09:05:41.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba2be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba241624f0 con 0x7fba2406dac0 2024-04-25T09:05:41.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba2be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2415e690 con 0x7fba2406bca0 2024-04-25T09:05:41.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba29e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba24160fe0 0x7fba24156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba29e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba24160fe0 0x7fba24156f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59438/0 (socket says 172.21.15.173:59438) 2024-04-25T09:05:41.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba29e00640 1 -- 172.21.15.173:0/2460699643 learned_addr learned my addr 172.21.15.173:0/2460699643 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:41.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba29400640 1 --2- 172.21.15.173:0/2460699643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba2406bca0 0x7fba2414faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba28a00640 1 --2- 172.21.15.173:0/2460699643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba2406dac0 0x7fba24156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba29e00640 1 -- 172.21.15.173:0/2460699643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba2406bca0 msgr2=0x7fba2414faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba29e00640 1 --2- 172.21.15.173:0/2460699643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba2406bca0 0x7fba2414faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba29e00640 1 -- 172.21.15.173:0/2460699643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba2406dac0 msgr2=0x7fba24156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba29e00640 1 --2- 172.21.15.173:0/2460699643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba2406dac0 0x7fba24156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba29e00640 1 -- 172.21.15.173:0/2460699643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2415da80 con 0x7fba24160fe0 2024-04-25T09:05:41.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba29e00640 1 --2- 172.21.15.173:0/2460699643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba24160fe0 0x7fba24156f70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00c790 tx=0x7fba1c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:41.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba21600640 1 -- 172.21.15.173:0/2460699643 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c003b80 con 0x7fba24160fe0 2024-04-25T09:05:41.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba21600640 1 -- 172.21.15.173:0/2460699643 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1c003d20 con 0x7fba24160fe0 2024-04-25T09:05:41.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba2be00640 1 -- 172.21.15.173:0/2460699643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2415dd60 con 0x7fba24160fe0 2024-04-25T09:05:41.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.607+0000 7fba21600640 1 -- 172.21.15.173:0/2460699643 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c00aa50 con 0x7fba24160fe0 2024-04-25T09:05:41.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.611+0000 7fba2be00640 1 -- 172.21.15.173:0/2460699643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2415e320 con 0x7fba24160fe0 2024-04-25T09:05:41.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.611+0000 7fba2be00640 1 -- 172.21.15.173:0/2460699643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba24073a40 con 0x7fba24160fe0 2024-04-25T09:05:41.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.611+0000 7fba21600640 1 -- 172.21.15.173:0/2460699643 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fba1c00abf0 con 0x7fba24160fe0 2024-04-25T09:05:41.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.611+0000 7fba21600640 1 --2- 172.21.15.173:0/2460699643 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba04066f60 0x7fba04069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.611+0000 7fba21600640 1 -- 172.21.15.173:0/2460699643 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7fba1c0850a0 con 0x7fba24160fe0 2024-04-25T09:05:41.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.611+0000 7fba29400640 1 --2- 172.21.15.173:0/2460699643 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba04066f60 0x7fba04069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.611+0000 7fba29400640 1 --2- 172.21.15.173:0/2460699643 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba04066f60 0x7fba04069420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fba180ad000 tx=0x7fba180a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:41.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.615+0000 7fba21600640 1 -- 172.21.15.173:0/2460699643 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fba1c055890 con 0x7fba24160fe0 2024-04-25T09:05:41.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.779+0000 7fba2be00640 1 -- 172.21.15.173:0/2460699643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba24169770 con 0x7fba24160fe0 2024-04-25T09:05:41.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.779+0000 7fba21600640 1 -- 172.21.15.173:0/2460699643 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+17059 (secure 0 0 0) 0x7fba1c059930 con 0x7fba24160fe0 2024-04-25T09:05:41.773 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:41.773 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":44,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:05:15.433778+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:00.889429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:02.209182+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:41.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.783+0000 7fba2be00640 1 -- 172.21.15.173:0/2460699643 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba04066f60 msgr2=0x7fba04069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.783+0000 7fba2be00640 1 --2- 172.21.15.173:0/2460699643 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba04066f60 0x7fba04069420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fba180ad000 tx=0x7fba180a6000 comp rx=0 tx=0).stop 2024-04-25T09:05:41.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.783+0000 7fba2be00640 1 -- 172.21.15.173:0/2460699643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba24160fe0 msgr2=0x7fba24156f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.783+0000 7fba2be00640 1 --2- 172.21.15.173:0/2460699643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba24160fe0 0x7fba24156f70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00c790 tx=0x7fba1c00cc50 comp rx=0 tx=0).stop 2024-04-25T09:05:41.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.783+0000 7fba2be00640 1 -- 172.21.15.173:0/2460699643 shutdown_connections 2024-04-25T09:05:41.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.783+0000 7fba2be00640 1 --2- 172.21.15.173:0/2460699643 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba04066f60 0x7fba04069420 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.783+0000 7fba2be00640 1 --2- 172.21.15.173:0/2460699643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba24160fe0 0x7fba24156f70 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.783+0000 7fba2be00640 1 --2- 172.21.15.173:0/2460699643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba2406dac0 0x7fba24156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.783+0000 7fba2be00640 1 --2- 172.21.15.173:0/2460699643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba2406bca0 0x7fba2414faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.783+0000 7fba2be00640 1 -- 172.21.15.173:0/2460699643 >> 172.21.15.173:0/2460699643 conn(0x7fba24071c20 msgr2=0x7fba24161530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:41.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.783+0000 7fba2be00640 1 -- 172.21.15.173:0/2460699643 shutdown_connections 2024-04-25T09:05:41.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.783+0000 7fba2be00640 1 -- 172.21.15.173:0/2460699643 wait complete. 2024-04-25T09:05:41.794 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:05:41.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.939+0000 7f6d0c000640 1 Processor -- start 2024-04-25T09:05:41.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.939+0000 7f6d0c000640 1 -- start start 2024-04-25T09:05:41.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.939+0000 7f6d0c000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6d040aeb90 0x7f6d040cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.939+0000 7f6d0c000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6d040ce2b0 0x7f6d040cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.939+0000 7f6d0c000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d04071570 con 0x7f6d040aef70 2024-04-25T09:05:41.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.939+0000 7f6d0c000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d04071320 con 0x7f6d040aeb90 2024-04-25T09:05:41.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.939+0000 7f6d0c000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d04072330 con 0x7f6d040ce2b0 2024-04-25T09:05:41.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.939+0000 7f6d09600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6d040aeb90 0x7f6d040cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.939+0000 7f6d08c00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f6d040aef70 0x7f6d040cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47086/0 (socket says 172.21.15.173:47086) 2024-04-25T09:05:41.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.939+0000 7f6d08c00640 1 -- 172.21.15.173:0/1227829190 learned_addr learned my addr 172.21.15.173:0/1227829190 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:41.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.939+0000 7f6d0a000640 1 --2- 172.21.15.173:0/1227829190 >> v2:172.21.15.194:3300/0 conn(0x7f6d040ce2b0 0x7f6d040cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.939+0000 7f6d09600640 1 -- 172.21.15.173:0/1227829190 >> v2:172.21.15.194:3300/0 conn(0x7f6d040ce2b0 msgr2=0x7f6d040cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:41.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.939+0000 7f6d09600640 1 --2- 172.21.15.173:0/1227829190 >> v2:172.21.15.194:3300/0 conn(0x7f6d040ce2b0 0x7f6d040cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.939+0000 7f6d09600640 1 -- 172.21.15.173:0/1227829190 >> v1:172.21.15.173:6789/0 conn(0x7f6d040aef70 legacy=0x7f6d040cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.939+0000 7f6d09600640 1 -- 172.21.15.173:0/1227829190 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d04071850 con 0x7f6d040aeb90 2024-04-25T09:05:41.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.943+0000 7f6d09600640 1 --2- 172.21.15.173:0/1227829190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d040aeb90 0x7f6d040cc0d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6d0415e4f0 tx=0x7f6cf801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99011fbbcdba051 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:41.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.943+0000 7f6d03e00640 1 -- 172.21.15.173:0/1227829190 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf80b2070 con 0x7f6d040aeb90 2024-04-25T09:05:41.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.943+0000 7f6d03e00640 1 -- 172.21.15.173:0/1227829190 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf80a5830 con 0x7f6d040aeb90 2024-04-25T09:05:41.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.943+0000 7f6d03e00640 1 -- 172.21.15.173:0/1227829190 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf80a5c00 con 0x7f6d040aeb90 2024-04-25T09:05:41.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.943+0000 7f6d0c000640 1 -- 172.21.15.173:0/1227829190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d040aeb90 msgr2=0x7f6d040cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.943+0000 7f6d0c000640 1 --2- 172.21.15.173:0/1227829190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d040aeb90 0x7f6d040cc0d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6d0415e4f0 tx=0x7f6cf801c870 comp rx=0 tx=0).stop 2024-04-25T09:05:41.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.943+0000 7f6d0c000640 1 -- 172.21.15.173:0/1227829190 shutdown_connections 2024-04-25T09:05:41.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.943+0000 7f6d0c000640 1 --2- 172.21.15.173:0/1227829190 >> v2:172.21.15.194:3300/0 conn(0x7f6d040ce2b0 0x7f6d040cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.943+0000 7f6d0c000640 1 --2- 172.21.15.173:0/1227829190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d040aeb90 0x7f6d040cc0d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.943+0000 7f6d0c000640 1 -- 172.21.15.173:0/1227829190 >> 172.21.15.173:0/1227829190 conn(0x7f6d0406ac90 msgr2=0x7f6d0406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:41.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.943+0000 7f6d0c000640 1 -- 172.21.15.173:0/1227829190 shutdown_connections 2024-04-25T09:05:41.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.943+0000 7f6d0c000640 1 -- 172.21.15.173:0/1227829190 wait complete. 2024-04-25T09:05:41.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d0c000640 1 Processor -- start 2024-04-25T09:05:41.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d0c000640 1 -- start start 2024-04-25T09:05:41.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d0c000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d040aeb90 0x7f6d04148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d0c000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d040aef70 0x7f6d04152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d0c000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d040ce2b0 0x7f6d04138c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d0c000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0415bb30 con 0x7f6d040aeb90 2024-04-25T09:05:41.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d0c000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0415b9b0 con 0x7f6d040aef70 2024-04-25T09:05:41.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d0c000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0415bcb0 con 0x7f6d040ce2b0 2024-04-25T09:05:41.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d09600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d040aeb90 0x7f6d04148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d09600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d040aeb90 0x7f6d04148190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59460/0 (socket says 172.21.15.173:59460) 2024-04-25T09:05:41.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d09600640 1 -- 172.21.15.173:0/283343634 learned_addr learned my addr 172.21.15.173:0/283343634 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:41.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d08c00640 1 --2- 172.21.15.173:0/283343634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d040aef70 0x7f6d04152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d0a000640 1 --2- 172.21.15.173:0/283343634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d040ce2b0 0x7f6d04138c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d09600640 1 -- 172.21.15.173:0/283343634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d040ce2b0 msgr2=0x7f6d04138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d09600640 1 --2- 172.21.15.173:0/283343634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d040ce2b0 0x7f6d04138c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d09600640 1 -- 172.21.15.173:0/283343634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d040aef70 msgr2=0x7f6d04152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d09600640 1 --2- 172.21.15.173:0/283343634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d040aef70 0x7f6d04152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d09600640 1 -- 172.21.15.173:0/283343634 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d040b1590 con 0x7f6d040aeb90 2024-04-25T09:05:41.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d08c00640 1 --2- 172.21.15.173:0/283343634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d040aef70 0x7f6d04152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:41.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d0a000640 1 --2- 172.21.15.173:0/283343634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d040ce2b0 0x7f6d04138c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:41.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d09600640 1 --2- 172.21.15.173:0/283343634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d040aeb90 0x7f6d04148190 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8019480 tx=0x7f6cf8019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:41.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d01600640 1 -- 172.21.15.173:0/283343634 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf80b2050 con 0x7f6d040aeb90 2024-04-25T09:05:41.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d01600640 1 -- 172.21.15.173:0/283343634 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf80be070 con 0x7f6d040aeb90 2024-04-25T09:05:41.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d01600640 1 -- 172.21.15.173:0/283343634 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf80ada70 con 0x7f6d040aeb90 2024-04-25T09:05:41.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d0c000640 1 -- 172.21.15.173:0/283343634 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d040b1870 con 0x7f6d040aeb90 2024-04-25T09:05:41.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.947+0000 7f6d0c000640 1 -- 172.21.15.173:0/283343634 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d040b1e30 con 0x7f6d040aeb90 2024-04-25T09:05:41.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.951+0000 7f6d0c000640 1 -- 172.21.15.173:0/283343634 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d04073ab0 con 0x7f6d040aeb90 2024-04-25T09:05:41.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.951+0000 7f6d01600640 1 -- 172.21.15.173:0/283343634 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6cf80a56b0 con 0x7f6d040aeb90 2024-04-25T09:05:41.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.951+0000 7f6d01600640 1 --2- 172.21.15.173:0/283343634 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6ce4066f60 0x7f6ce4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.951+0000 7f6d01600640 1 -- 172.21.15.173:0/283343634 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f6cf8120340 con 0x7f6d040aeb90 2024-04-25T09:05:41.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.951+0000 7f6d08c00640 1 --2- 172.21.15.173:0/283343634 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6ce4066f60 0x7f6ce4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.951+0000 7f6d08c00640 1 --2- 172.21.15.173:0/283343634 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6ce4066f60 0x7f6ce4069420 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0007fd0 tx=0x7f6cf0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:41.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:41.955+0000 7f6d01600640 1 -- 172.21.15.173:0/283343634 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6cf8016520 con 0x7f6d040aeb90 2024-04-25T09:05:42.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.143+0000 7f6d0c000640 1 -- 172.21.15.173:0/283343634 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6d04159b80 con 0x7f6d040aeb90 2024-04-25T09:05:42.134 INFO:tasks.ceph.mon.a.smithi173.stderr:2024-04-25T09:05:42.143+0000 7f537be00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:05:42.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.143+0000 7f6d01600640 1 -- 172.21.15.173:0/283343634 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6cf80f11a0 con 0x7f6d040aeb90 2024-04-25T09:05:42.136 INFO:teuthology.orchestra.run.smithi173.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:05:42.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.147+0000 7f6d0c000640 1 -- 172.21.15.173:0/283343634 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6ce4066f60 msgr2=0x7f6ce4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.147+0000 7f6d0c000640 1 --2- 172.21.15.173:0/283343634 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6ce4066f60 0x7f6ce4069420 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0007fd0 tx=0x7f6cf0009040 comp rx=0 tx=0).stop 2024-04-25T09:05:42.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.147+0000 7f6d0c000640 1 -- 172.21.15.173:0/283343634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d040aeb90 msgr2=0x7f6d04148190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.147+0000 7f6d0c000640 1 --2- 172.21.15.173:0/283343634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d040aeb90 0x7f6d04148190 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8019480 tx=0x7f6cf8019610 comp rx=0 tx=0).stop 2024-04-25T09:05:42.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.147+0000 7f6d0c000640 1 -- 172.21.15.173:0/283343634 shutdown_connections 2024-04-25T09:05:42.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.147+0000 7f6d0c000640 1 --2- 172.21.15.173:0/283343634 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6ce4066f60 0x7f6ce4069420 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.147+0000 7f6d0c000640 1 --2- 172.21.15.173:0/283343634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d040ce2b0 0x7f6d04138c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.147+0000 7f6d0c000640 1 --2- 172.21.15.173:0/283343634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d040aef70 0x7f6d04152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.147+0000 7f6d0c000640 1 --2- 172.21.15.173:0/283343634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d040aeb90 0x7f6d04148190 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.147+0000 7f6d0c000640 1 -- 172.21.15.173:0/283343634 >> 172.21.15.173:0/283343634 conn(0x7f6d0406ac90 msgr2=0x7f6d0406e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:42.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.147+0000 7f6d0c000640 1 -- 172.21.15.173:0/283343634 shutdown_connections 2024-04-25T09:05:42.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.147+0000 7f6d0c000640 1 -- 172.21.15.173:0/283343634 wait complete. 2024-04-25T09:05:42.161 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:05:42.215 INFO:tasks.ceph.mds.c.smithi173.stdout:starting mds.c at 2024-04-25T09:05:42.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.311+0000 7f05ff600640 1 Processor -- start 2024-04-25T09:05:42.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.311+0000 7f05ff600640 1 -- start start 2024-04-25T09:05:42.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.311+0000 7f05ff600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05f80cc7e0 0x7f05f80cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.311+0000 7f05ff600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f05f80aef70 0x7f05f80ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.311+0000 7f05ff600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f8071570 con 0x7f05f80aeb90 2024-04-25T09:05:42.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.311+0000 7f05ff600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f8071320 con 0x7f05f80aef70 2024-04-25T09:05:42.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.311+0000 7f05ff600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f8072330 con 0x7f05f80cc7e0 2024-04-25T09:05:42.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.311+0000 7f05fd600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f05f80aef70 0x7f05f80ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.311+0000 7f05fcc00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f05f80aeb90 0x7f05f80cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47106/0 (socket says 172.21.15.173:47106) 2024-04-25T09:05:42.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.311+0000 7f05fcc00640 1 -- 172.21.15.173:0/1321363444 learned_addr learned my addr 172.21.15.173:0/1321363444 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:42.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.311+0000 7f05efe00640 1 --2- 172.21.15.173:0/1321363444 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05f80cc7e0 0x7f05f80cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.311+0000 7f05fd600640 1 -- 172.21.15.173:0/1321363444 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05f80cc7e0 msgr2=0x7f05f80cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:42.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.311+0000 7f05fd600640 1 --2- 172.21.15.173:0/1321363444 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05f80cc7e0 0x7f05f80cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.311+0000 7f05fd600640 1 -- 172.21.15.173:0/1321363444 >> v1:172.21.15.173:6789/0 conn(0x7f05f80aeb90 legacy=0x7f05f80cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.311+0000 7f05fd600640 1 -- 172.21.15.173:0/1321363444 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f8071850 con 0x7f05f80aef70 2024-04-25T09:05:42.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.315+0000 7f05fd600640 1 --2- 172.21.15.173:0/1321363444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05f80aef70 0x7f05f80ce0e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009d90 tx=0x7f05f001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14aa150f81f15bd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:42.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.315+0000 7f05f7e00640 1 -- 172.21.15.173:0/1321363444 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f00b2070 con 0x7f05f80aef70 2024-04-25T09:05:42.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.315+0000 7f05f7e00640 1 -- 172.21.15.173:0/1321363444 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f00a5790 con 0x7f05f80aef70 2024-04-25T09:05:42.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.315+0000 7f05f7e00640 1 -- 172.21.15.173:0/1321363444 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f00a5b60 con 0x7f05f80aef70 2024-04-25T09:05:42.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.315+0000 7f05ff600640 1 -- 172.21.15.173:0/1321363444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05f80aef70 msgr2=0x7f05f80ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.315+0000 7f05ff600640 1 --2- 172.21.15.173:0/1321363444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05f80aef70 0x7f05f80ce0e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009d90 tx=0x7f05f001c8e0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.315+0000 7f05ff600640 1 -- 172.21.15.173:0/1321363444 shutdown_connections 2024-04-25T09:05:42.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.315+0000 7f05ff600640 1 --2- 172.21.15.173:0/1321363444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05f80aef70 0x7f05f80ce0e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.315+0000 7f05ff600640 1 --2- 172.21.15.173:0/1321363444 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05f80cc7e0 0x7f05f80cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.315+0000 7f05ff600640 1 -- 172.21.15.173:0/1321363444 >> 172.21.15.173:0/1321363444 conn(0x7f05f806ac90 msgr2=0x7f05f806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:42.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.315+0000 7f05ff600640 1 -- 172.21.15.173:0/1321363444 shutdown_connections 2024-04-25T09:05:42.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.315+0000 7f05ff600640 1 -- 172.21.15.173:0/1321363444 wait complete. 2024-04-25T09:05:42.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05ff600640 1 Processor -- start 2024-04-25T09:05:42.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05ff600640 1 -- start start 2024-04-25T09:05:42.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05ff600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05f80aeb90 0x7f05f80b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05ff600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05f80aef70 0x7f05f814a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05ff600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05f80cc7e0 0x7f05f80cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05ff600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f815bb30 con 0x7f05f80aef70 2024-04-25T09:05:42.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05ff600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f815b9b0 con 0x7f05f80cc7e0 2024-04-25T09:05:42.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05ff600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f815bcb0 con 0x7f05f80aeb90 2024-04-25T09:05:42.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05efe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05f80aef70 0x7f05f814a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05efe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05f80aef70 0x7f05f814a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59490/0 (socket says 172.21.15.173:59490) 2024-04-25T09:05:42.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05efe00640 1 -- 172.21.15.173:0/3379157400 learned_addr learned my addr 172.21.15.173:0/3379157400 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:42.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05fcc00640 1 --2- 172.21.15.173:0/3379157400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05f80aeb90 0x7f05f80b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05fd600640 1 --2- 172.21.15.173:0/3379157400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05f80cc7e0 0x7f05f80cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05efe00640 1 -- 172.21.15.173:0/3379157400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05f80aeb90 msgr2=0x7f05f80b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05efe00640 1 --2- 172.21.15.173:0/3379157400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05f80aeb90 0x7f05f80b0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05efe00640 1 -- 172.21.15.173:0/3379157400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05f80cc7e0 msgr2=0x7f05f80cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05efe00640 1 --2- 172.21.15.173:0/3379157400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05f80cc7e0 0x7f05f80cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05efe00640 1 -- 172.21.15.173:0/3379157400 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f8153a60 con 0x7f05f80aef70 2024-04-25T09:05:42.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05efe00640 1 --2- 172.21.15.173:0/3379157400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05f80aef70 0x7f05f814a1c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f05e000d800 tx=0x7f05e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:42.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05f5600640 1 -- 172.21.15.173:0/3379157400 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e000b660 con 0x7f05f80aef70 2024-04-25T09:05:42.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05f5600640 1 -- 172.21.15.173:0/3379157400 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e0019070 con 0x7f05f80aef70 2024-04-25T09:05:42.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05ff600640 1 -- 172.21.15.173:0/3379157400 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f814e220 con 0x7f05f80aef70 2024-04-25T09:05:42.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05f5600640 1 -- 172.21.15.173:0/3379157400 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e000ba00 con 0x7f05f80aef70 2024-04-25T09:05:42.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.319+0000 7f05ff600640 1 -- 172.21.15.173:0/3379157400 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f814e7e0 con 0x7f05f80aef70 2024-04-25T09:05:42.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.323+0000 7f05ff600640 1 -- 172.21.15.173:0/3379157400 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f8073ab0 con 0x7f05f80aef70 2024-04-25T09:05:42.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.323+0000 7f05f5600640 1 -- 172.21.15.173:0/3379157400 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f05e000bba0 con 0x7f05f80aef70 2024-04-25T09:05:42.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.323+0000 7f05f5600640 1 --2- 172.21.15.173:0/3379157400 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f05d4066f60 0x7f05d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.323+0000 7f05f5600640 1 -- 172.21.15.173:0/3379157400 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6216+0+0 (secure 0 0 0) 0x7f05e0085620 con 0x7f05f80aef70 2024-04-25T09:05:42.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.323+0000 7f05fcc00640 1 --2- 172.21.15.173:0/3379157400 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f05d4066f60 0x7f05d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.323+0000 7f05fcc00640 1 --2- 172.21.15.173:0/3379157400 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f05d4066f60 0x7f05d4069420 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f05e8000f70 tx=0x7f05e8007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:42.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.327+0000 7f05f5600640 1 -- 172.21.15.173:0/3379157400 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f05e0055cb0 con 0x7f05f80aef70 2024-04-25T09:05:42.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:42.523+0000 7f05ff600640 1 -- 172.21.15.173:0/3379157400 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f05f806c300 con 0x7f05f80aef70 2024-04-25T09:05:43.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.147+0000 7f05f5600640 1 -- 172.21.15.173:0/3379157400 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f05e0059d50 con 0x7f05f80aef70 2024-04-25T09:05:43.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.147+0000 7f05ff600640 1 -- 172.21.15.173:0/3379157400 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f05d4066f60 msgr2=0x7f05d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:43.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.147+0000 7f05ff600640 1 --2- 172.21.15.173:0/3379157400 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f05d4066f60 0x7f05d4069420 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f05e8000f70 tx=0x7f05e8007e90 comp rx=0 tx=0).stop 2024-04-25T09:05:43.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.147+0000 7f05ff600640 1 -- 172.21.15.173:0/3379157400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05f80aef70 msgr2=0x7f05f814a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:43.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.147+0000 7f05ff600640 1 --2- 172.21.15.173:0/3379157400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05f80aef70 0x7f05f814a1c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f05e000d800 tx=0x7f05e000dcc0 comp rx=0 tx=0).stop 2024-04-25T09:05:43.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.147+0000 7f05ff600640 1 -- 172.21.15.173:0/3379157400 shutdown_connections 2024-04-25T09:05:43.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.147+0000 7f05ff600640 1 --2- 172.21.15.173:0/3379157400 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f05d4066f60 0x7f05d4069420 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:43.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.147+0000 7f05ff600640 1 --2- 172.21.15.173:0/3379157400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05f80cc7e0 0x7f05f80cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:43.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.147+0000 7f05ff600640 1 --2- 172.21.15.173:0/3379157400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05f80aef70 0x7f05f814a1c0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:43.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.147+0000 7f05ff600640 1 --2- 172.21.15.173:0/3379157400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05f80aeb90 0x7f05f80b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:43.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.147+0000 7f05ff600640 1 -- 172.21.15.173:0/3379157400 >> 172.21.15.173:0/3379157400 conn(0x7f05f806ac90 msgr2=0x7f05f80cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:43.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.151+0000 7f05ff600640 1 -- 172.21.15.173:0/3379157400 shutdown_connections 2024-04-25T09:05:43.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.151+0000 7f05ff600640 1 -- 172.21.15.173:0/3379157400 wait complete. 2024-04-25T09:05:43.163 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:05:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.315+0000 7f1e80400640 1 Processor -- start 2024-04-25T09:05:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.315+0000 7f1e80400640 1 -- start start 2024-04-25T09:05:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.315+0000 7f1e80400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1e780b3fe0 0x7f1e780b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.315+0000 7f1e80400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1e780cc260 0x7f1e780cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.315+0000 7f1e80400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7806d4b0 con 0x7f1e78145290 2024-04-25T09:05:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.315+0000 7f1e80400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7806d790 con 0x7f1e780b3fe0 2024-04-25T09:05:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.315+0000 7f1e80400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7806da70 con 0x7f1e780cc260 2024-04-25T09:05:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.315+0000 7f1e7d000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1e780b3fe0 0x7f1e780b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.315+0000 7f1e7d000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1e780b3fe0 0x7f1e780b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41630/0 (socket says 172.21.15.173:41630) 2024-04-25T09:05:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.315+0000 7f1e7d000640 1 -- 172.21.15.173:0/1371206780 learned_addr learned my addr 172.21.15.173:0/1371206780 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.315+0000 7f1e7da00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f1e78145290 0x7f1e7815c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:56244/0 (socket says 172.21.15.173:56244) 2024-04-25T09:05:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.315+0000 7f1e7e400640 1 --2- 172.21.15.173:0/1371206780 >> v2:172.21.15.194:3300/0 conn(0x7f1e780cc260 0x7f1e780cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.315+0000 7f1e7d000640 1 -- 172.21.15.173:0/1371206780 >> v2:172.21.15.194:3300/0 conn(0x7f1e780cc260 msgr2=0x7f1e780cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.315+0000 7f1e7d000640 1 --2- 172.21.15.173:0/1371206780 >> v2:172.21.15.194:3300/0 conn(0x7f1e780cc260 0x7f1e780cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.315+0000 7f1e7d000640 1 -- 172.21.15.173:0/1371206780 >> v1:172.21.15.173:6789/0 conn(0x7f1e78145290 legacy=0x7f1e7815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.315+0000 7f1e7d000640 1 -- 172.21.15.173:0/1371206780 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7806dd50 con 0x7f1e780b3fe0 2024-04-25T09:05:43.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.319+0000 7f1e7d000640 1 --2- 172.21.15.173:0/1371206780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e780b3fe0 0x7f1e780b4450 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1e7815f5b0 tx=0x7f1e6401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1348518f14a415c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:43.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.319+0000 7f1e77e00640 1 -- 172.21.15.173:0/1371206780 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e640b1070 con 0x7f1e780b3fe0 2024-04-25T09:05:43.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.319+0000 7f1e77e00640 1 -- 172.21.15.173:0/1371206780 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e640ac640 con 0x7f1e780b3fe0 2024-04-25T09:05:43.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.319+0000 7f1e77e00640 1 -- 172.21.15.173:0/1371206780 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e640aca10 con 0x7f1e780b3fe0 2024-04-25T09:05:43.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.319+0000 7f1e80400640 1 -- 172.21.15.173:0/1371206780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e780b3fe0 msgr2=0x7f1e780b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:43.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.319+0000 7f1e80400640 1 --2- 172.21.15.173:0/1371206780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e780b3fe0 0x7f1e780b4450 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1e7815f5b0 tx=0x7f1e6401c400 comp rx=0 tx=0).stop 2024-04-25T09:05:43.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.319+0000 7f1e80400640 1 -- 172.21.15.173:0/1371206780 shutdown_connections 2024-04-25T09:05:43.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.319+0000 7f1e80400640 1 --2- 172.21.15.173:0/1371206780 >> v2:172.21.15.194:3300/0 conn(0x7f1e780cc260 0x7f1e780cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:43.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.319+0000 7f1e80400640 1 --2- 172.21.15.173:0/1371206780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e780b3fe0 0x7f1e780b4450 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:43.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.319+0000 7f1e80400640 1 -- 172.21.15.173:0/1371206780 >> 172.21.15.173:0/1371206780 conn(0x7f1e7806ac90 msgr2=0x7f1e7806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:43.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.319+0000 7f1e80400640 1 -- 172.21.15.173:0/1371206780 shutdown_connections 2024-04-25T09:05:43.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.319+0000 7f1e80400640 1 -- 172.21.15.173:0/1371206780 wait complete. 2024-04-25T09:05:43.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e80400640 1 Processor -- start 2024-04-25T09:05:43.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e80400640 1 -- start start 2024-04-25T09:05:43.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e80400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e780b3fe0 0x7f1e7813b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:43.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e80400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e780cc260 0x7f1e7815c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:43.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e80400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e78145290 0x7f1e7813db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:43.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e80400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7806eee0 con 0x7f1e78145290 2024-04-25T09:05:43.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e80400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7806ed60 con 0x7f1e780cc260 2024-04-25T09:05:43.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e80400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7806f060 con 0x7f1e780b3fe0 2024-04-25T09:05:43.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e7e400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e78145290 0x7f1e7813db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:43.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e7e400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e78145290 0x7f1e7813db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41642/0 (socket says 172.21.15.173:41642) 2024-04-25T09:05:43.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e7e400640 1 -- 172.21.15.173:0/471242819 learned_addr learned my addr 172.21.15.173:0/471242819 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:43.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e7da00640 1 --2- 172.21.15.173:0/471242819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e780b3fe0 0x7f1e7813b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:43.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e7d000640 1 --2- 172.21.15.173:0/471242819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e780cc260 0x7f1e7815c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:43.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e7e400640 1 -- 172.21.15.173:0/471242819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e780b3fe0 msgr2=0x7f1e7813b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:43.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e7e400640 1 --2- 172.21.15.173:0/471242819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e780b3fe0 0x7f1e7813b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:43.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e7e400640 1 -- 172.21.15.173:0/471242819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e780cc260 msgr2=0x7f1e7815c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:43.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e7e400640 1 --2- 172.21.15.173:0/471242819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e780cc260 0x7f1e7815c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:43.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e7e400640 1 -- 172.21.15.173:0/471242819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7813c5d0 con 0x7f1e78145290 2024-04-25T09:05:43.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e7e400640 1 --2- 172.21.15.173:0/471242819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e78145290 0x7f1e7813db20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000d560 tx=0x7f1e7000da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:43.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e75600640 1 -- 172.21.15.173:0/471242819 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e700125f0 con 0x7f1e78145290 2024-04-25T09:05:43.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e75600640 1 -- 172.21.15.173:0/471242819 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e70019070 con 0x7f1e78145290 2024-04-25T09:05:43.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e80400640 1 -- 172.21.15.173:0/471242819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7813c010 con 0x7f1e78145290 2024-04-25T09:05:43.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e75600640 1 -- 172.21.15.173:0/471242819 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e700129f0 con 0x7f1e78145290 2024-04-25T09:05:43.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e80400640 1 -- 172.21.15.173:0/471242819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e780ad290 con 0x7f1e78145290 2024-04-25T09:05:43.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.323+0000 7f1e80400640 1 -- 172.21.15.173:0/471242819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e78073ab0 con 0x7f1e78145290 2024-04-25T09:05:43.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.327+0000 7f1e75600640 1 -- 172.21.15.173:0/471242819 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1e70012b90 con 0x7f1e78145290 2024-04-25T09:05:43.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.327+0000 7f1e75600640 1 --2- 172.21.15.173:0/471242819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1e58066f90 0x7f1e58069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:43.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.327+0000 7f1e75600640 1 -- 172.21.15.173:0/471242819 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6216+0+0 (secure 0 0 0) 0x7f1e70085540 con 0x7f1e78145290 2024-04-25T09:05:43.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.327+0000 7f1e7da00640 1 --2- 172.21.15.173:0/471242819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1e58066f90 0x7f1e58069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:43.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.327+0000 7f1e7da00640 1 --2- 172.21.15.173:0/471242819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1e58066f90 0x7f1e58069450 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0012f0 tx=0x7f1e6c001640 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.331+0000 7f1e75600640 1 -- 172.21.15.173:0/471242819 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1e70055c60 con 0x7f1e78145290 2024-04-25T09:05:43.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:43.487+0000 7f1e80400640 1 -- 172.21.15.173:0/471242819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1e780b0130 con 0x7f1e78145290 2024-04-25T09:05:44.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.147+0000 7f1e75600640 1 -- 172.21.15.173:0/471242819 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v46) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1e70059d00 con 0x7f1e78145290 2024-04-25T09:05:44.141 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:05:44.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.151+0000 7f1e80400640 1 -- 172.21.15.173:0/471242819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1e58066f90 msgr2=0x7f1e58069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:44.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.151+0000 7f1e80400640 1 --2- 172.21.15.173:0/471242819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1e58066f90 0x7f1e58069450 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0012f0 tx=0x7f1e6c001640 comp rx=0 tx=0).stop 2024-04-25T09:05:44.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.155+0000 7f1e80400640 1 -- 172.21.15.173:0/471242819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e78145290 msgr2=0x7f1e7813db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:44.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.155+0000 7f1e80400640 1 --2- 172.21.15.173:0/471242819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e78145290 0x7f1e7813db20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000d560 tx=0x7f1e7000da20 comp rx=0 tx=0).stop 2024-04-25T09:05:44.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.155+0000 7f1e80400640 1 -- 172.21.15.173:0/471242819 shutdown_connections 2024-04-25T09:05:44.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.155+0000 7f1e80400640 1 --2- 172.21.15.173:0/471242819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1e58066f90 0x7f1e58069450 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.155+0000 7f1e80400640 1 --2- 172.21.15.173:0/471242819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e78145290 0x7f1e7813db20 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.155+0000 7f1e80400640 1 --2- 172.21.15.173:0/471242819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e780cc260 0x7f1e7815c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.155+0000 7f1e80400640 1 --2- 172.21.15.173:0/471242819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e780b3fe0 0x7f1e7813b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.155+0000 7f1e80400640 1 -- 172.21.15.173:0/471242819 >> 172.21.15.173:0/471242819 conn(0x7f1e7806ac90 msgr2=0x7f1e780af570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:44.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.155+0000 7f1e80400640 1 -- 172.21.15.173:0/471242819 shutdown_connections 2024-04-25T09:05:44.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.155+0000 7f1e80400640 1 -- 172.21.15.173:0/471242819 wait complete. 2024-04-25T09:05:44.168 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:05:44.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8b7000640 1 Processor -- start 2024-04-25T09:05:44.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8b7000640 1 -- start start 2024-04-25T09:05:44.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8b7000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8b00b3fe0 0x7fa8b00b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:44.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8b7000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b006d4b0 con 0x7fa8b00cc260 2024-04-25T09:05:44.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8b7000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b006d790 con 0x7fa8b0145290 2024-04-25T09:05:44.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8b7000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b006da70 con 0x7fa8b00b3fe0 2024-04-25T09:05:44.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8b5000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa8b00cc260 0x7fa8b00cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:56258/0 (socket says 172.21.15.173:56258) 2024-04-25T09:05:44.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8b5000640 1 -- 172.21.15.173:0/2512276148 learned_addr learned my addr 172.21.15.173:0/2512276148 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:44.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8a7400640 1 --2- 172.21.15.173:0/2512276148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8b00b3fe0 0x7fa8b00b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:44.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8af400640 1 -- 172.21.15.173:0/2512276148 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090403404 0 0) 0x7fa8b006d4b0 con 0x7fa8b00cc260 2024-04-25T09:05:44.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8af400640 1 -- 172.21.15.173:0/2512276148 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa894003530 con 0x7fa8b00cc260 2024-04-25T09:05:44.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8af400640 1 -- 172.21.15.173:0/2512276148 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491163102 0 0) 0x7fa8b006d790 con 0x7fa8b0145290 2024-04-25T09:05:44.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8af400640 1 -- 172.21.15.173:0/2512276148 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8b006d4b0 con 0x7fa8b0145290 2024-04-25T09:05:44.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8af400640 1 -- 172.21.15.173:0/2512276148 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 753600208 0 0) 0x7fa894003530 con 0x7fa8b00cc260 2024-04-25T09:05:44.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8af400640 1 -- 172.21.15.173:0/2512276148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8b00b3fe0 msgr2=0x7fa8b00b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:44.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8af400640 1 --2- 172.21.15.173:0/2512276148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8b00b3fe0 0x7fa8b00b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8af400640 1 -- 172.21.15.173:0/2512276148 >> v1:172.21.15.194:6789/0 conn(0x7fa8b0145290 legacy=0x7fa8b015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:44.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8af400640 1 -- 172.21.15.173:0/2512276148 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b006dd50 con 0x7fa8b00cc260 2024-04-25T09:05:44.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8af400640 1 -- 172.21.15.173:0/2512276148 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fa8a8001a00 con 0x7fa8b00cc260 2024-04-25T09:05:44.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8af400640 1 -- 172.21.15.173:0/2512276148 >> v1:172.21.15.173:6789/0 conn(0x7fa8b00cc260 legacy=0x7fa8b00cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:44.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8af400640 1 --2- 172.21.15.173:0/2512276148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa894003b80 0x7fa894003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8af400640 1 --2- 172.21.15.173:0/2512276148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa894004810 0x7fa894004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8af400640 1 --2- 172.21.15.173:0/2512276148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8940051d0 0x7fa89400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8af400640 1 -- 172.21.15.173:0/2512276148 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b006da70 con 0x7fa8940051d0 2024-04-25T09:05:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8af400640 1 -- 172.21.15.173:0/2512276148 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89400c100 con 0x7fa894004810 2024-04-25T09:05:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8af400640 1 -- 172.21.15.173:0/2512276148 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89400c300 con 0x7fa894003b80 2024-04-25T09:05:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8a7400640 1 --2- 172.21.15.173:0/2512276148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8b00b3fe0 0x7fa8b00b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8b5000640 1 --2- 172.21.15.173:0/2512276148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8940051d0 0x7fa89400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8afe00640 1 --2- 172.21.15.173:0/2512276148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa894003b80 0x7fa894003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8a7400640 1 --2- 172.21.15.173:0/2512276148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa894004810 0x7fa894004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8b5000640 1 -- 172.21.15.173:0/2512276148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa894003b80 msgr2=0x7fa894003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8b5000640 1 --2- 172.21.15.173:0/2512276148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa894003b80 0x7fa894003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8b5000640 1 -- 172.21.15.173:0/2512276148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa894004810 msgr2=0x7fa894004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8b5000640 1 --2- 172.21.15.173:0/2512276148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa894004810 0x7fa894004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.331+0000 7fa8b5000640 1 -- 172.21.15.173:0/2512276148 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa894003530 con 0x7fa8940051d0 2024-04-25T09:05:44.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.335+0000 7fa8b5000640 1 --2- 172.21.15.173:0/2512276148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8940051d0 0x7fa89400b9d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800a7c0 tx=0x7fa8a801d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28b8af784769cf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:44.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.335+0000 7fa8af400640 1 -- 172.21.15.173:0/2512276148 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a800a410 con 0x7fa8940051d0 2024-04-25T09:05:44.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.335+0000 7fa8af400640 1 -- 172.21.15.173:0/2512276148 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a80ad650 con 0x7fa8940051d0 2024-04-25T09:05:44.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.335+0000 7fa8af400640 1 -- 172.21.15.173:0/2512276148 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80ada80 con 0x7fa8940051d0 2024-04-25T09:05:44.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.335+0000 7fa8b7000640 1 -- 172.21.15.173:0/2512276148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8940051d0 msgr2=0x7fa89400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:44.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.335+0000 7fa8b7000640 1 --2- 172.21.15.173:0/2512276148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8940051d0 0x7fa89400b9d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800a7c0 tx=0x7fa8a801d2c0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.335+0000 7fa8b5000640 1 -- 172.21.15.173:0/2512276148 reap_dead start 2024-04-25T09:05:44.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.335+0000 7fa8b7000640 1 -- 172.21.15.173:0/2512276148 shutdown_connections 2024-04-25T09:05:44.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.335+0000 7fa8b7000640 1 -- 172.21.15.173:0/2512276148 >> 172.21.15.173:0/2512276148 conn(0x7fa8b006ac90 msgr2=0x7fa8b006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:44.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.335+0000 7fa8b7000640 1 -- 172.21.15.173:0/2512276148 shutdown_connections 2024-04-25T09:05:44.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.335+0000 7fa8b7000640 1 -- 172.21.15.173:0/2512276148 wait complete. 2024-04-25T09:05:44.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8b7000640 1 Processor -- start 2024-04-25T09:05:44.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8b7000640 1 -- start start 2024-04-25T09:05:44.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8b7000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8940051d0 0x7fa8b01f7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:44.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8b7000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8b01eb110 0x7fa8b01f98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:44.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8b7000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8b01f6ba0 0x7fa8b01f7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:44.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8b7000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b006f0f0 con 0x7fa8940051d0 2024-04-25T09:05:44.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8b7000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b006ef70 con 0x7fa8b01f6ba0 2024-04-25T09:05:44.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8b7000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b01f7590 con 0x7fa8b01eb110 2024-04-25T09:05:44.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8afe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8940051d0 0x7fa8b01f7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:44.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8afe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8940051d0 0x7fa8b01f7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41674/0 (socket says 172.21.15.173:41674) 2024-04-25T09:05:44.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8afe00640 1 -- 172.21.15.173:0/4119640608 learned_addr learned my addr 172.21.15.173:0/4119640608 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:44.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8b5000640 1 --2- 172.21.15.173:0/4119640608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8b01f6ba0 0x7fa8b01f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:44.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8a7400640 1 --2- 172.21.15.173:0/4119640608 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8b01eb110 0x7fa8b01f98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:44.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8afe00640 1 -- 172.21.15.173:0/4119640608 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8b01eb110 msgr2=0x7fa8b01f98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:44.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8afe00640 1 --2- 172.21.15.173:0/4119640608 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8b01eb110 0x7fa8b01f98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8afe00640 1 -- 172.21.15.173:0/4119640608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8b01f6ba0 msgr2=0x7fa8b01f7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:44.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8afe00640 1 --2- 172.21.15.173:0/4119640608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8b01f6ba0 0x7fa8b01f7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8afe00640 1 -- 172.21.15.173:0/4119640608 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b01ea150 con 0x7fa8940051d0 2024-04-25T09:05:44.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8afe00640 1 --2- 172.21.15.173:0/4119640608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8940051d0 0x7fa8b01f7c90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000f7a0 tx=0x7fa8a000fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:44.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8acc00640 1 -- 172.21.15.173:0/4119640608 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a000fe50 con 0x7fa8940051d0 2024-04-25T09:05:44.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8acc00640 1 -- 172.21.15.173:0/4119640608 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a0018070 con 0x7fa8940051d0 2024-04-25T09:05:44.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8b7000640 1 -- 172.21.15.173:0/4119640608 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b013fc80 con 0x7fa8940051d0 2024-04-25T09:05:44.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8acc00640 1 -- 172.21.15.173:0/4119640608 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a000d730 con 0x7fa8940051d0 2024-04-25T09:05:44.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.339+0000 7fa8b7000640 1 -- 172.21.15.173:0/4119640608 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b0140240 con 0x7fa8940051d0 2024-04-25T09:05:44.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.343+0000 7fa8b7000640 1 -- 172.21.15.173:0/4119640608 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b0073ab0 con 0x7fa8940051d0 2024-04-25T09:05:44.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.343+0000 7fa8acc00640 1 -- 172.21.15.173:0/4119640608 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa8a000d8d0 con 0x7fa8940051d0 2024-04-25T09:05:44.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.343+0000 7fa8acc00640 1 --2- 172.21.15.173:0/4119640608 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa88c066f60 0x7fa88c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:44.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.343+0000 7fa8acc00640 1 -- 172.21.15.173:0/4119640608 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5778+0+0 (secure 0 0 0) 0x7fa8a0084f70 con 0x7fa8940051d0 2024-04-25T09:05:44.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.343+0000 7fa8a7400640 1 --2- 172.21.15.173:0/4119640608 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa88c066f60 0x7fa88c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:44.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.343+0000 7fa8a7400640 1 --2- 172.21.15.173:0/4119640608 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa88c066f60 0x7fa88c069420 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0162530 tx=0x7fa898009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:44.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.347+0000 7fa8acc00640 1 -- 172.21.15.173:0/4119640608 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa8a0055840 con 0x7fa8940051d0 2024-04-25T09:05:44.463 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:05:44.466 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:05:44.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:44.503+0000 7fa8b7000640 1 -- 172.21.15.173:0/4119640608 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa8b0160cd0 con 0x7fa8940051d0 2024-04-25T09:05:45.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.151+0000 7fa8acc00640 1 -- 172.21.15.173:0/4119640608 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v47) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa8a00598e0 con 0x7fa8940051d0 2024-04-25T09:05:45.143 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' removed 2024-04-25T09:05:45.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.155+0000 7fa8b7000640 1 -- 172.21.15.173:0/4119640608 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa88c066f60 msgr2=0x7fa88c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:45.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.155+0000 7fa8b7000640 1 --2- 172.21.15.173:0/4119640608 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa88c066f60 0x7fa88c069420 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0162530 tx=0x7fa898009190 comp rx=0 tx=0).stop 2024-04-25T09:05:45.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.155+0000 7fa8b7000640 1 -- 172.21.15.173:0/4119640608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8940051d0 msgr2=0x7fa8b01f7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:45.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.155+0000 7fa8b7000640 1 --2- 172.21.15.173:0/4119640608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8940051d0 0x7fa8b01f7c90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000f7a0 tx=0x7fa8a000fc60 comp rx=0 tx=0).stop 2024-04-25T09:05:45.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.155+0000 7fa8b7000640 1 -- 172.21.15.173:0/4119640608 shutdown_connections 2024-04-25T09:05:45.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.155+0000 7fa8b7000640 1 --2- 172.21.15.173:0/4119640608 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa88c066f60 0x7fa88c069420 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.155+0000 7fa8b7000640 1 --2- 172.21.15.173:0/4119640608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8b01f6ba0 0x7fa8b01f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.155+0000 7fa8b7000640 1 --2- 172.21.15.173:0/4119640608 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8b01eb110 0x7fa8b01f98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.155+0000 7fa8b7000640 1 --2- 172.21.15.173:0/4119640608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8940051d0 0x7fa8b01f7c90 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.155+0000 7fa8b7000640 1 -- 172.21.15.173:0/4119640608 >> 172.21.15.173:0/4119640608 conn(0x7fa8b006ac90 msgr2=0x7fa8b00af6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:45.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.155+0000 7fa8b7000640 1 -- 172.21.15.173:0/4119640608 shutdown_connections 2024-04-25T09:05:45.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.155+0000 7fa8b7000640 1 -- 172.21.15.173:0/4119640608 wait complete. 2024-04-25T09:05:45.172 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:05:45.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.319+0000 7fcf56000640 1 Processor -- start 2024-04-25T09:05:45.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.319+0000 7fcf56000640 1 -- start start 2024-04-25T09:05:45.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.319+0000 7fcf56000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcf500b3fe0 0x7fcf500b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:45.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.319+0000 7fcf56000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcf500cc260 0x7fcf500cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:45.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.319+0000 7fcf56000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5006d4b0 con 0x7fcf50145290 2024-04-25T09:05:45.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.319+0000 7fcf56000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5006d790 con 0x7fcf500cc260 2024-04-25T09:05:45.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.319+0000 7fcf56000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5006da70 con 0x7fcf500b3fe0 2024-04-25T09:05:45.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.319+0000 7fcf4fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcf500cc260 0x7fcf500cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:45.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.319+0000 7fcf4f400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fcf50145290 0x7fcf5015c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:56268/0 (socket says 172.21.15.173:56268) 2024-04-25T09:05:45.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.319+0000 7fcf4f400640 1 -- 172.21.15.173:0/187208128 learned_addr learned my addr 172.21.15.173:0/187208128 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:45.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.319+0000 7fcf47e00640 1 --2- 172.21.15.173:0/187208128 >> v2:172.21.15.194:3300/0 conn(0x7fcf500b3fe0 0x7fcf500b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:45.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.319+0000 7fcf4ea00640 1 -- 172.21.15.173:0/187208128 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974000865 0 0) 0x7fcf5006d4b0 con 0x7fcf50145290 2024-04-25T09:05:45.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.319+0000 7fcf4ea00640 1 -- 172.21.15.173:0/187208128 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf34003530 con 0x7fcf50145290 2024-04-25T09:05:45.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.319+0000 7fcf4fe00640 1 -- 172.21.15.173:0/187208128 >> v2:172.21.15.194:3300/0 conn(0x7fcf500b3fe0 msgr2=0x7fcf500b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:45.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.319+0000 7fcf4fe00640 1 --2- 172.21.15.173:0/187208128 >> v2:172.21.15.194:3300/0 conn(0x7fcf500b3fe0 0x7fcf500b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.319+0000 7fcf4fe00640 1 -- 172.21.15.173:0/187208128 >> v1:172.21.15.173:6789/0 conn(0x7fcf50145290 legacy=0x7fcf5015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:45.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.319+0000 7fcf4fe00640 1 -- 172.21.15.173:0/187208128 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5006dd50 con 0x7fcf500cc260 2024-04-25T09:05:45.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.319+0000 7fcf47e00640 1 --2- 172.21.15.173:0/187208128 >> v2:172.21.15.194:3300/0 conn(0x7fcf500b3fe0 0x7fcf500b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:45.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.323+0000 7fcf4fe00640 1 --2- 172.21.15.173:0/187208128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf500cc260 0x7fcf500cc670 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcf50071100 tx=0x7fcf4801c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c68cf0c3857253 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:45.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.323+0000 7fcf4ea00640 1 -- 172.21.15.173:0/187208128 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf480b2070 con 0x7fcf500cc260 2024-04-25T09:05:45.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.323+0000 7fcf4ea00640 1 -- 172.21.15.173:0/187208128 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf480a57e0 con 0x7fcf500cc260 2024-04-25T09:05:45.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.323+0000 7fcf4ea00640 1 -- 172.21.15.173:0/187208128 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf480a5bb0 con 0x7fcf500cc260 2024-04-25T09:05:45.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.323+0000 7fcf56000640 1 -- 172.21.15.173:0/187208128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf500cc260 msgr2=0x7fcf500cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:45.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.323+0000 7fcf56000640 1 --2- 172.21.15.173:0/187208128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf500cc260 0x7fcf500cc670 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcf50071100 tx=0x7fcf4801c810 comp rx=0 tx=0).stop 2024-04-25T09:05:45.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.323+0000 7fcf56000640 1 -- 172.21.15.173:0/187208128 shutdown_connections 2024-04-25T09:05:45.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.323+0000 7fcf56000640 1 --2- 172.21.15.173:0/187208128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf500cc260 0x7fcf500cc670 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.323+0000 7fcf56000640 1 --2- 172.21.15.173:0/187208128 >> v2:172.21.15.194:3300/0 conn(0x7fcf500b3fe0 0x7fcf500b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.323+0000 7fcf56000640 1 -- 172.21.15.173:0/187208128 >> 172.21.15.173:0/187208128 conn(0x7fcf5006ac90 msgr2=0x7fcf5006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:45.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.323+0000 7fcf56000640 1 -- 172.21.15.173:0/187208128 shutdown_connections 2024-04-25T09:05:45.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.323+0000 7fcf56000640 1 -- 172.21.15.173:0/187208128 wait complete. 2024-04-25T09:05:45.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf56000640 1 Processor -- start 2024-04-25T09:05:45.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf56000640 1 -- start start 2024-04-25T09:05:45.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf56000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf500b3fe0 0x7fcf5015c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:45.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf56000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf500cc260 0x7fcf500ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:45.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf56000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf50145290 0x7fcf500adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:45.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf56000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5006eee0 con 0x7fcf500cc260 2024-04-25T09:05:45.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf56000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5006ed60 con 0x7fcf500b3fe0 2024-04-25T09:05:45.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf56000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5006f060 con 0x7fcf50145290 2024-04-25T09:05:45.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf47e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf500cc260 0x7fcf500ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:45.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf47e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf500cc260 0x7fcf500ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41702/0 (socket says 172.21.15.173:41702) 2024-04-25T09:05:45.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf47e00640 1 -- 172.21.15.173:0/2355665898 learned_addr learned my addr 172.21.15.173:0/2355665898 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:45.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf4f400640 1 --2- 172.21.15.173:0/2355665898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf500b3fe0 0x7fcf5015c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:45.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf47e00640 1 -- 172.21.15.173:0/2355665898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf50145290 msgr2=0x7fcf500adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:45.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf47e00640 1 --2- 172.21.15.173:0/2355665898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf50145290 0x7fcf500adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf47e00640 1 -- 172.21.15.173:0/2355665898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf500b3fe0 msgr2=0x7fcf5015c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:45.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf47e00640 1 --2- 172.21.15.173:0/2355665898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf500b3fe0 0x7fcf5015c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf47e00640 1 -- 172.21.15.173:0/2355665898 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf500ace10 con 0x7fcf500cc260 2024-04-25T09:05:45.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf47e00640 1 --2- 172.21.15.173:0/2355665898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf500cc260 0x7fcf500ceb60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800d800 tx=0x7fcf3800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:45.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf47400640 1 -- 172.21.15.173:0/2355665898 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38018020 con 0x7fcf500cc260 2024-04-25T09:05:45.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf47400640 1 -- 172.21.15.173:0/2355665898 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf380096c0 con 0x7fcf500cc260 2024-04-25T09:05:45.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf56000640 1 -- 172.21.15.173:0/2355665898 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf500ad0f0 con 0x7fcf500cc260 2024-04-25T09:05:45.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf47400640 1 -- 172.21.15.173:0/2355665898 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38009ab0 con 0x7fcf500cc260 2024-04-25T09:05:45.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.327+0000 7fcf56000640 1 -- 172.21.15.173:0/2355665898 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf500ad6b0 con 0x7fcf500cc260 2024-04-25T09:05:45.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.331+0000 7fcf56000640 1 -- 172.21.15.173:0/2355665898 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf50073ab0 con 0x7fcf500cc260 2024-04-25T09:05:45.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.331+0000 7fcf47400640 1 -- 172.21.15.173:0/2355665898 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcf3801b020 con 0x7fcf500cc260 2024-04-25T09:05:45.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.331+0000 7fcf47400640 1 --2- 172.21.15.173:0/2355665898 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcf2c066f60 0x7fcf2c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:45.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.331+0000 7fcf47400640 1 -- 172.21.15.173:0/2355665898 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fcf380854c0 con 0x7fcf500cc260 2024-04-25T09:05:45.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.331+0000 7fcf4f400640 1 --2- 172.21.15.173:0/2355665898 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcf2c066f60 0x7fcf2c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:45.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.331+0000 7fcf4f400640 1 --2- 172.21.15.173:0/2355665898 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcf2c066f60 0x7fcf2c069420 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcf40007fd0 tx=0x7fcf40009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:45.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.335+0000 7fcf47400640 1 -- 172.21.15.173:0/2355665898 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcf38022020 con 0x7fcf500cc260 2024-04-25T09:05:45.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.491+0000 7fcf56000640 1 -- 172.21.15.173:0/2355665898 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcf5006c300 con 0x7fcf500cc260 2024-04-25T09:05:45.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.495+0000 7fcf47400640 1 -- 172.21.15.173:0/2355665898 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcf380565a0 con 0x7fcf500cc260 2024-04-25T09:05:45.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.495+0000 7fcf56000640 1 -- 172.21.15.173:0/2355665898 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcf2c066f60 msgr2=0x7fcf2c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:45.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.495+0000 7fcf56000640 1 --2- 172.21.15.173:0/2355665898 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcf2c066f60 0x7fcf2c069420 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcf40007fd0 tx=0x7fcf40009040 comp rx=0 tx=0).stop 2024-04-25T09:05:45.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.495+0000 7fcf56000640 1 -- 172.21.15.173:0/2355665898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf500cc260 msgr2=0x7fcf500ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:45.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.495+0000 7fcf56000640 1 --2- 172.21.15.173:0/2355665898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf500cc260 0x7fcf500ceb60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800d800 tx=0x7fcf3800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.495+0000 7fcf56000640 1 -- 172.21.15.173:0/2355665898 shutdown_connections 2024-04-25T09:05:45.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.495+0000 7fcf56000640 1 --2- 172.21.15.173:0/2355665898 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcf2c066f60 0x7fcf2c069420 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.495+0000 7fcf56000640 1 --2- 172.21.15.173:0/2355665898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf50145290 0x7fcf500adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.495+0000 7fcf56000640 1 --2- 172.21.15.173:0/2355665898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf500cc260 0x7fcf500ceb60 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.495+0000 7fcf56000640 1 --2- 172.21.15.173:0/2355665898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf500b3fe0 0x7fcf5015c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.495+0000 7fcf56000640 1 -- 172.21.15.173:0/2355665898 >> 172.21.15.173:0/2355665898 conn(0x7fcf5006ac90 msgr2=0x7fcf500b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.495+0000 7fcf56000640 1 -- 172.21.15.173:0/2355665898 shutdown_connections 2024-04-25T09:05:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.495+0000 7fcf56000640 1 -- 172.21.15.173:0/2355665898 wait complete. 2024-04-25T09:05:45.508 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-04-25T09:05:45.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.651+0000 7fde5d000640 1 Processor -- start 2024-04-25T09:05:45.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.651+0000 7fde5d000640 1 -- start start 2024-04-25T09:05:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.651+0000 7fde5d000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fde5815edd0 0x7fde580cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.651+0000 7fde5d000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5815f320 con 0x7fde580aefa0 2024-04-25T09:05:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.651+0000 7fde5d000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5806d420 con 0x7fde580b3e70 2024-04-25T09:05:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.651+0000 7fde5d000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5806dd50 con 0x7fde5815edd0 2024-04-25T09:05:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.651+0000 7fde4d400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fde580aefa0 0x7fde580cd7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:56280/0 (socket says 172.21.15.173:56280) 2024-04-25T09:05:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.651+0000 7fde4d400640 1 -- 172.21.15.173:0/1737598744 learned_addr learned my addr 172.21.15.173:0/1737598744 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.651+0000 7fde56800640 1 --2- 172.21.15.173:0/1737598744 >> v2:172.21.15.194:3300/0 conn(0x7fde5815edd0 0x7fde580cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.651+0000 7fde55400640 1 -- 172.21.15.173:0/1737598744 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652474900 0 0) 0x7fde5815f320 con 0x7fde580aefa0 2024-04-25T09:05:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.651+0000 7fde55400640 1 -- 172.21.15.173:0/1737598744 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde3c003530 con 0x7fde580aefa0 2024-04-25T09:05:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.651+0000 7fde56800640 1 -- 172.21.15.173:0/1737598744 >> v1:172.21.15.194:6789/0 conn(0x7fde580b3e70 legacy=0x7fde580b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.651+0000 7fde56800640 1 -- 172.21.15.173:0/1737598744 >> v1:172.21.15.173:6789/0 conn(0x7fde580aefa0 legacy=0x7fde580cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.651+0000 7fde56800640 1 -- 172.21.15.173:0/1737598744 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5806d700 con 0x7fde5815edd0 2024-04-25T09:05:45.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.655+0000 7fde56800640 1 --2- 172.21.15.173:0/1737598744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde5815edd0 0x7fde580cdeb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fde50009d90 tx=0x7fde5001c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0ef8be1d9d62a13 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:45.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.655+0000 7fde55400640 1 -- 172.21.15.173:0/1737598744 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500b2070 con 0x7fde5815edd0 2024-04-25T09:05:45.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.655+0000 7fde55400640 1 -- 172.21.15.173:0/1737598744 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde500a5a20 con 0x7fde5815edd0 2024-04-25T09:05:45.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.655+0000 7fde55400640 1 -- 172.21.15.173:0/1737598744 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500a5df0 con 0x7fde5815edd0 2024-04-25T09:05:45.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.655+0000 7fde5d000640 1 -- 172.21.15.173:0/1737598744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde5815edd0 msgr2=0x7fde580cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:45.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.655+0000 7fde5d000640 1 --2- 172.21.15.173:0/1737598744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde5815edd0 0x7fde580cdeb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fde50009d90 tx=0x7fde5001c940 comp rx=0 tx=0).stop 2024-04-25T09:05:45.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.655+0000 7fde5d000640 1 -- 172.21.15.173:0/1737598744 shutdown_connections 2024-04-25T09:05:45.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.655+0000 7fde5d000640 1 --2- 172.21.15.173:0/1737598744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde5815edd0 0x7fde580cdeb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.655+0000 7fde5d000640 1 -- 172.21.15.173:0/1737598744 >> 172.21.15.173:0/1737598744 conn(0x7fde5806ac90 msgr2=0x7fde5806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:45.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.655+0000 7fde5d000640 1 -- 172.21.15.173:0/1737598744 shutdown_connections 2024-04-25T09:05:45.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.655+0000 7fde5d000640 1 -- 172.21.15.173:0/1737598744 wait complete. 2024-04-25T09:05:45.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde5d000640 1 Processor -- start 2024-04-25T09:05:45.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde5d000640 1 -- start start 2024-04-25T09:05:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde5d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde580aefa0 0x7fde580b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde5d000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde580b3e70 0x7fde581f73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde5d000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde5815edd0 0x7fde5813ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde5d000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5806e340 con 0x7fde5815edd0 2024-04-25T09:05:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde5d000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5806e1c0 con 0x7fde580b3e70 2024-04-25T09:05:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde5d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde58168fd0 con 0x7fde580aefa0 2024-04-25T09:05:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde56800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde5815edd0 0x7fde5813ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde56800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde5815edd0 0x7fde5813ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41712/0 (socket says 172.21.15.173:41712) 2024-04-25T09:05:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde56800640 1 -- 172.21.15.173:0/536337991 learned_addr learned my addr 172.21.15.173:0/536337991 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde4d400640 1 --2- 172.21.15.173:0/536337991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde580b3e70 0x7fde581f73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde55e00640 1 --2- 172.21.15.173:0/536337991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde580aefa0 0x7fde580b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde56800640 1 -- 172.21.15.173:0/536337991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde580aefa0 msgr2=0x7fde580b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde56800640 1 --2- 172.21.15.173:0/536337991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde580aefa0 0x7fde580b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde56800640 1 -- 172.21.15.173:0/536337991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde580b3e70 msgr2=0x7fde581f73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde56800640 1 --2- 172.21.15.173:0/536337991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde580b3e70 0x7fde581f73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde56800640 1 -- 172.21.15.173:0/536337991 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde58151680 con 0x7fde5815edd0 2024-04-25T09:05:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde55e00640 1 --2- 172.21.15.173:0/536337991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde580aefa0 0x7fde580b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde56800640 1 --2- 172.21.15.173:0/536337991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde5815edd0 0x7fde5813ffd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fde500b0040 tx=0x7fde500196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde4ea00640 1 -- 172.21.15.173:0/536337991 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500b2050 con 0x7fde5815edd0 2024-04-25T09:05:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde4ea00640 1 -- 172.21.15.173:0/536337991 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde500be070 con 0x7fde5815edd0 2024-04-25T09:05:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde4ea00640 1 -- 172.21.15.173:0/536337991 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500adb10 con 0x7fde5815edd0 2024-04-25T09:05:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.659+0000 7fde5d000640 1 -- 172.21.15.173:0/536337991 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde58151960 con 0x7fde5815edd0 2024-04-25T09:05:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.663+0000 7fde5d000640 1 -- 172.21.15.173:0/536337991 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde58152200 con 0x7fde5815edd0 2024-04-25T09:05:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.663+0000 7fde5d000640 1 -- 172.21.15.173:0/536337991 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde58151d50 con 0x7fde5815edd0 2024-04-25T09:05:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.663+0000 7fde4ea00640 1 -- 172.21.15.173:0/536337991 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fde500adcb0 con 0x7fde5815edd0 2024-04-25T09:05:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.663+0000 7fde4ea00640 1 --2- 172.21.15.173:0/536337991 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde34066f60 0x7fde34069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.663+0000 7fde4ea00640 1 -- 172.21.15.173:0/536337991 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fde501200a0 con 0x7fde5815edd0 2024-04-25T09:05:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.663+0000 7fde55e00640 1 --2- 172.21.15.173:0/536337991 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde34066f60 0x7fde34069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.663+0000 7fde55e00640 1 --2- 172.21.15.173:0/536337991 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde34066f60 0x7fde34069420 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fde48001670 tx=0x7fde48009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:45.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.667+0000 7fde4ea00640 1 -- 172.21.15.173:0/536337991 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fde50016560 con 0x7fde5815edd0 2024-04-25T09:05:45.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:45.879+0000 7fde5d000640 1 -- 172.21.15.173:0/536337991 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) v1 -- 0x7fde58073a40 con 0x7fde5815edd0 2024-04-25T09:05:46.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.151+0000 7fde4ea00640 1 -- 172.21.15.173:0/536337991 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v154) v1 ==== 148+0+0 (secure 0 0 0) 0x7fde500f1210 con 0x7fde5815edd0 2024-04-25T09:05:46.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.155+0000 7fde5d000640 1 -- 172.21.15.173:0/536337991 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde34066f60 msgr2=0x7fde34069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.155+0000 7fde5d000640 1 --2- 172.21.15.173:0/536337991 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde34066f60 0x7fde34069420 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fde48001670 tx=0x7fde48009040 comp rx=0 tx=0).stop 2024-04-25T09:05:46.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.155+0000 7fde5d000640 1 -- 172.21.15.173:0/536337991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde5815edd0 msgr2=0x7fde5813ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.155+0000 7fde5d000640 1 --2- 172.21.15.173:0/536337991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde5815edd0 0x7fde5813ffd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fde500b0040 tx=0x7fde500196e0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.155+0000 7fde5d000640 1 -- 172.21.15.173:0/536337991 shutdown_connections 2024-04-25T09:05:46.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.155+0000 7fde5d000640 1 --2- 172.21.15.173:0/536337991 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fde34066f60 0x7fde34069420 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.155+0000 7fde5d000640 1 --2- 172.21.15.173:0/536337991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde5815edd0 0x7fde5813ffd0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.155+0000 7fde5d000640 1 --2- 172.21.15.173:0/536337991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde580b3e70 0x7fde581f73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.155+0000 7fde5d000640 1 --2- 172.21.15.173:0/536337991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde580aefa0 0x7fde580b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.155+0000 7fde5d000640 1 -- 172.21.15.173:0/536337991 >> 172.21.15.173:0/536337991 conn(0x7fde5806ac90 msgr2=0x7fde5814ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:46.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.155+0000 7fde5d000640 1 -- 172.21.15.173:0/536337991 shutdown_connections 2024-04-25T09:05:46.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.155+0000 7fde5d000640 1 -- 172.21.15.173:0/536337991 wait complete. 2024-04-25T09:05:46.167 INFO:tasks.cephfs_test_runner:test flag scrub_mdsdir ... ok 2024-04-25T09:05:46.169 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-04-25T09:05:46.170 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:46.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.315+0000 7f886ec00640 1 Processor -- start 2024-04-25T09:05:46.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.315+0000 7f886ec00640 1 -- start start 2024-04-25T09:05:46.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.315+0000 7f886ec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f886815da60 0x7f886809a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.315+0000 7f886ec00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f886806c270 0x7f886806c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.315+0000 7f886ec00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886809ad60 con 0x7f886806ccf0 2024-04-25T09:05:46.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.315+0000 7f886ec00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88680cc660 con 0x7f886806c270 2024-04-25T09:05:46.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.315+0000 7f886ec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88680cdb00 con 0x7f886815da60 2024-04-25T09:05:46.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.315+0000 7f886ce00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f886806c270 0x7f886806c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.315+0000 7f886e200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f886806ccf0 0x7f88680b22c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:56296/0 (socket says 172.21.15.173:56296) 2024-04-25T09:05:46.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.315+0000 7f886e200640 1 -- 172.21.15.173:0/114493287 learned_addr learned my addr 172.21.15.173:0/114493287 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:46.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.315+0000 7f886d800640 1 --2- 172.21.15.173:0/114493287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f886815da60 0x7f886809a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.315+0000 7f886ce00640 1 -- 172.21.15.173:0/114493287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f886815da60 msgr2=0x7f886809a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:46.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.315+0000 7f886ce00640 1 --2- 172.21.15.173:0/114493287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f886815da60 0x7f886809a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.315+0000 7f886ce00640 1 -- 172.21.15.173:0/114493287 >> v1:172.21.15.173:6789/0 conn(0x7f886806ccf0 legacy=0x7f88680b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.315+0000 7f886ce00640 1 -- 172.21.15.173:0/114493287 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88680cbd30 con 0x7f886806c270 2024-04-25T09:05:46.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.315+0000 7f8867e00640 1 -- 172.21.15.173:0/114493287 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861798400 0 0) 0x7f886809ad60 con 0x7f886806ccf0 2024-04-25T09:05:46.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.315+0000 7f886d800640 1 --2- 172.21.15.173:0/114493287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f886815da60 0x7f886809a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:46.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.319+0000 7f886ce00640 1 --2- 172.21.15.173:0/114493287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f886806c270 0x7f886806c7b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f88540097c0 tx=0x7f885401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4247570e2a2c9ea1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:46.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.319+0000 7f8867e00640 1 -- 172.21.15.173:0/114493287 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88540b0070 con 0x7f886806c270 2024-04-25T09:05:46.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.319+0000 7f8867e00640 1 -- 172.21.15.173:0/114493287 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88540ab600 con 0x7f886806c270 2024-04-25T09:05:46.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.319+0000 7f8867e00640 1 -- 172.21.15.173:0/114493287 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88540ab9d0 con 0x7f886806c270 2024-04-25T09:05:46.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.319+0000 7f886ec00640 1 -- 172.21.15.173:0/114493287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f886806c270 msgr2=0x7f886806c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.319+0000 7f886ec00640 1 --2- 172.21.15.173:0/114493287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f886806c270 0x7f886806c7b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f88540097c0 tx=0x7f885401c480 comp rx=0 tx=0).stop 2024-04-25T09:05:46.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.319+0000 7f886ec00640 1 -- 172.21.15.173:0/114493287 shutdown_connections 2024-04-25T09:05:46.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.319+0000 7f886ec00640 1 --2- 172.21.15.173:0/114493287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f886806c270 0x7f886806c7b0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.319+0000 7f886ec00640 1 --2- 172.21.15.173:0/114493287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f886815da60 0x7f886809a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.319+0000 7f886ec00640 1 -- 172.21.15.173:0/114493287 >> 172.21.15.173:0/114493287 conn(0x7f88680b3130 msgr2=0x7f88680b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:46.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.319+0000 7f886ec00640 1 -- 172.21.15.173:0/114493287 shutdown_connections 2024-04-25T09:05:46.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.319+0000 7f886ec00640 1 -- 172.21.15.173:0/114493287 wait complete. 2024-04-25T09:05:46.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886ec00640 1 Processor -- start 2024-04-25T09:05:46.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886ec00640 1 -- start start 2024-04-25T09:05:46.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886ec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f886806c270 0x7f886814de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886ec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f886806ccf0 0x7f886814f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886ec00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f886815da60 0x7f886814fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886ec00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886815dfc0 con 0x7f886815da60 2024-04-25T09:05:46.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886ec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886815de40 con 0x7f886806c270 2024-04-25T09:05:46.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886ec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886809a970 con 0x7f886806ccf0 2024-04-25T09:05:46.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886e200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f886815da60 0x7f886814fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886e200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f886815da60 0x7f886814fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41728/0 (socket says 172.21.15.173:41728) 2024-04-25T09:05:46.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886e200640 1 -- 172.21.15.173:0/2603513642 learned_addr learned my addr 172.21.15.173:0/2603513642 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:46.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886ce00640 1 --2- 172.21.15.173:0/2603513642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f886806ccf0 0x7f886814f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886d800640 1 --2- 172.21.15.173:0/2603513642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f886806c270 0x7f886814de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886e200640 1 -- 172.21.15.173:0/2603513642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f886806ccf0 msgr2=0x7f886814f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886e200640 1 --2- 172.21.15.173:0/2603513642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f886806ccf0 0x7f886814f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886e200640 1 -- 172.21.15.173:0/2603513642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f886806c270 msgr2=0x7f886814de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886e200640 1 --2- 172.21.15.173:0/2603513642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f886806c270 0x7f886814de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886e200640 1 -- 172.21.15.173:0/2603513642 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88680af380 con 0x7f886815da60 2024-04-25T09:05:46.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886d800640 1 --2- 172.21.15.173:0/2603513642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f886806c270 0x7f886814de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:46.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886e200640 1 --2- 172.21.15.173:0/2603513642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f886815da60 0x7f886814fcc0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f886000c730 tx=0x7f886000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:46.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f8865600640 1 -- 172.21.15.173:0/2603513642 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860018070 con 0x7f886815da60 2024-04-25T09:05:46.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f8865600640 1 -- 172.21.15.173:0/2603513642 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886000ce40 con 0x7f886815da60 2024-04-25T09:05:46.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f8865600640 1 -- 172.21.15.173:0/2603513642 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886000a800 con 0x7f886815da60 2024-04-25T09:05:46.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886ec00640 1 -- 172.21.15.173:0/2603513642 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8868150570 con 0x7f886815da60 2024-04-25T09:05:46.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.323+0000 7f886ec00640 1 -- 172.21.15.173:0/2603513642 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8868150b30 con 0x7f886815da60 2024-04-25T09:05:46.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.327+0000 7f886ec00640 1 -- 172.21.15.173:0/2603513642 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8868073a40 con 0x7f886815da60 2024-04-25T09:05:46.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.327+0000 7f8865600640 1 -- 172.21.15.173:0/2603513642 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f886001b070 con 0x7f886815da60 2024-04-25T09:05:46.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.327+0000 7f8865600640 1 --2- 172.21.15.173:0/2603513642 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8848066f60 0x7f8848069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.327+0000 7f8865600640 1 -- 172.21.15.173:0/2603513642 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f88600843d0 con 0x7f886815da60 2024-04-25T09:05:46.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.327+0000 7f886d800640 1 --2- 172.21.15.173:0/2603513642 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8848066f60 0x7f8848069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.327+0000 7f886d800640 1 --2- 172.21.15.173:0/2603513642 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8848066f60 0x7f8848069420 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f885c009970 tx=0x7f885c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:46.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.331+0000 7f8865600640 1 -- 172.21.15.173:0/2603513642 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8860054e60 con 0x7f886815da60 2024-04-25T09:05:46.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.487+0000 7f886ec00640 1 -- 172.21.15.173:0/2603513642 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f886815d290 con 0x7f886815da60 2024-04-25T09:05:46.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.487+0000 7f8865600640 1 -- 172.21.15.173:0/2603513642 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+13353 (secure 0 0 0) 0x7f8860059e20 con 0x7f886815da60 2024-04-25T09:05:46.479 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:46.480 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":47,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:05:45.154349+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:6837/960880761":"2024-04-26T09:05:42.147530+0000","172.21.15.173:6834/960880761":"2024-04-26T09:05:42.147530+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:46.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.491+0000 7f886ec00640 1 -- 172.21.15.173:0/2603513642 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8848066f60 msgr2=0x7f8848069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.491+0000 7f886ec00640 1 --2- 172.21.15.173:0/2603513642 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8848066f60 0x7f8848069420 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f885c009970 tx=0x7f885c008040 comp rx=0 tx=0).stop 2024-04-25T09:05:46.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.491+0000 7f886ec00640 1 -- 172.21.15.173:0/2603513642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f886815da60 msgr2=0x7f886814fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.491+0000 7f886ec00640 1 --2- 172.21.15.173:0/2603513642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f886815da60 0x7f886814fcc0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f886000c730 tx=0x7f886000cbf0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.491+0000 7f886ec00640 1 -- 172.21.15.173:0/2603513642 shutdown_connections 2024-04-25T09:05:46.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.491+0000 7f886ec00640 1 --2- 172.21.15.173:0/2603513642 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8848066f60 0x7f8848069420 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.491+0000 7f886ec00640 1 --2- 172.21.15.173:0/2603513642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f886815da60 0x7f886814fcc0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.491+0000 7f886ec00640 1 --2- 172.21.15.173:0/2603513642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f886806ccf0 0x7f886814f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.491+0000 7f886ec00640 1 --2- 172.21.15.173:0/2603513642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f886806c270 0x7f886814de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.491+0000 7f886ec00640 1 -- 172.21.15.173:0/2603513642 >> 172.21.15.173:0/2603513642 conn(0x7f88680b3130 msgr2=0x7f886806f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:46.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.491+0000 7f886ec00640 1 -- 172.21.15.173:0/2603513642 shutdown_connections 2024-04-25T09:05:46.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.491+0000 7f886ec00640 1 -- 172.21.15.173:0/2603513642 wait complete. 2024-04-25T09:05:46.501 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:05:46.501 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:05:46.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.655+0000 7f19d9a00640 1 Processor -- start 2024-04-25T09:05:46.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.655+0000 7f19d9a00640 1 -- start start 2024-04-25T09:05:46.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.655+0000 7f19d9a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f19d40cd3d0 0x7f19d40cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.655+0000 7f19d9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19d40cc670 0x7f19d40ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.655+0000 7f19d9a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d4072590 con 0x7f19d415b710 2024-04-25T09:05:46.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.655+0000 7f19d9a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d40ccae0 con 0x7f19d40cd3d0 2024-04-25T09:05:46.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.655+0000 7f19d9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d415eea0 con 0x7f19d40cc670 2024-04-25T09:05:46.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.655+0000 7f19d2000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f19d40cd3d0 0x7f19d40cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.655+0000 7f19d2a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f19d415b710 0x7f19d4071e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:56306/0 (socket says 172.21.15.173:56306) 2024-04-25T09:05:46.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.655+0000 7f19d2a00640 1 -- 172.21.15.173:0/3038940141 learned_addr learned my addr 172.21.15.173:0/3038940141 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:46.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.655+0000 7f19d3400640 1 --2- 172.21.15.173:0/3038940141 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19d40cc670 0x7f19d40ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.655+0000 7f19d2000640 1 -- 172.21.15.173:0/3038940141 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19d40cc670 msgr2=0x7f19d40ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:46.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.655+0000 7f19d2000640 1 --2- 172.21.15.173:0/3038940141 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19d40cc670 0x7f19d40ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.655+0000 7f19d2000640 1 -- 172.21.15.173:0/3038940141 >> v1:172.21.15.173:6789/0 conn(0x7f19d415b710 legacy=0x7f19d4071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.655+0000 7f19d2000640 1 -- 172.21.15.173:0/3038940141 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d415e2d0 con 0x7f19d40cd3d0 2024-04-25T09:05:46.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.659+0000 7f19d2000640 1 --2- 172.21.15.173:0/3038940141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19d40cd3d0 0x7f19d40cc130 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f19c00097c0 tx=0x7f19c001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1a346d5e67dfaa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:46.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.659+0000 7f19d1600640 1 -- 172.21.15.173:0/3038940141 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c00a7070 con 0x7f19d40cd3d0 2024-04-25T09:05:46.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.659+0000 7f19d1600640 1 -- 172.21.15.173:0/3038940141 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c00b0070 con 0x7f19d40cd3d0 2024-04-25T09:05:46.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.659+0000 7f19d1600640 1 -- 172.21.15.173:0/3038940141 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c00ab890 con 0x7f19d40cd3d0 2024-04-25T09:05:46.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.659+0000 7f19d9a00640 1 -- 172.21.15.173:0/3038940141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19d40cd3d0 msgr2=0x7f19d40cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.659+0000 7f19d9a00640 1 --2- 172.21.15.173:0/3038940141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19d40cd3d0 0x7f19d40cc130 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f19c00097c0 tx=0x7f19c001c470 comp rx=0 tx=0).stop 2024-04-25T09:05:46.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.659+0000 7f19d9a00640 1 -- 172.21.15.173:0/3038940141 shutdown_connections 2024-04-25T09:05:46.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.659+0000 7f19d9a00640 1 --2- 172.21.15.173:0/3038940141 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19d40cc670 0x7f19d40ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.659+0000 7f19d9a00640 1 --2- 172.21.15.173:0/3038940141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19d40cd3d0 0x7f19d40cc130 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.659+0000 7f19d9a00640 1 -- 172.21.15.173:0/3038940141 >> 172.21.15.173:0/3038940141 conn(0x7f19d406ac90 msgr2=0x7f19d406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:46.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.659+0000 7f19d9a00640 1 -- 172.21.15.173:0/3038940141 shutdown_connections 2024-04-25T09:05:46.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.659+0000 7f19d9a00640 1 -- 172.21.15.173:0/3038940141 wait complete. 2024-04-25T09:05:46.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d9a00640 1 Processor -- start 2024-04-25T09:05:46.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d9a00640 1 -- start start 2024-04-25T09:05:46.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19d40cc670 0x7f19d41544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d9a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19d40cd3d0 0x7f19d41535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d9a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19d415b710 0x7f19d41478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d9a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d40cf890 con 0x7f19d415b710 2024-04-25T09:05:46.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d9a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d415baf0 con 0x7f19d40cd3d0 2024-04-25T09:05:46.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d40cfa10 con 0x7f19d40cc670 2024-04-25T09:05:46.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19d415b710 0x7f19d41478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19d415b710 0x7f19d41478e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41750/0 (socket says 172.21.15.173:41750) 2024-04-25T09:05:46.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d3400640 1 -- 172.21.15.173:0/2276474755 learned_addr learned my addr 172.21.15.173:0/2276474755 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:46.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d3400640 1 -- 172.21.15.173:0/2276474755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19d40cc670 msgr2=0x7f19d41544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d3400640 1 --2- 172.21.15.173:0/2276474755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19d40cc670 0x7f19d41544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d3400640 1 -- 172.21.15.173:0/2276474755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19d40cd3d0 msgr2=0x7f19d41535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d3400640 1 --2- 172.21.15.173:0/2276474755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19d40cd3d0 0x7f19d41535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d3400640 1 -- 172.21.15.173:0/2276474755 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d414a640 con 0x7f19d415b710 2024-04-25T09:05:46.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d3400640 1 --2- 172.21.15.173:0/2276474755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19d415b710 0x7f19d41478e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00d800 tx=0x7f19cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:46.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19caa00640 1 -- 172.21.15.173:0/2276474755 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc00b6c0 con 0x7f19d415b710 2024-04-25T09:05:46.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19caa00640 1 -- 172.21.15.173:0/2276474755 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc019070 con 0x7f19d415b710 2024-04-25T09:05:46.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19caa00640 1 -- 172.21.15.173:0/2276474755 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc00baa0 con 0x7f19d415b710 2024-04-25T09:05:46.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d9a00640 1 -- 172.21.15.173:0/2276474755 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d414a920 con 0x7f19d415b710 2024-04-25T09:05:46.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.663+0000 7f19d9a00640 1 -- 172.21.15.173:0/2276474755 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d414aee0 con 0x7f19d415b710 2024-04-25T09:05:46.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.667+0000 7f19d9a00640 1 -- 172.21.15.173:0/2276474755 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d4073ab0 con 0x7f19d415b710 2024-04-25T09:05:46.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.667+0000 7f19caa00640 1 -- 172.21.15.173:0/2276474755 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f19cc00bc40 con 0x7f19d415b710 2024-04-25T09:05:46.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.667+0000 7f19caa00640 1 --2- 172.21.15.173:0/2276474755 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f19b4066f90 0x7f19b4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.667+0000 7f19caa00640 1 -- 172.21.15.173:0/2276474755 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f19cc0853a0 con 0x7f19d415b710 2024-04-25T09:05:46.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.667+0000 7f19d2a00640 1 --2- 172.21.15.173:0/2276474755 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f19b4066f90 0x7f19b4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.667+0000 7f19d2a00640 1 --2- 172.21.15.173:0/2276474755 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f19b4066f90 0x7f19b4069450 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f19c40012f0 tx=0x7f19c40015a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:46.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.671+0000 7f19caa00640 1 -- 172.21.15.173:0/2276474755 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f19cc056480 con 0x7f19d415b710 2024-04-25T09:05:46.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.827+0000 7f19d9a00640 1 -- 172.21.15.173:0/2276474755 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19d415cce0 con 0x7f19d415b710 2024-04-25T09:05:46.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.827+0000 7f19caa00640 1 -- 172.21.15.173:0/2276474755 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19cc055d80 con 0x7f19d415b710 2024-04-25T09:05:46.821 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:05:46.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.831+0000 7f19d9a00640 1 -- 172.21.15.173:0/2276474755 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f19b4066f90 msgr2=0x7f19b4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.831+0000 7f19d9a00640 1 --2- 172.21.15.173:0/2276474755 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f19b4066f90 0x7f19b4069450 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f19c40012f0 tx=0x7f19c40015a0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.831+0000 7f19d9a00640 1 -- 172.21.15.173:0/2276474755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19d415b710 msgr2=0x7f19d41478e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.831+0000 7f19d9a00640 1 --2- 172.21.15.173:0/2276474755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19d415b710 0x7f19d41478e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00d800 tx=0x7f19cc00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.831+0000 7f19d9a00640 1 -- 172.21.15.173:0/2276474755 shutdown_connections 2024-04-25T09:05:46.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.831+0000 7f19d9a00640 1 --2- 172.21.15.173:0/2276474755 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f19b4066f90 0x7f19b4069450 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.831+0000 7f19d9a00640 1 --2- 172.21.15.173:0/2276474755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19d415b710 0x7f19d41478e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.831+0000 7f19d9a00640 1 --2- 172.21.15.173:0/2276474755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19d40cd3d0 0x7f19d41535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.831+0000 7f19d9a00640 1 --2- 172.21.15.173:0/2276474755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19d40cc670 0x7f19d41544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.831+0000 7f19d9a00640 1 -- 172.21.15.173:0/2276474755 >> 172.21.15.173:0/2276474755 conn(0x7f19d406ac90 msgr2=0x7f19d40cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:46.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.831+0000 7f19d9a00640 1 -- 172.21.15.173:0/2276474755 shutdown_connections 2024-04-25T09:05:46.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.831+0000 7f19d9a00640 1 -- 172.21.15.173:0/2276474755 wait complete. 2024-04-25T09:05:46.843 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-04-25T09:05:46.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.987+0000 7fdfb5a00640 1 Processor -- start 2024-04-25T09:05:46.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.987+0000 7fdfb5a00640 1 -- start start 2024-04-25T09:05:46.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.987+0000 7fdfb5a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdfb015ddf0 0x7fdfb00cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.987+0000 7fdfb5a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdfb00b2d50 0x7fdfb006ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.987+0000 7fdfb5a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb00d0420 con 0x7fdfb006b1d0 2024-04-25T09:05:46.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.987+0000 7fdfb5a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb006b640 con 0x7fdfb015ddf0 2024-04-25T09:05:46.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.987+0000 7fdfb5a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb00cde30 con 0x7fdfb00b2d50 2024-04-25T09:05:46.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.987+0000 7fdfaea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdfb015ddf0 0x7fdfb00cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.987+0000 7fdfaea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdfb015ddf0 0x7fdfb00cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41758/0 (socket says 172.21.15.173:41758) 2024-04-25T09:05:46.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.987+0000 7fdfaea00640 1 -- 172.21.15.173:0/1035417348 learned_addr learned my addr 172.21.15.173:0/1035417348 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:46.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.987+0000 7fdfaf400640 1 --1- 172.21.15.173:0/1035417348 >> v1:172.21.15.173:6789/0 conn(0x7fdfb006b1d0 0x7fdfb0161970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:56320/0 (socket says 172.21.15.173:56320) 2024-04-25T09:05:46.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.987+0000 7fdfae000640 1 --2- 172.21.15.173:0/1035417348 >> v2:172.21.15.194:3300/0 conn(0x7fdfb00b2d50 0x7fdfb006ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.987+0000 7fdfaea00640 1 -- 172.21.15.173:0/1035417348 >> v2:172.21.15.194:3300/0 conn(0x7fdfb00b2d50 msgr2=0x7fdfb006ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:46.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.987+0000 7fdfaea00640 1 --2- 172.21.15.173:0/1035417348 >> v2:172.21.15.194:3300/0 conn(0x7fdfb00b2d50 0x7fdfb006ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.987+0000 7fdfaea00640 1 -- 172.21.15.173:0/1035417348 >> v1:172.21.15.173:6789/0 conn(0x7fdfb006b1d0 legacy=0x7fdfb0161970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.987+0000 7fdfaea00640 1 -- 172.21.15.173:0/1035417348 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb00cd540 con 0x7fdfb015ddf0 2024-04-25T09:05:46.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.987+0000 7fdfad600640 1 -- 172.21.15.173:0/1035417348 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424895311 0 0) 0x7fdfb00d0420 con 0x7fdfb006b1d0 2024-04-25T09:05:46.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.991+0000 7fdfaea00640 1 --2- 172.21.15.173:0/1035417348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfb015ddf0 0x7fdfb00cfb40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00d17d0 tx=0x7fdfa001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326eac13b60c6f2a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:46.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.991+0000 7fdfad600640 1 -- 172.21.15.173:0/1035417348 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00ab600 con 0x7fdfb015ddf0 2024-04-25T09:05:46.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.991+0000 7fdfad600640 1 -- 172.21.15.173:0/1035417348 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa00b0070 con 0x7fdfb015ddf0 2024-04-25T09:05:46.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.991+0000 7fdfad600640 1 -- 172.21.15.173:0/1035417348 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00ab9c0 con 0x7fdfb015ddf0 2024-04-25T09:05:46.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.991+0000 7fdfb5a00640 1 -- 172.21.15.173:0/1035417348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfb015ddf0 msgr2=0x7fdfb00cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.991+0000 7fdfb5a00640 1 --2- 172.21.15.173:0/1035417348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfb015ddf0 0x7fdfb00cfb40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00d17d0 tx=0x7fdfa001c4f0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.991+0000 7fdfb5a00640 1 -- 172.21.15.173:0/1035417348 shutdown_connections 2024-04-25T09:05:46.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.991+0000 7fdfb5a00640 1 --2- 172.21.15.173:0/1035417348 >> v2:172.21.15.194:3300/0 conn(0x7fdfb00b2d50 0x7fdfb006ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.991+0000 7fdfb5a00640 1 --2- 172.21.15.173:0/1035417348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfb015ddf0 0x7fdfb00cfb40 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.991+0000 7fdfb5a00640 1 -- 172.21.15.173:0/1035417348 >> 172.21.15.173:0/1035417348 conn(0x7fdfb00b2230 msgr2=0x7fdfb00b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:46.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.991+0000 7fdfb5a00640 1 -- 172.21.15.173:0/1035417348 shutdown_connections 2024-04-25T09:05:46.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.991+0000 7fdfb5a00640 1 -- 172.21.15.173:0/1035417348 wait complete. 2024-04-25T09:05:46.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfb5a00640 1 Processor -- start 2024-04-25T09:05:46.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfb5a00640 1 -- start start 2024-04-25T09:05:46.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfb5a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfb006b1d0 0x7fdfb00b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfb5a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfb00b2d50 0x7fdfb00af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfb5a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfb015ddf0 0x7fdfb0155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfb5a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb00d0200 con 0x7fdfb006b1d0 2024-04-25T09:05:46.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfb5a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb00d0080 con 0x7fdfb015ddf0 2024-04-25T09:05:46.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfb5a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb016acb0 con 0x7fdfb00b2d50 2024-04-25T09:05:46.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfaea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfb006b1d0 0x7fdfb00b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfaea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfb006b1d0 0x7fdfb00b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41766/0 (socket says 172.21.15.173:41766) 2024-04-25T09:05:46.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfaea00640 1 -- 172.21.15.173:0/3725717193 learned_addr learned my addr 172.21.15.173:0/3725717193 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:46.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfaf400640 1 --2- 172.21.15.173:0/3725717193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfb015ddf0 0x7fdfb0155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfae000640 1 --2- 172.21.15.173:0/3725717193 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfb00b2d50 0x7fdfb00af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfaea00640 1 -- 172.21.15.173:0/3725717193 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfb00b2d50 msgr2=0x7fdfb00af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfaea00640 1 --2- 172.21.15.173:0/3725717193 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfb00b2d50 0x7fdfb00af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfaea00640 1 -- 172.21.15.173:0/3725717193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfb015ddf0 msgr2=0x7fdfb0155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfaea00640 1 --2- 172.21.15.173:0/3725717193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfb015ddf0 0x7fdfb0155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfaea00640 1 -- 172.21.15.173:0/3725717193 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb00aeb00 con 0x7fdfb006b1d0 2024-04-25T09:05:46.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfaea00640 1 --2- 172.21.15.173:0/3725717193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfb006b1d0 0x7fdfb00b4950 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00ad040 tx=0x7fdfa001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:46.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfa6a00640 1 -- 172.21.15.173:0/3725717193 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00be5f0 con 0x7fdfb006b1d0 2024-04-25T09:05:46.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfa6a00640 1 -- 172.21.15.173:0/3725717193 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa00be7b0 con 0x7fdfb006b1d0 2024-04-25T09:05:46.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfa6a00640 1 -- 172.21.15.173:0/3725717193 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00beba0 con 0x7fdfb006b1d0 2024-04-25T09:05:46.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfb5a00640 1 -- 172.21.15.173:0/3725717193 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb00aede0 con 0x7fdfb006b1d0 2024-04-25T09:05:46.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.995+0000 7fdfb5a00640 1 -- 172.21.15.173:0/3725717193 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb00af3a0 con 0x7fdfb006b1d0 2024-04-25T09:05:46.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.999+0000 7fdfb5a00640 1 -- 172.21.15.173:0/3725717193 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb006cd30 con 0x7fdfb006b1d0 2024-04-25T09:05:46.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.999+0000 7fdfa6a00640 1 -- 172.21.15.173:0/3725717193 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdfa00aa070 con 0x7fdfb006b1d0 2024-04-25T09:05:46.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.999+0000 7fdfa6a00640 1 --2- 172.21.15.173:0/3725717193 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdf90066f60 0x7fdf90069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.999+0000 7fdfa6a00640 1 -- 172.21.15.173:0/3725717193 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fdfa011f660 con 0x7fdfb006b1d0 2024-04-25T09:05:46.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.999+0000 7fdfae000640 1 --2- 172.21.15.173:0/3725717193 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdf90066f60 0x7fdf90069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:46.999+0000 7fdfae000640 1 --2- 172.21.15.173:0/3725717193 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdf90066f60 0x7fdf90069420 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0159860 tx=0x7fdf9c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:46.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:47.003+0000 7fdfa6a00640 1 -- 172.21.15.173:0/3725717193 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdfa00c4060 con 0x7fdfb006b1d0 2024-04-25T09:05:47.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:47.215+0000 7fdfb5a00640 1 -- 172.21.15.173:0/3725717193 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) v1 -- 0x7fdfb0073a40 con 0x7fdfb006b1d0 2024-04-25T09:05:48.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.159+0000 7fdfa6a00640 1 -- 172.21.15.173:0/3725717193 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v156) v1 ==== 146+0+0 (secure 0 0 0) 0x7fdfa0016110 con 0x7fdfb006b1d0 2024-04-25T09:05:48.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.163+0000 7fdfb5a00640 1 -- 172.21.15.173:0/3725717193 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdf90066f60 msgr2=0x7fdf90069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.163+0000 7fdfb5a00640 1 --2- 172.21.15.173:0/3725717193 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdf90066f60 0x7fdf90069420 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0159860 tx=0x7fdf9c008040 comp rx=0 tx=0).stop 2024-04-25T09:05:48.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.163+0000 7fdfb5a00640 1 -- 172.21.15.173:0/3725717193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfb006b1d0 msgr2=0x7fdfb00b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.163+0000 7fdfb5a00640 1 --2- 172.21.15.173:0/3725717193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfb006b1d0 0x7fdfb00b4950 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00ad040 tx=0x7fdfa001ad30 comp rx=0 tx=0).stop 2024-04-25T09:05:48.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.163+0000 7fdfb5a00640 1 -- 172.21.15.173:0/3725717193 shutdown_connections 2024-04-25T09:05:48.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.163+0000 7fdfb5a00640 1 --2- 172.21.15.173:0/3725717193 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdf90066f60 0x7fdf90069420 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.163+0000 7fdfb5a00640 1 --2- 172.21.15.173:0/3725717193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfb015ddf0 0x7fdfb0155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.163+0000 7fdfb5a00640 1 --2- 172.21.15.173:0/3725717193 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfb00b2d50 0x7fdfb00af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.163+0000 7fdfb5a00640 1 --2- 172.21.15.173:0/3725717193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfb006b1d0 0x7fdfb00b4950 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.163+0000 7fdfb5a00640 1 -- 172.21.15.173:0/3725717193 >> 172.21.15.173:0/3725717193 conn(0x7fdfb00b2230 msgr2=0x7fdfb00cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:48.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.163+0000 7fdfb5a00640 1 -- 172.21.15.173:0/3725717193 shutdown_connections 2024-04-25T09:05:48.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.163+0000 7fdfb5a00640 1 -- 172.21.15.173:0/3725717193 wait complete. 2024-04-25T09:05:48.177 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:05:48.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.327+0000 7efe7a600640 1 Processor -- start 2024-04-25T09:05:48.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.327+0000 7efe7a600640 1 -- start start 2024-04-25T09:05:48.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.327+0000 7efe7a600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efe740aeb90 0x7efe740cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.327+0000 7efe7a600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efe740ce2b0 0x7efe740cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.327+0000 7efe7a600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe74071570 con 0x7efe740aef70 2024-04-25T09:05:48.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.327+0000 7efe7a600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe74071320 con 0x7efe740aeb90 2024-04-25T09:05:48.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.327+0000 7efe7a600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe74072330 con 0x7efe740ce2b0 2024-04-25T09:05:48.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.331+0000 7efe73400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efe740aeb90 0x7efe740cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.331+0000 7efe73400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efe740aeb90 0x7efe740cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41778/0 (socket says 172.21.15.173:41778) 2024-04-25T09:05:48.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.331+0000 7efe73400640 1 -- 172.21.15.173:0/1561012842 learned_addr learned my addr 172.21.15.173:0/1561012842 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:48.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.331+0000 7efe73e00640 1 --2- 172.21.15.173:0/1561012842 >> v2:172.21.15.194:3300/0 conn(0x7efe740ce2b0 0x7efe740cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.331+0000 7efe73400640 1 -- 172.21.15.173:0/1561012842 >> v2:172.21.15.194:3300/0 conn(0x7efe740ce2b0 msgr2=0x7efe740cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:48.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.331+0000 7efe73400640 1 --2- 172.21.15.173:0/1561012842 >> v2:172.21.15.194:3300/0 conn(0x7efe740ce2b0 0x7efe740cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.331+0000 7efe73400640 1 -- 172.21.15.173:0/1561012842 >> v1:172.21.15.194:6789/0 conn(0x7efe740aef70 legacy=0x7efe740cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:48.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.331+0000 7efe73400640 1 -- 172.21.15.173:0/1561012842 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe74071850 con 0x7efe740aeb90 2024-04-25T09:05:48.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.331+0000 7efe73e00640 1 --2- 172.21.15.173:0/1561012842 >> v2:172.21.15.194:3300/0 conn(0x7efe740ce2b0 0x7efe740cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:48.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.331+0000 7efe73400640 1 --2- 172.21.15.173:0/1561012842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe740aeb90 0x7efe740cc0d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7efe7415e4f0 tx=0x7efe6401eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d053982eff30510 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.331+0000 7efe72a00640 1 -- 172.21.15.173:0/1561012842 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe640b4070 con 0x7efe740aeb90 2024-04-25T09:05:48.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.331+0000 7efe72a00640 1 -- 172.21.15.173:0/1561012842 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe640a7ac0 con 0x7efe740aeb90 2024-04-25T09:05:48.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.331+0000 7efe72a00640 1 -- 172.21.15.173:0/1561012842 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe640af440 con 0x7efe740aeb90 2024-04-25T09:05:48.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe7a600640 1 -- 172.21.15.173:0/1561012842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe740aeb90 msgr2=0x7efe740cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe7a600640 1 --2- 172.21.15.173:0/1561012842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe740aeb90 0x7efe740cc0d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7efe7415e4f0 tx=0x7efe6401eaf0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe7a600640 1 -- 172.21.15.173:0/1561012842 shutdown_connections 2024-04-25T09:05:48.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe7a600640 1 --2- 172.21.15.173:0/1561012842 >> v2:172.21.15.194:3300/0 conn(0x7efe740ce2b0 0x7efe740cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe7a600640 1 --2- 172.21.15.173:0/1561012842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe740aeb90 0x7efe740cc0d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe7a600640 1 -- 172.21.15.173:0/1561012842 >> 172.21.15.173:0/1561012842 conn(0x7efe7406ac90 msgr2=0x7efe7406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:48.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe7a600640 1 -- 172.21.15.173:0/1561012842 shutdown_connections 2024-04-25T09:05:48.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe7a600640 1 -- 172.21.15.173:0/1561012842 wait complete. 2024-04-25T09:05:48.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe7a600640 1 Processor -- start 2024-04-25T09:05:48.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe7a600640 1 -- start start 2024-04-25T09:05:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe7a600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe740aeb90 0x7efe740af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe7a600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe740aef70 0x7efe7414e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe7a600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe740ce2b0 0x7efe74157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe7a600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7415bb30 con 0x7efe740ce2b0 2024-04-25T09:05:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe7a600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7415b9b0 con 0x7efe740aef70 2024-04-25T09:05:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe7a600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7415bcb0 con 0x7efe740aeb90 2024-04-25T09:05:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe73e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe740ce2b0 0x7efe74157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe73e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe740ce2b0 0x7efe74157b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41784/0 (socket says 172.21.15.173:41784) 2024-04-25T09:05:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe73e00640 1 -- 172.21.15.173:0/3976108898 learned_addr learned my addr 172.21.15.173:0/3976108898 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe6aa00640 1 --2- 172.21.15.173:0/3976108898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe740aef70 0x7efe7414e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe73400640 1 --2- 172.21.15.173:0/3976108898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe740aeb90 0x7efe740af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe73e00640 1 -- 172.21.15.173:0/3976108898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe740aeb90 msgr2=0x7efe740af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe73e00640 1 --2- 172.21.15.173:0/3976108898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe740aeb90 0x7efe740af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe73e00640 1 -- 172.21.15.173:0/3976108898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe740aef70 msgr2=0x7efe7414e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe73e00640 1 --2- 172.21.15.173:0/3976108898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe740aef70 0x7efe7414e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe73e00640 1 -- 172.21.15.173:0/3976108898 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7414ec40 con 0x7efe740ce2b0 2024-04-25T09:05:48.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.335+0000 7efe73e00640 1 --2- 172.21.15.173:0/3976108898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe740ce2b0 0x7efe74157b90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00cef0 tx=0x7efe6c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.339+0000 7efe6be00640 1 -- 172.21.15.173:0/3976108898 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c01a070 con 0x7efe740ce2b0 2024-04-25T09:05:48.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.339+0000 7efe6be00640 1 -- 172.21.15.173:0/3976108898 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c00d860 con 0x7efe740ce2b0 2024-04-25T09:05:48.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.339+0000 7efe7a600640 1 -- 172.21.15.173:0/3976108898 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7414ef20 con 0x7efe740ce2b0 2024-04-25T09:05:48.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.339+0000 7efe6be00640 1 -- 172.21.15.173:0/3976108898 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00dc50 con 0x7efe740ce2b0 2024-04-25T09:05:48.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.339+0000 7efe7a600640 1 -- 172.21.15.173:0/3976108898 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe741524c0 con 0x7efe740ce2b0 2024-04-25T09:05:48.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.339+0000 7efe7a600640 1 -- 172.21.15.173:0/3976108898 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe741526c0 con 0x7efe740ce2b0 2024-04-25T09:05:48.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.339+0000 7efe6be00640 1 -- 172.21.15.173:0/3976108898 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efe6c01d070 con 0x7efe740ce2b0 2024-04-25T09:05:48.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.339+0000 7efe6be00640 1 --2- 172.21.15.173:0/3976108898 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efe50066f60 0x7efe50069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.339+0000 7efe6be00640 1 -- 172.21.15.173:0/3976108898 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5335+0+0 (secure 0 0 0) 0x7efe6c0857b0 con 0x7efe740ce2b0 2024-04-25T09:05:48.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.339+0000 7efe73400640 1 --2- 172.21.15.173:0/3976108898 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efe50066f60 0x7efe50069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.339+0000 7efe73400640 1 --2- 172.21.15.173:0/3976108898 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efe50066f60 0x7efe50069420 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7efe640b1000 tx=0x7efe640a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.343+0000 7efe6be00640 1 -- 172.21.15.173:0/3976108898 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efe741526c0 con 0x7efe740ce2b0 2024-04-25T09:05:48.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.499+0000 7efe7a600640 1 -- 172.21.15.173:0/3976108898 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7efe74073ab0 con 0x7efe740ce2b0 2024-04-25T09:05:48.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.503+0000 7efe6be00640 1 -- 172.21.15.173:0/3976108898 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7efe6c056270 con 0x7efe740ce2b0 2024-04-25T09:05:48.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.503+0000 7efe7a600640 1 -- 172.21.15.173:0/3976108898 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efe50066f60 msgr2=0x7efe50069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.503+0000 7efe7a600640 1 --2- 172.21.15.173:0/3976108898 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efe50066f60 0x7efe50069420 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7efe640b1000 tx=0x7efe640a9070 comp rx=0 tx=0).stop 2024-04-25T09:05:48.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.503+0000 7efe7a600640 1 -- 172.21.15.173:0/3976108898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe740ce2b0 msgr2=0x7efe74157b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.503+0000 7efe7a600640 1 --2- 172.21.15.173:0/3976108898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe740ce2b0 0x7efe74157b90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00cef0 tx=0x7efe6c00a710 comp rx=0 tx=0).stop 2024-04-25T09:05:48.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.503+0000 7efe7a600640 1 -- 172.21.15.173:0/3976108898 shutdown_connections 2024-04-25T09:05:48.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.503+0000 7efe7a600640 1 --2- 172.21.15.173:0/3976108898 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efe50066f60 0x7efe50069420 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.503+0000 7efe7a600640 1 --2- 172.21.15.173:0/3976108898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe740ce2b0 0x7efe74157b90 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.503+0000 7efe7a600640 1 --2- 172.21.15.173:0/3976108898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe740aef70 0x7efe7414e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.503+0000 7efe7a600640 1 --2- 172.21.15.173:0/3976108898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe740aeb90 0x7efe740af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.503+0000 7efe7a600640 1 -- 172.21.15.173:0/3976108898 >> 172.21.15.173:0/3976108898 conn(0x7efe7406ac90 msgr2=0x7efe7414fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:48.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.503+0000 7efe7a600640 1 -- 172.21.15.173:0/3976108898 shutdown_connections 2024-04-25T09:05:48.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.503+0000 7efe7a600640 1 -- 172.21.15.173:0/3976108898 wait complete. 2024-04-25T09:05:48.515 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:05:48.516 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:05:48.611 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:05:48.705 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:05:48.705 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:05:48.705 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:48.713 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:05:48.714 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:05:48.714 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:48.723 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:05:48.723 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:05:48.723 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:48.765 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:05:48.765 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:05:48.765 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:48.774 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:05:48.774 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:05:48.775 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:48.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.951+0000 7ff0e5a00640 1 Processor -- start 2024-04-25T09:05:48.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.951+0000 7ff0e5a00640 1 -- start start 2024-04-25T09:05:48.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.951+0000 7ff0e5a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff0e015ba20 0x7ff0e015be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.951+0000 7ff0e5a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0e00b70f0 0x7ff0e006f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.951+0000 7ff0e5a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff0e00b7550 0x7ff0e006fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.951+0000 7ff0e5a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e015c460 con 0x7ff0e00b7550 2024-04-25T09:05:48.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.951+0000 7ff0e5a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e015c740 con 0x7ff0e015ba20 2024-04-25T09:05:48.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.951+0000 7ff0e5a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e015ca20 con 0x7ff0e00b70f0 2024-04-25T09:05:48.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.951+0000 7ff0df400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff0e00b7550 0x7ff0e006fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.951+0000 7ff0df400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff0e00b7550 0x7ff0e006fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41788/0 (socket says 172.21.15.173:41788) 2024-04-25T09:05:48.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.951+0000 7ff0df400640 1 -- 172.21.15.173:0/2162881415 learned_addr learned my addr 172.21.15.173:0/2162881415 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:48.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.951+0000 7ff0dea00640 1 --2- 172.21.15.173:0/2162881415 >> v2:172.21.15.194:3300/0 conn(0x7ff0e015ba20 0x7ff0e015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.951+0000 7ff0d6000640 1 --2- 172.21.15.173:0/2162881415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0e00b70f0 0x7ff0e006f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.951+0000 7ff0df400640 1 -- 172.21.15.173:0/2162881415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0e00b70f0 msgr2=0x7ff0e006f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:48.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.951+0000 7ff0df400640 1 --2- 172.21.15.173:0/2162881415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0e00b70f0 0x7ff0e006f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.951+0000 7ff0df400640 1 -- 172.21.15.173:0/2162881415 >> v2:172.21.15.194:3300/0 conn(0x7ff0e015ba20 msgr2=0x7ff0e015be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:48.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.951+0000 7ff0df400640 1 --2- 172.21.15.173:0/2162881415 >> v2:172.21.15.194:3300/0 conn(0x7ff0e015ba20 0x7ff0e015be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.951+0000 7ff0df400640 1 -- 172.21.15.173:0/2162881415 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e015cd00 con 0x7ff0e00b7550 2024-04-25T09:05:48.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.955+0000 7ff0df400640 1 --2- 172.21.15.173:0/2162881415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0e00b7550 0x7ff0e006fea0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ff0e00d27c0 tx=0x7ff0d801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb93631444514116 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.955+0000 7ff0de000640 1 -- 172.21.15.173:0/2162881415 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d80a5860 con 0x7ff0e00b7550 2024-04-25T09:05:48.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.955+0000 7ff0de000640 1 -- 172.21.15.173:0/2162881415 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d80a5a00 con 0x7ff0e00b7550 2024-04-25T09:05:48.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.955+0000 7ff0de000640 1 -- 172.21.15.173:0/2162881415 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d80a5dd0 con 0x7ff0e00b7550 2024-04-25T09:05:48.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.955+0000 7ff0e5a00640 1 -- 172.21.15.173:0/2162881415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0e00b7550 msgr2=0x7ff0e006fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.955+0000 7ff0e5a00640 1 --2- 172.21.15.173:0/2162881415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0e00b7550 0x7ff0e006fea0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ff0e00d27c0 tx=0x7ff0d801c9c0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.955+0000 7ff0e5a00640 1 -- 172.21.15.173:0/2162881415 shutdown_connections 2024-04-25T09:05:48.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.955+0000 7ff0e5a00640 1 --2- 172.21.15.173:0/2162881415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0e00b7550 0x7ff0e006fea0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.955+0000 7ff0e5a00640 1 --2- 172.21.15.173:0/2162881415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0e00b70f0 0x7ff0e006f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.955+0000 7ff0e5a00640 1 --2- 172.21.15.173:0/2162881415 >> v2:172.21.15.194:3300/0 conn(0x7ff0e015ba20 0x7ff0e015be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.955+0000 7ff0e5a00640 1 -- 172.21.15.173:0/2162881415 >> 172.21.15.173:0/2162881415 conn(0x7ff0e0061880 msgr2=0x7ff0e0061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:48.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.955+0000 7ff0e5a00640 1 -- 172.21.15.173:0/2162881415 shutdown_connections 2024-04-25T09:05:48.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.955+0000 7ff0e5a00640 1 -- 172.21.15.173:0/2162881415 wait complete. 2024-04-25T09:05:48.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0e5a00640 1 Processor -- start 2024-04-25T09:05:48.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0e5a00640 1 -- start start 2024-04-25T09:05:48.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0e5a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0e00b70f0 0x7ff0e01537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0e5a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0e015ba20 0x7ff0e01662a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0e5a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0e0156230 0x7ff0e01f6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0e5a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00d2620 con 0x7ff0e0156230 2024-04-25T09:05:48.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0e5a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00d24a0 con 0x7ff0e015ba20 2024-04-25T09:05:48.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0e5a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e015f3f0 con 0x7ff0e00b70f0 2024-04-25T09:05:48.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0df400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0e0156230 0x7ff0e01f6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0df400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0e0156230 0x7ff0e01f6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41804/0 (socket says 172.21.15.173:41804) 2024-04-25T09:05:48.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0df400640 1 -- 172.21.15.173:0/1969441019 learned_addr learned my addr 172.21.15.173:0/1969441019 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:48.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0dea00640 1 --2- 172.21.15.173:0/1969441019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0e00b70f0 0x7ff0e01537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0d6000640 1 --2- 172.21.15.173:0/1969441019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0e015ba20 0x7ff0e01662a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0dea00640 1 -- 172.21.15.173:0/1969441019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0e015ba20 msgr2=0x7ff0e01662a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0dea00640 1 --2- 172.21.15.173:0/1969441019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0e015ba20 0x7ff0e01662a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0dea00640 1 -- 172.21.15.173:0/1969441019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0e0156230 msgr2=0x7ff0e01f6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0dea00640 1 --2- 172.21.15.173:0/1969441019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0e0156230 0x7ff0e01f6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0dea00640 1 -- 172.21.15.173:0/1969441019 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e01567a0 con 0x7ff0e00b70f0 2024-04-25T09:05:48.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0df400640 1 --2- 172.21.15.173:0/1969441019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0e0156230 0x7ff0e01f6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:48.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0dea00640 1 --2- 172.21.15.173:0/1969441019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0e00b70f0 0x7ff0e01537a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000e870 tx=0x7ff0d000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0d7400640 1 -- 172.21.15.173:0/1969441019 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0017070 con 0x7ff0e00b70f0 2024-04-25T09:05:48.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0d7400640 1 -- 172.21.15.173:0/1969441019 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d000ee60 con 0x7ff0e00b70f0 2024-04-25T09:05:48.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0e5a00640 1 -- 172.21.15.173:0/1969441019 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e0156a80 con 0x7ff0e00b70f0 2024-04-25T09:05:48.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0d7400640 1 -- 172.21.15.173:0/1969441019 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000cb60 con 0x7ff0e00b70f0 2024-04-25T09:05:48.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.959+0000 7ff0e5a00640 1 -- 172.21.15.173:0/1969441019 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e0157040 con 0x7ff0e00b70f0 2024-04-25T09:05:48.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.963+0000 7ff0e5a00640 1 -- 172.21.15.173:0/1969441019 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e0073a40 con 0x7ff0e00b70f0 2024-04-25T09:05:48.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.963+0000 7ff0d7400640 1 -- 172.21.15.173:0/1969441019 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff0d001a070 con 0x7ff0e00b70f0 2024-04-25T09:05:48.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.963+0000 7ff0d7400640 1 --2- 172.21.15.173:0/1969441019 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff0bc066f60 0x7ff0bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.963+0000 7ff0d7400640 1 -- 172.21.15.173:0/1969441019 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5335+0+0 (secure 0 0 0) 0x7ff0d0085470 con 0x7ff0e00b70f0 2024-04-25T09:05:48.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.963+0000 7ff0d6000640 1 --2- 172.21.15.173:0/1969441019 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff0bc066f60 0x7ff0bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.963+0000 7ff0d6000640 1 --2- 172.21.15.173:0/1969441019 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff0bc066f60 0x7ff0bc069420 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff0e00b69a0 tx=0x7ff0c8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:48.967+0000 7ff0d7400640 1 -- 172.21.15.173:0/1969441019 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff0d0055f90 con 0x7ff0e00b70f0 2024-04-25T09:05:49.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.151+0000 7ff0e5a00640 1 -- 172.21.15.173:0/1969441019 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0e00b69d0 con 0x7ff0e00b70f0 2024-04-25T09:05:49.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.155+0000 7ff0d7400640 1 -- 172.21.15.173:0/1969441019 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3711 (secure 0 0 0) 0x7ff0d005a030 con 0x7ff0e00b70f0 2024-04-25T09:05:49.146 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:49.146 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2065115729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2065115729},{"type":"v1","addr":"172.21.15.194:6834","nonce":2065115729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4121705012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4121705012},{"type":"v1","addr":"172.21.15.194:6835","nonce":4121705012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3839820980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3839820980},{"type":"v1","addr":"172.21.15.173:6836","nonce":3839820980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5560,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2151487615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2151487615},{"type":"v1","addr":"172.21.15.173:6837","nonce":2151487615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[]} 2024-04-25T09:05:49.146 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 21 2024-04-25T09:05:49.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.155+0000 7ff0e5a00640 1 -- 172.21.15.173:0/1969441019 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff0bc066f60 msgr2=0x7ff0bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.155+0000 7ff0e5a00640 1 --2- 172.21.15.173:0/1969441019 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff0bc066f60 0x7ff0bc069420 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff0e00b69a0 tx=0x7ff0c8009190 comp rx=0 tx=0).stop 2024-04-25T09:05:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.155+0000 7ff0e5a00640 1 -- 172.21.15.173:0/1969441019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0e00b70f0 msgr2=0x7ff0e01537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.155+0000 7ff0e5a00640 1 --2- 172.21.15.173:0/1969441019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0e00b70f0 0x7ff0e01537a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000e870 tx=0x7ff0d000ed30 comp rx=0 tx=0).stop 2024-04-25T09:05:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.155+0000 7ff0e5a00640 1 -- 172.21.15.173:0/1969441019 shutdown_connections 2024-04-25T09:05:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.155+0000 7ff0e5a00640 1 --2- 172.21.15.173:0/1969441019 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff0bc066f60 0x7ff0bc069420 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.155+0000 7ff0e5a00640 1 --2- 172.21.15.173:0/1969441019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0e0156230 0x7ff0e01f6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.155+0000 7ff0e5a00640 1 --2- 172.21.15.173:0/1969441019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0e015ba20 0x7ff0e01662a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.155+0000 7ff0e5a00640 1 --2- 172.21.15.173:0/1969441019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0e00b70f0 0x7ff0e01537a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.155+0000 7ff0e5a00640 1 -- 172.21.15.173:0/1969441019 >> 172.21.15.173:0/1969441019 conn(0x7ff0e0061880 msgr2=0x7ff0e00b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:49.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.155+0000 7ff0e5a00640 1 -- 172.21.15.173:0/1969441019 shutdown_connections 2024-04-25T09:05:49.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.155+0000 7ff0e5a00640 1 -- 172.21.15.173:0/1969441019 wait complete. 2024-04-25T09:05:49.168 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:05:49.168 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:05:49.168 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:05:49.169 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:05:49.169 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:05:49.169 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:05:49.169 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:05:49.169 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:05:49.169 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:05:49.169 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:05:49.170 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:05:49.170 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:05:49.170 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:05:49.170 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:05:49.170 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:05:49.170 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:05:49.181 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:05:49.182 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:05:49.182 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:05:49.183 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:05:49.184 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:05:49.184 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:05:49.186 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:05:49.186 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:05:49.231 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:05:49.232 DEBUG:teuthology.parallel:result is None 2024-04-25T09:05:49.232 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:05:49.233 DEBUG:teuthology.parallel:result is None 2024-04-25T09:05:49.233 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:05:49.233 DEBUG:teuthology.parallel:result is None 2024-04-25T09:05:49.235 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:05:49.235 DEBUG:teuthology.parallel:result is None 2024-04-25T09:05:49.235 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:05:49.319 INFO:tasks.ceph.mds.c.smithi173.stdout:starting mds.c at 2024-04-25T09:05:49.320 INFO:tasks.ceph.mds.a.smithi173.stdout:starting mds.a at 2024-04-25T09:05:49.320 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-04-25T09:05:49.321 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-04-25T09:05:49.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.387+0000 7fa451800640 1 Processor -- start 2024-04-25T09:05:49.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.387+0000 7fa451800640 1 -- start start 2024-04-25T09:05:49.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.387+0000 7fa451800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa44c0aeb90 0x7fa44c0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.387+0000 7fa451800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa44c0aef70 0x7fa44c0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.387+0000 7fa451800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa44c0cdba0 0x7fa44c0ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.387+0000 7fa451800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44c071320 con 0x7fa44c0cdba0 2024-04-25T09:05:49.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.387+0000 7fa451800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44c072330 con 0x7fa44c0aef70 2024-04-25T09:05:49.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.387+0000 7fa451800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c0ce550 con 0x7fa44c0aeb90 2024-04-25T09:05:49.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.387+0000 7fa44b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa44c0cdba0 0x7fa44c0ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.387+0000 7fa44b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa44c0cdba0 0x7fa44c0ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41856/0 (socket says 172.21.15.173:41856) 2024-04-25T09:05:49.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.387+0000 7fa44b400640 1 -- 172.21.15.173:0/658818952 learned_addr learned my addr 172.21.15.173:0/658818952 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:49.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.387+0000 7fa44aa00640 1 --2- 172.21.15.173:0/658818952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa44c0aeb90 0x7fa44c0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.387+0000 7fa44a000640 1 --2- 172.21.15.173:0/658818952 >> v2:172.21.15.194:3300/0 conn(0x7fa44c0aef70 0x7fa44c0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.387+0000 7fa44b400640 1 -- 172.21.15.173:0/658818952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa44c0aeb90 msgr2=0x7fa44c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:49.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.387+0000 7fa44b400640 1 --2- 172.21.15.173:0/658818952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa44c0aeb90 0x7fa44c0cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.387+0000 7fa44b400640 1 -- 172.21.15.173:0/658818952 >> v2:172.21.15.194:3300/0 conn(0x7fa44c0aef70 msgr2=0x7fa44c0cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:49.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.387+0000 7fa44b400640 1 --2- 172.21.15.173:0/658818952 >> v2:172.21.15.194:3300/0 conn(0x7fa44c0aef70 0x7fa44c0cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.387+0000 7fa44b400640 1 -- 172.21.15.173:0/658818952 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c071570 con 0x7fa44c0cdba0 2024-04-25T09:05:49.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.391+0000 7fa44b400640 1 --2- 172.21.15.173:0/658818952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa44c0cdba0 0x7fa44c0ce010 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa44c06b9e0 tx=0x7fa44401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd933c6f247f5661 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.391+0000 7fa449600640 1 -- 172.21.15.173:0/658818952 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4440ab620 con 0x7fa44c0cdba0 2024-04-25T09:05:49.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.391+0000 7fa449600640 1 -- 172.21.15.173:0/658818952 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4440b0070 con 0x7fa44c0cdba0 2024-04-25T09:05:49.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.391+0000 7fa449600640 1 -- 172.21.15.173:0/658818952 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4440ab9e0 con 0x7fa44c0cdba0 2024-04-25T09:05:49.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.391+0000 7fa451800640 1 -- 172.21.15.173:0/658818952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa44c0cdba0 msgr2=0x7fa44c0ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.391+0000 7fa451800640 1 --2- 172.21.15.173:0/658818952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa44c0cdba0 0x7fa44c0ce010 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa44c06b9e0 tx=0x7fa44401c460 comp rx=0 tx=0).stop 2024-04-25T09:05:49.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.391+0000 7fa451800640 1 -- 172.21.15.173:0/658818952 shutdown_connections 2024-04-25T09:05:49.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.391+0000 7fa451800640 1 --2- 172.21.15.173:0/658818952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa44c0cdba0 0x7fa44c0ce010 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.391+0000 7fa451800640 1 --2- 172.21.15.173:0/658818952 >> v2:172.21.15.194:3300/0 conn(0x7fa44c0aef70 0x7fa44c0cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.391+0000 7fa451800640 1 --2- 172.21.15.173:0/658818952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa44c0aeb90 0x7fa44c0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.391+0000 7fa451800640 1 -- 172.21.15.173:0/658818952 >> 172.21.15.173:0/658818952 conn(0x7fa44c06ac90 msgr2=0x7fa44c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:49.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.391+0000 7fa451800640 1 -- 172.21.15.173:0/658818952 shutdown_connections 2024-04-25T09:05:49.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.391+0000 7fa451800640 1 -- 172.21.15.173:0/658818952 wait complete. 2024-04-25T09:05:49.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa451800640 1 Processor -- start 2024-04-25T09:05:49.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa451800640 1 -- start start 2024-04-25T09:05:49.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa451800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa44c0aeb90 0x7fa44c157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa451800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa44c0aef70 0x7fa44c1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa451800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa44c0cdba0 0x7fa44c0af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa451800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c15ef40 con 0x7fa44c0cdba0 2024-04-25T09:05:49.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa451800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c15edc0 con 0x7fa44c0aeb90 2024-04-25T09:05:49.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa451800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c15f0c0 con 0x7fa44c0aef70 2024-04-25T09:05:49.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa44b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa44c0cdba0 0x7fa44c0af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa44b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa44c0cdba0 0x7fa44c0af3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41860/0 (socket says 172.21.15.173:41860) 2024-04-25T09:05:49.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa44b400640 1 -- 172.21.15.173:0/4210189368 learned_addr learned my addr 172.21.15.173:0/4210189368 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:49.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa44a000640 1 --2- 172.21.15.173:0/4210189368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa44c0aef70 0x7fa44c1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa44aa00640 1 --2- 172.21.15.173:0/4210189368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa44c0aeb90 0x7fa44c157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa44b400640 1 -- 172.21.15.173:0/4210189368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa44c0aef70 msgr2=0x7fa44c1530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa44b400640 1 --2- 172.21.15.173:0/4210189368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa44c0aef70 0x7fa44c1530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa44b400640 1 -- 172.21.15.173:0/4210189368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa44c0aeb90 msgr2=0x7fa44c157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa44b400640 1 --2- 172.21.15.173:0/4210189368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa44c0aeb90 0x7fa44c157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa44b400640 1 -- 172.21.15.173:0/4210189368 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c1539e0 con 0x7fa44c0cdba0 2024-04-25T09:05:49.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa44b400640 1 --2- 172.21.15.173:0/4210189368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa44c0cdba0 0x7fa44c0af3e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa4440ad040 tx=0x7fa44401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa442a00640 1 -- 172.21.15.173:0/4210189368 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4440abb70 con 0x7fa44c0cdba0 2024-04-25T09:05:49.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa442a00640 1 -- 172.21.15.173:0/4210189368 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4440abd30 con 0x7fa44c0cdba0 2024-04-25T09:05:49.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa442a00640 1 -- 172.21.15.173:0/4210189368 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4440be630 con 0x7fa44c0cdba0 2024-04-25T09:05:49.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa451800640 1 -- 172.21.15.173:0/4210189368 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44c153cc0 con 0x7fa44c0cdba0 2024-04-25T09:05:49.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.395+0000 7fa451800640 1 -- 172.21.15.173:0/4210189368 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44c155da0 con 0x7fa44c0cdba0 2024-04-25T09:05:49.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.399+0000 7fa451800640 1 -- 172.21.15.173:0/4210189368 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44c073ab0 con 0x7fa44c0cdba0 2024-04-25T09:05:49.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.399+0000 7fa442a00640 1 -- 172.21.15.173:0/4210189368 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa4440b43f0 con 0x7fa44c0cdba0 2024-04-25T09:05:49.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.399+0000 7fa442a00640 1 --2- 172.21.15.173:0/4210189368 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa42c066f60 0x7fa42c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.399+0000 7fa442a00640 1 -- 172.21.15.173:0/4210189368 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fa44411ed70 con 0x7fa44c0cdba0 2024-04-25T09:05:49.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.399+0000 7fa44aa00640 1 --2- 172.21.15.173:0/4210189368 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa42c066f60 0x7fa42c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.399+0000 7fa44aa00640 1 --2- 172.21.15.173:0/4210189368 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa42c066f60 0x7fa42c069420 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0073f0 tx=0x7fa43c00d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.403+0000 7fa442a00640 1 -- 172.21.15.173:0/4210189368 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa444016110 con 0x7fa44c0cdba0 2024-04-25T09:05:49.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:49.575+0000 7fa451800640 1 -- 172.21.15.173:0/4210189368 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa44c155f70 con 0x7fa44c0cdba0 2024-04-25T09:05:50.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.515+0000 7fa442a00640 1 -- 172.21.15.173:0/4210189368 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v52) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa4440ef800 con 0x7fa44c0cdba0 2024-04-25T09:05:50.507 INFO:teuthology.orchestra.run.smithi173.stderr: removed all blocklist entries 2024-04-25T09:05:50.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.519+0000 7fa451800640 1 -- 172.21.15.173:0/4210189368 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa42c066f60 msgr2=0x7fa42c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.519+0000 7fa451800640 1 --2- 172.21.15.173:0/4210189368 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa42c066f60 0x7fa42c069420 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0073f0 tx=0x7fa43c00d040 comp rx=0 tx=0).stop 2024-04-25T09:05:50.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.519+0000 7fa451800640 1 -- 172.21.15.173:0/4210189368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa44c0cdba0 msgr2=0x7fa44c0af3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.519+0000 7fa451800640 1 --2- 172.21.15.173:0/4210189368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa44c0cdba0 0x7fa44c0af3e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa4440ad040 tx=0x7fa44401aca0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.519+0000 7fa451800640 1 -- 172.21.15.173:0/4210189368 shutdown_connections 2024-04-25T09:05:50.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.519+0000 7fa451800640 1 --2- 172.21.15.173:0/4210189368 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa42c066f60 0x7fa42c069420 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.519+0000 7fa451800640 1 --2- 172.21.15.173:0/4210189368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa44c0cdba0 0x7fa44c0af3e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.519+0000 7fa451800640 1 --2- 172.21.15.173:0/4210189368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa44c0aef70 0x7fa44c1530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.519+0000 7fa451800640 1 --2- 172.21.15.173:0/4210189368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa44c0aeb90 0x7fa44c157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.519+0000 7fa451800640 1 -- 172.21.15.173:0/4210189368 >> 172.21.15.173:0/4210189368 conn(0x7fa44c06ac90 msgr2=0x7fa44c15c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:50.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.519+0000 7fa451800640 1 -- 172.21.15.173:0/4210189368 shutdown_connections 2024-04-25T09:05:50.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.519+0000 7fa451800640 1 -- 172.21.15.173:0/4210189368 wait complete. 2024-04-25T09:05:50.534 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:05:50.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.683+0000 7f5d19c00640 1 Processor -- start 2024-04-25T09:05:50.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.683+0000 7f5d19c00640 1 -- start start 2024-04-25T09:05:50.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.683+0000 7f5d19c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5d1415edd0 0x7f5d140cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.683+0000 7f5d19c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d1415f320 con 0x7f5d140b3e70 2024-04-25T09:05:50.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.683+0000 7f5d19c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d1406d420 con 0x7f5d140aefa0 2024-04-25T09:05:50.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.683+0000 7f5d19c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d1406dd50 con 0x7f5d1415edd0 2024-04-25T09:05:50.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.683+0000 7f5d12a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f5d140b3e70 0x7f5d140b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:56338/0 (socket says 172.21.15.173:56338) 2024-04-25T09:05:50.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.683+0000 7f5d12a00640 1 -- 172.21.15.173:0/409448054 learned_addr learned my addr 172.21.15.173:0/409448054 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:50.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.683+0000 7f5d13400640 1 --2- 172.21.15.173:0/409448054 >> v2:172.21.15.194:3300/0 conn(0x7f5d1415edd0 0x7f5d140cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.683+0000 7f5d12000640 1 -- 172.21.15.173:0/409448054 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120844404 0 0) 0x7f5d1415f320 con 0x7f5d140b3e70 2024-04-25T09:05:50.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.683+0000 7f5d12000640 1 -- 172.21.15.173:0/409448054 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cf8005740 con 0x7f5d140b3e70 2024-04-25T09:05:50.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.683+0000 7f5d12000640 1 -- 172.21.15.173:0/409448054 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054910485 0 0) 0x7f5d1406d420 con 0x7f5d140aefa0 2024-04-25T09:05:50.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.683+0000 7f5d12000640 1 -- 172.21.15.173:0/409448054 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d1415f320 con 0x7f5d140aefa0 2024-04-25T09:05:50.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.687+0000 7f5d12000640 1 -- 172.21.15.173:0/409448054 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2615413461 0 0) 0x7f5cf8005740 con 0x7f5d140b3e70 2024-04-25T09:05:50.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.687+0000 7f5d13400640 1 -- 172.21.15.173:0/409448054 >> v1:172.21.15.194:6789/0 conn(0x7f5d140aefa0 legacy=0x7f5d140cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.687+0000 7f5d13400640 1 -- 172.21.15.173:0/409448054 >> v1:172.21.15.173:6789/0 conn(0x7f5d140b3e70 legacy=0x7f5d140b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.687+0000 7f5d13400640 1 -- 172.21.15.173:0/409448054 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1406d700 con 0x7f5d1415edd0 2024-04-25T09:05:50.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.687+0000 7f5d13400640 1 --2- 172.21.15.173:0/409448054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d1415edd0 0x7f5d140cdeb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c009d90 tx=0x7f5d0c01c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=987aba9b60f9eb66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.687+0000 7f5d12000640 1 -- 172.21.15.173:0/409448054 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c0b2070 con 0x7f5d1415edd0 2024-04-25T09:05:50.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.687+0000 7f5d12000640 1 -- 172.21.15.173:0/409448054 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0c0a55c0 con 0x7f5d1415edd0 2024-04-25T09:05:50.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.687+0000 7f5d12000640 1 -- 172.21.15.173:0/409448054 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d04001680 con 0x7f5d1415edd0 2024-04-25T09:05:50.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.687+0000 7f5d19c00640 1 -- 172.21.15.173:0/409448054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d1415edd0 msgr2=0x7f5d140cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.687+0000 7f5d19c00640 1 --2- 172.21.15.173:0/409448054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d1415edd0 0x7f5d140cdeb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c009d90 tx=0x7f5d0c01c860 comp rx=0 tx=0).stop 2024-04-25T09:05:50.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d19c00640 1 -- 172.21.15.173:0/409448054 shutdown_connections 2024-04-25T09:05:50.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d19c00640 1 --2- 172.21.15.173:0/409448054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d1415edd0 0x7f5d140cdeb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d19c00640 1 -- 172.21.15.173:0/409448054 >> 172.21.15.173:0/409448054 conn(0x7f5d1406ac90 msgr2=0x7f5d1406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:50.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d19c00640 1 -- 172.21.15.173:0/409448054 shutdown_connections 2024-04-25T09:05:50.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d19c00640 1 -- 172.21.15.173:0/409448054 wait complete. 2024-04-25T09:05:50.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d19c00640 1 Processor -- start 2024-04-25T09:05:50.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d19c00640 1 -- start start 2024-04-25T09:05:50.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d19c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d140aefa0 0x7f5d140b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d19c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d140b3e70 0x7f5d1414f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d19c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d1415edd0 0x7f5d140cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d19c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1406e360 con 0x7f5d1415edd0 2024-04-25T09:05:50.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d19c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1406e1e0 con 0x7f5d140b3e70 2024-04-25T09:05:50.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d19c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d14071b30 con 0x7f5d140aefa0 2024-04-25T09:05:50.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d13400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d1415edd0 0x7f5d140cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d13400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d1415edd0 0x7f5d140cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41872/0 (socket says 172.21.15.173:41872) 2024-04-25T09:05:50.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d13400640 1 -- 172.21.15.173:0/19744059 learned_addr learned my addr 172.21.15.173:0/19744059 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:50.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d12a00640 1 --2- 172.21.15.173:0/19744059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d140aefa0 0x7f5d140b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d0a000640 1 --2- 172.21.15.173:0/19744059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d140b3e70 0x7f5d1414f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d13400640 1 -- 172.21.15.173:0/19744059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d140aefa0 msgr2=0x7f5d140b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d13400640 1 --2- 172.21.15.173:0/19744059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d140aefa0 0x7f5d140b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d13400640 1 -- 172.21.15.173:0/19744059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d140b3e70 msgr2=0x7f5d1414f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d13400640 1 --2- 172.21.15.173:0/19744059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d140b3e70 0x7f5d1414f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d13400640 1 -- 172.21.15.173:0/19744059 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1415b170 con 0x7f5d1415edd0 2024-04-25T09:05:50.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.691+0000 7f5d13400640 1 --2- 172.21.15.173:0/19744059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d1415edd0 0x7f5d140cf8a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0b0040 tx=0x7f5d0c019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.695+0000 7f5d0b400640 1 -- 172.21.15.173:0/19744059 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c0b2070 con 0x7f5d1415edd0 2024-04-25T09:05:50.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.695+0000 7f5d0b400640 1 -- 172.21.15.173:0/19744059 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0c0bc070 con 0x7f5d1415edd0 2024-04-25T09:05:50.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.695+0000 7f5d0b400640 1 -- 172.21.15.173:0/19744059 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c009450 con 0x7f5d1415edd0 2024-04-25T09:05:50.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.695+0000 7f5d19c00640 1 -- 172.21.15.173:0/19744059 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d1415b450 con 0x7f5d1415edd0 2024-04-25T09:05:50.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.695+0000 7f5d19c00640 1 -- 172.21.15.173:0/19744059 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d1415ba10 con 0x7f5d1415edd0 2024-04-25T09:05:50.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.695+0000 7f5d19c00640 1 -- 172.21.15.173:0/19744059 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d14073a40 con 0x7f5d1415edd0 2024-04-25T09:05:50.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.695+0000 7f5d0b400640 1 -- 172.21.15.173:0/19744059 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5d0c004040 con 0x7f5d1415edd0 2024-04-25T09:05:50.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.695+0000 7f5d0b400640 1 --2- 172.21.15.173:0/19744059 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5cf0066f90 0x7f5cf0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.695+0000 7f5d0b400640 1 -- 172.21.15.173:0/19744059 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f5d0c11f3c0 con 0x7f5d1415edd0 2024-04-25T09:05:50.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.695+0000 7f5d12a00640 1 --2- 172.21.15.173:0/19744059 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5cf0066f90 0x7f5cf0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.699+0000 7f5d12a00640 1 --2- 172.21.15.173:0/19744059 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5cf0066f90 0x7f5cf0069450 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5d04000fe0 tx=0x7f5d04001160 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.699+0000 7f5d0b400640 1 -- 172.21.15.173:0/19744059 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5d0c016480 con 0x7f5d1415edd0 2024-04-25T09:05:50.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.911+0000 7f5d19c00640 1 -- 172.21.15.173:0/19744059 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5d1406f1c0 con 0x7f5d1415edd0 2024-04-25T09:05:50.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.911+0000 7f5d0b400640 1 -- 172.21.15.173:0/19744059 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5d0c0eff30 con 0x7f5d1415edd0 2024-04-25T09:05:50.903 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:50.903 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:05:50.903 INFO:teuthology.orchestra.run.smithi173.stdout: "auth_dump": [ 2024-04-25T09:05:50.903 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.904 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.a", 2024-04-25T09:05:50.904 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmnVr3EhAAn+C0Mb/MrYSZuQyr5QTXig==", 2024-04-25T09:05:50.904 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.904 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:05:50.904 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:05:50.904 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:05:50.904 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:05:50.904 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.904 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:50.904 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.904 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.b", 2024-04-25T09:05:50.904 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6Gypm0QfFHhAAuP8xE/8pvSZMcP8N33OB9Q==", 2024-04-25T09:05:50.904 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.904 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:05:50.904 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:05:50.905 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:05:50.905 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:05:50.905 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.905 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:50.905 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.905 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.c", 2024-04-25T09:05:50.905 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmQsv4GRAATNiD7udOvl8xRDIx64O5jg==", 2024-04-25T09:05:50.905 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.905 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:05:50.905 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:05:50.905 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:05:50.905 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:05:50.905 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.905 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:50.906 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.906 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.d", 2024-04-25T09:05:50.906 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmtGMSJhAAonqLeuSsNrgyZks1eoJ1Gg==", 2024-04-25T09:05:50.906 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.906 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:05:50.906 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:05:50.906 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:05:50.906 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:05:50.906 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.906 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:50.906 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.906 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.0", 2024-04-25T09:05:50.906 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD9Gypm+Yw7LBAAnOFUKU3w1ltre7aHMWZ/SQ==", 2024-04-25T09:05:50.907 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.907 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:50.907 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:05:50.907 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:05:50.907 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.907 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:50.907 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.907 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.1", 2024-04-25T09:05:50.907 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAAHCpm4BUIOBAAmbfWUWCun/una5WoemhL6Q==", 2024-04-25T09:05:50.907 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.907 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:50.907 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:05:50.907 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:05:50.907 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.907 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:50.907 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.908 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.2", 2024-04-25T09:05:50.908 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAEHCpmFXIaBRAA0cN2GdLSS3jJC+x4RVUUlw==", 2024-04-25T09:05:50.908 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.908 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:50.908 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:05:50.908 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:05:50.908 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.908 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:50.908 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.908 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.3", 2024-04-25T09:05:50.909 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAHHCpmUD+YDxAALPvf1wLzhuQmFPo3/vJkdQ==", 2024-04-25T09:05:50.909 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.909 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:50.909 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:05:50.909 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:05:50.909 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.909 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:50.909 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.909 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.4", 2024-04-25T09:05:50.909 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQANHCpmLQ0fCBAA1Shz0Pfns+rj5r601hzOnQ==", 2024-04-25T09:05:50.909 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.909 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:50.909 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:05:50.909 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:05:50.909 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.910 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:50.910 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.910 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.5", 2024-04-25T09:05:50.910 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAQHCpmyMj1ERAAMRvZ3PFQa9oe6oGemLvfxw==", 2024-04-25T09:05:50.910 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.910 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:50.910 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:05:50.910 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:05:50.910 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.910 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:50.910 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.910 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.6", 2024-04-25T09:05:50.910 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQATHCpmKha6GxAAF4zfdFDlylGHHhGI5tVpGA==", 2024-04-25T09:05:50.910 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.911 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:50.911 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:05:50.911 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:05:50.911 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.911 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:50.911 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.911 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.7", 2024-04-25T09:05:50.911 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAWHCpmB2lFJhAA3sYYsjS5DIC5fCDz6ur0tA==", 2024-04-25T09:05:50.911 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.911 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:50.911 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:05:50.911 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:05:50.911 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.911 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:50.911 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.912 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.0", 2024-04-25T09:05:50.912 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w==", 2024-04-25T09:05:50.912 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.912 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:05:50.912 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow r", 2024-04-25T09:05:50.912 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:05:50.912 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.912 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:50.912 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.912 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.1", 2024-04-25T09:05:50.912 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6Gypm1PbHMxAAXMrgpR/xgzfQuuNrculQxA==", 2024-04-25T09:05:50.912 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.912 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:05:50.912 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:05:50.912 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:05:50.912 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:05:50.913 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.913 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:50.913 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.913 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.2", 2024-04-25T09:05:50.913 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmrTxjMBAAaqwDl5uiLxhaDIk7m6oDIw==", 2024-04-25T09:05:50.913 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.913 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:05:50.913 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:05:50.913 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:05:50.913 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:05:50.913 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.913 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:50.913 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.913 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.3", 2024-04-25T09:05:50.913 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmlAS9ORAAvYbwLnUaDHXOqvEBwJJJcQ==", 2024-04-25T09:05:50.913 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.914 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:05:50.914 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:05:50.914 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:05:50.914 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:05:50.914 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.914 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:50.914 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.914 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.admin", 2024-04-25T09:05:50.914 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD5GypmYFhkMhAACwSsE+B9l263vnlJ0LjFkQ==", 2024-04-25T09:05:50.914 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.914 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:05:50.914 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:05:50.915 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:05:50.915 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:05:50.915 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.915 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:50.915 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.915 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mgr.x", 2024-04-25T09:05:50.915 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmMSqHDhAAe0nkrXbT7dBbAbI89ExUmw==", 2024-04-25T09:05:50.915 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.915 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:05:50.915 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile mgr", 2024-04-25T09:05:50.915 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:05:50.915 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.915 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:05:50.915 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:50.915 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mgr.y", 2024-04-25T09:05:50.916 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmjCuzChAAomjH5vLVICqSFpyDVQeB4w==", 2024-04-25T09:05:50.916 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:05:50.916 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:05:50.916 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile mgr", 2024-04-25T09:05:50.916 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:05:50.916 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.916 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:50.916 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-04-25T09:05:50.916 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:05:50.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.911+0000 7f5d19c00640 1 -- 172.21.15.173:0/19744059 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5cf0066f90 msgr2=0x7f5cf0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.911+0000 7f5d19c00640 1 --2- 172.21.15.173:0/19744059 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5cf0066f90 0x7f5cf0069450 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5d04000fe0 tx=0x7f5d04001160 comp rx=0 tx=0).stop 2024-04-25T09:05:50.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.911+0000 7f5d19c00640 1 -- 172.21.15.173:0/19744059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d1415edd0 msgr2=0x7f5d140cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.911+0000 7f5d19c00640 1 --2- 172.21.15.173:0/19744059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d1415edd0 0x7f5d140cf8a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0b0040 tx=0x7f5d0c019600 comp rx=0 tx=0).stop 2024-04-25T09:05:50.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.915+0000 7f5d19c00640 1 -- 172.21.15.173:0/19744059 shutdown_connections 2024-04-25T09:05:50.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.915+0000 7f5d19c00640 1 --2- 172.21.15.173:0/19744059 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5cf0066f90 0x7f5cf0069450 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.915+0000 7f5d19c00640 1 --2- 172.21.15.173:0/19744059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d1415edd0 0x7f5d140cf8a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.915+0000 7f5d19c00640 1 --2- 172.21.15.173:0/19744059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d140b3e70 0x7f5d1414f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.915+0000 7f5d19c00640 1 --2- 172.21.15.173:0/19744059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d140aefa0 0x7f5d140b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.915+0000 7f5d19c00640 1 -- 172.21.15.173:0/19744059 >> 172.21.15.173:0/19744059 conn(0x7f5d1406ac90 msgr2=0x7f5d140afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:50.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.915+0000 7f5d19c00640 1 -- 172.21.15.173:0/19744059 shutdown_connections 2024-04-25T09:05:50.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:50.915+0000 7f5d19c00640 1 -- 172.21.15.173:0/19744059 wait complete. 2024-04-25T09:05:50.925 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:51.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.071+0000 7f6083200640 1 Processor -- start 2024-04-25T09:05:51.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.071+0000 7f6083200640 1 -- start start 2024-04-25T09:05:51.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.071+0000 7f6083200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f60840cc000 0x7f60840cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.071+0000 7f6083200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60840cff20 0x7f60840cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.071+0000 7f6083200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60840cc440 con 0x7f608415b900 2024-04-25T09:05:51.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.071+0000 7f6083200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60840cd2d0 con 0x7f60840cc000 2024-04-25T09:05:51.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.071+0000 7f6083200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608415bce0 con 0x7f60840cff20 2024-04-25T09:05:51.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.071+0000 7f6081400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f60840cc000 0x7f60840cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.071+0000 7f6081400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f60840cc000 0x7f60840cf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41888/0 (socket says 172.21.15.173:41888) 2024-04-25T09:05:51.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.071+0000 7f6081e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f608415b900 0x7f60840b2930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:36424/0 (socket says 172.21.15.173:36424) 2024-04-25T09:05:51.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.071+0000 7f6081400640 1 -- 172.21.15.173:0/527920727 learned_addr learned my addr 172.21.15.173:0/527920727 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:51.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.071+0000 7f6082800640 1 --2- 172.21.15.173:0/527920727 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60840cff20 0x7f60840cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.071+0000 7f6081400640 1 -- 172.21.15.173:0/527920727 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60840cff20 msgr2=0x7f60840cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:51.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.071+0000 7f6081400640 1 --2- 172.21.15.173:0/527920727 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60840cff20 0x7f60840cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.071+0000 7f6081400640 1 -- 172.21.15.173:0/527920727 >> v1:172.21.15.194:6789/0 conn(0x7f608415b900 legacy=0x7f60840b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.071+0000 7f6080a00640 1 -- 172.21.15.173:0/527920727 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384507510 0 0) 0x7f6074001120 con 0x7f608415b900 2024-04-25T09:05:51.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.071+0000 7f6081400640 1 -- 172.21.15.173:0/527920727 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60840cc6c0 con 0x7f60840cc000 2024-04-25T09:05:51.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.075+0000 7f6081400640 1 --2- 172.21.15.173:0/527920727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60840cc000 0x7f60840cf9e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6070009870 tx=0x7f607001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76b28565aa1bc6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.075+0000 7f6080a00640 1 -- 172.21.15.173:0/527920727 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700ab650 con 0x7f60840cc000 2024-04-25T09:05:51.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.075+0000 7f6080a00640 1 -- 172.21.15.173:0/527920727 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60700b0070 con 0x7f60840cc000 2024-04-25T09:05:51.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.075+0000 7f6080a00640 1 -- 172.21.15.173:0/527920727 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700aba10 con 0x7f60840cc000 2024-04-25T09:05:51.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.075+0000 7f6083200640 1 -- 172.21.15.173:0/527920727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60840cc000 msgr2=0x7f60840cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.075+0000 7f6083200640 1 --2- 172.21.15.173:0/527920727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60840cc000 0x7f60840cf9e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6070009870 tx=0x7f607001c560 comp rx=0 tx=0).stop 2024-04-25T09:05:51.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.075+0000 7f6083200640 1 -- 172.21.15.173:0/527920727 shutdown_connections 2024-04-25T09:05:51.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.075+0000 7f6083200640 1 --2- 172.21.15.173:0/527920727 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60840cff20 0x7f60840cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.075+0000 7f6083200640 1 --2- 172.21.15.173:0/527920727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60840cc000 0x7f60840cf9e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.075+0000 7f6083200640 1 -- 172.21.15.173:0/527920727 >> 172.21.15.173:0/527920727 conn(0x7f60840d1620 msgr2=0x7f60840d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.075+0000 7f6083200640 1 -- 172.21.15.173:0/527920727 shutdown_connections 2024-04-25T09:05:51.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.075+0000 7f6083200640 1 -- 172.21.15.173:0/527920727 wait complete. 2024-04-25T09:05:51.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.075+0000 7f6083200640 1 Processor -- start 2024-04-25T09:05:51.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.075+0000 7f6083200640 1 -- start start 2024-04-25T09:05:51.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6083200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60840cc000 0x7f60841511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6083200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60840cff20 0x7f60840c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6083200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f608415b900 0x7f608415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6083200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60840ce630 con 0x7f60840cc000 2024-04-25T09:05:51.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6083200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60840ce4b0 con 0x7f608415b900 2024-04-25T09:05:51.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6083200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60840ce7b0 con 0x7f60840cff20 2024-04-25T09:05:51.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6081e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60840cc000 0x7f60841511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6081e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60840cc000 0x7f60841511d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41904/0 (socket says 172.21.15.173:41904) 2024-04-25T09:05:51.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6081e00640 1 -- 172.21.15.173:0/2615255579 learned_addr learned my addr 172.21.15.173:0/2615255579 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:51.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6082800640 1 --2- 172.21.15.173:0/2615255579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f608415b900 0x7f608415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6081400640 1 --2- 172.21.15.173:0/2615255579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60840cff20 0x7f60840c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6081e00640 1 -- 172.21.15.173:0/2615255579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60840cff20 msgr2=0x7f60840c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6081e00640 1 --2- 172.21.15.173:0/2615255579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60840cff20 0x7f60840c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6081e00640 1 -- 172.21.15.173:0/2615255579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f608415b900 msgr2=0x7f608415d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6081e00640 1 --2- 172.21.15.173:0/2615255579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f608415b900 0x7f608415d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6081e00640 1 -- 172.21.15.173:0/2615255579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60840c86f0 con 0x7f60840cc000 2024-04-25T09:05:51.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6081e00640 1 --2- 172.21.15.173:0/2615255579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60840cc000 0x7f60841511d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f607400c480 tx=0x7f607400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f607a000640 1 -- 172.21.15.173:0/2615255579 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074018070 con 0x7f60840cc000 2024-04-25T09:05:51.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f607a000640 1 -- 172.21.15.173:0/2615255579 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6074007500 con 0x7f60840cc000 2024-04-25T09:05:51.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6083200640 1 -- 172.21.15.173:0/2615255579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608415e820 con 0x7f60840cc000 2024-04-25T09:05:51.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f607a000640 1 -- 172.21.15.173:0/2615255579 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074004a30 con 0x7f60840cc000 2024-04-25T09:05:51.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6083200640 1 -- 172.21.15.173:0/2615255579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60840ae710 con 0x7f60840cc000 2024-04-25T09:05:51.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f6083200640 1 -- 172.21.15.173:0/2615255579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6084073a40 con 0x7f60840cc000 2024-04-25T09:05:51.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.079+0000 7f607a000640 1 -- 172.21.15.173:0/2615255579 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f607401b070 con 0x7f60840cc000 2024-04-25T09:05:51.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.083+0000 7f607a000640 1 --2- 172.21.15.173:0/2615255579 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6064066f60 0x7f6064069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.083+0000 7f607a000640 1 -- 172.21.15.173:0/2615255579 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f6074084160 con 0x7f60840cc000 2024-04-25T09:05:51.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.083+0000 7f6081400640 1 --2- 172.21.15.173:0/2615255579 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6064066f60 0x7f6064069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.083+0000 7f6081400640 1 --2- 172.21.15.173:0/2615255579 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6064066f60 0x7f6064069420 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f60700af000 tx=0x7f60700a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.087+0000 7f607a000640 1 -- 172.21.15.173:0/2615255579 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f60840cc440 con 0x7f60840cc000 2024-04-25T09:05:51.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.243+0000 7f6083200640 1 -- 172.21.15.173:0/2615255579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60840c4e20 con 0x7f60840cc000 2024-04-25T09:05:51.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.243+0000 7f607a000640 1 -- 172.21.15.173:0/2615255579 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+13224 (secure 0 0 0) 0x7f6074055320 con 0x7f60840cc000 2024-04-25T09:05:51.236 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:51.236 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":52,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:05:50.518854+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:51.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.247+0000 7f6083200640 1 -- 172.21.15.173:0/2615255579 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6064066f60 msgr2=0x7f6064069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.247+0000 7f6083200640 1 --2- 172.21.15.173:0/2615255579 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6064066f60 0x7f6064069420 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f60700af000 tx=0x7f60700a7000 comp rx=0 tx=0).stop 2024-04-25T09:05:51.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.247+0000 7f6083200640 1 -- 172.21.15.173:0/2615255579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60840cc000 msgr2=0x7f60841511d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.247+0000 7f6083200640 1 --2- 172.21.15.173:0/2615255579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60840cc000 0x7f60841511d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f607400c480 tx=0x7f607400c940 comp rx=0 tx=0).stop 2024-04-25T09:05:51.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.247+0000 7f6083200640 1 -- 172.21.15.173:0/2615255579 shutdown_connections 2024-04-25T09:05:51.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.247+0000 7f6083200640 1 --2- 172.21.15.173:0/2615255579 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6064066f60 0x7f6064069420 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.247+0000 7f6083200640 1 --2- 172.21.15.173:0/2615255579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f608415b900 0x7f608415d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.247+0000 7f6083200640 1 --2- 172.21.15.173:0/2615255579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60840cff20 0x7f60840c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.247+0000 7f6083200640 1 --2- 172.21.15.173:0/2615255579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60840cc000 0x7f60841511d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.247+0000 7f6083200640 1 -- 172.21.15.173:0/2615255579 >> 172.21.15.173:0/2615255579 conn(0x7f60840d1620 msgr2=0x7f60840b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.247+0000 7f6083200640 1 -- 172.21.15.173:0/2615255579 shutdown_connections 2024-04-25T09:05:51.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.247+0000 7f6083200640 1 -- 172.21.15.173:0/2615255579 wait complete. 2024-04-25T09:05:51.257 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:05:51.257 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:05:51.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.403+0000 7fc22da00640 1 Processor -- start 2024-04-25T09:05:51.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.403+0000 7fc22da00640 1 -- start start 2024-04-25T09:05:51.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.407+0000 7fc22da00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc228145290 0x7fc22815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.407+0000 7fc22da00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22815c5f0 con 0x7fc2280b3fe0 2024-04-25T09:05:51.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.407+0000 7fc22da00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22806d4b0 con 0x7fc2280cc260 2024-04-25T09:05:51.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.407+0000 7fc22da00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2280ccd80 con 0x7fc228145290 2024-04-25T09:05:51.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.407+0000 7fc226a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc228145290 0x7fc22815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.407+0000 7fc226a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc228145290 0x7fc22815c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41908/0 (socket says 172.21.15.173:41908) 2024-04-25T09:05:51.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.407+0000 7fc226a00640 1 -- 172.21.15.173:0/440489402 learned_addr learned my addr 172.21.15.173:0/440489402 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:51.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.407+0000 7fc226a00640 1 -- 172.21.15.173:0/440489402 >> v1:172.21.15.194:6789/0 conn(0x7fc2280cc260 legacy=0x7fc2280cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:51.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.407+0000 7fc226a00640 1 -- 172.21.15.173:0/440489402 >> v1:172.21.15.173:6789/0 conn(0x7fc2280b3fe0 legacy=0x7fc2280b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.407+0000 7fc226a00640 1 -- 172.21.15.173:0/440489402 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22806d790 con 0x7fc228145290 2024-04-25T09:05:51.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.407+0000 7fc226a00640 1 --2- 172.21.15.173:0/440489402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc228145290 0x7fc22815c0b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc218009e50 tx=0x7fc21801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb672a7d1693a043 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.407+0000 7fc226000640 1 -- 172.21.15.173:0/440489402 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2180a56a0 con 0x7fc228145290 2024-04-25T09:05:51.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.407+0000 7fc226000640 1 -- 172.21.15.173:0/440489402 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2180a5840 con 0x7fc228145290 2024-04-25T09:05:51.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.407+0000 7fc226000640 1 -- 172.21.15.173:0/440489402 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2180a5c10 con 0x7fc228145290 2024-04-25T09:05:51.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc22da00640 1 -- 172.21.15.173:0/440489402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc228145290 msgr2=0x7fc22815c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc22da00640 1 --2- 172.21.15.173:0/440489402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc228145290 0x7fc22815c0b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc218009e50 tx=0x7fc21801c8d0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc22da00640 1 -- 172.21.15.173:0/440489402 shutdown_connections 2024-04-25T09:05:51.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc22da00640 1 --2- 172.21.15.173:0/440489402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc228145290 0x7fc22815c0b0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc22da00640 1 -- 172.21.15.173:0/440489402 >> 172.21.15.173:0/440489402 conn(0x7fc22806ac90 msgr2=0x7fc22806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc22da00640 1 -- 172.21.15.173:0/440489402 shutdown_connections 2024-04-25T09:05:51.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc22da00640 1 -- 172.21.15.173:0/440489402 wait complete. 2024-04-25T09:05:51.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc22da00640 1 Processor -- start 2024-04-25T09:05:51.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc22da00640 1 -- start start 2024-04-25T09:05:51.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc22da00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2280b3fe0 0x7fc22813df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc22da00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2280cc260 0x7fc228147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc22da00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc228145290 0x7fc22815b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc22da00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22806eee0 con 0x7fc2280b3fe0 2024-04-25T09:05:51.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc22da00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22806ed60 con 0x7fc2280cc260 2024-04-25T09:05:51.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc22da00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22806f060 con 0x7fc228145290 2024-04-25T09:05:51.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc226a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2280b3fe0 0x7fc22813df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc226a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2280b3fe0 0x7fc22813df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41916/0 (socket says 172.21.15.173:41916) 2024-04-25T09:05:51.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc226a00640 1 -- 172.21.15.173:0/1548893229 learned_addr learned my addr 172.21.15.173:0/1548893229 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:51.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc227400640 1 --2- 172.21.15.173:0/1548893229 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc228145290 0x7fc22815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc21e000640 1 --2- 172.21.15.173:0/1548893229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2280cc260 0x7fc228147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc226a00640 1 -- 172.21.15.173:0/1548893229 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc228145290 msgr2=0x7fc22815b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc226a00640 1 --2- 172.21.15.173:0/1548893229 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc228145290 0x7fc22815b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc226a00640 1 -- 172.21.15.173:0/1548893229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2280cc260 msgr2=0x7fc228147e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc226a00640 1 --2- 172.21.15.173:0/1548893229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2280cc260 0x7fc228147e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.411+0000 7fc226a00640 1 -- 172.21.15.173:0/1548893229 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22813e870 con 0x7fc2280b3fe0 2024-04-25T09:05:51.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.415+0000 7fc226a00640 1 --2- 172.21.15.173:0/1548893229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2280b3fe0 0x7fc22813df90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc2180194e0 tx=0x7fc218019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.415+0000 7fc21f400640 1 -- 172.21.15.173:0/1548893229 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2180bc020 con 0x7fc2280b3fe0 2024-04-25T09:05:51.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.415+0000 7fc21f400640 1 -- 172.21.15.173:0/1548893229 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2180b8670 con 0x7fc2280b3fe0 2024-04-25T09:05:51.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.415+0000 7fc22da00640 1 -- 172.21.15.173:0/1548893229 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22813eb50 con 0x7fc2280b3fe0 2024-04-25T09:05:51.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.415+0000 7fc21f400640 1 -- 172.21.15.173:0/1548893229 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2180b8a60 con 0x7fc2280b3fe0 2024-04-25T09:05:51.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.415+0000 7fc22da00640 1 -- 172.21.15.173:0/1548893229 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22813f110 con 0x7fc2280b3fe0 2024-04-25T09:05:51.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.415+0000 7fc22da00640 1 -- 172.21.15.173:0/1548893229 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc228073ab0 con 0x7fc2280b3fe0 2024-04-25T09:05:51.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.415+0000 7fc21f400640 1 -- 172.21.15.173:0/1548893229 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc2180bf020 con 0x7fc2280b3fe0 2024-04-25T09:05:51.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.415+0000 7fc21f400640 1 --2- 172.21.15.173:0/1548893229 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc204066f60 0x7fc204069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.415+0000 7fc21f400640 1 -- 172.21.15.173:0/1548893229 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fc21811fcf0 con 0x7fc2280b3fe0 2024-04-25T09:05:51.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.415+0000 7fc21e000640 1 --2- 172.21.15.173:0/1548893229 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc204066f60 0x7fc204069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.415+0000 7fc21e000640 1 --2- 172.21.15.173:0/1548893229 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc204066f60 0x7fc204069420 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc22815d5c0 tx=0x7fc210009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.419+0000 7fc21f400640 1 -- 172.21.15.173:0/1548893229 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc218124070 con 0x7fc2280b3fe0 2024-04-25T09:05:51.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.575+0000 7fc22da00640 1 -- 172.21.15.173:0/1548893229 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc228140ce0 con 0x7fc2280b3fe0 2024-04-25T09:05:51.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.575+0000 7fc21f400640 1 -- 172.21.15.173:0/1548893229 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc2180c6030 con 0x7fc2280b3fe0 2024-04-25T09:05:51.569 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:05:51.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.579+0000 7fc22da00640 1 -- 172.21.15.173:0/1548893229 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc204066f60 msgr2=0x7fc204069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.579+0000 7fc22da00640 1 --2- 172.21.15.173:0/1548893229 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc204066f60 0x7fc204069420 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc22815d5c0 tx=0x7fc210009040 comp rx=0 tx=0).stop 2024-04-25T09:05:51.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.579+0000 7fc22da00640 1 -- 172.21.15.173:0/1548893229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2280b3fe0 msgr2=0x7fc22813df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.579+0000 7fc22da00640 1 --2- 172.21.15.173:0/1548893229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2280b3fe0 0x7fc22813df90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc2180194e0 tx=0x7fc218019670 comp rx=0 tx=0).stop 2024-04-25T09:05:51.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.579+0000 7fc22da00640 1 -- 172.21.15.173:0/1548893229 shutdown_connections 2024-04-25T09:05:51.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.579+0000 7fc22da00640 1 --2- 172.21.15.173:0/1548893229 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc204066f60 0x7fc204069420 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.579+0000 7fc22da00640 1 --2- 172.21.15.173:0/1548893229 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc228145290 0x7fc22815b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.579+0000 7fc22da00640 1 --2- 172.21.15.173:0/1548893229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2280cc260 0x7fc228147e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.579+0000 7fc22da00640 1 --2- 172.21.15.173:0/1548893229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2280b3fe0 0x7fc22813df90 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.579+0000 7fc22da00640 1 -- 172.21.15.173:0/1548893229 >> 172.21.15.173:0/1548893229 conn(0x7fc22806ac90 msgr2=0x7fc2280cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.579+0000 7fc22da00640 1 -- 172.21.15.173:0/1548893229 shutdown_connections 2024-04-25T09:05:51.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.579+0000 7fc22da00640 1 -- 172.21.15.173:0/1548893229 wait complete. 2024-04-25T09:05:51.590 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:05:51.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.735+0000 7f9dc9200640 1 Processor -- start 2024-04-25T09:05:51.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.735+0000 7f9dc9200640 1 -- start start 2024-04-25T09:05:51.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.735+0000 7f9dc9200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9dc415ba20 0x7f9dc415be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.735+0000 7f9dc9200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9dc4070070 0x7f9dc40d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.735+0000 7f9dc9200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc415c460 con 0x7f9dc40b70f0 2024-04-25T09:05:51.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.735+0000 7f9dc9200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc415c740 con 0x7f9dc415ba20 2024-04-25T09:05:51.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.735+0000 7f9dc9200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc415ca20 con 0x7f9dc4070070 2024-04-25T09:05:51.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.735+0000 7f9dc1e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9dc415ba20 0x7f9dc415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.735+0000 7f9dc1e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9dc415ba20 0x7f9dc415be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41926/0 (socket says 172.21.15.173:41926) 2024-04-25T09:05:51.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.735+0000 7f9dc1e00640 1 -- 172.21.15.173:0/156144124 learned_addr learned my addr 172.21.15.173:0/156144124 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:51.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.735+0000 7f9dc1e00640 1 -- 172.21.15.173:0/156144124 >> v2:172.21.15.194:3300/0 conn(0x7f9dc4070070 msgr2=0x7f9dc40d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:51.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.735+0000 7f9dc1e00640 1 --2- 172.21.15.173:0/156144124 >> v2:172.21.15.194:3300/0 conn(0x7f9dc4070070 0x7f9dc40d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.735+0000 7f9dc1e00640 1 -- 172.21.15.173:0/156144124 >> v1:172.21.15.194:6789/0 conn(0x7f9dc40b70f0 legacy=0x7f9dc406f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:51.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.735+0000 7f9dc1e00640 1 -- 172.21.15.173:0/156144124 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc415cd00 con 0x7f9dc415ba20 2024-04-25T09:05:51.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.739+0000 7f9dc1e00640 1 --2- 172.21.15.173:0/156144124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dc415ba20 0x7f9dc415be00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9db4009870 tx=0x7f9db401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de133b4588e76885 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.739+0000 7f9dc0a00640 1 -- 172.21.15.173:0/156144124 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db40aa430 con 0x7f9dc415ba20 2024-04-25T09:05:51.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.739+0000 7f9dc0a00640 1 -- 172.21.15.173:0/156144124 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db40af070 con 0x7f9dc415ba20 2024-04-25T09:05:51.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.739+0000 7f9dc0a00640 1 -- 172.21.15.173:0/156144124 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db40aa7f0 con 0x7f9dc415ba20 2024-04-25T09:05:51.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.739+0000 7f9dc9200640 1 -- 172.21.15.173:0/156144124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dc415ba20 msgr2=0x7f9dc415be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.739+0000 7f9dc9200640 1 --2- 172.21.15.173:0/156144124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dc415ba20 0x7f9dc415be00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9db4009870 tx=0x7f9db401c4b0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.739+0000 7f9dc9200640 1 -- 172.21.15.173:0/156144124 shutdown_connections 2024-04-25T09:05:51.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.739+0000 7f9dc9200640 1 --2- 172.21.15.173:0/156144124 >> v2:172.21.15.194:3300/0 conn(0x7f9dc4070070 0x7f9dc40d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.739+0000 7f9dc9200640 1 --2- 172.21.15.173:0/156144124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dc415ba20 0x7f9dc415be00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.739+0000 7f9dc9200640 1 -- 172.21.15.173:0/156144124 >> 172.21.15.173:0/156144124 conn(0x7f9dc4061880 msgr2=0x7f9dc4061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.739+0000 7f9dc9200640 1 -- 172.21.15.173:0/156144124 shutdown_connections 2024-04-25T09:05:51.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.739+0000 7f9dc9200640 1 -- 172.21.15.173:0/156144124 wait complete. 2024-04-25T09:05:51.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc9200640 1 Processor -- start 2024-04-25T09:05:51.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc9200640 1 -- start start 2024-04-25T09:05:51.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc9200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dc4070070 0x7f9dc4152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc9200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dc40b70f0 0x7f9dc4166f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc9200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dc415ba20 0x7f9dc41fa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc9200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc415df20 con 0x7f9dc415ba20 2024-04-25T09:05:51.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc9200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc40d25e0 con 0x7f9dc4070070 2024-04-25T09:05:51.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc9200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc415e0a0 con 0x7f9dc40b70f0 2024-04-25T09:05:51.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc2800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dc415ba20 0x7f9dc41fa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc2800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dc415ba20 0x7f9dc41fa4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41930/0 (socket says 172.21.15.173:41930) 2024-04-25T09:05:51.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc2800640 1 -- 172.21.15.173:0/742717132 learned_addr learned my addr 172.21.15.173:0/742717132 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:51.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc1e00640 1 --2- 172.21.15.173:0/742717132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dc4070070 0x7f9dc4152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc1400640 1 --2- 172.21.15.173:0/742717132 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dc40b70f0 0x7f9dc4166f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc2800640 1 -- 172.21.15.173:0/742717132 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dc40b70f0 msgr2=0x7f9dc4166f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc2800640 1 --2- 172.21.15.173:0/742717132 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dc40b70f0 0x7f9dc4166f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc2800640 1 -- 172.21.15.173:0/742717132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dc4070070 msgr2=0x7f9dc4152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc2800640 1 --2- 172.21.15.173:0/742717132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dc4070070 0x7f9dc4152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc2800640 1 -- 172.21.15.173:0/742717132 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc41530e0 con 0x7f9dc415ba20 2024-04-25T09:05:51.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc2800640 1 --2- 172.21.15.173:0/742717132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dc415ba20 0x7f9dc41fa4e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00ba10 tx=0x7f9dbc00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dba000640 1 -- 172.21.15.173:0/742717132 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc019070 con 0x7f9dc415ba20 2024-04-25T09:05:51.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dba000640 1 -- 172.21.15.173:0/742717132 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc00cb60 con 0x7f9dc415ba20 2024-04-25T09:05:51.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc9200640 1 -- 172.21.15.173:0/742717132 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc40b4aa0 con 0x7f9dc415ba20 2024-04-25T09:05:51.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dba000640 1 -- 172.21.15.173:0/742717132 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc014440 con 0x7f9dc415ba20 2024-04-25T09:05:51.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc9200640 1 -- 172.21.15.173:0/742717132 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc406cee0 con 0x7f9dc415ba20 2024-04-25T09:05:51.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.743+0000 7f9dc9200640 1 -- 172.21.15.173:0/742717132 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc4073a40 con 0x7f9dc415ba20 2024-04-25T09:05:51.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.747+0000 7f9dba000640 1 -- 172.21.15.173:0/742717132 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9dbc01c070 con 0x7f9dc415ba20 2024-04-25T09:05:51.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.747+0000 7f9dba000640 1 --2- 172.21.15.173:0/742717132 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9da4066f60 0x7f9da4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.747+0000 7f9dba000640 1 -- 172.21.15.173:0/742717132 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f9dbc084b40 con 0x7f9dc415ba20 2024-04-25T09:05:51.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.747+0000 7f9dc1e00640 1 --2- 172.21.15.173:0/742717132 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9da4066f60 0x7f9da4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.747+0000 7f9dc1e00640 1 --2- 172.21.15.173:0/742717132 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9da4066f60 0x7f9da4069420 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9db40ae000 tx=0x7f9db40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.751+0000 7f9dba000640 1 -- 172.21.15.173:0/742717132 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9dbc055620 con 0x7f9dc415ba20 2024-04-25T09:05:51.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.907+0000 7f9dc9200640 1 -- 172.21.15.173:0/742717132 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9dc40d0490 con 0x7f9dc415ba20 2024-04-25T09:05:51.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.907+0000 7f9dba000640 1 -- 172.21.15.173:0/742717132 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v52) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9dbc0596c0 con 0x7f9dc415ba20 2024-04-25T09:05:51.898 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:51.898 INFO:teuthology.orchestra.run.smithi173.stdout:[ 2024-04-25T09:05:51.898 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:05:51.898 INFO:teuthology.orchestra.run.smithi173.stdout: "poolnum": 1, 2024-04-25T09:05:51.898 INFO:teuthology.orchestra.run.smithi173.stdout: "poolname": ".mgr" 2024-04-25T09:05:51.898 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:05:51.898 INFO:teuthology.orchestra.run.smithi173.stdout:] 2024-04-25T09:05:51.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.907+0000 7f9dc9200640 1 -- 172.21.15.173:0/742717132 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9da4066f60 msgr2=0x7f9da4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.907+0000 7f9dc9200640 1 --2- 172.21.15.173:0/742717132 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9da4066f60 0x7f9da4069420 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9db40ae000 tx=0x7f9db40a7000 comp rx=0 tx=0).stop 2024-04-25T09:05:51.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.907+0000 7f9dc9200640 1 -- 172.21.15.173:0/742717132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dc415ba20 msgr2=0x7f9dc41fa4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.907+0000 7f9dc9200640 1 --2- 172.21.15.173:0/742717132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dc415ba20 0x7f9dc41fa4e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00ba10 tx=0x7f9dbc00bed0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.907+0000 7f9dc9200640 1 -- 172.21.15.173:0/742717132 shutdown_connections 2024-04-25T09:05:51.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.907+0000 7f9dc9200640 1 --2- 172.21.15.173:0/742717132 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9da4066f60 0x7f9da4069420 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.907+0000 7f9dc9200640 1 --2- 172.21.15.173:0/742717132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dc415ba20 0x7f9dc41fa4e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.907+0000 7f9dc9200640 1 --2- 172.21.15.173:0/742717132 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dc40b70f0 0x7f9dc4166f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.907+0000 7f9dc9200640 1 --2- 172.21.15.173:0/742717132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dc4070070 0x7f9dc4152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.907+0000 7f9dc9200640 1 -- 172.21.15.173:0/742717132 >> 172.21.15.173:0/742717132 conn(0x7f9dc4061880 msgr2=0x7f9dc40cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.907+0000 7f9dc9200640 1 -- 172.21.15.173:0/742717132 shutdown_connections 2024-04-25T09:05:51.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:51.907+0000 7f9dc9200640 1 -- 172.21.15.173:0/742717132 wait complete. 2024-04-25T09:05:51.919 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:05:51.919 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:05:52.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f2719a00640 1 Processor -- start 2024-04-25T09:05:52.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f2719a00640 1 -- start start 2024-04-25T09:05:52.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f2719a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f271406e1c0 0x7f271406bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f2719a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f271406c410 0x7f27140aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f2719a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27140ad3f0 0x7f271406e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f2719a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27140b3170 con 0x7f271406c410 2024-04-25T09:05:52.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f2719a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271415e070 con 0x7f271406e1c0 2024-04-25T09:05:52.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f2719a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271406ae30 con 0x7f27140ad3f0 2024-04-25T09:05:52.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f270a000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f271406c410 0x7f27140aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f270a000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f271406c410 0x7f27140aceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41942/0 (socket says 172.21.15.173:41942) 2024-04-25T09:05:52.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f270a000640 1 -- 172.21.15.173:0/3439566731 learned_addr learned my addr 172.21.15.173:0/3439566731 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:52.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f2712a00640 1 --2- 172.21.15.173:0/3439566731 >> v2:172.21.15.194:3300/0 conn(0x7f271406e1c0 0x7f271406bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f2713400640 1 --2- 172.21.15.173:0/3439566731 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27140ad3f0 0x7f271406e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f270a000640 1 -- 172.21.15.173:0/3439566731 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27140ad3f0 msgr2=0x7f271406e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:52.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f270a000640 1 --2- 172.21.15.173:0/3439566731 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27140ad3f0 0x7f271406e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f270a000640 1 -- 172.21.15.173:0/3439566731 >> v2:172.21.15.194:3300/0 conn(0x7f271406e1c0 msgr2=0x7f271406bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:52.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f270a000640 1 --2- 172.21.15.173:0/3439566731 >> v2:172.21.15.194:3300/0 conn(0x7f271406e1c0 0x7f271406bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f270a000640 1 -- 172.21.15.173:0/3439566731 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271406b110 con 0x7f271406c410 2024-04-25T09:05:52.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.067+0000 7f2712a00640 1 --2- 172.21.15.173:0/3439566731 >> v2:172.21.15.194:3300/0 conn(0x7f271406e1c0 0x7f271406bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:52.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.071+0000 7f270a000640 1 --2- 172.21.15.173:0/3439566731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f271406c410 0x7f27140aceb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2714071b60 tx=0x7f26fc01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f000aaadb78e778 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:52.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.071+0000 7f2712000640 1 -- 172.21.15.173:0/3439566731 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc0b5070 con 0x7f271406c410 2024-04-25T09:05:52.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.071+0000 7f2712000640 1 -- 172.21.15.173:0/3439566731 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc0a89d0 con 0x7f271406c410 2024-04-25T09:05:52.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.071+0000 7f2712000640 1 -- 172.21.15.173:0/3439566731 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc0a8da0 con 0x7f271406c410 2024-04-25T09:05:52.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.071+0000 7f2719a00640 1 -- 172.21.15.173:0/3439566731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f271406c410 msgr2=0x7f27140aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.071+0000 7f2719a00640 1 --2- 172.21.15.173:0/3439566731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f271406c410 0x7f27140aceb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2714071b60 tx=0x7f26fc01ed10 comp rx=0 tx=0).stop 2024-04-25T09:05:52.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.071+0000 7f2719a00640 1 -- 172.21.15.173:0/3439566731 shutdown_connections 2024-04-25T09:05:52.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.071+0000 7f2719a00640 1 --2- 172.21.15.173:0/3439566731 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27140ad3f0 0x7f271406e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.071+0000 7f2719a00640 1 --2- 172.21.15.173:0/3439566731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f271406c410 0x7f27140aceb0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.071+0000 7f2719a00640 1 --2- 172.21.15.173:0/3439566731 >> v2:172.21.15.194:3300/0 conn(0x7f271406e1c0 0x7f271406bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.071+0000 7f2719a00640 1 -- 172.21.15.173:0/3439566731 >> 172.21.15.173:0/3439566731 conn(0x7f27140cfed0 msgr2=0x7f27140d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:52.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.071+0000 7f2719a00640 1 -- 172.21.15.173:0/3439566731 shutdown_connections 2024-04-25T09:05:52.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.071+0000 7f2719a00640 1 -- 172.21.15.173:0/3439566731 wait complete. 2024-04-25T09:05:52.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f2719a00640 1 Processor -- start 2024-04-25T09:05:52.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f2719a00640 1 -- start start 2024-04-25T09:05:52.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f2719a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f271406c410 0x7f27140c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f2719a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f271406e1c0 0x7f2714154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f2719a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27140ad3f0 0x7f2714157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f2719a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271406b9b0 con 0x7f271406e1c0 2024-04-25T09:05:52.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f2719a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271406b6d0 con 0x7f27140ad3f0 2024-04-25T09:05:52.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f2719a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27140ad840 con 0x7f271406c410 2024-04-25T09:05:52.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f270a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f271406e1c0 0x7f2714154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f270a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f271406e1c0 0x7f2714154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41952/0 (socket says 172.21.15.173:41952) 2024-04-25T09:05:52.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f270a000640 1 -- 172.21.15.173:0/3649293968 learned_addr learned my addr 172.21.15.173:0/3649293968 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:52.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f2713400640 1 --2- 172.21.15.173:0/3649293968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27140ad3f0 0x7f2714157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f2712a00640 1 --2- 172.21.15.173:0/3649293968 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f271406c410 0x7f27140c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f270a000640 1 -- 172.21.15.173:0/3649293968 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f271406c410 msgr2=0x7f27140c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f270a000640 1 --2- 172.21.15.173:0/3649293968 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f271406c410 0x7f27140c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f270a000640 1 -- 172.21.15.173:0/3649293968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27140ad3f0 msgr2=0x7f2714157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f270a000640 1 --2- 172.21.15.173:0/3649293968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27140ad3f0 0x7f2714157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f270a000640 1 -- 172.21.15.173:0/3649293968 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27141f3d30 con 0x7f271406e1c0 2024-04-25T09:05:52.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f270a000640 1 --2- 172.21.15.173:0/3649293968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f271406e1c0 0x7f2714154140 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f26fc01d3c0 tx=0x7f26fc01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:52.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f270b400640 1 -- 172.21.15.173:0/3649293968 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc0b5070 con 0x7f271406e1c0 2024-04-25T09:05:52.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f270b400640 1 -- 172.21.15.173:0/3649293968 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc0b0a70 con 0x7f271406e1c0 2024-04-25T09:05:52.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f2719a00640 1 -- 172.21.15.173:0/3649293968 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27141f4010 con 0x7f271406e1c0 2024-04-25T09:05:52.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f270b400640 1 -- 172.21.15.173:0/3649293968 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc0b0e60 con 0x7f271406e1c0 2024-04-25T09:05:52.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f2719a00640 1 -- 172.21.15.173:0/3649293968 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27141f45d0 con 0x7f271406e1c0 2024-04-25T09:05:52.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.075+0000 7f2719a00640 1 -- 172.21.15.173:0/3649293968 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2714073ab0 con 0x7f271406e1c0 2024-04-25T09:05:52.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.079+0000 7f270b400640 1 -- 172.21.15.173:0/3649293968 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f26fc0c2060 con 0x7f271406e1c0 2024-04-25T09:05:52.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.079+0000 7f270b400640 1 --2- 172.21.15.173:0/3649293968 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f26f0066f60 0x7f26f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.079+0000 7f270b400640 1 -- 172.21.15.173:0/3649293968 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f26fc122060 con 0x7f271406e1c0 2024-04-25T09:05:52.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.079+0000 7f2712a00640 1 --2- 172.21.15.173:0/3649293968 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f26f0066f60 0x7f26f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.079+0000 7f2712a00640 1 --2- 172.21.15.173:0/3649293968 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f26f0066f60 0x7f26f0069420 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f27140c68c0 tx=0x7f2704008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:52.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.083+0000 7f270b400640 1 -- 172.21.15.173:0/3649293968 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f26fc018870 con 0x7f271406e1c0 2024-04-25T09:05:52.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:52.239+0000 7f2719a00640 1 -- 172.21.15.173:0/3649293968 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f27140c52d0 con 0x7f271406e1c0 2024-04-25T09:05:53.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.179+0000 7f270b400640 1 -- 172.21.15.173:0/3649293968 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7f26fc0f3230 con 0x7f271406e1c0 2024-04-25T09:05:53.170 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' created 2024-04-25T09:05:53.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.179+0000 7f2719a00640 1 -- 172.21.15.173:0/3649293968 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f26f0066f60 msgr2=0x7f26f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.179+0000 7f2719a00640 1 --2- 172.21.15.173:0/3649293968 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f26f0066f60 0x7f26f0069420 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f27140c68c0 tx=0x7f2704008040 comp rx=0 tx=0).stop 2024-04-25T09:05:53.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.179+0000 7f2719a00640 1 -- 172.21.15.173:0/3649293968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f271406e1c0 msgr2=0x7f2714154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.179+0000 7f2719a00640 1 --2- 172.21.15.173:0/3649293968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f271406e1c0 0x7f2714154140 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f26fc01d3c0 tx=0x7f26fc01bab0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.183+0000 7f2719a00640 1 -- 172.21.15.173:0/3649293968 shutdown_connections 2024-04-25T09:05:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.183+0000 7f2719a00640 1 --2- 172.21.15.173:0/3649293968 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f26f0066f60 0x7f26f0069420 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.183+0000 7f2719a00640 1 --2- 172.21.15.173:0/3649293968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27140ad3f0 0x7f2714157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.183+0000 7f2719a00640 1 --2- 172.21.15.173:0/3649293968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f271406e1c0 0x7f2714154140 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.183+0000 7f2719a00640 1 --2- 172.21.15.173:0/3649293968 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f271406c410 0x7f27140c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.183+0000 7f2719a00640 1 -- 172.21.15.173:0/3649293968 >> 172.21.15.173:0/3649293968 conn(0x7f27140cfed0 msgr2=0x7f27140aeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.183+0000 7f2719a00640 1 -- 172.21.15.173:0/3649293968 shutdown_connections 2024-04-25T09:05:53.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.183+0000 7f2719a00640 1 -- 172.21.15.173:0/3649293968 wait complete. 2024-04-25T09:05:53.202 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:05:53.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.355+0000 7ff093a00640 1 Processor -- start 2024-04-25T09:05:53.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.355+0000 7ff093a00640 1 -- start start 2024-04-25T09:05:53.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.359+0000 7ff093a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff08c0b3fe0 0x7ff08c0b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.359+0000 7ff093a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff08c0cc260 0x7ff08c0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.359+0000 7ff093a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff08c06d4b0 con 0x7ff08c145290 2024-04-25T09:05:53.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.359+0000 7ff093a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff08c06d790 con 0x7ff08c0cc260 2024-04-25T09:05:53.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.359+0000 7ff093a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c06da70 con 0x7ff08c0b3fe0 2024-04-25T09:05:53.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.359+0000 7ff091a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff08c0cc260 0x7ff08c0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.359+0000 7ff091000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ff08c145290 0x7ff08c15c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39570/0 (socket says 172.21.15.173:39570) 2024-04-25T09:05:53.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.359+0000 7ff091000640 1 -- 172.21.15.173:0/734393043 learned_addr learned my addr 172.21.15.173:0/734393043 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:53.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.359+0000 7ff091a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff08c0cc260 0x7ff08c0cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50268/0 (socket says 172.21.15.173:50268) 2024-04-25T09:05:53.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.359+0000 7ff091a00640 1 -- 172.21.15.173:0/734393043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff08c0b3fe0 msgr2=0x7ff08c0b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:53.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.359+0000 7ff091a00640 1 --2- 172.21.15.173:0/734393043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff08c0b3fe0 0x7ff08c0b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.359+0000 7ff091a00640 1 -- 172.21.15.173:0/734393043 >> v1:172.21.15.173:6789/0 conn(0x7ff08c145290 legacy=0x7ff08c15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.359+0000 7ff091a00640 1 -- 172.21.15.173:0/734393043 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c06dd50 con 0x7ff08c0cc260 2024-04-25T09:05:53.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.359+0000 7ff08b400640 1 -- 172.21.15.173:0/734393043 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855596365 0 0) 0x7ff08c06d4b0 con 0x7ff08c145290 2024-04-25T09:05:53.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff091a00640 1 --2- 172.21.15.173:0/734393043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff08c0cc260 0x7ff08c0cc6b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff0840097c0 tx=0x7ff08401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1788d717d3dc122 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff08b400640 1 -- 172.21.15.173:0/734393043 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0840b0070 con 0x7ff08c0cc260 2024-04-25T09:05:53.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff08b400640 1 -- 172.21.15.173:0/734393043 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0840ab600 con 0x7ff08c0cc260 2024-04-25T09:05:53.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff08b400640 1 -- 172.21.15.173:0/734393043 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0840ab9d0 con 0x7ff08c0cc260 2024-04-25T09:05:53.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff093a00640 1 -- 172.21.15.173:0/734393043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff08c0cc260 msgr2=0x7ff08c0cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff093a00640 1 --2- 172.21.15.173:0/734393043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff08c0cc260 0x7ff08c0cc6b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff0840097c0 tx=0x7ff08401c380 comp rx=0 tx=0).stop 2024-04-25T09:05:53.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff093a00640 1 -- 172.21.15.173:0/734393043 shutdown_connections 2024-04-25T09:05:53.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff093a00640 1 --2- 172.21.15.173:0/734393043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff08c0cc260 0x7ff08c0cc6b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff093a00640 1 --2- 172.21.15.173:0/734393043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff08c0b3fe0 0x7ff08c0b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff093a00640 1 -- 172.21.15.173:0/734393043 >> 172.21.15.173:0/734393043 conn(0x7ff08c06ac90 msgr2=0x7ff08c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:53.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff093a00640 1 -- 172.21.15.173:0/734393043 shutdown_connections 2024-04-25T09:05:53.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff093a00640 1 -- 172.21.15.173:0/734393043 wait complete. 2024-04-25T09:05:53.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff093a00640 1 Processor -- start 2024-04-25T09:05:53.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff093a00640 1 -- start start 2024-04-25T09:05:53.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff093a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff08c0b3fe0 0x7ff08c15ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff093a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff08c0cc260 0x7ff08c0a8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff093a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff08c145290 0x7ff08c0ab100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff093a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c06eee0 con 0x7ff08c0b3fe0 2024-04-25T09:05:53.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff093a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c06ed60 con 0x7ff08c0cc260 2024-04-25T09:05:53.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff093a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c06f060 con 0x7ff08c145290 2024-04-25T09:05:53.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff091000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff08c0b3fe0 0x7ff08c15ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff091000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff08c0b3fe0 0x7ff08c15ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50284/0 (socket says 172.21.15.173:50284) 2024-04-25T09:05:53.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.363+0000 7ff091000640 1 -- 172.21.15.173:0/730518017 learned_addr learned my addr 172.21.15.173:0/730518017 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:53.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.367+0000 7ff091a00640 1 --2- 172.21.15.173:0/730518017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff08c145290 0x7ff08c0ab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.367+0000 7ff08be00640 1 --2- 172.21.15.173:0/730518017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff08c0cc260 0x7ff08c0a8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.367+0000 7ff091000640 1 -- 172.21.15.173:0/730518017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff08c145290 msgr2=0x7ff08c0ab100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.367+0000 7ff091000640 1 --2- 172.21.15.173:0/730518017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff08c145290 0x7ff08c0ab100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.367+0000 7ff091000640 1 -- 172.21.15.173:0/730518017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff08c0cc260 msgr2=0x7ff08c0a8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.367+0000 7ff091000640 1 --2- 172.21.15.173:0/730518017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff08c0cc260 0x7ff08c0a8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.367+0000 7ff091000640 1 -- 172.21.15.173:0/730518017 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c0adda0 con 0x7ff08c0b3fe0 2024-04-25T09:05:53.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.367+0000 7ff091000640 1 --2- 172.21.15.173:0/730518017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff08c0b3fe0 0x7ff08c15ac30 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff07c001570 tx=0x7ff07c00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.367+0000 7ff088c00640 1 -- 172.21.15.173:0/730518017 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c018070 con 0x7ff08c0b3fe0 2024-04-25T09:05:53.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.367+0000 7ff088c00640 1 -- 172.21.15.173:0/730518017 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07c00a640 con 0x7ff08c0b3fe0 2024-04-25T09:05:53.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.367+0000 7ff093a00640 1 -- 172.21.15.173:0/730518017 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08c0ae040 con 0x7ff08c0b3fe0 2024-04-25T09:05:53.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.367+0000 7ff088c00640 1 -- 172.21.15.173:0/730518017 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c00aa30 con 0x7ff08c0b3fe0 2024-04-25T09:05:53.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.367+0000 7ff093a00640 1 -- 172.21.15.173:0/730518017 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08c1424e0 con 0x7ff08c0b3fe0 2024-04-25T09:05:53.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.367+0000 7ff093a00640 1 -- 172.21.15.173:0/730518017 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08c073ab0 con 0x7ff08c0b3fe0 2024-04-25T09:05:53.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.367+0000 7ff088c00640 1 -- 172.21.15.173:0/730518017 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff07c01b070 con 0x7ff08c0b3fe0 2024-04-25T09:05:53.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.371+0000 7ff088c00640 1 --2- 172.21.15.173:0/730518017 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff06c066f60 0x7ff06c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.371+0000 7ff088c00640 1 -- 172.21.15.173:0/730518017 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5619+0+0 (secure 0 0 0) 0x7ff07c084650 con 0x7ff08c0b3fe0 2024-04-25T09:05:53.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.371+0000 7ff08be00640 1 --2- 172.21.15.173:0/730518017 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff06c066f60 0x7ff06c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.371+0000 7ff08be00640 1 --2- 172.21.15.173:0/730518017 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff06c066f60 0x7ff06c069420 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0aab40 tx=0x7ff078006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.375+0000 7ff088c00640 1 -- 172.21.15.173:0/730518017 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff07c055060 con 0x7ff08c0b3fe0 2024-04-25T09:05:53.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:53.527+0000 7ff093a00640 1 -- 172.21.15.173:0/730518017 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff08c15d530 con 0x7ff08c0b3fe0 2024-04-25T09:05:54.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.183+0000 7ff088c00640 1 -- 172.21.15.173:0/730518017 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v54) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff07c059100 con 0x7ff08c0b3fe0 2024-04-25T09:05:54.177 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' created 2024-04-25T09:05:54.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.187+0000 7ff093a00640 1 -- 172.21.15.173:0/730518017 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff06c066f60 msgr2=0x7ff06c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.187+0000 7ff093a00640 1 --2- 172.21.15.173:0/730518017 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff06c066f60 0x7ff06c069420 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0aab40 tx=0x7ff078006f90 comp rx=0 tx=0).stop 2024-04-25T09:05:54.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.187+0000 7ff093a00640 1 -- 172.21.15.173:0/730518017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff08c0b3fe0 msgr2=0x7ff08c15ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.187+0000 7ff093a00640 1 --2- 172.21.15.173:0/730518017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff08c0b3fe0 0x7ff08c15ac30 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff07c001570 tx=0x7ff07c00cd20 comp rx=0 tx=0).stop 2024-04-25T09:05:54.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.187+0000 7ff093a00640 1 -- 172.21.15.173:0/730518017 shutdown_connections 2024-04-25T09:05:54.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.187+0000 7ff093a00640 1 --2- 172.21.15.173:0/730518017 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff06c066f60 0x7ff06c069420 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.187+0000 7ff093a00640 1 --2- 172.21.15.173:0/730518017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff08c145290 0x7ff08c0ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.187+0000 7ff093a00640 1 --2- 172.21.15.173:0/730518017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff08c0cc260 0x7ff08c0a8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.187+0000 7ff093a00640 1 --2- 172.21.15.173:0/730518017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff08c0b3fe0 0x7ff08c15ac30 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.187+0000 7ff093a00640 1 -- 172.21.15.173:0/730518017 >> 172.21.15.173:0/730518017 conn(0x7ff08c06ac90 msgr2=0x7ff08c140f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.187+0000 7ff093a00640 1 -- 172.21.15.173:0/730518017 shutdown_connections 2024-04-25T09:05:54.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.187+0000 7ff093a00640 1 -- 172.21.15.173:0/730518017 wait complete. 2024-04-25T09:05:54.222 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:05:54.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.371+0000 7f4d38c00640 1 Processor -- start 2024-04-25T09:05:54.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.371+0000 7f4d38c00640 1 -- start start 2024-04-25T09:05:54.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.371+0000 7f4d38c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4d3406e1c0 0x7f4d3406bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.371+0000 7f4d38c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4d3406c410 0x7f4d340aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.371+0000 7f4d38c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3406ae30 con 0x7f4d340ad3f0 2024-04-25T09:05:54.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.371+0000 7f4d38c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d340b3170 con 0x7f4d3406c410 2024-04-25T09:05:54.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.371+0000 7f4d38c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3415e070 con 0x7f4d3406e1c0 2024-04-25T09:05:54.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.375+0000 7f4d29400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4d3406c410 0x7f4d340aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.375+0000 7f4d32800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4d340ad3f0 0x7f4d3406e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39580/0 (socket says 172.21.15.173:39580) 2024-04-25T09:05:54.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.375+0000 7f4d32800640 1 -- 172.21.15.173:0/2852284347 learned_addr learned my addr 172.21.15.173:0/2852284347 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:54.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.375+0000 7f4d31e00640 1 --2- 172.21.15.173:0/2852284347 >> v2:172.21.15.194:3300/0 conn(0x7f4d3406e1c0 0x7f4d3406bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.375+0000 7f4d29400640 1 -- 172.21.15.173:0/2852284347 >> v2:172.21.15.194:3300/0 conn(0x7f4d3406e1c0 msgr2=0x7f4d3406bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.375+0000 7f4d29400640 1 --2- 172.21.15.173:0/2852284347 >> v2:172.21.15.194:3300/0 conn(0x7f4d3406e1c0 0x7f4d3406bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.375+0000 7f4d29400640 1 -- 172.21.15.173:0/2852284347 >> v1:172.21.15.173:6789/0 conn(0x7f4d340ad3f0 legacy=0x7f4d3406e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.375+0000 7f4d31400640 1 -- 172.21.15.173:0/2852284347 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474316874 0 0) 0x7f4d3406ae30 con 0x7f4d340ad3f0 2024-04-25T09:05:54.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.375+0000 7f4d29400640 1 -- 172.21.15.173:0/2852284347 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3406b110 con 0x7f4d3406c410 2024-04-25T09:05:54.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.375+0000 7f4d29400640 1 --2- 172.21.15.173:0/2852284347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d3406c410 0x7f4d340aceb0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4d34071b60 tx=0x7f4d1c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93fe8bb409403e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.375+0000 7f4d31400640 1 -- 172.21.15.173:0/2852284347 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0ab430 con 0x7f4d3406c410 2024-04-25T09:05:54.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.375+0000 7f4d31400640 1 -- 172.21.15.173:0/2852284347 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c0b0070 con 0x7f4d3406c410 2024-04-25T09:05:54.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.375+0000 7f4d31400640 1 -- 172.21.15.173:0/2852284347 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0ab7f0 con 0x7f4d3406c410 2024-04-25T09:05:54.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d38c00640 1 -- 172.21.15.173:0/2852284347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d3406c410 msgr2=0x7f4d340aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d38c00640 1 --2- 172.21.15.173:0/2852284347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d3406c410 0x7f4d340aceb0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4d34071b60 tx=0x7f4d1c01c430 comp rx=0 tx=0).stop 2024-04-25T09:05:54.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d38c00640 1 -- 172.21.15.173:0/2852284347 shutdown_connections 2024-04-25T09:05:54.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d38c00640 1 --2- 172.21.15.173:0/2852284347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d3406c410 0x7f4d340aceb0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d38c00640 1 --2- 172.21.15.173:0/2852284347 >> v2:172.21.15.194:3300/0 conn(0x7f4d3406e1c0 0x7f4d3406bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d38c00640 1 -- 172.21.15.173:0/2852284347 >> 172.21.15.173:0/2852284347 conn(0x7f4d340cfed0 msgr2=0x7f4d340d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d38c00640 1 -- 172.21.15.173:0/2852284347 shutdown_connections 2024-04-25T09:05:54.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d38c00640 1 -- 172.21.15.173:0/2852284347 wait complete. 2024-04-25T09:05:54.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d38c00640 1 Processor -- start 2024-04-25T09:05:54.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d38c00640 1 -- start start 2024-04-25T09:05:54.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d38c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d3406c410 0x7f4d34139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d38c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d3406e1c0 0x7f4d34136bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d38c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d340ad3f0 0x7f4d341511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d38c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d340ad800 con 0x7f4d3406e1c0 2024-04-25T09:05:54.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d38c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3406f4c0 con 0x7f4d340ad3f0 2024-04-25T09:05:54.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d38c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3413a530 con 0x7f4d3406c410 2024-04-25T09:05:54.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d29400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d3406e1c0 0x7f4d34136bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d29400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d3406e1c0 0x7f4d34136bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50288/0 (socket says 172.21.15.173:50288) 2024-04-25T09:05:54.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d29400640 1 -- 172.21.15.173:0/1589071305 learned_addr learned my addr 172.21.15.173:0/1589071305 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:54.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d31e00640 1 --2- 172.21.15.173:0/1589071305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d3406c410 0x7f4d34139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d32800640 1 --2- 172.21.15.173:0/1589071305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d340ad3f0 0x7f4d341511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d29400640 1 -- 172.21.15.173:0/1589071305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d3406c410 msgr2=0x7f4d34139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d29400640 1 --2- 172.21.15.173:0/1589071305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d3406c410 0x7f4d34139ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d29400640 1 -- 172.21.15.173:0/1589071305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d340ad3f0 msgr2=0x7f4d341511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d29400640 1 --2- 172.21.15.173:0/1589071305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d340ad3f0 0x7f4d341511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d29400640 1 -- 172.21.15.173:0/1589071305 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3414bc00 con 0x7f4d3406e1c0 2024-04-25T09:05:54.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d31e00640 1 --2- 172.21.15.173:0/1589071305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d3406c410 0x7f4d34139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:54.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.379+0000 7f4d32800640 1 --2- 172.21.15.173:0/1589071305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d340ad3f0 0x7f4d341511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:54.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.383+0000 7f4d29400640 1 --2- 172.21.15.173:0/1589071305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d3406e1c0 0x7f4d34136bd0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0ad040 tx=0x7f4d1c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.383+0000 7f4d2aa00640 1 -- 172.21.15.173:0/1589071305 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c004220 con 0x7f4d3406e1c0 2024-04-25T09:05:54.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.383+0000 7f4d2aa00640 1 -- 172.21.15.173:0/1589071305 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c0043c0 con 0x7f4d3406e1c0 2024-04-25T09:05:54.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.383+0000 7f4d2aa00640 1 -- 172.21.15.173:0/1589071305 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c003820 con 0x7f4d3406e1c0 2024-04-25T09:05:54.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.383+0000 7f4d38c00640 1 -- 172.21.15.173:0/1589071305 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3414bee0 con 0x7f4d3406e1c0 2024-04-25T09:05:54.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.383+0000 7f4d38c00640 1 -- 172.21.15.173:0/1589071305 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3414c4a0 con 0x7f4d3406e1c0 2024-04-25T09:05:54.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.383+0000 7f4d38c00640 1 -- 172.21.15.173:0/1589071305 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d34073ab0 con 0x7f4d3406e1c0 2024-04-25T09:05:54.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.383+0000 7f4d2aa00640 1 -- 172.21.15.173:0/1589071305 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4d1c0039c0 con 0x7f4d3406e1c0 2024-04-25T09:05:54.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.383+0000 7f4d2aa00640 1 --2- 172.21.15.173:0/1589071305 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4d10066f60 0x7f4d10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.383+0000 7f4d2aa00640 1 -- 172.21.15.173:0/1589071305 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f4d1c0a8020 con 0x7f4d3406e1c0 2024-04-25T09:05:54.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.383+0000 7f4d31e00640 1 --2- 172.21.15.173:0/1589071305 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4d10066f60 0x7f4d10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.387+0000 7f4d31e00640 1 --2- 172.21.15.173:0/1589071305 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4d10066f60 0x7f4d10069420 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4d3415d300 tx=0x7f4d24008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.391+0000 7f4d2aa00640 1 -- 172.21.15.173:0/1589071305 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4d1c0c4030 con 0x7f4d3406e1c0 2024-04-25T09:05:54.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:54.575+0000 7f4d38c00640 1 -- 172.21.15.173:0/1589071305 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4d340cf150 con 0x7f4d3406e1c0 2024-04-25T09:05:55.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.203+0000 7f4d2aa00640 1 -- 172.21.15.173:0/1589071305 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v23) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4d1c016050 con 0x7f4d3406e1c0 2024-04-25T09:05:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:new fs with metadata pool 7 and data pool 8 2024-04-25T09:05:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.223+0000 7f4d38c00640 1 -- 172.21.15.173:0/1589071305 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4d10066f60 msgr2=0x7f4d10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.223+0000 7f4d38c00640 1 --2- 172.21.15.173:0/1589071305 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4d10066f60 0x7f4d10069420 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4d3415d300 tx=0x7f4d24008040 comp rx=0 tx=0).stop 2024-04-25T09:05:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.223+0000 7f4d38c00640 1 -- 172.21.15.173:0/1589071305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d3406e1c0 msgr2=0x7f4d34136bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.223+0000 7f4d38c00640 1 --2- 172.21.15.173:0/1589071305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d3406e1c0 0x7f4d34136bd0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0ad040 tx=0x7f4d1c01ac70 comp rx=0 tx=0).stop 2024-04-25T09:05:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.223+0000 7f4d38c00640 1 -- 172.21.15.173:0/1589071305 shutdown_connections 2024-04-25T09:05:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.223+0000 7f4d38c00640 1 --2- 172.21.15.173:0/1589071305 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4d10066f60 0x7f4d10069420 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.223+0000 7f4d38c00640 1 --2- 172.21.15.173:0/1589071305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d340ad3f0 0x7f4d341511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.223+0000 7f4d38c00640 1 --2- 172.21.15.173:0/1589071305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d3406e1c0 0x7f4d34136bd0 secure :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0ad040 tx=0x7f4d1c01ac70 comp rx=0 tx=0).stop 2024-04-25T09:05:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.223+0000 7f4d38c00640 1 --2- 172.21.15.173:0/1589071305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d3406c410 0x7f4d34139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.223+0000 7f4d38c00640 1 -- 172.21.15.173:0/1589071305 >> 172.21.15.173:0/1589071305 conn(0x7f4d340cfed0 msgr2=0x7f4d34153330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:55.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.223+0000 7f4d38c00640 1 -- 172.21.15.173:0/1589071305 shutdown_connections 2024-04-25T09:05:55.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.223+0000 7f4d38c00640 1 -- 172.21.15.173:0/1589071305 wait complete. 2024-04-25T09:05:55.244 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:55.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.387+0000 7fafd6e00640 1 Processor -- start 2024-04-25T09:05:55.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.387+0000 7fafd6e00640 1 -- start start 2024-04-25T09:05:55.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.391+0000 7fafd6e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fafd0144240 0x7fafd00cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:55.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.391+0000 7fafd6e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd00ce080 con 0x7fafd00717b0 2024-04-25T09:05:55.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.391+0000 7fafd6e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd015f3d0 con 0x7fafd01449b0 2024-04-25T09:05:55.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.391+0000 7fafd6e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd015f6b0 con 0x7fafd0144240 2024-04-25T09:05:55.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.391+0000 7fafd5a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fafd0144240 0x7fafd00cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:55.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.391+0000 7fafd6400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fafd00717b0 0x7fafd006d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39592/0 (socket says 172.21.15.173:39592) 2024-04-25T09:05:55.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.391+0000 7fafd6400640 1 -- 172.21.15.173:0/67832356 learned_addr learned my addr 172.21.15.173:0/67832356 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:55.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.391+0000 7fafd5a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fafd0144240 0x7fafd00cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50300/0 (socket says 172.21.15.173:50300) 2024-04-25T09:05:55.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.391+0000 7fafd5a00640 1 -- 172.21.15.173:0/67832356 >> v1:172.21.15.194:6789/0 conn(0x7fafd01449b0 legacy=0x7fafd00710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:55.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.391+0000 7fafd5a00640 1 -- 172.21.15.173:0/67832356 >> v1:172.21.15.173:6789/0 conn(0x7fafd00717b0 legacy=0x7fafd006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.391+0000 7fafd5a00640 1 -- 172.21.15.173:0/67832356 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd015f990 con 0x7fafd0144240 2024-04-25T09:05:55.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.391+0000 7fafcfe00640 1 -- 172.21.15.173:0/67832356 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 860191624 0 0) 0x7fafd00ce080 con 0x7fafd00717b0 2024-04-25T09:05:55.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.395+0000 7fafd5a00640 1 --2- 172.21.15.173:0/67832356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd0144240 0x7fafd00cdb40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fafc40097c0 tx=0x7fafc401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0584795863da8f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:55.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.395+0000 7fafcfe00640 1 -- 172.21.15.173:0/67832356 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc40ab430 con 0x7fafd0144240 2024-04-25T09:05:55.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.395+0000 7fafcfe00640 1 -- 172.21.15.173:0/67832356 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc40b0070 con 0x7fafd0144240 2024-04-25T09:05:55.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.395+0000 7fafcfe00640 1 -- 172.21.15.173:0/67832356 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc40ab7f0 con 0x7fafd0144240 2024-04-25T09:05:55.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.395+0000 7fafd6e00640 1 -- 172.21.15.173:0/67832356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd0144240 msgr2=0x7fafd00cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.395+0000 7fafd6e00640 1 --2- 172.21.15.173:0/67832356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd0144240 0x7fafd00cdb40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fafc40097c0 tx=0x7fafc401c430 comp rx=0 tx=0).stop 2024-04-25T09:05:55.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.395+0000 7fafd6e00640 1 -- 172.21.15.173:0/67832356 shutdown_connections 2024-04-25T09:05:55.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.395+0000 7fafd6e00640 1 --2- 172.21.15.173:0/67832356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd0144240 0x7fafd00cdb40 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.395+0000 7fafd6e00640 1 -- 172.21.15.173:0/67832356 >> 172.21.15.173:0/67832356 conn(0x7fafd006ac90 msgr2=0x7fafd006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:55.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.395+0000 7fafd6e00640 1 -- 172.21.15.173:0/67832356 shutdown_connections 2024-04-25T09:05:55.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.395+0000 7fafd6e00640 1 -- 172.21.15.173:0/67832356 wait complete. 2024-04-25T09:05:55.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.395+0000 7fafd6e00640 1 Processor -- start 2024-04-25T09:05:55.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.395+0000 7fafd6e00640 1 -- start start 2024-04-25T09:05:55.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.395+0000 7fafd6e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd00717b0 0x7fafd015d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:55.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.395+0000 7fafd6e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafd0144240 0x7fafd00b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:55.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd6e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafd01449b0 0x7fafd015ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:55.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd6e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd006e280 con 0x7fafd00717b0 2024-04-25T09:05:55.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd6e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd006e100 con 0x7fafd0144240 2024-04-25T09:05:55.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd6e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd006e400 con 0x7fafd01449b0 2024-04-25T09:05:55.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd5a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd00717b0 0x7fafd015d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:55.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd5a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd00717b0 0x7fafd015d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50316/0 (socket says 172.21.15.173:50316) 2024-04-25T09:05:55.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd5a00640 1 -- 172.21.15.173:0/3649471402 learned_addr learned my addr 172.21.15.173:0/3649471402 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:55.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd5000640 1 --2- 172.21.15.173:0/3649471402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafd0144240 0x7fafd00b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:55.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd6400640 1 --2- 172.21.15.173:0/3649471402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafd01449b0 0x7fafd015ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:55.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd5a00640 1 -- 172.21.15.173:0/3649471402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafd01449b0 msgr2=0x7fafd015ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd5a00640 1 --2- 172.21.15.173:0/3649471402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafd01449b0 0x7fafd015ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd5a00640 1 -- 172.21.15.173:0/3649471402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafd0144240 msgr2=0x7fafd00b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd5a00640 1 --2- 172.21.15.173:0/3649471402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafd0144240 0x7fafd00b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd5a00640 1 -- 172.21.15.173:0/3649471402 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd00b1620 con 0x7fafd00717b0 2024-04-25T09:05:55.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd6400640 1 --2- 172.21.15.173:0/3649471402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafd01449b0 0x7fafd015ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:55.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd5a00640 1 --2- 172.21.15.173:0/3649471402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd00717b0 0x7fafd015d360 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fafc40097c0 tx=0x7fafc401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:55.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafcd600640 1 -- 172.21.15.173:0/3649471402 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4004230 con 0x7fafd00717b0 2024-04-25T09:05:55.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafcd600640 1 -- 172.21.15.173:0/3649471402 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc40043d0 con 0x7fafd00717b0 2024-04-25T09:05:55.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafcd600640 1 -- 172.21.15.173:0/3649471402 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4003820 con 0x7fafd00717b0 2024-04-25T09:05:55.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd6e00640 1 -- 172.21.15.173:0/3649471402 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd00b1900 con 0x7fafd00717b0 2024-04-25T09:05:55.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd6e00640 1 -- 172.21.15.173:0/3649471402 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd01f69b0 con 0x7fafd00717b0 2024-04-25T09:05:55.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafd6e00640 1 -- 172.21.15.173:0/3649471402 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd0073a40 con 0x7fafd00717b0 2024-04-25T09:05:55.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.399+0000 7fafcd600640 1 -- 172.21.15.173:0/3649471402 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fafc40039c0 con 0x7fafd00717b0 2024-04-25T09:05:55.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.403+0000 7fafcd600640 1 --2- 172.21.15.173:0/3649471402 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fafb0066f60 0x7fafb0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:55.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.403+0000 7fafcd600640 1 -- 172.21.15.173:0/3649471402 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fafc40a8020 con 0x7fafd00717b0 2024-04-25T09:05:55.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.403+0000 7fafd5000640 1 --2- 172.21.15.173:0/3649471402 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fafb0066f60 0x7fafb0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:55.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.403+0000 7fafd5000640 1 --2- 172.21.15.173:0/3649471402 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fafb0066f60 0x7fafb0069420 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fafd01675a0 tx=0x7fafbc009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:55.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.407+0000 7fafcd600640 1 -- 172.21.15.173:0/3649471402 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fafc4016050 con 0x7fafd00717b0 2024-04-25T09:05:55.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.563+0000 7fafd6e00640 1 -- 172.21.15.173:0/3649471402 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafd00b1ad0 con 0x7fafd00717b0 2024-04-25T09:05:55.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.563+0000 7fafcd600640 1 -- 172.21.15.173:0/3649471402 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17015 (secure 0 0 0) 0x7fafc40f0650 con 0x7fafd00717b0 2024-04-25T09:05:55.555 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:55.555 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":55,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:05:54.582490+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:52.287873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:53.577379+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:55.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.563+0000 7fafd6e00640 1 -- 172.21.15.173:0/3649471402 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fafb0066f60 msgr2=0x7fafb0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.563+0000 7fafd6e00640 1 --2- 172.21.15.173:0/3649471402 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fafb0066f60 0x7fafb0069420 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fafd01675a0 tx=0x7fafbc009060 comp rx=0 tx=0).stop 2024-04-25T09:05:55.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.563+0000 7fafd6e00640 1 -- 172.21.15.173:0/3649471402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd00717b0 msgr2=0x7fafd015d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.563+0000 7fafd6e00640 1 --2- 172.21.15.173:0/3649471402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd00717b0 0x7fafd015d360 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fafc40097c0 tx=0x7fafc401ac70 comp rx=0 tx=0).stop 2024-04-25T09:05:55.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.563+0000 7fafd6e00640 1 -- 172.21.15.173:0/3649471402 shutdown_connections 2024-04-25T09:05:55.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.563+0000 7fafd6e00640 1 --2- 172.21.15.173:0/3649471402 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fafb0066f60 0x7fafb0069420 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.563+0000 7fafd6e00640 1 --2- 172.21.15.173:0/3649471402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafd01449b0 0x7fafd015ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.563+0000 7fafd6e00640 1 --2- 172.21.15.173:0/3649471402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafd0144240 0x7fafd00b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.563+0000 7fafd6e00640 1 --2- 172.21.15.173:0/3649471402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd00717b0 0x7fafd015d360 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.563+0000 7fafd6e00640 1 -- 172.21.15.173:0/3649471402 >> 172.21.15.173:0/3649471402 conn(0x7fafd006ac90 msgr2=0x7fafd013f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:55.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.563+0000 7fafd6e00640 1 -- 172.21.15.173:0/3649471402 shutdown_connections 2024-04-25T09:05:55.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.563+0000 7fafd6e00640 1 -- 172.21.15.173:0/3649471402 wait complete. 2024-04-25T09:05:55.576 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.719+0000 7feb96600640 1 Processor -- start 2024-04-25T09:05:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.719+0000 7feb96600640 1 -- start start 2024-04-25T09:05:55.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.719+0000 7feb96600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb900cfb80 0x7feb9009a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:55.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.719+0000 7feb96600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feb9015d210 0x7feb9015d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:55.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.719+0000 7feb96600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb900ccbe0 con 0x7feb900cff60 2024-04-25T09:05:55.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.719+0000 7feb96600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb900cd7f0 con 0x7feb9015d210 2024-04-25T09:05:55.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.719+0000 7feb96600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb900cdc80 con 0x7feb900cfb80 2024-04-25T09:05:55.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.723+0000 7feb95200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb900cfb80 0x7feb9009a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:55.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.723+0000 7feb95c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feb9015d210 0x7feb9015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:55.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.723+0000 7feb87e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7feb900cff60 0x7feb900cc390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:34554/0 (socket says 172.21.15.173:34554) 2024-04-25T09:05:55.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.723+0000 7feb87e00640 1 -- 172.21.15.173:0/729542394 learned_addr learned my addr 172.21.15.173:0/729542394 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:55.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.723+0000 7feb95c00640 1 -- 172.21.15.173:0/729542394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb900cfb80 msgr2=0x7feb9009a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:55.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.723+0000 7feb95c00640 1 --2- 172.21.15.173:0/729542394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb900cfb80 0x7feb9009a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.723+0000 7feb95c00640 1 -- 172.21.15.173:0/729542394 >> v1:172.21.15.194:6789/0 conn(0x7feb900cff60 legacy=0x7feb900cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.723+0000 7feb95c00640 1 -- 172.21.15.173:0/729542394 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb900ccec0 con 0x7feb9015d210 2024-04-25T09:05:55.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.723+0000 7feb95200640 1 --2- 172.21.15.173:0/729542394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb900cfb80 0x7feb9009a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:55.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb95c00640 1 --2- 172.21.15.173:0/729542394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb9015d210 0x7feb9015d660 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7feb88009d90 tx=0x7feb8801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1513c5253599849d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:55.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb8fe00640 1 -- 172.21.15.173:0/729542394 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880b2070 con 0x7feb9015d210 2024-04-25T09:05:55.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb8fe00640 1 -- 172.21.15.173:0/729542394 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb880a5830 con 0x7feb9015d210 2024-04-25T09:05:55.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb8fe00640 1 -- 172.21.15.173:0/729542394 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880a5c00 con 0x7feb9015d210 2024-04-25T09:05:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb96600640 1 -- 172.21.15.173:0/729542394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb9015d210 msgr2=0x7feb9015d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb96600640 1 --2- 172.21.15.173:0/729542394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb9015d210 0x7feb9015d660 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7feb88009d90 tx=0x7feb8801c970 comp rx=0 tx=0).stop 2024-04-25T09:05:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb96600640 1 -- 172.21.15.173:0/729542394 shutdown_connections 2024-04-25T09:05:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb96600640 1 --2- 172.21.15.173:0/729542394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb9015d210 0x7feb9015d660 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb96600640 1 --2- 172.21.15.173:0/729542394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb900cfb80 0x7feb9009a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb96600640 1 -- 172.21.15.173:0/729542394 >> 172.21.15.173:0/729542394 conn(0x7feb900b3090 msgr2=0x7feb900b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb96600640 1 -- 172.21.15.173:0/729542394 shutdown_connections 2024-04-25T09:05:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb96600640 1 -- 172.21.15.173:0/729542394 wait complete. 2024-04-25T09:05:55.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb96600640 1 Processor -- start 2024-04-25T09:05:55.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb96600640 1 -- start start 2024-04-25T09:05:55.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb96600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb900cfb80 0x7feb901549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:55.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb96600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb900cff60 0x7feb90154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:55.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb96600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb9015d210 0x7feb90153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:55.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb96600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb900b2e50 con 0x7feb9015d210 2024-04-25T09:05:55.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb96600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb900b2cd0 con 0x7feb900cff60 2024-04-25T09:05:55.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb96600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9006c3f0 con 0x7feb900cfb80 2024-04-25T09:05:55.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb95c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb9015d210 0x7feb90153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:55.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb95c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb9015d210 0x7feb90153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50322/0 (socket says 172.21.15.173:50322) 2024-04-25T09:05:55.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.727+0000 7feb95c00640 1 -- 172.21.15.173:0/2351132462 learned_addr learned my addr 172.21.15.173:0/2351132462 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:55.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.731+0000 7feb87e00640 1 --2- 172.21.15.173:0/2351132462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb900cff60 0x7feb90154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:55.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.731+0000 7feb95200640 1 --2- 172.21.15.173:0/2351132462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb900cfb80 0x7feb901549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:55.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.731+0000 7feb95c00640 1 -- 172.21.15.173:0/2351132462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb900cfb80 msgr2=0x7feb901549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.731+0000 7feb95c00640 1 --2- 172.21.15.173:0/2351132462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb900cfb80 0x7feb901549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.731+0000 7feb95c00640 1 -- 172.21.15.173:0/2351132462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb900cff60 msgr2=0x7feb90154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.731+0000 7feb95c00640 1 --2- 172.21.15.173:0/2351132462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb900cff60 0x7feb90154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.731+0000 7feb95c00640 1 -- 172.21.15.173:0/2351132462 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90150820 con 0x7feb9015d210 2024-04-25T09:05:55.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.731+0000 7feb95200640 1 --2- 172.21.15.173:0/2351132462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb900cfb80 0x7feb901549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:55.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.731+0000 7feb87e00640 1 --2- 172.21.15.173:0/2351132462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb900cff60 0x7feb90154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:55.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.731+0000 7feb95c00640 1 --2- 172.21.15.173:0/2351132462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb9015d210 0x7feb90153550 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7feb880b0040 tx=0x7feb88019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:55.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.731+0000 7feb8d600640 1 -- 172.21.15.173:0/2351132462 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880b2050 con 0x7feb9015d210 2024-04-25T09:05:55.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.731+0000 7feb8d600640 1 -- 172.21.15.173:0/2351132462 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb880be070 con 0x7feb9015d210 2024-04-25T09:05:55.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.731+0000 7feb8d600640 1 -- 172.21.15.173:0/2351132462 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880ad850 con 0x7feb9015d210 2024-04-25T09:05:55.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.731+0000 7feb96600640 1 -- 172.21.15.173:0/2351132462 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb90154130 con 0x7feb9015d210 2024-04-25T09:05:55.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.731+0000 7feb96600640 1 -- 172.21.15.173:0/2351132462 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb900c9ae0 con 0x7feb9015d210 2024-04-25T09:05:55.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.731+0000 7feb96600640 1 -- 172.21.15.173:0/2351132462 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb90073a40 con 0x7feb9015d210 2024-04-25T09:05:55.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.731+0000 7feb8d600640 1 -- 172.21.15.173:0/2351132462 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feb880ad9f0 con 0x7feb9015d210 2024-04-25T09:05:55.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.735+0000 7feb8d600640 1 --2- 172.21.15.173:0/2351132462 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb6c066f60 0x7feb6c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:55.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.735+0000 7feb8d600640 1 -- 172.21.15.173:0/2351132462 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6101+0+0 (secure 0 0 0) 0x7feb88120230 con 0x7feb9015d210 2024-04-25T09:05:55.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.735+0000 7feb95200640 1 --2- 172.21.15.173:0/2351132462 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb6c066f60 0x7feb6c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:55.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.735+0000 7feb95200640 1 --2- 172.21.15.173:0/2351132462 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb6c066f60 0x7feb6c069420 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7feb80009bc0 tx=0x7feb80008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:55.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.739+0000 7feb8d600640 1 -- 172.21.15.173:0/2351132462 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feb88016560 con 0x7feb9015d210 2024-04-25T09:05:55.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.891+0000 7feb96600640 1 -- 172.21.15.173:0/2351132462 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb900b3ee0 con 0x7feb9015d210 2024-04-25T09:05:55.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.891+0000 7feb8d600640 1 -- 172.21.15.173:0/2351132462 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17015 (secure 0 0 0) 0x7feb880f1010 con 0x7feb9015d210 2024-04-25T09:05:55.885 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:55.885 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":55,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:05:54.582490+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:52.287873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:53.577379+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.895+0000 7feb96600640 1 -- 172.21.15.173:0/2351132462 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb6c066f60 msgr2=0x7feb6c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.895+0000 7feb96600640 1 --2- 172.21.15.173:0/2351132462 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb6c066f60 0x7feb6c069420 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7feb80009bc0 tx=0x7feb80008040 comp rx=0 tx=0).stop 2024-04-25T09:05:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.895+0000 7feb96600640 1 -- 172.21.15.173:0/2351132462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb9015d210 msgr2=0x7feb90153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.895+0000 7feb96600640 1 --2- 172.21.15.173:0/2351132462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb9015d210 0x7feb90153550 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7feb880b0040 tx=0x7feb88019710 comp rx=0 tx=0).stop 2024-04-25T09:05:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.895+0000 7feb96600640 1 -- 172.21.15.173:0/2351132462 shutdown_connections 2024-04-25T09:05:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.895+0000 7feb96600640 1 --2- 172.21.15.173:0/2351132462 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb6c066f60 0x7feb6c069420 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.895+0000 7feb96600640 1 --2- 172.21.15.173:0/2351132462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb9015d210 0x7feb90153550 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.895+0000 7feb96600640 1 --2- 172.21.15.173:0/2351132462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb900cff60 0x7feb90154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.895+0000 7feb96600640 1 --2- 172.21.15.173:0/2351132462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb900cfb80 0x7feb901549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.895+0000 7feb96600640 1 -- 172.21.15.173:0/2351132462 >> 172.21.15.173:0/2351132462 conn(0x7feb900b3090 msgr2=0x7feb90158e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.895+0000 7feb96600640 1 -- 172.21.15.173:0/2351132462 shutdown_connections 2024-04-25T09:05:55.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:55.895+0000 7feb96600640 1 -- 172.21.15.173:0/2351132462 wait complete. 2024-04-25T09:05:55.906 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:05:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.051+0000 7fcc30a00640 1 Processor -- start 2024-04-25T09:05:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.051+0000 7fcc30a00640 1 -- start start 2024-04-25T09:05:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.055+0000 7fcc30a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcc2c15dbc0 0x7fcc2c099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.055+0000 7fcc30a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcc2c099f90 0x7fcc2c06bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.055+0000 7fcc30a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc2c0b1040 con 0x7fcc2c06c2e0 2024-04-25T09:05:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.055+0000 7fcc30a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2c0cfce0 con 0x7fcc2c15dbc0 2024-04-25T09:05:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.055+0000 7fcc30a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2c09a3d0 con 0x7fcc2c099f90 2024-04-25T09:05:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.055+0000 7fcc2a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcc2c15dbc0 0x7fcc2c099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.055+0000 7fcc2a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcc2c15dbc0 0x7fcc2c099a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50334/0 (socket says 172.21.15.173:50334) 2024-04-25T09:05:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.055+0000 7fcc2b200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fcc2c06c2e0 0x7fcc2c161660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39606/0 (socket says 172.21.15.173:39606) 2024-04-25T09:05:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.055+0000 7fcc2a800640 1 -- 172.21.15.173:0/2757294173 learned_addr learned my addr 172.21.15.173:0/2757294173 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.055+0000 7fcc21e00640 1 --2- 172.21.15.173:0/2757294173 >> v2:172.21.15.194:3300/0 conn(0x7fcc2c099f90 0x7fcc2c06bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:56.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.055+0000 7fcc2a800640 1 -- 172.21.15.173:0/2757294173 >> v2:172.21.15.194:3300/0 conn(0x7fcc2c099f90 msgr2=0x7fcc2c06bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:56.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.055+0000 7fcc2a800640 1 --2- 172.21.15.173:0/2757294173 >> v2:172.21.15.194:3300/0 conn(0x7fcc2c099f90 0x7fcc2c06bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:56.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.055+0000 7fcc2a800640 1 -- 172.21.15.173:0/2757294173 >> v1:172.21.15.173:6789/0 conn(0x7fcc2c06c2e0 legacy=0x7fcc2c161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:56.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.055+0000 7fcc2a800640 1 -- 172.21.15.173:0/2757294173 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2c06cab0 con 0x7fcc2c15dbc0 2024-04-25T09:05:56.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc2a800640 1 --2- 172.21.15.173:0/2757294173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc2c15dbc0 0x7fcc2c099a50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c06dbc0 tx=0x7fcc1c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c0a265e6c9def2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:56.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc29e00640 1 -- 172.21.15.173:0/2757294173 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0b0070 con 0x7fcc2c15dbc0 2024-04-25T09:05:56.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc29e00640 1 -- 172.21.15.173:0/2757294173 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c004230 con 0x7fcc2c15dbc0 2024-04-25T09:05:56.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc29e00640 1 -- 172.21.15.173:0/2757294173 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c003620 con 0x7fcc2c15dbc0 2024-04-25T09:05:56.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc30a00640 1 -- 172.21.15.173:0/2757294173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc2c15dbc0 msgr2=0x7fcc2c099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:56.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc30a00640 1 --2- 172.21.15.173:0/2757294173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc2c15dbc0 0x7fcc2c099a50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c06dbc0 tx=0x7fcc1c01c520 comp rx=0 tx=0).stop 2024-04-25T09:05:56.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc30a00640 1 -- 172.21.15.173:0/2757294173 shutdown_connections 2024-04-25T09:05:56.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc30a00640 1 --2- 172.21.15.173:0/2757294173 >> v2:172.21.15.194:3300/0 conn(0x7fcc2c099f90 0x7fcc2c06bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:56.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc30a00640 1 --2- 172.21.15.173:0/2757294173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc2c15dbc0 0x7fcc2c099a50 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:56.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc30a00640 1 -- 172.21.15.173:0/2757294173 >> 172.21.15.173:0/2757294173 conn(0x7fcc2c0b31d0 msgr2=0x7fcc2c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:56.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc30a00640 1 -- 172.21.15.173:0/2757294173 shutdown_connections 2024-04-25T09:05:56.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc30a00640 1 -- 172.21.15.173:0/2757294173 wait complete. 2024-04-25T09:05:56.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc30a00640 1 Processor -- start 2024-04-25T09:05:56.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc30a00640 1 -- start start 2024-04-25T09:05:56.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc30a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc2c06c2e0 0x7fcc2c15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:56.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc30a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc2c099f90 0x7fcc2c15b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:56.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc30a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc2c15dbc0 0x7fcc2c15e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:56.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc30a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c06c6f0 con 0x7fcc2c06c2e0 2024-04-25T09:05:56.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc30a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c0d1180 con 0x7fcc2c099f90 2024-04-25T09:05:56.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.059+0000 7fcc30a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c06c870 con 0x7fcc2c15dbc0 2024-04-25T09:05:56.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc2a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc2c06c2e0 0x7fcc2c15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:56.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc2a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc2c06c2e0 0x7fcc2c15b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50338/0 (socket says 172.21.15.173:50338) 2024-04-25T09:05:56.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc2a800640 1 -- 172.21.15.173:0/998455443 learned_addr learned my addr 172.21.15.173:0/998455443 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:56.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc21e00640 1 --2- 172.21.15.173:0/998455443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc2c099f90 0x7fcc2c15b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:56.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc2a800640 1 -- 172.21.15.173:0/998455443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc2c15dbc0 msgr2=0x7fcc2c15e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:56.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc2b200640 1 --2- 172.21.15.173:0/998455443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc2c15dbc0 0x7fcc2c15e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:56.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc2a800640 1 --2- 172.21.15.173:0/998455443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc2c15dbc0 0x7fcc2c15e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:56.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc2a800640 1 -- 172.21.15.173:0/998455443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc2c099f90 msgr2=0x7fcc2c15b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:56.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc2a800640 1 --2- 172.21.15.173:0/998455443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc2c099f90 0x7fcc2c15b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:56.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc2a800640 1 -- 172.21.15.173:0/998455443 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2c145130 con 0x7fcc2c06c2e0 2024-04-25T09:05:56.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc21e00640 1 --2- 172.21.15.173:0/998455443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc2c099f90 0x7fcc2c15b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:56.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc2b200640 1 --2- 172.21.15.173:0/998455443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc2c15dbc0 0x7fcc2c15e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:56.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc2a800640 1 --2- 172.21.15.173:0/998455443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc2c06c2e0 0x7fcc2c15b0e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c0ae040 tx=0x7fcc1c0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:56.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc23400640 1 -- 172.21.15.173:0/998455443 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0b9020 con 0x7fcc2c06c2e0 2024-04-25T09:05:56.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc23400640 1 -- 172.21.15.173:0/998455443 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c0b1040 con 0x7fcc2c06c2e0 2024-04-25T09:05:56.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc23400640 1 -- 172.21.15.173:0/998455443 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0b0050 con 0x7fcc2c06c2e0 2024-04-25T09:05:56.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc30a00640 1 -- 172.21.15.173:0/998455443 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2c15bc30 con 0x7fcc2c06c2e0 2024-04-25T09:05:56.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc30a00640 1 -- 172.21.15.173:0/998455443 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2c15c1f0 con 0x7fcc2c06c2e0 2024-04-25T09:05:56.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc30a00640 1 -- 172.21.15.173:0/998455443 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2c073a40 con 0x7fcc2c06c2e0 2024-04-25T09:05:56.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.063+0000 7fcc23400640 1 -- 172.21.15.173:0/998455443 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcc1c0bc020 con 0x7fcc2c06c2e0 2024-04-25T09:05:56.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.067+0000 7fcc23400640 1 --2- 172.21.15.173:0/998455443 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcc08066f60 0x7fcc08069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:56.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.067+0000 7fcc23400640 1 -- 172.21.15.173:0/998455443 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcc1c11f0f0 con 0x7fcc2c06c2e0 2024-04-25T09:05:56.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.067+0000 7fcc21e00640 1 --2- 172.21.15.173:0/998455443 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcc08066f60 0x7fcc08069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:56.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.067+0000 7fcc21e00640 1 --2- 172.21.15.173:0/998455443 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcc08066f60 0x7fcc08069420 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c154300 tx=0x7fcc14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:56.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.071+0000 7fcc23400640 1 -- 172.21.15.173:0/998455443 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcc1c0c3030 con 0x7fcc2c06c2e0 2024-04-25T09:05:56.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:56.259+0000 7fcc30a00640 1 -- 172.21.15.173:0/998455443 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcc2c158c30 con 0x7fcc2c06c2e0 2024-04-25T09:05:57.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.215+0000 7fcc23400640 1 -- 172.21.15.173:0/998455443 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcc1c016110 con 0x7fcc2c06c2e0 2024-04-25T09:05:57.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.219+0000 7fcc30a00640 1 -- 172.21.15.173:0/998455443 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcc08066f60 msgr2=0x7fcc08069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:57.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.219+0000 7fcc30a00640 1 --2- 172.21.15.173:0/998455443 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcc08066f60 0x7fcc08069420 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c154300 tx=0x7fcc14008040 comp rx=0 tx=0).stop 2024-04-25T09:05:57.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.219+0000 7fcc30a00640 1 -- 172.21.15.173:0/998455443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc2c06c2e0 msgr2=0x7fcc2c15b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.219+0000 7fcc30a00640 1 --2- 172.21.15.173:0/998455443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc2c06c2e0 0x7fcc2c15b0e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c0ae040 tx=0x7fcc1c0192c0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.219+0000 7fcc30a00640 1 -- 172.21.15.173:0/998455443 shutdown_connections 2024-04-25T09:05:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.219+0000 7fcc30a00640 1 --2- 172.21.15.173:0/998455443 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcc08066f60 0x7fcc08069420 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.219+0000 7fcc30a00640 1 --2- 172.21.15.173:0/998455443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc2c15dbc0 0x7fcc2c15e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.219+0000 7fcc30a00640 1 --2- 172.21.15.173:0/998455443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc2c099f90 0x7fcc2c15b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.219+0000 7fcc30a00640 1 --2- 172.21.15.173:0/998455443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc2c06c2e0 0x7fcc2c15b0e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.219+0000 7fcc30a00640 1 -- 172.21.15.173:0/998455443 >> 172.21.15.173:0/998455443 conn(0x7fcc2c0b31d0 msgr2=0x7fcc2c0b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.223+0000 7fcc30a00640 1 -- 172.21.15.173:0/998455443 shutdown_connections 2024-04-25T09:05:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.223+0000 7fcc30a00640 1 -- 172.21.15.173:0/998455443 wait complete. 2024-04-25T09:05:57.237 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:05:57.237 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:05:57.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.387+0000 7fd2c3c00640 1 Processor -- start 2024-04-25T09:05:57.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.387+0000 7fd2c3c00640 1 -- start start 2024-04-25T09:05:57.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.391+0000 7fd2c3c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd2bc145290 0x7fd2bc15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:57.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.391+0000 7fd2c3c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc0b3fe0 0x7fd2bc0b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:57.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.391+0000 7fd2c3c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd2bc0cc260 0x7fd2bc0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:57.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.391+0000 7fd2c3c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc15c5f0 con 0x7fd2bc0cc260 2024-04-25T09:05:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.391+0000 7fd2c3c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc06d4b0 con 0x7fd2bc145290 2024-04-25T09:05:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.391+0000 7fd2c3c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc06d790 con 0x7fd2bc0b3fe0 2024-04-25T09:05:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.391+0000 7fd2c1c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd2bc0cc260 0x7fd2bc0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.391+0000 7fd2c1c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd2bc0cc260 0x7fd2bc0cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50344/0 (socket says 172.21.15.173:50344) 2024-04-25T09:05:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.391+0000 7fd2c1c00640 1 -- 172.21.15.173:0/862143234 learned_addr learned my addr 172.21.15.173:0/862143234 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.391+0000 7fd2bbe00640 1 --2- 172.21.15.173:0/862143234 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc0b3fe0 0x7fd2bc0b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.391+0000 7fd2c1200640 1 --2- 172.21.15.173:0/862143234 >> v2:172.21.15.194:3300/0 conn(0x7fd2bc145290 0x7fd2bc15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.391+0000 7fd2c1c00640 1 -- 172.21.15.173:0/862143234 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc0b3fe0 msgr2=0x7fd2bc0b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.391+0000 7fd2c1c00640 1 --2- 172.21.15.173:0/862143234 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc0b3fe0 0x7fd2bc0b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.391+0000 7fd2c1c00640 1 -- 172.21.15.173:0/862143234 >> v2:172.21.15.194:3300/0 conn(0x7fd2bc145290 msgr2=0x7fd2bc15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.391+0000 7fd2c1c00640 1 --2- 172.21.15.173:0/862143234 >> v2:172.21.15.194:3300/0 conn(0x7fd2bc145290 0x7fd2bc15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.391+0000 7fd2c1c00640 1 -- 172.21.15.173:0/862143234 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc06da70 con 0x7fd2bc0cc260 2024-04-25T09:05:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.395+0000 7fd2c1c00640 1 --2- 172.21.15.173:0/862143234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2bc0cc260 0x7fd2bc0cc6b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc0d0800 tx=0x7fd2b401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c366a93007353c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.395+0000 7fd2bb400640 1 -- 172.21.15.173:0/862143234 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40b0070 con 0x7fd2bc0cc260 2024-04-25T09:05:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.395+0000 7fd2bb400640 1 -- 172.21.15.173:0/862143234 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b40ab600 con 0x7fd2bc0cc260 2024-04-25T09:05:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.395+0000 7fd2bb400640 1 -- 172.21.15.173:0/862143234 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40ab9d0 con 0x7fd2bc0cc260 2024-04-25T09:05:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.395+0000 7fd2c3c00640 1 -- 172.21.15.173:0/862143234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2bc0cc260 msgr2=0x7fd2bc0cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.395+0000 7fd2c3c00640 1 --2- 172.21.15.173:0/862143234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2bc0cc260 0x7fd2bc0cc6b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc0d0800 tx=0x7fd2b401c400 comp rx=0 tx=0).stop 2024-04-25T09:05:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.395+0000 7fd2c3c00640 1 -- 172.21.15.173:0/862143234 shutdown_connections 2024-04-25T09:05:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.395+0000 7fd2c3c00640 1 --2- 172.21.15.173:0/862143234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2bc0cc260 0x7fd2bc0cc6b0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.395+0000 7fd2c3c00640 1 --2- 172.21.15.173:0/862143234 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc0b3fe0 0x7fd2bc0b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.395+0000 7fd2c3c00640 1 --2- 172.21.15.173:0/862143234 >> v2:172.21.15.194:3300/0 conn(0x7fd2bc145290 0x7fd2bc15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.395+0000 7fd2c3c00640 1 -- 172.21.15.173:0/862143234 >> 172.21.15.173:0/862143234 conn(0x7fd2bc06ac90 msgr2=0x7fd2bc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.395+0000 7fd2c3c00640 1 -- 172.21.15.173:0/862143234 shutdown_connections 2024-04-25T09:05:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.395+0000 7fd2c3c00640 1 -- 172.21.15.173:0/862143234 wait complete. 2024-04-25T09:05:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.395+0000 7fd2c3c00640 1 Processor -- start 2024-04-25T09:05:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.395+0000 7fd2c3c00640 1 -- start start 2024-04-25T09:05:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c3c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc0b3fe0 0x7fd2bc1380f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c3c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2bc0cc260 0x7fd2bc0b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c3c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2bc145290 0x7fd2bc15a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c3c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc1457f0 con 0x7fd2bc145290 2024-04-25T09:05:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c3c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc145670 con 0x7fd2bc0cc260 2024-04-25T09:05:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c3c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc06ed60 con 0x7fd2bc0b3fe0 2024-04-25T09:05:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c1c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2bc145290 0x7fd2bc15a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c1c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2bc145290 0x7fd2bc15a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50346/0 (socket says 172.21.15.173:50346) 2024-04-25T09:05:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c1c00640 1 -- 172.21.15.173:0/701821962 learned_addr learned my addr 172.21.15.173:0/701821962 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c1200640 1 --2- 172.21.15.173:0/701821962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc0b3fe0 0x7fd2bc1380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2bbe00640 1 --2- 172.21.15.173:0/701821962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2bc0cc260 0x7fd2bc0b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c1c00640 1 -- 172.21.15.173:0/701821962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc0b3fe0 msgr2=0x7fd2bc1380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c1c00640 1 --2- 172.21.15.173:0/701821962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc0b3fe0 0x7fd2bc1380f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c1c00640 1 -- 172.21.15.173:0/701821962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2bc0cc260 msgr2=0x7fd2bc0b2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c1c00640 1 --2- 172.21.15.173:0/701821962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2bc0cc260 0x7fd2bc0b2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c1c00640 1 -- 172.21.15.173:0/701821962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc15b6b0 con 0x7fd2bc145290 2024-04-25T09:05:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c1c00640 1 --2- 172.21.15.173:0/701821962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2bc145290 0x7fd2bc15a790 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40ae040 tx=0x7fd2b40191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2b8c00640 1 -- 172.21.15.173:0/701821962 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40b0040 con 0x7fd2bc145290 2024-04-25T09:05:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2b8c00640 1 -- 172.21.15.173:0/701821962 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b40b9070 con 0x7fd2bc145290 2024-04-25T09:05:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2b8c00640 1 -- 172.21.15.173:0/701821962 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40b4670 con 0x7fd2bc145290 2024-04-25T09:05:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c3c00640 1 -- 172.21.15.173:0/701821962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2bc1426f0 con 0x7fd2bc145290 2024-04-25T09:05:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c3c00640 1 -- 172.21.15.173:0/701821962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2bc142f90 con 0x7fd2bc145290 2024-04-25T09:05:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2c3c00640 1 -- 172.21.15.173:0/701821962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc073ab0 con 0x7fd2bc145290 2024-04-25T09:05:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.399+0000 7fd2b8c00640 1 -- 172.21.15.173:0/701821962 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd2b40b4810 con 0x7fd2bc145290 2024-04-25T09:05:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.403+0000 7fd2b8c00640 1 --2- 172.21.15.173:0/701821962 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd29c066f60 0x7fd29c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:57.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.403+0000 7fd2b8c00640 1 -- 172.21.15.173:0/701821962 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd2b411e870 con 0x7fd2bc145290 2024-04-25T09:05:57.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.403+0000 7fd2c1200640 1 --2- 172.21.15.173:0/701821962 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd29c066f60 0x7fd29c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:57.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.403+0000 7fd2c1200640 1 --2- 172.21.15.173:0/701821962 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd29c066f60 0x7fd29c069420 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac003ab0 tx=0x7fd2ac009830 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:57.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.407+0000 7fd2b8c00640 1 -- 172.21.15.173:0/701821962 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd2b4016110 con 0x7fd2bc145290 2024-04-25T09:05:57.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:57.591+0000 7fd2c3c00640 1 -- 172.21.15.173:0/701821962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd2bc141dd0 con 0x7fd2bc145290 2024-04-25T09:05:58.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.219+0000 7fd2b8c00640 1 -- 172.21.15.173:0/701821962 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd2b40ef250 con 0x7fd2bc145290 2024-04-25T09:05:58.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.219+0000 7fd2c3c00640 1 -- 172.21.15.173:0/701821962 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd29c066f60 msgr2=0x7fd29c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.219+0000 7fd2c3c00640 1 --2- 172.21.15.173:0/701821962 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd29c066f60 0x7fd29c069420 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac003ab0 tx=0x7fd2ac009830 comp rx=0 tx=0).stop 2024-04-25T09:05:58.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.219+0000 7fd2c3c00640 1 -- 172.21.15.173:0/701821962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2bc145290 msgr2=0x7fd2bc15a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.219+0000 7fd2c3c00640 1 --2- 172.21.15.173:0/701821962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2bc145290 0x7fd2bc15a790 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40ae040 tx=0x7fd2b40191a0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.219+0000 7fd2c3c00640 1 -- 172.21.15.173:0/701821962 shutdown_connections 2024-04-25T09:05:58.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.219+0000 7fd2c3c00640 1 --2- 172.21.15.173:0/701821962 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd29c066f60 0x7fd29c069420 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.219+0000 7fd2c3c00640 1 --2- 172.21.15.173:0/701821962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2bc145290 0x7fd2bc15a790 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.219+0000 7fd2c3c00640 1 --2- 172.21.15.173:0/701821962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2bc0cc260 0x7fd2bc0b2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.219+0000 7fd2c3c00640 1 --2- 172.21.15.173:0/701821962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc0b3fe0 0x7fd2bc1380f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.219+0000 7fd2c3c00640 1 -- 172.21.15.173:0/701821962 >> 172.21.15.173:0/701821962 conn(0x7fd2bc06ac90 msgr2=0x7fd2bc0cb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:58.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.223+0000 7fd2c3c00640 1 -- 172.21.15.173:0/701821962 shutdown_connections 2024-04-25T09:05:58.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.223+0000 7fd2c3c00640 1 -- 172.21.15.173:0/701821962 wait complete. 2024-04-25T09:05:58.238 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:05:58.238 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:58.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.387+0000 7ff007e00640 1 Processor -- start 2024-04-25T09:05:58.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.387+0000 7ff007e00640 1 -- start start 2024-04-25T09:05:58.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.387+0000 7ff007e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff00815dc90 0x7ff0080b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.387+0000 7ff007e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff008161660 0x7ff008161ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.387+0000 7ff007e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff008162020 0x7ff00806ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.387+0000 7ff007e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff00806db00 con 0x7ff008161660 2024-04-25T09:05:58.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.387+0000 7ff007e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0080b4e70 con 0x7ff008162020 2024-04-25T09:05:58.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.387+0000 7ff007e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080b50c0 con 0x7ff00815dc90 2024-04-25T09:05:58.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.387+0000 7feffe000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff008161660 0x7ff008161ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.387+0000 7feffe000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff008161660 0x7ff008161ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50350/0 (socket says 172.21.15.173:50350) 2024-04-25T09:05:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.387+0000 7feffe000640 1 -- 172.21.15.173:0/512719371 learned_addr learned my addr 172.21.15.173:0/512719371 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.387+0000 7ff006a00640 1 --2- 172.21.15.173:0/512719371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff00815dc90 0x7ff0080b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.387+0000 7ff007400640 1 --2- 172.21.15.173:0/512719371 >> v2:172.21.15.194:3300/0 conn(0x7ff008162020 0x7ff00806ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.387+0000 7feffe000640 1 -- 172.21.15.173:0/512719371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff00815dc90 msgr2=0x7ff0080b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.387+0000 7feffe000640 1 --2- 172.21.15.173:0/512719371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff00815dc90 0x7ff0080b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.387+0000 7feffe000640 1 -- 172.21.15.173:0/512719371 >> v2:172.21.15.194:3300/0 conn(0x7ff008162020 msgr2=0x7ff00806ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.387+0000 7feffe000640 1 --2- 172.21.15.173:0/512719371 >> v2:172.21.15.194:3300/0 conn(0x7ff008162020 0x7ff00806ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.387+0000 7feffe000640 1 -- 172.21.15.173:0/512719371 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0080b2ee0 con 0x7ff008161660 2024-04-25T09:05:58.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.391+0000 7feffe000640 1 --2- 172.21.15.173:0/512719371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff008161660 0x7ff008161ae0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff008162700 tx=0x7feff001c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e4380d52a87a14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:58.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.391+0000 7ff006000640 1 -- 172.21.15.173:0/512719371 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff00b0070 con 0x7ff008161660 2024-04-25T09:05:58.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.391+0000 7ff006000640 1 -- 172.21.15.173:0/512719371 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff00ab600 con 0x7ff008161660 2024-04-25T09:05:58.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.391+0000 7ff006000640 1 -- 172.21.15.173:0/512719371 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff00ab9d0 con 0x7ff008161660 2024-04-25T09:05:58.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.391+0000 7ff007e00640 1 -- 172.21.15.173:0/512719371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff008161660 msgr2=0x7ff008161ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.391+0000 7ff007e00640 1 --2- 172.21.15.173:0/512719371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff008161660 0x7ff008161ae0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff008162700 tx=0x7feff001c1d0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.391+0000 7ff007e00640 1 -- 172.21.15.173:0/512719371 shutdown_connections 2024-04-25T09:05:58.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.391+0000 7ff007e00640 1 --2- 172.21.15.173:0/512719371 >> v2:172.21.15.194:3300/0 conn(0x7ff008162020 0x7ff00806ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.391+0000 7ff007e00640 1 --2- 172.21.15.173:0/512719371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff008161660 0x7ff008161ae0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.391+0000 7ff007e00640 1 --2- 172.21.15.173:0/512719371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff00815dc90 0x7ff0080b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.391+0000 7ff007e00640 1 -- 172.21.15.173:0/512719371 >> 172.21.15.173:0/512719371 conn(0x7ff0080cc800 msgr2=0x7ff0080ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:58.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.391+0000 7ff007e00640 1 -- 172.21.15.173:0/512719371 shutdown_connections 2024-04-25T09:05:58.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.391+0000 7ff007e00640 1 -- 172.21.15.173:0/512719371 wait complete. 2024-04-25T09:05:58.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.391+0000 7ff007e00640 1 Processor -- start 2024-04-25T09:05:58.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.391+0000 7ff007e00640 1 -- start start 2024-04-25T09:05:58.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff007e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff00815dc90 0x7ff0080afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff007e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff008161660 0x7ff00815fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff007e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff008162020 0x7ff008160190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff007e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00806e0f0 con 0x7ff008162020 2024-04-25T09:05:58.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff007e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00806df70 con 0x7ff00815dc90 2024-04-25T09:05:58.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff007e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00806e270 con 0x7ff008161660 2024-04-25T09:05:58.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff007400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff008162020 0x7ff008160190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff006a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff00815dc90 0x7ff0080afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff007400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff008162020 0x7ff008160190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50360/0 (socket says 172.21.15.173:50360) 2024-04-25T09:05:58.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7feffe000640 1 --2- 172.21.15.173:0/2022103390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff008161660 0x7ff00815fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff007400640 1 -- 172.21.15.173:0/2022103390 learned_addr learned my addr 172.21.15.173:0/2022103390 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:58.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff007400640 1 -- 172.21.15.173:0/2022103390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff008161660 msgr2=0x7ff00815fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff007400640 1 --2- 172.21.15.173:0/2022103390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff008161660 0x7ff00815fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff007400640 1 -- 172.21.15.173:0/2022103390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff00815dc90 msgr2=0x7ff0080afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff007400640 1 --2- 172.21.15.173:0/2022103390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff00815dc90 0x7ff0080afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff007400640 1 -- 172.21.15.173:0/2022103390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff008160a10 con 0x7ff008162020 2024-04-25T09:05:58.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff007400640 1 --2- 172.21.15.173:0/2022103390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff008162020 0x7ff008160190 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff000007e90 tx=0x7ff00000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:58.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7fefff400640 1 -- 172.21.15.173:0/2022103390 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000014420 con 0x7ff008162020 2024-04-25T09:05:58.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7fefff400640 1 -- 172.21.15.173:0/2022103390 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff000019070 con 0x7ff008162020 2024-04-25T09:05:58.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7fefff400640 1 -- 172.21.15.173:0/2022103390 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000014800 con 0x7ff008162020 2024-04-25T09:05:58.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff007e00640 1 -- 172.21.15.173:0/2022103390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0080ad2f0 con 0x7ff008162020 2024-04-25T09:05:58.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff007e00640 1 -- 172.21.15.173:0/2022103390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0081606d0 con 0x7ff008162020 2024-04-25T09:05:58.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7ff007e00640 1 -- 172.21.15.173:0/2022103390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff008073a40 con 0x7ff008162020 2024-04-25T09:05:58.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.395+0000 7fefff400640 1 -- 172.21.15.173:0/2022103390 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff0000149a0 con 0x7ff008162020 2024-04-25T09:05:58.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.399+0000 7fefff400640 1 --2- 172.21.15.173:0/2022103390 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fefe4066f60 0x7fefe4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.399+0000 7fefff400640 1 -- 172.21.15.173:0/2022103390 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff0000859e0 con 0x7ff008162020 2024-04-25T09:05:58.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.399+0000 7ff006a00640 1 --2- 172.21.15.173:0/2022103390 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fefe4066f60 0x7fefe4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.399+0000 7ff006a00640 1 --2- 172.21.15.173:0/2022103390 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fefe4066f60 0x7fefe4069420 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7feff80045f0 tx=0x7feff8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.403+0000 7fefff400640 1 -- 172.21.15.173:0/2022103390 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff0000560e0 con 0x7ff008162020 2024-04-25T09:05:58.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.591+0000 7ff007e00640 1 -- 172.21.15.173:0/2022103390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff00806eca0 con 0x7ff008162020 2024-04-25T09:05:58.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.591+0000 7fefff400640 1 -- 172.21.15.173:0/2022103390 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4950 (secure 0 0 0) 0x7ff00005a180 con 0x7ff008162020 2024-04-25T09:05:58.585 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:58.585 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:05:57.598642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:05:58.585 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 26 2024-04-25T09:05:58.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.595+0000 7ff007e00640 1 -- 172.21.15.173:0/2022103390 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fefe4066f60 msgr2=0x7fefe4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.595+0000 7ff007e00640 1 --2- 172.21.15.173:0/2022103390 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fefe4066f60 0x7fefe4069420 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7feff80045f0 tx=0x7feff8008040 comp rx=0 tx=0).stop 2024-04-25T09:05:58.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.595+0000 7ff007e00640 1 -- 172.21.15.173:0/2022103390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff008162020 msgr2=0x7ff008160190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.595+0000 7ff007e00640 1 --2- 172.21.15.173:0/2022103390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff008162020 0x7ff008160190 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff000007e90 tx=0x7ff00000e4b0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.595+0000 7ff007e00640 1 -- 172.21.15.173:0/2022103390 shutdown_connections 2024-04-25T09:05:58.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.595+0000 7ff007e00640 1 --2- 172.21.15.173:0/2022103390 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fefe4066f60 0x7fefe4069420 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.595+0000 7ff007e00640 1 --2- 172.21.15.173:0/2022103390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff008162020 0x7ff008160190 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.595+0000 7ff007e00640 1 --2- 172.21.15.173:0/2022103390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff008161660 0x7ff00815fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.595+0000 7ff007e00640 1 --2- 172.21.15.173:0/2022103390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff00815dc90 0x7ff0080afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.595+0000 7ff007e00640 1 -- 172.21.15.173:0/2022103390 >> 172.21.15.173:0/2022103390 conn(0x7ff0080cc800 msgr2=0x7ff00806bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:58.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.595+0000 7ff007e00640 1 -- 172.21.15.173:0/2022103390 shutdown_connections 2024-04-25T09:05:58.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.595+0000 7ff007e00640 1 -- 172.21.15.173:0/2022103390 wait complete. 2024-04-25T09:05:58.606 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:58.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.751+0000 7fcefd400640 1 Processor -- start 2024-04-25T09:05:58.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.751+0000 7fcefd400640 1 -- start start 2024-04-25T09:05:58.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.751+0000 7fcefd400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcef815ba20 0x7fcef815be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.751+0000 7fcefd400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcef8070070 0x7fcef80d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.751+0000 7fcefd400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef815c460 con 0x7fcef80b70f0 2024-04-25T09:05:58.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.751+0000 7fcefd400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef815c740 con 0x7fcef815ba20 2024-04-25T09:05:58.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.751+0000 7fcefd400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef815ca20 con 0x7fcef8070070 2024-04-25T09:05:58.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.751+0000 7fceede00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fcef80b70f0 0x7fcef806f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39620/0 (socket says 172.21.15.173:39620) 2024-04-25T09:05:58.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.751+0000 7fceede00640 1 -- 172.21.15.173:0/3241475081 learned_addr learned my addr 172.21.15.173:0/3241475081 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:58.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.751+0000 7fcef6800640 1 --2- 172.21.15.173:0/3241475081 >> v2:172.21.15.194:3300/0 conn(0x7fcef815ba20 0x7fcef815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.751+0000 7fcef7200640 1 --2- 172.21.15.173:0/3241475081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcef8070070 0x7fcef80d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.751+0000 7fcef5e00640 1 -- 172.21.15.173:0/3241475081 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482832239 0 0) 0x7fcef815c460 con 0x7fcef80b70f0 2024-04-25T09:05:58.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.751+0000 7fcef5e00640 1 -- 172.21.15.173:0/3241475081 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcedc003530 con 0x7fcef80b70f0 2024-04-25T09:05:58.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.751+0000 7fcef6800640 1 -- 172.21.15.173:0/3241475081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcef8070070 msgr2=0x7fcef80d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:58.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.751+0000 7fcef6800640 1 --2- 172.21.15.173:0/3241475081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcef8070070 0x7fcef80d1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.751+0000 7fcef6800640 1 -- 172.21.15.173:0/3241475081 >> v1:172.21.15.173:6789/0 conn(0x7fcef80b70f0 legacy=0x7fcef806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.751+0000 7fcef6800640 1 -- 172.21.15.173:0/3241475081 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef815cd00 con 0x7fcef815ba20 2024-04-25T09:05:58.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.755+0000 7fcef6800640 1 --2- 172.21.15.173:0/3241475081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcef815ba20 0x7fcef815be00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcee80097f0 tx=0x7fcee801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74a055aac231044e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:58.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.755+0000 7fcef5e00640 1 -- 172.21.15.173:0/3241475081 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee80aa5f0 con 0x7fcef815ba20 2024-04-25T09:05:58.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.755+0000 7fcef5e00640 1 -- 172.21.15.173:0/3241475081 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee80af070 con 0x7fcef815ba20 2024-04-25T09:05:58.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.755+0000 7fcef5e00640 1 -- 172.21.15.173:0/3241475081 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee80aa9b0 con 0x7fcef815ba20 2024-04-25T09:05:58.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.755+0000 7fcefd400640 1 -- 172.21.15.173:0/3241475081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcef815ba20 msgr2=0x7fcef815be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.755+0000 7fcefd400640 1 --2- 172.21.15.173:0/3241475081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcef815ba20 0x7fcef815be00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcee80097f0 tx=0x7fcee801c470 comp rx=0 tx=0).stop 2024-04-25T09:05:58.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.755+0000 7fcefd400640 1 -- 172.21.15.173:0/3241475081 shutdown_connections 2024-04-25T09:05:58.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.755+0000 7fcefd400640 1 --2- 172.21.15.173:0/3241475081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcef8070070 0x7fcef80d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.755+0000 7fcefd400640 1 --2- 172.21.15.173:0/3241475081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcef815ba20 0x7fcef815be00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.755+0000 7fcefd400640 1 -- 172.21.15.173:0/3241475081 >> 172.21.15.173:0/3241475081 conn(0x7fcef8061880 msgr2=0x7fcef8061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:58.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.755+0000 7fcefd400640 1 -- 172.21.15.173:0/3241475081 shutdown_connections 2024-04-25T09:05:58.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.755+0000 7fcefd400640 1 -- 172.21.15.173:0/3241475081 wait complete. 2024-04-25T09:05:58.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.755+0000 7fcefd400640 1 Processor -- start 2024-04-25T09:05:58.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fcefd400640 1 -- start start 2024-04-25T09:05:58.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fcefd400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcef8070070 0x7fcef8156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fcefd400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcef80b70f0 0x7fcef8162390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fcefd400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcef815ba20 0x7fcef80b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fcefd400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef815e2b0 con 0x7fcef80b70f0 2024-04-25T09:05:58.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fcefd400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef815e130 con 0x7fcef815ba20 2024-04-25T09:05:58.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fcefd400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef815e430 con 0x7fcef8070070 2024-04-25T09:05:58.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fceede00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcef80b70f0 0x7fcef8162390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fceede00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcef80b70f0 0x7fcef8162390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50376/0 (socket says 172.21.15.173:50376) 2024-04-25T09:05:58.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fceede00640 1 -- 172.21.15.173:0/1453715810 learned_addr learned my addr 172.21.15.173:0/1453715810 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:58.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fcef6800640 1 --2- 172.21.15.173:0/1453715810 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcef8070070 0x7fcef8156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fcef7200640 1 --2- 172.21.15.173:0/1453715810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcef815ba20 0x7fcef80b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fceede00640 1 -- 172.21.15.173:0/1453715810 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcef8070070 msgr2=0x7fcef8156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fceede00640 1 --2- 172.21.15.173:0/1453715810 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcef8070070 0x7fcef8156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fceede00640 1 -- 172.21.15.173:0/1453715810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcef815ba20 msgr2=0x7fcef80b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fceede00640 1 --2- 172.21.15.173:0/1453715810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcef815ba20 0x7fcef80b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fceede00640 1 -- 172.21.15.173:0/1453715810 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef8156e00 con 0x7fcef80b70f0 2024-04-25T09:05:58.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fceede00640 1 --2- 172.21.15.173:0/1453715810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcef80b70f0 0x7fcef8162390 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fcee00010f0 tx=0x7fcee000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:58.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fceef400640 1 -- 172.21.15.173:0/1453715810 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee0017070 con 0x7fcef80b70f0 2024-04-25T09:05:58.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fceef400640 1 -- 172.21.15.173:0/1453715810 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee0005d10 con 0x7fcef80b70f0 2024-04-25T09:05:58.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fceef400640 1 -- 172.21.15.173:0/1453715810 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee0007310 con 0x7fcef80b70f0 2024-04-25T09:05:58.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fcefd400640 1 -- 172.21.15.173:0/1453715810 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef81570e0 con 0x7fcef80b70f0 2024-04-25T09:05:58.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fcefd400640 1 -- 172.21.15.173:0/1453715810 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef81576a0 con 0x7fcef80b70f0 2024-04-25T09:05:58.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.759+0000 7fcefd400640 1 -- 172.21.15.173:0/1453715810 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef8073a40 con 0x7fcef80b70f0 2024-04-25T09:05:58.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.763+0000 7fceef400640 1 -- 172.21.15.173:0/1453715810 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcee001a070 con 0x7fcef80b70f0 2024-04-25T09:05:58.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.763+0000 7fceef400640 1 --2- 172.21.15.173:0/1453715810 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fced4066f90 0x7fced4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.763+0000 7fceef400640 1 -- 172.21.15.173:0/1453715810 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcee0084580 con 0x7fcef80b70f0 2024-04-25T09:05:58.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.763+0000 7fcef6800640 1 --2- 172.21.15.173:0/1453715810 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fced4066f90 0x7fced4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.763+0000 7fcef6800640 1 --2- 172.21.15.173:0/1453715810 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fced4066f90 0x7fced4069450 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcee80ae000 tx=0x7fcee80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:58.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.767+0000 7fceef400640 1 -- 172.21.15.173:0/1453715810 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcee0054da0 con 0x7fcef80b70f0 2024-04-25T09:05:58.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.919+0000 7fcefd400640 1 -- 172.21.15.173:0/1453715810 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcef80cefc0 con 0x7fcef80b70f0 2024-04-25T09:05:58.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.923+0000 7fceef400640 1 -- 172.21.15.173:0/1453715810 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17002 (secure 0 0 0) 0x7fcee0058e40 con 0x7fcef80b70f0 2024-04-25T09:05:58.914 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:58.914 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":56,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:05:56.208638+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:52.287873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:53.577379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:58.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.923+0000 7fcefd400640 1 -- 172.21.15.173:0/1453715810 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fced4066f90 msgr2=0x7fced4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.923+0000 7fcefd400640 1 --2- 172.21.15.173:0/1453715810 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fced4066f90 0x7fced4069450 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcee80ae000 tx=0x7fcee80a7000 comp rx=0 tx=0).stop 2024-04-25T09:05:58.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.923+0000 7fcefd400640 1 -- 172.21.15.173:0/1453715810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcef80b70f0 msgr2=0x7fcef8162390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.923+0000 7fcefd400640 1 --2- 172.21.15.173:0/1453715810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcef80b70f0 0x7fcef8162390 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fcee00010f0 tx=0x7fcee000c8f0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.923+0000 7fcefd400640 1 -- 172.21.15.173:0/1453715810 shutdown_connections 2024-04-25T09:05:58.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.923+0000 7fcefd400640 1 --2- 172.21.15.173:0/1453715810 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fced4066f90 0x7fced4069450 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.923+0000 7fcefd400640 1 --2- 172.21.15.173:0/1453715810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcef815ba20 0x7fcef80b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.923+0000 7fcefd400640 1 --2- 172.21.15.173:0/1453715810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcef80b70f0 0x7fcef8162390 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.923+0000 7fcefd400640 1 --2- 172.21.15.173:0/1453715810 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcef8070070 0x7fcef8156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.923+0000 7fcefd400640 1 -- 172.21.15.173:0/1453715810 >> 172.21.15.173:0/1453715810 conn(0x7fcef8061880 msgr2=0x7fcef80d1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:58.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.923+0000 7fcefd400640 1 -- 172.21.15.173:0/1453715810 shutdown_connections 2024-04-25T09:05:58.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:58.923+0000 7fcefd400640 1 -- 172.21.15.173:0/1453715810 wait complete. 2024-04-25T09:05:58.936 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:05:58.936 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:05:59.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.079+0000 7f4e39a00640 1 Processor -- start 2024-04-25T09:05:59.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.079+0000 7f4e39a00640 1 -- start start 2024-04-25T09:05:59.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.079+0000 7f4e39a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e340aefa0 0x7f4e340cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.079+0000 7f4e39a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4e3415edd0 0x7f4e340cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.079+0000 7f4e39a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3415f320 con 0x7f4e340b3e70 2024-04-25T09:05:59.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.079+0000 7f4e39a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3406dd50 con 0x7f4e3415edd0 2024-04-25T09:05:59.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.079+0000 7f4e39a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3406d420 con 0x7f4e340aefa0 2024-04-25T09:05:59.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.079+0000 7f4e33400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4e3415edd0 0x7f4e340cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.079+0000 7f4e33400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4e3415edd0 0x7f4e340cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50384/0 (socket says 172.21.15.173:50384) 2024-04-25T09:05:59.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.079+0000 7f4e33400640 1 -- 172.21.15.173:0/2772268889 learned_addr learned my addr 172.21.15.173:0/2772268889 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:59.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.079+0000 7f4e32000640 1 --2- 172.21.15.173:0/2772268889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e340aefa0 0x7f4e340cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.079+0000 7f4e33400640 1 -- 172.21.15.173:0/2772268889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e340aefa0 msgr2=0x7f4e340cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:59.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.079+0000 7f4e33400640 1 --2- 172.21.15.173:0/2772268889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e340aefa0 0x7f4e340cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.079+0000 7f4e33400640 1 -- 172.21.15.173:0/2772268889 >> v1:172.21.15.194:6789/0 conn(0x7f4e340b3e70 legacy=0x7f4e340b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.079+0000 7f4e33400640 1 -- 172.21.15.173:0/2772268889 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3406d700 con 0x7f4e3415edd0 2024-04-25T09:05:59.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.083+0000 7f4e33400640 1 --2- 172.21.15.173:0/2772268889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e3415edd0 0x7f4e340cdce0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009870 tx=0x7f4e2c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283762bcf789ee2f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.083+0000 7f4e31600640 1 -- 172.21.15.173:0/2772268889 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0aa680 con 0x7f4e3415edd0 2024-04-25T09:05:59.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.083+0000 7f4e31600640 1 -- 172.21.15.173:0/2772268889 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c0af070 con 0x7f4e3415edd0 2024-04-25T09:05:59.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.083+0000 7f4e31600640 1 -- 172.21.15.173:0/2772268889 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0aaa40 con 0x7f4e3415edd0 2024-04-25T09:05:59.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.083+0000 7f4e39a00640 1 -- 172.21.15.173:0/2772268889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e3415edd0 msgr2=0x7f4e340cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.083+0000 7f4e39a00640 1 --2- 172.21.15.173:0/2772268889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e3415edd0 0x7f4e340cdce0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009870 tx=0x7f4e2c01c530 comp rx=0 tx=0).stop 2024-04-25T09:05:59.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.083+0000 7f4e39a00640 1 -- 172.21.15.173:0/2772268889 shutdown_connections 2024-04-25T09:05:59.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.083+0000 7f4e39a00640 1 --2- 172.21.15.173:0/2772268889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e340aefa0 0x7f4e340cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.083+0000 7f4e39a00640 1 --2- 172.21.15.173:0/2772268889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e3415edd0 0x7f4e340cdce0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.083+0000 7f4e39a00640 1 -- 172.21.15.173:0/2772268889 >> 172.21.15.173:0/2772268889 conn(0x7f4e3406ac90 msgr2=0x7f4e3406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:59.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.083+0000 7f4e39a00640 1 -- 172.21.15.173:0/2772268889 shutdown_connections 2024-04-25T09:05:59.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.083+0000 7f4e39a00640 1 -- 172.21.15.173:0/2772268889 wait complete. 2024-04-25T09:05:59.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e39a00640 1 Processor -- start 2024-04-25T09:05:59.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e39a00640 1 -- start start 2024-04-25T09:05:59.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e39a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e340aefa0 0x7f4e341f9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e39a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e340b3e70 0x7f4e34151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e39a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e3415edd0 0x7f4e34151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e39a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e34167930 con 0x7f4e3415edd0 2024-04-25T09:05:59.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e39a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e341677b0 con 0x7f4e340aefa0 2024-04-25T09:05:59.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e39a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e34167ab0 con 0x7f4e340b3e70 2024-04-25T09:05:59.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e33400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e3415edd0 0x7f4e34151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e33400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e3415edd0 0x7f4e34151680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50390/0 (socket says 172.21.15.173:50390) 2024-04-25T09:05:59.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e33400640 1 -- 172.21.15.173:0/1658830763 learned_addr learned my addr 172.21.15.173:0/1658830763 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:59.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e32000640 1 --2- 172.21.15.173:0/1658830763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e340b3e70 0x7f4e34151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e32a00640 1 --2- 172.21.15.173:0/1658830763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e340aefa0 0x7f4e341f9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e33400640 1 -- 172.21.15.173:0/1658830763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e340b3e70 msgr2=0x7f4e34151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e33400640 1 --2- 172.21.15.173:0/1658830763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e340b3e70 0x7f4e34151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e33400640 1 -- 172.21.15.173:0/1658830763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e340aefa0 msgr2=0x7f4e341f9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e33400640 1 --2- 172.21.15.173:0/1658830763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e340aefa0 0x7f4e341f9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e33400640 1 -- 172.21.15.173:0/1658830763 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e340b2600 con 0x7f4e3415edd0 2024-04-25T09:05:59.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e32a00640 1 --2- 172.21.15.173:0/1658830763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e340aefa0 0x7f4e341f9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:59.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e32000640 1 --2- 172.21.15.173:0/1658830763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e340b3e70 0x7f4e34151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:59.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e33400640 1 --2- 172.21.15.173:0/1658830763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e3415edd0 0x7f4e34151680 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c0ac040 tx=0x7f4e2c0192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e2aa00640 1 -- 172.21.15.173:0/1658830763 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0be610 con 0x7f4e3415edd0 2024-04-25T09:05:59.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e2aa00640 1 -- 172.21.15.173:0/1658830763 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c0be7d0 con 0x7f4e3415edd0 2024-04-25T09:05:59.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e2aa00640 1 -- 172.21.15.173:0/1658830763 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0bebc0 con 0x7f4e3415edd0 2024-04-25T09:05:59.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e39a00640 1 -- 172.21.15.173:0/1658830763 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e340b28e0 con 0x7f4e3415edd0 2024-04-25T09:05:59.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.087+0000 7f4e39a00640 1 -- 172.21.15.173:0/1658830763 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e340b2ea0 con 0x7f4e3415edd0 2024-04-25T09:05:59.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.091+0000 7f4e39a00640 1 -- 172.21.15.173:0/1658830763 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e34073a40 con 0x7f4e3415edd0 2024-04-25T09:05:59.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.091+0000 7f4e2aa00640 1 -- 172.21.15.173:0/1658830763 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4e2c0bc020 con 0x7f4e3415edd0 2024-04-25T09:05:59.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.091+0000 7f4e2aa00640 1 --2- 172.21.15.173:0/1658830763 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4e14066f60 0x7f4e14069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.091+0000 7f4e2aa00640 1 -- 172.21.15.173:0/1658830763 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4e2c11f680 con 0x7f4e3415edd0 2024-04-25T09:05:59.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.091+0000 7f4e32a00640 1 --2- 172.21.15.173:0/1658830763 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4e14066f60 0x7f4e14069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.091+0000 7f4e32a00640 1 --2- 172.21.15.173:0/1658830763 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4e14066f60 0x7f4e14069420 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4e24001e10 tx=0x7f4e24009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.095+0000 7f4e2aa00640 1 -- 172.21.15.173:0/1658830763 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4e2c0c5030 con 0x7f4e3415edd0 2024-04-25T09:05:59.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.247+0000 7f4e39a00640 1 -- 172.21.15.173:0/1658830763 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e3406e540 con 0x7f4e14066f60 2024-04-25T09:05:59.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.251+0000 7f4e2aa00640 1 -- 172.21.15.173:0/1658830763 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+241537 (secure 0 0 0) 0x7f4e3406e540 con 0x7f4e14066f60 2024-04-25T09:05:59.247 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:59.249 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:05:59.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.255+0000 7f4e39a00640 1 -- 172.21.15.173:0/1658830763 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4e14066f60 msgr2=0x7f4e14069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.255+0000 7f4e39a00640 1 --2- 172.21.15.173:0/1658830763 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4e14066f60 0x7f4e14069420 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4e24001e10 tx=0x7f4e24009040 comp rx=0 tx=0).stop 2024-04-25T09:05:59.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.255+0000 7f4e39a00640 1 -- 172.21.15.173:0/1658830763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e3415edd0 msgr2=0x7f4e34151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.255+0000 7f4e39a00640 1 --2- 172.21.15.173:0/1658830763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e3415edd0 0x7f4e34151680 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c0ac040 tx=0x7f4e2c0192d0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.255+0000 7f4e39a00640 1 -- 172.21.15.173:0/1658830763 shutdown_connections 2024-04-25T09:05:59.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.255+0000 7f4e39a00640 1 --2- 172.21.15.173:0/1658830763 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4e14066f60 0x7f4e14069420 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.255+0000 7f4e39a00640 1 --2- 172.21.15.173:0/1658830763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e3415edd0 0x7f4e34151680 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.255+0000 7f4e39a00640 1 --2- 172.21.15.173:0/1658830763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e340b3e70 0x7f4e34151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.255+0000 7f4e39a00640 1 --2- 172.21.15.173:0/1658830763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e340aefa0 0x7f4e341f9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.255+0000 7f4e39a00640 1 -- 172.21.15.173:0/1658830763 >> 172.21.15.173:0/1658830763 conn(0x7f4e3406ac90 msgr2=0x7f4e3415e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:59.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.255+0000 7f4e39a00640 1 -- 172.21.15.173:0/1658830763 shutdown_connections 2024-04-25T09:05:59.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.255+0000 7f4e39a00640 1 -- 172.21.15.173:0/1658830763 wait complete. 2024-04-25T09:05:59.268 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-04-25T09:05:58.765800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":297116,"kb_used_data":6044,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754677604,"statfs":{"total":773094113280,"available":772789866496,"internally_reserved":0,"allocated":6189056,"data_stored":3387608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.581728"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223866+0000","last_change":"2024-04-25T09:05:55.219954+0000","last_active":"2024-04-25T09:05:56.223866+0000","last_peered":"2024-04-25T09:05:56.223866+0000","last_clean":"2024-04-25T09:05:56.223866+0000","last_became_active":"2024-04-25T09:05:55.219366+0000","last_became_peered":"2024-04-25T09:05:55.219366+0000","last_unstale":"2024-04-25T09:05:56.223866+0000","last_undegraded":"2024-04-25T09:05:56.223866+0000","last_fullsized":"2024-04-25T09:05:56.223866+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:28.598212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223740+0000","last_change":"2024-04-25T09:05:55.201262+0000","last_active":"2024-04-25T09:05:56.223740+0000","last_peered":"2024-04-25T09:05:56.223740+0000","last_clean":"2024-04-25T09:05:56.223740+0000","last_became_active":"2024-04-25T09:05:55.200598+0000","last_became_peered":"2024-04-25T09:05:55.200598+0000","last_unstale":"2024-04-25T09:05:56.223740+0000","last_undegraded":"2024-04-25T09:05:56.223740+0000","last_fullsized":"2024-04-25T09:05:56.223740+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:24.962814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223470+0000","last_change":"2024-04-25T09:05:55.205181+0000","last_active":"2024-04-25T09:05:56.223470+0000","last_peered":"2024-04-25T09:05:56.223470+0000","last_clean":"2024-04-25T09:05:56.223470+0000","last_became_active":"2024-04-25T09:05:55.204398+0000","last_became_peered":"2024-04-25T09:05:55.204398+0000","last_unstale":"2024-04-25T09:05:56.223470+0000","last_undegraded":"2024-04-25T09:05:56.223470+0000","last_fullsized":"2024-04-25T09:05:56.223470+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:26.873286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223940+0000","last_change":"2024-04-25T09:05:55.212558+0000","last_active":"2024-04-25T09:05:56.223940+0000","last_peered":"2024-04-25T09:05:56.223940+0000","last_clean":"2024-04-25T09:05:56.223940+0000","last_became_active":"2024-04-25T09:05:55.212302+0000","last_became_peered":"2024-04-25T09:05:55.212302+0000","last_unstale":"2024-04-25T09:05:56.223940+0000","last_undegraded":"2024-04-25T09:05:56.223940+0000","last_fullsized":"2024-04-25T09:05:56.223940+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:46.562069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223610+0000","last_change":"2024-04-25T09:05:55.205780+0000","last_active":"2024-04-25T09:05:56.223610+0000","last_peered":"2024-04-25T09:05:56.223610+0000","last_clean":"2024-04-25T09:05:56.223610+0000","last_became_active":"2024-04-25T09:05:55.205567+0000","last_became_peered":"2024-04-25T09:05:55.205567+0000","last_unstale":"2024-04-25T09:05:56.223610+0000","last_undegraded":"2024-04-25T09:05:56.223610+0000","last_fullsized":"2024-04-25T09:05:56.223610+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:40.637861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223350+0000","last_change":"2024-04-25T09:05:55.217536+0000","last_active":"2024-04-25T09:05:56.223350+0000","last_peered":"2024-04-25T09:05:56.223350+0000","last_clean":"2024-04-25T09:05:56.223350+0000","last_became_active":"2024-04-25T09:05:55.216767+0000","last_became_peered":"2024-04-25T09:05:55.216767+0000","last_unstale":"2024-04-25T09:05:56.223350+0000","last_undegraded":"2024-04-25T09:05:56.223350+0000","last_fullsized":"2024-04-25T09:05:56.223350+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:58.407880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187924+0000","last_change":"2024-04-25T09:05:53.187924+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187924+0000","last_undegraded":"2024-04-25T09:05:53.187924+0000","last_fullsized":"2024-04-25T09:05:53.187924+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187402+0000","last_change":"2024-04-25T09:05:53.187402+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187402+0000","last_undegraded":"2024-04-25T09:05:53.187402+0000","last_fullsized":"2024-04-25T09:05:53.187402+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187333+0000","last_change":"2024-04-25T09:05:53.187333+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187333+0000","last_undegraded":"2024-04-25T09:05:53.187333+0000","last_fullsized":"2024-04-25T09:05:53.187333+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189839+0000","last_change":"2024-04-25T09:05:53.189839+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189839+0000","last_undegraded":"2024-04-25T09:05:53.189839+0000","last_fullsized":"2024-04-25T09:05:53.189839+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.190416+0000","last_change":"2024-04-25T09:05:53.190416+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.190416+0000","last_undegraded":"2024-04-25T09:05:53.190416+0000","last_fullsized":"2024-04-25T09:05:53.190416+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223785+0000","last_change":"2024-04-25T09:05:55.211631+0000","last_active":"2024-04-25T09:05:56.223785+0000","last_peered":"2024-04-25T09:05:56.223785+0000","last_clean":"2024-04-25T09:05:56.223785+0000","last_became_active":"2024-04-25T09:05:55.211374+0000","last_became_peered":"2024-04-25T09:05:55.211374+0000","last_unstale":"2024-04-25T09:05:56.223785+0000","last_undegraded":"2024-04-25T09:05:56.223785+0000","last_fullsized":"2024-04-25T09:05:56.223785+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:10.316296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.186453+0000","last_change":"2024-04-25T09:05:53.186453+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.186453+0000","last_undegraded":"2024-04-25T09:05:53.186453+0000","last_fullsized":"2024-04-25T09:05:53.186453+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187199+0000","last_change":"2024-04-25T09:05:53.187199+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187199+0000","last_undegraded":"2024-04-25T09:05:53.187199+0000","last_fullsized":"2024-04-25T09:05:53.187199+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223891+0000","last_change":"2024-04-25T09:05:55.215366+0000","last_active":"2024-04-25T09:05:56.223891+0000","last_peered":"2024-04-25T09:05:56.223891+0000","last_clean":"2024-04-25T09:05:56.223891+0000","last_became_active":"2024-04-25T09:05:55.215099+0000","last_became_peered":"2024-04-25T09:05:55.215099+0000","last_unstale":"2024-04-25T09:05:56.223891+0000","last_undegraded":"2024-04-25T09:05:56.223891+0000","last_fullsized":"2024-04-25T09:05:56.223891+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:23.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189830+0000","last_change":"2024-04-25T09:05:53.189830+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189830+0000","last_undegraded":"2024-04-25T09:05:53.189830+0000","last_fullsized":"2024-04-25T09:05:53.189830+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223851+0000","last_change":"2024-04-25T09:05:54.210644+0000","last_active":"2024-04-25T09:05:56.223851+0000","last_peered":"2024-04-25T09:05:56.223851+0000","last_clean":"2024-04-25T09:05:56.223851+0000","last_became_active":"2024-04-25T09:05:54.210237+0000","last_became_peered":"2024-04-25T09:05:54.210237+0000","last_unstale":"2024-04-25T09:05:56.223851+0000","last_undegraded":"2024-04-25T09:05:56.223851+0000","last_fullsized":"2024-04-25T09:05:56.223851+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:35.462884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.186420+0000","last_change":"2024-04-25T09:05:53.186420+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.186420+0000","last_undegraded":"2024-04-25T09:05:53.186420+0000","last_fullsized":"2024-04-25T09:05:53.186420+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"55'3","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223882+0000","last_change":"2024-04-25T09:05:54.212021+0000","last_active":"2024-04-25T09:05:56.223882+0000","last_peered":"2024-04-25T09:05:56.223882+0000","last_clean":"2024-04-25T09:05:56.223882+0000","last_became_active":"2024-04-25T09:05:54.211587+0000","last_became_peered":"2024-04-25T09:05:54.211587+0000","last_unstale":"2024-04-25T09:05:56.223882+0000","last_undegraded":"2024-04-25T09:05:56.223882+0000","last_fullsized":"2024-04-25T09:05:56.223882+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:29.891670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189601+0000","last_change":"2024-04-25T09:05:53.189601+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189601+0000","last_undegraded":"2024-04-25T09:05:53.189601+0000","last_fullsized":"2024-04-25T09:05:53.189601+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189971+0000","last_change":"2024-04-25T09:05:53.189971+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189971+0000","last_undegraded":"2024-04-25T09:05:53.189971+0000","last_fullsized":"2024-04-25T09:05:53.189971+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.186976+0000","last_change":"2024-04-25T09:05:53.186976+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.186976+0000","last_undegraded":"2024-04-25T09:05:53.186976+0000","last_fullsized":"2024-04-25T09:05:53.186976+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223453+0000","last_change":"2024-04-25T09:05:54.209026+0000","last_active":"2024-04-25T09:05:56.223453+0000","last_peered":"2024-04-25T09:05:56.223453+0000","last_clean":"2024-04-25T09:05:56.223453+0000","last_became_active":"2024-04-25T09:05:54.208694+0000","last_became_peered":"2024-04-25T09:05:54.208694+0000","last_unstale":"2024-04-25T09:05:56.223453+0000","last_undegraded":"2024-04-25T09:05:56.223453+0000","last_fullsized":"2024-04-25T09:05:56.223453+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:33.050737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189561+0000","last_change":"2024-04-25T09:05:53.189561+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189561+0000","last_undegraded":"2024-04-25T09:05:53.189561+0000","last_fullsized":"2024-04-25T09:05:53.189561+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.190098+0000","last_change":"2024-04-25T09:05:53.190098+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.190098+0000","last_undegraded":"2024-04-25T09:05:53.190098+0000","last_fullsized":"2024-04-25T09:05:53.190098+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.194349+0000","last_change":"2024-04-25T09:05:53.194349+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.194349+0000","last_undegraded":"2024-04-25T09:05:53.194349+0000","last_fullsized":"2024-04-25T09:05:53.194349+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187134+0000","last_change":"2024-04-25T09:05:53.187134+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187134+0000","last_undegraded":"2024-04-25T09:05:53.187134+0000","last_fullsized":"2024-04-25T09:05:53.187134+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187228+0000","last_change":"2024-04-25T09:05:53.187228+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187228+0000","last_undegraded":"2024-04-25T09:05:53.187228+0000","last_fullsized":"2024-04-25T09:05:53.187228+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187311+0000","last_change":"2024-04-25T09:05:53.187311+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187311+0000","last_undegraded":"2024-04-25T09:05:53.187311+0000","last_fullsized":"2024-04-25T09:05:53.187311+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.190493+0000","last_change":"2024-04-25T09:05:53.190493+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.190493+0000","last_undegraded":"2024-04-25T09:05:53.190493+0000","last_fullsized":"2024-04-25T09:05:53.190493+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189775+0000","last_change":"2024-04-25T09:05:53.189775+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189775+0000","last_undegraded":"2024-04-25T09:05:53.189775+0000","last_fullsized":"2024-04-25T09:05:53.189775+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.194023+0000","last_change":"2024-04-25T09:05:53.194023+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.194023+0000","last_undegraded":"2024-04-25T09:05:53.194023+0000","last_fullsized":"2024-04-25T09:05:53.194023+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187298+0000","last_change":"2024-04-25T09:05:53.187298+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187298+0000","last_undegraded":"2024-04-25T09:05:53.187298+0000","last_fullsized":"2024-04-25T09:05:53.187298+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223964+0000","last_change":"2024-04-25T09:05:54.216477+0000","last_active":"2024-04-25T09:05:56.223964+0000","last_peered":"2024-04-25T09:05:56.223964+0000","last_clean":"2024-04-25T09:05:56.223964+0000","last_became_active":"2024-04-25T09:05:54.216178+0000","last_became_peered":"2024-04-25T09:05:54.216178+0000","last_unstale":"2024-04-25T09:05:56.223964+0000","last_undegraded":"2024-04-25T09:05:56.223964+0000","last_fullsized":"2024-04-25T09:05:56.223964+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:09.811164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.190586+0000","last_change":"2024-04-25T09:05:53.190586+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.190586+0000","last_undegraded":"2024-04-25T09:05:53.190586+0000","last_fullsized":"2024-04-25T09:05:53.190586+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189637+0000","last_change":"2024-04-25T09:05:53.189637+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189637+0000","last_undegraded":"2024-04-25T09:05:53.189637+0000","last_fullsized":"2024-04-25T09:05:53.189637+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.190070+0000","last_change":"2024-04-25T09:05:53.190070+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.190070+0000","last_undegraded":"2024-04-25T09:05:53.190070+0000","last_fullsized":"2024-04-25T09:05:53.190070+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.186412+0000","last_change":"2024-04-25T09:05:53.186412+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.186412+0000","last_undegraded":"2024-04-25T09:05:53.186412+0000","last_fullsized":"2024-04-25T09:05:53.186412+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189805+0000","last_change":"2024-04-25T09:05:53.189805+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189805+0000","last_undegraded":"2024-04-25T09:05:53.189805+0000","last_fullsized":"2024-04-25T09:05:53.189805+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.190875+0000","last_change":"2024-04-25T09:05:53.190875+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.190875+0000","last_undegraded":"2024-04-25T09:05:53.190875+0000","last_fullsized":"2024-04-25T09:05:53.190875+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":233,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223303+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:05:56.223303+0000","last_peered":"2024-04-25T09:05:56.223303+0000","last_clean":"2024-04-25T09:05:56.223303+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:05:56.223303+0000","last_undegraded":"2024-04-25T09:05:56.223303+0000","last_fullsized":"2024-04-25T09:05:56.223303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":1},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35940,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335900,"statfs":{"total":96636764160,"available":96599961600,"internally_reserved":0,"allocated":610304,"data_stored":268621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":622592,"data_stored":274830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40112,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331728,"statfs":{"total":96636764160,"available":96595689472,"internally_reserved":0,"allocated":610304,"data_stored":268621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35948,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335892,"statfs":{"total":96636764160,"available":96599953408,"internally_reserved":0,"allocated":622592,"data_stored":274830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35948,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335892,"statfs":{"total":96636764160,"available":96599953408,"internally_reserved":0,"allocated":622592,"data_stored":274830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509483,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35948,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335892,"statfs":{"total":96636764160,"available":96599953408,"internally_reserved":0,"allocated":622592,"data_stored":274830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40692,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331148,"statfs":{"total":96636764160,"available":96595095552,"internally_reserved":0,"allocated":1216512,"data_stored":865198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36576,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335264,"statfs":{"total":96636764160,"available":96599310336,"internally_reserved":0,"allocated":1261568,"data_stored":885848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:05:59.272 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:05:59.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.451+0000 7f4f29000640 1 Processor -- start 2024-04-25T09:05:59.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.451+0000 7f4f29000640 1 -- start start 2024-04-25T09:05:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f29000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f2415edd0 0x7f4f240cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f29000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2415f320 con 0x7f4f240aefa0 2024-04-25T09:05:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f29000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2406d420 con 0x7f4f240b3e70 2024-04-25T09:05:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f29000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2406dd50 con 0x7f4f2415edd0 2024-04-25T09:05:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f19400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4f240aefa0 0x7f4f240cd7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39628/0 (socket says 172.21.15.173:39628) 2024-04-25T09:05:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f19400640 1 -- 172.21.15.173:0/1569821467 learned_addr learned my addr 172.21.15.173:0/1569821467 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:59.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21400640 1 -- 172.21.15.173:0/1569821467 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817543889 0 0) 0x7f4f2415f320 con 0x7f4f240aefa0 2024-04-25T09:05:59.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21400640 1 -- 172.21.15.173:0/1569821467 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f08003530 con 0x7f4f240aefa0 2024-04-25T09:05:59.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f22800640 1 --2- 172.21.15.173:0/1569821467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f2415edd0 0x7f4f240cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21400640 1 -- 172.21.15.173:0/1569821467 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1263642805 0 0) 0x7f4f08003530 con 0x7f4f240aefa0 2024-04-25T09:05:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21400640 1 -- 172.21.15.173:0/1569821467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f2415edd0 msgr2=0x7f4f240cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21400640 1 --2- 172.21.15.173:0/1569821467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f2415edd0 0x7f4f240cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21400640 1 -- 172.21.15.173:0/1569821467 >> v1:172.21.15.194:6789/0 conn(0x7f4f240b3e70 legacy=0x7f4f240b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21400640 1 -- 172.21.15.173:0/1569821467 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2406d700 con 0x7f4f240aefa0 2024-04-25T09:05:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21400640 1 -- 172.21.15.173:0/1569821467 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f4f0c001680 con 0x7f4f240aefa0 2024-04-25T09:05:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21400640 1 -- 172.21.15.173:0/1569821467 >> v1:172.21.15.173:6789/0 conn(0x7f4f240aefa0 legacy=0x7f4f240cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21400640 1 --2- 172.21.15.173:0/1569821467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f080039f0 0x7f4f08003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21400640 1 --2- 172.21.15.173:0/1569821467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f080043c0 0x7f4f08004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21400640 1 --2- 172.21.15.173:0/1569821467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f2415edd0 0x7f4f080050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21400640 1 -- 172.21.15.173:0/1569821467 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2406dd50 con 0x7f4f080039f0 2024-04-25T09:05:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21400640 1 -- 172.21.15.173:0/1569821467 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0800ba30 con 0x7f4f080043c0 2024-04-25T09:05:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21400640 1 -- 172.21.15.173:0/1569821467 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0800de40 con 0x7f4f2415edd0 2024-04-25T09:05:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21e00640 1 --2- 172.21.15.173:0/1569821467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f080039f0 0x7f4f08003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f19400640 1 --2- 172.21.15.173:0/1569821467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f080043c0 0x7f4f08004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f22800640 1 --2- 172.21.15.173:0/1569821467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f2415edd0 0x7f4f080050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21e00640 1 -- 172.21.15.173:0/1569821467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f2415edd0 msgr2=0x7f4f080050f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:59.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21e00640 1 --2- 172.21.15.173:0/1569821467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f2415edd0 0x7f4f080050f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21e00640 1 -- 172.21.15.173:0/1569821467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f080043c0 msgr2=0x7f4f08004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:59.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21e00640 1 --2- 172.21.15.173:0/1569821467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f080043c0 0x7f4f08004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.455+0000 7f4f21e00640 1 -- 172.21.15.173:0/1569821467 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f08003530 con 0x7f4f080039f0 2024-04-25T09:05:59.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.459+0000 7f4f21e00640 1 --2- 172.21.15.173:0/1569821467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f080039f0 0x7f4f08003df0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4f14001f60 tx=0x7f4f1401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251722160f21c5b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.459+0000 7f4f21400640 1 -- 172.21.15.173:0/1569821467 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f140b2070 con 0x7f4f080039f0 2024-04-25T09:05:59.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.459+0000 7f4f21400640 1 -- 172.21.15.173:0/1569821467 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f140a5760 con 0x7f4f080039f0 2024-04-25T09:05:59.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.459+0000 7f4f21400640 1 -- 172.21.15.173:0/1569821467 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f14001b60 con 0x7f4f080039f0 2024-04-25T09:05:59.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.459+0000 7f4f29000640 1 -- 172.21.15.173:0/1569821467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f080039f0 msgr2=0x7f4f08003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.459+0000 7f4f29000640 1 --2- 172.21.15.173:0/1569821467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f080039f0 0x7f4f08003df0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4f14001f60 tx=0x7f4f1401c870 comp rx=0 tx=0).stop 2024-04-25T09:05:59.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.459+0000 7f4f22800640 1 -- 172.21.15.173:0/1569821467 reap_dead start 2024-04-25T09:05:59.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.459+0000 7f4f29000640 1 -- 172.21.15.173:0/1569821467 shutdown_connections 2024-04-25T09:05:59.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.459+0000 7f4f29000640 1 -- 172.21.15.173:0/1569821467 >> 172.21.15.173:0/1569821467 conn(0x7f4f2406ac90 msgr2=0x7f4f2406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:59.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.459+0000 7f4f29000640 1 -- 172.21.15.173:0/1569821467 shutdown_connections 2024-04-25T09:05:59.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.459+0000 7f4f29000640 1 -- 172.21.15.173:0/1569821467 wait complete. 2024-04-25T09:05:59.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f29000640 1 Processor -- start 2024-04-25T09:05:59.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f29000640 1 -- start start 2024-04-25T09:05:59.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f29000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f080039f0 0x7f4f2414abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f29000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f2415cd40 0x7f4f240719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f29000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f24071f20 0x7f4f2415af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f29000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f240714a0 con 0x7f4f2415cd40 2024-04-25T09:05:59.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f29000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f24071320 con 0x7f4f24071f20 2024-04-25T09:05:59.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f29000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f24071620 con 0x7f4f080039f0 2024-04-25T09:05:59.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f19400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f2415cd40 0x7f4f240719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f19400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f2415cd40 0x7f4f240719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50416/0 (socket says 172.21.15.173:50416) 2024-04-25T09:05:59.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f19400640 1 -- 172.21.15.173:0/1300531255 learned_addr learned my addr 172.21.15.173:0/1300531255 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:59.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f22800640 1 --2- 172.21.15.173:0/1300531255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f24071f20 0x7f4f2415af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f21e00640 1 --2- 172.21.15.173:0/1300531255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f080039f0 0x7f4f2414abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f19400640 1 -- 172.21.15.173:0/1300531255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f080039f0 msgr2=0x7f4f2414abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f19400640 1 --2- 172.21.15.173:0/1300531255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f080039f0 0x7f4f2414abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f19400640 1 -- 172.21.15.173:0/1300531255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f24071f20 msgr2=0x7f4f2415af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f19400640 1 --2- 172.21.15.173:0/1300531255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f24071f20 0x7f4f2415af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f19400640 1 -- 172.21.15.173:0/1300531255 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2415bca0 con 0x7f4f2415cd40 2024-04-25T09:05:59.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f19400640 1 --2- 172.21.15.173:0/1300531255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f2415cd40 0x7f4f240719e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c007320 tx=0x7f4f0c007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f1aa00640 1 -- 172.21.15.173:0/1300531255 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c01a070 con 0x7f4f2415cd40 2024-04-25T09:05:59.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f1aa00640 1 -- 172.21.15.173:0/1300531255 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c00f9c0 con 0x7f4f2415cd40 2024-04-25T09:05:59.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f1aa00640 1 -- 172.21.15.173:0/1300531255 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c00fdb0 con 0x7f4f2415cd40 2024-04-25T09:05:59.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f29000640 1 -- 172.21.15.173:0/1300531255 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2415bf80 con 0x7f4f2415cd40 2024-04-25T09:05:59.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f29000640 1 -- 172.21.15.173:0/1300531255 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2415c540 con 0x7f4f2415cd40 2024-04-25T09:05:59.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.463+0000 7f4f29000640 1 -- 172.21.15.173:0/1300531255 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f24073a40 con 0x7f4f2415cd40 2024-04-25T09:05:59.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.467+0000 7f4f1aa00640 1 -- 172.21.15.173:0/1300531255 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4f0c014450 con 0x7f4f2415cd40 2024-04-25T09:05:59.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.467+0000 7f4f1aa00640 1 --2- 172.21.15.173:0/1300531255 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4f00066f90 0x7f4f00069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.467+0000 7f4f1aa00640 1 -- 172.21.15.173:0/1300531255 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4f0c084ac0 con 0x7f4f2415cd40 2024-04-25T09:05:59.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.467+0000 7f4f21e00640 1 --2- 172.21.15.173:0/1300531255 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4f00066f90 0x7f4f00069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.467+0000 7f4f21e00640 1 --2- 172.21.15.173:0/1300531255 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4f00066f90 0x7f4f00069450 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4f140af000 tx=0x7f4f140a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.471+0000 7f4f1aa00640 1 -- 172.21.15.173:0/1300531255 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4f0c0552e0 con 0x7f4f2415cd40 2024-04-25T09:05:59.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.619+0000 7f4f29000640 1 -- 172.21.15.173:0/1300531255 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f24072300 con 0x7f4f00066f90 2024-04-25T09:05:59.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.627+0000 7f4f1aa00640 1 -- 172.21.15.173:0/1300531255 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+241537 (secure 0 0 0) 0x7f4f24072300 con 0x7f4f00066f90 2024-04-25T09:05:59.621 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:59.622 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:05:59.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.631+0000 7f4f29000640 1 -- 172.21.15.173:0/1300531255 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4f00066f90 msgr2=0x7f4f00069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.631+0000 7f4f29000640 1 --2- 172.21.15.173:0/1300531255 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4f00066f90 0x7f4f00069450 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4f140af000 tx=0x7f4f140a7070 comp rx=0 tx=0).stop 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.631+0000 7f4f29000640 1 -- 172.21.15.173:0/1300531255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f2415cd40 msgr2=0x7f4f240719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.631+0000 7f4f29000640 1 --2- 172.21.15.173:0/1300531255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f2415cd40 0x7f4f240719e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c007320 tx=0x7f4f0c007720 comp rx=0 tx=0).stop 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.631+0000 7f4f29000640 1 -- 172.21.15.173:0/1300531255 shutdown_connections 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.631+0000 7f4f29000640 1 --2- 172.21.15.173:0/1300531255 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4f00066f90 0x7f4f00069450 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.631+0000 7f4f29000640 1 --2- 172.21.15.173:0/1300531255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f24071f20 0x7f4f2415af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.631+0000 7f4f29000640 1 --2- 172.21.15.173:0/1300531255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f2415cd40 0x7f4f240719e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.631+0000 7f4f29000640 1 --2- 172.21.15.173:0/1300531255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f080039f0 0x7f4f2414abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.631+0000 7f4f29000640 1 -- 172.21.15.173:0/1300531255 >> 172.21.15.173:0/1300531255 conn(0x7f4f2406ac90 msgr2=0x7f4f241550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.631+0000 7f4f29000640 1 -- 172.21.15.173:0/1300531255 shutdown_connections 2024-04-25T09:05:59.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.631+0000 7f4f29000640 1 -- 172.21.15.173:0/1300531255 wait complete. 2024-04-25T09:05:59.642 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-04-25T09:05:58.765800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":297116,"kb_used_data":6044,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754677604,"statfs":{"total":773094113280,"available":772789866496,"internally_reserved":0,"allocated":6189056,"data_stored":3387608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.581728"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223866+0000","last_change":"2024-04-25T09:05:55.219954+0000","last_active":"2024-04-25T09:05:56.223866+0000","last_peered":"2024-04-25T09:05:56.223866+0000","last_clean":"2024-04-25T09:05:56.223866+0000","last_became_active":"2024-04-25T09:05:55.219366+0000","last_became_peered":"2024-04-25T09:05:55.219366+0000","last_unstale":"2024-04-25T09:05:56.223866+0000","last_undegraded":"2024-04-25T09:05:56.223866+0000","last_fullsized":"2024-04-25T09:05:56.223866+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:28.598212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223740+0000","last_change":"2024-04-25T09:05:55.201262+0000","last_active":"2024-04-25T09:05:56.223740+0000","last_peered":"2024-04-25T09:05:56.223740+0000","last_clean":"2024-04-25T09:05:56.223740+0000","last_became_active":"2024-04-25T09:05:55.200598+0000","last_became_peered":"2024-04-25T09:05:55.200598+0000","last_unstale":"2024-04-25T09:05:56.223740+0000","last_undegraded":"2024-04-25T09:05:56.223740+0000","last_fullsized":"2024-04-25T09:05:56.223740+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:24.962814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223470+0000","last_change":"2024-04-25T09:05:55.205181+0000","last_active":"2024-04-25T09:05:56.223470+0000","last_peered":"2024-04-25T09:05:56.223470+0000","last_clean":"2024-04-25T09:05:56.223470+0000","last_became_active":"2024-04-25T09:05:55.204398+0000","last_became_peered":"2024-04-25T09:05:55.204398+0000","last_unstale":"2024-04-25T09:05:56.223470+0000","last_undegraded":"2024-04-25T09:05:56.223470+0000","last_fullsized":"2024-04-25T09:05:56.223470+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:26.873286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223940+0000","last_change":"2024-04-25T09:05:55.212558+0000","last_active":"2024-04-25T09:05:56.223940+0000","last_peered":"2024-04-25T09:05:56.223940+0000","last_clean":"2024-04-25T09:05:56.223940+0000","last_became_active":"2024-04-25T09:05:55.212302+0000","last_became_peered":"2024-04-25T09:05:55.212302+0000","last_unstale":"2024-04-25T09:05:56.223940+0000","last_undegraded":"2024-04-25T09:05:56.223940+0000","last_fullsized":"2024-04-25T09:05:56.223940+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:46.562069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223610+0000","last_change":"2024-04-25T09:05:55.205780+0000","last_active":"2024-04-25T09:05:56.223610+0000","last_peered":"2024-04-25T09:05:56.223610+0000","last_clean":"2024-04-25T09:05:56.223610+0000","last_became_active":"2024-04-25T09:05:55.205567+0000","last_became_peered":"2024-04-25T09:05:55.205567+0000","last_unstale":"2024-04-25T09:05:56.223610+0000","last_undegraded":"2024-04-25T09:05:56.223610+0000","last_fullsized":"2024-04-25T09:05:56.223610+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:40.637861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223350+0000","last_change":"2024-04-25T09:05:55.217536+0000","last_active":"2024-04-25T09:05:56.223350+0000","last_peered":"2024-04-25T09:05:56.223350+0000","last_clean":"2024-04-25T09:05:56.223350+0000","last_became_active":"2024-04-25T09:05:55.216767+0000","last_became_peered":"2024-04-25T09:05:55.216767+0000","last_unstale":"2024-04-25T09:05:56.223350+0000","last_undegraded":"2024-04-25T09:05:56.223350+0000","last_fullsized":"2024-04-25T09:05:56.223350+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:58.407880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187924+0000","last_change":"2024-04-25T09:05:53.187924+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187924+0000","last_undegraded":"2024-04-25T09:05:53.187924+0000","last_fullsized":"2024-04-25T09:05:53.187924+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187402+0000","last_change":"2024-04-25T09:05:53.187402+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187402+0000","last_undegraded":"2024-04-25T09:05:53.187402+0000","last_fullsized":"2024-04-25T09:05:53.187402+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187333+0000","last_change":"2024-04-25T09:05:53.187333+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187333+0000","last_undegraded":"2024-04-25T09:05:53.187333+0000","last_fullsized":"2024-04-25T09:05:53.187333+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189839+0000","last_change":"2024-04-25T09:05:53.189839+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189839+0000","last_undegraded":"2024-04-25T09:05:53.189839+0000","last_fullsized":"2024-04-25T09:05:53.189839+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.190416+0000","last_change":"2024-04-25T09:05:53.190416+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.190416+0000","last_undegraded":"2024-04-25T09:05:53.190416+0000","last_fullsized":"2024-04-25T09:05:53.190416+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223785+0000","last_change":"2024-04-25T09:05:55.211631+0000","last_active":"2024-04-25T09:05:56.223785+0000","last_peered":"2024-04-25T09:05:56.223785+0000","last_clean":"2024-04-25T09:05:56.223785+0000","last_became_active":"2024-04-25T09:05:55.211374+0000","last_became_peered":"2024-04-25T09:05:55.211374+0000","last_unstale":"2024-04-25T09:05:56.223785+0000","last_undegraded":"2024-04-25T09:05:56.223785+0000","last_fullsized":"2024-04-25T09:05:56.223785+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:10.316296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.186453+0000","last_change":"2024-04-25T09:05:53.186453+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.186453+0000","last_undegraded":"2024-04-25T09:05:53.186453+0000","last_fullsized":"2024-04-25T09:05:53.186453+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187199+0000","last_change":"2024-04-25T09:05:53.187199+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187199+0000","last_undegraded":"2024-04-25T09:05:53.187199+0000","last_fullsized":"2024-04-25T09:05:53.187199+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223891+0000","last_change":"2024-04-25T09:05:55.215366+0000","last_active":"2024-04-25T09:05:56.223891+0000","last_peered":"2024-04-25T09:05:56.223891+0000","last_clean":"2024-04-25T09:05:56.223891+0000","last_became_active":"2024-04-25T09:05:55.215099+0000","last_became_peered":"2024-04-25T09:05:55.215099+0000","last_unstale":"2024-04-25T09:05:56.223891+0000","last_undegraded":"2024-04-25T09:05:56.223891+0000","last_fullsized":"2024-04-25T09:05:56.223891+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:23.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189830+0000","last_change":"2024-04-25T09:05:53.189830+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189830+0000","last_undegraded":"2024-04-25T09:05:53.189830+0000","last_fullsized":"2024-04-25T09:05:53.189830+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223851+0000","last_change":"2024-04-25T09:05:54.210644+0000","last_active":"2024-04-25T09:05:56.223851+0000","last_peered":"2024-04-25T09:05:56.223851+0000","last_clean":"2024-04-25T09:05:56.223851+0000","last_became_active":"2024-04-25T09:05:54.210237+0000","last_became_peered":"2024-04-25T09:05:54.210237+0000","last_unstale":"2024-04-25T09:05:56.223851+0000","last_undegraded":"2024-04-25T09:05:56.223851+0000","last_fullsized":"2024-04-25T09:05:56.223851+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:35.462884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.186420+0000","last_change":"2024-04-25T09:05:53.186420+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.186420+0000","last_undegraded":"2024-04-25T09:05:53.186420+0000","last_fullsized":"2024-04-25T09:05:53.186420+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"55'3","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223882+0000","last_change":"2024-04-25T09:05:54.212021+0000","last_active":"2024-04-25T09:05:56.223882+0000","last_peered":"2024-04-25T09:05:56.223882+0000","last_clean":"2024-04-25T09:05:56.223882+0000","last_became_active":"2024-04-25T09:05:54.211587+0000","last_became_peered":"2024-04-25T09:05:54.211587+0000","last_unstale":"2024-04-25T09:05:56.223882+0000","last_undegraded":"2024-04-25T09:05:56.223882+0000","last_fullsized":"2024-04-25T09:05:56.223882+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:29.891670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189601+0000","last_change":"2024-04-25T09:05:53.189601+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189601+0000","last_undegraded":"2024-04-25T09:05:53.189601+0000","last_fullsized":"2024-04-25T09:05:53.189601+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189971+0000","last_change":"2024-04-25T09:05:53.189971+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189971+0000","last_undegraded":"2024-04-25T09:05:53.189971+0000","last_fullsized":"2024-04-25T09:05:53.189971+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.186976+0000","last_change":"2024-04-25T09:05:53.186976+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.186976+0000","last_undegraded":"2024-04-25T09:05:53.186976+0000","last_fullsized":"2024-04-25T09:05:53.186976+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223453+0000","last_change":"2024-04-25T09:05:54.209026+0000","last_active":"2024-04-25T09:05:56.223453+0000","last_peered":"2024-04-25T09:05:56.223453+0000","last_clean":"2024-04-25T09:05:56.223453+0000","last_became_active":"2024-04-25T09:05:54.208694+0000","last_became_peered":"2024-04-25T09:05:54.208694+0000","last_unstale":"2024-04-25T09:05:56.223453+0000","last_undegraded":"2024-04-25T09:05:56.223453+0000","last_fullsized":"2024-04-25T09:05:56.223453+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:33.050737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189561+0000","last_change":"2024-04-25T09:05:53.189561+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189561+0000","last_undegraded":"2024-04-25T09:05:53.189561+0000","last_fullsized":"2024-04-25T09:05:53.189561+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.190098+0000","last_change":"2024-04-25T09:05:53.190098+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.190098+0000","last_undegraded":"2024-04-25T09:05:53.190098+0000","last_fullsized":"2024-04-25T09:05:53.190098+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.194349+0000","last_change":"2024-04-25T09:05:53.194349+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.194349+0000","last_undegraded":"2024-04-25T09:05:53.194349+0000","last_fullsized":"2024-04-25T09:05:53.194349+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187134+0000","last_change":"2024-04-25T09:05:53.187134+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187134+0000","last_undegraded":"2024-04-25T09:05:53.187134+0000","last_fullsized":"2024-04-25T09:05:53.187134+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187228+0000","last_change":"2024-04-25T09:05:53.187228+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187228+0000","last_undegraded":"2024-04-25T09:05:53.187228+0000","last_fullsized":"2024-04-25T09:05:53.187228+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187311+0000","last_change":"2024-04-25T09:05:53.187311+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187311+0000","last_undegraded":"2024-04-25T09:05:53.187311+0000","last_fullsized":"2024-04-25T09:05:53.187311+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.190493+0000","last_change":"2024-04-25T09:05:53.190493+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.190493+0000","last_undegraded":"2024-04-25T09:05:53.190493+0000","last_fullsized":"2024-04-25T09:05:53.190493+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189775+0000","last_change":"2024-04-25T09:05:53.189775+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189775+0000","last_undegraded":"2024-04-25T09:05:53.189775+0000","last_fullsized":"2024-04-25T09:05:53.189775+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.194023+0000","last_change":"2024-04-25T09:05:53.194023+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.194023+0000","last_undegraded":"2024-04-25T09:05:53.194023+0000","last_fullsized":"2024-04-25T09:05:53.194023+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187298+0000","last_change":"2024-04-25T09:05:53.187298+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187298+0000","last_undegraded":"2024-04-25T09:05:53.187298+0000","last_fullsized":"2024-04-25T09:05:53.187298+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223964+0000","last_change":"2024-04-25T09:05:54.216477+0000","last_active":"2024-04-25T09:05:56.223964+0000","last_peered":"2024-04-25T09:05:56.223964+0000","last_clean":"2024-04-25T09:05:56.223964+0000","last_became_active":"2024-04-25T09:05:54.216178+0000","last_became_peered":"2024-04-25T09:05:54.216178+0000","last_unstale":"2024-04-25T09:05:56.223964+0000","last_undegraded":"2024-04-25T09:05:56.223964+0000","last_fullsized":"2024-04-25T09:05:56.223964+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:09.811164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.190586+0000","last_change":"2024-04-25T09:05:53.190586+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.190586+0000","last_undegraded":"2024-04-25T09:05:53.190586+0000","last_fullsized":"2024-04-25T09:05:53.190586+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189637+0000","last_change":"2024-04-25T09:05:53.189637+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189637+0000","last_undegraded":"2024-04-25T09:05:53.189637+0000","last_fullsized":"2024-04-25T09:05:53.189637+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.190070+0000","last_change":"2024-04-25T09:05:53.190070+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.190070+0000","last_undegraded":"2024-04-25T09:05:53.190070+0000","last_fullsized":"2024-04-25T09:05:53.190070+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.186412+0000","last_change":"2024-04-25T09:05:53.186412+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.186412+0000","last_undegraded":"2024-04-25T09:05:53.186412+0000","last_fullsized":"2024-04-25T09:05:53.186412+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189805+0000","last_change":"2024-04-25T09:05:53.189805+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189805+0000","last_undegraded":"2024-04-25T09:05:53.189805+0000","last_fullsized":"2024-04-25T09:05:53.189805+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.190875+0000","last_change":"2024-04-25T09:05:53.190875+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.190875+0000","last_undegraded":"2024-04-25T09:05:53.190875+0000","last_fullsized":"2024-04-25T09:05:53.190875+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":233,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223303+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:05:56.223303+0000","last_peered":"2024-04-25T09:05:56.223303+0000","last_clean":"2024-04-25T09:05:56.223303+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:05:56.223303+0000","last_undegraded":"2024-04-25T09:05:56.223303+0000","last_fullsized":"2024-04-25T09:05:56.223303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":1},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35940,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335900,"statfs":{"total":96636764160,"available":96599961600,"internally_reserved":0,"allocated":610304,"data_stored":268621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":622592,"data_stored":274830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40112,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331728,"statfs":{"total":96636764160,"available":96595689472,"internally_reserved":0,"allocated":610304,"data_stored":268621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35948,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335892,"statfs":{"total":96636764160,"available":96599953408,"internally_reserved":0,"allocated":622592,"data_stored":274830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35948,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335892,"statfs":{"total":96636764160,"available":96599953408,"internally_reserved":0,"allocated":622592,"data_stored":274830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509483,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35948,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335892,"statfs":{"total":96636764160,"available":96599953408,"internally_reserved":0,"allocated":622592,"data_stored":274830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40692,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331148,"statfs":{"total":96636764160,"available":96595095552,"internally_reserved":0,"allocated":1216512,"data_stored":865198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36576,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335264,"statfs":{"total":96636764160,"available":96599310336,"internally_reserved":0,"allocated":1261568,"data_stored":885848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:05:59.646 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:05:59.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.827+0000 7f36aec00640 1 Processor -- start 2024-04-25T09:05:59.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.827+0000 7f36aec00640 1 -- start start 2024-04-25T09:05:59.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.827+0000 7f36aec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36a80b3e70 0x7f36a80b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.827+0000 7f36aec00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a80b3590 con 0x7f36a80aefa0 2024-04-25T09:05:59.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.827+0000 7f36aec00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a80b4790 con 0x7f36a815edd0 2024-04-25T09:05:59.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.827+0000 7f36aec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a806dd50 con 0x7f36a80b3e70 2024-04-25T09:05:59.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.827+0000 7f369fe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f36a80aefa0 0x7f36a80b2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39634/0 (socket says 172.21.15.173:39634) 2024-04-25T09:05:59.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.831+0000 7f369fe00640 1 -- 172.21.15.173:0/2292377557 learned_addr learned my addr 172.21.15.173:0/2292377557 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:05:59.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.831+0000 7f36a7e00640 1 --2- 172.21.15.173:0/2292377557 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36a80b3e70 0x7f36a80b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.831+0000 7f36a7400640 1 -- 172.21.15.173:0/2292377557 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610882594 0 0) 0x7f36a80b3590 con 0x7f36a80aefa0 2024-04-25T09:05:59.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.831+0000 7f36a7400640 1 -- 172.21.15.173:0/2292377557 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f368c003530 con 0x7f36a80aefa0 2024-04-25T09:05:59.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.831+0000 7f36a7e00640 1 -- 172.21.15.173:0/2292377557 >> v1:172.21.15.194:6789/0 conn(0x7f36a815edd0 legacy=0x7f36a80b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.831+0000 7f36a7400640 1 -- 172.21.15.173:0/2292377557 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240647639 0 0) 0x7f36a80b4790 con 0x7f36a815edd0 2024-04-25T09:05:59.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.831+0000 7f36a7e00640 1 -- 172.21.15.173:0/2292377557 >> v1:172.21.15.173:6789/0 conn(0x7f36a80aefa0 legacy=0x7f36a80b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.831+0000 7f36a7e00640 1 -- 172.21.15.173:0/2292377557 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a815f320 con 0x7f36a80b3e70 2024-04-25T09:05:59.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.831+0000 7f36a7e00640 1 --2- 172.21.15.173:0/2292377557 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36a80b3e70 0x7f36a80b4250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f36980097f0 tx=0x7f369801c2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=524c5c555d53cc3b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.831+0000 7f36a7400640 1 -- 172.21.15.173:0/2292377557 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36980b0070 con 0x7f36a80b3e70 2024-04-25T09:05:59.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36a7400640 1 -- 172.21.15.173:0/2292377557 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36980ab400 con 0x7f36a80b3e70 2024-04-25T09:05:59.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36a7400640 1 -- 172.21.15.173:0/2292377557 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690001680 con 0x7f36a80b3e70 2024-04-25T09:05:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36aec00640 1 -- 172.21.15.173:0/2292377557 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36a80b3e70 msgr2=0x7f36a80b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36aec00640 1 --2- 172.21.15.173:0/2292377557 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36a80b3e70 0x7f36a80b4250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f36980097f0 tx=0x7f369801c2f0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36aec00640 1 -- 172.21.15.173:0/2292377557 shutdown_connections 2024-04-25T09:05:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36aec00640 1 --2- 172.21.15.173:0/2292377557 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36a80b3e70 0x7f36a80b4250 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36aec00640 1 -- 172.21.15.173:0/2292377557 >> 172.21.15.173:0/2292377557 conn(0x7f36a806ac90 msgr2=0x7f36a806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36aec00640 1 -- 172.21.15.173:0/2292377557 shutdown_connections 2024-04-25T09:05:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36aec00640 1 -- 172.21.15.173:0/2292377557 wait complete. 2024-04-25T09:05:59.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36aec00640 1 Processor -- start 2024-04-25T09:05:59.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36aec00640 1 -- start start 2024-04-25T09:05:59.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36aec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36a80aefa0 0x7f36a815b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36aec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36a80b3e70 0x7f36a815d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36aec00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36a815edd0 0x7f36a81f7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36aec00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a815aba0 con 0x7f36a815edd0 2024-04-25T09:05:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36aec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80ce7b0 con 0x7f36a80aefa0 2024-04-25T09:05:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36aec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a806e1e0 con 0x7f36a80b3e70 2024-04-25T09:05:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36acc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36a815edd0 0x7f36a81f7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36acc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36a815edd0 0x7f36a81f7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50430/0 (socket says 172.21.15.173:50430) 2024-04-25T09:05:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36acc00640 1 -- 172.21.15.173:0/82543914 learned_addr learned my addr 172.21.15.173:0/82543914 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:05:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36a7e00640 1 --2- 172.21.15.173:0/82543914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36a80aefa0 0x7f36a815b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f369fe00640 1 --2- 172.21.15.173:0/82543914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36a80b3e70 0x7f36a815d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36acc00640 1 -- 172.21.15.173:0/82543914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36a80b3e70 msgr2=0x7f36a815d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36acc00640 1 --2- 172.21.15.173:0/82543914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36a80b3e70 0x7f36a815d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36acc00640 1 -- 172.21.15.173:0/82543914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36a80aefa0 msgr2=0x7f36a815b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36acc00640 1 --2- 172.21.15.173:0/82543914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36a80aefa0 0x7f36a815b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f36acc00640 1 -- 172.21.15.173:0/82543914 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a815bc70 con 0x7f36a815edd0 2024-04-25T09:05:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.835+0000 7f369fe00640 1 --2- 172.21.15.173:0/82543914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36a80b3e70 0x7f36a815d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.839+0000 7f36acc00640 1 --2- 172.21.15.173:0/82543914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36a815edd0 0x7f36a81f7d30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f36a000c780 tx=0x7f36a000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.839+0000 7f36a4c00640 1 -- 172.21.15.173:0/82543914 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0003db0 con 0x7f36a815edd0 2024-04-25T09:05:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.839+0000 7f36a4c00640 1 -- 172.21.15.173:0/82543914 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a0005070 con 0x7f36a815edd0 2024-04-25T09:05:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.839+0000 7f36a4c00640 1 -- 172.21.15.173:0/82543914 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0005460 con 0x7f36a815edd0 2024-04-25T09:05:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.839+0000 7f36aec00640 1 -- 172.21.15.173:0/82543914 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a81fa700 con 0x7f36a815edd0 2024-04-25T09:05:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.839+0000 7f36aec00640 1 -- 172.21.15.173:0/82543914 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a81facc0 con 0x7f36a815edd0 2024-04-25T09:05:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.839+0000 7f36aec00640 1 -- 172.21.15.173:0/82543914 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a81fb0c0 con 0x7f36a815edd0 2024-04-25T09:05:59.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.839+0000 7f36a4c00640 1 -- 172.21.15.173:0/82543914 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f36a0005600 con 0x7f36a815edd0 2024-04-25T09:05:59.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.839+0000 7f36a4c00640 1 --2- 172.21.15.173:0/82543914 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3684066f60 0x7f3684069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.839+0000 7f36a4c00640 1 -- 172.21.15.173:0/82543914 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f36a0085150 con 0x7f36a815edd0 2024-04-25T09:05:59.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.839+0000 7f36a7e00640 1 --2- 172.21.15.173:0/82543914 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3684066f60 0x7f3684069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.843+0000 7f36a7e00640 1 --2- 172.21.15.173:0/82543914 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3684066f60 0x7f3684069420 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f36980ad000 tx=0x7f36980a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.843+0000 7f36a4c00640 1 -- 172.21.15.173:0/82543914 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f36a815bc70 con 0x7f36a815edd0 2024-04-25T09:05:59.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:05:59.995+0000 7f36aec00640 1 -- 172.21.15.173:0/82543914 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36a8073a40 con 0x7f3684066f60 2024-04-25T09:05:59.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.003+0000 7f36a4c00640 1 -- 172.21.15.173:0/82543914 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+241537 (secure 0 0 0) 0x7f36a8073a40 con 0x7f3684066f60 2024-04-25T09:05:59.997 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:05:59.998 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:05:59.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.007+0000 7f36aec00640 1 -- 172.21.15.173:0/82543914 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3684066f60 msgr2=0x7f3684069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.007+0000 7f36aec00640 1 --2- 172.21.15.173:0/82543914 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3684066f60 0x7f3684069420 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f36980ad000 tx=0x7f36980a6000 comp rx=0 tx=0).stop 2024-04-25T09:05:59.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.007+0000 7f36aec00640 1 -- 172.21.15.173:0/82543914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36a815edd0 msgr2=0x7f36a81f7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.007+0000 7f36aec00640 1 --2- 172.21.15.173:0/82543914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36a815edd0 0x7f36a81f7d30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f36a000c780 tx=0x7f36a000cc40 comp rx=0 tx=0).stop 2024-04-25T09:06:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.007+0000 7f36aec00640 1 -- 172.21.15.173:0/82543914 shutdown_connections 2024-04-25T09:06:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.007+0000 7f36aec00640 1 --2- 172.21.15.173:0/82543914 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3684066f60 0x7f3684069420 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.007+0000 7f36aec00640 1 --2- 172.21.15.173:0/82543914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36a815edd0 0x7f36a81f7d30 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.007+0000 7f36aec00640 1 --2- 172.21.15.173:0/82543914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36a80b3e70 0x7f36a815d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.007+0000 7f36aec00640 1 --2- 172.21.15.173:0/82543914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36a80aefa0 0x7f36a815b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.007+0000 7f36aec00640 1 -- 172.21.15.173:0/82543914 >> 172.21.15.173:0/82543914 conn(0x7f36a806ac90 msgr2=0x7f36a80adbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.007+0000 7f36aec00640 1 -- 172.21.15.173:0/82543914 shutdown_connections 2024-04-25T09:06:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.007+0000 7f36aec00640 1 -- 172.21.15.173:0/82543914 wait complete. 2024-04-25T09:06:00.017 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-04-25T09:05:58.765800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":297116,"kb_used_data":6044,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754677604,"statfs":{"total":773094113280,"available":772789866496,"internally_reserved":0,"allocated":6189056,"data_stored":3387608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.581728"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223866+0000","last_change":"2024-04-25T09:05:55.219954+0000","last_active":"2024-04-25T09:05:56.223866+0000","last_peered":"2024-04-25T09:05:56.223866+0000","last_clean":"2024-04-25T09:05:56.223866+0000","last_became_active":"2024-04-25T09:05:55.219366+0000","last_became_peered":"2024-04-25T09:05:55.219366+0000","last_unstale":"2024-04-25T09:05:56.223866+0000","last_undegraded":"2024-04-25T09:05:56.223866+0000","last_fullsized":"2024-04-25T09:05:56.223866+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:28.598212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223740+0000","last_change":"2024-04-25T09:05:55.201262+0000","last_active":"2024-04-25T09:05:56.223740+0000","last_peered":"2024-04-25T09:05:56.223740+0000","last_clean":"2024-04-25T09:05:56.223740+0000","last_became_active":"2024-04-25T09:05:55.200598+0000","last_became_peered":"2024-04-25T09:05:55.200598+0000","last_unstale":"2024-04-25T09:05:56.223740+0000","last_undegraded":"2024-04-25T09:05:56.223740+0000","last_fullsized":"2024-04-25T09:05:56.223740+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:24.962814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223470+0000","last_change":"2024-04-25T09:05:55.205181+0000","last_active":"2024-04-25T09:05:56.223470+0000","last_peered":"2024-04-25T09:05:56.223470+0000","last_clean":"2024-04-25T09:05:56.223470+0000","last_became_active":"2024-04-25T09:05:55.204398+0000","last_became_peered":"2024-04-25T09:05:55.204398+0000","last_unstale":"2024-04-25T09:05:56.223470+0000","last_undegraded":"2024-04-25T09:05:56.223470+0000","last_fullsized":"2024-04-25T09:05:56.223470+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:26.873286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223940+0000","last_change":"2024-04-25T09:05:55.212558+0000","last_active":"2024-04-25T09:05:56.223940+0000","last_peered":"2024-04-25T09:05:56.223940+0000","last_clean":"2024-04-25T09:05:56.223940+0000","last_became_active":"2024-04-25T09:05:55.212302+0000","last_became_peered":"2024-04-25T09:05:55.212302+0000","last_unstale":"2024-04-25T09:05:56.223940+0000","last_undegraded":"2024-04-25T09:05:56.223940+0000","last_fullsized":"2024-04-25T09:05:56.223940+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:46.562069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223610+0000","last_change":"2024-04-25T09:05:55.205780+0000","last_active":"2024-04-25T09:05:56.223610+0000","last_peered":"2024-04-25T09:05:56.223610+0000","last_clean":"2024-04-25T09:05:56.223610+0000","last_became_active":"2024-04-25T09:05:55.205567+0000","last_became_peered":"2024-04-25T09:05:55.205567+0000","last_unstale":"2024-04-25T09:05:56.223610+0000","last_undegraded":"2024-04-25T09:05:56.223610+0000","last_fullsized":"2024-04-25T09:05:56.223610+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:40.637861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223350+0000","last_change":"2024-04-25T09:05:55.217536+0000","last_active":"2024-04-25T09:05:56.223350+0000","last_peered":"2024-04-25T09:05:56.223350+0000","last_clean":"2024-04-25T09:05:56.223350+0000","last_became_active":"2024-04-25T09:05:55.216767+0000","last_became_peered":"2024-04-25T09:05:55.216767+0000","last_unstale":"2024-04-25T09:05:56.223350+0000","last_undegraded":"2024-04-25T09:05:56.223350+0000","last_fullsized":"2024-04-25T09:05:56.223350+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:58.407880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187924+0000","last_change":"2024-04-25T09:05:53.187924+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187924+0000","last_undegraded":"2024-04-25T09:05:53.187924+0000","last_fullsized":"2024-04-25T09:05:53.187924+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187402+0000","last_change":"2024-04-25T09:05:53.187402+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187402+0000","last_undegraded":"2024-04-25T09:05:53.187402+0000","last_fullsized":"2024-04-25T09:05:53.187402+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187333+0000","last_change":"2024-04-25T09:05:53.187333+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187333+0000","last_undegraded":"2024-04-25T09:05:53.187333+0000","last_fullsized":"2024-04-25T09:05:53.187333+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189839+0000","last_change":"2024-04-25T09:05:53.189839+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189839+0000","last_undegraded":"2024-04-25T09:05:53.189839+0000","last_fullsized":"2024-04-25T09:05:53.189839+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.190416+0000","last_change":"2024-04-25T09:05:53.190416+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.190416+0000","last_undegraded":"2024-04-25T09:05:53.190416+0000","last_fullsized":"2024-04-25T09:05:53.190416+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223785+0000","last_change":"2024-04-25T09:05:55.211631+0000","last_active":"2024-04-25T09:05:56.223785+0000","last_peered":"2024-04-25T09:05:56.223785+0000","last_clean":"2024-04-25T09:05:56.223785+0000","last_became_active":"2024-04-25T09:05:55.211374+0000","last_became_peered":"2024-04-25T09:05:55.211374+0000","last_unstale":"2024-04-25T09:05:56.223785+0000","last_undegraded":"2024-04-25T09:05:56.223785+0000","last_fullsized":"2024-04-25T09:05:56.223785+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:10.316296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.186453+0000","last_change":"2024-04-25T09:05:53.186453+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.186453+0000","last_undegraded":"2024-04-25T09:05:53.186453+0000","last_fullsized":"2024-04-25T09:05:53.186453+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187199+0000","last_change":"2024-04-25T09:05:53.187199+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187199+0000","last_undegraded":"2024-04-25T09:05:53.187199+0000","last_fullsized":"2024-04-25T09:05:53.187199+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223891+0000","last_change":"2024-04-25T09:05:55.215366+0000","last_active":"2024-04-25T09:05:56.223891+0000","last_peered":"2024-04-25T09:05:56.223891+0000","last_clean":"2024-04-25T09:05:56.223891+0000","last_became_active":"2024-04-25T09:05:55.215099+0000","last_became_peered":"2024-04-25T09:05:55.215099+0000","last_unstale":"2024-04-25T09:05:56.223891+0000","last_undegraded":"2024-04-25T09:05:56.223891+0000","last_fullsized":"2024-04-25T09:05:56.223891+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:23.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189830+0000","last_change":"2024-04-25T09:05:53.189830+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189830+0000","last_undegraded":"2024-04-25T09:05:53.189830+0000","last_fullsized":"2024-04-25T09:05:53.189830+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223851+0000","last_change":"2024-04-25T09:05:54.210644+0000","last_active":"2024-04-25T09:05:56.223851+0000","last_peered":"2024-04-25T09:05:56.223851+0000","last_clean":"2024-04-25T09:05:56.223851+0000","last_became_active":"2024-04-25T09:05:54.210237+0000","last_became_peered":"2024-04-25T09:05:54.210237+0000","last_unstale":"2024-04-25T09:05:56.223851+0000","last_undegraded":"2024-04-25T09:05:56.223851+0000","last_fullsized":"2024-04-25T09:05:56.223851+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:35.462884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.186420+0000","last_change":"2024-04-25T09:05:53.186420+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.186420+0000","last_undegraded":"2024-04-25T09:05:53.186420+0000","last_fullsized":"2024-04-25T09:05:53.186420+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"55'3","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223882+0000","last_change":"2024-04-25T09:05:54.212021+0000","last_active":"2024-04-25T09:05:56.223882+0000","last_peered":"2024-04-25T09:05:56.223882+0000","last_clean":"2024-04-25T09:05:56.223882+0000","last_became_active":"2024-04-25T09:05:54.211587+0000","last_became_peered":"2024-04-25T09:05:54.211587+0000","last_unstale":"2024-04-25T09:05:56.223882+0000","last_undegraded":"2024-04-25T09:05:56.223882+0000","last_fullsized":"2024-04-25T09:05:56.223882+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:29.891670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189601+0000","last_change":"2024-04-25T09:05:53.189601+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189601+0000","last_undegraded":"2024-04-25T09:05:53.189601+0000","last_fullsized":"2024-04-25T09:05:53.189601+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189971+0000","last_change":"2024-04-25T09:05:53.189971+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189971+0000","last_undegraded":"2024-04-25T09:05:53.189971+0000","last_fullsized":"2024-04-25T09:05:53.189971+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.186976+0000","last_change":"2024-04-25T09:05:53.186976+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.186976+0000","last_undegraded":"2024-04-25T09:05:53.186976+0000","last_fullsized":"2024-04-25T09:05:53.186976+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223453+0000","last_change":"2024-04-25T09:05:54.209026+0000","last_active":"2024-04-25T09:05:56.223453+0000","last_peered":"2024-04-25T09:05:56.223453+0000","last_clean":"2024-04-25T09:05:56.223453+0000","last_became_active":"2024-04-25T09:05:54.208694+0000","last_became_peered":"2024-04-25T09:05:54.208694+0000","last_unstale":"2024-04-25T09:05:56.223453+0000","last_undegraded":"2024-04-25T09:05:56.223453+0000","last_fullsized":"2024-04-25T09:05:56.223453+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:33.050737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189561+0000","last_change":"2024-04-25T09:05:53.189561+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189561+0000","last_undegraded":"2024-04-25T09:05:53.189561+0000","last_fullsized":"2024-04-25T09:05:53.189561+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.190098+0000","last_change":"2024-04-25T09:05:53.190098+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.190098+0000","last_undegraded":"2024-04-25T09:05:53.190098+0000","last_fullsized":"2024-04-25T09:05:53.190098+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.194349+0000","last_change":"2024-04-25T09:05:53.194349+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.194349+0000","last_undegraded":"2024-04-25T09:05:53.194349+0000","last_fullsized":"2024-04-25T09:05:53.194349+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187134+0000","last_change":"2024-04-25T09:05:53.187134+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187134+0000","last_undegraded":"2024-04-25T09:05:53.187134+0000","last_fullsized":"2024-04-25T09:05:53.187134+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187228+0000","last_change":"2024-04-25T09:05:53.187228+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187228+0000","last_undegraded":"2024-04-25T09:05:53.187228+0000","last_fullsized":"2024-04-25T09:05:53.187228+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187311+0000","last_change":"2024-04-25T09:05:53.187311+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187311+0000","last_undegraded":"2024-04-25T09:05:53.187311+0000","last_fullsized":"2024-04-25T09:05:53.187311+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.190493+0000","last_change":"2024-04-25T09:05:53.190493+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.190493+0000","last_undegraded":"2024-04-25T09:05:53.190493+0000","last_fullsized":"2024-04-25T09:05:53.190493+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189775+0000","last_change":"2024-04-25T09:05:53.189775+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189775+0000","last_undegraded":"2024-04-25T09:05:53.189775+0000","last_fullsized":"2024-04-25T09:05:53.189775+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.194023+0000","last_change":"2024-04-25T09:05:53.194023+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.194023+0000","last_undegraded":"2024-04-25T09:05:53.194023+0000","last_fullsized":"2024-04-25T09:05:53.194023+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.187298+0000","last_change":"2024-04-25T09:05:53.187298+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.187298+0000","last_undegraded":"2024-04-25T09:05:53.187298+0000","last_fullsized":"2024-04-25T09:05:53.187298+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223964+0000","last_change":"2024-04-25T09:05:54.216477+0000","last_active":"2024-04-25T09:05:56.223964+0000","last_peered":"2024-04-25T09:05:56.223964+0000","last_clean":"2024-04-25T09:05:56.223964+0000","last_became_active":"2024-04-25T09:05:54.216178+0000","last_became_peered":"2024-04-25T09:05:54.216178+0000","last_unstale":"2024-04-25T09:05:56.223964+0000","last_undegraded":"2024-04-25T09:05:56.223964+0000","last_fullsized":"2024-04-25T09:05:56.223964+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:09.811164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.190586+0000","last_change":"2024-04-25T09:05:53.190586+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.190586+0000","last_undegraded":"2024-04-25T09:05:53.190586+0000","last_fullsized":"2024-04-25T09:05:53.190586+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189637+0000","last_change":"2024-04-25T09:05:53.189637+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189637+0000","last_undegraded":"2024-04-25T09:05:53.189637+0000","last_fullsized":"2024-04-25T09:05:53.189637+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.190070+0000","last_change":"2024-04-25T09:05:53.190070+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.190070+0000","last_undegraded":"2024-04-25T09:05:53.190070+0000","last_fullsized":"2024-04-25T09:05:53.190070+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.186412+0000","last_change":"2024-04-25T09:05:53.186412+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.186412+0000","last_undegraded":"2024-04-25T09:05:53.186412+0000","last_fullsized":"2024-04-25T09:05:53.186412+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.189805+0000","last_change":"2024-04-25T09:05:53.189805+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.189805+0000","last_undegraded":"2024-04-25T09:05:53.189805+0000","last_fullsized":"2024-04-25T09:05:53.189805+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:05:54.183729+0000","last_change":"2024-04-25T09:05:54.183729+0000","last_active":"2024-04-25T09:05:54.183729+0000","last_peered":"2024-04-25T09:05:54.183729+0000","last_clean":"2024-04-25T09:05:54.183729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:54.183729+0000","last_undegraded":"2024-04-25T09:05:54.183729+0000","last_fullsized":"2024-04-25T09:05:54.183729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-04-25T09:05:53.190875+0000","last_change":"2024-04-25T09:05:53.190875+0000","last_active":"2024-04-25T09:05:53.176744+0000","last_peered":"2024-04-25T09:05:53.176744+0000","last_clean":"2024-04-25T09:05:53.176744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:53.190875+0000","last_undegraded":"2024-04-25T09:05:53.190875+0000","last_fullsized":"2024-04-25T09:05:53.190875+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":233,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223303+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:05:56.223303+0000","last_peered":"2024-04-25T09:05:56.223303+0000","last_clean":"2024-04-25T09:05:56.223303+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:05:56.223303+0000","last_undegraded":"2024-04-25T09:05:56.223303+0000","last_fullsized":"2024-04-25T09:05:56.223303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":1},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35940,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335900,"statfs":{"total":96636764160,"available":96599961600,"internally_reserved":0,"allocated":610304,"data_stored":268621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":622592,"data_stored":274830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40112,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331728,"statfs":{"total":96636764160,"available":96595689472,"internally_reserved":0,"allocated":610304,"data_stored":268621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35948,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335892,"statfs":{"total":96636764160,"available":96599953408,"internally_reserved":0,"allocated":622592,"data_stored":274830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35948,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335892,"statfs":{"total":96636764160,"available":96599953408,"internally_reserved":0,"allocated":622592,"data_stored":274830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509483,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35948,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335892,"statfs":{"total":96636764160,"available":96599953408,"internally_reserved":0,"allocated":622592,"data_stored":274830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40692,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331148,"statfs":{"total":96636764160,"available":96595095552,"internally_reserved":0,"allocated":1216512,"data_stored":865198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36576,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335264,"statfs":{"total":96636764160,"available":96599310336,"internally_reserved":0,"allocated":1261568,"data_stored":885848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:06:00.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2024-04-25T09:06:00.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2024-04-25T09:06:00.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2024-04-25T09:06:00.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2024-04-25T09:06:00.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2024-04-25T09:06:00.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2024-04-25T09:06:00.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2024-04-25T09:06:00.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2024-04-25T09:06:00.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2024-04-25T09:06:00.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2024-04-25T09:06:00.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2024-04-25T09:06:00.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2024-04-25T09:06:00.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2024-04-25T09:06:00.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2024-04-25T09:06:00.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2024-04-25T09:06:00.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2024-04-25T09:06:00.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2024-04-25T09:06:00.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2024-04-25T09:06:00.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2024-04-25T09:06:00.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2024-04-25T09:06:00.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2024-04-25T09:06:00.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2024-04-25T09:06:00.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2024-04-25T09:06:00.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2024-04-25T09:06:00.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2024-04-25T09:06:00.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2024-04-25T09:06:00.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2024-04-25T09:06:00.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2024-04-25T09:06:00.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.187924+0000', 'last_change': '2024-04-25T09:05:53.187924+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.187924+0000', 'last_undegraded': '2024-04-25T09:05:53.187924+0000', 'last_fullsized': '2024-04-25T09:05:53.187924+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:06:00.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2024-04-25T09:06:00.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2024-04-25T09:06:00.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.187402+0000', 'last_change': '2024-04-25T09:05:53.187402+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.187402+0000', 'last_undegraded': '2024-04-25T09:05:53.187402+0000', 'last_fullsized': '2024-04-25T09:05:53.187402+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:06:00.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2024-04-25T09:06:00.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2024-04-25T09:06:00.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.187333+0000', 'last_change': '2024-04-25T09:05:53.187333+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.187333+0000', 'last_undegraded': '2024-04-25T09:05:53.187333+0000', 'last_fullsized': '2024-04-25T09:05:53.187333+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:06:00.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2024-04-25T09:06:00.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2024-04-25T09:06:00.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.189839+0000', 'last_change': '2024-04-25T09:05:53.189839+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.189839+0000', 'last_undegraded': '2024-04-25T09:05:53.189839+0000', 'last_fullsized': '2024-04-25T09:05:53.189839+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:06:00.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2024-04-25T09:06:00.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2024-04-25T09:06:00.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.190416+0000', 'last_change': '2024-04-25T09:05:53.190416+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.190416+0000', 'last_undegraded': '2024-04-25T09:05:53.190416+0000', 'last_fullsized': '2024-04-25T09:05:53.190416+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:06:00.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2024-04-25T09:06:00.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.186453+0000', 'last_change': '2024-04-25T09:05:53.186453+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.186453+0000', 'last_undegraded': '2024-04-25T09:05:53.186453+0000', 'last_fullsized': '2024-04-25T09:05:53.186453+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:06:00.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2024-04-25T09:06:00.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2024-04-25T09:06:00.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.187199+0000', 'last_change': '2024-04-25T09:05:53.187199+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.187199+0000', 'last_undegraded': '2024-04-25T09:05:53.187199+0000', 'last_fullsized': '2024-04-25T09:05:53.187199+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:06:00.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2024-04-25T09:06:00.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.189830+0000', 'last_change': '2024-04-25T09:05:53.189830+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.189830+0000', 'last_undegraded': '2024-04-25T09:05:53.189830+0000', 'last_fullsized': '2024-04-25T09:05:53.189830+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:06:00.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2024-04-25T09:06:00.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2024-04-25T09:06:00.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2024-04-25T09:06:00.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.186420+0000', 'last_change': '2024-04-25T09:05:53.186420+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.186420+0000', 'last_undegraded': '2024-04-25T09:05:53.186420+0000', 'last_fullsized': '2024-04-25T09:05:53.186420+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:06:00.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2024-04-25T09:06:00.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2024-04-25T09:06:00.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2024-04-25T09:06:00.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.189601+0000', 'last_change': '2024-04-25T09:05:53.189601+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.189601+0000', 'last_undegraded': '2024-04-25T09:05:53.189601+0000', 'last_fullsized': '2024-04-25T09:05:53.189601+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:06:00.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2024-04-25T09:06:00.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2024-04-25T09:06:00.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.189971+0000', 'last_change': '2024-04-25T09:05:53.189971+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.189971+0000', 'last_undegraded': '2024-04-25T09:05:53.189971+0000', 'last_fullsized': '2024-04-25T09:05:53.189971+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:06:00.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2024-04-25T09:06:00.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2024-04-25T09:06:00.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.186976+0000', 'last_change': '2024-04-25T09:05:53.186976+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.186976+0000', 'last_undegraded': '2024-04-25T09:05:53.186976+0000', 'last_fullsized': '2024-04-25T09:05:53.186976+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:06:00.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2024-04-25T09:06:00.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2024-04-25T09:06:00.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2024-04-25T09:06:00.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.189561+0000', 'last_change': '2024-04-25T09:05:53.189561+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.189561+0000', 'last_undegraded': '2024-04-25T09:05:53.189561+0000', 'last_fullsized': '2024-04-25T09:05:53.189561+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:06:00.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2024-04-25T09:06:00.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2024-04-25T09:06:00.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.190098+0000', 'last_change': '2024-04-25T09:05:53.190098+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.190098+0000', 'last_undegraded': '2024-04-25T09:05:53.190098+0000', 'last_fullsized': '2024-04-25T09:05:53.190098+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:06:00.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2024-04-25T09:06:00.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2024-04-25T09:06:00.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.194349+0000', 'last_change': '2024-04-25T09:05:53.194349+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.194349+0000', 'last_undegraded': '2024-04-25T09:05:53.194349+0000', 'last_fullsized': '2024-04-25T09:05:53.194349+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:06:00.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2024-04-25T09:06:00.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2024-04-25T09:06:00.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.187134+0000', 'last_change': '2024-04-25T09:05:53.187134+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.187134+0000', 'last_undegraded': '2024-04-25T09:05:53.187134+0000', 'last_fullsized': '2024-04-25T09:05:53.187134+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:06:00.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2024-04-25T09:06:00.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2024-04-25T09:06:00.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.187228+0000', 'last_change': '2024-04-25T09:05:53.187228+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.187228+0000', 'last_undegraded': '2024-04-25T09:05:53.187228+0000', 'last_fullsized': '2024-04-25T09:05:53.187228+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:06:00.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2024-04-25T09:06:00.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2024-04-25T09:06:00.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.187311+0000', 'last_change': '2024-04-25T09:05:53.187311+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.187311+0000', 'last_undegraded': '2024-04-25T09:05:53.187311+0000', 'last_fullsized': '2024-04-25T09:05:53.187311+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:06:00.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2024-04-25T09:06:00.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2024-04-25T09:06:00.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.190493+0000', 'last_change': '2024-04-25T09:05:53.190493+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.190493+0000', 'last_undegraded': '2024-04-25T09:05:53.190493+0000', 'last_fullsized': '2024-04-25T09:05:53.190493+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:06:00.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2024-04-25T09:06:00.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2024-04-25T09:06:00.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.189775+0000', 'last_change': '2024-04-25T09:05:53.189775+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.189775+0000', 'last_undegraded': '2024-04-25T09:05:53.189775+0000', 'last_fullsized': '2024-04-25T09:05:53.189775+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:06:00.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2024-04-25T09:06:00.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2024-04-25T09:06:00.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.194023+0000', 'last_change': '2024-04-25T09:05:53.194023+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.194023+0000', 'last_undegraded': '2024-04-25T09:05:53.194023+0000', 'last_fullsized': '2024-04-25T09:05:53.194023+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:06:00.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2024-04-25T09:06:00.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2024-04-25T09:06:00.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.187298+0000', 'last_change': '2024-04-25T09:05:53.187298+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.187298+0000', 'last_undegraded': '2024-04-25T09:05:53.187298+0000', 'last_fullsized': '2024-04-25T09:05:53.187298+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:06:00.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2024-04-25T09:06:00.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2024-04-25T09:06:00.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2024-04-25T09:06:00.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.190586+0000', 'last_change': '2024-04-25T09:05:53.190586+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.190586+0000', 'last_undegraded': '2024-04-25T09:05:53.190586+0000', 'last_fullsized': '2024-04-25T09:05:53.190586+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:06:00.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2024-04-25T09:06:00.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2024-04-25T09:06:00.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.189637+0000', 'last_change': '2024-04-25T09:05:53.189637+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.189637+0000', 'last_undegraded': '2024-04-25T09:05:53.189637+0000', 'last_fullsized': '2024-04-25T09:05:53.189637+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:06:00.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2024-04-25T09:06:00.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2024-04-25T09:06:00.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.190070+0000', 'last_change': '2024-04-25T09:05:53.190070+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.190070+0000', 'last_undegraded': '2024-04-25T09:05:53.190070+0000', 'last_fullsized': '2024-04-25T09:05:53.190070+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:06:00.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2024-04-25T09:06:00.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2024-04-25T09:06:00.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.186412+0000', 'last_change': '2024-04-25T09:05:53.186412+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.186412+0000', 'last_undegraded': '2024-04-25T09:05:53.186412+0000', 'last_fullsized': '2024-04-25T09:05:53.186412+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:06:00.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2024-04-25T09:06:00.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2024-04-25T09:06:00.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.189805+0000', 'last_change': '2024-04-25T09:05:53.189805+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.189805+0000', 'last_undegraded': '2024-04-25T09:05:53.189805+0000', 'last_fullsized': '2024-04-25T09:05:53.189805+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:06:00.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2024-04-25T09:06:00.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:05:54.183729+0000', 'last_change': '2024-04-25T09:05:54.183729+0000', 'last_active': '2024-04-25T09:05:54.183729+0000', 'last_peered': '2024-04-25T09:05:54.183729+0000', 'last_clean': '2024-04-25T09:05:54.183729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:54.183729+0000', 'last_undegraded': '2024-04-25T09:05:54.183729+0000', 'last_fullsized': '2024-04-25T09:05:54.183729+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:54.183729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:00.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2024-04-25T09:06:00.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:53.190875+0000', 'last_change': '2024-04-25T09:05:53.190875+0000', 'last_active': '2024-04-25T09:05:53.176744+0000', 'last_peered': '2024-04-25T09:05:53.176744+0000', 'last_clean': '2024-04-25T09:05:53.176744+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:53.190875+0000', 'last_undegraded': '2024-04-25T09:05:53.190875+0000', 'last_fullsized': '2024-04-25T09:05:53.190875+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:53.176744+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:06:00.037 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:06:00.166 INFO:tasks.ceph.mds.a.smithi173.stderr:2024-04-25T09:06:00.175+0000 7fbf7e800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:06:00.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.203+0000 7fe1cb200640 1 Processor -- start 2024-04-25T09:06:00.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.203+0000 7fe1cb200640 1 -- start start 2024-04-25T09:06:00.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.207+0000 7fe1cb200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe1cc0b0de0 0x7fe1cc09a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.207+0000 7fe1cb200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe1cc06c0b0 0x7fe1cc06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.207+0000 7fe1cb200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1cc15dd20 con 0x7fe1cc15d940 2024-04-25T09:06:00.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.207+0000 7fe1cb200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc0b13a0 con 0x7fe1cc0b0de0 2024-04-25T09:06:00.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.207+0000 7fe1cb200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc0b1680 con 0x7fe1cc06c0b0 2024-04-25T09:06:00.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.207+0000 7fe1c9400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe1cc0b0de0 0x7fe1cc09a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.207+0000 7fe1c9400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe1cc0b0de0 0x7fe1cc09a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50440/0 (socket says 172.21.15.173:50440) 2024-04-25T09:06:00.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.207+0000 7fe1c9400640 1 -- 172.21.15.173:0/4220168714 learned_addr learned my addr 172.21.15.173:0/4220168714 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:00.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.207+0000 7fe1ca800640 1 --2- 172.21.15.173:0/4220168714 >> v2:172.21.15.194:3300/0 conn(0x7fe1cc06c0b0 0x7fe1cc06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.207+0000 7fe1c9400640 1 -- 172.21.15.173:0/4220168714 >> v2:172.21.15.194:3300/0 conn(0x7fe1cc06c0b0 msgr2=0x7fe1cc06c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:00.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.207+0000 7fe1c9400640 1 --2- 172.21.15.173:0/4220168714 >> v2:172.21.15.194:3300/0 conn(0x7fe1cc06c0b0 0x7fe1cc06c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.207+0000 7fe1c9400640 1 -- 172.21.15.173:0/4220168714 >> v1:172.21.15.194:6789/0 conn(0x7fe1cc15d940 legacy=0x7fe1cc099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.207+0000 7fe1c9400640 1 -- 172.21.15.173:0/4220168714 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc0b1960 con 0x7fe1cc0b0de0 2024-04-25T09:06:00.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.211+0000 7fe1c9400640 1 --2- 172.21.15.173:0/4220168714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1cc0b0de0 0x7fe1cc09a160 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0cbc00 tx=0x7fe1b801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2bf9833b6475fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:00.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.211+0000 7fe1c8a00640 1 -- 172.21.15.173:0/4220168714 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b80ab660 con 0x7fe1cc0b0de0 2024-04-25T09:06:00.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.211+0000 7fe1c8a00640 1 -- 172.21.15.173:0/4220168714 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b80b0070 con 0x7fe1cc0b0de0 2024-04-25T09:06:00.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.211+0000 7fe1c8a00640 1 -- 172.21.15.173:0/4220168714 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b80aba20 con 0x7fe1cc0b0de0 2024-04-25T09:06:00.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.211+0000 7fe1cb200640 1 -- 172.21.15.173:0/4220168714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1cc0b0de0 msgr2=0x7fe1cc09a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.211+0000 7fe1cb200640 1 --2- 172.21.15.173:0/4220168714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1cc0b0de0 0x7fe1cc09a160 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0cbc00 tx=0x7fe1b801c460 comp rx=0 tx=0).stop 2024-04-25T09:06:00.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.211+0000 7fe1cb200640 1 -- 172.21.15.173:0/4220168714 shutdown_connections 2024-04-25T09:06:00.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.211+0000 7fe1cb200640 1 --2- 172.21.15.173:0/4220168714 >> v2:172.21.15.194:3300/0 conn(0x7fe1cc06c0b0 0x7fe1cc06c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.211+0000 7fe1cb200640 1 --2- 172.21.15.173:0/4220168714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1cc0b0de0 0x7fe1cc09a160 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.211+0000 7fe1cb200640 1 -- 172.21.15.173:0/4220168714 >> 172.21.15.173:0/4220168714 conn(0x7fe1cc0d1620 msgr2=0x7fe1cc0d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:00.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.211+0000 7fe1cb200640 1 -- 172.21.15.173:0/4220168714 shutdown_connections 2024-04-25T09:06:00.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.211+0000 7fe1cb200640 1 -- 172.21.15.173:0/4220168714 wait complete. 2024-04-25T09:06:00.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.211+0000 7fe1cb200640 1 Processor -- start 2024-04-25T09:06:00.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.211+0000 7fe1cb200640 1 -- start start 2024-04-25T09:06:00.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1cb200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1cc06c0b0 0x7fe1cc154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1cb200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1cc0b0de0 0x7fe1cc15e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1cb200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1cc15d940 0x7fe1cc156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1cb200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc09a6a0 con 0x7fe1cc06c0b0 2024-04-25T09:06:00.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1cb200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0b2440 con 0x7fe1cc0b0de0 2024-04-25T09:06:00.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1cb200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc09a820 con 0x7fe1cc15d940 2024-04-25T09:06:00.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1c9e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1cc06c0b0 0x7fe1cc154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1c9e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1cc06c0b0 0x7fe1cc154220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50444/0 (socket says 172.21.15.173:50444) 2024-04-25T09:06:00.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1c9e00640 1 -- 172.21.15.173:0/1749182251 learned_addr learned my addr 172.21.15.173:0/1749182251 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:00.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1c9400640 1 --2- 172.21.15.173:0/1749182251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1cc0b0de0 0x7fe1cc15e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1ca800640 1 --2- 172.21.15.173:0/1749182251 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1cc15d940 0x7fe1cc156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1c9e00640 1 -- 172.21.15.173:0/1749182251 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1cc15d940 msgr2=0x7fe1cc156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1c9e00640 1 --2- 172.21.15.173:0/1749182251 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1cc15d940 0x7fe1cc156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1c9e00640 1 -- 172.21.15.173:0/1749182251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1cc0b0de0 msgr2=0x7fe1cc15e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1c9e00640 1 --2- 172.21.15.173:0/1749182251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1cc0b0de0 0x7fe1cc15e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1c9e00640 1 -- 172.21.15.173:0/1749182251 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc15e6e0 con 0x7fe1cc06c0b0 2024-04-25T09:06:00.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1c9e00640 1 --2- 172.21.15.173:0/1749182251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1cc06c0b0 0x7fe1cc154220 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00c420 tx=0x7fe1bc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:00.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1c2000640 1 -- 172.21.15.173:0/1749182251 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc0052d0 con 0x7fe1cc06c0b0 2024-04-25T09:06:00.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1c2000640 1 -- 172.21.15.173:0/1749182251 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc005470 con 0x7fe1cc06c0b0 2024-04-25T09:06:00.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1cb200640 1 -- 172.21.15.173:0/1749182251 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc154a90 con 0x7fe1cc06c0b0 2024-04-25T09:06:00.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1c2000640 1 -- 172.21.15.173:0/1749182251 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc007260 con 0x7fe1cc06c0b0 2024-04-25T09:06:00.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1cb200640 1 -- 172.21.15.173:0/1749182251 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc155050 con 0x7fe1cc06c0b0 2024-04-25T09:06:00.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1cb200640 1 -- 172.21.15.173:0/1749182251 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1cc073a40 con 0x7fe1cc06c0b0 2024-04-25T09:06:00.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.215+0000 7fe1c2000640 1 -- 172.21.15.173:0/1749182251 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe1bc007400 con 0x7fe1cc06c0b0 2024-04-25T09:06:00.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.219+0000 7fe1c2000640 1 --2- 172.21.15.173:0/1749182251 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe1ac066f90 0x7fe1ac069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.219+0000 7fe1c2000640 1 -- 172.21.15.173:0/1749182251 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe1bc084600 con 0x7fe1cc06c0b0 2024-04-25T09:06:00.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.219+0000 7fe1c9400640 1 --2- 172.21.15.173:0/1749182251 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe1ac066f90 0x7fe1ac069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.219+0000 7fe1c9400640 1 --2- 172.21.15.173:0/1749182251 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe1ac066f90 0x7fe1ac069450 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80af000 tx=0x7fe1b80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:00.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.223+0000 7fe1c2000640 1 -- 172.21.15.173:0/1749182251 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe1bc054d90 con 0x7fe1cc06c0b0 2024-04-25T09:06:00.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.435+0000 7fe1cb200640 1 -- 172.21.15.173:0/1749182251 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe1cc15a840 con 0x7fe1cc06c0b0 2024-04-25T09:06:00.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.435+0000 7fe1c2000640 1 -- 172.21.15.173:0/1749182251 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1174 (secure 0 0 0) 0x7fe1bc058e30 con 0x7fe1cc06c0b0 2024-04-25T09:06:00.427 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:00.427 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":214,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":56,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":56},{"state_name":"creating+peering","count":28},{"state_name":"active+clean","count":13}],"num_pgs":97,"num_pools":3,"num_objects":4,"data_bytes":590458,"bytes_used":304246784,"bytes_avail":772789866496,"bytes_total":773094113280,"unknown_pgs_ratio":0.57731956243515015,"inactive_pgs_ratio":0.28865978121757507,"write_bytes_sec":183,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":26,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5874}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-04-25T09:05:42.762822+0000","services":{}},"progress_events":{}} 2024-04-25T09:06:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.439+0000 7fe1cb200640 1 -- 172.21.15.173:0/1749182251 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe1ac066f90 msgr2=0x7fe1ac069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.439+0000 7fe1cb200640 1 --2- 172.21.15.173:0/1749182251 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe1ac066f90 0x7fe1ac069450 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80af000 tx=0x7fe1b80a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.439+0000 7fe1cb200640 1 -- 172.21.15.173:0/1749182251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1cc06c0b0 msgr2=0x7fe1cc154220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.439+0000 7fe1cb200640 1 --2- 172.21.15.173:0/1749182251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1cc06c0b0 0x7fe1cc154220 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00c420 tx=0x7fe1bc00c8e0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.439+0000 7fe1cb200640 1 -- 172.21.15.173:0/1749182251 shutdown_connections 2024-04-25T09:06:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.439+0000 7fe1cb200640 1 --2- 172.21.15.173:0/1749182251 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe1ac066f90 0x7fe1ac069450 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.439+0000 7fe1cb200640 1 --2- 172.21.15.173:0/1749182251 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1cc15d940 0x7fe1cc156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.439+0000 7fe1cb200640 1 --2- 172.21.15.173:0/1749182251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1cc0b0de0 0x7fe1cc15e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.439+0000 7fe1cb200640 1 --2- 172.21.15.173:0/1749182251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1cc06c0b0 0x7fe1cc154220 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.439+0000 7fe1cb200640 1 -- 172.21.15.173:0/1749182251 >> 172.21.15.173:0/1749182251 conn(0x7fe1cc0d1620 msgr2=0x7fe1cc0ae390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.439+0000 7fe1cb200640 1 -- 172.21.15.173:0/1749182251 shutdown_connections 2024-04-25T09:06:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.439+0000 7fe1cb200640 1 -- 172.21.15.173:0/1749182251 wait complete. 2024-04-25T09:06:00.449 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:06:00.449 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:06:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.595+0000 7f46c4a00640 1 Processor -- start 2024-04-25T09:06:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.595+0000 7f46c4a00640 1 -- start start 2024-04-25T09:06:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.595+0000 7f46c4a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f46c00cf850 0x7f46c00616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.595+0000 7f46c4a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c00af810 con 0x7f46c00af3c0 2024-04-25T09:06:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.595+0000 7f46c4a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c0061c90 con 0x7f46c006ffa0 2024-04-25T09:06:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.595+0000 7f46c4a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c00ad0e0 con 0x7f46c00cf850 2024-04-25T09:06:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.595+0000 7f46b7e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f46c00cf850 0x7f46c00616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.595+0000 7f46b7e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f46c00cf850 0x7f46c00616b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50452/0 (socket says 172.21.15.173:50452) 2024-04-25T09:06:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.595+0000 7f46b7e00640 1 -- 172.21.15.173:0/4052188614 learned_addr learned my addr 172.21.15.173:0/4052188614 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.595+0000 7f46bf200640 1 --1- 172.21.15.173:0/4052188614 >> v1:172.21.15.173:6789/0 conn(0x7f46c00af3c0 0x7f46c015f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39650/0 (socket says 172.21.15.173:39650) 2024-04-25T09:06:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.595+0000 7f46b7e00640 1 -- 172.21.15.173:0/4052188614 >> v1:172.21.15.194:6789/0 conn(0x7f46c006ffa0 legacy=0x7f46c00cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.595+0000 7f46b7e00640 1 -- 172.21.15.173:0/4052188614 >> v1:172.21.15.173:6789/0 conn(0x7f46c00af3c0 legacy=0x7f46c015f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.595+0000 7f46b7e00640 1 -- 172.21.15.173:0/4052188614 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c015bf10 con 0x7f46c00cf850 2024-04-25T09:06:00.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.599+0000 7f46b7e00640 1 --2- 172.21.15.173:0/4052188614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c00cf850 0x7f46c00616b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009870 tx=0x7f46a801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b343f3639a0361 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:00.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.599+0000 7f46bde00640 1 -- 172.21.15.173:0/4052188614 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a80ab650 con 0x7f46c00cf850 2024-04-25T09:06:00.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.599+0000 7f46bde00640 1 -- 172.21.15.173:0/4052188614 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a80b0070 con 0x7f46c00cf850 2024-04-25T09:06:00.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.599+0000 7f46bde00640 1 -- 172.21.15.173:0/4052188614 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a80aba10 con 0x7f46c00cf850 2024-04-25T09:06:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.599+0000 7f46c4a00640 1 -- 172.21.15.173:0/4052188614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c00cf850 msgr2=0x7f46c00616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.599+0000 7f46c4a00640 1 --2- 172.21.15.173:0/4052188614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c00cf850 0x7f46c00616b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009870 tx=0x7f46a801c560 comp rx=0 tx=0).stop 2024-04-25T09:06:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.599+0000 7f46c4a00640 1 -- 172.21.15.173:0/4052188614 shutdown_connections 2024-04-25T09:06:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.599+0000 7f46c4a00640 1 --2- 172.21.15.173:0/4052188614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c00cf850 0x7f46c00616b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.599+0000 7f46c4a00640 1 -- 172.21.15.173:0/4052188614 >> 172.21.15.173:0/4052188614 conn(0x7f46c00cc800 msgr2=0x7f46c00ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:00.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.599+0000 7f46c4a00640 1 -- 172.21.15.173:0/4052188614 shutdown_connections 2024-04-25T09:06:00.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.599+0000 7f46c4a00640 1 -- 172.21.15.173:0/4052188614 wait complete. 2024-04-25T09:06:00.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.599+0000 7f46c4a00640 1 Processor -- start 2024-04-25T09:06:00.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.599+0000 7f46c4a00640 1 -- start start 2024-04-25T09:06:00.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46c4a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46c006ffa0 0x7f46c014cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46c4a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c00af3c0 0x7f46c0146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46c4a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c00cf850 0x7f46c014f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46c4a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c01697a0 con 0x7f46c00cf850 2024-04-25T09:06:00.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46c4a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c015ccd0 con 0x7f46c00af3c0 2024-04-25T09:06:00.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46c4a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0169920 con 0x7f46c006ffa0 2024-04-25T09:06:00.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46bf200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c00cf850 0x7f46c014f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46bf200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c00cf850 0x7f46c014f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50466/0 (socket says 172.21.15.173:50466) 2024-04-25T09:06:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46bf200640 1 -- 172.21.15.173:0/545662371 learned_addr learned my addr 172.21.15.173:0/545662371 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46b7e00640 1 --2- 172.21.15.173:0/545662371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c00af3c0 0x7f46c0146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46be800640 1 --2- 172.21.15.173:0/545662371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46c006ffa0 0x7f46c014cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46bf200640 1 -- 172.21.15.173:0/545662371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46c006ffa0 msgr2=0x7f46c014cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46bf200640 1 --2- 172.21.15.173:0/545662371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46c006ffa0 0x7f46c014cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46bf200640 1 -- 172.21.15.173:0/545662371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c00af3c0 msgr2=0x7f46c0146ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46bf200640 1 --2- 172.21.15.173:0/545662371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c00af3c0 0x7f46c0146ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46bf200640 1 -- 172.21.15.173:0/545662371 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c01473e0 con 0x7f46c00cf850 2024-04-25T09:06:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46b7e00640 1 --2- 172.21.15.173:0/545662371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c00af3c0 0x7f46c0146ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46bf200640 1 --2- 172.21.15.173:0/545662371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c00cf850 0x7f46c014f130 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f46b800c7a0 tx=0x7f46b800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46b6a00640 1 -- 172.21.15.173:0/545662371 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8017070 con 0x7f46c00cf850 2024-04-25T09:06:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46b6a00640 1 -- 172.21.15.173:0/545662371 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b800a640 con 0x7f46c00cf850 2024-04-25T09:06:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46c4a00640 1 -- 172.21.15.173:0/545662371 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c0150a90 con 0x7f46c00cf850 2024-04-25T09:06:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46b6a00640 1 -- 172.21.15.173:0/545662371 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b800a9f0 con 0x7f46c00cf850 2024-04-25T09:06:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46c4a00640 1 -- 172.21.15.173:0/545662371 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c014fcd0 con 0x7f46c00cf850 2024-04-25T09:06:00.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46c4a00640 1 -- 172.21.15.173:0/545662371 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c0073a40 con 0x7f46c00cf850 2024-04-25T09:06:00.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.603+0000 7f46b6a00640 1 -- 172.21.15.173:0/545662371 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f46b801a070 con 0x7f46c00cf850 2024-04-25T09:06:00.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.607+0000 7f46b6a00640 1 --2- 172.21.15.173:0/545662371 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f469c066f60 0x7f469c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.607+0000 7f46b6a00640 1 -- 172.21.15.173:0/545662371 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f46b8084750 con 0x7f46c00cf850 2024-04-25T09:06:00.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.607+0000 7f46be800640 1 --2- 172.21.15.173:0/545662371 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f469c066f60 0x7f469c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.607+0000 7f46be800640 1 --2- 172.21.15.173:0/545662371 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f469c066f60 0x7f469c069420 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f46b0001650 tx=0x7f46b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:00.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.611+0000 7f46b6a00640 1 -- 172.21.15.173:0/545662371 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f46b8054f80 con 0x7f46c00cf850 2024-04-25T09:06:00.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.767+0000 7f46c4a00640 1 -- 172.21.15.173:0/545662371 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46c00cd8e0 con 0x7f469c066f60 2024-04-25T09:06:00.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.771+0000 7f46b6a00640 1 -- 172.21.15.173:0/545662371 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251955 (secure 0 0 0) 0x7f46c00cd8e0 con 0x7f469c066f60 2024-04-25T09:06:00.765 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:00.768 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:06:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.775+0000 7f46c4a00640 1 -- 172.21.15.173:0/545662371 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f469c066f60 msgr2=0x7f469c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.775+0000 7f46c4a00640 1 --2- 172.21.15.173:0/545662371 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f469c066f60 0x7f469c069420 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f46b0001650 tx=0x7f46b0009040 comp rx=0 tx=0).stop 2024-04-25T09:06:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.775+0000 7f46c4a00640 1 -- 172.21.15.173:0/545662371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c00cf850 msgr2=0x7f46c014f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.775+0000 7f46c4a00640 1 --2- 172.21.15.173:0/545662371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c00cf850 0x7f46c014f130 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f46b800c7a0 tx=0x7f46b800cc60 comp rx=0 tx=0).stop 2024-04-25T09:06:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.775+0000 7f46c4a00640 1 -- 172.21.15.173:0/545662371 shutdown_connections 2024-04-25T09:06:00.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.775+0000 7f46c4a00640 1 --2- 172.21.15.173:0/545662371 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f469c066f60 0x7f469c069420 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.775+0000 7f46c4a00640 1 --2- 172.21.15.173:0/545662371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c00cf850 0x7f46c014f130 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.775+0000 7f46c4a00640 1 --2- 172.21.15.173:0/545662371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c00af3c0 0x7f46c0146ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.775+0000 7f46c4a00640 1 --2- 172.21.15.173:0/545662371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46c006ffa0 0x7f46c014cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.775+0000 7f46c4a00640 1 -- 172.21.15.173:0/545662371 >> 172.21.15.173:0/545662371 conn(0x7f46c00cc800 msgr2=0x7f46c0151460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:00.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.775+0000 7f46c4a00640 1 -- 172.21.15.173:0/545662371 shutdown_connections 2024-04-25T09:06:00.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:00.775+0000 7f46c4a00640 1 -- 172.21.15.173:0/545662371 wait complete. 2024-04-25T09:06:00.787 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-04-25T09:06:00.766209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":297440,"kb_used_data":6376,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754677280,"statfs":{"total":773094113280,"available":772789534720,"internally_reserved":0,"allocated":6529024,"data_stored":3548404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.574961"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720824+0000","last_change":"2024-04-25T09:05:55.221942+0000","last_active":"2024-04-25T09:05:56.720824+0000","last_peered":"2024-04-25T09:05:56.720824+0000","last_clean":"2024-04-25T09:05:56.720824+0000","last_became_active":"2024-04-25T09:05:55.221580+0000","last_became_peered":"2024-04-25T09:05:55.221580+0000","last_unstale":"2024-04-25T09:05:56.720824+0000","last_undegraded":"2024-04-25T09:05:56.720824+0000","last_fullsized":"2024-04-25T09:05:56.720824+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:09.646750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223866+0000","last_change":"2024-04-25T09:05:55.219954+0000","last_active":"2024-04-25T09:05:56.223866+0000","last_peered":"2024-04-25T09:05:56.223866+0000","last_clean":"2024-04-25T09:05:56.223866+0000","last_became_active":"2024-04-25T09:05:55.219366+0000","last_became_peered":"2024-04-25T09:05:55.219366+0000","last_unstale":"2024-04-25T09:05:56.223866+0000","last_undegraded":"2024-04-25T09:05:56.223866+0000","last_fullsized":"2024-04-25T09:05:56.223866+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:28.598212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219196+0000","last_change":"2024-04-25T09:05:55.226082+0000","last_active":"2024-04-25T09:05:56.219196+0000","last_peered":"2024-04-25T09:05:56.219196+0000","last_clean":"2024-04-25T09:05:56.219196+0000","last_became_active":"2024-04-25T09:05:55.225723+0000","last_became_peered":"2024-04-25T09:05:55.225723+0000","last_unstale":"2024-04-25T09:05:56.219196+0000","last_undegraded":"2024-04-25T09:05:56.219196+0000","last_fullsized":"2024-04-25T09:05:56.219196+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:24.962814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223740+0000","last_change":"2024-04-25T09:05:55.201262+0000","last_active":"2024-04-25T09:05:56.223740+0000","last_peered":"2024-04-25T09:05:56.223740+0000","last_clean":"2024-04-25T09:05:56.223740+0000","last_became_active":"2024-04-25T09:05:55.200598+0000","last_became_peered":"2024-04-25T09:05:55.200598+0000","last_unstale":"2024-04-25T09:05:56.223740+0000","last_undegraded":"2024-04-25T09:05:56.223740+0000","last_fullsized":"2024-04-25T09:05:56.223740+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:24.962814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.221593+0000","last_change":"2024-04-25T09:05:55.205084+0000","last_active":"2024-04-25T09:05:56.221593+0000","last_peered":"2024-04-25T09:05:56.221593+0000","last_clean":"2024-04-25T09:05:56.221593+0000","last_became_active":"2024-04-25T09:05:55.204319+0000","last_became_peered":"2024-04-25T09:05:55.204319+0000","last_unstale":"2024-04-25T09:05:56.221593+0000","last_undegraded":"2024-04-25T09:05:56.221593+0000","last_fullsized":"2024-04-25T09:05:56.221593+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:04.969177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720506+0000","last_change":"2024-04-25T09:05:55.219356+0000","last_active":"2024-04-25T09:05:56.720506+0000","last_peered":"2024-04-25T09:05:56.720506+0000","last_clean":"2024-04-25T09:05:56.720506+0000","last_became_active":"2024-04-25T09:05:55.219114+0000","last_became_peered":"2024-04-25T09:05:55.219114+0000","last_unstale":"2024-04-25T09:05:56.720506+0000","last_undegraded":"2024-04-25T09:05:56.720506+0000","last_fullsized":"2024-04-25T09:05:56.720506+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:42.431288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218499+0000","last_change":"2024-04-25T09:05:55.226755+0000","last_active":"2024-04-25T09:05:56.218499+0000","last_peered":"2024-04-25T09:05:56.218499+0000","last_clean":"2024-04-25T09:05:56.218499+0000","last_became_active":"2024-04-25T09:05:55.226223+0000","last_became_peered":"2024-04-25T09:05:55.226223+0000","last_unstale":"2024-04-25T09:05:56.218499+0000","last_undegraded":"2024-04-25T09:05:56.218499+0000","last_fullsized":"2024-04-25T09:05:56.218499+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:05.701545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720518+0000","last_change":"2024-04-25T09:05:55.223143+0000","last_active":"2024-04-25T09:05:56.720518+0000","last_peered":"2024-04-25T09:05:56.720518+0000","last_clean":"2024-04-25T09:05:56.720518+0000","last_became_active":"2024-04-25T09:05:55.222550+0000","last_became_peered":"2024-04-25T09:05:55.222550+0000","last_unstale":"2024-04-25T09:05:56.720518+0000","last_undegraded":"2024-04-25T09:05:56.720518+0000","last_fullsized":"2024-04-25T09:05:56.720518+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:26.194099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721454+0000","last_change":"2024-04-25T09:05:55.222899+0000","last_active":"2024-04-25T09:05:56.721454+0000","last_peered":"2024-04-25T09:05:56.721454+0000","last_clean":"2024-04-25T09:05:56.721454+0000","last_became_active":"2024-04-25T09:05:55.222471+0000","last_became_peered":"2024-04-25T09:05:55.222471+0000","last_unstale":"2024-04-25T09:05:56.721454+0000","last_undegraded":"2024-04-25T09:05:56.721454+0000","last_fullsized":"2024-04-25T09:05:56.721454+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:35.649081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720770+0000","last_change":"2024-04-25T09:05:55.217788+0000","last_active":"2024-04-25T09:05:56.720770+0000","last_peered":"2024-04-25T09:05:56.720770+0000","last_clean":"2024-04-25T09:05:56.720770+0000","last_became_active":"2024-04-25T09:05:55.217479+0000","last_became_peered":"2024-04-25T09:05:55.217479+0000","last_unstale":"2024-04-25T09:05:56.720770+0000","last_undegraded":"2024-04-25T09:05:56.720770+0000","last_fullsized":"2024-04-25T09:05:56.720770+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:12.217572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.220868+0000","last_change":"2024-04-25T09:05:55.218467+0000","last_active":"2024-04-25T09:05:56.220868+0000","last_peered":"2024-04-25T09:05:56.220868+0000","last_clean":"2024-04-25T09:05:56.220868+0000","last_became_active":"2024-04-25T09:05:55.217196+0000","last_became_peered":"2024-04-25T09:05:55.217196+0000","last_unstale":"2024-04-25T09:05:56.220868+0000","last_undegraded":"2024-04-25T09:05:56.220868+0000","last_fullsized":"2024-04-25T09:05:56.220868+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:01.803379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721288+0000","last_change":"2024-04-25T09:05:55.208680+0000","last_active":"2024-04-25T09:05:56.721288+0000","last_peered":"2024-04-25T09:05:56.721288+0000","last_clean":"2024-04-25T09:05:56.721288+0000","last_became_active":"2024-04-25T09:05:55.208416+0000","last_became_peered":"2024-04-25T09:05:55.208416+0000","last_unstale":"2024-04-25T09:05:56.721288+0000","last_undegraded":"2024-04-25T09:05:56.721288+0000","last_fullsized":"2024-04-25T09:05:56.721288+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:35.138879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720448+0000","last_change":"2024-04-25T09:05:55.212042+0000","last_active":"2024-04-25T09:05:56.720448+0000","last_peered":"2024-04-25T09:05:56.720448+0000","last_clean":"2024-04-25T09:05:56.720448+0000","last_became_active":"2024-04-25T09:05:55.211771+0000","last_became_peered":"2024-04-25T09:05:55.211771+0000","last_unstale":"2024-04-25T09:05:56.720448+0000","last_undegraded":"2024-04-25T09:05:56.720448+0000","last_fullsized":"2024-04-25T09:05:56.720448+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:17.784163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218708+0000","last_change":"2024-04-25T09:05:55.226358+0000","last_active":"2024-04-25T09:05:56.218708+0000","last_peered":"2024-04-25T09:05:56.218708+0000","last_clean":"2024-04-25T09:05:56.218708+0000","last_became_active":"2024-04-25T09:05:55.226111+0000","last_became_peered":"2024-04-25T09:05:55.226111+0000","last_unstale":"2024-04-25T09:05:56.218708+0000","last_undegraded":"2024-04-25T09:05:56.218708+0000","last_fullsized":"2024-04-25T09:05:56.218708+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:59.371854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223470+0000","last_change":"2024-04-25T09:05:55.205181+0000","last_active":"2024-04-25T09:05:56.223470+0000","last_peered":"2024-04-25T09:05:56.223470+0000","last_clean":"2024-04-25T09:05:56.223470+0000","last_became_active":"2024-04-25T09:05:55.204398+0000","last_became_peered":"2024-04-25T09:05:55.204398+0000","last_unstale":"2024-04-25T09:05:56.223470+0000","last_undegraded":"2024-04-25T09:05:56.223470+0000","last_fullsized":"2024-04-25T09:05:56.223470+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:26.873286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720345+0000","last_change":"2024-04-25T09:05:55.210716+0000","last_active":"2024-04-25T09:05:56.720345+0000","last_peered":"2024-04-25T09:05:56.720345+0000","last_clean":"2024-04-25T09:05:56.720345+0000","last_became_active":"2024-04-25T09:05:55.210437+0000","last_became_peered":"2024-04-25T09:05:55.210437+0000","last_unstale":"2024-04-25T09:05:56.720345+0000","last_undegraded":"2024-04-25T09:05:56.720345+0000","last_fullsized":"2024-04-25T09:05:56.720345+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:56.576485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219437+0000","last_change":"2024-04-25T09:05:55.215568+0000","last_active":"2024-04-25T09:05:56.219437+0000","last_peered":"2024-04-25T09:05:56.219437+0000","last_clean":"2024-04-25T09:05:56.219437+0000","last_became_active":"2024-04-25T09:05:55.215258+0000","last_became_peered":"2024-04-25T09:05:55.215258+0000","last_unstale":"2024-04-25T09:05:56.219437+0000","last_undegraded":"2024-04-25T09:05:56.219437+0000","last_fullsized":"2024-04-25T09:05:56.219437+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:23.801323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223940+0000","last_change":"2024-04-25T09:05:55.212558+0000","last_active":"2024-04-25T09:05:56.223940+0000","last_peered":"2024-04-25T09:05:56.223940+0000","last_clean":"2024-04-25T09:05:56.223940+0000","last_became_active":"2024-04-25T09:05:55.212302+0000","last_became_peered":"2024-04-25T09:05:55.212302+0000","last_unstale":"2024-04-25T09:05:56.223940+0000","last_undegraded":"2024-04-25T09:05:56.223940+0000","last_fullsized":"2024-04-25T09:05:56.223940+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:46.562069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219171+0000","last_change":"2024-04-25T09:05:55.216218+0000","last_active":"2024-04-25T09:05:56.219171+0000","last_peered":"2024-04-25T09:05:56.219171+0000","last_clean":"2024-04-25T09:05:56.219171+0000","last_became_active":"2024-04-25T09:05:55.215654+0000","last_became_peered":"2024-04-25T09:05:55.215654+0000","last_unstale":"2024-04-25T09:05:56.219171+0000","last_undegraded":"2024-04-25T09:05:56.219171+0000","last_fullsized":"2024-04-25T09:05:56.219171+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:40.637861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721164+0000","last_change":"2024-04-25T09:05:55.208803+0000","last_active":"2024-04-25T09:05:56.721164+0000","last_peered":"2024-04-25T09:05:56.721164+0000","last_clean":"2024-04-25T09:05:56.721164+0000","last_became_active":"2024-04-25T09:05:55.208507+0000","last_became_peered":"2024-04-25T09:05:55.208507+0000","last_unstale":"2024-04-25T09:05:56.721164+0000","last_undegraded":"2024-04-25T09:05:56.721164+0000","last_fullsized":"2024-04-25T09:05:56.721164+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:18.982237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720973+0000","last_change":"2024-04-25T09:05:55.215220+0000","last_active":"2024-04-25T09:05:56.720973+0000","last_peered":"2024-04-25T09:05:56.720973+0000","last_clean":"2024-04-25T09:05:56.720973+0000","last_became_active":"2024-04-25T09:05:55.214549+0000","last_became_peered":"2024-04-25T09:05:55.214549+0000","last_unstale":"2024-04-25T09:05:56.720973+0000","last_undegraded":"2024-04-25T09:05:56.720973+0000","last_fullsized":"2024-04-25T09:05:56.720973+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:45.957424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720685+0000","last_change":"2024-04-25T09:05:55.219026+0000","last_active":"2024-04-25T09:05:56.720685+0000","last_peered":"2024-04-25T09:05:56.720685+0000","last_clean":"2024-04-25T09:05:56.720685+0000","last_became_active":"2024-04-25T09:05:55.218756+0000","last_became_peered":"2024-04-25T09:05:55.218756+0000","last_unstale":"2024-04-25T09:05:56.720685+0000","last_undegraded":"2024-04-25T09:05:56.720685+0000","last_fullsized":"2024-04-25T09:05:56.720685+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:50.222180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.220707+0000","last_change":"2024-04-25T09:05:55.217820+0000","last_active":"2024-04-25T09:05:56.220707+0000","last_peered":"2024-04-25T09:05:56.220707+0000","last_clean":"2024-04-25T09:05:56.220707+0000","last_became_active":"2024-04-25T09:05:55.217488+0000","last_became_peered":"2024-04-25T09:05:55.217488+0000","last_unstale":"2024-04-25T09:05:56.220707+0000","last_undegraded":"2024-04-25T09:05:56.220707+0000","last_fullsized":"2024-04-25T09:05:56.220707+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:51.771563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218445+0000","last_change":"2024-04-25T09:05:55.231495+0000","last_active":"2024-04-25T09:05:56.218445+0000","last_peered":"2024-04-25T09:05:56.218445+0000","last_clean":"2024-04-25T09:05:56.218445+0000","last_became_active":"2024-04-25T09:05:55.225771+0000","last_became_peered":"2024-04-25T09:05:55.225771+0000","last_unstale":"2024-04-25T09:05:56.218445+0000","last_undegraded":"2024-04-25T09:05:56.218445+0000","last_fullsized":"2024-04-25T09:05:56.218445+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:25.181612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219512+0000","last_change":"2024-04-25T09:05:55.237107+0000","last_active":"2024-04-25T09:05:56.219512+0000","last_peered":"2024-04-25T09:05:56.219512+0000","last_clean":"2024-04-25T09:05:56.219512+0000","last_became_active":"2024-04-25T09:05:55.236834+0000","last_became_peered":"2024-04-25T09:05:55.236834+0000","last_unstale":"2024-04-25T09:05:56.219512+0000","last_undegraded":"2024-04-25T09:05:56.219512+0000","last_fullsized":"2024-04-25T09:05:56.219512+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:44.979123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721178+0000","last_change":"2024-04-25T09:05:55.234725+0000","last_active":"2024-04-25T09:05:56.721178+0000","last_peered":"2024-04-25T09:05:56.721178+0000","last_clean":"2024-04-25T09:05:56.721178+0000","last_became_active":"2024-04-25T09:05:55.234492+0000","last_became_peered":"2024-04-25T09:05:55.234492+0000","last_unstale":"2024-04-25T09:05:56.721178+0000","last_undegraded":"2024-04-25T09:05:56.721178+0000","last_fullsized":"2024-04-25T09:05:56.721178+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:45.198174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720893+0000","last_change":"2024-04-25T09:05:55.219632+0000","last_active":"2024-04-25T09:05:56.720893+0000","last_peered":"2024-04-25T09:05:56.720893+0000","last_clean":"2024-04-25T09:05:56.720893+0000","last_became_active":"2024-04-25T09:05:55.216482+0000","last_became_peered":"2024-04-25T09:05:55.216482+0000","last_unstale":"2024-04-25T09:05:56.720893+0000","last_undegraded":"2024-04-25T09:05:56.720893+0000","last_fullsized":"2024-04-25T09:05:56.720893+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.469870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721122+0000","last_change":"2024-04-25T09:05:55.210680+0000","last_active":"2024-04-25T09:05:56.721122+0000","last_peered":"2024-04-25T09:05:56.721122+0000","last_clean":"2024-04-25T09:05:56.721122+0000","last_became_active":"2024-04-25T09:05:55.210392+0000","last_became_peered":"2024-04-25T09:05:55.210392+0000","last_unstale":"2024-04-25T09:05:56.721122+0000","last_undegraded":"2024-04-25T09:05:56.721122+0000","last_fullsized":"2024-04-25T09:05:56.721122+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:04.969177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218781+0000","last_change":"2024-04-25T09:05:55.225437+0000","last_active":"2024-04-25T09:05:56.218781+0000","last_peered":"2024-04-25T09:05:56.218781+0000","last_clean":"2024-04-25T09:05:56.218781+0000","last_became_active":"2024-04-25T09:05:55.225000+0000","last_became_peered":"2024-04-25T09:05:55.225000+0000","last_unstale":"2024-04-25T09:05:56.218781+0000","last_undegraded":"2024-04-25T09:05:56.218781+0000","last_fullsized":"2024-04-25T09:05:56.218781+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:58.407880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223610+0000","last_change":"2024-04-25T09:05:55.205780+0000","last_active":"2024-04-25T09:05:56.223610+0000","last_peered":"2024-04-25T09:05:56.223610+0000","last_clean":"2024-04-25T09:05:56.223610+0000","last_became_active":"2024-04-25T09:05:55.205567+0000","last_became_peered":"2024-04-25T09:05:55.205567+0000","last_unstale":"2024-04-25T09:05:56.223610+0000","last_undegraded":"2024-04-25T09:05:56.223610+0000","last_fullsized":"2024-04-25T09:05:56.223610+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:40.637861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218584+0000","last_change":"2024-04-25T09:05:55.226496+0000","last_active":"2024-04-25T09:05:56.218584+0000","last_peered":"2024-04-25T09:05:56.218584+0000","last_clean":"2024-04-25T09:05:56.218584+0000","last_became_active":"2024-04-25T09:05:55.225841+0000","last_became_peered":"2024-04-25T09:05:55.225841+0000","last_unstale":"2024-04-25T09:05:56.218584+0000","last_undegraded":"2024-04-25T09:05:56.218584+0000","last_fullsized":"2024-04-25T09:05:56.218584+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:58.485906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720356+0000","last_change":"2024-04-25T09:05:55.236875+0000","last_active":"2024-04-25T09:05:56.720356+0000","last_peered":"2024-04-25T09:05:56.720356+0000","last_clean":"2024-04-25T09:05:56.720356+0000","last_became_active":"2024-04-25T09:05:55.236573+0000","last_became_peered":"2024-04-25T09:05:55.236573+0000","last_unstale":"2024-04-25T09:05:56.720356+0000","last_undegraded":"2024-04-25T09:05:56.720356+0000","last_fullsized":"2024-04-25T09:05:56.720356+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:08.149507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223350+0000","last_change":"2024-04-25T09:05:55.217536+0000","last_active":"2024-04-25T09:05:56.223350+0000","last_peered":"2024-04-25T09:05:56.223350+0000","last_clean":"2024-04-25T09:05:56.223350+0000","last_became_active":"2024-04-25T09:05:55.216767+0000","last_became_peered":"2024-04-25T09:05:55.216767+0000","last_unstale":"2024-04-25T09:05:56.223350+0000","last_undegraded":"2024-04-25T09:05:56.223350+0000","last_fullsized":"2024-04-25T09:05:56.223350+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:58.407880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"55'4","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720757+0000","last_change":"2024-04-25T09:05:54.203348+0000","last_active":"2024-04-25T09:05:56.720757+0000","last_peered":"2024-04-25T09:05:56.720757+0000","last_clean":"2024-04-25T09:05:56.720757+0000","last_became_active":"2024-04-25T09:05:54.203061+0000","last_became_peered":"2024-04-25T09:05:54.203061+0000","last_unstale":"2024-04-25T09:05:56.720757+0000","last_undegraded":"2024-04-25T09:05:56.720757+0000","last_fullsized":"2024-04-25T09:05:56.720757+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:11.289523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720800+0000","last_change":"2024-04-25T09:05:55.220487+0000","last_active":"2024-04-25T09:05:56.720800+0000","last_peered":"2024-04-25T09:05:56.720800+0000","last_clean":"2024-04-25T09:05:56.720800+0000","last_became_active":"2024-04-25T09:05:55.220074+0000","last_became_peered":"2024-04-25T09:05:55.220074+0000","last_unstale":"2024-04-25T09:05:56.720800+0000","last_undegraded":"2024-04-25T09:05:56.720800+0000","last_fullsized":"2024-04-25T09:05:56.720800+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:23:31.046644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"55'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720727+0000","last_change":"2024-04-25T09:05:54.209646+0000","last_active":"2024-04-25T09:05:56.720727+0000","last_peered":"2024-04-25T09:05:56.720727+0000","last_clean":"2024-04-25T09:05:56.720727+0000","last_became_active":"2024-04-25T09:05:54.209386+0000","last_became_peered":"2024-04-25T09:05:54.209386+0000","last_unstale":"2024-04-25T09:05:56.720727+0000","last_undegraded":"2024-04-25T09:05:56.720727+0000","last_fullsized":"2024-04-25T09:05:56.720727+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:53.098738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721288+0000","last_change":"2024-04-25T09:05:55.210315+0000","last_active":"2024-04-25T09:05:56.721288+0000","last_peered":"2024-04-25T09:05:56.721288+0000","last_clean":"2024-04-25T09:05:56.721288+0000","last_became_active":"2024-04-25T09:05:55.210015+0000","last_became_peered":"2024-04-25T09:05:55.210015+0000","last_unstale":"2024-04-25T09:05:56.721288+0000","last_undegraded":"2024-04-25T09:05:56.721288+0000","last_fullsized":"2024-04-25T09:05:56.721288+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:39.331377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"55'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720915+0000","last_change":"2024-04-25T09:05:54.203361+0000","last_active":"2024-04-25T09:05:56.720915+0000","last_peered":"2024-04-25T09:05:56.720915+0000","last_clean":"2024-04-25T09:05:56.720915+0000","last_became_active":"2024-04-25T09:05:54.203048+0000","last_became_peered":"2024-04-25T09:05:54.203048+0000","last_unstale":"2024-04-25T09:05:56.720915+0000","last_undegraded":"2024-04-25T09:05:56.720915+0000","last_fullsized":"2024-04-25T09:05:56.720915+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:50.945769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720617+0000","last_change":"2024-04-25T09:05:55.217260+0000","last_active":"2024-04-25T09:05:56.720617+0000","last_peered":"2024-04-25T09:05:56.720617+0000","last_clean":"2024-04-25T09:05:56.720617+0000","last_became_active":"2024-04-25T09:05:55.216971+0000","last_became_peered":"2024-04-25T09:05:55.216971+0000","last_unstale":"2024-04-25T09:05:56.720617+0000","last_undegraded":"2024-04-25T09:05:56.720617+0000","last_fullsized":"2024-04-25T09:05:56.720617+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:31.428280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"55'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720610+0000","last_change":"2024-04-25T09:05:54.210604+0000","last_active":"2024-04-25T09:05:56.720610+0000","last_peered":"2024-04-25T09:05:56.720610+0000","last_clean":"2024-04-25T09:05:56.720610+0000","last_became_active":"2024-04-25T09:05:54.210115+0000","last_became_peered":"2024-04-25T09:05:54.210115+0000","last_unstale":"2024-04-25T09:05:56.720610+0000","last_undegraded":"2024-04-25T09:05:56.720610+0000","last_fullsized":"2024-04-25T09:05:56.720610+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:18.006382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.221465+0000","last_change":"2024-04-25T09:05:55.215842+0000","last_active":"2024-04-25T09:05:56.221465+0000","last_peered":"2024-04-25T09:05:56.221465+0000","last_clean":"2024-04-25T09:05:56.221465+0000","last_became_active":"2024-04-25T09:05:55.215487+0000","last_became_peered":"2024-04-25T09:05:55.215487+0000","last_unstale":"2024-04-25T09:05:56.221465+0000","last_undegraded":"2024-04-25T09:05:56.221465+0000","last_fullsized":"2024-04-25T09:05:56.221465+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:45.957424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"55'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218700+0000","last_change":"2024-04-25T09:05:54.216780+0000","last_active":"2024-04-25T09:05:56.218700+0000","last_peered":"2024-04-25T09:05:56.218700+0000","last_clean":"2024-04-25T09:05:56.218700+0000","last_became_active":"2024-04-25T09:05:54.216529+0000","last_became_peered":"2024-04-25T09:05:54.216529+0000","last_unstale":"2024-04-25T09:05:56.218700+0000","last_undegraded":"2024-04-25T09:05:56.218700+0000","last_fullsized":"2024-04-25T09:05:56.218700+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:41.137095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223785+0000","last_change":"2024-04-25T09:05:55.211631+0000","last_active":"2024-04-25T09:05:56.223785+0000","last_peered":"2024-04-25T09:05:56.223785+0000","last_clean":"2024-04-25T09:05:56.223785+0000","last_became_active":"2024-04-25T09:05:55.211374+0000","last_became_peered":"2024-04-25T09:05:55.211374+0000","last_unstale":"2024-04-25T09:05:56.223785+0000","last_undegraded":"2024-04-25T09:05:56.223785+0000","last_fullsized":"2024-04-25T09:05:56.223785+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:10.316296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"55'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.221231+0000","last_change":"2024-04-25T09:05:54.205542+0000","last_active":"2024-04-25T09:05:56.221231+0000","last_peered":"2024-04-25T09:05:56.221231+0000","last_clean":"2024-04-25T09:05:56.221231+0000","last_became_active":"2024-04-25T09:05:54.205250+0000","last_became_peered":"2024-04-25T09:05:54.205250+0000","last_unstale":"2024-04-25T09:05:56.221231+0000","last_undegraded":"2024-04-25T09:05:56.221231+0000","last_fullsized":"2024-04-25T09:05:56.221231+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:11.289523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721346+0000","last_change":"2024-04-25T09:05:55.224834+0000","last_active":"2024-04-25T09:05:56.721346+0000","last_peered":"2024-04-25T09:05:56.721346+0000","last_clean":"2024-04-25T09:05:56.721346+0000","last_became_active":"2024-04-25T09:05:55.224594+0000","last_became_peered":"2024-04-25T09:05:55.224594+0000","last_unstale":"2024-04-25T09:05:56.721346+0000","last_undegraded":"2024-04-25T09:05:56.721346+0000","last_fullsized":"2024-04-25T09:05:56.721346+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:27.484334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721029+0000","last_change":"2024-04-25T09:05:54.207023+0000","last_active":"2024-04-25T09:05:56.721029+0000","last_peered":"2024-04-25T09:05:56.721029+0000","last_clean":"2024-04-25T09:05:56.721029+0000","last_became_active":"2024-04-25T09:05:54.206382+0000","last_became_peered":"2024-04-25T09:05:54.206382+0000","last_unstale":"2024-04-25T09:05:56.721029+0000","last_undegraded":"2024-04-25T09:05:56.721029+0000","last_fullsized":"2024-04-25T09:05:56.721029+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:50.302415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223891+0000","last_change":"2024-04-25T09:05:55.215366+0000","last_active":"2024-04-25T09:05:56.223891+0000","last_peered":"2024-04-25T09:05:56.223891+0000","last_clean":"2024-04-25T09:05:56.223891+0000","last_became_active":"2024-04-25T09:05:55.215099+0000","last_became_peered":"2024-04-25T09:05:55.215099+0000","last_unstale":"2024-04-25T09:05:56.223891+0000","last_undegraded":"2024-04-25T09:05:56.223891+0000","last_fullsized":"2024-04-25T09:05:56.223891+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:23.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218385+0000","last_change":"2024-04-25T09:05:54.211525+0000","last_active":"2024-04-25T09:05:56.218385+0000","last_peered":"2024-04-25T09:05:56.218385+0000","last_clean":"2024-04-25T09:05:56.218385+0000","last_became_active":"2024-04-25T09:05:54.211181+0000","last_became_peered":"2024-04-25T09:05:54.211181+0000","last_unstale":"2024-04-25T09:05:56.218385+0000","last_undegraded":"2024-04-25T09:05:56.218385+0000","last_fullsized":"2024-04-25T09:05:56.218385+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:36.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.221158+0000","last_change":"2024-04-25T09:05:55.208758+0000","last_active":"2024-04-25T09:05:56.221158+0000","last_peered":"2024-04-25T09:05:56.221158+0000","last_clean":"2024-04-25T09:05:56.221158+0000","last_became_active":"2024-04-25T09:05:55.207949+0000","last_became_peered":"2024-04-25T09:05:55.207949+0000","last_unstale":"2024-04-25T09:05:56.221158+0000","last_undegraded":"2024-04-25T09:05:56.221158+0000","last_fullsized":"2024-04-25T09:05:56.221158+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:07.076509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223851+0000","last_change":"2024-04-25T09:05:54.210644+0000","last_active":"2024-04-25T09:05:56.223851+0000","last_peered":"2024-04-25T09:05:56.223851+0000","last_clean":"2024-04-25T09:05:56.223851+0000","last_became_active":"2024-04-25T09:05:54.210237+0000","last_became_peered":"2024-04-25T09:05:54.210237+0000","last_unstale":"2024-04-25T09:05:56.223851+0000","last_undegraded":"2024-04-25T09:05:56.223851+0000","last_fullsized":"2024-04-25T09:05:56.223851+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:35.462884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720348+0000","last_change":"2024-04-25T09:05:55.213406+0000","last_active":"2024-04-25T09:05:56.720348+0000","last_peered":"2024-04-25T09:05:56.720348+0000","last_clean":"2024-04-25T09:05:56.720348+0000","last_became_active":"2024-04-25T09:05:55.213041+0000","last_became_peered":"2024-04-25T09:05:55.213041+0000","last_unstale":"2024-04-25T09:05:56.720348+0000","last_undegraded":"2024-04-25T09:05:56.720348+0000","last_fullsized":"2024-04-25T09:05:56.720348+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:38.984593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.221266+0000","last_change":"2024-04-25T09:05:54.218917+0000","last_active":"2024-04-25T09:05:56.221266+0000","last_peered":"2024-04-25T09:05:56.221266+0000","last_clean":"2024-04-25T09:05:56.221266+0000","last_became_active":"2024-04-25T09:05:54.218684+0000","last_became_peered":"2024-04-25T09:05:54.218684+0000","last_unstale":"2024-04-25T09:05:56.221266+0000","last_undegraded":"2024-04-25T09:05:56.221266+0000","last_fullsized":"2024-04-25T09:05:56.221266+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:48.113164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218752+0000","last_change":"2024-04-25T09:05:55.215918+0000","last_active":"2024-04-25T09:05:56.218752+0000","last_peered":"2024-04-25T09:05:56.218752+0000","last_clean":"2024-04-25T09:05:56.218752+0000","last_became_active":"2024-04-25T09:05:55.213487+0000","last_became_peered":"2024-04-25T09:05:55.213487+0000","last_unstale":"2024-04-25T09:05:56.218752+0000","last_undegraded":"2024-04-25T09:05:56.218752+0000","last_fullsized":"2024-04-25T09:05:56.218752+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:03.470550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"55'3","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223882+0000","last_change":"2024-04-25T09:05:54.212021+0000","last_active":"2024-04-25T09:05:56.223882+0000","last_peered":"2024-04-25T09:05:56.223882+0000","last_clean":"2024-04-25T09:05:56.223882+0000","last_became_active":"2024-04-25T09:05:54.211587+0000","last_became_peered":"2024-04-25T09:05:54.211587+0000","last_unstale":"2024-04-25T09:05:56.223882+0000","last_undegraded":"2024-04-25T09:05:56.223882+0000","last_fullsized":"2024-04-25T09:05:56.223882+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:29.891670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.221553+0000","last_change":"2024-04-25T09:05:55.213030+0000","last_active":"2024-04-25T09:05:56.221553+0000","last_peered":"2024-04-25T09:05:56.221553+0000","last_clean":"2024-04-25T09:05:56.221553+0000","last_became_active":"2024-04-25T09:05:55.212583+0000","last_became_peered":"2024-04-25T09:05:55.212583+0000","last_unstale":"2024-04-25T09:05:56.221553+0000","last_undegraded":"2024-04-25T09:05:56.221553+0000","last_fullsized":"2024-04-25T09:05:56.221553+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:54.089248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"55'6","reported_seq":20,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721260+0000","last_change":"2024-04-25T09:05:54.217131+0000","last_active":"2024-04-25T09:05:56.721260+0000","last_peered":"2024-04-25T09:05:56.721260+0000","last_clean":"2024-04-25T09:05:56.721260+0000","last_became_active":"2024-04-25T09:05:54.216815+0000","last_became_peered":"2024-04-25T09:05:54.216815+0000","last_unstale":"2024-04-25T09:05:56.721260+0000","last_undegraded":"2024-04-25T09:05:56.721260+0000","last_fullsized":"2024-04-25T09:05:56.721260+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:58.364868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720549+0000","last_change":"2024-04-25T09:05:55.220240+0000","last_active":"2024-04-25T09:05:56.720549+0000","last_peered":"2024-04-25T09:05:56.720549+0000","last_clean":"2024-04-25T09:05:56.720549+0000","last_became_active":"2024-04-25T09:05:55.219688+0000","last_became_peered":"2024-04-25T09:05:55.219688+0000","last_unstale":"2024-04-25T09:05:56.720549+0000","last_undegraded":"2024-04-25T09:05:56.720549+0000","last_fullsized":"2024-04-25T09:05:56.720549+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:35.008699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"55'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218802+0000","last_change":"2024-04-25T09:05:54.212396+0000","last_active":"2024-04-25T09:05:56.218802+0000","last_peered":"2024-04-25T09:05:56.218802+0000","last_clean":"2024-04-25T09:05:56.218802+0000","last_became_active":"2024-04-25T09:05:54.212115+0000","last_became_peered":"2024-04-25T09:05:54.212115+0000","last_unstale":"2024-04-25T09:05:56.218802+0000","last_undegraded":"2024-04-25T09:05:56.218802+0000","last_fullsized":"2024-04-25T09:05:56.218802+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:51.251036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219321+0000","last_change":"2024-04-25T09:05:55.215608+0000","last_active":"2024-04-25T09:05:56.219321+0000","last_peered":"2024-04-25T09:05:56.219321+0000","last_clean":"2024-04-25T09:05:56.219321+0000","last_became_active":"2024-04-25T09:05:55.214476+0000","last_became_peered":"2024-04-25T09:05:55.214476+0000","last_unstale":"2024-04-25T09:05:56.219321+0000","last_undegraded":"2024-04-25T09:05:56.219321+0000","last_fullsized":"2024-04-25T09:05:56.219321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:28.598212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721341+0000","last_change":"2024-04-25T09:05:54.211740+0000","last_active":"2024-04-25T09:05:56.721341+0000","last_peered":"2024-04-25T09:05:56.721341+0000","last_clean":"2024-04-25T09:05:56.721341+0000","last_became_active":"2024-04-25T09:05:54.211465+0000","last_became_peered":"2024-04-25T09:05:54.211465+0000","last_unstale":"2024-04-25T09:05:56.721341+0000","last_undegraded":"2024-04-25T09:05:56.721341+0000","last_fullsized":"2024-04-25T09:05:56.721341+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:20.035915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721214+0000","last_change":"2024-04-25T09:05:55.215032+0000","last_active":"2024-04-25T09:05:56.721214+0000","last_peered":"2024-04-25T09:05:56.721214+0000","last_clean":"2024-04-25T09:05:56.721214+0000","last_became_active":"2024-04-25T09:05:55.214713+0000","last_became_peered":"2024-04-25T09:05:55.214713+0000","last_unstale":"2024-04-25T09:05:56.721214+0000","last_undegraded":"2024-04-25T09:05:56.721214+0000","last_fullsized":"2024-04-25T09:05:56.721214+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:58.934174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223453+0000","last_change":"2024-04-25T09:05:54.209026+0000","last_active":"2024-04-25T09:05:56.223453+0000","last_peered":"2024-04-25T09:05:56.223453+0000","last_clean":"2024-04-25T09:05:56.223453+0000","last_became_active":"2024-04-25T09:05:54.208694+0000","last_became_peered":"2024-04-25T09:05:54.208694+0000","last_unstale":"2024-04-25T09:05:56.223453+0000","last_undegraded":"2024-04-25T09:05:56.223453+0000","last_fullsized":"2024-04-25T09:05:56.223453+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:33.050737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219405+0000","last_change":"2024-04-25T09:05:55.215940+0000","last_active":"2024-04-25T09:05:56.219405+0000","last_peered":"2024-04-25T09:05:56.219405+0000","last_clean":"2024-04-25T09:05:56.219405+0000","last_became_active":"2024-04-25T09:05:55.215632+0000","last_became_peered":"2024-04-25T09:05:55.215632+0000","last_unstale":"2024-04-25T09:05:56.219405+0000","last_undegraded":"2024-04-25T09:05:56.219405+0000","last_fullsized":"2024-04-25T09:05:56.219405+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:46.562069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"55'8","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720760+0000","last_change":"2024-04-25T09:05:54.212465+0000","last_active":"2024-04-25T09:05:56.720760+0000","last_peered":"2024-04-25T09:05:56.720760+0000","last_clean":"2024-04-25T09:05:56.720760+0000","last_became_active":"2024-04-25T09:05:54.212226+0000","last_became_peered":"2024-04-25T09:05:54.212226+0000","last_unstale":"2024-04-25T09:05:56.720760+0000","last_undegraded":"2024-04-25T09:05:56.720760+0000","last_fullsized":"2024-04-25T09:05:56.720760+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:57.478920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720900+0000","last_change":"2024-04-25T09:05:55.223349+0000","last_active":"2024-04-25T09:05:56.720900+0000","last_peered":"2024-04-25T09:05:56.720900+0000","last_clean":"2024-04-25T09:05:56.720900+0000","last_became_active":"2024-04-25T09:05:55.222895+0000","last_became_peered":"2024-04-25T09:05:55.222895+0000","last_unstale":"2024-04-25T09:05:56.720900+0000","last_undegraded":"2024-04-25T09:05:56.720900+0000","last_fullsized":"2024-04-25T09:05:56.720900+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:40.900352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"55'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219515+0000","last_change":"2024-04-25T09:05:54.218064+0000","last_active":"2024-04-25T09:05:56.219515+0000","last_peered":"2024-04-25T09:05:56.219515+0000","last_clean":"2024-04-25T09:05:56.219515+0000","last_became_active":"2024-04-25T09:05:54.217761+0000","last_became_peered":"2024-04-25T09:05:54.217761+0000","last_unstale":"2024-04-25T09:05:56.219515+0000","last_undegraded":"2024-04-25T09:05:56.219515+0000","last_fullsized":"2024-04-25T09:05:56.219515+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:29.422516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720370+0000","last_change":"2024-04-25T09:05:55.218750+0000","last_active":"2024-04-25T09:05:56.720370+0000","last_peered":"2024-04-25T09:05:56.720370+0000","last_clean":"2024-04-25T09:05:56.720370+0000","last_became_active":"2024-04-25T09:05:55.218416+0000","last_became_peered":"2024-04-25T09:05:55.218416+0000","last_unstale":"2024-04-25T09:05:56.720370+0000","last_undegraded":"2024-04-25T09:05:56.720370+0000","last_fullsized":"2024-04-25T09:05:56.720370+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:40.632906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"55'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.220930+0000","last_change":"2024-04-25T09:05:54.212390+0000","last_active":"2024-04-25T09:05:56.220930+0000","last_peered":"2024-04-25T09:05:56.220930+0000","last_clean":"2024-04-25T09:05:56.220930+0000","last_became_active":"2024-04-25T09:05:54.212152+0000","last_became_peered":"2024-04-25T09:05:54.212152+0000","last_unstale":"2024-04-25T09:05:56.220930+0000","last_undegraded":"2024-04-25T09:05:56.220930+0000","last_fullsized":"2024-04-25T09:05:56.220930+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:54.348144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.221156+0000","last_change":"2024-04-25T09:05:55.216352+0000","last_active":"2024-04-25T09:05:56.221156+0000","last_peered":"2024-04-25T09:05:56.221156+0000","last_clean":"2024-04-25T09:05:56.221156+0000","last_became_active":"2024-04-25T09:05:55.215830+0000","last_became_peered":"2024-04-25T09:05:55.215830+0000","last_unstale":"2024-04-25T09:05:56.221156+0000","last_undegraded":"2024-04-25T09:05:56.221156+0000","last_fullsized":"2024-04-25T09:05:56.221156+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:06.696703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"55'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721258+0000","last_change":"2024-04-25T09:05:54.202810+0000","last_active":"2024-04-25T09:05:56.721258+0000","last_peered":"2024-04-25T09:05:56.721258+0000","last_clean":"2024-04-25T09:05:56.721258+0000","last_became_active":"2024-04-25T09:05:54.202139+0000","last_became_peered":"2024-04-25T09:05:54.202139+0000","last_unstale":"2024-04-25T09:05:56.721258+0000","last_undegraded":"2024-04-25T09:05:56.721258+0000","last_fullsized":"2024-04-25T09:05:56.721258+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:48.113164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720552+0000","last_change":"2024-04-25T09:05:55.229236+0000","last_active":"2024-04-25T09:05:56.720552+0000","last_peered":"2024-04-25T09:05:56.720552+0000","last_clean":"2024-04-25T09:05:56.720552+0000","last_became_active":"2024-04-25T09:05:55.221684+0000","last_became_peered":"2024-04-25T09:05:55.221684+0000","last_unstale":"2024-04-25T09:05:56.720552+0000","last_undegraded":"2024-04-25T09:05:56.720552+0000","last_fullsized":"2024-04-25T09:05:56.720552+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:49.159743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721190+0000","last_change":"2024-04-25T09:05:54.209589+0000","last_active":"2024-04-25T09:05:56.721190+0000","last_peered":"2024-04-25T09:05:56.721190+0000","last_clean":"2024-04-25T09:05:56.721190+0000","last_became_active":"2024-04-25T09:05:54.209272+0000","last_became_peered":"2024-04-25T09:05:54.209272+0000","last_unstale":"2024-04-25T09:05:56.721190+0000","last_undegraded":"2024-04-25T09:05:56.721190+0000","last_fullsized":"2024-04-25T09:05:56.721190+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:59.668768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720735+0000","last_change":"2024-04-25T09:05:55.213743+0000","last_active":"2024-04-25T09:05:56.720735+0000","last_peered":"2024-04-25T09:05:56.720735+0000","last_clean":"2024-04-25T09:05:56.720735+0000","last_became_active":"2024-04-25T09:05:55.213465+0000","last_became_peered":"2024-04-25T09:05:55.213465+0000","last_unstale":"2024-04-25T09:05:56.720735+0000","last_undegraded":"2024-04-25T09:05:56.720735+0000","last_fullsized":"2024-04-25T09:05:56.720735+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:33.803821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"55'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720515+0000","last_change":"2024-04-25T09:05:54.208798+0000","last_active":"2024-04-25T09:05:56.720515+0000","last_peered":"2024-04-25T09:05:56.720515+0000","last_clean":"2024-04-25T09:05:56.720515+0000","last_became_active":"2024-04-25T09:05:54.208508+0000","last_became_peered":"2024-04-25T09:05:54.208508+0000","last_unstale":"2024-04-25T09:05:56.720515+0000","last_undegraded":"2024-04-25T09:05:56.720515+0000","last_fullsized":"2024-04-25T09:05:56.720515+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:27.366985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721293+0000","last_change":"2024-04-25T09:05:55.208883+0000","last_active":"2024-04-25T09:05:56.721293+0000","last_peered":"2024-04-25T09:05:56.721293+0000","last_clean":"2024-04-25T09:05:56.721293+0000","last_became_active":"2024-04-25T09:05:55.208628+0000","last_became_peered":"2024-04-25T09:05:55.208628+0000","last_unstale":"2024-04-25T09:05:56.721293+0000","last_undegraded":"2024-04-25T09:05:56.721293+0000","last_fullsized":"2024-04-25T09:05:56.721293+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:22.730055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720616+0000","last_change":"2024-04-25T09:05:54.214040+0000","last_active":"2024-04-25T09:05:56.720616+0000","last_peered":"2024-04-25T09:05:56.720616+0000","last_clean":"2024-04-25T09:05:56.720616+0000","last_became_active":"2024-04-25T09:05:54.213736+0000","last_became_peered":"2024-04-25T09:05:54.213736+0000","last_unstale":"2024-04-25T09:05:56.720616+0000","last_undegraded":"2024-04-25T09:05:56.720616+0000","last_fullsized":"2024-04-25T09:05:56.720616+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:24.174626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219354+0000","last_change":"2024-04-25T09:05:55.225764+0000","last_active":"2024-04-25T09:05:56.219354+0000","last_peered":"2024-04-25T09:05:56.219354+0000","last_clean":"2024-04-25T09:05:56.219354+0000","last_became_active":"2024-04-25T09:05:55.225406+0000","last_became_peered":"2024-04-25T09:05:55.225406+0000","last_unstale":"2024-04-25T09:05:56.219354+0000","last_undegraded":"2024-04-25T09:05:56.219354+0000","last_fullsized":"2024-04-25T09:05:56.219354+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:23.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218554+0000","last_change":"2024-04-25T09:05:54.212211+0000","last_active":"2024-04-25T09:05:56.218554+0000","last_peered":"2024-04-25T09:05:56.218554+0000","last_clean":"2024-04-25T09:05:56.218554+0000","last_became_active":"2024-04-25T09:05:54.211924+0000","last_became_peered":"2024-04-25T09:05:54.211924+0000","last_unstale":"2024-04-25T09:05:56.218554+0000","last_undegraded":"2024-04-25T09:05:56.218554+0000","last_fullsized":"2024-04-25T09:05:56.218554+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:15.118800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720991+0000","last_change":"2024-04-25T09:05:55.229329+0000","last_active":"2024-04-25T09:05:56.720991+0000","last_peered":"2024-04-25T09:05:56.720991+0000","last_clean":"2024-04-25T09:05:56.720991+0000","last_became_active":"2024-04-25T09:05:55.221830+0000","last_became_peered":"2024-04-25T09:05:55.221830+0000","last_unstale":"2024-04-25T09:05:56.720991+0000","last_undegraded":"2024-04-25T09:05:56.720991+0000","last_fullsized":"2024-04-25T09:05:56.720991+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:30.898656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.220575+0000","last_change":"2024-04-25T09:05:54.211504+0000","last_active":"2024-04-25T09:05:56.220575+0000","last_peered":"2024-04-25T09:05:56.220575+0000","last_clean":"2024-04-25T09:05:56.220575+0000","last_became_active":"2024-04-25T09:05:54.211265+0000","last_became_peered":"2024-04-25T09:05:54.211265+0000","last_unstale":"2024-04-25T09:05:56.220575+0000","last_undegraded":"2024-04-25T09:05:56.220575+0000","last_fullsized":"2024-04-25T09:05:56.220575+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:40.486890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720543+0000","last_change":"2024-04-25T09:05:55.236878+0000","last_active":"2024-04-25T09:05:56.720543+0000","last_peered":"2024-04-25T09:05:56.720543+0000","last_clean":"2024-04-25T09:05:56.720543+0000","last_became_active":"2024-04-25T09:05:55.236595+0000","last_became_peered":"2024-04-25T09:05:55.236595+0000","last_unstale":"2024-04-25T09:05:56.720543+0000","last_undegraded":"2024-04-25T09:05:56.720543+0000","last_fullsized":"2024-04-25T09:05:56.720543+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:36.110243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"55'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720876+0000","last_change":"2024-04-25T09:05:54.216421+0000","last_active":"2024-04-25T09:05:56.720876+0000","last_peered":"2024-04-25T09:05:56.720876+0000","last_clean":"2024-04-25T09:05:56.720876+0000","last_became_active":"2024-04-25T09:05:54.216159+0000","last_became_peered":"2024-04-25T09:05:54.216159+0000","last_unstale":"2024-04-25T09:05:56.720876+0000","last_undegraded":"2024-04-25T09:05:56.720876+0000","last_fullsized":"2024-04-25T09:05:56.720876+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:50.369765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720484+0000","last_change":"2024-04-25T09:05:55.212728+0000","last_active":"2024-04-25T09:05:56.720484+0000","last_peered":"2024-04-25T09:05:56.720484+0000","last_clean":"2024-04-25T09:05:56.720484+0000","last_became_active":"2024-04-25T09:05:55.212428+0000","last_became_peered":"2024-04-25T09:05:55.212428+0000","last_unstale":"2024-04-25T09:05:56.720484+0000","last_undegraded":"2024-04-25T09:05:56.720484+0000","last_fullsized":"2024-04-25T09:05:56.720484+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:08.890002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223964+0000","last_change":"2024-04-25T09:05:54.216477+0000","last_active":"2024-04-25T09:05:56.223964+0000","last_peered":"2024-04-25T09:05:56.223964+0000","last_clean":"2024-04-25T09:05:56.223964+0000","last_became_active":"2024-04-25T09:05:54.216178+0000","last_became_peered":"2024-04-25T09:05:54.216178+0000","last_unstale":"2024-04-25T09:05:56.223964+0000","last_undegraded":"2024-04-25T09:05:56.223964+0000","last_fullsized":"2024-04-25T09:05:56.223964+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:09.811164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720988+0000","last_change":"2024-04-25T09:05:55.209478+0000","last_active":"2024-04-25T09:05:56.720988+0000","last_peered":"2024-04-25T09:05:56.720988+0000","last_clean":"2024-04-25T09:05:56.720988+0000","last_became_active":"2024-04-25T09:05:55.209220+0000","last_became_peered":"2024-04-25T09:05:55.209220+0000","last_unstale":"2024-04-25T09:05:56.720988+0000","last_undegraded":"2024-04-25T09:05:56.720988+0000","last_fullsized":"2024-04-25T09:05:56.720988+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:19.675839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218931+0000","last_change":"2024-04-25T09:05:54.218073+0000","last_active":"2024-04-25T09:05:56.218931+0000","last_peered":"2024-04-25T09:05:56.218931+0000","last_clean":"2024-04-25T09:05:56.218931+0000","last_became_active":"2024-04-25T09:05:54.217827+0000","last_became_peered":"2024-04-25T09:05:54.217827+0000","last_unstale":"2024-04-25T09:05:56.218931+0000","last_undegraded":"2024-04-25T09:05:56.218931+0000","last_fullsized":"2024-04-25T09:05:56.218931+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:19.731677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219002+0000","last_change":"2024-04-25T09:05:55.223384+0000","last_active":"2024-04-25T09:05:56.219002+0000","last_peered":"2024-04-25T09:05:56.219002+0000","last_clean":"2024-04-25T09:05:56.219002+0000","last_became_active":"2024-04-25T09:05:55.223129+0000","last_became_peered":"2024-04-25T09:05:55.223129+0000","last_unstale":"2024-04-25T09:05:56.219002+0000","last_undegraded":"2024-04-25T09:05:56.219002+0000","last_fullsized":"2024-04-25T09:05:56.219002+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:26.873286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720937+0000","last_change":"2024-04-25T09:05:54.214413+0000","last_active":"2024-04-25T09:05:56.720937+0000","last_peered":"2024-04-25T09:05:56.720937+0000","last_clean":"2024-04-25T09:05:56.720937+0000","last_became_active":"2024-04-25T09:05:54.214139+0000","last_became_peered":"2024-04-25T09:05:54.214139+0000","last_unstale":"2024-04-25T09:05:56.720937+0000","last_undegraded":"2024-04-25T09:05:56.720937+0000","last_fullsized":"2024-04-25T09:05:56.720937+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:02.463564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720536+0000","last_change":"2024-04-25T09:05:55.221842+0000","last_active":"2024-04-25T09:05:56.720536+0000","last_peered":"2024-04-25T09:05:56.720536+0000","last_clean":"2024-04-25T09:05:56.720536+0000","last_became_active":"2024-04-25T09:05:55.221587+0000","last_became_peered":"2024-04-25T09:05:55.221587+0000","last_unstale":"2024-04-25T09:05:56.720536+0000","last_undegraded":"2024-04-25T09:05:56.720536+0000","last_fullsized":"2024-04-25T09:05:56.720536+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:27.311776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720751+0000","last_change":"2024-04-25T09:05:54.208816+0000","last_active":"2024-04-25T09:05:56.720751+0000","last_peered":"2024-04-25T09:05:56.720751+0000","last_clean":"2024-04-25T09:05:56.720751+0000","last_became_active":"2024-04-25T09:05:54.208534+0000","last_became_peered":"2024-04-25T09:05:54.208534+0000","last_unstale":"2024-04-25T09:05:56.720751+0000","last_undegraded":"2024-04-25T09:05:56.720751+0000","last_fullsized":"2024-04-25T09:05:56.720751+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:04.694559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219258+0000","last_change":"2024-04-25T09:05:55.239969+0000","last_active":"2024-04-25T09:05:56.219258+0000","last_peered":"2024-04-25T09:05:56.219258+0000","last_clean":"2024-04-25T09:05:56.219258+0000","last_became_active":"2024-04-25T09:05:55.239661+0000","last_became_peered":"2024-04-25T09:05:55.239661+0000","last_unstale":"2024-04-25T09:05:56.219258+0000","last_undegraded":"2024-04-25T09:05:56.219258+0000","last_fullsized":"2024-04-25T09:05:56.219258+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:10.316296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.221055+0000","last_change":"2024-04-25T09:05:54.218546+0000","last_active":"2024-04-25T09:05:56.221055+0000","last_peered":"2024-04-25T09:05:56.221055+0000","last_clean":"2024-04-25T09:05:56.221055+0000","last_became_active":"2024-04-25T09:05:54.218184+0000","last_became_peered":"2024-04-25T09:05:54.218184+0000","last_unstale":"2024-04-25T09:05:56.221055+0000","last_undegraded":"2024-04-25T09:05:56.221055+0000","last_fullsized":"2024-04-25T09:05:56.221055+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:59.668768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721484+0000","last_change":"2024-04-25T09:05:55.213099+0000","last_active":"2024-04-25T09:05:56.721484+0000","last_peered":"2024-04-25T09:05:56.721484+0000","last_clean":"2024-04-25T09:05:56.721484+0000","last_became_active":"2024-04-25T09:05:55.212816+0000","last_became_peered":"2024-04-25T09:05:55.212816+0000","last_unstale":"2024-04-25T09:05:56.721484+0000","last_undegraded":"2024-04-25T09:05:56.721484+0000","last_fullsized":"2024-04-25T09:05:56.721484+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:51.773279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720608+0000","last_change":"2024-04-25T09:05:54.208852+0000","last_active":"2024-04-25T09:05:56.720608+0000","last_peered":"2024-04-25T09:05:56.720608+0000","last_clean":"2024-04-25T09:05:56.720608+0000","last_became_active":"2024-04-25T09:05:54.208561+0000","last_became_peered":"2024-04-25T09:05:54.208561+0000","last_unstale":"2024-04-25T09:05:56.720608+0000","last_undegraded":"2024-04-25T09:05:56.720608+0000","last_fullsized":"2024-04-25T09:05:56.720608+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:19.839847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721055+0000","last_change":"2024-04-25T09:05:55.214202+0000","last_active":"2024-04-25T09:05:56.721055+0000","last_peered":"2024-04-25T09:05:56.721055+0000","last_clean":"2024-04-25T09:05:56.721055+0000","last_became_active":"2024-04-25T09:05:55.213411+0000","last_became_peered":"2024-04-25T09:05:55.213411+0000","last_unstale":"2024-04-25T09:05:56.721055+0000","last_undegraded":"2024-04-25T09:05:56.721055+0000","last_fullsized":"2024-04-25T09:05:56.721055+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:54.089248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"56'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219389+0000","last_change":"2024-04-25T09:05:54.213735+0000","last_active":"2024-04-25T09:05:56.219389+0000","last_peered":"2024-04-25T09:05:56.219389+0000","last_clean":"2024-04-25T09:05:56.219389+0000","last_became_active":"2024-04-25T09:05:54.213473+0000","last_became_peered":"2024-04-25T09:05:54.213473+0000","last_unstale":"2024-04-25T09:05:56.219389+0000","last_undegraded":"2024-04-25T09:05:56.219389+0000","last_fullsized":"2024-04-25T09:05:56.219389+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:48.379855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":233,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223303+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:05:56.223303+0000","last_peered":"2024-04-25T09:05:56.223303+0000","last_clean":"2024-04-25T09:05:56.223303+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:05:56.223303+0000","last_undegraded":"2024-04-25T09:05:56.223303+0000","last_fullsized":"2024-04-25T09:05:56.223303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35992,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335848,"statfs":{"total":96636764160,"available":96599908352,"internally_reserved":0,"allocated":667648,"data_stored":296008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":659456,"data_stored":295356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40148,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331692,"statfs":{"total":96636764160,"available":96595652608,"internally_reserved":0,"allocated":663552,"data_stored":295938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36004,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335836,"statfs":{"total":96636764160,"available":96599896064,"internally_reserved":0,"allocated":675840,"data_stored":296990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509483,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36000,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335840,"statfs":{"total":96636764160,"available":96599900160,"internally_reserved":0,"allocated":671744,"data_stored":296968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35996,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335844,"statfs":{"total":96636764160,"available":96599904256,"internally_reserved":0,"allocated":667648,"data_stored":295516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40740,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331100,"statfs":{"total":96636764160,"available":96595046400,"internally_reserved":0,"allocated":1261568,"data_stored":885780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36576,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335264,"statfs":{"total":96636764160,"available":96599310336,"internally_reserved":0,"allocated":1261568,"data_stored":885848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:06:03.792 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:06:03.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.947+0000 7f3ff3a00640 1 Processor -- start 2024-04-25T09:06:03.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.947+0000 7f3ff3a00640 1 -- start start 2024-04-25T09:06:03.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.947+0000 7f3ff3a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3fec15dc60 0x7f3fec0b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.947+0000 7f3ff3a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3fec0ae810 0x7f3fec0aec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.947+0000 7f3ff3a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fec0af160 con 0x7f3fec15e040 2024-04-25T09:06:03.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.947+0000 7f3ff3a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fec071450 con 0x7f3fec15dc60 2024-04-25T09:06:03.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.947+0000 7f3ff3a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fec15e8e0 con 0x7f3fec0ae810 2024-04-25T09:06:03.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.947+0000 7f3ff1000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3fec15dc60 0x7f3fec0b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.947+0000 7f3ff1000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3fec15dc60 0x7f3fec0b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49318/0 (socket says 172.21.15.173:49318) 2024-04-25T09:06:03.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.947+0000 7f3ff1000640 1 -- 172.21.15.173:0/560766517 learned_addr learned my addr 172.21.15.173:0/560766517 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:03.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.947+0000 7f3ff1000640 1 -- 172.21.15.173:0/560766517 >> v2:172.21.15.194:3300/0 conn(0x7f3fec0ae810 msgr2=0x7f3fec0aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:03.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.947+0000 7f3ff1000640 1 --2- 172.21.15.173:0/560766517 >> v2:172.21.15.194:3300/0 conn(0x7f3fec0ae810 0x7f3fec0aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.947+0000 7f3ff1000640 1 -- 172.21.15.173:0/560766517 >> v1:172.21.15.194:6789/0 conn(0x7f3fec15e040 legacy=0x7f3fec0ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:03.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.947+0000 7f3ff1000640 1 -- 172.21.15.173:0/560766517 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec15ebc0 con 0x7f3fec15dc60 2024-04-25T09:06:03.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.951+0000 7f3ff1000640 1 --2- 172.21.15.173:0/560766517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fec15dc60 0x7f3fec0b3710 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0cf350 tx=0x7f3fdc01c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f475c75aef8bc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:03.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.951+0000 7f3feb400640 1 -- 172.21.15.173:0/560766517 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0a5580 con 0x7f3fec15dc60 2024-04-25T09:06:03.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.951+0000 7f3feb400640 1 -- 172.21.15.173:0/560766517 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc0a5720 con 0x7f3fec15dc60 2024-04-25T09:06:03.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.951+0000 7f3feb400640 1 -- 172.21.15.173:0/560766517 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0a5af0 con 0x7f3fec15dc60 2024-04-25T09:06:03.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.951+0000 7f3ff3a00640 1 -- 172.21.15.173:0/560766517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fec15dc60 msgr2=0x7f3fec0b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.951+0000 7f3ff3a00640 1 --2- 172.21.15.173:0/560766517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fec15dc60 0x7f3fec0b3710 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0cf350 tx=0x7f3fdc01c7d0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.951+0000 7f3ff3a00640 1 -- 172.21.15.173:0/560766517 shutdown_connections 2024-04-25T09:06:03.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.951+0000 7f3ff3a00640 1 --2- 172.21.15.173:0/560766517 >> v2:172.21.15.194:3300/0 conn(0x7f3fec0ae810 0x7f3fec0aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.951+0000 7f3ff3a00640 1 --2- 172.21.15.173:0/560766517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fec15dc60 0x7f3fec0b3710 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.951+0000 7f3ff3a00640 1 -- 172.21.15.173:0/560766517 >> 172.21.15.173:0/560766517 conn(0x7f3fec06ac90 msgr2=0x7f3fec06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:03.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.951+0000 7f3ff3a00640 1 -- 172.21.15.173:0/560766517 shutdown_connections 2024-04-25T09:06:03.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.951+0000 7f3ff3a00640 1 -- 172.21.15.173:0/560766517 wait complete. 2024-04-25T09:06:03.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff3a00640 1 Processor -- start 2024-04-25T09:06:03.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff3a00640 1 -- start start 2024-04-25T09:06:03.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff3a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fec0ae810 0x7f3fec14ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff3a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fec15dc60 0x7f3fec0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff3a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3fec15e040 0x7f3fec14cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff3a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec15e4b0 con 0x7f3fec0ae810 2024-04-25T09:06:03.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff3a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec0ad520 con 0x7f3fec15dc60 2024-04-25T09:06:03.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff3a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec15e630 con 0x7f3fec15e040 2024-04-25T09:06:03.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff1000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fec0ae810 0x7f3fec14ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff1000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fec0ae810 0x7f3fec14ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49324/0 (socket says 172.21.15.173:49324) 2024-04-25T09:06:03.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff1000640 1 -- 172.21.15.173:0/4291458857 learned_addr learned my addr 172.21.15.173:0/4291458857 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:03.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3febe00640 1 --2- 172.21.15.173:0/4291458857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fec15dc60 0x7f3fec0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff1a00640 1 --2- 172.21.15.173:0/4291458857 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3fec15e040 0x7f3fec14cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff1000640 1 -- 172.21.15.173:0/4291458857 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3fec15e040 msgr2=0x7f3fec14cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff1000640 1 --2- 172.21.15.173:0/4291458857 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3fec15e040 0x7f3fec14cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff1000640 1 -- 172.21.15.173:0/4291458857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fec15dc60 msgr2=0x7f3fec0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff1000640 1 --2- 172.21.15.173:0/4291458857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fec15dc60 0x7f3fec0cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff1000640 1 -- 172.21.15.173:0/4291458857 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec15f860 con 0x7f3fec0ae810 2024-04-25T09:06:03.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff1a00640 1 --2- 172.21.15.173:0/4291458857 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3fec15e040 0x7f3fec14cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:03.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff1000640 1 --2- 172.21.15.173:0/4291458857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fec0ae810 0x7f3fec14ed20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0af040 tx=0x7f3fdc019570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:03.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3fe8c00640 1 -- 172.21.15.173:0/4291458857 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0b8670 con 0x7f3fec0ae810 2024-04-25T09:06:03.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3fe8c00640 1 -- 172.21.15.173:0/4291458857 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc0be070 con 0x7f3fec0ae810 2024-04-25T09:06:03.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3fe8c00640 1 -- 172.21.15.173:0/4291458857 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0b8a70 con 0x7f3fec0ae810 2024-04-25T09:06:03.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff3a00640 1 -- 172.21.15.173:0/4291458857 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fec15fb40 con 0x7f3fec0ae810 2024-04-25T09:06:03.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.955+0000 7f3ff3a00640 1 -- 172.21.15.173:0/4291458857 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fec14e960 con 0x7f3fec0ae810 2024-04-25T09:06:03.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.959+0000 7f3ff3a00640 1 -- 172.21.15.173:0/4291458857 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fec073a40 con 0x7f3fec0ae810 2024-04-25T09:06:03.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.959+0000 7f3fe8c00640 1 -- 172.21.15.173:0/4291458857 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3fdc0b8c10 con 0x7f3fec0ae810 2024-04-25T09:06:03.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.959+0000 7f3fe8c00640 1 --2- 172.21.15.173:0/4291458857 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3fcc066f60 0x7f3fcc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.959+0000 7f3fe8c00640 1 -- 172.21.15.173:0/4291458857 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3fdc1202f0 con 0x7f3fec0ae810 2024-04-25T09:06:03.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.959+0000 7f3febe00640 1 --2- 172.21.15.173:0/4291458857 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3fcc066f60 0x7f3fcc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.959+0000 7f3febe00640 1 --2- 172.21.15.173:0/4291458857 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3fcc066f60 0x7f3fcc069420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3fec160c50 tx=0x7f3fd8009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:03.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:03.963+0000 7f3fe8c00640 1 -- 172.21.15.173:0/4291458857 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3fec0af160 con 0x7f3fec0ae810 2024-04-25T09:06:04.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.111+0000 7f3ff3a00640 1 -- 172.21.15.173:0/4291458857 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3fec0cf190 con 0x7f3fcc066f60 2024-04-25T09:06:04.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.119+0000 7f3fe8c00640 1 -- 172.21.15.173:0/4291458857 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251944 (secure 0 0 0) 0x7f3fd8009530 con 0x7f3fcc066f60 2024-04-25T09:06:04.114 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:04.115 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:06:04.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.123+0000 7f3ff3a00640 1 -- 172.21.15.173:0/4291458857 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3fcc066f60 msgr2=0x7f3fcc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.123+0000 7f3ff3a00640 1 --2- 172.21.15.173:0/4291458857 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3fcc066f60 0x7f3fcc069420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3fec160c50 tx=0x7f3fd8009060 comp rx=0 tx=0).stop 2024-04-25T09:06:04.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.123+0000 7f3ff3a00640 1 -- 172.21.15.173:0/4291458857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fec0ae810 msgr2=0x7f3fec14ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.123+0000 7f3ff3a00640 1 --2- 172.21.15.173:0/4291458857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fec0ae810 0x7f3fec14ed20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0af040 tx=0x7f3fdc019570 comp rx=0 tx=0).stop 2024-04-25T09:06:04.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.123+0000 7f3ff3a00640 1 -- 172.21.15.173:0/4291458857 shutdown_connections 2024-04-25T09:06:04.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.123+0000 7f3ff3a00640 1 --2- 172.21.15.173:0/4291458857 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3fcc066f60 0x7f3fcc069420 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.123+0000 7f3ff3a00640 1 --2- 172.21.15.173:0/4291458857 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3fec15e040 0x7f3fec14cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.123+0000 7f3ff3a00640 1 --2- 172.21.15.173:0/4291458857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fec15dc60 0x7f3fec0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.123+0000 7f3ff3a00640 1 --2- 172.21.15.173:0/4291458857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fec0ae810 0x7f3fec14ed20 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.123+0000 7f3ff3a00640 1 -- 172.21.15.173:0/4291458857 >> 172.21.15.173:0/4291458857 conn(0x7f3fec06ac90 msgr2=0x7f3fec0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:04.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.123+0000 7f3ff3a00640 1 -- 172.21.15.173:0/4291458857 shutdown_connections 2024-04-25T09:06:04.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.123+0000 7f3ff3a00640 1 -- 172.21.15.173:0/4291458857 wait complete. 2024-04-25T09:06:04.134 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-04-25T09:06:02.766852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":297440,"kb_used_data":6376,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754677280,"statfs":{"total":773094113280,"available":772789534720,"internally_reserved":0,"allocated":6529024,"data_stored":3548404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001777"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720824+0000","last_change":"2024-04-25T09:05:55.221942+0000","last_active":"2024-04-25T09:05:56.720824+0000","last_peered":"2024-04-25T09:05:56.720824+0000","last_clean":"2024-04-25T09:05:56.720824+0000","last_became_active":"2024-04-25T09:05:55.221580+0000","last_became_peered":"2024-04-25T09:05:55.221580+0000","last_unstale":"2024-04-25T09:05:56.720824+0000","last_undegraded":"2024-04-25T09:05:56.720824+0000","last_fullsized":"2024-04-25T09:05:56.720824+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:09.646750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223866+0000","last_change":"2024-04-25T09:05:55.219954+0000","last_active":"2024-04-25T09:05:56.223866+0000","last_peered":"2024-04-25T09:05:56.223866+0000","last_clean":"2024-04-25T09:05:56.223866+0000","last_became_active":"2024-04-25T09:05:55.219366+0000","last_became_peered":"2024-04-25T09:05:55.219366+0000","last_unstale":"2024-04-25T09:05:56.223866+0000","last_undegraded":"2024-04-25T09:05:56.223866+0000","last_fullsized":"2024-04-25T09:05:56.223866+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:28.598212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219196+0000","last_change":"2024-04-25T09:05:55.226082+0000","last_active":"2024-04-25T09:05:56.219196+0000","last_peered":"2024-04-25T09:05:56.219196+0000","last_clean":"2024-04-25T09:05:56.219196+0000","last_became_active":"2024-04-25T09:05:55.225723+0000","last_became_peered":"2024-04-25T09:05:55.225723+0000","last_unstale":"2024-04-25T09:05:56.219196+0000","last_undegraded":"2024-04-25T09:05:56.219196+0000","last_fullsized":"2024-04-25T09:05:56.219196+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:24.962814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223740+0000","last_change":"2024-04-25T09:05:55.201262+0000","last_active":"2024-04-25T09:05:56.223740+0000","last_peered":"2024-04-25T09:05:56.223740+0000","last_clean":"2024-04-25T09:05:56.223740+0000","last_became_active":"2024-04-25T09:05:55.200598+0000","last_became_peered":"2024-04-25T09:05:55.200598+0000","last_unstale":"2024-04-25T09:05:56.223740+0000","last_undegraded":"2024-04-25T09:05:56.223740+0000","last_fullsized":"2024-04-25T09:05:56.223740+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:24.962814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.221593+0000","last_change":"2024-04-25T09:05:55.205084+0000","last_active":"2024-04-25T09:05:56.221593+0000","last_peered":"2024-04-25T09:05:56.221593+0000","last_clean":"2024-04-25T09:05:56.221593+0000","last_became_active":"2024-04-25T09:05:55.204319+0000","last_became_peered":"2024-04-25T09:05:55.204319+0000","last_unstale":"2024-04-25T09:05:56.221593+0000","last_undegraded":"2024-04-25T09:05:56.221593+0000","last_fullsized":"2024-04-25T09:05:56.221593+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:04.969177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720506+0000","last_change":"2024-04-25T09:05:55.219356+0000","last_active":"2024-04-25T09:05:56.720506+0000","last_peered":"2024-04-25T09:05:56.720506+0000","last_clean":"2024-04-25T09:05:56.720506+0000","last_became_active":"2024-04-25T09:05:55.219114+0000","last_became_peered":"2024-04-25T09:05:55.219114+0000","last_unstale":"2024-04-25T09:05:56.720506+0000","last_undegraded":"2024-04-25T09:05:56.720506+0000","last_fullsized":"2024-04-25T09:05:56.720506+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:42.431288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218499+0000","last_change":"2024-04-25T09:05:55.226755+0000","last_active":"2024-04-25T09:05:56.218499+0000","last_peered":"2024-04-25T09:05:56.218499+0000","last_clean":"2024-04-25T09:05:56.218499+0000","last_became_active":"2024-04-25T09:05:55.226223+0000","last_became_peered":"2024-04-25T09:05:55.226223+0000","last_unstale":"2024-04-25T09:05:56.218499+0000","last_undegraded":"2024-04-25T09:05:56.218499+0000","last_fullsized":"2024-04-25T09:05:56.218499+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:05.701545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720518+0000","last_change":"2024-04-25T09:05:55.223143+0000","last_active":"2024-04-25T09:05:56.720518+0000","last_peered":"2024-04-25T09:05:56.720518+0000","last_clean":"2024-04-25T09:05:56.720518+0000","last_became_active":"2024-04-25T09:05:55.222550+0000","last_became_peered":"2024-04-25T09:05:55.222550+0000","last_unstale":"2024-04-25T09:05:56.720518+0000","last_undegraded":"2024-04-25T09:05:56.720518+0000","last_fullsized":"2024-04-25T09:05:56.720518+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:26.194099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721454+0000","last_change":"2024-04-25T09:05:55.222899+0000","last_active":"2024-04-25T09:05:56.721454+0000","last_peered":"2024-04-25T09:05:56.721454+0000","last_clean":"2024-04-25T09:05:56.721454+0000","last_became_active":"2024-04-25T09:05:55.222471+0000","last_became_peered":"2024-04-25T09:05:55.222471+0000","last_unstale":"2024-04-25T09:05:56.721454+0000","last_undegraded":"2024-04-25T09:05:56.721454+0000","last_fullsized":"2024-04-25T09:05:56.721454+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:35.649081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720770+0000","last_change":"2024-04-25T09:05:55.217788+0000","last_active":"2024-04-25T09:05:56.720770+0000","last_peered":"2024-04-25T09:05:56.720770+0000","last_clean":"2024-04-25T09:05:56.720770+0000","last_became_active":"2024-04-25T09:05:55.217479+0000","last_became_peered":"2024-04-25T09:05:55.217479+0000","last_unstale":"2024-04-25T09:05:56.720770+0000","last_undegraded":"2024-04-25T09:05:56.720770+0000","last_fullsized":"2024-04-25T09:05:56.720770+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:12.217572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.220868+0000","last_change":"2024-04-25T09:05:55.218467+0000","last_active":"2024-04-25T09:05:56.220868+0000","last_peered":"2024-04-25T09:05:56.220868+0000","last_clean":"2024-04-25T09:05:56.220868+0000","last_became_active":"2024-04-25T09:05:55.217196+0000","last_became_peered":"2024-04-25T09:05:55.217196+0000","last_unstale":"2024-04-25T09:05:56.220868+0000","last_undegraded":"2024-04-25T09:05:56.220868+0000","last_fullsized":"2024-04-25T09:05:56.220868+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:01.803379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721288+0000","last_change":"2024-04-25T09:05:55.208680+0000","last_active":"2024-04-25T09:05:56.721288+0000","last_peered":"2024-04-25T09:05:56.721288+0000","last_clean":"2024-04-25T09:05:56.721288+0000","last_became_active":"2024-04-25T09:05:55.208416+0000","last_became_peered":"2024-04-25T09:05:55.208416+0000","last_unstale":"2024-04-25T09:05:56.721288+0000","last_undegraded":"2024-04-25T09:05:56.721288+0000","last_fullsized":"2024-04-25T09:05:56.721288+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:35.138879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720448+0000","last_change":"2024-04-25T09:05:55.212042+0000","last_active":"2024-04-25T09:05:56.720448+0000","last_peered":"2024-04-25T09:05:56.720448+0000","last_clean":"2024-04-25T09:05:56.720448+0000","last_became_active":"2024-04-25T09:05:55.211771+0000","last_became_peered":"2024-04-25T09:05:55.211771+0000","last_unstale":"2024-04-25T09:05:56.720448+0000","last_undegraded":"2024-04-25T09:05:56.720448+0000","last_fullsized":"2024-04-25T09:05:56.720448+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:17.784163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218708+0000","last_change":"2024-04-25T09:05:55.226358+0000","last_active":"2024-04-25T09:05:56.218708+0000","last_peered":"2024-04-25T09:05:56.218708+0000","last_clean":"2024-04-25T09:05:56.218708+0000","last_became_active":"2024-04-25T09:05:55.226111+0000","last_became_peered":"2024-04-25T09:05:55.226111+0000","last_unstale":"2024-04-25T09:05:56.218708+0000","last_undegraded":"2024-04-25T09:05:56.218708+0000","last_fullsized":"2024-04-25T09:05:56.218708+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:59.371854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223470+0000","last_change":"2024-04-25T09:05:55.205181+0000","last_active":"2024-04-25T09:05:56.223470+0000","last_peered":"2024-04-25T09:05:56.223470+0000","last_clean":"2024-04-25T09:05:56.223470+0000","last_became_active":"2024-04-25T09:05:55.204398+0000","last_became_peered":"2024-04-25T09:05:55.204398+0000","last_unstale":"2024-04-25T09:05:56.223470+0000","last_undegraded":"2024-04-25T09:05:56.223470+0000","last_fullsized":"2024-04-25T09:05:56.223470+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:26.873286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720345+0000","last_change":"2024-04-25T09:05:55.210716+0000","last_active":"2024-04-25T09:05:56.720345+0000","last_peered":"2024-04-25T09:05:56.720345+0000","last_clean":"2024-04-25T09:05:56.720345+0000","last_became_active":"2024-04-25T09:05:55.210437+0000","last_became_peered":"2024-04-25T09:05:55.210437+0000","last_unstale":"2024-04-25T09:05:56.720345+0000","last_undegraded":"2024-04-25T09:05:56.720345+0000","last_fullsized":"2024-04-25T09:05:56.720345+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:56.576485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219437+0000","last_change":"2024-04-25T09:05:55.215568+0000","last_active":"2024-04-25T09:05:56.219437+0000","last_peered":"2024-04-25T09:05:56.219437+0000","last_clean":"2024-04-25T09:05:56.219437+0000","last_became_active":"2024-04-25T09:05:55.215258+0000","last_became_peered":"2024-04-25T09:05:55.215258+0000","last_unstale":"2024-04-25T09:05:56.219437+0000","last_undegraded":"2024-04-25T09:05:56.219437+0000","last_fullsized":"2024-04-25T09:05:56.219437+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:23.801323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223940+0000","last_change":"2024-04-25T09:05:55.212558+0000","last_active":"2024-04-25T09:05:56.223940+0000","last_peered":"2024-04-25T09:05:56.223940+0000","last_clean":"2024-04-25T09:05:56.223940+0000","last_became_active":"2024-04-25T09:05:55.212302+0000","last_became_peered":"2024-04-25T09:05:55.212302+0000","last_unstale":"2024-04-25T09:05:56.223940+0000","last_undegraded":"2024-04-25T09:05:56.223940+0000","last_fullsized":"2024-04-25T09:05:56.223940+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:46.562069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219171+0000","last_change":"2024-04-25T09:05:55.216218+0000","last_active":"2024-04-25T09:05:56.219171+0000","last_peered":"2024-04-25T09:05:56.219171+0000","last_clean":"2024-04-25T09:05:56.219171+0000","last_became_active":"2024-04-25T09:05:55.215654+0000","last_became_peered":"2024-04-25T09:05:55.215654+0000","last_unstale":"2024-04-25T09:05:56.219171+0000","last_undegraded":"2024-04-25T09:05:56.219171+0000","last_fullsized":"2024-04-25T09:05:56.219171+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:40.637861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721164+0000","last_change":"2024-04-25T09:05:55.208803+0000","last_active":"2024-04-25T09:05:56.721164+0000","last_peered":"2024-04-25T09:05:56.721164+0000","last_clean":"2024-04-25T09:05:56.721164+0000","last_became_active":"2024-04-25T09:05:55.208507+0000","last_became_peered":"2024-04-25T09:05:55.208507+0000","last_unstale":"2024-04-25T09:05:56.721164+0000","last_undegraded":"2024-04-25T09:05:56.721164+0000","last_fullsized":"2024-04-25T09:05:56.721164+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:18.982237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720973+0000","last_change":"2024-04-25T09:05:55.215220+0000","last_active":"2024-04-25T09:05:56.720973+0000","last_peered":"2024-04-25T09:05:56.720973+0000","last_clean":"2024-04-25T09:05:56.720973+0000","last_became_active":"2024-04-25T09:05:55.214549+0000","last_became_peered":"2024-04-25T09:05:55.214549+0000","last_unstale":"2024-04-25T09:05:56.720973+0000","last_undegraded":"2024-04-25T09:05:56.720973+0000","last_fullsized":"2024-04-25T09:05:56.720973+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:45.957424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720685+0000","last_change":"2024-04-25T09:05:55.219026+0000","last_active":"2024-04-25T09:05:56.720685+0000","last_peered":"2024-04-25T09:05:56.720685+0000","last_clean":"2024-04-25T09:05:56.720685+0000","last_became_active":"2024-04-25T09:05:55.218756+0000","last_became_peered":"2024-04-25T09:05:55.218756+0000","last_unstale":"2024-04-25T09:05:56.720685+0000","last_undegraded":"2024-04-25T09:05:56.720685+0000","last_fullsized":"2024-04-25T09:05:56.720685+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:50.222180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.220707+0000","last_change":"2024-04-25T09:05:55.217820+0000","last_active":"2024-04-25T09:05:56.220707+0000","last_peered":"2024-04-25T09:05:56.220707+0000","last_clean":"2024-04-25T09:05:56.220707+0000","last_became_active":"2024-04-25T09:05:55.217488+0000","last_became_peered":"2024-04-25T09:05:55.217488+0000","last_unstale":"2024-04-25T09:05:56.220707+0000","last_undegraded":"2024-04-25T09:05:56.220707+0000","last_fullsized":"2024-04-25T09:05:56.220707+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:51.771563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218445+0000","last_change":"2024-04-25T09:05:55.231495+0000","last_active":"2024-04-25T09:05:56.218445+0000","last_peered":"2024-04-25T09:05:56.218445+0000","last_clean":"2024-04-25T09:05:56.218445+0000","last_became_active":"2024-04-25T09:05:55.225771+0000","last_became_peered":"2024-04-25T09:05:55.225771+0000","last_unstale":"2024-04-25T09:05:56.218445+0000","last_undegraded":"2024-04-25T09:05:56.218445+0000","last_fullsized":"2024-04-25T09:05:56.218445+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:25.181612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219512+0000","last_change":"2024-04-25T09:05:55.237107+0000","last_active":"2024-04-25T09:05:56.219512+0000","last_peered":"2024-04-25T09:05:56.219512+0000","last_clean":"2024-04-25T09:05:56.219512+0000","last_became_active":"2024-04-25T09:05:55.236834+0000","last_became_peered":"2024-04-25T09:05:55.236834+0000","last_unstale":"2024-04-25T09:05:56.219512+0000","last_undegraded":"2024-04-25T09:05:56.219512+0000","last_fullsized":"2024-04-25T09:05:56.219512+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:44.979123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721178+0000","last_change":"2024-04-25T09:05:55.234725+0000","last_active":"2024-04-25T09:05:56.721178+0000","last_peered":"2024-04-25T09:05:56.721178+0000","last_clean":"2024-04-25T09:05:56.721178+0000","last_became_active":"2024-04-25T09:05:55.234492+0000","last_became_peered":"2024-04-25T09:05:55.234492+0000","last_unstale":"2024-04-25T09:05:56.721178+0000","last_undegraded":"2024-04-25T09:05:56.721178+0000","last_fullsized":"2024-04-25T09:05:56.721178+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:45.198174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720893+0000","last_change":"2024-04-25T09:05:55.219632+0000","last_active":"2024-04-25T09:05:56.720893+0000","last_peered":"2024-04-25T09:05:56.720893+0000","last_clean":"2024-04-25T09:05:56.720893+0000","last_became_active":"2024-04-25T09:05:55.216482+0000","last_became_peered":"2024-04-25T09:05:55.216482+0000","last_unstale":"2024-04-25T09:05:56.720893+0000","last_undegraded":"2024-04-25T09:05:56.720893+0000","last_fullsized":"2024-04-25T09:05:56.720893+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.469870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721122+0000","last_change":"2024-04-25T09:05:55.210680+0000","last_active":"2024-04-25T09:05:56.721122+0000","last_peered":"2024-04-25T09:05:56.721122+0000","last_clean":"2024-04-25T09:05:56.721122+0000","last_became_active":"2024-04-25T09:05:55.210392+0000","last_became_peered":"2024-04-25T09:05:55.210392+0000","last_unstale":"2024-04-25T09:05:56.721122+0000","last_undegraded":"2024-04-25T09:05:56.721122+0000","last_fullsized":"2024-04-25T09:05:56.721122+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:04.969177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218781+0000","last_change":"2024-04-25T09:05:55.225437+0000","last_active":"2024-04-25T09:05:56.218781+0000","last_peered":"2024-04-25T09:05:56.218781+0000","last_clean":"2024-04-25T09:05:56.218781+0000","last_became_active":"2024-04-25T09:05:55.225000+0000","last_became_peered":"2024-04-25T09:05:55.225000+0000","last_unstale":"2024-04-25T09:05:56.218781+0000","last_undegraded":"2024-04-25T09:05:56.218781+0000","last_fullsized":"2024-04-25T09:05:56.218781+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:58.407880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223610+0000","last_change":"2024-04-25T09:05:55.205780+0000","last_active":"2024-04-25T09:05:56.223610+0000","last_peered":"2024-04-25T09:05:56.223610+0000","last_clean":"2024-04-25T09:05:56.223610+0000","last_became_active":"2024-04-25T09:05:55.205567+0000","last_became_peered":"2024-04-25T09:05:55.205567+0000","last_unstale":"2024-04-25T09:05:56.223610+0000","last_undegraded":"2024-04-25T09:05:56.223610+0000","last_fullsized":"2024-04-25T09:05:56.223610+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:40.637861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218584+0000","last_change":"2024-04-25T09:05:55.226496+0000","last_active":"2024-04-25T09:05:56.218584+0000","last_peered":"2024-04-25T09:05:56.218584+0000","last_clean":"2024-04-25T09:05:56.218584+0000","last_became_active":"2024-04-25T09:05:55.225841+0000","last_became_peered":"2024-04-25T09:05:55.225841+0000","last_unstale":"2024-04-25T09:05:56.218584+0000","last_undegraded":"2024-04-25T09:05:56.218584+0000","last_fullsized":"2024-04-25T09:05:56.218584+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:58.485906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720356+0000","last_change":"2024-04-25T09:05:55.236875+0000","last_active":"2024-04-25T09:05:56.720356+0000","last_peered":"2024-04-25T09:05:56.720356+0000","last_clean":"2024-04-25T09:05:56.720356+0000","last_became_active":"2024-04-25T09:05:55.236573+0000","last_became_peered":"2024-04-25T09:05:55.236573+0000","last_unstale":"2024-04-25T09:05:56.720356+0000","last_undegraded":"2024-04-25T09:05:56.720356+0000","last_fullsized":"2024-04-25T09:05:56.720356+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:08.149507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223350+0000","last_change":"2024-04-25T09:05:55.217536+0000","last_active":"2024-04-25T09:05:56.223350+0000","last_peered":"2024-04-25T09:05:56.223350+0000","last_clean":"2024-04-25T09:05:56.223350+0000","last_became_active":"2024-04-25T09:05:55.216767+0000","last_became_peered":"2024-04-25T09:05:55.216767+0000","last_unstale":"2024-04-25T09:05:56.223350+0000","last_undegraded":"2024-04-25T09:05:56.223350+0000","last_fullsized":"2024-04-25T09:05:56.223350+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:58.407880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"55'4","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720757+0000","last_change":"2024-04-25T09:05:54.203348+0000","last_active":"2024-04-25T09:05:56.720757+0000","last_peered":"2024-04-25T09:05:56.720757+0000","last_clean":"2024-04-25T09:05:56.720757+0000","last_became_active":"2024-04-25T09:05:54.203061+0000","last_became_peered":"2024-04-25T09:05:54.203061+0000","last_unstale":"2024-04-25T09:05:56.720757+0000","last_undegraded":"2024-04-25T09:05:56.720757+0000","last_fullsized":"2024-04-25T09:05:56.720757+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:11.289523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720800+0000","last_change":"2024-04-25T09:05:55.220487+0000","last_active":"2024-04-25T09:05:56.720800+0000","last_peered":"2024-04-25T09:05:56.720800+0000","last_clean":"2024-04-25T09:05:56.720800+0000","last_became_active":"2024-04-25T09:05:55.220074+0000","last_became_peered":"2024-04-25T09:05:55.220074+0000","last_unstale":"2024-04-25T09:05:56.720800+0000","last_undegraded":"2024-04-25T09:05:56.720800+0000","last_fullsized":"2024-04-25T09:05:56.720800+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:23:31.046644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"55'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720727+0000","last_change":"2024-04-25T09:05:54.209646+0000","last_active":"2024-04-25T09:05:56.720727+0000","last_peered":"2024-04-25T09:05:56.720727+0000","last_clean":"2024-04-25T09:05:56.720727+0000","last_became_active":"2024-04-25T09:05:54.209386+0000","last_became_peered":"2024-04-25T09:05:54.209386+0000","last_unstale":"2024-04-25T09:05:56.720727+0000","last_undegraded":"2024-04-25T09:05:56.720727+0000","last_fullsized":"2024-04-25T09:05:56.720727+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:53.098738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721288+0000","last_change":"2024-04-25T09:05:55.210315+0000","last_active":"2024-04-25T09:05:56.721288+0000","last_peered":"2024-04-25T09:05:56.721288+0000","last_clean":"2024-04-25T09:05:56.721288+0000","last_became_active":"2024-04-25T09:05:55.210015+0000","last_became_peered":"2024-04-25T09:05:55.210015+0000","last_unstale":"2024-04-25T09:05:56.721288+0000","last_undegraded":"2024-04-25T09:05:56.721288+0000","last_fullsized":"2024-04-25T09:05:56.721288+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:39.331377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"55'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720915+0000","last_change":"2024-04-25T09:05:54.203361+0000","last_active":"2024-04-25T09:05:56.720915+0000","last_peered":"2024-04-25T09:05:56.720915+0000","last_clean":"2024-04-25T09:05:56.720915+0000","last_became_active":"2024-04-25T09:05:54.203048+0000","last_became_peered":"2024-04-25T09:05:54.203048+0000","last_unstale":"2024-04-25T09:05:56.720915+0000","last_undegraded":"2024-04-25T09:05:56.720915+0000","last_fullsized":"2024-04-25T09:05:56.720915+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:50.945769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720617+0000","last_change":"2024-04-25T09:05:55.217260+0000","last_active":"2024-04-25T09:05:56.720617+0000","last_peered":"2024-04-25T09:05:56.720617+0000","last_clean":"2024-04-25T09:05:56.720617+0000","last_became_active":"2024-04-25T09:05:55.216971+0000","last_became_peered":"2024-04-25T09:05:55.216971+0000","last_unstale":"2024-04-25T09:05:56.720617+0000","last_undegraded":"2024-04-25T09:05:56.720617+0000","last_fullsized":"2024-04-25T09:05:56.720617+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:31.428280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"55'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720610+0000","last_change":"2024-04-25T09:05:54.210604+0000","last_active":"2024-04-25T09:05:56.720610+0000","last_peered":"2024-04-25T09:05:56.720610+0000","last_clean":"2024-04-25T09:05:56.720610+0000","last_became_active":"2024-04-25T09:05:54.210115+0000","last_became_peered":"2024-04-25T09:05:54.210115+0000","last_unstale":"2024-04-25T09:05:56.720610+0000","last_undegraded":"2024-04-25T09:05:56.720610+0000","last_fullsized":"2024-04-25T09:05:56.720610+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:18.006382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.221465+0000","last_change":"2024-04-25T09:05:55.215842+0000","last_active":"2024-04-25T09:05:56.221465+0000","last_peered":"2024-04-25T09:05:56.221465+0000","last_clean":"2024-04-25T09:05:56.221465+0000","last_became_active":"2024-04-25T09:05:55.215487+0000","last_became_peered":"2024-04-25T09:05:55.215487+0000","last_unstale":"2024-04-25T09:05:56.221465+0000","last_undegraded":"2024-04-25T09:05:56.221465+0000","last_fullsized":"2024-04-25T09:05:56.221465+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:45.957424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"55'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218700+0000","last_change":"2024-04-25T09:05:54.216780+0000","last_active":"2024-04-25T09:05:56.218700+0000","last_peered":"2024-04-25T09:05:56.218700+0000","last_clean":"2024-04-25T09:05:56.218700+0000","last_became_active":"2024-04-25T09:05:54.216529+0000","last_became_peered":"2024-04-25T09:05:54.216529+0000","last_unstale":"2024-04-25T09:05:56.218700+0000","last_undegraded":"2024-04-25T09:05:56.218700+0000","last_fullsized":"2024-04-25T09:05:56.218700+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:41.137095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223785+0000","last_change":"2024-04-25T09:05:55.211631+0000","last_active":"2024-04-25T09:05:56.223785+0000","last_peered":"2024-04-25T09:05:56.223785+0000","last_clean":"2024-04-25T09:05:56.223785+0000","last_became_active":"2024-04-25T09:05:55.211374+0000","last_became_peered":"2024-04-25T09:05:55.211374+0000","last_unstale":"2024-04-25T09:05:56.223785+0000","last_undegraded":"2024-04-25T09:05:56.223785+0000","last_fullsized":"2024-04-25T09:05:56.223785+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:10.316296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"55'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.221231+0000","last_change":"2024-04-25T09:05:54.205542+0000","last_active":"2024-04-25T09:05:56.221231+0000","last_peered":"2024-04-25T09:05:56.221231+0000","last_clean":"2024-04-25T09:05:56.221231+0000","last_became_active":"2024-04-25T09:05:54.205250+0000","last_became_peered":"2024-04-25T09:05:54.205250+0000","last_unstale":"2024-04-25T09:05:56.221231+0000","last_undegraded":"2024-04-25T09:05:56.221231+0000","last_fullsized":"2024-04-25T09:05:56.221231+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:11.289523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721346+0000","last_change":"2024-04-25T09:05:55.224834+0000","last_active":"2024-04-25T09:05:56.721346+0000","last_peered":"2024-04-25T09:05:56.721346+0000","last_clean":"2024-04-25T09:05:56.721346+0000","last_became_active":"2024-04-25T09:05:55.224594+0000","last_became_peered":"2024-04-25T09:05:55.224594+0000","last_unstale":"2024-04-25T09:05:56.721346+0000","last_undegraded":"2024-04-25T09:05:56.721346+0000","last_fullsized":"2024-04-25T09:05:56.721346+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:27.484334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721029+0000","last_change":"2024-04-25T09:05:54.207023+0000","last_active":"2024-04-25T09:05:56.721029+0000","last_peered":"2024-04-25T09:05:56.721029+0000","last_clean":"2024-04-25T09:05:56.721029+0000","last_became_active":"2024-04-25T09:05:54.206382+0000","last_became_peered":"2024-04-25T09:05:54.206382+0000","last_unstale":"2024-04-25T09:05:56.721029+0000","last_undegraded":"2024-04-25T09:05:56.721029+0000","last_fullsized":"2024-04-25T09:05:56.721029+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:50.302415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223891+0000","last_change":"2024-04-25T09:05:55.215366+0000","last_active":"2024-04-25T09:05:56.223891+0000","last_peered":"2024-04-25T09:05:56.223891+0000","last_clean":"2024-04-25T09:05:56.223891+0000","last_became_active":"2024-04-25T09:05:55.215099+0000","last_became_peered":"2024-04-25T09:05:55.215099+0000","last_unstale":"2024-04-25T09:05:56.223891+0000","last_undegraded":"2024-04-25T09:05:56.223891+0000","last_fullsized":"2024-04-25T09:05:56.223891+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:23.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218385+0000","last_change":"2024-04-25T09:05:54.211525+0000","last_active":"2024-04-25T09:05:56.218385+0000","last_peered":"2024-04-25T09:05:56.218385+0000","last_clean":"2024-04-25T09:05:56.218385+0000","last_became_active":"2024-04-25T09:05:54.211181+0000","last_became_peered":"2024-04-25T09:05:54.211181+0000","last_unstale":"2024-04-25T09:05:56.218385+0000","last_undegraded":"2024-04-25T09:05:56.218385+0000","last_fullsized":"2024-04-25T09:05:56.218385+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:36.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.221158+0000","last_change":"2024-04-25T09:05:55.208758+0000","last_active":"2024-04-25T09:05:56.221158+0000","last_peered":"2024-04-25T09:05:56.221158+0000","last_clean":"2024-04-25T09:05:56.221158+0000","last_became_active":"2024-04-25T09:05:55.207949+0000","last_became_peered":"2024-04-25T09:05:55.207949+0000","last_unstale":"2024-04-25T09:05:56.221158+0000","last_undegraded":"2024-04-25T09:05:56.221158+0000","last_fullsized":"2024-04-25T09:05:56.221158+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:07.076509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223851+0000","last_change":"2024-04-25T09:05:54.210644+0000","last_active":"2024-04-25T09:05:56.223851+0000","last_peered":"2024-04-25T09:05:56.223851+0000","last_clean":"2024-04-25T09:05:56.223851+0000","last_became_active":"2024-04-25T09:05:54.210237+0000","last_became_peered":"2024-04-25T09:05:54.210237+0000","last_unstale":"2024-04-25T09:05:56.223851+0000","last_undegraded":"2024-04-25T09:05:56.223851+0000","last_fullsized":"2024-04-25T09:05:56.223851+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:35.462884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720348+0000","last_change":"2024-04-25T09:05:55.213406+0000","last_active":"2024-04-25T09:05:56.720348+0000","last_peered":"2024-04-25T09:05:56.720348+0000","last_clean":"2024-04-25T09:05:56.720348+0000","last_became_active":"2024-04-25T09:05:55.213041+0000","last_became_peered":"2024-04-25T09:05:55.213041+0000","last_unstale":"2024-04-25T09:05:56.720348+0000","last_undegraded":"2024-04-25T09:05:56.720348+0000","last_fullsized":"2024-04-25T09:05:56.720348+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:38.984593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.221266+0000","last_change":"2024-04-25T09:05:54.218917+0000","last_active":"2024-04-25T09:05:56.221266+0000","last_peered":"2024-04-25T09:05:56.221266+0000","last_clean":"2024-04-25T09:05:56.221266+0000","last_became_active":"2024-04-25T09:05:54.218684+0000","last_became_peered":"2024-04-25T09:05:54.218684+0000","last_unstale":"2024-04-25T09:05:56.221266+0000","last_undegraded":"2024-04-25T09:05:56.221266+0000","last_fullsized":"2024-04-25T09:05:56.221266+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:48.113164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218752+0000","last_change":"2024-04-25T09:05:55.215918+0000","last_active":"2024-04-25T09:05:56.218752+0000","last_peered":"2024-04-25T09:05:56.218752+0000","last_clean":"2024-04-25T09:05:56.218752+0000","last_became_active":"2024-04-25T09:05:55.213487+0000","last_became_peered":"2024-04-25T09:05:55.213487+0000","last_unstale":"2024-04-25T09:05:56.218752+0000","last_undegraded":"2024-04-25T09:05:56.218752+0000","last_fullsized":"2024-04-25T09:05:56.218752+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:03.470550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"55'3","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223882+0000","last_change":"2024-04-25T09:05:54.212021+0000","last_active":"2024-04-25T09:05:56.223882+0000","last_peered":"2024-04-25T09:05:56.223882+0000","last_clean":"2024-04-25T09:05:56.223882+0000","last_became_active":"2024-04-25T09:05:54.211587+0000","last_became_peered":"2024-04-25T09:05:54.211587+0000","last_unstale":"2024-04-25T09:05:56.223882+0000","last_undegraded":"2024-04-25T09:05:56.223882+0000","last_fullsized":"2024-04-25T09:05:56.223882+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:29.891670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.221553+0000","last_change":"2024-04-25T09:05:55.213030+0000","last_active":"2024-04-25T09:05:56.221553+0000","last_peered":"2024-04-25T09:05:56.221553+0000","last_clean":"2024-04-25T09:05:56.221553+0000","last_became_active":"2024-04-25T09:05:55.212583+0000","last_became_peered":"2024-04-25T09:05:55.212583+0000","last_unstale":"2024-04-25T09:05:56.221553+0000","last_undegraded":"2024-04-25T09:05:56.221553+0000","last_fullsized":"2024-04-25T09:05:56.221553+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:54.089248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"55'6","reported_seq":20,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721260+0000","last_change":"2024-04-25T09:05:54.217131+0000","last_active":"2024-04-25T09:05:56.721260+0000","last_peered":"2024-04-25T09:05:56.721260+0000","last_clean":"2024-04-25T09:05:56.721260+0000","last_became_active":"2024-04-25T09:05:54.216815+0000","last_became_peered":"2024-04-25T09:05:54.216815+0000","last_unstale":"2024-04-25T09:05:56.721260+0000","last_undegraded":"2024-04-25T09:05:56.721260+0000","last_fullsized":"2024-04-25T09:05:56.721260+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:58.364868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720549+0000","last_change":"2024-04-25T09:05:55.220240+0000","last_active":"2024-04-25T09:05:56.720549+0000","last_peered":"2024-04-25T09:05:56.720549+0000","last_clean":"2024-04-25T09:05:56.720549+0000","last_became_active":"2024-04-25T09:05:55.219688+0000","last_became_peered":"2024-04-25T09:05:55.219688+0000","last_unstale":"2024-04-25T09:05:56.720549+0000","last_undegraded":"2024-04-25T09:05:56.720549+0000","last_fullsized":"2024-04-25T09:05:56.720549+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:35.008699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"55'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218802+0000","last_change":"2024-04-25T09:05:54.212396+0000","last_active":"2024-04-25T09:05:56.218802+0000","last_peered":"2024-04-25T09:05:56.218802+0000","last_clean":"2024-04-25T09:05:56.218802+0000","last_became_active":"2024-04-25T09:05:54.212115+0000","last_became_peered":"2024-04-25T09:05:54.212115+0000","last_unstale":"2024-04-25T09:05:56.218802+0000","last_undegraded":"2024-04-25T09:05:56.218802+0000","last_fullsized":"2024-04-25T09:05:56.218802+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:51.251036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219321+0000","last_change":"2024-04-25T09:05:55.215608+0000","last_active":"2024-04-25T09:05:56.219321+0000","last_peered":"2024-04-25T09:05:56.219321+0000","last_clean":"2024-04-25T09:05:56.219321+0000","last_became_active":"2024-04-25T09:05:55.214476+0000","last_became_peered":"2024-04-25T09:05:55.214476+0000","last_unstale":"2024-04-25T09:05:56.219321+0000","last_undegraded":"2024-04-25T09:05:56.219321+0000","last_fullsized":"2024-04-25T09:05:56.219321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:28.598212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721341+0000","last_change":"2024-04-25T09:05:54.211740+0000","last_active":"2024-04-25T09:05:56.721341+0000","last_peered":"2024-04-25T09:05:56.721341+0000","last_clean":"2024-04-25T09:05:56.721341+0000","last_became_active":"2024-04-25T09:05:54.211465+0000","last_became_peered":"2024-04-25T09:05:54.211465+0000","last_unstale":"2024-04-25T09:05:56.721341+0000","last_undegraded":"2024-04-25T09:05:56.721341+0000","last_fullsized":"2024-04-25T09:05:56.721341+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:20.035915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721214+0000","last_change":"2024-04-25T09:05:55.215032+0000","last_active":"2024-04-25T09:05:56.721214+0000","last_peered":"2024-04-25T09:05:56.721214+0000","last_clean":"2024-04-25T09:05:56.721214+0000","last_became_active":"2024-04-25T09:05:55.214713+0000","last_became_peered":"2024-04-25T09:05:55.214713+0000","last_unstale":"2024-04-25T09:05:56.721214+0000","last_undegraded":"2024-04-25T09:05:56.721214+0000","last_fullsized":"2024-04-25T09:05:56.721214+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:58.934174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223453+0000","last_change":"2024-04-25T09:05:54.209026+0000","last_active":"2024-04-25T09:05:56.223453+0000","last_peered":"2024-04-25T09:05:56.223453+0000","last_clean":"2024-04-25T09:05:56.223453+0000","last_became_active":"2024-04-25T09:05:54.208694+0000","last_became_peered":"2024-04-25T09:05:54.208694+0000","last_unstale":"2024-04-25T09:05:56.223453+0000","last_undegraded":"2024-04-25T09:05:56.223453+0000","last_fullsized":"2024-04-25T09:05:56.223453+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:33.050737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219405+0000","last_change":"2024-04-25T09:05:55.215940+0000","last_active":"2024-04-25T09:05:56.219405+0000","last_peered":"2024-04-25T09:05:56.219405+0000","last_clean":"2024-04-25T09:05:56.219405+0000","last_became_active":"2024-04-25T09:05:55.215632+0000","last_became_peered":"2024-04-25T09:05:55.215632+0000","last_unstale":"2024-04-25T09:05:56.219405+0000","last_undegraded":"2024-04-25T09:05:56.219405+0000","last_fullsized":"2024-04-25T09:05:56.219405+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:46.562069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"55'8","reported_seq":22,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720760+0000","last_change":"2024-04-25T09:05:54.212465+0000","last_active":"2024-04-25T09:05:56.720760+0000","last_peered":"2024-04-25T09:05:56.720760+0000","last_clean":"2024-04-25T09:05:56.720760+0000","last_became_active":"2024-04-25T09:05:54.212226+0000","last_became_peered":"2024-04-25T09:05:54.212226+0000","last_unstale":"2024-04-25T09:05:56.720760+0000","last_undegraded":"2024-04-25T09:05:56.720760+0000","last_fullsized":"2024-04-25T09:05:56.720760+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:57.478920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720900+0000","last_change":"2024-04-25T09:05:55.223349+0000","last_active":"2024-04-25T09:05:56.720900+0000","last_peered":"2024-04-25T09:05:56.720900+0000","last_clean":"2024-04-25T09:05:56.720900+0000","last_became_active":"2024-04-25T09:05:55.222895+0000","last_became_peered":"2024-04-25T09:05:55.222895+0000","last_unstale":"2024-04-25T09:05:56.720900+0000","last_undegraded":"2024-04-25T09:05:56.720900+0000","last_fullsized":"2024-04-25T09:05:56.720900+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:40.900352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"55'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219515+0000","last_change":"2024-04-25T09:05:54.218064+0000","last_active":"2024-04-25T09:05:56.219515+0000","last_peered":"2024-04-25T09:05:56.219515+0000","last_clean":"2024-04-25T09:05:56.219515+0000","last_became_active":"2024-04-25T09:05:54.217761+0000","last_became_peered":"2024-04-25T09:05:54.217761+0000","last_unstale":"2024-04-25T09:05:56.219515+0000","last_undegraded":"2024-04-25T09:05:56.219515+0000","last_fullsized":"2024-04-25T09:05:56.219515+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:29.422516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720370+0000","last_change":"2024-04-25T09:05:55.218750+0000","last_active":"2024-04-25T09:05:56.720370+0000","last_peered":"2024-04-25T09:05:56.720370+0000","last_clean":"2024-04-25T09:05:56.720370+0000","last_became_active":"2024-04-25T09:05:55.218416+0000","last_became_peered":"2024-04-25T09:05:55.218416+0000","last_unstale":"2024-04-25T09:05:56.720370+0000","last_undegraded":"2024-04-25T09:05:56.720370+0000","last_fullsized":"2024-04-25T09:05:56.720370+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:40.632906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"55'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.220930+0000","last_change":"2024-04-25T09:05:54.212390+0000","last_active":"2024-04-25T09:05:56.220930+0000","last_peered":"2024-04-25T09:05:56.220930+0000","last_clean":"2024-04-25T09:05:56.220930+0000","last_became_active":"2024-04-25T09:05:54.212152+0000","last_became_peered":"2024-04-25T09:05:54.212152+0000","last_unstale":"2024-04-25T09:05:56.220930+0000","last_undegraded":"2024-04-25T09:05:56.220930+0000","last_fullsized":"2024-04-25T09:05:56.220930+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:54.348144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.221156+0000","last_change":"2024-04-25T09:05:55.216352+0000","last_active":"2024-04-25T09:05:56.221156+0000","last_peered":"2024-04-25T09:05:56.221156+0000","last_clean":"2024-04-25T09:05:56.221156+0000","last_became_active":"2024-04-25T09:05:55.215830+0000","last_became_peered":"2024-04-25T09:05:55.215830+0000","last_unstale":"2024-04-25T09:05:56.221156+0000","last_undegraded":"2024-04-25T09:05:56.221156+0000","last_fullsized":"2024-04-25T09:05:56.221156+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:06.696703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"55'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721258+0000","last_change":"2024-04-25T09:05:54.202810+0000","last_active":"2024-04-25T09:05:56.721258+0000","last_peered":"2024-04-25T09:05:56.721258+0000","last_clean":"2024-04-25T09:05:56.721258+0000","last_became_active":"2024-04-25T09:05:54.202139+0000","last_became_peered":"2024-04-25T09:05:54.202139+0000","last_unstale":"2024-04-25T09:05:56.721258+0000","last_undegraded":"2024-04-25T09:05:56.721258+0000","last_fullsized":"2024-04-25T09:05:56.721258+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:48.113164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720552+0000","last_change":"2024-04-25T09:05:55.229236+0000","last_active":"2024-04-25T09:05:56.720552+0000","last_peered":"2024-04-25T09:05:56.720552+0000","last_clean":"2024-04-25T09:05:56.720552+0000","last_became_active":"2024-04-25T09:05:55.221684+0000","last_became_peered":"2024-04-25T09:05:55.221684+0000","last_unstale":"2024-04-25T09:05:56.720552+0000","last_undegraded":"2024-04-25T09:05:56.720552+0000","last_fullsized":"2024-04-25T09:05:56.720552+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:49.159743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721190+0000","last_change":"2024-04-25T09:05:54.209589+0000","last_active":"2024-04-25T09:05:56.721190+0000","last_peered":"2024-04-25T09:05:56.721190+0000","last_clean":"2024-04-25T09:05:56.721190+0000","last_became_active":"2024-04-25T09:05:54.209272+0000","last_became_peered":"2024-04-25T09:05:54.209272+0000","last_unstale":"2024-04-25T09:05:56.721190+0000","last_undegraded":"2024-04-25T09:05:56.721190+0000","last_fullsized":"2024-04-25T09:05:56.721190+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:59.668768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720735+0000","last_change":"2024-04-25T09:05:55.213743+0000","last_active":"2024-04-25T09:05:56.720735+0000","last_peered":"2024-04-25T09:05:56.720735+0000","last_clean":"2024-04-25T09:05:56.720735+0000","last_became_active":"2024-04-25T09:05:55.213465+0000","last_became_peered":"2024-04-25T09:05:55.213465+0000","last_unstale":"2024-04-25T09:05:56.720735+0000","last_undegraded":"2024-04-25T09:05:56.720735+0000","last_fullsized":"2024-04-25T09:05:56.720735+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:33.803821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"55'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720515+0000","last_change":"2024-04-25T09:05:54.208798+0000","last_active":"2024-04-25T09:05:56.720515+0000","last_peered":"2024-04-25T09:05:56.720515+0000","last_clean":"2024-04-25T09:05:56.720515+0000","last_became_active":"2024-04-25T09:05:54.208508+0000","last_became_peered":"2024-04-25T09:05:54.208508+0000","last_unstale":"2024-04-25T09:05:56.720515+0000","last_undegraded":"2024-04-25T09:05:56.720515+0000","last_fullsized":"2024-04-25T09:05:56.720515+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:27.366985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721293+0000","last_change":"2024-04-25T09:05:55.208883+0000","last_active":"2024-04-25T09:05:56.721293+0000","last_peered":"2024-04-25T09:05:56.721293+0000","last_clean":"2024-04-25T09:05:56.721293+0000","last_became_active":"2024-04-25T09:05:55.208628+0000","last_became_peered":"2024-04-25T09:05:55.208628+0000","last_unstale":"2024-04-25T09:05:56.721293+0000","last_undegraded":"2024-04-25T09:05:56.721293+0000","last_fullsized":"2024-04-25T09:05:56.721293+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:22.730055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720616+0000","last_change":"2024-04-25T09:05:54.214040+0000","last_active":"2024-04-25T09:05:56.720616+0000","last_peered":"2024-04-25T09:05:56.720616+0000","last_clean":"2024-04-25T09:05:56.720616+0000","last_became_active":"2024-04-25T09:05:54.213736+0000","last_became_peered":"2024-04-25T09:05:54.213736+0000","last_unstale":"2024-04-25T09:05:56.720616+0000","last_undegraded":"2024-04-25T09:05:56.720616+0000","last_fullsized":"2024-04-25T09:05:56.720616+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:24.174626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219354+0000","last_change":"2024-04-25T09:05:55.225764+0000","last_active":"2024-04-25T09:05:56.219354+0000","last_peered":"2024-04-25T09:05:56.219354+0000","last_clean":"2024-04-25T09:05:56.219354+0000","last_became_active":"2024-04-25T09:05:55.225406+0000","last_became_peered":"2024-04-25T09:05:55.225406+0000","last_unstale":"2024-04-25T09:05:56.219354+0000","last_undegraded":"2024-04-25T09:05:56.219354+0000","last_fullsized":"2024-04-25T09:05:56.219354+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:23.037086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218554+0000","last_change":"2024-04-25T09:05:54.212211+0000","last_active":"2024-04-25T09:05:56.218554+0000","last_peered":"2024-04-25T09:05:56.218554+0000","last_clean":"2024-04-25T09:05:56.218554+0000","last_became_active":"2024-04-25T09:05:54.211924+0000","last_became_peered":"2024-04-25T09:05:54.211924+0000","last_unstale":"2024-04-25T09:05:56.218554+0000","last_undegraded":"2024-04-25T09:05:56.218554+0000","last_fullsized":"2024-04-25T09:05:56.218554+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:15.118800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720991+0000","last_change":"2024-04-25T09:05:55.229329+0000","last_active":"2024-04-25T09:05:56.720991+0000","last_peered":"2024-04-25T09:05:56.720991+0000","last_clean":"2024-04-25T09:05:56.720991+0000","last_became_active":"2024-04-25T09:05:55.221830+0000","last_became_peered":"2024-04-25T09:05:55.221830+0000","last_unstale":"2024-04-25T09:05:56.720991+0000","last_undegraded":"2024-04-25T09:05:56.720991+0000","last_fullsized":"2024-04-25T09:05:56.720991+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:30.898656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.220575+0000","last_change":"2024-04-25T09:05:54.211504+0000","last_active":"2024-04-25T09:05:56.220575+0000","last_peered":"2024-04-25T09:05:56.220575+0000","last_clean":"2024-04-25T09:05:56.220575+0000","last_became_active":"2024-04-25T09:05:54.211265+0000","last_became_peered":"2024-04-25T09:05:54.211265+0000","last_unstale":"2024-04-25T09:05:56.220575+0000","last_undegraded":"2024-04-25T09:05:56.220575+0000","last_fullsized":"2024-04-25T09:05:56.220575+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:40.486890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720543+0000","last_change":"2024-04-25T09:05:55.236878+0000","last_active":"2024-04-25T09:05:56.720543+0000","last_peered":"2024-04-25T09:05:56.720543+0000","last_clean":"2024-04-25T09:05:56.720543+0000","last_became_active":"2024-04-25T09:05:55.236595+0000","last_became_peered":"2024-04-25T09:05:55.236595+0000","last_unstale":"2024-04-25T09:05:56.720543+0000","last_undegraded":"2024-04-25T09:05:56.720543+0000","last_fullsized":"2024-04-25T09:05:56.720543+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:36.110243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"55'2","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720876+0000","last_change":"2024-04-25T09:05:54.216421+0000","last_active":"2024-04-25T09:05:56.720876+0000","last_peered":"2024-04-25T09:05:56.720876+0000","last_clean":"2024-04-25T09:05:56.720876+0000","last_became_active":"2024-04-25T09:05:54.216159+0000","last_became_peered":"2024-04-25T09:05:54.216159+0000","last_unstale":"2024-04-25T09:05:56.720876+0000","last_undegraded":"2024-04-25T09:05:56.720876+0000","last_fullsized":"2024-04-25T09:05:56.720876+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:50.369765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720484+0000","last_change":"2024-04-25T09:05:55.212728+0000","last_active":"2024-04-25T09:05:56.720484+0000","last_peered":"2024-04-25T09:05:56.720484+0000","last_clean":"2024-04-25T09:05:56.720484+0000","last_became_active":"2024-04-25T09:05:55.212428+0000","last_became_peered":"2024-04-25T09:05:55.212428+0000","last_unstale":"2024-04-25T09:05:56.720484+0000","last_undegraded":"2024-04-25T09:05:56.720484+0000","last_fullsized":"2024-04-25T09:05:56.720484+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:08.890002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223964+0000","last_change":"2024-04-25T09:05:54.216477+0000","last_active":"2024-04-25T09:05:56.223964+0000","last_peered":"2024-04-25T09:05:56.223964+0000","last_clean":"2024-04-25T09:05:56.223964+0000","last_became_active":"2024-04-25T09:05:54.216178+0000","last_became_peered":"2024-04-25T09:05:54.216178+0000","last_unstale":"2024-04-25T09:05:56.223964+0000","last_undegraded":"2024-04-25T09:05:56.223964+0000","last_fullsized":"2024-04-25T09:05:56.223964+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:09.811164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720988+0000","last_change":"2024-04-25T09:05:55.209478+0000","last_active":"2024-04-25T09:05:56.720988+0000","last_peered":"2024-04-25T09:05:56.720988+0000","last_clean":"2024-04-25T09:05:56.720988+0000","last_became_active":"2024-04-25T09:05:55.209220+0000","last_became_peered":"2024-04-25T09:05:55.209220+0000","last_unstale":"2024-04-25T09:05:56.720988+0000","last_undegraded":"2024-04-25T09:05:56.720988+0000","last_fullsized":"2024-04-25T09:05:56.720988+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:19.675839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.218931+0000","last_change":"2024-04-25T09:05:54.218073+0000","last_active":"2024-04-25T09:05:56.218931+0000","last_peered":"2024-04-25T09:05:56.218931+0000","last_clean":"2024-04-25T09:05:56.218931+0000","last_became_active":"2024-04-25T09:05:54.217827+0000","last_became_peered":"2024-04-25T09:05:54.217827+0000","last_unstale":"2024-04-25T09:05:56.218931+0000","last_undegraded":"2024-04-25T09:05:56.218931+0000","last_fullsized":"2024-04-25T09:05:56.218931+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:19.731677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219002+0000","last_change":"2024-04-25T09:05:55.223384+0000","last_active":"2024-04-25T09:05:56.219002+0000","last_peered":"2024-04-25T09:05:56.219002+0000","last_clean":"2024-04-25T09:05:56.219002+0000","last_became_active":"2024-04-25T09:05:55.223129+0000","last_became_peered":"2024-04-25T09:05:55.223129+0000","last_unstale":"2024-04-25T09:05:56.219002+0000","last_undegraded":"2024-04-25T09:05:56.219002+0000","last_fullsized":"2024-04-25T09:05:56.219002+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:26.873286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720937+0000","last_change":"2024-04-25T09:05:54.214413+0000","last_active":"2024-04-25T09:05:56.720937+0000","last_peered":"2024-04-25T09:05:56.720937+0000","last_clean":"2024-04-25T09:05:56.720937+0000","last_became_active":"2024-04-25T09:05:54.214139+0000","last_became_peered":"2024-04-25T09:05:54.214139+0000","last_unstale":"2024-04-25T09:05:56.720937+0000","last_undegraded":"2024-04-25T09:05:56.720937+0000","last_fullsized":"2024-04-25T09:05:56.720937+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:02.463564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720536+0000","last_change":"2024-04-25T09:05:55.221842+0000","last_active":"2024-04-25T09:05:56.720536+0000","last_peered":"2024-04-25T09:05:56.720536+0000","last_clean":"2024-04-25T09:05:56.720536+0000","last_became_active":"2024-04-25T09:05:55.221587+0000","last_became_peered":"2024-04-25T09:05:55.221587+0000","last_unstale":"2024-04-25T09:05:56.720536+0000","last_undegraded":"2024-04-25T09:05:56.720536+0000","last_fullsized":"2024-04-25T09:05:56.720536+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:27.311776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720751+0000","last_change":"2024-04-25T09:05:54.208816+0000","last_active":"2024-04-25T09:05:56.720751+0000","last_peered":"2024-04-25T09:05:56.720751+0000","last_clean":"2024-04-25T09:05:56.720751+0000","last_became_active":"2024-04-25T09:05:54.208534+0000","last_became_peered":"2024-04-25T09:05:54.208534+0000","last_unstale":"2024-04-25T09:05:56.720751+0000","last_undegraded":"2024-04-25T09:05:56.720751+0000","last_fullsized":"2024-04-25T09:05:56.720751+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:04.694559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219258+0000","last_change":"2024-04-25T09:05:55.239969+0000","last_active":"2024-04-25T09:05:56.219258+0000","last_peered":"2024-04-25T09:05:56.219258+0000","last_clean":"2024-04-25T09:05:56.219258+0000","last_became_active":"2024-04-25T09:05:55.239661+0000","last_became_peered":"2024-04-25T09:05:55.239661+0000","last_unstale":"2024-04-25T09:05:56.219258+0000","last_undegraded":"2024-04-25T09:05:56.219258+0000","last_fullsized":"2024-04-25T09:05:56.219258+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:10.316296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.221055+0000","last_change":"2024-04-25T09:05:54.218546+0000","last_active":"2024-04-25T09:05:56.221055+0000","last_peered":"2024-04-25T09:05:56.221055+0000","last_clean":"2024-04-25T09:05:56.221055+0000","last_became_active":"2024-04-25T09:05:54.218184+0000","last_became_peered":"2024-04-25T09:05:54.218184+0000","last_unstale":"2024-04-25T09:05:56.221055+0000","last_undegraded":"2024-04-25T09:05:56.221055+0000","last_fullsized":"2024-04-25T09:05:56.221055+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:59.668768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721484+0000","last_change":"2024-04-25T09:05:55.213099+0000","last_active":"2024-04-25T09:05:56.721484+0000","last_peered":"2024-04-25T09:05:56.721484+0000","last_clean":"2024-04-25T09:05:56.721484+0000","last_became_active":"2024-04-25T09:05:55.212816+0000","last_became_peered":"2024-04-25T09:05:55.212816+0000","last_unstale":"2024-04-25T09:05:56.721484+0000","last_undegraded":"2024-04-25T09:05:56.721484+0000","last_fullsized":"2024-04-25T09:05:56.721484+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:51.773279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.720608+0000","last_change":"2024-04-25T09:05:54.208852+0000","last_active":"2024-04-25T09:05:56.720608+0000","last_peered":"2024-04-25T09:05:56.720608+0000","last_clean":"2024-04-25T09:05:56.720608+0000","last_became_active":"2024-04-25T09:05:54.208561+0000","last_became_peered":"2024-04-25T09:05:54.208561+0000","last_unstale":"2024-04-25T09:05:56.720608+0000","last_undegraded":"2024-04-25T09:05:56.720608+0000","last_fullsized":"2024-04-25T09:05:56.720608+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:19.839847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.721055+0000","last_change":"2024-04-25T09:05:55.214202+0000","last_active":"2024-04-25T09:05:56.721055+0000","last_peered":"2024-04-25T09:05:56.721055+0000","last_clean":"2024-04-25T09:05:56.721055+0000","last_became_active":"2024-04-25T09:05:55.213411+0000","last_became_peered":"2024-04-25T09:05:55.213411+0000","last_unstale":"2024-04-25T09:05:56.721055+0000","last_undegraded":"2024-04-25T09:05:56.721055+0000","last_fullsized":"2024-04-25T09:05:56.721055+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:54.183729+0000","last_clean_scrub_stamp":"2024-04-25T09:05:54.183729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:54.089248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"56'1","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.219389+0000","last_change":"2024-04-25T09:05:54.213735+0000","last_active":"2024-04-25T09:05:56.219389+0000","last_peered":"2024-04-25T09:05:56.219389+0000","last_clean":"2024-04-25T09:05:56.219389+0000","last_became_active":"2024-04-25T09:05:54.213473+0000","last_became_peered":"2024-04-25T09:05:54.213473+0000","last_unstale":"2024-04-25T09:05:56.219389+0000","last_undegraded":"2024-04-25T09:05:56.219389+0000","last_fullsized":"2024-04-25T09:05:56.219389+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:53.176744+0000","last_clean_scrub_stamp":"2024-04-25T09:05:53.176744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:48.379855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":233,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:05:56.223303+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:05:56.223303+0000","last_peered":"2024-04-25T09:05:56.223303+0000","last_clean":"2024-04-25T09:05:56.223303+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:05:56.223303+0000","last_undegraded":"2024-04-25T09:05:56.223303+0000","last_fullsized":"2024-04-25T09:05:56.223303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35992,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335848,"statfs":{"total":96636764160,"available":96599908352,"internally_reserved":0,"allocated":667648,"data_stored":296008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":659456,"data_stored":295356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40148,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331692,"statfs":{"total":96636764160,"available":96595652608,"internally_reserved":0,"allocated":663552,"data_stored":295938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36004,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335836,"statfs":{"total":96636764160,"available":96599896064,"internally_reserved":0,"allocated":675840,"data_stored":296990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509483,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36000,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335840,"statfs":{"total":96636764160,"available":96599900160,"internally_reserved":0,"allocated":671744,"data_stored":296968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35996,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335844,"statfs":{"total":96636764160,"available":96599904256,"internally_reserved":0,"allocated":667648,"data_stored":295516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40740,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331100,"statfs":{"total":96636764160,"available":96595046400,"internally_reserved":0,"allocated":1261568,"data_stored":885780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36576,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335264,"statfs":{"total":96636764160,"available":96599310336,"internally_reserved":0,"allocated":1261568,"data_stored":885848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:06:04.138 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:06:04.138 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:06:04.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.327+0000 7f9319c00640 1 Processor -- start 2024-04-25T09:06:04.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.327+0000 7f9319c00640 1 -- start start 2024-04-25T09:06:04.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9319c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f931406e1c0 0x7f931406bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9319c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f931406ae30 con 0x7f93140ad5c0 2024-04-25T09:06:04.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9319c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f931406b110 con 0x7f931406c410 2024-04-25T09:06:04.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9319c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93140b3170 con 0x7f931406e1c0 2024-04-25T09:06:04.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9313400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f93140ad5c0 0x7f93141677c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47588/0 (socket says 172.21.15.173:47588) 2024-04-25T09:06:04.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9313400640 1 -- 172.21.15.173:0/1523890323 learned_addr learned my addr 172.21.15.173:0/1523890323 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:04.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9312a00640 1 --2- 172.21.15.173:0/1523890323 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f931406e1c0 0x7f931406bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9311600640 1 -- 172.21.15.173:0/1523890323 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846108812 0 0) 0x7f931406ae30 con 0x7f93140ad5c0 2024-04-25T09:06:04.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9311600640 1 -- 172.21.15.173:0/1523890323 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92f8003530 con 0x7f93140ad5c0 2024-04-25T09:06:04.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9311600640 1 -- 172.21.15.173:0/1523890323 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 671546038 0 0) 0x7f92f8003530 con 0x7f93140ad5c0 2024-04-25T09:06:04.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9311600640 1 -- 172.21.15.173:0/1523890323 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f931406e1c0 msgr2=0x7f931406bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:04.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9311600640 1 --2- 172.21.15.173:0/1523890323 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f931406e1c0 0x7f931406bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9311600640 1 -- 172.21.15.173:0/1523890323 >> v1:172.21.15.194:6789/0 conn(0x7f931406c410 legacy=0x7f93140aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9311600640 1 -- 172.21.15.173:0/1523890323 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931406b3f0 con 0x7f93140ad5c0 2024-04-25T09:06:04.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9311600640 1 -- 172.21.15.173:0/1523890323 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f930c001a00 con 0x7f93140ad5c0 2024-04-25T09:06:04.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9311600640 1 -- 172.21.15.173:0/1523890323 >> v1:172.21.15.173:6789/0 conn(0x7f93140ad5c0 legacy=0x7f93141677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9311600640 1 --2- 172.21.15.173:0/1523890323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92f80039f0 0x7f92f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9311600640 1 --2- 172.21.15.173:0/1523890323 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f931406e1c0 0x7f92f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9311600640 1 --2- 172.21.15.173:0/1523890323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92f8004d50 0x7f92f80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9311600640 1 -- 172.21.15.173:0/1523890323 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f800b9d0 con 0x7f92f8004d50 2024-04-25T09:06:04.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9311600640 1 -- 172.21.15.173:0/1523890323 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f800bb50 con 0x7f92f80039f0 2024-04-25T09:06:04.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9311600640 1 -- 172.21.15.173:0/1523890323 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f800bd50 con 0x7f931406e1c0 2024-04-25T09:06:04.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9313400640 1 --2- 172.21.15.173:0/1523890323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92f8004d50 0x7f92f80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9312a00640 1 --2- 172.21.15.173:0/1523890323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92f80039f0 0x7f92f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9312000640 1 --2- 172.21.15.173:0/1523890323 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f931406e1c0 0x7f92f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9313400640 1 -- 172.21.15.173:0/1523890323 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f931406e1c0 msgr2=0x7f92f8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:04.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9313400640 1 --2- 172.21.15.173:0/1523890323 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f931406e1c0 0x7f92f8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9313400640 1 -- 172.21.15.173:0/1523890323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92f80039f0 msgr2=0x7f92f8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:04.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9313400640 1 --2- 172.21.15.173:0/1523890323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92f80039f0 0x7f92f8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.331+0000 7f9313400640 1 -- 172.21.15.173:0/1523890323 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f8003530 con 0x7f92f8004d50 2024-04-25T09:06:04.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.335+0000 7f9313400640 1 --2- 172.21.15.173:0/1523890323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92f8004d50 0x7f92f80051d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f930c00a880 tx=0x7f930c01d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f491776d2547cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.335+0000 7f9311600640 1 -- 172.21.15.173:0/1523890323 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c00a4a0 con 0x7f92f8004d50 2024-04-25T09:06:04.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.335+0000 7f9311600640 1 -- 172.21.15.173:0/1523890323 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930c0ad650 con 0x7f92f8004d50 2024-04-25T09:06:04.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.335+0000 7f9311600640 1 -- 172.21.15.173:0/1523890323 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c0ada40 con 0x7f92f8004d50 2024-04-25T09:06:04.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.335+0000 7f9319c00640 1 -- 172.21.15.173:0/1523890323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92f8004d50 msgr2=0x7f92f80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.335+0000 7f9319c00640 1 --2- 172.21.15.173:0/1523890323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92f8004d50 0x7f92f80051d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f930c00a880 tx=0x7f930c01d380 comp rx=0 tx=0).stop 2024-04-25T09:06:04.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.335+0000 7f9313400640 1 -- 172.21.15.173:0/1523890323 reap_dead start 2024-04-25T09:06:04.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.335+0000 7f9319c00640 1 -- 172.21.15.173:0/1523890323 shutdown_connections 2024-04-25T09:06:04.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.335+0000 7f9319c00640 1 -- 172.21.15.173:0/1523890323 >> 172.21.15.173:0/1523890323 conn(0x7f93140cfed0 msgr2=0x7f93140d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:04.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.335+0000 7f9319c00640 1 -- 172.21.15.173:0/1523890323 shutdown_connections 2024-04-25T09:06:04.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.335+0000 7f9319c00640 1 -- 172.21.15.173:0/1523890323 wait complete. 2024-04-25T09:06:04.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.335+0000 7f9319c00640 1 Processor -- start 2024-04-25T09:06:04.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.335+0000 7f9319c00640 1 -- start start 2024-04-25T09:06:04.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9319c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92f8004d50 0x7f931414f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9319c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9314151f30 0x7f93141e6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9319c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93141e7470 0x7f9314153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9319c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931406b9b0 con 0x7f9314151f30 2024-04-25T09:06:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9319c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931415e070 con 0x7f93141e7470 2024-04-25T09:06:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9319c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931406bed0 con 0x7f92f8004d50 2024-04-25T09:06:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9312000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9314151f30 0x7f93141e6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9312000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9314151f30 0x7f93141e6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49342/0 (socket says 172.21.15.173:49342) 2024-04-25T09:06:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9312000640 1 -- 172.21.15.173:0/3088755299 learned_addr learned my addr 172.21.15.173:0/3088755299 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9312a00640 1 --2- 172.21.15.173:0/3088755299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92f8004d50 0x7f931414f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9313400640 1 --2- 172.21.15.173:0/3088755299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93141e7470 0x7f9314153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9312000640 1 -- 172.21.15.173:0/3088755299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92f8004d50 msgr2=0x7f931414f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9312000640 1 --2- 172.21.15.173:0/3088755299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92f8004d50 0x7f931414f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9312000640 1 -- 172.21.15.173:0/3088755299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93141e7470 msgr2=0x7f9314153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9312000640 1 --2- 172.21.15.173:0/3088755299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93141e7470 0x7f9314153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9312000640 1 -- 172.21.15.173:0/3088755299 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9314150ed0 con 0x7f9314151f30 2024-04-25T09:06:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9313400640 1 --2- 172.21.15.173:0/3088755299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93141e7470 0x7f9314153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9312000640 1 --2- 172.21.15.173:0/3088755299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9314151f30 0x7f93141e6f30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f930000f820 tx=0x7f930000fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f930aa00640 1 -- 172.21.15.173:0/3088755299 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93000050d0 con 0x7f9314151f30 2024-04-25T09:06:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f930aa00640 1 -- 172.21.15.173:0/3088755299 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9300018070 con 0x7f9314151f30 2024-04-25T09:06:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f930aa00640 1 -- 172.21.15.173:0/3088755299 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930000d6d0 con 0x7f9314151f30 2024-04-25T09:06:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9319c00640 1 -- 172.21.15.173:0/3088755299 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9314151170 con 0x7f9314151f30 2024-04-25T09:06:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9319c00640 1 -- 172.21.15.173:0/3088755299 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9314151730 con 0x7f9314151f30 2024-04-25T09:06:04.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f9319c00640 1 -- 172.21.15.173:0/3088755299 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9314073ab0 con 0x7f9314151f30 2024-04-25T09:06:04.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.339+0000 7f930aa00640 1 -- 172.21.15.173:0/3088755299 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f930000d870 con 0x7f9314151f30 2024-04-25T09:06:04.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.343+0000 7f930aa00640 1 --2- 172.21.15.173:0/3088755299 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92f4066f60 0x7f92f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.343+0000 7f930aa00640 1 -- 172.21.15.173:0/3088755299 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9300084f50 con 0x7f9314151f30 2024-04-25T09:06:04.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.343+0000 7f9312a00640 1 --2- 172.21.15.173:0/3088755299 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92f4066f60 0x7f92f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.343+0000 7f9312a00640 1 --2- 172.21.15.173:0/3088755299 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92f4066f60 0x7f92f4069420 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9304009be0 tx=0x7f9304009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.347+0000 7f930aa00640 1 -- 172.21.15.173:0/3088755299 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9300055dc0 con 0x7f9314151f30 2024-04-25T09:06:04.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.555+0000 7f9319c00640 1 -- 172.21.15.173:0/3088755299 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f93140cf740 con 0x7f9314151f30 2024-04-25T09:06:04.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.559+0000 7f930aa00640 1 -- 172.21.15.173:0/3088755299 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) v1 ==== 190+0+147 (secure 0 0 0) 0x7f93000556c0 con 0x7f9314151f30 2024-04-25T09:06:04.549 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2024-04-25T09:06:04.549 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w== 2024-04-25T09:06:04.550 INFO:teuthology.orchestra.run.smithi173.stdout: caps mds = "allow" 2024-04-25T09:06:04.550 INFO:teuthology.orchestra.run.smithi173.stdout: caps mon = "allow r" 2024-04-25T09:06:04.550 INFO:teuthology.orchestra.run.smithi173.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:06:04.550 INFO:teuthology.orchestra.run.smithi173.stderr:updated caps for client.0 2024-04-25T09:06:04.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.559+0000 7f9319c00640 1 -- 172.21.15.173:0/3088755299 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92f4066f60 msgr2=0x7f92f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.559+0000 7f9319c00640 1 --2- 172.21.15.173:0/3088755299 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92f4066f60 0x7f92f4069420 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9304009be0 tx=0x7f9304009190 comp rx=0 tx=0).stop 2024-04-25T09:06:04.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.559+0000 7f9319c00640 1 -- 172.21.15.173:0/3088755299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9314151f30 msgr2=0x7f93141e6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.559+0000 7f9319c00640 1 --2- 172.21.15.173:0/3088755299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9314151f30 0x7f93141e6f30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f930000f820 tx=0x7f930000fc20 comp rx=0 tx=0).stop 2024-04-25T09:06:04.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.559+0000 7f9319c00640 1 -- 172.21.15.173:0/3088755299 shutdown_connections 2024-04-25T09:06:04.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.559+0000 7f9319c00640 1 --2- 172.21.15.173:0/3088755299 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92f4066f60 0x7f92f4069420 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.559+0000 7f9319c00640 1 --2- 172.21.15.173:0/3088755299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93141e7470 0x7f9314153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.559+0000 7f9319c00640 1 --2- 172.21.15.173:0/3088755299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9314151f30 0x7f93141e6f30 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.559+0000 7f9319c00640 1 --2- 172.21.15.173:0/3088755299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92f8004d50 0x7f931414f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.559+0000 7f9319c00640 1 -- 172.21.15.173:0/3088755299 >> 172.21.15.173:0/3088755299 conn(0x7f93140cfed0 msgr2=0x7f93140afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:04.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.559+0000 7f9319c00640 1 -- 172.21.15.173:0/3088755299 shutdown_connections 2024-04-25T09:06:04.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.559+0000 7f9319c00640 1 -- 172.21.15.173:0/3088755299 wait complete. 2024-04-25T09:06:04.571 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:04.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.715+0000 7f6d0ec00640 1 Processor -- start 2024-04-25T09:06:04.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.715+0000 7f6d0ec00640 1 -- start start 2024-04-25T09:06:04.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.715+0000 7f6d0ec00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6d08145250 0x7f6d0815c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.715+0000 7f6d0ec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d080ccd30 0x7f6d08071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.715+0000 7f6d0ec00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d0815cec0 con 0x7f6d080cc8b0 2024-04-25T09:06:04.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.715+0000 7f6d0ec00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d0806e7c0 con 0x7f6d08145250 2024-04-25T09:06:04.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.715+0000 7f6d0ec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0806d720 con 0x7f6d080ccd30 2024-04-25T09:06:04.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.715+0000 7f6d0cc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d080ccd30 0x7f6d08071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.715+0000 7f6d0cc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d080ccd30 0x7f6d08071a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:40094/0 (socket says 172.21.15.173:40094) 2024-04-25T09:06:04.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.715+0000 7f6d0cc00640 1 -- 172.21.15.173:0/2785759529 learned_addr learned my addr 172.21.15.173:0/2785759529 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:04.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.715+0000 7f6d07e00640 1 --2- 172.21.15.173:0/2785759529 >> v2:172.21.15.194:3300/0 conn(0x7f6d08145250 0x7f6d0815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.719+0000 7f6d0cc00640 1 -- 172.21.15.173:0/2785759529 >> v2:172.21.15.194:3300/0 conn(0x7f6d08145250 msgr2=0x7f6d0815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:04.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.719+0000 7f6d0cc00640 1 --2- 172.21.15.173:0/2785759529 >> v2:172.21.15.194:3300/0 conn(0x7f6d08145250 0x7f6d0815c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.719+0000 7f6d0cc00640 1 -- 172.21.15.173:0/2785759529 >> v1:172.21.15.194:6789/0 conn(0x7f6d080cc8b0 legacy=0x7f6d08071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.719+0000 7f6d0cc00640 1 -- 172.21.15.173:0/2785759529 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0806da00 con 0x7f6d080ccd30 2024-04-25T09:06:04.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.719+0000 7f6d06a00640 1 -- 172.21.15.173:0/2785759529 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959062656 0 0) 0x7f6cf0001120 con 0x7f6d080cc8b0 2024-04-25T09:06:04.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.719+0000 7f6d0cc00640 1 --2- 172.21.15.173:0/2785759529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d080ccd30 0x7f6d08071a30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6d00009e50 tx=0x7f6d0001ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3ab29eca5f17d0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.719+0000 7f6d06a00640 1 -- 172.21.15.173:0/2785759529 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d000a58d0 con 0x7f6d080ccd30 2024-04-25T09:06:04.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.719+0000 7f6d06a00640 1 -- 172.21.15.173:0/2785759529 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d000a5a70 con 0x7f6d080ccd30 2024-04-25T09:06:04.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.719+0000 7f6d06a00640 1 -- 172.21.15.173:0/2785759529 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d000a5e40 con 0x7f6d080ccd30 2024-04-25T09:06:04.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0ec00640 1 -- 172.21.15.173:0/2785759529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d080ccd30 msgr2=0x7f6d08071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0ec00640 1 --2- 172.21.15.173:0/2785759529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d080ccd30 0x7f6d08071a30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6d00009e50 tx=0x7f6d0001ca00 comp rx=0 tx=0).stop 2024-04-25T09:06:04.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0ec00640 1 -- 172.21.15.173:0/2785759529 shutdown_connections 2024-04-25T09:06:04.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0ec00640 1 --2- 172.21.15.173:0/2785759529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d080ccd30 0x7f6d08071a30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0ec00640 1 --2- 172.21.15.173:0/2785759529 >> v2:172.21.15.194:3300/0 conn(0x7f6d08145250 0x7f6d0815c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0ec00640 1 -- 172.21.15.173:0/2785759529 >> 172.21.15.173:0/2785759529 conn(0x7f6d0806ac90 msgr2=0x7f6d0806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:04.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0ec00640 1 -- 172.21.15.173:0/2785759529 shutdown_connections 2024-04-25T09:06:04.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0ec00640 1 -- 172.21.15.173:0/2785759529 wait complete. 2024-04-25T09:06:04.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0ec00640 1 Processor -- start 2024-04-25T09:06:04.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0ec00640 1 -- start start 2024-04-25T09:06:04.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0ec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d080cc8b0 0x7f6d080b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0ec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d080ccd30 0x7f6d08143160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0ec00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d08145250 0x7f6d080b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0ec00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080cd180 con 0x7f6d08145250 2024-04-25T09:06:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0ec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d08145630 con 0x7f6d080cc8b0 2024-04-25T09:06:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0ec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0806ef80 con 0x7f6d080ccd30 2024-04-25T09:06:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0cc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d08145250 0x7f6d080b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d07400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d080ccd30 0x7f6d08143160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0cc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d08145250 0x7f6d080b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49358/0 (socket says 172.21.15.173:49358) 2024-04-25T09:06:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0cc00640 1 -- 172.21.15.173:0/2579370632 learned_addr learned my addr 172.21.15.173:0/2579370632 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d07e00640 1 --2- 172.21.15.173:0/2579370632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d080cc8b0 0x7f6d080b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0cc00640 1 -- 172.21.15.173:0/2579370632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d080ccd30 msgr2=0x7f6d08143160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0cc00640 1 --2- 172.21.15.173:0/2579370632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d080ccd30 0x7f6d08143160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0cc00640 1 -- 172.21.15.173:0/2579370632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d080cc8b0 msgr2=0x7f6d080b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0cc00640 1 --2- 172.21.15.173:0/2579370632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d080cc8b0 0x7f6d080b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d0cc00640 1 -- 172.21.15.173:0/2579370632 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d081436a0 con 0x7f6d08145250 2024-04-25T09:06:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.723+0000 7f6d07400640 1 --2- 172.21.15.173:0/2579370632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d080ccd30 0x7f6d08143160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:04.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.727+0000 7f6d0cc00640 1 --2- 172.21.15.173:0/2579370632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d08145250 0x7f6d080b2870 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6d00009e50 tx=0x7f6d000197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.727+0000 7f6cffe00640 1 -- 172.21.15.173:0/2579370632 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d000a58d0 con 0x7f6d08145250 2024-04-25T09:06:04.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.727+0000 7f6cffe00640 1 -- 172.21.15.173:0/2579370632 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d000be070 con 0x7f6d08145250 2024-04-25T09:06:04.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.727+0000 7f6cffe00640 1 -- 172.21.15.173:0/2579370632 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00009510 con 0x7f6d08145250 2024-04-25T09:06:04.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.727+0000 7f6d0ec00640 1 -- 172.21.15.173:0/2579370632 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d080ae160 con 0x7f6d08145250 2024-04-25T09:06:04.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.727+0000 7f6d0ec00640 1 -- 172.21.15.173:0/2579370632 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d080b36c0 con 0x7f6d08145250 2024-04-25T09:06:04.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.727+0000 7f6d0ec00640 1 -- 172.21.15.173:0/2579370632 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d08073a40 con 0x7f6d08145250 2024-04-25T09:06:04.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.727+0000 7f6cffe00640 1 -- 172.21.15.173:0/2579370632 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6d000b86b0 con 0x7f6d08145250 2024-04-25T09:06:04.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.727+0000 7f6cffe00640 1 --2- 172.21.15.173:0/2579370632 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6ce4066f60 0x7f6ce4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.727+0000 7f6cffe00640 1 -- 172.21.15.173:0/2579370632 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6d001207a0 con 0x7f6d08145250 2024-04-25T09:06:04.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.727+0000 7f6d07e00640 1 --2- 172.21.15.173:0/2579370632 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6ce4066f60 0x7f6ce4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.731+0000 7f6d07e00640 1 --2- 172.21.15.173:0/2579370632 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6ce4066f60 0x7f6ce4069420 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8009b60 tx=0x7f6cf8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.731+0000 7f6cffe00640 1 -- 172.21.15.173:0/2579370632 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6d00016620 con 0x7f6d08145250 2024-04-25T09:06:04.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.923+0000 7f6d0ec00640 1 -- 172.21.15.173:0/2579370632 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d0815be50 con 0x7f6d08145250 2024-04-25T09:06:04.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.923+0000 7f6cffe00640 1 -- 172.21.15.173:0/2579370632 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f6d000f0ea0 con 0x7f6d08145250 2024-04-25T09:06:04.914 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:04.914 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:05:57.598642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:04.915 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 26 2024-04-25T09:06:04.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.923+0000 7f6d0ec00640 1 -- 172.21.15.173:0/2579370632 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6ce4066f60 msgr2=0x7f6ce4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.923+0000 7f6d0ec00640 1 --2- 172.21.15.173:0/2579370632 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6ce4066f60 0x7f6ce4069420 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8009b60 tx=0x7f6cf8009190 comp rx=0 tx=0).stop 2024-04-25T09:06:04.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.923+0000 7f6d0ec00640 1 -- 172.21.15.173:0/2579370632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d08145250 msgr2=0x7f6d080b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.923+0000 7f6d0ec00640 1 --2- 172.21.15.173:0/2579370632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d08145250 0x7f6d080b2870 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6d00009e50 tx=0x7f6d000197a0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.923+0000 7f6d0ec00640 1 -- 172.21.15.173:0/2579370632 shutdown_connections 2024-04-25T09:06:04.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.923+0000 7f6d0ec00640 1 --2- 172.21.15.173:0/2579370632 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6ce4066f60 0x7f6ce4069420 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.923+0000 7f6d0ec00640 1 --2- 172.21.15.173:0/2579370632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d08145250 0x7f6d080b2870 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.923+0000 7f6d0ec00640 1 --2- 172.21.15.173:0/2579370632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d080ccd30 0x7f6d08143160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.923+0000 7f6d0ec00640 1 --2- 172.21.15.173:0/2579370632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d080cc8b0 0x7f6d080b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.923+0000 7f6d0ec00640 1 -- 172.21.15.173:0/2579370632 >> 172.21.15.173:0/2579370632 conn(0x7f6d0806ac90 msgr2=0x7f6d080ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:04.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.923+0000 7f6d0ec00640 1 -- 172.21.15.173:0/2579370632 shutdown_connections 2024-04-25T09:06:04.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:04.923+0000 7f6d0ec00640 1 -- 172.21.15.173:0/2579370632 wait complete. 2024-04-25T09:06:05.338 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:05:54.582822+0000', 'modified': '2024-04-25T09:05:57.598642+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5874}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5874': {'gid': 5874, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.173:6837/3298938023', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6835', 'nonce': 3298938023}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 3298938023}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:06:05.338 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:06:05.339 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:06:05.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbff200640 1 Processor -- start 2024-04-25T09:06:05.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbff200640 1 -- start start 2024-04-25T09:06:05.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbff200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc0015da40 0x7fcc000cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbff200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcc00161480 0x7fcc001618c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbff200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcc00161e00 0x7fcc0015de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbff200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0006db50 con 0x7fcc00161480 2024-04-25T09:06:05.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbff200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc000d0b50 con 0x7fcc00161e00 2024-04-25T09:06:05.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbff200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000616b0 con 0x7fcc0015da40 2024-04-25T09:06:05.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbfd400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcc00161480 0x7fcc001618c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbfd400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcc00161480 0x7fcc001618c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49362/0 (socket says 172.21.15.173:49362) 2024-04-25T09:06:05.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbfd400640 1 -- 172.21.15.173:0/733855430 learned_addr learned my addr 172.21.15.173:0/733855430 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:05.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbfde00640 1 --2- 172.21.15.173:0/733855430 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc0015da40 0x7fcc000cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbfe800640 1 --2- 172.21.15.173:0/733855430 >> v2:172.21.15.194:3300/0 conn(0x7fcc00161e00 0x7fcc0015de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbfd400640 1 -- 172.21.15.173:0/733855430 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc0015da40 msgr2=0x7fcc000cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:05.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbfd400640 1 --2- 172.21.15.173:0/733855430 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc0015da40 0x7fcc000cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbfd400640 1 -- 172.21.15.173:0/733855430 >> v2:172.21.15.194:3300/0 conn(0x7fcc00161e00 msgr2=0x7fcc0015de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:05.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbfd400640 1 --2- 172.21.15.173:0/733855430 >> v2:172.21.15.194:3300/0 conn(0x7fcc00161e00 0x7fcc0015de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbfd400640 1 -- 172.21.15.173:0/733855430 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc00061990 con 0x7fcc00161480 2024-04-25T09:06:05.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.487+0000 7fcbfde00640 1 --2- 172.21.15.173:0/733855430 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc0015da40 0x7fcc000cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:05.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.491+0000 7fcbfd400640 1 --2- 172.21.15.173:0/733855430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc00161480 0x7fcc001618c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcc00073280 tx=0x7fcbf001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b5bf680f7c3a25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:05.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.491+0000 7fcbfca00640 1 -- 172.21.15.173:0/733855430 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00aa610 con 0x7fcc00161480 2024-04-25T09:06:05.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.491+0000 7fcbfca00640 1 -- 172.21.15.173:0/733855430 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf00af070 con 0x7fcc00161480 2024-04-25T09:06:05.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.491+0000 7fcbfca00640 1 -- 172.21.15.173:0/733855430 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00aa9d0 con 0x7fcc00161480 2024-04-25T09:06:05.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.491+0000 7fcbff200640 1 -- 172.21.15.173:0/733855430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc00161480 msgr2=0x7fcc001618c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.491+0000 7fcbff200640 1 --2- 172.21.15.173:0/733855430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc00161480 0x7fcc001618c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcc00073280 tx=0x7fcbf001c4f0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.491+0000 7fcbff200640 1 -- 172.21.15.173:0/733855430 shutdown_connections 2024-04-25T09:06:05.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.491+0000 7fcbff200640 1 --2- 172.21.15.173:0/733855430 >> v2:172.21.15.194:3300/0 conn(0x7fcc00161e00 0x7fcc0015de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.491+0000 7fcbff200640 1 --2- 172.21.15.173:0/733855430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc00161480 0x7fcc001618c0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.491+0000 7fcbff200640 1 --2- 172.21.15.173:0/733855430 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc0015da40 0x7fcc000cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.491+0000 7fcbff200640 1 -- 172.21.15.173:0/733855430 >> 172.21.15.173:0/733855430 conn(0x7fcc000cfd60 msgr2=0x7fcc000d0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:05.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.491+0000 7fcbff200640 1 -- 172.21.15.173:0/733855430 shutdown_connections 2024-04-25T09:06:05.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.491+0000 7fcbff200640 1 -- 172.21.15.173:0/733855430 wait complete. 2024-04-25T09:06:05.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbff200640 1 Processor -- start 2024-04-25T09:06:05.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbff200640 1 -- start start 2024-04-25T09:06:05.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbff200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc0015da40 0x7fcc000ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbff200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc00161480 0x7fcc00152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbff200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc00161e00 0x7fcc00159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbff200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0015eb70 con 0x7fcc00161480 2024-04-25T09:06:05.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbff200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00162210 con 0x7fcc00161e00 2024-04-25T09:06:05.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbff200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0015ecf0 con 0x7fcc0015da40 2024-04-25T09:06:05.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbfd400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc00161480 0x7fcc00152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbfd400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc00161480 0x7fcc00152cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49370/0 (socket says 172.21.15.173:49370) 2024-04-25T09:06:05.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbfd400640 1 -- 172.21.15.173:0/1379281953 learned_addr learned my addr 172.21.15.173:0/1379281953 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:05.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbfe800640 1 --2- 172.21.15.173:0/1379281953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc00161e00 0x7fcc00159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbfde00640 1 --2- 172.21.15.173:0/1379281953 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc0015da40 0x7fcc000ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbfd400640 1 -- 172.21.15.173:0/1379281953 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc0015da40 msgr2=0x7fcc000ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbfd400640 1 --2- 172.21.15.173:0/1379281953 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc0015da40 0x7fcc000ad4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbfd400640 1 -- 172.21.15.173:0/1379281953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc00161e00 msgr2=0x7fcc00159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbfd400640 1 --2- 172.21.15.173:0/1379281953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc00161e00 0x7fcc00159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbfd400640 1 -- 172.21.15.173:0/1379281953 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc000ada80 con 0x7fcc00161480 2024-04-25T09:06:05.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbfe800640 1 --2- 172.21.15.173:0/1379281953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc00161e00 0x7fcc00159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:05.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbfde00640 1 --2- 172.21.15.173:0/1379281953 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc0015da40 0x7fcc000ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:05.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbfd400640 1 --2- 172.21.15.173:0/1379281953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc00161480 0x7fcc00152cb0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcbf001aba0 tx=0x7fcbf001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:05.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbf6000640 1 -- 172.21.15.173:0/1379281953 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00bd5f0 con 0x7fcc00161480 2024-04-25T09:06:05.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbf6000640 1 -- 172.21.15.173:0/1379281953 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf00bd790 con 0x7fcc00161480 2024-04-25T09:06:05.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbf6000640 1 -- 172.21.15.173:0/1379281953 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00bdb40 con 0x7fcc00161480 2024-04-25T09:06:05.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbff200640 1 -- 172.21.15.173:0/1379281953 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc000aded0 con 0x7fcc00161480 2024-04-25T09:06:05.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.495+0000 7fcbff200640 1 -- 172.21.15.173:0/1379281953 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc000ae490 con 0x7fcc00161480 2024-04-25T09:06:05.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.499+0000 7fcbf6000640 1 -- 172.21.15.173:0/1379281953 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcbf00b33f0 con 0x7fcc00161480 2024-04-25T09:06:05.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.499+0000 7fcbf6000640 1 --2- 172.21.15.173:0/1379281953 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcbdc066f60 0x7fcbdc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.499+0000 7fcbf6000640 1 -- 172.21.15.173:0/1379281953 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcbf011fc20 con 0x7fcc00161480 2024-04-25T09:06:05.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.499+0000 7fcbfde00640 1 --2- 172.21.15.173:0/1379281953 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcbdc066f60 0x7fcbdc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.499+0000 7fcc081d2000 1 Processor -- start 2024-04-25T09:06:05.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.499+0000 7fcc081d2000 1 -- start start 2024-04-25T09:06:05.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.499+0000 7fcbfde00640 1 --2- 172.21.15.173:0/1379281953 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcbdc066f60 0x7fcbdc069420 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800d940 tx=0x7fcbe8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:05.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.499+0000 7fcc081d2000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b4920 0x55c1e26b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.499+0000 7fcc081d2000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e26b5240 0x55c1e266a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.499+0000 7fcc081d2000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e266af30 0x55c1e266b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.499+0000 7fcc081d2000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e25525f0 con 0x55c1e266af30 2024-04-25T09:06:05.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.499+0000 7fcc081d2000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e24b9da0 con 0x55c1e26b5240 2024-04-25T09:06:05.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.499+0000 7fcc081d2000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1e2442150 con 0x55c1e26b4920 2024-04-25T09:06:05.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.499+0000 7fcbfe800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e266af30 0x55c1e266b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.499+0000 7fcbfe800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e266af30 0x55c1e266b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49376/0 (socket says 172.21.15.173:49376) 2024-04-25T09:06:05.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.499+0000 7fcbfe800640 1 -- 172.21.15.173:0/2200479624 learned_addr learned my addr 172.21.15.173:0/2200479624 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:05.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcbfde00640 1 --2- 172.21.15.173:0/2200479624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b4920 0x55c1e26b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcbfd400640 1 --2- 172.21.15.173:0/2200479624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e26b5240 0x55c1e266a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcbfe800640 1 -- 172.21.15.173:0/2200479624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b4920 msgr2=0x55c1e26b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:05.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcbfe800640 1 --2- 172.21.15.173:0/2200479624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b4920 0x55c1e26b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcbfe800640 1 -- 172.21.15.173:0/2200479624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e26b5240 msgr2=0x55c1e266a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:05.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcbfe800640 1 --2- 172.21.15.173:0/2200479624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e26b5240 0x55c1e266a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcbfe800640 1 -- 172.21.15.173:0/2200479624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1e245bca0 con 0x55c1e266af30 2024-04-25T09:06:05.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcbfe800640 1 --2- 172.21.15.173:0/2200479624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e266af30 0x55c1e266b310 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8007330 tx=0x7fcbf80077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05ed8542420da18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:05.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcbeea00640 1 -- 172.21.15.173:0/2200479624 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf801a070 con 0x55c1e266af30 2024-04-25T09:06:05.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcbeea00640 1 -- 172.21.15.173:0/2200479624 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf8003db0 con 0x55c1e266af30 2024-04-25T09:06:05.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcbeea00640 1 -- 172.21.15.173:0/2200479624 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8004230 con 0x55c1e266af30 2024-04-25T09:06:05.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcc081d2000 1 -- 172.21.15.173:0/2200479624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e266af30 msgr2=0x55c1e266b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcc081d2000 1 --2- 172.21.15.173:0/2200479624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e266af30 0x55c1e266b310 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8007330 tx=0x7fcbf80077f0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcc081d2000 1 -- 172.21.15.173:0/2200479624 shutdown_connections 2024-04-25T09:06:05.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcc081d2000 1 --2- 172.21.15.173:0/2200479624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e266af30 0x55c1e266b310 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcc081d2000 1 --2- 172.21.15.173:0/2200479624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e26b5240 0x55c1e266a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcc081d2000 1 --2- 172.21.15.173:0/2200479624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b4920 0x55c1e26b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcc081d2000 1 -- 172.21.15.173:0/2200479624 >> 172.21.15.173:0/2200479624 conn(0x55c1e26712a0 msgr2=0x55c1e26692d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:05.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcc081d2000 1 -- 172.21.15.173:0/2200479624 shutdown_connections 2024-04-25T09:06:05.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcc081d2000 1 -- 172.21.15.173:0/2200479624 wait complete. 2024-04-25T09:06:05.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcc081d2000 1 -- start start 2024-04-25T09:06:05.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcc081d2000 1 Processor -- start 2024-04-25T09:06:05.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcc081d2000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e266af30 0x55c1e26a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcc081d2000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b4920 0x55c1e266eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcc081d2000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b5240 0x55c1e266efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcc081d2000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e2474990 con 0x55c1e26b5240 2024-04-25T09:06:05.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcc081d2000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e24b5e40 con 0x55c1e266af30 2024-04-25T09:06:05.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcc081d2000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1e2445900 con 0x55c1e26b4920 2024-04-25T09:06:05.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcc081d2000 10 client.0 _ll_register_callbacks cb 0x55c1e256d1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:05.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcbfe800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b5240 0x55c1e266efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcbfe800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b5240 0x55c1e266efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49382/0 (socket says 172.21.15.173:49382) 2024-04-25T09:06:05.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcbfde00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e266af30 0x55c1e26a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcbfe800640 1 -- 172.21.15.173:0/19992236 learned_addr learned my addr 172.21.15.173:0/19992236 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:05.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.503+0000 7fcbfd400640 1 --2- 172.21.15.173:0/19992236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b4920 0x55c1e266eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcbfe800640 1 -- 172.21.15.173:0/19992236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b4920 msgr2=0x55c1e266eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:05.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcbfe800640 1 --2- 172.21.15.173:0/19992236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b4920 0x55c1e266eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcbfe800640 1 -- 172.21.15.173:0/19992236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e266af30 msgr2=0x55c1e26a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:05.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcbfe800640 1 --2- 172.21.15.173:0/19992236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e266af30 0x55c1e26a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcbfe800640 1 -- 172.21.15.173:0/19992236 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c1e2472630 con 0x55c1e26b5240 2024-04-25T09:06:05.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcbfe800640 1 --2- 172.21.15.173:0/19992236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b5240 0x55c1e266efe0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8018040 tx=0x7fcbf8004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c689dc156f7bfadb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:05.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcbe3400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:05.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcbe3400640 1 -- 172.21.15.173:0/19992236 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8024030 con 0x55c1e26b5240 2024-04-25T09:06:05.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcbe3400640 1 -- 172.21.15.173:0/19992236 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcbf8003bb0 con 0x55c1e26b5240 2024-04-25T09:06:05.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 1 -- 172.21.15.173:0/19992236 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcbf8003db0 con 0x55c1e26b5240 2024-04-25T09:06:05.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcbe3400640 1 -- 172.21.15.173:0/19992236 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbf8030050 con 0x55c1e26b5240 2024-04-25T09:06:05.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 10 client.6036 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:05.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 1 -- 172.21.15.173:0/19992236 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55c1e24423a0 con 0x55c1e26b5240 2024-04-25T09:06:05.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcbe3400640 1 -- 172.21.15.173:0/19992236 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf8003db0 con 0x55c1e26b5240 2024-04-25T09:06:05.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcbe3400640 1 -- 172.21.15.173:0/19992236 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcbf8033020 con 0x55c1e26b5240 2024-04-25T09:06:05.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 10 client.6036 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:05.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 10 client.6036 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:06:05.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 20 client.6036 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:05.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 1 --2- 172.21.15.173:0/19992236 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55c1e26c3bc0 0x55c1e26c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 4 client.6036 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:05.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 1 -- 172.21.15.173:0/19992236 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c1e2455a50 con 0x55c1e26c3bc0 2024-04-25T09:06:05.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcbfde00640 1 --2- 172.21.15.173:0/19992236 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55c1e26c3bc0 0x55c1e26c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcbfde00640 1 --2- 172.21.15.173:0/19992236 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55c1e26c3bc0 0x55c1e26c5fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=975937d1675cbdd9 server_cookie=216a17267283c88e in_seq=0 out_seq=0 2024-04-25T09:06:05.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcbe3400640 10 client.6036 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:05.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcbe3400640 1 -- 172.21.15.173:0/19992236 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c1e2455a50 con 0x55c1e26c3bc0 2024-04-25T09:06:05.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcbe3400640 10 client.6036 handle_command_reply: tid=0 2024-04-25T09:06:05.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 1 client.6036 shutdown 2024-04-25T09:06:05.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 1 -- 172.21.15.173:0/19992236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b5240 msgr2=0x55c1e266efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 1 --2- 172.21.15.173:0/19992236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b5240 0x55c1e266efe0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8018040 tx=0x7fcbf8004ac0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 1 -- 172.21.15.173:0/19992236 shutdown_connections 2024-04-25T09:06:05.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 1 --2- 172.21.15.173:0/19992236 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55c1e26c3bc0 0x55c1e26c5fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 1 --2- 172.21.15.173:0/19992236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b5240 0x55c1e266efe0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 1 --2- 172.21.15.173:0/19992236 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b4920 0x55c1e266eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcbe3400640 0 client.6036 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:05.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 1 --2- 172.21.15.173:0/19992236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e266af30 0x55c1e26a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 1 -- 172.21.15.173:0/19992236 >> 172.21.15.173:0/19992236 conn(0x55c1e26712a0 msgr2=0x55c1e26699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:05.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 1 -- 172.21.15.173:0/19992236 shutdown_connections 2024-04-25T09:06:05.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 1 -- 172.21.15.173:0/19992236 wait complete. 2024-04-25T09:06:05.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.507+0000 7fcc081d2000 20 client.6036 trim_cache size 0 max 16384 2024-04-25T09:06:05.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.523+0000 7fcc081d2000 1 Processor -- start 2024-04-25T09:06:05.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.523+0000 7fcc081d2000 1 -- start start 2024-04-25T09:06:05.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.523+0000 7fcc081d2000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e266af30 0x55c1e26b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.523+0000 7fcc081d2000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b4920 0x55c1e26b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.523+0000 7fcc081d2000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b5240 0x55c1e26c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.523+0000 7fcc081d2000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc002020f0 con 0x55c1e26b4920 2024-04-25T09:06:05.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.523+0000 7fcc081d2000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00153f20 con 0x55c1e266af30 2024-04-25T09:06:05.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.523+0000 7fcc081d2000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00201b20 con 0x55c1e26b5240 2024-04-25T09:06:05.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.523+0000 7fcbfd400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b4920 0x55c1e26b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.523+0000 7fcbfd400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b4920 0x55c1e26b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49394/0 (socket says 172.21.15.173:49394) 2024-04-25T09:06:05.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.523+0000 7fcbfd400640 1 -- 172.21.15.173:0/2889878704 learned_addr learned my addr 172.21.15.173:0/2889878704 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:05.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbfde00640 1 --2- 172.21.15.173:0/2889878704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e266af30 0x55c1e26b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbfe800640 1 --2- 172.21.15.173:0/2889878704 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b5240 0x55c1e26c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbfd400640 1 -- 172.21.15.173:0/2889878704 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b5240 msgr2=0x55c1e26c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:05.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbfd400640 1 --2- 172.21.15.173:0/2889878704 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b5240 0x55c1e26c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbfd400640 1 -- 172.21.15.173:0/2889878704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e266af30 msgr2=0x55c1e26b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:05.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbfd400640 1 --2- 172.21.15.173:0/2889878704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e266af30 0x55c1e26b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbfd400640 1 -- 172.21.15.173:0/2889878704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1e253b600 con 0x55c1e26b4920 2024-04-25T09:06:05.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbfd400640 1 --2- 172.21.15.173:0/2889878704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b4920 0x55c1e26b3e00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcbf001ca60 tx=0x7fcbf0009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527fa552aa805c91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:05.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbee000640 1 -- 172.21.15.173:0/2889878704 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00c3040 con 0x55c1e26b4920 2024-04-25T09:06:05.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbee000640 1 -- 172.21.15.173:0/2889878704 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf00af040 con 0x55c1e26b4920 2024-04-25T09:06:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbee000640 1 -- 172.21.15.173:0/2889878704 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00f8aa0 con 0x55c1e26b4920 2024-04-25T09:06:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcc081d2000 1 -- 172.21.15.173:0/2889878704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b4920 msgr2=0x55c1e26b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcc081d2000 1 --2- 172.21.15.173:0/2889878704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b4920 0x55c1e26b3e00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcbf001ca60 tx=0x7fcbf0009240 comp rx=0 tx=0).stop 2024-04-25T09:06:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcc081d2000 1 -- 172.21.15.173:0/2889878704 shutdown_connections 2024-04-25T09:06:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcc081d2000 1 --2- 172.21.15.173:0/2889878704 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b5240 0x55c1e26c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcc081d2000 1 --2- 172.21.15.173:0/2889878704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b4920 0x55c1e26b3e00 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcc081d2000 1 --2- 172.21.15.173:0/2889878704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e266af30 0x55c1e26b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcc081d2000 1 -- 172.21.15.173:0/2889878704 >> 172.21.15.173:0/2889878704 conn(0x55c1e26712a0 msgr2=0x55c1e26b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcc081d2000 1 -- 172.21.15.173:0/2889878704 shutdown_connections 2024-04-25T09:06:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcc081d2000 1 -- 172.21.15.173:0/2889878704 wait complete. 2024-04-25T09:06:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcc081d2000 1 -- start start 2024-04-25T09:06:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcc081d2000 1 Processor -- start 2024-04-25T09:06:05.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcc081d2000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e266af30 0x55c1e26c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcc081d2000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b4920 0x55c1e26cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcc081d2000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b5240 0x55c1e26cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcc081d2000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e24be3d0 con 0x55c1e26b4920 2024-04-25T09:06:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcc081d2000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e2575d50 con 0x55c1e266af30 2024-04-25T09:06:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcc081d2000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1e2454980 con 0x55c1e26b5240 2024-04-25T09:06:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcc081d2000 10 client.0 _ll_register_callbacks cb 0x7fcbf8009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbfd400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b4920 0x55c1e26cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbfd400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b4920 0x55c1e26cfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49400/0 (socket says 172.21.15.173:49400) 2024-04-25T09:06:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbfd400640 1 -- 172.21.15.173:0/3569140475 learned_addr learned my addr 172.21.15.173:0/3569140475 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbfe800640 1 --2- 172.21.15.173:0/3569140475 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b5240 0x55c1e26cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbfde00640 1 --2- 172.21.15.173:0/3569140475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e266af30 0x55c1e26c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbfd400640 1 -- 172.21.15.173:0/3569140475 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b5240 msgr2=0x55c1e26cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbfd400640 1 --2- 172.21.15.173:0/3569140475 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b5240 0x55c1e26cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbfd400640 1 -- 172.21.15.173:0/3569140475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e266af30 msgr2=0x55c1e26c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbfd400640 1 --2- 172.21.15.173:0/3569140475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e266af30 0x55c1e26c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.527+0000 7fcbfd400640 1 -- 172.21.15.173:0/3569140475 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c1e244e9b0 con 0x55c1e26b4920 2024-04-25T09:06:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbfd400640 1 --2- 172.21.15.173:0/3569140475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b4920 0x55c1e26cfa30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00ec8a0 tx=0x7fcbf011de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68e7625eba7058e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:05.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbe3400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:05.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbe3400640 1 -- 172.21.15.173:0/3569140475 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00c3030 con 0x55c1e26b4920 2024-04-25T09:06:05.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbe3400640 1 -- 172.21.15.173:0/3569140475 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcbf00f8610 con 0x55c1e26b4920 2024-04-25T09:06:05.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 1 -- 172.21.15.173:0/3569140475 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcbf00af040 con 0x55c1e26b4920 2024-04-25T09:06:05.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbe3400640 1 -- 172.21.15.173:0/3569140475 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbf00f8830 con 0x55c1e26b4920 2024-04-25T09:06:05.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 10 client.6042 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:05.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 1 -- 172.21.15.173:0/3569140475 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55c1e24610b0 con 0x55c1e26b4920 2024-04-25T09:06:05.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbe3400640 1 -- 172.21.15.173:0/3569140475 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf00af040 con 0x55c1e26b4920 2024-04-25T09:06:05.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbe3400640 1 -- 172.21.15.173:0/3569140475 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcbf00bdce0 con 0x55c1e26b4920 2024-04-25T09:06:05.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 10 client.6042 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:05.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 10 client.6042 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:06:05.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 20 client.6042 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:05.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 1 --2- 172.21.15.173:0/3569140475 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55c1e2670e80 0x55c1e26d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 4 client.6042 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:06:05.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 1 -- 172.21.15.173:0/3569140475 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c1e24c72e0 con 0x55c1e2670e80 2024-04-25T09:06:05.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbfde00640 1 --2- 172.21.15.173:0/3569140475 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55c1e2670e80 0x55c1e26d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbfde00640 1 --2- 172.21.15.173:0/3569140475 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55c1e2670e80 0x55c1e26d04b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2dc7173a1ca3e41 server_cookie=609c5835ee568b4e in_seq=0 out_seq=0 2024-04-25T09:06:05.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbe3400640 10 client.6042 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:05.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbe3400640 1 -- 172.21.15.173:0/3569140475 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55c1e24c72e0 con 0x55c1e2670e80 2024-04-25T09:06:05.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbe3400640 10 client.6042 handle_command_reply: tid=0 2024-04-25T09:06:05.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 1 client.6042 shutdown 2024-04-25T09:06:05.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 1 -- 172.21.15.173:0/3569140475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b4920 msgr2=0x55c1e26cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 1 --2- 172.21.15.173:0/3569140475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b4920 0x55c1e26cfa30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00ec8a0 tx=0x7fcbf011de80 comp rx=0 tx=0).stop 2024-04-25T09:06:05.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 1 -- 172.21.15.173:0/3569140475 shutdown_connections 2024-04-25T09:06:05.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 1 --2- 172.21.15.173:0/3569140475 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55c1e2670e80 0x55c1e26d04b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 1 --2- 172.21.15.173:0/3569140475 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55c1e26b5240 0x55c1e26cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 1 --2- 172.21.15.173:0/3569140475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1e26b4920 0x55c1e26cfa30 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 1 --2- 172.21.15.173:0/3569140475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1e266af30 0x55c1e26c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbe3400640 0 client.6042 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:05.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 1 -- 172.21.15.173:0/3569140475 >> 172.21.15.173:0/3569140475 conn(0x55c1e26712a0 msgr2=0x55c1e26b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:05.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 1 -- 172.21.15.173:0/3569140475 shutdown_connections 2024-04-25T09:06:05.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 1 -- 172.21.15.173:0/3569140475 wait complete. 2024-04-25T09:06:05.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcc081d2000 20 client.6042 trim_cache size 0 max 16384 2024-04-25T09:06:05.528 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:05.528 INFO:teuthology.orchestra.run.smithi173.stdout: "cluster_fsid": "ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6", 2024-04-25T09:06:05.528 INFO:teuthology.orchestra.run.smithi173.stdout: "whoami": 0, 2024-04-25T09:06:05.528 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 5874, 2024-04-25T09:06:05.528 INFO:teuthology.orchestra.run.smithi173.stdout: "want_state": "up:active", 2024-04-25T09:06:05.528 INFO:teuthology.orchestra.run.smithi173.stdout: "state": "up:active", 2024-04-25T09:06:05.529 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs", 2024-04-25T09:06:05.529 INFO:teuthology.orchestra.run.smithi173.stdout: "rank_uptime": 10.325976679, 2024-04-25T09:06:05.529 INFO:teuthology.orchestra.run.smithi173.stdout: "mdsmap_epoch": 26, 2024-04-25T09:06:05.529 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch": 56, 2024-04-25T09:06:05.529 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch_barrier": 56, 2024-04-25T09:06:05.529 INFO:teuthology.orchestra.run.smithi173.stdout: "uptime": 16.19979545 2024-04-25T09:06:05.529 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:05.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbff200640 1 -- 172.21.15.173:0/1379281953 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcbdc066f60 msgr2=0x7fcbdc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbff200640 1 --2- 172.21.15.173:0/1379281953 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcbdc066f60 0x7fcbdc069420 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800d940 tx=0x7fcbe8008040 comp rx=0 tx=0).stop 2024-04-25T09:06:05.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbff200640 1 -- 172.21.15.173:0/1379281953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc00161480 msgr2=0x7fcc00152cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbff200640 1 --2- 172.21.15.173:0/1379281953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc00161480 0x7fcc00152cb0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcbf001aba0 tx=0x7fcbf001ad30 comp rx=0 tx=0).stop 2024-04-25T09:06:05.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbff200640 1 -- 172.21.15.173:0/1379281953 shutdown_connections 2024-04-25T09:06:05.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbff200640 1 --2- 172.21.15.173:0/1379281953 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcbdc066f60 0x7fcbdc069420 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbff200640 1 --2- 172.21.15.173:0/1379281953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc00161e00 0x7fcc00159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbff200640 1 --2- 172.21.15.173:0/1379281953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc00161480 0x7fcc00152cb0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbff200640 1 --2- 172.21.15.173:0/1379281953 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc0015da40 0x7fcc000ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbff200640 1 -- 172.21.15.173:0/1379281953 >> 172.21.15.173:0/1379281953 conn(0x7fcc000cfd60 msgr2=0x7fcc0015fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:05.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbff200640 1 -- 172.21.15.173:0/1379281953 shutdown_connections 2024-04-25T09:06:05.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.531+0000 7fcbff200640 1 -- 172.21.15.173:0/1379281953 wait complete. 2024-04-25T09:06:05.542 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:06:05.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.687+0000 7f323fc00640 1 Processor -- start 2024-04-25T09:06:05.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.687+0000 7f323fc00640 1 -- start start 2024-04-25T09:06:05.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f323fc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f32380aefa0 0x7f32380cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f323fc00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323815f320 con 0x7f323815edd0 2024-04-25T09:06:05.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f323fc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323806d420 con 0x7f32380b3e70 2024-04-25T09:06:05.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f323fc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323806dd50 con 0x7f32380aefa0 2024-04-25T09:06:05.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f323dc00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f323815edd0 0x7f32380cdce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47596/0 (socket says 172.21.15.173:47596) 2024-04-25T09:06:05.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f323dc00640 1 -- 172.21.15.173:0/390078833 learned_addr learned my addr 172.21.15.173:0/390078833 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f3237400640 1 -- 172.21.15.173:0/390078833 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548008070 0 0) 0x7f323815f320 con 0x7f323815edd0 2024-04-25T09:06:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f3237400640 1 -- 172.21.15.173:0/390078833 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f321c003530 con 0x7f323815edd0 2024-04-25T09:06:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f3237e00640 1 --2- 172.21.15.173:0/390078833 >> v2:172.21.15.194:3300/0 conn(0x7f32380aefa0 0x7f32380cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f3237400640 1 -- 172.21.15.173:0/390078833 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4190370690 0 0) 0x7f321c003530 con 0x7f323815edd0 2024-04-25T09:06:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f3237400640 1 -- 172.21.15.173:0/390078833 >> v2:172.21.15.194:3300/0 conn(0x7f32380aefa0 msgr2=0x7f32380cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f3237400640 1 --2- 172.21.15.173:0/390078833 >> v2:172.21.15.194:3300/0 conn(0x7f32380aefa0 0x7f32380cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f3237400640 1 -- 172.21.15.173:0/390078833 >> v1:172.21.15.194:6789/0 conn(0x7f32380b3e70 legacy=0x7f32380b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f3237400640 1 -- 172.21.15.173:0/390078833 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323806d700 con 0x7f323815edd0 2024-04-25T09:06:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f3237400640 1 -- 172.21.15.173:0/390078833 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f3230001680 con 0x7f323815edd0 2024-04-25T09:06:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f3237400640 1 -- 172.21.15.173:0/390078833 >> v1:172.21.15.173:6789/0 conn(0x7f323815edd0 legacy=0x7f32380cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f3237400640 1 --2- 172.21.15.173:0/390078833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f321c0039c0 0x7f321c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f3237400640 1 --2- 172.21.15.173:0/390078833 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f321c004810 0x7f321c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f3237400640 1 --2- 172.21.15.173:0/390078833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c0051d0 0x7f321c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f3237400640 1 -- 172.21.15.173:0/390078833 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323806dd50 con 0x7f321c0051d0 2024-04-25T09:06:05.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f3237400640 1 -- 172.21.15.173:0/390078833 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c00c020 con 0x7f321c0039c0 2024-04-25T09:06:05.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f3237400640 1 -- 172.21.15.173:0/390078833 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321c00c220 con 0x7f321c004810 2024-04-25T09:06:05.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f323dc00640 1 --2- 172.21.15.173:0/390078833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c0051d0 0x7f321c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f3237e00640 1 --2- 172.21.15.173:0/390078833 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f321c004810 0x7f321c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f323d200640 1 --2- 172.21.15.173:0/390078833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f321c0039c0 0x7f321c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f323dc00640 1 -- 172.21.15.173:0/390078833 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f321c004810 msgr2=0x7f321c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:05.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f323dc00640 1 --2- 172.21.15.173:0/390078833 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f321c004810 0x7f321c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f323dc00640 1 -- 172.21.15.173:0/390078833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f321c0039c0 msgr2=0x7f321c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:05.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f323dc00640 1 --2- 172.21.15.173:0/390078833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f321c0039c0 0x7f321c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f323dc00640 1 -- 172.21.15.173:0/390078833 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321c003530 con 0x7f321c0051d0 2024-04-25T09:06:05.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.691+0000 7f323d200640 1 --2- 172.21.15.173:0/390078833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f321c0039c0 0x7f321c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.695+0000 7f323dc00640 1 -- 172.21.15.173:0/390078833 reap_dead start 2024-04-25T09:06:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.695+0000 7f323dc00640 1 --2- 172.21.15.173:0/390078833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c0051d0 0x7f321c00b9d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f323000c110 tx=0x7f323001f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7377907b0f80733d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.695+0000 7f3237400640 1 -- 172.21.15.173:0/390078833 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230007c50 con 0x7f321c0051d0 2024-04-25T09:06:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.695+0000 7f3237400640 1 -- 172.21.15.173:0/390078833 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3230005b00 con 0x7f321c0051d0 2024-04-25T09:06:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.695+0000 7f3237400640 1 -- 172.21.15.173:0/390078833 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230007070 con 0x7f321c0051d0 2024-04-25T09:06:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.695+0000 7f323fc00640 1 -- 172.21.15.173:0/390078833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c0051d0 msgr2=0x7f321c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.695+0000 7f323fc00640 1 --2- 172.21.15.173:0/390078833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c0051d0 0x7f321c00b9d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f323000c110 tx=0x7f323001f2f0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.695+0000 7f323fc00640 1 -- 172.21.15.173:0/390078833 shutdown_connections 2024-04-25T09:06:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.695+0000 7f323fc00640 1 --2- 172.21.15.173:0/390078833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c0051d0 0x7f321c00b9d0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.695+0000 7f323fc00640 1 -- 172.21.15.173:0/390078833 >> 172.21.15.173:0/390078833 conn(0x7f323806ac90 msgr2=0x7f323806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:05.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.695+0000 7f323fc00640 1 -- 172.21.15.173:0/390078833 shutdown_connections 2024-04-25T09:06:05.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.695+0000 7f323fc00640 1 -- 172.21.15.173:0/390078833 wait complete. 2024-04-25T09:06:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.695+0000 7f323fc00640 1 Processor -- start 2024-04-25T09:06:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.695+0000 7f323fc00640 1 -- start start 2024-04-25T09:06:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323fc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c0051d0 0x7f32381f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323fc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f323815c8f0 0x7f32381f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323fc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32380b0210 0x7f32380b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323fc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323806e1e0 con 0x7f321c0051d0 2024-04-25T09:06:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323fc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323815aba0 con 0x7f323815c8f0 2024-04-25T09:06:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323fc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323806e360 con 0x7f32380b0210 2024-04-25T09:06:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c0051d0 0x7f32381f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c0051d0 0x7f32381f1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49408/0 (socket says 172.21.15.173:49408) 2024-04-25T09:06:05.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323d200640 1 -- 172.21.15.173:0/2220003070 learned_addr learned my addr 172.21.15.173:0/2220003070 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:05.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323dc00640 1 --2- 172.21.15.173:0/2220003070 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32380b0210 0x7f32380b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f3237e00640 1 --2- 172.21.15.173:0/2220003070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f323815c8f0 0x7f32381f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323d200640 1 -- 172.21.15.173:0/2220003070 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32380b0210 msgr2=0x7f32380b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323d200640 1 --2- 172.21.15.173:0/2220003070 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32380b0210 0x7f32380b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323d200640 1 -- 172.21.15.173:0/2220003070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f323815c8f0 msgr2=0x7f32381f0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323d200640 1 --2- 172.21.15.173:0/2220003070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f323815c8f0 0x7f32381f0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323d200640 1 -- 172.21.15.173:0/2220003070 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323815cd70 con 0x7f321c0051d0 2024-04-25T09:06:05.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323d200640 1 --2- 172.21.15.173:0/2220003070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c0051d0 0x7f32381f1d70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f322800e8f0 tx=0x7f322800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:05.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f3234c00640 1 -- 172.21.15.173:0/2220003070 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228003b90 con 0x7f321c0051d0 2024-04-25T09:06:05.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f3234c00640 1 -- 172.21.15.173:0/2220003070 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3228018070 con 0x7f321c0051d0 2024-04-25T09:06:05.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f3234c00640 1 -- 172.21.15.173:0/2220003070 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32280050d0 con 0x7f321c0051d0 2024-04-25T09:06:05.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323fc00640 1 -- 172.21.15.173:0/2220003070 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323815d040 con 0x7f321c0051d0 2024-04-25T09:06:05.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323fc00640 1 -- 172.21.15.173:0/2220003070 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3238157fa0 con 0x7f321c0051d0 2024-04-25T09:06:05.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f323fc00640 1 -- 172.21.15.173:0/2220003070 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3238073a40 con 0x7f321c0051d0 2024-04-25T09:06:05.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.699+0000 7f3234c00640 1 -- 172.21.15.173:0/2220003070 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3228005270 con 0x7f321c0051d0 2024-04-25T09:06:05.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.703+0000 7f3234c00640 1 --2- 172.21.15.173:0/2220003070 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3218066f60 0x7f3218069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.703+0000 7f3234c00640 1 -- 172.21.15.173:0/2220003070 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3228085160 con 0x7f321c0051d0 2024-04-25T09:06:05.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.703+0000 7f3237e00640 1 --2- 172.21.15.173:0/2220003070 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3218066f60 0x7f3218069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.703+0000 7f3237e00640 1 --2- 172.21.15.173:0/2220003070 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3218066f60 0x7f3218069420 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f323814ec50 tx=0x7f3224009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:05.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.707+0000 7f3234c00640 1 -- 172.21.15.173:0/2220003070 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3228055fd0 con 0x7f321c0051d0 2024-04-25T09:06:05.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.895+0000 7f323fc00640 1 -- 172.21.15.173:0/2220003070 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f323806f1c0 con 0x7f321c0051d0 2024-04-25T09:06:05.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.895+0000 7f3234c00640 1 -- 172.21.15.173:0/2220003070 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f32280558d0 con 0x7f321c0051d0 2024-04-25T09:06:05.887 INFO:teuthology.orchestra.run.smithi173.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:06:05.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.895+0000 7f323fc00640 1 -- 172.21.15.173:0/2220003070 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3218066f60 msgr2=0x7f3218069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.895+0000 7f323fc00640 1 --2- 172.21.15.173:0/2220003070 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3218066f60 0x7f3218069420 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f323814ec50 tx=0x7f3224009190 comp rx=0 tx=0).stop 2024-04-25T09:06:05.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.895+0000 7f323fc00640 1 -- 172.21.15.173:0/2220003070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c0051d0 msgr2=0x7f32381f1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.895+0000 7f323fc00640 1 --2- 172.21.15.173:0/2220003070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c0051d0 0x7f32381f1d70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f322800e8f0 tx=0x7f322800ecf0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.895+0000 7f323fc00640 1 -- 172.21.15.173:0/2220003070 shutdown_connections 2024-04-25T09:06:05.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.895+0000 7f323fc00640 1 --2- 172.21.15.173:0/2220003070 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3218066f60 0x7f3218069420 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.895+0000 7f323fc00640 1 --2- 172.21.15.173:0/2220003070 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32380b0210 0x7f32380b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.895+0000 7f323fc00640 1 --2- 172.21.15.173:0/2220003070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f323815c8f0 0x7f32381f0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.895+0000 7f323fc00640 1 --2- 172.21.15.173:0/2220003070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c0051d0 0x7f32381f1d70 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.895+0000 7f323fc00640 1 -- 172.21.15.173:0/2220003070 >> 172.21.15.173:0/2220003070 conn(0x7f323806ac90 msgr2=0x7f32380cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:05.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.899+0000 7f323fc00640 1 -- 172.21.15.173:0/2220003070 shutdown_connections 2024-04-25T09:06:05.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:05.899+0000 7f323fc00640 1 -- 172.21.15.173:0/2220003070 wait complete. 2024-04-25T09:06:05.908 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:06:05.908 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:06:05.908 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2024-04-25T09:06:05.908 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:06:05.908 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:05.908 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:06:05.908 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:06:05.908 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:06:05.908 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:06:05.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:05.909 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2024-04-25T09:06:05.917 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:06:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:06:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:06:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-25T09:06:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:05.918 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:06:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2024-04-25T09:06:05.918 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:06:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2024-04-25T09:06:05.918 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:06:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:05.919 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:06:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:06:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 42252sec preferred_lft 42252sec 2024-04-25T09:06:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2024-04-25T09:06:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:05.919 INFO:teuthology.orchestra.run.smithi173.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:06:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 02:42:00:0e:60:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:06:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:05.919 INFO:teuthology.orchestra.run.smithi173.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:06:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:06:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:06:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:05.920 INFO:teuthology.orchestra.run.smithi173.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:06:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:06:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:06:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:05.920 INFO:teuthology.orchestra.run.smithi173.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:06:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:06:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:06:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:05.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:05.921 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:06:05.986 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-04-25T09:06:05.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:05.988 DEBUG:teuthology.orchestra.run.smithi173:> route 2024-04-25T09:06:06.041 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2024-04-25T09:06:06.041 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:06:06.041 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:06:06.041 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:06:06.041 INFO:teuthology.orchestra.run.smithi173.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:06:06.041 INFO:teuthology.orchestra.run.smithi173.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:06:06.041 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:06:06.042 INFO:teuthology.orchestra.run.smithi173.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:06:06.042 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:06:06.042 INFO:teuthology.orchestra.run.smithi173.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:06:06.042 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:06:06.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:06.042 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:06:06.042 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:06:06.042 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:06:06.042 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:06:06.042 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:06:06.042 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:06:06.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:06.132 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-25T09:06:06.140 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:06:06.140 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:06:06.141 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:06:06.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:06.141 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2024-04-25T09:06:06.207 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:06:06.208 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:06.256 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:06:06.256 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:06:06.256 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:06.308 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:06:06.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:06.308 DEBUG:teuthology.orchestra.run.smithi173:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:06.400 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:06.400 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:06:06.400 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:06:06.415 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:06.415 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:06:06.415 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:06:06.415 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:06:06.415 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:06:06.423 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:06.423 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:06:06.423 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:06:06.423 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:06:06.423 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:06:06.424 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-04-25T09:06:06.424 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-04-25T09:06:06.424 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6" will pass to kernel 2024-04-25T09:06:06.427 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:06:06.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:06.428 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:06.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:06.447 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:06:06.508 INFO:teuthology.orchestra.run.smithi173.stdout:client5381 2024-04-25T09:06:06.508 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:06:06.508 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:06.557 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:06.558 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-04-25T09:06:06.558 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-04-25T09:06:06.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:06.558 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-04-25T09:06:06.618 DEBUG:teuthology.orchestra.run.smithi173:> stdin-killer -- python3 -c ' 2024-04-25T09:06:06.618 DEBUG:teuthology.orchestra.run.smithi173:> import os 2024-04-25T09:06:06.618 DEBUG:teuthology.orchestra.run.smithi173:> import stat 2024-04-25T09:06:06.618 DEBUG:teuthology.orchestra.run.smithi173:> import json 2024-04-25T09:06:06.618 DEBUG:teuthology.orchestra.run.smithi173:> import sys 2024-04-25T09:06:06.618 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:06:06.618 DEBUG:teuthology.orchestra.run.smithi173:> try: 2024-04-25T09:06:06.618 DEBUG:teuthology.orchestra.run.smithi173:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-04-25T09:06:06.619 DEBUG:teuthology.orchestra.run.smithi173:> except OSError as e: 2024-04-25T09:06:06.619 DEBUG:teuthology.orchestra.run.smithi173:> sys.exit(e.errno) 2024-04-25T09:06:06.619 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:06:06.619 DEBUG:teuthology.orchestra.run.smithi173:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-04-25T09:06:06.619 DEBUG:teuthology.orchestra.run.smithi173:> print(json.dumps( 2024-04-25T09:06:06.619 DEBUG:teuthology.orchestra.run.smithi173:> dict([(a, getattr(s, a)) for a in attrs]), 2024-04-25T09:06:06.619 DEBUG:teuthology.orchestra.run.smithi173:> indent=2)) 2024-04-25T09:06:06.619 DEBUG:teuthology.orchestra.run.smithi173:> ' 2024-04-25T09:06:06.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:06 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-04-25T09:06:06.742 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-25T09:06:06.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:06.742 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone --branch giant http://github.com/ceph/ceph-qa-suite /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite) 2024-04-25T09:06:06.799 INFO:teuthology.orchestra.run.smithi173.stderr:Cloning into '/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'... 2024-04-25T09:06:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-04-25T09:06:09.926 INFO:teuthology.orchestra.run.smithi173.stderr:Updating files: 54% (760/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 96% (1354/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-04-25T09:06:09.935 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 0 2024-04-25T09:06:09.935 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-04-25T09:06:09.935 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:10.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.119+0000 7f4628e00640 1 Processor -- start 2024-04-25T09:06:10.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.119+0000 7f4628e00640 1 -- start start 2024-04-25T09:06:10.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.123+0000 7f4628e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f46240ccd30 0x7f46240cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.123+0000 7f4628e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462406e7c0 con 0x7f4624145250 2024-04-25T09:06:10.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.123+0000 7f4628e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462406d720 con 0x7f46240cc8b0 2024-04-25T09:06:10.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.123+0000 7f4628e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462406da00 con 0x7f46240ccd30 2024-04-25T09:06:10.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.123+0000 7f4621e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4624145250 0x7f462415c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47610/0 (socket says 172.21.15.173:47610) 2024-04-25T09:06:10.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.123+0000 7f4621e00640 1 -- 172.21.15.173:0/3721327019 learned_addr learned my addr 172.21.15.173:0/3721327019 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:10.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.123+0000 7f4622800640 1 --2- 172.21.15.173:0/3721327019 >> v2:172.21.15.173:3300/0 conn(0x7f46240ccd30 0x7f46240cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.123+0000 7f4622800640 1 -- 172.21.15.173:0/3721327019 >> v1:172.21.15.194:6789/0 conn(0x7f46240cc8b0 legacy=0x7f46240ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.123+0000 7f4622800640 1 -- 172.21.15.173:0/3721327019 >> v1:172.21.15.173:6789/0 conn(0x7f4624145250 legacy=0x7f462415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.123+0000 7f4622800640 1 -- 172.21.15.173:0/3721327019 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462406dce0 con 0x7f46240ccd30 2024-04-25T09:06:10.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4622800640 1 --2- 172.21.15.173:0/3721327019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46240ccd30 0x7f46240cf000 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f461c0097c0 tx=0x7f461c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54992d5ed6aaa98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4620a00640 1 -- 172.21.15.173:0/3721327019 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c0a7070 con 0x7f46240ccd30 2024-04-25T09:06:10.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4620a00640 1 -- 172.21.15.173:0/3721327019 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461c0b0070 con 0x7f46240ccd30 2024-04-25T09:06:10.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4620a00640 1 -- 172.21.15.173:0/3721327019 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c0ab890 con 0x7f46240ccd30 2024-04-25T09:06:10.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4628e00640 1 -- 172.21.15.173:0/3721327019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46240ccd30 msgr2=0x7f46240cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4628e00640 1 --2- 172.21.15.173:0/3721327019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46240ccd30 0x7f46240cf000 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f461c0097c0 tx=0x7f461c01c470 comp rx=0 tx=0).stop 2024-04-25T09:06:10.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4628e00640 1 -- 172.21.15.173:0/3721327019 shutdown_connections 2024-04-25T09:06:10.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4628e00640 1 --2- 172.21.15.173:0/3721327019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46240ccd30 0x7f46240cf000 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4628e00640 1 -- 172.21.15.173:0/3721327019 >> 172.21.15.173:0/3721327019 conn(0x7f462406ac90 msgr2=0x7f462406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:10.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4628e00640 1 -- 172.21.15.173:0/3721327019 shutdown_connections 2024-04-25T09:06:10.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4628e00640 1 -- 172.21.15.173:0/3721327019 wait complete. 2024-04-25T09:06:10.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4628e00640 1 Processor -- start 2024-04-25T09:06:10.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4628e00640 1 -- start start 2024-04-25T09:06:10.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4628e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46240cc8b0 0x7f462413fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4628e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46240ccd30 0x7f462412cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4628e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4624145250 0x7f462415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4628e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46240cd140 con 0x7f4624145250 2024-04-25T09:06:10.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4628e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462406ef80 con 0x7f46240cc8b0 2024-04-25T09:06:10.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.127+0000 7f4628e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462406d380 con 0x7f46240ccd30 2024-04-25T09:06:10.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f4622800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4624145250 0x7f462415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f4622800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4624145250 0x7f462415abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49428/0 (socket says 172.21.15.173:49428) 2024-04-25T09:06:10.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f4622800640 1 -- 172.21.15.173:0/1397895044 learned_addr learned my addr 172.21.15.173:0/1397895044 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:10.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f4621e00640 1 --2- 172.21.15.173:0/1397895044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46240cc8b0 0x7f462413fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f4621400640 1 --2- 172.21.15.173:0/1397895044 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46240ccd30 0x7f462412cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f4622800640 1 -- 172.21.15.173:0/1397895044 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46240ccd30 msgr2=0x7f462412cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f4622800640 1 --2- 172.21.15.173:0/1397895044 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46240ccd30 0x7f462412cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f4622800640 1 -- 172.21.15.173:0/1397895044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46240cc8b0 msgr2=0x7f462413fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f4622800640 1 --2- 172.21.15.173:0/1397895044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46240cc8b0 0x7f462413fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f4622800640 1 -- 172.21.15.173:0/1397895044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462412d190 con 0x7f4624145250 2024-04-25T09:06:10.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f4622800640 1 --2- 172.21.15.173:0/1397895044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4624145250 0x7f462415abf0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f461c0ad040 tx=0x7f461c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f461a000640 1 -- 172.21.15.173:0/1397895044 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c0bf610 con 0x7f4624145250 2024-04-25T09:06:10.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f461a000640 1 -- 172.21.15.173:0/1397895044 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461c0bf7b0 con 0x7f4624145250 2024-04-25T09:06:10.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f4628e00640 1 -- 172.21.15.173:0/1397895044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462412d470 con 0x7f4624145250 2024-04-25T09:06:10.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f461a000640 1 -- 172.21.15.173:0/1397895044 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c0bfb80 con 0x7f4624145250 2024-04-25T09:06:10.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f4628e00640 1 -- 172.21.15.173:0/1397895044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462412da30 con 0x7f4624145250 2024-04-25T09:06:10.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f4628e00640 1 -- 172.21.15.173:0/1397895044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4624073a40 con 0x7f4624145250 2024-04-25T09:06:10.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f461a000640 1 -- 172.21.15.173:0/1397895044 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f461c0bd020 con 0x7f4624145250 2024-04-25T09:06:10.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.131+0000 7f461a000640 1 --2- 172.21.15.173:0/1397895044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4604066f60 0x7f4604069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.135+0000 7f461a000640 1 -- 172.21.15.173:0/1397895044 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f461c120260 con 0x7f4624145250 2024-04-25T09:06:10.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.135+0000 7f4621e00640 1 --2- 172.21.15.173:0/1397895044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4604066f60 0x7f4604069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.135+0000 7f4621e00640 1 --2- 172.21.15.173:0/1397895044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4604066f60 0x7f4604069420 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4614005c10 tx=0x7f4614009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.135+0000 7f461a000640 1 -- 172.21.15.173:0/1397895044 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f461c016090 con 0x7f4624145250 2024-04-25T09:06:10.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.327+0000 7f4628e00640 1 -- 172.21.15.173:0/1397895044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4624140a60 con 0x7f4624145250 2024-04-25T09:06:10.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.331+0000 7f461a000640 1 -- 172.21.15.173:0/1397895044 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f461c0f1e20 con 0x7f4624145250 2024-04-25T09:06:10.321 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:10.321 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:05:57.598642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:10.321 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 26 2024-04-25T09:06:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.331+0000 7f4628e00640 1 -- 172.21.15.173:0/1397895044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4604066f60 msgr2=0x7f4604069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.331+0000 7f4628e00640 1 --2- 172.21.15.173:0/1397895044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4604066f60 0x7f4604069420 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4614005c10 tx=0x7f4614009040 comp rx=0 tx=0).stop 2024-04-25T09:06:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.331+0000 7f4628e00640 1 -- 172.21.15.173:0/1397895044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4624145250 msgr2=0x7f462415abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.331+0000 7f4628e00640 1 --2- 172.21.15.173:0/1397895044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4624145250 0x7f462415abf0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f461c0ad040 tx=0x7f461c01acb0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.331+0000 7f4628e00640 1 -- 172.21.15.173:0/1397895044 shutdown_connections 2024-04-25T09:06:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.331+0000 7f4628e00640 1 --2- 172.21.15.173:0/1397895044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4604066f60 0x7f4604069420 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.331+0000 7f4628e00640 1 --2- 172.21.15.173:0/1397895044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4624145250 0x7f462415abf0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.331+0000 7f4628e00640 1 --2- 172.21.15.173:0/1397895044 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46240ccd30 0x7f462412cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.331+0000 7f4628e00640 1 --2- 172.21.15.173:0/1397895044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46240cc8b0 0x7f462413fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.331+0000 7f4628e00640 1 -- 172.21.15.173:0/1397895044 >> 172.21.15.173:0/1397895044 conn(0x7f462406ac90 msgr2=0x7f4624142e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:10.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.331+0000 7f4628e00640 1 -- 172.21.15.173:0/1397895044 shutdown_connections 2024-04-25T09:06:10.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.331+0000 7f4628e00640 1 -- 172.21.15.173:0/1397895044 wait complete. 2024-04-25T09:06:10.342 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path /scrub_test_path/i/dont/exist 2024-04-25T09:06:10.479 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:10.479 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": -2 2024-04-25T09:06:10.479 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:10.494 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' got response code '0' and stdout '{ "return_code": -2 } ' 2024-04-25T09:06:10.494 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-04-25T09:06:10.494 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:06:10.494 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-04-25T09:06:10.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.643+0000 7efea1800640 1 Processor -- start 2024-04-25T09:06:10.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.643+0000 7efea1800640 1 -- start start 2024-04-25T09:06:10.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.643+0000 7efea1800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efe9c0aef70 0x7efe9c06d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.643+0000 7efea1800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe9c071570 con 0x7efe9c0cc7e0 2024-04-25T09:06:10.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.643+0000 7efea1800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe9c071850 con 0x7efe9c0aeb90 2024-04-25T09:06:10.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.643+0000 7efea1800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe9c071320 con 0x7efe9c0aef70 2024-04-25T09:06:10.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.643+0000 7efe92000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7efe9c0cc7e0 0x7efe9c0cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47626/0 (socket says 172.21.15.173:47626) 2024-04-25T09:06:10.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.643+0000 7efe92000640 1 -- 172.21.15.173:0/2127485440 learned_addr learned my addr 172.21.15.173:0/2127485440 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:10.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.643+0000 7efe9b400640 1 --2- 172.21.15.173:0/2127485440 >> v2:172.21.15.194:3300/0 conn(0x7efe9c0aef70 0x7efe9c06d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.643+0000 7efe9a000640 1 -- 172.21.15.173:0/2127485440 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392592620 0 0) 0x7efe9c071570 con 0x7efe9c0cc7e0 2024-04-25T09:06:10.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.643+0000 7efe9a000640 1 -- 172.21.15.173:0/2127485440 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe80005740 con 0x7efe9c0cc7e0 2024-04-25T09:06:10.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.643+0000 7efe9a000640 1 -- 172.21.15.173:0/2127485440 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2227000487 0 0) 0x7efe80005740 con 0x7efe9c0cc7e0 2024-04-25T09:06:10.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.643+0000 7efe9a000640 1 -- 172.21.15.173:0/2127485440 >> v2:172.21.15.194:3300/0 conn(0x7efe9c0aef70 msgr2=0x7efe9c06d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.643+0000 7efe9a000640 1 --2- 172.21.15.173:0/2127485440 >> v2:172.21.15.194:3300/0 conn(0x7efe9c0aef70 0x7efe9c06d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.643+0000 7efe9a000640 1 -- 172.21.15.173:0/2127485440 >> v1:172.21.15.194:6789/0 conn(0x7efe9c0aeb90 legacy=0x7efe9c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.643+0000 7efe9a000640 1 -- 172.21.15.173:0/2127485440 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c071b30 con 0x7efe9c0cc7e0 2024-04-25T09:06:10.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.643+0000 7efe9a000640 1 -- 172.21.15.173:0/2127485440 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7efe840016a0 con 0x7efe9c0cc7e0 2024-04-25T09:06:10.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.643+0000 7efe9a000640 1 -- 172.21.15.173:0/2127485440 >> v1:172.21.15.173:6789/0 conn(0x7efe9c0cc7e0 legacy=0x7efe9c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe9a000640 1 --2- 172.21.15.173:0/2127485440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe80005bd0 0x7efe80005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe9a000640 1 --2- 172.21.15.173:0/2127485440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe80006a20 0x7efe80006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe9a000640 1 --2- 172.21.15.173:0/2127485440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe800073e0 0x7efe8000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe9a000640 1 -- 172.21.15.173:0/2127485440 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c071320 con 0x7efe800073e0 2024-04-25T09:06:10.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe9a000640 1 -- 172.21.15.173:0/2127485440 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8000e380 con 0x7efe80006a20 2024-04-25T09:06:10.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe9a000640 1 -- 172.21.15.173:0/2127485440 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8000e580 con 0x7efe80005bd0 2024-04-25T09:06:10.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe9b400640 1 --2- 172.21.15.173:0/2127485440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe800073e0 0x7efe8000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe92000640 1 --2- 172.21.15.173:0/2127485440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe80006a20 0x7efe80006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe9aa00640 1 --2- 172.21.15.173:0/2127485440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe80005bd0 0x7efe80005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe9b400640 1 -- 172.21.15.173:0/2127485440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe80005bd0 msgr2=0x7efe80005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe9b400640 1 --2- 172.21.15.173:0/2127485440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe80005bd0 0x7efe80005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe9b400640 1 -- 172.21.15.173:0/2127485440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe80006a20 msgr2=0x7efe80006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe9b400640 1 --2- 172.21.15.173:0/2127485440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe80006a20 0x7efe80006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe9b400640 1 -- 172.21.15.173:0/2127485440 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe80005740 con 0x7efe800073e0 2024-04-25T09:06:10.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe9b400640 1 -- 172.21.15.173:0/2127485440 reap_dead start 2024-04-25T09:06:10.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe9b400640 1 --2- 172.21.15.173:0/2127485440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe800073e0 0x7efe8000dbe0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7efe94009ae0 tx=0x7efe9401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57794bcfdadcba73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe9a000640 1 -- 172.21.15.173:0/2127485440 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe940096b0 con 0x7efe800073e0 2024-04-25T09:06:10.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe9a000640 1 -- 172.21.15.173:0/2127485440 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe94004020 con 0x7efe800073e0 2024-04-25T09:06:10.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.647+0000 7efe9a000640 1 -- 172.21.15.173:0/2127485440 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe94004410 con 0x7efe800073e0 2024-04-25T09:06:10.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efea1800640 1 -- 172.21.15.173:0/2127485440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe800073e0 msgr2=0x7efe8000dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efea1800640 1 --2- 172.21.15.173:0/2127485440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe800073e0 0x7efe8000dbe0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7efe94009ae0 tx=0x7efe9401cab0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efea1800640 1 -- 172.21.15.173:0/2127485440 shutdown_connections 2024-04-25T09:06:10.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efea1800640 1 --2- 172.21.15.173:0/2127485440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe800073e0 0x7efe8000dbe0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efea1800640 1 -- 172.21.15.173:0/2127485440 >> 172.21.15.173:0/2127485440 conn(0x7efe9c06ac90 msgr2=0x7efe9c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:10.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efea1800640 1 -- 172.21.15.173:0/2127485440 shutdown_connections 2024-04-25T09:06:10.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efea1800640 1 -- 172.21.15.173:0/2127485440 wait complete. 2024-04-25T09:06:10.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efea1800640 1 Processor -- start 2024-04-25T09:06:10.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efea1800640 1 -- start start 2024-04-25T09:06:10.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efea1800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe800073e0 0x7efe9c0b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efea1800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe9c14d380 0x7efe9c1f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efea1800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe9c1f4210 0x7efe9c14ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efea1800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c0cc0d0 con 0x7efe9c1f4210 2024-04-25T09:06:10.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efea1800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c072330 con 0x7efe9c14d380 2024-04-25T09:06:10.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efea1800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c0cc250 con 0x7efe800073e0 2024-04-25T09:06:10.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efe9b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe9c1f4210 0x7efe9c14ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efe9b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe9c1f4210 0x7efe9c14ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49448/0 (socket says 172.21.15.173:49448) 2024-04-25T09:06:10.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efe9b400640 1 -- 172.21.15.173:0/3914454885 learned_addr learned my addr 172.21.15.173:0/3914454885 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:10.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efe9aa00640 1 --2- 172.21.15.173:0/3914454885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe800073e0 0x7efe9c0b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efe92000640 1 --2- 172.21.15.173:0/3914454885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe9c14d380 0x7efe9c1f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efe9b400640 1 -- 172.21.15.173:0/3914454885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe800073e0 msgr2=0x7efe9c0b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efe9b400640 1 --2- 172.21.15.173:0/3914454885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe800073e0 0x7efe9c0b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efe9b400640 1 -- 172.21.15.173:0/3914454885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe9c14d380 msgr2=0x7efe9c1f3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efe9b400640 1 --2- 172.21.15.173:0/3914454885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe9c14d380 0x7efe9c1f3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.651+0000 7efe9b400640 1 -- 172.21.15.173:0/3914454885 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c1f4720 con 0x7efe9c1f4210 2024-04-25T09:06:10.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.655+0000 7efe9b400640 1 --2- 172.21.15.173:0/3914454885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe9c1f4210 0x7efe9c14ef60 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efe9401cf90 tx=0x7efe80007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.655+0000 7efe93400640 1 -- 172.21.15.173:0/3914454885 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe940b2070 con 0x7efe9c1f4210 2024-04-25T09:06:10.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.655+0000 7efe93400640 1 -- 172.21.15.173:0/3914454885 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe940bb070 con 0x7efe9c1f4210 2024-04-25T09:06:10.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.655+0000 7efe93400640 1 -- 172.21.15.173:0/3914454885 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe940a5ae0 con 0x7efe9c1f4210 2024-04-25T09:06:10.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.655+0000 7efea1800640 1 -- 172.21.15.173:0/3914454885 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe9c1f4a00 con 0x7efe9c1f4210 2024-04-25T09:06:10.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.655+0000 7efea1800640 1 -- 172.21.15.173:0/3914454885 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9c14d800 con 0x7efe9c1f4210 2024-04-25T09:06:10.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.655+0000 7efe93400640 1 -- 172.21.15.173:0/3914454885 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efe940a5c80 con 0x7efe9c1f4210 2024-04-25T09:06:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.655+0000 7efe93400640 1 --2- 172.21.15.173:0/3914454885 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efe78066f90 0x7efe78069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.655+0000 7efe93400640 1 -- 172.21.15.173:0/3914454885 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efe9411ea70 con 0x7efe9c1f4210 2024-04-25T09:06:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.655+0000 7efe9aa00640 1 --2- 172.21.15.173:0/3914454885 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efe78066f90 0x7efe78069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.655+0000 7efea4d81000 1 Processor -- start 2024-04-25T09:06:10.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efea4d81000 1 -- start start 2024-04-25T09:06:10.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efe9aa00640 1 --2- 172.21.15.173:0/3914454885 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efe78066f90 0x7efe78069450 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efe8c000f90 tx=0x7efe8c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efea4d81000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a2411970 0x55f2a2411d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efea4d81000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 0x55f2a23c7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efea4d81000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a23c7cd0 0x55f2a23c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efea4d81000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a21dd8a0 con 0x55f2a2412290 2024-04-25T09:06:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efea4d81000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a2215d10 con 0x55f2a2411970 2024-04-25T09:06:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efea4d81000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f2a219e2d0 con 0x55f2a23c7cd0 2024-04-25T09:06:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efe92000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 0x55f2a23c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efe92000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 0x55f2a23c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49462/0 (socket says 172.21.15.173:49462) 2024-04-25T09:06:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efe92000640 1 -- 172.21.15.173:0/3617023809 learned_addr learned my addr 172.21.15.173:0/3617023809 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efe9aa00640 1 --2- 172.21.15.173:0/3617023809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a2411970 0x55f2a2411d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efe9b400640 1 --2- 172.21.15.173:0/3617023809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a23c7cd0 0x55f2a23c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efe92000640 1 -- 172.21.15.173:0/3617023809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a23c7cd0 msgr2=0x55f2a23c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efe92000640 1 --2- 172.21.15.173:0/3617023809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a23c7cd0 0x55f2a23c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efe92000640 1 -- 172.21.15.173:0/3617023809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a2411970 msgr2=0x55f2a2411d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efe92000640 1 --2- 172.21.15.173:0/3617023809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a2411970 0x55f2a2411d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efe92000640 1 -- 172.21.15.173:0/3617023809 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2a225c870 con 0x55f2a2412290 2024-04-25T09:06:10.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efe92000640 1 --2- 172.21.15.173:0/3617023809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 0x55f2a23c7790 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7efe84001ec0 tx=0x7efe84005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b321d12e170a95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efe8b400640 1 -- 172.21.15.173:0/3617023809 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe840158d0 con 0x55f2a2412290 2024-04-25T09:06:10.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efe8b400640 1 -- 172.21.15.173:0/3617023809 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8401c020 con 0x55f2a2412290 2024-04-25T09:06:10.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efe8b400640 1 -- 172.21.15.173:0/3617023809 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84015a70 con 0x55f2a2412290 2024-04-25T09:06:10.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efea4d81000 1 -- 172.21.15.173:0/3617023809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 msgr2=0x55f2a23c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efea4d81000 1 --2- 172.21.15.173:0/3617023809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 0x55f2a23c7790 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7efe84001ec0 tx=0x7efe84005550 comp rx=0 tx=0).stop 2024-04-25T09:06:10.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efea4d81000 1 -- 172.21.15.173:0/3617023809 shutdown_connections 2024-04-25T09:06:10.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efea4d81000 1 --2- 172.21.15.173:0/3617023809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a23c7cd0 0x55f2a23c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efea4d81000 1 --2- 172.21.15.173:0/3617023809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 0x55f2a23c7790 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efea4d81000 1 --2- 172.21.15.173:0/3617023809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a2411970 0x55f2a2411d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efea4d81000 1 -- 172.21.15.173:0/3617023809 >> 172.21.15.173:0/3617023809 conn(0x55f2a23ce540 msgr2=0x55f2a23ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:10.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efea4d81000 1 -- 172.21.15.173:0/3617023809 shutdown_connections 2024-04-25T09:06:10.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efea4d81000 1 -- 172.21.15.173:0/3617023809 wait complete. 2024-04-25T09:06:10.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efea4d81000 1 -- start start 2024-04-25T09:06:10.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.659+0000 7efea4d81000 1 Processor -- start 2024-04-25T09:06:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efea4d81000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a23c7cd0 0x55f2a23ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efea4d81000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a2411970 0x55f2a23d3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efea4d81000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a2412290 0x55f2a23d3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efea4d81000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a21d0b50 con 0x55f2a23c7cd0 2024-04-25T09:06:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efea4d81000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a2211db0 con 0x55f2a2411970 2024-04-25T09:06:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efea4d81000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f2a23d1ad0 con 0x55f2a2412290 2024-04-25T09:06:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efea4d81000 10 client.0 _ll_register_callbacks cb 0x55f2a22c9fb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe9aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a23c7cd0 0x55f2a23ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe9aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a23c7cd0 0x55f2a23ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49468/0 (socket says 172.21.15.173:49468) 2024-04-25T09:06:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe9aa00640 1 -- 172.21.15.173:0/2249058012 learned_addr learned my addr 172.21.15.173:0/2249058012 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe92000640 1 --2- 172.21.15.173:0/2249058012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a2411970 0x55f2a23d3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe9b400640 1 --2- 172.21.15.173:0/2249058012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a2412290 0x55f2a23d3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe9aa00640 1 -- 172.21.15.173:0/2249058012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a2412290 msgr2=0x55f2a23d3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe9aa00640 1 --2- 172.21.15.173:0/2249058012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a2412290 0x55f2a23d3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe9aa00640 1 -- 172.21.15.173:0/2249058012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a2411970 msgr2=0x55f2a23d3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe9aa00640 1 --2- 172.21.15.173:0/2249058012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a2411970 0x55f2a23d3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe9aa00640 1 -- 172.21.15.173:0/2249058012 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2a219e520 con 0x55f2a23c7cd0 2024-04-25T09:06:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe9aa00640 1 --2- 172.21.15.173:0/2249058012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a23c7cd0 0x55f2a23ccc10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7efe8c015b30 tx=0x7efe8c0014b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b9934f8809b039 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe7fe00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe7fe00640 1 -- 172.21.15.173:0/2249058012 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c026070 con 0x55f2a23c7cd0 2024-04-25T09:06:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe7fe00640 1 -- 172.21.15.173:0/2249058012 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efe8c014820 con 0x55f2a23c7cd0 2024-04-25T09:06:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efea4d81000 1 -- 172.21.15.173:0/2249058012 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe8401c020 con 0x55f2a23c7cd0 2024-04-25T09:06:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe7fe00640 1 -- 172.21.15.173:0/2249058012 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe8c031050 con 0x55f2a23c7cd0 2024-04-25T09:06:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efea4d81000 10 client.6069 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efea4d81000 1 -- 172.21.15.173:0/2249058012 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55f2a2210d00 con 0x55f2a23c7cd0 2024-04-25T09:06:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe7fe00640 1 -- 172.21.15.173:0/2249058012 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8401c020 con 0x55f2a23c7cd0 2024-04-25T09:06:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe7fe00640 1 -- 172.21.15.173:0/2249058012 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efe8c034020 con 0x55f2a23c7cd0 2024-04-25T09:06:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efea4d81000 10 client.6069 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efea4d81000 10 client.6069 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efea4d81000 20 client.6069 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efea4d81000 1 --2- 172.21.15.173:0/2249058012 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55f2a2417da0 0x55f2a2418180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efea4d81000 4 client.6069 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efea4d81000 1 -- 172.21.15.173:0/2249058012 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f2a21b1b10 con 0x55f2a2417da0 2024-04-25T09:06:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe92000640 1 --2- 172.21.15.173:0/2249058012 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55f2a2417da0 0x55f2a2418180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe92000640 1 --2- 172.21.15.173:0/2249058012 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55f2a2417da0 0x55f2a2418180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f551b7e5bac7254 server_cookie=b2e759ba19cce277 in_seq=0 out_seq=0 2024-04-25T09:06:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe7fe00640 10 client.6069 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:10.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe7fe00640 1 -- 172.21.15.173:0/2249058012 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f2a21b1b10 con 0x55f2a2417da0 2024-04-25T09:06:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.663+0000 7efe7fe00640 10 client.6069 handle_command_reply: tid=0 2024-04-25T09:06:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.667+0000 7efea4d81000 1 client.6069 shutdown 2024-04-25T09:06:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.667+0000 7efea4d81000 1 -- 172.21.15.173:0/2249058012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a23c7cd0 msgr2=0x55f2a23ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.667+0000 7efea4d81000 1 --2- 172.21.15.173:0/2249058012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a23c7cd0 0x55f2a23ccc10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7efe8c015b30 tx=0x7efe8c0014b0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.667+0000 7efea4d81000 1 -- 172.21.15.173:0/2249058012 shutdown_connections 2024-04-25T09:06:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.667+0000 7efea4d81000 1 --2- 172.21.15.173:0/2249058012 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55f2a2417da0 0x55f2a2418180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.667+0000 7efea4d81000 1 --2- 172.21.15.173:0/2249058012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a2412290 0x55f2a23d3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.667+0000 7efe7fe00640 0 client.6069 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.667+0000 7efea4d81000 1 --2- 172.21.15.173:0/2249058012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a2411970 0x55f2a23d3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.667+0000 7efea4d81000 1 --2- 172.21.15.173:0/2249058012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a23c7cd0 0x55f2a23ccc10 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.667+0000 7efea4d81000 1 -- 172.21.15.173:0/2249058012 >> 172.21.15.173:0/2249058012 conn(0x55f2a23ce540 msgr2=0x55f2a23c6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.667+0000 7efea4d81000 1 -- 172.21.15.173:0/2249058012 shutdown_connections 2024-04-25T09:06:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.667+0000 7efea4d81000 1 -- 172.21.15.173:0/2249058012 wait complete. 2024-04-25T09:06:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.667+0000 7efea4d81000 20 client.6069 trim_cache size 0 max 16384 2024-04-25T09:06:10.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.679+0000 7efea4d81000 1 Processor -- start 2024-04-25T09:06:10.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.679+0000 7efea4d81000 1 -- start start 2024-04-25T09:06:10.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a23c7cd0 0x55f2a24109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a2411970 0x55f2a2410f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 0x55f2a23c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c1ffae0 con 0x55f2a2412290 2024-04-25T09:06:10.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c153400 con 0x55f2a23c7cd0 2024-04-25T09:06:10.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c1ff510 con 0x55f2a2411970 2024-04-25T09:06:10.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe9b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 0x55f2a23c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe9b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 0x55f2a23c5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49484/0 (socket says 172.21.15.173:49484) 2024-04-25T09:06:10.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe9b400640 1 -- 172.21.15.173:0/2607273641 learned_addr learned my addr 172.21.15.173:0/2607273641 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:10.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe9aa00640 1 --2- 172.21.15.173:0/2607273641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a23c7cd0 0x55f2a24109e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe92000640 1 --2- 172.21.15.173:0/2607273641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a2411970 0x55f2a2410f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe9b400640 1 -- 172.21.15.173:0/2607273641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a2411970 msgr2=0x55f2a2410f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe9b400640 1 --2- 172.21.15.173:0/2607273641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a2411970 0x55f2a2410f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe9b400640 1 -- 172.21.15.173:0/2607273641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a23c7cd0 msgr2=0x55f2a24109e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe9b400640 1 --2- 172.21.15.173:0/2607273641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a23c7cd0 0x55f2a24109e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe9b400640 1 -- 172.21.15.173:0/2607273641 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2a2299920 con 0x55f2a2412290 2024-04-25T09:06:10.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe9b400640 1 --2- 172.21.15.173:0/2607273641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 0x55f2a23c5ef0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7efe940ef060 tx=0x7efe94009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96c1572c83b8c2a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe8aa00640 1 -- 172.21.15.173:0/2607273641 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe940f79c0 con 0x55f2a2412290 2024-04-25T09:06:10.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe8aa00640 1 -- 172.21.15.173:0/2607273641 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe940ed400 con 0x55f2a2412290 2024-04-25T09:06:10.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe8aa00640 1 -- 172.21.15.173:0/2607273641 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe940ed660 con 0x55f2a2412290 2024-04-25T09:06:10.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 -- 172.21.15.173:0/2607273641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 msgr2=0x55f2a23c5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 --2- 172.21.15.173:0/2607273641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 0x55f2a23c5ef0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7efe940ef060 tx=0x7efe94009190 comp rx=0 tx=0).stop 2024-04-25T09:06:10.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 -- 172.21.15.173:0/2607273641 shutdown_connections 2024-04-25T09:06:10.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 --2- 172.21.15.173:0/2607273641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 0x55f2a23c5ef0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 --2- 172.21.15.173:0/2607273641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a2411970 0x55f2a2410f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 --2- 172.21.15.173:0/2607273641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a23c7cd0 0x55f2a24109e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 -- 172.21.15.173:0/2607273641 >> 172.21.15.173:0/2607273641 conn(0x55f2a23ce540 msgr2=0x55f2a24102d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:10.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 -- 172.21.15.173:0/2607273641 shutdown_connections 2024-04-25T09:06:10.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 -- 172.21.15.173:0/2607273641 wait complete. 2024-04-25T09:06:10.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 -- start start 2024-04-25T09:06:10.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 Processor -- start 2024-04-25T09:06:10.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a23c7cd0 0x55f2a2471270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a2411970 0x55f2a2415b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 0x55f2a2416070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a21ccd20 con 0x55f2a2412290 2024-04-25T09:06:10.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a221a340 con 0x55f2a2411970 2024-04-25T09:06:10.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f2a2299490 con 0x55f2a23c7cd0 2024-04-25T09:06:10.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efea4d81000 10 client.0 _ll_register_callbacks cb 0x7efe840014a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:10.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe9b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 0x55f2a2416070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe9aa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a23c7cd0 0x55f2a2471270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe9b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 0x55f2a2416070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49488/0 (socket says 172.21.15.173:49488) 2024-04-25T09:06:10.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe9b400640 1 -- 172.21.15.173:0/70218963 learned_addr learned my addr 172.21.15.173:0/70218963 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:10.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.683+0000 7efe92000640 1 --2- 172.21.15.173:0/70218963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a2411970 0x55f2a2415b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efe9b400640 1 -- 172.21.15.173:0/70218963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a23c7cd0 msgr2=0x55f2a2471270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efe9b400640 1 --2- 172.21.15.173:0/70218963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a23c7cd0 0x55f2a2471270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efe9b400640 1 -- 172.21.15.173:0/70218963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a2411970 msgr2=0x55f2a2415b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efe9b400640 1 --2- 172.21.15.173:0/70218963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a2411970 0x55f2a2415b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efe9b400640 1 -- 172.21.15.173:0/70218963 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2a226fa30 con 0x55f2a2412290 2024-04-25T09:06:10.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efe9b400640 1 --2- 172.21.15.173:0/70218963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 0x55f2a2416070 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7efe9401c8e0 tx=0x7efe9401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa51a7af0475802 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efe7fe00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:10.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efe7fe00640 1 -- 172.21.15.173:0/70218963 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9410a070 con 0x55f2a2412290 2024-04-25T09:06:10.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efe7fe00640 1 -- 172.21.15.173:0/70218963 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efe940ee7b0 con 0x55f2a2412290 2024-04-25T09:06:10.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 1 -- 172.21.15.173:0/70218963 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe940ed400 con 0x55f2a2412290 2024-04-25T09:06:10.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efe7fe00640 1 -- 172.21.15.173:0/70218963 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe9410d360 con 0x55f2a2412290 2024-04-25T09:06:10.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 10 client.6075 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:10.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 1 -- 172.21.15.173:0/70218963 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55f2a21bd150 con 0x55f2a2412290 2024-04-25T09:06:10.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efe7fe00640 1 -- 172.21.15.173:0/70218963 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe940ed400 con 0x55f2a2412290 2024-04-25T09:06:10.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efe7fe00640 1 -- 172.21.15.173:0/70218963 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efe940f5390 con 0x55f2a2412290 2024-04-25T09:06:10.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 10 client.6075 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:10.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 10 client.6075 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:10.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 20 client.6075 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:10.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 1 --2- 172.21.15.173:0/70218963 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55f2a24165b0 0x55f2a2416990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 4 client.6075 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-04-25T09:06:10.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 1 -- 172.21.15.173:0/70218963 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) v1 -- 0x55f2a2223250 con 0x55f2a24165b0 2024-04-25T09:06:10.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efe9aa00640 1 --2- 172.21.15.173:0/70218963 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55f2a24165b0 0x55f2a2416990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efe9aa00640 1 --2- 172.21.15.173:0/70218963 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55f2a24165b0 0x55f2a2416990 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11a98e18deba31ff server_cookie=4466f5b3757f2d26 in_seq=0 out_seq=0 2024-04-25T09:06:10.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efe7fe00640 10 client.6075 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:10.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efe7fe00640 1 -- 172.21.15.173:0/70218963 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+26 (crc 0 0 0) 0x55f2a2223250 con 0x55f2a24165b0 2024-04-25T09:06:10.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efe7fe00640 10 client.6075 handle_command_reply: tid=0 2024-04-25T09:06:10.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 1 client.6075 shutdown 2024-04-25T09:06:10.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 1 -- 172.21.15.173:0/70218963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 msgr2=0x55f2a2416070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 1 --2- 172.21.15.173:0/70218963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 0x55f2a2416070 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7efe9401c8e0 tx=0x7efe9401cab0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 1 -- 172.21.15.173:0/70218963 shutdown_connections 2024-04-25T09:06:10.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 1 --2- 172.21.15.173:0/70218963 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55f2a24165b0 0x55f2a2416990 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 1 --2- 172.21.15.173:0/70218963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f2a2412290 0x55f2a2416070 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efe7fe00640 0 client.6075 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:10.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 1 --2- 172.21.15.173:0/70218963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f2a2411970 0x55f2a2415b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 1 --2- 172.21.15.173:0/70218963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2a23c7cd0 0x55f2a2471270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 1 -- 172.21.15.173:0/70218963 >> 172.21.15.173:0/70218963 conn(0x55f2a23ce540 msgr2=0x55f2a2410b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:10.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 1 -- 172.21.15.173:0/70218963 shutdown_connections 2024-04-25T09:06:10.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 1 -- 172.21.15.173:0/70218963 wait complete. 2024-04-25T09:06:10.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea4d81000 20 client.6075 trim_cache size 0 max 16384 2024-04-25T09:06:10.683 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:10.683 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": -2 2024-04-25T09:06:10.683 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:10.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea1800640 1 -- 172.21.15.173:0/3914454885 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efe78066f90 msgr2=0x7efe78069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea1800640 1 --2- 172.21.15.173:0/3914454885 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efe78066f90 0x7efe78069450 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efe8c000f90 tx=0x7efe8c009040 comp rx=0 tx=0).stop 2024-04-25T09:06:10.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea1800640 1 -- 172.21.15.173:0/3914454885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe9c1f4210 msgr2=0x7efe9c14ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea1800640 1 --2- 172.21.15.173:0/3914454885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe9c1f4210 0x7efe9c14ef60 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efe9401cf90 tx=0x7efe80007a50 comp rx=0 tx=0).stop 2024-04-25T09:06:10.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea1800640 1 -- 172.21.15.173:0/3914454885 shutdown_connections 2024-04-25T09:06:10.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea1800640 1 --2- 172.21.15.173:0/3914454885 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efe78066f90 0x7efe78069450 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea1800640 1 --2- 172.21.15.173:0/3914454885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe9c1f4210 0x7efe9c14ef60 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea1800640 1 --2- 172.21.15.173:0/3914454885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe9c14d380 0x7efe9c1f3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea1800640 1 --2- 172.21.15.173:0/3914454885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe800073e0 0x7efe9c0b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea1800640 1 -- 172.21.15.173:0/3914454885 >> 172.21.15.173:0/3914454885 conn(0x7efe9c06ac90 msgr2=0x7efe9c15ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:10.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea1800640 1 -- 172.21.15.173:0/3914454885 shutdown_connections 2024-04-25T09:06:10.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.687+0000 7efea1800640 1 -- 172.21.15.173:0/3914454885 wait complete. 2024-04-25T09:06:10.699 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-04-25T09:06:10.699 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites 2024-04-25T09:06:10.699 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites' 2024-04-25T09:06:10.699 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:10.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.843+0000 7f9490a00640 1 Processor -- start 2024-04-25T09:06:10.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.843+0000 7f9490a00640 1 -- start start 2024-04-25T09:06:10.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.843+0000 7f9490a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f948c0b4930 0x7f948c161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.843+0000 7f9490a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c0b2ee0 con 0x7f948c15dc90 2024-04-25T09:06:10.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.843+0000 7f9490a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c0b31c0 con 0x7f948c06df90 2024-04-25T09:06:10.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.843+0000 7f9490a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948c06db00 con 0x7f948c0b4930 2024-04-25T09:06:10.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.843+0000 7f948b400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f948c15dc90 0x7f948c161660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47638/0 (socket says 172.21.15.173:47638) 2024-04-25T09:06:10.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.843+0000 7f948b400640 1 -- 172.21.15.173:0/1620680221 learned_addr learned my addr 172.21.15.173:0/1620680221 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:10.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.843+0000 7f9482a00640 1 --2- 172.21.15.173:0/1620680221 >> v2:172.21.15.173:3300/0 conn(0x7f948c0b4930 0x7f948c161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.843+0000 7f9482a00640 1 -- 172.21.15.173:0/1620680221 >> v1:172.21.15.194:6789/0 conn(0x7f948c06df90 legacy=0x7f948c06e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.843+0000 7f9482a00640 1 -- 172.21.15.173:0/1620680221 >> v1:172.21.15.173:6789/0 conn(0x7f948c15dc90 legacy=0x7f948c161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.843+0000 7f9482a00640 1 -- 172.21.15.173:0/1620680221 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c0b4db0 con 0x7f948c0b4930 2024-04-25T09:06:10.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.847+0000 7f9482a00640 1 --2- 172.21.15.173:0/1620680221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f948c0b4930 0x7f948c161d70 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f94740097c0 tx=0x7f947401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca44937d0f4ef919 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.847+0000 7f948aa00640 1 -- 172.21.15.173:0/1620680221 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94740b0070 con 0x7f948c0b4930 2024-04-25T09:06:10.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.847+0000 7f948aa00640 1 -- 172.21.15.173:0/1620680221 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94740ab600 con 0x7f948c0b4930 2024-04-25T09:06:10.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.847+0000 7f948aa00640 1 -- 172.21.15.173:0/1620680221 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94740a4e60 con 0x7f948c0b4930 2024-04-25T09:06:10.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.847+0000 7f9490a00640 1 -- 172.21.15.173:0/1620680221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f948c0b4930 msgr2=0x7f948c161d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.847+0000 7f9490a00640 1 --2- 172.21.15.173:0/1620680221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f948c0b4930 0x7f948c161d70 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f94740097c0 tx=0x7f947401c3d0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.847+0000 7f9490a00640 1 -- 172.21.15.173:0/1620680221 shutdown_connections 2024-04-25T09:06:10.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.847+0000 7f9490a00640 1 --2- 172.21.15.173:0/1620680221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f948c0b4930 0x7f948c161d70 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.847+0000 7f9490a00640 1 -- 172.21.15.173:0/1620680221 >> 172.21.15.173:0/1620680221 conn(0x7f948c0cc800 msgr2=0x7f948c0ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:10.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.847+0000 7f9490a00640 1 -- 172.21.15.173:0/1620680221 shutdown_connections 2024-04-25T09:06:10.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.847+0000 7f9490a00640 1 -- 172.21.15.173:0/1620680221 wait complete. 2024-04-25T09:06:10.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9490a00640 1 Processor -- start 2024-04-25T09:06:10.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9490a00640 1 -- start start 2024-04-25T09:06:10.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9490a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f948c06df90 0x7f948c14d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9490a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f948c0b4930 0x7f948c14fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9490a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c15dc90 0x7f948c1607a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9490a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c16bbc0 con 0x7f948c0b4930 2024-04-25T09:06:10.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9490a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c1624c0 con 0x7f948c06df90 2024-04-25T09:06:10.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9490a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c16bd40 con 0x7f948c15dc90 2024-04-25T09:06:10.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9482a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f948c0b4930 0x7f948c14fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9482a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f948c0b4930 0x7f948c14fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49492/0 (socket says 172.21.15.173:49492) 2024-04-25T09:06:10.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9482a00640 1 -- 172.21.15.173:0/637817009 learned_addr learned my addr 172.21.15.173:0/637817009 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:10.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f948b400640 1 --2- 172.21.15.173:0/637817009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f948c06df90 0x7f948c14d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f948be00640 1 --2- 172.21.15.173:0/637817009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c15dc90 0x7f948c1607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9482a00640 1 -- 172.21.15.173:0/637817009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c15dc90 msgr2=0x7f948c1607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9482a00640 1 --2- 172.21.15.173:0/637817009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c15dc90 0x7f948c1607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9482a00640 1 -- 172.21.15.173:0/637817009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f948c06df90 msgr2=0x7f948c14d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9482a00640 1 --2- 172.21.15.173:0/637817009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f948c06df90 0x7f948c14d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9482a00640 1 -- 172.21.15.173:0/637817009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c15f9e0 con 0x7f948c0b4930 2024-04-25T09:06:10.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f948be00640 1 --2- 172.21.15.173:0/637817009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c15dc90 0x7f948c1607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:10.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9482a00640 1 --2- 172.21.15.173:0/637817009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f948c0b4930 0x7f948c14fc00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9474018fe0 tx=0x7f9474019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9483e00640 1 -- 172.21.15.173:0/637817009 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94740b0040 con 0x7f948c0b4930 2024-04-25T09:06:10.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9483e00640 1 -- 172.21.15.173:0/637817009 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94740bb070 con 0x7f948c0b4930 2024-04-25T09:06:10.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9483e00640 1 -- 172.21.15.173:0/637817009 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94740b4630 con 0x7f948c0b4930 2024-04-25T09:06:10.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9490a00640 1 -- 172.21.15.173:0/637817009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948c15fcc0 con 0x7f948c0b4930 2024-04-25T09:06:10.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.851+0000 7f9490a00640 1 -- 172.21.15.173:0/637817009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c160280 con 0x7f948c0b4930 2024-04-25T09:06:10.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.855+0000 7f9490a00640 1 -- 172.21.15.173:0/637817009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948c073a40 con 0x7f948c0b4930 2024-04-25T09:06:10.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.855+0000 7f9483e00640 1 -- 172.21.15.173:0/637817009 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f94740b47d0 con 0x7f948c0b4930 2024-04-25T09:06:10.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.855+0000 7f9483e00640 1 --2- 172.21.15.173:0/637817009 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9468066f60 0x7f9468069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.855+0000 7f9483e00640 1 -- 172.21.15.173:0/637817009 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f947411ef30 con 0x7f948c0b4930 2024-04-25T09:06:10.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.855+0000 7f948b400640 1 --2- 172.21.15.173:0/637817009 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9468066f60 0x7f9468069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.855+0000 7f948b400640 1 --2- 172.21.15.173:0/637817009 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9468066f60 0x7f9468069420 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f947c000f70 tx=0x7f947c007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:10.859+0000 7f9483e00640 1 -- 172.21.15.173:0/637817009 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9474016050 con 0x7f948c0b4930 2024-04-25T09:06:11.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.043+0000 7f9490a00640 1 -- 172.21.15.173:0/637817009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f948c0cd560 con 0x7f948c0b4930 2024-04-25T09:06:11.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.047+0000 7f9483e00640 1 -- 172.21.15.173:0/637817009 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f94740efc80 con 0x7f948c0b4930 2024-04-25T09:06:11.037 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:11.037 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:05:57.598642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:11.037 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 26 2024-04-25T09:06:11.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.047+0000 7f9490a00640 1 -- 172.21.15.173:0/637817009 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9468066f60 msgr2=0x7f9468069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.047+0000 7f9490a00640 1 --2- 172.21.15.173:0/637817009 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9468066f60 0x7f9468069420 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f947c000f70 tx=0x7f947c007e90 comp rx=0 tx=0).stop 2024-04-25T09:06:11.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.047+0000 7f9490a00640 1 -- 172.21.15.173:0/637817009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f948c0b4930 msgr2=0x7f948c14fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.047+0000 7f9490a00640 1 --2- 172.21.15.173:0/637817009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f948c0b4930 0x7f948c14fc00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9474018fe0 tx=0x7f9474019170 comp rx=0 tx=0).stop 2024-04-25T09:06:11.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.047+0000 7f9490a00640 1 -- 172.21.15.173:0/637817009 shutdown_connections 2024-04-25T09:06:11.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.047+0000 7f9490a00640 1 --2- 172.21.15.173:0/637817009 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9468066f60 0x7f9468069420 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.047+0000 7f9490a00640 1 --2- 172.21.15.173:0/637817009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c15dc90 0x7f948c1607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.047+0000 7f9490a00640 1 --2- 172.21.15.173:0/637817009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f948c0b4930 0x7f948c14fc00 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.047+0000 7f9490a00640 1 --2- 172.21.15.173:0/637817009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f948c06df90 0x7f948c14d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.047+0000 7f9490a00640 1 -- 172.21.15.173:0/637817009 >> 172.21.15.173:0/637817009 conn(0x7f948c0cc800 msgr2=0x7f948c06f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:11.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.047+0000 7f9490a00640 1 -- 172.21.15.173:0/637817009 shutdown_connections 2024-04-25T09:06:11.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.047+0000 7f9490a00640 1 -- 172.21.15.173:0/637817009 wait complete. 2024-04-25T09:06:11.058 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path /scrub_test_path/ceph-qa-suite/suites 2024-04-25T09:06:11.429 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:11.429 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0 2024-04-25T09:06:11.429 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:11.444 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T09:06:11.444 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-04-25T09:06:11.444 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:06:11.445 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-04-25T09:06:11.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.590+0000 7f2dad800640 1 Processor -- start 2024-04-25T09:06:11.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.590+0000 7f2dad800640 1 -- start start 2024-04-25T09:06:11.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.590+0000 7f2dad800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2da8145290 0x7f2da815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.590+0000 7f2dad800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2da80b3fe0 0x7f2da80b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.590+0000 7f2dad800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2da80cc260 0x7f2da80cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.590+0000 7f2dad800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da815c5f0 con 0x7f2da80b3fe0 2024-04-25T09:06:11.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.590+0000 7f2dad800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da806d4b0 con 0x7f2da8145290 2024-04-25T09:06:11.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.590+0000 7f2dad800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da806d790 con 0x7f2da80cc260 2024-04-25T09:06:11.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.590+0000 7f2da6000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2da80b3fe0 0x7f2da80b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.590+0000 7f2da6000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2da80b3fe0 0x7f2da80b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49504/0 (socket says 172.21.15.173:49504) 2024-04-25T09:06:11.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.590+0000 7f2da6000640 1 -- 172.21.15.173:0/2978229211 learned_addr learned my addr 172.21.15.173:0/2978229211 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:11.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.590+0000 7f2da6a00640 1 --2- 172.21.15.173:0/2978229211 >> v2:172.21.15.194:3300/0 conn(0x7f2da8145290 0x7f2da815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.590+0000 7f2da7400640 1 --2- 172.21.15.173:0/2978229211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2da80cc260 0x7f2da80cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.594+0000 7f2da6000640 1 -- 172.21.15.173:0/2978229211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2da80cc260 msgr2=0x7f2da80cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:11.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.594+0000 7f2da6000640 1 --2- 172.21.15.173:0/2978229211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2da80cc260 0x7f2da80cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.594+0000 7f2da6000640 1 -- 172.21.15.173:0/2978229211 >> v2:172.21.15.194:3300/0 conn(0x7f2da8145290 msgr2=0x7f2da815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:11.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.594+0000 7f2da6000640 1 --2- 172.21.15.173:0/2978229211 >> v2:172.21.15.194:3300/0 conn(0x7f2da8145290 0x7f2da815c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.594+0000 7f2da6000640 1 -- 172.21.15.173:0/2978229211 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da806da70 con 0x7f2da80b3fe0 2024-04-25T09:06:11.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.594+0000 7f2da6a00640 1 --2- 172.21.15.173:0/2978229211 >> v2:172.21.15.194:3300/0 conn(0x7f2da8145290 0x7f2da815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:11.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.594+0000 7f2da6000640 1 --2- 172.21.15.173:0/2978229211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2da80b3fe0 0x7f2da80b4450 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f2da80d0800 tx=0x7f2d9401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f19a0925abe75e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.594+0000 7f2da5600640 1 -- 172.21.15.173:0/2978229211 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d940b0070 con 0x7f2da80b3fe0 2024-04-25T09:06:11.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.594+0000 7f2da5600640 1 -- 172.21.15.173:0/2978229211 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d940ab600 con 0x7f2da80b3fe0 2024-04-25T09:06:11.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.594+0000 7f2da5600640 1 -- 172.21.15.173:0/2978229211 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d940ab9d0 con 0x7f2da80b3fe0 2024-04-25T09:06:11.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.594+0000 7f2dad800640 1 -- 172.21.15.173:0/2978229211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2da80b3fe0 msgr2=0x7f2da80b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.594+0000 7f2dad800640 1 --2- 172.21.15.173:0/2978229211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2da80b3fe0 0x7f2da80b4450 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f2da80d0800 tx=0x7f2d9401c400 comp rx=0 tx=0).stop 2024-04-25T09:06:11.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2dad800640 1 -- 172.21.15.173:0/2978229211 shutdown_connections 2024-04-25T09:06:11.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2dad800640 1 --2- 172.21.15.173:0/2978229211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2da80cc260 0x7f2da80cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2dad800640 1 --2- 172.21.15.173:0/2978229211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2da80b3fe0 0x7f2da80b4450 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2dad800640 1 --2- 172.21.15.173:0/2978229211 >> v2:172.21.15.194:3300/0 conn(0x7f2da8145290 0x7f2da815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2dad800640 1 -- 172.21.15.173:0/2978229211 >> 172.21.15.173:0/2978229211 conn(0x7f2da806ac90 msgr2=0x7f2da806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:11.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2dad800640 1 -- 172.21.15.173:0/2978229211 shutdown_connections 2024-04-25T09:06:11.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2dad800640 1 -- 172.21.15.173:0/2978229211 wait complete. 2024-04-25T09:06:11.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2dad800640 1 Processor -- start 2024-04-25T09:06:11.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2dad800640 1 -- start start 2024-04-25T09:06:11.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2dad800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2da80b3fe0 0x7f2da81595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2dad800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2da80cc260 0x7f2da815aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2dad800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2da8145290 0x7f2da8143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2dad800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da81457f0 con 0x7f2da80b3fe0 2024-04-25T09:06:11.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2dad800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da8145670 con 0x7f2da8145290 2024-04-25T09:06:11.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2dad800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da806ed60 con 0x7f2da80cc260 2024-04-25T09:06:11.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2da6a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2da80b3fe0 0x7f2da81595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2da6a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2da80b3fe0 0x7f2da81595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49508/0 (socket says 172.21.15.173:49508) 2024-04-25T09:06:11.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2da6a00640 1 -- 172.21.15.173:0/2655698652 learned_addr learned my addr 172.21.15.173:0/2655698652 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:11.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2da6000640 1 --2- 172.21.15.173:0/2655698652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2da80cc260 0x7f2da815aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2da6a00640 1 -- 172.21.15.173:0/2655698652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2da80cc260 msgr2=0x7f2da815aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2da6a00640 1 --2- 172.21.15.173:0/2655698652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2da80cc260 0x7f2da815aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2da6a00640 1 -- 172.21.15.173:0/2655698652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2da8145290 msgr2=0x7f2da8143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2da6a00640 1 --2- 172.21.15.173:0/2655698652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2da8145290 0x7f2da8143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2da6a00640 1 -- 172.21.15.173:0/2655698652 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da8135800 con 0x7f2da80b3fe0 2024-04-25T09:06:11.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2da6000640 1 --2- 172.21.15.173:0/2655698652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2da80cc260 0x7f2da815aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:11.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2da6a00640 1 --2- 172.21.15.173:0/2655698652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2da80b3fe0 0x7f2da81595a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2d98007f20 tx=0x7f2d9800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.598+0000 7f2d9ea00640 1 -- 172.21.15.173:0/2655698652 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9801a070 con 0x7f2da80b3fe0 2024-04-25T09:06:11.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.602+0000 7f2d9ea00640 1 -- 172.21.15.173:0/2655698652 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d98003ba0 con 0x7f2da80b3fe0 2024-04-25T09:06:11.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.602+0000 7f2dad800640 1 -- 172.21.15.173:0/2655698652 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da8135ae0 con 0x7f2da80b3fe0 2024-04-25T09:06:11.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.602+0000 7f2d9ea00640 1 -- 172.21.15.173:0/2655698652 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98004030 con 0x7f2da80b3fe0 2024-04-25T09:06:11.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.602+0000 7f2dad800640 1 -- 172.21.15.173:0/2655698652 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da81360a0 con 0x7f2da80b3fe0 2024-04-25T09:06:11.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.602+0000 7f2d9ea00640 1 -- 172.21.15.173:0/2655698652 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2d9801d070 con 0x7f2da80b3fe0 2024-04-25T09:06:11.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.602+0000 7f2d9ea00640 1 --2- 172.21.15.173:0/2655698652 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2d88066f90 0x7f2d88069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.602+0000 7f2d9ea00640 1 -- 172.21.15.173:0/2655698652 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2d98085380 con 0x7f2da80b3fe0 2024-04-25T09:06:11.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.602+0000 7f2da6000640 1 --2- 172.21.15.173:0/2655698652 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2d88066f90 0x7f2d88069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.602+0000 7f2db0d4d000 1 Processor -- start 2024-04-25T09:06:11.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.602+0000 7f2da6000640 1 --2- 172.21.15.173:0/2655698652 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2d88066f90 0x7f2d88069450 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2d940ad000 tx=0x7f2d94008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.602+0000 7f2db0d4d000 1 -- start start 2024-04-25T09:06:11.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2db0d4d000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588756aa300 0x5588756aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2db0d4d000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aac20 0x5588756605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2db0d4d000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558875660b20 0x558875660f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2db0d4d000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588754aadb0 con 0x5588756aac20 2024-04-25T09:06:11.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2db0d4d000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558875433230 con 0x5588756aa300 2024-04-25T09:06:11.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2db0d4d000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588754a6e50 con 0x558875660b20 2024-04-25T09:06:11.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2da6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aac20 0x5588756605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2da6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aac20 0x5588756605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49522/0 (socket says 172.21.15.173:49522) 2024-04-25T09:06:11.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2da6000640 1 -- 172.21.15.173:0/561502992 learned_addr learned my addr 172.21.15.173:0/561502992 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:11.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2da7400640 1 --2- 172.21.15.173:0/561502992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558875660b20 0x558875660f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2da6a00640 1 --2- 172.21.15.173:0/561502992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588756aa300 0x5588756aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2da6000640 1 -- 172.21.15.173:0/561502992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558875660b20 msgr2=0x558875660f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:11.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2da6000640 1 --2- 172.21.15.173:0/561502992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558875660b20 0x558875660f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2da6000640 1 -- 172.21.15.173:0/561502992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588756aa300 msgr2=0x5588756aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:11.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2da6000640 1 --2- 172.21.15.173:0/561502992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588756aa300 0x5588756aa6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2da6000640 1 -- 172.21.15.173:0/561502992 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55887546c750 con 0x5588756aac20 2024-04-25T09:06:11.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2da7400640 1 --2- 172.21.15.173:0/561502992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558875660b20 0x558875660f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:11.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2da6a00640 1 --2- 172.21.15.173:0/561502992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588756aa300 0x5588756aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:11.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2da6000640 1 --2- 172.21.15.173:0/561502992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aac20 0x5588756605e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2d940ae040 tx=0x7f2d940a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a3e8bad97b05ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2d93400640 1 -- 172.21.15.173:0/561502992 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d940c6070 con 0x5588756aac20 2024-04-25T09:06:11.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2d93400640 1 -- 172.21.15.173:0/561502992 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d940b6620 con 0x5588756aac20 2024-04-25T09:06:11.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2d93400640 1 -- 172.21.15.173:0/561502992 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d940b0040 con 0x5588756aac20 2024-04-25T09:06:11.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2db0d4d000 1 -- 172.21.15.173:0/561502992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aac20 msgr2=0x5588756605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/561502992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aac20 0x5588756605e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2d940ae040 tx=0x7f2d940a6000 comp rx=0 tx=0).stop 2024-04-25T09:06:11.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2db0d4d000 1 -- 172.21.15.173:0/561502992 shutdown_connections 2024-04-25T09:06:11.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/561502992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558875660b20 0x558875660f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/561502992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aac20 0x5588756605e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/561502992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588756aa300 0x5588756aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2db0d4d000 1 -- 172.21.15.173:0/561502992 >> 172.21.15.173:0/561502992 conn(0x5588756586c0 msgr2=0x55887565aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:11.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2db0d4d000 1 -- 172.21.15.173:0/561502992 shutdown_connections 2024-04-25T09:06:11.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2db0d4d000 1 -- 172.21.15.173:0/561502992 wait complete. 2024-04-25T09:06:11.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2db0d4d000 1 -- start start 2024-04-25T09:06:11.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.606+0000 7f2db0d4d000 1 Processor -- start 2024-04-25T09:06:11.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558875660b20 0x5588756b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 0x5588756b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5588756aac20 0x55887568e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558875465bf0 con 0x5588756aa300 2024-04-25T09:06:11.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558875566c50 con 0x558875660b20 2024-04-25T09:06:11.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588754aa0c0 con 0x5588756aac20 2024-04-25T09:06:11.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 10 client.0 _ll_register_callbacks cb 0x558875647790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:11.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2da6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 0x5588756b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2da6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 0x5588756b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49534/0 (socket says 172.21.15.173:49534) 2024-04-25T09:06:11.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2da6000640 1 -- 172.21.15.173:0/919187102 learned_addr learned my addr 172.21.15.173:0/919187102 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:11.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2da6a00640 1 --2- 172.21.15.173:0/919187102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558875660b20 0x5588756b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2da7400640 1 --2- 172.21.15.173:0/919187102 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5588756aac20 0x55887568e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2da6000640 1 -- 172.21.15.173:0/919187102 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5588756aac20 msgr2=0x55887568e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:11.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2da6000640 1 --2- 172.21.15.173:0/919187102 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5588756aac20 0x55887568e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2da6000640 1 -- 172.21.15.173:0/919187102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558875660b20 msgr2=0x5588756b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:11.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2da6000640 1 --2- 172.21.15.173:0/919187102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558875660b20 0x5588756b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2da6000640 1 -- 172.21.15.173:0/919187102 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55887544d640 con 0x5588756aa300 2024-04-25T09:06:11.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2da6000640 1 --2- 172.21.15.173:0/919187102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 0x5588756b1ba0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2d940ae040 tx=0x7f2d9401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35166c9cd2107623 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2d87e00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:11.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2d87e00640 1 -- 172.21.15.173:0/919187102 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d940ce020 con 0x5588756aa300 2024-04-25T09:06:11.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2d87e00640 1 -- 172.21.15.173:0/919187102 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2d940ab520 con 0x5588756aa300 2024-04-25T09:06:11.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 1 -- 172.21.15.173:0/919187102 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d940b6620 con 0x5588756aa300 2024-04-25T09:06:11.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2d87e00640 1 -- 172.21.15.173:0/919187102 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d940d8050 con 0x5588756aa300 2024-04-25T09:06:11.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 10 client.6096 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:11.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 1 -- 172.21.15.173:0/919187102 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x558875433480 con 0x5588756aa300 2024-04-25T09:06:11.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2d87e00640 1 -- 172.21.15.173:0/919187102 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d940b6620 con 0x5588756aa300 2024-04-25T09:06:11.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2d87e00640 1 -- 172.21.15.173:0/919187102 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2d940db020 con 0x5588756aa300 2024-04-25T09:06:11.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 10 client.6096 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:11.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 10 client.6096 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:11.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 20 client.6096 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:11.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/919187102 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55887568ef10 0x55887568f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 4 client.6096 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:11.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 1 -- 172.21.15.173:0/919187102 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558875446bb0 con 0x55887568ef10 2024-04-25T09:06:11.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2da6a00640 1 --2- 172.21.15.173:0/919187102 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55887568ef10 0x55887568f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2da6a00640 1 --2- 172.21.15.173:0/919187102 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55887568ef10 0x55887568f320 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b4bc3be6911d0b0 server_cookie=381c48acb15e45dd in_seq=0 out_seq=0 2024-04-25T09:06:11.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2d87e00640 10 client.6096 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:11.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2d87e00640 1 -- 172.21.15.173:0/919187102 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558875446bb0 con 0x55887568ef10 2024-04-25T09:06:11.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2d87e00640 10 client.6096 handle_command_reply: tid=0 2024-04-25T09:06:11.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 1 client.6096 shutdown 2024-04-25T09:06:11.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 1 -- 172.21.15.173:0/919187102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 msgr2=0x5588756b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.610+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/919187102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 0x5588756b1ba0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2d940ae040 tx=0x7f2d9401ac40 comp rx=0 tx=0).stop 2024-04-25T09:06:11.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.614+0000 7f2db0d4d000 1 -- 172.21.15.173:0/919187102 shutdown_connections 2024-04-25T09:06:11.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.614+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/919187102 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55887568ef10 0x55887568f320 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.614+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/919187102 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5588756aac20 0x55887568e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.614+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/919187102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 0x5588756b1ba0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.614+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/919187102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558875660b20 0x5588756b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.614+0000 7f2d87e00640 0 client.6096 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:11.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.614+0000 7f2db0d4d000 1 -- 172.21.15.173:0/919187102 >> 172.21.15.173:0/919187102 conn(0x5588756586c0 msgr2=0x558875661790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:11.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.614+0000 7f2db0d4d000 1 -- 172.21.15.173:0/919187102 shutdown_connections 2024-04-25T09:06:11.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.614+0000 7f2db0d4d000 1 -- 172.21.15.173:0/919187102 wait complete. 2024-04-25T09:06:11.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.614+0000 7f2db0d4d000 20 client.6096 trim_cache size 0 max 16384 2024-04-25T09:06:11.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 Processor -- start 2024-04-25T09:06:11.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 -- start start 2024-04-25T09:06:11.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558875660b20 0x55887568e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 0x558875689260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5588756aac20 0x558875660f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da81fedf0 con 0x5588756aa300 2024-04-25T09:06:11.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80ceb00 con 0x558875660b20 2024-04-25T09:06:11.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da813f8c0 con 0x5588756aac20 2024-04-25T09:06:11.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2da6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 0x558875689260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2da6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 0x558875689260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49546/0 (socket says 172.21.15.173:49546) 2024-04-25T09:06:11.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2da6000640 1 -- 172.21.15.173:0/64744580 learned_addr learned my addr 172.21.15.173:0/64744580 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:11.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2da6000640 1 -- 172.21.15.173:0/64744580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5588756aac20 msgr2=0x558875660f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:11.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2da6000640 1 --2- 172.21.15.173:0/64744580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5588756aac20 0x558875660f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2da6000640 1 -- 172.21.15.173:0/64744580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558875660b20 msgr2=0x55887568e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:11.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2da6000640 1 --2- 172.21.15.173:0/64744580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558875660b20 0x55887568e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2da6000640 1 -- 172.21.15.173:0/64744580 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588756aa130 con 0x5588756aa300 2024-04-25T09:06:11.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2da6000640 1 --2- 172.21.15.173:0/64744580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 0x558875689260 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2d9401ac80 tx=0x7f2d940c8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15726f75c24ad24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2d92a00640 1 -- 172.21.15.173:0/64744580 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d940e1070 con 0x5588756aa300 2024-04-25T09:06:11.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2d92a00640 1 -- 172.21.15.173:0/64744580 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d940b6420 con 0x5588756aa300 2024-04-25T09:06:11.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2d92a00640 1 -- 172.21.15.173:0/64744580 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d940ce070 con 0x5588756aa300 2024-04-25T09:06:11.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 -- 172.21.15.173:0/64744580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 msgr2=0x558875689260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/64744580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 0x558875689260 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2d9401ac80 tx=0x7f2d940c8000 comp rx=0 tx=0).stop 2024-04-25T09:06:11.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 -- 172.21.15.173:0/64744580 shutdown_connections 2024-04-25T09:06:11.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/64744580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5588756aac20 0x558875660f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/64744580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 0x558875689260 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/64744580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558875660b20 0x55887568e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 -- 172.21.15.173:0/64744580 >> 172.21.15.173:0/64744580 conn(0x5588756586c0 msgr2=0x558875688b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:11.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 -- 172.21.15.173:0/64744580 shutdown_connections 2024-04-25T09:06:11.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 -- 172.21.15.173:0/64744580 wait complete. 2024-04-25T09:06:11.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 -- start start 2024-04-25T09:06:11.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 Processor -- start 2024-04-25T09:06:11.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558875660b20 0x55887570bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 0x55887570c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588756aac20 0x5588756ae060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558875566c50 con 0x5588756aa300 2024-04-25T09:06:11.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80ce500 con 0x5588756aac20 2024-04-25T09:06:11.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x558875665200 con 0x558875660b20 2024-04-25T09:06:11.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2db0d4d000 10 client.0 _ll_register_callbacks cb 0x7f2d940ae070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:11.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2da6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 0x55887570c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2da6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 0x55887570c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49558/0 (socket says 172.21.15.173:49558) 2024-04-25T09:06:11.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.630+0000 7f2da6000640 1 -- 172.21.15.173:0/1401893639 learned_addr learned my addr 172.21.15.173:0/1401893639 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:11.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2da7400640 1 --2- 172.21.15.173:0/1401893639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588756aac20 0x5588756ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2da6a00640 1 --2- 172.21.15.173:0/1401893639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558875660b20 0x55887570bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2da6000640 1 -- 172.21.15.173:0/1401893639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558875660b20 msgr2=0x55887570bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:11.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2da6000640 1 --2- 172.21.15.173:0/1401893639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558875660b20 0x55887570bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2da6000640 1 -- 172.21.15.173:0/1401893639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588756aac20 msgr2=0x5588756ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:11.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2da6000640 1 --2- 172.21.15.173:0/1401893639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588756aac20 0x5588756ae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2da6000640 1 -- 172.21.15.173:0/1401893639 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55887552cef0 con 0x5588756aa300 2024-04-25T09:06:11.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2da6000640 1 --2- 172.21.15.173:0/1401893639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 0x55887570c1c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009210 tx=0x7f2d940b8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d934e6f7db7f1afa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2d87e00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:11.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2d87e00640 1 -- 172.21.15.173:0/1401893639 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d940e1070 con 0x5588756aa300 2024-04-25T09:06:11.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2d87e00640 1 -- 172.21.15.173:0/1401893639 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2d940ab520 con 0x5588756aa300 2024-04-25T09:06:11.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 1 -- 172.21.15.173:0/1401893639 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d940b6420 con 0x5588756aa300 2024-04-25T09:06:11.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2d87e00640 1 -- 172.21.15.173:0/1401893639 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d940ce040 con 0x5588756aa300 2024-04-25T09:06:11.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 10 client.6102 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:11.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 1 -- 172.21.15.173:0/1401893639 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55887546a9a0 con 0x5588756aa300 2024-04-25T09:06:11.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2d87e00640 1 -- 172.21.15.173:0/1401893639 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d940b6420 con 0x5588756aa300 2024-04-25T09:06:11.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2d87e00640 1 -- 172.21.15.173:0/1401893639 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2d940db040 con 0x5588756aa300 2024-04-25T09:06:11.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 10 client.6102 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:11.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 10 client.6102 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:11.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 20 client.6102 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:11.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/1401893639 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5588756ae5a0 0x5588756ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 4 client.6102 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-04-25T09:06:11.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 1 -- 172.21.15.173:0/1401893639 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) v1 -- 0x55887545a080 con 0x5588756ae5a0 2024-04-25T09:06:11.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2da6a00640 1 --2- 172.21.15.173:0/1401893639 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5588756ae5a0 0x5588756ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2da6a00640 1 --2- 172.21.15.173:0/1401893639 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5588756ae5a0 0x5588756ae9b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9570008302a593b2 server_cookie=af963e30a3438cd1 in_seq=0 out_seq=0 2024-04-25T09:06:11.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2d87e00640 10 client.6102 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:11.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2d87e00640 1 -- 172.21.15.173:0/1401893639 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55887545a080 con 0x5588756ae5a0 2024-04-25T09:06:11.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2d87e00640 10 client.6102 handle_command_reply: tid=0 2024-04-25T09:06:11.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 1 client.6102 shutdown 2024-04-25T09:06:11.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 1 -- 172.21.15.173:0/1401893639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 msgr2=0x55887570c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/1401893639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 0x55887570c1c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009210 tx=0x7f2d940b8040 comp rx=0 tx=0).stop 2024-04-25T09:06:11.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 1 -- 172.21.15.173:0/1401893639 shutdown_connections 2024-04-25T09:06:11.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/1401893639 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5588756ae5a0 0x5588756ae9b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/1401893639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588756aac20 0x5588756ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/1401893639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5588756aa300 0x55887570c1c0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 1 --2- 172.21.15.173:0/1401893639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558875660b20 0x55887570bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 1 -- 172.21.15.173:0/1401893639 >> 172.21.15.173:0/1401893639 conn(0x5588756586c0 msgr2=0x5588756893e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:11.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2d87e00640 0 client.6102 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:11.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 1 -- 172.21.15.173:0/1401893639 shutdown_connections 2024-04-25T09:06:11.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 1 -- 172.21.15.173:0/1401893639 wait complete. 2024-04-25T09:06:11.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2db0d4d000 20 client.6102 trim_cache size 0 max 16384 2024-04-25T09:06:11.631 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:11.631 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0, 2024-04-25T09:06:11.632 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_tag": "49953bd4-1e9e-4178-9cf1-75baace3c1e5", 2024-04-25T09:06:11.632 INFO:teuthology.orchestra.run.smithi173.stdout: "mode": "asynchronous" 2024-04-25T09:06:11.632 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:11.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2dad800640 1 -- 172.21.15.173:0/2655698652 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2d88066f90 msgr2=0x7f2d88069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2dad800640 1 --2- 172.21.15.173:0/2655698652 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2d88066f90 0x7f2d88069450 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2d940ad000 tx=0x7f2d94008040 comp rx=0 tx=0).stop 2024-04-25T09:06:11.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2dad800640 1 -- 172.21.15.173:0/2655698652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2da80b3fe0 msgr2=0x7f2da81595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2dad800640 1 --2- 172.21.15.173:0/2655698652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2da80b3fe0 0x7f2da81595a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2d98007f20 tx=0x7f2d9800d560 comp rx=0 tx=0).stop 2024-04-25T09:06:11.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2dad800640 1 -- 172.21.15.173:0/2655698652 shutdown_connections 2024-04-25T09:06:11.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2dad800640 1 --2- 172.21.15.173:0/2655698652 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2d88066f90 0x7f2d88069450 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2dad800640 1 --2- 172.21.15.173:0/2655698652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2da8145290 0x7f2da8143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2dad800640 1 --2- 172.21.15.173:0/2655698652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2da80cc260 0x7f2da815aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2dad800640 1 --2- 172.21.15.173:0/2655698652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2da80b3fe0 0x7f2da81595a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2dad800640 1 -- 172.21.15.173:0/2655698652 >> 172.21.15.173:0/2655698652 conn(0x7f2da806ac90 msgr2=0x7f2da80b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:11.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.634+0000 7f2dad800640 1 -- 172.21.15.173:0/2655698652 shutdown_connections 2024-04-25T09:06:11.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.638+0000 7f2dad800640 1 -- 172.21.15.173:0/2655698652 wait complete. 2024-04-25T09:06:11.646 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': '49953bd4-1e9e-4178-9cf1-75baace3c1e5', 'mode': 'asynchronous'}' 2024-04-25T09:06:11.646 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-04-25T09:06:11.646 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-04-25T09:06:11.647 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:11.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa844400640 1 Processor -- start 2024-04-25T09:06:11.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa844400640 1 -- start start 2024-04-25T09:06:11.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa844400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa83c0b3e70 0x7fa83c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa844400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa83c15edd0 0x7fa83c0b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa844400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83c0b4790 con 0x7fa83c0aefa0 2024-04-25T09:06:11.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa844400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83c06dd50 con 0x7fa83c15edd0 2024-04-25T09:06:11.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa844400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c15f320 con 0x7fa83c0b3e70 2024-04-25T09:06:11.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa841000640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa83c0aefa0 0x7fa83c0b2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:41580/0 (socket says 172.21.15.173:41580) 2024-04-25T09:06:11.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa841000640 1 -- 172.21.15.173:0/3849184964 learned_addr learned my addr 172.21.15.173:0/3849184964 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:11.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa842400640 1 --2- 172.21.15.173:0/3849184964 >> v2:172.21.15.194:3300/0 conn(0x7fa83c15edd0 0x7fa83c0b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa841a00640 1 --2- 172.21.15.173:0/3849184964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa83c0b3e70 0x7fa83c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa83be00640 1 -- 172.21.15.173:0/3849184964 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487990450 0 0) 0x7fa83c0b4790 con 0x7fa83c0aefa0 2024-04-25T09:06:11.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa842400640 1 -- 172.21.15.173:0/3849184964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa83c0b3e70 msgr2=0x7fa83c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:11.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa842400640 1 --2- 172.21.15.173:0/3849184964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa83c0b3e70 0x7fa83c0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa842400640 1 -- 172.21.15.173:0/3849184964 >> v1:172.21.15.194:6789/0 conn(0x7fa83c0aefa0 legacy=0x7fa83c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa842400640 1 -- 172.21.15.173:0/3849184964 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c06d420 con 0x7fa83c15edd0 2024-04-25T09:06:11.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa842400640 1 --2- 172.21.15.173:0/3849184964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa83c15edd0 0x7fa83c0b2e80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa834009d90 tx=0x7fa83401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff3907f0f5907698 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa83be00640 1 -- 172.21.15.173:0/3849184964 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8340b2070 con 0x7fa83c15edd0 2024-04-25T09:06:11.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa83be00640 1 -- 172.21.15.173:0/3849184964 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8340a5a20 con 0x7fa83c15edd0 2024-04-25T09:06:11.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa83be00640 1 -- 172.21.15.173:0/3849184964 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8340a5df0 con 0x7fa83c15edd0 2024-04-25T09:06:11.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa844400640 1 -- 172.21.15.173:0/3849184964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa83c15edd0 msgr2=0x7fa83c0b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.794+0000 7fa844400640 1 --2- 172.21.15.173:0/3849184964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa83c15edd0 0x7fa83c0b2e80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa834009d90 tx=0x7fa83401c940 comp rx=0 tx=0).stop 2024-04-25T09:06:11.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa844400640 1 -- 172.21.15.173:0/3849184964 shutdown_connections 2024-04-25T09:06:11.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa844400640 1 --2- 172.21.15.173:0/3849184964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa83c15edd0 0x7fa83c0b2e80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa844400640 1 --2- 172.21.15.173:0/3849184964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa83c0b3e70 0x7fa83c0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa844400640 1 -- 172.21.15.173:0/3849184964 >> 172.21.15.173:0/3849184964 conn(0x7fa83c06ac90 msgr2=0x7fa83c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:11.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa844400640 1 -- 172.21.15.173:0/3849184964 shutdown_connections 2024-04-25T09:06:11.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa844400640 1 -- 172.21.15.173:0/3849184964 wait complete. 2024-04-25T09:06:11.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa844400640 1 Processor -- start 2024-04-25T09:06:11.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa844400640 1 -- start start 2024-04-25T09:06:11.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa844400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa83c0aefa0 0x7fa83c150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa844400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa83c0b3e70 0x7fa83c151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa844400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa83c15edd0 0x7fa83c0b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa844400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c06e1c0 con 0x7fa83c15edd0 2024-04-25T09:06:11.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa844400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c15aba0 con 0x7fa83c0b3e70 2024-04-25T09:06:11.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa844400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c06e340 con 0x7fa83c0aefa0 2024-04-25T09:06:11.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa842400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa83c15edd0 0x7fa83c0b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa842400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa83c15edd0 0x7fa83c0b2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49564/0 (socket says 172.21.15.173:49564) 2024-04-25T09:06:11.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa842400640 1 -- 172.21.15.173:0/1288144083 learned_addr learned my addr 172.21.15.173:0/1288144083 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:11.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa841a00640 1 --2- 172.21.15.173:0/1288144083 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa83c0aefa0 0x7fa83c150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa841000640 1 --2- 172.21.15.173:0/1288144083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa83c0b3e70 0x7fa83c151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa842400640 1 -- 172.21.15.173:0/1288144083 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa83c0aefa0 msgr2=0x7fa83c150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa842400640 1 --2- 172.21.15.173:0/1288144083 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa83c0aefa0 0x7fa83c150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa842400640 1 -- 172.21.15.173:0/1288144083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa83c0b3e70 msgr2=0x7fa83c151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa842400640 1 --2- 172.21.15.173:0/1288144083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa83c0b3e70 0x7fa83c151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa842400640 1 -- 172.21.15.173:0/1288144083 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c156e50 con 0x7fa83c15edd0 2024-04-25T09:06:11.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.798+0000 7fa842400640 1 --2- 172.21.15.173:0/1288144083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa83c15edd0 0x7fa83c0b2dc0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa8340b0040 tx=0x7fa8340196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.802+0000 7fa839600640 1 -- 172.21.15.173:0/1288144083 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8340bd020 con 0x7fa83c15edd0 2024-04-25T09:06:11.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.802+0000 7fa839600640 1 -- 172.21.15.173:0/1288144083 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8340b3040 con 0x7fa83c15edd0 2024-04-25T09:06:11.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.802+0000 7fa839600640 1 -- 172.21.15.173:0/1288144083 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8340b2050 con 0x7fa83c15edd0 2024-04-25T09:06:11.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.802+0000 7fa844400640 1 -- 172.21.15.173:0/1288144083 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83c0b1830 con 0x7fa83c15edd0 2024-04-25T09:06:11.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.802+0000 7fa844400640 1 -- 172.21.15.173:0/1288144083 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83c0b1df0 con 0x7fa83c15edd0 2024-04-25T09:06:11.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.802+0000 7fa844400640 1 -- 172.21.15.173:0/1288144083 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83c073a40 con 0x7fa83c15edd0 2024-04-25T09:06:11.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.802+0000 7fa839600640 1 -- 172.21.15.173:0/1288144083 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa8340ad650 con 0x7fa83c15edd0 2024-04-25T09:06:11.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.802+0000 7fa839600640 1 --2- 172.21.15.173:0/1288144083 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa81c066f60 0x7fa81c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.802+0000 7fa839600640 1 -- 172.21.15.173:0/1288144083 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa83411f9e0 con 0x7fa83c15edd0 2024-04-25T09:06:11.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.802+0000 7fa841a00640 1 --2- 172.21.15.173:0/1288144083 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa81c066f60 0x7fa81c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.802+0000 7fa841a00640 1 --2- 172.21.15.173:0/1288144083 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa81c066f60 0x7fa81c069420 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa830009ac0 tx=0x7fa830009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.806+0000 7fa839600640 1 -- 172.21.15.173:0/1288144083 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa83c156e50 con 0x7fa83c15edd0 2024-04-25T09:06:11.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.990+0000 7fa844400640 1 -- 172.21.15.173:0/1288144083 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa83c0cbe10 con 0x7fa83c15edd0 2024-04-25T09:06:11.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.994+0000 7fa839600640 1 -- 172.21.15.173:0/1288144083 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4950 (secure 0 0 0) 0x7fa834016560 con 0x7fa83c15edd0 2024-04-25T09:06:11.986 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:11.986 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:05:57.598642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:11.986 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 26 2024-04-25T09:06:11.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.994+0000 7fa844400640 1 -- 172.21.15.173:0/1288144083 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa81c066f60 msgr2=0x7fa81c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.994+0000 7fa844400640 1 --2- 172.21.15.173:0/1288144083 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa81c066f60 0x7fa81c069420 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa830009ac0 tx=0x7fa830009190 comp rx=0 tx=0).stop 2024-04-25T09:06:11.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.994+0000 7fa844400640 1 -- 172.21.15.173:0/1288144083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa83c15edd0 msgr2=0x7fa83c0b2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.994+0000 7fa844400640 1 --2- 172.21.15.173:0/1288144083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa83c15edd0 0x7fa83c0b2dc0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa8340b0040 tx=0x7fa8340196e0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.994+0000 7fa844400640 1 -- 172.21.15.173:0/1288144083 shutdown_connections 2024-04-25T09:06:11.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.994+0000 7fa844400640 1 --2- 172.21.15.173:0/1288144083 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa81c066f60 0x7fa81c069420 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.994+0000 7fa844400640 1 --2- 172.21.15.173:0/1288144083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa83c15edd0 0x7fa83c0b2dc0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.994+0000 7fa844400640 1 --2- 172.21.15.173:0/1288144083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa83c0b3e70 0x7fa83c151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.994+0000 7fa844400640 1 --2- 172.21.15.173:0/1288144083 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa83c0aefa0 0x7fa83c150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.994+0000 7fa844400640 1 -- 172.21.15.173:0/1288144083 >> 172.21.15.173:0/1288144083 conn(0x7fa83c06ac90 msgr2=0x7fa83c152f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:11.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.994+0000 7fa844400640 1 -- 172.21.15.173:0/1288144083 shutdown_connections 2024-04-25T09:06:11.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:11.994+0000 7fa844400640 1 -- 172.21.15.173:0/1288144083 wait complete. 2024-04-25T09:06:12.006 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-04-25T09:06:12.148 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:12.148 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0 2024-04-25T09:06:12.148 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:12.163 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T09:06:12.164 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-04-25T09:06:12.164 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:06:12.164 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-04-25T09:06:12.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.314+0000 7faf25600640 1 Processor -- start 2024-04-25T09:06:12.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.314+0000 7faf25600640 1 -- start start 2024-04-25T09:06:12.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.314+0000 7faf25600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf200b5050 0x7faf2015fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.314+0000 7faf25600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2015f3c0 con 0x7faf2015efe0 2024-04-25T09:06:12.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.314+0000 7faf25600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf200af730 con 0x7faf2006b120 2024-04-25T09:06:12.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.314+0000 7faf25600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2006ac90 con 0x7faf200b5050 2024-04-25T09:06:12.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.314+0000 7faf1ea00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7faf2015efe0 0x7faf2015f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47644/0 (socket says 172.21.15.173:47644) 2024-04-25T09:06:12.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.314+0000 7faf1ea00640 1 -- 172.21.15.173:0/2521629789 learned_addr learned my addr 172.21.15.173:0/2521629789 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:12.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.314+0000 7faf1e000640 1 --2- 172.21.15.173:0/2521629789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf200b5050 0x7faf2015fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.314+0000 7faf1d600640 1 -- 172.21.15.173:0/2521629789 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611070291 0 0) 0x7faf2015f3c0 con 0x7faf2015efe0 2024-04-25T09:06:12.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.314+0000 7faf1d600640 1 -- 172.21.15.173:0/2521629789 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf04003530 con 0x7faf2015efe0 2024-04-25T09:06:12.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.314+0000 7faf1d600640 1 -- 172.21.15.173:0/2521629789 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191499746 0 0) 0x7faf200af730 con 0x7faf2006b120 2024-04-25T09:06:12.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.314+0000 7faf1d600640 1 -- 172.21.15.173:0/2521629789 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf2015f3c0 con 0x7faf2006b120 2024-04-25T09:06:12.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.314+0000 7faf1d600640 1 -- 172.21.15.173:0/2521629789 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2514018900 0 0) 0x7faf04003530 con 0x7faf2015efe0 2024-04-25T09:06:12.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.314+0000 7faf1e000640 1 -- 172.21.15.173:0/2521629789 >> v1:172.21.15.194:6789/0 conn(0x7faf2006b120 legacy=0x7faf2006b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.314+0000 7faf1e000640 1 -- 172.21.15.173:0/2521629789 >> v1:172.21.15.173:6789/0 conn(0x7faf2015efe0 legacy=0x7faf2015f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.314+0000 7faf1e000640 1 -- 172.21.15.173:0/2521629789 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf200ad9d0 con 0x7faf200b5050 2024-04-25T09:06:12.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.318+0000 7faf1e000640 1 --2- 172.21.15.173:0/2521629789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf200b5050 0x7faf2015fd10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0097f0 tx=0x7faf0c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ca07e0c66e53421 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.318+0000 7faf1d600640 1 -- 172.21.15.173:0/2521629789 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0b0070 con 0x7faf200b5050 2024-04-25T09:06:12.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.318+0000 7faf1d600640 1 -- 172.21.15.173:0/2521629789 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c0ab400 con 0x7faf200b5050 2024-04-25T09:06:12.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.318+0000 7faf1d600640 1 -- 172.21.15.173:0/2521629789 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf10001680 con 0x7faf200b5050 2024-04-25T09:06:12.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.318+0000 7faf25600640 1 -- 172.21.15.173:0/2521629789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf200b5050 msgr2=0x7faf2015fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.318+0000 7faf25600640 1 --2- 172.21.15.173:0/2521629789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf200b5050 0x7faf2015fd10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0097f0 tx=0x7faf0c01c400 comp rx=0 tx=0).stop 2024-04-25T09:06:12.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.318+0000 7faf25600640 1 -- 172.21.15.173:0/2521629789 shutdown_connections 2024-04-25T09:06:12.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.318+0000 7faf25600640 1 --2- 172.21.15.173:0/2521629789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf200b5050 0x7faf2015fd10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.318+0000 7faf25600640 1 -- 172.21.15.173:0/2521629789 >> 172.21.15.173:0/2521629789 conn(0x7faf200cfed0 msgr2=0x7faf200d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.318+0000 7faf25600640 1 -- 172.21.15.173:0/2521629789 shutdown_connections 2024-04-25T09:06:12.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.318+0000 7faf25600640 1 -- 172.21.15.173:0/2521629789 wait complete. 2024-04-25T09:06:12.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf25600640 1 Processor -- start 2024-04-25T09:06:12.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf25600640 1 -- start start 2024-04-25T09:06:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf25600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf2006b120 0x7faf2014e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf25600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf200b5050 0x7faf2014cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf25600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf2015efe0 0x7faf2014bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf25600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf20169b30 con 0x7faf200b5050 2024-04-25T09:06:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf25600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf201699b0 con 0x7faf2015efe0 2024-04-25T09:06:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf25600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf20169cb0 con 0x7faf2006b120 2024-04-25T09:06:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf1e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf200b5050 0x7faf2014cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf1e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf200b5050 0x7faf2014cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49572/0 (socket says 172.21.15.173:49572) 2024-04-25T09:06:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf1e000640 1 -- 172.21.15.173:0/180933020 learned_addr learned my addr 172.21.15.173:0/180933020 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf1f400640 1 --2- 172.21.15.173:0/180933020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf2015efe0 0x7faf2014bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf1ea00640 1 --2- 172.21.15.173:0/180933020 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf2006b120 0x7faf2014e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf1e000640 1 -- 172.21.15.173:0/180933020 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf2006b120 msgr2=0x7faf2014e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf1e000640 1 --2- 172.21.15.173:0/180933020 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf2006b120 0x7faf2014e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf1e000640 1 -- 172.21.15.173:0/180933020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf2015efe0 msgr2=0x7faf2014bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf1e000640 1 --2- 172.21.15.173:0/180933020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf2015efe0 0x7faf2014bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf1e000640 1 -- 172.21.15.173:0/180933020 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2014eb90 con 0x7faf200b5050 2024-04-25T09:06:12.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf1e000640 1 --2- 172.21.15.173:0/180933020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf200b5050 0x7faf2014cba0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0097f0 tx=0x7faf0c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf16a00640 1 -- 172.21.15.173:0/180933020 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0bb020 con 0x7faf200b5050 2024-04-25T09:06:12.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf16a00640 1 -- 172.21.15.173:0/180933020 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c0b1040 con 0x7faf200b5050 2024-04-25T09:06:12.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf25600640 1 -- 172.21.15.173:0/180933020 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2014ee70 con 0x7faf200b5050 2024-04-25T09:06:12.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf16a00640 1 -- 172.21.15.173:0/180933020 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0b0050 con 0x7faf200b5050 2024-04-25T09:06:12.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.322+0000 7faf25600640 1 -- 172.21.15.173:0/180933020 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2014f430 con 0x7faf200b5050 2024-04-25T09:06:12.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.326+0000 7faf16a00640 1 -- 172.21.15.173:0/180933020 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faf0c0be070 con 0x7faf200b5050 2024-04-25T09:06:12.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.326+0000 7faf16a00640 1 --2- 172.21.15.173:0/180933020 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf00066f60 0x7faf00069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.326+0000 7faf16a00640 1 -- 172.21.15.173:0/180933020 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faf0c11e640 con 0x7faf200b5050 2024-04-25T09:06:12.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.326+0000 7faf1ea00640 1 --2- 172.21.15.173:0/180933020 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf00066f60 0x7faf00069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.326+0000 7faf28b5a000 1 Processor -- start 2024-04-25T09:06:12.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.326+0000 7faf28b5a000 1 -- start start 2024-04-25T09:06:12.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.326+0000 7faf1ea00640 1 --2- 172.21.15.173:0/180933020 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf00066f60 0x7faf00069420 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faf10001000 tx=0x7faf10001700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.326+0000 7faf28b5a000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d43b9200 0x5558d43b95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.326+0000 7faf28b5a000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d43b9b20 0x5558d439da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.326+0000 7faf28b5a000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d439df60 0x5558d439e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.326+0000 7faf28b5a000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d42564a0 con 0x5558d439df60 2024-04-25T09:06:12.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.326+0000 7faf28b5a000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d41be210 con 0x5558d43b9b20 2024-04-25T09:06:12.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.326+0000 7faf28b5a000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558d4146980 con 0x5558d43b9200 2024-04-25T09:06:12.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.326+0000 7faf1f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d439df60 0x5558d439e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.326+0000 7faf1f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d439df60 0x5558d439e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49582/0 (socket says 172.21.15.173:49582) 2024-04-25T09:06:12.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.326+0000 7faf1f400640 1 -- 172.21.15.173:0/2769931046 learned_addr learned my addr 172.21.15.173:0/2769931046 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:12.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.326+0000 7faf1e000640 1 --2- 172.21.15.173:0/2769931046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d43b9b20 0x5558d439da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.326+0000 7faf1ea00640 1 --2- 172.21.15.173:0/2769931046 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d43b9200 0x5558d43b95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf1f400640 1 -- 172.21.15.173:0/2769931046 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d43b9200 msgr2=0x5558d43b95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:12.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf1f400640 1 --2- 172.21.15.173:0/2769931046 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d43b9200 0x5558d43b95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf1f400640 1 -- 172.21.15.173:0/2769931046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d43b9b20 msgr2=0x5558d439da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:12.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf1f400640 1 --2- 172.21.15.173:0/2769931046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d43b9b20 0x5558d439da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf1f400640 1 -- 172.21.15.173:0/2769931046 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558d41b9200 con 0x5558d439df60 2024-04-25T09:06:12.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf1f400640 1 --2- 172.21.15.173:0/2769931046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d439df60 0x5558d439e340 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7faf18001ec0 tx=0x7faf18001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994ac56492a1e555 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf0b400640 1 -- 172.21.15.173:0/2769931046 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf180020d0 con 0x5558d439df60 2024-04-25T09:06:12.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf0b400640 1 -- 172.21.15.173:0/2769931046 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf18018070 con 0x5558d439df60 2024-04-25T09:06:12.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf0b400640 1 -- 172.21.15.173:0/2769931046 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18003bc0 con 0x5558d439df60 2024-04-25T09:06:12.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf28b5a000 1 -- 172.21.15.173:0/2769931046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d439df60 msgr2=0x5558d439e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf28b5a000 1 --2- 172.21.15.173:0/2769931046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d439df60 0x5558d439e340 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7faf18001ec0 tx=0x7faf18001640 comp rx=0 tx=0).stop 2024-04-25T09:06:12.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf28b5a000 1 -- 172.21.15.173:0/2769931046 shutdown_connections 2024-04-25T09:06:12.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf28b5a000 1 --2- 172.21.15.173:0/2769931046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d439df60 0x5558d439e340 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf28b5a000 1 --2- 172.21.15.173:0/2769931046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d43b9b20 0x5558d439da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf28b5a000 1 --2- 172.21.15.173:0/2769931046 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d43b9200 0x5558d43b95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf28b5a000 1 -- 172.21.15.173:0/2769931046 >> 172.21.15.173:0/2769931046 conn(0x5558d43664f0 msgr2=0x5558d4375a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf28b5a000 1 -- 172.21.15.173:0/2769931046 shutdown_connections 2024-04-25T09:06:12.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf28b5a000 1 -- 172.21.15.173:0/2769931046 wait complete. 2024-04-25T09:06:12.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf28b5a000 1 -- start start 2024-04-25T09:06:12.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf28b5a000 1 Processor -- start 2024-04-25T09:06:12.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf28b5a000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d439df60 0x5558d43c0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf28b5a000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 0x5558d43c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf28b5a000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d43b9b20 0x5558d439e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf28b5a000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d4178d80 con 0x5558d43b9200 2024-04-25T09:06:12.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf28b5a000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d41ba2b0 con 0x5558d439df60 2024-04-25T09:06:12.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf28b5a000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558d417f830 con 0x5558d43b9b20 2024-04-25T09:06:12.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf28b5a000 10 client.0 _ll_register_callbacks cb 0x5558d4271070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:12.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf1e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 0x5558d43c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf1e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 0x5558d43c0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49596/0 (socket says 172.21.15.173:49596) 2024-04-25T09:06:12.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf1e000640 1 -- 172.21.15.173:0/1916373387 learned_addr learned my addr 172.21.15.173:0/1916373387 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:12.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf1ea00640 1 --2- 172.21.15.173:0/1916373387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d439df60 0x5558d43c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf1f400640 1 --2- 172.21.15.173:0/1916373387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d43b9b20 0x5558d439e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf1e000640 1 -- 172.21.15.173:0/1916373387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d43b9b20 msgr2=0x5558d439e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:12.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf1e000640 1 --2- 172.21.15.173:0/1916373387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d43b9b20 0x5558d439e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf1e000640 1 -- 172.21.15.173:0/1916373387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d439df60 msgr2=0x5558d43c0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:12.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf1e000640 1 --2- 172.21.15.173:0/1916373387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d439df60 0x5558d43c0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf1e000640 1 -- 172.21.15.173:0/1916373387 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558d418a130 con 0x5558d43b9200 2024-04-25T09:06:12.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf1f400640 1 --2- 172.21.15.173:0/1916373387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d43b9b20 0x5558d439e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:12.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.330+0000 7faf1ea00640 1 --2- 172.21.15.173:0/1916373387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d439df60 0x5558d43c0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:12.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf1e000640 1 --2- 172.21.15.173:0/1916373387 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 0x5558d43c0ec0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7faf0c097de0 tx=0x7faf0c0ee760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522aa7fa144ad725 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faeffe00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:12.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faeffe00640 1 -- 172.21.15.173:0/1916373387 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0f2de0 con 0x5558d43b9200 2024-04-25T09:06:12.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faeffe00640 1 -- 172.21.15.173:0/1916373387 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faf0c0f6fa0 con 0x5558d43b9200 2024-04-25T09:06:12.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 1 -- 172.21.15.173:0/1916373387 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf18018070 con 0x5558d43b9200 2024-04-25T09:06:12.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faeffe00640 1 -- 172.21.15.173:0/1916373387 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf0c0f7430 con 0x5558d43b9200 2024-04-25T09:06:12.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 10 client.6117 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:12.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 1 -- 172.21.15.173:0/1916373387 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x5558d423f490 con 0x5558d43b9200 2024-04-25T09:06:12.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faeffe00640 1 -- 172.21.15.173:0/1916373387 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf18018070 con 0x5558d43b9200 2024-04-25T09:06:12.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faeffe00640 1 -- 172.21.15.173:0/1916373387 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7faf0c102ce0 con 0x5558d43b9200 2024-04-25T09:06:12.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 10 client.6117 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:12.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 10 client.6117 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:12.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 20 client.6117 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:12.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 1 --2- 172.21.15.173:0/1916373387 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5558d439f0b0 0x5558d439f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 4 client.6117 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:12.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 1 -- 172.21.15.173:0/1916373387 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5558d415a020 con 0x5558d439f0b0 2024-04-25T09:06:12.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf1ea00640 1 --2- 172.21.15.173:0/1916373387 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5558d439f0b0 0x5558d439f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faeffe00640 10 client.6117 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:12.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf1ea00640 1 --2- 172.21.15.173:0/1916373387 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5558d439f0b0 0x5558d439f490 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b9ddc608368dc70 server_cookie=85ba2744e9e9bc1 in_seq=0 out_seq=0 2024-04-25T09:06:12.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faeffe00640 1 -- 172.21.15.173:0/1916373387 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5558d415a020 con 0x5558d439f0b0 2024-04-25T09:06:12.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faeffe00640 10 client.6117 handle_command_reply: tid=0 2024-04-25T09:06:12.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 1 client.6117 shutdown 2024-04-25T09:06:12.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 1 -- 172.21.15.173:0/1916373387 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 msgr2=0x5558d43c0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 1 --2- 172.21.15.173:0/1916373387 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 0x5558d43c0ec0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7faf0c097de0 tx=0x7faf0c0ee760 comp rx=0 tx=0).stop 2024-04-25T09:06:12.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 1 -- 172.21.15.173:0/1916373387 shutdown_connections 2024-04-25T09:06:12.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 1 --2- 172.21.15.173:0/1916373387 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5558d439f0b0 0x5558d439f490 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 1 --2- 172.21.15.173:0/1916373387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d43b9b20 0x5558d439e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 1 --2- 172.21.15.173:0/1916373387 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 0x5558d43c0ec0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faeffe00640 0 client.6117 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:12.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 1 --2- 172.21.15.173:0/1916373387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d439df60 0x5558d43c0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 1 -- 172.21.15.173:0/1916373387 >> 172.21.15.173:0/1916373387 conn(0x5558d43664f0 msgr2=0x5558d436daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 1 -- 172.21.15.173:0/1916373387 shutdown_connections 2024-04-25T09:06:12.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 1 -- 172.21.15.173:0/1916373387 wait complete. 2024-04-25T09:06:12.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.334+0000 7faf28b5a000 20 client.6117 trim_cache size 0 max 16384 2024-04-25T09:06:12.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 Processor -- start 2024-04-25T09:06:12.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 -- start start 2024-04-25T09:06:12.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d439df60 0x5558d43b8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 0x5558d43b7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d43b9b20 0x5558d43b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf20203210 con 0x5558d43b9200 2024-04-25T09:06:12.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf20202420 con 0x5558d43b9b20 2024-04-25T09:06:12.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf20138060 con 0x5558d439df60 2024-04-25T09:06:12.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 0x5558d43b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 0x5558d43b7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49600/0 (socket says 172.21.15.173:49600) 2024-04-25T09:06:12.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1e000640 1 -- 172.21.15.173:0/2043647638 learned_addr learned my addr 172.21.15.173:0/2043647638 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:12.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1ea00640 1 --2- 172.21.15.173:0/2043647638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d439df60 0x5558d43b8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1f400640 1 --2- 172.21.15.173:0/2043647638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d43b9b20 0x5558d43b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1e000640 1 -- 172.21.15.173:0/2043647638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d439df60 msgr2=0x5558d43b8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:12.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1e000640 1 --2- 172.21.15.173:0/2043647638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d439df60 0x5558d43b8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1e000640 1 -- 172.21.15.173:0/2043647638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d43b9b20 msgr2=0x5558d43b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:12.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1e000640 1 --2- 172.21.15.173:0/2043647638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d43b9b20 0x5558d43b7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1e000640 1 -- 172.21.15.173:0/2043647638 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558d417da30 con 0x5558d43b9200 2024-04-25T09:06:12.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1f400640 1 --2- 172.21.15.173:0/2043647638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d43b9b20 0x5558d43b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:12.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1e000640 1 --2- 172.21.15.173:0/2043647638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 0x5558d43b7550 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009250 tx=0x7faf0c11e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb1685b91b2c4f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf0aa00640 1 -- 172.21.15.173:0/2043647638 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0f2de0 con 0x5558d43b9200 2024-04-25T09:06:12.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf0aa00640 1 -- 172.21.15.173:0/2043647638 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c0f6fa0 con 0x5558d43b9200 2024-04-25T09:06:12.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf0aa00640 1 -- 172.21.15.173:0/2043647638 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0ee880 con 0x5558d43b9200 2024-04-25T09:06:12.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 -- 172.21.15.173:0/2043647638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 msgr2=0x5558d43b7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 --2- 172.21.15.173:0/2043647638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 0x5558d43b7550 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009250 tx=0x7faf0c11e050 comp rx=0 tx=0).stop 2024-04-25T09:06:12.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 -- 172.21.15.173:0/2043647638 shutdown_connections 2024-04-25T09:06:12.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 --2- 172.21.15.173:0/2043647638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d43b9b20 0x5558d43b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 --2- 172.21.15.173:0/2043647638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 0x5558d43b7550 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 --2- 172.21.15.173:0/2043647638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d439df60 0x5558d43b8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 -- 172.21.15.173:0/2043647638 >> 172.21.15.173:0/2043647638 conn(0x5558d43664f0 msgr2=0x5558d439c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 -- 172.21.15.173:0/2043647638 shutdown_connections 2024-04-25T09:06:12.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 -- 172.21.15.173:0/2043647638 wait complete. 2024-04-25T09:06:12.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 -- start start 2024-04-25T09:06:12.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 Processor -- start 2024-04-25T09:06:12.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d439df60 0x5558d439d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 0x5558d436e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d43b9b20 0x5558d436e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d414a190 con 0x5558d43b9200 2024-04-25T09:06:12.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf20138660 con 0x5558d43b9b20 2024-04-25T09:06:12.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558d41bd520 con 0x5558d439df60 2024-04-25T09:06:12.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 10 client.0 _ll_register_callbacks cb 0x7faf18001930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:12.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 0x5558d436e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 0x5558d436e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49606/0 (socket says 172.21.15.173:49606) 2024-04-25T09:06:12.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1e000640 1 -- 172.21.15.173:0/972591028 learned_addr learned my addr 172.21.15.173:0/972591028 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:12.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1ea00640 1 --2- 172.21.15.173:0/972591028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d439df60 0x5558d439d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1f400640 1 --2- 172.21.15.173:0/972591028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d43b9b20 0x5558d436e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1e000640 1 -- 172.21.15.173:0/972591028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d439df60 msgr2=0x5558d439d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1e000640 1 --2- 172.21.15.173:0/972591028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d439df60 0x5558d439d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1e000640 1 -- 172.21.15.173:0/972591028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d43b9b20 msgr2=0x5558d436e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1e000640 1 --2- 172.21.15.173:0/972591028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d43b9b20 0x5558d436e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1e000640 1 -- 172.21.15.173:0/972591028 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558d4186040 con 0x5558d43b9200 2024-04-25T09:06:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf1e000640 1 --2- 172.21.15.173:0/972591028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 0x5558d436e260 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7faf0c01c970 tx=0x7faf0c11c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183dca9e208c07d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faeffe00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faeffe00640 1 -- 172.21.15.173:0/972591028 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0eeb10 con 0x5558d43b9200 2024-04-25T09:06:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faeffe00640 1 -- 172.21.15.173:0/972591028 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faf0c0c0c30 con 0x5558d43b9200 2024-04-25T09:06:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 -- 172.21.15.173:0/972591028 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf0c0f6fa0 con 0x5558d43b9200 2024-04-25T09:06:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faeffe00640 1 -- 172.21.15.173:0/972591028 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf0c0ee880 con 0x5558d43b9200 2024-04-25T09:06:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 10 client.6123 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 -- 172.21.15.173:0/972591028 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x5558d3e7a900 con 0x5558d43b9200 2024-04-25T09:06:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faeffe00640 1 -- 172.21.15.173:0/972591028 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c0f6fa0 con 0x5558d43b9200 2024-04-25T09:06:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faeffe00640 1 -- 172.21.15.173:0/972591028 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7faf0c112070 con 0x5558d43b9200 2024-04-25T09:06:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 10 client.6123 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:12.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 10 client.6123 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:12.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 20 client.6123 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:12.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 --2- 172.21.15.173:0/972591028 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5558d441f490 0x5558d4421880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 4 client.6123 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-04-25T09:06:12.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.354+0000 7faf28b5a000 1 -- 172.21.15.173:0/972591028 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) v1 -- 0x5558d41cb750 con 0x5558d441f490 2024-04-25T09:06:12.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf1ea00640 1 --2- 172.21.15.173:0/972591028 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5558d441f490 0x5558d4421880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf1ea00640 1 --2- 172.21.15.173:0/972591028 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5558d441f490 0x5558d4421880 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddb8c64a24e4e4f5 server_cookie=ce6a340003526c38 in_seq=0 out_seq=0 2024-04-25T09:06:12.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faeffe00640 10 client.6123 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:12.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faeffe00640 1 -- 172.21.15.173:0/972591028 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5558d41cb750 con 0x5558d441f490 2024-04-25T09:06:12.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faeffe00640 10 client.6123 handle_command_reply: tid=0 2024-04-25T09:06:12.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf28b5a000 1 client.6123 shutdown 2024-04-25T09:06:12.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf28b5a000 1 -- 172.21.15.173:0/972591028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 msgr2=0x5558d436e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf28b5a000 1 --2- 172.21.15.173:0/972591028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 0x5558d436e260 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7faf0c01c970 tx=0x7faf0c11c810 comp rx=0 tx=0).stop 2024-04-25T09:06:12.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf28b5a000 1 -- 172.21.15.173:0/972591028 shutdown_connections 2024-04-25T09:06:12.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf28b5a000 1 --2- 172.21.15.173:0/972591028 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5558d441f490 0x5558d4421880 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf28b5a000 1 --2- 172.21.15.173:0/972591028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5558d43b9b20 0x5558d436e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf28b5a000 1 --2- 172.21.15.173:0/972591028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5558d43b9200 0x5558d436e260 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faeffe00640 0 client.6123 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:12.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf28b5a000 1 --2- 172.21.15.173:0/972591028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5558d439df60 0x5558d439d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf28b5a000 1 -- 172.21.15.173:0/972591028 >> 172.21.15.173:0/972591028 conn(0x5558d43664f0 msgr2=0x5558d4370c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf28b5a000 1 -- 172.21.15.173:0/972591028 shutdown_connections 2024-04-25T09:06:12.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf28b5a000 1 -- 172.21.15.173:0/972591028 wait complete. 2024-04-25T09:06:12.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf28b5a000 20 client.6123 trim_cache size 0 max 16384 2024-04-25T09:06:12.354 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:12.354 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0, 2024-04-25T09:06:12.354 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_tag": "52a97ab7-989f-4814-bf9c-95f058a266db", 2024-04-25T09:06:12.355 INFO:teuthology.orchestra.run.smithi173.stdout: "mode": "asynchronous" 2024-04-25T09:06:12.355 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:12.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf25600640 1 -- 172.21.15.173:0/180933020 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf00066f60 msgr2=0x7faf00069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf25600640 1 --2- 172.21.15.173:0/180933020 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf00066f60 0x7faf00069420 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faf10001000 tx=0x7faf10001700 comp rx=0 tx=0).stop 2024-04-25T09:06:12.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf25600640 1 -- 172.21.15.173:0/180933020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf200b5050 msgr2=0x7faf2014cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf25600640 1 --2- 172.21.15.173:0/180933020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf200b5050 0x7faf2014cba0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0097f0 tx=0x7faf0c01ac40 comp rx=0 tx=0).stop 2024-04-25T09:06:12.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf25600640 1 -- 172.21.15.173:0/180933020 shutdown_connections 2024-04-25T09:06:12.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf25600640 1 --2- 172.21.15.173:0/180933020 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf00066f60 0x7faf00069420 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf25600640 1 --2- 172.21.15.173:0/180933020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf2015efe0 0x7faf2014bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf25600640 1 --2- 172.21.15.173:0/180933020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf200b5050 0x7faf2014cba0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf25600640 1 --2- 172.21.15.173:0/180933020 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf2006b120 0x7faf2014e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf25600640 1 -- 172.21.15.173:0/180933020 >> 172.21.15.173:0/180933020 conn(0x7faf200cfed0 msgr2=0x7faf20155cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf25600640 1 -- 172.21.15.173:0/180933020 shutdown_connections 2024-04-25T09:06:12.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.358+0000 7faf25600640 1 -- 172.21.15.173:0/180933020 wait complete. 2024-04-25T09:06:12.369 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '52a97ab7-989f-4814-bf9c-95f058a266db', 'mode': 'asynchronous'}' 2024-04-25T09:06:12.369 INFO:tasks.cephfs.test_scrub_checks:First run: flushing base dir / 2024-04-25T09:06:12.370 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-04-25T09:06:12.370 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:12.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.514+0000 7fed0f600640 1 Processor -- start 2024-04-25T09:06:12.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.514+0000 7fed0f600640 1 -- start start 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.514+0000 7fed0f600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fed0806ac90 0x7fed080aee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.514+0000 7fed0f600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fed0815d4a0 0x7fed0815d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.514+0000 7fed0f600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed080afff0 con 0x7fed0815c870 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.514+0000 7fed0f600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed080ad890 con 0x7fed0815d4a0 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.514+0000 7fed0f600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed080af470 con 0x7fed0806ac90 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.514+0000 7fed0d600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fed0815d4a0 0x7fed0815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.514+0000 7fed07e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fed0815c870 0x7fed0806b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47658/0 (socket says 172.21.15.173:47658) 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.514+0000 7fed07e00640 1 -- 172.21.15.173:0/819147148 learned_addr learned my addr 172.21.15.173:0/819147148 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.514+0000 7fed0cc00640 1 --2- 172.21.15.173:0/819147148 >> v2:172.21.15.194:3300/0 conn(0x7fed0806ac90 0x7fed080aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.514+0000 7fed0d600640 1 -- 172.21.15.173:0/819147148 >> v2:172.21.15.194:3300/0 conn(0x7fed0806ac90 msgr2=0x7fed080aee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.514+0000 7fed0d600640 1 --2- 172.21.15.173:0/819147148 >> v2:172.21.15.194:3300/0 conn(0x7fed0806ac90 0x7fed080aee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.514+0000 7fed0d600640 1 -- 172.21.15.173:0/819147148 >> v1:172.21.15.173:6789/0 conn(0x7fed0815c870 legacy=0x7fed0806b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.514+0000 7fed0d600640 1 -- 172.21.15.173:0/819147148 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed080af750 con 0x7fed0815d4a0 2024-04-25T09:06:12.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.518+0000 7fed0d600640 1 --2- 172.21.15.173:0/819147148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed0815d4a0 0x7fed0815d910 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fed080720d0 tx=0x7fed0001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b228ea8e73a485 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.518+0000 7fed07400640 1 -- 172.21.15.173:0/819147148 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed000ab650 con 0x7fed0815d4a0 2024-04-25T09:06:12.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.518+0000 7fed07400640 1 -- 172.21.15.173:0/819147148 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed000b0070 con 0x7fed0815d4a0 2024-04-25T09:06:12.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.518+0000 7fed07400640 1 -- 172.21.15.173:0/819147148 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed000aba10 con 0x7fed0815d4a0 2024-04-25T09:06:12.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.518+0000 7fed0f600640 1 -- 172.21.15.173:0/819147148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed0815d4a0 msgr2=0x7fed0815d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.518+0000 7fed0f600640 1 --2- 172.21.15.173:0/819147148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed0815d4a0 0x7fed0815d910 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fed080720d0 tx=0x7fed0001c450 comp rx=0 tx=0).stop 2024-04-25T09:06:12.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.518+0000 7fed0f600640 1 -- 172.21.15.173:0/819147148 shutdown_connections 2024-04-25T09:06:12.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.518+0000 7fed0f600640 1 --2- 172.21.15.173:0/819147148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed0815d4a0 0x7fed0815d910 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.518+0000 7fed0f600640 1 --2- 172.21.15.173:0/819147148 >> v2:172.21.15.194:3300/0 conn(0x7fed0806ac90 0x7fed080aee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.518+0000 7fed0f600640 1 -- 172.21.15.173:0/819147148 >> 172.21.15.173:0/819147148 conn(0x7fed08099a50 msgr2=0x7fed080b5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.518+0000 7fed0f600640 1 -- 172.21.15.173:0/819147148 shutdown_connections 2024-04-25T09:06:12.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.518+0000 7fed0f600640 1 -- 172.21.15.173:0/819147148 wait complete. 2024-04-25T09:06:12.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0f600640 1 Processor -- start 2024-04-25T09:06:12.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0f600640 1 -- start start 2024-04-25T09:06:12.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0f600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed0806ac90 0x7fed0813d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0f600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed0815c870 0x7fed0814df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0f600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed0815d4a0 0x7fed081f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0f600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed08145630 con 0x7fed0815d4a0 2024-04-25T09:06:12.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0f600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed081454b0 con 0x7fed0815c870 2024-04-25T09:06:12.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0f600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed08168780 con 0x7fed0806ac90 2024-04-25T09:06:12.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0d600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed0815d4a0 0x7fed081f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0d600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed0815d4a0 0x7fed081f6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49616/0 (socket says 172.21.15.173:49616) 2024-04-25T09:06:12.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0d600640 1 -- 172.21.15.173:0/3007433409 learned_addr learned my addr 172.21.15.173:0/3007433409 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:12.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed07e00640 1 --2- 172.21.15.173:0/3007433409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed0815c870 0x7fed0814df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0cc00640 1 --2- 172.21.15.173:0/3007433409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed0806ac90 0x7fed0813d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0d600640 1 -- 172.21.15.173:0/3007433409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed0806ac90 msgr2=0x7fed0813d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0d600640 1 --2- 172.21.15.173:0/3007433409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed0806ac90 0x7fed0813d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0d600640 1 -- 172.21.15.173:0/3007433409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed0815c870 msgr2=0x7fed0814df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0d600640 1 --2- 172.21.15.173:0/3007433409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed0815c870 0x7fed0814df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0d600640 1 -- 172.21.15.173:0/3007433409 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0813b420 con 0x7fed0815d4a0 2024-04-25T09:06:12.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed07e00640 1 --2- 172.21.15.173:0/3007433409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed0815c870 0x7fed0814df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:12.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0cc00640 1 --2- 172.21.15.173:0/3007433409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed0806ac90 0x7fed0813d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:12.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0d600640 1 --2- 172.21.15.173:0/3007433409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed0815d4a0 0x7fed081f6a60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fed000ad040 tx=0x7fed0001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed04c00640 1 -- 172.21.15.173:0/3007433409 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed000bf610 con 0x7fed0815d4a0 2024-04-25T09:06:12.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed04c00640 1 -- 172.21.15.173:0/3007433409 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed000bf7b0 con 0x7fed0815d4a0 2024-04-25T09:06:12.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0f600640 1 -- 172.21.15.173:0/3007433409 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0809e3b0 con 0x7fed0815d4a0 2024-04-25T09:06:12.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed04c00640 1 -- 172.21.15.173:0/3007433409 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed000bfb80 con 0x7fed0815d4a0 2024-04-25T09:06:12.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0f600640 1 -- 172.21.15.173:0/3007433409 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0813b9a0 con 0x7fed0815d4a0 2024-04-25T09:06:12.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.522+0000 7fed0f600640 1 -- 172.21.15.173:0/3007433409 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed08073a40 con 0x7fed0815d4a0 2024-04-25T09:06:12.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.526+0000 7fed04c00640 1 -- 172.21.15.173:0/3007433409 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fed000bd020 con 0x7fed0815d4a0 2024-04-25T09:06:12.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.526+0000 7fed04c00640 1 --2- 172.21.15.173:0/3007433409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fece8066f60 0x7fece8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.526+0000 7fed04c00640 1 -- 172.21.15.173:0/3007433409 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fed0011fe60 con 0x7fed0815d4a0 2024-04-25T09:06:12.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.526+0000 7fed0cc00640 1 --2- 172.21.15.173:0/3007433409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fece8066f60 0x7fece8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.526+0000 7fed0cc00640 1 --2- 172.21.15.173:0/3007433409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fece8066f60 0x7fece8069420 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fecf8003fd0 tx=0x7fecf80039e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.530+0000 7fed04c00640 1 -- 172.21.15.173:0/3007433409 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fed00016070 con 0x7fed0815d4a0 2024-04-25T09:06:12.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.718+0000 7fed0f600640 1 -- 172.21.15.173:0/3007433409 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed0806bb80 con 0x7fed0815d4a0 2024-04-25T09:06:12.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.718+0000 7fed04c00640 1 -- 172.21.15.173:0/3007433409 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4950 (secure 0 0 0) 0x7fed000f0e00 con 0x7fed0815d4a0 2024-04-25T09:06:12.712 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:12.712 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:05:57.598642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:12.713 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 26 2024-04-25T09:06:12.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.722+0000 7fed0f600640 1 -- 172.21.15.173:0/3007433409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fece8066f60 msgr2=0x7fece8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.722+0000 7fed0f600640 1 --2- 172.21.15.173:0/3007433409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fece8066f60 0x7fece8069420 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fecf8003fd0 tx=0x7fecf80039e0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.722+0000 7fed0f600640 1 -- 172.21.15.173:0/3007433409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed0815d4a0 msgr2=0x7fed081f6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.722+0000 7fed0f600640 1 --2- 172.21.15.173:0/3007433409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed0815d4a0 0x7fed081f6a60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fed000ad040 tx=0x7fed0001ac90 comp rx=0 tx=0).stop 2024-04-25T09:06:12.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.722+0000 7fed0f600640 1 -- 172.21.15.173:0/3007433409 shutdown_connections 2024-04-25T09:06:12.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.722+0000 7fed0f600640 1 --2- 172.21.15.173:0/3007433409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fece8066f60 0x7fece8069420 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.722+0000 7fed0f600640 1 --2- 172.21.15.173:0/3007433409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed0815d4a0 0x7fed081f6a60 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.722+0000 7fed0f600640 1 --2- 172.21.15.173:0/3007433409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed0815c870 0x7fed0814df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.722+0000 7fed0f600640 1 --2- 172.21.15.173:0/3007433409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed0806ac90 0x7fed0813d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.722+0000 7fed0f600640 1 -- 172.21.15.173:0/3007433409 >> 172.21.15.173:0/3007433409 conn(0x7fed08099a50 msgr2=0x7fed0806fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.722+0000 7fed0f600640 1 -- 172.21.15.173:0/3007433409 shutdown_connections 2024-04-25T09:06:12.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:12.722+0000 7fed0f600640 1 -- 172.21.15.173:0/3007433409 wait complete. 2024-04-25T09:06:12.732 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path / 2024-04-25T09:06:12.874 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:12.874 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0 2024-04-25T09:06:12.874 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:12.889 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T09:06:12.889 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-04-25T09:06:12.889 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:06:12.889 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-04-25T09:06:13.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.038+0000 7f9207400640 1 Processor -- start 2024-04-25T09:06:13.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.038+0000 7f9207400640 1 -- start start 2024-04-25T09:06:13.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.038+0000 7f9207400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f920006e1c0 0x7f920006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.038+0000 7f9207400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920006ae30 con 0x7f920006c410 2024-04-25T09:06:13.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.038+0000 7f9207400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920006b110 con 0x7f92000ad5c0 2024-04-25T09:06:13.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.038+0000 7f9207400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92000b3170 con 0x7f920006e1c0 2024-04-25T09:06:13.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.038+0000 7f91f7e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f920006c410 0x7f92000aceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47670/0 (socket says 172.21.15.173:47670) 2024-04-25T09:06:13.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.038+0000 7f91f7e00640 1 -- 172.21.15.173:0/2505461567 learned_addr learned my addr 172.21.15.173:0/2505461567 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:13.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.038+0000 7f9204a00640 1 --2- 172.21.15.173:0/2505461567 >> v2:172.21.15.194:3300/0 conn(0x7f920006e1c0 0x7f920006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.038+0000 7f91ffe00640 1 -- 172.21.15.173:0/2505461567 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311041621 0 0) 0x7f920006ae30 con 0x7f920006c410 2024-04-25T09:06:13.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.038+0000 7f91ffe00640 1 -- 172.21.15.173:0/2505461567 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91e4003530 con 0x7f920006c410 2024-04-25T09:06:13.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.038+0000 7f9204a00640 1 -- 172.21.15.173:0/2505461567 >> v1:172.21.15.194:6789/0 conn(0x7f92000ad5c0 legacy=0x7f92001677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.038+0000 7f9204a00640 1 -- 172.21.15.173:0/2505461567 >> v1:172.21.15.173:6789/0 conn(0x7f920006c410 legacy=0x7f92000aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.038+0000 7f9204a00640 1 -- 172.21.15.173:0/2505461567 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920006b3f0 con 0x7f920006e1c0 2024-04-25T09:06:13.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.038+0000 7f9204a00640 1 --2- 172.21.15.173:0/2505461567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f920006e1c0 0x7f920006bed0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f91f00097c0 tx=0x7f91f001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfc3f65c55b9f1d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.038+0000 7f91ffe00640 1 -- 172.21.15.173:0/2505461567 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f00b0070 con 0x7f920006e1c0 2024-04-25T09:06:13.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.038+0000 7f91ffe00640 1 -- 172.21.15.173:0/2505461567 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f00ab600 con 0x7f920006e1c0 2024-04-25T09:06:13.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.038+0000 7f91ffe00640 1 -- 172.21.15.173:0/2505461567 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f00ab9d0 con 0x7f920006e1c0 2024-04-25T09:06:13.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9207400640 1 -- 172.21.15.173:0/2505461567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f920006e1c0 msgr2=0x7f920006bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9207400640 1 --2- 172.21.15.173:0/2505461567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f920006e1c0 0x7f920006bed0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f91f00097c0 tx=0x7f91f001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9207400640 1 -- 172.21.15.173:0/2505461567 shutdown_connections 2024-04-25T09:06:13.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9207400640 1 --2- 172.21.15.173:0/2505461567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f920006e1c0 0x7f920006bed0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9207400640 1 -- 172.21.15.173:0/2505461567 >> 172.21.15.173:0/2505461567 conn(0x7f92000cfed0 msgr2=0x7f92000d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9207400640 1 -- 172.21.15.173:0/2505461567 shutdown_connections 2024-04-25T09:06:13.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9207400640 1 -- 172.21.15.173:0/2505461567 wait complete. 2024-04-25T09:06:13.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9207400640 1 Processor -- start 2024-04-25T09:06:13.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9207400640 1 -- start start 2024-04-25T09:06:13.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9207400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f920006c410 0x7f920014c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9207400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f920006e1c0 0x7f9200159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9207400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92000ad5c0 0x7f92001faef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9207400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920016b880 con 0x7f920006c410 2024-04-25T09:06:13.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9207400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920016b700 con 0x7f920006e1c0 2024-04-25T09:06:13.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9207400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920016ba00 con 0x7f92000ad5c0 2024-04-25T09:06:13.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9204a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f920006c410 0x7f920014c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9204a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f920006c410 0x7f920014c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49622/0 (socket says 172.21.15.173:49622) 2024-04-25T09:06:13.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9204a00640 1 -- 172.21.15.173:0/2820702303 learned_addr learned my addr 172.21.15.173:0/2820702303 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:13.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f91f7e00640 1 --2- 172.21.15.173:0/2820702303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f920006e1c0 0x7f9200159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9205400640 1 --2- 172.21.15.173:0/2820702303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92000ad5c0 0x7f92001faef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9204a00640 1 -- 172.21.15.173:0/2820702303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92000ad5c0 msgr2=0x7f92001faef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9204a00640 1 --2- 172.21.15.173:0/2820702303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92000ad5c0 0x7f92001faef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9204a00640 1 -- 172.21.15.173:0/2820702303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f920006e1c0 msgr2=0x7f9200159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9204a00640 1 --2- 172.21.15.173:0/2820702303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f920006e1c0 0x7f9200159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.042+0000 7f9204a00640 1 -- 172.21.15.173:0/2820702303 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92000cfd00 con 0x7f920006c410 2024-04-25T09:06:13.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.046+0000 7f9204a00640 1 --2- 172.21.15.173:0/2820702303 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f920006c410 0x7f920014c550 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f91f00190b0 tx=0x7f91f001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.046+0000 7f91fd600640 1 -- 172.21.15.173:0/2820702303 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f00b0050 con 0x7f920006c410 2024-04-25T09:06:13.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.046+0000 7f91fd600640 1 -- 172.21.15.173:0/2820702303 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f00bc070 con 0x7f920006c410 2024-04-25T09:06:13.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.046+0000 7f9207400640 1 -- 172.21.15.173:0/2820702303 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92000af4c0 con 0x7f920006c410 2024-04-25T09:06:13.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.046+0000 7f91fd600640 1 -- 172.21.15.173:0/2820702303 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f00b5830 con 0x7f920006c410 2024-04-25T09:06:13.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.046+0000 7f9207400640 1 -- 172.21.15.173:0/2820702303 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9200159c90 con 0x7f920006c410 2024-04-25T09:06:13.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.046+0000 7f91fd600640 1 -- 172.21.15.173:0/2820702303 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f91f00b59d0 con 0x7f920006c410 2024-04-25T09:06:13.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f91fd600640 1 --2- 172.21.15.173:0/2820702303 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f91dc066f60 0x7f91dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f91fd600640 1 -- 172.21.15.173:0/2820702303 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f91f011f8d0 con 0x7f920006c410 2024-04-25T09:06:13.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f91f7e00640 1 --2- 172.21.15.173:0/2820702303 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f91dc066f60 0x7f91dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f920a953000 1 Processor -- start 2024-04-25T09:06:13.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f920a953000 1 -- start start 2024-04-25T09:06:13.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f91f7e00640 1 --2- 172.21.15.173:0/2820702303 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f91dc066f60 0x7f91dc069420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9200167c10 tx=0x7f91e8007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f920a953000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7f4000 0x55910a7f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f920a953000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4920 0x55910a7a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f920a953000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7aa410 0x55910a7aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f920a953000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55910a5f7f40 con 0x55910a7f4920 2024-04-25T09:06:13.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f920a953000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55910a57ffc0 con 0x55910a7f4000 2024-04-25T09:06:13.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f920a953000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55910a5f3fe0 con 0x55910a7aa410 2024-04-25T09:06:13.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f91f7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4920 0x55910a7a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f91f7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4920 0x55910a7a9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49626/0 (socket says 172.21.15.173:49626) 2024-04-25T09:06:13.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f91f7e00640 1 -- 172.21.15.173:0/2811436796 learned_addr learned my addr 172.21.15.173:0/2811436796 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:13.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f9205400640 1 --2- 172.21.15.173:0/2811436796 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7aa410 0x55910a7aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f9204a00640 1 --2- 172.21.15.173:0/2811436796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7f4000 0x55910a7f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f91f7e00640 1 -- 172.21.15.173:0/2811436796 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7aa410 msgr2=0x55910a7aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f91f7e00640 1 --2- 172.21.15.173:0/2811436796 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7aa410 0x55910a7aa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f91f7e00640 1 -- 172.21.15.173:0/2811436796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7f4000 msgr2=0x55910a7f43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f91f7e00640 1 --2- 172.21.15.173:0/2811436796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7f4000 0x55910a7f43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f91f7e00640 1 -- 172.21.15.173:0/2811436796 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55910a63fa50 con 0x55910a7f4920 2024-04-25T09:06:13.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f91f7e00640 1 --2- 172.21.15.173:0/2811436796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4920 0x55910a7a9ed0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f91e8007fd0 tx=0x7f91e8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901d04e381e633a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f91f5600640 1 -- 172.21.15.173:0/2811436796 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e8026070 con 0x55910a7f4920 2024-04-25T09:06:13.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f91f5600640 1 -- 172.21.15.173:0/2811436796 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e80014f0 con 0x55910a7f4920 2024-04-25T09:06:13.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f91f5600640 1 -- 172.21.15.173:0/2811436796 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e80018a0 con 0x55910a7f4920 2024-04-25T09:06:13.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f920a953000 1 -- 172.21.15.173:0/2811436796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4920 msgr2=0x55910a7a9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f920a953000 1 --2- 172.21.15.173:0/2811436796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4920 0x55910a7a9ed0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f91e8007fd0 tx=0x7f91e8012000 comp rx=0 tx=0).stop 2024-04-25T09:06:13.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f920a953000 1 -- 172.21.15.173:0/2811436796 shutdown_connections 2024-04-25T09:06:13.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f920a953000 1 --2- 172.21.15.173:0/2811436796 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7aa410 0x55910a7aa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f920a953000 1 --2- 172.21.15.173:0/2811436796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4920 0x55910a7a9ed0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f920a953000 1 --2- 172.21.15.173:0/2811436796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7f4000 0x55910a7f43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f920a953000 1 -- 172.21.15.173:0/2811436796 >> 172.21.15.173:0/2811436796 conn(0x55910a7a63c0 msgr2=0x55910a7a87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f920a953000 1 -- 172.21.15.173:0/2811436796 shutdown_connections 2024-04-25T09:06:13.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.050+0000 7f920a953000 1 -- 172.21.15.173:0/2811436796 wait complete. 2024-04-25T09:06:13.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f920a953000 1 -- start start 2024-04-25T09:06:13.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f920a953000 1 Processor -- start 2024-04-25T09:06:13.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f920a953000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7aa410 0x55910a7b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f920a953000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7f4000 0x55910a7b6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f920a953000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4920 0x55910a7b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f920a953000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55910a5fc570 con 0x55910a7f4920 2024-04-25T09:06:13.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f920a953000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55910a5b25f0 con 0x55910a7aa410 2024-04-25T09:06:13.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f920a953000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55910a5f4fb0 con 0x55910a7f4000 2024-04-25T09:06:13.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f920a953000 10 client.0 _ll_register_callbacks cb 0x55910a6ac7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:13.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f9205400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4920 0x55910a7b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f9205400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4920 0x55910a7b6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49642/0 (socket says 172.21.15.173:49642) 2024-04-25T09:06:13.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f91f7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7f4000 0x55910a7b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f9205400640 1 -- 172.21.15.173:0/1506894573 learned_addr learned my addr 172.21.15.173:0/1506894573 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:13.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f9204a00640 1 --2- 172.21.15.173:0/1506894573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7aa410 0x55910a7b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f9205400640 1 -- 172.21.15.173:0/1506894573 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7f4000 msgr2=0x55910a7b6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f9205400640 1 --2- 172.21.15.173:0/1506894573 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7f4000 0x55910a7b6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f9205400640 1 -- 172.21.15.173:0/1506894573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7aa410 msgr2=0x55910a7b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f9205400640 1 --2- 172.21.15.173:0/1506894573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7aa410 0x55910a7b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f9205400640 1 -- 172.21.15.173:0/1506894573 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55910a580210 con 0x55910a7f4920 2024-04-25T09:06:13.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f9205400640 1 --2- 172.21.15.173:0/1506894573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4920 0x55910a7b6880 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f91f8005950 tx=0x7f91f8001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd017334e09d783 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f91ee000640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:13.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f91ee000640 1 -- 172.21.15.173:0/1506894573 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f80020b0 con 0x55910a7f4920 2024-04-25T09:06:13.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f91ee000640 1 -- 172.21.15.173:0/1506894573 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f91f8013570 con 0x55910a7f4920 2024-04-25T09:06:13.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f920a953000 1 -- 172.21.15.173:0/1506894573 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f91e80014f0 con 0x55910a7f4920 2024-04-25T09:06:13.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f91ee000640 1 -- 172.21.15.173:0/1506894573 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91f8021050 con 0x55910a7f4920 2024-04-25T09:06:13.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f920a953000 10 client.6144 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:13.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f920a953000 1 -- 172.21.15.173:0/1506894573 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55910a67c400 con 0x55910a7f4920 2024-04-25T09:06:13.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f91ee000640 1 -- 172.21.15.173:0/1506894573 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e80014f0 con 0x55910a7f4920 2024-04-25T09:06:13.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f91ee000640 1 -- 172.21.15.173:0/1506894573 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f91f8024020 con 0x55910a7f4920 2024-04-25T09:06:13.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f920a953000 10 client.6144 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:13.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f920a953000 10 client.6144 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:13.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f920a953000 20 client.6144 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:13.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f920a953000 1 --2- 172.21.15.173:0/1506894573 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55910a8042b0 0x55910a8066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f920a953000 4 client.6144 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:13.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f920a953000 1 -- 172.21.15.173:0/1506894573 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55910a593c90 con 0x55910a8042b0 2024-04-25T09:06:13.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f9204a00640 1 --2- 172.21.15.173:0/1506894573 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55910a8042b0 0x55910a8066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f9204a00640 1 --2- 172.21.15.173:0/1506894573 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55910a8042b0 0x55910a8066a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=738e72d44bf1adb4 server_cookie=3e844dd346127d10 in_seq=0 out_seq=0 2024-04-25T09:06:13.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.054+0000 7f91ee000640 10 client.6144 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:13.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.058+0000 7f91ee000640 1 -- 172.21.15.173:0/1506894573 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55910a593c90 con 0x55910a8042b0 2024-04-25T09:06:13.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.058+0000 7f91ee000640 10 client.6144 handle_command_reply: tid=0 2024-04-25T09:06:13.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.058+0000 7f920a953000 1 client.6144 shutdown 2024-04-25T09:06:13.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.058+0000 7f920a953000 1 -- 172.21.15.173:0/1506894573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4920 msgr2=0x55910a7b6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.058+0000 7f920a953000 1 --2- 172.21.15.173:0/1506894573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4920 0x55910a7b6880 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f91f8005950 tx=0x7f91f8001940 comp rx=0 tx=0).stop 2024-04-25T09:06:13.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.058+0000 7f920a953000 1 -- 172.21.15.173:0/1506894573 shutdown_connections 2024-04-25T09:06:13.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.058+0000 7f920a953000 1 --2- 172.21.15.173:0/1506894573 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55910a8042b0 0x55910a8066a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.058+0000 7f920a953000 1 --2- 172.21.15.173:0/1506894573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4920 0x55910a7b6880 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.058+0000 7f920a953000 1 --2- 172.21.15.173:0/1506894573 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7f4000 0x55910a7b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.058+0000 7f91ee000640 0 client.6144 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:13.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.058+0000 7f920a953000 1 --2- 172.21.15.173:0/1506894573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7aa410 0x55910a7b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.058+0000 7f920a953000 1 -- 172.21.15.173:0/1506894573 >> 172.21.15.173:0/1506894573 conn(0x55910a7a63c0 msgr2=0x55910a7a9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.058+0000 7f920a953000 1 -- 172.21.15.173:0/1506894573 shutdown_connections 2024-04-25T09:06:13.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.058+0000 7f920a953000 1 -- 172.21.15.173:0/1506894573 wait complete. 2024-04-25T09:06:13.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.058+0000 7f920a953000 20 client.6144 trim_cache size 0 max 16384 2024-04-25T09:06:13.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.070+0000 7f920a953000 1 Processor -- start 2024-04-25T09:06:13.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.070+0000 7f920a953000 1 -- start start 2024-04-25T09:06:13.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f920a953000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7aa410 0x55910a851180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f920a953000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7f4000 0x55910a8516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f920a953000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7f4920 0x55910a851c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f920a953000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9200203520 con 0x55910a7aa410 2024-04-25T09:06:13.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f920a953000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9200202720 con 0x55910a7f4000 2024-04-25T09:06:13.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f920a953000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9200201b20 con 0x55910a7f4920 2024-04-25T09:06:13.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f9204a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7aa410 0x55910a851180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f9204a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7aa410 0x55910a851180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49654/0 (socket says 172.21.15.173:49654) 2024-04-25T09:06:13.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f9204a00640 1 -- 172.21.15.173:0/169213233 learned_addr learned my addr 172.21.15.173:0/169213233 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:13.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f9204a00640 1 -- 172.21.15.173:0/169213233 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7f4920 msgr2=0x55910a851c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f9204a00640 1 --2- 172.21.15.173:0/169213233 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7f4920 0x55910a851c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f9204a00640 1 -- 172.21.15.173:0/169213233 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7f4000 msgr2=0x55910a8516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f9204a00640 1 --2- 172.21.15.173:0/169213233 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7f4000 0x55910a8516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f9204a00640 1 -- 172.21.15.173:0/169213233 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55910a652c10 con 0x55910a7aa410 2024-04-25T09:06:13.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f9204a00640 1 --2- 172.21.15.173:0/169213233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7aa410 0x55910a851180 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f91f011dc70 tx=0x7f91f00c3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636c2744955d1587 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f91f4c00640 1 -- 172.21.15.173:0/169213233 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f010c070 con 0x55910a7aa410 2024-04-25T09:06:13.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f91f4c00640 1 -- 172.21.15.173:0/169213233 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f00b1040 con 0x55910a7aa410 2024-04-25T09:06:13.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f91f4c00640 1 -- 172.21.15.173:0/169213233 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f011b030 con 0x55910a7aa410 2024-04-25T09:06:13.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f920a953000 1 -- 172.21.15.173:0/169213233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7aa410 msgr2=0x55910a851180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f920a953000 1 --2- 172.21.15.173:0/169213233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7aa410 0x55910a851180 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f91f011dc70 tx=0x7f91f00c3040 comp rx=0 tx=0).stop 2024-04-25T09:06:13.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f920a953000 1 -- 172.21.15.173:0/169213233 shutdown_connections 2024-04-25T09:06:13.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f920a953000 1 --2- 172.21.15.173:0/169213233 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7f4920 0x55910a851c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f920a953000 1 --2- 172.21.15.173:0/169213233 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7f4000 0x55910a8516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f920a953000 1 --2- 172.21.15.173:0/169213233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7aa410 0x55910a851180 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f920a953000 1 -- 172.21.15.173:0/169213233 >> 172.21.15.173:0/169213233 conn(0x55910a7a63c0 msgr2=0x55910a7b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f920a953000 1 -- 172.21.15.173:0/169213233 shutdown_connections 2024-04-25T09:06:13.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f920a953000 1 -- 172.21.15.173:0/169213233 wait complete. 2024-04-25T09:06:13.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f920a953000 1 -- start start 2024-04-25T09:06:13.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.074+0000 7f920a953000 1 Processor -- start 2024-04-25T09:06:13.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7aa410 0x55910a8552e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4000 0x55910a855820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7f4920 0x55910a810120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55910a5a3310 con 0x55910a7f4000 2024-04-25T09:06:13.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9200202120 con 0x55910a7aa410 2024-04-25T09:06:13.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55910a5fc570 con 0x55910a7f4920 2024-04-25T09:06:13.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 10 client.0 _ll_register_callbacks cb 0x55910a64a2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:13.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91f7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4000 0x55910a855820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91f7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4000 0x55910a855820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49662/0 (socket says 172.21.15.173:49662) 2024-04-25T09:06:13.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91f7e00640 1 -- 172.21.15.173:0/1995909071 learned_addr learned my addr 172.21.15.173:0/1995909071 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:13.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f9204a00640 1 --2- 172.21.15.173:0/1995909071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7aa410 0x55910a8552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f9205400640 1 --2- 172.21.15.173:0/1995909071 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7f4920 0x55910a810120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91f7e00640 1 -- 172.21.15.173:0/1995909071 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7f4920 msgr2=0x55910a810120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91f7e00640 1 --2- 172.21.15.173:0/1995909071 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7f4920 0x55910a810120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91f7e00640 1 -- 172.21.15.173:0/1995909071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7aa410 msgr2=0x55910a8552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91f7e00640 1 --2- 172.21.15.173:0/1995909071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7aa410 0x55910a8552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91f7e00640 1 -- 172.21.15.173:0/1995909071 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55910a58cbb0 con 0x55910a7f4000 2024-04-25T09:06:13.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f9205400640 1 --2- 172.21.15.173:0/1995909071 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7f4920 0x55910a810120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:13.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91f7e00640 1 --2- 172.21.15.173:0/1995909071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4000 0x55910a855820 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f91e8024040 tx=0x7f91e8001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea8fd08f6577ff3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91ee000640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:13.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91ee000640 1 -- 172.21.15.173:0/1995909071 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e8026040 con 0x55910a7f4000 2024-04-25T09:06:13.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91ee000640 1 -- 172.21.15.173:0/1995909071 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f91e8010040 con 0x55910a7f4000 2024-04-25T09:06:13.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 -- 172.21.15.173:0/1995909071 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f91f00b1040 con 0x55910a7f4000 2024-04-25T09:06:13.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91ee000640 1 -- 172.21.15.173:0/1995909071 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91e8039050 con 0x55910a7f4000 2024-04-25T09:06:13.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 10 client.6150 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:13.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 -- 172.21.15.173:0/1995909071 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55910a59f030 con 0x55910a7f4000 2024-04-25T09:06:13.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91ee000640 1 -- 172.21.15.173:0/1995909071 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f00b1040 con 0x55910a7f4000 2024-04-25T09:06:13.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91ee000640 1 -- 172.21.15.173:0/1995909071 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f91e803c020 con 0x55910a7f4000 2024-04-25T09:06:13.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 10 client.6150 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:13.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 10 client.6150 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:13.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 20 client.6150 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:13.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 --2- 172.21.15.173:0/1995909071 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55910a810e90 0x55910a8112a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 4 client.6150 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-04-25T09:06:13.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 -- 172.21.15.173:0/1995909071 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) v1 -- 0x55910a605480 con 0x55910a810e90 2024-04-25T09:06:13.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f9204a00640 1 --2- 172.21.15.173:0/1995909071 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55910a810e90 0x55910a8112a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91ee000640 10 client.6150 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:13.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f9204a00640 1 --2- 172.21.15.173:0/1995909071 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55910a810e90 0x55910a8112a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b60210c7ab54d9f server_cookie=a5e4f4dc1d7e12f3 in_seq=0 out_seq=0 2024-04-25T09:06:13.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91ee000640 1 -- 172.21.15.173:0/1995909071 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55910a605480 con 0x55910a810e90 2024-04-25T09:06:13.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91ee000640 10 client.6150 handle_command_reply: tid=0 2024-04-25T09:06:13.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 client.6150 shutdown 2024-04-25T09:06:13.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 -- 172.21.15.173:0/1995909071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4000 msgr2=0x55910a855820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 --2- 172.21.15.173:0/1995909071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4000 0x55910a855820 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f91e8024040 tx=0x7f91e8001160 comp rx=0 tx=0).stop 2024-04-25T09:06:13.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 -- 172.21.15.173:0/1995909071 shutdown_connections 2024-04-25T09:06:13.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 --2- 172.21.15.173:0/1995909071 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55910a810e90 0x55910a8112a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 --2- 172.21.15.173:0/1995909071 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55910a7f4920 0x55910a810120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 --2- 172.21.15.173:0/1995909071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55910a7f4000 0x55910a855820 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 --2- 172.21.15.173:0/1995909071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55910a7aa410 0x55910a8552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 -- 172.21.15.173:0/1995909071 >> 172.21.15.173:0/1995909071 conn(0x55910a7a63c0 msgr2=0x55910a7a9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f91ee000640 0 client.6150 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:13.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 -- 172.21.15.173:0/1995909071 shutdown_connections 2024-04-25T09:06:13.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 1 -- 172.21.15.173:0/1995909071 wait complete. 2024-04-25T09:06:13.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.078+0000 7f920a953000 20 client.6150 trim_cache size 0 max 16384 2024-04-25T09:06:13.076 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:13.076 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0, 2024-04-25T09:06:13.076 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_tag": "950fd8ab-c5a2-4805-9e8b-f15540185179", 2024-04-25T09:06:13.076 INFO:teuthology.orchestra.run.smithi173.stdout: "mode": "asynchronous" 2024-04-25T09:06:13.076 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:13.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.082+0000 7f9207400640 1 -- 172.21.15.173:0/2820702303 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f91dc066f60 msgr2=0x7f91dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.082+0000 7f9207400640 1 --2- 172.21.15.173:0/2820702303 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f91dc066f60 0x7f91dc069420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9200167c10 tx=0x7f91e8007d40 comp rx=0 tx=0).stop 2024-04-25T09:06:13.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.082+0000 7f9207400640 1 -- 172.21.15.173:0/2820702303 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f920006c410 msgr2=0x7f920014c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.082+0000 7f9207400640 1 --2- 172.21.15.173:0/2820702303 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f920006c410 0x7f920014c550 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f91f00190b0 tx=0x7f91f001ace0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.082+0000 7f9207400640 1 -- 172.21.15.173:0/2820702303 shutdown_connections 2024-04-25T09:06:13.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.082+0000 7f9207400640 1 --2- 172.21.15.173:0/2820702303 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f91dc066f60 0x7f91dc069420 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.082+0000 7f9207400640 1 --2- 172.21.15.173:0/2820702303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92000ad5c0 0x7f92001faef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.082+0000 7f9207400640 1 --2- 172.21.15.173:0/2820702303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f920006e1c0 0x7f9200159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.082+0000 7f9207400640 1 --2- 172.21.15.173:0/2820702303 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f920006c410 0x7f920014c550 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.082+0000 7f9207400640 1 -- 172.21.15.173:0/2820702303 >> 172.21.15.173:0/2820702303 conn(0x7f92000cfed0 msgr2=0x7f92000b35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.082+0000 7f9207400640 1 -- 172.21.15.173:0/2820702303 shutdown_connections 2024-04-25T09:06:13.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.082+0000 7f9207400640 1 -- 172.21.15.173:0/2820702303 wait complete. 2024-04-25T09:06:13.092 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': '950fd8ab-c5a2-4805-9e8b-f15540185179', 'mode': 'asynchronous'}' 2024-04-25T09:06:13.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:13.093 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_0) 2024-04-25T09:06:13.103 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' 2024-04-25T09:06:13.103 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:13.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.290+0000 7f66cd400640 1 Processor -- start 2024-04-25T09:06:13.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.290+0000 7f66cd400640 1 -- start start 2024-04-25T09:06:13.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.290+0000 7f66cd400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f66c815dbb0 0x7f66c815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.290+0000 7f66cd400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f66c80d2130 0x7f66c806c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.290+0000 7f66cd400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66c806c7b0 0x7f66c806f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.290+0000 7f66cd400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c806d870 con 0x7f66c815dbb0 2024-04-25T09:06:13.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.290+0000 7f66cd400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c8161690 con 0x7f66c80d2130 2024-04-25T09:06:13.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.290+0000 7f66cd400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80d2590 con 0x7f66c806c7b0 2024-04-25T09:06:13.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.290+0000 7f66c6800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f66c815dbb0 0x7f66c815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.290+0000 7f66c6800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f66c815dbb0 0x7f66c815df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46002/0 (socket says 172.21.15.173:46002) 2024-04-25T09:06:13.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.290+0000 7f66c6800640 1 -- 172.21.15.173:0/1826161803 learned_addr learned my addr 172.21.15.173:0/1826161803 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:13.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.290+0000 7f66c6800640 1 -- 172.21.15.173:0/1826161803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66c806c7b0 msgr2=0x7f66c806f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.290+0000 7f66c6800640 1 --2- 172.21.15.173:0/1826161803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66c806c7b0 0x7f66c806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.290+0000 7f66c6800640 1 -- 172.21.15.173:0/1826161803 >> v2:172.21.15.194:3300/0 conn(0x7f66c80d2130 msgr2=0x7f66c806c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.290+0000 7f66bde00640 1 --2- 172.21.15.173:0/1826161803 >> v2:172.21.15.194:3300/0 conn(0x7f66c80d2130 0x7f66c806c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.290+0000 7f66c6800640 1 --2- 172.21.15.173:0/1826161803 >> v2:172.21.15.194:3300/0 conn(0x7f66c80d2130 0x7f66c806c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.290+0000 7f66c6800640 1 -- 172.21.15.173:0/1826161803 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c815e5c0 con 0x7f66c815dbb0 2024-04-25T09:06:13.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.290+0000 7f66bde00640 1 --2- 172.21.15.173:0/1826161803 >> v2:172.21.15.194:3300/0 conn(0x7f66c80d2130 0x7f66c806c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:13.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.294+0000 7f66c6800640 1 --2- 172.21.15.173:0/1826161803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66c815dbb0 0x7f66c815df90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f66c8070590 tx=0x7f66b801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5ca02458bbc674 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.294+0000 7f66c5e00640 1 -- 172.21.15.173:0/1826161803 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b80b1070 con 0x7f66c815dbb0 2024-04-25T09:06:13.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.294+0000 7f66c5e00640 1 -- 172.21.15.173:0/1826161803 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b80a8050 con 0x7f66c815dbb0 2024-04-25T09:06:13.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.294+0000 7f66c5e00640 1 -- 172.21.15.173:0/1826161803 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b80ac860 con 0x7f66c815dbb0 2024-04-25T09:06:13.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.294+0000 7f66cd400640 1 -- 172.21.15.173:0/1826161803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66c815dbb0 msgr2=0x7f66c815df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.294+0000 7f66cd400640 1 --2- 172.21.15.173:0/1826161803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66c815dbb0 0x7f66c815df90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f66c8070590 tx=0x7f66b801c510 comp rx=0 tx=0).stop 2024-04-25T09:06:13.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.294+0000 7f66cd400640 1 -- 172.21.15.173:0/1826161803 shutdown_connections 2024-04-25T09:06:13.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.294+0000 7f66cd400640 1 --2- 172.21.15.173:0/1826161803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66c806c7b0 0x7f66c806f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.294+0000 7f66cd400640 1 --2- 172.21.15.173:0/1826161803 >> v2:172.21.15.194:3300/0 conn(0x7f66c80d2130 0x7f66c806c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.294+0000 7f66cd400640 1 --2- 172.21.15.173:0/1826161803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66c815dbb0 0x7f66c815df90 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.294+0000 7f66cd400640 1 -- 172.21.15.173:0/1826161803 >> 172.21.15.173:0/1826161803 conn(0x7f66c8061880 msgr2=0x7f66c8061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.294+0000 7f66cd400640 1 -- 172.21.15.173:0/1826161803 shutdown_connections 2024-04-25T09:06:13.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.294+0000 7f66cd400640 1 -- 172.21.15.173:0/1826161803 wait complete. 2024-04-25T09:06:13.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66cd400640 1 Processor -- start 2024-04-25T09:06:13.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66cd400640 1 -- start start 2024-04-25T09:06:13.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66cd400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c806c7b0 0x7f66c80ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66cd400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66c80d2130 0x7f66c80b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66cd400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66c815dbb0 0x7f66c80c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66cd400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80cf4e0 con 0x7f66c80d2130 2024-04-25T09:06:13.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66cd400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80cf360 con 0x7f66c806c7b0 2024-04-25T09:06:13.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66cd400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80cf660 con 0x7f66c815dbb0 2024-04-25T09:06:13.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66bde00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66c80d2130 0x7f66c80b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66bde00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66c80d2130 0x7f66c80b09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46006/0 (socket says 172.21.15.173:46006) 2024-04-25T09:06:13.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66bde00640 1 -- 172.21.15.173:0/5252455 learned_addr learned my addr 172.21.15.173:0/5252455 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:13.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66c6800640 1 --2- 172.21.15.173:0/5252455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c806c7b0 0x7f66c80ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66c7200640 1 --2- 172.21.15.173:0/5252455 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66c815dbb0 0x7f66c80c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66bde00640 1 -- 172.21.15.173:0/5252455 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66c815dbb0 msgr2=0x7f66c80c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66bde00640 1 --2- 172.21.15.173:0/5252455 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66c815dbb0 0x7f66c80c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66bde00640 1 -- 172.21.15.173:0/5252455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c806c7b0 msgr2=0x7f66c80ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66bde00640 1 --2- 172.21.15.173:0/5252455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c806c7b0 0x7f66c80ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66bde00640 1 -- 172.21.15.173:0/5252455 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c80b0f30 con 0x7f66c80d2130 2024-04-25T09:06:13.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66bde00640 1 --2- 172.21.15.173:0/5252455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66c80d2130 0x7f66c80b09f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f66b000c7c0 tx=0x7f66b000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66bf400640 1 -- 172.21.15.173:0/5252455 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b0007a30 con 0x7f66c80d2130 2024-04-25T09:06:13.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66bf400640 1 -- 172.21.15.173:0/5252455 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b0007bd0 con 0x7f66c80d2130 2024-04-25T09:06:13.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66cd400640 1 -- 172.21.15.173:0/5252455 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c80cd8f0 con 0x7f66c80d2130 2024-04-25T09:06:13.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66bf400640 1 -- 172.21.15.173:0/5252455 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b00113f0 con 0x7f66c80d2130 2024-04-25T09:06:13.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66cd400640 1 -- 172.21.15.173:0/5252455 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c80cdeb0 con 0x7f66c80d2130 2024-04-25T09:06:13.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.298+0000 7f66cd400640 1 -- 172.21.15.173:0/5252455 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c8073a40 con 0x7f66c80d2130 2024-04-25T09:06:13.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.302+0000 7f66bf400640 1 -- 172.21.15.173:0/5252455 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f66b0011590 con 0x7f66c80d2130 2024-04-25T09:06:13.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.302+0000 7f66bf400640 1 --2- 172.21.15.173:0/5252455 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f66a4066f60 0x7f66a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.302+0000 7f66bf400640 1 -- 172.21.15.173:0/5252455 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f66b0085280 con 0x7f66c80d2130 2024-04-25T09:06:13.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.302+0000 7f66c6800640 1 --2- 172.21.15.173:0/5252455 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f66a4066f60 0x7f66a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.302+0000 7f66c6800640 1 --2- 172.21.15.173:0/5252455 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f66a4066f60 0x7f66a4069420 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f66b80ae000 tx=0x7f66b80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.306+0000 7f66bf400640 1 -- 172.21.15.173:0/5252455 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f66b0015020 con 0x7f66c80d2130 2024-04-25T09:06:13.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.494+0000 7f66cd400640 1 -- 172.21.15.173:0/5252455 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66c80c7b80 con 0x7f66c80d2130 2024-04-25T09:06:13.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.498+0000 7f66bf400640 1 -- 172.21.15.173:0/5252455 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f66b0055b40 con 0x7f66c80d2130 2024-04-25T09:06:13.489 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:13.489 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:05:57.598642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:13.489 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 26 2024-04-25T09:06:13.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.498+0000 7f66cd400640 1 -- 172.21.15.173:0/5252455 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f66a4066f60 msgr2=0x7f66a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.498+0000 7f66cd400640 1 --2- 172.21.15.173:0/5252455 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f66a4066f60 0x7f66a4069420 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f66b80ae000 tx=0x7f66b80a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:13.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.498+0000 7f66cd400640 1 -- 172.21.15.173:0/5252455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66c80d2130 msgr2=0x7f66c80b09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.498+0000 7f66cd400640 1 --2- 172.21.15.173:0/5252455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66c80d2130 0x7f66c80b09f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f66b000c7c0 tx=0x7f66b000cc80 comp rx=0 tx=0).stop 2024-04-25T09:06:13.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.498+0000 7f66cd400640 1 -- 172.21.15.173:0/5252455 shutdown_connections 2024-04-25T09:06:13.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.498+0000 7f66cd400640 1 --2- 172.21.15.173:0/5252455 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f66a4066f60 0x7f66a4069420 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.498+0000 7f66cd400640 1 --2- 172.21.15.173:0/5252455 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66c815dbb0 0x7f66c80c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.498+0000 7f66cd400640 1 --2- 172.21.15.173:0/5252455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66c80d2130 0x7f66c80b09f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.498+0000 7f66cd400640 1 --2- 172.21.15.173:0/5252455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66c806c7b0 0x7f66c80ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.498+0000 7f66cd400640 1 -- 172.21.15.173:0/5252455 >> 172.21.15.173:0/5252455 conn(0x7f66c8061880 msgr2=0x7f66c815f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.498+0000 7f66cd400640 1 -- 172.21.15.173:0/5252455 shutdown_connections 2024-04-25T09:06:13.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.498+0000 7f66cd400640 1 -- 172.21.15.173:0/5252455 wait complete. 2024-04-25T09:06:13.510 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path /scrub_test_path/ceph-qa-suite/new_dir_0 2024-04-25T09:06:13.653 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:13.654 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0 2024-04-25T09:06:13.654 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:13.669 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T09:06:13.669 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:06:13.669 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:13.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:13.677 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0 bs=1M conv=fdatasync count=1 seek=0) 2024-04-25T09:06:13.747 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:06:13.747 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:06:13.747 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188016 s, 55.8 MB/s 2024-04-25T09:06:13.748 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' 2024-04-25T09:06:13.748 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:13.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.934+0000 7f3b30a00640 1 Processor -- start 2024-04-25T09:06:13.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.934+0000 7f3b30a00640 1 -- start start 2024-04-25T09:06:13.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.938+0000 7f3b30a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3b2c0b3e70 0x7f3b2c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.938+0000 7f3b30a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b2c15edd0 0x7f3b2c0b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.938+0000 7f3b30a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c0b4790 con 0x7f3b2c0aefa0 2024-04-25T09:06:13.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.938+0000 7f3b30a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2c06dd50 con 0x7f3b2c0b3e70 2024-04-25T09:06:13.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.938+0000 7f3b30a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c15f320 con 0x7f3b2c15edd0 2024-04-25T09:06:13.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.938+0000 7f3b2a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b2c15edd0 0x7f3b2c0b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.938+0000 7f3b2a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b2c15edd0 0x7f3b2c0b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:49610/0 (socket says 172.21.15.173:49610) 2024-04-25T09:06:13.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.938+0000 7f3b2a800640 1 -- 172.21.15.173:0/2193915293 learned_addr learned my addr 172.21.15.173:0/2193915293 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:13.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.938+0000 7f3b29e00640 1 --2- 172.21.15.173:0/2193915293 >> v2:172.21.15.194:3300/0 conn(0x7f3b2c0b3e70 0x7f3b2c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.938+0000 7f3b29400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f3b2c0aefa0 0x7f3b2c0b2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:59488/0 (socket says 172.21.15.173:59488) 2024-04-25T09:06:13.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.938+0000 7f3b2a800640 1 -- 172.21.15.173:0/2193915293 >> v2:172.21.15.194:3300/0 conn(0x7f3b2c0b3e70 msgr2=0x7f3b2c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.938+0000 7f3b2a800640 1 --2- 172.21.15.173:0/2193915293 >> v2:172.21.15.194:3300/0 conn(0x7f3b2c0b3e70 0x7f3b2c0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.938+0000 7f3b2a800640 1 -- 172.21.15.173:0/2193915293 >> v1:172.21.15.194:6789/0 conn(0x7f3b2c0aefa0 legacy=0x7f3b2c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.938+0000 7f3b2a800640 1 -- 172.21.15.173:0/2193915293 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c06d420 con 0x7f3b2c15edd0 2024-04-25T09:06:13.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.942+0000 7f3b2a800640 1 --2- 172.21.15.173:0/2193915293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b2c15edd0 0x7f3b2c0b2e80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400d150 tx=0x7f3b2401ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=869d89de0718c9cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.942+0000 7f3b28a00640 1 -- 172.21.15.173:0/2193915293 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2400b2d0 con 0x7f3b2c15edd0 2024-04-25T09:06:13.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.942+0000 7f3b28a00640 1 -- 172.21.15.173:0/2193915293 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2400b470 con 0x7f3b2c15edd0 2024-04-25T09:06:13.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.942+0000 7f3b28a00640 1 -- 172.21.15.173:0/2193915293 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b240a7c10 con 0x7f3b2c15edd0 2024-04-25T09:06:13.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.942+0000 7f3b30a00640 1 -- 172.21.15.173:0/2193915293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b2c15edd0 msgr2=0x7f3b2c0b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.942+0000 7f3b30a00640 1 --2- 172.21.15.173:0/2193915293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b2c15edd0 0x7f3b2c0b2e80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400d150 tx=0x7f3b2401ec00 comp rx=0 tx=0).stop 2024-04-25T09:06:13.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.942+0000 7f3b30a00640 1 -- 172.21.15.173:0/2193915293 shutdown_connections 2024-04-25T09:06:13.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.942+0000 7f3b30a00640 1 --2- 172.21.15.173:0/2193915293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b2c15edd0 0x7f3b2c0b2e80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.942+0000 7f3b30a00640 1 --2- 172.21.15.173:0/2193915293 >> v2:172.21.15.194:3300/0 conn(0x7f3b2c0b3e70 0x7f3b2c0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.942+0000 7f3b30a00640 1 -- 172.21.15.173:0/2193915293 >> 172.21.15.173:0/2193915293 conn(0x7f3b2c06ac90 msgr2=0x7f3b2c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.942+0000 7f3b30a00640 1 -- 172.21.15.173:0/2193915293 shutdown_connections 2024-04-25T09:06:13.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.942+0000 7f3b30a00640 1 -- 172.21.15.173:0/2193915293 wait complete. 2024-04-25T09:06:13.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.942+0000 7f3b30a00640 1 Processor -- start 2024-04-25T09:06:13.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.942+0000 7f3b30a00640 1 -- start start 2024-04-25T09:06:13.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b30a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c0aefa0 0x7f3b2c144140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b30a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b2c0b3e70 0x7f3b2c146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b30a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b2c15edd0 0x7f3b2c146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b30a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c06e1c0 con 0x7f3b2c15edd0 2024-04-25T09:06:13.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b30a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c15aba0 con 0x7f3b2c0aefa0 2024-04-25T09:06:13.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b30a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c06e340 con 0x7f3b2c0b3e70 2024-04-25T09:06:13.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b29400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b2c0b3e70 0x7f3b2c146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b2a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b2c15edd0 0x7f3b2c146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b29e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c0aefa0 0x7f3b2c144140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b29e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c0aefa0 0x7f3b2c144140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:51030/0 (socket says 172.21.15.173:51030) 2024-04-25T09:06:13.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b29400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b2c0b3e70 0x7f3b2c146050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:49612/0 (socket says 172.21.15.173:49612) 2024-04-25T09:06:13.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b29400640 1 -- 172.21.15.173:0/82783652 learned_addr learned my addr 172.21.15.173:0/82783652 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:13.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b2a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b2c15edd0 0x7f3b2c146590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46010/0 (socket says 172.21.15.173:46010) 2024-04-25T09:06:13.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b2a800640 1 -- 172.21.15.173:0/82783652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b2c0b3e70 msgr2=0x7f3b2c146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b2a800640 1 --2- 172.21.15.173:0/82783652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b2c0b3e70 0x7f3b2c146050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b2a800640 1 -- 172.21.15.173:0/82783652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c0aefa0 msgr2=0x7f3b2c144140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b2a800640 1 --2- 172.21.15.173:0/82783652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c0aefa0 0x7f3b2c144140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b2a800640 1 -- 172.21.15.173:0/82783652 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c1494a0 con 0x7f3b2c15edd0 2024-04-25T09:06:13.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b2a800640 1 --2- 172.21.15.173:0/82783652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b2c15edd0 0x7f3b2c146590 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c06ded0 tx=0x7f3b2401b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b22000640 1 -- 172.21.15.173:0/82783652 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b240c0020 con 0x7f3b2c15edd0 2024-04-25T09:06:13.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b22000640 1 -- 172.21.15.173:0/82783652 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b24009800 con 0x7f3b2c15edd0 2024-04-25T09:06:13.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b22000640 1 -- 172.21.15.173:0/82783652 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24009bf0 con 0x7f3b2c15edd0 2024-04-25T09:06:13.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b30a00640 1 -- 172.21.15.173:0/82783652 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c149780 con 0x7f3b2c15edd0 2024-04-25T09:06:13.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b30a00640 1 -- 172.21.15.173:0/82783652 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c149e60 con 0x7f3b2c15edd0 2024-04-25T09:06:13.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.946+0000 7f3b30a00640 1 -- 172.21.15.173:0/82783652 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2c073a40 con 0x7f3b2c15edd0 2024-04-25T09:06:13.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.950+0000 7f3b22000640 1 -- 172.21.15.173:0/82783652 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3b240c3070 con 0x7f3b2c15edd0 2024-04-25T09:06:13.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.950+0000 7f3b22000640 1 --2- 172.21.15.173:0/82783652 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b0c066f90 0x7f3b0c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.950+0000 7f3b22000640 1 -- 172.21.15.173:0/82783652 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3b24121210 con 0x7f3b2c15edd0 2024-04-25T09:06:13.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.950+0000 7f3b29e00640 1 --2- 172.21.15.173:0/82783652 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b0c066f90 0x7f3b0c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.950+0000 7f3b29e00640 1 --2- 172.21.15.173:0/82783652 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b0c066f90 0x7f3b0c069450 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c009ac0 tx=0x7f3b1c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:13.954+0000 7f3b22000640 1 -- 172.21.15.173:0/82783652 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3b24018820 con 0x7f3b2c15edd0 2024-04-25T09:06:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.138+0000 7f3b30a00640 1 -- 172.21.15.173:0/82783652 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b2c06f1c0 con 0x7f3b2c15edd0 2024-04-25T09:06:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.138+0000 7f3b22000640 1 -- 172.21.15.173:0/82783652 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f3b240f1910 con 0x7f3b2c15edd0 2024-04-25T09:06:14.133 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:14.133 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:05:57.598642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:14.133 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 26 2024-04-25T09:06:14.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.142+0000 7f3b30a00640 1 -- 172.21.15.173:0/82783652 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b0c066f90 msgr2=0x7f3b0c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.142+0000 7f3b30a00640 1 --2- 172.21.15.173:0/82783652 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b0c066f90 0x7f3b0c069450 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c009ac0 tx=0x7f3b1c009190 comp rx=0 tx=0).stop 2024-04-25T09:06:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.142+0000 7f3b30a00640 1 -- 172.21.15.173:0/82783652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b2c15edd0 msgr2=0x7f3b2c146590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.142+0000 7f3b30a00640 1 --2- 172.21.15.173:0/82783652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b2c15edd0 0x7f3b2c146590 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c06ded0 tx=0x7f3b2401b9a0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.142+0000 7f3b30a00640 1 -- 172.21.15.173:0/82783652 shutdown_connections 2024-04-25T09:06:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.142+0000 7f3b30a00640 1 --2- 172.21.15.173:0/82783652 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b0c066f90 0x7f3b0c069450 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.142+0000 7f3b30a00640 1 --2- 172.21.15.173:0/82783652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b2c15edd0 0x7f3b2c146590 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.142+0000 7f3b30a00640 1 --2- 172.21.15.173:0/82783652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b2c0b3e70 0x7f3b2c146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.142+0000 7f3b30a00640 1 --2- 172.21.15.173:0/82783652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c0aefa0 0x7f3b2c144140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.142+0000 7f3b30a00640 1 -- 172.21.15.173:0/82783652 >> 172.21.15.173:0/82783652 conn(0x7f3b2c06ac90 msgr2=0x7f3b2c152980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.142+0000 7f3b30a00640 1 -- 172.21.15.173:0/82783652 shutdown_connections 2024-04-25T09:06:14.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.142+0000 7f3b30a00640 1 -- 172.21.15.173:0/82783652 wait complete. 2024-04-25T09:06:14.155 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path /scrub_test_path/ceph-qa-suite/new_file_0 2024-04-25T09:06:14.298 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:14.298 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0 2024-04-25T09:06:14.298 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:14.313 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T09:06:14.314 DEBUG:teuthology.orchestra.run.smithi173:> stdin-killer -- python3 -c ' 2024-04-25T09:06:14.314 DEBUG:teuthology.orchestra.run.smithi173:> import os 2024-04-25T09:06:14.314 DEBUG:teuthology.orchestra.run.smithi173:> import stat 2024-04-25T09:06:14.314 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:06:14.314 DEBUG:teuthology.orchestra.run.smithi173:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0").st_ino) 2024-04-25T09:06:14.314 DEBUG:teuthology.orchestra.run.smithi173:> ' 2024-04-25T09:06:14.443 INFO:teuthology.orchestra.run.smithi173.stdout:1099511630187 2024-04-25T09:06:14.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:06:14.453 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:06:14.453 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-04-25T09:06:14.527 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:06:14.547 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:06:14.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.650+0000 7f62c2a00640 1 Processor -- start 2024-04-25T09:06:14.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.650+0000 7f62c2a00640 1 -- start start 2024-04-25T09:06:14.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.654+0000 7f62c2a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f62bc0aeb90 0x7f62bc0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.654+0000 7f62c2a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62bc0ce2b0 0x7f62bc0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.654+0000 7f62c2a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62bc071570 con 0x7f62bc0aef70 2024-04-25T09:06:14.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.654+0000 7f62c2a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62bc071320 con 0x7f62bc0aeb90 2024-04-25T09:06:14.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.654+0000 7f62c2a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc072330 con 0x7f62bc0ce2b0 2024-04-25T09:06:14.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.654+0000 7f62bbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f62bc0aeb90 0x7f62bc0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.654+0000 7f62bbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f62bc0aeb90 0x7f62bc0cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46024/0 (socket says 172.21.15.173:46024) 2024-04-25T09:06:14.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.654+0000 7f62bbe00640 1 -- 172.21.15.173:0/4161996015 learned_addr learned my addr 172.21.15.173:0/4161996015 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:14.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.654+0000 7f62c0a00640 1 --2- 172.21.15.173:0/4161996015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62bc0ce2b0 0x7f62bc0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.654+0000 7f62bbe00640 1 -- 172.21.15.173:0/4161996015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62bc0ce2b0 msgr2=0x7f62bc0cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.654+0000 7f62bbe00640 1 --2- 172.21.15.173:0/4161996015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62bc0ce2b0 0x7f62bc0cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.654+0000 7f62bbe00640 1 -- 172.21.15.173:0/4161996015 >> v1:172.21.15.173:6789/0 conn(0x7f62bc0aef70 legacy=0x7f62bc0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.654+0000 7f62bbe00640 1 -- 172.21.15.173:0/4161996015 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc071850 con 0x7f62bc0aeb90 2024-04-25T09:06:14.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.654+0000 7f62c0a00640 1 --2- 172.21.15.173:0/4161996015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62bc0ce2b0 0x7f62bc0cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:14.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62bbe00640 1 --2- 172.21.15.173:0/4161996015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62bc0aeb90 0x7f62bc0cc0d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009e50 tx=0x7f62ac01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4811a031da12f354 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62baa00640 1 -- 172.21.15.173:0/4161996015 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0a5730 con 0x7f62bc0aeb90 2024-04-25T09:06:14.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62baa00640 1 -- 172.21.15.173:0/4161996015 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac0a58d0 con 0x7f62bc0aeb90 2024-04-25T09:06:14.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62baa00640 1 -- 172.21.15.173:0/4161996015 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0a5ca0 con 0x7f62bc0aeb90 2024-04-25T09:06:14.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62c2a00640 1 -- 172.21.15.173:0/4161996015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62bc0aeb90 msgr2=0x7f62bc0cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62c2a00640 1 --2- 172.21.15.173:0/4161996015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62bc0aeb90 0x7f62bc0cc0d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009e50 tx=0x7f62ac01c970 comp rx=0 tx=0).stop 2024-04-25T09:06:14.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62c2a00640 1 -- 172.21.15.173:0/4161996015 shutdown_connections 2024-04-25T09:06:14.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62c2a00640 1 --2- 172.21.15.173:0/4161996015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62bc0ce2b0 0x7f62bc0cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62c2a00640 1 --2- 172.21.15.173:0/4161996015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62bc0aeb90 0x7f62bc0cc0d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62c2a00640 1 -- 172.21.15.173:0/4161996015 >> 172.21.15.173:0/4161996015 conn(0x7f62bc06ac90 msgr2=0x7f62bc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:14.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62c2a00640 1 -- 172.21.15.173:0/4161996015 shutdown_connections 2024-04-25T09:06:14.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62c2a00640 1 -- 172.21.15.173:0/4161996015 wait complete. 2024-04-25T09:06:14.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62c2a00640 1 Processor -- start 2024-04-25T09:06:14.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62c2a00640 1 -- start start 2024-04-25T09:06:14.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62c2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62bc0aeb90 0x7f62bc14c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62c2a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62bc0aef70 0x7f62bc155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62c2a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62bc0ce2b0 0x7f62bc1564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62c2a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc15bb70 con 0x7f62bc0aeb90 2024-04-25T09:06:14.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62c2a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc15b9f0 con 0x7f62bc0ce2b0 2024-04-25T09:06:14.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62c2a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc15bcf0 con 0x7f62bc0aef70 2024-04-25T09:06:14.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62bbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62bc0aeb90 0x7f62bc14c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62bbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62bc0aeb90 0x7f62bc14c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46038/0 (socket says 172.21.15.173:46038) 2024-04-25T09:06:14.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.658+0000 7f62bbe00640 1 -- 172.21.15.173:0/2515922267 learned_addr learned my addr 172.21.15.173:0/2515922267 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:14.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.662+0000 7f62c0a00640 1 --2- 172.21.15.173:0/2515922267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62bc0ce2b0 0x7f62bc1564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.662+0000 7f62bb400640 1 --2- 172.21.15.173:0/2515922267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62bc0aef70 0x7f62bc155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.662+0000 7f62bbe00640 1 -- 172.21.15.173:0/2515922267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62bc0aef70 msgr2=0x7f62bc155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.662+0000 7f62bbe00640 1 --2- 172.21.15.173:0/2515922267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62bc0aef70 0x7f62bc155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.662+0000 7f62bbe00640 1 -- 172.21.15.173:0/2515922267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62bc0ce2b0 msgr2=0x7f62bc1564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.662+0000 7f62bbe00640 1 --2- 172.21.15.173:0/2515922267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62bc0ce2b0 0x7f62bc1564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.662+0000 7f62bbe00640 1 -- 172.21.15.173:0/2515922267 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc154c30 con 0x7f62bc0aeb90 2024-04-25T09:06:14.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.662+0000 7f62bbe00640 1 --2- 172.21.15.173:0/2515922267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62bc0aeb90 0x7f62bc14c600 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f62ac01a5a0 tx=0x7f62ac019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.662+0000 7f62b3e00640 1 -- 172.21.15.173:0/2515922267 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0bc020 con 0x7f62bc0aeb90 2024-04-25T09:06:14.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.662+0000 7f62b3e00640 1 -- 172.21.15.173:0/2515922267 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac0b8670 con 0x7f62bc0aeb90 2024-04-25T09:06:14.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.662+0000 7f62b3e00640 1 -- 172.21.15.173:0/2515922267 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0b8a40 con 0x7f62bc0aeb90 2024-04-25T09:06:14.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.662+0000 7f62c2a00640 1 -- 172.21.15.173:0/2515922267 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62bc154f10 con 0x7f62bc0aeb90 2024-04-25T09:06:14.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.662+0000 7f62c2a00640 1 -- 172.21.15.173:0/2515922267 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62bc1551f0 con 0x7f62bc0aeb90 2024-04-25T09:06:14.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.662+0000 7f62b3e00640 1 -- 172.21.15.173:0/2515922267 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f62ac0bf020 con 0x7f62bc0aeb90 2024-04-25T09:06:14.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.662+0000 7f62b3e00640 1 --2- 172.21.15.173:0/2515922267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f629c066f60 0x7f629c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.662+0000 7f62b3e00640 1 -- 172.21.15.173:0/2515922267 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f62ac120380 con 0x7f62bc0aeb90 2024-04-25T09:06:14.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62bb400640 1 --2- 172.21.15.173:0/2515922267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f629c066f60 0x7f629c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 Processor -- start 2024-04-25T09:06:14.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 -- start start 2024-04-25T09:06:14.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62bb400640 1 --2- 172.21.15.173:0/2515922267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f629c066f60 0x7f629c069420 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0b1fa0 tx=0x7f62a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656af3f180 0x55656af3f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656af3faa0 0x55656aef50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656aef5600 0x55656aef59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656ad42f20 con 0x55656af3f180 2024-04-25T09:06:14.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656accb000 con 0x55656aef5600 2024-04-25T09:06:14.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55656ad3efc0 con 0x55656af3faa0 2024-04-25T09:06:14.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62bbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656af3f180 0x55656af3f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62bbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656af3f180 0x55656af3f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46044/0 (socket says 172.21.15.173:46044) 2024-04-25T09:06:14.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62bbe00640 1 -- 172.21.15.173:0/2880128651 learned_addr learned my addr 172.21.15.173:0/2880128651 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:14.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62bbe00640 1 -- 172.21.15.173:0/2880128651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656af3faa0 msgr2=0x55656aef50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62bbe00640 1 --2- 172.21.15.173:0/2880128651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656af3faa0 0x55656aef50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62bbe00640 1 -- 172.21.15.173:0/2880128651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656aef5600 msgr2=0x55656aef59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62bbe00640 1 --2- 172.21.15.173:0/2880128651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656aef5600 0x55656aef59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62bbe00640 1 -- 172.21.15.173:0/2880128651 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55656ad1eba0 con 0x55656af3f180 2024-04-25T09:06:14.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62bbe00640 1 --2- 172.21.15.173:0/2880128651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656af3f180 0x55656af3f560 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0ecf50 tx=0x7f62ac009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7dda5a871dadc2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62b0c00640 1 -- 172.21.15.173:0/2880128651 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0f4c40 con 0x55656af3f180 2024-04-25T09:06:14.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62b0c00640 1 -- 172.21.15.173:0/2880128651 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac0f9200 con 0x55656af3f180 2024-04-25T09:06:14.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62b0c00640 1 -- 172.21.15.173:0/2880128651 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0eedf0 con 0x55656af3f180 2024-04-25T09:06:14.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 -- 172.21.15.173:0/2880128651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656af3f180 msgr2=0x55656af3f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/2880128651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656af3f180 0x55656af3f560 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0ecf50 tx=0x7f62ac009810 comp rx=0 tx=0).stop 2024-04-25T09:06:14.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 -- 172.21.15.173:0/2880128651 shutdown_connections 2024-04-25T09:06:14.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/2880128651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656aef5600 0x55656aef59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/2880128651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656af3faa0 0x55656aef50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/2880128651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656af3f180 0x55656af3f560 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 -- 172.21.15.173:0/2880128651 >> 172.21.15.173:0/2880128651 conn(0x55656aefb760 msgr2=0x55656aef39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:14.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 -- 172.21.15.173:0/2880128651 shutdown_connections 2024-04-25T09:06:14.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 -- 172.21.15.173:0/2880128651 wait complete. 2024-04-25T09:06:14.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 -- start start 2024-04-25T09:06:14.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.666+0000 7f62c5f5d000 1 Processor -- start 2024-04-25T09:06:14.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aef5600 0x55656aefa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656af3f180 0x55656aefabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656af3faa0 0x55656af2d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656ae009c0 con 0x55656aef5600 2024-04-25T09:06:14.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656acfd5d0 con 0x55656af3f180 2024-04-25T09:06:14.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55656ad42f20 con 0x55656af3faa0 2024-04-25T09:06:14.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 10 client.0 _ll_register_callbacks cb 0x55656aee0a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:14.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62bbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aef5600 0x55656aefa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62bbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aef5600 0x55656aefa6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46048/0 (socket says 172.21.15.173:46048) 2024-04-25T09:06:14.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62bbe00640 1 -- 172.21.15.173:0/600393738 learned_addr learned my addr 172.21.15.173:0/600393738 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:14.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c0a00640 1 --2- 172.21.15.173:0/600393738 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656af3faa0 0x55656af2d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62bb400640 1 --2- 172.21.15.173:0/600393738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656af3f180 0x55656aefabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62bbe00640 1 -- 172.21.15.173:0/600393738 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656af3faa0 msgr2=0x55656af2d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62bbe00640 1 --2- 172.21.15.173:0/600393738 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656af3faa0 0x55656af2d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62bbe00640 1 -- 172.21.15.173:0/600393738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656af3f180 msgr2=0x55656aefabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62bbe00640 1 --2- 172.21.15.173:0/600393738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656af3f180 0x55656aefabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62bbe00640 1 -- 172.21.15.173:0/600393738 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55656ad895a0 con 0x55656aef5600 2024-04-25T09:06:14.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62bbe00640 1 --2- 172.21.15.173:0/600393738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aef5600 0x55656aefa6a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f62ac01ce50 tx=0x7f62ac01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=decb509371043a28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62a5600640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:14.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62a5600640 1 -- 172.21.15.173:0/600393738 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0eedf0 con 0x55656aef5600 2024-04-25T09:06:14.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62a5600640 1 -- 172.21.15.173:0/600393738 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f62ac0b8be0 con 0x55656aef5600 2024-04-25T09:06:14.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 -- 172.21.15.173:0/600393738 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f62ac0f9200 con 0x55656aef5600 2024-04-25T09:06:14.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62a5600640 1 -- 172.21.15.173:0/600393738 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62ac0b8de0 con 0x55656aef5600 2024-04-25T09:06:14.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 10 client.6174 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:14.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 -- 172.21.15.173:0/600393738 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55656ad1a2b0 con 0x55656aef5600 2024-04-25T09:06:14.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62a5600640 1 -- 172.21.15.173:0/600393738 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac0f9200 con 0x55656aef5600 2024-04-25T09:06:14.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62a5600640 1 -- 172.21.15.173:0/600393738 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f62ac11e2b0 con 0x55656aef5600 2024-04-25T09:06:14.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 10 client.6174 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:14.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 10 client.6174 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:14.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 20 client.6174 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:14.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/600393738 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55656af2ce60 0x55656af2de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 4 client.6174 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:14.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 -- 172.21.15.173:0/600393738 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55656acdec70 con 0x55656af2ce60 2024-04-25T09:06:14.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62bb400640 1 --2- 172.21.15.173:0/600393738 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55656af2ce60 0x55656af2de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62bb400640 1 --2- 172.21.15.173:0/600393738 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55656af2ce60 0x55656af2de60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c24e11a81d9ffae server_cookie=7d13d6e04eb2c6f0 in_seq=0 out_seq=0 2024-04-25T09:06:14.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62a5600640 10 client.6174 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:14.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62a5600640 1 -- 172.21.15.173:0/600393738 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55656acdec70 con 0x55656af2ce60 2024-04-25T09:06:14.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62a5600640 10 client.6174 handle_command_reply: tid=0 2024-04-25T09:06:14.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 client.6174 shutdown 2024-04-25T09:06:14.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 -- 172.21.15.173:0/600393738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aef5600 msgr2=0x55656aefa6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/600393738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aef5600 0x55656aefa6a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f62ac01ce50 tx=0x7f62ac01c970 comp rx=0 tx=0).stop 2024-04-25T09:06:14.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 -- 172.21.15.173:0/600393738 shutdown_connections 2024-04-25T09:06:14.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/600393738 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55656af2ce60 0x55656af2de60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/600393738 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656af3faa0 0x55656af2d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/600393738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656af3f180 0x55656aefabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/600393738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aef5600 0x55656aefa6a0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62a5600640 0 client.6174 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:14.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.670+0000 7f62c5f5d000 1 -- 172.21.15.173:0/600393738 >> 172.21.15.173:0/600393738 conn(0x55656aefb760 msgr2=0x55656aef40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:14.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.674+0000 7f62c5f5d000 1 -- 172.21.15.173:0/600393738 shutdown_connections 2024-04-25T09:06:14.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.674+0000 7f62c5f5d000 1 -- 172.21.15.173:0/600393738 wait complete. 2024-04-25T09:06:14.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.674+0000 7f62c5f5d000 20 client.6174 trim_cache size 0 max 16384 2024-04-25T09:06:14.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.682+0000 7f62c5f5d000 1 Processor -- start 2024-04-25T09:06:14.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c5f5d000 1 -- start start 2024-04-25T09:06:14.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c5f5d000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aefb760 0x55656af558a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c5f5d000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656aef5600 0x55656aef4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c5f5d000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656af3f180 0x55656aef4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c5f5d000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc203250 con 0x55656aefb760 2024-04-25T09:06:14.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c5f5d000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc202390 con 0x55656aef5600 2024-04-25T09:06:14.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c5f5d000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc2017c0 con 0x55656af3f180 2024-04-25T09:06:14.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62bbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aefb760 0x55656af558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62bbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aefb760 0x55656af558a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46050/0 (socket says 172.21.15.173:46050) 2024-04-25T09:06:14.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62bbe00640 1 -- 172.21.15.173:0/2292103270 learned_addr learned my addr 172.21.15.173:0/2292103270 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:14.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c0a00640 1 --2- 172.21.15.173:0/2292103270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656af3f180 0x55656aef4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62bb400640 1 --2- 172.21.15.173:0/2292103270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656aef5600 0x55656aef4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62bbe00640 1 -- 172.21.15.173:0/2292103270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656af3f180 msgr2=0x55656aef4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62bbe00640 1 --2- 172.21.15.173:0/2292103270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656af3f180 0x55656aef4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62bbe00640 1 -- 172.21.15.173:0/2292103270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656aef5600 msgr2=0x55656aef4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62bbe00640 1 --2- 172.21.15.173:0/2292103270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656aef5600 0x55656aef4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62bbe00640 1 -- 172.21.15.173:0/2292103270 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55656af2e1d0 con 0x55656aefb760 2024-04-25T09:06:14.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c0a00640 1 --2- 172.21.15.173:0/2292103270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656af3f180 0x55656aef4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:14.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62bb400640 1 --2- 172.21.15.173:0/2292103270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656aef5600 0x55656aef4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:14.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62bbe00640 1 --2- 172.21.15.173:0/2292103270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aefb760 0x55656af558a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f62ac01cee0 tx=0x7f62ac107000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d43c16961ba7a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62a7e00640 1 -- 172.21.15.173:0/2292103270 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0f9200 con 0x55656aefb760 2024-04-25T09:06:14.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62a7e00640 1 -- 172.21.15.173:0/2292103270 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac0f0da0 con 0x55656aefb760 2024-04-25T09:06:14.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62a7e00640 1 -- 172.21.15.173:0/2292103270 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac11e2b0 con 0x55656aefb760 2024-04-25T09:06:14.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c5f5d000 1 -- 172.21.15.173:0/2292103270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aefb760 msgr2=0x55656af558a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/2292103270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aefb760 0x55656af558a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f62ac01cee0 tx=0x7f62ac107000 comp rx=0 tx=0).stop 2024-04-25T09:06:14.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c5f5d000 1 -- 172.21.15.173:0/2292103270 shutdown_connections 2024-04-25T09:06:14.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/2292103270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656af3f180 0x55656aef4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/2292103270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656aef5600 0x55656aef4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/2292103270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aefb760 0x55656af558a0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c5f5d000 1 -- 172.21.15.173:0/2292103270 >> 172.21.15.173:0/2292103270 conn(0x55656af2d5b0 msgr2=0x55656af4c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:14.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c5f5d000 1 -- 172.21.15.173:0/2292103270 shutdown_connections 2024-04-25T09:06:14.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c5f5d000 1 -- 172.21.15.173:0/2292103270 wait complete. 2024-04-25T09:06:14.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c5f5d000 1 -- start start 2024-04-25T09:06:14.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.686+0000 7f62c5f5d000 1 Processor -- start 2024-04-25T09:06:14.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aef5600 0x55656af9f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656aefb760 0x55656af9f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656af3f180 0x55656af53d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656ae009c0 con 0x55656aef5600 2024-04-25T09:06:14.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc201dc0 con 0x55656af3f180 2024-04-25T09:06:14.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55656ad42230 con 0x55656aefb760 2024-04-25T09:06:14.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 10 client.0 _ll_register_callbacks cb 0x55656aec1600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:14.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62bbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aef5600 0x55656af9f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62bbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aef5600 0x55656af9f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46054/0 (socket says 172.21.15.173:46054) 2024-04-25T09:06:14.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62bbe00640 1 -- 172.21.15.173:0/2693298257 learned_addr learned my addr 172.21.15.173:0/2693298257 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:14.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c0a00640 1 --2- 172.21.15.173:0/2693298257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656af3f180 0x55656af53d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62bb400640 1 --2- 172.21.15.173:0/2693298257 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656aefb760 0x55656af9f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62bbe00640 1 -- 172.21.15.173:0/2693298257 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656aefb760 msgr2=0x55656af9f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62bbe00640 1 --2- 172.21.15.173:0/2693298257 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656aefb760 0x55656af9f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62bbe00640 1 -- 172.21.15.173:0/2693298257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656af3f180 msgr2=0x55656af53d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62bbe00640 1 --2- 172.21.15.173:0/2693298257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656af3f180 0x55656af53d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62bbe00640 1 -- 172.21.15.173:0/2693298257 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55656accb250 con 0x55656aef5600 2024-04-25T09:06:14.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c0a00640 1 --2- 172.21.15.173:0/2693298257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656af3f180 0x55656af53d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:14.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62bb400640 1 --2- 172.21.15.173:0/2693298257 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656aefb760 0x55656af9f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:14.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62bbe00640 1 --2- 172.21.15.173:0/2693298257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aef5600 0x55656af9f3b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f62ac11e710 tx=0x7f62ac009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77970eacde2ec9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62a5600640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:14.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62a5600640 1 -- 172.21.15.173:0/2693298257 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0f9200 con 0x55656aef5600 2024-04-25T09:06:14.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62a5600640 1 -- 172.21.15.173:0/2693298257 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f62ac0f8d70 con 0x55656aef5600 2024-04-25T09:06:14.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 -- 172.21.15.173:0/2693298257 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f62ac0f0da0 con 0x55656aef5600 2024-04-25T09:06:14.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62a5600640 1 -- 172.21.15.173:0/2693298257 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62ac0f8fb0 con 0x55656aef5600 2024-04-25T09:06:14.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 10 client.6180 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:14.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 -- 172.21.15.173:0/2693298257 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55656acd7b90 con 0x55656aef5600 2024-04-25T09:06:14.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62a5600640 1 -- 172.21.15.173:0/2693298257 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac0f0da0 con 0x55656aef5600 2024-04-25T09:06:14.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62a5600640 1 -- 172.21.15.173:0/2693298257 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f62ac0f5b60 con 0x55656aef5600 2024-04-25T09:06:14.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 10 client.6180 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:14.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 10 client.6180 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:14.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 20 client.6180 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:14.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/2693298257 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55656af3faa0 0x55656af546c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 4 client.6180 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T09:06:14.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 -- 172.21.15.173:0/2693298257 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55656ad50460 con 0x55656af3faa0 2024-04-25T09:06:14.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62bb400640 1 --2- 172.21.15.173:0/2693298257 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55656af3faa0 0x55656af546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62bb400640 1 --2- 172.21.15.173:0/2693298257 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55656af3faa0 0x55656af546c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8ce22bc67605156 server_cookie=b4f906d43e7d7dc0 in_seq=0 out_seq=0 2024-04-25T09:06:14.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62a5600640 10 client.6180 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:14.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62a5600640 1 -- 172.21.15.173:0/2693298257 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55656ad50460 con 0x55656af3faa0 2024-04-25T09:06:14.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62a5600640 10 client.6180 handle_command_reply: tid=0 2024-04-25T09:06:14.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 client.6180 shutdown 2024-04-25T09:06:14.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 -- 172.21.15.173:0/2693298257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aef5600 msgr2=0x55656af9f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/2693298257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aef5600 0x55656af9f3b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f62ac11e710 tx=0x7f62ac009040 comp rx=0 tx=0).stop 2024-04-25T09:06:14.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 -- 172.21.15.173:0/2693298257 shutdown_connections 2024-04-25T09:06:14.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/2693298257 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55656af3faa0 0x55656af546c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/2693298257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55656af3f180 0x55656af53d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/2693298257 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55656aefb760 0x55656af9f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62a5600640 0 client.6180 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:14.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 --2- 172.21.15.173:0/2693298257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55656aef5600 0x55656af9f3b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 -- 172.21.15.173:0/2693298257 >> 172.21.15.173:0/2693298257 conn(0x55656af2d5b0 msgr2=0x55656aef3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:14.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 -- 172.21.15.173:0/2693298257 shutdown_connections 2024-04-25T09:06:14.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 1 -- 172.21.15.173:0/2693298257 wait complete. 2024-04-25T09:06:14.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c5f5d000 20 client.6180 trim_cache size 0 max 16384 2024-04-25T09:06:14.685 INFO:teuthology.orchestra.run.smithi173.stdout:[] 2024-04-25T09:06:14.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c2a00640 1 -- 172.21.15.173:0/2515922267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f629c066f60 msgr2=0x7f629c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c2a00640 1 --2- 172.21.15.173:0/2515922267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f629c066f60 0x7f629c069420 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0b1fa0 tx=0x7f62a8009040 comp rx=0 tx=0).stop 2024-04-25T09:06:14.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c2a00640 1 -- 172.21.15.173:0/2515922267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62bc0aeb90 msgr2=0x7f62bc14c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c2a00640 1 --2- 172.21.15.173:0/2515922267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62bc0aeb90 0x7f62bc14c600 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f62ac01a5a0 tx=0x7f62ac019710 comp rx=0 tx=0).stop 2024-04-25T09:06:14.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c2a00640 1 -- 172.21.15.173:0/2515922267 shutdown_connections 2024-04-25T09:06:14.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c2a00640 1 --2- 172.21.15.173:0/2515922267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f629c066f60 0x7f629c069420 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c2a00640 1 --2- 172.21.15.173:0/2515922267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62bc0ce2b0 0x7f62bc1564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c2a00640 1 --2- 172.21.15.173:0/2515922267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62bc0aef70 0x7f62bc155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c2a00640 1 --2- 172.21.15.173:0/2515922267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62bc0aeb90 0x7f62bc14c600 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.690+0000 7f62c2a00640 1 -- 172.21.15.173:0/2515922267 >> 172.21.15.173:0/2515922267 conn(0x7f62bc06ac90 msgr2=0x7f62bc0b2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:14.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.694+0000 7f62c2a00640 1 -- 172.21.15.173:0/2515922267 shutdown_connections 2024-04-25T09:06:14.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.694+0000 7f62c2a00640 1 -- 172.21.15.173:0/2515922267 wait complete. 2024-04-25T09:06:14.699 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 1000000096b.00000000 parent 2024-04-25T09:06:14.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.754+0000 7fe7c6e47080 1 Processor -- start 2024-04-25T09:06:14.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.754+0000 7fe7c6e47080 1 -- start start 2024-04-25T09:06:14.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aed481b820 0x55aed48a3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aed4836810 0x55aed482d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aed48abee0 0x55aed482dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed47939f0 con 0x55aed481b820 2024-04-25T09:06:14.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed4797950 con 0x55aed4836810 2024-04-25T09:06:14.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aed48c3030 con 0x55aed48abee0 2024-04-25T09:06:14.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aed481b820 0x55aed48a3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aed481b820 0x55aed48a3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46056/0 (socket says 172.21.15.173:46056) 2024-04-25T09:06:14.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c3400640 1 -- 172.21.15.173:0/1384832772 learned_addr learned my addr 172.21.15.173:0/1384832772 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:14.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c2a00640 1 --2- 172.21.15.173:0/1384832772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aed4836810 0x55aed482d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c3e00640 1 --2- 172.21.15.173:0/1384832772 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aed48abee0 0x55aed482dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c3400640 1 -- 172.21.15.173:0/1384832772 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aed48abee0 msgr2=0x55aed482dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c3400640 1 --2- 172.21.15.173:0/1384832772 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aed48abee0 0x55aed482dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c3400640 1 -- 172.21.15.173:0/1384832772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aed4836810 msgr2=0x55aed482d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c3400640 1 --2- 172.21.15.173:0/1384832772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aed4836810 0x55aed482d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c3400640 1 -- 172.21.15.173:0/1384832772 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aed48c0c80 con 0x55aed481b820 2024-04-25T09:06:14.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c3400640 1 --2- 172.21.15.173:0/1384832772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aed481b820 0x55aed48a3e60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40ad040 tx=0x7fe7b4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b274d130dcd34f68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c1600640 1 -- 172.21.15.173:0/1384832772 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b40af040 con 0x55aed481b820 2024-04-25T09:06:14.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c1600640 1 -- 172.21.15.173:0/1384832772 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b40b9070 con 0x55aed481b820 2024-04-25T09:06:14.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c1600640 1 -- 172.21.15.173:0/1384832772 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b40aa9d0 con 0x55aed481b820 2024-04-25T09:06:14.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 -- 172.21.15.173:0/1384832772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aed481b820 msgr2=0x55aed48a3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 --2- 172.21.15.173:0/1384832772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aed481b820 0x55aed48a3e60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40ad040 tx=0x7fe7b4003030 comp rx=0 tx=0).stop 2024-04-25T09:06:14.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 -- 172.21.15.173:0/1384832772 shutdown_connections 2024-04-25T09:06:14.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 --2- 172.21.15.173:0/1384832772 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aed48abee0 0x55aed482dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 --2- 172.21.15.173:0/1384832772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aed4836810 0x55aed482d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 --2- 172.21.15.173:0/1384832772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aed481b820 0x55aed48a3e60 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 -- 172.21.15.173:0/1384832772 >> 172.21.15.173:0/1384832772 conn(0x55aed47ed5a0 msgr2=0x55aed48c51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:14.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 -- 172.21.15.173:0/1384832772 shutdown_connections 2024-04-25T09:06:14.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 -- 172.21.15.173:0/1384832772 wait complete. 2024-04-25T09:06:14.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 Processor -- start 2024-04-25T09:06:14.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 -- start start 2024-04-25T09:06:14.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aed481b820 0x55aed48340c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aed4836810 0x55aed48c0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aed48abee0 0x55aed48358f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed48c11c0 con 0x55aed4836810 2024-04-25T09:06:14.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed48c0f20 con 0x55aed48abee0 2024-04-25T09:06:14.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c6e47080 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aed48c1460 con 0x55aed481b820 2024-04-25T09:06:14.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aed4836810 0x55aed48c0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aed4836810 0x55aed48c0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46062/0 (socket says 172.21.15.173:46062) 2024-04-25T09:06:14.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.758+0000 7fe7c2a00640 1 -- 172.21.15.173:0/3449900329 learned_addr learned my addr 172.21.15.173:0/3449900329 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:14.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.762+0000 7fe7c3400640 1 --2- 172.21.15.173:0/3449900329 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aed481b820 0x55aed48340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.762+0000 7fe7c3e00640 1 --2- 172.21.15.173:0/3449900329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aed48abee0 0x55aed48358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.762+0000 7fe7c2a00640 1 -- 172.21.15.173:0/3449900329 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aed481b820 msgr2=0x55aed48340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.762+0000 7fe7c2a00640 1 --2- 172.21.15.173:0/3449900329 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aed481b820 0x55aed48340c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.762+0000 7fe7c2a00640 1 -- 172.21.15.173:0/3449900329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aed48abee0 msgr2=0x55aed48358f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.762+0000 7fe7c2a00640 1 --2- 172.21.15.173:0/3449900329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aed48abee0 0x55aed48358f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.762+0000 7fe7c2a00640 1 -- 172.21.15.173:0/3449900329 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aed48349d0 con 0x55aed4836810 2024-04-25T09:06:14.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.762+0000 7fe7c2a00640 1 --2- 172.21.15.173:0/3449900329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aed4836810 0x55aed48c0310 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000dd70 tx=0x7fe7b000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.762+0000 7fe7bbe00640 1 -- 172.21.15.173:0/3449900329 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0017670 con 0x55aed4836810 2024-04-25T09:06:14.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.762+0000 7fe7bbe00640 1 -- 172.21.15.173:0/3449900329 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b0012070 con 0x55aed4836810 2024-04-25T09:06:14.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.762+0000 7fe7bbe00640 1 -- 172.21.15.173:0/3449900329 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0017a50 con 0x55aed4836810 2024-04-25T09:06:14.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.762+0000 7fe7c6e47080 1 -- 172.21.15.173:0/3449900329 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55aed4834c70 con 0x55aed4836810 2024-04-25T09:06:14.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.762+0000 7fe7c6e47080 1 -- 172.21.15.173:0/3449900329 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aed48351b0 con 0x55aed4836810 2024-04-25T09:06:14.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.762+0000 7fe7bbe00640 1 -- 172.21.15.173:0/3449900329 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe7b0009070 con 0x55aed4836810 2024-04-25T09:06:14.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.762+0000 7fe7bbe00640 1 --2- 172.21.15.173:0/3449900329 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe7a4065970 0x7fe7a4067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.762+0000 7fe7bbe00640 1 -- 172.21.15.173:0/3449900329 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe7b0017e00 con 0x55aed4836810 2024-04-25T09:06:14.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.762+0000 7fe7c3400640 1 --2- 172.21.15.173:0/3449900329 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe7a4065970 0x7fe7a4067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.766+0000 7fe7c6e47080 1 --2- 172.21.15.173:0/3449900329 >> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] conn(0x55aed4835e30 0x55aed48a8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.766+0000 7fe7c6e47080 1 -- 172.21.15.173:0/3449900329 --> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] -- osd_op(unknown.0.0:1 8.a 8:51f47cfd:::1000000096b.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56) v9 -- 0x55aed48c21a0 con 0x55aed4835e30 2024-04-25T09:06:14.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.766+0000 7fe7c3e00640 1 --2- 172.21.15.173:0/3449900329 >> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] conn(0x55aed4835e30 0x55aed48a8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.766+0000 7fe7c3400640 1 --2- 172.21.15.173:0/3449900329 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe7a4065970 0x7fe7a4067e30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40ad040 tx=0x7fe7b40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.766+0000 7fe7c3e00640 1 --2- 172.21.15.173:0/3449900329 >> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] conn(0x55aed4835e30 0x55aed48a8270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.766+0000 7fe7c3e00640 1 -- 172.21.15.173:0/3449900329 <== osd.1 v2:172.21.15.173:6800/3130238007 1 ==== osd_op_reply(1 1000000096b.00000000 [rmxattr] v56'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe7bc003950 con 0x55aed4835e30 2024-04-25T09:06:14.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.766+0000 7fe7c6e47080 1 -- 172.21.15.173:0/3449900329 >> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] conn(0x55aed4835e30 msgr2=0x55aed48a8270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.766+0000 7fe7c6e47080 1 --2- 172.21.15.173:0/3449900329 >> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] conn(0x55aed4835e30 0x55aed48a8270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.766+0000 7fe7c6e47080 1 -- 172.21.15.173:0/3449900329 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe7a4065970 msgr2=0x7fe7a4067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.766+0000 7fe7c6e47080 1 --2- 172.21.15.173:0/3449900329 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe7a4065970 0x7fe7a4067e30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40ad040 tx=0x7fe7b40a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:14.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.766+0000 7fe7c6e47080 1 -- 172.21.15.173:0/3449900329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aed4836810 msgr2=0x55aed48c0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.766+0000 7fe7c6e47080 1 --2- 172.21.15.173:0/3449900329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aed4836810 0x55aed48c0310 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000dd70 tx=0x7fe7b000b6d0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.766+0000 7fe7c3e00640 1 -- 172.21.15.173:0/3449900329 reap_dead start 2024-04-25T09:06:14.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.766+0000 7fe7c6e47080 1 -- 172.21.15.173:0/3449900329 shutdown_connections 2024-04-25T09:06:14.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.766+0000 7fe7c6e47080 1 -- 172.21.15.173:0/3449900329 >> 172.21.15.173:0/3449900329 conn(0x55aed47ed5a0 msgr2=0x55aed48ab190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:14.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.766+0000 7fe7c6e47080 1 -- 172.21.15.173:0/3449900329 shutdown_connections 2024-04-25T09:06:14.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.766+0000 7fe7c6e47080 1 -- 172.21.15.173:0/3449900329 wait complete. 2024-04-25T09:06:14.760 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' 2024-04-25T09:06:14.760 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:06:14.760 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_0 2024-04-25T09:06:14.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.950+0000 7fbe1b600640 1 Processor -- start 2024-04-25T09:06:14.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.950+0000 7fbe1b600640 1 -- start start 2024-04-25T09:06:14.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.950+0000 7fbe1b600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe14070310 0x7fbe140b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.950+0000 7fbe1b600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbe140cd9d0 0x7fbe140cc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.950+0000 7fbe1b600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe140cf6b0 con 0x7fbe140706f0 2024-04-25T09:06:14.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.950+0000 7fbe1b600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe140d02c0 con 0x7fbe140cd9d0 2024-04-25T09:06:14.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.950+0000 7fbe1b600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe140cf990 con 0x7fbe14070310 2024-04-25T09:06:14.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.950+0000 7fbe13e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fbe140706f0 0x7fbe140cd2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:51456/0 (socket says 172.21.15.173:51456) 2024-04-25T09:06:14.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.950+0000 7fbe13e00640 1 -- 172.21.15.173:0/3185691447 learned_addr learned my addr 172.21.15.173:0/3185691447 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:14.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.950+0000 7fbe18c00640 1 --2- 172.21.15.173:0/3185691447 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe14070310 0x7fbe140b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.950+0000 7fbe19600640 1 --2- 172.21.15.173:0/3185691447 >> v2:172.21.15.194:3300/0 conn(0x7fbe140cd9d0 0x7fbe140cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.950+0000 7fbe13400640 1 -- 172.21.15.173:0/3185691447 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804000010 0 0) 0x7fbe140cf6b0 con 0x7fbe140706f0 2024-04-25T09:06:14.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.950+0000 7fbe13400640 1 -- 172.21.15.173:0/3185691447 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf8003530 con 0x7fbe140706f0 2024-04-25T09:06:14.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.950+0000 7fbe18c00640 1 -- 172.21.15.173:0/3185691447 >> v2:172.21.15.194:3300/0 conn(0x7fbe140cd9d0 msgr2=0x7fbe140cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.950+0000 7fbe18c00640 1 --2- 172.21.15.173:0/3185691447 >> v2:172.21.15.194:3300/0 conn(0x7fbe140cd9d0 0x7fbe140cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.950+0000 7fbe18c00640 1 -- 172.21.15.173:0/3185691447 >> v1:172.21.15.173:6789/0 conn(0x7fbe140706f0 legacy=0x7fbe140cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.950+0000 7fbe18c00640 1 -- 172.21.15.173:0/3185691447 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe140cfc70 con 0x7fbe14070310 2024-04-25T09:06:14.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.950+0000 7fbe19600640 1 --2- 172.21.15.173:0/3185691447 >> v2:172.21.15.194:3300/0 conn(0x7fbe140cd9d0 0x7fbe140cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:14.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.954+0000 7fbe18c00640 1 --2- 172.21.15.173:0/3185691447 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe14070310 0x7fbe140b36f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009d90 tx=0x7fbe0401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ba7027e148ee917 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.954+0000 7fbe13400640 1 -- 172.21.15.173:0/3185691447 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe040b2070 con 0x7fbe14070310 2024-04-25T09:06:14.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.954+0000 7fbe13400640 1 -- 172.21.15.173:0/3185691447 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe040a5990 con 0x7fbe14070310 2024-04-25T09:06:14.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.954+0000 7fbe13400640 1 -- 172.21.15.173:0/3185691447 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe040a5d60 con 0x7fbe14070310 2024-04-25T09:06:14.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe1b600640 1 -- 172.21.15.173:0/3185691447 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe14070310 msgr2=0x7fbe140b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe1b600640 1 --2- 172.21.15.173:0/3185691447 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe14070310 0x7fbe140b36f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009d90 tx=0x7fbe0401c8b0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe1b600640 1 -- 172.21.15.173:0/3185691447 shutdown_connections 2024-04-25T09:06:14.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe1b600640 1 --2- 172.21.15.173:0/3185691447 >> v2:172.21.15.194:3300/0 conn(0x7fbe140cd9d0 0x7fbe140cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe1b600640 1 --2- 172.21.15.173:0/3185691447 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe14070310 0x7fbe140b36f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe1b600640 1 -- 172.21.15.173:0/3185691447 >> 172.21.15.173:0/3185691447 conn(0x7fbe140b23f0 msgr2=0x7fbe140b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:14.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe1b600640 1 -- 172.21.15.173:0/3185691447 shutdown_connections 2024-04-25T09:06:14.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe1b600640 1 -- 172.21.15.173:0/3185691447 wait complete. 2024-04-25T09:06:14.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe1b600640 1 Processor -- start 2024-04-25T09:06:14.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe1b600640 1 -- start start 2024-04-25T09:06:14.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe1b600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe14070310 0x7fbe14140ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe1b600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe140706f0 0x7fbe141474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe1b600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe140cd9d0 0x7fbe141479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe1b600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe141655d0 con 0x7fbe140706f0 2024-04-25T09:06:14.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe1b600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14165450 con 0x7fbe14070310 2024-04-25T09:06:14.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe1b600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14165750 con 0x7fbe140cd9d0 2024-04-25T09:06:14.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe13e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe140706f0 0x7fbe141474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe13e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe140706f0 0x7fbe141474a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46078/0 (socket says 172.21.15.173:46078) 2024-04-25T09:06:14.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe13e00640 1 -- 172.21.15.173:0/433738730 learned_addr learned my addr 172.21.15.173:0/433738730 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:14.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe19600640 1 --2- 172.21.15.173:0/433738730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe140cd9d0 0x7fbe141479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe13e00640 1 -- 172.21.15.173:0/433738730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe140cd9d0 msgr2=0x7fbe141479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe18c00640 1 --2- 172.21.15.173:0/433738730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe14070310 0x7fbe14140ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe13e00640 1 --2- 172.21.15.173:0/433738730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe140cd9d0 0x7fbe141479e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe13e00640 1 -- 172.21.15.173:0/433738730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe14070310 msgr2=0x7fbe14140ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe13e00640 1 --2- 172.21.15.173:0/433738730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe14070310 0x7fbe14140ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe13e00640 1 -- 172.21.15.173:0/433738730 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe14151690 con 0x7fbe140706f0 2024-04-25T09:06:14.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe19600640 1 --2- 172.21.15.173:0/433738730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe140cd9d0 0x7fbe141479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:14.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe18c00640 1 --2- 172.21.15.173:0/433738730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe14070310 0x7fbe14140ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:14.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe13e00640 1 --2- 172.21.15.173:0/433738730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe140706f0 0x7fbe141474a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000c450 tx=0x7fbe0000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe10c00640 1 -- 172.21.15.173:0/433738730 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00017070 con 0x7fbe140706f0 2024-04-25T09:06:14.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.958+0000 7fbe10c00640 1 -- 172.21.15.173:0/433738730 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe00005cf0 con 0x7fbe140706f0 2024-04-25T09:06:14.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.962+0000 7fbe10c00640 1 -- 172.21.15.173:0/433738730 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00007290 con 0x7fbe140706f0 2024-04-25T09:06:14.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.962+0000 7fbe1b600640 1 -- 172.21.15.173:0/433738730 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1414eb30 con 0x7fbe140706f0 2024-04-25T09:06:14.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.962+0000 7fbe1b600640 1 -- 172.21.15.173:0/433738730 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1414f900 con 0x7fbe140706f0 2024-04-25T09:06:14.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.962+0000 7fbe10c00640 1 -- 172.21.15.173:0/433738730 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbe0001a070 con 0x7fbe140706f0 2024-04-25T09:06:14.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.962+0000 7fbe10c00640 1 --2- 172.21.15.173:0/433738730 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbdf4066f60 0x7fbdf4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.962+0000 7fbe10c00640 1 -- 172.21.15.173:0/433738730 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbe00084580 con 0x7fbe140706f0 2024-04-25T09:06:14.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.962+0000 7fbe18c00640 1 --2- 172.21.15.173:0/433738730 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbdf4066f60 0x7fbdf4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.962+0000 7fbe1ea1b000 1 Processor -- start 2024-04-25T09:06:14.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.962+0000 7fbe1ea1b000 1 -- start start 2024-04-25T09:06:14.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.962+0000 7fbe18c00640 1 --2- 172.21.15.173:0/433738730 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbdf4066f60 0x7fbdf4069420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbe040af000 tx=0x7fbe040a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe1ea1b000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6d650 0x55afb3f6da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe1ea1b000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f6df70 0x55afb3f207f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe1ea1b000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 0x55afb3f21110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe1ea1b000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afb3d6cce0 con 0x55afb3f20d30 2024-04-25T09:06:14.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe1ea1b000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afb3cf5530 con 0x55afb3f6df70 2024-04-25T09:06:14.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe1ea1b000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55afb3d68d80 con 0x55afb3f6d650 2024-04-25T09:06:14.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe19600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 0x55afb3f21110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe19600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 0x55afb3f21110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46082/0 (socket says 172.21.15.173:46082) 2024-04-25T09:06:14.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe19600640 1 -- 172.21.15.173:0/2271562886 learned_addr learned my addr 172.21.15.173:0/2271562886 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:14.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe18c00640 1 --2- 172.21.15.173:0/2271562886 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6d650 0x55afb3f6da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe13e00640 1 --2- 172.21.15.173:0/2271562886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f6df70 0x55afb3f207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe19600640 1 -- 172.21.15.173:0/2271562886 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6d650 msgr2=0x55afb3f6da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe19600640 1 --2- 172.21.15.173:0/2271562886 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6d650 0x55afb3f6da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe19600640 1 -- 172.21.15.173:0/2271562886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f6df70 msgr2=0x55afb3f207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe19600640 1 --2- 172.21.15.173:0/2271562886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f6df70 0x55afb3f207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe19600640 1 -- 172.21.15.173:0/2271562886 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55afb3d67cd0 con 0x55afb3f20d30 2024-04-25T09:06:14.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe19600640 1 --2- 172.21.15.173:0/2271562886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 0x55afb3f21110 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0099e0 tx=0x7fbe0c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a0d9ad19e6421f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe09600640 1 -- 172.21.15.173:0/2271562886 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c018070 con 0x55afb3f20d30 2024-04-25T09:06:14.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe09600640 1 -- 172.21.15.173:0/2271562886 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c010ca0 con 0x55afb3f20d30 2024-04-25T09:06:14.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe09600640 1 -- 172.21.15.173:0/2271562886 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c00f040 con 0x55afb3f20d30 2024-04-25T09:06:14.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/2271562886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 msgr2=0x55afb3f21110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/2271562886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 0x55afb3f21110 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0099e0 tx=0x7fbe0c009190 comp rx=0 tx=0).stop 2024-04-25T09:06:14.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/2271562886 shutdown_connections 2024-04-25T09:06:14.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/2271562886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 0x55afb3f21110 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/2271562886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f6df70 0x55afb3f207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/2271562886 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6d650 0x55afb3f6da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/2271562886 >> 172.21.15.173:0/2271562886 conn(0x55afb3f4e3f0 msgr2=0x55afb3f507e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:14.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/2271562886 shutdown_connections 2024-04-25T09:06:14.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/2271562886 wait complete. 2024-04-25T09:06:14.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe1ea1b000 1 -- start start 2024-04-25T09:06:14.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.966+0000 7fbe1ea1b000 1 Processor -- start 2024-04-25T09:06:14.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 0x55afb3f39060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6d650 0x55afb3f395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f6df70 0x55afb3f39ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afb3d27bc0 con 0x55afb3f20d30 2024-04-25T09:06:14.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afb3d138e0 con 0x55afb3f6df70 2024-04-25T09:06:14.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55afb3f28130 con 0x55afb3f6d650 2024-04-25T09:06:14.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 10 client.0 _ll_register_callbacks cb 0x55afb3f0a4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:14.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe18c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 0x55afb3f39060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe18c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 0x55afb3f39060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46098/0 (socket says 172.21.15.173:46098) 2024-04-25T09:06:14.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe18c00640 1 -- 172.21.15.173:0/1016342296 learned_addr learned my addr 172.21.15.173:0/1016342296 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:14.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe19600640 1 --2- 172.21.15.173:0/1016342296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f6df70 0x55afb3f39ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe13e00640 1 --2- 172.21.15.173:0/1016342296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6d650 0x55afb3f395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe18c00640 1 -- 172.21.15.173:0/1016342296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6d650 msgr2=0x55afb3f395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe18c00640 1 --2- 172.21.15.173:0/1016342296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6d650 0x55afb3f395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe18c00640 1 -- 172.21.15.173:0/1016342296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f6df70 msgr2=0x55afb3f39ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe18c00640 1 --2- 172.21.15.173:0/1016342296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f6df70 0x55afb3f39ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe18c00640 1 -- 172.21.15.173:0/1016342296 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55afb3d7a950 con 0x55afb3f20d30 2024-04-25T09:06:14.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe18c00640 1 --2- 172.21.15.173:0/1016342296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 0x55afb3f39060 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbe0401ce20 tx=0x7fbe0401b0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa457b99c65802b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbdfe000640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:14.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbdfe000640 1 -- 172.21.15.173:0/1016342296 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe040b2040 con 0x55afb3f20d30 2024-04-25T09:06:14.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbdfe000640 1 -- 172.21.15.173:0/1016342296 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbe040b8bb0 con 0x55afb3f20d30 2024-04-25T09:06:14.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/1016342296 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe0c010ca0 con 0x55afb3f20d30 2024-04-25T09:06:14.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbdfe000640 1 -- 172.21.15.173:0/1016342296 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe040d2050 con 0x55afb3f20d30 2024-04-25T09:06:14.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 10 client.6201 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:14.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/1016342296 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55afb3de9790 con 0x55afb3f20d30 2024-04-25T09:06:14.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbdfe000640 1 -- 172.21.15.173:0/1016342296 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c010ca0 con 0x55afb3f20d30 2024-04-25T09:06:14.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbdfe000640 1 -- 172.21.15.173:0/1016342296 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbe040d5020 con 0x55afb3f20d30 2024-04-25T09:06:14.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 10 client.6201 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:14.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 10 client.6201 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:14.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 20 client.6201 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:14.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/1016342296 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55afb3f3a380 0x55afb3f7ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 4 client.6201 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:14.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/1016342296 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55afb3d08b80 con 0x55afb3f3a380 2024-04-25T09:06:14.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe13e00640 1 --2- 172.21.15.173:0/1016342296 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55afb3f3a380 0x55afb3f7ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe13e00640 1 --2- 172.21.15.173:0/1016342296 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55afb3f3a380 0x55afb3f7ebc0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b9968a0fae40618 server_cookie=9532390c53b847b2 in_seq=0 out_seq=0 2024-04-25T09:06:14.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbdfe000640 10 client.6201 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:14.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbdfe000640 1 -- 172.21.15.173:0/1016342296 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55afb3d08b80 con 0x55afb3f3a380 2024-04-25T09:06:14.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbdfe000640 10 client.6201 handle_command_reply: tid=0 2024-04-25T09:06:14.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 1 client.6201 shutdown 2024-04-25T09:06:14.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/1016342296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 msgr2=0x55afb3f39060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.970+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/1016342296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 0x55afb3f39060 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbe0401ce20 tx=0x7fbe0401b0f0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.974+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/1016342296 shutdown_connections 2024-04-25T09:06:14.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.974+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/1016342296 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55afb3f3a380 0x55afb3f7ebc0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.974+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/1016342296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f6df70 0x55afb3f39ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.974+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/1016342296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6d650 0x55afb3f395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.974+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/1016342296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 0x55afb3f39060 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.974+0000 7fbdfe000640 0 client.6201 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:14.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.974+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/1016342296 >> 172.21.15.173:0/1016342296 conn(0x55afb3f4e3f0 msgr2=0x55afb3f507e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:14.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.974+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/1016342296 shutdown_connections 2024-04-25T09:06:14.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.974+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/1016342296 wait complete. 2024-04-25T09:06:14.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.974+0000 7fbe1ea1b000 20 client.6201 trim_cache size 0 max 16384 2024-04-25T09:06:14.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.986+0000 7fbe1ea1b000 1 Processor -- start 2024-04-25T09:06:14.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.986+0000 7fbe1ea1b000 1 -- start start 2024-04-25T09:06:14.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 0x55afb3f4d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6d650 0x55afb3f4c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f6df70 0x55afb3f4cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe141feea0 con 0x55afb3f20d30 2024-04-25T09:06:14.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14167a20 con 0x55afb3f6df70 2024-04-25T09:06:14.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14146b30 con 0x55afb3f6d650 2024-04-25T09:06:14.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe18c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 0x55afb3f4d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe18c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 0x55afb3f4d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46108/0 (socket says 172.21.15.173:46108) 2024-04-25T09:06:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe18c00640 1 -- 172.21.15.173:0/443778874 learned_addr learned my addr 172.21.15.173:0/443778874 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe13e00640 1 --2- 172.21.15.173:0/443778874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6d650 0x55afb3f4c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe19600640 1 --2- 172.21.15.173:0/443778874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f6df70 0x55afb3f4cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe18c00640 1 -- 172.21.15.173:0/443778874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6d650 msgr2=0x55afb3f4c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe18c00640 1 --2- 172.21.15.173:0/443778874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6d650 0x55afb3f4c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe18c00640 1 -- 172.21.15.173:0/443778874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f6df70 msgr2=0x55afb3f4cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe18c00640 1 --2- 172.21.15.173:0/443778874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f6df70 0x55afb3f4cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe18c00640 1 -- 172.21.15.173:0/443778874 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55afb3f6dda0 con 0x55afb3f20d30 2024-04-25T09:06:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe18c00640 1 --2- 172.21.15.173:0/443778874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 0x55afb3f4d9a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fbe0401cd90 tx=0x7fbe040bb070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c40c6abf07b36d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe08c00640 1 -- 172.21.15.173:0/443778874 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe040db070 con 0x55afb3f20d30 2024-04-25T09:06:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe08c00640 1 -- 172.21.15.173:0/443778874 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe040ca070 con 0x55afb3f20d30 2024-04-25T09:06:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe08c00640 1 -- 172.21.15.173:0/443778874 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe040b2040 con 0x55afb3f20d30 2024-04-25T09:06:14.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/443778874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 msgr2=0x55afb3f4d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/443778874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 0x55afb3f4d9a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fbe0401cd90 tx=0x7fbe040bb070 comp rx=0 tx=0).stop 2024-04-25T09:06:14.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/443778874 shutdown_connections 2024-04-25T09:06:14.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/443778874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f6df70 0x55afb3f4cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/443778874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6d650 0x55afb3f4c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/443778874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f20d30 0x55afb3f4d9a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/443778874 >> 172.21.15.173:0/443778874 conn(0x55afb3f4e3f0 msgr2=0x55afb3f398f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:14.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/443778874 shutdown_connections 2024-04-25T09:06:14.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/443778874 wait complete. 2024-04-25T09:06:14.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 -- start start 2024-04-25T09:06:14.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 Processor -- start 2024-04-25T09:06:14.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f20d30 0x55afb3f1e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f6d650 0x55afb3f1e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6df70 0x55afb3f7cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afb3f1b250 con 0x55afb3f6d650 2024-04-25T09:06:14.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14147130 con 0x55afb3f20d30 2024-04-25T09:06:14.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55afb3f28130 con 0x55afb3f6df70 2024-04-25T09:06:14.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.990+0000 7fbe1ea1b000 10 client.0 _ll_register_callbacks cb 0x7fbe1406f420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:14.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe13e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f6d650 0x55afb3f1e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe19600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6df70 0x55afb3f7cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe18c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f20d30 0x55afb3f1e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe13e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f6d650 0x55afb3f1e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46114/0 (socket says 172.21.15.173:46114) 2024-04-25T09:06:14.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe19600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6df70 0x55afb3f7cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:49716/0 (socket says 172.21.15.173:49716) 2024-04-25T09:06:14.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe18c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f20d30 0x55afb3f1e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:51162/0 (socket says 172.21.15.173:51162) 2024-04-25T09:06:14.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe13e00640 1 -- 172.21.15.173:0/679708068 learned_addr learned my addr 172.21.15.173:0/679708068 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:14.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe13e00640 1 -- 172.21.15.173:0/679708068 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6df70 msgr2=0x55afb3f7cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe13e00640 1 --2- 172.21.15.173:0/679708068 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6df70 0x55afb3f7cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe13e00640 1 -- 172.21.15.173:0/679708068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f20d30 msgr2=0x55afb3f1e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe13e00640 1 --2- 172.21.15.173:0/679708068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f20d30 0x55afb3f1e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe13e00640 1 -- 172.21.15.173:0/679708068 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55afb3d326f0 con 0x55afb3f6d650 2024-04-25T09:06:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe13e00640 1 --2- 172.21.15.173:0/679708068 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f6d650 0x55afb3f1e970 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbe00051160 tx=0x7fbe00084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced503f64a9dad67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbdfe000640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbdfe000640 1 -- 172.21.15.173:0/679708068 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00051370 con 0x55afb3f6d650 2024-04-25T09:06:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbdfe000640 1 -- 172.21.15.173:0/679708068 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbe0005cf80 con 0x55afb3f6d650 2024-04-25T09:06:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/679708068 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe040ca070 con 0x55afb3f6d650 2024-04-25T09:06:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbdfe000640 1 -- 172.21.15.173:0/679708068 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe00051510 con 0x55afb3f6d650 2024-04-25T09:06:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 10 client.6207 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/679708068 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55afb3d28c80 con 0x55afb3f6d650 2024-04-25T09:06:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbdfe000640 1 -- 172.21.15.173:0/679708068 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe040ca070 con 0x55afb3f6d650 2024-04-25T09:06:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbdfe000640 1 -- 172.21.15.173:0/679708068 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbe0007e070 con 0x55afb3f6d650 2024-04-25T09:06:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 10 client.6207 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 10 client.6207 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 20 client.6207 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/679708068 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55afb3f7d0f0 0x55afb3f7d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:14.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 4 client.6207 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-04-25T09:06:14.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/679708068 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) v1 -- 0x55afb3d7a220 con 0x55afb3f7d0f0 2024-04-25T09:06:14.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe18c00640 1 --2- 172.21.15.173:0/679708068 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55afb3f7d0f0 0x55afb3f7d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:14.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe18c00640 1 --2- 172.21.15.173:0/679708068 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55afb3f7d0f0 0x55afb3f7d4d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e46bd880b6fa1315 server_cookie=b114e09d5efc48dc in_seq=0 out_seq=0 2024-04-25T09:06:14.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbdfe000640 10 client.6207 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:14.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbdfe000640 1 -- 172.21.15.173:0/679708068 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55afb3d7a220 con 0x55afb3f7d0f0 2024-04-25T09:06:14.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbdfe000640 10 client.6207 handle_command_reply: tid=0 2024-04-25T09:06:14.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 1 client.6207 shutdown 2024-04-25T09:06:14.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/679708068 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f6d650 msgr2=0x55afb3f1e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/679708068 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f6d650 0x55afb3f1e970 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbe00051160 tx=0x7fbe00084040 comp rx=0 tx=0).stop 2024-04-25T09:06:14.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/679708068 shutdown_connections 2024-04-25T09:06:14.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/679708068 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55afb3f7d0f0 0x55afb3f7d4d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/679708068 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afb3f6df70 0x55afb3f7cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/679708068 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afb3f6d650 0x55afb3f1e970 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 1 --2- 172.21.15.173:0/679708068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afb3f20d30 0x55afb3f1e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/679708068 >> 172.21.15.173:0/679708068 conn(0x55afb3f4e3f0 msgr2=0x55afb3f379e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:14.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbdfe000640 0 client.6207 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:14.988 INFO:tasks.ceph.mds.a.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbf79800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096b [2,head] /scrub_test_path/ceph-qa-suite/new_file_0 auth v622 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5381=0-4194304@1} caps={5381=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@3},l=5381 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x560771568c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x1000000096b:[<0x10000000001/new_file_0 v622>,<0x10000000000/ceph-qa-suite v51>,<0x1/scrub_test_path v15>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-04-25T09:06:14.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/679708068 shutdown_connections 2024-04-25T09:06:14.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 1 -- 172.21.15.173:0/679708068 wait complete. 2024-04-25T09:06:14.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1ea1b000 20 client.6207 trim_cache size 0 max 16384 2024-04-25T09:06:14.989 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:14.989 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0, 2024-04-25T09:06:14.989 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_tag": "852995b7-72ca-42a1-a642-1ec31dad95ac", 2024-04-25T09:06:14.989 INFO:teuthology.orchestra.run.smithi173.stdout: "mode": "asynchronous" 2024-04-25T09:06:14.989 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:14.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1b600640 1 -- 172.21.15.173:0/433738730 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbdf4066f60 msgr2=0x7fbdf4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1b600640 1 --2- 172.21.15.173:0/433738730 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbdf4066f60 0x7fbdf4069420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbe040af000 tx=0x7fbe040a7070 comp rx=0 tx=0).stop 2024-04-25T09:06:14.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1b600640 1 -- 172.21.15.173:0/433738730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe140706f0 msgr2=0x7fbe141474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.994+0000 7fbe1b600640 1 --2- 172.21.15.173:0/433738730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe140706f0 0x7fbe141474a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000c450 tx=0x7fbe0000c910 comp rx=0 tx=0).stop 2024-04-25T09:06:14.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.998+0000 7fbe1b600640 1 -- 172.21.15.173:0/433738730 shutdown_connections 2024-04-25T09:06:14.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.998+0000 7fbe1b600640 1 --2- 172.21.15.173:0/433738730 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbdf4066f60 0x7fbdf4069420 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.998+0000 7fbe1b600640 1 --2- 172.21.15.173:0/433738730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe140cd9d0 0x7fbe141479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.998+0000 7fbe1b600640 1 --2- 172.21.15.173:0/433738730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe140706f0 0x7fbe141474a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.998+0000 7fbe1b600640 1 --2- 172.21.15.173:0/433738730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe14070310 0x7fbe14140ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.998+0000 7fbe1b600640 1 -- 172.21.15.173:0/433738730 >> 172.21.15.173:0/433738730 conn(0x7fbe140b23f0 msgr2=0x7fbe14152360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:14.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.998+0000 7fbe1b600640 1 -- 172.21.15.173:0/433738730 shutdown_connections 2024-04-25T09:06:14.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:14.998+0000 7fbe1b600640 1 -- 172.21.15.173:0/433738730 wait complete. 2024-04-25T09:06:15.002 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'return_code': 0, 'scrub_tag': '852995b7-72ca-42a1-a642-1ec31dad95ac', 'mode': 'asynchronous'}' 2024-04-25T09:06:15.003 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T09:06:15.003 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T09:06:15.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.154+0000 7f7f97e00640 1 Processor -- start 2024-04-25T09:06:15.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.154+0000 7f7f97e00640 1 -- start start 2024-04-25T09:06:15.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.154+0000 7f7f97e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7f9006e1c0 0x7f7f9006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.154+0000 7f7f97e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7f900ad5c0 0x7f7f9006f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.154+0000 7f7f97e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f9006ae30 con 0x7f7f9006c410 2024-04-25T09:06:15.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.154+0000 7f7f97e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f900b3170 con 0x7f7f900ad5c0 2024-04-25T09:06:15.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.154+0000 7f7f97e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f9015e070 con 0x7f7f9006e1c0 2024-04-25T09:06:15.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.154+0000 7f7f94a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f7f9006c410 0x7f7f900aceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:51462/0 (socket says 172.21.15.173:51462) 2024-04-25T09:06:15.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.154+0000 7f7f94a00640 1 -- 172.21.15.173:0/1256217684 learned_addr learned my addr 172.21.15.173:0/1256217684 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:15.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.154+0000 7f7f95e00640 1 --2- 172.21.15.173:0/1256217684 >> v2:172.21.15.173:3300/0 conn(0x7f7f900ad5c0 0x7f7f9006f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.154+0000 7f7f95400640 1 --2- 172.21.15.173:0/1256217684 >> v2:172.21.15.194:3300/0 conn(0x7f7f9006e1c0 0x7f7f9006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.154+0000 7f7f8fe00640 1 -- 172.21.15.173:0/1256217684 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962977815 0 0) 0x7f7f9006ae30 con 0x7f7f9006c410 2024-04-25T09:06:15.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.154+0000 7f7f8fe00640 1 -- 172.21.15.173:0/1256217684 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f78003530 con 0x7f7f9006c410 2024-04-25T09:06:15.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.154+0000 7f7f95e00640 1 -- 172.21.15.173:0/1256217684 >> v2:172.21.15.194:3300/0 conn(0x7f7f9006e1c0 msgr2=0x7f7f9006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:15.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.154+0000 7f7f95e00640 1 --2- 172.21.15.173:0/1256217684 >> v2:172.21.15.194:3300/0 conn(0x7f7f9006e1c0 0x7f7f9006bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.154+0000 7f7f95e00640 1 -- 172.21.15.173:0/1256217684 >> v1:172.21.15.173:6789/0 conn(0x7f7f9006c410 legacy=0x7f7f900aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.154+0000 7f7f95e00640 1 -- 172.21.15.173:0/1256217684 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9006b110 con 0x7f7f900ad5c0 2024-04-25T09:06:15.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.158+0000 7f7f95e00640 1 --2- 172.21.15.173:0/1256217684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f900ad5c0 0x7f7f9006f5b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7f90071b60 tx=0x7f7f8801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c08cc2f5b091bb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.158+0000 7f7f8fe00640 1 -- 172.21.15.173:0/1256217684 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f880b2070 con 0x7f7f900ad5c0 2024-04-25T09:06:15.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.158+0000 7f7f8fe00640 1 -- 172.21.15.173:0/1256217684 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f880a59f0 con 0x7f7f900ad5c0 2024-04-25T09:06:15.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.158+0000 7f7f8fe00640 1 -- 172.21.15.173:0/1256217684 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f880a5dc0 con 0x7f7f900ad5c0 2024-04-25T09:06:15.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.158+0000 7f7f97e00640 1 -- 172.21.15.173:0/1256217684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f900ad5c0 msgr2=0x7f7f9006f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.158+0000 7f7f97e00640 1 --2- 172.21.15.173:0/1256217684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f900ad5c0 0x7f7f9006f5b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7f90071b60 tx=0x7f7f8801c930 comp rx=0 tx=0).stop 2024-04-25T09:06:15.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.158+0000 7f7f97e00640 1 -- 172.21.15.173:0/1256217684 shutdown_connections 2024-04-25T09:06:15.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.158+0000 7f7f97e00640 1 --2- 172.21.15.173:0/1256217684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f900ad5c0 0x7f7f9006f5b0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.158+0000 7f7f97e00640 1 --2- 172.21.15.173:0/1256217684 >> v2:172.21.15.194:3300/0 conn(0x7f7f9006e1c0 0x7f7f9006bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.158+0000 7f7f97e00640 1 -- 172.21.15.173:0/1256217684 >> 172.21.15.173:0/1256217684 conn(0x7f7f900cfed0 msgr2=0x7f7f900d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:15.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.158+0000 7f7f97e00640 1 -- 172.21.15.173:0/1256217684 shutdown_connections 2024-04-25T09:06:15.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.158+0000 7f7f97e00640 1 -- 172.21.15.173:0/1256217684 wait complete. 2024-04-25T09:06:15.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.158+0000 7f7f97e00640 1 Processor -- start 2024-04-25T09:06:15.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.158+0000 7f7f97e00640 1 -- start start 2024-04-25T09:06:15.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f97e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f9006c410 0x7f7f901495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f97e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f9006e1c0 0x7f7f9014c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f97e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f900ad5c0 0x7f7f9014a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f97e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9016a160 con 0x7f7f9006e1c0 2024-04-25T09:06:15.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f97e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f90169fe0 con 0x7f7f900ad5c0 2024-04-25T09:06:15.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f97e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9016a2e0 con 0x7f7f9006c410 2024-04-25T09:06:15.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f94a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f9006e1c0 0x7f7f9014c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f94a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f9006e1c0 0x7f7f9014c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46128/0 (socket says 172.21.15.173:46128) 2024-04-25T09:06:15.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f94a00640 1 -- 172.21.15.173:0/58967542 learned_addr learned my addr 172.21.15.173:0/58967542 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:15.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f95400640 1 --2- 172.21.15.173:0/58967542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f9006c410 0x7f7f901495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f95e00640 1 --2- 172.21.15.173:0/58967542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f900ad5c0 0x7f7f9014a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f94a00640 1 -- 172.21.15.173:0/58967542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f9006c410 msgr2=0x7f7f901495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f94a00640 1 --2- 172.21.15.173:0/58967542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f9006c410 0x7f7f901495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f94a00640 1 -- 172.21.15.173:0/58967542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f900ad5c0 msgr2=0x7f7f9014a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f94a00640 1 --2- 172.21.15.173:0/58967542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f900ad5c0 0x7f7f9014a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f94a00640 1 -- 172.21.15.173:0/58967542 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9014afd0 con 0x7f7f9006e1c0 2024-04-25T09:06:15.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f94a00640 1 --2- 172.21.15.173:0/58967542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f9006e1c0 0x7f7f9014c070 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c450 tx=0x7f7f7c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f8d600640 1 -- 172.21.15.173:0/58967542 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c017070 con 0x7f7f9006e1c0 2024-04-25T09:06:15.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f8d600640 1 -- 172.21.15.173:0/58967542 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c005cf0 con 0x7f7f9006e1c0 2024-04-25T09:06:15.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f97e00640 1 -- 172.21.15.173:0/58967542 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f9014b2b0 con 0x7f7f9006e1c0 2024-04-25T09:06:15.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f8d600640 1 -- 172.21.15.173:0/58967542 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c007290 con 0x7f7f9006e1c0 2024-04-25T09:06:15.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.162+0000 7f7f97e00640 1 -- 172.21.15.173:0/58967542 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f9014b870 con 0x7f7f9006e1c0 2024-04-25T09:06:15.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f8d600640 1 -- 172.21.15.173:0/58967542 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7f7c01a070 con 0x7f7f9006e1c0 2024-04-25T09:06:15.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f8d600640 1 --2- 172.21.15.173:0/58967542 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7f70066f60 0x7f7f70069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f8d600640 1 -- 172.21.15.173:0/58967542 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7f7c084610 con 0x7f7f9006e1c0 2024-04-25T09:06:15.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f95400640 1 --2- 172.21.15.173:0/58967542 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7f70066f60 0x7f7f70069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f9b2ae000 1 Processor -- start 2024-04-25T09:06:15.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f95400640 1 --2- 172.21.15.173:0/58967542 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7f70066f60 0x7f7f70069420 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7f901f9940 tx=0x7f7f84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f9b2ae000 1 -- start start 2024-04-25T09:06:15.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f9b2ae000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098769d0 0x562709876db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f9b2ae000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627098772f0 0x56270982cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f9b2ae000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56270982d0a0 0x56270982d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f9b2ae000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x562709679ff0 con 0x5627098769d0 2024-04-25T09:06:15.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f9b2ae000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562709602150 con 0x5627098772f0 2024-04-25T09:06:15.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f9b2ae000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x562709676090 con 0x56270982d0a0 2024-04-25T09:06:15.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f95400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098769d0 0x562709876db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f95400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098769d0 0x562709876db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46138/0 (socket says 172.21.15.173:46138) 2024-04-25T09:06:15.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f95400640 1 -- 172.21.15.173:0/2907398951 learned_addr learned my addr 172.21.15.173:0/2907398951 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:15.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f95e00640 1 --2- 172.21.15.173:0/2907398951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56270982d0a0 0x56270982d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f94a00640 1 --2- 172.21.15.173:0/2907398951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627098772f0 0x56270982cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f95400640 1 -- 172.21.15.173:0/2907398951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56270982d0a0 msgr2=0x56270982d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:15.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f95400640 1 --2- 172.21.15.173:0/2907398951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56270982d0a0 0x56270982d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f95400640 1 -- 172.21.15.173:0/2907398951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627098772f0 msgr2=0x56270982cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:15.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f95400640 1 --2- 172.21.15.173:0/2907398951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627098772f0 0x56270982cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f95400640 1 -- 172.21.15.173:0/2907398951 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627098100d0 con 0x5627098769d0 2024-04-25T09:06:15.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f94a00640 1 --2- 172.21.15.173:0/2907398951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627098772f0 0x56270982cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:15.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f95400640 1 --2- 172.21.15.173:0/2907398951 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098769d0 0x562709876db0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009510 tx=0x7f7f84014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421237c36bce31bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f82000640 1 -- 172.21.15.173:0/2907398951 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f84011d80 con 0x5627098769d0 2024-04-25T09:06:15.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f82000640 1 -- 172.21.15.173:0/2907398951 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f84026070 con 0x5627098769d0 2024-04-25T09:06:15.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.166+0000 7f7f82000640 1 -- 172.21.15.173:0/2907398951 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f84021640 con 0x5627098769d0 2024-04-25T09:06:15.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/2907398951 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098769d0 msgr2=0x562709876db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/2907398951 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098769d0 0x562709876db0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009510 tx=0x7f7f84014000 comp rx=0 tx=0).stop 2024-04-25T09:06:15.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/2907398951 shutdown_connections 2024-04-25T09:06:15.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/2907398951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56270982d0a0 0x56270982d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/2907398951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627098772f0 0x56270982cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/2907398951 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098769d0 0x562709876db0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/2907398951 >> 172.21.15.173:0/2907398951 conn(0x562709829020 msgr2=0x56270982b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:15.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/2907398951 shutdown_connections 2024-04-25T09:06:15.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/2907398951 wait complete. 2024-04-25T09:06:15.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 -- start start 2024-04-25T09:06:15.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 Processor -- start 2024-04-25T09:06:15.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56270982d0a0 0x56270985b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5627098769d0 0x56270985bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 0x56270985c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56270963e250 con 0x5627098772f0 2024-04-25T09:06:15.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562709634690 con 0x56270982d0a0 2024-04-25T09:06:15.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x562709602a40 con 0x5627098769d0 2024-04-25T09:06:15.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 10 client.0 _ll_register_callbacks cb 0x562709817e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:15.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f95e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 0x56270985c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f95e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 0x56270985c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46148/0 (socket says 172.21.15.173:46148) 2024-04-25T09:06:15.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f95e00640 1 -- 172.21.15.173:0/1258907939 learned_addr learned my addr 172.21.15.173:0/1258907939 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:15.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f94a00640 1 --2- 172.21.15.173:0/1258907939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5627098769d0 0x56270985bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f95400640 1 --2- 172.21.15.173:0/1258907939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56270982d0a0 0x56270985b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f95e00640 1 -- 172.21.15.173:0/1258907939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5627098769d0 msgr2=0x56270985bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:15.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f95e00640 1 --2- 172.21.15.173:0/1258907939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5627098769d0 0x56270985bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f95e00640 1 -- 172.21.15.173:0/1258907939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56270982d0a0 msgr2=0x56270985b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:15.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f95e00640 1 --2- 172.21.15.173:0/1258907939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56270982d0a0 0x56270985b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f95e00640 1 -- 172.21.15.173:0/1258907939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627097271c0 con 0x5627098772f0 2024-04-25T09:06:15.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f95e00640 1 --2- 172.21.15.173:0/1258907939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 0x56270985c270 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7f880b0040 tx=0x7f7f8801b170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8116ac216aa4f47e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f76a00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:15.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f76a00640 1 -- 172.21.15.173:0/1258907939 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f880b2040 con 0x5627098772f0 2024-04-25T09:06:15.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f76a00640 1 -- 172.21.15.173:0/1258907939 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7f880ad440 con 0x5627098772f0 2024-04-25T09:06:15.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/1258907939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7f84026070 con 0x5627098772f0 2024-04-25T09:06:15.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f76a00640 1 -- 172.21.15.173:0/1258907939 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f880ca050 con 0x5627098772f0 2024-04-25T09:06:15.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 10 client.6222 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:15.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.170+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/1258907939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x562709723170 con 0x5627098772f0 2024-04-25T09:06:15.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f76a00640 1 -- 172.21.15.173:0/1258907939 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f84026070 con 0x5627098772f0 2024-04-25T09:06:15.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f76a00640 1 -- 172.21.15.173:0/1258907939 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7f880cd020 con 0x5627098772f0 2024-04-25T09:06:15.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f9b2ae000 10 client.6222 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:15.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f9b2ae000 10 client.6222 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:15.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f9b2ae000 20 client.6222 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:15.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/1258907939 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x562709886c80 0x562709889070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f9b2ae000 4 client.6222 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:15.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/1258907939 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562709615c60 con 0x562709886c80 2024-04-25T09:06:15.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f95400640 1 --2- 172.21.15.173:0/1258907939 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x562709886c80 0x562709889070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f76a00640 10 client.6222 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:15.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f95400640 1 --2- 172.21.15.173:0/1258907939 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x562709886c80 0x562709889070 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=701cb9ab9b522951 server_cookie=8adf2e54593afbeb in_seq=0 out_seq=0 2024-04-25T09:06:15.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f76a00640 1 -- 172.21.15.173:0/1258907939 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562709615c60 con 0x562709886c80 2024-04-25T09:06:15.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f76a00640 10 client.6222 handle_command_reply: tid=0 2024-04-25T09:06:15.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f9b2ae000 1 client.6222 shutdown 2024-04-25T09:06:15.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/1258907939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 msgr2=0x56270985c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/1258907939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 0x56270985c270 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7f880b0040 tx=0x7f7f8801b170 comp rx=0 tx=0).stop 2024-04-25T09:06:15.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/1258907939 shutdown_connections 2024-04-25T09:06:15.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/1258907939 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x562709886c80 0x562709889070 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/1258907939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 0x56270985c270 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/1258907939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5627098769d0 0x56270985bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f76a00640 0 client.6222 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:15.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/1258907939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56270982d0a0 0x56270985b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/1258907939 >> 172.21.15.173:0/1258907939 conn(0x562709829020 msgr2=0x56270982bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:15.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/1258907939 shutdown_connections 2024-04-25T09:06:15.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/1258907939 wait complete. 2024-04-25T09:06:15.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.174+0000 7f7f9b2ae000 20 client.6222 trim_cache size 0 max 16384 2024-04-25T09:06:15.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f9b2ae000 1 Processor -- start 2024-04-25T09:06:15.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f9b2ae000 1 -- start start 2024-04-25T09:06:15.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f9b2ae000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56270982d0a0 0x56270982c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f9b2ae000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627098769d0 0x562709883e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f9b2ae000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 0x562709884380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f9b2ae000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f90202fd0 con 0x5627098772f0 2024-04-25T09:06:15.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f9b2ae000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f902021d0 con 0x5627098769d0 2024-04-25T09:06:15.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f9b2ae000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f90155380 con 0x56270982d0a0 2024-04-25T09:06:15.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f95e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 0x562709884380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f95e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 0x562709884380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46154/0 (socket says 172.21.15.173:46154) 2024-04-25T09:06:15.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f95e00640 1 -- 172.21.15.173:0/2852606273 learned_addr learned my addr 172.21.15.173:0/2852606273 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:15.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f95400640 1 --2- 172.21.15.173:0/2852606273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56270982d0a0 0x56270982c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f94a00640 1 --2- 172.21.15.173:0/2852606273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627098769d0 0x562709883e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f95e00640 1 -- 172.21.15.173:0/2852606273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56270982d0a0 msgr2=0x56270982c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:15.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f95e00640 1 --2- 172.21.15.173:0/2852606273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56270982d0a0 0x56270982c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f95e00640 1 -- 172.21.15.173:0/2852606273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627098769d0 msgr2=0x562709883e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:15.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f95e00640 1 --2- 172.21.15.173:0/2852606273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627098769d0 0x562709883e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f95e00640 1 -- 172.21.15.173:0/2852606273 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627096c0de0 con 0x5627098772f0 2024-04-25T09:06:15.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f94a00640 1 --2- 172.21.15.173:0/2852606273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627098769d0 0x562709883e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:15.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f95e00640 1 --2- 172.21.15.173:0/2852606273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 0x562709884380 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7f8801a560 tx=0x7f7f880b9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6c70da4b1b8e2a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f81600640 1 -- 172.21.15.173:0/2852606273 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f880b2040 con 0x5627098772f0 2024-04-25T09:06:15.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f81600640 1 -- 172.21.15.173:0/2852606273 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f880a54d0 con 0x5627098772f0 2024-04-25T09:06:15.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.190+0000 7f7f81600640 1 -- 172.21.15.173:0/2852606273 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f880a5d00 con 0x5627098772f0 2024-04-25T09:06:15.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/2852606273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 msgr2=0x562709884380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/2852606273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 0x562709884380 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7f8801a560 tx=0x7f7f880b9000 comp rx=0 tx=0).stop 2024-04-25T09:06:15.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/2852606273 shutdown_connections 2024-04-25T09:06:15.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/2852606273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 0x562709884380 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/2852606273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627098769d0 0x562709883e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/2852606273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56270982d0a0 0x56270982c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/2852606273 >> 172.21.15.173:0/2852606273 conn(0x562709829020 msgr2=0x562709883730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:15.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/2852606273 shutdown_connections 2024-04-25T09:06:15.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/2852606273 wait complete. 2024-04-25T09:06:15.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 -- start start 2024-04-25T09:06:15.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 Processor -- start 2024-04-25T09:06:15.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56270982d0a0 0x5627098d6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627098769d0 0x5627098d6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 0x562709888a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x562709614e00 con 0x5627098772f0 2024-04-25T09:06:15.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f90201c30 con 0x5627098769d0 2024-04-25T09:06:15.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x562709679300 con 0x56270982d0a0 2024-04-25T09:06:15.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 10 client.0 _ll_register_callbacks cb 0x5627097f8040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:15.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f95e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 0x562709888a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f95e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 0x562709888a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46168/0 (socket says 172.21.15.173:46168) 2024-04-25T09:06:15.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f95e00640 1 -- 172.21.15.173:0/1442374750 learned_addr learned my addr 172.21.15.173:0/1442374750 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:15.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f95400640 1 --2- 172.21.15.173:0/1442374750 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56270982d0a0 0x5627098d6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f94a00640 1 --2- 172.21.15.173:0/1442374750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627098769d0 0x5627098d6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f95e00640 1 -- 172.21.15.173:0/1442374750 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56270982d0a0 msgr2=0x5627098d6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:15.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f95e00640 1 --2- 172.21.15.173:0/1442374750 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56270982d0a0 0x5627098d6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f95e00640 1 -- 172.21.15.173:0/1442374750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627098769d0 msgr2=0x5627098d6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:15.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f95e00640 1 --2- 172.21.15.173:0/1442374750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627098769d0 0x5627098d6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f95e00640 1 -- 172.21.15.173:0/1442374750 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56270961b8e0 con 0x5627098772f0 2024-04-25T09:06:15.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f94a00640 1 --2- 172.21.15.173:0/1442374750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627098769d0 0x5627098d6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:15.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f95e00640 1 --2- 172.21.15.173:0/1442374750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 0x562709888a20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7f8801cea0 tx=0x7f7f88009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1123affbb75ee46e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f76a00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:15.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f76a00640 1 -- 172.21.15.173:0/1442374750 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f880b2070 con 0x5627098772f0 2024-04-25T09:06:15.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f76a00640 1 -- 172.21.15.173:0/1442374750 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7f88003db0 con 0x5627098772f0 2024-04-25T09:06:15.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/1442374750 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7f880a54d0 con 0x5627098772f0 2024-04-25T09:06:15.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f76a00640 1 -- 172.21.15.173:0/1442374750 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f88002070 con 0x5627098772f0 2024-04-25T09:06:15.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 10 client.6228 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:15.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/1442374750 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x5627096d38f0 con 0x5627098772f0 2024-04-25T09:06:15.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f76a00640 1 -- 172.21.15.173:0/1442374750 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f880a54d0 con 0x5627098772f0 2024-04-25T09:06:15.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f76a00640 1 -- 172.21.15.173:0/1442374750 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7f880cd070 con 0x5627098772f0 2024-04-25T09:06:15.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 10 client.6228 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:15.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 10 client.6228 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:15.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 20 client.6228 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:15.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/1442374750 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x562709889410 0x562709889820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 4 client.6228 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:06:15.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/1442374750 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562709687530 con 0x562709889410 2024-04-25T09:06:15.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.194+0000 7f7f95400640 1 --2- 172.21.15.173:0/1442374750 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x562709889410 0x562709889820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f95400640 1 --2- 172.21.15.173:0/1442374750 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x562709889410 0x562709889820 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd4058f5c222ba7d server_cookie=b42811f114c648a6 in_seq=0 out_seq=0 2024-04-25T09:06:15.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f76a00640 10 client.6228 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:15.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f76a00640 1 -- 172.21.15.173:0/1442374750 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+284 (crc 0 0 0) 0x562709687530 con 0x562709889410 2024-04-25T09:06:15.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f76a00640 10 client.6228 handle_command_reply: tid=0 2024-04-25T09:06:15.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f9b2ae000 1 client.6228 shutdown 2024-04-25T09:06:15.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/1442374750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 msgr2=0x562709888a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/1442374750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 0x562709888a20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7f8801cea0 tx=0x7f7f88009750 comp rx=0 tx=0).stop 2024-04-25T09:06:15.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/1442374750 shutdown_connections 2024-04-25T09:06:15.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/1442374750 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x562709889410 0x562709889820 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/1442374750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5627098772f0 0x562709888a20 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/1442374750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627098769d0 0x5627098d6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f9b2ae000 1 --2- 172.21.15.173:0/1442374750 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56270982d0a0 0x5627098d6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f76a00640 0 client.6228 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:15.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/1442374750 >> 172.21.15.173:0/1442374750 conn(0x562709829020 msgr2=0x562709883fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:15.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/1442374750 shutdown_connections 2024-04-25T09:06:15.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f9b2ae000 1 -- 172.21.15.173:0/1442374750 wait complete. 2024-04-25T09:06:15.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f9b2ae000 20 client.6228 trim_cache size 0 max 16384 2024-04-25T09:06:15.191 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:15.191 INFO:teuthology.orchestra.run.smithi173.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:06:15.191 INFO:teuthology.orchestra.run.smithi173.stdout: "scrubs": { 2024-04-25T09:06:15.191 INFO:teuthology.orchestra.run.smithi173.stdout: "852995b7-72ca-42a1-a642-1ec31dad95ac": { 2024-04-25T09:06:15.191 INFO:teuthology.orchestra.run.smithi173.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-04-25T09:06:15.191 INFO:teuthology.orchestra.run.smithi173.stdout: "tag": "852995b7-72ca-42a1-a642-1ec31dad95ac", 2024-04-25T09:06:15.191 INFO:teuthology.orchestra.run.smithi173.stdout: "options": "" 2024-04-25T09:06:15.192 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:15.192 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:15.192 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:15.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f97e00640 1 -- 172.21.15.173:0/58967542 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7f70066f60 msgr2=0x7f7f70069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f97e00640 1 --2- 172.21.15.173:0/58967542 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7f70066f60 0x7f7f70069420 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7f901f9940 tx=0x7f7f84008040 comp rx=0 tx=0).stop 2024-04-25T09:06:15.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f97e00640 1 -- 172.21.15.173:0/58967542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f9006e1c0 msgr2=0x7f7f9014c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f97e00640 1 --2- 172.21.15.173:0/58967542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f9006e1c0 0x7f7f9014c070 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c450 tx=0x7f7f7c00c910 comp rx=0 tx=0).stop 2024-04-25T09:06:15.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f97e00640 1 -- 172.21.15.173:0/58967542 shutdown_connections 2024-04-25T09:06:15.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f97e00640 1 --2- 172.21.15.173:0/58967542 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7f70066f60 0x7f7f70069420 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f97e00640 1 --2- 172.21.15.173:0/58967542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f900ad5c0 0x7f7f9014a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f97e00640 1 --2- 172.21.15.173:0/58967542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f9006e1c0 0x7f7f9014c070 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f97e00640 1 --2- 172.21.15.173:0/58967542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f9006c410 0x7f7f901495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f97e00640 1 -- 172.21.15.173:0/58967542 >> 172.21.15.173:0/58967542 conn(0x7f7f900cfed0 msgr2=0x7f7f9006f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:15.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f97e00640 1 -- 172.21.15.173:0/58967542 shutdown_connections 2024-04-25T09:06:15.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:15.198+0000 7f7f97e00640 1 -- 172.21.15.173:0/58967542 wait complete. 2024-04-25T09:06:20.205 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T09:06:20.205 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T09:06:20.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.366+0000 7f78f4000640 1 Processor -- start 2024-04-25T09:06:20.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.366+0000 7f78f4000640 1 -- start start 2024-04-25T09:06:20.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.366+0000 7f78f4000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f78ec06f5b0 0x7f78ec0aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.366+0000 7f78f4000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78ec0ad3f0 0x7f78ec1677c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.366+0000 7f78f4000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ec06fa20 con 0x7f78ec06e1c0 2024-04-25T09:06:20.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.366+0000 7f78f4000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ec0b3170 con 0x7f78ec06f5b0 2024-04-25T09:06:20.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.366+0000 7f78f4000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec15e070 con 0x7f78ec0ad3f0 2024-04-25T09:06:20.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.366+0000 7f78f1600640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f78ec06e1c0 0x7f78ec06bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:51468/0 (socket says 172.21.15.173:51468) 2024-04-25T09:06:20.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.366+0000 7f78f1600640 1 -- 172.21.15.173:0/1609613298 learned_addr learned my addr 172.21.15.173:0/1609613298 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:20.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.366+0000 7f78f0c00640 1 --2- 172.21.15.173:0/1609613298 >> v2:172.21.15.173:3300/0 conn(0x7f78ec06f5b0 0x7f78ec0aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.366+0000 7f78f2000640 1 --2- 172.21.15.173:0/1609613298 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78ec0ad3f0 0x7f78ec1677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.366+0000 7f78f0c00640 1 -- 172.21.15.173:0/1609613298 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78ec0ad3f0 msgr2=0x7f78ec1677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.366+0000 7f78ebe00640 1 -- 172.21.15.173:0/1609613298 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317773932 0 0) 0x7f78ec06fa20 con 0x7f78ec06e1c0 2024-04-25T09:06:20.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.366+0000 7f78f0c00640 1 --2- 172.21.15.173:0/1609613298 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78ec0ad3f0 0x7f78ec1677c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.366+0000 7f78f0c00640 1 -- 172.21.15.173:0/1609613298 >> v1:172.21.15.173:6789/0 conn(0x7f78ec06e1c0 legacy=0x7f78ec06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.366+0000 7f78f0c00640 1 -- 172.21.15.173:0/1609613298 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec06ae30 con 0x7f78ec06f5b0 2024-04-25T09:06:20.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.370+0000 7f78f0c00640 1 --2- 172.21.15.173:0/1609613298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78ec06f5b0 0x7f78ec0aceb0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f78d80097c0 tx=0x7f78d801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01ad0aba08ad5e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.370+0000 7f78ebe00640 1 -- 172.21.15.173:0/1609613298 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d80b5070 con 0x7f78ec06f5b0 2024-04-25T09:06:20.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.370+0000 7f78ebe00640 1 -- 172.21.15.173:0/1609613298 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d80a8990 con 0x7f78ec06f5b0 2024-04-25T09:06:20.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.370+0000 7f78ebe00640 1 -- 172.21.15.173:0/1609613298 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d80a8d60 con 0x7f78ec06f5b0 2024-04-25T09:06:20.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.370+0000 7f78f4000640 1 -- 172.21.15.173:0/1609613298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78ec06f5b0 msgr2=0x7f78ec0aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.370+0000 7f78f4000640 1 --2- 172.21.15.173:0/1609613298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78ec06f5b0 0x7f78ec0aceb0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f78d80097c0 tx=0x7f78d801ec90 comp rx=0 tx=0).stop 2024-04-25T09:06:20.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.370+0000 7f78f4000640 1 -- 172.21.15.173:0/1609613298 shutdown_connections 2024-04-25T09:06:20.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.370+0000 7f78f4000640 1 --2- 172.21.15.173:0/1609613298 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78ec0ad3f0 0x7f78ec1677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.370+0000 7f78f4000640 1 --2- 172.21.15.173:0/1609613298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78ec06f5b0 0x7f78ec0aceb0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.370+0000 7f78f4000640 1 -- 172.21.15.173:0/1609613298 >> 172.21.15.173:0/1609613298 conn(0x7f78ec0cfed0 msgr2=0x7f78ec0d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.370+0000 7f78f4000640 1 -- 172.21.15.173:0/1609613298 shutdown_connections 2024-04-25T09:06:20.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.370+0000 7f78f4000640 1 -- 172.21.15.173:0/1609613298 wait complete. 2024-04-25T09:06:20.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f4000640 1 Processor -- start 2024-04-25T09:06:20.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f4000640 1 -- start start 2024-04-25T09:06:20.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f4000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78ec06e1c0 0x7f78ec145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f4000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78ec06f5b0 0x7f78ec153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f4000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78ec0ad3f0 0x7f78ec1e3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f4000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec06b6d0 con 0x7f78ec06e1c0 2024-04-25T09:06:20.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f4000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec06b3f0 con 0x7f78ec0ad3f0 2024-04-25T09:06:20.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f4000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec06b9b0 con 0x7f78ec06f5b0 2024-04-25T09:06:20.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f1600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78ec06e1c0 0x7f78ec145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f1600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78ec06e1c0 0x7f78ec145aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46184/0 (socket says 172.21.15.173:46184) 2024-04-25T09:06:20.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f1600640 1 -- 172.21.15.173:0/2337851228 learned_addr learned my addr 172.21.15.173:0/2337851228 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:20.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f0c00640 1 --2- 172.21.15.173:0/2337851228 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78ec06f5b0 0x7f78ec153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f2000640 1 --2- 172.21.15.173:0/2337851228 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78ec0ad3f0 0x7f78ec1e3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f1600640 1 -- 172.21.15.173:0/2337851228 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78ec06f5b0 msgr2=0x7f78ec153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f1600640 1 --2- 172.21.15.173:0/2337851228 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78ec06f5b0 0x7f78ec153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f1600640 1 -- 172.21.15.173:0/2337851228 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78ec0ad3f0 msgr2=0x7f78ec1e3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f1600640 1 --2- 172.21.15.173:0/2337851228 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78ec0ad3f0 0x7f78ec1e3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f1600640 1 -- 172.21.15.173:0/2337851228 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec154720 con 0x7f78ec06e1c0 2024-04-25T09:06:20.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f2000640 1 --2- 172.21.15.173:0/2337851228 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78ec0ad3f0 0x7f78ec1e3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:20.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f1600640 1 --2- 172.21.15.173:0/2337851228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78ec06e1c0 0x7f78ec145aa0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f78e0001570 tx=0x7f78e000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78e9600640 1 -- 172.21.15.173:0/2337851228 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e0018070 con 0x7f78ec06e1c0 2024-04-25T09:06:20.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78e9600640 1 -- 172.21.15.173:0/2337851228 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e000a640 con 0x7f78ec06e1c0 2024-04-25T09:06:20.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f4000640 1 -- 172.21.15.173:0/2337851228 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ec154a00 con 0x7f78ec06e1c0 2024-04-25T09:06:20.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78e9600640 1 -- 172.21.15.173:0/2337851228 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e000aa30 con 0x7f78ec06e1c0 2024-04-25T09:06:20.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.374+0000 7f78f4000640 1 -- 172.21.15.173:0/2337851228 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ec154fc0 con 0x7f78ec06e1c0 2024-04-25T09:06:20.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.378+0000 7f78e9600640 1 -- 172.21.15.173:0/2337851228 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f78e001b070 con 0x7f78ec06e1c0 2024-04-25T09:06:20.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.378+0000 7f78e9600640 1 --2- 172.21.15.173:0/2337851228 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f78cc066f90 0x7f78cc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.378+0000 7f78e9600640 1 -- 172.21.15.173:0/2337851228 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f78e0084800 con 0x7f78ec06e1c0 2024-04-25T09:06:20.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.378+0000 7f78f0c00640 1 --2- 172.21.15.173:0/2337851228 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f78cc066f90 0x7f78cc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.378+0000 7f78f7437000 1 Processor -- start 2024-04-25T09:06:20.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.378+0000 7f78f7437000 1 -- start start 2024-04-25T09:06:20.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.378+0000 7f78f0c00640 1 --2- 172.21.15.173:0/2337851228 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f78cc066f90 0x7f78cc069450 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f78d80b2000 tx=0x7f78d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.378+0000 7f78f7437000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce29d0 0x558e10ce2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.378+0000 7f78f7437000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce32f0 0x558e10c98b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.378+0000 7f78f7437000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10c990a0 0x558e10c99480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.378+0000 7f78f7437000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e10ae5ff0 con 0x558e10ce29d0 2024-04-25T09:06:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.378+0000 7f78f7437000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e10a6e150 con 0x558e10c990a0 2024-04-25T09:06:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.378+0000 7f78f7437000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e10ae2090 con 0x558e10ce32f0 2024-04-25T09:06:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.378+0000 7f78f1600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce29d0 0x558e10ce2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.378+0000 7f78f1600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce29d0 0x558e10ce2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46194/0 (socket says 172.21.15.173:46194) 2024-04-25T09:06:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.378+0000 7f78f1600640 1 -- 172.21.15.173:0/3060334754 learned_addr learned my addr 172.21.15.173:0/3060334754 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.378+0000 7f78f2000640 1 --2- 172.21.15.173:0/3060334754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10c990a0 0x558e10c99480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.378+0000 7f78f0c00640 1 --2- 172.21.15.173:0/3060334754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce32f0 0x558e10c98b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f1600640 1 -- 172.21.15.173:0/3060334754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce32f0 msgr2=0x558e10c98b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f1600640 1 --2- 172.21.15.173:0/3060334754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce32f0 0x558e10c98b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f1600640 1 -- 172.21.15.173:0/3060334754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10c990a0 msgr2=0x558e10c99480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f1600640 1 --2- 172.21.15.173:0/3060334754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10c990a0 0x558e10c99480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f1600640 1 -- 172.21.15.173:0/3060334754 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e10c7c0d0 con 0x558e10ce29d0 2024-04-25T09:06:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f2000640 1 --2- 172.21.15.173:0/3060334754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10c990a0 0x558e10c99480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:20.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f1600640 1 --2- 172.21.15.173:0/3060334754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce29d0 0x558e10ce2db0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f78e0054fb0 tx=0x7f78e0055160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c311ae446f4c843c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78de000640 1 -- 172.21.15.173:0/3060334754 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e0053320 con 0x558e10ce29d0 2024-04-25T09:06:20.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78de000640 1 -- 172.21.15.173:0/3060334754 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e0051690 con 0x558e10ce29d0 2024-04-25T09:06:20.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78de000640 1 -- 172.21.15.173:0/3060334754 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e005d3f0 con 0x558e10ce29d0 2024-04-25T09:06:20.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f7437000 1 -- 172.21.15.173:0/3060334754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce29d0 msgr2=0x558e10ce2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f7437000 1 --2- 172.21.15.173:0/3060334754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce29d0 0x558e10ce2db0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f78e0054fb0 tx=0x7f78e0055160 comp rx=0 tx=0).stop 2024-04-25T09:06:20.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f7437000 1 -- 172.21.15.173:0/3060334754 shutdown_connections 2024-04-25T09:06:20.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f7437000 1 --2- 172.21.15.173:0/3060334754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10c990a0 0x558e10c99480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f7437000 1 --2- 172.21.15.173:0/3060334754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce32f0 0x558e10c98b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f7437000 1 --2- 172.21.15.173:0/3060334754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce29d0 0x558e10ce2db0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f7437000 1 -- 172.21.15.173:0/3060334754 >> 172.21.15.173:0/3060334754 conn(0x558e10c95020 msgr2=0x558e10c97440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f7437000 1 -- 172.21.15.173:0/3060334754 shutdown_connections 2024-04-25T09:06:20.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f7437000 1 -- 172.21.15.173:0/3060334754 wait complete. 2024-04-25T09:06:20.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f7437000 1 -- start start 2024-04-25T09:06:20.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f7437000 1 Processor -- start 2024-04-25T09:06:20.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f7437000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10c990a0 0x558e10cc77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f7437000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce29d0 0x558e10cc7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f7437000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce32f0 0x558e10cc8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f7437000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e10aaa250 con 0x558e10ce32f0 2024-04-25T09:06:20.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f7437000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e10aa0690 con 0x558e10c990a0 2024-04-25T09:06:20.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f7437000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e10a6ea40 con 0x558e10ce29d0 2024-04-25T09:06:20.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f7437000 10 client.0 _ll_register_callbacks cb 0x558e10c83e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:20.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f2000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce32f0 0x558e10cc8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f2000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce32f0 0x558e10cc8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46202/0 (socket says 172.21.15.173:46202) 2024-04-25T09:06:20.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f2000640 1 -- 172.21.15.173:0/814961489 learned_addr learned my addr 172.21.15.173:0/814961489 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:20.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f0c00640 1 --2- 172.21.15.173:0/814961489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce29d0 0x558e10cc7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f1600640 1 --2- 172.21.15.173:0/814961489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10c990a0 0x558e10cc77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f2000640 1 -- 172.21.15.173:0/814961489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce29d0 msgr2=0x558e10cc7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f2000640 1 --2- 172.21.15.173:0/814961489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce29d0 0x558e10cc7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f2000640 1 -- 172.21.15.173:0/814961489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10c990a0 msgr2=0x558e10cc77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f2000640 1 --2- 172.21.15.173:0/814961489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10c990a0 0x558e10cc77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.382+0000 7f78f2000640 1 -- 172.21.15.173:0/814961489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e10b931c0 con 0x558e10ce32f0 2024-04-25T09:06:20.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f2000640 1 --2- 172.21.15.173:0/814961489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce32f0 0x558e10cc8270 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f78e4009d50 tx=0x7f78e40136b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9f0b89e6e352c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78d2a00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:20.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78d2a00640 1 -- 172.21.15.173:0/814961489 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e401a030 con 0x558e10ce32f0 2024-04-25T09:06:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78d2a00640 1 -- 172.21.15.173:0/814961489 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f78e4016460 con 0x558e10ce32f0 2024-04-25T09:06:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 1 -- 172.21.15.173:0/814961489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f78e0051690 con 0x558e10ce32f0 2024-04-25T09:06:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78d2a00640 1 -- 172.21.15.173:0/814961489 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78e40059a0 con 0x558e10ce32f0 2024-04-25T09:06:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 10 client.6243 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 1 -- 172.21.15.173:0/814961489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x558e10b8f170 con 0x558e10ce32f0 2024-04-25T09:06:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78d2a00640 1 -- 172.21.15.173:0/814961489 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e0051690 con 0x558e10ce32f0 2024-04-25T09:06:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78d2a00640 1 -- 172.21.15.173:0/814961489 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f78e4029080 con 0x558e10ce32f0 2024-04-25T09:06:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 10 client.6243 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 10 client.6243 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 20 client.6243 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 1 --2- 172.21.15.173:0/814961489 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x558e10cf2c80 0x558e10cf5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 4 client.6243 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 1 -- 172.21.15.173:0/814961489 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e10a81c60 con 0x558e10cf2c80 2024-04-25T09:06:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f1600640 1 --2- 172.21.15.173:0/814961489 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x558e10cf2c80 0x558e10cf5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78d2a00640 10 client.6243 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f1600640 1 --2- 172.21.15.173:0/814961489 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x558e10cf2c80 0x558e10cf5070 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da76d910f771e27e server_cookie=604b66b3eb5b3567 in_seq=0 out_seq=0 2024-04-25T09:06:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78d2a00640 1 -- 172.21.15.173:0/814961489 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558e10a81c60 con 0x558e10cf2c80 2024-04-25T09:06:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78d2a00640 10 client.6243 handle_command_reply: tid=0 2024-04-25T09:06:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 1 client.6243 shutdown 2024-04-25T09:06:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 1 -- 172.21.15.173:0/814961489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce32f0 msgr2=0x558e10cc8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 1 --2- 172.21.15.173:0/814961489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce32f0 0x558e10cc8270 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f78e4009d50 tx=0x7f78e40136b0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 1 -- 172.21.15.173:0/814961489 shutdown_connections 2024-04-25T09:06:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 1 --2- 172.21.15.173:0/814961489 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x558e10cf2c80 0x558e10cf5070 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 1 --2- 172.21.15.173:0/814961489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce32f0 0x558e10cc8270 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 1 --2- 172.21.15.173:0/814961489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce29d0 0x558e10cc7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 1 --2- 172.21.15.173:0/814961489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10c990a0 0x558e10cc77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78d2a00640 0 client.6243 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:20.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 1 -- 172.21.15.173:0/814961489 >> 172.21.15.173:0/814961489 conn(0x558e10c95020 msgr2=0x558e10c97ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 1 -- 172.21.15.173:0/814961489 shutdown_connections 2024-04-25T09:06:20.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 1 -- 172.21.15.173:0/814961489 wait complete. 2024-04-25T09:06:20.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.386+0000 7f78f7437000 20 client.6243 trim_cache size 0 max 16384 2024-04-25T09:06:20.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f7437000 1 Processor -- start 2024-04-25T09:06:20.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f7437000 1 -- start start 2024-04-25T09:06:20.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f7437000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10c990a0 0x558e10d3eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f7437000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce29d0 0x558e10d3f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f7437000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce32f0 0x558e10d3f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f7437000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec200330 con 0x558e10ce32f0 2024-04-25T09:06:20.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f7437000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec1ff4d0 con 0x558e10c990a0 2024-04-25T09:06:20.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f7437000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec1fea20 con 0x558e10ce29d0 2024-04-25T09:06:20.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f2000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce32f0 0x558e10d3f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f2000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce32f0 0x558e10d3f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46218/0 (socket says 172.21.15.173:46218) 2024-04-25T09:06:20.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f2000640 1 -- 172.21.15.173:0/4163449167 learned_addr learned my addr 172.21.15.173:0/4163449167 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:20.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f0c00640 1 --2- 172.21.15.173:0/4163449167 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce29d0 0x558e10d3f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f1600640 1 --2- 172.21.15.173:0/4163449167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10c990a0 0x558e10d3eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f2000640 1 -- 172.21.15.173:0/4163449167 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce29d0 msgr2=0x558e10d3f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f2000640 1 --2- 172.21.15.173:0/4163449167 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce29d0 0x558e10d3f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f2000640 1 -- 172.21.15.173:0/4163449167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10c990a0 msgr2=0x558e10d3eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f2000640 1 --2- 172.21.15.173:0/4163449167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10c990a0 0x558e10d3eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f2000640 1 -- 172.21.15.173:0/4163449167 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e10b2cde0 con 0x558e10ce32f0 2024-04-25T09:06:20.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f1600640 1 --2- 172.21.15.173:0/4163449167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10c990a0 0x558e10d3eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:20.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78f2000640 1 --2- 172.21.15.173:0/4163449167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce32f0 0x558e10d3f960 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f78e4009850 tx=0x7f78e4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26894e0f66de66a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78dd600640 1 -- 172.21.15.173:0/4163449167 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e401a070 con 0x558e10ce32f0 2024-04-25T09:06:20.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78dd600640 1 -- 172.21.15.173:0/4163449167 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e401b040 con 0x558e10ce32f0 2024-04-25T09:06:20.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.402+0000 7f78dd600640 1 -- 172.21.15.173:0/4163449167 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e4006110 con 0x558e10ce32f0 2024-04-25T09:06:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 -- 172.21.15.173:0/4163449167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce32f0 msgr2=0x558e10d3f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 --2- 172.21.15.173:0/4163449167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce32f0 0x558e10d3f960 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f78e4009850 tx=0x7f78e4011000 comp rx=0 tx=0).stop 2024-04-25T09:06:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 -- 172.21.15.173:0/4163449167 shutdown_connections 2024-04-25T09:06:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 --2- 172.21.15.173:0/4163449167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10ce32f0 0x558e10d3f960 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 --2- 172.21.15.173:0/4163449167 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce29d0 0x558e10d3f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 --2- 172.21.15.173:0/4163449167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10c990a0 0x558e10d3eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 -- 172.21.15.173:0/4163449167 >> 172.21.15.173:0/4163449167 conn(0x558e10c95020 msgr2=0x558e10ceffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 -- 172.21.15.173:0/4163449167 shutdown_connections 2024-04-25T09:06:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 -- 172.21.15.173:0/4163449167 wait complete. 2024-04-25T09:06:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 -- start start 2024-04-25T09:06:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 Processor -- start 2024-04-25T09:06:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10c990a0 0x558e10cf5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10ce29d0 0x558e10cf58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce32f0 0x558e10cf5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e10a80e00 con 0x558e10c990a0 2024-04-25T09:06:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec1feed0 con 0x558e10ce29d0 2024-04-25T09:06:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e10ae5300 con 0x558e10ce32f0 2024-04-25T09:06:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 10 client.0 _ll_register_callbacks cb 0x558e10c64040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f1600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10c990a0 0x558e10cf5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f1600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10c990a0 0x558e10cf5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46232/0 (socket says 172.21.15.173:46232) 2024-04-25T09:06:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f1600640 1 -- 172.21.15.173:0/3039506120 learned_addr learned my addr 172.21.15.173:0/3039506120 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f0c00640 1 --2- 172.21.15.173:0/3039506120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10ce29d0 0x558e10cf58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f2000640 1 --2- 172.21.15.173:0/3039506120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce32f0 0x558e10cf5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f1600640 1 -- 172.21.15.173:0/3039506120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce32f0 msgr2=0x558e10cf5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f1600640 1 --2- 172.21.15.173:0/3039506120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce32f0 0x558e10cf5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f1600640 1 -- 172.21.15.173:0/3039506120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10ce29d0 msgr2=0x558e10cf58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f1600640 1 --2- 172.21.15.173:0/3039506120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10ce29d0 0x558e10cf58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f1600640 1 -- 172.21.15.173:0/3039506120 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e10a878e0 con 0x558e10c990a0 2024-04-25T09:06:20.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f1600640 1 --2- 172.21.15.173:0/3039506120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10c990a0 0x558e10cf5380 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f78e000a430 tx=0x7f78e0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1889ed5d2c55d05a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78d2a00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:20.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78d2a00640 1 -- 172.21.15.173:0/3039506120 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e0071060 con 0x558e10c990a0 2024-04-25T09:06:20.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78d2a00640 1 -- 172.21.15.173:0/3039506120 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f78e005d3f0 con 0x558e10c990a0 2024-04-25T09:06:20.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 -- 172.21.15.173:0/3039506120 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f78e401b040 con 0x558e10c990a0 2024-04-25T09:06:20.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78d2a00640 1 -- 172.21.15.173:0/3039506120 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78e0079050 con 0x558e10c990a0 2024-04-25T09:06:20.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 10 client.6249 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:20.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78f7437000 1 -- 172.21.15.173:0/3039506120 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x558e10b3f8f0 con 0x558e10c990a0 2024-04-25T09:06:20.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.406+0000 7f78d2a00640 1 -- 172.21.15.173:0/3039506120 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e401b040 con 0x558e10c990a0 2024-04-25T09:06:20.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78d2a00640 1 -- 172.21.15.173:0/3039506120 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f78e007c020 con 0x558e10c990a0 2024-04-25T09:06:20.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f7437000 10 client.6249 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:20.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f7437000 10 client.6249 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:20.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f7437000 20 client.6249 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:20.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f7437000 1 --2- 172.21.15.173:0/3039506120 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x558e10cf6700 0x558e10d4af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f7437000 4 client.6249 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:06:20.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f7437000 1 -- 172.21.15.173:0/3039506120 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558e10af3530 con 0x558e10cf6700 2024-04-25T09:06:20.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f0c00640 1 --2- 172.21.15.173:0/3039506120 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x558e10cf6700 0x558e10d4af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f0c00640 1 --2- 172.21.15.173:0/3039506120 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x558e10cf6700 0x558e10d4af60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=259d20fec74e6ef2 server_cookie=3dc91322c0eb33cb in_seq=0 out_seq=0 2024-04-25T09:06:20.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78d2a00640 10 client.6249 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:20.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78d2a00640 1 -- 172.21.15.173:0/3039506120 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558e10af3530 con 0x558e10cf6700 2024-04-25T09:06:20.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78d2a00640 10 client.6249 handle_command_reply: tid=0 2024-04-25T09:06:20.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f7437000 1 client.6249 shutdown 2024-04-25T09:06:20.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f7437000 1 -- 172.21.15.173:0/3039506120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10c990a0 msgr2=0x558e10cf5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f7437000 1 --2- 172.21.15.173:0/3039506120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10c990a0 0x558e10cf5380 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f78e000a430 tx=0x7f78e0013000 comp rx=0 tx=0).stop 2024-04-25T09:06:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f7437000 1 -- 172.21.15.173:0/3039506120 shutdown_connections 2024-04-25T09:06:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f7437000 1 --2- 172.21.15.173:0/3039506120 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x558e10cf6700 0x558e10d4af60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f7437000 1 --2- 172.21.15.173:0/3039506120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558e10ce32f0 0x558e10cf5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f7437000 1 --2- 172.21.15.173:0/3039506120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e10ce29d0 0x558e10cf58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78d2a00640 0 client.6249 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f7437000 1 --2- 172.21.15.173:0/3039506120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e10c990a0 0x558e10cf5380 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f7437000 1 -- 172.21.15.173:0/3039506120 >> 172.21.15.173:0/3039506120 conn(0x558e10c95020 msgr2=0x558e10ce10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f7437000 1 -- 172.21.15.173:0/3039506120 shutdown_connections 2024-04-25T09:06:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f7437000 1 -- 172.21.15.173:0/3039506120 wait complete. 2024-04-25T09:06:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f7437000 20 client.6249 trim_cache size 0 max 16384 2024-04-25T09:06:20.402 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:20.403 INFO:teuthology.orchestra.run.smithi173.stdout: "status": "no active scrubs running", 2024-04-25T09:06:20.403 INFO:teuthology.orchestra.run.smithi173.stdout: "scrubs": {} 2024-04-25T09:06:20.403 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f4000640 1 -- 172.21.15.173:0/2337851228 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f78cc066f90 msgr2=0x7f78cc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f4000640 1 --2- 172.21.15.173:0/2337851228 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f78cc066f90 0x7f78cc069450 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f78d80b2000 tx=0x7f78d8008040 comp rx=0 tx=0).stop 2024-04-25T09:06:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f4000640 1 -- 172.21.15.173:0/2337851228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78ec06e1c0 msgr2=0x7f78ec145aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f4000640 1 --2- 172.21.15.173:0/2337851228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78ec06e1c0 0x7f78ec145aa0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f78e0001570 tx=0x7f78e000cd20 comp rx=0 tx=0).stop 2024-04-25T09:06:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f4000640 1 -- 172.21.15.173:0/2337851228 shutdown_connections 2024-04-25T09:06:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f4000640 1 --2- 172.21.15.173:0/2337851228 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f78cc066f90 0x7f78cc069450 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f4000640 1 --2- 172.21.15.173:0/2337851228 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78ec0ad3f0 0x7f78ec1e3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f4000640 1 --2- 172.21.15.173:0/2337851228 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78ec06f5b0 0x7f78ec153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f4000640 1 --2- 172.21.15.173:0/2337851228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f78ec06e1c0 0x7f78ec145aa0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f4000640 1 -- 172.21.15.173:0/2337851228 >> 172.21.15.173:0/2337851228 conn(0x7f78ec0cfed0 msgr2=0x7f78ec15a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f4000640 1 -- 172.21.15.173:0/2337851228 shutdown_connections 2024-04-25T09:06:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.410+0000 7f78f4000640 1 -- 172.21.15.173:0/2337851228 wait complete. 2024-04-25T09:06:20.417 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:06:20.417 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:06:20.417 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-04-25T09:06:20.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.566+0000 7f4386800640 1 Processor -- start 2024-04-25T09:06:20.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.566+0000 7f4386800640 1 -- start start 2024-04-25T09:06:20.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.566+0000 7f4386800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43800aeb90 0x7f43800cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.566+0000 7f4386800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f43800aef70 0x7f43800cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.566+0000 7f4386800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f43800cdba0 0x7f43800ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.566+0000 7f4386800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4380071320 con 0x7f43800cdba0 2024-04-25T09:06:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.566+0000 7f4386800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4380072330 con 0x7f43800aef70 2024-04-25T09:06:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.566+0000 7f4386800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43800ce550 con 0x7f43800aeb90 2024-04-25T09:06:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.566+0000 7f437fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f43800cdba0 0x7f43800ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.566+0000 7f437fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f43800cdba0 0x7f43800ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46242/0 (socket says 172.21.15.173:46242) 2024-04-25T09:06:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.566+0000 7f437fe00640 1 -- 172.21.15.173:0/3927032730 learned_addr learned my addr 172.21.15.173:0/3927032730 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.566+0000 7f437f400640 1 --2- 172.21.15.173:0/3927032730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43800aeb90 0x7f43800cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.566+0000 7f437ea00640 1 --2- 172.21.15.173:0/3927032730 >> v2:172.21.15.194:3300/0 conn(0x7f43800aef70 0x7f43800cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.570+0000 7f437fe00640 1 -- 172.21.15.173:0/3927032730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43800aeb90 msgr2=0x7f43800cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.570+0000 7f437fe00640 1 --2- 172.21.15.173:0/3927032730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43800aeb90 0x7f43800cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.570+0000 7f437fe00640 1 -- 172.21.15.173:0/3927032730 >> v2:172.21.15.194:3300/0 conn(0x7f43800aef70 msgr2=0x7f43800cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.570+0000 7f437fe00640 1 --2- 172.21.15.173:0/3927032730 >> v2:172.21.15.194:3300/0 conn(0x7f43800aef70 0x7f43800cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.570+0000 7f437fe00640 1 -- 172.21.15.173:0/3927032730 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4380071570 con 0x7f43800cdba0 2024-04-25T09:06:20.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.570+0000 7f437fe00640 1 --2- 172.21.15.173:0/3927032730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43800cdba0 0x7f43800ce010 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f438006b9e0 tx=0x7f437801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf285af8e83a883f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.570+0000 7f437e000640 1 -- 172.21.15.173:0/3927032730 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780ab620 con 0x7f43800cdba0 2024-04-25T09:06:20.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.570+0000 7f437e000640 1 -- 172.21.15.173:0/3927032730 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43780b0070 con 0x7f43800cdba0 2024-04-25T09:06:20.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.570+0000 7f437e000640 1 -- 172.21.15.173:0/3927032730 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780ab9e0 con 0x7f43800cdba0 2024-04-25T09:06:20.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.570+0000 7f4386800640 1 -- 172.21.15.173:0/3927032730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43800cdba0 msgr2=0x7f43800ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.570+0000 7f4386800640 1 --2- 172.21.15.173:0/3927032730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43800cdba0 0x7f43800ce010 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f438006b9e0 tx=0x7f437801c460 comp rx=0 tx=0).stop 2024-04-25T09:06:20.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.570+0000 7f4386800640 1 -- 172.21.15.173:0/3927032730 shutdown_connections 2024-04-25T09:06:20.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.570+0000 7f4386800640 1 --2- 172.21.15.173:0/3927032730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43800cdba0 0x7f43800ce010 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.570+0000 7f4386800640 1 --2- 172.21.15.173:0/3927032730 >> v2:172.21.15.194:3300/0 conn(0x7f43800aef70 0x7f43800cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.570+0000 7f4386800640 1 --2- 172.21.15.173:0/3927032730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43800aeb90 0x7f43800cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.570+0000 7f4386800640 1 -- 172.21.15.173:0/3927032730 >> 172.21.15.173:0/3927032730 conn(0x7f438006ac90 msgr2=0x7f438006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.570+0000 7f4386800640 1 -- 172.21.15.173:0/3927032730 shutdown_connections 2024-04-25T09:06:20.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.570+0000 7f4386800640 1 -- 172.21.15.173:0/3927032730 wait complete. 2024-04-25T09:06:20.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f4386800640 1 Processor -- start 2024-04-25T09:06:20.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f4386800640 1 -- start start 2024-04-25T09:06:20.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f4386800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43800aeb90 0x7f438014fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f4386800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43800aef70 0x7f4380147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f4386800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43800cdba0 0x7f4380150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f4386800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438015ef40 con 0x7f43800cdba0 2024-04-25T09:06:20.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f4386800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438015edc0 con 0x7f43800aef70 2024-04-25T09:06:20.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f4386800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438015f0c0 con 0x7f43800aeb90 2024-04-25T09:06:20.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f437fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43800cdba0 0x7f4380150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f437fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43800cdba0 0x7f4380150a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46258/0 (socket says 172.21.15.173:46258) 2024-04-25T09:06:20.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f437fe00640 1 -- 172.21.15.173:0/1955138654 learned_addr learned my addr 172.21.15.173:0/1955138654 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:20.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f437ea00640 1 --2- 172.21.15.173:0/1955138654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43800aef70 0x7f4380147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f437f400640 1 --2- 172.21.15.173:0/1955138654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43800aeb90 0x7f438014fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f437fe00640 1 -- 172.21.15.173:0/1955138654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43800aeb90 msgr2=0x7f438014fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f437fe00640 1 --2- 172.21.15.173:0/1955138654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43800aeb90 0x7f438014fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f437fe00640 1 -- 172.21.15.173:0/1955138654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43800aef70 msgr2=0x7f4380147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f437fe00640 1 --2- 172.21.15.173:0/1955138654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43800aef70 0x7f4380147b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f437fe00640 1 -- 172.21.15.173:0/1955138654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4380151430 con 0x7f43800cdba0 2024-04-25T09:06:20.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f437fe00640 1 --2- 172.21.15.173:0/1955138654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43800cdba0 0x7f4380150a20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f43780ad040 tx=0x7f437801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f4377400640 1 -- 172.21.15.173:0/1955138654 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780abcf0 con 0x7f43800cdba0 2024-04-25T09:06:20.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f4377400640 1 -- 172.21.15.173:0/1955138654 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43780be3f0 con 0x7f43800cdba0 2024-04-25T09:06:20.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f4386800640 1 -- 172.21.15.173:0/1955138654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438014f080 con 0x7f43800cdba0 2024-04-25T09:06:20.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f4377400640 1 -- 172.21.15.173:0/1955138654 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780be7e0 con 0x7f43800cdba0 2024-04-25T09:06:20.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.574+0000 7f4386800640 1 -- 172.21.15.173:0/1955138654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438014f640 con 0x7f43800cdba0 2024-04-25T09:06:20.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.578+0000 7f4377400640 1 -- 172.21.15.173:0/1955138654 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f43780b43f0 con 0x7f43800cdba0 2024-04-25T09:06:20.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.578+0000 7f4377400640 1 --2- 172.21.15.173:0/1955138654 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4360066f60 0x7f4360069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.578+0000 7f4377400640 1 -- 172.21.15.173:0/1955138654 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f437811f560 con 0x7f43800cdba0 2024-04-25T09:06:20.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.578+0000 7f437f400640 1 --2- 172.21.15.173:0/1955138654 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4360066f60 0x7f4360069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.578+0000 7f4389d4e000 1 Processor -- start 2024-04-25T09:06:20.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f4389d4e000 1 -- start start 2024-04-25T09:06:20.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f437f400640 1 --2- 172.21.15.173:0/1955138654 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4360066f60 0x7f4360069420 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f43800cc810 tx=0x7f4370009790 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f4389d4e000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db59b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f4389d4e000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 0x555db596d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f4389d4e000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db596da10 0x555db596ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f4389d4e000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555db57b6f20 con 0x555db59b7cf0 2024-04-25T09:06:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f4389d4e000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x555db573f000 con 0x555db596da10 2024-04-25T09:06:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f4389d4e000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x555db57b2fc0 con 0x555db59b73d0 2024-04-25T09:06:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f437ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 0x555db596d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f437f400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db59b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f437f400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db59b77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:49840/0 (socket says 172.21.15.173:49840) 2024-04-25T09:06:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f437f400640 1 -- 172.21.15.173:0/1456518254 learned_addr learned my addr 172.21.15.173:0/1456518254 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f437fe00640 1 --2- 172.21.15.173:0/1456518254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db596da10 0x555db596ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f437ea00640 1 -- 172.21.15.173:0/1456518254 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 msgr2=0x555db59b77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f437ea00640 1 --2- 172.21.15.173:0/1456518254 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db59b77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f437ea00640 1 -- 172.21.15.173:0/1456518254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db596da10 msgr2=0x555db596ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f437ea00640 1 --2- 172.21.15.173:0/1456518254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db596da10 0x555db596ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f437ea00640 1 -- 172.21.15.173:0/1456518254 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555db5792ba0 con 0x555db59b7cf0 2024-04-25T09:06:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f437f400640 1 --2- 172.21.15.173:0/1456518254 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db59b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f437ea00640 1 --2- 172.21.15.173:0/1456518254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 0x555db596d4d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4380148ff0 tx=0x7f436c007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5ee957bad83ba3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f436be00640 1 -- 172.21.15.173:0/1456518254 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c018020 con 0x555db59b7cf0 2024-04-25T09:06:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f436be00640 1 -- 172.21.15.173:0/1456518254 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c004300 con 0x555db59b7cf0 2024-04-25T09:06:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f436be00640 1 -- 172.21.15.173:0/1456518254 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c010a20 con 0x555db59b7cf0 2024-04-25T09:06:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f4389d4e000 1 -- 172.21.15.173:0/1456518254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 msgr2=0x555db596d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f4389d4e000 1 --2- 172.21.15.173:0/1456518254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 0x555db596d4d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4380148ff0 tx=0x7f436c007d40 comp rx=0 tx=0).stop 2024-04-25T09:06:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f4389d4e000 1 -- 172.21.15.173:0/1456518254 shutdown_connections 2024-04-25T09:06:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f4389d4e000 1 --2- 172.21.15.173:0/1456518254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db596da10 0x555db596ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f4389d4e000 1 --2- 172.21.15.173:0/1456518254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 0x555db596d4d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f4389d4e000 1 --2- 172.21.15.173:0/1456518254 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db59b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f4389d4e000 1 -- 172.21.15.173:0/1456518254 >> 172.21.15.173:0/1456518254 conn(0x555db596f760 msgr2=0x555db59679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f4389d4e000 1 -- 172.21.15.173:0/1456518254 shutdown_connections 2024-04-25T09:06:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f4389d4e000 1 -- 172.21.15.173:0/1456518254 wait complete. 2024-04-25T09:06:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f4389d4e000 1 -- start start 2024-04-25T09:06:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.582+0000 7f4389d4e000 1 Processor -- start 2024-04-25T09:06:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db596da10 0x555db59785a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db5978ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 0x555db5979020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555db57715d0 con 0x555db59b7cf0 2024-04-25T09:06:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x555db576bd40 con 0x555db596da10 2024-04-25T09:06:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x555db57b6230 con 0x555db59b73d0 2024-04-25T09:06:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 10 client.0 _ll_register_callbacks cb 0x555db5954a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f437fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 0x555db5979020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f437ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db5978ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f437f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db596da10 0x555db59785a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f437fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 0x555db5979020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46288/0 (socket says 172.21.15.173:46288) 2024-04-25T09:06:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f437ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db5978ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:49844/0 (socket says 172.21.15.173:49844) 2024-04-25T09:06:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f437fe00640 1 -- 172.21.15.173:0/2759427801 learned_addr learned my addr 172.21.15.173:0/2759427801 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f437fe00640 1 -- 172.21.15.173:0/2759427801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 msgr2=0x555db5978ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f437fe00640 1 --2- 172.21.15.173:0/2759427801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db5978ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f437fe00640 1 -- 172.21.15.173:0/2759427801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db596da10 msgr2=0x555db59785a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f437fe00640 1 --2- 172.21.15.173:0/2759427801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db596da10 0x555db59785a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f437fe00640 1 -- 172.21.15.173:0/2759427801 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555db57fd5a0 con 0x555db59b7cf0 2024-04-25T09:06:20.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f437fe00640 1 --2- 172.21.15.173:0/2759427801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 0x555db5979020 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f437801c9d0 tx=0x7f4378019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834d0067db7966a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4368c00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:20.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4368c00640 1 -- 172.21.15.173:0/2759427801 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780f3d90 con 0x555db59b7cf0 2024-04-25T09:06:20.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4368c00640 1 -- 172.21.15.173:0/2759427801 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f437811f0b0 con 0x555db59b7cf0 2024-04-25T09:06:20.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 1 -- 172.21.15.173:0/2759427801 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f436c004300 con 0x555db59b7cf0 2024-04-25T09:06:20.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4368c00640 1 -- 172.21.15.173:0/2759427801 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43780f8350 con 0x555db59b7cf0 2024-04-25T09:06:20.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 10 client.6261 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:20.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 1 -- 172.21.15.173:0/2759427801 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x555db578e2b0 con 0x555db59b7cf0 2024-04-25T09:06:20.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4368c00640 1 -- 172.21.15.173:0/2759427801 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c004300 con 0x555db59b7cf0 2024-04-25T09:06:20.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4368c00640 1 -- 172.21.15.173:0/2759427801 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f437811b030 con 0x555db59b7cf0 2024-04-25T09:06:20.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 10 client.6261 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:20.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 10 client.6261 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:20.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 20 client.6261 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:20.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 1 --2- 172.21.15.173:0/2759427801 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x555db59798f0 0x555db59c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 4 client.6261 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:20.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 1 -- 172.21.15.173:0/2759427801 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555db5752c70 con 0x555db59798f0 2024-04-25T09:06:20.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f437f400640 1 --2- 172.21.15.173:0/2759427801 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x555db59798f0 0x555db59c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f437f400640 1 --2- 172.21.15.173:0/2759427801 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x555db59798f0 0x555db59c8b50 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32687d6e0a6442cd server_cookie=15b8e0c6e2772675 in_seq=0 out_seq=0 2024-04-25T09:06:20.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4368c00640 10 client.6261 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:20.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4368c00640 1 -- 172.21.15.173:0/2759427801 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555db5752c70 con 0x555db59798f0 2024-04-25T09:06:20.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4368c00640 10 client.6261 handle_command_reply: tid=0 2024-04-25T09:06:20.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 1 client.6261 shutdown 2024-04-25T09:06:20.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 1 -- 172.21.15.173:0/2759427801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 msgr2=0x555db5979020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.586+0000 7f4389d4e000 1 --2- 172.21.15.173:0/2759427801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 0x555db5979020 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f437801c9d0 tx=0x7f4378019200 comp rx=0 tx=0).stop 2024-04-25T09:06:20.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.590+0000 7f4389d4e000 1 -- 172.21.15.173:0/2759427801 shutdown_connections 2024-04-25T09:06:20.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.590+0000 7f4389d4e000 1 --2- 172.21.15.173:0/2759427801 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x555db59798f0 0x555db59c8b50 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.590+0000 7f4389d4e000 1 --2- 172.21.15.173:0/2759427801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 0x555db5979020 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.590+0000 7f4389d4e000 1 --2- 172.21.15.173:0/2759427801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db5978ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.590+0000 7f4389d4e000 1 --2- 172.21.15.173:0/2759427801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db596da10 0x555db59785a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.590+0000 7f4368c00640 0 client.6261 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:20.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.590+0000 7f4389d4e000 1 -- 172.21.15.173:0/2759427801 >> 172.21.15.173:0/2759427801 conn(0x555db596f760 msgr2=0x555db596ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.590+0000 7f4389d4e000 1 -- 172.21.15.173:0/2759427801 shutdown_connections 2024-04-25T09:06:20.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.590+0000 7f4389d4e000 1 -- 172.21.15.173:0/2759427801 wait complete. 2024-04-25T09:06:20.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.590+0000 7f4389d4e000 20 client.6261 trim_cache size 0 max 16384 2024-04-25T09:06:20.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f4389d4e000 1 Processor -- start 2024-04-25T09:06:20.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f4389d4e000 1 -- start start 2024-04-25T09:06:20.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f4389d4e000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db596da10 0x555db5974640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f4389d4e000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db5974b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f4389d4e000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db59b7cf0 0x555db5967110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f4389d4e000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43801fecc0 con 0x555db596da10 2024-04-25T09:06:20.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f4389d4e000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438015c8d0 con 0x555db59b7cf0 2024-04-25T09:06:20.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f4389d4e000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4380152b40 con 0x555db59b73d0 2024-04-25T09:06:20.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f437f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db596da10 0x555db5974640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f437f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db596da10 0x555db5974640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46294/0 (socket says 172.21.15.173:46294) 2024-04-25T09:06:20.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f437f400640 1 -- 172.21.15.173:0/1352595717 learned_addr learned my addr 172.21.15.173:0/1352595717 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:20.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f437ea00640 1 --2- 172.21.15.173:0/1352595717 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db5974b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f437fe00640 1 --2- 172.21.15.173:0/1352595717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db59b7cf0 0x555db5967110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f437f400640 1 -- 172.21.15.173:0/1352595717 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 msgr2=0x555db5974b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f437f400640 1 --2- 172.21.15.173:0/1352595717 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db5974b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f437f400640 1 -- 172.21.15.173:0/1352595717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db59b7cf0 msgr2=0x555db5967110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f437f400640 1 --2- 172.21.15.173:0/1352595717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db59b7cf0 0x555db5967110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f437f400640 1 -- 172.21.15.173:0/1352595717 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555db5968ef0 con 0x555db596da10 2024-04-25T09:06:20.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f437fe00640 1 --2- 172.21.15.173:0/1352595717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db59b7cf0 0x555db5967110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:20.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.602+0000 7f437f400640 1 --2- 172.21.15.173:0/1352595717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db596da10 0x555db5974640 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f43700048f0 tx=0x7f4370013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1613312a36aeee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f436b400640 1 -- 172.21.15.173:0/1352595717 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4370017c50 con 0x555db596da10 2024-04-25T09:06:20.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f436b400640 1 -- 172.21.15.173:0/1352595717 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437002e030 con 0x555db596da10 2024-04-25T09:06:20.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f436b400640 1 -- 172.21.15.173:0/1352595717 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4370017df0 con 0x555db596da10 2024-04-25T09:06:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f4389d4e000 1 -- 172.21.15.173:0/1352595717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db596da10 msgr2=0x555db5974640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f4389d4e000 1 --2- 172.21.15.173:0/1352595717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db596da10 0x555db5974640 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f43700048f0 tx=0x7f4370013000 comp rx=0 tx=0).stop 2024-04-25T09:06:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f4389d4e000 1 -- 172.21.15.173:0/1352595717 shutdown_connections 2024-04-25T09:06:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f4389d4e000 1 --2- 172.21.15.173:0/1352595717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db59b7cf0 0x555db5967110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f4389d4e000 1 --2- 172.21.15.173:0/1352595717 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db5974b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f4389d4e000 1 --2- 172.21.15.173:0/1352595717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db596da10 0x555db5974640 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f4389d4e000 1 -- 172.21.15.173:0/1352595717 >> 172.21.15.173:0/1352595717 conn(0x555db596f760 msgr2=0x555db5973f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f4389d4e000 1 -- 172.21.15.173:0/1352595717 shutdown_connections 2024-04-25T09:06:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f4389d4e000 1 -- 172.21.15.173:0/1352595717 wait complete. 2024-04-25T09:06:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f4389d4e000 1 -- start start 2024-04-25T09:06:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f4389d4e000 1 Processor -- start 2024-04-25T09:06:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f4389d4e000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db596da10 0x555db59c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f4389d4e000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db59d45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f4389d4e000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 0x555db59d4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f4389d4e000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555db57bb550 con 0x555db59b7cf0 2024-04-25T09:06:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f4389d4e000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438015c2d0 con 0x555db596da10 2024-04-25T09:06:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f4389d4e000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x555db575a360 con 0x555db59b73d0 2024-04-25T09:06:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f4389d4e000 10 client.0 _ll_register_callbacks cb 0x555db5935600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f437fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 0x555db59d4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f437ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db59d45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f437f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db596da10 0x555db59c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f437fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 0x555db59d4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46298/0 (socket says 172.21.15.173:46298) 2024-04-25T09:06:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f437fe00640 1 -- 172.21.15.173:0/1595492492 learned_addr learned my addr 172.21.15.173:0/1595492492 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f437fe00640 1 -- 172.21.15.173:0/1595492492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 msgr2=0x555db59d45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f437fe00640 1 --2- 172.21.15.173:0/1595492492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db59d45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f437fe00640 1 -- 172.21.15.173:0/1595492492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db596da10 msgr2=0x555db59c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f437fe00640 1 --2- 172.21.15.173:0/1595492492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db596da10 0x555db59c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f437fe00640 1 -- 172.21.15.173:0/1595492492 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555db573f250 con 0x555db59b7cf0 2024-04-25T09:06:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.606+0000 7f437f400640 1 --2- 172.21.15.173:0/1595492492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db596da10 0x555db59c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f437fe00640 1 --2- 172.21.15.173:0/1595492492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 0x555db59d4b20 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f437811f010 tx=0x7f43780b0000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2643db7448ea7614 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4368c00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4368c00640 1 -- 172.21.15.173:0/1595492492 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780f3d90 con 0x555db59b7cf0 2024-04-25T09:06:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 1 -- 172.21.15.173:0/1595492492 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f437002e030 con 0x555db59b7cf0 2024-04-25T09:06:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4368c00640 1 -- 172.21.15.173:0/1595492492 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f43780ebc40 con 0x555db59b7cf0 2024-04-25T09:06:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4368c00640 1 -- 172.21.15.173:0/1595492492 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43780ebf90 con 0x555db59b7cf0 2024-04-25T09:06:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 10 client.6267 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 1 -- 172.21.15.173:0/1595492492 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x555db574bb90 con 0x555db59b7cf0 2024-04-25T09:06:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4368c00640 1 -- 172.21.15.173:0/1595492492 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437002e030 con 0x555db59b7cf0 2024-04-25T09:06:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4368c00640 1 -- 172.21.15.173:0/1595492492 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f437811b070 con 0x555db59b7cf0 2024-04-25T09:06:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 10 client.6267 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 10 client.6267 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 20 client.6267 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 1 --2- 172.21.15.173:0/1595492492 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x555db59d5060 0x555db5a1fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 4 client.6267 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T09:06:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 1 -- 172.21.15.173:0/1595492492 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555db57c4460 con 0x555db59d5060 2024-04-25T09:06:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f437f400640 1 --2- 172.21.15.173:0/1595492492 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x555db59d5060 0x555db5a1fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f437f400640 1 --2- 172.21.15.173:0/1595492492 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x555db59d5060 0x555db5a1fa50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=740a7780e62f4d90 server_cookie=8052e91f05448f22 in_seq=0 out_seq=0 2024-04-25T09:06:20.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4368c00640 10 client.6267 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:20.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4368c00640 1 -- 172.21.15.173:0/1595492492 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+168 (crc 0 0 0) 0x555db57c4460 con 0x555db59d5060 2024-04-25T09:06:20.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4368c00640 10 client.6267 handle_command_reply: tid=0 2024-04-25T09:06:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 1 client.6267 shutdown 2024-04-25T09:06:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 1 -- 172.21.15.173:0/1595492492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 msgr2=0x555db59d4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 1 --2- 172.21.15.173:0/1595492492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 0x555db59d4b20 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f437811f010 tx=0x7f43780b0000 comp rx=0 tx=0).stop 2024-04-25T09:06:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 1 -- 172.21.15.173:0/1595492492 shutdown_connections 2024-04-25T09:06:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 1 --2- 172.21.15.173:0/1595492492 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x555db59d5060 0x555db5a1fa50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 1 --2- 172.21.15.173:0/1595492492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555db59b7cf0 0x555db59d4b20 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 1 --2- 172.21.15.173:0/1595492492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555db59b73d0 0x555db59d45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 1 --2- 172.21.15.173:0/1595492492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555db596da10 0x555db59c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4368c00640 0 client.6267 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 1 -- 172.21.15.173:0/1595492492 >> 172.21.15.173:0/1595492492 conn(0x555db596f760 msgr2=0x555db59747c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 1 -- 172.21.15.173:0/1595492492 shutdown_connections 2024-04-25T09:06:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 1 -- 172.21.15.173:0/1595492492 wait complete. 2024-04-25T09:06:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4389d4e000 20 client.6267 trim_cache size 0 max 16384 2024-04-25T09:06:20.603 INFO:teuthology.orchestra.run.smithi173.stdout:[ 2024-04-25T09:06:20.603 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:20.603 INFO:teuthology.orchestra.run.smithi173.stdout: "damage_type": "backtrace", 2024-04-25T09:06:20.603 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 3903933147, 2024-04-25T09:06:20.603 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 1099511630187, 2024-04-25T09:06:20.603 INFO:teuthology.orchestra.run.smithi173.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0" 2024-04-25T09:06:20.603 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:20.603 INFO:teuthology.orchestra.run.smithi173.stdout:] 2024-04-25T09:06:20.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4386800640 1 -- 172.21.15.173:0/1955138654 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4360066f60 msgr2=0x7f4360069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4386800640 1 --2- 172.21.15.173:0/1955138654 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4360066f60 0x7f4360069420 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f43800cc810 tx=0x7f4370009790 comp rx=0 tx=0).stop 2024-04-25T09:06:20.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4386800640 1 -- 172.21.15.173:0/1955138654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43800cdba0 msgr2=0x7f4380150a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4386800640 1 --2- 172.21.15.173:0/1955138654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43800cdba0 0x7f4380150a20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f43780ad040 tx=0x7f437801aca0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4386800640 1 -- 172.21.15.173:0/1955138654 shutdown_connections 2024-04-25T09:06:20.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4386800640 1 --2- 172.21.15.173:0/1955138654 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4360066f60 0x7f4360069420 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4386800640 1 --2- 172.21.15.173:0/1955138654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43800cdba0 0x7f4380150a20 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4386800640 1 --2- 172.21.15.173:0/1955138654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43800aef70 0x7f4380147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4386800640 1 --2- 172.21.15.173:0/1955138654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43800aeb90 0x7f438014fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4386800640 1 -- 172.21.15.173:0/1955138654 >> 172.21.15.173:0/1955138654 conn(0x7f438006ac90 msgr2=0x7f438006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4386800640 1 -- 172.21.15.173:0/1955138654 shutdown_connections 2024-04-25T09:06:20.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.610+0000 7f4386800640 1 -- 172.21.15.173:0/1955138654 wait complete. 2024-04-25T09:06:20.618 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.766+0000 7f908fe00640 1 Processor -- start 2024-04-25T09:06:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.766+0000 7f908fe00640 1 -- start start 2024-04-25T09:06:20.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.766+0000 7f908fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f909015ed60 0x7f909006e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.766+0000 7f908fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90900cd7d0 0x7f909006ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.766+0000 7f908fe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909006e950 con 0x7f909006b1d0 2024-04-25T09:06:20.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.766+0000 7f908fe00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90900cce80 con 0x7f909015ed60 2024-04-25T09:06:20.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.766+0000 7f908fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909006ec30 con 0x7f90900cd7d0 2024-04-25T09:06:20.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.766+0000 7f908ea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f909015ed60 0x7f909006e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.766+0000 7f908ea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f909015ed60 0x7f909006e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46300/0 (socket says 172.21.15.173:46300) 2024-04-25T09:06:20.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.766+0000 7f908ea00640 1 -- 172.21.15.173:0/1354106900 learned_addr learned my addr 172.21.15.173:0/1354106900 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:20.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.766+0000 7f9086000640 1 --2- 172.21.15.173:0/1354106900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90900cd7d0 0x7f909006ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.766+0000 7f908ea00640 1 -- 172.21.15.173:0/1354106900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90900cd7d0 msgr2=0x7f909006ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.766+0000 7f908ea00640 1 --2- 172.21.15.173:0/1354106900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90900cd7d0 0x7f909006ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.766+0000 7f908ea00640 1 -- 172.21.15.173:0/1354106900 >> v1:172.21.15.194:6789/0 conn(0x7f909006b1d0 legacy=0x7f909015f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:20.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.766+0000 7f908ea00640 1 -- 172.21.15.173:0/1354106900 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909006ef10 con 0x7f909015ed60 2024-04-25T09:06:20.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.766+0000 7f9086000640 1 --2- 172.21.15.173:0/1354106900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90900cd7d0 0x7f909006ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:20.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.770+0000 7f908ea00640 1 --2- 172.21.15.173:0/1354106900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f909015ed60 0x7f909006e290 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9080009e50 tx=0x7f908001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4876f167d01665f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.770+0000 7f908e000640 1 -- 172.21.15.173:0/1354106900 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800a5670 con 0x7f909015ed60 2024-04-25T09:06:20.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.770+0000 7f908e000640 1 -- 172.21.15.173:0/1354106900 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90800a5810 con 0x7f909015ed60 2024-04-25T09:06:20.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.770+0000 7f908e000640 1 -- 172.21.15.173:0/1354106900 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800a5be0 con 0x7f909015ed60 2024-04-25T09:06:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.770+0000 7f908fe00640 1 -- 172.21.15.173:0/1354106900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f909015ed60 msgr2=0x7f909006e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.770+0000 7f908fe00640 1 --2- 172.21.15.173:0/1354106900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f909015ed60 0x7f909006e290 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9080009e50 tx=0x7f908001c9f0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.770+0000 7f908fe00640 1 -- 172.21.15.173:0/1354106900 shutdown_connections 2024-04-25T09:06:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.770+0000 7f908fe00640 1 --2- 172.21.15.173:0/1354106900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90900cd7d0 0x7f909006ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.770+0000 7f908fe00640 1 --2- 172.21.15.173:0/1354106900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f909015ed60 0x7f909006e290 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.770+0000 7f908fe00640 1 -- 172.21.15.173:0/1354106900 >> 172.21.15.173:0/1354106900 conn(0x7f9090072730 msgr2=0x7f9090099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.770+0000 7f908fe00640 1 -- 172.21.15.173:0/1354106900 shutdown_connections 2024-04-25T09:06:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.770+0000 7f908fe00640 1 -- 172.21.15.173:0/1354106900 wait complete. 2024-04-25T09:06:20.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908fe00640 1 Processor -- start 2024-04-25T09:06:20.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908fe00640 1 -- start start 2024-04-25T09:06:20.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f909006b1d0 0x7f90901575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90900cd7d0 0x7f90900c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f909015ed60 0x7f90900c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908fe00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90901689b0 con 0x7f909006b1d0 2024-04-25T09:06:20.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908fe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9090168830 con 0x7f90900cd7d0 2024-04-25T09:06:20.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9090168b30 con 0x7f909015ed60 2024-04-25T09:06:20.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f909006b1d0 0x7f90901575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f909006b1d0 0x7f90901575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46312/0 (socket says 172.21.15.173:46312) 2024-04-25T09:06:20.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908ea00640 1 -- 172.21.15.173:0/4187178643 learned_addr learned my addr 172.21.15.173:0/4187178643 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:20.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f9086000640 1 --2- 172.21.15.173:0/4187178643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90900cd7d0 0x7f90900c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908f400640 1 --2- 172.21.15.173:0/4187178643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f909015ed60 0x7f90900c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908ea00640 1 -- 172.21.15.173:0/4187178643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f909015ed60 msgr2=0x7f90900c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908ea00640 1 --2- 172.21.15.173:0/4187178643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f909015ed60 0x7f90900c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908ea00640 1 -- 172.21.15.173:0/4187178643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90900cd7d0 msgr2=0x7f90900c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908ea00640 1 --2- 172.21.15.173:0/4187178643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90900cd7d0 0x7f90900c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908ea00640 1 -- 172.21.15.173:0/4187178643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9090157c40 con 0x7f909006b1d0 2024-04-25T09:06:20.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908ea00640 1 --2- 172.21.15.173:0/4187178643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f909006b1d0 0x7f90901575b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f908001b0a0 tx=0x7f9080019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f9087400640 1 -- 172.21.15.173:0/4187178643 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800b8880 con 0x7f909006b1d0 2024-04-25T09:06:20.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f9087400640 1 -- 172.21.15.173:0/4187178643 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90800be070 con 0x7f909006b1d0 2024-04-25T09:06:20.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f9087400640 1 -- 172.21.15.173:0/4187178643 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800b8c80 con 0x7f909006b1d0 2024-04-25T09:06:20.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908fe00640 1 -- 172.21.15.173:0/4187178643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9090157f20 con 0x7f909006b1d0 2024-04-25T09:06:20.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.774+0000 7f908fe00640 1 -- 172.21.15.173:0/4187178643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90901584e0 con 0x7f909006b1d0 2024-04-25T09:06:20.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.778+0000 7f908fe00640 1 -- 172.21.15.173:0/4187178643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9090073a40 con 0x7f909006b1d0 2024-04-25T09:06:20.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.778+0000 7f9087400640 1 -- 172.21.15.173:0/4187178643 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f90800c3460 con 0x7f909006b1d0 2024-04-25T09:06:20.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.778+0000 7f9087400640 1 --2- 172.21.15.173:0/4187178643 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f906c066f60 0x7f906c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.778+0000 7f9087400640 1 -- 172.21.15.173:0/4187178643 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9080120520 con 0x7f909006b1d0 2024-04-25T09:06:20.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.778+0000 7f9086000640 1 --2- 172.21.15.173:0/4187178643 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f906c066f60 0x7f906c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.778+0000 7f9086000640 1 --2- 172.21.15.173:0/4187178643 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f906c066f60 0x7f906c069420 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f909015a3e0 tx=0x7f9078008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.782+0000 7f9087400640 1 -- 172.21.15.173:0/4187178643 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f90800165e0 con 0x7f909006b1d0 2024-04-25T09:06:20.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.966+0000 7f908fe00640 1 -- 172.21.15.173:0/4187178643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90900cd060 con 0x7f909006b1d0 2024-04-25T09:06:20.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.966+0000 7f9087400640 1 -- 172.21.15.173:0/4187178643 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f90800f0ea0 con 0x7f909006b1d0 2024-04-25T09:06:20.957 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:20.957 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:05:57.598642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:20.957 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 26 2024-04-25T09:06:20.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.970+0000 7f908fe00640 1 -- 172.21.15.173:0/4187178643 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f906c066f60 msgr2=0x7f906c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.970+0000 7f908fe00640 1 --2- 172.21.15.173:0/4187178643 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f906c066f60 0x7f906c069420 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f909015a3e0 tx=0x7f9078008040 comp rx=0 tx=0).stop 2024-04-25T09:06:20.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.970+0000 7f908fe00640 1 -- 172.21.15.173:0/4187178643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f909006b1d0 msgr2=0x7f90901575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.970+0000 7f908fe00640 1 --2- 172.21.15.173:0/4187178643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f909006b1d0 0x7f90901575b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f908001b0a0 tx=0x7f9080019790 comp rx=0 tx=0).stop 2024-04-25T09:06:20.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.970+0000 7f908fe00640 1 -- 172.21.15.173:0/4187178643 shutdown_connections 2024-04-25T09:06:20.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.970+0000 7f908fe00640 1 --2- 172.21.15.173:0/4187178643 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f906c066f60 0x7f906c069420 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.970+0000 7f908fe00640 1 --2- 172.21.15.173:0/4187178643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f909015ed60 0x7f90900c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.970+0000 7f908fe00640 1 --2- 172.21.15.173:0/4187178643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90900cd7d0 0x7f90900c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.970+0000 7f908fe00640 1 --2- 172.21.15.173:0/4187178643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f909006b1d0 0x7f90901575b0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.970+0000 7f908fe00640 1 -- 172.21.15.173:0/4187178643 >> 172.21.15.173:0/4187178643 conn(0x7f9090072730 msgr2=0x7f90900b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.970+0000 7f908fe00640 1 -- 172.21.15.173:0/4187178643 shutdown_connections 2024-04-25T09:06:20.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:20.970+0000 7f908fe00640 1 -- 172.21.15.173:0/4187178643 wait complete. 2024-04-25T09:06:20.978 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage rm 3903933147 2024-04-25T09:06:21.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.126+0000 7f70f7200640 1 Processor -- start 2024-04-25T09:06:21.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.126+0000 7f70f7200640 1 -- start start 2024-04-25T09:06:21.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.130+0000 7f70f7200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f70f00b3fe0 0x7f70f00b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.130+0000 7f70f7200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f70f00cc260 0x7f70f00cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.130+0000 7f70f7200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f006d4b0 con 0x7f70f0145290 2024-04-25T09:06:21.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.130+0000 7f70f7200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f006d790 con 0x7f70f00cc260 2024-04-25T09:06:21.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.130+0000 7f70f7200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f006da70 con 0x7f70f00b3fe0 2024-04-25T09:06:21.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.130+0000 7f70f5200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f70f00cc260 0x7f70f00cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.130+0000 7f70efe00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f70f0145290 0x7f70f015c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:59500/0 (socket says 172.21.15.173:59500) 2024-04-25T09:06:21.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.130+0000 7f70efe00640 1 -- 172.21.15.173:0/1947919364 learned_addr learned my addr 172.21.15.173:0/1947919364 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:21.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.130+0000 7f70e7400640 1 --2- 172.21.15.173:0/1947919364 >> v2:172.21.15.194:3300/0 conn(0x7f70f00b3fe0 0x7f70f00b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.130+0000 7f70f5200640 1 -- 172.21.15.173:0/1947919364 >> v2:172.21.15.194:3300/0 conn(0x7f70f00b3fe0 msgr2=0x7f70f00b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:21.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.130+0000 7f70f5200640 1 --2- 172.21.15.173:0/1947919364 >> v2:172.21.15.194:3300/0 conn(0x7f70f00b3fe0 0x7f70f00b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.130+0000 7f70f5200640 1 -- 172.21.15.173:0/1947919364 >> v1:172.21.15.194:6789/0 conn(0x7f70f0145290 legacy=0x7f70f015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:21.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.130+0000 7f70f5200640 1 -- 172.21.15.173:0/1947919364 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f006dd50 con 0x7f70f00cc260 2024-04-25T09:06:21.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.130+0000 7f70f5200640 1 --2- 172.21.15.173:0/1947919364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70f00cc260 0x7f70f00cc670 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f70f0071100 tx=0x7f70e801c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de52c3279dcd561a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:21.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.130+0000 7f70ef400640 1 -- 172.21.15.173:0/1947919364 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e80b2070 con 0x7f70f00cc260 2024-04-25T09:06:21.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70ef400640 1 -- 172.21.15.173:0/1947919364 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e80a57e0 con 0x7f70f00cc260 2024-04-25T09:06:21.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70ef400640 1 -- 172.21.15.173:0/1947919364 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e80a5bb0 con 0x7f70f00cc260 2024-04-25T09:06:21.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70f7200640 1 -- 172.21.15.173:0/1947919364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70f00cc260 msgr2=0x7f70f00cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:21.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70f7200640 1 --2- 172.21.15.173:0/1947919364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70f00cc260 0x7f70f00cc670 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f70f0071100 tx=0x7f70e801c810 comp rx=0 tx=0).stop 2024-04-25T09:06:21.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70f7200640 1 -- 172.21.15.173:0/1947919364 shutdown_connections 2024-04-25T09:06:21.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70f7200640 1 --2- 172.21.15.173:0/1947919364 >> v2:172.21.15.194:3300/0 conn(0x7f70f00b3fe0 0x7f70f00b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70f7200640 1 --2- 172.21.15.173:0/1947919364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70f00cc260 0x7f70f00cc670 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70f7200640 1 -- 172.21.15.173:0/1947919364 >> 172.21.15.173:0/1947919364 conn(0x7f70f006ac90 msgr2=0x7f70f006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:21.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70f7200640 1 -- 172.21.15.173:0/1947919364 shutdown_connections 2024-04-25T09:06:21.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70f7200640 1 -- 172.21.15.173:0/1947919364 wait complete. 2024-04-25T09:06:21.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70f7200640 1 Processor -- start 2024-04-25T09:06:21.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70f7200640 1 -- start start 2024-04-25T09:06:21.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70f7200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f00b3fe0 0x7f70f015b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70f7200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70f00cc260 0x7f70f00ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70f7200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70f0145290 0x7f70f00ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70f7200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f006eee0 con 0x7f70f00cc260 2024-04-25T09:06:21.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70f7200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f006ed60 con 0x7f70f00b3fe0 2024-04-25T09:06:21.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70f7200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f006f060 con 0x7f70f0145290 2024-04-25T09:06:21.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70e7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70f00cc260 0x7f70f00ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70e7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70f00cc260 0x7f70f00ad4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46320/0 (socket says 172.21.15.173:46320) 2024-04-25T09:06:21.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70e7400640 1 -- 172.21.15.173:0/716197968 learned_addr learned my addr 172.21.15.173:0/716197968 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:21.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70efe00640 1 --2- 172.21.15.173:0/716197968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f00b3fe0 0x7f70f015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.134+0000 7f70f5200640 1 --2- 172.21.15.173:0/716197968 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70f0145290 0x7f70f00ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.138+0000 7f70e7400640 1 -- 172.21.15.173:0/716197968 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70f0145290 msgr2=0x7f70f00ada20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:21.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.138+0000 7f70e7400640 1 --2- 172.21.15.173:0/716197968 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70f0145290 0x7f70f00ada20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.138+0000 7f70e7400640 1 -- 172.21.15.173:0/716197968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f00b3fe0 msgr2=0x7f70f015b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:21.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.138+0000 7f70e7400640 1 --2- 172.21.15.173:0/716197968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f00b3fe0 0x7f70f015b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.138+0000 7f70e7400640 1 -- 172.21.15.173:0/716197968 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f013ef30 con 0x7f70f00cc260 2024-04-25T09:06:21.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.138+0000 7f70e7400640 1 --2- 172.21.15.173:0/716197968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70f00cc260 0x7f70f00ad4e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f70d800d5f0 tx=0x7f70d800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:21.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.138+0000 7f70ecc00640 1 -- 172.21.15.173:0/716197968 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d80125f0 con 0x7f70f00cc260 2024-04-25T09:06:21.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.138+0000 7f70ecc00640 1 -- 172.21.15.173:0/716197968 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d8019070 con 0x7f70f00cc260 2024-04-25T09:06:21.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.138+0000 7f70f7200640 1 -- 172.21.15.173:0/716197968 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f013f210 con 0x7f70f00cc260 2024-04-25T09:06:21.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.138+0000 7f70ecc00640 1 -- 172.21.15.173:0/716197968 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d80129b0 con 0x7f70f00cc260 2024-04-25T09:06:21.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.138+0000 7f70f7200640 1 -- 172.21.15.173:0/716197968 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f013f7d0 con 0x7f70f00cc260 2024-04-25T09:06:21.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.138+0000 7f70ecc00640 1 -- 172.21.15.173:0/716197968 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f70d8012b50 con 0x7f70f00cc260 2024-04-25T09:06:21.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.138+0000 7f70ecc00640 1 --2- 172.21.15.173:0/716197968 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f70cc066f60 0x7f70cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70ecc00640 1 -- 172.21.15.173:0/716197968 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f70d80854b0 con 0x7f70f00cc260 2024-04-25T09:06:21.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70efe00640 1 --2- 172.21.15.173:0/716197968 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f70cc066f60 0x7f70cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70fa6a4000 1 Processor -- start 2024-04-25T09:06:21.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70fa6a4000 1 -- start start 2024-04-25T09:06:21.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70efe00640 1 --2- 172.21.15.173:0/716197968 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f70cc066f60 0x7f70cc069420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f70e0000f70 tx=0x7f70e0007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:21.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70fa6a4000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1487b070 0x560e1487b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70fa6a4000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 0x560e1482e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70fa6a4000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1482ebe0 0x560e1482efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70fa6a4000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e1467ef00 con 0x560e1487b990 2024-04-25T09:06:21.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70fa6a4000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e146074a0 con 0x560e1482ebe0 2024-04-25T09:06:21.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70fa6a4000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e1467afa0 con 0x560e1487b070 2024-04-25T09:06:21.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70e7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 0x560e1482e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70e7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 0x560e1482e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46328/0 (socket says 172.21.15.173:46328) 2024-04-25T09:06:21.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70e7400640 1 -- 172.21.15.173:0/2541695414 learned_addr learned my addr 172.21.15.173:0/2541695414 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:21.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70f5200640 1 --2- 172.21.15.173:0/2541695414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1482ebe0 0x560e1482efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70efe00640 1 --2- 172.21.15.173:0/2541695414 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1487b070 0x560e1487b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70e7400640 1 -- 172.21.15.173:0/2541695414 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1487b070 msgr2=0x560e1487b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:21.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70e7400640 1 --2- 172.21.15.173:0/2541695414 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1487b070 0x560e1487b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70e7400640 1 -- 172.21.15.173:0/2541695414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1482ebe0 msgr2=0x560e1482efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:21.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70e7400640 1 --2- 172.21.15.173:0/2541695414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1482ebe0 0x560e1482efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70e7400640 1 -- 172.21.15.173:0/2541695414 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e14604d00 con 0x560e1487b990 2024-04-25T09:06:21.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70f5200640 1 --2- 172.21.15.173:0/2541695414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1482ebe0 0x560e1482efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:21.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70e7400640 1 --2- 172.21.15.173:0/2541695414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 0x560e1482e6a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f70d805de00 tx=0x7f70d805c110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1bd5ff48901777 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:21.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70e4c00640 1 -- 172.21.15.173:0/2541695414 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d805e330 con 0x560e1487b990 2024-04-25T09:06:21.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70e4c00640 1 -- 172.21.15.173:0/2541695414 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d8053d70 con 0x560e1487b990 2024-04-25T09:06:21.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70e4c00640 1 -- 172.21.15.173:0/2541695414 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d8052340 con 0x560e1487b990 2024-04-25T09:06:21.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70fa6a4000 1 -- 172.21.15.173:0/2541695414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 msgr2=0x560e1482e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:21.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/2541695414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 0x560e1482e6a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f70d805de00 tx=0x7f70d805c110 comp rx=0 tx=0).stop 2024-04-25T09:06:21.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70fa6a4000 1 -- 172.21.15.173:0/2541695414 shutdown_connections 2024-04-25T09:06:21.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/2541695414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1482ebe0 0x560e1482efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/2541695414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 0x560e1482e6a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/2541695414 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1487b070 0x560e1487b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70fa6a4000 1 -- 172.21.15.173:0/2541695414 >> 172.21.15.173:0/2541695414 conn(0x560e1485be10 msgr2=0x560e1485e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:21.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70fa6a4000 1 -- 172.21.15.173:0/2541695414 shutdown_connections 2024-04-25T09:06:21.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70fa6a4000 1 -- 172.21.15.173:0/2541695414 wait complete. 2024-04-25T09:06:21.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.142+0000 7f70fa6a4000 1 -- start start 2024-04-25T09:06:21.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70fa6a4000 1 Processor -- start 2024-04-25T09:06:21.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70fa6a4000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1482ebe0 0x560e14834670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70fa6a4000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1487b070 0x560e14834bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70fa6a4000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1487b990 0x560e148350f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70fa6a4000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e14683530 con 0x560e1482ebe0 2024-04-25T09:06:21.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70fa6a4000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e14639ae0 con 0x560e1487b990 2024-04-25T09:06:21.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70fa6a4000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e1463de10 con 0x560e1487b070 2024-04-25T09:06:21.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70fa6a4000 10 client.0 _ll_register_callbacks cb 0x560e1481c750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:21.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70efe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1482ebe0 0x560e14834670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70efe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1482ebe0 0x560e14834670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46340/0 (socket says 172.21.15.173:46340) 2024-04-25T09:06:21.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70efe00640 1 -- 172.21.15.173:0/4282995644 learned_addr learned my addr 172.21.15.173:0/4282995644 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:21.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70e7400640 1 --2- 172.21.15.173:0/4282995644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1487b070 0x560e14834bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70f5200640 1 --2- 172.21.15.173:0/4282995644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1487b990 0x560e148350f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70efe00640 1 -- 172.21.15.173:0/4282995644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1487b070 msgr2=0x560e14834bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:21.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70efe00640 1 --2- 172.21.15.173:0/4282995644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1487b070 0x560e14834bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70efe00640 1 -- 172.21.15.173:0/4282995644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1487b990 msgr2=0x560e148350f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:21.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70efe00640 1 --2- 172.21.15.173:0/4282995644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1487b990 0x560e148350f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70efe00640 1 -- 172.21.15.173:0/4282995644 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e14621a10 con 0x560e1482ebe0 2024-04-25T09:06:21.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70f5200640 1 --2- 172.21.15.173:0/4282995644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1487b990 0x560e148350f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:21.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70efe00640 1 --2- 172.21.15.173:0/4282995644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1482ebe0 0x560e14834670 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f70e0013470 tx=0x7f70e0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45a02ce9178378f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:21.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70dd600640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:21.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70dd600640 1 -- 172.21.15.173:0/4282995644 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0027060 con 0x560e1482ebe0 2024-04-25T09:06:21.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70dd600640 1 -- 172.21.15.173:0/4282995644 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f70e0022c40 con 0x560e1482ebe0 2024-04-25T09:06:21.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70fa6a4000 1 -- 172.21.15.173:0/4282995644 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f70d8053d70 con 0x560e1482ebe0 2024-04-25T09:06:21.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70dd600640 1 -- 172.21.15.173:0/4282995644 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70e0022e40 con 0x560e1482ebe0 2024-04-25T09:06:21.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70fa6a4000 10 client.6285 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:21.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70fa6a4000 1 -- 172.21.15.173:0/4282995644 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x560e14679ef0 con 0x560e1482ebe0 2024-04-25T09:06:21.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70dd600640 1 -- 172.21.15.173:0/4282995644 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d8053d70 con 0x560e1482ebe0 2024-04-25T09:06:21.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70dd600640 1 -- 172.21.15.173:0/4282995644 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f70e0012560 con 0x560e1482ebe0 2024-04-25T09:06:21.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70fa6a4000 10 client.6285 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:21.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70fa6a4000 10 client.6285 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:06:21.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70fa6a4000 20 client.6285 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:21.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/4282995644 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x560e1488a100 0x560e1488c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70fa6a4000 4 client.6285 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:21.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70fa6a4000 1 -- 172.21.15.173:0/4282995644 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e1461ab20 con 0x560e1488a100 2024-04-25T09:06:21.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70e7400640 1 --2- 172.21.15.173:0/4282995644 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x560e1488a100 0x560e1488c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70e7400640 1 --2- 172.21.15.173:0/4282995644 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x560e1488a100 0x560e1488c4f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eff71c5150efac57 server_cookie=f38a9ee3d56465db in_seq=0 out_seq=0 2024-04-25T09:06:21.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.146+0000 7f70dd600640 10 client.6285 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:21.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.150+0000 7f70dd600640 1 -- 172.21.15.173:0/4282995644 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560e1461ab20 con 0x560e1488a100 2024-04-25T09:06:21.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.150+0000 7f70dd600640 10 client.6285 handle_command_reply: tid=0 2024-04-25T09:06:21.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.150+0000 7f70fa6a4000 1 client.6285 shutdown 2024-04-25T09:06:21.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.150+0000 7f70fa6a4000 1 -- 172.21.15.173:0/4282995644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1482ebe0 msgr2=0x560e14834670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:21.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.150+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/4282995644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1482ebe0 0x560e14834670 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f70e0013470 tx=0x7f70e0000bd0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.150+0000 7f70fa6a4000 1 -- 172.21.15.173:0/4282995644 shutdown_connections 2024-04-25T09:06:21.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.150+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/4282995644 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x560e1488a100 0x560e1488c4f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.150+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/4282995644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1487b990 0x560e148350f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.150+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/4282995644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1487b070 0x560e14834bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.150+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/4282995644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1482ebe0 0x560e14834670 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.150+0000 7f70dd600640 0 client.6285 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:21.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.150+0000 7f70fa6a4000 1 -- 172.21.15.173:0/4282995644 >> 172.21.15.173:0/4282995644 conn(0x560e1485be10 msgr2=0x560e1482dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:21.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.150+0000 7f70fa6a4000 1 -- 172.21.15.173:0/4282995644 shutdown_connections 2024-04-25T09:06:21.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.150+0000 7f70fa6a4000 1 -- 172.21.15.173:0/4282995644 wait complete. 2024-04-25T09:06:21.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.150+0000 7f70fa6a4000 20 client.6285 trim_cache size 0 max 16384 2024-04-25T09:06:21.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70fa6a4000 1 Processor -- start 2024-04-25T09:06:21.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70fa6a4000 1 -- start start 2024-04-25T09:06:21.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70fa6a4000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1482ebe0 0x560e148dfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70fa6a4000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1487b070 0x560e148e00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70fa6a4000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 0x560e148e0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70fa6a4000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f0202490 con 0x560e1487b990 2024-04-25T09:06:21.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70fa6a4000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f00cdc00 con 0x560e1487b070 2024-04-25T09:06:21.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70fa6a4000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f0202060 con 0x560e1482ebe0 2024-04-25T09:06:21.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70f5200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 0x560e148e0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70f5200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 0x560e148e0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46350/0 (socket says 172.21.15.173:46350) 2024-04-25T09:06:21.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70f5200640 1 -- 172.21.15.173:0/519250802 learned_addr learned my addr 172.21.15.173:0/519250802 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:21.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70efe00640 1 --2- 172.21.15.173:0/519250802 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1482ebe0 0x560e148dfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70e7400640 1 --2- 172.21.15.173:0/519250802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1487b070 0x560e148e00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70f5200640 1 -- 172.21.15.173:0/519250802 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1482ebe0 msgr2=0x560e148dfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:21.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70f5200640 1 --2- 172.21.15.173:0/519250802 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1482ebe0 0x560e148dfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70f5200640 1 -- 172.21.15.173:0/519250802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1487b070 msgr2=0x560e148e00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:21.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70f5200640 1 --2- 172.21.15.173:0/519250802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1487b070 0x560e148e00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70f5200640 1 -- 172.21.15.173:0/519250802 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e1463e790 con 0x560e1487b990 2024-04-25T09:06:21.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70f5200640 1 --2- 172.21.15.173:0/519250802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 0x560e148e0610 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f70e801a440 tx=0x7f70e8004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3b561ef2391e85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:21.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70dfe00640 1 -- 172.21.15.173:0/519250802 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e80c6070 con 0x560e1487b990 2024-04-25T09:06:21.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70dfe00640 1 -- 172.21.15.173:0/519250802 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e80b3040 con 0x560e1487b990 2024-04-25T09:06:21.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70dfe00640 1 -- 172.21.15.173:0/519250802 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e80b2040 con 0x560e1487b990 2024-04-25T09:06:21.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70fa6a4000 1 -- 172.21.15.173:0/519250802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 msgr2=0x560e148e0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:21.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/519250802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 0x560e148e0610 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f70e801a440 tx=0x7f70e8004ac0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70fa6a4000 1 -- 172.21.15.173:0/519250802 shutdown_connections 2024-04-25T09:06:21.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/519250802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 0x560e148e0610 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/519250802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1487b070 0x560e148e00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/519250802 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1482ebe0 0x560e148dfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70fa6a4000 1 -- 172.21.15.173:0/519250802 >> 172.21.15.173:0/519250802 conn(0x560e1485be10 msgr2=0x560e14835e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:21.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70fa6a4000 1 -- 172.21.15.173:0/519250802 shutdown_connections 2024-04-25T09:06:21.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.162+0000 7f70fa6a4000 1 -- 172.21.15.173:0/519250802 wait complete. 2024-04-25T09:06:21.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70fa6a4000 1 -- start start 2024-04-25T09:06:21.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70fa6a4000 1 Processor -- start 2024-04-25T09:06:21.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70fa6a4000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1482ebe0 0x560e148e3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70fa6a4000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1487b070 0x560e1488d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70fa6a4000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 0x560e1488dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70fa6a4000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e1483a1c0 con 0x560e1487b990 2024-04-25T09:06:21.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70fa6a4000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e1464bb90 con 0x560e1482ebe0 2024-04-25T09:06:21.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70fa6a4000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e1467e210 con 0x560e1487b070 2024-04-25T09:06:21.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70fa6a4000 10 client.0 _ll_register_callbacks cb 0x7f70d8055aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:21.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70f5200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 0x560e1488dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70efe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1482ebe0 0x560e148e3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70e7400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1487b070 0x560e1488d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70f5200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 0x560e1488dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46366/0 (socket says 172.21.15.173:46366) 2024-04-25T09:06:21.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70f5200640 1 -- 172.21.15.173:0/1599427581 learned_addr learned my addr 172.21.15.173:0/1599427581 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:21.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70f5200640 1 -- 172.21.15.173:0/1599427581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1487b070 msgr2=0x560e1488d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:21.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70f5200640 1 --2- 172.21.15.173:0/1599427581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1487b070 0x560e1488d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70f5200640 1 -- 172.21.15.173:0/1599427581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1482ebe0 msgr2=0x560e148e3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:21.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70f5200640 1 --2- 172.21.15.173:0/1599427581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1482ebe0 0x560e148e3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70f5200640 1 -- 172.21.15.173:0/1599427581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e14646da0 con 0x560e1487b990 2024-04-25T09:06:21.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70f5200640 1 --2- 172.21.15.173:0/1599427581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 0x560e1488dd00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f70e8019420 tx=0x7f70e801b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822d7e0ce8a9262f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:21.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70dd600640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:21.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70dd600640 1 -- 172.21.15.173:0/1599427581 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e80c6070 con 0x560e1487b990 2024-04-25T09:06:21.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70dd600640 1 -- 172.21.15.173:0/1599427581 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f70e80cbc40 con 0x560e1487b990 2024-04-25T09:06:21.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70fa6a4000 1 -- 172.21.15.173:0/1599427581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f70e80b3040 con 0x560e1487b990 2024-04-25T09:06:21.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70dd600640 1 -- 172.21.15.173:0/1599427581 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70e80d2050 con 0x560e1487b990 2024-04-25T09:06:21.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70fa6a4000 10 client.6291 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:21.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70fa6a4000 1 -- 172.21.15.173:0/1599427581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x560e1433b360 con 0x560e1487b990 2024-04-25T09:06:21.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70dd600640 1 -- 172.21.15.173:0/1599427581 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e80b3040 con 0x560e1487b990 2024-04-25T09:06:21.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70dd600640 1 -- 172.21.15.173:0/1599427581 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f70e80d5020 con 0x560e1487b990 2024-04-25T09:06:21.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70fa6a4000 10 client.6291 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:21.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70fa6a4000 10 client.6291 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:06:21.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70fa6a4000 20 client.6291 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:21.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/1599427581 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x560e1489fbc0 0x560e1489ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70fa6a4000 4 client.6291 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 3903933147}] 2024-04-25T09:06:21.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70fa6a4000 1 -- 172.21.15.173:0/1599427581 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "damage rm", "damage_id": 3903933147}) v1 -- 0x560e1468c440 con 0x560e1489fbc0 2024-04-25T09:06:21.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70efe00640 1 --2- 172.21.15.173:0/1599427581 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x560e1489fbc0 0x560e1489ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70efe00640 1 --2- 172.21.15.173:0/1599427581 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x560e1489fbc0 0x560e1489ffa0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c6dfa92df04fc7d server_cookie=b66f59b2b7194f11 in_seq=0 out_seq=0 2024-04-25T09:06:21.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.166+0000 7f70dd600640 10 client.6291 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:21.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70dd600640 1 -- 172.21.15.173:0/1599427581 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+0 (crc 0 0 0) 0x560e1468c440 con 0x560e1489fbc0 2024-04-25T09:06:21.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70dd600640 10 client.6291 handle_command_reply: tid=0 2024-04-25T09:06:21.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70fa6a4000 1 client.6291 shutdown 2024-04-25T09:06:21.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70fa6a4000 1 -- 172.21.15.173:0/1599427581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 msgr2=0x560e1488dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:21.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/1599427581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 0x560e1488dd00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f70e8019420 tx=0x7f70e801b050 comp rx=0 tx=0).stop 2024-04-25T09:06:21.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70fa6a4000 1 -- 172.21.15.173:0/1599427581 shutdown_connections 2024-04-25T09:06:21.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/1599427581 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x560e1489fbc0 0x560e1489ffa0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/1599427581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560e1487b990 0x560e1488dd00 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/1599427581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560e1487b070 0x560e1488d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70fa6a4000 1 --2- 172.21.15.173:0/1599427581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e1482ebe0 0x560e148e3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70fa6a4000 1 -- 172.21.15.173:0/1599427581 >> 172.21.15.173:0/1599427581 conn(0x560e1485be10 msgr2=0x560e148366c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:21.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70dd600640 0 client.6291 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:21.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70fa6a4000 1 -- 172.21.15.173:0/1599427581 shutdown_connections 2024-04-25T09:06:21.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70fa6a4000 1 -- 172.21.15.173:0/1599427581 wait complete. 2024-04-25T09:06:21.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70fa6a4000 20 client.6291 trim_cache size 0 max 16384 2024-04-25T09:06:21.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70f7200640 1 -- 172.21.15.173:0/716197968 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f70cc066f60 msgr2=0x7f70cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:21.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70f7200640 1 --2- 172.21.15.173:0/716197968 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f70cc066f60 0x7f70cc069420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f70e0000f70 tx=0x7f70e0007e90 comp rx=0 tx=0).stop 2024-04-25T09:06:21.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70f7200640 1 -- 172.21.15.173:0/716197968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70f00cc260 msgr2=0x7f70f00ad4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:21.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70f7200640 1 --2- 172.21.15.173:0/716197968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70f00cc260 0x7f70f00ad4e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f70d800d5f0 tx=0x7f70d800dab0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70f7200640 1 -- 172.21.15.173:0/716197968 shutdown_connections 2024-04-25T09:06:21.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70f7200640 1 --2- 172.21.15.173:0/716197968 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f70cc066f60 0x7f70cc069420 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70f7200640 1 --2- 172.21.15.173:0/716197968 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70f0145290 0x7f70f00ada20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70f7200640 1 --2- 172.21.15.173:0/716197968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70f00cc260 0x7f70f00ad4e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70f7200640 1 --2- 172.21.15.173:0/716197968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f00b3fe0 0x7f70f015b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70f7200640 1 -- 172.21.15.173:0/716197968 >> 172.21.15.173:0/716197968 conn(0x7f70f006ac90 msgr2=0x7f70f015c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:21.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70f7200640 1 -- 172.21.15.173:0/716197968 shutdown_connections 2024-04-25T09:06:21.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.170+0000 7f70f7200640 1 -- 172.21.15.173:0/716197968 wait complete. 2024-04-25T09:06:21.176 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-04-25T09:06:21.176 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:21.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.326+0000 7f2f12000640 1 Processor -- start 2024-04-25T09:06:21.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.326+0000 7f2f12000640 1 -- start start 2024-04-25T09:06:21.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.326+0000 7f2f12000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2f0c15dbb0 0x7f2f0c15df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.326+0000 7f2f12000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2f0c06f830 0x7f2f0c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.326+0000 7f2f12000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0c06d870 con 0x7f2f0c0d2130 2024-04-25T09:06:21.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.326+0000 7f2f12000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c0701e0 con 0x7f2f0c15dbb0 2024-04-25T09:06:21.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.326+0000 7f2f12000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c0d2590 con 0x7f2f0c06f830 2024-04-25T09:06:21.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.326+0000 7f2f0b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2f0c15dbb0 0x7f2f0c15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.326+0000 7f2f0b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2f0c15dbb0 0x7f2f0c15df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46380/0 (socket says 172.21.15.173:46380) 2024-04-25T09:06:21.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.326+0000 7f2f0b400640 1 -- 172.21.15.173:0/3420205906 learned_addr learned my addr 172.21.15.173:0/3420205906 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:21.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.326+0000 7f2f0be00640 1 --2- 172.21.15.173:0/3420205906 >> v2:172.21.15.194:3300/0 conn(0x7f2f0c06f830 0x7f2f0c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.326+0000 7f2f0b400640 1 -- 172.21.15.173:0/3420205906 >> v2:172.21.15.194:3300/0 conn(0x7f2f0c06f830 msgr2=0x7f2f0c06fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:21.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.326+0000 7f2f0b400640 1 --2- 172.21.15.173:0/3420205906 >> v2:172.21.15.194:3300/0 conn(0x7f2f0c06f830 0x7f2f0c06fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.326+0000 7f2f0b400640 1 -- 172.21.15.173:0/3420205906 >> v1:172.21.15.194:6789/0 conn(0x7f2f0c0d2130 legacy=0x7f2f0c06c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:21.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.326+0000 7f2f0b400640 1 -- 172.21.15.173:0/3420205906 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c161690 con 0x7f2f0c15dbb0 2024-04-25T09:06:21.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.330+0000 7f2f0b400640 1 --2- 172.21.15.173:0/3420205906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f0c15dbb0 0x7f2f0c15df90 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c062610 tx=0x7f2efc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43edd88b58910574 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:21.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.330+0000 7f2f0a000640 1 -- 172.21.15.173:0/3420205906 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0aa650 con 0x7f2f0c15dbb0 2024-04-25T09:06:21.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.330+0000 7f2f0a000640 1 -- 172.21.15.173:0/3420205906 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc0af070 con 0x7f2f0c15dbb0 2024-04-25T09:06:21.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.330+0000 7f2f0a000640 1 -- 172.21.15.173:0/3420205906 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0aaa10 con 0x7f2f0c15dbb0 2024-04-25T09:06:21.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.330+0000 7f2f12000640 1 -- 172.21.15.173:0/3420205906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f0c15dbb0 msgr2=0x7f2f0c15df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:21.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.330+0000 7f2f12000640 1 --2- 172.21.15.173:0/3420205906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f0c15dbb0 0x7f2f0c15df90 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c062610 tx=0x7f2efc01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.330+0000 7f2f12000640 1 -- 172.21.15.173:0/3420205906 shutdown_connections 2024-04-25T09:06:21.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.330+0000 7f2f12000640 1 --2- 172.21.15.173:0/3420205906 >> v2:172.21.15.194:3300/0 conn(0x7f2f0c06f830 0x7f2f0c06fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.330+0000 7f2f12000640 1 --2- 172.21.15.173:0/3420205906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f0c15dbb0 0x7f2f0c15df90 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.330+0000 7f2f12000640 1 -- 172.21.15.173:0/3420205906 >> 172.21.15.173:0/3420205906 conn(0x7f2f0c061880 msgr2=0x7f2f0c061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:21.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.330+0000 7f2f12000640 1 -- 172.21.15.173:0/3420205906 shutdown_connections 2024-04-25T09:06:21.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.330+0000 7f2f12000640 1 -- 172.21.15.173:0/3420205906 wait complete. 2024-04-25T09:06:21.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.330+0000 7f2f12000640 1 Processor -- start 2024-04-25T09:06:21.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.330+0000 7f2f12000640 1 -- start start 2024-04-25T09:06:21.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f12000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f0c06f830 0x7f2f0c0b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f12000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0c0d2130 0x7f2f0c15a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f12000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f0c15dbb0 0x7f2f0c15a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f12000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c15ee60 con 0x7f2f0c15dbb0 2024-04-25T09:06:21.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f12000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c06c980 con 0x7f2f0c0d2130 2024-04-25T09:06:21.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f12000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c16a990 con 0x7f2f0c06f830 2024-04-25T09:06:21.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f0be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f0c15dbb0 0x7f2f0c15a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f0be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f0c15dbb0 0x7f2f0c15a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46392/0 (socket says 172.21.15.173:46392) 2024-04-25T09:06:21.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f0be00640 1 -- 172.21.15.173:0/2191361704 learned_addr learned my addr 172.21.15.173:0/2191361704 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:21.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f0b400640 1 --2- 172.21.15.173:0/2191361704 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f0c06f830 0x7f2f0c0b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f0aa00640 1 --2- 172.21.15.173:0/2191361704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0c0d2130 0x7f2f0c15a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f0be00640 1 -- 172.21.15.173:0/2191361704 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f0c06f830 msgr2=0x7f2f0c0b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:21.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f0be00640 1 --2- 172.21.15.173:0/2191361704 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f0c06f830 0x7f2f0c0b00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f0be00640 1 -- 172.21.15.173:0/2191361704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0c0d2130 msgr2=0x7f2f0c15a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:21.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f0be00640 1 --2- 172.21.15.173:0/2191361704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0c0d2130 0x7f2f0c15a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f0be00640 1 -- 172.21.15.173:0/2191361704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c156d10 con 0x7f2f0c15dbb0 2024-04-25T09:06:21.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f0aa00640 1 --2- 172.21.15.173:0/2191361704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0c0d2130 0x7f2f0c15a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:21.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f0be00640 1 --2- 172.21.15.173:0/2191361704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f0c15dbb0 0x7f2f0c15a6a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2f04007e90 tx=0x7f2f0400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:21.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f03400640 1 -- 172.21.15.173:0/2191361704 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f04014420 con 0x7f2f0c15dbb0 2024-04-25T09:06:21.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f03400640 1 -- 172.21.15.173:0/2191361704 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f04019070 con 0x7f2f0c15dbb0 2024-04-25T09:06:21.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f12000640 1 -- 172.21.15.173:0/2191361704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0c156ff0 con 0x7f2f0c15dbb0 2024-04-25T09:06:21.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f03400640 1 -- 172.21.15.173:0/2191361704 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f04014800 con 0x7f2f0c15dbb0 2024-04-25T09:06:21.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f12000640 1 -- 172.21.15.173:0/2191361704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0c0c8c70 con 0x7f2f0c15dbb0 2024-04-25T09:06:21.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f12000640 1 -- 172.21.15.173:0/2191361704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0c0c8e70 con 0x7f2f0c15dbb0 2024-04-25T09:06:21.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.334+0000 7f2f03400640 1 -- 172.21.15.173:0/2191361704 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2f040149a0 con 0x7f2f0c15dbb0 2024-04-25T09:06:21.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.338+0000 7f2f03400640 1 --2- 172.21.15.173:0/2191361704 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2eec066f60 0x7f2eec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:21.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.338+0000 7f2f03400640 1 -- 172.21.15.173:0/2191361704 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2f04085920 con 0x7f2f0c15dbb0 2024-04-25T09:06:21.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.338+0000 7f2f0b400640 1 --2- 172.21.15.173:0/2191361704 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2eec066f60 0x7f2eec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:21.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.338+0000 7f2f0b400640 1 --2- 172.21.15.173:0/2191361704 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2eec066f60 0x7f2eec069420 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0ae000 tx=0x7f2efc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:21.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.342+0000 7f2f03400640 1 -- 172.21.15.173:0/2191361704 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2f0c0c8e70 con 0x7f2f0c15dbb0 2024-04-25T09:06:21.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.526+0000 7f2f12000640 1 -- 172.21.15.173:0/2191361704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f0c0cf020 con 0x7f2f0c15dbb0 2024-04-25T09:06:21.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.526+0000 7f2f03400640 1 -- 172.21.15.173:0/2191361704 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f2f04056830 con 0x7f2f0c15dbb0 2024-04-25T09:06:21.515 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:21.515 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:05:57.598642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:21.515 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 26 2024-04-25T09:06:21.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.526+0000 7f2f12000640 1 -- 172.21.15.173:0/2191361704 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2eec066f60 msgr2=0x7f2eec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:21.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.526+0000 7f2f12000640 1 --2- 172.21.15.173:0/2191361704 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2eec066f60 0x7f2eec069420 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0ae000 tx=0x7f2efc0a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:21.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.526+0000 7f2f12000640 1 -- 172.21.15.173:0/2191361704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f0c15dbb0 msgr2=0x7f2f0c15a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:21.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.526+0000 7f2f12000640 1 --2- 172.21.15.173:0/2191361704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f0c15dbb0 0x7f2f0c15a6a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2f04007e90 tx=0x7f2f0400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.530+0000 7f2f12000640 1 -- 172.21.15.173:0/2191361704 shutdown_connections 2024-04-25T09:06:21.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.530+0000 7f2f12000640 1 --2- 172.21.15.173:0/2191361704 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2eec066f60 0x7f2eec069420 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.530+0000 7f2f12000640 1 --2- 172.21.15.173:0/2191361704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f0c15dbb0 0x7f2f0c15a6a0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.530+0000 7f2f12000640 1 --2- 172.21.15.173:0/2191361704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0c0d2130 0x7f2f0c15a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.530+0000 7f2f12000640 1 --2- 172.21.15.173:0/2191361704 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f0c06f830 0x7f2f0c0b00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.530+0000 7f2f12000640 1 -- 172.21.15.173:0/2191361704 >> 172.21.15.173:0/2191361704 conn(0x7f2f0c061880 msgr2=0x7f2f0c06c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:21.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.530+0000 7f2f12000640 1 -- 172.21.15.173:0/2191361704 shutdown_connections 2024-04-25T09:06:21.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21.530+0000 7f2f12000640 1 -- 172.21.15.173:0/2191361704 wait complete. 2024-04-25T09:06:21.537 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path / 2024-04-25T09:06:21.678 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:21.678 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0 2024-04-25T09:06:21.679 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:21.694 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T09:06:21.694 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:21.695 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-04-25T09:06:21.695 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-04-25T09:06:21.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:21.695 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-04-25T09:06:21.705 DEBUG:teuthology.orchestra.run.smithi173:> stdin-killer -- python3 -c ' 2024-04-25T09:06:21.705 DEBUG:teuthology.orchestra.run.smithi173:> import os 2024-04-25T09:06:21.705 DEBUG:teuthology.orchestra.run.smithi173:> import stat 2024-04-25T09:06:21.705 DEBUG:teuthology.orchestra.run.smithi173:> import json 2024-04-25T09:06:21.705 DEBUG:teuthology.orchestra.run.smithi173:> import sys 2024-04-25T09:06:21.705 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:06:21.705 DEBUG:teuthology.orchestra.run.smithi173:> try: 2024-04-25T09:06:21.705 DEBUG:teuthology.orchestra.run.smithi173:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-04-25T09:06:21.705 DEBUG:teuthology.orchestra.run.smithi173:> except OSError as e: 2024-04-25T09:06:21.705 DEBUG:teuthology.orchestra.run.smithi173:> sys.exit(e.errno) 2024-04-25T09:06:21.706 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:06:21.706 DEBUG:teuthology.orchestra.run.smithi173:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-04-25T09:06:21.706 DEBUG:teuthology.orchestra.run.smithi173:> print(json.dumps( 2024-04-25T09:06:21.706 DEBUG:teuthology.orchestra.run.smithi173:> dict([(a, getattr(s, a)) for a in attrs]), 2024-04-25T09:06:21.706 DEBUG:teuthology.orchestra.run.smithi173:> indent=2)) 2024-04-25T09:06:21.706 DEBUG:teuthology.orchestra.run.smithi173:> ' 2024-04-25T09:06:21.816 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:21.816 INFO:teuthology.orchestra.run.smithi173.stdout: "st_mode": 16893, 2024-04-25T09:06:21.816 INFO:teuthology.orchestra.run.smithi173.stdout: "st_ino": 1099511627777, 2024-04-25T09:06:21.816 INFO:teuthology.orchestra.run.smithi173.stdout: "st_dev": 44, 2024-04-25T09:06:21.816 INFO:teuthology.orchestra.run.smithi173.stdout: "st_nlink": 16, 2024-04-25T09:06:21.816 INFO:teuthology.orchestra.run.smithi173.stdout: "st_uid": 1000, 2024-04-25T09:06:21.817 INFO:teuthology.orchestra.run.smithi173.stdout: "st_gid": 1271, 2024-04-25T09:06:21.817 INFO:teuthology.orchestra.run.smithi173.stdout: "st_size": 18, 2024-04-25T09:06:21.817 INFO:teuthology.orchestra.run.smithi173.stdout: "st_atime": 1714035966.807046, 2024-04-25T09:06:21.817 INFO:teuthology.orchestra.run.smithi173.stdout: "st_mtime": 1714035973.7389712, 2024-04-25T09:06:21.817 INFO:teuthology.orchestra.run.smithi173.stdout: "st_ctime": 1714035973.7389712 2024-04-25T09:06:21.817 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:21.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:06:21.826 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 1 2024-04-25T09:06:21.826 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-04-25T09:06:21.826 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:22.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.018+0000 7f9955800640 1 Processor -- start 2024-04-25T09:06:22.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.018+0000 7f9955800640 1 -- start start 2024-04-25T09:06:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.018+0000 7f9955800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99500b3e70 0x7f99500b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.018+0000 7f9955800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f99500aefa0 0x7f99500b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.018+0000 7f9955800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99500b4790 con 0x7f995015edd0 2024-04-25T09:06:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.022+0000 7f9955800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995006dd50 con 0x7f99500aefa0 2024-04-25T09:06:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.022+0000 7f9955800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995015f320 con 0x7f99500b3e70 2024-04-25T09:06:22.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.022+0000 7f9946000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f99500aefa0 0x7f99500b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.022+0000 7f994f400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f995015edd0 0x7f99500b2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:59518/0 (socket says 172.21.15.173:59518) 2024-04-25T09:06:22.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.022+0000 7f994f400640 1 -- 172.21.15.173:0/2576133012 learned_addr learned my addr 172.21.15.173:0/2576133012 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:22.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.022+0000 7f994ea00640 1 --2- 172.21.15.173:0/2576133012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99500b3e70 0x7f99500b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.022+0000 7f9946000640 1 -- 172.21.15.173:0/2576133012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99500b3e70 msgr2=0x7f99500b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.022+0000 7f9946000640 1 --2- 172.21.15.173:0/2576133012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99500b3e70 0x7f99500b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.022+0000 7f9946000640 1 -- 172.21.15.173:0/2576133012 >> v1:172.21.15.194:6789/0 conn(0x7f995015edd0 legacy=0x7f99500b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.022+0000 7f9946000640 1 -- 172.21.15.173:0/2576133012 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995006d420 con 0x7f99500aefa0 2024-04-25T09:06:22.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f9946000640 1 --2- 172.21.15.173:0/2576133012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99500aefa0 0x7f99500b2770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f99380097c0 tx=0x7f993801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5df58be3cfc9ed9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f994e000640 1 -- 172.21.15.173:0/2576133012 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99380b0070 con 0x7f99500aefa0 2024-04-25T09:06:22.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f994e000640 1 -- 172.21.15.173:0/2576133012 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99380ab600 con 0x7f99500aefa0 2024-04-25T09:06:22.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f994e000640 1 -- 172.21.15.173:0/2576133012 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99380ab9d0 con 0x7f99500aefa0 2024-04-25T09:06:22.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f9955800640 1 -- 172.21.15.173:0/2576133012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99500aefa0 msgr2=0x7f99500b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f9955800640 1 --2- 172.21.15.173:0/2576133012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99500aefa0 0x7f99500b2770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f99380097c0 tx=0x7f993801c330 comp rx=0 tx=0).stop 2024-04-25T09:06:22.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f9955800640 1 -- 172.21.15.173:0/2576133012 shutdown_connections 2024-04-25T09:06:22.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f9955800640 1 --2- 172.21.15.173:0/2576133012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99500aefa0 0x7f99500b2770 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f9955800640 1 --2- 172.21.15.173:0/2576133012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99500b3e70 0x7f99500b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f9955800640 1 -- 172.21.15.173:0/2576133012 >> 172.21.15.173:0/2576133012 conn(0x7f995006ac90 msgr2=0x7f995006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f9955800640 1 -- 172.21.15.173:0/2576133012 shutdown_connections 2024-04-25T09:06:22.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f9955800640 1 -- 172.21.15.173:0/2576133012 wait complete. 2024-04-25T09:06:22.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f9955800640 1 Processor -- start 2024-04-25T09:06:22.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f9955800640 1 -- start start 2024-04-25T09:06:22.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f9955800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99500aefa0 0x7f9950154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f9955800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99500b3e70 0x7f99501e4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f9955800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f995015edd0 0x7f9950153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f9955800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99500ce7b0 con 0x7f99500b3e70 2024-04-25T09:06:22.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f9955800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995006d9e0 con 0x7f995015edd0 2024-04-25T09:06:22.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f9955800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995015aba0 con 0x7f99500aefa0 2024-04-25T09:06:22.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.026+0000 7f9946000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99500b3e70 0x7f99501e4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f9946000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99500b3e70 0x7f99501e4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46402/0 (socket says 172.21.15.173:46402) 2024-04-25T09:06:22.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f994ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99500aefa0 0x7f9950154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f9946000640 1 -- 172.21.15.173:0/2610140890 learned_addr learned my addr 172.21.15.173:0/2610140890 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:22.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f994f400640 1 --2- 172.21.15.173:0/2610140890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f995015edd0 0x7f9950153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f9946000640 1 -- 172.21.15.173:0/2610140890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99500aefa0 msgr2=0x7f9950154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f9946000640 1 --2- 172.21.15.173:0/2610140890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99500aefa0 0x7f9950154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f9946000640 1 -- 172.21.15.173:0/2610140890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f995015edd0 msgr2=0x7f9950153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f9946000640 1 --2- 172.21.15.173:0/2610140890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f995015edd0 0x7f9950153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f9946000640 1 -- 172.21.15.173:0/2610140890 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99501e49b0 con 0x7f99500b3e70 2024-04-25T09:06:22.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f9946000640 1 --2- 172.21.15.173:0/2610140890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99500b3e70 0x7f99501e4240 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f99380ae040 tx=0x7f99380190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f9947400640 1 -- 172.21.15.173:0/2610140890 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99380b0040 con 0x7f99500b3e70 2024-04-25T09:06:22.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f9947400640 1 -- 172.21.15.173:0/2610140890 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99380b9070 con 0x7f99500b3e70 2024-04-25T09:06:22.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f9947400640 1 -- 172.21.15.173:0/2610140890 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99380aaa30 con 0x7f99500b3e70 2024-04-25T09:06:22.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f9955800640 1 -- 172.21.15.173:0/2610140890 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9950158bd0 con 0x7f99500b3e70 2024-04-25T09:06:22.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f9955800640 1 -- 172.21.15.173:0/2610140890 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9950159190 con 0x7f99500b3e70 2024-04-25T09:06:22.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f9955800640 1 -- 172.21.15.173:0/2610140890 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9950073a40 con 0x7f99500b3e70 2024-04-25T09:06:22.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f9947400640 1 -- 172.21.15.173:0/2610140890 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f99380aabd0 con 0x7f99500b3e70 2024-04-25T09:06:22.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f9947400640 1 --2- 172.21.15.173:0/2610140890 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f992c066f60 0x7f992c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.030+0000 7f9947400640 1 -- 172.21.15.173:0/2610140890 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f993811f200 con 0x7f99500b3e70 2024-04-25T09:06:22.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.034+0000 7f994ea00640 1 --2- 172.21.15.173:0/2610140890 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f992c066f60 0x7f992c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.034+0000 7f994ea00640 1 --2- 172.21.15.173:0/2610140890 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f992c066f60 0x7f992c069420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9940009b60 tx=0x7f9940009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.038+0000 7f9947400640 1 -- 172.21.15.173:0/2610140890 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9938015fb0 con 0x7f99500b3e70 2024-04-25T09:06:22.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.222+0000 7f9955800640 1 -- 172.21.15.173:0/2610140890 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9950072210 con 0x7f99500b3e70 2024-04-25T09:06:22.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.222+0000 7f9947400640 1 -- 172.21.15.173:0/2610140890 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f99380efa20 con 0x7f99500b3e70 2024-04-25T09:06:22.211 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:22.211 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:05:57.598642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:22.211 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 26 2024-04-25T09:06:22.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.222+0000 7f9955800640 1 -- 172.21.15.173:0/2610140890 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f992c066f60 msgr2=0x7f992c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.222+0000 7f9955800640 1 --2- 172.21.15.173:0/2610140890 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f992c066f60 0x7f992c069420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9940009b60 tx=0x7f9940009190 comp rx=0 tx=0).stop 2024-04-25T09:06:22.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.226+0000 7f9955800640 1 -- 172.21.15.173:0/2610140890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99500b3e70 msgr2=0x7f99501e4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.226+0000 7f9955800640 1 --2- 172.21.15.173:0/2610140890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99500b3e70 0x7f99501e4240 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f99380ae040 tx=0x7f99380190d0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.226+0000 7f9955800640 1 -- 172.21.15.173:0/2610140890 shutdown_connections 2024-04-25T09:06:22.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.226+0000 7f9955800640 1 --2- 172.21.15.173:0/2610140890 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f992c066f60 0x7f992c069420 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.226+0000 7f9955800640 1 --2- 172.21.15.173:0/2610140890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f995015edd0 0x7f9950153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.226+0000 7f9955800640 1 --2- 172.21.15.173:0/2610140890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99500b3e70 0x7f99501e4240 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.226+0000 7f9955800640 1 --2- 172.21.15.173:0/2610140890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99500aefa0 0x7f9950154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.226+0000 7f9955800640 1 -- 172.21.15.173:0/2610140890 >> 172.21.15.173:0/2610140890 conn(0x7f995006ac90 msgr2=0x7f995015ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.226+0000 7f9955800640 1 -- 172.21.15.173:0/2610140890 shutdown_connections 2024-04-25T09:06:22.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.226+0000 7f9955800640 1 -- 172.21.15.173:0/2610140890 wait complete. 2024-04-25T09:06:22.233 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path /scrub_test_path/i/dont/exist 2024-04-25T09:06:22.370 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:22.370 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": -2 2024-04-25T09:06:22.370 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:22.385 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' got response code '0' and stdout '{ "return_code": -2 } ' 2024-04-25T09:06:22.385 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-04-25T09:06:22.385 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:06:22.385 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-04-25T09:06:22.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.534+0000 7f1385c00640 1 Processor -- start 2024-04-25T09:06:22.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.534+0000 7f1385c00640 1 -- start start 2024-04-25T09:06:22.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.534+0000 7f1385c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13800aeb90 0x7f13800cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.534+0000 7f1385c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f13800aef70 0x7f13800cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.534+0000 7f1385c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380071570 con 0x7f13800cdba0 2024-04-25T09:06:22.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.534+0000 7f1385c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1380071320 con 0x7f13800aef70 2024-04-25T09:06:22.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.534+0000 7f1385c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1380072330 con 0x7f13800aeb90 2024-04-25T09:06:22.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.538+0000 7f137e000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f13800aef70 0x7f13800cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.538+0000 7f137f400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f13800cdba0 0x7f13800ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:51482/0 (socket says 172.21.15.173:51482) 2024-04-25T09:06:22.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.538+0000 7f137f400640 1 -- 172.21.15.173:0/779418039 learned_addr learned my addr 172.21.15.173:0/779418039 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:22.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.538+0000 7f137ea00640 1 --2- 172.21.15.173:0/779418039 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13800aeb90 0x7f13800cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.538+0000 7f137e000640 1 -- 172.21.15.173:0/779418039 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13800aeb90 msgr2=0x7f13800cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.538+0000 7f137e000640 1 --2- 172.21.15.173:0/779418039 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13800aeb90 0x7f13800cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.538+0000 7f137e000640 1 -- 172.21.15.173:0/779418039 >> v1:172.21.15.173:6789/0 conn(0x7f13800cdba0 legacy=0x7f13800ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.538+0000 7f137e000640 1 -- 172.21.15.173:0/779418039 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1380071850 con 0x7f13800aef70 2024-04-25T09:06:22.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.538+0000 7f137d600640 1 -- 172.21.15.173:0/779418039 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37343548 0 0) 0x7f1380071570 con 0x7f13800cdba0 2024-04-25T09:06:22.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.538+0000 7f137ea00640 1 --2- 172.21.15.173:0/779418039 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13800aeb90 0x7f13800cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:22.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.538+0000 7f137e000640 1 --2- 172.21.15.173:0/779418039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13800aef70 0x7f13800cc610 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f136c0097c0 tx=0x7f136c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9059b335a3e809 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.538+0000 7f137d600640 1 -- 172.21.15.173:0/779418039 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c0b0070 con 0x7f13800aef70 2024-04-25T09:06:22.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.538+0000 7f137d600640 1 -- 172.21.15.173:0/779418039 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136c0ab600 con 0x7f13800aef70 2024-04-25T09:06:22.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.538+0000 7f137d600640 1 -- 172.21.15.173:0/779418039 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c0ab9d0 con 0x7f13800aef70 2024-04-25T09:06:22.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f1385c00640 1 -- 172.21.15.173:0/779418039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13800aef70 msgr2=0x7f13800cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f1385c00640 1 --2- 172.21.15.173:0/779418039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13800aef70 0x7f13800cc610 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f136c0097c0 tx=0x7f136c01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f1385c00640 1 -- 172.21.15.173:0/779418039 shutdown_connections 2024-04-25T09:06:22.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f1385c00640 1 --2- 172.21.15.173:0/779418039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13800aef70 0x7f13800cc610 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f1385c00640 1 --2- 172.21.15.173:0/779418039 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13800aeb90 0x7f13800cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f1385c00640 1 -- 172.21.15.173:0/779418039 >> 172.21.15.173:0/779418039 conn(0x7f138006ac90 msgr2=0x7f138006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f1385c00640 1 -- 172.21.15.173:0/779418039 shutdown_connections 2024-04-25T09:06:22.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f1385c00640 1 -- 172.21.15.173:0/779418039 wait complete. 2024-04-25T09:06:22.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f1385c00640 1 Processor -- start 2024-04-25T09:06:22.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f1385c00640 1 -- start start 2024-04-25T09:06:22.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f1385c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13800aeb90 0x7f1380157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f1385c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13800aef70 0x7f1380143520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f1385c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13800cdba0 0x7f13801555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f1385c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138015bb30 con 0x7f13800aeb90 2024-04-25T09:06:22.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f1385c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138015b9b0 con 0x7f13800aef70 2024-04-25T09:06:22.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f1385c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138015bcb0 con 0x7f13800cdba0 2024-04-25T09:06:22.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f137ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13800aeb90 0x7f1380157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f137ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13800aeb90 0x7f1380157070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46422/0 (socket says 172.21.15.173:46422) 2024-04-25T09:06:22.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f137ea00640 1 -- 172.21.15.173:0/416566138 learned_addr learned my addr 172.21.15.173:0/416566138 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:22.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f137f400640 1 --2- 172.21.15.173:0/416566138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13800cdba0 0x7f13801555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f137e000640 1 --2- 172.21.15.173:0/416566138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13800aef70 0x7f1380143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f137ea00640 1 -- 172.21.15.173:0/416566138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13800cdba0 msgr2=0x7f13801555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f137ea00640 1 --2- 172.21.15.173:0/416566138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13800cdba0 0x7f13801555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f137ea00640 1 -- 172.21.15.173:0/416566138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13800aef70 msgr2=0x7f1380143520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f137ea00640 1 --2- 172.21.15.173:0/416566138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13800aef70 0x7f1380143520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f137ea00640 1 -- 172.21.15.173:0/416566138 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1380155fd0 con 0x7f13800aeb90 2024-04-25T09:06:22.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f137e000640 1 --2- 172.21.15.173:0/416566138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13800aef70 0x7f1380143520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:22.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.542+0000 7f137f400640 1 --2- 172.21.15.173:0/416566138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13800cdba0 0x7f13801555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:22.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.546+0000 7f137ea00640 1 --2- 172.21.15.173:0/416566138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13800aeb90 0x7f1380157070 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1370007ef0 tx=0x7f137000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.546+0000 7f1376a00640 1 -- 172.21.15.173:0/416566138 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137001a070 con 0x7f13800aeb90 2024-04-25T09:06:22.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.546+0000 7f1376a00640 1 -- 172.21.15.173:0/416566138 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1370003ba0 con 0x7f13800aeb90 2024-04-25T09:06:22.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.546+0000 7f1376a00640 1 -- 172.21.15.173:0/416566138 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370004030 con 0x7f13800aeb90 2024-04-25T09:06:22.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.546+0000 7f1385c00640 1 -- 172.21.15.173:0/416566138 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13801562b0 con 0x7f13800aeb90 2024-04-25T09:06:22.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.546+0000 7f1385c00640 1 -- 172.21.15.173:0/416566138 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1380156870 con 0x7f13800aeb90 2024-04-25T09:06:22.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.546+0000 7f1376a00640 1 -- 172.21.15.173:0/416566138 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f137001d070 con 0x7f13800aeb90 2024-04-25T09:06:22.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.546+0000 7f1376a00640 1 --2- 172.21.15.173:0/416566138 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1360066f60 0x7f1360069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.546+0000 7f1376a00640 1 -- 172.21.15.173:0/416566138 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1370085490 con 0x7f13800aeb90 2024-04-25T09:06:22.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.546+0000 7f137e000640 1 --2- 172.21.15.173:0/416566138 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1360066f60 0x7f1360069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.546+0000 7f1389040000 1 Processor -- start 2024-04-25T09:06:22.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f1389040000 1 -- start start 2024-04-25T09:06:22.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f137e000640 1 --2- 172.21.15.173:0/416566138 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1360066f60 0x7f1360069420 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f136c0ad000 tx=0x7f136c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f1389040000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 0x556c2bb50d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f1389040000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb51290 0x556c2bb06790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f1389040000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb06cd0 0x556c2bb070b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f1389040000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c2b91c8a0 con 0x556c2bb50970 2024-04-25T09:06:22.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f1389040000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c2b954d10 con 0x556c2bb06cd0 2024-04-25T09:06:22.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f1389040000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c2b8dd2d0 con 0x556c2bb51290 2024-04-25T09:06:22.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f137ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 0x556c2bb50d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f137ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 0x556c2bb50d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46434/0 (socket says 172.21.15.173:46434) 2024-04-25T09:06:22.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f137ea00640 1 -- 172.21.15.173:0/3160975620 learned_addr learned my addr 172.21.15.173:0/3160975620 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:22.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f137f400640 1 --2- 172.21.15.173:0/3160975620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb06cd0 0x556c2bb070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f137e000640 1 --2- 172.21.15.173:0/3160975620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb51290 0x556c2bb06790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f137ea00640 1 -- 172.21.15.173:0/3160975620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb51290 msgr2=0x556c2bb06790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f137ea00640 1 --2- 172.21.15.173:0/3160975620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb51290 0x556c2bb06790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f137ea00640 1 -- 172.21.15.173:0/3160975620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb06cd0 msgr2=0x556c2bb070b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f137ea00640 1 --2- 172.21.15.173:0/3160975620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb06cd0 0x556c2bb070b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f137ea00640 1 -- 172.21.15.173:0/3160975620 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c2b99b870 con 0x556c2bb50970 2024-04-25T09:06:22.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f137ea00640 1 --2- 172.21.15.173:0/3160975620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 0x556c2bb50d50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1370055890 tx=0x7f1370051f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65b00a187a43f8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f136b400640 1 -- 172.21.15.173:0/3160975620 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370053e90 con 0x556c2bb50970 2024-04-25T09:06:22.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f136b400640 1 -- 172.21.15.173:0/3160975620 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13700833d0 con 0x556c2bb50970 2024-04-25T09:06:22.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f136b400640 1 -- 172.21.15.173:0/3160975620 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370055df0 con 0x556c2bb50970 2024-04-25T09:06:22.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f1389040000 1 -- 172.21.15.173:0/3160975620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 msgr2=0x556c2bb50d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f1389040000 1 --2- 172.21.15.173:0/3160975620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 0x556c2bb50d50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1370055890 tx=0x7f1370051f60 comp rx=0 tx=0).stop 2024-04-25T09:06:22.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f1389040000 1 -- 172.21.15.173:0/3160975620 shutdown_connections 2024-04-25T09:06:22.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f1389040000 1 --2- 172.21.15.173:0/3160975620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb06cd0 0x556c2bb070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f1389040000 1 --2- 172.21.15.173:0/3160975620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb51290 0x556c2bb06790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f1389040000 1 --2- 172.21.15.173:0/3160975620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 0x556c2bb50d50 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f1389040000 1 -- 172.21.15.173:0/3160975620 >> 172.21.15.173:0/3160975620 conn(0x556c2bb0d540 msgr2=0x556c2bb0d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f1389040000 1 -- 172.21.15.173:0/3160975620 shutdown_connections 2024-04-25T09:06:22.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f1389040000 1 -- 172.21.15.173:0/3160975620 wait complete. 2024-04-25T09:06:22.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f1389040000 1 -- start start 2024-04-25T09:06:22.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.550+0000 7f1389040000 1 Processor -- start 2024-04-25T09:06:22.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f1389040000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb06cd0 0x556c2bb56cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f1389040000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 0x556c2bb57200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f1389040000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb51290 0x556c2bb0b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f1389040000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c2b90fb50 con 0x556c2bb50970 2024-04-25T09:06:22.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f1389040000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c2b950db0 con 0x556c2bb06cd0 2024-04-25T09:06:22.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f1389040000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c2b8fb870 con 0x556c2bb51290 2024-04-25T09:06:22.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f1389040000 10 client.0 _ll_register_callbacks cb 0x556c2ba08fb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:22.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f137e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 0x556c2bb57200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f137e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 0x556c2bb57200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46448/0 (socket says 172.21.15.173:46448) 2024-04-25T09:06:22.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f137e000640 1 -- 172.21.15.173:0/3442653025 learned_addr learned my addr 172.21.15.173:0/3442653025 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:22.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f137ea00640 1 --2- 172.21.15.173:0/3442653025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb06cd0 0x556c2bb56cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f137f400640 1 --2- 172.21.15.173:0/3442653025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb51290 0x556c2bb0b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f137e000640 1 -- 172.21.15.173:0/3442653025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb51290 msgr2=0x556c2bb0b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f137e000640 1 --2- 172.21.15.173:0/3442653025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb51290 0x556c2bb0b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f137e000640 1 -- 172.21.15.173:0/3442653025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb06cd0 msgr2=0x556c2bb56cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f137e000640 1 --2- 172.21.15.173:0/3442653025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb06cd0 0x556c2bb56cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f137e000640 1 -- 172.21.15.173:0/3442653025 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c2b8dd520 con 0x556c2bb50970 2024-04-25T09:06:22.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f137f400640 1 --2- 172.21.15.173:0/3442653025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb51290 0x556c2bb0b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:22.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f137e000640 1 --2- 172.21.15.173:0/3442653025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 0x556c2bb57200 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f136c008010 tx=0x7f136c01ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0f4213eb39b437 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f135fe00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:22.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f135fe00640 1 -- 172.21.15.173:0/3442653025 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c0c8060 con 0x556c2bb50970 2024-04-25T09:06:22.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f135fe00640 1 -- 172.21.15.173:0/3442653025 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f136c004230 con 0x556c2bb50970 2024-04-25T09:06:22.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f1389040000 1 -- 172.21.15.173:0/3442653025 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f13700833d0 con 0x556c2bb50970 2024-04-25T09:06:22.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f135fe00640 1 -- 172.21.15.173:0/3442653025 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f136c0ce050 con 0x556c2bb50970 2024-04-25T09:06:22.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f1389040000 10 client.6315 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:22.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f1389040000 1 -- 172.21.15.173:0/3442653025 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x556c2b94fd00 con 0x556c2bb50970 2024-04-25T09:06:22.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f135fe00640 1 -- 172.21.15.173:0/3442653025 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13700833d0 con 0x556c2bb50970 2024-04-25T09:06:22.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f135fe00640 1 -- 172.21.15.173:0/3442653025 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f136c0d1020 con 0x556c2bb50970 2024-04-25T09:06:22.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f1389040000 10 client.6315 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:22.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f1389040000 10 client.6315 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:22.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f1389040000 20 client.6315 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:22.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f1389040000 1 --2- 172.21.15.173:0/3442653025 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x556c2bb0c550 0x556c2bb0c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f1389040000 4 client.6315 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:22.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f1389040000 1 -- 172.21.15.173:0/3442653025 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c2b8f0b10 con 0x556c2bb0c550 2024-04-25T09:06:22.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f137ea00640 1 --2- 172.21.15.173:0/3442653025 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x556c2bb0c550 0x556c2bb0c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f135fe00640 10 client.6315 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:22.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.554+0000 7f137ea00640 1 --2- 172.21.15.173:0/3442653025 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x556c2bb0c550 0x556c2bb0c960 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fde71275a3418eb0 server_cookie=544cf63bc06319 in_seq=0 out_seq=0 2024-04-25T09:06:22.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.558+0000 7f135fe00640 1 -- 172.21.15.173:0/3442653025 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556c2b8f0b10 con 0x556c2bb0c550 2024-04-25T09:06:22.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.558+0000 7f135fe00640 10 client.6315 handle_command_reply: tid=0 2024-04-25T09:06:22.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.558+0000 7f1389040000 1 client.6315 shutdown 2024-04-25T09:06:22.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.558+0000 7f1389040000 1 -- 172.21.15.173:0/3442653025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 msgr2=0x556c2bb57200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.558+0000 7f1389040000 1 --2- 172.21.15.173:0/3442653025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 0x556c2bb57200 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f136c008010 tx=0x7f136c01ac20 comp rx=0 tx=0).stop 2024-04-25T09:06:22.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.558+0000 7f1389040000 1 -- 172.21.15.173:0/3442653025 shutdown_connections 2024-04-25T09:06:22.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.558+0000 7f1389040000 1 --2- 172.21.15.173:0/3442653025 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x556c2bb0c550 0x556c2bb0c960 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.558+0000 7f1389040000 1 --2- 172.21.15.173:0/3442653025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb51290 0x556c2bb0b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.558+0000 7f1389040000 1 --2- 172.21.15.173:0/3442653025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 0x556c2bb57200 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.558+0000 7f135fe00640 0 client.6315 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:22.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.558+0000 7f1389040000 1 --2- 172.21.15.173:0/3442653025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb06cd0 0x556c2bb56cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.558+0000 7f1389040000 1 -- 172.21.15.173:0/3442653025 >> 172.21.15.173:0/3442653025 conn(0x556c2bb0d540 msgr2=0x556c2bb05780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.558+0000 7f1389040000 1 -- 172.21.15.173:0/3442653025 shutdown_connections 2024-04-25T09:06:22.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.558+0000 7f1389040000 1 -- 172.21.15.173:0/3442653025 wait complete. 2024-04-25T09:06:22.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.558+0000 7f1389040000 20 client.6315 trim_cache size 0 max 16384 2024-04-25T09:06:22.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.570+0000 7f1389040000 1 Processor -- start 2024-04-25T09:06:22.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.570+0000 7f1389040000 1 -- start start 2024-04-25T09:06:22.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb06cd0 0x556c2bb06320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb50970 0x556c2bb53680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb51290 0x556c2bb53bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1380202390 con 0x556c2bb06cd0 2024-04-25T09:06:22.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13801595b0 con 0x556c2bb50970 2024-04-25T09:06:22.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1380201d90 con 0x556c2bb51290 2024-04-25T09:06:22.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f137ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb06cd0 0x556c2bb06320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f137ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb06cd0 0x556c2bb06320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46464/0 (socket says 172.21.15.173:46464) 2024-04-25T09:06:22.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f137ea00640 1 -- 172.21.15.173:0/249082776 learned_addr learned my addr 172.21.15.173:0/249082776 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:22.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f137ea00640 1 -- 172.21.15.173:0/249082776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb51290 msgr2=0x556c2bb53bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f137ea00640 1 --2- 172.21.15.173:0/249082776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb51290 0x556c2bb53bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f137ea00640 1 -- 172.21.15.173:0/249082776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb50970 msgr2=0x556c2bb53680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f137ea00640 1 --2- 172.21.15.173:0/249082776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb50970 0x556c2bb53680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f137ea00640 1 -- 172.21.15.173:0/249082776 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c2b9d8920 con 0x556c2bb06cd0 2024-04-25T09:06:22.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f137ea00640 1 --2- 172.21.15.173:0/249082776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb06cd0 0x556c2bb06320 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1370055890 tx=0x7f1370058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67baa8ea806685ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f136aa00640 1 -- 172.21.15.173:0/249082776 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13700833d0 con 0x556c2bb06cd0 2024-04-25T09:06:22.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f136aa00640 1 -- 172.21.15.173:0/249082776 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1370052200 con 0x556c2bb06cd0 2024-04-25T09:06:22.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f136aa00640 1 -- 172.21.15.173:0/249082776 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137005dff0 con 0x556c2bb06cd0 2024-04-25T09:06:22.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 -- 172.21.15.173:0/249082776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb06cd0 msgr2=0x556c2bb06320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 --2- 172.21.15.173:0/249082776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb06cd0 0x556c2bb06320 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1370055890 tx=0x7f1370058000 comp rx=0 tx=0).stop 2024-04-25T09:06:22.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 -- 172.21.15.173:0/249082776 shutdown_connections 2024-04-25T09:06:22.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 --2- 172.21.15.173:0/249082776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb51290 0x556c2bb53bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 --2- 172.21.15.173:0/249082776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb50970 0x556c2bb53680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 --2- 172.21.15.173:0/249082776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb06cd0 0x556c2bb06320 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 -- 172.21.15.173:0/249082776 >> 172.21.15.173:0/249082776 conn(0x556c2bb0d540 msgr2=0x556c2bb0abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 -- 172.21.15.173:0/249082776 shutdown_connections 2024-04-25T09:06:22.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 -- 172.21.15.173:0/249082776 wait complete. 2024-04-25T09:06:22.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 -- start start 2024-04-25T09:06:22.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 Processor -- start 2024-04-25T09:06:22.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb06cd0 0x556c2bbb1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 0x556c2bbb3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb51290 0x556c2bbb5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c2b918550 con 0x556c2bb50970 2024-04-25T09:06:22.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c2b9d8490 con 0x556c2bb51290 2024-04-25T09:06:22.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c2b959340 con 0x556c2bb06cd0 2024-04-25T09:06:22.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f1389040000 10 client.0 _ll_register_callbacks cb 0x7f1370051e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:22.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.574+0000 7f137e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 0x556c2bbb3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f137e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 0x556c2bbb3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46468/0 (socket says 172.21.15.173:46468) 2024-04-25T09:06:22.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f137e000640 1 -- 172.21.15.173:0/885333197 learned_addr learned my addr 172.21.15.173:0/885333197 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:22.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f137f400640 1 --2- 172.21.15.173:0/885333197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb51290 0x556c2bbb5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f137ea00640 1 --2- 172.21.15.173:0/885333197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb06cd0 0x556c2bbb1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f137e000640 1 -- 172.21.15.173:0/885333197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb06cd0 msgr2=0x556c2bbb1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f137e000640 1 --2- 172.21.15.173:0/885333197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb06cd0 0x556c2bbb1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f137e000640 1 -- 172.21.15.173:0/885333197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb51290 msgr2=0x556c2bbb5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f137e000640 1 --2- 172.21.15.173:0/885333197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb51290 0x556c2bbb5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f137e000640 1 -- 172.21.15.173:0/885333197 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c2b9aea30 con 0x556c2bb50970 2024-04-25T09:06:22.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f137e000640 1 --2- 172.21.15.173:0/885333197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 0x556c2bbb3970 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f136c0cc040 tx=0x7f136c019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad0ec21e93b6e0d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f135fe00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:22.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f135fe00640 1 -- 172.21.15.173:0/885333197 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c0036f0 con 0x556c2bb50970 2024-04-25T09:06:22.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f135fe00640 1 -- 172.21.15.173:0/885333197 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f136c003990 con 0x556c2bb50970 2024-04-25T09:06:22.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 1 -- 172.21.15.173:0/885333197 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1370052200 con 0x556c2bb50970 2024-04-25T09:06:22.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f135fe00640 1 -- 172.21.15.173:0/885333197 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f136c0df050 con 0x556c2bb50970 2024-04-25T09:06:22.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 10 client.6321 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:22.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 1 -- 172.21.15.173:0/885333197 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x556c2b8fc150 con 0x556c2bb50970 2024-04-25T09:06:22.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f135fe00640 1 -- 172.21.15.173:0/885333197 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1370052200 con 0x556c2bb50970 2024-04-25T09:06:22.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f135fe00640 1 -- 172.21.15.173:0/885333197 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f136c0e2020 con 0x556c2bb50970 2024-04-25T09:06:22.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 10 client.6321 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:22.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 10 client.6321 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:22.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 20 client.6321 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:22.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 1 --2- 172.21.15.173:0/885333197 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x556c2bbb6400 0x556c2bbb87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 4 client.6321 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-04-25T09:06:22.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 1 -- 172.21.15.173:0/885333197 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) v1 -- 0x556c2b962250 con 0x556c2bbb6400 2024-04-25T09:06:22.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f137ea00640 1 --2- 172.21.15.173:0/885333197 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x556c2bbb6400 0x556c2bbb87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f137ea00640 1 --2- 172.21.15.173:0/885333197 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x556c2bbb6400 0x556c2bbb87f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6844487114d2c5c server_cookie=dfa00d9c0b3e7a9d in_seq=0 out_seq=0 2024-04-25T09:06:22.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f135fe00640 10 client.6321 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:22.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f135fe00640 1 -- 172.21.15.173:0/885333197 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+26 (crc 0 0 0) 0x556c2b962250 con 0x556c2bbb6400 2024-04-25T09:06:22.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f135fe00640 10 client.6321 handle_command_reply: tid=0 2024-04-25T09:06:22.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 1 client.6321 shutdown 2024-04-25T09:06:22.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 1 -- 172.21.15.173:0/885333197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 msgr2=0x556c2bbb3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 1 --2- 172.21.15.173:0/885333197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 0x556c2bbb3970 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f136c0cc040 tx=0x7f136c019180 comp rx=0 tx=0).stop 2024-04-25T09:06:22.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 1 -- 172.21.15.173:0/885333197 shutdown_connections 2024-04-25T09:06:22.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 1 --2- 172.21.15.173:0/885333197 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x556c2bbb6400 0x556c2bbb87f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 1 --2- 172.21.15.173:0/885333197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556c2bb51290 0x556c2bbb5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 1 --2- 172.21.15.173:0/885333197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2bb50970 0x556c2bbb3970 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f135fe00640 0 client.6321 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:22.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 1 --2- 172.21.15.173:0/885333197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556c2bb06cd0 0x556c2bbb1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 1 -- 172.21.15.173:0/885333197 >> 172.21.15.173:0/885333197 conn(0x556c2bb0d540 msgr2=0x556c2bb05e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 1 -- 172.21.15.173:0/885333197 shutdown_connections 2024-04-25T09:06:22.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 1 -- 172.21.15.173:0/885333197 wait complete. 2024-04-25T09:06:22.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1389040000 20 client.6321 trim_cache size 0 max 16384 2024-04-25T09:06:22.571 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:22.572 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": -2 2024-04-25T09:06:22.572 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:22.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1385c00640 1 -- 172.21.15.173:0/416566138 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1360066f60 msgr2=0x7f1360069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1385c00640 1 --2- 172.21.15.173:0/416566138 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1360066f60 0x7f1360069420 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f136c0ad000 tx=0x7f136c008040 comp rx=0 tx=0).stop 2024-04-25T09:06:22.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1385c00640 1 -- 172.21.15.173:0/416566138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13800aeb90 msgr2=0x7f1380157070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1385c00640 1 --2- 172.21.15.173:0/416566138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13800aeb90 0x7f1380157070 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1370007ef0 tx=0x7f137000d4a0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1385c00640 1 -- 172.21.15.173:0/416566138 shutdown_connections 2024-04-25T09:06:22.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1385c00640 1 --2- 172.21.15.173:0/416566138 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1360066f60 0x7f1360069420 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1385c00640 1 --2- 172.21.15.173:0/416566138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13800cdba0 0x7f13801555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1385c00640 1 --2- 172.21.15.173:0/416566138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13800aef70 0x7f1380143520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1385c00640 1 --2- 172.21.15.173:0/416566138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13800aeb90 0x7f1380157070 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1385c00640 1 -- 172.21.15.173:0/416566138 >> 172.21.15.173:0/416566138 conn(0x7f138006ac90 msgr2=0x7f138006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1385c00640 1 -- 172.21.15.173:0/416566138 shutdown_connections 2024-04-25T09:06:22.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.578+0000 7f1385c00640 1 -- 172.21.15.173:0/416566138 wait complete. 2024-04-25T09:06:22.587 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-04-25T09:06:22.587 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-04-25T09:06:22.587 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:06:22.587 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-04-25T09:06:22.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.738+0000 7f96e5800640 1 Processor -- start 2024-04-25T09:06:22.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.738+0000 7f96e5800640 1 -- start start 2024-04-25T09:06:22.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.738+0000 7f96e5800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f96e00aeb90 0x7f96e00cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.738+0000 7f96e5800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f96e00aef70 0x7f96e00cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.738+0000 7f96e5800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96e00cdba0 0x7f96e00ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.738+0000 7f96e5800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e0071320 con 0x7f96e00aeb90 2024-04-25T09:06:22.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.738+0000 7f96e5800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e0072330 con 0x7f96e00aef70 2024-04-25T09:06:22.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.738+0000 7f96e5800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e00ce570 con 0x7f96e00cdba0 2024-04-25T09:06:22.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.738+0000 7f96dea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f96e00aeb90 0x7f96e00cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.738+0000 7f96dea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f96e00aeb90 0x7f96e00cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46482/0 (socket says 172.21.15.173:46482) 2024-04-25T09:06:22.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.738+0000 7f96dea00640 1 -- 172.21.15.173:0/3403379867 learned_addr learned my addr 172.21.15.173:0/3403379867 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:22.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.738+0000 7f96df400640 1 --2- 172.21.15.173:0/3403379867 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96e00cdba0 0x7f96e00ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.738+0000 7f96d6000640 1 --2- 172.21.15.173:0/3403379867 >> v2:172.21.15.194:3300/0 conn(0x7f96e00aef70 0x7f96e00cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.738+0000 7f96dea00640 1 -- 172.21.15.173:0/3403379867 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96e00cdba0 msgr2=0x7f96e00ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.738+0000 7f96dea00640 1 --2- 172.21.15.173:0/3403379867 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96e00cdba0 0x7f96e00ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.738+0000 7f96dea00640 1 -- 172.21.15.173:0/3403379867 >> v2:172.21.15.194:3300/0 conn(0x7f96e00aef70 msgr2=0x7f96e00cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.738+0000 7f96dea00640 1 --2- 172.21.15.173:0/3403379867 >> v2:172.21.15.194:3300/0 conn(0x7f96e00aef70 0x7f96e00cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.738+0000 7f96dea00640 1 -- 172.21.15.173:0/3403379867 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e0071570 con 0x7f96e00aeb90 2024-04-25T09:06:22.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.742+0000 7f96dea00640 1 --2- 172.21.15.173:0/3403379867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e00aeb90 0x7f96e00cc0d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f96e00cd960 tx=0x7f96d001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daabaa038da2604d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.742+0000 7f96de000640 1 -- 172.21.15.173:0/3403379867 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d00ab620 con 0x7f96e00aeb90 2024-04-25T09:06:22.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.742+0000 7f96de000640 1 -- 172.21.15.173:0/3403379867 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d00b0070 con 0x7f96e00aeb90 2024-04-25T09:06:22.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.742+0000 7f96de000640 1 -- 172.21.15.173:0/3403379867 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d00ab9e0 con 0x7f96e00aeb90 2024-04-25T09:06:22.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.742+0000 7f96e5800640 1 -- 172.21.15.173:0/3403379867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e00aeb90 msgr2=0x7f96e00cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.742+0000 7f96e5800640 1 --2- 172.21.15.173:0/3403379867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e00aeb90 0x7f96e00cc0d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f96e00cd960 tx=0x7f96d001c460 comp rx=0 tx=0).stop 2024-04-25T09:06:22.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.742+0000 7f96e5800640 1 -- 172.21.15.173:0/3403379867 shutdown_connections 2024-04-25T09:06:22.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.742+0000 7f96e5800640 1 --2- 172.21.15.173:0/3403379867 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96e00cdba0 0x7f96e00ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.742+0000 7f96e5800640 1 --2- 172.21.15.173:0/3403379867 >> v2:172.21.15.194:3300/0 conn(0x7f96e00aef70 0x7f96e00cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.742+0000 7f96e5800640 1 --2- 172.21.15.173:0/3403379867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e00aeb90 0x7f96e00cc0d0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.742+0000 7f96e5800640 1 -- 172.21.15.173:0/3403379867 >> 172.21.15.173:0/3403379867 conn(0x7f96e006ac90 msgr2=0x7f96e006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.742+0000 7f96e5800640 1 -- 172.21.15.173:0/3403379867 shutdown_connections 2024-04-25T09:06:22.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.742+0000 7f96e5800640 1 -- 172.21.15.173:0/3403379867 wait complete. 2024-04-25T09:06:22.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96e5800640 1 Processor -- start 2024-04-25T09:06:22.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96e5800640 1 -- start start 2024-04-25T09:06:22.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96e5800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e00aeb90 0x7f96e0144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96e5800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96e00aef70 0x7f96e0156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96e5800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96e00cdba0 0x7f96e0157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96e5800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e015ef40 con 0x7f96e00aeb90 2024-04-25T09:06:22.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96e5800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e015edc0 con 0x7f96e00cdba0 2024-04-25T09:06:22.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96e5800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e015f0c0 con 0x7f96e00aef70 2024-04-25T09:06:22.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96dea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e00aeb90 0x7f96e0144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96dea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e00aeb90 0x7f96e0144050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46488/0 (socket says 172.21.15.173:46488) 2024-04-25T09:06:22.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96dea00640 1 -- 172.21.15.173:0/860219920 learned_addr learned my addr 172.21.15.173:0/860219920 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:22.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96df400640 1 --2- 172.21.15.173:0/860219920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96e00cdba0 0x7f96e0157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96d6000640 1 --2- 172.21.15.173:0/860219920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96e00aef70 0x7f96e0156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96dea00640 1 -- 172.21.15.173:0/860219920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96e00aef70 msgr2=0x7f96e0156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96dea00640 1 --2- 172.21.15.173:0/860219920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96e00aef70 0x7f96e0156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96dea00640 1 -- 172.21.15.173:0/860219920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96e00cdba0 msgr2=0x7f96e0157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96dea00640 1 --2- 172.21.15.173:0/860219920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96e00cdba0 0x7f96e0157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96dea00640 1 -- 172.21.15.173:0/860219920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e0144590 con 0x7f96e00aeb90 2024-04-25T09:06:22.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96df400640 1 --2- 172.21.15.173:0/860219920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96e00cdba0 0x7f96e0157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:22.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96dea00640 1 --2- 172.21.15.173:0/860219920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e00aeb90 0x7f96e0144050 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f96d00ad040 tx=0x7f96d001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96d7400640 1 -- 172.21.15.173:0/860219920 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d00abda0 con 0x7f96e00aeb90 2024-04-25T09:06:22.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96d7400640 1 -- 172.21.15.173:0/860219920 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d00be3f0 con 0x7f96e00aeb90 2024-04-25T09:06:22.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96d7400640 1 -- 172.21.15.173:0/860219920 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d00be7e0 con 0x7f96e00aeb90 2024-04-25T09:06:22.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96e5800640 1 -- 172.21.15.173:0/860219920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e0155720 con 0x7f96e00aeb90 2024-04-25T09:06:22.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.746+0000 7f96e5800640 1 -- 172.21.15.173:0/860219920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e0155ce0 con 0x7f96e00aeb90 2024-04-25T09:06:22.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.750+0000 7f96d7400640 1 -- 172.21.15.173:0/860219920 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f96d00c7440 con 0x7f96e00aeb90 2024-04-25T09:06:22.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.750+0000 7f96d7400640 1 --2- 172.21.15.173:0/860219920 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f96bc066f60 0x7f96bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.750+0000 7f96d7400640 1 -- 172.21.15.173:0/860219920 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f96d011f640 con 0x7f96e00aeb90 2024-04-25T09:06:22.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.750+0000 7f96d6000640 1 --2- 172.21.15.173:0/860219920 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f96bc066f60 0x7f96bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.750+0000 7f96e8bed000 1 Processor -- start 2024-04-25T09:06:22.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.750+0000 7f96e8bed000 1 -- start start 2024-04-25T09:06:22.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.750+0000 7f96d6000640 1 --2- 172.21.15.173:0/860219920 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f96bc066f60 0x7f96bc069420 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f96e00cc910 tx=0x7f96c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.750+0000 7f96e8bed000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56025474e300 0x56025474e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.750+0000 7f96e8bed000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474ec20 0x5602547045e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.750+0000 7f96e8bed000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560254704b20 0x560254704f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.750+0000 7f96e8bed000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025454edb0 con 0x56025474ec20 2024-04-25T09:06:22.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.750+0000 7f96e8bed000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602544d7230 con 0x560254704b20 2024-04-25T09:06:22.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.750+0000 7f96e8bed000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56025454ae50 con 0x56025474e300 2024-04-25T09:06:22.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.750+0000 7f96d6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474ec20 0x5602547045e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96d6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474ec20 0x5602547045e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46490/0 (socket says 172.21.15.173:46490) 2024-04-25T09:06:22.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96d6000640 1 -- 172.21.15.173:0/2005976889 learned_addr learned my addr 172.21.15.173:0/2005976889 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:22.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96df400640 1 --2- 172.21.15.173:0/2005976889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560254704b20 0x560254704f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96dea00640 1 --2- 172.21.15.173:0/2005976889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56025474e300 0x56025474e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96d6000640 1 -- 172.21.15.173:0/2005976889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56025474e300 msgr2=0x56025474e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96d6000640 1 --2- 172.21.15.173:0/2005976889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56025474e300 0x56025474e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96d6000640 1 -- 172.21.15.173:0/2005976889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560254704b20 msgr2=0x560254704f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96d6000640 1 --2- 172.21.15.173:0/2005976889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560254704b20 0x560254704f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96d6000640 1 -- 172.21.15.173:0/2005976889 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560254510750 con 0x56025474ec20 2024-04-25T09:06:22.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96d6000640 1 --2- 172.21.15.173:0/2005976889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474ec20 0x5602547045e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f96c800fa00 tx=0x7f96c8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308600a299100b8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96cf400640 1 -- 172.21.15.173:0/2005976889 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c801b050 con 0x56025474ec20 2024-04-25T09:06:22.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96cf400640 1 -- 172.21.15.173:0/2005976889 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c8025070 con 0x56025474ec20 2024-04-25T09:06:22.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96cf400640 1 -- 172.21.15.173:0/2005976889 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c8014de0 con 0x56025474ec20 2024-04-25T09:06:22.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96e8bed000 1 -- 172.21.15.173:0/2005976889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474ec20 msgr2=0x5602547045e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96e8bed000 1 --2- 172.21.15.173:0/2005976889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474ec20 0x5602547045e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f96c800fa00 tx=0x7f96c8012000 comp rx=0 tx=0).stop 2024-04-25T09:06:22.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96e8bed000 1 -- 172.21.15.173:0/2005976889 shutdown_connections 2024-04-25T09:06:22.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96e8bed000 1 --2- 172.21.15.173:0/2005976889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560254704b20 0x560254704f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96e8bed000 1 --2- 172.21.15.173:0/2005976889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474ec20 0x5602547045e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96e8bed000 1 --2- 172.21.15.173:0/2005976889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56025474e300 0x56025474e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96e8bed000 1 -- 172.21.15.173:0/2005976889 >> 172.21.15.173:0/2005976889 conn(0x5602546fc6c0 msgr2=0x5602546feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96e8bed000 1 -- 172.21.15.173:0/2005976889 shutdown_connections 2024-04-25T09:06:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96e8bed000 1 -- 172.21.15.173:0/2005976889 wait complete. 2024-04-25T09:06:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96e8bed000 1 -- start start 2024-04-25T09:06:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96e8bed000 1 Processor -- start 2024-04-25T09:06:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96e8bed000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560254704b20 0x560254755660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96e8bed000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474e300 0x560254755ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96e8bed000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56025474ec20 0x560254732170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96e8bed000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x560254509bf0 con 0x56025474e300 2024-04-25T09:06:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96e8bed000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602545b0410 con 0x560254704b20 2024-04-25T09:06:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96e8bed000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602547560e0 con 0x56025474ec20 2024-04-25T09:06:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96e8bed000 10 client.0 _ll_register_callbacks cb 0x5602546eb790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96d6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474e300 0x560254755ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96d6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474e300 0x560254755ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46492/0 (socket says 172.21.15.173:46492) 2024-04-25T09:06:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96d6000640 1 -- 172.21.15.173:0/37419397 learned_addr learned my addr 172.21.15.173:0/37419397 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96dea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560254704b20 0x560254755660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.754+0000 7f96df400640 1 --2- 172.21.15.173:0/37419397 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56025474ec20 0x560254732170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96d6000640 1 -- 172.21.15.173:0/37419397 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56025474ec20 msgr2=0x560254732170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96d6000640 1 --2- 172.21.15.173:0/37419397 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56025474ec20 0x560254732170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96d6000640 1 -- 172.21.15.173:0/37419397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560254704b20 msgr2=0x560254755660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96d6000640 1 --2- 172.21.15.173:0/37419397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560254704b20 0x560254755660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96d6000640 1 -- 172.21.15.173:0/37419397 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602544f1640 con 0x56025474e300 2024-04-25T09:06:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96df400640 1 --2- 172.21.15.173:0/37419397 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56025474ec20 0x560254732170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96d6000640 1 --2- 172.21.15.173:0/37419397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474e300 0x560254755ba0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x56025454da50 tx=0x7f96c8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b0a4146907ac64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96c3e00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96c3e00640 1 -- 172.21.15.173:0/37419397 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c8020a70 con 0x56025474e300 2024-04-25T09:06:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96c3e00640 1 -- 172.21.15.173:0/37419397 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f96c8034c70 con 0x56025474e300 2024-04-25T09:06:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 1 -- 172.21.15.173:0/37419397 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f96c8025070 con 0x56025474e300 2024-04-25T09:06:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96c3e00640 1 -- 172.21.15.173:0/37419397 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96c803b050 con 0x56025474e300 2024-04-25T09:06:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 10 client.6333 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 1 -- 172.21.15.173:0/37419397 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x5602544d7480 con 0x56025474e300 2024-04-25T09:06:22.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96c3e00640 1 -- 172.21.15.173:0/37419397 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c8025070 con 0x56025474e300 2024-04-25T09:06:22.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96c3e00640 1 -- 172.21.15.173:0/37419397 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f96c803e020 con 0x56025474e300 2024-04-25T09:06:22.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 10 client.6333 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:22.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 10 client.6333 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:22.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 20 client.6333 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:22.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 1 --2- 172.21.15.173:0/37419397 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x560254732f10 0x560254733320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 4 client.6333 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:22.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 1 -- 172.21.15.173:0/37419397 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5602544eabb0 con 0x560254732f10 2024-04-25T09:06:22.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96dea00640 1 --2- 172.21.15.173:0/37419397 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x560254732f10 0x560254733320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96dea00640 1 --2- 172.21.15.173:0/37419397 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x560254732f10 0x560254733320 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14c15899f03ac175 server_cookie=8f3f7ee8e64e48d5 in_seq=0 out_seq=0 2024-04-25T09:06:22.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96c3e00640 10 client.6333 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:22.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96c3e00640 1 -- 172.21.15.173:0/37419397 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5602544eabb0 con 0x560254732f10 2024-04-25T09:06:22.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96c3e00640 10 client.6333 handle_command_reply: tid=0 2024-04-25T09:06:22.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 1 client.6333 shutdown 2024-04-25T09:06:22.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 1 -- 172.21.15.173:0/37419397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474e300 msgr2=0x560254755ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 1 --2- 172.21.15.173:0/37419397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474e300 0x560254755ba0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x56025454da50 tx=0x7f96c8004740 comp rx=0 tx=0).stop 2024-04-25T09:06:22.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 1 -- 172.21.15.173:0/37419397 shutdown_connections 2024-04-25T09:06:22.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 1 --2- 172.21.15.173:0/37419397 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x560254732f10 0x560254733320 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 1 --2- 172.21.15.173:0/37419397 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56025474ec20 0x560254732170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 1 --2- 172.21.15.173:0/37419397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474e300 0x560254755ba0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 1 --2- 172.21.15.173:0/37419397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560254704b20 0x560254755660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96c3e00640 0 client.6333 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:22.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 1 -- 172.21.15.173:0/37419397 >> 172.21.15.173:0/37419397 conn(0x5602546fc6c0 msgr2=0x560254705790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 1 -- 172.21.15.173:0/37419397 shutdown_connections 2024-04-25T09:06:22.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 1 -- 172.21.15.173:0/37419397 wait complete. 2024-04-25T09:06:22.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.758+0000 7f96e8bed000 20 client.6333 trim_cache size 0 max 16384 2024-04-25T09:06:22.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96e8bed000 1 Processor -- start 2024-04-25T09:06:22.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96e8bed000 1 -- start start 2024-04-25T09:06:22.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96e8bed000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5602546fc6c0 0x560254731f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96e8bed000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560254704b20 0x56025472d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96e8bed000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56025474e300 0x560254704f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96e8bed000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01febf0 con 0x560254704b20 2024-04-25T09:06:22.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96e8bed000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e00b0bb0 con 0x56025474e300 2024-04-25T09:06:22.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96e8bed000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0145b10 con 0x5602546fc6c0 2024-04-25T09:06:22.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96d6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560254704b20 0x56025472d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96d6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560254704b20 0x56025472d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46502/0 (socket says 172.21.15.173:46502) 2024-04-25T09:06:22.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96d6000640 1 -- 172.21.15.173:0/2084080577 learned_addr learned my addr 172.21.15.173:0/2084080577 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:22.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96dea00640 1 --2- 172.21.15.173:0/2084080577 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5602546fc6c0 0x560254731f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96d6000640 1 -- 172.21.15.173:0/2084080577 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5602546fc6c0 msgr2=0x560254731f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96d6000640 1 --2- 172.21.15.173:0/2084080577 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5602546fc6c0 0x560254731f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96d6000640 1 -- 172.21.15.173:0/2084080577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56025474e300 msgr2=0x560254704f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96df400640 1 --2- 172.21.15.173:0/2084080577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56025474e300 0x560254704f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96d6000640 1 --2- 172.21.15.173:0/2084080577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56025474e300 0x560254704f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96d6000640 1 -- 172.21.15.173:0/2084080577 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602545d0ef0 con 0x560254704b20 2024-04-25T09:06:22.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.774+0000 7f96df400640 1 --2- 172.21.15.173:0/2084080577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56025474e300 0x560254704f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:22.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96d6000640 1 --2- 172.21.15.173:0/2084080577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560254704b20 0x56025472d260 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f96c800f980 tx=0x7f96c802c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7fe346d8455706 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96cea00640 1 -- 172.21.15.173:0/2084080577 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c801b040 con 0x560254704b20 2024-04-25T09:06:22.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96cea00640 1 -- 172.21.15.173:0/2084080577 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c8025040 con 0x560254704b20 2024-04-25T09:06:22.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96cea00640 1 -- 172.21.15.173:0/2084080577 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c8020a50 con 0x560254704b20 2024-04-25T09:06:22.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96e8bed000 1 -- 172.21.15.173:0/2084080577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560254704b20 msgr2=0x56025472d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96e8bed000 1 --2- 172.21.15.173:0/2084080577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560254704b20 0x56025472d260 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f96c800f980 tx=0x7f96c802c070 comp rx=0 tx=0).stop 2024-04-25T09:06:22.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96e8bed000 1 -- 172.21.15.173:0/2084080577 shutdown_connections 2024-04-25T09:06:22.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96e8bed000 1 --2- 172.21.15.173:0/2084080577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56025474e300 0x560254704f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96e8bed000 1 --2- 172.21.15.173:0/2084080577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560254704b20 0x56025472d260 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96e8bed000 1 --2- 172.21.15.173:0/2084080577 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5602546fc6c0 0x560254731f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96e8bed000 1 -- 172.21.15.173:0/2084080577 >> 172.21.15.173:0/2084080577 conn(0x56025474d980 msgr2=0x56025472cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96e8bed000 1 -- 172.21.15.173:0/2084080577 shutdown_connections 2024-04-25T09:06:22.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96e8bed000 1 -- 172.21.15.173:0/2084080577 wait complete. 2024-04-25T09:06:22.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96e8bed000 1 -- start start 2024-04-25T09:06:22.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96e8bed000 1 Processor -- start 2024-04-25T09:06:22.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96e8bed000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5602546fc6c0 0x5602547aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96e8bed000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560254704b20 0x560254751010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96e8bed000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474e300 0x560254751550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96e8bed000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x560254509bf0 con 0x56025474e300 2024-04-25T09:06:22.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96e8bed000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e00b05b0 con 0x560254704b20 2024-04-25T09:06:22.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96e8bed000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x560254709200 con 0x5602546fc6c0 2024-04-25T09:06:22.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96e8bed000 10 client.0 _ll_register_callbacks cb 0x7f96c800b640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:22.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96df400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474e300 0x560254751550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96dea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5602546fc6c0 0x5602547aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96df400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474e300 0x560254751550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46504/0 (socket says 172.21.15.173:46504) 2024-04-25T09:06:22.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96df400640 1 -- 172.21.15.173:0/3286543171 learned_addr learned my addr 172.21.15.173:0/3286543171 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:22.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96d6000640 1 --2- 172.21.15.173:0/3286543171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560254704b20 0x560254751010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96df400640 1 -- 172.21.15.173:0/3286543171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5602546fc6c0 msgr2=0x5602547aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96df400640 1 --2- 172.21.15.173:0/3286543171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5602546fc6c0 0x5602547aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96df400640 1 -- 172.21.15.173:0/3286543171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560254704b20 msgr2=0x560254751010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96df400640 1 --2- 172.21.15.173:0/3286543171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560254704b20 0x560254751010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.778+0000 7f96df400640 1 -- 172.21.15.173:0/3286543171 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56025450e9a0 con 0x56025474e300 2024-04-25T09:06:22.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96df400640 1 --2- 172.21.15.173:0/3286543171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474e300 0x560254751550 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f96d8007af0 tx=0x7f96d8009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251b4a04b0c45c29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96c3e00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:22.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96c3e00640 1 -- 172.21.15.173:0/3286543171 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d801d070 con 0x56025474e300 2024-04-25T09:06:22.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96c3e00640 1 -- 172.21.15.173:0/3286543171 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f96d8017440 con 0x56025474e300 2024-04-25T09:06:22.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 1 -- 172.21.15.173:0/3286543171 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f96c8025040 con 0x56025474e300 2024-04-25T09:06:22.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96c3e00640 1 -- 172.21.15.173:0/3286543171 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96d8028050 con 0x56025474e300 2024-04-25T09:06:22.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 10 client.6339 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:22.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 1 -- 172.21.15.173:0/3286543171 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x56025420b5a0 con 0x56025474e300 2024-04-25T09:06:22.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96c3e00640 1 -- 172.21.15.173:0/3286543171 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c8025040 con 0x56025474e300 2024-04-25T09:06:22.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96c3e00640 1 -- 172.21.15.173:0/3286543171 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f96d802b020 con 0x56025474e300 2024-04-25T09:06:22.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 10 client.6339 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:22.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 10 client.6339 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:22.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 20 client.6339 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:22.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 1 --2- 172.21.15.173:0/3286543171 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x56025474ec20 0x560254752400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 4 client.6339 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-04-25T09:06:22.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 1 -- 172.21.15.173:0/3286543171 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) v1 -- 0x5602544fe080 con 0x56025474ec20 2024-04-25T09:06:22.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96dea00640 1 --2- 172.21.15.173:0/3286543171 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x56025474ec20 0x560254752400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96dea00640 1 --2- 172.21.15.173:0/3286543171 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x56025474ec20 0x560254752400 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1aab319ecfe111f8 server_cookie=ed6629dae6f6eff4 in_seq=0 out_seq=0 2024-04-25T09:06:22.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96c3e00640 10 client.6339 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:22.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96c3e00640 1 -- 172.21.15.173:0/3286543171 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5602544fe080 con 0x56025474ec20 2024-04-25T09:06:22.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96c3e00640 10 client.6339 handle_command_reply: tid=0 2024-04-25T09:06:22.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 1 client.6339 shutdown 2024-04-25T09:06:22.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 1 -- 172.21.15.173:0/3286543171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474e300 msgr2=0x560254751550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 1 --2- 172.21.15.173:0/3286543171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474e300 0x560254751550 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f96d8007af0 tx=0x7f96d8009f60 comp rx=0 tx=0).stop 2024-04-25T09:06:22.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 1 -- 172.21.15.173:0/3286543171 shutdown_connections 2024-04-25T09:06:22.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 1 --2- 172.21.15.173:0/3286543171 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x56025474ec20 0x560254752400 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 1 --2- 172.21.15.173:0/3286543171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56025474e300 0x560254751550 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 1 --2- 172.21.15.173:0/3286543171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560254704b20 0x560254751010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 1 --2- 172.21.15.173:0/3286543171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5602546fc6c0 0x5602547aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96c3e00640 0 client.6339 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:22.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 1 -- 172.21.15.173:0/3286543171 >> 172.21.15.173:0/3286543171 conn(0x56025474d980 msgr2=0x56025472d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 1 -- 172.21.15.173:0/3286543171 shutdown_connections 2024-04-25T09:06:22.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 1 -- 172.21.15.173:0/3286543171 wait complete. 2024-04-25T09:06:22.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e8bed000 20 client.6339 trim_cache size 0 max 16384 2024-04-25T09:06:22.776 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:22.776 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0, 2024-04-25T09:06:22.777 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_tag": "37f99154-362f-4be2-b625-53f41a847cc3", 2024-04-25T09:06:22.777 INFO:teuthology.orchestra.run.smithi173.stdout: "mode": "asynchronous" 2024-04-25T09:06:22.777 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:22.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e5800640 1 -- 172.21.15.173:0/860219920 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f96bc066f60 msgr2=0x7f96bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e5800640 1 --2- 172.21.15.173:0/860219920 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f96bc066f60 0x7f96bc069420 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f96e00cc910 tx=0x7f96c8008040 comp rx=0 tx=0).stop 2024-04-25T09:06:22.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e5800640 1 -- 172.21.15.173:0/860219920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e00aeb90 msgr2=0x7f96e0144050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e5800640 1 --2- 172.21.15.173:0/860219920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e00aeb90 0x7f96e0144050 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f96d00ad040 tx=0x7f96d001aca0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e5800640 1 -- 172.21.15.173:0/860219920 shutdown_connections 2024-04-25T09:06:22.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e5800640 1 --2- 172.21.15.173:0/860219920 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f96bc066f60 0x7f96bc069420 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e5800640 1 --2- 172.21.15.173:0/860219920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96e00cdba0 0x7f96e0157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e5800640 1 --2- 172.21.15.173:0/860219920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96e00aef70 0x7f96e0156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e5800640 1 --2- 172.21.15.173:0/860219920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e00aeb90 0x7f96e0144050 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e5800640 1 -- 172.21.15.173:0/860219920 >> 172.21.15.173:0/860219920 conn(0x7f96e006ac90 msgr2=0x7f96e014dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e5800640 1 -- 172.21.15.173:0/860219920 shutdown_connections 2024-04-25T09:06:22.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.782+0000 7f96e5800640 1 -- 172.21.15.173:0/860219920 wait complete. 2024-04-25T09:06:22.791 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': '37f99154-362f-4be2-b625-53f41a847cc3', 'mode': 'asynchronous'}' 2024-04-25T09:06:22.791 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-04-25T09:06:22.791 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:06:22.791 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-04-25T09:06:22.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.942+0000 7f40ade00640 1 Processor -- start 2024-04-25T09:06:22.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.942+0000 7f40ade00640 1 -- start start 2024-04-25T09:06:22.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.942+0000 7f40ade00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f40a815bab0 0x7f40a80d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.942+0000 7f40ade00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f40a809a160 0x7f40a80c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.942+0000 7f40ade00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a80cc7a0 con 0x7f40a80cd840 2024-04-25T09:06:22.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.942+0000 7f40ade00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a80d07e0 con 0x7f40a815bab0 2024-04-25T09:06:22.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.942+0000 7f40ade00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a80cca80 con 0x7f40a809a160 2024-04-25T09:06:22.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.942+0000 7f40a6a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f40a815bab0 0x7f40a80d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.942+0000 7f40a6a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f40a815bab0 0x7f40a80d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46514/0 (socket says 172.21.15.173:46514) 2024-04-25T09:06:22.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.942+0000 7f40a6a00640 1 -- 172.21.15.173:0/1685433240 learned_addr learned my addr 172.21.15.173:0/1685433240 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:22.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.942+0000 7f40a7400640 1 --2- 172.21.15.173:0/1685433240 >> v2:172.21.15.194:3300/0 conn(0x7f40a809a160 0x7f40a80c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.942+0000 7f40a6a00640 1 -- 172.21.15.173:0/1685433240 >> v2:172.21.15.194:3300/0 conn(0x7f40a809a160 msgr2=0x7f40a80c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.942+0000 7f40a6a00640 1 --2- 172.21.15.173:0/1685433240 >> v2:172.21.15.194:3300/0 conn(0x7f40a809a160 0x7f40a80c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.946+0000 7f40a6a00640 1 -- 172.21.15.173:0/1685433240 >> v1:172.21.15.194:6789/0 conn(0x7f40a80cd840 legacy=0x7f40a8099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.946+0000 7f40a6a00640 1 -- 172.21.15.173:0/1685433240 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a80ccd60 con 0x7f40a815bab0 2024-04-25T09:06:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.946+0000 7f40a6a00640 1 --2- 172.21.15.173:0/1685433240 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40a815bab0 0x7f40a80d02a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f40a80c5280 tx=0x7f409001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d6a0002fedfbd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.946+0000 7f40a5600640 1 -- 172.21.15.173:0/1685433240 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40900aa650 con 0x7f40a815bab0 2024-04-25T09:06:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.946+0000 7f40a5600640 1 -- 172.21.15.173:0/1685433240 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40900af070 con 0x7f40a815bab0 2024-04-25T09:06:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.946+0000 7f40a5600640 1 -- 172.21.15.173:0/1685433240 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40900aaa10 con 0x7f40a815bab0 2024-04-25T09:06:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.946+0000 7f40ade00640 1 -- 172.21.15.173:0/1685433240 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40a815bab0 msgr2=0x7f40a80d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.946+0000 7f40ade00640 1 --2- 172.21.15.173:0/1685433240 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40a815bab0 0x7f40a80d02a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f40a80c5280 tx=0x7f409001c4f0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.946+0000 7f40ade00640 1 -- 172.21.15.173:0/1685433240 shutdown_connections 2024-04-25T09:06:22.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.946+0000 7f40ade00640 1 --2- 172.21.15.173:0/1685433240 >> v2:172.21.15.194:3300/0 conn(0x7f40a809a160 0x7f40a80c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.946+0000 7f40ade00640 1 --2- 172.21.15.173:0/1685433240 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40a815bab0 0x7f40a80d02a0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.946+0000 7f40ade00640 1 -- 172.21.15.173:0/1685433240 >> 172.21.15.173:0/1685433240 conn(0x7f40a80b32a0 msgr2=0x7f40a80b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.946+0000 7f40ade00640 1 -- 172.21.15.173:0/1685433240 shutdown_connections 2024-04-25T09:06:22.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.946+0000 7f40ade00640 1 -- 172.21.15.173:0/1685433240 wait complete. 2024-04-25T09:06:22.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40ade00640 1 Processor -- start 2024-04-25T09:06:22.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40ade00640 1 -- start start 2024-04-25T09:06:22.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40ade00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40a809a160 0x7f40a806cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40ade00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40a80cd840 0x7f40a81526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40ade00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40a815bab0 0x7f40a8152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40ade00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80cc540 con 0x7f40a80cd840 2024-04-25T09:06:22.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40ade00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80cc3c0 con 0x7f40a815bab0 2024-04-25T09:06:22.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40ade00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80cf540 con 0x7f40a809a160 2024-04-25T09:06:22.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40a6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40a80cd840 0x7f40a81526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40a6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40a80cd840 0x7f40a81526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46526/0 (socket says 172.21.15.173:46526) 2024-04-25T09:06:22.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40a6000640 1 -- 172.21.15.173:0/2699391193 learned_addr learned my addr 172.21.15.173:0/2699391193 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:22.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40a7400640 1 --2- 172.21.15.173:0/2699391193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40a815bab0 0x7f40a8152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40a6a00640 1 --2- 172.21.15.173:0/2699391193 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40a809a160 0x7f40a806cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40a6000640 1 -- 172.21.15.173:0/2699391193 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40a809a160 msgr2=0x7f40a806cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40a6000640 1 --2- 172.21.15.173:0/2699391193 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40a809a160 0x7f40a806cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40a6000640 1 -- 172.21.15.173:0/2699391193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40a815bab0 msgr2=0x7f40a8152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40a6000640 1 --2- 172.21.15.173:0/2699391193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40a815bab0 0x7f40a8152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40a6000640 1 -- 172.21.15.173:0/2699391193 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a80b6560 con 0x7f40a80cd840 2024-04-25T09:06:22.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40a6000640 1 --2- 172.21.15.173:0/2699391193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40a80cd840 0x7f40a81526f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f409800c420 tx=0x7f409800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f409f400640 1 -- 172.21.15.173:0/2699391193 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40980052d0 con 0x7f40a80cd840 2024-04-25T09:06:22.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f409f400640 1 -- 172.21.15.173:0/2699391193 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4098005470 con 0x7f40a80cd840 2024-04-25T09:06:22.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40ade00640 1 -- 172.21.15.173:0/2699391193 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a81515c0 con 0x7f40a80cd840 2024-04-25T09:06:22.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f409f400640 1 -- 172.21.15.173:0/2699391193 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098007260 con 0x7f40a80cd840 2024-04-25T09:06:22.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.950+0000 7f40ade00640 1 -- 172.21.15.173:0/2699391193 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a80b5a80 con 0x7f40a80cd840 2024-04-25T09:06:22.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.954+0000 7f409f400640 1 -- 172.21.15.173:0/2699391193 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4098007400 con 0x7f40a80cd840 2024-04-25T09:06:22.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.954+0000 7f409f400640 1 --2- 172.21.15.173:0/2699391193 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4084066f60 0x7f4084069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.954+0000 7f409f400640 1 -- 172.21.15.173:0/2699391193 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f40980846b0 con 0x7f40a80cd840 2024-04-25T09:06:22.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.954+0000 7f40a6a00640 1 --2- 172.21.15.173:0/2699391193 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4084066f60 0x7f4084069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.954+0000 7f40b121c000 1 Processor -- start 2024-04-25T09:06:22.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.954+0000 7f40b121c000 1 -- start start 2024-04-25T09:06:22.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40a6a00640 1 --2- 172.21.15.173:0/2699391193 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4084066f60 0x7f4084069420 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f40900ae000 tx=0x7f40900a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40b121c000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56142170e200 0x56142170e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40b121c000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56142170eb20 0x5614216f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40b121c000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5614216f2f60 0x5614216f3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40b121c000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614215ab4a0 con 0x5614216f2f60 2024-04-25T09:06:22.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40b121c000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561421513210 con 0x56142170e200 2024-04-25T09:06:22.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40b121c000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56142149b980 con 0x56142170eb20 2024-04-25T09:06:22.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40a7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5614216f2f60 0x5614216f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40a7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5614216f2f60 0x5614216f3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46530/0 (socket says 172.21.15.173:46530) 2024-04-25T09:06:22.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40a7400640 1 -- 172.21.15.173:0/1674524904 learned_addr learned my addr 172.21.15.173:0/1674524904 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:22.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40a6a00640 1 --2- 172.21.15.173:0/1674524904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56142170e200 0x56142170e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40a6000640 1 --2- 172.21.15.173:0/1674524904 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56142170eb20 0x5614216f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40a7400640 1 -- 172.21.15.173:0/1674524904 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56142170eb20 msgr2=0x5614216f2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40a7400640 1 --2- 172.21.15.173:0/1674524904 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56142170eb20 0x5614216f2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40a7400640 1 -- 172.21.15.173:0/1674524904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56142170e200 msgr2=0x56142170e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40a7400640 1 --2- 172.21.15.173:0/1674524904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56142170e200 0x56142170e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40a7400640 1 -- 172.21.15.173:0/1674524904 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56142150e200 con 0x5614216f2f60 2024-04-25T09:06:22.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40a7400640 1 --2- 172.21.15.173:0/1674524904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5614216f2f60 0x5614216f3340 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009f80 tx=0x7f40a0003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f27132f201e52d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f4097e00640 1 -- 172.21.15.173:0/1674524904 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a0015420 con 0x5614216f2f60 2024-04-25T09:06:22.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f4097e00640 1 -- 172.21.15.173:0/1674524904 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a001a070 con 0x5614216f2f60 2024-04-25T09:06:22.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f4097e00640 1 -- 172.21.15.173:0/1674524904 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a00157c0 con 0x5614216f2f60 2024-04-25T09:06:22.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40b121c000 1 -- 172.21.15.173:0/1674524904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5614216f2f60 msgr2=0x5614216f3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40b121c000 1 --2- 172.21.15.173:0/1674524904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5614216f2f60 0x5614216f3340 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009f80 tx=0x7f40a0003e30 comp rx=0 tx=0).stop 2024-04-25T09:06:22.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40b121c000 1 -- 172.21.15.173:0/1674524904 shutdown_connections 2024-04-25T09:06:22.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40b121c000 1 --2- 172.21.15.173:0/1674524904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5614216f2f60 0x5614216f3340 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40b121c000 1 --2- 172.21.15.173:0/1674524904 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56142170eb20 0x5614216f2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40b121c000 1 --2- 172.21.15.173:0/1674524904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56142170e200 0x56142170e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40b121c000 1 -- 172.21.15.173:0/1674524904 >> 172.21.15.173:0/1674524904 conn(0x5614216bb4f0 msgr2=0x5614216caa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40b121c000 1 -- 172.21.15.173:0/1674524904 shutdown_connections 2024-04-25T09:06:22.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40b121c000 1 -- 172.21.15.173:0/1674524904 wait complete. 2024-04-25T09:06:22.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40b121c000 1 -- start start 2024-04-25T09:06:22.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.958+0000 7f40b121c000 1 Processor -- start 2024-04-25T09:06:22.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40b121c000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614216f2f60 0x561421715980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40b121c000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56142170e200 0x561421715ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40b121c000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56142170eb20 0x5614216f3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40b121c000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614214cdd80 con 0x56142170eb20 2024-04-25T09:06:22.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40b121c000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56142150f2b0 con 0x5614216f2f60 2024-04-25T09:06:22.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40b121c000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614214d4830 con 0x56142170e200 2024-04-25T09:06:22.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40b121c000 10 client.0 _ll_register_callbacks cb 0x5614215c6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:22.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40a7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56142170eb20 0x5614216f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40a7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56142170eb20 0x5614216f3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46542/0 (socket says 172.21.15.173:46542) 2024-04-25T09:06:22.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40a7400640 1 -- 172.21.15.173:0/68832390 learned_addr learned my addr 172.21.15.173:0/68832390 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:22.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40a6000640 1 --2- 172.21.15.173:0/68832390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56142170e200 0x561421715ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40a6a00640 1 --2- 172.21.15.173:0/68832390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614216f2f60 0x561421715980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40a7400640 1 -- 172.21.15.173:0/68832390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56142170e200 msgr2=0x561421715ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40a7400640 1 --2- 172.21.15.173:0/68832390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56142170e200 0x561421715ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40a7400640 1 -- 172.21.15.173:0/68832390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614216f2f60 msgr2=0x561421715980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40a7400640 1 --2- 172.21.15.173:0/68832390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614216f2f60 0x561421715980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40a7400640 1 -- 172.21.15.173:0/68832390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5614214df130 con 0x56142170eb20 2024-04-25T09:06:22.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40a7400640 1 --2- 172.21.15.173:0/68832390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56142170eb20 0x5614216f3340 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f40a0003e70 tx=0x7f40a0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25ea5a93e2507c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f4094c00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:22.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f4094c00640 1 -- 172.21.15.173:0/68832390 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a00159d0 con 0x56142170eb20 2024-04-25T09:06:22.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f4094c00640 1 -- 172.21.15.173:0/68832390 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f40a0029c70 con 0x56142170eb20 2024-04-25T09:06:22.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40b121c000 1 -- 172.21.15.173:0/68832390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40a001a070 con 0x56142170eb20 2024-04-25T09:06:22.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f4094c00640 1 -- 172.21.15.173:0/68832390 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40a0030050 con 0x56142170eb20 2024-04-25T09:06:22.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40b121c000 10 client.6351 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:22.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40b121c000 1 -- 172.21.15.173:0/68832390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x561421594490 con 0x56142170eb20 2024-04-25T09:06:22.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f4094c00640 1 -- 172.21.15.173:0/68832390 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a001a070 con 0x56142170eb20 2024-04-25T09:06:22.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f4094c00640 1 -- 172.21.15.173:0/68832390 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f40a0033020 con 0x56142170eb20 2024-04-25T09:06:22.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40b121c000 10 client.6351 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:22.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40b121c000 10 client.6351 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:22.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40b121c000 20 client.6351 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:22.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40b121c000 1 --2- 172.21.15.173:0/68832390 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5614216f40b0 0x5614216f4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40b121c000 4 client.6351 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:22.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40b121c000 1 -- 172.21.15.173:0/68832390 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5614214af020 con 0x5614216f40b0 2024-04-25T09:06:22.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40a6a00640 1 --2- 172.21.15.173:0/68832390 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5614216f40b0 0x5614216f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f4094c00640 10 client.6351 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:22.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40a6a00640 1 --2- 172.21.15.173:0/68832390 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5614216f40b0 0x5614216f4490 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e18a75020be99210 server_cookie=32991d587a477c48 in_seq=0 out_seq=0 2024-04-25T09:06:22.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f4094c00640 1 -- 172.21.15.173:0/68832390 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5614214af020 con 0x5614216f40b0 2024-04-25T09:06:22.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f4094c00640 10 client.6351 handle_command_reply: tid=0 2024-04-25T09:06:22.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.962+0000 7f40b121c000 1 client.6351 shutdown 2024-04-25T09:06:22.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.966+0000 7f40b121c000 1 -- 172.21.15.173:0/68832390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56142170eb20 msgr2=0x5614216f3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.966+0000 7f40b121c000 1 --2- 172.21.15.173:0/68832390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56142170eb20 0x5614216f3340 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f40a0003e70 tx=0x7f40a0004ac0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.966+0000 7f40b121c000 1 -- 172.21.15.173:0/68832390 shutdown_connections 2024-04-25T09:06:22.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.966+0000 7f40b121c000 1 --2- 172.21.15.173:0/68832390 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5614216f40b0 0x5614216f4490 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.966+0000 7f40b121c000 1 --2- 172.21.15.173:0/68832390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56142170eb20 0x5614216f3340 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.966+0000 7f40b121c000 1 --2- 172.21.15.173:0/68832390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56142170e200 0x561421715ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.966+0000 7f40b121c000 1 --2- 172.21.15.173:0/68832390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5614216f2f60 0x561421715980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.966+0000 7f4094c00640 0 client.6351 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:22.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.966+0000 7f40b121c000 1 -- 172.21.15.173:0/68832390 >> 172.21.15.173:0/68832390 conn(0x5614216bb4f0 msgr2=0x5614216c2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.966+0000 7f40b121c000 1 -- 172.21.15.173:0/68832390 shutdown_connections 2024-04-25T09:06:22.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.966+0000 7f40b121c000 1 -- 172.21.15.173:0/68832390 wait complete. 2024-04-25T09:06:22.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.966+0000 7f40b121c000 20 client.6351 trim_cache size 0 max 16384 2024-04-25T09:06:22.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.978+0000 7f40b121c000 1 Processor -- start 2024-04-25T09:06:22.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.978+0000 7f40b121c000 1 -- start start 2024-04-25T09:06:22.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.978+0000 7f40b121c000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5614216f2f60 0x5614216c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.978+0000 7f40b121c000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56142170e200 0x5614216c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.978+0000 7f40b121c000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56142170eb20 0x5614216c9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.978+0000 7f40b121c000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a8203560 con 0x5614216f2f60 2024-04-25T09:06:22.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.978+0000 7f40b121c000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a82026e0 con 0x56142170e200 2024-04-25T09:06:22.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.978+0000 7f40b121c000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a8201ae0 con 0x56142170eb20 2024-04-25T09:06:22.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5614216f2f60 0x5614216c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5614216f2f60 0x5614216c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46552/0 (socket says 172.21.15.173:46552) 2024-04-25T09:06:22.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6a00640 1 -- 172.21.15.173:0/860142361 learned_addr learned my addr 172.21.15.173:0/860142361 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:22.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6000640 1 --2- 172.21.15.173:0/860142361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56142170e200 0x5614216c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a7400640 1 --2- 172.21.15.173:0/860142361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56142170eb20 0x5614216c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6a00640 1 -- 172.21.15.173:0/860142361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56142170eb20 msgr2=0x5614216c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6a00640 1 --2- 172.21.15.173:0/860142361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56142170eb20 0x5614216c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6a00640 1 -- 172.21.15.173:0/860142361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56142170e200 msgr2=0x5614216c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6a00640 1 --2- 172.21.15.173:0/860142361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56142170e200 0x5614216c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6a00640 1 -- 172.21.15.173:0/860142361 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614214d2a30 con 0x5614216f2f60 2024-04-25T09:06:22.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6a00640 1 --2- 172.21.15.173:0/860142361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5614216f2f60 0x5614216c8f00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f40900ac040 tx=0x7f4090009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d632e6ebf70a612 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f4097400640 1 -- 172.21.15.173:0/860142361 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40900aad50 con 0x5614216f2f60 2024-04-25T09:06:22.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f4097400640 1 -- 172.21.15.173:0/860142361 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40900af040 con 0x5614216f2f60 2024-04-25T09:06:22.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f4097400640 1 -- 172.21.15.173:0/860142361 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40900cb550 con 0x5614216f2f60 2024-04-25T09:06:22.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40b121c000 1 -- 172.21.15.173:0/860142361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5614216f2f60 msgr2=0x5614216c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40b121c000 1 --2- 172.21.15.173:0/860142361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5614216f2f60 0x5614216c8f00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f40900ac040 tx=0x7f4090009240 comp rx=0 tx=0).stop 2024-04-25T09:06:22.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40b121c000 1 -- 172.21.15.173:0/860142361 shutdown_connections 2024-04-25T09:06:22.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40b121c000 1 --2- 172.21.15.173:0/860142361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56142170eb20 0x5614216c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40b121c000 1 --2- 172.21.15.173:0/860142361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56142170e200 0x5614216c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40b121c000 1 --2- 172.21.15.173:0/860142361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5614216f2f60 0x5614216c8f00 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40b121c000 1 -- 172.21.15.173:0/860142361 >> 172.21.15.173:0/860142361 conn(0x5614216bb4f0 msgr2=0x5614216f16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40b121c000 1 -- 172.21.15.173:0/860142361 shutdown_connections 2024-04-25T09:06:22.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40b121c000 1 -- 172.21.15.173:0/860142361 wait complete. 2024-04-25T09:06:22.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40b121c000 1 -- start start 2024-04-25T09:06:22.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40b121c000 1 Processor -- start 2024-04-25T09:06:22.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40b121c000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5614216f2f60 0x5614216c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40b121c000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56142170e200 0x5614216c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40b121c000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56142170eb20 0x5614216c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40b121c000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56142149f190 con 0x56142170e200 2024-04-25T09:06:22.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40b121c000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a82020e0 con 0x56142170eb20 2024-04-25T09:06:22.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40b121c000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614215cec00 con 0x5614216f2f60 2024-04-25T09:06:22.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40b121c000 10 client.0 _ll_register_callbacks cb 0x7f40a0009bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:22.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56142170e200 0x5614216c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56142170e200 0x5614216c3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46554/0 (socket says 172.21.15.173:46554) 2024-04-25T09:06:22.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6000640 1 -- 172.21.15.173:0/560382351 learned_addr learned my addr 172.21.15.173:0/560382351 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:22.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6a00640 1 --2- 172.21.15.173:0/560382351 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5614216f2f60 0x5614216c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a7400640 1 --2- 172.21.15.173:0/560382351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56142170eb20 0x5614216c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6000640 1 -- 172.21.15.173:0/560382351 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5614216f2f60 msgr2=0x5614216c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6000640 1 --2- 172.21.15.173:0/560382351 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5614216f2f60 0x5614216c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6000640 1 -- 172.21.15.173:0/560382351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56142170eb20 msgr2=0x5614216c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6000640 1 --2- 172.21.15.173:0/560382351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56142170eb20 0x5614216c44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.982+0000 7f40a6000640 1 -- 172.21.15.173:0/560382351 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5614214db040 con 0x56142170e200 2024-04-25T09:06:22.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40a6000640 1 --2- 172.21.15.173:0/560382351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56142170e200 0x5614216c3fa0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f40980512a0 tx=0x7f4098000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e81cc949d377e25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f4094c00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:22.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f4094c00640 1 -- 172.21.15.173:0/560382351 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098053200 con 0x56142170e200 2024-04-25T09:06:22.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f4094c00640 1 -- 172.21.15.173:0/560382351 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f40980514b0 con 0x56142170e200 2024-04-25T09:06:22.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 1 -- 172.21.15.173:0/560382351 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40900af040 con 0x56142170e200 2024-04-25T09:06:22.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f4094c00640 1 -- 172.21.15.173:0/560382351 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4098054290 con 0x56142170e200 2024-04-25T09:06:22.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 10 client.6357 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:22.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 1 -- 172.21.15.173:0/560382351 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x5614211cf900 con 0x56142170e200 2024-04-25T09:06:22.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f4094c00640 1 -- 172.21.15.173:0/560382351 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40900af040 con 0x56142170e200 2024-04-25T09:06:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f4094c00640 1 -- 172.21.15.173:0/560382351 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4098054430 con 0x56142170e200 2024-04-25T09:06:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 10 client.6357 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 10 client.6357 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 20 client.6357 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 1 --2- 172.21.15.173:0/560382351 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x56142172c040 0x56142172c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 4 client.6357 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-04-25T09:06:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 1 -- 172.21.15.173:0/560382351 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) v1 -- 0x561421520750 con 0x56142172c040 2024-04-25T09:06:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40a6a00640 1 --2- 172.21.15.173:0/560382351 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x56142172c040 0x56142172c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40a6a00640 1 --2- 172.21.15.173:0/560382351 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x56142172c040 0x56142172c420 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d34edf0470ef2e0a server_cookie=64d260af4c4b2f3f in_seq=0 out_seq=0 2024-04-25T09:06:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f4094c00640 10 client.6357 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f4094c00640 1 -- 172.21.15.173:0/560382351 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561421520750 con 0x56142172c040 2024-04-25T09:06:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f4094c00640 10 client.6357 handle_command_reply: tid=0 2024-04-25T09:06:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 1 client.6357 shutdown 2024-04-25T09:06:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 1 -- 172.21.15.173:0/560382351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56142170e200 msgr2=0x5614216c3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 1 --2- 172.21.15.173:0/560382351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56142170e200 0x5614216c3fa0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f40980512a0 tx=0x7f4098000ee0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 1 -- 172.21.15.173:0/560382351 shutdown_connections 2024-04-25T09:06:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 1 --2- 172.21.15.173:0/560382351 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x56142172c040 0x56142172c420 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 1 --2- 172.21.15.173:0/560382351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56142170eb20 0x5614216c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 1 --2- 172.21.15.173:0/560382351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56142170e200 0x5614216c3fa0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f4094c00640 0 client.6357 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:22.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 1 --2- 172.21.15.173:0/560382351 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5614216f2f60 0x5614216c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 1 -- 172.21.15.173:0/560382351 >> 172.21.15.173:0/560382351 conn(0x5614216bb4f0 msgr2=0x5614216c5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 1 -- 172.21.15.173:0/560382351 shutdown_connections 2024-04-25T09:06:22.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 1 -- 172.21.15.173:0/560382351 wait complete. 2024-04-25T09:06:22.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40b121c000 20 client.6357 trim_cache size 0 max 16384 2024-04-25T09:06:22.991 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:22.991 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0, 2024-04-25T09:06:22.991 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_tag": "1258a9ce-b156-47f3-8e5e-c58c5282cfaa", 2024-04-25T09:06:22.991 INFO:teuthology.orchestra.run.smithi173.stdout: "mode": "asynchronous" 2024-04-25T09:06:22.991 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:22.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40ade00640 1 -- 172.21.15.173:0/2699391193 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4084066f60 msgr2=0x7f4084069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40ade00640 1 --2- 172.21.15.173:0/2699391193 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4084066f60 0x7f4084069420 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f40900ae000 tx=0x7f40900a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:22.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40ade00640 1 -- 172.21.15.173:0/2699391193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40a80cd840 msgr2=0x7f40a81526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40ade00640 1 --2- 172.21.15.173:0/2699391193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40a80cd840 0x7f40a81526f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f409800c420 tx=0x7f409800c8e0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40ade00640 1 -- 172.21.15.173:0/2699391193 shutdown_connections 2024-04-25T09:06:22.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40ade00640 1 --2- 172.21.15.173:0/2699391193 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4084066f60 0x7f4084069420 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40ade00640 1 --2- 172.21.15.173:0/2699391193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40a815bab0 0x7f40a8152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40ade00640 1 --2- 172.21.15.173:0/2699391193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40a80cd840 0x7f40a81526f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40ade00640 1 --2- 172.21.15.173:0/2699391193 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40a809a160 0x7f40a806cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40ade00640 1 -- 172.21.15.173:0/2699391193 >> 172.21.15.173:0/2699391193 conn(0x7f40a80b32a0 msgr2=0x7f40a80c6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40ade00640 1 -- 172.21.15.173:0/2699391193 shutdown_connections 2024-04-25T09:06:22.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:22.986+0000 7f40ade00640 1 -- 172.21.15.173:0/2699391193 wait complete. 2024-04-25T09:06:22.994 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '1258a9ce-b156-47f3-8e5e-c58c5282cfaa', 'mode': 'asynchronous'}' 2024-04-25T09:06:22.994 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-04-25T09:06:22.995 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:06:22.995 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-04-25T09:06:23.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.142+0000 7f4102200640 1 Processor -- start 2024-04-25T09:06:23.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.142+0000 7f4102200640 1 -- start start 2024-04-25T09:06:23.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.146+0000 7f4102200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f40fc0b3fe0 0x7f40fc0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.146+0000 7f4102200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40fc0cc260 0x7f40fc0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.146+0000 7f4102200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40fc06d4b0 con 0x7f40fc145290 2024-04-25T09:06:23.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.146+0000 7f4102200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40fc06d790 con 0x7f40fc0b3fe0 2024-04-25T09:06:23.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.146+0000 7f4102200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc06da70 con 0x7f40fc0cc260 2024-04-25T09:06:23.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.146+0000 7f40f2a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f40fc0b3fe0 0x7f40fc0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.146+0000 7f40fb400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f40fc145290 0x7f40fc15c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:51484/0 (socket says 172.21.15.173:51484) 2024-04-25T09:06:23.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.146+0000 7f40fb400640 1 -- 172.21.15.173:0/3478671739 learned_addr learned my addr 172.21.15.173:0/3478671739 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.146+0000 7f40fbe00640 1 --2- 172.21.15.173:0/3478671739 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40fc0cc260 0x7f40fc0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.146+0000 7f40f2a00640 1 -- 172.21.15.173:0/3478671739 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40fc0cc260 msgr2=0x7f40fc0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.146+0000 7f40f2a00640 1 --2- 172.21.15.173:0/3478671739 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40fc0cc260 0x7f40fc0cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.146+0000 7f40f2a00640 1 -- 172.21.15.173:0/3478671739 >> v1:172.21.15.173:6789/0 conn(0x7f40fc145290 legacy=0x7f40fc15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.146+0000 7f40f2a00640 1 -- 172.21.15.173:0/3478671739 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc06dd50 con 0x7f40fc0b3fe0 2024-04-25T09:06:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.146+0000 7f40faa00640 1 -- 172.21.15.173:0/3478671739 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441991289 0 0) 0x7f40fc06d4b0 con 0x7f40fc145290 2024-04-25T09:06:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.150+0000 7f40f2a00640 1 --2- 172.21.15.173:0/3478671739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40fc0b3fe0 0x7f40fc0b4450 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f40e40097c0 tx=0x7f40e401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c27472edcdddbb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.150+0000 7f40faa00640 1 -- 172.21.15.173:0/3478671739 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40b0070 con 0x7f40fc0b3fe0 2024-04-25T09:06:23.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.150+0000 7f40faa00640 1 -- 172.21.15.173:0/3478671739 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e40ab600 con 0x7f40fc0b3fe0 2024-04-25T09:06:23.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.150+0000 7f40faa00640 1 -- 172.21.15.173:0/3478671739 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40ab9d0 con 0x7f40fc0b3fe0 2024-04-25T09:06:23.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.150+0000 7f4102200640 1 -- 172.21.15.173:0/3478671739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40fc0b3fe0 msgr2=0x7f40fc0b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.150+0000 7f4102200640 1 --2- 172.21.15.173:0/3478671739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40fc0b3fe0 0x7f40fc0b4450 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f40e40097c0 tx=0x7f40e401c380 comp rx=0 tx=0).stop 2024-04-25T09:06:23.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.150+0000 7f4102200640 1 -- 172.21.15.173:0/3478671739 shutdown_connections 2024-04-25T09:06:23.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.150+0000 7f4102200640 1 --2- 172.21.15.173:0/3478671739 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40fc0cc260 0x7f40fc0cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.150+0000 7f4102200640 1 --2- 172.21.15.173:0/3478671739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40fc0b3fe0 0x7f40fc0b4450 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.150+0000 7f4102200640 1 -- 172.21.15.173:0/3478671739 >> 172.21.15.173:0/3478671739 conn(0x7f40fc06ac90 msgr2=0x7f40fc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:23.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.150+0000 7f4102200640 1 -- 172.21.15.173:0/3478671739 shutdown_connections 2024-04-25T09:06:23.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.150+0000 7f4102200640 1 -- 172.21.15.173:0/3478671739 wait complete. 2024-04-25T09:06:23.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.150+0000 7f4102200640 1 Processor -- start 2024-04-25T09:06:23.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.150+0000 7f4102200640 1 -- start start 2024-04-25T09:06:23.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f4102200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40fc0b3fe0 0x7f40fc15b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f4102200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40fc0cc260 0x7f40fc0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f4102200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40fc145290 0x7f40fc0ce880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f4102200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc06ed60 con 0x7f40fc145290 2024-04-25T09:06:23.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f4102200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc06eee0 con 0x7f40fc0cc260 2024-04-25T09:06:23.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f4102200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc06f060 con 0x7f40fc0b3fe0 2024-04-25T09:06:23.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f40fbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40fc145290 0x7f40fc0ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f40fbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40fc145290 0x7f40fc0ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46582/0 (socket says 172.21.15.173:46582) 2024-04-25T09:06:23.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f40fbe00640 1 -- 172.21.15.173:0/3536134385 learned_addr learned my addr 172.21.15.173:0/3536134385 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:23.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f40f2a00640 1 --2- 172.21.15.173:0/3536134385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40fc0cc260 0x7f40fc0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f40fb400640 1 --2- 172.21.15.173:0/3536134385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40fc0b3fe0 0x7f40fc15b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f40fbe00640 1 -- 172.21.15.173:0/3536134385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40fc0b3fe0 msgr2=0x7f40fc15b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f40fbe00640 1 --2- 172.21.15.173:0/3536134385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40fc0b3fe0 0x7f40fc15b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f40fbe00640 1 -- 172.21.15.173:0/3536134385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40fc0cc260 msgr2=0x7f40fc0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f40fbe00640 1 --2- 172.21.15.173:0/3536134385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40fc0cc260 0x7f40fc0ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f40fbe00640 1 -- 172.21.15.173:0/3536134385 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc15b970 con 0x7f40fc145290 2024-04-25T09:06:23.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f40fbe00640 1 --2- 172.21.15.173:0/3536134385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40fc145290 0x7f40fc0ce880 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f40f400e7f0 tx=0x7f40f400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f40f3e00640 1 -- 172.21.15.173:0/3536134385 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4017070 con 0x7f40fc145290 2024-04-25T09:06:23.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f40f3e00640 1 -- 172.21.15.173:0/3536134385 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f400c940 con 0x7f40fc145290 2024-04-25T09:06:23.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f40f3e00640 1 -- 172.21.15.173:0/3536134385 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f400eea0 con 0x7f40fc145290 2024-04-25T09:06:23.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f4102200640 1 -- 172.21.15.173:0/3536134385 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40fc143c70 con 0x7f40fc145290 2024-04-25T09:06:23.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f4102200640 1 -- 172.21.15.173:0/3536134385 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40fc144230 con 0x7f40fc145290 2024-04-25T09:06:23.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.154+0000 7f40f3e00640 1 -- 172.21.15.173:0/3536134385 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f40f401a070 con 0x7f40fc145290 2024-04-25T09:06:23.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f40f3e00640 1 --2- 172.21.15.173:0/3536134385 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40d8066f60 0x7f40d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f40f3e00640 1 -- 172.21.15.173:0/3536134385 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f40f40854b0 con 0x7f40fc145290 2024-04-25T09:06:23.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f40fb400640 1 --2- 172.21.15.173:0/3536134385 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40d8066f60 0x7f40d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f4105647000 1 Processor -- start 2024-04-25T09:06:23.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f4105647000 1 -- start start 2024-04-25T09:06:23.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f40fb400640 1 --2- 172.21.15.173:0/3536134385 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40d8066f60 0x7f40d8069420 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f40ec005fd0 tx=0x7f40ec005b80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f4105647000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5574999d5000 0x5574999d53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f4105647000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5920 0x55749998aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f4105647000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55749998b410 0x55749998b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f4105647000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574997d8f40 con 0x5574999d5920 2024-04-25T09:06:23.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f4105647000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x557499760fc0 con 0x55749998b410 2024-04-25T09:06:23.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f4105647000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574997d4fe0 con 0x5574999d5000 2024-04-25T09:06:23.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f40f2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5920 0x55749998aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f40f2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5920 0x55749998aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46586/0 (socket says 172.21.15.173:46586) 2024-04-25T09:06:23.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f40f2a00640 1 -- 172.21.15.173:0/1313720905 learned_addr learned my addr 172.21.15.173:0/1313720905 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:23.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f40fb400640 1 --2- 172.21.15.173:0/1313720905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5574999d5000 0x5574999d53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f40fbe00640 1 --2- 172.21.15.173:0/1313720905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55749998b410 0x55749998b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f40f2a00640 1 -- 172.21.15.173:0/1313720905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5574999d5000 msgr2=0x5574999d53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f40f2a00640 1 --2- 172.21.15.173:0/1313720905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5574999d5000 0x5574999d53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f40f2a00640 1 -- 172.21.15.173:0/1313720905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55749998b410 msgr2=0x55749998b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f40f2a00640 1 --2- 172.21.15.173:0/1313720905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55749998b410 0x55749998b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f40f2a00640 1 -- 172.21.15.173:0/1313720905 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557499820a50 con 0x5574999d5920 2024-04-25T09:06:23.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f40f2a00640 1 --2- 172.21.15.173:0/1313720905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5920 0x55749998aed0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f40e40097c0 tx=0x7f40e40a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f3957111e3667a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f40ebe00640 1 -- 172.21.15.173:0/1313720905 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40bc070 con 0x5574999d5920 2024-04-25T09:06:23.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f40ebe00640 1 -- 172.21.15.173:0/1313720905 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e40ab740 con 0x5574999d5920 2024-04-25T09:06:23.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.158+0000 7f40ebe00640 1 -- 172.21.15.173:0/1313720905 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40b0040 con 0x5574999d5920 2024-04-25T09:06:23.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 -- 172.21.15.173:0/1313720905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5920 msgr2=0x55749998aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 --2- 172.21.15.173:0/1313720905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5920 0x55749998aed0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f40e40097c0 tx=0x7f40e40a6000 comp rx=0 tx=0).stop 2024-04-25T09:06:23.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 -- 172.21.15.173:0/1313720905 shutdown_connections 2024-04-25T09:06:23.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 --2- 172.21.15.173:0/1313720905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55749998b410 0x55749998b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 --2- 172.21.15.173:0/1313720905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5920 0x55749998aed0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 --2- 172.21.15.173:0/1313720905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5574999d5000 0x5574999d53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 -- 172.21.15.173:0/1313720905 >> 172.21.15.173:0/1313720905 conn(0x5574999873c0 msgr2=0x5574999897b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:23.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 -- 172.21.15.173:0/1313720905 shutdown_connections 2024-04-25T09:06:23.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 -- 172.21.15.173:0/1313720905 wait complete. 2024-04-25T09:06:23.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 -- start start 2024-04-25T09:06:23.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 Processor -- start 2024-04-25T09:06:23.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55749998b410 0x557499996e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5574999d5000 0x557499997340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5920 0x557499997880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574997dd570 con 0x5574999d5920 2024-04-25T09:06:23.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574997935f0 con 0x5574999d5000 2024-04-25T09:06:23.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55749978dd60 con 0x55749998b410 2024-04-25T09:06:23.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 10 client.0 _ll_register_callbacks cb 0x55749988d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:23.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f40fbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5920 0x557499997880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f40fbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5920 0x557499997880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46588/0 (socket says 172.21.15.173:46588) 2024-04-25T09:06:23.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f40fbe00640 1 -- 172.21.15.173:0/2401748138 learned_addr learned my addr 172.21.15.173:0/2401748138 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:23.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f40fbe00640 1 -- 172.21.15.173:0/2401748138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55749998b410 msgr2=0x557499996e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f40fbe00640 1 --2- 172.21.15.173:0/2401748138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55749998b410 0x557499996e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f40fbe00640 1 -- 172.21.15.173:0/2401748138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5574999d5000 msgr2=0x557499997340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f40fbe00640 1 --2- 172.21.15.173:0/2401748138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5574999d5000 0x557499997340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f40fbe00640 1 -- 172.21.15.173:0/2401748138 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557499761210 con 0x5574999d5920 2024-04-25T09:06:23.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f40fbe00640 1 --2- 172.21.15.173:0/2401748138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5920 0x557499997880 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f40f40837b0 tx=0x7f40f4056400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9589fab4d6b712 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f40e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:23.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f40e8c00640 1 -- 172.21.15.173:0/2401748138 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f406d070 con 0x5574999d5920 2024-04-25T09:06:23.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f40e8c00640 1 -- 172.21.15.173:0/2401748138 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f40f40850b0 con 0x5574999d5920 2024-04-25T09:06:23.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 -- 172.21.15.173:0/2401748138 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40e40ab740 con 0x5574999d5920 2024-04-25T09:06:23.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f40e8c00640 1 -- 172.21.15.173:0/2401748138 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40f4021040 con 0x5574999d5920 2024-04-25T09:06:23.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 10 client.6372 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:23.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 -- 172.21.15.173:0/2401748138 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55749985d400 con 0x5574999d5920 2024-04-25T09:06:23.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f40e8c00640 1 -- 172.21.15.173:0/2401748138 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e40ab740 con 0x5574999d5920 2024-04-25T09:06:23.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f40e8c00640 1 -- 172.21.15.173:0/2401748138 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f40f4069b50 con 0x5574999d5920 2024-04-25T09:06:23.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 10 client.6372 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:23.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 10 client.6372 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:23.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 20 client.6372 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:23.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 --2- 172.21.15.173:0/2401748138 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x557499998290 0x5574999e72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 4 client.6372 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:23.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.162+0000 7f4105647000 1 -- 172.21.15.173:0/2401748138 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557499774c90 con 0x557499998290 2024-04-25T09:06:23.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.166+0000 7f40fb400640 1 --2- 172.21.15.173:0/2401748138 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x557499998290 0x5574999e72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.166+0000 7f40fb400640 1 --2- 172.21.15.173:0/2401748138 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x557499998290 0x5574999e72c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a108785b620c0dac server_cookie=4a5c2de4aa22846c in_seq=0 out_seq=0 2024-04-25T09:06:23.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.166+0000 7f40e8c00640 10 client.6372 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:23.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.166+0000 7f40e8c00640 1 -- 172.21.15.173:0/2401748138 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557499774c90 con 0x557499998290 2024-04-25T09:06:23.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.166+0000 7f40e8c00640 10 client.6372 handle_command_reply: tid=0 2024-04-25T09:06:23.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.166+0000 7f4105647000 1 client.6372 shutdown 2024-04-25T09:06:23.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.166+0000 7f4105647000 1 -- 172.21.15.173:0/2401748138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5920 msgr2=0x557499997880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.166+0000 7f4105647000 1 --2- 172.21.15.173:0/2401748138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5920 0x557499997880 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f40f40837b0 tx=0x7f40f4056400 comp rx=0 tx=0).stop 2024-04-25T09:06:23.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.166+0000 7f4105647000 1 -- 172.21.15.173:0/2401748138 shutdown_connections 2024-04-25T09:06:23.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.166+0000 7f4105647000 1 --2- 172.21.15.173:0/2401748138 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x557499998290 0x5574999e72c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.166+0000 7f4105647000 1 --2- 172.21.15.173:0/2401748138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5920 0x557499997880 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.166+0000 7f4105647000 1 --2- 172.21.15.173:0/2401748138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5574999d5000 0x557499997340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.166+0000 7f4105647000 1 --2- 172.21.15.173:0/2401748138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55749998b410 0x557499996e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.166+0000 7f40e8c00640 0 client.6372 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:23.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.166+0000 7f4105647000 1 -- 172.21.15.173:0/2401748138 >> 172.21.15.173:0/2401748138 conn(0x5574999873c0 msgr2=0x55749998a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:23.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.166+0000 7f4105647000 1 -- 172.21.15.173:0/2401748138 shutdown_connections 2024-04-25T09:06:23.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.166+0000 7f4105647000 1 -- 172.21.15.173:0/2401748138 wait complete. 2024-04-25T09:06:23.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.166+0000 7f4105647000 20 client.6372 trim_cache size 0 max 16384 2024-04-25T09:06:23.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f4105647000 1 Processor -- start 2024-04-25T09:06:23.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f4105647000 1 -- start start 2024-04-25T09:06:23.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f4105647000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55749998b410 0x55749998a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f4105647000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5000 0x55749998ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f4105647000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5574999d5920 0x5574999e72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f4105647000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc203210 con 0x5574999d5000 2024-04-25T09:06:23.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f4105647000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc2023e0 con 0x55749998b410 2024-04-25T09:06:23.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f4105647000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc13fda0 con 0x5574999d5920 2024-04-25T09:06:23.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f40f2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5000 0x55749998ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f40f2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5000 0x55749998ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46598/0 (socket says 172.21.15.173:46598) 2024-04-25T09:06:23.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f40f2a00640 1 -- 172.21.15.173:0/763589076 learned_addr learned my addr 172.21.15.173:0/763589076 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:23.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f40fb400640 1 --2- 172.21.15.173:0/763589076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55749998b410 0x55749998a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f40fbe00640 1 --2- 172.21.15.173:0/763589076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5574999d5920 0x5574999e72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f40f2a00640 1 -- 172.21.15.173:0/763589076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5574999d5920 msgr2=0x5574999e72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f40f2a00640 1 --2- 172.21.15.173:0/763589076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5574999d5920 0x5574999e72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f40f2a00640 1 -- 172.21.15.173:0/763589076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55749998b410 msgr2=0x55749998a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f40f2a00640 1 --2- 172.21.15.173:0/763589076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55749998b410 0x55749998a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f40f2a00640 1 -- 172.21.15.173:0/763589076 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557499833c10 con 0x5574999d5000 2024-04-25T09:06:23.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f40f2a00640 1 --2- 172.21.15.173:0/763589076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5000 0x55749998ad00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f40e4006cf0 tx=0x7f40e4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b84ae443989864f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f40eb400640 1 -- 172.21.15.173:0/763589076 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40bc070 con 0x5574999d5000 2024-04-25T09:06:23.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f40eb400640 1 -- 172.21.15.173:0/763589076 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e40ab930 con 0x5574999d5000 2024-04-25T09:06:23.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f40eb400640 1 -- 172.21.15.173:0/763589076 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40b0040 con 0x5574999d5000 2024-04-25T09:06:23.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f4105647000 1 -- 172.21.15.173:0/763589076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5000 msgr2=0x55749998ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f4105647000 1 --2- 172.21.15.173:0/763589076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5000 0x55749998ad00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f40e4006cf0 tx=0x7f40e4004740 comp rx=0 tx=0).stop 2024-04-25T09:06:23.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f4105647000 1 -- 172.21.15.173:0/763589076 shutdown_connections 2024-04-25T09:06:23.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f4105647000 1 --2- 172.21.15.173:0/763589076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5574999d5920 0x5574999e72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f4105647000 1 --2- 172.21.15.173:0/763589076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574999d5000 0x55749998ad00 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f4105647000 1 --2- 172.21.15.173:0/763589076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55749998b410 0x55749998a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f4105647000 1 -- 172.21.15.173:0/763589076 >> 172.21.15.173:0/763589076 conn(0x5574999873c0 msgr2=0x557499996ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:23.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f4105647000 1 -- 172.21.15.173:0/763589076 shutdown_connections 2024-04-25T09:06:23.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.182+0000 7f4105647000 1 -- 172.21.15.173:0/763589076 wait complete. 2024-04-25T09:06:23.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f4105647000 1 -- start start 2024-04-25T09:06:23.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f4105647000 1 Processor -- start 2024-04-25T09:06:23.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f4105647000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55749998b410 0x557499a35ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f4105647000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5574999d5000 0x557499a36020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f4105647000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5574999d5920 0x5574999f0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f4105647000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749985cf70 con 0x55749998b410 2024-04-25T09:06:23.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f4105647000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc1403a0 con 0x5574999d5920 2024-04-25T09:06:23.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f4105647000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574997950a0 con 0x5574999d5000 2024-04-25T09:06:23.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f4105647000 10 client.0 _ll_register_callbacks cb 0x55749982b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:23.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f40fb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55749998b410 0x557499a35ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f40fb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55749998b410 0x557499a35ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46612/0 (socket says 172.21.15.173:46612) 2024-04-25T09:06:23.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f40fb400640 1 -- 172.21.15.173:0/1135528681 learned_addr learned my addr 172.21.15.173:0/1135528681 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:23.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f40f2a00640 1 --2- 172.21.15.173:0/1135528681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5574999d5000 0x557499a36020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f40fb400640 1 -- 172.21.15.173:0/1135528681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5574999d5000 msgr2=0x557499a36020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f40fb400640 1 --2- 172.21.15.173:0/1135528681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5574999d5000 0x557499a36020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f40fbe00640 1 --2- 172.21.15.173:0/1135528681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5574999d5920 0x5574999f0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f40fb400640 1 -- 172.21.15.173:0/1135528681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5574999d5920 msgr2=0x5574999f0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f40fb400640 1 --2- 172.21.15.173:0/1135528681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5574999d5920 0x5574999f0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f40fb400640 1 -- 172.21.15.173:0/1135528681 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55749976dbb0 con 0x55749998b410 2024-04-25T09:06:23.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f40fb400640 1 --2- 172.21.15.173:0/1135528681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55749998b410 0x557499a35ae0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x55749970da00 tx=0x7f40ec001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9b6a29e043a2f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f40e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:23.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f40e8c00640 1 -- 172.21.15.173:0/1135528681 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec013870 con 0x55749998b410 2024-04-25T09:06:23.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f4105647000 1 -- 172.21.15.173:0/1135528681 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40e40ab930 con 0x55749998b410 2024-04-25T09:06:23.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f40e8c00640 1 -- 172.21.15.173:0/1135528681 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f40ec010040 con 0x55749998b410 2024-04-25T09:06:23.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f40e8c00640 1 -- 172.21.15.173:0/1135528681 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40ec035050 con 0x55749998b410 2024-04-25T09:06:23.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f4105647000 10 client.6378 fetch_fsmap learned FSMap version 26 2024-04-25T09:06:23.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f4105647000 1 -- 172.21.15.173:0/1135528681 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x557499780030 con 0x55749998b410 2024-04-25T09:06:23.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f40e8c00640 1 -- 172.21.15.173:0/1135528681 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e40ab930 con 0x55749998b410 2024-04-25T09:06:23.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f40e8c00640 1 -- 172.21.15.173:0/1135528681 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f40ec038020 con 0x55749998b410 2024-04-25T09:06:23.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f4105647000 10 client.6378 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T09:06:23.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f4105647000 10 client.6378 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:23.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f4105647000 20 client.6378 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:23.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f4105647000 1 --2- 172.21.15.173:0/1135528681 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5574999f1ad0 0x5574999f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f4105647000 4 client.6378 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-04-25T09:06:23.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f4105647000 1 -- 172.21.15.173:0/1135528681 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) v1 -- 0x5574997e6480 con 0x5574999f1ad0 2024-04-25T09:06:23.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.186+0000 7f40f2a00640 1 --2- 172.21.15.173:0/1135528681 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5574999f1ad0 0x5574999f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f40e8c00640 10 client.6378 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:23.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f40f2a00640 1 --2- 172.21.15.173:0/1135528681 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5574999f1ad0 0x5574999f1ee0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b717fb643295e18d server_cookie=525b6ed21824d9c7 in_seq=0 out_seq=0 2024-04-25T09:06:23.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f40e8c00640 1 -- 172.21.15.173:0/1135528681 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5574997e6480 con 0x5574999f1ad0 2024-04-25T09:06:23.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f40e8c00640 10 client.6378 handle_command_reply: tid=0 2024-04-25T09:06:23.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4105647000 1 client.6378 shutdown 2024-04-25T09:06:23.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4105647000 1 -- 172.21.15.173:0/1135528681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55749998b410 msgr2=0x557499a35ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4105647000 1 --2- 172.21.15.173:0/1135528681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55749998b410 0x557499a35ae0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x55749970da00 tx=0x7f40ec001260 comp rx=0 tx=0).stop 2024-04-25T09:06:23.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4105647000 1 -- 172.21.15.173:0/1135528681 shutdown_connections 2024-04-25T09:06:23.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4105647000 1 --2- 172.21.15.173:0/1135528681 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x5574999f1ad0 0x5574999f1ee0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4105647000 1 --2- 172.21.15.173:0/1135528681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5574999d5920 0x5574999f0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4105647000 1 --2- 172.21.15.173:0/1135528681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5574999d5000 0x557499a36020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4105647000 1 --2- 172.21.15.173:0/1135528681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55749998b410 0x557499a35ae0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f40e8c00640 0 client.6378 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:23.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4105647000 1 -- 172.21.15.173:0/1135528681 >> 172.21.15.173:0/1135528681 conn(0x5574999873c0 msgr2=0x557499997600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:23.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4105647000 1 -- 172.21.15.173:0/1135528681 shutdown_connections 2024-04-25T09:06:23.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4105647000 1 -- 172.21.15.173:0/1135528681 wait complete. 2024-04-25T09:06:23.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4105647000 20 client.6378 trim_cache size 0 max 16384 2024-04-25T09:06:23.181 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:23.182 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0, 2024-04-25T09:06:23.182 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_tag": "979c6597-0312-40b7-b740-08eb3b932754", 2024-04-25T09:06:23.182 INFO:teuthology.orchestra.run.smithi173.stdout: "mode": "asynchronous" 2024-04-25T09:06:23.182 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:23.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4102200640 1 -- 172.21.15.173:0/3536134385 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40d8066f60 msgr2=0x7f40d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4102200640 1 --2- 172.21.15.173:0/3536134385 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40d8066f60 0x7f40d8069420 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f40ec005fd0 tx=0x7f40ec005b80 comp rx=0 tx=0).stop 2024-04-25T09:06:23.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4102200640 1 -- 172.21.15.173:0/3536134385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40fc145290 msgr2=0x7f40fc0ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4102200640 1 --2- 172.21.15.173:0/3536134385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40fc145290 0x7f40fc0ce880 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f40f400e7f0 tx=0x7f40f400ecb0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4102200640 1 -- 172.21.15.173:0/3536134385 shutdown_connections 2024-04-25T09:06:23.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4102200640 1 --2- 172.21.15.173:0/3536134385 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40d8066f60 0x7f40d8069420 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4102200640 1 --2- 172.21.15.173:0/3536134385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40fc145290 0x7f40fc0ce880 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4102200640 1 --2- 172.21.15.173:0/3536134385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40fc0cc260 0x7f40fc0ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4102200640 1 --2- 172.21.15.173:0/3536134385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40fc0b3fe0 0x7f40fc15b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4102200640 1 -- 172.21.15.173:0/3536134385 >> 172.21.15.173:0/3536134385 conn(0x7f40fc06ac90 msgr2=0x7f40fc0b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:23.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4102200640 1 -- 172.21.15.173:0/3536134385 shutdown_connections 2024-04-25T09:06:23.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.190+0000 7f4102200640 1 -- 172.21.15.173:0/3536134385 wait complete. 2024-04-25T09:06:23.197 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': '979c6597-0312-40b7-b740-08eb3b932754', 'mode': 'asynchronous'}' 2024-04-25T09:06:23.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:23.198 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_1) 2024-04-25T09:06:23.208 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' 2024-04-25T09:06:23.208 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:23.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.394+0000 7f4192800640 1 Processor -- start 2024-04-25T09:06:23.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.394+0000 7f4192800640 1 -- start start 2024-04-25T09:06:23.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.394+0000 7f4192800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f418c160fe0 0x7f418c161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.394+0000 7f4192800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f418c06dac0 0x7f418c0ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.394+0000 7f4192800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f418c06bca0 0x7f418c06c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.394+0000 7f4192800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418c06c640 con 0x7f418c06bca0 2024-04-25T09:06:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.394+0000 7f4192800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418c1613c0 con 0x7f418c160fe0 2024-04-25T09:06:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.394+0000 7f4192800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418c061d60 con 0x7f418c06dac0 2024-04-25T09:06:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.394+0000 7f418be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f418c06bca0 0x7f418c06c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.394+0000 7f418be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f418c06bca0 0x7f418c06c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38210/0 (socket says 172.21.15.173:38210) 2024-04-25T09:06:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.394+0000 7f418be00640 1 -- 172.21.15.173:0/4244660856 learned_addr learned my addr 172.21.15.173:0/4244660856 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.394+0000 7f4182a00640 1 --2- 172.21.15.173:0/4244660856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f418c06dac0 0x7f418c0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.394+0000 7f418b400640 1 --2- 172.21.15.173:0/4244660856 >> v2:172.21.15.194:3300/0 conn(0x7f418c160fe0 0x7f418c161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.394+0000 7f418be00640 1 -- 172.21.15.173:0/4244660856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f418c06dac0 msgr2=0x7f418c0ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.394+0000 7f418be00640 1 --2- 172.21.15.173:0/4244660856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f418c06dac0 0x7f418c0ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.394+0000 7f418be00640 1 -- 172.21.15.173:0/4244660856 >> v2:172.21.15.194:3300/0 conn(0x7f418c160fe0 msgr2=0x7f418c161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.394+0000 7f418be00640 1 --2- 172.21.15.173:0/4244660856 >> v2:172.21.15.194:3300/0 conn(0x7f418c160fe0 0x7f418c161fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.394+0000 7f418be00640 1 -- 172.21.15.173:0/4244660856 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c06dfa0 con 0x7f418c06bca0 2024-04-25T09:06:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.398+0000 7f418b400640 1 --2- 172.21.15.173:0/4244660856 >> v2:172.21.15.194:3300/0 conn(0x7f418c160fe0 0x7f418c161fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:23.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.398+0000 7f418be00640 1 --2- 172.21.15.173:0/4244660856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c06bca0 0x7f418c06c100 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f418c071070 tx=0x7f418401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52de142398ba04b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.398+0000 7f418aa00640 1 -- 172.21.15.173:0/4244660856 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41840ab620 con 0x7f418c06bca0 2024-04-25T09:06:23.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.398+0000 7f418aa00640 1 -- 172.21.15.173:0/4244660856 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41840b0070 con 0x7f418c06bca0 2024-04-25T09:06:23.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.398+0000 7f418aa00640 1 -- 172.21.15.173:0/4244660856 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41840ab9e0 con 0x7f418c06bca0 2024-04-25T09:06:23.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.398+0000 7f4192800640 1 -- 172.21.15.173:0/4244660856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c06bca0 msgr2=0x7f418c06c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.398+0000 7f4192800640 1 --2- 172.21.15.173:0/4244660856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c06bca0 0x7f418c06c100 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f418c071070 tx=0x7f418401c460 comp rx=0 tx=0).stop 2024-04-25T09:06:23.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.398+0000 7f4192800640 1 -- 172.21.15.173:0/4244660856 shutdown_connections 2024-04-25T09:06:23.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.398+0000 7f4192800640 1 --2- 172.21.15.173:0/4244660856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c06bca0 0x7f418c06c100 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.398+0000 7f4192800640 1 --2- 172.21.15.173:0/4244660856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f418c06dac0 0x7f418c0ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.398+0000 7f4192800640 1 --2- 172.21.15.173:0/4244660856 >> v2:172.21.15.194:3300/0 conn(0x7f418c160fe0 0x7f418c161fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.398+0000 7f4192800640 1 -- 172.21.15.173:0/4244660856 >> 172.21.15.173:0/4244660856 conn(0x7f418c071c20 msgr2=0x7f418c072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:23.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.398+0000 7f4192800640 1 -- 172.21.15.173:0/4244660856 shutdown_connections 2024-04-25T09:06:23.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.398+0000 7f4192800640 1 -- 172.21.15.173:0/4244660856 wait complete. 2024-04-25T09:06:23.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f4192800640 1 Processor -- start 2024-04-25T09:06:23.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f4192800640 1 -- start start 2024-04-25T09:06:23.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f4192800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c06bca0 0x7f418c1f9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f4192800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f418c06dac0 0x7f418c0ad640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f4192800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f418c160fe0 0x7f418c0adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f4192800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c1624f0 con 0x7f418c06bca0 2024-04-25T09:06:23.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f4192800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c06eb20 con 0x7f418c06dac0 2024-04-25T09:06:23.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f4192800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0ad340 con 0x7f418c160fe0 2024-04-25T09:06:23.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f418b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c06bca0 0x7f418c1f9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f418b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c06bca0 0x7f418c1f9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38220/0 (socket says 172.21.15.173:38220) 2024-04-25T09:06:23.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f418b400640 1 -- 172.21.15.173:0/896119763 learned_addr learned my addr 172.21.15.173:0/896119763 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:23.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f418be00640 1 --2- 172.21.15.173:0/896119763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f418c160fe0 0x7f418c0adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f4182a00640 1 --2- 172.21.15.173:0/896119763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f418c06dac0 0x7f418c0ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f418b400640 1 -- 172.21.15.173:0/896119763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f418c160fe0 msgr2=0x7f418c0adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f418b400640 1 --2- 172.21.15.173:0/896119763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f418c160fe0 0x7f418c0adb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f418b400640 1 -- 172.21.15.173:0/896119763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f418c06dac0 msgr2=0x7f418c0ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f418b400640 1 --2- 172.21.15.173:0/896119763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f418c06dac0 0x7f418c0ad640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f418b400640 1 -- 172.21.15.173:0/896119763 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c15ca80 con 0x7f418c06bca0 2024-04-25T09:06:23.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f418be00640 1 --2- 172.21.15.173:0/896119763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f418c160fe0 0x7f418c0adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:23.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f418b400640 1 --2- 172.21.15.173:0/896119763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c06bca0 0x7f418c1f9c90 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f417c009fa0 tx=0x7f417c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f4183e00640 1 -- 172.21.15.173:0/896119763 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c01a070 con 0x7f418c06bca0 2024-04-25T09:06:23.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f4183e00640 1 -- 172.21.15.173:0/896119763 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417c003bc0 con 0x7f418c06bca0 2024-04-25T09:06:23.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f4192800640 1 -- 172.21.15.173:0/896119763 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418c15ff00 con 0x7f418c06bca0 2024-04-25T09:06:23.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f4183e00640 1 -- 172.21.15.173:0/896119763 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c004030 con 0x7f418c06bca0 2024-04-25T09:06:23.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.402+0000 7f4192800640 1 -- 172.21.15.173:0/896119763 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418c1604c0 con 0x7f418c06bca0 2024-04-25T09:06:23.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.406+0000 7f4192800640 1 -- 172.21.15.173:0/896119763 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418c073a40 con 0x7f418c06bca0 2024-04-25T09:06:23.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.406+0000 7f4183e00640 1 -- 172.21.15.173:0/896119763 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f417c01d070 con 0x7f418c06bca0 2024-04-25T09:06:23.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.406+0000 7f4183e00640 1 --2- 172.21.15.173:0/896119763 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4168066f60 0x7f4168069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.406+0000 7f4183e00640 1 -- 172.21.15.173:0/896119763 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f417c085270 con 0x7f418c06bca0 2024-04-25T09:06:23.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.406+0000 7f4182a00640 1 --2- 172.21.15.173:0/896119763 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4168066f60 0x7f4168069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.406+0000 7f4182a00640 1 --2- 172.21.15.173:0/896119763 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4168066f60 0x7f4168069420 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f418c1465e0 tx=0x7f4174008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.410+0000 7f4183e00640 1 -- 172.21.15.173:0/896119763 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f417c010070 con 0x7f418c06bca0 2024-04-25T09:06:23.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.598+0000 7f4192800640 1 -- 172.21.15.173:0/896119763 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f418c0cf6c0 con 0x7f418c06bca0 2024-04-25T09:06:23.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.598+0000 7f4183e00640 1 -- 172.21.15.173:0/896119763 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f417c055aa0 con 0x7f418c06bca0 2024-04-25T09:06:23.585 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:23.586 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:05:57.598642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:23.586 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 26 2024-04-25T09:06:23.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.598+0000 7f4192800640 1 -- 172.21.15.173:0/896119763 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4168066f60 msgr2=0x7f4168069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.598+0000 7f4192800640 1 --2- 172.21.15.173:0/896119763 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4168066f60 0x7f4168069420 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f418c1465e0 tx=0x7f4174008040 comp rx=0 tx=0).stop 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.598+0000 7f4192800640 1 -- 172.21.15.173:0/896119763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c06bca0 msgr2=0x7f418c1f9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.598+0000 7f4192800640 1 --2- 172.21.15.173:0/896119763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c06bca0 0x7f418c1f9c90 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f417c009fa0 tx=0x7f417c00d560 comp rx=0 tx=0).stop 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.598+0000 7f4192800640 1 -- 172.21.15.173:0/896119763 shutdown_connections 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.598+0000 7f4192800640 1 --2- 172.21.15.173:0/896119763 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4168066f60 0x7f4168069420 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.598+0000 7f4192800640 1 --2- 172.21.15.173:0/896119763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f418c160fe0 0x7f418c0adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.598+0000 7f4192800640 1 --2- 172.21.15.173:0/896119763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f418c06dac0 0x7f418c0ad640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.598+0000 7f4192800640 1 --2- 172.21.15.173:0/896119763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c06bca0 0x7f418c1f9c90 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.598+0000 7f4192800640 1 -- 172.21.15.173:0/896119763 >> 172.21.15.173:0/896119763 conn(0x7f418c071c20 msgr2=0x7f418c0aeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.598+0000 7f4192800640 1 -- 172.21.15.173:0/896119763 shutdown_connections 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:23.598+0000 7f4192800640 1 -- 172.21.15.173:0/896119763 wait complete. 2024-04-25T09:06:23.602 INFO:tasks.ceph.mon.a.smithi173.stderr:2024-04-25T09:06:23.610+0000 7f537f000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T09:06:23.608 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path /scrub_test_path/ceph-qa-suite/new_dir_1 2024-04-25T09:06:23.752 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:23.752 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0 2024-04-25T09:06:23.752 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:23.768 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T09:06:23.768 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:06:23.768 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:23.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:23.777 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1 bs=1M conv=fdatasync count=1 seek=0) 2024-04-25T09:06:23.846 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:06:23.846 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:06:23.846 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167044 s, 62.8 MB/s 2024-04-25T09:06:23.847 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' 2024-04-25T09:06:23.847 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:24.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.034+0000 7f3220e00640 1 Processor -- start 2024-04-25T09:06:24.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.034+0000 7f3220e00640 1 -- start start 2024-04-25T09:06:24.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.034+0000 7f3220e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f321c0b3e70 0x7f321c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.034+0000 7f3220e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321c0b3590 con 0x7f321c15edd0 2024-04-25T09:06:24.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.034+0000 7f3220e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321c0b4790 con 0x7f321c0aefa0 2024-04-25T09:06:24.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.034+0000 7f3220e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321c06dd50 con 0x7f321c0b3e70 2024-04-25T09:06:24.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f321a800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f321c15edd0 0x7f321c0b2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49528/0 (socket says 172.21.15.173:49528) 2024-04-25T09:06:24.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f321a800640 1 -- 172.21.15.173:0/689848620 learned_addr learned my addr 172.21.15.173:0/689848620 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:24.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219e00640 1 --2- 172.21.15.173:0/689848620 >> v2:172.21.15.194:3300/0 conn(0x7f321c0b3e70 0x7f321c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219400640 1 -- 172.21.15.173:0/689848620 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357101645 0 0) 0x7f321c0b3590 con 0x7f321c15edd0 2024-04-25T09:06:24.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219400640 1 -- 172.21.15.173:0/689848620 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3200003530 con 0x7f321c15edd0 2024-04-25T09:06:24.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219400640 1 -- 172.21.15.173:0/689848620 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2866560740 0 0) 0x7f3200003530 con 0x7f321c15edd0 2024-04-25T09:06:24.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219400640 1 -- 172.21.15.173:0/689848620 >> v2:172.21.15.194:3300/0 conn(0x7f321c0b3e70 msgr2=0x7f321c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219400640 1 --2- 172.21.15.173:0/689848620 >> v2:172.21.15.194:3300/0 conn(0x7f321c0b3e70 0x7f321c0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219400640 1 -- 172.21.15.173:0/689848620 >> v1:172.21.15.194:6789/0 conn(0x7f321c0aefa0 legacy=0x7f321c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219400640 1 -- 172.21.15.173:0/689848620 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321c15f320 con 0x7f321c15edd0 2024-04-25T09:06:24.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219400640 1 -- 172.21.15.173:0/689848620 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f3214001680 con 0x7f321c15edd0 2024-04-25T09:06:24.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219400640 1 -- 172.21.15.173:0/689848620 >> v1:172.21.15.173:6789/0 conn(0x7f321c15edd0 legacy=0x7f321c0b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219400640 1 --2- 172.21.15.173:0/689848620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32000039c0 0x7f3200003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219400640 1 --2- 172.21.15.173:0/689848620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3200004810 0x7f3200004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219400640 1 --2- 172.21.15.173:0/689848620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32000051d0 0x7f320000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219400640 1 -- 172.21.15.173:0/689848620 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c06dd50 con 0x7f32000039c0 2024-04-25T09:06:24.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219400640 1 -- 172.21.15.173:0/689848620 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320000c070 con 0x7f3200004810 2024-04-25T09:06:24.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219400640 1 -- 172.21.15.173:0/689848620 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320000c270 con 0x7f32000051d0 2024-04-25T09:06:24.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219e00640 1 --2- 172.21.15.173:0/689848620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32000039c0 0x7f3200003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3211400640 1 --2- 172.21.15.173:0/689848620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3200004810 0x7f3200004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f321a800640 1 --2- 172.21.15.173:0/689848620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32000051d0 0x7f320000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219e00640 1 -- 172.21.15.173:0/689848620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32000051d0 msgr2=0x7f320000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219e00640 1 --2- 172.21.15.173:0/689848620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32000051d0 0x7f320000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219e00640 1 -- 172.21.15.173:0/689848620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3200004810 msgr2=0x7f3200004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219e00640 1 --2- 172.21.15.173:0/689848620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3200004810 0x7f3200004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f3219e00640 1 -- 172.21.15.173:0/689848620 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3200003530 con 0x7f32000039c0 2024-04-25T09:06:24.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.038+0000 7f321a800640 1 -- 172.21.15.173:0/689848620 reap_dead start 2024-04-25T09:06:24.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.042+0000 7f3219e00640 1 --2- 172.21.15.173:0/689848620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32000039c0 0x7f3200003de0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f320c009fc0 tx=0x7f320c01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806edd845b68e370 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.042+0000 7f3219400640 1 -- 172.21.15.173:0/689848620 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c0b2070 con 0x7f32000039c0 2024-04-25T09:06:24.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.042+0000 7f3219400640 1 -- 172.21.15.173:0/689848620 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320c0a5cf0 con 0x7f32000039c0 2024-04-25T09:06:24.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.042+0000 7f3219400640 1 -- 172.21.15.173:0/689848620 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c009c10 con 0x7f32000039c0 2024-04-25T09:06:24.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.042+0000 7f3220e00640 1 -- 172.21.15.173:0/689848620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32000039c0 msgr2=0x7f3200003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.042+0000 7f3220e00640 1 --2- 172.21.15.173:0/689848620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32000039c0 0x7f3200003de0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f320c009fc0 tx=0x7f320c01cc50 comp rx=0 tx=0).stop 2024-04-25T09:06:24.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.042+0000 7f3220e00640 1 -- 172.21.15.173:0/689848620 shutdown_connections 2024-04-25T09:06:24.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.042+0000 7f3220e00640 1 --2- 172.21.15.173:0/689848620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32000039c0 0x7f3200003de0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.042+0000 7f3220e00640 1 -- 172.21.15.173:0/689848620 >> 172.21.15.173:0/689848620 conn(0x7f321c06ac90 msgr2=0x7f321c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.042+0000 7f3220e00640 1 -- 172.21.15.173:0/689848620 shutdown_connections 2024-04-25T09:06:24.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.042+0000 7f3220e00640 1 -- 172.21.15.173:0/689848620 wait complete. 2024-04-25T09:06:24.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.042+0000 7f3220e00640 1 Processor -- start 2024-04-25T09:06:24.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.042+0000 7f3220e00640 1 -- start start 2024-04-25T09:06:24.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f3220e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32000039c0 0x7f321c153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f3220e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f321c14ee40 0x7f321c14f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f3220e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c1f4fb0 0x7f321c1f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f3220e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c15aba0 con 0x7f321c1f4fb0 2024-04-25T09:06:24.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f3220e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c06d9e0 con 0x7f321c14ee40 2024-04-25T09:06:24.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f3220e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321c06e1c0 con 0x7f32000039c0 2024-04-25T09:06:24.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f321a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c1f4fb0 0x7f321c1f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f321a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c1f4fb0 0x7f321c1f5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38230/0 (socket says 172.21.15.173:38230) 2024-04-25T09:06:24.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f321a800640 1 -- 172.21.15.173:0/4204837099 learned_addr learned my addr 172.21.15.173:0/4204837099 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:24.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f3211400640 1 --2- 172.21.15.173:0/4204837099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f321c14ee40 0x7f321c14f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f3219e00640 1 --2- 172.21.15.173:0/4204837099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32000039c0 0x7f321c153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f321a800640 1 -- 172.21.15.173:0/4204837099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32000039c0 msgr2=0x7f321c153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f321a800640 1 --2- 172.21.15.173:0/4204837099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32000039c0 0x7f321c153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f321a800640 1 -- 172.21.15.173:0/4204837099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f321c14ee40 msgr2=0x7f321c14f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f321a800640 1 --2- 172.21.15.173:0/4204837099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f321c14ee40 0x7f321c14f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f321a800640 1 -- 172.21.15.173:0/4204837099 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321c1590c0 con 0x7f321c1f4fb0 2024-04-25T09:06:24.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f321a800640 1 --2- 172.21.15.173:0/4204837099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c1f4fb0 0x7f321c1f5430 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f321c15f1b0 tx=0x7f3214007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f3212a00640 1 -- 172.21.15.173:0/4204837099 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321400f680 con 0x7f321c1f4fb0 2024-04-25T09:06:24.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f3212a00640 1 -- 172.21.15.173:0/4204837099 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3214018070 con 0x7f321c1f4fb0 2024-04-25T09:06:24.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f3212a00640 1 -- 172.21.15.173:0/4204837099 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321400fa80 con 0x7f321c1f4fb0 2024-04-25T09:06:24.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f3220e00640 1 -- 172.21.15.173:0/4204837099 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321c1593a0 con 0x7f321c1f4fb0 2024-04-25T09:06:24.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f3220e00640 1 -- 172.21.15.173:0/4204837099 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321c159960 con 0x7f321c1f4fb0 2024-04-25T09:06:24.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f3220e00640 1 -- 172.21.15.173:0/4204837099 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f321c073a40 con 0x7f321c1f4fb0 2024-04-25T09:06:24.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.046+0000 7f3212a00640 1 -- 172.21.15.173:0/4204837099 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f321400fc20 con 0x7f321c1f4fb0 2024-04-25T09:06:24.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.050+0000 7f3212a00640 1 --2- 172.21.15.173:0/4204837099 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31f8066f90 0x7f31f8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.050+0000 7f3212a00640 1 -- 172.21.15.173:0/4204837099 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3214084c00 con 0x7f321c1f4fb0 2024-04-25T09:06:24.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.050+0000 7f3219e00640 1 --2- 172.21.15.173:0/4204837099 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31f8066f90 0x7f31f8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.050+0000 7f3219e00640 1 --2- 172.21.15.173:0/4204837099 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31f8066f90 0x7f31f8069450 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f320c0af000 tx=0x7f320c004ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.054+0000 7f3212a00640 1 -- 172.21.15.173:0/4204837099 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3214055420 con 0x7f321c1f4fb0 2024-04-25T09:06:24.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.238+0000 7f3220e00640 1 -- 172.21.15.173:0/4204837099 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f321c06f1c0 con 0x7f321c1f4fb0 2024-04-25T09:06:24.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.238+0000 7f3212a00640 1 -- 172.21.15.173:0/4204837099 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4951 (secure 0 0 0) 0x7f32140594c0 con 0x7f321c1f4fb0 2024-04-25T09:06:24.227 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:24.227 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:06:23.243735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:24.228 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 27 2024-04-25T09:06:24.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.242+0000 7f3220e00640 1 -- 172.21.15.173:0/4204837099 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31f8066f90 msgr2=0x7f31f8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.242+0000 7f3220e00640 1 --2- 172.21.15.173:0/4204837099 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31f8066f90 0x7f31f8069450 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f320c0af000 tx=0x7f320c004ac0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.242+0000 7f3220e00640 1 -- 172.21.15.173:0/4204837099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c1f4fb0 msgr2=0x7f321c1f5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.242+0000 7f3220e00640 1 --2- 172.21.15.173:0/4204837099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c1f4fb0 0x7f321c1f5430 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f321c15f1b0 tx=0x7f3214007430 comp rx=0 tx=0).stop 2024-04-25T09:06:24.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.242+0000 7f3220e00640 1 -- 172.21.15.173:0/4204837099 shutdown_connections 2024-04-25T09:06:24.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.242+0000 7f3220e00640 1 --2- 172.21.15.173:0/4204837099 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f31f8066f90 0x7f31f8069450 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.242+0000 7f3220e00640 1 --2- 172.21.15.173:0/4204837099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f321c1f4fb0 0x7f321c1f5430 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.242+0000 7f3220e00640 1 --2- 172.21.15.173:0/4204837099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f321c14ee40 0x7f321c14f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.242+0000 7f3220e00640 1 --2- 172.21.15.173:0/4204837099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32000039c0 0x7f321c153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.242+0000 7f3220e00640 1 -- 172.21.15.173:0/4204837099 >> 172.21.15.173:0/4204837099 conn(0x7f321c06ac90 msgr2=0x7f321c0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.242+0000 7f3220e00640 1 -- 172.21.15.173:0/4204837099 shutdown_connections 2024-04-25T09:06:24.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.242+0000 7f3220e00640 1 -- 172.21.15.173:0/4204837099 wait complete. 2024-04-25T09:06:24.249 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path /scrub_test_path/ceph-qa-suite/new_file_1 2024-04-25T09:06:24.394 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:24.395 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0 2024-04-25T09:06:24.395 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:24.410 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T09:06:24.410 DEBUG:teuthology.orchestra.run.smithi173:> stdin-killer -- python3 -c ' 2024-04-25T09:06:24.411 DEBUG:teuthology.orchestra.run.smithi173:> import os 2024-04-25T09:06:24.411 DEBUG:teuthology.orchestra.run.smithi173:> import stat 2024-04-25T09:06:24.411 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:06:24.411 DEBUG:teuthology.orchestra.run.smithi173:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1").st_ino) 2024-04-25T09:06:24.411 DEBUG:teuthology.orchestra.run.smithi173:> ' 2024-04-25T09:06:24.474 INFO:teuthology.orchestra.run.smithi173.stdout:1099511630189 2024-04-25T09:06:24.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:06:24.483 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:06:24.483 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-04-25T09:06:24.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa314400640 1 Processor -- start 2024-04-25T09:06:24.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa314400640 1 -- start start 2024-04-25T09:06:24.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa314400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa30c145290 0x7fa30c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa314400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa30c0cc260 0x7fa30c0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa314400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30c15c5f0 con 0x7fa30c0b3fe0 2024-04-25T09:06:24.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa314400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30c06d4b0 con 0x7fa30c0cc260 2024-04-25T09:06:24.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa314400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c06d790 con 0x7fa30c145290 2024-04-25T09:06:24.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa311000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa30c0b3fe0 0x7fa30c0b4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49530/0 (socket says 172.21.15.173:49530) 2024-04-25T09:06:24.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa311000640 1 -- 172.21.15.173:0/1967773643 learned_addr learned my addr 172.21.15.173:0/1967773643 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:24.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa312400640 1 --2- 172.21.15.173:0/1967773643 >> v2:172.21.15.194:3300/0 conn(0x7fa30c0cc260 0x7fa30c0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa30be00640 1 -- 172.21.15.173:0/1967773643 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890158213 0 0) 0x7fa2f8001120 con 0x7fa30c0b3fe0 2024-04-25T09:06:24.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa311a00640 1 --2- 172.21.15.173:0/1967773643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa30c145290 0x7fa30c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa30be00640 1 -- 172.21.15.173:0/1967773643 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f4003530 con 0x7fa30c0b3fe0 2024-04-25T09:06:24.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa30be00640 1 -- 172.21.15.173:0/1967773643 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4089260460 0 0) 0x7fa2f4003530 con 0x7fa30c0b3fe0 2024-04-25T09:06:24.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa30be00640 1 -- 172.21.15.173:0/1967773643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa30c145290 msgr2=0x7fa30c15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa30be00640 1 --2- 172.21.15.173:0/1967773643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa30c145290 0x7fa30c15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa30be00640 1 -- 172.21.15.173:0/1967773643 >> v2:172.21.15.194:3300/0 conn(0x7fa30c0cc260 msgr2=0x7fa30c0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa30be00640 1 --2- 172.21.15.173:0/1967773643 >> v2:172.21.15.194:3300/0 conn(0x7fa30c0cc260 0x7fa30c0cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa30be00640 1 -- 172.21.15.173:0/1967773643 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c06da70 con 0x7fa30c0b3fe0 2024-04-25T09:06:24.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa30be00640 1 -- 172.21.15.173:0/1967773643 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fa2f8001850 con 0x7fa30c0b3fe0 2024-04-25T09:06:24.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa30be00640 1 -- 172.21.15.173:0/1967773643 >> v1:172.21.15.173:6789/0 conn(0x7fa30c0b3fe0 legacy=0x7fa30c0b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa30be00640 1 --2- 172.21.15.173:0/1967773643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f40039c0 0x7fa2f4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa30be00640 1 --2- 172.21.15.173:0/1967773643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa30c145290 0x7fa2f4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa30be00640 1 --2- 172.21.15.173:0/1967773643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f4004d50 0x7fa2f40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa30be00640 1 -- 172.21.15.173:0/1967773643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c06d4b0 con 0x7fa2f40039c0 2024-04-25T09:06:24.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa30be00640 1 -- 172.21.15.173:0/1967773643 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c06d790 con 0x7fa2f4004d50 2024-04-25T09:06:24.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.674+0000 7fa30be00640 1 -- 172.21.15.173:0/1967773643 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f400ba50 con 0x7fa30c145290 2024-04-25T09:06:24.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.678+0000 7fa311a00640 1 --2- 172.21.15.173:0/1967773643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f40039c0 0x7fa2f4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.678+0000 7fa311000640 1 --2- 172.21.15.173:0/1967773643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa30c145290 0x7fa2f4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.678+0000 7fa312400640 1 --2- 172.21.15.173:0/1967773643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f4004d50 0x7fa2f40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.678+0000 7fa311a00640 1 -- 172.21.15.173:0/1967773643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa30c145290 msgr2=0x7fa2f4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.678+0000 7fa311a00640 1 --2- 172.21.15.173:0/1967773643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa30c145290 0x7fa2f4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.678+0000 7fa311a00640 1 -- 172.21.15.173:0/1967773643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f4004d50 msgr2=0x7fa2f40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.678+0000 7fa311a00640 1 --2- 172.21.15.173:0/1967773643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f4004d50 0x7fa2f40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.678+0000 7fa311a00640 1 -- 172.21.15.173:0/1967773643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f4003530 con 0x7fa2f40039c0 2024-04-25T09:06:24.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.678+0000 7fa312400640 1 --2- 172.21.15.173:0/1967773643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f4004d50 0x7fa2f40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:24.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.678+0000 7fa311a00640 1 --2- 172.21.15.173:0/1967773643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f40039c0 0x7fa2f4003de0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa300009ae0 tx=0x7fa30001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e13163115f3ad1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.678+0000 7fa30be00640 1 -- 172.21.15.173:0/1967773643 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3000b2070 con 0x7fa2f40039c0 2024-04-25T09:06:24.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.678+0000 7fa30be00640 1 -- 172.21.15.173:0/1967773643 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3000a5550 con 0x7fa2f40039c0 2024-04-25T09:06:24.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.678+0000 7fa30be00640 1 -- 172.21.15.173:0/1967773643 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3000096b0 con 0x7fa2f40039c0 2024-04-25T09:06:24.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa314400640 1 -- 172.21.15.173:0/1967773643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f40039c0 msgr2=0x7fa2f4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa314400640 1 --2- 172.21.15.173:0/1967773643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f40039c0 0x7fa2f4003de0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa300009ae0 tx=0x7fa30001ca70 comp rx=0 tx=0).stop 2024-04-25T09:06:24.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa312400640 1 -- 172.21.15.173:0/1967773643 reap_dead start 2024-04-25T09:06:24.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa314400640 1 -- 172.21.15.173:0/1967773643 shutdown_connections 2024-04-25T09:06:24.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa314400640 1 -- 172.21.15.173:0/1967773643 >> 172.21.15.173:0/1967773643 conn(0x7fa30c06ac90 msgr2=0x7fa30c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa314400640 1 -- 172.21.15.173:0/1967773643 shutdown_connections 2024-04-25T09:06:24.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa314400640 1 -- 172.21.15.173:0/1967773643 wait complete. 2024-04-25T09:06:24.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa314400640 1 Processor -- start 2024-04-25T09:06:24.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa314400640 1 -- start start 2024-04-25T09:06:24.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa314400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f40039c0 0x7fa30c0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa314400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa30c0cde40 0x7fa30c0ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa314400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa30c1f6f00 0x7fa30c1f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa314400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c06ed60 con 0x7fa2f40039c0 2024-04-25T09:06:24.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa314400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c06eee0 con 0x7fa30c1f6f00 2024-04-25T09:06:24.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa314400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c06f060 con 0x7fa30c0cde40 2024-04-25T09:06:24.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa311a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f40039c0 0x7fa30c0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa311a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f40039c0 0x7fa30c0af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38252/0 (socket says 172.21.15.173:38252) 2024-04-25T09:06:24.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa311a00640 1 -- 172.21.15.173:0/508249337 learned_addr learned my addr 172.21.15.173:0/508249337 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:24.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa312400640 1 --2- 172.21.15.173:0/508249337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa30c1f6f00 0x7fa30c1f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa311000640 1 --2- 172.21.15.173:0/508249337 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa30c0cde40 0x7fa30c0ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa311a00640 1 -- 172.21.15.173:0/508249337 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa30c0cde40 msgr2=0x7fa30c0ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa311a00640 1 --2- 172.21.15.173:0/508249337 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa30c0cde40 0x7fa30c0ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa311a00640 1 -- 172.21.15.173:0/508249337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa30c1f6f00 msgr2=0x7fa30c1f73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa311a00640 1 --2- 172.21.15.173:0/508249337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa30c1f6f00 0x7fa30c1f73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa311a00640 1 -- 172.21.15.173:0/508249337 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c0afb10 con 0x7fa2f40039c0 2024-04-25T09:06:24.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa311a00640 1 --2- 172.21.15.173:0/508249337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f40039c0 0x7fa30c0af2e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa30001c8a0 tx=0x7fa2f4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.682+0000 7fa309600640 1 -- 172.21.15.173:0/508249337 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3000bc020 con 0x7fa2f40039c0 2024-04-25T09:06:24.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.686+0000 7fa309600640 1 -- 172.21.15.173:0/508249337 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3000a5d80 con 0x7fa2f40039c0 2024-04-25T09:06:24.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.686+0000 7fa309600640 1 -- 172.21.15.173:0/508249337 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3000b2040 con 0x7fa2f40039c0 2024-04-25T09:06:24.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.686+0000 7fa314400640 1 -- 172.21.15.173:0/508249337 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30c0afdf0 con 0x7fa2f40039c0 2024-04-25T09:06:24.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.686+0000 7fa314400640 1 -- 172.21.15.173:0/508249337 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30c0af820 con 0x7fa2f40039c0 2024-04-25T09:06:24.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.686+0000 7fa309600640 1 -- 172.21.15.173:0/508249337 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa300004220 con 0x7fa2f40039c0 2024-04-25T09:06:24.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.686+0000 7fa309600640 1 --2- 172.21.15.173:0/508249337 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2ec066f90 0x7fa2ec069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.686+0000 7fa309600640 1 -- 172.21.15.173:0/508249337 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa30011f310 con 0x7fa2f40039c0 2024-04-25T09:06:24.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.686+0000 7fa311000640 1 --2- 172.21.15.173:0/508249337 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2ec066f90 0x7fa2ec069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.686+0000 7fa317875000 1 Processor -- start 2024-04-25T09:06:24.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.686+0000 7fa317875000 1 -- start start 2024-04-25T09:06:24.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.686+0000 7fa311000640 1 --2- 172.21.15.173:0/508249337 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2ec066f90 0x7fa2ec069450 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0cbfd0 tx=0x7fa2f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa317875000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0db1180 0x55fad0db1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa317875000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0db1aa0 0x55fad0d670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa317875000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0d67600 0x55fad0d679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa317875000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fad0bb4f20 con 0x55fad0d67600 2024-04-25T09:06:24.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa317875000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fad0b3d000 con 0x55fad0db1180 2024-04-25T09:06:24.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa317875000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fad0bb0fc0 con 0x55fad0db1aa0 2024-04-25T09:06:24.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa312400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0d67600 0x55fad0d679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa312400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0d67600 0x55fad0d679e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38260/0 (socket says 172.21.15.173:38260) 2024-04-25T09:06:24.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa312400640 1 -- 172.21.15.173:0/1502321763 learned_addr learned my addr 172.21.15.173:0/1502321763 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:24.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa311a00640 1 --2- 172.21.15.173:0/1502321763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0db1180 0x55fad0db1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa311000640 1 --2- 172.21.15.173:0/1502321763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0db1aa0 0x55fad0d670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa312400640 1 -- 172.21.15.173:0/1502321763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0db1aa0 msgr2=0x55fad0d670c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa312400640 1 --2- 172.21.15.173:0/1502321763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0db1aa0 0x55fad0d670c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa312400640 1 -- 172.21.15.173:0/1502321763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0db1180 msgr2=0x55fad0db1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa312400640 1 --2- 172.21.15.173:0/1502321763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0db1180 0x55fad0db1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa312400640 1 -- 172.21.15.173:0/1502321763 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fad0b90ba0 con 0x55fad0d67600 2024-04-25T09:06:24.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa312400640 1 --2- 172.21.15.173:0/1502321763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0d67600 0x55fad0d679e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0d0800 tx=0x7fa304009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ebbb964125a9f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa2fe000640 1 -- 172.21.15.173:0/1502321763 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30401a070 con 0x55fad0d67600 2024-04-25T09:06:24.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa2fe000640 1 -- 172.21.15.173:0/1502321763 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa304016620 con 0x55fad0d67600 2024-04-25T09:06:24.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa2fe000640 1 -- 172.21.15.173:0/1502321763 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3040169d0 con 0x55fad0d67600 2024-04-25T09:06:24.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa317875000 1 -- 172.21.15.173:0/1502321763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0d67600 msgr2=0x55fad0d679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa317875000 1 --2- 172.21.15.173:0/1502321763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0d67600 0x55fad0d679e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0d0800 tx=0x7fa304009750 comp rx=0 tx=0).stop 2024-04-25T09:06:24.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa317875000 1 -- 172.21.15.173:0/1502321763 shutdown_connections 2024-04-25T09:06:24.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa317875000 1 --2- 172.21.15.173:0/1502321763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0d67600 0x55fad0d679e0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa317875000 1 --2- 172.21.15.173:0/1502321763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0db1aa0 0x55fad0d670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa317875000 1 --2- 172.21.15.173:0/1502321763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0db1180 0x55fad0db1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa317875000 1 -- 172.21.15.173:0/1502321763 >> 172.21.15.173:0/1502321763 conn(0x55fad0d6d760 msgr2=0x55fad0d659a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa317875000 1 -- 172.21.15.173:0/1502321763 shutdown_connections 2024-04-25T09:06:24.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa317875000 1 -- 172.21.15.173:0/1502321763 wait complete. 2024-04-25T09:06:24.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa317875000 1 -- start start 2024-04-25T09:06:24.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.690+0000 7fa317875000 1 Processor -- start 2024-04-25T09:06:24.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0d67600 0x55fad0d6c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0db1180 0x55fad0d6cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0db1aa0 0x55fad0d9f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fad0c729c0 con 0x55fad0db1180 2024-04-25T09:06:24.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fad0b6f5d0 con 0x55fad0d67600 2024-04-25T09:06:24.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fad0b76ee0 con 0x55fad0db1aa0 2024-04-25T09:06:24.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 10 client.0 _ll_register_callbacks cb 0x55fad0d52a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:24.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa311000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0db1180 0x55fad0d6cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa311000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0db1180 0x55fad0d6cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38272/0 (socket says 172.21.15.173:38272) 2024-04-25T09:06:24.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa311000640 1 -- 172.21.15.173:0/3232842031 learned_addr learned my addr 172.21.15.173:0/3232842031 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:24.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa312400640 1 --2- 172.21.15.173:0/3232842031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0db1aa0 0x55fad0d9f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa311a00640 1 --2- 172.21.15.173:0/3232842031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0d67600 0x55fad0d6c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa311000640 1 -- 172.21.15.173:0/3232842031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0db1aa0 msgr2=0x55fad0d9f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa311000640 1 --2- 172.21.15.173:0/3232842031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0db1aa0 0x55fad0d9f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa311000640 1 -- 172.21.15.173:0/3232842031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0d67600 msgr2=0x55fad0d6c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa311000640 1 --2- 172.21.15.173:0/3232842031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0d67600 0x55fad0d6c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa311000640 1 -- 172.21.15.173:0/3232842031 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fad0bfb5a0 con 0x55fad0db1180 2024-04-25T09:06:24.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa311a00640 1 --2- 172.21.15.173:0/3232842031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0d67600 0x55fad0d6c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:24.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa311000640 1 --2- 172.21.15.173:0/3232842031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0db1180 0x55fad0d6cbf0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80159b0 tx=0x7fa30c06dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e5fd3811118f7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa2f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:24.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa2f2a00640 1 -- 172.21.15.173:0/3232842031 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8028060 con 0x55fad0db1180 2024-04-25T09:06:24.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa2f2a00640 1 -- 172.21.15.173:0/3232842031 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa2f8023c70 con 0x55fad0db1180 2024-04-25T09:06:24.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 -- 172.21.15.173:0/3232842031 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa304016620 con 0x55fad0db1180 2024-04-25T09:06:24.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa2f2a00640 1 -- 172.21.15.173:0/3232842031 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2f8014b60 con 0x55fad0db1180 2024-04-25T09:06:24.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 10 client.6402 fetch_fsmap learned FSMap version 27 2024-04-25T09:06:24.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 -- 172.21.15.173:0/3232842031 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x55fad0b8c2b0 con 0x55fad0db1180 2024-04-25T09:06:24.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa2f2a00640 1 -- 172.21.15.173:0/3232842031 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa304016620 con 0x55fad0db1180 2024-04-25T09:06:24.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa2f2a00640 1 -- 172.21.15.173:0/3232842031 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 27) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa2f802d3e0 con 0x55fad0db1180 2024-04-25T09:06:24.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 10 client.6402 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T09:06:24.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 10 client.6402 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:24.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 20 client.6402 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:24.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 --2- 172.21.15.173:0/3232842031 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55fad0d9fe60 0x55fad0dc3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 4 client.6402 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:24.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 -- 172.21.15.173:0/3232842031 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fad0b50c70 con 0x55fad0d9fe60 2024-04-25T09:06:24.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa311a00640 1 --2- 172.21.15.173:0/3232842031 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55fad0d9fe60 0x55fad0dc3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa311a00640 1 --2- 172.21.15.173:0/3232842031 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55fad0d9fe60 0x55fad0dc3440 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=574ed5d21435a4db server_cookie=f5be22bad4bf8943 in_seq=0 out_seq=0 2024-04-25T09:06:24.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa2f2a00640 10 client.6402 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:24.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa2f2a00640 1 -- 172.21.15.173:0/3232842031 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fad0b50c70 con 0x55fad0d9fe60 2024-04-25T09:06:24.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa2f2a00640 10 client.6402 handle_command_reply: tid=0 2024-04-25T09:06:24.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 client.6402 shutdown 2024-04-25T09:06:24.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 -- 172.21.15.173:0/3232842031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0db1180 msgr2=0x55fad0d6cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 --2- 172.21.15.173:0/3232842031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0db1180 0x55fad0d6cbf0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80159b0 tx=0x7fa30c06dc40 comp rx=0 tx=0).stop 2024-04-25T09:06:24.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 -- 172.21.15.173:0/3232842031 shutdown_connections 2024-04-25T09:06:24.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 --2- 172.21.15.173:0/3232842031 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55fad0d9fe60 0x55fad0dc3440 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 --2- 172.21.15.173:0/3232842031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0db1aa0 0x55fad0d9f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 --2- 172.21.15.173:0/3232842031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0db1180 0x55fad0d6cbf0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 --2- 172.21.15.173:0/3232842031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0d67600 0x55fad0d6c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa2f2a00640 0 client.6402 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:24.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 -- 172.21.15.173:0/3232842031 >> 172.21.15.173:0/3232842031 conn(0x55fad0d6d760 msgr2=0x55fad0d660b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 -- 172.21.15.173:0/3232842031 shutdown_connections 2024-04-25T09:06:24.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.694+0000 7fa317875000 1 -- 172.21.15.173:0/3232842031 wait complete. 2024-04-25T09:06:24.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.698+0000 7fa317875000 20 client.6402 trim_cache size 0 max 16384 2024-04-25T09:06:24.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.706+0000 7fa317875000 1 Processor -- start 2024-04-25T09:06:24.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.706+0000 7fa317875000 1 -- start start 2024-04-25T09:06:24.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa317875000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0d6d760 0x55fad0dc5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa317875000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0d67600 0x55fad0d66120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa317875000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0db1180 0x55fad0d66660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa317875000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c204090 con 0x55fad0db1180 2024-04-25T09:06:24.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa317875000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c203290 con 0x55fad0d6d760 2024-04-25T09:06:24.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa317875000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c202690 con 0x55fad0d67600 2024-04-25T09:06:24.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa312400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0db1180 0x55fad0d66660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa312400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0db1180 0x55fad0d66660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38288/0 (socket says 172.21.15.173:38288) 2024-04-25T09:06:24.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa312400640 1 -- 172.21.15.173:0/370622683 learned_addr learned my addr 172.21.15.173:0/370622683 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:24.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa311a00640 1 --2- 172.21.15.173:0/370622683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0d6d760 0x55fad0dc5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa311000640 1 --2- 172.21.15.173:0/370622683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0d67600 0x55fad0d66120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa312400640 1 -- 172.21.15.173:0/370622683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0d67600 msgr2=0x55fad0d66120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa312400640 1 --2- 172.21.15.173:0/370622683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0d67600 0x55fad0d66120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa312400640 1 -- 172.21.15.173:0/370622683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0d6d760 msgr2=0x55fad0dc5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa312400640 1 --2- 172.21.15.173:0/370622683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0d6d760 0x55fad0dc5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa312400640 1 -- 172.21.15.173:0/370622683 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fad0b3d250 con 0x55fad0db1180 2024-04-25T09:06:24.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa311a00640 1 --2- 172.21.15.173:0/370622683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0d6d760 0x55fad0dc5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:24.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa311000640 1 --2- 172.21.15.173:0/370622683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0d67600 0x55fad0d66120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:24.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa312400640 1 --2- 172.21.15.173:0/370622683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0db1180 0x55fad0d66660 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x55fad0bbaf00 tx=0x7fa304017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabcdb19feb9666f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa2fd600640 1 -- 172.21.15.173:0/370622683 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30401a070 con 0x55fad0db1180 2024-04-25T09:06:24.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa2fd600640 1 -- 172.21.15.173:0/370622683 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa304007080 con 0x55fad0db1180 2024-04-25T09:06:24.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa2fd600640 1 -- 172.21.15.173:0/370622683 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa304004280 con 0x55fad0db1180 2024-04-25T09:06:24.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa317875000 1 -- 172.21.15.173:0/370622683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0db1180 msgr2=0x55fad0d66660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa317875000 1 --2- 172.21.15.173:0/370622683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0db1180 0x55fad0d66660 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x55fad0bbaf00 tx=0x7fa304017000 comp rx=0 tx=0).stop 2024-04-25T09:06:24.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa317875000 1 -- 172.21.15.173:0/370622683 shutdown_connections 2024-04-25T09:06:24.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa317875000 1 --2- 172.21.15.173:0/370622683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0db1180 0x55fad0d66660 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa317875000 1 --2- 172.21.15.173:0/370622683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0d67600 0x55fad0d66120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa317875000 1 --2- 172.21.15.173:0/370622683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0d6d760 0x55fad0dc5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa317875000 1 -- 172.21.15.173:0/370622683 >> 172.21.15.173:0/370622683 conn(0x55fad0d9f5b0 msgr2=0x55fad0db0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa317875000 1 -- 172.21.15.173:0/370622683 shutdown_connections 2024-04-25T09:06:24.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa317875000 1 -- 172.21.15.173:0/370622683 wait complete. 2024-04-25T09:06:24.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa317875000 1 -- start start 2024-04-25T09:06:24.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.710+0000 7fa317875000 1 Processor -- start 2024-04-25T09:06:24.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0d67600 0x55fad0e118f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0d6d760 0x55fad0e11e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0db1180 0x55fad0dc3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fad0bb4230 con 0x55fad0d6d760 2024-04-25T09:06:24.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c202c90 con 0x55fad0d67600 2024-04-25T09:06:24.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fad0b7f4b0 con 0x55fad0db1180 2024-04-25T09:06:24.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 10 client.0 _ll_register_callbacks cb 0x55fad0d33600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:24.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa311000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0d6d760 0x55fad0e11e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa311000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0d6d760 0x55fad0e11e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38292/0 (socket says 172.21.15.173:38292) 2024-04-25T09:06:24.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa311000640 1 -- 172.21.15.173:0/2100525645 learned_addr learned my addr 172.21.15.173:0/2100525645 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:24.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa312400640 1 --2- 172.21.15.173:0/2100525645 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0db1180 0x55fad0dc3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa311a00640 1 --2- 172.21.15.173:0/2100525645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0d67600 0x55fad0e118f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa311000640 1 -- 172.21.15.173:0/2100525645 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0db1180 msgr2=0x55fad0dc3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa311000640 1 --2- 172.21.15.173:0/2100525645 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0db1180 0x55fad0dc3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa311000640 1 -- 172.21.15.173:0/2100525645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0d67600 msgr2=0x55fad0e118f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa311000640 1 --2- 172.21.15.173:0/2100525645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0d67600 0x55fad0e118f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa311000640 1 -- 172.21.15.173:0/2100525645 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fad0b49b90 con 0x55fad0d6d760 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa311000640 1 --2- 172.21.15.173:0/2100525645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0d6d760 0x55fad0e11e30 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80018c0 tx=0x7fa2f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889e052cda559c0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa2f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa2f2a00640 1 -- 172.21.15.173:0/2100525645 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8032070 con 0x55fad0d6d760 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa2f2a00640 1 -- 172.21.15.173:0/2100525645 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa2f8014070 con 0x55fad0d6d760 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 -- 172.21.15.173:0/2100525645 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa304007080 con 0x55fad0d6d760 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa2f2a00640 1 -- 172.21.15.173:0/2100525645 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2f802d8e0 con 0x55fad0d6d760 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 10 client.6408 fetch_fsmap learned FSMap version 27 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 -- 172.21.15.173:0/2100525645 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x55fad0b5c010 con 0x55fad0d6d760 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa2f2a00640 1 -- 172.21.15.173:0/2100525645 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa304007080 con 0x55fad0d6d760 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa2f2a00640 1 -- 172.21.15.173:0/2100525645 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 27) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa2f802da80 con 0x55fad0d6d760 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 10 client.6408 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 10 client.6408 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 20 client.6408 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:24.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 --2- 172.21.15.173:0/2100525645 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55fad0db1aa0 0x55fad0dc4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 4 client.6408 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T09:06:24.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 -- 172.21.15.173:0/2100525645 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fad0bc2460 con 0x55fad0db1aa0 2024-04-25T09:06:24.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa311a00640 1 --2- 172.21.15.173:0/2100525645 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55fad0db1aa0 0x55fad0dc4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa2f2a00640 10 client.6408 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:24.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa311a00640 1 --2- 172.21.15.173:0/2100525645 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55fad0db1aa0 0x55fad0dc4b20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=560219ac6fc0102f server_cookie=8ecf86e77a07d373 in_seq=0 out_seq=0 2024-04-25T09:06:24.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa2f2a00640 1 -- 172.21.15.173:0/2100525645 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fad0bc2460 con 0x55fad0db1aa0 2024-04-25T09:06:24.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa2f2a00640 10 client.6408 handle_command_reply: tid=0 2024-04-25T09:06:24.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 client.6408 shutdown 2024-04-25T09:06:24.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 -- 172.21.15.173:0/2100525645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0d6d760 msgr2=0x55fad0e11e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 --2- 172.21.15.173:0/2100525645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0d6d760 0x55fad0e11e30 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80018c0 tx=0x7fa2f8017000 comp rx=0 tx=0).stop 2024-04-25T09:06:24.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 -- 172.21.15.173:0/2100525645 shutdown_connections 2024-04-25T09:06:24.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 --2- 172.21.15.173:0/2100525645 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55fad0db1aa0 0x55fad0dc4b20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 --2- 172.21.15.173:0/2100525645 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55fad0db1180 0x55fad0dc3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 --2- 172.21.15.173:0/2100525645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fad0d6d760 0x55fad0e11e30 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa2f2a00640 0 client.6408 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:24.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 --2- 172.21.15.173:0/2100525645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fad0d67600 0x55fad0e118f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 -- 172.21.15.173:0/2100525645 >> 172.21.15.173:0/2100525645 conn(0x55fad0d9f5b0 msgr2=0x55fad0dbe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 -- 172.21.15.173:0/2100525645 shutdown_connections 2024-04-25T09:06:24.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 1 -- 172.21.15.173:0/2100525645 wait complete. 2024-04-25T09:06:24.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.714+0000 7fa317875000 20 client.6408 trim_cache size 0 max 16384 2024-04-25T09:06:24.708 INFO:teuthology.orchestra.run.smithi173.stdout:[] 2024-04-25T09:06:24.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.718+0000 7fa314400640 1 -- 172.21.15.173:0/508249337 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2ec066f90 msgr2=0x7fa2ec069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.718+0000 7fa314400640 1 --2- 172.21.15.173:0/508249337 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2ec066f90 0x7fa2ec069450 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0cbfd0 tx=0x7fa2f8009040 comp rx=0 tx=0).stop 2024-04-25T09:06:24.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.718+0000 7fa314400640 1 -- 172.21.15.173:0/508249337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f40039c0 msgr2=0x7fa30c0af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.718+0000 7fa314400640 1 --2- 172.21.15.173:0/508249337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f40039c0 0x7fa30c0af2e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa30001c8a0 tx=0x7fa2f4005840 comp rx=0 tx=0).stop 2024-04-25T09:06:24.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.718+0000 7fa314400640 1 -- 172.21.15.173:0/508249337 shutdown_connections 2024-04-25T09:06:24.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.718+0000 7fa314400640 1 --2- 172.21.15.173:0/508249337 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2ec066f90 0x7fa2ec069450 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.718+0000 7fa314400640 1 --2- 172.21.15.173:0/508249337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa30c1f6f00 0x7fa30c1f73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.718+0000 7fa314400640 1 --2- 172.21.15.173:0/508249337 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa30c0cde40 0x7fa30c0ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.718+0000 7fa314400640 1 --2- 172.21.15.173:0/508249337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f40039c0 0x7fa30c0af2e0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.718+0000 7fa314400640 1 -- 172.21.15.173:0/508249337 >> 172.21.15.173:0/508249337 conn(0x7fa30c06ac90 msgr2=0x7fa30c0cf690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.718+0000 7fa314400640 1 -- 172.21.15.173:0/508249337 shutdown_connections 2024-04-25T09:06:24.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.718+0000 7fa314400640 1 -- 172.21.15.173:0/508249337 wait complete. 2024-04-25T09:06:24.724 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 1000000096d.00000000 parent 2024-04-25T09:06:24.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbeac3080 1 Processor -- start 2024-04-25T09:06:24.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbeac3080 1 -- start start 2024-04-25T09:06:24.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbeac3080 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdca0003100 0x55f2699ab700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbeac3080 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2698fed10 0x55f269990e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbeac3080 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f26998eb30 0x55f269991340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbeac3080 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f269901800 con 0x55f26998eb30 2024-04-25T09:06:24.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbeac3080 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2698779f0 con 0x7fdca0003100 2024-04-25T09:06:24.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbeac3080 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f269901980 con 0x55f2698fed10 2024-04-25T09:06:24.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbc600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f26998eb30 0x55f269991340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbc600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f26998eb30 0x55f269991340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38304/0 (socket says 172.21.15.173:38304) 2024-04-25T09:06:24.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbc600640 1 -- 172.21.15.173:0/834554177 learned_addr learned my addr 172.21.15.173:0/834554177 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:24.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbb200640 1 --2- 172.21.15.173:0/834554177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2698fed10 0x55f269990e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbc600640 1 -- 172.21.15.173:0/834554177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2698fed10 msgr2=0x55f269990e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbbc00640 1 --2- 172.21.15.173:0/834554177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdca0003100 0x55f2699ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbc600640 1 --2- 172.21.15.173:0/834554177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2698fed10 0x55f269990e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbc600640 1 -- 172.21.15.173:0/834554177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdca0003100 msgr2=0x55f2699ab700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbc600640 1 --2- 172.21.15.173:0/834554177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdca0003100 0x55f2699ab700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbc600640 1 -- 172.21.15.173:0/834554177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2698fb590 con 0x55f26998eb30 2024-04-25T09:06:24.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbbc00640 1 --2- 172.21.15.173:0/834554177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdca0003100 0x55f2699ab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:24.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcbc600640 1 --2- 172.21.15.173:0/834554177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f26998eb30 0x55f269991340 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400a5a0 tx=0x7fdcb4005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b11e4edfb546167 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcb9e00640 1 -- 172.21.15.173:0/834554177 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4017070 con 0x55f26998eb30 2024-04-25T09:06:24.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcb9e00640 1 -- 172.21.15.173:0/834554177 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb4012670 con 0x55f26998eb30 2024-04-25T09:06:24.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.782+0000 7fdcb9e00640 1 -- 172.21.15.173:0/834554177 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4012a20 con 0x55f26998eb30 2024-04-25T09:06:24.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 -- 172.21.15.173:0/834554177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f26998eb30 msgr2=0x55f269991340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 --2- 172.21.15.173:0/834554177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f26998eb30 0x55f269991340 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400a5a0 tx=0x7fdcb4005d90 comp rx=0 tx=0).stop 2024-04-25T09:06:24.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 -- 172.21.15.173:0/834554177 shutdown_connections 2024-04-25T09:06:24.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 --2- 172.21.15.173:0/834554177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f26998eb30 0x55f269991340 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 --2- 172.21.15.173:0/834554177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2698fed10 0x55f269990e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 --2- 172.21.15.173:0/834554177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdca0003100 0x55f2699ab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 -- 172.21.15.173:0/834554177 >> 172.21.15.173:0/834554177 conn(0x55f2698d15a0 msgr2=0x55f2698fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 -- 172.21.15.173:0/834554177 shutdown_connections 2024-04-25T09:06:24.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 -- 172.21.15.173:0/834554177 wait complete. 2024-04-25T09:06:24.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 Processor -- start 2024-04-25T09:06:24.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 -- start start 2024-04-25T09:06:24.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2698fed10 0x55f2699a8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f26998eb30 0x55f269981020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdca0003100 0x55f269981560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2699b10b0 con 0x7fdca0003100 2024-04-25T09:06:24.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2698fb830 con 0x55f26998eb30 2024-04-25T09:06:24.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f2698fbad0 con 0x55f2698fed10 2024-04-25T09:06:24.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbc600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdca0003100 0x55f269981560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbc600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdca0003100 0x55f269981560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38312/0 (socket says 172.21.15.173:38312) 2024-04-25T09:06:24.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbc600640 1 -- 172.21.15.173:0/2101155134 learned_addr learned my addr 172.21.15.173:0/2101155134 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:24.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbb200640 1 --2- 172.21.15.173:0/2101155134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f26998eb30 0x55f269981020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbbc00640 1 --2- 172.21.15.173:0/2101155134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2698fed10 0x55f2699a8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbc600640 1 -- 172.21.15.173:0/2101155134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2698fed10 msgr2=0x55f2699a8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbc600640 1 --2- 172.21.15.173:0/2101155134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55f2698fed10 0x55f2699a8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbc600640 1 -- 172.21.15.173:0/2101155134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f26998eb30 msgr2=0x55f269981020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbc600640 1 --2- 172.21.15.173:0/2101155134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f26998eb30 0x55f269981020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbc600640 1 -- 172.21.15.173:0/2101155134 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f269981ba0 con 0x7fdca0003100 2024-04-25T09:06:24.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbc600640 1 --2- 172.21.15.173:0/2101155134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdca0003100 0x55f269981560 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fdcb401d690 tx=0x7fdcb4003340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcb8a00640 1 -- 172.21.15.173:0/2101155134 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4017040 con 0x7fdca0003100 2024-04-25T09:06:24.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcb8a00640 1 -- 172.21.15.173:0/2101155134 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb401da00 con 0x7fdca0003100 2024-04-25T09:06:24.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcb8a00640 1 -- 172.21.15.173:0/2101155134 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb401ddd0 con 0x7fdca0003100 2024-04-25T09:06:24.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 -- 172.21.15.173:0/2101155134 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f269981e40 con 0x7fdca0003100 2024-04-25T09:06:24.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.786+0000 7fdcbeac3080 1 -- 172.21.15.173:0/2101155134 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f269982380 con 0x7fdca0003100 2024-04-25T09:06:24.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.790+0000 7fdcb8a00640 1 -- 172.21.15.173:0/2101155134 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdcb401a070 con 0x7fdca0003100 2024-04-25T09:06:24.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.790+0000 7fdcb8a00640 1 --2- 172.21.15.173:0/2101155134 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdc9c065970 0x7fdc9c067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.790+0000 7fdcb8a00640 1 -- 172.21.15.173:0/2101155134 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdcb4085d80 con 0x7fdca0003100 2024-04-25T09:06:24.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.790+0000 7fdcbbc00640 1 --2- 172.21.15.173:0/2101155134 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdc9c065970 0x7fdc9c067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.790+0000 7fdcbeac3080 1 --2- 172.21.15.173:0/2101155134 >> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] conn(0x55f2699ada10 0x55f2699addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.790+0000 7fdcbeac3080 1 -- 172.21.15.173:0/2101155134 --> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] -- osd_op(unknown.0.0:1 8.21 8:844f785e:::1000000096d.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56) v9 -- 0x55f2699ae330 con 0x55f2699ada10 2024-04-25T09:06:24.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.790+0000 7fdcbb200640 1 --2- 172.21.15.173:0/2101155134 >> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] conn(0x55f2699ada10 0x55f2699addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.790+0000 7fdcbbc00640 1 --2- 172.21.15.173:0/2101155134 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdc9c065970 0x7fdc9c067e30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009710 tx=0x7fdcac00c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.790+0000 7fdcbb200640 1 --2- 172.21.15.173:0/2101155134 >> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] conn(0x55f2699ada10 0x55f2699addf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.794+0000 7fdcbb200640 1 -- 172.21.15.173:0/2101155134 <== osd.0 v2:172.21.15.173:6802/3393779300 1 ==== osd_op_reply(1 1000000096d.00000000 [rmxattr] v56'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fdca8008030 con 0x55f2699ada10 2024-04-25T09:06:24.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.794+0000 7fdcbeac3080 1 -- 172.21.15.173:0/2101155134 >> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] conn(0x55f2699ada10 msgr2=0x55f2699addf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.794+0000 7fdcbeac3080 1 --2- 172.21.15.173:0/2101155134 >> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] conn(0x55f2699ada10 0x55f2699addf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.794+0000 7fdcbeac3080 1 -- 172.21.15.173:0/2101155134 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdc9c065970 msgr2=0x7fdc9c067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.794+0000 7fdcbeac3080 1 --2- 172.21.15.173:0/2101155134 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdc9c065970 0x7fdc9c067e30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009710 tx=0x7fdcac00c040 comp rx=0 tx=0).stop 2024-04-25T09:06:24.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.794+0000 7fdcbeac3080 1 -- 172.21.15.173:0/2101155134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdca0003100 msgr2=0x55f269981560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.794+0000 7fdcbeac3080 1 --2- 172.21.15.173:0/2101155134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdca0003100 0x55f269981560 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fdcb401d690 tx=0x7fdcb4003340 comp rx=0 tx=0).stop 2024-04-25T09:06:24.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.794+0000 7fdcbc600640 1 -- 172.21.15.173:0/2101155134 reap_dead start 2024-04-25T09:06:24.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.794+0000 7fdcbeac3080 1 -- 172.21.15.173:0/2101155134 shutdown_connections 2024-04-25T09:06:24.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.794+0000 7fdcbeac3080 1 -- 172.21.15.173:0/2101155134 >> 172.21.15.173:0/2101155134 conn(0x55f2698d15a0 msgr2=0x55f2698fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.794+0000 7fdcbeac3080 1 -- 172.21.15.173:0/2101155134 shutdown_connections 2024-04-25T09:06:24.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.794+0000 7fdcbeac3080 1 -- 172.21.15.173:0/2101155134 wait complete. 2024-04-25T09:06:24.786 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' 2024-04-25T09:06:24.786 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:06:24.786 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_1 2024-04-25T09:06:24.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.978+0000 7fb6de800640 1 Processor -- start 2024-04-25T09:06:24.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.978+0000 7fb6de800640 1 -- start start 2024-04-25T09:06:24.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.978+0000 7fb6de800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb6d80cc7e0 0x7fb6d80cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.978+0000 7fb6de800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d8071570 con 0x7fb6d80aeb90 2024-04-25T09:06:24.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.978+0000 7fb6de800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d8071850 con 0x7fb6d80aef70 2024-04-25T09:06:24.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.978+0000 7fb6de800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d8071320 con 0x7fb6d80cc7e0 2024-04-25T09:06:24.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.978+0000 7fb6cea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb6d80cc7e0 0x7fb6d80cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.978+0000 7fb6cea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb6d80cc7e0 0x7fb6d80cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38318/0 (socket says 172.21.15.173:38318) 2024-04-25T09:06:24.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.978+0000 7fb6cea00640 1 -- 172.21.15.173:0/2544172508 learned_addr learned my addr 172.21.15.173:0/2544172508 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:24.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.978+0000 7fb6d7400640 1 --1- 172.21.15.173:0/2544172508 >> v1:172.21.15.173:6789/0 conn(0x7fb6d80aeb90 0x7fb6d80cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49538/0 (socket says 172.21.15.173:49538) 2024-04-25T09:06:24.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.982+0000 7fb6cea00640 1 -- 172.21.15.173:0/2544172508 >> v1:172.21.15.194:6789/0 conn(0x7fb6d80aef70 legacy=0x7fb6d815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.982+0000 7fb6cea00640 1 -- 172.21.15.173:0/2544172508 >> v1:172.21.15.173:6789/0 conn(0x7fb6d80aeb90 legacy=0x7fb6d80cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.982+0000 7fb6cea00640 1 -- 172.21.15.173:0/2544172508 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d8071b30 con 0x7fb6d80cc7e0 2024-04-25T09:06:24.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.982+0000 7fb6cea00640 1 --2- 172.21.15.173:0/2544172508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d80cc7e0 0x7fb6d80cdba0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009870 tx=0x7fb6c001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1aa5ad2e7bbb1f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.982+0000 7fb6d6a00640 1 -- 172.21.15.173:0/2544172508 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c00b1070 con 0x7fb6d80cc7e0 2024-04-25T09:06:24.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.982+0000 7fb6d6a00640 1 -- 172.21.15.173:0/2544172508 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c00a8050 con 0x7fb6d80cc7e0 2024-04-25T09:06:24.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.982+0000 7fb6d6a00640 1 -- 172.21.15.173:0/2544172508 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c00ac860 con 0x7fb6d80cc7e0 2024-04-25T09:06:24.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.982+0000 7fb6de800640 1 -- 172.21.15.173:0/2544172508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d80cc7e0 msgr2=0x7fb6d80cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.982+0000 7fb6de800640 1 --2- 172.21.15.173:0/2544172508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d80cc7e0 0x7fb6d80cdba0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009870 tx=0x7fb6c001c4d0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.982+0000 7fb6de800640 1 -- 172.21.15.173:0/2544172508 shutdown_connections 2024-04-25T09:06:24.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.982+0000 7fb6de800640 1 --2- 172.21.15.173:0/2544172508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d80cc7e0 0x7fb6d80cdba0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.982+0000 7fb6de800640 1 -- 172.21.15.173:0/2544172508 >> 172.21.15.173:0/2544172508 conn(0x7fb6d806ac90 msgr2=0x7fb6d806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.982+0000 7fb6de800640 1 -- 172.21.15.173:0/2544172508 shutdown_connections 2024-04-25T09:06:24.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.982+0000 7fb6de800640 1 -- 172.21.15.173:0/2544172508 wait complete. 2024-04-25T09:06:24.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6de800640 1 Processor -- start 2024-04-25T09:06:24.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6de800640 1 -- start start 2024-04-25T09:06:24.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6de800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6d80aeb90 0x7fb6d813c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6de800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d80aef70 0x7fb6d80afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6de800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6d80cc7e0 0x7fb6d814acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6de800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d81688b0 con 0x7fb6d80aef70 2024-04-25T09:06:24.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6de800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d8168730 con 0x7fb6d80aeb90 2024-04-25T09:06:24.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6de800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d8168a30 con 0x7fb6d80cc7e0 2024-04-25T09:06:24.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6cea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d80aef70 0x7fb6d80afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6cea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d80aef70 0x7fb6d80afd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38320/0 (socket says 172.21.15.173:38320) 2024-04-25T09:06:24.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6cea00640 1 -- 172.21.15.173:0/2300024851 learned_addr learned my addr 172.21.15.173:0/2300024851 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:24.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6d7400640 1 --2- 172.21.15.173:0/2300024851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6d80aeb90 0x7fb6d813c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6d7e00640 1 --2- 172.21.15.173:0/2300024851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6d80cc7e0 0x7fb6d814acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6cea00640 1 -- 172.21.15.173:0/2300024851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6d80cc7e0 msgr2=0x7fb6d814acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6cea00640 1 --2- 172.21.15.173:0/2300024851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6d80cc7e0 0x7fb6d814acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6cea00640 1 -- 172.21.15.173:0/2300024851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6d80aeb90 msgr2=0x7fb6d813c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6cea00640 1 --2- 172.21.15.173:0/2300024851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6d80aeb90 0x7fb6d813c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6cea00640 1 -- 172.21.15.173:0/2300024851 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d80b0600 con 0x7fb6d80aef70 2024-04-25T09:06:24.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6cea00640 1 --2- 172.21.15.173:0/2300024851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d80aef70 0x7fb6d80afd20 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb6c001c9b0 tx=0x7fb6c0019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6cfe00640 1 -- 172.21.15.173:0/2300024851 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c00bb070 con 0x7fb6d80aef70 2024-04-25T09:06:24.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6cfe00640 1 -- 172.21.15.173:0/2300024851 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c00b5640 con 0x7fb6d80aef70 2024-04-25T09:06:24.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6cfe00640 1 -- 172.21.15.173:0/2300024851 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c00b1040 con 0x7fb6d80aef70 2024-04-25T09:06:24.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6de800640 1 -- 172.21.15.173:0/2300024851 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d80b08e0 con 0x7fb6d80aef70 2024-04-25T09:06:24.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.986+0000 7fb6de800640 1 -- 172.21.15.173:0/2300024851 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d80b0ea0 con 0x7fb6d80aef70 2024-04-25T09:06:24.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.990+0000 7fb6cfe00640 1 -- 172.21.15.173:0/2300024851 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb6c00b5a30 con 0x7fb6d80aef70 2024-04-25T09:06:24.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.990+0000 7fb6cfe00640 1 --2- 172.21.15.173:0/2300024851 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb6b4066f60 0x7fb6b4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.990+0000 7fb6cfe00640 1 -- 172.21.15.173:0/2300024851 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb6c011e7e0 con 0x7fb6d80aef70 2024-04-25T09:06:24.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.990+0000 7fb6d7400640 1 --2- 172.21.15.173:0/2300024851 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb6b4066f60 0x7fb6b4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.990+0000 7fb6e1d22000 1 Processor -- start 2024-04-25T09:06:24.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6e1d22000 1 -- start start 2024-04-25T09:06:24.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6d7400640 1 --2- 172.21.15.173:0/2300024851 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb6b4066f60 0x7fb6b4069420 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8000f70 tx=0x7fb6c8007c30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6e1d22000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc993a1f0 0x55afc993a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6e1d22000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993ab10 0x55afc98ed3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6e1d22000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc98ed920 0x55afc98edd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6e1d22000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afc973dce0 con 0x55afc993ab10 2024-04-25T09:06:24.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6e1d22000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afc96c6530 con 0x55afc993a1f0 2024-04-25T09:06:24.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6e1d22000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55afc9739d80 con 0x55afc98ed920 2024-04-25T09:06:24.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6cea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993ab10 0x55afc98ed3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6cea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993ab10 0x55afc98ed3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38324/0 (socket says 172.21.15.173:38324) 2024-04-25T09:06:24.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6cea00640 1 -- 172.21.15.173:0/1188344837 learned_addr learned my addr 172.21.15.173:0/1188344837 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:24.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6d7e00640 1 --2- 172.21.15.173:0/1188344837 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc98ed920 0x55afc98edd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6cea00640 1 -- 172.21.15.173:0/1188344837 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc98ed920 msgr2=0x55afc98edd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6d7400640 1 --2- 172.21.15.173:0/1188344837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc993a1f0 0x55afc993a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6cea00640 1 --2- 172.21.15.173:0/1188344837 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc98ed920 0x55afc98edd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6cea00640 1 -- 172.21.15.173:0/1188344837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc993a1f0 msgr2=0x55afc993a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6cea00640 1 --2- 172.21.15.173:0/1188344837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc993a1f0 0x55afc993a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6cea00640 1 -- 172.21.15.173:0/1188344837 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55afc9738cd0 con 0x55afc993ab10 2024-04-25T09:06:24.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6d7e00640 1 --2- 172.21.15.173:0/1188344837 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc98ed920 0x55afc98edd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:24.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6d7400640 1 --2- 172.21.15.173:0/1188344837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc993a1f0 0x55afc993a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:24.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6cea00640 1 --2- 172.21.15.173:0/1188344837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993ab10 0x55afc98ed3e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb6c00f3fd0 tx=0x7fb6c00b2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a96a04a0391f961 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6c7e00640 1 -- 172.21.15.173:0/1188344837 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c00f7670 con 0x55afc993ab10 2024-04-25T09:06:24.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6c7e00640 1 -- 172.21.15.173:0/1188344837 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c00a8050 con 0x55afc993ab10 2024-04-25T09:06:24.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6c7e00640 1 -- 172.21.15.173:0/1188344837 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c00b5d20 con 0x55afc993ab10 2024-04-25T09:06:24.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6e1d22000 1 -- 172.21.15.173:0/1188344837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993ab10 msgr2=0x55afc98ed3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/1188344837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993ab10 0x55afc98ed3e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb6c00f3fd0 tx=0x7fb6c00b2000 comp rx=0 tx=0).stop 2024-04-25T09:06:24.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6e1d22000 1 -- 172.21.15.173:0/1188344837 shutdown_connections 2024-04-25T09:06:24.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/1188344837 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc98ed920 0x55afc98edd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/1188344837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993ab10 0x55afc98ed3e0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/1188344837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc993a1f0 0x55afc993a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6e1d22000 1 -- 172.21.15.173:0/1188344837 >> 172.21.15.173:0/1188344837 conn(0x55afc991af90 msgr2=0x55afc991d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6e1d22000 1 -- 172.21.15.173:0/1188344837 shutdown_connections 2024-04-25T09:06:24.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6e1d22000 1 -- 172.21.15.173:0/1188344837 wait complete. 2024-04-25T09:06:24.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6e1d22000 1 -- start start 2024-04-25T09:06:24.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.994+0000 7fb6e1d22000 1 Processor -- start 2024-04-25T09:06:24.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6e1d22000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc98ed920 0x55afc98f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6e1d22000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc993a1f0 0x55afc98f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6e1d22000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993ab10 0x55afc98f3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6e1d22000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afc96f8bc0 con 0x55afc993ab10 2024-04-25T09:06:24.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6e1d22000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afc98f9130 con 0x55afc993a1f0 2024-04-25T09:06:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6e1d22000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55afc97f7400 con 0x55afc98ed920 2024-04-25T09:06:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6e1d22000 10 client.0 _ll_register_callbacks cb 0x55afc98db4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6d7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993ab10 0x55afc98f3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6d7400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc98ed920 0x55afc98f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6cea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc993a1f0 0x55afc98f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6d7400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc98ed920 0x55afc98f2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:59088/0 (socket says 172.21.15.173:59088) 2024-04-25T09:06:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6d7400640 1 -- 172.21.15.173:0/1470132781 learned_addr learned my addr 172.21.15.173:0/1470132781 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6cea00640 1 -- 172.21.15.173:0/1470132781 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc98ed920 msgr2=0x55afc98f2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6cea00640 1 --2- 172.21.15.173:0/1470132781 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc98ed920 0x55afc98f2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6cea00640 1 -- 172.21.15.173:0/1470132781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993ab10 msgr2=0x55afc98f3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6cea00640 1 --2- 172.21.15.173:0/1470132781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993ab10 0x55afc98f3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6cea00640 1 -- 172.21.15.173:0/1470132781 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55afc974b950 con 0x55afc993a1f0 2024-04-25T09:06:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6d7e00640 1 --2- 172.21.15.173:0/1470132781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993ab10 0x55afc98f3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6cea00640 1 --2- 172.21.15.173:0/1470132781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc993a1f0 0x55afc98f31e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0097eb0 tx=0x7fb6c0009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4d0e466494591db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-04-25T09:06:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6c4c00640 1 -- 172.21.15.173:0/1470132781 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c00f50b0 con 0x55afc993a1f0 2024-04-25T09:06:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6c4c00640 1 -- 172.21.15.173:0/1470132781 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb6c00f5250 con 0x55afc993a1f0 2024-04-25T09:06:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6e1d22000 1 -- 172.21.15.173:0/1470132781 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb6c00a8050 con 0x55afc993a1f0 2024-04-25T09:06:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6c4c00640 1 -- 172.21.15.173:0/1470132781 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6c00ee3b0 con 0x55afc993a1f0 2024-04-25T09:06:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6e1d22000 10 client.6088 fetch_fsmap learned FSMap version 27 2024-04-25T09:06:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6e1d22000 1 -- 172.21.15.173:0/1470132781 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x55afc97ba790 con 0x55afc993a1f0 2024-04-25T09:06:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6c4c00640 1 -- 172.21.15.173:0/1470132781 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c00a8050 con 0x55afc993a1f0 2024-04-25T09:06:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6c4c00640 1 -- 172.21.15.173:0/1470132781 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 27) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb6c00ee550 con 0x55afc993a1f0 2024-04-25T09:06:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6e1d22000 10 client.6088 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T09:06:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6e1d22000 10 client.6088 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6e1d22000 20 client.6088 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/1470132781 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55afc98f4130 0x55afc994b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6e1d22000 4 client.6088 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6e1d22000 1 -- 172.21.15.173:0/1470132781 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55afc96d9b80 con 0x55afc98f4130 2024-04-25T09:06:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6d7400640 1 --2- 172.21.15.173:0/1470132781 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55afc98f4130 0x55afc994b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6c4c00640 10 client.6088 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:24.998+0000 7fb6d7400640 1 --2- 172.21.15.173:0/1470132781 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55afc98f4130 0x55afc994b290 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=695418017a996938 server_cookie=3a74d3ee2e390db4 in_seq=0 out_seq=0 2024-04-25T09:06:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.002+0000 7fb6c4c00640 1 -- 172.21.15.173:0/1470132781 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55afc96d9b80 con 0x55afc98f4130 2024-04-25T09:06:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.002+0000 7fb6c4c00640 10 client.6088 handle_command_reply: tid=0 2024-04-25T09:06:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.002+0000 7fb6e1d22000 1 client.6088 shutdown 2024-04-25T09:06:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.002+0000 7fb6e1d22000 1 -- 172.21.15.173:0/1470132781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc993a1f0 msgr2=0x55afc98f31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.002+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/1470132781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc993a1f0 0x55afc98f31e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0097eb0 tx=0x7fb6c0009240 comp rx=0 tx=0).stop 2024-04-25T09:06:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.002+0000 7fb6e1d22000 1 -- 172.21.15.173:0/1470132781 shutdown_connections 2024-04-25T09:06:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.002+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/1470132781 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55afc98f4130 0x55afc994b290 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.002+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/1470132781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993ab10 0x55afc98f3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.002+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/1470132781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc993a1f0 0x55afc98f31e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.002+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/1470132781 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc98ed920 0x55afc98f2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.002+0000 7fb6e1d22000 1 -- 172.21.15.173:0/1470132781 >> 172.21.15.173:0/1470132781 conn(0x55afc991af90 msgr2=0x55afc991d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.002+0000 7fb6c4c00640 0 client.6088 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.002+0000 7fb6e1d22000 1 -- 172.21.15.173:0/1470132781 shutdown_connections 2024-04-25T09:06:24.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.002+0000 7fb6e1d22000 1 -- 172.21.15.173:0/1470132781 wait complete. 2024-04-25T09:06:24.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.002+0000 7fb6e1d22000 20 client.6088 trim_cache size 0 max 16384 2024-04-25T09:06:25.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.014+0000 7fb6e1d22000 1 Processor -- start 2024-04-25T09:06:25.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.014+0000 7fb6e1d22000 1 -- start start 2024-04-25T09:06:25.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc98ed920 0x55afc99392b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc993a1f0 0x55afc99397f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc993ab10 0x55afc994b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d8203910 con 0x55afc98ed920 2024-04-25T09:06:25.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d8202af0 con 0x55afc993a1f0 2024-04-25T09:06:25.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d80ad960 con 0x55afc993ab10 2024-04-25T09:06:25.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6d7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc98ed920 0x55afc99392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6d7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc98ed920 0x55afc99392b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38340/0 (socket says 172.21.15.173:38340) 2024-04-25T09:06:25.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6d7400640 1 -- 172.21.15.173:0/1359505162 learned_addr learned my addr 172.21.15.173:0/1359505162 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:25.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6cea00640 1 --2- 172.21.15.173:0/1359505162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc993a1f0 0x55afc99397f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6d7e00640 1 --2- 172.21.15.173:0/1359505162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc993ab10 0x55afc994b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6d7400640 1 -- 172.21.15.173:0/1359505162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc993ab10 msgr2=0x55afc994b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:25.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6d7400640 1 --2- 172.21.15.173:0/1359505162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc993ab10 0x55afc994b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6d7400640 1 -- 172.21.15.173:0/1359505162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc993a1f0 msgr2=0x55afc99397f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:25.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6d7400640 1 --2- 172.21.15.173:0/1359505162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc993a1f0 0x55afc99397f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6d7400640 1 -- 172.21.15.173:0/1359505162 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55afc97036f0 con 0x55afc98ed920 2024-04-25T09:06:25.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6d7e00640 1 --2- 172.21.15.173:0/1359505162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc993ab10 0x55afc994b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:25.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6cea00640 1 --2- 172.21.15.173:0/1359505162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc993a1f0 0x55afc99397f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:25.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6d7400640 1 --2- 172.21.15.173:0/1359505162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc98ed920 0x55afc99392b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8005eb0 tx=0x7fb6c8009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515cf0c49413805b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6c7400640 1 -- 172.21.15.173:0/1359505162 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8022460 con 0x55afc98ed920 2024-04-25T09:06:25.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6c7400640 1 -- 172.21.15.173:0/1359505162 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c8022600 con 0x55afc98ed920 2024-04-25T09:06:25.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6c7400640 1 -- 172.21.15.173:0/1359505162 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c80229b0 con 0x55afc98ed920 2024-04-25T09:06:25.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 -- 172.21.15.173:0/1359505162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc98ed920 msgr2=0x55afc99392b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/1359505162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc98ed920 0x55afc99392b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8005eb0 tx=0x7fb6c8009030 comp rx=0 tx=0).stop 2024-04-25T09:06:25.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 -- 172.21.15.173:0/1359505162 shutdown_connections 2024-04-25T09:06:25.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/1359505162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc993ab10 0x55afc994b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/1359505162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc993a1f0 0x55afc99397f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/1359505162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc98ed920 0x55afc99392b0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 -- 172.21.15.173:0/1359505162 >> 172.21.15.173:0/1359505162 conn(0x55afc991af90 msgr2=0x55afc98ec3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 -- 172.21.15.173:0/1359505162 shutdown_connections 2024-04-25T09:06:25.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 -- 172.21.15.173:0/1359505162 wait complete. 2024-04-25T09:06:25.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 -- start start 2024-04-25T09:06:25.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 Processor -- start 2024-04-25T09:06:25.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc98ed920 0x55afc99396a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993a1f0 0x55afc9955d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc993ab10 0x55afc99562a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afc96e48e0 con 0x55afc993a1f0 2024-04-25T09:06:25.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d82024f0 con 0x55afc98ed920 2024-04-25T09:06:25.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55afc98f9130 con 0x55afc993ab10 2024-04-25T09:06:25.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.018+0000 7fb6e1d22000 10 client.0 _ll_register_callbacks cb 0x7fb6c00eb200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:25.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6cea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993a1f0 0x55afc9955d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6cea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993a1f0 0x55afc9955d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38344/0 (socket says 172.21.15.173:38344) 2024-04-25T09:06:25.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6cea00640 1 -- 172.21.15.173:0/816787531 learned_addr learned my addr 172.21.15.173:0/816787531 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:25.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6d7e00640 1 --2- 172.21.15.173:0/816787531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc993ab10 0x55afc99562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6d7400640 1 --2- 172.21.15.173:0/816787531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc98ed920 0x55afc99396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6cea00640 1 -- 172.21.15.173:0/816787531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc993ab10 msgr2=0x55afc99562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:25.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6cea00640 1 --2- 172.21.15.173:0/816787531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc993ab10 0x55afc99562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6cea00640 1 -- 172.21.15.173:0/816787531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc98ed920 msgr2=0x55afc99396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:25.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6cea00640 1 --2- 172.21.15.173:0/816787531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc98ed920 0x55afc99396a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6cea00640 1 -- 172.21.15.173:0/816787531 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55afc96f9c80 con 0x55afc993a1f0 2024-04-25T09:06:25.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6d7e00640 1 --2- 172.21.15.173:0/816787531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc993ab10 0x55afc99562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:25.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6cea00640 1 --2- 172.21.15.173:0/816787531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993a1f0 0x55afc9955d60 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb6c001c300 tx=0x7fb6c00f5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4fcdbee35b9e93 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:25.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6c4c00640 1 -- 172.21.15.173:0/816787531 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c00f52b0 con 0x55afc993a1f0 2024-04-25T09:06:25.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6c4c00640 1 -- 172.21.15.173:0/816787531 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb6c00eacb0 con 0x55afc993a1f0 2024-04-25T09:06:25.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 1 -- 172.21.15.173:0/816787531 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb6c8022600 con 0x55afc993a1f0 2024-04-25T09:06:25.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6c4c00640 1 -- 172.21.15.173:0/816787531 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6c00f7670 con 0x55afc993a1f0 2024-04-25T09:06:25.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 10 client.6438 fetch_fsmap learned FSMap version 27 2024-04-25T09:06:25.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 1 -- 172.21.15.173:0/816787531 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x55afc93fa600 con 0x55afc993a1f0 2024-04-25T09:06:25.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6c4c00640 1 -- 172.21.15.173:0/816787531 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c8022600 con 0x55afc993a1f0 2024-04-25T09:06:25.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6c4c00640 1 -- 172.21.15.173:0/816787531 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 27) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb6c00eaeb0 con 0x55afc993a1f0 2024-04-25T09:06:25.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 10 client.6438 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T09:06:25.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 10 client.6438 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:25.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 20 client.6438 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:25.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/816787531 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55afc999a000 0x55afc999a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 4 client.6438 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-04-25T09:06:25.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 1 -- 172.21.15.173:0/816787531 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) v1 -- 0x55afc974b220 con 0x55afc999a000 2024-04-25T09:06:25.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6d7400640 1 --2- 172.21.15.173:0/816787531 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55afc999a000 0x55afc999a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6d7400640 1 --2- 172.21.15.173:0/816787531 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55afc999a000 0x55afc999a3e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4ed6b914aaf5356 server_cookie=c7cc90e7ef4bf87f in_seq=0 out_seq=0 2024-04-25T09:06:25.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6c4c00640 10 client.6438 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:25.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6c4c00640 1 -- 172.21.15.173:0/816787531 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55afc974b220 con 0x55afc999a000 2024-04-25T09:06:25.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6c4c00640 10 client.6438 handle_command_reply: tid=0 2024-04-25T09:06:25.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 1 client.6438 shutdown 2024-04-25T09:06:25.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 1 -- 172.21.15.173:0/816787531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993a1f0 msgr2=0x55afc9955d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/816787531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993a1f0 0x55afc9955d60 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb6c001c300 tx=0x7fb6c00f5040 comp rx=0 tx=0).stop 2024-04-25T09:06:25.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 1 -- 172.21.15.173:0/816787531 shutdown_connections 2024-04-25T09:06:25.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/816787531 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55afc999a000 0x55afc999a3e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/816787531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55afc993ab10 0x55afc99562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/816787531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afc993a1f0 0x55afc9955d60 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 1 --2- 172.21.15.173:0/816787531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afc98ed920 0x55afc99396a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6c4c00640 0 client.6438 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:25.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 1 -- 172.21.15.173:0/816787531 >> 172.21.15.173:0/816787531 conn(0x55afc991af90 msgr2=0x55afc994d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 1 -- 172.21.15.173:0/816787531 shutdown_connections 2024-04-25T09:06:25.016 INFO:tasks.ceph.mds.a.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fbf79800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096d [2,head] /scrub_test_path/ceph-qa-suite/new_file_1 auth v647 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5381=0-4194304@1} caps={5381=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5381 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x560771569700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x1000000096d:[<0x10000000001/new_file_1 v647>,<0x10000000000/ceph-qa-suite v68>,<0x1/scrub_test_path v23>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-04-25T09:06:25.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 1 -- 172.21.15.173:0/816787531 wait complete. 2024-04-25T09:06:25.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6e1d22000 20 client.6438 trim_cache size 0 max 16384 2024-04-25T09:06:25.017 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:25.017 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0, 2024-04-25T09:06:25.017 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_tag": "70446dc9-ab9d-4d1f-a4c1-8ac11a8b9d81", 2024-04-25T09:06:25.017 INFO:teuthology.orchestra.run.smithi173.stdout: "mode": "asynchronous" 2024-04-25T09:06:25.017 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:25.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6de800640 1 -- 172.21.15.173:0/2300024851 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb6b4066f60 msgr2=0x7fb6b4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6de800640 1 --2- 172.21.15.173:0/2300024851 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb6b4066f60 0x7fb6b4069420 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8000f70 tx=0x7fb6c8007c30 comp rx=0 tx=0).stop 2024-04-25T09:06:25.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6de800640 1 -- 172.21.15.173:0/2300024851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d80aef70 msgr2=0x7fb6d80afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.022+0000 7fb6de800640 1 --2- 172.21.15.173:0/2300024851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d80aef70 0x7fb6d80afd20 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb6c001c9b0 tx=0x7fb6c0019270 comp rx=0 tx=0).stop 2024-04-25T09:06:25.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.026+0000 7fb6de800640 1 -- 172.21.15.173:0/2300024851 shutdown_connections 2024-04-25T09:06:25.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.026+0000 7fb6de800640 1 --2- 172.21.15.173:0/2300024851 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb6b4066f60 0x7fb6b4069420 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.026+0000 7fb6de800640 1 --2- 172.21.15.173:0/2300024851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6d80cc7e0 0x7fb6d814acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.026+0000 7fb6de800640 1 --2- 172.21.15.173:0/2300024851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d80aef70 0x7fb6d80afd20 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.026+0000 7fb6de800640 1 --2- 172.21.15.173:0/2300024851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6d80aeb90 0x7fb6d813c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.026+0000 7fb6de800640 1 -- 172.21.15.173:0/2300024851 >> 172.21.15.173:0/2300024851 conn(0x7fb6d806ac90 msgr2=0x7fb6d80b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.026+0000 7fb6de800640 1 -- 172.21.15.173:0/2300024851 shutdown_connections 2024-04-25T09:06:25.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.026+0000 7fb6de800640 1 -- 172.21.15.173:0/2300024851 wait complete. 2024-04-25T09:06:25.031 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'return_code': 0, 'scrub_tag': '70446dc9-ab9d-4d1f-a4c1-8ac11a8b9d81', 'mode': 'asynchronous'}' 2024-04-25T09:06:25.031 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T09:06:25.032 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T09:06:25.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.182+0000 7f9595200640 1 Processor -- start 2024-04-25T09:06:25.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.182+0000 7f9595200640 1 -- start start 2024-04-25T09:06:25.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.182+0000 7f9595200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f959015bab0 0x7f95900d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.182+0000 7f9595200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f959009a160 0x7f95900c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.182+0000 7f9595200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95900cc7a0 con 0x7f95900cd840 2024-04-25T09:06:25.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.182+0000 7f9595200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95900d07e0 con 0x7f959009a160 2024-04-25T09:06:25.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.182+0000 7f9595200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95900cca80 con 0x7f959015bab0 2024-04-25T09:06:25.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.182+0000 7f958d400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f95900cd840 0x7f9590099a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49540/0 (socket says 172.21.15.173:49540) 2024-04-25T09:06:25.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.182+0000 7f958d400640 1 -- 172.21.15.173:0/2618402422 learned_addr learned my addr 172.21.15.173:0/2618402422 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:25.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.182+0000 7f958de00640 1 --2- 172.21.15.173:0/2618402422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f959015bab0 0x7f95900d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.182+0000 7f958e800640 1 --2- 172.21.15.173:0/2618402422 >> v2:172.21.15.194:3300/0 conn(0x7f959009a160 0x7f95900c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.182+0000 7f958ca00640 1 -- 172.21.15.173:0/2618402422 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284161393 0 0) 0x7f95900cc7a0 con 0x7f95900cd840 2024-04-25T09:06:25.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.182+0000 7f958ca00640 1 -- 172.21.15.173:0/2618402422 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9574003530 con 0x7f95900cd840 2024-04-25T09:06:25.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.182+0000 7f958de00640 1 -- 172.21.15.173:0/2618402422 >> v2:172.21.15.194:3300/0 conn(0x7f959009a160 msgr2=0x7f95900c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:25.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.182+0000 7f958de00640 1 --2- 172.21.15.173:0/2618402422 >> v2:172.21.15.194:3300/0 conn(0x7f959009a160 0x7f95900c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.182+0000 7f958de00640 1 -- 172.21.15.173:0/2618402422 >> v1:172.21.15.173:6789/0 conn(0x7f95900cd840 legacy=0x7f9590099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.182+0000 7f958de00640 1 -- 172.21.15.173:0/2618402422 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95900ccd60 con 0x7f959015bab0 2024-04-25T09:06:25.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.186+0000 7f958de00640 1 --2- 172.21.15.173:0/2618402422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f959015bab0 0x7f95900d02a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f95800097c0 tx=0x7f958001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e6eb300f19aa8c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.186+0000 7f958ca00640 1 -- 172.21.15.173:0/2618402422 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95800a7070 con 0x7f959015bab0 2024-04-25T09:06:25.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.186+0000 7f958ca00640 1 -- 172.21.15.173:0/2618402422 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95800b0070 con 0x7f959015bab0 2024-04-25T09:06:25.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.186+0000 7f958ca00640 1 -- 172.21.15.173:0/2618402422 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95800ab890 con 0x7f959015bab0 2024-04-25T09:06:25.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.186+0000 7f9595200640 1 -- 172.21.15.173:0/2618402422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f959015bab0 msgr2=0x7f95900d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.186+0000 7f9595200640 1 --2- 172.21.15.173:0/2618402422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f959015bab0 0x7f95900d02a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f95800097c0 tx=0x7f958001c470 comp rx=0 tx=0).stop 2024-04-25T09:06:25.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.186+0000 7f9595200640 1 -- 172.21.15.173:0/2618402422 shutdown_connections 2024-04-25T09:06:25.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.186+0000 7f9595200640 1 --2- 172.21.15.173:0/2618402422 >> v2:172.21.15.194:3300/0 conn(0x7f959009a160 0x7f95900c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.186+0000 7f9595200640 1 --2- 172.21.15.173:0/2618402422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f959015bab0 0x7f95900d02a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.186+0000 7f9595200640 1 -- 172.21.15.173:0/2618402422 >> 172.21.15.173:0/2618402422 conn(0x7f95900b32a0 msgr2=0x7f95900b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.186+0000 7f9595200640 1 -- 172.21.15.173:0/2618402422 shutdown_connections 2024-04-25T09:06:25.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.186+0000 7f9595200640 1 -- 172.21.15.173:0/2618402422 wait complete. 2024-04-25T09:06:25.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f9595200640 1 Processor -- start 2024-04-25T09:06:25.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f9595200640 1 -- start start 2024-04-25T09:06:25.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f9595200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f959009a160 0x7f95900b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f9595200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95900cd840 0x7f95900b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f9595200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f959015bab0 0x7f959006f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f9595200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95900cc540 con 0x7f95900cd840 2024-04-25T09:06:25.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f9595200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95900cc3c0 con 0x7f959015bab0 2024-04-25T09:06:25.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f9595200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95900cf540 con 0x7f959009a160 2024-04-25T09:06:25.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f958d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95900cd840 0x7f95900b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f958d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95900cd840 0x7f95900b62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38360/0 (socket says 172.21.15.173:38360) 2024-04-25T09:06:25.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f958d400640 1 -- 172.21.15.173:0/438024790 learned_addr learned my addr 172.21.15.173:0/438024790 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:25.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f958de00640 1 --2- 172.21.15.173:0/438024790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f959009a160 0x7f95900b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f958e800640 1 --2- 172.21.15.173:0/438024790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f959015bab0 0x7f959006f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f958d400640 1 -- 172.21.15.173:0/438024790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f959009a160 msgr2=0x7f95900b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f958d400640 1 --2- 172.21.15.173:0/438024790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f959009a160 0x7f95900b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f958d400640 1 -- 172.21.15.173:0/438024790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f959015bab0 msgr2=0x7f959006f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f958d400640 1 --2- 172.21.15.173:0/438024790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f959015bab0 0x7f959006f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f958d400640 1 -- 172.21.15.173:0/438024790 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95901fa460 con 0x7f95900cd840 2024-04-25T09:06:25.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f958e800640 1 --2- 172.21.15.173:0/438024790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f959015bab0 0x7f959006f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:25.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f958d400640 1 --2- 172.21.15.173:0/438024790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95900cd840 0x7f95900b62f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f957c00c450 tx=0x7f957c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f9586000640 1 -- 172.21.15.173:0/438024790 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c017070 con 0x7f95900cd840 2024-04-25T09:06:25.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f9586000640 1 -- 172.21.15.173:0/438024790 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c005cf0 con 0x7f95900cd840 2024-04-25T09:06:25.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f9586000640 1 -- 172.21.15.173:0/438024790 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c007290 con 0x7f95900cd840 2024-04-25T09:06:25.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f9595200640 1 -- 172.21.15.173:0/438024790 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95901fa740 con 0x7f95900cd840 2024-04-25T09:06:25.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.190+0000 7f9595200640 1 -- 172.21.15.173:0/438024790 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95901fad00 con 0x7f95900cd840 2024-04-25T09:06:25.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.194+0000 7f9586000640 1 -- 172.21.15.173:0/438024790 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f957c01a070 con 0x7f95900cd840 2024-04-25T09:06:25.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.194+0000 7f9586000640 1 --2- 172.21.15.173:0/438024790 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9570066f60 0x7f9570069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.194+0000 7f9598716000 1 Processor -- start 2024-04-25T09:06:25.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.194+0000 7f9586000640 1 -- 172.21.15.173:0/438024790 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f957c084560 con 0x7f95900cd840 2024-04-25T09:06:25.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.194+0000 7f958de00640 1 --2- 172.21.15.173:0/438024790 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9570066f60 0x7f9570069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.194+0000 7f9598716000 1 -- start start 2024-04-25T09:06:25.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.194+0000 7f958de00640 1 --2- 172.21.15.173:0/438024790 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9570066f60 0x7f9570069420 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f95800af000 tx=0x7f95800a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.194+0000 7f9598716000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be699d0 0x56522be69db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.194+0000 7f9598716000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be6a2f0 0x56522be1fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.194+0000 7f9598716000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be200a0 0x56522be20480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.194+0000 7f9598716000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56522bc6cff0 con 0x56522be699d0 2024-04-25T09:06:25.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.194+0000 7f9598716000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56522bbf5150 con 0x56522be6a2f0 2024-04-25T09:06:25.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.194+0000 7f9598716000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56522bc69090 con 0x56522be200a0 2024-04-25T09:06:25.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.194+0000 7f958de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be699d0 0x56522be69db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.194+0000 7f958de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be699d0 0x56522be69db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38366/0 (socket says 172.21.15.173:38366) 2024-04-25T09:06:25.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.194+0000 7f958de00640 1 -- 172.21.15.173:0/1494772462 learned_addr learned my addr 172.21.15.173:0/1494772462 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:25.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.194+0000 7f958d400640 1 --2- 172.21.15.173:0/1494772462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be6a2f0 0x56522be1fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.194+0000 7f958e800640 1 --2- 172.21.15.173:0/1494772462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be200a0 0x56522be20480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f958de00640 1 -- 172.21.15.173:0/1494772462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be200a0 msgr2=0x56522be20480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:25.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f958de00640 1 --2- 172.21.15.173:0/1494772462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be200a0 0x56522be20480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f958de00640 1 -- 172.21.15.173:0/1494772462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be6a2f0 msgr2=0x56522be1fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:25.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f958de00640 1 --2- 172.21.15.173:0/1494772462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be6a2f0 0x56522be1fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f958de00640 1 -- 172.21.15.173:0/1494772462 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56522be030d0 con 0x56522be699d0 2024-04-25T09:06:25.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f958de00640 1 --2- 172.21.15.173:0/1494772462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be699d0 0x56522be69db0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f958001a0a0 tx=0x7f9580004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657d1de6dc794879 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f957aa00640 1 -- 172.21.15.173:0/1494772462 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95800bc070 con 0x56522be699d0 2024-04-25T09:06:25.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f957aa00640 1 -- 172.21.15.173:0/1494772462 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95800b0040 con 0x56522be699d0 2024-04-25T09:06:25.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f957aa00640 1 -- 172.21.15.173:0/1494772462 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95800cc480 con 0x56522be699d0 2024-04-25T09:06:25.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f9598716000 1 -- 172.21.15.173:0/1494772462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be699d0 msgr2=0x56522be69db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f9598716000 1 --2- 172.21.15.173:0/1494772462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be699d0 0x56522be69db0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f958001a0a0 tx=0x7f9580004740 comp rx=0 tx=0).stop 2024-04-25T09:06:25.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f9598716000 1 -- 172.21.15.173:0/1494772462 shutdown_connections 2024-04-25T09:06:25.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f9598716000 1 --2- 172.21.15.173:0/1494772462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be200a0 0x56522be20480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f9598716000 1 --2- 172.21.15.173:0/1494772462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be6a2f0 0x56522be1fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f9598716000 1 --2- 172.21.15.173:0/1494772462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be699d0 0x56522be69db0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f9598716000 1 -- 172.21.15.173:0/1494772462 >> 172.21.15.173:0/1494772462 conn(0x56522be1c020 msgr2=0x56522be1e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f9598716000 1 -- 172.21.15.173:0/1494772462 shutdown_connections 2024-04-25T09:06:25.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f9598716000 1 -- 172.21.15.173:0/1494772462 wait complete. 2024-04-25T09:06:25.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f9598716000 1 -- start start 2024-04-25T09:06:25.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f9598716000 1 Processor -- start 2024-04-25T09:06:25.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f9598716000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be200a0 0x56522be4e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f9598716000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be699d0 0x56522be4ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f9598716000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be6a2f0 0x56522be4f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f9598716000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56522bc31250 con 0x56522be200a0 2024-04-25T09:06:25.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f9598716000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56522bc27690 con 0x56522be699d0 2024-04-25T09:06:25.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f9598716000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56522bbf5a40 con 0x56522be6a2f0 2024-04-25T09:06:25.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f9598716000 10 client.0 _ll_register_callbacks cb 0x56522be0ae90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:25.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f958de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be200a0 0x56522be4e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f958de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be200a0 0x56522be4e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38380/0 (socket says 172.21.15.173:38380) 2024-04-25T09:06:25.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f958de00640 1 -- 172.21.15.173:0/3153656644 learned_addr learned my addr 172.21.15.173:0/3153656644 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:25.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f958d400640 1 --2- 172.21.15.173:0/3153656644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be699d0 0x56522be4ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f958e800640 1 --2- 172.21.15.173:0/3153656644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be6a2f0 0x56522be4f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f958de00640 1 -- 172.21.15.173:0/3153656644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be6a2f0 msgr2=0x56522be4f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:25.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f958de00640 1 --2- 172.21.15.173:0/3153656644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be6a2f0 0x56522be4f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f958de00640 1 -- 172.21.15.173:0/3153656644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be699d0 msgr2=0x56522be4ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:25.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f958de00640 1 --2- 172.21.15.173:0/3153656644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be699d0 0x56522be4ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f958de00640 1 -- 172.21.15.173:0/3153656644 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56522bd1a1c0 con 0x56522be200a0 2024-04-25T09:06:25.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.198+0000 7f958d400640 1 --2- 172.21.15.173:0/3153656644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be699d0 0x56522be4ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:25.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f958de00640 1 --2- 172.21.15.173:0/3153656644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be200a0 0x56522be4e7f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f958001a0a0 tx=0x7f958001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae695e5455d28ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f956f400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:25.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f956f400640 1 -- 172.21.15.173:0/3153656644 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95800bc040 con 0x56522be200a0 2024-04-25T09:06:25.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f956f400640 1 -- 172.21.15.173:0/3153656644 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f95800cc740 con 0x56522be200a0 2024-04-25T09:06:25.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 1 -- 172.21.15.173:0/3153656644 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f95800b0040 con 0x56522be200a0 2024-04-25T09:06:25.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f956f400640 1 -- 172.21.15.173:0/3153656644 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95800dd050 con 0x56522be200a0 2024-04-25T09:06:25.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 10 client.6450 fetch_fsmap learned FSMap version 27 2024-04-25T09:06:25.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 1 -- 172.21.15.173:0/3153656644 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x56522bd16170 con 0x56522be200a0 2024-04-25T09:06:25.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f956f400640 1 -- 172.21.15.173:0/3153656644 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95800b0040 con 0x56522be200a0 2024-04-25T09:06:25.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f956f400640 1 -- 172.21.15.173:0/3153656644 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 27) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f95800e0020 con 0x56522be200a0 2024-04-25T09:06:25.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 10 client.6450 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T09:06:25.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 10 client.6450 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:25.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 20 client.6450 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:25.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 1 --2- 172.21.15.173:0/3153656644 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x56522be79c80 0x56522be7c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 4 client.6450 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:25.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 1 -- 172.21.15.173:0/3153656644 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56522bc08c60 con 0x56522be79c80 2024-04-25T09:06:25.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f958d400640 1 --2- 172.21.15.173:0/3153656644 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x56522be79c80 0x56522be7c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f958d400640 1 --2- 172.21.15.173:0/3153656644 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x56522be79c80 0x56522be7c070 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=654dbc018faecd17 server_cookie=1e2935dbce79862f in_seq=0 out_seq=0 2024-04-25T09:06:25.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f956f400640 10 client.6450 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:25.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f956f400640 1 -- 172.21.15.173:0/3153656644 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56522bc08c60 con 0x56522be79c80 2024-04-25T09:06:25.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f956f400640 10 client.6450 handle_command_reply: tid=0 2024-04-25T09:06:25.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 1 client.6450 shutdown 2024-04-25T09:06:25.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 1 -- 172.21.15.173:0/3153656644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be200a0 msgr2=0x56522be4e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 1 --2- 172.21.15.173:0/3153656644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be200a0 0x56522be4e7f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f958001a0a0 tx=0x7f958001acb0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 1 -- 172.21.15.173:0/3153656644 shutdown_connections 2024-04-25T09:06:25.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 1 --2- 172.21.15.173:0/3153656644 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x56522be79c80 0x56522be7c070 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 1 --2- 172.21.15.173:0/3153656644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be6a2f0 0x56522be4f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 1 --2- 172.21.15.173:0/3153656644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be699d0 0x56522be4ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f956f400640 0 client.6450 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:25.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 1 --2- 172.21.15.173:0/3153656644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be200a0 0x56522be4e7f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 1 -- 172.21.15.173:0/3153656644 >> 172.21.15.173:0/3153656644 conn(0x56522be1c020 msgr2=0x56522be1eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 1 -- 172.21.15.173:0/3153656644 shutdown_connections 2024-04-25T09:06:25.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 1 -- 172.21.15.173:0/3153656644 wait complete. 2024-04-25T09:06:25.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.202+0000 7f9598716000 20 client.6450 trim_cache size 0 max 16384 2024-04-25T09:06:25.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f9598716000 1 Processor -- start 2024-04-25T09:06:25.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f9598716000 1 -- start start 2024-04-25T09:06:25.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f9598716000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be200a0 0x56522be1e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f9598716000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be699d0 0x56522be1e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f9598716000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be6a2f0 0x56522be1ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f9598716000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9590203250 con 0x56522be6a2f0 2024-04-25T09:06:25.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f9598716000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9590202510 con 0x56522be699d0 2024-04-25T09:06:25.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f9598716000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9590155440 con 0x56522be200a0 2024-04-25T09:06:25.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f958e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be6a2f0 0x56522be1ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f958e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be6a2f0 0x56522be1ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38388/0 (socket says 172.21.15.173:38388) 2024-04-25T09:06:25.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f958e800640 1 -- 172.21.15.173:0/1057511247 learned_addr learned my addr 172.21.15.173:0/1057511247 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:25.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f958de00640 1 --2- 172.21.15.173:0/1057511247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be200a0 0x56522be1e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f958d400640 1 --2- 172.21.15.173:0/1057511247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be699d0 0x56522be1e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f958e800640 1 -- 172.21.15.173:0/1057511247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be200a0 msgr2=0x56522be1e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:25.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f958e800640 1 --2- 172.21.15.173:0/1057511247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be200a0 0x56522be1e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f958e800640 1 -- 172.21.15.173:0/1057511247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be699d0 msgr2=0x56522be1e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:25.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f958e800640 1 --2- 172.21.15.173:0/1057511247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be699d0 0x56522be1e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f958e800640 1 -- 172.21.15.173:0/1057511247 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56522bcb3de0 con 0x56522be6a2f0 2024-04-25T09:06:25.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f958e800640 1 --2- 172.21.15.173:0/1057511247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be6a2f0 0x56522be1ee90 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9588007470 tx=0x7f9588009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54b76a5c58aa943 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f957a000640 1 -- 172.21.15.173:0/1057511247 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958801c070 con 0x56522be6a2f0 2024-04-25T09:06:25.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f957a000640 1 -- 172.21.15.173:0/1057511247 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9588017680 con 0x56522be6a2f0 2024-04-25T09:06:25.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.218+0000 7f957a000640 1 -- 172.21.15.173:0/1057511247 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588017a50 con 0x56522be6a2f0 2024-04-25T09:06:25.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 1 -- 172.21.15.173:0/1057511247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be6a2f0 msgr2=0x56522be1ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 1 --2- 172.21.15.173:0/1057511247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be6a2f0 0x56522be1ee90 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9588007470 tx=0x7f9588009750 comp rx=0 tx=0).stop 2024-04-25T09:06:25.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 1 -- 172.21.15.173:0/1057511247 shutdown_connections 2024-04-25T09:06:25.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 1 --2- 172.21.15.173:0/1057511247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be6a2f0 0x56522be1ee90 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 1 --2- 172.21.15.173:0/1057511247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be699d0 0x56522be1e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 1 --2- 172.21.15.173:0/1057511247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be200a0 0x56522be1e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 1 -- 172.21.15.173:0/1057511247 >> 172.21.15.173:0/1057511247 conn(0x56522be1c020 msgr2=0x56522be680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 1 -- 172.21.15.173:0/1057511247 shutdown_connections 2024-04-25T09:06:25.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 1 -- 172.21.15.173:0/1057511247 wait complete. 2024-04-25T09:06:25.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 1 -- start start 2024-04-25T09:06:25.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 1 Processor -- start 2024-04-25T09:06:25.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be200a0 0x56522be7c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be699d0 0x56522be7c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be6a2f0 0x56522be7ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56522bc07e00 con 0x56522be6a2f0 2024-04-25T09:06:25.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9590155a40 con 0x56522be699d0 2024-04-25T09:06:25.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56522bc6c300 con 0x56522be200a0 2024-04-25T09:06:25.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 10 client.0 _ll_register_callbacks cb 0x56522bdeb040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:25.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f958e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be6a2f0 0x56522be7ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f958e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be6a2f0 0x56522be7ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38390/0 (socket says 172.21.15.173:38390) 2024-04-25T09:06:25.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f958d400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be699d0 0x56522be7c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f958e800640 1 -- 172.21.15.173:0/2630815886 learned_addr learned my addr 172.21.15.173:0/2630815886 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:25.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f958de00640 1 --2- 172.21.15.173:0/2630815886 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be200a0 0x56522be7c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f958e800640 1 -- 172.21.15.173:0/2630815886 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be200a0 msgr2=0x56522be7c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:25.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f958e800640 1 --2- 172.21.15.173:0/2630815886 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be200a0 0x56522be7c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f958e800640 1 -- 172.21.15.173:0/2630815886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be699d0 msgr2=0x56522be7c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:25.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f958e800640 1 --2- 172.21.15.173:0/2630815886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be699d0 0x56522be7c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f958e800640 1 -- 172.21.15.173:0/2630815886 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56522bc0e8e0 con 0x56522be6a2f0 2024-04-25T09:06:25.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f958e800640 1 --2- 172.21.15.173:0/2630815886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be6a2f0 0x56522be7ce00 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x56522bc0d060 tx=0x7f9588004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b841a69edc8706 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f956f400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f956f400640 1 -- 172.21.15.173:0/2630815886 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958802f060 con 0x56522be6a2f0 2024-04-25T09:06:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f956f400640 1 -- 172.21.15.173:0/2630815886 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9588021450 con 0x56522be6a2f0 2024-04-25T09:06:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.222+0000 7f9598716000 1 -- 172.21.15.173:0/2630815886 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9588017680 con 0x56522be6a2f0 2024-04-25T09:06:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f956f400640 1 -- 172.21.15.173:0/2630815886 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9588035050 con 0x56522be6a2f0 2024-04-25T09:06:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 10 client.6456 fetch_fsmap learned FSMap version 27 2024-04-25T09:06:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 1 -- 172.21.15.173:0/2630815886 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x56522bcc68f0 con 0x56522be6a2f0 2024-04-25T09:06:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f956f400640 1 -- 172.21.15.173:0/2630815886 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9588017680 con 0x56522be6a2f0 2024-04-25T09:06:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f956f400640 1 -- 172.21.15.173:0/2630815886 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 27) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9588038020 con 0x56522be6a2f0 2024-04-25T09:06:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 10 client.6456 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T09:06:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 10 client.6456 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 20 client.6456 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 1 --2- 172.21.15.173:0/2630815886 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x56522be7d9c0 0x56522bed1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 4 client.6456 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:06:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 1 -- 172.21.15.173:0/2630815886 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56522bc7a530 con 0x56522be7d9c0 2024-04-25T09:06:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f958de00640 1 --2- 172.21.15.173:0/2630815886 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x56522be7d9c0 0x56522bed1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f958de00640 1 --2- 172.21.15.173:0/2630815886 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x56522be7d9c0 0x56522bed1f60 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed5cdc18217bac8c server_cookie=48887df14fe80ba9 in_seq=0 out_seq=0 2024-04-25T09:06:25.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f956f400640 10 client.6456 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:25.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f956f400640 1 -- 172.21.15.173:0/2630815886 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+284 (crc 0 0 0) 0x56522bc7a530 con 0x56522be7d9c0 2024-04-25T09:06:25.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f956f400640 10 client.6456 handle_command_reply: tid=0 2024-04-25T09:06:25.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 1 client.6456 shutdown 2024-04-25T09:06:25.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 1 -- 172.21.15.173:0/2630815886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be6a2f0 msgr2=0x56522be7ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 1 --2- 172.21.15.173:0/2630815886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be6a2f0 0x56522be7ce00 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x56522bc0d060 tx=0x7f9588004ac0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 1 -- 172.21.15.173:0/2630815886 shutdown_connections 2024-04-25T09:06:25.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 1 --2- 172.21.15.173:0/2630815886 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x56522be7d9c0 0x56522bed1f60 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 1 --2- 172.21.15.173:0/2630815886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56522be6a2f0 0x56522be7ce00 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 1 --2- 172.21.15.173:0/2630815886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56522be699d0 0x56522be7c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 1 --2- 172.21.15.173:0/2630815886 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56522be200a0 0x56522be7c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f956f400640 0 client.6456 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:25.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 1 -- 172.21.15.173:0/2630815886 >> 172.21.15.173:0/2630815886 conn(0x56522be1c020 msgr2=0x56522be68930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 1 -- 172.21.15.173:0/2630815886 shutdown_connections 2024-04-25T09:06:25.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 1 -- 172.21.15.173:0/2630815886 wait complete. 2024-04-25T09:06:25.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9598716000 20 client.6456 trim_cache size 0 max 16384 2024-04-25T09:06:25.218 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:25.218 INFO:teuthology.orchestra.run.smithi173.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:06:25.218 INFO:teuthology.orchestra.run.smithi173.stdout: "scrubs": { 2024-04-25T09:06:25.218 INFO:teuthology.orchestra.run.smithi173.stdout: "70446dc9-ab9d-4d1f-a4c1-8ac11a8b9d81": { 2024-04-25T09:06:25.219 INFO:teuthology.orchestra.run.smithi173.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-04-25T09:06:25.219 INFO:teuthology.orchestra.run.smithi173.stdout: "tag": "70446dc9-ab9d-4d1f-a4c1-8ac11a8b9d81", 2024-04-25T09:06:25.219 INFO:teuthology.orchestra.run.smithi173.stdout: "options": "" 2024-04-25T09:06:25.219 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:25.219 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:25.219 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:25.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9595200640 1 -- 172.21.15.173:0/438024790 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9570066f60 msgr2=0x7f9570069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9595200640 1 --2- 172.21.15.173:0/438024790 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9570066f60 0x7f9570069420 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f95800af000 tx=0x7f95800a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:25.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9595200640 1 -- 172.21.15.173:0/438024790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95900cd840 msgr2=0x7f95900b62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9595200640 1 --2- 172.21.15.173:0/438024790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95900cd840 0x7f95900b62f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f957c00c450 tx=0x7f957c00c910 comp rx=0 tx=0).stop 2024-04-25T09:06:25.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9595200640 1 -- 172.21.15.173:0/438024790 shutdown_connections 2024-04-25T09:06:25.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9595200640 1 --2- 172.21.15.173:0/438024790 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9570066f60 0x7f9570069420 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9595200640 1 --2- 172.21.15.173:0/438024790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f959015bab0 0x7f959006f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9595200640 1 --2- 172.21.15.173:0/438024790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95900cd840 0x7f95900b62f0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9595200640 1 --2- 172.21.15.173:0/438024790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f959009a160 0x7f95900b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9595200640 1 -- 172.21.15.173:0/438024790 >> 172.21.15.173:0/438024790 conn(0x7f95900b32a0 msgr2=0x7f959006d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9595200640 1 -- 172.21.15.173:0/438024790 shutdown_connections 2024-04-25T09:06:25.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:25.226+0000 7f9595200640 1 -- 172.21.15.173:0/438024790 wait complete. 2024-04-25T09:06:30.234 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T09:06:30.234 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T09:06:30.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.394+0000 7f508bc00640 1 Processor -- start 2024-04-25T09:06:30.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.394+0000 7f508bc00640 1 -- start start 2024-04-25T09:06:30.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.398+0000 7f508bc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50840b3fe0 0x7f50840b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.398+0000 7f508bc00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508406d4b0 con 0x7f5084145290 2024-04-25T09:06:30.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.398+0000 7f508bc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508406d790 con 0x7f50840cc260 2024-04-25T09:06:30.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.398+0000 7f508bc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508406da70 con 0x7f50840b3fe0 2024-04-25T09:06:30.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.398+0000 7f5089200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f5084145290 0x7f508415c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49542/0 (socket says 172.21.15.173:49542) 2024-04-25T09:06:30.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.398+0000 7f5089200640 1 -- 172.21.15.173:0/354679663 learned_addr learned my addr 172.21.15.173:0/354679663 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:30.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.398+0000 7f507be00640 1 --2- 172.21.15.173:0/354679663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50840b3fe0 0x7f50840b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.398+0000 7f5083e00640 1 -- 172.21.15.173:0/354679663 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2630562860 0 0) 0x7f508406d4b0 con 0x7f5084145290 2024-04-25T09:06:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.398+0000 7f5083e00640 1 -- 172.21.15.173:0/354679663 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5068003530 con 0x7f5084145290 2024-04-25T09:06:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.398+0000 7f5083e00640 1 -- 172.21.15.173:0/354679663 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258896869 0 0) 0x7f508406d790 con 0x7f50840cc260 2024-04-25T09:06:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.398+0000 7f5083e00640 1 -- 172.21.15.173:0/354679663 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f508406d4b0 con 0x7f50840cc260 2024-04-25T09:06:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.398+0000 7f5083e00640 1 -- 172.21.15.173:0/354679663 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1412564105 0 0) 0x7f5068003530 con 0x7f5084145290 2024-04-25T09:06:30.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.398+0000 7f507be00640 1 -- 172.21.15.173:0/354679663 >> v1:172.21.15.194:6789/0 conn(0x7f50840cc260 legacy=0x7f50840cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.398+0000 7f507be00640 1 -- 172.21.15.173:0/354679663 >> v1:172.21.15.173:6789/0 conn(0x7f5084145290 legacy=0x7f508415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.398+0000 7f507be00640 1 -- 172.21.15.173:0/354679663 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508406dd50 con 0x7f50840b3fe0 2024-04-25T09:06:30.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.402+0000 7f507be00640 1 --2- 172.21.15.173:0/354679663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50840b3fe0 0x7f50840b4420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f506c0097f0 tx=0x7f506c01c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bffa361d08078f24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.402+0000 7f5083e00640 1 -- 172.21.15.173:0/354679663 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c0b0070 con 0x7f50840b3fe0 2024-04-25T09:06:30.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.402+0000 7f5083e00640 1 -- 172.21.15.173:0/354679663 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c0ab400 con 0x7f50840b3fe0 2024-04-25T09:06:30.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.402+0000 7f5083e00640 1 -- 172.21.15.173:0/354679663 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5074001680 con 0x7f50840b3fe0 2024-04-25T09:06:30.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.402+0000 7f508bc00640 1 -- 172.21.15.173:0/354679663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50840b3fe0 msgr2=0x7f50840b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.402+0000 7f508bc00640 1 --2- 172.21.15.173:0/354679663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50840b3fe0 0x7f50840b4420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f506c0097f0 tx=0x7f506c01c2e0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.402+0000 7f508bc00640 1 -- 172.21.15.173:0/354679663 shutdown_connections 2024-04-25T09:06:30.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.402+0000 7f508bc00640 1 --2- 172.21.15.173:0/354679663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50840b3fe0 0x7f50840b4420 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.402+0000 7f508bc00640 1 -- 172.21.15.173:0/354679663 >> 172.21.15.173:0/354679663 conn(0x7f508406ac90 msgr2=0x7f508406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.402+0000 7f508bc00640 1 -- 172.21.15.173:0/354679663 shutdown_connections 2024-04-25T09:06:30.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.402+0000 7f508bc00640 1 -- 172.21.15.173:0/354679663 wait complete. 2024-04-25T09:06:30.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.402+0000 7f508bc00640 1 Processor -- start 2024-04-25T09:06:30.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.402+0000 7f508bc00640 1 -- start start 2024-04-25T09:06:30.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.402+0000 7f508bc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50840b3fe0 0x7f50840ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.402+0000 7f508bc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50840cc260 0x7f508413c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f508bc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5084145290 0x7f5084141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f508bc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508406f130 con 0x7f50840b3fe0 2024-04-25T09:06:30.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f508bc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508406efb0 con 0x7f50840cc260 2024-04-25T09:06:30.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f508bc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508413c8f0 con 0x7f5084145290 2024-04-25T09:06:30.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f5089200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50840b3fe0 0x7f50840ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f5089200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50840b3fe0 0x7f50840ae3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38392/0 (socket says 172.21.15.173:38392) 2024-04-25T09:06:30.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f5089200640 1 -- 172.21.15.173:0/2655777798 learned_addr learned my addr 172.21.15.173:0/2655777798 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:30.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f5089c00640 1 --2- 172.21.15.173:0/2655777798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5084145290 0x7f5084141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f507be00640 1 --2- 172.21.15.173:0/2655777798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50840cc260 0x7f508413c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f5089200640 1 -- 172.21.15.173:0/2655777798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5084145290 msgr2=0x7f5084141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f5089200640 1 --2- 172.21.15.173:0/2655777798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5084145290 0x7f5084141bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f5089200640 1 -- 172.21.15.173:0/2655777798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50840cc260 msgr2=0x7f508413c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f5089200640 1 --2- 172.21.15.173:0/2655777798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50840cc260 0x7f508413c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f5089200640 1 -- 172.21.15.173:0/2655777798 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50840aea50 con 0x7f50840b3fe0 2024-04-25T09:06:30.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f5089200640 1 --2- 172.21.15.173:0/2655777798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50840b3fe0 0x7f50840ae3c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f507400c750 tx=0x7f507400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f5081600640 1 -- 172.21.15.173:0/2655777798 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5074005af0 con 0x7f50840b3fe0 2024-04-25T09:06:30.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f5081600640 1 -- 172.21.15.173:0/2655777798 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5074005cb0 con 0x7f50840b3fe0 2024-04-25T09:06:30.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f5081600640 1 -- 172.21.15.173:0/2655777798 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5074005e60 con 0x7f50840b3fe0 2024-04-25T09:06:30.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f508bc00640 1 -- 172.21.15.173:0/2655777798 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50840aed30 con 0x7f50840b3fe0 2024-04-25T09:06:30.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.406+0000 7f508bc00640 1 -- 172.21.15.173:0/2655777798 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5084141690 con 0x7f50840b3fe0 2024-04-25T09:06:30.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f5081600640 1 -- 172.21.15.173:0/2655777798 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f50740072b0 con 0x7f50840b3fe0 2024-04-25T09:06:30.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f5081600640 1 --2- 172.21.15.173:0/2655777798 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5060066f60 0x7f5060069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f5081600640 1 -- 172.21.15.173:0/2655777798 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5074084ed0 con 0x7f50840b3fe0 2024-04-25T09:06:30.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f507be00640 1 --2- 172.21.15.173:0/2655777798 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5060066f60 0x7f5060069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f508f193000 1 Processor -- start 2024-04-25T09:06:30.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f508f193000 1 -- start start 2024-04-25T09:06:30.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f507be00640 1 --2- 172.21.15.173:0/2655777798 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5060066f60 0x7f5060069420 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f506c0ad000 tx=0x7f506c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f508f193000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e69d0 0x55de6e3e6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f508f193000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e3e72f0 0x55de6e39cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f508f193000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 0x55de6e39d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f508f193000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de6e1e9ff0 con 0x55de6e39d0a0 2024-04-25T09:06:30.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f508f193000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de6e172150 con 0x55de6e3e72f0 2024-04-25T09:06:30.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f508f193000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de6e1e6090 con 0x55de6e3e69d0 2024-04-25T09:06:30.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f5089c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 0x55de6e39d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f5089c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 0x55de6e39d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38394/0 (socket says 172.21.15.173:38394) 2024-04-25T09:06:30.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f5089c00640 1 -- 172.21.15.173:0/4087353541 learned_addr learned my addr 172.21.15.173:0/4087353541 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:30.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f507be00640 1 --2- 172.21.15.173:0/4087353541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e3e72f0 0x55de6e39cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f5089200640 1 --2- 172.21.15.173:0/4087353541 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e69d0 0x55de6e3e6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f5089c00640 1 -- 172.21.15.173:0/4087353541 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e69d0 msgr2=0x55de6e3e6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f5089c00640 1 --2- 172.21.15.173:0/4087353541 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e69d0 0x55de6e3e6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f5089c00640 1 -- 172.21.15.173:0/4087353541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e3e72f0 msgr2=0x55de6e39cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f5089c00640 1 --2- 172.21.15.173:0/4087353541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e3e72f0 0x55de6e39cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f5089c00640 1 -- 172.21.15.173:0/4087353541 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de6e3800d0 con 0x55de6e39d0a0 2024-04-25T09:06:30.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f5089c00640 1 --2- 172.21.15.173:0/4087353541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 0x55de6e39d480 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f507c001ec0 tx=0x7f507c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61263114a0295952 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f5079600640 1 -- 172.21.15.173:0/4087353541 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c0020d0 con 0x55de6e39d0a0 2024-04-25T09:06:30.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f5079600640 1 -- 172.21.15.173:0/4087353541 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c018070 con 0x55de6e39d0a0 2024-04-25T09:06:30.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.410+0000 7f5079600640 1 -- 172.21.15.173:0/4087353541 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c003bc0 con 0x55de6e39d0a0 2024-04-25T09:06:30.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 -- 172.21.15.173:0/4087353541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 msgr2=0x55de6e39d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 --2- 172.21.15.173:0/4087353541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 0x55de6e39d480 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f507c001ec0 tx=0x7f507c001640 comp rx=0 tx=0).stop 2024-04-25T09:06:30.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 -- 172.21.15.173:0/4087353541 shutdown_connections 2024-04-25T09:06:30.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 --2- 172.21.15.173:0/4087353541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 0x55de6e39d480 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 --2- 172.21.15.173:0/4087353541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e3e72f0 0x55de6e39cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 --2- 172.21.15.173:0/4087353541 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e69d0 0x55de6e3e6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 -- 172.21.15.173:0/4087353541 >> 172.21.15.173:0/4087353541 conn(0x55de6e399020 msgr2=0x55de6e39b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 -- 172.21.15.173:0/4087353541 shutdown_connections 2024-04-25T09:06:30.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 -- 172.21.15.173:0/4087353541 wait complete. 2024-04-25T09:06:30.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 -- start start 2024-04-25T09:06:30.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 Processor -- start 2024-04-25T09:06:30.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 0x55de6e3cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e3e69d0 0x55de6e3cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e72f0 0x55de6e3cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de6e1ae250 con 0x55de6e39d0a0 2024-04-25T09:06:30.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de6e1a4690 con 0x55de6e3e69d0 2024-04-25T09:06:30.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de6e172a40 con 0x55de6e3e72f0 2024-04-25T09:06:30.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 10 client.0 _ll_register_callbacks cb 0x55de6e387e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:30.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f5089200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 0x55de6e3cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f5089200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 0x55de6e3cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38396/0 (socket says 172.21.15.173:38396) 2024-04-25T09:06:30.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f5089200640 1 -- 172.21.15.173:0/3281638560 learned_addr learned my addr 172.21.15.173:0/3281638560 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:30.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f507be00640 1 --2- 172.21.15.173:0/3281638560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e3e69d0 0x55de6e3cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f5089c00640 1 --2- 172.21.15.173:0/3281638560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e72f0 0x55de6e3cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f5089200640 1 -- 172.21.15.173:0/3281638560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e72f0 msgr2=0x55de6e3cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f5089200640 1 --2- 172.21.15.173:0/3281638560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e72f0 0x55de6e3cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f5089200640 1 -- 172.21.15.173:0/3281638560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e3e69d0 msgr2=0x55de6e3cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f5089200640 1 --2- 172.21.15.173:0/3281638560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e3e69d0 0x55de6e3cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f5089200640 1 -- 172.21.15.173:0/3281638560 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de6e2971c0 con 0x55de6e39d0a0 2024-04-25T09:06:30.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f5089200640 1 --2- 172.21.15.173:0/3281638560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 0x55de6e3cb7f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f5074005890 tx=0x7f507405dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d5f09167f5cff0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f5072000640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:30.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f5072000640 1 -- 172.21.15.173:0/3281638560 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5074081060 con 0x55de6e39d0a0 2024-04-25T09:06:30.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f5072000640 1 -- 172.21.15.173:0/3281638560 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f507407cdd0 con 0x55de6e39d0a0 2024-04-25T09:06:30.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 -- 172.21.15.173:0/3281638560 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f507c018070 con 0x55de6e39d0a0 2024-04-25T09:06:30.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f5072000640 1 -- 172.21.15.173:0/3281638560 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f507406d070 con 0x55de6e39d0a0 2024-04-25T09:06:30.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 10 client.6468 fetch_fsmap learned FSMap version 28 2024-04-25T09:06:30.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f508f193000 1 -- 172.21.15.173:0/3281638560 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55de6e293170 con 0x55de6e39d0a0 2024-04-25T09:06:30.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.414+0000 7f5072000640 1 -- 172.21.15.173:0/3281638560 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c018070 con 0x55de6e39d0a0 2024-04-25T09:06:30.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f5072000640 1 -- 172.21.15.173:0/3281638560 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f507405d8d0 con 0x55de6e39d0a0 2024-04-25T09:06:30.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f508f193000 10 client.6468 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:06:30.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f508f193000 10 client.6468 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:30.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f508f193000 20 client.6468 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:30.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f508f193000 1 --2- 172.21.15.173:0/3281638560 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55de6e3f6c80 0x55de6e3f9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f508f193000 4 client.6468 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:30.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f508f193000 1 -- 172.21.15.173:0/3281638560 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55de6e185c60 con 0x55de6e3f6c80 2024-04-25T09:06:30.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f507be00640 1 --2- 172.21.15.173:0/3281638560 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55de6e3f6c80 0x55de6e3f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f507be00640 1 --2- 172.21.15.173:0/3281638560 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55de6e3f6c80 0x55de6e3f9070 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91d06fe5cf856b99 server_cookie=3580598b24ecbd5b in_seq=0 out_seq=0 2024-04-25T09:06:30.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f5072000640 10 client.6468 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:30.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f5072000640 1 -- 172.21.15.173:0/3281638560 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55de6e185c60 con 0x55de6e3f6c80 2024-04-25T09:06:30.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f5072000640 10 client.6468 handle_command_reply: tid=0 2024-04-25T09:06:30.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f508f193000 1 client.6468 shutdown 2024-04-25T09:06:30.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f508f193000 1 -- 172.21.15.173:0/3281638560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 msgr2=0x55de6e3cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f508f193000 1 --2- 172.21.15.173:0/3281638560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 0x55de6e3cb7f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f5074005890 tx=0x7f507405dea0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f508f193000 1 -- 172.21.15.173:0/3281638560 shutdown_connections 2024-04-25T09:06:30.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f508f193000 1 --2- 172.21.15.173:0/3281638560 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55de6e3f6c80 0x55de6e3f9070 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f508f193000 1 --2- 172.21.15.173:0/3281638560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e72f0 0x55de6e3cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f508f193000 1 --2- 172.21.15.173:0/3281638560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e3e69d0 0x55de6e3cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f508f193000 1 --2- 172.21.15.173:0/3281638560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 0x55de6e3cb7f0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f5072000640 0 client.6468 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:30.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f508f193000 1 -- 172.21.15.173:0/3281638560 >> 172.21.15.173:0/3281638560 conn(0x55de6e399020 msgr2=0x55de6e39bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f508f193000 1 -- 172.21.15.173:0/3281638560 shutdown_connections 2024-04-25T09:06:30.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f508f193000 1 -- 172.21.15.173:0/3281638560 wait complete. 2024-04-25T09:06:30.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.418+0000 7f508f193000 20 client.6468 trim_cache size 0 max 16384 2024-04-25T09:06:30.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f508f193000 1 Processor -- start 2024-04-25T09:06:30.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f508f193000 1 -- start start 2024-04-25T09:06:30.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f508f193000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 0x55de6e4430f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f508f193000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e3e69d0 0x55de6e443630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f508f193000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e72f0 0x55de6e443b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f508f193000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5084203210 con 0x55de6e39d0a0 2024-04-25T09:06:30.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f508f193000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50842023b0 con 0x55de6e3e69d0 2024-04-25T09:06:30.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f508f193000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50840cee00 con 0x55de6e3e72f0 2024-04-25T09:06:30.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f5089200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 0x55de6e4430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f5089200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 0x55de6e4430f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38402/0 (socket says 172.21.15.173:38402) 2024-04-25T09:06:30.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f5089200640 1 -- 172.21.15.173:0/359075650 learned_addr learned my addr 172.21.15.173:0/359075650 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:30.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f5089200640 1 -- 172.21.15.173:0/359075650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e72f0 msgr2=0x55de6e443b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f5089200640 1 --2- 172.21.15.173:0/359075650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e72f0 0x55de6e443b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f5089200640 1 -- 172.21.15.173:0/359075650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e3e69d0 msgr2=0x55de6e443630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f5089200640 1 --2- 172.21.15.173:0/359075650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e3e69d0 0x55de6e443630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f5089200640 1 -- 172.21.15.173:0/359075650 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de6e230de0 con 0x55de6e39d0a0 2024-04-25T09:06:30.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f5089200640 1 --2- 172.21.15.173:0/359075650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 0x55de6e4430f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f50740014f0 tx=0x7f507406a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ba049fc4264ddc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f5078c00640 1 -- 172.21.15.173:0/359075650 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5074081040 con 0x55de6e39d0a0 2024-04-25T09:06:30.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f5078c00640 1 -- 172.21.15.173:0/359075650 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5074053ac0 con 0x55de6e39d0a0 2024-04-25T09:06:30.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f5078c00640 1 -- 172.21.15.173:0/359075650 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5074055060 con 0x55de6e39d0a0 2024-04-25T09:06:30.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f508f193000 1 -- 172.21.15.173:0/359075650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 msgr2=0x55de6e4430f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f508f193000 1 --2- 172.21.15.173:0/359075650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 0x55de6e4430f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f50740014f0 tx=0x7f507406a000 comp rx=0 tx=0).stop 2024-04-25T09:06:30.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f508f193000 1 -- 172.21.15.173:0/359075650 shutdown_connections 2024-04-25T09:06:30.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f508f193000 1 --2- 172.21.15.173:0/359075650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e72f0 0x55de6e443b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f508f193000 1 --2- 172.21.15.173:0/359075650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e3e69d0 0x55de6e443630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f508f193000 1 --2- 172.21.15.173:0/359075650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e39d0a0 0x55de6e4430f0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f508f193000 1 -- 172.21.15.173:0/359075650 >> 172.21.15.173:0/359075650 conn(0x55de6e399020 msgr2=0x55de6e3f3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f508f193000 1 -- 172.21.15.173:0/359075650 shutdown_connections 2024-04-25T09:06:30.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f508f193000 1 -- 172.21.15.173:0/359075650 wait complete. 2024-04-25T09:06:30.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.434+0000 7f508f193000 1 -- start start 2024-04-25T09:06:30.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 1 Processor -- start 2024-04-25T09:06:30.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e39d0a0 0x55de6e3f9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e3e69d0 0x55de6e3f98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e72f0 0x55de6e3f9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de6e184e00 con 0x55de6e3e69d0 2024-04-25T09:06:30.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5084201e30 con 0x55de6e39d0a0 2024-04-25T09:06:30.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de6e1e9300 con 0x55de6e3e72f0 2024-04-25T09:06:30.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 10 client.0 _ll_register_callbacks cb 0x55de6e368040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:30.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f507be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e3e69d0 0x55de6e3f98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f507be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e3e69d0 0x55de6e3f98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38418/0 (socket says 172.21.15.173:38418) 2024-04-25T09:06:30.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f507be00640 1 -- 172.21.15.173:0/2980217246 learned_addr learned my addr 172.21.15.173:0/2980217246 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:30.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f5089200640 1 --2- 172.21.15.173:0/2980217246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e39d0a0 0x55de6e3f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f5089c00640 1 --2- 172.21.15.173:0/2980217246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e72f0 0x55de6e3f9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f507be00640 1 -- 172.21.15.173:0/2980217246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e72f0 msgr2=0x55de6e3f9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f507be00640 1 --2- 172.21.15.173:0/2980217246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e72f0 0x55de6e3f9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f507be00640 1 -- 172.21.15.173:0/2980217246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e39d0a0 msgr2=0x55de6e3f9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f507be00640 1 --2- 172.21.15.173:0/2980217246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e39d0a0 0x55de6e3f9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f507be00640 1 -- 172.21.15.173:0/2980217246 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de6e18b8e0 con 0x55de6e3e69d0 2024-04-25T09:06:30.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f507be00640 1 --2- 172.21.15.173:0/2980217246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e3e69d0 0x55de6e3f98c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f506c009580 tx=0x7f506c019080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b846e2de0a97f862 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f5072000640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:30.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f5072000640 1 -- 172.21.15.173:0/2980217246 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c0d3070 con 0x55de6e3e69d0 2024-04-25T09:06:30.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f5072000640 1 -- 172.21.15.173:0/2980217246 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f506c0b79f0 con 0x55de6e3e69d0 2024-04-25T09:06:30.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 1 -- 172.21.15.173:0/2980217246 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de6e1f7530 con 0x55de6e3e69d0 2024-04-25T09:06:30.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f5072000640 1 -- 172.21.15.173:0/2980217246 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f506c0de050 con 0x55de6e3e69d0 2024-04-25T09:06:30.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 10 client.6474 fetch_fsmap learned FSMap version 28 2024-04-25T09:06:30.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 1 -- 172.21.15.173:0/2980217246 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55de6e2438f0 con 0x55de6e3e69d0 2024-04-25T09:06:30.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f5072000640 1 -- 172.21.15.173:0/2980217246 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55de6e1f7530 con 0x55de6e3e69d0 2024-04-25T09:06:30.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f5072000640 1 -- 172.21.15.173:0/2980217246 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f506c0e1020 con 0x55de6e3e69d0 2024-04-25T09:06:30.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 10 client.6474 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:06:30.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 10 client.6474 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:30.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 20 client.6474 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:30.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 1 --2- 172.21.15.173:0/2980217246 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55de6e44cf50 0x55de6e44f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 4 client.6474 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:06:30.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 1 -- 172.21.15.173:0/2980217246 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55de6e1f1880 con 0x55de6e44cf50 2024-04-25T09:06:30.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f5089200640 1 --2- 172.21.15.173:0/2980217246 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55de6e44cf50 0x55de6e44f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f5072000640 10 client.6474 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:30.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f5089200640 1 --2- 172.21.15.173:0/2980217246 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55de6e44cf50 0x55de6e44f340 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95fde1c645ee3c47 server_cookie=4177009251b229f3 in_seq=0 out_seq=0 2024-04-25T09:06:30.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f5072000640 1 -- 172.21.15.173:0/2980217246 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55de6e1f1880 con 0x55de6e44cf50 2024-04-25T09:06:30.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f5072000640 10 client.6474 handle_command_reply: tid=0 2024-04-25T09:06:30.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 1 client.6474 shutdown 2024-04-25T09:06:30.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.438+0000 7f508f193000 1 -- 172.21.15.173:0/2980217246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e3e69d0 msgr2=0x55de6e3f98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508f193000 1 --2- 172.21.15.173:0/2980217246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e3e69d0 0x55de6e3f98c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f506c009580 tx=0x7f506c019080 comp rx=0 tx=0).stop 2024-04-25T09:06:30.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508f193000 1 -- 172.21.15.173:0/2980217246 shutdown_connections 2024-04-25T09:06:30.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508f193000 1 --2- 172.21.15.173:0/2980217246 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55de6e44cf50 0x55de6e44f340 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508f193000 1 --2- 172.21.15.173:0/2980217246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de6e3e72f0 0x55de6e3f9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508f193000 1 --2- 172.21.15.173:0/2980217246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6e3e69d0 0x55de6e3f98c0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f5072000640 0 client.6474 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:30.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508f193000 1 --2- 172.21.15.173:0/2980217246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de6e39d0a0 0x55de6e3f9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508f193000 1 -- 172.21.15.173:0/2980217246 >> 172.21.15.173:0/2980217246 conn(0x55de6e399020 msgr2=0x55de6e3e50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508f193000 1 -- 172.21.15.173:0/2980217246 shutdown_connections 2024-04-25T09:06:30.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508f193000 1 -- 172.21.15.173:0/2980217246 wait complete. 2024-04-25T09:06:30.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508f193000 20 client.6474 trim_cache size 0 max 16384 2024-04-25T09:06:30.433 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:30.433 INFO:teuthology.orchestra.run.smithi173.stdout: "status": "no active scrubs running", 2024-04-25T09:06:30.433 INFO:teuthology.orchestra.run.smithi173.stdout: "scrubs": {} 2024-04-25T09:06:30.433 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:30.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508bc00640 1 -- 172.21.15.173:0/2655777798 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5060066f60 msgr2=0x7f5060069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508bc00640 1 --2- 172.21.15.173:0/2655777798 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5060066f60 0x7f5060069420 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f506c0ad000 tx=0x7f506c008040 comp rx=0 tx=0).stop 2024-04-25T09:06:30.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508bc00640 1 -- 172.21.15.173:0/2655777798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50840b3fe0 msgr2=0x7f50840ae3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508bc00640 1 --2- 172.21.15.173:0/2655777798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50840b3fe0 0x7f50840ae3c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f507400c750 tx=0x7f507400cc10 comp rx=0 tx=0).stop 2024-04-25T09:06:30.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508bc00640 1 -- 172.21.15.173:0/2655777798 shutdown_connections 2024-04-25T09:06:30.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508bc00640 1 --2- 172.21.15.173:0/2655777798 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5060066f60 0x7f5060069420 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508bc00640 1 --2- 172.21.15.173:0/2655777798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5084145290 0x7f5084141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508bc00640 1 --2- 172.21.15.173:0/2655777798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50840cc260 0x7f508413c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508bc00640 1 --2- 172.21.15.173:0/2655777798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50840b3fe0 0x7f50840ae3c0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508bc00640 1 -- 172.21.15.173:0/2655777798 >> 172.21.15.173:0/2655777798 conn(0x7f508406ac90 msgr2=0x7f508415e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508bc00640 1 -- 172.21.15.173:0/2655777798 shutdown_connections 2024-04-25T09:06:30.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.442+0000 7f508bc00640 1 -- 172.21.15.173:0/2655777798 wait complete. 2024-04-25T09:06:30.448 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:06:30.448 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:06:30.448 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-04-25T09:06:30.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.598+0000 7f5b13000640 1 Processor -- start 2024-04-25T09:06:30.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.598+0000 7f5b13000640 1 -- start start 2024-04-25T09:06:30.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.598+0000 7f5b13000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b0c09a160 0x7f5b0c0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.598+0000 7f5b13000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0c0cc7a0 con 0x7f5b0c15bab0 2024-04-25T09:06:30.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.598+0000 7f5b13000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0c0cca80 con 0x7f5b0c0d02a0 2024-04-25T09:06:30.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.598+0000 7f5b13000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0ccd60 con 0x7f5b0c09a160 2024-04-25T09:06:30.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.598+0000 7f5b0be00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f5b0c15bab0 0x7f5b0c0cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49548/0 (socket says 172.21.15.173:49548) 2024-04-25T09:06:30.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.598+0000 7f5b0be00640 1 -- 172.21.15.173:0/3035832733 learned_addr learned my addr 172.21.15.173:0/3035832733 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:30.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.598+0000 7f5b11000640 1 --2- 172.21.15.173:0/3035832733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b0c09a160 0x7f5b0c0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.602+0000 7f5b0aa00640 1 -- 172.21.15.173:0/3035832733 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382697512 0 0) 0x7f5b0c0cc7a0 con 0x7f5b0c15bab0 2024-04-25T09:06:30.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.602+0000 7f5b0aa00640 1 -- 172.21.15.173:0/3035832733 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5af0003530 con 0x7f5b0c15bab0 2024-04-25T09:06:30.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.602+0000 7f5b0aa00640 1 -- 172.21.15.173:0/3035832733 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2099856811 0 0) 0x7f5b0c0cca80 con 0x7f5b0c0d02a0 2024-04-25T09:06:30.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.602+0000 7f5b0aa00640 1 -- 172.21.15.173:0/3035832733 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b0c0cc7a0 con 0x7f5b0c0d02a0 2024-04-25T09:06:30.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.602+0000 7f5b11000640 1 -- 172.21.15.173:0/3035832733 >> v1:172.21.15.194:6789/0 conn(0x7f5b0c0d02a0 legacy=0x7f5b0c099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.602+0000 7f5b11000640 1 -- 172.21.15.173:0/3035832733 >> v1:172.21.15.173:6789/0 conn(0x7f5b0c15bab0 legacy=0x7f5b0c0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.602+0000 7f5b11000640 1 -- 172.21.15.173:0/3035832733 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c0cd040 con 0x7f5b0c09a160 2024-04-25T09:06:30.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.602+0000 7f5b11000640 1 --2- 172.21.15.173:0/3035832733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b0c09a160 0x7f5b0c0c5300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009dc0 tx=0x7f5b0401c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46a8ebdddd87d59a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.602+0000 7f5b0aa00640 1 -- 172.21.15.173:0/3035832733 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b040b2070 con 0x7f5b0c09a160 2024-04-25T09:06:30.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.602+0000 7f5b0aa00640 1 -- 172.21.15.173:0/3035832733 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b040a5950 con 0x7f5b0c09a160 2024-04-25T09:06:30.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.602+0000 7f5b0aa00640 1 -- 172.21.15.173:0/3035832733 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b040a5d20 con 0x7f5b0c09a160 2024-04-25T09:06:30.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b13000640 1 -- 172.21.15.173:0/3035832733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b0c09a160 msgr2=0x7f5b0c0c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b13000640 1 --2- 172.21.15.173:0/3035832733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b0c09a160 0x7f5b0c0c5300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009dc0 tx=0x7f5b0401c960 comp rx=0 tx=0).stop 2024-04-25T09:06:30.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b13000640 1 -- 172.21.15.173:0/3035832733 shutdown_connections 2024-04-25T09:06:30.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b13000640 1 --2- 172.21.15.173:0/3035832733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b0c09a160 0x7f5b0c0c5300 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b13000640 1 -- 172.21.15.173:0/3035832733 >> 172.21.15.173:0/3035832733 conn(0x7f5b0c0b32a0 msgr2=0x7f5b0c0b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b13000640 1 -- 172.21.15.173:0/3035832733 shutdown_connections 2024-04-25T09:06:30.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b13000640 1 -- 172.21.15.173:0/3035832733 wait complete. 2024-04-25T09:06:30.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b13000640 1 Processor -- start 2024-04-25T09:06:30.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b13000640 1 -- start start 2024-04-25T09:06:30.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b13000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b0c09a160 0x7f5b0c0ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b13000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b0c0d02a0 0x7f5b0c158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b13000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b0c15bab0 0x7f5b0c14a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b13000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0cc540 con 0x7f5b0c09a160 2024-04-25T09:06:30.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b13000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0cc3c0 con 0x7f5b0c15bab0 2024-04-25T09:06:30.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b13000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0cf540 con 0x7f5b0c0d02a0 2024-04-25T09:06:30.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b0be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b0c09a160 0x7f5b0c0ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b0be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b0c09a160 0x7f5b0c0ce6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38422/0 (socket says 172.21.15.173:38422) 2024-04-25T09:06:30.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b0be00640 1 -- 172.21.15.173:0/2227015142 learned_addr learned my addr 172.21.15.173:0/2227015142 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:30.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b0b400640 1 --2- 172.21.15.173:0/2227015142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b0c0d02a0 0x7f5b0c158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b11000640 1 --2- 172.21.15.173:0/2227015142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b0c15bab0 0x7f5b0c14a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b0be00640 1 -- 172.21.15.173:0/2227015142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b0c0d02a0 msgr2=0x7f5b0c158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b0be00640 1 --2- 172.21.15.173:0/2227015142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b0c0d02a0 0x7f5b0c158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b0be00640 1 -- 172.21.15.173:0/2227015142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b0c15bab0 msgr2=0x7f5b0c14a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b0be00640 1 --2- 172.21.15.173:0/2227015142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b0c15bab0 0x7f5b0c14a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b0be00640 1 -- 172.21.15.173:0/2227015142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c159850 con 0x7f5b0c09a160 2024-04-25T09:06:30.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b11000640 1 --2- 172.21.15.173:0/2227015142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b0c15bab0 0x7f5b0c14a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:30.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.606+0000 7f5b0be00640 1 --2- 172.21.15.173:0/2227015142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b0c09a160 0x7f5b0c0ce6a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00c4d0 tx=0x7f5afc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.610+0000 7f5b03e00640 1 -- 172.21.15.173:0/2227015142 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc017070 con 0x7f5b0c09a160 2024-04-25T09:06:30.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.610+0000 7f5b03e00640 1 -- 172.21.15.173:0/2227015142 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc005cf0 con 0x7f5b0c09a160 2024-04-25T09:06:30.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.610+0000 7f5b13000640 1 -- 172.21.15.173:0/2227015142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0c152f00 con 0x7f5b0c09a160 2024-04-25T09:06:30.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.610+0000 7f5b03e00640 1 -- 172.21.15.173:0/2227015142 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0072b0 con 0x7f5b0c09a160 2024-04-25T09:06:30.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.610+0000 7f5b13000640 1 -- 172.21.15.173:0/2227015142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0c1534c0 con 0x7f5b0c09a160 2024-04-25T09:06:30.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.610+0000 7f5b03e00640 1 -- 172.21.15.173:0/2227015142 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5afc01a070 con 0x7f5b0c09a160 2024-04-25T09:06:30.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.610+0000 7f5b03e00640 1 --2- 172.21.15.173:0/2227015142 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5aec066f60 0x7f5aec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.610+0000 7f5b03e00640 1 -- 172.21.15.173:0/2227015142 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5afc084660 con 0x7f5b0c09a160 2024-04-25T09:06:30.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b0b400640 1 --2- 172.21.15.173:0/2227015142 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5aec066f60 0x7f5aec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b16473000 1 Processor -- start 2024-04-25T09:06:30.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b16473000 1 -- start start 2024-04-25T09:06:30.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b0b400640 1 --2- 172.21.15.173:0/2227015142 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5aec066f60 0x7f5aec069420 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5af8007fd0 tx=0x7f5af8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b16473000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7ab3180 0x555cf7ab3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b16473000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3aa0 0x555cf7a690c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b16473000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7a69600 0x555cf7a699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b16473000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cf78b6f20 con 0x555cf7ab3aa0 2024-04-25T09:06:30.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b16473000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cf783f000 con 0x555cf7a69600 2024-04-25T09:06:30.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b16473000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x555cf78b2fc0 con 0x555cf7ab3180 2024-04-25T09:06:30.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b0b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3aa0 0x555cf7a690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b0b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3aa0 0x555cf7a690c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38432/0 (socket says 172.21.15.173:38432) 2024-04-25T09:06:30.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b0b400640 1 -- 172.21.15.173:0/4223253991 learned_addr learned my addr 172.21.15.173:0/4223253991 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:30.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b11000640 1 --2- 172.21.15.173:0/4223253991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7a69600 0x555cf7a699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b0be00640 1 --2- 172.21.15.173:0/4223253991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7ab3180 0x555cf7ab3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b0be00640 1 -- 172.21.15.173:0/4223253991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7a69600 msgr2=0x555cf7a699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b0be00640 1 --2- 172.21.15.173:0/4223253991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7a69600 0x555cf7a699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b0be00640 1 -- 172.21.15.173:0/4223253991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3aa0 msgr2=0x555cf7a690c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b0be00640 1 --2- 172.21.15.173:0/4223253991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3aa0 0x555cf7a690c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b0be00640 1 -- 172.21.15.173:0/4223253991 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555cf7892ba0 con 0x555cf7ab3180 2024-04-25T09:06:30.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b0b400640 1 --2- 172.21.15.173:0/4223253991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3aa0 0x555cf7a690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:30.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b0be00640 1 --2- 172.21.15.173:0/4223253991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7ab3180 0x555cf7ab3560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5afc054a40 tx=0x7f5afc054e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d8fbd76598230cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b00c00640 1 -- 172.21.15.173:0/4223253991 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc052de0 con 0x555cf7ab3180 2024-04-25T09:06:30.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b00c00640 1 -- 172.21.15.173:0/4223253991 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc053040 con 0x555cf7ab3180 2024-04-25T09:06:30.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b00c00640 1 -- 172.21.15.173:0/4223253991 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc05cfc0 con 0x555cf7ab3180 2024-04-25T09:06:30.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b16473000 1 -- 172.21.15.173:0/4223253991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7ab3180 msgr2=0x555cf7ab3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b16473000 1 --2- 172.21.15.173:0/4223253991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7ab3180 0x555cf7ab3560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5afc054a40 tx=0x7f5afc054e00 comp rx=0 tx=0).stop 2024-04-25T09:06:30.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b16473000 1 -- 172.21.15.173:0/4223253991 shutdown_connections 2024-04-25T09:06:30.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b16473000 1 --2- 172.21.15.173:0/4223253991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7a69600 0x555cf7a699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b16473000 1 --2- 172.21.15.173:0/4223253991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3aa0 0x555cf7a690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b16473000 1 --2- 172.21.15.173:0/4223253991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7ab3180 0x555cf7ab3560 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b16473000 1 -- 172.21.15.173:0/4223253991 >> 172.21.15.173:0/4223253991 conn(0x555cf7a6f760 msgr2=0x555cf7a679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b16473000 1 -- 172.21.15.173:0/4223253991 shutdown_connections 2024-04-25T09:06:30.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.614+0000 7f5b16473000 1 -- 172.21.15.173:0/4223253991 wait complete. 2024-04-25T09:06:30.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b16473000 1 -- start start 2024-04-25T09:06:30.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b16473000 1 Processor -- start 2024-04-25T09:06:30.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b16473000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7a69600 0x555cf7a6e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b16473000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3180 0x555cf7a6ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b16473000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7ab3aa0 0x555cf7aa1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b16473000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cf79749c0 con 0x555cf7ab3180 2024-04-25T09:06:30.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b16473000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cf78715d0 con 0x555cf7ab3aa0 2024-04-25T09:06:30.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b16473000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x555cf78b3f90 con 0x555cf7a69600 2024-04-25T09:06:30.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b16473000 10 client.0 _ll_register_callbacks cb 0x555cf7a54a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:30.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b0b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3180 0x555cf7a6ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b0b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3180 0x555cf7a6ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38434/0 (socket says 172.21.15.173:38434) 2024-04-25T09:06:30.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b0b400640 1 -- 172.21.15.173:0/674737196 learned_addr learned my addr 172.21.15.173:0/674737196 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:30.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b11000640 1 --2- 172.21.15.173:0/674737196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7ab3aa0 0x555cf7aa1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b0be00640 1 --2- 172.21.15.173:0/674737196 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7a69600 0x555cf7a6e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b0b400640 1 -- 172.21.15.173:0/674737196 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7a69600 msgr2=0x555cf7a6e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b0b400640 1 --2- 172.21.15.173:0/674737196 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7a69600 0x555cf7a6e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b0b400640 1 -- 172.21.15.173:0/674737196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7ab3aa0 msgr2=0x555cf7aa1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b0b400640 1 --2- 172.21.15.173:0/674737196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7ab3aa0 0x555cf7aa1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b0b400640 1 -- 172.21.15.173:0/674737196 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555cf78fd5a0 con 0x555cf7ab3180 2024-04-25T09:06:30.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b0b400640 1 --2- 172.21.15.173:0/674737196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3180 0x555cf7a6ec20 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5af8007900 tx=0x7f5af8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bccf556e2ca90c4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5af5600640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:30.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5af5600640 1 -- 172.21.15.173:0/674737196 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8027060 con 0x555cf7ab3180 2024-04-25T09:06:30.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b16473000 1 -- 172.21.15.173:0/674737196 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5afc053040 con 0x555cf7ab3180 2024-04-25T09:06:30.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5af5600640 1 -- 172.21.15.173:0/674737196 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5af8010040 con 0x555cf7ab3180 2024-04-25T09:06:30.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5af5600640 1 -- 172.21.15.173:0/674737196 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5af802d050 con 0x555cf7ab3180 2024-04-25T09:06:30.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b16473000 10 client.6486 fetch_fsmap learned FSMap version 28 2024-04-25T09:06:30.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b16473000 1 -- 172.21.15.173:0/674737196 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x555cf788e2b0 con 0x555cf7ab3180 2024-04-25T09:06:30.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5af5600640 1 -- 172.21.15.173:0/674737196 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc053040 con 0x555cf7ab3180 2024-04-25T09:06:30.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5af5600640 1 -- 172.21.15.173:0/674737196 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5af8030020 con 0x555cf7ab3180 2024-04-25T09:06:30.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b16473000 10 client.6486 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:06:30.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b16473000 10 client.6486 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:30.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b16473000 20 client.6486 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:30.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b16473000 1 --2- 172.21.15.173:0/674737196 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x555cf7aa0e60 0x555cf7aa1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b16473000 4 client.6486 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:30.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b16473000 1 -- 172.21.15.173:0/674737196 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555cf7852c70 con 0x555cf7aa0e60 2024-04-25T09:06:30.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.618+0000 7f5b0be00640 1 --2- 172.21.15.173:0/674737196 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x555cf7aa0e60 0x555cf7aa1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.622+0000 7f5b0be00640 1 --2- 172.21.15.173:0/674737196 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x555cf7aa0e60 0x555cf7aa1e60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3283e2ba17256ee1 server_cookie=8d861e688a56a06b in_seq=0 out_seq=0 2024-04-25T09:06:30.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.622+0000 7f5af5600640 10 client.6486 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:30.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.622+0000 7f5af5600640 1 -- 172.21.15.173:0/674737196 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555cf7852c70 con 0x555cf7aa0e60 2024-04-25T09:06:30.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.622+0000 7f5af5600640 10 client.6486 handle_command_reply: tid=0 2024-04-25T09:06:30.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.622+0000 7f5b16473000 1 client.6486 shutdown 2024-04-25T09:06:30.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.622+0000 7f5b16473000 1 -- 172.21.15.173:0/674737196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3180 msgr2=0x555cf7a6ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.622+0000 7f5b16473000 1 --2- 172.21.15.173:0/674737196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3180 0x555cf7a6ec20 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5af8007900 tx=0x7f5af8000ee0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.622+0000 7f5b16473000 1 -- 172.21.15.173:0/674737196 shutdown_connections 2024-04-25T09:06:30.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.622+0000 7f5b16473000 1 --2- 172.21.15.173:0/674737196 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x555cf7aa0e60 0x555cf7aa1e60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.622+0000 7f5b16473000 1 --2- 172.21.15.173:0/674737196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7ab3aa0 0x555cf7aa1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.622+0000 7f5b16473000 1 --2- 172.21.15.173:0/674737196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3180 0x555cf7a6ec20 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.622+0000 7f5b16473000 1 --2- 172.21.15.173:0/674737196 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7a69600 0x555cf7a6e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.622+0000 7f5af5600640 0 client.6486 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:30.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.622+0000 7f5b16473000 1 -- 172.21.15.173:0/674737196 >> 172.21.15.173:0/674737196 conn(0x555cf7a6f760 msgr2=0x555cf7a680b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.622+0000 7f5b16473000 1 -- 172.21.15.173:0/674737196 shutdown_connections 2024-04-25T09:06:30.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.622+0000 7f5b16473000 1 -- 172.21.15.173:0/674737196 wait complete. 2024-04-25T09:06:30.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.622+0000 7f5b16473000 20 client.6486 trim_cache size 0 max 16384 2024-04-25T09:06:30.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b16473000 1 Processor -- start 2024-04-25T09:06:30.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b16473000 1 -- start start 2024-04-25T09:06:30.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b16473000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7a69600 0x555cf7ac9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b16473000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7ab3180 0x555cf7a68120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b16473000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7ab3aa0 0x555cf7a68660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b16473000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c203a40 con 0x555cf7a69600 2024-04-25T09:06:30.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b16473000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c202cf0 con 0x555cf7ab3aa0 2024-04-25T09:06:30.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b16473000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c165920 con 0x555cf7ab3180 2024-04-25T09:06:30.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b0be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7a69600 0x555cf7ac9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b0be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7a69600 0x555cf7ac9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38450/0 (socket says 172.21.15.173:38450) 2024-04-25T09:06:30.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b0be00640 1 -- 172.21.15.173:0/4014382759 learned_addr learned my addr 172.21.15.173:0/4014382759 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:30.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b0b400640 1 --2- 172.21.15.173:0/4014382759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7ab3180 0x555cf7a68120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b11000640 1 --2- 172.21.15.173:0/4014382759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7ab3aa0 0x555cf7a68660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b0be00640 1 -- 172.21.15.173:0/4014382759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7ab3180 msgr2=0x555cf7a68120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b0be00640 1 --2- 172.21.15.173:0/4014382759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7ab3180 0x555cf7a68120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b0be00640 1 -- 172.21.15.173:0/4014382759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7ab3aa0 msgr2=0x555cf7a68660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b0be00640 1 --2- 172.21.15.173:0/4014382759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7ab3aa0 0x555cf7a68660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b0be00640 1 -- 172.21.15.173:0/4014382759 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555cf7aa21d0 con 0x555cf7a69600 2024-04-25T09:06:30.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b11000640 1 --2- 172.21.15.173:0/4014382759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7ab3aa0 0x555cf7a68660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:30.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b0be00640 1 --2- 172.21.15.173:0/4014382759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7a69600 0x555cf7ac9690 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00ce90 tx=0x7f5afc05b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958dee325bed170c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5af7e00640 1 -- 172.21.15.173:0/4014382759 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0513b0 con 0x555cf7a69600 2024-04-25T09:06:30.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5af7e00640 1 -- 172.21.15.173:0/4014382759 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc05cfc0 con 0x555cf7a69600 2024-04-25T09:06:30.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5af7e00640 1 -- 172.21.15.173:0/4014382759 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc051550 con 0x555cf7a69600 2024-04-25T09:06:30.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b16473000 1 -- 172.21.15.173:0/4014382759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7a69600 msgr2=0x555cf7ac9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b16473000 1 --2- 172.21.15.173:0/4014382759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7a69600 0x555cf7ac9690 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00ce90 tx=0x7f5afc05b000 comp rx=0 tx=0).stop 2024-04-25T09:06:30.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b16473000 1 -- 172.21.15.173:0/4014382759 shutdown_connections 2024-04-25T09:06:30.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b16473000 1 --2- 172.21.15.173:0/4014382759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7ab3aa0 0x555cf7a68660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b16473000 1 --2- 172.21.15.173:0/4014382759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7ab3180 0x555cf7a68120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b16473000 1 --2- 172.21.15.173:0/4014382759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7a69600 0x555cf7ac9690 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b16473000 1 -- 172.21.15.173:0/4014382759 >> 172.21.15.173:0/4014382759 conn(0x555cf7a6f760 msgr2=0x555cf7ac0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b16473000 1 -- 172.21.15.173:0/4014382759 shutdown_connections 2024-04-25T09:06:30.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.634+0000 7f5b16473000 1 -- 172.21.15.173:0/4014382759 wait complete. 2024-04-25T09:06:30.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b16473000 1 -- start start 2024-04-25T09:06:30.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b16473000 1 Processor -- start 2024-04-25T09:06:30.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b16473000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7a69600 0x555cf7b13210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b16473000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3180 0x555cf7b13750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b16473000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7ab3aa0 0x555cf7ac7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b16473000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cf79749c0 con 0x555cf7ab3180 2024-04-25T09:06:30.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b16473000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cf796c9d0 con 0x555cf7ab3aa0 2024-04-25T09:06:30.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b16473000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x555cf786fe80 con 0x555cf7a69600 2024-04-25T09:06:30.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b16473000 10 client.0 _ll_register_callbacks cb 0x555cf7a35600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:30.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b0b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3180 0x555cf7b13750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b0b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3180 0x555cf7b13750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38466/0 (socket says 172.21.15.173:38466) 2024-04-25T09:06:30.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b0b400640 1 -- 172.21.15.173:0/2112133600 learned_addr learned my addr 172.21.15.173:0/2112133600 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:30.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b0be00640 1 --2- 172.21.15.173:0/2112133600 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7a69600 0x555cf7b13210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b11000640 1 --2- 172.21.15.173:0/2112133600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7ab3aa0 0x555cf7ac7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b0b400640 1 -- 172.21.15.173:0/2112133600 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7a69600 msgr2=0x555cf7b13210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b0b400640 1 --2- 172.21.15.173:0/2112133600 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7a69600 0x555cf7b13210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b0b400640 1 -- 172.21.15.173:0/2112133600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7ab3aa0 msgr2=0x555cf7ac7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b0b400640 1 --2- 172.21.15.173:0/2112133600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7ab3aa0 0x555cf7ac7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b0b400640 1 -- 172.21.15.173:0/2112133600 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555cf783f250 con 0x555cf7ab3180 2024-04-25T09:06:30.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b0b400640 1 --2- 172.21.15.173:0/2112133600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3180 0x555cf7b13750 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5af800f9e0 tx=0x7f5af8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b99563d52682 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5af5600640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:30.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5af5600640 1 -- 172.21.15.173:0/2112133600 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8036060 con 0x555cf7ab3180 2024-04-25T09:06:30.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5af5600640 1 -- 172.21.15.173:0/2112133600 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5af80279b0 con 0x555cf7ab3180 2024-04-25T09:06:30.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b16473000 1 -- 172.21.15.173:0/2112133600 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5afc05cfc0 con 0x555cf7ab3180 2024-04-25T09:06:30.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5af5600640 1 -- 172.21.15.173:0/2112133600 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5af800fd40 con 0x555cf7ab3180 2024-04-25T09:06:30.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b16473000 10 client.6492 fetch_fsmap learned FSMap version 28 2024-04-25T09:06:30.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.638+0000 7f5b16473000 1 -- 172.21.15.173:0/2112133600 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x555cf784bb90 con 0x555cf7ab3180 2024-04-25T09:06:30.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5af5600640 1 -- 172.21.15.173:0/2112133600 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc05cfc0 con 0x555cf7ab3180 2024-04-25T09:06:30.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5af5600640 1 -- 172.21.15.173:0/2112133600 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5af8030070 con 0x555cf7ab3180 2024-04-25T09:06:30.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b16473000 10 client.6492 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:06:30.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b16473000 10 client.6492 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:06:30.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b16473000 20 client.6492 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:30.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b16473000 1 --2- 172.21.15.173:0/2112133600 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x555cf7ac8ae0 0x555cf7ac8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b16473000 4 client.6492 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T09:06:30.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b16473000 1 -- 172.21.15.173:0/2112133600 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555cf7aa17e0 con 0x555cf7ac8ae0 2024-04-25T09:06:30.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b0be00640 1 --2- 172.21.15.173:0/2112133600 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x555cf7ac8ae0 0x555cf7ac8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b0be00640 1 --2- 172.21.15.173:0/2112133600 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x555cf7ac8ae0 0x555cf7ac8ef0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1bf248bf0f79c1b server_cookie=bd4405340455ec5c in_seq=0 out_seq=0 2024-04-25T09:06:30.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5af5600640 10 client.6492 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:30.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5af5600640 1 -- 172.21.15.173:0/2112133600 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+168 (crc 0 0 0) 0x555cf7aa17e0 con 0x555cf7ac8ae0 2024-04-25T09:06:30.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5af5600640 10 client.6492 handle_command_reply: tid=0 2024-04-25T09:06:30.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b16473000 1 client.6492 shutdown 2024-04-25T09:06:30.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b16473000 1 -- 172.21.15.173:0/2112133600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3180 msgr2=0x555cf7b13750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b16473000 1 --2- 172.21.15.173:0/2112133600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3180 0x555cf7b13750 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5af800f9e0 tx=0x7f5af8013000 comp rx=0 tx=0).stop 2024-04-25T09:06:30.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b16473000 1 -- 172.21.15.173:0/2112133600 shutdown_connections 2024-04-25T09:06:30.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b16473000 1 --2- 172.21.15.173:0/2112133600 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x555cf7ac8ae0 0x555cf7ac8ef0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b16473000 1 --2- 172.21.15.173:0/2112133600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555cf7ab3aa0 0x555cf7ac7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b16473000 1 --2- 172.21.15.173:0/2112133600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf7ab3180 0x555cf7b13750 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b16473000 1 --2- 172.21.15.173:0/2112133600 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x555cf7a69600 0x555cf7b13210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5af5600640 0 client.6492 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:30.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b16473000 1 -- 172.21.15.173:0/2112133600 >> 172.21.15.173:0/2112133600 conn(0x555cf7a6f760 msgr2=0x555cf7a67110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b16473000 1 -- 172.21.15.173:0/2112133600 shutdown_connections 2024-04-25T09:06:30.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b16473000 1 -- 172.21.15.173:0/2112133600 wait complete. 2024-04-25T09:06:30.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b16473000 20 client.6492 trim_cache size 0 max 16384 2024-04-25T09:06:30.634 INFO:teuthology.orchestra.run.smithi173.stdout:[ 2024-04-25T09:06:30.634 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:30.635 INFO:teuthology.orchestra.run.smithi173.stdout: "damage_type": "backtrace", 2024-04-25T09:06:30.635 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 3174508789, 2024-04-25T09:06:30.635 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 1099511630189, 2024-04-25T09:06:30.635 INFO:teuthology.orchestra.run.smithi173.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1" 2024-04-25T09:06:30.635 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:30.635 INFO:teuthology.orchestra.run.smithi173.stdout:] 2024-04-25T09:06:30.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b13000640 1 -- 172.21.15.173:0/2227015142 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5aec066f60 msgr2=0x7f5aec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b13000640 1 --2- 172.21.15.173:0/2227015142 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5aec066f60 0x7f5aec069420 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5af8007fd0 tx=0x7f5af8009040 comp rx=0 tx=0).stop 2024-04-25T09:06:30.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b13000640 1 -- 172.21.15.173:0/2227015142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b0c09a160 msgr2=0x7f5b0c0ce6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b13000640 1 --2- 172.21.15.173:0/2227015142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b0c09a160 0x7f5b0c0ce6a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00c4d0 tx=0x7f5afc00c990 comp rx=0 tx=0).stop 2024-04-25T09:06:30.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b13000640 1 -- 172.21.15.173:0/2227015142 shutdown_connections 2024-04-25T09:06:30.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b13000640 1 --2- 172.21.15.173:0/2227015142 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5aec066f60 0x7f5aec069420 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b13000640 1 --2- 172.21.15.173:0/2227015142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b0c15bab0 0x7f5b0c14a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b13000640 1 --2- 172.21.15.173:0/2227015142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b0c0d02a0 0x7f5b0c158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b13000640 1 --2- 172.21.15.173:0/2227015142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b0c09a160 0x7f5b0c0ce6a0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b13000640 1 -- 172.21.15.173:0/2227015142 >> 172.21.15.173:0/2227015142 conn(0x7f5b0c0b32a0 msgr2=0x7f5b0c0c7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b13000640 1 -- 172.21.15.173:0/2227015142 shutdown_connections 2024-04-25T09:06:30.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.642+0000 7f5b13000640 1 -- 172.21.15.173:0/2227015142 wait complete. 2024-04-25T09:06:30.650 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:30.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.798+0000 7f0c09a00640 1 Processor -- start 2024-04-25T09:06:30.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.798+0000 7f0c09a00640 1 -- start start 2024-04-25T09:06:30.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.802+0000 7f0c09a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c040b3e70 0x7f0c040b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.802+0000 7f0c09a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0c040aefa0 0x7f0c040b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.802+0000 7f0c09a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c040b4790 con 0x7f0c0415edd0 2024-04-25T09:06:30.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.802+0000 7f0c09a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0406dd50 con 0x7f0c040aefa0 2024-04-25T09:06:30.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.802+0000 7f0c09a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0415f320 con 0x7f0c040b3e70 2024-04-25T09:06:30.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.802+0000 7f0c02a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c040b3e70 0x7f0c040b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.802+0000 7f0c02a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c040b3e70 0x7f0c040b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:59256/0 (socket says 172.21.15.173:59256) 2024-04-25T09:06:30.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.802+0000 7f0c02a00640 1 -- 172.21.15.173:0/2609921672 learned_addr learned my addr 172.21.15.173:0/2609921672 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:30.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.802+0000 7f0bfbe00640 1 --2- 172.21.15.173:0/2609921672 >> v2:172.21.15.194:3300/0 conn(0x7f0c040aefa0 0x7f0c040b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.802+0000 7f0c02a00640 1 -- 172.21.15.173:0/2609921672 >> v2:172.21.15.194:3300/0 conn(0x7f0c040aefa0 msgr2=0x7f0c040b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.802+0000 7f0c02a00640 1 --2- 172.21.15.173:0/2609921672 >> v2:172.21.15.194:3300/0 conn(0x7f0c040aefa0 0x7f0c040b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.802+0000 7f0c02a00640 1 -- 172.21.15.173:0/2609921672 >> v1:172.21.15.194:6789/0 conn(0x7f0c0415edd0 legacy=0x7f0c040b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.802+0000 7f0c02a00640 1 -- 172.21.15.173:0/2609921672 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0406d420 con 0x7f0c040b3e70 2024-04-25T09:06:30.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.806+0000 7f0c02a00640 1 --2- 172.21.15.173:0/2609921672 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c040b3e70 0x7f0c040b4250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4009870 tx=0x7f0bf401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfe59fc69926289e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.806+0000 7f0c02000640 1 -- 172.21.15.173:0/2609921672 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf40a9610 con 0x7f0c040b3e70 2024-04-25T09:06:30.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.806+0000 7f0c02000640 1 -- 172.21.15.173:0/2609921672 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf40a97b0 con 0x7f0c040b3e70 2024-04-25T09:06:30.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.806+0000 7f0c02000640 1 -- 172.21.15.173:0/2609921672 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf40a9b80 con 0x7f0c040b3e70 2024-04-25T09:06:30.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.806+0000 7f0c09a00640 1 -- 172.21.15.173:0/2609921672 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c040b3e70 msgr2=0x7f0c040b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.806+0000 7f0c09a00640 1 --2- 172.21.15.173:0/2609921672 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c040b3e70 0x7f0c040b4250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4009870 tx=0x7f0bf401c530 comp rx=0 tx=0).stop 2024-04-25T09:06:30.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.806+0000 7f0c09a00640 1 -- 172.21.15.173:0/2609921672 shutdown_connections 2024-04-25T09:06:30.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.806+0000 7f0c09a00640 1 --2- 172.21.15.173:0/2609921672 >> v2:172.21.15.194:3300/0 conn(0x7f0c040aefa0 0x7f0c040b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.806+0000 7f0c09a00640 1 --2- 172.21.15.173:0/2609921672 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c040b3e70 0x7f0c040b4250 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.806+0000 7f0c09a00640 1 -- 172.21.15.173:0/2609921672 >> 172.21.15.173:0/2609921672 conn(0x7f0c0406ac90 msgr2=0x7f0c0406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.806+0000 7f0c09a00640 1 -- 172.21.15.173:0/2609921672 shutdown_connections 2024-04-25T09:06:30.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.806+0000 7f0c09a00640 1 -- 172.21.15.173:0/2609921672 wait complete. 2024-04-25T09:06:30.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.806+0000 7f0c09a00640 1 Processor -- start 2024-04-25T09:06:30.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.806+0000 7f0c09a00640 1 -- start start 2024-04-25T09:06:30.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c09a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c040aefa0 0x7f0c040b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c09a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c040b3e70 0x7f0c04155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c09a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c0415edd0 0x7f0c0415c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c09a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0406e1e0 con 0x7f0c040aefa0 2024-04-25T09:06:30.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c09a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0415aba0 con 0x7f0c0415edd0 2024-04-25T09:06:30.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c09a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0406e360 con 0x7f0c040b3e70 2024-04-25T09:06:30.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c02a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c040aefa0 0x7f0c040b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c02a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c040aefa0 0x7f0c040b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38480/0 (socket says 172.21.15.173:38480) 2024-04-25T09:06:30.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c02a00640 1 -- 172.21.15.173:0/3406172307 learned_addr learned my addr 172.21.15.173:0/3406172307 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:30.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0bfbe00640 1 --2- 172.21.15.173:0/3406172307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c040b3e70 0x7f0c04155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c03400640 1 --2- 172.21.15.173:0/3406172307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c0415edd0 0x7f0c0415c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c02a00640 1 -- 172.21.15.173:0/3406172307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c040b3e70 msgr2=0x7f0c04155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c02a00640 1 --2- 172.21.15.173:0/3406172307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c040b3e70 0x7f0c04155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c02a00640 1 -- 172.21.15.173:0/3406172307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c0415edd0 msgr2=0x7f0c0415c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c02a00640 1 --2- 172.21.15.173:0/3406172307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c0415edd0 0x7f0c0415c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c02a00640 1 -- 172.21.15.173:0/3406172307 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0406f690 con 0x7f0c040aefa0 2024-04-25T09:06:30.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c03400640 1 --2- 172.21.15.173:0/3406172307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c0415edd0 0x7f0c0415c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:30.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c02a00640 1 --2- 172.21.15.173:0/3406172307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c040aefa0 0x7f0c040b1ea0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f0bf401abe0 tx=0x7f0bf40192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0bfaa00640 1 -- 172.21.15.173:0/3406172307 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf40a9610 con 0x7f0c040aefa0 2024-04-25T09:06:30.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0bfaa00640 1 -- 172.21.15.173:0/3406172307 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf40bb5f0 con 0x7f0c040aefa0 2024-04-25T09:06:30.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0bfaa00640 1 -- 172.21.15.173:0/3406172307 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf40bb9e0 con 0x7f0c040aefa0 2024-04-25T09:06:30.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c09a00640 1 -- 172.21.15.173:0/3406172307 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c04072260 con 0x7f0c040aefa0 2024-04-25T09:06:30.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c09a00640 1 -- 172.21.15.173:0/3406172307 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0415d120 con 0x7f0c040aefa0 2024-04-25T09:06:30.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0c09a00640 1 -- 172.21.15.173:0/3406172307 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0415d360 con 0x7f0c040aefa0 2024-04-25T09:06:30.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.810+0000 7f0bfaa00640 1 -- 172.21.15.173:0/3406172307 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0bf40bbb80 con 0x7f0c040aefa0 2024-04-25T09:06:30.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.814+0000 7f0bfaa00640 1 --2- 172.21.15.173:0/3406172307 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0be0066f60 0x7f0be0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.814+0000 7f0bfaa00640 1 -- 172.21.15.173:0/3406172307 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0bf411f3c0 con 0x7f0c040aefa0 2024-04-25T09:06:30.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.814+0000 7f0bfbe00640 1 --2- 172.21.15.173:0/3406172307 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0be0066f60 0x7f0be0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.814+0000 7f0bfbe00640 1 --2- 172.21.15.173:0/3406172307 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0be0066f60 0x7f0be0069420 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0c040ae370 tx=0x7f0bec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:30.818+0000 7f0bfaa00640 1 -- 172.21.15.173:0/3406172307 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0bf40c2030 con 0x7f0c040aefa0 2024-04-25T09:06:30.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.002+0000 7f0c09a00640 1 -- 172.21.15.173:0/3406172307 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c0406f1c0 con 0x7f0c040aefa0 2024-04-25T09:06:30.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.002+0000 7f0bfaa00640 1 -- 172.21.15.173:0/3406172307 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4951 (secure 0 0 0) 0x7f0bf40ad020 con 0x7f0c040aefa0 2024-04-25T09:06:30.991 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:30.991 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:06:27.244658+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:30.991 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 28 2024-04-25T09:06:30.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.002+0000 7f0c09a00640 1 -- 172.21.15.173:0/3406172307 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0be0066f60 msgr2=0x7f0be0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.002+0000 7f0c09a00640 1 --2- 172.21.15.173:0/3406172307 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0be0066f60 0x7f0be0069420 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0c040ae370 tx=0x7f0bec008040 comp rx=0 tx=0).stop 2024-04-25T09:06:30.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.002+0000 7f0c09a00640 1 -- 172.21.15.173:0/3406172307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c040aefa0 msgr2=0x7f0c040b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.002+0000 7f0c09a00640 1 --2- 172.21.15.173:0/3406172307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c040aefa0 0x7f0c040b1ea0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f0bf401abe0 tx=0x7f0bf40192d0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.002+0000 7f0c09a00640 1 -- 172.21.15.173:0/3406172307 shutdown_connections 2024-04-25T09:06:30.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.002+0000 7f0c09a00640 1 --2- 172.21.15.173:0/3406172307 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0be0066f60 0x7f0be0069420 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.002+0000 7f0c09a00640 1 --2- 172.21.15.173:0/3406172307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c0415edd0 0x7f0c0415c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.002+0000 7f0c09a00640 1 --2- 172.21.15.173:0/3406172307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c040b3e70 0x7f0c04155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.002+0000 7f0c09a00640 1 --2- 172.21.15.173:0/3406172307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c040aefa0 0x7f0c040b1ea0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.002+0000 7f0c09a00640 1 -- 172.21.15.173:0/3406172307 >> 172.21.15.173:0/3406172307 conn(0x7f0c0406ac90 msgr2=0x7f0c040ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.006+0000 7f0c09a00640 1 -- 172.21.15.173:0/3406172307 shutdown_connections 2024-04-25T09:06:30.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.006+0000 7f0c09a00640 1 -- 172.21.15.173:0/3406172307 wait complete. 2024-04-25T09:06:31.012 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage rm 3174508789 2024-04-25T09:06:31.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.162+0000 7f020a800640 1 Processor -- start 2024-04-25T09:06:31.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.162+0000 7f020a800640 1 -- start start 2024-04-25T09:06:31.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.162+0000 7f020a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0204145290 0x7f020415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.162+0000 7f020a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f02040cc260 0x7f02040cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.162+0000 7f020a800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020415c5f0 con 0x7f02040b3fe0 2024-04-25T09:06:31.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.162+0000 7f020a800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020406d4b0 con 0x7f02040cc260 2024-04-25T09:06:31.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.162+0000 7f020a800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020406d790 con 0x7f0204145290 2024-04-25T09:06:31.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.162+0000 7f0203e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f02040cc260 0x7f02040cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.162+0000 7f0203e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f02040cc260 0x7f02040cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38492/0 (socket says 172.21.15.173:38492) 2024-04-25T09:06:31.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.162+0000 7f0203e00640 1 -- 172.21.15.173:0/785005456 learned_addr learned my addr 172.21.15.173:0/785005456 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:31.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.162+0000 7f0203400640 1 --2- 172.21.15.173:0/785005456 >> v2:172.21.15.194:3300/0 conn(0x7f0204145290 0x7f020415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.162+0000 7f0203e00640 1 -- 172.21.15.173:0/785005456 >> v2:172.21.15.194:3300/0 conn(0x7f0204145290 msgr2=0x7f020415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:31.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.162+0000 7f0203e00640 1 --2- 172.21.15.173:0/785005456 >> v2:172.21.15.194:3300/0 conn(0x7f0204145290 0x7f020415c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.162+0000 7f0203e00640 1 -- 172.21.15.173:0/785005456 >> v1:172.21.15.194:6789/0 conn(0x7f02040b3fe0 legacy=0x7f02040b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:31.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.162+0000 7f0203e00640 1 -- 172.21.15.173:0/785005456 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020406da70 con 0x7f02040cc260 2024-04-25T09:06:31.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.162+0000 7f0203400640 1 --2- 172.21.15.173:0/785005456 >> v2:172.21.15.194:3300/0 conn(0x7f0204145290 0x7f020415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:31.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.166+0000 7f0203e00640 1 --2- 172.21.15.173:0/785005456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02040cc260 0x7f02040cc670 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f020415f5b0 tx=0x7f01fc01c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be122048b7c58042 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:31.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.166+0000 7f0202000640 1 -- 172.21.15.173:0/785005456 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0ac020 con 0x7f02040cc260 2024-04-25T09:06:31.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.166+0000 7f0202000640 1 -- 172.21.15.173:0/785005456 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc0a6470 con 0x7f02040cc260 2024-04-25T09:06:31.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.166+0000 7f0202000640 1 -- 172.21.15.173:0/785005456 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0a6840 con 0x7f02040cc260 2024-04-25T09:06:31.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.166+0000 7f020a800640 1 -- 172.21.15.173:0/785005456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02040cc260 msgr2=0x7f02040cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.166+0000 7f020a800640 1 --2- 172.21.15.173:0/785005456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02040cc260 0x7f02040cc670 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f020415f5b0 tx=0x7f01fc01c690 comp rx=0 tx=0).stop 2024-04-25T09:06:31.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.166+0000 7f020a800640 1 -- 172.21.15.173:0/785005456 shutdown_connections 2024-04-25T09:06:31.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.166+0000 7f020a800640 1 --2- 172.21.15.173:0/785005456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02040cc260 0x7f02040cc670 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.166+0000 7f020a800640 1 --2- 172.21.15.173:0/785005456 >> v2:172.21.15.194:3300/0 conn(0x7f0204145290 0x7f020415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.166+0000 7f020a800640 1 -- 172.21.15.173:0/785005456 >> 172.21.15.173:0/785005456 conn(0x7f020406ac90 msgr2=0x7f020406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:31.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.166+0000 7f020a800640 1 -- 172.21.15.173:0/785005456 shutdown_connections 2024-04-25T09:06:31.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.166+0000 7f020a800640 1 -- 172.21.15.173:0/785005456 wait complete. 2024-04-25T09:06:31.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.166+0000 7f020a800640 1 Processor -- start 2024-04-25T09:06:31.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.166+0000 7f020a800640 1 -- start start 2024-04-25T09:06:31.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f020a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02040b3fe0 0x7f02041f5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f020a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02040cc260 0x7f02041427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f020a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0204145290 0x7f02040ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f020a800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020406eee0 con 0x7f02040cc260 2024-04-25T09:06:31.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f020a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020406ed60 con 0x7f02040b3fe0 2024-04-25T09:06:31.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f020a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020406f060 con 0x7f0204145290 2024-04-25T09:06:31.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f0202a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02040cc260 0x7f02041427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f0202a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02040cc260 0x7f02041427a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38504/0 (socket says 172.21.15.173:38504) 2024-04-25T09:06:31.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f0202a00640 1 -- 172.21.15.173:0/4283216999 learned_addr learned my addr 172.21.15.173:0/4283216999 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:31.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f0203400640 1 --2- 172.21.15.173:0/4283216999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02040b3fe0 0x7f02041f5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f0203e00640 1 --2- 172.21.15.173:0/4283216999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0204145290 0x7f02040ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f0202a00640 1 -- 172.21.15.173:0/4283216999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0204145290 msgr2=0x7f02040ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f0202a00640 1 --2- 172.21.15.173:0/4283216999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0204145290 0x7f02040ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f0202a00640 1 -- 172.21.15.173:0/4283216999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02040b3fe0 msgr2=0x7f02041f5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f0202a00640 1 --2- 172.21.15.173:0/4283216999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02040b3fe0 0x7f02041f5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f0202a00640 1 -- 172.21.15.173:0/4283216999 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0204149bd0 con 0x7f02040cc260 2024-04-25T09:06:31.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f0203400640 1 --2- 172.21.15.173:0/4283216999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02040b3fe0 0x7f02041f5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:31.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f0202a00640 1 --2- 172.21.15.173:0/4283216999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02040cc260 0x7f02041427a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f01f000b410 tx=0x7f01f000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:31.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f01fb400640 1 -- 172.21.15.173:0/4283216999 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f0015030 con 0x7f02040cc260 2024-04-25T09:06:31.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f01fb400640 1 -- 172.21.15.173:0/4283216999 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f0004020 con 0x7f02040cc260 2024-04-25T09:06:31.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f01fb400640 1 -- 172.21.15.173:0/4283216999 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f0004450 con 0x7f02040cc260 2024-04-25T09:06:31.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f020a800640 1 -- 172.21.15.173:0/4283216999 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0204149eb0 con 0x7f02040cc260 2024-04-25T09:06:31.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f020a800640 1 -- 172.21.15.173:0/4283216999 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020414a470 con 0x7f02040cc260 2024-04-25T09:06:31.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.170+0000 7f01fb400640 1 -- 172.21.15.173:0/4283216999 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f01f0018070 con 0x7f02040cc260 2024-04-25T09:06:31.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f01fb400640 1 --2- 172.21.15.173:0/4283216999 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01e4066f60 0x7f01e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f01fb400640 1 -- 172.21.15.173:0/4283216999 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f01f0084d50 con 0x7f02040cc260 2024-04-25T09:06:31.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f0203400640 1 --2- 172.21.15.173:0/4283216999 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01e4066f60 0x7f01e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f020dc65000 1 Processor -- start 2024-04-25T09:06:31.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f020dc65000 1 -- start start 2024-04-25T09:06:31.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f0203400640 1 --2- 172.21.15.173:0/4283216999 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01e4066f60 0x7f01e4069420 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f01f400a9b0 tx=0x7f01f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:31.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f020dc65000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa677d8070 0x55aa677d8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f020dc65000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa677d8990 0x55aa6778b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f020dc65000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa6778bbe0 0x55aa6778bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f020dc65000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa675dbf00 con 0x55aa6778bbe0 2024-04-25T09:06:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f020dc65000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa675644a0 con 0x55aa677d8990 2024-04-25T09:06:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f020dc65000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa675d7fa0 con 0x55aa677d8070 2024-04-25T09:06:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f0203e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa6778bbe0 0x55aa6778bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f0203e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa6778bbe0 0x55aa6778bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38508/0 (socket says 172.21.15.173:38508) 2024-04-25T09:06:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f0203e00640 1 -- 172.21.15.173:0/635962915 learned_addr learned my addr 172.21.15.173:0/635962915 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f0202a00640 1 --2- 172.21.15.173:0/635962915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa677d8990 0x55aa6778b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f0203400640 1 --2- 172.21.15.173:0/635962915 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa677d8070 0x55aa677d8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f0203e00640 1 -- 172.21.15.173:0/635962915 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa677d8070 msgr2=0x55aa677d8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f0203e00640 1 --2- 172.21.15.173:0/635962915 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa677d8070 0x55aa677d8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f0203e00640 1 -- 172.21.15.173:0/635962915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa677d8990 msgr2=0x55aa6778b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:31.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f0203e00640 1 --2- 172.21.15.173:0/635962915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa677d8990 0x55aa6778b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f0203e00640 1 -- 172.21.15.173:0/635962915 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa67561d00 con 0x55aa6778bbe0 2024-04-25T09:06:31.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f0202a00640 1 --2- 172.21.15.173:0/635962915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa677d8990 0x55aa6778b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:31.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.174+0000 7f0203e00640 1 --2- 172.21.15.173:0/635962915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa6778bbe0 0x55aa6778bfc0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f01fc01c6d0 tx=0x7f01fc0a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7363c5d16ba39e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:31.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f01efe00640 1 -- 172.21.15.173:0/635962915 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0ac040 con 0x55aa6778bbe0 2024-04-25T09:06:31.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f01efe00640 1 -- 172.21.15.173:0/635962915 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc0a6570 con 0x55aa6778bbe0 2024-04-25T09:06:31.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f01efe00640 1 -- 172.21.15.173:0/635962915 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0a6940 con 0x55aa6778bbe0 2024-04-25T09:06:31.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 1 -- 172.21.15.173:0/635962915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa6778bbe0 msgr2=0x55aa6778bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 1 --2- 172.21.15.173:0/635962915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa6778bbe0 0x55aa6778bfc0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f01fc01c6d0 tx=0x7f01fc0a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:31.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 1 -- 172.21.15.173:0/635962915 shutdown_connections 2024-04-25T09:06:31.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 1 --2- 172.21.15.173:0/635962915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa6778bbe0 0x55aa6778bfc0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 1 --2- 172.21.15.173:0/635962915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa677d8990 0x55aa6778b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 1 --2- 172.21.15.173:0/635962915 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa677d8070 0x55aa677d8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 1 -- 172.21.15.173:0/635962915 >> 172.21.15.173:0/635962915 conn(0x55aa677b8e10 msgr2=0x55aa677bb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:31.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 1 -- 172.21.15.173:0/635962915 shutdown_connections 2024-04-25T09:06:31.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 1 -- 172.21.15.173:0/635962915 wait complete. 2024-04-25T09:06:31.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 1 -- start start 2024-04-25T09:06:31.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 1 Processor -- start 2024-04-25T09:06:31.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa6778bbe0 0x55aa67791bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa677d8070 0x55aa67792100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa677d8990 0x55aa67792640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa675e0530 con 0x55aa677d8990 2024-04-25T09:06:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa67596ae0 con 0x55aa677d8070 2024-04-25T09:06:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa6759ae10 con 0x55aa6778bbe0 2024-04-25T09:06:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 10 client.0 _ll_register_callbacks cb 0x55aa67779750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f0203e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa677d8990 0x55aa67792640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f0203400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa6778bbe0 0x55aa67791bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f0203e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa677d8990 0x55aa67792640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38524/0 (socket says 172.21.15.173:38524) 2024-04-25T09:06:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f0203e00640 1 -- 172.21.15.173:0/3252666612 learned_addr learned my addr 172.21.15.173:0/3252666612 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f0202a00640 1 --2- 172.21.15.173:0/3252666612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa677d8070 0x55aa67792100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f0203e00640 1 -- 172.21.15.173:0/3252666612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa6778bbe0 msgr2=0x55aa67791bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f0203e00640 1 --2- 172.21.15.173:0/3252666612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa6778bbe0 0x55aa67791bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f0203e00640 1 -- 172.21.15.173:0/3252666612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa677d8070 msgr2=0x55aa67792100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f0203e00640 1 --2- 172.21.15.173:0/3252666612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa677d8070 0x55aa67792100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f0203e00640 1 -- 172.21.15.173:0/3252666612 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aa6757ea10 con 0x55aa677d8990 2024-04-25T09:06:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f0203e00640 1 --2- 172.21.15.173:0/3252666612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa677d8990 0x55aa67792640 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0093e0 tx=0x7f01fc01aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f51e377d5179b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f01ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f01ecc00640 1 -- 172.21.15.173:0/3252666612 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0ac070 con 0x55aa677d8990 2024-04-25T09:06:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f01ecc00640 1 -- 172.21.15.173:0/3252666612 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f01fc0a69a0 con 0x55aa677d8990 2024-04-25T09:06:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.178+0000 7f020dc65000 1 -- 172.21.15.173:0/3252666612 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01fc0a6570 con 0x55aa677d8990 2024-04-25T09:06:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f01ecc00640 1 -- 172.21.15.173:0/3252666612 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01fc0cb050 con 0x55aa677d8990 2024-04-25T09:06:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 10 client.6507 fetch_fsmap learned FSMap version 28 2024-04-25T09:06:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 1 -- 172.21.15.173:0/3252666612 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55aa675d6ef0 con 0x55aa677d8990 2024-04-25T09:06:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f01ecc00640 1 -- 172.21.15.173:0/3252666612 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc0a6570 con 0x55aa677d8990 2024-04-25T09:06:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f01ecc00640 1 -- 172.21.15.173:0/3252666612 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f01fc0ce020 con 0x55aa677d8990 2024-04-25T09:06:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 10 client.6507 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:06:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 10 client.6507 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:06:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 20 client.6507 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 1 --2- 172.21.15.173:0/3252666612 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55aa67792ee0 0x55aa677e95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 4 client.6507 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 1 -- 172.21.15.173:0/3252666612 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aa67577b20 con 0x55aa67792ee0 2024-04-25T09:06:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f0203400640 1 --2- 172.21.15.173:0/3252666612 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55aa67792ee0 0x55aa677e95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f0203400640 1 --2- 172.21.15.173:0/3252666612 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55aa67792ee0 0x55aa677e95e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c880be0dd67f0f5 server_cookie=2c34a735b8c9669b in_seq=0 out_seq=0 2024-04-25T09:06:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f01ecc00640 10 client.6507 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f01ecc00640 1 -- 172.21.15.173:0/3252666612 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55aa67577b20 con 0x55aa67792ee0 2024-04-25T09:06:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f01ecc00640 10 client.6507 handle_command_reply: tid=0 2024-04-25T09:06:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 1 client.6507 shutdown 2024-04-25T09:06:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 1 -- 172.21.15.173:0/3252666612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa677d8990 msgr2=0x55aa67792640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 1 --2- 172.21.15.173:0/3252666612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa677d8990 0x55aa67792640 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0093e0 tx=0x7f01fc01aed0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 1 -- 172.21.15.173:0/3252666612 shutdown_connections 2024-04-25T09:06:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 1 --2- 172.21.15.173:0/3252666612 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55aa67792ee0 0x55aa677e95e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 1 --2- 172.21.15.173:0/3252666612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa677d8990 0x55aa67792640 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 1 --2- 172.21.15.173:0/3252666612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa677d8070 0x55aa67792100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 1 --2- 172.21.15.173:0/3252666612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa6778bbe0 0x55aa67791bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f01ecc00640 0 client.6507 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:31.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 1 -- 172.21.15.173:0/3252666612 >> 172.21.15.173:0/3252666612 conn(0x55aa677b8e10 msgr2=0x55aa6778ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:31.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 1 -- 172.21.15.173:0/3252666612 shutdown_connections 2024-04-25T09:06:31.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 1 -- 172.21.15.173:0/3252666612 wait complete. 2024-04-25T09:06:31.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.182+0000 7f020dc65000 20 client.6507 trim_cache size 0 max 16384 2024-04-25T09:06:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.194+0000 7f020dc65000 1 Processor -- start 2024-04-25T09:06:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.194+0000 7f020dc65000 1 -- start start 2024-04-25T09:06:31.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.194+0000 7f020dc65000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa6778bbe0 0x55aa67789e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.194+0000 7f020dc65000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa677d8070 0x55aa6778a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.194+0000 7f020dc65000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa677d8990 0x55aa677ea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.194+0000 7f020dc65000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0204201f00 con 0x55aa6778bbe0 2024-04-25T09:06:31.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.194+0000 7f020dc65000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa675a8b90 con 0x55aa677d8070 2024-04-25T09:06:31.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.194+0000 7f020dc65000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa677971c0 con 0x55aa677d8990 2024-04-25T09:06:31.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.194+0000 7f0203400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa6778bbe0 0x55aa67789e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.194+0000 7f0203400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa6778bbe0 0x55aa67789e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38534/0 (socket says 172.21.15.173:38534) 2024-04-25T09:06:31.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.194+0000 7f0203400640 1 -- 172.21.15.173:0/2809863291 learned_addr learned my addr 172.21.15.173:0/2809863291 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:31.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.194+0000 7f0203400640 1 -- 172.21.15.173:0/2809863291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa677d8990 msgr2=0x55aa677ea5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:31.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.194+0000 7f0203400640 1 --2- 172.21.15.173:0/2809863291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa677d8990 0x55aa677ea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.194+0000 7f0203400640 1 -- 172.21.15.173:0/2809863291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa677d8070 msgr2=0x55aa6778a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:31.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.194+0000 7f0203400640 1 --2- 172.21.15.173:0/2809863291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa677d8070 0x55aa6778a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.194+0000 7f0203400640 1 -- 172.21.15.173:0/2809863291 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa6759b790 con 0x55aa6778bbe0 2024-04-25T09:06:31.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.194+0000 7f0203400640 1 --2- 172.21.15.173:0/2809863291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa6778bbe0 0x55aa67789e00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f01f400fbd0 tx=0x7f01f4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7cacd5687c8b45 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:31.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f01ef400640 1 -- 172.21.15.173:0/2809863291 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f402f070 con 0x55aa6778bbe0 2024-04-25T09:06:31.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f01ef400640 1 -- 172.21.15.173:0/2809863291 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f401c040 con 0x55aa6778bbe0 2024-04-25T09:06:31.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f01ef400640 1 -- 172.21.15.173:0/2809863291 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f401b030 con 0x55aa6778bbe0 2024-04-25T09:06:31.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 -- 172.21.15.173:0/2809863291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa6778bbe0 msgr2=0x55aa67789e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 --2- 172.21.15.173:0/2809863291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa6778bbe0 0x55aa67789e00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f01f400fbd0 tx=0x7f01f4015000 comp rx=0 tx=0).stop 2024-04-25T09:06:31.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 -- 172.21.15.173:0/2809863291 shutdown_connections 2024-04-25T09:06:31.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 --2- 172.21.15.173:0/2809863291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa677d8990 0x55aa677ea5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 --2- 172.21.15.173:0/2809863291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa677d8070 0x55aa6778a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 --2- 172.21.15.173:0/2809863291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa6778bbe0 0x55aa67789e00 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 -- 172.21.15.173:0/2809863291 >> 172.21.15.173:0/2809863291 conn(0x55aa677b8e10 msgr2=0x55aa67790780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 -- 172.21.15.173:0/2809863291 shutdown_connections 2024-04-25T09:06:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 -- 172.21.15.173:0/2809863291 wait complete. 2024-04-25T09:06:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 -- start start 2024-04-25T09:06:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 Processor -- start 2024-04-25T09:06:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa6778bbe0 0x55aa677eaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa677d8070 0x55aa677f5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa677d8990 0x55aa677f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa675db210 con 0x55aa677d8070 2024-04-25T09:06:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa675e0530 con 0x55aa6778bbe0 2024-04-25T09:06:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa67599700 con 0x55aa677d8990 2024-04-25T09:06:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 10 client.0 _ll_register_callbacks cb 0x7f01fc009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f0202a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa677d8070 0x55aa677f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f0202a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa677d8070 0x55aa677f5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38540/0 (socket says 172.21.15.173:38540) 2024-04-25T09:06:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f0202a00640 1 -- 172.21.15.173:0/18023542 learned_addr learned my addr 172.21.15.173:0/18023542 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f0203e00640 1 --2- 172.21.15.173:0/18023542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa677d8990 0x55aa677f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f0203400640 1 --2- 172.21.15.173:0/18023542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa6778bbe0 0x55aa677eaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f0202a00640 1 -- 172.21.15.173:0/18023542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa677d8990 msgr2=0x55aa677f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f0202a00640 1 --2- 172.21.15.173:0/18023542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa677d8990 0x55aa677f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f0202a00640 1 -- 172.21.15.173:0/18023542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa6778bbe0 msgr2=0x55aa677eaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f0202a00640 1 --2- 172.21.15.173:0/18023542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa6778bbe0 0x55aa677eaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f0202a00640 1 -- 172.21.15.173:0/18023542 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aa675a3da0 con 0x55aa677d8070 2024-04-25T09:06:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f0202a00640 1 --2- 172.21.15.173:0/18023542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa677d8070 0x55aa677f5070 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f01f000bdd0 tx=0x7f01f0059640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5659eefd7b4c2cf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f01ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f01ecc00640 1 -- 172.21.15.173:0/18023542 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f0059330 con 0x55aa677d8070 2024-04-25T09:06:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f01ecc00640 1 -- 172.21.15.173:0/18023542 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f01f0054880 con 0x55aa677d8070 2024-04-25T09:06:31.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 -- 172.21.15.173:0/18023542 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01f401c040 con 0x55aa677d8070 2024-04-25T09:06:31.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f01ecc00640 1 -- 172.21.15.173:0/18023542 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01f0054a80 con 0x55aa677d8070 2024-04-25T09:06:31.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 10 client.6513 fetch_fsmap learned FSMap version 28 2024-04-25T09:06:31.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.198+0000 7f020dc65000 1 -- 172.21.15.173:0/18023542 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55aa67298360 con 0x55aa677d8070 2024-04-25T09:06:31.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f01ecc00640 1 -- 172.21.15.173:0/18023542 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f401c040 con 0x55aa677d8070 2024-04-25T09:06:31.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f01ecc00640 1 -- 172.21.15.173:0/18023542 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f01f0022060 con 0x55aa677d8070 2024-04-25T09:06:31.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020dc65000 10 client.6513 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:06:31.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020dc65000 10 client.6513 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:06:31.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020dc65000 20 client.6513 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:31.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020dc65000 1 --2- 172.21.15.173:0/18023542 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55aa6783e4d0 0x55aa678408c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020dc65000 4 client.6513 mds_command: new command op to 5874 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 3174508789}] 2024-04-25T09:06:31.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020dc65000 1 -- 172.21.15.173:0/18023542 --> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] -- command(tid 0: {"prefix": "damage rm", "damage_id": 3174508789}) v1 -- 0x55aa675e9440 con 0x55aa6783e4d0 2024-04-25T09:06:31.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f0203400640 1 --2- 172.21.15.173:0/18023542 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55aa6783e4d0 0x55aa678408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f0203400640 1 --2- 172.21.15.173:0/18023542 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55aa6783e4d0 0x55aa678408c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72dd43206d50c6f6 server_cookie=3256c792f536a06d in_seq=0 out_seq=0 2024-04-25T09:06:31.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f01ecc00640 10 client.6513 ms_handle_connect on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:31.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f01ecc00640 1 -- 172.21.15.173:0/18023542 <== mds.0 v2:172.21.15.173:6835/3298938023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+0 (crc 0 0 0) 0x55aa675e9440 con 0x55aa6783e4d0 2024-04-25T09:06:31.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f01ecc00640 10 client.6513 handle_command_reply: tid=0 2024-04-25T09:06:31.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020dc65000 1 client.6513 shutdown 2024-04-25T09:06:31.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020dc65000 1 -- 172.21.15.173:0/18023542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa677d8070 msgr2=0x55aa677f5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020dc65000 1 --2- 172.21.15.173:0/18023542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa677d8070 0x55aa677f5070 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f01f000bdd0 tx=0x7f01f0059640 comp rx=0 tx=0).stop 2024-04-25T09:06:31.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020dc65000 1 -- 172.21.15.173:0/18023542 shutdown_connections 2024-04-25T09:06:31.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020dc65000 1 --2- 172.21.15.173:0/18023542 >> [v2:172.21.15.173:6835/3298938023,v1:172.21.15.173:6837/3298938023] conn(0x55aa6783e4d0 0x55aa678408c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020dc65000 1 --2- 172.21.15.173:0/18023542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55aa677d8990 0x55aa677f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020dc65000 1 --2- 172.21.15.173:0/18023542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa677d8070 0x55aa677f5070 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f01ecc00640 0 client.6513 ms_handle_reset on v2:172.21.15.173:6835/3298938023 2024-04-25T09:06:31.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020dc65000 1 --2- 172.21.15.173:0/18023542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa6778bbe0 0x55aa677eaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020dc65000 1 -- 172.21.15.173:0/18023542 >> 172.21.15.173:0/18023542 conn(0x55aa677b8e10 msgr2=0x55aa67791010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:31.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020dc65000 1 -- 172.21.15.173:0/18023542 shutdown_connections 2024-04-25T09:06:31.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020dc65000 1 -- 172.21.15.173:0/18023542 wait complete. 2024-04-25T09:06:31.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020dc65000 20 client.6513 trim_cache size 0 max 16384 2024-04-25T09:06:31.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020a800640 1 -- 172.21.15.173:0/4283216999 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01e4066f60 msgr2=0x7f01e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020a800640 1 --2- 172.21.15.173:0/4283216999 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01e4066f60 0x7f01e4069420 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f01f400a9b0 tx=0x7f01f4008040 comp rx=0 tx=0).stop 2024-04-25T09:06:31.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020a800640 1 -- 172.21.15.173:0/4283216999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02040cc260 msgr2=0x7f02041427a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020a800640 1 --2- 172.21.15.173:0/4283216999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02040cc260 0x7f02041427a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f01f000b410 tx=0x7f01f000b8d0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020a800640 1 -- 172.21.15.173:0/4283216999 shutdown_connections 2024-04-25T09:06:31.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020a800640 1 --2- 172.21.15.173:0/4283216999 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01e4066f60 0x7f01e4069420 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020a800640 1 --2- 172.21.15.173:0/4283216999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0204145290 0x7f02040ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020a800640 1 --2- 172.21.15.173:0/4283216999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02040cc260 0x7f02041427a0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020a800640 1 --2- 172.21.15.173:0/4283216999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02040b3fe0 0x7f02041f5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020a800640 1 -- 172.21.15.173:0/4283216999 >> 172.21.15.173:0/4283216999 conn(0x7f020406ac90 msgr2=0x7f020406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:31.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020a800640 1 -- 172.21.15.173:0/4283216999 shutdown_connections 2024-04-25T09:06:31.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.202+0000 7f020a800640 1 -- 172.21.15.173:0/4283216999 wait complete. 2024-04-25T09:06:31.209 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-04-25T09:06:31.209 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:31.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.358+0000 7febc6a00640 1 Processor -- start 2024-04-25T09:06:31.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.358+0000 7febc6a00640 1 -- start start 2024-04-25T09:06:31.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.358+0000 7febc6a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7febc00c7d20 0x7febc01633e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.358+0000 7febc6a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc00cd1b0 con 0x7febc00ccc60 2024-04-25T09:06:31.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.358+0000 7febc6a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc00c5230 con 0x7febc00cf6c0 2024-04-25T09:06:31.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.358+0000 7febc6a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc00c5510 con 0x7febc00c7d20 2024-04-25T09:06:31.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.358+0000 7febc4c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7febc00c7d20 0x7febc01633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.358+0000 7febc6000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7febc00ccc60 0x7febc0165930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49554/0 (socket says 172.21.15.173:49554) 2024-04-25T09:06:31.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.358+0000 7febc6000640 1 -- 172.21.15.173:0/3887920680 learned_addr learned my addr 172.21.15.173:0/3887920680 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:31.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.358+0000 7febc4c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7febc00c7d20 0x7febc01633e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38556/0 (socket says 172.21.15.173:38556) 2024-04-25T09:06:31.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.358+0000 7febc4c00640 1 -- 172.21.15.173:0/3887920680 >> v1:172.21.15.194:6789/0 conn(0x7febc00cf6c0 legacy=0x7febc00cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.358+0000 7febc4c00640 1 -- 172.21.15.173:0/3887920680 >> v1:172.21.15.173:6789/0 conn(0x7febc00ccc60 legacy=0x7febc0165930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.358+0000 7febc4c00640 1 -- 172.21.15.173:0/3887920680 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc00c57f0 con 0x7febc00c7d20 2024-04-25T09:06:31.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.358+0000 7febbfe00640 1 -- 172.21.15.173:0/3887920680 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282265037 0 0) 0x7febc00cd1b0 con 0x7febc00ccc60 2024-04-25T09:06:31.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.362+0000 7febc4c00640 1 --2- 172.21.15.173:0/3887920680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc00c7d20 0x7febc01633e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7febac0097c0 tx=0x7febac01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c4cf1262de1e01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:31.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.362+0000 7febbfe00640 1 -- 172.21.15.173:0/3887920680 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac0b0070 con 0x7febc00c7d20 2024-04-25T09:06:31.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.362+0000 7febbfe00640 1 -- 172.21.15.173:0/3887920680 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac0ab600 con 0x7febc00c7d20 2024-04-25T09:06:31.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.362+0000 7febbfe00640 1 -- 172.21.15.173:0/3887920680 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac0ab9d0 con 0x7febc00c7d20 2024-04-25T09:06:31.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.362+0000 7febc6a00640 1 -- 172.21.15.173:0/3887920680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc00c7d20 msgr2=0x7febc01633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.362+0000 7febc6a00640 1 --2- 172.21.15.173:0/3887920680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc00c7d20 0x7febc01633e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7febac0097c0 tx=0x7febac01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.362+0000 7febc6a00640 1 -- 172.21.15.173:0/3887920680 shutdown_connections 2024-04-25T09:06:31.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.362+0000 7febc6a00640 1 --2- 172.21.15.173:0/3887920680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc00c7d20 0x7febc01633e0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.362+0000 7febc6a00640 1 -- 172.21.15.173:0/3887920680 >> 172.21.15.173:0/3887920680 conn(0x7febc00b3130 msgr2=0x7febc00b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:31.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.362+0000 7febc6a00640 1 -- 172.21.15.173:0/3887920680 shutdown_connections 2024-04-25T09:06:31.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.362+0000 7febc6a00640 1 -- 172.21.15.173:0/3887920680 wait complete. 2024-04-25T09:06:31.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.362+0000 7febc6a00640 1 Processor -- start 2024-04-25T09:06:31.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.362+0000 7febc6a00640 1 -- start start 2024-04-25T09:06:31.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc6a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc00c7d20 0x7febc015a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc6a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febc00ccc60 0x7febc0152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc6a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc00cf6c0 0x7febc01555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc6a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc01699f0 con 0x7febc00cf6c0 2024-04-25T09:06:31.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc6a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc0169870 con 0x7febc00c7d20 2024-04-25T09:06:31.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc6a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc0169b70 con 0x7febc00ccc60 2024-04-25T09:06:31.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc00cf6c0 0x7febc01555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc00cf6c0 0x7febc01555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38566/0 (socket says 172.21.15.173:38566) 2024-04-25T09:06:31.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc6000640 1 -- 172.21.15.173:0/1219847063 learned_addr learned my addr 172.21.15.173:0/1219847063 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:31.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc5600640 1 --2- 172.21.15.173:0/1219847063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc00c7d20 0x7febc015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc4c00640 1 --2- 172.21.15.173:0/1219847063 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febc00ccc60 0x7febc0152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc6000640 1 -- 172.21.15.173:0/1219847063 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febc00ccc60 msgr2=0x7febc0152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc6000640 1 --2- 172.21.15.173:0/1219847063 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febc00ccc60 0x7febc0152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc6000640 1 -- 172.21.15.173:0/1219847063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc00c7d20 msgr2=0x7febc015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc6000640 1 --2- 172.21.15.173:0/1219847063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc00c7d20 0x7febc015a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc6000640 1 -- 172.21.15.173:0/1219847063 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc015a040 con 0x7febc00cf6c0 2024-04-25T09:06:31.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc6000640 1 --2- 172.21.15.173:0/1219847063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc00cf6c0 0x7febc01555c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7febb800c700 tx=0x7febb800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:31.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febbd600640 1 -- 172.21.15.173:0/1219847063 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb8018070 con 0x7febc00cf6c0 2024-04-25T09:06:31.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febbd600640 1 -- 172.21.15.173:0/1219847063 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb800ce10 con 0x7febc00cf6c0 2024-04-25T09:06:31.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc6a00640 1 -- 172.21.15.173:0/1219847063 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc01525d0 con 0x7febc00cf6c0 2024-04-25T09:06:31.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febbd600640 1 -- 172.21.15.173:0/1219847063 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb800a860 con 0x7febc00cf6c0 2024-04-25T09:06:31.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc6a00640 1 -- 172.21.15.173:0/1219847063 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc0159d60 con 0x7febc00cf6c0 2024-04-25T09:06:31.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.366+0000 7febc6a00640 1 -- 172.21.15.173:0/1219847063 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc0073a40 con 0x7febc00cf6c0 2024-04-25T09:06:31.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.370+0000 7febbd600640 1 -- 172.21.15.173:0/1219847063 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7febb801b070 con 0x7febc00cf6c0 2024-04-25T09:06:31.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.370+0000 7febbd600640 1 --2- 172.21.15.173:0/1219847063 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feba0066f60 0x7feba0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.370+0000 7febbd600640 1 -- 172.21.15.173:0/1219847063 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7febb8084680 con 0x7febc00cf6c0 2024-04-25T09:06:31.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.370+0000 7febc5600640 1 --2- 172.21.15.173:0/1219847063 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feba0066f60 0x7feba0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.370+0000 7febc5600640 1 --2- 172.21.15.173:0/1219847063 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feba0066f60 0x7feba0069420 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7febc00b28a0 tx=0x7febb4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:31.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.374+0000 7febbd600640 1 -- 172.21.15.173:0/1219847063 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7febb8054e90 con 0x7febc00cf6c0 2024-04-25T09:06:31.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.558+0000 7febc6a00640 1 -- 172.21.15.173:0/1219847063 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febc0153840 con 0x7febc00cf6c0 2024-04-25T09:06:31.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.558+0000 7febbd600640 1 -- 172.21.15.173:0/1219847063 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4951 (secure 0 0 0) 0x7febb8082e20 con 0x7febc00cf6c0 2024-04-25T09:06:31.546 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:31.546 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:06:27.244658+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:31.546 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 28 2024-04-25T09:06:31.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.558+0000 7febc6a00640 1 -- 172.21.15.173:0/1219847063 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feba0066f60 msgr2=0x7feba0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.558+0000 7febc6a00640 1 --2- 172.21.15.173:0/1219847063 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feba0066f60 0x7feba0069420 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7febc00b28a0 tx=0x7febb4009040 comp rx=0 tx=0).stop 2024-04-25T09:06:31.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.558+0000 7febc6a00640 1 -- 172.21.15.173:0/1219847063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc00cf6c0 msgr2=0x7febc01555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.558+0000 7febc6a00640 1 --2- 172.21.15.173:0/1219847063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc00cf6c0 0x7febc01555c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7febb800c700 tx=0x7febb800cbc0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.558+0000 7febc6a00640 1 -- 172.21.15.173:0/1219847063 shutdown_connections 2024-04-25T09:06:31.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.558+0000 7febc6a00640 1 --2- 172.21.15.173:0/1219847063 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feba0066f60 0x7feba0069420 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.558+0000 7febc6a00640 1 --2- 172.21.15.173:0/1219847063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc00cf6c0 0x7febc01555c0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.558+0000 7febc6a00640 1 --2- 172.21.15.173:0/1219847063 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febc00ccc60 0x7febc0152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.558+0000 7febc6a00640 1 --2- 172.21.15.173:0/1219847063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febc00c7d20 0x7febc015a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.558+0000 7febc6a00640 1 -- 172.21.15.173:0/1219847063 >> 172.21.15.173:0/1219847063 conn(0x7febc00b3130 msgr2=0x7febc00c5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:31.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.558+0000 7febc6a00640 1 -- 172.21.15.173:0/1219847063 shutdown_connections 2024-04-25T09:06:31.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:31.558+0000 7febc6a00640 1 -- 172.21.15.173:0/1219847063 wait complete. 2024-04-25T09:06:31.567 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok flush_path / 2024-04-25T09:06:31.625 INFO:tasks.ceph.mon.a.smithi173.stderr:2024-04-25T09:06:31.638+0000 7f537f000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T09:06:31.709 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:31.709 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0 2024-04-25T09:06:31.709 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:31.724 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T09:06:31.724 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:06:31.725 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:06:31.803 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:06:31.920 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:06:31.921 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:06:31.921 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:31.929 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:06:31.929 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:31.980 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:32.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.174+0000 7f8289600640 1 Processor -- start 2024-04-25T09:06:32.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.174+0000 7f8289600640 1 -- start start 2024-04-25T09:06:32.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.174+0000 7f8289600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f828406dac0 0x7f82840ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.174+0000 7f8289600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f828406bca0 0x7f828406c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.174+0000 7f8289600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8284061d60 con 0x7f8284160fe0 2024-04-25T09:06:32.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.174+0000 7f8289600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828406c640 con 0x7f828406bca0 2024-04-25T09:06:32.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.174+0000 7f8289600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82841613c0 con 0x7f828406dac0 2024-04-25T09:06:32.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.178+0000 7f8282000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f828406dac0 0x7f82840ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.178+0000 7f8283400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f828406bca0 0x7f828406c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.178+0000 7f8282a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f8284160fe0 0x7f8284161fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:44332/0 (socket says 172.21.15.173:44332) 2024-04-25T09:06:32.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.178+0000 7f8282a00640 1 -- 172.21.15.173:0/3904272067 learned_addr learned my addr 172.21.15.173:0/3904272067 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:32.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.178+0000 7f8283400640 1 -- 172.21.15.173:0/3904272067 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f828406dac0 msgr2=0x7f82840ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:32.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.178+0000 7f8283400640 1 --2- 172.21.15.173:0/3904272067 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f828406dac0 0x7f82840ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.178+0000 7f8283400640 1 -- 172.21.15.173:0/3904272067 >> v1:172.21.15.194:6789/0 conn(0x7f8284160fe0 legacy=0x7f8284161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.178+0000 7f8283400640 1 -- 172.21.15.173:0/3904272067 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828406dfa0 con 0x7f828406bca0 2024-04-25T09:06:32.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.178+0000 7f8282000640 1 --2- 172.21.15.173:0/3904272067 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f828406dac0 0x7f82840ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:32.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.178+0000 7f8281600640 1 -- 172.21.15.173:0/3904272067 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618265162 0 0) 0x7f82740014a0 con 0x7f8284160fe0 2024-04-25T09:06:32.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.178+0000 7f8283400640 1 --2- 172.21.15.173:0/3904272067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f828406bca0 0x7f828406c100 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f827c0097f0 tx=0x7f827c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30c508706c46b758 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:32.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8281600640 1 -- 172.21.15.173:0/3904272067 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c0b1070 con 0x7f828406bca0 2024-04-25T09:06:32.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8281600640 1 -- 172.21.15.173:0/3904272067 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c0a8050 con 0x7f828406bca0 2024-04-25T09:06:32.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8281600640 1 -- 172.21.15.173:0/3904272067 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c0ac860 con 0x7f828406bca0 2024-04-25T09:06:32.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8289600640 1 -- 172.21.15.173:0/3904272067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f828406bca0 msgr2=0x7f828406c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8289600640 1 --2- 172.21.15.173:0/3904272067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f828406bca0 0x7f828406c100 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f827c0097f0 tx=0x7f827c01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8289600640 1 -- 172.21.15.173:0/3904272067 shutdown_connections 2024-04-25T09:06:32.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8289600640 1 --2- 172.21.15.173:0/3904272067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f828406bca0 0x7f828406c100 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8289600640 1 --2- 172.21.15.173:0/3904272067 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f828406dac0 0x7f82840ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8289600640 1 -- 172.21.15.173:0/3904272067 >> 172.21.15.173:0/3904272067 conn(0x7f8284071c20 msgr2=0x7f8284072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:32.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8289600640 1 -- 172.21.15.173:0/3904272067 shutdown_connections 2024-04-25T09:06:32.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8289600640 1 -- 172.21.15.173:0/3904272067 wait complete. 2024-04-25T09:06:32.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8289600640 1 Processor -- start 2024-04-25T09:06:32.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8289600640 1 -- start start 2024-04-25T09:06:32.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8289600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f828406bca0 0x7f82840b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8289600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f828406dac0 0x7f82840b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8289600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8284160fe0 0x7f82840b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8289600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82840ad340 con 0x7f8284160fe0 2024-04-25T09:06:32.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8289600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828406eb20 con 0x7f828406dac0 2024-04-25T09:06:32.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8289600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82840ad4c0 con 0x7f828406bca0 2024-04-25T09:06:32.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8283400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8284160fe0 0x7f82840b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8283400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8284160fe0 0x7f82840b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38574/0 (socket says 172.21.15.173:38574) 2024-04-25T09:06:32.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8283400640 1 -- 172.21.15.173:0/3985273084 learned_addr learned my addr 172.21.15.173:0/3985273084 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:32.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8282a00640 1 --2- 172.21.15.173:0/3985273084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f828406bca0 0x7f82840b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.182+0000 7f8282000640 1 --2- 172.21.15.173:0/3985273084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f828406dac0 0x7f82840b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.186+0000 7f8283400640 1 -- 172.21.15.173:0/3985273084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f828406bca0 msgr2=0x7f82840b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.186+0000 7f8283400640 1 --2- 172.21.15.173:0/3985273084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f828406bca0 0x7f82840b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.186+0000 7f8283400640 1 -- 172.21.15.173:0/3985273084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f828406dac0 msgr2=0x7f82840b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.186+0000 7f8283400640 1 --2- 172.21.15.173:0/3985273084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f828406dac0 0x7f82840b0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.186+0000 7f8283400640 1 -- 172.21.15.173:0/3985273084 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82841504f0 con 0x7f8284160fe0 2024-04-25T09:06:32.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.186+0000 7f8283400640 1 --2- 172.21.15.173:0/3985273084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8284160fe0 0x7f82840b13f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f827c0097f0 tx=0x7f827c01ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:32.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.186+0000 7f827aa00640 1 -- 172.21.15.173:0/3985273084 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c0bd070 con 0x7f8284160fe0 2024-04-25T09:06:32.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.186+0000 7f827aa00640 1 -- 172.21.15.173:0/3985273084 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c0b2040 con 0x7f8284160fe0 2024-04-25T09:06:32.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.186+0000 7f8289600640 1 -- 172.21.15.173:0/3985273084 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82841507d0 con 0x7f8284160fe0 2024-04-25T09:06:32.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.186+0000 7f827aa00640 1 -- 172.21.15.173:0/3985273084 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c0b1050 con 0x7f8284160fe0 2024-04-25T09:06:32.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.186+0000 7f8289600640 1 -- 172.21.15.173:0/3985273084 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8284150d90 con 0x7f8284160fe0 2024-04-25T09:06:32.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.186+0000 7f8289600640 1 -- 172.21.15.173:0/3985273084 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8284073a40 con 0x7f8284160fe0 2024-04-25T09:06:32.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.186+0000 7f827aa00640 1 -- 172.21.15.173:0/3985273084 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f827c0c0070 con 0x7f8284160fe0 2024-04-25T09:06:32.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.190+0000 7f827aa00640 1 --2- 172.21.15.173:0/3985273084 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8264066f60 0x7f8264069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.190+0000 7f827aa00640 1 -- 172.21.15.173:0/3985273084 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f827c11eba0 con 0x7f8284160fe0 2024-04-25T09:06:32.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.190+0000 7f8282a00640 1 --2- 172.21.15.173:0/3985273084 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8264066f60 0x7f8264069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.190+0000 7f8282a00640 1 --2- 172.21.15.173:0/3985273084 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8264066f60 0x7f8264069420 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f82740012f0 tx=0x7f8274001690 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:32.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.194+0000 7f827aa00640 1 -- 172.21.15.173:0/3985273084 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f827c016090 con 0x7f8284160fe0 2024-04-25T09:06:32.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.346+0000 7f8289600640 1 -- 172.21.15.173:0/3985273084 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82840cf6c0 con 0x7f8284160fe0 2024-04-25T09:06:32.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.350+0000 7f827aa00640 1 -- 172.21.15.173:0/3985273084 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17002 (secure 0 0 0) 0x7f827c0ef460 con 0x7f8284160fe0 2024-04-25T09:06:32.337 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:32.337 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":56,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:05:56.208638+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:52.287873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:53.577379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:32.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.350+0000 7f8289600640 1 -- 172.21.15.173:0/3985273084 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8264066f60 msgr2=0x7f8264069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.350+0000 7f8289600640 1 --2- 172.21.15.173:0/3985273084 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8264066f60 0x7f8264069420 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f82740012f0 tx=0x7f8274001690 comp rx=0 tx=0).stop 2024-04-25T09:06:32.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.350+0000 7f8289600640 1 -- 172.21.15.173:0/3985273084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8284160fe0 msgr2=0x7f82840b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.350+0000 7f8289600640 1 --2- 172.21.15.173:0/3985273084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8284160fe0 0x7f82840b13f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f827c0097f0 tx=0x7f827c01ac20 comp rx=0 tx=0).stop 2024-04-25T09:06:32.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.350+0000 7f8289600640 1 -- 172.21.15.173:0/3985273084 shutdown_connections 2024-04-25T09:06:32.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.350+0000 7f8289600640 1 --2- 172.21.15.173:0/3985273084 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8264066f60 0x7f8264069420 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.350+0000 7f8289600640 1 --2- 172.21.15.173:0/3985273084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8284160fe0 0x7f82840b13f0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.350+0000 7f8289600640 1 --2- 172.21.15.173:0/3985273084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f828406dac0 0x7f82840b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.350+0000 7f8289600640 1 --2- 172.21.15.173:0/3985273084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f828406bca0 0x7f82840b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.350+0000 7f8289600640 1 -- 172.21.15.173:0/3985273084 >> 172.21.15.173:0/3985273084 conn(0x7f8284071c20 msgr2=0x7f828414e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:32.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.350+0000 7f8289600640 1 -- 172.21.15.173:0/3985273084 shutdown_connections 2024-04-25T09:06:32.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.350+0000 7f8289600640 1 -- 172.21.15.173:0/3985273084 wait complete. 2024-04-25T09:06:32.358 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:05:52.287873+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:05:53.577379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:06:32.358 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:06:32.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.506+0000 7f39ada00640 1 Processor -- start 2024-04-25T09:06:32.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.506+0000 7f39ada00640 1 -- start start 2024-04-25T09:06:32.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.510+0000 7f39ada00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f39a8145290 0x7f39a815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.510+0000 7f39ada00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39a80b3fe0 0x7f39a80b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.510+0000 7f39ada00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a815c5f0 con 0x7f39a80cc260 2024-04-25T09:06:32.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.510+0000 7f39ada00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a806d4b0 con 0x7f39a8145290 2024-04-25T09:06:32.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.510+0000 7f39ada00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a806d790 con 0x7f39a80b3fe0 2024-04-25T09:06:32.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.510+0000 7f39a7400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f39a80cc260 0x7f39a80cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49558/0 (socket says 172.21.15.173:49558) 2024-04-25T09:06:32.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.510+0000 7f39a7400640 1 -- 172.21.15.173:0/594743760 learned_addr learned my addr 172.21.15.173:0/594743760 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:32.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.510+0000 7f39a6a00640 1 --2- 172.21.15.173:0/594743760 >> v2:172.21.15.194:3300/0 conn(0x7f39a8145290 0x7f39a815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.510+0000 7f399e000640 1 --2- 172.21.15.173:0/594743760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39a80b3fe0 0x7f39a80b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.510+0000 7f39a6000640 1 -- 172.21.15.173:0/594743760 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690105895 0 0) 0x7f39a00014a0 con 0x7f39a80cc260 2024-04-25T09:06:32.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.510+0000 7f39a6000640 1 -- 172.21.15.173:0/594743760 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f398c003530 con 0x7f39a80cc260 2024-04-25T09:06:32.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.510+0000 7f39a6a00640 1 -- 172.21.15.173:0/594743760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39a80b3fe0 msgr2=0x7f39a80b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:32.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.510+0000 7f39a6a00640 1 --2- 172.21.15.173:0/594743760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39a80b3fe0 0x7f39a80b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.510+0000 7f39a6a00640 1 -- 172.21.15.173:0/594743760 >> v1:172.21.15.173:6789/0 conn(0x7f39a80cc260 legacy=0x7f39a80cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.510+0000 7f39a6a00640 1 -- 172.21.15.173:0/594743760 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a806da70 con 0x7f39a8145290 2024-04-25T09:06:32.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.514+0000 7f39a6a00640 1 --2- 172.21.15.173:0/594743760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39a8145290 0x7f39a815c0b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f39980097c0 tx=0x7f399801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=408e51f1fd138d1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:32.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.514+0000 7f39a6000640 1 -- 172.21.15.173:0/594743760 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39980b0070 con 0x7f39a8145290 2024-04-25T09:06:32.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.514+0000 7f39a6000640 1 -- 172.21.15.173:0/594743760 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39980ab600 con 0x7f39a8145290 2024-04-25T09:06:32.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.514+0000 7f39a6000640 1 -- 172.21.15.173:0/594743760 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39980ab9d0 con 0x7f39a8145290 2024-04-25T09:06:32.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.514+0000 7f39ada00640 1 -- 172.21.15.173:0/594743760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39a8145290 msgr2=0x7f39a815c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.514+0000 7f39ada00640 1 --2- 172.21.15.173:0/594743760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39a8145290 0x7f39a815c0b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f39980097c0 tx=0x7f399801c380 comp rx=0 tx=0).stop 2024-04-25T09:06:32.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.514+0000 7f39ada00640 1 -- 172.21.15.173:0/594743760 shutdown_connections 2024-04-25T09:06:32.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.514+0000 7f39ada00640 1 --2- 172.21.15.173:0/594743760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39a80b3fe0 0x7f39a80b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.514+0000 7f39ada00640 1 --2- 172.21.15.173:0/594743760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39a8145290 0x7f39a815c0b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.514+0000 7f39ada00640 1 -- 172.21.15.173:0/594743760 >> 172.21.15.173:0/594743760 conn(0x7f39a806ac90 msgr2=0x7f39a806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:32.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.514+0000 7f39ada00640 1 -- 172.21.15.173:0/594743760 shutdown_connections 2024-04-25T09:06:32.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.514+0000 7f39ada00640 1 -- 172.21.15.173:0/594743760 wait complete. 2024-04-25T09:06:32.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.514+0000 7f39ada00640 1 Processor -- start 2024-04-25T09:06:32.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.514+0000 7f39ada00640 1 -- start start 2024-04-25T09:06:32.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39ada00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39a80b3fe0 0x7f39a815b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39ada00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39a80cc260 0x7f39a80b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39ada00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39a8145290 0x7f39a8141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39ada00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a806eee0 con 0x7f39a8145290 2024-04-25T09:06:32.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39ada00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a806ed60 con 0x7f39a80cc260 2024-04-25T09:06:32.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39ada00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a806f060 con 0x7f39a80b3fe0 2024-04-25T09:06:32.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39a7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39a8145290 0x7f39a8141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39a7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39a8145290 0x7f39a8141c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38582/0 (socket says 172.21.15.173:38582) 2024-04-25T09:06:32.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39a7400640 1 -- 172.21.15.173:0/3479479510 learned_addr learned my addr 172.21.15.173:0/3479479510 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:32.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f399e000640 1 --2- 172.21.15.173:0/3479479510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39a80cc260 0x7f39a80b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39a6a00640 1 --2- 172.21.15.173:0/3479479510 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39a80b3fe0 0x7f39a815b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39a7400640 1 -- 172.21.15.173:0/3479479510 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39a80b3fe0 msgr2=0x7f39a815b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39a7400640 1 --2- 172.21.15.173:0/3479479510 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39a80b3fe0 0x7f39a815b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39a7400640 1 -- 172.21.15.173:0/3479479510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39a80cc260 msgr2=0x7f39a80b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39a7400640 1 --2- 172.21.15.173:0/3479479510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39a80cc260 0x7f39a80b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39a7400640 1 -- 172.21.15.173:0/3479479510 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a813f050 con 0x7f39a8145290 2024-04-25T09:06:32.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f399e000640 1 --2- 172.21.15.173:0/3479479510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39a80cc260 0x7f39a80b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:32.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39a7400640 1 --2- 172.21.15.173:0/3479479510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39a8145290 0x7f39a8141c50 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f39a000cb10 tx=0x7f39a000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:32.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f399f400640 1 -- 172.21.15.173:0/3479479510 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0017070 con 0x7f39a8145290 2024-04-25T09:06:32.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f399f400640 1 -- 172.21.15.173:0/3479479510 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a000abb0 con 0x7f39a8145290 2024-04-25T09:06:32.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39ada00640 1 -- 172.21.15.173:0/3479479510 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a813f330 con 0x7f39a8145290 2024-04-25T09:06:32.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f399f400640 1 -- 172.21.15.173:0/3479479510 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0012400 con 0x7f39a8145290 2024-04-25T09:06:32.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39ada00640 1 -- 172.21.15.173:0/3479479510 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a813f8f0 con 0x7f39a8145290 2024-04-25T09:06:32.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f39ada00640 1 -- 172.21.15.173:0/3479479510 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a8073ab0 con 0x7f39a8145290 2024-04-25T09:06:32.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.518+0000 7f399f400640 1 -- 172.21.15.173:0/3479479510 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f39a001a070 con 0x7f39a8145290 2024-04-25T09:06:32.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.522+0000 7f399f400640 1 --2- 172.21.15.173:0/3479479510 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3984066f60 0x7f3984069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.522+0000 7f399f400640 1 -- 172.21.15.173:0/3479479510 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f39a0084f00 con 0x7f39a8145290 2024-04-25T09:06:32.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.522+0000 7f39a6a00640 1 --2- 172.21.15.173:0/3479479510 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3984066f60 0x7f3984069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.522+0000 7f39a6a00640 1 --2- 172.21.15.173:0/3479479510 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3984066f60 0x7f3984069420 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f39980ad000 tx=0x7f3998008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:32.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.526+0000 7f399f400640 1 -- 172.21.15.173:0/3479479510 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f39a815c5f0 con 0x7f39a8145290 2024-04-25T09:06:32.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.686+0000 7f39ada00640 1 -- 172.21.15.173:0/3479479510 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39a81449c0 con 0x7f39a8145290 2024-04-25T09:06:32.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.686+0000 7f399f400640 1 -- 172.21.15.173:0/3479479510 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39a0055690 con 0x7f39a8145290 2024-04-25T09:06:32.673 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:06:32.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.686+0000 7f39ada00640 1 -- 172.21.15.173:0/3479479510 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3984066f60 msgr2=0x7f3984069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.686+0000 7f39ada00640 1 --2- 172.21.15.173:0/3479479510 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3984066f60 0x7f3984069420 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f39980ad000 tx=0x7f3998008040 comp rx=0 tx=0).stop 2024-04-25T09:06:32.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.686+0000 7f39ada00640 1 -- 172.21.15.173:0/3479479510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39a8145290 msgr2=0x7f39a8141c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.686+0000 7f39ada00640 1 --2- 172.21.15.173:0/3479479510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39a8145290 0x7f39a8141c50 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f39a000cb10 tx=0x7f39a000a060 comp rx=0 tx=0).stop 2024-04-25T09:06:32.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.686+0000 7f39ada00640 1 -- 172.21.15.173:0/3479479510 shutdown_connections 2024-04-25T09:06:32.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.686+0000 7f39ada00640 1 --2- 172.21.15.173:0/3479479510 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3984066f60 0x7f3984069420 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.686+0000 7f39ada00640 1 --2- 172.21.15.173:0/3479479510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39a8145290 0x7f39a8141c50 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.686+0000 7f39ada00640 1 --2- 172.21.15.173:0/3479479510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39a80cc260 0x7f39a80b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.686+0000 7f39ada00640 1 --2- 172.21.15.173:0/3479479510 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39a80b3fe0 0x7f39a815b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.686+0000 7f39ada00640 1 -- 172.21.15.173:0/3479479510 >> 172.21.15.173:0/3479479510 conn(0x7f39a806ac90 msgr2=0x7f39a8143cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:32.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.686+0000 7f39ada00640 1 -- 172.21.15.173:0/3479479510 shutdown_connections 2024-04-25T09:06:32.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.686+0000 7f39ada00640 1 -- 172.21.15.173:0/3479479510 wait complete. 2024-04-25T09:06:32.695 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:06:32.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.846+0000 7f22aaa00640 1 Processor -- start 2024-04-25T09:06:32.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.846+0000 7f22aaa00640 1 -- start start 2024-04-25T09:06:32.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.846+0000 7f22aaa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22a4145290 0x7f22a415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.846+0000 7f22aaa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f22a40cc260 0x7f22a40cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.846+0000 7f22aaa00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a415c5f0 con 0x7f22a40b3fe0 2024-04-25T09:06:32.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.846+0000 7f22aaa00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a406d4b0 con 0x7f22a40cc260 2024-04-25T09:06:32.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.846+0000 7f22aaa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a406d790 con 0x7f22a4145290 2024-04-25T09:06:32.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.846+0000 7f229b400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f22a40b3fe0 0x7f22a40b4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49568/0 (socket says 172.21.15.173:49568) 2024-04-25T09:06:32.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.846+0000 7f229b400640 1 -- 172.21.15.173:0/760734413 learned_addr learned my addr 172.21.15.173:0/760734413 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:32.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a8a00640 1 --2- 172.21.15.173:0/760734413 >> v2:172.21.15.194:3300/0 conn(0x7f22a40cc260 0x7f22a40cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a3e00640 1 --2- 172.21.15.173:0/760734413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22a4145290 0x7f22a415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a3400640 1 -- 172.21.15.173:0/760734413 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215599788 0 0) 0x7f228c001120 con 0x7f22a40b3fe0 2024-04-25T09:06:32.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a3400640 1 -- 172.21.15.173:0/760734413 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2288003530 con 0x7f22a40b3fe0 2024-04-25T09:06:32.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a3400640 1 -- 172.21.15.173:0/760734413 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4070734328 0 0) 0x7f2288003530 con 0x7f22a40b3fe0 2024-04-25T09:06:32.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a3400640 1 -- 172.21.15.173:0/760734413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22a4145290 msgr2=0x7f22a415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:32.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a3400640 1 --2- 172.21.15.173:0/760734413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22a4145290 0x7f22a415c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a3400640 1 -- 172.21.15.173:0/760734413 >> v2:172.21.15.194:3300/0 conn(0x7f22a40cc260 msgr2=0x7f22a40cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:32.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a3400640 1 --2- 172.21.15.173:0/760734413 >> v2:172.21.15.194:3300/0 conn(0x7f22a40cc260 0x7f22a40cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a3400640 1 -- 172.21.15.173:0/760734413 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a406da70 con 0x7f22a40b3fe0 2024-04-25T09:06:32.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a3400640 1 -- 172.21.15.173:0/760734413 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f228c001850 con 0x7f22a40b3fe0 2024-04-25T09:06:32.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a3400640 1 -- 172.21.15.173:0/760734413 >> v1:172.21.15.173:6789/0 conn(0x7f22a40b3fe0 legacy=0x7f22a40b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a3400640 1 --2- 172.21.15.173:0/760734413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22a4145290 0x7f22880039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a3400640 1 --2- 172.21.15.173:0/760734413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2288003f40 0x7f2288004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a3400640 1 --2- 172.21.15.173:0/760734413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2288004d50 0x7f22880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a3400640 1 -- 172.21.15.173:0/760734413 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a406d4b0 con 0x7f2288003f40 2024-04-25T09:06:32.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a3400640 1 -- 172.21.15.173:0/760734413 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a406d790 con 0x7f2288004d50 2024-04-25T09:06:32.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a3400640 1 -- 172.21.15.173:0/760734413 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228800bab0 con 0x7f22a4145290 2024-04-25T09:06:32.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f229b400640 1 --2- 172.21.15.173:0/760734413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2288003f40 0x7f2288004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a3e00640 1 --2- 172.21.15.173:0/760734413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22a4145290 0x7f22880039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f22a8a00640 1 --2- 172.21.15.173:0/760734413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2288004d50 0x7f22880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f229b400640 1 -- 172.21.15.173:0/760734413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22a4145290 msgr2=0x7f22880039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:32.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f229b400640 1 --2- 172.21.15.173:0/760734413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22a4145290 0x7f22880039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f229b400640 1 -- 172.21.15.173:0/760734413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2288004d50 msgr2=0x7f22880051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:32.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f229b400640 1 --2- 172.21.15.173:0/760734413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2288004d50 0x7f22880051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.850+0000 7f229b400640 1 -- 172.21.15.173:0/760734413 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2288003530 con 0x7f2288003f40 2024-04-25T09:06:32.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f229b400640 1 --2- 172.21.15.173:0/760734413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2288003f40 0x7f2288004810 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f228c00c4c0 tx=0x7f228c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad65fb82cf317bec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:32.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22a3400640 1 -- 172.21.15.173:0/760734413 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c00c0e0 con 0x7f2288003f40 2024-04-25T09:06:32.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22a3400640 1 -- 172.21.15.173:0/760734413 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c0a9020 con 0x7f2288003f40 2024-04-25T09:06:32.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22a3400640 1 -- 172.21.15.173:0/760734413 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c005ae0 con 0x7f2288003f40 2024-04-25T09:06:32.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22aaa00640 1 -- 172.21.15.173:0/760734413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2288003f40 msgr2=0x7f2288004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22aaa00640 1 --2- 172.21.15.173:0/760734413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2288003f40 0x7f2288004810 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f228c00c4c0 tx=0x7f228c01ccc0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22a8a00640 1 -- 172.21.15.173:0/760734413 reap_dead start 2024-04-25T09:06:32.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22aaa00640 1 -- 172.21.15.173:0/760734413 shutdown_connections 2024-04-25T09:06:32.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22aaa00640 1 -- 172.21.15.173:0/760734413 >> 172.21.15.173:0/760734413 conn(0x7f22a406ac90 msgr2=0x7f22a406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:32.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22aaa00640 1 -- 172.21.15.173:0/760734413 shutdown_connections 2024-04-25T09:06:32.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22aaa00640 1 -- 172.21.15.173:0/760734413 wait complete. 2024-04-25T09:06:32.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22aaa00640 1 Processor -- start 2024-04-25T09:06:32.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22aaa00640 1 -- start start 2024-04-25T09:06:32.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22aaa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2288003f40 0x7f22a415b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22aaa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22a40ae310 0x7f22a40ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22aaa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22a40ab740 0x7f22a40abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22aaa00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a406ed60 con 0x7f22a40ae310 2024-04-25T09:06:32.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22aaa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a406eee0 con 0x7f2288003f40 2024-04-25T09:06:32.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22aaa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a406f060 con 0x7f22a40ab740 2024-04-25T09:06:32.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f229b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22a40ae310 0x7f22a40ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f229b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22a40ae310 0x7f22a40ae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38604/0 (socket says 172.21.15.173:38604) 2024-04-25T09:06:32.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f229b400640 1 -- 172.21.15.173:0/1944835587 learned_addr learned my addr 172.21.15.173:0/1944835587 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:32.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22a8a00640 1 --2- 172.21.15.173:0/1944835587 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22a40ab740 0x7f22a40abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.854+0000 7f22a3e00640 1 --2- 172.21.15.173:0/1944835587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2288003f40 0x7f22a415b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.858+0000 7f229b400640 1 -- 172.21.15.173:0/1944835587 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22a40ab740 msgr2=0x7f22a40abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.858+0000 7f229b400640 1 --2- 172.21.15.173:0/1944835587 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22a40ab740 0x7f22a40abba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.858+0000 7f229b400640 1 -- 172.21.15.173:0/1944835587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2288003f40 msgr2=0x7f22a415b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.858+0000 7f229b400640 1 --2- 172.21.15.173:0/1944835587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2288003f40 0x7f22a415b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.858+0000 7f229b400640 1 -- 172.21.15.173:0/1944835587 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a40ac4b0 con 0x7f22a40ae310 2024-04-25T09:06:32.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.858+0000 7f229b400640 1 --2- 172.21.15.173:0/1944835587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22a40ae310 0x7f22a40ae750 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f228c007040 tx=0x7f2288005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:32.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.858+0000 7f22a0c00640 1 -- 172.21.15.173:0/1944835587 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c001130 con 0x7f22a40ae310 2024-04-25T09:06:32.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.858+0000 7f22a0c00640 1 -- 172.21.15.173:0/1944835587 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c0b3070 con 0x7f22a40ae310 2024-04-25T09:06:32.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.858+0000 7f22a0c00640 1 -- 172.21.15.173:0/1944835587 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c0a5ab0 con 0x7f22a40ae310 2024-04-25T09:06:32.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.858+0000 7f22aaa00640 1 -- 172.21.15.173:0/1944835587 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a40ac790 con 0x7f22a40ae310 2024-04-25T09:06:32.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.858+0000 7f22aaa00640 1 -- 172.21.15.173:0/1944835587 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a40acd50 con 0x7f22a40ae310 2024-04-25T09:06:32.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.858+0000 7f22aaa00640 1 -- 172.21.15.173:0/1944835587 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a4073ab0 con 0x7f22a40ae310 2024-04-25T09:06:32.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.858+0000 7f22a0c00640 1 -- 172.21.15.173:0/1944835587 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f228c0a5c50 con 0x7f22a40ae310 2024-04-25T09:06:32.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.858+0000 7f22a0c00640 1 --2- 172.21.15.173:0/1944835587 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2280066f60 0x7f2280069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.858+0000 7f22a0c00640 1 -- 172.21.15.173:0/1944835587 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f228c11e9b0 con 0x7f22a40ae310 2024-04-25T09:06:32.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.858+0000 7f22a3e00640 1 --2- 172.21.15.173:0/1944835587 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2280066f60 0x7f2280069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.862+0000 7f22a3e00640 1 --2- 172.21.15.173:0/1944835587 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2280066f60 0x7f2280069420 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2294009950 tx=0x7f2294008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:32.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:32.862+0000 7f22a0c00640 1 -- 172.21.15.173:0/1944835587 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f22a415c5f0 con 0x7f22a40ae310 2024-04-25T09:06:33.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.018+0000 7f22aaa00640 1 -- 172.21.15.173:0/1944835587 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f22a4072490 con 0x7f22a40ae310 2024-04-25T09:06:33.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.018+0000 7f22a0c00640 1 -- 172.21.15.173:0/1944835587 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) v1 ==== 104+0+11 (secure 0 0 0) 0x7f228c0ef7f0 con 0x7f22a40ae310 2024-04-25T09:06:33.006 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:06:33.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.018+0000 7f22aaa00640 1 -- 172.21.15.173:0/1944835587 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2280066f60 msgr2=0x7f2280069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.018+0000 7f22aaa00640 1 --2- 172.21.15.173:0/1944835587 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2280066f60 0x7f2280069420 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2294009950 tx=0x7f2294008040 comp rx=0 tx=0).stop 2024-04-25T09:06:33.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.018+0000 7f22aaa00640 1 -- 172.21.15.173:0/1944835587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22a40ae310 msgr2=0x7f22a40ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.018+0000 7f22aaa00640 1 --2- 172.21.15.173:0/1944835587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22a40ae310 0x7f22a40ae750 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f228c007040 tx=0x7f2288005840 comp rx=0 tx=0).stop 2024-04-25T09:06:33.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.018+0000 7f22aaa00640 1 -- 172.21.15.173:0/1944835587 shutdown_connections 2024-04-25T09:06:33.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.018+0000 7f22aaa00640 1 --2- 172.21.15.173:0/1944835587 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2280066f60 0x7f2280069420 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.018+0000 7f22aaa00640 1 --2- 172.21.15.173:0/1944835587 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22a40ab740 0x7f22a40abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.018+0000 7f22aaa00640 1 --2- 172.21.15.173:0/1944835587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22a40ae310 0x7f22a40ae750 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.018+0000 7f22aaa00640 1 --2- 172.21.15.173:0/1944835587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2288003f40 0x7f22a415b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.018+0000 7f22aaa00640 1 -- 172.21.15.173:0/1944835587 >> 172.21.15.173:0/1944835587 conn(0x7f22a406ac90 msgr2=0x7f22a40cf690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:33.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.022+0000 7f22aaa00640 1 -- 172.21.15.173:0/1944835587 shutdown_connections 2024-04-25T09:06:33.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.022+0000 7f22aaa00640 1 -- 172.21.15.173:0/1944835587 wait complete. 2024-04-25T09:06:33.027 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:06:33.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.178+0000 7fedd0400640 1 Processor -- start 2024-04-25T09:06:33.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.178+0000 7fedd0400640 1 -- start start 2024-04-25T09:06:33.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.178+0000 7fedd0400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedc8145290 0x7fedc815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.178+0000 7fedd0400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fedc80b3fe0 0x7fedc80b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.178+0000 7fedd0400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc815c5f0 con 0x7fedc80cc260 2024-04-25T09:06:33.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.178+0000 7fedd0400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc806d4b0 con 0x7fedc80b3fe0 2024-04-25T09:06:33.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.178+0000 7fedd0400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc806d790 con 0x7fedc8145290 2024-04-25T09:06:33.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.178+0000 7fedcd000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fedc80b3fe0 0x7fedc80b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.178+0000 7fedcd000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fedc80b3fe0 0x7fedc80b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38618/0 (socket says 172.21.15.173:38618) 2024-04-25T09:06:33.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.178+0000 7fedcd000640 1 -- 172.21.15.173:0/2777668572 learned_addr learned my addr 172.21.15.173:0/2777668572 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:33.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.178+0000 7fedce400640 1 --1- 172.21.15.173:0/2777668572 >> v1:172.21.15.173:6789/0 conn(0x7fedc80cc260 0x7fedc80cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49572/0 (socket says 172.21.15.173:49572) 2024-04-25T09:06:33.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.178+0000 7fedcda00640 1 --2- 172.21.15.173:0/2777668572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedc8145290 0x7fedc815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.182+0000 7fedcd000640 1 -- 172.21.15.173:0/2777668572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedc8145290 msgr2=0x7fedc815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:33.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.182+0000 7fedcd000640 1 --2- 172.21.15.173:0/2777668572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedc8145290 0x7fedc815c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.182+0000 7fedcd000640 1 -- 172.21.15.173:0/2777668572 >> v1:172.21.15.173:6789/0 conn(0x7fedc80cc260 legacy=0x7fedc80cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.182+0000 7fedcd000640 1 -- 172.21.15.173:0/2777668572 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc806da70 con 0x7fedc80b3fe0 2024-04-25T09:06:33.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.182+0000 7fedc7e00640 1 -- 172.21.15.173:0/2777668572 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846074494 0 0) 0x7fedc0001120 con 0x7fedc80cc260 2024-04-25T09:06:33.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.182+0000 7fedcd000640 1 --2- 172.21.15.173:0/2777668572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedc80b3fe0 0x7fedc80b4420 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fedb4009870 tx=0x7fedb401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26682746665c54d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:33.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.182+0000 7fedc7e00640 1 -- 172.21.15.173:0/2777668572 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb40b0070 con 0x7fedc80b3fe0 2024-04-25T09:06:33.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.182+0000 7fedc7e00640 1 -- 172.21.15.173:0/2777668572 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb4004230 con 0x7fedc80b3fe0 2024-04-25T09:06:33.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.182+0000 7fedc7e00640 1 -- 172.21.15.173:0/2777668572 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4003620 con 0x7fedc80b3fe0 2024-04-25T09:06:33.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.182+0000 7fedd0400640 1 -- 172.21.15.173:0/2777668572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedc80b3fe0 msgr2=0x7fedc80b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.182+0000 7fedd0400640 1 --2- 172.21.15.173:0/2777668572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedc80b3fe0 0x7fedc80b4420 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fedb4009870 tx=0x7fedb401c440 comp rx=0 tx=0).stop 2024-04-25T09:06:33.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.182+0000 7fedd0400640 1 -- 172.21.15.173:0/2777668572 shutdown_connections 2024-04-25T09:06:33.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.182+0000 7fedd0400640 1 --2- 172.21.15.173:0/2777668572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedc80b3fe0 0x7fedc80b4420 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.182+0000 7fedd0400640 1 --2- 172.21.15.173:0/2777668572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedc8145290 0x7fedc815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.182+0000 7fedd0400640 1 -- 172.21.15.173:0/2777668572 >> 172.21.15.173:0/2777668572 conn(0x7fedc806ac90 msgr2=0x7fedc806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:33.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.182+0000 7fedd0400640 1 -- 172.21.15.173:0/2777668572 shutdown_connections 2024-04-25T09:06:33.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.182+0000 7fedd0400640 1 -- 172.21.15.173:0/2777668572 wait complete. 2024-04-25T09:06:33.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedd0400640 1 Processor -- start 2024-04-25T09:06:33.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedd0400640 1 -- start start 2024-04-25T09:06:33.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedd0400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedc80b3fe0 0x7fedc815ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedd0400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedc80cc260 0x7fedc80ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedd0400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedc8145290 0x7fedc815dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedd0400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc806eee0 con 0x7fedc8145290 2024-04-25T09:06:33.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedd0400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc806ed60 con 0x7fedc80cc260 2024-04-25T09:06:33.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedd0400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc806f060 con 0x7fedc80b3fe0 2024-04-25T09:06:33.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedce400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedc8145290 0x7fedc815dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedce400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedc8145290 0x7fedc815dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:38634/0 (socket says 172.21.15.173:38634) 2024-04-25T09:06:33.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedce400640 1 -- 172.21.15.173:0/2164321197 learned_addr learned my addr 172.21.15.173:0/2164321197 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:33.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedcd000640 1 --2- 172.21.15.173:0/2164321197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedc80cc260 0x7fedc80ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedcda00640 1 --2- 172.21.15.173:0/2164321197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedc80b3fe0 0x7fedc815ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedce400640 1 -- 172.21.15.173:0/2164321197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedc80b3fe0 msgr2=0x7fedc815ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedce400640 1 --2- 172.21.15.173:0/2164321197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedc80b3fe0 0x7fedc815ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedce400640 1 -- 172.21.15.173:0/2164321197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedc80cc260 msgr2=0x7fedc80ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedce400640 1 --2- 172.21.15.173:0/2164321197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedc80cc260 0x7fedc80ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedce400640 1 -- 172.21.15.173:0/2164321197 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc80ae4f0 con 0x7fedc8145290 2024-04-25T09:06:33.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedcd000640 1 --2- 172.21.15.173:0/2164321197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedc80cc260 0x7fedc80ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:33.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedcda00640 1 --2- 172.21.15.173:0/2164321197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedc80b3fe0 0x7fedc815ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:33.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedce400640 1 --2- 172.21.15.173:0/2164321197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedc8145290 0x7fedc815dcf0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fedc000c3e0 tx=0x7fedc000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:33.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedc5600640 1 -- 172.21.15.173:0/2164321197 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc00074e0 con 0x7fedc8145290 2024-04-25T09:06:33.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedc5600640 1 -- 172.21.15.173:0/2164321197 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc00047f0 con 0x7fedc8145290 2024-04-25T09:06:33.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedc5600640 1 -- 172.21.15.173:0/2164321197 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0004be0 con 0x7fedc8145290 2024-04-25T09:06:33.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedd0400640 1 -- 172.21.15.173:0/2164321197 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc80ae7d0 con 0x7fedc8145290 2024-04-25T09:06:33.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.186+0000 7fedd0400640 1 -- 172.21.15.173:0/2164321197 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc80aed90 con 0x7fedc8145290 2024-04-25T09:06:33.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.190+0000 7fedd0400640 1 -- 172.21.15.173:0/2164321197 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc8073ab0 con 0x7fedc8145290 2024-04-25T09:06:33.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.190+0000 7fedc5600640 1 -- 172.21.15.173:0/2164321197 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fedc0011070 con 0x7fedc8145290 2024-04-25T09:06:33.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.190+0000 7fedc5600640 1 --2- 172.21.15.173:0/2164321197 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feda8066f60 0x7feda8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.190+0000 7fedc5600640 1 -- 172.21.15.173:0/2164321197 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fedc0084db0 con 0x7fedc8145290 2024-04-25T09:06:33.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.190+0000 7fedcda00640 1 --2- 172.21.15.173:0/2164321197 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feda8066f60 0x7feda8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.190+0000 7fedcda00640 1 --2- 172.21.15.173:0/2164321197 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feda8066f60 0x7feda8069420 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fedbc007520 tx=0x7fedbc00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:33.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.194+0000 7fedc5600640 1 -- 172.21.15.173:0/2164321197 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fedc815c5f0 con 0x7fedc8145290 2024-04-25T09:06:33.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.350+0000 7fedd0400640 1 -- 172.21.15.173:0/2164321197 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fedc8141f90 con 0x7fedc8145290 2024-04-25T09:06:33.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.350+0000 7fedc5600640 1 -- 172.21.15.173:0/2164321197 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v57) v1 ==== 100+0+11 (secure 0 0 0) 0x7fedc0055bf0 con 0x7fedc8145290 2024-04-25T09:06:33.339 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:06:33.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.350+0000 7fedd0400640 1 -- 172.21.15.173:0/2164321197 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feda8066f60 msgr2=0x7feda8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.350+0000 7fedd0400640 1 --2- 172.21.15.173:0/2164321197 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feda8066f60 0x7feda8069420 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fedbc007520 tx=0x7fedbc00b040 comp rx=0 tx=0).stop 2024-04-25T09:06:33.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.350+0000 7fedd0400640 1 -- 172.21.15.173:0/2164321197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedc8145290 msgr2=0x7fedc815dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.350+0000 7fedd0400640 1 --2- 172.21.15.173:0/2164321197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedc8145290 0x7fedc815dcf0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fedc000c3e0 tx=0x7fedc000c8a0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.350+0000 7fedd0400640 1 -- 172.21.15.173:0/2164321197 shutdown_connections 2024-04-25T09:06:33.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.350+0000 7fedd0400640 1 --2- 172.21.15.173:0/2164321197 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feda8066f60 0x7feda8069420 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.350+0000 7fedd0400640 1 --2- 172.21.15.173:0/2164321197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedc8145290 0x7fedc815dcf0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.350+0000 7fedd0400640 1 --2- 172.21.15.173:0/2164321197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedc80cc260 0x7fedc80ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.350+0000 7fedd0400640 1 --2- 172.21.15.173:0/2164321197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedc80b3fe0 0x7fedc815ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.350+0000 7fedd0400640 1 -- 172.21.15.173:0/2164321197 >> 172.21.15.173:0/2164321197 conn(0x7fedc806ac90 msgr2=0x7fedc815ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:33.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.354+0000 7fedd0400640 1 -- 172.21.15.173:0/2164321197 shutdown_connections 2024-04-25T09:06:33.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.354+0000 7fedd0400640 1 -- 172.21.15.173:0/2164321197 wait complete. 2024-04-25T09:06:33.361 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:06:33.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.510+0000 7faeb9c00640 1 Processor -- start 2024-04-25T09:06:33.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.510+0000 7faeb9c00640 1 -- start start 2024-04-25T09:06:33.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.510+0000 7faeb9c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7faeb406c4b0 0x7faeb41689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.510+0000 7faeb9c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb40b1040 con 0x7faeb415dbc0 2024-04-25T09:06:33.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.510+0000 7faeb9c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb406cab0 con 0x7faeb409a160 2024-04-25T09:06:33.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.510+0000 7faeb9c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb40cfce0 con 0x7faeb406c4b0 2024-04-25T09:06:33.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.510+0000 7faeb3e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7faeb415dbc0 0x7faeb4099a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36032/0 (socket says 172.21.15.173:36032) 2024-04-25T09:06:33.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.510+0000 7faeb3e00640 1 -- 172.21.15.173:0/1223440480 learned_addr learned my addr 172.21.15.173:0/1223440480 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:33.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.510+0000 7faeb9200640 1 --2- 172.21.15.173:0/1223440480 >> v2:172.21.15.194:3300/0 conn(0x7faeb406c4b0 0x7faeb41689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.510+0000 7faeb2a00640 1 -- 172.21.15.173:0/1223440480 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1076046958 0 0) 0x7faea4001120 con 0x7faeb415dbc0 2024-04-25T09:06:33.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.510+0000 7faeb2a00640 1 -- 172.21.15.173:0/1223440480 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae98003530 con 0x7faeb415dbc0 2024-04-25T09:06:33.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.510+0000 7faeb2a00640 1 -- 172.21.15.173:0/1223440480 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 98323334 0 0) 0x7fae98003530 con 0x7faeb415dbc0 2024-04-25T09:06:33.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.510+0000 7faeb9200640 1 -- 172.21.15.173:0/1223440480 >> v1:172.21.15.194:6789/0 conn(0x7faeb409a160 legacy=0x7faeb406bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.510+0000 7faeb9200640 1 -- 172.21.15.173:0/1223440480 >> v1:172.21.15.173:6789/0 conn(0x7faeb415dbc0 legacy=0x7faeb4099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.510+0000 7faeb9200640 1 -- 172.21.15.173:0/1223440480 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb406cd90 con 0x7faeb406c4b0 2024-04-25T09:06:33.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.514+0000 7faeb9200640 1 --2- 172.21.15.173:0/1223440480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faeb406c4b0 0x7faeb41689f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faeac009d90 tx=0x7faeac01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=223ddd2b8e0fd77f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:33.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.514+0000 7faeb2a00640 1 -- 172.21.15.173:0/1223440480 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac0b2070 con 0x7faeb406c4b0 2024-04-25T09:06:33.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.514+0000 7faeb2a00640 1 -- 172.21.15.173:0/1223440480 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac0a55e0 con 0x7faeb406c4b0 2024-04-25T09:06:33.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.514+0000 7faeb2a00640 1 -- 172.21.15.173:0/1223440480 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4001850 con 0x7faeb406c4b0 2024-04-25T09:06:33.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.514+0000 7faeb9c00640 1 -- 172.21.15.173:0/1223440480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faeb406c4b0 msgr2=0x7faeb41689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.514+0000 7faeb9c00640 1 --2- 172.21.15.173:0/1223440480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faeb406c4b0 0x7faeb41689f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faeac009d90 tx=0x7faeac01c890 comp rx=0 tx=0).stop 2024-04-25T09:06:33.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.514+0000 7faeb9c00640 1 -- 172.21.15.173:0/1223440480 shutdown_connections 2024-04-25T09:06:33.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.514+0000 7faeb9c00640 1 --2- 172.21.15.173:0/1223440480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faeb406c4b0 0x7faeb41689f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.514+0000 7faeb9c00640 1 -- 172.21.15.173:0/1223440480 >> 172.21.15.173:0/1223440480 conn(0x7faeb40b31d0 msgr2=0x7faeb40b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:33.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.514+0000 7faeb9c00640 1 -- 172.21.15.173:0/1223440480 shutdown_connections 2024-04-25T09:06:33.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.514+0000 7faeb9c00640 1 -- 172.21.15.173:0/1223440480 wait complete. 2024-04-25T09:06:33.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9c00640 1 Processor -- start 2024-04-25T09:06:33.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9c00640 1 -- start start 2024-04-25T09:06:33.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faeb406c4b0 0x7faeb4152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faeb409a160 0x7faeb40afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faeb415dbc0 0x7faeb41533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb416b8d0 con 0x7faeb415dbc0 2024-04-25T09:06:33.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb416b750 con 0x7faeb406c4b0 2024-04-25T09:06:33.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb416ba50 con 0x7faeb409a160 2024-04-25T09:06:33.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faeb415dbc0 0x7faeb41533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faeb415dbc0 0x7faeb41533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47250/0 (socket says 172.21.15.173:47250) 2024-04-25T09:06:33.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9200640 1 -- 172.21.15.173:0/907392529 learned_addr learned my addr 172.21.15.173:0/907392529 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:33.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb3e00640 1 --2- 172.21.15.173:0/907392529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faeb406c4b0 0x7faeb4152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb3400640 1 --2- 172.21.15.173:0/907392529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faeb409a160 0x7faeb40afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9200640 1 -- 172.21.15.173:0/907392529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faeb409a160 msgr2=0x7faeb40afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9200640 1 --2- 172.21.15.173:0/907392529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faeb409a160 0x7faeb40afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9200640 1 -- 172.21.15.173:0/907392529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faeb406c4b0 msgr2=0x7faeb4152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9200640 1 --2- 172.21.15.173:0/907392529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faeb406c4b0 0x7faeb4152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9200640 1 -- 172.21.15.173:0/907392529 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb40cc450 con 0x7faeb415dbc0 2024-04-25T09:06:33.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9200640 1 --2- 172.21.15.173:0/907392529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faeb415dbc0 0x7faeb41533d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7faeac0b0040 tx=0x7faeac019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:33.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeabe00640 1 -- 172.21.15.173:0/907392529 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac0b2040 con 0x7faeb415dbc0 2024-04-25T09:06:33.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeabe00640 1 -- 172.21.15.173:0/907392529 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac003ba0 con 0x7faeb415dbc0 2024-04-25T09:06:33.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeabe00640 1 -- 172.21.15.173:0/907392529 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac009450 con 0x7faeb415dbc0 2024-04-25T09:06:33.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9c00640 1 -- 172.21.15.173:0/907392529 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb40cc730 con 0x7faeb415dbc0 2024-04-25T09:06:33.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.518+0000 7faeb9c00640 1 -- 172.21.15.173:0/907392529 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb4152d50 con 0x7faeb415dbc0 2024-04-25T09:06:33.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.522+0000 7faeb9c00640 1 -- 172.21.15.173:0/907392529 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb4073a40 con 0x7faeb415dbc0 2024-04-25T09:06:33.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.522+0000 7faeabe00640 1 -- 172.21.15.173:0/907392529 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faeac004030 con 0x7faeb415dbc0 2024-04-25T09:06:33.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.522+0000 7faeabe00640 1 --2- 172.21.15.173:0/907392529 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fae94066fb0 0x7fae94069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.522+0000 7faeabe00640 1 -- 172.21.15.173:0/907392529 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6159+0+0 (secure 0 0 0) 0x7faeac11ffa0 con 0x7faeb415dbc0 2024-04-25T09:06:33.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.522+0000 7faeb3e00640 1 --2- 172.21.15.173:0/907392529 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fae94066fb0 0x7fae94069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.522+0000 7faeb3e00640 1 --2- 172.21.15.173:0/907392529 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fae94066fb0 0x7fae94069470 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7faea40013c0 tx=0x7faea4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:33.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.526+0000 7faeabe00640 1 -- 172.21.15.173:0/907392529 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faeac016480 con 0x7faeb415dbc0 2024-04-25T09:06:33.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.694+0000 7faeb9c00640 1 -- 172.21.15.173:0/907392529 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faeb40b4030 con 0x7faeb415dbc0 2024-04-25T09:06:33.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.694+0000 7faeabe00640 1 -- 172.21.15.173:0/907392529 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v58) v1 ==== 80+0+0 (secure 0 0 0) 0x7faeac0f0e60 con 0x7faeb415dbc0 2024-04-25T09:06:33.684 INFO:teuthology.orchestra.run.smithi173.stderr:listed 0 entries 2024-04-25T09:06:33.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.698+0000 7faeb9c00640 1 -- 172.21.15.173:0/907392529 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fae94066fb0 msgr2=0x7fae94069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.698+0000 7faeb9c00640 1 --2- 172.21.15.173:0/907392529 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fae94066fb0 0x7fae94069470 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7faea40013c0 tx=0x7faea4009040 comp rx=0 tx=0).stop 2024-04-25T09:06:33.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.698+0000 7faeb9c00640 1 -- 172.21.15.173:0/907392529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faeb415dbc0 msgr2=0x7faeb41533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.698+0000 7faeb9c00640 1 --2- 172.21.15.173:0/907392529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faeb415dbc0 0x7faeb41533d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7faeac0b0040 tx=0x7faeac019630 comp rx=0 tx=0).stop 2024-04-25T09:06:33.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.698+0000 7faeb9c00640 1 -- 172.21.15.173:0/907392529 shutdown_connections 2024-04-25T09:06:33.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.698+0000 7faeb9c00640 1 --2- 172.21.15.173:0/907392529 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fae94066fb0 0x7fae94069470 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.698+0000 7faeb9c00640 1 --2- 172.21.15.173:0/907392529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faeb415dbc0 0x7faeb41533d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.698+0000 7faeb9c00640 1 --2- 172.21.15.173:0/907392529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faeb409a160 0x7faeb40afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.698+0000 7faeb9c00640 1 --2- 172.21.15.173:0/907392529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faeb406c4b0 0x7faeb4152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.698+0000 7faeb9c00640 1 -- 172.21.15.173:0/907392529 >> 172.21.15.173:0/907392529 conn(0x7faeb40b31d0 msgr2=0x7faeb4099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:33.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.698+0000 7faeb9c00640 1 -- 172.21.15.173:0/907392529 shutdown_connections 2024-04-25T09:06:33.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:33.698+0000 7faeb9c00640 1 -- 172.21.15.173:0/907392529 wait complete. 2024-04-25T09:06:33.704 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:06:33.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:33.705 DEBUG:teuthology.orchestra.run.smithi173:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:34.692 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:06:34.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:34.692 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:06:34.701 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:06:34.701 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:34.710 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:06:34.710 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:06:34.710 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:34.752 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:06:34.752 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:06:34.753 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:34.761 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:06:34.761 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:34.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.946+0000 7fd961400640 1 Processor -- start 2024-04-25T09:06:34.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.946+0000 7fd961400640 1 -- start start 2024-04-25T09:06:34.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.950+0000 7fd961400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd95c0ae810 0x7fd95c0aec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.950+0000 7fd961400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95c0af160 con 0x7fd95c15dc60 2024-04-25T09:06:34.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.950+0000 7fd961400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95c15e8e0 con 0x7fd95c15e040 2024-04-25T09:06:34.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.950+0000 7fd961400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c071450 con 0x7fd95c0ae810 2024-04-25T09:06:34.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.950+0000 7fd95a800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd95c15dc60 0x7fd95c0b3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36036/0 (socket says 172.21.15.173:36036) 2024-04-25T09:06:34.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.950+0000 7fd95a800640 1 -- 172.21.15.173:0/3735763893 learned_addr learned my addr 172.21.15.173:0/3735763893 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:34.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.950+0000 7fd95b200640 1 --2- 172.21.15.173:0/3735763893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd95c0ae810 0x7fd95c0aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.950+0000 7fd959400640 1 -- 172.21.15.173:0/3735763893 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889961503 0 0) 0x7fd94c0014a0 con 0x7fd95c15dc60 2024-04-25T09:06:34.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.950+0000 7fd959400640 1 -- 172.21.15.173:0/3735763893 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd940003530 con 0x7fd95c15dc60 2024-04-25T09:06:34.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.950+0000 7fd959400640 1 -- 172.21.15.173:0/3735763893 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61012927 0 0) 0x7fd95c15e8e0 con 0x7fd95c15e040 2024-04-25T09:06:34.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.950+0000 7fd959400640 1 -- 172.21.15.173:0/3735763893 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd94c0014a0 con 0x7fd95c15e040 2024-04-25T09:06:34.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.950+0000 7fd959400640 1 -- 172.21.15.173:0/3735763893 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 256497343 0 0) 0x7fd940003530 con 0x7fd95c15dc60 2024-04-25T09:06:34.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.950+0000 7fd95b200640 1 -- 172.21.15.173:0/3735763893 >> v1:172.21.15.194:6789/0 conn(0x7fd95c15e040 legacy=0x7fd95c0ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.950+0000 7fd95b200640 1 -- 172.21.15.173:0/3735763893 >> v1:172.21.15.173:6789/0 conn(0x7fd95c15dc60 legacy=0x7fd95c0b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.950+0000 7fd95b200640 1 -- 172.21.15.173:0/3735763893 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c15ebc0 con 0x7fd95c0ae810 2024-04-25T09:06:34.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.954+0000 7fd95b200640 1 --2- 172.21.15.173:0/3735763893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd95c0ae810 0x7fd95c0aec20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0715d0 tx=0x7fd95401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bbab1878cd212f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:34.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.954+0000 7fd959400640 1 -- 172.21.15.173:0/3735763893 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9540b0070 con 0x7fd95c0ae810 2024-04-25T09:06:34.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.954+0000 7fd959400640 1 -- 172.21.15.173:0/3735763893 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9540ab400 con 0x7fd95c0ae810 2024-04-25T09:06:34.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.954+0000 7fd959400640 1 -- 172.21.15.173:0/3735763893 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c001bd0 con 0x7fd95c0ae810 2024-04-25T09:06:34.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.954+0000 7fd961400640 1 -- 172.21.15.173:0/3735763893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd95c0ae810 msgr2=0x7fd95c0aec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.954+0000 7fd961400640 1 --2- 172.21.15.173:0/3735763893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd95c0ae810 0x7fd95c0aec20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0715d0 tx=0x7fd95401c3e0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.954+0000 7fd961400640 1 -- 172.21.15.173:0/3735763893 shutdown_connections 2024-04-25T09:06:34.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.954+0000 7fd961400640 1 --2- 172.21.15.173:0/3735763893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd95c0ae810 0x7fd95c0aec20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.954+0000 7fd961400640 1 -- 172.21.15.173:0/3735763893 >> 172.21.15.173:0/3735763893 conn(0x7fd95c06ac90 msgr2=0x7fd95c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:34.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.954+0000 7fd961400640 1 -- 172.21.15.173:0/3735763893 shutdown_connections 2024-04-25T09:06:34.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.954+0000 7fd961400640 1 -- 172.21.15.173:0/3735763893 wait complete. 2024-04-25T09:06:34.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.954+0000 7fd961400640 1 Processor -- start 2024-04-25T09:06:34.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.954+0000 7fd961400640 1 -- start start 2024-04-25T09:06:34.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd961400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd95c0ae810 0x7fd95c15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd961400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd95c15dc60 0x7fd95c0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd961400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd95c15e040 0x7fd95c0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd961400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c15e5d0 con 0x7fd95c15e040 2024-04-25T09:06:34.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd961400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c15e450 con 0x7fd95c0ae810 2024-04-25T09:06:34.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd961400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c16b990 con 0x7fd95c15dc60 2024-04-25T09:06:34.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd95b200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd95c15e040 0x7fd95c0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd95b200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd95c15e040 0x7fd95c0cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47260/0 (socket says 172.21.15.173:47260) 2024-04-25T09:06:34.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd95b200640 1 -- 172.21.15.173:0/1461914104 learned_addr learned my addr 172.21.15.173:0/1461914104 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:34.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd95a800640 1 --2- 172.21.15.173:0/1461914104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd95c0ae810 0x7fd95c15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd959e00640 1 --2- 172.21.15.173:0/1461914104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd95c15dc60 0x7fd95c0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd95b200640 1 -- 172.21.15.173:0/1461914104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd95c15dc60 msgr2=0x7fd95c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd95b200640 1 --2- 172.21.15.173:0/1461914104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd95c15dc60 0x7fd95c0cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd95b200640 1 -- 172.21.15.173:0/1461914104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd95c0ae810 msgr2=0x7fd95c15a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd95b200640 1 --2- 172.21.15.173:0/1461914104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd95c0ae810 0x7fd95c15a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd95b200640 1 -- 172.21.15.173:0/1461914104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c15d7f0 con 0x7fd95c15e040 2024-04-25T09:06:34.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd95b200640 1 --2- 172.21.15.173:0/1461914104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd95c15e040 0x7fd95c0cdc80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fd95401a010 tx=0x7fd95401ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:34.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd952a00640 1 -- 172.21.15.173:0/1461914104 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9540b0050 con 0x7fd95c15e040 2024-04-25T09:06:34.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd952a00640 1 -- 172.21.15.173:0/1461914104 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9540bc070 con 0x7fd95c15e040 2024-04-25T09:06:34.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd952a00640 1 -- 172.21.15.173:0/1461914104 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954006e20 con 0x7fd95c15e040 2024-04-25T09:06:34.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd961400640 1 -- 172.21.15.173:0/1461914104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95c15cf50 con 0x7fd95c15e040 2024-04-25T09:06:34.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd961400640 1 -- 172.21.15.173:0/1461914104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95c15d510 con 0x7fd95c15e040 2024-04-25T09:06:34.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd961400640 1 -- 172.21.15.173:0/1461914104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95c073a40 con 0x7fd95c15e040 2024-04-25T09:06:34.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.958+0000 7fd952a00640 1 -- 172.21.15.173:0/1461914104 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd9540b7850 con 0x7fd95c15e040 2024-04-25T09:06:34.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.962+0000 7fd952a00640 1 --2- 172.21.15.173:0/1461914104 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd93c066f60 0x7fd93c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.962+0000 7fd952a00640 1 -- 172.21.15.173:0/1461914104 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd95411f690 con 0x7fd95c15e040 2024-04-25T09:06:34.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.962+0000 7fd95a800640 1 --2- 172.21.15.173:0/1461914104 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd93c066f60 0x7fd93c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.962+0000 7fd95a800640 1 --2- 172.21.15.173:0/1461914104 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd93c066f60 0x7fd93c069420 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd94c001360 tx=0x7fd94c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:34.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:34.966+0000 7fd952a00640 1 -- 172.21.15.173:0/1461914104 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd954015fd0 con 0x7fd95c15e040 2024-04-25T09:06:35.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.150+0000 7fd961400640 1 -- 172.21.15.173:0/1461914104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd95c0cf180 con 0x7fd95c15e040 2024-04-25T09:06:35.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.150+0000 7fd952a00640 1 -- 172.21.15.173:0/1461914104 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4951 (secure 0 0 0) 0x7fd9540efe80 con 0x7fd95c15e040 2024-04-25T09:06:35.139 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:35.140 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":29,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:06:31.245247+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:35.140 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 29 2024-04-25T09:06:35.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.154+0000 7fd961400640 1 -- 172.21.15.173:0/1461914104 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd93c066f60 msgr2=0x7fd93c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.154+0000 7fd961400640 1 --2- 172.21.15.173:0/1461914104 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd93c066f60 0x7fd93c069420 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd94c001360 tx=0x7fd94c009040 comp rx=0 tx=0).stop 2024-04-25T09:06:35.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.154+0000 7fd961400640 1 -- 172.21.15.173:0/1461914104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd95c15e040 msgr2=0x7fd95c0cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.154+0000 7fd961400640 1 --2- 172.21.15.173:0/1461914104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd95c15e040 0x7fd95c0cdc80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fd95401a010 tx=0x7fd95401ac20 comp rx=0 tx=0).stop 2024-04-25T09:06:35.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.154+0000 7fd961400640 1 -- 172.21.15.173:0/1461914104 shutdown_connections 2024-04-25T09:06:35.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.154+0000 7fd961400640 1 --2- 172.21.15.173:0/1461914104 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd93c066f60 0x7fd93c069420 secure :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd94c001360 tx=0x7fd94c009040 comp rx=0 tx=0).stop 2024-04-25T09:06:35.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.154+0000 7fd961400640 1 --2- 172.21.15.173:0/1461914104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd95c15e040 0x7fd95c0cdc80 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.154+0000 7fd961400640 1 --2- 172.21.15.173:0/1461914104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd95c15dc60 0x7fd95c0cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.154+0000 7fd961400640 1 --2- 172.21.15.173:0/1461914104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd95c0ae810 0x7fd95c15a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.154+0000 7fd961400640 1 -- 172.21.15.173:0/1461914104 >> 172.21.15.173:0/1461914104 conn(0x7fd95c06ac90 msgr2=0x7fd95c0b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:35.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.154+0000 7fd961400640 1 -- 172.21.15.173:0/1461914104 shutdown_connections 2024-04-25T09:06:35.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.154+0000 7fd961400640 1 -- 172.21.15.173:0/1461914104 wait complete. 2024-04-25T09:06:35.160 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:35.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.314+0000 7f52aae00640 1 Processor -- start 2024-04-25T09:06:35.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.314+0000 7f52aae00640 1 -- start start 2024-04-25T09:06:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.318+0000 7f52aae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52a40aefa0 0x7f52a40cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.318+0000 7f52aae00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52a415edd0 0x7f52a40cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.318+0000 7f52aae00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a415f320 con 0x7f52a40b3e70 2024-04-25T09:06:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.318+0000 7f52aae00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a406dd50 con 0x7f52a415edd0 2024-04-25T09:06:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.318+0000 7f52aae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a406d420 con 0x7f52a40aefa0 2024-04-25T09:06:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.318+0000 7f52a8e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52a415edd0 0x7f52a40cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.318+0000 7f52a3e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f52a40b3e70 0x7f52a40b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36052/0 (socket says 172.21.15.173:36052) 2024-04-25T09:06:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.318+0000 7f52a3e00640 1 -- 172.21.15.173:0/2740813062 learned_addr learned my addr 172.21.15.173:0/2740813062 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.318+0000 7f529b400640 1 --2- 172.21.15.173:0/2740813062 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52a40aefa0 0x7f52a40cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.318+0000 7f52a8e00640 1 -- 172.21.15.173:0/2740813062 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52a40aefa0 msgr2=0x7f52a40cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.318+0000 7f52a8e00640 1 --2- 172.21.15.173:0/2740813062 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52a40aefa0 0x7f52a40cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.318+0000 7f52a8e00640 1 -- 172.21.15.173:0/2740813062 >> v1:172.21.15.173:6789/0 conn(0x7f52a40b3e70 legacy=0x7f52a40b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.318+0000 7f52a8e00640 1 -- 172.21.15.173:0/2740813062 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a406d700 con 0x7f52a415edd0 2024-04-25T09:06:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.318+0000 7f52a3400640 1 -- 172.21.15.173:0/2740813062 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3644104788 0 0) 0x7f52a415f320 con 0x7f52a40b3e70 2024-04-25T09:06:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.318+0000 7f529b400640 1 --2- 172.21.15.173:0/2740813062 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52a40aefa0 0x7f52a40cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:35.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.318+0000 7f52a8e00640 1 --2- 172.21.15.173:0/2740813062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52a415edd0 0x7f52a40cdce0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f529c009d90 tx=0x7f529c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73177daeca1c9fe3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.318+0000 7f52a3400640 1 -- 172.21.15.173:0/2740813062 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c0b2070 con 0x7f52a415edd0 2024-04-25T09:06:35.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52a3400640 1 -- 172.21.15.173:0/2740813062 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c0a59f0 con 0x7f52a415edd0 2024-04-25T09:06:35.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52a3400640 1 -- 172.21.15.173:0/2740813062 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c0a5dc0 con 0x7f52a415edd0 2024-04-25T09:06:35.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52aae00640 1 -- 172.21.15.173:0/2740813062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52a415edd0 msgr2=0x7f52a40cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52aae00640 1 --2- 172.21.15.173:0/2740813062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52a415edd0 0x7f52a40cdce0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f529c009d90 tx=0x7f529c01c940 comp rx=0 tx=0).stop 2024-04-25T09:06:35.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52aae00640 1 -- 172.21.15.173:0/2740813062 shutdown_connections 2024-04-25T09:06:35.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52aae00640 1 --2- 172.21.15.173:0/2740813062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52a415edd0 0x7f52a40cdce0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52aae00640 1 --2- 172.21.15.173:0/2740813062 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52a40aefa0 0x7f52a40cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52aae00640 1 -- 172.21.15.173:0/2740813062 >> 172.21.15.173:0/2740813062 conn(0x7f52a406ac90 msgr2=0x7f52a406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:35.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52aae00640 1 -- 172.21.15.173:0/2740813062 shutdown_connections 2024-04-25T09:06:35.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52aae00640 1 -- 172.21.15.173:0/2740813062 wait complete. 2024-04-25T09:06:35.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52aae00640 1 Processor -- start 2024-04-25T09:06:35.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52aae00640 1 -- start start 2024-04-25T09:06:35.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52aae00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52a40aefa0 0x7f52a4151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52aae00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52a40b3e70 0x7f52a414fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52aae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52a415edd0 0x7f52a414e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52aae00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40714a0 con 0x7f52a40b3e70 2024-04-25T09:06:35.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52aae00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4071320 con 0x7f52a40aefa0 2024-04-25T09:06:35.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52aae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4071620 con 0x7f52a415edd0 2024-04-25T09:06:35.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f529b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52a40b3e70 0x7f52a414fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f529b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52a40b3e70 0x7f52a414fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47284/0 (socket says 172.21.15.173:47284) 2024-04-25T09:06:35.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f529b400640 1 -- 172.21.15.173:0/3268576667 learned_addr learned my addr 172.21.15.173:0/3268576667 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:35.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52a3e00640 1 --2- 172.21.15.173:0/3268576667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52a40aefa0 0x7f52a4151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.322+0000 7f52a8e00640 1 --2- 172.21.15.173:0/3268576667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52a415edd0 0x7f52a414e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.326+0000 7f529b400640 1 -- 172.21.15.173:0/3268576667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52a415edd0 msgr2=0x7f52a414e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.326+0000 7f529b400640 1 --2- 172.21.15.173:0/3268576667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52a415edd0 0x7f52a414e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.326+0000 7f529b400640 1 -- 172.21.15.173:0/3268576667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52a40aefa0 msgr2=0x7f52a4151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.326+0000 7f529b400640 1 --2- 172.21.15.173:0/3268576667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52a40aefa0 0x7f52a4151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.326+0000 7f529b400640 1 -- 172.21.15.173:0/3268576667 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a414e940 con 0x7f52a40b3e70 2024-04-25T09:06:35.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.326+0000 7f52a3e00640 1 --2- 172.21.15.173:0/3268576667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52a40aefa0 0x7f52a4151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:35.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.326+0000 7f529b400640 1 --2- 172.21.15.173:0/3268576667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52a40b3e70 0x7f52a414fea0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f528c00c7c0 tx=0x7f528c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.326+0000 7f52a0c00640 1 -- 172.21.15.173:0/3268576667 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c007a30 con 0x7f52a40b3e70 2024-04-25T09:06:35.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.326+0000 7f52a0c00640 1 -- 172.21.15.173:0/3268576667 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c007bd0 con 0x7f52a40b3e70 2024-04-25T09:06:35.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.326+0000 7f52aae00640 1 -- 172.21.15.173:0/3268576667 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a4154390 con 0x7f52a40b3e70 2024-04-25T09:06:35.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.326+0000 7f52a0c00640 1 -- 172.21.15.173:0/3268576667 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0113f0 con 0x7f52a40b3e70 2024-04-25T09:06:35.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.326+0000 7f52aae00640 1 -- 172.21.15.173:0/3268576667 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a4154950 con 0x7f52a40b3e70 2024-04-25T09:06:35.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.326+0000 7f52aae00640 1 -- 172.21.15.173:0/3268576667 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a4073a40 con 0x7f52a40b3e70 2024-04-25T09:06:35.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.326+0000 7f52a0c00640 1 -- 172.21.15.173:0/3268576667 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f528c011590 con 0x7f52a40b3e70 2024-04-25T09:06:35.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.330+0000 7f52a0c00640 1 --2- 172.21.15.173:0/3268576667 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5280066f60 0x7f5280069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.330+0000 7f52a0c00640 1 -- 172.21.15.173:0/3268576667 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f528c085350 con 0x7f52a40b3e70 2024-04-25T09:06:35.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.330+0000 7f52a3e00640 1 --2- 172.21.15.173:0/3268576667 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5280066f60 0x7f5280069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.330+0000 7f52a3e00640 1 --2- 172.21.15.173:0/3268576667 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5280066f60 0x7f5280069420 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5294007fd0 tx=0x7f5294007c20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.334+0000 7f52a0c00640 1 -- 172.21.15.173:0/3268576667 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f528c015020 con 0x7f52a40b3e70 2024-04-25T09:06:35.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.490+0000 7f52aae00640 1 -- 172.21.15.173:0/3268576667 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52a406f1c0 con 0x7f52a40b3e70 2024-04-25T09:06:35.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.490+0000 7f52a0c00640 1 -- 172.21.15.173:0/3268576667 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+17098 (secure 0 0 0) 0x7f528c055b40 con 0x7f52a40b3e70 2024-04-25T09:06:35.479 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:35.479 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":58,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:06:33.651218+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:52.287873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:53.577379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1f","mappings":[{"from":0,"to":6}]},{"pgid":"8.28","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:35.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.494+0000 7f52aae00640 1 -- 172.21.15.173:0/3268576667 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5280066f60 msgr2=0x7f5280069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.494+0000 7f52aae00640 1 --2- 172.21.15.173:0/3268576667 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5280066f60 0x7f5280069420 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5294007fd0 tx=0x7f5294007c20 comp rx=0 tx=0).stop 2024-04-25T09:06:35.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.494+0000 7f52aae00640 1 -- 172.21.15.173:0/3268576667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52a40b3e70 msgr2=0x7f52a414fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.494+0000 7f52aae00640 1 --2- 172.21.15.173:0/3268576667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52a40b3e70 0x7f52a414fea0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f528c00c7c0 tx=0x7f528c00cc80 comp rx=0 tx=0).stop 2024-04-25T09:06:35.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.494+0000 7f52aae00640 1 -- 172.21.15.173:0/3268576667 shutdown_connections 2024-04-25T09:06:35.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.494+0000 7f52aae00640 1 --2- 172.21.15.173:0/3268576667 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5280066f60 0x7f5280069420 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.494+0000 7f52aae00640 1 --2- 172.21.15.173:0/3268576667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52a415edd0 0x7f52a414e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.494+0000 7f52aae00640 1 --2- 172.21.15.173:0/3268576667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52a40b3e70 0x7f52a414fea0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.494+0000 7f52aae00640 1 --2- 172.21.15.173:0/3268576667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52a40aefa0 0x7f52a4151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.494+0000 7f52aae00640 1 -- 172.21.15.173:0/3268576667 >> 172.21.15.173:0/3268576667 conn(0x7f52a406ac90 msgr2=0x7f52a40cd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:35.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.494+0000 7f52aae00640 1 -- 172.21.15.173:0/3268576667 shutdown_connections 2024-04-25T09:06:35.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.494+0000 7f52aae00640 1 -- 172.21.15.173:0/3268576667 wait complete. 2024-04-25T09:06:35.500 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:05:52.287873+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:05:53.577379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:06:35.500 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:06:35.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.650+0000 7f6b6d600640 1 Processor -- start 2024-04-25T09:06:35.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.650+0000 7f6b6d600640 1 -- start start 2024-04-25T09:06:35.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.650+0000 7f6b6d600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6b680aeb90 0x7f6b680cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.650+0000 7f6b6d600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b680aef70 0x7f6b680cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.650+0000 7f6b6d600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6b680cdba0 0x7f6b680ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.650+0000 7f6b6d600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b68071320 con 0x7f6b680cdba0 2024-04-25T09:06:35.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.650+0000 7f6b6d600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b68072330 con 0x7f6b680aeb90 2024-04-25T09:06:35.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.650+0000 7f6b6d600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b680ce550 con 0x7f6b680aef70 2024-04-25T09:06:35.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.654+0000 7f6b67400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6b680cdba0 0x7f6b680ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.654+0000 7f6b67400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6b680cdba0 0x7f6b680ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47290/0 (socket says 172.21.15.173:47290) 2024-04-25T09:06:35.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.654+0000 7f6b67400640 1 -- 172.21.15.173:0/105894404 learned_addr learned my addr 172.21.15.173:0/105894404 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:35.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.654+0000 7f6b66000640 1 --2- 172.21.15.173:0/105894404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b680aef70 0x7f6b680cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.654+0000 7f6b66a00640 1 --2- 172.21.15.173:0/105894404 >> v2:172.21.15.194:3300/0 conn(0x7f6b680aeb90 0x7f6b680cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.654+0000 7f6b67400640 1 -- 172.21.15.173:0/105894404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b680aef70 msgr2=0x7f6b680cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:35.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.654+0000 7f6b67400640 1 --2- 172.21.15.173:0/105894404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b680aef70 0x7f6b680cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.654+0000 7f6b67400640 1 -- 172.21.15.173:0/105894404 >> v2:172.21.15.194:3300/0 conn(0x7f6b680aeb90 msgr2=0x7f6b680cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:35.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.654+0000 7f6b67400640 1 --2- 172.21.15.173:0/105894404 >> v2:172.21.15.194:3300/0 conn(0x7f6b680aeb90 0x7f6b680cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.654+0000 7f6b67400640 1 -- 172.21.15.173:0/105894404 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68071570 con 0x7f6b680cdba0 2024-04-25T09:06:35.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.654+0000 7f6b67400640 1 --2- 172.21.15.173:0/105894404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b680cdba0 0x7f6b680ce010 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f6b680cd220 tx=0x7f6b6001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745b2208c4c43133 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.654+0000 7f6b65600640 1 -- 172.21.15.173:0/105894404 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b600ab620 con 0x7f6b680cdba0 2024-04-25T09:06:35.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.654+0000 7f6b65600640 1 -- 172.21.15.173:0/105894404 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b600b0070 con 0x7f6b680cdba0 2024-04-25T09:06:35.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.654+0000 7f6b65600640 1 -- 172.21.15.173:0/105894404 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b600ab9e0 con 0x7f6b680cdba0 2024-04-25T09:06:35.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b6d600640 1 -- 172.21.15.173:0/105894404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b680cdba0 msgr2=0x7f6b680ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b6d600640 1 --2- 172.21.15.173:0/105894404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b680cdba0 0x7f6b680ce010 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f6b680cd220 tx=0x7f6b6001c460 comp rx=0 tx=0).stop 2024-04-25T09:06:35.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b6d600640 1 -- 172.21.15.173:0/105894404 shutdown_connections 2024-04-25T09:06:35.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b6d600640 1 --2- 172.21.15.173:0/105894404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b680cdba0 0x7f6b680ce010 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b6d600640 1 --2- 172.21.15.173:0/105894404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b680aef70 0x7f6b680cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b6d600640 1 --2- 172.21.15.173:0/105894404 >> v2:172.21.15.194:3300/0 conn(0x7f6b680aeb90 0x7f6b680cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b6d600640 1 -- 172.21.15.173:0/105894404 >> 172.21.15.173:0/105894404 conn(0x7f6b6806ac90 msgr2=0x7f6b6806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:35.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b6d600640 1 -- 172.21.15.173:0/105894404 shutdown_connections 2024-04-25T09:06:35.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b6d600640 1 -- 172.21.15.173:0/105894404 wait complete. 2024-04-25T09:06:35.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b6d600640 1 Processor -- start 2024-04-25T09:06:35.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b6d600640 1 -- start start 2024-04-25T09:06:35.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b6d600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b680aeb90 0x7f6b6814f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b6d600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b680aef70 0x7f6b680b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b6d600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b680cdba0 0x7f6b680af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b6d600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6815ef40 con 0x7f6b680cdba0 2024-04-25T09:06:35.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b6d600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6815edc0 con 0x7f6b680aeb90 2024-04-25T09:06:35.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b6d600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6815f0c0 con 0x7f6b680aef70 2024-04-25T09:06:35.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b67400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b680cdba0 0x7f6b680af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b66000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b680aef70 0x7f6b680b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b67400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b680cdba0 0x7f6b680af3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47294/0 (socket says 172.21.15.173:47294) 2024-04-25T09:06:35.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b66a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b680aeb90 0x7f6b6814f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.658+0000 7f6b67400640 1 -- 172.21.15.173:0/2470710171 learned_addr learned my addr 172.21.15.173:0/2470710171 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:35.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.662+0000 7f6b67400640 1 -- 172.21.15.173:0/2470710171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b680aef70 msgr2=0x7f6b680b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.662+0000 7f6b67400640 1 --2- 172.21.15.173:0/2470710171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b680aef70 0x7f6b680b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.662+0000 7f6b67400640 1 -- 172.21.15.173:0/2470710171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b680aeb90 msgr2=0x7f6b6814f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.662+0000 7f6b67400640 1 --2- 172.21.15.173:0/2470710171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b680aeb90 0x7f6b6814f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.662+0000 7f6b67400640 1 -- 172.21.15.173:0/2470710171 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b680afb60 con 0x7f6b680cdba0 2024-04-25T09:06:35.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.662+0000 7f6b67400640 1 --2- 172.21.15.173:0/2470710171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b680cdba0 0x7f6b680af3e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6b6001ab10 tx=0x7f6b6001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.662+0000 7f6b5ea00640 1 -- 172.21.15.173:0/2470710171 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b600abb90 con 0x7f6b680cdba0 2024-04-25T09:06:35.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.662+0000 7f6b5ea00640 1 -- 172.21.15.173:0/2470710171 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b600abd30 con 0x7f6b680cdba0 2024-04-25T09:06:35.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.662+0000 7f6b6d600640 1 -- 172.21.15.173:0/2470710171 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b680afe40 con 0x7f6b680cdba0 2024-04-25T09:06:35.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.662+0000 7f6b5ea00640 1 -- 172.21.15.173:0/2470710171 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b600be630 con 0x7f6b680cdba0 2024-04-25T09:06:35.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.662+0000 7f6b6d600640 1 -- 172.21.15.173:0/2470710171 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b680b0400 con 0x7f6b680cdba0 2024-04-25T09:06:35.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.662+0000 7f6b6d600640 1 -- 172.21.15.173:0/2470710171 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b68073ab0 con 0x7f6b680cdba0 2024-04-25T09:06:35.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.662+0000 7f6b5ea00640 1 -- 172.21.15.173:0/2470710171 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6b600b43f0 con 0x7f6b680cdba0 2024-04-25T09:06:35.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.662+0000 7f6b5ea00640 1 --2- 172.21.15.173:0/2470710171 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6b48066f60 0x7f6b48069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.662+0000 7f6b5ea00640 1 -- 172.21.15.173:0/2470710171 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6b6011f420 con 0x7f6b680cdba0 2024-04-25T09:06:35.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.662+0000 7f6b66a00640 1 --2- 172.21.15.173:0/2470710171 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6b48066f60 0x7f6b48069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.666+0000 7f6b66a00640 1 --2- 172.21.15.173:0/2470710171 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6b48066f60 0x7f6b48069420 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6b58011200 tx=0x7f6b5800d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.666+0000 7f6b5ea00640 1 -- 172.21.15.173:0/2470710171 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6b600c4060 con 0x7f6b680cdba0 2024-04-25T09:06:35.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.826+0000 7f6b6d600640 1 -- 172.21.15.173:0/2470710171 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b680cf970 con 0x7f6b680cdba0 2024-04-25T09:06:35.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.826+0000 7f6b5ea00640 1 -- 172.21.15.173:0/2470710171 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b60016110 con 0x7f6b680cdba0 2024-04-25T09:06:35.815 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:06:35.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.830+0000 7f6b6d600640 1 -- 172.21.15.173:0/2470710171 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6b48066f60 msgr2=0x7f6b48069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.830+0000 7f6b6d600640 1 --2- 172.21.15.173:0/2470710171 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6b48066f60 0x7f6b48069420 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6b58011200 tx=0x7f6b5800d040 comp rx=0 tx=0).stop 2024-04-25T09:06:35.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.830+0000 7f6b6d600640 1 -- 172.21.15.173:0/2470710171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b680cdba0 msgr2=0x7f6b680af3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.830+0000 7f6b6d600640 1 --2- 172.21.15.173:0/2470710171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b680cdba0 0x7f6b680af3e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6b6001ab10 tx=0x7f6b6001aca0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.830+0000 7f6b6d600640 1 -- 172.21.15.173:0/2470710171 shutdown_connections 2024-04-25T09:06:35.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.830+0000 7f6b6d600640 1 --2- 172.21.15.173:0/2470710171 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6b48066f60 0x7f6b48069420 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.830+0000 7f6b6d600640 1 --2- 172.21.15.173:0/2470710171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b680cdba0 0x7f6b680af3e0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.830+0000 7f6b6d600640 1 --2- 172.21.15.173:0/2470710171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b680aef70 0x7f6b680b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.830+0000 7f6b6d600640 1 --2- 172.21.15.173:0/2470710171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b680aeb90 0x7f6b6814f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.830+0000 7f6b6d600640 1 -- 172.21.15.173:0/2470710171 >> 172.21.15.173:0/2470710171 conn(0x7f6b6806ac90 msgr2=0x7f6b680b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:35.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.830+0000 7f6b6d600640 1 -- 172.21.15.173:0/2470710171 shutdown_connections 2024-04-25T09:06:35.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.830+0000 7f6b6d600640 1 -- 172.21.15.173:0/2470710171 wait complete. 2024-04-25T09:06:35.835 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:06:35.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.986+0000 7f0ddc400640 1 Processor -- start 2024-04-25T09:06:35.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.986+0000 7f0ddc400640 1 -- start start 2024-04-25T09:06:35.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.986+0000 7f0ddc400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dd40cd3d0 0x7f0dd40cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.986+0000 7f0ddc400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0dd40cc670 0x7f0dd40ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.986+0000 7f0ddc400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd4072590 con 0x7f0dd415b710 2024-04-25T09:06:35.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.986+0000 7f0ddc400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd415eea0 con 0x7f0dd40cc670 2024-04-25T09:06:35.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.986+0000 7f0ddc400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd40ccaa0 con 0x7f0dd40cd3d0 2024-04-25T09:06:35.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.990+0000 7f0dda400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0dd40cc670 0x7f0dd40ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.990+0000 7f0dd9000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dd40cd3d0 0x7f0dd40cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.990+0000 7f0dd9a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f0dd415b710 0x7f0dd4071e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:54068/0 (socket says 172.21.15.173:54068) 2024-04-25T09:06:35.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.990+0000 7f0dd9a00640 1 -- 172.21.15.173:0/1884147018 learned_addr learned my addr 172.21.15.173:0/1884147018 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:35.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.990+0000 7f0dda400640 1 -- 172.21.15.173:0/1884147018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dd40cd3d0 msgr2=0x7f0dd40cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:35.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.990+0000 7f0dda400640 1 --2- 172.21.15.173:0/1884147018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dd40cd3d0 0x7f0dd40cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.990+0000 7f0dda400640 1 -- 172.21.15.173:0/1884147018 >> v1:172.21.15.194:6789/0 conn(0x7f0dd415b710 legacy=0x7f0dd4071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.990+0000 7f0dda400640 1 -- 172.21.15.173:0/1884147018 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd415e2d0 con 0x7f0dd40cc670 2024-04-25T09:06:35.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.990+0000 7f0dd9000640 1 --2- 172.21.15.173:0/1884147018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dd40cd3d0 0x7f0dd40cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:35.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.990+0000 7f0dd3e00640 1 -- 172.21.15.173:0/1884147018 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891485069 0 0) 0x7f0dc8001120 con 0x7f0dd415b710 2024-04-25T09:06:35.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.990+0000 7f0dda400640 1 --2- 172.21.15.173:0/1884147018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dd40cc670 0x7f0dd40ceb40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009d90 tx=0x7f0dcc01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdacc0d0da9e12e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0dd3e00640 1 -- 172.21.15.173:0/1884147018 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc0b2070 con 0x7f0dd40cc670 2024-04-25T09:06:35.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0dd3e00640 1 -- 172.21.15.173:0/1884147018 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc0a5a00 con 0x7f0dd40cc670 2024-04-25T09:06:35.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0dd3e00640 1 -- 172.21.15.173:0/1884147018 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc0a5dd0 con 0x7f0dd40cc670 2024-04-25T09:06:35.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0ddc400640 1 -- 172.21.15.173:0/1884147018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dd40cc670 msgr2=0x7f0dd40ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0ddc400640 1 --2- 172.21.15.173:0/1884147018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dd40cc670 0x7f0dd40ceb40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009d90 tx=0x7f0dcc01c940 comp rx=0 tx=0).stop 2024-04-25T09:06:35.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0ddc400640 1 -- 172.21.15.173:0/1884147018 shutdown_connections 2024-04-25T09:06:35.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0ddc400640 1 --2- 172.21.15.173:0/1884147018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dd40cc670 0x7f0dd40ceb40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0ddc400640 1 --2- 172.21.15.173:0/1884147018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dd40cd3d0 0x7f0dd40cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0ddc400640 1 -- 172.21.15.173:0/1884147018 >> 172.21.15.173:0/1884147018 conn(0x7f0dd406ac90 msgr2=0x7f0dd406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:35.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0ddc400640 1 -- 172.21.15.173:0/1884147018 shutdown_connections 2024-04-25T09:06:35.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0ddc400640 1 -- 172.21.15.173:0/1884147018 wait complete. 2024-04-25T09:06:35.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0ddc400640 1 Processor -- start 2024-04-25T09:06:35.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0ddc400640 1 -- start start 2024-04-25T09:06:35.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0ddc400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dd40cc670 0x7f0dd414eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0ddc400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dd40cd3d0 0x7f0dd414c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0ddc400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dd415b710 0x7f0dd4147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0ddc400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd40cf890 con 0x7f0dd415b710 2024-04-25T09:06:35.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0ddc400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd415baf0 con 0x7f0dd40cc670 2024-04-25T09:06:35.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0ddc400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd40cfa10 con 0x7f0dd40cd3d0 2024-04-25T09:06:35.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0dda400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dd415b710 0x7f0dd4147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0dda400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dd415b710 0x7f0dd4147670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47298/0 (socket says 172.21.15.173:47298) 2024-04-25T09:06:35.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.994+0000 7f0dda400640 1 -- 172.21.15.173:0/2812052133 learned_addr learned my addr 172.21.15.173:0/2812052133 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:35.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.998+0000 7f0dd9a00640 1 --2- 172.21.15.173:0/2812052133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dd40cc670 0x7f0dd414eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.998+0000 7f0dd9000640 1 --2- 172.21.15.173:0/2812052133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dd40cd3d0 0x7f0dd414c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.998+0000 7f0dda400640 1 -- 172.21.15.173:0/2812052133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dd40cd3d0 msgr2=0x7f0dd414c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.998+0000 7f0dda400640 1 --2- 172.21.15.173:0/2812052133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dd40cd3d0 0x7f0dd414c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.998+0000 7f0dda400640 1 -- 172.21.15.173:0/2812052133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dd40cc670 msgr2=0x7f0dd414eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.998+0000 7f0dda400640 1 --2- 172.21.15.173:0/2812052133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dd40cc670 0x7f0dd414eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.998+0000 7f0dda400640 1 -- 172.21.15.173:0/2812052133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd4151720 con 0x7f0dd415b710 2024-04-25T09:06:35.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.998+0000 7f0dda400640 1 --2- 172.21.15.173:0/2812052133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dd415b710 0x7f0dd4147670 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009d90 tx=0x7f0dcc0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.998+0000 7f0dd1600640 1 -- 172.21.15.173:0/2812052133 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc0b2050 con 0x7f0dd415b710 2024-04-25T09:06:35.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.998+0000 7f0dd1600640 1 -- 172.21.15.173:0/2812052133 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc0b3040 con 0x7f0dd415b710 2024-04-25T09:06:35.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.998+0000 7f0ddc400640 1 -- 172.21.15.173:0/2812052133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd414c990 con 0x7f0dd415b710 2024-04-25T09:06:35.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.998+0000 7f0dd1600640 1 -- 172.21.15.173:0/2812052133 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc0ad850 con 0x7f0dd415b710 2024-04-25T09:06:35.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.998+0000 7f0ddc400640 1 -- 172.21.15.173:0/2812052133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd4151160 con 0x7f0dd415b710 2024-04-25T09:06:35.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.998+0000 7f0ddc400640 1 -- 172.21.15.173:0/2812052133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd4073ab0 con 0x7f0dd415b710 2024-04-25T09:06:35.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.998+0000 7f0dd1600640 1 -- 172.21.15.173:0/2812052133 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0dcc0c0020 con 0x7f0dd415b710 2024-04-25T09:06:35.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:35.998+0000 7f0dd1600640 1 --2- 172.21.15.173:0/2812052133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0db4066f90 0x7f0db4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.002+0000 7f0dd1600640 1 -- 172.21.15.173:0/2812052133 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0dcc1206b0 con 0x7f0dd415b710 2024-04-25T09:06:35.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.002+0000 7f0dd9a00640 1 --2- 172.21.15.173:0/2812052133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0db4066f90 0x7f0db4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.002+0000 7f0dd9a00640 1 --2- 172.21.15.173:0/2812052133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0db4066f90 0x7f0db4069450 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8000f70 tx=0x7f0dc8007df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.002+0000 7f0dd1600640 1 -- 172.21.15.173:0/2812052133 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0dcc016560 con 0x7f0dd415b710 2024-04-25T09:06:36.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.158+0000 7f0ddc400640 1 -- 172.21.15.173:0/2812052133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0dd41481c0 con 0x7f0dd415b710 2024-04-25T09:06:36.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.158+0000 7f0dd1600640 1 -- 172.21.15.173:0/2812052133 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0dcc0f0e90 con 0x7f0dd415b710 2024-04-25T09:06:36.146 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:06:36.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.158+0000 7f0ddc400640 1 -- 172.21.15.173:0/2812052133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0db4066f90 msgr2=0x7f0db4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.158+0000 7f0ddc400640 1 --2- 172.21.15.173:0/2812052133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0db4066f90 0x7f0db4069450 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8000f70 tx=0x7f0dc8007df0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.158+0000 7f0ddc400640 1 -- 172.21.15.173:0/2812052133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dd415b710 msgr2=0x7f0dd4147670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.158+0000 7f0ddc400640 1 --2- 172.21.15.173:0/2812052133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dd415b710 0x7f0dd4147670 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009d90 tx=0x7f0dcc0196e0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.158+0000 7f0ddc400640 1 -- 172.21.15.173:0/2812052133 shutdown_connections 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.158+0000 7f0ddc400640 1 --2- 172.21.15.173:0/2812052133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0db4066f90 0x7f0db4069450 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.158+0000 7f0ddc400640 1 --2- 172.21.15.173:0/2812052133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dd415b710 0x7f0dd4147670 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.158+0000 7f0ddc400640 1 --2- 172.21.15.173:0/2812052133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dd40cd3d0 0x7f0dd414c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.158+0000 7f0ddc400640 1 --2- 172.21.15.173:0/2812052133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dd40cc670 0x7f0dd414eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.158+0000 7f0ddc400640 1 -- 172.21.15.173:0/2812052133 >> 172.21.15.173:0/2812052133 conn(0x7f0dd406ac90 msgr2=0x7f0dd415c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.158+0000 7f0ddc400640 1 -- 172.21.15.173:0/2812052133 shutdown_connections 2024-04-25T09:06:36.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.158+0000 7f0ddc400640 1 -- 172.21.15.173:0/2812052133 wait complete. 2024-04-25T09:06:36.167 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:06:36.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd91800640 1 Processor -- start 2024-04-25T09:06:36.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd91800640 1 -- start start 2024-04-25T09:06:36.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd91800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdd8c159f00 0x7fdd8c0cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd91800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c15ddd0 con 0x7fdd8c0cda00 2024-04-25T09:06:36.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd91800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c15e0b0 con 0x7fdd8c0cff40 2024-04-25T09:06:36.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd91800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8c15e390 con 0x7fdd8c159f00 2024-04-25T09:06:36.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd8b400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fdd8c0cda00 0x7fdd8c071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36054/0 (socket says 172.21.15.173:36054) 2024-04-25T09:06:36.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd8b400640 1 -- 172.21.15.173:0/297803164 learned_addr learned my addr 172.21.15.173:0/297803164 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:36.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd8aa00640 1 --2- 172.21.15.173:0/297803164 >> v2:172.21.15.194:3300/0 conn(0x7fdd8c159f00 0x7fdd8c0cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd89600640 1 -- 172.21.15.173:0/297803164 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964153245 0 0) 0x7fdd8c15ddd0 con 0x7fdd8c0cda00 2024-04-25T09:06:36.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd89600640 1 -- 172.21.15.173:0/297803164 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd70005740 con 0x7fdd8c0cda00 2024-04-25T09:06:36.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd89600640 1 -- 172.21.15.173:0/297803164 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2432532187 0 0) 0x7fdd70005740 con 0x7fdd8c0cda00 2024-04-25T09:06:36.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd89600640 1 -- 172.21.15.173:0/297803164 >> v2:172.21.15.194:3300/0 conn(0x7fdd8c159f00 msgr2=0x7fdd8c0cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:36.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd89600640 1 --2- 172.21.15.173:0/297803164 >> v2:172.21.15.194:3300/0 conn(0x7fdd8c159f00 0x7fdd8c0cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd89600640 1 -- 172.21.15.173:0/297803164 >> v1:172.21.15.194:6789/0 conn(0x7fdd8c0cff40 legacy=0x7fdd8c0cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd89600640 1 -- 172.21.15.173:0/297803164 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c15e670 con 0x7fdd8c0cda00 2024-04-25T09:06:36.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd89600640 1 -- 172.21.15.173:0/297803164 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fdd84001a00 con 0x7fdd8c0cda00 2024-04-25T09:06:36.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd89600640 1 -- 172.21.15.173:0/297803164 >> v1:172.21.15.173:6789/0 conn(0x7fdd8c0cda00 legacy=0x7fdd8c071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd89600640 1 --2- 172.21.15.173:0/297803164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd70005bd0 0x7fdd70005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd89600640 1 --2- 172.21.15.173:0/297803164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd70006a20 0x7fdd70006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd89600640 1 --2- 172.21.15.173:0/297803164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd700073e0 0x7fdd7000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd89600640 1 -- 172.21.15.173:0/297803164 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c15e390 con 0x7fdd700073e0 2024-04-25T09:06:36.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd89600640 1 -- 172.21.15.173:0/297803164 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7000e280 con 0x7fdd70006a20 2024-04-25T09:06:36.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd89600640 1 -- 172.21.15.173:0/297803164 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7000e480 con 0x7fdd70005bd0 2024-04-25T09:06:36.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd8b400640 1 --2- 172.21.15.173:0/297803164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd700073e0 0x7fdd7000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd8aa00640 1 --2- 172.21.15.173:0/297803164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd70005bd0 0x7fdd70005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd8a000640 1 --2- 172.21.15.173:0/297803164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd70006a20 0x7fdd70006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd8b400640 1 -- 172.21.15.173:0/297803164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd70005bd0 msgr2=0x7fdd70005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:36.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd8b400640 1 --2- 172.21.15.173:0/297803164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd70005bd0 0x7fdd70005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd8b400640 1 -- 172.21.15.173:0/297803164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd70006a20 msgr2=0x7fdd70006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:36.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd8b400640 1 --2- 172.21.15.173:0/297803164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd70006a20 0x7fdd70006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.318+0000 7fdd8b400640 1 -- 172.21.15.173:0/297803164 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd70005740 con 0x7fdd700073e0 2024-04-25T09:06:36.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.322+0000 7fdd8b400640 1 -- 172.21.15.173:0/297803164 reap_dead start 2024-04-25T09:06:36.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.322+0000 7fdd8b400640 1 --2- 172.21.15.173:0/297803164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd700073e0 0x7fdd7000dbe0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400a840 tx=0x7fdd8401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93f9a22f84531ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.322+0000 7fdd89600640 1 -- 172.21.15.173:0/297803164 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8400a460 con 0x7fdd700073e0 2024-04-25T09:06:36.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.322+0000 7fdd89600640 1 -- 172.21.15.173:0/297803164 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd840ac640 con 0x7fdd700073e0 2024-04-25T09:06:36.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.322+0000 7fdd89600640 1 -- 172.21.15.173:0/297803164 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd840aca30 con 0x7fdd700073e0 2024-04-25T09:06:36.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.322+0000 7fdd91800640 1 -- 172.21.15.173:0/297803164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd700073e0 msgr2=0x7fdd7000dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.322+0000 7fdd91800640 1 --2- 172.21.15.173:0/297803164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd700073e0 0x7fdd7000dbe0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400a840 tx=0x7fdd8401d360 comp rx=0 tx=0).stop 2024-04-25T09:06:36.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.322+0000 7fdd91800640 1 -- 172.21.15.173:0/297803164 shutdown_connections 2024-04-25T09:06:36.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.322+0000 7fdd91800640 1 --2- 172.21.15.173:0/297803164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd700073e0 0x7fdd7000dbe0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.322+0000 7fdd91800640 1 -- 172.21.15.173:0/297803164 >> 172.21.15.173:0/297803164 conn(0x7fdd8c06ac90 msgr2=0x7fdd8c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:36.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.322+0000 7fdd91800640 1 -- 172.21.15.173:0/297803164 shutdown_connections 2024-04-25T09:06:36.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.322+0000 7fdd91800640 1 -- 172.21.15.173:0/297803164 wait complete. 2024-04-25T09:06:36.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd91800640 1 Processor -- start 2024-04-25T09:06:36.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd91800640 1 -- start start 2024-04-25T09:06:36.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd91800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd700073e0 0x7fdd8c14d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd91800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd8c1f45f0 0x7fdd8c1f7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd91800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd8c0ac8c0 0x7fdd8c0acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd91800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c15a460 con 0x7fdd8c1f45f0 2024-04-25T09:06:36.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd91800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c15a2e0 con 0x7fdd8c0ac8c0 2024-04-25T09:06:36.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd91800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c15a5e0 con 0x7fdd700073e0 2024-04-25T09:06:36.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd8a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd8c1f45f0 0x7fdd8c1f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd8a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd8c1f45f0 0x7fdd8c1f7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47310/0 (socket says 172.21.15.173:47310) 2024-04-25T09:06:36.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd8a000640 1 -- 172.21.15.173:0/1995688776 learned_addr learned my addr 172.21.15.173:0/1995688776 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:36.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd8aa00640 1 --2- 172.21.15.173:0/1995688776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd700073e0 0x7fdd8c14d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd8b400640 1 --2- 172.21.15.173:0/1995688776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd8c0ac8c0 0x7fdd8c0acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd8a000640 1 -- 172.21.15.173:0/1995688776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd700073e0 msgr2=0x7fdd8c14d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd8a000640 1 --2- 172.21.15.173:0/1995688776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd700073e0 0x7fdd8c14d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd8a000640 1 -- 172.21.15.173:0/1995688776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd8c0ac8c0 msgr2=0x7fdd8c0acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd8a000640 1 --2- 172.21.15.173:0/1995688776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd8c0ac8c0 0x7fdd8c0acd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd8a000640 1 -- 172.21.15.173:0/1995688776 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c15a800 con 0x7fdd8c1f45f0 2024-04-25T09:06:36.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd8a000640 1 --2- 172.21.15.173:0/1995688776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd8c1f45f0 0x7fdd8c1f7040 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800e3f0 tx=0x7fdd7800e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd82a00640 1 -- 172.21.15.173:0/1995688776 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78019070 con 0x7fdd8c1f45f0 2024-04-25T09:06:36.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd82a00640 1 -- 172.21.15.173:0/1995688776 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd780052e0 con 0x7fdd8c1f45f0 2024-04-25T09:06:36.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd91800640 1 -- 172.21.15.173:0/1995688776 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c1f7890 con 0x7fdd8c1f45f0 2024-04-25T09:06:36.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd82a00640 1 -- 172.21.15.173:0/1995688776 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78003820 con 0x7fdd8c1f45f0 2024-04-25T09:06:36.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.326+0000 7fdd91800640 1 -- 172.21.15.173:0/1995688776 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c1f7580 con 0x7fdd8c1f45f0 2024-04-25T09:06:36.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.330+0000 7fdd91800640 1 -- 172.21.15.173:0/1995688776 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8c073ab0 con 0x7fdd8c1f45f0 2024-04-25T09:06:36.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.330+0000 7fdd82a00640 1 -- 172.21.15.173:0/1995688776 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdd7801c070 con 0x7fdd8c1f45f0 2024-04-25T09:06:36.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.330+0000 7fdd82a00640 1 --2- 172.21.15.173:0/1995688776 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdd6c066f90 0x7fdd6c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.330+0000 7fdd82a00640 1 -- 172.21.15.173:0/1995688776 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fdd78084540 con 0x7fdd8c1f45f0 2024-04-25T09:06:36.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.330+0000 7fdd8aa00640 1 --2- 172.21.15.173:0/1995688776 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdd6c066f90 0x7fdd6c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.330+0000 7fdd8aa00640 1 --2- 172.21.15.173:0/1995688776 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdd6c066f90 0x7fdd6c069450 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c1508f0 tx=0x7fdd7c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.334+0000 7fdd82a00640 1 -- 172.21.15.173:0/1995688776 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdd78054dd0 con 0x7fdd8c1f45f0 2024-04-25T09:06:36.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.486+0000 7fdd91800640 1 -- 172.21.15.173:0/1995688776 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdd8c0cd7e0 con 0x7fdd8c1f45f0 2024-04-25T09:06:36.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.486+0000 7fdd82a00640 1 -- 172.21.15.173:0/1995688776 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdd78058e70 con 0x7fdd8c1f45f0 2024-04-25T09:06:36.476 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:06:36.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.490+0000 7fdd91800640 1 -- 172.21.15.173:0/1995688776 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdd6c066f90 msgr2=0x7fdd6c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.490+0000 7fdd91800640 1 --2- 172.21.15.173:0/1995688776 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdd6c066f90 0x7fdd6c069450 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c1508f0 tx=0x7fdd7c009190 comp rx=0 tx=0).stop 2024-04-25T09:06:36.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.490+0000 7fdd91800640 1 -- 172.21.15.173:0/1995688776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd8c1f45f0 msgr2=0x7fdd8c1f7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.490+0000 7fdd91800640 1 --2- 172.21.15.173:0/1995688776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd8c1f45f0 0x7fdd8c1f7040 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800e3f0 tx=0x7fdd7800e7f0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.490+0000 7fdd91800640 1 -- 172.21.15.173:0/1995688776 shutdown_connections 2024-04-25T09:06:36.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.490+0000 7fdd91800640 1 --2- 172.21.15.173:0/1995688776 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdd6c066f90 0x7fdd6c069450 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.490+0000 7fdd91800640 1 --2- 172.21.15.173:0/1995688776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd8c0ac8c0 0x7fdd8c0acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.490+0000 7fdd91800640 1 --2- 172.21.15.173:0/1995688776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd8c1f45f0 0x7fdd8c1f7040 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.490+0000 7fdd91800640 1 --2- 172.21.15.173:0/1995688776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd700073e0 0x7fdd8c14d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.490+0000 7fdd91800640 1 -- 172.21.15.173:0/1995688776 >> 172.21.15.173:0/1995688776 conn(0x7fdd8c06ac90 msgr2=0x7fdd8c158d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:36.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.490+0000 7fdd91800640 1 -- 172.21.15.173:0/1995688776 shutdown_connections 2024-04-25T09:06:36.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.490+0000 7fdd91800640 1 -- 172.21.15.173:0/1995688776 wait complete. 2024-04-25T09:06:36.498 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:36.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.642+0000 7f0428200640 1 Processor -- start 2024-04-25T09:06:36.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.642+0000 7f0428200640 1 -- start start 2024-04-25T09:06:36.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.646+0000 7f0428200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042015ba20 0x7f042015be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.646+0000 7f0428200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f04200b70f0 0x7f042006f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.646+0000 7f0428200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f04200b7550 0x7f042006fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.646+0000 7f0428200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042015c460 con 0x7f04200b70f0 2024-04-25T09:06:36.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.646+0000 7f0428200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042015c740 con 0x7f04200b7550 2024-04-25T09:06:36.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.646+0000 7f0428200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042015ca20 con 0x7f042015ba20 2024-04-25T09:06:36.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.646+0000 7f0424e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f04200b70f0 0x7f042006f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.646+0000 7f0424e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f04200b70f0 0x7f042006f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47322/0 (socket says 172.21.15.173:47322) 2024-04-25T09:06:36.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.646+0000 7f0424e00640 1 -- 172.21.15.173:0/3482024194 learned_addr learned my addr 172.21.15.173:0/3482024194 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:36.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.646+0000 7f0425800640 1 --2- 172.21.15.173:0/3482024194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042015ba20 0x7f042015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.646+0000 7f0426200640 1 --2- 172.21.15.173:0/3482024194 >> v2:172.21.15.194:3300/0 conn(0x7f04200b7550 0x7f042006fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.646+0000 7f0424e00640 1 -- 172.21.15.173:0/3482024194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042015ba20 msgr2=0x7f042015be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:36.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.646+0000 7f0424e00640 1 --2- 172.21.15.173:0/3482024194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042015ba20 0x7f042015be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.646+0000 7f0424e00640 1 -- 172.21.15.173:0/3482024194 >> v2:172.21.15.194:3300/0 conn(0x7f04200b7550 msgr2=0x7f042006fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:36.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.646+0000 7f0424e00640 1 --2- 172.21.15.173:0/3482024194 >> v2:172.21.15.194:3300/0 conn(0x7f04200b7550 0x7f042006fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.646+0000 7f0424e00640 1 -- 172.21.15.173:0/3482024194 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042015cd00 con 0x7f04200b70f0 2024-04-25T09:06:36.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.650+0000 7f0424e00640 1 --2- 172.21.15.173:0/3482024194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04200b70f0 0x7f042006f960 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f04200b6bf0 tx=0x7f040c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b77e506aadce1fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.650+0000 7f041fe00640 1 -- 172.21.15.173:0/3482024194 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0aa430 con 0x7f04200b70f0 2024-04-25T09:06:36.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.650+0000 7f041fe00640 1 -- 172.21.15.173:0/3482024194 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c0af070 con 0x7f04200b70f0 2024-04-25T09:06:36.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.650+0000 7f041fe00640 1 -- 172.21.15.173:0/3482024194 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0aa7f0 con 0x7f04200b70f0 2024-04-25T09:06:36.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.650+0000 7f0428200640 1 -- 172.21.15.173:0/3482024194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04200b70f0 msgr2=0x7f042006f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.650+0000 7f0428200640 1 --2- 172.21.15.173:0/3482024194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04200b70f0 0x7f042006f960 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f04200b6bf0 tx=0x7f040c01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.650+0000 7f0428200640 1 -- 172.21.15.173:0/3482024194 shutdown_connections 2024-04-25T09:06:36.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.650+0000 7f0428200640 1 --2- 172.21.15.173:0/3482024194 >> v2:172.21.15.194:3300/0 conn(0x7f04200b7550 0x7f042006fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.650+0000 7f0428200640 1 --2- 172.21.15.173:0/3482024194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04200b70f0 0x7f042006f960 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.650+0000 7f0428200640 1 --2- 172.21.15.173:0/3482024194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042015ba20 0x7f042015be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.650+0000 7f0428200640 1 -- 172.21.15.173:0/3482024194 >> 172.21.15.173:0/3482024194 conn(0x7f0420061880 msgr2=0x7f0420061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:36.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.650+0000 7f0428200640 1 -- 172.21.15.173:0/3482024194 shutdown_connections 2024-04-25T09:06:36.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.650+0000 7f0428200640 1 -- 172.21.15.173:0/3482024194 wait complete. 2024-04-25T09:06:36.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.650+0000 7f0428200640 1 Processor -- start 2024-04-25T09:06:36.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.650+0000 7f0428200640 1 -- start start 2024-04-25T09:06:36.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0428200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04200b70f0 0x7f04201662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0428200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f042015ba20 0x7f04200cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0428200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f042014cbd0 0x7f04200b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0428200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04200d2620 con 0x7f042015ba20 2024-04-25T09:06:36.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0428200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04200d24a0 con 0x7f042014cbd0 2024-04-25T09:06:36.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0428200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042015f3f0 con 0x7f04200b70f0 2024-04-25T09:06:36.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0424e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f042015ba20 0x7f04200cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0424e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f042015ba20 0x7f04200cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47326/0 (socket says 172.21.15.173:47326) 2024-04-25T09:06:36.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0424e00640 1 -- 172.21.15.173:0/3573823079 learned_addr learned my addr 172.21.15.173:0/3573823079 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:36.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0425800640 1 --2- 172.21.15.173:0/3573823079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04200b70f0 0x7f04201662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0426200640 1 --2- 172.21.15.173:0/3573823079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f042014cbd0 0x7f04200b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0424e00640 1 -- 172.21.15.173:0/3573823079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04200b70f0 msgr2=0x7f04201662e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0424e00640 1 --2- 172.21.15.173:0/3573823079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04200b70f0 0x7f04201662e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0424e00640 1 -- 172.21.15.173:0/3573823079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f042014cbd0 msgr2=0x7f04200b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0424e00640 1 --2- 172.21.15.173:0/3573823079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f042014cbd0 0x7f04200b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0424e00640 1 -- 172.21.15.173:0/3573823079 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0420163e90 con 0x7f042015ba20 2024-04-25T09:06:36.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0424e00640 1 --2- 172.21.15.173:0/3573823079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f042015ba20 0x7f04200cb100 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f040c0ac040 tx=0x7f040c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f041d600640 1 -- 172.21.15.173:0/3573823079 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0b3800 con 0x7f042015ba20 2024-04-25T09:06:36.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f041d600640 1 -- 172.21.15.173:0/3573823079 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c0b39a0 con 0x7f042015ba20 2024-04-25T09:06:36.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f041d600640 1 -- 172.21.15.173:0/3573823079 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0b3d50 con 0x7f042015ba20 2024-04-25T09:06:36.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0428200640 1 -- 172.21.15.173:0/3573823079 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0420164170 con 0x7f042015ba20 2024-04-25T09:06:36.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0428200640 1 -- 172.21.15.173:0/3573823079 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0420164730 con 0x7f042015ba20 2024-04-25T09:06:36.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f0428200640 1 -- 172.21.15.173:0/3573823079 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04200cb640 con 0x7f042015ba20 2024-04-25T09:06:36.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.654+0000 7f041d600640 1 -- 172.21.15.173:0/3573823079 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f040c0b2380 con 0x7f042015ba20 2024-04-25T09:06:36.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.658+0000 7f041d600640 1 --2- 172.21.15.173:0/3573823079 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0400066f90 0x7f0400069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.658+0000 7f041d600640 1 -- 172.21.15.173:0/3573823079 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f040c11f2d0 con 0x7f042015ba20 2024-04-25T09:06:36.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.658+0000 7f0425800640 1 --2- 172.21.15.173:0/3573823079 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0400066f90 0x7f0400069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.658+0000 7f0425800640 1 --2- 172.21.15.173:0/3573823079 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0400066f90 0x7f0400069450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f04140079c0 tx=0x7f0414008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.662+0000 7f041d600640 1 -- 172.21.15.173:0/3573823079 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f040c016110 con 0x7f042015ba20 2024-04-25T09:06:36.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.850+0000 7f0428200640 1 -- 172.21.15.173:0/3573823079 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0420073a40 con 0x7f042015ba20 2024-04-25T09:06:36.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.850+0000 7f041d600640 1 -- 172.21.15.173:0/3573823079 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4951 (secure 0 0 0) 0x7f040c0ef9a0 con 0x7f042015ba20 2024-04-25T09:06:36.839 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:36.839 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":30,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:06:35.243292+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:36.840 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 30 2024-04-25T09:06:36.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.854+0000 7f0428200640 1 -- 172.21.15.173:0/3573823079 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0400066f90 msgr2=0x7f0400069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.854+0000 7f0428200640 1 --2- 172.21.15.173:0/3573823079 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0400066f90 0x7f0400069450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f04140079c0 tx=0x7f0414008040 comp rx=0 tx=0).stop 2024-04-25T09:06:36.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.854+0000 7f0428200640 1 -- 172.21.15.173:0/3573823079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f042015ba20 msgr2=0x7f04200cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.854+0000 7f0428200640 1 --2- 172.21.15.173:0/3573823079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f042015ba20 0x7f04200cb100 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f040c0ac040 tx=0x7f040c01ad30 comp rx=0 tx=0).stop 2024-04-25T09:06:36.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.854+0000 7f0428200640 1 -- 172.21.15.173:0/3573823079 shutdown_connections 2024-04-25T09:06:36.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.854+0000 7f0428200640 1 --2- 172.21.15.173:0/3573823079 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0400066f90 0x7f0400069450 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.854+0000 7f0428200640 1 --2- 172.21.15.173:0/3573823079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f042014cbd0 0x7f04200b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.854+0000 7f0428200640 1 --2- 172.21.15.173:0/3573823079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f042015ba20 0x7f04200cb100 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.854+0000 7f0428200640 1 --2- 172.21.15.173:0/3573823079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04200b70f0 0x7f04201662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.854+0000 7f0428200640 1 -- 172.21.15.173:0/3573823079 >> 172.21.15.173:0/3573823079 conn(0x7f0420061880 msgr2=0x7f0420061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:36.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.854+0000 7f0428200640 1 -- 172.21.15.173:0/3573823079 shutdown_connections 2024-04-25T09:06:36.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:36.854+0000 7f0428200640 1 -- 172.21.15.173:0/3573823079 wait complete. 2024-04-25T09:06:36.860 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:36.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.006+0000 7eff4ca00640 1 Processor -- start 2024-04-25T09:06:36.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.006+0000 7eff4ca00640 1 -- start start 2024-04-25T09:06:36.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.006+0000 7eff4ca00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7eff4815dbb0 0x7eff4815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.006+0000 7eff4ca00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7eff4806f830 0x7eff4806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.006+0000 7eff4ca00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4806d870 con 0x7eff480d2130 2024-04-25T09:06:36.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.006+0000 7eff4ca00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff480701e0 con 0x7eff4815dbb0 2024-04-25T09:06:36.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.006+0000 7eff4ca00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff480d2590 con 0x7eff4806f830 2024-04-25T09:06:36.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.006+0000 7eff45e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7eff4815dbb0 0x7eff4815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.006+0000 7eff45e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7eff4815dbb0 0x7eff4815df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47338/0 (socket says 172.21.15.173:47338) 2024-04-25T09:06:36.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.006+0000 7eff45e00640 1 -- 172.21.15.173:0/345796680 learned_addr learned my addr 172.21.15.173:0/345796680 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:36.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.006+0000 7eff46800640 1 --2- 172.21.15.173:0/345796680 >> v2:172.21.15.194:3300/0 conn(0x7eff4806f830 0x7eff4806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.010+0000 7eff45e00640 1 -- 172.21.15.173:0/345796680 >> v2:172.21.15.194:3300/0 conn(0x7eff4806f830 msgr2=0x7eff4806fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:36.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.010+0000 7eff45e00640 1 --2- 172.21.15.173:0/345796680 >> v2:172.21.15.194:3300/0 conn(0x7eff4806f830 0x7eff4806fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.010+0000 7eff45e00640 1 -- 172.21.15.173:0/345796680 >> v1:172.21.15.173:6789/0 conn(0x7eff480d2130 legacy=0x7eff4806c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.010+0000 7eff45e00640 1 -- 172.21.15.173:0/345796680 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff48161690 con 0x7eff4815dbb0 2024-04-25T09:06:36.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.010+0000 7eff45e00640 1 --2- 172.21.15.173:0/345796680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4815dbb0 0x7eff4815df90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7eff48062610 tx=0x7eff3801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe931774db897e16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.010+0000 7eff44a00640 1 -- 172.21.15.173:0/345796680 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff380a5880 con 0x7eff4815dbb0 2024-04-25T09:06:37.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.010+0000 7eff44a00640 1 -- 172.21.15.173:0/345796680 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff380a5a20 con 0x7eff4815dbb0 2024-04-25T09:06:37.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.010+0000 7eff44a00640 1 -- 172.21.15.173:0/345796680 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff380a5df0 con 0x7eff4815dbb0 2024-04-25T09:06:37.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.010+0000 7eff4ca00640 1 -- 172.21.15.173:0/345796680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4815dbb0 msgr2=0x7eff4815df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.010+0000 7eff4ca00640 1 --2- 172.21.15.173:0/345796680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4815dbb0 0x7eff4815df90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7eff48062610 tx=0x7eff3801c9c0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.010+0000 7eff4ca00640 1 -- 172.21.15.173:0/345796680 shutdown_connections 2024-04-25T09:06:37.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.010+0000 7eff4ca00640 1 --2- 172.21.15.173:0/345796680 >> v2:172.21.15.194:3300/0 conn(0x7eff4806f830 0x7eff4806fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.010+0000 7eff4ca00640 1 --2- 172.21.15.173:0/345796680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4815dbb0 0x7eff4815df90 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.010+0000 7eff4ca00640 1 -- 172.21.15.173:0/345796680 >> 172.21.15.173:0/345796680 conn(0x7eff48061880 msgr2=0x7eff48061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:37.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.010+0000 7eff4ca00640 1 -- 172.21.15.173:0/345796680 shutdown_connections 2024-04-25T09:06:37.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.010+0000 7eff4ca00640 1 -- 172.21.15.173:0/345796680 wait complete. 2024-04-25T09:06:37.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff4ca00640 1 Processor -- start 2024-04-25T09:06:37.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff4ca00640 1 -- start start 2024-04-25T09:06:37.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff4ca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4806f830 0x7eff4815ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff4ca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff480d2130 0x7eff480c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff4ca00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff4815dbb0 0x7eff480ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff4ca00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4815ee60 con 0x7eff4806f830 2024-04-25T09:06:37.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff4ca00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4806c980 con 0x7eff480d2130 2024-04-25T09:06:37.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff4ca00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4816a990 con 0x7eff4815dbb0 2024-04-25T09:06:37.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff45e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4806f830 0x7eff4815ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff45e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4806f830 0x7eff4815ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47352/0 (socket says 172.21.15.173:47352) 2024-04-25T09:06:37.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff45e00640 1 -- 172.21.15.173:0/2634744032 learned_addr learned my addr 172.21.15.173:0/2634744032 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:37.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff45400640 1 --2- 172.21.15.173:0/2634744032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff480d2130 0x7eff480c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff46800640 1 --2- 172.21.15.173:0/2634744032 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff4815dbb0 0x7eff480ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff45e00640 1 -- 172.21.15.173:0/2634744032 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff4815dbb0 msgr2=0x7eff480ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff45e00640 1 --2- 172.21.15.173:0/2634744032 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff4815dbb0 0x7eff480ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff45e00640 1 -- 172.21.15.173:0/2634744032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff480d2130 msgr2=0x7eff480c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff45e00640 1 --2- 172.21.15.173:0/2634744032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff480d2130 0x7eff480c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff45e00640 1 -- 172.21.15.173:0/2634744032 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff480b68f0 con 0x7eff4806f830 2024-04-25T09:06:37.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff45400640 1 --2- 172.21.15.173:0/2634744032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff480d2130 0x7eff480c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:37.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff45e00640 1 --2- 172.21.15.173:0/2634744032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4806f830 0x7eff4815ac20 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7eff380af040 tx=0x7eff38019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:37.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff3e000640 1 -- 172.21.15.173:0/2634744032 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff380b8670 con 0x7eff4806f830 2024-04-25T09:06:37.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff3e000640 1 -- 172.21.15.173:0/2634744032 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff380be070 con 0x7eff4806f830 2024-04-25T09:06:37.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff3e000640 1 -- 172.21.15.173:0/2634744032 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff380b8a90 con 0x7eff4806f830 2024-04-25T09:06:37.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff4ca00640 1 -- 172.21.15.173:0/2634744032 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff480b6bd0 con 0x7eff4806f830 2024-04-25T09:06:37.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.014+0000 7eff4ca00640 1 -- 172.21.15.173:0/2634744032 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff480b7190 con 0x7eff4806f830 2024-04-25T09:06:37.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.018+0000 7eff4ca00640 1 -- 172.21.15.173:0/2634744032 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff48073a40 con 0x7eff4806f830 2024-04-25T09:06:37.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.018+0000 7eff3e000640 1 -- 172.21.15.173:0/2634744032 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7eff380b8c30 con 0x7eff4806f830 2024-04-25T09:06:37.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.018+0000 7eff3e000640 1 --2- 172.21.15.173:0/2634744032 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7eff28066f60 0x7eff28069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.018+0000 7eff3e000640 1 -- 172.21.15.173:0/2634744032 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6159+0+0 (secure 0 0 0) 0x7eff381206a0 con 0x7eff4806f830 2024-04-25T09:06:37.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.018+0000 7eff45400640 1 --2- 172.21.15.173:0/2634744032 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7eff28066f60 0x7eff28069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.018+0000 7eff45400640 1 --2- 172.21.15.173:0/2634744032 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7eff28066f60 0x7eff28069420 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7eff481f9cf0 tx=0x7eff34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:37.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.022+0000 7eff3e000640 1 -- 172.21.15.173:0/2634744032 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7eff380165e0 con 0x7eff4806f830 2024-04-25T09:06:37.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.178+0000 7eff4ca00640 1 -- 172.21.15.173:0/2634744032 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff4815fb20 con 0x7eff4806f830 2024-04-25T09:06:37.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.178+0000 7eff3e000640 1 -- 172.21.15.173:0/2634744032 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+17098 (secure 0 0 0) 0x7eff380f1610 con 0x7eff4806f830 2024-04-25T09:06:37.167 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:37.167 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":58,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:06:33.651218+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:52.287873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:53.577379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1f","mappings":[{"from":0,"to":6}]},{"pgid":"8.28","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:37.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.178+0000 7eff4ca00640 1 -- 172.21.15.173:0/2634744032 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7eff28066f60 msgr2=0x7eff28069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.178+0000 7eff4ca00640 1 --2- 172.21.15.173:0/2634744032 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7eff28066f60 0x7eff28069420 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7eff481f9cf0 tx=0x7eff34009040 comp rx=0 tx=0).stop 2024-04-25T09:06:37.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.178+0000 7eff4ca00640 1 -- 172.21.15.173:0/2634744032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4806f830 msgr2=0x7eff4815ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.178+0000 7eff4ca00640 1 --2- 172.21.15.173:0/2634744032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4806f830 0x7eff4815ac20 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7eff380af040 tx=0x7eff38019760 comp rx=0 tx=0).stop 2024-04-25T09:06:37.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.178+0000 7eff4ca00640 1 -- 172.21.15.173:0/2634744032 shutdown_connections 2024-04-25T09:06:37.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.178+0000 7eff4ca00640 1 --2- 172.21.15.173:0/2634744032 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7eff28066f60 0x7eff28069420 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.178+0000 7eff4ca00640 1 --2- 172.21.15.173:0/2634744032 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff4815dbb0 0x7eff480ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.178+0000 7eff4ca00640 1 --2- 172.21.15.173:0/2634744032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff480d2130 0x7eff480c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.178+0000 7eff4ca00640 1 --2- 172.21.15.173:0/2634744032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff4806f830 0x7eff4815ac20 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.178+0000 7eff4ca00640 1 -- 172.21.15.173:0/2634744032 >> 172.21.15.173:0/2634744032 conn(0x7eff48061880 msgr2=0x7eff4806c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:37.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.182+0000 7eff4ca00640 1 -- 172.21.15.173:0/2634744032 shutdown_connections 2024-04-25T09:06:37.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.182+0000 7eff4ca00640 1 -- 172.21.15.173:0/2634744032 wait complete. 2024-04-25T09:06:37.188 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:06:37.188 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:37.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.334+0000 7fb3fa600640 1 Processor -- start 2024-04-25T09:06:37.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.334+0000 7fb3fa600640 1 -- start start 2024-04-25T09:06:37.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.338+0000 7fb3fa600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3f40b3e70 0x7fb3f40b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.338+0000 7fb3fa600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb3f40aefa0 0x7fb3f40b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.338+0000 7fb3fa600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f40b4790 con 0x7fb3f415edd0 2024-04-25T09:06:37.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.338+0000 7fb3fa600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f406dd50 con 0x7fb3f40aefa0 2024-04-25T09:06:37.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.338+0000 7fb3fa600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f415f320 con 0x7fb3f40b3e70 2024-04-25T09:06:37.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.338+0000 7fb3f3e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fb3f415edd0 0x7fb3f40b2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36084/0 (socket says 172.21.15.173:36084) 2024-04-25T09:06:37.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.338+0000 7fb3f3e00640 1 -- 172.21.15.173:0/1580792318 learned_addr learned my addr 172.21.15.173:0/1580792318 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:37.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.338+0000 7fb3f2a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb3f40aefa0 0x7fb3f40b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.338+0000 7fb3f3400640 1 --2- 172.21.15.173:0/1580792318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3f40b3e70 0x7fb3f40b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.338+0000 7fb3f2a00640 1 -- 172.21.15.173:0/1580792318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3f40b3e70 msgr2=0x7fb3f40b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:37.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.338+0000 7fb3f2a00640 1 --2- 172.21.15.173:0/1580792318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3f40b3e70 0x7fb3f40b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.338+0000 7fb3f2a00640 1 -- 172.21.15.173:0/1580792318 >> v1:172.21.15.173:6789/0 conn(0x7fb3f415edd0 legacy=0x7fb3f40b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.338+0000 7fb3f2000640 1 -- 172.21.15.173:0/1580792318 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078416912 0 0) 0x7fb3f40b4790 con 0x7fb3f415edd0 2024-04-25T09:06:37.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.338+0000 7fb3f2a00640 1 -- 172.21.15.173:0/1580792318 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f406d420 con 0x7fb3f40aefa0 2024-04-25T09:06:37.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.338+0000 7fb3f2a00640 1 --2- 172.21.15.173:0/1580792318 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3f40aefa0 0x7fb3f40b2770 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00097c0 tx=0x7fb3e001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a7784d34fb366d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:37.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3f2000640 1 -- 172.21.15.173:0/1580792318 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e00aa5f0 con 0x7fb3f40aefa0 2024-04-25T09:06:37.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3f2000640 1 -- 172.21.15.173:0/1580792318 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e00af070 con 0x7fb3f40aefa0 2024-04-25T09:06:37.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3f2000640 1 -- 172.21.15.173:0/1580792318 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e00aa9b0 con 0x7fb3f40aefa0 2024-04-25T09:06:37.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3fa600640 1 -- 172.21.15.173:0/1580792318 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3f40aefa0 msgr2=0x7fb3f40b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3fa600640 1 --2- 172.21.15.173:0/1580792318 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3f40aefa0 0x7fb3f40b2770 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00097c0 tx=0x7fb3e001c470 comp rx=0 tx=0).stop 2024-04-25T09:06:37.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3fa600640 1 -- 172.21.15.173:0/1580792318 shutdown_connections 2024-04-25T09:06:37.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3fa600640 1 --2- 172.21.15.173:0/1580792318 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3f40aefa0 0x7fb3f40b2770 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3fa600640 1 --2- 172.21.15.173:0/1580792318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3f40b3e70 0x7fb3f40b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3fa600640 1 -- 172.21.15.173:0/1580792318 >> 172.21.15.173:0/1580792318 conn(0x7fb3f406ac90 msgr2=0x7fb3f406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:37.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3fa600640 1 -- 172.21.15.173:0/1580792318 shutdown_connections 2024-04-25T09:06:37.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3fa600640 1 -- 172.21.15.173:0/1580792318 wait complete. 2024-04-25T09:06:37.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3fa600640 1 Processor -- start 2024-04-25T09:06:37.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3fa600640 1 -- start start 2024-04-25T09:06:37.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3fa600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3f40aefa0 0x7fb3f4147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3fa600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3f40b3e70 0x7fb3f4149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3fa600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3f415edd0 0x7fb3f414f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3fa600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f406e1c0 con 0x7fb3f40b3e70 2024-04-25T09:06:37.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3fa600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f415aba0 con 0x7fb3f415edd0 2024-04-25T09:06:37.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3fa600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f406e340 con 0x7fb3f40aefa0 2024-04-25T09:06:37.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3f2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3f40b3e70 0x7fb3f4149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3f2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3f40b3e70 0x7fb3f4149390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47376/0 (socket says 172.21.15.173:47376) 2024-04-25T09:06:37.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.342+0000 7fb3f2a00640 1 -- 172.21.15.173:0/3984799641 learned_addr learned my addr 172.21.15.173:0/3984799641 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:37.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.346+0000 7fb3f3400640 1 --2- 172.21.15.173:0/3984799641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3f40aefa0 0x7fb3f4147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.346+0000 7fb3f2a00640 1 -- 172.21.15.173:0/3984799641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3f40aefa0 msgr2=0x7fb3f4147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.346+0000 7fb3f2a00640 1 --2- 172.21.15.173:0/3984799641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3f40aefa0 0x7fb3f4147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.346+0000 7fb3f2a00640 1 -- 172.21.15.173:0/3984799641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3f415edd0 msgr2=0x7fb3f414f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.346+0000 7fb3f2a00640 1 --2- 172.21.15.173:0/3984799641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3f415edd0 0x7fb3f414f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.346+0000 7fb3f2a00640 1 -- 172.21.15.173:0/3984799641 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f41482f0 con 0x7fb3f40b3e70 2024-04-25T09:06:37.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.346+0000 7fb3f3400640 1 --2- 172.21.15.173:0/3984799641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3f40aefa0 0x7fb3f4147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:37.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.346+0000 7fb3f2a00640 1 --2- 172.21.15.173:0/3984799641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3f40b3e70 0x7fb3f4149390 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00097c0 tx=0x7fb3e001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:37.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.346+0000 7fb3eb400640 1 -- 172.21.15.173:0/3984799641 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0006e20 con 0x7fb3f40b3e70 2024-04-25T09:06:37.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.346+0000 7fb3eb400640 1 -- 172.21.15.173:0/3984799641 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e0004220 con 0x7fb3f40b3e70 2024-04-25T09:06:37.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.346+0000 7fb3fa600640 1 -- 172.21.15.173:0/3984799641 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f41485d0 con 0x7fb3f40b3e70 2024-04-25T09:06:37.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.346+0000 7fb3eb400640 1 -- 172.21.15.173:0/3984799641 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e00aae60 con 0x7fb3f40b3e70 2024-04-25T09:06:37.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.346+0000 7fb3fa600640 1 -- 172.21.15.173:0/3984799641 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f4148b90 con 0x7fb3f40b3e70 2024-04-25T09:06:37.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.346+0000 7fb3fa600640 1 -- 172.21.15.173:0/3984799641 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f4073a40 con 0x7fb3f40b3e70 2024-04-25T09:06:37.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.346+0000 7fb3eb400640 1 -- 172.21.15.173:0/3984799641 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb3e0003620 con 0x7fb3f40b3e70 2024-04-25T09:06:37.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.350+0000 7fb3eb400640 1 --2- 172.21.15.173:0/3984799641 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb3d4066f60 0x7fb3d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.350+0000 7fb3eb400640 1 -- 172.21.15.173:0/3984799641 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb3e011f520 con 0x7fb3f40b3e70 2024-04-25T09:06:37.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.350+0000 7fb3f3400640 1 --2- 172.21.15.173:0/3984799641 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb3d4066f60 0x7fb3d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.350+0000 7fb3f3400640 1 --2- 172.21.15.173:0/3984799641 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb3d4066f60 0x7fb3d4069420 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb3f41f8320 tx=0x7fb3e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:37.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.354+0000 7fb3eb400640 1 -- 172.21.15.173:0/3984799641 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb3e0016090 con 0x7fb3f40b3e70 2024-04-25T09:06:37.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.538+0000 7fb3fa600640 1 -- 172.21.15.173:0/3984799641 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3f4165550 con 0x7fb3f40b3e70 2024-04-25T09:06:37.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.538+0000 7fb3eb400640 1 -- 172.21.15.173:0/3984799641 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4951 (secure 0 0 0) 0x7fb3e00f0480 con 0x7fb3f40b3e70 2024-04-25T09:06:37.526 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:37.526 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":30,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:06:35.243292+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:37.526 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 30 2024-04-25T09:06:37.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.538+0000 7fb3fa600640 1 -- 172.21.15.173:0/3984799641 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb3d4066f60 msgr2=0x7fb3d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.538+0000 7fb3fa600640 1 --2- 172.21.15.173:0/3984799641 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb3d4066f60 0x7fb3d4069420 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb3f41f8320 tx=0x7fb3e4008040 comp rx=0 tx=0).stop 2024-04-25T09:06:37.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.538+0000 7fb3fa600640 1 -- 172.21.15.173:0/3984799641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3f40b3e70 msgr2=0x7fb3f4149390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.538+0000 7fb3fa600640 1 --2- 172.21.15.173:0/3984799641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3f40b3e70 0x7fb3f4149390 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00097c0 tx=0x7fb3e001acb0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.538+0000 7fb3fa600640 1 -- 172.21.15.173:0/3984799641 shutdown_connections 2024-04-25T09:06:37.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.538+0000 7fb3fa600640 1 --2- 172.21.15.173:0/3984799641 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb3d4066f60 0x7fb3d4069420 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.538+0000 7fb3fa600640 1 --2- 172.21.15.173:0/3984799641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3f415edd0 0x7fb3f414f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.538+0000 7fb3fa600640 1 --2- 172.21.15.173:0/3984799641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3f40b3e70 0x7fb3f4149390 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.538+0000 7fb3fa600640 1 --2- 172.21.15.173:0/3984799641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3f40aefa0 0x7fb3f4147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.538+0000 7fb3fa600640 1 -- 172.21.15.173:0/3984799641 >> 172.21.15.173:0/3984799641 conn(0x7fb3f406ac90 msgr2=0x7fb3f4150d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:37.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.538+0000 7fb3fa600640 1 -- 172.21.15.173:0/3984799641 shutdown_connections 2024-04-25T09:06:37.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.538+0000 7fb3fa600640 1 -- 172.21.15.173:0/3984799641 wait complete. 2024-04-25T09:06:37.547 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:37.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.694+0000 7fe3cf600640 1 Processor -- start 2024-04-25T09:06:37.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.698+0000 7fe3cf600640 1 -- start start 2024-04-25T09:06:37.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.698+0000 7fe3cf600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe3c815ba20 0x7fe3c815be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.698+0000 7fe3cf600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c815c460 con 0x7fe3c80b70f0 2024-04-25T09:06:37.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.698+0000 7fe3cf600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c815c740 con 0x7fe3c8070070 2024-04-25T09:06:37.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.698+0000 7fe3cf600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c815ca20 con 0x7fe3c815ba20 2024-04-25T09:06:37.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.698+0000 7fe3ccc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe3c815ba20 0x7fe3c815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.698+0000 7fe3ccc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe3c815ba20 0x7fe3c815be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47380/0 (socket says 172.21.15.173:47380) 2024-04-25T09:06:37.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.698+0000 7fe3ccc00640 1 -- 172.21.15.173:0/2043178910 learned_addr learned my addr 172.21.15.173:0/2043178910 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:37.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.698+0000 7fe3bfe00640 1 --1- 172.21.15.173:0/2043178910 >> v1:172.21.15.173:6789/0 conn(0x7fe3c80b70f0 0x7fe3c806f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36094/0 (socket says 172.21.15.173:36094) 2024-04-25T09:06:37.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.698+0000 7fe3ccc00640 1 -- 172.21.15.173:0/2043178910 >> v1:172.21.15.194:6789/0 conn(0x7fe3c8070070 legacy=0x7fe3c80d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:37.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.698+0000 7fe3ccc00640 1 -- 172.21.15.173:0/2043178910 >> v1:172.21.15.173:6789/0 conn(0x7fe3c80b70f0 legacy=0x7fe3c806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.698+0000 7fe3ccc00640 1 -- 172.21.15.173:0/2043178910 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c815cd00 con 0x7fe3c815ba20 2024-04-25T09:06:37.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.702+0000 7fe3ccc00640 1 --2- 172.21.15.173:0/2043178910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3c815ba20 0x7fe3c815be00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80098a0 tx=0x7fe3b801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b235738cddd45b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:37.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.702+0000 7fe3c7e00640 1 -- 172.21.15.173:0/2043178910 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b80a95f0 con 0x7fe3c815ba20 2024-04-25T09:06:37.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.702+0000 7fe3c7e00640 1 -- 172.21.15.173:0/2043178910 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b80a9790 con 0x7fe3c815ba20 2024-04-25T09:06:37.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.702+0000 7fe3c7e00640 1 -- 172.21.15.173:0/2043178910 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b80a9b60 con 0x7fe3c815ba20 2024-04-25T09:06:37.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.702+0000 7fe3cf600640 1 -- 172.21.15.173:0/2043178910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3c815ba20 msgr2=0x7fe3c815be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.702+0000 7fe3cf600640 1 --2- 172.21.15.173:0/2043178910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3c815ba20 0x7fe3c815be00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80098a0 tx=0x7fe3b801c510 comp rx=0 tx=0).stop 2024-04-25T09:06:37.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.702+0000 7fe3cf600640 1 -- 172.21.15.173:0/2043178910 shutdown_connections 2024-04-25T09:06:37.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.702+0000 7fe3cf600640 1 --2- 172.21.15.173:0/2043178910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3c815ba20 0x7fe3c815be00 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.702+0000 7fe3cf600640 1 -- 172.21.15.173:0/2043178910 >> 172.21.15.173:0/2043178910 conn(0x7fe3c8061880 msgr2=0x7fe3c8061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:37.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.702+0000 7fe3cf600640 1 -- 172.21.15.173:0/2043178910 shutdown_connections 2024-04-25T09:06:37.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.702+0000 7fe3cf600640 1 -- 172.21.15.173:0/2043178910 wait complete. 2024-04-25T09:06:37.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.702+0000 7fe3cf600640 1 Processor -- start 2024-04-25T09:06:37.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.702+0000 7fe3cf600640 1 -- start start 2024-04-25T09:06:37.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3cf600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3c8070070 0x7fe3c80caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3cf600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3c80b70f0 0x7fe3c814cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3cf600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3c815ba20 0x7fe3c80d1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3cf600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c816a0d0 con 0x7fe3c8070070 2024-04-25T09:06:37.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3cf600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c8169f50 con 0x7fe3c80b70f0 2024-04-25T09:06:37.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3cf600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c816a250 con 0x7fe3c815ba20 2024-04-25T09:06:37.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3ccc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3c8070070 0x7fe3c80caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3ccc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3c8070070 0x7fe3c80caa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47388/0 (socket says 172.21.15.173:47388) 2024-04-25T09:06:37.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3ccc00640 1 -- 172.21.15.173:0/699716386 learned_addr learned my addr 172.21.15.173:0/699716386 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:37.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3bfe00640 1 --2- 172.21.15.173:0/699716386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3c80b70f0 0x7fe3c814cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3cd600640 1 --2- 172.21.15.173:0/699716386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3c815ba20 0x7fe3c80d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3ccc00640 1 -- 172.21.15.173:0/699716386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3c815ba20 msgr2=0x7fe3c80d1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3ccc00640 1 --2- 172.21.15.173:0/699716386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3c815ba20 0x7fe3c80d1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3ccc00640 1 -- 172.21.15.173:0/699716386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3c80b70f0 msgr2=0x7fe3c814cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3ccc00640 1 --2- 172.21.15.173:0/699716386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3c80b70f0 0x7fe3c814cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3ccc00640 1 -- 172.21.15.173:0/699716386 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8164760 con 0x7fe3c8070070 2024-04-25T09:06:37.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3ccc00640 1 --2- 172.21.15.173:0/699716386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3c8070070 0x7fe3c80caa30 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe3b801a140 tx=0x7fe3b80192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:37.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3c5600640 1 -- 172.21.15.173:0/699716386 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b80b18c0 con 0x7fe3c8070070 2024-04-25T09:06:37.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3c5600640 1 -- 172.21.15.173:0/699716386 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b80b1a80 con 0x7fe3c8070070 2024-04-25T09:06:37.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3cf600640 1 -- 172.21.15.173:0/699716386 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c8164a40 con 0x7fe3c8070070 2024-04-25T09:06:37.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3c5600640 1 -- 172.21.15.173:0/699716386 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b80bb3f0 con 0x7fe3c8070070 2024-04-25T09:06:37.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3cf600640 1 -- 172.21.15.173:0/699716386 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c8165000 con 0x7fe3c8070070 2024-04-25T09:06:37.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3cf600640 1 -- 172.21.15.173:0/699716386 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c8073a40 con 0x7fe3c8070070 2024-04-25T09:06:37.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.706+0000 7fe3c5600640 1 -- 172.21.15.173:0/699716386 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe3b80bb590 con 0x7fe3c8070070 2024-04-25T09:06:37.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.710+0000 7fe3c5600640 1 --2- 172.21.15.173:0/699716386 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe3a4066f60 0x7fe3a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.710+0000 7fe3c5600640 1 -- 172.21.15.173:0/699716386 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe3b811fae0 con 0x7fe3c8070070 2024-04-25T09:06:37.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.710+0000 7fe3bfe00640 1 --2- 172.21.15.173:0/699716386 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe3a4066f60 0x7fe3a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.710+0000 7fe3bfe00640 1 --2- 172.21.15.173:0/699716386 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe3a4066f60 0x7fe3a4069420 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe3c815ad10 tx=0x7fe3b0007e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:37.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.710+0000 7fe3c5600640 1 -- 172.21.15.173:0/699716386 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe3b80ad020 con 0x7fe3c8070070 2024-04-25T09:06:37.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.898+0000 7fe3cf600640 1 -- 172.21.15.173:0/699716386 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3c80cefc0 con 0x7fe3c8070070 2024-04-25T09:06:37.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.898+0000 7fe3c5600640 1 -- 172.21.15.173:0/699716386 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4951 (secure 0 0 0) 0x7fe3b8016130 con 0x7fe3c8070070 2024-04-25T09:06:37.887 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:37.887 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":30,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:54.582822+0000","modified":"2024-04-25T09:06:35.243292+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5874":{"gid":5874,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.173:6837/3298938023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3298938023},{"type":"v1","addr":"172.21.15.173:6837","nonce":3298938023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:37.887 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 30 2024-04-25T09:06:37.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.898+0000 7fe3cf600640 1 -- 172.21.15.173:0/699716386 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe3a4066f60 msgr2=0x7fe3a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.898+0000 7fe3cf600640 1 --2- 172.21.15.173:0/699716386 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe3a4066f60 0x7fe3a4069420 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe3c815ad10 tx=0x7fe3b0007e50 comp rx=0 tx=0).stop 2024-04-25T09:06:37.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.898+0000 7fe3cf600640 1 -- 172.21.15.173:0/699716386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3c8070070 msgr2=0x7fe3c80caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.898+0000 7fe3cf600640 1 --2- 172.21.15.173:0/699716386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3c8070070 0x7fe3c80caa30 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe3b801a140 tx=0x7fe3b80192b0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.898+0000 7fe3cf600640 1 -- 172.21.15.173:0/699716386 shutdown_connections 2024-04-25T09:06:37.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.898+0000 7fe3cf600640 1 --2- 172.21.15.173:0/699716386 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe3a4066f60 0x7fe3a4069420 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.898+0000 7fe3cf600640 1 --2- 172.21.15.173:0/699716386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3c815ba20 0x7fe3c80d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.898+0000 7fe3cf600640 1 --2- 172.21.15.173:0/699716386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3c80b70f0 0x7fe3c814cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.898+0000 7fe3cf600640 1 --2- 172.21.15.173:0/699716386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3c8070070 0x7fe3c80caa30 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.902+0000 7fe3cf600640 1 -- 172.21.15.173:0/699716386 >> 172.21.15.173:0/699716386 conn(0x7fe3c8061880 msgr2=0x7fe3c81669e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:37.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.902+0000 7fe3cf600640 1 -- 172.21.15.173:0/699716386 shutdown_connections 2024-04-25T09:06:37.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:37.902+0000 7fe3cf600640 1 -- 172.21.15.173:0/699716386 wait complete. 2024-04-25T09:06:37.908 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:38.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.054+0000 7f8268e00640 1 Processor -- start 2024-04-25T09:06:38.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.054+0000 7f8268e00640 1 -- start start 2024-04-25T09:06:38.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8268e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8264157f00 0x7f82640b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8268e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82640b36c0 0x7f826406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8268e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826415e010 con 0x7f826406ac90 2024-04-25T09:06:38.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8268e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82640b55b0 con 0x7f8264157f00 2024-04-25T09:06:38.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8268e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82640b57e0 con 0x7f82640b36c0 2024-04-25T09:06:38.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8262800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f826406ac90 0x7f826415e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36100/0 (socket says 172.21.15.173:36100) 2024-04-25T09:06:38.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8262800640 1 -- 172.21.15.173:0/3772330188 learned_addr learned my addr 172.21.15.173:0/3772330188 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:38.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8261e00640 1 --2- 172.21.15.173:0/3772330188 >> v2:172.21.15.194:3300/0 conn(0x7f8264157f00 0x7f82640b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8261400640 1 --2- 172.21.15.173:0/3772330188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82640b36c0 0x7f826406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8260a00640 1 -- 172.21.15.173:0/3772330188 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942622766 0 0) 0x7f826415e010 con 0x7f826406ac90 2024-04-25T09:06:38.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8260a00640 1 -- 172.21.15.173:0/3772330188 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8248003530 con 0x7f826406ac90 2024-04-25T09:06:38.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8260a00640 1 -- 172.21.15.173:0/3772330188 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1496372804 0 0) 0x7f8248003530 con 0x7f826406ac90 2024-04-25T09:06:38.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8260a00640 1 -- 172.21.15.173:0/3772330188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82640b36c0 msgr2=0x7f826406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:38.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8260a00640 1 --2- 172.21.15.173:0/3772330188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82640b36c0 0x7f826406e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8260a00640 1 -- 172.21.15.173:0/3772330188 >> v2:172.21.15.194:3300/0 conn(0x7f8264157f00 msgr2=0x7f82640b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:38.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8260a00640 1 --2- 172.21.15.173:0/3772330188 >> v2:172.21.15.194:3300/0 conn(0x7f8264157f00 0x7f82640b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8260a00640 1 -- 172.21.15.173:0/3772330188 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826406fe90 con 0x7f826406ac90 2024-04-25T09:06:38.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8260a00640 1 -- 172.21.15.173:0/3772330188 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f825c001680 con 0x7f826406ac90 2024-04-25T09:06:38.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8260a00640 1 -- 172.21.15.173:0/3772330188 >> v1:172.21.15.173:6789/0 conn(0x7f826406ac90 legacy=0x7f826415e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8260a00640 1 --2- 172.21.15.173:0/3772330188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82640b36c0 0x7f82480039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8260a00640 1 --2- 172.21.15.173:0/3772330188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8248003f40 0x7f8248004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8260a00640 1 --2- 172.21.15.173:0/3772330188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8248004d50 0x7f82480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8260a00640 1 -- 172.21.15.173:0/3772330188 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82640b57e0 con 0x7f8248003f40 2024-04-25T09:06:38.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8260a00640 1 -- 172.21.15.173:0/3772330188 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824800b9d0 con 0x7f8248004d50 2024-04-25T09:06:38.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8260a00640 1 -- 172.21.15.173:0/3772330188 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824800bb50 con 0x7f82640b36c0 2024-04-25T09:06:38.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8261400640 1 --2- 172.21.15.173:0/3772330188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8248003f40 0x7f8248004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8261e00640 1 --2- 172.21.15.173:0/3772330188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82640b36c0 0x7f82480039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8262800640 1 --2- 172.21.15.173:0/3772330188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8248004d50 0x7f82480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8261400640 1 -- 172.21.15.173:0/3772330188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82640b36c0 msgr2=0x7f82480039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:38.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8261400640 1 --2- 172.21.15.173:0/3772330188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82640b36c0 0x7f82480039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8261400640 1 -- 172.21.15.173:0/3772330188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8248004d50 msgr2=0x7f82480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:38.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8261400640 1 --2- 172.21.15.173:0/3772330188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8248004d50 0x7f82480051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8261400640 1 -- 172.21.15.173:0/3772330188 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8248003530 con 0x7f8248003f40 2024-04-25T09:06:38.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.058+0000 7f8262800640 1 --2- 172.21.15.173:0/3772330188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8248004d50 0x7f82480051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:38.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.062+0000 7f8261400640 1 --2- 172.21.15.173:0/3772330188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8248003f40 0x7f8248004810 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8250009ae0 tx=0x7f825001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1535094c48016a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.062+0000 7f8260a00640 1 -- 172.21.15.173:0/3772330188 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82500b2070 con 0x7f8248003f40 2024-04-25T09:06:38.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.062+0000 7f8260a00640 1 -- 172.21.15.173:0/3772330188 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82500a5660 con 0x7f8248003f40 2024-04-25T09:06:38.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.062+0000 7f8260a00640 1 -- 172.21.15.173:0/3772330188 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82500096b0 con 0x7f8248003f40 2024-04-25T09:06:38.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.062+0000 7f8268e00640 1 -- 172.21.15.173:0/3772330188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8248003f40 msgr2=0x7f8248004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.062+0000 7f8268e00640 1 --2- 172.21.15.173:0/3772330188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8248003f40 0x7f8248004810 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8250009ae0 tx=0x7f825001ca10 comp rx=0 tx=0).stop 2024-04-25T09:06:38.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.062+0000 7f8262800640 1 -- 172.21.15.173:0/3772330188 reap_dead start 2024-04-25T09:06:38.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.062+0000 7f8268e00640 1 -- 172.21.15.173:0/3772330188 shutdown_connections 2024-04-25T09:06:38.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.062+0000 7f8268e00640 1 -- 172.21.15.173:0/3772330188 >> 172.21.15.173:0/3772330188 conn(0x7f8264099a50 msgr2=0x7f82640b5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:38.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.062+0000 7f8268e00640 1 -- 172.21.15.173:0/3772330188 shutdown_connections 2024-04-25T09:06:38.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.062+0000 7f8268e00640 1 -- 172.21.15.173:0/3772330188 wait complete. 2024-04-25T09:06:38.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.062+0000 7f8268e00640 1 Processor -- start 2024-04-25T09:06:38.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.062+0000 7f8268e00640 1 -- start start 2024-04-25T09:06:38.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8268e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8248003f40 0x7f826414b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8268e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f826414baa0 0x7f82640b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8268e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82640b24e0 0x7f826409bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8268e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82640b3b40 con 0x7f82640b24e0 2024-04-25T09:06:38.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8268e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8264070450 con 0x7f826414baa0 2024-04-25T09:06:38.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8268e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82641582e0 con 0x7f8248003f40 2024-04-25T09:06:38.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8262800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82640b24e0 0x7f826409bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8262800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82640b24e0 0x7f826409bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47400/0 (socket says 172.21.15.173:47400) 2024-04-25T09:06:38.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8262800640 1 -- 172.21.15.173:0/2378056782 learned_addr learned my addr 172.21.15.173:0/2378056782 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:38.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8261e00640 1 --2- 172.21.15.173:0/2378056782 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8248003f40 0x7f826414b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8261400640 1 --2- 172.21.15.173:0/2378056782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f826414baa0 0x7f82640b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8262800640 1 -- 172.21.15.173:0/2378056782 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8248003f40 msgr2=0x7f826414b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8262800640 1 --2- 172.21.15.173:0/2378056782 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8248003f40 0x7f826414b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8262800640 1 -- 172.21.15.173:0/2378056782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f826414baa0 msgr2=0x7f82640b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8262800640 1 --2- 172.21.15.173:0/2378056782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f826414baa0 0x7f82640b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8262800640 1 -- 172.21.15.173:0/2378056782 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82640b2c60 con 0x7f82640b24e0 2024-04-25T09:06:38.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8262800640 1 --2- 172.21.15.173:0/2378056782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82640b24e0 0x7f826409bd10 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8264070ea0 tx=0x7f825c0119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f825a000640 1 -- 172.21.15.173:0/2378056782 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c010040 con 0x7f82640b24e0 2024-04-25T09:06:38.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f825a000640 1 -- 172.21.15.173:0/2378056782 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c01a070 con 0x7f82640b24e0 2024-04-25T09:06:38.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8268e00640 1 -- 172.21.15.173:0/2378056782 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82640af2d0 con 0x7f82640b24e0 2024-04-25T09:06:38.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f825a000640 1 -- 172.21.15.173:0/2378056782 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c0139e0 con 0x7f82640b24e0 2024-04-25T09:06:38.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8268e00640 1 -- 172.21.15.173:0/2378056782 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82640af570 con 0x7f82640b24e0 2024-04-25T09:06:38.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.066+0000 7f8268e00640 1 -- 172.21.15.173:0/2378056782 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8264073a40 con 0x7f82640b24e0 2024-04-25T09:06:38.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.070+0000 7f825a000640 1 -- 172.21.15.173:0/2378056782 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f825c013b80 con 0x7f82640b24e0 2024-04-25T09:06:38.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.070+0000 7f825a000640 1 --2- 172.21.15.173:0/2378056782 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8244066f60 0x7f8244069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.070+0000 7f825a000640 1 -- 172.21.15.173:0/2378056782 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f825c087f20 con 0x7f82640b24e0 2024-04-25T09:06:38.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.070+0000 7f8261e00640 1 --2- 172.21.15.173:0/2378056782 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8244066f60 0x7f8244069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.070+0000 7f8261e00640 1 --2- 172.21.15.173:0/2378056782 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8244066f60 0x7f8244069420 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8254014510 tx=0x7f825400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.074+0000 7f825a000640 1 -- 172.21.15.173:0/2378056782 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f825c0587b0 con 0x7f82640b24e0 2024-04-25T09:06:38.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.226+0000 7f8268e00640 1 -- 172.21.15.173:0/2378056782 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f826406f600 con 0x7f82640b24e0 2024-04-25T09:06:38.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.230+0000 7f825a000640 1 -- 172.21.15.173:0/2378056782 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+17098 (secure 0 0 0) 0x7f825c05c850 con 0x7f82640b24e0 2024-04-25T09:06:38.218 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:38.218 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":58,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:06:33.651218+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:52.287873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:53.577379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1f","mappings":[{"from":0,"to":6}]},{"pgid":"8.28","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:38.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.230+0000 7f8268e00640 1 -- 172.21.15.173:0/2378056782 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8244066f60 msgr2=0x7f8244069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.230+0000 7f8268e00640 1 --2- 172.21.15.173:0/2378056782 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8244066f60 0x7f8244069420 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8254014510 tx=0x7f825400b040 comp rx=0 tx=0).stop 2024-04-25T09:06:38.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.230+0000 7f8268e00640 1 -- 172.21.15.173:0/2378056782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82640b24e0 msgr2=0x7f826409bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.230+0000 7f8268e00640 1 --2- 172.21.15.173:0/2378056782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82640b24e0 0x7f826409bd10 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8264070ea0 tx=0x7f825c0119f0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.230+0000 7f8268e00640 1 -- 172.21.15.173:0/2378056782 shutdown_connections 2024-04-25T09:06:38.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.230+0000 7f8268e00640 1 --2- 172.21.15.173:0/2378056782 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8244066f60 0x7f8244069420 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.230+0000 7f8268e00640 1 --2- 172.21.15.173:0/2378056782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82640b24e0 0x7f826409bd10 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.230+0000 7f8268e00640 1 --2- 172.21.15.173:0/2378056782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f826414baa0 0x7f82640b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.230+0000 7f8268e00640 1 --2- 172.21.15.173:0/2378056782 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8248003f40 0x7f826414b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.230+0000 7f8268e00640 1 -- 172.21.15.173:0/2378056782 >> 172.21.15.173:0/2378056782 conn(0x7f8264099a50 msgr2=0x7f826415a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:38.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.230+0000 7f8268e00640 1 -- 172.21.15.173:0/2378056782 shutdown_connections 2024-04-25T09:06:38.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.230+0000 7f8268e00640 1 -- 172.21.15.173:0/2378056782 wait complete. 2024-04-25T09:06:38.240 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:06:38.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.386+0000 7f4653600640 1 Processor -- start 2024-04-25T09:06:38.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.386+0000 7f4653600640 1 -- start start 2024-04-25T09:06:38.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.390+0000 7f4653600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f464c145290 0x7f464c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.390+0000 7f4653600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f464c0b3fe0 0x7f464c0b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.390+0000 7f4653600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464c15c5f0 con 0x7f464c0cc260 2024-04-25T09:06:38.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.390+0000 7f4653600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464c06d4b0 con 0x7f464c0b3fe0 2024-04-25T09:06:38.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.390+0000 7f4653600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c06d790 con 0x7f464c145290 2024-04-25T09:06:38.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.390+0000 7f4651600640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f464c0cc260 0x7f464c0cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36106/0 (socket says 172.21.15.173:36106) 2024-04-25T09:06:38.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.390+0000 7f4651600640 1 -- 172.21.15.173:0/4060747047 learned_addr learned my addr 172.21.15.173:0/4060747047 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:38.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.390+0000 7f4650c00640 1 --2- 172.21.15.173:0/4060747047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f464c145290 0x7f464c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.390+0000 7f4643e00640 1 --2- 172.21.15.173:0/4060747047 >> v2:172.21.15.194:3300/0 conn(0x7f464c0b3fe0 0x7f464c0b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.390+0000 7f464be00640 1 -- 172.21.15.173:0/4060747047 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631964502 0 0) 0x7f46440014a0 con 0x7f464c0cc260 2024-04-25T09:06:38.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.390+0000 7f464be00640 1 -- 172.21.15.173:0/4060747047 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4630003530 con 0x7f464c0cc260 2024-04-25T09:06:38.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.390+0000 7f4650c00640 1 -- 172.21.15.173:0/4060747047 >> v2:172.21.15.194:3300/0 conn(0x7f464c0b3fe0 msgr2=0x7f464c0b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:38.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.390+0000 7f4650c00640 1 --2- 172.21.15.173:0/4060747047 >> v2:172.21.15.194:3300/0 conn(0x7f464c0b3fe0 0x7f464c0b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.390+0000 7f4650c00640 1 -- 172.21.15.173:0/4060747047 >> v1:172.21.15.173:6789/0 conn(0x7f464c0cc260 legacy=0x7f464c0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.390+0000 7f4650c00640 1 -- 172.21.15.173:0/4060747047 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c06da70 con 0x7f464c145290 2024-04-25T09:06:38.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.394+0000 7f4650c00640 1 --2- 172.21.15.173:0/4060747047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f464c145290 0x7f464c15c0b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f463c0097c0 tx=0x7f463c01c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a79cb535a41d3a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.394+0000 7f464be00640 1 -- 172.21.15.173:0/4060747047 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c0b0070 con 0x7f464c145290 2024-04-25T09:06:38.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.394+0000 7f464be00640 1 -- 172.21.15.173:0/4060747047 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c0ab600 con 0x7f464c145290 2024-04-25T09:06:38.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.394+0000 7f464be00640 1 -- 172.21.15.173:0/4060747047 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c0ab9d0 con 0x7f464c145290 2024-04-25T09:06:38.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.394+0000 7f4653600640 1 -- 172.21.15.173:0/4060747047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f464c145290 msgr2=0x7f464c15c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.394+0000 7f4653600640 1 --2- 172.21.15.173:0/4060747047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f464c145290 0x7f464c15c0b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f463c0097c0 tx=0x7f463c01c380 comp rx=0 tx=0).stop 2024-04-25T09:06:38.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.394+0000 7f4653600640 1 -- 172.21.15.173:0/4060747047 shutdown_connections 2024-04-25T09:06:38.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.394+0000 7f4653600640 1 --2- 172.21.15.173:0/4060747047 >> v2:172.21.15.194:3300/0 conn(0x7f464c0b3fe0 0x7f464c0b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.394+0000 7f4653600640 1 --2- 172.21.15.173:0/4060747047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f464c145290 0x7f464c15c0b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.394+0000 7f4653600640 1 -- 172.21.15.173:0/4060747047 >> 172.21.15.173:0/4060747047 conn(0x7f464c06ac90 msgr2=0x7f464c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:38.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.394+0000 7f4653600640 1 -- 172.21.15.173:0/4060747047 shutdown_connections 2024-04-25T09:06:38.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.394+0000 7f4653600640 1 -- 172.21.15.173:0/4060747047 wait complete. 2024-04-25T09:06:38.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.394+0000 7f4653600640 1 Processor -- start 2024-04-25T09:06:38.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.394+0000 7f4653600640 1 -- start start 2024-04-25T09:06:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4653600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f464c0b3fe0 0x7f464c13f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4653600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f464c0cc260 0x7f464c15a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4653600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f464c145290 0x7f464c0ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4653600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c06eee0 con 0x7f464c0cc260 2024-04-25T09:06:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4653600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c06ed60 con 0x7f464c145290 2024-04-25T09:06:38.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4653600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c06f060 con 0x7f464c0b3fe0 2024-04-25T09:06:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4643e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f464c0cc260 0x7f464c15a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4643e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f464c0cc260 0x7f464c15a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47406/0 (socket says 172.21.15.173:47406) 2024-04-25T09:06:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4643e00640 1 -- 172.21.15.173:0/1527461273 learned_addr learned my addr 172.21.15.173:0/1527461273 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4650c00640 1 --2- 172.21.15.173:0/1527461273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f464c0b3fe0 0x7f464c13f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4651600640 1 --2- 172.21.15.173:0/1527461273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f464c145290 0x7f464c0ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4643e00640 1 -- 172.21.15.173:0/1527461273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f464c0b3fe0 msgr2=0x7f464c13f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4643e00640 1 --2- 172.21.15.173:0/1527461273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f464c0b3fe0 0x7f464c13f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4643e00640 1 -- 172.21.15.173:0/1527461273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f464c145290 msgr2=0x7f464c0ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4643e00640 1 --2- 172.21.15.173:0/1527461273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f464c145290 0x7f464c0ad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4643e00640 1 -- 172.21.15.173:0/1527461273 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c13e480 con 0x7f464c0cc260 2024-04-25T09:06:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4643e00640 1 --2- 172.21.15.173:0/1527461273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f464c0cc260 0x7f464c15a8a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f463400e870 tx=0x7f463400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4649600640 1 -- 172.21.15.173:0/1527461273 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634017070 con 0x7f464c0cc260 2024-04-25T09:06:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4649600640 1 -- 172.21.15.173:0/1527461273 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463400c940 con 0x7f464c0cc260 2024-04-25T09:06:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4649600640 1 -- 172.21.15.173:0/1527461273 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463400ccf0 con 0x7f464c0cc260 2024-04-25T09:06:38.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4653600640 1 -- 172.21.15.173:0/1527461273 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464c13e760 con 0x7f464c0cc260 2024-04-25T09:06:38.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4653600640 1 -- 172.21.15.173:0/1527461273 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c13ed20 con 0x7f464c0cc260 2024-04-25T09:06:38.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4653600640 1 -- 172.21.15.173:0/1527461273 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464c073ab0 con 0x7f464c0cc260 2024-04-25T09:06:38.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.398+0000 7f4649600640 1 -- 172.21.15.173:0/1527461273 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f463401a070 con 0x7f464c0cc260 2024-04-25T09:06:38.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.402+0000 7f4649600640 1 --2- 172.21.15.173:0/1527461273 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4628066f60 0x7f4628069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.402+0000 7f4649600640 1 -- 172.21.15.173:0/1527461273 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f4634085490 con 0x7f464c0cc260 2024-04-25T09:06:38.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.402+0000 7f4650c00640 1 --2- 172.21.15.173:0/1527461273 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4628066f60 0x7f4628069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.402+0000 7f4650c00640 1 --2- 172.21.15.173:0/1527461273 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4628066f60 0x7f4628069420 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f463c0ad000 tx=0x7f463c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.406+0000 7f4649600640 1 -- 172.21.15.173:0/1527461273 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f46340562c0 con 0x7f464c0cc260 2024-04-25T09:06:38.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.586+0000 7f4653600640 1 -- 172.21.15.173:0/1527461273 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f464c1442a0 con 0x7f464c0cc260 2024-04-25T09:06:38.577 INFO:tasks.ceph.mon.a.smithi173.stderr:2024-04-25T09:06:38.590+0000 7f537be00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:06:38.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.590+0000 7f4649600640 1 -- 172.21.15.173:0/1527461273 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4634055bc0 con 0x7f464c0cc260 2024-04-25T09:06:38.579 INFO:teuthology.orchestra.run.smithi173.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:06:38.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.594+0000 7f4653600640 1 -- 172.21.15.173:0/1527461273 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4628066f60 msgr2=0x7f4628069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.594+0000 7f4653600640 1 --2- 172.21.15.173:0/1527461273 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4628066f60 0x7f4628069420 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f463c0ad000 tx=0x7f463c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:06:38.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.594+0000 7f4653600640 1 -- 172.21.15.173:0/1527461273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f464c0cc260 msgr2=0x7f464c15a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.594+0000 7f4653600640 1 --2- 172.21.15.173:0/1527461273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f464c0cc260 0x7f464c15a8a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f463400e870 tx=0x7f463400ec70 comp rx=0 tx=0).stop 2024-04-25T09:06:38.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.594+0000 7f4653600640 1 -- 172.21.15.173:0/1527461273 shutdown_connections 2024-04-25T09:06:38.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.594+0000 7f4653600640 1 --2- 172.21.15.173:0/1527461273 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4628066f60 0x7f4628069420 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.594+0000 7f4653600640 1 --2- 172.21.15.173:0/1527461273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f464c145290 0x7f464c0ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.594+0000 7f4653600640 1 --2- 172.21.15.173:0/1527461273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f464c0cc260 0x7f464c15a8a0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.594+0000 7f4653600640 1 --2- 172.21.15.173:0/1527461273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f464c0b3fe0 0x7f464c13f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.594+0000 7f4653600640 1 -- 172.21.15.173:0/1527461273 >> 172.21.15.173:0/1527461273 conn(0x7f464c06ac90 msgr2=0x7f464c143410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:38.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.594+0000 7f4653600640 1 -- 172.21.15.173:0/1527461273 shutdown_connections 2024-04-25T09:06:38.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.594+0000 7f4653600640 1 -- 172.21.15.173:0/1527461273 wait complete. 2024-04-25T09:06:38.603 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:06:38.657 INFO:tasks.ceph.mds.a.smithi173.stdout:starting mds.a at 2024-04-25T09:06:38.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.762+0000 7f43e5a00640 1 Processor -- start 2024-04-25T09:06:38.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.762+0000 7f43e5a00640 1 -- start start 2024-04-25T09:06:38.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.762+0000 7f43e5a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e00cc7e0 0x7f43e00cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.762+0000 7f43e5a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f43e00aef70 0x7f43e00ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.762+0000 7f43e5a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e0071570 con 0x7f43e00aeb90 2024-04-25T09:06:38.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.762+0000 7f43e5a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e0071320 con 0x7f43e00aef70 2024-04-25T09:06:38.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.762+0000 7f43e5a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e0072330 con 0x7f43e00cc7e0 2024-04-25T09:06:38.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.762+0000 7f43df400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f43e00aef70 0x7f43e00ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.762+0000 7f43df400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f43e00aef70 0x7f43e00ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47430/0 (socket says 172.21.15.173:47430) 2024-04-25T09:06:38.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.762+0000 7f43df400640 1 -- 172.21.15.173:0/544629396 learned_addr learned my addr 172.21.15.173:0/544629396 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:38.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.762+0000 7f43de000640 1 --2- 172.21.15.173:0/544629396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e00cc7e0 0x7f43e00cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.762+0000 7f43df400640 1 -- 172.21.15.173:0/544629396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e00cc7e0 msgr2=0x7f43e00cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:38.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.762+0000 7f43df400640 1 --2- 172.21.15.173:0/544629396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e00cc7e0 0x7f43e00cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.762+0000 7f43df400640 1 -- 172.21.15.173:0/544629396 >> v1:172.21.15.194:6789/0 conn(0x7f43e00aeb90 legacy=0x7f43e00cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.762+0000 7f43df400640 1 -- 172.21.15.173:0/544629396 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e0071850 con 0x7f43e00aef70 2024-04-25T09:06:38.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.762+0000 7f43dd600640 1 -- 172.21.15.173:0/544629396 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877205652 0 0) 0x7f43e0071570 con 0x7f43e00aeb90 2024-04-25T09:06:38.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.766+0000 7f43df400640 1 --2- 172.21.15.173:0/544629396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e00aef70 0x7f43e00ce0e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f43d8009870 tx=0x7f43d801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5cc8380d48e3b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.766+0000 7f43dd600640 1 -- 172.21.15.173:0/544629396 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d80b0070 con 0x7f43e00aef70 2024-04-25T09:06:38.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.766+0000 7f43dd600640 1 -- 172.21.15.173:0/544629396 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d80ab600 con 0x7f43e00aef70 2024-04-25T09:06:38.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.766+0000 7f43dd600640 1 -- 172.21.15.173:0/544629396 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d80ab9d0 con 0x7f43e00aef70 2024-04-25T09:06:38.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.766+0000 7f43e5a00640 1 -- 172.21.15.173:0/544629396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e00aef70 msgr2=0x7f43e00ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.766+0000 7f43e5a00640 1 --2- 172.21.15.173:0/544629396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e00aef70 0x7f43e00ce0e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f43d8009870 tx=0x7f43d801c4d0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.766+0000 7f43e5a00640 1 -- 172.21.15.173:0/544629396 shutdown_connections 2024-04-25T09:06:38.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.766+0000 7f43e5a00640 1 --2- 172.21.15.173:0/544629396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e00cc7e0 0x7f43e00cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.766+0000 7f43e5a00640 1 --2- 172.21.15.173:0/544629396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e00aef70 0x7f43e00ce0e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.766+0000 7f43e5a00640 1 -- 172.21.15.173:0/544629396 >> 172.21.15.173:0/544629396 conn(0x7f43e006ac90 msgr2=0x7f43e006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:38.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.766+0000 7f43e5a00640 1 -- 172.21.15.173:0/544629396 shutdown_connections 2024-04-25T09:06:38.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.766+0000 7f43e5a00640 1 -- 172.21.15.173:0/544629396 wait complete. 2024-04-25T09:06:38.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43e5a00640 1 Processor -- start 2024-04-25T09:06:38.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43e5a00640 1 -- start start 2024-04-25T09:06:38.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43e5a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e00aeb90 0x7f43e014b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43e5a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e00aef70 0x7f43e01682f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43e5a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43e00cc7e0 0x7f43e0138fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43e5a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e015bb30 con 0x7f43e00aeb90 2024-04-25T09:06:38.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43e5a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e015b9b0 con 0x7f43e00cc7e0 2024-04-25T09:06:38.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43e5a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e015bcb0 con 0x7f43e00aef70 2024-04-25T09:06:38.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43dea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e00aeb90 0x7f43e014b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43dea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e00aeb90 0x7f43e014b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47446/0 (socket says 172.21.15.173:47446) 2024-04-25T09:06:38.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43dea00640 1 -- 172.21.15.173:0/1760631983 learned_addr learned my addr 172.21.15.173:0/1760631983 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:38.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43de000640 1 --2- 172.21.15.173:0/1760631983 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e00aef70 0x7f43e01682f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43df400640 1 --2- 172.21.15.173:0/1760631983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43e00cc7e0 0x7f43e0138fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43dea00640 1 -- 172.21.15.173:0/1760631983 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e00aef70 msgr2=0x7f43e01682f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43dea00640 1 --2- 172.21.15.173:0/1760631983 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e00aef70 0x7f43e01682f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43dea00640 1 -- 172.21.15.173:0/1760631983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43e00cc7e0 msgr2=0x7f43e0138fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43dea00640 1 --2- 172.21.15.173:0/1760631983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43e00cc7e0 0x7f43e0138fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43dea00640 1 -- 172.21.15.173:0/1760631983 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e00ccff0 con 0x7f43e00aeb90 2024-04-25T09:06:38.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43df400640 1 --2- 172.21.15.173:0/1760631983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43e00cc7e0 0x7f43e0138fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:38.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43dea00640 1 --2- 172.21.15.173:0/1760631983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e00aeb90 0x7f43e014b620 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f43d000c7a0 tx=0x7f43d000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43d6a00640 1 -- 172.21.15.173:0/1760631983 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d0017070 con 0x7f43e00aeb90 2024-04-25T09:06:38.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43d6a00640 1 -- 172.21.15.173:0/1760631983 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d0003db0 con 0x7f43e00aeb90 2024-04-25T09:06:38.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43e5a00640 1 -- 172.21.15.173:0/1760631983 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e01546a0 con 0x7f43e00aeb90 2024-04-25T09:06:38.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43d6a00640 1 -- 172.21.15.173:0/1760631983 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d0005270 con 0x7f43e00aeb90 2024-04-25T09:06:38.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43e5a00640 1 -- 172.21.15.173:0/1760631983 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e014b100 con 0x7f43e00aeb90 2024-04-25T09:06:38.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.770+0000 7f43e5a00640 1 -- 172.21.15.173:0/1760631983 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e0073ab0 con 0x7f43e00aeb90 2024-04-25T09:06:38.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.774+0000 7f43d6a00640 1 -- 172.21.15.173:0/1760631983 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f43d001a070 con 0x7f43e00aeb90 2024-04-25T09:06:38.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.774+0000 7f43d6a00640 1 --2- 172.21.15.173:0/1760631983 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f43c0066f60 0x7f43c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.774+0000 7f43d6a00640 1 -- 172.21.15.173:0/1760631983 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f43d00847a0 con 0x7f43e00aeb90 2024-04-25T09:06:38.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.774+0000 7f43de000640 1 --2- 172.21.15.173:0/1760631983 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f43c0066f60 0x7f43c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.774+0000 7f43de000640 1 --2- 172.21.15.173:0/1760631983 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f43c0066f60 0x7f43c0069420 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f43e0168180 tx=0x7f43cc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.778+0000 7f43d6a00640 1 -- 172.21.15.173:0/1760631983 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f43d0054f20 con 0x7f43e00aeb90 2024-04-25T09:06:38.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:38.970+0000 7f43e5a00640 1 -- 172.21.15.173:0/1760631983 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f43e00cd610 con 0x7f43e00aeb90 2024-04-25T09:06:39.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.682+0000 7f43d6a00640 1 -- 172.21.15.173:0/1760631983 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7f43d0058fc0 con 0x7f43e00aeb90 2024-04-25T09:06:39.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.682+0000 7f43e5a00640 1 -- 172.21.15.173:0/1760631983 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f43c0066f60 msgr2=0x7f43c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.682+0000 7f43e5a00640 1 --2- 172.21.15.173:0/1760631983 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f43c0066f60 0x7f43c0069420 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f43e0168180 tx=0x7f43cc009190 comp rx=0 tx=0).stop 2024-04-25T09:06:39.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.686+0000 7f43e5a00640 1 -- 172.21.15.173:0/1760631983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e00aeb90 msgr2=0x7f43e014b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.686+0000 7f43e5a00640 1 --2- 172.21.15.173:0/1760631983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e00aeb90 0x7f43e014b620 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f43d000c7a0 tx=0x7f43d000cc60 comp rx=0 tx=0).stop 2024-04-25T09:06:39.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.686+0000 7f43e5a00640 1 -- 172.21.15.173:0/1760631983 shutdown_connections 2024-04-25T09:06:39.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.686+0000 7f43e5a00640 1 --2- 172.21.15.173:0/1760631983 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f43c0066f60 0x7f43c0069420 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.686+0000 7f43e5a00640 1 --2- 172.21.15.173:0/1760631983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43e00cc7e0 0x7f43e0138fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.686+0000 7f43e5a00640 1 --2- 172.21.15.173:0/1760631983 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e00aef70 0x7f43e01682f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.686+0000 7f43e5a00640 1 --2- 172.21.15.173:0/1760631983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43e00aeb90 0x7f43e014b620 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.686+0000 7f43e5a00640 1 -- 172.21.15.173:0/1760631983 >> 172.21.15.173:0/1760631983 conn(0x7f43e006ac90 msgr2=0x7f43e015cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:39.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.686+0000 7f43e5a00640 1 -- 172.21.15.173:0/1760631983 shutdown_connections 2024-04-25T09:06:39.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.686+0000 7f43e5a00640 1 -- 172.21.15.173:0/1760631983 wait complete. 2024-04-25T09:06:39.695 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:06:39.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.846+0000 7f04bd200640 1 Processor -- start 2024-04-25T09:06:39.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.846+0000 7f04bd200640 1 -- start start 2024-04-25T09:06:39.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.850+0000 7f04bd200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f04b806d6d0 0x7f04b80cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.850+0000 7f04bd200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04b8071270 0x7f04b80cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.850+0000 7f04bd200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b80d06f0 con 0x7f04b815db40 2024-04-25T09:06:39.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.850+0000 7f04bd200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b80cd910 con 0x7f04b806d6d0 2024-04-25T09:06:39.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.850+0000 7f04bd200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b80d1300 con 0x7f04b8071270 2024-04-25T09:06:39.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.850+0000 7f04ad400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f04b806d6d0 0x7f04b80cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.850+0000 7f04ad400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f04b806d6d0 0x7f04b80cb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47454/0 (socket says 172.21.15.173:47454) 2024-04-25T09:06:39.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.850+0000 7f04ad400640 1 -- 172.21.15.173:0/3503302920 learned_addr learned my addr 172.21.15.173:0/3503302920 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:39.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.850+0000 7f04b6800640 1 --2- 172.21.15.173:0/3503302920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04b8071270 0x7f04b80cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.850+0000 7f04ad400640 1 -- 172.21.15.173:0/3503302920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04b8071270 msgr2=0x7f04b80cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:39.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.850+0000 7f04ad400640 1 --2- 172.21.15.173:0/3503302920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04b8071270 0x7f04b80cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.850+0000 7f04ad400640 1 -- 172.21.15.173:0/3503302920 >> v1:172.21.15.194:6789/0 conn(0x7f04b815db40 legacy=0x7f04b806cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.850+0000 7f04ad400640 1 -- 172.21.15.173:0/3503302920 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b80d09d0 con 0x7f04b806d6d0 2024-04-25T09:06:39.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.850+0000 7f04ad400640 1 --2- 172.21.15.173:0/3503302920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04b806d6d0 0x7f04b80cb4f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009870 tx=0x7f04a001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5529f078942e8a49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:39.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04b5400640 1 -- 172.21.15.173:0/3503302920 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a00ab610 con 0x7f04b806d6d0 2024-04-25T09:06:39.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04b5400640 1 -- 172.21.15.173:0/3503302920 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a00b0070 con 0x7f04b806d6d0 2024-04-25T09:06:39.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04b5400640 1 -- 172.21.15.173:0/3503302920 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a00ab9d0 con 0x7f04b806d6d0 2024-04-25T09:06:39.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04bd200640 1 -- 172.21.15.173:0/3503302920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04b806d6d0 msgr2=0x7f04b80cb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04bd200640 1 --2- 172.21.15.173:0/3503302920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04b806d6d0 0x7f04b80cb4f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009870 tx=0x7f04a001c410 comp rx=0 tx=0).stop 2024-04-25T09:06:39.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04bd200640 1 -- 172.21.15.173:0/3503302920 shutdown_connections 2024-04-25T09:06:39.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04bd200640 1 --2- 172.21.15.173:0/3503302920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04b8071270 0x7f04b80cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04bd200640 1 --2- 172.21.15.173:0/3503302920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04b806d6d0 0x7f04b80cb4f0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04bd200640 1 -- 172.21.15.173:0/3503302920 >> 172.21.15.173:0/3503302920 conn(0x7f04b80b3460 msgr2=0x7f04b80b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:39.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04bd200640 1 -- 172.21.15.173:0/3503302920 shutdown_connections 2024-04-25T09:06:39.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04bd200640 1 -- 172.21.15.173:0/3503302920 wait complete. 2024-04-25T09:06:39.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04bd200640 1 Processor -- start 2024-04-25T09:06:39.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04bd200640 1 -- start start 2024-04-25T09:06:39.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04bd200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04b806d6d0 0x7f04b8140220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04bd200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04b8071270 0x7f04b80b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04bd200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04b815db40 0x7f04b806c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04bd200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b80cbf60 con 0x7f04b8071270 2024-04-25T09:06:39.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04bd200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b80cbde0 con 0x7f04b815db40 2024-04-25T09:06:39.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04bd200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b80cea10 con 0x7f04b806d6d0 2024-04-25T09:06:39.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04ad400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04b8071270 0x7f04b80b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04ad400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04b8071270 0x7f04b80b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47458/0 (socket says 172.21.15.173:47458) 2024-04-25T09:06:39.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04ad400640 1 -- 172.21.15.173:0/1950095468 learned_addr learned my addr 172.21.15.173:0/1950095468 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:39.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04b5e00640 1 --2- 172.21.15.173:0/1950095468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04b806d6d0 0x7f04b8140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.854+0000 7f04b6800640 1 --2- 172.21.15.173:0/1950095468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04b815db40 0x7f04b806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.858+0000 7f04ad400640 1 -- 172.21.15.173:0/1950095468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04b806d6d0 msgr2=0x7f04b8140220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.858+0000 7f04ad400640 1 --2- 172.21.15.173:0/1950095468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04b806d6d0 0x7f04b8140220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.858+0000 7f04ad400640 1 -- 172.21.15.173:0/1950095468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04b815db40 msgr2=0x7f04b806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.858+0000 7f04ad400640 1 --2- 172.21.15.173:0/1950095468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04b815db40 0x7f04b806c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.858+0000 7f04ad400640 1 -- 172.21.15.173:0/1950095468 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b81548c0 con 0x7f04b8071270 2024-04-25T09:06:39.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.858+0000 7f04ad400640 1 --2- 172.21.15.173:0/1950095468 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04b8071270 0x7f04b80b4510 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f04a001aac0 tx=0x7f04a001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:39.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.858+0000 7f04aea00640 1 -- 172.21.15.173:0/1950095468 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a00be5f0 con 0x7f04b8071270 2024-04-25T09:06:39.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.858+0000 7f04aea00640 1 -- 172.21.15.173:0/1950095468 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a00be7b0 con 0x7f04b8071270 2024-04-25T09:06:39.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.858+0000 7f04aea00640 1 -- 172.21.15.173:0/1950095468 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a00beba0 con 0x7f04b8071270 2024-04-25T09:06:39.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.858+0000 7f04bd200640 1 -- 172.21.15.173:0/1950095468 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b8154ba0 con 0x7f04b8071270 2024-04-25T09:06:39.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.858+0000 7f04bd200640 1 -- 172.21.15.173:0/1950095468 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b8155160 con 0x7f04b8071270 2024-04-25T09:06:39.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.858+0000 7f04bd200640 1 -- 172.21.15.173:0/1950095468 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b806df30 con 0x7f04b8071270 2024-04-25T09:06:39.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.858+0000 7f04aea00640 1 -- 172.21.15.173:0/1950095468 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f04a00b43f0 con 0x7f04b8071270 2024-04-25T09:06:39.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.862+0000 7f04aea00640 1 --2- 172.21.15.173:0/1950095468 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0494066f60 0x7f0494069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.862+0000 7f04aea00640 1 -- 172.21.15.173:0/1950095468 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f04a011f4d0 con 0x7f04b8071270 2024-04-25T09:06:39.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.862+0000 7f04b5e00640 1 --2- 172.21.15.173:0/1950095468 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0494066f60 0x7f0494069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.862+0000 7f04b5e00640 1 --2- 172.21.15.173:0/1950095468 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0494066f60 0x7f0494069420 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f04a8001810 tx=0x7f04a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:39.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:39.866+0000 7f04aea00640 1 -- 172.21.15.173:0/1950095468 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f04a00a8050 con 0x7f04b8071270 2024-04-25T09:06:40.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.022+0000 7f04bd200640 1 -- 172.21.15.173:0/1950095468 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f04b8073ab0 con 0x7f04b8071270 2024-04-25T09:06:40.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.686+0000 7f04aea00640 1 -- 172.21.15.173:0/1950095468 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v60) v1 ==== 181+0+0 (secure 0 0 0) 0x7f04a0016150 con 0x7f04b8071270 2024-04-25T09:06:40.676 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:06:40.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.690+0000 7f04bd200640 1 -- 172.21.15.173:0/1950095468 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0494066f60 msgr2=0x7f0494069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.690+0000 7f04bd200640 1 --2- 172.21.15.173:0/1950095468 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0494066f60 0x7f0494069420 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f04a8001810 tx=0x7f04a8009040 comp rx=0 tx=0).stop 2024-04-25T09:06:40.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.690+0000 7f04bd200640 1 -- 172.21.15.173:0/1950095468 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04b8071270 msgr2=0x7f04b80b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.690+0000 7f04bd200640 1 --2- 172.21.15.173:0/1950095468 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04b8071270 0x7f04b80b4510 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f04a001aac0 tx=0x7f04a001ac50 comp rx=0 tx=0).stop 2024-04-25T09:06:40.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.690+0000 7f04bd200640 1 -- 172.21.15.173:0/1950095468 shutdown_connections 2024-04-25T09:06:40.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.690+0000 7f04bd200640 1 --2- 172.21.15.173:0/1950095468 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0494066f60 0x7f0494069420 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.690+0000 7f04bd200640 1 --2- 172.21.15.173:0/1950095468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04b815db40 0x7f04b806c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.690+0000 7f04bd200640 1 --2- 172.21.15.173:0/1950095468 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04b8071270 0x7f04b80b4510 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.690+0000 7f04bd200640 1 --2- 172.21.15.173:0/1950095468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04b806d6d0 0x7f04b8140220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.690+0000 7f04bd200640 1 -- 172.21.15.173:0/1950095468 >> 172.21.15.173:0/1950095468 conn(0x7f04b80b3460 msgr2=0x7f04b80cc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:40.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.690+0000 7f04bd200640 1 -- 172.21.15.173:0/1950095468 shutdown_connections 2024-04-25T09:06:40.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.690+0000 7f04bd200640 1 -- 172.21.15.173:0/1950095468 wait complete. 2024-04-25T09:06:40.704 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:06:40.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.866+0000 7f627a800640 1 Processor -- start 2024-04-25T09:06:40.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.866+0000 7f627a800640 1 -- start start 2024-04-25T09:06:40.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.866+0000 7f627a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f62740ad5c0 0x7f62741687d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.866+0000 7f627a800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627406fa20 con 0x7f627406f5b0 2024-04-25T09:06:40.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.866+0000 7f627a800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627406ae30 con 0x7f627406e1c0 2024-04-25T09:06:40.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.866+0000 7f627a800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62740b3170 con 0x7f62740ad5c0 2024-04-25T09:06:40.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.866+0000 7f626aa00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f627406f5b0 0x7f62740aceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36116/0 (socket says 172.21.15.173:36116) 2024-04-25T09:06:40.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.866+0000 7f626aa00640 1 -- 172.21.15.173:0/755132291 learned_addr learned my addr 172.21.15.173:0/755132291 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:40.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.866+0000 7f6273e00640 1 --2- 172.21.15.173:0/755132291 >> v2:172.21.15.173:3300/0 conn(0x7f62740ad5c0 0x7f62741687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.870+0000 7f6272a00640 1 -- 172.21.15.173:0/755132291 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953956351 0 0) 0x7f627406fa20 con 0x7f627406f5b0 2024-04-25T09:06:40.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.870+0000 7f6272a00640 1 -- 172.21.15.173:0/755132291 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6258003530 con 0x7f627406f5b0 2024-04-25T09:06:40.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.870+0000 7f6273e00640 1 -- 172.21.15.173:0/755132291 >> v1:172.21.15.194:6789/0 conn(0x7f627406e1c0 legacy=0x7f627406bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.870+0000 7f6273e00640 1 -- 172.21.15.173:0/755132291 >> v1:172.21.15.173:6789/0 conn(0x7f627406f5b0 legacy=0x7f62740aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.870+0000 7f6273e00640 1 -- 172.21.15.173:0/755132291 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627406b110 con 0x7f62740ad5c0 2024-04-25T09:06:40.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.870+0000 7f6273e00640 1 --2- 172.21.15.173:0/755132291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62740ad5c0 0x7f62741687d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f626c009d90 tx=0x7f626c01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34fbc160a4bb010a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.870+0000 7f6272a00640 1 -- 172.21.15.173:0/755132291 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c0b4070 con 0x7f62740ad5c0 2024-04-25T09:06:40.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.870+0000 7f6272a00640 1 -- 172.21.15.173:0/755132291 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c0af600 con 0x7f62740ad5c0 2024-04-25T09:06:40.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.870+0000 7f6272a00640 1 -- 172.21.15.173:0/755132291 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c0af9d0 con 0x7f62740ad5c0 2024-04-25T09:06:40.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.870+0000 7f627a800640 1 -- 172.21.15.173:0/755132291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62740ad5c0 msgr2=0x7f62741687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.870+0000 7f627a800640 1 --2- 172.21.15.173:0/755132291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62740ad5c0 0x7f62741687d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f626c009d90 tx=0x7f626c01f150 comp rx=0 tx=0).stop 2024-04-25T09:06:40.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.870+0000 7f627a800640 1 -- 172.21.15.173:0/755132291 shutdown_connections 2024-04-25T09:06:40.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.870+0000 7f627a800640 1 --2- 172.21.15.173:0/755132291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62740ad5c0 0x7f62741687d0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.870+0000 7f627a800640 1 -- 172.21.15.173:0/755132291 >> 172.21.15.173:0/755132291 conn(0x7f62740cfed0 msgr2=0x7f62740d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:40.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.870+0000 7f627a800640 1 -- 172.21.15.173:0/755132291 shutdown_connections 2024-04-25T09:06:40.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f627a800640 1 -- 172.21.15.173:0/755132291 wait complete. 2024-04-25T09:06:40.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f627a800640 1 Processor -- start 2024-04-25T09:06:40.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f627a800640 1 -- start start 2024-04-25T09:06:40.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f627a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f627406e1c0 0x7f6274142900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f627a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f627406f5b0 0x7f627415acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f627a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62740ad5c0 0x7f627415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f627a800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627406b6d0 con 0x7f627406f5b0 2024-04-25T09:06:40.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f627a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627415e070 con 0x7f627406e1c0 2024-04-25T09:06:40.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f627a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627406b9b0 con 0x7f62740ad5c0 2024-04-25T09:06:40.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f626aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f627406f5b0 0x7f627415acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f626aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f627406f5b0 0x7f627415acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47468/0 (socket says 172.21.15.173:47468) 2024-04-25T09:06:40.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f626aa00640 1 -- 172.21.15.173:0/612727065 learned_addr learned my addr 172.21.15.173:0/612727065 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:40.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f6273400640 1 --2- 172.21.15.173:0/612727065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f627406e1c0 0x7f6274142900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f6273e00640 1 --2- 172.21.15.173:0/612727065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62740ad5c0 0x7f627415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f626aa00640 1 -- 172.21.15.173:0/612727065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62740ad5c0 msgr2=0x7f627415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f626aa00640 1 --2- 172.21.15.173:0/612727065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62740ad5c0 0x7f627415c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f626aa00640 1 -- 172.21.15.173:0/612727065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f627406e1c0 msgr2=0x7f6274142900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f626aa00640 1 --2- 172.21.15.173:0/612727065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f627406e1c0 0x7f6274142900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f626aa00640 1 -- 172.21.15.173:0/612727065 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627415b7e0 con 0x7f627406f5b0 2024-04-25T09:06:40.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f6273e00640 1 --2- 172.21.15.173:0/612727065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62740ad5c0 0x7f627415c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:40.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f6273400640 1 --2- 172.21.15.173:0/612727065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f627406e1c0 0x7f6274142900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:40.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f626aa00640 1 --2- 172.21.15.173:0/612727065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f627406f5b0 0x7f627415acf0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f625c00c4d0 tx=0x7f625c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f626be00640 1 -- 172.21.15.173:0/612727065 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c017070 con 0x7f627406f5b0 2024-04-25T09:06:40.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f626be00640 1 -- 172.21.15.173:0/612727065 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c005cf0 con 0x7f627406f5b0 2024-04-25T09:06:40.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.874+0000 7f627a800640 1 -- 172.21.15.173:0/612727065 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627415bac0 con 0x7f627406f5b0 2024-04-25T09:06:40.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.878+0000 7f626be00640 1 -- 172.21.15.173:0/612727065 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c007270 con 0x7f627406f5b0 2024-04-25T09:06:40.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.878+0000 7f627a800640 1 -- 172.21.15.173:0/612727065 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6274153e20 con 0x7f627406f5b0 2024-04-25T09:06:40.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.878+0000 7f627a800640 1 -- 172.21.15.173:0/612727065 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6274073ab0 con 0x7f627406f5b0 2024-04-25T09:06:40.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.878+0000 7f626be00640 1 -- 172.21.15.173:0/612727065 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f625c01a070 con 0x7f627406f5b0 2024-04-25T09:06:40.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.878+0000 7f626be00640 1 --2- 172.21.15.173:0/612727065 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6250066f60 0x7f6250069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.878+0000 7f626be00640 1 -- 172.21.15.173:0/612727065 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5807+0+0 (secure 0 0 0) 0x7f625c084410 con 0x7f627406f5b0 2024-04-25T09:06:40.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.878+0000 7f6273400640 1 --2- 172.21.15.173:0/612727065 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6250066f60 0x7f6250069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.878+0000 7f6273400640 1 --2- 172.21.15.173:0/612727065 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6250066f60 0x7f6250069420 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6264000f70 tx=0x7f6264009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:40.882+0000 7f626be00640 1 -- 172.21.15.173:0/612727065 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f625c054cd0 con 0x7f627406f5b0 2024-04-25T09:06:41.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.062+0000 7f627a800640 1 -- 172.21.15.173:0/612727065 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6274153b40 con 0x7f627406f5b0 2024-04-25T09:06:41.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.694+0000 7f626be00640 1 -- 172.21.15.173:0/612727065 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v61) v1 ==== 169+0+0 (secure 0 0 0) 0x7f625c058d70 con 0x7f627406f5b0 2024-04-25T09:06:41.681 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' removed 2024-04-25T09:06:41.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.702+0000 7f627a800640 1 -- 172.21.15.173:0/612727065 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6250066f60 msgr2=0x7f6250069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.702+0000 7f627a800640 1 --2- 172.21.15.173:0/612727065 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6250066f60 0x7f6250069420 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6264000f70 tx=0x7f6264009040 comp rx=0 tx=0).stop 2024-04-25T09:06:41.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.702+0000 7f627a800640 1 -- 172.21.15.173:0/612727065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f627406f5b0 msgr2=0x7f627415acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.702+0000 7f627a800640 1 --2- 172.21.15.173:0/612727065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f627406f5b0 0x7f627415acf0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f625c00c4d0 tx=0x7f625c00c990 comp rx=0 tx=0).stop 2024-04-25T09:06:41.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.702+0000 7f627a800640 1 -- 172.21.15.173:0/612727065 shutdown_connections 2024-04-25T09:06:41.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.702+0000 7f627a800640 1 --2- 172.21.15.173:0/612727065 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6250066f60 0x7f6250069420 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.702+0000 7f627a800640 1 --2- 172.21.15.173:0/612727065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62740ad5c0 0x7f627415c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.702+0000 7f627a800640 1 --2- 172.21.15.173:0/612727065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f627406f5b0 0x7f627415acf0 secure :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f625c00c4d0 tx=0x7f625c00c990 comp rx=0 tx=0).stop 2024-04-25T09:06:41.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.702+0000 7f627a800640 1 --2- 172.21.15.173:0/612727065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f627406e1c0 0x7f6274142900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.702+0000 7f627a800640 1 -- 172.21.15.173:0/612727065 >> 172.21.15.173:0/612727065 conn(0x7f62740cfed0 msgr2=0x7f62740ae5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:41.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.702+0000 7f627a800640 1 -- 172.21.15.173:0/612727065 shutdown_connections 2024-04-25T09:06:41.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.702+0000 7f627a800640 1 -- 172.21.15.173:0/612727065 wait complete. 2024-04-25T09:06:41.738 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:06:41.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.890+0000 7fc17de00640 1 Processor -- start 2024-04-25T09:06:41.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.890+0000 7fc17de00640 1 -- start start 2024-04-25T09:06:41.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.890+0000 7fc17de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc178145290 0x7fc17815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.890+0000 7fc17de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc1780cc260 0x7fc1780cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.890+0000 7fc17de00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17815c5f0 con 0x7fc1780b3fe0 2024-04-25T09:06:41.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.890+0000 7fc17de00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17806d4b0 con 0x7fc1780cc260 2024-04-25T09:06:41.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.890+0000 7fc17de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17806d790 con 0x7fc178145290 2024-04-25T09:06:41.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.890+0000 7fc176a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc178145290 0x7fc17815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.890+0000 7fc177400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc1780cc260 0x7fc1780cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.890+0000 7fc176a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc178145290 0x7fc17815c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:59972/0 (socket says 172.21.15.173:59972) 2024-04-25T09:06:41.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.890+0000 7fc16e000640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fc1780b3fe0 0x7fc1780b4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:54148/0 (socket says 172.21.15.173:54148) 2024-04-25T09:06:41.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.890+0000 7fc176a00640 1 -- 172.21.15.173:0/4021030719 learned_addr learned my addr 172.21.15.173:0/4021030719 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:41.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.890+0000 7fc176a00640 1 -- 172.21.15.173:0/4021030719 >> v2:172.21.15.194:3300/0 conn(0x7fc1780cc260 msgr2=0x7fc1780cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:41.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.890+0000 7fc176a00640 1 --2- 172.21.15.173:0/4021030719 >> v2:172.21.15.194:3300/0 conn(0x7fc1780cc260 0x7fc1780cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.890+0000 7fc176a00640 1 -- 172.21.15.173:0/4021030719 >> v1:172.21.15.194:6789/0 conn(0x7fc1780b3fe0 legacy=0x7fc1780b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.890+0000 7fc176a00640 1 -- 172.21.15.173:0/4021030719 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17806da70 con 0x7fc178145290 2024-04-25T09:06:41.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.890+0000 7fc177400640 1 --2- 172.21.15.173:0/4021030719 >> v2:172.21.15.194:3300/0 conn(0x7fc1780cc260 0x7fc1780cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:41.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.894+0000 7fc176a00640 1 --2- 172.21.15.173:0/4021030719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc178145290 0x7fc17815c0b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc168009870 tx=0x7fc16801c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cda6f5ec621e7f4d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:41.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.894+0000 7fc176000640 1 -- 172.21.15.173:0/4021030719 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1680b0070 con 0x7fc178145290 2024-04-25T09:06:41.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.894+0000 7fc176000640 1 -- 172.21.15.173:0/4021030719 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc168004230 con 0x7fc178145290 2024-04-25T09:06:41.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.894+0000 7fc176000640 1 -- 172.21.15.173:0/4021030719 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168003620 con 0x7fc178145290 2024-04-25T09:06:41.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.894+0000 7fc17de00640 1 -- 172.21.15.173:0/4021030719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc178145290 msgr2=0x7fc17815c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.894+0000 7fc17de00640 1 --2- 172.21.15.173:0/4021030719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc178145290 0x7fc17815c0b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc168009870 tx=0x7fc16801c440 comp rx=0 tx=0).stop 2024-04-25T09:06:41.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.894+0000 7fc17de00640 1 -- 172.21.15.173:0/4021030719 shutdown_connections 2024-04-25T09:06:41.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.894+0000 7fc17de00640 1 --2- 172.21.15.173:0/4021030719 >> v2:172.21.15.194:3300/0 conn(0x7fc1780cc260 0x7fc1780cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.894+0000 7fc17de00640 1 --2- 172.21.15.173:0/4021030719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc178145290 0x7fc17815c0b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.894+0000 7fc17de00640 1 -- 172.21.15.173:0/4021030719 >> 172.21.15.173:0/4021030719 conn(0x7fc17806ac90 msgr2=0x7fc17806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:41.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.894+0000 7fc17de00640 1 -- 172.21.15.173:0/4021030719 shutdown_connections 2024-04-25T09:06:41.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.894+0000 7fc17de00640 1 -- 172.21.15.173:0/4021030719 wait complete. 2024-04-25T09:06:41.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc17de00640 1 Processor -- start 2024-04-25T09:06:41.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc17de00640 1 -- start start 2024-04-25T09:06:41.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc17de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1780b3fe0 0x7fc1781f7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc17de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1780cc260 0x7fc1780cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc17de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc178145290 0x7fc17815dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc17de00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17806eee0 con 0x7fc1780b3fe0 2024-04-25T09:06:41.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc17de00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17806ed60 con 0x7fc178145290 2024-04-25T09:06:41.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc17de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17806f060 con 0x7fc1780cc260 2024-04-25T09:06:41.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc176a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1780b3fe0 0x7fc1781f7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc176a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1780b3fe0 0x7fc1781f7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47476/0 (socket says 172.21.15.173:47476) 2024-04-25T09:06:41.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc176a00640 1 -- 172.21.15.173:0/3595880993 learned_addr learned my addr 172.21.15.173:0/3595880993 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:41.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc176a00640 1 -- 172.21.15.173:0/3595880993 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1780cc260 msgr2=0x7fc1780cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc16e000640 1 --2- 172.21.15.173:0/3595880993 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1780cc260 0x7fc1780cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc177400640 1 --2- 172.21.15.173:0/3595880993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc178145290 0x7fc17815dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc176a00640 1 --2- 172.21.15.173:0/3595880993 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1780cc260 0x7fc1780cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc176a00640 1 -- 172.21.15.173:0/3595880993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc178145290 msgr2=0x7fc17815dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc176a00640 1 --2- 172.21.15.173:0/3595880993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc178145290 0x7fc17815dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc176a00640 1 -- 172.21.15.173:0/3595880993 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1780ce560 con 0x7fc1780b3fe0 2024-04-25T09:06:41.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc177400640 1 --2- 172.21.15.173:0/3595880993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc178145290 0x7fc17815dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:41.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc16e000640 1 --2- 172.21.15.173:0/3595880993 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1780cc260 0x7fc1780cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:41.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc176a00640 1 --2- 172.21.15.173:0/3595880993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1780b3fe0 0x7fc1781f7560 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fc16801aaf0 tx=0x7fc1680191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:41.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc16fe00640 1 -- 172.21.15.173:0/3595880993 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1680b9020 con 0x7fc1780b3fe0 2024-04-25T09:06:41.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc16fe00640 1 -- 172.21.15.173:0/3595880993 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1680b1040 con 0x7fc1780b3fe0 2024-04-25T09:06:41.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc16fe00640 1 -- 172.21.15.173:0/3595880993 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1680b0070 con 0x7fc1780b3fe0 2024-04-25T09:06:41.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc17de00640 1 -- 172.21.15.173:0/3595880993 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1780ce840 con 0x7fc1780b3fe0 2024-04-25T09:06:41.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.898+0000 7fc17de00640 1 -- 172.21.15.173:0/3595880993 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1780cee00 con 0x7fc1780b3fe0 2024-04-25T09:06:41.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.902+0000 7fc17de00640 1 -- 172.21.15.173:0/3595880993 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc178073ab0 con 0x7fc1780b3fe0 2024-04-25T09:06:41.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.902+0000 7fc16fe00640 1 -- 172.21.15.173:0/3595880993 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc1680bc020 con 0x7fc1780b3fe0 2024-04-25T09:06:41.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.902+0000 7fc16fe00640 1 --2- 172.21.15.173:0/3595880993 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc154066f60 0x7fc154069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.902+0000 7fc16fe00640 1 -- 172.21.15.173:0/3595880993 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc16811ebd0 con 0x7fc1780b3fe0 2024-04-25T09:06:41.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.902+0000 7fc16e000640 1 --2- 172.21.15.173:0/3595880993 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc154066f60 0x7fc154069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.902+0000 7fc16e000640 1 --2- 172.21.15.173:0/3595880993 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc154066f60 0x7fc154069420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc160007fd0 tx=0x7fc160009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:41.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:41.906+0000 7fc16fe00640 1 -- 172.21.15.173:0/3595880993 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc1680c3030 con 0x7fc1780b3fe0 2024-04-25T09:06:42.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.058+0000 7fc17de00640 1 -- 172.21.15.173:0/3595880993 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc1780cce00 con 0x7fc1780b3fe0 2024-04-25T09:06:42.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.062+0000 7fc16fe00640 1 -- 172.21.15.173:0/3595880993 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc168016150 con 0x7fc1780b3fe0 2024-04-25T09:06:42.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.066+0000 7fc17de00640 1 -- 172.21.15.173:0/3595880993 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc154066f60 msgr2=0x7fc154069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.066+0000 7fc17de00640 1 --2- 172.21.15.173:0/3595880993 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc154066f60 0x7fc154069420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc160007fd0 tx=0x7fc160009040 comp rx=0 tx=0).stop 2024-04-25T09:06:42.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.066+0000 7fc17de00640 1 -- 172.21.15.173:0/3595880993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1780b3fe0 msgr2=0x7fc1781f7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.066+0000 7fc17de00640 1 --2- 172.21.15.173:0/3595880993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1780b3fe0 0x7fc1781f7560 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fc16801aaf0 tx=0x7fc1680191e0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.066+0000 7fc17de00640 1 -- 172.21.15.173:0/3595880993 shutdown_connections 2024-04-25T09:06:42.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.066+0000 7fc17de00640 1 --2- 172.21.15.173:0/3595880993 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc154066f60 0x7fc154069420 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.066+0000 7fc17de00640 1 --2- 172.21.15.173:0/3595880993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc178145290 0x7fc17815dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.066+0000 7fc17de00640 1 --2- 172.21.15.173:0/3595880993 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1780cc260 0x7fc1780cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.066+0000 7fc17de00640 1 --2- 172.21.15.173:0/3595880993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1780b3fe0 0x7fc1781f7560 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.066+0000 7fc17de00640 1 -- 172.21.15.173:0/3595880993 >> 172.21.15.173:0/3595880993 conn(0x7fc17806ac90 msgr2=0x7fc1780b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:42.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.066+0000 7fc17de00640 1 -- 172.21.15.173:0/3595880993 shutdown_connections 2024-04-25T09:06:42.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.066+0000 7fc17de00640 1 -- 172.21.15.173:0/3595880993 wait complete. 2024-04-25T09:06:42.073 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-04-25T09:06:42.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.222+0000 7f44a1a00640 1 Processor -- start 2024-04-25T09:06:42.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.222+0000 7f44a1a00640 1 -- start start 2024-04-25T09:06:42.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.222+0000 7f44a1a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f449c15a680 0x7f449c0b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.222+0000 7f44a1a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f449c15aa60 0x7f449c06fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.222+0000 7f44a1a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449c0b4890 con 0x7f449c15b770 2024-04-25T09:06:42.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.222+0000 7f44a1a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449c070390 con 0x7f449c15aa60 2024-04-25T09:06:42.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.222+0000 7f44a1a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449c0b42d0 con 0x7f449c15a680 2024-04-25T09:06:42.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.222+0000 7f449b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f449c15aa60 0x7f449c06fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.222+0000 7f449b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f449c15aa60 0x7f449c06fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47480/0 (socket says 172.21.15.173:47480) 2024-04-25T09:06:42.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.222+0000 7f449b400640 1 -- 172.21.15.173:0/3615336613 learned_addr learned my addr 172.21.15.173:0/3615336613 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:42.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.222+0000 7f449be00640 1 --2- 172.21.15.173:0/3615336613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f449c15a680 0x7f449c0b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.222+0000 7f449b400640 1 -- 172.21.15.173:0/3615336613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f449c15a680 msgr2=0x7f449c0b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:42.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.222+0000 7f449b400640 1 --2- 172.21.15.173:0/3615336613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f449c15a680 0x7f449c0b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.222+0000 7f449b400640 1 -- 172.21.15.173:0/3615336613 >> v1:172.21.15.194:6789/0 conn(0x7f449c15b770 legacy=0x7f449c06bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.222+0000 7f449b400640 1 -- 172.21.15.173:0/3615336613 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c0b45b0 con 0x7f449c15aa60 2024-04-25T09:06:42.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.226+0000 7f449b400640 1 --2- 172.21.15.173:0/3615336613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f449c15aa60 0x7f449c06fe50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f448800bb10 tx=0x7f448801eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f18f7d56416a55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:42.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.226+0000 7f449aa00640 1 -- 172.21.15.173:0/3615336613 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44880b4070 con 0x7f449c15aa60 2024-04-25T09:06:42.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.226+0000 7f449aa00640 1 -- 172.21.15.173:0/3615336613 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44880a7b80 con 0x7f449c15aa60 2024-04-25T09:06:42.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.226+0000 7f449aa00640 1 -- 172.21.15.173:0/3615336613 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44880af440 con 0x7f449c15aa60 2024-04-25T09:06:42.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.226+0000 7f44a1a00640 1 -- 172.21.15.173:0/3615336613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f449c15aa60 msgr2=0x7f449c06fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.226+0000 7f44a1a00640 1 --2- 172.21.15.173:0/3615336613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f449c15aa60 0x7f449c06fe50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f448800bb10 tx=0x7f448801eba0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.226+0000 7f44a1a00640 1 -- 172.21.15.173:0/3615336613 shutdown_connections 2024-04-25T09:06:42.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.226+0000 7f44a1a00640 1 --2- 172.21.15.173:0/3615336613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f449c15aa60 0x7f449c06fe50 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.226+0000 7f44a1a00640 1 --2- 172.21.15.173:0/3615336613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f449c15a680 0x7f449c0b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.226+0000 7f44a1a00640 1 -- 172.21.15.173:0/3615336613 >> 172.21.15.173:0/3615336613 conn(0x7f449c0cc800 msgr2=0x7f449c0ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:42.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.226+0000 7f44a1a00640 1 -- 172.21.15.173:0/3615336613 shutdown_connections 2024-04-25T09:06:42.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.226+0000 7f44a1a00640 1 -- 172.21.15.173:0/3615336613 wait complete. 2024-04-25T09:06:42.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.226+0000 7f44a1a00640 1 Processor -- start 2024-04-25T09:06:42.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.226+0000 7f44a1a00640 1 -- start start 2024-04-25T09:06:42.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f44a1a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f449c15a680 0x7f449c152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f44a1a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f449c15aa60 0x7f449c151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f44a1a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f449c15b770 0x7f449c15d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f44a1a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c0ae020 con 0x7f449c15a680 2024-04-25T09:06:42.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f44a1a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c06c700 con 0x7f449c15b770 2024-04-25T09:06:42.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f44a1a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449c0ae1a0 con 0x7f449c15aa60 2024-04-25T09:06:42.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f449be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f449c15a680 0x7f449c152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f449be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f449c15a680 0x7f449c152200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47496/0 (socket says 172.21.15.173:47496) 2024-04-25T09:06:42.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f449be00640 1 -- 172.21.15.173:0/568057912 learned_addr learned my addr 172.21.15.173:0/568057912 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:42.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f449b400640 1 --2- 172.21.15.173:0/568057912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f449c15aa60 0x7f449c151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f44a1000640 1 --2- 172.21.15.173:0/568057912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f449c15b770 0x7f449c15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f449be00640 1 -- 172.21.15.173:0/568057912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f449c15aa60 msgr2=0x7f449c151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f449be00640 1 --2- 172.21.15.173:0/568057912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f449c15aa60 0x7f449c151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f449be00640 1 -- 172.21.15.173:0/568057912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f449c15b770 msgr2=0x7f449c15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f449be00640 1 --2- 172.21.15.173:0/568057912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f449c15b770 0x7f449c15d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f449be00640 1 -- 172.21.15.173:0/568057912 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c154b00 con 0x7f449c15a680 2024-04-25T09:06:42.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f44a1000640 1 --2- 172.21.15.173:0/568057912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f449c15b770 0x7f449c15d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:42.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f449be00640 1 --2- 172.21.15.173:0/568057912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f449c15a680 0x7f449c152200 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f448c00d830 tx=0x7f448c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:42.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f4493e00640 1 -- 172.21.15.173:0/568057912 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c00b6c0 con 0x7f449c15a680 2024-04-25T09:06:42.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f4493e00640 1 -- 172.21.15.173:0/568057912 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c019070 con 0x7f449c15a680 2024-04-25T09:06:42.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f44a1a00640 1 -- 172.21.15.173:0/568057912 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449c154de0 con 0x7f449c15a680 2024-04-25T09:06:42.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f4493e00640 1 -- 172.21.15.173:0/568057912 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c00bae0 con 0x7f449c15a680 2024-04-25T09:06:42.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f44a1a00640 1 -- 172.21.15.173:0/568057912 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449c1553a0 con 0x7f449c15a680 2024-04-25T09:06:42.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f44a1a00640 1 -- 172.21.15.173:0/568057912 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f449c073a40 con 0x7f449c15a680 2024-04-25T09:06:42.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.230+0000 7f4493e00640 1 -- 172.21.15.173:0/568057912 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f448c01e460 con 0x7f449c15a680 2024-04-25T09:06:42.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.234+0000 7f4493e00640 1 --2- 172.21.15.173:0/568057912 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f447c066f60 0x7f447c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.234+0000 7f4493e00640 1 -- 172.21.15.173:0/568057912 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f448c0856b0 con 0x7f449c15a680 2024-04-25T09:06:42.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.234+0000 7f449b400640 1 --2- 172.21.15.173:0/568057912 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f447c066f60 0x7f447c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.234+0000 7f449b400640 1 --2- 172.21.15.173:0/568057912 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f447c066f60 0x7f447c069420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f44880b1000 tx=0x7f4488008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:42.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.238+0000 7f4493e00640 1 -- 172.21.15.173:0/568057912 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f448c056790 con 0x7f449c15a680 2024-04-25T09:06:42.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.446+0000 7f44a1a00640 1 -- 172.21.15.173:0/568057912 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) v1 -- 0x7f449c152e30 con 0x7f449c15a680 2024-04-25T09:06:42.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.694+0000 7f4493e00640 1 -- 172.21.15.173:0/568057912 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v204) v1 ==== 143+0+0 (secure 0 0 0) 0x7f448c056090 con 0x7f449c15a680 2024-04-25T09:06:42.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.698+0000 7f44a1a00640 1 -- 172.21.15.173:0/568057912 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f447c066f60 msgr2=0x7f447c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.698+0000 7f44a1a00640 1 --2- 172.21.15.173:0/568057912 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f447c066f60 0x7f447c069420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f44880b1000 tx=0x7f4488008040 comp rx=0 tx=0).stop 2024-04-25T09:06:42.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.698+0000 7f44a1a00640 1 -- 172.21.15.173:0/568057912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f449c15a680 msgr2=0x7f449c152200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.698+0000 7f44a1a00640 1 --2- 172.21.15.173:0/568057912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f449c15a680 0x7f449c152200 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f448c00d830 tx=0x7f448c00dcf0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.698+0000 7f44a1a00640 1 -- 172.21.15.173:0/568057912 shutdown_connections 2024-04-25T09:06:42.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.698+0000 7f44a1a00640 1 --2- 172.21.15.173:0/568057912 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f447c066f60 0x7f447c069420 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.698+0000 7f44a1a00640 1 --2- 172.21.15.173:0/568057912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f449c15b770 0x7f449c15d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.698+0000 7f44a1a00640 1 --2- 172.21.15.173:0/568057912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f449c15aa60 0x7f449c151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.698+0000 7f44a1a00640 1 --2- 172.21.15.173:0/568057912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f449c15a680 0x7f449c152200 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.698+0000 7f44a1a00640 1 -- 172.21.15.173:0/568057912 >> 172.21.15.173:0/568057912 conn(0x7f449c0cc800 msgr2=0x7f449c0af160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:42.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.698+0000 7f44a1a00640 1 -- 172.21.15.173:0/568057912 shutdown_connections 2024-04-25T09:06:42.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.698+0000 7f44a1a00640 1 -- 172.21.15.173:0/568057912 wait complete. 2024-04-25T09:06:42.704 INFO:tasks.cephfs_test_runner:test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-04-25T09:06:42.704 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-04-25T09:06:42.705 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:42.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.854+0000 7fa948e00640 1 Processor -- start 2024-04-25T09:06:42.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.854+0000 7fa948e00640 1 -- start start 2024-04-25T09:06:42.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.854+0000 7fa948e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa94415dbb0 0x7fa94415df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.854+0000 7fa948e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9440d2130 0x7fa94406c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.854+0000 7fa948e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94406d870 con 0x7fa94406c7b0 2024-04-25T09:06:42.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.854+0000 7fa948e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9440d2590 con 0x7fa94415dbb0 2024-04-25T09:06:42.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.854+0000 7fa948e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94415e5c0 con 0x7fa9440d2130 2024-04-25T09:06:42.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.854+0000 7fa941e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa94415dbb0 0x7fa94415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.854+0000 7fa939400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9440d2130 0x7fa94406c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.854+0000 7fa942800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa94406c7b0 0x7fa94406f830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:54166/0 (socket says 172.21.15.173:54166) 2024-04-25T09:06:42.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.854+0000 7fa942800640 1 -- 172.21.15.173:0/1751854165 learned_addr learned my addr 172.21.15.173:0/1751854165 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:42.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.854+0000 7fa941e00640 1 -- 172.21.15.173:0/1751854165 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9440d2130 msgr2=0x7fa94406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:42.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.854+0000 7fa941e00640 1 --2- 172.21.15.173:0/1751854165 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9440d2130 0x7fa94406c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.854+0000 7fa941e00640 1 -- 172.21.15.173:0/1751854165 >> v1:172.21.15.194:6789/0 conn(0x7fa94406c7b0 legacy=0x7fa94406f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.854+0000 7fa941e00640 1 -- 172.21.15.173:0/1751854165 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa944161690 con 0x7fa94415dbb0 2024-04-25T09:06:42.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.858+0000 7fa941e00640 1 --2- 172.21.15.173:0/1751854165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa94415dbb0 0x7fa94415df90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa9340097c0 tx=0x7fa93401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fe1d3236652e72d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:42.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.858+0000 7fa941400640 1 -- 172.21.15.173:0/1751854165 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9340a7070 con 0x7fa94415dbb0 2024-04-25T09:06:42.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.858+0000 7fa941400640 1 -- 172.21.15.173:0/1751854165 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9340b0070 con 0x7fa94415dbb0 2024-04-25T09:06:42.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.858+0000 7fa941400640 1 -- 172.21.15.173:0/1751854165 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9340ab890 con 0x7fa94415dbb0 2024-04-25T09:06:42.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.858+0000 7fa948e00640 1 -- 172.21.15.173:0/1751854165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa94415dbb0 msgr2=0x7fa94415df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.858+0000 7fa948e00640 1 --2- 172.21.15.173:0/1751854165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa94415dbb0 0x7fa94415df90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa9340097c0 tx=0x7fa93401c470 comp rx=0 tx=0).stop 2024-04-25T09:06:42.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa948e00640 1 -- 172.21.15.173:0/1751854165 shutdown_connections 2024-04-25T09:06:42.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa948e00640 1 --2- 172.21.15.173:0/1751854165 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9440d2130 0x7fa94406c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa948e00640 1 --2- 172.21.15.173:0/1751854165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa94415dbb0 0x7fa94415df90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa948e00640 1 -- 172.21.15.173:0/1751854165 >> 172.21.15.173:0/1751854165 conn(0x7fa944061880 msgr2=0x7fa944061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:42.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa948e00640 1 -- 172.21.15.173:0/1751854165 shutdown_connections 2024-04-25T09:06:42.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa948e00640 1 -- 172.21.15.173:0/1751854165 wait complete. 2024-04-25T09:06:42.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa948e00640 1 Processor -- start 2024-04-25T09:06:42.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa948e00640 1 -- start start 2024-04-25T09:06:42.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa948e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa94406c7b0 0x7fa9440b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa948e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9440d2130 0x7fa94415a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa948e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa94415dbb0 0x7fa9440b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa948e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9441624d0 con 0x7fa94406c7b0 2024-04-25T09:06:42.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa948e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa944162350 con 0x7fa9440d2130 2024-04-25T09:06:42.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa948e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94406ff40 con 0x7fa94415dbb0 2024-04-25T09:06:42.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa941e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa94406c7b0 0x7fa9440b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa941e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa94406c7b0 0x7fa9440b02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47506/0 (socket says 172.21.15.173:47506) 2024-04-25T09:06:42.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa941e00640 1 -- 172.21.15.173:0/488515347 learned_addr learned my addr 172.21.15.173:0/488515347 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:42.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa939400640 1 --2- 172.21.15.173:0/488515347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9440d2130 0x7fa94415a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa942800640 1 --2- 172.21.15.173:0/488515347 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa94415dbb0 0x7fa9440b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa941e00640 1 -- 172.21.15.173:0/488515347 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa94415dbb0 msgr2=0x7fa9440b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa941e00640 1 --2- 172.21.15.173:0/488515347 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa94415dbb0 0x7fa9440b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa941e00640 1 -- 172.21.15.173:0/488515347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9440d2130 msgr2=0x7fa94415a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa941e00640 1 --2- 172.21.15.173:0/488515347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9440d2130 0x7fa94415a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa941e00640 1 -- 172.21.15.173:0/488515347 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9440b07e0 con 0x7fa94406c7b0 2024-04-25T09:06:42.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa939400640 1 --2- 172.21.15.173:0/488515347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9440d2130 0x7fa94415a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:42.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.862+0000 7fa941e00640 1 --2- 172.21.15.173:0/488515347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa94406c7b0 0x7fa9440b02a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa93401a0a0 tx=0x7fa93401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:42.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.866+0000 7fa93aa00640 1 -- 172.21.15.173:0/488515347 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9340bf610 con 0x7fa94406c7b0 2024-04-25T09:06:42.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.866+0000 7fa93aa00640 1 -- 172.21.15.173:0/488515347 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9340bf7d0 con 0x7fa94406c7b0 2024-04-25T09:06:42.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.866+0000 7fa948e00640 1 -- 172.21.15.173:0/488515347 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94415a650 con 0x7fa94406c7b0 2024-04-25T09:06:42.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.866+0000 7fa93aa00640 1 -- 172.21.15.173:0/488515347 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9340bfbc0 con 0x7fa94406c7b0 2024-04-25T09:06:42.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.866+0000 7fa948e00640 1 -- 172.21.15.173:0/488515347 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9441555d0 con 0x7fa94406c7b0 2024-04-25T09:06:42.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.866+0000 7fa948e00640 1 -- 172.21.15.173:0/488515347 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa944073a40 con 0x7fa94406c7b0 2024-04-25T09:06:42.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.866+0000 7fa93aa00640 1 -- 172.21.15.173:0/488515347 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa9340bd020 con 0x7fa94406c7b0 2024-04-25T09:06:42.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.866+0000 7fa93aa00640 1 --2- 172.21.15.173:0/488515347 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa920066f90 0x7fa920069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.866+0000 7fa93aa00640 1 -- 172.21.15.173:0/488515347 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fa93411f780 con 0x7fa94406c7b0 2024-04-25T09:06:42.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.866+0000 7fa939400640 1 --2- 172.21.15.173:0/488515347 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa920066f90 0x7fa920069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.870+0000 7fa939400640 1 --2- 172.21.15.173:0/488515347 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa920066f90 0x7fa920069450 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa944146b70 tx=0x7fa92c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:42.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:42.870+0000 7fa93aa00640 1 -- 172.21.15.173:0/488515347 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa934016090 con 0x7fa94406c7b0 2024-04-25T09:06:43.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.026+0000 7fa948e00640 1 -- 172.21.15.173:0/488515347 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9440cf020 con 0x7fa94406c7b0 2024-04-25T09:06:43.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.026+0000 7fa93aa00640 1 -- 172.21.15.173:0/488515347 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+13355 (secure 0 0 0) 0x7fa9340f0330 con 0x7fa94406c7b0 2024-04-25T09:06:43.016 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:43.016 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":61,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:06:41.690476+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:6837/3298938023":"2024-04-26T09:06:38.590957+0000","172.21.15.173:6835/3298938023":"2024-04-26T09:06:38.590957+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:43.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.030+0000 7fa948e00640 1 -- 172.21.15.173:0/488515347 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa920066f90 msgr2=0x7fa920069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.030+0000 7fa948e00640 1 --2- 172.21.15.173:0/488515347 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa920066f90 0x7fa920069450 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa944146b70 tx=0x7fa92c00b040 comp rx=0 tx=0).stop 2024-04-25T09:06:43.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.030+0000 7fa948e00640 1 -- 172.21.15.173:0/488515347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa94406c7b0 msgr2=0x7fa9440b02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.030+0000 7fa948e00640 1 --2- 172.21.15.173:0/488515347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa94406c7b0 0x7fa9440b02a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa93401a0a0 tx=0x7fa93401acb0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.030+0000 7fa948e00640 1 -- 172.21.15.173:0/488515347 shutdown_connections 2024-04-25T09:06:43.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.030+0000 7fa948e00640 1 --2- 172.21.15.173:0/488515347 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa920066f90 0x7fa920069450 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.030+0000 7fa948e00640 1 --2- 172.21.15.173:0/488515347 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa94415dbb0 0x7fa9440b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.030+0000 7fa948e00640 1 --2- 172.21.15.173:0/488515347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9440d2130 0x7fa94415a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.030+0000 7fa948e00640 1 --2- 172.21.15.173:0/488515347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa94406c7b0 0x7fa9440b02a0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.030+0000 7fa948e00640 1 -- 172.21.15.173:0/488515347 >> 172.21.15.173:0/488515347 conn(0x7fa944061880 msgr2=0x7fa9440b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:43.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.030+0000 7fa948e00640 1 -- 172.21.15.173:0/488515347 shutdown_connections 2024-04-25T09:06:43.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.030+0000 7fa948e00640 1 -- 172.21.15.173:0/488515347 wait complete. 2024-04-25T09:06:43.036 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:06:43.037 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:06:43.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.186+0000 7fccaa800640 1 Processor -- start 2024-04-25T09:06:43.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.186+0000 7fccaa800640 1 -- start start 2024-04-25T09:06:43.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.186+0000 7fccaa800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcca40aeb90 0x7fcca40cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.186+0000 7fccaa800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcca40aef70 0x7fcca40cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.186+0000 7fccaa800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca4071570 con 0x7fcca40cdba0 2024-04-25T09:06:43.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.186+0000 7fccaa800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca4071320 con 0x7fcca40aeb90 2024-04-25T09:06:43.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.190+0000 7fccaa800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca4072330 con 0x7fcca40aef70 2024-04-25T09:06:43.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.190+0000 7fcca3400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcca40aeb90 0x7fcca40cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.190+0000 7fcca3400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcca40aeb90 0x7fcca40cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47516/0 (socket says 172.21.15.173:47516) 2024-04-25T09:06:43.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.190+0000 7fcca3400640 1 -- 172.21.15.173:0/339876121 learned_addr learned my addr 172.21.15.173:0/339876121 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:43.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.190+0000 7fcc9aa00640 1 --2- 172.21.15.173:0/339876121 >> v2:172.21.15.194:3300/0 conn(0x7fcca40aef70 0x7fcca40cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.190+0000 7fcca3400640 1 -- 172.21.15.173:0/339876121 >> v2:172.21.15.194:3300/0 conn(0x7fcca40aef70 msgr2=0x7fcca40cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:43.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.190+0000 7fcca3400640 1 --2- 172.21.15.173:0/339876121 >> v2:172.21.15.194:3300/0 conn(0x7fcca40aef70 0x7fcca40cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.190+0000 7fcca3400640 1 -- 172.21.15.173:0/339876121 >> v1:172.21.15.194:6789/0 conn(0x7fcca40cdba0 legacy=0x7fcca40cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.190+0000 7fcca3400640 1 -- 172.21.15.173:0/339876121 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca4071850 con 0x7fcca40aeb90 2024-04-25T09:06:43.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.190+0000 7fcca3400640 1 --2- 172.21.15.173:0/339876121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca40aeb90 0x7fcca40cc0d0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fcca40cd960 tx=0x7fcc9401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1643ba2f1b113 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:43.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.190+0000 7fcca2a00640 1 -- 172.21.15.173:0/339876121 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc940b2070 con 0x7fcca40aeb90 2024-04-25T09:06:43.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.190+0000 7fcca2a00640 1 -- 172.21.15.173:0/339876121 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc940a9070 con 0x7fcca40aeb90 2024-04-25T09:06:43.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.190+0000 7fcca2a00640 1 -- 172.21.15.173:0/339876121 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc940ad880 con 0x7fcca40aeb90 2024-04-25T09:06:43.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fccaa800640 1 -- 172.21.15.173:0/339876121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca40aeb90 msgr2=0x7fcca40cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fccaa800640 1 --2- 172.21.15.173:0/339876121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca40aeb90 0x7fcca40cc0d0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fcca40cd960 tx=0x7fcc9401c460 comp rx=0 tx=0).stop 2024-04-25T09:06:43.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fccaa800640 1 -- 172.21.15.173:0/339876121 shutdown_connections 2024-04-25T09:06:43.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fccaa800640 1 --2- 172.21.15.173:0/339876121 >> v2:172.21.15.194:3300/0 conn(0x7fcca40aef70 0x7fcca40cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fccaa800640 1 --2- 172.21.15.173:0/339876121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca40aeb90 0x7fcca40cc0d0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fccaa800640 1 -- 172.21.15.173:0/339876121 >> 172.21.15.173:0/339876121 conn(0x7fcca406ac90 msgr2=0x7fcca406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:43.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fccaa800640 1 -- 172.21.15.173:0/339876121 shutdown_connections 2024-04-25T09:06:43.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fccaa800640 1 -- 172.21.15.173:0/339876121 wait complete. 2024-04-25T09:06:43.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fccaa800640 1 Processor -- start 2024-04-25T09:06:43.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fccaa800640 1 -- start start 2024-04-25T09:06:43.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fccaa800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca40aeb90 0x7fcca41486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fccaa800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcca40aef70 0x7fcca414b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fccaa800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcca40cdba0 0x7fcca41460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fccaa800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca415bb30 con 0x7fcca40aeb90 2024-04-25T09:06:43.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fccaa800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca415b9b0 con 0x7fcca40cdba0 2024-04-25T09:06:43.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fccaa800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca415bcb0 con 0x7fcca40aef70 2024-04-25T09:06:43.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fcca3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca40aeb90 0x7fcca41486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fcca3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca40aeb90 0x7fcca41486a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47530/0 (socket says 172.21.15.173:47530) 2024-04-25T09:06:43.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fcca3400640 1 -- 172.21.15.173:0/818129358 learned_addr learned my addr 172.21.15.173:0/818129358 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:43.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fcc9aa00640 1 --2- 172.21.15.173:0/818129358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcca40aef70 0x7fcca414b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fcca3e00640 1 --2- 172.21.15.173:0/818129358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcca40cdba0 0x7fcca41460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fcca3400640 1 -- 172.21.15.173:0/818129358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcca40aef70 msgr2=0x7fcca414b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fcca3400640 1 --2- 172.21.15.173:0/818129358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcca40aef70 0x7fcca414b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fcca3400640 1 -- 172.21.15.173:0/818129358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcca40cdba0 msgr2=0x7fcca41460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fcca3400640 1 --2- 172.21.15.173:0/818129358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcca40cdba0 0x7fcca41460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fcca3400640 1 -- 172.21.15.173:0/818129358 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca4148be0 con 0x7fcca40aeb90 2024-04-25T09:06:43.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fcca3e00640 1 --2- 172.21.15.173:0/818129358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcca40cdba0 0x7fcca41460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:43.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.194+0000 7fcca3400640 1 --2- 172.21.15.173:0/818129358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca40aeb90 0x7fcca41486a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fcc94019070 tx=0x7fcc9401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:43.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.198+0000 7fcc9be00640 1 -- 172.21.15.173:0/818129358 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc940bc020 con 0x7fcca40aeb90 2024-04-25T09:06:43.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.198+0000 7fcc9be00640 1 -- 172.21.15.173:0/818129358 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc940ade10 con 0x7fcca40aeb90 2024-04-25T09:06:43.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.198+0000 7fccaa800640 1 -- 172.21.15.173:0/818129358 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca4166ce0 con 0x7fcca40aeb90 2024-04-25T09:06:43.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.198+0000 7fcc9be00640 1 -- 172.21.15.173:0/818129358 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc940b2040 con 0x7fcca40aeb90 2024-04-25T09:06:43.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.198+0000 7fccaa800640 1 -- 172.21.15.173:0/818129358 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca41672a0 con 0x7fcca40aeb90 2024-04-25T09:06:43.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.198+0000 7fccaa800640 1 -- 172.21.15.173:0/818129358 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca4073ab0 con 0x7fcca40aeb90 2024-04-25T09:06:43.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.198+0000 7fcc9be00640 1 -- 172.21.15.173:0/818129358 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcc940bf020 con 0x7fcca40aeb90 2024-04-25T09:06:43.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.198+0000 7fcc9be00640 1 --2- 172.21.15.173:0/818129358 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcc80066f60 0x7fcc80069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.198+0000 7fcc9be00640 1 -- 172.21.15.173:0/818129358 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fcc9411f1b0 con 0x7fcca40aeb90 2024-04-25T09:06:43.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.198+0000 7fcc9aa00640 1 --2- 172.21.15.173:0/818129358 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcc80066f60 0x7fcc80069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.198+0000 7fcc9aa00640 1 --2- 172.21.15.173:0/818129358 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcc80066f60 0x7fcc80069420 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcca415c110 tx=0x7fcc8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:43.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.202+0000 7fcc9be00640 1 -- 172.21.15.173:0/818129358 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcc940c6030 con 0x7fcca40aeb90 2024-04-25T09:06:43.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.358+0000 7fccaa800640 1 -- 172.21.15.173:0/818129358 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcca40cf0b0 con 0x7fcca40aeb90 2024-04-25T09:06:43.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.358+0000 7fcc9be00640 1 -- 172.21.15.173:0/818129358 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc94016110 con 0x7fcca40aeb90 2024-04-25T09:06:43.347 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:06:43.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.362+0000 7fccaa800640 1 -- 172.21.15.173:0/818129358 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcc80066f60 msgr2=0x7fcc80069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.362+0000 7fccaa800640 1 --2- 172.21.15.173:0/818129358 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcc80066f60 0x7fcc80069420 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcca415c110 tx=0x7fcc8c008040 comp rx=0 tx=0).stop 2024-04-25T09:06:43.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.362+0000 7fccaa800640 1 -- 172.21.15.173:0/818129358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca40aeb90 msgr2=0x7fcca41486a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.362+0000 7fccaa800640 1 --2- 172.21.15.173:0/818129358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca40aeb90 0x7fcca41486a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fcc94019070 tx=0x7fcc9401aca0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.362+0000 7fccaa800640 1 -- 172.21.15.173:0/818129358 shutdown_connections 2024-04-25T09:06:43.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.362+0000 7fccaa800640 1 --2- 172.21.15.173:0/818129358 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcc80066f60 0x7fcc80069420 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.362+0000 7fccaa800640 1 --2- 172.21.15.173:0/818129358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcca40cdba0 0x7fcca41460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.362+0000 7fccaa800640 1 --2- 172.21.15.173:0/818129358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcca40aef70 0x7fcca414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.362+0000 7fccaa800640 1 --2- 172.21.15.173:0/818129358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca40aeb90 0x7fcca41486a0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.362+0000 7fccaa800640 1 -- 172.21.15.173:0/818129358 >> 172.21.15.173:0/818129358 conn(0x7fcca406ac90 msgr2=0x7fcca414c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:43.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.362+0000 7fccaa800640 1 -- 172.21.15.173:0/818129358 shutdown_connections 2024-04-25T09:06:43.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.362+0000 7fccaa800640 1 -- 172.21.15.173:0/818129358 wait complete. 2024-04-25T09:06:43.368 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-04-25T09:06:43.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.598+0000 7f51c6600640 1 Processor -- start 2024-04-25T09:06:43.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.598+0000 7f51c6600640 1 -- start start 2024-04-25T09:06:43.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.598+0000 7f51c6600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f51c006ac90 0x7f51c006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.598+0000 7f51c6600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51c00b3920 0x7f51c006b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.598+0000 7f51c6600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c006b5b0 con 0x7f51c015ea80 2024-04-25T09:06:43.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.598+0000 7f51c6600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c00b01a0 con 0x7f51c006ac90 2024-04-25T09:06:43.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.598+0000 7f51c6600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c0070230 con 0x7f51c00b3920 2024-04-25T09:06:43.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.598+0000 7f51bf400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f51c006ac90 0x7f51c006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.598+0000 7f51bf400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f51c006ac90 0x7f51c006fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40288/0 (socket says 172.21.15.173:40288) 2024-04-25T09:06:43.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.598+0000 7f51bf400640 1 -- 172.21.15.173:0/2221488421 learned_addr learned my addr 172.21.15.173:0/2221488421 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:43.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.598+0000 7f51bfe00640 1 --1- 172.21.15.173:0/2221488421 >> v1:172.21.15.173:6789/0 conn(0x7f51c015ea80 0x7f51c015f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:57358/0 (socket says 172.21.15.173:57358) 2024-04-25T09:06:43.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.598+0000 7f51bea00640 1 --2- 172.21.15.173:0/2221488421 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51c00b3920 0x7f51c006b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.598+0000 7f51bf400640 1 -- 172.21.15.173:0/2221488421 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51c00b3920 msgr2=0x7f51c006b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:43.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.598+0000 7f51bf400640 1 --2- 172.21.15.173:0/2221488421 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51c00b3920 0x7f51c006b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.598+0000 7f51bf400640 1 -- 172.21.15.173:0/2221488421 >> v1:172.21.15.173:6789/0 conn(0x7f51c015ea80 legacy=0x7f51c015f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.598+0000 7f51bf400640 1 -- 172.21.15.173:0/2221488421 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c0070510 con 0x7f51c006ac90 2024-04-25T09:06:43.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.602+0000 7f51bf400640 1 --2- 172.21.15.173:0/2221488421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c006ac90 0x7f51c006fba0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009e50 tx=0x7f51b001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c29e176f27d6cb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:43.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.602+0000 7f51be000640 1 -- 172.21.15.173:0/2221488421 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b00a57f0 con 0x7f51c006ac90 2024-04-25T09:06:43.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.602+0000 7f51be000640 1 -- 172.21.15.173:0/2221488421 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b00a5990 con 0x7f51c006ac90 2024-04-25T09:06:43.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.602+0000 7f51be000640 1 -- 172.21.15.173:0/2221488421 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b00a5d60 con 0x7f51c006ac90 2024-04-25T09:06:43.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.602+0000 7f51c6600640 1 -- 172.21.15.173:0/2221488421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c006ac90 msgr2=0x7f51c006fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.602+0000 7f51c6600640 1 --2- 172.21.15.173:0/2221488421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c006ac90 0x7f51c006fba0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009e50 tx=0x7f51b001ca30 comp rx=0 tx=0).stop 2024-04-25T09:06:43.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.602+0000 7f51c6600640 1 -- 172.21.15.173:0/2221488421 shutdown_connections 2024-04-25T09:06:43.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.602+0000 7f51c6600640 1 --2- 172.21.15.173:0/2221488421 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51c00b3920 0x7f51c006b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.602+0000 7f51c6600640 1 --2- 172.21.15.173:0/2221488421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c006ac90 0x7f51c006fba0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.602+0000 7f51c6600640 1 -- 172.21.15.173:0/2221488421 >> 172.21.15.173:0/2221488421 conn(0x7f51c00b23f0 msgr2=0x7f51c00b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:43.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.602+0000 7f51c6600640 1 -- 172.21.15.173:0/2221488421 shutdown_connections 2024-04-25T09:06:43.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.602+0000 7f51c6600640 1 -- 172.21.15.173:0/2221488421 wait complete. 2024-04-25T09:06:43.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51c6600640 1 Processor -- start 2024-04-25T09:06:43.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51c6600640 1 -- start start 2024-04-25T09:06:43.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51c6600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51c006ac90 0x7f51c0144030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51c6600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c00b3920 0x7f51c0153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51c6600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51c015ea80 0x7f51c0153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51c6600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c015ee90 con 0x7f51c00b3920 2024-04-25T09:06:43.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51c6600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00b3d00 con 0x7f51c015ea80 2024-04-25T09:06:43.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51c6600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c015f010 con 0x7f51c006ac90 2024-04-25T09:06:43.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51bea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c00b3920 0x7f51c0153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51bea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c00b3920 0x7f51c0153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40298/0 (socket says 172.21.15.173:40298) 2024-04-25T09:06:43.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51bea00640 1 -- 172.21.15.173:0/1124779165 learned_addr learned my addr 172.21.15.173:0/1124779165 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:43.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51bf400640 1 --2- 172.21.15.173:0/1124779165 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51c006ac90 0x7f51c0144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51bfe00640 1 --2- 172.21.15.173:0/1124779165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51c015ea80 0x7f51c0153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51bea00640 1 -- 172.21.15.173:0/1124779165 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51c006ac90 msgr2=0x7f51c0144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51bea00640 1 --2- 172.21.15.173:0/1124779165 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51c006ac90 0x7f51c0144030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51bea00640 1 -- 172.21.15.173:0/1124779165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51c015ea80 msgr2=0x7f51c0153fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51bea00640 1 --2- 172.21.15.173:0/1124779165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51c015ea80 0x7f51c0153fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51bea00640 1 -- 172.21.15.173:0/1124779165 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c0154b00 con 0x7f51c00b3920 2024-04-25T09:06:43.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51bfe00640 1 --2- 172.21.15.173:0/1124779165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51c015ea80 0x7f51c0153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:43.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51bea00640 1 --2- 172.21.15.173:0/1124779165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c00b3920 0x7f51c0153a70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00d800 tx=0x7f51ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:43.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51b7400640 1 -- 172.21.15.173:0/1124779165 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac00b6c0 con 0x7f51c00b3920 2024-04-25T09:06:43.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51b7400640 1 -- 172.21.15.173:0/1124779165 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac019070 con 0x7f51c00b3920 2024-04-25T09:06:43.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51c6600640 1 -- 172.21.15.173:0/1124779165 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c0154de0 con 0x7f51c00b3920 2024-04-25T09:06:43.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51b7400640 1 -- 172.21.15.173:0/1124779165 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac00ba60 con 0x7f51c00b3920 2024-04-25T09:06:43.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51c6600640 1 -- 172.21.15.173:0/1124779165 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c01553a0 con 0x7f51c00b3920 2024-04-25T09:06:43.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.606+0000 7f51c6600640 1 -- 172.21.15.173:0/1124779165 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c0073a40 con 0x7f51c00b3920 2024-04-25T09:06:43.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.610+0000 7f51b7400640 1 -- 172.21.15.173:0/1124779165 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f51ac00bc00 con 0x7f51c00b3920 2024-04-25T09:06:43.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.610+0000 7f51b7400640 1 --2- 172.21.15.173:0/1124779165 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f51a0066f60 0x7f51a0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.610+0000 7f51b7400640 1 -- 172.21.15.173:0/1124779165 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f51ac0853a0 con 0x7f51c00b3920 2024-04-25T09:06:43.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.610+0000 7f51bf400640 1 --2- 172.21.15.173:0/1124779165 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f51a0066f60 0x7f51a0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.610+0000 7f51bf400640 1 --2- 172.21.15.173:0/1124779165 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f51a0066f60 0x7f51a0069420 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f51b00ae000 tx=0x7f51b00a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:43.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.614+0000 7f51b7400640 1 -- 172.21.15.173:0/1124779165 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f51ac056480 con 0x7f51c00b3920 2024-04-25T09:06:43.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:43.826+0000 7f51c6600640 1 -- 172.21.15.173:0/1124779165 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) v1 -- 0x7f51c00b3110 con 0x7f51c00b3920 2024-04-25T09:06:44.598 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:06:44.602 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:06:44.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.702+0000 7f51b7400640 1 -- 172.21.15.173:0/1124779165 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v206) v1 ==== 146+0+0 (secure 0 0 0) 0x7f51ac055d80 con 0x7f51c00b3920 2024-04-25T09:06:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.702+0000 7f51c6600640 1 -- 172.21.15.173:0/1124779165 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f51a0066f60 msgr2=0x7f51a0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.702+0000 7f51c6600640 1 --2- 172.21.15.173:0/1124779165 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f51a0066f60 0x7f51a0069420 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f51b00ae000 tx=0x7f51b00a7070 comp rx=0 tx=0).stop 2024-04-25T09:06:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.702+0000 7f51c6600640 1 -- 172.21.15.173:0/1124779165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c00b3920 msgr2=0x7f51c0153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.702+0000 7f51c6600640 1 --2- 172.21.15.173:0/1124779165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c00b3920 0x7f51c0153a70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00d800 tx=0x7f51ac00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.706+0000 7f51c6600640 1 -- 172.21.15.173:0/1124779165 shutdown_connections 2024-04-25T09:06:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.706+0000 7f51c6600640 1 --2- 172.21.15.173:0/1124779165 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f51a0066f60 0x7f51a0069420 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.706+0000 7f51c6600640 1 --2- 172.21.15.173:0/1124779165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51c015ea80 0x7f51c0153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.706+0000 7f51c6600640 1 --2- 172.21.15.173:0/1124779165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c00b3920 0x7f51c0153a70 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.706+0000 7f51c6600640 1 --2- 172.21.15.173:0/1124779165 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51c006ac90 0x7f51c0144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.706+0000 7f51c6600640 1 -- 172.21.15.173:0/1124779165 >> 172.21.15.173:0/1124779165 conn(0x7f51c00b23f0 msgr2=0x7f51c00d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.706+0000 7f51c6600640 1 -- 172.21.15.173:0/1124779165 shutdown_connections 2024-04-25T09:06:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.706+0000 7f51c6600640 1 -- 172.21.15.173:0/1124779165 wait complete. 2024-04-25T09:06:44.715 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:06:44.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.910+0000 7f3f39a00640 1 Processor -- start 2024-04-25T09:06:44.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.910+0000 7f3f39a00640 1 -- start start 2024-04-25T09:06:44.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f39a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3f340b4e10 0x7f3f3406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f39a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f340adef0 con 0x7f3f340ad780 2024-04-25T09:06:44.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f39a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f340adc10 con 0x7f3f3415fcf0 2024-04-25T09:06:44.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f39a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3406b820 con 0x7f3f340b4e10 2024-04-25T09:06:44.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f32000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f3f340ad780 0x7f3f3415f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:57374/0 (socket says 172.21.15.173:57374) 2024-04-25T09:06:44.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f32000640 1 -- 172.21.15.173:0/270332514 learned_addr learned my addr 172.21.15.173:0/270332514 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:44.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f32a00640 1 --2- 172.21.15.173:0/270332514 >> v2:172.21.15.194:3300/0 conn(0x7f3f340b4e10 0x7f3f3406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f31600640 1 -- 172.21.15.173:0/270332514 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577494657 0 0) 0x7f3f340adef0 con 0x7f3f340ad780 2024-04-25T09:06:44.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f31600640 1 -- 172.21.15.173:0/270332514 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f18003530 con 0x7f3f340ad780 2024-04-25T09:06:44.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f31600640 1 -- 172.21.15.173:0/270332514 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192008156 0 0) 0x7f3f340adc10 con 0x7f3f3415fcf0 2024-04-25T09:06:44.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f31600640 1 -- 172.21.15.173:0/270332514 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f340adef0 con 0x7f3f3415fcf0 2024-04-25T09:06:44.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f31600640 1 -- 172.21.15.173:0/270332514 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1459560906 0 0) 0x7f3f18003530 con 0x7f3f340ad780 2024-04-25T09:06:44.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f31600640 1 -- 172.21.15.173:0/270332514 >> v2:172.21.15.194:3300/0 conn(0x7f3f340b4e10 msgr2=0x7f3f3406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:44.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f31600640 1 --2- 172.21.15.173:0/270332514 >> v2:172.21.15.194:3300/0 conn(0x7f3f340b4e10 0x7f3f3406c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f31600640 1 -- 172.21.15.173:0/270332514 >> v1:172.21.15.194:6789/0 conn(0x7f3f3415fcf0 legacy=0x7f3f34152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f31600640 1 -- 172.21.15.173:0/270332514 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3406bb00 con 0x7f3f340ad780 2024-04-25T09:06:44.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f31600640 1 -- 172.21.15.173:0/270332514 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f3f20001680 con 0x7f3f340ad780 2024-04-25T09:06:44.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f32a00640 1 --2- 172.21.15.173:0/270332514 >> v2:172.21.15.194:3300/0 conn(0x7f3f340b4e10 0x7f3f3406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:44.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f31600640 1 -- 172.21.15.173:0/270332514 >> v1:172.21.15.173:6789/0 conn(0x7f3f340ad780 legacy=0x7f3f3415f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f31600640 1 --2- 172.21.15.173:0/270332514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f18003b50 0x7f3f18003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f31600640 1 --2- 172.21.15.173:0/270332514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f18004810 0x7f3f18004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f31600640 1 --2- 172.21.15.173:0/270332514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f180051d0 0x7f3f1800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f31600640 1 -- 172.21.15.173:0/270332514 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3406b820 con 0x7f3f18003b50 2024-04-25T09:06:44.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f31600640 1 -- 172.21.15.173:0/270332514 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1800c100 con 0x7f3f18004810 2024-04-25T09:06:44.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f31600640 1 -- 172.21.15.173:0/270332514 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1800c300 con 0x7f3f180051d0 2024-04-25T09:06:44.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f32a00640 1 --2- 172.21.15.173:0/270332514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f18003b50 0x7f3f18003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f32000640 1 --2- 172.21.15.173:0/270332514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f18004810 0x7f3f18004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f33400640 1 --2- 172.21.15.173:0/270332514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f180051d0 0x7f3f1800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f32a00640 1 -- 172.21.15.173:0/270332514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f180051d0 msgr2=0x7f3f1800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:44.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f32a00640 1 --2- 172.21.15.173:0/270332514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f180051d0 0x7f3f1800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f32a00640 1 -- 172.21.15.173:0/270332514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f18004810 msgr2=0x7f3f18004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:44.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f32a00640 1 --2- 172.21.15.173:0/270332514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f18004810 0x7f3f18004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f32a00640 1 -- 172.21.15.173:0/270332514 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f18003530 con 0x7f3f18003b50 2024-04-25T09:06:44.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.914+0000 7f3f33400640 1 -- 172.21.15.173:0/270332514 reap_dead start 2024-04-25T09:06:44.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.918+0000 7f3f32a00640 1 --2- 172.21.15.173:0/270332514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f18003b50 0x7f3f18003f50 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009cb0 tx=0x7f3f2401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d1256d5e9c95ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:44.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.918+0000 7f3f31600640 1 -- 172.21.15.173:0/270332514 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f240b2070 con 0x7f3f18003b50 2024-04-25T09:06:44.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.918+0000 7f3f31600640 1 -- 172.21.15.173:0/270332514 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f240a5790 con 0x7f3f18003b50 2024-04-25T09:06:44.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.918+0000 7f3f31600640 1 -- 172.21.15.173:0/270332514 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24009880 con 0x7f3f18003b50 2024-04-25T09:06:44.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.918+0000 7f3f39a00640 1 -- 172.21.15.173:0/270332514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f18003b50 msgr2=0x7f3f18003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.918+0000 7f3f39a00640 1 --2- 172.21.15.173:0/270332514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f18003b50 0x7f3f18003f50 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009cb0 tx=0x7f3f2401cbe0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.918+0000 7f3f39a00640 1 -- 172.21.15.173:0/270332514 shutdown_connections 2024-04-25T09:06:44.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.918+0000 7f3f39a00640 1 --2- 172.21.15.173:0/270332514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f18003b50 0x7f3f18003f50 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.918+0000 7f3f39a00640 1 -- 172.21.15.173:0/270332514 >> 172.21.15.173:0/270332514 conn(0x7f3f340cfed0 msgr2=0x7f3f340d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:44.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.918+0000 7f3f39a00640 1 -- 172.21.15.173:0/270332514 shutdown_connections 2024-04-25T09:06:44.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.918+0000 7f3f39a00640 1 -- 172.21.15.173:0/270332514 wait complete. 2024-04-25T09:06:44.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.918+0000 7f3f39a00640 1 Processor -- start 2024-04-25T09:06:44.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f39a00640 1 -- start start 2024-04-25T09:06:44.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f39a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f18003b50 0x7f3f341420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f39a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f34156f30 0x7f3f341549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f39a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f34154ef0 0x7f3f34159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f39a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f340b5370 con 0x7f3f18003b50 2024-04-25T09:06:44.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f39a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f340b51f0 con 0x7f3f34156f30 2024-04-25T09:06:44.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f39a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3415f5e0 con 0x7f3f34154ef0 2024-04-25T09:06:44.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f32a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f18003b50 0x7f3f341420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f32a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f18003b50 0x7f3f341420f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40316/0 (socket says 172.21.15.173:40316) 2024-04-25T09:06:44.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f32a00640 1 -- 172.21.15.173:0/3307802203 learned_addr learned my addr 172.21.15.173:0/3307802203 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:44.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f33400640 1 --2- 172.21.15.173:0/3307802203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f34154ef0 0x7f3f34159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f32000640 1 --2- 172.21.15.173:0/3307802203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f34156f30 0x7f3f341549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f32a00640 1 -- 172.21.15.173:0/3307802203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f34154ef0 msgr2=0x7f3f34159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f32a00640 1 --2- 172.21.15.173:0/3307802203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f34154ef0 0x7f3f34159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f32a00640 1 -- 172.21.15.173:0/3307802203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f34156f30 msgr2=0x7f3f341549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f32a00640 1 --2- 172.21.15.173:0/3307802203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f34156f30 0x7f3f341549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f32a00640 1 -- 172.21.15.173:0/3307802203 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f34142830 con 0x7f3f18003b50 2024-04-25T09:06:44.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f32a00640 1 --2- 172.21.15.173:0/3307802203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f18003b50 0x7f3f341420f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009cb0 tx=0x7f3f18005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:44.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f2aa00640 1 -- 172.21.15.173:0/3307802203 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f240b2040 con 0x7f3f18003b50 2024-04-25T09:06:44.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f2aa00640 1 -- 172.21.15.173:0/3307802203 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f240be070 con 0x7f3f18003b50 2024-04-25T09:06:44.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f2aa00640 1 -- 172.21.15.173:0/3307802203 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f240ad680 con 0x7f3f18003b50 2024-04-25T09:06:44.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f39a00640 1 -- 172.21.15.173:0/3307802203 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f34142ad0 con 0x7f3f18003b50 2024-04-25T09:06:44.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f39a00640 1 -- 172.21.15.173:0/3307802203 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f34143090 con 0x7f3f18003b50 2024-04-25T09:06:44.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.922+0000 7f3f39a00640 1 -- 172.21.15.173:0/3307802203 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f340d0e30 con 0x7f3f18003b50 2024-04-25T09:06:44.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.926+0000 7f3f2aa00640 1 -- 172.21.15.173:0/3307802203 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3f240ad820 con 0x7f3f18003b50 2024-04-25T09:06:44.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.926+0000 7f3f2aa00640 1 --2- 172.21.15.173:0/3307802203 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f14066f60 0x7f3f14069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.926+0000 7f3f2aa00640 1 -- 172.21.15.173:0/3307802203 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f3f2411f330 con 0x7f3f18003b50 2024-04-25T09:06:44.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.926+0000 7f3f32000640 1 --2- 172.21.15.173:0/3307802203 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f14066f60 0x7f3f14069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.926+0000 7f3f32000640 1 --2- 172.21.15.173:0/3307802203 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f14066f60 0x7f3f14069420 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3f34156cd0 tx=0x7f3f20009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:44.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:44.930+0000 7f3f2aa00640 1 -- 172.21.15.173:0/3307802203 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3f240c7020 con 0x7f3f18003b50 2024-04-25T09:06:45.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.086+0000 7f3f39a00640 1 -- 172.21.15.173:0/3307802203 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3f341552d0 con 0x7f3f18003b50 2024-04-25T09:06:45.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.090+0000 7f3f2aa00640 1 -- 172.21.15.173:0/3307802203 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3f24016920 con 0x7f3f18003b50 2024-04-25T09:06:45.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.090+0000 7f3f39a00640 1 -- 172.21.15.173:0/3307802203 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f14066f60 msgr2=0x7f3f14069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.090+0000 7f3f39a00640 1 --2- 172.21.15.173:0/3307802203 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f14066f60 0x7f3f14069420 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3f34156cd0 tx=0x7f3f20009040 comp rx=0 tx=0).stop 2024-04-25T09:06:45.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.090+0000 7f3f39a00640 1 -- 172.21.15.173:0/3307802203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f18003b50 msgr2=0x7f3f341420f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.090+0000 7f3f39a00640 1 --2- 172.21.15.173:0/3307802203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f18003b50 0x7f3f341420f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009cb0 tx=0x7f3f18005840 comp rx=0 tx=0).stop 2024-04-25T09:06:45.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.094+0000 7f3f39a00640 1 -- 172.21.15.173:0/3307802203 shutdown_connections 2024-04-25T09:06:45.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.094+0000 7f3f39a00640 1 --2- 172.21.15.173:0/3307802203 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f14066f60 0x7f3f14069420 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.094+0000 7f3f39a00640 1 --2- 172.21.15.173:0/3307802203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f34154ef0 0x7f3f34159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.094+0000 7f3f39a00640 1 --2- 172.21.15.173:0/3307802203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f34156f30 0x7f3f341549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.094+0000 7f3f39a00640 1 --2- 172.21.15.173:0/3307802203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f18003b50 0x7f3f341420f0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.094+0000 7f3f39a00640 1 -- 172.21.15.173:0/3307802203 >> 172.21.15.173:0/3307802203 conn(0x7f3f340cfed0 msgr2=0x7f3f340b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:45.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.094+0000 7f3f39a00640 1 -- 172.21.15.173:0/3307802203 shutdown_connections 2024-04-25T09:06:45.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.094+0000 7f3f39a00640 1 -- 172.21.15.173:0/3307802203 wait complete. 2024-04-25T09:06:45.099 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:06:45.099 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:06:45.163 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:06:45.245 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:06:45.245 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:06:45.245 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:45.253 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:06:45.254 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:06:45.254 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:45.263 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:06:45.263 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:06:45.263 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:45.304 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:06:45.304 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:06:45.304 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:45.313 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:06:45.313 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:06:45.314 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:45.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.490+0000 7f8190a00640 1 Processor -- start 2024-04-25T09:06:45.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.490+0000 7f8190a00640 1 -- start start 2024-04-25T09:06:45.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.494+0000 7f8190a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f818c0b3e70 0x7f818c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.494+0000 7f8190a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818c0b3590 con 0x7f818c0aefa0 2024-04-25T09:06:45.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.494+0000 7f8190a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818c0b4790 con 0x7f818c15edd0 2024-04-25T09:06:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.494+0000 7f8190a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818c06dd50 con 0x7f818c0b3e70 2024-04-25T09:06:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.494+0000 7f8189e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f818c0b3e70 0x7f818c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.494+0000 7f8189400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f818c0aefa0 0x7f818c0b2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:57384/0 (socket says 172.21.15.173:57384) 2024-04-25T09:06:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.494+0000 7f8189e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f818c0b3e70 0x7f818c0b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40326/0 (socket says 172.21.15.173:40326) 2024-04-25T09:06:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.494+0000 7f8189400640 1 -- 172.21.15.173:0/3008034571 learned_addr learned my addr 172.21.15.173:0/3008034571 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.494+0000 7f8189e00640 1 -- 172.21.15.173:0/3008034571 >> v1:172.21.15.194:6789/0 conn(0x7f818c15edd0 legacy=0x7f818c0b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.494+0000 7f8189e00640 1 -- 172.21.15.173:0/3008034571 >> v1:172.21.15.173:6789/0 conn(0x7f818c0aefa0 legacy=0x7f818c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.494+0000 7f8189e00640 1 -- 172.21.15.173:0/3008034571 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c15f320 con 0x7f818c0b3e70 2024-04-25T09:06:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.494+0000 7f8188a00640 1 -- 172.21.15.173:0/3008034571 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327949781 0 0) 0x7f818c0b3590 con 0x7f818c0aefa0 2024-04-25T09:06:45.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.498+0000 7f8189e00640 1 --2- 172.21.15.173:0/3008034571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818c0b3e70 0x7f818c0b4250 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f817c0097c0 tx=0x7f817c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a926a7f1aed516 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:45.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.498+0000 7f8188a00640 1 -- 172.21.15.173:0/3008034571 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c0ab650 con 0x7f818c0b3e70 2024-04-25T09:06:45.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.498+0000 7f8188a00640 1 -- 172.21.15.173:0/3008034571 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817c0b0070 con 0x7f818c0b3e70 2024-04-25T09:06:45.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.498+0000 7f8188a00640 1 -- 172.21.15.173:0/3008034571 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c0aba10 con 0x7f818c0b3e70 2024-04-25T09:06:45.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.498+0000 7f8190a00640 1 -- 172.21.15.173:0/3008034571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818c0b3e70 msgr2=0x7f818c0b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.498+0000 7f8190a00640 1 --2- 172.21.15.173:0/3008034571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818c0b3e70 0x7f818c0b4250 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f817c0097c0 tx=0x7f817c01c430 comp rx=0 tx=0).stop 2024-04-25T09:06:45.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.498+0000 7f8190a00640 1 -- 172.21.15.173:0/3008034571 shutdown_connections 2024-04-25T09:06:45.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.498+0000 7f8190a00640 1 --2- 172.21.15.173:0/3008034571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818c0b3e70 0x7f818c0b4250 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.498+0000 7f8190a00640 1 -- 172.21.15.173:0/3008034571 >> 172.21.15.173:0/3008034571 conn(0x7f818c06ac90 msgr2=0x7f818c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:45.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.498+0000 7f8190a00640 1 -- 172.21.15.173:0/3008034571 shutdown_connections 2024-04-25T09:06:45.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.498+0000 7f8190a00640 1 -- 172.21.15.173:0/3008034571 wait complete. 2024-04-25T09:06:45.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.498+0000 7f8190a00640 1 Processor -- start 2024-04-25T09:06:45.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.498+0000 7f8190a00640 1 -- start start 2024-04-25T09:06:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.498+0000 7f8190a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818c0aefa0 0x7f818c13d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.498+0000 7f8190a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f818c0b3e70 0x7f818c0cf980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8190a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f818c15edd0 0x7f818c0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8190a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c15aba0 con 0x7f818c0aefa0 2024-04-25T09:06:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8190a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c0ce7b0 con 0x7f818c15edd0 2024-04-25T09:06:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8190a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818c06e1e0 con 0x7f818c0b3e70 2024-04-25T09:06:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8189e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818c0aefa0 0x7f818c13d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8189e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818c0aefa0 0x7f818c13d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40330/0 (socket says 172.21.15.173:40330) 2024-04-25T09:06:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8189e00640 1 -- 172.21.15.173:0/4042841997 learned_addr learned my addr 172.21.15.173:0/4042841997 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8189e00640 1 -- 172.21.15.173:0/4042841997 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f818c0b3e70 msgr2=0x7f818c0cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8189e00640 1 --2- 172.21.15.173:0/4042841997 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f818c0b3e70 0x7f818c0cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8189e00640 1 -- 172.21.15.173:0/4042841997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f818c15edd0 msgr2=0x7f818c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8189e00640 1 --2- 172.21.15.173:0/4042841997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f818c15edd0 0x7f818c0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8189e00640 1 -- 172.21.15.173:0/4042841997 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c13eb00 con 0x7f818c0aefa0 2024-04-25T09:06:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8189e00640 1 --2- 172.21.15.173:0/4042841997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818c0aefa0 0x7f818c13d620 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f817c019040 tx=0x7f817c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8182000640 1 -- 172.21.15.173:0/4042841997 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c0bf610 con 0x7f818c0aefa0 2024-04-25T09:06:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8182000640 1 -- 172.21.15.173:0/4042841997 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817c0bf7b0 con 0x7f818c0aefa0 2024-04-25T09:06:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8190a00640 1 -- 172.21.15.173:0/4042841997 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818c13dd40 con 0x7f818c0aefa0 2024-04-25T09:06:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8182000640 1 -- 172.21.15.173:0/4042841997 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c0bfba0 con 0x7f818c0aefa0 2024-04-25T09:06:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8190a00640 1 -- 172.21.15.173:0/4042841997 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818c13e300 con 0x7f818c0aefa0 2024-04-25T09:06:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8190a00640 1 -- 172.21.15.173:0/4042841997 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818c159680 con 0x7f818c0aefa0 2024-04-25T09:06:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.502+0000 7f8182000640 1 -- 172.21.15.173:0/4042841997 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f817c0bd020 con 0x7f818c0aefa0 2024-04-25T09:06:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.506+0000 7f8182000640 1 --2- 172.21.15.173:0/4042841997 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f816c066f60 0x7f816c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.506+0000 7f8182000640 1 -- 172.21.15.173:0/4042841997 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f817c11f710 con 0x7f818c0aefa0 2024-04-25T09:06:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.506+0000 7f8189400640 1 --2- 172.21.15.173:0/4042841997 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f816c066f60 0x7f816c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.506+0000 7f8189400640 1 --2- 172.21.15.173:0/4042841997 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f816c066f60 0x7f816c069420 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f818c1519f0 tx=0x7f8178007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:45.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.510+0000 7f8182000640 1 -- 172.21.15.173:0/4042841997 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f817c016050 con 0x7f818c0aefa0 2024-04-25T09:06:45.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.694+0000 7f8190a00640 1 -- 172.21.15.173:0/4042841997 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f818c073a40 con 0x7f818c0aefa0 2024-04-25T09:06:45.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.694+0000 7f8182000640 1 -- 172.21.15.173:0/4042841997 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f817c0f07f0 con 0x7f818c0aefa0 2024-04-25T09:06:45.684 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:45.684 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4043669020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":4043669020},{"type":"v1","addr":"172.21.15.194:6835","nonce":4043669020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2878227991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2878227991},{"type":"v1","addr":"172.21.15.194:6834","nonce":2878227991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5871,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/4114441142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4114441142},{"type":"v1","addr":"172.21.15.173:6836","nonce":4114441142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":6636,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1135245070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":1135245070},{"type":"v1","addr":"172.21.15.173:6837","nonce":1135245070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[]} 2024-04-25T09:06:45.684 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 32 2024-04-25T09:06:45.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.698+0000 7f8190a00640 1 -- 172.21.15.173:0/4042841997 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f816c066f60 msgr2=0x7f816c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.698+0000 7f8190a00640 1 --2- 172.21.15.173:0/4042841997 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f816c066f60 0x7f816c069420 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f818c1519f0 tx=0x7f8178007970 comp rx=0 tx=0).stop 2024-04-25T09:06:45.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.698+0000 7f8190a00640 1 -- 172.21.15.173:0/4042841997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818c0aefa0 msgr2=0x7f818c13d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.698+0000 7f8190a00640 1 --2- 172.21.15.173:0/4042841997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818c0aefa0 0x7f818c13d620 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f817c019040 tx=0x7f817c01ac70 comp rx=0 tx=0).stop 2024-04-25T09:06:45.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.698+0000 7f8190a00640 1 -- 172.21.15.173:0/4042841997 shutdown_connections 2024-04-25T09:06:45.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.698+0000 7f8190a00640 1 --2- 172.21.15.173:0/4042841997 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f816c066f60 0x7f816c069420 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.698+0000 7f8190a00640 1 --2- 172.21.15.173:0/4042841997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f818c15edd0 0x7f818c0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.698+0000 7f8190a00640 1 --2- 172.21.15.173:0/4042841997 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f818c0b3e70 0x7f818c0cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.698+0000 7f8190a00640 1 --2- 172.21.15.173:0/4042841997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818c0aefa0 0x7f818c13d620 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.698+0000 7f8190a00640 1 -- 172.21.15.173:0/4042841997 >> 172.21.15.173:0/4042841997 conn(0x7f818c06ac90 msgr2=0x7f818c159de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:45.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.698+0000 7f8190a00640 1 -- 172.21.15.173:0/4042841997 shutdown_connections 2024-04-25T09:06:45.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.698+0000 7f8190a00640 1 -- 172.21.15.173:0/4042841997 wait complete. 2024-04-25T09:06:45.707 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:06:45.707 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:06:45.707 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:06:45.707 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:06:45.707 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:06:45.708 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:06:45.708 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:06:45.708 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:06:45.708 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:06:45.708 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:06:45.708 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:06:45.709 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:06:45.709 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:06:45.709 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:06:45.709 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:06:45.709 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:06:45.720 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:06:45.721 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:06:45.721 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:06:45.722 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:06:45.727 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:06:45.727 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:06:45.728 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:06:45.728 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:06:45.770 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:06:45.771 DEBUG:teuthology.parallel:result is None 2024-04-25T09:06:45.772 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:06:45.772 DEBUG:teuthology.parallel:result is None 2024-04-25T09:06:45.773 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:06:45.773 DEBUG:teuthology.parallel:result is None 2024-04-25T09:06:45.774 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:06:45.774 DEBUG:teuthology.parallel:result is None 2024-04-25T09:06:45.774 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:06:45.856 INFO:tasks.ceph.mds.a.smithi173.stdout:starting mds.a at 2024-04-25T09:06:45.857 INFO:tasks.ceph.mds.c.smithi173.stdout:starting mds.c at 2024-04-25T09:06:45.865 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-04-25T09:06:45.866 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-04-25T09:06:45.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.930+0000 7f6f4b000640 1 Processor -- start 2024-04-25T09:06:45.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.934+0000 7f6f4b000640 1 -- start start 2024-04-25T09:06:45.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.934+0000 7f6f4b000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6f440b3fe0 0x7f6f440b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.934+0000 7f6f4b000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4406d4b0 con 0x7f6f44145290 2024-04-25T09:06:45.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.934+0000 7f6f4b000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4406d790 con 0x7f6f440cc260 2024-04-25T09:06:45.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.934+0000 7f6f4b000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f440ccd80 con 0x7f6f440b3fe0 2024-04-25T09:06:45.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.934+0000 7f6f43e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f6f44145290 0x7f6f4415c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:57410/0 (socket says 172.21.15.173:57410) 2024-04-25T09:06:45.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.934+0000 7f6f43e00640 1 -- 172.21.15.173:0/1527173851 learned_addr learned my addr 172.21.15.173:0/1527173851 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:45.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.934+0000 7f6f43400640 1 --2- 172.21.15.173:0/1527173851 >> v2:172.21.15.194:3300/0 conn(0x7f6f440b3fe0 0x7f6f440b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:45.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.934+0000 7f6f42a00640 1 -- 172.21.15.173:0/1527173851 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132793971 0 0) 0x7f6f4406d4b0 con 0x7f6f44145290 2024-04-25T09:06:45.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.934+0000 7f6f42a00640 1 -- 172.21.15.173:0/1527173851 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f28003530 con 0x7f6f44145290 2024-04-25T09:06:45.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.934+0000 7f6f43400640 1 -- 172.21.15.173:0/1527173851 >> v1:172.21.15.194:6789/0 conn(0x7f6f440cc260 legacy=0x7f6f440cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.934+0000 7f6f43400640 1 -- 172.21.15.173:0/1527173851 >> v1:172.21.15.173:6789/0 conn(0x7f6f44145290 legacy=0x7f6f4415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.934+0000 7f6f43400640 1 -- 172.21.15.173:0/1527173851 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4406da70 con 0x7f6f440b3fe0 2024-04-25T09:06:45.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.938+0000 7f6f43400640 1 --2- 172.21.15.173:0/1527173851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f440b3fe0 0x7f6f440b4450 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6f300097c0 tx=0x7f6f3001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c007411f386f056c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:45.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.938+0000 7f6f42a00640 1 -- 172.21.15.173:0/1527173851 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f300b0070 con 0x7f6f440b3fe0 2024-04-25T09:06:45.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.938+0000 7f6f42a00640 1 -- 172.21.15.173:0/1527173851 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f300ab600 con 0x7f6f440b3fe0 2024-04-25T09:06:45.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.938+0000 7f6f42a00640 1 -- 172.21.15.173:0/1527173851 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f300ab9d0 con 0x7f6f440b3fe0 2024-04-25T09:06:45.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.938+0000 7f6f4b000640 1 -- 172.21.15.173:0/1527173851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f440b3fe0 msgr2=0x7f6f440b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.938+0000 7f6f4b000640 1 --2- 172.21.15.173:0/1527173851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f440b3fe0 0x7f6f440b4450 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6f300097c0 tx=0x7f6f3001c380 comp rx=0 tx=0).stop 2024-04-25T09:06:45.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.938+0000 7f6f4b000640 1 -- 172.21.15.173:0/1527173851 shutdown_connections 2024-04-25T09:06:45.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.938+0000 7f6f4b000640 1 --2- 172.21.15.173:0/1527173851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f440b3fe0 0x7f6f440b4450 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.938+0000 7f6f4b000640 1 -- 172.21.15.173:0/1527173851 >> 172.21.15.173:0/1527173851 conn(0x7f6f4406ac90 msgr2=0x7f6f4406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:45.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.938+0000 7f6f4b000640 1 -- 172.21.15.173:0/1527173851 shutdown_connections 2024-04-25T09:06:45.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.938+0000 7f6f4b000640 1 -- 172.21.15.173:0/1527173851 wait complete. 2024-04-25T09:06:45.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.938+0000 7f6f4b000640 1 Processor -- start 2024-04-25T09:06:45.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f4b000640 1 -- start start 2024-04-25T09:06:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f4b000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f440b3fe0 0x7f6f440b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f4b000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f440cc260 0x7f6f440b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f4b000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f44145290 0x7f6f4415aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f4b000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4406eee0 con 0x7f6f440cc260 2024-04-25T09:06:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f4b000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4406ed60 con 0x7f6f44145290 2024-04-25T09:06:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f4b000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4406f060 con 0x7f6f440b3fe0 2024-04-25T09:06:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f43400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f440cc260 0x7f6f440b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f43400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f440cc260 0x7f6f440b1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40356/0 (socket says 172.21.15.173:40356) 2024-04-25T09:06:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f43400640 1 -- 172.21.15.173:0/1544899013 learned_addr learned my addr 172.21.15.173:0/1544899013 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f43e00640 1 --2- 172.21.15.173:0/1544899013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f440b3fe0 0x7f6f440b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f49000640 1 --2- 172.21.15.173:0/1544899013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f44145290 0x7f6f4415aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f43400640 1 -- 172.21.15.173:0/1544899013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f440b3fe0 msgr2=0x7f6f440b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f43400640 1 --2- 172.21.15.173:0/1544899013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f440b3fe0 0x7f6f440b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f43400640 1 -- 172.21.15.173:0/1544899013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f44145290 msgr2=0x7f6f4415aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f43400640 1 --2- 172.21.15.173:0/1544899013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f44145290 0x7f6f4415aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f43400640 1 -- 172.21.15.173:0/1544899013 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4413ff20 con 0x7f6f440cc260 2024-04-25T09:06:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f43400640 1 --2- 172.21.15.173:0/1544899013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f440cc260 0x7f6f440b1990 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6f30018f90 tx=0x7f6f30019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:45.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f3be00640 1 -- 172.21.15.173:0/1544899013 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f300b0040 con 0x7f6f440cc260 2024-04-25T09:06:45.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f3be00640 1 -- 172.21.15.173:0/1544899013 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f300b43f0 con 0x7f6f440cc260 2024-04-25T09:06:45.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f3be00640 1 -- 172.21.15.173:0/1544899013 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f300b47c0 con 0x7f6f440cc260 2024-04-25T09:06:45.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f4b000640 1 -- 172.21.15.173:0/1544899013 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f44140200 con 0x7f6f440cc260 2024-04-25T09:06:45.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f4b000640 1 -- 172.21.15.173:0/1544899013 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f441407c0 con 0x7f6f440cc260 2024-04-25T09:06:45.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.942+0000 7f6f4b000640 1 -- 172.21.15.173:0/1544899013 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f44073ab0 con 0x7f6f440cc260 2024-04-25T09:06:45.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.946+0000 7f6f3be00640 1 -- 172.21.15.173:0/1544899013 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6f300b4960 con 0x7f6f440cc260 2024-04-25T09:06:45.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.946+0000 7f6f3be00640 1 --2- 172.21.15.173:0/1544899013 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f24066f60 0x7f6f24069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.946+0000 7f6f3be00640 1 -- 172.21.15.173:0/1544899013 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f6f3011e730 con 0x7f6f440cc260 2024-04-25T09:06:45.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.946+0000 7f6f43e00640 1 --2- 172.21.15.173:0/1544899013 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f24066f60 0x7f6f24069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:45.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.946+0000 7f6f43e00640 1 --2- 172.21.15.173:0/1544899013 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f24066f60 0x7f6f24069420 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6f340011f0 tx=0x7f6f34007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:45.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:45.950+0000 7f6f3be00640 1 -- 172.21.15.173:0/1544899013 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6f30016090 con 0x7f6f440cc260 2024-04-25T09:06:46.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.114+0000 7f6f4b000640 1 -- 172.21.15.173:0/1544899013 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6f440cc9c0 con 0x7f6f440cc260 2024-04-25T09:06:46.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.726+0000 7f6f3be00640 1 -- 172.21.15.173:0/1544899013 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v63) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6f300ef250 con 0x7f6f440cc260 2024-04-25T09:06:46.716 INFO:teuthology.orchestra.run.smithi173.stderr: removed all blocklist entries 2024-04-25T09:06:46.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.730+0000 7f6f4b000640 1 -- 172.21.15.173:0/1544899013 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f24066f60 msgr2=0x7f6f24069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:46.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.730+0000 7f6f4b000640 1 --2- 172.21.15.173:0/1544899013 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f24066f60 0x7f6f24069420 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6f340011f0 tx=0x7f6f34007d40 comp rx=0 tx=0).stop 2024-04-25T09:06:46.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.730+0000 7f6f4b000640 1 -- 172.21.15.173:0/1544899013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f440cc260 msgr2=0x7f6f440b1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:46.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.730+0000 7f6f4b000640 1 --2- 172.21.15.173:0/1544899013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f440cc260 0x7f6f440b1990 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6f30018f90 tx=0x7f6f30019120 comp rx=0 tx=0).stop 2024-04-25T09:06:46.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.730+0000 7f6f4b000640 1 -- 172.21.15.173:0/1544899013 shutdown_connections 2024-04-25T09:06:46.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.730+0000 7f6f4b000640 1 --2- 172.21.15.173:0/1544899013 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f24066f60 0x7f6f24069420 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.730+0000 7f6f4b000640 1 --2- 172.21.15.173:0/1544899013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f44145290 0x7f6f4415aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.730+0000 7f6f4b000640 1 --2- 172.21.15.173:0/1544899013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f440cc260 0x7f6f440b1990 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.730+0000 7f6f4b000640 1 --2- 172.21.15.173:0/1544899013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f440b3fe0 0x7f6f440b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.730+0000 7f6f4b000640 1 -- 172.21.15.173:0/1544899013 >> 172.21.15.173:0/1544899013 conn(0x7f6f4406ac90 msgr2=0x7f6f440aea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:46.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.730+0000 7f6f4b000640 1 -- 172.21.15.173:0/1544899013 shutdown_connections 2024-04-25T09:06:46.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.730+0000 7f6f4b000640 1 -- 172.21.15.173:0/1544899013 wait complete. 2024-04-25T09:06:46.744 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:06:46.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.894+0000 7fceaa200640 1 Processor -- start 2024-04-25T09:06:46.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.894+0000 7fceaa200640 1 -- start start 2024-04-25T09:06:46.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.894+0000 7fceaa200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcea40ccd30 0x7fcea40cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.894+0000 7fceaa200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea406e7c0 con 0x7fcea40cc8b0 2024-04-25T09:06:46.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.894+0000 7fceaa200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea406d720 con 0x7fcea4145250 2024-04-25T09:06:46.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.894+0000 7fceaa200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea406da00 con 0x7fcea40ccd30 2024-04-25T09:06:46.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.898+0000 7fce9aa00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fcea40cc8b0 0x7fcea40ce8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:57422/0 (socket says 172.21.15.173:57422) 2024-04-25T09:06:46.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.898+0000 7fce9aa00640 1 -- 172.21.15.173:0/297842447 learned_addr learned my addr 172.21.15.173:0/297842447 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:46.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.898+0000 7fcea3e00640 1 --2- 172.21.15.173:0/297842447 >> v2:172.21.15.173:3300/0 conn(0x7fcea40ccd30 0x7fcea40cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.898+0000 7fcea2a00640 1 -- 172.21.15.173:0/297842447 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788649898 0 0) 0x7fcea406e7c0 con 0x7fcea40cc8b0 2024-04-25T09:06:46.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.898+0000 7fcea3e00640 1 -- 172.21.15.173:0/297842447 >> v1:172.21.15.194:6789/0 conn(0x7fcea4145250 legacy=0x7fcea415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:46.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.898+0000 7fcea3e00640 1 -- 172.21.15.173:0/297842447 >> v1:172.21.15.173:6789/0 conn(0x7fcea40cc8b0 legacy=0x7fcea40ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:46.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.898+0000 7fcea3e00640 1 -- 172.21.15.173:0/297842447 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea406dce0 con 0x7fcea40ccd30 2024-04-25T09:06:46.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.898+0000 7fcea3e00640 1 --2- 172.21.15.173:0/297842447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcea40ccd30 0x7fcea40cf000 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fce9c009d90 tx=0x7fce9c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5ec9cf92ae3525 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:46.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.898+0000 7fcea2a00640 1 -- 172.21.15.173:0/297842447 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c0b2070 con 0x7fcea40ccd30 2024-04-25T09:06:46.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.898+0000 7fcea2a00640 1 -- 172.21.15.173:0/297842447 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c0a5a00 con 0x7fcea40ccd30 2024-04-25T09:06:46.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.898+0000 7fcea2a00640 1 -- 172.21.15.173:0/297842447 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c0a5dd0 con 0x7fcea40ccd30 2024-04-25T09:06:46.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fceaa200640 1 -- 172.21.15.173:0/297842447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcea40ccd30 msgr2=0x7fcea40cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:46.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fceaa200640 1 --2- 172.21.15.173:0/297842447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcea40ccd30 0x7fcea40cf000 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fce9c009d90 tx=0x7fce9c01c940 comp rx=0 tx=0).stop 2024-04-25T09:06:46.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fceaa200640 1 -- 172.21.15.173:0/297842447 shutdown_connections 2024-04-25T09:06:46.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fceaa200640 1 --2- 172.21.15.173:0/297842447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcea40ccd30 0x7fcea40cf000 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fceaa200640 1 -- 172.21.15.173:0/297842447 >> 172.21.15.173:0/297842447 conn(0x7fcea406ac90 msgr2=0x7fcea406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:46.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fceaa200640 1 -- 172.21.15.173:0/297842447 shutdown_connections 2024-04-25T09:06:46.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fceaa200640 1 -- 172.21.15.173:0/297842447 wait complete. 2024-04-25T09:06:46.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fceaa200640 1 Processor -- start 2024-04-25T09:06:46.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fceaa200640 1 -- start start 2024-04-25T09:06:46.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fceaa200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcea40cc8b0 0x7fcea40c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fceaa200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcea40ccd30 0x7fcea413ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fceaa200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcea4145250 0x7fcea40c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fceaa200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea40cd140 con 0x7fcea40ccd30 2024-04-25T09:06:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fceaa200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea406ef80 con 0x7fcea4145250 2024-04-25T09:06:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fceaa200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea406d380 con 0x7fcea40cc8b0 2024-04-25T09:06:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fce9aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcea40ccd30 0x7fcea413ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fce9aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcea40ccd30 0x7fcea413ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40364/0 (socket says 172.21.15.173:40364) 2024-04-25T09:06:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fce9aa00640 1 -- 172.21.15.173:0/2900746827 learned_addr learned my addr 172.21.15.173:0/2900746827 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fcea3e00640 1 --2- 172.21.15.173:0/2900746827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcea4145250 0x7fcea40c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fcea3400640 1 --2- 172.21.15.173:0/2900746827 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcea40cc8b0 0x7fcea40c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fce9aa00640 1 -- 172.21.15.173:0/2900746827 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcea40cc8b0 msgr2=0x7fcea40c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fce9aa00640 1 --2- 172.21.15.173:0/2900746827 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcea40cc8b0 0x7fcea40c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fce9aa00640 1 -- 172.21.15.173:0/2900746827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcea4145250 msgr2=0x7fcea40c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fce9aa00640 1 --2- 172.21.15.173:0/2900746827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcea4145250 0x7fcea40c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fce9aa00640 1 -- 172.21.15.173:0/2900746827 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea413f630 con 0x7fcea40ccd30 2024-04-25T09:06:46.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fcea3e00640 1 --2- 172.21.15.173:0/2900746827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcea4145250 0x7fcea40c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:46.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.902+0000 7fce9aa00640 1 --2- 172.21.15.173:0/2900746827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcea40ccd30 0x7fcea413ea30 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00c410 tx=0x7fce8c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:46.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.906+0000 7fce9be00640 1 -- 172.21.15.173:0/2900746827 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c0074e0 con 0x7fcea40ccd30 2024-04-25T09:06:46.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.906+0000 7fce9be00640 1 -- 172.21.15.173:0/2900746827 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8c0047f0 con 0x7fcea40ccd30 2024-04-25T09:06:46.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.906+0000 7fce9be00640 1 -- 172.21.15.173:0/2900746827 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c007680 con 0x7fcea40ccd30 2024-04-25T09:06:46.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.906+0000 7fceaa200640 1 -- 172.21.15.173:0/2900746827 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea40c50f0 con 0x7fcea40ccd30 2024-04-25T09:06:46.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.906+0000 7fceaa200640 1 -- 172.21.15.173:0/2900746827 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea40c56b0 con 0x7fcea40ccd30 2024-04-25T09:06:46.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.906+0000 7fceaa200640 1 -- 172.21.15.173:0/2900746827 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea4073a40 con 0x7fcea40ccd30 2024-04-25T09:06:46.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.906+0000 7fce9be00640 1 -- 172.21.15.173:0/2900746827 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fce8c011070 con 0x7fcea40ccd30 2024-04-25T09:06:46.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.906+0000 7fce9be00640 1 --2- 172.21.15.173:0/2900746827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce80066f60 0x7fce80069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.906+0000 7fce9be00640 1 -- 172.21.15.173:0/2900746827 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fce8c084a80 con 0x7fcea40ccd30 2024-04-25T09:06:46.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.906+0000 7fcea3400640 1 --2- 172.21.15.173:0/2900746827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce80066f60 0x7fce80069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.910+0000 7fcea3400640 1 --2- 172.21.15.173:0/2900746827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce80066f60 0x7fce80069420 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcea40b45f0 tx=0x7fce94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:46.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:46.910+0000 7fce9be00640 1 -- 172.21.15.173:0/2900746827 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fce8c086e20 con 0x7fcea40ccd30 2024-04-25T09:06:47.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.118+0000 7fceaa200640 1 -- 172.21.15.173:0/2900746827 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcea41443c0 con 0x7fcea40ccd30 2024-04-25T09:06:47.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.118+0000 7fce9be00640 1 -- 172.21.15.173:0/2900746827 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fcea413f630 con 0x7fcea40ccd30 2024-04-25T09:06:47.107 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:47.107 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:47.107 INFO:teuthology.orchestra.run.smithi173.stdout: "auth_dump": [ 2024-04-25T09:06:47.107 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.107 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.a", 2024-04-25T09:06:47.107 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmnVr3EhAAn+C0Mb/MrYSZuQyr5QTXig==", 2024-04-25T09:06:47.107 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.107 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:06:47.107 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:06:47.107 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:06:47.107 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:06:47.108 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.108 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:06:47.108 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.108 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.b", 2024-04-25T09:06:47.108 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6Gypm0QfFHhAAuP8xE/8pvSZMcP8N33OB9Q==", 2024-04-25T09:06:47.108 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.108 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:06:47.108 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:06:47.108 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:06:47.108 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:06:47.108 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.108 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:06:47.108 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.108 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.c", 2024-04-25T09:06:47.108 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmQsv4GRAATNiD7udOvl8xRDIx64O5jg==", 2024-04-25T09:06:47.108 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.109 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:06:47.109 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:06:47.109 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:06:47.109 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:06:47.109 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.109 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:06:47.109 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.109 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.d", 2024-04-25T09:06:47.109 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmtGMSJhAAonqLeuSsNrgyZks1eoJ1Gg==", 2024-04-25T09:06:47.109 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.109 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:06:47.109 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:06:47.109 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:06:47.109 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:06:47.109 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.109 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:06:47.109 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.110 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.0", 2024-04-25T09:06:47.110 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD9Gypm+Yw7LBAAnOFUKU3w1ltre7aHMWZ/SQ==", 2024-04-25T09:06:47.110 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.110 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:47.110 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:06:47.110 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:06:47.110 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.110 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:06:47.110 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.110 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.1", 2024-04-25T09:06:47.110 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAAHCpm4BUIOBAAmbfWUWCun/una5WoemhL6Q==", 2024-04-25T09:06:47.110 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.110 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:47.110 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:06:47.110 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:06:47.111 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.111 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:06:47.111 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.111 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.2", 2024-04-25T09:06:47.111 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAEHCpmFXIaBRAA0cN2GdLSS3jJC+x4RVUUlw==", 2024-04-25T09:06:47.111 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.111 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:47.111 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:06:47.111 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:06:47.111 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.111 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:06:47.111 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.111 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.3", 2024-04-25T09:06:47.111 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAHHCpmUD+YDxAALPvf1wLzhuQmFPo3/vJkdQ==", 2024-04-25T09:06:47.111 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.111 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:47.111 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:06:47.112 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:06:47.112 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.112 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:06:47.112 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.112 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.4", 2024-04-25T09:06:47.112 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQANHCpmLQ0fCBAA1Shz0Pfns+rj5r601hzOnQ==", 2024-04-25T09:06:47.112 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.112 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:47.112 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:06:47.112 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:06:47.112 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.112 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:06:47.112 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.112 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.5", 2024-04-25T09:06:47.112 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAQHCpmyMj1ERAAMRvZ3PFQa9oe6oGemLvfxw==", 2024-04-25T09:06:47.112 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.112 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:47.113 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:06:47.113 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:06:47.113 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.113 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:06:47.113 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.113 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.6", 2024-04-25T09:06:47.113 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQATHCpmKha6GxAAF4zfdFDlylGHHhGI5tVpGA==", 2024-04-25T09:06:47.113 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.113 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:47.113 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:06:47.113 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:06:47.113 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.113 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:06:47.113 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.113 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.7", 2024-04-25T09:06:47.113 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAWHCpmB2lFJhAA3sYYsjS5DIC5fCDz6ur0tA==", 2024-04-25T09:06:47.114 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.114 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:47.114 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:06:47.114 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:06:47.114 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.114 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:06:47.114 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.114 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.0", 2024-04-25T09:06:47.114 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w==", 2024-04-25T09:06:47.114 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.114 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:06:47.114 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow r", 2024-04-25T09:06:47.114 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:06:47.114 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.114 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:06:47.114 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.115 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.1", 2024-04-25T09:06:47.115 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6Gypm1PbHMxAAXMrgpR/xgzfQuuNrculQxA==", 2024-04-25T09:06:47.115 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.115 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:06:47.115 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:06:47.115 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:06:47.115 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:06:47.115 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.115 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:06:47.117 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.117 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.2", 2024-04-25T09:06:47.117 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmrTxjMBAAaqwDl5uiLxhaDIk7m6oDIw==", 2024-04-25T09:06:47.117 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.117 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:06:47.118 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:06:47.118 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:06:47.118 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:06:47.118 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.118 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:06:47.118 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.118 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.3", 2024-04-25T09:06:47.118 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmlAS9ORAAvYbwLnUaDHXOqvEBwJJJcQ==", 2024-04-25T09:06:47.118 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.118 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:06:47.118 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:06:47.118 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:06:47.118 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:06:47.118 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.118 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:06:47.119 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.119 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.admin", 2024-04-25T09:06:47.119 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD5GypmYFhkMhAACwSsE+B9l263vnlJ0LjFkQ==", 2024-04-25T09:06:47.119 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.119 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:06:47.119 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:06:47.119 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:06:47.119 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:06:47.119 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.119 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:06:47.119 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.119 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mgr.x", 2024-04-25T09:06:47.119 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmMSqHDhAAe0nkrXbT7dBbAbI89ExUmw==", 2024-04-25T09:06:47.119 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.119 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:06:47.119 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile mgr", 2024-04-25T09:06:47.119 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:06:47.119 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.120 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:06:47.120 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:47.120 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mgr.y", 2024-04-25T09:06:47.120 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmjCuzChAAomjH5vLVICqSFpyDVQeB4w==", 2024-04-25T09:06:47.120 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:06:47.120 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:06:47.120 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile mgr", 2024-04-25T09:06:47.120 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:06:47.120 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.120 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:47.120 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-04-25T09:06:47.120 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:47.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.122+0000 7fceaa200640 1 -- 172.21.15.173:0/2900746827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce80066f60 msgr2=0x7fce80069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.122+0000 7fceaa200640 1 --2- 172.21.15.173:0/2900746827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce80066f60 0x7fce80069420 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcea40b45f0 tx=0x7fce94009040 comp rx=0 tx=0).stop 2024-04-25T09:06:47.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.122+0000 7fceaa200640 1 -- 172.21.15.173:0/2900746827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcea40ccd30 msgr2=0x7fcea413ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.122+0000 7fceaa200640 1 --2- 172.21.15.173:0/2900746827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcea40ccd30 0x7fcea413ea30 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00c410 tx=0x7fce8c00c8d0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.122+0000 7fceaa200640 1 -- 172.21.15.173:0/2900746827 shutdown_connections 2024-04-25T09:06:47.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.122+0000 7fceaa200640 1 --2- 172.21.15.173:0/2900746827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce80066f60 0x7fce80069420 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.122+0000 7fceaa200640 1 --2- 172.21.15.173:0/2900746827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcea4145250 0x7fcea40c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.122+0000 7fceaa200640 1 --2- 172.21.15.173:0/2900746827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcea40ccd30 0x7fcea413ea30 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.122+0000 7fceaa200640 1 --2- 172.21.15.173:0/2900746827 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcea40cc8b0 0x7fcea40c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.122+0000 7fceaa200640 1 -- 172.21.15.173:0/2900746827 >> 172.21.15.173:0/2900746827 conn(0x7fcea406ac90 msgr2=0x7fcea41434f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:47.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.122+0000 7fceaa200640 1 -- 172.21.15.173:0/2900746827 shutdown_connections 2024-04-25T09:06:47.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.122+0000 7fceaa200640 1 -- 172.21.15.173:0/2900746827 wait complete. 2024-04-25T09:06:47.128 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:47.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.274+0000 7f5a9c200640 1 Processor -- start 2024-04-25T09:06:47.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.274+0000 7f5a9c200640 1 -- start start 2024-04-25T09:06:47.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.274+0000 7f5a9c200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5a940b3b00 0x7f5a941618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.274+0000 7f5a9c200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5a940d03d0 0x7f5a940c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.274+0000 7f5a9c200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a940cf680 con 0x7f5a9415de10 2024-04-25T09:06:47.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.274+0000 7f5a9c200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a940c7010 con 0x7f5a940d03d0 2024-04-25T09:06:47.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.274+0000 7f5a9c200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a940cc390 con 0x7f5a940b3b00 2024-04-25T09:06:47.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.274+0000 7f5a9a200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5a940d03d0 0x7f5a940c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.278+0000 7f5a9a200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5a940d03d0 0x7f5a940c74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40372/0 (socket says 172.21.15.173:40372) 2024-04-25T09:06:47.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.278+0000 7f5a9a200640 1 -- 172.21.15.173:0/3161065155 learned_addr learned my addr 172.21.15.173:0/3161065155 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:47.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.278+0000 7f5a99800640 1 --1- 172.21.15.173:0/3161065155 >> v1:172.21.15.173:6789/0 conn(0x7f5a9415de10 0x7f5a940b33f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:57436/0 (socket says 172.21.15.173:57436) 2024-04-25T09:06:47.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.278+0000 7f5a98e00640 1 --2- 172.21.15.173:0/3161065155 >> v2:172.21.15.194:3300/0 conn(0x7f5a940b3b00 0x7f5a941618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.278+0000 7f5a9a200640 1 -- 172.21.15.173:0/3161065155 >> v2:172.21.15.194:3300/0 conn(0x7f5a940b3b00 msgr2=0x7f5a941618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:47.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.278+0000 7f5a9a200640 1 --2- 172.21.15.173:0/3161065155 >> v2:172.21.15.194:3300/0 conn(0x7f5a940b3b00 0x7f5a941618f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.278+0000 7f5a9a200640 1 -- 172.21.15.173:0/3161065155 >> v1:172.21.15.173:6789/0 conn(0x7f5a9415de10 legacy=0x7f5a940b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.278+0000 7f5a9a200640 1 -- 172.21.15.173:0/3161065155 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9415e1f0 con 0x7f5a940d03d0 2024-04-25T09:06:47.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.278+0000 7f5a93e00640 1 -- 172.21.15.173:0/3161065155 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107562191 0 0) 0x7f5a88001120 con 0x7f5a9415de10 2024-04-25T09:06:47.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.278+0000 7f5a9a200640 1 --2- 172.21.15.173:0/3161065155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a940d03d0 0x7f5a940c74a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f5a940d27e0 tx=0x7f5a8c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbdf2f8783f2c81 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.278+0000 7f5a93e00640 1 -- 172.21.15.173:0/3161065155 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c0a57a0 con 0x7f5a940d03d0 2024-04-25T09:06:47.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.278+0000 7f5a93e00640 1 -- 172.21.15.173:0/3161065155 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c0a5940 con 0x7f5a940d03d0 2024-04-25T09:06:47.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.278+0000 7f5a93e00640 1 -- 172.21.15.173:0/3161065155 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c0a5d10 con 0x7f5a940d03d0 2024-04-25T09:06:47.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9c200640 1 -- 172.21.15.173:0/3161065155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a940d03d0 msgr2=0x7f5a940c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9c200640 1 --2- 172.21.15.173:0/3161065155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a940d03d0 0x7f5a940c74a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f5a940d27e0 tx=0x7f5a8c01c9f0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9c200640 1 -- 172.21.15.173:0/3161065155 shutdown_connections 2024-04-25T09:06:47.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9c200640 1 --2- 172.21.15.173:0/3161065155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a940d03d0 0x7f5a940c74a0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9c200640 1 --2- 172.21.15.173:0/3161065155 >> v2:172.21.15.194:3300/0 conn(0x7f5a940b3b00 0x7f5a941618f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9c200640 1 -- 172.21.15.173:0/3161065155 >> 172.21.15.173:0/3161065155 conn(0x7f5a940d1810 msgr2=0x7f5a940d1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:47.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9c200640 1 -- 172.21.15.173:0/3161065155 shutdown_connections 2024-04-25T09:06:47.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9c200640 1 -- 172.21.15.173:0/3161065155 wait complete. 2024-04-25T09:06:47.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9c200640 1 Processor -- start 2024-04-25T09:06:47.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9c200640 1 -- start start 2024-04-25T09:06:47.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9c200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a940b3b00 0x7f5a941401e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9c200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a940d03d0 0x7f5a941543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9c200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a9415de10 0x7f5a941548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9c200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a940c81f0 con 0x7f5a9415de10 2024-04-25T09:06:47.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9c200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a94162770 con 0x7f5a940d03d0 2024-04-25T09:06:47.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9c200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a940c8370 con 0x7f5a940b3b00 2024-04-25T09:06:47.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9a200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a9415de10 0x7f5a941548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9a200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a9415de10 0x7f5a941548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40384/0 (socket says 172.21.15.173:40384) 2024-04-25T09:06:47.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9a200640 1 -- 172.21.15.173:0/1313420557 learned_addr learned my addr 172.21.15.173:0/1313420557 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:47.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a99800640 1 --2- 172.21.15.173:0/1313420557 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a940b3b00 0x7f5a941401e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a98e00640 1 --2- 172.21.15.173:0/1313420557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a940d03d0 0x7f5a941543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9a200640 1 -- 172.21.15.173:0/1313420557 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a940b3b00 msgr2=0x7f5a941401e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9a200640 1 --2- 172.21.15.173:0/1313420557 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a940b3b00 0x7f5a941401e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9a200640 1 -- 172.21.15.173:0/1313420557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a940d03d0 msgr2=0x7f5a941543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9a200640 1 --2- 172.21.15.173:0/1313420557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a940d03d0 0x7f5a941543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9a200640 1 -- 172.21.15.173:0/1313420557 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a94155110 con 0x7f5a9415de10 2024-04-25T09:06:47.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.282+0000 7f5a9a200640 1 --2- 172.21.15.173:0/1313420557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a9415de10 0x7f5a941548e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c01ced0 tx=0x7f5a8c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.286+0000 7f5a91600640 1 -- 172.21.15.173:0/1313420557 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c0bc030 con 0x7f5a9415de10 2024-04-25T09:06:47.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.286+0000 7f5a91600640 1 -- 172.21.15.173:0/1313420557 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c0039a0 con 0x7f5a9415de10 2024-04-25T09:06:47.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.286+0000 7f5a91600640 1 -- 172.21.15.173:0/1313420557 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c003d50 con 0x7f5a9415de10 2024-04-25T09:06:47.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.286+0000 7f5a9c200640 1 -- 172.21.15.173:0/1313420557 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a941553f0 con 0x7f5a9415de10 2024-04-25T09:06:47.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.286+0000 7f5a9c200640 1 -- 172.21.15.173:0/1313420557 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a941559b0 con 0x7f5a9415de10 2024-04-25T09:06:47.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.286+0000 7f5a9c200640 1 -- 172.21.15.173:0/1313420557 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a94073a40 con 0x7f5a9415de10 2024-04-25T09:06:47.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.286+0000 7f5a91600640 1 -- 172.21.15.173:0/1313420557 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5a8c004020 con 0x7f5a9415de10 2024-04-25T09:06:47.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.286+0000 7f5a91600640 1 --2- 172.21.15.173:0/1313420557 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5a74066f60 0x7f5a74069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.286+0000 7f5a91600640 1 -- 172.21.15.173:0/1313420557 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f5a8c11fcf0 con 0x7f5a9415de10 2024-04-25T09:06:47.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.286+0000 7f5a99800640 1 --2- 172.21.15.173:0/1313420557 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5a74066f60 0x7f5a74069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.286+0000 7f5a99800640 1 --2- 172.21.15.173:0/1313420557 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5a74066f60 0x7f5a74069420 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5a88000f70 tx=0x7f5a88007c10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.290+0000 7f5a91600640 1 -- 172.21.15.173:0/1313420557 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5a8c0165e0 con 0x7f5a9415de10 2024-04-25T09:06:47.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.446+0000 7f5a9c200640 1 -- 172.21.15.173:0/1313420557 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a94157200 con 0x7f5a9415de10 2024-04-25T09:06:47.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.446+0000 7f5a91600640 1 -- 172.21.15.173:0/1313420557 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+13224 (secure 0 0 0) 0x7f5a8c0f0eb0 con 0x7f5a9415de10 2024-04-25T09:06:47.433 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:47.434 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":65,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:06:46.739267+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:47.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.446+0000 7f5a9c200640 1 -- 172.21.15.173:0/1313420557 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5a74066f60 msgr2=0x7f5a74069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.446+0000 7f5a9c200640 1 --2- 172.21.15.173:0/1313420557 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5a74066f60 0x7f5a74069420 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5a88000f70 tx=0x7f5a88007c10 comp rx=0 tx=0).stop 2024-04-25T09:06:47.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.446+0000 7f5a9c200640 1 -- 172.21.15.173:0/1313420557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a9415de10 msgr2=0x7f5a941548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.446+0000 7f5a9c200640 1 --2- 172.21.15.173:0/1313420557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a9415de10 0x7f5a941548e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c01ced0 tx=0x7f5a8c019790 comp rx=0 tx=0).stop 2024-04-25T09:06:47.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.446+0000 7f5a9c200640 1 -- 172.21.15.173:0/1313420557 shutdown_connections 2024-04-25T09:06:47.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.446+0000 7f5a9c200640 1 --2- 172.21.15.173:0/1313420557 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5a74066f60 0x7f5a74069420 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.446+0000 7f5a9c200640 1 --2- 172.21.15.173:0/1313420557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a9415de10 0x7f5a941548e0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.446+0000 7f5a9c200640 1 --2- 172.21.15.173:0/1313420557 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a940d03d0 0x7f5a941543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.446+0000 7f5a9c200640 1 --2- 172.21.15.173:0/1313420557 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a940b3b00 0x7f5a941401e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.446+0000 7f5a9c200640 1 -- 172.21.15.173:0/1313420557 >> 172.21.15.173:0/1313420557 conn(0x7f5a940d1810 msgr2=0x7f5a940cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:47.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.446+0000 7f5a9c200640 1 -- 172.21.15.173:0/1313420557 shutdown_connections 2024-04-25T09:06:47.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.446+0000 7f5a9c200640 1 -- 172.21.15.173:0/1313420557 wait complete. 2024-04-25T09:06:47.454 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:06:47.455 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:06:47.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b3de00640 1 Processor -- start 2024-04-25T09:06:47.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b3de00640 1 -- start start 2024-04-25T09:06:47.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b3de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b3806f5b0 0x7f2b380aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b3de00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3806f9f0 con 0x7f2b3806e1c0 2024-04-25T09:06:47.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b3de00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3806ae30 con 0x7f2b380ad3f0 2024-04-25T09:06:47.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b3de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b380b3170 con 0x7f2b3806f5b0 2024-04-25T09:06:47.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b36a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f2b3806e1c0 0x7f2b3806bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:57444/0 (socket says 172.21.15.173:57444) 2024-04-25T09:06:47.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b36a00640 1 -- 172.21.15.173:0/1644778271 learned_addr learned my addr 172.21.15.173:0/1644778271 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b36000640 1 --2- 172.21.15.173:0/1644778271 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b3806f5b0 0x7f2b380aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b35600640 1 -- 172.21.15.173:0/1644778271 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596411783 0 0) 0x7f2b3806f9f0 con 0x7f2b3806e1c0 2024-04-25T09:06:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b35600640 1 -- 172.21.15.173:0/1644778271 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b1c003530 con 0x7f2b3806e1c0 2024-04-25T09:06:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b35600640 1 -- 172.21.15.173:0/1644778271 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3928623864 0 0) 0x7f2b1c003530 con 0x7f2b3806e1c0 2024-04-25T09:06:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b35600640 1 -- 172.21.15.173:0/1644778271 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b3806f5b0 msgr2=0x7f2b380aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b35600640 1 --2- 172.21.15.173:0/1644778271 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b3806f5b0 0x7f2b380aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b35600640 1 -- 172.21.15.173:0/1644778271 >> v1:172.21.15.194:6789/0 conn(0x7f2b380ad3f0 legacy=0x7f2b381677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b35600640 1 -- 172.21.15.173:0/1644778271 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3806b110 con 0x7f2b3806e1c0 2024-04-25T09:06:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b35600640 1 -- 172.21.15.173:0/1644778271 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f2b28001680 con 0x7f2b3806e1c0 2024-04-25T09:06:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b35600640 1 -- 172.21.15.173:0/1644778271 >> v1:172.21.15.173:6789/0 conn(0x7f2b3806e1c0 legacy=0x7f2b3806bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b35600640 1 --2- 172.21.15.173:0/1644778271 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b3806f5b0 0x7f2b1c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b35600640 1 --2- 172.21.15.173:0/1644778271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b1c003fc0 0x7f2b1c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b35600640 1 --2- 172.21.15.173:0/1644778271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b1c004d50 0x7f2b1c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b35600640 1 -- 172.21.15.173:0/1644778271 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c00bb70 con 0x7f2b1c003fc0 2024-04-25T09:06:47.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b35600640 1 -- 172.21.15.173:0/1644778271 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c00bd20 con 0x7f2b1c004d50 2024-04-25T09:06:47.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b35600640 1 -- 172.21.15.173:0/1644778271 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c00bf20 con 0x7f2b3806f5b0 2024-04-25T09:06:47.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b36000640 1 --2- 172.21.15.173:0/1644778271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b1c003fc0 0x7f2b1c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b36a00640 1 --2- 172.21.15.173:0/1644778271 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b3806f5b0 0x7f2b1c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b37400640 1 --2- 172.21.15.173:0/1644778271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b1c004d50 0x7f2b1c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b36000640 1 -- 172.21.15.173:0/1644778271 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b3806f5b0 msgr2=0x7f2b1c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:47.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b36000640 1 --2- 172.21.15.173:0/1644778271 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b3806f5b0 0x7f2b1c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b36000640 1 -- 172.21.15.173:0/1644778271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b1c004d50 msgr2=0x7f2b1c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:47.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b36000640 1 --2- 172.21.15.173:0/1644778271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b1c004d50 0x7f2b1c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.606+0000 7f2b36000640 1 -- 172.21.15.173:0/1644778271 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c003530 con 0x7f2b1c003fc0 2024-04-25T09:06:47.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.610+0000 7f2b36000640 1 --2- 172.21.15.173:0/1644778271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b1c003fc0 0x7f2b1c004810 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009ae0 tx=0x7f2b2401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0966e6e860139c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.610+0000 7f2b35600640 1 -- 172.21.15.173:0/1644778271 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b240b2070 con 0x7f2b1c003fc0 2024-04-25T09:06:47.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.610+0000 7f2b35600640 1 -- 172.21.15.173:0/1644778271 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b240a55a0 con 0x7f2b1c003fc0 2024-04-25T09:06:47.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.610+0000 7f2b35600640 1 -- 172.21.15.173:0/1644778271 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b240096b0 con 0x7f2b1c003fc0 2024-04-25T09:06:47.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.610+0000 7f2b3de00640 1 -- 172.21.15.173:0/1644778271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b1c003fc0 msgr2=0x7f2b1c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.610+0000 7f2b3de00640 1 --2- 172.21.15.173:0/1644778271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b1c003fc0 0x7f2b1c004810 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009ae0 tx=0x7f2b2401c9b0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.610+0000 7f2b37400640 1 -- 172.21.15.173:0/1644778271 reap_dead start 2024-04-25T09:06:47.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.610+0000 7f2b3de00640 1 -- 172.21.15.173:0/1644778271 shutdown_connections 2024-04-25T09:06:47.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.610+0000 7f2b3de00640 1 -- 172.21.15.173:0/1644778271 >> 172.21.15.173:0/1644778271 conn(0x7f2b380cfed0 msgr2=0x7f2b380d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:47.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.610+0000 7f2b3de00640 1 -- 172.21.15.173:0/1644778271 shutdown_connections 2024-04-25T09:06:47.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.610+0000 7f2b3de00640 1 -- 172.21.15.173:0/1644778271 wait complete. 2024-04-25T09:06:47.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b3de00640 1 Processor -- start 2024-04-25T09:06:47.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b3de00640 1 -- start start 2024-04-25T09:06:47.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b3de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b38146710 0x7f2b38150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b3de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b38146af0 0x7f2b381f3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b3de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b381f3e90 0x7f2b381581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b3de00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3806b6d0 con 0x7f2b381f3e90 2024-04-25T09:06:47.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b3de00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3815e070 con 0x7f2b38146af0 2024-04-25T09:06:47.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b3de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3806b9b0 con 0x7f2b38146710 2024-04-25T09:06:47.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b37400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b381f3e90 0x7f2b381581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b37400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b381f3e90 0x7f2b381581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40400/0 (socket says 172.21.15.173:40400) 2024-04-25T09:06:47.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b37400640 1 -- 172.21.15.173:0/3431457205 learned_addr learned my addr 172.21.15.173:0/3431457205 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:47.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b36000640 1 --2- 172.21.15.173:0/3431457205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b38146af0 0x7f2b381f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b36a00640 1 --2- 172.21.15.173:0/3431457205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b38146710 0x7f2b38150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b37400640 1 -- 172.21.15.173:0/3431457205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b38146710 msgr2=0x7f2b38150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b37400640 1 --2- 172.21.15.173:0/3431457205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b38146710 0x7f2b38150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b37400640 1 -- 172.21.15.173:0/3431457205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b38146af0 msgr2=0x7f2b381f3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b37400640 1 --2- 172.21.15.173:0/3431457205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b38146af0 0x7f2b381f3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b37400640 1 -- 172.21.15.173:0/3431457205 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3815fde0 con 0x7f2b381f3e90 2024-04-25T09:06:47.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b37400640 1 --2- 172.21.15.173:0/3431457205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b381f3e90 0x7f2b381581c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f2b380ad7d0 tx=0x7f2b3000fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b2f400640 1 -- 172.21.15.173:0/3431457205 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3001a070 con 0x7f2b381f3e90 2024-04-25T09:06:47.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b2f400640 1 -- 172.21.15.173:0/3431457205 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b30006d70 con 0x7f2b381f3e90 2024-04-25T09:06:47.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b3de00640 1 -- 172.21.15.173:0/3431457205 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b381600c0 con 0x7f2b381f3e90 2024-04-25T09:06:47.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b2f400640 1 -- 172.21.15.173:0/3431457205 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b30003ba0 con 0x7f2b381f3e90 2024-04-25T09:06:47.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b3de00640 1 -- 172.21.15.173:0/3431457205 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b38150c50 con 0x7f2b381f3e90 2024-04-25T09:06:47.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.614+0000 7f2b3de00640 1 -- 172.21.15.173:0/3431457205 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b38073ab0 con 0x7f2b381f3e90 2024-04-25T09:06:47.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.618+0000 7f2b2f400640 1 -- 172.21.15.173:0/3431457205 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2b3001d070 con 0x7f2b381f3e90 2024-04-25T09:06:47.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.618+0000 7f2b2f400640 1 --2- 172.21.15.173:0/3431457205 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2b18066f60 0x7f2b18069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.618+0000 7f2b2f400640 1 -- 172.21.15.173:0/3431457205 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f2b30084380 con 0x7f2b381f3e90 2024-04-25T09:06:47.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.618+0000 7f2b36a00640 1 --2- 172.21.15.173:0/3431457205 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2b18066f60 0x7f2b18069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.618+0000 7f2b36a00640 1 --2- 172.21.15.173:0/3431457205 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2b18066f60 0x7f2b18069420 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2b28001060 tx=0x7f2b28000f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.622+0000 7f2b2f400640 1 -- 172.21.15.173:0/3431457205 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2b30054f00 con 0x7f2b381f3e90 2024-04-25T09:06:47.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.782+0000 7f2b3de00640 1 -- 172.21.15.173:0/3431457205 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2b380b1740 con 0x7f2b381f3e90 2024-04-25T09:06:47.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.782+0000 7f2b2f400640 1 -- 172.21.15.173:0/3431457205 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2b30058fa0 con 0x7f2b381f3e90 2024-04-25T09:06:47.770 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:06:47.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.782+0000 7f2b3de00640 1 -- 172.21.15.173:0/3431457205 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2b18066f60 msgr2=0x7f2b18069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.782+0000 7f2b3de00640 1 --2- 172.21.15.173:0/3431457205 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2b18066f60 0x7f2b18069420 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2b28001060 tx=0x7f2b28000f90 comp rx=0 tx=0).stop 2024-04-25T09:06:47.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.782+0000 7f2b3de00640 1 -- 172.21.15.173:0/3431457205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b381f3e90 msgr2=0x7f2b381581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.782+0000 7f2b3de00640 1 --2- 172.21.15.173:0/3431457205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b381f3e90 0x7f2b381581c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f2b380ad7d0 tx=0x7f2b3000fcd0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.782+0000 7f2b3de00640 1 -- 172.21.15.173:0/3431457205 shutdown_connections 2024-04-25T09:06:47.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.782+0000 7f2b3de00640 1 --2- 172.21.15.173:0/3431457205 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2b18066f60 0x7f2b18069420 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.782+0000 7f2b3de00640 1 --2- 172.21.15.173:0/3431457205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b381f3e90 0x7f2b381581c0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.782+0000 7f2b3de00640 1 --2- 172.21.15.173:0/3431457205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b38146af0 0x7f2b381f3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.782+0000 7f2b3de00640 1 --2- 172.21.15.173:0/3431457205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b38146710 0x7f2b38150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.782+0000 7f2b3de00640 1 -- 172.21.15.173:0/3431457205 >> 172.21.15.173:0/3431457205 conn(0x7f2b380cfed0 msgr2=0x7f2b3806e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:47.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.786+0000 7f2b3de00640 1 -- 172.21.15.173:0/3431457205 shutdown_connections 2024-04-25T09:06:47.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.786+0000 7f2b3de00640 1 -- 172.21.15.173:0/3431457205 wait complete. 2024-04-25T09:06:47.791 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:06:47.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.938+0000 7f2ba8c00640 1 Processor -- start 2024-04-25T09:06:47.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.938+0000 7f2ba8c00640 1 -- start start 2024-04-25T09:06:47.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.938+0000 7f2ba8c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2ba415ba20 0x7f2ba415be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.938+0000 7f2ba8c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ba40b70f0 0x7f2ba406f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.938+0000 7f2ba8c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba415c460 con 0x7f2ba40b7550 2024-04-25T09:06:47.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.938+0000 7f2ba8c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba415c740 con 0x7f2ba415ba20 2024-04-25T09:06:47.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.938+0000 7f2ba8c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba415ca20 con 0x7f2ba40b70f0 2024-04-25T09:06:47.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.938+0000 7f2ba1e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2ba415ba20 0x7f2ba415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.938+0000 7f2ba1e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2ba415ba20 0x7f2ba415be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40414/0 (socket says 172.21.15.173:40414) 2024-04-25T09:06:47.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.938+0000 7f2ba1e00640 1 -- 172.21.15.173:0/3787167091 learned_addr learned my addr 172.21.15.173:0/3787167091 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:47.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.938+0000 7f2b99400640 1 --2- 172.21.15.173:0/3787167091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ba40b70f0 0x7f2ba406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.938+0000 7f2ba1e00640 1 -- 172.21.15.173:0/3787167091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ba40b70f0 msgr2=0x7f2ba406f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:47.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.938+0000 7f2ba1e00640 1 --2- 172.21.15.173:0/3787167091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ba40b70f0 0x7f2ba406f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.938+0000 7f2ba1e00640 1 -- 172.21.15.173:0/3787167091 >> v1:172.21.15.194:6789/0 conn(0x7f2ba40b7550 legacy=0x7f2ba40d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:47.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.938+0000 7f2ba1e00640 1 -- 172.21.15.173:0/3787167091 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba415cd00 con 0x7f2ba415ba20 2024-04-25T09:06:47.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.938+0000 7f2b99400640 1 --2- 172.21.15.173:0/3787167091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ba40b70f0 0x7f2ba406f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:47.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.942+0000 7f2ba1e00640 1 --2- 172.21.15.173:0/3787167091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ba415ba20 0x7f2ba415be00 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009870 tx=0x7f2b9401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af46e41ff1726a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.942+0000 7f2ba1400640 1 -- 172.21.15.173:0/3787167091 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b940b1070 con 0x7f2ba415ba20 2024-04-25T09:06:47.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.942+0000 7f2ba1400640 1 -- 172.21.15.173:0/3787167091 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b940ac620 con 0x7f2ba415ba20 2024-04-25T09:06:47.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.942+0000 7f2ba1400640 1 -- 172.21.15.173:0/3787167091 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b940ac9f0 con 0x7f2ba415ba20 2024-04-25T09:06:47.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.942+0000 7f2ba8c00640 1 -- 172.21.15.173:0/3787167091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ba415ba20 msgr2=0x7f2ba415be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.942+0000 7f2ba8c00640 1 --2- 172.21.15.173:0/3787167091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ba415ba20 0x7f2ba415be00 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009870 tx=0x7f2b9401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.942+0000 7f2ba8c00640 1 -- 172.21.15.173:0/3787167091 shutdown_connections 2024-04-25T09:06:47.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.942+0000 7f2ba8c00640 1 --2- 172.21.15.173:0/3787167091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ba40b70f0 0x7f2ba406f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.942+0000 7f2ba8c00640 1 --2- 172.21.15.173:0/3787167091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ba415ba20 0x7f2ba415be00 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.942+0000 7f2ba8c00640 1 -- 172.21.15.173:0/3787167091 >> 172.21.15.173:0/3787167091 conn(0x7f2ba4061880 msgr2=0x7f2ba4061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:47.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.942+0000 7f2ba8c00640 1 -- 172.21.15.173:0/3787167091 shutdown_connections 2024-04-25T09:06:47.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.942+0000 7f2ba8c00640 1 -- 172.21.15.173:0/3787167091 wait complete. 2024-04-25T09:06:47.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2ba8c00640 1 Processor -- start 2024-04-25T09:06:47.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2ba8c00640 1 -- start start 2024-04-25T09:06:47.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2ba8c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ba40b70f0 0x7f2ba4156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2ba8c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ba415ba20 0x7f2ba40c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2ba8c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ba406ce20 0x7f2ba40d0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2ba8c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba415e2b0 con 0x7f2ba415ba20 2024-04-25T09:06:47.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2ba8c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba415e130 con 0x7f2ba406ce20 2024-04-25T09:06:47.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2ba8c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba415e430 con 0x7f2ba40b70f0 2024-04-25T09:06:47.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2b99400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ba415ba20 0x7f2ba40c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2b99400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ba415ba20 0x7f2ba40c98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40422/0 (socket says 172.21.15.173:40422) 2024-04-25T09:06:47.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2b99400640 1 -- 172.21.15.173:0/3677017007 learned_addr learned my addr 172.21.15.173:0/3677017007 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:47.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2ba1e00640 1 --2- 172.21.15.173:0/3677017007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ba40b70f0 0x7f2ba4156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2ba2800640 1 --2- 172.21.15.173:0/3677017007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ba406ce20 0x7f2ba40d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2b99400640 1 -- 172.21.15.173:0/3677017007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ba40b70f0 msgr2=0x7f2ba4156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2b99400640 1 --2- 172.21.15.173:0/3677017007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ba40b70f0 0x7f2ba4156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2b99400640 1 -- 172.21.15.173:0/3677017007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ba406ce20 msgr2=0x7f2ba40d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2b99400640 1 --2- 172.21.15.173:0/3677017007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ba406ce20 0x7f2ba40d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2b99400640 1 -- 172.21.15.173:0/3677017007 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba40ca1b0 con 0x7f2ba415ba20 2024-04-25T09:06:47.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2ba2800640 1 --2- 172.21.15.173:0/3677017007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ba406ce20 0x7f2ba40d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:47.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2b99400640 1 --2- 172.21.15.173:0/3677017007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ba415ba20 0x7f2ba40c98b0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00c7c0 tx=0x7f2b8c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2b9aa00640 1 -- 172.21.15.173:0/3677017007 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c007a30 con 0x7f2ba415ba20 2024-04-25T09:06:47.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2b9aa00640 1 -- 172.21.15.173:0/3677017007 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c007bd0 con 0x7f2ba415ba20 2024-04-25T09:06:47.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2b9aa00640 1 -- 172.21.15.173:0/3677017007 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c0113f0 con 0x7f2ba415ba20 2024-04-25T09:06:47.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2ba8c00640 1 -- 172.21.15.173:0/3677017007 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba40ca490 con 0x7f2ba415ba20 2024-04-25T09:06:47.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2ba8c00640 1 -- 172.21.15.173:0/3677017007 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba40caa50 con 0x7f2ba415ba20 2024-04-25T09:06:47.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.946+0000 7f2ba8c00640 1 -- 172.21.15.173:0/3677017007 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba4073a40 con 0x7f2ba415ba20 2024-04-25T09:06:47.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.950+0000 7f2b9aa00640 1 -- 172.21.15.173:0/3677017007 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2b8c011590 con 0x7f2ba415ba20 2024-04-25T09:06:47.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.950+0000 7f2b9aa00640 1 --2- 172.21.15.173:0/3677017007 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2b80066f90 0x7f2b80069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.950+0000 7f2b9aa00640 1 -- 172.21.15.173:0/3677017007 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f2b8c084fd0 con 0x7f2ba415ba20 2024-04-25T09:06:47.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.950+0000 7f2ba1e00640 1 --2- 172.21.15.173:0/3677017007 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2b80066f90 0x7f2b80069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.950+0000 7f2ba1e00640 1 --2- 172.21.15.173:0/3677017007 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2b80066f90 0x7f2b80069450 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2b940ae000 tx=0x7f2b940a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:47.954+0000 7f2b9aa00640 1 -- 172.21.15.173:0/3677017007 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2b8c015020 con 0x7f2ba415ba20 2024-04-25T09:06:48.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.110+0000 7f2ba8c00640 1 -- 172.21.15.173:0/3677017007 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2ba40cefc0 con 0x7f2ba415ba20 2024-04-25T09:06:48.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.110+0000 7f2b9aa00640 1 -- 172.21.15.173:0/3677017007 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v65) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2b8c055b40 con 0x7f2ba415ba20 2024-04-25T09:06:48.097 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:48.098 INFO:teuthology.orchestra.run.smithi173.stdout:[ 2024-04-25T09:06:48.098 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:06:48.098 INFO:teuthology.orchestra.run.smithi173.stdout: "poolnum": 1, 2024-04-25T09:06:48.098 INFO:teuthology.orchestra.run.smithi173.stdout: "poolname": ".mgr" 2024-04-25T09:06:48.098 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:06:48.098 INFO:teuthology.orchestra.run.smithi173.stdout:] 2024-04-25T09:06:48.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.110+0000 7f2ba8c00640 1 -- 172.21.15.173:0/3677017007 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2b80066f90 msgr2=0x7f2b80069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.110+0000 7f2ba8c00640 1 --2- 172.21.15.173:0/3677017007 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2b80066f90 0x7f2b80069450 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2b940ae000 tx=0x7f2b940a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:48.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.110+0000 7f2ba8c00640 1 -- 172.21.15.173:0/3677017007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ba415ba20 msgr2=0x7f2ba40c98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.110+0000 7f2ba8c00640 1 --2- 172.21.15.173:0/3677017007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ba415ba20 0x7f2ba40c98b0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00c7c0 tx=0x7f2b8c00cc80 comp rx=0 tx=0).stop 2024-04-25T09:06:48.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.110+0000 7f2ba8c00640 1 -- 172.21.15.173:0/3677017007 shutdown_connections 2024-04-25T09:06:48.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.110+0000 7f2ba8c00640 1 --2- 172.21.15.173:0/3677017007 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2b80066f90 0x7f2b80069450 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.110+0000 7f2ba8c00640 1 --2- 172.21.15.173:0/3677017007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ba406ce20 0x7f2ba40d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.110+0000 7f2ba8c00640 1 --2- 172.21.15.173:0/3677017007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ba415ba20 0x7f2ba40c98b0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.110+0000 7f2ba8c00640 1 --2- 172.21.15.173:0/3677017007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ba40b70f0 0x7f2ba4156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.110+0000 7f2ba8c00640 1 -- 172.21.15.173:0/3677017007 >> 172.21.15.173:0/3677017007 conn(0x7f2ba4061880 msgr2=0x7f2ba40b5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:48.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.110+0000 7f2ba8c00640 1 -- 172.21.15.173:0/3677017007 shutdown_connections 2024-04-25T09:06:48.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.110+0000 7f2ba8c00640 1 -- 172.21.15.173:0/3677017007 wait complete. 2024-04-25T09:06:48.118 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:06:48.119 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:06:48.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.270+0000 7f8e06c00640 1 Processor -- start 2024-04-25T09:06:48.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.270+0000 7f8e06c00640 1 -- start start 2024-04-25T09:06:48.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.270+0000 7f8e06c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8e000d02a0 0x7f8e00099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.270+0000 7f8e06c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8e00099f90 0x7f8e000c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.270+0000 7f8e06c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e000cc7a0 con 0x7f8e0015bab0 2024-04-25T09:06:48.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.270+0000 7f8e06c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e000cca80 con 0x7f8e000d02a0 2024-04-25T09:06:48.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.270+0000 7f8e06c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e000ccd60 con 0x7f8e00099f90 2024-04-25T09:06:48.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.270+0000 7f8dffe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f8e0015bab0 0x7f8e000cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:57458/0 (socket says 172.21.15.173:57458) 2024-04-25T09:06:48.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.270+0000 7f8dffe00640 1 -- 172.21.15.173:0/1566940467 learned_addr learned my addr 172.21.15.173:0/1566940467 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:48.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.270+0000 7f8df7400640 1 --2- 172.21.15.173:0/1566940467 >> v2:172.21.15.173:3300/0 conn(0x7f8e000d02a0 0x7f8e00099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8df7400640 1 -- 172.21.15.173:0/1566940467 >> v2:172.21.15.194:3300/0 conn(0x7f8e00099f90 msgr2=0x7f8e000c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:48.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8e04c00640 1 --2- 172.21.15.173:0/1566940467 >> v2:172.21.15.194:3300/0 conn(0x7f8e00099f90 0x7f8e000c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8df7400640 1 --2- 172.21.15.173:0/1566940467 >> v2:172.21.15.194:3300/0 conn(0x7f8e00099f90 0x7f8e000c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8df7400640 1 -- 172.21.15.173:0/1566940467 >> v1:172.21.15.173:6789/0 conn(0x7f8e0015bab0 legacy=0x7f8e000cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8df7400640 1 -- 172.21.15.173:0/1566940467 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e000cd040 con 0x7f8e000d02a0 2024-04-25T09:06:48.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8dff400640 1 -- 172.21.15.173:0/1566940467 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476398781 0 0) 0x7f8e000cc7a0 con 0x7f8e0015bab0 2024-04-25T09:06:48.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8e04c00640 1 --2- 172.21.15.173:0/1566940467 >> v2:172.21.15.194:3300/0 conn(0x7f8e00099f90 0x7f8e000c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:48.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8df7400640 1 --2- 172.21.15.173:0/1566940467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e000d02a0 0x7f8e00099a50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8e00160730 tx=0x7f8de801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52838d4aab555245 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:48.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8dff400640 1 -- 172.21.15.173:0/1566940467 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de80b1070 con 0x7f8e000d02a0 2024-04-25T09:06:48.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8dff400640 1 -- 172.21.15.173:0/1566940467 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de80ac5f0 con 0x7f8e000d02a0 2024-04-25T09:06:48.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8dff400640 1 -- 172.21.15.173:0/1566940467 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de80ac9c0 con 0x7f8e000d02a0 2024-04-25T09:06:48.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8e06c00640 1 -- 172.21.15.173:0/1566940467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e000d02a0 msgr2=0x7f8e00099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8e06c00640 1 --2- 172.21.15.173:0/1566940467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e000d02a0 0x7f8e00099a50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8e00160730 tx=0x7f8de801cee0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8e06c00640 1 -- 172.21.15.173:0/1566940467 shutdown_connections 2024-04-25T09:06:48.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8e06c00640 1 --2- 172.21.15.173:0/1566940467 >> v2:172.21.15.194:3300/0 conn(0x7f8e00099f90 0x7f8e000c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8e06c00640 1 --2- 172.21.15.173:0/1566940467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e000d02a0 0x7f8e00099a50 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8e06c00640 1 -- 172.21.15.173:0/1566940467 >> 172.21.15.173:0/1566940467 conn(0x7f8e000b32a0 msgr2=0x7f8e000b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:48.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8e06c00640 1 -- 172.21.15.173:0/1566940467 shutdown_connections 2024-04-25T09:06:48.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.274+0000 7f8e06c00640 1 -- 172.21.15.173:0/1566940467 wait complete. 2024-04-25T09:06:48.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8e06c00640 1 Processor -- start 2024-04-25T09:06:48.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8e06c00640 1 -- start start 2024-04-25T09:06:48.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8e06c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e00099f90 0x7f8e0015a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8e06c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e000d02a0 0x7f8e000b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8e06c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e0015bab0 0x7f8e00156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8e06c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000cc540 con 0x7f8e000d02a0 2024-04-25T09:06:48.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8e06c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000cc3c0 con 0x7f8e00099f90 2024-04-25T09:06:48.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8e06c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000cf540 con 0x7f8e0015bab0 2024-04-25T09:06:48.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8df7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e000d02a0 0x7f8e000b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8df7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e000d02a0 0x7f8e000b6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40444/0 (socket says 172.21.15.173:40444) 2024-04-25T09:06:48.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8df7400640 1 -- 172.21.15.173:0/2349113035 learned_addr learned my addr 172.21.15.173:0/2349113035 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:48.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8df7400640 1 -- 172.21.15.173:0/2349113035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e0015bab0 msgr2=0x7f8e00156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8df7400640 1 --2- 172.21.15.173:0/2349113035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e0015bab0 0x7f8e00156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8df7400640 1 -- 172.21.15.173:0/2349113035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e00099f90 msgr2=0x7f8e0015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8df7400640 1 --2- 172.21.15.173:0/2349113035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e00099f90 0x7f8e0015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8df7400640 1 -- 172.21.15.173:0/2349113035 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e000b6f80 con 0x7f8e000d02a0 2024-04-25T09:06:48.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8df7400640 1 --2- 172.21.15.173:0/2349113035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e000d02a0 0x7f8e000b6a40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f8de801ab30 tx=0x7f8de8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:48.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8dfcc00640 1 -- 172.21.15.173:0/2349113035 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de80b1040 con 0x7f8e000d02a0 2024-04-25T09:06:48.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8dfcc00640 1 -- 172.21.15.173:0/2349113035 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de80bc070 con 0x7f8e000d02a0 2024-04-25T09:06:48.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8e06c00640 1 -- 172.21.15.173:0/2349113035 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e000c6eb0 con 0x7f8e000d02a0 2024-04-25T09:06:48.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.278+0000 7f8dfcc00640 1 -- 172.21.15.173:0/2349113035 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de80b5650 con 0x7f8e000d02a0 2024-04-25T09:06:48.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.282+0000 7f8e06c00640 1 -- 172.21.15.173:0/2349113035 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e000c7470 con 0x7f8e000d02a0 2024-04-25T09:06:48.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.282+0000 7f8e06c00640 1 -- 172.21.15.173:0/2349113035 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e00073ab0 con 0x7f8e000d02a0 2024-04-25T09:06:48.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.282+0000 7f8dfcc00640 1 -- 172.21.15.173:0/2349113035 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8de80b57f0 con 0x7f8e000d02a0 2024-04-25T09:06:48.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.282+0000 7f8dfcc00640 1 --2- 172.21.15.173:0/2349113035 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8ddc066f60 0x7f8ddc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.282+0000 7f8dfcc00640 1 -- 172.21.15.173:0/2349113035 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f8de811eb70 con 0x7f8e000d02a0 2024-04-25T09:06:48.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.282+0000 7f8dffe00640 1 --2- 172.21.15.173:0/2349113035 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8ddc066f60 0x7f8ddc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.282+0000 7f8dffe00640 1 --2- 172.21.15.173:0/2349113035 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8ddc066f60 0x7f8ddc069420 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8df00015a0 tx=0x7f8df0007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:48.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.286+0000 7f8dfcc00640 1 -- 172.21.15.173:0/2349113035 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8de80a9070 con 0x7f8e000d02a0 2024-04-25T09:06:48.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.446+0000 7f8e06c00640 1 -- 172.21.15.173:0/2349113035 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8e000b73a0 con 0x7f8e000d02a0 2024-04-25T09:06:48.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.742+0000 7f8dfcc00640 1 -- 172.21.15.173:0/2349113035 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v66) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8de8016070 con 0x7f8e000d02a0 2024-04-25T09:06:48.731 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' created 2024-04-25T09:06:48.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.746+0000 7f8e06c00640 1 -- 172.21.15.173:0/2349113035 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8ddc066f60 msgr2=0x7f8ddc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.746+0000 7f8e06c00640 1 --2- 172.21.15.173:0/2349113035 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8ddc066f60 0x7f8ddc069420 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8df00015a0 tx=0x7f8df0007970 comp rx=0 tx=0).stop 2024-04-25T09:06:48.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.746+0000 7f8e06c00640 1 -- 172.21.15.173:0/2349113035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e000d02a0 msgr2=0x7f8e000b6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.746+0000 7f8e06c00640 1 --2- 172.21.15.173:0/2349113035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e000d02a0 0x7f8e000b6a40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f8de801ab30 tx=0x7f8de8019220 comp rx=0 tx=0).stop 2024-04-25T09:06:48.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.746+0000 7f8e06c00640 1 -- 172.21.15.173:0/2349113035 shutdown_connections 2024-04-25T09:06:48.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.746+0000 7f8e06c00640 1 --2- 172.21.15.173:0/2349113035 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8ddc066f60 0x7f8ddc069420 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.746+0000 7f8e06c00640 1 --2- 172.21.15.173:0/2349113035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e0015bab0 0x7f8e00156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.746+0000 7f8e06c00640 1 --2- 172.21.15.173:0/2349113035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e000d02a0 0x7f8e000b6a40 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.746+0000 7f8e06c00640 1 --2- 172.21.15.173:0/2349113035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e00099f90 0x7f8e0015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.746+0000 7f8e06c00640 1 -- 172.21.15.173:0/2349113035 >> 172.21.15.173:0/2349113035 conn(0x7f8e000b32a0 msgr2=0x7f8e0015ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:48.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.746+0000 7f8e06c00640 1 -- 172.21.15.173:0/2349113035 shutdown_connections 2024-04-25T09:06:48.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.746+0000 7f8e06c00640 1 -- 172.21.15.173:0/2349113035 wait complete. 2024-04-25T09:06:48.757 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:06:48.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.910+0000 7f87b5200640 1 Processor -- start 2024-04-25T09:06:48.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.914+0000 7f87b5200640 1 -- start start 2024-04-25T09:06:48.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.914+0000 7f87b5200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87b00b3fe0 0x7f87b00b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.914+0000 7f87b5200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b006d4b0 con 0x7f87b00cc260 2024-04-25T09:06:48.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.914+0000 7f87b5200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b006d790 con 0x7f87b0145290 2024-04-25T09:06:48.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.914+0000 7f87b5200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b006da70 con 0x7f87b00b3fe0 2024-04-25T09:06:48.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.914+0000 7f87ae800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f87b00cc260 0x7f87b00cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:57474/0 (socket says 172.21.15.173:57474) 2024-04-25T09:06:48.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.914+0000 7f87ae800640 1 -- 172.21.15.173:0/2174029108 learned_addr learned my addr 172.21.15.173:0/2174029108 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:48.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.914+0000 7f87ad400640 1 --2- 172.21.15.173:0/2174029108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87b00b3fe0 0x7f87b00b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.914+0000 7f87aca00640 1 -- 172.21.15.173:0/2174029108 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588174273 0 0) 0x7f87b006d4b0 con 0x7f87b00cc260 2024-04-25T09:06:48.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.914+0000 7f87aca00640 1 -- 172.21.15.173:0/2174029108 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8794003530 con 0x7f87b00cc260 2024-04-25T09:06:48.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.914+0000 7f87aca00640 1 -- 172.21.15.173:0/2174029108 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060896012 0 0) 0x7f87b006d790 con 0x7f87b0145290 2024-04-25T09:06:48.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.914+0000 7f87ad400640 1 -- 172.21.15.173:0/2174029108 >> v1:172.21.15.194:6789/0 conn(0x7f87b0145290 legacy=0x7f87b015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.914+0000 7f87ad400640 1 -- 172.21.15.173:0/2174029108 >> v1:172.21.15.173:6789/0 conn(0x7f87b00cc260 legacy=0x7f87b00cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.914+0000 7f87ad400640 1 -- 172.21.15.173:0/2174029108 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b006dd50 con 0x7f87b00b3fe0 2024-04-25T09:06:48.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.918+0000 7f87ad400640 1 --2- 172.21.15.173:0/2174029108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87b00b3fe0 0x7f87b00b4420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f879c0097f0 tx=0x7f879c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=308bf90da8e89b7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:48.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.918+0000 7f87aca00640 1 -- 172.21.15.173:0/2174029108 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0b0070 con 0x7f87b00b3fe0 2024-04-25T09:06:48.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.918+0000 7f87aca00640 1 -- 172.21.15.173:0/2174029108 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c0ab600 con 0x7f87b00b3fe0 2024-04-25T09:06:48.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.918+0000 7f87aca00640 1 -- 172.21.15.173:0/2174029108 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0ab9d0 con 0x7f87b00b3fe0 2024-04-25T09:06:48.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.918+0000 7f87b5200640 1 -- 172.21.15.173:0/2174029108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87b00b3fe0 msgr2=0x7f87b00b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.918+0000 7f87b5200640 1 --2- 172.21.15.173:0/2174029108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87b00b3fe0 0x7f87b00b4420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f879c0097f0 tx=0x7f879c01c3c0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.918+0000 7f87b5200640 1 -- 172.21.15.173:0/2174029108 shutdown_connections 2024-04-25T09:06:48.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.918+0000 7f87b5200640 1 --2- 172.21.15.173:0/2174029108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87b00b3fe0 0x7f87b00b4420 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.918+0000 7f87b5200640 1 -- 172.21.15.173:0/2174029108 >> 172.21.15.173:0/2174029108 conn(0x7f87b006ac90 msgr2=0x7f87b006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:48.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.918+0000 7f87b5200640 1 -- 172.21.15.173:0/2174029108 shutdown_connections 2024-04-25T09:06:48.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.918+0000 7f87b5200640 1 -- 172.21.15.173:0/2174029108 wait complete. 2024-04-25T09:06:48.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.918+0000 7f87b5200640 1 Processor -- start 2024-04-25T09:06:48.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87b5200640 1 -- start start 2024-04-25T09:06:48.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87b5200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87b00b3fe0 0x7f87b00c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87b5200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87b00cc260 0x7f87b015b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87b5200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87b0145290 0x7f87b00c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87b5200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b006f130 con 0x7f87b0145290 2024-04-25T09:06:48.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87b5200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b006efb0 con 0x7f87b00b3fe0 2024-04-25T09:06:48.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87b5200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b00c7e10 con 0x7f87b00cc260 2024-04-25T09:06:48.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87ae800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87b0145290 0x7f87b00c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87ae800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87b0145290 0x7f87b00c9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40450/0 (socket says 172.21.15.173:40450) 2024-04-25T09:06:48.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87ae800640 1 -- 172.21.15.173:0/133923247 learned_addr learned my addr 172.21.15.173:0/133923247 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:48.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87ade00640 1 --2- 172.21.15.173:0/133923247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87b00b3fe0 0x7f87b00c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87ad400640 1 --2- 172.21.15.173:0/133923247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87b00cc260 0x7f87b015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87ae800640 1 -- 172.21.15.173:0/133923247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87b00cc260 msgr2=0x7f87b015b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87ae800640 1 --2- 172.21.15.173:0/133923247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87b00cc260 0x7f87b015b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87ae800640 1 -- 172.21.15.173:0/133923247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87b00b3fe0 msgr2=0x7f87b00c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87ae800640 1 --2- 172.21.15.173:0/133923247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87b00b3fe0 0x7f87b00c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87ae800640 1 -- 172.21.15.173:0/133923247 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b00c80b0 con 0x7f87b0145290 2024-04-25T09:06:48.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87ae800640 1 --2- 172.21.15.173:0/133923247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87b0145290 0x7f87b00c9150 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f87a800c3c0 tx=0x7f87a800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:48.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87a6000640 1 -- 172.21.15.173:0/133923247 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8017070 con 0x7f87b0145290 2024-04-25T09:06:48.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87a6000640 1 -- 172.21.15.173:0/133923247 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a8005cf0 con 0x7f87b0145290 2024-04-25T09:06:48.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87b5200640 1 -- 172.21.15.173:0/133923247 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b00c8390 con 0x7f87b0145290 2024-04-25T09:06:48.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87a6000640 1 -- 172.21.15.173:0/133923247 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8007310 con 0x7f87b0145290 2024-04-25T09:06:48.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87b5200640 1 -- 172.21.15.173:0/133923247 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b00c8950 con 0x7f87b0145290 2024-04-25T09:06:48.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.922+0000 7f87b5200640 1 -- 172.21.15.173:0/133923247 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b0073ab0 con 0x7f87b0145290 2024-04-25T09:06:48.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.926+0000 7f87a6000640 1 -- 172.21.15.173:0/133923247 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f87a801a070 con 0x7f87b0145290 2024-04-25T09:06:48.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.926+0000 7f87a6000640 1 --2- 172.21.15.173:0/133923247 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8790066f60 0x7f8790069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.926+0000 7f87a6000640 1 -- 172.21.15.173:0/133923247 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f87a8084310 con 0x7f87b0145290 2024-04-25T09:06:48.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.926+0000 7f87ade00640 1 --2- 172.21.15.173:0/133923247 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8790066f60 0x7f8790069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.926+0000 7f87ade00640 1 --2- 172.21.15.173:0/133923247 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8790066f60 0x7f8790069420 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f87a00012f0 tx=0x7f87a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:48.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:48.930+0000 7f87a6000640 1 -- 172.21.15.173:0/133923247 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f87a8054bf0 con 0x7f87b0145290 2024-04-25T09:06:49.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.086+0000 7f87b5200640 1 -- 172.21.15.173:0/133923247 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f87b00cc990 con 0x7f87b0145290 2024-04-25T09:06:49.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.750+0000 7f87a6000640 1 -- 172.21.15.173:0/133923247 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v67) v1 ==== 170+0+0 (secure 0 0 0) 0x7f87a80840d0 con 0x7f87b0145290 2024-04-25T09:06:49.737 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' created 2024-04-25T09:06:49.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.750+0000 7f87b5200640 1 -- 172.21.15.173:0/133923247 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8790066f60 msgr2=0x7f8790069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.750+0000 7f87b5200640 1 --2- 172.21.15.173:0/133923247 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8790066f60 0x7f8790069420 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f87a00012f0 tx=0x7f87a0009040 comp rx=0 tx=0).stop 2024-04-25T09:06:49.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.750+0000 7f87b5200640 1 -- 172.21.15.173:0/133923247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87b0145290 msgr2=0x7f87b00c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.750+0000 7f87b5200640 1 --2- 172.21.15.173:0/133923247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87b0145290 0x7f87b00c9150 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f87a800c3c0 tx=0x7f87a800c880 comp rx=0 tx=0).stop 2024-04-25T09:06:49.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.750+0000 7f87b5200640 1 -- 172.21.15.173:0/133923247 shutdown_connections 2024-04-25T09:06:49.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.750+0000 7f87b5200640 1 --2- 172.21.15.173:0/133923247 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8790066f60 0x7f8790069420 secure :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f87a00012f0 tx=0x7f87a0009040 comp rx=0 tx=0).stop 2024-04-25T09:06:49.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.750+0000 7f87b5200640 1 --2- 172.21.15.173:0/133923247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87b0145290 0x7f87b00c9150 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.750+0000 7f87b5200640 1 --2- 172.21.15.173:0/133923247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87b00cc260 0x7f87b015b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.750+0000 7f87b5200640 1 --2- 172.21.15.173:0/133923247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87b00b3fe0 0x7f87b00c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.750+0000 7f87b5200640 1 -- 172.21.15.173:0/133923247 >> 172.21.15.173:0/133923247 conn(0x7f87b006ac90 msgr2=0x7f87b00b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:49.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.750+0000 7f87b5200640 1 -- 172.21.15.173:0/133923247 shutdown_connections 2024-04-25T09:06:49.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.750+0000 7f87b5200640 1 -- 172.21.15.173:0/133923247 wait complete. 2024-04-25T09:06:49.775 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:06:49.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.926+0000 7fbd3f000640 1 Processor -- start 2024-04-25T09:06:49.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.926+0000 7fbd3f000640 1 -- start start 2024-04-25T09:06:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.926+0000 7fbd3f000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbd38145290 0x7fbd3815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.926+0000 7fbd3f000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd3815c5f0 con 0x7fbd380cc260 2024-04-25T09:06:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.926+0000 7fbd3f000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd3806d4b0 con 0x7fbd380b3fe0 2024-04-25T09:06:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.926+0000 7fbd3f000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd380ccd80 con 0x7fbd38145290 2024-04-25T09:06:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.926+0000 7fbd37e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbd38145290 0x7fbd3815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.926+0000 7fbd37e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbd38145290 0x7fbd3815c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40456/0 (socket says 172.21.15.173:40456) 2024-04-25T09:06:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.926+0000 7fbd37e00640 1 -- 172.21.15.173:0/3280644571 learned_addr learned my addr 172.21.15.173:0/3280644571 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.926+0000 7fbd3d000640 1 --1- 172.21.15.173:0/3280644571 >> v1:172.21.15.173:6789/0 conn(0x7fbd380cc260 0x7fbd380cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:57486/0 (socket says 172.21.15.173:57486) 2024-04-25T09:06:49.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.926+0000 7fbd37e00640 1 -- 172.21.15.173:0/3280644571 >> v1:172.21.15.194:6789/0 conn(0x7fbd380b3fe0 legacy=0x7fbd380b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.926+0000 7fbd37e00640 1 -- 172.21.15.173:0/3280644571 >> v1:172.21.15.173:6789/0 conn(0x7fbd380cc260 legacy=0x7fbd380cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.926+0000 7fbd37400640 1 -- 172.21.15.173:0/3280644571 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277138933 0 0) 0x7fbd300014a0 con 0x7fbd380cc260 2024-04-25T09:06:49.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.926+0000 7fbd37e00640 1 -- 172.21.15.173:0/3280644571 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3806d790 con 0x7fbd38145290 2024-04-25T09:06:49.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.930+0000 7fbd37e00640 1 --2- 172.21.15.173:0/3280644571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd38145290 0x7fbd3815c0b0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fbd28009870 tx=0x7fbd2801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6788be7ae76261 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.930+0000 7fbd37400640 1 -- 172.21.15.173:0/3280644571 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd280b0070 con 0x7fbd38145290 2024-04-25T09:06:49.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.930+0000 7fbd37400640 1 -- 172.21.15.173:0/3280644571 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd28004230 con 0x7fbd38145290 2024-04-25T09:06:49.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.930+0000 7fbd37400640 1 -- 172.21.15.173:0/3280644571 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd28003620 con 0x7fbd38145290 2024-04-25T09:06:49.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.930+0000 7fbd3f000640 1 -- 172.21.15.173:0/3280644571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd38145290 msgr2=0x7fbd3815c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.930+0000 7fbd3f000640 1 --2- 172.21.15.173:0/3280644571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd38145290 0x7fbd3815c0b0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fbd28009870 tx=0x7fbd2801c440 comp rx=0 tx=0).stop 2024-04-25T09:06:49.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.930+0000 7fbd3f000640 1 -- 172.21.15.173:0/3280644571 shutdown_connections 2024-04-25T09:06:49.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.930+0000 7fbd3f000640 1 --2- 172.21.15.173:0/3280644571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd38145290 0x7fbd3815c0b0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.930+0000 7fbd3f000640 1 -- 172.21.15.173:0/3280644571 >> 172.21.15.173:0/3280644571 conn(0x7fbd3806ac90 msgr2=0x7fbd3806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:49.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.930+0000 7fbd3f000640 1 -- 172.21.15.173:0/3280644571 shutdown_connections 2024-04-25T09:06:49.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.930+0000 7fbd3f000640 1 -- 172.21.15.173:0/3280644571 wait complete. 2024-04-25T09:06:49.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd3f000640 1 Processor -- start 2024-04-25T09:06:49.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd3f000640 1 -- start start 2024-04-25T09:06:49.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd3f000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd380b3fe0 0x7fbd3815ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd3f000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd380cc260 0x7fbd3813a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd3f000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd38145290 0x7fbd3813ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd3f000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3806eee0 con 0x7fbd380b3fe0 2024-04-25T09:06:49.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd3f000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3806ed60 con 0x7fbd380cc260 2024-04-25T09:06:49.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd3f000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3806f060 con 0x7fbd38145290 2024-04-25T09:06:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd37e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd380b3fe0 0x7fbd3815ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd37e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd380b3fe0 0x7fbd3815ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40468/0 (socket says 172.21.15.173:40468) 2024-04-25T09:06:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd37e00640 1 -- 172.21.15.173:0/4203412700 learned_addr learned my addr 172.21.15.173:0/4203412700 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd37e00640 1 -- 172.21.15.173:0/4203412700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd38145290 msgr2=0x7fbd3813ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd3d000640 1 --2- 172.21.15.173:0/4203412700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd38145290 0x7fbd3813ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd2fe00640 1 --2- 172.21.15.173:0/4203412700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd380cc260 0x7fbd3813a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd37e00640 1 --2- 172.21.15.173:0/4203412700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd38145290 0x7fbd3813ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd37e00640 1 -- 172.21.15.173:0/4203412700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd380cc260 msgr2=0x7fbd3813a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd37e00640 1 --2- 172.21.15.173:0/4203412700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd380cc260 0x7fbd3813a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd37e00640 1 -- 172.21.15.173:0/4203412700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3815dd70 con 0x7fbd380b3fe0 2024-04-25T09:06:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd3d000640 1 --2- 172.21.15.173:0/4203412700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd38145290 0x7fbd3813ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd2fe00640 1 --2- 172.21.15.173:0/4203412700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd380cc260 0x7fbd3813a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd37e00640 1 --2- 172.21.15.173:0/4203412700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd380b3fe0 0x7fbd3815ae10 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fbd28009870 tx=0x7fbd280191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd34c00640 1 -- 172.21.15.173:0/4203412700 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd280b9020 con 0x7fbd380b3fe0 2024-04-25T09:06:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd34c00640 1 -- 172.21.15.173:0/4203412700 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd280b1040 con 0x7fbd380b3fe0 2024-04-25T09:06:49.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd34c00640 1 -- 172.21.15.173:0/4203412700 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd280b0050 con 0x7fbd380b3fe0 2024-04-25T09:06:49.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd3f000640 1 -- 172.21.15.173:0/4203412700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3815ccd0 con 0x7fbd380b3fe0 2024-04-25T09:06:49.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd3f000640 1 -- 172.21.15.173:0/4203412700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd3815d290 con 0x7fbd380b3fe0 2024-04-25T09:06:49.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.934+0000 7fbd3f000640 1 -- 172.21.15.173:0/4203412700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd38073ab0 con 0x7fbd380b3fe0 2024-04-25T09:06:49.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.938+0000 7fbd34c00640 1 -- 172.21.15.173:0/4203412700 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbd280bc020 con 0x7fbd380b3fe0 2024-04-25T09:06:49.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.938+0000 7fbd34c00640 1 --2- 172.21.15.173:0/4203412700 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbd14066f60 0x7fbd14069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.938+0000 7fbd34c00640 1 -- 172.21.15.173:0/4203412700 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fbd2811efd0 con 0x7fbd380b3fe0 2024-04-25T09:06:49.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.938+0000 7fbd2fe00640 1 --2- 172.21.15.173:0/4203412700 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbd14066f60 0x7fbd14069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.938+0000 7fbd2fe00640 1 --2- 172.21.15.173:0/4203412700 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbd14066f60 0x7fbd14069420 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbd3813b4c0 tx=0x7fbd20009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:49.942+0000 7fbd34c00640 1 -- 172.21.15.173:0/4203412700 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbd280c3030 con 0x7fbd380b3fe0 2024-04-25T09:06:50.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.130+0000 7fbd3f000640 1 -- 172.21.15.173:0/4203412700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbd38143430 con 0x7fbd380b3fe0 2024-04-25T09:06:50.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.758+0000 7fbd34c00640 1 -- 172.21.15.173:0/4203412700 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v35) v1 ==== 173+0+0 (secure 0 0 0) 0x7fbd28016150 con 0x7fbd380b3fe0 2024-04-25T09:06:50.751 INFO:teuthology.orchestra.run.smithi173.stderr:new fs with metadata pool 9 and data pool 10 2024-04-25T09:06:50.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.770+0000 7fbd3f000640 1 -- 172.21.15.173:0/4203412700 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbd14066f60 msgr2=0x7fbd14069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.770+0000 7fbd3f000640 1 --2- 172.21.15.173:0/4203412700 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbd14066f60 0x7fbd14069420 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbd3813b4c0 tx=0x7fbd20009040 comp rx=0 tx=0).stop 2024-04-25T09:06:50.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.770+0000 7fbd3f000640 1 -- 172.21.15.173:0/4203412700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd380b3fe0 msgr2=0x7fbd3815ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.770+0000 7fbd3f000640 1 --2- 172.21.15.173:0/4203412700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd380b3fe0 0x7fbd3815ae10 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fbd28009870 tx=0x7fbd280191e0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.774+0000 7fbd3f000640 1 -- 172.21.15.173:0/4203412700 shutdown_connections 2024-04-25T09:06:50.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.774+0000 7fbd3f000640 1 --2- 172.21.15.173:0/4203412700 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbd14066f60 0x7fbd14069420 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.774+0000 7fbd3f000640 1 --2- 172.21.15.173:0/4203412700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd38145290 0x7fbd3813ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.774+0000 7fbd3f000640 1 --2- 172.21.15.173:0/4203412700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd380cc260 0x7fbd3813a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.774+0000 7fbd3f000640 1 --2- 172.21.15.173:0/4203412700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd380b3fe0 0x7fbd3815ae10 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.774+0000 7fbd3f000640 1 -- 172.21.15.173:0/4203412700 >> 172.21.15.173:0/4203412700 conn(0x7fbd3806ac90 msgr2=0x7fbd380ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:50.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.774+0000 7fbd3f000640 1 -- 172.21.15.173:0/4203412700 shutdown_connections 2024-04-25T09:06:50.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.774+0000 7fbd3f000640 1 -- 172.21.15.173:0/4203412700 wait complete. 2024-04-25T09:06:50.794 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:50.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.942+0000 7ff23c200640 1 Processor -- start 2024-04-25T09:06:50.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.942+0000 7ff23c200640 1 -- start start 2024-04-25T09:06:50.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.946+0000 7ff23c200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff234145250 0x7ff23415c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.946+0000 7ff23c200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff2340ccd30 0x7ff234071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.946+0000 7ff23c200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23415cec0 con 0x7ff2340cc8b0 2024-04-25T09:06:50.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.946+0000 7ff23c200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23406e7c0 con 0x7ff2340ccd30 2024-04-25T09:06:50.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.946+0000 7ff23c200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23406d720 con 0x7ff234145250 2024-04-25T09:06:50.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.946+0000 7ff23a200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff2340ccd30 0x7ff234071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.946+0000 7ff23a200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff2340ccd30 0x7ff234071a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40476/0 (socket says 172.21.15.173:40476) 2024-04-25T09:06:50.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.946+0000 7ff23a200640 1 -- 172.21.15.173:0/2023282169 learned_addr learned my addr 172.21.15.173:0/2023282169 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:50.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.946+0000 7ff238e00640 1 --1- 172.21.15.173:0/2023282169 >> v1:172.21.15.173:6789/0 conn(0x7ff2340cc8b0 0x7ff234071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:57492/0 (socket says 172.21.15.173:57492) 2024-04-25T09:06:50.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.946+0000 7ff239800640 1 --2- 172.21.15.173:0/2023282169 >> v2:172.21.15.194:3300/0 conn(0x7ff234145250 0x7ff23415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.946+0000 7ff23a200640 1 -- 172.21.15.173:0/2023282169 >> v2:172.21.15.194:3300/0 conn(0x7ff234145250 msgr2=0x7ff23415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:50.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.946+0000 7ff23a200640 1 --2- 172.21.15.173:0/2023282169 >> v2:172.21.15.194:3300/0 conn(0x7ff234145250 0x7ff23415c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.946+0000 7ff23a200640 1 -- 172.21.15.173:0/2023282169 >> v1:172.21.15.173:6789/0 conn(0x7ff2340cc8b0 legacy=0x7ff234071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.946+0000 7ff23a200640 1 -- 172.21.15.173:0/2023282169 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23406da00 con 0x7ff2340ccd30 2024-04-25T09:06:50.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.946+0000 7ff23a200640 1 --2- 172.21.15.173:0/2023282169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2340ccd30 0x7ff234071a30 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff2340d0420 tx=0x7ff22c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae14a852e455c82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff233e00640 1 -- 172.21.15.173:0/2023282169 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0a5880 con 0x7ff2340ccd30 2024-04-25T09:06:50.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff233e00640 1 -- 172.21.15.173:0/2023282169 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c0a5a20 con 0x7ff2340ccd30 2024-04-25T09:06:50.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff233e00640 1 -- 172.21.15.173:0/2023282169 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0a5df0 con 0x7ff2340ccd30 2024-04-25T09:06:50.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23c200640 1 -- 172.21.15.173:0/2023282169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2340ccd30 msgr2=0x7ff234071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23c200640 1 --2- 172.21.15.173:0/2023282169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2340ccd30 0x7ff234071a30 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff2340d0420 tx=0x7ff22c01c9c0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23c200640 1 -- 172.21.15.173:0/2023282169 shutdown_connections 2024-04-25T09:06:50.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23c200640 1 --2- 172.21.15.173:0/2023282169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2340ccd30 0x7ff234071a30 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23c200640 1 --2- 172.21.15.173:0/2023282169 >> v2:172.21.15.194:3300/0 conn(0x7ff234145250 0x7ff23415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23c200640 1 -- 172.21.15.173:0/2023282169 >> 172.21.15.173:0/2023282169 conn(0x7ff23406ac90 msgr2=0x7ff23406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:50.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23c200640 1 -- 172.21.15.173:0/2023282169 shutdown_connections 2024-04-25T09:06:50.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23c200640 1 -- 172.21.15.173:0/2023282169 wait complete. 2024-04-25T09:06:50.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23c200640 1 Processor -- start 2024-04-25T09:06:50.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23c200640 1 -- start start 2024-04-25T09:06:50.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23c200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2340cc8b0 0x7ff2341412a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23c200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2340ccd30 0x7ff23415afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23c200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff234145250 0x7ff2340adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23c200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23406ef80 con 0x7ff234145250 2024-04-25T09:06:50.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23c200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff234145630 con 0x7ff2340cc8b0 2024-04-25T09:06:50.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23c200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340cd140 con 0x7ff2340ccd30 2024-04-25T09:06:50.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23a200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff234145250 0x7ff2340adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23a200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff234145250 0x7ff2340adb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40492/0 (socket says 172.21.15.173:40492) 2024-04-25T09:06:50.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff23a200640 1 -- 172.21.15.173:0/3479430661 learned_addr learned my addr 172.21.15.173:0/3479430661 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:50.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff239800640 1 --2- 172.21.15.173:0/3479430661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2340cc8b0 0x7ff2341412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.950+0000 7ff238e00640 1 --2- 172.21.15.173:0/3479430661 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2340ccd30 0x7ff23415afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.954+0000 7ff23a200640 1 -- 172.21.15.173:0/3479430661 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2340ccd30 msgr2=0x7ff23415afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.954+0000 7ff23a200640 1 --2- 172.21.15.173:0/3479430661 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2340ccd30 0x7ff23415afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.954+0000 7ff23a200640 1 -- 172.21.15.173:0/3479430661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2340cc8b0 msgr2=0x7ff2341412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:50.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.954+0000 7ff23a200640 1 --2- 172.21.15.173:0/3479430661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2340cc8b0 0x7ff2341412a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:50.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.954+0000 7ff23a200640 1 -- 172.21.15.173:0/3479430661 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff234140200 con 0x7ff234145250 2024-04-25T09:06:50.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.954+0000 7ff239800640 1 --2- 172.21.15.173:0/3479430661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2340cc8b0 0x7ff2341412a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:50.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.954+0000 7ff23a200640 1 --2- 172.21.15.173:0/3479430661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff234145250 0x7ff2340adb00 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0195d0 tx=0x7ff22c019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.954+0000 7ff231600640 1 -- 172.21.15.173:0/3479430661 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0b8670 con 0x7ff234145250 2024-04-25T09:06:50.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.954+0000 7ff231600640 1 -- 172.21.15.173:0/3479430661 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c0be070 con 0x7ff234145250 2024-04-25T09:06:50.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.954+0000 7ff23c200640 1 -- 172.21.15.173:0/3479430661 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2341404e0 con 0x7ff234145250 2024-04-25T09:06:50.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.954+0000 7ff231600640 1 -- 172.21.15.173:0/3479430661 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0b8a70 con 0x7ff234145250 2024-04-25T09:06:50.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.954+0000 7ff23c200640 1 -- 172.21.15.173:0/3479430661 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff234140aa0 con 0x7ff234145250 2024-04-25T09:06:50.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.954+0000 7ff23c200640 1 -- 172.21.15.173:0/3479430661 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff234073a40 con 0x7ff234145250 2024-04-25T09:06:50.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.954+0000 7ff231600640 1 -- 172.21.15.173:0/3479430661 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff22c0b8c10 con 0x7ff234145250 2024-04-25T09:06:50.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.954+0000 7ff231600640 1 --2- 172.21.15.173:0/3479430661 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff214066f60 0x7ff214069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:50.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.954+0000 7ff231600640 1 -- 172.21.15.173:0/3479430661 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff22c120440 con 0x7ff234145250 2024-04-25T09:06:50.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.958+0000 7ff239800640 1 --2- 172.21.15.173:0/3479430661 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff214066f60 0x7ff214069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:50.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.958+0000 7ff239800640 1 --2- 172.21.15.173:0/3479430661 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff214066f60 0x7ff214069420 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff228009eb0 tx=0x7ff228009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:50.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:50.962+0000 7ff231600640 1 -- 172.21.15.173:0/3479430661 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff22c0165e0 con 0x7ff234145250 2024-04-25T09:06:51.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.114+0000 7ff23c200640 1 -- 172.21.15.173:0/3479430661 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff23415b4f0 con 0x7ff234145250 2024-04-25T09:06:51.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.114+0000 7ff231600640 1 -- 172.21.15.173:0/3479430661 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16957 (secure 0 0 0) 0x7ff22c0f0d80 con 0x7ff234145250 2024-04-25T09:06:51.103 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:51.103 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":68,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:06:50.132321+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:48.493059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:49.133352+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:51.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.118+0000 7ff23c200640 1 -- 172.21.15.173:0/3479430661 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff214066f60 msgr2=0x7ff214069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.118+0000 7ff23c200640 1 --2- 172.21.15.173:0/3479430661 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff214066f60 0x7ff214069420 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff228009eb0 tx=0x7ff228009190 comp rx=0 tx=0).stop 2024-04-25T09:06:51.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.118+0000 7ff23c200640 1 -- 172.21.15.173:0/3479430661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff234145250 msgr2=0x7ff2340adb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.118+0000 7ff23c200640 1 --2- 172.21.15.173:0/3479430661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff234145250 0x7ff2340adb00 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0195d0 tx=0x7ff22c019760 comp rx=0 tx=0).stop 2024-04-25T09:06:51.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.118+0000 7ff23c200640 1 -- 172.21.15.173:0/3479430661 shutdown_connections 2024-04-25T09:06:51.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.118+0000 7ff23c200640 1 --2- 172.21.15.173:0/3479430661 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff214066f60 0x7ff214069420 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.118+0000 7ff23c200640 1 --2- 172.21.15.173:0/3479430661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff234145250 0x7ff2340adb00 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.118+0000 7ff23c200640 1 --2- 172.21.15.173:0/3479430661 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2340ccd30 0x7ff23415afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.118+0000 7ff23c200640 1 --2- 172.21.15.173:0/3479430661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2340cc8b0 0x7ff2341412a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.118+0000 7ff23c200640 1 -- 172.21.15.173:0/3479430661 >> 172.21.15.173:0/3479430661 conn(0x7ff23406ac90 msgr2=0x7ff23415d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:51.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.118+0000 7ff23c200640 1 -- 172.21.15.173:0/3479430661 shutdown_connections 2024-04-25T09:06:51.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.118+0000 7ff23c200640 1 -- 172.21.15.173:0/3479430661 wait complete. 2024-04-25T09:06:51.124 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:51.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.270+0000 7fab02e00640 1 Processor -- start 2024-04-25T09:06:51.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.270+0000 7fab02e00640 1 -- start start 2024-04-25T09:06:51.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.274+0000 7fab02e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faafc0b3e70 0x7faafc0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.274+0000 7fab02e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7faafc0aefa0 0x7faafc0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.274+0000 7fab02e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faafc0b4790 con 0x7faafc15edd0 2024-04-25T09:06:51.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.274+0000 7fab02e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faafc06dd50 con 0x7faafc0aefa0 2024-04-25T09:06:51.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.274+0000 7fab02e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc15f320 con 0x7faafc0b3e70 2024-04-25T09:06:51.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.274+0000 7faafb400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7faafc0aefa0 0x7faafc0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.274+0000 7faafb400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7faafc0aefa0 0x7faafc0b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40498/0 (socket says 172.21.15.173:40498) 2024-04-25T09:06:51.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.274+0000 7faafb400640 1 -- 172.21.15.173:0/3460603517 learned_addr learned my addr 172.21.15.173:0/3460603517 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:51.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.274+0000 7faafbe00640 1 --2- 172.21.15.173:0/3460603517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faafc0b3e70 0x7faafc0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.274+0000 7faafb400640 1 -- 172.21.15.173:0/3460603517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faafc0b3e70 msgr2=0x7faafc0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:51.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.274+0000 7faafb400640 1 --2- 172.21.15.173:0/3460603517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faafc0b3e70 0x7faafc0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.274+0000 7faafb400640 1 -- 172.21.15.173:0/3460603517 >> v1:172.21.15.194:6789/0 conn(0x7faafc15edd0 legacy=0x7faafc0b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.274+0000 7faafb400640 1 -- 172.21.15.173:0/3460603517 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc06d420 con 0x7faafc0aefa0 2024-04-25T09:06:51.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.274+0000 7faafbe00640 1 --2- 172.21.15.173:0/3460603517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faafc0b3e70 0x7faafc0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:51.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.278+0000 7faafb400640 1 --2- 172.21.15.173:0/3460603517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faafc0aefa0 0x7faafc0b2770 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7faae8009870 tx=0x7faae801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87290718907fecc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.278+0000 7faafaa00640 1 -- 172.21.15.173:0/3460603517 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae80a9610 con 0x7faafc0aefa0 2024-04-25T09:06:51.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.278+0000 7faafaa00640 1 -- 172.21.15.173:0/3460603517 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae80a97b0 con 0x7faafc0aefa0 2024-04-25T09:06:51.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.278+0000 7faafaa00640 1 -- 172.21.15.173:0/3460603517 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae80a9b80 con 0x7faafc0aefa0 2024-04-25T09:06:51.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.278+0000 7fab02e00640 1 -- 172.21.15.173:0/3460603517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faafc0aefa0 msgr2=0x7faafc0b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.278+0000 7fab02e00640 1 --2- 172.21.15.173:0/3460603517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faafc0aefa0 0x7faafc0b2770 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7faae8009870 tx=0x7faae801c530 comp rx=0 tx=0).stop 2024-04-25T09:06:51.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.278+0000 7fab02e00640 1 -- 172.21.15.173:0/3460603517 shutdown_connections 2024-04-25T09:06:51.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.278+0000 7fab02e00640 1 --2- 172.21.15.173:0/3460603517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faafc0aefa0 0x7faafc0b2770 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.278+0000 7fab02e00640 1 --2- 172.21.15.173:0/3460603517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faafc0b3e70 0x7faafc0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.278+0000 7fab02e00640 1 -- 172.21.15.173:0/3460603517 >> 172.21.15.173:0/3460603517 conn(0x7faafc06ac90 msgr2=0x7faafc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:51.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.278+0000 7fab02e00640 1 -- 172.21.15.173:0/3460603517 shutdown_connections 2024-04-25T09:06:51.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.278+0000 7fab02e00640 1 -- 172.21.15.173:0/3460603517 wait complete. 2024-04-25T09:06:51.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.278+0000 7fab02e00640 1 Processor -- start 2024-04-25T09:06:51.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.278+0000 7fab02e00640 1 -- start start 2024-04-25T09:06:51.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7fab02e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faafc0aefa0 0x7faafc1f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7fab02e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faafc0b3e70 0x7faafc14bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7fab02e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faafc15edd0 0x7faafc14cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7fab02e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc06e1c0 con 0x7faafc0b3e70 2024-04-25T09:06:51.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7fab02e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc15aba0 con 0x7faafc15edd0 2024-04-25T09:06:51.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7fab02e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc06e340 con 0x7faafc0aefa0 2024-04-25T09:06:51.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7faafb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faafc0b3e70 0x7faafc14bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7faafbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faafc0aefa0 0x7faafc1f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7faafb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faafc0b3e70 0x7faafc14bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40514/0 (socket says 172.21.15.173:40514) 2024-04-25T09:06:51.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7faafb400640 1 -- 172.21.15.173:0/2020437455 learned_addr learned my addr 172.21.15.173:0/2020437455 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:51.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7fab00e00640 1 --2- 172.21.15.173:0/2020437455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faafc15edd0 0x7faafc14cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7faafb400640 1 -- 172.21.15.173:0/2020437455 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faafc0aefa0 msgr2=0x7faafc1f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7faafb400640 1 --2- 172.21.15.173:0/2020437455 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faafc0aefa0 0x7faafc1f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7faafb400640 1 -- 172.21.15.173:0/2020437455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faafc15edd0 msgr2=0x7faafc14cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7faafb400640 1 --2- 172.21.15.173:0/2020437455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faafc15edd0 0x7faafc14cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7faafb400640 1 -- 172.21.15.173:0/2020437455 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc14f1d0 con 0x7faafc0b3e70 2024-04-25T09:06:51.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7faafbe00640 1 --2- 172.21.15.173:0/2020437455 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faafc0aefa0 0x7faafc1f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:51.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7faafb400640 1 --2- 172.21.15.173:0/2020437455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faafc0b3e70 0x7faafc14bc30 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7faae801abe0 tx=0x7faae80192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7faaf3e00640 1 -- 172.21.15.173:0/2020437455 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae80b9620 con 0x7faafc0b3e70 2024-04-25T09:06:51.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7faaf3e00640 1 -- 172.21.15.173:0/2020437455 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae80b97c0 con 0x7faafc0b3e70 2024-04-25T09:06:51.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7fab02e00640 1 -- 172.21.15.173:0/2020437455 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faafc14f4b0 con 0x7faafc0b3e70 2024-04-25T09:06:51.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7faaf3e00640 1 -- 172.21.15.173:0/2020437455 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae80b9b90 con 0x7faafc0b3e70 2024-04-25T09:06:51.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7fab02e00640 1 -- 172.21.15.173:0/2020437455 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faafc14fa70 con 0x7faafc0b3e70 2024-04-25T09:06:51.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7fab02e00640 1 -- 172.21.15.173:0/2020437455 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faafc073a40 con 0x7faafc0b3e70 2024-04-25T09:06:51.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.282+0000 7faaf3e00640 1 -- 172.21.15.173:0/2020437455 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faae80b13f0 con 0x7faafc0b3e70 2024-04-25T09:06:51.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.286+0000 7faaf3e00640 1 --2- 172.21.15.173:0/2020437455 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faadc066f60 0x7faadc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.286+0000 7faaf3e00640 1 -- 172.21.15.173:0/2020437455 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faae811f060 con 0x7faafc0b3e70 2024-04-25T09:06:51.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.286+0000 7faafbe00640 1 --2- 172.21.15.173:0/2020437455 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faadc066f60 0x7faadc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.286+0000 7faafbe00640 1 --2- 172.21.15.173:0/2020437455 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faadc066f60 0x7faadc069420 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faaec003e70 tx=0x7faaec0097f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.290+0000 7faaf3e00640 1 -- 172.21.15.173:0/2020437455 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faae80ad020 con 0x7faafc0b3e70 2024-04-25T09:06:51.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.442+0000 7fab02e00640 1 -- 172.21.15.173:0/2020437455 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faafc06f1c0 con 0x7faafc0b3e70 2024-04-25T09:06:51.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.446+0000 7faaf3e00640 1 -- 172.21.15.173:0/2020437455 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16957 (secure 0 0 0) 0x7faae8016150 con 0x7faafc0b3e70 2024-04-25T09:06:51.433 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:51.433 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":68,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:06:50.132321+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:48.493059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:49.133352+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:51.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.446+0000 7fab02e00640 1 -- 172.21.15.173:0/2020437455 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faadc066f60 msgr2=0x7faadc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.446+0000 7fab02e00640 1 --2- 172.21.15.173:0/2020437455 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faadc066f60 0x7faadc069420 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faaec003e70 tx=0x7faaec0097f0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.446+0000 7fab02e00640 1 -- 172.21.15.173:0/2020437455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faafc0b3e70 msgr2=0x7faafc14bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.446+0000 7fab02e00640 1 --2- 172.21.15.173:0/2020437455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faafc0b3e70 0x7faafc14bc30 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7faae801abe0 tx=0x7faae80192d0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.446+0000 7fab02e00640 1 -- 172.21.15.173:0/2020437455 shutdown_connections 2024-04-25T09:06:51.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.446+0000 7fab02e00640 1 --2- 172.21.15.173:0/2020437455 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faadc066f60 0x7faadc069420 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.446+0000 7fab02e00640 1 --2- 172.21.15.173:0/2020437455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faafc15edd0 0x7faafc14cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.446+0000 7fab02e00640 1 --2- 172.21.15.173:0/2020437455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faafc0b3e70 0x7faafc14bc30 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.446+0000 7fab02e00640 1 --2- 172.21.15.173:0/2020437455 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faafc0aefa0 0x7faafc1f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.446+0000 7fab02e00640 1 -- 172.21.15.173:0/2020437455 >> 172.21.15.173:0/2020437455 conn(0x7faafc06ac90 msgr2=0x7faafc15e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:51.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.446+0000 7fab02e00640 1 -- 172.21.15.173:0/2020437455 shutdown_connections 2024-04-25T09:06:51.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.446+0000 7fab02e00640 1 -- 172.21.15.173:0/2020437455 wait complete. 2024-04-25T09:06:51.454 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:06:51.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.606+0000 7f9330800640 1 Processor -- start 2024-04-25T09:06:51.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.606+0000 7f9330800640 1 -- start start 2024-04-25T09:06:51.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.606+0000 7f9330800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93280ad5c0 0x7f93281687d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.606+0000 7f9330800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932806fa20 con 0x7f932806f5b0 2024-04-25T09:06:51.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.606+0000 7f9330800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932806ae30 con 0x7f932806e1c0 2024-04-25T09:06:51.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.606+0000 7f9330800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93280b3170 con 0x7f93280ad5c0 2024-04-25T09:06:51.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.606+0000 7f932d400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f932806f5b0 0x7f93280aceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:57508/0 (socket says 172.21.15.173:57508) 2024-04-25T09:06:51.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.606+0000 7f932d400640 1 -- 172.21.15.173:0/1542616937 learned_addr learned my addr 172.21.15.173:0/1542616937 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:51.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.606+0000 7f932e800640 1 --2- 172.21.15.173:0/1542616937 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93280ad5c0 0x7f93281687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.606+0000 7f932ca00640 1 -- 172.21.15.173:0/1542616937 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386231456 0 0) 0x7f932806fa20 con 0x7f932806f5b0 2024-04-25T09:06:51.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.606+0000 7f932ca00640 1 -- 172.21.15.173:0/1542616937 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9310003530 con 0x7f932806f5b0 2024-04-25T09:06:51.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.606+0000 7f932ca00640 1 -- 172.21.15.173:0/1542616937 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982998430 0 0) 0x7f932806ae30 con 0x7f932806e1c0 2024-04-25T09:06:51.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.606+0000 7f932ca00640 1 -- 172.21.15.173:0/1542616937 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f932806fa20 con 0x7f932806e1c0 2024-04-25T09:06:51.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.606+0000 7f932e800640 1 -- 172.21.15.173:0/1542616937 >> v1:172.21.15.194:6789/0 conn(0x7f932806e1c0 legacy=0x7f932806bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.606+0000 7f932e800640 1 -- 172.21.15.173:0/1542616937 >> v1:172.21.15.173:6789/0 conn(0x7f932806f5b0 legacy=0x7f93280aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.606+0000 7f932e800640 1 -- 172.21.15.173:0/1542616937 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932806b110 con 0x7f93280ad5c0 2024-04-25T09:06:51.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.610+0000 7f932e800640 1 --2- 172.21.15.173:0/1542616937 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93280ad5c0 0x7f93281687d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9324009dc0 tx=0x7f932401f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=836d289d595866bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.610+0000 7f932ca00640 1 -- 172.21.15.173:0/1542616937 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93240b4070 con 0x7f93280ad5c0 2024-04-25T09:06:51.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.610+0000 7f932ca00640 1 -- 172.21.15.173:0/1542616937 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93240af600 con 0x7f93280ad5c0 2024-04-25T09:06:51.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.610+0000 7f932ca00640 1 -- 172.21.15.173:0/1542616937 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93240af9d0 con 0x7f93280ad5c0 2024-04-25T09:06:51.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.610+0000 7f9330800640 1 -- 172.21.15.173:0/1542616937 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93280ad5c0 msgr2=0x7f93281687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.610+0000 7f9330800640 1 --2- 172.21.15.173:0/1542616937 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93280ad5c0 0x7f93281687d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9324009dc0 tx=0x7f932401f170 comp rx=0 tx=0).stop 2024-04-25T09:06:51.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.610+0000 7f9330800640 1 -- 172.21.15.173:0/1542616937 shutdown_connections 2024-04-25T09:06:51.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.610+0000 7f9330800640 1 --2- 172.21.15.173:0/1542616937 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93280ad5c0 0x7f93281687d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.610+0000 7f9330800640 1 -- 172.21.15.173:0/1542616937 >> 172.21.15.173:0/1542616937 conn(0x7f93280cfed0 msgr2=0x7f93280d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:51.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.610+0000 7f9330800640 1 -- 172.21.15.173:0/1542616937 shutdown_connections 2024-04-25T09:06:51.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.610+0000 7f9330800640 1 -- 172.21.15.173:0/1542616937 wait complete. 2024-04-25T09:06:51.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f9330800640 1 Processor -- start 2024-04-25T09:06:51.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f9330800640 1 -- start start 2024-04-25T09:06:51.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f9330800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f932806e1c0 0x7f932815c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f9330800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f932806f5b0 0x7f932815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f9330800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93280ad5c0 0x7f9328144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f9330800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932806b6d0 con 0x7f932806f5b0 2024-04-25T09:06:51.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f9330800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932815e070 con 0x7f93280ad5c0 2024-04-25T09:06:51.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f9330800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932806b9b0 con 0x7f932806e1c0 2024-04-25T09:06:51.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f932d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f932806f5b0 0x7f932815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f932d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f932806f5b0 0x7f932815c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40518/0 (socket says 172.21.15.173:40518) 2024-04-25T09:06:51.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f932d400640 1 -- 172.21.15.173:0/3041186930 learned_addr learned my addr 172.21.15.173:0/3041186930 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:51.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f932e800640 1 --2- 172.21.15.173:0/3041186930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93280ad5c0 0x7f9328144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f932de00640 1 --2- 172.21.15.173:0/3041186930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f932806e1c0 0x7f932815c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f932d400640 1 -- 172.21.15.173:0/3041186930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f932806e1c0 msgr2=0x7f932815c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f932d400640 1 --2- 172.21.15.173:0/3041186930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f932806e1c0 0x7f932815c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f932d400640 1 -- 172.21.15.173:0/3041186930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93280ad5c0 msgr2=0x7f9328144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:51.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f932d400640 1 --2- 172.21.15.173:0/3041186930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93280ad5c0 0x7f9328144cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:51.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f932d400640 1 -- 172.21.15.173:0/3041186930 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9328145b80 con 0x7f932806f5b0 2024-04-25T09:06:51.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f932d400640 1 --2- 172.21.15.173:0/3041186930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f932806f5b0 0x7f932815c9b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f931800c4d0 tx=0x7f931800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f9322000640 1 -- 172.21.15.173:0/3041186930 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318017070 con 0x7f932806f5b0 2024-04-25T09:06:51.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f9322000640 1 -- 172.21.15.173:0/3041186930 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9318005cf0 con 0x7f932806f5b0 2024-04-25T09:06:51.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f9322000640 1 -- 172.21.15.173:0/3041186930 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93180072b0 con 0x7f932806f5b0 2024-04-25T09:06:51.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f9330800640 1 -- 172.21.15.173:0/3041186930 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9328145e60 con 0x7f932806f5b0 2024-04-25T09:06:51.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f9330800640 1 -- 172.21.15.173:0/3041186930 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93281e5710 con 0x7f932806f5b0 2024-04-25T09:06:51.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.614+0000 7f9330800640 1 -- 172.21.15.173:0/3041186930 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9328073ab0 con 0x7f932806f5b0 2024-04-25T09:06:51.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.618+0000 7f9322000640 1 -- 172.21.15.173:0/3041186930 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f931801a070 con 0x7f932806f5b0 2024-04-25T09:06:51.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.618+0000 7f9322000640 1 --2- 172.21.15.173:0/3041186930 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f930c066f60 0x7f930c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:51.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.618+0000 7f9322000640 1 -- 172.21.15.173:0/3041186930 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9318084480 con 0x7f932806f5b0 2024-04-25T09:06:51.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.618+0000 7f932de00640 1 --2- 172.21.15.173:0/3041186930 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f930c066f60 0x7f930c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:51.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.618+0000 7f932de00640 1 --2- 172.21.15.173:0/3041186930 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f930c066f60 0x7f930c069420 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f931c0011f0 tx=0x7f931c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:51.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.622+0000 7f9322000640 1 -- 172.21.15.173:0/3041186930 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9318054d40 con 0x7f932806f5b0 2024-04-25T09:06:51.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:51.818+0000 7f9330800640 1 -- 172.21.15.173:0/3041186930 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f93280af4f0 con 0x7f932806f5b0 2024-04-25T09:06:52.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.766+0000 7f9322000640 1 -- 172.21.15.173:0/3041186930 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9318058de0 con 0x7f932806f5b0 2024-04-25T09:06:52.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.770+0000 7f9330800640 1 -- 172.21.15.173:0/3041186930 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f930c066f60 msgr2=0x7f930c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.770+0000 7f9330800640 1 --2- 172.21.15.173:0/3041186930 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f930c066f60 0x7f930c069420 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f931c0011f0 tx=0x7f931c009040 comp rx=0 tx=0).stop 2024-04-25T09:06:52.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.770+0000 7f9330800640 1 -- 172.21.15.173:0/3041186930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f932806f5b0 msgr2=0x7f932815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.770+0000 7f9330800640 1 --2- 172.21.15.173:0/3041186930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f932806f5b0 0x7f932815c9b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f931800c4d0 tx=0x7f931800c990 comp rx=0 tx=0).stop 2024-04-25T09:06:52.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.770+0000 7f9330800640 1 -- 172.21.15.173:0/3041186930 shutdown_connections 2024-04-25T09:06:52.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.770+0000 7f9330800640 1 --2- 172.21.15.173:0/3041186930 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f930c066f60 0x7f930c069420 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.770+0000 7f9330800640 1 --2- 172.21.15.173:0/3041186930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93280ad5c0 0x7f9328144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.770+0000 7f9330800640 1 --2- 172.21.15.173:0/3041186930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f932806f5b0 0x7f932815c9b0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.770+0000 7f9330800640 1 --2- 172.21.15.173:0/3041186930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f932806e1c0 0x7f932815c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.770+0000 7f9330800640 1 -- 172.21.15.173:0/3041186930 >> 172.21.15.173:0/3041186930 conn(0x7f93280cfed0 msgr2=0x7f93280b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:52.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.770+0000 7f9330800640 1 -- 172.21.15.173:0/3041186930 shutdown_connections 2024-04-25T09:06:52.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.770+0000 7f9330800640 1 -- 172.21.15.173:0/3041186930 wait complete. 2024-04-25T09:06:52.780 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:06:52.781 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:06:52.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.934+0000 7f0a03600640 1 Processor -- start 2024-04-25T09:06:52.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.934+0000 7f0a03600640 1 -- start start 2024-04-25T09:06:52.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.938+0000 7f0a03600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f09fc0ad780 0x7f09fc06c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.938+0000 7f0a03600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09fc15fcf0 0x7f09fc0af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.938+0000 7f0a03600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09fc0adef0 con 0x7f09fc0b4e10 2024-04-25T09:06:52.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.938+0000 7f0a03600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09fc0adc10 con 0x7f09fc0ad780 2024-04-25T09:06:52.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.938+0000 7f0a03600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc06b820 con 0x7f09fc15fcf0 2024-04-25T09:06:52.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.938+0000 7f09f3e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f09fc0ad780 0x7f09fc06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.938+0000 7f09f3e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f09fc0ad780 0x7f09fc06c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40528/0 (socket says 172.21.15.173:40528) 2024-04-25T09:06:52.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.938+0000 7f09f3e00640 1 -- 172.21.15.173:0/1218570289 learned_addr learned my addr 172.21.15.173:0/1218570289 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:52.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.938+0000 7f0a01600640 1 --2- 172.21.15.173:0/1218570289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09fc15fcf0 0x7f09fc0af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.938+0000 7f09f3e00640 1 -- 172.21.15.173:0/1218570289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09fc15fcf0 msgr2=0x7f09fc0af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:52.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.938+0000 7f09f3e00640 1 --2- 172.21.15.173:0/1218570289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09fc15fcf0 0x7f09fc0af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.938+0000 7f09f3e00640 1 -- 172.21.15.173:0/1218570289 >> v1:172.21.15.194:6789/0 conn(0x7f09fc0b4e10 legacy=0x7f09fc15f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.938+0000 7f09f3e00640 1 -- 172.21.15.173:0/1218570289 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc06bb00 con 0x7f09fc0ad780 2024-04-25T09:06:52.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.938+0000 7f09f3e00640 1 --2- 172.21.15.173:0/1218570289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09fc0ad780 0x7f09fc06c300 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009870 tx=0x7f09e401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e06b7601dc8ca71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:52.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f09fbe00640 1 -- 172.21.15.173:0/1218570289 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e40b1070 con 0x7f09fc0ad780 2024-04-25T09:06:52.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f09fbe00640 1 -- 172.21.15.173:0/1218570289 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e40a8050 con 0x7f09fc0ad780 2024-04-25T09:06:52.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f09fbe00640 1 -- 172.21.15.173:0/1218570289 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e40ac860 con 0x7f09fc0ad780 2024-04-25T09:06:52.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f0a03600640 1 -- 172.21.15.173:0/1218570289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09fc0ad780 msgr2=0x7f09fc06c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f0a03600640 1 --2- 172.21.15.173:0/1218570289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09fc0ad780 0x7f09fc06c300 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009870 tx=0x7f09e401c4d0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f0a03600640 1 -- 172.21.15.173:0/1218570289 shutdown_connections 2024-04-25T09:06:52.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f0a03600640 1 --2- 172.21.15.173:0/1218570289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09fc15fcf0 0x7f09fc0af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f0a03600640 1 --2- 172.21.15.173:0/1218570289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09fc0ad780 0x7f09fc06c300 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f0a03600640 1 -- 172.21.15.173:0/1218570289 >> 172.21.15.173:0/1218570289 conn(0x7f09fc0cfed0 msgr2=0x7f09fc0d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:52.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f0a03600640 1 -- 172.21.15.173:0/1218570289 shutdown_connections 2024-04-25T09:06:52.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f0a03600640 1 -- 172.21.15.173:0/1218570289 wait complete. 2024-04-25T09:06:52.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f0a03600640 1 Processor -- start 2024-04-25T09:06:52.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f0a03600640 1 -- start start 2024-04-25T09:06:52.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f0a03600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09fc0b4e10 0x7f09fc14ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f0a03600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09fc15fcf0 0x7f09fc09ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f0a03600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09fc150420 0x7f09fc155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f0a03600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc152ab0 con 0x7f09fc15fcf0 2024-04-25T09:06:52.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f0a03600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc152930 con 0x7f09fc150420 2024-04-25T09:06:52.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f0a03600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc152c30 con 0x7f09fc0b4e10 2024-04-25T09:06:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f09f3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09fc15fcf0 0x7f09fc09ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f09f3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09fc15fcf0 0x7f09fc09ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40530/0 (socket says 172.21.15.173:40530) 2024-04-25T09:06:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f09f3e00640 1 -- 172.21.15.173:0/2702963033 learned_addr learned my addr 172.21.15.173:0/2702963033 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f0a01600640 1 --2- 172.21.15.173:0/2702963033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09fc150420 0x7f09fc155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.942+0000 7f0a00c00640 1 --2- 172.21.15.173:0/2702963033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09fc0b4e10 0x7f09fc14ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.946+0000 7f09f3e00640 1 -- 172.21.15.173:0/2702963033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09fc0b4e10 msgr2=0x7f09fc14ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.946+0000 7f09f3e00640 1 --2- 172.21.15.173:0/2702963033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09fc0b4e10 0x7f09fc14ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.946+0000 7f09f3e00640 1 -- 172.21.15.173:0/2702963033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09fc150420 msgr2=0x7f09fc155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.946+0000 7f09f3e00640 1 --2- 172.21.15.173:0/2702963033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09fc150420 0x7f09fc155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.946+0000 7f09f3e00640 1 -- 172.21.15.173:0/2702963033 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc09c540 con 0x7f09fc15fcf0 2024-04-25T09:06:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.946+0000 7f0a00c00640 1 --2- 172.21.15.173:0/2702963033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09fc0b4e10 0x7f09fc14ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.946+0000 7f09f3e00640 1 --2- 172.21.15.173:0/2702963033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09fc15fcf0 0x7f09fc09ac70 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f09e40af040 tx=0x7f09e401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.946+0000 7f09f9600640 1 -- 172.21.15.173:0/2702963033 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e40b1040 con 0x7f09fc15fcf0 2024-04-25T09:06:52.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.946+0000 7f09f9600640 1 -- 172.21.15.173:0/2702963033 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e40bd070 con 0x7f09fc15fcf0 2024-04-25T09:06:52.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.946+0000 7f0a03600640 1 -- 172.21.15.173:0/2702963033 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09fc09b4a0 con 0x7f09fc15fcf0 2024-04-25T09:06:52.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.946+0000 7f09f9600640 1 -- 172.21.15.173:0/2702963033 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e40b7660 con 0x7f09fc15fcf0 2024-04-25T09:06:52.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.946+0000 7f0a03600640 1 -- 172.21.15.173:0/2702963033 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09fc09ba60 con 0x7f09fc15fcf0 2024-04-25T09:06:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.946+0000 7f0a03600640 1 -- 172.21.15.173:0/2702963033 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09fc0d0e30 con 0x7f09fc15fcf0 2024-04-25T09:06:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.946+0000 7f09f9600640 1 -- 172.21.15.173:0/2702963033 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f09e40b7800 con 0x7f09fc15fcf0 2024-04-25T09:06:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.946+0000 7f09f9600640 1 --2- 172.21.15.173:0/2702963033 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f09d8066f60 0x7f09d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.946+0000 7f09f9600640 1 -- 172.21.15.173:0/2702963033 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f09e411f4a0 con 0x7f09fc15fcf0 2024-04-25T09:06:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.946+0000 7f0a00c00640 1 --2- 172.21.15.173:0/2702963033 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f09d8066f60 0x7f09d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.950+0000 7f0a00c00640 1 --2- 172.21.15.173:0/2702963033 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f09d8066f60 0x7f09d8069420 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f09ec001710 tx=0x7f09ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:52.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:52.950+0000 7f09f9600640 1 -- 172.21.15.173:0/2702963033 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f09e4016150 con 0x7f09fc15fcf0 2024-04-25T09:06:53.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.138+0000 7f0a03600640 1 -- 172.21.15.173:0/2702963033 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f09fc073ab0 con 0x7f09fc15fcf0 2024-04-25T09:06:53.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.770+0000 7f09f9600640 1 -- 172.21.15.173:0/2702963033 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v39) v1 ==== 122+0+0 (secure 0 0 0) 0x7f09e40f0280 con 0x7f09fc15fcf0 2024-04-25T09:06:53.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.774+0000 7f0a03600640 1 -- 172.21.15.173:0/2702963033 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f09d8066f60 msgr2=0x7f09d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.774+0000 7f0a03600640 1 --2- 172.21.15.173:0/2702963033 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f09d8066f60 0x7f09d8069420 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f09ec001710 tx=0x7f09ec009040 comp rx=0 tx=0).stop 2024-04-25T09:06:53.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.774+0000 7f0a03600640 1 -- 172.21.15.173:0/2702963033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09fc15fcf0 msgr2=0x7f09fc09ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.774+0000 7f0a03600640 1 --2- 172.21.15.173:0/2702963033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09fc15fcf0 0x7f09fc09ac70 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f09e40af040 tx=0x7f09e401ad10 comp rx=0 tx=0).stop 2024-04-25T09:06:53.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.774+0000 7f0a03600640 1 -- 172.21.15.173:0/2702963033 shutdown_connections 2024-04-25T09:06:53.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.774+0000 7f0a03600640 1 --2- 172.21.15.173:0/2702963033 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f09d8066f60 0x7f09d8069420 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.774+0000 7f0a03600640 1 --2- 172.21.15.173:0/2702963033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09fc150420 0x7f09fc155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.774+0000 7f0a03600640 1 --2- 172.21.15.173:0/2702963033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09fc15fcf0 0x7f09fc09ac70 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.774+0000 7f0a03600640 1 --2- 172.21.15.173:0/2702963033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09fc0b4e10 0x7f09fc14ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.774+0000 7f0a03600640 1 -- 172.21.15.173:0/2702963033 >> 172.21.15.173:0/2702963033 conn(0x7f09fc0cfed0 msgr2=0x7f09fc15e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:53.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.774+0000 7f0a03600640 1 -- 172.21.15.173:0/2702963033 shutdown_connections 2024-04-25T09:06:53.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.774+0000 7f0a03600640 1 -- 172.21.15.173:0/2702963033 wait complete. 2024-04-25T09:06:53.786 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:06:53.786 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:53.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.938+0000 7f8d64c00640 1 Processor -- start 2024-04-25T09:06:53.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.938+0000 7f8d64c00640 1 -- start start 2024-04-25T09:06:53.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.938+0000 7f8d64c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8d600cc8b0 0x7f8d600ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.938+0000 7f8d64c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8d600ce8f0 0x7f8d600ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.938+0000 7f8d64c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d6006e7c0 con 0x7f8d60145250 2024-04-25T09:06:53.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.938+0000 7f8d64c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6006d720 con 0x7f8d600cc8b0 2024-04-25T09:06:53.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.938+0000 7f8d64c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6006da00 con 0x7f8d600ce8f0 2024-04-25T09:06:53.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.938+0000 7f8d5d400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8d600cc8b0 0x7f8d600ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.938+0000 7f8d5d400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8d600cc8b0 0x7f8d600ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53044/0 (socket says 172.21.15.173:53044) 2024-04-25T09:06:53.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.938+0000 7f8d5d400640 1 -- 172.21.15.173:0/2972840765 learned_addr learned my addr 172.21.15.173:0/2972840765 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:53.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.938+0000 7f8d5d400640 1 -- 172.21.15.173:0/2972840765 >> v2:172.21.15.194:3300/0 conn(0x7f8d600ce8f0 msgr2=0x7f8d600ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:53.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.938+0000 7f8d5e800640 1 --2- 172.21.15.173:0/2972840765 >> v2:172.21.15.194:3300/0 conn(0x7f8d600ce8f0 0x7f8d600ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.938+0000 7f8d5d400640 1 --2- 172.21.15.173:0/2972840765 >> v2:172.21.15.194:3300/0 conn(0x7f8d600ce8f0 0x7f8d600ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.938+0000 7f8d5d400640 1 -- 172.21.15.173:0/2972840765 >> v1:172.21.15.194:6789/0 conn(0x7f8d60145250 legacy=0x7f8d6015c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:53.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.938+0000 7f8d5d400640 1 -- 172.21.15.173:0/2972840765 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6006dce0 con 0x7f8d600cc8b0 2024-04-25T09:06:53.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.938+0000 7f8d5e800640 1 --2- 172.21.15.173:0/2972840765 >> v2:172.21.15.194:3300/0 conn(0x7f8d600ce8f0 0x7f8d600ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:53.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.942+0000 7f8d5d400640 1 --2- 172.21.15.173:0/2972840765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d600cc8b0 0x7f8d600ccd30 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f8d6006f4a0 tx=0x7f8d4c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9152ca4960a28d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:53.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.942+0000 7f8d5ca00640 1 -- 172.21.15.173:0/2972840765 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c0b1070 con 0x7f8d600cc8b0 2024-04-25T09:06:53.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.942+0000 7f8d5ca00640 1 -- 172.21.15.173:0/2972840765 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4c0ac630 con 0x7f8d600cc8b0 2024-04-25T09:06:53.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.942+0000 7f8d5ca00640 1 -- 172.21.15.173:0/2972840765 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c0a8050 con 0x7f8d600cc8b0 2024-04-25T09:06:53.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.942+0000 7f8d64c00640 1 -- 172.21.15.173:0/2972840765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d600cc8b0 msgr2=0x7f8d600ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.942+0000 7f8d64c00640 1 --2- 172.21.15.173:0/2972840765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d600cc8b0 0x7f8d600ccd30 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f8d6006f4a0 tx=0x7f8d4c01c4e0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.942+0000 7f8d64c00640 1 -- 172.21.15.173:0/2972840765 shutdown_connections 2024-04-25T09:06:53.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.942+0000 7f8d64c00640 1 --2- 172.21.15.173:0/2972840765 >> v2:172.21.15.194:3300/0 conn(0x7f8d600ce8f0 0x7f8d600ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.942+0000 7f8d64c00640 1 --2- 172.21.15.173:0/2972840765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d600cc8b0 0x7f8d600ccd30 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.942+0000 7f8d64c00640 1 -- 172.21.15.173:0/2972840765 >> 172.21.15.173:0/2972840765 conn(0x7f8d6006ac90 msgr2=0x7f8d6006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:53.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.942+0000 7f8d64c00640 1 -- 172.21.15.173:0/2972840765 shutdown_connections 2024-04-25T09:06:53.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.942+0000 7f8d64c00640 1 -- 172.21.15.173:0/2972840765 wait complete. 2024-04-25T09:06:53.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d64c00640 1 Processor -- start 2024-04-25T09:06:53.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d64c00640 1 -- start start 2024-04-25T09:06:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d64c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d600cc8b0 0x7f8d600b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d64c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d600ce8f0 0x7f8d6015d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d64c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d60145250 0x7f8d6015a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d64c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6006d380 con 0x7f8d600ce8f0 2024-04-25T09:06:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d64c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6006ef80 con 0x7f8d60145250 2024-04-25T09:06:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d64c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6006d500 con 0x7f8d600cc8b0 2024-04-25T09:06:53.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d5d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d600ce8f0 0x7f8d6015d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d5d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d600ce8f0 0x7f8d6015d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53060/0 (socket says 172.21.15.173:53060) 2024-04-25T09:06:53.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d5d400640 1 -- 172.21.15.173:0/1681730531 learned_addr learned my addr 172.21.15.173:0/1681730531 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:53.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d5e800640 1 --2- 172.21.15.173:0/1681730531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d60145250 0x7f8d6015a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d5de00640 1 --2- 172.21.15.173:0/1681730531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d600cc8b0 0x7f8d600b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d5d400640 1 -- 172.21.15.173:0/1681730531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d600cc8b0 msgr2=0x7f8d600b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d5d400640 1 --2- 172.21.15.173:0/1681730531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d600cc8b0 0x7f8d600b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d5d400640 1 -- 172.21.15.173:0/1681730531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d60145250 msgr2=0x7f8d6015a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d5d400640 1 --2- 172.21.15.173:0/1681730531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d60145250 0x7f8d6015a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d5d400640 1 -- 172.21.15.173:0/1681730531 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6015df40 con 0x7f8d600ce8f0 2024-04-25T09:06:53.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d5d400640 1 --2- 172.21.15.173:0/1681730531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d600ce8f0 0x7f8d6015d480 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c0af040 tx=0x7f8d4c019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:53.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d56000640 1 -- 172.21.15.173:0/1681730531 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c0b1070 con 0x7f8d600ce8f0 2024-04-25T09:06:53.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d56000640 1 -- 172.21.15.173:0/1681730531 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4c0ab800 con 0x7f8d600ce8f0 2024-04-25T09:06:53.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d56000640 1 -- 172.21.15.173:0/1681730531 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c0a8040 con 0x7f8d600ce8f0 2024-04-25T09:06:53.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d64c00640 1 -- 172.21.15.173:0/1681730531 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d6015e220 con 0x7f8d600ce8f0 2024-04-25T09:06:53.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.946+0000 7f8d64c00640 1 -- 172.21.15.173:0/1681730531 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6015e7e0 con 0x7f8d600ce8f0 2024-04-25T09:06:53.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.950+0000 7f8d64c00640 1 -- 172.21.15.173:0/1681730531 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d60073a40 con 0x7f8d600ce8f0 2024-04-25T09:06:53.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.950+0000 7f8d56000640 1 -- 172.21.15.173:0/1681730531 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8d4c0be060 con 0x7f8d600ce8f0 2024-04-25T09:06:53.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.950+0000 7f8d56000640 1 --2- 172.21.15.173:0/1681730531 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8d40066f60 0x7f8d40069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.950+0000 7f8d56000640 1 -- 172.21.15.173:0/1681730531 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8d4c11e640 con 0x7f8d600ce8f0 2024-04-25T09:06:53.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.950+0000 7f8d5de00640 1 --2- 172.21.15.173:0/1681730531 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8d40066f60 0x7f8d40069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.950+0000 7f8d5de00640 1 --2- 172.21.15.173:0/1681730531 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8d40066f60 0x7f8d40069420 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8d6015d3b0 tx=0x7f8d50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:53.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:53.954+0000 7f8d56000640 1 -- 172.21.15.173:0/1681730531 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8d4c0160d0 con 0x7f8d600ce8f0 2024-04-25T09:06:54.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.138+0000 7f8d64c00640 1 -- 172.21.15.173:0/1681730531 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d6006c300 con 0x7f8d600ce8f0 2024-04-25T09:06:54.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.138+0000 7f8d56000640 1 -- 172.21.15.173:0/1681730531 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4945 (secure 0 0 0) 0x7f8d4c0ef4c0 con 0x7f8d600ce8f0 2024-04-25T09:06:54.128 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:54.128 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5873,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1118362753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":1118362753},{"type":"v1","addr":"172.21.15.173:6837","nonce":1118362753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6340,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/853427023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":853427023},{"type":"v1","addr":"172.21.15.194:6834","nonce":853427023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6343,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2791623450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2791623450},{"type":"v1","addr":"172.21.15.194:6835","nonce":2791623450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:50.132659+0000","modified":"2024-04-25T09:06:53.143192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6711":{"gid":6711,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6836/962695208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":962695208},{"type":"v1","addr":"172.21.15.173:6836","nonce":962695208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:06:54.128 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 39 2024-04-25T09:06:54.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.142+0000 7f8d64c00640 1 -- 172.21.15.173:0/1681730531 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8d40066f60 msgr2=0x7f8d40069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.142+0000 7f8d64c00640 1 --2- 172.21.15.173:0/1681730531 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8d40066f60 0x7f8d40069420 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8d6015d3b0 tx=0x7f8d50009040 comp rx=0 tx=0).stop 2024-04-25T09:06:54.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.142+0000 7f8d64c00640 1 -- 172.21.15.173:0/1681730531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d600ce8f0 msgr2=0x7f8d6015d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.142+0000 7f8d64c00640 1 --2- 172.21.15.173:0/1681730531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d600ce8f0 0x7f8d6015d480 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c0af040 tx=0x7f8d4c019280 comp rx=0 tx=0).stop 2024-04-25T09:06:54.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.142+0000 7f8d64c00640 1 -- 172.21.15.173:0/1681730531 shutdown_connections 2024-04-25T09:06:54.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.142+0000 7f8d64c00640 1 --2- 172.21.15.173:0/1681730531 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8d40066f60 0x7f8d40069420 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.142+0000 7f8d64c00640 1 --2- 172.21.15.173:0/1681730531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d60145250 0x7f8d6015a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.142+0000 7f8d64c00640 1 --2- 172.21.15.173:0/1681730531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d600ce8f0 0x7f8d6015d480 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.142+0000 7f8d64c00640 1 --2- 172.21.15.173:0/1681730531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d600cc8b0 0x7f8d600b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.142+0000 7f8d64c00640 1 -- 172.21.15.173:0/1681730531 >> 172.21.15.173:0/1681730531 conn(0x7f8d6006ac90 msgr2=0x7f8d6006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:54.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.142+0000 7f8d64c00640 1 -- 172.21.15.173:0/1681730531 shutdown_connections 2024-04-25T09:06:54.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.142+0000 7f8d64c00640 1 -- 172.21.15.173:0/1681730531 wait complete. 2024-04-25T09:06:54.150 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:54.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2ff4600640 1 Processor -- start 2024-04-25T09:06:54.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2ff4600640 1 -- start start 2024-04-25T09:06:54.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2ff4600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fec15ba20 0x7f2fec15be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2ff4600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fec15c460 con 0x7f2fec0b70f0 2024-04-25T09:06:54.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2ff4600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fec15c740 con 0x7f2fec0b7550 2024-04-25T09:06:54.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2ff4600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec15ca20 con 0x7f2fec15ba20 2024-04-25T09:06:54.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2ff1200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f2fec0b70f0 0x7f2fec06f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:35210/0 (socket says 172.21.15.173:35210) 2024-04-25T09:06:54.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2ff1200640 1 -- 172.21.15.173:0/2016237220 learned_addr learned my addr 172.21.15.173:0/2016237220 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:54.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2ff1c00640 1 --2- 172.21.15.173:0/2016237220 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fec15ba20 0x7f2fec15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2febe00640 1 -- 172.21.15.173:0/2016237220 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195685987 0 0) 0x7f2fec15c460 con 0x7f2fec0b70f0 2024-04-25T09:06:54.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2febe00640 1 -- 172.21.15.173:0/2016237220 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fd4003530 con 0x7f2fec0b70f0 2024-04-25T09:06:54.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2febe00640 1 -- 172.21.15.173:0/2016237220 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227851338 0 0) 0x7f2fec15c740 con 0x7f2fec0b7550 2024-04-25T09:06:54.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2febe00640 1 -- 172.21.15.173:0/2016237220 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fec15c460 con 0x7f2fec0b7550 2024-04-25T09:06:54.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2febe00640 1 -- 172.21.15.173:0/2016237220 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 700274589 0 0) 0x7f2fd4003530 con 0x7f2fec0b70f0 2024-04-25T09:06:54.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2febe00640 1 -- 172.21.15.173:0/2016237220 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fec15ba20 msgr2=0x7f2fec15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:54.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2febe00640 1 --2- 172.21.15.173:0/2016237220 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fec15ba20 0x7f2fec15be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2febe00640 1 -- 172.21.15.173:0/2016237220 >> v1:172.21.15.194:6789/0 conn(0x7f2fec0b7550 legacy=0x7f2fec0d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2febe00640 1 -- 172.21.15.173:0/2016237220 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec15cd00 con 0x7f2fec0b70f0 2024-04-25T09:06:54.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2febe00640 1 -- 172.21.15.173:0/2016237220 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f2fd8001680 con 0x7f2fec0b70f0 2024-04-25T09:06:54.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2febe00640 1 -- 172.21.15.173:0/2016237220 >> v1:172.21.15.173:6789/0 conn(0x7f2fec0b70f0 legacy=0x7f2fec06f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2febe00640 1 --2- 172.21.15.173:0/2016237220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fd4003b80 0x7f2fd4003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2febe00640 1 --2- 172.21.15.173:0/2016237220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fd4004810 0x7f2fd4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2febe00640 1 --2- 172.21.15.173:0/2016237220 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fec15ba20 0x7f2fd40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2febe00640 1 -- 172.21.15.173:0/2016237220 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec15ca20 con 0x7f2fd4004810 2024-04-25T09:06:54.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2febe00640 1 -- 172.21.15.173:0/2016237220 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd400ba80 con 0x7f2fd4003b80 2024-04-25T09:06:54.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2febe00640 1 -- 172.21.15.173:0/2016237220 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd400bc50 con 0x7f2fec15ba20 2024-04-25T09:06:54.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2ff1200640 1 --2- 172.21.15.173:0/2016237220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fd4004810 0x7f2fd4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2ff1c00640 1 --2- 172.21.15.173:0/2016237220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fd4003b80 0x7f2fd4003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2ff2600640 1 --2- 172.21.15.173:0/2016237220 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fec15ba20 0x7f2fd40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.298+0000 7f2ff1200640 1 -- 172.21.15.173:0/2016237220 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fec15ba20 msgr2=0x7f2fd40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:54.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.302+0000 7f2ff1200640 1 --2- 172.21.15.173:0/2016237220 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fec15ba20 0x7f2fd40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.302+0000 7f2ff1200640 1 -- 172.21.15.173:0/2016237220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fd4003b80 msgr2=0x7f2fd4003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:54.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.302+0000 7f2ff1200640 1 --2- 172.21.15.173:0/2016237220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fd4003b80 0x7f2fd4003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.302+0000 7f2ff1200640 1 -- 172.21.15.173:0/2016237220 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd4003530 con 0x7f2fd4004810 2024-04-25T09:06:54.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.302+0000 7f2ff1200640 1 --2- 172.21.15.173:0/2016237220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fd4004810 0x7f2fd4004c90 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f2fd800c210 tx=0x7f2fd801cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ebf2295b1feacc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:54.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.302+0000 7f2febe00640 1 -- 172.21.15.173:0/2016237220 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8007cf0 con 0x7f2fd4004810 2024-04-25T09:06:54.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.302+0000 7f2febe00640 1 -- 172.21.15.173:0/2016237220 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd80a9020 con 0x7f2fd4004810 2024-04-25T09:06:54.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.302+0000 7f2febe00640 1 -- 172.21.15.173:0/2016237220 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8005b00 con 0x7f2fd4004810 2024-04-25T09:06:54.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.302+0000 7f2ff4600640 1 -- 172.21.15.173:0/2016237220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fd4004810 msgr2=0x7f2fd4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.302+0000 7f2ff4600640 1 --2- 172.21.15.173:0/2016237220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fd4004810 0x7f2fd4004c90 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f2fd800c210 tx=0x7f2fd801cba0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.302+0000 7f2ff2600640 1 -- 172.21.15.173:0/2016237220 reap_dead start 2024-04-25T09:06:54.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.302+0000 7f2ff4600640 1 -- 172.21.15.173:0/2016237220 shutdown_connections 2024-04-25T09:06:54.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.302+0000 7f2ff4600640 1 -- 172.21.15.173:0/2016237220 >> 172.21.15.173:0/2016237220 conn(0x7f2fec061880 msgr2=0x7f2fec061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:54.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.302+0000 7f2ff4600640 1 -- 172.21.15.173:0/2016237220 shutdown_connections 2024-04-25T09:06:54.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.302+0000 7f2ff4600640 1 -- 172.21.15.173:0/2016237220 wait complete. 2024-04-25T09:06:54.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff4600640 1 Processor -- start 2024-04-25T09:06:54.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff4600640 1 -- start start 2024-04-25T09:06:54.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff4600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fd4004810 0x7f2fec152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff4600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fec155880 0x7f2fec0b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff4600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fec0b66b0 0x7f2fec148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff4600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0701f0 con 0x7f2fec0b66b0 2024-04-25T09:06:54.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff4600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec070070 con 0x7f2fec155880 2024-04-25T09:06:54.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff4600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec15e720 con 0x7f2fd4004810 2024-04-25T09:06:54.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff2600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fec0b66b0 0x7f2fec148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff2600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fec0b66b0 0x7f2fec148320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53088/0 (socket says 172.21.15.173:53088) 2024-04-25T09:06:54.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff2600640 1 -- 172.21.15.173:0/1564457832 learned_addr learned my addr 172.21.15.173:0/1564457832 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:54.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff1200640 1 --2- 172.21.15.173:0/1564457832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fec155880 0x7f2fec0b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff1c00640 1 --2- 172.21.15.173:0/1564457832 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fd4004810 0x7f2fec152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff2600640 1 -- 172.21.15.173:0/1564457832 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fd4004810 msgr2=0x7f2fec152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff2600640 1 --2- 172.21.15.173:0/1564457832 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fd4004810 0x7f2fec152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff2600640 1 -- 172.21.15.173:0/1564457832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fec155880 msgr2=0x7f2fec0b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff2600640 1 --2- 172.21.15.173:0/1564457832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fec155880 0x7f2fec0b6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff2600640 1 -- 172.21.15.173:0/1564457832 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec154ac0 con 0x7f2fec0b66b0 2024-04-25T09:06:54.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff2600640 1 --2- 172.21.15.173:0/1564457832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fec0b66b0 0x7f2fec148320 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0b12c0 tx=0x7f2fe4011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:54.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2fe9600640 1 -- 172.21.15.173:0/1564457832 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4010040 con 0x7f2fec0b66b0 2024-04-25T09:06:54.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2fe9600640 1 -- 172.21.15.173:0/1564457832 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe401a070 con 0x7f2fec0b66b0 2024-04-25T09:06:54.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2fe9600640 1 -- 172.21.15.173:0/1564457832 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe400fe90 con 0x7f2fec0b66b0 2024-04-25T09:06:54.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff4600640 1 -- 172.21.15.173:0/1564457832 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fec154da0 con 0x7f2fec0b66b0 2024-04-25T09:06:54.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.306+0000 7f2ff4600640 1 -- 172.21.15.173:0/1564457832 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fec155360 con 0x7f2fec0b66b0 2024-04-25T09:06:54.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.310+0000 7f2ff4600640 1 -- 172.21.15.173:0/1564457832 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fec073a40 con 0x7f2fec0b66b0 2024-04-25T09:06:54.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.310+0000 7f2fe9600640 1 -- 172.21.15.173:0/1564457832 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2fe401f460 con 0x7f2fec0b66b0 2024-04-25T09:06:54.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.310+0000 7f2fe9600640 1 --2- 172.21.15.173:0/1564457832 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2fcc067130 0x7f2fcc0695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.310+0000 7f2fe9600640 1 -- 172.21.15.173:0/1564457832 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2fe4088580 con 0x7f2fec0b66b0 2024-04-25T09:06:54.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.310+0000 7f2ff1c00640 1 --2- 172.21.15.173:0/1564457832 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2fcc067130 0x7f2fcc0695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.310+0000 7f2ff1c00640 1 --2- 172.21.15.173:0/1564457832 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2fcc067130 0x7f2fcc0695f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0cb960 tx=0x7f2fe0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:54.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.314+0000 7f2fe9600640 1 -- 172.21.15.173:0/1564457832 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2fe4059360 con 0x7f2fec0b66b0 2024-04-25T09:06:54.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.470+0000 7f2ff4600640 1 -- 172.21.15.173:0/1564457832 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fec0cefc0 con 0x7f2fec0b66b0 2024-04-25T09:06:54.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.470+0000 7f2fe9600640 1 -- 172.21.15.173:0/1564457832 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16944 (secure 0 0 0) 0x7f2fe4058c60 con 0x7f2fec0b66b0 2024-04-25T09:06:54.459 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:54.459 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":69,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:06:51.749084+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:48.493059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:49.133352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:54.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.474+0000 7f2ff4600640 1 -- 172.21.15.173:0/1564457832 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2fcc067130 msgr2=0x7f2fcc0695f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.474+0000 7f2ff4600640 1 --2- 172.21.15.173:0/1564457832 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2fcc067130 0x7f2fcc0695f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0cb960 tx=0x7f2fe0008040 comp rx=0 tx=0).stop 2024-04-25T09:06:54.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.474+0000 7f2ff4600640 1 -- 172.21.15.173:0/1564457832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fec0b66b0 msgr2=0x7f2fec148320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.474+0000 7f2ff4600640 1 --2- 172.21.15.173:0/1564457832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fec0b66b0 0x7f2fec148320 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0b12c0 tx=0x7f2fe4011f90 comp rx=0 tx=0).stop 2024-04-25T09:06:54.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.474+0000 7f2ff4600640 1 -- 172.21.15.173:0/1564457832 shutdown_connections 2024-04-25T09:06:54.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.474+0000 7f2ff4600640 1 --2- 172.21.15.173:0/1564457832 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2fcc067130 0x7f2fcc0695f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.474+0000 7f2ff4600640 1 --2- 172.21.15.173:0/1564457832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fec0b66b0 0x7f2fec148320 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.474+0000 7f2ff4600640 1 --2- 172.21.15.173:0/1564457832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fec155880 0x7f2fec0b6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.474+0000 7f2ff4600640 1 --2- 172.21.15.173:0/1564457832 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fd4004810 0x7f2fec152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.474+0000 7f2ff4600640 1 -- 172.21.15.173:0/1564457832 >> 172.21.15.173:0/1564457832 conn(0x7f2fec061880 msgr2=0x7f2fec06f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:54.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.474+0000 7f2ff4600640 1 -- 172.21.15.173:0/1564457832 shutdown_connections 2024-04-25T09:06:54.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.474+0000 7f2ff4600640 1 -- 172.21.15.173:0/1564457832 wait complete. 2024-04-25T09:06:54.481 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:06:54.481 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:06:54.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.626+0000 7fcf3b000640 1 Processor -- start 2024-04-25T09:06:54.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.626+0000 7fcf3b000640 1 -- start start 2024-04-25T09:06:54.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.630+0000 7fcf3b000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcf340b3e70 0x7fcf340b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.630+0000 7fcf3b000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcf340aefa0 0x7fcf340b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.630+0000 7fcf3b000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf340b4790 con 0x7fcf3415edd0 2024-04-25T09:06:54.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.630+0000 7fcf3b000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3406dd50 con 0x7fcf340b3e70 2024-04-25T09:06:54.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.630+0000 7fcf3b000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3415f320 con 0x7fcf340aefa0 2024-04-25T09:06:54.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.630+0000 7fcf33e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcf340b3e70 0x7fcf340b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.630+0000 7fcf33e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcf340b3e70 0x7fcf340b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53100/0 (socket says 172.21.15.173:53100) 2024-04-25T09:06:54.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.630+0000 7fcf33e00640 1 -- 172.21.15.173:0/3523873898 learned_addr learned my addr 172.21.15.173:0/3523873898 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:54.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.630+0000 7fcf39000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fcf3415edd0 0x7fcf340b2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:35218/0 (socket says 172.21.15.173:35218) 2024-04-25T09:06:54.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.630+0000 7fcf2b400640 1 --2- 172.21.15.173:0/3523873898 >> v2:172.21.15.194:3300/0 conn(0x7fcf340aefa0 0x7fcf340b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.630+0000 7fcf33e00640 1 -- 172.21.15.173:0/3523873898 >> v2:172.21.15.194:3300/0 conn(0x7fcf340aefa0 msgr2=0x7fcf340b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:54.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.630+0000 7fcf33e00640 1 --2- 172.21.15.173:0/3523873898 >> v2:172.21.15.194:3300/0 conn(0x7fcf340aefa0 0x7fcf340b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.630+0000 7fcf33e00640 1 -- 172.21.15.173:0/3523873898 >> v1:172.21.15.173:6789/0 conn(0x7fcf3415edd0 legacy=0x7fcf340b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.630+0000 7fcf33e00640 1 -- 172.21.15.173:0/3523873898 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3406d420 con 0x7fcf340b3e70 2024-04-25T09:06:54.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.630+0000 7fcf33400640 1 -- 172.21.15.173:0/3523873898 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301150320 0 0) 0x7fcf340b4790 con 0x7fcf3415edd0 2024-04-25T09:06:54.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.634+0000 7fcf33e00640 1 --2- 172.21.15.173:0/3523873898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf340b3e70 0x7fcf340b4250 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fcf340d0650 tx=0x7fcf2401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b092949c0c893d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:54.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.634+0000 7fcf33400640 1 -- 172.21.15.173:0/3523873898 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf240aa670 con 0x7fcf340b3e70 2024-04-25T09:06:54.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.634+0000 7fcf33400640 1 -- 172.21.15.173:0/3523873898 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf240af070 con 0x7fcf340b3e70 2024-04-25T09:06:54.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.634+0000 7fcf33400640 1 -- 172.21.15.173:0/3523873898 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf240aaa30 con 0x7fcf340b3e70 2024-04-25T09:06:54.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.634+0000 7fcf3b000640 1 -- 172.21.15.173:0/3523873898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf340b3e70 msgr2=0x7fcf340b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.634+0000 7fcf3b000640 1 --2- 172.21.15.173:0/3523873898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf340b3e70 0x7fcf340b4250 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fcf340d0650 tx=0x7fcf2401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.634+0000 7fcf3b000640 1 -- 172.21.15.173:0/3523873898 shutdown_connections 2024-04-25T09:06:54.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.634+0000 7fcf3b000640 1 --2- 172.21.15.173:0/3523873898 >> v2:172.21.15.194:3300/0 conn(0x7fcf340aefa0 0x7fcf340b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.634+0000 7fcf3b000640 1 --2- 172.21.15.173:0/3523873898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf340b3e70 0x7fcf340b4250 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.634+0000 7fcf3b000640 1 -- 172.21.15.173:0/3523873898 >> 172.21.15.173:0/3523873898 conn(0x7fcf3406ac90 msgr2=0x7fcf3406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:54.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.634+0000 7fcf3b000640 1 -- 172.21.15.173:0/3523873898 shutdown_connections 2024-04-25T09:06:54.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.634+0000 7fcf3b000640 1 -- 172.21.15.173:0/3523873898 wait complete. 2024-04-25T09:06:54.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.634+0000 7fcf3b000640 1 Processor -- start 2024-04-25T09:06:54.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.634+0000 7fcf3b000640 1 -- start start 2024-04-25T09:06:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf3b000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf340aefa0 0x7fcf3414b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf3b000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf340b3e70 0x7fcf3415b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf3b000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf3415edd0 0x7fcf3415b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf3b000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3406e1e0 con 0x7fcf340aefa0 2024-04-25T09:06:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf3b000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3415aba0 con 0x7fcf340b3e70 2024-04-25T09:06:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf3b000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3406e360 con 0x7fcf3415edd0 2024-04-25T09:06:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf33e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf340aefa0 0x7fcf3414b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf33e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf340aefa0 0x7fcf3414b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53110/0 (socket says 172.21.15.173:53110) 2024-04-25T09:06:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf33e00640 1 -- 172.21.15.173:0/3211010402 learned_addr learned my addr 172.21.15.173:0/3211010402 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf2b400640 1 --2- 172.21.15.173:0/3211010402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf340b3e70 0x7fcf3415b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf39000640 1 --2- 172.21.15.173:0/3211010402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf3415edd0 0x7fcf3415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf33e00640 1 -- 172.21.15.173:0/3211010402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf3415edd0 msgr2=0x7fcf3415b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf33e00640 1 --2- 172.21.15.173:0/3211010402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf3415edd0 0x7fcf3415b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf33e00640 1 -- 172.21.15.173:0/3211010402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf340b3e70 msgr2=0x7fcf3415b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf33e00640 1 --2- 172.21.15.173:0/3211010402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf340b3e70 0x7fcf3415b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf33e00640 1 -- 172.21.15.173:0/3211010402 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3414b910 con 0x7fcf340aefa0 2024-04-25T09:06:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf33e00640 1 --2- 172.21.15.173:0/3211010402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf340aefa0 0x7fcf3414b3d0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fcf240ac040 tx=0x7fcf2401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf30c00640 1 -- 172.21.15.173:0/3211010402 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf240bd5f0 con 0x7fcf340aefa0 2024-04-25T09:06:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf30c00640 1 -- 172.21.15.173:0/3211010402 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf240bd7b0 con 0x7fcf340aefa0 2024-04-25T09:06:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf3b000640 1 -- 172.21.15.173:0/3211010402 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf340b2090 con 0x7fcf340aefa0 2024-04-25T09:06:54.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf30c00640 1 -- 172.21.15.173:0/3211010402 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf240bdba0 con 0x7fcf340aefa0 2024-04-25T09:06:54.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf3b000640 1 -- 172.21.15.173:0/3211010402 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf340b2650 con 0x7fcf340aefa0 2024-04-25T09:06:54.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf3b000640 1 -- 172.21.15.173:0/3211010402 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf34073a40 con 0x7fcf340aefa0 2024-04-25T09:06:54.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.638+0000 7fcf30c00640 1 -- 172.21.15.173:0/3211010402 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcf240b33f0 con 0x7fcf340aefa0 2024-04-25T09:06:54.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.642+0000 7fcf30c00640 1 --2- 172.21.15.173:0/3211010402 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcf10066f60 0x7fcf10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.642+0000 7fcf30c00640 1 -- 172.21.15.173:0/3211010402 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcf2411fce0 con 0x7fcf340aefa0 2024-04-25T09:06:54.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.642+0000 7fcf2b400640 1 --2- 172.21.15.173:0/3211010402 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcf10066f60 0x7fcf10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.642+0000 7fcf2b400640 1 --2- 172.21.15.173:0/3211010402 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcf10066f60 0x7fcf10069420 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcf34072160 tx=0x7fcf1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:54.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.646+0000 7fcf30c00640 1 -- 172.21.15.173:0/3211010402 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcf240c3060 con 0x7fcf340aefa0 2024-04-25T09:06:54.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.798+0000 7fcf3b000640 1 -- 172.21.15.173:0/3211010402 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf340b2d10 con 0x7fcf10066f60 2024-04-25T09:06:54.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.806+0000 7fcf30c00640 1 -- 172.21.15.173:0/3211010402 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252018 (secure 0 0 0) 0x7fcf340b2d10 con 0x7fcf10066f60 2024-04-25T09:06:54.796 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:54.798 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:06:54.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.810+0000 7fcf3b000640 1 -- 172.21.15.173:0/3211010402 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcf10066f60 msgr2=0x7fcf10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.810+0000 7fcf3b000640 1 --2- 172.21.15.173:0/3211010402 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcf10066f60 0x7fcf10069420 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcf34072160 tx=0x7fcf1c008040 comp rx=0 tx=0).stop 2024-04-25T09:06:54.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.810+0000 7fcf3b000640 1 -- 172.21.15.173:0/3211010402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf340aefa0 msgr2=0x7fcf3414b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.810+0000 7fcf3b000640 1 --2- 172.21.15.173:0/3211010402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf340aefa0 0x7fcf3414b3d0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fcf240ac040 tx=0x7fcf2401ad30 comp rx=0 tx=0).stop 2024-04-25T09:06:54.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.810+0000 7fcf3b000640 1 -- 172.21.15.173:0/3211010402 shutdown_connections 2024-04-25T09:06:54.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.810+0000 7fcf3b000640 1 --2- 172.21.15.173:0/3211010402 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcf10066f60 0x7fcf10069420 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.810+0000 7fcf3b000640 1 --2- 172.21.15.173:0/3211010402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf3415edd0 0x7fcf3415b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.810+0000 7fcf3b000640 1 --2- 172.21.15.173:0/3211010402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf340b3e70 0x7fcf3415b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.810+0000 7fcf3b000640 1 --2- 172.21.15.173:0/3211010402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf340aefa0 0x7fcf3414b3d0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.810+0000 7fcf3b000640 1 -- 172.21.15.173:0/3211010402 >> 172.21.15.173:0/3211010402 conn(0x7fcf3406ac90 msgr2=0x7fcf340af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:54.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.810+0000 7fcf3b000640 1 -- 172.21.15.173:0/3211010402 shutdown_connections 2024-04-25T09:06:54.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:54.810+0000 7fcf3b000640 1 -- 172.21.15.173:0/3211010402 wait complete. 2024-04-25T09:06:54.817 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-04-25T09:06:54.779478+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":320972,"kb_used_data":7676,"kb_used_omap":12,"kb_used_meta":313139,"kb_avail":754653748,"statfs":{"total":773094113280,"available":772765437952,"internally_reserved":0,"allocated":7860224,"data_stored":4185216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":320654896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002552"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774290+0000","last_change":"2024-04-25T09:06:50.774184+0000","last_active":"2024-04-25T09:06:51.774290+0000","last_peered":"2024-04-25T09:06:51.774290+0000","last_clean":"2024-04-25T09:06:51.774290+0000","last_became_active":"2024-04-25T09:06:50.773048+0000","last_became_peered":"2024-04-25T09:06:50.773048+0000","last_unstale":"2024-04-25T09:06:51.774290+0000","last_undegraded":"2024-04-25T09:06:51.774290+0000","last_fullsized":"2024-04-25T09:06:51.774290+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:11.063792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774076+0000","last_change":"2024-04-25T09:06:50.776098+0000","last_active":"2024-04-25T09:06:51.774076+0000","last_peered":"2024-04-25T09:06:51.774076+0000","last_clean":"2024-04-25T09:06:51.774076+0000","last_became_active":"2024-04-25T09:06:50.775764+0000","last_became_peered":"2024-04-25T09:06:50.775764+0000","last_unstale":"2024-04-25T09:06:51.774076+0000","last_undegraded":"2024-04-25T09:06:51.774076+0000","last_fullsized":"2024-04-25T09:06:51.774076+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:58.781138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773487+0000","last_change":"2024-04-25T09:06:50.777583+0000","last_active":"2024-04-25T09:06:51.773487+0000","last_peered":"2024-04-25T09:06:51.773487+0000","last_clean":"2024-04-25T09:06:51.773487+0000","last_became_active":"2024-04-25T09:06:50.777307+0000","last_became_peered":"2024-04-25T09:06:50.777307+0000","last_unstale":"2024-04-25T09:06:51.773487+0000","last_undegraded":"2024-04-25T09:06:51.773487+0000","last_fullsized":"2024-04-25T09:06:51.773487+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:29.296800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759075+0000","last_change":"2024-04-25T09:06:50.762209+0000","last_active":"2024-04-25T09:06:51.759075+0000","last_peered":"2024-04-25T09:06:51.759075+0000","last_clean":"2024-04-25T09:06:51.759075+0000","last_became_active":"2024-04-25T09:06:50.761619+0000","last_became_peered":"2024-04-25T09:06:50.761619+0000","last_unstale":"2024-04-25T09:06:51.759075+0000","last_undegraded":"2024-04-25T09:06:51.759075+0000","last_fullsized":"2024-04-25T09:06:51.759075+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:27.422521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772791+0000","last_change":"2024-04-25T09:06:50.766421+0000","last_active":"2024-04-25T09:06:51.772791+0000","last_peered":"2024-04-25T09:06:51.772791+0000","last_clean":"2024-04-25T09:06:51.772791+0000","last_became_active":"2024-04-25T09:06:50.764884+0000","last_became_peered":"2024-04-25T09:06:50.764884+0000","last_unstale":"2024-04-25T09:06:51.772791+0000","last_undegraded":"2024-04-25T09:06:51.772791+0000","last_fullsized":"2024-04-25T09:06:51.772791+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:56:08.156681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773237+0000","last_change":"2024-04-25T09:06:50.769549+0000","last_active":"2024-04-25T09:06:51.773237+0000","last_peered":"2024-04-25T09:06:51.773237+0000","last_clean":"2024-04-25T09:06:51.773237+0000","last_became_active":"2024-04-25T09:06:50.769153+0000","last_became_peered":"2024-04-25T09:06:50.769153+0000","last_unstale":"2024-04-25T09:06:51.773237+0000","last_undegraded":"2024-04-25T09:06:51.773237+0000","last_fullsized":"2024-04-25T09:06:51.773237+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:01.408076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.760016+0000","last_change":"2024-04-25T09:06:50.772926+0000","last_active":"2024-04-25T09:06:51.760016+0000","last_peered":"2024-04-25T09:06:51.760016+0000","last_clean":"2024-04-25T09:06:51.760016+0000","last_became_active":"2024-04-25T09:06:50.772668+0000","last_became_peered":"2024-04-25T09:06:50.772668+0000","last_unstale":"2024-04-25T09:06:51.760016+0000","last_undegraded":"2024-04-25T09:06:51.760016+0000","last_fullsized":"2024-04-25T09:06:51.760016+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:44.721285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772378+0000","last_change":"2024-04-25T09:06:50.767250+0000","last_active":"2024-04-25T09:06:51.772378+0000","last_peered":"2024-04-25T09:06:51.772378+0000","last_clean":"2024-04-25T09:06:51.772378+0000","last_became_active":"2024-04-25T09:06:50.765486+0000","last_became_peered":"2024-04-25T09:06:50.765486+0000","last_unstale":"2024-04-25T09:06:51.772378+0000","last_undegraded":"2024-04-25T09:06:51.772378+0000","last_fullsized":"2024-04-25T09:06:51.772378+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:42:25.617339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773704+0000","last_change":"2024-04-25T09:06:50.778513+0000","last_active":"2024-04-25T09:06:51.773704+0000","last_peered":"2024-04-25T09:06:51.773704+0000","last_clean":"2024-04-25T09:06:51.773704+0000","last_became_active":"2024-04-25T09:06:50.778250+0000","last_became_peered":"2024-04-25T09:06:50.778250+0000","last_unstale":"2024-04-25T09:06:51.773704+0000","last_undegraded":"2024-04-25T09:06:51.773704+0000","last_fullsized":"2024-04-25T09:06:51.773704+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:44.515167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773420+0000","last_change":"2024-04-25T09:06:50.785992+0000","last_active":"2024-04-25T09:06:51.773420+0000","last_peered":"2024-04-25T09:06:51.773420+0000","last_clean":"2024-04-25T09:06:51.773420+0000","last_became_active":"2024-04-25T09:06:50.785695+0000","last_became_peered":"2024-04-25T09:06:50.785695+0000","last_unstale":"2024-04-25T09:06:51.773420+0000","last_undegraded":"2024-04-25T09:06:51.773420+0000","last_fullsized":"2024-04-25T09:06:51.773420+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:46.997116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759066+0000","last_change":"2024-04-25T09:06:50.772960+0000","last_active":"2024-04-25T09:06:51.759066+0000","last_peered":"2024-04-25T09:06:51.759066+0000","last_clean":"2024-04-25T09:06:51.759066+0000","last_became_active":"2024-04-25T09:06:50.772366+0000","last_became_peered":"2024-04-25T09:06:50.772366+0000","last_unstale":"2024-04-25T09:06:51.759066+0000","last_undegraded":"2024-04-25T09:06:51.759066+0000","last_fullsized":"2024-04-25T09:06:51.759066+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:42.928642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773171+0000","last_change":"2024-04-25T09:06:50.769056+0000","last_active":"2024-04-25T09:06:51.773171+0000","last_peered":"2024-04-25T09:06:51.773171+0000","last_clean":"2024-04-25T09:06:51.773171+0000","last_became_active":"2024-04-25T09:06:50.768826+0000","last_became_peered":"2024-04-25T09:06:50.768826+0000","last_unstale":"2024-04-25T09:06:51.773171+0000","last_undegraded":"2024-04-25T09:06:51.773171+0000","last_fullsized":"2024-04-25T09:06:51.773171+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:57.285386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773406+0000","last_change":"2024-04-25T09:06:50.768909+0000","last_active":"2024-04-25T09:06:51.773406+0000","last_peered":"2024-04-25T09:06:51.773406+0000","last_clean":"2024-04-25T09:06:51.773406+0000","last_became_active":"2024-04-25T09:06:50.768644+0000","last_became_peered":"2024-04-25T09:06:50.768644+0000","last_unstale":"2024-04-25T09:06:51.773406+0000","last_undegraded":"2024-04-25T09:06:51.773406+0000","last_fullsized":"2024-04-25T09:06:51.773406+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:48.054806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773096+0000","last_change":"2024-04-25T09:06:50.777432+0000","last_active":"2024-04-25T09:06:51.773096+0000","last_peered":"2024-04-25T09:06:51.773096+0000","last_clean":"2024-04-25T09:06:51.773096+0000","last_became_active":"2024-04-25T09:06:50.777150+0000","last_became_peered":"2024-04-25T09:06:50.777150+0000","last_unstale":"2024-04-25T09:06:51.773096+0000","last_undegraded":"2024-04-25T09:06:51.773096+0000","last_fullsized":"2024-04-25T09:06:51.773096+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:25.723105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772994+0000","last_change":"2024-04-25T09:06:50.772104+0000","last_active":"2024-04-25T09:06:51.772994+0000","last_peered":"2024-04-25T09:06:51.772994+0000","last_clean":"2024-04-25T09:06:51.772994+0000","last_became_active":"2024-04-25T09:06:50.771832+0000","last_became_peered":"2024-04-25T09:06:50.771832+0000","last_unstale":"2024-04-25T09:06:51.772994+0000","last_undegraded":"2024-04-25T09:06:51.772994+0000","last_fullsized":"2024-04-25T09:06:51.772994+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:22.031522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759914+0000","last_change":"2024-04-25T09:06:50.770720+0000","last_active":"2024-04-25T09:06:51.759914+0000","last_peered":"2024-04-25T09:06:51.759914+0000","last_clean":"2024-04-25T09:06:51.759914+0000","last_became_active":"2024-04-25T09:06:50.770290+0000","last_became_peered":"2024-04-25T09:06:50.770290+0000","last_unstale":"2024-04-25T09:06:51.759914+0000","last_undegraded":"2024-04-25T09:06:51.759914+0000","last_fullsized":"2024-04-25T09:06:51.759914+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:37.992830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774417+0000","last_change":"2024-04-25T09:06:50.780004+0000","last_active":"2024-04-25T09:06:51.774417+0000","last_peered":"2024-04-25T09:06:51.774417+0000","last_clean":"2024-04-25T09:06:51.774417+0000","last_became_active":"2024-04-25T09:06:50.779619+0000","last_became_peered":"2024-04-25T09:06:50.779619+0000","last_unstale":"2024-04-25T09:06:51.774417+0000","last_undegraded":"2024-04-25T09:06:51.774417+0000","last_fullsized":"2024-04-25T09:06:51.774417+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:51.731165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759154+0000","last_change":"2024-04-25T09:06:50.757036+0000","last_active":"2024-04-25T09:06:51.759154+0000","last_peered":"2024-04-25T09:06:51.759154+0000","last_clean":"2024-04-25T09:06:51.759154+0000","last_became_active":"2024-04-25T09:06:50.756684+0000","last_became_peered":"2024-04-25T09:06:50.756684+0000","last_unstale":"2024-04-25T09:06:51.759154+0000","last_undegraded":"2024-04-25T09:06:51.759154+0000","last_fullsized":"2024-04-25T09:06:51.759154+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:53.256387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773989+0000","last_change":"2024-04-25T09:06:50.771991+0000","last_active":"2024-04-25T09:06:51.773989+0000","last_peered":"2024-04-25T09:06:51.773989+0000","last_clean":"2024-04-25T09:06:51.773989+0000","last_became_active":"2024-04-25T09:06:50.771743+0000","last_became_peered":"2024-04-25T09:06:50.771743+0000","last_unstale":"2024-04-25T09:06:51.773989+0000","last_undegraded":"2024-04-25T09:06:51.773989+0000","last_fullsized":"2024-04-25T09:06:51.773989+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:58.661212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759457+0000","last_change":"2024-04-25T09:06:50.758625+0000","last_active":"2024-04-25T09:06:51.759457+0000","last_peered":"2024-04-25T09:06:51.759457+0000","last_clean":"2024-04-25T09:06:51.759457+0000","last_became_active":"2024-04-25T09:06:50.758344+0000","last_became_peered":"2024-04-25T09:06:50.758344+0000","last_unstale":"2024-04-25T09:06:51.759457+0000","last_undegraded":"2024-04-25T09:06:51.759457+0000","last_fullsized":"2024-04-25T09:06:51.759457+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:02.755914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773549+0000","last_change":"2024-04-25T09:06:50.770965+0000","last_active":"2024-04-25T09:06:51.773549+0000","last_peered":"2024-04-25T09:06:51.773549+0000","last_clean":"2024-04-25T09:06:51.773549+0000","last_became_active":"2024-04-25T09:06:50.770720+0000","last_became_peered":"2024-04-25T09:06:50.770720+0000","last_unstale":"2024-04-25T09:06:51.773549+0000","last_undegraded":"2024-04-25T09:06:51.773549+0000","last_fullsized":"2024-04-25T09:06:51.773549+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:57.526276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758846+0000","last_change":"2024-04-25T09:06:50.767117+0000","last_active":"2024-04-25T09:06:51.758846+0000","last_peered":"2024-04-25T09:06:51.758846+0000","last_clean":"2024-04-25T09:06:51.758846+0000","last_became_active":"2024-04-25T09:06:50.766806+0000","last_became_peered":"2024-04-25T09:06:50.766806+0000","last_unstale":"2024-04-25T09:06:51.758846+0000","last_undegraded":"2024-04-25T09:06:51.758846+0000","last_fullsized":"2024-04-25T09:06:51.758846+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:28.080484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758796+0000","last_change":"2024-04-25T09:06:50.770072+0000","last_active":"2024-04-25T09:06:51.758796+0000","last_peered":"2024-04-25T09:06:51.758796+0000","last_clean":"2024-04-25T09:06:51.758796+0000","last_became_active":"2024-04-25T09:06:50.769746+0000","last_became_peered":"2024-04-25T09:06:50.769746+0000","last_unstale":"2024-04-25T09:06:51.758796+0000","last_undegraded":"2024-04-25T09:06:51.758796+0000","last_fullsized":"2024-04-25T09:06:51.758796+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:17.232567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773076+0000","last_change":"2024-04-25T09:06:50.776457+0000","last_active":"2024-04-25T09:06:51.773076+0000","last_peered":"2024-04-25T09:06:51.773076+0000","last_clean":"2024-04-25T09:06:51.773076+0000","last_became_active":"2024-04-25T09:06:50.775462+0000","last_became_peered":"2024-04-25T09:06:50.775462+0000","last_unstale":"2024-04-25T09:06:51.773076+0000","last_undegraded":"2024-04-25T09:06:51.773076+0000","last_fullsized":"2024-04-25T09:06:51.773076+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:49.407566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773953+0000","last_change":"2024-04-25T09:06:50.772100+0000","last_active":"2024-04-25T09:06:51.773953+0000","last_peered":"2024-04-25T09:06:51.773953+0000","last_clean":"2024-04-25T09:06:51.773953+0000","last_became_active":"2024-04-25T09:06:50.771812+0000","last_became_peered":"2024-04-25T09:06:50.771812+0000","last_unstale":"2024-04-25T09:06:51.773953+0000","last_undegraded":"2024-04-25T09:06:51.773953+0000","last_fullsized":"2024-04-25T09:06:51.773953+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:50.709647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773695+0000","last_change":"2024-04-25T09:06:50.780040+0000","last_active":"2024-04-25T09:06:51.773695+0000","last_peered":"2024-04-25T09:06:51.773695+0000","last_clean":"2024-04-25T09:06:51.773695+0000","last_became_active":"2024-04-25T09:06:50.779797+0000","last_became_peered":"2024-04-25T09:06:50.779797+0000","last_unstale":"2024-04-25T09:06:51.773695+0000","last_undegraded":"2024-04-25T09:06:51.773695+0000","last_fullsized":"2024-04-25T09:06:51.773695+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:08.299511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759095+0000","last_change":"2024-04-25T09:06:50.773583+0000","last_active":"2024-04-25T09:06:51.759095+0000","last_peered":"2024-04-25T09:06:51.759095+0000","last_clean":"2024-04-25T09:06:51.759095+0000","last_became_active":"2024-04-25T09:06:50.773323+0000","last_became_peered":"2024-04-25T09:06:50.773323+0000","last_unstale":"2024-04-25T09:06:51.759095+0000","last_undegraded":"2024-04-25T09:06:51.759095+0000","last_fullsized":"2024-04-25T09:06:51.759095+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:59.358584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773919+0000","last_change":"2024-04-25T09:06:50.771653+0000","last_active":"2024-04-25T09:06:51.773919+0000","last_peered":"2024-04-25T09:06:51.773919+0000","last_clean":"2024-04-25T09:06:51.773919+0000","last_became_active":"2024-04-25T09:06:50.771330+0000","last_became_peered":"2024-04-25T09:06:50.771330+0000","last_unstale":"2024-04-25T09:06:51.773919+0000","last_undegraded":"2024-04-25T09:06:51.773919+0000","last_fullsized":"2024-04-25T09:06:51.773919+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:06.761636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773226+0000","last_change":"2024-04-25T09:06:50.778814+0000","last_active":"2024-04-25T09:06:51.773226+0000","last_peered":"2024-04-25T09:06:51.773226+0000","last_clean":"2024-04-25T09:06:51.773226+0000","last_became_active":"2024-04-25T09:06:50.778327+0000","last_became_peered":"2024-04-25T09:06:50.778327+0000","last_unstale":"2024-04-25T09:06:51.773226+0000","last_undegraded":"2024-04-25T09:06:51.773226+0000","last_fullsized":"2024-04-25T09:06:51.773226+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:03.496893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772655+0000","last_change":"2024-04-25T09:06:50.771588+0000","last_active":"2024-04-25T09:06:51.772655+0000","last_peered":"2024-04-25T09:06:51.772655+0000","last_clean":"2024-04-25T09:06:51.772655+0000","last_became_active":"2024-04-25T09:06:50.767731+0000","last_became_peered":"2024-04-25T09:06:50.767731+0000","last_unstale":"2024-04-25T09:06:51.772655+0000","last_undegraded":"2024-04-25T09:06:51.772655+0000","last_fullsized":"2024-04-25T09:06:51.772655+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:33.278099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758721+0000","last_change":"2024-04-25T09:06:50.773228+0000","last_active":"2024-04-25T09:06:51.758721+0000","last_peered":"2024-04-25T09:06:51.758721+0000","last_clean":"2024-04-25T09:06:51.758721+0000","last_became_active":"2024-04-25T09:06:50.772962+0000","last_became_peered":"2024-04-25T09:06:50.772962+0000","last_unstale":"2024-04-25T09:06:51.758721+0000","last_undegraded":"2024-04-25T09:06:51.758721+0000","last_fullsized":"2024-04-25T09:06:51.758721+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:18.099004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773045+0000","last_change":"2024-04-25T09:06:50.776544+0000","last_active":"2024-04-25T09:06:51.773045+0000","last_peered":"2024-04-25T09:06:51.773045+0000","last_clean":"2024-04-25T09:06:51.773045+0000","last_became_active":"2024-04-25T09:06:50.776257+0000","last_became_peered":"2024-04-25T09:06:50.776257+0000","last_unstale":"2024-04-25T09:06:51.773045+0000","last_undegraded":"2024-04-25T09:06:51.773045+0000","last_fullsized":"2024-04-25T09:06:51.773045+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:42.960328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774140+0000","last_change":"2024-04-25T09:06:50.774229+0000","last_active":"2024-04-25T09:06:51.774140+0000","last_peered":"2024-04-25T09:06:51.774140+0000","last_clean":"2024-04-25T09:06:51.774140+0000","last_became_active":"2024-04-25T09:06:50.773884+0000","last_became_peered":"2024-04-25T09:06:50.773884+0000","last_unstale":"2024-04-25T09:06:51.774140+0000","last_undegraded":"2024-04-25T09:06:51.774140+0000","last_fullsized":"2024-04-25T09:06:51.774140+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:12.627010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"68'4","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774463+0000","last_change":"2024-04-25T09:06:49.772396+0000","last_active":"2024-04-25T09:06:51.774463+0000","last_peered":"2024-04-25T09:06:51.774463+0000","last_clean":"2024-04-25T09:06:51.774463+0000","last_became_active":"2024-04-25T09:06:49.772012+0000","last_became_peered":"2024-04-25T09:06:49.772012+0000","last_unstale":"2024-04-25T09:06:51.774463+0000","last_undegraded":"2024-04-25T09:06:51.774463+0000","last_fullsized":"2024-04-25T09:06:51.774463+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:44.780984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759236+0000","last_change":"2024-04-25T09:06:50.757543+0000","last_active":"2024-04-25T09:06:51.759236+0000","last_peered":"2024-04-25T09:06:51.759236+0000","last_clean":"2024-04-25T09:06:51.759236+0000","last_became_active":"2024-04-25T09:06:50.757264+0000","last_became_peered":"2024-04-25T09:06:50.757264+0000","last_unstale":"2024-04-25T09:06:51.759236+0000","last_undegraded":"2024-04-25T09:06:51.759236+0000","last_fullsized":"2024-04-25T09:06:51.759236+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:56:08.156681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773394+0000","last_change":"2024-04-25T09:06:49.770666+0000","last_active":"2024-04-25T09:06:51.773394+0000","last_peered":"2024-04-25T09:06:51.773394+0000","last_clean":"2024-04-25T09:06:51.773394+0000","last_became_active":"2024-04-25T09:06:49.770416+0000","last_became_peered":"2024-04-25T09:06:49.770416+0000","last_unstale":"2024-04-25T09:06:51.773394+0000","last_undegraded":"2024-04-25T09:06:51.773394+0000","last_fullsized":"2024-04-25T09:06:51.773394+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:13.917626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773356+0000","last_change":"2024-04-25T09:06:50.768348+0000","last_active":"2024-04-25T09:06:51.773356+0000","last_peered":"2024-04-25T09:06:51.773356+0000","last_clean":"2024-04-25T09:06:51.773356+0000","last_became_active":"2024-04-25T09:06:50.768028+0000","last_became_peered":"2024-04-25T09:06:50.768028+0000","last_unstale":"2024-04-25T09:06:51.773356+0000","last_undegraded":"2024-04-25T09:06:51.773356+0000","last_fullsized":"2024-04-25T09:06:51.773356+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:08.452417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773614+0000","last_change":"2024-04-25T09:06:49.769759+0000","last_active":"2024-04-25T09:06:51.773614+0000","last_peered":"2024-04-25T09:06:51.773614+0000","last_clean":"2024-04-25T09:06:51.773614+0000","last_became_active":"2024-04-25T09:06:49.769481+0000","last_became_peered":"2024-04-25T09:06:49.769481+0000","last_unstale":"2024-04-25T09:06:51.773614+0000","last_undegraded":"2024-04-25T09:06:51.773614+0000","last_fullsized":"2024-04-25T09:06:51.773614+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:45.064269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773487+0000","last_change":"2024-04-25T09:06:50.785953+0000","last_active":"2024-04-25T09:06:51.773487+0000","last_peered":"2024-04-25T09:06:51.773487+0000","last_clean":"2024-04-25T09:06:51.773487+0000","last_became_active":"2024-04-25T09:06:50.785671+0000","last_became_peered":"2024-04-25T09:06:50.785671+0000","last_unstale":"2024-04-25T09:06:51.773487+0000","last_undegraded":"2024-04-25T09:06:51.773487+0000","last_fullsized":"2024-04-25T09:06:51.773487+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:38.897683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773468+0000","last_change":"2024-04-25T09:06:49.768037+0000","last_active":"2024-04-25T09:06:51.773468+0000","last_peered":"2024-04-25T09:06:51.773468+0000","last_clean":"2024-04-25T09:06:51.773468+0000","last_became_active":"2024-04-25T09:06:49.767790+0000","last_became_peered":"2024-04-25T09:06:49.767790+0000","last_unstale":"2024-04-25T09:06:51.773468+0000","last_undegraded":"2024-04-25T09:06:51.773468+0000","last_fullsized":"2024-04-25T09:06:51.773468+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:27.933814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.760064+0000","last_change":"2024-04-25T09:06:50.773617+0000","last_active":"2024-04-25T09:06:51.760064+0000","last_peered":"2024-04-25T09:06:51.760064+0000","last_clean":"2024-04-25T09:06:51.760064+0000","last_became_active":"2024-04-25T09:06:50.773239+0000","last_became_peered":"2024-04-25T09:06:50.773239+0000","last_unstale":"2024-04-25T09:06:51.760064+0000","last_undegraded":"2024-04-25T09:06:51.760064+0000","last_fullsized":"2024-04-25T09:06:51.760064+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:07.779114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759095+0000","last_change":"2024-04-25T09:06:49.773360+0000","last_active":"2024-04-25T09:06:51.759095+0000","last_peered":"2024-04-25T09:06:51.759095+0000","last_clean":"2024-04-25T09:06:51.759095+0000","last_became_active":"2024-04-25T09:06:49.773097+0000","last_became_peered":"2024-04-25T09:06:49.773097+0000","last_unstale":"2024-04-25T09:06:51.759095+0000","last_undegraded":"2024-04-25T09:06:51.759095+0000","last_fullsized":"2024-04-25T09:06:51.759095+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:45.994378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773380+0000","last_change":"2024-04-25T09:06:50.781673+0000","last_active":"2024-04-25T09:06:51.773380+0000","last_peered":"2024-04-25T09:06:51.773380+0000","last_clean":"2024-04-25T09:06:51.773380+0000","last_became_active":"2024-04-25T09:06:50.781300+0000","last_became_peered":"2024-04-25T09:06:50.781300+0000","last_unstale":"2024-04-25T09:06:51.773380+0000","last_undegraded":"2024-04-25T09:06:51.773380+0000","last_fullsized":"2024-04-25T09:06:51.773380+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:02.919869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758940+0000","last_change":"2024-04-25T09:06:49.765619+0000","last_active":"2024-04-25T09:06:51.758940+0000","last_peered":"2024-04-25T09:06:51.758940+0000","last_clean":"2024-04-25T09:06:51.758940+0000","last_became_active":"2024-04-25T09:06:49.765278+0000","last_became_peered":"2024-04-25T09:06:49.765278+0000","last_unstale":"2024-04-25T09:06:51.758940+0000","last_undegraded":"2024-04-25T09:06:51.758940+0000","last_fullsized":"2024-04-25T09:06:51.758940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:48.404828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772543+0000","last_change":"2024-04-25T09:06:50.769227+0000","last_active":"2024-04-25T09:06:51.772543+0000","last_peered":"2024-04-25T09:06:51.772543+0000","last_clean":"2024-04-25T09:06:51.772543+0000","last_became_active":"2024-04-25T09:06:50.766915+0000","last_became_peered":"2024-04-25T09:06:50.766915+0000","last_unstale":"2024-04-25T09:06:51.772543+0000","last_undegraded":"2024-04-25T09:06:51.772543+0000","last_fullsized":"2024-04-25T09:06:51.772543+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:53.256387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758781+0000","last_change":"2024-04-25T09:06:49.774484+0000","last_active":"2024-04-25T09:06:51.758781+0000","last_peered":"2024-04-25T09:06:51.758781+0000","last_clean":"2024-04-25T09:06:51.758781+0000","last_became_active":"2024-04-25T09:06:49.773991+0000","last_became_peered":"2024-04-25T09:06:49.773991+0000","last_unstale":"2024-04-25T09:06:51.758781+0000","last_undegraded":"2024-04-25T09:06:51.758781+0000","last_fullsized":"2024-04-25T09:06:51.758781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:21.028784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759122+0000","last_change":"2024-04-25T09:06:50.757620+0000","last_active":"2024-04-25T09:06:51.759122+0000","last_peered":"2024-04-25T09:06:51.759122+0000","last_clean":"2024-04-25T09:06:51.759122+0000","last_became_active":"2024-04-25T09:06:50.757350+0000","last_became_peered":"2024-04-25T09:06:50.757350+0000","last_unstale":"2024-04-25T09:06:51.759122+0000","last_undegraded":"2024-04-25T09:06:51.759122+0000","last_fullsized":"2024-04-25T09:06:51.759122+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:11.873700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772212+0000","last_change":"2024-04-25T09:06:49.776390+0000","last_active":"2024-04-25T09:06:51.772212+0000","last_peered":"2024-04-25T09:06:51.772212+0000","last_clean":"2024-04-25T09:06:51.772212+0000","last_became_active":"2024-04-25T09:06:49.776053+0000","last_became_peered":"2024-04-25T09:06:49.776053+0000","last_unstale":"2024-04-25T09:06:51.772212+0000","last_undegraded":"2024-04-25T09:06:51.772212+0000","last_fullsized":"2024-04-25T09:06:51.772212+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:01.810733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773929+0000","last_change":"2024-04-25T09:06:50.782313+0000","last_active":"2024-04-25T09:06:51.773929+0000","last_peered":"2024-04-25T09:06:51.773929+0000","last_clean":"2024-04-25T09:06:51.773929+0000","last_became_active":"2024-04-25T09:06:50.782030+0000","last_became_peered":"2024-04-25T09:06:50.782030+0000","last_unstale":"2024-04-25T09:06:51.773929+0000","last_undegraded":"2024-04-25T09:06:51.773929+0000","last_fullsized":"2024-04-25T09:06:51.773929+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:46.543061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773594+0000","last_change":"2024-04-25T09:06:49.776299+0000","last_active":"2024-04-25T09:06:51.773594+0000","last_peered":"2024-04-25T09:06:51.773594+0000","last_clean":"2024-04-25T09:06:51.773594+0000","last_became_active":"2024-04-25T09:06:49.776045+0000","last_became_peered":"2024-04-25T09:06:49.776045+0000","last_unstale":"2024-04-25T09:06:51.773594+0000","last_undegraded":"2024-04-25T09:06:51.773594+0000","last_fullsized":"2024-04-25T09:06:51.773594+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:31.928871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759365+0000","last_change":"2024-04-25T09:06:50.770119+0000","last_active":"2024-04-25T09:06:51.759365+0000","last_peered":"2024-04-25T09:06:51.759365+0000","last_clean":"2024-04-25T09:06:51.759365+0000","last_became_active":"2024-04-25T09:06:50.769809+0000","last_became_peered":"2024-04-25T09:06:50.769809+0000","last_unstale":"2024-04-25T09:06:51.759365+0000","last_undegraded":"2024-04-25T09:06:51.759365+0000","last_fullsized":"2024-04-25T09:06:51.759365+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:42.775238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759214+0000","last_change":"2024-04-25T09:06:49.761678+0000","last_active":"2024-04-25T09:06:51.759214+0000","last_peered":"2024-04-25T09:06:51.759214+0000","last_clean":"2024-04-25T09:06:51.759214+0000","last_became_active":"2024-04-25T09:06:49.761408+0000","last_became_peered":"2024-04-25T09:06:49.761408+0000","last_unstale":"2024-04-25T09:06:51.759214+0000","last_undegraded":"2024-04-25T09:06:51.759214+0000","last_fullsized":"2024-04-25T09:06:51.759214+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:47.680263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774561+0000","last_change":"2024-04-25T09:06:50.769061+0000","last_active":"2024-04-25T09:06:51.774561+0000","last_peered":"2024-04-25T09:06:51.774561+0000","last_clean":"2024-04-25T09:06:51.774561+0000","last_became_active":"2024-04-25T09:06:50.768782+0000","last_became_peered":"2024-04-25T09:06:50.768782+0000","last_unstale":"2024-04-25T09:06:51.774561+0000","last_undegraded":"2024-04-25T09:06:51.774561+0000","last_fullsized":"2024-04-25T09:06:51.774561+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:49.902976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"68'3","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773597+0000","last_change":"2024-04-25T09:06:49.773025+0000","last_active":"2024-04-25T09:06:51.773597+0000","last_peered":"2024-04-25T09:06:51.773597+0000","last_clean":"2024-04-25T09:06:51.773597+0000","last_became_active":"2024-04-25T09:06:49.772699+0000","last_became_peered":"2024-04-25T09:06:49.772699+0000","last_unstale":"2024-04-25T09:06:51.773597+0000","last_undegraded":"2024-04-25T09:06:51.773597+0000","last_fullsized":"2024-04-25T09:06:51.773597+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:45.064269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759319+0000","last_change":"2024-04-25T09:06:50.770342+0000","last_active":"2024-04-25T09:06:51.759319+0000","last_peered":"2024-04-25T09:06:51.759319+0000","last_clean":"2024-04-25T09:06:51.759319+0000","last_became_active":"2024-04-25T09:06:50.770077+0000","last_became_peered":"2024-04-25T09:06:50.770077+0000","last_unstale":"2024-04-25T09:06:51.759319+0000","last_undegraded":"2024-04-25T09:06:51.759319+0000","last_fullsized":"2024-04-25T09:06:51.759319+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:54.634087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"68'6","reported_seq":20,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774000+0000","last_change":"2024-04-25T09:06:49.766081+0000","last_active":"2024-04-25T09:06:51.774000+0000","last_peered":"2024-04-25T09:06:51.774000+0000","last_clean":"2024-04-25T09:06:51.774000+0000","last_became_active":"2024-04-25T09:06:49.765478+0000","last_became_peered":"2024-04-25T09:06:49.765478+0000","last_unstale":"2024-04-25T09:06:51.774000+0000","last_undegraded":"2024-04-25T09:06:51.774000+0000","last_fullsized":"2024-04-25T09:06:51.774000+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:20.752903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758819+0000","last_change":"2024-04-25T09:06:50.765079+0000","last_active":"2024-04-25T09:06:51.758819+0000","last_peered":"2024-04-25T09:06:51.758819+0000","last_clean":"2024-04-25T09:06:51.758819+0000","last_became_active":"2024-04-25T09:06:50.764825+0000","last_became_peered":"2024-04-25T09:06:50.764825+0000","last_unstale":"2024-04-25T09:06:51.758819+0000","last_undegraded":"2024-04-25T09:06:51.758819+0000","last_fullsized":"2024-04-25T09:06:51.758819+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:00.759417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773354+0000","last_change":"2024-04-25T09:06:49.778303+0000","last_active":"2024-04-25T09:06:51.773354+0000","last_peered":"2024-04-25T09:06:51.773354+0000","last_clean":"2024-04-25T09:06:51.773354+0000","last_became_active":"2024-04-25T09:06:49.777962+0000","last_became_peered":"2024-04-25T09:06:49.777962+0000","last_unstale":"2024-04-25T09:06:51.773354+0000","last_undegraded":"2024-04-25T09:06:51.773354+0000","last_fullsized":"2024-04-25T09:06:51.773354+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:27.933814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772610+0000","last_change":"2024-04-25T09:06:50.769425+0000","last_active":"2024-04-25T09:06:51.772610+0000","last_peered":"2024-04-25T09:06:51.772610+0000","last_clean":"2024-04-25T09:06:51.772610+0000","last_became_active":"2024-04-25T09:06:50.769177+0000","last_became_peered":"2024-04-25T09:06:50.769177+0000","last_unstale":"2024-04-25T09:06:51.772610+0000","last_undegraded":"2024-04-25T09:06:51.772610+0000","last_fullsized":"2024-04-25T09:06:51.772610+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:31.418868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772706+0000","last_change":"2024-04-25T09:06:49.768363+0000","last_active":"2024-04-25T09:06:51.772706+0000","last_peered":"2024-04-25T09:06:51.772706+0000","last_clean":"2024-04-25T09:06:51.772706+0000","last_became_active":"2024-04-25T09:06:49.767887+0000","last_became_peered":"2024-04-25T09:06:49.767887+0000","last_unstale":"2024-04-25T09:06:51.772706+0000","last_undegraded":"2024-04-25T09:06:51.772706+0000","last_fullsized":"2024-04-25T09:06:51.772706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:53.631349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772568+0000","last_change":"2024-04-25T09:06:50.768559+0000","last_active":"2024-04-25T09:06:51.772568+0000","last_peered":"2024-04-25T09:06:51.772568+0000","last_clean":"2024-04-25T09:06:51.772568+0000","last_became_active":"2024-04-25T09:06:50.766844+0000","last_became_peered":"2024-04-25T09:06:50.766844+0000","last_unstale":"2024-04-25T09:06:51.772568+0000","last_undegraded":"2024-04-25T09:06:51.772568+0000","last_fullsized":"2024-04-25T09:06:51.772568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:21.185317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772911+0000","last_change":"2024-04-25T09:06:49.775924+0000","last_active":"2024-04-25T09:06:51.772911+0000","last_peered":"2024-04-25T09:06:51.772911+0000","last_clean":"2024-04-25T09:06:51.772911+0000","last_became_active":"2024-04-25T09:06:49.775464+0000","last_became_peered":"2024-04-25T09:06:49.775464+0000","last_unstale":"2024-04-25T09:06:51.772911+0000","last_undegraded":"2024-04-25T09:06:51.772911+0000","last_fullsized":"2024-04-25T09:06:51.772911+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:23.417984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773801+0000","last_change":"2024-04-25T09:06:50.768904+0000","last_active":"2024-04-25T09:06:51.773801+0000","last_peered":"2024-04-25T09:06:51.773801+0000","last_clean":"2024-04-25T09:06:51.773801+0000","last_became_active":"2024-04-25T09:06:50.768435+0000","last_became_peered":"2024-04-25T09:06:50.768435+0000","last_unstale":"2024-04-25T09:06:51.773801+0000","last_undegraded":"2024-04-25T09:06:51.773801+0000","last_fullsized":"2024-04-25T09:06:51.773801+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:47.263323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"68'8","reported_seq":22,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758566+0000","last_change":"2024-04-25T09:06:49.771727+0000","last_active":"2024-04-25T09:06:51.758566+0000","last_peered":"2024-04-25T09:06:51.758566+0000","last_clean":"2024-04-25T09:06:51.758566+0000","last_became_active":"2024-04-25T09:06:49.771370+0000","last_became_peered":"2024-04-25T09:06:49.771370+0000","last_unstale":"2024-04-25T09:06:51.758566+0000","last_undegraded":"2024-04-25T09:06:51.758566+0000","last_fullsized":"2024-04-25T09:06:51.758566+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:25.605448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774255+0000","last_change":"2024-04-25T09:06:50.779022+0000","last_active":"2024-04-25T09:06:51.774255+0000","last_peered":"2024-04-25T09:06:51.774255+0000","last_clean":"2024-04-25T09:06:51.774255+0000","last_became_active":"2024-04-25T09:06:50.778721+0000","last_became_peered":"2024-04-25T09:06:50.778721+0000","last_unstale":"2024-04-25T09:06:51.774255+0000","last_undegraded":"2024-04-25T09:06:51.774255+0000","last_fullsized":"2024-04-25T09:06:51.774255+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:55.914047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773866+0000","last_change":"2024-04-25T09:06:49.770482+0000","last_active":"2024-04-25T09:06:51.773866+0000","last_peered":"2024-04-25T09:06:51.773866+0000","last_clean":"2024-04-25T09:06:51.773866+0000","last_became_active":"2024-04-25T09:06:49.770097+0000","last_became_peered":"2024-04-25T09:06:49.770097+0000","last_unstale":"2024-04-25T09:06:51.773866+0000","last_undegraded":"2024-04-25T09:06:51.773866+0000","last_fullsized":"2024-04-25T09:06:51.773866+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:47.244523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774137+0000","last_change":"2024-04-25T09:06:50.764498+0000","last_active":"2024-04-25T09:06:51.774137+0000","last_peered":"2024-04-25T09:06:51.774137+0000","last_clean":"2024-04-25T09:06:51.774137+0000","last_became_active":"2024-04-25T09:06:50.764163+0000","last_became_peered":"2024-04-25T09:06:50.764163+0000","last_unstale":"2024-04-25T09:06:51.774137+0000","last_undegraded":"2024-04-25T09:06:51.774137+0000","last_fullsized":"2024-04-25T09:06:51.774137+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:07.976442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773527+0000","last_change":"2024-04-25T09:06:49.770792+0000","last_active":"2024-04-25T09:06:51.773527+0000","last_peered":"2024-04-25T09:06:51.773527+0000","last_clean":"2024-04-25T09:06:51.773527+0000","last_became_active":"2024-04-25T09:06:49.770528+0000","last_became_peered":"2024-04-25T09:06:49.770528+0000","last_unstale":"2024-04-25T09:06:51.773527+0000","last_undegraded":"2024-04-25T09:06:51.773527+0000","last_fullsized":"2024-04-25T09:06:51.773527+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:53.519331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759159+0000","last_change":"2024-04-25T09:06:50.760990+0000","last_active":"2024-04-25T09:06:51.759159+0000","last_peered":"2024-04-25T09:06:51.759159+0000","last_clean":"2024-04-25T09:06:51.759159+0000","last_became_active":"2024-04-25T09:06:50.760460+0000","last_became_peered":"2024-04-25T09:06:50.760460+0000","last_unstale":"2024-04-25T09:06:51.759159+0000","last_undegraded":"2024-04-25T09:06:51.759159+0000","last_fullsized":"2024-04-25T09:06:51.759159+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:21.185317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773633+0000","last_change":"2024-04-25T09:06:49.776752+0000","last_active":"2024-04-25T09:06:51.773633+0000","last_peered":"2024-04-25T09:06:51.773633+0000","last_clean":"2024-04-25T09:06:51.773633+0000","last_became_active":"2024-04-25T09:06:49.776484+0000","last_became_peered":"2024-04-25T09:06:49.776484+0000","last_unstale":"2024-04-25T09:06:51.773633+0000","last_undegraded":"2024-04-25T09:06:51.773633+0000","last_fullsized":"2024-04-25T09:06:51.773633+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:39.550531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774065+0000","last_change":"2024-04-25T09:06:50.762270+0000","last_active":"2024-04-25T09:06:51.774065+0000","last_peered":"2024-04-25T09:06:51.774065+0000","last_clean":"2024-04-25T09:06:51.774065+0000","last_became_active":"2024-04-25T09:06:50.761808+0000","last_became_peered":"2024-04-25T09:06:50.761808+0000","last_unstale":"2024-04-25T09:06:51.774065+0000","last_undegraded":"2024-04-25T09:06:51.774065+0000","last_fullsized":"2024-04-25T09:06:51.774065+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:48.247261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759254+0000","last_change":"2024-04-25T09:06:49.769270+0000","last_active":"2024-04-25T09:06:51.759254+0000","last_peered":"2024-04-25T09:06:51.759254+0000","last_clean":"2024-04-25T09:06:51.759254+0000","last_became_active":"2024-04-25T09:06:49.768293+0000","last_became_peered":"2024-04-25T09:06:49.768293+0000","last_unstale":"2024-04-25T09:06:51.759254+0000","last_undegraded":"2024-04-25T09:06:51.759254+0000","last_fullsized":"2024-04-25T09:06:51.759254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:37.894945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773299+0000","last_change":"2024-04-25T09:06:50.776731+0000","last_active":"2024-04-25T09:06:51.773299+0000","last_peered":"2024-04-25T09:06:51.773299+0000","last_clean":"2024-04-25T09:06:51.773299+0000","last_became_active":"2024-04-25T09:06:50.776461+0000","last_became_peered":"2024-04-25T09:06:50.776461+0000","last_unstale":"2024-04-25T09:06:51.773299+0000","last_undegraded":"2024-04-25T09:06:51.773299+0000","last_fullsized":"2024-04-25T09:06:51.773299+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:17.281098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773151+0000","last_change":"2024-04-25T09:06:49.773985+0000","last_active":"2024-04-25T09:06:51.773151+0000","last_peered":"2024-04-25T09:06:51.773151+0000","last_clean":"2024-04-25T09:06:51.773151+0000","last_became_active":"2024-04-25T09:06:49.773715+0000","last_became_peered":"2024-04-25T09:06:49.773715+0000","last_unstale":"2024-04-25T09:06:51.773151+0000","last_undegraded":"2024-04-25T09:06:51.773151+0000","last_fullsized":"2024-04-25T09:06:51.773151+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:23.417984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772931+0000","last_change":"2024-04-25T09:06:50.773743+0000","last_active":"2024-04-25T09:06:51.772931+0000","last_peered":"2024-04-25T09:06:51.772931+0000","last_clean":"2024-04-25T09:06:51.772931+0000","last_became_active":"2024-04-25T09:06:50.773492+0000","last_became_peered":"2024-04-25T09:06:50.773492+0000","last_unstale":"2024-04-25T09:06:51.772931+0000","last_undegraded":"2024-04-25T09:06:51.772931+0000","last_fullsized":"2024-04-25T09:06:51.772931+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:29.172564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773031+0000","last_change":"2024-04-25T09:06:49.768143+0000","last_active":"2024-04-25T09:06:51.773031+0000","last_peered":"2024-04-25T09:06:51.773031+0000","last_clean":"2024-04-25T09:06:51.773031+0000","last_became_active":"2024-04-25T09:06:49.767483+0000","last_became_peered":"2024-04-25T09:06:49.767483+0000","last_unstale":"2024-04-25T09:06:51.773031+0000","last_undegraded":"2024-04-25T09:06:51.773031+0000","last_fullsized":"2024-04-25T09:06:51.773031+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:22.172861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772885+0000","last_change":"2024-04-25T09:06:50.762853+0000","last_active":"2024-04-25T09:06:51.772885+0000","last_peered":"2024-04-25T09:06:51.772885+0000","last_clean":"2024-04-25T09:06:51.772885+0000","last_became_active":"2024-04-25T09:06:50.762586+0000","last_became_peered":"2024-04-25T09:06:50.762586+0000","last_unstale":"2024-04-25T09:06:51.772885+0000","last_undegraded":"2024-04-25T09:06:51.772885+0000","last_fullsized":"2024-04-25T09:06:51.772885+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:54.634087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772991+0000","last_change":"2024-04-25T09:06:49.769821+0000","last_active":"2024-04-25T09:06:51.772991+0000","last_peered":"2024-04-25T09:06:51.772991+0000","last_clean":"2024-04-25T09:06:51.772991+0000","last_became_active":"2024-04-25T09:06:49.769494+0000","last_became_peered":"2024-04-25T09:06:49.769494+0000","last_unstale":"2024-04-25T09:06:51.772991+0000","last_undegraded":"2024-04-25T09:06:51.772991+0000","last_fullsized":"2024-04-25T09:06:51.772991+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:53.519331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773386+0000","last_change":"2024-04-25T09:06:50.763526+0000","last_active":"2024-04-25T09:06:51.773386+0000","last_peered":"2024-04-25T09:06:51.773386+0000","last_clean":"2024-04-25T09:06:51.773386+0000","last_became_active":"2024-04-25T09:06:50.763261+0000","last_became_peered":"2024-04-25T09:06:50.763261+0000","last_unstale":"2024-04-25T09:06:51.773386+0000","last_undegraded":"2024-04-25T09:06:51.773386+0000","last_fullsized":"2024-04-25T09:06:51.773386+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:52.422520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774013+0000","last_change":"2024-04-25T09:06:49.774665+0000","last_active":"2024-04-25T09:06:51.774013+0000","last_peered":"2024-04-25T09:06:51.774013+0000","last_clean":"2024-04-25T09:06:51.774013+0000","last_became_active":"2024-04-25T09:06:49.774262+0000","last_became_peered":"2024-04-25T09:06:49.774262+0000","last_unstale":"2024-04-25T09:06:51.774013+0000","last_undegraded":"2024-04-25T09:06:51.774013+0000","last_fullsized":"2024-04-25T09:06:51.774013+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:06.973704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.760119+0000","last_change":"2024-04-25T09:06:50.767853+0000","last_active":"2024-04-25T09:06:51.760119+0000","last_peered":"2024-04-25T09:06:51.760119+0000","last_clean":"2024-04-25T09:06:51.760119+0000","last_became_active":"2024-04-25T09:06:50.767557+0000","last_became_peered":"2024-04-25T09:06:50.767557+0000","last_unstale":"2024-04-25T09:06:51.760119+0000","last_undegraded":"2024-04-25T09:06:51.760119+0000","last_fullsized":"2024-04-25T09:06:51.760119+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:05.208292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"69'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773801+0000","last_change":"2024-04-25T09:06:49.767570+0000","last_active":"2024-04-25T09:06:51.773801+0000","last_peered":"2024-04-25T09:06:51.773801+0000","last_clean":"2024-04-25T09:06:51.773801+0000","last_became_active":"2024-04-25T09:06:49.767272+0000","last_became_peered":"2024-04-25T09:06:49.767272+0000","last_unstale":"2024-04-25T09:06:51.773801+0000","last_undegraded":"2024-04-25T09:06:51.773801+0000","last_fullsized":"2024-04-25T09:06:51.773801+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:57.658474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773706+0000","last_change":"2024-04-25T09:06:50.772573+0000","last_active":"2024-04-25T09:06:51.773706+0000","last_peered":"2024-04-25T09:06:51.773706+0000","last_clean":"2024-04-25T09:06:51.773706+0000","last_became_active":"2024-04-25T09:06:50.771236+0000","last_became_peered":"2024-04-25T09:06:50.771236+0000","last_unstale":"2024-04-25T09:06:51.773706+0000","last_undegraded":"2024-04-25T09:06:51.773706+0000","last_fullsized":"2024-04-25T09:06:51.773706+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:31.377839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773677+0000","last_change":"2024-04-25T09:06:49.777073+0000","last_active":"2024-04-25T09:06:51.773677+0000","last_peered":"2024-04-25T09:06:51.773677+0000","last_clean":"2024-04-25T09:06:51.773677+0000","last_became_active":"2024-04-25T09:06:49.776788+0000","last_became_peered":"2024-04-25T09:06:49.776788+0000","last_unstale":"2024-04-25T09:06:51.773677+0000","last_undegraded":"2024-04-25T09:06:51.773677+0000","last_fullsized":"2024-04-25T09:06:51.773677+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:39.550531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774194+0000","last_change":"2024-04-25T09:06:50.762043+0000","last_active":"2024-04-25T09:06:51.774194+0000","last_peered":"2024-04-25T09:06:51.774194+0000","last_clean":"2024-04-25T09:06:51.774194+0000","last_became_active":"2024-04-25T09:06:50.761466+0000","last_became_peered":"2024-04-25T09:06:50.761466+0000","last_unstale":"2024-04-25T09:06:51.774194+0000","last_undegraded":"2024-04-25T09:06:51.774194+0000","last_fullsized":"2024-04-25T09:06:51.774194+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:21.375288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774063+0000","last_change":"2024-04-25T09:06:49.766342+0000","last_active":"2024-04-25T09:06:51.774063+0000","last_peered":"2024-04-25T09:06:51.774063+0000","last_clean":"2024-04-25T09:06:51.774063+0000","last_became_active":"2024-04-25T09:06:49.765839+0000","last_became_peered":"2024-04-25T09:06:49.765839+0000","last_unstale":"2024-04-25T09:06:51.774063+0000","last_undegraded":"2024-04-25T09:06:51.774063+0000","last_fullsized":"2024-04-25T09:06:51.774063+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:25.987084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772323+0000","last_change":"2024-04-25T09:06:50.771430+0000","last_active":"2024-04-25T09:06:51.772323+0000","last_peered":"2024-04-25T09:06:51.772323+0000","last_clean":"2024-04-25T09:06:51.772323+0000","last_became_active":"2024-04-25T09:06:50.771084+0000","last_became_peered":"2024-04-25T09:06:50.771084+0000","last_unstale":"2024-04-25T09:06:51.772323+0000","last_undegraded":"2024-04-25T09:06:51.772323+0000","last_fullsized":"2024-04-25T09:06:51.772323+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:59.358584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773354+0000","last_change":"2024-04-25T09:06:49.774900+0000","last_active":"2024-04-25T09:06:51.773354+0000","last_peered":"2024-04-25T09:06:51.773354+0000","last_clean":"2024-04-25T09:06:51.773354+0000","last_became_active":"2024-04-25T09:06:49.774561+0000","last_became_peered":"2024-04-25T09:06:49.774561+0000","last_unstale":"2024-04-25T09:06:51.773354+0000","last_undegraded":"2024-04-25T09:06:51.773354+0000","last_fullsized":"2024-04-25T09:06:51.773354+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:13.917626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758914+0000","last_change":"2024-04-25T09:06:50.768915+0000","last_active":"2024-04-25T09:06:51.758914+0000","last_peered":"2024-04-25T09:06:51.758914+0000","last_clean":"2024-04-25T09:06:51.758914+0000","last_became_active":"2024-04-25T09:06:50.768661+0000","last_became_peered":"2024-04-25T09:06:50.768661+0000","last_unstale":"2024-04-25T09:06:51.758914+0000","last_undegraded":"2024-04-25T09:06:51.758914+0000","last_fullsized":"2024-04-25T09:06:51.758914+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:33.068325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758990+0000","last_change":"2024-04-25T09:06:49.770770+0000","last_active":"2024-04-25T09:06:51.758990+0000","last_peered":"2024-04-25T09:06:51.758990+0000","last_clean":"2024-04-25T09:06:51.758990+0000","last_became_active":"2024-04-25T09:06:49.769210+0000","last_became_peered":"2024-04-25T09:06:49.769210+0000","last_unstale":"2024-04-25T09:06:51.758990+0000","last_undegraded":"2024-04-25T09:06:51.758990+0000","last_fullsized":"2024-04-25T09:06:51.758990+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:02.494155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773643+0000","last_change":"2024-04-25T09:06:50.768937+0000","last_active":"2024-04-25T09:06:51.773643+0000","last_peered":"2024-04-25T09:06:51.773643+0000","last_clean":"2024-04-25T09:06:51.773643+0000","last_became_active":"2024-04-25T09:06:50.768633+0000","last_became_peered":"2024-04-25T09:06:50.768633+0000","last_unstale":"2024-04-25T09:06:51.773643+0000","last_undegraded":"2024-04-25T09:06:51.773643+0000","last_fullsized":"2024-04-25T09:06:51.773643+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:15.545199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758847+0000","last_change":"2024-04-25T09:06:49.774257+0000","last_active":"2024-04-25T09:06:51.758847+0000","last_peered":"2024-04-25T09:06:51.758847+0000","last_clean":"2024-04-25T09:06:51.758847+0000","last_became_active":"2024-04-25T09:06:49.773652+0000","last_became_peered":"2024-04-25T09:06:49.773652+0000","last_unstale":"2024-04-25T09:06:51.758847+0000","last_undegraded":"2024-04-25T09:06:51.758847+0000","last_fullsized":"2024-04-25T09:06:51.758847+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:24.720367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.760166+0000","last_change":"2024-04-25T09:06:50.769891+0000","last_active":"2024-04-25T09:06:51.760166+0000","last_peered":"2024-04-25T09:06:51.760166+0000","last_clean":"2024-04-25T09:06:51.760166+0000","last_became_active":"2024-04-25T09:06:50.767216+0000","last_became_peered":"2024-04-25T09:06:50.767216+0000","last_unstale":"2024-04-25T09:06:51.760166+0000","last_undegraded":"2024-04-25T09:06:51.760166+0000","last_fullsized":"2024-04-25T09:06:51.760166+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:32.031412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773163+0000","last_change":"2024-04-25T09:06:49.772802+0000","last_active":"2024-04-25T09:06:51.773163+0000","last_peered":"2024-04-25T09:06:51.773163+0000","last_clean":"2024-04-25T09:06:51.773163+0000","last_became_active":"2024-04-25T09:06:49.772500+0000","last_became_peered":"2024-04-25T09:06:49.772500+0000","last_unstale":"2024-04-25T09:06:51.773163+0000","last_undegraded":"2024-04-25T09:06:51.773163+0000","last_fullsized":"2024-04-25T09:06:51.773163+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:21.180550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773338+0000","last_change":"2024-04-25T09:06:50.773349+0000","last_active":"2024-04-25T09:06:51.773338+0000","last_peered":"2024-04-25T09:06:51.773338+0000","last_clean":"2024-04-25T09:06:51.773338+0000","last_became_active":"2024-04-25T09:06:50.771243+0000","last_became_peered":"2024-04-25T09:06:50.771243+0000","last_unstale":"2024-04-25T09:06:51.773338+0000","last_undegraded":"2024-04-25T09:06:51.773338+0000","last_fullsized":"2024-04-25T09:06:51.773338+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:23.175599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758677+0000","last_change":"2024-04-25T09:06:49.769307+0000","last_active":"2024-04-25T09:06:51.758677+0000","last_peered":"2024-04-25T09:06:51.758677+0000","last_clean":"2024-04-25T09:06:51.758677+0000","last_became_active":"2024-04-25T09:06:49.769036+0000","last_became_peered":"2024-04-25T09:06:49.769036+0000","last_unstale":"2024-04-25T09:06:51.758677+0000","last_undegraded":"2024-04-25T09:06:51.758677+0000","last_fullsized":"2024-04-25T09:06:51.758677+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:51.419782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":258,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773133+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:06:51.773133+0000","last_peered":"2024-04-25T09:06:51.773133+0000","last_clean":"2024-04-25T09:06:51.773133+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:06:51.773133+0000","last_undegraded":"2024-04-25T09:06:51.773133+0000","last_fullsized":"2024-04-25T09:06:51.773133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40320,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331520,"statfs":{"total":96636764160,"available":96595476480,"internally_reserved":0,"allocated":831488,"data_stored":375828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509494,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335684,"statfs":{"total":96636764160,"available":96599740416,"internally_reserved":0,"allocated":831488,"data_stored":375816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40328,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331512,"statfs":{"total":96636764160,"available":96595468288,"internally_reserved":0,"allocated":839680,"data_stored":377406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335688,"statfs":{"total":96636764160,"available":96599744512,"internally_reserved":0,"allocated":827392,"data_stored":375794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335688,"statfs":{"total":96636764160,"available":96599744512,"internally_reserved":0,"allocated":827392,"data_stored":375794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36184,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335656,"statfs":{"total":96636764160,"available":96599711744,"internally_reserved":0,"allocated":856064,"data_stored":378170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58940,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312900,"statfs":{"total":96636764160,"available":96576409600,"internally_reserved":0,"allocated":1421312,"data_stored":966162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36740,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335100,"statfs":{"total":96636764160,"available":96599142400,"internally_reserved":0,"allocated":1425408,"data_stored":960246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:06:54.822 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:06:54.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.006+0000 7f0dd3200640 1 Processor -- start 2024-04-25T09:06:54.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.006+0000 7f0dd3200640 1 -- start start 2024-04-25T09:06:54.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.006+0000 7f0dd3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dcc06e2e0 0x7f0dcc06e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.006+0000 7f0dd3200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0dcc163710 0x7f0dcc163b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.006+0000 7f0dd3200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dcc071de0 con 0x7f0dcc0aeef0 2024-04-25T09:06:54.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.006+0000 7f0dd3200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dcc0720c0 con 0x7f0dcc163710 2024-04-25T09:06:54.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.006+0000 7f0dd3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc06dae0 con 0x7f0dcc06e2e0 2024-04-25T09:06:54.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.010+0000 7f0dc3400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dcc06e2e0 0x7f0dcc06e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.010+0000 7f0dd1200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0dcc163710 0x7f0dcc163b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.010+0000 7f0dc3400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dcc06e2e0 0x7f0dcc06e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:60408/0 (socket says 172.21.15.173:60408) 2024-04-25T09:06:54.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.010+0000 7f0dc3400640 1 -- 172.21.15.173:0/2278359846 learned_addr learned my addr 172.21.15.173:0/2278359846 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:54.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.010+0000 7f0dd1200640 1 -- 172.21.15.173:0/2278359846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dcc06e2e0 msgr2=0x7f0dcc06e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:54.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.010+0000 7f0dd1200640 1 --2- 172.21.15.173:0/2278359846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dcc06e2e0 0x7f0dcc06e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.010+0000 7f0dd1200640 1 -- 172.21.15.173:0/2278359846 >> v1:172.21.15.194:6789/0 conn(0x7f0dcc0aeef0 legacy=0x7f0dcc071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.010+0000 7f0dd1200640 1 -- 172.21.15.173:0/2278359846 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc06ddc0 con 0x7f0dcc163710 2024-04-25T09:06:55.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.010+0000 7f0dd1200640 1 --2- 172.21.15.173:0/2278359846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dcc163710 0x7f0dcc163b80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009d90 tx=0x7f0dc401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=652f76fe899e511a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:55.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.010+0000 7f0dcb400640 1 -- 172.21.15.173:0/2278359846 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc40b2070 con 0x7f0dcc163710 2024-04-25T09:06:55.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.010+0000 7f0dcb400640 1 -- 172.21.15.173:0/2278359846 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc40a5830 con 0x7f0dcc163710 2024-04-25T09:06:55.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dcb400640 1 -- 172.21.15.173:0/2278359846 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc40a5c00 con 0x7f0dcc163710 2024-04-25T09:06:55.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dd3200640 1 -- 172.21.15.173:0/2278359846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dcc163710 msgr2=0x7f0dcc163b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dd3200640 1 --2- 172.21.15.173:0/2278359846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dcc163710 0x7f0dcc163b80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009d90 tx=0x7f0dc401c970 comp rx=0 tx=0).stop 2024-04-25T09:06:55.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dd3200640 1 -- 172.21.15.173:0/2278359846 shutdown_connections 2024-04-25T09:06:55.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dd3200640 1 --2- 172.21.15.173:0/2278359846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dcc163710 0x7f0dcc163b80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dd3200640 1 --2- 172.21.15.173:0/2278359846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dcc06e2e0 0x7f0dcc06e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dd3200640 1 -- 172.21.15.173:0/2278359846 >> 172.21.15.173:0/2278359846 conn(0x7f0dcc06ac90 msgr2=0x7f0dcc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:55.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dd3200640 1 -- 172.21.15.173:0/2278359846 shutdown_connections 2024-04-25T09:06:55.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dd3200640 1 -- 172.21.15.173:0/2278359846 wait complete. 2024-04-25T09:06:55.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dd3200640 1 Processor -- start 2024-04-25T09:06:55.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dd3200640 1 -- start start 2024-04-25T09:06:55.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dd3200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dcc06e2e0 0x7f0dcc15fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:55.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dd3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dcc0aeef0 0x7f0dcc1467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:55.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dd3200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dcc163710 0x7f0dcc160920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:55.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dd3200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc16f130 con 0x7f0dcc06e2e0 2024-04-25T09:06:55.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dd3200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc16efb0 con 0x7f0dcc163710 2024-04-25T09:06:55.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dd3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc16f2b0 con 0x7f0dcc0aeef0 2024-04-25T09:06:55.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dcbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dcc06e2e0 0x7f0dcc15fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:55.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dcbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dcc06e2e0 0x7f0dcc15fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53122/0 (socket says 172.21.15.173:53122) 2024-04-25T09:06:55.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dcbe00640 1 -- 172.21.15.173:0/384349015 learned_addr learned my addr 172.21.15.173:0/384349015 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:55.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dd1200640 1 --2- 172.21.15.173:0/384349015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dcc163710 0x7f0dcc160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:55.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.014+0000 7f0dc3400640 1 --2- 172.21.15.173:0/384349015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dcc0aeef0 0x7f0dcc1467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.018+0000 7f0dcbe00640 1 -- 172.21.15.173:0/384349015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dcc0aeef0 msgr2=0x7f0dcc1467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.018+0000 7f0dcbe00640 1 --2- 172.21.15.173:0/384349015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dcc0aeef0 0x7f0dcc1467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.018+0000 7f0dcbe00640 1 -- 172.21.15.173:0/384349015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dcc163710 msgr2=0x7f0dcc160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.018+0000 7f0dcbe00640 1 --2- 172.21.15.173:0/384349015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dcc163710 0x7f0dcc160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.018+0000 7f0dcbe00640 1 -- 172.21.15.173:0/384349015 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc15ee80 con 0x7f0dcc06e2e0 2024-04-25T09:06:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.018+0000 7f0dc3400640 1 --2- 172.21.15.173:0/384349015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dcc0aeef0 0x7f0dcc1467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.018+0000 7f0dcbe00640 1 --2- 172.21.15.173:0/384349015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dcc06e2e0 0x7f0dcc15fc40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00c420 tx=0x7f0dbc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.018+0000 7f0dc8c00640 1 -- 172.21.15.173:0/384349015 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0052d0 con 0x7f0dcc06e2e0 2024-04-25T09:06:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.018+0000 7f0dc8c00640 1 -- 172.21.15.173:0/384349015 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc005470 con 0x7f0dcc06e2e0 2024-04-25T09:06:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.018+0000 7f0dc8c00640 1 -- 172.21.15.173:0/384349015 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc007260 con 0x7f0dcc06e2e0 2024-04-25T09:06:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.018+0000 7f0dd3200640 1 -- 172.21.15.173:0/384349015 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dcc15f160 con 0x7f0dcc06e2e0 2024-04-25T09:06:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.018+0000 7f0dd3200640 1 -- 172.21.15.173:0/384349015 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc15f720 con 0x7f0dcc06e2e0 2024-04-25T09:06:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.018+0000 7f0dd3200640 1 -- 172.21.15.173:0/384349015 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dcc073a40 con 0x7f0dcc06e2e0 2024-04-25T09:06:55.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.018+0000 7f0dc8c00640 1 -- 172.21.15.173:0/384349015 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0dbc007400 con 0x7f0dcc06e2e0 2024-04-25T09:06:55.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.018+0000 7f0dc8c00640 1 --2- 172.21.15.173:0/384349015 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0da8066f60 0x7f0da8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:55.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.018+0000 7f0dc8c00640 1 -- 172.21.15.173:0/384349015 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0dbc084650 con 0x7f0dcc06e2e0 2024-04-25T09:06:55.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.018+0000 7f0dc3400640 1 --2- 172.21.15.173:0/384349015 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0da8066f60 0x7f0da8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:55.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.022+0000 7f0dc3400640 1 --2- 172.21.15.173:0/384349015 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0da8066f60 0x7f0da8069420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc15b1b0 tx=0x7f0db4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:55.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.022+0000 7f0dc8c00640 1 -- 172.21.15.173:0/384349015 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0dbc054e70 con 0x7f0dcc06e2e0 2024-04-25T09:06:55.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.174+0000 7f0dd3200640 1 -- 172.21.15.173:0/384349015 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0dcc06c300 con 0x7f0da8066f60 2024-04-25T09:06:55.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.182+0000 7f0dc8c00640 1 -- 172.21.15.173:0/384349015 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252018 (secure 0 0 0) 0x7f0dcc06c300 con 0x7f0da8066f60 2024-04-25T09:06:55.172 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:55.174 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:06:55.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.186+0000 7f0dd3200640 1 -- 172.21.15.173:0/384349015 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0da8066f60 msgr2=0x7f0da8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.186+0000 7f0dd3200640 1 --2- 172.21.15.173:0/384349015 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0da8066f60 0x7f0da8069420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc15b1b0 tx=0x7f0db4008040 comp rx=0 tx=0).stop 2024-04-25T09:06:55.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.186+0000 7f0dd3200640 1 -- 172.21.15.173:0/384349015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dcc06e2e0 msgr2=0x7f0dcc15fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.186+0000 7f0dd3200640 1 --2- 172.21.15.173:0/384349015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dcc06e2e0 0x7f0dcc15fc40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00c420 tx=0x7f0dbc00c8e0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.186+0000 7f0dd3200640 1 -- 172.21.15.173:0/384349015 shutdown_connections 2024-04-25T09:06:55.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.186+0000 7f0dd3200640 1 --2- 172.21.15.173:0/384349015 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0da8066f60 0x7f0da8069420 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.186+0000 7f0dd3200640 1 --2- 172.21.15.173:0/384349015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0dcc163710 0x7f0dcc160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.186+0000 7f0dd3200640 1 --2- 172.21.15.173:0/384349015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0dcc0aeef0 0x7f0dcc1467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.186+0000 7f0dd3200640 1 --2- 172.21.15.173:0/384349015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dcc06e2e0 0x7f0dcc15fc40 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.186+0000 7f0dd3200640 1 -- 172.21.15.173:0/384349015 >> 172.21.15.173:0/384349015 conn(0x7f0dcc06ac90 msgr2=0x7f0dcc16c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:55.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.186+0000 7f0dd3200640 1 -- 172.21.15.173:0/384349015 shutdown_connections 2024-04-25T09:06:55.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.186+0000 7f0dd3200640 1 -- 172.21.15.173:0/384349015 wait complete. 2024-04-25T09:06:55.193 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-04-25T09:06:54.779478+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":320972,"kb_used_data":7676,"kb_used_omap":12,"kb_used_meta":313139,"kb_avail":754653748,"statfs":{"total":773094113280,"available":772765437952,"internally_reserved":0,"allocated":7860224,"data_stored":4185216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":320654896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002552"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774290+0000","last_change":"2024-04-25T09:06:50.774184+0000","last_active":"2024-04-25T09:06:51.774290+0000","last_peered":"2024-04-25T09:06:51.774290+0000","last_clean":"2024-04-25T09:06:51.774290+0000","last_became_active":"2024-04-25T09:06:50.773048+0000","last_became_peered":"2024-04-25T09:06:50.773048+0000","last_unstale":"2024-04-25T09:06:51.774290+0000","last_undegraded":"2024-04-25T09:06:51.774290+0000","last_fullsized":"2024-04-25T09:06:51.774290+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:11.063792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774076+0000","last_change":"2024-04-25T09:06:50.776098+0000","last_active":"2024-04-25T09:06:51.774076+0000","last_peered":"2024-04-25T09:06:51.774076+0000","last_clean":"2024-04-25T09:06:51.774076+0000","last_became_active":"2024-04-25T09:06:50.775764+0000","last_became_peered":"2024-04-25T09:06:50.775764+0000","last_unstale":"2024-04-25T09:06:51.774076+0000","last_undegraded":"2024-04-25T09:06:51.774076+0000","last_fullsized":"2024-04-25T09:06:51.774076+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:58.781138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773487+0000","last_change":"2024-04-25T09:06:50.777583+0000","last_active":"2024-04-25T09:06:51.773487+0000","last_peered":"2024-04-25T09:06:51.773487+0000","last_clean":"2024-04-25T09:06:51.773487+0000","last_became_active":"2024-04-25T09:06:50.777307+0000","last_became_peered":"2024-04-25T09:06:50.777307+0000","last_unstale":"2024-04-25T09:06:51.773487+0000","last_undegraded":"2024-04-25T09:06:51.773487+0000","last_fullsized":"2024-04-25T09:06:51.773487+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:29.296800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759075+0000","last_change":"2024-04-25T09:06:50.762209+0000","last_active":"2024-04-25T09:06:51.759075+0000","last_peered":"2024-04-25T09:06:51.759075+0000","last_clean":"2024-04-25T09:06:51.759075+0000","last_became_active":"2024-04-25T09:06:50.761619+0000","last_became_peered":"2024-04-25T09:06:50.761619+0000","last_unstale":"2024-04-25T09:06:51.759075+0000","last_undegraded":"2024-04-25T09:06:51.759075+0000","last_fullsized":"2024-04-25T09:06:51.759075+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:27.422521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772791+0000","last_change":"2024-04-25T09:06:50.766421+0000","last_active":"2024-04-25T09:06:51.772791+0000","last_peered":"2024-04-25T09:06:51.772791+0000","last_clean":"2024-04-25T09:06:51.772791+0000","last_became_active":"2024-04-25T09:06:50.764884+0000","last_became_peered":"2024-04-25T09:06:50.764884+0000","last_unstale":"2024-04-25T09:06:51.772791+0000","last_undegraded":"2024-04-25T09:06:51.772791+0000","last_fullsized":"2024-04-25T09:06:51.772791+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:56:08.156681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773237+0000","last_change":"2024-04-25T09:06:50.769549+0000","last_active":"2024-04-25T09:06:51.773237+0000","last_peered":"2024-04-25T09:06:51.773237+0000","last_clean":"2024-04-25T09:06:51.773237+0000","last_became_active":"2024-04-25T09:06:50.769153+0000","last_became_peered":"2024-04-25T09:06:50.769153+0000","last_unstale":"2024-04-25T09:06:51.773237+0000","last_undegraded":"2024-04-25T09:06:51.773237+0000","last_fullsized":"2024-04-25T09:06:51.773237+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:01.408076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.760016+0000","last_change":"2024-04-25T09:06:50.772926+0000","last_active":"2024-04-25T09:06:51.760016+0000","last_peered":"2024-04-25T09:06:51.760016+0000","last_clean":"2024-04-25T09:06:51.760016+0000","last_became_active":"2024-04-25T09:06:50.772668+0000","last_became_peered":"2024-04-25T09:06:50.772668+0000","last_unstale":"2024-04-25T09:06:51.760016+0000","last_undegraded":"2024-04-25T09:06:51.760016+0000","last_fullsized":"2024-04-25T09:06:51.760016+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:44.721285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772378+0000","last_change":"2024-04-25T09:06:50.767250+0000","last_active":"2024-04-25T09:06:51.772378+0000","last_peered":"2024-04-25T09:06:51.772378+0000","last_clean":"2024-04-25T09:06:51.772378+0000","last_became_active":"2024-04-25T09:06:50.765486+0000","last_became_peered":"2024-04-25T09:06:50.765486+0000","last_unstale":"2024-04-25T09:06:51.772378+0000","last_undegraded":"2024-04-25T09:06:51.772378+0000","last_fullsized":"2024-04-25T09:06:51.772378+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:42:25.617339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773704+0000","last_change":"2024-04-25T09:06:50.778513+0000","last_active":"2024-04-25T09:06:51.773704+0000","last_peered":"2024-04-25T09:06:51.773704+0000","last_clean":"2024-04-25T09:06:51.773704+0000","last_became_active":"2024-04-25T09:06:50.778250+0000","last_became_peered":"2024-04-25T09:06:50.778250+0000","last_unstale":"2024-04-25T09:06:51.773704+0000","last_undegraded":"2024-04-25T09:06:51.773704+0000","last_fullsized":"2024-04-25T09:06:51.773704+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:44.515167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773420+0000","last_change":"2024-04-25T09:06:50.785992+0000","last_active":"2024-04-25T09:06:51.773420+0000","last_peered":"2024-04-25T09:06:51.773420+0000","last_clean":"2024-04-25T09:06:51.773420+0000","last_became_active":"2024-04-25T09:06:50.785695+0000","last_became_peered":"2024-04-25T09:06:50.785695+0000","last_unstale":"2024-04-25T09:06:51.773420+0000","last_undegraded":"2024-04-25T09:06:51.773420+0000","last_fullsized":"2024-04-25T09:06:51.773420+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:46.997116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759066+0000","last_change":"2024-04-25T09:06:50.772960+0000","last_active":"2024-04-25T09:06:51.759066+0000","last_peered":"2024-04-25T09:06:51.759066+0000","last_clean":"2024-04-25T09:06:51.759066+0000","last_became_active":"2024-04-25T09:06:50.772366+0000","last_became_peered":"2024-04-25T09:06:50.772366+0000","last_unstale":"2024-04-25T09:06:51.759066+0000","last_undegraded":"2024-04-25T09:06:51.759066+0000","last_fullsized":"2024-04-25T09:06:51.759066+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:42.928642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773171+0000","last_change":"2024-04-25T09:06:50.769056+0000","last_active":"2024-04-25T09:06:51.773171+0000","last_peered":"2024-04-25T09:06:51.773171+0000","last_clean":"2024-04-25T09:06:51.773171+0000","last_became_active":"2024-04-25T09:06:50.768826+0000","last_became_peered":"2024-04-25T09:06:50.768826+0000","last_unstale":"2024-04-25T09:06:51.773171+0000","last_undegraded":"2024-04-25T09:06:51.773171+0000","last_fullsized":"2024-04-25T09:06:51.773171+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:57.285386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773406+0000","last_change":"2024-04-25T09:06:50.768909+0000","last_active":"2024-04-25T09:06:51.773406+0000","last_peered":"2024-04-25T09:06:51.773406+0000","last_clean":"2024-04-25T09:06:51.773406+0000","last_became_active":"2024-04-25T09:06:50.768644+0000","last_became_peered":"2024-04-25T09:06:50.768644+0000","last_unstale":"2024-04-25T09:06:51.773406+0000","last_undegraded":"2024-04-25T09:06:51.773406+0000","last_fullsized":"2024-04-25T09:06:51.773406+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:48.054806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773096+0000","last_change":"2024-04-25T09:06:50.777432+0000","last_active":"2024-04-25T09:06:51.773096+0000","last_peered":"2024-04-25T09:06:51.773096+0000","last_clean":"2024-04-25T09:06:51.773096+0000","last_became_active":"2024-04-25T09:06:50.777150+0000","last_became_peered":"2024-04-25T09:06:50.777150+0000","last_unstale":"2024-04-25T09:06:51.773096+0000","last_undegraded":"2024-04-25T09:06:51.773096+0000","last_fullsized":"2024-04-25T09:06:51.773096+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:25.723105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772994+0000","last_change":"2024-04-25T09:06:50.772104+0000","last_active":"2024-04-25T09:06:51.772994+0000","last_peered":"2024-04-25T09:06:51.772994+0000","last_clean":"2024-04-25T09:06:51.772994+0000","last_became_active":"2024-04-25T09:06:50.771832+0000","last_became_peered":"2024-04-25T09:06:50.771832+0000","last_unstale":"2024-04-25T09:06:51.772994+0000","last_undegraded":"2024-04-25T09:06:51.772994+0000","last_fullsized":"2024-04-25T09:06:51.772994+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:22.031522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759914+0000","last_change":"2024-04-25T09:06:50.770720+0000","last_active":"2024-04-25T09:06:51.759914+0000","last_peered":"2024-04-25T09:06:51.759914+0000","last_clean":"2024-04-25T09:06:51.759914+0000","last_became_active":"2024-04-25T09:06:50.770290+0000","last_became_peered":"2024-04-25T09:06:50.770290+0000","last_unstale":"2024-04-25T09:06:51.759914+0000","last_undegraded":"2024-04-25T09:06:51.759914+0000","last_fullsized":"2024-04-25T09:06:51.759914+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:37.992830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774417+0000","last_change":"2024-04-25T09:06:50.780004+0000","last_active":"2024-04-25T09:06:51.774417+0000","last_peered":"2024-04-25T09:06:51.774417+0000","last_clean":"2024-04-25T09:06:51.774417+0000","last_became_active":"2024-04-25T09:06:50.779619+0000","last_became_peered":"2024-04-25T09:06:50.779619+0000","last_unstale":"2024-04-25T09:06:51.774417+0000","last_undegraded":"2024-04-25T09:06:51.774417+0000","last_fullsized":"2024-04-25T09:06:51.774417+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:51.731165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759154+0000","last_change":"2024-04-25T09:06:50.757036+0000","last_active":"2024-04-25T09:06:51.759154+0000","last_peered":"2024-04-25T09:06:51.759154+0000","last_clean":"2024-04-25T09:06:51.759154+0000","last_became_active":"2024-04-25T09:06:50.756684+0000","last_became_peered":"2024-04-25T09:06:50.756684+0000","last_unstale":"2024-04-25T09:06:51.759154+0000","last_undegraded":"2024-04-25T09:06:51.759154+0000","last_fullsized":"2024-04-25T09:06:51.759154+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:53.256387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773989+0000","last_change":"2024-04-25T09:06:50.771991+0000","last_active":"2024-04-25T09:06:51.773989+0000","last_peered":"2024-04-25T09:06:51.773989+0000","last_clean":"2024-04-25T09:06:51.773989+0000","last_became_active":"2024-04-25T09:06:50.771743+0000","last_became_peered":"2024-04-25T09:06:50.771743+0000","last_unstale":"2024-04-25T09:06:51.773989+0000","last_undegraded":"2024-04-25T09:06:51.773989+0000","last_fullsized":"2024-04-25T09:06:51.773989+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:58.661212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759457+0000","last_change":"2024-04-25T09:06:50.758625+0000","last_active":"2024-04-25T09:06:51.759457+0000","last_peered":"2024-04-25T09:06:51.759457+0000","last_clean":"2024-04-25T09:06:51.759457+0000","last_became_active":"2024-04-25T09:06:50.758344+0000","last_became_peered":"2024-04-25T09:06:50.758344+0000","last_unstale":"2024-04-25T09:06:51.759457+0000","last_undegraded":"2024-04-25T09:06:51.759457+0000","last_fullsized":"2024-04-25T09:06:51.759457+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:02.755914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773549+0000","last_change":"2024-04-25T09:06:50.770965+0000","last_active":"2024-04-25T09:06:51.773549+0000","last_peered":"2024-04-25T09:06:51.773549+0000","last_clean":"2024-04-25T09:06:51.773549+0000","last_became_active":"2024-04-25T09:06:50.770720+0000","last_became_peered":"2024-04-25T09:06:50.770720+0000","last_unstale":"2024-04-25T09:06:51.773549+0000","last_undegraded":"2024-04-25T09:06:51.773549+0000","last_fullsized":"2024-04-25T09:06:51.773549+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:57.526276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758846+0000","last_change":"2024-04-25T09:06:50.767117+0000","last_active":"2024-04-25T09:06:51.758846+0000","last_peered":"2024-04-25T09:06:51.758846+0000","last_clean":"2024-04-25T09:06:51.758846+0000","last_became_active":"2024-04-25T09:06:50.766806+0000","last_became_peered":"2024-04-25T09:06:50.766806+0000","last_unstale":"2024-04-25T09:06:51.758846+0000","last_undegraded":"2024-04-25T09:06:51.758846+0000","last_fullsized":"2024-04-25T09:06:51.758846+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:28.080484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758796+0000","last_change":"2024-04-25T09:06:50.770072+0000","last_active":"2024-04-25T09:06:51.758796+0000","last_peered":"2024-04-25T09:06:51.758796+0000","last_clean":"2024-04-25T09:06:51.758796+0000","last_became_active":"2024-04-25T09:06:50.769746+0000","last_became_peered":"2024-04-25T09:06:50.769746+0000","last_unstale":"2024-04-25T09:06:51.758796+0000","last_undegraded":"2024-04-25T09:06:51.758796+0000","last_fullsized":"2024-04-25T09:06:51.758796+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:17.232567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773076+0000","last_change":"2024-04-25T09:06:50.776457+0000","last_active":"2024-04-25T09:06:51.773076+0000","last_peered":"2024-04-25T09:06:51.773076+0000","last_clean":"2024-04-25T09:06:51.773076+0000","last_became_active":"2024-04-25T09:06:50.775462+0000","last_became_peered":"2024-04-25T09:06:50.775462+0000","last_unstale":"2024-04-25T09:06:51.773076+0000","last_undegraded":"2024-04-25T09:06:51.773076+0000","last_fullsized":"2024-04-25T09:06:51.773076+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:49.407566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773953+0000","last_change":"2024-04-25T09:06:50.772100+0000","last_active":"2024-04-25T09:06:51.773953+0000","last_peered":"2024-04-25T09:06:51.773953+0000","last_clean":"2024-04-25T09:06:51.773953+0000","last_became_active":"2024-04-25T09:06:50.771812+0000","last_became_peered":"2024-04-25T09:06:50.771812+0000","last_unstale":"2024-04-25T09:06:51.773953+0000","last_undegraded":"2024-04-25T09:06:51.773953+0000","last_fullsized":"2024-04-25T09:06:51.773953+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:50.709647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773695+0000","last_change":"2024-04-25T09:06:50.780040+0000","last_active":"2024-04-25T09:06:51.773695+0000","last_peered":"2024-04-25T09:06:51.773695+0000","last_clean":"2024-04-25T09:06:51.773695+0000","last_became_active":"2024-04-25T09:06:50.779797+0000","last_became_peered":"2024-04-25T09:06:50.779797+0000","last_unstale":"2024-04-25T09:06:51.773695+0000","last_undegraded":"2024-04-25T09:06:51.773695+0000","last_fullsized":"2024-04-25T09:06:51.773695+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:08.299511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759095+0000","last_change":"2024-04-25T09:06:50.773583+0000","last_active":"2024-04-25T09:06:51.759095+0000","last_peered":"2024-04-25T09:06:51.759095+0000","last_clean":"2024-04-25T09:06:51.759095+0000","last_became_active":"2024-04-25T09:06:50.773323+0000","last_became_peered":"2024-04-25T09:06:50.773323+0000","last_unstale":"2024-04-25T09:06:51.759095+0000","last_undegraded":"2024-04-25T09:06:51.759095+0000","last_fullsized":"2024-04-25T09:06:51.759095+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:59.358584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773919+0000","last_change":"2024-04-25T09:06:50.771653+0000","last_active":"2024-04-25T09:06:51.773919+0000","last_peered":"2024-04-25T09:06:51.773919+0000","last_clean":"2024-04-25T09:06:51.773919+0000","last_became_active":"2024-04-25T09:06:50.771330+0000","last_became_peered":"2024-04-25T09:06:50.771330+0000","last_unstale":"2024-04-25T09:06:51.773919+0000","last_undegraded":"2024-04-25T09:06:51.773919+0000","last_fullsized":"2024-04-25T09:06:51.773919+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:06.761636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773226+0000","last_change":"2024-04-25T09:06:50.778814+0000","last_active":"2024-04-25T09:06:51.773226+0000","last_peered":"2024-04-25T09:06:51.773226+0000","last_clean":"2024-04-25T09:06:51.773226+0000","last_became_active":"2024-04-25T09:06:50.778327+0000","last_became_peered":"2024-04-25T09:06:50.778327+0000","last_unstale":"2024-04-25T09:06:51.773226+0000","last_undegraded":"2024-04-25T09:06:51.773226+0000","last_fullsized":"2024-04-25T09:06:51.773226+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:03.496893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772655+0000","last_change":"2024-04-25T09:06:50.771588+0000","last_active":"2024-04-25T09:06:51.772655+0000","last_peered":"2024-04-25T09:06:51.772655+0000","last_clean":"2024-04-25T09:06:51.772655+0000","last_became_active":"2024-04-25T09:06:50.767731+0000","last_became_peered":"2024-04-25T09:06:50.767731+0000","last_unstale":"2024-04-25T09:06:51.772655+0000","last_undegraded":"2024-04-25T09:06:51.772655+0000","last_fullsized":"2024-04-25T09:06:51.772655+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:33.278099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758721+0000","last_change":"2024-04-25T09:06:50.773228+0000","last_active":"2024-04-25T09:06:51.758721+0000","last_peered":"2024-04-25T09:06:51.758721+0000","last_clean":"2024-04-25T09:06:51.758721+0000","last_became_active":"2024-04-25T09:06:50.772962+0000","last_became_peered":"2024-04-25T09:06:50.772962+0000","last_unstale":"2024-04-25T09:06:51.758721+0000","last_undegraded":"2024-04-25T09:06:51.758721+0000","last_fullsized":"2024-04-25T09:06:51.758721+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:18.099004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773045+0000","last_change":"2024-04-25T09:06:50.776544+0000","last_active":"2024-04-25T09:06:51.773045+0000","last_peered":"2024-04-25T09:06:51.773045+0000","last_clean":"2024-04-25T09:06:51.773045+0000","last_became_active":"2024-04-25T09:06:50.776257+0000","last_became_peered":"2024-04-25T09:06:50.776257+0000","last_unstale":"2024-04-25T09:06:51.773045+0000","last_undegraded":"2024-04-25T09:06:51.773045+0000","last_fullsized":"2024-04-25T09:06:51.773045+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:42.960328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774140+0000","last_change":"2024-04-25T09:06:50.774229+0000","last_active":"2024-04-25T09:06:51.774140+0000","last_peered":"2024-04-25T09:06:51.774140+0000","last_clean":"2024-04-25T09:06:51.774140+0000","last_became_active":"2024-04-25T09:06:50.773884+0000","last_became_peered":"2024-04-25T09:06:50.773884+0000","last_unstale":"2024-04-25T09:06:51.774140+0000","last_undegraded":"2024-04-25T09:06:51.774140+0000","last_fullsized":"2024-04-25T09:06:51.774140+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:12.627010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"68'4","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774463+0000","last_change":"2024-04-25T09:06:49.772396+0000","last_active":"2024-04-25T09:06:51.774463+0000","last_peered":"2024-04-25T09:06:51.774463+0000","last_clean":"2024-04-25T09:06:51.774463+0000","last_became_active":"2024-04-25T09:06:49.772012+0000","last_became_peered":"2024-04-25T09:06:49.772012+0000","last_unstale":"2024-04-25T09:06:51.774463+0000","last_undegraded":"2024-04-25T09:06:51.774463+0000","last_fullsized":"2024-04-25T09:06:51.774463+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:44.780984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759236+0000","last_change":"2024-04-25T09:06:50.757543+0000","last_active":"2024-04-25T09:06:51.759236+0000","last_peered":"2024-04-25T09:06:51.759236+0000","last_clean":"2024-04-25T09:06:51.759236+0000","last_became_active":"2024-04-25T09:06:50.757264+0000","last_became_peered":"2024-04-25T09:06:50.757264+0000","last_unstale":"2024-04-25T09:06:51.759236+0000","last_undegraded":"2024-04-25T09:06:51.759236+0000","last_fullsized":"2024-04-25T09:06:51.759236+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:56:08.156681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773394+0000","last_change":"2024-04-25T09:06:49.770666+0000","last_active":"2024-04-25T09:06:51.773394+0000","last_peered":"2024-04-25T09:06:51.773394+0000","last_clean":"2024-04-25T09:06:51.773394+0000","last_became_active":"2024-04-25T09:06:49.770416+0000","last_became_peered":"2024-04-25T09:06:49.770416+0000","last_unstale":"2024-04-25T09:06:51.773394+0000","last_undegraded":"2024-04-25T09:06:51.773394+0000","last_fullsized":"2024-04-25T09:06:51.773394+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:13.917626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773356+0000","last_change":"2024-04-25T09:06:50.768348+0000","last_active":"2024-04-25T09:06:51.773356+0000","last_peered":"2024-04-25T09:06:51.773356+0000","last_clean":"2024-04-25T09:06:51.773356+0000","last_became_active":"2024-04-25T09:06:50.768028+0000","last_became_peered":"2024-04-25T09:06:50.768028+0000","last_unstale":"2024-04-25T09:06:51.773356+0000","last_undegraded":"2024-04-25T09:06:51.773356+0000","last_fullsized":"2024-04-25T09:06:51.773356+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:08.452417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773614+0000","last_change":"2024-04-25T09:06:49.769759+0000","last_active":"2024-04-25T09:06:51.773614+0000","last_peered":"2024-04-25T09:06:51.773614+0000","last_clean":"2024-04-25T09:06:51.773614+0000","last_became_active":"2024-04-25T09:06:49.769481+0000","last_became_peered":"2024-04-25T09:06:49.769481+0000","last_unstale":"2024-04-25T09:06:51.773614+0000","last_undegraded":"2024-04-25T09:06:51.773614+0000","last_fullsized":"2024-04-25T09:06:51.773614+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:45.064269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773487+0000","last_change":"2024-04-25T09:06:50.785953+0000","last_active":"2024-04-25T09:06:51.773487+0000","last_peered":"2024-04-25T09:06:51.773487+0000","last_clean":"2024-04-25T09:06:51.773487+0000","last_became_active":"2024-04-25T09:06:50.785671+0000","last_became_peered":"2024-04-25T09:06:50.785671+0000","last_unstale":"2024-04-25T09:06:51.773487+0000","last_undegraded":"2024-04-25T09:06:51.773487+0000","last_fullsized":"2024-04-25T09:06:51.773487+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:38.897683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773468+0000","last_change":"2024-04-25T09:06:49.768037+0000","last_active":"2024-04-25T09:06:51.773468+0000","last_peered":"2024-04-25T09:06:51.773468+0000","last_clean":"2024-04-25T09:06:51.773468+0000","last_became_active":"2024-04-25T09:06:49.767790+0000","last_became_peered":"2024-04-25T09:06:49.767790+0000","last_unstale":"2024-04-25T09:06:51.773468+0000","last_undegraded":"2024-04-25T09:06:51.773468+0000","last_fullsized":"2024-04-25T09:06:51.773468+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:27.933814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.760064+0000","last_change":"2024-04-25T09:06:50.773617+0000","last_active":"2024-04-25T09:06:51.760064+0000","last_peered":"2024-04-25T09:06:51.760064+0000","last_clean":"2024-04-25T09:06:51.760064+0000","last_became_active":"2024-04-25T09:06:50.773239+0000","last_became_peered":"2024-04-25T09:06:50.773239+0000","last_unstale":"2024-04-25T09:06:51.760064+0000","last_undegraded":"2024-04-25T09:06:51.760064+0000","last_fullsized":"2024-04-25T09:06:51.760064+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:07.779114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759095+0000","last_change":"2024-04-25T09:06:49.773360+0000","last_active":"2024-04-25T09:06:51.759095+0000","last_peered":"2024-04-25T09:06:51.759095+0000","last_clean":"2024-04-25T09:06:51.759095+0000","last_became_active":"2024-04-25T09:06:49.773097+0000","last_became_peered":"2024-04-25T09:06:49.773097+0000","last_unstale":"2024-04-25T09:06:51.759095+0000","last_undegraded":"2024-04-25T09:06:51.759095+0000","last_fullsized":"2024-04-25T09:06:51.759095+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:45.994378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773380+0000","last_change":"2024-04-25T09:06:50.781673+0000","last_active":"2024-04-25T09:06:51.773380+0000","last_peered":"2024-04-25T09:06:51.773380+0000","last_clean":"2024-04-25T09:06:51.773380+0000","last_became_active":"2024-04-25T09:06:50.781300+0000","last_became_peered":"2024-04-25T09:06:50.781300+0000","last_unstale":"2024-04-25T09:06:51.773380+0000","last_undegraded":"2024-04-25T09:06:51.773380+0000","last_fullsized":"2024-04-25T09:06:51.773380+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:02.919869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758940+0000","last_change":"2024-04-25T09:06:49.765619+0000","last_active":"2024-04-25T09:06:51.758940+0000","last_peered":"2024-04-25T09:06:51.758940+0000","last_clean":"2024-04-25T09:06:51.758940+0000","last_became_active":"2024-04-25T09:06:49.765278+0000","last_became_peered":"2024-04-25T09:06:49.765278+0000","last_unstale":"2024-04-25T09:06:51.758940+0000","last_undegraded":"2024-04-25T09:06:51.758940+0000","last_fullsized":"2024-04-25T09:06:51.758940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:48.404828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772543+0000","last_change":"2024-04-25T09:06:50.769227+0000","last_active":"2024-04-25T09:06:51.772543+0000","last_peered":"2024-04-25T09:06:51.772543+0000","last_clean":"2024-04-25T09:06:51.772543+0000","last_became_active":"2024-04-25T09:06:50.766915+0000","last_became_peered":"2024-04-25T09:06:50.766915+0000","last_unstale":"2024-04-25T09:06:51.772543+0000","last_undegraded":"2024-04-25T09:06:51.772543+0000","last_fullsized":"2024-04-25T09:06:51.772543+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:53.256387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758781+0000","last_change":"2024-04-25T09:06:49.774484+0000","last_active":"2024-04-25T09:06:51.758781+0000","last_peered":"2024-04-25T09:06:51.758781+0000","last_clean":"2024-04-25T09:06:51.758781+0000","last_became_active":"2024-04-25T09:06:49.773991+0000","last_became_peered":"2024-04-25T09:06:49.773991+0000","last_unstale":"2024-04-25T09:06:51.758781+0000","last_undegraded":"2024-04-25T09:06:51.758781+0000","last_fullsized":"2024-04-25T09:06:51.758781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:21.028784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759122+0000","last_change":"2024-04-25T09:06:50.757620+0000","last_active":"2024-04-25T09:06:51.759122+0000","last_peered":"2024-04-25T09:06:51.759122+0000","last_clean":"2024-04-25T09:06:51.759122+0000","last_became_active":"2024-04-25T09:06:50.757350+0000","last_became_peered":"2024-04-25T09:06:50.757350+0000","last_unstale":"2024-04-25T09:06:51.759122+0000","last_undegraded":"2024-04-25T09:06:51.759122+0000","last_fullsized":"2024-04-25T09:06:51.759122+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:11.873700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772212+0000","last_change":"2024-04-25T09:06:49.776390+0000","last_active":"2024-04-25T09:06:51.772212+0000","last_peered":"2024-04-25T09:06:51.772212+0000","last_clean":"2024-04-25T09:06:51.772212+0000","last_became_active":"2024-04-25T09:06:49.776053+0000","last_became_peered":"2024-04-25T09:06:49.776053+0000","last_unstale":"2024-04-25T09:06:51.772212+0000","last_undegraded":"2024-04-25T09:06:51.772212+0000","last_fullsized":"2024-04-25T09:06:51.772212+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:01.810733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773929+0000","last_change":"2024-04-25T09:06:50.782313+0000","last_active":"2024-04-25T09:06:51.773929+0000","last_peered":"2024-04-25T09:06:51.773929+0000","last_clean":"2024-04-25T09:06:51.773929+0000","last_became_active":"2024-04-25T09:06:50.782030+0000","last_became_peered":"2024-04-25T09:06:50.782030+0000","last_unstale":"2024-04-25T09:06:51.773929+0000","last_undegraded":"2024-04-25T09:06:51.773929+0000","last_fullsized":"2024-04-25T09:06:51.773929+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:46.543061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773594+0000","last_change":"2024-04-25T09:06:49.776299+0000","last_active":"2024-04-25T09:06:51.773594+0000","last_peered":"2024-04-25T09:06:51.773594+0000","last_clean":"2024-04-25T09:06:51.773594+0000","last_became_active":"2024-04-25T09:06:49.776045+0000","last_became_peered":"2024-04-25T09:06:49.776045+0000","last_unstale":"2024-04-25T09:06:51.773594+0000","last_undegraded":"2024-04-25T09:06:51.773594+0000","last_fullsized":"2024-04-25T09:06:51.773594+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:31.928871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759365+0000","last_change":"2024-04-25T09:06:50.770119+0000","last_active":"2024-04-25T09:06:51.759365+0000","last_peered":"2024-04-25T09:06:51.759365+0000","last_clean":"2024-04-25T09:06:51.759365+0000","last_became_active":"2024-04-25T09:06:50.769809+0000","last_became_peered":"2024-04-25T09:06:50.769809+0000","last_unstale":"2024-04-25T09:06:51.759365+0000","last_undegraded":"2024-04-25T09:06:51.759365+0000","last_fullsized":"2024-04-25T09:06:51.759365+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:42.775238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759214+0000","last_change":"2024-04-25T09:06:49.761678+0000","last_active":"2024-04-25T09:06:51.759214+0000","last_peered":"2024-04-25T09:06:51.759214+0000","last_clean":"2024-04-25T09:06:51.759214+0000","last_became_active":"2024-04-25T09:06:49.761408+0000","last_became_peered":"2024-04-25T09:06:49.761408+0000","last_unstale":"2024-04-25T09:06:51.759214+0000","last_undegraded":"2024-04-25T09:06:51.759214+0000","last_fullsized":"2024-04-25T09:06:51.759214+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:47.680263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774561+0000","last_change":"2024-04-25T09:06:50.769061+0000","last_active":"2024-04-25T09:06:51.774561+0000","last_peered":"2024-04-25T09:06:51.774561+0000","last_clean":"2024-04-25T09:06:51.774561+0000","last_became_active":"2024-04-25T09:06:50.768782+0000","last_became_peered":"2024-04-25T09:06:50.768782+0000","last_unstale":"2024-04-25T09:06:51.774561+0000","last_undegraded":"2024-04-25T09:06:51.774561+0000","last_fullsized":"2024-04-25T09:06:51.774561+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:49.902976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"68'3","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773597+0000","last_change":"2024-04-25T09:06:49.773025+0000","last_active":"2024-04-25T09:06:51.773597+0000","last_peered":"2024-04-25T09:06:51.773597+0000","last_clean":"2024-04-25T09:06:51.773597+0000","last_became_active":"2024-04-25T09:06:49.772699+0000","last_became_peered":"2024-04-25T09:06:49.772699+0000","last_unstale":"2024-04-25T09:06:51.773597+0000","last_undegraded":"2024-04-25T09:06:51.773597+0000","last_fullsized":"2024-04-25T09:06:51.773597+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:45.064269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759319+0000","last_change":"2024-04-25T09:06:50.770342+0000","last_active":"2024-04-25T09:06:51.759319+0000","last_peered":"2024-04-25T09:06:51.759319+0000","last_clean":"2024-04-25T09:06:51.759319+0000","last_became_active":"2024-04-25T09:06:50.770077+0000","last_became_peered":"2024-04-25T09:06:50.770077+0000","last_unstale":"2024-04-25T09:06:51.759319+0000","last_undegraded":"2024-04-25T09:06:51.759319+0000","last_fullsized":"2024-04-25T09:06:51.759319+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:54.634087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"68'6","reported_seq":20,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774000+0000","last_change":"2024-04-25T09:06:49.766081+0000","last_active":"2024-04-25T09:06:51.774000+0000","last_peered":"2024-04-25T09:06:51.774000+0000","last_clean":"2024-04-25T09:06:51.774000+0000","last_became_active":"2024-04-25T09:06:49.765478+0000","last_became_peered":"2024-04-25T09:06:49.765478+0000","last_unstale":"2024-04-25T09:06:51.774000+0000","last_undegraded":"2024-04-25T09:06:51.774000+0000","last_fullsized":"2024-04-25T09:06:51.774000+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:20.752903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758819+0000","last_change":"2024-04-25T09:06:50.765079+0000","last_active":"2024-04-25T09:06:51.758819+0000","last_peered":"2024-04-25T09:06:51.758819+0000","last_clean":"2024-04-25T09:06:51.758819+0000","last_became_active":"2024-04-25T09:06:50.764825+0000","last_became_peered":"2024-04-25T09:06:50.764825+0000","last_unstale":"2024-04-25T09:06:51.758819+0000","last_undegraded":"2024-04-25T09:06:51.758819+0000","last_fullsized":"2024-04-25T09:06:51.758819+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:00.759417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773354+0000","last_change":"2024-04-25T09:06:49.778303+0000","last_active":"2024-04-25T09:06:51.773354+0000","last_peered":"2024-04-25T09:06:51.773354+0000","last_clean":"2024-04-25T09:06:51.773354+0000","last_became_active":"2024-04-25T09:06:49.777962+0000","last_became_peered":"2024-04-25T09:06:49.777962+0000","last_unstale":"2024-04-25T09:06:51.773354+0000","last_undegraded":"2024-04-25T09:06:51.773354+0000","last_fullsized":"2024-04-25T09:06:51.773354+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:27.933814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772610+0000","last_change":"2024-04-25T09:06:50.769425+0000","last_active":"2024-04-25T09:06:51.772610+0000","last_peered":"2024-04-25T09:06:51.772610+0000","last_clean":"2024-04-25T09:06:51.772610+0000","last_became_active":"2024-04-25T09:06:50.769177+0000","last_became_peered":"2024-04-25T09:06:50.769177+0000","last_unstale":"2024-04-25T09:06:51.772610+0000","last_undegraded":"2024-04-25T09:06:51.772610+0000","last_fullsized":"2024-04-25T09:06:51.772610+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:31.418868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772706+0000","last_change":"2024-04-25T09:06:49.768363+0000","last_active":"2024-04-25T09:06:51.772706+0000","last_peered":"2024-04-25T09:06:51.772706+0000","last_clean":"2024-04-25T09:06:51.772706+0000","last_became_active":"2024-04-25T09:06:49.767887+0000","last_became_peered":"2024-04-25T09:06:49.767887+0000","last_unstale":"2024-04-25T09:06:51.772706+0000","last_undegraded":"2024-04-25T09:06:51.772706+0000","last_fullsized":"2024-04-25T09:06:51.772706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:53.631349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772568+0000","last_change":"2024-04-25T09:06:50.768559+0000","last_active":"2024-04-25T09:06:51.772568+0000","last_peered":"2024-04-25T09:06:51.772568+0000","last_clean":"2024-04-25T09:06:51.772568+0000","last_became_active":"2024-04-25T09:06:50.766844+0000","last_became_peered":"2024-04-25T09:06:50.766844+0000","last_unstale":"2024-04-25T09:06:51.772568+0000","last_undegraded":"2024-04-25T09:06:51.772568+0000","last_fullsized":"2024-04-25T09:06:51.772568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:21.185317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772911+0000","last_change":"2024-04-25T09:06:49.775924+0000","last_active":"2024-04-25T09:06:51.772911+0000","last_peered":"2024-04-25T09:06:51.772911+0000","last_clean":"2024-04-25T09:06:51.772911+0000","last_became_active":"2024-04-25T09:06:49.775464+0000","last_became_peered":"2024-04-25T09:06:49.775464+0000","last_unstale":"2024-04-25T09:06:51.772911+0000","last_undegraded":"2024-04-25T09:06:51.772911+0000","last_fullsized":"2024-04-25T09:06:51.772911+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:23.417984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773801+0000","last_change":"2024-04-25T09:06:50.768904+0000","last_active":"2024-04-25T09:06:51.773801+0000","last_peered":"2024-04-25T09:06:51.773801+0000","last_clean":"2024-04-25T09:06:51.773801+0000","last_became_active":"2024-04-25T09:06:50.768435+0000","last_became_peered":"2024-04-25T09:06:50.768435+0000","last_unstale":"2024-04-25T09:06:51.773801+0000","last_undegraded":"2024-04-25T09:06:51.773801+0000","last_fullsized":"2024-04-25T09:06:51.773801+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:47.263323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"68'8","reported_seq":22,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758566+0000","last_change":"2024-04-25T09:06:49.771727+0000","last_active":"2024-04-25T09:06:51.758566+0000","last_peered":"2024-04-25T09:06:51.758566+0000","last_clean":"2024-04-25T09:06:51.758566+0000","last_became_active":"2024-04-25T09:06:49.771370+0000","last_became_peered":"2024-04-25T09:06:49.771370+0000","last_unstale":"2024-04-25T09:06:51.758566+0000","last_undegraded":"2024-04-25T09:06:51.758566+0000","last_fullsized":"2024-04-25T09:06:51.758566+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:25.605448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774255+0000","last_change":"2024-04-25T09:06:50.779022+0000","last_active":"2024-04-25T09:06:51.774255+0000","last_peered":"2024-04-25T09:06:51.774255+0000","last_clean":"2024-04-25T09:06:51.774255+0000","last_became_active":"2024-04-25T09:06:50.778721+0000","last_became_peered":"2024-04-25T09:06:50.778721+0000","last_unstale":"2024-04-25T09:06:51.774255+0000","last_undegraded":"2024-04-25T09:06:51.774255+0000","last_fullsized":"2024-04-25T09:06:51.774255+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:55.914047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773866+0000","last_change":"2024-04-25T09:06:49.770482+0000","last_active":"2024-04-25T09:06:51.773866+0000","last_peered":"2024-04-25T09:06:51.773866+0000","last_clean":"2024-04-25T09:06:51.773866+0000","last_became_active":"2024-04-25T09:06:49.770097+0000","last_became_peered":"2024-04-25T09:06:49.770097+0000","last_unstale":"2024-04-25T09:06:51.773866+0000","last_undegraded":"2024-04-25T09:06:51.773866+0000","last_fullsized":"2024-04-25T09:06:51.773866+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:47.244523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774137+0000","last_change":"2024-04-25T09:06:50.764498+0000","last_active":"2024-04-25T09:06:51.774137+0000","last_peered":"2024-04-25T09:06:51.774137+0000","last_clean":"2024-04-25T09:06:51.774137+0000","last_became_active":"2024-04-25T09:06:50.764163+0000","last_became_peered":"2024-04-25T09:06:50.764163+0000","last_unstale":"2024-04-25T09:06:51.774137+0000","last_undegraded":"2024-04-25T09:06:51.774137+0000","last_fullsized":"2024-04-25T09:06:51.774137+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:07.976442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773527+0000","last_change":"2024-04-25T09:06:49.770792+0000","last_active":"2024-04-25T09:06:51.773527+0000","last_peered":"2024-04-25T09:06:51.773527+0000","last_clean":"2024-04-25T09:06:51.773527+0000","last_became_active":"2024-04-25T09:06:49.770528+0000","last_became_peered":"2024-04-25T09:06:49.770528+0000","last_unstale":"2024-04-25T09:06:51.773527+0000","last_undegraded":"2024-04-25T09:06:51.773527+0000","last_fullsized":"2024-04-25T09:06:51.773527+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:53.519331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759159+0000","last_change":"2024-04-25T09:06:50.760990+0000","last_active":"2024-04-25T09:06:51.759159+0000","last_peered":"2024-04-25T09:06:51.759159+0000","last_clean":"2024-04-25T09:06:51.759159+0000","last_became_active":"2024-04-25T09:06:50.760460+0000","last_became_peered":"2024-04-25T09:06:50.760460+0000","last_unstale":"2024-04-25T09:06:51.759159+0000","last_undegraded":"2024-04-25T09:06:51.759159+0000","last_fullsized":"2024-04-25T09:06:51.759159+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:21.185317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773633+0000","last_change":"2024-04-25T09:06:49.776752+0000","last_active":"2024-04-25T09:06:51.773633+0000","last_peered":"2024-04-25T09:06:51.773633+0000","last_clean":"2024-04-25T09:06:51.773633+0000","last_became_active":"2024-04-25T09:06:49.776484+0000","last_became_peered":"2024-04-25T09:06:49.776484+0000","last_unstale":"2024-04-25T09:06:51.773633+0000","last_undegraded":"2024-04-25T09:06:51.773633+0000","last_fullsized":"2024-04-25T09:06:51.773633+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:39.550531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774065+0000","last_change":"2024-04-25T09:06:50.762270+0000","last_active":"2024-04-25T09:06:51.774065+0000","last_peered":"2024-04-25T09:06:51.774065+0000","last_clean":"2024-04-25T09:06:51.774065+0000","last_became_active":"2024-04-25T09:06:50.761808+0000","last_became_peered":"2024-04-25T09:06:50.761808+0000","last_unstale":"2024-04-25T09:06:51.774065+0000","last_undegraded":"2024-04-25T09:06:51.774065+0000","last_fullsized":"2024-04-25T09:06:51.774065+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:48.247261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.759254+0000","last_change":"2024-04-25T09:06:49.769270+0000","last_active":"2024-04-25T09:06:51.759254+0000","last_peered":"2024-04-25T09:06:51.759254+0000","last_clean":"2024-04-25T09:06:51.759254+0000","last_became_active":"2024-04-25T09:06:49.768293+0000","last_became_peered":"2024-04-25T09:06:49.768293+0000","last_unstale":"2024-04-25T09:06:51.759254+0000","last_undegraded":"2024-04-25T09:06:51.759254+0000","last_fullsized":"2024-04-25T09:06:51.759254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:37.894945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773299+0000","last_change":"2024-04-25T09:06:50.776731+0000","last_active":"2024-04-25T09:06:51.773299+0000","last_peered":"2024-04-25T09:06:51.773299+0000","last_clean":"2024-04-25T09:06:51.773299+0000","last_became_active":"2024-04-25T09:06:50.776461+0000","last_became_peered":"2024-04-25T09:06:50.776461+0000","last_unstale":"2024-04-25T09:06:51.773299+0000","last_undegraded":"2024-04-25T09:06:51.773299+0000","last_fullsized":"2024-04-25T09:06:51.773299+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:17.281098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773151+0000","last_change":"2024-04-25T09:06:49.773985+0000","last_active":"2024-04-25T09:06:51.773151+0000","last_peered":"2024-04-25T09:06:51.773151+0000","last_clean":"2024-04-25T09:06:51.773151+0000","last_became_active":"2024-04-25T09:06:49.773715+0000","last_became_peered":"2024-04-25T09:06:49.773715+0000","last_unstale":"2024-04-25T09:06:51.773151+0000","last_undegraded":"2024-04-25T09:06:51.773151+0000","last_fullsized":"2024-04-25T09:06:51.773151+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:23.417984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772931+0000","last_change":"2024-04-25T09:06:50.773743+0000","last_active":"2024-04-25T09:06:51.772931+0000","last_peered":"2024-04-25T09:06:51.772931+0000","last_clean":"2024-04-25T09:06:51.772931+0000","last_became_active":"2024-04-25T09:06:50.773492+0000","last_became_peered":"2024-04-25T09:06:50.773492+0000","last_unstale":"2024-04-25T09:06:51.772931+0000","last_undegraded":"2024-04-25T09:06:51.772931+0000","last_fullsized":"2024-04-25T09:06:51.772931+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:29.172564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773031+0000","last_change":"2024-04-25T09:06:49.768143+0000","last_active":"2024-04-25T09:06:51.773031+0000","last_peered":"2024-04-25T09:06:51.773031+0000","last_clean":"2024-04-25T09:06:51.773031+0000","last_became_active":"2024-04-25T09:06:49.767483+0000","last_became_peered":"2024-04-25T09:06:49.767483+0000","last_unstale":"2024-04-25T09:06:51.773031+0000","last_undegraded":"2024-04-25T09:06:51.773031+0000","last_fullsized":"2024-04-25T09:06:51.773031+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:22.172861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772885+0000","last_change":"2024-04-25T09:06:50.762853+0000","last_active":"2024-04-25T09:06:51.772885+0000","last_peered":"2024-04-25T09:06:51.772885+0000","last_clean":"2024-04-25T09:06:51.772885+0000","last_became_active":"2024-04-25T09:06:50.762586+0000","last_became_peered":"2024-04-25T09:06:50.762586+0000","last_unstale":"2024-04-25T09:06:51.772885+0000","last_undegraded":"2024-04-25T09:06:51.772885+0000","last_fullsized":"2024-04-25T09:06:51.772885+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:54.634087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772991+0000","last_change":"2024-04-25T09:06:49.769821+0000","last_active":"2024-04-25T09:06:51.772991+0000","last_peered":"2024-04-25T09:06:51.772991+0000","last_clean":"2024-04-25T09:06:51.772991+0000","last_became_active":"2024-04-25T09:06:49.769494+0000","last_became_peered":"2024-04-25T09:06:49.769494+0000","last_unstale":"2024-04-25T09:06:51.772991+0000","last_undegraded":"2024-04-25T09:06:51.772991+0000","last_fullsized":"2024-04-25T09:06:51.772991+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:53.519331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773386+0000","last_change":"2024-04-25T09:06:50.763526+0000","last_active":"2024-04-25T09:06:51.773386+0000","last_peered":"2024-04-25T09:06:51.773386+0000","last_clean":"2024-04-25T09:06:51.773386+0000","last_became_active":"2024-04-25T09:06:50.763261+0000","last_became_peered":"2024-04-25T09:06:50.763261+0000","last_unstale":"2024-04-25T09:06:51.773386+0000","last_undegraded":"2024-04-25T09:06:51.773386+0000","last_fullsized":"2024-04-25T09:06:51.773386+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:52.422520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774013+0000","last_change":"2024-04-25T09:06:49.774665+0000","last_active":"2024-04-25T09:06:51.774013+0000","last_peered":"2024-04-25T09:06:51.774013+0000","last_clean":"2024-04-25T09:06:51.774013+0000","last_became_active":"2024-04-25T09:06:49.774262+0000","last_became_peered":"2024-04-25T09:06:49.774262+0000","last_unstale":"2024-04-25T09:06:51.774013+0000","last_undegraded":"2024-04-25T09:06:51.774013+0000","last_fullsized":"2024-04-25T09:06:51.774013+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:06.973704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.760119+0000","last_change":"2024-04-25T09:06:50.767853+0000","last_active":"2024-04-25T09:06:51.760119+0000","last_peered":"2024-04-25T09:06:51.760119+0000","last_clean":"2024-04-25T09:06:51.760119+0000","last_became_active":"2024-04-25T09:06:50.767557+0000","last_became_peered":"2024-04-25T09:06:50.767557+0000","last_unstale":"2024-04-25T09:06:51.760119+0000","last_undegraded":"2024-04-25T09:06:51.760119+0000","last_fullsized":"2024-04-25T09:06:51.760119+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:05.208292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"69'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773801+0000","last_change":"2024-04-25T09:06:49.767570+0000","last_active":"2024-04-25T09:06:51.773801+0000","last_peered":"2024-04-25T09:06:51.773801+0000","last_clean":"2024-04-25T09:06:51.773801+0000","last_became_active":"2024-04-25T09:06:49.767272+0000","last_became_peered":"2024-04-25T09:06:49.767272+0000","last_unstale":"2024-04-25T09:06:51.773801+0000","last_undegraded":"2024-04-25T09:06:51.773801+0000","last_fullsized":"2024-04-25T09:06:51.773801+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:57.658474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773706+0000","last_change":"2024-04-25T09:06:50.772573+0000","last_active":"2024-04-25T09:06:51.773706+0000","last_peered":"2024-04-25T09:06:51.773706+0000","last_clean":"2024-04-25T09:06:51.773706+0000","last_became_active":"2024-04-25T09:06:50.771236+0000","last_became_peered":"2024-04-25T09:06:50.771236+0000","last_unstale":"2024-04-25T09:06:51.773706+0000","last_undegraded":"2024-04-25T09:06:51.773706+0000","last_fullsized":"2024-04-25T09:06:51.773706+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:31.377839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773677+0000","last_change":"2024-04-25T09:06:49.777073+0000","last_active":"2024-04-25T09:06:51.773677+0000","last_peered":"2024-04-25T09:06:51.773677+0000","last_clean":"2024-04-25T09:06:51.773677+0000","last_became_active":"2024-04-25T09:06:49.776788+0000","last_became_peered":"2024-04-25T09:06:49.776788+0000","last_unstale":"2024-04-25T09:06:51.773677+0000","last_undegraded":"2024-04-25T09:06:51.773677+0000","last_fullsized":"2024-04-25T09:06:51.773677+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:39.550531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774194+0000","last_change":"2024-04-25T09:06:50.762043+0000","last_active":"2024-04-25T09:06:51.774194+0000","last_peered":"2024-04-25T09:06:51.774194+0000","last_clean":"2024-04-25T09:06:51.774194+0000","last_became_active":"2024-04-25T09:06:50.761466+0000","last_became_peered":"2024-04-25T09:06:50.761466+0000","last_unstale":"2024-04-25T09:06:51.774194+0000","last_undegraded":"2024-04-25T09:06:51.774194+0000","last_fullsized":"2024-04-25T09:06:51.774194+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:21.375288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.774063+0000","last_change":"2024-04-25T09:06:49.766342+0000","last_active":"2024-04-25T09:06:51.774063+0000","last_peered":"2024-04-25T09:06:51.774063+0000","last_clean":"2024-04-25T09:06:51.774063+0000","last_became_active":"2024-04-25T09:06:49.765839+0000","last_became_peered":"2024-04-25T09:06:49.765839+0000","last_unstale":"2024-04-25T09:06:51.774063+0000","last_undegraded":"2024-04-25T09:06:51.774063+0000","last_fullsized":"2024-04-25T09:06:51.774063+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:25.987084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.772323+0000","last_change":"2024-04-25T09:06:50.771430+0000","last_active":"2024-04-25T09:06:51.772323+0000","last_peered":"2024-04-25T09:06:51.772323+0000","last_clean":"2024-04-25T09:06:51.772323+0000","last_became_active":"2024-04-25T09:06:50.771084+0000","last_became_peered":"2024-04-25T09:06:50.771084+0000","last_unstale":"2024-04-25T09:06:51.772323+0000","last_undegraded":"2024-04-25T09:06:51.772323+0000","last_fullsized":"2024-04-25T09:06:51.772323+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:59.358584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773354+0000","last_change":"2024-04-25T09:06:49.774900+0000","last_active":"2024-04-25T09:06:51.773354+0000","last_peered":"2024-04-25T09:06:51.773354+0000","last_clean":"2024-04-25T09:06:51.773354+0000","last_became_active":"2024-04-25T09:06:49.774561+0000","last_became_peered":"2024-04-25T09:06:49.774561+0000","last_unstale":"2024-04-25T09:06:51.773354+0000","last_undegraded":"2024-04-25T09:06:51.773354+0000","last_fullsized":"2024-04-25T09:06:51.773354+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:13.917626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758914+0000","last_change":"2024-04-25T09:06:50.768915+0000","last_active":"2024-04-25T09:06:51.758914+0000","last_peered":"2024-04-25T09:06:51.758914+0000","last_clean":"2024-04-25T09:06:51.758914+0000","last_became_active":"2024-04-25T09:06:50.768661+0000","last_became_peered":"2024-04-25T09:06:50.768661+0000","last_unstale":"2024-04-25T09:06:51.758914+0000","last_undegraded":"2024-04-25T09:06:51.758914+0000","last_fullsized":"2024-04-25T09:06:51.758914+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:33.068325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758990+0000","last_change":"2024-04-25T09:06:49.770770+0000","last_active":"2024-04-25T09:06:51.758990+0000","last_peered":"2024-04-25T09:06:51.758990+0000","last_clean":"2024-04-25T09:06:51.758990+0000","last_became_active":"2024-04-25T09:06:49.769210+0000","last_became_peered":"2024-04-25T09:06:49.769210+0000","last_unstale":"2024-04-25T09:06:51.758990+0000","last_undegraded":"2024-04-25T09:06:51.758990+0000","last_fullsized":"2024-04-25T09:06:51.758990+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:02.494155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773643+0000","last_change":"2024-04-25T09:06:50.768937+0000","last_active":"2024-04-25T09:06:51.773643+0000","last_peered":"2024-04-25T09:06:51.773643+0000","last_clean":"2024-04-25T09:06:51.773643+0000","last_became_active":"2024-04-25T09:06:50.768633+0000","last_became_peered":"2024-04-25T09:06:50.768633+0000","last_unstale":"2024-04-25T09:06:51.773643+0000","last_undegraded":"2024-04-25T09:06:51.773643+0000","last_fullsized":"2024-04-25T09:06:51.773643+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:15.545199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758847+0000","last_change":"2024-04-25T09:06:49.774257+0000","last_active":"2024-04-25T09:06:51.758847+0000","last_peered":"2024-04-25T09:06:51.758847+0000","last_clean":"2024-04-25T09:06:51.758847+0000","last_became_active":"2024-04-25T09:06:49.773652+0000","last_became_peered":"2024-04-25T09:06:49.773652+0000","last_unstale":"2024-04-25T09:06:51.758847+0000","last_undegraded":"2024-04-25T09:06:51.758847+0000","last_fullsized":"2024-04-25T09:06:51.758847+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:24.720367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.760166+0000","last_change":"2024-04-25T09:06:50.769891+0000","last_active":"2024-04-25T09:06:51.760166+0000","last_peered":"2024-04-25T09:06:51.760166+0000","last_clean":"2024-04-25T09:06:51.760166+0000","last_became_active":"2024-04-25T09:06:50.767216+0000","last_became_peered":"2024-04-25T09:06:50.767216+0000","last_unstale":"2024-04-25T09:06:51.760166+0000","last_undegraded":"2024-04-25T09:06:51.760166+0000","last_fullsized":"2024-04-25T09:06:51.760166+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:32.031412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773163+0000","last_change":"2024-04-25T09:06:49.772802+0000","last_active":"2024-04-25T09:06:51.773163+0000","last_peered":"2024-04-25T09:06:51.773163+0000","last_clean":"2024-04-25T09:06:51.773163+0000","last_became_active":"2024-04-25T09:06:49.772500+0000","last_became_peered":"2024-04-25T09:06:49.772500+0000","last_unstale":"2024-04-25T09:06:51.773163+0000","last_undegraded":"2024-04-25T09:06:51.773163+0000","last_fullsized":"2024-04-25T09:06:51.773163+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:21.180550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773338+0000","last_change":"2024-04-25T09:06:50.773349+0000","last_active":"2024-04-25T09:06:51.773338+0000","last_peered":"2024-04-25T09:06:51.773338+0000","last_clean":"2024-04-25T09:06:51.773338+0000","last_became_active":"2024-04-25T09:06:50.771243+0000","last_became_peered":"2024-04-25T09:06:50.771243+0000","last_unstale":"2024-04-25T09:06:51.773338+0000","last_undegraded":"2024-04-25T09:06:51.773338+0000","last_fullsized":"2024-04-25T09:06:51.773338+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:49.745272+0000","last_clean_scrub_stamp":"2024-04-25T09:06:49.745272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:23.175599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.758677+0000","last_change":"2024-04-25T09:06:49.769307+0000","last_active":"2024-04-25T09:06:51.758677+0000","last_peered":"2024-04-25T09:06:51.758677+0000","last_clean":"2024-04-25T09:06:51.758677+0000","last_became_active":"2024-04-25T09:06:49.769036+0000","last_became_peered":"2024-04-25T09:06:49.769036+0000","last_unstale":"2024-04-25T09:06:51.758677+0000","last_undegraded":"2024-04-25T09:06:51.758677+0000","last_fullsized":"2024-04-25T09:06:51.758677+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:48.742534+0000","last_clean_scrub_stamp":"2024-04-25T09:06:48.742534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:51.419782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":258,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:06:51.773133+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:06:51.773133+0000","last_peered":"2024-04-25T09:06:51.773133+0000","last_clean":"2024-04-25T09:06:51.773133+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:06:51.773133+0000","last_undegraded":"2024-04-25T09:06:51.773133+0000","last_fullsized":"2024-04-25T09:06:51.773133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40320,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331520,"statfs":{"total":96636764160,"available":96595476480,"internally_reserved":0,"allocated":831488,"data_stored":375828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509494,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335684,"statfs":{"total":96636764160,"available":96599740416,"internally_reserved":0,"allocated":831488,"data_stored":375816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40328,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331512,"statfs":{"total":96636764160,"available":96595468288,"internally_reserved":0,"allocated":839680,"data_stored":377406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335688,"statfs":{"total":96636764160,"available":96599744512,"internally_reserved":0,"allocated":827392,"data_stored":375794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335688,"statfs":{"total":96636764160,"available":96599744512,"internally_reserved":0,"allocated":827392,"data_stored":375794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36184,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335656,"statfs":{"total":96636764160,"available":96599711744,"internally_reserved":0,"allocated":856064,"data_stored":378170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58940,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312900,"statfs":{"total":96636764160,"available":96576409600,"internally_reserved":0,"allocated":1421312,"data_stored":966162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36740,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335100,"statfs":{"total":96636764160,"available":96599142400,"internally_reserved":0,"allocated":1425408,"data_stored":960246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:06:55.197 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:06:55.197 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:06:55.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.390+0000 7f92fa000640 1 Processor -- start 2024-04-25T09:06:55.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.390+0000 7f92fa000640 1 -- start start 2024-04-25T09:06:55.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.390+0000 7f92fa000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f92f406c760 0x7f92f40b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:55.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.390+0000 7f92fa000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f92f4099a50 0x7f92f4099f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:55.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.390+0000 7f92fa000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f40b16d0 con 0x7f92f41612b0 2024-04-25T09:06:55.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.390+0000 7f92fa000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f4161690 con 0x7f92f4099a50 2024-04-25T09:06:55.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.390+0000 7f92fa000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f40d0080 con 0x7f92f406c760 2024-04-25T09:06:55.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.390+0000 7f92f9600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f92f4099a50 0x7f92f4099f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:55.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.390+0000 7f92f9600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f92f4099a50 0x7f92f4099f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53126/0 (socket says 172.21.15.173:53126) 2024-04-25T09:06:55.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.390+0000 7f92f9600640 1 -- 172.21.15.173:0/3387355191 learned_addr learned my addr 172.21.15.173:0/3387355191 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:55.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.390+0000 7f92f3e00640 1 --2- 172.21.15.173:0/3387355191 >> v2:172.21.15.194:3300/0 conn(0x7f92f406c760 0x7f92f40b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:55.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.390+0000 7f92f9600640 1 -- 172.21.15.173:0/3387355191 >> v2:172.21.15.194:3300/0 conn(0x7f92f406c760 msgr2=0x7f92f40b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:55.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.390+0000 7f92f9600640 1 --2- 172.21.15.173:0/3387355191 >> v2:172.21.15.194:3300/0 conn(0x7f92f406c760 0x7f92f40b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.390+0000 7f92f9600640 1 -- 172.21.15.173:0/3387355191 >> v1:172.21.15.194:6789/0 conn(0x7f92f41612b0 legacy=0x7f92f40b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.390+0000 7f92f9600640 1 -- 172.21.15.173:0/3387355191 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f406ccb0 con 0x7f92f4099a50 2024-04-25T09:06:55.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.390+0000 7f92f3e00640 1 --2- 172.21.15.173:0/3387355191 >> v2:172.21.15.194:3300/0 conn(0x7f92f406c760 0x7f92f40b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:55.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.394+0000 7f92f9600640 1 --2- 172.21.15.173:0/3387355191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92f4099a50 0x7f92f4099f00 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f92f406df80 tx=0x7f92ec01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61f40d9433b2570 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:55.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.394+0000 7f92f3400640 1 -- 172.21.15.173:0/3387355191 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0ab610 con 0x7f92f4099a50 2024-04-25T09:06:55.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.394+0000 7f92f3400640 1 -- 172.21.15.173:0/3387355191 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec0b0070 con 0x7f92f4099a50 2024-04-25T09:06:55.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.394+0000 7f92f3400640 1 -- 172.21.15.173:0/3387355191 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0ab9d0 con 0x7f92f4099a50 2024-04-25T09:06:55.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.394+0000 7f92fa000640 1 -- 172.21.15.173:0/3387355191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92f4099a50 msgr2=0x7f92f4099f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.394+0000 7f92fa000640 1 --2- 172.21.15.173:0/3387355191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92f4099a50 0x7f92f4099f00 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f92f406df80 tx=0x7f92ec01c520 comp rx=0 tx=0).stop 2024-04-25T09:06:55.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.394+0000 7f92fa000640 1 -- 172.21.15.173:0/3387355191 shutdown_connections 2024-04-25T09:06:55.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.394+0000 7f92fa000640 1 --2- 172.21.15.173:0/3387355191 >> v2:172.21.15.194:3300/0 conn(0x7f92f406c760 0x7f92f40b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.394+0000 7f92fa000640 1 --2- 172.21.15.173:0/3387355191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92f4099a50 0x7f92f4099f00 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.394+0000 7f92fa000640 1 -- 172.21.15.173:0/3387355191 >> 172.21.15.173:0/3387355191 conn(0x7f92f40b3260 msgr2=0x7f92f40b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:55.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.394+0000 7f92fa000640 1 -- 172.21.15.173:0/3387355191 shutdown_connections 2024-04-25T09:06:55.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.394+0000 7f92fa000640 1 -- 172.21.15.173:0/3387355191 wait complete. 2024-04-25T09:06:55.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92fa000640 1 Processor -- start 2024-04-25T09:06:55.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92fa000640 1 -- start start 2024-04-25T09:06:55.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92fa000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92f406c760 0x7f92f40c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:55.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92fa000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92f4099a50 0x7f92f414c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:55.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92fa000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92f41612b0 0x7f92f4160360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:55.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92fa000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f409b140 con 0x7f92f41612b0 2024-04-25T09:06:55.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92fa000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f409afc0 con 0x7f92f406c760 2024-04-25T09:06:55.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92fa000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f40d0d00 con 0x7f92f4099a50 2024-04-25T09:06:55.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92f9600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92f41612b0 0x7f92f4160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:55.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92f9600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92f41612b0 0x7f92f4160360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53140/0 (socket says 172.21.15.173:53140) 2024-04-25T09:06:55.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92f9600640 1 -- 172.21.15.173:0/467630359 learned_addr learned my addr 172.21.15.173:0/467630359 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:55.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92f8c00640 1 --2- 172.21.15.173:0/467630359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92f406c760 0x7f92f40c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:55.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92f3e00640 1 --2- 172.21.15.173:0/467630359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92f4099a50 0x7f92f414c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:55.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92f9600640 1 -- 172.21.15.173:0/467630359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92f4099a50 msgr2=0x7f92f414c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92f9600640 1 --2- 172.21.15.173:0/467630359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92f4099a50 0x7f92f414c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92f9600640 1 -- 172.21.15.173:0/467630359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92f406c760 msgr2=0x7f92f40c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92f9600640 1 --2- 172.21.15.173:0/467630359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92f406c760 0x7f92f40c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92f9600640 1 -- 172.21.15.173:0/467630359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f40afc40 con 0x7f92f41612b0 2024-04-25T09:06:55.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92f9600640 1 --2- 172.21.15.173:0/467630359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92f41612b0 0x7f92f4160360 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f92ec01a150 tx=0x7f92ec01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:55.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92f0c00640 1 -- 172.21.15.173:0/467630359 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0be5f0 con 0x7f92f41612b0 2024-04-25T09:06:55.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92f0c00640 1 -- 172.21.15.173:0/467630359 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec0be7b0 con 0x7f92f41612b0 2024-04-25T09:06:55.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92f0c00640 1 -- 172.21.15.173:0/467630359 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0beba0 con 0x7f92f41612b0 2024-04-25T09:06:55.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92fa000640 1 -- 172.21.15.173:0/467630359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f40aff20 con 0x7f92f41612b0 2024-04-25T09:06:55.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.398+0000 7f92fa000640 1 -- 172.21.15.173:0/467630359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f414cf10 con 0x7f92f41612b0 2024-04-25T09:06:55.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.402+0000 7f92fa000640 1 -- 172.21.15.173:0/467630359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f409a830 con 0x7f92f41612b0 2024-04-25T09:06:55.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.402+0000 7f92f0c00640 1 -- 172.21.15.173:0/467630359 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f92ec0b43f0 con 0x7f92f41612b0 2024-04-25T09:06:55.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.402+0000 7f92f0c00640 1 --2- 172.21.15.173:0/467630359 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92d4066f90 0x7f92d4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:55.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.402+0000 7f92f0c00640 1 -- 172.21.15.173:0/467630359 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f92ec11fb10 con 0x7f92f41612b0 2024-04-25T09:06:55.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.402+0000 7f92f8c00640 1 --2- 172.21.15.173:0/467630359 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92d4066f90 0x7f92d4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:55.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.402+0000 7f92f8c00640 1 --2- 172.21.15.173:0/467630359 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92d4066f90 0x7f92d4069450 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f92e4001e00 tx=0x7f92e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:55.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.406+0000 7f92f0c00640 1 -- 172.21.15.173:0/467630359 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f92ec0a8050 con 0x7f92f41612b0 2024-04-25T09:06:55.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.610+0000 7f92fa000640 1 -- 172.21.15.173:0/467630359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f92f40b3fc0 con 0x7f92f41612b0 2024-04-25T09:06:55.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.614+0000 7f92f0c00640 1 -- 172.21.15.173:0/467630359 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f92ec016110 con 0x7f92f41612b0 2024-04-25T09:06:55.603 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2024-04-25T09:06:55.603 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w== 2024-04-25T09:06:55.603 INFO:teuthology.orchestra.run.smithi173.stdout: caps mds = "allow" 2024-04-25T09:06:55.603 INFO:teuthology.orchestra.run.smithi173.stdout: caps mon = "allow r" 2024-04-25T09:06:55.603 INFO:teuthology.orchestra.run.smithi173.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:06:55.603 INFO:teuthology.orchestra.run.smithi173.stderr:updated caps for client.0 2024-04-25T09:06:55.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.618+0000 7f92fa000640 1 -- 172.21.15.173:0/467630359 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92d4066f90 msgr2=0x7f92d4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.618+0000 7f92fa000640 1 --2- 172.21.15.173:0/467630359 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92d4066f90 0x7f92d4069450 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f92e4001e00 tx=0x7f92e4009040 comp rx=0 tx=0).stop 2024-04-25T09:06:55.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.618+0000 7f92fa000640 1 -- 172.21.15.173:0/467630359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92f41612b0 msgr2=0x7f92f4160360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.618+0000 7f92fa000640 1 --2- 172.21.15.173:0/467630359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92f41612b0 0x7f92f4160360 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f92ec01a150 tx=0x7f92ec01ad60 comp rx=0 tx=0).stop 2024-04-25T09:06:55.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.618+0000 7f92fa000640 1 -- 172.21.15.173:0/467630359 shutdown_connections 2024-04-25T09:06:55.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.618+0000 7f92fa000640 1 --2- 172.21.15.173:0/467630359 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92d4066f90 0x7f92d4069450 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.618+0000 7f92fa000640 1 --2- 172.21.15.173:0/467630359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92f41612b0 0x7f92f4160360 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.618+0000 7f92fa000640 1 --2- 172.21.15.173:0/467630359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92f4099a50 0x7f92f414c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.618+0000 7f92fa000640 1 --2- 172.21.15.173:0/467630359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92f406c760 0x7f92f40c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.618+0000 7f92fa000640 1 -- 172.21.15.173:0/467630359 >> 172.21.15.173:0/467630359 conn(0x7f92f40b3260 msgr2=0x7f92f406c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:55.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.618+0000 7f92fa000640 1 -- 172.21.15.173:0/467630359 shutdown_connections 2024-04-25T09:06:55.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.618+0000 7f92fa000640 1 -- 172.21.15.173:0/467630359 wait complete. 2024-04-25T09:06:55.624 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:55.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.770+0000 7f9772800640 1 Processor -- start 2024-04-25T09:06:55.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.770+0000 7f9772800640 1 -- start start 2024-04-25T09:06:55.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.774+0000 7f9772800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f976c15a180 0x7f976c0b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:55.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.774+0000 7f9772800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f976c0ccf20 0x7f976c071320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:55.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.774+0000 7f9772800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976c0cd390 con 0x7f976c0b2ca0 2024-04-25T09:06:55.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.774+0000 7f9772800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f976c0af230 con 0x7f976c15a180 2024-04-25T09:06:55.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.774+0000 7f9772800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976c0cfdb0 con 0x7f976c0ccf20 2024-04-25T09:06:55.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.774+0000 7f976b400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f976c0b2ca0 0x7f976c0cf6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:35220/0 (socket says 172.21.15.173:35220) 2024-04-25T09:06:55.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.774+0000 7f976b400640 1 -- 172.21.15.173:0/3389929388 learned_addr learned my addr 172.21.15.173:0/3389929388 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:55.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.774+0000 7f976aa00640 1 --2- 172.21.15.173:0/3389929388 >> v2:172.21.15.194:3300/0 conn(0x7f976c15a180 0x7f976c0b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:55.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.774+0000 7f976be00640 1 --2- 172.21.15.173:0/3389929388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f976c0ccf20 0x7f976c071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:55.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.774+0000 7f976a000640 1 -- 172.21.15.173:0/3389929388 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179859271 0 0) 0x7f976c0cd390 con 0x7f976c0b2ca0 2024-04-25T09:06:55.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.774+0000 7f976a000640 1 -- 172.21.15.173:0/3389929388 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9750003530 con 0x7f976c0b2ca0 2024-04-25T09:06:55.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.774+0000 7f976aa00640 1 -- 172.21.15.173:0/3389929388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f976c0ccf20 msgr2=0x7f976c071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:55.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.774+0000 7f976aa00640 1 --2- 172.21.15.173:0/3389929388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f976c0ccf20 0x7f976c071320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.774+0000 7f976aa00640 1 -- 172.21.15.173:0/3389929388 >> v1:172.21.15.173:6789/0 conn(0x7f976c0b2ca0 legacy=0x7f976c0cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.774+0000 7f976aa00640 1 -- 172.21.15.173:0/3389929388 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c06e860 con 0x7f976c15a180 2024-04-25T09:06:55.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.774+0000 7f976be00640 1 --2- 172.21.15.173:0/3389929388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f976c0ccf20 0x7f976c071320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:55.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.778+0000 7f976aa00640 1 --2- 172.21.15.173:0/3389929388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f976c15a180 0x7f976c0b40e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f97580097c0 tx=0x7f975801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbf096017050eee7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:55.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.778+0000 7f976a000640 1 -- 172.21.15.173:0/3389929388 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97580b0070 con 0x7f976c15a180 2024-04-25T09:06:55.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.778+0000 7f976a000640 1 -- 172.21.15.173:0/3389929388 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97580ab600 con 0x7f976c15a180 2024-04-25T09:06:55.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.778+0000 7f976a000640 1 -- 172.21.15.173:0/3389929388 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97580ab9b0 con 0x7f976c15a180 2024-04-25T09:06:55.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.778+0000 7f9772800640 1 -- 172.21.15.173:0/3389929388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f976c15a180 msgr2=0x7f976c0b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.778+0000 7f9772800640 1 --2- 172.21.15.173:0/3389929388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f976c15a180 0x7f976c0b40e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f97580097c0 tx=0x7f975801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.778+0000 7f9772800640 1 -- 172.21.15.173:0/3389929388 shutdown_connections 2024-04-25T09:06:55.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.778+0000 7f9772800640 1 --2- 172.21.15.173:0/3389929388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f976c0ccf20 0x7f976c071320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.778+0000 7f9772800640 1 --2- 172.21.15.173:0/3389929388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f976c15a180 0x7f976c0b40e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.778+0000 7f9772800640 1 -- 172.21.15.173:0/3389929388 >> 172.21.15.173:0/3389929388 conn(0x7f976c06ac90 msgr2=0x7f976c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:55.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.778+0000 7f9772800640 1 -- 172.21.15.173:0/3389929388 shutdown_connections 2024-04-25T09:06:55.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.778+0000 7f9772800640 1 -- 172.21.15.173:0/3389929388 wait complete. 2024-04-25T09:06:55.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.778+0000 7f9772800640 1 Processor -- start 2024-04-25T09:06:55.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f9772800640 1 -- start start 2024-04-25T09:06:55.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f9772800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f976c0b2ca0 0x7f976c14fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:55.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f9772800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f976c0ccf20 0x7f976c14d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:55.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f9772800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f976c15a180 0x7f976c0ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:55.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f9772800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c06dfd0 con 0x7f976c0ccf20 2024-04-25T09:06:55.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f9772800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c06de50 con 0x7f976c15a180 2024-04-25T09:06:55.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f9772800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976c06e150 con 0x7f976c0b2ca0 2024-04-25T09:06:55.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f976aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f976c0ccf20 0x7f976c14d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:55.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f976aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f976c0ccf20 0x7f976c14d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53156/0 (socket says 172.21.15.173:53156) 2024-04-25T09:06:55.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f976aa00640 1 -- 172.21.15.173:0/3154189198 learned_addr learned my addr 172.21.15.173:0/3154189198 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:55.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f976b400640 1 --2- 172.21.15.173:0/3154189198 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f976c0b2ca0 0x7f976c14fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:55.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f976be00640 1 --2- 172.21.15.173:0/3154189198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f976c15a180 0x7f976c0ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:55.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f976aa00640 1 -- 172.21.15.173:0/3154189198 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f976c0b2ca0 msgr2=0x7f976c14fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f976aa00640 1 --2- 172.21.15.173:0/3154189198 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f976c0b2ca0 0x7f976c14fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f976aa00640 1 -- 172.21.15.173:0/3154189198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f976c15a180 msgr2=0x7f976c0ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f976aa00640 1 --2- 172.21.15.173:0/3154189198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f976c15a180 0x7f976c0ce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f976aa00640 1 -- 172.21.15.173:0/3154189198 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c14dd00 con 0x7f976c0ccf20 2024-04-25T09:06:55.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f976aa00640 1 --2- 172.21.15.173:0/3154189198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f976c0ccf20 0x7f976c14d7c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f975801a0d0 tx=0x7f9758019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:55.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f9763400640 1 -- 172.21.15.173:0/3154189198 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97580ba070 con 0x7f976c0ccf20 2024-04-25T09:06:55.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f9763400640 1 -- 172.21.15.173:0/3154189198 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97580ab7b0 con 0x7f976c0ccf20 2024-04-25T09:06:55.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f9763400640 1 -- 172.21.15.173:0/3154189198 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97580b0040 con 0x7f976c0ccf20 2024-04-25T09:06:55.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f9772800640 1 -- 172.21.15.173:0/3154189198 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976c150640 con 0x7f976c0ccf20 2024-04-25T09:06:55.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f9772800640 1 -- 172.21.15.173:0/3154189198 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976c0cd900 con 0x7f976c0ccf20 2024-04-25T09:06:55.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.782+0000 7f9772800640 1 -- 172.21.15.173:0/3154189198 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976c073a40 con 0x7f976c0ccf20 2024-04-25T09:06:55.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.786+0000 7f9763400640 1 -- 172.21.15.173:0/3154189198 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f97580bd070 con 0x7f976c0ccf20 2024-04-25T09:06:55.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.786+0000 7f9763400640 1 --2- 172.21.15.173:0/3154189198 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f974c066f60 0x7f974c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:55.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.786+0000 7f9763400640 1 -- 172.21.15.173:0/3154189198 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f975811e210 con 0x7f976c0ccf20 2024-04-25T09:06:55.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.786+0000 7f976b400640 1 --2- 172.21.15.173:0/3154189198 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f974c066f60 0x7f974c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:55.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.786+0000 7f976b400640 1 --2- 172.21.15.173:0/3154189198 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f974c066f60 0x7f974c069420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f976c071480 tx=0x7f975c000bd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:55.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.790+0000 7f9763400640 1 -- 172.21.15.173:0/3154189198 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9758016090 con 0x7f976c0ccf20 2024-04-25T09:06:55.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.974+0000 7f9772800640 1 -- 172.21.15.173:0/3154189198 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f976c0720f0 con 0x7f976c0ccf20 2024-04-25T09:06:55.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.974+0000 7f9763400640 1 -- 172.21.15.173:0/3154189198 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4945 (secure 0 0 0) 0x7f97580ee9a0 con 0x7f976c0ccf20 2024-04-25T09:06:55.963 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:55.963 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5873,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1118362753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":1118362753},{"type":"v1","addr":"172.21.15.173:6837","nonce":1118362753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6340,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/853427023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":853427023},{"type":"v1","addr":"172.21.15.194:6834","nonce":853427023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6343,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2791623450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2791623450},{"type":"v1","addr":"172.21.15.194:6835","nonce":2791623450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:50.132659+0000","modified":"2024-04-25T09:06:53.143192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6711":{"gid":6711,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6836/962695208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":962695208},{"type":"v1","addr":"172.21.15.173:6836","nonce":962695208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:06:55.963 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 39 2024-04-25T09:06:55.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.978+0000 7f9772800640 1 -- 172.21.15.173:0/3154189198 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f974c066f60 msgr2=0x7f974c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.978+0000 7f9772800640 1 --2- 172.21.15.173:0/3154189198 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f974c066f60 0x7f974c069420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f976c071480 tx=0x7f975c000bd0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.978+0000 7f9772800640 1 -- 172.21.15.173:0/3154189198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f976c0ccf20 msgr2=0x7f976c14d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.978+0000 7f9772800640 1 --2- 172.21.15.173:0/3154189198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f976c0ccf20 0x7f976c14d7c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f975801a0d0 tx=0x7f9758019240 comp rx=0 tx=0).stop 2024-04-25T09:06:55.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.978+0000 7f9772800640 1 -- 172.21.15.173:0/3154189198 shutdown_connections 2024-04-25T09:06:55.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.978+0000 7f9772800640 1 --2- 172.21.15.173:0/3154189198 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f974c066f60 0x7f974c069420 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.978+0000 7f9772800640 1 --2- 172.21.15.173:0/3154189198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f976c15a180 0x7f976c0ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.978+0000 7f9772800640 1 --2- 172.21.15.173:0/3154189198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f976c0ccf20 0x7f976c14d7c0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.978+0000 7f9772800640 1 --2- 172.21.15.173:0/3154189198 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f976c0b2ca0 0x7f976c14fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.978+0000 7f9772800640 1 -- 172.21.15.173:0/3154189198 >> 172.21.15.173:0/3154189198 conn(0x7f976c06ac90 msgr2=0x7f976c0af3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:55.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.978+0000 7f9772800640 1 -- 172.21.15.173:0/3154189198 shutdown_connections 2024-04-25T09:06:55.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:55.978+0000 7f9772800640 1 -- 172.21.15.173:0/3154189198 wait complete. 2024-04-25T09:06:56.386 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:06:50.132659+0000', 'modified': '2024-04-25T09:06:53.143192+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6711}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6711': {'gid': 6711, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.173:6836/962695208', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6834', 'nonce': 962695208}, {'type': 'v1', 'addr': '172.21.15.173:6836', 'nonce': 962695208}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:06:56.386 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:06:56.386 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:06:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.538+0000 7f8df9800640 1 Processor -- start 2024-04-25T09:06:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.538+0000 7f8df9800640 1 -- start start 2024-04-25T09:06:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.538+0000 7f8df9800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8df40cc7e0 0x7f8df40cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.538+0000 7f8df9800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8df40aef70 0x7f8df40ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.538+0000 7f8df9800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df4071570 con 0x7f8df40aeb90 2024-04-25T09:06:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.538+0000 7f8df9800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df4071320 con 0x7f8df40cc7e0 2024-04-25T09:06:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.538+0000 7f8df9800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df4072330 con 0x7f8df40aef70 2024-04-25T09:06:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.538+0000 7f8df2000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8df40cc7e0 0x7f8df40cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.538+0000 7f8df2000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8df40cc7e0 0x7f8df40cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53168/0 (socket says 172.21.15.173:53168) 2024-04-25T09:06:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.538+0000 7f8df2000640 1 -- 172.21.15.173:0/775543520 learned_addr learned my addr 172.21.15.173:0/775543520 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.538+0000 7f8df2a00640 1 --1- 172.21.15.173:0/775543520 >> v1:172.21.15.173:6789/0 conn(0x7f8df40aeb90 0x7f8df40cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:35236/0 (socket says 172.21.15.173:35236) 2024-04-25T09:06:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.538+0000 7f8df3400640 1 --2- 172.21.15.173:0/775543520 >> v2:172.21.15.194:3300/0 conn(0x7f8df40aef70 0x7f8df40ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.538+0000 7f8df2000640 1 -- 172.21.15.173:0/775543520 >> v2:172.21.15.194:3300/0 conn(0x7f8df40aef70 msgr2=0x7f8df40ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.538+0000 7f8df2000640 1 --2- 172.21.15.173:0/775543520 >> v2:172.21.15.194:3300/0 conn(0x7f8df40aef70 0x7f8df40ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.538+0000 7f8df2000640 1 -- 172.21.15.173:0/775543520 >> v1:172.21.15.173:6789/0 conn(0x7f8df40aeb90 legacy=0x7f8df40cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.538+0000 7f8df2000640 1 -- 172.21.15.173:0/775543520 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df4071850 con 0x7f8df40cc7e0 2024-04-25T09:06:56.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.542+0000 7f8df2000640 1 --2- 172.21.15.173:0/775543520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8df40cc7e0 0x7f8df40cdba0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f8df41555a0 tx=0x7f8de001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185b2d9832b09238 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.542+0000 7f8df1600640 1 -- 172.21.15.173:0/775543520 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00b0070 con 0x7f8df40cc7e0 2024-04-25T09:06:56.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.542+0000 7f8df1600640 1 -- 172.21.15.173:0/775543520 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de00ab600 con 0x7f8df40cc7e0 2024-04-25T09:06:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.542+0000 7f8df1600640 1 -- 172.21.15.173:0/775543520 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00ab9d0 con 0x7f8df40cc7e0 2024-04-25T09:06:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.542+0000 7f8df9800640 1 -- 172.21.15.173:0/775543520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8df40cc7e0 msgr2=0x7f8df40cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.542+0000 7f8df9800640 1 --2- 172.21.15.173:0/775543520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8df40cc7e0 0x7f8df40cdba0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f8df41555a0 tx=0x7f8de001c490 comp rx=0 tx=0).stop 2024-04-25T09:06:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.542+0000 7f8df9800640 1 -- 172.21.15.173:0/775543520 shutdown_connections 2024-04-25T09:06:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.542+0000 7f8df9800640 1 --2- 172.21.15.173:0/775543520 >> v2:172.21.15.194:3300/0 conn(0x7f8df40aef70 0x7f8df40ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.542+0000 7f8df9800640 1 --2- 172.21.15.173:0/775543520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8df40cc7e0 0x7f8df40cdba0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.542+0000 7f8df9800640 1 -- 172.21.15.173:0/775543520 >> 172.21.15.173:0/775543520 conn(0x7f8df406ac90 msgr2=0x7f8df406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.542+0000 7f8df9800640 1 -- 172.21.15.173:0/775543520 shutdown_connections 2024-04-25T09:06:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.542+0000 7f8df9800640 1 -- 172.21.15.173:0/775543520 wait complete. 2024-04-25T09:06:56.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df9800640 1 Processor -- start 2024-04-25T09:06:56.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df9800640 1 -- start start 2024-04-25T09:06:56.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df9800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8df40aeb90 0x7f8df4151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df9800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8df40aef70 0x7f8df40af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df9800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8df40cc7e0 0x7f8df40cd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df9800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df415bb30 con 0x7f8df40aef70 2024-04-25T09:06:56.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df9800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df415b9b0 con 0x7f8df40cc7e0 2024-04-25T09:06:56.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df9800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df415bcb0 con 0x7f8df40aeb90 2024-04-25T09:06:56.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df2000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8df40aef70 0x7f8df40af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df2000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8df40aef70 0x7f8df40af3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53180/0 (socket says 172.21.15.173:53180) 2024-04-25T09:06:56.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df2000640 1 -- 172.21.15.173:0/3232869765 learned_addr learned my addr 172.21.15.173:0/3232869765 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:56.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df2000640 1 -- 172.21.15.173:0/3232869765 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8df40aeb90 msgr2=0x7f8df4151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df2000640 1 --2- 172.21.15.173:0/3232869765 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8df40aeb90 0x7f8df4151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df2000640 1 -- 172.21.15.173:0/3232869765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8df40cc7e0 msgr2=0x7f8df40cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df2000640 1 --2- 172.21.15.173:0/3232869765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8df40cc7e0 0x7f8df40cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df2000640 1 -- 172.21.15.173:0/3232869765 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df414f320 con 0x7f8df40aef70 2024-04-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df2000640 1 --2- 172.21.15.173:0/3232869765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8df40aef70 0x7f8df40af3e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8de00ae040 tx=0x7f8de0019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8deaa00640 1 -- 172.21.15.173:0/3232869765 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00b9070 con 0x7f8df40aef70 2024-04-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8deaa00640 1 -- 172.21.15.173:0/3232869765 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de00b4400 con 0x7f8df40aef70 2024-04-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df9800640 1 -- 172.21.15.173:0/3232869765 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df40b1c60 con 0x7f8df40aef70 2024-04-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8deaa00640 1 -- 172.21.15.173:0/3232869765 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00b0040 con 0x7f8df40aef70 2024-04-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.546+0000 7f8df9800640 1 -- 172.21.15.173:0/3232869765 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df40b2220 con 0x7f8df40aef70 2024-04-25T09:06:56.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.550+0000 7f8deaa00640 1 -- 172.21.15.173:0/3232869765 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8de00bc070 con 0x7f8df40aef70 2024-04-25T09:06:56.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.550+0000 7f8deaa00640 1 --2- 172.21.15.173:0/3232869765 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8dd4066f60 0x7f8dd4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.550+0000 7f8deaa00640 1 -- 172.21.15.173:0/3232869765 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8de011e290 con 0x7f8df40aef70 2024-04-25T09:06:56.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.550+0000 7f8df2a00640 1 --2- 172.21.15.173:0/3232869765 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8dd4066f60 0x7f8dd4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.550+0000 7f8dfcd18000 1 Processor -- start 2024-04-25T09:06:56.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.550+0000 7f8dfcd18000 1 -- start start 2024-04-25T09:06:56.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.550+0000 7f8df2a00640 1 --2- 172.21.15.173:0/3232869765 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8dd4066f60 0x7f8dd4069420 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8df40af3b0 tx=0x7f8de40079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 0x5564b638fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b6390240 0x5564b63459f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6345f30 0x5564b6346310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564b622d5f0 con 0x5564b638f920 2024-04-25T09:06:56.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564b6194da0 con 0x5564b6390240 2024-04-25T09:06:56.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5564b611d150 con 0x5564b6345f30 2024-04-25T09:06:56.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8df2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 0x5564b638fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8df2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 0x5564b638fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53188/0 (socket says 172.21.15.173:53188) 2024-04-25T09:06:56.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8df2a00640 1 -- 172.21.15.173:0/3392599906 learned_addr learned my addr 172.21.15.173:0/3392599906 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:56.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8df2000640 1 --2- 172.21.15.173:0/3392599906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b6390240 0x5564b63459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8df3400640 1 --2- 172.21.15.173:0/3392599906 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6345f30 0x5564b6346310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8df2a00640 1 -- 172.21.15.173:0/3392599906 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6345f30 msgr2=0x5564b6346310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8df2a00640 1 --2- 172.21.15.173:0/3392599906 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6345f30 0x5564b6346310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8df2a00640 1 -- 172.21.15.173:0/3392599906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b6390240 msgr2=0x5564b63459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8df2a00640 1 --2- 172.21.15.173:0/3392599906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b6390240 0x5564b63459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8df2a00640 1 -- 172.21.15.173:0/3392599906 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564b6136ca0 con 0x5564b638f920 2024-04-25T09:06:56.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8df3400640 1 --2- 172.21.15.173:0/3392599906 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6345f30 0x5564b6346310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:56.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8df2a00640 1 --2- 172.21.15.173:0/3392599906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 0x5564b638fd00 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f8de4007580 tx=0x7f8de400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad33c3e48e374c67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8ddf400640 1 -- 172.21.15.173:0/3392599906 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de4007670 con 0x5564b638f920 2024-04-25T09:06:56.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8ddf400640 1 -- 172.21.15.173:0/3392599906 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de4005c90 con 0x5564b638f920 2024-04-25T09:06:56.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8ddf400640 1 -- 172.21.15.173:0/3392599906 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de4016b70 con 0x5564b638f920 2024-04-25T09:06:56.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 -- 172.21.15.173:0/3392599906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 msgr2=0x5564b638fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/3392599906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 0x5564b638fd00 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f8de4007580 tx=0x7f8de400f000 comp rx=0 tx=0).stop 2024-04-25T09:06:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 -- 172.21.15.173:0/3392599906 shutdown_connections 2024-04-25T09:06:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/3392599906 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6345f30 0x5564b6346310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/3392599906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b6390240 0x5564b63459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/3392599906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 0x5564b638fd00 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 -- 172.21.15.173:0/3392599906 >> 172.21.15.173:0/3392599906 conn(0x5564b634c2a0 msgr2=0x5564b63442d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 -- 172.21.15.173:0/3392599906 shutdown_connections 2024-04-25T09:06:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 -- 172.21.15.173:0/3392599906 wait complete. 2024-04-25T09:06:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 -- start start 2024-04-25T09:06:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 Processor -- start 2024-04-25T09:06:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b6345f30 0x5564b6396cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 0x5564b6397230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.554+0000 7f8dfcd18000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6390240 0x5564b6349aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564b614f990 con 0x5564b638f920 2024-04-25T09:06:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564b6190e40 con 0x5564b6345f30 2024-04-25T09:06:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5564b6120900 con 0x5564b6390240 2024-04-25T09:06:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 10 client.0 _ll_register_callbacks cb 0x5564b62481c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8df2000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 0x5564b6397230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8df2000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 0x5564b6397230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53192/0 (socket says 172.21.15.173:53192) 2024-04-25T09:06:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8df2000640 1 -- 172.21.15.173:0/3737289206 learned_addr learned my addr 172.21.15.173:0/3737289206 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8df2a00640 1 --2- 172.21.15.173:0/3737289206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b6345f30 0x5564b6396cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8df3400640 1 --2- 172.21.15.173:0/3737289206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6390240 0x5564b6349aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8df2000640 1 -- 172.21.15.173:0/3737289206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6390240 msgr2=0x5564b6349aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8df2000640 1 --2- 172.21.15.173:0/3737289206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6390240 0x5564b6349aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8df2000640 1 -- 172.21.15.173:0/3737289206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b6345f30 msgr2=0x5564b6396cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8df2000640 1 --2- 172.21.15.173:0/3737289206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b6345f30 0x5564b6396cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8df2000640 1 -- 172.21.15.173:0/3737289206 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564b614d630 con 0x5564b638f920 2024-04-25T09:06:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8df2000640 1 --2- 172.21.15.173:0/3737289206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 0x5564b6397230 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f8de001ca00 tx=0x7f8de00eea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3814ad18caca0f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dd3e00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dd3e00640 1 -- 172.21.15.173:0/3737289206 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00eedd0 con 0x5564b638f920 2024-04-25T09:06:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dd3e00640 1 -- 172.21.15.173:0/3737289206 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8de00f6bf0 con 0x5564b638f920 2024-04-25T09:06:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 1 -- 172.21.15.173:0/3737289206 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8de4005c90 con 0x5564b638f920 2024-04-25T09:06:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dd3e00640 1 -- 172.21.15.173:0/3737289206 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8de00f6e30 con 0x5564b638f920 2024-04-25T09:06:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 10 client.6858 fetch_fsmap learned FSMap version 39 2024-04-25T09:06:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 1 -- 172.21.15.173:0/3737289206 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x5564b611d3a0 con 0x5564b638f920 2024-04-25T09:06:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dd3e00640 1 -- 172.21.15.173:0/3737289206 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de4005c90 con 0x5564b638f920 2024-04-25T09:06:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dd3e00640 1 -- 172.21.15.173:0/3737289206 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 39) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8de00eddc0 con 0x5564b638f920 2024-04-25T09:06:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 10 client.6858 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T09:06:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 10 client.6858 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:06:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 20 client.6858 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/3737289206 >> [v2:172.21.15.173:6834/962695208,v1:172.21.15.173:6836/962695208] conn(0x5564b634b160 0x5564b63a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 4 client.6858 mds_command: new command op to 6711 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 1 -- 172.21.15.173:0/3737289206 --> [v2:172.21.15.173:6834/962695208,v1:172.21.15.173:6836/962695208] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5564b6130a50 con 0x5564b634b160 2024-04-25T09:06:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8df2a00640 1 --2- 172.21.15.173:0/3737289206 >> [v2:172.21.15.173:6834/962695208,v1:172.21.15.173:6836/962695208] conn(0x5564b634b160 0x5564b63a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8df2a00640 1 --2- 172.21.15.173:0/3737289206 >> [v2:172.21.15.173:6834/962695208,v1:172.21.15.173:6836/962695208] conn(0x5564b634b160 0x5564b63a0d50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50a4a3f48f7edb7e server_cookie=5c599b600c6a6f13 in_seq=0 out_seq=0 2024-04-25T09:06:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dd3e00640 10 client.6858 ms_handle_connect on v2:172.21.15.173:6834/962695208 2024-04-25T09:06:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dd3e00640 1 -- 172.21.15.173:0/3737289206 <== mds.0 v2:172.21.15.173:6834/962695208 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5564b6130a50 con 0x5564b634b160 2024-04-25T09:06:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dd3e00640 10 client.6858 handle_command_reply: tid=0 2024-04-25T09:06:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 1 client.6858 shutdown 2024-04-25T09:06:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 1 -- 172.21.15.173:0/3737289206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 msgr2=0x5564b6397230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/3737289206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 0x5564b6397230 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f8de001ca00 tx=0x7f8de00eea30 comp rx=0 tx=0).stop 2024-04-25T09:06:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 1 -- 172.21.15.173:0/3737289206 shutdown_connections 2024-04-25T09:06:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/3737289206 >> [v2:172.21.15.173:6834/962695208,v1:172.21.15.173:6836/962695208] conn(0x5564b634b160 0x5564b63a0d50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/3737289206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6390240 0x5564b6349aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/3737289206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 0x5564b6397230 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dd3e00640 0 client.6858 ms_handle_reset on v2:172.21.15.173:6834/962695208 2024-04-25T09:06:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/3737289206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b6345f30 0x5564b6396cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 1 -- 172.21.15.173:0/3737289206 >> 172.21.15.173:0/3737289206 conn(0x5564b634c2a0 msgr2=0x5564b63449e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:56.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 1 -- 172.21.15.173:0/3737289206 shutdown_connections 2024-04-25T09:06:56.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 1 -- 172.21.15.173:0/3737289206 wait complete. 2024-04-25T09:06:56.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.558+0000 7f8dfcd18000 20 client.6858 trim_cache size 0 max 16384 2024-04-25T09:06:56.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.574+0000 7f8dfcd18000 1 Processor -- start 2024-04-25T09:06:56.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.574+0000 7f8dfcd18000 1 -- start start 2024-04-25T09:06:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.574+0000 7f8dfcd18000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6345f30 0x5564b63eaa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.574+0000 7f8dfcd18000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 0x5564b63eaf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.574+0000 7f8dfcd18000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b6390240 0x5564b63eb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.574+0000 7f8dfcd18000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df4202570 con 0x5564b638f920 2024-04-25T09:06:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.574+0000 7f8dfcd18000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df41504d0 con 0x5564b6390240 2024-04-25T09:06:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.574+0000 7f8dfcd18000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df4150ad0 con 0x5564b6345f30 2024-04-25T09:06:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.574+0000 7f8df2000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 0x5564b63eaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.574+0000 7f8df2000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 0x5564b63eaf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53194/0 (socket says 172.21.15.173:53194) 2024-04-25T09:06:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.574+0000 7f8df2000640 1 -- 172.21.15.173:0/357907367 learned_addr learned my addr 172.21.15.173:0/357907367 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df2a00640 1 --2- 172.21.15.173:0/357907367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6345f30 0x5564b63eaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df3400640 1 --2- 172.21.15.173:0/357907367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b6390240 0x5564b63eb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df2000640 1 -- 172.21.15.173:0/357907367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6345f30 msgr2=0x5564b63eaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df2000640 1 --2- 172.21.15.173:0/357907367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6345f30 0x5564b63eaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df2000640 1 -- 172.21.15.173:0/357907367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b6390240 msgr2=0x5564b63eb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df2000640 1 --2- 172.21.15.173:0/357907367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b6390240 0x5564b63eb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df2000640 1 -- 172.21.15.173:0/357907367 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564b6216600 con 0x5564b638f920 2024-04-25T09:06:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df2000640 1 --2- 172.21.15.173:0/357907367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 0x5564b63eaf70 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f8de00f6b50 tx=0x7f8de00f1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1118e09b2c2090fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8ddea00640 1 -- 172.21.15.173:0/357907367 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00ef070 con 0x5564b638f920 2024-04-25T09:06:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8ddea00640 1 -- 172.21.15.173:0/357907367 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de00f2ac0 con 0x5564b638f920 2024-04-25T09:06:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8ddea00640 1 -- 172.21.15.173:0/357907367 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00eddc0 con 0x5564b638f920 2024-04-25T09:06:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dfcd18000 1 -- 172.21.15.173:0/357907367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 msgr2=0x5564b63eaf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/357907367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 0x5564b63eaf70 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f8de00f6b50 tx=0x7f8de00f1000 comp rx=0 tx=0).stop 2024-04-25T09:06:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dfcd18000 1 -- 172.21.15.173:0/357907367 shutdown_connections 2024-04-25T09:06:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/357907367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b6390240 0x5564b63eb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/357907367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b638f920 0x5564b63eaf70 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/357907367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6345f30 0x5564b63eaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dfcd18000 1 -- 172.21.15.173:0/357907367 >> 172.21.15.173:0/357907367 conn(0x5564b634c2a0 msgr2=0x5564b6349470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dfcd18000 1 -- 172.21.15.173:0/357907367 shutdown_connections 2024-04-25T09:06:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dfcd18000 1 -- 172.21.15.173:0/357907367 wait complete. 2024-04-25T09:06:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dfcd18000 1 -- start start 2024-04-25T09:06:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dfcd18000 1 Processor -- start 2024-04-25T09:06:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dfcd18000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b6345f30 0x5564b639c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dfcd18000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b638f920 0x5564b63eb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dfcd18000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6390240 0x5564b63eb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dfcd18000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564b61993d0 con 0x5564b6345f30 2024-04-25T09:06:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dfcd18000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564b6250d50 con 0x5564b638f920 2024-04-25T09:06:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dfcd18000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5564b612f980 con 0x5564b6390240 2024-04-25T09:06:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dfcd18000 10 client.0 _ll_register_callbacks cb 0x5564b6197b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b6345f30 0x5564b639c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b6345f30 0x5564b639c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53200/0 (socket says 172.21.15.173:53200) 2024-04-25T09:06:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df2a00640 1 -- 172.21.15.173:0/1770340574 learned_addr learned my addr 172.21.15.173:0/1770340574 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df2000640 1 --2- 172.21.15.173:0/1770340574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b638f920 0x5564b63eb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df3400640 1 --2- 172.21.15.173:0/1770340574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6390240 0x5564b63eb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df2a00640 1 -- 172.21.15.173:0/1770340574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6390240 msgr2=0x5564b63eb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df2a00640 1 --2- 172.21.15.173:0/1770340574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6390240 0x5564b63eb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df2a00640 1 -- 172.21.15.173:0/1770340574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b638f920 msgr2=0x5564b63eb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df2a00640 1 --2- 172.21.15.173:0/1770340574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b638f920 0x5564b63eb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df2a00640 1 -- 172.21.15.173:0/1770340574 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564b61299b0 con 0x5564b6345f30 2024-04-25T09:06:56.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df2000640 1 --2- 172.21.15.173:0/1770340574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b638f920 0x5564b63eb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:56.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8df2a00640 1 --2- 172.21.15.173:0/1770340574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b6345f30 0x5564b639c6a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f8de4007550 tx=0x7f8de4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5dc4108271eeba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.578+0000 7f8dd3e00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:06:56.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dd3e00640 1 -- 172.21.15.173:0/1770340574 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de4005c90 con 0x5564b6345f30 2024-04-25T09:06:56.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dd3e00640 1 -- 172.21.15.173:0/1770340574 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8de40168d0 con 0x5564b6345f30 2024-04-25T09:06:56.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 1 -- 172.21.15.173:0/1770340574 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8de00f2ac0 con 0x5564b6345f30 2024-04-25T09:06:56.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dd3e00640 1 -- 172.21.15.173:0/1770340574 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8de403a050 con 0x5564b6345f30 2024-04-25T09:06:56.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 10 client.6864 fetch_fsmap learned FSMap version 39 2024-04-25T09:06:56.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 1 -- 172.21.15.173:0/1770340574 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x5564b613c0b0 con 0x5564b6345f30 2024-04-25T09:06:56.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dd3e00640 1 -- 172.21.15.173:0/1770340574 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de00f2ac0 con 0x5564b6345f30 2024-04-25T09:06:56.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dd3e00640 1 -- 172.21.15.173:0/1770340574 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 39) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8de403d020 con 0x5564b6345f30 2024-04-25T09:06:56.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 10 client.6864 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T09:06:56.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 10 client.6864 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:06:56.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 20 client.6864 populate_metadata read hostname 'smithi173' 2024-04-25T09:06:56.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/1770340574 >> [v2:172.21.15.173:6834/962695208,v1:172.21.15.173:6836/962695208] conn(0x5564b63ebe40 0x5564b63ec220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 4 client.6864 mds_command: new command op to 6711 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:06:56.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 1 -- 172.21.15.173:0/1770340574 --> [v2:172.21.15.173:6834/962695208,v1:172.21.15.173:6836/962695208] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5564b61a22e0 con 0x5564b63ebe40 2024-04-25T09:06:56.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8df2000640 1 --2- 172.21.15.173:0/1770340574 >> [v2:172.21.15.173:6834/962695208,v1:172.21.15.173:6836/962695208] conn(0x5564b63ebe40 0x5564b63ec220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8df2000640 1 --2- 172.21.15.173:0/1770340574 >> [v2:172.21.15.173:6834/962695208,v1:172.21.15.173:6836/962695208] conn(0x5564b63ebe40 0x5564b63ec220 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1092d1f7ec34bb server_cookie=5530476a54818244 in_seq=0 out_seq=0 2024-04-25T09:06:56.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dd3e00640 10 client.6864 ms_handle_connect on v2:172.21.15.173:6834/962695208 2024-04-25T09:06:56.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dd3e00640 1 -- 172.21.15.173:0/1770340574 <== mds.0 v2:172.21.15.173:6834/962695208 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5564b61a22e0 con 0x5564b63ebe40 2024-04-25T09:06:56.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dd3e00640 10 client.6864 handle_command_reply: tid=0 2024-04-25T09:06:56.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 1 client.6864 shutdown 2024-04-25T09:06:56.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 1 -- 172.21.15.173:0/1770340574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b6345f30 msgr2=0x5564b639c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/1770340574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b6345f30 0x5564b639c6a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f8de4007550 tx=0x7f8de4011000 comp rx=0 tx=0).stop 2024-04-25T09:06:56.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 1 -- 172.21.15.173:0/1770340574 shutdown_connections 2024-04-25T09:06:56.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/1770340574 >> [v2:172.21.15.173:6834/962695208,v1:172.21.15.173:6836/962695208] conn(0x5564b63ebe40 0x5564b63ec220 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/1770340574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5564b6390240 0x5564b63eb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/1770340574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564b638f920 0x5564b63eb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 1 --2- 172.21.15.173:0/1770340574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5564b6345f30 0x5564b639c6a0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 1 -- 172.21.15.173:0/1770340574 >> 172.21.15.173:0/1770340574 conn(0x5564b634c2a0 msgr2=0x5564b6397810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:56.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dd3e00640 0 client.6864 ms_handle_reset on v2:172.21.15.173:6834/962695208 2024-04-25T09:06:56.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 1 -- 172.21.15.173:0/1770340574 shutdown_connections 2024-04-25T09:06:56.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 1 -- 172.21.15.173:0/1770340574 wait complete. 2024-04-25T09:06:56.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8dfcd18000 20 client.6864 trim_cache size 0 max 16384 2024-04-25T09:06:56.575 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:06:56.575 INFO:teuthology.orchestra.run.smithi173.stdout: "cluster_fsid": "ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6", 2024-04-25T09:06:56.575 INFO:teuthology.orchestra.run.smithi173.stdout: "whoami": 0, 2024-04-25T09:06:56.576 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 6711, 2024-04-25T09:06:56.576 INFO:teuthology.orchestra.run.smithi173.stdout: "want_state": "up:active", 2024-04-25T09:06:56.576 INFO:teuthology.orchestra.run.smithi173.stdout: "state": "up:active", 2024-04-25T09:06:56.576 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs", 2024-04-25T09:06:56.576 INFO:teuthology.orchestra.run.smithi173.stdout: "rank_uptime": 5.8223664050000004, 2024-04-25T09:06:56.576 INFO:teuthology.orchestra.run.smithi173.stdout: "mdsmap_epoch": 39, 2024-04-25T09:06:56.576 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch": 69, 2024-04-25T09:06:56.576 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch_barrier": 69, 2024-04-25T09:06:56.576 INFO:teuthology.orchestra.run.smithi173.stdout: "uptime": 10.709419516000001 2024-04-25T09:06:56.576 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:06:56.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8df9800640 1 -- 172.21.15.173:0/3232869765 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8dd4066f60 msgr2=0x7f8dd4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8df9800640 1 --2- 172.21.15.173:0/3232869765 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8dd4066f60 0x7f8dd4069420 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8df40af3b0 tx=0x7f8de40079b0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8df9800640 1 -- 172.21.15.173:0/3232869765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8df40aef70 msgr2=0x7f8df40af3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8df9800640 1 --2- 172.21.15.173:0/3232869765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8df40aef70 0x7f8df40af3e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8de00ae040 tx=0x7f8de0019230 comp rx=0 tx=0).stop 2024-04-25T09:06:56.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8df9800640 1 -- 172.21.15.173:0/3232869765 shutdown_connections 2024-04-25T09:06:56.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8df9800640 1 --2- 172.21.15.173:0/3232869765 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8dd4066f60 0x7f8dd4069420 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8df9800640 1 --2- 172.21.15.173:0/3232869765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8df40cc7e0 0x7f8df40cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8df9800640 1 --2- 172.21.15.173:0/3232869765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8df40aef70 0x7f8df40af3e0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8df9800640 1 --2- 172.21.15.173:0/3232869765 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8df40aeb90 0x7f8df4151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8df9800640 1 -- 172.21.15.173:0/3232869765 >> 172.21.15.173:0/3232869765 conn(0x7f8df406ac90 msgr2=0x7f8df40ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:56.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8df9800640 1 -- 172.21.15.173:0/3232869765 shutdown_connections 2024-04-25T09:06:56.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.582+0000 7f8df9800640 1 -- 172.21.15.173:0/3232869765 wait complete. 2024-04-25T09:06:56.590 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:06:56.709 INFO:tasks.ceph.mds.a.smithi173.stderr:2024-04-25T09:06:56.722+0000 7f0720600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:06:56.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.738+0000 7f95eb000640 1 Processor -- start 2024-04-25T09:06:56.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.738+0000 7f95eb000640 1 -- start start 2024-04-25T09:06:56.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.738+0000 7f95eb000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f95e4145250 0x7f95e415c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.738+0000 7f95eb000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e415cec0 con 0x7f95e40ccd30 2024-04-25T09:06:56.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.738+0000 7f95eb000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e406e7c0 con 0x7f95e40cc8b0 2024-04-25T09:06:56.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.738+0000 7f95eb000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e4072140 con 0x7f95e4145250 2024-04-25T09:06:56.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.738+0000 7f95e3e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f95e4145250 0x7f95e415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.742+0000 7f95e9000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f95e40ccd30 0x7f95e4071a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:35238/0 (socket says 172.21.15.173:35238) 2024-04-25T09:06:56.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.742+0000 7f95e9000640 1 -- 172.21.15.173:0/3139170035 learned_addr learned my addr 172.21.15.173:0/3139170035 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:56.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.742+0000 7f95e3e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f95e4145250 0x7f95e415c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53216/0 (socket says 172.21.15.173:53216) 2024-04-25T09:06:56.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.742+0000 7f95e3e00640 1 -- 172.21.15.173:0/3139170035 >> v1:172.21.15.194:6789/0 conn(0x7f95e40cc8b0 legacy=0x7f95e4071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.742+0000 7f95e3e00640 1 -- 172.21.15.173:0/3139170035 >> v1:172.21.15.173:6789/0 conn(0x7f95e40ccd30 legacy=0x7f95e4071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.742+0000 7f95e3e00640 1 -- 172.21.15.173:0/3139170035 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e406d720 con 0x7f95e4145250 2024-04-25T09:06:56.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.742+0000 7f95e3400640 1 -- 172.21.15.173:0/3139170035 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737288501 0 0) 0x7f95dc0014a0 con 0x7f95e40ccd30 2024-04-25T09:06:56.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.742+0000 7f95e3e00640 1 --2- 172.21.15.173:0/3139170035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95e4145250 0x7f95e415c980 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f95d40097c0 tx=0x7f95d401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33556c9c0d45f10c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.742+0000 7f95e3400640 1 -- 172.21.15.173:0/3139170035 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d40a7070 con 0x7f95e4145250 2024-04-25T09:06:56.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.742+0000 7f95e3400640 1 -- 172.21.15.173:0/3139170035 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d40b0070 con 0x7f95e4145250 2024-04-25T09:06:56.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.742+0000 7f95e3400640 1 -- 172.21.15.173:0/3139170035 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d40ab890 con 0x7f95e4145250 2024-04-25T09:06:56.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95eb000640 1 -- 172.21.15.173:0/3139170035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95e4145250 msgr2=0x7f95e415c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95eb000640 1 --2- 172.21.15.173:0/3139170035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95e4145250 0x7f95e415c980 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f95d40097c0 tx=0x7f95d401c470 comp rx=0 tx=0).stop 2024-04-25T09:06:56.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95eb000640 1 -- 172.21.15.173:0/3139170035 shutdown_connections 2024-04-25T09:06:56.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95eb000640 1 --2- 172.21.15.173:0/3139170035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95e4145250 0x7f95e415c980 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95eb000640 1 -- 172.21.15.173:0/3139170035 >> 172.21.15.173:0/3139170035 conn(0x7f95e406ac90 msgr2=0x7f95e406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:56.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95eb000640 1 -- 172.21.15.173:0/3139170035 shutdown_connections 2024-04-25T09:06:56.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95eb000640 1 -- 172.21.15.173:0/3139170035 wait complete. 2024-04-25T09:06:56.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95eb000640 1 Processor -- start 2024-04-25T09:06:56.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95eb000640 1 -- start start 2024-04-25T09:06:56.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95eb000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e40cc8b0 0x7f95e4143b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95eb000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95e40ccd30 0x7f95e4141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95eb000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95e4145250 0x7f95e41f9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95eb000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e4145630 con 0x7f95e4145250 2024-04-25T09:06:56.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95eb000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e406e2a0 con 0x7f95e40cc8b0 2024-04-25T09:06:56.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95eb000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e406ef80 con 0x7f95e40ccd30 2024-04-25T09:06:56.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95e9000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95e4145250 0x7f95e41f9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95e9000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95e4145250 0x7f95e41f9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53226/0 (socket says 172.21.15.173:53226) 2024-04-25T09:06:56.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95e9000640 1 -- 172.21.15.173:0/831267096 learned_addr learned my addr 172.21.15.173:0/831267096 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:56.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95db400640 1 --2- 172.21.15.173:0/831267096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95e40ccd30 0x7f95e4141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95e3e00640 1 --2- 172.21.15.173:0/831267096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e40cc8b0 0x7f95e4143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95e9000640 1 -- 172.21.15.173:0/831267096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95e40ccd30 msgr2=0x7f95e4141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95e9000640 1 --2- 172.21.15.173:0/831267096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95e40ccd30 0x7f95e4141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95e9000640 1 -- 172.21.15.173:0/831267096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e40cc8b0 msgr2=0x7f95e4143b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95e9000640 1 --2- 172.21.15.173:0/831267096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e40cc8b0 0x7f95e4143b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95e9000640 1 -- 172.21.15.173:0/831267096 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e415ab90 con 0x7f95e4145250 2024-04-25T09:06:56.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.746+0000 7f95e9000640 1 --2- 172.21.15.173:0/831267096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95e4145250 0x7f95e41f9a60 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00c7f0 tx=0x7f95dc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.750+0000 7f95e0c00640 1 -- 172.21.15.173:0/831267096 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc018070 con 0x7f95e4145250 2024-04-25T09:06:56.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.750+0000 7f95e0c00640 1 -- 172.21.15.173:0/831267096 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc00a640 con 0x7f95e4145250 2024-04-25T09:06:56.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.750+0000 7f95e0c00640 1 -- 172.21.15.173:0/831267096 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc00aa30 con 0x7f95e4145250 2024-04-25T09:06:56.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.750+0000 7f95eb000640 1 -- 172.21.15.173:0/831267096 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e415ae30 con 0x7f95e4145250 2024-04-25T09:06:56.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.750+0000 7f95eb000640 1 -- 172.21.15.173:0/831267096 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e415b6d0 con 0x7f95e4145250 2024-04-25T09:06:56.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.750+0000 7f95eb000640 1 -- 172.21.15.173:0/831267096 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e415b000 con 0x7f95e4145250 2024-04-25T09:06:56.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.750+0000 7f95e0c00640 1 -- 172.21.15.173:0/831267096 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f95dc00abd0 con 0x7f95e4145250 2024-04-25T09:06:56.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.750+0000 7f95e0c00640 1 --2- 172.21.15.173:0/831267096 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f95c0066f90 0x7f95c0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.750+0000 7f95e0c00640 1 -- 172.21.15.173:0/831267096 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f95dc0846f0 con 0x7f95e4145250 2024-04-25T09:06:56.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.750+0000 7f95e3e00640 1 --2- 172.21.15.173:0/831267096 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f95c0066f90 0x7f95c0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.754+0000 7f95e3e00640 1 --2- 172.21.15.173:0/831267096 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f95c0066f90 0x7f95c0069450 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f95d40af000 tx=0x7f95d40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.754+0000 7f95e0c00640 1 -- 172.21.15.173:0/831267096 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f95e415cec0 con 0x7f95e4145250 2024-04-25T09:06:56.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.950+0000 7f95eb000640 1 -- 172.21.15.173:0/831267096 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f95e4073a40 con 0x7f95e4145250 2024-04-25T09:06:56.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.950+0000 7f95e0c00640 1 -- 172.21.15.173:0/831267096 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7f95dc054e80 con 0x7f95e4145250 2024-04-25T09:06:56.938 INFO:teuthology.orchestra.run.smithi173.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:06:56.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.950+0000 7f95eb000640 1 -- 172.21.15.173:0/831267096 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f95c0066f90 msgr2=0x7f95c0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.950+0000 7f95eb000640 1 --2- 172.21.15.173:0/831267096 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f95c0066f90 0x7f95c0069450 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f95d40af000 tx=0x7f95d40a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:56.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.950+0000 7f95eb000640 1 -- 172.21.15.173:0/831267096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95e4145250 msgr2=0x7f95e41f9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.950+0000 7f95eb000640 1 --2- 172.21.15.173:0/831267096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95e4145250 0x7f95e41f9a60 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00c7f0 tx=0x7f95dc00ccb0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.950+0000 7f95eb000640 1 -- 172.21.15.173:0/831267096 shutdown_connections 2024-04-25T09:06:56.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.950+0000 7f95eb000640 1 --2- 172.21.15.173:0/831267096 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f95c0066f90 0x7f95c0069450 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.950+0000 7f95eb000640 1 --2- 172.21.15.173:0/831267096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95e4145250 0x7f95e41f9a60 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.950+0000 7f95eb000640 1 --2- 172.21.15.173:0/831267096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95e40ccd30 0x7f95e4141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.950+0000 7f95eb000640 1 --2- 172.21.15.173:0/831267096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e40cc8b0 0x7f95e4143b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.950+0000 7f95eb000640 1 -- 172.21.15.173:0/831267096 >> 172.21.15.173:0/831267096 conn(0x7f95e406ac90 msgr2=0x7f95e413fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:56.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.950+0000 7f95eb000640 1 -- 172.21.15.173:0/831267096 shutdown_connections 2024-04-25T09:06:56.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:56.950+0000 7f95eb000640 1 -- 172.21.15.173:0/831267096 wait complete. 2024-04-25T09:06:56.959 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:06:56.959 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:06:56.959 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2024-04-25T09:06:56.959 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:06:56.959 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:56.959 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:06:56.959 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:06:56.959 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:06:56.959 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:06:56.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:56.959 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2024-04-25T09:06:56.969 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:06:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:06:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:06:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-25T09:06:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:56.969 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:06:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2024-04-25T09:06:56.969 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:06:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 42201sec preferred_lft 42201sec 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi173.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 02:42:00:0e:60:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi173.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:06:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:06:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:56.971 INFO:teuthology.orchestra.run.smithi173.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:06:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:06:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:06:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:56.971 INFO:teuthology.orchestra.run.smithi173.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:06:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:06:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:06:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:56.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:56.972 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:06:57.033 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-04-25T09:06:57.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:57.036 DEBUG:teuthology.orchestra.run.smithi173:> route 2024-04-25T09:06:57.092 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2024-04-25T09:06:57.092 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:06:57.092 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:06:57.092 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:06:57.092 INFO:teuthology.orchestra.run.smithi173.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:06:57.092 INFO:teuthology.orchestra.run.smithi173.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:06:57.092 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:06:57.092 INFO:teuthology.orchestra.run.smithi173.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:06:57.092 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:06:57.092 INFO:teuthology.orchestra.run.smithi173.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:06:57.092 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:06:57.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:57.093 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:06:57.093 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:06:57.093 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:06:57.093 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:06:57.093 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:06:57.093 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:06:57.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:57.183 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-25T09:06:57.192 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:06:57.192 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:06:57.193 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:06:57.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:57.193 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2024-04-25T09:06:57.255 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:06:57.255 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:57.303 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:06:57.304 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:06:57.304 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:57.351 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:06:57.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:57.351 DEBUG:teuthology.orchestra.run.smithi173:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:57.439 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:57.440 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:06:57.440 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:06:57.454 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:57.455 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:06:57.455 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:06:57.455 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:06:57.455 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:06:57.464 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:57.464 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:06:57.464 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:06:57.464 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:06:57.464 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:06:57.464 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-04-25T09:06:57.464 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-04-25T09:06:57.464 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6" will pass to kernel 2024-04-25T09:06:57.468 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:06:57.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:57.468 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:57.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:57.487 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:06:57.544 INFO:teuthology.orchestra.run.smithi173.stdout:client5969 2024-04-25T09:06:57.544 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:06:57.544 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:57.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:57.596 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scrub_repair_path) 2024-04-25T09:06:57.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:57.653 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch scrub_repair_path/file) 2024-04-25T09:06:57.705 DEBUG:teuthology.orchestra.run.smithi173:> stdin-killer -- python3 -c ' 2024-04-25T09:06:57.705 DEBUG:teuthology.orchestra.run.smithi173:> import os 2024-04-25T09:06:57.705 DEBUG:teuthology.orchestra.run.smithi173:> import stat 2024-04-25T09:06:57.706 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:06:57.706 DEBUG:teuthology.orchestra.run.smithi173:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_repair_path").st_ino) 2024-04-25T09:06:57.706 DEBUG:teuthology.orchestra.run.smithi173:> ' 2024-04-25T09:06:57.812 INFO:teuthology.orchestra.run.smithi173.stdout:1099511627776 2024-04-25T09:06:57.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:06:57.821 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:06:57.822 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:57.872 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:06:57.872 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:57.923 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:58.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.110+0000 7f127c200640 1 Processor -- start 2024-04-25T09:06:58.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.110+0000 7f127c200640 1 -- start start 2024-04-25T09:06:58.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.110+0000 7f127c200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f127415ba20 0x7f127415be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.110+0000 7f127c200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f12740b70f0 0x7f127406f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.110+0000 7f127c200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f127406fea0 0x7f12740d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.110+0000 7f127c200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127415c460 con 0x7f127415ba20 2024-04-25T09:06:58.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.110+0000 7f127c200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127415c740 con 0x7f12740b70f0 2024-04-25T09:06:58.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.110+0000 7f127c200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127415ca20 con 0x7f127406fea0 2024-04-25T09:06:58.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.110+0000 7f1279800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f127415ba20 0x7f127415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.110+0000 7f1279800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f127415ba20 0x7f127415be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53230/0 (socket says 172.21.15.173:53230) 2024-04-25T09:06:58.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.110+0000 7f1279800640 1 -- 172.21.15.173:0/3168123957 learned_addr learned my addr 172.21.15.173:0/3168123957 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:58.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.114+0000 7f1278e00640 1 --2- 172.21.15.173:0/3168123957 >> v2:172.21.15.194:3300/0 conn(0x7f12740b70f0 0x7f127406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.114+0000 7f127a200640 1 --2- 172.21.15.173:0/3168123957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f127406fea0 0x7f12740d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.114+0000 7f1279800640 1 -- 172.21.15.173:0/3168123957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f127406fea0 msgr2=0x7f12740d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.114+0000 7f1279800640 1 --2- 172.21.15.173:0/3168123957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f127406fea0 0x7f12740d1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.114+0000 7f1279800640 1 -- 172.21.15.173:0/3168123957 >> v2:172.21.15.194:3300/0 conn(0x7f12740b70f0 msgr2=0x7f127406f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.114+0000 7f1279800640 1 --2- 172.21.15.173:0/3168123957 >> v2:172.21.15.194:3300/0 conn(0x7f12740b70f0 0x7f127406f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.114+0000 7f1279800640 1 -- 172.21.15.173:0/3168123957 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127415cd00 con 0x7f127415ba20 2024-04-25T09:06:58.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.114+0000 7f1278e00640 1 --2- 172.21.15.173:0/3168123957 >> v2:172.21.15.194:3300/0 conn(0x7f12740b70f0 0x7f127406f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:58.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.114+0000 7f1279800640 1 --2- 172.21.15.173:0/3168123957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f127415ba20 0x7f127415be00 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f1268009e50 tx=0x7f126801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb95116961251f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.114+0000 7f1273e00640 1 -- 172.21.15.173:0/3168123957 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12680a5780 con 0x7f127415ba20 2024-04-25T09:06:58.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.114+0000 7f1273e00640 1 -- 172.21.15.173:0/3168123957 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12680a5920 con 0x7f127415ba20 2024-04-25T09:06:58.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.114+0000 7f1273e00640 1 -- 172.21.15.173:0/3168123957 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12680a5cf0 con 0x7f127415ba20 2024-04-25T09:06:58.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.114+0000 7f127c200640 1 -- 172.21.15.173:0/3168123957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f127415ba20 msgr2=0x7f127415be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.114+0000 7f127c200640 1 --2- 172.21.15.173:0/3168123957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f127415ba20 0x7f127415be00 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f1268009e50 tx=0x7f126801c9f0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f127c200640 1 -- 172.21.15.173:0/3168123957 shutdown_connections 2024-04-25T09:06:58.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f127c200640 1 --2- 172.21.15.173:0/3168123957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f127406fea0 0x7f12740d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f127c200640 1 --2- 172.21.15.173:0/3168123957 >> v2:172.21.15.194:3300/0 conn(0x7f12740b70f0 0x7f127406f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f127c200640 1 --2- 172.21.15.173:0/3168123957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f127415ba20 0x7f127415be00 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f127c200640 1 -- 172.21.15.173:0/3168123957 >> 172.21.15.173:0/3168123957 conn(0x7f1274061880 msgr2=0x7f1274061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f127c200640 1 -- 172.21.15.173:0/3168123957 shutdown_connections 2024-04-25T09:06:58.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f127c200640 1 -- 172.21.15.173:0/3168123957 wait complete. 2024-04-25T09:06:58.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f127c200640 1 Processor -- start 2024-04-25T09:06:58.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f127c200640 1 -- start start 2024-04-25T09:06:58.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f127c200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f127406fea0 0x7f1274155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f127c200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12740b70f0 0x7f12740cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f127c200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f127415ba20 0x7f12740ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f127c200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127415ff90 con 0x7f12740b70f0 2024-04-25T09:06:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f127c200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127415fe10 con 0x7f127415ba20 2024-04-25T09:06:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f127c200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1274160110 con 0x7f127406fea0 2024-04-25T09:06:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f1278e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12740b70f0 0x7f12740cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f1278e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12740b70f0 0x7f12740cb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53240/0 (socket says 172.21.15.173:53240) 2024-04-25T09:06:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f1278e00640 1 -- 172.21.15.173:0/443536956 learned_addr learned my addr 172.21.15.173:0/443536956 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f1279800640 1 --2- 172.21.15.173:0/443536956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f127406fea0 0x7f1274155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f127a200640 1 --2- 172.21.15.173:0/443536956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f127415ba20 0x7f12740ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f1278e00640 1 -- 172.21.15.173:0/443536956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f127406fea0 msgr2=0x7f1274155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f1278e00640 1 --2- 172.21.15.173:0/443536956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f127406fea0 0x7f1274155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f1278e00640 1 -- 172.21.15.173:0/443536956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f127415ba20 msgr2=0x7f12740ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f1278e00640 1 --2- 172.21.15.173:0/443536956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f127415ba20 0x7f12740ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f1278e00640 1 -- 172.21.15.173:0/443536956 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12740cb720 con 0x7f12740b70f0 2024-04-25T09:06:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f1278e00640 1 --2- 172.21.15.173:0/443536956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12740b70f0 0x7f12740cb1e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f126000e810 tx=0x7f126000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f1271600640 1 -- 172.21.15.173:0/443536956 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260017070 con 0x7f12740b70f0 2024-04-25T09:06:58.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f1271600640 1 -- 172.21.15.173:0/443536956 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126000c8d0 con 0x7f12740b70f0 2024-04-25T09:06:58.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f1271600640 1 -- 172.21.15.173:0/443536956 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126000f040 con 0x7f12740b70f0 2024-04-25T09:06:58.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.118+0000 7f127c200640 1 -- 172.21.15.173:0/443536956 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1274156480 con 0x7f12740b70f0 2024-04-25T09:06:58.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.122+0000 7f127c200640 1 -- 172.21.15.173:0/443536956 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1274156a40 con 0x7f12740b70f0 2024-04-25T09:06:58.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.122+0000 7f127c200640 1 -- 172.21.15.173:0/443536956 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1274161670 con 0x7f12740b70f0 2024-04-25T09:06:58.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.122+0000 7f1271600640 1 -- 172.21.15.173:0/443536956 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f126001a070 con 0x7f12740b70f0 2024-04-25T09:06:58.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.122+0000 7f1271600640 1 --2- 172.21.15.173:0/443536956 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1254066f60 0x7f1254069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.122+0000 7f1271600640 1 -- 172.21.15.173:0/443536956 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1260084d80 con 0x7f12740b70f0 2024-04-25T09:06:58.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.122+0000 7f1279800640 1 --2- 172.21.15.173:0/443536956 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1254066f60 0x7f1254069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.126+0000 7f1279800640 1 --2- 172.21.15.173:0/443536956 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1254066f60 0x7f1254069420 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f12680ae000 tx=0x7f12680a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.126+0000 7f1271600640 1 -- 172.21.15.173:0/443536956 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1260055510 con 0x7f12740b70f0 2024-04-25T09:06:58.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.282+0000 7f127c200640 1 -- 172.21.15.173:0/443536956 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12740d17d0 con 0x7f12740b70f0 2024-04-25T09:06:58.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.282+0000 7f1271600640 1 -- 172.21.15.173:0/443536956 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16944 (secure 0 0 0) 0x7f12600595b0 con 0x7f12740b70f0 2024-04-25T09:06:58.270 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:06:58.270 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":69,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:06:51.749084+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:48.493059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:49.133352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:58.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.282+0000 7f127c200640 1 -- 172.21.15.173:0/443536956 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1254066f60 msgr2=0x7f1254069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.282+0000 7f127c200640 1 --2- 172.21.15.173:0/443536956 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1254066f60 0x7f1254069420 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f12680ae000 tx=0x7f12680a7070 comp rx=0 tx=0).stop 2024-04-25T09:06:58.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.282+0000 7f127c200640 1 -- 172.21.15.173:0/443536956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12740b70f0 msgr2=0x7f12740cb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.282+0000 7f127c200640 1 --2- 172.21.15.173:0/443536956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12740b70f0 0x7f12740cb1e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f126000e810 tx=0x7f126000ecd0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.282+0000 7f127c200640 1 -- 172.21.15.173:0/443536956 shutdown_connections 2024-04-25T09:06:58.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.282+0000 7f127c200640 1 --2- 172.21.15.173:0/443536956 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1254066f60 0x7f1254069420 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.286+0000 7f127c200640 1 --2- 172.21.15.173:0/443536956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f127415ba20 0x7f12740ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.286+0000 7f127c200640 1 --2- 172.21.15.173:0/443536956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12740b70f0 0x7f12740cb1e0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.286+0000 7f127c200640 1 --2- 172.21.15.173:0/443536956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f127406fea0 0x7f1274155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.286+0000 7f127c200640 1 -- 172.21.15.173:0/443536956 >> 172.21.15.173:0/443536956 conn(0x7f1274061880 msgr2=0x7f12740b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.286+0000 7f127c200640 1 -- 172.21.15.173:0/443536956 shutdown_connections 2024-04-25T09:06:58.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.286+0000 7f127c200640 1 -- 172.21.15.173:0/443536956 wait complete. 2024-04-25T09:06:58.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:06:48.493059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:06:49.133352+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:06:58.292 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:06:58.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.442+0000 7f67fe600640 1 Processor -- start 2024-04-25T09:06:58.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.442+0000 7f67fe600640 1 -- start start 2024-04-25T09:06:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.442+0000 7f67fe600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67f8145290 0x7f67f815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.442+0000 7f67fe600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f67f80b3fe0 0x7f67f80b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.442+0000 7f67fe600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f67f80cc260 0x7f67f80cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.442+0000 7f67fe600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f815c5f0 con 0x7f67f80b3fe0 2024-04-25T09:06:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.442+0000 7f67fe600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f806d4b0 con 0x7f67f80cc260 2024-04-25T09:06:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.442+0000 7f67fe600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f806d790 con 0x7f67f8145290 2024-04-25T09:06:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.442+0000 7f67eea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f67f80b3fe0 0x7f67f80b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.442+0000 7f67eea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f67f80b3fe0 0x7f67f80b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53242/0 (socket says 172.21.15.173:53242) 2024-04-25T09:06:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.442+0000 7f67eea00640 1 -- 172.21.15.173:0/1326168983 learned_addr learned my addr 172.21.15.173:0/1326168983 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.446+0000 7f67f7400640 1 --2- 172.21.15.173:0/1326168983 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67f8145290 0x7f67f815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.446+0000 7f67f7e00640 1 --2- 172.21.15.173:0/1326168983 >> v2:172.21.15.194:3300/0 conn(0x7f67f80cc260 0x7f67f80cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.446+0000 7f67eea00640 1 -- 172.21.15.173:0/1326168983 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67f8145290 msgr2=0x7f67f815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.446+0000 7f67eea00640 1 --2- 172.21.15.173:0/1326168983 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67f8145290 0x7f67f815c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.446+0000 7f67eea00640 1 -- 172.21.15.173:0/1326168983 >> v2:172.21.15.194:3300/0 conn(0x7f67f80cc260 msgr2=0x7f67f80cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.446+0000 7f67eea00640 1 --2- 172.21.15.173:0/1326168983 >> v2:172.21.15.194:3300/0 conn(0x7f67f80cc260 0x7f67f80cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.446+0000 7f67eea00640 1 -- 172.21.15.173:0/1326168983 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f806da70 con 0x7f67f80b3fe0 2024-04-25T09:06:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.446+0000 7f67eea00640 1 --2- 172.21.15.173:0/1326168983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67f80b3fe0 0x7f67f80b4420 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f67f80af390 tx=0x7f67e001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1914da69ebcbbc05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.446+0000 7f67f6a00640 1 -- 172.21.15.173:0/1326168983 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e00b0070 con 0x7f67f80b3fe0 2024-04-25T09:06:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.446+0000 7f67f6a00640 1 -- 172.21.15.173:0/1326168983 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e00ab600 con 0x7f67f80b3fe0 2024-04-25T09:06:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.446+0000 7f67f6a00640 1 -- 172.21.15.173:0/1326168983 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e00ab9d0 con 0x7f67f80b3fe0 2024-04-25T09:06:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.446+0000 7f67fe600640 1 -- 172.21.15.173:0/1326168983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67f80b3fe0 msgr2=0x7f67f80b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.446+0000 7f67fe600640 1 --2- 172.21.15.173:0/1326168983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67f80b3fe0 0x7f67f80b4420 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f67f80af390 tx=0x7f67e001c400 comp rx=0 tx=0).stop 2024-04-25T09:06:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.446+0000 7f67fe600640 1 -- 172.21.15.173:0/1326168983 shutdown_connections 2024-04-25T09:06:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.446+0000 7f67fe600640 1 --2- 172.21.15.173:0/1326168983 >> v2:172.21.15.194:3300/0 conn(0x7f67f80cc260 0x7f67f80cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.446+0000 7f67fe600640 1 --2- 172.21.15.173:0/1326168983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67f80b3fe0 0x7f67f80b4420 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.446+0000 7f67fe600640 1 --2- 172.21.15.173:0/1326168983 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67f8145290 0x7f67f815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.446+0000 7f67fe600640 1 -- 172.21.15.173:0/1326168983 >> 172.21.15.173:0/1326168983 conn(0x7f67f806ac90 msgr2=0x7f67f806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67fe600640 1 -- 172.21.15.173:0/1326168983 shutdown_connections 2024-04-25T09:06:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67fe600640 1 -- 172.21.15.173:0/1326168983 wait complete. 2024-04-25T09:06:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67fe600640 1 Processor -- start 2024-04-25T09:06:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67fe600640 1 -- start start 2024-04-25T09:06:58.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67fe600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67f80b3fe0 0x7f67f8142170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67fe600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67f80cc260 0x7f67f815b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67fe600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67f8145290 0x7f67f80cff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67fe600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f81457f0 con 0x7f67f80cc260 2024-04-25T09:06:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67fe600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f8145670 con 0x7f67f80b3fe0 2024-04-25T09:06:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67fe600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f806ed60 con 0x7f67f8145290 2024-04-25T09:06:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67eea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67f80cc260 0x7f67f815b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67eea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67f80cc260 0x7f67f815b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53252/0 (socket says 172.21.15.173:53252) 2024-04-25T09:06:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67eea00640 1 -- 172.21.15.173:0/324576283 learned_addr learned my addr 172.21.15.173:0/324576283 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67f7e00640 1 --2- 172.21.15.173:0/324576283 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67f8145290 0x7f67f80cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67f7400640 1 --2- 172.21.15.173:0/324576283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67f80b3fe0 0x7f67f8142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67eea00640 1 -- 172.21.15.173:0/324576283 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67f8145290 msgr2=0x7f67f80cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67eea00640 1 --2- 172.21.15.173:0/324576283 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67f8145290 0x7f67f80cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67eea00640 1 -- 172.21.15.173:0/324576283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67f80b3fe0 msgr2=0x7f67f8142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67eea00640 1 --2- 172.21.15.173:0/324576283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67f80b3fe0 0x7f67f8142170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67eea00640 1 -- 172.21.15.173:0/324576283 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f80d0470 con 0x7f67f80cc260 2024-04-25T09:06:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67eea00640 1 --2- 172.21.15.173:0/324576283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67f80cc260 0x7f67f815b310 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f67e00ae040 tx=0x7f67e00191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67efe00640 1 -- 172.21.15.173:0/324576283 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e00b9070 con 0x7f67f80cc260 2024-04-25T09:06:58.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67efe00640 1 -- 172.21.15.173:0/324576283 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e00b4400 con 0x7f67f80cc260 2024-04-25T09:06:58.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67fe600640 1 -- 172.21.15.173:0/324576283 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f8142800 con 0x7f67f80cc260 2024-04-25T09:06:58.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.450+0000 7f67efe00640 1 -- 172.21.15.173:0/324576283 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e00b0040 con 0x7f67f80cc260 2024-04-25T09:06:58.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.454+0000 7f67fe600640 1 -- 172.21.15.173:0/324576283 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f8142dc0 con 0x7f67f80cc260 2024-04-25T09:06:58.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.454+0000 7f67fe600640 1 -- 172.21.15.173:0/324576283 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f8073ab0 con 0x7f67f80cc260 2024-04-25T09:06:58.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.454+0000 7f67efe00640 1 -- 172.21.15.173:0/324576283 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f67e00bc070 con 0x7f67f80cc260 2024-04-25T09:06:58.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.454+0000 7f67efe00640 1 --2- 172.21.15.173:0/324576283 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f67d4066f60 0x7f67d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.454+0000 7f67efe00640 1 -- 172.21.15.173:0/324576283 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f67e011e210 con 0x7f67f80cc260 2024-04-25T09:06:58.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.454+0000 7f67f7400640 1 --2- 172.21.15.173:0/324576283 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f67d4066f60 0x7f67d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.454+0000 7f67f7400640 1 --2- 172.21.15.173:0/324576283 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f67d4066f60 0x7f67d4069420 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f67f8138050 tx=0x7f67e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.458+0000 7f67efe00640 1 -- 172.21.15.173:0/324576283 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f67e0016110 con 0x7f67f80cc260 2024-04-25T09:06:58.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.614+0000 7f67fe600640 1 -- 172.21.15.173:0/324576283 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67f80aeac0 con 0x7f67f80cc260 2024-04-25T09:06:58.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.614+0000 7f67efe00640 1 -- 172.21.15.173:0/324576283 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67e00ef110 con 0x7f67f80cc260 2024-04-25T09:06:58.602 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:06:58.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.614+0000 7f67fe600640 1 -- 172.21.15.173:0/324576283 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f67d4066f60 msgr2=0x7f67d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.614+0000 7f67fe600640 1 --2- 172.21.15.173:0/324576283 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f67d4066f60 0x7f67d4069420 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f67f8138050 tx=0x7f67e8008040 comp rx=0 tx=0).stop 2024-04-25T09:06:58.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.614+0000 7f67fe600640 1 -- 172.21.15.173:0/324576283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67f80cc260 msgr2=0x7f67f815b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.614+0000 7f67fe600640 1 --2- 172.21.15.173:0/324576283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67f80cc260 0x7f67f815b310 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f67e00ae040 tx=0x7f67e00191a0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.614+0000 7f67fe600640 1 -- 172.21.15.173:0/324576283 shutdown_connections 2024-04-25T09:06:58.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.614+0000 7f67fe600640 1 --2- 172.21.15.173:0/324576283 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f67d4066f60 0x7f67d4069420 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.614+0000 7f67fe600640 1 --2- 172.21.15.173:0/324576283 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67f8145290 0x7f67f80cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.614+0000 7f67fe600640 1 --2- 172.21.15.173:0/324576283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67f80cc260 0x7f67f815b310 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.614+0000 7f67fe600640 1 --2- 172.21.15.173:0/324576283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67f80b3fe0 0x7f67f8142170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.614+0000 7f67fe600640 1 -- 172.21.15.173:0/324576283 >> 172.21.15.173:0/324576283 conn(0x7f67f806ac90 msgr2=0x7f67f80cbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.618+0000 7f67fe600640 1 -- 172.21.15.173:0/324576283 shutdown_connections 2024-04-25T09:06:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.618+0000 7f67fe600640 1 -- 172.21.15.173:0/324576283 wait complete. 2024-04-25T09:06:58.623 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:06:58.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.778+0000 7f66e8c00640 1 Processor -- start 2024-04-25T09:06:58.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.778+0000 7f66e8c00640 1 -- start start 2024-04-25T09:06:58.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.778+0000 7f66e8c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f66e415bb90 0x7f66e415bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.778+0000 7f66e8c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e40cf360 0x7f66e40cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.778+0000 7f66e8c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f66e4099a50 0x7f66e4099f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.778+0000 7f66e8c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e40cc310 con 0x7f66e415bb90 2024-04-25T09:06:58.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.778+0000 7f66e8c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e415c550 con 0x7f66e4099a50 2024-04-25T09:06:58.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.778+0000 7f66e8c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e415c830 con 0x7f66e40cf360 2024-04-25T09:06:58.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.778+0000 7f66e3400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f66e415bb90 0x7f66e415bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.778+0000 7f66e3400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f66e415bb90 0x7f66e415bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53264/0 (socket says 172.21.15.173:53264) 2024-04-25T09:06:58.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.778+0000 7f66e3400640 1 -- 172.21.15.173:0/1714063901 learned_addr learned my addr 172.21.15.173:0/1714063901 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:58.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.778+0000 7f66e2a00640 1 --2- 172.21.15.173:0/1714063901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e40cf360 0x7f66e40cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.778+0000 7f66e3e00640 1 --2- 172.21.15.173:0/1714063901 >> v2:172.21.15.194:3300/0 conn(0x7f66e4099a50 0x7f66e4099f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.778+0000 7f66e3400640 1 -- 172.21.15.173:0/1714063901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e40cf360 msgr2=0x7f66e40cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.778+0000 7f66e3400640 1 --2- 172.21.15.173:0/1714063901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e40cf360 0x7f66e40cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.778+0000 7f66e3400640 1 -- 172.21.15.173:0/1714063901 >> v2:172.21.15.194:3300/0 conn(0x7f66e4099a50 msgr2=0x7f66e4099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.778+0000 7f66e3400640 1 --2- 172.21.15.173:0/1714063901 >> v2:172.21.15.194:3300/0 conn(0x7f66e4099a50 0x7f66e4099f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.778+0000 7f66e3400640 1 -- 172.21.15.173:0/1714063901 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e415cb10 con 0x7f66e415bb90 2024-04-25T09:06:58.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.782+0000 7f66e3400640 1 --2- 172.21.15.173:0/1714063901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66e415bb90 0x7f66e415bf70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f66e409b020 tx=0x7f66d401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190dbf90c700ee44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.782+0000 7f66e2000640 1 -- 172.21.15.173:0/1714063901 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d40ab5f0 con 0x7f66e415bb90 2024-04-25T09:06:58.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.782+0000 7f66e2000640 1 -- 172.21.15.173:0/1714063901 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d40b0070 con 0x7f66e415bb90 2024-04-25T09:06:58.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.782+0000 7f66e2000640 1 -- 172.21.15.173:0/1714063901 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d40ab9b0 con 0x7f66e415bb90 2024-04-25T09:06:58.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.782+0000 7f66e8c00640 1 -- 172.21.15.173:0/1714063901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66e415bb90 msgr2=0x7f66e415bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.782+0000 7f66e8c00640 1 --2- 172.21.15.173:0/1714063901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66e415bb90 0x7f66e415bf70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f66e409b020 tx=0x7f66d401c520 comp rx=0 tx=0).stop 2024-04-25T09:06:58.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.782+0000 7f66e8c00640 1 -- 172.21.15.173:0/1714063901 shutdown_connections 2024-04-25T09:06:58.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.782+0000 7f66e8c00640 1 --2- 172.21.15.173:0/1714063901 >> v2:172.21.15.194:3300/0 conn(0x7f66e4099a50 0x7f66e4099f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.782+0000 7f66e8c00640 1 --2- 172.21.15.173:0/1714063901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e40cf360 0x7f66e40cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.782+0000 7f66e8c00640 1 --2- 172.21.15.173:0/1714063901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66e415bb90 0x7f66e415bf70 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.782+0000 7f66e8c00640 1 -- 172.21.15.173:0/1714063901 >> 172.21.15.173:0/1714063901 conn(0x7f66e40d1790 msgr2=0x7f66e40d1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.782+0000 7f66e8c00640 1 -- 172.21.15.173:0/1714063901 shutdown_connections 2024-04-25T09:06:58.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.782+0000 7f66e8c00640 1 -- 172.21.15.173:0/1714063901 wait complete. 2024-04-25T09:06:58.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.782+0000 7f66e8c00640 1 Processor -- start 2024-04-25T09:06:58.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e8c00640 1 -- start start 2024-04-25T09:06:58.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e8c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e4099a50 0x7f66e40b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e8c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66e40cf360 0x7f66e4153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e8c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66e415bb90 0x7f66e40c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e8c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e4160280 con 0x7f66e40cf360 2024-04-25T09:06:58.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e8c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e4160100 con 0x7f66e415bb90 2024-04-25T09:06:58.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e8c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e4160400 con 0x7f66e4099a50 2024-04-25T09:06:58.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66e40cf360 0x7f66e4153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66e40cf360 0x7f66e4153a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53272/0 (socket says 172.21.15.173:53272) 2024-04-25T09:06:58.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e2a00640 1 -- 172.21.15.173:0/1287429396 learned_addr learned my addr 172.21.15.173:0/1287429396 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:58.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e3e00640 1 --2- 172.21.15.173:0/1287429396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66e415bb90 0x7f66e40c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e3400640 1 --2- 172.21.15.173:0/1287429396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e4099a50 0x7f66e40b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e2a00640 1 -- 172.21.15.173:0/1287429396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e4099a50 msgr2=0x7f66e40b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e2a00640 1 --2- 172.21.15.173:0/1287429396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e4099a50 0x7f66e40b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e2a00640 1 -- 172.21.15.173:0/1287429396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66e415bb90 msgr2=0x7f66e40c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e2a00640 1 --2- 172.21.15.173:0/1287429396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66e415bb90 0x7f66e40c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e2a00640 1 -- 172.21.15.173:0/1287429396 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e40b5d30 con 0x7f66e40cf360 2024-04-25T09:06:58.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e2a00640 1 --2- 172.21.15.173:0/1287429396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66e40cf360 0x7f66e4153a00 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f66d000e900 tx=0x7f66d000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66db400640 1 -- 172.21.15.173:0/1287429396 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d0017070 con 0x7f66e40cf360 2024-04-25T09:06:58.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66db400640 1 -- 172.21.15.173:0/1287429396 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d000ca00 con 0x7f66e40cf360 2024-04-25T09:06:58.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66db400640 1 -- 172.21.15.173:0/1287429396 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d000cdd0 con 0x7f66e40cf360 2024-04-25T09:06:58.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e8c00640 1 -- 172.21.15.173:0/1287429396 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e40b6010 con 0x7f66e40cf360 2024-04-25T09:06:58.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e8c00640 1 -- 172.21.15.173:0/1287429396 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e40b65d0 con 0x7f66e40cf360 2024-04-25T09:06:58.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.786+0000 7f66e8c00640 1 -- 172.21.15.173:0/1287429396 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e415b3c0 con 0x7f66e40cf360 2024-04-25T09:06:58.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.790+0000 7f66db400640 1 -- 172.21.15.173:0/1287429396 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f66d001a070 con 0x7f66e40cf360 2024-04-25T09:06:58.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.790+0000 7f66db400640 1 --2- 172.21.15.173:0/1287429396 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f66c4066f60 0x7f66c4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.790+0000 7f66db400640 1 -- 172.21.15.173:0/1287429396 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f66d00851d0 con 0x7f66e40cf360 2024-04-25T09:06:58.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.790+0000 7f66e3400640 1 --2- 172.21.15.173:0/1287429396 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f66c4066f60 0x7f66c4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.790+0000 7f66e3400640 1 --2- 172.21.15.173:0/1287429396 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f66c4066f60 0x7f66c4069420 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f66d40af000 tx=0x7f66d40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.794+0000 7f66db400640 1 -- 172.21.15.173:0/1287429396 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f66d0055960 con 0x7f66e40cf360 2024-04-25T09:06:58.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.950+0000 7f66e8c00640 1 -- 172.21.15.173:0/1287429396 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f66e40743c0 con 0x7f66e40cf360 2024-04-25T09:06:58.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.950+0000 7f66db400640 1 -- 172.21.15.173:0/1287429396 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7f66d0059a00 con 0x7f66e40cf360 2024-04-25T09:06:58.937 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:06:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.950+0000 7f66e8c00640 1 -- 172.21.15.173:0/1287429396 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f66c4066f60 msgr2=0x7f66c4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.950+0000 7f66e8c00640 1 --2- 172.21.15.173:0/1287429396 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f66c4066f60 0x7f66c4069420 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f66d40af000 tx=0x7f66d40a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.950+0000 7f66e8c00640 1 -- 172.21.15.173:0/1287429396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66e40cf360 msgr2=0x7f66e4153a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.950+0000 7f66e8c00640 1 --2- 172.21.15.173:0/1287429396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66e40cf360 0x7f66e4153a00 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f66d000e900 tx=0x7f66d000edc0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.950+0000 7f66e8c00640 1 -- 172.21.15.173:0/1287429396 shutdown_connections 2024-04-25T09:06:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.950+0000 7f66e8c00640 1 --2- 172.21.15.173:0/1287429396 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f66c4066f60 0x7f66c4069420 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.950+0000 7f66e8c00640 1 --2- 172.21.15.173:0/1287429396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66e415bb90 0x7f66e40c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.950+0000 7f66e8c00640 1 --2- 172.21.15.173:0/1287429396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66e40cf360 0x7f66e4153a00 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.950+0000 7f66e8c00640 1 --2- 172.21.15.173:0/1287429396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66e4099a50 0x7f66e40b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.950+0000 7f66e8c00640 1 -- 172.21.15.173:0/1287429396 >> 172.21.15.173:0/1287429396 conn(0x7f66e40d1790 msgr2=0x7f66e415d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.950+0000 7f66e8c00640 1 -- 172.21.15.173:0/1287429396 shutdown_connections 2024-04-25T09:06:58.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:58.950+0000 7f66e8c00640 1 -- 172.21.15.173:0/1287429396 wait complete. 2024-04-25T09:06:58.958 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:06:59.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.110+0000 7f4d1b000640 1 Processor -- start 2024-04-25T09:06:59.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.110+0000 7f4d1b000640 1 -- start start 2024-04-25T09:06:59.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.110+0000 7f4d1b000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d14070e70 0x7f4d140712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:59.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.110+0000 7f4d1b000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d14071830 con 0x7f4d140b5a60 2024-04-25T09:06:59.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.110+0000 7f4d1b000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d140b0ec0 con 0x7f4d14158210 2024-04-25T09:06:59.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.110+0000 7f4d1b000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d140b1190 con 0x7f4d14070e70 2024-04-25T09:06:59.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.110+0000 7f4d19000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4d140b5a60 0x7f4d140b5ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:35242/0 (socket says 172.21.15.173:35242) 2024-04-25T09:06:59.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.110+0000 7f4d19000640 1 -- 172.21.15.173:0/3807677355 learned_addr learned my addr 172.21.15.173:0/3807677355 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:06:59.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.110+0000 7f4d13400640 1 --2- 172.21.15.173:0/3807677355 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d14070e70 0x7f4d140712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:59.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.110+0000 7f4d12a00640 1 -- 172.21.15.173:0/3807677355 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020529175 0 0) 0x7f4d14071830 con 0x7f4d140b5a60 2024-04-25T09:06:59.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.110+0000 7f4d12a00640 1 -- 172.21.15.173:0/3807677355 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cf8003530 con 0x7f4d140b5a60 2024-04-25T09:06:59.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.110+0000 7f4d12a00640 1 -- 172.21.15.173:0/3807677355 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553852049 0 0) 0x7f4d140b0ec0 con 0x7f4d14158210 2024-04-25T09:06:59.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.110+0000 7f4d12a00640 1 -- 172.21.15.173:0/3807677355 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d14071830 con 0x7f4d14158210 2024-04-25T09:06:59.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.114+0000 7f4d13400640 1 -- 172.21.15.173:0/3807677355 >> v1:172.21.15.194:6789/0 conn(0x7f4d14158210 legacy=0x7f4d140b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:59.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.114+0000 7f4d13400640 1 -- 172.21.15.173:0/3807677355 >> v1:172.21.15.173:6789/0 conn(0x7f4d140b5a60 legacy=0x7f4d140b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:59.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.114+0000 7f4d13400640 1 -- 172.21.15.173:0/3807677355 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1415e5d0 con 0x7f4d14070e70 2024-04-25T09:06:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.114+0000 7f4d13400640 1 --2- 172.21.15.173:0/3807677355 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d14070e70 0x7f4d140712f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4d000097f0 tx=0x7f4d0001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e19ca6846080a2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.114+0000 7f4d12a00640 1 -- 172.21.15.173:0/3807677355 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d000b0070 con 0x7f4d14070e70 2024-04-25T09:06:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.114+0000 7f4d12a00640 1 -- 172.21.15.173:0/3807677355 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d000ab600 con 0x7f4d14070e70 2024-04-25T09:06:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.114+0000 7f4d12a00640 1 -- 172.21.15.173:0/3807677355 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d000ab9d0 con 0x7f4d14070e70 2024-04-25T09:06:59.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.114+0000 7f4d1b000640 1 -- 172.21.15.173:0/3807677355 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d14070e70 msgr2=0x7f4d140712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:59.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.114+0000 7f4d1b000640 1 --2- 172.21.15.173:0/3807677355 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d14070e70 0x7f4d140712f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4d000097f0 tx=0x7f4d0001c450 comp rx=0 tx=0).stop 2024-04-25T09:06:59.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.114+0000 7f4d1b000640 1 -- 172.21.15.173:0/3807677355 shutdown_connections 2024-04-25T09:06:59.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.114+0000 7f4d1b000640 1 --2- 172.21.15.173:0/3807677355 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d14070e70 0x7f4d140712f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.114+0000 7f4d1b000640 1 -- 172.21.15.173:0/3807677355 >> 172.21.15.173:0/3807677355 conn(0x7f4d140b3540 msgr2=0x7f4d140b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:59.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.114+0000 7f4d1b000640 1 -- 172.21.15.173:0/3807677355 shutdown_connections 2024-04-25T09:06:59.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.114+0000 7f4d1b000640 1 -- 172.21.15.173:0/3807677355 wait complete. 2024-04-25T09:06:59.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d1b000640 1 Processor -- start 2024-04-25T09:06:59.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d1b000640 1 -- start start 2024-04-25T09:06:59.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d1b000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d14070e70 0x7f4d1415b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:59.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d1b000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d140b5a60 0x7f4d14159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:59.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d1b000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d14158210 0x7f4d141545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:59.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d1b000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d140b6780 con 0x7f4d14158210 2024-04-25T09:06:59.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d1b000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d140b6600 con 0x7f4d14070e70 2024-04-25T09:06:59.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d1b000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d141585f0 con 0x7f4d140b5a60 2024-04-25T09:06:59.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d19000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d14158210 0x7f4d141545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:59.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d19000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d14158210 0x7f4d141545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53286/0 (socket says 172.21.15.173:53286) 2024-04-25T09:06:59.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d19000640 1 -- 172.21.15.173:0/535059716 learned_addr learned my addr 172.21.15.173:0/535059716 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:59.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d13400640 1 --2- 172.21.15.173:0/535059716 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d140b5a60 0x7f4d14159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:59.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d13e00640 1 --2- 172.21.15.173:0/535059716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d14070e70 0x7f4d1415b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:59.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d19000640 1 -- 172.21.15.173:0/535059716 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d140b5a60 msgr2=0x7f4d14159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:59.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d19000640 1 --2- 172.21.15.173:0/535059716 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d140b5a60 0x7f4d14159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d19000640 1 -- 172.21.15.173:0/535059716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d14070e70 msgr2=0x7f4d1415b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:59.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d19000640 1 --2- 172.21.15.173:0/535059716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d14070e70 0x7f4d1415b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d19000640 1 -- 172.21.15.173:0/535059716 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d14155d80 con 0x7f4d14158210 2024-04-25T09:06:59.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d13e00640 1 --2- 172.21.15.173:0/535059716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d14070e70 0x7f4d1415b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:59.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d19000640 1 --2- 172.21.15.173:0/535059716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d14158210 0x7f4d141545b0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00cbd0 tx=0x7f4d0c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:59.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d0be00640 1 -- 172.21.15.173:0/535059716 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c017070 con 0x7f4d14158210 2024-04-25T09:06:59.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d0be00640 1 -- 172.21.15.173:0/535059716 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c00ace0 con 0x7f4d14158210 2024-04-25T09:06:59.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d0be00640 1 -- 172.21.15.173:0/535059716 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c012620 con 0x7f4d14158210 2024-04-25T09:06:59.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d1b000640 1 -- 172.21.15.173:0/535059716 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d14156020 con 0x7f4d14158210 2024-04-25T09:06:59.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.118+0000 7f4d1b000640 1 -- 172.21.15.173:0/535059716 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d14153420 con 0x7f4d14158210 2024-04-25T09:06:59.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.122+0000 7f4d1b000640 1 -- 172.21.15.173:0/535059716 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d14073ab0 con 0x7f4d14158210 2024-04-25T09:06:59.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.122+0000 7f4d0be00640 1 -- 172.21.15.173:0/535059716 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4d0c01a070 con 0x7f4d14158210 2024-04-25T09:06:59.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.122+0000 7f4d0be00640 1 --2- 172.21.15.173:0/535059716 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4cf4066f60 0x7f4cf4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:59.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.122+0000 7f4d0be00640 1 -- 172.21.15.173:0/535059716 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4d0c085280 con 0x7f4d14158210 2024-04-25T09:06:59.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.122+0000 7f4d13e00640 1 --2- 172.21.15.173:0/535059716 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4cf4066f60 0x7f4cf4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:59.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.122+0000 7f4d13e00640 1 --2- 172.21.15.173:0/535059716 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4cf4066f60 0x7f4cf4069420 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4d140ce3a0 tx=0x7f4d04009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.126+0000 7f4d0be00640 1 -- 172.21.15.173:0/535059716 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4d0c056060 con 0x7f4d14158210 2024-04-25T09:06:59.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.282+0000 7f4d1b000640 1 -- 172.21.15.173:0/535059716 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d140b6b10 con 0x7f4d14158210 2024-04-25T09:06:59.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.282+0000 7f4d0be00640 1 -- 172.21.15.173:0/535059716 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d0c055960 con 0x7f4d14158210 2024-04-25T09:06:59.270 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:06:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.282+0000 7f4d1b000640 1 -- 172.21.15.173:0/535059716 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4cf4066f60 msgr2=0x7f4cf4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.282+0000 7f4d1b000640 1 --2- 172.21.15.173:0/535059716 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4cf4066f60 0x7f4cf4069420 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4d140ce3a0 tx=0x7f4d04009040 comp rx=0 tx=0).stop 2024-04-25T09:06:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.282+0000 7f4d1b000640 1 -- 172.21.15.173:0/535059716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d14158210 msgr2=0x7f4d141545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.282+0000 7f4d1b000640 1 --2- 172.21.15.173:0/535059716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d14158210 0x7f4d141545b0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00cbd0 tx=0x7f4d0c00a430 comp rx=0 tx=0).stop 2024-04-25T09:06:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.282+0000 7f4d1b000640 1 -- 172.21.15.173:0/535059716 shutdown_connections 2024-04-25T09:06:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.282+0000 7f4d1b000640 1 --2- 172.21.15.173:0/535059716 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4cf4066f60 0x7f4cf4069420 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.282+0000 7f4d1b000640 1 --2- 172.21.15.173:0/535059716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d14158210 0x7f4d141545b0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.282+0000 7f4d1b000640 1 --2- 172.21.15.173:0/535059716 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d140b5a60 0x7f4d14159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.282+0000 7f4d1b000640 1 --2- 172.21.15.173:0/535059716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d14070e70 0x7f4d1415b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.282+0000 7f4d1b000640 1 -- 172.21.15.173:0/535059716 >> 172.21.15.173:0/535059716 conn(0x7f4d140b3540 msgr2=0x7f4d140cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:59.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.282+0000 7f4d1b000640 1 -- 172.21.15.173:0/535059716 shutdown_connections 2024-04-25T09:06:59.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.282+0000 7f4d1b000640 1 -- 172.21.15.173:0/535059716 wait complete. 2024-04-25T09:06:59.291 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:06:59.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.438+0000 7f2abd000640 1 Processor -- start 2024-04-25T09:06:59.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.438+0000 7f2abd000640 1 -- start start 2024-04-25T09:06:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.442+0000 7f2abd000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ab8145290 0x7f2ab815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.442+0000 7f2abd000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2ab80b3fe0 0x7f2ab80b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.442+0000 7f2abd000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab815c5f0 con 0x7f2ab80cc260 2024-04-25T09:06:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.442+0000 7f2abd000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab806d4b0 con 0x7f2ab80b3fe0 2024-04-25T09:06:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.442+0000 7f2abd000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab806d790 con 0x7f2ab8145290 2024-04-25T09:06:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.442+0000 7f2ab5400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2ab80b3fe0 0x7f2ab80b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.442+0000 7f2ab5e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ab8145290 0x7f2ab815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.442+0000 7f2ab5e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ab8145290 0x7f2ab815c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:60550/0 (socket says 172.21.15.173:60550) 2024-04-25T09:06:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.442+0000 7f2ab5400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2ab80b3fe0 0x7f2ab80b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:38678/0 (socket says 172.21.15.173:38678) 2024-04-25T09:06:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.442+0000 7f2ab6800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f2ab80cc260 0x7f2ab80cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:51524/0 (socket says 172.21.15.173:51524) 2024-04-25T09:06:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.442+0000 7f2ab5e00640 1 -- 172.21.15.173:0/189266948 learned_addr learned my addr 172.21.15.173:0/189266948 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.442+0000 7f2ab4a00640 1 -- 172.21.15.173:0/189266948 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534033274 0 0) 0x7f2ab00014a0 con 0x7f2ab80cc260 2024-04-25T09:06:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.442+0000 7f2ab4a00640 1 -- 172.21.15.173:0/189266948 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a9c003530 con 0x7f2ab80cc260 2024-04-25T09:06:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.442+0000 7f2ab5400640 1 -- 172.21.15.173:0/189266948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ab8145290 msgr2=0x7f2ab815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.442+0000 7f2ab5400640 1 --2- 172.21.15.173:0/189266948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ab8145290 0x7f2ab815c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.442+0000 7f2ab5400640 1 -- 172.21.15.173:0/189266948 >> v1:172.21.15.194:6789/0 conn(0x7f2ab80cc260 legacy=0x7f2ab80cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.442+0000 7f2ab5400640 1 -- 172.21.15.173:0/189266948 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab806da70 con 0x7f2ab80b3fe0 2024-04-25T09:06:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.442+0000 7f2ab5e00640 1 --2- 172.21.15.173:0/189266948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ab8145290 0x7f2ab815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.446+0000 7f2ab5400640 1 --2- 172.21.15.173:0/189266948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ab80b3fe0 0x7f2ab80b4420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40097c0 tx=0x7f2aa401c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a4898547ef00502 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.446+0000 7f2ab4a00640 1 -- 172.21.15.173:0/189266948 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40b0070 con 0x7f2ab80b3fe0 2024-04-25T09:06:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.446+0000 7f2ab4a00640 1 -- 172.21.15.173:0/189266948 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa40ab600 con 0x7f2ab80b3fe0 2024-04-25T09:06:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.446+0000 7f2ab4a00640 1 -- 172.21.15.173:0/189266948 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40ab9d0 con 0x7f2ab80b3fe0 2024-04-25T09:06:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.446+0000 7f2abd000640 1 -- 172.21.15.173:0/189266948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ab80b3fe0 msgr2=0x7f2ab80b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.446+0000 7f2abd000640 1 --2- 172.21.15.173:0/189266948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ab80b3fe0 0x7f2ab80b4420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40097c0 tx=0x7f2aa401c380 comp rx=0 tx=0).stop 2024-04-25T09:06:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.446+0000 7f2abd000640 1 -- 172.21.15.173:0/189266948 shutdown_connections 2024-04-25T09:06:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.446+0000 7f2abd000640 1 --2- 172.21.15.173:0/189266948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ab80b3fe0 0x7f2ab80b4420 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.446+0000 7f2abd000640 1 --2- 172.21.15.173:0/189266948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ab8145290 0x7f2ab815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.446+0000 7f2abd000640 1 -- 172.21.15.173:0/189266948 >> 172.21.15.173:0/189266948 conn(0x7f2ab806ac90 msgr2=0x7f2ab806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:59.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.446+0000 7f2abd000640 1 -- 172.21.15.173:0/189266948 shutdown_connections 2024-04-25T09:06:59.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.446+0000 7f2abd000640 1 -- 172.21.15.173:0/189266948 wait complete. 2024-04-25T09:06:59.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.446+0000 7f2abd000640 1 Processor -- start 2024-04-25T09:06:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.446+0000 7f2abd000640 1 -- start start 2024-04-25T09:06:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2abd000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ab80b3fe0 0x7f2ab815acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2abd000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ab80cc260 0x7f2ab80acd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2abd000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ab8145290 0x7f2ab80cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2abd000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab806eee0 con 0x7f2ab8145290 2024-04-25T09:06:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2abd000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab806ed60 con 0x7f2ab80b3fe0 2024-04-25T09:06:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2abd000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab806f060 con 0x7f2ab80cc260 2024-04-25T09:06:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2ab6800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ab8145290 0x7f2ab80cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2ab5400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ab80cc260 0x7f2ab80acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2ab5e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ab80b3fe0 0x7f2ab815acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2ab6800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ab8145290 0x7f2ab80cd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53300/0 (socket says 172.21.15.173:53300) 2024-04-25T09:06:59.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2ab6800640 1 -- 172.21.15.173:0/958602322 learned_addr learned my addr 172.21.15.173:0/958602322 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:59.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2ab6800640 1 -- 172.21.15.173:0/958602322 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ab80cc260 msgr2=0x7f2ab80acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2ab6800640 1 --2- 172.21.15.173:0/958602322 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ab80cc260 0x7f2ab80acd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2ab6800640 1 -- 172.21.15.173:0/958602322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ab80b3fe0 msgr2=0x7f2ab815acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2ab6800640 1 --2- 172.21.15.173:0/958602322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ab80b3fe0 0x7f2ab815acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2ab6800640 1 -- 172.21.15.173:0/958602322 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab80ad700 con 0x7f2ab8145290 2024-04-25T09:06:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2ab6800640 1 --2- 172.21.15.173:0/958602322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ab8145290 0x7f2ab80cd620 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000c7a0 tx=0x7f2ab000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2aae000640 1 -- 172.21.15.173:0/958602322 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0017070 con 0x7f2ab8145290 2024-04-25T09:06:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2aae000640 1 -- 172.21.15.173:0/958602322 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab000a640 con 0x7f2ab8145290 2024-04-25T09:06:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2aae000640 1 -- 172.21.15.173:0/958602322 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab000aa10 con 0x7f2ab8145290 2024-04-25T09:06:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2abd000640 1 -- 172.21.15.173:0/958602322 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab80ad9e0 con 0x7f2ab8145290 2024-04-25T09:06:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2abd000640 1 -- 172.21.15.173:0/958602322 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab80adfa0 con 0x7f2ab8145290 2024-04-25T09:06:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.450+0000 7f2abd000640 1 -- 172.21.15.173:0/958602322 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab8073ab0 con 0x7f2ab8145290 2024-04-25T09:06:59.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.454+0000 7f2aae000640 1 -- 172.21.15.173:0/958602322 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2ab001a070 con 0x7f2ab8145290 2024-04-25T09:06:59.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.454+0000 7f2aae000640 1 --2- 172.21.15.173:0/958602322 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2a98066f60 0x7f2a98069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:59.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.454+0000 7f2aae000640 1 -- 172.21.15.173:0/958602322 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2ab00848c0 con 0x7f2ab8145290 2024-04-25T09:06:59.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.454+0000 7f2ab5e00640 1 --2- 172.21.15.173:0/958602322 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2a98066f60 0x7f2a98069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:59.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.454+0000 7f2ab5e00640 1 --2- 172.21.15.173:0/958602322 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2a98066f60 0x7f2a98069420 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8006cb0 tx=0x7f2aa8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:59.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.458+0000 7f2aae000640 1 -- 172.21.15.173:0/958602322 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2ab815c5f0 con 0x7f2ab8145290 2024-04-25T09:06:59.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.622+0000 7f2abd000640 1 -- 172.21.15.173:0/958602322 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2ab8144110 con 0x7f2ab8145290 2024-04-25T09:06:59.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.622+0000 7f2aae000640 1 -- 172.21.15.173:0/958602322 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2ab0054fc0 con 0x7f2ab8145290 2024-04-25T09:06:59.611 INFO:teuthology.orchestra.run.smithi173.stderr:listed 0 entries 2024-04-25T09:06:59.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.626+0000 7f2abd000640 1 -- 172.21.15.173:0/958602322 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2a98066f60 msgr2=0x7f2a98069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.626+0000 7f2abd000640 1 --2- 172.21.15.173:0/958602322 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2a98066f60 0x7f2a98069420 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8006cb0 tx=0x7f2aa8009240 comp rx=0 tx=0).stop 2024-04-25T09:06:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.626+0000 7f2abd000640 1 -- 172.21.15.173:0/958602322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ab8145290 msgr2=0x7f2ab80cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.626+0000 7f2abd000640 1 --2- 172.21.15.173:0/958602322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ab8145290 0x7f2ab80cd620 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000c7a0 tx=0x7f2ab000cc60 comp rx=0 tx=0).stop 2024-04-25T09:06:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.626+0000 7f2abd000640 1 -- 172.21.15.173:0/958602322 shutdown_connections 2024-04-25T09:06:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.626+0000 7f2abd000640 1 --2- 172.21.15.173:0/958602322 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2a98066f60 0x7f2a98069420 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.626+0000 7f2abd000640 1 --2- 172.21.15.173:0/958602322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ab8145290 0x7f2ab80cd620 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.626+0000 7f2abd000640 1 --2- 172.21.15.173:0/958602322 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ab80cc260 0x7f2ab80acd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.626+0000 7f2abd000640 1 --2- 172.21.15.173:0/958602322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ab80b3fe0 0x7f2ab815acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.626+0000 7f2abd000640 1 -- 172.21.15.173:0/958602322 >> 172.21.15.173:0/958602322 conn(0x7f2ab806ac90 msgr2=0x7f2ab80cb950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.626+0000 7f2abd000640 1 -- 172.21.15.173:0/958602322 shutdown_connections 2024-04-25T09:06:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.626+0000 7f2abd000640 1 -- 172.21.15.173:0/958602322 wait complete. 2024-04-25T09:06:59.633 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:06:59.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:59.633 DEBUG:teuthology.orchestra.run.smithi173:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:59.683 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:06:59.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:59.683 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:06:59.732 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:59.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.926+0000 7f86d5800640 1 Processor -- start 2024-04-25T09:06:59.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.926+0000 7f86d5800640 1 -- start start 2024-04-25T09:06:59.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.926+0000 7f86d5800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f86d0160fe0 0x7f86d0161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:59.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.926+0000 7f86d5800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f86d006dac0 0x7f86d00ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:59.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.926+0000 7f86d5800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d0061d60 con 0x7f86d006bca0 2024-04-25T09:06:59.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.926+0000 7f86d5800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d01613c0 con 0x7f86d006dac0 2024-04-25T09:06:59.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.926+0000 7f86d5800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d006dfa0 con 0x7f86d0160fe0 2024-04-25T09:06:59.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.930+0000 7f86c6000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f86d006dac0 0x7f86d00ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:59.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.930+0000 7f86c6000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f86d006dac0 0x7f86d00ace00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53316/0 (socket says 172.21.15.173:53316) 2024-04-25T09:06:59.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.930+0000 7f86c6000640 1 -- 172.21.15.173:0/1752041032 learned_addr learned my addr 172.21.15.173:0/1752041032 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:59.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.930+0000 7f86cea00640 1 --2- 172.21.15.173:0/1752041032 >> v2:172.21.15.194:3300/0 conn(0x7f86d0160fe0 0x7f86d0161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:59.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.930+0000 7f86c6000640 1 -- 172.21.15.173:0/1752041032 >> v2:172.21.15.194:3300/0 conn(0x7f86d0160fe0 msgr2=0x7f86d0161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:59.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.930+0000 7f86c6000640 1 --2- 172.21.15.173:0/1752041032 >> v2:172.21.15.194:3300/0 conn(0x7f86d0160fe0 0x7f86d0161fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.930+0000 7f86c6000640 1 -- 172.21.15.173:0/1752041032 >> v1:172.21.15.194:6789/0 conn(0x7f86d006bca0 legacy=0x7f86d006f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:59.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.930+0000 7f86c6000640 1 -- 172.21.15.173:0/1752041032 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d006e280 con 0x7f86d006dac0 2024-04-25T09:06:59.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.930+0000 7f86c6000640 1 --2- 172.21.15.173:0/1752041032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86d006dac0 0x7f86d00ace00 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f86d0071070 tx=0x7f86b801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95ec9a8369aa19b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:59.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.930+0000 7f86ce000640 1 -- 172.21.15.173:0/1752041032 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b80b0070 con 0x7f86d006dac0 2024-04-25T09:06:59.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.930+0000 7f86ce000640 1 -- 172.21.15.173:0/1752041032 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b80ab600 con 0x7f86d006dac0 2024-04-25T09:06:59.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.930+0000 7f86ce000640 1 -- 172.21.15.173:0/1752041032 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b80ab9d0 con 0x7f86d006dac0 2024-04-25T09:06:59.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86d5800640 1 -- 172.21.15.173:0/1752041032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86d006dac0 msgr2=0x7f86d00ace00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:59.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86d5800640 1 --2- 172.21.15.173:0/1752041032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86d006dac0 0x7f86d00ace00 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f86d0071070 tx=0x7f86b801c460 comp rx=0 tx=0).stop 2024-04-25T09:06:59.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86d5800640 1 -- 172.21.15.173:0/1752041032 shutdown_connections 2024-04-25T09:06:59.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86d5800640 1 --2- 172.21.15.173:0/1752041032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86d006dac0 0x7f86d00ace00 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86d5800640 1 --2- 172.21.15.173:0/1752041032 >> v2:172.21.15.194:3300/0 conn(0x7f86d0160fe0 0x7f86d0161fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86d5800640 1 -- 172.21.15.173:0/1752041032 >> 172.21.15.173:0/1752041032 conn(0x7f86d0071c20 msgr2=0x7f86d0072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:59.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86d5800640 1 -- 172.21.15.173:0/1752041032 shutdown_connections 2024-04-25T09:06:59.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86d5800640 1 -- 172.21.15.173:0/1752041032 wait complete. 2024-04-25T09:06:59.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86d5800640 1 Processor -- start 2024-04-25T09:06:59.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86d5800640 1 -- start start 2024-04-25T09:06:59.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86d5800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86d006bca0 0x7f86d015ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:59.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86d5800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86d006dac0 0x7f86d0140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:59.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86d5800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86d0160fe0 0x7f86d0153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:59.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86d5800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d006c4c0 con 0x7f86d0160fe0 2024-04-25T09:06:59.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86d5800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d01624f0 con 0x7f86d006bca0 2024-04-25T09:06:59.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86d5800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d01604c0 con 0x7f86d006dac0 2024-04-25T09:06:59.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86cf400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86d0160fe0 0x7f86d0153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:59.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86c6000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86d006dac0 0x7f86d0140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:59.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86cea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86d006bca0 0x7f86d015ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:59.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86c6000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86d006dac0 0x7f86d0140680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:60578/0 (socket says 172.21.15.173:60578) 2024-04-25T09:06:59.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86cf400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86d0160fe0 0x7f86d0153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53322/0 (socket says 172.21.15.173:53322) 2024-04-25T09:06:59.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86c6000640 1 -- 172.21.15.173:0/1821888563 learned_addr learned my addr 172.21.15.173:0/1821888563 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:06:59.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86c6000640 1 -- 172.21.15.173:0/1821888563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86d006bca0 msgr2=0x7f86d015ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:59.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86c6000640 1 --2- 172.21.15.173:0/1821888563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86d006bca0 0x7f86d015ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86c6000640 1 -- 172.21.15.173:0/1821888563 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86d0160fe0 msgr2=0x7f86d0153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:59.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86c6000640 1 --2- 172.21.15.173:0/1821888563 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86d0160fe0 0x7f86d0153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:59.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86c6000640 1 -- 172.21.15.173:0/1821888563 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d00acf10 con 0x7f86d006dac0 2024-04-25T09:06:59.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.934+0000 7f86cf400640 1 --2- 172.21.15.173:0/1821888563 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86d0160fe0 0x7f86d0153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:59.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.938+0000 7f86c6000640 1 --2- 172.21.15.173:0/1821888563 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86d006dac0 0x7f86d0140680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f86b8019070 tx=0x7f86b8019200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:59.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.938+0000 7f86c7400640 1 -- 172.21.15.173:0/1821888563 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b80b0040 con 0x7f86d006dac0 2024-04-25T09:06:59.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.938+0000 7f86c7400640 1 -- 172.21.15.173:0/1821888563 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b80b4420 con 0x7f86d006dac0 2024-04-25T09:06:59.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.938+0000 7f86c7400640 1 -- 172.21.15.173:0/1821888563 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b80b47f0 con 0x7f86d006dac0 2024-04-25T09:06:59.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.938+0000 7f86d5800640 1 -- 172.21.15.173:0/1821888563 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d00ad1f0 con 0x7f86d006dac0 2024-04-25T09:06:59.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.938+0000 7f86d5800640 1 -- 172.21.15.173:0/1821888563 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d00ad7b0 con 0x7f86d006dac0 2024-04-25T09:06:59.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.938+0000 7f86d5800640 1 -- 172.21.15.173:0/1821888563 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d0073a40 con 0x7f86d006dac0 2024-04-25T09:06:59.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.938+0000 7f86c7400640 1 -- 172.21.15.173:0/1821888563 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f86b80b4990 con 0x7f86d006dac0 2024-04-25T09:06:59.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.938+0000 7f86c7400640 1 --2- 172.21.15.173:0/1821888563 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f86ac066f60 0x7f86ac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:59.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.938+0000 7f86c7400640 1 -- 172.21.15.173:0/1821888563 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f86b811eb90 con 0x7f86d006dac0 2024-04-25T09:06:59.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.938+0000 7f86cea00640 1 --2- 172.21.15.173:0/1821888563 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f86ac066f60 0x7f86ac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:59.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.942+0000 7f86cea00640 1 --2- 172.21.15.173:0/1821888563 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f86ac066f60 0x7f86ac069420 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009ac0 tx=0x7f86c0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:59.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:06:59.946+0000 7f86c7400640 1 -- 172.21.15.173:0/1821888563 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f86b8016110 con 0x7f86d006dac0 2024-04-25T09:07:00.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.242+0000 7f86d5800640 1 -- 172.21.15.173:0/1821888563 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86d015e760 con 0x7f86d006dac0 2024-04-25T09:07:00.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.242+0000 7f86c7400640 1 -- 172.21.15.173:0/1821888563 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4945 (secure 0 0 0) 0x7f86b80ef4d0 con 0x7f86d006dac0 2024-04-25T09:07:00.231 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:00.231 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5873,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1118362753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":1118362753},{"type":"v1","addr":"172.21.15.173:6837","nonce":1118362753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6340,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/853427023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":853427023},{"type":"v1","addr":"172.21.15.194:6834","nonce":853427023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6343,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2791623450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2791623450},{"type":"v1","addr":"172.21.15.194:6835","nonce":2791623450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:50.132659+0000","modified":"2024-04-25T09:06:53.143192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6711":{"gid":6711,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6836/962695208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":962695208},{"type":"v1","addr":"172.21.15.173:6836","nonce":962695208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:07:00.231 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 39 2024-04-25T09:07:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.246+0000 7f86d5800640 1 -- 172.21.15.173:0/1821888563 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f86ac066f60 msgr2=0x7f86ac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.246+0000 7f86d5800640 1 --2- 172.21.15.173:0/1821888563 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f86ac066f60 0x7f86ac069420 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009ac0 tx=0x7f86c0009190 comp rx=0 tx=0).stop 2024-04-25T09:07:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.246+0000 7f86d5800640 1 -- 172.21.15.173:0/1821888563 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86d006dac0 msgr2=0x7f86d0140680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.246+0000 7f86d5800640 1 --2- 172.21.15.173:0/1821888563 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86d006dac0 0x7f86d0140680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f86b8019070 tx=0x7f86b8019200 comp rx=0 tx=0).stop 2024-04-25T09:07:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.246+0000 7f86d5800640 1 -- 172.21.15.173:0/1821888563 shutdown_connections 2024-04-25T09:07:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.246+0000 7f86d5800640 1 --2- 172.21.15.173:0/1821888563 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f86ac066f60 0x7f86ac069420 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.246+0000 7f86d5800640 1 --2- 172.21.15.173:0/1821888563 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86d0160fe0 0x7f86d0153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.246+0000 7f86d5800640 1 --2- 172.21.15.173:0/1821888563 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86d006dac0 0x7f86d0140680 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.246+0000 7f86d5800640 1 --2- 172.21.15.173:0/1821888563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86d006bca0 0x7f86d015ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.246+0000 7f86d5800640 1 -- 172.21.15.173:0/1821888563 >> 172.21.15.173:0/1821888563 conn(0x7f86d0071c20 msgr2=0x7f86d015ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.246+0000 7f86d5800640 1 -- 172.21.15.173:0/1821888563 shutdown_connections 2024-04-25T09:07:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.246+0000 7f86d5800640 1 -- 172.21.15.173:0/1821888563 wait complete. 2024-04-25T09:07:00.253 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T09:07:00.423 INFO:teuthology.orchestra.run.smithi173.stdout:{"message":"","return_code":0} 2024-04-25T09:07:00.423 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:07:00.424 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:07:00.424 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:00.424 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:07:00.424 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:00.424 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:07:00.425 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:00.425 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:07:00.425 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:00.438 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:07:00.438 DEBUG:teuthology.parallel:result is None 2024-04-25T09:07:00.439 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:07:00.439 DEBUG:teuthology.parallel:result is None 2024-04-25T09:07:00.440 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:07:00.440 DEBUG:teuthology.parallel:result is None 2024-04-25T09:07:00.453 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:07:00.453 DEBUG:teuthology.parallel:result is None 2024-04-25T09:07:00.454 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.00000000 file_head 2024-04-25T09:07:00.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17de480080 1 Processor -- start 2024-04-25T09:07:00.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17de480080 1 -- start start 2024-04-25T09:07:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17de480080 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5568a0e68350 0x5568a0dc9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17de480080 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5568a0e81730 0x5568a0da8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17de480080 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568a0e7f480 0x5568a0e66140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17de480080 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a0d4d9f0 con 0x5568a0e7f480 2024-04-25T09:07:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17de480080 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a0d51950 con 0x5568a0e81730 2024-04-25T09:07:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17de480080 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568a0dd5b40 con 0x5568a0e68350 2024-04-25T09:07:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17dc000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568a0e7f480 0x5568a0e66140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17dc000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568a0e7f480 0x5568a0e66140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53338/0 (socket says 172.21.15.173:53338) 2024-04-25T09:07:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17dc000640 1 -- 172.21.15.173:0/1371976108 learned_addr learned my addr 172.21.15.173:0/1371976108 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17dc000640 1 -- 172.21.15.173:0/1371976108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5568a0e68350 msgr2=0x5568a0dc9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17dc000640 1 --2- 172.21.15.173:0/1371976108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5568a0e68350 0x5568a0dc9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17dc000640 1 -- 172.21.15.173:0/1371976108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5568a0e81730 msgr2=0x5568a0da8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:00.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17dc000640 1 --2- 172.21.15.173:0/1371976108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5568a0e81730 0x5568a0da8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17dc000640 1 -- 172.21.15.173:0/1371976108 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568a0e81c40 con 0x5568a0e7f480 2024-04-25T09:07:00.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17dc000640 1 --2- 172.21.15.173:0/1371976108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568a0e7f480 0x5568a0e66140 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f17c0003010 tx=0x7f17d4003a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c406ec3836c9fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:00.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17d9800640 1 -- 172.21.15.173:0/1371976108 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4018070 con 0x5568a0e7f480 2024-04-25T09:07:00.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17d9800640 1 -- 172.21.15.173:0/1371976108 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d4003110 con 0x5568a0e7f480 2024-04-25T09:07:00.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17d9800640 1 -- 172.21.15.173:0/1371976108 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4001620 con 0x5568a0e7f480 2024-04-25T09:07:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17de480080 1 -- 172.21.15.173:0/1371976108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568a0e7f480 msgr2=0x5568a0e66140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17de480080 1 --2- 172.21.15.173:0/1371976108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568a0e7f480 0x5568a0e66140 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f17c0003010 tx=0x7f17d4003a10 comp rx=0 tx=0).stop 2024-04-25T09:07:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17de480080 1 -- 172.21.15.173:0/1371976108 shutdown_connections 2024-04-25T09:07:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17de480080 1 --2- 172.21.15.173:0/1371976108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568a0e7f480 0x5568a0e66140 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17de480080 1 --2- 172.21.15.173:0/1371976108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5568a0e81730 0x5568a0da8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17de480080 1 --2- 172.21.15.173:0/1371976108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5568a0e68350 0x5568a0dc9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17de480080 1 -- 172.21.15.173:0/1371976108 >> 172.21.15.173:0/1371976108 conn(0x5568a0da75a0 msgr2=0x5568a0da9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17de480080 1 -- 172.21.15.173:0/1371976108 shutdown_connections 2024-04-25T09:07:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.542+0000 7f17de480080 1 -- 172.21.15.173:0/1371976108 wait complete. 2024-04-25T09:07:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17de480080 1 Processor -- start 2024-04-25T09:07:00.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17de480080 1 -- start start 2024-04-25T09:07:00.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17de480080 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5568a0e68350 0x5568a0e5ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17de480080 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5568a0e7f480 0x5568a0e646e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17de480080 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568a0e81730 0x5568a0e64c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17de480080 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a0debfc0 con 0x5568a0e81730 2024-04-25T09:07:00.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17de480080 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a0debd20 con 0x5568a0e7f480 2024-04-25T09:07:00.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17de480080 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568a0dec260 con 0x5568a0e68350 2024-04-25T09:07:00.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17dc000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568a0e81730 0x5568a0e64c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17dc000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568a0e81730 0x5568a0e64c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53354/0 (socket says 172.21.15.173:53354) 2024-04-25T09:07:00.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17dc000640 1 -- 172.21.15.173:0/2622252103 learned_addr learned my addr 172.21.15.173:0/2622252103 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:00.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17db600640 1 --2- 172.21.15.173:0/2622252103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5568a0e68350 0x5568a0e5ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17dac00640 1 --2- 172.21.15.173:0/2622252103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5568a0e7f480 0x5568a0e646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17dc000640 1 -- 172.21.15.173:0/2622252103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5568a0e68350 msgr2=0x5568a0e5ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17dc000640 1 --2- 172.21.15.173:0/2622252103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5568a0e68350 0x5568a0e5ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17dc000640 1 -- 172.21.15.173:0/2622252103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5568a0e7f480 msgr2=0x5568a0e646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17dc000640 1 --2- 172.21.15.173:0/2622252103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5568a0e7f480 0x5568a0e646e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17dc000640 1 -- 172.21.15.173:0/2622252103 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568a0e60610 con 0x5568a0e81730 2024-04-25T09:07:00.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17dc000640 1 --2- 172.21.15.173:0/2622252103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568a0e81730 0x5568a0e64c20 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x5568a0dab530 tx=0x7f17d4001520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:00.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17d3e00640 1 -- 172.21.15.173:0/2622252103 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4018030 con 0x5568a0e81730 2024-04-25T09:07:00.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17d3e00640 1 -- 172.21.15.173:0/2622252103 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d4024070 con 0x5568a0e81730 2024-04-25T09:07:00.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17de480080 1 -- 172.21.15.173:0/2622252103 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5568a0e608b0 con 0x5568a0e81730 2024-04-25T09:07:00.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17d3e00640 1 -- 172.21.15.173:0/2622252103 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d40136b0 con 0x5568a0e81730 2024-04-25T09:07:00.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.546+0000 7f17de480080 1 -- 172.21.15.173:0/2622252103 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568a0e60df0 con 0x5568a0e81730 2024-04-25T09:07:00.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.550+0000 7f17d3e00640 1 -- 172.21.15.173:0/2622252103 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f17d4029460 con 0x5568a0e81730 2024-04-25T09:07:00.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.550+0000 7f17d3e00640 1 --2- 172.21.15.173:0/2622252103 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f17bc065970 0x7f17bc067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.550+0000 7f17d3e00640 1 -- 172.21.15.173:0/2622252103 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f17d4085140 con 0x5568a0e81730 2024-04-25T09:07:00.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.550+0000 7f17db600640 1 --2- 172.21.15.173:0/2622252103 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f17bc065970 0x7f17bc067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.550+0000 7f17de480080 1 --2- 172.21.15.173:0/2622252103 >> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] conn(0x5568a0e62950 0x5568a0e62d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.550+0000 7f17de480080 1 -- 172.21.15.173:0/2622252103 --> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] -- osd_op(unknown.0.0:1 9.10 9:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69) v9 -- 0x5568a0e5f4d0 con 0x5568a0e62950 2024-04-25T09:07:00.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.550+0000 7f17dac00640 1 --2- 172.21.15.173:0/2622252103 >> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] conn(0x5568a0e62950 0x5568a0e62d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.550+0000 7f17db600640 1 --2- 172.21.15.173:0/2622252103 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f17bc065970 0x7f17bc067e30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009a30 tx=0x7f17cc001980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:00.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.550+0000 7f17dac00640 1 --2- 172.21.15.173:0/2622252103 >> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] conn(0x5568a0e62950 0x5568a0e62d30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:00.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.554+0000 7f17dac00640 1 -- 172.21.15.173:0/2622252103 <== osd.4 v2:172.21.15.194:6805/3578285787 1 ==== osd_op_reply(1 10000000000.00000000 [omap-rm-keys] v69'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f17c80096c0 con 0x5568a0e62950 2024-04-25T09:07:00.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.554+0000 7f17de480080 1 -- 172.21.15.173:0/2622252103 >> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] conn(0x5568a0e62950 msgr2=0x5568a0e62d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.554+0000 7f17de480080 1 --2- 172.21.15.173:0/2622252103 >> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] conn(0x5568a0e62950 0x5568a0e62d30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.554+0000 7f17de480080 1 -- 172.21.15.173:0/2622252103 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f17bc065970 msgr2=0x7f17bc067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.554+0000 7f17de480080 1 --2- 172.21.15.173:0/2622252103 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f17bc065970 0x7f17bc067e30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009a30 tx=0x7f17cc001980 comp rx=0 tx=0).stop 2024-04-25T09:07:00.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.554+0000 7f17de480080 1 -- 172.21.15.173:0/2622252103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568a0e81730 msgr2=0x5568a0e64c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.554+0000 7f17de480080 1 --2- 172.21.15.173:0/2622252103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568a0e81730 0x5568a0e64c20 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x5568a0dab530 tx=0x7f17d4001520 comp rx=0 tx=0).stop 2024-04-25T09:07:00.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.554+0000 7f17dc000640 1 -- 172.21.15.173:0/2622252103 reap_dead start 2024-04-25T09:07:00.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.554+0000 7f17de480080 1 -- 172.21.15.173:0/2622252103 shutdown_connections 2024-04-25T09:07:00.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.554+0000 7f17de480080 1 -- 172.21.15.173:0/2622252103 >> 172.21.15.173:0/2622252103 conn(0x5568a0da75a0 msgr2=0x5568a0e7fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:00.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.554+0000 7f17de480080 1 -- 172.21.15.173:0/2622252103 shutdown_connections 2024-04-25T09:07:00.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.554+0000 7f17de480080 1 -- 172.21.15.173:0/2622252103 wait complete. 2024-04-25T09:07:00.546 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2024-04-25T09:07:00.546 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-04-25T09:07:00.546 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-04-25T09:07:00.546 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-04-25T09:07:00.547 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2024-04-25T09:07:00.547 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-04-25T09:07:00.547 ERROR:tasks.ceph.mds.d:tried to stop a non-running daemon 2024-04-25T09:07:00.547 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-04-25T09:07:00.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.706+0000 7f9641800640 1 Processor -- start 2024-04-25T09:07:00.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.706+0000 7fa748e00640 1 Processor -- start 2024-04-25T09:07:00.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.706+0000 7f9641800640 1 -- start start 2024-04-25T09:07:00.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.706+0000 7fa748e00640 1 -- start start 2024-04-25T09:07:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7f9641800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c0cc800 0x7f963c0cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7f9641800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f963c0b2770 con 0x7f963c0aea40 2024-04-25T09:07:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7f9641800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f963c071e80 con 0x7f963c161f80 2024-04-25T09:07:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7f9641800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963c072160 con 0x7f963c0cc800 2024-04-25T09:07:00.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7f963b400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f963c0aea40 0x7f963c0cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:35258/0 (socket says 172.21.15.173:35258) 2024-04-25T09:07:00.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7f963b400640 1 -- 172.21.15.173:0/3013409797 learned_addr learned my addr 172.21.15.173:0/3013409797 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:00.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7f963a000640 1 --2- 172.21.15.173:0/3013409797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c0cc800 0x7f963c0cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7f9639600640 1 -- 172.21.15.173:0/3013409797 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087318443 0 0) 0x7f96340014a0 con 0x7f963c0aea40 2024-04-25T09:07:00.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7f9639600640 1 -- 172.21.15.173:0/3013409797 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9620003530 con 0x7f963c0aea40 2024-04-25T09:07:00.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7f9639600640 1 -- 172.21.15.173:0/3013409797 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490362851 0 0) 0x7f963c071e80 con 0x7f963c161f80 2024-04-25T09:07:00.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7f9639600640 1 -- 172.21.15.173:0/3013409797 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96340014a0 con 0x7f963c161f80 2024-04-25T09:07:00.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7f963a000640 1 -- 172.21.15.173:0/3013409797 >> v1:172.21.15.194:6789/0 conn(0x7f963c161f80 legacy=0x7f963c0cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7f9639600640 1 -- 172.21.15.173:0/3013409797 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3596978122 0 0) 0x7f9620003530 con 0x7f963c0aea40 2024-04-25T09:07:00.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7f963a000640 1 -- 172.21.15.173:0/3013409797 >> v1:172.21.15.173:6789/0 conn(0x7f963c0aea40 legacy=0x7f963c0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7f963a000640 1 -- 172.21.15.173:0/3013409797 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963c072440 con 0x7f963c0cc800 2024-04-25T09:07:00.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7fa748e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa74415bab0 0x7fa7440d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7fa748e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7440cd840 0x7fa744099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7fa748e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa744099f90 0x7fa7440c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7fa748e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7440d07e0 con 0x7fa74415bab0 2024-04-25T09:07:00.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7fa748e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7440cc7a0 con 0x7fa744099f90 2024-04-25T09:07:00.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7fa748e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7440cca80 con 0x7fa7440cd840 2024-04-25T09:07:00.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7fa741e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa74415bab0 0x7fa7440d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7fa741e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa74415bab0 0x7fa7440d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53364/0 (socket says 172.21.15.173:53364) 2024-04-25T09:07:00.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7fa741e00640 1 -- 172.21.15.173:0/4013318177 learned_addr learned my addr 172.21.15.173:0/4013318177 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:00.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7fa742800640 1 --2- 172.21.15.173:0/4013318177 >> v2:172.21.15.194:3300/0 conn(0x7fa744099f90 0x7fa7440c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7fa741400640 1 --2- 172.21.15.173:0/4013318177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7440cd840 0x7fa744099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7fa741e00640 1 -- 172.21.15.173:0/4013318177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7440cd840 msgr2=0x7fa744099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:00.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7fa741e00640 1 --2- 172.21.15.173:0/4013318177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7440cd840 0x7fa744099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7fa741e00640 1 -- 172.21.15.173:0/4013318177 >> v2:172.21.15.194:3300/0 conn(0x7fa744099f90 msgr2=0x7fa7440c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:00.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7fa741e00640 1 --2- 172.21.15.173:0/4013318177 >> v2:172.21.15.194:3300/0 conn(0x7fa744099f90 0x7fa7440c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7fa741e00640 1 -- 172.21.15.173:0/4013318177 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7440ccd60 con 0x7fa74415bab0 2024-04-25T09:07:00.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.710+0000 7fa741400640 1 --2- 172.21.15.173:0/4013318177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7440cd840 0x7fa744099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:00.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7f963a000640 1 --2- 172.21.15.173:0/3013409797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c0cc800 0x7f963c0cd2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f96280097f0 tx=0x7f962801c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1744e208f9c9e3b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:00.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7fa741e00640 1 --2- 172.21.15.173:0/4013318177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74415bab0 0x7fa7440d02a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fa744072c40 tx=0x7fa73401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cda68c69ac1845e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:00.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7f9639600640 1 -- 172.21.15.173:0/3013409797 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96280b1070 con 0x7f963c0cc800 2024-04-25T09:07:00.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7f9639600640 1 -- 172.21.15.173:0/3013409797 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96280a4c80 con 0x7f963c0cc800 2024-04-25T09:07:00.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7f9639600640 1 -- 172.21.15.173:0/3013409797 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9634001bd0 con 0x7f963c0cc800 2024-04-25T09:07:00.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7fa740a00640 1 -- 172.21.15.173:0/4013318177 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7340b0070 con 0x7fa74415bab0 2024-04-25T09:07:00.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7fa740a00640 1 -- 172.21.15.173:0/4013318177 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7340ab600 con 0x7fa74415bab0 2024-04-25T09:07:00.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7fa740a00640 1 -- 172.21.15.173:0/4013318177 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7340ab9d0 con 0x7fa74415bab0 2024-04-25T09:07:00.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7f9641800640 1 -- 172.21.15.173:0/3013409797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c0cc800 msgr2=0x7f963c0cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7f9641800640 1 --2- 172.21.15.173:0/3013409797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c0cc800 0x7f963c0cd2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f96280097f0 tx=0x7f962801c300 comp rx=0 tx=0).stop 2024-04-25T09:07:00.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7f9641800640 1 -- 172.21.15.173:0/3013409797 shutdown_connections 2024-04-25T09:07:00.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7f9641800640 1 --2- 172.21.15.173:0/3013409797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c0cc800 0x7f963c0cd2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7f9641800640 1 -- 172.21.15.173:0/3013409797 >> 172.21.15.173:0/3013409797 conn(0x7f963c06ac90 msgr2=0x7f963c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:00.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7f9641800640 1 -- 172.21.15.173:0/3013409797 shutdown_connections 2024-04-25T09:07:00.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7f9641800640 1 -- 172.21.15.173:0/3013409797 wait complete. 2024-04-25T09:07:00.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7fa748e00640 1 -- 172.21.15.173:0/4013318177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74415bab0 msgr2=0x7fa7440d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7fa748e00640 1 --2- 172.21.15.173:0/4013318177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74415bab0 0x7fa7440d02a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fa744072c40 tx=0x7fa73401c520 comp rx=0 tx=0).stop 2024-04-25T09:07:00.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7fa748e00640 1 -- 172.21.15.173:0/4013318177 shutdown_connections 2024-04-25T09:07:00.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7fa748e00640 1 --2- 172.21.15.173:0/4013318177 >> v2:172.21.15.194:3300/0 conn(0x7fa744099f90 0x7fa7440c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7fa748e00640 1 --2- 172.21.15.173:0/4013318177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7440cd840 0x7fa744099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7fa748e00640 1 --2- 172.21.15.173:0/4013318177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74415bab0 0x7fa7440d02a0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7fa748e00640 1 -- 172.21.15.173:0/4013318177 >> 172.21.15.173:0/4013318177 conn(0x7fa7440b32a0 msgr2=0x7fa7440b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:00.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7fa748e00640 1 -- 172.21.15.173:0/4013318177 shutdown_connections 2024-04-25T09:07:00.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.714+0000 7fa748e00640 1 -- 172.21.15.173:0/4013318177 wait complete. 2024-04-25T09:07:00.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f859c400640 1 Processor -- start 2024-04-25T09:07:00.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f859c400640 1 -- start start 2024-04-25T09:07:00.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f9641800640 1 Processor -- start 2024-04-25T09:07:00.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f9641800640 1 -- start start 2024-04-25T09:07:00.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7fa748e00640 1 Processor -- start 2024-04-25T09:07:00.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7fa748e00640 1 -- start start 2024-04-25T09:07:00.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f859c400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f859415bb00 0x7f85940cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f859c400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f85940b16c0 0x7f85940b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f859c400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f859415bee0 0x7f859415c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f859c400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f859415cf40 con 0x7f859415bee0 2024-04-25T09:07:00.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f859c400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85940b2060 con 0x7f85940b16c0 2024-04-25T09:07:00.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f859c400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859415cc60 con 0x7f859415bb00 2024-04-25T09:07:00.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f859a400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f859415bee0 0x7f859415c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f9641800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c0aea40 0x7f963c15ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f9641800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f963c0cc800 0x7f963c14b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f859a400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f859415bee0 0x7f859415c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53372/0 (socket says 172.21.15.173:53372) 2024-04-25T09:07:00.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f859a400640 1 -- 172.21.15.173:0/3974153507 learned_addr learned my addr 172.21.15.173:0/3974153507 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:00.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f9641800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f963c161f80 0x7f963c164610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f9641800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963c071730 con 0x7f963c0cc800 2024-04-25T09:07:00.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f9641800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963c0715b0 con 0x7f963c161f80 2024-04-25T09:07:00.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f9641800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963c16fc00 con 0x7f963c0aea40 2024-04-25T09:07:00.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f8599a00640 1 --2- 172.21.15.173:0/3974153507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f859415bb00 0x7f85940cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f8599000640 1 --2- 172.21.15.173:0/3974153507 >> v2:172.21.15.194:3300/0 conn(0x7f85940b16c0 0x7f85940b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f963a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f963c0cc800 0x7f963c14b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f963b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f963c161f80 0x7f963c164610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f963a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f963c0cc800 0x7f963c14b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53374/0 (socket says 172.21.15.173:53374) 2024-04-25T09:07:00.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f963a000640 1 -- 172.21.15.173:0/1026861219 learned_addr learned my addr 172.21.15.173:0/1026861219 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:00.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7fa748e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa744099f90 0x7fa7440b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f963aa00640 1 --2- 172.21.15.173:0/1026861219 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c0aea40 0x7f963c15ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7fa748e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7440cd840 0x7fa744154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7fa748e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74415bab0 0x7fa744155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7fa748e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7440cc540 con 0x7fa74415bab0 2024-04-25T09:07:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7fa748e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7440cc3c0 con 0x7fa744099f90 2024-04-25T09:07:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7fa748e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7440cf540 con 0x7fa7440cd840 2024-04-25T09:07:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f963a000640 1 -- 172.21.15.173:0/1026861219 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c0aea40 msgr2=0x7f963c15ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f963a000640 1 --2- 172.21.15.173:0/1026861219 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c0aea40 0x7f963c15ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f963a000640 1 -- 172.21.15.173:0/1026861219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f963c161f80 msgr2=0x7f963c164610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f963a000640 1 --2- 172.21.15.173:0/1026861219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f963c161f80 0x7f963c164610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f963a000640 1 -- 172.21.15.173:0/1026861219 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963c14aa50 con 0x7f963c0cc800 2024-04-25T09:07:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f963aa00640 1 --2- 172.21.15.173:0/1026861219 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c0aea40 0x7f963c15ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f8599000640 1 -- 172.21.15.173:0/3974153507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f859415bb00 msgr2=0x7f85940cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f8599000640 1 --2- 172.21.15.173:0/3974153507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f859415bb00 0x7f85940cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f8599000640 1 -- 172.21.15.173:0/3974153507 >> v2:172.21.15.173:3300/0 conn(0x7f859415bee0 msgr2=0x7f859415c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f8599000640 1 --2- 172.21.15.173:0/3974153507 >> v2:172.21.15.173:3300/0 conn(0x7f859415bee0 0x7f859415c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7f8599000640 1 -- 172.21.15.173:0/3974153507 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85940cd050 con 0x7f85940b16c0 2024-04-25T09:07:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7fa741e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa744099f90 0x7fa7440b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7fa741400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7440cd840 0x7fa744154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7fa741e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa744099f90 0x7fa7440b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:38752/0 (socket says 172.21.15.173:38752) 2024-04-25T09:07:00.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.718+0000 7fa741e00640 1 -- 172.21.15.173:0/2487700503 learned_addr learned my addr 172.21.15.173:0/2487700503 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:00.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7f963a000640 1 --2- 172.21.15.173:0/1026861219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f963c0cc800 0x7f963c14b4f0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f96280af040 tx=0x7f96280190a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:00.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7fa742800640 1 --2- 172.21.15.173:0/2487700503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74415bab0 0x7fa744155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7fa741e00640 1 -- 172.21.15.173:0/2487700503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7440cd840 msgr2=0x7fa744154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7fa741e00640 1 --2- 172.21.15.173:0/2487700503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7440cd840 0x7fa744154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7fa741e00640 1 -- 172.21.15.173:0/2487700503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74415bab0 msgr2=0x7fa744155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7fa741e00640 1 --2- 172.21.15.173:0/2487700503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74415bab0 0x7fa744155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7fa741e00640 1 -- 172.21.15.173:0/2487700503 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7440b5920 con 0x7fa744099f90 2024-04-25T09:07:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7fa742800640 1 --2- 172.21.15.173:0/2487700503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74415bab0 0x7fa744155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7f9632a00640 1 -- 172.21.15.173:0/1026861219 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96280b1040 con 0x7f963c0cc800 2024-04-25T09:07:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7f9632a00640 1 -- 172.21.15.173:0/1026861219 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96280acb40 con 0x7f963c0cc800 2024-04-25T09:07:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7f9641800640 1 -- 172.21.15.173:0/1026861219 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f963c165160 con 0x7f963c0cc800 2024-04-25T09:07:00.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7fa741e00640 1 --2- 172.21.15.173:0/2487700503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa744099f90 0x7fa7440b51b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa73401a150 tx=0x7fa7340192c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:00.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7f9632a00640 1 -- 172.21.15.173:0/1026861219 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96280b5410 con 0x7f963c0cc800 2024-04-25T09:07:00.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7f9641800640 1 -- 172.21.15.173:0/1026861219 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f963c165440 con 0x7f963c0cc800 2024-04-25T09:07:00.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7fa73a000640 1 -- 172.21.15.173:0/2487700503 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7340b0050 con 0x7fa744099f90 2024-04-25T09:07:00.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7fa73a000640 1 -- 172.21.15.173:0/2487700503 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7340ba070 con 0x7fa744099f90 2024-04-25T09:07:00.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7fa748e00640 1 -- 172.21.15.173:0/2487700503 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7440b5c00 con 0x7fa744099f90 2024-04-25T09:07:00.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7fa748e00640 1 -- 172.21.15.173:0/2487700503 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7440b61c0 con 0x7fa744099f90 2024-04-25T09:07:00.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7fa73a000640 1 -- 172.21.15.173:0/2487700503 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7340abe60 con 0x7fa744099f90 2024-04-25T09:07:00.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7f9627e00640 1 -- 172.21.15.173:0/1026861219 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96100052a0 con 0x7f963c0cc800 2024-04-25T09:07:00.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7fa748e00640 1 -- 172.21.15.173:0/2487700503 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71c0052a0 con 0x7fa744099f90 2024-04-25T09:07:00.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.722+0000 7f8599000640 1 --2- 172.21.15.173:0/3974153507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85940b16c0 0x7f85940b1b20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f85800097c0 tx=0x7f858001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9db515f9409afde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:00.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f8593e00640 1 -- 172.21.15.173:0/3974153507 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85800b2070 con 0x7f85940b16c0 2024-04-25T09:07:00.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f8593e00640 1 -- 172.21.15.173:0/3974153507 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85800a9070 con 0x7f85940b16c0 2024-04-25T09:07:00.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f8593e00640 1 -- 172.21.15.173:0/3974153507 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85800ad880 con 0x7f85940b16c0 2024-04-25T09:07:00.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f9632a00640 1 -- 172.21.15.173:0/1026861219 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f96280be030 con 0x7f963c0cc800 2024-04-25T09:07:00.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7fa73a000640 1 -- 172.21.15.173:0/2487700503 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa7340b4810 con 0x7fa744099f90 2024-04-25T09:07:00.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f859c400640 1 -- 172.21.15.173:0/3974153507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85940b16c0 msgr2=0x7f85940b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f859c400640 1 --2- 172.21.15.173:0/3974153507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85940b16c0 0x7f85940b1b20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f85800097c0 tx=0x7f858001c3c0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f9632a00640 1 --2- 172.21.15.173:0/1026861219 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f961c066f60 0x7f961c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f9632a00640 1 -- 172.21.15.173:0/1026861219 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f962811e2a0 con 0x7f963c0cc800 2024-04-25T09:07:00.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f859c400640 1 -- 172.21.15.173:0/3974153507 shutdown_connections 2024-04-25T09:07:00.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f859c400640 1 --2- 172.21.15.173:0/3974153507 >> v2:172.21.15.173:3300/0 conn(0x7f859415bee0 0x7f859415c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f859c400640 1 --2- 172.21.15.173:0/3974153507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85940b16c0 0x7f85940b1b20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f859c400640 1 --2- 172.21.15.173:0/3974153507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f859415bb00 0x7f85940cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f859c400640 1 -- 172.21.15.173:0/3974153507 >> 172.21.15.173:0/3974153507 conn(0x7f85940b23a0 msgr2=0x7f85940b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:00.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7fa73a000640 1 --2- 172.21.15.173:0/2487700503 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa724066f60 0x7fa724069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7fa73a000640 1 -- 172.21.15.173:0/2487700503 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa73411eec0 con 0x7fa744099f90 2024-04-25T09:07:00.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f859c400640 1 -- 172.21.15.173:0/3974153507 shutdown_connections 2024-04-25T09:07:00.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f963aa00640 1 --2- 172.21.15.173:0/1026861219 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f961c066f60 0x7f961c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7fa741400640 1 --2- 172.21.15.173:0/2487700503 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa724066f60 0x7fa724069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f859c400640 1 -- 172.21.15.173:0/3974153507 wait complete. 2024-04-25T09:07:00.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7fa741400640 1 --2- 172.21.15.173:0/2487700503 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa724066f60 0x7fa724069420 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa7441f6070 tx=0x7fa73000b680 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:00.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f963aa00640 1 --2- 172.21.15.173:0/1026861219 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f961c066f60 0x7f961c069420 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f962c000c10 tx=0x7f962c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:00.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f859c400640 1 Processor -- start 2024-04-25T09:07:00.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.726+0000 7f859c400640 1 -- start start 2024-04-25T09:07:00.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f859c400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85940b16c0 0x7f85940ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f8599a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85940b16c0 0x7f85940ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f859c400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f859415bb00 0x7f85941490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f8599a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85940b16c0 0x7f85940ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:60660/0 (socket says 172.21.15.173:60660) 2024-04-25T09:07:00.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f859c400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f859415bee0 0x7f8594164d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f8599a00640 1 -- 172.21.15.173:0/3431776783 learned_addr learned my addr 172.21.15.173:0/3431776783 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f859c400640 1 -- 172.21.15.173:0/3431776783 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85940cb750 con 0x7f859415bee0 2024-04-25T09:07:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f859c400640 1 -- 172.21.15.173:0/3431776783 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85940cb5d0 con 0x7f859415bb00 2024-04-25T09:07:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f859c400640 1 -- 172.21.15.173:0/3431776783 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85940cb8d0 con 0x7f85940b16c0 2024-04-25T09:07:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f8599000640 1 --2- 172.21.15.173:0/3431776783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f859415bb00 0x7f85941490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f859a400640 1 --2- 172.21.15.173:0/3431776783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f859415bee0 0x7f8594164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f8599a00640 1 -- 172.21.15.173:0/3431776783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f859415bb00 msgr2=0x7f85941490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f8599a00640 1 --2- 172.21.15.173:0/3431776783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f859415bb00 0x7f85941490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f8599a00640 1 -- 172.21.15.173:0/3431776783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f859415bee0 msgr2=0x7f8594164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f8599a00640 1 --2- 172.21.15.173:0/3431776783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f859415bee0 0x7f8594164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f8599a00640 1 -- 172.21.15.173:0/3431776783 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85940cfa40 con 0x7f85940b16c0 2024-04-25T09:07:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f8599000640 1 --2- 172.21.15.173:0/3431776783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f859415bb00 0x7f85941490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f859a400640 1 --2- 172.21.15.173:0/3431776783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f859415bee0 0x7f8594164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f8599a00640 1 --2- 172.21.15.173:0/3431776783 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85940b16c0 0x7f85940ca520 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f858800e8b0 tx=0x7f858800ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f8591600640 1 -- 172.21.15.173:0/3431776783 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8588017070 con 0x7f85940b16c0 2024-04-25T09:07:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f8591600640 1 -- 172.21.15.173:0/3431776783 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858800c940 con 0x7f85940b16c0 2024-04-25T09:07:00.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f8591600640 1 -- 172.21.15.173:0/3431776783 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858800cd10 con 0x7f85940b16c0 2024-04-25T09:07:00.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f859c400640 1 -- 172.21.15.173:0/3431776783 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8594067cd0 con 0x7f85940b16c0 2024-04-25T09:07:00.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7fa73a000640 1 -- 172.21.15.173:0/2487700503 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa734016110 con 0x7fa744099f90 2024-04-25T09:07:00.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f859c400640 1 -- 172.21.15.173:0/3431776783 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85941fa0a0 con 0x7f85940b16c0 2024-04-25T09:07:00.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.730+0000 7f9632a00640 1 -- 172.21.15.173:0/1026861219 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f96280c5060 con 0x7f963c0cc800 2024-04-25T09:07:00.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.734+0000 7f859c400640 1 -- 172.21.15.173:0/3431776783 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f859406cd30 con 0x7f85940b16c0 2024-04-25T09:07:00.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.734+0000 7f8591600640 1 -- 172.21.15.173:0/3431776783 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f858801a070 con 0x7f85940b16c0 2024-04-25T09:07:00.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.734+0000 7f8591600640 1 --2- 172.21.15.173:0/3431776783 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8574066f60 0x7f8574069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.734+0000 7f8591600640 1 -- 172.21.15.173:0/3431776783 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8588085130 con 0x7f85940b16c0 2024-04-25T09:07:00.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.734+0000 7f8599000640 1 --2- 172.21.15.173:0/3431776783 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8574066f60 0x7f8574069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.738+0000 7f8599000640 1 --2- 172.21.15.173:0/3431776783 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8574066f60 0x7f8574069420 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f85800af000 tx=0x7f8580008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:00.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.738+0000 7f8591600640 1 -- 172.21.15.173:0/3431776783 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f85880558c0 con 0x7f85940b16c0 2024-04-25T09:07:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.770+0000 7f2ea0c00640 1 Processor -- start 2024-04-25T09:07:00.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.770+0000 7f2ea0c00640 1 -- start start 2024-04-25T09:07:00.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.770+0000 7f2ea0c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2e9c0cd910 0x7f2e9c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.770+0000 7f2ea0c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e9c06cec0 0x7f2e9c15d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.770+0000 7f2ea0c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9c0d03d0 con 0x7f2e9c0cff30 2024-04-25T09:07:00.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.770+0000 7f2ea0c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c0cce10 con 0x7f2e9c0cd910 2024-04-25T09:07:00.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.770+0000 7f2ea0c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0d06b0 con 0x7f2e9c06cec0 2024-04-25T09:07:00.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.770+0000 7f2e99e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2e9c0cd910 0x7f2e9c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.770+0000 7f2e99e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2e9c0cd910 0x7f2e9c0cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53406/0 (socket says 172.21.15.173:53406) 2024-04-25T09:07:00.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.770+0000 7f2e99e00640 1 -- 172.21.15.173:0/2598013129 learned_addr learned my addr 172.21.15.173:0/2598013129 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:00.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.770+0000 7f2e9a800640 1 --2- 172.21.15.173:0/2598013129 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e9c06cec0 0x7f2e9c15d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.770+0000 7f2e99e00640 1 -- 172.21.15.173:0/2598013129 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e9c06cec0 msgr2=0x7f2e9c15d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:00.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.770+0000 7f2e99e00640 1 --2- 172.21.15.173:0/2598013129 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e9c06cec0 0x7f2e9c15d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.770+0000 7f2e99e00640 1 -- 172.21.15.173:0/2598013129 >> v1:172.21.15.194:6789/0 conn(0x7f2e9c0cff30 legacy=0x7f2e9c06c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.770+0000 7f2e99e00640 1 -- 172.21.15.173:0/2598013129 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c0d0990 con 0x7f2e9c0cd910 2024-04-25T09:07:00.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.774+0000 7f2e99e00640 1 --2- 172.21.15.173:0/2598013129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e9c0cd910 0x7f2e9c0cf9f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0098a0 tx=0x7f2e8c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d69df24cddcd36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.774+0000 7f2e98a00640 1 -- 172.21.15.173:0/2598013129 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0ab430 con 0x7f2e9c0cd910 2024-04-25T09:07:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.774+0000 7f2e98a00640 1 -- 172.21.15.173:0/2598013129 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c0b0070 con 0x7f2e9c0cd910 2024-04-25T09:07:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.774+0000 7f2e98a00640 1 -- 172.21.15.173:0/2598013129 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0ab5f0 con 0x7f2e9c0cd910 2024-04-25T09:07:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.774+0000 7f2ea0c00640 1 -- 172.21.15.173:0/2598013129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e9c0cd910 msgr2=0x7f2e9c0cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.774+0000 7f2ea0c00640 1 --2- 172.21.15.173:0/2598013129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e9c0cd910 0x7f2e9c0cf9f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0098a0 tx=0x7f2e8c01c540 comp rx=0 tx=0).stop 2024-04-25T09:07:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.774+0000 7f2ea0c00640 1 -- 172.21.15.173:0/2598013129 shutdown_connections 2024-04-25T09:07:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.774+0000 7f2ea0c00640 1 --2- 172.21.15.173:0/2598013129 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e9c06cec0 0x7f2e9c15d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.774+0000 7f2ea0c00640 1 --2- 172.21.15.173:0/2598013129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e9c0cd910 0x7f2e9c0cf9f0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.774+0000 7f2ea0c00640 1 -- 172.21.15.173:0/2598013129 >> 172.21.15.173:0/2598013129 conn(0x7f2e9c0b32a0 msgr2=0x7f2e9c0b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.774+0000 7f2ea0c00640 1 -- 172.21.15.173:0/2598013129 shutdown_connections 2024-04-25T09:07:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.774+0000 7f2ea0c00640 1 -- 172.21.15.173:0/2598013129 wait complete. 2024-04-25T09:07:00.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.778+0000 7f2ea0c00640 1 Processor -- start 2024-04-25T09:07:00.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.778+0000 7f2ea0c00640 1 -- start start 2024-04-25T09:07:00.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.778+0000 7f2ea0c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e9c06cec0 0x7f2e9c160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.778+0000 7f2ea0c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e9c0cd910 0x7f2e9c0c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.778+0000 7f2ea0c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e9c0cff30 0x7f2e9c154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.778+0000 7f2ea0c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0cbf80 con 0x7f2e9c0cff30 2024-04-25T09:07:00.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.778+0000 7f2ea0c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0cbe00 con 0x7f2e9c06cec0 2024-04-25T09:07:00.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.778+0000 7f2ea0c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0cc100 con 0x7f2e9c0cd910 2024-04-25T09:07:00.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.778+0000 7f2e9a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e9c0cff30 0x7f2e9c154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.778+0000 7f2e9a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e9c0cff30 0x7f2e9c154ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53422/0 (socket says 172.21.15.173:53422) 2024-04-25T09:07:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.778+0000 7f2e9a800640 1 -- 172.21.15.173:0/3516367053 learned_addr learned my addr 172.21.15.173:0/3516367053 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.778+0000 7f2e99400640 1 --2- 172.21.15.173:0/3516367053 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e9c0cd910 0x7f2e9c0c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.778+0000 7f2e99e00640 1 --2- 172.21.15.173:0/3516367053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e9c06cec0 0x7f2e9c160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.782+0000 7f2e99e00640 1 -- 172.21.15.173:0/3516367053 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e9c0cd910 msgr2=0x7f2e9c0c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.782+0000 7f2e99e00640 1 --2- 172.21.15.173:0/3516367053 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e9c0cd910 0x7f2e9c0c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.782+0000 7f2e99e00640 1 -- 172.21.15.173:0/3516367053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e9c0cff30 msgr2=0x7f2e9c154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.782+0000 7f2e99e00640 1 --2- 172.21.15.173:0/3516367053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e9c0cff30 0x7f2e9c154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.782+0000 7f2e99e00640 1 -- 172.21.15.173:0/3516367053 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c15e210 con 0x7f2e9c06cec0 2024-04-25T09:07:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.782+0000 7f2e9a800640 1 --2- 172.21.15.173:0/3516367053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e9c0cff30 0x7f2e9c154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.782+0000 7f2e99e00640 1 --2- 172.21.15.173:0/3516367053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e9c06cec0 0x7f2e9c160bc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0ac000 tx=0x7f2e8c0192e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:00.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.782+0000 7f2e92000640 1 -- 172.21.15.173:0/3516367053 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0abe40 con 0x7f2e9c06cec0 2024-04-25T09:07:00.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.782+0000 7f2e92000640 1 -- 172.21.15.173:0/3516367053 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c0b4420 con 0x7f2e9c06cec0 2024-04-25T09:07:00.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.782+0000 7f2ea0c00640 1 -- 172.21.15.173:0/3516367053 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c0c5c50 con 0x7f2e9c06cec0 2024-04-25T09:07:00.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.782+0000 7f2e92000640 1 -- 172.21.15.173:0/3516367053 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0b47f0 con 0x7f2e9c06cec0 2024-04-25T09:07:00.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.782+0000 7f2ea0c00640 1 -- 172.21.15.173:0/3516367053 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c0c5f30 con 0x7f2e9c06cec0 2024-04-25T09:07:00.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.782+0000 7f2ea0c00640 1 -- 172.21.15.173:0/3516367053 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9c073ab0 con 0x7f2e9c06cec0 2024-04-25T09:07:00.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.782+0000 7f2e92000640 1 -- 172.21.15.173:0/3516367053 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2e8c0b4990 con 0x7f2e9c06cec0 2024-04-25T09:07:00.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.786+0000 7f2e92000640 1 --2- 172.21.15.173:0/3516367053 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2e7c066f60 0x7f2e7c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:00.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.786+0000 7f2e92000640 1 -- 172.21.15.173:0/3516367053 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2e8c11ee50 con 0x7f2e9c06cec0 2024-04-25T09:07:00.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.786+0000 7f2e99400640 1 --2- 172.21.15.173:0/3516367053 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2e7c066f60 0x7f2e7c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:00.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.786+0000 7f2e99400640 1 --2- 172.21.15.173:0/3516367053 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2e7c066f60 0x7f2e7c069420 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c169b80 tx=0x7f2e88009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:00.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.790+0000 7f2e92000640 1 -- 172.21.15.173:0/3516367053 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2e8c0ba020 con 0x7f2e9c06cec0 2024-04-25T09:07:00.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.962+0000 7fa748e00640 1 -- 172.21.15.173:0/2487700503 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fa71c005860 con 0x7fa744099f90 2024-04-25T09:07:00.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:00.994+0000 7f9627e00640 1 -- 172.21.15.173:0/1026861219 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f9610005590 con 0x7f963c0cc800 2024-04-25T09:07:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.002+0000 7f859c400640 1 -- 172.21.15.173:0/3431776783 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) v1 -- 0x7f85941faa80 con 0x7f85940b16c0 2024-04-25T09:07:00.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.006+0000 7f2ea0c00640 1 -- 172.21.15.173:0/3516367053 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f2e9c0b4140 con 0x7f2e9c06cec0 2024-04-25T09:07:01.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.854+0000 7fa73a000640 1 -- 172.21.15.173:0/2487700503 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6340 v40) v1 ==== 95+0+0 (secure 0 0 0) 0x7fa7340efd40 con 0x7fa744099f90 2024-04-25T09:07:01.843 INFO:teuthology.orchestra.run.smithi173.stderr:failed mds gid 6340 2024-04-25T09:07:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.858+0000 7fa748e00640 1 -- 172.21.15.173:0/2487700503 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa724066f60 msgr2=0x7fa724069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.858+0000 7fa748e00640 1 --2- 172.21.15.173:0/2487700503 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa724066f60 0x7fa724069420 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa7441f6070 tx=0x7fa73000b680 comp rx=0 tx=0).stop 2024-04-25T09:07:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.858+0000 7fa748e00640 1 -- 172.21.15.173:0/2487700503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa744099f90 msgr2=0x7fa7440b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.858+0000 7fa748e00640 1 --2- 172.21.15.173:0/2487700503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa744099f90 0x7fa7440b51b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa73401a150 tx=0x7fa7340192c0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.858+0000 7fa748e00640 1 -- 172.21.15.173:0/2487700503 shutdown_connections 2024-04-25T09:07:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.858+0000 7fa748e00640 1 --2- 172.21.15.173:0/2487700503 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa724066f60 0x7fa724069420 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.858+0000 7fa748e00640 1 --2- 172.21.15.173:0/2487700503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74415bab0 0x7fa744155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.858+0000 7fa748e00640 1 --2- 172.21.15.173:0/2487700503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7440cd840 0x7fa744154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.858+0000 7fa748e00640 1 --2- 172.21.15.173:0/2487700503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa744099f90 0x7fa7440b51b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.858+0000 7fa748e00640 1 -- 172.21.15.173:0/2487700503 >> 172.21.15.173:0/2487700503 conn(0x7fa7440b32a0 msgr2=0x7fa7440ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:01.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.858+0000 7fa748e00640 1 -- 172.21.15.173:0/2487700503 shutdown_connections 2024-04-25T09:07:01.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.858+0000 7fa748e00640 1 -- 172.21.15.173:0/2487700503 wait complete. 2024-04-25T09:07:01.853 INFO:tasks.ceph.mon.a.smithi173.stderr:2024-04-25T09:07:01.866+0000 7f5378c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:07:01.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.866+0000 7f9632a00640 1 -- 172.21.15.173:0/1026861219 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 5873 v41) v1 ==== 95+0+0 (secure 0 0 0) 0x7f9628015ff0 con 0x7f963c0cc800 2024-04-25T09:07:01.855 INFO:teuthology.orchestra.run.smithi173.stderr:failed mds gid 5873 2024-04-25T09:07:01.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.870+0000 7f2e92000640 1 -- 172.21.15.173:0/3516367053 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6711 v41) v1 ==== 95+0+0 (secure 0 0 0) 0x7f2e8c016130 con 0x7f2e9c06cec0 2024-04-25T09:07:01.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.870+0000 7f8591600640 1 -- 172.21.15.173:0/3431776783 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6343 v41) v1 ==== 95+0+0 (secure 0 0 0) 0x7f8588059960 con 0x7f85940b16c0 2024-04-25T09:07:01.859 INFO:teuthology.orchestra.run.smithi173.stderr:failed mds gid 6711 2024-04-25T09:07:01.859 INFO:teuthology.orchestra.run.smithi173.stderr:failed mds gid 6343 2024-04-25T09:07:01.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.870+0000 7f9627e00640 1 -- 172.21.15.173:0/1026861219 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f961c066f60 msgr2=0x7f961c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:01.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.870+0000 7f9627e00640 1 --2- 172.21.15.173:0/1026861219 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f961c066f60 0x7f961c069420 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f962c000c10 tx=0x7f962c009040 comp rx=0 tx=0).stop 2024-04-25T09:07:01.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.870+0000 7f9627e00640 1 -- 172.21.15.173:0/1026861219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f963c0cc800 msgr2=0x7f963c14b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:01.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.870+0000 7f9627e00640 1 --2- 172.21.15.173:0/1026861219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f963c0cc800 0x7f963c14b4f0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f96280af040 tx=0x7f96280190a0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.870+0000 7f9627e00640 1 -- 172.21.15.173:0/1026861219 shutdown_connections 2024-04-25T09:07:01.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.870+0000 7f9627e00640 1 --2- 172.21.15.173:0/1026861219 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f961c066f60 0x7f961c069420 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.870+0000 7f9627e00640 1 --2- 172.21.15.173:0/1026861219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f963c161f80 0x7f963c164610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.870+0000 7f9627e00640 1 --2- 172.21.15.173:0/1026861219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f963c0cc800 0x7f963c14b4f0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.870+0000 7f9627e00640 1 --2- 172.21.15.173:0/1026861219 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c0aea40 0x7f963c15ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.870+0000 7f9627e00640 1 -- 172.21.15.173:0/1026861219 >> 172.21.15.173:0/1026861219 conn(0x7f963c06ac90 msgr2=0x7f963c0b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:01.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.870+0000 7f9627e00640 1 -- 172.21.15.173:0/1026861219 shutdown_connections 2024-04-25T09:07:01.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.870+0000 7f9627e00640 1 -- 172.21.15.173:0/1026861219 wait complete. 2024-04-25T09:07:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f2ea0c00640 1 -- 172.21.15.173:0/3516367053 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2e7c066f60 msgr2=0x7f2e7c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f2ea0c00640 1 --2- 172.21.15.173:0/3516367053 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2e7c066f60 0x7f2e7c069420 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c169b80 tx=0x7f2e88009040 comp rx=0 tx=0).stop 2024-04-25T09:07:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f2ea0c00640 1 -- 172.21.15.173:0/3516367053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e9c06cec0 msgr2=0x7f2e9c160bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f2ea0c00640 1 --2- 172.21.15.173:0/3516367053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e9c06cec0 0x7f2e9c160bc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0ac000 tx=0x7f2e8c0192e0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f2ea0c00640 1 -- 172.21.15.173:0/3516367053 shutdown_connections 2024-04-25T09:07:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f2ea0c00640 1 --2- 172.21.15.173:0/3516367053 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2e7c066f60 0x7f2e7c069420 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f2ea0c00640 1 --2- 172.21.15.173:0/3516367053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e9c0cff30 0x7f2e9c154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f2ea0c00640 1 --2- 172.21.15.173:0/3516367053 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e9c0cd910 0x7f2e9c0c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f2ea0c00640 1 --2- 172.21.15.173:0/3516367053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e9c06cec0 0x7f2e9c160bc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f2ea0c00640 1 -- 172.21.15.173:0/3516367053 >> 172.21.15.173:0/3516367053 conn(0x7f2e9c0b32a0 msgr2=0x7f2e9c070000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:01.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f859c400640 1 -- 172.21.15.173:0/3431776783 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8574066f60 msgr2=0x7f8574069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:01.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f859c400640 1 --2- 172.21.15.173:0/3431776783 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8574066f60 0x7f8574069420 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f85800af000 tx=0x7f8580008040 comp rx=0 tx=0).stop 2024-04-25T09:07:01.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f859c400640 1 -- 172.21.15.173:0/3431776783 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85940b16c0 msgr2=0x7f85940ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:01.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f859c400640 1 --2- 172.21.15.173:0/3431776783 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85940b16c0 0x7f85940ca520 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f858800e8b0 tx=0x7f858800ed70 comp rx=0 tx=0).stop 2024-04-25T09:07:01.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f2ea0c00640 1 -- 172.21.15.173:0/3516367053 shutdown_connections 2024-04-25T09:07:01.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f2ea0c00640 1 -- 172.21.15.173:0/3516367053 wait complete. 2024-04-25T09:07:01.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f859c400640 1 -- 172.21.15.173:0/3431776783 shutdown_connections 2024-04-25T09:07:01.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f859c400640 1 --2- 172.21.15.173:0/3431776783 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8574066f60 0x7f8574069420 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f859c400640 1 --2- 172.21.15.173:0/3431776783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f859415bee0 0x7f8594164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f859c400640 1 --2- 172.21.15.173:0/3431776783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f859415bb00 0x7f85941490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f859c400640 1 --2- 172.21.15.173:0/3431776783 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85940b16c0 0x7f85940ca520 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:01.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f859c400640 1 -- 172.21.15.173:0/3431776783 >> 172.21.15.173:0/3431776783 conn(0x7f85940b23a0 msgr2=0x7f859415a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:01.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f859c400640 1 -- 172.21.15.173:0/3431776783 shutdown_connections 2024-04-25T09:07:01.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:01.874+0000 7f859c400640 1 -- 172.21.15.173:0/3431776783 wait complete. 2024-04-25T09:07:01.881 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:07:01.881 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:07:01.885 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:07:01.885 DEBUG:teuthology.parallel:result is None 2024-04-25T09:07:01.890 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:07:01.890 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:07:01.891 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:07:01.891 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:07:01.892 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:07:01.892 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:07:01.894 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:07:01.894 DEBUG:teuthology.parallel:result is None 2024-04-25T09:07:01.939 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:07:01.939 DEBUG:teuthology.parallel:result is None 2024-04-25T09:07:01.940 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:07:01.940 DEBUG:teuthology.parallel:result is None 2024-04-25T09:07:01.940 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:01.976 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-04-25T09:07:01.985 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-04-25T09:07:02.027 INFO:tasks.ceph.mds.c.smithi173.stdout:starting mds.c at 2024-04-25T09:07:02.027 INFO:tasks.ceph.mds.a.smithi173.stdout:starting mds.a at 2024-04-25T09:07:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.094+0000 7f4073c00640 1 Processor -- start 2024-04-25T09:07:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.094+0000 7f4073c00640 1 -- start start 2024-04-25T09:07:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.098+0000 7f4073c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f406c145250 0x7f406c15c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.098+0000 7f4073c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f406c0cc8b0 0x7f406c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.098+0000 7f4073c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406c15cec0 con 0x7f406c071320 2024-04-25T09:07:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.098+0000 7f4073c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f406c06e7c0 con 0x7f406c0cc8b0 2024-04-25T09:07:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.098+0000 7f4073c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c06d720 con 0x7f406c145250 2024-04-25T09:07:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.098+0000 7f4071c00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f406c071320 0x7f406c071790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:35262/0 (socket says 172.21.15.173:35262) 2024-04-25T09:07:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.098+0000 7f4071c00640 1 -- 172.21.15.173:0/2182671003 learned_addr learned my addr 172.21.15.173:0/2182671003 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.098+0000 7f406be00640 1 --2- 172.21.15.173:0/2182671003 >> v2:172.21.15.194:3300/0 conn(0x7f406c0cc8b0 0x7f406c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.098+0000 7f4071200640 1 --2- 172.21.15.173:0/2182671003 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f406c145250 0x7f406c15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.098+0000 7f406b400640 1 -- 172.21.15.173:0/2182671003 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905867197 0 0) 0x7f40640014a0 con 0x7f406c071320 2024-04-25T09:07:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.098+0000 7f406b400640 1 -- 172.21.15.173:0/2182671003 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4050003530 con 0x7f406c071320 2024-04-25T09:07:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.098+0000 7f406be00640 1 -- 172.21.15.173:0/2182671003 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f406c145250 msgr2=0x7f406c15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.098+0000 7f406be00640 1 --2- 172.21.15.173:0/2182671003 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f406c145250 0x7f406c15c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.098+0000 7f406be00640 1 -- 172.21.15.173:0/2182671003 >> v1:172.21.15.173:6789/0 conn(0x7f406c071320 legacy=0x7f406c071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.098+0000 7f406be00640 1 -- 172.21.15.173:0/2182671003 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c06da00 con 0x7f406c0cc8b0 2024-04-25T09:07:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.098+0000 7f4071200640 1 --2- 172.21.15.173:0/2182671003 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f406c145250 0x7f406c15c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:02.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.102+0000 7f406be00640 1 --2- 172.21.15.173:0/2182671003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f406c0cc8b0 0x7f406c0ccd30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f40580097c0 tx=0x7f405801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a37f9d4f906f596 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:02.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.102+0000 7f406b400640 1 -- 172.21.15.173:0/2182671003 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40580b2070 con 0x7f406c0cc8b0 2024-04-25T09:07:02.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.102+0000 7f406b400640 1 -- 172.21.15.173:0/2182671003 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40580ad640 con 0x7f406c0cc8b0 2024-04-25T09:07:02.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.102+0000 7f406b400640 1 -- 172.21.15.173:0/2182671003 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40580ada10 con 0x7f406c0cc8b0 2024-04-25T09:07:02.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.102+0000 7f4073c00640 1 -- 172.21.15.173:0/2182671003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f406c0cc8b0 msgr2=0x7f406c0ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:02.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.102+0000 7f4073c00640 1 --2- 172.21.15.173:0/2182671003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f406c0cc8b0 0x7f406c0ccd30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f40580097c0 tx=0x7f405801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:07:02.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.102+0000 7f4073c00640 1 -- 172.21.15.173:0/2182671003 shutdown_connections 2024-04-25T09:07:02.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.102+0000 7f4073c00640 1 --2- 172.21.15.173:0/2182671003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f406c0cc8b0 0x7f406c0ccd30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:02.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.102+0000 7f4073c00640 1 --2- 172.21.15.173:0/2182671003 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f406c145250 0x7f406c15c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:02.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.102+0000 7f4073c00640 1 -- 172.21.15.173:0/2182671003 >> 172.21.15.173:0/2182671003 conn(0x7f406c06ac90 msgr2=0x7f406c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:02.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.102+0000 7f4073c00640 1 -- 172.21.15.173:0/2182671003 shutdown_connections 2024-04-25T09:07:02.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.102+0000 7f4073c00640 1 -- 172.21.15.173:0/2182671003 wait complete. 2024-04-25T09:07:02.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.102+0000 7f4073c00640 1 Processor -- start 2024-04-25T09:07:02.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.102+0000 7f4073c00640 1 -- start start 2024-04-25T09:07:02.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f4073c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f406c071320 0x7f406c13da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:02.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f4073c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f406c0cc8b0 0x7f406c1406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:02.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f4073c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f406c145250 0x7f406c1fa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:02.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f4073c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c06ef80 con 0x7f406c0cc8b0 2024-04-25T09:07:02.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f4073c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c145630 con 0x7f406c071320 2024-04-25T09:07:02.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f4073c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c06d380 con 0x7f406c145250 2024-04-25T09:07:02.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f406be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f406c0cc8b0 0x7f406c1406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:02.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f406be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f406c0cc8b0 0x7f406c1406c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53460/0 (socket says 172.21.15.173:53460) 2024-04-25T09:07:02.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f406be00640 1 -- 172.21.15.173:0/2434154478 learned_addr learned my addr 172.21.15.173:0/2434154478 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:02.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f4071c00640 1 --2- 172.21.15.173:0/2434154478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f406c145250 0x7f406c1fa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:02.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f4071200640 1 --2- 172.21.15.173:0/2434154478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f406c071320 0x7f406c13da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:02.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f406be00640 1 -- 172.21.15.173:0/2434154478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f406c145250 msgr2=0x7f406c1fa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:02.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f406be00640 1 --2- 172.21.15.173:0/2434154478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f406c145250 0x7f406c1fa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:02.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f406be00640 1 -- 172.21.15.173:0/2434154478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f406c071320 msgr2=0x7f406c13da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:02.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f406be00640 1 --2- 172.21.15.173:0/2434154478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f406c071320 0x7f406c13da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:02.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f406be00640 1 -- 172.21.15.173:0/2434154478 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c13dfe0 con 0x7f406c0cc8b0 2024-04-25T09:07:02.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f406be00640 1 --2- 172.21.15.173:0/2434154478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f406c0cc8b0 0x7f406c1406c0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f40580b0040 tx=0x7f4058019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:02.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f4068c00640 1 -- 172.21.15.173:0/2434154478 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40580b2040 con 0x7f406c0cc8b0 2024-04-25T09:07:02.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f4068c00640 1 -- 172.21.15.173:0/2434154478 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40580bc070 con 0x7f406c0cc8b0 2024-04-25T09:07:02.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f4073c00640 1 -- 172.21.15.173:0/2434154478 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406c13e2c0 con 0x7f406c0cc8b0 2024-04-25T09:07:02.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f4068c00640 1 -- 172.21.15.173:0/2434154478 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4058006e20 con 0x7f406c0cc8b0 2024-04-25T09:07:02.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f4073c00640 1 -- 172.21.15.173:0/2434154478 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406c13e880 con 0x7f406c0cc8b0 2024-04-25T09:07:02.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f4073c00640 1 -- 172.21.15.173:0/2434154478 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406c073a40 con 0x7f406c0cc8b0 2024-04-25T09:07:02.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.106+0000 7f4068c00640 1 -- 172.21.15.173:0/2434154478 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f40580b6670 con 0x7f406c0cc8b0 2024-04-25T09:07:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.110+0000 7f4068c00640 1 --2- 172.21.15.173:0/2434154478 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f404c066f60 0x7f404c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.110+0000 7f4068c00640 1 -- 172.21.15.173:0/2434154478 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f405811eff0 con 0x7f406c0cc8b0 2024-04-25T09:07:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.110+0000 7f4071200640 1 --2- 172.21.15.173:0/2434154478 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f404c066f60 0x7f404c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.110+0000 7f4071200640 1 --2- 172.21.15.173:0/2434154478 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f404c066f60 0x7f404c069420 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f405c009580 tx=0x7f405c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:02.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.114+0000 7f4068c00640 1 -- 172.21.15.173:0/2434154478 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4058016090 con 0x7f406c0cc8b0 2024-04-25T09:07:02.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.298+0000 7f4073c00640 1 -- 172.21.15.173:0/2434154478 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f406c06b110 con 0x7f406c0cc8b0 2024-04-25T09:07:02.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.298+0000 7f4068c00640 1 -- 172.21.15.173:0/2434154478 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+1768 (secure 0 0 0) 0x7f40580ef810 con 0x7f406c0cc8b0 2024-04-25T09:07:02.287 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:02.287 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":41,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:50.132659+0000","modified":"2024-04-25T09:07:01.867741+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:07:02.287 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 41 2024-04-25T09:07:02.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.302+0000 7f4073c00640 1 -- 172.21.15.173:0/2434154478 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f404c066f60 msgr2=0x7f404c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.302+0000 7f4073c00640 1 --2- 172.21.15.173:0/2434154478 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f404c066f60 0x7f404c069420 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f405c009580 tx=0x7f405c009190 comp rx=0 tx=0).stop 2024-04-25T09:07:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.302+0000 7f4073c00640 1 -- 172.21.15.173:0/2434154478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f406c0cc8b0 msgr2=0x7f406c1406c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.302+0000 7f4073c00640 1 --2- 172.21.15.173:0/2434154478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f406c0cc8b0 0x7f406c1406c0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f40580b0040 tx=0x7f4058019240 comp rx=0 tx=0).stop 2024-04-25T09:07:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.302+0000 7f4073c00640 1 -- 172.21.15.173:0/2434154478 shutdown_connections 2024-04-25T09:07:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.302+0000 7f4073c00640 1 --2- 172.21.15.173:0/2434154478 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f404c066f60 0x7f404c069420 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.302+0000 7f4073c00640 1 --2- 172.21.15.173:0/2434154478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f406c145250 0x7f406c1fa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.302+0000 7f4073c00640 1 --2- 172.21.15.173:0/2434154478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f406c0cc8b0 0x7f406c1406c0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.302+0000 7f4073c00640 1 --2- 172.21.15.173:0/2434154478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f406c071320 0x7f406c13da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.302+0000 7f4073c00640 1 -- 172.21.15.173:0/2434154478 >> 172.21.15.173:0/2434154478 conn(0x7f406c06ac90 msgr2=0x7f406c0b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.302+0000 7f4073c00640 1 -- 172.21.15.173:0/2434154478 shutdown_connections 2024-04-25T09:07:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:02.302+0000 7f4073c00640 1 -- 172.21.15.173:0/2434154478 wait complete. 2024-04-25T09:07:02.710 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:06:50.132659+0000', 'modified': '2024-04-25T09:07:01.867741+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 73, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:07:02.710 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2024-04-25T09:07:03.710 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:03.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.870+0000 7fb0a2200640 1 Processor -- start 2024-04-25T09:07:03.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.870+0000 7fb0a2200640 1 -- start start 2024-04-25T09:07:03.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.870+0000 7fb0a2200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb09c15dc80 0x7fb09c0cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:03.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.870+0000 7fb0a2200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb09c0d0ae0 0x7fb09c0d27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:03.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.870+0000 7fb0a2200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09c0d3550 con 0x7fb09c0d3070 2024-04-25T09:07:03.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.870+0000 7fb0a2200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09c0d3830 con 0x7fb09c0d0ae0 2024-04-25T09:07:03.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.870+0000 7fb0a2200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c0d1cf0 con 0x7fb09c15dc80 2024-04-25T09:07:03.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.870+0000 7fb09be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb09c0d0ae0 0x7fb09c0d27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:03.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.870+0000 7fb09be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb09c0d0ae0 0x7fb09c0d27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49242/0 (socket says 172.21.15.173:49242) 2024-04-25T09:07:03.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.870+0000 7fb09aa00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fb09c0d3070 0x7fb09c0d03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54792/0 (socket says 172.21.15.173:54792) 2024-04-25T09:07:03.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.870+0000 7fb09be00640 1 -- 172.21.15.173:0/662450683 learned_addr learned my addr 172.21.15.173:0/662450683 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:03.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.870+0000 7fb09b400640 1 --2- 172.21.15.173:0/662450683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb09c15dc80 0x7fb09c0cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:03.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.870+0000 7fb09be00640 1 -- 172.21.15.173:0/662450683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb09c15dc80 msgr2=0x7fb09c0cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:03.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.870+0000 7fb09be00640 1 --2- 172.21.15.173:0/662450683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb09c15dc80 0x7fb09c0cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:03.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.870+0000 7fb09be00640 1 -- 172.21.15.173:0/662450683 >> v1:172.21.15.173:6789/0 conn(0x7fb09c0d3070 legacy=0x7fb09c0d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:03.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.870+0000 7fb09be00640 1 -- 172.21.15.173:0/662450683 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c0d1fd0 con 0x7fb09c0d0ae0 2024-04-25T09:07:03.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.874+0000 7fb09be00640 1 --2- 172.21.15.173:0/662450683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb09c0d0ae0 0x7fb09c0d27d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fb094009870 tx=0x7fb09401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea97b10b6f75d298 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:03.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.874+0000 7fb09a000640 1 -- 172.21.15.173:0/662450683 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0940ab5f0 con 0x7fb09c0d0ae0 2024-04-25T09:07:03.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.874+0000 7fb09a000640 1 -- 172.21.15.173:0/662450683 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0940b0070 con 0x7fb09c0d0ae0 2024-04-25T09:07:03.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.874+0000 7fb09a000640 1 -- 172.21.15.173:0/662450683 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0940ab9b0 con 0x7fb09c0d0ae0 2024-04-25T09:07:03.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.874+0000 7fb0a2200640 1 -- 172.21.15.173:0/662450683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb09c0d0ae0 msgr2=0x7fb09c0d27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:03.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.874+0000 7fb0a2200640 1 --2- 172.21.15.173:0/662450683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb09c0d0ae0 0x7fb09c0d27d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fb094009870 tx=0x7fb09401c560 comp rx=0 tx=0).stop 2024-04-25T09:07:03.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.874+0000 7fb0a2200640 1 -- 172.21.15.173:0/662450683 shutdown_connections 2024-04-25T09:07:03.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.874+0000 7fb0a2200640 1 --2- 172.21.15.173:0/662450683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb09c0d0ae0 0x7fb09c0d27d0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:03.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.874+0000 7fb0a2200640 1 --2- 172.21.15.173:0/662450683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb09c15dc80 0x7fb09c0cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:03.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.874+0000 7fb0a2200640 1 -- 172.21.15.173:0/662450683 >> 172.21.15.173:0/662450683 conn(0x7fb09c06c510 msgr2=0x7fb09c06c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:03.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.874+0000 7fb0a2200640 1 -- 172.21.15.173:0/662450683 shutdown_connections 2024-04-25T09:07:03.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.874+0000 7fb0a2200640 1 -- 172.21.15.173:0/662450683 wait complete. 2024-04-25T09:07:03.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.878+0000 7fb0a2200640 1 Processor -- start 2024-04-25T09:07:03.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.878+0000 7fb0a2200640 1 -- start start 2024-04-25T09:07:03.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.878+0000 7fb0a2200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb09c0d0ae0 0x7fb09c158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:03.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.878+0000 7fb0a2200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb09c0d3070 0x7fb09c0caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:03.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.878+0000 7fb0a2200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb09c15dc80 0x7fb09c0cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:03.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.878+0000 7fb0a2200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c0b7430 con 0x7fb09c15dc80 2024-04-25T09:07:03.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.878+0000 7fb0a2200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c0b72b0 con 0x7fb09c0d0ae0 2024-04-25T09:07:03.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.878+0000 7fb0a2200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c0b75b0 con 0x7fb09c0d3070 2024-04-25T09:07:03.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.878+0000 7fb09be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb09c15dc80 0x7fb09c0cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:03.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.878+0000 7fb09aa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb09c0d3070 0x7fb09c0caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:03.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.878+0000 7fb09be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb09c15dc80 0x7fb09c0cb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49252/0 (socket says 172.21.15.173:49252) 2024-04-25T09:07:03.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.878+0000 7fb09b400640 1 --2- 172.21.15.173:0/2074655879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb09c0d0ae0 0x7fb09c158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:03.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.878+0000 7fb09be00640 1 -- 172.21.15.173:0/2074655879 learned_addr learned my addr 172.21.15.173:0/2074655879 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:03.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.878+0000 7fb09be00640 1 -- 172.21.15.173:0/2074655879 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb09c0d3070 msgr2=0x7fb09c0caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:03.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.878+0000 7fb09be00640 1 --2- 172.21.15.173:0/2074655879 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb09c0d3070 0x7fb09c0caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:03.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.878+0000 7fb09be00640 1 -- 172.21.15.173:0/2074655879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb09c0d0ae0 msgr2=0x7fb09c158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:03.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.878+0000 7fb09be00640 1 --2- 172.21.15.173:0/2074655879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb09c0d0ae0 0x7fb09c158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:03.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.878+0000 7fb09be00640 1 -- 172.21.15.173:0/2074655879 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c0cb650 con 0x7fb09c15dc80 2024-04-25T09:07:03.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.882+0000 7fb09be00640 1 --2- 172.21.15.173:0/2074655879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb09c15dc80 0x7fb09c0cb020 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fb0940ad040 tx=0x7fb09401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:03.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.882+0000 7fb093400640 1 -- 172.21.15.173:0/2074655879 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0940be3f0 con 0x7fb09c15dc80 2024-04-25T09:07:03.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.882+0000 7fb093400640 1 -- 172.21.15.173:0/2074655879 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0940be590 con 0x7fb09c15dc80 2024-04-25T09:07:03.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.882+0000 7fb093400640 1 -- 172.21.15.173:0/2074655879 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0940be980 con 0x7fb09c15dc80 2024-04-25T09:07:03.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.882+0000 7fb0a2200640 1 -- 172.21.15.173:0/2074655879 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09c0cb930 con 0x7fb09c15dc80 2024-04-25T09:07:03.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.882+0000 7fb0a2200640 1 -- 172.21.15.173:0/2074655879 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09c0cbef0 con 0x7fb09c15dc80 2024-04-25T09:07:03.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.882+0000 7fb0a2200640 1 -- 172.21.15.173:0/2074655879 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09c06ac90 con 0x7fb09c15dc80 2024-04-25T09:07:03.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.882+0000 7fb093400640 1 -- 172.21.15.173:0/2074655879 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb0940b43f0 con 0x7fb09c15dc80 2024-04-25T09:07:03.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.882+0000 7fb093400640 1 --2- 172.21.15.173:0/2074655879 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb07c066f60 0x7fb07c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:03.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.882+0000 7fb093400640 1 -- 172.21.15.173:0/2074655879 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fb09411f490 con 0x7fb09c15dc80 2024-04-25T09:07:03.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.882+0000 7fb09b400640 1 --2- 172.21.15.173:0/2074655879 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb07c066f60 0x7fb07c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:03.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.882+0000 7fb09b400640 1 --2- 172.21.15.173:0/2074655879 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb07c066f60 0x7fb07c069420 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb08c011340 tx=0x7fb08c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:03.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:03.886+0000 7fb093400640 1 -- 172.21.15.173:0/2074655879 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb0940c4060 con 0x7fb09c15dc80 2024-04-25T09:07:04.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:04.070+0000 7fb0a2200640 1 -- 172.21.15.173:0/2074655879 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb09c15a640 con 0x7fb09c15dc80 2024-04-25T09:07:04.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:04.074+0000 7fb093400640 1 -- 172.21.15.173:0/2074655879 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4952 (secure 0 0 0) 0x7fb094016150 con 0x7fb09c15dc80 2024-04-25T09:07:04.060 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:04.060 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":44,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/894026798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":894026798},{"type":"v1","addr":"172.21.15.194:6833","nonce":894026798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2000586494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2000586494},{"type":"v1","addr":"172.21.15.194:6835","nonce":2000586494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3382962588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3382962588},{"type":"v1","addr":"172.21.15.173:6837","nonce":3382962588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:50.132659+0000","modified":"2024-04-25T09:07:02.892566+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6960":{"gid":6960,"name":"c","rank":0,"incarnation":43,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.173:6836/4214702139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4214702139},{"type":"v1","addr":"172.21.15.173:6836","nonce":4214702139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:07:04.061 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 44 2024-04-25T09:07:04.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:04.074+0000 7fb0a2200640 1 -- 172.21.15.173:0/2074655879 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb07c066f60 msgr2=0x7fb07c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:04.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:04.074+0000 7fb0a2200640 1 --2- 172.21.15.173:0/2074655879 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb07c066f60 0x7fb07c069420 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb08c011340 tx=0x7fb08c00b040 comp rx=0 tx=0).stop 2024-04-25T09:07:04.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:04.074+0000 7fb0a2200640 1 -- 172.21.15.173:0/2074655879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb09c15dc80 msgr2=0x7fb09c0cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:04.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:04.074+0000 7fb0a2200640 1 --2- 172.21.15.173:0/2074655879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb09c15dc80 0x7fb09c0cb020 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fb0940ad040 tx=0x7fb09401ada0 comp rx=0 tx=0).stop 2024-04-25T09:07:04.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:04.074+0000 7fb0a2200640 1 -- 172.21.15.173:0/2074655879 shutdown_connections 2024-04-25T09:07:04.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:04.074+0000 7fb0a2200640 1 --2- 172.21.15.173:0/2074655879 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb07c066f60 0x7fb07c069420 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:04.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:04.074+0000 7fb0a2200640 1 --2- 172.21.15.173:0/2074655879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb09c15dc80 0x7fb09c0cb020 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:04.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:04.074+0000 7fb0a2200640 1 --2- 172.21.15.173:0/2074655879 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb09c0d3070 0x7fb09c0caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:04.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:04.074+0000 7fb0a2200640 1 --2- 172.21.15.173:0/2074655879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb09c0d0ae0 0x7fb09c158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:04.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:04.074+0000 7fb0a2200640 1 -- 172.21.15.173:0/2074655879 >> 172.21.15.173:0/2074655879 conn(0x7fb09c06c510 msgr2=0x7fb09c0b79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:04.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:04.074+0000 7fb0a2200640 1 -- 172.21.15.173:0/2074655879 shutdown_connections 2024-04-25T09:07:04.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:04.074+0000 7fb0a2200640 1 -- 172.21.15.173:0/2074655879 wait complete. 2024-04-25T09:07:04.484 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:06:50.132659+0000', 'modified': '2024-04-25T09:07:02.892566+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 73, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6960}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6960': {'gid': 6960, 'name': 'c', 'rank': 0, 'incarnation': 43, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.173:6836/4214702139', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6834', 'nonce': 4214702139}, {'type': 'v1', 'addr': '172.21.15.173:6836', 'nonce': 4214702139}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:07:04.484 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6960:up:reconnect 2024-04-25T09:07:05.485 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:05.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.646+0000 7f4a88a00640 1 Processor -- start 2024-04-25T09:07:05.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.646+0000 7f4a88a00640 1 -- start start 2024-04-25T09:07:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.646+0000 7f4a88a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4a840b4930 0x7f4a84161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.646+0000 7f4a88a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a840b2ee0 con 0x7f4a8415dc90 2024-04-25T09:07:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.646+0000 7f4a88a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a840b31c0 con 0x7f4a8406df90 2024-04-25T09:07:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.646+0000 7f4a88a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a8406db00 con 0x7f4a840b4930 2024-04-25T09:07:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.646+0000 7f4a83400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4a8415dc90 0x7f4a84161660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54802/0 (socket says 172.21.15.173:54802) 2024-04-25T09:07:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.646+0000 7f4a83400640 1 -- 172.21.15.173:0/3387656344 learned_addr learned my addr 172.21.15.173:0/3387656344 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.646+0000 7f4a82a00640 1 --2- 172.21.15.173:0/3387656344 >> v2:172.21.15.194:3300/0 conn(0x7f4a840b4930 0x7f4a84161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:05.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.646+0000 7f4a82000640 1 -- 172.21.15.173:0/3387656344 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867916570 0 0) 0x7f4a840b2ee0 con 0x7f4a8415dc90 2024-04-25T09:07:05.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.646+0000 7f4a82000640 1 -- 172.21.15.173:0/3387656344 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a68003530 con 0x7f4a8415dc90 2024-04-25T09:07:05.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.646+0000 7f4a82000640 1 -- 172.21.15.173:0/3387656344 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401745553 0 0) 0x7f4a840b31c0 con 0x7f4a8406df90 2024-04-25T09:07:05.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.646+0000 7f4a82000640 1 -- 172.21.15.173:0/3387656344 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a840b2ee0 con 0x7f4a8406df90 2024-04-25T09:07:05.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.646+0000 7f4a82a00640 1 -- 172.21.15.173:0/3387656344 >> v1:172.21.15.194:6789/0 conn(0x7f4a8406df90 legacy=0x7f4a8406e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:05.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.646+0000 7f4a82a00640 1 -- 172.21.15.173:0/3387656344 >> v1:172.21.15.173:6789/0 conn(0x7f4a8415dc90 legacy=0x7f4a84161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:05.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.646+0000 7f4a82a00640 1 -- 172.21.15.173:0/3387656344 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a840b4db0 con 0x7f4a840b4930 2024-04-25T09:07:05.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.650+0000 7f4a82a00640 1 --2- 172.21.15.173:0/3387656344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a840b4930 0x7f4a84161d70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4a700097c0 tx=0x7f4a7001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=909db2bd800f0329 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.650+0000 7f4a82000640 1 -- 172.21.15.173:0/3387656344 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a700b0070 con 0x7f4a840b4930 2024-04-25T09:07:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.650+0000 7f4a82000640 1 -- 172.21.15.173:0/3387656344 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a700ab600 con 0x7f4a840b4930 2024-04-25T09:07:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.650+0000 7f4a82000640 1 -- 172.21.15.173:0/3387656344 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a700ab9d0 con 0x7f4a840b4930 2024-04-25T09:07:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.650+0000 7f4a88a00640 1 -- 172.21.15.173:0/3387656344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a840b4930 msgr2=0x7f4a84161d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.650+0000 7f4a88a00640 1 --2- 172.21.15.173:0/3387656344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a840b4930 0x7f4a84161d70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4a700097c0 tx=0x7f4a7001c410 comp rx=0 tx=0).stop 2024-04-25T09:07:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.650+0000 7f4a88a00640 1 -- 172.21.15.173:0/3387656344 shutdown_connections 2024-04-25T09:07:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.650+0000 7f4a88a00640 1 --2- 172.21.15.173:0/3387656344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a840b4930 0x7f4a84161d70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.650+0000 7f4a88a00640 1 -- 172.21.15.173:0/3387656344 >> 172.21.15.173:0/3387656344 conn(0x7f4a840cc800 msgr2=0x7f4a840ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.650+0000 7f4a88a00640 1 -- 172.21.15.173:0/3387656344 shutdown_connections 2024-04-25T09:07:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.650+0000 7f4a88a00640 1 -- 172.21.15.173:0/3387656344 wait complete. 2024-04-25T09:07:05.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.650+0000 7f4a88a00640 1 Processor -- start 2024-04-25T09:07:05.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a88a00640 1 -- start start 2024-04-25T09:07:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a88a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a8406df90 0x7f4a841559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a88a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840b4930 0x7f4a84139830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a88a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a8415dc90 0x7f4a84153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a88a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8416bbc0 con 0x7f4a840b4930 2024-04-25T09:07:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a88a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a841624c0 con 0x7f4a8415dc90 2024-04-25T09:07:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a88a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8416bd40 con 0x7f4a8406df90 2024-04-25T09:07:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a82a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840b4930 0x7f4a84139830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a82a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840b4930 0x7f4a84139830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49254/0 (socket says 172.21.15.173:49254) 2024-04-25T09:07:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a82a00640 1 -- 172.21.15.173:0/1681388801 learned_addr learned my addr 172.21.15.173:0/1681388801 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a83400640 1 --2- 172.21.15.173:0/1681388801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a8406df90 0x7f4a841559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a83e00640 1 --2- 172.21.15.173:0/1681388801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a8415dc90 0x7f4a84153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a82a00640 1 -- 172.21.15.173:0/1681388801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a8406df90 msgr2=0x7f4a841559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:05.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a82a00640 1 --2- 172.21.15.173:0/1681388801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a8406df90 0x7f4a841559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:05.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a82a00640 1 -- 172.21.15.173:0/1681388801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a8415dc90 msgr2=0x7f4a84153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:05.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a82a00640 1 --2- 172.21.15.173:0/1681388801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a8415dc90 0x7f4a84153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:05.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a82a00640 1 -- 172.21.15.173:0/1681388801 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a84154940 con 0x7f4a840b4930 2024-04-25T09:07:05.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a82a00640 1 --2- 172.21.15.173:0/1681388801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840b4930 0x7f4a84139830 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f4a700097c0 tx=0x7f4a700191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:05.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a7b400640 1 -- 172.21.15.173:0/1681388801 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a700b0040 con 0x7f4a840b4930 2024-04-25T09:07:05.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a7b400640 1 -- 172.21.15.173:0/1681388801 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a700b9070 con 0x7f4a840b4930 2024-04-25T09:07:05.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a7b400640 1 -- 172.21.15.173:0/1681388801 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a700b4670 con 0x7f4a840b4930 2024-04-25T09:07:05.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a88a00640 1 -- 172.21.15.173:0/1681388801 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a84154c20 con 0x7f4a840b4930 2024-04-25T09:07:05.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a88a00640 1 -- 172.21.15.173:0/1681388801 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a841551e0 con 0x7f4a840b4930 2024-04-25T09:07:05.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.654+0000 7f4a88a00640 1 -- 172.21.15.173:0/1681388801 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a84073a40 con 0x7f4a840b4930 2024-04-25T09:07:05.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.658+0000 7f4a7b400640 1 -- 172.21.15.173:0/1681388801 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4a700b4810 con 0x7f4a840b4930 2024-04-25T09:07:05.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.658+0000 7f4a7b400640 1 --2- 172.21.15.173:0/1681388801 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4a64066f60 0x7f4a64069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:05.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.658+0000 7f4a7b400640 1 -- 172.21.15.173:0/1681388801 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f4a7011ee30 con 0x7f4a840b4930 2024-04-25T09:07:05.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.658+0000 7f4a83400640 1 --2- 172.21.15.173:0/1681388801 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4a64066f60 0x7f4a64069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:05.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.658+0000 7f4a83400640 1 --2- 172.21.15.173:0/1681388801 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4a64066f60 0x7f4a64069420 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4a74000f70 tx=0x7f4a74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:05.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.662+0000 7f4a7b400640 1 -- 172.21.15.173:0/1681388801 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4a70016090 con 0x7f4a840b4930 2024-04-25T09:07:05.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.850+0000 7f4a88a00640 1 -- 172.21.15.173:0/1681388801 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a840ccc50 con 0x7f4a840b4930 2024-04-25T09:07:05.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.854+0000 7f4a7b400640 1 -- 172.21.15.173:0/1681388801 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f4a700efbc0 con 0x7f4a840b4930 2024-04-25T09:07:05.840 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:05.840 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":45,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/894026798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":894026798},{"type":"v1","addr":"172.21.15.194:6833","nonce":894026798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2000586494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2000586494},{"type":"v1","addr":"172.21.15.194:6835","nonce":2000586494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3382962588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3382962588},{"type":"v1","addr":"172.21.15.173:6837","nonce":3382962588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:50.132659+0000","modified":"2024-04-25T09:07:03.882304+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6960":{"gid":6960,"name":"c","rank":0,"incarnation":43,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.173:6836/4214702139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4214702139},{"type":"v1","addr":"172.21.15.173:6836","nonce":4214702139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:07:05.841 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 45 2024-04-25T09:07:05.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.854+0000 7f4a88a00640 1 -- 172.21.15.173:0/1681388801 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4a64066f60 msgr2=0x7f4a64069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.854+0000 7f4a88a00640 1 --2- 172.21.15.173:0/1681388801 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4a64066f60 0x7f4a64069420 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4a74000f70 tx=0x7f4a74009040 comp rx=0 tx=0).stop 2024-04-25T09:07:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.854+0000 7f4a88a00640 1 -- 172.21.15.173:0/1681388801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840b4930 msgr2=0x7f4a84139830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.854+0000 7f4a88a00640 1 --2- 172.21.15.173:0/1681388801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840b4930 0x7f4a84139830 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f4a700097c0 tx=0x7f4a700191b0 comp rx=0 tx=0).stop 2024-04-25T09:07:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.854+0000 7f4a88a00640 1 -- 172.21.15.173:0/1681388801 shutdown_connections 2024-04-25T09:07:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.854+0000 7f4a88a00640 1 --2- 172.21.15.173:0/1681388801 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4a64066f60 0x7f4a64069420 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.854+0000 7f4a88a00640 1 --2- 172.21.15.173:0/1681388801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a8415dc90 0x7f4a84153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.854+0000 7f4a88a00640 1 --2- 172.21.15.173:0/1681388801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840b4930 0x7f4a84139830 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.854+0000 7f4a88a00640 1 --2- 172.21.15.173:0/1681388801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a8406df90 0x7f4a841559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.854+0000 7f4a88a00640 1 -- 172.21.15.173:0/1681388801 >> 172.21.15.173:0/1681388801 conn(0x7f4a840cc800 msgr2=0x7f4a840cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.854+0000 7f4a88a00640 1 -- 172.21.15.173:0/1681388801 shutdown_connections 2024-04-25T09:07:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:05.854+0000 7f4a88a00640 1 -- 172.21.15.173:0/1681388801 wait complete. 2024-04-25T09:07:06.265 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:06:50.132659+0000', 'modified': '2024-04-25T09:07:03.882304+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 73, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6960}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6960': {'gid': 6960, 'name': 'c', 'rank': 0, 'incarnation': 43, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.173:6836/4214702139', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6834', 'nonce': 4214702139}, {'type': 'v1', 'addr': '172.21.15.173:6836', 'nonce': 4214702139}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:07:06.266 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6960:up:rejoin 2024-04-25T09:07:07.266 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:07.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.422+0000 7ff889200640 1 Processor -- start 2024-04-25T09:07:07.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.426+0000 7ff889200640 1 -- start start 2024-04-25T09:07:07.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.426+0000 7ff889200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff884145250 0x7ff88415c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:07.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.426+0000 7ff889200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff8840ccd30 0x7ff884071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:07.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.426+0000 7ff889200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff88415cec0 con 0x7ff8840cc8b0 2024-04-25T09:07:07.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.426+0000 7ff889200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff88406e7c0 con 0x7ff8840ccd30 2024-04-25T09:07:07.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.426+0000 7ff889200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff88406d720 con 0x7ff884145250 2024-04-25T09:07:07.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.426+0000 7ff882800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff8840ccd30 0x7ff884071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:07.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.426+0000 7ff879400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ff8840cc8b0 0x7ff884071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54816/0 (socket says 172.21.15.173:54816) 2024-04-25T09:07:07.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.426+0000 7ff879400640 1 -- 172.21.15.173:0/3827133906 learned_addr learned my addr 172.21.15.173:0/3827133906 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:07.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.426+0000 7ff881e00640 1 --2- 172.21.15.173:0/3827133906 >> v2:172.21.15.194:3300/0 conn(0x7ff884145250 0x7ff88415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:07.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.426+0000 7ff882800640 1 -- 172.21.15.173:0/3827133906 >> v2:172.21.15.194:3300/0 conn(0x7ff884145250 msgr2=0x7ff88415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:07.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.426+0000 7ff882800640 1 --2- 172.21.15.173:0/3827133906 >> v2:172.21.15.194:3300/0 conn(0x7ff884145250 0x7ff88415c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:07.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.426+0000 7ff882800640 1 -- 172.21.15.173:0/3827133906 >> v1:172.21.15.173:6789/0 conn(0x7ff8840cc8b0 legacy=0x7ff884071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:07.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.426+0000 7ff881400640 1 -- 172.21.15.173:0/3827133906 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186079046 0 0) 0x7ff86c001120 con 0x7ff8840cc8b0 2024-04-25T09:07:07.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.426+0000 7ff882800640 1 -- 172.21.15.173:0/3827133906 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88406da00 con 0x7ff8840ccd30 2024-04-25T09:07:07.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.430+0000 7ff882800640 1 --2- 172.21.15.173:0/3827133906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8840ccd30 0x7ff884071a30 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff8840d0420 tx=0x7ff87c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb13761d29145c2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:07.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.430+0000 7ff881400640 1 -- 172.21.15.173:0/3827133906 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c0b2070 con 0x7ff8840ccd30 2024-04-25T09:07:07.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.430+0000 7ff881400640 1 -- 172.21.15.173:0/3827133906 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87c0a59c0 con 0x7ff8840ccd30 2024-04-25T09:07:07.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.430+0000 7ff881400640 1 -- 172.21.15.173:0/3827133906 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c0a5d90 con 0x7ff8840ccd30 2024-04-25T09:07:07.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.430+0000 7ff889200640 1 -- 172.21.15.173:0/3827133906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8840ccd30 msgr2=0x7ff884071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:07.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.430+0000 7ff889200640 1 --2- 172.21.15.173:0/3827133906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8840ccd30 0x7ff884071a30 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff8840d0420 tx=0x7ff87c01c900 comp rx=0 tx=0).stop 2024-04-25T09:07:07.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.430+0000 7ff889200640 1 -- 172.21.15.173:0/3827133906 shutdown_connections 2024-04-25T09:07:07.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.430+0000 7ff889200640 1 --2- 172.21.15.173:0/3827133906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8840ccd30 0x7ff884071a30 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:07.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.430+0000 7ff889200640 1 --2- 172.21.15.173:0/3827133906 >> v2:172.21.15.194:3300/0 conn(0x7ff884145250 0x7ff88415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:07.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.430+0000 7ff889200640 1 -- 172.21.15.173:0/3827133906 >> 172.21.15.173:0/3827133906 conn(0x7ff88406ac90 msgr2=0x7ff88406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:07.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.430+0000 7ff889200640 1 -- 172.21.15.173:0/3827133906 shutdown_connections 2024-04-25T09:07:07.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.430+0000 7ff889200640 1 -- 172.21.15.173:0/3827133906 wait complete. 2024-04-25T09:07:07.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.430+0000 7ff889200640 1 Processor -- start 2024-04-25T09:07:07.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.430+0000 7ff889200640 1 -- start start 2024-04-25T09:07:07.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff889200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8840cc8b0 0x7ff88413da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:07.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff889200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8840ccd30 0x7ff8840ced10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:07.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff889200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff884145250 0x7ff8840cf250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:07.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff889200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88406ef80 con 0x7ff8840ccd30 2024-04-25T09:07:07.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff889200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff884145630 con 0x7ff8840cc8b0 2024-04-25T09:07:07.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff889200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8840cd140 con 0x7ff884145250 2024-04-25T09:07:07.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff879400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8840ccd30 0x7ff8840ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:07.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff879400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8840ccd30 0x7ff8840ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49280/0 (socket says 172.21.15.173:49280) 2024-04-25T09:07:07.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff879400640 1 -- 172.21.15.173:0/2226899439 learned_addr learned my addr 172.21.15.173:0/2226899439 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:07.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff881e00640 1 --2- 172.21.15.173:0/2226899439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8840cc8b0 0x7ff88413da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:07.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff882800640 1 --2- 172.21.15.173:0/2226899439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff884145250 0x7ff8840cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:07.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff879400640 1 -- 172.21.15.173:0/2226899439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff884145250 msgr2=0x7ff8840cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:07.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff879400640 1 --2- 172.21.15.173:0/2226899439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff884145250 0x7ff8840cf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:07.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff879400640 1 -- 172.21.15.173:0/2226899439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8840cc8b0 msgr2=0x7ff88413da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:07.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff879400640 1 --2- 172.21.15.173:0/2226899439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8840cc8b0 0x7ff88413da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:07.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff879400640 1 -- 172.21.15.173:0/2226899439 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff884140140 con 0x7ff8840ccd30 2024-04-25T09:07:07.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff882800640 1 --2- 172.21.15.173:0/2226899439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff884145250 0x7ff8840cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:07.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff879400640 1 --2- 172.21.15.173:0/2226899439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8840ccd30 0x7ff8840ced10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00c780 tx=0x7ff86c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:07.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff87aa00640 1 -- 172.21.15.173:0/2226899439 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c018070 con 0x7ff8840ccd30 2024-04-25T09:07:07.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff87aa00640 1 -- 172.21.15.173:0/2226899439 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c0072f0 con 0x7ff8840ccd30 2024-04-25T09:07:07.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff889200640 1 -- 172.21.15.173:0/2226899439 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff884140420 con 0x7ff8840ccd30 2024-04-25T09:07:07.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff87aa00640 1 -- 172.21.15.173:0/2226899439 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c0047f0 con 0x7ff8840ccd30 2024-04-25T09:07:07.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff889200640 1 -- 172.21.15.173:0/2226899439 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8841409e0 con 0x7ff8840ccd30 2024-04-25T09:07:07.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.434+0000 7ff889200640 1 -- 172.21.15.173:0/2226899439 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff884073a40 con 0x7ff8840ccd30 2024-04-25T09:07:07.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.438+0000 7ff87aa00640 1 -- 172.21.15.173:0/2226899439 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff86c01b070 con 0x7ff8840ccd30 2024-04-25T09:07:07.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.438+0000 7ff87aa00640 1 --2- 172.21.15.173:0/2226899439 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff860066f60 0x7ff860069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:07.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.438+0000 7ff87aa00640 1 -- 172.21.15.173:0/2226899439 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ff86c084690 con 0x7ff8840ccd30 2024-04-25T09:07:07.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.438+0000 7ff881e00640 1 --2- 172.21.15.173:0/2226899439 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff860066f60 0x7ff860069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:07.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.438+0000 7ff881e00640 1 --2- 172.21.15.173:0/2226899439 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff860066f60 0x7ff860069420 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff8840cfae0 tx=0x7ff874008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:07.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.442+0000 7ff87aa00640 1 -- 172.21.15.173:0/2226899439 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff88415cec0 con 0x7ff8840ccd30 2024-04-25T09:07:07.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.626+0000 7ff889200640 1 -- 172.21.15.173:0/2226899439 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8840b4770 con 0x7ff8840ccd30 2024-04-25T09:07:07.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.626+0000 7ff87aa00640 1 -- 172.21.15.173:0/2226899439 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4949 (secure 0 0 0) 0x7ff86c054dd0 con 0x7ff8840ccd30 2024-04-25T09:07:07.616 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:07.616 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":46,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/894026798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":894026798},{"type":"v1","addr":"172.21.15.194:6833","nonce":894026798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2000586494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2000586494},{"type":"v1","addr":"172.21.15.194:6835","nonce":2000586494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3382962588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3382962588},{"type":"v1","addr":"172.21.15.173:6837","nonce":3382962588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:50.132659+0000","modified":"2024-04-25T09:07:04.888384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6960":{"gid":6960,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.173:6836/4214702139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4214702139},{"type":"v1","addr":"172.21.15.173:6836","nonce":4214702139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:07:07.617 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 46 2024-04-25T09:07:07.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.630+0000 7ff889200640 1 -- 172.21.15.173:0/2226899439 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff860066f60 msgr2=0x7ff860069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:07.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.630+0000 7ff889200640 1 --2- 172.21.15.173:0/2226899439 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff860066f60 0x7ff860069420 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff8840cfae0 tx=0x7ff874008040 comp rx=0 tx=0).stop 2024-04-25T09:07:07.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.630+0000 7ff889200640 1 -- 172.21.15.173:0/2226899439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8840ccd30 msgr2=0x7ff8840ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:07.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.630+0000 7ff889200640 1 --2- 172.21.15.173:0/2226899439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8840ccd30 0x7ff8840ced10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00c780 tx=0x7ff86c00cc40 comp rx=0 tx=0).stop 2024-04-25T09:07:07.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.630+0000 7ff889200640 1 -- 172.21.15.173:0/2226899439 shutdown_connections 2024-04-25T09:07:07.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.630+0000 7ff889200640 1 --2- 172.21.15.173:0/2226899439 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff860066f60 0x7ff860069420 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:07.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.630+0000 7ff889200640 1 --2- 172.21.15.173:0/2226899439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff884145250 0x7ff8840cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:07.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.630+0000 7ff889200640 1 --2- 172.21.15.173:0/2226899439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8840ccd30 0x7ff8840ced10 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:07.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.630+0000 7ff889200640 1 --2- 172.21.15.173:0/2226899439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8840cc8b0 0x7ff88413da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:07.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.630+0000 7ff889200640 1 -- 172.21.15.173:0/2226899439 >> 172.21.15.173:0/2226899439 conn(0x7ff88406ac90 msgr2=0x7ff88415e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:07.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.630+0000 7ff889200640 1 -- 172.21.15.173:0/2226899439 shutdown_connections 2024-04-25T09:07:07.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:07.630+0000 7ff889200640 1 -- 172.21.15.173:0/2226899439 wait complete. 2024-04-25T09:07:08.040 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:06:50.132659+0000', 'modified': '2024-04-25T09:07:04.888384+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 73, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6960}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6960': {'gid': 6960, 'name': 'c', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.173:6836/4214702139', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6834', 'nonce': 4214702139}, {'type': 'v1', 'addr': '172.21.15.173:6836', 'nonce': 4214702139}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:07:08.040 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:07:08.040 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:07:08.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.190+0000 7f01aec00640 1 Processor -- start 2024-04-25T09:07:08.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.190+0000 7f01aec00640 1 -- start start 2024-04-25T09:07:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.194+0000 7f01aec00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f01a8145290 0x7f01a815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.194+0000 7f01aec00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f01a80cc260 0x7f01a80cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.194+0000 7f01aec00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a815c5f0 con 0x7f01a80b3fe0 2024-04-25T09:07:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.194+0000 7f01aec00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a806d4b0 con 0x7f01a80cc260 2024-04-25T09:07:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.194+0000 7f01aec00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a806d790 con 0x7f01a8145290 2024-04-25T09:07:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.194+0000 7f01acc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f01a80cc260 0x7f01a80cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.194+0000 7f01acc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f01a80cc260 0x7f01a80cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49282/0 (socket says 172.21.15.173:49282) 2024-04-25T09:07:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.194+0000 7f01acc00640 1 -- 172.21.15.173:0/1080186527 learned_addr learned my addr 172.21.15.173:0/1080186527 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.194+0000 7f01a7e00640 1 --2- 172.21.15.173:0/1080186527 >> v2:172.21.15.194:3300/0 conn(0x7f01a8145290 0x7f01a815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.194+0000 7f01acc00640 1 -- 172.21.15.173:0/1080186527 >> v2:172.21.15.194:3300/0 conn(0x7f01a8145290 msgr2=0x7f01a815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.194+0000 7f01acc00640 1 --2- 172.21.15.173:0/1080186527 >> v2:172.21.15.194:3300/0 conn(0x7f01a8145290 0x7f01a815c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.194+0000 7f01acc00640 1 -- 172.21.15.173:0/1080186527 >> v1:172.21.15.173:6789/0 conn(0x7f01a80b3fe0 legacy=0x7f01a80b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.194+0000 7f01acc00640 1 -- 172.21.15.173:0/1080186527 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a806da70 con 0x7f01a80cc260 2024-04-25T09:07:08.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.194+0000 7f01acc00640 1 --2- 172.21.15.173:0/1080186527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01a80cc260 0x7f01a80cc670 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f01a80d0800 tx=0x7f01a001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33c9387cf04025b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:08.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.194+0000 7f01a7400640 1 -- 172.21.15.173:0/1080186527 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a00b1070 con 0x7f01a80cc260 2024-04-25T09:07:08.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01a7400640 1 -- 172.21.15.173:0/1080186527 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a00ac640 con 0x7f01a80cc260 2024-04-25T09:07:08.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01a7400640 1 -- 172.21.15.173:0/1080186527 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a00aca10 con 0x7f01a80cc260 2024-04-25T09:07:08.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01aec00640 1 -- 172.21.15.173:0/1080186527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01a80cc260 msgr2=0x7f01a80cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:08.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01aec00640 1 --2- 172.21.15.173:0/1080186527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01a80cc260 0x7f01a80cc670 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f01a80d0800 tx=0x7f01a001c400 comp rx=0 tx=0).stop 2024-04-25T09:07:08.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01aec00640 1 -- 172.21.15.173:0/1080186527 shutdown_connections 2024-04-25T09:07:08.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01aec00640 1 --2- 172.21.15.173:0/1080186527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01a80cc260 0x7f01a80cc670 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01aec00640 1 --2- 172.21.15.173:0/1080186527 >> v2:172.21.15.194:3300/0 conn(0x7f01a8145290 0x7f01a815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01aec00640 1 -- 172.21.15.173:0/1080186527 >> 172.21.15.173:0/1080186527 conn(0x7f01a806ac90 msgr2=0x7f01a806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:08.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01aec00640 1 -- 172.21.15.173:0/1080186527 shutdown_connections 2024-04-25T09:07:08.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01aec00640 1 -- 172.21.15.173:0/1080186527 wait complete. 2024-04-25T09:07:08.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01aec00640 1 Processor -- start 2024-04-25T09:07:08.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01aec00640 1 -- start start 2024-04-25T09:07:08.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01aec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01a80b3fe0 0x7f01a815ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01aec00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01a80cc260 0x7f01a80ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01aec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01a8145290 0x7f01a815dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01aec00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a806eee0 con 0x7f01a80cc260 2024-04-25T09:07:08.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01aec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a806ed60 con 0x7f01a8145290 2024-04-25T09:07:08.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01aec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a806f060 con 0x7f01a80b3fe0 2024-04-25T09:07:08.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f019f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01a80cc260 0x7f01a80ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f019f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01a80cc260 0x7f01a80ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49288/0 (socket says 172.21.15.173:49288) 2024-04-25T09:07:08.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f019f400640 1 -- 172.21.15.173:0/2643417136 learned_addr learned my addr 172.21.15.173:0/2643417136 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:08.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.198+0000 7f01acc00640 1 --2- 172.21.15.173:0/2643417136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01a8145290 0x7f01a815dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.202+0000 7f01a7e00640 1 --2- 172.21.15.173:0/2643417136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01a80b3fe0 0x7f01a815ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.202+0000 7f019f400640 1 -- 172.21.15.173:0/2643417136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01a80b3fe0 msgr2=0x7f01a815ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:08.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.202+0000 7f019f400640 1 --2- 172.21.15.173:0/2643417136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01a80b3fe0 0x7f01a815ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.202+0000 7f019f400640 1 -- 172.21.15.173:0/2643417136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01a8145290 msgr2=0x7f01a815dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:08.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.202+0000 7f019f400640 1 --2- 172.21.15.173:0/2643417136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01a8145290 0x7f01a815dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.202+0000 7f019f400640 1 -- 172.21.15.173:0/2643417136 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a80adbd0 con 0x7f01a80cc260 2024-04-25T09:07:08.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.202+0000 7f01a7e00640 1 --2- 172.21.15.173:0/2643417136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01a80b3fe0 0x7f01a815ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:08.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.202+0000 7f019f400640 1 --2- 172.21.15.173:0/2643417136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01a80cc260 0x7f01a80ad280 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f019000c390 tx=0x7f019000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:08.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.202+0000 7f01a4c00640 1 -- 172.21.15.173:0/2643417136 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190017070 con 0x7f01a80cc260 2024-04-25T09:07:08.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.202+0000 7f01a4c00640 1 -- 172.21.15.173:0/2643417136 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01900052f0 con 0x7f01a80cc260 2024-04-25T09:07:08.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.202+0000 7f01a4c00640 1 -- 172.21.15.173:0/2643417136 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190003840 con 0x7f01a80cc260 2024-04-25T09:07:08.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.202+0000 7f01aec00640 1 -- 172.21.15.173:0/2643417136 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a80adeb0 con 0x7f01a80cc260 2024-04-25T09:07:08.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.202+0000 7f01aec00640 1 -- 172.21.15.173:0/2643417136 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a80ae470 con 0x7f01a80cc260 2024-04-25T09:07:08.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.202+0000 7f01a4c00640 1 -- 172.21.15.173:0/2643417136 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f019001a070 con 0x7f01a80cc260 2024-04-25T09:07:08.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01a4c00640 1 --2- 172.21.15.173:0/2643417136 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0184066f60 0x7f0184069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01a4c00640 1 -- 172.21.15.173:0/2643417136 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f0190084530 con 0x7f01a80cc260 2024-04-25T09:07:08.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01a7e00640 1 --2- 172.21.15.173:0/2643417136 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0184066f60 0x7f0184069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01b2161000 1 Processor -- start 2024-04-25T09:07:08.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01b2161000 1 -- start start 2024-04-25T09:07:08.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01a7e00640 1 --2- 172.21.15.173:0/2643417136 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0184066f60 0x7f0184069420 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0198003fd0 tx=0x7f0198003a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:08.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01b2161000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f43920 0x55bc80f43d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01b2161000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80f44240 0x55bc80ef99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01b2161000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80ef9f30 0x55bc80efa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01b2161000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc80de15f0 con 0x55bc80f43920 2024-04-25T09:07:08.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01b2161000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc80d48da0 con 0x55bc80f44240 2024-04-25T09:07:08.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01b2161000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc80cd1150 con 0x55bc80ef9f30 2024-04-25T09:07:08.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01a7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f43920 0x55bc80f43d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01a7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f43920 0x55bc80f43d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49294/0 (socket says 172.21.15.173:49294) 2024-04-25T09:07:08.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01a7e00640 1 -- 172.21.15.173:0/1976652460 learned_addr learned my addr 172.21.15.173:0/1976652460 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:08.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f019f400640 1 --2- 172.21.15.173:0/1976652460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80f44240 0x55bc80ef99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01acc00640 1 --2- 172.21.15.173:0/1976652460 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80ef9f30 0x55bc80efa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01a7e00640 1 -- 172.21.15.173:0/1976652460 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80ef9f30 msgr2=0x55bc80efa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:08.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01a7e00640 1 --2- 172.21.15.173:0/1976652460 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80ef9f30 0x55bc80efa310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01a7e00640 1 -- 172.21.15.173:0/1976652460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80f44240 msgr2=0x55bc80ef99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:08.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01a7e00640 1 --2- 172.21.15.173:0/1976652460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80f44240 0x55bc80ef99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01a7e00640 1 -- 172.21.15.173:0/1976652460 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc80ceaca0 con 0x55bc80f43920 2024-04-25T09:07:08.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f019f400640 1 --2- 172.21.15.173:0/1976652460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80f44240 0x55bc80ef99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:08.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01a7e00640 1 --2- 172.21.15.173:0/1976652460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f43920 0x55bc80f43d00 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f0198009fd0 tx=0x7f0198012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cffa78e94e8e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:08.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f019cc00640 1 -- 172.21.15.173:0/1976652460 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198026070 con 0x55bc80f43920 2024-04-25T09:07:08.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f019cc00640 1 -- 172.21.15.173:0/1976652460 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01980147e0 con 0x55bc80f43920 2024-04-25T09:07:08.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f019cc00640 1 -- 172.21.15.173:0/1976652460 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198014bd0 con 0x55bc80f43920 2024-04-25T09:07:08.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01b2161000 1 -- 172.21.15.173:0/1976652460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f43920 msgr2=0x55bc80f43d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:08.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01b2161000 1 --2- 172.21.15.173:0/1976652460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f43920 0x55bc80f43d00 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f0198009fd0 tx=0x7f0198012000 comp rx=0 tx=0).stop 2024-04-25T09:07:08.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01b2161000 1 -- 172.21.15.173:0/1976652460 shutdown_connections 2024-04-25T09:07:08.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01b2161000 1 --2- 172.21.15.173:0/1976652460 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80ef9f30 0x55bc80efa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01b2161000 1 --2- 172.21.15.173:0/1976652460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80f44240 0x55bc80ef99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01b2161000 1 --2- 172.21.15.173:0/1976652460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f43920 0x55bc80f43d00 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01b2161000 1 -- 172.21.15.173:0/1976652460 >> 172.21.15.173:0/1976652460 conn(0x55bc80f002a0 msgr2=0x55bc80ef82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:08.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01b2161000 1 -- 172.21.15.173:0/1976652460 shutdown_connections 2024-04-25T09:07:08.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.206+0000 7f01b2161000 1 -- 172.21.15.173:0/1976652460 wait complete. 2024-04-25T09:07:08.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01b2161000 1 -- start start 2024-04-25T09:07:08.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01b2161000 1 Processor -- start 2024-04-25T09:07:08.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01b2161000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80ef9f30 0x55bc80f4ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01b2161000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80f43920 0x55bc80f4b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01b2161000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f44240 0x55bc80efdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01b2161000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc80d03990 con 0x55bc80f44240 2024-04-25T09:07:08.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01b2161000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc80d44e40 con 0x55bc80ef9f30 2024-04-25T09:07:08.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01b2161000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc80cd4900 con 0x55bc80f43920 2024-04-25T09:07:08.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01b2161000 10 client.0 _ll_register_callbacks cb 0x55bc80dfc1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:08.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01acc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f44240 0x55bc80efdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01acc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f44240 0x55bc80efdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49298/0 (socket says 172.21.15.173:49298) 2024-04-25T09:07:08.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01acc00640 1 -- 172.21.15.173:0/703151687 learned_addr learned my addr 172.21.15.173:0/703151687 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:08.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f019f400640 1 --2- 172.21.15.173:0/703151687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80f43920 0x55bc80f4b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01a7e00640 1 --2- 172.21.15.173:0/703151687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80ef9f30 0x55bc80f4ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01acc00640 1 -- 172.21.15.173:0/703151687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80f43920 msgr2=0x55bc80f4b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:08.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01acc00640 1 --2- 172.21.15.173:0/703151687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80f43920 0x55bc80f4b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01acc00640 1 -- 172.21.15.173:0/703151687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80ef9f30 msgr2=0x55bc80f4ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:08.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01acc00640 1 --2- 172.21.15.173:0/703151687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80ef9f30 0x55bc80f4ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01acc00640 1 -- 172.21.15.173:0/703151687 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc80d01630 con 0x55bc80f44240 2024-04-25T09:07:08.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f019f400640 1 --2- 172.21.15.173:0/703151687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80f43920 0x55bc80f4b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:08.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01acc00640 1 --2- 172.21.15.173:0/703151687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f44240 0x55bc80efdaa0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f01a0019010 tx=0x7f01a001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2578fad3bd7c2b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:08.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f0195600640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:07:08.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f0195600640 1 -- 172.21.15.173:0/703151687 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a00bc020 con 0x55bc80f44240 2024-04-25T09:07:08.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01b2161000 1 -- 172.21.15.173:0/703151687 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01980147e0 con 0x55bc80f44240 2024-04-25T09:07:08.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f0195600640 1 -- 172.21.15.173:0/703151687 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f01a00accc0 con 0x55bc80f44240 2024-04-25T09:07:08.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f0195600640 1 -- 172.21.15.173:0/703151687 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01a00c6050 con 0x55bc80f44240 2024-04-25T09:07:08.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01b2161000 10 client.7008 fetch_fsmap learned FSMap version 46 2024-04-25T09:07:08.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01b2161000 1 -- 172.21.15.173:0/703151687 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x55bc80cd13a0 con 0x55bc80f44240 2024-04-25T09:07:08.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f0195600640 1 -- 172.21.15.173:0/703151687 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01980147e0 con 0x55bc80f44240 2024-04-25T09:07:08.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f0195600640 1 -- 172.21.15.173:0/703151687 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f01a00c9020 con 0x55bc80f44240 2024-04-25T09:07:08.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01b2161000 10 client.7008 fetch_fsmap finished waiting for FSMap version 46 2024-04-25T09:07:08.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01b2161000 10 client.7008 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:07:08.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01b2161000 20 client.7008 populate_metadata read hostname 'smithi173' 2024-04-25T09:07:08.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01b2161000 1 --2- 172.21.15.173:0/703151687 >> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] conn(0x55bc80eff160 0x55bc80f54ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01b2161000 4 client.7008 mds_command: new command op to 6960 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:07:08.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01b2161000 1 -- 172.21.15.173:0/703151687 --> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc80ce4a50 con 0x55bc80eff160 2024-04-25T09:07:08.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.210+0000 7f01a7e00640 1 --2- 172.21.15.173:0/703151687 >> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] conn(0x55bc80eff160 0x55bc80f54ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.214+0000 7f01a7e00640 1 --2- 172.21.15.173:0/703151687 >> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] conn(0x55bc80eff160 0x55bc80f54ce0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95fd487a7750084e server_cookie=cd5ec1b45a86bed3 in_seq=0 out_seq=0 2024-04-25T09:07:08.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.214+0000 7f0195600640 10 client.7008 ms_handle_connect on v2:172.21.15.173:6834/4214702139 2024-04-25T09:07:08.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.214+0000 7f0195600640 1 -- 172.21.15.173:0/703151687 <== mds.0 v2:172.21.15.173:6834/4214702139 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bc80ce4a50 con 0x55bc80eff160 2024-04-25T09:07:08.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.214+0000 7f0195600640 10 client.7008 handle_command_reply: tid=0 2024-04-25T09:07:08.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.214+0000 7f01b2161000 1 client.7008 shutdown 2024-04-25T09:07:08.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.214+0000 7f01b2161000 1 -- 172.21.15.173:0/703151687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f44240 msgr2=0x55bc80efdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:08.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.214+0000 7f01b2161000 1 --2- 172.21.15.173:0/703151687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f44240 0x55bc80efdaa0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f01a0019010 tx=0x7f01a001ac40 comp rx=0 tx=0).stop 2024-04-25T09:07:08.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.214+0000 7f01b2161000 1 -- 172.21.15.173:0/703151687 shutdown_connections 2024-04-25T09:07:08.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.214+0000 7f01b2161000 1 --2- 172.21.15.173:0/703151687 >> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] conn(0x55bc80eff160 0x55bc80f54ce0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.214+0000 7f01b2161000 1 --2- 172.21.15.173:0/703151687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f44240 0x55bc80efdaa0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.214+0000 7f01b2161000 1 --2- 172.21.15.173:0/703151687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80f43920 0x55bc80f4b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.214+0000 7f01b2161000 1 --2- 172.21.15.173:0/703151687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80ef9f30 0x55bc80f4ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.214+0000 7f01b2161000 1 -- 172.21.15.173:0/703151687 >> 172.21.15.173:0/703151687 conn(0x55bc80f002a0 msgr2=0x55bc80ef89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:08.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.214+0000 7f0195600640 0 client.7008 ms_handle_reset on v2:172.21.15.173:6834/4214702139 2024-04-25T09:07:08.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.214+0000 7f01b2161000 1 -- 172.21.15.173:0/703151687 shutdown_connections 2024-04-25T09:07:08.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.214+0000 7f01b2161000 1 -- 172.21.15.173:0/703151687 wait complete. 2024-04-25T09:07:08.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.214+0000 7f01b2161000 20 client.7008 trim_cache size 0 max 16384 2024-04-25T09:07:08.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01b2161000 1 Processor -- start 2024-04-25T09:07:08.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01b2161000 1 -- start start 2024-04-25T09:07:08.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01b2161000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80ef9f30 0x55bc80efd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01b2161000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f43920 0x55bc80efd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01b2161000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80f44240 0x55bc80f4d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01b2161000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a8202770 con 0x55bc80f43920 2024-04-25T09:07:08.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01b2161000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a81f7b20 con 0x55bc80ef9f30 2024-04-25T09:07:08.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01b2161000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a8202170 con 0x55bc80f44240 2024-04-25T09:07:08.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f019f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f43920 0x55bc80efd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f019f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f43920 0x55bc80efd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49312/0 (socket says 172.21.15.173:49312) 2024-04-25T09:07:08.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f019f400640 1 -- 172.21.15.173:0/2364079096 learned_addr learned my addr 172.21.15.173:0/2364079096 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:08.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01a7e00640 1 --2- 172.21.15.173:0/2364079096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80ef9f30 0x55bc80efd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01acc00640 1 --2- 172.21.15.173:0/2364079096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80f44240 0x55bc80f4d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f019f400640 1 -- 172.21.15.173:0/2364079096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80f44240 msgr2=0x55bc80f4d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:08.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f019f400640 1 --2- 172.21.15.173:0/2364079096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80f44240 0x55bc80f4d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f019f400640 1 -- 172.21.15.173:0/2364079096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80ef9f30 msgr2=0x55bc80efd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:08.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f019f400640 1 --2- 172.21.15.173:0/2364079096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80ef9f30 0x55bc80efd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f019f400640 1 -- 172.21.15.173:0/2364079096 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc80f44070 con 0x55bc80f43920 2024-04-25T09:07:08.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01a7e00640 1 --2- 172.21.15.173:0/2364079096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80ef9f30 0x55bc80efd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:08.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f019f400640 1 --2- 172.21.15.173:0/2364079096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f43920 0x55bc80efd870 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f019000cd50 tx=0x7f0190005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c0553a2d35f6af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:08.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f0197e00640 1 -- 172.21.15.173:0/2364079096 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190052f70 con 0x55bc80f43920 2024-04-25T09:07:08.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f0197e00640 1 -- 172.21.15.173:0/2364079096 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01900512e0 con 0x55bc80f43920 2024-04-25T09:07:08.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f0197e00640 1 -- 172.21.15.173:0/2364079096 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01900550d0 con 0x55bc80f43920 2024-04-25T09:07:08.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01b2161000 1 -- 172.21.15.173:0/2364079096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f43920 msgr2=0x55bc80efd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:08.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01b2161000 1 --2- 172.21.15.173:0/2364079096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f43920 0x55bc80efd870 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f019000cd50 tx=0x7f0190005040 comp rx=0 tx=0).stop 2024-04-25T09:07:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01b2161000 1 -- 172.21.15.173:0/2364079096 shutdown_connections 2024-04-25T09:07:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01b2161000 1 --2- 172.21.15.173:0/2364079096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80f44240 0x55bc80f4d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01b2161000 1 --2- 172.21.15.173:0/2364079096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f43920 0x55bc80efd870 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01b2161000 1 --2- 172.21.15.173:0/2364079096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80ef9f30 0x55bc80efd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01b2161000 1 -- 172.21.15.173:0/2364079096 >> 172.21.15.173:0/2364079096 conn(0x55bc80f002a0 msgr2=0x55bc80f30260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.230+0000 7f01b2161000 1 -- 172.21.15.173:0/2364079096 shutdown_connections 2024-04-25T09:07:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 1 -- 172.21.15.173:0/2364079096 wait complete. 2024-04-25T09:07:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 1 -- start start 2024-04-25T09:07:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 1 Processor -- start 2024-04-25T09:07:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80ef9f30 0x55bc80f873e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80f43920 0x55bc80f87920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f44240 0x55bc80f509d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc80d4d3d0 con 0x55bc80f44240 2024-04-25T09:07:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc80e04d50 con 0x55bc80ef9f30 2024-04-25T09:07:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc80ce3980 con 0x55bc80f43920 2024-04-25T09:07:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 10 client.0 _ll_register_callbacks cb 0x7f0198009730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:08.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01acc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f44240 0x55bc80f509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01acc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f44240 0x55bc80f509d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49326/0 (socket says 172.21.15.173:49326) 2024-04-25T09:07:08.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01acc00640 1 -- 172.21.15.173:0/1108986861 learned_addr learned my addr 172.21.15.173:0/1108986861 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:08.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f019f400640 1 --2- 172.21.15.173:0/1108986861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80f43920 0x55bc80f87920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01a7e00640 1 --2- 172.21.15.173:0/1108986861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80ef9f30 0x55bc80f873e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01acc00640 1 -- 172.21.15.173:0/1108986861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80f43920 msgr2=0x55bc80f87920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:08.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01acc00640 1 --2- 172.21.15.173:0/1108986861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80f43920 0x55bc80f87920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01acc00640 1 -- 172.21.15.173:0/1108986861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80ef9f30 msgr2=0x55bc80f873e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:08.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01acc00640 1 --2- 172.21.15.173:0/1108986861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80ef9f30 0x55bc80f873e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01acc00640 1 -- 172.21.15.173:0/1108986861 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc80dca600 con 0x55bc80f44240 2024-04-25T09:07:08.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01a7e00640 1 --2- 172.21.15.173:0/1108986861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80ef9f30 0x55bc80f873e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:08.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f019f400640 1 --2- 172.21.15.173:0/1108986861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80f43920 0x55bc80f87920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:08.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01acc00640 1 --2- 172.21.15.173:0/1108986861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f44240 0x55bc80f509d0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f01a00c1410 tx=0x7f01a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8276d548057fd02e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:08.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f0195600640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:07:08.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f0195600640 1 -- 172.21.15.173:0/1108986861 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a00bc070 con 0x55bc80f44240 2024-04-25T09:07:08.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 1 -- 172.21.15.173:0/1108986861 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01900512e0 con 0x55bc80f44240 2024-04-25T09:07:08.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f0195600640 1 -- 172.21.15.173:0/1108986861 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f01a00acbf0 con 0x55bc80f44240 2024-04-25T09:07:08.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f0195600640 1 -- 172.21.15.173:0/1108986861 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01a00b1040 con 0x55bc80f44240 2024-04-25T09:07:08.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 10 client.7014 fetch_fsmap learned FSMap version 46 2024-04-25T09:07:08.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 1 -- 172.21.15.173:0/1108986861 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x55bc80cdd9b0 con 0x55bc80f44240 2024-04-25T09:07:08.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f0195600640 1 -- 172.21.15.173:0/1108986861 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01900512e0 con 0x55bc80f44240 2024-04-25T09:07:08.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f0195600640 1 -- 172.21.15.173:0/1108986861 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f01a00c9070 con 0x55bc80f44240 2024-04-25T09:07:08.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 10 client.7014 fetch_fsmap finished waiting for FSMap version 46 2024-04-25T09:07:08.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 10 client.7014 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:07:08.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 20 client.7014 populate_metadata read hostname 'smithi173' 2024-04-25T09:07:08.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 1 --2- 172.21.15.173:0/1108986861 >> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] conn(0x55bc80f510a0 0x55bc80f88230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 4 client.7014 mds_command: new command op to 6960 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:07:08.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01b2161000 1 -- 172.21.15.173:0/1108986861 --> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bc80d562e0 con 0x55bc80f510a0 2024-04-25T09:07:08.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.234+0000 7f01a7e00640 1 --2- 172.21.15.173:0/1108986861 >> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] conn(0x55bc80f510a0 0x55bc80f88230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01a7e00640 1 --2- 172.21.15.173:0/1108986861 >> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] conn(0x55bc80f510a0 0x55bc80f88230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93ce4bd0ca704092 server_cookie=e6431c4f66e65a29 in_seq=0 out_seq=0 2024-04-25T09:07:08.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f0195600640 10 client.7014 ms_handle_connect on v2:172.21.15.173:6834/4214702139 2024-04-25T09:07:08.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f0195600640 1 -- 172.21.15.173:0/1108986861 <== mds.0 v2:172.21.15.173:6834/4214702139 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55bc80d562e0 con 0x55bc80f510a0 2024-04-25T09:07:08.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f0195600640 10 client.7014 handle_command_reply: tid=0 2024-04-25T09:07:08.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01b2161000 1 client.7014 shutdown 2024-04-25T09:07:08.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01b2161000 1 -- 172.21.15.173:0/1108986861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f44240 msgr2=0x55bc80f509d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:08.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01b2161000 1 --2- 172.21.15.173:0/1108986861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f44240 0x55bc80f509d0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f01a00c1410 tx=0x7f01a0008040 comp rx=0 tx=0).stop 2024-04-25T09:07:08.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01b2161000 1 -- 172.21.15.173:0/1108986861 shutdown_connections 2024-04-25T09:07:08.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01b2161000 1 --2- 172.21.15.173:0/1108986861 >> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] conn(0x55bc80f510a0 0x55bc80f88230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01b2161000 1 --2- 172.21.15.173:0/1108986861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc80f44240 0x55bc80f509d0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01b2161000 1 --2- 172.21.15.173:0/1108986861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55bc80f43920 0x55bc80f87920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f0195600640 0 client.7014 ms_handle_reset on v2:172.21.15.173:6834/4214702139 2024-04-25T09:07:08.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01b2161000 1 --2- 172.21.15.173:0/1108986861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc80ef9f30 0x55bc80f873e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01b2161000 1 -- 172.21.15.173:0/1108986861 >> 172.21.15.173:0/1108986861 conn(0x55bc80f002a0 msgr2=0x55bc80efc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:08.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01b2161000 1 -- 172.21.15.173:0/1108986861 shutdown_connections 2024-04-25T09:07:08.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01b2161000 1 -- 172.21.15.173:0/1108986861 wait complete. 2024-04-25T09:07:08.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01b2161000 20 client.7014 trim_cache size 0 max 16384 2024-04-25T09:07:08.229 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:07:08.229 INFO:teuthology.orchestra.run.smithi173.stdout: "cluster_fsid": "ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6", 2024-04-25T09:07:08.229 INFO:teuthology.orchestra.run.smithi173.stdout: "whoami": 0, 2024-04-25T09:07:08.229 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 6960, 2024-04-25T09:07:08.229 INFO:teuthology.orchestra.run.smithi173.stdout: "want_state": "up:active", 2024-04-25T09:07:08.229 INFO:teuthology.orchestra.run.smithi173.stdout: "state": "up:active", 2024-04-25T09:07:08.229 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs", 2024-04-25T09:07:08.229 INFO:teuthology.orchestra.run.smithi173.stdout: "rank_uptime": 5.3575789709999997, 2024-04-25T09:07:08.230 INFO:teuthology.orchestra.run.smithi173.stdout: "mdsmap_epoch": 46, 2024-04-25T09:07:08.230 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch": 73, 2024-04-25T09:07:08.230 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch_barrier": 73, 2024-04-25T09:07:08.230 INFO:teuthology.orchestra.run.smithi173.stdout: "uptime": 6.1933297429999996 2024-04-25T09:07:08.230 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:07:08.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01aec00640 1 -- 172.21.15.173:0/2643417136 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0184066f60 msgr2=0x7f0184069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:08.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01aec00640 1 --2- 172.21.15.173:0/2643417136 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0184066f60 0x7f0184069420 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0198003fd0 tx=0x7f0198003a00 comp rx=0 tx=0).stop 2024-04-25T09:07:08.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01aec00640 1 -- 172.21.15.173:0/2643417136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01a80cc260 msgr2=0x7f01a80ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:08.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01aec00640 1 --2- 172.21.15.173:0/2643417136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01a80cc260 0x7f01a80ad280 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f019000c390 tx=0x7f019000c850 comp rx=0 tx=0).stop 2024-04-25T09:07:08.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01aec00640 1 -- 172.21.15.173:0/2643417136 shutdown_connections 2024-04-25T09:07:08.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01aec00640 1 --2- 172.21.15.173:0/2643417136 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0184066f60 0x7f0184069420 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01aec00640 1 --2- 172.21.15.173:0/2643417136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01a8145290 0x7f01a815dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01aec00640 1 --2- 172.21.15.173:0/2643417136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01a80cc260 0x7f01a80ad280 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01aec00640 1 --2- 172.21.15.173:0/2643417136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01a80b3fe0 0x7f01a815ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01aec00640 1 -- 172.21.15.173:0/2643417136 >> 172.21.15.173:0/2643417136 conn(0x7f01a806ac90 msgr2=0x7f01a806b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:08.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01aec00640 1 -- 172.21.15.173:0/2643417136 shutdown_connections 2024-04-25T09:07:08.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.238+0000 7f01aec00640 1 -- 172.21.15.173:0/2643417136 wait complete. 2024-04-25T09:07:08.245 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:07:08.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.390+0000 7fee19600640 1 Processor -- start 2024-04-25T09:07:08.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.390+0000 7fee19600640 1 -- start start 2024-04-25T09:07:08.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.394+0000 7fee19600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee14145250 0x7fee1415c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.394+0000 7fee19600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fee140cc8b0 0x7fee140ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.394+0000 7fee19600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee1415cec0 con 0x7fee14071320 2024-04-25T09:07:08.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.394+0000 7fee19600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1406e7c0 con 0x7fee140cc8b0 2024-04-25T09:07:08.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.394+0000 7fee19600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1406d720 con 0x7fee14145250 2024-04-25T09:07:08.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.394+0000 7fee0a000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fee140cc8b0 0x7fee140ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.394+0000 7fee12a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee14145250 0x7fee1415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.394+0000 7fee0a000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fee140cc8b0 0x7fee140ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:52220/0 (socket says 172.21.15.173:52220) 2024-04-25T09:07:08.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.394+0000 7fee0a000640 1 -- 172.21.15.173:0/3040425787 learned_addr learned my addr 172.21.15.173:0/3040425787 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:08.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.394+0000 7fee0a000640 1 -- 172.21.15.173:0/3040425787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee14145250 msgr2=0x7fee1415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:08.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.394+0000 7fee0a000640 1 --2- 172.21.15.173:0/3040425787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee14145250 0x7fee1415c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.394+0000 7fee0a000640 1 -- 172.21.15.173:0/3040425787 >> v1:172.21.15.194:6789/0 conn(0x7fee14071320 legacy=0x7fee14071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:08.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.394+0000 7fee0a000640 1 -- 172.21.15.173:0/3040425787 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1406da00 con 0x7fee140cc8b0 2024-04-25T09:07:08.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.394+0000 7fee12a00640 1 --2- 172.21.15.173:0/3040425787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee14145250 0x7fee1415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:08.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.394+0000 7fee12000640 1 -- 172.21.15.173:0/3040425787 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917734223 0 0) 0x7fee0c0014a0 con 0x7fee14071320 2024-04-25T09:07:08.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.398+0000 7fee0a000640 1 --2- 172.21.15.173:0/3040425787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee140cc8b0 0x7fee140ccd30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fedfc009870 tx=0x7fedfc01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2441f5703ba9eadd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:08.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.398+0000 7fee12000640 1 -- 172.21.15.173:0/3040425787 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0ab650 con 0x7fee140cc8b0 2024-04-25T09:07:08.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.398+0000 7fee12000640 1 -- 172.21.15.173:0/3040425787 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc0b0070 con 0x7fee140cc8b0 2024-04-25T09:07:08.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.398+0000 7fee12000640 1 -- 172.21.15.173:0/3040425787 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0aba10 con 0x7fee140cc8b0 2024-04-25T09:07:08.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.398+0000 7fee19600640 1 -- 172.21.15.173:0/3040425787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee140cc8b0 msgr2=0x7fee140ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:08.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.398+0000 7fee19600640 1 --2- 172.21.15.173:0/3040425787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee140cc8b0 0x7fee140ccd30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fedfc009870 tx=0x7fedfc01c560 comp rx=0 tx=0).stop 2024-04-25T09:07:08.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.398+0000 7fee19600640 1 -- 172.21.15.173:0/3040425787 shutdown_connections 2024-04-25T09:07:08.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.398+0000 7fee19600640 1 --2- 172.21.15.173:0/3040425787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee140cc8b0 0x7fee140ccd30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.398+0000 7fee19600640 1 --2- 172.21.15.173:0/3040425787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee14145250 0x7fee1415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.398+0000 7fee19600640 1 -- 172.21.15.173:0/3040425787 >> 172.21.15.173:0/3040425787 conn(0x7fee1406ac90 msgr2=0x7fee1406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:08.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.398+0000 7fee19600640 1 -- 172.21.15.173:0/3040425787 shutdown_connections 2024-04-25T09:07:08.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.398+0000 7fee19600640 1 -- 172.21.15.173:0/3040425787 wait complete. 2024-04-25T09:07:08.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.398+0000 7fee19600640 1 Processor -- start 2024-04-25T09:07:08.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.398+0000 7fee19600640 1 -- start start 2024-04-25T09:07:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee19600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14071320 0x7fee140ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee19600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee140cc8b0 0x7fee1413fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee19600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee14145250 0x7fee141402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee19600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1406ef80 con 0x7fee14071320 2024-04-25T09:07:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee19600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee14145630 con 0x7fee14145250 2024-04-25T09:07:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee19600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1406d380 con 0x7fee140cc8b0 2024-04-25T09:07:08.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee12a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14071320 0x7fee140ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee12a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14071320 0x7fee140ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49332/0 (socket says 172.21.15.173:49332) 2024-04-25T09:07:08.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee12a00640 1 -- 172.21.15.173:0/2853916878 learned_addr learned my addr 172.21.15.173:0/2853916878 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:08.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee0a000640 1 --2- 172.21.15.173:0/2853916878 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee140cc8b0 0x7fee1413fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee13400640 1 --2- 172.21.15.173:0/2853916878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee14145250 0x7fee141402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee12a00640 1 -- 172.21.15.173:0/2853916878 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee140cc8b0 msgr2=0x7fee1413fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:08.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee12a00640 1 --2- 172.21.15.173:0/2853916878 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee140cc8b0 0x7fee1413fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee12a00640 1 -- 172.21.15.173:0/2853916878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee14145250 msgr2=0x7fee141402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:08.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee12a00640 1 --2- 172.21.15.173:0/2853916878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee14145250 0x7fee141402b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee12a00640 1 -- 172.21.15.173:0/2853916878 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee140b29f0 con 0x7fee14071320 2024-04-25T09:07:08.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee12a00640 1 --2- 172.21.15.173:0/2853916878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14071320 0x7fee140ad770 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fee0400ec10 tx=0x7fee0400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:08.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee0b400640 1 -- 172.21.15.173:0/2853916878 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04017070 con 0x7fee14071320 2024-04-25T09:07:08.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee0b400640 1 -- 172.21.15.173:0/2853916878 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0400cc30 con 0x7fee14071320 2024-04-25T09:07:08.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee0b400640 1 -- 172.21.15.173:0/2853916878 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04013470 con 0x7fee14071320 2024-04-25T09:07:08.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee19600640 1 -- 172.21.15.173:0/2853916878 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee140b2cd0 con 0x7fee14071320 2024-04-25T09:07:08.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee19600640 1 -- 172.21.15.173:0/2853916878 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee140b3290 con 0x7fee14071320 2024-04-25T09:07:08.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee19600640 1 -- 172.21.15.173:0/2853916878 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee14073a40 con 0x7fee14071320 2024-04-25T09:07:08.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.402+0000 7fee0b400640 1 -- 172.21.15.173:0/2853916878 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fee0401a070 con 0x7fee14071320 2024-04-25T09:07:08.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.406+0000 7fee0b400640 1 --2- 172.21.15.173:0/2853916878 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fedf0066f90 0x7fedf0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:08.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.406+0000 7fee0b400640 1 -- 172.21.15.173:0/2853916878 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fee04085520 con 0x7fee14071320 2024-04-25T09:07:08.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.406+0000 7fee0a000640 1 --2- 172.21.15.173:0/2853916878 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fedf0066f90 0x7fedf0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:08.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.406+0000 7fee0a000640 1 --2- 172.21.15.173:0/2853916878 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fedf0066f90 0x7fedf0069450 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0af000 tx=0x7fedfc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:08.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.410+0000 7fee0b400640 1 -- 172.21.15.173:0/2853916878 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fee04055c60 con 0x7fee14071320 2024-04-25T09:07:08.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.594+0000 7fee19600640 1 -- 172.21.15.173:0/2853916878 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fee14166310 con 0x7fee14071320 2024-04-25T09:07:08.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.594+0000 7fee0b400640 1 -- 172.21.15.173:0/2853916878 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) v1 ==== 53+0+73 (secure 0 0 0) 0x7fee04059d00 con 0x7fee14071320 2024-04-25T09:07:08.584 INFO:teuthology.orchestra.run.smithi173.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:07:08.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.598+0000 7fee19600640 1 -- 172.21.15.173:0/2853916878 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fedf0066f90 msgr2=0x7fedf0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:08.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.598+0000 7fee19600640 1 --2- 172.21.15.173:0/2853916878 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fedf0066f90 0x7fedf0069450 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0af000 tx=0x7fedfc0a7000 comp rx=0 tx=0).stop 2024-04-25T09:07:08.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.598+0000 7fee19600640 1 -- 172.21.15.173:0/2853916878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14071320 msgr2=0x7fee140ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:08.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.598+0000 7fee19600640 1 --2- 172.21.15.173:0/2853916878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14071320 0x7fee140ad770 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fee0400ec10 tx=0x7fee0400c520 comp rx=0 tx=0).stop 2024-04-25T09:07:08.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.598+0000 7fee19600640 1 -- 172.21.15.173:0/2853916878 shutdown_connections 2024-04-25T09:07:08.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.598+0000 7fee19600640 1 --2- 172.21.15.173:0/2853916878 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fedf0066f90 0x7fedf0069450 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.598+0000 7fee19600640 1 --2- 172.21.15.173:0/2853916878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee14145250 0x7fee141402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.598+0000 7fee19600640 1 --2- 172.21.15.173:0/2853916878 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee140cc8b0 0x7fee1413fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.598+0000 7fee19600640 1 --2- 172.21.15.173:0/2853916878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14071320 0x7fee140ad770 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:08.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.598+0000 7fee19600640 1 -- 172.21.15.173:0/2853916878 >> 172.21.15.173:0/2853916878 conn(0x7fee1406ac90 msgr2=0x7fee1415e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:08.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.598+0000 7fee19600640 1 -- 172.21.15.173:0/2853916878 shutdown_connections 2024-04-25T09:07:08.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:08.598+0000 7fee19600640 1 -- 172.21.15.173:0/2853916878 wait complete. 2024-04-25T09:07:08.605 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:07:08.606 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:07:08.606 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2024-04-25T09:07:08.606 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:07:08.606 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:08.606 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:07:08.606 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:07:08.606 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:07:08.606 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:07:08.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:08.607 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2024-04-25T09:07:08.615 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:07:08.615 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:07:08.616 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:07:08.616 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:08.616 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-25T09:07:08.616 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:08.616 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:07:08.616 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:08.616 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2024-04-25T09:07:08.616 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:07:08.616 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:08.616 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2024-04-25T09:07:08.616 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:07:08.616 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:08.616 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:07:08.616 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:08.617 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:07:08.617 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 42189sec preferred_lft 42189sec 2024-04-25T09:07:08.617 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2024-04-25T09:07:08.617 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:08.617 INFO:teuthology.orchestra.run.smithi173.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:07:08.617 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 02:42:00:0e:60:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:08.617 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:07:08.617 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:08.617 INFO:teuthology.orchestra.run.smithi173.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:07:08.617 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:08.617 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:07:08.617 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:08.617 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:07:08.617 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:08.617 INFO:teuthology.orchestra.run.smithi173.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:07:08.618 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:07:08.618 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:07:08.618 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:08.618 INFO:teuthology.orchestra.run.smithi173.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:07:08.618 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:07:08.618 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:07:08.618 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:08.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:08.619 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:07:08.677 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-04-25T09:07:08.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:08.679 DEBUG:teuthology.orchestra.run.smithi173:> route 2024-04-25T09:07:08.731 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2024-04-25T09:07:08.731 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:07:08.731 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:07:08.732 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:07:08.732 INFO:teuthology.orchestra.run.smithi173.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:07:08.732 INFO:teuthology.orchestra.run.smithi173.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:07:08.732 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:07:08.732 INFO:teuthology.orchestra.run.smithi173.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:07:08.732 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:07:08.732 INFO:teuthology.orchestra.run.smithi173.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:07:08.732 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:07:08.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:08.733 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:07:08.733 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:07:08.733 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:07:08.733 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:07:08.733 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:07:08.733 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:07:08.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:08.821 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-25T09:07:08.829 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:07:08.829 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:07:08.830 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:07:08.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:08.830 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2024-04-25T09:07:08.892 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:07:08.892 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:08.945 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:07:08.946 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:07:08.946 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:08.995 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:07:08.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:08.995 DEBUG:teuthology.orchestra.run.smithi173:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:07:09.083 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:07:09.083 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:07:09.083 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:07:09.098 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:07:09.098 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:07:09.098 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:07:09.098 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:07:09.098 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:07:09.107 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:07:09.107 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:07:09.107 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:07:09.108 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:07:09.108 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:07:09.108 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-04-25T09:07:09.108 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-04-25T09:07:09.108 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6" will pass to kernel 2024-04-25T09:07:09.111 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:07:09.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:09.112 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:09.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:09.131 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:07:09.182 INFO:teuthology.orchestra.run.smithi173.stdout:client6610 2024-04-25T09:07:09.182 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:07:09.182 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:09.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:09.232 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-04-25T09:07:09.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:07:09.281 INFO:teuthology.orchestra.run.smithi173.stderr:rmdir: failed to remove 'scrub_repair_path': Directory not empty 2024-04-25T09:07:09.281 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_repair_path repair' 2024-04-25T09:07:09.282 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:07:09.282 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start /scrub_repair_path repair 2024-04-25T09:07:09.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.474+0000 7f116be00640 1 Processor -- start 2024-04-25T09:07:09.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.474+0000 7f116be00640 1 -- start start 2024-04-25T09:07:09.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.474+0000 7f116be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f116406e1c0 0x7f116406bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.474+0000 7f116be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f116406c410 0x7f11640aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.474+0000 7f116be00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f116406ae30 con 0x7f11640ad3f0 2024-04-25T09:07:09.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.474+0000 7f116be00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11640b3170 con 0x7f116406e1c0 2024-04-25T09:07:09.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.478+0000 7f116be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116415e070 con 0x7f116406c410 2024-04-25T09:07:09.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.478+0000 7f1169400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f116406e1c0 0x7f116406bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:09.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.478+0000 7f1169e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f11640ad3f0 0x7f116406e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54824/0 (socket says 172.21.15.173:54824) 2024-04-25T09:07:09.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.478+0000 7f1169e00640 1 -- 172.21.15.173:0/3310260971 learned_addr learned my addr 172.21.15.173:0/3310260971 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:09.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.478+0000 7f1168a00640 1 --2- 172.21.15.173:0/3310260971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f116406c410 0x7f11640aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:09.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.478+0000 7f1169400640 1 -- 172.21.15.173:0/3310260971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f116406c410 msgr2=0x7f11640aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:09.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.478+0000 7f1169400640 1 --2- 172.21.15.173:0/3310260971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f116406c410 0x7f11640aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.478+0000 7f1169400640 1 -- 172.21.15.173:0/3310260971 >> v1:172.21.15.173:6789/0 conn(0x7f11640ad3f0 legacy=0x7f116406e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:09.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.478+0000 7f1169400640 1 -- 172.21.15.173:0/3310260971 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116406b110 con 0x7f116406e1c0 2024-04-25T09:07:09.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.478+0000 7f1163e00640 1 -- 172.21.15.173:0/3310260971 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269881343 0 0) 0x7f116406ae30 con 0x7f11640ad3f0 2024-04-25T09:07:09.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.478+0000 7f1168a00640 1 --2- 172.21.15.173:0/3310260971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f116406c410 0x7f11640aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:09.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.478+0000 7f1169400640 1 --2- 172.21.15.173:0/3310260971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f116406e1c0 0x7f116406bed0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f11580097f0 tx=0x7f115801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a0226bc5e7911b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:09.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.478+0000 7f1163e00640 1 -- 172.21.15.173:0/3310260971 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580b5070 con 0x7f116406e1c0 2024-04-25T09:07:09.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.478+0000 7f1163e00640 1 -- 172.21.15.173:0/3310260971 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11580a8990 con 0x7f116406e1c0 2024-04-25T09:07:09.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.478+0000 7f1163e00640 1 -- 172.21.15.173:0/3310260971 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580a8d60 con 0x7f116406e1c0 2024-04-25T09:07:09.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f116be00640 1 -- 172.21.15.173:0/3310260971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f116406e1c0 msgr2=0x7f116406bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:09.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f116be00640 1 --2- 172.21.15.173:0/3310260971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f116406e1c0 0x7f116406bed0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f11580097f0 tx=0x7f115801ec90 comp rx=0 tx=0).stop 2024-04-25T09:07:09.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f116be00640 1 -- 172.21.15.173:0/3310260971 shutdown_connections 2024-04-25T09:07:09.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f116be00640 1 --2- 172.21.15.173:0/3310260971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f116406c410 0x7f11640aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f116be00640 1 --2- 172.21.15.173:0/3310260971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f116406e1c0 0x7f116406bed0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f116be00640 1 -- 172.21.15.173:0/3310260971 >> 172.21.15.173:0/3310260971 conn(0x7f11640cfed0 msgr2=0x7f11640d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:09.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f116be00640 1 -- 172.21.15.173:0/3310260971 shutdown_connections 2024-04-25T09:07:09.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f116be00640 1 -- 172.21.15.173:0/3310260971 wait complete. 2024-04-25T09:07:09.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f116be00640 1 Processor -- start 2024-04-25T09:07:09.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f116be00640 1 -- start start 2024-04-25T09:07:09.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f116be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f116406c410 0x7f1164145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f116be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f116406e1c0 0x7f116415b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f116be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11640ad3f0 0x7f116415b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f116be00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116406b9b0 con 0x7f116406e1c0 2024-04-25T09:07:09.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f116be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116406b6d0 con 0x7f116406c410 2024-04-25T09:07:09.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f116be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11640ad8a0 con 0x7f11640ad3f0 2024-04-25T09:07:09.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f1168a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f116406e1c0 0x7f116415b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:09.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f1168a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f116406e1c0 0x7f116415b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49340/0 (socket says 172.21.15.173:49340) 2024-04-25T09:07:09.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f1168a00640 1 -- 172.21.15.173:0/1067849054 learned_addr learned my addr 172.21.15.173:0/1067849054 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:09.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f1169400640 1 --2- 172.21.15.173:0/1067849054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f116406c410 0x7f1164145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:09.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.482+0000 7f1169e00640 1 --2- 172.21.15.173:0/1067849054 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11640ad3f0 0x7f116415b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:09.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.486+0000 7f1168a00640 1 -- 172.21.15.173:0/1067849054 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11640ad3f0 msgr2=0x7f116415b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:09.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.486+0000 7f1168a00640 1 --2- 172.21.15.173:0/1067849054 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11640ad3f0 0x7f116415b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.486+0000 7f1168a00640 1 -- 172.21.15.173:0/1067849054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f116406c410 msgr2=0x7f1164145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:09.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.486+0000 7f1168a00640 1 --2- 172.21.15.173:0/1067849054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f116406c410 0x7f1164145090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.486+0000 7f1168a00640 1 -- 172.21.15.173:0/1067849054 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11641455d0 con 0x7f116406e1c0 2024-04-25T09:07:09.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.486+0000 7f1169400640 1 --2- 172.21.15.173:0/1067849054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f116406c410 0x7f1164145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:09.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.486+0000 7f1168a00640 1 --2- 172.21.15.173:0/1067849054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f116406e1c0 0x7f116415b4b0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f115000c7f0 tx=0x7f115000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:09.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.486+0000 7f1161600640 1 -- 172.21.15.173:0/1067849054 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1150015070 con 0x7f116406e1c0 2024-04-25T09:07:09.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.486+0000 7f1161600640 1 -- 172.21.15.173:0/1067849054 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1150007a30 con 0x7f116406e1c0 2024-04-25T09:07:09.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.486+0000 7f1161600640 1 -- 172.21.15.173:0/1067849054 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1150007e00 con 0x7f116406e1c0 2024-04-25T09:07:09.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.486+0000 7f116be00640 1 -- 172.21.15.173:0/1067849054 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11641e3f40 con 0x7f116406e1c0 2024-04-25T09:07:09.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.486+0000 7f116be00640 1 -- 172.21.15.173:0/1067849054 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1164155070 con 0x7f116406e1c0 2024-04-25T09:07:09.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.486+0000 7f1161600640 1 -- 172.21.15.173:0/1067849054 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1150018070 con 0x7f116406e1c0 2024-04-25T09:07:09.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.486+0000 7f1161600640 1 --2- 172.21.15.173:0/1067849054 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1144066f60 0x7f1144069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.486+0000 7f1161600640 1 -- 172.21.15.173:0/1067849054 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f11500850e0 con 0x7f116406e1c0 2024-04-25T09:07:09.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.486+0000 7f1169400640 1 --2- 172.21.15.173:0/1067849054 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1144066f60 0x7f1144069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:09.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 Processor -- start 2024-04-25T09:07:09.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 -- start start 2024-04-25T09:07:09.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f1169400640 1 --2- 172.21.15.173:0/1067849054 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1144066f60 0x7f1144069420 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f11580b2000 tx=0x7f1158008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:09.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce05d8e60 0x559ce05d9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce05d9780 0x559ce0591840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce0591d80 0x559ce0592160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce0476c70 con 0x559ce05d9780 2024-04-25T09:07:09.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce03dd040 con 0x559ce0591d80 2024-04-25T09:07:09.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ce0365040 con 0x559ce05d8e60 2024-04-25T09:07:09.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f1168a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce05d9780 0x559ce0591840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:09.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f1168a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce05d9780 0x559ce0591840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49350/0 (socket says 172.21.15.173:49350) 2024-04-25T09:07:09.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f1168a00640 1 -- 172.21.15.173:0/887183718 learned_addr learned my addr 172.21.15.173:0/887183718 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:09.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f1169e00640 1 --2- 172.21.15.173:0/887183718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce0591d80 0x559ce0592160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:09.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f1169400640 1 --2- 172.21.15.173:0/887183718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce05d8e60 0x559ce05d9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:09.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f1168a00640 1 -- 172.21.15.173:0/887183718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce05d8e60 msgr2=0x559ce05d9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:09.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f1168a00640 1 --2- 172.21.15.173:0/887183718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce05d8e60 0x559ce05d9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f1168a00640 1 -- 172.21.15.173:0/887183718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce0591d80 msgr2=0x559ce0592160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:09.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f1168a00640 1 --2- 172.21.15.173:0/887183718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce0591d80 0x559ce0592160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f1168a00640 1 -- 172.21.15.173:0/887183718 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ce0394240 con 0x559ce05d9780 2024-04-25T09:07:09.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f1169e00640 1 --2- 172.21.15.173:0/887183718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce0591d80 0x559ce0592160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:09.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f1168a00640 1 --2- 172.21.15.173:0/887183718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce05d9780 0x559ce0591840 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f1150051d10 tx=0x7f11500557b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5c8989e3252373 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:09.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f1156000640 1 -- 172.21.15.173:0/887183718 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115006d020 con 0x559ce05d9780 2024-04-25T09:07:09.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f1156000640 1 -- 172.21.15.173:0/887183718 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1150053bb0 con 0x559ce05d9780 2024-04-25T09:07:09.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f1156000640 1 -- 172.21.15.173:0/887183718 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115001f040 con 0x559ce05d9780 2024-04-25T09:07:09.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 -- 172.21.15.173:0/887183718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce05d9780 msgr2=0x559ce0591840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:09.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 --2- 172.21.15.173:0/887183718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce05d9780 0x559ce0591840 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f1150051d10 tx=0x7f11500557b0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 -- 172.21.15.173:0/887183718 shutdown_connections 2024-04-25T09:07:09.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 --2- 172.21.15.173:0/887183718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce0591d80 0x559ce0592160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 --2- 172.21.15.173:0/887183718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce05d9780 0x559ce0591840 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 --2- 172.21.15.173:0/887183718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce05d8e60 0x559ce05d9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 -- 172.21.15.173:0/887183718 >> 172.21.15.173:0/887183718 conn(0x559ce0589100 msgr2=0x559ce0590120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:09.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 -- 172.21.15.173:0/887183718 shutdown_connections 2024-04-25T09:07:09.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 -- 172.21.15.173:0/887183718 wait complete. 2024-04-25T09:07:09.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 -- start start 2024-04-25T09:07:09.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.490+0000 7f116f207000 1 Processor -- start 2024-04-25T09:07:09.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f116f207000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce0591d80 0x559ce059a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f116f207000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce05d8e60 0x559ce059a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f116f207000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce05d9780 0x559ce059ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f116f207000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce0397540 con 0x559ce05d9780 2024-04-25T09:07:09.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f116f207000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce03d90e0 con 0x559ce05d8e60 2024-04-25T09:07:09.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f116f207000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ce0388260 con 0x559ce0591d80 2024-04-25T09:07:09.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f116f207000 10 client.0 _ll_register_callbacks cb 0x559ce04913a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:09.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f1169e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce05d9780 0x559ce059ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:09.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f1169e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce05d9780 0x559ce059ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49356/0 (socket says 172.21.15.173:49356) 2024-04-25T09:07:09.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f1169e00640 1 -- 172.21.15.173:0/3284628381 learned_addr learned my addr 172.21.15.173:0/3284628381 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:09.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f1169400640 1 --2- 172.21.15.173:0/3284628381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce0591d80 0x559ce059a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:09.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f1168a00640 1 --2- 172.21.15.173:0/3284628381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce05d8e60 0x559ce059a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:09.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f1169e00640 1 -- 172.21.15.173:0/3284628381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce0591d80 msgr2=0x559ce059a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:09.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f1169e00640 1 --2- 172.21.15.173:0/3284628381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce0591d80 0x559ce059a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f1169e00640 1 -- 172.21.15.173:0/3284628381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce05d8e60 msgr2=0x559ce059a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:09.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f1169e00640 1 --2- 172.21.15.173:0/3284628381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce05d8e60 0x559ce059a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f1169e00640 1 -- 172.21.15.173:0/3284628381 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ce03a5410 con 0x559ce05d9780 2024-04-25T09:07:09.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f1169e00640 1 --2- 172.21.15.173:0/3284628381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce05d9780 0x559ce059ac90 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f115c007090 tx=0x7f115c007550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bac103d8c442e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:09.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f114aa00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:07:09.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f114aa00640 1 -- 172.21.15.173:0/3284628381 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c013600 con 0x559ce05d9780 2024-04-25T09:07:09.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f114aa00640 1 -- 172.21.15.173:0/3284628381 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f115c0137a0 con 0x559ce05d9780 2024-04-25T09:07:09.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f116f207000 1 -- 172.21.15.173:0/3284628381 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1150053bb0 con 0x559ce05d9780 2024-04-25T09:07:09.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f114aa00640 1 -- 172.21.15.173:0/3284628381 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f115c022050 con 0x559ce05d9780 2024-04-25T09:07:09.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f116f207000 10 client.7032 fetch_fsmap learned FSMap version 46 2024-04-25T09:07:09.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f116f207000 1 -- 172.21.15.173:0/3284628381 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x559ce0365290 con 0x559ce05d9780 2024-04-25T09:07:09.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f114aa00640 1 -- 172.21.15.173:0/3284628381 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1150053bb0 con 0x559ce05d9780 2024-04-25T09:07:09.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f114aa00640 1 -- 172.21.15.173:0/3284628381 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f115c025020 con 0x559ce05d9780 2024-04-25T09:07:09.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f116f207000 10 client.7032 fetch_fsmap finished waiting for FSMap version 46 2024-04-25T09:07:09.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f116f207000 10 client.7032 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-04-25T09:07:09.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f116f207000 20 client.7032 populate_metadata read hostname 'smithi173' 2024-04-25T09:07:09.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f116f207000 1 --2- 172.21.15.173:0/3284628381 >> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] conn(0x559ce059b530 0x559ce05ea5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f116f207000 4 client.7032 mds_command: new command op to 6960 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:07:09.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f116f207000 1 -- 172.21.15.173:0/3284628381 --> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ce0378d70 con 0x559ce059b530 2024-04-25T09:07:09.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f1169400640 1 --2- 172.21.15.173:0/3284628381 >> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] conn(0x559ce059b530 0x559ce05ea5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:09.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f1169400640 1 --2- 172.21.15.173:0/3284628381 >> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] conn(0x559ce059b530 0x559ce05ea5e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8544e7bcc882c63b server_cookie=7ba8773873b626eb in_seq=0 out_seq=0 2024-04-25T09:07:09.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f114aa00640 10 client.7032 ms_handle_connect on v2:172.21.15.173:6834/4214702139 2024-04-25T09:07:09.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f114aa00640 1 -- 172.21.15.173:0/3284628381 <== mds.0 v2:172.21.15.173:6834/4214702139 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559ce0378d70 con 0x559ce059b530 2024-04-25T09:07:09.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.494+0000 7f114aa00640 10 client.7032 handle_command_reply: tid=0 2024-04-25T09:07:09.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.498+0000 7f116f207000 1 client.7032 shutdown 2024-04-25T09:07:09.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.498+0000 7f116f207000 1 -- 172.21.15.173:0/3284628381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce05d9780 msgr2=0x559ce059ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:09.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.498+0000 7f116f207000 1 --2- 172.21.15.173:0/3284628381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce05d9780 0x559ce059ac90 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f115c007090 tx=0x7f115c007550 comp rx=0 tx=0).stop 2024-04-25T09:07:09.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.498+0000 7f116f207000 1 -- 172.21.15.173:0/3284628381 shutdown_connections 2024-04-25T09:07:09.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.498+0000 7f116f207000 1 --2- 172.21.15.173:0/3284628381 >> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] conn(0x559ce059b530 0x559ce05ea5e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.498+0000 7f116f207000 1 --2- 172.21.15.173:0/3284628381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce05d9780 0x559ce059ac90 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.498+0000 7f116f207000 1 --2- 172.21.15.173:0/3284628381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce05d8e60 0x559ce059a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.498+0000 7f114aa00640 0 client.7032 ms_handle_reset on v2:172.21.15.173:6834/4214702139 2024-04-25T09:07:09.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.498+0000 7f116f207000 1 --2- 172.21.15.173:0/3284628381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce0591d80 0x559ce059a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.498+0000 7f116f207000 1 -- 172.21.15.173:0/3284628381 >> 172.21.15.173:0/3284628381 conn(0x559ce0589100 msgr2=0x559ce0590830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:09.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.498+0000 7f116f207000 1 -- 172.21.15.173:0/3284628381 shutdown_connections 2024-04-25T09:07:09.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.498+0000 7f116f207000 1 -- 172.21.15.173:0/3284628381 wait complete. 2024-04-25T09:07:09.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.498+0000 7f116f207000 20 client.7032 trim_cache size 0 max 16384 2024-04-25T09:07:09.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.510+0000 7f116f207000 1 Processor -- start 2024-04-25T09:07:09.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.510+0000 7f116f207000 1 -- start start 2024-04-25T09:07:09.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce0591d80 0x559ce05ec960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce05d8e60 0x559ce05ea5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce05d9780 0x559ce05eab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11642003b0 con 0x559ce0591d80 2024-04-25T09:07:09.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11641ff5b0 con 0x559ce05d8e60 2024-04-25T09:07:09.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11641562b0 con 0x559ce05d9780 2024-04-25T09:07:09.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f1169400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce0591d80 0x559ce05ec960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:09.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f1169400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce0591d80 0x559ce05ec960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49358/0 (socket says 172.21.15.173:49358) 2024-04-25T09:07:09.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f1169400640 1 -- 172.21.15.173:0/562730051 learned_addr learned my addr 172.21.15.173:0/562730051 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:09.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f1169400640 1 -- 172.21.15.173:0/562730051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce05d9780 msgr2=0x559ce05eab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:09.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f1169400640 1 --2- 172.21.15.173:0/562730051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce05d9780 0x559ce05eab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f1169400640 1 -- 172.21.15.173:0/562730051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce05d8e60 msgr2=0x559ce05ea5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:09.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f1169400640 1 --2- 172.21.15.173:0/562730051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce05d8e60 0x559ce05ea5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f1169400640 1 -- 172.21.15.173:0/562730051 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ce045f890 con 0x559ce0591d80 2024-04-25T09:07:09.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f1169400640 1 --2- 172.21.15.173:0/562730051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce0591d80 0x559ce05ec960 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f11580b3040 tx=0x7f1158004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56dcc3b413f70dba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:09.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f1155600640 1 -- 172.21.15.173:0/562730051 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580b5040 con 0x559ce0591d80 2024-04-25T09:07:09.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f1155600640 1 -- 172.21.15.173:0/562730051 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11580cc0d0 con 0x559ce0591d80 2024-04-25T09:07:09.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f1155600640 1 -- 172.21.15.173:0/562730051 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580cc480 con 0x559ce0591d80 2024-04-25T09:07:09.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 -- 172.21.15.173:0/562730051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce0591d80 msgr2=0x559ce05ec960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:09.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 --2- 172.21.15.173:0/562730051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce0591d80 0x559ce05ec960 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f11580b3040 tx=0x7f1158004740 comp rx=0 tx=0).stop 2024-04-25T09:07:09.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 -- 172.21.15.173:0/562730051 shutdown_connections 2024-04-25T09:07:09.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 --2- 172.21.15.173:0/562730051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce05d9780 0x559ce05eab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 --2- 172.21.15.173:0/562730051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce05d8e60 0x559ce05ea5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 --2- 172.21.15.173:0/562730051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce0591d80 0x559ce05ec960 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 -- 172.21.15.173:0/562730051 >> 172.21.15.173:0/562730051 conn(0x559ce0589100 msgr2=0x559ce05d6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:09.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 -- 172.21.15.173:0/562730051 shutdown_connections 2024-04-25T09:07:09.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 -- 172.21.15.173:0/562730051 wait complete. 2024-04-25T09:07:09.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 -- start start 2024-04-25T09:07:09.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 Processor -- start 2024-04-25T09:07:09.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce0591d80 0x559ce0639e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce05d8e60 0x559ce063a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce05d9780 0x559ce05f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce045f400 con 0x559ce0591d80 2024-04-25T09:07:09.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11641568b0 con 0x559ce05d9780 2024-04-25T09:07:09.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.514+0000 7f116f207000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ce0365b50 con 0x559ce05d8e60 2024-04-25T09:07:09.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 10 client.0 _ll_register_callbacks cb 0x7f115c001470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:09.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f1169400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce0591d80 0x559ce0639e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:09.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f1169400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce0591d80 0x559ce0639e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:49362/0 (socket says 172.21.15.173:49362) 2024-04-25T09:07:09.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f1169400640 1 -- 172.21.15.173:0/3467208169 learned_addr learned my addr 172.21.15.173:0/3467208169 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:09.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f1168a00640 1 --2- 172.21.15.173:0/3467208169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce05d8e60 0x559ce063a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:09.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f1169e00640 1 --2- 172.21.15.173:0/3467208169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce05d9780 0x559ce05f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:09.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f1169400640 1 -- 172.21.15.173:0/3467208169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce05d8e60 msgr2=0x559ce063a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:09.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f1169400640 1 --2- 172.21.15.173:0/3467208169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce05d8e60 0x559ce063a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f1169400640 1 -- 172.21.15.173:0/3467208169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce05d9780 msgr2=0x559ce05f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:09.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f1169400640 1 --2- 172.21.15.173:0/3467208169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce05d9780 0x559ce05f50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f1169400640 1 -- 172.21.15.173:0/3467208169 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ce0371e50 con 0x559ce0591d80 2024-04-25T09:07:09.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f1168a00640 1 --2- 172.21.15.173:0/3467208169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce05d8e60 0x559ce063a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:09.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f1169e00640 1 --2- 172.21.15.173:0/3467208169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce05d9780 0x559ce05f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:09.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f1169400640 1 --2- 172.21.15.173:0/3467208169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce0591d80 0x559ce0639e90 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f115801d340 tx=0x7f115801d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6ad3c981451963 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:09.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f114aa00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:07:09.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f114aa00640 1 -- 172.21.15.173:0/3467208169 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580da030 con 0x559ce0591d80 2024-04-25T09:07:09.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f114aa00640 1 -- 172.21.15.173:0/3467208169 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f11580bbd20 con 0x559ce0591d80 2024-04-25T09:07:09.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 1 -- 172.21.15.173:0/3467208169 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f11580cc0d0 con 0x559ce0591d80 2024-04-25T09:07:09.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f114aa00640 1 -- 172.21.15.173:0/3467208169 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11580cc280 con 0x559ce0591d80 2024-04-25T09:07:09.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 10 client.7038 fetch_fsmap learned FSMap version 46 2024-04-25T09:07:09.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 1 -- 172.21.15.173:0/3467208169 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x559ce0383f80 con 0x559ce0591d80 2024-04-25T09:07:09.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f114aa00640 1 -- 172.21.15.173:0/3467208169 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11580cc0d0 con 0x559ce0591d80 2024-04-25T09:07:09.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f114aa00640 1 -- 172.21.15.173:0/3467208169 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f11580cc420 con 0x559ce0591d80 2024-04-25T09:07:09.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 10 client.7038 fetch_fsmap finished waiting for FSMap version 46 2024-04-25T09:07:09.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 10 client.7038 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-04-25T09:07:09.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 20 client.7038 populate_metadata read hostname 'smithi173' 2024-04-25T09:07:09.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 1 --2- 172.21.15.173:0/3467208169 >> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] conn(0x559ce05f5dc0 0x559ce05f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:09.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 4 client.7038 mds_command: new command op to 6960 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}] 2024-04-25T09:07:09.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 1 -- 172.21.15.173:0/3467208169 --> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}) v1 -- 0x559ce03ea580 con 0x559ce05f5dc0 2024-04-25T09:07:09.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f1168a00640 1 --2- 172.21.15.173:0/3467208169 >> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] conn(0x559ce05f5dc0 0x559ce05f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:09.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f1168a00640 1 --2- 172.21.15.173:0/3467208169 >> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] conn(0x559ce05f5dc0 0x559ce05f61d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c5583ced32d6254 server_cookie=3a858044bb3b2246 in_seq=0 out_seq=0 2024-04-25T09:07:09.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f114aa00640 10 client.7038 ms_handle_connect on v2:172.21.15.173:6834/4214702139 2024-04-25T09:07:09.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f114aa00640 1 -- 172.21.15.173:0/3467208169 <== mds.0 v2:172.21.15.173:6834/4214702139 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x559ce03ea580 con 0x559ce05f5dc0 2024-04-25T09:07:09.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f114aa00640 10 client.7038 handle_command_reply: tid=0 2024-04-25T09:07:09.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 1 client.7038 shutdown 2024-04-25T09:07:09.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 1 -- 172.21.15.173:0/3467208169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce0591d80 msgr2=0x559ce0639e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:09.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 1 --2- 172.21.15.173:0/3467208169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce0591d80 0x559ce0639e90 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f115801d340 tx=0x7f115801d4d0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 1 -- 172.21.15.173:0/3467208169 shutdown_connections 2024-04-25T09:07:09.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 1 --2- 172.21.15.173:0/3467208169 >> [v2:172.21.15.173:6834/4214702139,v1:172.21.15.173:6836/4214702139] conn(0x559ce05f5dc0 0x559ce05f61d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 1 --2- 172.21.15.173:0/3467208169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ce05d9780 0x559ce05f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 1 --2- 172.21.15.173:0/3467208169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ce05d8e60 0x559ce063a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f114aa00640 0 client.7038 ms_handle_reset on v2:172.21.15.173:6834/4214702139 2024-04-25T09:07:09.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 1 --2- 172.21.15.173:0/3467208169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ce0591d80 0x559ce0639e90 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 1 -- 172.21.15.173:0/3467208169 >> 172.21.15.173:0/3467208169 conn(0x559ce0589100 msgr2=0x559ce05d7370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:09.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 1 -- 172.21.15.173:0/3467208169 shutdown_connections 2024-04-25T09:07:09.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 1 -- 172.21.15.173:0/3467208169 wait complete. 2024-04-25T09:07:09.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116f207000 20 client.7038 trim_cache size 0 max 16384 2024-04-25T09:07:09.511 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:07:09.512 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0, 2024-04-25T09:07:09.512 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_tag": "0a49197d-6aaf-48f0-9f20-315abf269947", 2024-04-25T09:07:09.512 INFO:teuthology.orchestra.run.smithi173.stdout: "mode": "asynchronous" 2024-04-25T09:07:09.512 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:07:09.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116be00640 1 -- 172.21.15.173:0/1067849054 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1144066f60 msgr2=0x7f1144069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:09.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116be00640 1 --2- 172.21.15.173:0/1067849054 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1144066f60 0x7f1144069420 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f11580b2000 tx=0x7f1158008040 comp rx=0 tx=0).stop 2024-04-25T09:07:09.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116be00640 1 -- 172.21.15.173:0/1067849054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f116406e1c0 msgr2=0x7f116415b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:09.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.518+0000 7f116be00640 1 --2- 172.21.15.173:0/1067849054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f116406e1c0 0x7f116415b4b0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f115000c7f0 tx=0x7f115000ccb0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.522+0000 7f116be00640 1 -- 172.21.15.173:0/1067849054 shutdown_connections 2024-04-25T09:07:09.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.522+0000 7f116be00640 1 --2- 172.21.15.173:0/1067849054 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1144066f60 0x7f1144069420 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.522+0000 7f116be00640 1 --2- 172.21.15.173:0/1067849054 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11640ad3f0 0x7f116415b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.522+0000 7f116be00640 1 --2- 172.21.15.173:0/1067849054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f116406e1c0 0x7f116415b4b0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.522+0000 7f116be00640 1 --2- 172.21.15.173:0/1067849054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f116406c410 0x7f1164145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:09.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.522+0000 7f116be00640 1 -- 172.21.15.173:0/1067849054 >> 172.21.15.173:0/1067849054 conn(0x7f11640cfed0 msgr2=0x7f11640afa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:09.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.522+0000 7f116be00640 1 -- 172.21.15.173:0/1067849054 shutdown_connections 2024-04-25T09:07:09.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:09.522+0000 7f116be00640 1 -- 172.21.15.173:0/1067849054 wait complete. 2024-04-25T09:07:09.527 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_repair_path repair' returned '{'return_code': 0, 'scrub_tag': '0a49197d-6aaf-48f0-9f20-315abf269947', 'mode': 'asynchronous'}' 2024-04-25T09:07:14.665 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:07:14.669 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:07:19.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:19.528 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-04-25T09:07:19.541 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:07:19.541 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:07:19.679 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:07:19.780 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:07:19.781 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:07:19.781 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:19.790 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:07:19.790 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:19.840 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:20.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.046+0000 7f9470c00640 1 Processor -- start 2024-04-25T09:07:20.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.046+0000 7f9470c00640 1 -- start start 2024-04-25T09:07:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.046+0000 7f9470c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f946c0b3e70 0x7f946c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.046+0000 7f9470c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f946c0aefa0 0x7f946c0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.046+0000 7f9470c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f946c15edd0 0x7f946c0b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.046+0000 7f9470c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946c06dd50 con 0x7f946c0b3e70 2024-04-25T09:07:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.046+0000 7f9470c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946c0b4790 con 0x7f946c0aefa0 2024-04-25T09:07:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.046+0000 7f9470c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946c15f320 con 0x7f946c15edd0 2024-04-25T09:07:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.046+0000 7f9469e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f946c0b3e70 0x7f946c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.046+0000 7f9469e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f946c0b3e70 0x7f946c0b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54292/0 (socket says 172.21.15.173:54292) 2024-04-25T09:07:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.046+0000 7f9469e00640 1 -- 172.21.15.173:0/2180458422 learned_addr learned my addr 172.21.15.173:0/2180458422 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.046+0000 7f9461400640 1 --2- 172.21.15.173:0/2180458422 >> v2:172.21.15.194:3300/0 conn(0x7f946c0aefa0 0x7f946c0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.046+0000 7f946a800640 1 --2- 172.21.15.173:0/2180458422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f946c15edd0 0x7f946c0b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:20.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.050+0000 7f9469e00640 1 -- 172.21.15.173:0/2180458422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f946c15edd0 msgr2=0x7f946c0b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:20.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.050+0000 7f9469e00640 1 --2- 172.21.15.173:0/2180458422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f946c15edd0 0x7f946c0b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.050+0000 7f9469e00640 1 -- 172.21.15.173:0/2180458422 >> v2:172.21.15.194:3300/0 conn(0x7f946c0aefa0 msgr2=0x7f946c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:20.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.050+0000 7f9469e00640 1 --2- 172.21.15.173:0/2180458422 >> v2:172.21.15.194:3300/0 conn(0x7f946c0aefa0 0x7f946c0b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.050+0000 7f9469e00640 1 -- 172.21.15.173:0/2180458422 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c06d420 con 0x7f946c0b3e70 2024-04-25T09:07:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.050+0000 7f9469e00640 1 --2- 172.21.15.173:0/2180458422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f946c0b3e70 0x7f946c0b4250 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f946c0d0650 tx=0x7f945c01ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd37fdbed92f914 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.050+0000 7f9469400640 1 -- 172.21.15.173:0/2180458422 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c00b2d0 con 0x7f946c0b3e70 2024-04-25T09:07:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.050+0000 7f9469400640 1 -- 172.21.15.173:0/2180458422 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945c00b470 con 0x7f946c0b3e70 2024-04-25T09:07:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.050+0000 7f9469400640 1 -- 172.21.15.173:0/2180458422 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c0a7b90 con 0x7f946c0b3e70 2024-04-25T09:07:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.050+0000 7f9470c00640 1 -- 172.21.15.173:0/2180458422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f946c0b3e70 msgr2=0x7f946c0b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.050+0000 7f9470c00640 1 --2- 172.21.15.173:0/2180458422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f946c0b3e70 0x7f946c0b4250 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f946c0d0650 tx=0x7f945c01ebc0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.050+0000 7f9470c00640 1 -- 172.21.15.173:0/2180458422 shutdown_connections 2024-04-25T09:07:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.050+0000 7f9470c00640 1 --2- 172.21.15.173:0/2180458422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f946c15edd0 0x7f946c0b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.050+0000 7f9470c00640 1 --2- 172.21.15.173:0/2180458422 >> v2:172.21.15.194:3300/0 conn(0x7f946c0aefa0 0x7f946c0b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.050+0000 7f9470c00640 1 --2- 172.21.15.173:0/2180458422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f946c0b3e70 0x7f946c0b4250 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.050+0000 7f9470c00640 1 -- 172.21.15.173:0/2180458422 >> 172.21.15.173:0/2180458422 conn(0x7f946c06ac90 msgr2=0x7f946c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.050+0000 7f9470c00640 1 -- 172.21.15.173:0/2180458422 shutdown_connections 2024-04-25T09:07:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.050+0000 7f9470c00640 1 -- 172.21.15.173:0/2180458422 wait complete. 2024-04-25T09:07:20.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9470c00640 1 Processor -- start 2024-04-25T09:07:20.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9470c00640 1 -- start start 2024-04-25T09:07:20.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9470c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f946c0aefa0 0x7f946c1f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:20.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9470c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f946c0b3e70 0x7f946c14e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:20.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9470c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f946c15edd0 0x7f946c14eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:20.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9470c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c06e1e0 con 0x7f946c0aefa0 2024-04-25T09:07:20.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9470c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c0b3600 con 0x7f946c0b3e70 2024-04-25T09:07:20.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9470c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946c06e360 con 0x7f946c15edd0 2024-04-25T09:07:20.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9469e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f946c0aefa0 0x7f946c1f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:20.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9469e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f946c0aefa0 0x7f946c1f8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54294/0 (socket says 172.21.15.173:54294) 2024-04-25T09:07:20.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9469e00640 1 -- 172.21.15.173:0/2049884374 learned_addr learned my addr 172.21.15.173:0/2049884374 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:20.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9461400640 1 --2- 172.21.15.173:0/2049884374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f946c0b3e70 0x7f946c14e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:20.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f946a800640 1 --2- 172.21.15.173:0/2049884374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f946c15edd0 0x7f946c14eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:20.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9469e00640 1 -- 172.21.15.173:0/2049884374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f946c15edd0 msgr2=0x7f946c14eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:20.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9469e00640 1 --2- 172.21.15.173:0/2049884374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f946c15edd0 0x7f946c14eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9469e00640 1 -- 172.21.15.173:0/2049884374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f946c0b3e70 msgr2=0x7f946c14e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:20.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9469e00640 1 --2- 172.21.15.173:0/2049884374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f946c0b3e70 0x7f946c14e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9469e00640 1 -- 172.21.15.173:0/2049884374 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c1f8b00 con 0x7f946c0aefa0 2024-04-25T09:07:20.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9469e00640 1 --2- 172.21.15.173:0/2049884374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f946c0aefa0 0x7f946c1f8dd0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f945c0b1040 tx=0x7f945c01b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:20.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9462a00640 1 -- 172.21.15.173:0/2049884374 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c009800 con 0x7f946c0aefa0 2024-04-25T09:07:20.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9462a00640 1 -- 172.21.15.173:0/2049884374 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945c0be070 con 0x7f946c0aefa0 2024-04-25T09:07:20.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.054+0000 7f9470c00640 1 -- 172.21.15.173:0/2049884374 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f946c0ad480 con 0x7f946c0aefa0 2024-04-25T09:07:20.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.058+0000 7f9462a00640 1 -- 172.21.15.173:0/2049884374 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c009c00 con 0x7f946c0aefa0 2024-04-25T09:07:20.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.058+0000 7f9470c00640 1 -- 172.21.15.173:0/2049884374 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f946c1f8820 con 0x7f946c0aefa0 2024-04-25T09:07:20.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.058+0000 7f9470c00640 1 -- 172.21.15.173:0/2049884374 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946c073a40 con 0x7f946c0aefa0 2024-04-25T09:07:20.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.058+0000 7f9462a00640 1 -- 172.21.15.173:0/2049884374 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f945c0b6070 con 0x7f946c0aefa0 2024-04-25T09:07:20.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.058+0000 7f9462a00640 1 --2- 172.21.15.173:0/2049884374 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9448066f90 0x7f9448069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:20.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.058+0000 7f9462a00640 1 -- 172.21.15.173:0/2049884374 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f945c11fa70 con 0x7f946c0aefa0 2024-04-25T09:07:20.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.058+0000 7f9461400640 1 --2- 172.21.15.173:0/2049884374 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9448066f90 0x7f9448069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:20.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.058+0000 7f9461400640 1 --2- 172.21.15.173:0/2049884374 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9448066f90 0x7f9448069450 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f946c0ad130 tx=0x7f9454008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:20.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.062+0000 7f9462a00640 1 -- 172.21.15.173:0/2049884374 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f945c0c7020 con 0x7f946c0aefa0 2024-04-25T09:07:20.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.218+0000 7f9470c00640 1 -- 172.21.15.173:0/2049884374 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f946c06e540 con 0x7f946c0aefa0 2024-04-25T09:07:20.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.222+0000 7f9462a00640 1 -- 172.21.15.173:0/2049884374 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+17073 (secure 0 0 0) 0x7f945c0187e0 con 0x7f946c0aefa0 2024-04-25T09:07:20.208 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:20.209 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":73,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:07:01.867759+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:48.493059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:49.133352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:6836/962695208":"2024-04-26T09:07:01.867727+0000","172.21.15.173:6834/962695208":"2024-04-26T09:07:01.867727+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:20.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.222+0000 7f9470c00640 1 -- 172.21.15.173:0/2049884374 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9448066f90 msgr2=0x7f9448069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:20.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.222+0000 7f9470c00640 1 --2- 172.21.15.173:0/2049884374 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9448066f90 0x7f9448069450 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f946c0ad130 tx=0x7f9454008040 comp rx=0 tx=0).stop 2024-04-25T09:07:20.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.222+0000 7f9470c00640 1 -- 172.21.15.173:0/2049884374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f946c0aefa0 msgr2=0x7f946c1f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:20.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.222+0000 7f9470c00640 1 --2- 172.21.15.173:0/2049884374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f946c0aefa0 0x7f946c1f8dd0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f945c0b1040 tx=0x7f945c01b960 comp rx=0 tx=0).stop 2024-04-25T09:07:20.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.222+0000 7f9470c00640 1 -- 172.21.15.173:0/2049884374 shutdown_connections 2024-04-25T09:07:20.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.222+0000 7f9470c00640 1 --2- 172.21.15.173:0/2049884374 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9448066f90 0x7f9448069450 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.222+0000 7f9470c00640 1 --2- 172.21.15.173:0/2049884374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f946c15edd0 0x7f946c14eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.222+0000 7f9470c00640 1 --2- 172.21.15.173:0/2049884374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f946c0b3e70 0x7f946c14e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.222+0000 7f9470c00640 1 --2- 172.21.15.173:0/2049884374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f946c0aefa0 0x7f946c1f8dd0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.222+0000 7f9470c00640 1 -- 172.21.15.173:0/2049884374 >> 172.21.15.173:0/2049884374 conn(0x7f946c06ac90 msgr2=0x7f946c0b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:20.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.222+0000 7f9470c00640 1 -- 172.21.15.173:0/2049884374 shutdown_connections 2024-04-25T09:07:20.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.222+0000 7f9470c00640 1 -- 172.21.15.173:0/2049884374 wait complete. 2024-04-25T09:07:20.230 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:06:48.493059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:06:49.133352+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:07:20.230 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:07:20.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.382+0000 7f00f9a00640 1 Processor -- start 2024-04-25T09:07:20.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.382+0000 7f00f9a00640 1 -- start start 2024-04-25T09:07:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.382+0000 7f00f9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00f40aeb90 0x7f00f40cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.382+0000 7f00f9a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f00f40ce2b0 0x7f00f40cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.382+0000 7f00f9a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f4071570 con 0x7f00f40aef70 2024-04-25T09:07:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.382+0000 7f00f9a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f4071320 con 0x7f00f40ce2b0 2024-04-25T09:07:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.382+0000 7f00f9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f4072330 con 0x7f00f40aeb90 2024-04-25T09:07:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.382+0000 7f00ebe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f00f40aef70 0x7f00f40cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:40424/0 (socket says 172.21.15.173:40424) 2024-04-25T09:07:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.382+0000 7f00ebe00640 1 -- 172.21.15.173:0/4241308890 learned_addr learned my addr 172.21.15.173:0/4241308890 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.382+0000 7f00f2a00640 1 --2- 172.21.15.173:0/4241308890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00f40aeb90 0x7f00f40cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:20.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.382+0000 7f00f3400640 1 --2- 172.21.15.173:0/4241308890 >> v2:172.21.15.194:3300/0 conn(0x7f00f40ce2b0 0x7f00f40cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:20.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.382+0000 7f00f2000640 1 -- 172.21.15.173:0/4241308890 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275964740 0 0) 0x7f00f4071570 con 0x7f00f40aef70 2024-04-25T09:07:20.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.382+0000 7f00f2000640 1 -- 172.21.15.173:0/4241308890 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00d8003530 con 0x7f00f40aef70 2024-04-25T09:07:20.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.382+0000 7f00f2a00640 1 -- 172.21.15.173:0/4241308890 >> v2:172.21.15.194:3300/0 conn(0x7f00f40ce2b0 msgr2=0x7f00f40cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:20.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.382+0000 7f00f2a00640 1 --2- 172.21.15.173:0/4241308890 >> v2:172.21.15.194:3300/0 conn(0x7f00f40ce2b0 0x7f00f40cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.382+0000 7f00f2a00640 1 -- 172.21.15.173:0/4241308890 >> v1:172.21.15.173:6789/0 conn(0x7f00f40aef70 legacy=0x7f00f40cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:20.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.382+0000 7f00f2a00640 1 -- 172.21.15.173:0/4241308890 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f4071850 con 0x7f00f40aeb90 2024-04-25T09:07:20.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.386+0000 7f00f2a00640 1 --2- 172.21.15.173:0/4241308890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00f40aeb90 0x7f00f40cc0d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f00e40097c0 tx=0x7f00e401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9550d27c0514b08c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:20.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.386+0000 7f00f2000640 1 -- 172.21.15.173:0/4241308890 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e40b0070 con 0x7f00f40aeb90 2024-04-25T09:07:20.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.386+0000 7f00f2000640 1 -- 172.21.15.173:0/4241308890 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e40ab600 con 0x7f00f40aeb90 2024-04-25T09:07:20.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.386+0000 7f00f2000640 1 -- 172.21.15.173:0/4241308890 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e40ab9d0 con 0x7f00f40aeb90 2024-04-25T09:07:20.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.386+0000 7f00f9a00640 1 -- 172.21.15.173:0/4241308890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00f40aeb90 msgr2=0x7f00f40cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:20.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.386+0000 7f00f9a00640 1 --2- 172.21.15.173:0/4241308890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00f40aeb90 0x7f00f40cc0d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f00e40097c0 tx=0x7f00e401c3e0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.386+0000 7f00f9a00640 1 -- 172.21.15.173:0/4241308890 shutdown_connections 2024-04-25T09:07:20.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.386+0000 7f00f9a00640 1 --2- 172.21.15.173:0/4241308890 >> v2:172.21.15.194:3300/0 conn(0x7f00f40ce2b0 0x7f00f40cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.386+0000 7f00f9a00640 1 --2- 172.21.15.173:0/4241308890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00f40aeb90 0x7f00f40cc0d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.386+0000 7f00f9a00640 1 -- 172.21.15.173:0/4241308890 >> 172.21.15.173:0/4241308890 conn(0x7f00f406ac90 msgr2=0x7f00f406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:20.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.386+0000 7f00f9a00640 1 -- 172.21.15.173:0/4241308890 shutdown_connections 2024-04-25T09:07:20.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.386+0000 7f00f9a00640 1 -- 172.21.15.173:0/4241308890 wait complete. 2024-04-25T09:07:20.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f9a00640 1 Processor -- start 2024-04-25T09:07:20.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f9a00640 1 -- start start 2024-04-25T09:07:20.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f9a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00f40aeb90 0x7f00f4141370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00f40aef70 0x7f00f4157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f9a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00f40ce2b0 0x7f00f41f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f9a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f415bb30 con 0x7f00f40aeb90 2024-04-25T09:07:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f9a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f415b9b0 con 0x7f00f40ce2b0 2024-04-25T09:07:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f415bcb0 con 0x7f00f40aef70 2024-04-25T09:07:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00f40aeb90 0x7f00f4141370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00f40aeb90 0x7f00f4141370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54310/0 (socket says 172.21.15.173:54310) 2024-04-25T09:07:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f2a00640 1 -- 172.21.15.173:0/2818070135 learned_addr learned my addr 172.21.15.173:0/2818070135 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f2a00640 1 -- 172.21.15.173:0/2818070135 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00f40aef70 msgr2=0x7f00f4157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f2a00640 1 --2- 172.21.15.173:0/2818070135 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00f40aef70 0x7f00f4157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f2a00640 1 -- 172.21.15.173:0/2818070135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00f40ce2b0 msgr2=0x7f00f41f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f2a00640 1 --2- 172.21.15.173:0/2818070135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00f40ce2b0 0x7f00f41f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f2a00640 1 -- 172.21.15.173:0/2818070135 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f41f7b70 con 0x7f00f40aeb90 2024-04-25T09:07:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f2a00640 1 --2- 172.21.15.173:0/2818070135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00f40aeb90 0x7f00f4141370 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f00e40097c0 tx=0x7f00e4019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00eaa00640 1 -- 172.21.15.173:0/2818070135 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e40b0040 con 0x7f00f40aeb90 2024-04-25T09:07:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00eaa00640 1 -- 172.21.15.173:0/2818070135 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e40b9070 con 0x7f00f40aeb90 2024-04-25T09:07:20.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f9a00640 1 -- 172.21.15.173:0/2818070135 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f41f7890 con 0x7f00f40aeb90 2024-04-25T09:07:20.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00eaa00640 1 -- 172.21.15.173:0/2818070135 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e40b4650 con 0x7f00f40aeb90 2024-04-25T09:07:20.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f9a00640 1 -- 172.21.15.173:0/2818070135 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f4157270 con 0x7f00f40aeb90 2024-04-25T09:07:20.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.390+0000 7f00f9a00640 1 -- 172.21.15.173:0/2818070135 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f4073ab0 con 0x7f00f40aeb90 2024-04-25T09:07:20.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.394+0000 7f00eaa00640 1 -- 172.21.15.173:0/2818070135 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f00e40b47f0 con 0x7f00f40aeb90 2024-04-25T09:07:20.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.394+0000 7f00eaa00640 1 --2- 172.21.15.173:0/2818070135 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f00d0066f60 0x7f00d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:20.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.394+0000 7f00eaa00640 1 -- 172.21.15.173:0/2818070135 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f00e411ef00 con 0x7f00f40aeb90 2024-04-25T09:07:20.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.394+0000 7f00ebe00640 1 --2- 172.21.15.173:0/2818070135 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f00d0066f60 0x7f00d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:20.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.394+0000 7f00ebe00640 1 --2- 172.21.15.173:0/2818070135 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f00d0066f60 0x7f00d0069420 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f00dc007fd0 tx=0x7f00dc007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:20.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.398+0000 7f00eaa00640 1 -- 172.21.15.173:0/2818070135 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f00e4016090 con 0x7f00f40aeb90 2024-04-25T09:07:20.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.550+0000 7f00f9a00640 1 -- 172.21.15.173:0/2818070135 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00f415dea0 con 0x7f00f40aeb90 2024-04-25T09:07:20.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.554+0000 7f00eaa00640 1 -- 172.21.15.173:0/2818070135 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00e40efd20 con 0x7f00f40aeb90 2024-04-25T09:07:20.540 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:07:20.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.554+0000 7f00f9a00640 1 -- 172.21.15.173:0/2818070135 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f00d0066f60 msgr2=0x7f00d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:20.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.554+0000 7f00f9a00640 1 --2- 172.21.15.173:0/2818070135 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f00d0066f60 0x7f00d0069420 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f00dc007fd0 tx=0x7f00dc007900 comp rx=0 tx=0).stop 2024-04-25T09:07:20.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.554+0000 7f00f9a00640 1 -- 172.21.15.173:0/2818070135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00f40aeb90 msgr2=0x7f00f4141370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:20.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.554+0000 7f00f9a00640 1 --2- 172.21.15.173:0/2818070135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00f40aeb90 0x7f00f4141370 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f00e40097c0 tx=0x7f00e4019180 comp rx=0 tx=0).stop 2024-04-25T09:07:20.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.554+0000 7f00f9a00640 1 -- 172.21.15.173:0/2818070135 shutdown_connections 2024-04-25T09:07:20.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.554+0000 7f00f9a00640 1 --2- 172.21.15.173:0/2818070135 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f00d0066f60 0x7f00d0069420 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.554+0000 7f00f9a00640 1 --2- 172.21.15.173:0/2818070135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00f40ce2b0 0x7f00f41f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.554+0000 7f00f9a00640 1 --2- 172.21.15.173:0/2818070135 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00f40aef70 0x7f00f4157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.554+0000 7f00f9a00640 1 --2- 172.21.15.173:0/2818070135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00f40aeb90 0x7f00f4141370 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.554+0000 7f00f9a00640 1 -- 172.21.15.173:0/2818070135 >> 172.21.15.173:0/2818070135 conn(0x7f00f406ac90 msgr2=0x7f00f415cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:20.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.554+0000 7f00f9a00640 1 -- 172.21.15.173:0/2818070135 shutdown_connections 2024-04-25T09:07:20.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.554+0000 7f00f9a00640 1 -- 172.21.15.173:0/2818070135 wait complete. 2024-04-25T09:07:20.562 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:07:20.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.710+0000 7f8372e00640 1 Processor -- start 2024-04-25T09:07:20.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.710+0000 7f8372e00640 1 -- start start 2024-04-25T09:07:20.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.714+0000 7f8372e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f836c0aeb90 0x7f836c0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:20.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.714+0000 7f8372e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836c071570 con 0x7f836c0ce2b0 2024-04-25T09:07:20.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.714+0000 7f8372e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836c071850 con 0x7f836c0aef70 2024-04-25T09:07:20.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.714+0000 7f8372e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c071320 con 0x7f836c0aeb90 2024-04-25T09:07:20.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.714+0000 7f836be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f836c0aeb90 0x7f836c0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:20.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.714+0000 7f8370e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f836c0ce2b0 0x7f836c15af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:40430/0 (socket says 172.21.15.173:40430) 2024-04-25T09:07:20.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.714+0000 7f836be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f836c0aeb90 0x7f836c0cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54316/0 (socket says 172.21.15.173:54316) 2024-04-25T09:07:20.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.714+0000 7f8370e00640 1 -- 172.21.15.173:0/1130570649 learned_addr learned my addr 172.21.15.173:0/1130570649 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:20.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.714+0000 7f836be00640 1 -- 172.21.15.173:0/1130570649 >> v1:172.21.15.194:6789/0 conn(0x7f836c0aef70 legacy=0x7f836c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:20.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.714+0000 7f836be00640 1 -- 172.21.15.173:0/1130570649 >> v1:172.21.15.173:6789/0 conn(0x7f836c0ce2b0 legacy=0x7f836c15af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:20.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.714+0000 7f836be00640 1 -- 172.21.15.173:0/1130570649 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c071b30 con 0x7f836c0aeb90 2024-04-25T09:07:20.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.714+0000 7f836b400640 1 -- 172.21.15.173:0/1130570649 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206132647 0 0) 0x7f836c071570 con 0x7f836c0ce2b0 2024-04-25T09:07:20.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.718+0000 7f836be00640 1 --2- 172.21.15.173:0/1130570649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f836c0aeb90 0x7f836c0cc0d0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f835c0097c0 tx=0x7f835c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c346ae659dc2ee5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:20.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.718+0000 7f836b400640 1 -- 172.21.15.173:0/1130570649 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c0b0070 con 0x7f836c0aeb90 2024-04-25T09:07:20.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.718+0000 7f836b400640 1 -- 172.21.15.173:0/1130570649 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c0ab600 con 0x7f836c0aeb90 2024-04-25T09:07:20.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.718+0000 7f836b400640 1 -- 172.21.15.173:0/1130570649 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c0a4e60 con 0x7f836c0aeb90 2024-04-25T09:07:20.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.718+0000 7f8372e00640 1 -- 172.21.15.173:0/1130570649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f836c0aeb90 msgr2=0x7f836c0cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:20.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.718+0000 7f8372e00640 1 --2- 172.21.15.173:0/1130570649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f836c0aeb90 0x7f836c0cc0d0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f835c0097c0 tx=0x7f835c01c3d0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.718+0000 7f8372e00640 1 -- 172.21.15.173:0/1130570649 shutdown_connections 2024-04-25T09:07:20.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.718+0000 7f8372e00640 1 --2- 172.21.15.173:0/1130570649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f836c0aeb90 0x7f836c0cc0d0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.718+0000 7f8372e00640 1 -- 172.21.15.173:0/1130570649 >> 172.21.15.173:0/1130570649 conn(0x7f836c06ac90 msgr2=0x7f836c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:20.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.718+0000 7f8372e00640 1 -- 172.21.15.173:0/1130570649 shutdown_connections 2024-04-25T09:07:20.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.718+0000 7f8372e00640 1 -- 172.21.15.173:0/1130570649 wait complete. 2024-04-25T09:07:20.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.718+0000 7f8372e00640 1 Processor -- start 2024-04-25T09:07:20.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.718+0000 7f8372e00640 1 -- start start 2024-04-25T09:07:20.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f8372e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f836c0aeb90 0x7f836c143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:20.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f8372e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f836c0aef70 0x7f836c14a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:20.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f8372e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f836c0ce2b0 0x7f836c143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:20.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f8372e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c168ac0 con 0x7f836c0aeb90 2024-04-25T09:07:20.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f8372e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c168940 con 0x7f836c0ce2b0 2024-04-25T09:07:20.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f8372e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c168c40 con 0x7f836c0aef70 2024-04-25T09:07:20.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f836be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f836c0aeb90 0x7f836c143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:20.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f836be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f836c0aeb90 0x7f836c143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54326/0 (socket says 172.21.15.173:54326) 2024-04-25T09:07:20.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f836be00640 1 -- 172.21.15.173:0/4130509381 learned_addr learned my addr 172.21.15.173:0/4130509381 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:20.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f8370e00640 1 --2- 172.21.15.173:0/4130509381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f836c0ce2b0 0x7f836c143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:20.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f8363400640 1 --2- 172.21.15.173:0/4130509381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f836c0aef70 0x7f836c14a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:20.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f836be00640 1 -- 172.21.15.173:0/4130509381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f836c0aef70 msgr2=0x7f836c14a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:20.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f836be00640 1 --2- 172.21.15.173:0/4130509381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f836c0aef70 0x7f836c14a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f836be00640 1 -- 172.21.15.173:0/4130509381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f836c0ce2b0 msgr2=0x7f836c143630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:20.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f836be00640 1 --2- 172.21.15.173:0/4130509381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f836c0ce2b0 0x7f836c143630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f836be00640 1 -- 172.21.15.173:0/4130509381 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c149290 con 0x7f836c0aeb90 2024-04-25T09:07:20.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f836be00640 1 --2- 172.21.15.173:0/4130509381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f836c0aeb90 0x7f836c143d30 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f835c0097c0 tx=0x7f835c01ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:20.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f8368c00640 1 -- 172.21.15.173:0/4130509381 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c0bb070 con 0x7f836c0aeb90 2024-04-25T09:07:20.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f8368c00640 1 -- 172.21.15.173:0/4130509381 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c0a4e60 con 0x7f836c0aeb90 2024-04-25T09:07:20.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f8372e00640 1 -- 172.21.15.173:0/4130509381 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836c149570 con 0x7f836c0aeb90 2024-04-25T09:07:20.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f8368c00640 1 -- 172.21.15.173:0/4130509381 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c0b0040 con 0x7f836c0aeb90 2024-04-25T09:07:20.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f8372e00640 1 -- 172.21.15.173:0/4130509381 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836c1443d0 con 0x7f836c0aeb90 2024-04-25T09:07:20.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f8372e00640 1 -- 172.21.15.173:0/4130509381 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836c073ab0 con 0x7f836c0aeb90 2024-04-25T09:07:20.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.722+0000 7f8368c00640 1 -- 172.21.15.173:0/4130509381 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f835c004240 con 0x7f836c0aeb90 2024-04-25T09:07:20.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.726+0000 7f8368c00640 1 --2- 172.21.15.173:0/4130509381 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8348066f60 0x7f8348069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:20.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.726+0000 7f8368c00640 1 -- 172.21.15.173:0/4130509381 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f835c11f700 con 0x7f836c0aeb90 2024-04-25T09:07:20.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.726+0000 7f8363400640 1 --2- 172.21.15.173:0/4130509381 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8348066f60 0x7f8348069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:20.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.726+0000 7f8363400640 1 --2- 172.21.15.173:0/4130509381 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8348066f60 0x7f8348069420 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f836c0afab0 tx=0x7f8354009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:20.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.730+0000 7f8368c00640 1 -- 172.21.15.173:0/4130509381 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f835c016050 con 0x7f836c0aeb90 2024-04-25T09:07:20.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.882+0000 7f8372e00640 1 -- 172.21.15.173:0/4130509381 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f836c0cbe80 con 0x7f836c0aeb90 2024-04-25T09:07:20.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.882+0000 7f8368c00640 1 -- 172.21.15.173:0/4130509381 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+11 (secure 0 0 0) 0x7f835c0aa3a0 con 0x7f836c0aeb90 2024-04-25T09:07:20.872 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:07:20.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.886+0000 7f8372e00640 1 -- 172.21.15.173:0/4130509381 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8348066f60 msgr2=0x7f8348069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:20.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.886+0000 7f8372e00640 1 --2- 172.21.15.173:0/4130509381 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8348066f60 0x7f8348069420 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f836c0afab0 tx=0x7f8354009040 comp rx=0 tx=0).stop 2024-04-25T09:07:20.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.886+0000 7f8372e00640 1 -- 172.21.15.173:0/4130509381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f836c0aeb90 msgr2=0x7f836c143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:20.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.886+0000 7f8372e00640 1 --2- 172.21.15.173:0/4130509381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f836c0aeb90 0x7f836c143d30 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f835c0097c0 tx=0x7f835c01ac10 comp rx=0 tx=0).stop 2024-04-25T09:07:20.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.886+0000 7f8372e00640 1 -- 172.21.15.173:0/4130509381 shutdown_connections 2024-04-25T09:07:20.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.886+0000 7f8372e00640 1 --2- 172.21.15.173:0/4130509381 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8348066f60 0x7f8348069420 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.886+0000 7f8372e00640 1 --2- 172.21.15.173:0/4130509381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f836c0ce2b0 0x7f836c143630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.886+0000 7f8372e00640 1 --2- 172.21.15.173:0/4130509381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f836c0aef70 0x7f836c14a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.886+0000 7f8372e00640 1 --2- 172.21.15.173:0/4130509381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f836c0aeb90 0x7f836c143d30 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:20.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.886+0000 7f8372e00640 1 -- 172.21.15.173:0/4130509381 >> 172.21.15.173:0/4130509381 conn(0x7f836c06ac90 msgr2=0x7f836c0cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:20.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.886+0000 7f8372e00640 1 -- 172.21.15.173:0/4130509381 shutdown_connections 2024-04-25T09:07:20.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:20.886+0000 7f8372e00640 1 -- 172.21.15.173:0/4130509381 wait complete. 2024-04-25T09:07:20.893 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:07:21.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.046+0000 7feb64200640 1 Processor -- start 2024-04-25T09:07:21.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.046+0000 7feb64200640 1 -- start start 2024-04-25T09:07:21.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.046+0000 7feb64200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7feb5c06f5b0 0x7feb5c0aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:21.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.046+0000 7feb64200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb5c0ad3f0 0x7feb5c1677c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:21.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.046+0000 7feb64200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5c06fa20 con 0x7feb5c06e1c0 2024-04-25T09:07:21.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.046+0000 7feb64200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb5c0b3170 con 0x7feb5c06f5b0 2024-04-25T09:07:21.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.046+0000 7feb64200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c15e070 con 0x7feb5c0ad3f0 2024-04-25T09:07:21.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.046+0000 7feb60e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7feb5c06f5b0 0x7feb5c0aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:21.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.046+0000 7feb61800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7feb5c06e1c0 0x7feb5c06bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:40442/0 (socket says 172.21.15.173:40442) 2024-04-25T09:07:21.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.046+0000 7feb60e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7feb5c06f5b0 0x7feb5c0aceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54328/0 (socket says 172.21.15.173:54328) 2024-04-25T09:07:21.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.046+0000 7feb61800640 1 -- 172.21.15.173:0/220483949 learned_addr learned my addr 172.21.15.173:0/220483949 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:21.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.050+0000 7feb62200640 1 --2- 172.21.15.173:0/220483949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb5c0ad3f0 0x7feb5c1677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:21.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.050+0000 7feb60e00640 1 -- 172.21.15.173:0/220483949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb5c0ad3f0 msgr2=0x7feb5c1677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:21.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.050+0000 7feb60e00640 1 --2- 172.21.15.173:0/220483949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb5c0ad3f0 0x7feb5c1677c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.050+0000 7feb60e00640 1 -- 172.21.15.173:0/220483949 >> v1:172.21.15.173:6789/0 conn(0x7feb5c06e1c0 legacy=0x7feb5c06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:21.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.050+0000 7feb60e00640 1 -- 172.21.15.173:0/220483949 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5c06ae30 con 0x7feb5c06f5b0 2024-04-25T09:07:21.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.050+0000 7feb5be00640 1 -- 172.21.15.173:0/220483949 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991570353 0 0) 0x7feb5c06fa20 con 0x7feb5c06e1c0 2024-04-25T09:07:21.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.050+0000 7feb60e00640 1 --2- 172.21.15.173:0/220483949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb5c06f5b0 0x7feb5c0aceb0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7feb480097c0 tx=0x7feb4801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f1c79393067cff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:21.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.050+0000 7feb5be00640 1 -- 172.21.15.173:0/220483949 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb480b5070 con 0x7feb5c06f5b0 2024-04-25T09:07:21.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.050+0000 7feb5be00640 1 -- 172.21.15.173:0/220483949 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb480a8990 con 0x7feb5c06f5b0 2024-04-25T09:07:21.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.050+0000 7feb5be00640 1 -- 172.21.15.173:0/220483949 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb480a8d60 con 0x7feb5c06f5b0 2024-04-25T09:07:21.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.050+0000 7feb64200640 1 -- 172.21.15.173:0/220483949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb5c06f5b0 msgr2=0x7feb5c0aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:21.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.050+0000 7feb64200640 1 --2- 172.21.15.173:0/220483949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb5c06f5b0 0x7feb5c0aceb0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7feb480097c0 tx=0x7feb4801ec90 comp rx=0 tx=0).stop 2024-04-25T09:07:21.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb64200640 1 -- 172.21.15.173:0/220483949 shutdown_connections 2024-04-25T09:07:21.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb64200640 1 --2- 172.21.15.173:0/220483949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb5c0ad3f0 0x7feb5c1677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb64200640 1 --2- 172.21.15.173:0/220483949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb5c06f5b0 0x7feb5c0aceb0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb64200640 1 -- 172.21.15.173:0/220483949 >> 172.21.15.173:0/220483949 conn(0x7feb5c0cfed0 msgr2=0x7feb5c0d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:21.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb64200640 1 -- 172.21.15.173:0/220483949 shutdown_connections 2024-04-25T09:07:21.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb64200640 1 -- 172.21.15.173:0/220483949 wait complete. 2024-04-25T09:07:21.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb64200640 1 Processor -- start 2024-04-25T09:07:21.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb64200640 1 -- start start 2024-04-25T09:07:21.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb64200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb5c06e1c0 0x7feb5c145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:21.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb64200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb5c06f5b0 0x7feb5c153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:21.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb64200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb5c0ad3f0 0x7feb5c1e3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:21.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb64200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c06b6d0 con 0x7feb5c06e1c0 2024-04-25T09:07:21.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb64200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c06b3f0 con 0x7feb5c06f5b0 2024-04-25T09:07:21.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb64200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c06b9b0 con 0x7feb5c0ad3f0 2024-04-25T09:07:21.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb61800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb5c06e1c0 0x7feb5c145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:21.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb61800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb5c06e1c0 0x7feb5c145aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54338/0 (socket says 172.21.15.173:54338) 2024-04-25T09:07:21.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb61800640 1 -- 172.21.15.173:0/3365907790 learned_addr learned my addr 172.21.15.173:0/3365907790 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:21.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb60e00640 1 --2- 172.21.15.173:0/3365907790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb5c06f5b0 0x7feb5c153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:21.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb62200640 1 --2- 172.21.15.173:0/3365907790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb5c0ad3f0 0x7feb5c1e3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:21.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb61800640 1 -- 172.21.15.173:0/3365907790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb5c0ad3f0 msgr2=0x7feb5c1e3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:21.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb61800640 1 --2- 172.21.15.173:0/3365907790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb5c0ad3f0 0x7feb5c1e3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb61800640 1 -- 172.21.15.173:0/3365907790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb5c06f5b0 msgr2=0x7feb5c153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:21.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb61800640 1 --2- 172.21.15.173:0/3365907790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb5c06f5b0 0x7feb5c153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb61800640 1 -- 172.21.15.173:0/3365907790 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5c154720 con 0x7feb5c06e1c0 2024-04-25T09:07:21.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb62200640 1 --2- 172.21.15.173:0/3365907790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb5c0ad3f0 0x7feb5c1e3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:21.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb61800640 1 --2- 172.21.15.173:0/3365907790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb5c06e1c0 0x7feb5c145aa0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7feb50001570 tx=0x7feb5000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:21.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb59600640 1 -- 172.21.15.173:0/3365907790 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb50018070 con 0x7feb5c06e1c0 2024-04-25T09:07:21.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb59600640 1 -- 172.21.15.173:0/3365907790 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5000a640 con 0x7feb5c06e1c0 2024-04-25T09:07:21.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb59600640 1 -- 172.21.15.173:0/3365907790 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5000aa30 con 0x7feb5c06e1c0 2024-04-25T09:07:21.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.054+0000 7feb64200640 1 -- 172.21.15.173:0/3365907790 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5c154a00 con 0x7feb5c06e1c0 2024-04-25T09:07:21.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.058+0000 7feb64200640 1 -- 172.21.15.173:0/3365907790 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5c154fc0 con 0x7feb5c06e1c0 2024-04-25T09:07:21.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.058+0000 7feb64200640 1 -- 172.21.15.173:0/3365907790 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5c073ab0 con 0x7feb5c06e1c0 2024-04-25T09:07:21.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.058+0000 7feb59600640 1 -- 172.21.15.173:0/3365907790 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feb5000abd0 con 0x7feb5c06e1c0 2024-04-25T09:07:21.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.058+0000 7feb59600640 1 --2- 172.21.15.173:0/3365907790 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb3c066f90 0x7feb3c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:21.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.058+0000 7feb59600640 1 -- 172.21.15.173:0/3365907790 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7feb50084880 con 0x7feb5c06e1c0 2024-04-25T09:07:21.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.058+0000 7feb60e00640 1 --2- 172.21.15.173:0/3365907790 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb3c066f90 0x7feb3c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:21.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.058+0000 7feb60e00640 1 --2- 172.21.15.173:0/3365907790 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb3c066f90 0x7feb3c069450 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7feb480b2000 tx=0x7feb48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:21.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.062+0000 7feb59600640 1 -- 172.21.15.173:0/3365907790 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feb500556a0 con 0x7feb5c06e1c0 2024-04-25T09:07:21.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.214+0000 7feb64200640 1 -- 172.21.15.173:0/3365907790 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feb5c15b410 con 0x7feb5c06e1c0 2024-04-25T09:07:21.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.218+0000 7feb59600640 1 -- 172.21.15.173:0/3365907790 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7feb50054fa0 con 0x7feb5c06e1c0 2024-04-25T09:07:21.204 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:07:21.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.218+0000 7feb64200640 1 -- 172.21.15.173:0/3365907790 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb3c066f90 msgr2=0x7feb3c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:21.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.218+0000 7feb64200640 1 --2- 172.21.15.173:0/3365907790 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb3c066f90 0x7feb3c069450 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7feb480b2000 tx=0x7feb48008040 comp rx=0 tx=0).stop 2024-04-25T09:07:21.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.218+0000 7feb64200640 1 -- 172.21.15.173:0/3365907790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb5c06e1c0 msgr2=0x7feb5c145aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:21.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.218+0000 7feb64200640 1 --2- 172.21.15.173:0/3365907790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb5c06e1c0 0x7feb5c145aa0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7feb50001570 tx=0x7feb5000cd20 comp rx=0 tx=0).stop 2024-04-25T09:07:21.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.218+0000 7feb64200640 1 -- 172.21.15.173:0/3365907790 shutdown_connections 2024-04-25T09:07:21.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.218+0000 7feb64200640 1 --2- 172.21.15.173:0/3365907790 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb3c066f90 0x7feb3c069450 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.218+0000 7feb64200640 1 --2- 172.21.15.173:0/3365907790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb5c0ad3f0 0x7feb5c1e3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.218+0000 7feb64200640 1 --2- 172.21.15.173:0/3365907790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb5c06f5b0 0x7feb5c153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.218+0000 7feb64200640 1 --2- 172.21.15.173:0/3365907790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb5c06e1c0 0x7feb5c145aa0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.218+0000 7feb64200640 1 -- 172.21.15.173:0/3365907790 >> 172.21.15.173:0/3365907790 conn(0x7feb5c0cfed0 msgr2=0x7feb5c15a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:21.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.218+0000 7feb64200640 1 -- 172.21.15.173:0/3365907790 shutdown_connections 2024-04-25T09:07:21.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.218+0000 7feb64200640 1 -- 172.21.15.173:0/3365907790 wait complete. 2024-04-25T09:07:21.227 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:07:21.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.374+0000 7f0150c00640 1 Processor -- start 2024-04-25T09:07:21.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.374+0000 7f0150c00640 1 -- start start 2024-04-25T09:07:21.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.374+0000 7f0150c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f014c0aeb90 0x7f014c0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:21.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.374+0000 7f0150c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f014c0ce2b0 0x7f014c0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:21.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.374+0000 7f0150c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c071570 con 0x7f014c0aef70 2024-04-25T09:07:21.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.374+0000 7f0150c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014c071320 con 0x7f014c0ce2b0 2024-04-25T09:07:21.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.374+0000 7f0150c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c072330 con 0x7f014c0aeb90 2024-04-25T09:07:21.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.378+0000 7f014a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f014c0ce2b0 0x7f014c0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:21.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.378+0000 7f014a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f014c0ce2b0 0x7f014c0cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54344/0 (socket says 172.21.15.173:54344) 2024-04-25T09:07:21.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.378+0000 7f014a800640 1 -- 172.21.15.173:0/3079578438 learned_addr learned my addr 172.21.15.173:0/3079578438 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:21.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.378+0000 7f0149e00640 1 --2- 172.21.15.173:0/3079578438 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f014c0aeb90 0x7f014c0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:21.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.378+0000 7f014a800640 1 -- 172.21.15.173:0/3079578438 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f014c0aeb90 msgr2=0x7f014c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:21.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.378+0000 7f014a800640 1 --2- 172.21.15.173:0/3079578438 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f014c0aeb90 0x7f014c0cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.378+0000 7f014a800640 1 -- 172.21.15.173:0/3079578438 >> v1:172.21.15.194:6789/0 conn(0x7f014c0aef70 legacy=0x7f014c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:21.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.378+0000 7f014a800640 1 -- 172.21.15.173:0/3079578438 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c071850 con 0x7f014c0ce2b0 2024-04-25T09:07:21.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.378+0000 7f014a800640 1 --2- 172.21.15.173:0/3079578438 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f014c0ce2b0 0x7f014c0cc610 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f0144009e50 tx=0x7f014401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8d130d07887cda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:21.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.378+0000 7f0149400640 1 -- 172.21.15.173:0/3079578438 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01440a5730 con 0x7f014c0ce2b0 2024-04-25T09:07:21.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.378+0000 7f0149400640 1 -- 172.21.15.173:0/3079578438 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01440a58d0 con 0x7f014c0ce2b0 2024-04-25T09:07:21.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.378+0000 7f0149400640 1 -- 172.21.15.173:0/3079578438 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01440a5ca0 con 0x7f014c0ce2b0 2024-04-25T09:07:21.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0150c00640 1 -- 172.21.15.173:0/3079578438 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f014c0ce2b0 msgr2=0x7f014c0cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:21.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0150c00640 1 --2- 172.21.15.173:0/3079578438 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f014c0ce2b0 0x7f014c0cc610 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f0144009e50 tx=0x7f014401c970 comp rx=0 tx=0).stop 2024-04-25T09:07:21.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0150c00640 1 -- 172.21.15.173:0/3079578438 shutdown_connections 2024-04-25T09:07:21.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0150c00640 1 --2- 172.21.15.173:0/3079578438 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f014c0ce2b0 0x7f014c0cc610 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0150c00640 1 --2- 172.21.15.173:0/3079578438 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f014c0aeb90 0x7f014c0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0150c00640 1 -- 172.21.15.173:0/3079578438 >> 172.21.15.173:0/3079578438 conn(0x7f014c06ac90 msgr2=0x7f014c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:21.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0150c00640 1 -- 172.21.15.173:0/3079578438 shutdown_connections 2024-04-25T09:07:21.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0150c00640 1 -- 172.21.15.173:0/3079578438 wait complete. 2024-04-25T09:07:21.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0150c00640 1 Processor -- start 2024-04-25T09:07:21.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0150c00640 1 -- start start 2024-04-25T09:07:21.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0150c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f014c0aeb90 0x7f014c14c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:21.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0150c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f014c0aef70 0x7f014c1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:21.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0150c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f014c0ce2b0 0x7f014c0b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:21.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0150c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c15bb30 con 0x7f014c0ce2b0 2024-04-25T09:07:21.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0150c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c15b9b0 con 0x7f014c0aef70 2024-04-25T09:07:21.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0150c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c15bcb0 con 0x7f014c0aeb90 2024-04-25T09:07:21.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f014a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f014c0ce2b0 0x7f014c0b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:21.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f014a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f014c0ce2b0 0x7f014c0b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54360/0 (socket says 172.21.15.173:54360) 2024-04-25T09:07:21.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f014a800640 1 -- 172.21.15.173:0/2917692649 learned_addr learned my addr 172.21.15.173:0/2917692649 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:21.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0149e00640 1 --2- 172.21.15.173:0/2917692649 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f014c0aeb90 0x7f014c14c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:21.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0141400640 1 --2- 172.21.15.173:0/2917692649 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f014c0aef70 0x7f014c1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:21.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f014a800640 1 -- 172.21.15.173:0/2917692649 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f014c0aeb90 msgr2=0x7f014c14c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:21.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f014a800640 1 --2- 172.21.15.173:0/2917692649 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f014c0aeb90 0x7f014c14c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f014a800640 1 -- 172.21.15.173:0/2917692649 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f014c0aef70 msgr2=0x7f014c1555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:21.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f014a800640 1 --2- 172.21.15.173:0/2917692649 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f014c0aef70 0x7f014c1555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f014a800640 1 -- 172.21.15.173:0/2917692649 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c156090 con 0x7f014c0ce2b0 2024-04-25T09:07:21.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.382+0000 7f0141400640 1 --2- 172.21.15.173:0/2917692649 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f014c0aef70 0x7f014c1555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:21.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.386+0000 7f014a800640 1 --2- 172.21.15.173:0/2917692649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f014c0ce2b0 0x7f014c0b2d80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f01440af040 tx=0x7f0144019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:21.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.386+0000 7f0142a00640 1 -- 172.21.15.173:0/2917692649 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01440bc020 con 0x7f014c0ce2b0 2024-04-25T09:07:21.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.386+0000 7f0142a00640 1 -- 172.21.15.173:0/2917692649 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01440b8670 con 0x7f014c0ce2b0 2024-04-25T09:07:21.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.386+0000 7f0142a00640 1 -- 172.21.15.173:0/2917692649 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144009510 con 0x7f014c0ce2b0 2024-04-25T09:07:21.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.386+0000 7f0150c00640 1 -- 172.21.15.173:0/2917692649 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014c156370 con 0x7f014c0ce2b0 2024-04-25T09:07:21.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.386+0000 7f0150c00640 1 -- 172.21.15.173:0/2917692649 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014c0cddf0 con 0x7f014c0ce2b0 2024-04-25T09:07:21.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.386+0000 7f0150c00640 1 -- 172.21.15.173:0/2917692649 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014c073ab0 con 0x7f014c0ce2b0 2024-04-25T09:07:21.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.386+0000 7f0142a00640 1 -- 172.21.15.173:0/2917692649 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f01440bf020 con 0x7f014c0ce2b0 2024-04-25T09:07:21.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.386+0000 7f0142a00640 1 --2- 172.21.15.173:0/2917692649 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0128066f60 0x7f0128069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:21.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.386+0000 7f0142a00640 1 -- 172.21.15.173:0/2917692649 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f0144120150 con 0x7f014c0ce2b0 2024-04-25T09:07:21.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.386+0000 7f0149e00640 1 --2- 172.21.15.173:0/2917692649 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0128066f60 0x7f0128069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:21.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.390+0000 7f0149e00640 1 --2- 172.21.15.173:0/2917692649 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0128066f60 0x7f0128069420 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f013c009ac0 tx=0x7f013c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:21.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.390+0000 7f0142a00640 1 -- 172.21.15.173:0/2917692649 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f01440c6030 con 0x7f014c0ce2b0 2024-04-25T09:07:21.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.554+0000 7f0150c00640 1 -- 172.21.15.173:0/2917692649 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f014c1531b0 con 0x7f014c0ce2b0 2024-04-25T09:07:21.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.554+0000 7f0142a00640 1 -- 172.21.15.173:0/2917692649 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v73) v1 ==== 80+0+122 (secure 0 0 0) 0x7f0144016620 con 0x7f014c0ce2b0 2024-04-25T09:07:21.543 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173:6836/962695208 2024-04-26T09:07:01.867727+0000 2024-04-25T09:07:21.543 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173:6834/962695208 2024-04-26T09:07:01.867727+0000 2024-04-25T09:07:21.544 INFO:teuthology.orchestra.run.smithi173.stderr:listed 2 entries 2024-04-25T09:07:21.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.558+0000 7f0150c00640 1 -- 172.21.15.173:0/2917692649 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0128066f60 msgr2=0x7f0128069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:21.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.558+0000 7f0150c00640 1 --2- 172.21.15.173:0/2917692649 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0128066f60 0x7f0128069420 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f013c009ac0 tx=0x7f013c009190 comp rx=0 tx=0).stop 2024-04-25T09:07:21.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.558+0000 7f0150c00640 1 -- 172.21.15.173:0/2917692649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f014c0ce2b0 msgr2=0x7f014c0b2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:21.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.558+0000 7f0150c00640 1 --2- 172.21.15.173:0/2917692649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f014c0ce2b0 0x7f014c0b2d80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f01440af040 tx=0x7f0144019710 comp rx=0 tx=0).stop 2024-04-25T09:07:21.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.558+0000 7f0150c00640 1 -- 172.21.15.173:0/2917692649 shutdown_connections 2024-04-25T09:07:21.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.558+0000 7f0150c00640 1 --2- 172.21.15.173:0/2917692649 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0128066f60 0x7f0128069420 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.558+0000 7f0150c00640 1 --2- 172.21.15.173:0/2917692649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f014c0ce2b0 0x7f014c0b2d80 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.558+0000 7f0150c00640 1 --2- 172.21.15.173:0/2917692649 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f014c0aef70 0x7f014c1555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.558+0000 7f0150c00640 1 --2- 172.21.15.173:0/2917692649 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f014c0aeb90 0x7f014c14c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.558+0000 7f0150c00640 1 -- 172.21.15.173:0/2917692649 >> 172.21.15.173:0/2917692649 conn(0x7f014c06ac90 msgr2=0x7f014c14d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:21.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.558+0000 7f0150c00640 1 -- 172.21.15.173:0/2917692649 shutdown_connections 2024-04-25T09:07:21.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.558+0000 7f0150c00640 1 -- 172.21.15.173:0/2917692649 wait complete. 2024-04-25T09:07:21.563 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:07:21.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:21.564 DEBUG:teuthology.orchestra.run.smithi173:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:21.592 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:07:21.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:21.592 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:07:21.648 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:07:21.648 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:21.658 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:07:21.658 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:07:21.658 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:21.699 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:07:21.699 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:07:21.699 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:21.713 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:07:21.713 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:21.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.886+0000 7f8c0b600640 1 Processor -- start 2024-04-25T09:07:21.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.890+0000 7f8c0b600640 1 -- start start 2024-04-25T09:07:21.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.890+0000 7f8c0b600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8c0415df90 0x7f8c040d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:21.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.890+0000 7f8c0b600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c0406f830 0x7f8c0406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:21.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.890+0000 7f8c0b600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0406d870 con 0x7f8c0415dbb0 2024-04-25T09:07:21.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.890+0000 7f8c0b600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0415e5c0 con 0x7f8c0415df90 2024-04-25T09:07:21.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.890+0000 7f8c0b600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0415e8a0 con 0x7f8c0406f830 2024-04-25T09:07:21.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.890+0000 7f8c03e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8c0415df90 0x7f8c040d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:21.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.890+0000 7f8c03e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8c0415df90 0x7f8c040d2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54372/0 (socket says 172.21.15.173:54372) 2024-04-25T09:07:21.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.890+0000 7f8c03e00640 1 -- 172.21.15.173:0/2670091098 learned_addr learned my addr 172.21.15.173:0/2670091098 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:21.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.890+0000 7f8c08c00640 1 --1- 172.21.15.173:0/2670091098 >> v1:172.21.15.173:6789/0 conn(0x7f8c0415dbb0 0x7f8c0406c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:40448/0 (socket says 172.21.15.173:40448) 2024-04-25T09:07:21.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.890+0000 7f8c09600640 1 --2- 172.21.15.173:0/2670091098 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c0406f830 0x7f8c0406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:21.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.890+0000 7f8c03e00640 1 -- 172.21.15.173:0/2670091098 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c0406f830 msgr2=0x7f8c0406fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:21.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.890+0000 7f8c03e00640 1 --2- 172.21.15.173:0/2670091098 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c0406f830 0x7f8c0406fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.890+0000 7f8c03e00640 1 -- 172.21.15.173:0/2670091098 >> v1:172.21.15.173:6789/0 conn(0x7f8c0415dbb0 legacy=0x7f8c0406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:21.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.890+0000 7f8c03e00640 1 -- 172.21.15.173:0/2670091098 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04161690 con 0x7f8c0415df90 2024-04-25T09:07:21.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.894+0000 7f8c03e00640 1 --2- 172.21.15.173:0/2670091098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c0415df90 0x7f8c040d2130 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009870 tx=0x7f8bf001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3d8aa3e5bd5749 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:21.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.894+0000 7f8c03400640 1 -- 172.21.15.173:0/2670091098 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf00b2070 con 0x7f8c0415df90 2024-04-25T09:07:21.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.894+0000 7f8c03400640 1 -- 172.21.15.173:0/2670091098 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf00a9070 con 0x7f8c0415df90 2024-04-25T09:07:21.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.894+0000 7f8c03400640 1 -- 172.21.15.173:0/2670091098 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf00ad880 con 0x7f8c0415df90 2024-04-25T09:07:21.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.894+0000 7f8c0b600640 1 -- 172.21.15.173:0/2670091098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c0415df90 msgr2=0x7f8c040d2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:21.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.894+0000 7f8c0b600640 1 --2- 172.21.15.173:0/2670091098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c0415df90 0x7f8c040d2130 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009870 tx=0x7f8bf001c560 comp rx=0 tx=0).stop 2024-04-25T09:07:21.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.894+0000 7f8c0b600640 1 -- 172.21.15.173:0/2670091098 shutdown_connections 2024-04-25T09:07:21.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.894+0000 7f8c0b600640 1 --2- 172.21.15.173:0/2670091098 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c0406f830 0x7f8c0406fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.894+0000 7f8c0b600640 1 --2- 172.21.15.173:0/2670091098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c0415df90 0x7f8c040d2130 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.894+0000 7f8c0b600640 1 -- 172.21.15.173:0/2670091098 >> 172.21.15.173:0/2670091098 conn(0x7f8c04061880 msgr2=0x7f8c04061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:21.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.894+0000 7f8c0b600640 1 -- 172.21.15.173:0/2670091098 shutdown_connections 2024-04-25T09:07:21.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.894+0000 7f8c0b600640 1 -- 172.21.15.173:0/2670091098 wait complete. 2024-04-25T09:07:21.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.894+0000 7f8c0b600640 1 Processor -- start 2024-04-25T09:07:21.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c0b600640 1 -- start start 2024-04-25T09:07:21.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c0b600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c0406f830 0x7f8c040cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:21.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c0b600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c0415dbb0 0x7f8c04151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:21.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c0b600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c0415df90 0x7f8c0415c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:21.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c0b600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0416ab10 con 0x7f8c0415dbb0 2024-04-25T09:07:21.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c0b600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0416a990 con 0x7f8c0415df90 2024-04-25T09:07:21.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c0b600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0416ac90 con 0x7f8c0406f830 2024-04-25T09:07:21.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c03e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c0415dbb0 0x7f8c04151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:21.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c08c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c0406f830 0x7f8c040cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:21.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c03e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c0415dbb0 0x7f8c04151cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54388/0 (socket says 172.21.15.173:54388) 2024-04-25T09:07:21.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c03e00640 1 -- 172.21.15.173:0/2557470349 learned_addr learned my addr 172.21.15.173:0/2557470349 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:21.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c09600640 1 --2- 172.21.15.173:0/2557470349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c0415df90 0x7f8c0415c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:21.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c03e00640 1 -- 172.21.15.173:0/2557470349 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c0406f830 msgr2=0x7f8c040cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:21.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c03e00640 1 --2- 172.21.15.173:0/2557470349 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c0406f830 0x7f8c040cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c03e00640 1 -- 172.21.15.173:0/2557470349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c0415df90 msgr2=0x7f8c0415c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:21.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c03e00640 1 --2- 172.21.15.173:0/2557470349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c0415df90 0x7f8c0415c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:21.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c03e00640 1 -- 172.21.15.173:0/2557470349 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c041521f0 con 0x7f8c0415dbb0 2024-04-25T09:07:21.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c03e00640 1 --2- 172.21.15.173:0/2557470349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c0415dbb0 0x7f8c04151cb0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00b0040 tx=0x7f8bf0019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:21.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c00c00640 1 -- 172.21.15.173:0/2557470349 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf00b2040 con 0x7f8c0415dbb0 2024-04-25T09:07:21.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c00c00640 1 -- 172.21.15.173:0/2557470349 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf00bd070 con 0x7f8c0415dbb0 2024-04-25T09:07:21.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c0b600640 1 -- 172.21.15.173:0/2557470349 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c040cabc0 con 0x7f8c0415dbb0 2024-04-25T09:07:21.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c00c00640 1 -- 172.21.15.173:0/2557470349 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf00b8440 con 0x7f8c0415dbb0 2024-04-25T09:07:21.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.898+0000 7f8c0b600640 1 -- 172.21.15.173:0/2557470349 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c040cb180 con 0x7f8c0415dbb0 2024-04-25T09:07:21.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.902+0000 7f8c0b600640 1 -- 172.21.15.173:0/2557470349 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c04073a40 con 0x7f8c0415dbb0 2024-04-25T09:07:21.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.902+0000 7f8c00c00640 1 -- 172.21.15.173:0/2557470349 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8bf00ab070 con 0x7f8c0415dbb0 2024-04-25T09:07:21.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.902+0000 7f8c00c00640 1 --2- 172.21.15.173:0/2557470349 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8be4066f60 0x7f8be4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:21.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.902+0000 7f8c00c00640 1 -- 172.21.15.173:0/2557470349 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f8bf011f1f0 con 0x7f8c0415dbb0 2024-04-25T09:07:21.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.902+0000 7f8c08c00640 1 --2- 172.21.15.173:0/2557470349 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8be4066f60 0x7f8be4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:21.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.902+0000 7f8c08c00640 1 --2- 172.21.15.173:0/2557470349 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8be4066f60 0x7f8be4069420 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80012f0 tx=0x7f8bf80016e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:21.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:21.906+0000 7f8c00c00640 1 -- 172.21.15.173:0/2557470349 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8bf0016150 con 0x7f8c0415dbb0 2024-04-25T09:07:22.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.094+0000 7f8c0b600640 1 -- 172.21.15.173:0/2557470349 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c040cf020 con 0x7f8c0415dbb0 2024-04-25T09:07:22.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.098+0000 7f8c00c00640 1 -- 172.21.15.173:0/2557470349 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f8bf00ef930 con 0x7f8c0415dbb0 2024-04-25T09:07:22.084 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:22.084 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":46,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/894026798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":894026798},{"type":"v1","addr":"172.21.15.194:6833","nonce":894026798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2000586494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2000586494},{"type":"v1","addr":"172.21.15.194:6835","nonce":2000586494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3382962588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3382962588},{"type":"v1","addr":"172.21.15.173:6837","nonce":3382962588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:50.132659+0000","modified":"2024-04-25T09:07:04.888384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6960":{"gid":6960,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.173:6836/4214702139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4214702139},{"type":"v1","addr":"172.21.15.173:6836","nonce":4214702139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:07:22.085 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 46 2024-04-25T09:07:22.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.098+0000 7f8c0b600640 1 -- 172.21.15.173:0/2557470349 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8be4066f60 msgr2=0x7f8be4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:22.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.098+0000 7f8c0b600640 1 --2- 172.21.15.173:0/2557470349 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8be4066f60 0x7f8be4069420 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80012f0 tx=0x7f8bf80016e0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.098+0000 7f8c0b600640 1 -- 172.21.15.173:0/2557470349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c0415dbb0 msgr2=0x7f8c04151cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:22.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.098+0000 7f8c0b600640 1 --2- 172.21.15.173:0/2557470349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c0415dbb0 0x7f8c04151cb0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00b0040 tx=0x7f8bf0019300 comp rx=0 tx=0).stop 2024-04-25T09:07:22.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.098+0000 7f8c0b600640 1 -- 172.21.15.173:0/2557470349 shutdown_connections 2024-04-25T09:07:22.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.098+0000 7f8c0b600640 1 --2- 172.21.15.173:0/2557470349 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8be4066f60 0x7f8be4069420 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.098+0000 7f8c0b600640 1 --2- 172.21.15.173:0/2557470349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c0415df90 0x7f8c0415c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.098+0000 7f8c0b600640 1 --2- 172.21.15.173:0/2557470349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c0415dbb0 0x7f8c04151cb0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.098+0000 7f8c0b600640 1 --2- 172.21.15.173:0/2557470349 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c0406f830 0x7f8c040cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.098+0000 7f8c0b600640 1 -- 172.21.15.173:0/2557470349 >> 172.21.15.173:0/2557470349 conn(0x7f8c04061880 msgr2=0x7f8c0406c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:22.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.098+0000 7f8c0b600640 1 -- 172.21.15.173:0/2557470349 shutdown_connections 2024-04-25T09:07:22.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.098+0000 7f8c0b600640 1 -- 172.21.15.173:0/2557470349 wait complete. 2024-04-25T09:07:22.105 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:22.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.254+0000 7f8a71400640 1 Processor -- start 2024-04-25T09:07:22.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.254+0000 7f8a71400640 1 -- start start 2024-04-25T09:07:22.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.254+0000 7f8a71400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8a6c06b3a0 0x7f8a6c0cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:22.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.254+0000 7f8a71400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6c15c0c0 con 0x7f8a6c1597d0 2024-04-25T09:07:22.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.254+0000 7f8a71400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6c0cfbe0 con 0x7f8a6c0cc270 2024-04-25T09:07:22.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.254+0000 7f8a71400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6c0cfec0 con 0x7f8a6c06b3a0 2024-04-25T09:07:22.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.254+0000 7f8a6b200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8a6c06b3a0 0x7f8a6c0cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:22.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.254+0000 7f8a6a800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f8a6c1597d0 0x7f8a6c15ff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:40456/0 (socket says 172.21.15.173:40456) 2024-04-25T09:07:22.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.254+0000 7f8a6a800640 1 -- 172.21.15.173:0/4242608128 learned_addr learned my addr 172.21.15.173:0/4242608128 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:22.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.254+0000 7f8a6b200640 1 -- 172.21.15.173:0/4242608128 >> v1:172.21.15.194:6789/0 conn(0x7f8a6c0cc270 legacy=0x7f8a6c06ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:22.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.254+0000 7f8a6b200640 1 -- 172.21.15.173:0/4242608128 >> v1:172.21.15.173:6789/0 conn(0x7f8a6c1597d0 legacy=0x7f8a6c15ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:22.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.254+0000 7f8a6b200640 1 -- 172.21.15.173:0/4242608128 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c0d01a0 con 0x7f8a6c06b3a0 2024-04-25T09:07:22.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.254+0000 7f8a69400640 1 -- 172.21.15.173:0/4242608128 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242508342 0 0) 0x7f8a6c15c0c0 con 0x7f8a6c1597d0 2024-04-25T09:07:22.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.258+0000 7f8a6b200640 1 --2- 172.21.15.173:0/4242608128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a6c06b3a0 0x7f8a6c0cc6e0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009d90 tx=0x7f8a6401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c31a83bef7f3ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:22.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.258+0000 7f8a69400640 1 -- 172.21.15.173:0/4242608128 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a640b2070 con 0x7f8a6c06b3a0 2024-04-25T09:07:22.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.258+0000 7f8a69400640 1 -- 172.21.15.173:0/4242608128 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a640a5880 con 0x7f8a6c06b3a0 2024-04-25T09:07:22.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.258+0000 7f8a69400640 1 -- 172.21.15.173:0/4242608128 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a640a5c50 con 0x7f8a6c06b3a0 2024-04-25T09:07:22.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.258+0000 7f8a71400640 1 -- 172.21.15.173:0/4242608128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a6c06b3a0 msgr2=0x7f8a6c0cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:22.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.258+0000 7f8a71400640 1 --2- 172.21.15.173:0/4242608128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a6c06b3a0 0x7f8a6c0cc6e0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009d90 tx=0x7f8a6401c930 comp rx=0 tx=0).stop 2024-04-25T09:07:22.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.258+0000 7f8a71400640 1 -- 172.21.15.173:0/4242608128 shutdown_connections 2024-04-25T09:07:22.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.258+0000 7f8a71400640 1 --2- 172.21.15.173:0/4242608128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a6c06b3a0 0x7f8a6c0cc6e0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.258+0000 7f8a71400640 1 -- 172.21.15.173:0/4242608128 >> 172.21.15.173:0/4242608128 conn(0x7f8a6c0b2230 msgr2=0x7f8a6c0b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:22.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.258+0000 7f8a71400640 1 -- 172.21.15.173:0/4242608128 shutdown_connections 2024-04-25T09:07:22.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.258+0000 7f8a71400640 1 -- 172.21.15.173:0/4242608128 wait complete. 2024-04-25T09:07:22.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a71400640 1 Processor -- start 2024-04-25T09:07:22.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a71400640 1 -- start start 2024-04-25T09:07:22.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a71400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a6c06b3a0 0x7f8a6c155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:22.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a71400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a6c0cc270 0x7f8a6c15fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:22.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a71400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a6c1597d0 0x7f8a6c0b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:22.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a71400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c169ad0 con 0x7f8a6c0cc270 2024-04-25T09:07:22.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a71400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c169950 con 0x7f8a6c1597d0 2024-04-25T09:07:22.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a71400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c169c50 con 0x7f8a6c06b3a0 2024-04-25T09:07:22.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a69e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a6c0cc270 0x7f8a6c15fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:22.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a69e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a6c0cc270 0x7f8a6c15fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54404/0 (socket says 172.21.15.173:54404) 2024-04-25T09:07:22.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a69e00640 1 -- 172.21.15.173:0/1035700201 learned_addr learned my addr 172.21.15.173:0/1035700201 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:22.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a6a800640 1 --2- 172.21.15.173:0/1035700201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a6c06b3a0 0x7f8a6c155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:22.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a6b200640 1 --2- 172.21.15.173:0/1035700201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a6c1597d0 0x7f8a6c0b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:22.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a69e00640 1 -- 172.21.15.173:0/1035700201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a6c06b3a0 msgr2=0x7f8a6c155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:22.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a69e00640 1 --2- 172.21.15.173:0/1035700201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a6c06b3a0 0x7f8a6c155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a69e00640 1 -- 172.21.15.173:0/1035700201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a6c1597d0 msgr2=0x7f8a6c0b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:22.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a69e00640 1 --2- 172.21.15.173:0/1035700201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a6c1597d0 0x7f8a6c0b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a69e00640 1 -- 172.21.15.173:0/1035700201 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c0c4dd0 con 0x7f8a6c0cc270 2024-04-25T09:07:22.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a69e00640 1 --2- 172.21.15.173:0/1035700201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a6c0cc270 0x7f8a6c15fa70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800b440 tx=0x7f8a5800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:22.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a62a00640 1 -- 172.21.15.173:0/1035700201 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58015020 con 0x7f8a6c0cc270 2024-04-25T09:07:22.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a62a00640 1 -- 172.21.15.173:0/1035700201 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a58011890 con 0x7f8a6c0cc270 2024-04-25T09:07:22.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a71400640 1 -- 172.21.15.173:0/1035700201 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6c0c50b0 con 0x7f8a6c0cc270 2024-04-25T09:07:22.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a62a00640 1 -- 172.21.15.173:0/1035700201 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58011c80 con 0x7f8a6c0cc270 2024-04-25T09:07:22.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.262+0000 7f8a71400640 1 -- 172.21.15.173:0/1035700201 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6c0c5670 con 0x7f8a6c0cc270 2024-04-25T09:07:22.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.266+0000 7f8a71400640 1 -- 172.21.15.173:0/1035700201 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6c073a40 con 0x7f8a6c0cc270 2024-04-25T09:07:22.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.266+0000 7f8a62a00640 1 -- 172.21.15.173:0/1035700201 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8a58018020 con 0x7f8a6c0cc270 2024-04-25T09:07:22.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.266+0000 7f8a62a00640 1 --2- 172.21.15.173:0/1035700201 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8a4c066f60 0x7f8a4c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:22.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.266+0000 7f8a62a00640 1 -- 172.21.15.173:0/1035700201 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f8a58085130 con 0x7f8a6c0cc270 2024-04-25T09:07:22.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.266+0000 7f8a6a800640 1 --2- 172.21.15.173:0/1035700201 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8a4c066f60 0x7f8a4c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:22.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.266+0000 7f8a6a800640 1 --2- 172.21.15.173:0/1035700201 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8a4c066f60 0x7f8a4c069420 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c000f70 tx=0x7f8a5c007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:22.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.270+0000 7f8a62a00640 1 -- 172.21.15.173:0/1035700201 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8a5801f030 con 0x7f8a6c0cc270 2024-04-25T09:07:22.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.426+0000 7f8a71400640 1 -- 172.21.15.173:0/1035700201 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a6c0af740 con 0x7f8a6c0cc270 2024-04-25T09:07:22.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.426+0000 7f8a62a00640 1 -- 172.21.15.173:0/1035700201 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+17073 (secure 0 0 0) 0x7f8a5800d040 con 0x7f8a6c0cc270 2024-04-25T09:07:22.414 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:22.414 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":73,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:07:01.867759+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:48.493059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:49.133352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:6836/962695208":"2024-04-26T09:07:01.867727+0000","172.21.15.173:6834/962695208":"2024-04-26T09:07:01.867727+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:22.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.426+0000 7f8a71400640 1 -- 172.21.15.173:0/1035700201 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8a4c066f60 msgr2=0x7f8a4c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:22.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.426+0000 7f8a71400640 1 --2- 172.21.15.173:0/1035700201 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8a4c066f60 0x7f8a4c069420 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c000f70 tx=0x7f8a5c007b60 comp rx=0 tx=0).stop 2024-04-25T09:07:22.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.426+0000 7f8a71400640 1 -- 172.21.15.173:0/1035700201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a6c0cc270 msgr2=0x7f8a6c15fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:22.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.426+0000 7f8a71400640 1 --2- 172.21.15.173:0/1035700201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a6c0cc270 0x7f8a6c15fa70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800b440 tx=0x7f8a5800b900 comp rx=0 tx=0).stop 2024-04-25T09:07:22.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.426+0000 7f8a71400640 1 -- 172.21.15.173:0/1035700201 shutdown_connections 2024-04-25T09:07:22.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.426+0000 7f8a71400640 1 --2- 172.21.15.173:0/1035700201 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8a4c066f60 0x7f8a4c069420 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.426+0000 7f8a71400640 1 --2- 172.21.15.173:0/1035700201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a6c1597d0 0x7f8a6c0b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.426+0000 7f8a71400640 1 --2- 172.21.15.173:0/1035700201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a6c0cc270 0x7f8a6c15fa70 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.426+0000 7f8a71400640 1 --2- 172.21.15.173:0/1035700201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a6c06b3a0 0x7f8a6c155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.430+0000 7f8a71400640 1 -- 172.21.15.173:0/1035700201 >> 172.21.15.173:0/1035700201 conn(0x7f8a6c0b2230 msgr2=0x7f8a6c15b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:22.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.430+0000 7f8a71400640 1 -- 172.21.15.173:0/1035700201 shutdown_connections 2024-04-25T09:07:22.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.430+0000 7f8a71400640 1 -- 172.21.15.173:0/1035700201 wait complete. 2024-04-25T09:07:22.435 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:06:48.493059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:06:49.133352+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:07:22.435 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:07:22.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.586+0000 7faf13200640 1 Processor -- start 2024-04-25T09:07:22.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.586+0000 7faf13200640 1 -- start start 2024-04-25T09:07:22.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.586+0000 7faf13200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7faf14144f10 0x7faf1415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:22.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.586+0000 7faf13200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf141452f0 0x7faf1406ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:22.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.586+0000 7faf13200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7faf140ce420 0x7faf140ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:22.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.586+0000 7faf13200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1415fa40 con 0x7faf14144f10 2024-04-25T09:07:22.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.586+0000 7faf13200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf140720a0 con 0x7faf140ce420 2024-04-25T09:07:22.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.586+0000 7faf13200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf14071490 con 0x7faf141452f0 2024-04-25T09:07:22.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.586+0000 7faf11e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7faf14144f10 0x7faf1415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:22.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.586+0000 7faf11e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7faf14144f10 0x7faf1415f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54410/0 (socket says 172.21.15.173:54410) 2024-04-25T09:07:22.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.586+0000 7faf11e00640 1 -- 172.21.15.173:0/818627307 learned_addr learned my addr 172.21.15.173:0/818627307 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:22.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.586+0000 7faf12800640 1 --2- 172.21.15.173:0/818627307 >> v2:172.21.15.194:3300/0 conn(0x7faf140ce420 0x7faf140ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:22.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.586+0000 7faf11400640 1 --2- 172.21.15.173:0/818627307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf141452f0 0x7faf1406ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:22.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.586+0000 7faf11e00640 1 -- 172.21.15.173:0/818627307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf141452f0 msgr2=0x7faf1406ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:22.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.586+0000 7faf11e00640 1 --2- 172.21.15.173:0/818627307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf141452f0 0x7faf1406ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.586+0000 7faf11e00640 1 -- 172.21.15.173:0/818627307 >> v2:172.21.15.194:3300/0 conn(0x7faf140ce420 msgr2=0x7faf140ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:22.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.586+0000 7faf11e00640 1 --2- 172.21.15.173:0/818627307 >> v2:172.21.15.194:3300/0 conn(0x7faf140ce420 0x7faf140ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.586+0000 7faf11e00640 1 -- 172.21.15.173:0/818627307 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf14071770 con 0x7faf14144f10 2024-04-25T09:07:22.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.590+0000 7faf11e00640 1 --2- 172.21.15.173:0/818627307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf14144f10 0x7faf1415f500 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7faf1406bc20 tx=0x7faefc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b06483966c7a0ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:22.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.590+0000 7faf10a00640 1 -- 172.21.15.173:0/818627307 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0b0070 con 0x7faf14144f10 2024-04-25T09:07:22.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.590+0000 7faf10a00640 1 -- 172.21.15.173:0/818627307 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc0ab600 con 0x7faf14144f10 2024-04-25T09:07:22.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.590+0000 7faf10a00640 1 -- 172.21.15.173:0/818627307 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0ab9d0 con 0x7faf14144f10 2024-04-25T09:07:22.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.590+0000 7faf13200640 1 -- 172.21.15.173:0/818627307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf14144f10 msgr2=0x7faf1415f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:22.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.590+0000 7faf13200640 1 --2- 172.21.15.173:0/818627307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf14144f10 0x7faf1415f500 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7faf1406bc20 tx=0x7faefc01c520 comp rx=0 tx=0).stop 2024-04-25T09:07:22.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.590+0000 7faf13200640 1 -- 172.21.15.173:0/818627307 shutdown_connections 2024-04-25T09:07:22.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.590+0000 7faf13200640 1 --2- 172.21.15.173:0/818627307 >> v2:172.21.15.194:3300/0 conn(0x7faf140ce420 0x7faf140ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.590+0000 7faf13200640 1 --2- 172.21.15.173:0/818627307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf141452f0 0x7faf1406ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.590+0000 7faf13200640 1 --2- 172.21.15.173:0/818627307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf14144f10 0x7faf1415f500 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.590+0000 7faf13200640 1 -- 172.21.15.173:0/818627307 >> 172.21.15.173:0/818627307 conn(0x7faf14061d40 msgr2=0x7faf1406ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:22.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.590+0000 7faf13200640 1 -- 172.21.15.173:0/818627307 shutdown_connections 2024-04-25T09:07:22.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.590+0000 7faf13200640 1 -- 172.21.15.173:0/818627307 wait complete. 2024-04-25T09:07:22.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf13200640 1 Processor -- start 2024-04-25T09:07:22.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf13200640 1 -- start start 2024-04-25T09:07:22.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf13200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf140ce420 0x7faf1415d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:22.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf13200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf14144f10 0x7faf14140a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:22.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf13200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf141452f0 0x7faf1413f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:22.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf13200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1406f140 con 0x7faf141452f0 2024-04-25T09:07:22.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf13200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1406efc0 con 0x7faf140ce420 2024-04-25T09:07:22.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf13200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1415ca30 con 0x7faf14144f10 2024-04-25T09:07:22.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf12800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf141452f0 0x7faf1413f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:22.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf12800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf141452f0 0x7faf1413f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54412/0 (socket says 172.21.15.173:54412) 2024-04-25T09:07:22.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf12800640 1 -- 172.21.15.173:0/3858107740 learned_addr learned my addr 172.21.15.173:0/3858107740 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:22.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf11e00640 1 --2- 172.21.15.173:0/3858107740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf140ce420 0x7faf1415d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:22.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf11400640 1 --2- 172.21.15.173:0/3858107740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf14144f10 0x7faf14140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:22.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf12800640 1 -- 172.21.15.173:0/3858107740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf14144f10 msgr2=0x7faf14140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:22.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf12800640 1 --2- 172.21.15.173:0/3858107740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf14144f10 0x7faf14140a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf12800640 1 -- 172.21.15.173:0/3858107740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf140ce420 msgr2=0x7faf1415d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:22.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf12800640 1 --2- 172.21.15.173:0/3858107740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf140ce420 0x7faf1415d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf12800640 1 -- 172.21.15.173:0/3858107740 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1415e0f0 con 0x7faf141452f0 2024-04-25T09:07:22.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf12800640 1 --2- 172.21.15.173:0/3858107740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf141452f0 0x7faf1413f030 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7faf0c007e60 tx=0x7faf0c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:22.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf0a000640 1 -- 172.21.15.173:0/3858107740 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c014620 con 0x7faf141452f0 2024-04-25T09:07:22.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf0a000640 1 -- 172.21.15.173:0/3858107740 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c019070 con 0x7faf141452f0 2024-04-25T09:07:22.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf13200640 1 -- 172.21.15.173:0/3858107740 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf1415e3d0 con 0x7faf141452f0 2024-04-25T09:07:22.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf0a000640 1 -- 172.21.15.173:0/3858107740 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c014a20 con 0x7faf141452f0 2024-04-25T09:07:22.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.594+0000 7faf13200640 1 -- 172.21.15.173:0/3858107740 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf1415e990 con 0x7faf141452f0 2024-04-25T09:07:22.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.598+0000 7faf13200640 1 -- 172.21.15.173:0/3858107740 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf14073a40 con 0x7faf141452f0 2024-04-25T09:07:22.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.598+0000 7faf0a000640 1 -- 172.21.15.173:0/3858107740 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faf0c014bc0 con 0x7faf141452f0 2024-04-25T09:07:22.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.598+0000 7faf0a000640 1 --2- 172.21.15.173:0/3858107740 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faef0066f60 0x7faef0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:22.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.598+0000 7faf0a000640 1 -- 172.21.15.173:0/3858107740 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7faf0c0859e0 con 0x7faf141452f0 2024-04-25T09:07:22.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.598+0000 7faf11e00640 1 --2- 172.21.15.173:0/3858107740 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faef0066f60 0x7faef0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:22.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.598+0000 7faf11e00640 1 --2- 172.21.15.173:0/3858107740 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faef0066f60 0x7faef0069420 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7faefc0ad000 tx=0x7faefc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:22.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.602+0000 7faf0a000640 1 -- 172.21.15.173:0/3858107740 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faf0c056120 con 0x7faf141452f0 2024-04-25T09:07:22.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.758+0000 7faf13200640 1 -- 172.21.15.173:0/3858107740 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf14166670 con 0x7faf141452f0 2024-04-25T09:07:22.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.758+0000 7faf0a000640 1 -- 172.21.15.173:0/3858107740 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf0c05a1c0 con 0x7faf141452f0 2024-04-25T09:07:22.746 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:07:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.762+0000 7faf13200640 1 -- 172.21.15.173:0/3858107740 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faef0066f60 msgr2=0x7faef0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.762+0000 7faf13200640 1 --2- 172.21.15.173:0/3858107740 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faef0066f60 0x7faef0069420 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7faefc0ad000 tx=0x7faefc0a6000 comp rx=0 tx=0).stop 2024-04-25T09:07:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.762+0000 7faf13200640 1 -- 172.21.15.173:0/3858107740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf141452f0 msgr2=0x7faf1413f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.762+0000 7faf13200640 1 --2- 172.21.15.173:0/3858107740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf141452f0 0x7faf1413f030 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7faf0c007e60 tx=0x7faf0c00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.762+0000 7faf13200640 1 -- 172.21.15.173:0/3858107740 shutdown_connections 2024-04-25T09:07:22.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.762+0000 7faf13200640 1 --2- 172.21.15.173:0/3858107740 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faef0066f60 0x7faef0069420 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.762+0000 7faf13200640 1 --2- 172.21.15.173:0/3858107740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf141452f0 0x7faf1413f030 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.762+0000 7faf13200640 1 --2- 172.21.15.173:0/3858107740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf14144f10 0x7faf14140a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.762+0000 7faf13200640 1 --2- 172.21.15.173:0/3858107740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf140ce420 0x7faf1415d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.762+0000 7faf13200640 1 -- 172.21.15.173:0/3858107740 >> 172.21.15.173:0/3858107740 conn(0x7faf14061d40 msgr2=0x7faf140b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:22.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.762+0000 7faf13200640 1 -- 172.21.15.173:0/3858107740 shutdown_connections 2024-04-25T09:07:22.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.762+0000 7faf13200640 1 -- 172.21.15.173:0/3858107740 wait complete. 2024-04-25T09:07:22.768 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:07:22.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.922+0000 7f981d800640 1 Processor -- start 2024-04-25T09:07:22.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.922+0000 7f981d800640 1 -- start start 2024-04-25T09:07:22.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.922+0000 7f981d800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981809a160 0x7f98180c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:22.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.922+0000 7f981d800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98180cc7a0 con 0x7f98180d02a0 2024-04-25T09:07:22.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.922+0000 7f981d800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98180cca80 con 0x7f981815bab0 2024-04-25T09:07:22.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.922+0000 7f981d800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98180ccd60 con 0x7f981809a160 2024-04-25T09:07:22.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.922+0000 7f980e000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f98180d02a0 0x7f9818099a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:40464/0 (socket says 172.21.15.173:40464) 2024-04-25T09:07:22.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.922+0000 7f980e000640 1 -- 172.21.15.173:0/2215086209 learned_addr learned my addr 172.21.15.173:0/2215086209 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:22.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.922+0000 7f9817400640 1 --2- 172.21.15.173:0/2215086209 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981809a160 0x7f98180c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:22.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.922+0000 7f9816000640 1 -- 172.21.15.173:0/2215086209 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974247876 0 0) 0x7f98180cc7a0 con 0x7f98180d02a0 2024-04-25T09:07:22.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.922+0000 7f9816000640 1 -- 172.21.15.173:0/2215086209 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97fc003530 con 0x7f98180d02a0 2024-04-25T09:07:22.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.922+0000 7f9816000640 1 -- 172.21.15.173:0/2215086209 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111756173 0 0) 0x7f98180cca80 con 0x7f981815bab0 2024-04-25T09:07:22.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.922+0000 7f9816000640 1 -- 172.21.15.173:0/2215086209 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98180cc7a0 con 0x7f981815bab0 2024-04-25T09:07:22.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.922+0000 7f9817400640 1 -- 172.21.15.173:0/2215086209 >> v1:172.21.15.194:6789/0 conn(0x7f981815bab0 legacy=0x7f98180cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:22.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.922+0000 7f9817400640 1 -- 172.21.15.173:0/2215086209 >> v1:172.21.15.173:6789/0 conn(0x7f98180d02a0 legacy=0x7f9818099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:22.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.922+0000 7f9817400640 1 -- 172.21.15.173:0/2215086209 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98180cd040 con 0x7f981809a160 2024-04-25T09:07:22.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.926+0000 7f9817400640 1 --2- 172.21.15.173:0/2215086209 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981809a160 0x7f98180c5300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f98100097f0 tx=0x7f981001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=242afe54f493abf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:22.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.926+0000 7f9816000640 1 -- 172.21.15.173:0/2215086209 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98100b1070 con 0x7f981809a160 2024-04-25T09:07:22.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.926+0000 7f9816000640 1 -- 172.21.15.173:0/2215086209 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98100a8050 con 0x7f981809a160 2024-04-25T09:07:22.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.926+0000 7f9816000640 1 -- 172.21.15.173:0/2215086209 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98100ac840 con 0x7f981809a160 2024-04-25T09:07:22.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.926+0000 7f981d800640 1 -- 172.21.15.173:0/2215086209 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981809a160 msgr2=0x7f98180c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:22.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.926+0000 7f981d800640 1 --2- 172.21.15.173:0/2215086209 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981809a160 0x7f98180c5300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f98100097f0 tx=0x7f981001c4b0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.926+0000 7f981d800640 1 -- 172.21.15.173:0/2215086209 shutdown_connections 2024-04-25T09:07:22.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.926+0000 7f981d800640 1 --2- 172.21.15.173:0/2215086209 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981809a160 0x7f98180c5300 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.926+0000 7f981d800640 1 -- 172.21.15.173:0/2215086209 >> 172.21.15.173:0/2215086209 conn(0x7f98180b32a0 msgr2=0x7f98180b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:22.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.926+0000 7f981d800640 1 -- 172.21.15.173:0/2215086209 shutdown_connections 2024-04-25T09:07:22.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.926+0000 7f981d800640 1 -- 172.21.15.173:0/2215086209 wait complete. 2024-04-25T09:07:22.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f981d800640 1 Processor -- start 2024-04-25T09:07:22.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f981d800640 1 -- start start 2024-04-25T09:07:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f981d800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981809a160 0x7f981806bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f981d800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98180d02a0 0x7f9818159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f981d800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f981815bab0 0x7f981806d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f981d800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98180cc540 con 0x7f98180d02a0 2024-04-25T09:07:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f981d800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98180cc3c0 con 0x7f981815bab0 2024-04-25T09:07:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f981d800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98180cf540 con 0x7f981809a160 2024-04-25T09:07:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f980e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98180d02a0 0x7f9818159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f980e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98180d02a0 0x7f9818159e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54416/0 (socket says 172.21.15.173:54416) 2024-04-25T09:07:22.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f980e000640 1 -- 172.21.15.173:0/279192356 learned_addr learned my addr 172.21.15.173:0/279192356 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:22.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f9817400640 1 --2- 172.21.15.173:0/279192356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f981815bab0 0x7f981806d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:22.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f9816a00640 1 --2- 172.21.15.173:0/279192356 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981809a160 0x7f981806bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:22.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f980e000640 1 -- 172.21.15.173:0/279192356 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981809a160 msgr2=0x7f981806bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:22.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f980e000640 1 --2- 172.21.15.173:0/279192356 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981809a160 0x7f981806bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f980e000640 1 -- 172.21.15.173:0/279192356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f981815bab0 msgr2=0x7f981806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:22.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f980e000640 1 --2- 172.21.15.173:0/279192356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f981815bab0 0x7f981806d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:22.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f980e000640 1 -- 172.21.15.173:0/279192356 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981806c4f0 con 0x7f98180d02a0 2024-04-25T09:07:22.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f980e000640 1 --2- 172.21.15.173:0/279192356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98180d02a0 0x7f9818159e40 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f980000c4d0 tx=0x7f980000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:22.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f980f400640 1 -- 172.21.15.173:0/279192356 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800017070 con 0x7f98180d02a0 2024-04-25T09:07:22.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f980f400640 1 -- 172.21.15.173:0/279192356 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9800005cf0 con 0x7f98180d02a0 2024-04-25T09:07:22.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f981d800640 1 -- 172.21.15.173:0/279192356 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981806c7d0 con 0x7f98180d02a0 2024-04-25T09:07:22.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f980f400640 1 -- 172.21.15.173:0/279192356 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98000072b0 con 0x7f98180d02a0 2024-04-25T09:07:22.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f981d800640 1 -- 172.21.15.173:0/279192356 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981806cd90 con 0x7f98180d02a0 2024-04-25T09:07:22.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.930+0000 7f981d800640 1 -- 172.21.15.173:0/279192356 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9818073ab0 con 0x7f98180d02a0 2024-04-25T09:07:22.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.934+0000 7f980f400640 1 -- 172.21.15.173:0/279192356 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f980001a070 con 0x7f98180d02a0 2024-04-25T09:07:22.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.934+0000 7f980f400640 1 --2- 172.21.15.173:0/279192356 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f97f4066f60 0x7f97f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:22.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.934+0000 7f980f400640 1 -- 172.21.15.173:0/279192356 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f9800084690 con 0x7f98180d02a0 2024-04-25T09:07:22.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.934+0000 7f9816a00640 1 --2- 172.21.15.173:0/279192356 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f97f4066f60 0x7f97f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:22.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.934+0000 7f9816a00640 1 --2- 172.21.15.173:0/279192356 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f97f4066f60 0x7f97f4069420 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9808001570 tx=0x7f9808009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:22.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:22.938+0000 7f980f400640 1 -- 172.21.15.173:0/279192356 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9800054d50 con 0x7f98180d02a0 2024-04-25T09:07:23.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.094+0000 7f981d800640 1 -- 172.21.15.173:0/279192356 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f98180cf830 con 0x7f98180d02a0 2024-04-25T09:07:23.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.094+0000 7f980f400640 1 -- 172.21.15.173:0/279192356 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9800058df0 con 0x7f98180d02a0 2024-04-25T09:07:23.081 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:07:23.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.094+0000 7f981d800640 1 -- 172.21.15.173:0/279192356 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f97f4066f60 msgr2=0x7f97f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:23.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.094+0000 7f981d800640 1 --2- 172.21.15.173:0/279192356 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f97f4066f60 0x7f97f4069420 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9808001570 tx=0x7f9808009040 comp rx=0 tx=0).stop 2024-04-25T09:07:23.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.094+0000 7f981d800640 1 -- 172.21.15.173:0/279192356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98180d02a0 msgr2=0x7f9818159e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:23.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.094+0000 7f981d800640 1 --2- 172.21.15.173:0/279192356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98180d02a0 0x7f9818159e40 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f980000c4d0 tx=0x7f980000c990 comp rx=0 tx=0).stop 2024-04-25T09:07:23.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.094+0000 7f981d800640 1 -- 172.21.15.173:0/279192356 shutdown_connections 2024-04-25T09:07:23.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.094+0000 7f981d800640 1 --2- 172.21.15.173:0/279192356 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f97f4066f60 0x7f97f4069420 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.094+0000 7f981d800640 1 --2- 172.21.15.173:0/279192356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f981815bab0 0x7f981806d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.094+0000 7f981d800640 1 --2- 172.21.15.173:0/279192356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98180d02a0 0x7f9818159e40 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.094+0000 7f981d800640 1 --2- 172.21.15.173:0/279192356 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981809a160 0x7f981806bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.094+0000 7f981d800640 1 -- 172.21.15.173:0/279192356 >> 172.21.15.173:0/279192356 conn(0x7f98180b32a0 msgr2=0x7f9818157a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:23.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.094+0000 7f981d800640 1 -- 172.21.15.173:0/279192356 shutdown_connections 2024-04-25T09:07:23.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.094+0000 7f981d800640 1 -- 172.21.15.173:0/279192356 wait complete. 2024-04-25T09:07:23.101 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:07:23.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.250+0000 7f0b9f000640 1 Processor -- start 2024-04-25T09:07:23.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.250+0000 7f0b9f000640 1 -- start start 2024-04-25T09:07:23.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.254+0000 7f0b9f000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b9806f5b0 0x7f0b980aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:23.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.254+0000 7f0b9f000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0b980ad3f0 0x7f0b981677c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:23.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.254+0000 7f0b9f000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9806f9f0 con 0x7f0b9806e1c0 2024-04-25T09:07:23.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.254+0000 7f0b9f000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b980b3170 con 0x7f0b980ad3f0 2024-04-25T09:07:23.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.254+0000 7f0b9f000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9815e070 con 0x7f0b9806f5b0 2024-04-25T09:07:23.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.254+0000 7f0b9d000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0b980ad3f0 0x7f0b981677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:23.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.254+0000 7f0b8f400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b9806f5b0 0x7f0b980aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:23.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.254+0000 7f0b9d000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0b980ad3f0 0x7f0b981677c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:58800/0 (socket says 172.21.15.173:58800) 2024-04-25T09:07:23.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.254+0000 7f0b9d000640 1 -- 172.21.15.173:0/3929977535 learned_addr learned my addr 172.21.15.173:0/3929977535 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:23.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.254+0000 7f0b8f400640 1 -- 172.21.15.173:0/3929977535 >> v2:172.21.15.194:3300/0 conn(0x7f0b980ad3f0 msgr2=0x7f0b981677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:23.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.254+0000 7f0b8f400640 1 --2- 172.21.15.173:0/3929977535 >> v2:172.21.15.194:3300/0 conn(0x7f0b980ad3f0 0x7f0b981677c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.254+0000 7f0b8f400640 1 -- 172.21.15.173:0/3929977535 >> v1:172.21.15.194:6789/0 conn(0x7f0b9806e1c0 legacy=0x7f0b9806bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:23.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.254+0000 7f0b8f400640 1 -- 172.21.15.173:0/3929977535 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9806ae30 con 0x7f0b9806f5b0 2024-04-25T09:07:23.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.254+0000 7f0b9d000640 1 --2- 172.21.15.173:0/3929977535 >> v2:172.21.15.194:3300/0 conn(0x7f0b980ad3f0 0x7f0b981677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:23.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.258+0000 7f0b8f400640 1 --2- 172.21.15.173:0/3929977535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b9806f5b0 0x7f0b980aceb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0b800097f0 tx=0x7f0b8001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5320425d89719fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:23.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.258+0000 7f0b97400640 1 -- 172.21.15.173:0/3929977535 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b800b5070 con 0x7f0b9806f5b0 2024-04-25T09:07:23.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.258+0000 7f0b97400640 1 -- 172.21.15.173:0/3929977535 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b800a8990 con 0x7f0b9806f5b0 2024-04-25T09:07:23.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.258+0000 7f0b97400640 1 -- 172.21.15.173:0/3929977535 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b800a8d60 con 0x7f0b9806f5b0 2024-04-25T09:07:23.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.258+0000 7f0b9f000640 1 -- 172.21.15.173:0/3929977535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b9806f5b0 msgr2=0x7f0b980aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:23.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.258+0000 7f0b9f000640 1 --2- 172.21.15.173:0/3929977535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b9806f5b0 0x7f0b980aceb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0b800097f0 tx=0x7f0b8001ec90 comp rx=0 tx=0).stop 2024-04-25T09:07:23.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.258+0000 7f0b9f000640 1 -- 172.21.15.173:0/3929977535 shutdown_connections 2024-04-25T09:07:23.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.258+0000 7f0b9f000640 1 --2- 172.21.15.173:0/3929977535 >> v2:172.21.15.194:3300/0 conn(0x7f0b980ad3f0 0x7f0b981677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.258+0000 7f0b9f000640 1 --2- 172.21.15.173:0/3929977535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b9806f5b0 0x7f0b980aceb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.258+0000 7f0b9f000640 1 -- 172.21.15.173:0/3929977535 >> 172.21.15.173:0/3929977535 conn(0x7f0b980cfed0 msgr2=0x7f0b980d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:23.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.258+0000 7f0b9f000640 1 -- 172.21.15.173:0/3929977535 shutdown_connections 2024-04-25T09:07:23.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.258+0000 7f0b9f000640 1 -- 172.21.15.173:0/3929977535 wait complete. 2024-04-25T09:07:23.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.258+0000 7f0b9f000640 1 Processor -- start 2024-04-25T09:07:23.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.258+0000 7f0b9f000640 1 -- start start 2024-04-25T09:07:23.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b9f000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b9806e1c0 0x7f0b981f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:23.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b9f000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b9806f5b0 0x7f0b981451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:23.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b9f000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b980ad3f0 0x7f0b981f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:23.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b9f000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9806b6d0 con 0x7f0b9806e1c0 2024-04-25T09:07:23.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b9f000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9806b3f0 con 0x7f0b980ad3f0 2024-04-25T09:07:23.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b9f000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9806b9b0 con 0x7f0b9806f5b0 2024-04-25T09:07:23.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b97e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b9806e1c0 0x7f0b981f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:23.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b97e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b9806e1c0 0x7f0b981f0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54426/0 (socket says 172.21.15.173:54426) 2024-04-25T09:07:23.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b97e00640 1 -- 172.21.15.173:0/2761881962 learned_addr learned my addr 172.21.15.173:0/2761881962 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:23.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b8f400640 1 --2- 172.21.15.173:0/2761881962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b9806f5b0 0x7f0b981451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:23.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b9d000640 1 --2- 172.21.15.173:0/2761881962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b980ad3f0 0x7f0b981f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:23.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b97e00640 1 -- 172.21.15.173:0/2761881962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b9806f5b0 msgr2=0x7f0b981451e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:23.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b97e00640 1 --2- 172.21.15.173:0/2761881962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b9806f5b0 0x7f0b981451e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b97e00640 1 -- 172.21.15.173:0/2761881962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b980ad3f0 msgr2=0x7f0b981f6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:23.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b97e00640 1 --2- 172.21.15.173:0/2761881962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b980ad3f0 0x7f0b981f6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b97e00640 1 -- 172.21.15.173:0/2761881962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b98145bf0 con 0x7f0b9806e1c0 2024-04-25T09:07:23.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b97e00640 1 --2- 172.21.15.173:0/2761881962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b9806e1c0 0x7f0b981f0d60 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800c420 tx=0x7f0b8800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:23.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b94c00640 1 -- 172.21.15.173:0/2761881962 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b880052d0 con 0x7f0b9806e1c0 2024-04-25T09:07:23.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b94c00640 1 -- 172.21.15.173:0/2761881962 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b88005470 con 0x7f0b9806e1c0 2024-04-25T09:07:23.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b94c00640 1 -- 172.21.15.173:0/2761881962 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88007260 con 0x7f0b9806e1c0 2024-04-25T09:07:23.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b9f000640 1 -- 172.21.15.173:0/2761881962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b98145ed0 con 0x7f0b9806e1c0 2024-04-25T09:07:23.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b9f000640 1 -- 172.21.15.173:0/2761881962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b981552c0 con 0x7f0b9806e1c0 2024-04-25T09:07:23.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.262+0000 7f0b9f000640 1 -- 172.21.15.173:0/2761881962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b98073ab0 con 0x7f0b9806e1c0 2024-04-25T09:07:23.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.266+0000 7f0b94c00640 1 -- 172.21.15.173:0/2761881962 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0b88007400 con 0x7f0b9806e1c0 2024-04-25T09:07:23.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.266+0000 7f0b94c00640 1 --2- 172.21.15.173:0/2761881962 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b74066f60 0x7f0b74069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:23.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.266+0000 7f0b94c00640 1 -- 172.21.15.173:0/2761881962 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f0b88084730 con 0x7f0b9806e1c0 2024-04-25T09:07:23.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.266+0000 7f0b8f400640 1 --2- 172.21.15.173:0/2761881962 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b74066f60 0x7f0b74069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:23.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.266+0000 7f0b8f400640 1 --2- 172.21.15.173:0/2761881962 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b74066f60 0x7f0b74069420 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0b800b2000 tx=0x7f0b80008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:23.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.270+0000 7f0b94c00640 1 -- 172.21.15.173:0/2761881962 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0b88054e70 con 0x7f0b9806e1c0 2024-04-25T09:07:23.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.422+0000 7f0b9f000640 1 -- 172.21.15.173:0/2761881962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b980afe10 con 0x7f0b9806e1c0 2024-04-25T09:07:23.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.422+0000 7f0b94c00640 1 -- 172.21.15.173:0/2761881962 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b88058f10 con 0x7f0b9806e1c0 2024-04-25T09:07:23.410 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:07:23.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.422+0000 7f0b9f000640 1 -- 172.21.15.173:0/2761881962 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b74066f60 msgr2=0x7f0b74069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:23.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.422+0000 7f0b9f000640 1 --2- 172.21.15.173:0/2761881962 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b74066f60 0x7f0b74069420 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0b800b2000 tx=0x7f0b80008040 comp rx=0 tx=0).stop 2024-04-25T09:07:23.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.422+0000 7f0b9f000640 1 -- 172.21.15.173:0/2761881962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b9806e1c0 msgr2=0x7f0b981f0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:23.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.422+0000 7f0b9f000640 1 --2- 172.21.15.173:0/2761881962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b9806e1c0 0x7f0b981f0d60 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800c420 tx=0x7f0b8800c8e0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.422+0000 7f0b9f000640 1 -- 172.21.15.173:0/2761881962 shutdown_connections 2024-04-25T09:07:23.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.422+0000 7f0b9f000640 1 --2- 172.21.15.173:0/2761881962 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b74066f60 0x7f0b74069420 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.422+0000 7f0b9f000640 1 --2- 172.21.15.173:0/2761881962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b980ad3f0 0x7f0b981f6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.422+0000 7f0b9f000640 1 --2- 172.21.15.173:0/2761881962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b9806f5b0 0x7f0b981451e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.422+0000 7f0b9f000640 1 --2- 172.21.15.173:0/2761881962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b9806e1c0 0x7f0b981f0d60 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.422+0000 7f0b9f000640 1 -- 172.21.15.173:0/2761881962 >> 172.21.15.173:0/2761881962 conn(0x7f0b980cfed0 msgr2=0x7f0b980b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:23.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.422+0000 7f0b9f000640 1 -- 172.21.15.173:0/2761881962 shutdown_connections 2024-04-25T09:07:23.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.422+0000 7f0b9f000640 1 -- 172.21.15.173:0/2761881962 wait complete. 2024-04-25T09:07:23.431 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:23.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.578+0000 7f88fd800640 1 Processor -- start 2024-04-25T09:07:23.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.578+0000 7f88fd800640 1 -- start start 2024-04-25T09:07:23.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.578+0000 7f88fd800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f8145250 0x7f88f815c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:23.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.578+0000 7f88fd800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f88f80cc8b0 0x7f88f80ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:23.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.578+0000 7f88fd800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f815cec0 con 0x7f88f8071320 2024-04-25T09:07:23.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.578+0000 7f88fd800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f806e7c0 con 0x7f88f80cc8b0 2024-04-25T09:07:23.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.578+0000 7f88fd800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f806d720 con 0x7f88f8145250 2024-04-25T09:07:23.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.582+0000 7f88f6000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f88f80cc8b0 0x7f88f80ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:23.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.582+0000 7f88f7400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f88f8071320 0x7f88f8071790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39212/0 (socket says 172.21.15.173:39212) 2024-04-25T09:07:23.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.582+0000 7f88f7400640 1 -- 172.21.15.173:0/3029370925 learned_addr learned my addr 172.21.15.173:0/3029370925 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:23.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.582+0000 7f88f6a00640 1 --2- 172.21.15.173:0/3029370925 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f8145250 0x7f88f815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:23.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.582+0000 7f88f6000640 1 -- 172.21.15.173:0/3029370925 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f8145250 msgr2=0x7f88f815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:23.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.582+0000 7f88f6000640 1 --2- 172.21.15.173:0/3029370925 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f8145250 0x7f88f815c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.582+0000 7f88f6000640 1 -- 172.21.15.173:0/3029370925 >> v1:172.21.15.173:6789/0 conn(0x7f88f8071320 legacy=0x7f88f8071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:23.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.582+0000 7f88f6000640 1 -- 172.21.15.173:0/3029370925 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f806da00 con 0x7f88f80cc8b0 2024-04-25T09:07:23.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.582+0000 7f88f6000640 1 --2- 172.21.15.173:0/3029370925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f80cc8b0 0x7f88f80ccd30 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f88e40097c0 tx=0x7f88e401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0bb37ee23c3f28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:23.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.582+0000 7f88f5600640 1 -- 172.21.15.173:0/3029370925 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e40b2070 con 0x7f88f80cc8b0 2024-04-25T09:07:23.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.582+0000 7f88f5600640 1 -- 172.21.15.173:0/3029370925 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e40ad640 con 0x7f88f80cc8b0 2024-04-25T09:07:23.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.582+0000 7f88f5600640 1 -- 172.21.15.173:0/3029370925 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e40ada10 con 0x7f88f80cc8b0 2024-04-25T09:07:23.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88fd800640 1 -- 172.21.15.173:0/3029370925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f80cc8b0 msgr2=0x7f88f80ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:23.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88fd800640 1 --2- 172.21.15.173:0/3029370925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f80cc8b0 0x7f88f80ccd30 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f88e40097c0 tx=0x7f88e401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88fd800640 1 -- 172.21.15.173:0/3029370925 shutdown_connections 2024-04-25T09:07:23.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88fd800640 1 --2- 172.21.15.173:0/3029370925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f80cc8b0 0x7f88f80ccd30 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88fd800640 1 --2- 172.21.15.173:0/3029370925 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f8145250 0x7f88f815c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88fd800640 1 -- 172.21.15.173:0/3029370925 >> 172.21.15.173:0/3029370925 conn(0x7f88f806ac90 msgr2=0x7f88f806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:23.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88fd800640 1 -- 172.21.15.173:0/3029370925 shutdown_connections 2024-04-25T09:07:23.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88fd800640 1 -- 172.21.15.173:0/3029370925 wait complete. 2024-04-25T09:07:23.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88fd800640 1 Processor -- start 2024-04-25T09:07:23.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88fd800640 1 -- start start 2024-04-25T09:07:23.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88fd800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f8071320 0x7f88f815ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:23.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88fd800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88f80cc8b0 0x7f88f8141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:23.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88fd800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f8145250 0x7f88f81415d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:23.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88fd800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f806ef80 con 0x7f88f8071320 2024-04-25T09:07:23.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88fd800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f8145630 con 0x7f88f80cc8b0 2024-04-25T09:07:23.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88fd800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f806d380 con 0x7f88f8145250 2024-04-25T09:07:23.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88f6a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f8071320 0x7f88f815ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:23.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88f6a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f8071320 0x7f88f815ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48524/0 (socket says 172.21.15.173:48524) 2024-04-25T09:07:23.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88f6a00640 1 -- 172.21.15.173:0/3218672127 learned_addr learned my addr 172.21.15.173:0/3218672127 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:23.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88f7400640 1 --2- 172.21.15.173:0/3218672127 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f8145250 0x7f88f81415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:23.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88f6000640 1 --2- 172.21.15.173:0/3218672127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88f80cc8b0 0x7f88f8141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:23.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88f6a00640 1 -- 172.21.15.173:0/3218672127 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f8145250 msgr2=0x7f88f81415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:23.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88f6a00640 1 --2- 172.21.15.173:0/3218672127 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f8145250 0x7f88f81415d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88f6a00640 1 -- 172.21.15.173:0/3218672127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88f80cc8b0 msgr2=0x7f88f8141090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:23.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88f6a00640 1 --2- 172.21.15.173:0/3218672127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88f80cc8b0 0x7f88f8141090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.586+0000 7f88f6a00640 1 -- 172.21.15.173:0/3218672127 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f80b3980 con 0x7f88f8071320 2024-04-25T09:07:23.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.590+0000 7f88f6a00640 1 --2- 172.21.15.173:0/3218672127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f8071320 0x7f88f815ad90 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f88e800c7f0 tx=0x7f88e800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:23.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.590+0000 7f88eea00640 1 -- 172.21.15.173:0/3218672127 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8015070 con 0x7f88f8071320 2024-04-25T09:07:23.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.590+0000 7f88eea00640 1 -- 172.21.15.173:0/3218672127 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e8007820 con 0x7f88f8071320 2024-04-25T09:07:23.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.590+0000 7f88fd800640 1 -- 172.21.15.173:0/3218672127 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f80b3c60 con 0x7f88f8071320 2024-04-25T09:07:23.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.590+0000 7f88eea00640 1 -- 172.21.15.173:0/3218672127 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8007c10 con 0x7f88f8071320 2024-04-25T09:07:23.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.590+0000 7f88fd800640 1 -- 172.21.15.173:0/3218672127 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f80b4220 con 0x7f88f8071320 2024-04-25T09:07:23.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.590+0000 7f88fd800640 1 -- 172.21.15.173:0/3218672127 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f8073a40 con 0x7f88f8071320 2024-04-25T09:07:23.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.590+0000 7f88eea00640 1 -- 172.21.15.173:0/3218672127 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f88e8018070 con 0x7f88f8071320 2024-04-25T09:07:23.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.590+0000 7f88eea00640 1 --2- 172.21.15.173:0/3218672127 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88d8066f60 0x7f88d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:23.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.590+0000 7f88eea00640 1 -- 172.21.15.173:0/3218672127 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f88e8085290 con 0x7f88f8071320 2024-04-25T09:07:23.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.590+0000 7f88f6000640 1 --2- 172.21.15.173:0/3218672127 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88d8066f60 0x7f88d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:23.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.590+0000 7f88f6000640 1 --2- 172.21.15.173:0/3218672127 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88d8066f60 0x7f88d8069420 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f88e40af000 tx=0x7f88e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:23.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.594+0000 7f88eea00640 1 -- 172.21.15.173:0/3218672127 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f88e80559d0 con 0x7f88f8071320 2024-04-25T09:07:23.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.782+0000 7f88fd800640 1 -- 172.21.15.173:0/3218672127 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88f8141d80 con 0x7f88f8071320 2024-04-25T09:07:23.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.782+0000 7f88eea00640 1 -- 172.21.15.173:0/3218672127 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f88e8059a70 con 0x7f88f8071320 2024-04-25T09:07:23.770 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:23.770 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":46,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/894026798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":894026798},{"type":"v1","addr":"172.21.15.194:6833","nonce":894026798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2000586494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2000586494},{"type":"v1","addr":"172.21.15.194:6835","nonce":2000586494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3382962588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3382962588},{"type":"v1","addr":"172.21.15.173:6837","nonce":3382962588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:50.132659+0000","modified":"2024-04-25T09:07:04.888384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6960":{"gid":6960,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.173:6836/4214702139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4214702139},{"type":"v1","addr":"172.21.15.173:6836","nonce":4214702139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:07:23.771 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 46 2024-04-25T09:07:23.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.786+0000 7f88fd800640 1 -- 172.21.15.173:0/3218672127 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88d8066f60 msgr2=0x7f88d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:23.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.786+0000 7f88fd800640 1 --2- 172.21.15.173:0/3218672127 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88d8066f60 0x7f88d8069420 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f88e40af000 tx=0x7f88e4008040 comp rx=0 tx=0).stop 2024-04-25T09:07:23.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.786+0000 7f88fd800640 1 -- 172.21.15.173:0/3218672127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f8071320 msgr2=0x7f88f815ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:23.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.786+0000 7f88fd800640 1 --2- 172.21.15.173:0/3218672127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f8071320 0x7f88f815ad90 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f88e800c7f0 tx=0x7f88e800ccb0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.786+0000 7f88fd800640 1 -- 172.21.15.173:0/3218672127 shutdown_connections 2024-04-25T09:07:23.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.786+0000 7f88fd800640 1 --2- 172.21.15.173:0/3218672127 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88d8066f60 0x7f88d8069420 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.786+0000 7f88fd800640 1 --2- 172.21.15.173:0/3218672127 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f8145250 0x7f88f81415d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.786+0000 7f88fd800640 1 --2- 172.21.15.173:0/3218672127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88f80cc8b0 0x7f88f8141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.786+0000 7f88fd800640 1 --2- 172.21.15.173:0/3218672127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f8071320 0x7f88f815ad90 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.786+0000 7f88fd800640 1 -- 172.21.15.173:0/3218672127 >> 172.21.15.173:0/3218672127 conn(0x7f88f806ac90 msgr2=0x7f88f815d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:23.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.786+0000 7f88fd800640 1 -- 172.21.15.173:0/3218672127 shutdown_connections 2024-04-25T09:07:23.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.786+0000 7f88fd800640 1 -- 172.21.15.173:0/3218672127 wait complete. 2024-04-25T09:07:23.792 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:23.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.938+0000 7ff8e5400640 1 Processor -- start 2024-04-25T09:07:23.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.938+0000 7ff8e5400640 1 -- start start 2024-04-25T09:07:23.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.942+0000 7ff8e5400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff8e0157f00 0x7ff8e00b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:23.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.942+0000 7ff8e5400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff8e00b36c0 0x7ff8e006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:23.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.942+0000 7ff8e5400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e015e010 con 0x7ff8e006ac90 2024-04-25T09:07:23.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.942+0000 7ff8e5400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e00b55b0 con 0x7ff8e00b36c0 2024-04-25T09:07:23.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.942+0000 7ff8e5400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e00b57e0 con 0x7ff8e0157f00 2024-04-25T09:07:23.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.942+0000 7ff8d5e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff8e00b36c0 0x7ff8e006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:23.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.942+0000 7ff8d5e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff8e00b36c0 0x7ff8e006e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48534/0 (socket says 172.21.15.173:48534) 2024-04-25T09:07:23.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.942+0000 7ff8d5e00640 1 -- 172.21.15.173:0/859613724 learned_addr learned my addr 172.21.15.173:0/859613724 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:23.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.942+0000 7ff8df200640 1 --1- 172.21.15.173:0/859613724 >> v1:172.21.15.173:6789/0 conn(0x7ff8e006ac90 0x7ff8e015e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39228/0 (socket says 172.21.15.173:39228) 2024-04-25T09:07:23.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.942+0000 7ff8de800640 1 --2- 172.21.15.173:0/859613724 >> v2:172.21.15.194:3300/0 conn(0x7ff8e0157f00 0x7ff8e00b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:23.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.942+0000 7ff8d5e00640 1 -- 172.21.15.173:0/859613724 >> v2:172.21.15.194:3300/0 conn(0x7ff8e0157f00 msgr2=0x7ff8e00b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:23.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.942+0000 7ff8d5e00640 1 --2- 172.21.15.173:0/859613724 >> v2:172.21.15.194:3300/0 conn(0x7ff8e0157f00 0x7ff8e00b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.942+0000 7ff8d5e00640 1 -- 172.21.15.173:0/859613724 >> v1:172.21.15.173:6789/0 conn(0x7ff8e006ac90 legacy=0x7ff8e015e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:23.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.942+0000 7ff8d5e00640 1 -- 172.21.15.173:0/859613724 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e006fe90 con 0x7ff8e00b36c0 2024-04-25T09:07:23.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.942+0000 7ff8dde00640 1 -- 172.21.15.173:0/859613724 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751186885 0 0) 0x7ff8e015e010 con 0x7ff8e006ac90 2024-04-25T09:07:23.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.946+0000 7ff8d5e00640 1 --2- 172.21.15.173:0/859613724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e00b36c0 0x7ff8e006e4d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00720f0 tx=0x7ff8c801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e0143ce724cf97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:23.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.946+0000 7ff8dde00640 1 -- 172.21.15.173:0/859613724 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c80ab600 con 0x7ff8e00b36c0 2024-04-25T09:07:23.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.946+0000 7ff8dde00640 1 -- 172.21.15.173:0/859613724 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c80b0070 con 0x7ff8e00b36c0 2024-04-25T09:07:23.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.946+0000 7ff8dde00640 1 -- 172.21.15.173:0/859613724 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c80ab9c0 con 0x7ff8e00b36c0 2024-04-25T09:07:23.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.946+0000 7ff8e5400640 1 -- 172.21.15.173:0/859613724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e00b36c0 msgr2=0x7ff8e006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:23.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.946+0000 7ff8e5400640 1 --2- 172.21.15.173:0/859613724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e00b36c0 0x7ff8e006e4d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00720f0 tx=0x7ff8c801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.946+0000 7ff8e5400640 1 -- 172.21.15.173:0/859613724 shutdown_connections 2024-04-25T09:07:23.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.946+0000 7ff8e5400640 1 --2- 172.21.15.173:0/859613724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e00b36c0 0x7ff8e006e4d0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.946+0000 7ff8e5400640 1 --2- 172.21.15.173:0/859613724 >> v2:172.21.15.194:3300/0 conn(0x7ff8e0157f00 0x7ff8e00b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.946+0000 7ff8e5400640 1 -- 172.21.15.173:0/859613724 >> 172.21.15.173:0/859613724 conn(0x7ff8e0099a50 msgr2=0x7ff8e00b5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:23.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.946+0000 7ff8e5400640 1 -- 172.21.15.173:0/859613724 shutdown_connections 2024-04-25T09:07:23.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.946+0000 7ff8e5400640 1 -- 172.21.15.173:0/859613724 wait complete. 2024-04-25T09:07:23.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.946+0000 7ff8e5400640 1 Processor -- start 2024-04-25T09:07:23.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.946+0000 7ff8e5400640 1 -- start start 2024-04-25T09:07:23.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.946+0000 7ff8e5400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e006ac90 0x7ff8e0151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:23.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.946+0000 7ff8e5400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8e00b36c0 0x7ff8e0151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:23.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8e5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8e0157f00 0x7ff8e0152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:23.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8e5400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e006b4b0 con 0x7ff8e006ac90 2024-04-25T09:07:23.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8e5400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e01582e0 con 0x7ff8e0157f00 2024-04-25T09:07:23.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8e5400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e009da90 con 0x7ff8e00b36c0 2024-04-25T09:07:23.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8de800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e006ac90 0x7ff8e0151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:23.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8de800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e006ac90 0x7ff8e0151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48544/0 (socket says 172.21.15.173:48544) 2024-04-25T09:07:23.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8de800640 1 -- 172.21.15.173:0/2397938863 learned_addr learned my addr 172.21.15.173:0/2397938863 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:23.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8df200640 1 --2- 172.21.15.173:0/2397938863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8e0157f00 0x7ff8e0152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:23.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8d5e00640 1 --2- 172.21.15.173:0/2397938863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8e00b36c0 0x7ff8e0151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:23.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8de800640 1 -- 172.21.15.173:0/2397938863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8e00b36c0 msgr2=0x7ff8e0151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:23.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8de800640 1 --2- 172.21.15.173:0/2397938863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8e00b36c0 0x7ff8e0151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8de800640 1 -- 172.21.15.173:0/2397938863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8e0157f00 msgr2=0x7ff8e0152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:23.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8de800640 1 --2- 172.21.15.173:0/2397938863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8e0157f00 0x7ff8e0152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8de800640 1 -- 172.21.15.173:0/2397938863 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e00b6100 con 0x7ff8e006ac90 2024-04-25T09:07:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8d5e00640 1 --2- 172.21.15.173:0/2397938863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8e00b36c0 0x7ff8e0151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8de800640 1 --2- 172.21.15.173:0/2397938863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e006ac90 0x7ff8e0151090 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000d620 tx=0x7ff8d000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8d7400640 1 -- 172.21.15.173:0/2397938863 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d000b620 con 0x7ff8e006ac90 2024-04-25T09:07:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8d7400640 1 -- 172.21.15.173:0/2397938863 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d0019070 con 0x7ff8e006ac90 2024-04-25T09:07:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8e5400640 1 -- 172.21.15.173:0/2397938863 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e01515d0 con 0x7ff8e006ac90 2024-04-25T09:07:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8d7400640 1 -- 172.21.15.173:0/2397938863 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d000b9e0 con 0x7ff8e006ac90 2024-04-25T09:07:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8e5400640 1 -- 172.21.15.173:0/2397938863 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e009d160 con 0x7ff8e006ac90 2024-04-25T09:07:23.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8e5400640 1 -- 172.21.15.173:0/2397938863 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e0073a40 con 0x7ff8e006ac90 2024-04-25T09:07:23.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.950+0000 7ff8d7400640 1 -- 172.21.15.173:0/2397938863 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff8d000bb80 con 0x7ff8e006ac90 2024-04-25T09:07:23.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.954+0000 7ff8d7400640 1 --2- 172.21.15.173:0/2397938863 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff8bc066f60 0x7ff8bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:23.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.954+0000 7ff8d7400640 1 -- 172.21.15.173:0/2397938863 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ff8d00856a0 con 0x7ff8e006ac90 2024-04-25T09:07:23.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.954+0000 7ff8d5e00640 1 --2- 172.21.15.173:0/2397938863 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff8bc066f60 0x7ff8bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:23.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.954+0000 7ff8d5e00640 1 --2- 172.21.15.173:0/2397938863 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff8bc066f60 0x7ff8bc069420 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80af000 tx=0x7ff8c80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:23.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:23.958+0000 7ff8d7400640 1 -- 172.21.15.173:0/2397938863 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff8d0056430 con 0x7ff8e006ac90 2024-04-25T09:07:24.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.110+0000 7ff8e5400640 1 -- 172.21.15.173:0/2397938863 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8e0099f30 con 0x7ff8e006ac90 2024-04-25T09:07:24.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.110+0000 7ff8d7400640 1 -- 172.21.15.173:0/2397938863 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+17073 (secure 0 0 0) 0x7ff8d0055d30 con 0x7ff8e006ac90 2024-04-25T09:07:24.099 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:24.099 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":73,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:07:01.867759+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:48.493059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:49.133352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:6836/962695208":"2024-04-26T09:07:01.867727+0000","172.21.15.173:6834/962695208":"2024-04-26T09:07:01.867727+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:24.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.114+0000 7ff8e5400640 1 -- 172.21.15.173:0/2397938863 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff8bc066f60 msgr2=0x7ff8bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:24.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.114+0000 7ff8e5400640 1 --2- 172.21.15.173:0/2397938863 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff8bc066f60 0x7ff8bc069420 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80af000 tx=0x7ff8c80a7000 comp rx=0 tx=0).stop 2024-04-25T09:07:24.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.114+0000 7ff8e5400640 1 -- 172.21.15.173:0/2397938863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e006ac90 msgr2=0x7ff8e0151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:24.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.114+0000 7ff8e5400640 1 --2- 172.21.15.173:0/2397938863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e006ac90 0x7ff8e0151090 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000d620 tx=0x7ff8d000dae0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.114+0000 7ff8e5400640 1 -- 172.21.15.173:0/2397938863 shutdown_connections 2024-04-25T09:07:24.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.114+0000 7ff8e5400640 1 --2- 172.21.15.173:0/2397938863 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff8bc066f60 0x7ff8bc069420 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.114+0000 7ff8e5400640 1 --2- 172.21.15.173:0/2397938863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8e0157f00 0x7ff8e0152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.114+0000 7ff8e5400640 1 --2- 172.21.15.173:0/2397938863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8e00b36c0 0x7ff8e0151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.114+0000 7ff8e5400640 1 --2- 172.21.15.173:0/2397938863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e006ac90 0x7ff8e0151090 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.114+0000 7ff8e5400640 1 -- 172.21.15.173:0/2397938863 >> 172.21.15.173:0/2397938863 conn(0x7ff8e0099a50 msgr2=0x7ff8e0158950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:24.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.114+0000 7ff8e5400640 1 -- 172.21.15.173:0/2397938863 shutdown_connections 2024-04-25T09:07:24.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.114+0000 7ff8e5400640 1 -- 172.21.15.173:0/2397938863 wait complete. 2024-04-25T09:07:24.121 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:07:24.121 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:24.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.270+0000 7f374fc00640 1 Processor -- start 2024-04-25T09:07:24.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.270+0000 7f374fc00640 1 -- start start 2024-04-25T09:07:24.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.270+0000 7f374fc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f37480b3e70 0x7f37480b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:24.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.270+0000 7f374fc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f37480aefa0 0x7f37480b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:24.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.270+0000 7f374fc00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37480b4790 con 0x7f374815edd0 2024-04-25T09:07:24.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.270+0000 7f374fc00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374806dd50 con 0x7f37480b3e70 2024-04-25T09:07:24.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.270+0000 7f374fc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374815f320 con 0x7f37480aefa0 2024-04-25T09:07:24.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.270+0000 7f374d200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f37480b3e70 0x7f37480b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:24.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.270+0000 7f374dc00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f374815edd0 0x7f37480b2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39244/0 (socket says 172.21.15.173:39244) 2024-04-25T09:07:24.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.270+0000 7f374d200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f37480b3e70 0x7f37480b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48558/0 (socket says 172.21.15.173:48558) 2024-04-25T09:07:24.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.270+0000 7f374dc00640 1 -- 172.21.15.173:0/3190384755 learned_addr learned my addr 172.21.15.173:0/3190384755 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:24.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.270+0000 7f3747e00640 1 --2- 172.21.15.173:0/3190384755 >> v2:172.21.15.194:3300/0 conn(0x7f37480aefa0 0x7f37480b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:24.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.270+0000 7f374d200640 1 -- 172.21.15.173:0/3190384755 >> v2:172.21.15.194:3300/0 conn(0x7f37480aefa0 msgr2=0x7f37480b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:24.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.270+0000 7f374d200640 1 --2- 172.21.15.173:0/3190384755 >> v2:172.21.15.194:3300/0 conn(0x7f37480aefa0 0x7f37480b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.270+0000 7f374d200640 1 -- 172.21.15.173:0/3190384755 >> v1:172.21.15.173:6789/0 conn(0x7f374815edd0 legacy=0x7f37480b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:24.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.274+0000 7f374d200640 1 -- 172.21.15.173:0/3190384755 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374806d420 con 0x7f37480b3e70 2024-04-25T09:07:24.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.274+0000 7f3747400640 1 -- 172.21.15.173:0/3190384755 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235995119 0 0) 0x7f37480b4790 con 0x7f374815edd0 2024-04-25T09:07:24.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.274+0000 7f374d200640 1 --2- 172.21.15.173:0/3190384755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37480b3e70 0x7f37480b4250 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f37480d0650 tx=0x7f373c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a03b7fb2c6ce9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:24.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.274+0000 7f3747400640 1 -- 172.21.15.173:0/3190384755 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c0a7070 con 0x7f37480b3e70 2024-04-25T09:07:24.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.274+0000 7f3747400640 1 -- 172.21.15.173:0/3190384755 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c0b0070 con 0x7f37480b3e70 2024-04-25T09:07:24.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.274+0000 7f3747400640 1 -- 172.21.15.173:0/3190384755 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c0ab890 con 0x7f37480b3e70 2024-04-25T09:07:24.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.274+0000 7f374fc00640 1 -- 172.21.15.173:0/3190384755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37480b3e70 msgr2=0x7f37480b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:24.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.274+0000 7f374fc00640 1 --2- 172.21.15.173:0/3190384755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37480b3e70 0x7f37480b4250 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f37480d0650 tx=0x7f373c01c450 comp rx=0 tx=0).stop 2024-04-25T09:07:24.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f374fc00640 1 -- 172.21.15.173:0/3190384755 shutdown_connections 2024-04-25T09:07:24.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f374fc00640 1 --2- 172.21.15.173:0/3190384755 >> v2:172.21.15.194:3300/0 conn(0x7f37480aefa0 0x7f37480b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f374fc00640 1 --2- 172.21.15.173:0/3190384755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37480b3e70 0x7f37480b4250 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f374fc00640 1 -- 172.21.15.173:0/3190384755 >> 172.21.15.173:0/3190384755 conn(0x7f374806ac90 msgr2=0x7f374806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:24.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f374fc00640 1 -- 172.21.15.173:0/3190384755 shutdown_connections 2024-04-25T09:07:24.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f374fc00640 1 -- 172.21.15.173:0/3190384755 wait complete. 2024-04-25T09:07:24.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f374fc00640 1 Processor -- start 2024-04-25T09:07:24.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f374fc00640 1 -- start start 2024-04-25T09:07:24.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f374fc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37480aefa0 0x7f374814bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:24.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f374fc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37480b3e70 0x7f3748148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:24.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f374fc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f374815edd0 0x7f374814e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:24.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f374fc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374806e1e0 con 0x7f37480b3e70 2024-04-25T09:07:24.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f374fc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374815aba0 con 0x7f37480aefa0 2024-04-25T09:07:24.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f374fc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374806e360 con 0x7f374815edd0 2024-04-25T09:07:24.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f3747e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37480b3e70 0x7f3748148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:24.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f3747e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37480b3e70 0x7f3748148d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48572/0 (socket says 172.21.15.173:48572) 2024-04-25T09:07:24.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f3747e00640 1 -- 172.21.15.173:0/893865590 learned_addr learned my addr 172.21.15.173:0/893865590 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:24.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f374d200640 1 --2- 172.21.15.173:0/893865590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37480aefa0 0x7f374814bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:24.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f374dc00640 1 --2- 172.21.15.173:0/893865590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f374815edd0 0x7f374814e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:24.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f3747e00640 1 -- 172.21.15.173:0/893865590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f374815edd0 msgr2=0x7f374814e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:24.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f3747e00640 1 --2- 172.21.15.173:0/893865590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f374815edd0 0x7f374814e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f3747e00640 1 -- 172.21.15.173:0/893865590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37480aefa0 msgr2=0x7f374814bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:24.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f3747e00640 1 --2- 172.21.15.173:0/893865590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37480aefa0 0x7f374814bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f3747e00640 1 -- 172.21.15.173:0/893865590 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3748149280 con 0x7f37480b3e70 2024-04-25T09:07:24.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f3747e00640 1 --2- 172.21.15.173:0/893865590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37480b3e70 0x7f3748148d40 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f373400d5f0 tx=0x7f373400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:24.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f3744c00640 1 -- 172.21.15.173:0/893865590 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37340125f0 con 0x7f37480b3e70 2024-04-25T09:07:24.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f3744c00640 1 -- 172.21.15.173:0/893865590 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3734019070 con 0x7f37480b3e70 2024-04-25T09:07:24.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f374fc00640 1 -- 172.21.15.173:0/893865590 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374814c0b0 con 0x7f37480b3e70 2024-04-25T09:07:24.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.278+0000 7f3744c00640 1 -- 172.21.15.173:0/893865590 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37340129b0 con 0x7f37480b3e70 2024-04-25T09:07:24.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.282+0000 7f374fc00640 1 -- 172.21.15.173:0/893865590 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374814c670 con 0x7f37480b3e70 2024-04-25T09:07:24.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.282+0000 7f374fc00640 1 -- 172.21.15.173:0/893865590 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3748073a40 con 0x7f37480b3e70 2024-04-25T09:07:24.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.282+0000 7f3744c00640 1 -- 172.21.15.173:0/893865590 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3734012b50 con 0x7f37480b3e70 2024-04-25T09:07:24.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.282+0000 7f3744c00640 1 --2- 172.21.15.173:0/893865590 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3728066f60 0x7f3728069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:24.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.282+0000 7f3744c00640 1 -- 172.21.15.173:0/893865590 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f3734085620 con 0x7f37480b3e70 2024-04-25T09:07:24.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.282+0000 7f374d200640 1 --2- 172.21.15.173:0/893865590 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3728066f60 0x7f3728069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:24.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.282+0000 7f374d200640 1 --2- 172.21.15.173:0/893865590 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3728066f60 0x7f3728069420 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f373c0af000 tx=0x7f373c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:24.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.286+0000 7f3744c00640 1 -- 172.21.15.173:0/893865590 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f37340563b0 con 0x7f37480b3e70 2024-04-25T09:07:24.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.474+0000 7f374fc00640 1 -- 172.21.15.173:0/893865590 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3748072210 con 0x7f37480b3e70 2024-04-25T09:07:24.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.474+0000 7f3744c00640 1 -- 172.21.15.173:0/893865590 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f3734055cb0 con 0x7f37480b3e70 2024-04-25T09:07:24.462 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:24.462 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":46,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/894026798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":894026798},{"type":"v1","addr":"172.21.15.194:6833","nonce":894026798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2000586494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2000586494},{"type":"v1","addr":"172.21.15.194:6835","nonce":2000586494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3382962588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3382962588},{"type":"v1","addr":"172.21.15.173:6837","nonce":3382962588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:50.132659+0000","modified":"2024-04-25T09:07:04.888384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6960":{"gid":6960,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.173:6836/4214702139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4214702139},{"type":"v1","addr":"172.21.15.173:6836","nonce":4214702139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:07:24.463 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 46 2024-04-25T09:07:24.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.478+0000 7f374fc00640 1 -- 172.21.15.173:0/893865590 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3728066f60 msgr2=0x7f3728069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:24.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.478+0000 7f374fc00640 1 --2- 172.21.15.173:0/893865590 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3728066f60 0x7f3728069420 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f373c0af000 tx=0x7f373c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:07:24.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.478+0000 7f374fc00640 1 -- 172.21.15.173:0/893865590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37480b3e70 msgr2=0x7f3748148d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:24.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.478+0000 7f374fc00640 1 --2- 172.21.15.173:0/893865590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37480b3e70 0x7f3748148d40 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f373400d5f0 tx=0x7f373400dab0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.478+0000 7f374fc00640 1 -- 172.21.15.173:0/893865590 shutdown_connections 2024-04-25T09:07:24.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.478+0000 7f374fc00640 1 --2- 172.21.15.173:0/893865590 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3728066f60 0x7f3728069420 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.478+0000 7f374fc00640 1 --2- 172.21.15.173:0/893865590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f374815edd0 0x7f374814e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.478+0000 7f374fc00640 1 --2- 172.21.15.173:0/893865590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37480b3e70 0x7f3748148d40 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.478+0000 7f374fc00640 1 --2- 172.21.15.173:0/893865590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37480aefa0 0x7f374814bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.478+0000 7f374fc00640 1 -- 172.21.15.173:0/893865590 >> 172.21.15.173:0/893865590 conn(0x7f374806ac90 msgr2=0x7f37480b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:24.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.478+0000 7f374fc00640 1 -- 172.21.15.173:0/893865590 shutdown_connections 2024-04-25T09:07:24.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.478+0000 7f374fc00640 1 -- 172.21.15.173:0/893865590 wait complete. 2024-04-25T09:07:24.485 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:24.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.630+0000 7f3bb2e00640 1 Processor -- start 2024-04-25T09:07:24.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.634+0000 7f3bb2e00640 1 -- start start 2024-04-25T09:07:24.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.634+0000 7f3bb2e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3bac145250 0x7f3bac15c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:24.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.634+0000 7f3bb2e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3bac0ccd30 0x7f3bac071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:24.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.634+0000 7f3bb2e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bac15cec0 con 0x7f3bac0cc8b0 2024-04-25T09:07:24.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.634+0000 7f3bb2e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bac06e7c0 con 0x7f3bac145250 2024-04-25T09:07:24.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.634+0000 7f3bb2e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bac06d720 con 0x7f3bac0ccd30 2024-04-25T09:07:24.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.634+0000 7f3babe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3bac145250 0x7f3bac15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:24.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.634+0000 7f3babe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3bac145250 0x7f3bac15c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48588/0 (socket says 172.21.15.173:48588) 2024-04-25T09:07:24.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.634+0000 7f3babe00640 1 -- 172.21.15.173:0/818620470 learned_addr learned my addr 172.21.15.173:0/818620470 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:24.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.634+0000 7f3bab400640 1 --1- 172.21.15.173:0/818620470 >> v1:172.21.15.173:6789/0 conn(0x7f3bac0cc8b0 0x7f3bac071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39260/0 (socket says 172.21.15.173:39260) 2024-04-25T09:07:24.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.634+0000 7f3bb0e00640 1 --2- 172.21.15.173:0/818620470 >> v2:172.21.15.194:3300/0 conn(0x7f3bac0ccd30 0x7f3bac071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:24.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.634+0000 7f3babe00640 1 -- 172.21.15.173:0/818620470 >> v2:172.21.15.194:3300/0 conn(0x7f3bac0ccd30 msgr2=0x7f3bac071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:24.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.634+0000 7f3babe00640 1 --2- 172.21.15.173:0/818620470 >> v2:172.21.15.194:3300/0 conn(0x7f3bac0ccd30 0x7f3bac071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.634+0000 7f3babe00640 1 -- 172.21.15.173:0/818620470 >> v1:172.21.15.173:6789/0 conn(0x7f3bac0cc8b0 legacy=0x7f3bac071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:24.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.634+0000 7f3babe00640 1 -- 172.21.15.173:0/818620470 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac06da00 con 0x7f3bac145250 2024-04-25T09:07:24.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.634+0000 7f3bb0e00640 1 --2- 172.21.15.173:0/818620470 >> v2:172.21.15.194:3300/0 conn(0x7f3bac0ccd30 0x7f3bac071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:24.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.638+0000 7f3babe00640 1 --2- 172.21.15.173:0/818620470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bac145250 0x7f3bac15c980 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f3bac06f4a0 tx=0x7f3b9c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c63b5787ab336 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:24.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.638+0000 7f3baaa00640 1 -- 172.21.15.173:0/818620470 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c0a5880 con 0x7f3bac145250 2024-04-25T09:07:24.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.638+0000 7f3baaa00640 1 -- 172.21.15.173:0/818620470 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9c0a5a20 con 0x7f3bac145250 2024-04-25T09:07:24.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.638+0000 7f3baaa00640 1 -- 172.21.15.173:0/818620470 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c0a5df0 con 0x7f3bac145250 2024-04-25T09:07:24.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.638+0000 7f3bb2e00640 1 -- 172.21.15.173:0/818620470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bac145250 msgr2=0x7f3bac15c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:24.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.638+0000 7f3bb2e00640 1 --2- 172.21.15.173:0/818620470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bac145250 0x7f3bac15c980 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f3bac06f4a0 tx=0x7f3b9c01c9c0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.638+0000 7f3bb2e00640 1 -- 172.21.15.173:0/818620470 shutdown_connections 2024-04-25T09:07:24.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.638+0000 7f3bb2e00640 1 --2- 172.21.15.173:0/818620470 >> v2:172.21.15.194:3300/0 conn(0x7f3bac0ccd30 0x7f3bac071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.638+0000 7f3bb2e00640 1 --2- 172.21.15.173:0/818620470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bac145250 0x7f3bac15c980 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.638+0000 7f3bb2e00640 1 -- 172.21.15.173:0/818620470 >> 172.21.15.173:0/818620470 conn(0x7f3bac06ac90 msgr2=0x7f3bac06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:24.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.638+0000 7f3bb2e00640 1 -- 172.21.15.173:0/818620470 shutdown_connections 2024-04-25T09:07:24.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.638+0000 7f3bb2e00640 1 -- 172.21.15.173:0/818620470 wait complete. 2024-04-25T09:07:24.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.638+0000 7f3bb2e00640 1 Processor -- start 2024-04-25T09:07:24.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.638+0000 7f3bb2e00640 1 -- start start 2024-04-25T09:07:24.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bb2e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bac0cc8b0 0x7f3bac15b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:24.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bb2e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bac0ccd30 0x7f3bac141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:24.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bb2e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bac145250 0x7f3bac158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:24.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bb2e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac06ef80 con 0x7f3bac145250 2024-04-25T09:07:24.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bb2e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac145630 con 0x7f3bac0ccd30 2024-04-25T09:07:24.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bb2e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac0cd140 con 0x7f3bac0cc8b0 2024-04-25T09:07:24.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bb0e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bac145250 0x7f3bac158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:24.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bb0e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bac145250 0x7f3bac158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48596/0 (socket says 172.21.15.173:48596) 2024-04-25T09:07:24.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bb0e00640 1 -- 172.21.15.173:0/1408147338 learned_addr learned my addr 172.21.15.173:0/1408147338 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:24.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bab400640 1 --2- 172.21.15.173:0/1408147338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bac0ccd30 0x7f3bac141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:24.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3babe00640 1 --2- 172.21.15.173:0/1408147338 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bac0cc8b0 0x7f3bac15b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:24.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bb0e00640 1 -- 172.21.15.173:0/1408147338 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bac0cc8b0 msgr2=0x7f3bac15b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:24.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bb0e00640 1 --2- 172.21.15.173:0/1408147338 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bac0cc8b0 0x7f3bac15b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bb0e00640 1 -- 172.21.15.173:0/1408147338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bac0ccd30 msgr2=0x7f3bac141b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:24.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bb0e00640 1 --2- 172.21.15.173:0/1408147338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bac0ccd30 0x7f3bac141b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bb0e00640 1 -- 172.21.15.173:0/1408147338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac15a2c0 con 0x7f3bac145250 2024-04-25T09:07:24.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bb0e00640 1 --2- 172.21.15.173:0/1408147338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bac145250 0x7f3bac158860 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400c7f0 tx=0x7f3ba400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:24.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3ba3e00640 1 -- 172.21.15.173:0/1408147338 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4015070 con 0x7f3bac145250 2024-04-25T09:07:24.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3ba3e00640 1 -- 172.21.15.173:0/1408147338 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba4007860 con 0x7f3bac145250 2024-04-25T09:07:24.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3ba3e00640 1 -- 172.21.15.173:0/1408147338 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4007c50 con 0x7f3bac145250 2024-04-25T09:07:24.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bb2e00640 1 -- 172.21.15.173:0/1408147338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bac15a5a0 con 0x7f3bac145250 2024-04-25T09:07:24.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bb2e00640 1 -- 172.21.15.173:0/1408147338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bac15ab60 con 0x7f3bac145250 2024-04-25T09:07:24.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3bb2e00640 1 -- 172.21.15.173:0/1408147338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bac073a40 con 0x7f3bac145250 2024-04-25T09:07:24.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.642+0000 7f3ba3e00640 1 -- 172.21.15.173:0/1408147338 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3ba4018070 con 0x7f3bac145250 2024-04-25T09:07:24.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.646+0000 7f3ba3e00640 1 --2- 172.21.15.173:0/1408147338 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b8c066f60 0x7f3b8c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:24.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.646+0000 7f3ba3e00640 1 -- 172.21.15.173:0/1408147338 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f3ba4085360 con 0x7f3bac145250 2024-04-25T09:07:24.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.646+0000 7f3babe00640 1 --2- 172.21.15.173:0/1408147338 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b8c066f60 0x7f3b8c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:24.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.646+0000 7f3babe00640 1 --2- 172.21.15.173:0/1408147338 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b8c066f60 0x7f3b8c069420 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0ae000 tx=0x7f3b9c0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:24.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.650+0000 7f3ba3e00640 1 -- 172.21.15.173:0/1408147338 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3ba4055aa0 con 0x7f3bac145250 2024-04-25T09:07:24.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.834+0000 7f3bb2e00640 1 -- 172.21.15.173:0/1408147338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bac0cbb10 con 0x7f3bac145250 2024-04-25T09:07:24.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.834+0000 7f3ba3e00640 1 -- 172.21.15.173:0/1408147338 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f3ba4059b40 con 0x7f3bac145250 2024-04-25T09:07:24.822 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:24.822 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":46,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/894026798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":894026798},{"type":"v1","addr":"172.21.15.194:6833","nonce":894026798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2000586494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2000586494},{"type":"v1","addr":"172.21.15.194:6835","nonce":2000586494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3382962588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3382962588},{"type":"v1","addr":"172.21.15.173:6837","nonce":3382962588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:50.132659+0000","modified":"2024-04-25T09:07:04.888384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6960":{"gid":6960,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.173:6836/4214702139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4214702139},{"type":"v1","addr":"172.21.15.173:6836","nonce":4214702139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:07:24.823 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 46 2024-04-25T09:07:24.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.838+0000 7f3bb2e00640 1 -- 172.21.15.173:0/1408147338 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b8c066f60 msgr2=0x7f3b8c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:24.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.838+0000 7f3bb2e00640 1 --2- 172.21.15.173:0/1408147338 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b8c066f60 0x7f3b8c069420 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0ae000 tx=0x7f3b9c0a7070 comp rx=0 tx=0).stop 2024-04-25T09:07:24.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.838+0000 7f3bb2e00640 1 -- 172.21.15.173:0/1408147338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bac145250 msgr2=0x7f3bac158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:24.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.838+0000 7f3bb2e00640 1 --2- 172.21.15.173:0/1408147338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bac145250 0x7f3bac158860 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400c7f0 tx=0x7f3ba400ccb0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.838+0000 7f3bb2e00640 1 -- 172.21.15.173:0/1408147338 shutdown_connections 2024-04-25T09:07:24.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.838+0000 7f3bb2e00640 1 --2- 172.21.15.173:0/1408147338 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b8c066f60 0x7f3b8c069420 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.838+0000 7f3bb2e00640 1 --2- 172.21.15.173:0/1408147338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bac145250 0x7f3bac158860 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.838+0000 7f3bb2e00640 1 --2- 172.21.15.173:0/1408147338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bac0ccd30 0x7f3bac141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.838+0000 7f3bb2e00640 1 --2- 172.21.15.173:0/1408147338 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bac0cc8b0 0x7f3bac15b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.838+0000 7f3bb2e00640 1 -- 172.21.15.173:0/1408147338 >> 172.21.15.173:0/1408147338 conn(0x7f3bac06ac90 msgr2=0x7f3bac0ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:24.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.838+0000 7f3bb2e00640 1 -- 172.21.15.173:0/1408147338 shutdown_connections 2024-04-25T09:07:24.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.838+0000 7f3bb2e00640 1 -- 172.21.15.173:0/1408147338 wait complete. 2024-04-25T09:07:24.843 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:24.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.994+0000 7f545d200640 1 Processor -- start 2024-04-25T09:07:24.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.994+0000 7f545d200640 1 -- start start 2024-04-25T09:07:24.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.994+0000 7f545d200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f545815a680 0x7f54580b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:24.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.994+0000 7f545d200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f545815aa60 0x7f545806fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:24.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.994+0000 7f545d200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54580b4890 con 0x7f545815b770 2024-04-25T09:07:24.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.994+0000 7f545d200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5458070390 con 0x7f545815aa60 2024-04-25T09:07:24.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.994+0000 7f545d200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54580b42d0 con 0x7f545815a680 2024-04-25T09:07:24.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.994+0000 7f544ea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f545815aa60 0x7f545806fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:24.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.994+0000 7f5457e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f545815b770 0x7f545806bda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39270/0 (socket says 172.21.15.173:39270) 2024-04-25T09:07:24.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.994+0000 7f5457e00640 1 -- 172.21.15.173:0/371850882 learned_addr learned my addr 172.21.15.173:0/371850882 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:24.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.994+0000 7f544ea00640 1 -- 172.21.15.173:0/371850882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f545815a680 msgr2=0x7f54580b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:24.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.994+0000 7f5457400640 1 --2- 172.21.15.173:0/371850882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f545815a680 0x7f54580b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:24.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.994+0000 7f544ea00640 1 --2- 172.21.15.173:0/371850882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f545815a680 0x7f54580b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.994+0000 7f544ea00640 1 -- 172.21.15.173:0/371850882 >> v1:172.21.15.173:6789/0 conn(0x7f545815b770 legacy=0x7f545806bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:24.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.994+0000 7f544ea00640 1 -- 172.21.15.173:0/371850882 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54580b45b0 con 0x7f545815aa60 2024-04-25T09:07:24.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.994+0000 7f5456a00640 1 -- 172.21.15.173:0/371850882 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115387372 0 0) 0x7f54580b4890 con 0x7f545815b770 2024-04-25T09:07:24.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.994+0000 7f5457400640 1 --2- 172.21.15.173:0/371850882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f545815a680 0x7f54580b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:24.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.998+0000 7f544ea00640 1 --2- 172.21.15.173:0/371850882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f545815aa60 0x7f545806fe50 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f54400097c0 tx=0x7f544001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b70a5f9137f046c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:24.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.998+0000 7f5456a00640 1 -- 172.21.15.173:0/371850882 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54400b0070 con 0x7f545815aa60 2024-04-25T09:07:24.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.998+0000 7f5456a00640 1 -- 172.21.15.173:0/371850882 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54400ab600 con 0x7f545815aa60 2024-04-25T09:07:24.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.998+0000 7f5456a00640 1 -- 172.21.15.173:0/371850882 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54400ab9d0 con 0x7f545815aa60 2024-04-25T09:07:24.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.998+0000 7f545d200640 1 -- 172.21.15.173:0/371850882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f545815aa60 msgr2=0x7f545806fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:24.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.998+0000 7f545d200640 1 --2- 172.21.15.173:0/371850882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f545815aa60 0x7f545806fe50 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f54400097c0 tx=0x7f544001c410 comp rx=0 tx=0).stop 2024-04-25T09:07:24.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.998+0000 7f545d200640 1 -- 172.21.15.173:0/371850882 shutdown_connections 2024-04-25T09:07:24.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.998+0000 7f545d200640 1 --2- 172.21.15.173:0/371850882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f545815aa60 0x7f545806fe50 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.998+0000 7f545d200640 1 --2- 172.21.15.173:0/371850882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f545815a680 0x7f54580b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.998+0000 7f545d200640 1 -- 172.21.15.173:0/371850882 >> 172.21.15.173:0/371850882 conn(0x7f54580cc800 msgr2=0x7f54580ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:24.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.998+0000 7f545d200640 1 -- 172.21.15.173:0/371850882 shutdown_connections 2024-04-25T09:07:24.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:24.998+0000 7f545d200640 1 -- 172.21.15.173:0/371850882 wait complete. 2024-04-25T09:07:24.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f545d200640 1 Processor -- start 2024-04-25T09:07:24.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f545d200640 1 -- start start 2024-04-25T09:07:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f545d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f545815a680 0x7f5458141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f545d200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f545815aa60 0x7f545813ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f545d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f545815b770 0x7f545813e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f545d200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54580ae020 con 0x7f545815b770 2024-04-25T09:07:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f545d200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545806c700 con 0x7f545815a680 2024-04-25T09:07:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f545d200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54580ae1a0 con 0x7f545815aa60 2024-04-25T09:07:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f5457e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f545815b770 0x7f545813e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f5457e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f545815b770 0x7f545813e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48622/0 (socket says 172.21.15.173:48622) 2024-04-25T09:07:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f5457e00640 1 -- 172.21.15.173:0/1603122232 learned_addr learned my addr 172.21.15.173:0/1603122232 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f544ea00640 1 --2- 172.21.15.173:0/1603122232 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f545815aa60 0x7f545813ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f5457400640 1 --2- 172.21.15.173:0/1603122232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f545815a680 0x7f5458141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f5457e00640 1 -- 172.21.15.173:0/1603122232 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f545815aa60 msgr2=0x7f545813ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f5457e00640 1 --2- 172.21.15.173:0/1603122232 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f545815aa60 0x7f545813ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f5457e00640 1 -- 172.21.15.173:0/1603122232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f545815a680 msgr2=0x7f5458141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f5457e00640 1 --2- 172.21.15.173:0/1603122232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f545815a680 0x7f5458141500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f5457e00640 1 -- 172.21.15.173:0/1603122232 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5458141a40 con 0x7f545815b770 2024-04-25T09:07:24.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f5457e00640 1 --2- 172.21.15.173:0/1603122232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f545815b770 0x7f545813e0f0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f545000c700 tx=0x7f545000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f544fe00640 1 -- 172.21.15.173:0/1603122232 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450018070 con 0x7f545815b770 2024-04-25T09:07:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f544fe00640 1 -- 172.21.15.173:0/1603122232 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545000ce10 con 0x7f545815b770 2024-04-25T09:07:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f544fe00640 1 -- 172.21.15.173:0/1603122232 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545000a860 con 0x7f545815b770 2024-04-25T09:07:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f545d200640 1 -- 172.21.15.173:0/1603122232 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54581517a0 con 0x7f545815b770 2024-04-25T09:07:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.002+0000 7f545d200640 1 -- 172.21.15.173:0/1603122232 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5458153720 con 0x7f545815b770 2024-04-25T09:07:24.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.006+0000 7f545d200640 1 -- 172.21.15.173:0/1603122232 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5458073a40 con 0x7f545815b770 2024-04-25T09:07:24.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.006+0000 7f544fe00640 1 -- 172.21.15.173:0/1603122232 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f545000aa00 con 0x7f545815b770 2024-04-25T09:07:24.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.006+0000 7f544fe00640 1 --2- 172.21.15.173:0/1603122232 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5434066f60 0x7f5434069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:24.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.006+0000 7f544fe00640 1 -- 172.21.15.173:0/1603122232 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f54500847f0 con 0x7f545815b770 2024-04-25T09:07:24.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.006+0000 7f5457400640 1 --2- 172.21.15.173:0/1603122232 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5434066f60 0x7f5434069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:24.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.006+0000 7f5457400640 1 --2- 172.21.15.173:0/1603122232 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5434066f60 0x7f5434069420 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f544800a9a0 tx=0x7f5448008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:24.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.010+0000 7f544fe00640 1 -- 172.21.15.173:0/1603122232 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5458141a40 con 0x7f545815b770 2024-04-25T09:07:25.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.170+0000 7f545d200640 1 -- 172.21.15.173:0/1603122232 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54580af420 con 0x7f545815b770 2024-04-25T09:07:25.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.170+0000 7f544fe00640 1 -- 172.21.15.173:0/1603122232 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+17073 (secure 0 0 0) 0x7f5450055610 con 0x7f545815b770 2024-04-25T09:07:25.158 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:25.158 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":73,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:07:01.867759+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:48.493059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:49.133352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:6836/962695208":"2024-04-26T09:07:01.867727+0000","172.21.15.173:6834/962695208":"2024-04-26T09:07:01.867727+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:25.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.170+0000 7f545d200640 1 -- 172.21.15.173:0/1603122232 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5434066f60 msgr2=0x7f5434069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:25.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.170+0000 7f545d200640 1 --2- 172.21.15.173:0/1603122232 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5434066f60 0x7f5434069420 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f544800a9a0 tx=0x7f5448008040 comp rx=0 tx=0).stop 2024-04-25T09:07:25.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.170+0000 7f545d200640 1 -- 172.21.15.173:0/1603122232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f545815b770 msgr2=0x7f545813e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:25.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.170+0000 7f545d200640 1 --2- 172.21.15.173:0/1603122232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f545815b770 0x7f545813e0f0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f545000c700 tx=0x7f545000cbc0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.174+0000 7f545d200640 1 -- 172.21.15.173:0/1603122232 shutdown_connections 2024-04-25T09:07:25.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.174+0000 7f545d200640 1 --2- 172.21.15.173:0/1603122232 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5434066f60 0x7f5434069420 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.174+0000 7f545d200640 1 --2- 172.21.15.173:0/1603122232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f545815b770 0x7f545813e0f0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.174+0000 7f545d200640 1 --2- 172.21.15.173:0/1603122232 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f545815aa60 0x7f545813ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.174+0000 7f545d200640 1 --2- 172.21.15.173:0/1603122232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f545815a680 0x7f5458141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.174+0000 7f545d200640 1 -- 172.21.15.173:0/1603122232 >> 172.21.15.173:0/1603122232 conn(0x7f54580cc800 msgr2=0x7f54580ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:25.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.174+0000 7f545d200640 1 -- 172.21.15.173:0/1603122232 shutdown_connections 2024-04-25T09:07:25.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.174+0000 7f545d200640 1 -- 172.21.15.173:0/1603122232 wait complete. 2024-04-25T09:07:25.179 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:07:25.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.326+0000 7f23d0600640 1 Processor -- start 2024-04-25T09:07:25.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.326+0000 7f23d0600640 1 -- start start 2024-04-25T09:07:25.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.330+0000 7f23d0600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23c80b3fe0 0x7f23c80b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:25.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.330+0000 7f23d0600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f23c80cc260 0x7f23c80cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:25.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.330+0000 7f23d0600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c806d4b0 con 0x7f23c8145290 2024-04-25T09:07:25.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.330+0000 7f23d0600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c806d790 con 0x7f23c80cc260 2024-04-25T09:07:25.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.330+0000 7f23d0600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c806da70 con 0x7f23c80b3fe0 2024-04-25T09:07:25.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.330+0000 7f23cdc00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f23c8145290 0x7f23c815c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39284/0 (socket says 172.21.15.173:39284) 2024-04-25T09:07:25.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.330+0000 7f23cdc00640 1 -- 172.21.15.173:0/2120537514 learned_addr learned my addr 172.21.15.173:0/2120537514 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:25.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.330+0000 7f23cd200640 1 --2- 172.21.15.173:0/2120537514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23c80b3fe0 0x7f23c80b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:25.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.330+0000 7f23ce600640 1 --2- 172.21.15.173:0/2120537514 >> v2:172.21.15.194:3300/0 conn(0x7f23c80cc260 0x7f23c80cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:25.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.330+0000 7f23c7e00640 1 -- 172.21.15.173:0/2120537514 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850730180 0 0) 0x7f23c806d4b0 con 0x7f23c8145290 2024-04-25T09:07:25.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.330+0000 7f23c7e00640 1 -- 172.21.15.173:0/2120537514 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23b0003530 con 0x7f23c8145290 2024-04-25T09:07:25.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.330+0000 7f23cd200640 1 -- 172.21.15.173:0/2120537514 >> v2:172.21.15.194:3300/0 conn(0x7f23c80cc260 msgr2=0x7f23c80cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:25.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.330+0000 7f23cd200640 1 --2- 172.21.15.173:0/2120537514 >> v2:172.21.15.194:3300/0 conn(0x7f23c80cc260 0x7f23c80cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.330+0000 7f23cd200640 1 -- 172.21.15.173:0/2120537514 >> v1:172.21.15.173:6789/0 conn(0x7f23c8145290 legacy=0x7f23c815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:25.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.330+0000 7f23cd200640 1 -- 172.21.15.173:0/2120537514 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c806dd50 con 0x7f23c80b3fe0 2024-04-25T09:07:25.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23cd200640 1 --2- 172.21.15.173:0/2120537514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23c80b3fe0 0x7f23c80b4420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f23b40097c0 tx=0x7f23b401c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47b6700896120c1d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:25.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23c7e00640 1 -- 172.21.15.173:0/2120537514 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b40b0070 con 0x7f23c80b3fe0 2024-04-25T09:07:25.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23c7e00640 1 -- 172.21.15.173:0/2120537514 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b40ab600 con 0x7f23c80b3fe0 2024-04-25T09:07:25.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23c7e00640 1 -- 172.21.15.173:0/2120537514 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b40ab9d0 con 0x7f23c80b3fe0 2024-04-25T09:07:25.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23d0600640 1 -- 172.21.15.173:0/2120537514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23c80b3fe0 msgr2=0x7f23c80b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:25.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23d0600640 1 --2- 172.21.15.173:0/2120537514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23c80b3fe0 0x7f23c80b4420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f23b40097c0 tx=0x7f23b401c380 comp rx=0 tx=0).stop 2024-04-25T09:07:25.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23d0600640 1 -- 172.21.15.173:0/2120537514 shutdown_connections 2024-04-25T09:07:25.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23d0600640 1 --2- 172.21.15.173:0/2120537514 >> v2:172.21.15.194:3300/0 conn(0x7f23c80cc260 0x7f23c80cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23d0600640 1 --2- 172.21.15.173:0/2120537514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23c80b3fe0 0x7f23c80b4420 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23d0600640 1 -- 172.21.15.173:0/2120537514 >> 172.21.15.173:0/2120537514 conn(0x7f23c806ac90 msgr2=0x7f23c806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:25.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23d0600640 1 -- 172.21.15.173:0/2120537514 shutdown_connections 2024-04-25T09:07:25.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23d0600640 1 -- 172.21.15.173:0/2120537514 wait complete. 2024-04-25T09:07:25.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23d0600640 1 Processor -- start 2024-04-25T09:07:25.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23d0600640 1 -- start start 2024-04-25T09:07:25.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23d0600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23c80b3fe0 0x7f23c8143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:25.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23d0600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23c80cc260 0x7f23c813d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:25.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23d0600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23c8145290 0x7f23c813d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:25.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23d0600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c806ed60 con 0x7f23c80b3fe0 2024-04-25T09:07:25.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23d0600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c806eee0 con 0x7f23c80cc260 2024-04-25T09:07:25.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23d0600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c806f060 con 0x7f23c8145290 2024-04-25T09:07:25.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23cdc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23c80b3fe0 0x7f23c8143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:25.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23cdc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23c80b3fe0 0x7f23c8143780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48630/0 (socket says 172.21.15.173:48630) 2024-04-25T09:07:25.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.334+0000 7f23cdc00640 1 -- 172.21.15.173:0/2632404394 learned_addr learned my addr 172.21.15.173:0/2632404394 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:25.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.338+0000 7f23cd200640 1 --2- 172.21.15.173:0/2632404394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23c80cc260 0x7f23c813d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:25.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.338+0000 7f23ce600640 1 --2- 172.21.15.173:0/2632404394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23c8145290 0x7f23c813d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:25.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.338+0000 7f23cdc00640 1 -- 172.21.15.173:0/2632404394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23c8145290 msgr2=0x7f23c813d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:25.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.338+0000 7f23cdc00640 1 --2- 172.21.15.173:0/2632404394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23c8145290 0x7f23c813d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.338+0000 7f23cdc00640 1 -- 172.21.15.173:0/2632404394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23c80cc260 msgr2=0x7f23c813d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:25.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.338+0000 7f23cdc00640 1 --2- 172.21.15.173:0/2632404394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23c80cc260 0x7f23c813d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.338+0000 7f23cdc00640 1 -- 172.21.15.173:0/2632404394 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c81426e0 con 0x7f23c80b3fe0 2024-04-25T09:07:25.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.338+0000 7f23cdc00640 1 --2- 172.21.15.173:0/2632404394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23c80b3fe0 0x7f23c8143780 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f23bc00cb40 tx=0x7f23bc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:25.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.338+0000 7f23c5600640 1 -- 172.21.15.173:0/2632404394 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc017070 con 0x7f23c80b3fe0 2024-04-25T09:07:25.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.338+0000 7f23c5600640 1 -- 172.21.15.173:0/2632404394 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23bc00aca0 con 0x7f23c80b3fe0 2024-04-25T09:07:25.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.338+0000 7f23c5600640 1 -- 172.21.15.173:0/2632404394 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc012620 con 0x7f23c80b3fe0 2024-04-25T09:07:25.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.338+0000 7f23d0600640 1 -- 172.21.15.173:0/2632404394 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c81429c0 con 0x7f23c80b3fe0 2024-04-25T09:07:25.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.338+0000 7f23d0600640 1 -- 172.21.15.173:0/2632404394 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c8142f80 con 0x7f23c80b3fe0 2024-04-25T09:07:25.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.338+0000 7f23d0600640 1 -- 172.21.15.173:0/2632404394 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c8073ab0 con 0x7f23c80b3fe0 2024-04-25T09:07:25.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.338+0000 7f23c5600640 1 -- 172.21.15.173:0/2632404394 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f23bc01a070 con 0x7f23c80b3fe0 2024-04-25T09:07:25.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.338+0000 7f23c5600640 1 --2- 172.21.15.173:0/2632404394 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f23a8066f60 0x7f23a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:25.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.338+0000 7f23c5600640 1 -- 172.21.15.173:0/2632404394 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f23bc084fe0 con 0x7f23c80b3fe0 2024-04-25T09:07:25.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.338+0000 7f23cd200640 1 --2- 172.21.15.173:0/2632404394 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f23a8066f60 0x7f23a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:25.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.342+0000 7f23cd200640 1 --2- 172.21.15.173:0/2632404394 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f23a8066f60 0x7f23a8069420 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f23b40ad000 tx=0x7f23b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:25.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.342+0000 7f23c5600640 1 -- 172.21.15.173:0/2632404394 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f23bc055740 con 0x7f23c80b3fe0 2024-04-25T09:07:25.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.530+0000 7f23d0600640 1 -- 172.21.15.173:0/2632404394 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f23c806c300 con 0x7f23c80b3fe0 2024-04-25T09:07:25.518 INFO:tasks.ceph.mon.a.smithi173.stderr:2024-04-25T09:07:25.530+0000 7f537be00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:07:25.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.534+0000 7f23c5600640 1 -- 172.21.15.173:0/2632404394 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) v1 ==== 161+0+0 (secure 0 0 0) 0x7f23bc0597e0 con 0x7f23c80b3fe0 2024-04-25T09:07:25.520 INFO:teuthology.orchestra.run.smithi173.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:07:25.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.534+0000 7f23d0600640 1 -- 172.21.15.173:0/2632404394 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f23a8066f60 msgr2=0x7f23a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:25.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.534+0000 7f23d0600640 1 --2- 172.21.15.173:0/2632404394 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f23a8066f60 0x7f23a8069420 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f23b40ad000 tx=0x7f23b4008040 comp rx=0 tx=0).stop 2024-04-25T09:07:25.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.534+0000 7f23d0600640 1 -- 172.21.15.173:0/2632404394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23c80b3fe0 msgr2=0x7f23c8143780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:25.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.534+0000 7f23d0600640 1 --2- 172.21.15.173:0/2632404394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23c80b3fe0 0x7f23c8143780 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f23bc00cb40 tx=0x7f23bc00a060 comp rx=0 tx=0).stop 2024-04-25T09:07:25.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.534+0000 7f23d0600640 1 -- 172.21.15.173:0/2632404394 shutdown_connections 2024-04-25T09:07:25.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.534+0000 7f23d0600640 1 --2- 172.21.15.173:0/2632404394 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f23a8066f60 0x7f23a8069420 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.534+0000 7f23d0600640 1 --2- 172.21.15.173:0/2632404394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23c8145290 0x7f23c813d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.534+0000 7f23d0600640 1 --2- 172.21.15.173:0/2632404394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23c80cc260 0x7f23c813d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.534+0000 7f23d0600640 1 --2- 172.21.15.173:0/2632404394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23c80b3fe0 0x7f23c8143780 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.534+0000 7f23d0600640 1 -- 172.21.15.173:0/2632404394 >> 172.21.15.173:0/2632404394 conn(0x7f23c806ac90 msgr2=0x7f23c80b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:25.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.534+0000 7f23d0600640 1 -- 172.21.15.173:0/2632404394 shutdown_connections 2024-04-25T09:07:25.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.534+0000 7f23d0600640 1 -- 172.21.15.173:0/2632404394 wait complete. 2024-04-25T09:07:25.544 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:07:25.576 INFO:tasks.ceph.mds.c.smithi173.stdout:starting mds.c at 2024-04-25T09:07:25.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.698+0000 7fe4ed400640 1 Processor -- start 2024-04-25T09:07:25.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.698+0000 7fe4ed400640 1 -- start start 2024-04-25T09:07:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.698+0000 7fe4ed400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe4e80aeb90 0x7fe4e80cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.698+0000 7fe4ed400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4e80aef70 0x7fe4e80cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.698+0000 7fe4ed400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e8071570 con 0x7fe4e80cdba0 2024-04-25T09:07:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.698+0000 7fe4ed400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e8071320 con 0x7fe4e80aeb90 2024-04-25T09:07:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.698+0000 7fe4ed400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e8072330 con 0x7fe4e80aef70 2024-04-25T09:07:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.698+0000 7fe4e6800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe4e80aeb90 0x7fe4e80cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.698+0000 7fe4e6800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe4e80aeb90 0x7fe4e80cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48660/0 (socket says 172.21.15.173:48660) 2024-04-25T09:07:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.698+0000 7fe4e6800640 1 -- 172.21.15.173:0/923827100 learned_addr learned my addr 172.21.15.173:0/923827100 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:25.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.698+0000 7fe4e7200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe4e80cdba0 0x7fe4e80ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39294/0 (socket says 172.21.15.173:39294) 2024-04-25T09:07:25.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.698+0000 7fe4e5e00640 1 --2- 172.21.15.173:0/923827100 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4e80aef70 0x7fe4e80cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:25.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.698+0000 7fe4e6800640 1 -- 172.21.15.173:0/923827100 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4e80aef70 msgr2=0x7fe4e80cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:25.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.698+0000 7fe4e6800640 1 --2- 172.21.15.173:0/923827100 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4e80aef70 0x7fe4e80cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.698+0000 7fe4e6800640 1 -- 172.21.15.173:0/923827100 >> v1:172.21.15.173:6789/0 conn(0x7fe4e80cdba0 legacy=0x7fe4e80ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:25.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.698+0000 7fe4e6800640 1 -- 172.21.15.173:0/923827100 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e8071850 con 0x7fe4e80aeb90 2024-04-25T09:07:25.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.698+0000 7fe4e5400640 1 -- 172.21.15.173:0/923827100 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586099047 0 0) 0x7fe4e8071570 con 0x7fe4e80cdba0 2024-04-25T09:07:25.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.702+0000 7fe4e6800640 1 --2- 172.21.15.173:0/923827100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4e80aeb90 0x7fe4e80cc0d0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009870 tx=0x7fe4d801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76e208ba080384a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:25.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.702+0000 7fe4e5400640 1 -- 172.21.15.173:0/923827100 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d80b1070 con 0x7fe4e80aeb90 2024-04-25T09:07:25.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.702+0000 7fe4e5400640 1 -- 172.21.15.173:0/923827100 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d80ac600 con 0x7fe4e80aeb90 2024-04-25T09:07:25.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.702+0000 7fe4e5400640 1 -- 172.21.15.173:0/923827100 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d80ac9d0 con 0x7fe4e80aeb90 2024-04-25T09:07:25.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.702+0000 7fe4ed400640 1 -- 172.21.15.173:0/923827100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4e80aeb90 msgr2=0x7fe4e80cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:25.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.702+0000 7fe4ed400640 1 --2- 172.21.15.173:0/923827100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4e80aeb90 0x7fe4e80cc0d0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009870 tx=0x7fe4d801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.702+0000 7fe4ed400640 1 -- 172.21.15.173:0/923827100 shutdown_connections 2024-04-25T09:07:25.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.702+0000 7fe4ed400640 1 --2- 172.21.15.173:0/923827100 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4e80aef70 0x7fe4e80cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.702+0000 7fe4ed400640 1 --2- 172.21.15.173:0/923827100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4e80aeb90 0x7fe4e80cc0d0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.702+0000 7fe4ed400640 1 -- 172.21.15.173:0/923827100 >> 172.21.15.173:0/923827100 conn(0x7fe4e806ac90 msgr2=0x7fe4e806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:25.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.702+0000 7fe4ed400640 1 -- 172.21.15.173:0/923827100 shutdown_connections 2024-04-25T09:07:25.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.702+0000 7fe4ed400640 1 -- 172.21.15.173:0/923827100 wait complete. 2024-04-25T09:07:25.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4ed400640 1 Processor -- start 2024-04-25T09:07:25.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4ed400640 1 -- start start 2024-04-25T09:07:25.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4ed400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4e80aeb90 0x7fe4e8143050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:25.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4ed400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4e80aef70 0x7fe4e8156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:25.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4ed400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e80cdba0 0x7fe4e81680d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:25.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4ed400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e815bb30 con 0x7fe4e80aef70 2024-04-25T09:07:25.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4ed400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e815b9b0 con 0x7fe4e80cdba0 2024-04-25T09:07:25.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4ed400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e815bcb0 con 0x7fe4e80aeb90 2024-04-25T09:07:25.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4e5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4e80aef70 0x7fe4e8156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:25.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4e5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4e80aef70 0x7fe4e8156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48662/0 (socket says 172.21.15.173:48662) 2024-04-25T09:07:25.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4e5e00640 1 -- 172.21.15.173:0/459396896 learned_addr learned my addr 172.21.15.173:0/459396896 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:25.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4e5e00640 1 -- 172.21.15.173:0/459396896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4e80aeb90 msgr2=0x7fe4e8143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:25.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4e6800640 1 --2- 172.21.15.173:0/459396896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4e80aeb90 0x7fe4e8143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:25.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4e7200640 1 --2- 172.21.15.173:0/459396896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e80cdba0 0x7fe4e81680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:25.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4e5e00640 1 --2- 172.21.15.173:0/459396896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4e80aeb90 0x7fe4e8143050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4e5e00640 1 -- 172.21.15.173:0/459396896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e80cdba0 msgr2=0x7fe4e81680d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:25.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4e5e00640 1 --2- 172.21.15.173:0/459396896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e80cdba0 0x7fe4e81680d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:25.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4e5e00640 1 -- 172.21.15.173:0/459396896 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e80b2730 con 0x7fe4e80aef70 2024-04-25T09:07:25.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4e6800640 1 --2- 172.21.15.173:0/459396896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4e80aeb90 0x7fe4e8143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:25.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4e7200640 1 --2- 172.21.15.173:0/459396896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e80cdba0 0x7fe4e81680d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:25.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4e5e00640 1 --2- 172.21.15.173:0/459396896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4e80aef70 0x7fe4e8156000 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400d800 tx=0x7fe4d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:25.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4dea00640 1 -- 172.21.15.173:0/459396896 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d400b6c0 con 0x7fe4e80aef70 2024-04-25T09:07:25.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4dea00640 1 -- 172.21.15.173:0/459396896 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d4019070 con 0x7fe4e80aef70 2024-04-25T09:07:25.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4dea00640 1 -- 172.21.15.173:0/459396896 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d400baa0 con 0x7fe4e80aef70 2024-04-25T09:07:25.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4ed400640 1 -- 172.21.15.173:0/459396896 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e8156540 con 0x7fe4e80aef70 2024-04-25T09:07:25.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4ed400640 1 -- 172.21.15.173:0/459396896 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e8156aa0 con 0x7fe4e80aef70 2024-04-25T09:07:25.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.706+0000 7fe4ed400640 1 -- 172.21.15.173:0/459396896 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e8073ab0 con 0x7fe4e80aef70 2024-04-25T09:07:25.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.710+0000 7fe4dea00640 1 -- 172.21.15.173:0/459396896 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe4d400bc40 con 0x7fe4e80aef70 2024-04-25T09:07:25.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.710+0000 7fe4dea00640 1 --2- 172.21.15.173:0/459396896 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe4c8066f60 0x7fe4c8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:25.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.710+0000 7fe4dea00640 1 -- 172.21.15.173:0/459396896 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fe4d4085770 con 0x7fe4e80aef70 2024-04-25T09:07:25.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.710+0000 7fe4e6800640 1 --2- 172.21.15.173:0/459396896 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe4c8066f60 0x7fe4c8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:25.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.710+0000 7fe4e6800640 1 --2- 172.21.15.173:0/459396896 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe4c8066f60 0x7fe4c8069420 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80ae000 tx=0x7fe4d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:25.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.714+0000 7fe4dea00640 1 -- 172.21.15.173:0/459396896 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe4e8156540 con 0x7fe4e80aef70 2024-04-25T09:07:25.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:25.906+0000 7fe4ed400640 1 -- 172.21.15.173:0/459396896 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe4e806c300 con 0x7fe4e80aef70 2024-04-25T09:07:26.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.534+0000 7fe4dea00640 1 -- 172.21.15.173:0/459396896 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v48) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe4d40564a0 con 0x7fe4e80aef70 2024-04-25T09:07:26.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.538+0000 7fe4ed400640 1 -- 172.21.15.173:0/459396896 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe4c8066f60 msgr2=0x7fe4c8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:26.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.538+0000 7fe4ed400640 1 --2- 172.21.15.173:0/459396896 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe4c8066f60 0x7fe4c8069420 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80ae000 tx=0x7fe4d8008040 comp rx=0 tx=0).stop 2024-04-25T09:07:26.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.538+0000 7fe4ed400640 1 -- 172.21.15.173:0/459396896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4e80aef70 msgr2=0x7fe4e8156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:26.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.538+0000 7fe4ed400640 1 --2- 172.21.15.173:0/459396896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4e80aef70 0x7fe4e8156000 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400d800 tx=0x7fe4d400dcc0 comp rx=0 tx=0).stop 2024-04-25T09:07:26.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.538+0000 7fe4ed400640 1 -- 172.21.15.173:0/459396896 shutdown_connections 2024-04-25T09:07:26.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.538+0000 7fe4ed400640 1 --2- 172.21.15.173:0/459396896 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe4c8066f60 0x7fe4c8069420 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:26.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.538+0000 7fe4ed400640 1 --2- 172.21.15.173:0/459396896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e80cdba0 0x7fe4e81680d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:26.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.538+0000 7fe4ed400640 1 --2- 172.21.15.173:0/459396896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4e80aef70 0x7fe4e8156000 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:26.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.538+0000 7fe4ed400640 1 --2- 172.21.15.173:0/459396896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4e80aeb90 0x7fe4e8143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:26.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.538+0000 7fe4ed400640 1 -- 172.21.15.173:0/459396896 >> 172.21.15.173:0/459396896 conn(0x7fe4e806ac90 msgr2=0x7fe4e80b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:26.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.538+0000 7fe4ed400640 1 -- 172.21.15.173:0/459396896 shutdown_connections 2024-04-25T09:07:26.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.538+0000 7fe4ed400640 1 -- 172.21.15.173:0/459396896 wait complete. 2024-04-25T09:07:26.547 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:07:26.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.746+0000 7f0651800640 1 Processor -- start 2024-04-25T09:07:26.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.746+0000 7f0651800640 1 -- start start 2024-04-25T09:07:26.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.750+0000 7f0651800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f064c06fba0 0x7f064c06ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:26.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.750+0000 7f0651800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f064c06b1d0 0x7f064c0cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:26.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.750+0000 7f0651800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064c06b5e0 con 0x7f064c15b730 2024-04-25T09:07:26.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.750+0000 7f0651800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064c15f060 con 0x7f064c06b1d0 2024-04-25T09:07:26.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.750+0000 7f0651800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064c073100 con 0x7f064c06fba0 2024-04-25T09:07:26.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.750+0000 7f064b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f064c06b1d0 0x7f064c0cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:26.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.750+0000 7f064aa00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f064c15b730 0x7f064c0ca410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39310/0 (socket says 172.21.15.173:39310) 2024-04-25T09:07:26.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.750+0000 7f064aa00640 1 -- 172.21.15.173:0/181578462 learned_addr learned my addr 172.21.15.173:0/181578462 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:26.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.750+0000 7f0642000640 1 --2- 172.21.15.173:0/181578462 >> v2:172.21.15.194:3300/0 conn(0x7f064c06fba0 0x7f064c06ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:26.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.750+0000 7f064b400640 1 -- 172.21.15.173:0/181578462 >> v2:172.21.15.194:3300/0 conn(0x7f064c06fba0 msgr2=0x7f064c06ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:26.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.750+0000 7f064b400640 1 --2- 172.21.15.173:0/181578462 >> v2:172.21.15.194:3300/0 conn(0x7f064c06fba0 0x7f064c06ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:26.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.750+0000 7f064b400640 1 -- 172.21.15.173:0/181578462 >> v1:172.21.15.173:6789/0 conn(0x7f064c15b730 legacy=0x7f064c0ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:26.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.750+0000 7f064b400640 1 -- 172.21.15.173:0/181578462 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c0cab20 con 0x7f064c06b1d0 2024-04-25T09:07:26.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.750+0000 7f064a000640 1 -- 172.21.15.173:0/181578462 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296265664 0 0) 0x7f063c001120 con 0x7f064c15b730 2024-04-25T09:07:26.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.750+0000 7f064b400640 1 --2- 172.21.15.173:0/181578462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f064c06b1d0 0x7f064c0cf700 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f064c072150 tx=0x7f064401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0a63bdca0e8432 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:26.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f064a000640 1 -- 172.21.15.173:0/181578462 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06440b2070 con 0x7f064c06b1d0 2024-04-25T09:07:26.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f064a000640 1 -- 172.21.15.173:0/181578462 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06440a59c0 con 0x7f064c06b1d0 2024-04-25T09:07:26.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f064a000640 1 -- 172.21.15.173:0/181578462 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06440a5d90 con 0x7f064c06b1d0 2024-04-25T09:07:26.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f0651800640 1 -- 172.21.15.173:0/181578462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f064c06b1d0 msgr2=0x7f064c0cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:26.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f0651800640 1 --2- 172.21.15.173:0/181578462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f064c06b1d0 0x7f064c0cf700 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f064c072150 tx=0x7f064401c900 comp rx=0 tx=0).stop 2024-04-25T09:07:26.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f0651800640 1 -- 172.21.15.173:0/181578462 shutdown_connections 2024-04-25T09:07:26.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f0651800640 1 --2- 172.21.15.173:0/181578462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f064c06b1d0 0x7f064c0cf700 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:26.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f0651800640 1 --2- 172.21.15.173:0/181578462 >> v2:172.21.15.194:3300/0 conn(0x7f064c06fba0 0x7f064c06ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:26.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f0651800640 1 -- 172.21.15.173:0/181578462 >> 172.21.15.173:0/181578462 conn(0x7f064c0b23f0 msgr2=0x7f064c0b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:26.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f0651800640 1 -- 172.21.15.173:0/181578462 shutdown_connections 2024-04-25T09:07:26.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f0651800640 1 -- 172.21.15.173:0/181578462 wait complete. 2024-04-25T09:07:26.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f0651800640 1 Processor -- start 2024-04-25T09:07:26.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f0651800640 1 -- start start 2024-04-25T09:07:26.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f0651800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f064c06b1d0 0x7f064c14d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:26.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f0651800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f064c06fba0 0x7f064c1565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:26.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f0651800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f064c15b730 0x7f064c15c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:26.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f0651800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c15e160 con 0x7f064c15b730 2024-04-25T09:07:26.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f0651800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c15ecf0 con 0x7f064c06b1d0 2024-04-25T09:07:26.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f0651800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c15bb10 con 0x7f064c06fba0 2024-04-25T09:07:26.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f064b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f064c15b730 0x7f064c15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:26.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f064b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f064c15b730 0x7f064c15c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48680/0 (socket says 172.21.15.173:48680) 2024-04-25T09:07:26.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.754+0000 7f064b400640 1 -- 172.21.15.173:0/3232310768 learned_addr learned my addr 172.21.15.173:0/3232310768 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:26.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.758+0000 7f064aa00640 1 --2- 172.21.15.173:0/3232310768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f064c06b1d0 0x7f064c14d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:26.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.758+0000 7f0642000640 1 --2- 172.21.15.173:0/3232310768 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f064c06fba0 0x7f064c1565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:26.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.758+0000 7f064b400640 1 -- 172.21.15.173:0/3232310768 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f064c06fba0 msgr2=0x7f064c1565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:26.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.758+0000 7f064b400640 1 --2- 172.21.15.173:0/3232310768 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f064c06fba0 0x7f064c1565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:26.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.758+0000 7f064b400640 1 -- 172.21.15.173:0/3232310768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f064c06b1d0 msgr2=0x7f064c14d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:26.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.758+0000 7f064b400640 1 --2- 172.21.15.173:0/3232310768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f064c06b1d0 0x7f064c14d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:26.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.758+0000 7f064b400640 1 -- 172.21.15.173:0/3232310768 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c14dbd0 con 0x7f064c15b730 2024-04-25T09:07:26.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.758+0000 7f064b400640 1 --2- 172.21.15.173:0/3232310768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f064c15b730 0x7f064c15c130 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f06440b0040 tx=0x7f06440196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:26.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.758+0000 7f0643400640 1 -- 172.21.15.173:0/3232310768 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06440b2050 con 0x7f064c15b730 2024-04-25T09:07:26.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.758+0000 7f0643400640 1 -- 172.21.15.173:0/3232310768 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06440b3040 con 0x7f064c15b730 2024-04-25T09:07:26.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.758+0000 7f0651800640 1 -- 172.21.15.173:0/3232310768 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064c154b10 con 0x7f064c15b730 2024-04-25T09:07:26.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.758+0000 7f0643400640 1 -- 172.21.15.173:0/3232310768 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06440ad850 con 0x7f064c15b730 2024-04-25T09:07:26.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.758+0000 7f0651800640 1 -- 172.21.15.173:0/3232310768 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c1550d0 con 0x7f064c15b730 2024-04-25T09:07:26.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.758+0000 7f0651800640 1 -- 172.21.15.173:0/3232310768 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064c073ab0 con 0x7f064c15b730 2024-04-25T09:07:26.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.758+0000 7f0643400640 1 -- 172.21.15.173:0/3232310768 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f06440c0020 con 0x7f064c15b730 2024-04-25T09:07:26.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.762+0000 7f0643400640 1 --2- 172.21.15.173:0/3232310768 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0628066f90 0x7f0628069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:26.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.762+0000 7f0643400640 1 -- 172.21.15.173:0/3232310768 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f064411fcf0 con 0x7f064c15b730 2024-04-25T09:07:26.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.762+0000 7f064aa00640 1 --2- 172.21.15.173:0/3232310768 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0628066f90 0x7f0628069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:26.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.762+0000 7f064aa00640 1 --2- 172.21.15.173:0/3232310768 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0628066f90 0x7f0628069450 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f063c007fd0 tx=0x7f063c007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:26.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.766+0000 7f0643400640 1 -- 172.21.15.173:0/3232310768 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0644016520 con 0x7f064c15b730 2024-04-25T09:07:26.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:26.922+0000 7f0651800640 1 -- 172.21.15.173:0/3232310768 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f064c152cc0 con 0x7f064c15b730 2024-04-25T09:07:27.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.538+0000 7f0643400640 1 -- 172.21.15.173:0/3232310768 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v75) v1 ==== 181+0+0 (secure 0 0 0) 0x7f06440f0b40 con 0x7f064c15b730 2024-04-25T09:07:27.527 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:07:27.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.542+0000 7f0651800640 1 -- 172.21.15.173:0/3232310768 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0628066f90 msgr2=0x7f0628069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.542+0000 7f0651800640 1 --2- 172.21.15.173:0/3232310768 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0628066f90 0x7f0628069450 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f063c007fd0 tx=0x7f063c007980 comp rx=0 tx=0).stop 2024-04-25T09:07:27.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.542+0000 7f0651800640 1 -- 172.21.15.173:0/3232310768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f064c15b730 msgr2=0x7f064c15c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.542+0000 7f0651800640 1 --2- 172.21.15.173:0/3232310768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f064c15b730 0x7f064c15c130 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f06440b0040 tx=0x7f06440196a0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.542+0000 7f0651800640 1 -- 172.21.15.173:0/3232310768 shutdown_connections 2024-04-25T09:07:27.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.542+0000 7f0651800640 1 --2- 172.21.15.173:0/3232310768 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0628066f90 0x7f0628069450 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.542+0000 7f0651800640 1 --2- 172.21.15.173:0/3232310768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f064c15b730 0x7f064c15c130 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.542+0000 7f0651800640 1 --2- 172.21.15.173:0/3232310768 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f064c06fba0 0x7f064c1565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.542+0000 7f0651800640 1 --2- 172.21.15.173:0/3232310768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f064c06b1d0 0x7f064c14d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.542+0000 7f0651800640 1 -- 172.21.15.173:0/3232310768 >> 172.21.15.173:0/3232310768 conn(0x7f064c0b23f0 msgr2=0x7f064c151f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:27.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.542+0000 7f0651800640 1 -- 172.21.15.173:0/3232310768 shutdown_connections 2024-04-25T09:07:27.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.542+0000 7f0651800640 1 -- 172.21.15.173:0/3232310768 wait complete. 2024-04-25T09:07:27.554 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:07:27.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.706+0000 7fe92ac00640 1 Processor -- start 2024-04-25T09:07:27.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.706+0000 7fe92ac00640 1 -- start start 2024-04-25T09:07:27.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.710+0000 7fe92ac00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe9240cc7e0 0x7fe9240cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.710+0000 7fe92ac00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe9240aef70 0x7fe9240ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.710+0000 7fe92ac00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe924071570 con 0x7fe9240aeb90 2024-04-25T09:07:27.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.710+0000 7fe92ac00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe924071320 con 0x7fe9240aef70 2024-04-25T09:07:27.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.710+0000 7fe92ac00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe924072330 con 0x7fe9240cc7e0 2024-04-25T09:07:27.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.710+0000 7fe928c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe9240aef70 0x7fe9240ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.710+0000 7fe923e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe9240aeb90 0x7fe9240cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39326/0 (socket says 172.21.15.173:39326) 2024-04-25T09:07:27.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.710+0000 7fe923e00640 1 -- 172.21.15.173:0/1973277433 learned_addr learned my addr 172.21.15.173:0/1973277433 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:27.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.710+0000 7fe91b400640 1 --2- 172.21.15.173:0/1973277433 >> v2:172.21.15.194:3300/0 conn(0x7fe9240cc7e0 0x7fe9240cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.710+0000 7fe928c00640 1 -- 172.21.15.173:0/1973277433 >> v2:172.21.15.194:3300/0 conn(0x7fe9240cc7e0 msgr2=0x7fe9240cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.710+0000 7fe928c00640 1 --2- 172.21.15.173:0/1973277433 >> v2:172.21.15.194:3300/0 conn(0x7fe9240cc7e0 0x7fe9240cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.710+0000 7fe928c00640 1 -- 172.21.15.173:0/1973277433 >> v1:172.21.15.173:6789/0 conn(0x7fe9240aeb90 legacy=0x7fe9240cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.710+0000 7fe928c00640 1 -- 172.21.15.173:0/1973277433 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe924071850 con 0x7fe9240aef70 2024-04-25T09:07:27.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.710+0000 7fe923400640 1 -- 172.21.15.173:0/1973277433 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888383353 0 0) 0x7fe924071570 con 0x7fe9240aeb90 2024-04-25T09:07:27.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.714+0000 7fe928c00640 1 --2- 172.21.15.173:0/1973277433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9240aef70 0x7fe9240ce0e0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe9240cd960 tx=0x7fe91c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed37362452ae1983 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.714+0000 7fe923400640 1 -- 172.21.15.173:0/1973277433 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0b0070 con 0x7fe9240aef70 2024-04-25T09:07:27.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.714+0000 7fe923400640 1 -- 172.21.15.173:0/1973277433 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c0ab600 con 0x7fe9240aef70 2024-04-25T09:07:27.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.714+0000 7fe923400640 1 -- 172.21.15.173:0/1973277433 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0ab9d0 con 0x7fe9240aef70 2024-04-25T09:07:27.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.714+0000 7fe92ac00640 1 -- 172.21.15.173:0/1973277433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9240aef70 msgr2=0x7fe9240ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.714+0000 7fe92ac00640 1 --2- 172.21.15.173:0/1973277433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9240aef70 0x7fe9240ce0e0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe9240cd960 tx=0x7fe91c01c3f0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.714+0000 7fe92ac00640 1 -- 172.21.15.173:0/1973277433 shutdown_connections 2024-04-25T09:07:27.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.714+0000 7fe92ac00640 1 --2- 172.21.15.173:0/1973277433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9240aef70 0x7fe9240ce0e0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.714+0000 7fe92ac00640 1 --2- 172.21.15.173:0/1973277433 >> v2:172.21.15.194:3300/0 conn(0x7fe9240cc7e0 0x7fe9240cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.714+0000 7fe92ac00640 1 -- 172.21.15.173:0/1973277433 >> 172.21.15.173:0/1973277433 conn(0x7fe92406ac90 msgr2=0x7fe92406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:27.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.714+0000 7fe92ac00640 1 -- 172.21.15.173:0/1973277433 shutdown_connections 2024-04-25T09:07:27.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.714+0000 7fe92ac00640 1 -- 172.21.15.173:0/1973277433 wait complete. 2024-04-25T09:07:27.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.714+0000 7fe92ac00640 1 Processor -- start 2024-04-25T09:07:27.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.714+0000 7fe92ac00640 1 -- start start 2024-04-25T09:07:27.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.714+0000 7fe92ac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9240aeb90 0x7fe92414dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.714+0000 7fe92ac00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9240aef70 0x7fe92414b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.714+0000 7fe92ac00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9240cc7e0 0x7fe92415a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe92ac00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92415bb30 con 0x7fe9240cc7e0 2024-04-25T09:07:27.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe92ac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92415b9b0 con 0x7fe9240aeb90 2024-04-25T09:07:27.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe92ac00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92415bcb0 con 0x7fe9240aef70 2024-04-25T09:07:27.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe928c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9240cc7e0 0x7fe92415a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe928c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9240cc7e0 0x7fe92415a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48692/0 (socket says 172.21.15.173:48692) 2024-04-25T09:07:27.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe928c00640 1 -- 172.21.15.173:0/2165782703 learned_addr learned my addr 172.21.15.173:0/2165782703 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:27.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe923e00640 1 --2- 172.21.15.173:0/2165782703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9240aeb90 0x7fe92414dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe91b400640 1 --2- 172.21.15.173:0/2165782703 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9240aef70 0x7fe92414b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe928c00640 1 -- 172.21.15.173:0/2165782703 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9240aef70 msgr2=0x7fe92414b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe928c00640 1 --2- 172.21.15.173:0/2165782703 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9240aef70 0x7fe92414b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe928c00640 1 -- 172.21.15.173:0/2165782703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9240aeb90 msgr2=0x7fe92414dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe928c00640 1 --2- 172.21.15.173:0/2165782703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9240aeb90 0x7fe92414dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe928c00640 1 -- 172.21.15.173:0/2165782703 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe924068730 con 0x7fe9240cc7e0 2024-04-25T09:07:27.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe923e00640 1 --2- 172.21.15.173:0/2165782703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9240aeb90 0x7fe92414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:27.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe928c00640 1 --2- 172.21.15.173:0/2165782703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9240cc7e0 0x7fe92415a250 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0ae040 tx=0x7fe91c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe920c00640 1 -- 172.21.15.173:0/2165782703 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0b0050 con 0x7fe9240cc7e0 2024-04-25T09:07:27.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe920c00640 1 -- 172.21.15.173:0/2165782703 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c0bc070 con 0x7fe9240cc7e0 2024-04-25T09:07:27.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe920c00640 1 -- 172.21.15.173:0/2165782703 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0b5830 con 0x7fe9240cc7e0 2024-04-25T09:07:27.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe92ac00640 1 -- 172.21.15.173:0/2165782703 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92414e1e0 con 0x7fe9240cc7e0 2024-04-25T09:07:27.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe92ac00640 1 -- 172.21.15.173:0/2165782703 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe924139150 con 0x7fe9240cc7e0 2024-04-25T09:07:27.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe92ac00640 1 -- 172.21.15.173:0/2165782703 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe924073ab0 con 0x7fe9240cc7e0 2024-04-25T09:07:27.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.718+0000 7fe920c00640 1 -- 172.21.15.173:0/2165782703 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe91c0b59d0 con 0x7fe9240cc7e0 2024-04-25T09:07:27.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.722+0000 7fe920c00640 1 --2- 172.21.15.173:0/2165782703 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe900066f60 0x7fe900069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.722+0000 7fe920c00640 1 -- 172.21.15.173:0/2165782703 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5835+0+0 (secure 0 0 0) 0x7fe91c11f980 con 0x7fe9240cc7e0 2024-04-25T09:07:27.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.722+0000 7fe923e00640 1 --2- 172.21.15.173:0/2165782703 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe900066f60 0x7fe900069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.722+0000 7fe923e00640 1 --2- 172.21.15.173:0/2165782703 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe900066f60 0x7fe900069420 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe9140012f0 tx=0x7fe914009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.726+0000 7fe920c00640 1 -- 172.21.15.173:0/2165782703 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe91c016070 con 0x7fe9240cc7e0 2024-04-25T09:07:27.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:27.878+0000 7fe92ac00640 1 -- 172.21.15.173:0/2165782703 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe92415db00 con 0x7fe9240cc7e0 2024-04-25T09:07:28.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.542+0000 7fe920c00640 1 -- 172.21.15.173:0/2165782703 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v76) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe91c11f030 con 0x7fe9240cc7e0 2024-04-25T09:07:28.529 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' removed 2024-04-25T09:07:28.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.546+0000 7fe92ac00640 1 -- 172.21.15.173:0/2165782703 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe900066f60 msgr2=0x7fe900069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.546+0000 7fe92ac00640 1 --2- 172.21.15.173:0/2165782703 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe900066f60 0x7fe900069420 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe9140012f0 tx=0x7fe914009040 comp rx=0 tx=0).stop 2024-04-25T09:07:28.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.546+0000 7fe92ac00640 1 -- 172.21.15.173:0/2165782703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9240cc7e0 msgr2=0x7fe92415a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.546+0000 7fe92ac00640 1 --2- 172.21.15.173:0/2165782703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9240cc7e0 0x7fe92415a250 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0ae040 tx=0x7fe91c01ac30 comp rx=0 tx=0).stop 2024-04-25T09:07:28.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.546+0000 7fe92ac00640 1 -- 172.21.15.173:0/2165782703 shutdown_connections 2024-04-25T09:07:28.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.546+0000 7fe92ac00640 1 --2- 172.21.15.173:0/2165782703 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe900066f60 0x7fe900069420 secure :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe9140012f0 tx=0x7fe914009040 comp rx=0 tx=0).stop 2024-04-25T09:07:28.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.546+0000 7fe92ac00640 1 --2- 172.21.15.173:0/2165782703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9240cc7e0 0x7fe92415a250 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.546+0000 7fe92ac00640 1 --2- 172.21.15.173:0/2165782703 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9240aef70 0x7fe92414b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.546+0000 7fe92ac00640 1 --2- 172.21.15.173:0/2165782703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9240aeb90 0x7fe92414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.546+0000 7fe92ac00640 1 -- 172.21.15.173:0/2165782703 >> 172.21.15.173:0/2165782703 conn(0x7fe92406ac90 msgr2=0x7fe9240cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:28.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.546+0000 7fe92ac00640 1 -- 172.21.15.173:0/2165782703 shutdown_connections 2024-04-25T09:07:28.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.546+0000 7fe92ac00640 1 -- 172.21.15.173:0/2165782703 wait complete. 2024-04-25T09:07:28.560 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:07:28.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.710+0000 7f3f56e00640 1 Processor -- start 2024-04-25T09:07:28.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.710+0000 7f3f56e00640 1 -- start start 2024-04-25T09:07:28.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.714+0000 7f3f56e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3f50145290 0x7f3f5015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.714+0000 7f3f56e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5015c5f0 con 0x7f3f500cc260 2024-04-25T09:07:28.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.714+0000 7f3f56e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5006d4b0 con 0x7f3f500b3fe0 2024-04-25T09:07:28.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.714+0000 7f3f56e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f500ccd80 con 0x7f3f50145290 2024-04-25T09:07:28.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.714+0000 7f3f54e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f3f500cc260 0x7f3f500cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39334/0 (socket says 172.21.15.173:39334) 2024-04-25T09:07:28.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.714+0000 7f3f54e00640 1 -- 172.21.15.173:0/613879613 learned_addr learned my addr 172.21.15.173:0/613879613 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:28.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.714+0000 7f3f4fe00640 1 --2- 172.21.15.173:0/613879613 >> v2:172.21.15.194:3300/0 conn(0x7f3f50145290 0x7f3f5015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.714+0000 7f3f4f400640 1 -- 172.21.15.173:0/613879613 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500198144 0 0) 0x7f3f480014a0 con 0x7f3f500cc260 2024-04-25T09:07:28.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.714+0000 7f3f4f400640 1 -- 172.21.15.173:0/613879613 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f34003530 con 0x7f3f500cc260 2024-04-25T09:07:28.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.714+0000 7f3f4fe00640 1 -- 172.21.15.173:0/613879613 >> v1:172.21.15.194:6789/0 conn(0x7f3f500b3fe0 legacy=0x7f3f500b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.714+0000 7f3f4fe00640 1 -- 172.21.15.173:0/613879613 >> v1:172.21.15.173:6789/0 conn(0x7f3f500cc260 legacy=0x7f3f500cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.714+0000 7f3f4f400640 1 -- 172.21.15.173:0/613879613 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1784631967 0 0) 0x7f3f34003530 con 0x7f3f500cc260 2024-04-25T09:07:28.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.714+0000 7f3f4fe00640 1 -- 172.21.15.173:0/613879613 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5006d790 con 0x7f3f50145290 2024-04-25T09:07:28.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f4fe00640 1 --2- 172.21.15.173:0/613879613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f50145290 0x7f3f5015c0b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3f400097c0 tx=0x7f3f4001c2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef1d7a0a33fc2c4c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f4f400640 1 -- 172.21.15.173:0/613879613 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f400b0070 con 0x7f3f50145290 2024-04-25T09:07:28.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f4f400640 1 -- 172.21.15.173:0/613879613 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f400ab400 con 0x7f3f50145290 2024-04-25T09:07:28.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f4f400640 1 -- 172.21.15.173:0/613879613 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48001bf0 con 0x7f3f50145290 2024-04-25T09:07:28.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f56e00640 1 -- 172.21.15.173:0/613879613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f50145290 msgr2=0x7f3f5015c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f56e00640 1 --2- 172.21.15.173:0/613879613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f50145290 0x7f3f5015c0b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3f400097c0 tx=0x7f3f4001c2a0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f56e00640 1 -- 172.21.15.173:0/613879613 shutdown_connections 2024-04-25T09:07:28.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f56e00640 1 --2- 172.21.15.173:0/613879613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f50145290 0x7f3f5015c0b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f56e00640 1 -- 172.21.15.173:0/613879613 >> 172.21.15.173:0/613879613 conn(0x7f3f5006ac90 msgr2=0x7f3f5006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:28.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f56e00640 1 -- 172.21.15.173:0/613879613 shutdown_connections 2024-04-25T09:07:28.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f56e00640 1 -- 172.21.15.173:0/613879613 wait complete. 2024-04-25T09:07:28.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f56e00640 1 Processor -- start 2024-04-25T09:07:28.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f56e00640 1 -- start start 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f56e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f500b3fe0 0x7f3f5015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f56e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f500cc260 0x7f3f501f7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f56e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f50145290 0x7f3f5015e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f56e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5006eee0 con 0x7f3f500b3fe0 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f56e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5006ed60 con 0x7f3f500cc260 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f56e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5006f060 con 0x7f3f50145290 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f4fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f500b3fe0 0x7f3f5015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f4fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f500b3fe0 0x7f3f5015b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48696/0 (socket says 172.21.15.173:48696) 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f4fe00640 1 -- 172.21.15.173:0/410927013 learned_addr learned my addr 172.21.15.173:0/410927013 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.718+0000 7f3f54e00640 1 --2- 172.21.15.173:0/410927013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f50145290 0x7f3f5015e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.722+0000 7f3f47400640 1 --2- 172.21.15.173:0/410927013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f500cc260 0x7f3f501f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.722+0000 7f3f4fe00640 1 -- 172.21.15.173:0/410927013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f50145290 msgr2=0x7f3f5015e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.722+0000 7f3f4fe00640 1 --2- 172.21.15.173:0/410927013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f50145290 0x7f3f5015e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.722+0000 7f3f4fe00640 1 -- 172.21.15.173:0/410927013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f500cc260 msgr2=0x7f3f501f7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.722+0000 7f3f4fe00640 1 --2- 172.21.15.173:0/410927013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f500cc260 0x7f3f501f7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.722+0000 7f3f4fe00640 1 -- 172.21.15.173:0/410927013 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f500cda50 con 0x7f3f500b3fe0 2024-04-25T09:07:28.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.722+0000 7f3f4fe00640 1 --2- 172.21.15.173:0/410927013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f500b3fe0 0x7f3f5015b0e0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f3f400ae040 tx=0x7f3f4001aae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.722+0000 7f3f4cc00640 1 -- 172.21.15.173:0/410927013 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f400b0050 con 0x7f3f500b3fe0 2024-04-25T09:07:28.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.722+0000 7f3f4cc00640 1 -- 172.21.15.173:0/410927013 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f400b1040 con 0x7f3f500b3fe0 2024-04-25T09:07:28.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.722+0000 7f3f56e00640 1 -- 172.21.15.173:0/410927013 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f500cdd30 con 0x7f3f500b3fe0 2024-04-25T09:07:28.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.722+0000 7f3f4cc00640 1 -- 172.21.15.173:0/410927013 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40006e20 con 0x7f3f500b3fe0 2024-04-25T09:07:28.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.722+0000 7f3f56e00640 1 -- 172.21.15.173:0/410927013 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f500ce2f0 con 0x7f3f500b3fe0 2024-04-25T09:07:28.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.722+0000 7f3f56e00640 1 -- 172.21.15.173:0/410927013 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f50073ab0 con 0x7f3f500b3fe0 2024-04-25T09:07:28.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.722+0000 7f3f4cc00640 1 -- 172.21.15.173:0/410927013 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3f400be030 con 0x7f3f500b3fe0 2024-04-25T09:07:28.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.722+0000 7f3f4cc00640 1 --2- 172.21.15.173:0/410927013 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f2c066f60 0x7f3f2c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.726+0000 7f3f4cc00640 1 -- 172.21.15.173:0/410927013 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f3f4011ebd0 con 0x7f3f500b3fe0 2024-04-25T09:07:28.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.726+0000 7f3f47400640 1 --2- 172.21.15.173:0/410927013 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f2c066f60 0x7f3f2c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.726+0000 7f3f47400640 1 --2- 172.21.15.173:0/410927013 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f2c066f60 0x7f3f2c069420 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3f50144ba0 tx=0x7f3f38009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.730+0000 7f3f4cc00640 1 -- 172.21.15.173:0/410927013 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3f400c5020 con 0x7f3f500b3fe0 2024-04-25T09:07:28.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.886+0000 7f3f56e00640 1 -- 172.21.15.173:0/410927013 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3f5013d020 con 0x7f3f500b3fe0 2024-04-25T09:07:28.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.890+0000 7f3f4cc00640 1 -- 172.21.15.173:0/410927013 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3f40015fb0 con 0x7f3f500b3fe0 2024-04-25T09:07:28.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.890+0000 7f3f56e00640 1 -- 172.21.15.173:0/410927013 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f2c066f60 msgr2=0x7f3f2c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.890+0000 7f3f56e00640 1 --2- 172.21.15.173:0/410927013 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f2c066f60 0x7f3f2c069420 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3f50144ba0 tx=0x7f3f38009040 comp rx=0 tx=0).stop 2024-04-25T09:07:28.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.890+0000 7f3f56e00640 1 -- 172.21.15.173:0/410927013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f500b3fe0 msgr2=0x7f3f5015b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.890+0000 7f3f56e00640 1 --2- 172.21.15.173:0/410927013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f500b3fe0 0x7f3f5015b0e0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f3f400ae040 tx=0x7f3f4001aae0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.890+0000 7f3f56e00640 1 -- 172.21.15.173:0/410927013 shutdown_connections 2024-04-25T09:07:28.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.890+0000 7f3f56e00640 1 --2- 172.21.15.173:0/410927013 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f2c066f60 0x7f3f2c069420 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.890+0000 7f3f56e00640 1 --2- 172.21.15.173:0/410927013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f50145290 0x7f3f5015e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.890+0000 7f3f56e00640 1 --2- 172.21.15.173:0/410927013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f500cc260 0x7f3f501f7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.890+0000 7f3f56e00640 1 --2- 172.21.15.173:0/410927013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f500b3fe0 0x7f3f5015b0e0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.890+0000 7f3f56e00640 1 -- 172.21.15.173:0/410927013 >> 172.21.15.173:0/410927013 conn(0x7f3f5006ac90 msgr2=0x7f3f500b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:28.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.890+0000 7f3f56e00640 1 -- 172.21.15.173:0/410927013 shutdown_connections 2024-04-25T09:07:28.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:28.890+0000 7f3f56e00640 1 -- 172.21.15.173:0/410927013 wait complete. 2024-04-25T09:07:28.898 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-04-25T09:07:29.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.050+0000 7f742fc00640 1 Processor -- start 2024-04-25T09:07:29.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.050+0000 7f742fc00640 1 -- start start 2024-04-25T09:07:29.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f742fc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f74280aefa0 0x7f74280cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f742fc00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742815f320 con 0x7f742815edd0 2024-04-25T09:07:29.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f742fc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742806d420 con 0x7f74280b3e70 2024-04-25T09:07:29.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f742fc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f742806dd50 con 0x7f74280aefa0 2024-04-25T09:07:29.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f742dc00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f742815edd0 0x7f74280cdce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39340/0 (socket says 172.21.15.173:39340) 2024-04-25T09:07:29.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f742dc00640 1 -- 172.21.15.173:0/3483417138 learned_addr learned my addr 172.21.15.173:0/3483417138 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:29.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f7427e00640 1 --2- 172.21.15.173:0/3483417138 >> v2:172.21.15.194:3300/0 conn(0x7f74280aefa0 0x7f74280cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f7427400640 1 -- 172.21.15.173:0/3483417138 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494517899 0 0) 0x7f742815f320 con 0x7f742815edd0 2024-04-25T09:07:29.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f7427400640 1 -- 172.21.15.173:0/3483417138 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f740c003530 con 0x7f742815edd0 2024-04-25T09:07:29.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f7427400640 1 -- 172.21.15.173:0/3483417138 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2831363547 0 0) 0x7f740c003530 con 0x7f742815edd0 2024-04-25T09:07:29.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f7427400640 1 -- 172.21.15.173:0/3483417138 >> v2:172.21.15.194:3300/0 conn(0x7f74280aefa0 msgr2=0x7f74280cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f7427400640 1 --2- 172.21.15.173:0/3483417138 >> v2:172.21.15.194:3300/0 conn(0x7f74280aefa0 0x7f74280cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f7427400640 1 -- 172.21.15.173:0/3483417138 >> v1:172.21.15.194:6789/0 conn(0x7f74280b3e70 legacy=0x7f74280b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f7427400640 1 -- 172.21.15.173:0/3483417138 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742806d700 con 0x7f742815edd0 2024-04-25T09:07:29.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f7427400640 1 -- 172.21.15.173:0/3483417138 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f7420001680 con 0x7f742815edd0 2024-04-25T09:07:29.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f7427400640 1 -- 172.21.15.173:0/3483417138 >> v1:172.21.15.173:6789/0 conn(0x7f742815edd0 legacy=0x7f74280cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f7427400640 1 --2- 172.21.15.173:0/3483417138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f740c0039c0 0x7f740c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f7427400640 1 --2- 172.21.15.173:0/3483417138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f740c004810 0x7f740c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f7427400640 1 --2- 172.21.15.173:0/3483417138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f740c0051d0 0x7f740c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f7427400640 1 -- 172.21.15.173:0/3483417138 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742806dd50 con 0x7f740c0051d0 2024-04-25T09:07:29.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f7427400640 1 -- 172.21.15.173:0/3483417138 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c00c070 con 0x7f740c0039c0 2024-04-25T09:07:29.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f7427400640 1 -- 172.21.15.173:0/3483417138 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740c00c270 con 0x7f740c004810 2024-04-25T09:07:29.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f742dc00640 1 --2- 172.21.15.173:0/3483417138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f740c0051d0 0x7f740c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f742d200640 1 --2- 172.21.15.173:0/3483417138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f740c0039c0 0x7f740c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f7427e00640 1 --2- 172.21.15.173:0/3483417138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f740c004810 0x7f740c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f742dc00640 1 -- 172.21.15.173:0/3483417138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f740c004810 msgr2=0x7f740c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f742dc00640 1 --2- 172.21.15.173:0/3483417138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f740c004810 0x7f740c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f742dc00640 1 -- 172.21.15.173:0/3483417138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f740c0039c0 msgr2=0x7f740c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f742dc00640 1 --2- 172.21.15.173:0/3483417138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f740c0039c0 0x7f740c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.054+0000 7f742dc00640 1 -- 172.21.15.173:0/3483417138 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c003530 con 0x7f740c0051d0 2024-04-25T09:07:29.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.058+0000 7f742dc00640 1 -- 172.21.15.173:0/3483417138 reap_dead start 2024-04-25T09:07:29.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.058+0000 7f742dc00640 1 --2- 172.21.15.173:0/3483417138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f740c0051d0 0x7f740c00b9d0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f742000c1c0 tx=0x7f742001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106c5f843436464 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.058+0000 7f7427400640 1 -- 172.21.15.173:0/3483417138 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7420007d00 con 0x7f740c0051d0 2024-04-25T09:07:29.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.058+0000 7f7427400640 1 -- 172.21.15.173:0/3483417138 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74200a9070 con 0x7f740c0051d0 2024-04-25T09:07:29.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.058+0000 7f7427400640 1 -- 172.21.15.173:0/3483417138 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74200a5da0 con 0x7f740c0051d0 2024-04-25T09:07:29.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.058+0000 7f742fc00640 1 -- 172.21.15.173:0/3483417138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f740c0051d0 msgr2=0x7f740c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.058+0000 7f742fc00640 1 --2- 172.21.15.173:0/3483417138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f740c0051d0 0x7f740c00b9d0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f742000c1c0 tx=0x7f742001cc60 comp rx=0 tx=0).stop 2024-04-25T09:07:29.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.058+0000 7f742fc00640 1 -- 172.21.15.173:0/3483417138 shutdown_connections 2024-04-25T09:07:29.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.058+0000 7f742fc00640 1 --2- 172.21.15.173:0/3483417138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f740c0051d0 0x7f740c00b9d0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.058+0000 7f742fc00640 1 -- 172.21.15.173:0/3483417138 >> 172.21.15.173:0/3483417138 conn(0x7f742806ac90 msgr2=0x7f742806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.058+0000 7f742fc00640 1 -- 172.21.15.173:0/3483417138 shutdown_connections 2024-04-25T09:07:29.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.058+0000 7f742fc00640 1 -- 172.21.15.173:0/3483417138 wait complete. 2024-04-25T09:07:29.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742fc00640 1 Processor -- start 2024-04-25T09:07:29.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742fc00640 1 -- start start 2024-04-25T09:07:29.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742fc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f740c0051d0 0x7f74281480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742fc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7428154b40 0x7f7428154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742fc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7428157e90 0x7f7428158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742fc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742806e1e0 con 0x7f740c0051d0 2024-04-25T09:07:29.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742fc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742815aba0 con 0x7f7428157e90 2024-04-25T09:07:29.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742fc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742806e360 con 0x7f7428154b40 2024-04-25T09:07:29.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f740c0051d0 0x7f74281480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f740c0051d0 0x7f74281480f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48722/0 (socket says 172.21.15.173:48722) 2024-04-25T09:07:29.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742d200640 1 -- 172.21.15.173:0/1355866535 learned_addr learned my addr 172.21.15.173:0/1355866535 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:29.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f7427e00640 1 --2- 172.21.15.173:0/1355866535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7428154b40 0x7f7428154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742dc00640 1 --2- 172.21.15.173:0/1355866535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7428157e90 0x7f7428158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742d200640 1 -- 172.21.15.173:0/1355866535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7428154b40 msgr2=0x7f7428154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742d200640 1 --2- 172.21.15.173:0/1355866535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7428154b40 0x7f7428154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742d200640 1 -- 172.21.15.173:0/1355866535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7428157e90 msgr2=0x7f7428158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742d200640 1 --2- 172.21.15.173:0/1355866535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7428157e90 0x7f7428158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742d200640 1 -- 172.21.15.173:0/1355866535 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74281f3e10 con 0x7f740c0051d0 2024-04-25T09:07:29.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742d200640 1 --2- 172.21.15.173:0/1355866535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f740c0051d0 0x7f74281480f0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f741800f990 tx=0x7f741800fe50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f7424c00640 1 -- 172.21.15.173:0/1355866535 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7418003b90 con 0x7f740c0051d0 2024-04-25T09:07:29.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f7424c00640 1 -- 172.21.15.173:0/1355866535 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7418018070 con 0x7f740c0051d0 2024-04-25T09:07:29.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f7424c00640 1 -- 172.21.15.173:0/1355866535 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74180050d0 con 0x7f740c0051d0 2024-04-25T09:07:29.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742fc00640 1 -- 172.21.15.173:0/1355866535 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74281f40f0 con 0x7f740c0051d0 2024-04-25T09:07:29.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742fc00640 1 -- 172.21.15.173:0/1355866535 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74281f46b0 con 0x7f740c0051d0 2024-04-25T09:07:29.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.062+0000 7f742fc00640 1 -- 172.21.15.173:0/1355866535 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7428073a40 con 0x7f740c0051d0 2024-04-25T09:07:29.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.066+0000 7f7424c00640 1 -- 172.21.15.173:0/1355866535 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7418005270 con 0x7f740c0051d0 2024-04-25T09:07:29.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.066+0000 7f7424c00640 1 --2- 172.21.15.173:0/1355866535 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7408066f60 0x7f7408069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.066+0000 7f7424c00640 1 -- 172.21.15.173:0/1355866535 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f7418085070 con 0x7f740c0051d0 2024-04-25T09:07:29.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.066+0000 7f7427e00640 1 --2- 172.21.15.173:0/1355866535 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7408066f60 0x7f7408069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.066+0000 7f7427e00640 1 --2- 172.21.15.173:0/1355866535 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7408066f60 0x7f7408069420 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f74280b0ed0 tx=0x7f7414008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.070+0000 7f7424c00640 1 -- 172.21.15.173:0/1355866535 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7418056100 con 0x7f740c0051d0 2024-04-25T09:07:29.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.278+0000 7f742fc00640 1 -- 172.21.15.173:0/1355866535 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) v1 -- 0x7f742806f1c0 con 0x7f740c0051d0 2024-04-25T09:07:29.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.558+0000 7f7424c00640 1 -- 172.21.15.173:0/1355866535 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v247) v1 ==== 143+0+0 (secure 0 0 0) 0x7f7418055a00 con 0x7f740c0051d0 2024-04-25T09:07:29.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.558+0000 7f742fc00640 1 -- 172.21.15.173:0/1355866535 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7408066f60 msgr2=0x7f7408069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.558+0000 7f742fc00640 1 --2- 172.21.15.173:0/1355866535 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7408066f60 0x7f7408069420 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f74280b0ed0 tx=0x7f7414008040 comp rx=0 tx=0).stop 2024-04-25T09:07:29.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.558+0000 7f742fc00640 1 -- 172.21.15.173:0/1355866535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f740c0051d0 msgr2=0x7f74281480f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.558+0000 7f742fc00640 1 --2- 172.21.15.173:0/1355866535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f740c0051d0 0x7f74281480f0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f741800f990 tx=0x7f741800fe50 comp rx=0 tx=0).stop 2024-04-25T09:07:29.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.558+0000 7f742fc00640 1 -- 172.21.15.173:0/1355866535 shutdown_connections 2024-04-25T09:07:29.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.558+0000 7f742fc00640 1 --2- 172.21.15.173:0/1355866535 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7408066f60 0x7f7408069420 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.558+0000 7f742fc00640 1 --2- 172.21.15.173:0/1355866535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7428157e90 0x7f7428158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.558+0000 7f742fc00640 1 --2- 172.21.15.173:0/1355866535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7428154b40 0x7f7428154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.558+0000 7f742fc00640 1 --2- 172.21.15.173:0/1355866535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f740c0051d0 0x7f74281480f0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.558+0000 7f742fc00640 1 -- 172.21.15.173:0/1355866535 >> 172.21.15.173:0/1355866535 conn(0x7f742806ac90 msgr2=0x7f74280b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.558+0000 7f742fc00640 1 -- 172.21.15.173:0/1355866535 shutdown_connections 2024-04-25T09:07:29.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.562+0000 7f742fc00640 1 -- 172.21.15.173:0/1355866535 wait complete. 2024-04-25T09:07:29.568 INFO:tasks.cephfs_test_runner:test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-04-25T09:07:29.568 INFO:tasks.cephfs_test_runner:Starting test: test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) test that scrub can iterate over ~mdsdir and evaluate strays 2024-04-25T09:07:29.568 INFO:tasks.cephfs_test_runner:test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-04-25T09:07:29.568 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:29.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f560b600640 1 Processor -- start 2024-04-25T09:07:29.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f560b600640 1 -- start start 2024-04-25T09:07:29.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f560b600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f560415dbb0 0x7f560415df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f560b600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f56040d2130 0x7f560406c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f560b600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560406d870 con 0x7f560406c7b0 2024-04-25T09:07:29.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f560b600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56040d2590 con 0x7f56040d2130 2024-04-25T09:07:29.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f560b600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560415e5c0 con 0x7f560415dbb0 2024-04-25T09:07:29.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5609600640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f560406c7b0 0x7f560406f830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39342/0 (socket says 172.21.15.173:39342) 2024-04-25T09:07:29.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5609600640 1 -- 172.21.15.173:0/3488829681 learned_addr learned my addr 172.21.15.173:0/3488829681 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:29.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f55fbe00640 1 --2- 172.21.15.173:0/3488829681 >> v2:172.21.15.194:3300/0 conn(0x7f56040d2130 0x7f560406c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5603e00640 1 -- 172.21.15.173:0/3488829681 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671218718 0 0) 0x7f560406d870 con 0x7f560406c7b0 2024-04-25T09:07:29.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5603e00640 1 -- 172.21.15.173:0/3488829681 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e8003530 con 0x7f560406c7b0 2024-04-25T09:07:29.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5608c00640 1 --2- 172.21.15.173:0/3488829681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f560415dbb0 0x7f560415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5603e00640 1 -- 172.21.15.173:0/3488829681 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 148866985 0 0) 0x7f55e8003530 con 0x7f560406c7b0 2024-04-25T09:07:29.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5603e00640 1 -- 172.21.15.173:0/3488829681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f560415dbb0 msgr2=0x7f560415df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5603e00640 1 --2- 172.21.15.173:0/3488829681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f560415dbb0 0x7f560415df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5603e00640 1 -- 172.21.15.173:0/3488829681 >> v2:172.21.15.194:3300/0 conn(0x7f56040d2130 msgr2=0x7f560406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5603e00640 1 --2- 172.21.15.173:0/3488829681 >> v2:172.21.15.194:3300/0 conn(0x7f56040d2130 0x7f560406c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5603e00640 1 -- 172.21.15.173:0/3488829681 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5604161690 con 0x7f560406c7b0 2024-04-25T09:07:29.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5603e00640 1 -- 172.21.15.173:0/3488829681 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f55fc001a00 con 0x7f560406c7b0 2024-04-25T09:07:29.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5603e00640 1 -- 172.21.15.173:0/3488829681 >> v1:172.21.15.173:6789/0 conn(0x7f560406c7b0 legacy=0x7f560406f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5603e00640 1 --2- 172.21.15.173:0/3488829681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f560415dbb0 0x7f55e80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5603e00640 1 --2- 172.21.15.173:0/3488829681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55e8003f40 0x7f55e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5603e00640 1 --2- 172.21.15.173:0/3488829681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55e8004d50 0x7f55e80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5603e00640 1 -- 172.21.15.173:0/3488829681 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56040d2590 con 0x7f55e8003f40 2024-04-25T09:07:29.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5603e00640 1 -- 172.21.15.173:0/3488829681 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560415e5c0 con 0x7f55e8004d50 2024-04-25T09:07:29.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5603e00640 1 -- 172.21.15.173:0/3488829681 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e800b9d0 con 0x7f560415dbb0 2024-04-25T09:07:29.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f55fbe00640 1 --2- 172.21.15.173:0/3488829681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55e8003f40 0x7f55e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5608c00640 1 --2- 172.21.15.173:0/3488829681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f560415dbb0 0x7f55e80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f5609600640 1 --2- 172.21.15.173:0/3488829681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55e8004d50 0x7f55e80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f55fbe00640 1 -- 172.21.15.173:0/3488829681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f560415dbb0 msgr2=0x7f55e80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f55fbe00640 1 --2- 172.21.15.173:0/3488829681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f560415dbb0 0x7f55e80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f55fbe00640 1 -- 172.21.15.173:0/3488829681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55e8004d50 msgr2=0x7f55e80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f55fbe00640 1 --2- 172.21.15.173:0/3488829681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55e8004d50 0x7f55e80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.718+0000 7f55fbe00640 1 -- 172.21.15.173:0/3488829681 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e8003530 con 0x7f55e8003f40 2024-04-25T09:07:29.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.722+0000 7f55fbe00640 1 --2- 172.21.15.173:0/3488829681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55e8003f40 0x7f55e8004810 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009ae0 tx=0x7f55ec01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c56bc63b3b3815 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.722+0000 7f5603e00640 1 -- 172.21.15.173:0/3488829681 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0b2070 con 0x7f55e8003f40 2024-04-25T09:07:29.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.722+0000 7f5603e00640 1 -- 172.21.15.173:0/3488829681 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec0a5590 con 0x7f55e8003f40 2024-04-25T09:07:29.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.722+0000 7f5603e00640 1 -- 172.21.15.173:0/3488829681 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0096b0 con 0x7f55e8003f40 2024-04-25T09:07:29.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.722+0000 7f560b600640 1 -- 172.21.15.173:0/3488829681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55e8003f40 msgr2=0x7f55e8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.722+0000 7f560b600640 1 --2- 172.21.15.173:0/3488829681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55e8003f40 0x7f55e8004810 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009ae0 tx=0x7f55ec01ca50 comp rx=0 tx=0).stop 2024-04-25T09:07:29.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.722+0000 7f5609600640 1 -- 172.21.15.173:0/3488829681 reap_dead start 2024-04-25T09:07:29.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.722+0000 7f560b600640 1 -- 172.21.15.173:0/3488829681 shutdown_connections 2024-04-25T09:07:29.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.722+0000 7f560b600640 1 -- 172.21.15.173:0/3488829681 >> 172.21.15.173:0/3488829681 conn(0x7f5604061880 msgr2=0x7f5604061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.722+0000 7f560b600640 1 -- 172.21.15.173:0/3488829681 shutdown_connections 2024-04-25T09:07:29.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.722+0000 7f560b600640 1 -- 172.21.15.173:0/3488829681 wait complete. 2024-04-25T09:07:29.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f560b600640 1 Processor -- start 2024-04-25T09:07:29.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f560b600640 1 -- start start 2024-04-25T09:07:29.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f560b600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55e8003f40 0x7f56041f1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f560b600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56041f0be0 0x7f56041f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f560b600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56040c9480 0x7f56040c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f560b600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560415ee60 con 0x7f56040c9480 2024-04-25T09:07:29.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f560b600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560415eb80 con 0x7f55e8003f40 2024-04-25T09:07:29.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f560b600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560406ff40 con 0x7f56041f0be0 2024-04-25T09:07:29.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f5609600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56040c9480 0x7f56040c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f5608c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55e8003f40 0x7f56041f1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f5609600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56040c9480 0x7f56040c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48746/0 (socket says 172.21.15.173:48746) 2024-04-25T09:07:29.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f5609600640 1 -- 172.21.15.173:0/1994548521 learned_addr learned my addr 172.21.15.173:0/1994548521 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:29.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f55fbe00640 1 --2- 172.21.15.173:0/1994548521 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56041f0be0 0x7f56041f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f5609600640 1 -- 172.21.15.173:0/1994548521 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56041f0be0 msgr2=0x7f56041f4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f5609600640 1 --2- 172.21.15.173:0/1994548521 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56041f0be0 0x7f56041f4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f5609600640 1 -- 172.21.15.173:0/1994548521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55e8003f40 msgr2=0x7f56041f1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f5609600640 1 --2- 172.21.15.173:0/1994548521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55e8003f40 0x7f56041f1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f5609600640 1 -- 172.21.15.173:0/1994548521 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56041f4680 con 0x7f56040c9480 2024-04-25T09:07:29.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f5609600640 1 --2- 172.21.15.173:0/1994548521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56040c9480 0x7f56040c9900 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f56040b1140 tx=0x7f55fc011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f5601600640 1 -- 172.21.15.173:0/1994548521 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc010040 con 0x7f56040c9480 2024-04-25T09:07:29.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f5601600640 1 -- 172.21.15.173:0/1994548521 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc01a070 con 0x7f56040c9480 2024-04-25T09:07:29.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f560b600640 1 -- 172.21.15.173:0/1994548521 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56041f4bf0 con 0x7f56040c9480 2024-04-25T09:07:29.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f5601600640 1 -- 172.21.15.173:0/1994548521 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc00fb00 con 0x7f56040c9480 2024-04-25T09:07:29.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.726+0000 7f560b600640 1 -- 172.21.15.173:0/1994548521 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56041f51b0 con 0x7f56040c9480 2024-04-25T09:07:29.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.730+0000 7f560b600640 1 -- 172.21.15.173:0/1994548521 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5604073a40 con 0x7f56040c9480 2024-04-25T09:07:29.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.730+0000 7f5601600640 1 -- 172.21.15.173:0/1994548521 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f55fc00fca0 con 0x7f56040c9480 2024-04-25T09:07:29.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.730+0000 7f5601600640 1 --2- 172.21.15.173:0/1994548521 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f55e0066f90 0x7f55e0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.730+0000 7f5601600640 1 -- 172.21.15.173:0/1994548521 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f55fc087cd0 con 0x7f56040c9480 2024-04-25T09:07:29.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.730+0000 7f5608c00640 1 --2- 172.21.15.173:0/1994548521 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f55e0066f90 0x7f55e0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.730+0000 7f5608c00640 1 --2- 172.21.15.173:0/1994548521 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f55e0066f90 0x7f55e0069450 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f55f4009b00 tx=0x7f55f4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.734+0000 7f5601600640 1 -- 172.21.15.173:0/1994548521 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f56041f4680 con 0x7f56040c9480 2024-04-25T09:07:29.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.890+0000 7f560b600640 1 -- 172.21.15.173:0/1994548521 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56040cf7e0 con 0x7f56040c9480 2024-04-25T09:07:29.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.894+0000 7f5601600640 1 -- 172.21.15.173:0/1994548521 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+13486 (secure 0 0 0) 0x7f55fc058df0 con 0x7f56040c9480 2024-04-25T09:07:29.881 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:29.881 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":76,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:07:28.542115+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:6836/4214702139":"2024-04-26T09:07:25.533137+0000","172.21.15.173:6834/4214702139":"2024-04-26T09:07:25.533137+0000","172.21.15.173:6836/962695208":"2024-04-26T09:07:01.867727+0000","172.21.15.173:6834/962695208":"2024-04-26T09:07:01.867727+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:29.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.894+0000 7f560b600640 1 -- 172.21.15.173:0/1994548521 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f55e0066f90 msgr2=0x7f55e0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.894+0000 7f560b600640 1 --2- 172.21.15.173:0/1994548521 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f55e0066f90 0x7f55e0069450 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f55f4009b00 tx=0x7f55f4009190 comp rx=0 tx=0).stop 2024-04-25T09:07:29.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.894+0000 7f560b600640 1 -- 172.21.15.173:0/1994548521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56040c9480 msgr2=0x7f56040c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.894+0000 7f560b600640 1 --2- 172.21.15.173:0/1994548521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56040c9480 0x7f56040c9900 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f56040b1140 tx=0x7f55fc011b60 comp rx=0 tx=0).stop 2024-04-25T09:07:29.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.894+0000 7f560b600640 1 -- 172.21.15.173:0/1994548521 shutdown_connections 2024-04-25T09:07:29.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.894+0000 7f560b600640 1 --2- 172.21.15.173:0/1994548521 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f55e0066f90 0x7f55e0069450 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.894+0000 7f560b600640 1 --2- 172.21.15.173:0/1994548521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56040c9480 0x7f56040c9900 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.894+0000 7f560b600640 1 --2- 172.21.15.173:0/1994548521 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56041f0be0 0x7f56041f4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.894+0000 7f560b600640 1 --2- 172.21.15.173:0/1994548521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55e8003f40 0x7f56041f1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.894+0000 7f560b600640 1 -- 172.21.15.173:0/1994548521 >> 172.21.15.173:0/1994548521 conn(0x7f5604061880 msgr2=0x7f560415c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.894+0000 7f560b600640 1 -- 172.21.15.173:0/1994548521 shutdown_connections 2024-04-25T09:07:29.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:29.894+0000 7f560b600640 1 -- 172.21.15.173:0/1994548521 wait complete. 2024-04-25T09:07:29.902 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:07:29.902 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:07:30.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.054+0000 7f0b92600640 1 Processor -- start 2024-04-25T09:07:30.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.054+0000 7f0b92600640 1 -- start start 2024-04-25T09:07:30.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.054+0000 7f0b92600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b8c06bda0 0x7f0b8c0cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.054+0000 7f0b92600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0b8c06c220 0x7f0b8c0cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.054+0000 7f0b92600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8c161570 con 0x7f0b8c099a50 2024-04-25T09:07:30.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.054+0000 7f0b92600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8c161850 con 0x7f0b8c06c220 2024-04-25T09:07:30.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.054+0000 7f0b92600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c161b30 con 0x7f0b8c06bda0 2024-04-25T09:07:30.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.054+0000 7f0b91200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f0b8c099a50 0x7f0b8c099e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39356/0 (socket says 172.21.15.173:39356) 2024-04-25T09:07:30.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.054+0000 7f0b91200640 1 -- 172.21.15.173:0/1451304553 learned_addr learned my addr 172.21.15.173:0/1451304553 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:30.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.054+0000 7f0b91c00640 1 --2- 172.21.15.173:0/1451304553 >> v2:172.21.15.194:3300/0 conn(0x7f0b8c06c220 0x7f0b8c0cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.054+0000 7f0b83e00640 1 --2- 172.21.15.173:0/1451304553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b8c06bda0 0x7f0b8c0cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.058+0000 7f0b8be00640 1 -- 172.21.15.173:0/1451304553 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233289902 0 0) 0x7f0b8c161570 con 0x7f0b8c099a50 2024-04-25T09:07:30.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.058+0000 7f0b8be00640 1 -- 172.21.15.173:0/1451304553 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b70003530 con 0x7f0b8c099a50 2024-04-25T09:07:30.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.058+0000 7f0b91c00640 1 -- 172.21.15.173:0/1451304553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b8c06bda0 msgr2=0x7f0b8c0cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:30.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.058+0000 7f0b91c00640 1 --2- 172.21.15.173:0/1451304553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b8c06bda0 0x7f0b8c0cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.058+0000 7f0b91c00640 1 -- 172.21.15.173:0/1451304553 >> v1:172.21.15.173:6789/0 conn(0x7f0b8c099a50 legacy=0x7f0b8c099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.058+0000 7f0b91c00640 1 -- 172.21.15.173:0/1451304553 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c161e10 con 0x7f0b8c06c220 2024-04-25T09:07:30.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.058+0000 7f0b91c00640 1 --2- 172.21.15.173:0/1451304553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b8c06c220 0x7f0b8c0cfce0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0b84009d90 tx=0x7f0b8401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cec81258a73bfbad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:30.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.058+0000 7f0b8be00640 1 -- 172.21.15.173:0/1451304553 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b840b2070 con 0x7f0b8c06c220 2024-04-25T09:07:30.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.058+0000 7f0b8be00640 1 -- 172.21.15.173:0/1451304553 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b840a5a20 con 0x7f0b8c06c220 2024-04-25T09:07:30.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.058+0000 7f0b8be00640 1 -- 172.21.15.173:0/1451304553 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b840a5df0 con 0x7f0b8c06c220 2024-04-25T09:07:30.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b92600640 1 -- 172.21.15.173:0/1451304553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b8c06c220 msgr2=0x7f0b8c0cfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b92600640 1 --2- 172.21.15.173:0/1451304553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b8c06c220 0x7f0b8c0cfce0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0b84009d90 tx=0x7f0b8401c940 comp rx=0 tx=0).stop 2024-04-25T09:07:30.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b92600640 1 -- 172.21.15.173:0/1451304553 shutdown_connections 2024-04-25T09:07:30.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b92600640 1 --2- 172.21.15.173:0/1451304553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b8c06c220 0x7f0b8c0cfce0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b92600640 1 --2- 172.21.15.173:0/1451304553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b8c06bda0 0x7f0b8c0cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b92600640 1 -- 172.21.15.173:0/1451304553 >> 172.21.15.173:0/1451304553 conn(0x7f0b8c0b31d0 msgr2=0x7f0b8c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:30.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b92600640 1 -- 172.21.15.173:0/1451304553 shutdown_connections 2024-04-25T09:07:30.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b92600640 1 -- 172.21.15.173:0/1451304553 wait complete. 2024-04-25T09:07:30.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b92600640 1 Processor -- start 2024-04-25T09:07:30.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b92600640 1 -- start start 2024-04-25T09:07:30.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b92600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b8c06bda0 0x7f0b8c151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b92600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b8c06c220 0x7f0b8c0b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b92600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b8c099a50 0x7f0b8c0b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b92600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c16a910 con 0x7f0b8c099a50 2024-04-25T09:07:30.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b92600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c09aed0 con 0x7f0b8c06c220 2024-04-25T09:07:30.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b92600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c16aa90 con 0x7f0b8c06bda0 2024-04-25T09:07:30.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b91c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b8c099a50 0x7f0b8c0b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b91c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b8c099a50 0x7f0b8c0b4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48752/0 (socket says 172.21.15.173:48752) 2024-04-25T09:07:30.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b91c00640 1 -- 172.21.15.173:0/1849999259 learned_addr learned my addr 172.21.15.173:0/1849999259 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:30.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b91200640 1 --2- 172.21.15.173:0/1849999259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b8c06bda0 0x7f0b8c151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b83e00640 1 --2- 172.21.15.173:0/1849999259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b8c06c220 0x7f0b8c0b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b91c00640 1 -- 172.21.15.173:0/1849999259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b8c06bda0 msgr2=0x7f0b8c151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b91c00640 1 --2- 172.21.15.173:0/1849999259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b8c06bda0 0x7f0b8c151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b91c00640 1 -- 172.21.15.173:0/1849999259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b8c06c220 msgr2=0x7f0b8c0b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b91c00640 1 --2- 172.21.15.173:0/1849999259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b8c06c220 0x7f0b8c0b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b91c00640 1 -- 172.21.15.173:0/1849999259 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c150f60 con 0x7f0b8c099a50 2024-04-25T09:07:30.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.062+0000 7f0b91200640 1 --2- 172.21.15.173:0/1849999259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b8c06bda0 0x7f0b8c151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:30.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.066+0000 7f0b91c00640 1 --2- 172.21.15.173:0/1849999259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b8c099a50 0x7f0b8c0b4a70 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f0b840b0040 tx=0x7f0b840196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:30.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.066+0000 7f0b89600640 1 -- 172.21.15.173:0/1849999259 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b840b2050 con 0x7f0b8c099a50 2024-04-25T09:07:30.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.066+0000 7f0b89600640 1 -- 172.21.15.173:0/1849999259 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b840be070 con 0x7f0b8c099a50 2024-04-25T09:07:30.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.066+0000 7f0b89600640 1 -- 172.21.15.173:0/1849999259 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b840adad0 con 0x7f0b8c099a50 2024-04-25T09:07:30.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.066+0000 7f0b92600640 1 -- 172.21.15.173:0/1849999259 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8c1511e0 con 0x7f0b8c099a50 2024-04-25T09:07:30.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.066+0000 7f0b92600640 1 -- 172.21.15.173:0/1849999259 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8c1517a0 con 0x7f0b8c099a50 2024-04-25T09:07:30.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.066+0000 7f0b92600640 1 -- 172.21.15.173:0/1849999259 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b8c073a40 con 0x7f0b8c099a50 2024-04-25T09:07:30.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.066+0000 7f0b89600640 1 -- 172.21.15.173:0/1849999259 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0b840adc70 con 0x7f0b8c099a50 2024-04-25T09:07:30.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.066+0000 7f0b89600640 1 --2- 172.21.15.173:0/1849999259 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b68066f60 0x7f0b68069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.066+0000 7f0b89600640 1 -- 172.21.15.173:0/1849999259 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f0b84120090 con 0x7f0b8c099a50 2024-04-25T09:07:30.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.066+0000 7f0b91200640 1 --2- 172.21.15.173:0/1849999259 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b68066f60 0x7f0b68069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.066+0000 7f0b91200640 1 --2- 172.21.15.173:0/1849999259 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b68066f60 0x7f0b68069420 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c005890 tx=0x7f0b7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:30.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.070+0000 7f0b89600640 1 -- 172.21.15.173:0/1849999259 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0b8c150f60 con 0x7f0b8c099a50 2024-04-25T09:07:30.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.226+0000 7f0b92600640 1 -- 172.21.15.173:0/1849999259 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b8c09a580 con 0x7f0b8c099a50 2024-04-25T09:07:30.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.226+0000 7f0b89600640 1 -- 172.21.15.173:0/1849999259 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b84016560 con 0x7f0b8c099a50 2024-04-25T09:07:30.213 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:07:30.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.226+0000 7f0b92600640 1 -- 172.21.15.173:0/1849999259 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b68066f60 msgr2=0x7f0b68069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.226+0000 7f0b92600640 1 --2- 172.21.15.173:0/1849999259 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b68066f60 0x7f0b68069420 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c005890 tx=0x7f0b7c009040 comp rx=0 tx=0).stop 2024-04-25T09:07:30.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.226+0000 7f0b92600640 1 -- 172.21.15.173:0/1849999259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b8c099a50 msgr2=0x7f0b8c0b4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.226+0000 7f0b92600640 1 --2- 172.21.15.173:0/1849999259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b8c099a50 0x7f0b8c0b4a70 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f0b840b0040 tx=0x7f0b840196e0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.226+0000 7f0b92600640 1 -- 172.21.15.173:0/1849999259 shutdown_connections 2024-04-25T09:07:30.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.226+0000 7f0b92600640 1 --2- 172.21.15.173:0/1849999259 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b68066f60 0x7f0b68069420 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.226+0000 7f0b92600640 1 --2- 172.21.15.173:0/1849999259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b8c099a50 0x7f0b8c0b4a70 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.226+0000 7f0b92600640 1 --2- 172.21.15.173:0/1849999259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b8c06c220 0x7f0b8c0b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.226+0000 7f0b92600640 1 --2- 172.21.15.173:0/1849999259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b8c06bda0 0x7f0b8c151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.226+0000 7f0b92600640 1 -- 172.21.15.173:0/1849999259 >> 172.21.15.173:0/1849999259 conn(0x7f0b8c0b31d0 msgr2=0x7f0b8c15dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:30.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.226+0000 7f0b92600640 1 -- 172.21.15.173:0/1849999259 shutdown_connections 2024-04-25T09:07:30.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.226+0000 7f0b92600640 1 -- 172.21.15.173:0/1849999259 wait complete. 2024-04-25T09:07:30.234 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-04-25T09:07:30.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa417e00640 1 Processor -- start 2024-04-25T09:07:30.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa417e00640 1 -- start start 2024-04-25T09:07:30.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa417e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa41015ba20 0x7fa41015be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa417e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41015c460 con 0x7fa4100b70f0 2024-04-25T09:07:30.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa417e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41015c740 con 0x7fa4100b7550 2024-04-25T09:07:30.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa417e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41015ca20 con 0x7fa41015ba20 2024-04-25T09:07:30.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa414a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa4100b70f0 0x7fa41006f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39366/0 (socket says 172.21.15.173:39366) 2024-04-25T09:07:30.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa414a00640 1 -- 172.21.15.173:0/3167753331 learned_addr learned my addr 172.21.15.173:0/3167753331 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:30.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa415400640 1 --2- 172.21.15.173:0/3167753331 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa41015ba20 0x7fa41015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa40fe00640 1 -- 172.21.15.173:0/3167753331 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009187604 0 0) 0x7fa41015c460 con 0x7fa4100b70f0 2024-04-25T09:07:30.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa40fe00640 1 -- 172.21.15.173:0/3167753331 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3f8003530 con 0x7fa4100b70f0 2024-04-25T09:07:30.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa40fe00640 1 -- 172.21.15.173:0/3167753331 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2373924825 0 0) 0x7fa3f8003530 con 0x7fa4100b70f0 2024-04-25T09:07:30.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa40fe00640 1 -- 172.21.15.173:0/3167753331 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa41015ba20 msgr2=0x7fa41015be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:30.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa40fe00640 1 --2- 172.21.15.173:0/3167753331 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa41015ba20 0x7fa41015be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa40fe00640 1 -- 172.21.15.173:0/3167753331 >> v1:172.21.15.194:6789/0 conn(0x7fa4100b7550 legacy=0x7fa4100d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa40fe00640 1 -- 172.21.15.173:0/3167753331 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41015cd00 con 0x7fa4100b70f0 2024-04-25T09:07:30.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa40fe00640 1 -- 172.21.15.173:0/3167753331 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fa3fc001680 con 0x7fa4100b70f0 2024-04-25T09:07:30.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa40fe00640 1 -- 172.21.15.173:0/3167753331 >> v1:172.21.15.173:6789/0 conn(0x7fa4100b70f0 legacy=0x7fa41006f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa40fe00640 1 --2- 172.21.15.173:0/3167753331 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa41015ba20 0x7fa3f80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa40fe00640 1 --2- 172.21.15.173:0/3167753331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3f8003fc0 0x7fa3f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa40fe00640 1 --2- 172.21.15.173:0/3167753331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f8004d50 0x7fa3f80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa40fe00640 1 -- 172.21.15.173:0/3167753331 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41015ca20 con 0x7fa3f8003fc0 2024-04-25T09:07:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa40fe00640 1 -- 172.21.15.173:0/3167753331 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f800bb10 con 0x7fa3f8004d50 2024-04-25T09:07:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa40fe00640 1 -- 172.21.15.173:0/3167753331 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f800bd10 con 0x7fa41015ba20 2024-04-25T09:07:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa414a00640 1 --2- 172.21.15.173:0/3167753331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3f8003fc0 0x7fa3f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa415400640 1 --2- 172.21.15.173:0/3167753331 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa41015ba20 0x7fa3f80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.382+0000 7fa415e00640 1 --2- 172.21.15.173:0/3167753331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f8004d50 0x7fa3f80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.386+0000 7fa414a00640 1 -- 172.21.15.173:0/3167753331 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa41015ba20 msgr2=0x7fa3f80039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.386+0000 7fa414a00640 1 --2- 172.21.15.173:0/3167753331 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa41015ba20 0x7fa3f80039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.386+0000 7fa414a00640 1 -- 172.21.15.173:0/3167753331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f8004d50 msgr2=0x7fa3f80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.386+0000 7fa414a00640 1 --2- 172.21.15.173:0/3167753331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f8004d50 0x7fa3f80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.386+0000 7fa414a00640 1 -- 172.21.15.173:0/3167753331 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f8003530 con 0x7fa3f8003fc0 2024-04-25T09:07:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.386+0000 7fa415e00640 1 --2- 172.21.15.173:0/3167753331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f8004d50 0x7fa3f80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.386+0000 7fa414a00640 1 --2- 172.21.15.173:0/3167753331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3f8003fc0 0x7fa3f8004810 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00c110 tx=0x7fa3fc01f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1542d44158248dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.386+0000 7fa40fe00640 1 -- 172.21.15.173:0/3167753331 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc007c30 con 0x7fa3f8003fc0 2024-04-25T09:07:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.386+0000 7fa40fe00640 1 -- 172.21.15.173:0/3167753331 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc0ac020 con 0x7fa3f8003fc0 2024-04-25T09:07:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.386+0000 7fa40fe00640 1 -- 172.21.15.173:0/3167753331 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc0a8e50 con 0x7fa3f8003fc0 2024-04-25T09:07:30.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.386+0000 7fa417e00640 1 -- 172.21.15.173:0/3167753331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3f8003fc0 msgr2=0x7fa3f8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.386+0000 7fa417e00640 1 --2- 172.21.15.173:0/3167753331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3f8003fc0 0x7fa3f8004810 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00c110 tx=0x7fa3fc01f230 comp rx=0 tx=0).stop 2024-04-25T09:07:30.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.386+0000 7fa415e00640 1 -- 172.21.15.173:0/3167753331 reap_dead start 2024-04-25T09:07:30.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.386+0000 7fa417e00640 1 -- 172.21.15.173:0/3167753331 shutdown_connections 2024-04-25T09:07:30.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.386+0000 7fa417e00640 1 -- 172.21.15.173:0/3167753331 >> 172.21.15.173:0/3167753331 conn(0x7fa410061880 msgr2=0x7fa410061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:30.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.386+0000 7fa417e00640 1 -- 172.21.15.173:0/3167753331 shutdown_connections 2024-04-25T09:07:30.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.386+0000 7fa417e00640 1 -- 172.21.15.173:0/3167753331 wait complete. 2024-04-25T09:07:30.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa417e00640 1 Processor -- start 2024-04-25T09:07:30.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa417e00640 1 -- start start 2024-04-25T09:07:30.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa417e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3f8003fc0 0x7fa4101f0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa417e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4101ece70 0x7fa410158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa417e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4101ed2f0 0x7fa410158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa417e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100701f0 con 0x7fa3f8003fc0 2024-04-25T09:07:30.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa417e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa410070070 con 0x7fa4101ed2f0 2024-04-25T09:07:30.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa417e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41015e720 con 0x7fa4101ece70 2024-04-25T09:07:30.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa415400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3f8003fc0 0x7fa4101f0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa415400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3f8003fc0 0x7fa4101f0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48772/0 (socket says 172.21.15.173:48772) 2024-04-25T09:07:30.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa415400640 1 -- 172.21.15.173:0/461622194 learned_addr learned my addr 172.21.15.173:0/461622194 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:30.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa414a00640 1 --2- 172.21.15.173:0/461622194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4101ece70 0x7fa410158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa415e00640 1 --2- 172.21.15.173:0/461622194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4101ed2f0 0x7fa410158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa415400640 1 -- 172.21.15.173:0/461622194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4101ece70 msgr2=0x7fa410158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa415400640 1 --2- 172.21.15.173:0/461622194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4101ece70 0x7fa410158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa415400640 1 -- 172.21.15.173:0/461622194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4101ed2f0 msgr2=0x7fa410158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa415400640 1 --2- 172.21.15.173:0/461622194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4101ed2f0 0x7fa410158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa415400640 1 -- 172.21.15.173:0/461622194 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4100d1460 con 0x7fa3f8003fc0 2024-04-25T09:07:30.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa415400640 1 --2- 172.21.15.173:0/461622194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3f8003fc0 0x7fa4101f0530 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fa404011a00 tx=0x7fa404011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:30.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa40d600640 1 -- 172.21.15.173:0/461622194 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40400fb50 con 0x7fa3f8003fc0 2024-04-25T09:07:30.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa40d600640 1 -- 172.21.15.173:0/461622194 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40400fcf0 con 0x7fa3f8003fc0 2024-04-25T09:07:30.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa417e00640 1 -- 172.21.15.173:0/461622194 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4101f0a70 con 0x7fa3f8003fc0 2024-04-25T09:07:30.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa40d600640 1 -- 172.21.15.173:0/461622194 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40400fea0 con 0x7fa3f8003fc0 2024-04-25T09:07:30.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.390+0000 7fa417e00640 1 -- 172.21.15.173:0/461622194 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4100cff60 con 0x7fa3f8003fc0 2024-04-25T09:07:30.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.394+0000 7fa417e00640 1 -- 172.21.15.173:0/461622194 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa410073a40 con 0x7fa3f8003fc0 2024-04-25T09:07:30.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.394+0000 7fa40d600640 1 -- 172.21.15.173:0/461622194 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa404012040 con 0x7fa3f8003fc0 2024-04-25T09:07:30.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.394+0000 7fa40d600640 1 --2- 172.21.15.173:0/461622194 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa3f0066f60 0x7fa3f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.394+0000 7fa40d600640 1 -- 172.21.15.173:0/461622194 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fa404085710 con 0x7fa3f8003fc0 2024-04-25T09:07:30.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.394+0000 7fa414a00640 1 --2- 172.21.15.173:0/461622194 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa3f0066f60 0x7fa3f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.394+0000 7fa414a00640 1 --2- 172.21.15.173:0/461622194 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa3f0066f60 0x7fa3f0069420 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0ad000 tx=0x7fa3fc0b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.398+0000 7fa40d600640 1 -- 172.21.15.173:0/461622194 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa404019030 con 0x7fa3f8003fc0 2024-04-25T09:07:30.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:30.606+0000 7fa417e00640 1 -- 172.21.15.173:0/461622194 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) v1 -- 0x7fa4100cefc0 con 0x7fa3f8003fc0 2024-04-25T09:07:31.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.566+0000 7fa40d600640 1 -- 172.21.15.173:0/461622194 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v249) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa404056860 con 0x7fa3f8003fc0 2024-04-25T09:07:31.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.570+0000 7fa417e00640 1 -- 172.21.15.173:0/461622194 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa3f0066f60 msgr2=0x7fa3f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.570+0000 7fa417e00640 1 --2- 172.21.15.173:0/461622194 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa3f0066f60 0x7fa3f0069420 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0ad000 tx=0x7fa3fc0b3040 comp rx=0 tx=0).stop 2024-04-25T09:07:31.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.570+0000 7fa417e00640 1 -- 172.21.15.173:0/461622194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3f8003fc0 msgr2=0x7fa4101f0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.570+0000 7fa417e00640 1 --2- 172.21.15.173:0/461622194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3f8003fc0 0x7fa4101f0530 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fa404011a00 tx=0x7fa404011ec0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.570+0000 7fa417e00640 1 -- 172.21.15.173:0/461622194 shutdown_connections 2024-04-25T09:07:31.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.570+0000 7fa417e00640 1 --2- 172.21.15.173:0/461622194 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa3f0066f60 0x7fa3f0069420 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.570+0000 7fa417e00640 1 --2- 172.21.15.173:0/461622194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4101ed2f0 0x7fa410158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.570+0000 7fa417e00640 1 --2- 172.21.15.173:0/461622194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4101ece70 0x7fa410158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.570+0000 7fa417e00640 1 --2- 172.21.15.173:0/461622194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3f8003fc0 0x7fa4101f0530 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.570+0000 7fa417e00640 1 -- 172.21.15.173:0/461622194 >> 172.21.15.173:0/461622194 conn(0x7fa410061880 msgr2=0x7fa4100cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:31.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.570+0000 7fa417e00640 1 -- 172.21.15.173:0/461622194 shutdown_connections 2024-04-25T09:07:31.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.570+0000 7fa417e00640 1 -- 172.21.15.173:0/461622194 wait complete. 2024-04-25T09:07:31.580 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:07:31.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.734+0000 7f4b97000640 1 Processor -- start 2024-04-25T09:07:31.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.734+0000 7f4b97000640 1 -- start start 2024-04-25T09:07:31.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.734+0000 7f4b97000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b900cc030 0x7f4b9015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.734+0000 7f4b97000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4b90163460 0x7f4b90165850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b97000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b900b11b0 con 0x7f4b900d22f0 2024-04-25T09:07:31.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b97000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b90071d40 con 0x7f4b90163460 2024-04-25T09:07:31.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b97000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b90070d30 con 0x7f4b900cc030 2024-04-25T09:07:31.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b87e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4b900d22f0 0x7f4b900cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39372/0 (socket says 172.21.15.173:39372) 2024-04-25T09:07:31.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b87e00640 1 -- 172.21.15.173:0/167961461 learned_addr learned my addr 172.21.15.173:0/167961461 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:31.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b95000640 1 --2- 172.21.15.173:0/167961461 >> v2:172.21.15.194:3300/0 conn(0x7f4b90163460 0x7f4b90165850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b8fe00640 1 --2- 172.21.15.173:0/167961461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b900cc030 0x7f4b9015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b8f400640 1 -- 172.21.15.173:0/167961461 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98765430 0 0) 0x7f4b900b11b0 con 0x7f4b900d22f0 2024-04-25T09:07:31.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b8f400640 1 -- 172.21.15.173:0/167961461 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b74003530 con 0x7f4b900d22f0 2024-04-25T09:07:31.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b8f400640 1 -- 172.21.15.173:0/167961461 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2510076245 0 0) 0x7f4b74003530 con 0x7f4b900d22f0 2024-04-25T09:07:31.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b8f400640 1 -- 172.21.15.173:0/167961461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b900cc030 msgr2=0x7f4b9015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:31.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b8f400640 1 --2- 172.21.15.173:0/167961461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b900cc030 0x7f4b9015c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b8f400640 1 -- 172.21.15.173:0/167961461 >> v2:172.21.15.194:3300/0 conn(0x7f4b90163460 msgr2=0x7f4b90165850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:31.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b8f400640 1 --2- 172.21.15.173:0/167961461 >> v2:172.21.15.194:3300/0 conn(0x7f4b90163460 0x7f4b90165850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b8f400640 1 -- 172.21.15.173:0/167961461 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b90070f80 con 0x7f4b900d22f0 2024-04-25T09:07:31.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b8f400640 1 -- 172.21.15.173:0/167961461 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f4b78001680 con 0x7f4b900d22f0 2024-04-25T09:07:31.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b8f400640 1 -- 172.21.15.173:0/167961461 >> v1:172.21.15.173:6789/0 conn(0x7f4b900d22f0 legacy=0x7f4b900cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b8f400640 1 --2- 172.21.15.173:0/167961461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b900cc030 0x7f4b740039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b8f400640 1 --2- 172.21.15.173:0/167961461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b74003f40 0x7f4b74004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b8f400640 1 --2- 172.21.15.173:0/167961461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b74004d50 0x7f4b740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b8f400640 1 -- 172.21.15.173:0/167961461 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b90070d30 con 0x7f4b74004d50 2024-04-25T09:07:31.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b8f400640 1 -- 172.21.15.173:0/167961461 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7400ba30 con 0x7f4b74003f40 2024-04-25T09:07:31.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b8f400640 1 -- 172.21.15.173:0/167961461 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7400bc30 con 0x7f4b900cc030 2024-04-25T09:07:31.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b95000640 1 --2- 172.21.15.173:0/167961461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b74004d50 0x7f4b740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b8fe00640 1 --2- 172.21.15.173:0/167961461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b900cc030 0x7f4b740039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b87e00640 1 --2- 172.21.15.173:0/167961461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b74003f40 0x7f4b74004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b95000640 1 -- 172.21.15.173:0/167961461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b900cc030 msgr2=0x7f4b740039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:31.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b95000640 1 --2- 172.21.15.173:0/167961461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b900cc030 0x7f4b740039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b95000640 1 -- 172.21.15.173:0/167961461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b74003f40 msgr2=0x7f4b74004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:31.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b95000640 1 --2- 172.21.15.173:0/167961461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b74003f40 0x7f4b74004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.738+0000 7f4b95000640 1 -- 172.21.15.173:0/167961461 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b74003530 con 0x7f4b74004d50 2024-04-25T09:07:31.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.742+0000 7f4b95000640 1 --2- 172.21.15.173:0/167961461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b74004d50 0x7f4b740051d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f4b900b3410 tx=0x7f4b8801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcac27966208e7d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:31.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.742+0000 7f4b8f400640 1 -- 172.21.15.173:0/167961461 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b880b2070 con 0x7f4b74004d50 2024-04-25T09:07:31.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.742+0000 7f4b8f400640 1 -- 172.21.15.173:0/167961461 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b880a5a50 con 0x7f4b74004d50 2024-04-25T09:07:31.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.742+0000 7f4b8f400640 1 -- 172.21.15.173:0/167961461 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b88009c10 con 0x7f4b74004d50 2024-04-25T09:07:31.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.742+0000 7f4b97000640 1 -- 172.21.15.173:0/167961461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b74004d50 msgr2=0x7f4b740051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.742+0000 7f4b97000640 1 --2- 172.21.15.173:0/167961461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b74004d50 0x7f4b740051d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f4b900b3410 tx=0x7f4b8801cc60 comp rx=0 tx=0).stop 2024-04-25T09:07:31.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.742+0000 7f4b95000640 1 -- 172.21.15.173:0/167961461 reap_dead start 2024-04-25T09:07:31.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.742+0000 7f4b97000640 1 -- 172.21.15.173:0/167961461 shutdown_connections 2024-04-25T09:07:31.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.742+0000 7f4b97000640 1 -- 172.21.15.173:0/167961461 >> 172.21.15.173:0/167961461 conn(0x7f4b900d17d0 msgr2=0x7f4b900d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:31.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.742+0000 7f4b97000640 1 -- 172.21.15.173:0/167961461 shutdown_connections 2024-04-25T09:07:31.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.742+0000 7f4b97000640 1 -- 172.21.15.173:0/167961461 wait complete. 2024-04-25T09:07:31.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.742+0000 7f4b97000640 1 Processor -- start 2024-04-25T09:07:31.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.742+0000 7f4b97000640 1 -- start start 2024-04-25T09:07:31.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b97000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b74004d50 0x7f4b901f48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b97000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b90152e80 0x7f4b90159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b97000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b900cf2a0 0x7f4b900cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b97000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900d03b0 con 0x7f4b900cf2a0 2024-04-25T09:07:31.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b97000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9015cce0 con 0x7f4b90152e80 2024-04-25T09:07:31.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b97000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900d0530 con 0x7f4b74004d50 2024-04-25T09:07:31.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b95000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b900cf2a0 0x7f4b900cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b95000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b900cf2a0 0x7f4b900cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48780/0 (socket says 172.21.15.173:48780) 2024-04-25T09:07:31.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b95000640 1 -- 172.21.15.173:0/594378379 learned_addr learned my addr 172.21.15.173:0/594378379 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:31.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b8fe00640 1 --2- 172.21.15.173:0/594378379 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b74004d50 0x7f4b901f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b87e00640 1 --2- 172.21.15.173:0/594378379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b90152e80 0x7f4b90159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b95000640 1 -- 172.21.15.173:0/594378379 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b74004d50 msgr2=0x7f4b901f48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b95000640 1 --2- 172.21.15.173:0/594378379 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b74004d50 0x7f4b901f48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b95000640 1 -- 172.21.15.173:0/594378379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b90152e80 msgr2=0x7f4b90159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b95000640 1 --2- 172.21.15.173:0/594378379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b90152e80 0x7f4b90159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b95000640 1 -- 172.21.15.173:0/594378379 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b90159ed0 con 0x7f4b900cf2a0 2024-04-25T09:07:31.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b95000640 1 --2- 172.21.15.173:0/594378379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b900cf2a0 0x7f4b900cf720 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f4b88002240 tx=0x7f4b88009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:31.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b8cc00640 1 -- 172.21.15.173:0/594378379 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b880bd070 con 0x7f4b900cf2a0 2024-04-25T09:07:31.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b8cc00640 1 -- 172.21.15.173:0/594378379 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b880a5850 con 0x7f4b900cf2a0 2024-04-25T09:07:31.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b8cc00640 1 -- 172.21.15.173:0/594378379 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b880b2040 con 0x7f4b900cf2a0 2024-04-25T09:07:31.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b97000640 1 -- 172.21.15.173:0/594378379 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9015a170 con 0x7f4b900cf2a0 2024-04-25T09:07:31.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b97000640 1 -- 172.21.15.173:0/594378379 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9015a730 con 0x7f4b900cf2a0 2024-04-25T09:07:31.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b97000640 1 -- 172.21.15.173:0/594378379 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b90073ab0 con 0x7f4b900cf2a0 2024-04-25T09:07:31.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.746+0000 7f4b8cc00640 1 -- 172.21.15.173:0/594378379 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4b88003bc0 con 0x7f4b900cf2a0 2024-04-25T09:07:31.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.750+0000 7f4b8cc00640 1 --2- 172.21.15.173:0/594378379 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4b6c066f60 0x7f4b6c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.750+0000 7f4b8cc00640 1 -- 172.21.15.173:0/594378379 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f4b8811ed60 con 0x7f4b900cf2a0 2024-04-25T09:07:31.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.750+0000 7f4b8fe00640 1 --2- 172.21.15.173:0/594378379 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4b6c066f60 0x7f4b6c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.750+0000 7f4b8fe00640 1 --2- 172.21.15.173:0/594378379 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4b6c066f60 0x7f4b6c069420 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009ae0 tx=0x7f4b80008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:31.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.754+0000 7f4b8cc00640 1 -- 172.21.15.173:0/594378379 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4b88016970 con 0x7f4b900cf2a0 2024-04-25T09:07:31.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.906+0000 7f4b97000640 1 -- 172.21.15.173:0/594378379 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4b9015b3a0 con 0x7f4b900cf2a0 2024-04-25T09:07:31.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.910+0000 7f4b8cc00640 1 -- 172.21.15.173:0/594378379 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4b880a5a20 con 0x7f4b900cf2a0 2024-04-25T09:07:31.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.910+0000 7f4b97000640 1 -- 172.21.15.173:0/594378379 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4b6c066f60 msgr2=0x7f4b6c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.910+0000 7f4b97000640 1 --2- 172.21.15.173:0/594378379 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4b6c066f60 0x7f4b6c069420 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009ae0 tx=0x7f4b80008040 comp rx=0 tx=0).stop 2024-04-25T09:07:31.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.910+0000 7f4b97000640 1 -- 172.21.15.173:0/594378379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b900cf2a0 msgr2=0x7f4b900cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.910+0000 7f4b97000640 1 --2- 172.21.15.173:0/594378379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b900cf2a0 0x7f4b900cf720 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f4b88002240 tx=0x7f4b88009750 comp rx=0 tx=0).stop 2024-04-25T09:07:31.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.910+0000 7f4b97000640 1 -- 172.21.15.173:0/594378379 shutdown_connections 2024-04-25T09:07:31.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.910+0000 7f4b97000640 1 --2- 172.21.15.173:0/594378379 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4b6c066f60 0x7f4b6c069420 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.910+0000 7f4b97000640 1 --2- 172.21.15.173:0/594378379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b900cf2a0 0x7f4b900cf720 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.910+0000 7f4b97000640 1 --2- 172.21.15.173:0/594378379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b90152e80 0x7f4b90159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.910+0000 7f4b97000640 1 --2- 172.21.15.173:0/594378379 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b74004d50 0x7f4b901f48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.910+0000 7f4b97000640 1 -- 172.21.15.173:0/594378379 >> 172.21.15.173:0/594378379 conn(0x7f4b900d17d0 msgr2=0x7f4b900d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:31.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.910+0000 7f4b97000640 1 -- 172.21.15.173:0/594378379 shutdown_connections 2024-04-25T09:07:31.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:31.910+0000 7f4b97000640 1 -- 172.21.15.173:0/594378379 wait complete. 2024-04-25T09:07:31.920 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:07:31.920 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:07:31.998 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:07:32.088 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:07:32.088 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:07:32.088 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:32.096 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:07:32.096 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:07:32.096 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:32.105 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:07:32.105 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:07:32.105 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:32.147 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:07:32.147 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:07:32.147 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:32.157 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:07:32.157 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:07:32.157 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:32.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.334+0000 7f7ef1000640 1 Processor -- start 2024-04-25T09:07:32.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.334+0000 7f7ef1000640 1 -- start start 2024-04-25T09:07:32.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.334+0000 7f7ef1000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7eec0b3e70 0x7f7eec0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.334+0000 7f7ef1000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7eec0aefa0 0x7f7eec0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.334+0000 7f7ef1000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7eec15edd0 0x7f7eec0b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.334+0000 7f7ef1000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eec06dd50 con 0x7f7eec0b3e70 2024-04-25T09:07:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.334+0000 7f7ef1000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eec0b4790 con 0x7f7eec0aefa0 2024-04-25T09:07:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.334+0000 7f7ef1000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec15f320 con 0x7f7eec15edd0 2024-04-25T09:07:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.334+0000 7f7ee9e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7eec0b3e70 0x7f7eec0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.334+0000 7f7ee9e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7eec0b3e70 0x7f7eec0b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48788/0 (socket says 172.21.15.173:48788) 2024-04-25T09:07:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.334+0000 7f7ee9e00640 1 -- 172.21.15.173:0/3416554481 learned_addr learned my addr 172.21.15.173:0/3416554481 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.334+0000 7f7ee1400640 1 --2- 172.21.15.173:0/3416554481 >> v2:172.21.15.194:3300/0 conn(0x7f7eec0aefa0 0x7f7eec0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.334+0000 7f7eea800640 1 --2- 172.21.15.173:0/3416554481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7eec15edd0 0x7f7eec0b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.334+0000 7f7ee9e00640 1 -- 172.21.15.173:0/3416554481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7eec15edd0 msgr2=0x7f7eec0b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.334+0000 7f7ee9e00640 1 --2- 172.21.15.173:0/3416554481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7eec15edd0 0x7f7eec0b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.334+0000 7f7ee9e00640 1 -- 172.21.15.173:0/3416554481 >> v2:172.21.15.194:3300/0 conn(0x7f7eec0aefa0 msgr2=0x7f7eec0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.334+0000 7f7ee9e00640 1 --2- 172.21.15.173:0/3416554481 >> v2:172.21.15.194:3300/0 conn(0x7f7eec0aefa0 0x7f7eec0b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.334+0000 7f7ee9e00640 1 -- 172.21.15.173:0/3416554481 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec06d420 con 0x7f7eec0b3e70 2024-04-25T09:07:32.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.338+0000 7f7ee9e00640 1 --2- 172.21.15.173:0/3416554481 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7eec0b3e70 0x7f7eec0b4250 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0d0650 tx=0x7f7edc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5791baa7e2a54cfc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:32.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.338+0000 7f7ee9400640 1 -- 172.21.15.173:0/3416554481 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0aa430 con 0x7f7eec0b3e70 2024-04-25T09:07:32.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.338+0000 7f7ee9400640 1 -- 172.21.15.173:0/3416554481 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc0af070 con 0x7f7eec0b3e70 2024-04-25T09:07:32.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.338+0000 7f7ee9400640 1 -- 172.21.15.173:0/3416554481 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0aa7f0 con 0x7f7eec0b3e70 2024-04-25T09:07:32.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.338+0000 7f7ef1000640 1 -- 172.21.15.173:0/3416554481 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7eec0b3e70 msgr2=0x7f7eec0b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.338+0000 7f7ef1000640 1 --2- 172.21.15.173:0/3416554481 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7eec0b3e70 0x7f7eec0b4250 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0d0650 tx=0x7f7edc01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.338+0000 7f7ef1000640 1 -- 172.21.15.173:0/3416554481 shutdown_connections 2024-04-25T09:07:32.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.338+0000 7f7ef1000640 1 --2- 172.21.15.173:0/3416554481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7eec15edd0 0x7f7eec0b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.338+0000 7f7ef1000640 1 --2- 172.21.15.173:0/3416554481 >> v2:172.21.15.194:3300/0 conn(0x7f7eec0aefa0 0x7f7eec0b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.338+0000 7f7ef1000640 1 --2- 172.21.15.173:0/3416554481 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7eec0b3e70 0x7f7eec0b4250 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.338+0000 7f7ef1000640 1 -- 172.21.15.173:0/3416554481 >> 172.21.15.173:0/3416554481 conn(0x7f7eec06ac90 msgr2=0x7f7eec06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:32.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.338+0000 7f7ef1000640 1 -- 172.21.15.173:0/3416554481 shutdown_connections 2024-04-25T09:07:32.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.338+0000 7f7ef1000640 1 -- 172.21.15.173:0/3416554481 wait complete. 2024-04-25T09:07:32.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7ef1000640 1 Processor -- start 2024-04-25T09:07:32.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7ef1000640 1 -- start start 2024-04-25T09:07:32.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7ef1000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7eec0aefa0 0x7f7eec1400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7ef1000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7eec0b3e70 0x7f7eec150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7ef1000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7eec15edd0 0x7f7eec1507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7ef1000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec06e1e0 con 0x7f7eec15edd0 2024-04-25T09:07:32.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7ef1000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec0b3600 con 0x7f7eec0b3e70 2024-04-25T09:07:32.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7ef1000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec06e360 con 0x7f7eec0aefa0 2024-04-25T09:07:32.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7eea800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7eec15edd0 0x7f7eec1507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7eea800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7eec15edd0 0x7f7eec1507b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48798/0 (socket says 172.21.15.173:48798) 2024-04-25T09:07:32.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7eea800640 1 -- 172.21.15.173:0/966578060 learned_addr learned my addr 172.21.15.173:0/966578060 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:32.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7ee9e00640 1 --2- 172.21.15.173:0/966578060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7eec0aefa0 0x7f7eec1400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7ee1400640 1 --2- 172.21.15.173:0/966578060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7eec0b3e70 0x7f7eec150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7eea800640 1 -- 172.21.15.173:0/966578060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7eec0aefa0 msgr2=0x7f7eec1400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7eea800640 1 --2- 172.21.15.173:0/966578060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7eec0aefa0 0x7f7eec1400e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7eea800640 1 -- 172.21.15.173:0/966578060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7eec0b3e70 msgr2=0x7f7eec150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7eea800640 1 --2- 172.21.15.173:0/966578060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7eec0b3e70 0x7f7eec150270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7eea800640 1 -- 172.21.15.173:0/966578060 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec1562b0 con 0x7f7eec15edd0 2024-04-25T09:07:32.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7ee1400640 1 --2- 172.21.15.173:0/966578060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7eec0b3e70 0x7f7eec150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:32.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7eea800640 1 --2- 172.21.15.173:0/966578060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7eec15edd0 0x7f7eec1507b0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4007e90 tx=0x7f7ee400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:32.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7ee2a00640 1 -- 172.21.15.173:0/966578060 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4014420 con 0x7f7eec15edd0 2024-04-25T09:07:32.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7ee2a00640 1 -- 172.21.15.173:0/966578060 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee4019070 con 0x7f7eec15edd0 2024-04-25T09:07:32.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7ef1000640 1 -- 172.21.15.173:0/966578060 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eec156590 con 0x7f7eec15edd0 2024-04-25T09:07:32.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7ee2a00640 1 -- 172.21.15.173:0/966578060 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4014800 con 0x7f7eec15edd0 2024-04-25T09:07:32.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.342+0000 7f7ef1000640 1 -- 172.21.15.173:0/966578060 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eec156b50 con 0x7f7eec15edd0 2024-04-25T09:07:32.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.346+0000 7f7ef1000640 1 -- 172.21.15.173:0/966578060 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eec073a40 con 0x7f7eec15edd0 2024-04-25T09:07:32.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.346+0000 7f7ee2a00640 1 -- 172.21.15.173:0/966578060 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7ee40149a0 con 0x7f7eec15edd0 2024-04-25T09:07:32.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.346+0000 7f7ee2a00640 1 --2- 172.21.15.173:0/966578060 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7ec8066f60 0x7f7ec8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.346+0000 7f7ee2a00640 1 -- 172.21.15.173:0/966578060 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f7ee4085750 con 0x7f7eec15edd0 2024-04-25T09:07:32.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.346+0000 7f7ee9e00640 1 --2- 172.21.15.173:0/966578060 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7ec8066f60 0x7f7ec8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.346+0000 7f7ee9e00640 1 --2- 172.21.15.173:0/966578060 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7ec8066f60 0x7f7ec8069420 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0ae000 tx=0x7f7edc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:32.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.350+0000 7f7ee2a00640 1 -- 172.21.15.173:0/966578060 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7ee40567e0 con 0x7f7eec15edd0 2024-04-25T09:07:32.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.534+0000 7f7ef1000640 1 -- 172.21.15.173:0/966578060 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7eec06e540 con 0x7f7eec15edd0 2024-04-25T09:07:32.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.534+0000 7f7ee2a00640 1 -- 172.21.15.173:0/966578060 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+3708 (secure 0 0 0) 0x7f7ee40560e0 con 0x7f7eec15edd0 2024-04-25T09:07:32.523 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:32.523 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":48,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/894026798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":894026798},{"type":"v1","addr":"172.21.15.194:6833","nonce":894026798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2000586494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2000586494},{"type":"v1","addr":"172.21.15.194:6835","nonce":2000586494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3382962588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3382962588},{"type":"v1","addr":"172.21.15.173:6837","nonce":3382962588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7167,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/1836726378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1836726378},{"type":"v1","addr":"172.21.15.173:6836","nonce":1836726378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[]} 2024-04-25T09:07:32.524 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 48 2024-04-25T09:07:32.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.538+0000 7f7ef1000640 1 -- 172.21.15.173:0/966578060 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7ec8066f60 msgr2=0x7f7ec8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.538+0000 7f7ef1000640 1 --2- 172.21.15.173:0/966578060 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7ec8066f60 0x7f7ec8069420 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0ae000 tx=0x7f7edc0a7000 comp rx=0 tx=0).stop 2024-04-25T09:07:32.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.538+0000 7f7ef1000640 1 -- 172.21.15.173:0/966578060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7eec15edd0 msgr2=0x7f7eec1507b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.538+0000 7f7ef1000640 1 --2- 172.21.15.173:0/966578060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7eec15edd0 0x7f7eec1507b0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4007e90 tx=0x7f7ee400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.538+0000 7f7ef1000640 1 -- 172.21.15.173:0/966578060 shutdown_connections 2024-04-25T09:07:32.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.538+0000 7f7ef1000640 1 --2- 172.21.15.173:0/966578060 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7ec8066f60 0x7f7ec8069420 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.538+0000 7f7ef1000640 1 --2- 172.21.15.173:0/966578060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7eec15edd0 0x7f7eec1507b0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.538+0000 7f7ef1000640 1 --2- 172.21.15.173:0/966578060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7eec0b3e70 0x7f7eec150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.538+0000 7f7ef1000640 1 --2- 172.21.15.173:0/966578060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7eec0aefa0 0x7f7eec1400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.538+0000 7f7ef1000640 1 -- 172.21.15.173:0/966578060 >> 172.21.15.173:0/966578060 conn(0x7f7eec06ac90 msgr2=0x7f7eec155780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:32.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.538+0000 7f7ef1000640 1 -- 172.21.15.173:0/966578060 shutdown_connections 2024-04-25T09:07:32.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.538+0000 7f7ef1000640 1 -- 172.21.15.173:0/966578060 wait complete. 2024-04-25T09:07:32.544 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:07:32.544 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:07:32.545 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:07:32.545 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:32.545 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:07:32.545 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:07:32.545 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:07:32.545 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:32.545 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:07:32.545 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:07:32.546 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:07:32.546 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:32.546 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:07:32.546 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:07:32.546 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:07:32.546 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:32.562 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:07:32.563 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:07:32.564 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:07:32.564 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:07:32.567 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:07:32.567 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:07:32.568 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:07:32.568 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:07:32.609 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:07:32.610 DEBUG:teuthology.parallel:result is None 2024-04-25T09:07:32.611 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:07:32.611 DEBUG:teuthology.parallel:result is None 2024-04-25T09:07:32.612 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:07:32.613 DEBUG:teuthology.parallel:result is None 2024-04-25T09:07:32.614 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:07:32.614 DEBUG:teuthology.parallel:result is None 2024-04-25T09:07:32.615 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:07:32.695 INFO:tasks.ceph.mds.c.smithi173.stdout:starting mds.c at 2024-04-25T09:07:32.698 INFO:tasks.ceph.mds.a.smithi173.stdout:starting mds.a at 2024-04-25T09:07:32.706 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-04-25T09:07:32.707 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-04-25T09:07:32.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.770+0000 7fab4de00640 1 Processor -- start 2024-04-25T09:07:32.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.770+0000 7fab4de00640 1 -- start start 2024-04-25T09:07:32.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.774+0000 7fab4de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fab480cc7e0 0x7fab480cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.774+0000 7fab4de00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab48071570 con 0x7fab480aef70 2024-04-25T09:07:32.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.774+0000 7fab4de00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab48071850 con 0x7fab480aeb90 2024-04-25T09:07:32.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.774+0000 7fab4de00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab48071320 con 0x7fab480cc7e0 2024-04-25T09:07:32.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.774+0000 7fab47400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fab480aef70 0x7fab4815af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39398/0 (socket says 172.21.15.173:39398) 2024-04-25T09:07:32.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.774+0000 7fab47400640 1 -- 172.21.15.173:0/3038760379 learned_addr learned my addr 172.21.15.173:0/3038760379 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:32.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.774+0000 7fab46000640 1 --2- 172.21.15.173:0/3038760379 >> v2:172.21.15.194:3300/0 conn(0x7fab480cc7e0 0x7fab480cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.774+0000 7fab45600640 1 -- 172.21.15.173:0/3038760379 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405741213 0 0) 0x7fab48071570 con 0x7fab480aef70 2024-04-25T09:07:32.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.774+0000 7fab45600640 1 -- 172.21.15.173:0/3038760379 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab2c003530 con 0x7fab480aef70 2024-04-25T09:07:32.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.774+0000 7fab45600640 1 -- 172.21.15.173:0/3038760379 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618154191 0 0) 0x7fab48071850 con 0x7fab480aeb90 2024-04-25T09:07:32.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.774+0000 7fab45600640 1 -- 172.21.15.173:0/3038760379 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab48071570 con 0x7fab480aeb90 2024-04-25T09:07:32.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.774+0000 7fab46000640 1 -- 172.21.15.173:0/3038760379 >> v1:172.21.15.194:6789/0 conn(0x7fab480aeb90 legacy=0x7fab480cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.774+0000 7fab45600640 1 -- 172.21.15.173:0/3038760379 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2876789767 0 0) 0x7fab2c003530 con 0x7fab480aef70 2024-04-25T09:07:32.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.774+0000 7fab46000640 1 -- 172.21.15.173:0/3038760379 >> v1:172.21.15.173:6789/0 conn(0x7fab480aef70 legacy=0x7fab4815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.774+0000 7fab46000640 1 -- 172.21.15.173:0/3038760379 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab48071b30 con 0x7fab480cc7e0 2024-04-25T09:07:32.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.778+0000 7fab46000640 1 --2- 172.21.15.173:0/3038760379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480cc7e0 0x7fab480cdba0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fab340097c0 tx=0x7fab3401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c186a5efd7daa85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:32.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.778+0000 7fab45600640 1 -- 172.21.15.173:0/3038760379 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340b0070 con 0x7fab480cc7e0 2024-04-25T09:07:32.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.778+0000 7fab45600640 1 -- 172.21.15.173:0/3038760379 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab340a4e50 con 0x7fab480cc7e0 2024-04-25T09:07:32.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.778+0000 7fab45600640 1 -- 172.21.15.173:0/3038760379 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40001a20 con 0x7fab480cc7e0 2024-04-25T09:07:32.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.778+0000 7fab4de00640 1 -- 172.21.15.173:0/3038760379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480cc7e0 msgr2=0x7fab480cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.778+0000 7fab4de00640 1 --2- 172.21.15.173:0/3038760379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480cc7e0 0x7fab480cdba0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fab340097c0 tx=0x7fab3401c330 comp rx=0 tx=0).stop 2024-04-25T09:07:32.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.778+0000 7fab4de00640 1 -- 172.21.15.173:0/3038760379 shutdown_connections 2024-04-25T09:07:32.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.778+0000 7fab4de00640 1 --2- 172.21.15.173:0/3038760379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480cc7e0 0x7fab480cdba0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.778+0000 7fab4de00640 1 -- 172.21.15.173:0/3038760379 >> 172.21.15.173:0/3038760379 conn(0x7fab4806ac90 msgr2=0x7fab4806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:32.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.778+0000 7fab4de00640 1 -- 172.21.15.173:0/3038760379 shutdown_connections 2024-04-25T09:07:32.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.778+0000 7fab4de00640 1 -- 172.21.15.173:0/3038760379 wait complete. 2024-04-25T09:07:32.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.778+0000 7fab4de00640 1 Processor -- start 2024-04-25T09:07:32.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.778+0000 7fab4de00640 1 -- start start 2024-04-25T09:07:32.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab4de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aeb90 0x7fab4814fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab4de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab480aef70 0x7fab48149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab4de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480cc7e0 0x7fab48155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab4de00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab481688b0 con 0x7fab480aeb90 2024-04-25T09:07:32.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab4de00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab48168730 con 0x7fab480cc7e0 2024-04-25T09:07:32.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab4de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab48168a30 con 0x7fab480aef70 2024-04-25T09:07:32.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab46a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aeb90 0x7fab4814fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab46a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aeb90 0x7fab4814fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48836/0 (socket says 172.21.15.173:48836) 2024-04-25T09:07:32.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab46a00640 1 -- 172.21.15.173:0/2058489835 learned_addr learned my addr 172.21.15.173:0/2058489835 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:32.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab47400640 1 --2- 172.21.15.173:0/2058489835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480cc7e0 0x7fab48155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab46000640 1 --2- 172.21.15.173:0/2058489835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab480aef70 0x7fab48149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab46a00640 1 -- 172.21.15.173:0/2058489835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab480aef70 msgr2=0x7fab48149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab46a00640 1 --2- 172.21.15.173:0/2058489835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab480aef70 0x7fab48149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab46a00640 1 -- 172.21.15.173:0/2058489835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480cc7e0 msgr2=0x7fab48155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab46a00640 1 --2- 172.21.15.173:0/2058489835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480cc7e0 0x7fab48155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab46a00640 1 -- 172.21.15.173:0/2058489835 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab481501b0 con 0x7fab480aeb90 2024-04-25T09:07:32.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab46a00640 1 --2- 172.21.15.173:0/2058489835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aeb90 0x7fab4814fc70 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fab3800c430 tx=0x7fab3800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:32.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab3f400640 1 -- 172.21.15.173:0/2058489835 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38017070 con 0x7fab480aeb90 2024-04-25T09:07:32.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab3f400640 1 -- 172.21.15.173:0/2058489835 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab380052f0 con 0x7fab480aeb90 2024-04-25T09:07:32.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab4de00640 1 -- 172.21.15.173:0/2058489835 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab481525a0 con 0x7fab480aeb90 2024-04-25T09:07:32.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab3f400640 1 -- 172.21.15.173:0/2058489835 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38003840 con 0x7fab480aeb90 2024-04-25T09:07:32.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab4de00640 1 -- 172.21.15.173:0/2058489835 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab48152b60 con 0x7fab480aeb90 2024-04-25T09:07:32.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.782+0000 7fab4de00640 1 -- 172.21.15.173:0/2058489835 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab48073ab0 con 0x7fab480aeb90 2024-04-25T09:07:32.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.786+0000 7fab3f400640 1 -- 172.21.15.173:0/2058489835 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fab3801a070 con 0x7fab480aeb90 2024-04-25T09:07:32.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.786+0000 7fab3f400640 1 --2- 172.21.15.173:0/2058489835 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fab28066f60 0x7fab28069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.786+0000 7fab3f400640 1 -- 172.21.15.173:0/2058489835 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fab38084290 con 0x7fab480aeb90 2024-04-25T09:07:32.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.786+0000 7fab46000640 1 --2- 172.21.15.173:0/2058489835 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fab28066f60 0x7fab28069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.786+0000 7fab46000640 1 --2- 172.21.15.173:0/2058489835 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fab28066f60 0x7fab28069420 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fab340ad000 tx=0x7fab340a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:32.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.790+0000 7fab3f400640 1 -- 172.21.15.173:0/2058489835 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fab38054d70 con 0x7fab480aeb90 2024-04-25T09:07:32.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:32.954+0000 7fab4de00640 1 -- 172.21.15.173:0/2058489835 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fab480b3ae0 con 0x7fab480aeb90 2024-04-25T09:07:33.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.582+0000 7fab3f400640 1 -- 172.21.15.173:0/2058489835 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v78) v1 ==== 97+0+0 (secure 0 0 0) 0x7fab38058e10 con 0x7fab480aeb90 2024-04-25T09:07:33.568 INFO:teuthology.orchestra.run.smithi173.stderr: removed all blocklist entries 2024-04-25T09:07:33.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.582+0000 7fab4de00640 1 -- 172.21.15.173:0/2058489835 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fab28066f60 msgr2=0x7fab28069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.582+0000 7fab4de00640 1 --2- 172.21.15.173:0/2058489835 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fab28066f60 0x7fab28069420 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fab340ad000 tx=0x7fab340a6000 comp rx=0 tx=0).stop 2024-04-25T09:07:33.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.582+0000 7fab4de00640 1 -- 172.21.15.173:0/2058489835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aeb90 msgr2=0x7fab4814fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.582+0000 7fab4de00640 1 --2- 172.21.15.173:0/2058489835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aeb90 0x7fab4814fc70 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fab3800c430 tx=0x7fab3800c8f0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.582+0000 7fab4de00640 1 -- 172.21.15.173:0/2058489835 shutdown_connections 2024-04-25T09:07:33.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.582+0000 7fab4de00640 1 --2- 172.21.15.173:0/2058489835 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fab28066f60 0x7fab28069420 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.582+0000 7fab4de00640 1 --2- 172.21.15.173:0/2058489835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480cc7e0 0x7fab48155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.582+0000 7fab4de00640 1 --2- 172.21.15.173:0/2058489835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab480aef70 0x7fab48149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.582+0000 7fab4de00640 1 --2- 172.21.15.173:0/2058489835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aeb90 0x7fab4814fc70 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.582+0000 7fab4de00640 1 -- 172.21.15.173:0/2058489835 >> 172.21.15.173:0/2058489835 conn(0x7fab4806ac90 msgr2=0x7fab480b3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:33.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.582+0000 7fab4de00640 1 -- 172.21.15.173:0/2058489835 shutdown_connections 2024-04-25T09:07:33.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.582+0000 7fab4de00640 1 -- 172.21.15.173:0/2058489835 wait complete. 2024-04-25T09:07:33.595 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:07:33.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.742+0000 7f0e8f400640 1 Processor -- start 2024-04-25T09:07:33.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.742+0000 7f0e8f400640 1 -- start start 2024-04-25T09:07:33.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e8f400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e8815dc60 0x7f0e880b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e8f400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0e8815e040 0x7f0e880ace10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e8f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0e880ad350 0x7f0e880ae810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e8f400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e88071450 con 0x7f0e880ad350 2024-04-25T09:07:33.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e8f400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e8815e8e0 con 0x7f0e8815e040 2024-04-25T09:07:33.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e8f400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8815ebc0 con 0x7f0e8815dc60 2024-04-25T09:07:33.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e8d400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0e880ad350 0x7f0e880ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e8d400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0e880ad350 0x7f0e880ae810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41374/0 (socket says 172.21.15.173:41374) 2024-04-25T09:07:33.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e8d400640 1 -- 172.21.15.173:0/305253371 learned_addr learned my addr 172.21.15.173:0/305253371 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:33.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e87e00640 1 --2- 172.21.15.173:0/305253371 >> v2:172.21.15.194:3300/0 conn(0x7f0e8815e040 0x7f0e880ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e8ca00640 1 --2- 172.21.15.173:0/305253371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e8815dc60 0x7f0e880b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e8d400640 1 -- 172.21.15.173:0/305253371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e8815dc60 msgr2=0x7f0e880b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:33.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e8d400640 1 --2- 172.21.15.173:0/305253371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e8815dc60 0x7f0e880b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e8d400640 1 -- 172.21.15.173:0/305253371 >> v2:172.21.15.194:3300/0 conn(0x7f0e8815e040 msgr2=0x7f0e880ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:33.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e8d400640 1 --2- 172.21.15.173:0/305253371 >> v2:172.21.15.194:3300/0 conn(0x7f0e8815e040 0x7f0e880ace10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e8d400640 1 -- 172.21.15.173:0/305253371 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8815eea0 con 0x7f0e880ad350 2024-04-25T09:07:33.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e87e00640 1 --2- 172.21.15.173:0/305253371 >> v2:172.21.15.194:3300/0 conn(0x7f0e8815e040 0x7f0e880ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:33.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e8ca00640 1 --2- 172.21.15.173:0/305253371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e8815dc60 0x7f0e880b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:33.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.746+0000 7f0e8d400640 1 --2- 172.21.15.173:0/305253371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e880ad350 0x7f0e880ae810 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f0e88062550 tx=0x7f0e8001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88508f50a0a1f623 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:33.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e87400640 1 -- 172.21.15.173:0/305253371 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800b2070 con 0x7f0e880ad350 2024-04-25T09:07:33.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e87400640 1 -- 172.21.15.173:0/305253371 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e800a9070 con 0x7f0e880ad350 2024-04-25T09:07:33.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e87400640 1 -- 172.21.15.173:0/305253371 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800ad880 con 0x7f0e880ad350 2024-04-25T09:07:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8f400640 1 -- 172.21.15.173:0/305253371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e880ad350 msgr2=0x7f0e880ae810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8f400640 1 --2- 172.21.15.173:0/305253371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e880ad350 0x7f0e880ae810 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f0e88062550 tx=0x7f0e8001c520 comp rx=0 tx=0).stop 2024-04-25T09:07:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8f400640 1 -- 172.21.15.173:0/305253371 shutdown_connections 2024-04-25T09:07:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8f400640 1 --2- 172.21.15.173:0/305253371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e880ad350 0x7f0e880ae810 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8f400640 1 --2- 172.21.15.173:0/305253371 >> v2:172.21.15.194:3300/0 conn(0x7f0e8815e040 0x7f0e880ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8f400640 1 --2- 172.21.15.173:0/305253371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e8815dc60 0x7f0e880b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8f400640 1 -- 172.21.15.173:0/305253371 >> 172.21.15.173:0/305253371 conn(0x7f0e8806ac90 msgr2=0x7f0e8806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8f400640 1 -- 172.21.15.173:0/305253371 shutdown_connections 2024-04-25T09:07:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8f400640 1 -- 172.21.15.173:0/305253371 wait complete. 2024-04-25T09:07:33.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8f400640 1 Processor -- start 2024-04-25T09:07:33.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8f400640 1 -- start start 2024-04-25T09:07:33.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e880ad350 0x7f0e880cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8f400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e8815dc60 0x7f0e88166ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e8815e040 0x7f0e88157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8f400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e880720d0 con 0x7f0e8815e040 2024-04-25T09:07:33.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8f400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8815e670 con 0x7f0e880ad350 2024-04-25T09:07:33.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8f400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e88072250 con 0x7f0e8815dc60 2024-04-25T09:07:33.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e8815e040 0x7f0e88157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e8815e040 0x7f0e88157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41378/0 (socket says 172.21.15.173:41378) 2024-04-25T09:07:33.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8d400640 1 -- 172.21.15.173:0/2125943734 learned_addr learned my addr 172.21.15.173:0/2125943734 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:33.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e8ca00640 1 --2- 172.21.15.173:0/2125943734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e880ad350 0x7f0e880cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.750+0000 7f0e87e00640 1 --2- 172.21.15.173:0/2125943734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e8815dc60 0x7f0e88166ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.754+0000 7f0e8d400640 1 -- 172.21.15.173:0/2125943734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e8815dc60 msgr2=0x7f0e88166ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.754+0000 7f0e8d400640 1 --2- 172.21.15.173:0/2125943734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e8815dc60 0x7f0e88166ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.754+0000 7f0e8d400640 1 -- 172.21.15.173:0/2125943734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e880ad350 msgr2=0x7f0e880cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.754+0000 7f0e8d400640 1 --2- 172.21.15.173:0/2125943734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e880ad350 0x7f0e880cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.754+0000 7f0e8d400640 1 -- 172.21.15.173:0/2125943734 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e88167420 con 0x7f0e8815e040 2024-04-25T09:07:33.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.754+0000 7f0e8ca00640 1 --2- 172.21.15.173:0/2125943734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e880ad350 0x7f0e880cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:33.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.754+0000 7f0e8d400640 1 --2- 172.21.15.173:0/2125943734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e8815e040 0x7f0e88157ec0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0e8001cdc0 tx=0x7f0e800192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:33.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.754+0000 7f0e84c00640 1 -- 172.21.15.173:0/2125943734 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800b2040 con 0x7f0e8815e040 2024-04-25T09:07:33.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.754+0000 7f0e84c00640 1 -- 172.21.15.173:0/2125943734 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e800bb070 con 0x7f0e8815e040 2024-04-25T09:07:33.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.754+0000 7f0e84c00640 1 -- 172.21.15.173:0/2125943734 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800b6890 con 0x7f0e8815e040 2024-04-25T09:07:33.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.754+0000 7f0e8f400640 1 -- 172.21.15.173:0/2125943734 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e880ce320 con 0x7f0e8815e040 2024-04-25T09:07:33.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.754+0000 7f0e8f400640 1 -- 172.21.15.173:0/2125943734 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e880cc7b0 con 0x7f0e8815e040 2024-04-25T09:07:33.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.754+0000 7f0e8f400640 1 -- 172.21.15.173:0/2125943734 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e88073a40 con 0x7f0e8815e040 2024-04-25T09:07:33.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.754+0000 7f0e84c00640 1 -- 172.21.15.173:0/2125943734 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0e800ab070 con 0x7f0e8815e040 2024-04-25T09:07:33.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.754+0000 7f0e84c00640 1 --2- 172.21.15.173:0/2125943734 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e68066f60 0x7f0e68069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.754+0000 7f0e84c00640 1 -- 172.21.15.173:0/2125943734 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f0e8011e6c0 con 0x7f0e8815e040 2024-04-25T09:07:33.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.758+0000 7f0e8ca00640 1 --2- 172.21.15.173:0/2125943734 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e68066f60 0x7f0e68069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.758+0000 7f0e8ca00640 1 --2- 172.21.15.173:0/2125943734 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e68066f60 0x7f0e68069420 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0e78007130 tx=0x7f0e78007670 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:33.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.758+0000 7f0e84c00640 1 -- 172.21.15.173:0/2125943734 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0e800c4020 con 0x7f0e8815e040 2024-04-25T09:07:33.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.966+0000 7f0e8f400640 1 -- 172.21.15.173:0/2125943734 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0e8806c300 con 0x7f0e8815e040 2024-04-25T09:07:33.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.966+0000 7f0e84c00640 1 -- 172.21.15.173:0/2125943734 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f0e80016110 con 0x7f0e8815e040 2024-04-25T09:07:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:33.956 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:07:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: "auth_dump": [ 2024-04-25T09:07:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.a", 2024-04-25T09:07:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmnVr3EhAAn+C0Mb/MrYSZuQyr5QTXig==", 2024-04-25T09:07:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:07:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:07:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:07:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:07:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:07:33.956 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.b", 2024-04-25T09:07:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6Gypm0QfFHhAAuP8xE/8pvSZMcP8N33OB9Q==", 2024-04-25T09:07:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:07:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:07:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:07:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:07:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:07:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.c", 2024-04-25T09:07:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmQsv4GRAATNiD7udOvl8xRDIx64O5jg==", 2024-04-25T09:07:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:07:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:07:33.957 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:07:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:07:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:07:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.d", 2024-04-25T09:07:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmtGMSJhAAonqLeuSsNrgyZks1eoJ1Gg==", 2024-04-25T09:07:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.958 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:07:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:07:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:07:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:07:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:07:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.0", 2024-04-25T09:07:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD9Gypm+Yw7LBAAnOFUKU3w1ltre7aHMWZ/SQ==", 2024-04-25T09:07:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:07:33.959 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:07:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:07:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:07:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.1", 2024-04-25T09:07:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAAHCpm4BUIOBAAmbfWUWCun/una5WoemhL6Q==", 2024-04-25T09:07:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:07:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:07:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:07:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.960 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:07:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.2", 2024-04-25T09:07:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAEHCpmFXIaBRAA0cN2GdLSS3jJC+x4RVUUlw==", 2024-04-25T09:07:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:07:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:07:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:07:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.961 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:07:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.3", 2024-04-25T09:07:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAHHCpmUD+YDxAALPvf1wLzhuQmFPo3/vJkdQ==", 2024-04-25T09:07:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:07:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:07:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:07:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.962 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:07:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.4", 2024-04-25T09:07:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQANHCpmLQ0fCBAA1Shz0Pfns+rj5r601hzOnQ==", 2024-04-25T09:07:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:07:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:07:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:07:33.963 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:07:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.5", 2024-04-25T09:07:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAQHCpmyMj1ERAAMRvZ3PFQa9oe6oGemLvfxw==", 2024-04-25T09:07:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:07:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:07:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:07:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.964 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:07:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.6", 2024-04-25T09:07:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQATHCpmKha6GxAAF4zfdFDlylGHHhGI5tVpGA==", 2024-04-25T09:07:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:07:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:07:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:07:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.965 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:07:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.7", 2024-04-25T09:07:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAWHCpmB2lFJhAA3sYYsjS5DIC5fCDz6ur0tA==", 2024-04-25T09:07:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:07:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:07:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:07:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.966 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:07:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.0", 2024-04-25T09:07:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w==", 2024-04-25T09:07:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:07:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow r", 2024-04-25T09:07:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:07:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.967 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:07:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.1", 2024-04-25T09:07:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6Gypm1PbHMxAAXMrgpR/xgzfQuuNrculQxA==", 2024-04-25T09:07:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:07:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:07:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:07:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:07:33.968 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:07:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.2", 2024-04-25T09:07:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmrTxjMBAAaqwDl5uiLxhaDIk7m6oDIw==", 2024-04-25T09:07:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:07:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:07:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:07:33.969 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:07:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:07:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.3", 2024-04-25T09:07:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmlAS9ORAAvYbwLnUaDHXOqvEBwJJJcQ==", 2024-04-25T09:07:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:07:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:07:33.970 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:07:33.971 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:07:33.971 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.971 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:07:33.971 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.971 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.admin", 2024-04-25T09:07:33.971 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD5GypmYFhkMhAACwSsE+B9l263vnlJ0LjFkQ==", 2024-04-25T09:07:33.971 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.971 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:07:33.971 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:07:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:07:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:07:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:07:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mgr.x", 2024-04-25T09:07:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmMSqHDhAAe0nkrXbT7dBbAbI89ExUmw==", 2024-04-25T09:07:33.972 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.973 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:07:33.973 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile mgr", 2024-04-25T09:07:33.973 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:07:33.973 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.973 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:07:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mgr.y", 2024-04-25T09:07:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmjCuzChAAomjH5vLVICqSFpyDVQeB4w==", 2024-04-25T09:07:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:07:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:07:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile mgr", 2024-04-25T09:07:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:07:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:33.974 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-04-25T09:07:33.974 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:07:33.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.970+0000 7f0e8f400640 1 -- 172.21.15.173:0/2125943734 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e68066f60 msgr2=0x7f0e68069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.970+0000 7f0e8f400640 1 --2- 172.21.15.173:0/2125943734 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e68066f60 0x7f0e68069420 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0e78007130 tx=0x7f0e78007670 comp rx=0 tx=0).stop 2024-04-25T09:07:33.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.970+0000 7f0e8f400640 1 -- 172.21.15.173:0/2125943734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e8815e040 msgr2=0x7f0e88157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.970+0000 7f0e8f400640 1 --2- 172.21.15.173:0/2125943734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e8815e040 0x7f0e88157ec0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0e8001cdc0 tx=0x7f0e800192c0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.970+0000 7f0e8f400640 1 -- 172.21.15.173:0/2125943734 shutdown_connections 2024-04-25T09:07:33.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.970+0000 7f0e8f400640 1 --2- 172.21.15.173:0/2125943734 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e68066f60 0x7f0e68069420 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.970+0000 7f0e8f400640 1 --2- 172.21.15.173:0/2125943734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e8815e040 0x7f0e88157ec0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.970+0000 7f0e8f400640 1 --2- 172.21.15.173:0/2125943734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e8815dc60 0x7f0e88166ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.970+0000 7f0e8f400640 1 --2- 172.21.15.173:0/2125943734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e880ad350 0x7f0e880cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.970+0000 7f0e8f400640 1 -- 172.21.15.173:0/2125943734 >> 172.21.15.173:0/2125943734 conn(0x7f0e8806ac90 msgr2=0x7f0e880ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:33.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.970+0000 7f0e8f400640 1 -- 172.21.15.173:0/2125943734 shutdown_connections 2024-04-25T09:07:33.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:33.970+0000 7f0e8f400640 1 -- 172.21.15.173:0/2125943734 wait complete. 2024-04-25T09:07:33.977 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:34.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.126+0000 7f7609800640 1 Processor -- start 2024-04-25T09:07:34.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.126+0000 7f7609800640 1 -- start start 2024-04-25T09:07:34.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.126+0000 7f7609800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f760415dbb0 0x7f760415df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.126+0000 7f7609800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f760406f830 0x7f760406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.126+0000 7f7609800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760406d870 con 0x7f76040d2130 2024-04-25T09:07:34.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.126+0000 7f7609800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76040701e0 con 0x7f760406f830 2024-04-25T09:07:34.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.126+0000 7f7609800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76040d2590 con 0x7f760415dbb0 2024-04-25T09:07:34.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.126+0000 7f7603400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f760406f830 0x7f760406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.126+0000 7f7603400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f760406f830 0x7f760406fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41380/0 (socket says 172.21.15.173:41380) 2024-04-25T09:07:34.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.126+0000 7f7603400640 1 -- 172.21.15.173:0/1571163799 learned_addr learned my addr 172.21.15.173:0/1571163799 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:34.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.126+0000 7f7602a00640 1 --2- 172.21.15.173:0/1571163799 >> v2:172.21.15.194:3300/0 conn(0x7f760415dbb0 0x7f760415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.126+0000 7f7603400640 1 -- 172.21.15.173:0/1571163799 >> v2:172.21.15.194:3300/0 conn(0x7f760415dbb0 msgr2=0x7f760415df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:34.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.126+0000 7f7603400640 1 --2- 172.21.15.173:0/1571163799 >> v2:172.21.15.194:3300/0 conn(0x7f760415dbb0 0x7f760415df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.126+0000 7f7603400640 1 -- 172.21.15.173:0/1571163799 >> v1:172.21.15.194:6789/0 conn(0x7f76040d2130 legacy=0x7f760406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:34.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.126+0000 7f7603400640 1 -- 172.21.15.173:0/1571163799 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7604161690 con 0x7f760406f830 2024-04-25T09:07:34.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.130+0000 7f7603400640 1 --2- 172.21.15.173:0/1571163799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760406f830 0x7f760406fca0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f76040625e0 tx=0x7f75fc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e5b350ed2aa896 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:34.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.130+0000 7f7601600640 1 -- 172.21.15.173:0/1571163799 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0aa610 con 0x7f760406f830 2024-04-25T09:07:34.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.130+0000 7f7601600640 1 -- 172.21.15.173:0/1571163799 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc0af070 con 0x7f760406f830 2024-04-25T09:07:34.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.130+0000 7f7601600640 1 -- 172.21.15.173:0/1571163799 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0aa9d0 con 0x7f760406f830 2024-04-25T09:07:34.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.130+0000 7f7609800640 1 -- 172.21.15.173:0/1571163799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760406f830 msgr2=0x7f760406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.130+0000 7f7609800640 1 --2- 172.21.15.173:0/1571163799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760406f830 0x7f760406fca0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f76040625e0 tx=0x7f75fc01c4b0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.130+0000 7f7609800640 1 -- 172.21.15.173:0/1571163799 shutdown_connections 2024-04-25T09:07:34.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.130+0000 7f7609800640 1 --2- 172.21.15.173:0/1571163799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760406f830 0x7f760406fca0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.130+0000 7f7609800640 1 --2- 172.21.15.173:0/1571163799 >> v2:172.21.15.194:3300/0 conn(0x7f760415dbb0 0x7f760415df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.130+0000 7f7609800640 1 -- 172.21.15.173:0/1571163799 >> 172.21.15.173:0/1571163799 conn(0x7f7604061880 msgr2=0x7f7604061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:34.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.130+0000 7f7609800640 1 -- 172.21.15.173:0/1571163799 shutdown_connections 2024-04-25T09:07:34.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.130+0000 7f7609800640 1 -- 172.21.15.173:0/1571163799 wait complete. 2024-04-25T09:07:34.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7609800640 1 Processor -- start 2024-04-25T09:07:34.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7609800640 1 -- start start 2024-04-25T09:07:34.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7609800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f760406f830 0x7f76040ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7609800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76040d2130 0x7f76040cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7609800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760415dbb0 0x7f76040c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7609800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760415ee60 con 0x7f760415dbb0 2024-04-25T09:07:34.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7609800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760406c980 con 0x7f76040d2130 2024-04-25T09:07:34.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7609800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760416a990 con 0x7f760406f830 2024-04-25T09:07:34.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7603400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760415dbb0 0x7f76040c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7602a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f760406f830 0x7f76040ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7602a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f760406f830 0x7f76040ca7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:60074/0 (socket says 172.21.15.173:60074) 2024-04-25T09:07:34.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7603400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760415dbb0 0x7f76040c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41382/0 (socket says 172.21.15.173:41382) 2024-04-25T09:07:34.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7602a00640 1 -- 172.21.15.173:0/2262066465 learned_addr learned my addr 172.21.15.173:0/2262066465 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:34.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7602000640 1 --2- 172.21.15.173:0/2262066465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76040d2130 0x7f76040cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7603400640 1 -- 172.21.15.173:0/2262066465 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f760406f830 msgr2=0x7f76040ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7603400640 1 --2- 172.21.15.173:0/2262066465 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f760406f830 0x7f76040ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7603400640 1 -- 172.21.15.173:0/2262066465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76040d2130 msgr2=0x7f76040cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7603400640 1 --2- 172.21.15.173:0/2262066465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76040d2130 0x7f76040cd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7603400640 1 -- 172.21.15.173:0/2262066465 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76040cdc30 con 0x7f760415dbb0 2024-04-25T09:07:34.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7603400640 1 --2- 172.21.15.173:0/2262066465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760415dbb0 0x7f76040c8ac0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0ab000 tx=0x7f75fc01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:34.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f75faa00640 1 -- 172.21.15.173:0/2262066465 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0bd5f0 con 0x7f760415dbb0 2024-04-25T09:07:34.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f75faa00640 1 -- 172.21.15.173:0/2262066465 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc0bd790 con 0x7f760415dbb0 2024-04-25T09:07:34.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7609800640 1 -- 172.21.15.173:0/2262066465 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76040cb640 con 0x7f760415dbb0 2024-04-25T09:07:34.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f75faa00640 1 -- 172.21.15.173:0/2262066465 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0bdb80 con 0x7f760415dbb0 2024-04-25T09:07:34.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7609800640 1 -- 172.21.15.173:0/2262066465 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76040cb080 con 0x7f760415dbb0 2024-04-25T09:07:34.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.134+0000 7f7609800640 1 -- 172.21.15.173:0/2262066465 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7604073a40 con 0x7f760415dbb0 2024-04-25T09:07:34.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.138+0000 7f75faa00640 1 -- 172.21.15.173:0/2262066465 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f75fc0b33f0 con 0x7f760415dbb0 2024-04-25T09:07:34.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.138+0000 7f75faa00640 1 --2- 172.21.15.173:0/2262066465 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f75e4066f60 0x7f75e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.138+0000 7f75faa00640 1 -- 172.21.15.173:0/2262066465 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f75fc11f9c0 con 0x7f760415dbb0 2024-04-25T09:07:34.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.138+0000 7f7602a00640 1 --2- 172.21.15.173:0/2262066465 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f75e4066f60 0x7f75e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.138+0000 7f7602a00640 1 --2- 172.21.15.173:0/2262066465 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f75e4066f60 0x7f75e4069420 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f75f4003b90 tx=0x7f75f40098d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:34.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.142+0000 7f75faa00640 1 -- 172.21.15.173:0/2262066465 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f75fc0c3060 con 0x7f760415dbb0 2024-04-25T09:07:34.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.298+0000 7f7609800640 1 -- 172.21.15.173:0/2262066465 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f760406e620 con 0x7f760415dbb0 2024-04-25T09:07:34.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.298+0000 7f75faa00640 1 -- 172.21.15.173:0/2262066465 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+13225 (secure 0 0 0) 0x7f76040cdc30 con 0x7f760415dbb0 2024-04-25T09:07:34.285 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:34.285 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":80,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:07:33.590192+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:34.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.298+0000 7f7609800640 1 -- 172.21.15.173:0/2262066465 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f75e4066f60 msgr2=0x7f75e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.298+0000 7f7609800640 1 --2- 172.21.15.173:0/2262066465 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f75e4066f60 0x7f75e4069420 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f75f4003b90 tx=0x7f75f40098d0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.298+0000 7f7609800640 1 -- 172.21.15.173:0/2262066465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760415dbb0 msgr2=0x7f76040c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.298+0000 7f7609800640 1 --2- 172.21.15.173:0/2262066465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760415dbb0 0x7f76040c8ac0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0ab000 tx=0x7f75fc01acf0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.298+0000 7f7609800640 1 -- 172.21.15.173:0/2262066465 shutdown_connections 2024-04-25T09:07:34.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.298+0000 7f7609800640 1 --2- 172.21.15.173:0/2262066465 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f75e4066f60 0x7f75e4069420 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.298+0000 7f7609800640 1 --2- 172.21.15.173:0/2262066465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760415dbb0 0x7f76040c8ac0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.298+0000 7f7609800640 1 --2- 172.21.15.173:0/2262066465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76040d2130 0x7f76040cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.298+0000 7f7609800640 1 --2- 172.21.15.173:0/2262066465 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f760406f830 0x7f76040ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.298+0000 7f7609800640 1 -- 172.21.15.173:0/2262066465 >> 172.21.15.173:0/2262066465 conn(0x7f7604061880 msgr2=0x7f7604061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:34.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.298+0000 7f7609800640 1 -- 172.21.15.173:0/2262066465 shutdown_connections 2024-04-25T09:07:34.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.298+0000 7f7609800640 1 -- 172.21.15.173:0/2262066465 wait complete. 2024-04-25T09:07:34.306 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:07:34.307 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:07:34.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.458+0000 7f1dc7000640 1 Processor -- start 2024-04-25T09:07:34.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.458+0000 7f1dc7000640 1 -- start start 2024-04-25T09:07:34.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.458+0000 7f1dc7000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1dc00b3fe0 0x7f1dc00b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.458+0000 7f1dc7000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dc00cc260 0x7f1dc00cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.458+0000 7f1dc7000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc006d4b0 con 0x7f1dc0145290 2024-04-25T09:07:34.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.458+0000 7f1dc7000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc006d790 con 0x7f1dc00b3fe0 2024-04-25T09:07:34.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.458+0000 7f1dc7000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc006da70 con 0x7f1dc00cc260 2024-04-25T09:07:34.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.458+0000 7f1db7400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1dc00b3fe0 0x7f1dc00b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.458+0000 7f1dbfe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f1dc0145290 0x7f1dc015c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:56904/0 (socket says 172.21.15.173:56904) 2024-04-25T09:07:34.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.458+0000 7f1dbfe00640 1 -- 172.21.15.173:0/2025296943 learned_addr learned my addr 172.21.15.173:0/2025296943 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:34.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.458+0000 7f1dc5000640 1 --2- 172.21.15.173:0/2025296943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dc00cc260 0x7f1dc00cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.458+0000 7f1db7400640 1 -- 172.21.15.173:0/2025296943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dc00cc260 msgr2=0x7f1dc00cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:34.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.458+0000 7f1db7400640 1 --2- 172.21.15.173:0/2025296943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dc00cc260 0x7f1dc00cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.458+0000 7f1db7400640 1 -- 172.21.15.173:0/2025296943 >> v1:172.21.15.173:6789/0 conn(0x7f1dc0145290 legacy=0x7f1dc015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.458+0000 7f1db7400640 1 -- 172.21.15.173:0/2025296943 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc006dd50 con 0x7f1dc00b3fe0 2024-04-25T09:07:34.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.458+0000 7f1dbf400640 1 -- 172.21.15.173:0/2025296943 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350829540 0 0) 0x7f1dc006d4b0 con 0x7f1dc0145290 2024-04-25T09:07:34.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.462+0000 7f1db7400640 1 --2- 172.21.15.173:0/2025296943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc00b3fe0 0x7f1dc00b4450 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f1da80097c0 tx=0x7f1da801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d62ba4f63f6636 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:34.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.462+0000 7f1dbf400640 1 -- 172.21.15.173:0/2025296943 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da80b0070 con 0x7f1dc00b3fe0 2024-04-25T09:07:34.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.462+0000 7f1dbf400640 1 -- 172.21.15.173:0/2025296943 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da80ab600 con 0x7f1dc00b3fe0 2024-04-25T09:07:34.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.462+0000 7f1dbf400640 1 -- 172.21.15.173:0/2025296943 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da80ab9d0 con 0x7f1dc00b3fe0 2024-04-25T09:07:34.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.462+0000 7f1dc7000640 1 -- 172.21.15.173:0/2025296943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc00b3fe0 msgr2=0x7f1dc00b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.462+0000 7f1dc7000640 1 --2- 172.21.15.173:0/2025296943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc00b3fe0 0x7f1dc00b4450 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f1da80097c0 tx=0x7f1da801c380 comp rx=0 tx=0).stop 2024-04-25T09:07:34.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.462+0000 7f1dc7000640 1 -- 172.21.15.173:0/2025296943 shutdown_connections 2024-04-25T09:07:34.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.462+0000 7f1dc7000640 1 --2- 172.21.15.173:0/2025296943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dc00cc260 0x7f1dc00cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.462+0000 7f1dc7000640 1 --2- 172.21.15.173:0/2025296943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc00b3fe0 0x7f1dc00b4450 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.462+0000 7f1dc7000640 1 -- 172.21.15.173:0/2025296943 >> 172.21.15.173:0/2025296943 conn(0x7f1dc006ac90 msgr2=0x7f1dc006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:34.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.462+0000 7f1dc7000640 1 -- 172.21.15.173:0/2025296943 shutdown_connections 2024-04-25T09:07:34.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.462+0000 7f1dc7000640 1 -- 172.21.15.173:0/2025296943 wait complete. 2024-04-25T09:07:34.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc7000640 1 Processor -- start 2024-04-25T09:07:34.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc7000640 1 -- start start 2024-04-25T09:07:34.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc7000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dc00b3fe0 0x7f1dc013d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc7000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1dc00cc260 0x7f1dc015a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc7000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc0145290 0x7f1dc015abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc7000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc006ed60 con 0x7f1dc0145290 2024-04-25T09:07:34.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc7000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc006eee0 con 0x7f1dc00cc260 2024-04-25T09:07:34.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc7000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc006f060 con 0x7f1dc00b3fe0 2024-04-25T09:07:34.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc5000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc0145290 0x7f1dc015abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc5000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc0145290 0x7f1dc015abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41390/0 (socket says 172.21.15.173:41390) 2024-04-25T09:07:34.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc5000640 1 -- 172.21.15.173:0/1861639817 learned_addr learned my addr 172.21.15.173:0/1861639817 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:34.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1db7400640 1 --2- 172.21.15.173:0/1861639817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1dc00cc260 0x7f1dc015a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dbfe00640 1 --2- 172.21.15.173:0/1861639817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dc00b3fe0 0x7f1dc013d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc5000640 1 -- 172.21.15.173:0/1861639817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dc00b3fe0 msgr2=0x7f1dc013d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc5000640 1 --2- 172.21.15.173:0/1861639817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dc00b3fe0 0x7f1dc013d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc5000640 1 -- 172.21.15.173:0/1861639817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1dc00cc260 msgr2=0x7f1dc015a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc5000640 1 --2- 172.21.15.173:0/1861639817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1dc00cc260 0x7f1dc015a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc5000640 1 -- 172.21.15.173:0/1861639817 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc0140240 con 0x7f1dc0145290 2024-04-25T09:07:34.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1db7400640 1 --2- 172.21.15.173:0/1861639817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1dc00cc260 0x7f1dc015a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:34.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc5000640 1 --2- 172.21.15.173:0/1861639817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc0145290 0x7f1dc015abf0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f1db8007e60 tx=0x7f1db800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:34.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dbcc00640 1 -- 172.21.15.173:0/1861639817 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db8014420 con 0x7f1dc0145290 2024-04-25T09:07:34.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dbcc00640 1 -- 172.21.15.173:0/1861639817 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db8019070 con 0x7f1dc0145290 2024-04-25T09:07:34.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dbcc00640 1 -- 172.21.15.173:0/1861639817 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db8014820 con 0x7f1dc0145290 2024-04-25T09:07:34.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc7000640 1 -- 172.21.15.173:0/1861639817 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc0140520 con 0x7f1dc0145290 2024-04-25T09:07:34.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc7000640 1 -- 172.21.15.173:0/1861639817 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc013c8b0 con 0x7f1dc0145290 2024-04-25T09:07:34.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.466+0000 7f1dc7000640 1 -- 172.21.15.173:0/1861639817 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc0073ab0 con 0x7f1dc0145290 2024-04-25T09:07:34.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.470+0000 7f1dbcc00640 1 -- 172.21.15.173:0/1861639817 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1db80149c0 con 0x7f1dc0145290 2024-04-25T09:07:34.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.470+0000 7f1dbcc00640 1 --2- 172.21.15.173:0/1861639817 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1d9c066f60 0x7f1d9c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.470+0000 7f1dbcc00640 1 -- 172.21.15.173:0/1861639817 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f1db8085650 con 0x7f1dc0145290 2024-04-25T09:07:34.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.470+0000 7f1dbfe00640 1 --2- 172.21.15.173:0/1861639817 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1d9c066f60 0x7f1d9c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.470+0000 7f1dbfe00640 1 --2- 172.21.15.173:0/1861639817 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1d9c066f60 0x7f1d9c069420 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1db0000f70 tx=0x7f1db0007df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:34.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.474+0000 7f1dbcc00640 1 -- 172.21.15.173:0/1861639817 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1db8056130 con 0x7f1dc0145290 2024-04-25T09:07:34.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.634+0000 7f1dc7000640 1 -- 172.21.15.173:0/1861639817 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1dc015e500 con 0x7f1dc0145290 2024-04-25T09:07:34.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.634+0000 7f1dbcc00640 1 -- 172.21.15.173:0/1861639817 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1db805a1d0 con 0x7f1dc0145290 2024-04-25T09:07:34.621 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:07:34.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.634+0000 7f1dc7000640 1 -- 172.21.15.173:0/1861639817 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1d9c066f60 msgr2=0x7f1d9c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.634+0000 7f1dc7000640 1 --2- 172.21.15.173:0/1861639817 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1d9c066f60 0x7f1d9c069420 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1db0000f70 tx=0x7f1db0007df0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.634+0000 7f1dc7000640 1 -- 172.21.15.173:0/1861639817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc0145290 msgr2=0x7f1dc015abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.634+0000 7f1dc7000640 1 --2- 172.21.15.173:0/1861639817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc0145290 0x7f1dc015abf0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f1db8007e60 tx=0x7f1db800e4b0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.634+0000 7f1dc7000640 1 -- 172.21.15.173:0/1861639817 shutdown_connections 2024-04-25T09:07:34.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.634+0000 7f1dc7000640 1 --2- 172.21.15.173:0/1861639817 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1d9c066f60 0x7f1d9c069420 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.634+0000 7f1dc7000640 1 --2- 172.21.15.173:0/1861639817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dc0145290 0x7f1dc015abf0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.634+0000 7f1dc7000640 1 --2- 172.21.15.173:0/1861639817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1dc00cc260 0x7f1dc015a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.634+0000 7f1dc7000640 1 --2- 172.21.15.173:0/1861639817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dc00b3fe0 0x7f1dc013d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.634+0000 7f1dc7000640 1 -- 172.21.15.173:0/1861639817 >> 172.21.15.173:0/1861639817 conn(0x7f1dc006ac90 msgr2=0x7f1dc015bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:34.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.634+0000 7f1dc7000640 1 -- 172.21.15.173:0/1861639817 shutdown_connections 2024-04-25T09:07:34.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.634+0000 7f1dc7000640 1 -- 172.21.15.173:0/1861639817 wait complete. 2024-04-25T09:07:34.642 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:07:34.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.790+0000 7f6f8ea00640 1 Processor -- start 2024-04-25T09:07:34.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.790+0000 7f6f8ea00640 1 -- start start 2024-04-25T09:07:34.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.790+0000 7f6f8ea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6f880af1e0 0x7f6f880affb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.790+0000 7f6f8ea00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8815dcc0 con 0x7f6f8806ac90 2024-04-25T09:07:34.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.790+0000 7f6f8ea00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f880b5310 con 0x7f6f880726f0 2024-04-25T09:07:34.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.790+0000 7f6f8ea00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f88072b50 con 0x7f6f880af1e0 2024-04-25T09:07:34.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f8d600640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f6f8806ac90 0x7f6f8806b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:56916/0 (socket says 172.21.15.173:56916) 2024-04-25T09:07:34.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f8d600640 1 -- 172.21.15.173:0/1413297401 learned_addr learned my addr 172.21.15.173:0/1413297401 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:34.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f8e000640 1 --2- 172.21.15.173:0/1413297401 >> v2:172.21.15.194:3300/0 conn(0x7f6f880af1e0 0x7f6f880affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f87e00640 1 -- 172.21.15.173:0/1413297401 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333490257 0 0) 0x7f6f8815dcc0 con 0x7f6f8806ac90 2024-04-25T09:07:34.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f87e00640 1 -- 172.21.15.173:0/1413297401 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f70003530 con 0x7f6f8806ac90 2024-04-25T09:07:34.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f87e00640 1 -- 172.21.15.173:0/1413297401 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361448022 0 0) 0x7f6f880b5310 con 0x7f6f880726f0 2024-04-25T09:07:34.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f87e00640 1 -- 172.21.15.173:0/1413297401 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f8815dcc0 con 0x7f6f880726f0 2024-04-25T09:07:34.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f87e00640 1 -- 172.21.15.173:0/1413297401 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1427701161 0 0) 0x7f6f70003530 con 0x7f6f8806ac90 2024-04-25T09:07:34.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f87e00640 1 -- 172.21.15.173:0/1413297401 >> v2:172.21.15.194:3300/0 conn(0x7f6f880af1e0 msgr2=0x7f6f880affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:34.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f87e00640 1 --2- 172.21.15.173:0/1413297401 >> v2:172.21.15.194:3300/0 conn(0x7f6f880af1e0 0x7f6f880affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f87e00640 1 -- 172.21.15.173:0/1413297401 >> v1:172.21.15.194:6789/0 conn(0x7f6f880726f0 legacy=0x7f6f8815e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f87e00640 1 -- 172.21.15.173:0/1413297401 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f880b55f0 con 0x7f6f8806ac90 2024-04-25T09:07:34.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f87e00640 1 -- 172.21.15.173:0/1413297401 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f6f7c001680 con 0x7f6f8806ac90 2024-04-25T09:07:34.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f87e00640 1 -- 172.21.15.173:0/1413297401 >> v1:172.21.15.173:6789/0 conn(0x7f6f8806ac90 legacy=0x7f6f8806b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f87e00640 1 --2- 172.21.15.173:0/1413297401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f70003b50 0x7f6f70003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f87e00640 1 --2- 172.21.15.173:0/1413297401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f70004810 0x7f6f70004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f87e00640 1 --2- 172.21.15.173:0/1413297401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f700051d0 0x7f6f7000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f87e00640 1 -- 172.21.15.173:0/1413297401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f88072b50 con 0x7f6f700051d0 2024-04-25T09:07:34.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f87e00640 1 -- 172.21.15.173:0/1413297401 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7000c050 con 0x7f6f70003b50 2024-04-25T09:07:34.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f87e00640 1 -- 172.21.15.173:0/1413297401 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7000c250 con 0x7f6f70004810 2024-04-25T09:07:34.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f8e000640 1 --2- 172.21.15.173:0/1413297401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f700051d0 0x7f6f7000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f8d600640 1 --2- 172.21.15.173:0/1413297401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f70003b50 0x7f6f70003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f8cc00640 1 --2- 172.21.15.173:0/1413297401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f70004810 0x7f6f70004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f8e000640 1 -- 172.21.15.173:0/1413297401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f70004810 msgr2=0x7f6f70004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:34.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f8e000640 1 --2- 172.21.15.173:0/1413297401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f70004810 0x7f6f70004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f8e000640 1 -- 172.21.15.173:0/1413297401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f70003b50 msgr2=0x7f6f70003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:34.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f8e000640 1 --2- 172.21.15.173:0/1413297401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f70003b50 0x7f6f70003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f8e000640 1 -- 172.21.15.173:0/1413297401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f70003530 con 0x7f6f700051d0 2024-04-25T09:07:34.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.794+0000 7f6f8cc00640 1 --2- 172.21.15.173:0/1413297401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f70004810 0x7f6f70004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:34.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.798+0000 7f6f8e000640 1 -- 172.21.15.173:0/1413297401 reap_dead start 2024-04-25T09:07:34.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.798+0000 7f6f8e000640 1 --2- 172.21.15.173:0/1413297401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f700051d0 0x7f6f7000b9d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009fc0 tx=0x7f6f8001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8461053969ba00ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:34.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.798+0000 7f6f87e00640 1 -- 172.21.15.173:0/1413297401 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f80009c10 con 0x7f6f700051d0 2024-04-25T09:07:34.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.798+0000 7f6f87e00640 1 -- 172.21.15.173:0/1413297401 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f800a5cd0 con 0x7f6f700051d0 2024-04-25T09:07:34.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.798+0000 7f6f87e00640 1 -- 172.21.15.173:0/1413297401 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f80003be0 con 0x7f6f700051d0 2024-04-25T09:07:34.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.798+0000 7f6f8ea00640 1 -- 172.21.15.173:0/1413297401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f700051d0 msgr2=0x7f6f7000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.798+0000 7f6f8ea00640 1 --2- 172.21.15.173:0/1413297401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f700051d0 0x7f6f7000b9d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009fc0 tx=0x7f6f8001ccc0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.798+0000 7f6f8ea00640 1 -- 172.21.15.173:0/1413297401 shutdown_connections 2024-04-25T09:07:34.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.798+0000 7f6f8ea00640 1 --2- 172.21.15.173:0/1413297401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f700051d0 0x7f6f7000b9d0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.798+0000 7f6f8ea00640 1 -- 172.21.15.173:0/1413297401 >> 172.21.15.173:0/1413297401 conn(0x7f6f880b60d0 msgr2=0x7f6f88099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:34.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.798+0000 7f6f8ea00640 1 -- 172.21.15.173:0/1413297401 shutdown_connections 2024-04-25T09:07:34.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.798+0000 7f6f8ea00640 1 -- 172.21.15.173:0/1413297401 wait complete. 2024-04-25T09:07:34.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.798+0000 7f6f8ea00640 1 Processor -- start 2024-04-25T09:07:34.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.798+0000 7f6f8ea00640 1 -- start start 2024-04-25T09:07:34.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8ea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f700051d0 0x7f6f88143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f881f44e0 0x7f6f881e7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f881e4b70 0x7f6f881e4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8ea00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8815e310 con 0x7f6f881f44e0 2024-04-25T09:07:34.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8ea00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f880b5170 con 0x7f6f700051d0 2024-04-25T09:07:34.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8ea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8815dfa0 con 0x7f6f881e4b70 2024-04-25T09:07:34.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8cc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f881f44e0 0x7f6f881e7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8cc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f881f44e0 0x7f6f881e7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41406/0 (socket says 172.21.15.173:41406) 2024-04-25T09:07:34.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8cc00640 1 -- 172.21.15.173:0/1135583836 learned_addr learned my addr 172.21.15.173:0/1135583836 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:34.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8d600640 1 --2- 172.21.15.173:0/1135583836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f700051d0 0x7f6f88143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8e000640 1 --2- 172.21.15.173:0/1135583836 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f881e4b70 0x7f6f881e4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8cc00640 1 -- 172.21.15.173:0/1135583836 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f881e4b70 msgr2=0x7f6f881e4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8cc00640 1 --2- 172.21.15.173:0/1135583836 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f881e4b70 0x7f6f881e4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8cc00640 1 -- 172.21.15.173:0/1135583836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f700051d0 msgr2=0x7f6f88143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8cc00640 1 --2- 172.21.15.173:0/1135583836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f700051d0 0x7f6f88143060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8cc00640 1 -- 172.21.15.173:0/1135583836 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f88156f30 con 0x7f6f881f44e0 2024-04-25T09:07:34.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8cc00640 1 --2- 172.21.15.173:0/1135583836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f881f44e0 0x7f6f881e7ff0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400e530 tx=0x7f6f7400e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:34.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f85600640 1 -- 172.21.15.173:0/1135583836 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f740052e0 con 0x7f6f881f44e0 2024-04-25T09:07:34.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f85600640 1 -- 172.21.15.173:0/1135583836 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f74007020 con 0x7f6f881f44e0 2024-04-25T09:07:34.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8ea00640 1 -- 172.21.15.173:0/1135583836 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f88157210 con 0x7f6f881f44e0 2024-04-25T09:07:34.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f85600640 1 -- 172.21.15.173:0/1135583836 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f74005480 con 0x7f6f881f44e0 2024-04-25T09:07:34.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8ea00640 1 -- 172.21.15.173:0/1135583836 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f881e8840 con 0x7f6f881f44e0 2024-04-25T09:07:34.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f8ea00640 1 -- 172.21.15.173:0/1135583836 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f881e5530 con 0x7f6f881f44e0 2024-04-25T09:07:34.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.802+0000 7f6f85600640 1 -- 172.21.15.173:0/1135583836 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6f7401a020 con 0x7f6f881f44e0 2024-04-25T09:07:34.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.806+0000 7f6f85600640 1 --2- 172.21.15.173:0/1135583836 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f68066f90 0x7f6f68069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.806+0000 7f6f85600640 1 -- 172.21.15.173:0/1135583836 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f6f74084370 con 0x7f6f881f44e0 2024-04-25T09:07:34.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.806+0000 7f6f8d600640 1 --2- 172.21.15.173:0/1135583836 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f68066f90 0x7f6f68069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.806+0000 7f6f8d600640 1 --2- 172.21.15.173:0/1135583836 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f68066f90 0x7f6f68069450 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c005180 tx=0x7f6f7c001bf0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:34.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.810+0000 7f6f85600640 1 -- 172.21.15.173:0/1135583836 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6f74054ee0 con 0x7f6f881f44e0 2024-04-25T09:07:34.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.966+0000 7f6f8ea00640 1 -- 172.21.15.173:0/1135583836 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6f88073a40 con 0x7f6f881f44e0 2024-04-25T09:07:34.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.966+0000 7f6f85600640 1 -- 172.21.15.173:0/1135583836 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6f74058f80 con 0x7f6f881f44e0 2024-04-25T09:07:34.954 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:34.954 INFO:teuthology.orchestra.run.smithi173.stdout:[ 2024-04-25T09:07:34.954 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:07:34.954 INFO:teuthology.orchestra.run.smithi173.stdout: "poolnum": 1, 2024-04-25T09:07:34.954 INFO:teuthology.orchestra.run.smithi173.stdout: "poolname": ".mgr" 2024-04-25T09:07:34.954 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:07:34.954 INFO:teuthology.orchestra.run.smithi173.stdout:] 2024-04-25T09:07:34.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.966+0000 7f6f8ea00640 1 -- 172.21.15.173:0/1135583836 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f68066f90 msgr2=0x7f6f68069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.966+0000 7f6f8ea00640 1 --2- 172.21.15.173:0/1135583836 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f68066f90 0x7f6f68069450 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c005180 tx=0x7f6f7c001bf0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.970+0000 7f6f8ea00640 1 -- 172.21.15.173:0/1135583836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f881f44e0 msgr2=0x7f6f881e7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.970+0000 7f6f8ea00640 1 --2- 172.21.15.173:0/1135583836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f881f44e0 0x7f6f881e7ff0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400e530 tx=0x7f6f7400e9f0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.970+0000 7f6f8ea00640 1 -- 172.21.15.173:0/1135583836 shutdown_connections 2024-04-25T09:07:34.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.970+0000 7f6f8ea00640 1 --2- 172.21.15.173:0/1135583836 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f68066f90 0x7f6f68069450 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.970+0000 7f6f8ea00640 1 --2- 172.21.15.173:0/1135583836 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f881e4b70 0x7f6f881e4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.970+0000 7f6f8ea00640 1 --2- 172.21.15.173:0/1135583836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f881f44e0 0x7f6f881e7ff0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.970+0000 7f6f8ea00640 1 --2- 172.21.15.173:0/1135583836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f700051d0 0x7f6f88143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.970+0000 7f6f8ea00640 1 -- 172.21.15.173:0/1135583836 >> 172.21.15.173:0/1135583836 conn(0x7f6f880b60d0 msgr2=0x7f6f8806e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:34.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.970+0000 7f6f8ea00640 1 -- 172.21.15.173:0/1135583836 shutdown_connections 2024-04-25T09:07:34.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:34.970+0000 7f6f8ea00640 1 -- 172.21.15.173:0/1135583836 wait complete. 2024-04-25T09:07:34.975 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:07:34.975 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:07:35.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.126+0000 7f579fe00640 1 Processor -- start 2024-04-25T09:07:35.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.126+0000 7f579fe00640 1 -- start start 2024-04-25T09:07:35.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.130+0000 7f579fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57980b3fe0 0x7f57980b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.130+0000 7f579fe00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579806d4b0 con 0x7f57980cc260 2024-04-25T09:07:35.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.130+0000 7f579fe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579806d790 con 0x7f5798145290 2024-04-25T09:07:35.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.130+0000 7f579fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579806da70 con 0x7f57980b3fe0 2024-04-25T09:07:35.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.130+0000 7f579de00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f57980cc260 0x7f57980cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:56926/0 (socket says 172.21.15.173:56926) 2024-04-25T09:07:35.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.130+0000 7f579de00640 1 -- 172.21.15.173:0/2345472035 learned_addr learned my addr 172.21.15.173:0/2345472035 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:35.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.130+0000 7f579ca00640 1 --2- 172.21.15.173:0/2345472035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57980b3fe0 0x7f57980b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.130+0000 7f5797e00640 1 -- 172.21.15.173:0/2345472035 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550885871 0 0) 0x7f579806d4b0 con 0x7f57980cc260 2024-04-25T09:07:35.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.130+0000 7f5797e00640 1 -- 172.21.15.173:0/2345472035 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5780003530 con 0x7f57980cc260 2024-04-25T09:07:35.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.130+0000 7f5797e00640 1 -- 172.21.15.173:0/2345472035 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497386756 0 0) 0x7f579806d790 con 0x7f5798145290 2024-04-25T09:07:35.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.130+0000 7f5797e00640 1 -- 172.21.15.173:0/2345472035 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f579806d4b0 con 0x7f5798145290 2024-04-25T09:07:35.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.130+0000 7f579ca00640 1 -- 172.21.15.173:0/2345472035 >> v1:172.21.15.194:6789/0 conn(0x7f5798145290 legacy=0x7f579815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.130+0000 7f579ca00640 1 -- 172.21.15.173:0/2345472035 >> v1:172.21.15.173:6789/0 conn(0x7f57980cc260 legacy=0x7f57980cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.130+0000 7f5797e00640 1 -- 172.21.15.173:0/2345472035 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2485624751 0 0) 0x7f5780003530 con 0x7f57980cc260 2024-04-25T09:07:35.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.130+0000 7f579ca00640 1 -- 172.21.15.173:0/2345472035 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579806dd50 con 0x7f57980b3fe0 2024-04-25T09:07:35.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f579ca00640 1 --2- 172.21.15.173:0/2345472035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57980b3fe0 0x7f57980b4420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f57840097f0 tx=0x7f578401c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88953416d4cae9a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:35.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f5797e00640 1 -- 172.21.15.173:0/2345472035 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57840b0070 con 0x7f57980b3fe0 2024-04-25T09:07:35.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f5797e00640 1 -- 172.21.15.173:0/2345472035 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57840ab400 con 0x7f57980b3fe0 2024-04-25T09:07:35.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f5797e00640 1 -- 172.21.15.173:0/2345472035 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790001680 con 0x7f57980b3fe0 2024-04-25T09:07:35.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f579fe00640 1 -- 172.21.15.173:0/2345472035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57980b3fe0 msgr2=0x7f57980b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f579fe00640 1 --2- 172.21.15.173:0/2345472035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57980b3fe0 0x7f57980b4420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f57840097f0 tx=0x7f578401c2e0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f579fe00640 1 -- 172.21.15.173:0/2345472035 shutdown_connections 2024-04-25T09:07:35.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f579fe00640 1 --2- 172.21.15.173:0/2345472035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57980b3fe0 0x7f57980b4420 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f579fe00640 1 -- 172.21.15.173:0/2345472035 >> 172.21.15.173:0/2345472035 conn(0x7f579806ac90 msgr2=0x7f579806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:35.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f579fe00640 1 -- 172.21.15.173:0/2345472035 shutdown_connections 2024-04-25T09:07:35.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f579fe00640 1 -- 172.21.15.173:0/2345472035 wait complete. 2024-04-25T09:07:35.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f579fe00640 1 Processor -- start 2024-04-25T09:07:35.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f579fe00640 1 -- start start 2024-04-25T09:07:35.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f579fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57980b3fe0 0x7f579813ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f579fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57980cc260 0x7f57980b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f579fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5798145290 0x7f579815cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f579fe00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579806f170 con 0x7f5798145290 2024-04-25T09:07:35.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f579fe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579806eff0 con 0x7f57980cc260 2024-04-25T09:07:35.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.134+0000 7f579fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579813eee0 con 0x7f57980b3fe0 2024-04-25T09:07:35.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.138+0000 7f579de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5798145290 0x7f579815cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.138+0000 7f579de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5798145290 0x7f579815cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41410/0 (socket says 172.21.15.173:41410) 2024-04-25T09:07:35.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.138+0000 7f579de00640 1 -- 172.21.15.173:0/846015593 learned_addr learned my addr 172.21.15.173:0/846015593 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:35.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.138+0000 7f579d400640 1 --2- 172.21.15.173:0/846015593 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57980b3fe0 0x7f579813ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.138+0000 7f579ca00640 1 --2- 172.21.15.173:0/846015593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57980cc260 0x7f57980b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.138+0000 7f579de00640 1 -- 172.21.15.173:0/846015593 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57980b3fe0 msgr2=0x7f579813ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.138+0000 7f579de00640 1 --2- 172.21.15.173:0/846015593 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57980b3fe0 0x7f579813ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.138+0000 7f579de00640 1 -- 172.21.15.173:0/846015593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57980cc260 msgr2=0x7f57980b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.138+0000 7f579de00640 1 --2- 172.21.15.173:0/846015593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57980cc260 0x7f57980b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.138+0000 7f579de00640 1 -- 172.21.15.173:0/846015593 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579813e5b0 con 0x7f5798145290 2024-04-25T09:07:35.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.138+0000 7f579de00640 1 --2- 172.21.15.173:0/846015593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5798145290 0x7f579815cae0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f57900011f0 tx=0x7f579000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:35.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.138+0000 7f5795600640 1 -- 172.21.15.173:0/846015593 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790005ae0 con 0x7f5798145290 2024-04-25T09:07:35.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.138+0000 7f5795600640 1 -- 172.21.15.173:0/846015593 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5790005ca0 con 0x7f5798145290 2024-04-25T09:07:35.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.138+0000 7f5795600640 1 -- 172.21.15.173:0/846015593 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57900072b0 con 0x7f5798145290 2024-04-25T09:07:35.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.138+0000 7f579fe00640 1 -- 172.21.15.173:0/846015593 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579813e890 con 0x7f5798145290 2024-04-25T09:07:35.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.138+0000 7f579fe00640 1 -- 172.21.15.173:0/846015593 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579815d680 con 0x7f5798145290 2024-04-25T09:07:35.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.138+0000 7f579fe00640 1 -- 172.21.15.173:0/846015593 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579815b710 con 0x7f5798145290 2024-04-25T09:07:35.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.138+0000 7f5795600640 1 -- 172.21.15.173:0/846015593 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5790007450 con 0x7f5798145290 2024-04-25T09:07:35.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.142+0000 7f5795600640 1 --2- 172.21.15.173:0/846015593 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5778066f60 0x7f5778069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.142+0000 7f5795600640 1 -- 172.21.15.173:0/846015593 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f5790084b70 con 0x7f5798145290 2024-04-25T09:07:35.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.142+0000 7f579d400640 1 --2- 172.21.15.173:0/846015593 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5778066f60 0x7f5778069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.142+0000 7f579d400640 1 --2- 172.21.15.173:0/846015593 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5778066f60 0x7f5778069420 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f578c001570 tx=0x7f578c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:35.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.146+0000 7f5795600640 1 -- 172.21.15.173:0/846015593 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5790055650 con 0x7f5798145290 2024-04-25T09:07:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.298+0000 7f579fe00640 1 -- 172.21.15.173:0/846015593 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5798073ab0 con 0x7f5798145290 2024-04-25T09:07:35.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.586+0000 7f5795600640 1 -- 172.21.15.173:0/846015593 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) v1 ==== 138+0+0 (secure 0 0 0) 0x7f57900596f0 con 0x7f5798145290 2024-04-25T09:07:35.574 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' created 2024-04-25T09:07:35.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.590+0000 7f579fe00640 1 -- 172.21.15.173:0/846015593 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5778066f60 msgr2=0x7f5778069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.590+0000 7f579fe00640 1 --2- 172.21.15.173:0/846015593 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5778066f60 0x7f5778069420 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f578c001570 tx=0x7f578c009040 comp rx=0 tx=0).stop 2024-04-25T09:07:35.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.590+0000 7f579fe00640 1 -- 172.21.15.173:0/846015593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5798145290 msgr2=0x7f579815cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.590+0000 7f579fe00640 1 --2- 172.21.15.173:0/846015593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5798145290 0x7f579815cae0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f57900011f0 tx=0x7f579000cbe0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.590+0000 7f579fe00640 1 -- 172.21.15.173:0/846015593 shutdown_connections 2024-04-25T09:07:35.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.590+0000 7f579fe00640 1 --2- 172.21.15.173:0/846015593 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5778066f60 0x7f5778069420 secure :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f578c001570 tx=0x7f578c009040 comp rx=0 tx=0).stop 2024-04-25T09:07:35.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.590+0000 7f579fe00640 1 --2- 172.21.15.173:0/846015593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5798145290 0x7f579815cae0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.590+0000 7f579fe00640 1 --2- 172.21.15.173:0/846015593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57980cc260 0x7f57980b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.590+0000 7f579fe00640 1 --2- 172.21.15.173:0/846015593 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57980b3fe0 0x7f579813ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.590+0000 7f579fe00640 1 -- 172.21.15.173:0/846015593 >> 172.21.15.173:0/846015593 conn(0x7f579806ac90 msgr2=0x7f57980b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:35.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.590+0000 7f579fe00640 1 -- 172.21.15.173:0/846015593 shutdown_connections 2024-04-25T09:07:35.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.590+0000 7f579fe00640 1 -- 172.21.15.173:0/846015593 wait complete. 2024-04-25T09:07:35.601 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:07:35.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.758+0000 7f3ad3200640 1 Processor -- start 2024-04-25T09:07:35.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.758+0000 7f3ad3200640 1 -- start start 2024-04-25T09:07:35.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.758+0000 7f3ad3200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3acc0aeb90 0x7f3acc0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.758+0000 7f3ad3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3acc0ce2b0 0x7f3acc0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.758+0000 7f3ad3200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3acc071570 con 0x7f3acc0aef70 2024-04-25T09:07:35.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.758+0000 7f3ad3200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3acc071320 con 0x7f3acc0aeb90 2024-04-25T09:07:35.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.758+0000 7f3ad3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc072330 con 0x7f3acc0ce2b0 2024-04-25T09:07:35.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.758+0000 7f3acbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3acc0aeb90 0x7f3acc0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.758+0000 7f3acbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3acc0aeb90 0x7f3acc0cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41416/0 (socket says 172.21.15.173:41416) 2024-04-25T09:07:35.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.758+0000 7f3ac3400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f3acc0aef70 0x7f3acc0cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:56932/0 (socket says 172.21.15.173:56932) 2024-04-25T09:07:35.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.758+0000 7f3acbe00640 1 -- 172.21.15.173:0/1213472205 learned_addr learned my addr 172.21.15.173:0/1213472205 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:35.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.758+0000 7f3ad1200640 1 --2- 172.21.15.173:0/1213472205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3acc0ce2b0 0x7f3acc0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.758+0000 7f3acbe00640 1 -- 172.21.15.173:0/1213472205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3acc0ce2b0 msgr2=0x7f3acc0cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:35.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.758+0000 7f3acbe00640 1 --2- 172.21.15.173:0/1213472205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3acc0ce2b0 0x7f3acc0cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.758+0000 7f3acbe00640 1 -- 172.21.15.173:0/1213472205 >> v1:172.21.15.173:6789/0 conn(0x7f3acc0aef70 legacy=0x7f3acc0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.758+0000 7f3acbe00640 1 -- 172.21.15.173:0/1213472205 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc071850 con 0x7f3acc0aeb90 2024-04-25T09:07:35.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.758+0000 7f3acb400640 1 -- 172.21.15.173:0/1213472205 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671469766 0 0) 0x7f3acc071570 con 0x7f3acc0aef70 2024-04-25T09:07:35.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.758+0000 7f3ad1200640 1 --2- 172.21.15.173:0/1213472205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3acc0ce2b0 0x7f3acc0cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:35.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.762+0000 7f3acbe00640 1 --2- 172.21.15.173:0/1213472205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3acc0aeb90 0x7f3acc0cc0d0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009870 tx=0x7f3abc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323070b4cbadea1a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:35.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.762+0000 7f3acb400640 1 -- 172.21.15.173:0/1213472205 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc0b1070 con 0x7f3acc0aeb90 2024-04-25T09:07:35.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.762+0000 7f3acb400640 1 -- 172.21.15.173:0/1213472205 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc0ac600 con 0x7f3acc0aeb90 2024-04-25T09:07:35.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.762+0000 7f3acb400640 1 -- 172.21.15.173:0/1213472205 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc0ac9d0 con 0x7f3acc0aeb90 2024-04-25T09:07:35.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.762+0000 7f3ad3200640 1 -- 172.21.15.173:0/1213472205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3acc0aeb90 msgr2=0x7f3acc0cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.762+0000 7f3ad3200640 1 --2- 172.21.15.173:0/1213472205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3acc0aeb90 0x7f3acc0cc0d0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009870 tx=0x7f3abc01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.762+0000 7f3ad3200640 1 -- 172.21.15.173:0/1213472205 shutdown_connections 2024-04-25T09:07:35.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.762+0000 7f3ad3200640 1 --2- 172.21.15.173:0/1213472205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3acc0ce2b0 0x7f3acc0cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.762+0000 7f3ad3200640 1 --2- 172.21.15.173:0/1213472205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3acc0aeb90 0x7f3acc0cc0d0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.762+0000 7f3ad3200640 1 -- 172.21.15.173:0/1213472205 >> 172.21.15.173:0/1213472205 conn(0x7f3acc06ac90 msgr2=0x7f3acc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:35.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.762+0000 7f3ad3200640 1 -- 172.21.15.173:0/1213472205 shutdown_connections 2024-04-25T09:07:35.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.762+0000 7f3ad3200640 1 -- 172.21.15.173:0/1213472205 wait complete. 2024-04-25T09:07:35.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ad3200640 1 Processor -- start 2024-04-25T09:07:35.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ad3200640 1 -- start start 2024-04-25T09:07:35.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ad3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3acc0aeb90 0x7f3acc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ad3200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3acc0aef70 0x7f3acc156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ad3200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3acc0ce2b0 0x7f3acc156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ad3200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc15bb70 con 0x7f3acc0aef70 2024-04-25T09:07:35.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ad3200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc15b9f0 con 0x7f3acc0ce2b0 2024-04-25T09:07:35.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ad3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc15bcf0 con 0x7f3acc0aeb90 2024-04-25T09:07:35.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ac3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3acc0aef70 0x7f3acc156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ac3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3acc0aef70 0x7f3acc156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41430/0 (socket says 172.21.15.173:41430) 2024-04-25T09:07:35.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ac3400640 1 -- 172.21.15.173:0/1836673829 learned_addr learned my addr 172.21.15.173:0/1836673829 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:35.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3acbe00640 1 --2- 172.21.15.173:0/1836673829 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3acc0aeb90 0x7f3acc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ad1200640 1 --2- 172.21.15.173:0/1836673829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3acc0ce2b0 0x7f3acc156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ac3400640 1 -- 172.21.15.173:0/1836673829 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3acc0aeb90 msgr2=0x7f3acc06e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ac3400640 1 --2- 172.21.15.173:0/1836673829 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3acc0aeb90 0x7f3acc06e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ac3400640 1 -- 172.21.15.173:0/1836673829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3acc0ce2b0 msgr2=0x7f3acc156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ac3400640 1 --2- 172.21.15.173:0/1836673829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3acc0ce2b0 0x7f3acc156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ac3400640 1 -- 172.21.15.173:0/1836673829 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc157810 con 0x7f3acc0aef70 2024-04-25T09:07:35.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ac3400640 1 --2- 172.21.15.173:0/1836673829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3acc0aef70 0x7f3acc156430 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400c410 tx=0x7f3ab400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:35.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ac8c00640 1 -- 172.21.15.173:0/1836673829 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab40074e0 con 0x7f3acc0aef70 2024-04-25T09:07:35.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ac8c00640 1 -- 172.21.15.173:0/1836673829 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab40047f0 con 0x7f3acc0aef70 2024-04-25T09:07:35.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ad3200640 1 -- 172.21.15.173:0/1836673829 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3acc157b30 con 0x7f3acc0aef70 2024-04-25T09:07:35.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ac8c00640 1 -- 172.21.15.173:0/1836673829 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4007680 con 0x7f3acc0aef70 2024-04-25T09:07:35.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ad3200640 1 -- 172.21.15.173:0/1836673829 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3acc158370 con 0x7f3acc0aef70 2024-04-25T09:07:35.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.766+0000 7f3ad3200640 1 -- 172.21.15.173:0/1836673829 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3acc073ab0 con 0x7f3acc0aef70 2024-04-25T09:07:35.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.770+0000 7f3ac8c00640 1 -- 172.21.15.173:0/1836673829 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3ab4011070 con 0x7f3acc0aef70 2024-04-25T09:07:35.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.770+0000 7f3ac8c00640 1 --2- 172.21.15.173:0/1836673829 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3aa8066f60 0x7f3aa8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.770+0000 7f3ac8c00640 1 -- 172.21.15.173:0/1836673829 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f3ab40851a0 con 0x7f3acc0aef70 2024-04-25T09:07:35.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.770+0000 7f3acbe00640 1 --2- 172.21.15.173:0/1836673829 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3aa8066f60 0x7f3aa8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.770+0000 7f3acbe00640 1 --2- 172.21.15.173:0/1836673829 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3aa8066f60 0x7f3aa8069420 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0ae000 tx=0x7f3abc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:35.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.774+0000 7f3ac8c00640 1 -- 172.21.15.173:0/1836673829 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3acc157b30 con 0x7f3acc0aef70 2024-04-25T09:07:35.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:35.930+0000 7f3ad3200640 1 -- 172.21.15.173:0/1836673829 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3acc0cdc40 con 0x7f3acc0aef70 2024-04-25T09:07:36.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.590+0000 7f3ac8c00640 1 -- 172.21.15.173:0/1836673829 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v82) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3ab40562e0 con 0x7f3acc0aef70 2024-04-25T09:07:36.578 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' created 2024-04-25T09:07:36.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.594+0000 7f3ad3200640 1 -- 172.21.15.173:0/1836673829 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3aa8066f60 msgr2=0x7f3aa8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.594+0000 7f3ad3200640 1 --2- 172.21.15.173:0/1836673829 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3aa8066f60 0x7f3aa8069420 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0ae000 tx=0x7f3abc0a7000 comp rx=0 tx=0).stop 2024-04-25T09:07:36.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.594+0000 7f3ad3200640 1 -- 172.21.15.173:0/1836673829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3acc0aef70 msgr2=0x7f3acc156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.594+0000 7f3ad3200640 1 --2- 172.21.15.173:0/1836673829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3acc0aef70 0x7f3acc156430 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400c410 tx=0x7f3ab400c8d0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.594+0000 7f3ad3200640 1 -- 172.21.15.173:0/1836673829 shutdown_connections 2024-04-25T09:07:36.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.594+0000 7f3ad3200640 1 --2- 172.21.15.173:0/1836673829 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3aa8066f60 0x7f3aa8069420 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.594+0000 7f3ad3200640 1 --2- 172.21.15.173:0/1836673829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3acc0ce2b0 0x7f3acc156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.594+0000 7f3ad3200640 1 --2- 172.21.15.173:0/1836673829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3acc0aef70 0x7f3acc156430 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.594+0000 7f3ad3200640 1 --2- 172.21.15.173:0/1836673829 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3acc0aeb90 0x7f3acc06e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.594+0000 7f3ad3200640 1 -- 172.21.15.173:0/1836673829 >> 172.21.15.173:0/1836673829 conn(0x7f3acc06ac90 msgr2=0x7f3acc0b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:36.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.594+0000 7f3ad3200640 1 -- 172.21.15.173:0/1836673829 shutdown_connections 2024-04-25T09:07:36.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.594+0000 7f3ad3200640 1 -- 172.21.15.173:0/1836673829 wait complete. 2024-04-25T09:07:36.620 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:07:36.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.774+0000 7f015fe00640 1 Processor -- start 2024-04-25T09:07:36.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.774+0000 7f015fe00640 1 -- start start 2024-04-25T09:07:36.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.774+0000 7f015fe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f015806ac90 0x7f015806b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.774+0000 7f015fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f015815c110 0x7f015815c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.774+0000 7f015fe00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015806b5b0 con 0x7f01580b35a0 2024-04-25T09:07:36.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.774+0000 7f015fe00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01580b4ad0 con 0x7f015806ac90 2024-04-25T09:07:36.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.774+0000 7f015fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01580b3a30 con 0x7f015815c110 2024-04-25T09:07:36.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f015ca00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f01580b35a0 0x7f01580b5310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:56946/0 (socket says 172.21.15.173:56946) 2024-04-25T09:07:36.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f015ca00640 1 -- 172.21.15.173:0/4186622076 learned_addr learned my addr 172.21.15.173:0/4186622076 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:36.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f015d400640 1 --2- 172.21.15.173:0/4186622076 >> v2:172.21.15.194:3300/0 conn(0x7f015806ac90 0x7f015806b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f015de00640 1 --2- 172.21.15.173:0/4186622076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f015815c110 0x7f015815c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f0157e00640 1 -- 172.21.15.173:0/4186622076 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366743843 0 0) 0x7f015806b5b0 con 0x7f01580b35a0 2024-04-25T09:07:36.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f0157e00640 1 -- 172.21.15.173:0/4186622076 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0140003530 con 0x7f01580b35a0 2024-04-25T09:07:36.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f0157e00640 1 -- 172.21.15.173:0/4186622076 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1295364822 0 0) 0x7f0140003530 con 0x7f01580b35a0 2024-04-25T09:07:36.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f0157e00640 1 -- 172.21.15.173:0/4186622076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f015815c110 msgr2=0x7f015815c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:36.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f0157e00640 1 --2- 172.21.15.173:0/4186622076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f015815c110 0x7f015815c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f0157e00640 1 -- 172.21.15.173:0/4186622076 >> v2:172.21.15.194:3300/0 conn(0x7f015806ac90 msgr2=0x7f015806b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:36.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f0157e00640 1 --2- 172.21.15.173:0/4186622076 >> v2:172.21.15.194:3300/0 conn(0x7f015806ac90 0x7f015806b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f0157e00640 1 -- 172.21.15.173:0/4186622076 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01580b3d10 con 0x7f01580b35a0 2024-04-25T09:07:36.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f0157e00640 1 -- 172.21.15.173:0/4186622076 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f0144001680 con 0x7f01580b35a0 2024-04-25T09:07:36.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f0157e00640 1 -- 172.21.15.173:0/4186622076 >> v1:172.21.15.173:6789/0 conn(0x7f01580b35a0 legacy=0x7f01580b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f0157e00640 1 --2- 172.21.15.173:0/4186622076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01400039c0 0x7f0140003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f0157e00640 1 --2- 172.21.15.173:0/4186622076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f015815c110 0x7f0140004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f0157e00640 1 --2- 172.21.15.173:0/4186622076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0140004d50 0x7f01400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f0157e00640 1 -- 172.21.15.173:0/4186622076 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01580b4ad0 con 0x7f0140004d50 2024-04-25T09:07:36.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f0157e00640 1 -- 172.21.15.173:0/4186622076 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01580b3a30 con 0x7f01400039c0 2024-04-25T09:07:36.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f0157e00640 1 -- 172.21.15.173:0/4186622076 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014000ba80 con 0x7f015815c110 2024-04-25T09:07:36.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f015de00640 1 --2- 172.21.15.173:0/4186622076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0140004d50 0x7f01400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f015d400640 1 --2- 172.21.15.173:0/4186622076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01400039c0 0x7f0140003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f015ca00640 1 --2- 172.21.15.173:0/4186622076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f015815c110 0x7f0140004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f015de00640 1 -- 172.21.15.173:0/4186622076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f015815c110 msgr2=0x7f0140004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:36.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f015de00640 1 --2- 172.21.15.173:0/4186622076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f015815c110 0x7f0140004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f015de00640 1 -- 172.21.15.173:0/4186622076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01400039c0 msgr2=0x7f0140003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:36.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f015de00640 1 --2- 172.21.15.173:0/4186622076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01400039c0 0x7f0140003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.778+0000 7f015de00640 1 -- 172.21.15.173:0/4186622076 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0140003530 con 0x7f0140004d50 2024-04-25T09:07:36.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.782+0000 7f015de00640 1 --2- 172.21.15.173:0/4186622076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0140004d50 0x7f01400051d0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f0150009fc0 tx=0x7f015001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede2a3babd4f898e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:36.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.782+0000 7f0157e00640 1 -- 172.21.15.173:0/4186622076 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01500b0070 con 0x7f0140004d50 2024-04-25T09:07:36.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.782+0000 7f0157e00640 1 -- 172.21.15.173:0/4186622076 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01500ab600 con 0x7f0140004d50 2024-04-25T09:07:36.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.782+0000 7f0157e00640 1 -- 172.21.15.173:0/4186622076 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0150009c10 con 0x7f0140004d50 2024-04-25T09:07:36.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.782+0000 7f015fe00640 1 -- 172.21.15.173:0/4186622076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0140004d50 msgr2=0x7f01400051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.782+0000 7f015fe00640 1 --2- 172.21.15.173:0/4186622076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0140004d50 0x7f01400051d0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f0150009fc0 tx=0x7f015001c960 comp rx=0 tx=0).stop 2024-04-25T09:07:36.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.782+0000 7f015de00640 1 -- 172.21.15.173:0/4186622076 reap_dead start 2024-04-25T09:07:36.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.782+0000 7f015fe00640 1 -- 172.21.15.173:0/4186622076 shutdown_connections 2024-04-25T09:07:36.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.782+0000 7f015fe00640 1 -- 172.21.15.173:0/4186622076 >> 172.21.15.173:0/4186622076 conn(0x7f01580b5b00 msgr2=0x7f01580b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:36.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.782+0000 7f015fe00640 1 -- 172.21.15.173:0/4186622076 shutdown_connections 2024-04-25T09:07:36.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.782+0000 7f015fe00640 1 -- 172.21.15.173:0/4186622076 wait complete. 2024-04-25T09:07:36.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.782+0000 7f015fe00640 1 Processor -- start 2024-04-25T09:07:36.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.782+0000 7f015fe00640 1 -- start start 2024-04-25T09:07:36.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0140004d50 0x7f015815afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f015809e0d0 0x7f01580b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01580b2300 0x7f015809a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015fe00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0158144c40 con 0x7f015809e0d0 2024-04-25T09:07:36.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015fe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0158144ac0 con 0x7f01580b2300 2024-04-25T09:07:36.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015815cd40 con 0x7f0140004d50 2024-04-25T09:07:36.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015ca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f015809e0d0 0x7f01580b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015ca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f015809e0d0 0x7f01580b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41456/0 (socket says 172.21.15.173:41456) 2024-04-25T09:07:36.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015ca00640 1 -- 172.21.15.173:0/3387773610 learned_addr learned my addr 172.21.15.173:0/3387773610 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:36.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015de00640 1 --2- 172.21.15.173:0/3387773610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01580b2300 0x7f015809a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015d400640 1 --2- 172.21.15.173:0/3387773610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0140004d50 0x7f015815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015ca00640 1 -- 172.21.15.173:0/3387773610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0140004d50 msgr2=0x7f015815afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015ca00640 1 --2- 172.21.15.173:0/3387773610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0140004d50 0x7f015815afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015ca00640 1 -- 172.21.15.173:0/3387773610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01580b2300 msgr2=0x7f015809a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015ca00640 1 --2- 172.21.15.173:0/3387773610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01580b2300 0x7f015809a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015ca00640 1 -- 172.21.15.173:0/3387773610 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015815b500 con 0x7f015809e0d0 2024-04-25T09:07:36.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015de00640 1 --2- 172.21.15.173:0/3387773610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01580b2300 0x7f015809a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:36.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015ca00640 1 --2- 172.21.15.173:0/3387773610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f015809e0d0 0x7f01580b1dc0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f01440122e0 tx=0x7f01440127a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:36.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f0155600640 1 -- 172.21.15.173:0/3387773610 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014401c070 con 0x7f015809e0d0 2024-04-25T09:07:36.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f0155600640 1 -- 172.21.15.173:0/3387773610 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0144014770 con 0x7f015809e0d0 2024-04-25T09:07:36.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015fe00640 1 -- 172.21.15.173:0/3387773610 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015809c580 con 0x7f015809e0d0 2024-04-25T09:07:36.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f0155600640 1 -- 172.21.15.173:0/3387773610 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144014b60 con 0x7f015809e0d0 2024-04-25T09:07:36.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015fe00640 1 -- 172.21.15.173:0/3387773610 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015809cb40 con 0x7f015809e0d0 2024-04-25T09:07:36.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f015fe00640 1 -- 172.21.15.173:0/3387773610 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015806cd30 con 0x7f015809e0d0 2024-04-25T09:07:36.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.786+0000 7f0155600640 1 -- 172.21.15.173:0/3387773610 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f014401f070 con 0x7f015809e0d0 2024-04-25T09:07:36.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.790+0000 7f0155600640 1 --2- 172.21.15.173:0/3387773610 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0138066f90 0x7f0138069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.790+0000 7f0155600640 1 -- 172.21.15.173:0/3387773610 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f0144087c10 con 0x7f015809e0d0 2024-04-25T09:07:36.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.790+0000 7f015d400640 1 --2- 172.21.15.173:0/3387773610 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0138066f90 0x7f0138069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.790+0000 7f015d400640 1 --2- 172.21.15.173:0/3387773610 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0138066f90 0x7f0138069450 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f01581429c0 tx=0x7f014c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:36.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.794+0000 7f0155600640 1 -- 172.21.15.173:0/3387773610 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0144058a50 con 0x7f015809e0d0 2024-04-25T09:07:36.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:36.978+0000 7f015fe00640 1 -- 172.21.15.173:0/3387773610 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0158073ab0 con 0x7f015809e0d0 2024-04-25T09:07:37.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.614+0000 7f0155600640 1 -- 172.21.15.173:0/3387773610 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v51) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0144058350 con 0x7f015809e0d0 2024-04-25T09:07:37.605 INFO:teuthology.orchestra.run.smithi173.stderr:new fs with metadata pool 11 and data pool 12 2024-04-25T09:07:37.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.634+0000 7f015fe00640 1 -- 172.21.15.173:0/3387773610 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0138066f90 msgr2=0x7f0138069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.634+0000 7f015fe00640 1 --2- 172.21.15.173:0/3387773610 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0138066f90 0x7f0138069450 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f01581429c0 tx=0x7f014c008040 comp rx=0 tx=0).stop 2024-04-25T09:07:37.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.634+0000 7f015fe00640 1 -- 172.21.15.173:0/3387773610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f015809e0d0 msgr2=0x7f01580b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.634+0000 7f015fe00640 1 --2- 172.21.15.173:0/3387773610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f015809e0d0 0x7f01580b1dc0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f01440122e0 tx=0x7f01440127a0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.634+0000 7f015fe00640 1 -- 172.21.15.173:0/3387773610 shutdown_connections 2024-04-25T09:07:37.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.634+0000 7f015fe00640 1 --2- 172.21.15.173:0/3387773610 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0138066f90 0x7f0138069450 secure :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f01581429c0 tx=0x7f014c008040 comp rx=0 tx=0).stop 2024-04-25T09:07:37.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.634+0000 7f015fe00640 1 --2- 172.21.15.173:0/3387773610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01580b2300 0x7f015809a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.634+0000 7f015fe00640 1 --2- 172.21.15.173:0/3387773610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f015809e0d0 0x7f01580b1dc0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.634+0000 7f015fe00640 1 --2- 172.21.15.173:0/3387773610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0140004d50 0x7f015815afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.634+0000 7f015fe00640 1 -- 172.21.15.173:0/3387773610 >> 172.21.15.173:0/3387773610 conn(0x7f01580b5b00 msgr2=0x7f0158074250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:37.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.638+0000 7f015fe00640 1 -- 172.21.15.173:0/3387773610 shutdown_connections 2024-04-25T09:07:37.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.638+0000 7f015fe00640 1 -- 172.21.15.173:0/3387773610 wait complete. 2024-04-25T09:07:37.655 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:37.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.802+0000 7feeede00640 1 Processor -- start 2024-04-25T09:07:37.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.802+0000 7feeede00640 1 -- start start 2024-04-25T09:07:37.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feeede00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feee815a180 0x7feee80b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feeede00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee806e860 con 0x7feee80b2ca0 2024-04-25T09:07:37.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feeede00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee806eb20 con 0x7feee8071a30 2024-04-25T09:07:37.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feeede00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee80af230 con 0x7feee815a180 2024-04-25T09:07:37.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee6000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7feee80b2ca0 0x7feee8071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:56960/0 (socket says 172.21.15.173:56960) 2024-04-25T09:07:37.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee6000640 1 -- 172.21.15.173:0/2011582245 learned_addr learned my addr 172.21.15.173:0/2011582245 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:37.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee6a00640 1 --2- 172.21.15.173:0/2011582245 >> v2:172.21.15.194:3300/0 conn(0x7feee815a180 0x7feee80b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee5600640 1 -- 172.21.15.173:0/2011582245 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3595336227 0 0) 0x7feee806e860 con 0x7feee80b2ca0 2024-04-25T09:07:37.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee5600640 1 -- 172.21.15.173:0/2011582245 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feecc003530 con 0x7feee80b2ca0 2024-04-25T09:07:37.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee5600640 1 -- 172.21.15.173:0/2011582245 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321766284 0 0) 0x7feee806eb20 con 0x7feee8071a30 2024-04-25T09:07:37.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee5600640 1 -- 172.21.15.173:0/2011582245 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feee806e860 con 0x7feee8071a30 2024-04-25T09:07:37.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee5600640 1 -- 172.21.15.173:0/2011582245 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 422159763 0 0) 0x7feecc003530 con 0x7feee80b2ca0 2024-04-25T09:07:37.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee5600640 1 -- 172.21.15.173:0/2011582245 >> v2:172.21.15.194:3300/0 conn(0x7feee815a180 msgr2=0x7feee80b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee5600640 1 --2- 172.21.15.173:0/2011582245 >> v2:172.21.15.194:3300/0 conn(0x7feee815a180 0x7feee80b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee5600640 1 -- 172.21.15.173:0/2011582245 >> v1:172.21.15.194:6789/0 conn(0x7feee8071a30 legacy=0x7feee806d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee5600640 1 -- 172.21.15.173:0/2011582245 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee80aebe0 con 0x7feee80b2ca0 2024-04-25T09:07:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee5600640 1 -- 172.21.15.173:0/2011582245 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7feed8001680 con 0x7feee80b2ca0 2024-04-25T09:07:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee5600640 1 -- 172.21.15.173:0/2011582245 >> v1:172.21.15.173:6789/0 conn(0x7feee80b2ca0 legacy=0x7feee8071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee5600640 1 --2- 172.21.15.173:0/2011582245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feecc003b50 0x7feecc003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee5600640 1 --2- 172.21.15.173:0/2011582245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feecc004810 0x7feecc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee5600640 1 --2- 172.21.15.173:0/2011582245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feecc0051d0 0x7feecc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee5600640 1 -- 172.21.15.173:0/2011582245 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee80af230 con 0x7feecc0051d0 2024-04-25T09:07:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee5600640 1 -- 172.21.15.173:0/2011582245 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc00c050 con 0x7feecc003b50 2024-04-25T09:07:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee5600640 1 -- 172.21.15.173:0/2011582245 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feecc00c250 con 0x7feecc004810 2024-04-25T09:07:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee6a00640 1 --2- 172.21.15.173:0/2011582245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feecc003b50 0x7feecc003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee7400640 1 --2- 172.21.15.173:0/2011582245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feecc0051d0 0x7feecc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee6000640 1 --2- 172.21.15.173:0/2011582245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feecc004810 0x7feecc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee7400640 1 -- 172.21.15.173:0/2011582245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feecc004810 msgr2=0x7feecc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:37.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee7400640 1 --2- 172.21.15.173:0/2011582245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feecc004810 0x7feecc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee7400640 1 -- 172.21.15.173:0/2011582245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feecc003b50 msgr2=0x7feecc003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:37.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee7400640 1 --2- 172.21.15.173:0/2011582245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feecc003b50 0x7feecc003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.806+0000 7feee7400640 1 -- 172.21.15.173:0/2011582245 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc003530 con 0x7feecc0051d0 2024-04-25T09:07:37.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.810+0000 7feee7400640 1 -- 172.21.15.173:0/2011582245 reap_dead start 2024-04-25T09:07:37.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.810+0000 7feee7400640 1 --2- 172.21.15.173:0/2011582245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feecc0051d0 0x7feecc00b9d0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7feee0001fd0 tx=0x7feee001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9dcb9720cb5ac61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:37.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.810+0000 7feee5600640 1 -- 172.21.15.173:0/2011582245 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0001c20 con 0x7feecc0051d0 2024-04-25T09:07:37.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.810+0000 7feee5600640 1 -- 172.21.15.173:0/2011582245 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee0003b80 con 0x7feecc0051d0 2024-04-25T09:07:37.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.810+0000 7feee5600640 1 -- 172.21.15.173:0/2011582245 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee00050d0 con 0x7feecc0051d0 2024-04-25T09:07:37.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.810+0000 7feeede00640 1 -- 172.21.15.173:0/2011582245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feecc0051d0 msgr2=0x7feecc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.810+0000 7feeede00640 1 --2- 172.21.15.173:0/2011582245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feecc0051d0 0x7feecc00b9d0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7feee0001fd0 tx=0x7feee001c900 comp rx=0 tx=0).stop 2024-04-25T09:07:37.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.810+0000 7feeede00640 1 -- 172.21.15.173:0/2011582245 shutdown_connections 2024-04-25T09:07:37.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.810+0000 7feeede00640 1 --2- 172.21.15.173:0/2011582245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feecc0051d0 0x7feecc00b9d0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.810+0000 7feeede00640 1 -- 172.21.15.173:0/2011582245 >> 172.21.15.173:0/2011582245 conn(0x7feee806ac90 msgr2=0x7feee806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:37.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.810+0000 7feeede00640 1 -- 172.21.15.173:0/2011582245 shutdown_connections 2024-04-25T09:07:37.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.810+0000 7feeede00640 1 -- 172.21.15.173:0/2011582245 wait complete. 2024-04-25T09:07:37.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feeede00640 1 Processor -- start 2024-04-25T09:07:37.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feeede00640 1 -- start start 2024-04-25T09:07:37.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feeede00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feecc0051d0 0x7feee81516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feeede00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feee814e7e0 0x7feee80aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feeede00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feee80ce0d0 0x7feee814ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feeede00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee80b4260 con 0x7feecc0051d0 2024-04-25T09:07:37.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feeede00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee80b40e0 con 0x7feee80ce0d0 2024-04-25T09:07:37.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feeede00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee80b43e0 con 0x7feee814e7e0 2024-04-25T09:07:37.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feee6a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feecc0051d0 0x7feee81516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feee6a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feecc0051d0 0x7feee81516d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41468/0 (socket says 172.21.15.173:41468) 2024-04-25T09:07:37.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feee6a00640 1 -- 172.21.15.173:0/3815130885 learned_addr learned my addr 172.21.15.173:0/3815130885 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:37.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feee6000640 1 --2- 172.21.15.173:0/3815130885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feee814e7e0 0x7feee80aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feee7400640 1 --2- 172.21.15.173:0/3815130885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feee80ce0d0 0x7feee814ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feee6a00640 1 -- 172.21.15.173:0/3815130885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feee814e7e0 msgr2=0x7feee80aa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feee6a00640 1 --2- 172.21.15.173:0/3815130885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feee814e7e0 0x7feee80aa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feee6a00640 1 -- 172.21.15.173:0/3815130885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feee80ce0d0 msgr2=0x7feee814ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feee6a00640 1 --2- 172.21.15.173:0/3815130885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feee80ce0d0 0x7feee814ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feee6a00640 1 -- 172.21.15.173:0/3815130885 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee80cd030 con 0x7feecc0051d0 2024-04-25T09:07:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feee6a00640 1 --2- 172.21.15.173:0/3815130885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feecc0051d0 0x7feee81516d0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7feed00119d0 tx=0x7feed0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feedf400640 1 -- 172.21.15.173:0/3815130885 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed000b040 con 0x7feecc0051d0 2024-04-25T09:07:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feedf400640 1 -- 172.21.15.173:0/3815130885 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed000fd30 con 0x7feecc0051d0 2024-04-25T09:07:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feedf400640 1 -- 172.21.15.173:0/3815130885 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed001c680 con 0x7feecc0051d0 2024-04-25T09:07:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feeede00640 1 -- 172.21.15.173:0/3815130885 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee80cd310 con 0x7feecc0051d0 2024-04-25T09:07:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feeede00640 1 -- 172.21.15.173:0/3815130885 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee80cd8d0 con 0x7feecc0051d0 2024-04-25T09:07:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.814+0000 7feeede00640 1 -- 172.21.15.173:0/3815130885 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee8073a40 con 0x7feecc0051d0 2024-04-25T09:07:37.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.818+0000 7feedf400640 1 -- 172.21.15.173:0/3815130885 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feed0013440 con 0x7feecc0051d0 2024-04-25T09:07:37.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.818+0000 7feedf400640 1 --2- 172.21.15.173:0/3815130885 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feec4066f90 0x7feec4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.818+0000 7feedf400640 1 -- 172.21.15.173:0/3815130885 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6101+0+0 (secure 0 0 0) 0x7feed0085e90 con 0x7feecc0051d0 2024-04-25T09:07:37.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.818+0000 7feee6000640 1 --2- 172.21.15.173:0/3815130885 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feec4066f90 0x7feec4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.818+0000 7feee6000640 1 --2- 172.21.15.173:0/3815130885 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feec4066f90 0x7feec4069450 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7feed8001060 tx=0x7feed8001e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:37.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.822+0000 7feedf400640 1 -- 172.21.15.173:0/3815130885 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feed0056d00 con 0x7feecc0051d0 2024-04-25T09:07:37.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.974+0000 7feeede00640 1 -- 172.21.15.173:0/3815130885 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feee80720f0 con 0x7feecc0051d0 2024-04-25T09:07:37.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.978+0000 7feedf400640 1 -- 172.21.15.173:0/3815130885 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+17018 (secure 0 0 0) 0x7feed0087090 con 0x7feecc0051d0 2024-04-25T09:07:37.965 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:37.965 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":83,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:07:36.982437+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:07:35.343920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:07:35.976786+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:37.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.978+0000 7feeede00640 1 -- 172.21.15.173:0/3815130885 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feec4066f90 msgr2=0x7feec4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.978+0000 7feeede00640 1 --2- 172.21.15.173:0/3815130885 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feec4066f90 0x7feec4069450 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7feed8001060 tx=0x7feed8001e30 comp rx=0 tx=0).stop 2024-04-25T09:07:37.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.978+0000 7feeede00640 1 -- 172.21.15.173:0/3815130885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feecc0051d0 msgr2=0x7feee81516d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.978+0000 7feeede00640 1 --2- 172.21.15.173:0/3815130885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feecc0051d0 0x7feee81516d0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7feed00119d0 tx=0x7feed0011e90 comp rx=0 tx=0).stop 2024-04-25T09:07:37.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.978+0000 7feeede00640 1 -- 172.21.15.173:0/3815130885 shutdown_connections 2024-04-25T09:07:37.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.978+0000 7feeede00640 1 --2- 172.21.15.173:0/3815130885 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feec4066f90 0x7feec4069450 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.978+0000 7feeede00640 1 --2- 172.21.15.173:0/3815130885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feee80ce0d0 0x7feee814ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.978+0000 7feeede00640 1 --2- 172.21.15.173:0/3815130885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feee814e7e0 0x7feee80aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.978+0000 7feeede00640 1 --2- 172.21.15.173:0/3815130885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feecc0051d0 0x7feee81516d0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.978+0000 7feeede00640 1 -- 172.21.15.173:0/3815130885 >> 172.21.15.173:0/3815130885 conn(0x7feee806ac90 msgr2=0x7feee806b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:37.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.978+0000 7feeede00640 1 -- 172.21.15.173:0/3815130885 shutdown_connections 2024-04-25T09:07:37.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:37.978+0000 7feeede00640 1 -- 172.21.15.173:0/3815130885 wait complete. 2024-04-25T09:07:37.986 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:38.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.134+0000 7fab4ea00640 1 Processor -- start 2024-04-25T09:07:38.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.134+0000 7fab4ea00640 1 -- start start 2024-04-25T09:07:38.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.134+0000 7fab4ea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fab480aefa0 0x7fab480cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.134+0000 7fab4ea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fab4815edd0 0x7fab480cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.134+0000 7fab4ea00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4815f320 con 0x7fab480b3e70 2024-04-25T09:07:38.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.134+0000 7fab4ea00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4806dd50 con 0x7fab480aefa0 2024-04-25T09:07:38.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.134+0000 7fab4ea00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4806d420 con 0x7fab4815edd0 2024-04-25T09:07:38.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.134+0000 7fab47400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fab480aefa0 0x7fab480cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.134+0000 7fab47400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fab480aefa0 0x7fab480cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41474/0 (socket says 172.21.15.173:41474) 2024-04-25T09:07:38.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.134+0000 7fab47400640 1 -- 172.21.15.173:0/1745464137 learned_addr learned my addr 172.21.15.173:0/1745464137 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:38.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.134+0000 7fab4ca00640 1 --2- 172.21.15.173:0/1745464137 >> v2:172.21.15.194:3300/0 conn(0x7fab4815edd0 0x7fab480cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.134+0000 7fab47400640 1 -- 172.21.15.173:0/1745464137 >> v2:172.21.15.194:3300/0 conn(0x7fab4815edd0 msgr2=0x7fab480cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:38.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.134+0000 7fab47400640 1 --2- 172.21.15.173:0/1745464137 >> v2:172.21.15.194:3300/0 conn(0x7fab4815edd0 0x7fab480cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.134+0000 7fab47400640 1 -- 172.21.15.173:0/1745464137 >> v1:172.21.15.194:6789/0 conn(0x7fab480b3e70 legacy=0x7fab480b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:38.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.134+0000 7fab47400640 1 -- 172.21.15.173:0/1745464137 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4806d700 con 0x7fab480aefa0 2024-04-25T09:07:38.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.134+0000 7fab4ca00640 1 --2- 172.21.15.173:0/1745464137 >> v2:172.21.15.194:3300/0 conn(0x7fab4815edd0 0x7fab480cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:38.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.138+0000 7fab47400640 1 --2- 172.21.15.173:0/1745464137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 0x7fab480cd7a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fab4806ef40 tx=0x7fab3401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d89066b680da13 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:38.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.138+0000 7fab46a00640 1 -- 172.21.15.173:0/1745464137 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340a6040 con 0x7fab480aefa0 2024-04-25T09:07:38.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.138+0000 7fab46a00640 1 -- 172.21.15.173:0/1745464137 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab340af070 con 0x7fab480aefa0 2024-04-25T09:07:38.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.138+0000 7fab46a00640 1 -- 172.21.15.173:0/1745464137 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340aa860 con 0x7fab480aefa0 2024-04-25T09:07:38.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.138+0000 7fab4ea00640 1 -- 172.21.15.173:0/1745464137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 msgr2=0x7fab480cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:38.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.138+0000 7fab4ea00640 1 --2- 172.21.15.173:0/1745464137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 0x7fab480cd7a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fab4806ef40 tx=0x7fab3401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.138+0000 7fab4ea00640 1 -- 172.21.15.173:0/1745464137 shutdown_connections 2024-04-25T09:07:38.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.138+0000 7fab4ea00640 1 --2- 172.21.15.173:0/1745464137 >> v2:172.21.15.194:3300/0 conn(0x7fab4815edd0 0x7fab480cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.138+0000 7fab4ea00640 1 --2- 172.21.15.173:0/1745464137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 0x7fab480cd7a0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.138+0000 7fab4ea00640 1 -- 172.21.15.173:0/1745464137 >> 172.21.15.173:0/1745464137 conn(0x7fab4806ac90 msgr2=0x7fab4806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:38.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.138+0000 7fab4ea00640 1 -- 172.21.15.173:0/1745464137 shutdown_connections 2024-04-25T09:07:38.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.138+0000 7fab4ea00640 1 -- 172.21.15.173:0/1745464137 wait complete. 2024-04-25T09:07:38.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab4ea00640 1 Processor -- start 2024-04-25T09:07:38.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab4ea00640 1 -- start start 2024-04-25T09:07:38.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab4ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 0x7fab48141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab4ea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480b3e70 0x7fab4815ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab4ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab4815edd0 0x7fab48152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab4ea00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab48167930 con 0x7fab480aefa0 2024-04-25T09:07:38.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab4ea00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab481677b0 con 0x7fab480b3e70 2024-04-25T09:07:38.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab4ea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab48167ab0 con 0x7fab4815edd0 2024-04-25T09:07:38.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab47e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 0x7fab48141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab47e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 0x7fab48141060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41486/0 (socket says 172.21.15.173:41486) 2024-04-25T09:07:38.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab47e00640 1 -- 172.21.15.173:0/3030242143 learned_addr learned my addr 172.21.15.173:0/3030242143 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:38.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab47400640 1 --2- 172.21.15.173:0/3030242143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480b3e70 0x7fab4815ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab4ca00640 1 --2- 172.21.15.173:0/3030242143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab4815edd0 0x7fab48152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab47e00640 1 -- 172.21.15.173:0/3030242143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab4815edd0 msgr2=0x7fab48152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:38.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab47e00640 1 --2- 172.21.15.173:0/3030242143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab4815edd0 0x7fab48152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab47e00640 1 -- 172.21.15.173:0/3030242143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480b3e70 msgr2=0x7fab4815ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:38.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab47e00640 1 --2- 172.21.15.173:0/3030242143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480b3e70 0x7fab4815ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab47e00640 1 -- 172.21.15.173:0/3030242143 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab48154520 con 0x7fab480aefa0 2024-04-25T09:07:38.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab47400640 1 --2- 172.21.15.173:0/3030242143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480b3e70 0x7fab4815ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:38.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab47e00640 1 --2- 172.21.15.173:0/3030242143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 0x7fab48141060 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fab3800c450 tx=0x7fab3800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:38.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab3fe00640 1 -- 172.21.15.173:0/3030242143 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38016020 con 0x7fab480aefa0 2024-04-25T09:07:38.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab3fe00640 1 -- 172.21.15.173:0/3030242143 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab380052d0 con 0x7fab480aefa0 2024-04-25T09:07:38.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab4ea00640 1 -- 172.21.15.173:0/3030242143 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab48154800 con 0x7fab480aefa0 2024-04-25T09:07:38.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab3fe00640 1 -- 172.21.15.173:0/3030242143 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38007260 con 0x7fab480aefa0 2024-04-25T09:07:38.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.142+0000 7fab4ea00640 1 -- 172.21.15.173:0/3030242143 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab48154dc0 con 0x7fab480aefa0 2024-04-25T09:07:38.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.146+0000 7fab4ea00640 1 -- 172.21.15.173:0/3030242143 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab48073a40 con 0x7fab480aefa0 2024-04-25T09:07:38.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.146+0000 7fab3fe00640 1 -- 172.21.15.173:0/3030242143 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fab38007400 con 0x7fab480aefa0 2024-04-25T09:07:38.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.146+0000 7fab3fe00640 1 --2- 172.21.15.173:0/3030242143 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fab28066f90 0x7fab28069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.146+0000 7fab3fe00640 1 -- 172.21.15.173:0/3030242143 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fab38084c40 con 0x7fab480aefa0 2024-04-25T09:07:38.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.146+0000 7fab47400640 1 --2- 172.21.15.173:0/3030242143 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fab28066f90 0x7fab28069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.146+0000 7fab47400640 1 --2- 172.21.15.173:0/3030242143 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fab28066f90 0x7fab28069450 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fab340ae000 tx=0x7fab340a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:38.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.150+0000 7fab3fe00640 1 -- 172.21.15.173:0/3030242143 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fab38020020 con 0x7fab480aefa0 2024-04-25T09:07:38.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.306+0000 7fab4ea00640 1 -- 172.21.15.173:0/3030242143 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab4806e540 con 0x7fab480aefa0 2024-04-25T09:07:38.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.306+0000 7fab3fe00640 1 -- 172.21.15.173:0/3030242143 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+17018 (secure 0 0 0) 0x7fab38005480 con 0x7fab480aefa0 2024-04-25T09:07:38.294 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:38.295 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":83,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:07:36.982437+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:07:35.343920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:07:35.976786+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:38.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.310+0000 7fab4ea00640 1 -- 172.21.15.173:0/3030242143 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fab28066f90 msgr2=0x7fab28069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:38.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.310+0000 7fab4ea00640 1 --2- 172.21.15.173:0/3030242143 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fab28066f90 0x7fab28069450 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fab340ae000 tx=0x7fab340a7000 comp rx=0 tx=0).stop 2024-04-25T09:07:38.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.310+0000 7fab4ea00640 1 -- 172.21.15.173:0/3030242143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 msgr2=0x7fab48141060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:38.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.310+0000 7fab4ea00640 1 --2- 172.21.15.173:0/3030242143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 0x7fab48141060 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fab3800c450 tx=0x7fab3800c910 comp rx=0 tx=0).stop 2024-04-25T09:07:38.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.310+0000 7fab4ea00640 1 -- 172.21.15.173:0/3030242143 shutdown_connections 2024-04-25T09:07:38.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.310+0000 7fab4ea00640 1 --2- 172.21.15.173:0/3030242143 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fab28066f90 0x7fab28069450 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.310+0000 7fab4ea00640 1 --2- 172.21.15.173:0/3030242143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab4815edd0 0x7fab48152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.310+0000 7fab4ea00640 1 --2- 172.21.15.173:0/3030242143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480b3e70 0x7fab4815ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.310+0000 7fab4ea00640 1 --2- 172.21.15.173:0/3030242143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 0x7fab48141060 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.310+0000 7fab4ea00640 1 -- 172.21.15.173:0/3030242143 >> 172.21.15.173:0/3030242143 conn(0x7fab4806ac90 msgr2=0x7fab4806b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:38.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.310+0000 7fab4ea00640 1 -- 172.21.15.173:0/3030242143 shutdown_connections 2024-04-25T09:07:38.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.310+0000 7fab4ea00640 1 -- 172.21.15.173:0/3030242143 wait complete. 2024-04-25T09:07:38.316 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:07:38.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.466+0000 7f54d6c00640 1 Processor -- start 2024-04-25T09:07:38.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.466+0000 7f54d6c00640 1 -- start start 2024-04-25T09:07:38.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.470+0000 7f54d6c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f54d015b5b0 0x7f54d0072e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.470+0000 7f54d6c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d00cd770 0x7f54d015ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.470+0000 7f54d6c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d015c680 con 0x7f54d015fb50 2024-04-25T09:07:38.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.470+0000 7f54d6c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d015f6c0 con 0x7f54d015b5b0 2024-04-25T09:07:38.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.470+0000 7f54d6c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d015c960 con 0x7f54d00cd770 2024-04-25T09:07:38.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.470+0000 7f54d5800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f54d015b5b0 0x7f54d0072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.470+0000 7f54d5800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f54d015b5b0 0x7f54d0072e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41494/0 (socket says 172.21.15.173:41494) 2024-04-25T09:07:38.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.470+0000 7f54d5800640 1 -- 172.21.15.173:0/407611370 learned_addr learned my addr 172.21.15.173:0/407611370 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:38.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.470+0000 7f54d5800640 1 -- 172.21.15.173:0/407611370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d00cd770 msgr2=0x7f54d015ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:38.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.470+0000 7f54d5800640 1 --2- 172.21.15.173:0/407611370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d00cd770 0x7f54d015ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.470+0000 7f54d5800640 1 -- 172.21.15.173:0/407611370 >> v1:172.21.15.194:6789/0 conn(0x7f54d015fb50 legacy=0x7f54d00cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:38.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.470+0000 7f54d5800640 1 -- 172.21.15.173:0/407611370 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d015cc40 con 0x7f54d015b5b0 2024-04-25T09:07:38.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.474+0000 7f54d5800640 1 --2- 172.21.15.173:0/407611370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d015b5b0 0x7f54d0072e70 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009870 tx=0x7f54c401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c203b48dfa945ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:38.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.474+0000 7f54cfe00640 1 -- 172.21.15.173:0/407611370 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c40b2070 con 0x7f54d015b5b0 2024-04-25T09:07:38.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.474+0000 7f54cfe00640 1 -- 172.21.15.173:0/407611370 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c40ad680 con 0x7f54d015b5b0 2024-04-25T09:07:38.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.474+0000 7f54cfe00640 1 -- 172.21.15.173:0/407611370 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c40ada50 con 0x7f54d015b5b0 2024-04-25T09:07:38.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.474+0000 7f54d6c00640 1 -- 172.21.15.173:0/407611370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d015b5b0 msgr2=0x7f54d0072e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:38.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.474+0000 7f54d6c00640 1 --2- 172.21.15.173:0/407611370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d015b5b0 0x7f54d0072e70 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009870 tx=0x7f54c401c4b0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.474+0000 7f54d6c00640 1 -- 172.21.15.173:0/407611370 shutdown_connections 2024-04-25T09:07:38.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.474+0000 7f54d6c00640 1 --2- 172.21.15.173:0/407611370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d00cd770 0x7f54d015ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.474+0000 7f54d6c00640 1 --2- 172.21.15.173:0/407611370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d015b5b0 0x7f54d0072e70 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.474+0000 7f54d6c00640 1 -- 172.21.15.173:0/407611370 >> 172.21.15.173:0/407611370 conn(0x7f54d006e460 msgr2=0x7f54d006e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:38.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.474+0000 7f54d6c00640 1 -- 172.21.15.173:0/407611370 shutdown_connections 2024-04-25T09:07:38.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.474+0000 7f54d6c00640 1 -- 172.21.15.173:0/407611370 wait complete. 2024-04-25T09:07:38.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.474+0000 7f54d6c00640 1 Processor -- start 2024-04-25T09:07:38.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.474+0000 7f54d6c00640 1 -- start start 2024-04-25T09:07:38.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d6c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d015b5b0 0x7f54d01446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d6c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d015fb50 0x7f54d01409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d6c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d0148f80 0x7f54d0146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d6c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d01687c0 con 0x7f54d015fb50 2024-04-25T09:07:38.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d6c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d015c3f0 con 0x7f54d0148f80 2024-04-25T09:07:38.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d6c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d0168940 con 0x7f54d015b5b0 2024-04-25T09:07:38.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d4e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d015fb50 0x7f54d01409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d4e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d015fb50 0x7f54d01409e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41502/0 (socket says 172.21.15.173:41502) 2024-04-25T09:07:38.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d4e00640 1 -- 172.21.15.173:0/2202409774 learned_addr learned my addr 172.21.15.173:0/2202409774 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:38.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d5800640 1 --2- 172.21.15.173:0/2202409774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d015b5b0 0x7f54d01446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d6200640 1 --2- 172.21.15.173:0/2202409774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d0148f80 0x7f54d0146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d4e00640 1 -- 172.21.15.173:0/2202409774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d015b5b0 msgr2=0x7f54d01446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:38.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d4e00640 1 --2- 172.21.15.173:0/2202409774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d015b5b0 0x7f54d01446a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d4e00640 1 -- 172.21.15.173:0/2202409774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d0148f80 msgr2=0x7f54d0146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:38.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d4e00640 1 --2- 172.21.15.173:0/2202409774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d0148f80 0x7f54d0146cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d4e00640 1 -- 172.21.15.173:0/2202409774 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d0140f20 con 0x7f54d015fb50 2024-04-25T09:07:38.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d4e00640 1 --2- 172.21.15.173:0/2202409774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d015fb50 0x7f54d01409e0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00b410 tx=0x7f54bc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:38.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54cd600640 1 -- 172.21.15.173:0/2202409774 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc015020 con 0x7f54d015fb50 2024-04-25T09:07:38.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54cd600640 1 -- 172.21.15.173:0/2202409774 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc011830 con 0x7f54d015fb50 2024-04-25T09:07:38.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54cd600640 1 -- 172.21.15.173:0/2202409774 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc011c20 con 0x7f54d015fb50 2024-04-25T09:07:38.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d6c00640 1 -- 172.21.15.173:0/2202409774 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d0144cf0 con 0x7f54d015fb50 2024-04-25T09:07:38.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d6c00640 1 -- 172.21.15.173:0/2202409774 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d01452b0 con 0x7f54d015fb50 2024-04-25T09:07:38.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54d6c00640 1 -- 172.21.15.173:0/2202409774 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d0073a40 con 0x7f54d015fb50 2024-04-25T09:07:38.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.478+0000 7f54cd600640 1 -- 172.21.15.173:0/2202409774 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f54bc018020 con 0x7f54d015fb50 2024-04-25T09:07:38.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.482+0000 7f54cd600640 1 --2- 172.21.15.173:0/2202409774 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54b0066f90 0x7f54b0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.482+0000 7f54cd600640 1 -- 172.21.15.173:0/2202409774 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f54bc084bb0 con 0x7f54d015fb50 2024-04-25T09:07:38.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.482+0000 7f54d5800640 1 --2- 172.21.15.173:0/2202409774 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54b0066f90 0x7f54b0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.482+0000 7f54d5800640 1 --2- 172.21.15.173:0/2202409774 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54b0066f90 0x7f54b0069450 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f54c40af000 tx=0x7f54c40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:38.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.486+0000 7f54cd600640 1 -- 172.21.15.173:0/2202409774 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f54bc01f070 con 0x7f54d015fb50 2024-04-25T09:07:38.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:38.678+0000 7f54d6c00640 1 -- 172.21.15.173:0/2202409774 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f54d0074700 con 0x7f54d015fb50 2024-04-25T09:07:39.574 INFO:tasks.ceph.mds.a.smithi173.stderr:2024-04-25T09:07:39.586+0000 7fb204800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:07:39.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.630+0000 7f54cd600640 1 -- 172.21.15.173:0/2202409774 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v54) v1 ==== 118+0+0 (secure 0 0 0) 0x7f54d0140f20 con 0x7f54d015fb50 2024-04-25T09:07:39.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.634+0000 7f54d6c00640 1 -- 172.21.15.173:0/2202409774 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54b0066f90 msgr2=0x7f54b0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:39.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.634+0000 7f54d6c00640 1 --2- 172.21.15.173:0/2202409774 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54b0066f90 0x7f54b0069450 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f54c40af000 tx=0x7f54c40a7000 comp rx=0 tx=0).stop 2024-04-25T09:07:39.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.634+0000 7f54d6c00640 1 -- 172.21.15.173:0/2202409774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d015fb50 msgr2=0x7f54d01409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:39.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.634+0000 7f54d6c00640 1 --2- 172.21.15.173:0/2202409774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d015fb50 0x7f54d01409e0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00b410 tx=0x7f54bc00b8d0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.634+0000 7f54d6c00640 1 -- 172.21.15.173:0/2202409774 shutdown_connections 2024-04-25T09:07:39.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.634+0000 7f54d6c00640 1 --2- 172.21.15.173:0/2202409774 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54b0066f90 0x7f54b0069450 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.634+0000 7f54d6c00640 1 --2- 172.21.15.173:0/2202409774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d0148f80 0x7f54d0146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.634+0000 7f54d6c00640 1 --2- 172.21.15.173:0/2202409774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d015fb50 0x7f54d01409e0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.634+0000 7f54d6c00640 1 --2- 172.21.15.173:0/2202409774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d015b5b0 0x7f54d01446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.634+0000 7f54d6c00640 1 -- 172.21.15.173:0/2202409774 >> 172.21.15.173:0/2202409774 conn(0x7f54d006e460 msgr2=0x7f54d015e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:39.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.634+0000 7f54d6c00640 1 -- 172.21.15.173:0/2202409774 shutdown_connections 2024-04-25T09:07:39.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.634+0000 7f54d6c00640 1 -- 172.21.15.173:0/2202409774 wait complete. 2024-04-25T09:07:39.644 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:07:39.644 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:07:39.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.798+0000 7f6b99600640 1 Processor -- start 2024-04-25T09:07:39.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b99600640 1 -- start start 2024-04-25T09:07:39.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b99600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b940aeb90 0x7f6b940cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:39.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b99600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6b940ce2b0 0x7f6b940cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:39.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b99600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b94071570 con 0x7f6b940aef70 2024-04-25T09:07:39.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b99600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b94071320 con 0x7f6b940ce2b0 2024-04-25T09:07:39.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b99600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b94072330 con 0x7f6b940aeb90 2024-04-25T09:07:39.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b92000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f6b940aef70 0x7f6b940cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:56964/0 (socket says 172.21.15.173:56964) 2024-04-25T09:07:39.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b92000640 1 -- 172.21.15.173:0/2518682719 learned_addr learned my addr 172.21.15.173:0/2518682719 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:39.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b92a00640 1 --2- 172.21.15.173:0/2518682719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b940aeb90 0x7f6b940cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:39.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b93400640 1 --2- 172.21.15.173:0/2518682719 >> v2:172.21.15.194:3300/0 conn(0x7f6b940ce2b0 0x7f6b940cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:39.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b91600640 1 -- 172.21.15.173:0/2518682719 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931757226 0 0) 0x7f6b94071570 con 0x7f6b940aef70 2024-04-25T09:07:39.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b91600640 1 -- 172.21.15.173:0/2518682719 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b78005740 con 0x7f6b940aef70 2024-04-25T09:07:39.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b91600640 1 -- 172.21.15.173:0/2518682719 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2232562270 0 0) 0x7f6b78005740 con 0x7f6b940aef70 2024-04-25T09:07:39.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b91600640 1 -- 172.21.15.173:0/2518682719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b940aeb90 msgr2=0x7f6b940cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:39.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b91600640 1 --2- 172.21.15.173:0/2518682719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b940aeb90 0x7f6b940cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b91600640 1 -- 172.21.15.173:0/2518682719 >> v2:172.21.15.194:3300/0 conn(0x7f6b940ce2b0 msgr2=0x7f6b940cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:39.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b91600640 1 --2- 172.21.15.173:0/2518682719 >> v2:172.21.15.194:3300/0 conn(0x7f6b940ce2b0 0x7f6b940cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b91600640 1 -- 172.21.15.173:0/2518682719 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b94071850 con 0x7f6b940aef70 2024-04-25T09:07:39.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b91600640 1 -- 172.21.15.173:0/2518682719 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f6b80001680 con 0x7f6b940aef70 2024-04-25T09:07:39.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b92a00640 1 --2- 172.21.15.173:0/2518682719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b940aeb90 0x7f6b940cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:39.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b91600640 1 -- 172.21.15.173:0/2518682719 >> v1:172.21.15.173:6789/0 conn(0x7f6b940aef70 legacy=0x7f6b940cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:39.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b91600640 1 --2- 172.21.15.173:0/2518682719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b78005bd0 0x7f6b78005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:39.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b91600640 1 --2- 172.21.15.173:0/2518682719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b940aeb90 0x7f6b78006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:39.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b91600640 1 --2- 172.21.15.173:0/2518682719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b78006f60 0x7f6b780073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:39.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b91600640 1 -- 172.21.15.173:0/2518682719 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b94071320 con 0x7f6b78006f60 2024-04-25T09:07:39.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b91600640 1 -- 172.21.15.173:0/2518682719 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b94072330 con 0x7f6b78005bd0 2024-04-25T09:07:39.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b91600640 1 -- 172.21.15.173:0/2518682719 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7800dbe0 con 0x7f6b940aeb90 2024-04-25T09:07:39.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b93400640 1 --2- 172.21.15.173:0/2518682719 >> v2:172.21.15.194:3300/0 conn(0x7f6b940ce2b0 0x7f6b940cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:39.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b93400640 1 --2- 172.21.15.173:0/2518682719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b78006f60 0x7f6b780073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:39.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b92a00640 1 --2- 172.21.15.173:0/2518682719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b78005bd0 0x7f6b78005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:39.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b92000640 1 --2- 172.21.15.173:0/2518682719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b940aeb90 0x7f6b78006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:39.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b93400640 1 -- 172.21.15.173:0/2518682719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b940aeb90 msgr2=0x7f6b78006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:39.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b93400640 1 --2- 172.21.15.173:0/2518682719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b940aeb90 0x7f6b78006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b93400640 1 -- 172.21.15.173:0/2518682719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b78005bd0 msgr2=0x7f6b78005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:39.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b93400640 1 --2- 172.21.15.173:0/2518682719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b78005bd0 0x7f6b78005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b93400640 1 -- 172.21.15.173:0/2518682719 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b78005740 con 0x7f6b78006f60 2024-04-25T09:07:39.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.802+0000 7f6b92000640 1 --2- 172.21.15.173:0/2518682719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b940aeb90 0x7f6b78006a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:39.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.806+0000 7f6b93400640 1 --2- 172.21.15.173:0/2518682719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b78006f60 0x7f6b780073e0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00e320 tx=0x7f6b8c01cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c378e738df4818d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:39.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.806+0000 7f6b91600640 1 -- 172.21.15.173:0/2518682719 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0b2070 con 0x7f6b78006f60 2024-04-25T09:07:39.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.806+0000 7f6b91600640 1 -- 172.21.15.173:0/2518682719 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c0a5e50 con 0x7f6b78006f60 2024-04-25T09:07:39.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.806+0000 7f6b91600640 1 -- 172.21.15.173:0/2518682719 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c009de0 con 0x7f6b78006f60 2024-04-25T09:07:39.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.806+0000 7f6b99600640 1 -- 172.21.15.173:0/2518682719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b78006f60 msgr2=0x7f6b780073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:39.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.806+0000 7f6b99600640 1 --2- 172.21.15.173:0/2518682719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b78006f60 0x7f6b780073e0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00e320 tx=0x7f6b8c01cde0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.806+0000 7f6b93400640 1 -- 172.21.15.173:0/2518682719 reap_dead start 2024-04-25T09:07:39.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.806+0000 7f6b99600640 1 -- 172.21.15.173:0/2518682719 shutdown_connections 2024-04-25T09:07:39.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.806+0000 7f6b99600640 1 -- 172.21.15.173:0/2518682719 >> 172.21.15.173:0/2518682719 conn(0x7f6b9406ac90 msgr2=0x7f6b9406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:39.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.806+0000 7f6b99600640 1 -- 172.21.15.173:0/2518682719 shutdown_connections 2024-04-25T09:07:39.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.806+0000 7f6b99600640 1 -- 172.21.15.173:0/2518682719 wait complete. 2024-04-25T09:07:39.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b99600640 1 Processor -- start 2024-04-25T09:07:39.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b99600640 1 -- start start 2024-04-25T09:07:39.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b99600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b78006f60 0x7f6b94146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:39.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b99600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b940b0230 0x7f6b9414b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:39.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b99600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b94154660 0x7f6b940b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:39.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b99600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b940cc0d0 con 0x7f6b94154660 2024-04-25T09:07:39.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b99600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b94071e10 con 0x7f6b940b0230 2024-04-25T09:07:39.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b99600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b940cc250 con 0x7f6b78006f60 2024-04-25T09:07:39.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b93400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b94154660 0x7f6b940b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:39.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b93400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b94154660 0x7f6b940b10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41524/0 (socket says 172.21.15.173:41524) 2024-04-25T09:07:39.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b93400640 1 -- 172.21.15.173:0/2703598786 learned_addr learned my addr 172.21.15.173:0/2703598786 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:39.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b92000640 1 --2- 172.21.15.173:0/2703598786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b940b0230 0x7f6b9414b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:39.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b93400640 1 -- 172.21.15.173:0/2703598786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b78006f60 msgr2=0x7f6b94146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:39.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b92a00640 1 --2- 172.21.15.173:0/2703598786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b78006f60 0x7f6b94146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:39.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b93400640 1 --2- 172.21.15.173:0/2703598786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b78006f60 0x7f6b94146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b93400640 1 -- 172.21.15.173:0/2703598786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b940b0230 msgr2=0x7f6b9414b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:39.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b93400640 1 --2- 172.21.15.173:0/2703598786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b940b0230 0x7f6b9414b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b93400640 1 -- 172.21.15.173:0/2703598786 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b94146750 con 0x7f6b94154660 2024-04-25T09:07:39.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b92000640 1 --2- 172.21.15.173:0/2703598786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b940b0230 0x7f6b9414b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:39.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b92a00640 1 --2- 172.21.15.173:0/2703598786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b78006f60 0x7f6b94146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:39.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b93400640 1 --2- 172.21.15.173:0/2703598786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b94154660 0x7f6b940b10a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c01c850 tx=0x7f6b8c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:39.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b8aa00640 1 -- 172.21.15.173:0/2703598786 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0b2040 con 0x7f6b94154660 2024-04-25T09:07:39.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b8aa00640 1 -- 172.21.15.173:0/2703598786 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c0a5c50 con 0x7f6b94154660 2024-04-25T09:07:39.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b99600640 1 -- 172.21.15.173:0/2703598786 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b94152240 con 0x7f6b94154660 2024-04-25T09:07:39.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b8aa00640 1 -- 172.21.15.173:0/2703598786 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c009de0 con 0x7f6b94154660 2024-04-25T09:07:39.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b99600640 1 -- 172.21.15.173:0/2703598786 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b94152800 con 0x7f6b94154660 2024-04-25T09:07:39.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.810+0000 7f6b99600640 1 -- 172.21.15.173:0/2703598786 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b94073ab0 con 0x7f6b94154660 2024-04-25T09:07:39.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.814+0000 7f6b8aa00640 1 -- 172.21.15.173:0/2703598786 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6b8c0be020 con 0x7f6b94154660 2024-04-25T09:07:39.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.814+0000 7f6b8aa00640 1 --2- 172.21.15.173:0/2703598786 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6b74066fe0 0x7f6b740694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:39.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.814+0000 7f6b8aa00640 1 -- 172.21.15.173:0/2703598786 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6b8c11f1a0 con 0x7f6b94154660 2024-04-25T09:07:39.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.814+0000 7f6b92a00640 1 --2- 172.21.15.173:0/2703598786 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6b74066fe0 0x7f6b740694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:39.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.814+0000 7f6b92a00640 1 --2- 172.21.15.173:0/2703598786 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6b74066fe0 0x7f6b740694a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6b940d02d0 tx=0x7f6b84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:39.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:39.818+0000 7f6b8aa00640 1 -- 172.21.15.173:0/2703598786 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6b8c0a5e20 con 0x7f6b94154660 2024-04-25T09:07:39.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.010+0000 7f6b99600640 1 -- 172.21.15.173:0/2703598786 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6b9406e1e0 con 0x7f6b94154660 2024-04-25T09:07:40.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.630+0000 7f6b8aa00640 1 -- 172.21.15.173:0/2703598786 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v55) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6b8c016b50 con 0x7f6b94154660 2024-04-25T09:07:40.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.634+0000 7f6b99600640 1 -- 172.21.15.173:0/2703598786 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6b74066fe0 msgr2=0x7f6b740694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:40.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.634+0000 7f6b99600640 1 --2- 172.21.15.173:0/2703598786 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6b74066fe0 0x7f6b740694a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6b940d02d0 tx=0x7f6b84008040 comp rx=0 tx=0).stop 2024-04-25T09:07:40.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.634+0000 7f6b99600640 1 -- 172.21.15.173:0/2703598786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b94154660 msgr2=0x7f6b940b10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:40.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.634+0000 7f6b99600640 1 --2- 172.21.15.173:0/2703598786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b94154660 0x7f6b940b10a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c01c850 tx=0x7f6b8c009750 comp rx=0 tx=0).stop 2024-04-25T09:07:40.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.634+0000 7f6b99600640 1 -- 172.21.15.173:0/2703598786 shutdown_connections 2024-04-25T09:07:40.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.634+0000 7f6b99600640 1 --2- 172.21.15.173:0/2703598786 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6b74066fe0 0x7f6b740694a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.634+0000 7f6b99600640 1 --2- 172.21.15.173:0/2703598786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b94154660 0x7f6b940b10a0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.634+0000 7f6b99600640 1 --2- 172.21.15.173:0/2703598786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b940b0230 0x7f6b9414b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.634+0000 7f6b99600640 1 --2- 172.21.15.173:0/2703598786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b78006f60 0x7f6b94146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.634+0000 7f6b99600640 1 -- 172.21.15.173:0/2703598786 >> 172.21.15.173:0/2703598786 conn(0x7f6b9406ac90 msgr2=0x7f6b9415c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:40.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.634+0000 7f6b99600640 1 -- 172.21.15.173:0/2703598786 shutdown_connections 2024-04-25T09:07:40.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.634+0000 7f6b99600640 1 -- 172.21.15.173:0/2703598786 wait complete. 2024-04-25T09:07:40.641 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:07:40.641 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:40.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.790+0000 7f4402a00640 1 Processor -- start 2024-04-25T09:07:40.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.790+0000 7f4402a00640 1 -- start start 2024-04-25T09:07:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.790+0000 7f4402a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43fc0b3e70 0x7f43fc0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.790+0000 7f4402a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f43fc0aefa0 0x7f43fc0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.790+0000 7f4402a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f43fc15edd0 0x7f43fc0b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.790+0000 7f4402a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43fc06dd50 con 0x7f43fc15edd0 2024-04-25T09:07:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.790+0000 7f4402a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43fc0b4790 con 0x7f43fc0aefa0 2024-04-25T09:07:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.790+0000 7f4402a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc15f320 con 0x7f43fc0b3e70 2024-04-25T09:07:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.794+0000 7f4400a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f43fc15edd0 0x7f43fc0b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.794+0000 7f4400a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f43fc15edd0 0x7f43fc0b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41536/0 (socket says 172.21.15.173:41536) 2024-04-25T09:07:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.794+0000 7f4400a00640 1 -- 172.21.15.173:0/3977082744 learned_addr learned my addr 172.21.15.173:0/3977082744 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.794+0000 7f43fbe00640 1 --2- 172.21.15.173:0/3977082744 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43fc0b3e70 0x7f43fc0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.794+0000 7f43fb400640 1 --2- 172.21.15.173:0/3977082744 >> v2:172.21.15.194:3300/0 conn(0x7f43fc0aefa0 0x7f43fc0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.794+0000 7f4400a00640 1 -- 172.21.15.173:0/3977082744 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43fc0b3e70 msgr2=0x7f43fc0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:40.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.794+0000 7f4400a00640 1 --2- 172.21.15.173:0/3977082744 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43fc0b3e70 0x7f43fc0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.794+0000 7f4400a00640 1 -- 172.21.15.173:0/3977082744 >> v2:172.21.15.194:3300/0 conn(0x7f43fc0aefa0 msgr2=0x7f43fc0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:40.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.794+0000 7f4400a00640 1 --2- 172.21.15.173:0/3977082744 >> v2:172.21.15.194:3300/0 conn(0x7f43fc0aefa0 0x7f43fc0b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.794+0000 7f4400a00640 1 -- 172.21.15.173:0/3977082744 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc06d420 con 0x7f43fc15edd0 2024-04-25T09:07:40.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.794+0000 7f43fb400640 1 --2- 172.21.15.173:0/3977082744 >> v2:172.21.15.194:3300/0 conn(0x7f43fc0aefa0 0x7f43fc0b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f4400a00640 1 --2- 172.21.15.173:0/3977082744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43fc15edd0 0x7f43fc0b2cb0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f43fc062550 tx=0x7f43f401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64896243dd00a161 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f43faa00640 1 -- 172.21.15.173:0/3977082744 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f40a5860 con 0x7f43fc15edd0 2024-04-25T09:07:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f43faa00640 1 -- 172.21.15.173:0/3977082744 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f40a5a00 con 0x7f43fc15edd0 2024-04-25T09:07:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f43faa00640 1 -- 172.21.15.173:0/3977082744 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f40a5dd0 con 0x7f43fc15edd0 2024-04-25T09:07:40.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f4402a00640 1 -- 172.21.15.173:0/3977082744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43fc15edd0 msgr2=0x7f43fc0b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:40.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f4402a00640 1 --2- 172.21.15.173:0/3977082744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43fc15edd0 0x7f43fc0b2cb0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f43fc062550 tx=0x7f43f401c9c0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f4402a00640 1 -- 172.21.15.173:0/3977082744 shutdown_connections 2024-04-25T09:07:40.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f4402a00640 1 --2- 172.21.15.173:0/3977082744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43fc15edd0 0x7f43fc0b2cb0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f4402a00640 1 --2- 172.21.15.173:0/3977082744 >> v2:172.21.15.194:3300/0 conn(0x7f43fc0aefa0 0x7f43fc0b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f4402a00640 1 --2- 172.21.15.173:0/3977082744 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43fc0b3e70 0x7f43fc0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f4402a00640 1 -- 172.21.15.173:0/3977082744 >> 172.21.15.173:0/3977082744 conn(0x7f43fc06ac90 msgr2=0x7f43fc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:40.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f4402a00640 1 -- 172.21.15.173:0/3977082744 shutdown_connections 2024-04-25T09:07:40.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f4402a00640 1 -- 172.21.15.173:0/3977082744 wait complete. 2024-04-25T09:07:40.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f4402a00640 1 Processor -- start 2024-04-25T09:07:40.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f4402a00640 1 -- start start 2024-04-25T09:07:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f4402a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43fc0aefa0 0x7f43fc150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f4402a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43fc0b3e70 0x7f43fc141e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f4402a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43fc15edd0 0x7f43fc1565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f4402a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc06e1c0 con 0x7f43fc0aefa0 2024-04-25T09:07:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f4402a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc0b3600 con 0x7f43fc15edd0 2024-04-25T09:07:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f4402a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc06e340 con 0x7f43fc0b3e70 2024-04-25T09:07:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f43fbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43fc0aefa0 0x7f43fc150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f43fbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43fc0aefa0 0x7f43fc150ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41538/0 (socket says 172.21.15.173:41538) 2024-04-25T09:07:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.798+0000 7f43fbe00640 1 -- 172.21.15.173:0/186276386 learned_addr learned my addr 172.21.15.173:0/186276386 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.802+0000 7f4400a00640 1 --2- 172.21.15.173:0/186276386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43fc15edd0 0x7f43fc1565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.802+0000 7f43fb400640 1 --2- 172.21.15.173:0/186276386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43fc0b3e70 0x7f43fc141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.802+0000 7f43fbe00640 1 -- 172.21.15.173:0/186276386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43fc0b3e70 msgr2=0x7f43fc141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.802+0000 7f43fbe00640 1 --2- 172.21.15.173:0/186276386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43fc0b3e70 0x7f43fc141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.802+0000 7f43fbe00640 1 -- 172.21.15.173:0/186276386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43fc15edd0 msgr2=0x7f43fc1565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.802+0000 7f43fbe00640 1 --2- 172.21.15.173:0/186276386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43fc15edd0 0x7f43fc1565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.802+0000 7f43fbe00640 1 -- 172.21.15.173:0/186276386 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc1425e0 con 0x7f43fc0aefa0 2024-04-25T09:07:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.802+0000 7f43fbe00640 1 --2- 172.21.15.173:0/186276386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43fc0aefa0 0x7f43fc150ee0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00e870 tx=0x7f43ec00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.802+0000 7f43f3e00640 1 -- 172.21.15.173:0/186276386 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec017070 con 0x7f43fc0aefa0 2024-04-25T09:07:40.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.802+0000 7f43f3e00640 1 -- 172.21.15.173:0/186276386 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ec00c940 con 0x7f43fc0aefa0 2024-04-25T09:07:40.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.802+0000 7f4402a00640 1 -- 172.21.15.173:0/186276386 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43fc1428c0 con 0x7f43fc0aefa0 2024-04-25T09:07:40.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.802+0000 7f43f3e00640 1 -- 172.21.15.173:0/186276386 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec00ccf0 con 0x7f43fc0aefa0 2024-04-25T09:07:40.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.802+0000 7f4402a00640 1 -- 172.21.15.173:0/186276386 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43fc15cbc0 con 0x7f43fc0aefa0 2024-04-25T09:07:40.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.802+0000 7f4402a00640 1 -- 172.21.15.173:0/186276386 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43fc142de0 con 0x7f43fc0aefa0 2024-04-25T09:07:40.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.802+0000 7f43f3e00640 1 -- 172.21.15.173:0/186276386 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f43ec01a070 con 0x7f43fc0aefa0 2024-04-25T09:07:40.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.802+0000 7f43f3e00640 1 --2- 172.21.15.173:0/186276386 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f43dc066f60 0x7f43dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.802+0000 7f43f3e00640 1 -- 172.21.15.173:0/186276386 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f43ec0853d0 con 0x7f43fc0aefa0 2024-04-25T09:07:40.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.802+0000 7f43fb400640 1 --2- 172.21.15.173:0/186276386 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f43dc066f60 0x7f43dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.806+0000 7f43fb400640 1 --2- 172.21.15.173:0/186276386 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f43dc066f60 0x7f43dc069420 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f43fc159480 tx=0x7f43e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:40.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.806+0000 7f43f3e00640 1 -- 172.21.15.173:0/186276386 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f43fc142de0 con 0x7f43fc0aefa0 2024-04-25T09:07:40.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.994+0000 7f4402a00640 1 -- 172.21.15.173:0/186276386 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43fc073a40 con 0x7f43fc0aefa0 2024-04-25T09:07:40.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.994+0000 7f43f3e00640 1 -- 172.21.15.173:0/186276386 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f43ec055bf0 con 0x7f43fc0aefa0 2024-04-25T09:07:40.980 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:40.981 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":55,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2817126227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2817126227},{"type":"v1","addr":"172.21.15.194:6835","nonce":2817126227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":6772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3100146198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3100146198},{"type":"v1","addr":"172.21.15.194:6834","nonce":3100146198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":7251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3600648366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3600648366},{"type":"v1","addr":"172.21.15.173:6835","nonce":3600648366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:36.982841+0000","modified":"2024-04-25T09:07:40.013688+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7263":{"gid":7263,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/2444108646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2444108646},{"type":"v1","addr":"172.21.15.173:6837","nonce":2444108646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:07:40.981 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 55 2024-04-25T09:07:40.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.994+0000 7f4402a00640 1 -- 172.21.15.173:0/186276386 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f43dc066f60 msgr2=0x7f43dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:40.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.994+0000 7f4402a00640 1 --2- 172.21.15.173:0/186276386 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f43dc066f60 0x7f43dc069420 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f43fc159480 tx=0x7f43e8008040 comp rx=0 tx=0).stop 2024-04-25T09:07:40.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.994+0000 7f4402a00640 1 -- 172.21.15.173:0/186276386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43fc0aefa0 msgr2=0x7f43fc150ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:40.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.994+0000 7f4402a00640 1 --2- 172.21.15.173:0/186276386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43fc0aefa0 0x7f43fc150ee0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00e870 tx=0x7f43ec00ec70 comp rx=0 tx=0).stop 2024-04-25T09:07:40.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.994+0000 7f4402a00640 1 -- 172.21.15.173:0/186276386 shutdown_connections 2024-04-25T09:07:40.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.994+0000 7f4402a00640 1 --2- 172.21.15.173:0/186276386 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f43dc066f60 0x7f43dc069420 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.994+0000 7f4402a00640 1 --2- 172.21.15.173:0/186276386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43fc15edd0 0x7f43fc1565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.994+0000 7f4402a00640 1 --2- 172.21.15.173:0/186276386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43fc0b3e70 0x7f43fc141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.994+0000 7f4402a00640 1 --2- 172.21.15.173:0/186276386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43fc0aefa0 0x7f43fc150ee0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.994+0000 7f4402a00640 1 -- 172.21.15.173:0/186276386 >> 172.21.15.173:0/186276386 conn(0x7f43fc06ac90 msgr2=0x7f43fc155050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:40.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.994+0000 7f4402a00640 1 -- 172.21.15.173:0/186276386 shutdown_connections 2024-04-25T09:07:40.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:40.994+0000 7f4402a00640 1 -- 172.21.15.173:0/186276386 wait complete. 2024-04-25T09:07:41.001 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:41.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.150+0000 7f2735a00640 1 Processor -- start 2024-04-25T09:07:41.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.150+0000 7f2735a00640 1 -- start start 2024-04-25T09:07:41.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.150+0000 7f2735a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f273015df90 0x7f27300d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.150+0000 7f2735a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f273006f830 0x7f273006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.150+0000 7f2735a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273006d870 con 0x7f273015dbb0 2024-04-25T09:07:41.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.150+0000 7f2735a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273015e5c0 con 0x7f273006f830 2024-04-25T09:07:41.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.150+0000 7f2735a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273015e8a0 con 0x7f273015df90 2024-04-25T09:07:41.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.150+0000 7f272f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f273006f830 0x7f273006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.150+0000 7f272f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f273006f830 0x7f273006fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41542/0 (socket says 172.21.15.173:41542) 2024-04-25T09:07:41.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.150+0000 7f272f400640 1 -- 172.21.15.173:0/1844851688 learned_addr learned my addr 172.21.15.173:0/1844851688 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:41.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.150+0000 7f2726000640 1 --2- 172.21.15.173:0/1844851688 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f273015df90 0x7f27300d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.150+0000 7f272f400640 1 -- 172.21.15.173:0/1844851688 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f273015df90 msgr2=0x7f27300d2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:41.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.150+0000 7f272f400640 1 --2- 172.21.15.173:0/1844851688 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f273015df90 0x7f27300d2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.150+0000 7f272f400640 1 -- 172.21.15.173:0/1844851688 >> v1:172.21.15.194:6789/0 conn(0x7f273015dbb0 legacy=0x7f273006c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.150+0000 7f272f400640 1 -- 172.21.15.173:0/1844851688 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2730161690 con 0x7f273006f830 2024-04-25T09:07:41.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.150+0000 7f272e000640 1 -- 172.21.15.173:0/1844851688 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530724005 0 0) 0x7f273006d870 con 0x7f273015dbb0 2024-04-25T09:07:41.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.154+0000 7f272f400640 1 --2- 172.21.15.173:0/1844851688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f273006f830 0x7f273006fcc0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f2728009e50 tx=0x7f272801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7dfe8f8bafb3e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:41.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.154+0000 7f272e000640 1 -- 172.21.15.173:0/1844851688 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27280a5700 con 0x7f273006f830 2024-04-25T09:07:41.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.154+0000 7f272e000640 1 -- 172.21.15.173:0/1844851688 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27280a58a0 con 0x7f273006f830 2024-04-25T09:07:41.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.154+0000 7f272e000640 1 -- 172.21.15.173:0/1844851688 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27280a5c70 con 0x7f273006f830 2024-04-25T09:07:41.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.154+0000 7f2735a00640 1 -- 172.21.15.173:0/1844851688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f273006f830 msgr2=0x7f273006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.154+0000 7f2735a00640 1 --2- 172.21.15.173:0/1844851688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f273006f830 0x7f273006fcc0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f2728009e50 tx=0x7f272801ca30 comp rx=0 tx=0).stop 2024-04-25T09:07:41.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.154+0000 7f2735a00640 1 -- 172.21.15.173:0/1844851688 shutdown_connections 2024-04-25T09:07:41.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.154+0000 7f2735a00640 1 --2- 172.21.15.173:0/1844851688 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f273015df90 0x7f27300d2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.154+0000 7f2735a00640 1 --2- 172.21.15.173:0/1844851688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f273006f830 0x7f273006fcc0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.154+0000 7f2735a00640 1 -- 172.21.15.173:0/1844851688 >> 172.21.15.173:0/1844851688 conn(0x7f2730061880 msgr2=0x7f2730061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:41.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.154+0000 7f2735a00640 1 -- 172.21.15.173:0/1844851688 shutdown_connections 2024-04-25T09:07:41.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.154+0000 7f2735a00640 1 -- 172.21.15.173:0/1844851688 wait complete. 2024-04-25T09:07:41.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f2735a00640 1 Processor -- start 2024-04-25T09:07:41.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f2735a00640 1 -- start start 2024-04-25T09:07:41.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f2735a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f273006f830 0x7f27300b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f2735a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f273015dbb0 0x7f2730154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f2735a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f273015df90 0x7f2730158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f2735a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273016ab10 con 0x7f273006f830 2024-04-25T09:07:41.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f2735a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273016a990 con 0x7f273015df90 2024-04-25T09:07:41.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f2735a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273016ac90 con 0x7f273015dbb0 2024-04-25T09:07:41.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f272ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f273006f830 0x7f27300b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f2726000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f273015dbb0 0x7f2730154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f272ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f273006f830 0x7f27300b6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41556/0 (socket says 172.21.15.173:41556) 2024-04-25T09:07:41.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f272ea00640 1 -- 172.21.15.173:0/671825267 learned_addr learned my addr 172.21.15.173:0/671825267 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:41.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f272f400640 1 --2- 172.21.15.173:0/671825267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f273015df90 0x7f2730158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f272ea00640 1 -- 172.21.15.173:0/671825267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f273015dbb0 msgr2=0x7f2730154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f272ea00640 1 --2- 172.21.15.173:0/671825267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f273015dbb0 0x7f2730154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f272ea00640 1 -- 172.21.15.173:0/671825267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f273015df90 msgr2=0x7f2730158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f272ea00640 1 --2- 172.21.15.173:0/671825267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f273015df90 0x7f2730158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f272ea00640 1 -- 172.21.15.173:0/671825267 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27300c8340 con 0x7f273006f830 2024-04-25T09:07:41.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f272ea00640 1 --2- 172.21.15.173:0/671825267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f273006f830 0x7f27300b6610 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f2720001ec0 tx=0x7f272000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:41.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f2727400640 1 -- 172.21.15.173:0/671825267 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720017070 con 0x7f273006f830 2024-04-25T09:07:41.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f2727400640 1 -- 172.21.15.173:0/671825267 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2720003600 con 0x7f273006f830 2024-04-25T09:07:41.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f2727400640 1 -- 172.21.15.173:0/671825267 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27200039f0 con 0x7f273006f830 2024-04-25T09:07:41.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f2735a00640 1 -- 172.21.15.173:0/671825267 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27300c7aa0 con 0x7f273006f830 2024-04-25T09:07:41.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f2735a00640 1 -- 172.21.15.173:0/671825267 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27300c8060 con 0x7f273006f830 2024-04-25T09:07:41.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.158+0000 7f2735a00640 1 -- 172.21.15.173:0/671825267 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2730073a40 con 0x7f273006f830 2024-04-25T09:07:41.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.162+0000 7f2727400640 1 -- 172.21.15.173:0/671825267 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f272001a070 con 0x7f273006f830 2024-04-25T09:07:41.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.162+0000 7f2727400640 1 --2- 172.21.15.173:0/671825267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f270c066f60 0x7f270c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.162+0000 7f2727400640 1 -- 172.21.15.173:0/671825267 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2720084590 con 0x7f273006f830 2024-04-25T09:07:41.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.162+0000 7f2726000640 1 --2- 172.21.15.173:0/671825267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f270c066f60 0x7f270c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.162+0000 7f2726000640 1 --2- 172.21.15.173:0/671825267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f270c066f60 0x7f270c069420 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2730168950 tx=0x7f2718009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:41.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.166+0000 7f2727400640 1 -- 172.21.15.173:0/671825267 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2720054d20 con 0x7f273006f830 2024-04-25T09:07:41.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.322+0000 7f2735a00640 1 -- 172.21.15.173:0/671825267 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f273015f630 con 0x7f273006f830 2024-04-25T09:07:41.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.322+0000 7f2727400640 1 -- 172.21.15.173:0/671825267 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+17005 (secure 0 0 0) 0x7f2720058dc0 con 0x7f273006f830 2024-04-25T09:07:41.309 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:41.309 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":84,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:07:38.616400+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:07:35.343920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:07:35.976786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:41.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.322+0000 7f2735a00640 1 -- 172.21.15.173:0/671825267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f270c066f60 msgr2=0x7f270c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.322+0000 7f2735a00640 1 --2- 172.21.15.173:0/671825267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f270c066f60 0x7f270c069420 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2730168950 tx=0x7f2718009190 comp rx=0 tx=0).stop 2024-04-25T09:07:41.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.322+0000 7f2735a00640 1 -- 172.21.15.173:0/671825267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f273006f830 msgr2=0x7f27300b6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.322+0000 7f2735a00640 1 --2- 172.21.15.173:0/671825267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f273006f830 0x7f27300b6610 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f2720001ec0 tx=0x7f272000c8e0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.322+0000 7f2735a00640 1 -- 172.21.15.173:0/671825267 shutdown_connections 2024-04-25T09:07:41.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.322+0000 7f2735a00640 1 --2- 172.21.15.173:0/671825267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f270c066f60 0x7f270c069420 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.322+0000 7f2735a00640 1 --2- 172.21.15.173:0/671825267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f273015df90 0x7f2730158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.322+0000 7f2735a00640 1 --2- 172.21.15.173:0/671825267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f273015dbb0 0x7f2730154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.322+0000 7f2735a00640 1 --2- 172.21.15.173:0/671825267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f273006f830 0x7f27300b6610 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.322+0000 7f2735a00640 1 -- 172.21.15.173:0/671825267 >> 172.21.15.173:0/671825267 conn(0x7f2730061880 msgr2=0x7f27300cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:41.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.322+0000 7f2735a00640 1 -- 172.21.15.173:0/671825267 shutdown_connections 2024-04-25T09:07:41.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.322+0000 7f2735a00640 1 -- 172.21.15.173:0/671825267 wait complete. 2024-04-25T09:07:41.331 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:07:41.331 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:07:41.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.478+0000 7ffa4f200640 1 Processor -- start 2024-04-25T09:07:41.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.478+0000 7ffa4f200640 1 -- start start 2024-04-25T09:07:41.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.482+0000 7ffa4f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa4815dc60 0x7ffa480b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.482+0000 7ffa4f200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ffa480ae810 0x7ffa480aec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.482+0000 7ffa4f200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4815e8e0 con 0x7ffa4815e040 2024-04-25T09:07:41.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.482+0000 7ffa4f200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa480af1a0 con 0x7ffa480ae810 2024-04-25T09:07:41.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.482+0000 7ffa4f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa48071450 con 0x7ffa4815dc60 2024-04-25T09:07:41.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.482+0000 7ffa4d200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ffa480ae810 0x7ffa480aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.482+0000 7ffa3f400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ffa4815e040 0x7ffa480ace10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:56976/0 (socket says 172.21.15.173:56976) 2024-04-25T09:07:41.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.482+0000 7ffa3f400640 1 -- 172.21.15.173:0/3322909138 learned_addr learned my addr 172.21.15.173:0/3322909138 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:41.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.482+0000 7ffa47e00640 1 --2- 172.21.15.173:0/3322909138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa4815dc60 0x7ffa480b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.482+0000 7ffa4d200640 1 -- 172.21.15.173:0/3322909138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa4815dc60 msgr2=0x7ffa480b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:41.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.482+0000 7ffa4d200640 1 --2- 172.21.15.173:0/3322909138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa4815dc60 0x7ffa480b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.482+0000 7ffa4d200640 1 -- 172.21.15.173:0/3322909138 >> v1:172.21.15.173:6789/0 conn(0x7ffa4815e040 legacy=0x7ffa480ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.482+0000 7ffa4d200640 1 -- 172.21.15.173:0/3322909138 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4815ebc0 con 0x7ffa480ae810 2024-04-25T09:07:41.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.482+0000 7ffa47400640 1 -- 172.21.15.173:0/3322909138 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422960624 0 0) 0x7ffa4815e8e0 con 0x7ffa4815e040 2024-04-25T09:07:41.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.482+0000 7ffa4d200640 1 --2- 172.21.15.173:0/3322909138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa480ae810 0x7ffa480aec60 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009d90 tx=0x7ffa4001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6c9d6e5ff77b7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:41.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa47400640 1 -- 172.21.15.173:0/3322909138 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa400b2070 con 0x7ffa480ae810 2024-04-25T09:07:41.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa47400640 1 -- 172.21.15.173:0/3322909138 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa400a5920 con 0x7ffa480ae810 2024-04-25T09:07:41.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa47400640 1 -- 172.21.15.173:0/3322909138 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa400a5cf0 con 0x7ffa480ae810 2024-04-25T09:07:41.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa4f200640 1 -- 172.21.15.173:0/3322909138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa480ae810 msgr2=0x7ffa480aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa4f200640 1 --2- 172.21.15.173:0/3322909138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa480ae810 0x7ffa480aec60 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009d90 tx=0x7ffa4001c970 comp rx=0 tx=0).stop 2024-04-25T09:07:41.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa4f200640 1 -- 172.21.15.173:0/3322909138 shutdown_connections 2024-04-25T09:07:41.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa4f200640 1 --2- 172.21.15.173:0/3322909138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa480ae810 0x7ffa480aec60 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa4f200640 1 --2- 172.21.15.173:0/3322909138 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa4815dc60 0x7ffa480b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa4f200640 1 -- 172.21.15.173:0/3322909138 >> 172.21.15.173:0/3322909138 conn(0x7ffa4806ac90 msgr2=0x7ffa4806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:41.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa4f200640 1 -- 172.21.15.173:0/3322909138 shutdown_connections 2024-04-25T09:07:41.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa4f200640 1 -- 172.21.15.173:0/3322909138 wait complete. 2024-04-25T09:07:41.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa4f200640 1 Processor -- start 2024-04-25T09:07:41.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa4f200640 1 -- start start 2024-04-25T09:07:41.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa4f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa480ae810 0x7ffa48152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa4f200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa4815dc60 0x7ffa4815b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa4f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa4815e040 0x7ffa4815b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa4f200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4815e440 con 0x7ffa4815dc60 2024-04-25T09:07:41.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa4f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa480ad520 con 0x7ffa4815e040 2024-04-25T09:07:41.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa4f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4815e5c0 con 0x7ffa480ae810 2024-04-25T09:07:41.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa3f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa4815dc60 0x7ffa4815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa3f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa4815dc60 0x7ffa4815b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41584/0 (socket says 172.21.15.173:41584) 2024-04-25T09:07:41.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa3f400640 1 -- 172.21.15.173:0/1093563747 learned_addr learned my addr 172.21.15.173:0/1093563747 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:41.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa4d200640 1 --2- 172.21.15.173:0/1093563747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa4815e040 0x7ffa4815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.486+0000 7ffa47e00640 1 --2- 172.21.15.173:0/1093563747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa480ae810 0x7ffa48152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.490+0000 7ffa3f400640 1 -- 172.21.15.173:0/1093563747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa480ae810 msgr2=0x7ffa48152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.490+0000 7ffa3f400640 1 --2- 172.21.15.173:0/1093563747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa480ae810 0x7ffa48152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.490+0000 7ffa3f400640 1 -- 172.21.15.173:0/1093563747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa4815e040 msgr2=0x7ffa4815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.490+0000 7ffa3f400640 1 --2- 172.21.15.173:0/1093563747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa4815e040 0x7ffa4815b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.490+0000 7ffa3f400640 1 -- 172.21.15.173:0/1093563747 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4815bfa0 con 0x7ffa4815dc60 2024-04-25T09:07:41.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.490+0000 7ffa3f400640 1 --2- 172.21.15.173:0/1093563747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa4815dc60 0x7ffa4815b230 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7ffa380011f0 tx=0x7ffa3800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:41.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.490+0000 7ffa44c00640 1 -- 172.21.15.173:0/1093563747 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38018070 con 0x7ffa4815dc60 2024-04-25T09:07:41.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.490+0000 7ffa44c00640 1 -- 172.21.15.173:0/1093563747 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa380074e0 con 0x7ffa4815dc60 2024-04-25T09:07:41.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.490+0000 7ffa44c00640 1 -- 172.21.15.173:0/1093563747 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38004a10 con 0x7ffa4815dc60 2024-04-25T09:07:41.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.490+0000 7ffa4f200640 1 -- 172.21.15.173:0/1093563747 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4815c280 con 0x7ffa4815dc60 2024-04-25T09:07:41.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.490+0000 7ffa4f200640 1 -- 172.21.15.173:0/1093563747 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4815c840 con 0x7ffa4815dc60 2024-04-25T09:07:41.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.490+0000 7ffa4f200640 1 -- 172.21.15.173:0/1093563747 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa48073a40 con 0x7ffa4815dc60 2024-04-25T09:07:41.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.490+0000 7ffa44c00640 1 -- 172.21.15.173:0/1093563747 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffa38004bb0 con 0x7ffa4815dc60 2024-04-25T09:07:41.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.490+0000 7ffa44c00640 1 --2- 172.21.15.173:0/1093563747 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa24066f90 0x7ffa24069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.490+0000 7ffa44c00640 1 -- 172.21.15.173:0/1093563747 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ffa38084400 con 0x7ffa4815dc60 2024-04-25T09:07:41.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.490+0000 7ffa47e00640 1 --2- 172.21.15.173:0/1093563747 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa24066f90 0x7ffa24069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.494+0000 7ffa47e00640 1 --2- 172.21.15.173:0/1093563747 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa24066f90 0x7ffa24069450 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ffa48153b30 tx=0x7ffa30008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:41.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.494+0000 7ffa44c00640 1 -- 172.21.15.173:0/1093563747 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffa38054c20 con 0x7ffa4815dc60 2024-04-25T09:07:41.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.650+0000 7ffa4f200640 1 -- 172.21.15.173:0/1093563747 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffa480723f0 con 0x7ffa24066f90 2024-04-25T09:07:41.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.658+0000 7ffa44c00640 1 -- 172.21.15.173:0/1093563747 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251559 (secure 0 0 0) 0x7ffa480723f0 con 0x7ffa24066f90 2024-04-25T09:07:41.646 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:07:41.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.658+0000 7ffa4f200640 1 -- 172.21.15.173:0/1093563747 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa24066f90 msgr2=0x7ffa24069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.658+0000 7ffa4f200640 1 --2- 172.21.15.173:0/1093563747 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa24066f90 0x7ffa24069450 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ffa48153b30 tx=0x7ffa30008040 comp rx=0 tx=0).stop 2024-04-25T09:07:41.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.658+0000 7ffa4f200640 1 -- 172.21.15.173:0/1093563747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa4815dc60 msgr2=0x7ffa4815b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.658+0000 7ffa4f200640 1 --2- 172.21.15.173:0/1093563747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa4815dc60 0x7ffa4815b230 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7ffa380011f0 tx=0x7ffa3800c9b0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.662+0000 7ffa4f200640 1 -- 172.21.15.173:0/1093563747 shutdown_connections 2024-04-25T09:07:41.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.662+0000 7ffa4f200640 1 --2- 172.21.15.173:0/1093563747 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ffa24066f90 0x7ffa24069450 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.662+0000 7ffa4f200640 1 --2- 172.21.15.173:0/1093563747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa4815e040 0x7ffa4815b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.662+0000 7ffa4f200640 1 --2- 172.21.15.173:0/1093563747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa4815dc60 0x7ffa4815b230 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.662+0000 7ffa4f200640 1 --2- 172.21.15.173:0/1093563747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa480ae810 0x7ffa48152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.662+0000 7ffa4f200640 1 -- 172.21.15.173:0/1093563747 >> 172.21.15.173:0/1093563747 conn(0x7ffa4806ac90 msgr2=0x7ffa4806d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:41.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.662+0000 7ffa4f200640 1 -- 172.21.15.173:0/1093563747 shutdown_connections 2024-04-25T09:07:41.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.662+0000 7ffa4f200640 1 -- 172.21.15.173:0/1093563747 wait complete. 2024-04-25T09:07:41.667 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2024-04-25T09:07:40.789622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":200,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":322364,"kb_used_data":9068,"kb_used_omap":12,"kb_used_meta":313139,"kb_avail":754652356,"statfs":{"total":773094113280,"available":772764012544,"internally_reserved":0,"allocated":9285632,"data_stored":4870932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":320654896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.199805"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-04-25T09:07:36.607014+0000","last_change":"2024-04-25T09:07:36.607014+0000","last_active":"2024-04-25T09:07:36.589349+0000","last_peered":"2024-04-25T09:07:36.589349+0000","last_clean":"2024-04-25T09:07:36.589349+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:07:36.607014+0000","last_undegraded":"2024-04-25T09:07:36.607014+0000","last_fullsized":"2024-04-25T09:07:36.607014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635118+0000","last_change":"2024-04-25T09:07:37.642120+0000","last_active":"2024-04-25T09:07:38.635118+0000","last_peered":"2024-04-25T09:07:38.635118+0000","last_clean":"2024-04-25T09:07:38.635118+0000","last_became_active":"2024-04-25T09:07:37.641706+0000","last_became_peered":"2024-04-25T09:07:37.641706+0000","last_unstale":"2024-04-25T09:07:38.635118+0000","last_undegraded":"2024-04-25T09:07:38.635118+0000","last_fullsized":"2024-04-25T09:07:38.635118+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:14.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.637727+0000","last_change":"2024-04-25T09:07:37.629356+0000","last_active":"2024-04-25T09:07:37.637727+0000","last_peered":"2024-04-25T09:07:37.637727+0000","last_clean":"2024-04-25T09:07:37.637727+0000","last_became_active":"2024-04-25T09:07:37.629071+0000","last_became_peered":"2024-04-25T09:07:37.629071+0000","last_unstale":"2024-04-25T09:07:37.637727+0000","last_undegraded":"2024-04-25T09:07:37.637727+0000","last_fullsized":"2024-04-25T09:07:37.637727+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:25.741760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.628278+0000","last_change":"2024-04-25T09:07:37.626588+0000","last_active":"2024-04-25T09:07:37.628278+0000","last_peered":"2024-04-25T09:07:37.628278+0000","last_clean":"2024-04-25T09:07:37.628278+0000","last_became_active":"2024-04-25T09:07:37.625527+0000","last_became_peered":"2024-04-25T09:07:37.625527+0000","last_unstale":"2024-04-25T09:07:37.628278+0000","last_undegraded":"2024-04-25T09:07:37.628278+0000","last_fullsized":"2024-04-25T09:07:37.628278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:40.108001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637267+0000","last_change":"2024-04-25T09:07:37.639626+0000","last_active":"2024-04-25T09:07:38.637267+0000","last_peered":"2024-04-25T09:07:38.637267+0000","last_clean":"2024-04-25T09:07:38.637267+0000","last_became_active":"2024-04-25T09:07:37.636488+0000","last_became_peered":"2024-04-25T09:07:37.636488+0000","last_unstale":"2024-04-25T09:07:38.637267+0000","last_undegraded":"2024-04-25T09:07:38.637267+0000","last_fullsized":"2024-04-25T09:07:38.637267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:33.387139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620739+0000","last_change":"2024-04-25T09:07:37.618282+0000","last_active":"2024-04-25T09:07:38.620739+0000","last_peered":"2024-04-25T09:07:38.620739+0000","last_clean":"2024-04-25T09:07:38.620739+0000","last_became_active":"2024-04-25T09:07:37.617980+0000","last_became_peered":"2024-04-25T09:07:37.617980+0000","last_unstale":"2024-04-25T09:07:38.620739+0000","last_undegraded":"2024-04-25T09:07:38.620739+0000","last_fullsized":"2024-04-25T09:07:38.620739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.374955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620911+0000","last_change":"2024-04-25T09:07:37.634612+0000","last_active":"2024-04-25T09:07:38.620911+0000","last_peered":"2024-04-25T09:07:38.620911+0000","last_clean":"2024-04-25T09:07:38.620911+0000","last_became_active":"2024-04-25T09:07:37.634272+0000","last_became_peered":"2024-04-25T09:07:37.634272+0000","last_unstale":"2024-04-25T09:07:38.620911+0000","last_undegraded":"2024-04-25T09:07:38.620911+0000","last_fullsized":"2024-04-25T09:07:38.620911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:24.395404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637140+0000","last_change":"2024-04-25T09:07:37.632445+0000","last_active":"2024-04-25T09:07:38.637140+0000","last_peered":"2024-04-25T09:07:38.637140+0000","last_clean":"2024-04-25T09:07:38.637140+0000","last_became_active":"2024-04-25T09:07:37.632100+0000","last_became_peered":"2024-04-25T09:07:37.632100+0000","last_unstale":"2024-04-25T09:07:38.637140+0000","last_undegraded":"2024-04-25T09:07:38.637140+0000","last_fullsized":"2024-04-25T09:07:38.637140+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:34.107400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621523+0000","last_change":"2024-04-25T09:07:37.620664+0000","last_active":"2024-04-25T09:07:38.621523+0000","last_peered":"2024-04-25T09:07:38.621523+0000","last_clean":"2024-04-25T09:07:38.621523+0000","last_became_active":"2024-04-25T09:07:37.620393+0000","last_became_peered":"2024-04-25T09:07:37.620393+0000","last_unstale":"2024-04-25T09:07:38.621523+0000","last_undegraded":"2024-04-25T09:07:38.621523+0000","last_fullsized":"2024-04-25T09:07:38.621523+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:37.691190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631368+0000","last_change":"2024-04-25T09:07:37.628104+0000","last_active":"2024-04-25T09:07:37.631368+0000","last_peered":"2024-04-25T09:07:37.631368+0000","last_clean":"2024-04-25T09:07:37.631368+0000","last_became_active":"2024-04-25T09:07:37.627451+0000","last_became_peered":"2024-04-25T09:07:37.627451+0000","last_unstale":"2024-04-25T09:07:37.631368+0000","last_undegraded":"2024-04-25T09:07:37.631368+0000","last_fullsized":"2024-04-25T09:07:37.631368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:54.940460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635165+0000","last_change":"2024-04-25T09:07:37.638244+0000","last_active":"2024-04-25T09:07:38.635165+0000","last_peered":"2024-04-25T09:07:38.635165+0000","last_clean":"2024-04-25T09:07:38.635165+0000","last_became_active":"2024-04-25T09:07:37.637967+0000","last_became_peered":"2024-04-25T09:07:37.637967+0000","last_unstale":"2024-04-25T09:07:38.635165+0000","last_undegraded":"2024-04-25T09:07:38.635165+0000","last_fullsized":"2024-04-25T09:07:38.635165+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:40.123592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631283+0000","last_change":"2024-04-25T09:07:37.628390+0000","last_active":"2024-04-25T09:07:37.631283+0000","last_peered":"2024-04-25T09:07:37.631283+0000","last_clean":"2024-04-25T09:07:37.631283+0000","last_became_active":"2024-04-25T09:07:37.628101+0000","last_became_peered":"2024-04-25T09:07:37.628101+0000","last_unstale":"2024-04-25T09:07:37.631283+0000","last_undegraded":"2024-04-25T09:07:37.631283+0000","last_fullsized":"2024-04-25T09:07:37.631283+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:21.781597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637387+0000","last_change":"2024-04-25T09:07:37.644053+0000","last_active":"2024-04-25T09:07:38.637387+0000","last_peered":"2024-04-25T09:07:38.637387+0000","last_clean":"2024-04-25T09:07:38.637387+0000","last_became_active":"2024-04-25T09:07:37.643783+0000","last_became_peered":"2024-04-25T09:07:37.643783+0000","last_unstale":"2024-04-25T09:07:38.637387+0000","last_undegraded":"2024-04-25T09:07:38.637387+0000","last_fullsized":"2024-04-25T09:07:38.637387+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:57.907870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620774+0000","last_change":"2024-04-25T09:07:37.618084+0000","last_active":"2024-04-25T09:07:38.620774+0000","last_peered":"2024-04-25T09:07:38.620774+0000","last_clean":"2024-04-25T09:07:38.620774+0000","last_became_active":"2024-04-25T09:07:37.617758+0000","last_became_peered":"2024-04-25T09:07:37.617758+0000","last_unstale":"2024-04-25T09:07:38.620774+0000","last_undegraded":"2024-04-25T09:07:38.620774+0000","last_fullsized":"2024-04-25T09:07:38.620774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:53.134215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634782+0000","last_change":"2024-04-25T09:07:37.624978+0000","last_active":"2024-04-25T09:07:38.634782+0000","last_peered":"2024-04-25T09:07:38.634782+0000","last_clean":"2024-04-25T09:07:38.634782+0000","last_became_active":"2024-04-25T09:07:37.624509+0000","last_became_peered":"2024-04-25T09:07:37.624509+0000","last_unstale":"2024-04-25T09:07:38.634782+0000","last_undegraded":"2024-04-25T09:07:38.634782+0000","last_fullsized":"2024-04-25T09:07:38.634782+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:18.688958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-04-25T09:07:36.604384+0000","last_change":"2024-04-25T09:07:36.604384+0000","last_active":"2024-04-25T09:07:36.589349+0000","last_peered":"2024-04-25T09:07:36.589349+0000","last_clean":"2024-04-25T09:07:36.589349+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:07:36.604384+0000","last_undegraded":"2024-04-25T09:07:36.604384+0000","last_fullsized":"2024-04-25T09:07:36.604384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637781+0000","last_change":"2024-04-25T09:07:37.639108+0000","last_active":"2024-04-25T09:07:38.637781+0000","last_peered":"2024-04-25T09:07:38.637781+0000","last_clean":"2024-04-25T09:07:38.637781+0000","last_became_active":"2024-04-25T09:07:37.638532+0000","last_became_peered":"2024-04-25T09:07:37.638532+0000","last_unstale":"2024-04-25T09:07:38.637781+0000","last_undegraded":"2024-04-25T09:07:38.637781+0000","last_fullsized":"2024-04-25T09:07:38.637781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:02.132000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.638553+0000","last_change":"2024-04-25T09:07:37.634860+0000","last_active":"2024-04-25T09:07:37.638553+0000","last_peered":"2024-04-25T09:07:37.638553+0000","last_clean":"2024-04-25T09:07:37.638553+0000","last_became_active":"2024-04-25T09:07:37.634582+0000","last_became_peered":"2024-04-25T09:07:37.634582+0000","last_unstale":"2024-04-25T09:07:37.638553+0000","last_undegraded":"2024-04-25T09:07:37.638553+0000","last_fullsized":"2024-04-25T09:07:37.638553+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:31.359245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621086+0000","last_change":"2024-04-25T09:07:37.638340+0000","last_active":"2024-04-25T09:07:38.621086+0000","last_peered":"2024-04-25T09:07:38.621086+0000","last_clean":"2024-04-25T09:07:38.621086+0000","last_became_active":"2024-04-25T09:07:37.638060+0000","last_became_peered":"2024-04-25T09:07:37.638060+0000","last_unstale":"2024-04-25T09:07:38.621086+0000","last_undegraded":"2024-04-25T09:07:38.621086+0000","last_fullsized":"2024-04-25T09:07:38.621086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:09.628669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637578+0000","last_change":"2024-04-25T09:07:37.639988+0000","last_active":"2024-04-25T09:07:38.637578+0000","last_peered":"2024-04-25T09:07:38.637578+0000","last_clean":"2024-04-25T09:07:38.637578+0000","last_became_active":"2024-04-25T09:07:37.639263+0000","last_became_peered":"2024-04-25T09:07:37.639263+0000","last_unstale":"2024-04-25T09:07:38.637578+0000","last_undegraded":"2024-04-25T09:07:38.637578+0000","last_fullsized":"2024-04-25T09:07:38.637578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:38.575243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621067+0000","last_change":"2024-04-25T09:07:37.633413+0000","last_active":"2024-04-25T09:07:38.621067+0000","last_peered":"2024-04-25T09:07:38.621067+0000","last_clean":"2024-04-25T09:07:38.621067+0000","last_became_active":"2024-04-25T09:07:37.633132+0000","last_became_peered":"2024-04-25T09:07:37.633132+0000","last_unstale":"2024-04-25T09:07:38.621067+0000","last_undegraded":"2024-04-25T09:07:38.621067+0000","last_fullsized":"2024-04-25T09:07:38.621067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:41.064820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637379+0000","last_change":"2024-04-25T09:07:37.644962+0000","last_active":"2024-04-25T09:07:38.637379+0000","last_peered":"2024-04-25T09:07:38.637379+0000","last_clean":"2024-04-25T09:07:38.637379+0000","last_became_active":"2024-04-25T09:07:37.644695+0000","last_became_peered":"2024-04-25T09:07:37.644695+0000","last_unstale":"2024-04-25T09:07:38.637379+0000","last_undegraded":"2024-04-25T09:07:38.637379+0000","last_fullsized":"2024-04-25T09:07:38.637379+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:05:45.625216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.622028+0000","last_change":"2024-04-25T09:07:37.624852+0000","last_active":"2024-04-25T09:07:38.622028+0000","last_peered":"2024-04-25T09:07:38.622028+0000","last_clean":"2024-04-25T09:07:38.622028+0000","last_became_active":"2024-04-25T09:07:37.624552+0000","last_became_peered":"2024-04-25T09:07:37.624552+0000","last_unstale":"2024-04-25T09:07:38.622028+0000","last_undegraded":"2024-04-25T09:07:38.622028+0000","last_fullsized":"2024-04-25T09:07:38.622028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:55.922340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634678+0000","last_change":"2024-04-25T09:07:37.628098+0000","last_active":"2024-04-25T09:07:38.634678+0000","last_peered":"2024-04-25T09:07:38.634678+0000","last_clean":"2024-04-25T09:07:38.634678+0000","last_became_active":"2024-04-25T09:07:37.627827+0000","last_became_peered":"2024-04-25T09:07:37.627827+0000","last_unstale":"2024-04-25T09:07:38.634678+0000","last_undegraded":"2024-04-25T09:07:38.634678+0000","last_fullsized":"2024-04-25T09:07:38.634678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:45.887572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635119+0000","last_change":"2024-04-25T09:07:37.627502+0000","last_active":"2024-04-25T09:07:38.635119+0000","last_peered":"2024-04-25T09:07:38.635119+0000","last_clean":"2024-04-25T09:07:38.635119+0000","last_became_active":"2024-04-25T09:07:37.626614+0000","last_became_peered":"2024-04-25T09:07:37.626614+0000","last_unstale":"2024-04-25T09:07:38.635119+0000","last_undegraded":"2024-04-25T09:07:38.635119+0000","last_fullsized":"2024-04-25T09:07:38.635119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:52.345009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631388+0000","last_change":"2024-04-25T09:07:37.630155+0000","last_active":"2024-04-25T09:07:37.631388+0000","last_peered":"2024-04-25T09:07:37.631388+0000","last_clean":"2024-04-25T09:07:37.631388+0000","last_became_active":"2024-04-25T09:07:37.629889+0000","last_became_peered":"2024-04-25T09:07:37.629889+0000","last_unstale":"2024-04-25T09:07:37.631388+0000","last_undegraded":"2024-04-25T09:07:37.631388+0000","last_fullsized":"2024-04-25T09:07:37.631388+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:12.490521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-04-25T09:07:36.607030+0000","last_change":"2024-04-25T09:07:36.607030+0000","last_active":"2024-04-25T09:07:36.589349+0000","last_peered":"2024-04-25T09:07:36.589349+0000","last_clean":"2024-04-25T09:07:36.589349+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:07:36.607030+0000","last_undegraded":"2024-04-25T09:07:36.607030+0000","last_fullsized":"2024-04-25T09:07:36.607030+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637640+0000","last_change":"2024-04-25T09:07:37.638930+0000","last_active":"2024-04-25T09:07:38.637640+0000","last_peered":"2024-04-25T09:07:38.637640+0000","last_clean":"2024-04-25T09:07:38.637640+0000","last_became_active":"2024-04-25T09:07:37.637356+0000","last_became_peered":"2024-04-25T09:07:37.637356+0000","last_unstale":"2024-04-25T09:07:38.637640+0000","last_undegraded":"2024-04-25T09:07:38.637640+0000","last_fullsized":"2024-04-25T09:07:38.637640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:54.912036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634809+0000","last_change":"2024-04-25T09:07:37.620835+0000","last_active":"2024-04-25T09:07:38.634809+0000","last_peered":"2024-04-25T09:07:38.634809+0000","last_clean":"2024-04-25T09:07:38.634809+0000","last_became_active":"2024-04-25T09:07:37.620537+0000","last_became_peered":"2024-04-25T09:07:37.620537+0000","last_unstale":"2024-04-25T09:07:38.634809+0000","last_undegraded":"2024-04-25T09:07:38.634809+0000","last_fullsized":"2024-04-25T09:07:38.634809+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:25.439081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-04-25T09:07:36.603398+0000","last_change":"2024-04-25T09:07:36.603398+0000","last_active":"2024-04-25T09:07:36.589349+0000","last_peered":"2024-04-25T09:07:36.589349+0000","last_clean":"2024-04-25T09:07:36.589349+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:07:36.603398+0000","last_undegraded":"2024-04-25T09:07:36.603398+0000","last_fullsized":"2024-04-25T09:07:36.603398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631453+0000","last_change":"2024-04-25T09:07:37.625322+0000","last_active":"2024-04-25T09:07:37.631453+0000","last_peered":"2024-04-25T09:07:37.631453+0000","last_clean":"2024-04-25T09:07:37.631453+0000","last_became_active":"2024-04-25T09:07:37.624684+0000","last_became_peered":"2024-04-25T09:07:37.624684+0000","last_unstale":"2024-04-25T09:07:37.631453+0000","last_undegraded":"2024-04-25T09:07:37.631453+0000","last_fullsized":"2024-04-25T09:07:37.631453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:12.567183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-04-25T09:07:36.603941+0000","last_change":"2024-04-25T09:07:36.603941+0000","last_active":"2024-04-25T09:07:36.589349+0000","last_peered":"2024-04-25T09:07:36.589349+0000","last_clean":"2024-04-25T09:07:36.589349+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:07:36.603941+0000","last_undegraded":"2024-04-25T09:07:36.603941+0000","last_fullsized":"2024-04-25T09:07:36.603941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.635064+0000","last_change":"2024-04-25T09:07:37.626057+0000","last_active":"2024-04-25T09:07:37.635064+0000","last_peered":"2024-04-25T09:07:37.635064+0000","last_clean":"2024-04-25T09:07:37.635064+0000","last_became_active":"2024-04-25T09:07:37.625736+0000","last_became_peered":"2024-04-25T09:07:37.625736+0000","last_unstale":"2024-04-25T09:07:37.635064+0000","last_undegraded":"2024-04-25T09:07:37.635064+0000","last_fullsized":"2024-04-25T09:07:37.635064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:50.340971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"83'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637794+0000","last_change":"2024-04-25T09:07:36.616376+0000","last_active":"2024-04-25T09:07:38.637794+0000","last_peered":"2024-04-25T09:07:38.637794+0000","last_clean":"2024-04-25T09:07:38.637794+0000","last_became_active":"2024-04-25T09:07:36.616075+0000","last_became_peered":"2024-04-25T09:07:36.616075+0000","last_unstale":"2024-04-25T09:07:38.637794+0000","last_undegraded":"2024-04-25T09:07:38.637794+0000","last_fullsized":"2024-04-25T09:07:38.637794+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:26.377752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634935+0000","last_change":"2024-04-25T09:07:37.628208+0000","last_active":"2024-04-25T09:07:38.634935+0000","last_peered":"2024-04-25T09:07:38.634935+0000","last_clean":"2024-04-25T09:07:38.634935+0000","last_became_active":"2024-04-25T09:07:37.627848+0000","last_became_peered":"2024-04-25T09:07:37.627848+0000","last_unstale":"2024-04-25T09:07:38.634935+0000","last_undegraded":"2024-04-25T09:07:38.634935+0000","last_fullsized":"2024-04-25T09:07:38.634935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:24.857733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.622668+0000","last_change":"2024-04-25T09:07:36.619079+0000","last_active":"2024-04-25T09:07:36.622668+0000","last_peered":"2024-04-25T09:07:36.622668+0000","last_clean":"2024-04-25T09:07:36.622668+0000","last_became_active":"2024-04-25T09:07:36.618396+0000","last_became_peered":"2024-04-25T09:07:36.618396+0000","last_unstale":"2024-04-25T09:07:36.622668+0000","last_undegraded":"2024-04-25T09:07:36.622668+0000","last_fullsized":"2024-04-25T09:07:36.622668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:59.294654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621321+0000","last_change":"2024-04-25T09:07:37.628645+0000","last_active":"2024-04-25T09:07:38.621321+0000","last_peered":"2024-04-25T09:07:38.621321+0000","last_clean":"2024-04-25T09:07:38.621321+0000","last_became_active":"2024-04-25T09:07:37.628344+0000","last_became_peered":"2024-04-25T09:07:37.628344+0000","last_unstale":"2024-04-25T09:07:38.621321+0000","last_undegraded":"2024-04-25T09:07:38.621321+0000","last_fullsized":"2024-04-25T09:07:38.621321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:46.246638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.622513+0000","last_change":"2024-04-25T09:07:36.618033+0000","last_active":"2024-04-25T09:07:36.622513+0000","last_peered":"2024-04-25T09:07:36.622513+0000","last_clean":"2024-04-25T09:07:36.622513+0000","last_became_active":"2024-04-25T09:07:36.617755+0000","last_became_peered":"2024-04-25T09:07:36.617755+0000","last_unstale":"2024-04-25T09:07:36.622513+0000","last_undegraded":"2024-04-25T09:07:36.622513+0000","last_fullsized":"2024-04-25T09:07:36.622513+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:31.306923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621071+0000","last_change":"2024-04-25T09:07:37.633374+0000","last_active":"2024-04-25T09:07:38.621071+0000","last_peered":"2024-04-25T09:07:38.621071+0000","last_clean":"2024-04-25T09:07:38.621071+0000","last_became_active":"2024-04-25T09:07:37.633097+0000","last_became_peered":"2024-04-25T09:07:37.633097+0000","last_unstale":"2024-04-25T09:07:38.621071+0000","last_undegraded":"2024-04-25T09:07:38.621071+0000","last_fullsized":"2024-04-25T09:07:38.621071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:04.260863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620809+0000","last_change":"2024-04-25T09:07:36.615481+0000","last_active":"2024-04-25T09:07:38.620809+0000","last_peered":"2024-04-25T09:07:38.620809+0000","last_clean":"2024-04-25T09:07:38.620809+0000","last_became_active":"2024-04-25T09:07:36.615203+0000","last_became_peered":"2024-04-25T09:07:36.615203+0000","last_unstale":"2024-04-25T09:07:38.620809+0000","last_undegraded":"2024-04-25T09:07:38.620809+0000","last_fullsized":"2024-04-25T09:07:38.620809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:03.253872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635044+0000","last_change":"2024-04-25T09:07:37.642388+0000","last_active":"2024-04-25T09:07:38.635044+0000","last_peered":"2024-04-25T09:07:38.635044+0000","last_clean":"2024-04-25T09:07:38.635044+0000","last_became_active":"2024-04-25T09:07:37.641673+0000","last_became_peered":"2024-04-25T09:07:37.641673+0000","last_unstale":"2024-04-25T09:07:38.635044+0000","last_undegraded":"2024-04-25T09:07:38.635044+0000","last_fullsized":"2024-04-25T09:07:38.635044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:01.788399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621200+0000","last_change":"2024-04-25T09:07:36.616454+0000","last_active":"2024-04-25T09:07:38.621200+0000","last_peered":"2024-04-25T09:07:38.621200+0000","last_clean":"2024-04-25T09:07:38.621200+0000","last_became_active":"2024-04-25T09:07:36.616058+0000","last_became_peered":"2024-04-25T09:07:36.616058+0000","last_unstale":"2024-04-25T09:07:38.621200+0000","last_undegraded":"2024-04-25T09:07:38.621200+0000","last_fullsized":"2024-04-25T09:07:38.621200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:19.115185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635202+0000","last_change":"2024-04-25T09:07:37.645238+0000","last_active":"2024-04-25T09:07:38.635202+0000","last_peered":"2024-04-25T09:07:38.635202+0000","last_clean":"2024-04-25T09:07:38.635202+0000","last_became_active":"2024-04-25T09:07:37.644352+0000","last_became_peered":"2024-04-25T09:07:37.644352+0000","last_unstale":"2024-04-25T09:07:38.635202+0000","last_undegraded":"2024-04-25T09:07:38.635202+0000","last_fullsized":"2024-04-25T09:07:38.635202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.374955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.644227+0000","last_change":"2024-04-25T09:07:36.610047+0000","last_active":"2024-04-25T09:07:37.644227+0000","last_peered":"2024-04-25T09:07:37.644227+0000","last_clean":"2024-04-25T09:07:37.644227+0000","last_became_active":"2024-04-25T09:07:36.609786+0000","last_became_peered":"2024-04-25T09:07:36.609786+0000","last_unstale":"2024-04-25T09:07:37.644227+0000","last_undegraded":"2024-04-25T09:07:37.644227+0000","last_fullsized":"2024-04-25T09:07:37.644227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:14.391941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621584+0000","last_change":"2024-04-25T09:07:37.617101+0000","last_active":"2024-04-25T09:07:38.621584+0000","last_peered":"2024-04-25T09:07:38.621584+0000","last_clean":"2024-04-25T09:07:38.621584+0000","last_became_active":"2024-04-25T09:07:37.616000+0000","last_became_peered":"2024-04-25T09:07:37.616000+0000","last_unstale":"2024-04-25T09:07:38.621584+0000","last_undegraded":"2024-04-25T09:07:38.621584+0000","last_fullsized":"2024-04-25T09:07:38.621584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:55.162579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634902+0000","last_change":"2024-04-25T09:07:36.614605+0000","last_active":"2024-04-25T09:07:38.634902+0000","last_peered":"2024-04-25T09:07:38.634902+0000","last_clean":"2024-04-25T09:07:38.634902+0000","last_became_active":"2024-04-25T09:07:36.614349+0000","last_became_peered":"2024-04-25T09:07:36.614349+0000","last_unstale":"2024-04-25T09:07:38.634902+0000","last_undegraded":"2024-04-25T09:07:38.634902+0000","last_fullsized":"2024-04-25T09:07:38.634902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:39.401019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621551+0000","last_change":"2024-04-25T09:07:37.642318+0000","last_active":"2024-04-25T09:07:38.621551+0000","last_peered":"2024-04-25T09:07:38.621551+0000","last_clean":"2024-04-25T09:07:38.621551+0000","last_became_active":"2024-04-25T09:07:37.641879+0000","last_became_peered":"2024-04-25T09:07:37.641879+0000","last_unstale":"2024-04-25T09:07:38.621551+0000","last_undegraded":"2024-04-25T09:07:38.621551+0000","last_fullsized":"2024-04-25T09:07:38.621551+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:33.063248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637137+0000","last_change":"2024-04-25T09:07:36.616980+0000","last_active":"2024-04-25T09:07:38.637137+0000","last_peered":"2024-04-25T09:07:38.637137+0000","last_clean":"2024-04-25T09:07:38.637137+0000","last_became_active":"2024-04-25T09:07:36.616698+0000","last_became_peered":"2024-04-25T09:07:36.616698+0000","last_unstale":"2024-04-25T09:07:38.637137+0000","last_undegraded":"2024-04-25T09:07:38.637137+0000","last_fullsized":"2024-04-25T09:07:38.637137+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:05.199952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634687+0000","last_change":"2024-04-25T09:07:37.618246+0000","last_active":"2024-04-25T09:07:38.634687+0000","last_peered":"2024-04-25T09:07:38.634687+0000","last_clean":"2024-04-25T09:07:38.634687+0000","last_became_active":"2024-04-25T09:07:37.617992+0000","last_became_peered":"2024-04-25T09:07:37.617992+0000","last_unstale":"2024-04-25T09:07:38.634687+0000","last_undegraded":"2024-04-25T09:07:38.634687+0000","last_fullsized":"2024-04-25T09:07:38.634687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:15.922910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.625601+0000","last_change":"2024-04-25T09:07:36.623042+0000","last_active":"2024-04-25T09:07:36.625601+0000","last_peered":"2024-04-25T09:07:36.625601+0000","last_clean":"2024-04-25T09:07:36.625601+0000","last_became_active":"2024-04-25T09:07:36.622793+0000","last_became_peered":"2024-04-25T09:07:36.622793+0000","last_unstale":"2024-04-25T09:07:36.625601+0000","last_undegraded":"2024-04-25T09:07:36.625601+0000","last_fullsized":"2024-04-25T09:07:36.625601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:52.551723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631331+0000","last_change":"2024-04-25T09:07:37.629312+0000","last_active":"2024-04-25T09:07:37.631331+0000","last_peered":"2024-04-25T09:07:37.631331+0000","last_clean":"2024-04-25T09:07:37.631331+0000","last_became_active":"2024-04-25T09:07:37.627276+0000","last_became_peered":"2024-04-25T09:07:37.627276+0000","last_unstale":"2024-04-25T09:07:37.631331+0000","last_undegraded":"2024-04-25T09:07:37.631331+0000","last_fullsized":"2024-04-25T09:07:37.631331+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:38.473267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.621587+0000","last_change":"2024-04-25T09:07:36.613966+0000","last_active":"2024-04-25T09:07:37.621587+0000","last_peered":"2024-04-25T09:07:37.621587+0000","last_clean":"2024-04-25T09:07:37.621587+0000","last_became_active":"2024-04-25T09:07:36.613700+0000","last_became_peered":"2024-04-25T09:07:36.613700+0000","last_unstale":"2024-04-25T09:07:37.621587+0000","last_undegraded":"2024-04-25T09:07:37.621587+0000","last_fullsized":"2024-04-25T09:07:37.621587+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:56.184210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620920+0000","last_change":"2024-04-25T09:07:37.624293+0000","last_active":"2024-04-25T09:07:38.620920+0000","last_peered":"2024-04-25T09:07:38.620920+0000","last_clean":"2024-04-25T09:07:38.620920+0000","last_became_active":"2024-04-25T09:07:37.624036+0000","last_became_peered":"2024-04-25T09:07:37.624036+0000","last_unstale":"2024-04-25T09:07:38.620920+0000","last_undegraded":"2024-04-25T09:07:38.620920+0000","last_fullsized":"2024-04-25T09:07:38.620920+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:34.726656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"83'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637768+0000","last_change":"2024-04-25T09:07:36.621681+0000","last_active":"2024-04-25T09:07:38.637768+0000","last_peered":"2024-04-25T09:07:38.637768+0000","last_clean":"2024-04-25T09:07:38.637768+0000","last_became_active":"2024-04-25T09:07:36.621425+0000","last_became_peered":"2024-04-25T09:07:36.621425+0000","last_unstale":"2024-04-25T09:07:38.637768+0000","last_undegraded":"2024-04-25T09:07:38.637768+0000","last_fullsized":"2024-04-25T09:07:38.637768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:12.826909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.638070+0000","last_change":"2024-04-25T09:07:37.631958+0000","last_active":"2024-04-25T09:07:37.638070+0000","last_peered":"2024-04-25T09:07:37.638070+0000","last_clean":"2024-04-25T09:07:37.638070+0000","last_became_active":"2024-04-25T09:07:37.631694+0000","last_became_peered":"2024-04-25T09:07:37.631694+0000","last_unstale":"2024-04-25T09:07:37.638070+0000","last_undegraded":"2024-04-25T09:07:37.638070+0000","last_fullsized":"2024-04-25T09:07:37.638070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:16.140878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"83'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620920+0000","last_change":"2024-04-25T09:07:36.605032+0000","last_active":"2024-04-25T09:07:38.620920+0000","last_peered":"2024-04-25T09:07:38.620920+0000","last_clean":"2024-04-25T09:07:38.620920+0000","last_became_active":"2024-04-25T09:07:36.603703+0000","last_became_peered":"2024-04-25T09:07:36.603703+0000","last_unstale":"2024-04-25T09:07:38.620920+0000","last_undegraded":"2024-04-25T09:07:38.620920+0000","last_fullsized":"2024-04-25T09:07:38.620920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:45.239647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631261+0000","last_change":"2024-04-25T09:07:37.628226+0000","last_active":"2024-04-25T09:07:37.631261+0000","last_peered":"2024-04-25T09:07:37.631261+0000","last_clean":"2024-04-25T09:07:37.631261+0000","last_became_active":"2024-04-25T09:07:37.625863+0000","last_became_peered":"2024-04-25T09:07:37.625863+0000","last_unstale":"2024-04-25T09:07:37.631261+0000","last_undegraded":"2024-04-25T09:07:37.631261+0000","last_fullsized":"2024-04-25T09:07:37.631261+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:33.063248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.641096+0000","last_change":"2024-04-25T09:07:36.611263+0000","last_active":"2024-04-25T09:07:37.641096+0000","last_peered":"2024-04-25T09:07:37.641096+0000","last_clean":"2024-04-25T09:07:37.641096+0000","last_became_active":"2024-04-25T09:07:36.610934+0000","last_became_peered":"2024-04-25T09:07:36.610934+0000","last_unstale":"2024-04-25T09:07:37.641096+0000","last_undegraded":"2024-04-25T09:07:37.641096+0000","last_fullsized":"2024-04-25T09:07:37.641096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:32.093652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621017+0000","last_change":"2024-04-25T09:07:37.625227+0000","last_active":"2024-04-25T09:07:38.621017+0000","last_peered":"2024-04-25T09:07:38.621017+0000","last_clean":"2024-04-25T09:07:38.621017+0000","last_became_active":"2024-04-25T09:07:37.624685+0000","last_became_peered":"2024-04-25T09:07:37.624685+0000","last_unstale":"2024-04-25T09:07:38.621017+0000","last_undegraded":"2024-04-25T09:07:38.621017+0000","last_fullsized":"2024-04-25T09:07:38.621017+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:15.398932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.625219+0000","last_change":"2024-04-25T09:07:36.620051+0000","last_active":"2024-04-25T09:07:36.625219+0000","last_peered":"2024-04-25T09:07:36.625219+0000","last_clean":"2024-04-25T09:07:36.625219+0000","last_became_active":"2024-04-25T09:07:36.619717+0000","last_became_peered":"2024-04-25T09:07:36.619717+0000","last_unstale":"2024-04-25T09:07:36.625219+0000","last_undegraded":"2024-04-25T09:07:36.625219+0000","last_fullsized":"2024-04-25T09:07:36.625219+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:58.842729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620865+0000","last_change":"2024-04-25T09:07:37.623281+0000","last_active":"2024-04-25T09:07:38.620865+0000","last_peered":"2024-04-25T09:07:38.620865+0000","last_clean":"2024-04-25T09:07:38.620865+0000","last_became_active":"2024-04-25T09:07:37.622461+0000","last_became_peered":"2024-04-25T09:07:37.622461+0000","last_unstale":"2024-04-25T09:07:38.620865+0000","last_undegraded":"2024-04-25T09:07:38.620865+0000","last_fullsized":"2024-04-25T09:07:38.620865+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:33.100643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637133+0000","last_change":"2024-04-25T09:07:36.617283+0000","last_active":"2024-04-25T09:07:38.637133+0000","last_peered":"2024-04-25T09:07:38.637133+0000","last_clean":"2024-04-25T09:07:38.637133+0000","last_became_active":"2024-04-25T09:07:36.615973+0000","last_became_peered":"2024-04-25T09:07:36.615973+0000","last_unstale":"2024-04-25T09:07:38.637133+0000","last_undegraded":"2024-04-25T09:07:38.637133+0000","last_fullsized":"2024-04-25T09:07:38.637133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:08.020375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621771+0000","last_change":"2024-04-25T09:07:37.628648+0000","last_active":"2024-04-25T09:07:38.621771+0000","last_peered":"2024-04-25T09:07:38.621771+0000","last_clean":"2024-04-25T09:07:38.621771+0000","last_became_active":"2024-04-25T09:07:37.627443+0000","last_became_peered":"2024-04-25T09:07:37.627443+0000","last_unstale":"2024-04-25T09:07:38.621771+0000","last_undegraded":"2024-04-25T09:07:38.621771+0000","last_fullsized":"2024-04-25T09:07:38.621771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:21.781597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"83'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634813+0000","last_change":"2024-04-25T09:07:36.601617+0000","last_active":"2024-04-25T09:07:38.634813+0000","last_peered":"2024-04-25T09:07:38.634813+0000","last_clean":"2024-04-25T09:07:38.634813+0000","last_became_active":"2024-04-25T09:07:36.601323+0000","last_became_peered":"2024-04-25T09:07:36.601323+0000","last_unstale":"2024-04-25T09:07:38.634813+0000","last_undegraded":"2024-04-25T09:07:38.634813+0000","last_fullsized":"2024-04-25T09:07:38.634813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:41.678865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620974+0000","last_change":"2024-04-25T09:07:37.627836+0000","last_active":"2024-04-25T09:07:38.620974+0000","last_peered":"2024-04-25T09:07:38.620974+0000","last_clean":"2024-04-25T09:07:38.620974+0000","last_became_active":"2024-04-25T09:07:37.627568+0000","last_became_peered":"2024-04-25T09:07:37.627568+0000","last_unstale":"2024-04-25T09:07:38.620974+0000","last_undegraded":"2024-04-25T09:07:38.620974+0000","last_fullsized":"2024-04-25T09:07:38.620974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:56.952875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.625246+0000","last_change":"2024-04-25T09:07:36.621694+0000","last_active":"2024-04-25T09:07:36.625246+0000","last_peered":"2024-04-25T09:07:36.625246+0000","last_clean":"2024-04-25T09:07:36.625246+0000","last_became_active":"2024-04-25T09:07:36.621503+0000","last_became_peered":"2024-04-25T09:07:36.621503+0000","last_unstale":"2024-04-25T09:07:36.625246+0000","last_undegraded":"2024-04-25T09:07:36.625246+0000","last_fullsized":"2024-04-25T09:07:36.625246+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:18.001799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637180+0000","last_change":"2024-04-25T09:07:37.635114+0000","last_active":"2024-04-25T09:07:38.637180+0000","last_peered":"2024-04-25T09:07:38.637180+0000","last_clean":"2024-04-25T09:07:38.637180+0000","last_became_active":"2024-04-25T09:07:37.634833+0000","last_became_peered":"2024-04-25T09:07:37.634833+0000","last_unstale":"2024-04-25T09:07:38.637180+0000","last_undegraded":"2024-04-25T09:07:38.637180+0000","last_fullsized":"2024-04-25T09:07:38.637180+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:53.605713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621693+0000","last_change":"2024-04-25T09:07:36.616078+0000","last_active":"2024-04-25T09:07:38.621693+0000","last_peered":"2024-04-25T09:07:38.621693+0000","last_clean":"2024-04-25T09:07:38.621693+0000","last_became_active":"2024-04-25T09:07:36.615403+0000","last_became_peered":"2024-04-25T09:07:36.615403+0000","last_unstale":"2024-04-25T09:07:38.621693+0000","last_undegraded":"2024-04-25T09:07:38.621693+0000","last_fullsized":"2024-04-25T09:07:38.621693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:15.009651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637101+0000","last_change":"2024-04-25T09:07:37.646400+0000","last_active":"2024-04-25T09:07:38.637101+0000","last_peered":"2024-04-25T09:07:38.637101+0000","last_clean":"2024-04-25T09:07:38.637101+0000","last_became_active":"2024-04-25T09:07:37.646129+0000","last_became_peered":"2024-04-25T09:07:37.646129+0000","last_unstale":"2024-04-25T09:07:38.637101+0000","last_undegraded":"2024-04-25T09:07:38.637101+0000","last_fullsized":"2024-04-25T09:07:38.637101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:02.389276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637780+0000","last_change":"2024-04-25T09:07:36.617644+0000","last_active":"2024-04-25T09:07:38.637780+0000","last_peered":"2024-04-25T09:07:38.637780+0000","last_clean":"2024-04-25T09:07:38.637780+0000","last_became_active":"2024-04-25T09:07:36.616325+0000","last_became_peered":"2024-04-25T09:07:36.616325+0000","last_unstale":"2024-04-25T09:07:38.637780+0000","last_undegraded":"2024-04-25T09:07:38.637780+0000","last_fullsized":"2024-04-25T09:07:38.637780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:31.620809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620896+0000","last_change":"2024-04-25T09:07:37.639937+0000","last_active":"2024-04-25T09:07:38.620896+0000","last_peered":"2024-04-25T09:07:38.620896+0000","last_clean":"2024-04-25T09:07:38.620896+0000","last_became_active":"2024-04-25T09:07:37.633606+0000","last_became_peered":"2024-04-25T09:07:37.633606+0000","last_unstale":"2024-04-25T09:07:38.620896+0000","last_undegraded":"2024-04-25T09:07:38.620896+0000","last_fullsized":"2024-04-25T09:07:38.620896+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:03.532182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.617233+0000","last_change":"2024-04-25T09:07:36.622372+0000","last_active":"2024-04-25T09:07:37.617233+0000","last_peered":"2024-04-25T09:07:37.617233+0000","last_clean":"2024-04-25T09:07:37.617233+0000","last_became_active":"2024-04-25T09:07:36.622088+0000","last_became_peered":"2024-04-25T09:07:36.622088+0000","last_unstale":"2024-04-25T09:07:37.617233+0000","last_undegraded":"2024-04-25T09:07:37.617233+0000","last_fullsized":"2024-04-25T09:07:37.617233+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:35.244653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635171+0000","last_change":"2024-04-25T09:07:37.629723+0000","last_active":"2024-04-25T09:07:38.635171+0000","last_peered":"2024-04-25T09:07:38.635171+0000","last_clean":"2024-04-25T09:07:38.635171+0000","last_became_active":"2024-04-25T09:07:37.629081+0000","last_became_peered":"2024-04-25T09:07:37.629081+0000","last_unstale":"2024-04-25T09:07:38.635171+0000","last_undegraded":"2024-04-25T09:07:38.635171+0000","last_fullsized":"2024-04-25T09:07:38.635171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:36.626956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620850+0000","last_change":"2024-04-25T09:07:36.619552+0000","last_active":"2024-04-25T09:07:38.620850+0000","last_peered":"2024-04-25T09:07:38.620850+0000","last_clean":"2024-04-25T09:07:38.620850+0000","last_became_active":"2024-04-25T09:07:36.619248+0000","last_became_peered":"2024-04-25T09:07:36.619248+0000","last_unstale":"2024-04-25T09:07:38.620850+0000","last_undegraded":"2024-04-25T09:07:38.620850+0000","last_fullsized":"2024-04-25T09:07:38.620850+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:17.681967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635263+0000","last_change":"2024-04-25T09:07:37.622142+0000","last_active":"2024-04-25T09:07:38.635263+0000","last_peered":"2024-04-25T09:07:38.635263+0000","last_clean":"2024-04-25T09:07:38.635263+0000","last_became_active":"2024-04-25T09:07:37.621887+0000","last_became_peered":"2024-04-25T09:07:37.621887+0000","last_unstale":"2024-04-25T09:07:38.635263+0000","last_undegraded":"2024-04-25T09:07:38.635263+0000","last_fullsized":"2024-04-25T09:07:38.635263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:53.134215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620629+0000","last_change":"2024-04-25T09:07:36.611689+0000","last_active":"2024-04-25T09:07:38.620629+0000","last_peered":"2024-04-25T09:07:38.620629+0000","last_clean":"2024-04-25T09:07:38.620629+0000","last_became_active":"2024-04-25T09:07:36.611363+0000","last_became_peered":"2024-04-25T09:07:36.611363+0000","last_unstale":"2024-04-25T09:07:38.620629+0000","last_undegraded":"2024-04-25T09:07:38.620629+0000","last_fullsized":"2024-04-25T09:07:38.620629+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:14.915918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621924+0000","last_change":"2024-04-25T09:07:37.627431+0000","last_active":"2024-04-25T09:07:38.621924+0000","last_peered":"2024-04-25T09:07:38.621924+0000","last_clean":"2024-04-25T09:07:38.621924+0000","last_became_active":"2024-04-25T09:07:37.627171+0000","last_became_peered":"2024-04-25T09:07:37.627171+0000","last_unstale":"2024-04-25T09:07:38.621924+0000","last_undegraded":"2024-04-25T09:07:38.621924+0000","last_fullsized":"2024-04-25T09:07:38.621924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:38.473267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620530+0000","last_change":"2024-04-25T09:07:36.614988+0000","last_active":"2024-04-25T09:07:38.620530+0000","last_peered":"2024-04-25T09:07:38.620530+0000","last_clean":"2024-04-25T09:07:38.620530+0000","last_became_active":"2024-04-25T09:07:36.614690+0000","last_became_peered":"2024-04-25T09:07:36.614690+0000","last_unstale":"2024-04-25T09:07:38.620530+0000","last_undegraded":"2024-04-25T09:07:38.620530+0000","last_fullsized":"2024-04-25T09:07:38.620530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:24.432090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621771+0000","last_change":"2024-04-25T09:07:37.621882+0000","last_active":"2024-04-25T09:07:38.621771+0000","last_peered":"2024-04-25T09:07:38.621771+0000","last_clean":"2024-04-25T09:07:38.621771+0000","last_became_active":"2024-04-25T09:07:37.621628+0000","last_became_peered":"2024-04-25T09:07:37.621628+0000","last_unstale":"2024-04-25T09:07:38.621771+0000","last_undegraded":"2024-04-25T09:07:38.621771+0000","last_fullsized":"2024-04-25T09:07:38.621771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:44.455585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.644170+0000","last_change":"2024-04-25T09:07:36.618544+0000","last_active":"2024-04-25T09:07:37.644170+0000","last_peered":"2024-04-25T09:07:37.644170+0000","last_clean":"2024-04-25T09:07:37.644170+0000","last_became_active":"2024-04-25T09:07:36.618264+0000","last_became_peered":"2024-04-25T09:07:36.618264+0000","last_unstale":"2024-04-25T09:07:37.644170+0000","last_undegraded":"2024-04-25T09:07:37.644170+0000","last_fullsized":"2024-04-25T09:07:37.644170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:23.388413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621069+0000","last_change":"2024-04-25T09:07:37.623868+0000","last_active":"2024-04-25T09:07:38.621069+0000","last_peered":"2024-04-25T09:07:38.621069+0000","last_clean":"2024-04-25T09:07:38.621069+0000","last_became_active":"2024-04-25T09:07:37.623586+0000","last_became_peered":"2024-04-25T09:07:37.623586+0000","last_unstale":"2024-04-25T09:07:38.621069+0000","last_undegraded":"2024-04-25T09:07:38.621069+0000","last_fullsized":"2024-04-25T09:07:38.621069+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:57.191201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"84'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.636608+0000","last_change":"2024-04-25T09:07:36.620391+0000","last_active":"2024-04-25T09:07:38.636608+0000","last_peered":"2024-04-25T09:07:38.636608+0000","last_clean":"2024-04-25T09:07:38.636608+0000","last_became_active":"2024-04-25T09:07:36.619820+0000","last_became_peered":"2024-04-25T09:07:36.619820+0000","last_unstale":"2024-04-25T09:07:38.636608+0000","last_undegraded":"2024-04-25T09:07:38.636608+0000","last_fullsized":"2024-04-25T09:07:38.636608+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:50.109112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621494+0000","last_change":"2024-04-25T09:07:37.621282+0000","last_active":"2024-04-25T09:07:38.621494+0000","last_peered":"2024-04-25T09:07:38.621494+0000","last_clean":"2024-04-25T09:07:38.621494+0000","last_became_active":"2024-04-25T09:07:37.620633+0000","last_became_peered":"2024-04-25T09:07:37.620633+0000","last_unstale":"2024-04-25T09:07:38.621494+0000","last_undegraded":"2024-04-25T09:07:38.621494+0000","last_fullsized":"2024-04-25T09:07:38.621494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:45.953616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.618207+0000","last_change":"2024-04-25T09:07:36.617437+0000","last_active":"2024-04-25T09:07:36.618207+0000","last_peered":"2024-04-25T09:07:36.618207+0000","last_clean":"2024-04-25T09:07:36.618207+0000","last_became_active":"2024-04-25T09:07:36.617117+0000","last_became_peered":"2024-04-25T09:07:36.617117+0000","last_unstale":"2024-04-25T09:07:36.618207+0000","last_undegraded":"2024-04-25T09:07:36.618207+0000","last_fullsized":"2024-04-25T09:07:36.618207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:38.211669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634889+0000","last_change":"2024-04-25T09:07:37.617426+0000","last_active":"2024-04-25T09:07:38.634889+0000","last_peered":"2024-04-25T09:07:38.634889+0000","last_clean":"2024-04-25T09:07:38.634889+0000","last_became_active":"2024-04-25T09:07:37.617172+0000","last_became_peered":"2024-04-25T09:07:37.617172+0000","last_unstale":"2024-04-25T09:07:38.634889+0000","last_undegraded":"2024-04-25T09:07:38.634889+0000","last_fullsized":"2024-04-25T09:07:38.634889+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:10.692785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.622645+0000","last_change":"2024-04-25T09:07:36.619230+0000","last_active":"2024-04-25T09:07:36.622645+0000","last_peered":"2024-04-25T09:07:36.622645+0000","last_clean":"2024-04-25T09:07:36.622645+0000","last_became_active":"2024-04-25T09:07:36.618957+0000","last_became_peered":"2024-04-25T09:07:36.618957+0000","last_unstale":"2024-04-25T09:07:36.622645+0000","last_undegraded":"2024-04-25T09:07:36.622645+0000","last_fullsized":"2024-04-25T09:07:36.622645+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:49.874474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621380+0000","last_change":"2024-04-25T09:07:37.628246+0000","last_active":"2024-04-25T09:07:38.621380+0000","last_peered":"2024-04-25T09:07:38.621380+0000","last_clean":"2024-04-25T09:07:38.621380+0000","last_became_active":"2024-04-25T09:07:37.623529+0000","last_became_peered":"2024-04-25T09:07:37.623529+0000","last_unstale":"2024-04-25T09:07:38.621380+0000","last_undegraded":"2024-04-25T09:07:38.621380+0000","last_fullsized":"2024-04-25T09:07:38.621380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:54.940460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620686+0000","last_change":"2024-04-25T09:07:36.612649+0000","last_active":"2024-04-25T09:07:38.620686+0000","last_peered":"2024-04-25T09:07:38.620686+0000","last_clean":"2024-04-25T09:07:38.620686+0000","last_became_active":"2024-04-25T09:07:36.611900+0000","last_became_peered":"2024-04-25T09:07:36.611900+0000","last_unstale":"2024-04-25T09:07:38.620686+0000","last_undegraded":"2024-04-25T09:07:38.620686+0000","last_fullsized":"2024-04-25T09:07:38.620686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:40.057829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621211+0000","last_change":"2024-04-25T09:07:37.634630+0000","last_active":"2024-04-25T09:07:38.621211+0000","last_peered":"2024-04-25T09:07:38.621211+0000","last_clean":"2024-04-25T09:07:38.621211+0000","last_became_active":"2024-04-25T09:07:37.634242+0000","last_became_peered":"2024-04-25T09:07:37.634242+0000","last_unstale":"2024-04-25T09:07:38.621211+0000","last_undegraded":"2024-04-25T09:07:38.621211+0000","last_fullsized":"2024-04-25T09:07:38.621211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:40.108001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637258+0000","last_change":"2024-04-25T09:07:36.617056+0000","last_active":"2024-04-25T09:07:38.637258+0000","last_peered":"2024-04-25T09:07:38.637258+0000","last_clean":"2024-04-25T09:07:38.637258+0000","last_became_active":"2024-04-25T09:07:36.616846+0000","last_became_peered":"2024-04-25T09:07:36.616846+0000","last_unstale":"2024-04-25T09:07:38.637258+0000","last_undegraded":"2024-04-25T09:07:38.637258+0000","last_fullsized":"2024-04-25T09:07:38.637258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:07.592728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.638281+0000","last_change":"2024-04-25T09:07:37.629289+0000","last_active":"2024-04-25T09:07:37.638281+0000","last_peered":"2024-04-25T09:07:37.638281+0000","last_clean":"2024-04-25T09:07:37.638281+0000","last_became_active":"2024-04-25T09:07:37.629029+0000","last_became_peered":"2024-04-25T09:07:37.629029+0000","last_unstale":"2024-04-25T09:07:37.638281+0000","last_undegraded":"2024-04-25T09:07:37.638281+0000","last_fullsized":"2024-04-25T09:07:37.638281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:33.841194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621190+0000","last_change":"2024-04-25T09:07:36.605134+0000","last_active":"2024-04-25T09:07:38.621190+0000","last_peered":"2024-04-25T09:07:38.621190+0000","last_clean":"2024-04-25T09:07:38.621190+0000","last_became_active":"2024-04-25T09:07:36.604853+0000","last_became_peered":"2024-04-25T09:07:36.604853+0000","last_unstale":"2024-04-25T09:07:38.621190+0000","last_undegraded":"2024-04-25T09:07:38.621190+0000","last_fullsized":"2024-04-25T09:07:38.621190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:44.946625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.639900+0000","last_change":"2024-04-25T09:07:37.635406+0000","last_active":"2024-04-25T09:07:37.639900+0000","last_peered":"2024-04-25T09:07:37.639900+0000","last_clean":"2024-04-25T09:07:37.639900+0000","last_became_active":"2024-04-25T09:07:37.635219+0000","last_became_peered":"2024-04-25T09:07:37.635219+0000","last_unstale":"2024-04-25T09:07:37.639900+0000","last_undegraded":"2024-04-25T09:07:37.639900+0000","last_fullsized":"2024-04-25T09:07:37.639900+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:42.758124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.615985+0000","last_change":"2024-04-25T09:07:36.612144+0000","last_active":"2024-04-25T09:07:37.615985+0000","last_peered":"2024-04-25T09:07:37.615985+0000","last_clean":"2024-04-25T09:07:37.615985+0000","last_became_active":"2024-04-25T09:07:36.610715+0000","last_became_peered":"2024-04-25T09:07:36.610715+0000","last_unstale":"2024-04-25T09:07:37.615985+0000","last_undegraded":"2024-04-25T09:07:37.615985+0000","last_fullsized":"2024-04-25T09:07:37.615985+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:07.868609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-04-25T09:07:36.606259+0000","last_change":"2024-04-25T09:07:36.606259+0000","last_active":"2024-04-25T09:07:36.589349+0000","last_peered":"2024-04-25T09:07:36.589349+0000","last_clean":"2024-04-25T09:07:36.589349+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:07:36.606259+0000","last_undegraded":"2024-04-25T09:07:36.606259+0000","last_fullsized":"2024-04-25T09:07:36.606259+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621217+0000","last_change":"2024-04-25T09:07:36.615155+0000","last_active":"2024-04-25T09:07:38.621217+0000","last_peered":"2024-04-25T09:07:38.621217+0000","last_clean":"2024-04-25T09:07:38.621217+0000","last_became_active":"2024-04-25T09:07:36.614868+0000","last_became_peered":"2024-04-25T09:07:36.614868+0000","last_unstale":"2024-04-25T09:07:38.621217+0000","last_undegraded":"2024-04-25T09:07:38.621217+0000","last_fullsized":"2024-04-25T09:07:38.621217+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:09.685794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":280,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.607625+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:07:36.607625+0000","last_peered":"2024-04-25T09:07:36.607625+0000","last_clean":"2024-04-25T09:07:36.607625+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:07:36.607625+0000","last_undegraded":"2024-04-25T09:07:36.607625+0000","last_fullsized":"2024-04-25T09:07:36.607625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1019904,"data_stored":464016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509503,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1011712,"data_stored":462438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509504,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1028096,"data_stored":464120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509503,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1011712,"data_stored":462986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509503,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36344,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335496,"statfs":{"total":96636764160,"available":96599547904,"internally_reserved":0,"allocated":1019904,"data_stored":463146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509504,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1015808,"data_stored":462516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509504,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59120,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312720,"statfs":{"total":96636764160,"available":96576225280,"internally_reserved":0,"allocated":1601536,"data_stored":1052772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36884,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334956,"statfs":{"total":96636764160,"available":96598994944,"internally_reserved":0,"allocated":1576960,"data_stored":1038938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:07:41.672 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:07:41.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.858+0000 7f97a8c00640 1 Processor -- start 2024-04-25T09:07:41.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.862+0000 7f97a8c00640 1 -- start start 2024-04-25T09:07:41.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.862+0000 7f97a8c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f97a415dbb0 0x7f97a415df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.862+0000 7f97a8c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f97a40d2130 0x7f97a406c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.862+0000 7f97a8c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a406d870 con 0x7f97a406c7b0 2024-04-25T09:07:41.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.862+0000 7f97a8c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a40d2590 con 0x7f97a415dbb0 2024-04-25T09:07:41.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.862+0000 7f97a8c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a415e5c0 con 0x7f97a40d2130 2024-04-25T09:07:41.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.862+0000 7f97a1e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f97a415dbb0 0x7f97a415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.862+0000 7f97a1e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f97a415dbb0 0x7f97a415df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41590/0 (socket says 172.21.15.173:41590) 2024-04-25T09:07:41.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.862+0000 7f97a1e00640 1 -- 172.21.15.173:0/757094810 learned_addr learned my addr 172.21.15.173:0/757094810 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:41.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.862+0000 7f9799400640 1 --2- 172.21.15.173:0/757094810 >> v2:172.21.15.194:3300/0 conn(0x7f97a40d2130 0x7f97a406c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.862+0000 7f97a1e00640 1 -- 172.21.15.173:0/757094810 >> v2:172.21.15.194:3300/0 conn(0x7f97a40d2130 msgr2=0x7f97a406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:41.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.862+0000 7f97a1e00640 1 --2- 172.21.15.173:0/757094810 >> v2:172.21.15.194:3300/0 conn(0x7f97a40d2130 0x7f97a406c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.862+0000 7f97a1e00640 1 -- 172.21.15.173:0/757094810 >> v1:172.21.15.194:6789/0 conn(0x7f97a406c7b0 legacy=0x7f97a406f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.862+0000 7f97a1e00640 1 -- 172.21.15.173:0/757094810 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a4161690 con 0x7f97a415dbb0 2024-04-25T09:07:41.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.866+0000 7f97a1e00640 1 --2- 172.21.15.173:0/757094810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97a415dbb0 0x7f97a415df90 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f97a4070590 tx=0x7f979401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b65de532c376cce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:41.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.866+0000 7f97a1400640 1 -- 172.21.15.173:0/757094810 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97940aa650 con 0x7f97a415dbb0 2024-04-25T09:07:41.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.866+0000 7f97a1400640 1 -- 172.21.15.173:0/757094810 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97940af070 con 0x7f97a415dbb0 2024-04-25T09:07:41.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.866+0000 7f97a1400640 1 -- 172.21.15.173:0/757094810 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97940aaa10 con 0x7f97a415dbb0 2024-04-25T09:07:41.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.866+0000 7f97a8c00640 1 -- 172.21.15.173:0/757094810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97a415dbb0 msgr2=0x7f97a415df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.866+0000 7f97a8c00640 1 --2- 172.21.15.173:0/757094810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97a415dbb0 0x7f97a415df90 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f97a4070590 tx=0x7f979401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.866+0000 7f97a8c00640 1 -- 172.21.15.173:0/757094810 shutdown_connections 2024-04-25T09:07:41.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.866+0000 7f97a8c00640 1 --2- 172.21.15.173:0/757094810 >> v2:172.21.15.194:3300/0 conn(0x7f97a40d2130 0x7f97a406c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.866+0000 7f97a8c00640 1 --2- 172.21.15.173:0/757094810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97a415dbb0 0x7f97a415df90 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.866+0000 7f97a8c00640 1 -- 172.21.15.173:0/757094810 >> 172.21.15.173:0/757094810 conn(0x7f97a4061880 msgr2=0x7f97a4061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:41.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.866+0000 7f97a8c00640 1 -- 172.21.15.173:0/757094810 shutdown_connections 2024-04-25T09:07:41.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.866+0000 7f97a8c00640 1 -- 172.21.15.173:0/757094810 wait complete. 2024-04-25T09:07:41.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.866+0000 7f97a8c00640 1 Processor -- start 2024-04-25T09:07:41.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.866+0000 7f97a8c00640 1 -- start start 2024-04-25T09:07:41.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a8c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97a406c7b0 0x7f97a40b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a8c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97a40d2130 0x7f97a4159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a8c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97a415dbb0 0x7f97a41596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a8c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a41624d0 con 0x7f97a406c7b0 2024-04-25T09:07:41.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a8c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a4162350 con 0x7f97a40d2130 2024-04-25T09:07:41.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a8c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a406ff40 con 0x7f97a415dbb0 2024-04-25T09:07:41.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a1e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97a406c7b0 0x7f97a40b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a1e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97a406c7b0 0x7f97a40b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41594/0 (socket says 172.21.15.173:41594) 2024-04-25T09:07:41.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a1e00640 1 -- 172.21.15.173:0/1056908984 learned_addr learned my addr 172.21.15.173:0/1056908984 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:41.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f9799400640 1 --2- 172.21.15.173:0/1056908984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97a40d2130 0x7f97a4159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a2800640 1 --2- 172.21.15.173:0/1056908984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97a415dbb0 0x7f97a41596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a1e00640 1 -- 172.21.15.173:0/1056908984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97a415dbb0 msgr2=0x7f97a41596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a1e00640 1 --2- 172.21.15.173:0/1056908984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97a415dbb0 0x7f97a41596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a1e00640 1 -- 172.21.15.173:0/1056908984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97a40d2130 msgr2=0x7f97a4159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a1e00640 1 --2- 172.21.15.173:0/1056908984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97a40d2130 0x7f97a4159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a1e00640 1 -- 172.21.15.173:0/1056908984 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a415a9d0 con 0x7f97a406c7b0 2024-04-25T09:07:41.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a2800640 1 --2- 172.21.15.173:0/1056908984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97a415dbb0 0x7f97a41596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:41.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a1e00640 1 --2- 172.21.15.173:0/1056908984 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97a406c7b0 0x7f97a40b25a0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f97940ac040 tx=0x7f979401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:41.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f979aa00640 1 -- 172.21.15.173:0/1056908984 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97940bd5f0 con 0x7f97a406c7b0 2024-04-25T09:07:41.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f979aa00640 1 -- 172.21.15.173:0/1056908984 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97940a6040 con 0x7f97a406c7b0 2024-04-25T09:07:41.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a8c00640 1 -- 172.21.15.173:0/1056908984 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a4159ce0 con 0x7f97a406c7b0 2024-04-25T09:07:41.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f979aa00640 1 -- 172.21.15.173:0/1056908984 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97940bd9d0 con 0x7f97a406c7b0 2024-04-25T09:07:41.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a8c00640 1 -- 172.21.15.173:0/1056908984 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a415a2a0 con 0x7f97a406c7b0 2024-04-25T09:07:41.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f97a8c00640 1 -- 172.21.15.173:0/1056908984 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a40ae7e0 con 0x7f97a406c7b0 2024-04-25T09:07:41.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.870+0000 7f979aa00640 1 -- 172.21.15.173:0/1056908984 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f97940b33f0 con 0x7f97a406c7b0 2024-04-25T09:07:41.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.874+0000 7f979aa00640 1 --2- 172.21.15.173:0/1056908984 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9780066f60 0x7f9780069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.874+0000 7f979aa00640 1 -- 172.21.15.173:0/1056908984 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f979411f660 con 0x7f97a406c7b0 2024-04-25T09:07:41.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.874+0000 7f9799400640 1 --2- 172.21.15.173:0/1056908984 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9780066f60 0x7f9780069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.874+0000 7f9799400640 1 --2- 172.21.15.173:0/1056908984 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9780066f60 0x7f9780069420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f97a40b7820 tx=0x7f978c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:41.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:41.878+0000 7f979aa00640 1 -- 172.21.15.173:0/1056908984 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f97a40ae7e0 con 0x7f97a406c7b0 2024-04-25T09:07:42.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.030+0000 7f97a8c00640 1 -- 172.21.15.173:0/1056908984 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f97a40cf020 con 0x7f9780066f60 2024-04-25T09:07:42.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.034+0000 7f979aa00640 1 -- 172.21.15.173:0/1056908984 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251559 (secure 0 0 0) 0x7f97a40cf020 con 0x7f9780066f60 2024-04-25T09:07:42.024 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:42.025 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:07:42.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.038+0000 7f97a8c00640 1 -- 172.21.15.173:0/1056908984 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9780066f60 msgr2=0x7f9780069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.038+0000 7f97a8c00640 1 --2- 172.21.15.173:0/1056908984 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9780066f60 0x7f9780069420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f97a40b7820 tx=0x7f978c008040 comp rx=0 tx=0).stop 2024-04-25T09:07:42.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.038+0000 7f97a8c00640 1 -- 172.21.15.173:0/1056908984 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97a406c7b0 msgr2=0x7f97a40b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.038+0000 7f97a8c00640 1 --2- 172.21.15.173:0/1056908984 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97a406c7b0 0x7f97a40b25a0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f97940ac040 tx=0x7f979401ad30 comp rx=0 tx=0).stop 2024-04-25T09:07:42.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.038+0000 7f97a8c00640 1 -- 172.21.15.173:0/1056908984 shutdown_connections 2024-04-25T09:07:42.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.038+0000 7f97a8c00640 1 --2- 172.21.15.173:0/1056908984 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9780066f60 0x7f9780069420 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.038+0000 7f97a8c00640 1 --2- 172.21.15.173:0/1056908984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97a415dbb0 0x7f97a41596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.038+0000 7f97a8c00640 1 --2- 172.21.15.173:0/1056908984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97a40d2130 0x7f97a4159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.038+0000 7f97a8c00640 1 --2- 172.21.15.173:0/1056908984 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97a406c7b0 0x7f97a40b25a0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.038+0000 7f97a8c00640 1 -- 172.21.15.173:0/1056908984 >> 172.21.15.173:0/1056908984 conn(0x7f97a4061880 msgr2=0x7f97a4061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:42.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.038+0000 7f97a8c00640 1 -- 172.21.15.173:0/1056908984 shutdown_connections 2024-04-25T09:07:42.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.038+0000 7f97a8c00640 1 -- 172.21.15.173:0/1056908984 wait complete. 2024-04-25T09:07:42.045 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2024-04-25T09:07:40.789622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":200,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":322364,"kb_used_data":9068,"kb_used_omap":12,"kb_used_meta":313139,"kb_avail":754652356,"statfs":{"total":773094113280,"available":772764012544,"internally_reserved":0,"allocated":9285632,"data_stored":4870932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":320654896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.199805"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-04-25T09:07:36.607014+0000","last_change":"2024-04-25T09:07:36.607014+0000","last_active":"2024-04-25T09:07:36.589349+0000","last_peered":"2024-04-25T09:07:36.589349+0000","last_clean":"2024-04-25T09:07:36.589349+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:07:36.607014+0000","last_undegraded":"2024-04-25T09:07:36.607014+0000","last_fullsized":"2024-04-25T09:07:36.607014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635118+0000","last_change":"2024-04-25T09:07:37.642120+0000","last_active":"2024-04-25T09:07:38.635118+0000","last_peered":"2024-04-25T09:07:38.635118+0000","last_clean":"2024-04-25T09:07:38.635118+0000","last_became_active":"2024-04-25T09:07:37.641706+0000","last_became_peered":"2024-04-25T09:07:37.641706+0000","last_unstale":"2024-04-25T09:07:38.635118+0000","last_undegraded":"2024-04-25T09:07:38.635118+0000","last_fullsized":"2024-04-25T09:07:38.635118+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:14.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.637727+0000","last_change":"2024-04-25T09:07:37.629356+0000","last_active":"2024-04-25T09:07:37.637727+0000","last_peered":"2024-04-25T09:07:37.637727+0000","last_clean":"2024-04-25T09:07:37.637727+0000","last_became_active":"2024-04-25T09:07:37.629071+0000","last_became_peered":"2024-04-25T09:07:37.629071+0000","last_unstale":"2024-04-25T09:07:37.637727+0000","last_undegraded":"2024-04-25T09:07:37.637727+0000","last_fullsized":"2024-04-25T09:07:37.637727+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:25.741760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.628278+0000","last_change":"2024-04-25T09:07:37.626588+0000","last_active":"2024-04-25T09:07:37.628278+0000","last_peered":"2024-04-25T09:07:37.628278+0000","last_clean":"2024-04-25T09:07:37.628278+0000","last_became_active":"2024-04-25T09:07:37.625527+0000","last_became_peered":"2024-04-25T09:07:37.625527+0000","last_unstale":"2024-04-25T09:07:37.628278+0000","last_undegraded":"2024-04-25T09:07:37.628278+0000","last_fullsized":"2024-04-25T09:07:37.628278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:40.108001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637267+0000","last_change":"2024-04-25T09:07:37.639626+0000","last_active":"2024-04-25T09:07:38.637267+0000","last_peered":"2024-04-25T09:07:38.637267+0000","last_clean":"2024-04-25T09:07:38.637267+0000","last_became_active":"2024-04-25T09:07:37.636488+0000","last_became_peered":"2024-04-25T09:07:37.636488+0000","last_unstale":"2024-04-25T09:07:38.637267+0000","last_undegraded":"2024-04-25T09:07:38.637267+0000","last_fullsized":"2024-04-25T09:07:38.637267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:33.387139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620739+0000","last_change":"2024-04-25T09:07:37.618282+0000","last_active":"2024-04-25T09:07:38.620739+0000","last_peered":"2024-04-25T09:07:38.620739+0000","last_clean":"2024-04-25T09:07:38.620739+0000","last_became_active":"2024-04-25T09:07:37.617980+0000","last_became_peered":"2024-04-25T09:07:37.617980+0000","last_unstale":"2024-04-25T09:07:38.620739+0000","last_undegraded":"2024-04-25T09:07:38.620739+0000","last_fullsized":"2024-04-25T09:07:38.620739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.374955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620911+0000","last_change":"2024-04-25T09:07:37.634612+0000","last_active":"2024-04-25T09:07:38.620911+0000","last_peered":"2024-04-25T09:07:38.620911+0000","last_clean":"2024-04-25T09:07:38.620911+0000","last_became_active":"2024-04-25T09:07:37.634272+0000","last_became_peered":"2024-04-25T09:07:37.634272+0000","last_unstale":"2024-04-25T09:07:38.620911+0000","last_undegraded":"2024-04-25T09:07:38.620911+0000","last_fullsized":"2024-04-25T09:07:38.620911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:24.395404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637140+0000","last_change":"2024-04-25T09:07:37.632445+0000","last_active":"2024-04-25T09:07:38.637140+0000","last_peered":"2024-04-25T09:07:38.637140+0000","last_clean":"2024-04-25T09:07:38.637140+0000","last_became_active":"2024-04-25T09:07:37.632100+0000","last_became_peered":"2024-04-25T09:07:37.632100+0000","last_unstale":"2024-04-25T09:07:38.637140+0000","last_undegraded":"2024-04-25T09:07:38.637140+0000","last_fullsized":"2024-04-25T09:07:38.637140+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:34.107400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621523+0000","last_change":"2024-04-25T09:07:37.620664+0000","last_active":"2024-04-25T09:07:38.621523+0000","last_peered":"2024-04-25T09:07:38.621523+0000","last_clean":"2024-04-25T09:07:38.621523+0000","last_became_active":"2024-04-25T09:07:37.620393+0000","last_became_peered":"2024-04-25T09:07:37.620393+0000","last_unstale":"2024-04-25T09:07:38.621523+0000","last_undegraded":"2024-04-25T09:07:38.621523+0000","last_fullsized":"2024-04-25T09:07:38.621523+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:37.691190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631368+0000","last_change":"2024-04-25T09:07:37.628104+0000","last_active":"2024-04-25T09:07:37.631368+0000","last_peered":"2024-04-25T09:07:37.631368+0000","last_clean":"2024-04-25T09:07:37.631368+0000","last_became_active":"2024-04-25T09:07:37.627451+0000","last_became_peered":"2024-04-25T09:07:37.627451+0000","last_unstale":"2024-04-25T09:07:37.631368+0000","last_undegraded":"2024-04-25T09:07:37.631368+0000","last_fullsized":"2024-04-25T09:07:37.631368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:54.940460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635165+0000","last_change":"2024-04-25T09:07:37.638244+0000","last_active":"2024-04-25T09:07:38.635165+0000","last_peered":"2024-04-25T09:07:38.635165+0000","last_clean":"2024-04-25T09:07:38.635165+0000","last_became_active":"2024-04-25T09:07:37.637967+0000","last_became_peered":"2024-04-25T09:07:37.637967+0000","last_unstale":"2024-04-25T09:07:38.635165+0000","last_undegraded":"2024-04-25T09:07:38.635165+0000","last_fullsized":"2024-04-25T09:07:38.635165+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:40.123592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631283+0000","last_change":"2024-04-25T09:07:37.628390+0000","last_active":"2024-04-25T09:07:37.631283+0000","last_peered":"2024-04-25T09:07:37.631283+0000","last_clean":"2024-04-25T09:07:37.631283+0000","last_became_active":"2024-04-25T09:07:37.628101+0000","last_became_peered":"2024-04-25T09:07:37.628101+0000","last_unstale":"2024-04-25T09:07:37.631283+0000","last_undegraded":"2024-04-25T09:07:37.631283+0000","last_fullsized":"2024-04-25T09:07:37.631283+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:21.781597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637387+0000","last_change":"2024-04-25T09:07:37.644053+0000","last_active":"2024-04-25T09:07:38.637387+0000","last_peered":"2024-04-25T09:07:38.637387+0000","last_clean":"2024-04-25T09:07:38.637387+0000","last_became_active":"2024-04-25T09:07:37.643783+0000","last_became_peered":"2024-04-25T09:07:37.643783+0000","last_unstale":"2024-04-25T09:07:38.637387+0000","last_undegraded":"2024-04-25T09:07:38.637387+0000","last_fullsized":"2024-04-25T09:07:38.637387+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:57.907870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620774+0000","last_change":"2024-04-25T09:07:37.618084+0000","last_active":"2024-04-25T09:07:38.620774+0000","last_peered":"2024-04-25T09:07:38.620774+0000","last_clean":"2024-04-25T09:07:38.620774+0000","last_became_active":"2024-04-25T09:07:37.617758+0000","last_became_peered":"2024-04-25T09:07:37.617758+0000","last_unstale":"2024-04-25T09:07:38.620774+0000","last_undegraded":"2024-04-25T09:07:38.620774+0000","last_fullsized":"2024-04-25T09:07:38.620774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:53.134215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634782+0000","last_change":"2024-04-25T09:07:37.624978+0000","last_active":"2024-04-25T09:07:38.634782+0000","last_peered":"2024-04-25T09:07:38.634782+0000","last_clean":"2024-04-25T09:07:38.634782+0000","last_became_active":"2024-04-25T09:07:37.624509+0000","last_became_peered":"2024-04-25T09:07:37.624509+0000","last_unstale":"2024-04-25T09:07:38.634782+0000","last_undegraded":"2024-04-25T09:07:38.634782+0000","last_fullsized":"2024-04-25T09:07:38.634782+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:18.688958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-04-25T09:07:36.604384+0000","last_change":"2024-04-25T09:07:36.604384+0000","last_active":"2024-04-25T09:07:36.589349+0000","last_peered":"2024-04-25T09:07:36.589349+0000","last_clean":"2024-04-25T09:07:36.589349+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:07:36.604384+0000","last_undegraded":"2024-04-25T09:07:36.604384+0000","last_fullsized":"2024-04-25T09:07:36.604384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637781+0000","last_change":"2024-04-25T09:07:37.639108+0000","last_active":"2024-04-25T09:07:38.637781+0000","last_peered":"2024-04-25T09:07:38.637781+0000","last_clean":"2024-04-25T09:07:38.637781+0000","last_became_active":"2024-04-25T09:07:37.638532+0000","last_became_peered":"2024-04-25T09:07:37.638532+0000","last_unstale":"2024-04-25T09:07:38.637781+0000","last_undegraded":"2024-04-25T09:07:38.637781+0000","last_fullsized":"2024-04-25T09:07:38.637781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:02.132000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.638553+0000","last_change":"2024-04-25T09:07:37.634860+0000","last_active":"2024-04-25T09:07:37.638553+0000","last_peered":"2024-04-25T09:07:37.638553+0000","last_clean":"2024-04-25T09:07:37.638553+0000","last_became_active":"2024-04-25T09:07:37.634582+0000","last_became_peered":"2024-04-25T09:07:37.634582+0000","last_unstale":"2024-04-25T09:07:37.638553+0000","last_undegraded":"2024-04-25T09:07:37.638553+0000","last_fullsized":"2024-04-25T09:07:37.638553+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:31.359245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621086+0000","last_change":"2024-04-25T09:07:37.638340+0000","last_active":"2024-04-25T09:07:38.621086+0000","last_peered":"2024-04-25T09:07:38.621086+0000","last_clean":"2024-04-25T09:07:38.621086+0000","last_became_active":"2024-04-25T09:07:37.638060+0000","last_became_peered":"2024-04-25T09:07:37.638060+0000","last_unstale":"2024-04-25T09:07:38.621086+0000","last_undegraded":"2024-04-25T09:07:38.621086+0000","last_fullsized":"2024-04-25T09:07:38.621086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:09.628669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637578+0000","last_change":"2024-04-25T09:07:37.639988+0000","last_active":"2024-04-25T09:07:38.637578+0000","last_peered":"2024-04-25T09:07:38.637578+0000","last_clean":"2024-04-25T09:07:38.637578+0000","last_became_active":"2024-04-25T09:07:37.639263+0000","last_became_peered":"2024-04-25T09:07:37.639263+0000","last_unstale":"2024-04-25T09:07:38.637578+0000","last_undegraded":"2024-04-25T09:07:38.637578+0000","last_fullsized":"2024-04-25T09:07:38.637578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:38.575243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621067+0000","last_change":"2024-04-25T09:07:37.633413+0000","last_active":"2024-04-25T09:07:38.621067+0000","last_peered":"2024-04-25T09:07:38.621067+0000","last_clean":"2024-04-25T09:07:38.621067+0000","last_became_active":"2024-04-25T09:07:37.633132+0000","last_became_peered":"2024-04-25T09:07:37.633132+0000","last_unstale":"2024-04-25T09:07:38.621067+0000","last_undegraded":"2024-04-25T09:07:38.621067+0000","last_fullsized":"2024-04-25T09:07:38.621067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:41.064820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637379+0000","last_change":"2024-04-25T09:07:37.644962+0000","last_active":"2024-04-25T09:07:38.637379+0000","last_peered":"2024-04-25T09:07:38.637379+0000","last_clean":"2024-04-25T09:07:38.637379+0000","last_became_active":"2024-04-25T09:07:37.644695+0000","last_became_peered":"2024-04-25T09:07:37.644695+0000","last_unstale":"2024-04-25T09:07:38.637379+0000","last_undegraded":"2024-04-25T09:07:38.637379+0000","last_fullsized":"2024-04-25T09:07:38.637379+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:05:45.625216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.622028+0000","last_change":"2024-04-25T09:07:37.624852+0000","last_active":"2024-04-25T09:07:38.622028+0000","last_peered":"2024-04-25T09:07:38.622028+0000","last_clean":"2024-04-25T09:07:38.622028+0000","last_became_active":"2024-04-25T09:07:37.624552+0000","last_became_peered":"2024-04-25T09:07:37.624552+0000","last_unstale":"2024-04-25T09:07:38.622028+0000","last_undegraded":"2024-04-25T09:07:38.622028+0000","last_fullsized":"2024-04-25T09:07:38.622028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:55.922340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634678+0000","last_change":"2024-04-25T09:07:37.628098+0000","last_active":"2024-04-25T09:07:38.634678+0000","last_peered":"2024-04-25T09:07:38.634678+0000","last_clean":"2024-04-25T09:07:38.634678+0000","last_became_active":"2024-04-25T09:07:37.627827+0000","last_became_peered":"2024-04-25T09:07:37.627827+0000","last_unstale":"2024-04-25T09:07:38.634678+0000","last_undegraded":"2024-04-25T09:07:38.634678+0000","last_fullsized":"2024-04-25T09:07:38.634678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:45.887572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635119+0000","last_change":"2024-04-25T09:07:37.627502+0000","last_active":"2024-04-25T09:07:38.635119+0000","last_peered":"2024-04-25T09:07:38.635119+0000","last_clean":"2024-04-25T09:07:38.635119+0000","last_became_active":"2024-04-25T09:07:37.626614+0000","last_became_peered":"2024-04-25T09:07:37.626614+0000","last_unstale":"2024-04-25T09:07:38.635119+0000","last_undegraded":"2024-04-25T09:07:38.635119+0000","last_fullsized":"2024-04-25T09:07:38.635119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:52.345009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631388+0000","last_change":"2024-04-25T09:07:37.630155+0000","last_active":"2024-04-25T09:07:37.631388+0000","last_peered":"2024-04-25T09:07:37.631388+0000","last_clean":"2024-04-25T09:07:37.631388+0000","last_became_active":"2024-04-25T09:07:37.629889+0000","last_became_peered":"2024-04-25T09:07:37.629889+0000","last_unstale":"2024-04-25T09:07:37.631388+0000","last_undegraded":"2024-04-25T09:07:37.631388+0000","last_fullsized":"2024-04-25T09:07:37.631388+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:12.490521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-04-25T09:07:36.607030+0000","last_change":"2024-04-25T09:07:36.607030+0000","last_active":"2024-04-25T09:07:36.589349+0000","last_peered":"2024-04-25T09:07:36.589349+0000","last_clean":"2024-04-25T09:07:36.589349+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:07:36.607030+0000","last_undegraded":"2024-04-25T09:07:36.607030+0000","last_fullsized":"2024-04-25T09:07:36.607030+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637640+0000","last_change":"2024-04-25T09:07:37.638930+0000","last_active":"2024-04-25T09:07:38.637640+0000","last_peered":"2024-04-25T09:07:38.637640+0000","last_clean":"2024-04-25T09:07:38.637640+0000","last_became_active":"2024-04-25T09:07:37.637356+0000","last_became_peered":"2024-04-25T09:07:37.637356+0000","last_unstale":"2024-04-25T09:07:38.637640+0000","last_undegraded":"2024-04-25T09:07:38.637640+0000","last_fullsized":"2024-04-25T09:07:38.637640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:54.912036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634809+0000","last_change":"2024-04-25T09:07:37.620835+0000","last_active":"2024-04-25T09:07:38.634809+0000","last_peered":"2024-04-25T09:07:38.634809+0000","last_clean":"2024-04-25T09:07:38.634809+0000","last_became_active":"2024-04-25T09:07:37.620537+0000","last_became_peered":"2024-04-25T09:07:37.620537+0000","last_unstale":"2024-04-25T09:07:38.634809+0000","last_undegraded":"2024-04-25T09:07:38.634809+0000","last_fullsized":"2024-04-25T09:07:38.634809+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:25.439081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-04-25T09:07:36.603398+0000","last_change":"2024-04-25T09:07:36.603398+0000","last_active":"2024-04-25T09:07:36.589349+0000","last_peered":"2024-04-25T09:07:36.589349+0000","last_clean":"2024-04-25T09:07:36.589349+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:07:36.603398+0000","last_undegraded":"2024-04-25T09:07:36.603398+0000","last_fullsized":"2024-04-25T09:07:36.603398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631453+0000","last_change":"2024-04-25T09:07:37.625322+0000","last_active":"2024-04-25T09:07:37.631453+0000","last_peered":"2024-04-25T09:07:37.631453+0000","last_clean":"2024-04-25T09:07:37.631453+0000","last_became_active":"2024-04-25T09:07:37.624684+0000","last_became_peered":"2024-04-25T09:07:37.624684+0000","last_unstale":"2024-04-25T09:07:37.631453+0000","last_undegraded":"2024-04-25T09:07:37.631453+0000","last_fullsized":"2024-04-25T09:07:37.631453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:12.567183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-04-25T09:07:36.603941+0000","last_change":"2024-04-25T09:07:36.603941+0000","last_active":"2024-04-25T09:07:36.589349+0000","last_peered":"2024-04-25T09:07:36.589349+0000","last_clean":"2024-04-25T09:07:36.589349+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:07:36.603941+0000","last_undegraded":"2024-04-25T09:07:36.603941+0000","last_fullsized":"2024-04-25T09:07:36.603941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.635064+0000","last_change":"2024-04-25T09:07:37.626057+0000","last_active":"2024-04-25T09:07:37.635064+0000","last_peered":"2024-04-25T09:07:37.635064+0000","last_clean":"2024-04-25T09:07:37.635064+0000","last_became_active":"2024-04-25T09:07:37.625736+0000","last_became_peered":"2024-04-25T09:07:37.625736+0000","last_unstale":"2024-04-25T09:07:37.635064+0000","last_undegraded":"2024-04-25T09:07:37.635064+0000","last_fullsized":"2024-04-25T09:07:37.635064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:50.340971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"83'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637794+0000","last_change":"2024-04-25T09:07:36.616376+0000","last_active":"2024-04-25T09:07:38.637794+0000","last_peered":"2024-04-25T09:07:38.637794+0000","last_clean":"2024-04-25T09:07:38.637794+0000","last_became_active":"2024-04-25T09:07:36.616075+0000","last_became_peered":"2024-04-25T09:07:36.616075+0000","last_unstale":"2024-04-25T09:07:38.637794+0000","last_undegraded":"2024-04-25T09:07:38.637794+0000","last_fullsized":"2024-04-25T09:07:38.637794+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:26.377752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634935+0000","last_change":"2024-04-25T09:07:37.628208+0000","last_active":"2024-04-25T09:07:38.634935+0000","last_peered":"2024-04-25T09:07:38.634935+0000","last_clean":"2024-04-25T09:07:38.634935+0000","last_became_active":"2024-04-25T09:07:37.627848+0000","last_became_peered":"2024-04-25T09:07:37.627848+0000","last_unstale":"2024-04-25T09:07:38.634935+0000","last_undegraded":"2024-04-25T09:07:38.634935+0000","last_fullsized":"2024-04-25T09:07:38.634935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:24.857733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.622668+0000","last_change":"2024-04-25T09:07:36.619079+0000","last_active":"2024-04-25T09:07:36.622668+0000","last_peered":"2024-04-25T09:07:36.622668+0000","last_clean":"2024-04-25T09:07:36.622668+0000","last_became_active":"2024-04-25T09:07:36.618396+0000","last_became_peered":"2024-04-25T09:07:36.618396+0000","last_unstale":"2024-04-25T09:07:36.622668+0000","last_undegraded":"2024-04-25T09:07:36.622668+0000","last_fullsized":"2024-04-25T09:07:36.622668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:59.294654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621321+0000","last_change":"2024-04-25T09:07:37.628645+0000","last_active":"2024-04-25T09:07:38.621321+0000","last_peered":"2024-04-25T09:07:38.621321+0000","last_clean":"2024-04-25T09:07:38.621321+0000","last_became_active":"2024-04-25T09:07:37.628344+0000","last_became_peered":"2024-04-25T09:07:37.628344+0000","last_unstale":"2024-04-25T09:07:38.621321+0000","last_undegraded":"2024-04-25T09:07:38.621321+0000","last_fullsized":"2024-04-25T09:07:38.621321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:46.246638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.622513+0000","last_change":"2024-04-25T09:07:36.618033+0000","last_active":"2024-04-25T09:07:36.622513+0000","last_peered":"2024-04-25T09:07:36.622513+0000","last_clean":"2024-04-25T09:07:36.622513+0000","last_became_active":"2024-04-25T09:07:36.617755+0000","last_became_peered":"2024-04-25T09:07:36.617755+0000","last_unstale":"2024-04-25T09:07:36.622513+0000","last_undegraded":"2024-04-25T09:07:36.622513+0000","last_fullsized":"2024-04-25T09:07:36.622513+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:31.306923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621071+0000","last_change":"2024-04-25T09:07:37.633374+0000","last_active":"2024-04-25T09:07:38.621071+0000","last_peered":"2024-04-25T09:07:38.621071+0000","last_clean":"2024-04-25T09:07:38.621071+0000","last_became_active":"2024-04-25T09:07:37.633097+0000","last_became_peered":"2024-04-25T09:07:37.633097+0000","last_unstale":"2024-04-25T09:07:38.621071+0000","last_undegraded":"2024-04-25T09:07:38.621071+0000","last_fullsized":"2024-04-25T09:07:38.621071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:04.260863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620809+0000","last_change":"2024-04-25T09:07:36.615481+0000","last_active":"2024-04-25T09:07:38.620809+0000","last_peered":"2024-04-25T09:07:38.620809+0000","last_clean":"2024-04-25T09:07:38.620809+0000","last_became_active":"2024-04-25T09:07:36.615203+0000","last_became_peered":"2024-04-25T09:07:36.615203+0000","last_unstale":"2024-04-25T09:07:38.620809+0000","last_undegraded":"2024-04-25T09:07:38.620809+0000","last_fullsized":"2024-04-25T09:07:38.620809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:03.253872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635044+0000","last_change":"2024-04-25T09:07:37.642388+0000","last_active":"2024-04-25T09:07:38.635044+0000","last_peered":"2024-04-25T09:07:38.635044+0000","last_clean":"2024-04-25T09:07:38.635044+0000","last_became_active":"2024-04-25T09:07:37.641673+0000","last_became_peered":"2024-04-25T09:07:37.641673+0000","last_unstale":"2024-04-25T09:07:38.635044+0000","last_undegraded":"2024-04-25T09:07:38.635044+0000","last_fullsized":"2024-04-25T09:07:38.635044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:01.788399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621200+0000","last_change":"2024-04-25T09:07:36.616454+0000","last_active":"2024-04-25T09:07:38.621200+0000","last_peered":"2024-04-25T09:07:38.621200+0000","last_clean":"2024-04-25T09:07:38.621200+0000","last_became_active":"2024-04-25T09:07:36.616058+0000","last_became_peered":"2024-04-25T09:07:36.616058+0000","last_unstale":"2024-04-25T09:07:38.621200+0000","last_undegraded":"2024-04-25T09:07:38.621200+0000","last_fullsized":"2024-04-25T09:07:38.621200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:19.115185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635202+0000","last_change":"2024-04-25T09:07:37.645238+0000","last_active":"2024-04-25T09:07:38.635202+0000","last_peered":"2024-04-25T09:07:38.635202+0000","last_clean":"2024-04-25T09:07:38.635202+0000","last_became_active":"2024-04-25T09:07:37.644352+0000","last_became_peered":"2024-04-25T09:07:37.644352+0000","last_unstale":"2024-04-25T09:07:38.635202+0000","last_undegraded":"2024-04-25T09:07:38.635202+0000","last_fullsized":"2024-04-25T09:07:38.635202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.374955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.644227+0000","last_change":"2024-04-25T09:07:36.610047+0000","last_active":"2024-04-25T09:07:37.644227+0000","last_peered":"2024-04-25T09:07:37.644227+0000","last_clean":"2024-04-25T09:07:37.644227+0000","last_became_active":"2024-04-25T09:07:36.609786+0000","last_became_peered":"2024-04-25T09:07:36.609786+0000","last_unstale":"2024-04-25T09:07:37.644227+0000","last_undegraded":"2024-04-25T09:07:37.644227+0000","last_fullsized":"2024-04-25T09:07:37.644227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:14.391941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621584+0000","last_change":"2024-04-25T09:07:37.617101+0000","last_active":"2024-04-25T09:07:38.621584+0000","last_peered":"2024-04-25T09:07:38.621584+0000","last_clean":"2024-04-25T09:07:38.621584+0000","last_became_active":"2024-04-25T09:07:37.616000+0000","last_became_peered":"2024-04-25T09:07:37.616000+0000","last_unstale":"2024-04-25T09:07:38.621584+0000","last_undegraded":"2024-04-25T09:07:38.621584+0000","last_fullsized":"2024-04-25T09:07:38.621584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:55.162579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634902+0000","last_change":"2024-04-25T09:07:36.614605+0000","last_active":"2024-04-25T09:07:38.634902+0000","last_peered":"2024-04-25T09:07:38.634902+0000","last_clean":"2024-04-25T09:07:38.634902+0000","last_became_active":"2024-04-25T09:07:36.614349+0000","last_became_peered":"2024-04-25T09:07:36.614349+0000","last_unstale":"2024-04-25T09:07:38.634902+0000","last_undegraded":"2024-04-25T09:07:38.634902+0000","last_fullsized":"2024-04-25T09:07:38.634902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:39.401019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621551+0000","last_change":"2024-04-25T09:07:37.642318+0000","last_active":"2024-04-25T09:07:38.621551+0000","last_peered":"2024-04-25T09:07:38.621551+0000","last_clean":"2024-04-25T09:07:38.621551+0000","last_became_active":"2024-04-25T09:07:37.641879+0000","last_became_peered":"2024-04-25T09:07:37.641879+0000","last_unstale":"2024-04-25T09:07:38.621551+0000","last_undegraded":"2024-04-25T09:07:38.621551+0000","last_fullsized":"2024-04-25T09:07:38.621551+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:33.063248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637137+0000","last_change":"2024-04-25T09:07:36.616980+0000","last_active":"2024-04-25T09:07:38.637137+0000","last_peered":"2024-04-25T09:07:38.637137+0000","last_clean":"2024-04-25T09:07:38.637137+0000","last_became_active":"2024-04-25T09:07:36.616698+0000","last_became_peered":"2024-04-25T09:07:36.616698+0000","last_unstale":"2024-04-25T09:07:38.637137+0000","last_undegraded":"2024-04-25T09:07:38.637137+0000","last_fullsized":"2024-04-25T09:07:38.637137+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:05.199952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634687+0000","last_change":"2024-04-25T09:07:37.618246+0000","last_active":"2024-04-25T09:07:38.634687+0000","last_peered":"2024-04-25T09:07:38.634687+0000","last_clean":"2024-04-25T09:07:38.634687+0000","last_became_active":"2024-04-25T09:07:37.617992+0000","last_became_peered":"2024-04-25T09:07:37.617992+0000","last_unstale":"2024-04-25T09:07:38.634687+0000","last_undegraded":"2024-04-25T09:07:38.634687+0000","last_fullsized":"2024-04-25T09:07:38.634687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:15.922910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.625601+0000","last_change":"2024-04-25T09:07:36.623042+0000","last_active":"2024-04-25T09:07:36.625601+0000","last_peered":"2024-04-25T09:07:36.625601+0000","last_clean":"2024-04-25T09:07:36.625601+0000","last_became_active":"2024-04-25T09:07:36.622793+0000","last_became_peered":"2024-04-25T09:07:36.622793+0000","last_unstale":"2024-04-25T09:07:36.625601+0000","last_undegraded":"2024-04-25T09:07:36.625601+0000","last_fullsized":"2024-04-25T09:07:36.625601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:52.551723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631331+0000","last_change":"2024-04-25T09:07:37.629312+0000","last_active":"2024-04-25T09:07:37.631331+0000","last_peered":"2024-04-25T09:07:37.631331+0000","last_clean":"2024-04-25T09:07:37.631331+0000","last_became_active":"2024-04-25T09:07:37.627276+0000","last_became_peered":"2024-04-25T09:07:37.627276+0000","last_unstale":"2024-04-25T09:07:37.631331+0000","last_undegraded":"2024-04-25T09:07:37.631331+0000","last_fullsized":"2024-04-25T09:07:37.631331+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:38.473267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.621587+0000","last_change":"2024-04-25T09:07:36.613966+0000","last_active":"2024-04-25T09:07:37.621587+0000","last_peered":"2024-04-25T09:07:37.621587+0000","last_clean":"2024-04-25T09:07:37.621587+0000","last_became_active":"2024-04-25T09:07:36.613700+0000","last_became_peered":"2024-04-25T09:07:36.613700+0000","last_unstale":"2024-04-25T09:07:37.621587+0000","last_undegraded":"2024-04-25T09:07:37.621587+0000","last_fullsized":"2024-04-25T09:07:37.621587+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:56.184210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620920+0000","last_change":"2024-04-25T09:07:37.624293+0000","last_active":"2024-04-25T09:07:38.620920+0000","last_peered":"2024-04-25T09:07:38.620920+0000","last_clean":"2024-04-25T09:07:38.620920+0000","last_became_active":"2024-04-25T09:07:37.624036+0000","last_became_peered":"2024-04-25T09:07:37.624036+0000","last_unstale":"2024-04-25T09:07:38.620920+0000","last_undegraded":"2024-04-25T09:07:38.620920+0000","last_fullsized":"2024-04-25T09:07:38.620920+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:34.726656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"83'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637768+0000","last_change":"2024-04-25T09:07:36.621681+0000","last_active":"2024-04-25T09:07:38.637768+0000","last_peered":"2024-04-25T09:07:38.637768+0000","last_clean":"2024-04-25T09:07:38.637768+0000","last_became_active":"2024-04-25T09:07:36.621425+0000","last_became_peered":"2024-04-25T09:07:36.621425+0000","last_unstale":"2024-04-25T09:07:38.637768+0000","last_undegraded":"2024-04-25T09:07:38.637768+0000","last_fullsized":"2024-04-25T09:07:38.637768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:12.826909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.638070+0000","last_change":"2024-04-25T09:07:37.631958+0000","last_active":"2024-04-25T09:07:37.638070+0000","last_peered":"2024-04-25T09:07:37.638070+0000","last_clean":"2024-04-25T09:07:37.638070+0000","last_became_active":"2024-04-25T09:07:37.631694+0000","last_became_peered":"2024-04-25T09:07:37.631694+0000","last_unstale":"2024-04-25T09:07:37.638070+0000","last_undegraded":"2024-04-25T09:07:37.638070+0000","last_fullsized":"2024-04-25T09:07:37.638070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:16.140878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"83'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620920+0000","last_change":"2024-04-25T09:07:36.605032+0000","last_active":"2024-04-25T09:07:38.620920+0000","last_peered":"2024-04-25T09:07:38.620920+0000","last_clean":"2024-04-25T09:07:38.620920+0000","last_became_active":"2024-04-25T09:07:36.603703+0000","last_became_peered":"2024-04-25T09:07:36.603703+0000","last_unstale":"2024-04-25T09:07:38.620920+0000","last_undegraded":"2024-04-25T09:07:38.620920+0000","last_fullsized":"2024-04-25T09:07:38.620920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:45.239647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631261+0000","last_change":"2024-04-25T09:07:37.628226+0000","last_active":"2024-04-25T09:07:37.631261+0000","last_peered":"2024-04-25T09:07:37.631261+0000","last_clean":"2024-04-25T09:07:37.631261+0000","last_became_active":"2024-04-25T09:07:37.625863+0000","last_became_peered":"2024-04-25T09:07:37.625863+0000","last_unstale":"2024-04-25T09:07:37.631261+0000","last_undegraded":"2024-04-25T09:07:37.631261+0000","last_fullsized":"2024-04-25T09:07:37.631261+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:33.063248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.641096+0000","last_change":"2024-04-25T09:07:36.611263+0000","last_active":"2024-04-25T09:07:37.641096+0000","last_peered":"2024-04-25T09:07:37.641096+0000","last_clean":"2024-04-25T09:07:37.641096+0000","last_became_active":"2024-04-25T09:07:36.610934+0000","last_became_peered":"2024-04-25T09:07:36.610934+0000","last_unstale":"2024-04-25T09:07:37.641096+0000","last_undegraded":"2024-04-25T09:07:37.641096+0000","last_fullsized":"2024-04-25T09:07:37.641096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:32.093652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621017+0000","last_change":"2024-04-25T09:07:37.625227+0000","last_active":"2024-04-25T09:07:38.621017+0000","last_peered":"2024-04-25T09:07:38.621017+0000","last_clean":"2024-04-25T09:07:38.621017+0000","last_became_active":"2024-04-25T09:07:37.624685+0000","last_became_peered":"2024-04-25T09:07:37.624685+0000","last_unstale":"2024-04-25T09:07:38.621017+0000","last_undegraded":"2024-04-25T09:07:38.621017+0000","last_fullsized":"2024-04-25T09:07:38.621017+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:15.398932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.625219+0000","last_change":"2024-04-25T09:07:36.620051+0000","last_active":"2024-04-25T09:07:36.625219+0000","last_peered":"2024-04-25T09:07:36.625219+0000","last_clean":"2024-04-25T09:07:36.625219+0000","last_became_active":"2024-04-25T09:07:36.619717+0000","last_became_peered":"2024-04-25T09:07:36.619717+0000","last_unstale":"2024-04-25T09:07:36.625219+0000","last_undegraded":"2024-04-25T09:07:36.625219+0000","last_fullsized":"2024-04-25T09:07:36.625219+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:58.842729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620865+0000","last_change":"2024-04-25T09:07:37.623281+0000","last_active":"2024-04-25T09:07:38.620865+0000","last_peered":"2024-04-25T09:07:38.620865+0000","last_clean":"2024-04-25T09:07:38.620865+0000","last_became_active":"2024-04-25T09:07:37.622461+0000","last_became_peered":"2024-04-25T09:07:37.622461+0000","last_unstale":"2024-04-25T09:07:38.620865+0000","last_undegraded":"2024-04-25T09:07:38.620865+0000","last_fullsized":"2024-04-25T09:07:38.620865+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:33.100643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637133+0000","last_change":"2024-04-25T09:07:36.617283+0000","last_active":"2024-04-25T09:07:38.637133+0000","last_peered":"2024-04-25T09:07:38.637133+0000","last_clean":"2024-04-25T09:07:38.637133+0000","last_became_active":"2024-04-25T09:07:36.615973+0000","last_became_peered":"2024-04-25T09:07:36.615973+0000","last_unstale":"2024-04-25T09:07:38.637133+0000","last_undegraded":"2024-04-25T09:07:38.637133+0000","last_fullsized":"2024-04-25T09:07:38.637133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:08.020375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621771+0000","last_change":"2024-04-25T09:07:37.628648+0000","last_active":"2024-04-25T09:07:38.621771+0000","last_peered":"2024-04-25T09:07:38.621771+0000","last_clean":"2024-04-25T09:07:38.621771+0000","last_became_active":"2024-04-25T09:07:37.627443+0000","last_became_peered":"2024-04-25T09:07:37.627443+0000","last_unstale":"2024-04-25T09:07:38.621771+0000","last_undegraded":"2024-04-25T09:07:38.621771+0000","last_fullsized":"2024-04-25T09:07:38.621771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:21.781597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"83'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634813+0000","last_change":"2024-04-25T09:07:36.601617+0000","last_active":"2024-04-25T09:07:38.634813+0000","last_peered":"2024-04-25T09:07:38.634813+0000","last_clean":"2024-04-25T09:07:38.634813+0000","last_became_active":"2024-04-25T09:07:36.601323+0000","last_became_peered":"2024-04-25T09:07:36.601323+0000","last_unstale":"2024-04-25T09:07:38.634813+0000","last_undegraded":"2024-04-25T09:07:38.634813+0000","last_fullsized":"2024-04-25T09:07:38.634813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:41.678865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620974+0000","last_change":"2024-04-25T09:07:37.627836+0000","last_active":"2024-04-25T09:07:38.620974+0000","last_peered":"2024-04-25T09:07:38.620974+0000","last_clean":"2024-04-25T09:07:38.620974+0000","last_became_active":"2024-04-25T09:07:37.627568+0000","last_became_peered":"2024-04-25T09:07:37.627568+0000","last_unstale":"2024-04-25T09:07:38.620974+0000","last_undegraded":"2024-04-25T09:07:38.620974+0000","last_fullsized":"2024-04-25T09:07:38.620974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:56.952875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.625246+0000","last_change":"2024-04-25T09:07:36.621694+0000","last_active":"2024-04-25T09:07:36.625246+0000","last_peered":"2024-04-25T09:07:36.625246+0000","last_clean":"2024-04-25T09:07:36.625246+0000","last_became_active":"2024-04-25T09:07:36.621503+0000","last_became_peered":"2024-04-25T09:07:36.621503+0000","last_unstale":"2024-04-25T09:07:36.625246+0000","last_undegraded":"2024-04-25T09:07:36.625246+0000","last_fullsized":"2024-04-25T09:07:36.625246+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:18.001799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637180+0000","last_change":"2024-04-25T09:07:37.635114+0000","last_active":"2024-04-25T09:07:38.637180+0000","last_peered":"2024-04-25T09:07:38.637180+0000","last_clean":"2024-04-25T09:07:38.637180+0000","last_became_active":"2024-04-25T09:07:37.634833+0000","last_became_peered":"2024-04-25T09:07:37.634833+0000","last_unstale":"2024-04-25T09:07:38.637180+0000","last_undegraded":"2024-04-25T09:07:38.637180+0000","last_fullsized":"2024-04-25T09:07:38.637180+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:53.605713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621693+0000","last_change":"2024-04-25T09:07:36.616078+0000","last_active":"2024-04-25T09:07:38.621693+0000","last_peered":"2024-04-25T09:07:38.621693+0000","last_clean":"2024-04-25T09:07:38.621693+0000","last_became_active":"2024-04-25T09:07:36.615403+0000","last_became_peered":"2024-04-25T09:07:36.615403+0000","last_unstale":"2024-04-25T09:07:38.621693+0000","last_undegraded":"2024-04-25T09:07:38.621693+0000","last_fullsized":"2024-04-25T09:07:38.621693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:15.009651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637101+0000","last_change":"2024-04-25T09:07:37.646400+0000","last_active":"2024-04-25T09:07:38.637101+0000","last_peered":"2024-04-25T09:07:38.637101+0000","last_clean":"2024-04-25T09:07:38.637101+0000","last_became_active":"2024-04-25T09:07:37.646129+0000","last_became_peered":"2024-04-25T09:07:37.646129+0000","last_unstale":"2024-04-25T09:07:38.637101+0000","last_undegraded":"2024-04-25T09:07:38.637101+0000","last_fullsized":"2024-04-25T09:07:38.637101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:02.389276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637780+0000","last_change":"2024-04-25T09:07:36.617644+0000","last_active":"2024-04-25T09:07:38.637780+0000","last_peered":"2024-04-25T09:07:38.637780+0000","last_clean":"2024-04-25T09:07:38.637780+0000","last_became_active":"2024-04-25T09:07:36.616325+0000","last_became_peered":"2024-04-25T09:07:36.616325+0000","last_unstale":"2024-04-25T09:07:38.637780+0000","last_undegraded":"2024-04-25T09:07:38.637780+0000","last_fullsized":"2024-04-25T09:07:38.637780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:31.620809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620896+0000","last_change":"2024-04-25T09:07:37.639937+0000","last_active":"2024-04-25T09:07:38.620896+0000","last_peered":"2024-04-25T09:07:38.620896+0000","last_clean":"2024-04-25T09:07:38.620896+0000","last_became_active":"2024-04-25T09:07:37.633606+0000","last_became_peered":"2024-04-25T09:07:37.633606+0000","last_unstale":"2024-04-25T09:07:38.620896+0000","last_undegraded":"2024-04-25T09:07:38.620896+0000","last_fullsized":"2024-04-25T09:07:38.620896+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:03.532182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.617233+0000","last_change":"2024-04-25T09:07:36.622372+0000","last_active":"2024-04-25T09:07:37.617233+0000","last_peered":"2024-04-25T09:07:37.617233+0000","last_clean":"2024-04-25T09:07:37.617233+0000","last_became_active":"2024-04-25T09:07:36.622088+0000","last_became_peered":"2024-04-25T09:07:36.622088+0000","last_unstale":"2024-04-25T09:07:37.617233+0000","last_undegraded":"2024-04-25T09:07:37.617233+0000","last_fullsized":"2024-04-25T09:07:37.617233+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:35.244653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635171+0000","last_change":"2024-04-25T09:07:37.629723+0000","last_active":"2024-04-25T09:07:38.635171+0000","last_peered":"2024-04-25T09:07:38.635171+0000","last_clean":"2024-04-25T09:07:38.635171+0000","last_became_active":"2024-04-25T09:07:37.629081+0000","last_became_peered":"2024-04-25T09:07:37.629081+0000","last_unstale":"2024-04-25T09:07:38.635171+0000","last_undegraded":"2024-04-25T09:07:38.635171+0000","last_fullsized":"2024-04-25T09:07:38.635171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:36.626956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620850+0000","last_change":"2024-04-25T09:07:36.619552+0000","last_active":"2024-04-25T09:07:38.620850+0000","last_peered":"2024-04-25T09:07:38.620850+0000","last_clean":"2024-04-25T09:07:38.620850+0000","last_became_active":"2024-04-25T09:07:36.619248+0000","last_became_peered":"2024-04-25T09:07:36.619248+0000","last_unstale":"2024-04-25T09:07:38.620850+0000","last_undegraded":"2024-04-25T09:07:38.620850+0000","last_fullsized":"2024-04-25T09:07:38.620850+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:17.681967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635263+0000","last_change":"2024-04-25T09:07:37.622142+0000","last_active":"2024-04-25T09:07:38.635263+0000","last_peered":"2024-04-25T09:07:38.635263+0000","last_clean":"2024-04-25T09:07:38.635263+0000","last_became_active":"2024-04-25T09:07:37.621887+0000","last_became_peered":"2024-04-25T09:07:37.621887+0000","last_unstale":"2024-04-25T09:07:38.635263+0000","last_undegraded":"2024-04-25T09:07:38.635263+0000","last_fullsized":"2024-04-25T09:07:38.635263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:53.134215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620629+0000","last_change":"2024-04-25T09:07:36.611689+0000","last_active":"2024-04-25T09:07:38.620629+0000","last_peered":"2024-04-25T09:07:38.620629+0000","last_clean":"2024-04-25T09:07:38.620629+0000","last_became_active":"2024-04-25T09:07:36.611363+0000","last_became_peered":"2024-04-25T09:07:36.611363+0000","last_unstale":"2024-04-25T09:07:38.620629+0000","last_undegraded":"2024-04-25T09:07:38.620629+0000","last_fullsized":"2024-04-25T09:07:38.620629+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:14.915918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621924+0000","last_change":"2024-04-25T09:07:37.627431+0000","last_active":"2024-04-25T09:07:38.621924+0000","last_peered":"2024-04-25T09:07:38.621924+0000","last_clean":"2024-04-25T09:07:38.621924+0000","last_became_active":"2024-04-25T09:07:37.627171+0000","last_became_peered":"2024-04-25T09:07:37.627171+0000","last_unstale":"2024-04-25T09:07:38.621924+0000","last_undegraded":"2024-04-25T09:07:38.621924+0000","last_fullsized":"2024-04-25T09:07:38.621924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:38.473267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620530+0000","last_change":"2024-04-25T09:07:36.614988+0000","last_active":"2024-04-25T09:07:38.620530+0000","last_peered":"2024-04-25T09:07:38.620530+0000","last_clean":"2024-04-25T09:07:38.620530+0000","last_became_active":"2024-04-25T09:07:36.614690+0000","last_became_peered":"2024-04-25T09:07:36.614690+0000","last_unstale":"2024-04-25T09:07:38.620530+0000","last_undegraded":"2024-04-25T09:07:38.620530+0000","last_fullsized":"2024-04-25T09:07:38.620530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:24.432090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621771+0000","last_change":"2024-04-25T09:07:37.621882+0000","last_active":"2024-04-25T09:07:38.621771+0000","last_peered":"2024-04-25T09:07:38.621771+0000","last_clean":"2024-04-25T09:07:38.621771+0000","last_became_active":"2024-04-25T09:07:37.621628+0000","last_became_peered":"2024-04-25T09:07:37.621628+0000","last_unstale":"2024-04-25T09:07:38.621771+0000","last_undegraded":"2024-04-25T09:07:38.621771+0000","last_fullsized":"2024-04-25T09:07:38.621771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:44.455585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.644170+0000","last_change":"2024-04-25T09:07:36.618544+0000","last_active":"2024-04-25T09:07:37.644170+0000","last_peered":"2024-04-25T09:07:37.644170+0000","last_clean":"2024-04-25T09:07:37.644170+0000","last_became_active":"2024-04-25T09:07:36.618264+0000","last_became_peered":"2024-04-25T09:07:36.618264+0000","last_unstale":"2024-04-25T09:07:37.644170+0000","last_undegraded":"2024-04-25T09:07:37.644170+0000","last_fullsized":"2024-04-25T09:07:37.644170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:23.388413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621069+0000","last_change":"2024-04-25T09:07:37.623868+0000","last_active":"2024-04-25T09:07:38.621069+0000","last_peered":"2024-04-25T09:07:38.621069+0000","last_clean":"2024-04-25T09:07:38.621069+0000","last_became_active":"2024-04-25T09:07:37.623586+0000","last_became_peered":"2024-04-25T09:07:37.623586+0000","last_unstale":"2024-04-25T09:07:38.621069+0000","last_undegraded":"2024-04-25T09:07:38.621069+0000","last_fullsized":"2024-04-25T09:07:38.621069+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:57.191201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"84'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.636608+0000","last_change":"2024-04-25T09:07:36.620391+0000","last_active":"2024-04-25T09:07:38.636608+0000","last_peered":"2024-04-25T09:07:38.636608+0000","last_clean":"2024-04-25T09:07:38.636608+0000","last_became_active":"2024-04-25T09:07:36.619820+0000","last_became_peered":"2024-04-25T09:07:36.619820+0000","last_unstale":"2024-04-25T09:07:38.636608+0000","last_undegraded":"2024-04-25T09:07:38.636608+0000","last_fullsized":"2024-04-25T09:07:38.636608+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:50.109112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621494+0000","last_change":"2024-04-25T09:07:37.621282+0000","last_active":"2024-04-25T09:07:38.621494+0000","last_peered":"2024-04-25T09:07:38.621494+0000","last_clean":"2024-04-25T09:07:38.621494+0000","last_became_active":"2024-04-25T09:07:37.620633+0000","last_became_peered":"2024-04-25T09:07:37.620633+0000","last_unstale":"2024-04-25T09:07:38.621494+0000","last_undegraded":"2024-04-25T09:07:38.621494+0000","last_fullsized":"2024-04-25T09:07:38.621494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:45.953616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.618207+0000","last_change":"2024-04-25T09:07:36.617437+0000","last_active":"2024-04-25T09:07:36.618207+0000","last_peered":"2024-04-25T09:07:36.618207+0000","last_clean":"2024-04-25T09:07:36.618207+0000","last_became_active":"2024-04-25T09:07:36.617117+0000","last_became_peered":"2024-04-25T09:07:36.617117+0000","last_unstale":"2024-04-25T09:07:36.618207+0000","last_undegraded":"2024-04-25T09:07:36.618207+0000","last_fullsized":"2024-04-25T09:07:36.618207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:38.211669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634889+0000","last_change":"2024-04-25T09:07:37.617426+0000","last_active":"2024-04-25T09:07:38.634889+0000","last_peered":"2024-04-25T09:07:38.634889+0000","last_clean":"2024-04-25T09:07:38.634889+0000","last_became_active":"2024-04-25T09:07:37.617172+0000","last_became_peered":"2024-04-25T09:07:37.617172+0000","last_unstale":"2024-04-25T09:07:38.634889+0000","last_undegraded":"2024-04-25T09:07:38.634889+0000","last_fullsized":"2024-04-25T09:07:38.634889+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:10.692785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.622645+0000","last_change":"2024-04-25T09:07:36.619230+0000","last_active":"2024-04-25T09:07:36.622645+0000","last_peered":"2024-04-25T09:07:36.622645+0000","last_clean":"2024-04-25T09:07:36.622645+0000","last_became_active":"2024-04-25T09:07:36.618957+0000","last_became_peered":"2024-04-25T09:07:36.618957+0000","last_unstale":"2024-04-25T09:07:36.622645+0000","last_undegraded":"2024-04-25T09:07:36.622645+0000","last_fullsized":"2024-04-25T09:07:36.622645+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:49.874474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621380+0000","last_change":"2024-04-25T09:07:37.628246+0000","last_active":"2024-04-25T09:07:38.621380+0000","last_peered":"2024-04-25T09:07:38.621380+0000","last_clean":"2024-04-25T09:07:38.621380+0000","last_became_active":"2024-04-25T09:07:37.623529+0000","last_became_peered":"2024-04-25T09:07:37.623529+0000","last_unstale":"2024-04-25T09:07:38.621380+0000","last_undegraded":"2024-04-25T09:07:38.621380+0000","last_fullsized":"2024-04-25T09:07:38.621380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:54.940460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620686+0000","last_change":"2024-04-25T09:07:36.612649+0000","last_active":"2024-04-25T09:07:38.620686+0000","last_peered":"2024-04-25T09:07:38.620686+0000","last_clean":"2024-04-25T09:07:38.620686+0000","last_became_active":"2024-04-25T09:07:36.611900+0000","last_became_peered":"2024-04-25T09:07:36.611900+0000","last_unstale":"2024-04-25T09:07:38.620686+0000","last_undegraded":"2024-04-25T09:07:38.620686+0000","last_fullsized":"2024-04-25T09:07:38.620686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:40.057829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621211+0000","last_change":"2024-04-25T09:07:37.634630+0000","last_active":"2024-04-25T09:07:38.621211+0000","last_peered":"2024-04-25T09:07:38.621211+0000","last_clean":"2024-04-25T09:07:38.621211+0000","last_became_active":"2024-04-25T09:07:37.634242+0000","last_became_peered":"2024-04-25T09:07:37.634242+0000","last_unstale":"2024-04-25T09:07:38.621211+0000","last_undegraded":"2024-04-25T09:07:38.621211+0000","last_fullsized":"2024-04-25T09:07:38.621211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:40.108001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637258+0000","last_change":"2024-04-25T09:07:36.617056+0000","last_active":"2024-04-25T09:07:38.637258+0000","last_peered":"2024-04-25T09:07:38.637258+0000","last_clean":"2024-04-25T09:07:38.637258+0000","last_became_active":"2024-04-25T09:07:36.616846+0000","last_became_peered":"2024-04-25T09:07:36.616846+0000","last_unstale":"2024-04-25T09:07:38.637258+0000","last_undegraded":"2024-04-25T09:07:38.637258+0000","last_fullsized":"2024-04-25T09:07:38.637258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:07.592728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.638281+0000","last_change":"2024-04-25T09:07:37.629289+0000","last_active":"2024-04-25T09:07:37.638281+0000","last_peered":"2024-04-25T09:07:37.638281+0000","last_clean":"2024-04-25T09:07:37.638281+0000","last_became_active":"2024-04-25T09:07:37.629029+0000","last_became_peered":"2024-04-25T09:07:37.629029+0000","last_unstale":"2024-04-25T09:07:37.638281+0000","last_undegraded":"2024-04-25T09:07:37.638281+0000","last_fullsized":"2024-04-25T09:07:37.638281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:33.841194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621190+0000","last_change":"2024-04-25T09:07:36.605134+0000","last_active":"2024-04-25T09:07:38.621190+0000","last_peered":"2024-04-25T09:07:38.621190+0000","last_clean":"2024-04-25T09:07:38.621190+0000","last_became_active":"2024-04-25T09:07:36.604853+0000","last_became_peered":"2024-04-25T09:07:36.604853+0000","last_unstale":"2024-04-25T09:07:38.621190+0000","last_undegraded":"2024-04-25T09:07:38.621190+0000","last_fullsized":"2024-04-25T09:07:38.621190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:44.946625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.639900+0000","last_change":"2024-04-25T09:07:37.635406+0000","last_active":"2024-04-25T09:07:37.639900+0000","last_peered":"2024-04-25T09:07:37.639900+0000","last_clean":"2024-04-25T09:07:37.639900+0000","last_became_active":"2024-04-25T09:07:37.635219+0000","last_became_peered":"2024-04-25T09:07:37.635219+0000","last_unstale":"2024-04-25T09:07:37.639900+0000","last_undegraded":"2024-04-25T09:07:37.639900+0000","last_fullsized":"2024-04-25T09:07:37.639900+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:42.758124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.615985+0000","last_change":"2024-04-25T09:07:36.612144+0000","last_active":"2024-04-25T09:07:37.615985+0000","last_peered":"2024-04-25T09:07:37.615985+0000","last_clean":"2024-04-25T09:07:37.615985+0000","last_became_active":"2024-04-25T09:07:36.610715+0000","last_became_peered":"2024-04-25T09:07:36.610715+0000","last_unstale":"2024-04-25T09:07:37.615985+0000","last_undegraded":"2024-04-25T09:07:37.615985+0000","last_fullsized":"2024-04-25T09:07:37.615985+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:07.868609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-04-25T09:07:36.606259+0000","last_change":"2024-04-25T09:07:36.606259+0000","last_active":"2024-04-25T09:07:36.589349+0000","last_peered":"2024-04-25T09:07:36.589349+0000","last_clean":"2024-04-25T09:07:36.589349+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:07:36.606259+0000","last_undegraded":"2024-04-25T09:07:36.606259+0000","last_fullsized":"2024-04-25T09:07:36.606259+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621217+0000","last_change":"2024-04-25T09:07:36.615155+0000","last_active":"2024-04-25T09:07:38.621217+0000","last_peered":"2024-04-25T09:07:38.621217+0000","last_clean":"2024-04-25T09:07:38.621217+0000","last_became_active":"2024-04-25T09:07:36.614868+0000","last_became_peered":"2024-04-25T09:07:36.614868+0000","last_unstale":"2024-04-25T09:07:38.621217+0000","last_undegraded":"2024-04-25T09:07:38.621217+0000","last_fullsized":"2024-04-25T09:07:38.621217+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:09.685794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":280,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.607625+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:07:36.607625+0000","last_peered":"2024-04-25T09:07:36.607625+0000","last_clean":"2024-04-25T09:07:36.607625+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:07:36.607625+0000","last_undegraded":"2024-04-25T09:07:36.607625+0000","last_fullsized":"2024-04-25T09:07:36.607625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1019904,"data_stored":464016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509503,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1011712,"data_stored":462438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509504,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1028096,"data_stored":464120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509503,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1011712,"data_stored":462986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509503,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36344,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335496,"statfs":{"total":96636764160,"available":96599547904,"internally_reserved":0,"allocated":1019904,"data_stored":463146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509504,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1015808,"data_stored":462516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509504,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59120,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312720,"statfs":{"total":96636764160,"available":96576225280,"internally_reserved":0,"allocated":1601536,"data_stored":1052772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36884,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334956,"statfs":{"total":96636764160,"available":96598994944,"internally_reserved":0,"allocated":1576960,"data_stored":1038938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:07:42.049 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:07:42.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.234+0000 7f96a6c00640 1 Processor -- start 2024-04-25T09:07:42.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.234+0000 7f96a6c00640 1 -- start start 2024-04-25T09:07:42.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f96a6c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f96a0145250 0x7f96a015c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f96a6c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96a00cc8b0 0x7f96a00ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f96a6c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f96a0071320 0x7f96a0071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f96a6c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a015cec0 con 0x7f96a0071320 2024-04-25T09:07:42.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f96a6c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a006e7c0 con 0x7f96a0145250 2024-04-25T09:07:42.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f96a6c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a006d720 con 0x7f96a00cc8b0 2024-04-25T09:07:42.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f96a4c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f96a0071320 0x7f96a0071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f96a4c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f96a0071320 0x7f96a0071790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41600/0 (socket says 172.21.15.173:41600) 2024-04-25T09:07:42.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f96a4c00640 1 -- 172.21.15.173:0/2766928297 learned_addr learned my addr 172.21.15.173:0/2766928297 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:42.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f969fe00640 1 --2- 172.21.15.173:0/2766928297 >> v2:172.21.15.194:3300/0 conn(0x7f96a0145250 0x7f96a015c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f96a4c00640 1 -- 172.21.15.173:0/2766928297 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96a00cc8b0 msgr2=0x7f96a00ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:42.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f9697400640 1 --2- 172.21.15.173:0/2766928297 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96a00cc8b0 0x7f96a00ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f96a4c00640 1 --2- 172.21.15.173:0/2766928297 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96a00cc8b0 0x7f96a00ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f96a4c00640 1 -- 172.21.15.173:0/2766928297 >> v2:172.21.15.194:3300/0 conn(0x7f96a0145250 msgr2=0x7f96a015c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:42.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f96a4c00640 1 --2- 172.21.15.173:0/2766928297 >> v2:172.21.15.194:3300/0 conn(0x7f96a0145250 0x7f96a015c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f96a4c00640 1 -- 172.21.15.173:0/2766928297 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a006da00 con 0x7f96a0071320 2024-04-25T09:07:42.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f969fe00640 1 --2- 172.21.15.173:0/2766928297 >> v2:172.21.15.194:3300/0 conn(0x7f96a0145250 0x7f96a015c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:42.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f9697400640 1 --2- 172.21.15.173:0/2766928297 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96a00cc8b0 0x7f96a00ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:42.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.238+0000 7f96a4c00640 1 --2- 172.21.15.173:0/2766928297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96a0071320 0x7f96a0071790 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f96a00d0420 tx=0x7f969801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87fcd369af6ef48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:42.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f969f400640 1 -- 172.21.15.173:0/2766928297 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96980a5760 con 0x7f96a0071320 2024-04-25T09:07:42.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f969f400640 1 -- 172.21.15.173:0/2766928297 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96980a5900 con 0x7f96a0071320 2024-04-25T09:07:42.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f969f400640 1 -- 172.21.15.173:0/2766928297 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96980a5cd0 con 0x7f96a0071320 2024-04-25T09:07:42.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a6c00640 1 -- 172.21.15.173:0/2766928297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96a0071320 msgr2=0x7f96a0071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a6c00640 1 --2- 172.21.15.173:0/2766928297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96a0071320 0x7f96a0071790 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f96a00d0420 tx=0x7f969801c9f0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a6c00640 1 -- 172.21.15.173:0/2766928297 shutdown_connections 2024-04-25T09:07:42.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a6c00640 1 --2- 172.21.15.173:0/2766928297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96a0071320 0x7f96a0071790 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a6c00640 1 --2- 172.21.15.173:0/2766928297 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96a00cc8b0 0x7f96a00ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a6c00640 1 --2- 172.21.15.173:0/2766928297 >> v2:172.21.15.194:3300/0 conn(0x7f96a0145250 0x7f96a015c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a6c00640 1 -- 172.21.15.173:0/2766928297 >> 172.21.15.173:0/2766928297 conn(0x7f96a006ac90 msgr2=0x7f96a006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:42.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a6c00640 1 -- 172.21.15.173:0/2766928297 shutdown_connections 2024-04-25T09:07:42.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a6c00640 1 -- 172.21.15.173:0/2766928297 wait complete. 2024-04-25T09:07:42.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a6c00640 1 Processor -- start 2024-04-25T09:07:42.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a6c00640 1 -- start start 2024-04-25T09:07:42.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a6c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96a0071320 0x7f96a0157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a6c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96a00cc8b0 0x7f96a013c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a6c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96a0145250 0x7f96a0143660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a6c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a00720e0 con 0x7f96a0145250 2024-04-25T09:07:42.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a6c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a0145630 con 0x7f96a0071320 2024-04-25T09:07:42.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a6c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a006ef80 con 0x7f96a00cc8b0 2024-04-25T09:07:42.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a4c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96a0145250 0x7f96a0143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f969fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96a0071320 0x7f96a0157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a4c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96a0145250 0x7f96a0143660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41602/0 (socket says 172.21.15.173:41602) 2024-04-25T09:07:42.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f96a4c00640 1 -- 172.21.15.173:0/3842248480 learned_addr learned my addr 172.21.15.173:0/3842248480 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:42.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.242+0000 7f9697400640 1 --2- 172.21.15.173:0/3842248480 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96a00cc8b0 0x7f96a013c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.246+0000 7f96a4c00640 1 -- 172.21.15.173:0/3842248480 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96a00cc8b0 msgr2=0x7f96a013c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.246+0000 7f96a4c00640 1 --2- 172.21.15.173:0/3842248480 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96a00cc8b0 0x7f96a013c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.246+0000 7f96a4c00640 1 -- 172.21.15.173:0/3842248480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96a0071320 msgr2=0x7f96a0157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.246+0000 7f96a4c00640 1 --2- 172.21.15.173:0/3842248480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96a0071320 0x7f96a0157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.246+0000 7f96a4c00640 1 -- 172.21.15.173:0/3842248480 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a006ebf0 con 0x7f96a0145250 2024-04-25T09:07:42.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.246+0000 7f96a4c00640 1 --2- 172.21.15.173:0/3842248480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96a0145250 0x7f96a0143660 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f969801b0a0 tx=0x7f9698019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:42.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.246+0000 7f969cc00640 1 -- 172.21.15.173:0/3842248480 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96980b8670 con 0x7f96a0145250 2024-04-25T09:07:42.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.246+0000 7f969cc00640 1 -- 172.21.15.173:0/3842248480 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96980be070 con 0x7f96a0145250 2024-04-25T09:07:42.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.246+0000 7f969cc00640 1 -- 172.21.15.173:0/3842248480 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96980b8a90 con 0x7f96a0145250 2024-04-25T09:07:42.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.246+0000 7f96a6c00640 1 -- 172.21.15.173:0/3842248480 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a0142bf0 con 0x7f96a0145250 2024-04-25T09:07:42.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.246+0000 7f96a6c00640 1 -- 172.21.15.173:0/3842248480 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a0142e60 con 0x7f96a0145250 2024-04-25T09:07:42.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.246+0000 7f96a6c00640 1 -- 172.21.15.173:0/3842248480 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a0073a40 con 0x7f96a0145250 2024-04-25T09:07:42.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.246+0000 7f969cc00640 1 -- 172.21.15.173:0/3842248480 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f96980b8c30 con 0x7f96a0145250 2024-04-25T09:07:42.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.246+0000 7f969cc00640 1 --2- 172.21.15.173:0/3842248480 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f967c066f60 0x7f967c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.246+0000 7f969cc00640 1 -- 172.21.15.173:0/3842248480 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f96981202f0 con 0x7f96a0145250 2024-04-25T09:07:42.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.246+0000 7f969fe00640 1 --2- 172.21.15.173:0/3842248480 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f967c066f60 0x7f967c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.250+0000 7f969fe00640 1 --2- 172.21.15.173:0/3842248480 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f967c066f60 0x7f967c069420 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9690006fd0 tx=0x7f9690008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:42.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.250+0000 7f969cc00640 1 -- 172.21.15.173:0/3842248480 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f96980165e0 con 0x7f96a0145250 2024-04-25T09:07:42.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.402+0000 7f96a6c00640 1 -- 172.21.15.173:0/3842248480 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f96a006c300 con 0x7f967c066f60 2024-04-25T09:07:42.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.410+0000 7f969cc00640 1 -- 172.21.15.173:0/3842248480 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251559 (secure 0 0 0) 0x7f96a006c300 con 0x7f967c066f60 2024-04-25T09:07:42.399 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:42.400 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:07:42.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.414+0000 7f96a6c00640 1 -- 172.21.15.173:0/3842248480 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f967c066f60 msgr2=0x7f967c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.414+0000 7f96a6c00640 1 --2- 172.21.15.173:0/3842248480 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f967c066f60 0x7f967c069420 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9690006fd0 tx=0x7f9690008040 comp rx=0 tx=0).stop 2024-04-25T09:07:42.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.414+0000 7f96a6c00640 1 -- 172.21.15.173:0/3842248480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96a0145250 msgr2=0x7f96a0143660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.414+0000 7f96a6c00640 1 --2- 172.21.15.173:0/3842248480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96a0145250 0x7f96a0143660 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f969801b0a0 tx=0x7f9698019790 comp rx=0 tx=0).stop 2024-04-25T09:07:42.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.414+0000 7f96a6c00640 1 -- 172.21.15.173:0/3842248480 shutdown_connections 2024-04-25T09:07:42.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.414+0000 7f96a6c00640 1 --2- 172.21.15.173:0/3842248480 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f967c066f60 0x7f967c069420 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.414+0000 7f96a6c00640 1 --2- 172.21.15.173:0/3842248480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96a0145250 0x7f96a0143660 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.414+0000 7f96a6c00640 1 --2- 172.21.15.173:0/3842248480 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96a00cc8b0 0x7f96a013c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.414+0000 7f96a6c00640 1 --2- 172.21.15.173:0/3842248480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96a0071320 0x7f96a0157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.414+0000 7f96a6c00640 1 -- 172.21.15.173:0/3842248480 >> 172.21.15.173:0/3842248480 conn(0x7f96a006ac90 msgr2=0x7f96a015acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:42.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.414+0000 7f96a6c00640 1 -- 172.21.15.173:0/3842248480 shutdown_connections 2024-04-25T09:07:42.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.414+0000 7f96a6c00640 1 -- 172.21.15.173:0/3842248480 wait complete. 2024-04-25T09:07:42.419 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2024-04-25T09:07:40.789622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":200,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":322364,"kb_used_data":9068,"kb_used_omap":12,"kb_used_meta":313139,"kb_avail":754652356,"statfs":{"total":773094113280,"available":772764012544,"internally_reserved":0,"allocated":9285632,"data_stored":4870932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":320654896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.199805"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-04-25T09:07:36.607014+0000","last_change":"2024-04-25T09:07:36.607014+0000","last_active":"2024-04-25T09:07:36.589349+0000","last_peered":"2024-04-25T09:07:36.589349+0000","last_clean":"2024-04-25T09:07:36.589349+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:07:36.607014+0000","last_undegraded":"2024-04-25T09:07:36.607014+0000","last_fullsized":"2024-04-25T09:07:36.607014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635118+0000","last_change":"2024-04-25T09:07:37.642120+0000","last_active":"2024-04-25T09:07:38.635118+0000","last_peered":"2024-04-25T09:07:38.635118+0000","last_clean":"2024-04-25T09:07:38.635118+0000","last_became_active":"2024-04-25T09:07:37.641706+0000","last_became_peered":"2024-04-25T09:07:37.641706+0000","last_unstale":"2024-04-25T09:07:38.635118+0000","last_undegraded":"2024-04-25T09:07:38.635118+0000","last_fullsized":"2024-04-25T09:07:38.635118+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:14.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.637727+0000","last_change":"2024-04-25T09:07:37.629356+0000","last_active":"2024-04-25T09:07:37.637727+0000","last_peered":"2024-04-25T09:07:37.637727+0000","last_clean":"2024-04-25T09:07:37.637727+0000","last_became_active":"2024-04-25T09:07:37.629071+0000","last_became_peered":"2024-04-25T09:07:37.629071+0000","last_unstale":"2024-04-25T09:07:37.637727+0000","last_undegraded":"2024-04-25T09:07:37.637727+0000","last_fullsized":"2024-04-25T09:07:37.637727+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:25.741760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.628278+0000","last_change":"2024-04-25T09:07:37.626588+0000","last_active":"2024-04-25T09:07:37.628278+0000","last_peered":"2024-04-25T09:07:37.628278+0000","last_clean":"2024-04-25T09:07:37.628278+0000","last_became_active":"2024-04-25T09:07:37.625527+0000","last_became_peered":"2024-04-25T09:07:37.625527+0000","last_unstale":"2024-04-25T09:07:37.628278+0000","last_undegraded":"2024-04-25T09:07:37.628278+0000","last_fullsized":"2024-04-25T09:07:37.628278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:40.108001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637267+0000","last_change":"2024-04-25T09:07:37.639626+0000","last_active":"2024-04-25T09:07:38.637267+0000","last_peered":"2024-04-25T09:07:38.637267+0000","last_clean":"2024-04-25T09:07:38.637267+0000","last_became_active":"2024-04-25T09:07:37.636488+0000","last_became_peered":"2024-04-25T09:07:37.636488+0000","last_unstale":"2024-04-25T09:07:38.637267+0000","last_undegraded":"2024-04-25T09:07:38.637267+0000","last_fullsized":"2024-04-25T09:07:38.637267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:33.387139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620739+0000","last_change":"2024-04-25T09:07:37.618282+0000","last_active":"2024-04-25T09:07:38.620739+0000","last_peered":"2024-04-25T09:07:38.620739+0000","last_clean":"2024-04-25T09:07:38.620739+0000","last_became_active":"2024-04-25T09:07:37.617980+0000","last_became_peered":"2024-04-25T09:07:37.617980+0000","last_unstale":"2024-04-25T09:07:38.620739+0000","last_undegraded":"2024-04-25T09:07:38.620739+0000","last_fullsized":"2024-04-25T09:07:38.620739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.374955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620911+0000","last_change":"2024-04-25T09:07:37.634612+0000","last_active":"2024-04-25T09:07:38.620911+0000","last_peered":"2024-04-25T09:07:38.620911+0000","last_clean":"2024-04-25T09:07:38.620911+0000","last_became_active":"2024-04-25T09:07:37.634272+0000","last_became_peered":"2024-04-25T09:07:37.634272+0000","last_unstale":"2024-04-25T09:07:38.620911+0000","last_undegraded":"2024-04-25T09:07:38.620911+0000","last_fullsized":"2024-04-25T09:07:38.620911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:24.395404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637140+0000","last_change":"2024-04-25T09:07:37.632445+0000","last_active":"2024-04-25T09:07:38.637140+0000","last_peered":"2024-04-25T09:07:38.637140+0000","last_clean":"2024-04-25T09:07:38.637140+0000","last_became_active":"2024-04-25T09:07:37.632100+0000","last_became_peered":"2024-04-25T09:07:37.632100+0000","last_unstale":"2024-04-25T09:07:38.637140+0000","last_undegraded":"2024-04-25T09:07:38.637140+0000","last_fullsized":"2024-04-25T09:07:38.637140+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:34.107400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621523+0000","last_change":"2024-04-25T09:07:37.620664+0000","last_active":"2024-04-25T09:07:38.621523+0000","last_peered":"2024-04-25T09:07:38.621523+0000","last_clean":"2024-04-25T09:07:38.621523+0000","last_became_active":"2024-04-25T09:07:37.620393+0000","last_became_peered":"2024-04-25T09:07:37.620393+0000","last_unstale":"2024-04-25T09:07:38.621523+0000","last_undegraded":"2024-04-25T09:07:38.621523+0000","last_fullsized":"2024-04-25T09:07:38.621523+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:37.691190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631368+0000","last_change":"2024-04-25T09:07:37.628104+0000","last_active":"2024-04-25T09:07:37.631368+0000","last_peered":"2024-04-25T09:07:37.631368+0000","last_clean":"2024-04-25T09:07:37.631368+0000","last_became_active":"2024-04-25T09:07:37.627451+0000","last_became_peered":"2024-04-25T09:07:37.627451+0000","last_unstale":"2024-04-25T09:07:37.631368+0000","last_undegraded":"2024-04-25T09:07:37.631368+0000","last_fullsized":"2024-04-25T09:07:37.631368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:54.940460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635165+0000","last_change":"2024-04-25T09:07:37.638244+0000","last_active":"2024-04-25T09:07:38.635165+0000","last_peered":"2024-04-25T09:07:38.635165+0000","last_clean":"2024-04-25T09:07:38.635165+0000","last_became_active":"2024-04-25T09:07:37.637967+0000","last_became_peered":"2024-04-25T09:07:37.637967+0000","last_unstale":"2024-04-25T09:07:38.635165+0000","last_undegraded":"2024-04-25T09:07:38.635165+0000","last_fullsized":"2024-04-25T09:07:38.635165+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:40.123592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631283+0000","last_change":"2024-04-25T09:07:37.628390+0000","last_active":"2024-04-25T09:07:37.631283+0000","last_peered":"2024-04-25T09:07:37.631283+0000","last_clean":"2024-04-25T09:07:37.631283+0000","last_became_active":"2024-04-25T09:07:37.628101+0000","last_became_peered":"2024-04-25T09:07:37.628101+0000","last_unstale":"2024-04-25T09:07:37.631283+0000","last_undegraded":"2024-04-25T09:07:37.631283+0000","last_fullsized":"2024-04-25T09:07:37.631283+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:21.781597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637387+0000","last_change":"2024-04-25T09:07:37.644053+0000","last_active":"2024-04-25T09:07:38.637387+0000","last_peered":"2024-04-25T09:07:38.637387+0000","last_clean":"2024-04-25T09:07:38.637387+0000","last_became_active":"2024-04-25T09:07:37.643783+0000","last_became_peered":"2024-04-25T09:07:37.643783+0000","last_unstale":"2024-04-25T09:07:38.637387+0000","last_undegraded":"2024-04-25T09:07:38.637387+0000","last_fullsized":"2024-04-25T09:07:38.637387+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:57.907870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620774+0000","last_change":"2024-04-25T09:07:37.618084+0000","last_active":"2024-04-25T09:07:38.620774+0000","last_peered":"2024-04-25T09:07:38.620774+0000","last_clean":"2024-04-25T09:07:38.620774+0000","last_became_active":"2024-04-25T09:07:37.617758+0000","last_became_peered":"2024-04-25T09:07:37.617758+0000","last_unstale":"2024-04-25T09:07:38.620774+0000","last_undegraded":"2024-04-25T09:07:38.620774+0000","last_fullsized":"2024-04-25T09:07:38.620774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:53.134215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634782+0000","last_change":"2024-04-25T09:07:37.624978+0000","last_active":"2024-04-25T09:07:38.634782+0000","last_peered":"2024-04-25T09:07:38.634782+0000","last_clean":"2024-04-25T09:07:38.634782+0000","last_became_active":"2024-04-25T09:07:37.624509+0000","last_became_peered":"2024-04-25T09:07:37.624509+0000","last_unstale":"2024-04-25T09:07:38.634782+0000","last_undegraded":"2024-04-25T09:07:38.634782+0000","last_fullsized":"2024-04-25T09:07:38.634782+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:18.688958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-04-25T09:07:36.604384+0000","last_change":"2024-04-25T09:07:36.604384+0000","last_active":"2024-04-25T09:07:36.589349+0000","last_peered":"2024-04-25T09:07:36.589349+0000","last_clean":"2024-04-25T09:07:36.589349+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:07:36.604384+0000","last_undegraded":"2024-04-25T09:07:36.604384+0000","last_fullsized":"2024-04-25T09:07:36.604384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637781+0000","last_change":"2024-04-25T09:07:37.639108+0000","last_active":"2024-04-25T09:07:38.637781+0000","last_peered":"2024-04-25T09:07:38.637781+0000","last_clean":"2024-04-25T09:07:38.637781+0000","last_became_active":"2024-04-25T09:07:37.638532+0000","last_became_peered":"2024-04-25T09:07:37.638532+0000","last_unstale":"2024-04-25T09:07:38.637781+0000","last_undegraded":"2024-04-25T09:07:38.637781+0000","last_fullsized":"2024-04-25T09:07:38.637781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:02.132000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.638553+0000","last_change":"2024-04-25T09:07:37.634860+0000","last_active":"2024-04-25T09:07:37.638553+0000","last_peered":"2024-04-25T09:07:37.638553+0000","last_clean":"2024-04-25T09:07:37.638553+0000","last_became_active":"2024-04-25T09:07:37.634582+0000","last_became_peered":"2024-04-25T09:07:37.634582+0000","last_unstale":"2024-04-25T09:07:37.638553+0000","last_undegraded":"2024-04-25T09:07:37.638553+0000","last_fullsized":"2024-04-25T09:07:37.638553+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:31.359245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621086+0000","last_change":"2024-04-25T09:07:37.638340+0000","last_active":"2024-04-25T09:07:38.621086+0000","last_peered":"2024-04-25T09:07:38.621086+0000","last_clean":"2024-04-25T09:07:38.621086+0000","last_became_active":"2024-04-25T09:07:37.638060+0000","last_became_peered":"2024-04-25T09:07:37.638060+0000","last_unstale":"2024-04-25T09:07:38.621086+0000","last_undegraded":"2024-04-25T09:07:38.621086+0000","last_fullsized":"2024-04-25T09:07:38.621086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:09.628669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637578+0000","last_change":"2024-04-25T09:07:37.639988+0000","last_active":"2024-04-25T09:07:38.637578+0000","last_peered":"2024-04-25T09:07:38.637578+0000","last_clean":"2024-04-25T09:07:38.637578+0000","last_became_active":"2024-04-25T09:07:37.639263+0000","last_became_peered":"2024-04-25T09:07:37.639263+0000","last_unstale":"2024-04-25T09:07:38.637578+0000","last_undegraded":"2024-04-25T09:07:38.637578+0000","last_fullsized":"2024-04-25T09:07:38.637578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:38.575243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621067+0000","last_change":"2024-04-25T09:07:37.633413+0000","last_active":"2024-04-25T09:07:38.621067+0000","last_peered":"2024-04-25T09:07:38.621067+0000","last_clean":"2024-04-25T09:07:38.621067+0000","last_became_active":"2024-04-25T09:07:37.633132+0000","last_became_peered":"2024-04-25T09:07:37.633132+0000","last_unstale":"2024-04-25T09:07:38.621067+0000","last_undegraded":"2024-04-25T09:07:38.621067+0000","last_fullsized":"2024-04-25T09:07:38.621067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:41.064820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637379+0000","last_change":"2024-04-25T09:07:37.644962+0000","last_active":"2024-04-25T09:07:38.637379+0000","last_peered":"2024-04-25T09:07:38.637379+0000","last_clean":"2024-04-25T09:07:38.637379+0000","last_became_active":"2024-04-25T09:07:37.644695+0000","last_became_peered":"2024-04-25T09:07:37.644695+0000","last_unstale":"2024-04-25T09:07:38.637379+0000","last_undegraded":"2024-04-25T09:07:38.637379+0000","last_fullsized":"2024-04-25T09:07:38.637379+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:05:45.625216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.622028+0000","last_change":"2024-04-25T09:07:37.624852+0000","last_active":"2024-04-25T09:07:38.622028+0000","last_peered":"2024-04-25T09:07:38.622028+0000","last_clean":"2024-04-25T09:07:38.622028+0000","last_became_active":"2024-04-25T09:07:37.624552+0000","last_became_peered":"2024-04-25T09:07:37.624552+0000","last_unstale":"2024-04-25T09:07:38.622028+0000","last_undegraded":"2024-04-25T09:07:38.622028+0000","last_fullsized":"2024-04-25T09:07:38.622028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:55.922340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634678+0000","last_change":"2024-04-25T09:07:37.628098+0000","last_active":"2024-04-25T09:07:38.634678+0000","last_peered":"2024-04-25T09:07:38.634678+0000","last_clean":"2024-04-25T09:07:38.634678+0000","last_became_active":"2024-04-25T09:07:37.627827+0000","last_became_peered":"2024-04-25T09:07:37.627827+0000","last_unstale":"2024-04-25T09:07:38.634678+0000","last_undegraded":"2024-04-25T09:07:38.634678+0000","last_fullsized":"2024-04-25T09:07:38.634678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:45.887572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635119+0000","last_change":"2024-04-25T09:07:37.627502+0000","last_active":"2024-04-25T09:07:38.635119+0000","last_peered":"2024-04-25T09:07:38.635119+0000","last_clean":"2024-04-25T09:07:38.635119+0000","last_became_active":"2024-04-25T09:07:37.626614+0000","last_became_peered":"2024-04-25T09:07:37.626614+0000","last_unstale":"2024-04-25T09:07:38.635119+0000","last_undegraded":"2024-04-25T09:07:38.635119+0000","last_fullsized":"2024-04-25T09:07:38.635119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:52.345009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631388+0000","last_change":"2024-04-25T09:07:37.630155+0000","last_active":"2024-04-25T09:07:37.631388+0000","last_peered":"2024-04-25T09:07:37.631388+0000","last_clean":"2024-04-25T09:07:37.631388+0000","last_became_active":"2024-04-25T09:07:37.629889+0000","last_became_peered":"2024-04-25T09:07:37.629889+0000","last_unstale":"2024-04-25T09:07:37.631388+0000","last_undegraded":"2024-04-25T09:07:37.631388+0000","last_fullsized":"2024-04-25T09:07:37.631388+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:12.490521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-04-25T09:07:36.607030+0000","last_change":"2024-04-25T09:07:36.607030+0000","last_active":"2024-04-25T09:07:36.589349+0000","last_peered":"2024-04-25T09:07:36.589349+0000","last_clean":"2024-04-25T09:07:36.589349+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:07:36.607030+0000","last_undegraded":"2024-04-25T09:07:36.607030+0000","last_fullsized":"2024-04-25T09:07:36.607030+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637640+0000","last_change":"2024-04-25T09:07:37.638930+0000","last_active":"2024-04-25T09:07:38.637640+0000","last_peered":"2024-04-25T09:07:38.637640+0000","last_clean":"2024-04-25T09:07:38.637640+0000","last_became_active":"2024-04-25T09:07:37.637356+0000","last_became_peered":"2024-04-25T09:07:37.637356+0000","last_unstale":"2024-04-25T09:07:38.637640+0000","last_undegraded":"2024-04-25T09:07:38.637640+0000","last_fullsized":"2024-04-25T09:07:38.637640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:54.912036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634809+0000","last_change":"2024-04-25T09:07:37.620835+0000","last_active":"2024-04-25T09:07:38.634809+0000","last_peered":"2024-04-25T09:07:38.634809+0000","last_clean":"2024-04-25T09:07:38.634809+0000","last_became_active":"2024-04-25T09:07:37.620537+0000","last_became_peered":"2024-04-25T09:07:37.620537+0000","last_unstale":"2024-04-25T09:07:38.634809+0000","last_undegraded":"2024-04-25T09:07:38.634809+0000","last_fullsized":"2024-04-25T09:07:38.634809+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:25.439081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-04-25T09:07:36.603398+0000","last_change":"2024-04-25T09:07:36.603398+0000","last_active":"2024-04-25T09:07:36.589349+0000","last_peered":"2024-04-25T09:07:36.589349+0000","last_clean":"2024-04-25T09:07:36.589349+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:07:36.603398+0000","last_undegraded":"2024-04-25T09:07:36.603398+0000","last_fullsized":"2024-04-25T09:07:36.603398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631453+0000","last_change":"2024-04-25T09:07:37.625322+0000","last_active":"2024-04-25T09:07:37.631453+0000","last_peered":"2024-04-25T09:07:37.631453+0000","last_clean":"2024-04-25T09:07:37.631453+0000","last_became_active":"2024-04-25T09:07:37.624684+0000","last_became_peered":"2024-04-25T09:07:37.624684+0000","last_unstale":"2024-04-25T09:07:37.631453+0000","last_undegraded":"2024-04-25T09:07:37.631453+0000","last_fullsized":"2024-04-25T09:07:37.631453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:12.567183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-04-25T09:07:36.603941+0000","last_change":"2024-04-25T09:07:36.603941+0000","last_active":"2024-04-25T09:07:36.589349+0000","last_peered":"2024-04-25T09:07:36.589349+0000","last_clean":"2024-04-25T09:07:36.589349+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:07:36.603941+0000","last_undegraded":"2024-04-25T09:07:36.603941+0000","last_fullsized":"2024-04-25T09:07:36.603941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.635064+0000","last_change":"2024-04-25T09:07:37.626057+0000","last_active":"2024-04-25T09:07:37.635064+0000","last_peered":"2024-04-25T09:07:37.635064+0000","last_clean":"2024-04-25T09:07:37.635064+0000","last_became_active":"2024-04-25T09:07:37.625736+0000","last_became_peered":"2024-04-25T09:07:37.625736+0000","last_unstale":"2024-04-25T09:07:37.635064+0000","last_undegraded":"2024-04-25T09:07:37.635064+0000","last_fullsized":"2024-04-25T09:07:37.635064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:50.340971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"83'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637794+0000","last_change":"2024-04-25T09:07:36.616376+0000","last_active":"2024-04-25T09:07:38.637794+0000","last_peered":"2024-04-25T09:07:38.637794+0000","last_clean":"2024-04-25T09:07:38.637794+0000","last_became_active":"2024-04-25T09:07:36.616075+0000","last_became_peered":"2024-04-25T09:07:36.616075+0000","last_unstale":"2024-04-25T09:07:38.637794+0000","last_undegraded":"2024-04-25T09:07:38.637794+0000","last_fullsized":"2024-04-25T09:07:38.637794+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:26.377752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634935+0000","last_change":"2024-04-25T09:07:37.628208+0000","last_active":"2024-04-25T09:07:38.634935+0000","last_peered":"2024-04-25T09:07:38.634935+0000","last_clean":"2024-04-25T09:07:38.634935+0000","last_became_active":"2024-04-25T09:07:37.627848+0000","last_became_peered":"2024-04-25T09:07:37.627848+0000","last_unstale":"2024-04-25T09:07:38.634935+0000","last_undegraded":"2024-04-25T09:07:38.634935+0000","last_fullsized":"2024-04-25T09:07:38.634935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:24.857733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.622668+0000","last_change":"2024-04-25T09:07:36.619079+0000","last_active":"2024-04-25T09:07:36.622668+0000","last_peered":"2024-04-25T09:07:36.622668+0000","last_clean":"2024-04-25T09:07:36.622668+0000","last_became_active":"2024-04-25T09:07:36.618396+0000","last_became_peered":"2024-04-25T09:07:36.618396+0000","last_unstale":"2024-04-25T09:07:36.622668+0000","last_undegraded":"2024-04-25T09:07:36.622668+0000","last_fullsized":"2024-04-25T09:07:36.622668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:59.294654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621321+0000","last_change":"2024-04-25T09:07:37.628645+0000","last_active":"2024-04-25T09:07:38.621321+0000","last_peered":"2024-04-25T09:07:38.621321+0000","last_clean":"2024-04-25T09:07:38.621321+0000","last_became_active":"2024-04-25T09:07:37.628344+0000","last_became_peered":"2024-04-25T09:07:37.628344+0000","last_unstale":"2024-04-25T09:07:38.621321+0000","last_undegraded":"2024-04-25T09:07:38.621321+0000","last_fullsized":"2024-04-25T09:07:38.621321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:46.246638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.622513+0000","last_change":"2024-04-25T09:07:36.618033+0000","last_active":"2024-04-25T09:07:36.622513+0000","last_peered":"2024-04-25T09:07:36.622513+0000","last_clean":"2024-04-25T09:07:36.622513+0000","last_became_active":"2024-04-25T09:07:36.617755+0000","last_became_peered":"2024-04-25T09:07:36.617755+0000","last_unstale":"2024-04-25T09:07:36.622513+0000","last_undegraded":"2024-04-25T09:07:36.622513+0000","last_fullsized":"2024-04-25T09:07:36.622513+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:31.306923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621071+0000","last_change":"2024-04-25T09:07:37.633374+0000","last_active":"2024-04-25T09:07:38.621071+0000","last_peered":"2024-04-25T09:07:38.621071+0000","last_clean":"2024-04-25T09:07:38.621071+0000","last_became_active":"2024-04-25T09:07:37.633097+0000","last_became_peered":"2024-04-25T09:07:37.633097+0000","last_unstale":"2024-04-25T09:07:38.621071+0000","last_undegraded":"2024-04-25T09:07:38.621071+0000","last_fullsized":"2024-04-25T09:07:38.621071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:04.260863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620809+0000","last_change":"2024-04-25T09:07:36.615481+0000","last_active":"2024-04-25T09:07:38.620809+0000","last_peered":"2024-04-25T09:07:38.620809+0000","last_clean":"2024-04-25T09:07:38.620809+0000","last_became_active":"2024-04-25T09:07:36.615203+0000","last_became_peered":"2024-04-25T09:07:36.615203+0000","last_unstale":"2024-04-25T09:07:38.620809+0000","last_undegraded":"2024-04-25T09:07:38.620809+0000","last_fullsized":"2024-04-25T09:07:38.620809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:03.253872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635044+0000","last_change":"2024-04-25T09:07:37.642388+0000","last_active":"2024-04-25T09:07:38.635044+0000","last_peered":"2024-04-25T09:07:38.635044+0000","last_clean":"2024-04-25T09:07:38.635044+0000","last_became_active":"2024-04-25T09:07:37.641673+0000","last_became_peered":"2024-04-25T09:07:37.641673+0000","last_unstale":"2024-04-25T09:07:38.635044+0000","last_undegraded":"2024-04-25T09:07:38.635044+0000","last_fullsized":"2024-04-25T09:07:38.635044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:01.788399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621200+0000","last_change":"2024-04-25T09:07:36.616454+0000","last_active":"2024-04-25T09:07:38.621200+0000","last_peered":"2024-04-25T09:07:38.621200+0000","last_clean":"2024-04-25T09:07:38.621200+0000","last_became_active":"2024-04-25T09:07:36.616058+0000","last_became_peered":"2024-04-25T09:07:36.616058+0000","last_unstale":"2024-04-25T09:07:38.621200+0000","last_undegraded":"2024-04-25T09:07:38.621200+0000","last_fullsized":"2024-04-25T09:07:38.621200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:19.115185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635202+0000","last_change":"2024-04-25T09:07:37.645238+0000","last_active":"2024-04-25T09:07:38.635202+0000","last_peered":"2024-04-25T09:07:38.635202+0000","last_clean":"2024-04-25T09:07:38.635202+0000","last_became_active":"2024-04-25T09:07:37.644352+0000","last_became_peered":"2024-04-25T09:07:37.644352+0000","last_unstale":"2024-04-25T09:07:38.635202+0000","last_undegraded":"2024-04-25T09:07:38.635202+0000","last_fullsized":"2024-04-25T09:07:38.635202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.374955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.644227+0000","last_change":"2024-04-25T09:07:36.610047+0000","last_active":"2024-04-25T09:07:37.644227+0000","last_peered":"2024-04-25T09:07:37.644227+0000","last_clean":"2024-04-25T09:07:37.644227+0000","last_became_active":"2024-04-25T09:07:36.609786+0000","last_became_peered":"2024-04-25T09:07:36.609786+0000","last_unstale":"2024-04-25T09:07:37.644227+0000","last_undegraded":"2024-04-25T09:07:37.644227+0000","last_fullsized":"2024-04-25T09:07:37.644227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:14.391941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621584+0000","last_change":"2024-04-25T09:07:37.617101+0000","last_active":"2024-04-25T09:07:38.621584+0000","last_peered":"2024-04-25T09:07:38.621584+0000","last_clean":"2024-04-25T09:07:38.621584+0000","last_became_active":"2024-04-25T09:07:37.616000+0000","last_became_peered":"2024-04-25T09:07:37.616000+0000","last_unstale":"2024-04-25T09:07:38.621584+0000","last_undegraded":"2024-04-25T09:07:38.621584+0000","last_fullsized":"2024-04-25T09:07:38.621584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:55.162579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634902+0000","last_change":"2024-04-25T09:07:36.614605+0000","last_active":"2024-04-25T09:07:38.634902+0000","last_peered":"2024-04-25T09:07:38.634902+0000","last_clean":"2024-04-25T09:07:38.634902+0000","last_became_active":"2024-04-25T09:07:36.614349+0000","last_became_peered":"2024-04-25T09:07:36.614349+0000","last_unstale":"2024-04-25T09:07:38.634902+0000","last_undegraded":"2024-04-25T09:07:38.634902+0000","last_fullsized":"2024-04-25T09:07:38.634902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:39.401019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621551+0000","last_change":"2024-04-25T09:07:37.642318+0000","last_active":"2024-04-25T09:07:38.621551+0000","last_peered":"2024-04-25T09:07:38.621551+0000","last_clean":"2024-04-25T09:07:38.621551+0000","last_became_active":"2024-04-25T09:07:37.641879+0000","last_became_peered":"2024-04-25T09:07:37.641879+0000","last_unstale":"2024-04-25T09:07:38.621551+0000","last_undegraded":"2024-04-25T09:07:38.621551+0000","last_fullsized":"2024-04-25T09:07:38.621551+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:33.063248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637137+0000","last_change":"2024-04-25T09:07:36.616980+0000","last_active":"2024-04-25T09:07:38.637137+0000","last_peered":"2024-04-25T09:07:38.637137+0000","last_clean":"2024-04-25T09:07:38.637137+0000","last_became_active":"2024-04-25T09:07:36.616698+0000","last_became_peered":"2024-04-25T09:07:36.616698+0000","last_unstale":"2024-04-25T09:07:38.637137+0000","last_undegraded":"2024-04-25T09:07:38.637137+0000","last_fullsized":"2024-04-25T09:07:38.637137+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:05.199952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634687+0000","last_change":"2024-04-25T09:07:37.618246+0000","last_active":"2024-04-25T09:07:38.634687+0000","last_peered":"2024-04-25T09:07:38.634687+0000","last_clean":"2024-04-25T09:07:38.634687+0000","last_became_active":"2024-04-25T09:07:37.617992+0000","last_became_peered":"2024-04-25T09:07:37.617992+0000","last_unstale":"2024-04-25T09:07:38.634687+0000","last_undegraded":"2024-04-25T09:07:38.634687+0000","last_fullsized":"2024-04-25T09:07:38.634687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:15.922910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.625601+0000","last_change":"2024-04-25T09:07:36.623042+0000","last_active":"2024-04-25T09:07:36.625601+0000","last_peered":"2024-04-25T09:07:36.625601+0000","last_clean":"2024-04-25T09:07:36.625601+0000","last_became_active":"2024-04-25T09:07:36.622793+0000","last_became_peered":"2024-04-25T09:07:36.622793+0000","last_unstale":"2024-04-25T09:07:36.625601+0000","last_undegraded":"2024-04-25T09:07:36.625601+0000","last_fullsized":"2024-04-25T09:07:36.625601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:52.551723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631331+0000","last_change":"2024-04-25T09:07:37.629312+0000","last_active":"2024-04-25T09:07:37.631331+0000","last_peered":"2024-04-25T09:07:37.631331+0000","last_clean":"2024-04-25T09:07:37.631331+0000","last_became_active":"2024-04-25T09:07:37.627276+0000","last_became_peered":"2024-04-25T09:07:37.627276+0000","last_unstale":"2024-04-25T09:07:37.631331+0000","last_undegraded":"2024-04-25T09:07:37.631331+0000","last_fullsized":"2024-04-25T09:07:37.631331+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:38.473267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.621587+0000","last_change":"2024-04-25T09:07:36.613966+0000","last_active":"2024-04-25T09:07:37.621587+0000","last_peered":"2024-04-25T09:07:37.621587+0000","last_clean":"2024-04-25T09:07:37.621587+0000","last_became_active":"2024-04-25T09:07:36.613700+0000","last_became_peered":"2024-04-25T09:07:36.613700+0000","last_unstale":"2024-04-25T09:07:37.621587+0000","last_undegraded":"2024-04-25T09:07:37.621587+0000","last_fullsized":"2024-04-25T09:07:37.621587+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:56.184210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620920+0000","last_change":"2024-04-25T09:07:37.624293+0000","last_active":"2024-04-25T09:07:38.620920+0000","last_peered":"2024-04-25T09:07:38.620920+0000","last_clean":"2024-04-25T09:07:38.620920+0000","last_became_active":"2024-04-25T09:07:37.624036+0000","last_became_peered":"2024-04-25T09:07:37.624036+0000","last_unstale":"2024-04-25T09:07:38.620920+0000","last_undegraded":"2024-04-25T09:07:38.620920+0000","last_fullsized":"2024-04-25T09:07:38.620920+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:34.726656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"83'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637768+0000","last_change":"2024-04-25T09:07:36.621681+0000","last_active":"2024-04-25T09:07:38.637768+0000","last_peered":"2024-04-25T09:07:38.637768+0000","last_clean":"2024-04-25T09:07:38.637768+0000","last_became_active":"2024-04-25T09:07:36.621425+0000","last_became_peered":"2024-04-25T09:07:36.621425+0000","last_unstale":"2024-04-25T09:07:38.637768+0000","last_undegraded":"2024-04-25T09:07:38.637768+0000","last_fullsized":"2024-04-25T09:07:38.637768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:12.826909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.638070+0000","last_change":"2024-04-25T09:07:37.631958+0000","last_active":"2024-04-25T09:07:37.638070+0000","last_peered":"2024-04-25T09:07:37.638070+0000","last_clean":"2024-04-25T09:07:37.638070+0000","last_became_active":"2024-04-25T09:07:37.631694+0000","last_became_peered":"2024-04-25T09:07:37.631694+0000","last_unstale":"2024-04-25T09:07:37.638070+0000","last_undegraded":"2024-04-25T09:07:37.638070+0000","last_fullsized":"2024-04-25T09:07:37.638070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:16.140878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"83'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620920+0000","last_change":"2024-04-25T09:07:36.605032+0000","last_active":"2024-04-25T09:07:38.620920+0000","last_peered":"2024-04-25T09:07:38.620920+0000","last_clean":"2024-04-25T09:07:38.620920+0000","last_became_active":"2024-04-25T09:07:36.603703+0000","last_became_peered":"2024-04-25T09:07:36.603703+0000","last_unstale":"2024-04-25T09:07:38.620920+0000","last_undegraded":"2024-04-25T09:07:38.620920+0000","last_fullsized":"2024-04-25T09:07:38.620920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:45.239647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631261+0000","last_change":"2024-04-25T09:07:37.628226+0000","last_active":"2024-04-25T09:07:37.631261+0000","last_peered":"2024-04-25T09:07:37.631261+0000","last_clean":"2024-04-25T09:07:37.631261+0000","last_became_active":"2024-04-25T09:07:37.625863+0000","last_became_peered":"2024-04-25T09:07:37.625863+0000","last_unstale":"2024-04-25T09:07:37.631261+0000","last_undegraded":"2024-04-25T09:07:37.631261+0000","last_fullsized":"2024-04-25T09:07:37.631261+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:33.063248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.641096+0000","last_change":"2024-04-25T09:07:36.611263+0000","last_active":"2024-04-25T09:07:37.641096+0000","last_peered":"2024-04-25T09:07:37.641096+0000","last_clean":"2024-04-25T09:07:37.641096+0000","last_became_active":"2024-04-25T09:07:36.610934+0000","last_became_peered":"2024-04-25T09:07:36.610934+0000","last_unstale":"2024-04-25T09:07:37.641096+0000","last_undegraded":"2024-04-25T09:07:37.641096+0000","last_fullsized":"2024-04-25T09:07:37.641096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:32.093652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621017+0000","last_change":"2024-04-25T09:07:37.625227+0000","last_active":"2024-04-25T09:07:38.621017+0000","last_peered":"2024-04-25T09:07:38.621017+0000","last_clean":"2024-04-25T09:07:38.621017+0000","last_became_active":"2024-04-25T09:07:37.624685+0000","last_became_peered":"2024-04-25T09:07:37.624685+0000","last_unstale":"2024-04-25T09:07:38.621017+0000","last_undegraded":"2024-04-25T09:07:38.621017+0000","last_fullsized":"2024-04-25T09:07:38.621017+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:15.398932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.625219+0000","last_change":"2024-04-25T09:07:36.620051+0000","last_active":"2024-04-25T09:07:36.625219+0000","last_peered":"2024-04-25T09:07:36.625219+0000","last_clean":"2024-04-25T09:07:36.625219+0000","last_became_active":"2024-04-25T09:07:36.619717+0000","last_became_peered":"2024-04-25T09:07:36.619717+0000","last_unstale":"2024-04-25T09:07:36.625219+0000","last_undegraded":"2024-04-25T09:07:36.625219+0000","last_fullsized":"2024-04-25T09:07:36.625219+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:58.842729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620865+0000","last_change":"2024-04-25T09:07:37.623281+0000","last_active":"2024-04-25T09:07:38.620865+0000","last_peered":"2024-04-25T09:07:38.620865+0000","last_clean":"2024-04-25T09:07:38.620865+0000","last_became_active":"2024-04-25T09:07:37.622461+0000","last_became_peered":"2024-04-25T09:07:37.622461+0000","last_unstale":"2024-04-25T09:07:38.620865+0000","last_undegraded":"2024-04-25T09:07:38.620865+0000","last_fullsized":"2024-04-25T09:07:38.620865+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:33.100643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637133+0000","last_change":"2024-04-25T09:07:36.617283+0000","last_active":"2024-04-25T09:07:38.637133+0000","last_peered":"2024-04-25T09:07:38.637133+0000","last_clean":"2024-04-25T09:07:38.637133+0000","last_became_active":"2024-04-25T09:07:36.615973+0000","last_became_peered":"2024-04-25T09:07:36.615973+0000","last_unstale":"2024-04-25T09:07:38.637133+0000","last_undegraded":"2024-04-25T09:07:38.637133+0000","last_fullsized":"2024-04-25T09:07:38.637133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:08.020375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621771+0000","last_change":"2024-04-25T09:07:37.628648+0000","last_active":"2024-04-25T09:07:38.621771+0000","last_peered":"2024-04-25T09:07:38.621771+0000","last_clean":"2024-04-25T09:07:38.621771+0000","last_became_active":"2024-04-25T09:07:37.627443+0000","last_became_peered":"2024-04-25T09:07:37.627443+0000","last_unstale":"2024-04-25T09:07:38.621771+0000","last_undegraded":"2024-04-25T09:07:38.621771+0000","last_fullsized":"2024-04-25T09:07:38.621771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:21.781597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"83'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634813+0000","last_change":"2024-04-25T09:07:36.601617+0000","last_active":"2024-04-25T09:07:38.634813+0000","last_peered":"2024-04-25T09:07:38.634813+0000","last_clean":"2024-04-25T09:07:38.634813+0000","last_became_active":"2024-04-25T09:07:36.601323+0000","last_became_peered":"2024-04-25T09:07:36.601323+0000","last_unstale":"2024-04-25T09:07:38.634813+0000","last_undegraded":"2024-04-25T09:07:38.634813+0000","last_fullsized":"2024-04-25T09:07:38.634813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:41.678865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620974+0000","last_change":"2024-04-25T09:07:37.627836+0000","last_active":"2024-04-25T09:07:38.620974+0000","last_peered":"2024-04-25T09:07:38.620974+0000","last_clean":"2024-04-25T09:07:38.620974+0000","last_became_active":"2024-04-25T09:07:37.627568+0000","last_became_peered":"2024-04-25T09:07:37.627568+0000","last_unstale":"2024-04-25T09:07:38.620974+0000","last_undegraded":"2024-04-25T09:07:38.620974+0000","last_fullsized":"2024-04-25T09:07:38.620974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:56.952875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.625246+0000","last_change":"2024-04-25T09:07:36.621694+0000","last_active":"2024-04-25T09:07:36.625246+0000","last_peered":"2024-04-25T09:07:36.625246+0000","last_clean":"2024-04-25T09:07:36.625246+0000","last_became_active":"2024-04-25T09:07:36.621503+0000","last_became_peered":"2024-04-25T09:07:36.621503+0000","last_unstale":"2024-04-25T09:07:36.625246+0000","last_undegraded":"2024-04-25T09:07:36.625246+0000","last_fullsized":"2024-04-25T09:07:36.625246+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:18.001799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637180+0000","last_change":"2024-04-25T09:07:37.635114+0000","last_active":"2024-04-25T09:07:38.637180+0000","last_peered":"2024-04-25T09:07:38.637180+0000","last_clean":"2024-04-25T09:07:38.637180+0000","last_became_active":"2024-04-25T09:07:37.634833+0000","last_became_peered":"2024-04-25T09:07:37.634833+0000","last_unstale":"2024-04-25T09:07:38.637180+0000","last_undegraded":"2024-04-25T09:07:38.637180+0000","last_fullsized":"2024-04-25T09:07:38.637180+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:53.605713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621693+0000","last_change":"2024-04-25T09:07:36.616078+0000","last_active":"2024-04-25T09:07:38.621693+0000","last_peered":"2024-04-25T09:07:38.621693+0000","last_clean":"2024-04-25T09:07:38.621693+0000","last_became_active":"2024-04-25T09:07:36.615403+0000","last_became_peered":"2024-04-25T09:07:36.615403+0000","last_unstale":"2024-04-25T09:07:38.621693+0000","last_undegraded":"2024-04-25T09:07:38.621693+0000","last_fullsized":"2024-04-25T09:07:38.621693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:15.009651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637101+0000","last_change":"2024-04-25T09:07:37.646400+0000","last_active":"2024-04-25T09:07:38.637101+0000","last_peered":"2024-04-25T09:07:38.637101+0000","last_clean":"2024-04-25T09:07:38.637101+0000","last_became_active":"2024-04-25T09:07:37.646129+0000","last_became_peered":"2024-04-25T09:07:37.646129+0000","last_unstale":"2024-04-25T09:07:38.637101+0000","last_undegraded":"2024-04-25T09:07:38.637101+0000","last_fullsized":"2024-04-25T09:07:38.637101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:02.389276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637780+0000","last_change":"2024-04-25T09:07:36.617644+0000","last_active":"2024-04-25T09:07:38.637780+0000","last_peered":"2024-04-25T09:07:38.637780+0000","last_clean":"2024-04-25T09:07:38.637780+0000","last_became_active":"2024-04-25T09:07:36.616325+0000","last_became_peered":"2024-04-25T09:07:36.616325+0000","last_unstale":"2024-04-25T09:07:38.637780+0000","last_undegraded":"2024-04-25T09:07:38.637780+0000","last_fullsized":"2024-04-25T09:07:38.637780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:31.620809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620896+0000","last_change":"2024-04-25T09:07:37.639937+0000","last_active":"2024-04-25T09:07:38.620896+0000","last_peered":"2024-04-25T09:07:38.620896+0000","last_clean":"2024-04-25T09:07:38.620896+0000","last_became_active":"2024-04-25T09:07:37.633606+0000","last_became_peered":"2024-04-25T09:07:37.633606+0000","last_unstale":"2024-04-25T09:07:38.620896+0000","last_undegraded":"2024-04-25T09:07:38.620896+0000","last_fullsized":"2024-04-25T09:07:38.620896+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:03.532182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.617233+0000","last_change":"2024-04-25T09:07:36.622372+0000","last_active":"2024-04-25T09:07:37.617233+0000","last_peered":"2024-04-25T09:07:37.617233+0000","last_clean":"2024-04-25T09:07:37.617233+0000","last_became_active":"2024-04-25T09:07:36.622088+0000","last_became_peered":"2024-04-25T09:07:36.622088+0000","last_unstale":"2024-04-25T09:07:37.617233+0000","last_undegraded":"2024-04-25T09:07:37.617233+0000","last_fullsized":"2024-04-25T09:07:37.617233+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:35.244653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635171+0000","last_change":"2024-04-25T09:07:37.629723+0000","last_active":"2024-04-25T09:07:38.635171+0000","last_peered":"2024-04-25T09:07:38.635171+0000","last_clean":"2024-04-25T09:07:38.635171+0000","last_became_active":"2024-04-25T09:07:37.629081+0000","last_became_peered":"2024-04-25T09:07:37.629081+0000","last_unstale":"2024-04-25T09:07:38.635171+0000","last_undegraded":"2024-04-25T09:07:38.635171+0000","last_fullsized":"2024-04-25T09:07:38.635171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:36.626956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620850+0000","last_change":"2024-04-25T09:07:36.619552+0000","last_active":"2024-04-25T09:07:38.620850+0000","last_peered":"2024-04-25T09:07:38.620850+0000","last_clean":"2024-04-25T09:07:38.620850+0000","last_became_active":"2024-04-25T09:07:36.619248+0000","last_became_peered":"2024-04-25T09:07:36.619248+0000","last_unstale":"2024-04-25T09:07:38.620850+0000","last_undegraded":"2024-04-25T09:07:38.620850+0000","last_fullsized":"2024-04-25T09:07:38.620850+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:17.681967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635263+0000","last_change":"2024-04-25T09:07:37.622142+0000","last_active":"2024-04-25T09:07:38.635263+0000","last_peered":"2024-04-25T09:07:38.635263+0000","last_clean":"2024-04-25T09:07:38.635263+0000","last_became_active":"2024-04-25T09:07:37.621887+0000","last_became_peered":"2024-04-25T09:07:37.621887+0000","last_unstale":"2024-04-25T09:07:38.635263+0000","last_undegraded":"2024-04-25T09:07:38.635263+0000","last_fullsized":"2024-04-25T09:07:38.635263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:53.134215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620629+0000","last_change":"2024-04-25T09:07:36.611689+0000","last_active":"2024-04-25T09:07:38.620629+0000","last_peered":"2024-04-25T09:07:38.620629+0000","last_clean":"2024-04-25T09:07:38.620629+0000","last_became_active":"2024-04-25T09:07:36.611363+0000","last_became_peered":"2024-04-25T09:07:36.611363+0000","last_unstale":"2024-04-25T09:07:38.620629+0000","last_undegraded":"2024-04-25T09:07:38.620629+0000","last_fullsized":"2024-04-25T09:07:38.620629+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:14.915918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621924+0000","last_change":"2024-04-25T09:07:37.627431+0000","last_active":"2024-04-25T09:07:38.621924+0000","last_peered":"2024-04-25T09:07:38.621924+0000","last_clean":"2024-04-25T09:07:38.621924+0000","last_became_active":"2024-04-25T09:07:37.627171+0000","last_became_peered":"2024-04-25T09:07:37.627171+0000","last_unstale":"2024-04-25T09:07:38.621924+0000","last_undegraded":"2024-04-25T09:07:38.621924+0000","last_fullsized":"2024-04-25T09:07:38.621924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:38.473267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620530+0000","last_change":"2024-04-25T09:07:36.614988+0000","last_active":"2024-04-25T09:07:38.620530+0000","last_peered":"2024-04-25T09:07:38.620530+0000","last_clean":"2024-04-25T09:07:38.620530+0000","last_became_active":"2024-04-25T09:07:36.614690+0000","last_became_peered":"2024-04-25T09:07:36.614690+0000","last_unstale":"2024-04-25T09:07:38.620530+0000","last_undegraded":"2024-04-25T09:07:38.620530+0000","last_fullsized":"2024-04-25T09:07:38.620530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:24.432090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621771+0000","last_change":"2024-04-25T09:07:37.621882+0000","last_active":"2024-04-25T09:07:38.621771+0000","last_peered":"2024-04-25T09:07:38.621771+0000","last_clean":"2024-04-25T09:07:38.621771+0000","last_became_active":"2024-04-25T09:07:37.621628+0000","last_became_peered":"2024-04-25T09:07:37.621628+0000","last_unstale":"2024-04-25T09:07:38.621771+0000","last_undegraded":"2024-04-25T09:07:38.621771+0000","last_fullsized":"2024-04-25T09:07:38.621771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:44.455585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.644170+0000","last_change":"2024-04-25T09:07:36.618544+0000","last_active":"2024-04-25T09:07:37.644170+0000","last_peered":"2024-04-25T09:07:37.644170+0000","last_clean":"2024-04-25T09:07:37.644170+0000","last_became_active":"2024-04-25T09:07:36.618264+0000","last_became_peered":"2024-04-25T09:07:36.618264+0000","last_unstale":"2024-04-25T09:07:37.644170+0000","last_undegraded":"2024-04-25T09:07:37.644170+0000","last_fullsized":"2024-04-25T09:07:37.644170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:23.388413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621069+0000","last_change":"2024-04-25T09:07:37.623868+0000","last_active":"2024-04-25T09:07:38.621069+0000","last_peered":"2024-04-25T09:07:38.621069+0000","last_clean":"2024-04-25T09:07:38.621069+0000","last_became_active":"2024-04-25T09:07:37.623586+0000","last_became_peered":"2024-04-25T09:07:37.623586+0000","last_unstale":"2024-04-25T09:07:38.621069+0000","last_undegraded":"2024-04-25T09:07:38.621069+0000","last_fullsized":"2024-04-25T09:07:38.621069+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:57.191201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"84'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.636608+0000","last_change":"2024-04-25T09:07:36.620391+0000","last_active":"2024-04-25T09:07:38.636608+0000","last_peered":"2024-04-25T09:07:38.636608+0000","last_clean":"2024-04-25T09:07:38.636608+0000","last_became_active":"2024-04-25T09:07:36.619820+0000","last_became_peered":"2024-04-25T09:07:36.619820+0000","last_unstale":"2024-04-25T09:07:38.636608+0000","last_undegraded":"2024-04-25T09:07:38.636608+0000","last_fullsized":"2024-04-25T09:07:38.636608+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:50.109112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621494+0000","last_change":"2024-04-25T09:07:37.621282+0000","last_active":"2024-04-25T09:07:38.621494+0000","last_peered":"2024-04-25T09:07:38.621494+0000","last_clean":"2024-04-25T09:07:38.621494+0000","last_became_active":"2024-04-25T09:07:37.620633+0000","last_became_peered":"2024-04-25T09:07:37.620633+0000","last_unstale":"2024-04-25T09:07:38.621494+0000","last_undegraded":"2024-04-25T09:07:38.621494+0000","last_fullsized":"2024-04-25T09:07:38.621494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:45.953616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.618207+0000","last_change":"2024-04-25T09:07:36.617437+0000","last_active":"2024-04-25T09:07:36.618207+0000","last_peered":"2024-04-25T09:07:36.618207+0000","last_clean":"2024-04-25T09:07:36.618207+0000","last_became_active":"2024-04-25T09:07:36.617117+0000","last_became_peered":"2024-04-25T09:07:36.617117+0000","last_unstale":"2024-04-25T09:07:36.618207+0000","last_undegraded":"2024-04-25T09:07:36.618207+0000","last_fullsized":"2024-04-25T09:07:36.618207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:38.211669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634889+0000","last_change":"2024-04-25T09:07:37.617426+0000","last_active":"2024-04-25T09:07:38.634889+0000","last_peered":"2024-04-25T09:07:38.634889+0000","last_clean":"2024-04-25T09:07:38.634889+0000","last_became_active":"2024-04-25T09:07:37.617172+0000","last_became_peered":"2024-04-25T09:07:37.617172+0000","last_unstale":"2024-04-25T09:07:38.634889+0000","last_undegraded":"2024-04-25T09:07:38.634889+0000","last_fullsized":"2024-04-25T09:07:38.634889+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:10.692785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.622645+0000","last_change":"2024-04-25T09:07:36.619230+0000","last_active":"2024-04-25T09:07:36.622645+0000","last_peered":"2024-04-25T09:07:36.622645+0000","last_clean":"2024-04-25T09:07:36.622645+0000","last_became_active":"2024-04-25T09:07:36.618957+0000","last_became_peered":"2024-04-25T09:07:36.618957+0000","last_unstale":"2024-04-25T09:07:36.622645+0000","last_undegraded":"2024-04-25T09:07:36.622645+0000","last_fullsized":"2024-04-25T09:07:36.622645+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:49.874474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621380+0000","last_change":"2024-04-25T09:07:37.628246+0000","last_active":"2024-04-25T09:07:38.621380+0000","last_peered":"2024-04-25T09:07:38.621380+0000","last_clean":"2024-04-25T09:07:38.621380+0000","last_became_active":"2024-04-25T09:07:37.623529+0000","last_became_peered":"2024-04-25T09:07:37.623529+0000","last_unstale":"2024-04-25T09:07:38.621380+0000","last_undegraded":"2024-04-25T09:07:38.621380+0000","last_fullsized":"2024-04-25T09:07:38.621380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:54.940460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620686+0000","last_change":"2024-04-25T09:07:36.612649+0000","last_active":"2024-04-25T09:07:38.620686+0000","last_peered":"2024-04-25T09:07:38.620686+0000","last_clean":"2024-04-25T09:07:38.620686+0000","last_became_active":"2024-04-25T09:07:36.611900+0000","last_became_peered":"2024-04-25T09:07:36.611900+0000","last_unstale":"2024-04-25T09:07:38.620686+0000","last_undegraded":"2024-04-25T09:07:38.620686+0000","last_fullsized":"2024-04-25T09:07:38.620686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:40.057829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621211+0000","last_change":"2024-04-25T09:07:37.634630+0000","last_active":"2024-04-25T09:07:38.621211+0000","last_peered":"2024-04-25T09:07:38.621211+0000","last_clean":"2024-04-25T09:07:38.621211+0000","last_became_active":"2024-04-25T09:07:37.634242+0000","last_became_peered":"2024-04-25T09:07:37.634242+0000","last_unstale":"2024-04-25T09:07:38.621211+0000","last_undegraded":"2024-04-25T09:07:38.621211+0000","last_fullsized":"2024-04-25T09:07:38.621211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:40.108001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637258+0000","last_change":"2024-04-25T09:07:36.617056+0000","last_active":"2024-04-25T09:07:38.637258+0000","last_peered":"2024-04-25T09:07:38.637258+0000","last_clean":"2024-04-25T09:07:38.637258+0000","last_became_active":"2024-04-25T09:07:36.616846+0000","last_became_peered":"2024-04-25T09:07:36.616846+0000","last_unstale":"2024-04-25T09:07:38.637258+0000","last_undegraded":"2024-04-25T09:07:38.637258+0000","last_fullsized":"2024-04-25T09:07:38.637258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:07.592728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.638281+0000","last_change":"2024-04-25T09:07:37.629289+0000","last_active":"2024-04-25T09:07:37.638281+0000","last_peered":"2024-04-25T09:07:37.638281+0000","last_clean":"2024-04-25T09:07:37.638281+0000","last_became_active":"2024-04-25T09:07:37.629029+0000","last_became_peered":"2024-04-25T09:07:37.629029+0000","last_unstale":"2024-04-25T09:07:37.638281+0000","last_undegraded":"2024-04-25T09:07:37.638281+0000","last_fullsized":"2024-04-25T09:07:37.638281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:33.841194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621190+0000","last_change":"2024-04-25T09:07:36.605134+0000","last_active":"2024-04-25T09:07:38.621190+0000","last_peered":"2024-04-25T09:07:38.621190+0000","last_clean":"2024-04-25T09:07:38.621190+0000","last_became_active":"2024-04-25T09:07:36.604853+0000","last_became_peered":"2024-04-25T09:07:36.604853+0000","last_unstale":"2024-04-25T09:07:38.621190+0000","last_undegraded":"2024-04-25T09:07:38.621190+0000","last_fullsized":"2024-04-25T09:07:38.621190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:44.946625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.639900+0000","last_change":"2024-04-25T09:07:37.635406+0000","last_active":"2024-04-25T09:07:37.639900+0000","last_peered":"2024-04-25T09:07:37.639900+0000","last_clean":"2024-04-25T09:07:37.639900+0000","last_became_active":"2024-04-25T09:07:37.635219+0000","last_became_peered":"2024-04-25T09:07:37.635219+0000","last_unstale":"2024-04-25T09:07:37.639900+0000","last_undegraded":"2024-04-25T09:07:37.639900+0000","last_fullsized":"2024-04-25T09:07:37.639900+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:42.758124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.615985+0000","last_change":"2024-04-25T09:07:36.612144+0000","last_active":"2024-04-25T09:07:37.615985+0000","last_peered":"2024-04-25T09:07:37.615985+0000","last_clean":"2024-04-25T09:07:37.615985+0000","last_became_active":"2024-04-25T09:07:36.610715+0000","last_became_peered":"2024-04-25T09:07:36.610715+0000","last_unstale":"2024-04-25T09:07:37.615985+0000","last_undegraded":"2024-04-25T09:07:37.615985+0000","last_fullsized":"2024-04-25T09:07:37.615985+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:07.868609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2024-04-25T09:07:36.606259+0000","last_change":"2024-04-25T09:07:36.606259+0000","last_active":"2024-04-25T09:07:36.589349+0000","last_peered":"2024-04-25T09:07:36.589349+0000","last_clean":"2024-04-25T09:07:36.589349+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:07:36.606259+0000","last_undegraded":"2024-04-25T09:07:36.606259+0000","last_fullsized":"2024-04-25T09:07:36.606259+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621217+0000","last_change":"2024-04-25T09:07:36.615155+0000","last_active":"2024-04-25T09:07:38.621217+0000","last_peered":"2024-04-25T09:07:38.621217+0000","last_clean":"2024-04-25T09:07:38.621217+0000","last_became_active":"2024-04-25T09:07:36.614868+0000","last_became_peered":"2024-04-25T09:07:36.614868+0000","last_unstale":"2024-04-25T09:07:38.621217+0000","last_undegraded":"2024-04-25T09:07:38.621217+0000","last_fullsized":"2024-04-25T09:07:38.621217+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:09.685794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":280,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T09:07:36.607625+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:07:36.607625+0000","last_peered":"2024-04-25T09:07:36.607625+0000","last_clean":"2024-04-25T09:07:36.607625+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:07:36.607625+0000","last_undegraded":"2024-04-25T09:07:36.607625+0000","last_fullsized":"2024-04-25T09:07:36.607625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1019904,"data_stored":464016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509503,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1011712,"data_stored":462438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509504,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1028096,"data_stored":464120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509503,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1011712,"data_stored":462986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509503,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36344,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335496,"statfs":{"total":96636764160,"available":96599547904,"internally_reserved":0,"allocated":1019904,"data_stored":463146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509504,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1015808,"data_stored":462516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509504,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59120,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312720,"statfs":{"total":96636764160,"available":96576225280,"internally_reserved":0,"allocated":1601536,"data_stored":1052772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36884,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334956,"statfs":{"total":96636764160,"available":96598994944,"internally_reserved":0,"allocated":1576960,"data_stored":1038938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:07:42.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2024-04-25T09:07:42.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:07:36.607014+0000', 'last_change': '2024-04-25T09:07:36.607014+0000', 'last_active': '2024-04-25T09:07:36.589349+0000', 'last_peered': '2024-04-25T09:07:36.589349+0000', 'last_clean': '2024-04-25T09:07:36.589349+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:07:36.607014+0000', 'last_undegraded': '2024-04-25T09:07:36.607014+0000', 'last_fullsized': '2024-04-25T09:07:36.607014+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:07:36.589349+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:07:36.589349+0000', 'last_clean_scrub_stamp': '2024-04-25T09:07:36.589349+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:07:42.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2024-04-25T09:07:42.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:07:36.604384+0000', 'last_change': '2024-04-25T09:07:36.604384+0000', 'last_active': '2024-04-25T09:07:36.589349+0000', 'last_peered': '2024-04-25T09:07:36.589349+0000', 'last_clean': '2024-04-25T09:07:36.589349+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:07:36.604384+0000', 'last_undegraded': '2024-04-25T09:07:36.604384+0000', 'last_fullsized': '2024-04-25T09:07:36.604384+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:07:36.589349+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:07:36.589349+0000', 'last_clean_scrub_stamp': '2024-04-25T09:07:36.589349+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:07:42.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2024-04-25T09:07:42.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:07:36.607030+0000', 'last_change': '2024-04-25T09:07:36.607030+0000', 'last_active': '2024-04-25T09:07:36.589349+0000', 'last_peered': '2024-04-25T09:07:36.589349+0000', 'last_clean': '2024-04-25T09:07:36.589349+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:07:36.607030+0000', 'last_undegraded': '2024-04-25T09:07:36.607030+0000', 'last_fullsized': '2024-04-25T09:07:36.607030+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:07:36.589349+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:07:36.589349+0000', 'last_clean_scrub_stamp': '2024-04-25T09:07:36.589349+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:07:42.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2024-04-25T09:07:42.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:07:36.603398+0000', 'last_change': '2024-04-25T09:07:36.603398+0000', 'last_active': '2024-04-25T09:07:36.589349+0000', 'last_peered': '2024-04-25T09:07:36.589349+0000', 'last_clean': '2024-04-25T09:07:36.589349+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:07:36.603398+0000', 'last_undegraded': '2024-04-25T09:07:36.603398+0000', 'last_fullsized': '2024-04-25T09:07:36.603398+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:07:36.589349+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:07:36.589349+0000', 'last_clean_scrub_stamp': '2024-04-25T09:07:36.589349+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:07:42.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2024-04-25T09:07:42.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:07:36.603941+0000', 'last_change': '2024-04-25T09:07:36.603941+0000', 'last_active': '2024-04-25T09:07:36.589349+0000', 'last_peered': '2024-04-25T09:07:36.589349+0000', 'last_clean': '2024-04-25T09:07:36.589349+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:07:36.603941+0000', 'last_undegraded': '2024-04-25T09:07:36.603941+0000', 'last_fullsized': '2024-04-25T09:07:36.603941+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:07:36.589349+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:07:36.589349+0000', 'last_clean_scrub_stamp': '2024-04-25T09:07:36.589349+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:07:42.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2024-04-25T09:07:42.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:07:36.606259+0000', 'last_change': '2024-04-25T09:07:36.606259+0000', 'last_active': '2024-04-25T09:07:36.589349+0000', 'last_peered': '2024-04-25T09:07:36.589349+0000', 'last_clean': '2024-04-25T09:07:36.589349+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:07:36.606259+0000', 'last_undegraded': '2024-04-25T09:07:36.606259+0000', 'last_fullsized': '2024-04-25T09:07:36.606259+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:07:36.589349+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:07:36.589349+0000', 'last_clean_scrub_stamp': '2024-04-25T09:07:36.589349+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:07:42.425 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:07:42.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.610+0000 7fd46b600640 1 Processor -- start 2024-04-25T09:07:42.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.610+0000 7fd46b600640 1 -- start start 2024-04-25T09:07:42.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.610+0000 7fd46b600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd46415dc60 0x7fd4640b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.610+0000 7fd46b600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd46415e040 0x7fd4640ace10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.610+0000 7fd46b600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640ad350 0x7fd4640ae810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.610+0000 7fd46b600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd464071450 con 0x7fd46415dc60 2024-04-25T09:07:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.610+0000 7fd46b600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46415e8e0 con 0x7fd46415e040 2024-04-25T09:07:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.610+0000 7fd46b600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46415ebc0 con 0x7fd4640ad350 2024-04-25T09:07:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.610+0000 7fd468c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd46415dc60 0x7fd4640b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.610+0000 7fd468c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd46415dc60 0x7fd4640b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41604/0 (socket says 172.21.15.173:41604) 2024-04-25T09:07:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.610+0000 7fd468c00640 1 -- 172.21.15.173:0/2229433907 learned_addr learned my addr 172.21.15.173:0/2229433907 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.610+0000 7fd45be00640 1 --2- 172.21.15.173:0/2229433907 >> v2:172.21.15.194:3300/0 conn(0x7fd46415e040 0x7fd4640ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.610+0000 7fd469600640 1 --2- 172.21.15.173:0/2229433907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640ad350 0x7fd4640ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.614+0000 7fd468c00640 1 -- 172.21.15.173:0/2229433907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640ad350 msgr2=0x7fd4640ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.614+0000 7fd468c00640 1 --2- 172.21.15.173:0/2229433907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640ad350 0x7fd4640ae810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.614+0000 7fd468c00640 1 -- 172.21.15.173:0/2229433907 >> v2:172.21.15.194:3300/0 conn(0x7fd46415e040 msgr2=0x7fd4640ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:42.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.614+0000 7fd468c00640 1 --2- 172.21.15.173:0/2229433907 >> v2:172.21.15.194:3300/0 conn(0x7fd46415e040 0x7fd4640ace10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.614+0000 7fd468c00640 1 -- 172.21.15.173:0/2229433907 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46415eea0 con 0x7fd46415dc60 2024-04-25T09:07:42.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.614+0000 7fd468c00640 1 --2- 172.21.15.173:0/2229433907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46415dc60 0x7fd4640b3710 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fd4641628b0 tx=0x7fd45401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2113ca04b0195807 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:42.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.614+0000 7fd463e00640 1 -- 172.21.15.173:0/2229433907 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540b0070 con 0x7fd46415dc60 2024-04-25T09:07:42.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.614+0000 7fd463e00640 1 -- 172.21.15.173:0/2229433907 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4540ab600 con 0x7fd46415dc60 2024-04-25T09:07:42.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.614+0000 7fd463e00640 1 -- 172.21.15.173:0/2229433907 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540ab9d0 con 0x7fd46415dc60 2024-04-25T09:07:42.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.614+0000 7fd46b600640 1 -- 172.21.15.173:0/2229433907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46415dc60 msgr2=0x7fd4640b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.614+0000 7fd46b600640 1 --2- 172.21.15.173:0/2229433907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46415dc60 0x7fd4640b3710 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fd4641628b0 tx=0x7fd45401c520 comp rx=0 tx=0).stop 2024-04-25T09:07:42.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.614+0000 7fd46b600640 1 -- 172.21.15.173:0/2229433907 shutdown_connections 2024-04-25T09:07:42.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.614+0000 7fd46b600640 1 --2- 172.21.15.173:0/2229433907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640ad350 0x7fd4640ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.614+0000 7fd46b600640 1 --2- 172.21.15.173:0/2229433907 >> v2:172.21.15.194:3300/0 conn(0x7fd46415e040 0x7fd4640ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.614+0000 7fd46b600640 1 --2- 172.21.15.173:0/2229433907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46415dc60 0x7fd4640b3710 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.614+0000 7fd46b600640 1 -- 172.21.15.173:0/2229433907 >> 172.21.15.173:0/2229433907 conn(0x7fd46406ac90 msgr2=0x7fd46406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:42.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.614+0000 7fd46b600640 1 -- 172.21.15.173:0/2229433907 shutdown_connections 2024-04-25T09:07:42.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.614+0000 7fd46b600640 1 -- 172.21.15.173:0/2229433907 wait complete. 2024-04-25T09:07:42.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd46b600640 1 Processor -- start 2024-04-25T09:07:42.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd46b600640 1 -- start start 2024-04-25T09:07:42.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd46b600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640ad350 0x7fd4640cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd46b600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46415dc60 0x7fd46406d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd46b600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd46415e040 0x7fd46406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd46b600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd464161810 con 0x7fd46415dc60 2024-04-25T09:07:42.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd46b600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46415e660 con 0x7fd46415e040 2024-04-25T09:07:42.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd46b600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd464161990 con 0x7fd4640ad350 2024-04-25T09:07:42.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd45be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46415dc60 0x7fd46406d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd45be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46415dc60 0x7fd46406d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41608/0 (socket says 172.21.15.173:41608) 2024-04-25T09:07:42.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd45be00640 1 -- 172.21.15.173:0/2314203136 learned_addr learned my addr 172.21.15.173:0/2314203136 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:42.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd469600640 1 --2- 172.21.15.173:0/2314203136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd46415e040 0x7fd46406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd468c00640 1 --2- 172.21.15.173:0/2314203136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640ad350 0x7fd4640cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd45be00640 1 -- 172.21.15.173:0/2314203136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640ad350 msgr2=0x7fd4640cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd45be00640 1 --2- 172.21.15.173:0/2314203136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640ad350 0x7fd4640cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd45be00640 1 -- 172.21.15.173:0/2314203136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd46415e040 msgr2=0x7fd46406de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd45be00640 1 --2- 172.21.15.173:0/2314203136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd46415e040 0x7fd46406de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd45be00640 1 -- 172.21.15.173:0/2314203136 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4641fa3e0 con 0x7fd46415dc60 2024-04-25T09:07:42.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd45be00640 1 --2- 172.21.15.173:0/2314203136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46415dc60 0x7fd46406d940 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00d650 tx=0x7fd44c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:42.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd461600640 1 -- 172.21.15.173:0/2314203136 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c00b6c0 con 0x7fd46415dc60 2024-04-25T09:07:42.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd461600640 1 -- 172.21.15.173:0/2314203136 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c019070 con 0x7fd46415dc60 2024-04-25T09:07:42.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd46b600640 1 -- 172.21.15.173:0/2314203136 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4641fa6c0 con 0x7fd46415dc60 2024-04-25T09:07:42.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd461600640 1 -- 172.21.15.173:0/2314203136 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c00ba80 con 0x7fd46415dc60 2024-04-25T09:07:42.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.618+0000 7fd46b600640 1 -- 172.21.15.173:0/2314203136 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4641fac80 con 0x7fd46415dc60 2024-04-25T09:07:42.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.622+0000 7fd46b600640 1 -- 172.21.15.173:0/2314203136 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd464073a40 con 0x7fd46415dc60 2024-04-25T09:07:42.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.622+0000 7fd461600640 1 -- 172.21.15.173:0/2314203136 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd44c00bc20 con 0x7fd46415dc60 2024-04-25T09:07:42.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.622+0000 7fd461600640 1 --2- 172.21.15.173:0/2314203136 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd440066f90 0x7fd440069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.622+0000 7fd461600640 1 -- 172.21.15.173:0/2314203136 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd44c085590 con 0x7fd46415dc60 2024-04-25T09:07:42.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.622+0000 7fd468c00640 1 --2- 172.21.15.173:0/2314203136 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd440066f90 0x7fd440069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.622+0000 7fd468c00640 1 --2- 172.21.15.173:0/2314203136 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd440066f90 0x7fd440069450 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd4540ad000 tx=0x7fd454008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:42.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.626+0000 7fd461600640 1 -- 172.21.15.173:0/2314203136 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd44c056400 con 0x7fd46415dc60 2024-04-25T09:07:42.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.838+0000 7fd46b600640 1 -- 172.21.15.173:0/2314203136 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd4640b37b0 con 0x7fd46415dc60 2024-04-25T09:07:42.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.838+0000 7fd461600640 1 -- 172.21.15.173:0/2314203136 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1648 (secure 0 0 0) 0x7fd44c055d00 con 0x7fd46415dc60 2024-04-25T09:07:42.824 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:42.824 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":317,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":84,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":91},{"state_name":"creating+peering","count":6}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592756,"bytes_used":330100736,"bytes_avail":772764012544,"bytes_total":773094113280,"inactive_pgs_ratio":0.061855670064687729,"write_bytes_sec":2560,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":55,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":7263}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-04-25T09:07:24.786795+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:07:42.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.838+0000 7fd46b600640 1 -- 172.21.15.173:0/2314203136 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd440066f90 msgr2=0x7fd440069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.838+0000 7fd46b600640 1 --2- 172.21.15.173:0/2314203136 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd440066f90 0x7fd440069450 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd4540ad000 tx=0x7fd454008040 comp rx=0 tx=0).stop 2024-04-25T09:07:42.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.838+0000 7fd46b600640 1 -- 172.21.15.173:0/2314203136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46415dc60 msgr2=0x7fd46406d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.838+0000 7fd46b600640 1 --2- 172.21.15.173:0/2314203136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46415dc60 0x7fd46406d940 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00d650 tx=0x7fd44c00db10 comp rx=0 tx=0).stop 2024-04-25T09:07:42.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.838+0000 7fd46b600640 1 -- 172.21.15.173:0/2314203136 shutdown_connections 2024-04-25T09:07:42.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.838+0000 7fd46b600640 1 --2- 172.21.15.173:0/2314203136 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd440066f90 0x7fd440069450 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.838+0000 7fd46b600640 1 --2- 172.21.15.173:0/2314203136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd46415e040 0x7fd46406de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.838+0000 7fd46b600640 1 --2- 172.21.15.173:0/2314203136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46415dc60 0x7fd46406d940 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.838+0000 7fd46b600640 1 --2- 172.21.15.173:0/2314203136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640ad350 0x7fd4640cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.838+0000 7fd46b600640 1 -- 172.21.15.173:0/2314203136 >> 172.21.15.173:0/2314203136 conn(0x7fd46406ac90 msgr2=0x7fd4640cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:42.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.838+0000 7fd46b600640 1 -- 172.21.15.173:0/2314203136 shutdown_connections 2024-04-25T09:07:42.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.838+0000 7fd46b600640 1 -- 172.21.15.173:0/2314203136 wait complete. 2024-04-25T09:07:42.845 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:07:42.845 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:07:42.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.994+0000 7efd58600640 1 Processor -- start 2024-04-25T09:07:42.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.994+0000 7efd58600640 1 -- start start 2024-04-25T09:07:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.994+0000 7efd58600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efd50145250 0x7efd5015c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.994+0000 7efd58600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efd500cc8b0 0x7efd500ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.994+0000 7efd58600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5015cec0 con 0x7efd50071320 2024-04-25T09:07:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.994+0000 7efd58600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5006e7c0 con 0x7efd500cc8b0 2024-04-25T09:07:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.994+0000 7efd58600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5006d720 con 0x7efd50145250 2024-04-25T09:07:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.994+0000 7efd55200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efd500cc8b0 0x7efd500ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.994+0000 7efd55200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efd500cc8b0 0x7efd500ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41624/0 (socket says 172.21.15.173:41624) 2024-04-25T09:07:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.994+0000 7efd55200640 1 -- 172.21.15.173:0/2004391790 learned_addr learned my addr 172.21.15.173:0/2004391790 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.994+0000 7efd55c00640 1 --2- 172.21.15.173:0/2004391790 >> v2:172.21.15.194:3300/0 conn(0x7efd50145250 0x7efd5015c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.994+0000 7efd55200640 1 -- 172.21.15.173:0/2004391790 >> v2:172.21.15.194:3300/0 conn(0x7efd50145250 msgr2=0x7efd5015c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.994+0000 7efd55200640 1 --2- 172.21.15.173:0/2004391790 >> v2:172.21.15.194:3300/0 conn(0x7efd50145250 0x7efd5015c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.994+0000 7efd55200640 1 -- 172.21.15.173:0/2004391790 >> v1:172.21.15.194:6789/0 conn(0x7efd50071320 legacy=0x7efd50071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.994+0000 7efd55200640 1 -- 172.21.15.173:0/2004391790 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5006da00 con 0x7efd500cc8b0 2024-04-25T09:07:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.994+0000 7efd55c00640 1 --2- 172.21.15.173:0/2004391790 >> v2:172.21.15.194:3300/0 conn(0x7efd50145250 0x7efd5015c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:42.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.998+0000 7efd55200640 1 --2- 172.21.15.173:0/2004391790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd500cc8b0 0x7efd500ccd30 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7efd500d0420 tx=0x7efd3c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5816d91127f1fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:42.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.998+0000 7efd4fe00640 1 -- 172.21.15.173:0/2004391790 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c0ab610 con 0x7efd500cc8b0 2024-04-25T09:07:42.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.998+0000 7efd4fe00640 1 -- 172.21.15.173:0/2004391790 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3c0b0070 con 0x7efd500cc8b0 2024-04-25T09:07:42.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.998+0000 7efd4fe00640 1 -- 172.21.15.173:0/2004391790 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c0ab9d0 con 0x7efd500cc8b0 2024-04-25T09:07:42.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.998+0000 7efd58600640 1 -- 172.21.15.173:0/2004391790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd500cc8b0 msgr2=0x7efd500ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.998+0000 7efd58600640 1 --2- 172.21.15.173:0/2004391790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd500cc8b0 0x7efd500ccd30 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7efd500d0420 tx=0x7efd3c01c520 comp rx=0 tx=0).stop 2024-04-25T09:07:42.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.998+0000 7efd58600640 1 -- 172.21.15.173:0/2004391790 shutdown_connections 2024-04-25T09:07:42.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.998+0000 7efd58600640 1 --2- 172.21.15.173:0/2004391790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd500cc8b0 0x7efd500ccd30 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.998+0000 7efd58600640 1 --2- 172.21.15.173:0/2004391790 >> v2:172.21.15.194:3300/0 conn(0x7efd50145250 0x7efd5015c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.998+0000 7efd58600640 1 -- 172.21.15.173:0/2004391790 >> 172.21.15.173:0/2004391790 conn(0x7efd5006ac90 msgr2=0x7efd5006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:42.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.998+0000 7efd58600640 1 -- 172.21.15.173:0/2004391790 shutdown_connections 2024-04-25T09:07:42.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:42.998+0000 7efd58600640 1 -- 172.21.15.173:0/2004391790 wait complete. 2024-04-25T09:07:42.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd58600640 1 Processor -- start 2024-04-25T09:07:42.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd58600640 1 -- start start 2024-04-25T09:07:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd58600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd50071320 0x7efd500a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd58600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd500cc8b0 0x7efd500aa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd58600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd50145250 0x7efd5013ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd58600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5006ef80 con 0x7efd500cc8b0 2024-04-25T09:07:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd58600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd50145630 con 0x7efd50071320 2024-04-25T09:07:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd58600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5006d380 con 0x7efd50145250 2024-04-25T09:07:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd55200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd500cc8b0 0x7efd500aa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd55200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd500cc8b0 0x7efd500aa830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41634/0 (socket says 172.21.15.173:41634) 2024-04-25T09:07:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd55200640 1 -- 172.21.15.173:0/1620056185 learned_addr learned my addr 172.21.15.173:0/1620056185 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd55c00640 1 --2- 172.21.15.173:0/1620056185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd50071320 0x7efd500a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd56600640 1 --2- 172.21.15.173:0/1620056185 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd50145250 0x7efd5013ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd55200640 1 -- 172.21.15.173:0/1620056185 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd50145250 msgr2=0x7efd5013ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd55200640 1 --2- 172.21.15.173:0/1620056185 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd50145250 0x7efd5013ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd55200640 1 -- 172.21.15.173:0/1620056185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd50071320 msgr2=0x7efd500a8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd55200640 1 --2- 172.21.15.173:0/1620056185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd50071320 0x7efd500a8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd55200640 1 -- 172.21.15.173:0/1620056185 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5015aa40 con 0x7efd500cc8b0 2024-04-25T09:07:42.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd55200640 1 --2- 172.21.15.173:0/1620056185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd500cc8b0 0x7efd500aa830 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7efd3c0ad040 tx=0x7efd3c01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd4d600640 1 -- 172.21.15.173:0/1620056185 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c0be5f0 con 0x7efd500cc8b0 2024-04-25T09:07:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd4d600640 1 -- 172.21.15.173:0/1620056185 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3c0be790 con 0x7efd500cc8b0 2024-04-25T09:07:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd58600640 1 -- 172.21.15.173:0/1620056185 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd500a9550 con 0x7efd500cc8b0 2024-04-25T09:07:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd4d600640 1 -- 172.21.15.173:0/1620056185 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c0beb40 con 0x7efd500cc8b0 2024-04-25T09:07:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd58600640 1 -- 172.21.15.173:0/1620056185 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd500a9b10 con 0x7efd500cc8b0 2024-04-25T09:07:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.002+0000 7efd58600640 1 -- 172.21.15.173:0/1620056185 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd50073a40 con 0x7efd500cc8b0 2024-04-25T09:07:42.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.006+0000 7efd4d600640 1 -- 172.21.15.173:0/1620056185 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efd3c0b43f0 con 0x7efd500cc8b0 2024-04-25T09:07:42.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.006+0000 7efd4d600640 1 --2- 172.21.15.173:0/1620056185 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd30066f60 0x7efd30069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.006+0000 7efd4d600640 1 -- 172.21.15.173:0/1620056185 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efd3c11f7a0 con 0x7efd500cc8b0 2024-04-25T09:07:42.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.006+0000 7efd55c00640 1 --2- 172.21.15.173:0/1620056185 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd30066f60 0x7efd30069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.006+0000 7efd55c00640 1 --2- 172.21.15.173:0/1620056185 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd30066f60 0x7efd30069420 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7efd500b0b50 tx=0x7efd44009890 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:42.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.010+0000 7efd4d600640 1 -- 172.21.15.173:0/1620056185 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efd3c0c4060 con 0x7efd500cc8b0 2024-04-25T09:07:43.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.162+0000 7efd58600640 1 -- 172.21.15.173:0/1620056185 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd5006c300 con 0x7efd30066f60 2024-04-25T09:07:43.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.170+0000 7efd4d600640 1 -- 172.21.15.173:0/1620056185 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252061 (secure 0 0 0) 0x7efd5006c300 con 0x7efd30066f60 2024-04-25T09:07:43.158 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:43.159 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:07:43.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.170+0000 7efd58600640 1 -- 172.21.15.173:0/1620056185 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd30066f60 msgr2=0x7efd30069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:43.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.170+0000 7efd58600640 1 --2- 172.21.15.173:0/1620056185 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd30066f60 0x7efd30069420 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7efd500b0b50 tx=0x7efd44009890 comp rx=0 tx=0).stop 2024-04-25T09:07:43.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.170+0000 7efd58600640 1 -- 172.21.15.173:0/1620056185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd500cc8b0 msgr2=0x7efd500aa830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:43.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.170+0000 7efd58600640 1 --2- 172.21.15.173:0/1620056185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd500cc8b0 0x7efd500aa830 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7efd3c0ad040 tx=0x7efd3c01ad60 comp rx=0 tx=0).stop 2024-04-25T09:07:43.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.170+0000 7efd58600640 1 -- 172.21.15.173:0/1620056185 shutdown_connections 2024-04-25T09:07:43.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.170+0000 7efd58600640 1 --2- 172.21.15.173:0/1620056185 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd30066f60 0x7efd30069420 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.170+0000 7efd58600640 1 --2- 172.21.15.173:0/1620056185 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd50145250 0x7efd5013ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.170+0000 7efd58600640 1 --2- 172.21.15.173:0/1620056185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd500cc8b0 0x7efd500aa830 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.170+0000 7efd58600640 1 --2- 172.21.15.173:0/1620056185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd50071320 0x7efd500a8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.170+0000 7efd58600640 1 -- 172.21.15.173:0/1620056185 >> 172.21.15.173:0/1620056185 conn(0x7efd5006ac90 msgr2=0x7efd5013da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:43.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.170+0000 7efd58600640 1 -- 172.21.15.173:0/1620056185 shutdown_connections 2024-04-25T09:07:43.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:43.170+0000 7efd58600640 1 -- 172.21.15.173:0/1620056185 wait complete. 2024-04-25T09:07:43.178 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2024-04-25T09:07:42.790034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":322408,"kb_used_data":9108,"kb_used_omap":12,"kb_used_meta":313139,"kb_avail":754652312,"statfs":{"total":773094113280,"available":772763967488,"internally_reserved":0,"allocated":9326592,"data_stored":4891480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":320654896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.196922"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007909+0000","last_change":"2024-04-25T09:07:37.617619+0000","last_active":"2024-04-25T09:07:39.007909+0000","last_peered":"2024-04-25T09:07:39.007909+0000","last_clean":"2024-04-25T09:07:39.007909+0000","last_became_active":"2024-04-25T09:07:37.617302+0000","last_became_peered":"2024-04-25T09:07:37.617302+0000","last_unstale":"2024-04-25T09:07:39.007909+0000","last_undegraded":"2024-04-25T09:07:39.007909+0000","last_fullsized":"2024-04-25T09:07:39.007909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:56.952875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635118+0000","last_change":"2024-04-25T09:07:37.642120+0000","last_active":"2024-04-25T09:07:38.635118+0000","last_peered":"2024-04-25T09:07:38.635118+0000","last_clean":"2024-04-25T09:07:38.635118+0000","last_became_active":"2024-04-25T09:07:37.641706+0000","last_became_peered":"2024-04-25T09:07:37.641706+0000","last_unstale":"2024-04-25T09:07:38.635118+0000","last_undegraded":"2024-04-25T09:07:38.635118+0000","last_fullsized":"2024-04-25T09:07:38.635118+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:14.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.637727+0000","last_change":"2024-04-25T09:07:37.629356+0000","last_active":"2024-04-25T09:07:37.637727+0000","last_peered":"2024-04-25T09:07:37.637727+0000","last_clean":"2024-04-25T09:07:37.637727+0000","last_became_active":"2024-04-25T09:07:37.629071+0000","last_became_peered":"2024-04-25T09:07:37.629071+0000","last_unstale":"2024-04-25T09:07:37.637727+0000","last_undegraded":"2024-04-25T09:07:37.637727+0000","last_fullsized":"2024-04-25T09:07:37.637727+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:25.741760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.628278+0000","last_change":"2024-04-25T09:07:37.626588+0000","last_active":"2024-04-25T09:07:37.628278+0000","last_peered":"2024-04-25T09:07:37.628278+0000","last_clean":"2024-04-25T09:07:37.628278+0000","last_became_active":"2024-04-25T09:07:37.625527+0000","last_became_peered":"2024-04-25T09:07:37.625527+0000","last_unstale":"2024-04-25T09:07:37.628278+0000","last_undegraded":"2024-04-25T09:07:37.628278+0000","last_fullsized":"2024-04-25T09:07:37.628278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:40.108001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637267+0000","last_change":"2024-04-25T09:07:37.639626+0000","last_active":"2024-04-25T09:07:38.637267+0000","last_peered":"2024-04-25T09:07:38.637267+0000","last_clean":"2024-04-25T09:07:38.637267+0000","last_became_active":"2024-04-25T09:07:37.636488+0000","last_became_peered":"2024-04-25T09:07:37.636488+0000","last_unstale":"2024-04-25T09:07:38.637267+0000","last_undegraded":"2024-04-25T09:07:38.637267+0000","last_fullsized":"2024-04-25T09:07:38.637267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:33.387139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620739+0000","last_change":"2024-04-25T09:07:37.618282+0000","last_active":"2024-04-25T09:07:38.620739+0000","last_peered":"2024-04-25T09:07:38.620739+0000","last_clean":"2024-04-25T09:07:38.620739+0000","last_became_active":"2024-04-25T09:07:37.617980+0000","last_became_peered":"2024-04-25T09:07:37.617980+0000","last_unstale":"2024-04-25T09:07:38.620739+0000","last_undegraded":"2024-04-25T09:07:38.620739+0000","last_fullsized":"2024-04-25T09:07:38.620739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.374955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620911+0000","last_change":"2024-04-25T09:07:37.634612+0000","last_active":"2024-04-25T09:07:38.620911+0000","last_peered":"2024-04-25T09:07:38.620911+0000","last_clean":"2024-04-25T09:07:38.620911+0000","last_became_active":"2024-04-25T09:07:37.634272+0000","last_became_peered":"2024-04-25T09:07:37.634272+0000","last_unstale":"2024-04-25T09:07:38.620911+0000","last_undegraded":"2024-04-25T09:07:38.620911+0000","last_fullsized":"2024-04-25T09:07:38.620911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:24.395404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637140+0000","last_change":"2024-04-25T09:07:37.632445+0000","last_active":"2024-04-25T09:07:38.637140+0000","last_peered":"2024-04-25T09:07:38.637140+0000","last_clean":"2024-04-25T09:07:38.637140+0000","last_became_active":"2024-04-25T09:07:37.632100+0000","last_became_peered":"2024-04-25T09:07:37.632100+0000","last_unstale":"2024-04-25T09:07:38.637140+0000","last_undegraded":"2024-04-25T09:07:38.637140+0000","last_fullsized":"2024-04-25T09:07:38.637140+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:34.107400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621523+0000","last_change":"2024-04-25T09:07:37.620664+0000","last_active":"2024-04-25T09:07:38.621523+0000","last_peered":"2024-04-25T09:07:38.621523+0000","last_clean":"2024-04-25T09:07:38.621523+0000","last_became_active":"2024-04-25T09:07:37.620393+0000","last_became_peered":"2024-04-25T09:07:37.620393+0000","last_unstale":"2024-04-25T09:07:38.621523+0000","last_undegraded":"2024-04-25T09:07:38.621523+0000","last_fullsized":"2024-04-25T09:07:38.621523+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:37.691190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631368+0000","last_change":"2024-04-25T09:07:37.628104+0000","last_active":"2024-04-25T09:07:37.631368+0000","last_peered":"2024-04-25T09:07:37.631368+0000","last_clean":"2024-04-25T09:07:37.631368+0000","last_became_active":"2024-04-25T09:07:37.627451+0000","last_became_peered":"2024-04-25T09:07:37.627451+0000","last_unstale":"2024-04-25T09:07:37.631368+0000","last_undegraded":"2024-04-25T09:07:37.631368+0000","last_fullsized":"2024-04-25T09:07:37.631368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:54.940460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635165+0000","last_change":"2024-04-25T09:07:37.638244+0000","last_active":"2024-04-25T09:07:38.635165+0000","last_peered":"2024-04-25T09:07:38.635165+0000","last_clean":"2024-04-25T09:07:38.635165+0000","last_became_active":"2024-04-25T09:07:37.637967+0000","last_became_peered":"2024-04-25T09:07:37.637967+0000","last_unstale":"2024-04-25T09:07:38.635165+0000","last_undegraded":"2024-04-25T09:07:38.635165+0000","last_fullsized":"2024-04-25T09:07:38.635165+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:40.123592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631283+0000","last_change":"2024-04-25T09:07:37.628390+0000","last_active":"2024-04-25T09:07:37.631283+0000","last_peered":"2024-04-25T09:07:37.631283+0000","last_clean":"2024-04-25T09:07:37.631283+0000","last_became_active":"2024-04-25T09:07:37.628101+0000","last_became_peered":"2024-04-25T09:07:37.628101+0000","last_unstale":"2024-04-25T09:07:37.631283+0000","last_undegraded":"2024-04-25T09:07:37.631283+0000","last_fullsized":"2024-04-25T09:07:37.631283+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:21.781597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637387+0000","last_change":"2024-04-25T09:07:37.644053+0000","last_active":"2024-04-25T09:07:38.637387+0000","last_peered":"2024-04-25T09:07:38.637387+0000","last_clean":"2024-04-25T09:07:38.637387+0000","last_became_active":"2024-04-25T09:07:37.643783+0000","last_became_peered":"2024-04-25T09:07:37.643783+0000","last_unstale":"2024-04-25T09:07:38.637387+0000","last_undegraded":"2024-04-25T09:07:38.637387+0000","last_fullsized":"2024-04-25T09:07:38.637387+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:57.907870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620774+0000","last_change":"2024-04-25T09:07:37.618084+0000","last_active":"2024-04-25T09:07:38.620774+0000","last_peered":"2024-04-25T09:07:38.620774+0000","last_clean":"2024-04-25T09:07:38.620774+0000","last_became_active":"2024-04-25T09:07:37.617758+0000","last_became_peered":"2024-04-25T09:07:37.617758+0000","last_unstale":"2024-04-25T09:07:38.620774+0000","last_undegraded":"2024-04-25T09:07:38.620774+0000","last_fullsized":"2024-04-25T09:07:38.620774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:53.134215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634782+0000","last_change":"2024-04-25T09:07:37.624978+0000","last_active":"2024-04-25T09:07:38.634782+0000","last_peered":"2024-04-25T09:07:38.634782+0000","last_clean":"2024-04-25T09:07:38.634782+0000","last_became_active":"2024-04-25T09:07:37.624509+0000","last_became_peered":"2024-04-25T09:07:37.624509+0000","last_unstale":"2024-04-25T09:07:38.634782+0000","last_undegraded":"2024-04-25T09:07:38.634782+0000","last_fullsized":"2024-04-25T09:07:38.634782+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:18.688958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007770+0000","last_change":"2024-04-25T09:07:37.626043+0000","last_active":"2024-04-25T09:07:39.007770+0000","last_peered":"2024-04-25T09:07:39.007770+0000","last_clean":"2024-04-25T09:07:39.007770+0000","last_became_active":"2024-04-25T09:07:37.625783+0000","last_became_peered":"2024-04-25T09:07:37.625783+0000","last_unstale":"2024-04-25T09:07:39.007770+0000","last_undegraded":"2024-04-25T09:07:39.007770+0000","last_fullsized":"2024-04-25T09:07:39.007770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:03.532182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637781+0000","last_change":"2024-04-25T09:07:37.639108+0000","last_active":"2024-04-25T09:07:38.637781+0000","last_peered":"2024-04-25T09:07:38.637781+0000","last_clean":"2024-04-25T09:07:38.637781+0000","last_became_active":"2024-04-25T09:07:37.638532+0000","last_became_peered":"2024-04-25T09:07:37.638532+0000","last_unstale":"2024-04-25T09:07:38.637781+0000","last_undegraded":"2024-04-25T09:07:38.637781+0000","last_fullsized":"2024-04-25T09:07:38.637781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:02.132000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.638553+0000","last_change":"2024-04-25T09:07:37.634860+0000","last_active":"2024-04-25T09:07:37.638553+0000","last_peered":"2024-04-25T09:07:37.638553+0000","last_clean":"2024-04-25T09:07:37.638553+0000","last_became_active":"2024-04-25T09:07:37.634582+0000","last_became_peered":"2024-04-25T09:07:37.634582+0000","last_unstale":"2024-04-25T09:07:37.638553+0000","last_undegraded":"2024-04-25T09:07:37.638553+0000","last_fullsized":"2024-04-25T09:07:37.638553+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:31.359245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621086+0000","last_change":"2024-04-25T09:07:37.638340+0000","last_active":"2024-04-25T09:07:38.621086+0000","last_peered":"2024-04-25T09:07:38.621086+0000","last_clean":"2024-04-25T09:07:38.621086+0000","last_became_active":"2024-04-25T09:07:37.638060+0000","last_became_peered":"2024-04-25T09:07:37.638060+0000","last_unstale":"2024-04-25T09:07:38.621086+0000","last_undegraded":"2024-04-25T09:07:38.621086+0000","last_fullsized":"2024-04-25T09:07:38.621086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:09.628669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637578+0000","last_change":"2024-04-25T09:07:37.639988+0000","last_active":"2024-04-25T09:07:38.637578+0000","last_peered":"2024-04-25T09:07:38.637578+0000","last_clean":"2024-04-25T09:07:38.637578+0000","last_became_active":"2024-04-25T09:07:37.639263+0000","last_became_peered":"2024-04-25T09:07:37.639263+0000","last_unstale":"2024-04-25T09:07:38.637578+0000","last_undegraded":"2024-04-25T09:07:38.637578+0000","last_fullsized":"2024-04-25T09:07:38.637578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:38.575243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621067+0000","last_change":"2024-04-25T09:07:37.633413+0000","last_active":"2024-04-25T09:07:38.621067+0000","last_peered":"2024-04-25T09:07:38.621067+0000","last_clean":"2024-04-25T09:07:38.621067+0000","last_became_active":"2024-04-25T09:07:37.633132+0000","last_became_peered":"2024-04-25T09:07:37.633132+0000","last_unstale":"2024-04-25T09:07:38.621067+0000","last_undegraded":"2024-04-25T09:07:38.621067+0000","last_fullsized":"2024-04-25T09:07:38.621067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:41.064820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637379+0000","last_change":"2024-04-25T09:07:37.644962+0000","last_active":"2024-04-25T09:07:38.637379+0000","last_peered":"2024-04-25T09:07:38.637379+0000","last_clean":"2024-04-25T09:07:38.637379+0000","last_became_active":"2024-04-25T09:07:37.644695+0000","last_became_peered":"2024-04-25T09:07:37.644695+0000","last_unstale":"2024-04-25T09:07:38.637379+0000","last_undegraded":"2024-04-25T09:07:38.637379+0000","last_fullsized":"2024-04-25T09:07:38.637379+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:05:45.625216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.622028+0000","last_change":"2024-04-25T09:07:37.624852+0000","last_active":"2024-04-25T09:07:38.622028+0000","last_peered":"2024-04-25T09:07:38.622028+0000","last_clean":"2024-04-25T09:07:38.622028+0000","last_became_active":"2024-04-25T09:07:37.624552+0000","last_became_peered":"2024-04-25T09:07:37.624552+0000","last_unstale":"2024-04-25T09:07:38.622028+0000","last_undegraded":"2024-04-25T09:07:38.622028+0000","last_fullsized":"2024-04-25T09:07:38.622028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:55.922340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634678+0000","last_change":"2024-04-25T09:07:37.628098+0000","last_active":"2024-04-25T09:07:38.634678+0000","last_peered":"2024-04-25T09:07:38.634678+0000","last_clean":"2024-04-25T09:07:38.634678+0000","last_became_active":"2024-04-25T09:07:37.627827+0000","last_became_peered":"2024-04-25T09:07:37.627827+0000","last_unstale":"2024-04-25T09:07:38.634678+0000","last_undegraded":"2024-04-25T09:07:38.634678+0000","last_fullsized":"2024-04-25T09:07:38.634678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:45.887572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635119+0000","last_change":"2024-04-25T09:07:37.627502+0000","last_active":"2024-04-25T09:07:38.635119+0000","last_peered":"2024-04-25T09:07:38.635119+0000","last_clean":"2024-04-25T09:07:38.635119+0000","last_became_active":"2024-04-25T09:07:37.626614+0000","last_became_peered":"2024-04-25T09:07:37.626614+0000","last_unstale":"2024-04-25T09:07:38.635119+0000","last_undegraded":"2024-04-25T09:07:38.635119+0000","last_fullsized":"2024-04-25T09:07:38.635119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:52.345009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631388+0000","last_change":"2024-04-25T09:07:37.630155+0000","last_active":"2024-04-25T09:07:37.631388+0000","last_peered":"2024-04-25T09:07:37.631388+0000","last_clean":"2024-04-25T09:07:37.631388+0000","last_became_active":"2024-04-25T09:07:37.629889+0000","last_became_peered":"2024-04-25T09:07:37.629889+0000","last_unstale":"2024-04-25T09:07:37.631388+0000","last_undegraded":"2024-04-25T09:07:37.631388+0000","last_fullsized":"2024-04-25T09:07:37.631388+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:12.490521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007711+0000","last_change":"2024-04-25T09:07:37.630454+0000","last_active":"2024-04-25T09:07:39.007711+0000","last_peered":"2024-04-25T09:07:39.007711+0000","last_clean":"2024-04-25T09:07:39.007711+0000","last_became_active":"2024-04-25T09:07:37.629856+0000","last_became_peered":"2024-04-25T09:07:37.629856+0000","last_unstale":"2024-04-25T09:07:39.007711+0000","last_undegraded":"2024-04-25T09:07:39.007711+0000","last_fullsized":"2024-04-25T09:07:39.007711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:34.726656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637640+0000","last_change":"2024-04-25T09:07:37.638930+0000","last_active":"2024-04-25T09:07:38.637640+0000","last_peered":"2024-04-25T09:07:38.637640+0000","last_clean":"2024-04-25T09:07:38.637640+0000","last_became_active":"2024-04-25T09:07:37.637356+0000","last_became_peered":"2024-04-25T09:07:37.637356+0000","last_unstale":"2024-04-25T09:07:38.637640+0000","last_undegraded":"2024-04-25T09:07:38.637640+0000","last_fullsized":"2024-04-25T09:07:38.637640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:54.912036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634809+0000","last_change":"2024-04-25T09:07:37.620835+0000","last_active":"2024-04-25T09:07:38.634809+0000","last_peered":"2024-04-25T09:07:38.634809+0000","last_clean":"2024-04-25T09:07:38.634809+0000","last_became_active":"2024-04-25T09:07:37.620537+0000","last_became_peered":"2024-04-25T09:07:37.620537+0000","last_unstale":"2024-04-25T09:07:38.634809+0000","last_undegraded":"2024-04-25T09:07:38.634809+0000","last_fullsized":"2024-04-25T09:07:38.634809+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:25.439081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007497+0000","last_change":"2024-04-25T09:07:37.625368+0000","last_active":"2024-04-25T09:07:39.007497+0000","last_peered":"2024-04-25T09:07:39.007497+0000","last_clean":"2024-04-25T09:07:39.007497+0000","last_became_active":"2024-04-25T09:07:37.625078+0000","last_became_peered":"2024-04-25T09:07:37.625078+0000","last_unstale":"2024-04-25T09:07:39.007497+0000","last_undegraded":"2024-04-25T09:07:39.007497+0000","last_fullsized":"2024-04-25T09:07:39.007497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.374955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631453+0000","last_change":"2024-04-25T09:07:37.625322+0000","last_active":"2024-04-25T09:07:37.631453+0000","last_peered":"2024-04-25T09:07:37.631453+0000","last_clean":"2024-04-25T09:07:37.631453+0000","last_became_active":"2024-04-25T09:07:37.624684+0000","last_became_peered":"2024-04-25T09:07:37.624684+0000","last_unstale":"2024-04-25T09:07:37.631453+0000","last_undegraded":"2024-04-25T09:07:37.631453+0000","last_fullsized":"2024-04-25T09:07:37.631453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:12.567183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007739+0000","last_change":"2024-04-25T09:07:37.617988+0000","last_active":"2024-04-25T09:07:39.007739+0000","last_peered":"2024-04-25T09:07:39.007739+0000","last_clean":"2024-04-25T09:07:39.007739+0000","last_became_active":"2024-04-25T09:07:37.616534+0000","last_became_peered":"2024-04-25T09:07:37.616534+0000","last_unstale":"2024-04-25T09:07:39.007739+0000","last_undegraded":"2024-04-25T09:07:39.007739+0000","last_fullsized":"2024-04-25T09:07:39.007739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:53.134215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.635064+0000","last_change":"2024-04-25T09:07:37.626057+0000","last_active":"2024-04-25T09:07:37.635064+0000","last_peered":"2024-04-25T09:07:37.635064+0000","last_clean":"2024-04-25T09:07:37.635064+0000","last_became_active":"2024-04-25T09:07:37.625736+0000","last_became_peered":"2024-04-25T09:07:37.625736+0000","last_unstale":"2024-04-25T09:07:37.635064+0000","last_undegraded":"2024-04-25T09:07:37.635064+0000","last_fullsized":"2024-04-25T09:07:37.635064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:50.340971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"83'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637794+0000","last_change":"2024-04-25T09:07:36.616376+0000","last_active":"2024-04-25T09:07:38.637794+0000","last_peered":"2024-04-25T09:07:38.637794+0000","last_clean":"2024-04-25T09:07:38.637794+0000","last_became_active":"2024-04-25T09:07:36.616075+0000","last_became_peered":"2024-04-25T09:07:36.616075+0000","last_unstale":"2024-04-25T09:07:38.637794+0000","last_undegraded":"2024-04-25T09:07:38.637794+0000","last_fullsized":"2024-04-25T09:07:38.637794+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:26.377752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634935+0000","last_change":"2024-04-25T09:07:37.628208+0000","last_active":"2024-04-25T09:07:38.634935+0000","last_peered":"2024-04-25T09:07:38.634935+0000","last_clean":"2024-04-25T09:07:38.634935+0000","last_became_active":"2024-04-25T09:07:37.627848+0000","last_became_peered":"2024-04-25T09:07:37.627848+0000","last_unstale":"2024-04-25T09:07:38.634935+0000","last_undegraded":"2024-04-25T09:07:38.634935+0000","last_fullsized":"2024-04-25T09:07:38.634935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:24.857733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007882+0000","last_change":"2024-04-25T09:07:36.619079+0000","last_active":"2024-04-25T09:07:39.007882+0000","last_peered":"2024-04-25T09:07:39.007882+0000","last_clean":"2024-04-25T09:07:39.007882+0000","last_became_active":"2024-04-25T09:07:36.618396+0000","last_became_peered":"2024-04-25T09:07:36.618396+0000","last_unstale":"2024-04-25T09:07:39.007882+0000","last_undegraded":"2024-04-25T09:07:39.007882+0000","last_fullsized":"2024-04-25T09:07:39.007882+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:44.880581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621321+0000","last_change":"2024-04-25T09:07:37.628645+0000","last_active":"2024-04-25T09:07:38.621321+0000","last_peered":"2024-04-25T09:07:38.621321+0000","last_clean":"2024-04-25T09:07:38.621321+0000","last_became_active":"2024-04-25T09:07:37.628344+0000","last_became_peered":"2024-04-25T09:07:37.628344+0000","last_unstale":"2024-04-25T09:07:38.621321+0000","last_undegraded":"2024-04-25T09:07:38.621321+0000","last_fullsized":"2024-04-25T09:07:38.621321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:46.246638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007688+0000","last_change":"2024-04-25T09:07:36.618033+0000","last_active":"2024-04-25T09:07:39.007688+0000","last_peered":"2024-04-25T09:07:39.007688+0000","last_clean":"2024-04-25T09:07:39.007688+0000","last_became_active":"2024-04-25T09:07:36.617755+0000","last_became_peered":"2024-04-25T09:07:36.617755+0000","last_unstale":"2024-04-25T09:07:39.007688+0000","last_undegraded":"2024-04-25T09:07:39.007688+0000","last_fullsized":"2024-04-25T09:07:39.007688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:28.529536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621071+0000","last_change":"2024-04-25T09:07:37.633374+0000","last_active":"2024-04-25T09:07:38.621071+0000","last_peered":"2024-04-25T09:07:38.621071+0000","last_clean":"2024-04-25T09:07:38.621071+0000","last_became_active":"2024-04-25T09:07:37.633097+0000","last_became_peered":"2024-04-25T09:07:37.633097+0000","last_unstale":"2024-04-25T09:07:38.621071+0000","last_undegraded":"2024-04-25T09:07:38.621071+0000","last_fullsized":"2024-04-25T09:07:38.621071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:04.260863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620809+0000","last_change":"2024-04-25T09:07:36.615481+0000","last_active":"2024-04-25T09:07:38.620809+0000","last_peered":"2024-04-25T09:07:38.620809+0000","last_clean":"2024-04-25T09:07:38.620809+0000","last_became_active":"2024-04-25T09:07:36.615203+0000","last_became_peered":"2024-04-25T09:07:36.615203+0000","last_unstale":"2024-04-25T09:07:38.620809+0000","last_undegraded":"2024-04-25T09:07:38.620809+0000","last_fullsized":"2024-04-25T09:07:38.620809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:03.253872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635044+0000","last_change":"2024-04-25T09:07:37.642388+0000","last_active":"2024-04-25T09:07:38.635044+0000","last_peered":"2024-04-25T09:07:38.635044+0000","last_clean":"2024-04-25T09:07:38.635044+0000","last_became_active":"2024-04-25T09:07:37.641673+0000","last_became_peered":"2024-04-25T09:07:37.641673+0000","last_unstale":"2024-04-25T09:07:38.635044+0000","last_undegraded":"2024-04-25T09:07:38.635044+0000","last_fullsized":"2024-04-25T09:07:38.635044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:01.788399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621200+0000","last_change":"2024-04-25T09:07:36.616454+0000","last_active":"2024-04-25T09:07:38.621200+0000","last_peered":"2024-04-25T09:07:38.621200+0000","last_clean":"2024-04-25T09:07:38.621200+0000","last_became_active":"2024-04-25T09:07:36.616058+0000","last_became_peered":"2024-04-25T09:07:36.616058+0000","last_unstale":"2024-04-25T09:07:38.621200+0000","last_undegraded":"2024-04-25T09:07:38.621200+0000","last_fullsized":"2024-04-25T09:07:38.621200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:19.115185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635202+0000","last_change":"2024-04-25T09:07:37.645238+0000","last_active":"2024-04-25T09:07:38.635202+0000","last_peered":"2024-04-25T09:07:38.635202+0000","last_clean":"2024-04-25T09:07:38.635202+0000","last_became_active":"2024-04-25T09:07:37.644352+0000","last_became_peered":"2024-04-25T09:07:37.644352+0000","last_unstale":"2024-04-25T09:07:38.635202+0000","last_undegraded":"2024-04-25T09:07:38.635202+0000","last_fullsized":"2024-04-25T09:07:38.635202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.374955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.644227+0000","last_change":"2024-04-25T09:07:36.610047+0000","last_active":"2024-04-25T09:07:37.644227+0000","last_peered":"2024-04-25T09:07:37.644227+0000","last_clean":"2024-04-25T09:07:37.644227+0000","last_became_active":"2024-04-25T09:07:36.609786+0000","last_became_peered":"2024-04-25T09:07:36.609786+0000","last_unstale":"2024-04-25T09:07:37.644227+0000","last_undegraded":"2024-04-25T09:07:37.644227+0000","last_fullsized":"2024-04-25T09:07:37.644227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:14.391941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621584+0000","last_change":"2024-04-25T09:07:37.617101+0000","last_active":"2024-04-25T09:07:38.621584+0000","last_peered":"2024-04-25T09:07:38.621584+0000","last_clean":"2024-04-25T09:07:38.621584+0000","last_became_active":"2024-04-25T09:07:37.616000+0000","last_became_peered":"2024-04-25T09:07:37.616000+0000","last_unstale":"2024-04-25T09:07:38.621584+0000","last_undegraded":"2024-04-25T09:07:38.621584+0000","last_fullsized":"2024-04-25T09:07:38.621584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:55.162579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634902+0000","last_change":"2024-04-25T09:07:36.614605+0000","last_active":"2024-04-25T09:07:38.634902+0000","last_peered":"2024-04-25T09:07:38.634902+0000","last_clean":"2024-04-25T09:07:38.634902+0000","last_became_active":"2024-04-25T09:07:36.614349+0000","last_became_peered":"2024-04-25T09:07:36.614349+0000","last_unstale":"2024-04-25T09:07:38.634902+0000","last_undegraded":"2024-04-25T09:07:38.634902+0000","last_fullsized":"2024-04-25T09:07:38.634902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:39.401019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621551+0000","last_change":"2024-04-25T09:07:37.642318+0000","last_active":"2024-04-25T09:07:38.621551+0000","last_peered":"2024-04-25T09:07:38.621551+0000","last_clean":"2024-04-25T09:07:38.621551+0000","last_became_active":"2024-04-25T09:07:37.641879+0000","last_became_peered":"2024-04-25T09:07:37.641879+0000","last_unstale":"2024-04-25T09:07:38.621551+0000","last_undegraded":"2024-04-25T09:07:38.621551+0000","last_fullsized":"2024-04-25T09:07:38.621551+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:33.063248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637137+0000","last_change":"2024-04-25T09:07:36.616980+0000","last_active":"2024-04-25T09:07:38.637137+0000","last_peered":"2024-04-25T09:07:38.637137+0000","last_clean":"2024-04-25T09:07:38.637137+0000","last_became_active":"2024-04-25T09:07:36.616698+0000","last_became_peered":"2024-04-25T09:07:36.616698+0000","last_unstale":"2024-04-25T09:07:38.637137+0000","last_undegraded":"2024-04-25T09:07:38.637137+0000","last_fullsized":"2024-04-25T09:07:38.637137+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:05.199952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634687+0000","last_change":"2024-04-25T09:07:37.618246+0000","last_active":"2024-04-25T09:07:38.634687+0000","last_peered":"2024-04-25T09:07:38.634687+0000","last_clean":"2024-04-25T09:07:38.634687+0000","last_became_active":"2024-04-25T09:07:37.617992+0000","last_became_peered":"2024-04-25T09:07:37.617992+0000","last_unstale":"2024-04-25T09:07:38.634687+0000","last_undegraded":"2024-04-25T09:07:38.634687+0000","last_fullsized":"2024-04-25T09:07:38.634687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:15.922910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007920+0000","last_change":"2024-04-25T09:07:36.623042+0000","last_active":"2024-04-25T09:07:39.007920+0000","last_peered":"2024-04-25T09:07:39.007920+0000","last_clean":"2024-04-25T09:07:39.007920+0000","last_became_active":"2024-04-25T09:07:36.622793+0000","last_became_peered":"2024-04-25T09:07:36.622793+0000","last_unstale":"2024-04-25T09:07:39.007920+0000","last_undegraded":"2024-04-25T09:07:39.007920+0000","last_fullsized":"2024-04-25T09:07:39.007920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:17.681967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631331+0000","last_change":"2024-04-25T09:07:37.629312+0000","last_active":"2024-04-25T09:07:37.631331+0000","last_peered":"2024-04-25T09:07:37.631331+0000","last_clean":"2024-04-25T09:07:37.631331+0000","last_became_active":"2024-04-25T09:07:37.627276+0000","last_became_peered":"2024-04-25T09:07:37.627276+0000","last_unstale":"2024-04-25T09:07:37.631331+0000","last_undegraded":"2024-04-25T09:07:37.631331+0000","last_fullsized":"2024-04-25T09:07:37.631331+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:38.473267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.621587+0000","last_change":"2024-04-25T09:07:36.613966+0000","last_active":"2024-04-25T09:07:37.621587+0000","last_peered":"2024-04-25T09:07:37.621587+0000","last_clean":"2024-04-25T09:07:37.621587+0000","last_became_active":"2024-04-25T09:07:36.613700+0000","last_became_peered":"2024-04-25T09:07:36.613700+0000","last_unstale":"2024-04-25T09:07:37.621587+0000","last_undegraded":"2024-04-25T09:07:37.621587+0000","last_fullsized":"2024-04-25T09:07:37.621587+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:56.184210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620920+0000","last_change":"2024-04-25T09:07:37.624293+0000","last_active":"2024-04-25T09:07:38.620920+0000","last_peered":"2024-04-25T09:07:38.620920+0000","last_clean":"2024-04-25T09:07:38.620920+0000","last_became_active":"2024-04-25T09:07:37.624036+0000","last_became_peered":"2024-04-25T09:07:37.624036+0000","last_unstale":"2024-04-25T09:07:38.620920+0000","last_undegraded":"2024-04-25T09:07:38.620920+0000","last_fullsized":"2024-04-25T09:07:38.620920+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:34.726656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"83'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637768+0000","last_change":"2024-04-25T09:07:36.621681+0000","last_active":"2024-04-25T09:07:38.637768+0000","last_peered":"2024-04-25T09:07:38.637768+0000","last_clean":"2024-04-25T09:07:38.637768+0000","last_became_active":"2024-04-25T09:07:36.621425+0000","last_became_peered":"2024-04-25T09:07:36.621425+0000","last_unstale":"2024-04-25T09:07:38.637768+0000","last_undegraded":"2024-04-25T09:07:38.637768+0000","last_fullsized":"2024-04-25T09:07:38.637768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:12.826909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.638070+0000","last_change":"2024-04-25T09:07:37.631958+0000","last_active":"2024-04-25T09:07:37.638070+0000","last_peered":"2024-04-25T09:07:37.638070+0000","last_clean":"2024-04-25T09:07:37.638070+0000","last_became_active":"2024-04-25T09:07:37.631694+0000","last_became_peered":"2024-04-25T09:07:37.631694+0000","last_unstale":"2024-04-25T09:07:37.638070+0000","last_undegraded":"2024-04-25T09:07:37.638070+0000","last_fullsized":"2024-04-25T09:07:37.638070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:16.140878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"83'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620920+0000","last_change":"2024-04-25T09:07:36.605032+0000","last_active":"2024-04-25T09:07:38.620920+0000","last_peered":"2024-04-25T09:07:38.620920+0000","last_clean":"2024-04-25T09:07:38.620920+0000","last_became_active":"2024-04-25T09:07:36.603703+0000","last_became_peered":"2024-04-25T09:07:36.603703+0000","last_unstale":"2024-04-25T09:07:38.620920+0000","last_undegraded":"2024-04-25T09:07:38.620920+0000","last_fullsized":"2024-04-25T09:07:38.620920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:45.239647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.631261+0000","last_change":"2024-04-25T09:07:37.628226+0000","last_active":"2024-04-25T09:07:37.631261+0000","last_peered":"2024-04-25T09:07:37.631261+0000","last_clean":"2024-04-25T09:07:37.631261+0000","last_became_active":"2024-04-25T09:07:37.625863+0000","last_became_peered":"2024-04-25T09:07:37.625863+0000","last_unstale":"2024-04-25T09:07:37.631261+0000","last_undegraded":"2024-04-25T09:07:37.631261+0000","last_fullsized":"2024-04-25T09:07:37.631261+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:33.063248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.641096+0000","last_change":"2024-04-25T09:07:36.611263+0000","last_active":"2024-04-25T09:07:37.641096+0000","last_peered":"2024-04-25T09:07:37.641096+0000","last_clean":"2024-04-25T09:07:37.641096+0000","last_became_active":"2024-04-25T09:07:36.610934+0000","last_became_peered":"2024-04-25T09:07:36.610934+0000","last_unstale":"2024-04-25T09:07:37.641096+0000","last_undegraded":"2024-04-25T09:07:37.641096+0000","last_fullsized":"2024-04-25T09:07:37.641096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:32.093652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621017+0000","last_change":"2024-04-25T09:07:37.625227+0000","last_active":"2024-04-25T09:07:38.621017+0000","last_peered":"2024-04-25T09:07:38.621017+0000","last_clean":"2024-04-25T09:07:38.621017+0000","last_became_active":"2024-04-25T09:07:37.624685+0000","last_became_peered":"2024-04-25T09:07:37.624685+0000","last_unstale":"2024-04-25T09:07:38.621017+0000","last_undegraded":"2024-04-25T09:07:38.621017+0000","last_fullsized":"2024-04-25T09:07:38.621017+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:15.398932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007520+0000","last_change":"2024-04-25T09:07:36.620051+0000","last_active":"2024-04-25T09:07:39.007520+0000","last_peered":"2024-04-25T09:07:39.007520+0000","last_clean":"2024-04-25T09:07:39.007520+0000","last_became_active":"2024-04-25T09:07:36.619717+0000","last_became_peered":"2024-04-25T09:07:36.619717+0000","last_unstale":"2024-04-25T09:07:39.007520+0000","last_undegraded":"2024-04-25T09:07:39.007520+0000","last_fullsized":"2024-04-25T09:07:39.007520+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:17.664094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620865+0000","last_change":"2024-04-25T09:07:37.623281+0000","last_active":"2024-04-25T09:07:38.620865+0000","last_peered":"2024-04-25T09:07:38.620865+0000","last_clean":"2024-04-25T09:07:38.620865+0000","last_became_active":"2024-04-25T09:07:37.622461+0000","last_became_peered":"2024-04-25T09:07:37.622461+0000","last_unstale":"2024-04-25T09:07:38.620865+0000","last_undegraded":"2024-04-25T09:07:38.620865+0000","last_fullsized":"2024-04-25T09:07:38.620865+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:33.100643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637133+0000","last_change":"2024-04-25T09:07:36.617283+0000","last_active":"2024-04-25T09:07:38.637133+0000","last_peered":"2024-04-25T09:07:38.637133+0000","last_clean":"2024-04-25T09:07:38.637133+0000","last_became_active":"2024-04-25T09:07:36.615973+0000","last_became_peered":"2024-04-25T09:07:36.615973+0000","last_unstale":"2024-04-25T09:07:38.637133+0000","last_undegraded":"2024-04-25T09:07:38.637133+0000","last_fullsized":"2024-04-25T09:07:38.637133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:08.020375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621771+0000","last_change":"2024-04-25T09:07:37.628648+0000","last_active":"2024-04-25T09:07:38.621771+0000","last_peered":"2024-04-25T09:07:38.621771+0000","last_clean":"2024-04-25T09:07:38.621771+0000","last_became_active":"2024-04-25T09:07:37.627443+0000","last_became_peered":"2024-04-25T09:07:37.627443+0000","last_unstale":"2024-04-25T09:07:38.621771+0000","last_undegraded":"2024-04-25T09:07:38.621771+0000","last_fullsized":"2024-04-25T09:07:38.621771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:21.781597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"83'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634813+0000","last_change":"2024-04-25T09:07:36.601617+0000","last_active":"2024-04-25T09:07:38.634813+0000","last_peered":"2024-04-25T09:07:38.634813+0000","last_clean":"2024-04-25T09:07:38.634813+0000","last_became_active":"2024-04-25T09:07:36.601323+0000","last_became_peered":"2024-04-25T09:07:36.601323+0000","last_unstale":"2024-04-25T09:07:38.634813+0000","last_undegraded":"2024-04-25T09:07:38.634813+0000","last_fullsized":"2024-04-25T09:07:38.634813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:41.678865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620974+0000","last_change":"2024-04-25T09:07:37.627836+0000","last_active":"2024-04-25T09:07:38.620974+0000","last_peered":"2024-04-25T09:07:38.620974+0000","last_clean":"2024-04-25T09:07:38.620974+0000","last_became_active":"2024-04-25T09:07:37.627568+0000","last_became_peered":"2024-04-25T09:07:37.627568+0000","last_unstale":"2024-04-25T09:07:38.620974+0000","last_undegraded":"2024-04-25T09:07:38.620974+0000","last_fullsized":"2024-04-25T09:07:38.620974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:56.952875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.008068+0000","last_change":"2024-04-25T09:07:36.621694+0000","last_active":"2024-04-25T09:07:39.008068+0000","last_peered":"2024-04-25T09:07:39.008068+0000","last_clean":"2024-04-25T09:07:39.008068+0000","last_became_active":"2024-04-25T09:07:36.621503+0000","last_became_peered":"2024-04-25T09:07:36.621503+0000","last_unstale":"2024-04-25T09:07:39.008068+0000","last_undegraded":"2024-04-25T09:07:39.008068+0000","last_fullsized":"2024-04-25T09:07:39.008068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:24.432090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637180+0000","last_change":"2024-04-25T09:07:37.635114+0000","last_active":"2024-04-25T09:07:38.637180+0000","last_peered":"2024-04-25T09:07:38.637180+0000","last_clean":"2024-04-25T09:07:38.637180+0000","last_became_active":"2024-04-25T09:07:37.634833+0000","last_became_peered":"2024-04-25T09:07:37.634833+0000","last_unstale":"2024-04-25T09:07:38.637180+0000","last_undegraded":"2024-04-25T09:07:38.637180+0000","last_fullsized":"2024-04-25T09:07:38.637180+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:53.605713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621693+0000","last_change":"2024-04-25T09:07:36.616078+0000","last_active":"2024-04-25T09:07:38.621693+0000","last_peered":"2024-04-25T09:07:38.621693+0000","last_clean":"2024-04-25T09:07:38.621693+0000","last_became_active":"2024-04-25T09:07:36.615403+0000","last_became_peered":"2024-04-25T09:07:36.615403+0000","last_unstale":"2024-04-25T09:07:38.621693+0000","last_undegraded":"2024-04-25T09:07:38.621693+0000","last_fullsized":"2024-04-25T09:07:38.621693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:15.009651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637101+0000","last_change":"2024-04-25T09:07:37.646400+0000","last_active":"2024-04-25T09:07:38.637101+0000","last_peered":"2024-04-25T09:07:38.637101+0000","last_clean":"2024-04-25T09:07:38.637101+0000","last_became_active":"2024-04-25T09:07:37.646129+0000","last_became_peered":"2024-04-25T09:07:37.646129+0000","last_unstale":"2024-04-25T09:07:38.637101+0000","last_undegraded":"2024-04-25T09:07:38.637101+0000","last_fullsized":"2024-04-25T09:07:38.637101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:02.389276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637780+0000","last_change":"2024-04-25T09:07:36.617644+0000","last_active":"2024-04-25T09:07:38.637780+0000","last_peered":"2024-04-25T09:07:38.637780+0000","last_clean":"2024-04-25T09:07:38.637780+0000","last_became_active":"2024-04-25T09:07:36.616325+0000","last_became_peered":"2024-04-25T09:07:36.616325+0000","last_unstale":"2024-04-25T09:07:38.637780+0000","last_undegraded":"2024-04-25T09:07:38.637780+0000","last_fullsized":"2024-04-25T09:07:38.637780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:31.620809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620896+0000","last_change":"2024-04-25T09:07:37.639937+0000","last_active":"2024-04-25T09:07:38.620896+0000","last_peered":"2024-04-25T09:07:38.620896+0000","last_clean":"2024-04-25T09:07:38.620896+0000","last_became_active":"2024-04-25T09:07:37.633606+0000","last_became_peered":"2024-04-25T09:07:37.633606+0000","last_unstale":"2024-04-25T09:07:38.620896+0000","last_undegraded":"2024-04-25T09:07:38.620896+0000","last_fullsized":"2024-04-25T09:07:38.620896+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:03.532182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.617233+0000","last_change":"2024-04-25T09:07:36.622372+0000","last_active":"2024-04-25T09:07:37.617233+0000","last_peered":"2024-04-25T09:07:37.617233+0000","last_clean":"2024-04-25T09:07:37.617233+0000","last_became_active":"2024-04-25T09:07:36.622088+0000","last_became_peered":"2024-04-25T09:07:36.622088+0000","last_unstale":"2024-04-25T09:07:37.617233+0000","last_undegraded":"2024-04-25T09:07:37.617233+0000","last_fullsized":"2024-04-25T09:07:37.617233+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:35.244653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635171+0000","last_change":"2024-04-25T09:07:37.629723+0000","last_active":"2024-04-25T09:07:38.635171+0000","last_peered":"2024-04-25T09:07:38.635171+0000","last_clean":"2024-04-25T09:07:38.635171+0000","last_became_active":"2024-04-25T09:07:37.629081+0000","last_became_peered":"2024-04-25T09:07:37.629081+0000","last_unstale":"2024-04-25T09:07:38.635171+0000","last_undegraded":"2024-04-25T09:07:38.635171+0000","last_fullsized":"2024-04-25T09:07:38.635171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:36.626956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620850+0000","last_change":"2024-04-25T09:07:36.619552+0000","last_active":"2024-04-25T09:07:38.620850+0000","last_peered":"2024-04-25T09:07:38.620850+0000","last_clean":"2024-04-25T09:07:38.620850+0000","last_became_active":"2024-04-25T09:07:36.619248+0000","last_became_peered":"2024-04-25T09:07:36.619248+0000","last_unstale":"2024-04-25T09:07:38.620850+0000","last_undegraded":"2024-04-25T09:07:38.620850+0000","last_fullsized":"2024-04-25T09:07:38.620850+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:17.681967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635263+0000","last_change":"2024-04-25T09:07:37.622142+0000","last_active":"2024-04-25T09:07:38.635263+0000","last_peered":"2024-04-25T09:07:38.635263+0000","last_clean":"2024-04-25T09:07:38.635263+0000","last_became_active":"2024-04-25T09:07:37.621887+0000","last_became_peered":"2024-04-25T09:07:37.621887+0000","last_unstale":"2024-04-25T09:07:38.635263+0000","last_undegraded":"2024-04-25T09:07:38.635263+0000","last_fullsized":"2024-04-25T09:07:38.635263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:53.134215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620629+0000","last_change":"2024-04-25T09:07:36.611689+0000","last_active":"2024-04-25T09:07:38.620629+0000","last_peered":"2024-04-25T09:07:38.620629+0000","last_clean":"2024-04-25T09:07:38.620629+0000","last_became_active":"2024-04-25T09:07:36.611363+0000","last_became_peered":"2024-04-25T09:07:36.611363+0000","last_unstale":"2024-04-25T09:07:38.620629+0000","last_undegraded":"2024-04-25T09:07:38.620629+0000","last_fullsized":"2024-04-25T09:07:38.620629+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:14.915918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621924+0000","last_change":"2024-04-25T09:07:37.627431+0000","last_active":"2024-04-25T09:07:38.621924+0000","last_peered":"2024-04-25T09:07:38.621924+0000","last_clean":"2024-04-25T09:07:38.621924+0000","last_became_active":"2024-04-25T09:07:37.627171+0000","last_became_peered":"2024-04-25T09:07:37.627171+0000","last_unstale":"2024-04-25T09:07:38.621924+0000","last_undegraded":"2024-04-25T09:07:38.621924+0000","last_fullsized":"2024-04-25T09:07:38.621924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:38.473267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620530+0000","last_change":"2024-04-25T09:07:36.614988+0000","last_active":"2024-04-25T09:07:38.620530+0000","last_peered":"2024-04-25T09:07:38.620530+0000","last_clean":"2024-04-25T09:07:38.620530+0000","last_became_active":"2024-04-25T09:07:36.614690+0000","last_became_peered":"2024-04-25T09:07:36.614690+0000","last_unstale":"2024-04-25T09:07:38.620530+0000","last_undegraded":"2024-04-25T09:07:38.620530+0000","last_fullsized":"2024-04-25T09:07:38.620530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:24.432090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621771+0000","last_change":"2024-04-25T09:07:37.621882+0000","last_active":"2024-04-25T09:07:38.621771+0000","last_peered":"2024-04-25T09:07:38.621771+0000","last_clean":"2024-04-25T09:07:38.621771+0000","last_became_active":"2024-04-25T09:07:37.621628+0000","last_became_peered":"2024-04-25T09:07:37.621628+0000","last_unstale":"2024-04-25T09:07:38.621771+0000","last_undegraded":"2024-04-25T09:07:38.621771+0000","last_fullsized":"2024-04-25T09:07:38.621771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:44.455585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.644170+0000","last_change":"2024-04-25T09:07:36.618544+0000","last_active":"2024-04-25T09:07:37.644170+0000","last_peered":"2024-04-25T09:07:37.644170+0000","last_clean":"2024-04-25T09:07:37.644170+0000","last_became_active":"2024-04-25T09:07:36.618264+0000","last_became_peered":"2024-04-25T09:07:36.618264+0000","last_unstale":"2024-04-25T09:07:37.644170+0000","last_undegraded":"2024-04-25T09:07:37.644170+0000","last_fullsized":"2024-04-25T09:07:37.644170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:23.388413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621069+0000","last_change":"2024-04-25T09:07:37.623868+0000","last_active":"2024-04-25T09:07:38.621069+0000","last_peered":"2024-04-25T09:07:38.621069+0000","last_clean":"2024-04-25T09:07:38.621069+0000","last_became_active":"2024-04-25T09:07:37.623586+0000","last_became_peered":"2024-04-25T09:07:37.623586+0000","last_unstale":"2024-04-25T09:07:38.621069+0000","last_undegraded":"2024-04-25T09:07:38.621069+0000","last_fullsized":"2024-04-25T09:07:38.621069+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:57.191201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"84'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.636608+0000","last_change":"2024-04-25T09:07:36.620391+0000","last_active":"2024-04-25T09:07:38.636608+0000","last_peered":"2024-04-25T09:07:38.636608+0000","last_clean":"2024-04-25T09:07:38.636608+0000","last_became_active":"2024-04-25T09:07:36.619820+0000","last_became_peered":"2024-04-25T09:07:36.619820+0000","last_unstale":"2024-04-25T09:07:38.636608+0000","last_undegraded":"2024-04-25T09:07:38.636608+0000","last_fullsized":"2024-04-25T09:07:38.636608+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:50.109112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621494+0000","last_change":"2024-04-25T09:07:37.621282+0000","last_active":"2024-04-25T09:07:38.621494+0000","last_peered":"2024-04-25T09:07:38.621494+0000","last_clean":"2024-04-25T09:07:38.621494+0000","last_became_active":"2024-04-25T09:07:37.620633+0000","last_became_peered":"2024-04-25T09:07:37.620633+0000","last_unstale":"2024-04-25T09:07:38.621494+0000","last_undegraded":"2024-04-25T09:07:38.621494+0000","last_fullsized":"2024-04-25T09:07:38.621494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:45.953616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007978+0000","last_change":"2024-04-25T09:07:36.617437+0000","last_active":"2024-04-25T09:07:39.007978+0000","last_peered":"2024-04-25T09:07:39.007978+0000","last_clean":"2024-04-25T09:07:39.007978+0000","last_became_active":"2024-04-25T09:07:36.617117+0000","last_became_peered":"2024-04-25T09:07:36.617117+0000","last_unstale":"2024-04-25T09:07:39.007978+0000","last_undegraded":"2024-04-25T09:07:39.007978+0000","last_fullsized":"2024-04-25T09:07:39.007978+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:14.915918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634889+0000","last_change":"2024-04-25T09:07:37.617426+0000","last_active":"2024-04-25T09:07:38.634889+0000","last_peered":"2024-04-25T09:07:38.634889+0000","last_clean":"2024-04-25T09:07:38.634889+0000","last_became_active":"2024-04-25T09:07:37.617172+0000","last_became_peered":"2024-04-25T09:07:37.617172+0000","last_unstale":"2024-04-25T09:07:38.634889+0000","last_undegraded":"2024-04-25T09:07:38.634889+0000","last_fullsized":"2024-04-25T09:07:38.634889+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:10.692785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007701+0000","last_change":"2024-04-25T09:07:36.619230+0000","last_active":"2024-04-25T09:07:39.007701+0000","last_peered":"2024-04-25T09:07:39.007701+0000","last_clean":"2024-04-25T09:07:39.007701+0000","last_became_active":"2024-04-25T09:07:36.618957+0000","last_became_peered":"2024-04-25T09:07:36.618957+0000","last_unstale":"2024-04-25T09:07:39.007701+0000","last_undegraded":"2024-04-25T09:07:39.007701+0000","last_fullsized":"2024-04-25T09:07:39.007701+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:31.128980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621380+0000","last_change":"2024-04-25T09:07:37.628246+0000","last_active":"2024-04-25T09:07:38.621380+0000","last_peered":"2024-04-25T09:07:38.621380+0000","last_clean":"2024-04-25T09:07:38.621380+0000","last_became_active":"2024-04-25T09:07:37.623529+0000","last_became_peered":"2024-04-25T09:07:37.623529+0000","last_unstale":"2024-04-25T09:07:38.621380+0000","last_undegraded":"2024-04-25T09:07:38.621380+0000","last_fullsized":"2024-04-25T09:07:38.621380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:54.940460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620686+0000","last_change":"2024-04-25T09:07:36.612649+0000","last_active":"2024-04-25T09:07:38.620686+0000","last_peered":"2024-04-25T09:07:38.620686+0000","last_clean":"2024-04-25T09:07:38.620686+0000","last_became_active":"2024-04-25T09:07:36.611900+0000","last_became_peered":"2024-04-25T09:07:36.611900+0000","last_unstale":"2024-04-25T09:07:38.620686+0000","last_undegraded":"2024-04-25T09:07:38.620686+0000","last_fullsized":"2024-04-25T09:07:38.620686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:40.057829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621211+0000","last_change":"2024-04-25T09:07:37.634630+0000","last_active":"2024-04-25T09:07:38.621211+0000","last_peered":"2024-04-25T09:07:38.621211+0000","last_clean":"2024-04-25T09:07:38.621211+0000","last_became_active":"2024-04-25T09:07:37.634242+0000","last_became_peered":"2024-04-25T09:07:37.634242+0000","last_unstale":"2024-04-25T09:07:38.621211+0000","last_undegraded":"2024-04-25T09:07:38.621211+0000","last_fullsized":"2024-04-25T09:07:38.621211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:40.108001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637258+0000","last_change":"2024-04-25T09:07:36.617056+0000","last_active":"2024-04-25T09:07:38.637258+0000","last_peered":"2024-04-25T09:07:38.637258+0000","last_clean":"2024-04-25T09:07:38.637258+0000","last_became_active":"2024-04-25T09:07:36.616846+0000","last_became_peered":"2024-04-25T09:07:36.616846+0000","last_unstale":"2024-04-25T09:07:38.637258+0000","last_undegraded":"2024-04-25T09:07:38.637258+0000","last_fullsized":"2024-04-25T09:07:38.637258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:07.592728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.638281+0000","last_change":"2024-04-25T09:07:37.629289+0000","last_active":"2024-04-25T09:07:37.638281+0000","last_peered":"2024-04-25T09:07:37.638281+0000","last_clean":"2024-04-25T09:07:37.638281+0000","last_became_active":"2024-04-25T09:07:37.629029+0000","last_became_peered":"2024-04-25T09:07:37.629029+0000","last_unstale":"2024-04-25T09:07:37.638281+0000","last_undegraded":"2024-04-25T09:07:37.638281+0000","last_fullsized":"2024-04-25T09:07:37.638281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:33.841194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621190+0000","last_change":"2024-04-25T09:07:36.605134+0000","last_active":"2024-04-25T09:07:38.621190+0000","last_peered":"2024-04-25T09:07:38.621190+0000","last_clean":"2024-04-25T09:07:38.621190+0000","last_became_active":"2024-04-25T09:07:36.604853+0000","last_became_peered":"2024-04-25T09:07:36.604853+0000","last_unstale":"2024-04-25T09:07:38.621190+0000","last_undegraded":"2024-04-25T09:07:38.621190+0000","last_fullsized":"2024-04-25T09:07:38.621190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:44.946625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.639900+0000","last_change":"2024-04-25T09:07:37.635406+0000","last_active":"2024-04-25T09:07:37.639900+0000","last_peered":"2024-04-25T09:07:37.639900+0000","last_clean":"2024-04-25T09:07:37.639900+0000","last_became_active":"2024-04-25T09:07:37.635219+0000","last_became_peered":"2024-04-25T09:07:37.635219+0000","last_unstale":"2024-04-25T09:07:37.639900+0000","last_undegraded":"2024-04-25T09:07:37.639900+0000","last_fullsized":"2024-04-25T09:07:37.639900+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:42.758124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:07:37.615985+0000","last_change":"2024-04-25T09:07:36.612144+0000","last_active":"2024-04-25T09:07:37.615985+0000","last_peered":"2024-04-25T09:07:37.615985+0000","last_clean":"2024-04-25T09:07:37.615985+0000","last_became_active":"2024-04-25T09:07:36.610715+0000","last_became_peered":"2024-04-25T09:07:36.610715+0000","last_unstale":"2024-04-25T09:07:37.615985+0000","last_undegraded":"2024-04-25T09:07:37.615985+0000","last_fullsized":"2024-04-25T09:07:37.615985+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:07.868609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007975+0000","last_change":"2024-04-25T09:07:37.633546+0000","last_active":"2024-04-25T09:07:39.007975+0000","last_peered":"2024-04-25T09:07:39.007975+0000","last_clean":"2024-04-25T09:07:39.007975+0000","last_became_active":"2024-04-25T09:07:37.633279+0000","last_became_peered":"2024-04-25T09:07:37.633279+0000","last_unstale":"2024-04-25T09:07:39.007975+0000","last_undegraded":"2024-04-25T09:07:39.007975+0000","last_fullsized":"2024-04-25T09:07:39.007975+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:09.628669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621217+0000","last_change":"2024-04-25T09:07:36.615155+0000","last_active":"2024-04-25T09:07:38.621217+0000","last_peered":"2024-04-25T09:07:38.621217+0000","last_clean":"2024-04-25T09:07:38.621217+0000","last_became_active":"2024-04-25T09:07:36.614868+0000","last_became_peered":"2024-04-25T09:07:36.614868+0000","last_unstale":"2024-04-25T09:07:38.621217+0000","last_undegraded":"2024-04-25T09:07:38.621217+0000","last_fullsized":"2024-04-25T09:07:38.621217+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:09.685794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":284,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007974+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:07:39.007974+0000","last_peered":"2024-04-25T09:07:39.007974+0000","last_clean":"2024-04-25T09:07:39.007974+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:07:39.007974+0000","last_undegraded":"2024-04-25T09:07:39.007974+0000","last_fullsized":"2024-04-25T09:07:39.007974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1019904,"data_stored":464016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509503,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1011712,"data_stored":462438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509504,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1028096,"data_stored":464120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509503,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1011712,"data_stored":462986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509503,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36344,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335496,"statfs":{"total":96636764160,"available":96599547904,"internally_reserved":0,"allocated":1019904,"data_stored":463146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509504,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1015808,"data_stored":462516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509504,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59120,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312720,"statfs":{"total":96636764160,"available":96576225280,"internally_reserved":0,"allocated":1601536,"data_stored":1052772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36928,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334912,"statfs":{"total":96636764160,"available":96598949888,"internally_reserved":0,"allocated":1617920,"data_stored":1059486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:07:44.723 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:07:44.726 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:07:46.183 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:07:46.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.342+0000 7f41d9a00640 1 Processor -- start 2024-04-25T09:07:46.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.342+0000 7f41d9a00640 1 -- start start 2024-04-25T09:07:46.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.342+0000 7f41d9a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f41d4145250 0x7f41d415c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.342+0000 7f41d9a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f41d40cc8b0 0x7f41d40ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.342+0000 7f41d9a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d415cec0 con 0x7f41d4071320 2024-04-25T09:07:46.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.346+0000 7f41d9a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d406e7c0 con 0x7f41d40cc8b0 2024-04-25T09:07:46.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.346+0000 7f41d9a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d406d720 con 0x7f41d4145250 2024-04-25T09:07:46.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.346+0000 7f41ca000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f41d40cc8b0 0x7f41d40ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.346+0000 7f41ca000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f41d40cc8b0 0x7f41d40ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58832/0 (socket says 172.21.15.173:58832) 2024-04-25T09:07:46.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.346+0000 7f41ca000640 1 -- 172.21.15.173:0/2038398842 learned_addr learned my addr 172.21.15.173:0/2038398842 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:46.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.346+0000 7f41ca000640 1 -- 172.21.15.173:0/2038398842 >> v2:172.21.15.194:3300/0 conn(0x7f41d4145250 msgr2=0x7f41d415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:46.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.346+0000 7f41ca000640 1 --2- 172.21.15.173:0/2038398842 >> v2:172.21.15.194:3300/0 conn(0x7f41d4145250 0x7f41d415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.346+0000 7f41ca000640 1 -- 172.21.15.173:0/2038398842 >> v1:172.21.15.194:6789/0 conn(0x7f41d4071320 legacy=0x7f41d4071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:46.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.346+0000 7f41ca000640 1 -- 172.21.15.173:0/2038398842 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d406da00 con 0x7f41d40cc8b0 2024-04-25T09:07:46.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.346+0000 7f41ca000640 1 --2- 172.21.15.173:0/2038398842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d40cc8b0 0x7f41d40ccd30 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f41d40d0420 tx=0x7f41bc01c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b013b112faf6c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:46.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.346+0000 7f41d2000640 1 -- 172.21.15.173:0/2038398842 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc0b0070 con 0x7f41d40cc8b0 2024-04-25T09:07:46.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.346+0000 7f41d2000640 1 -- 172.21.15.173:0/2038398842 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc0ab600 con 0x7f41d40cc8b0 2024-04-25T09:07:46.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.346+0000 7f41d2000640 1 -- 172.21.15.173:0/2038398842 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc0ab9d0 con 0x7f41d40cc8b0 2024-04-25T09:07:46.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d9a00640 1 -- 172.21.15.173:0/2038398842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d40cc8b0 msgr2=0x7f41d40ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d9a00640 1 --2- 172.21.15.173:0/2038398842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d40cc8b0 0x7f41d40ccd30 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f41d40d0420 tx=0x7f41bc01c300 comp rx=0 tx=0).stop 2024-04-25T09:07:46.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d9a00640 1 -- 172.21.15.173:0/2038398842 shutdown_connections 2024-04-25T09:07:46.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d9a00640 1 --2- 172.21.15.173:0/2038398842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d40cc8b0 0x7f41d40ccd30 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d9a00640 1 --2- 172.21.15.173:0/2038398842 >> v2:172.21.15.194:3300/0 conn(0x7f41d4145250 0x7f41d415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d9a00640 1 -- 172.21.15.173:0/2038398842 >> 172.21.15.173:0/2038398842 conn(0x7f41d406ac90 msgr2=0x7f41d406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:46.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d9a00640 1 -- 172.21.15.173:0/2038398842 shutdown_connections 2024-04-25T09:07:46.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d9a00640 1 -- 172.21.15.173:0/2038398842 wait complete. 2024-04-25T09:07:46.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d9a00640 1 Processor -- start 2024-04-25T09:07:46.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d9a00640 1 -- start start 2024-04-25T09:07:46.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d9a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d4071320 0x7f41d4142a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41d40cc8b0 0x7f41d413ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d9a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41d4145250 0x7f41d415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d9a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d406ef80 con 0x7f41d4071320 2024-04-25T09:07:46.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d9a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d4145630 con 0x7f41d4145250 2024-04-25T09:07:46.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d406d380 con 0x7f41d40cc8b0 2024-04-25T09:07:46.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d4071320 0x7f41d4142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d4071320 0x7f41d4142a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58838/0 (socket says 172.21.15.173:58838) 2024-04-25T09:07:46.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d2a00640 1 -- 172.21.15.173:0/1035420793 learned_addr learned my addr 172.21.15.173:0/1035420793 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:46.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d3400640 1 --2- 172.21.15.173:0/1035420793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41d4145250 0x7f41d415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41ca000640 1 --2- 172.21.15.173:0/1035420793 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41d40cc8b0 0x7f41d413ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d2a00640 1 -- 172.21.15.173:0/1035420793 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41d40cc8b0 msgr2=0x7f41d413ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.350+0000 7f41d2a00640 1 --2- 172.21.15.173:0/1035420793 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41d40cc8b0 0x7f41d413ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.354+0000 7f41d2a00640 1 -- 172.21.15.173:0/1035420793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41d4145250 msgr2=0x7f41d415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.354+0000 7f41d2a00640 1 --2- 172.21.15.173:0/1035420793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41d4145250 0x7f41d415a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.354+0000 7f41d2a00640 1 -- 172.21.15.173:0/1035420793 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d415aa30 con 0x7f41d4071320 2024-04-25T09:07:46.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.354+0000 7f41d2a00640 1 --2- 172.21.15.173:0/1035420793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d4071320 0x7f41d4142a10 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f41c400b580 tx=0x7f41c400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:46.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.354+0000 7f41cb400640 1 -- 172.21.15.173:0/1035420793 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c4014070 con 0x7f41d4071320 2024-04-25T09:07:46.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.354+0000 7f41cb400640 1 -- 172.21.15.173:0/1035420793 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c4010890 con 0x7f41d4071320 2024-04-25T09:07:46.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.354+0000 7f41cb400640 1 -- 172.21.15.173:0/1035420793 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c4010c80 con 0x7f41d4071320 2024-04-25T09:07:46.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.354+0000 7f41d9a00640 1 -- 172.21.15.173:0/1035420793 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d413cb50 con 0x7f41d4071320 2024-04-25T09:07:46.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.354+0000 7f41d9a00640 1 -- 172.21.15.173:0/1035420793 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d413d0d0 con 0x7f41d4071320 2024-04-25T09:07:46.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.354+0000 7f41d9a00640 1 -- 172.21.15.173:0/1035420793 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d4073a40 con 0x7f41d4071320 2024-04-25T09:07:46.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.354+0000 7f41cb400640 1 -- 172.21.15.173:0/1035420793 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f41c4017070 con 0x7f41d4071320 2024-04-25T09:07:46.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.354+0000 7f41cb400640 1 --2- 172.21.15.173:0/1035420793 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f41b0066f60 0x7f41b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.354+0000 7f41cb400640 1 -- 172.21.15.173:0/1035420793 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f41c4084fe0 con 0x7f41d4071320 2024-04-25T09:07:46.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.354+0000 7f41ca000640 1 --2- 172.21.15.173:0/1035420793 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f41b0066f60 0x7f41b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.358+0000 7f41ca000640 1 --2- 172.21.15.173:0/1035420793 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f41b0066f60 0x7f41b0069420 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f41bc0ad000 tx=0x7f41bc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:46.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.358+0000 7f41cb400640 1 -- 172.21.15.173:0/1035420793 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f41c4055df0 con 0x7f41d4071320 2024-04-25T09:07:46.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.509+0000 7f41d9a00640 1 -- 172.21.15.173:0/1035420793 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41d40ae6b0 con 0x7f41b0066f60 2024-04-25T09:07:46.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.517+0000 7f41cb400640 1 -- 172.21.15.173:0/1035420793 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252021 (secure 0 0 0) 0x7f41d40ae6b0 con 0x7f41b0066f60 2024-04-25T09:07:46.507 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:46.508 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:07:46.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.521+0000 7f41d9a00640 1 -- 172.21.15.173:0/1035420793 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f41b0066f60 msgr2=0x7f41b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.521+0000 7f41d9a00640 1 --2- 172.21.15.173:0/1035420793 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f41b0066f60 0x7f41b0069420 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f41bc0ad000 tx=0x7f41bc0a6000 comp rx=0 tx=0).stop 2024-04-25T09:07:46.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.521+0000 7f41d9a00640 1 -- 172.21.15.173:0/1035420793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d4071320 msgr2=0x7f41d4142a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.521+0000 7f41d9a00640 1 --2- 172.21.15.173:0/1035420793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d4071320 0x7f41d4142a10 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f41c400b580 tx=0x7f41c400ba40 comp rx=0 tx=0).stop 2024-04-25T09:07:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.521+0000 7f41d9a00640 1 -- 172.21.15.173:0/1035420793 shutdown_connections 2024-04-25T09:07:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.521+0000 7f41d9a00640 1 --2- 172.21.15.173:0/1035420793 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f41b0066f60 0x7f41b0069420 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.521+0000 7f41d9a00640 1 --2- 172.21.15.173:0/1035420793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41d4145250 0x7f41d415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.521+0000 7f41d9a00640 1 --2- 172.21.15.173:0/1035420793 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41d40cc8b0 0x7f41d413ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.521+0000 7f41d9a00640 1 --2- 172.21.15.173:0/1035420793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d4071320 0x7f41d4142a10 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.521+0000 7f41d9a00640 1 -- 172.21.15.173:0/1035420793 >> 172.21.15.173:0/1035420793 conn(0x7f41d406ac90 msgr2=0x7f41d415bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.521+0000 7f41d9a00640 1 -- 172.21.15.173:0/1035420793 shutdown_connections 2024-04-25T09:07:46.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.521+0000 7f41d9a00640 1 -- 172.21.15.173:0/1035420793 wait complete. 2024-04-25T09:07:46.527 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2024-04-25T09:07:44.790534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":322452,"kb_used_data":9192,"kb_used_omap":12,"kb_used_meta":313139,"kb_avail":754652268,"statfs":{"total":773094113280,"available":772763922432,"internally_reserved":0,"allocated":9412608,"data_stored":4938324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":320654896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001720"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007909+0000","last_change":"2024-04-25T09:07:37.617619+0000","last_active":"2024-04-25T09:07:39.007909+0000","last_peered":"2024-04-25T09:07:39.007909+0000","last_clean":"2024-04-25T09:07:39.007909+0000","last_became_active":"2024-04-25T09:07:37.617302+0000","last_became_peered":"2024-04-25T09:07:37.617302+0000","last_unstale":"2024-04-25T09:07:39.007909+0000","last_undegraded":"2024-04-25T09:07:39.007909+0000","last_fullsized":"2024-04-25T09:07:39.007909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:56.952875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635118+0000","last_change":"2024-04-25T09:07:37.642120+0000","last_active":"2024-04-25T09:07:38.635118+0000","last_peered":"2024-04-25T09:07:38.635118+0000","last_clean":"2024-04-25T09:07:38.635118+0000","last_became_active":"2024-04-25T09:07:37.641706+0000","last_became_peered":"2024-04-25T09:07:37.641706+0000","last_unstale":"2024-04-25T09:07:38.635118+0000","last_undegraded":"2024-04-25T09:07:38.635118+0000","last_fullsized":"2024-04-25T09:07:38.635118+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:14.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.296394+0000","last_change":"2024-04-25T09:07:37.629356+0000","last_active":"2024-04-25T09:07:39.296394+0000","last_peered":"2024-04-25T09:07:39.296394+0000","last_clean":"2024-04-25T09:07:39.296394+0000","last_became_active":"2024-04-25T09:07:37.629071+0000","last_became_peered":"2024-04-25T09:07:37.629071+0000","last_unstale":"2024-04-25T09:07:39.296394+0000","last_undegraded":"2024-04-25T09:07:39.296394+0000","last_fullsized":"2024-04-25T09:07:39.296394+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:49.599992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.295404+0000","last_change":"2024-04-25T09:07:37.626588+0000","last_active":"2024-04-25T09:07:39.295404+0000","last_peered":"2024-04-25T09:07:39.295404+0000","last_clean":"2024-04-25T09:07:39.295404+0000","last_became_active":"2024-04-25T09:07:37.625527+0000","last_became_peered":"2024-04-25T09:07:37.625527+0000","last_unstale":"2024-04-25T09:07:39.295404+0000","last_undegraded":"2024-04-25T09:07:39.295404+0000","last_fullsized":"2024-04-25T09:07:39.295404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:36.782781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637267+0000","last_change":"2024-04-25T09:07:37.639626+0000","last_active":"2024-04-25T09:07:38.637267+0000","last_peered":"2024-04-25T09:07:38.637267+0000","last_clean":"2024-04-25T09:07:38.637267+0000","last_became_active":"2024-04-25T09:07:37.636488+0000","last_became_peered":"2024-04-25T09:07:37.636488+0000","last_unstale":"2024-04-25T09:07:38.637267+0000","last_undegraded":"2024-04-25T09:07:38.637267+0000","last_fullsized":"2024-04-25T09:07:38.637267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:33.387139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620739+0000","last_change":"2024-04-25T09:07:37.618282+0000","last_active":"2024-04-25T09:07:38.620739+0000","last_peered":"2024-04-25T09:07:38.620739+0000","last_clean":"2024-04-25T09:07:38.620739+0000","last_became_active":"2024-04-25T09:07:37.617980+0000","last_became_peered":"2024-04-25T09:07:37.617980+0000","last_unstale":"2024-04-25T09:07:38.620739+0000","last_undegraded":"2024-04-25T09:07:38.620739+0000","last_fullsized":"2024-04-25T09:07:38.620739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.374955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620911+0000","last_change":"2024-04-25T09:07:37.634612+0000","last_active":"2024-04-25T09:07:38.620911+0000","last_peered":"2024-04-25T09:07:38.620911+0000","last_clean":"2024-04-25T09:07:38.620911+0000","last_became_active":"2024-04-25T09:07:37.634272+0000","last_became_peered":"2024-04-25T09:07:37.634272+0000","last_unstale":"2024-04-25T09:07:38.620911+0000","last_undegraded":"2024-04-25T09:07:38.620911+0000","last_fullsized":"2024-04-25T09:07:38.620911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:24.395404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637140+0000","last_change":"2024-04-25T09:07:37.632445+0000","last_active":"2024-04-25T09:07:38.637140+0000","last_peered":"2024-04-25T09:07:38.637140+0000","last_clean":"2024-04-25T09:07:38.637140+0000","last_became_active":"2024-04-25T09:07:37.632100+0000","last_became_peered":"2024-04-25T09:07:37.632100+0000","last_unstale":"2024-04-25T09:07:38.637140+0000","last_undegraded":"2024-04-25T09:07:38.637140+0000","last_fullsized":"2024-04-25T09:07:38.637140+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:34.107400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621523+0000","last_change":"2024-04-25T09:07:37.620664+0000","last_active":"2024-04-25T09:07:38.621523+0000","last_peered":"2024-04-25T09:07:38.621523+0000","last_clean":"2024-04-25T09:07:38.621523+0000","last_became_active":"2024-04-25T09:07:37.620393+0000","last_became_peered":"2024-04-25T09:07:37.620393+0000","last_unstale":"2024-04-25T09:07:38.621523+0000","last_undegraded":"2024-04-25T09:07:38.621523+0000","last_fullsized":"2024-04-25T09:07:38.621523+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:37.691190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.295420+0000","last_change":"2024-04-25T09:07:37.628104+0000","last_active":"2024-04-25T09:07:39.295420+0000","last_peered":"2024-04-25T09:07:39.295420+0000","last_clean":"2024-04-25T09:07:39.295420+0000","last_became_active":"2024-04-25T09:07:37.627451+0000","last_became_peered":"2024-04-25T09:07:37.627451+0000","last_unstale":"2024-04-25T09:07:39.295420+0000","last_undegraded":"2024-04-25T09:07:39.295420+0000","last_fullsized":"2024-04-25T09:07:39.295420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:47.875931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635165+0000","last_change":"2024-04-25T09:07:37.638244+0000","last_active":"2024-04-25T09:07:38.635165+0000","last_peered":"2024-04-25T09:07:38.635165+0000","last_clean":"2024-04-25T09:07:38.635165+0000","last_became_active":"2024-04-25T09:07:37.637967+0000","last_became_peered":"2024-04-25T09:07:37.637967+0000","last_unstale":"2024-04-25T09:07:38.635165+0000","last_undegraded":"2024-04-25T09:07:38.635165+0000","last_fullsized":"2024-04-25T09:07:38.635165+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:40.123592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.295418+0000","last_change":"2024-04-25T09:07:37.628390+0000","last_active":"2024-04-25T09:07:39.295418+0000","last_peered":"2024-04-25T09:07:39.295418+0000","last_clean":"2024-04-25T09:07:39.295418+0000","last_became_active":"2024-04-25T09:07:37.628101+0000","last_became_peered":"2024-04-25T09:07:37.628101+0000","last_unstale":"2024-04-25T09:07:39.295418+0000","last_undegraded":"2024-04-25T09:07:39.295418+0000","last_fullsized":"2024-04-25T09:07:39.295418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:20.271525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637387+0000","last_change":"2024-04-25T09:07:37.644053+0000","last_active":"2024-04-25T09:07:38.637387+0000","last_peered":"2024-04-25T09:07:38.637387+0000","last_clean":"2024-04-25T09:07:38.637387+0000","last_became_active":"2024-04-25T09:07:37.643783+0000","last_became_peered":"2024-04-25T09:07:37.643783+0000","last_unstale":"2024-04-25T09:07:38.637387+0000","last_undegraded":"2024-04-25T09:07:38.637387+0000","last_fullsized":"2024-04-25T09:07:38.637387+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:57.907870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620774+0000","last_change":"2024-04-25T09:07:37.618084+0000","last_active":"2024-04-25T09:07:38.620774+0000","last_peered":"2024-04-25T09:07:38.620774+0000","last_clean":"2024-04-25T09:07:38.620774+0000","last_became_active":"2024-04-25T09:07:37.617758+0000","last_became_peered":"2024-04-25T09:07:37.617758+0000","last_unstale":"2024-04-25T09:07:38.620774+0000","last_undegraded":"2024-04-25T09:07:38.620774+0000","last_fullsized":"2024-04-25T09:07:38.620774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:53.134215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634782+0000","last_change":"2024-04-25T09:07:37.624978+0000","last_active":"2024-04-25T09:07:38.634782+0000","last_peered":"2024-04-25T09:07:38.634782+0000","last_clean":"2024-04-25T09:07:38.634782+0000","last_became_active":"2024-04-25T09:07:37.624509+0000","last_became_peered":"2024-04-25T09:07:37.624509+0000","last_unstale":"2024-04-25T09:07:38.634782+0000","last_undegraded":"2024-04-25T09:07:38.634782+0000","last_fullsized":"2024-04-25T09:07:38.634782+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:18.688958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007770+0000","last_change":"2024-04-25T09:07:37.626043+0000","last_active":"2024-04-25T09:07:39.007770+0000","last_peered":"2024-04-25T09:07:39.007770+0000","last_clean":"2024-04-25T09:07:39.007770+0000","last_became_active":"2024-04-25T09:07:37.625783+0000","last_became_peered":"2024-04-25T09:07:37.625783+0000","last_unstale":"2024-04-25T09:07:39.007770+0000","last_undegraded":"2024-04-25T09:07:39.007770+0000","last_fullsized":"2024-04-25T09:07:39.007770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:03.532182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637781+0000","last_change":"2024-04-25T09:07:37.639108+0000","last_active":"2024-04-25T09:07:38.637781+0000","last_peered":"2024-04-25T09:07:38.637781+0000","last_clean":"2024-04-25T09:07:38.637781+0000","last_became_active":"2024-04-25T09:07:37.638532+0000","last_became_peered":"2024-04-25T09:07:37.638532+0000","last_unstale":"2024-04-25T09:07:38.637781+0000","last_undegraded":"2024-04-25T09:07:38.637781+0000","last_fullsized":"2024-04-25T09:07:38.637781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:02.132000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.296321+0000","last_change":"2024-04-25T09:07:37.634860+0000","last_active":"2024-04-25T09:07:39.296321+0000","last_peered":"2024-04-25T09:07:39.296321+0000","last_clean":"2024-04-25T09:07:39.296321+0000","last_became_active":"2024-04-25T09:07:37.634582+0000","last_became_peered":"2024-04-25T09:07:37.634582+0000","last_unstale":"2024-04-25T09:07:39.296321+0000","last_undegraded":"2024-04-25T09:07:39.296321+0000","last_fullsized":"2024-04-25T09:07:39.296321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:29.619316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621086+0000","last_change":"2024-04-25T09:07:37.638340+0000","last_active":"2024-04-25T09:07:38.621086+0000","last_peered":"2024-04-25T09:07:38.621086+0000","last_clean":"2024-04-25T09:07:38.621086+0000","last_became_active":"2024-04-25T09:07:37.638060+0000","last_became_peered":"2024-04-25T09:07:37.638060+0000","last_unstale":"2024-04-25T09:07:38.621086+0000","last_undegraded":"2024-04-25T09:07:38.621086+0000","last_fullsized":"2024-04-25T09:07:38.621086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:09.628669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637578+0000","last_change":"2024-04-25T09:07:37.639988+0000","last_active":"2024-04-25T09:07:38.637578+0000","last_peered":"2024-04-25T09:07:38.637578+0000","last_clean":"2024-04-25T09:07:38.637578+0000","last_became_active":"2024-04-25T09:07:37.639263+0000","last_became_peered":"2024-04-25T09:07:37.639263+0000","last_unstale":"2024-04-25T09:07:38.637578+0000","last_undegraded":"2024-04-25T09:07:38.637578+0000","last_fullsized":"2024-04-25T09:07:38.637578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:38.575243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621067+0000","last_change":"2024-04-25T09:07:37.633413+0000","last_active":"2024-04-25T09:07:38.621067+0000","last_peered":"2024-04-25T09:07:38.621067+0000","last_clean":"2024-04-25T09:07:38.621067+0000","last_became_active":"2024-04-25T09:07:37.633132+0000","last_became_peered":"2024-04-25T09:07:37.633132+0000","last_unstale":"2024-04-25T09:07:38.621067+0000","last_undegraded":"2024-04-25T09:07:38.621067+0000","last_fullsized":"2024-04-25T09:07:38.621067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:41.064820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637379+0000","last_change":"2024-04-25T09:07:37.644962+0000","last_active":"2024-04-25T09:07:38.637379+0000","last_peered":"2024-04-25T09:07:38.637379+0000","last_clean":"2024-04-25T09:07:38.637379+0000","last_became_active":"2024-04-25T09:07:37.644695+0000","last_became_peered":"2024-04-25T09:07:37.644695+0000","last_unstale":"2024-04-25T09:07:38.637379+0000","last_undegraded":"2024-04-25T09:07:38.637379+0000","last_fullsized":"2024-04-25T09:07:38.637379+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:05:45.625216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.622028+0000","last_change":"2024-04-25T09:07:37.624852+0000","last_active":"2024-04-25T09:07:38.622028+0000","last_peered":"2024-04-25T09:07:38.622028+0000","last_clean":"2024-04-25T09:07:38.622028+0000","last_became_active":"2024-04-25T09:07:37.624552+0000","last_became_peered":"2024-04-25T09:07:37.624552+0000","last_unstale":"2024-04-25T09:07:38.622028+0000","last_undegraded":"2024-04-25T09:07:38.622028+0000","last_fullsized":"2024-04-25T09:07:38.622028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:55.922340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634678+0000","last_change":"2024-04-25T09:07:37.628098+0000","last_active":"2024-04-25T09:07:38.634678+0000","last_peered":"2024-04-25T09:07:38.634678+0000","last_clean":"2024-04-25T09:07:38.634678+0000","last_became_active":"2024-04-25T09:07:37.627827+0000","last_became_peered":"2024-04-25T09:07:37.627827+0000","last_unstale":"2024-04-25T09:07:38.634678+0000","last_undegraded":"2024-04-25T09:07:38.634678+0000","last_fullsized":"2024-04-25T09:07:38.634678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:45.887572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635119+0000","last_change":"2024-04-25T09:07:37.627502+0000","last_active":"2024-04-25T09:07:38.635119+0000","last_peered":"2024-04-25T09:07:38.635119+0000","last_clean":"2024-04-25T09:07:38.635119+0000","last_became_active":"2024-04-25T09:07:37.626614+0000","last_became_peered":"2024-04-25T09:07:37.626614+0000","last_unstale":"2024-04-25T09:07:38.635119+0000","last_undegraded":"2024-04-25T09:07:38.635119+0000","last_fullsized":"2024-04-25T09:07:38.635119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:52.345009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.295427+0000","last_change":"2024-04-25T09:07:37.630155+0000","last_active":"2024-04-25T09:07:39.295427+0000","last_peered":"2024-04-25T09:07:39.295427+0000","last_clean":"2024-04-25T09:07:39.295427+0000","last_became_active":"2024-04-25T09:07:37.629889+0000","last_became_peered":"2024-04-25T09:07:37.629889+0000","last_unstale":"2024-04-25T09:07:39.295427+0000","last_undegraded":"2024-04-25T09:07:39.295427+0000","last_fullsized":"2024-04-25T09:07:39.295427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:18.415368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007711+0000","last_change":"2024-04-25T09:07:37.630454+0000","last_active":"2024-04-25T09:07:39.007711+0000","last_peered":"2024-04-25T09:07:39.007711+0000","last_clean":"2024-04-25T09:07:39.007711+0000","last_became_active":"2024-04-25T09:07:37.629856+0000","last_became_peered":"2024-04-25T09:07:37.629856+0000","last_unstale":"2024-04-25T09:07:39.007711+0000","last_undegraded":"2024-04-25T09:07:39.007711+0000","last_fullsized":"2024-04-25T09:07:39.007711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:34.726656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637640+0000","last_change":"2024-04-25T09:07:37.638930+0000","last_active":"2024-04-25T09:07:38.637640+0000","last_peered":"2024-04-25T09:07:38.637640+0000","last_clean":"2024-04-25T09:07:38.637640+0000","last_became_active":"2024-04-25T09:07:37.637356+0000","last_became_peered":"2024-04-25T09:07:37.637356+0000","last_unstale":"2024-04-25T09:07:38.637640+0000","last_undegraded":"2024-04-25T09:07:38.637640+0000","last_fullsized":"2024-04-25T09:07:38.637640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:54.912036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634809+0000","last_change":"2024-04-25T09:07:37.620835+0000","last_active":"2024-04-25T09:07:38.634809+0000","last_peered":"2024-04-25T09:07:38.634809+0000","last_clean":"2024-04-25T09:07:38.634809+0000","last_became_active":"2024-04-25T09:07:37.620537+0000","last_became_peered":"2024-04-25T09:07:37.620537+0000","last_unstale":"2024-04-25T09:07:38.634809+0000","last_undegraded":"2024-04-25T09:07:38.634809+0000","last_fullsized":"2024-04-25T09:07:38.634809+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:25.439081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007497+0000","last_change":"2024-04-25T09:07:37.625368+0000","last_active":"2024-04-25T09:07:39.007497+0000","last_peered":"2024-04-25T09:07:39.007497+0000","last_clean":"2024-04-25T09:07:39.007497+0000","last_became_active":"2024-04-25T09:07:37.625078+0000","last_became_peered":"2024-04-25T09:07:37.625078+0000","last_unstale":"2024-04-25T09:07:39.007497+0000","last_undegraded":"2024-04-25T09:07:39.007497+0000","last_fullsized":"2024-04-25T09:07:39.007497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.374955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.296001+0000","last_change":"2024-04-25T09:07:37.625322+0000","last_active":"2024-04-25T09:07:39.296001+0000","last_peered":"2024-04-25T09:07:39.296001+0000","last_clean":"2024-04-25T09:07:39.296001+0000","last_became_active":"2024-04-25T09:07:37.624684+0000","last_became_peered":"2024-04-25T09:07:37.624684+0000","last_unstale":"2024-04-25T09:07:39.296001+0000","last_undegraded":"2024-04-25T09:07:39.296001+0000","last_fullsized":"2024-04-25T09:07:39.296001+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:40.395112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007739+0000","last_change":"2024-04-25T09:07:37.617988+0000","last_active":"2024-04-25T09:07:39.007739+0000","last_peered":"2024-04-25T09:07:39.007739+0000","last_clean":"2024-04-25T09:07:39.007739+0000","last_became_active":"2024-04-25T09:07:37.616534+0000","last_became_peered":"2024-04-25T09:07:37.616534+0000","last_unstale":"2024-04-25T09:07:39.007739+0000","last_undegraded":"2024-04-25T09:07:39.007739+0000","last_fullsized":"2024-04-25T09:07:39.007739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:53.134215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.296189+0000","last_change":"2024-04-25T09:07:37.626057+0000","last_active":"2024-04-25T09:07:39.296189+0000","last_peered":"2024-04-25T09:07:39.296189+0000","last_clean":"2024-04-25T09:07:39.296189+0000","last_became_active":"2024-04-25T09:07:37.625736+0000","last_became_peered":"2024-04-25T09:07:37.625736+0000","last_unstale":"2024-04-25T09:07:39.296189+0000","last_undegraded":"2024-04-25T09:07:39.296189+0000","last_fullsized":"2024-04-25T09:07:39.296189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:14.924562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"83'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637794+0000","last_change":"2024-04-25T09:07:36.616376+0000","last_active":"2024-04-25T09:07:38.637794+0000","last_peered":"2024-04-25T09:07:38.637794+0000","last_clean":"2024-04-25T09:07:38.637794+0000","last_became_active":"2024-04-25T09:07:36.616075+0000","last_became_peered":"2024-04-25T09:07:36.616075+0000","last_unstale":"2024-04-25T09:07:38.637794+0000","last_undegraded":"2024-04-25T09:07:38.637794+0000","last_fullsized":"2024-04-25T09:07:38.637794+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:26.377752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634935+0000","last_change":"2024-04-25T09:07:37.628208+0000","last_active":"2024-04-25T09:07:38.634935+0000","last_peered":"2024-04-25T09:07:38.634935+0000","last_clean":"2024-04-25T09:07:38.634935+0000","last_became_active":"2024-04-25T09:07:37.627848+0000","last_became_peered":"2024-04-25T09:07:37.627848+0000","last_unstale":"2024-04-25T09:07:38.634935+0000","last_undegraded":"2024-04-25T09:07:38.634935+0000","last_fullsized":"2024-04-25T09:07:38.634935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:24.857733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007882+0000","last_change":"2024-04-25T09:07:36.619079+0000","last_active":"2024-04-25T09:07:39.007882+0000","last_peered":"2024-04-25T09:07:39.007882+0000","last_clean":"2024-04-25T09:07:39.007882+0000","last_became_active":"2024-04-25T09:07:36.618396+0000","last_became_peered":"2024-04-25T09:07:36.618396+0000","last_unstale":"2024-04-25T09:07:39.007882+0000","last_undegraded":"2024-04-25T09:07:39.007882+0000","last_fullsized":"2024-04-25T09:07:39.007882+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:44.880581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621321+0000","last_change":"2024-04-25T09:07:37.628645+0000","last_active":"2024-04-25T09:07:38.621321+0000","last_peered":"2024-04-25T09:07:38.621321+0000","last_clean":"2024-04-25T09:07:38.621321+0000","last_became_active":"2024-04-25T09:07:37.628344+0000","last_became_peered":"2024-04-25T09:07:37.628344+0000","last_unstale":"2024-04-25T09:07:38.621321+0000","last_undegraded":"2024-04-25T09:07:38.621321+0000","last_fullsized":"2024-04-25T09:07:38.621321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:46.246638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007688+0000","last_change":"2024-04-25T09:07:36.618033+0000","last_active":"2024-04-25T09:07:39.007688+0000","last_peered":"2024-04-25T09:07:39.007688+0000","last_clean":"2024-04-25T09:07:39.007688+0000","last_became_active":"2024-04-25T09:07:36.617755+0000","last_became_peered":"2024-04-25T09:07:36.617755+0000","last_unstale":"2024-04-25T09:07:39.007688+0000","last_undegraded":"2024-04-25T09:07:39.007688+0000","last_fullsized":"2024-04-25T09:07:39.007688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:28.529536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621071+0000","last_change":"2024-04-25T09:07:37.633374+0000","last_active":"2024-04-25T09:07:38.621071+0000","last_peered":"2024-04-25T09:07:38.621071+0000","last_clean":"2024-04-25T09:07:38.621071+0000","last_became_active":"2024-04-25T09:07:37.633097+0000","last_became_peered":"2024-04-25T09:07:37.633097+0000","last_unstale":"2024-04-25T09:07:38.621071+0000","last_undegraded":"2024-04-25T09:07:38.621071+0000","last_fullsized":"2024-04-25T09:07:38.621071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:04.260863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620809+0000","last_change":"2024-04-25T09:07:36.615481+0000","last_active":"2024-04-25T09:07:38.620809+0000","last_peered":"2024-04-25T09:07:38.620809+0000","last_clean":"2024-04-25T09:07:38.620809+0000","last_became_active":"2024-04-25T09:07:36.615203+0000","last_became_peered":"2024-04-25T09:07:36.615203+0000","last_unstale":"2024-04-25T09:07:38.620809+0000","last_undegraded":"2024-04-25T09:07:38.620809+0000","last_fullsized":"2024-04-25T09:07:38.620809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:03.253872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635044+0000","last_change":"2024-04-25T09:07:37.642388+0000","last_active":"2024-04-25T09:07:38.635044+0000","last_peered":"2024-04-25T09:07:38.635044+0000","last_clean":"2024-04-25T09:07:38.635044+0000","last_became_active":"2024-04-25T09:07:37.641673+0000","last_became_peered":"2024-04-25T09:07:37.641673+0000","last_unstale":"2024-04-25T09:07:38.635044+0000","last_undegraded":"2024-04-25T09:07:38.635044+0000","last_fullsized":"2024-04-25T09:07:38.635044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:01.788399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621200+0000","last_change":"2024-04-25T09:07:36.616454+0000","last_active":"2024-04-25T09:07:38.621200+0000","last_peered":"2024-04-25T09:07:38.621200+0000","last_clean":"2024-04-25T09:07:38.621200+0000","last_became_active":"2024-04-25T09:07:36.616058+0000","last_became_peered":"2024-04-25T09:07:36.616058+0000","last_unstale":"2024-04-25T09:07:38.621200+0000","last_undegraded":"2024-04-25T09:07:38.621200+0000","last_fullsized":"2024-04-25T09:07:38.621200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:19.115185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635202+0000","last_change":"2024-04-25T09:07:37.645238+0000","last_active":"2024-04-25T09:07:38.635202+0000","last_peered":"2024-04-25T09:07:38.635202+0000","last_clean":"2024-04-25T09:07:38.635202+0000","last_became_active":"2024-04-25T09:07:37.644352+0000","last_became_peered":"2024-04-25T09:07:37.644352+0000","last_unstale":"2024-04-25T09:07:38.635202+0000","last_undegraded":"2024-04-25T09:07:38.635202+0000","last_fullsized":"2024-04-25T09:07:38.635202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.374955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.295022+0000","last_change":"2024-04-25T09:07:36.610047+0000","last_active":"2024-04-25T09:07:39.295022+0000","last_peered":"2024-04-25T09:07:39.295022+0000","last_clean":"2024-04-25T09:07:39.295022+0000","last_became_active":"2024-04-25T09:07:36.609786+0000","last_became_peered":"2024-04-25T09:07:36.609786+0000","last_unstale":"2024-04-25T09:07:39.295022+0000","last_undegraded":"2024-04-25T09:07:39.295022+0000","last_fullsized":"2024-04-25T09:07:39.295022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:14.391941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621584+0000","last_change":"2024-04-25T09:07:37.617101+0000","last_active":"2024-04-25T09:07:38.621584+0000","last_peered":"2024-04-25T09:07:38.621584+0000","last_clean":"2024-04-25T09:07:38.621584+0000","last_became_active":"2024-04-25T09:07:37.616000+0000","last_became_peered":"2024-04-25T09:07:37.616000+0000","last_unstale":"2024-04-25T09:07:38.621584+0000","last_undegraded":"2024-04-25T09:07:38.621584+0000","last_fullsized":"2024-04-25T09:07:38.621584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:55.162579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634902+0000","last_change":"2024-04-25T09:07:36.614605+0000","last_active":"2024-04-25T09:07:38.634902+0000","last_peered":"2024-04-25T09:07:38.634902+0000","last_clean":"2024-04-25T09:07:38.634902+0000","last_became_active":"2024-04-25T09:07:36.614349+0000","last_became_peered":"2024-04-25T09:07:36.614349+0000","last_unstale":"2024-04-25T09:07:38.634902+0000","last_undegraded":"2024-04-25T09:07:38.634902+0000","last_fullsized":"2024-04-25T09:07:38.634902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:39.401019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621551+0000","last_change":"2024-04-25T09:07:37.642318+0000","last_active":"2024-04-25T09:07:38.621551+0000","last_peered":"2024-04-25T09:07:38.621551+0000","last_clean":"2024-04-25T09:07:38.621551+0000","last_became_active":"2024-04-25T09:07:37.641879+0000","last_became_peered":"2024-04-25T09:07:37.641879+0000","last_unstale":"2024-04-25T09:07:38.621551+0000","last_undegraded":"2024-04-25T09:07:38.621551+0000","last_fullsized":"2024-04-25T09:07:38.621551+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:33.063248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637137+0000","last_change":"2024-04-25T09:07:36.616980+0000","last_active":"2024-04-25T09:07:38.637137+0000","last_peered":"2024-04-25T09:07:38.637137+0000","last_clean":"2024-04-25T09:07:38.637137+0000","last_became_active":"2024-04-25T09:07:36.616698+0000","last_became_peered":"2024-04-25T09:07:36.616698+0000","last_unstale":"2024-04-25T09:07:38.637137+0000","last_undegraded":"2024-04-25T09:07:38.637137+0000","last_fullsized":"2024-04-25T09:07:38.637137+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:05.199952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634687+0000","last_change":"2024-04-25T09:07:37.618246+0000","last_active":"2024-04-25T09:07:38.634687+0000","last_peered":"2024-04-25T09:07:38.634687+0000","last_clean":"2024-04-25T09:07:38.634687+0000","last_became_active":"2024-04-25T09:07:37.617992+0000","last_became_peered":"2024-04-25T09:07:37.617992+0000","last_unstale":"2024-04-25T09:07:38.634687+0000","last_undegraded":"2024-04-25T09:07:38.634687+0000","last_fullsized":"2024-04-25T09:07:38.634687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:15.922910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007920+0000","last_change":"2024-04-25T09:07:36.623042+0000","last_active":"2024-04-25T09:07:39.007920+0000","last_peered":"2024-04-25T09:07:39.007920+0000","last_clean":"2024-04-25T09:07:39.007920+0000","last_became_active":"2024-04-25T09:07:36.622793+0000","last_became_peered":"2024-04-25T09:07:36.622793+0000","last_unstale":"2024-04-25T09:07:39.007920+0000","last_undegraded":"2024-04-25T09:07:39.007920+0000","last_fullsized":"2024-04-25T09:07:39.007920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:17.681967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.295121+0000","last_change":"2024-04-25T09:07:37.629312+0000","last_active":"2024-04-25T09:07:39.295121+0000","last_peered":"2024-04-25T09:07:39.295121+0000","last_clean":"2024-04-25T09:07:39.295121+0000","last_became_active":"2024-04-25T09:07:37.627276+0000","last_became_peered":"2024-04-25T09:07:37.627276+0000","last_unstale":"2024-04-25T09:07:39.295121+0000","last_undegraded":"2024-04-25T09:07:39.295121+0000","last_fullsized":"2024-04-25T09:07:39.295121+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:29.321692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.295576+0000","last_change":"2024-04-25T09:07:36.613966+0000","last_active":"2024-04-25T09:07:39.295576+0000","last_peered":"2024-04-25T09:07:39.295576+0000","last_clean":"2024-04-25T09:07:39.295576+0000","last_became_active":"2024-04-25T09:07:36.613700+0000","last_became_peered":"2024-04-25T09:07:36.613700+0000","last_unstale":"2024-04-25T09:07:39.295576+0000","last_undegraded":"2024-04-25T09:07:39.295576+0000","last_fullsized":"2024-04-25T09:07:39.295576+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:56.184210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620920+0000","last_change":"2024-04-25T09:07:37.624293+0000","last_active":"2024-04-25T09:07:38.620920+0000","last_peered":"2024-04-25T09:07:38.620920+0000","last_clean":"2024-04-25T09:07:38.620920+0000","last_became_active":"2024-04-25T09:07:37.624036+0000","last_became_peered":"2024-04-25T09:07:37.624036+0000","last_unstale":"2024-04-25T09:07:38.620920+0000","last_undegraded":"2024-04-25T09:07:38.620920+0000","last_fullsized":"2024-04-25T09:07:38.620920+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:34.726656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"83'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637768+0000","last_change":"2024-04-25T09:07:36.621681+0000","last_active":"2024-04-25T09:07:38.637768+0000","last_peered":"2024-04-25T09:07:38.637768+0000","last_clean":"2024-04-25T09:07:38.637768+0000","last_became_active":"2024-04-25T09:07:36.621425+0000","last_became_peered":"2024-04-25T09:07:36.621425+0000","last_unstale":"2024-04-25T09:07:38.637768+0000","last_undegraded":"2024-04-25T09:07:38.637768+0000","last_fullsized":"2024-04-25T09:07:38.637768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:12.826909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.296168+0000","last_change":"2024-04-25T09:07:37.631958+0000","last_active":"2024-04-25T09:07:39.296168+0000","last_peered":"2024-04-25T09:07:39.296168+0000","last_clean":"2024-04-25T09:07:39.296168+0000","last_became_active":"2024-04-25T09:07:37.631694+0000","last_became_peered":"2024-04-25T09:07:37.631694+0000","last_unstale":"2024-04-25T09:07:39.296168+0000","last_undegraded":"2024-04-25T09:07:39.296168+0000","last_fullsized":"2024-04-25T09:07:39.296168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:04.076645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"83'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620920+0000","last_change":"2024-04-25T09:07:36.605032+0000","last_active":"2024-04-25T09:07:38.620920+0000","last_peered":"2024-04-25T09:07:38.620920+0000","last_clean":"2024-04-25T09:07:38.620920+0000","last_became_active":"2024-04-25T09:07:36.603703+0000","last_became_peered":"2024-04-25T09:07:36.603703+0000","last_unstale":"2024-04-25T09:07:38.620920+0000","last_undegraded":"2024-04-25T09:07:38.620920+0000","last_fullsized":"2024-04-25T09:07:38.620920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:45.239647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.295630+0000","last_change":"2024-04-25T09:07:37.628226+0000","last_active":"2024-04-25T09:07:39.295630+0000","last_peered":"2024-04-25T09:07:39.295630+0000","last_clean":"2024-04-25T09:07:39.295630+0000","last_became_active":"2024-04-25T09:07:37.625863+0000","last_became_peered":"2024-04-25T09:07:37.625863+0000","last_unstale":"2024-04-25T09:07:39.295630+0000","last_undegraded":"2024-04-25T09:07:39.295630+0000","last_fullsized":"2024-04-25T09:07:39.295630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:21.235880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.295040+0000","last_change":"2024-04-25T09:07:36.611263+0000","last_active":"2024-04-25T09:07:39.295040+0000","last_peered":"2024-04-25T09:07:39.295040+0000","last_clean":"2024-04-25T09:07:39.295040+0000","last_became_active":"2024-04-25T09:07:36.610934+0000","last_became_peered":"2024-04-25T09:07:36.610934+0000","last_unstale":"2024-04-25T09:07:39.295040+0000","last_undegraded":"2024-04-25T09:07:39.295040+0000","last_fullsized":"2024-04-25T09:07:39.295040+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:32.093652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621017+0000","last_change":"2024-04-25T09:07:37.625227+0000","last_active":"2024-04-25T09:07:38.621017+0000","last_peered":"2024-04-25T09:07:38.621017+0000","last_clean":"2024-04-25T09:07:38.621017+0000","last_became_active":"2024-04-25T09:07:37.624685+0000","last_became_peered":"2024-04-25T09:07:37.624685+0000","last_unstale":"2024-04-25T09:07:38.621017+0000","last_undegraded":"2024-04-25T09:07:38.621017+0000","last_fullsized":"2024-04-25T09:07:38.621017+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:15.398932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007520+0000","last_change":"2024-04-25T09:07:36.620051+0000","last_active":"2024-04-25T09:07:39.007520+0000","last_peered":"2024-04-25T09:07:39.007520+0000","last_clean":"2024-04-25T09:07:39.007520+0000","last_became_active":"2024-04-25T09:07:36.619717+0000","last_became_peered":"2024-04-25T09:07:36.619717+0000","last_unstale":"2024-04-25T09:07:39.007520+0000","last_undegraded":"2024-04-25T09:07:39.007520+0000","last_fullsized":"2024-04-25T09:07:39.007520+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:17.664094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620865+0000","last_change":"2024-04-25T09:07:37.623281+0000","last_active":"2024-04-25T09:07:38.620865+0000","last_peered":"2024-04-25T09:07:38.620865+0000","last_clean":"2024-04-25T09:07:38.620865+0000","last_became_active":"2024-04-25T09:07:37.622461+0000","last_became_peered":"2024-04-25T09:07:37.622461+0000","last_unstale":"2024-04-25T09:07:38.620865+0000","last_undegraded":"2024-04-25T09:07:38.620865+0000","last_fullsized":"2024-04-25T09:07:38.620865+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:33.100643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637133+0000","last_change":"2024-04-25T09:07:36.617283+0000","last_active":"2024-04-25T09:07:38.637133+0000","last_peered":"2024-04-25T09:07:38.637133+0000","last_clean":"2024-04-25T09:07:38.637133+0000","last_became_active":"2024-04-25T09:07:36.615973+0000","last_became_peered":"2024-04-25T09:07:36.615973+0000","last_unstale":"2024-04-25T09:07:38.637133+0000","last_undegraded":"2024-04-25T09:07:38.637133+0000","last_fullsized":"2024-04-25T09:07:38.637133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:08.020375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621771+0000","last_change":"2024-04-25T09:07:37.628648+0000","last_active":"2024-04-25T09:07:38.621771+0000","last_peered":"2024-04-25T09:07:38.621771+0000","last_clean":"2024-04-25T09:07:38.621771+0000","last_became_active":"2024-04-25T09:07:37.627443+0000","last_became_peered":"2024-04-25T09:07:37.627443+0000","last_unstale":"2024-04-25T09:07:38.621771+0000","last_undegraded":"2024-04-25T09:07:38.621771+0000","last_fullsized":"2024-04-25T09:07:38.621771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:21.781597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"83'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634813+0000","last_change":"2024-04-25T09:07:36.601617+0000","last_active":"2024-04-25T09:07:38.634813+0000","last_peered":"2024-04-25T09:07:38.634813+0000","last_clean":"2024-04-25T09:07:38.634813+0000","last_became_active":"2024-04-25T09:07:36.601323+0000","last_became_peered":"2024-04-25T09:07:36.601323+0000","last_unstale":"2024-04-25T09:07:38.634813+0000","last_undegraded":"2024-04-25T09:07:38.634813+0000","last_fullsized":"2024-04-25T09:07:38.634813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:41.678865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620974+0000","last_change":"2024-04-25T09:07:37.627836+0000","last_active":"2024-04-25T09:07:38.620974+0000","last_peered":"2024-04-25T09:07:38.620974+0000","last_clean":"2024-04-25T09:07:38.620974+0000","last_became_active":"2024-04-25T09:07:37.627568+0000","last_became_peered":"2024-04-25T09:07:37.627568+0000","last_unstale":"2024-04-25T09:07:38.620974+0000","last_undegraded":"2024-04-25T09:07:38.620974+0000","last_fullsized":"2024-04-25T09:07:38.620974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:56.952875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.008068+0000","last_change":"2024-04-25T09:07:36.621694+0000","last_active":"2024-04-25T09:07:39.008068+0000","last_peered":"2024-04-25T09:07:39.008068+0000","last_clean":"2024-04-25T09:07:39.008068+0000","last_became_active":"2024-04-25T09:07:36.621503+0000","last_became_peered":"2024-04-25T09:07:36.621503+0000","last_unstale":"2024-04-25T09:07:39.008068+0000","last_undegraded":"2024-04-25T09:07:39.008068+0000","last_fullsized":"2024-04-25T09:07:39.008068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:24.432090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637180+0000","last_change":"2024-04-25T09:07:37.635114+0000","last_active":"2024-04-25T09:07:38.637180+0000","last_peered":"2024-04-25T09:07:38.637180+0000","last_clean":"2024-04-25T09:07:38.637180+0000","last_became_active":"2024-04-25T09:07:37.634833+0000","last_became_peered":"2024-04-25T09:07:37.634833+0000","last_unstale":"2024-04-25T09:07:38.637180+0000","last_undegraded":"2024-04-25T09:07:38.637180+0000","last_fullsized":"2024-04-25T09:07:38.637180+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:53.605713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621693+0000","last_change":"2024-04-25T09:07:36.616078+0000","last_active":"2024-04-25T09:07:38.621693+0000","last_peered":"2024-04-25T09:07:38.621693+0000","last_clean":"2024-04-25T09:07:38.621693+0000","last_became_active":"2024-04-25T09:07:36.615403+0000","last_became_peered":"2024-04-25T09:07:36.615403+0000","last_unstale":"2024-04-25T09:07:38.621693+0000","last_undegraded":"2024-04-25T09:07:38.621693+0000","last_fullsized":"2024-04-25T09:07:38.621693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:15.009651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637101+0000","last_change":"2024-04-25T09:07:37.646400+0000","last_active":"2024-04-25T09:07:38.637101+0000","last_peered":"2024-04-25T09:07:38.637101+0000","last_clean":"2024-04-25T09:07:38.637101+0000","last_became_active":"2024-04-25T09:07:37.646129+0000","last_became_peered":"2024-04-25T09:07:37.646129+0000","last_unstale":"2024-04-25T09:07:38.637101+0000","last_undegraded":"2024-04-25T09:07:38.637101+0000","last_fullsized":"2024-04-25T09:07:38.637101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:02.389276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637780+0000","last_change":"2024-04-25T09:07:36.617644+0000","last_active":"2024-04-25T09:07:38.637780+0000","last_peered":"2024-04-25T09:07:38.637780+0000","last_clean":"2024-04-25T09:07:38.637780+0000","last_became_active":"2024-04-25T09:07:36.616325+0000","last_became_peered":"2024-04-25T09:07:36.616325+0000","last_unstale":"2024-04-25T09:07:38.637780+0000","last_undegraded":"2024-04-25T09:07:38.637780+0000","last_fullsized":"2024-04-25T09:07:38.637780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:31.620809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620896+0000","last_change":"2024-04-25T09:07:37.639937+0000","last_active":"2024-04-25T09:07:38.620896+0000","last_peered":"2024-04-25T09:07:38.620896+0000","last_clean":"2024-04-25T09:07:38.620896+0000","last_became_active":"2024-04-25T09:07:37.633606+0000","last_became_peered":"2024-04-25T09:07:37.633606+0000","last_unstale":"2024-04-25T09:07:38.620896+0000","last_undegraded":"2024-04-25T09:07:38.620896+0000","last_fullsized":"2024-04-25T09:07:38.620896+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:03.532182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.296074+0000","last_change":"2024-04-25T09:07:36.622372+0000","last_active":"2024-04-25T09:07:39.296074+0000","last_peered":"2024-04-25T09:07:39.296074+0000","last_clean":"2024-04-25T09:07:39.296074+0000","last_became_active":"2024-04-25T09:07:36.622088+0000","last_became_peered":"2024-04-25T09:07:36.622088+0000","last_unstale":"2024-04-25T09:07:39.296074+0000","last_undegraded":"2024-04-25T09:07:39.296074+0000","last_fullsized":"2024-04-25T09:07:39.296074+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:35.244653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635171+0000","last_change":"2024-04-25T09:07:37.629723+0000","last_active":"2024-04-25T09:07:38.635171+0000","last_peered":"2024-04-25T09:07:38.635171+0000","last_clean":"2024-04-25T09:07:38.635171+0000","last_became_active":"2024-04-25T09:07:37.629081+0000","last_became_peered":"2024-04-25T09:07:37.629081+0000","last_unstale":"2024-04-25T09:07:38.635171+0000","last_undegraded":"2024-04-25T09:07:38.635171+0000","last_fullsized":"2024-04-25T09:07:38.635171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:36.626956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620850+0000","last_change":"2024-04-25T09:07:36.619552+0000","last_active":"2024-04-25T09:07:38.620850+0000","last_peered":"2024-04-25T09:07:38.620850+0000","last_clean":"2024-04-25T09:07:38.620850+0000","last_became_active":"2024-04-25T09:07:36.619248+0000","last_became_peered":"2024-04-25T09:07:36.619248+0000","last_unstale":"2024-04-25T09:07:38.620850+0000","last_undegraded":"2024-04-25T09:07:38.620850+0000","last_fullsized":"2024-04-25T09:07:38.620850+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:17.681967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.635263+0000","last_change":"2024-04-25T09:07:37.622142+0000","last_active":"2024-04-25T09:07:38.635263+0000","last_peered":"2024-04-25T09:07:38.635263+0000","last_clean":"2024-04-25T09:07:38.635263+0000","last_became_active":"2024-04-25T09:07:37.621887+0000","last_became_peered":"2024-04-25T09:07:37.621887+0000","last_unstale":"2024-04-25T09:07:38.635263+0000","last_undegraded":"2024-04-25T09:07:38.635263+0000","last_fullsized":"2024-04-25T09:07:38.635263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:53.134215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620629+0000","last_change":"2024-04-25T09:07:36.611689+0000","last_active":"2024-04-25T09:07:38.620629+0000","last_peered":"2024-04-25T09:07:38.620629+0000","last_clean":"2024-04-25T09:07:38.620629+0000","last_became_active":"2024-04-25T09:07:36.611363+0000","last_became_peered":"2024-04-25T09:07:36.611363+0000","last_unstale":"2024-04-25T09:07:38.620629+0000","last_undegraded":"2024-04-25T09:07:38.620629+0000","last_fullsized":"2024-04-25T09:07:38.620629+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:14.915918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621924+0000","last_change":"2024-04-25T09:07:37.627431+0000","last_active":"2024-04-25T09:07:38.621924+0000","last_peered":"2024-04-25T09:07:38.621924+0000","last_clean":"2024-04-25T09:07:38.621924+0000","last_became_active":"2024-04-25T09:07:37.627171+0000","last_became_peered":"2024-04-25T09:07:37.627171+0000","last_unstale":"2024-04-25T09:07:38.621924+0000","last_undegraded":"2024-04-25T09:07:38.621924+0000","last_fullsized":"2024-04-25T09:07:38.621924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:38.473267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620530+0000","last_change":"2024-04-25T09:07:36.614988+0000","last_active":"2024-04-25T09:07:38.620530+0000","last_peered":"2024-04-25T09:07:38.620530+0000","last_clean":"2024-04-25T09:07:38.620530+0000","last_became_active":"2024-04-25T09:07:36.614690+0000","last_became_peered":"2024-04-25T09:07:36.614690+0000","last_unstale":"2024-04-25T09:07:38.620530+0000","last_undegraded":"2024-04-25T09:07:38.620530+0000","last_fullsized":"2024-04-25T09:07:38.620530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:24.432090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621771+0000","last_change":"2024-04-25T09:07:37.621882+0000","last_active":"2024-04-25T09:07:38.621771+0000","last_peered":"2024-04-25T09:07:38.621771+0000","last_clean":"2024-04-25T09:07:38.621771+0000","last_became_active":"2024-04-25T09:07:37.621628+0000","last_became_peered":"2024-04-25T09:07:37.621628+0000","last_unstale":"2024-04-25T09:07:38.621771+0000","last_undegraded":"2024-04-25T09:07:38.621771+0000","last_fullsized":"2024-04-25T09:07:38.621771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:44.455585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.295454+0000","last_change":"2024-04-25T09:07:36.618544+0000","last_active":"2024-04-25T09:07:39.295454+0000","last_peered":"2024-04-25T09:07:39.295454+0000","last_clean":"2024-04-25T09:07:39.295454+0000","last_became_active":"2024-04-25T09:07:36.618264+0000","last_became_peered":"2024-04-25T09:07:36.618264+0000","last_unstale":"2024-04-25T09:07:39.295454+0000","last_undegraded":"2024-04-25T09:07:39.295454+0000","last_fullsized":"2024-04-25T09:07:39.295454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:23.388413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621069+0000","last_change":"2024-04-25T09:07:37.623868+0000","last_active":"2024-04-25T09:07:38.621069+0000","last_peered":"2024-04-25T09:07:38.621069+0000","last_clean":"2024-04-25T09:07:38.621069+0000","last_became_active":"2024-04-25T09:07:37.623586+0000","last_became_peered":"2024-04-25T09:07:37.623586+0000","last_unstale":"2024-04-25T09:07:38.621069+0000","last_undegraded":"2024-04-25T09:07:38.621069+0000","last_fullsized":"2024-04-25T09:07:38.621069+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:57.191201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"84'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.636608+0000","last_change":"2024-04-25T09:07:36.620391+0000","last_active":"2024-04-25T09:07:38.636608+0000","last_peered":"2024-04-25T09:07:38.636608+0000","last_clean":"2024-04-25T09:07:38.636608+0000","last_became_active":"2024-04-25T09:07:36.619820+0000","last_became_peered":"2024-04-25T09:07:36.619820+0000","last_unstale":"2024-04-25T09:07:38.636608+0000","last_undegraded":"2024-04-25T09:07:38.636608+0000","last_fullsized":"2024-04-25T09:07:38.636608+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:50.109112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621494+0000","last_change":"2024-04-25T09:07:37.621282+0000","last_active":"2024-04-25T09:07:38.621494+0000","last_peered":"2024-04-25T09:07:38.621494+0000","last_clean":"2024-04-25T09:07:38.621494+0000","last_became_active":"2024-04-25T09:07:37.620633+0000","last_became_peered":"2024-04-25T09:07:37.620633+0000","last_unstale":"2024-04-25T09:07:38.621494+0000","last_undegraded":"2024-04-25T09:07:38.621494+0000","last_fullsized":"2024-04-25T09:07:38.621494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:45.953616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007978+0000","last_change":"2024-04-25T09:07:36.617437+0000","last_active":"2024-04-25T09:07:39.007978+0000","last_peered":"2024-04-25T09:07:39.007978+0000","last_clean":"2024-04-25T09:07:39.007978+0000","last_became_active":"2024-04-25T09:07:36.617117+0000","last_became_peered":"2024-04-25T09:07:36.617117+0000","last_unstale":"2024-04-25T09:07:39.007978+0000","last_undegraded":"2024-04-25T09:07:39.007978+0000","last_fullsized":"2024-04-25T09:07:39.007978+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:14.915918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.634889+0000","last_change":"2024-04-25T09:07:37.617426+0000","last_active":"2024-04-25T09:07:38.634889+0000","last_peered":"2024-04-25T09:07:38.634889+0000","last_clean":"2024-04-25T09:07:38.634889+0000","last_became_active":"2024-04-25T09:07:37.617172+0000","last_became_peered":"2024-04-25T09:07:37.617172+0000","last_unstale":"2024-04-25T09:07:38.634889+0000","last_undegraded":"2024-04-25T09:07:38.634889+0000","last_fullsized":"2024-04-25T09:07:38.634889+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:10.692785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007701+0000","last_change":"2024-04-25T09:07:36.619230+0000","last_active":"2024-04-25T09:07:39.007701+0000","last_peered":"2024-04-25T09:07:39.007701+0000","last_clean":"2024-04-25T09:07:39.007701+0000","last_became_active":"2024-04-25T09:07:36.618957+0000","last_became_peered":"2024-04-25T09:07:36.618957+0000","last_unstale":"2024-04-25T09:07:39.007701+0000","last_undegraded":"2024-04-25T09:07:39.007701+0000","last_fullsized":"2024-04-25T09:07:39.007701+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:31.128980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621380+0000","last_change":"2024-04-25T09:07:37.628246+0000","last_active":"2024-04-25T09:07:38.621380+0000","last_peered":"2024-04-25T09:07:38.621380+0000","last_clean":"2024-04-25T09:07:38.621380+0000","last_became_active":"2024-04-25T09:07:37.623529+0000","last_became_peered":"2024-04-25T09:07:37.623529+0000","last_unstale":"2024-04-25T09:07:38.621380+0000","last_undegraded":"2024-04-25T09:07:38.621380+0000","last_fullsized":"2024-04-25T09:07:38.621380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:54.940460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.620686+0000","last_change":"2024-04-25T09:07:36.612649+0000","last_active":"2024-04-25T09:07:38.620686+0000","last_peered":"2024-04-25T09:07:38.620686+0000","last_clean":"2024-04-25T09:07:38.620686+0000","last_became_active":"2024-04-25T09:07:36.611900+0000","last_became_peered":"2024-04-25T09:07:36.611900+0000","last_unstale":"2024-04-25T09:07:38.620686+0000","last_undegraded":"2024-04-25T09:07:38.620686+0000","last_fullsized":"2024-04-25T09:07:38.620686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:40.057829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621211+0000","last_change":"2024-04-25T09:07:37.634630+0000","last_active":"2024-04-25T09:07:38.621211+0000","last_peered":"2024-04-25T09:07:38.621211+0000","last_clean":"2024-04-25T09:07:38.621211+0000","last_became_active":"2024-04-25T09:07:37.634242+0000","last_became_peered":"2024-04-25T09:07:37.634242+0000","last_unstale":"2024-04-25T09:07:38.621211+0000","last_undegraded":"2024-04-25T09:07:38.621211+0000","last_fullsized":"2024-04-25T09:07:38.621211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:40.108001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.637258+0000","last_change":"2024-04-25T09:07:36.617056+0000","last_active":"2024-04-25T09:07:38.637258+0000","last_peered":"2024-04-25T09:07:38.637258+0000","last_clean":"2024-04-25T09:07:38.637258+0000","last_became_active":"2024-04-25T09:07:36.616846+0000","last_became_peered":"2024-04-25T09:07:36.616846+0000","last_unstale":"2024-04-25T09:07:38.637258+0000","last_undegraded":"2024-04-25T09:07:38.637258+0000","last_fullsized":"2024-04-25T09:07:38.637258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:07.592728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.296290+0000","last_change":"2024-04-25T09:07:37.629289+0000","last_active":"2024-04-25T09:07:39.296290+0000","last_peered":"2024-04-25T09:07:39.296290+0000","last_clean":"2024-04-25T09:07:39.296290+0000","last_became_active":"2024-04-25T09:07:37.629029+0000","last_became_peered":"2024-04-25T09:07:37.629029+0000","last_unstale":"2024-04-25T09:07:39.296290+0000","last_undegraded":"2024-04-25T09:07:39.296290+0000","last_fullsized":"2024-04-25T09:07:39.296290+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:58.717778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621190+0000","last_change":"2024-04-25T09:07:36.605134+0000","last_active":"2024-04-25T09:07:38.621190+0000","last_peered":"2024-04-25T09:07:38.621190+0000","last_clean":"2024-04-25T09:07:38.621190+0000","last_became_active":"2024-04-25T09:07:36.604853+0000","last_became_peered":"2024-04-25T09:07:36.604853+0000","last_unstale":"2024-04-25T09:07:38.621190+0000","last_undegraded":"2024-04-25T09:07:38.621190+0000","last_fullsized":"2024-04-25T09:07:38.621190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:44.946625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.296452+0000","last_change":"2024-04-25T09:07:37.635406+0000","last_active":"2024-04-25T09:07:39.296452+0000","last_peered":"2024-04-25T09:07:39.296452+0000","last_clean":"2024-04-25T09:07:39.296452+0000","last_became_active":"2024-04-25T09:07:37.635219+0000","last_became_peered":"2024-04-25T09:07:37.635219+0000","last_unstale":"2024-04-25T09:07:39.296452+0000","last_undegraded":"2024-04-25T09:07:39.296452+0000","last_fullsized":"2024-04-25T09:07:39.296452+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:03.494576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.295932+0000","last_change":"2024-04-25T09:07:36.612144+0000","last_active":"2024-04-25T09:07:39.295932+0000","last_peered":"2024-04-25T09:07:39.295932+0000","last_clean":"2024-04-25T09:07:39.295932+0000","last_became_active":"2024-04-25T09:07:36.610715+0000","last_became_peered":"2024-04-25T09:07:36.610715+0000","last_unstale":"2024-04-25T09:07:39.295932+0000","last_undegraded":"2024-04-25T09:07:39.295932+0000","last_fullsized":"2024-04-25T09:07:39.295932+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:07.868609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007975+0000","last_change":"2024-04-25T09:07:37.633546+0000","last_active":"2024-04-25T09:07:39.007975+0000","last_peered":"2024-04-25T09:07:39.007975+0000","last_clean":"2024-04-25T09:07:39.007975+0000","last_became_active":"2024-04-25T09:07:37.633279+0000","last_became_peered":"2024-04-25T09:07:37.633279+0000","last_unstale":"2024-04-25T09:07:39.007975+0000","last_undegraded":"2024-04-25T09:07:39.007975+0000","last_fullsized":"2024-04-25T09:07:39.007975+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:36.589349+0000","last_clean_scrub_stamp":"2024-04-25T09:07:36.589349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:09.628669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:38.621217+0000","last_change":"2024-04-25T09:07:36.615155+0000","last_active":"2024-04-25T09:07:38.621217+0000","last_peered":"2024-04-25T09:07:38.621217+0000","last_clean":"2024-04-25T09:07:38.621217+0000","last_became_active":"2024-04-25T09:07:36.614868+0000","last_became_peered":"2024-04-25T09:07:36.614868+0000","last_unstale":"2024-04-25T09:07:38.621217+0000","last_undegraded":"2024-04-25T09:07:38.621217+0000","last_fullsized":"2024-04-25T09:07:38.621217+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:35.582358+0000","last_clean_scrub_stamp":"2024-04-25T09:07:35.582358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:09.685794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":284,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:07:39.007974+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:07:39.007974+0000","last_peered":"2024-04-25T09:07:39.007974+0000","last_clean":"2024-04-25T09:07:39.007974+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:07:39.007974+0000","last_undegraded":"2024-04-25T09:07:39.007974+0000","last_fullsized":"2024-04-25T09:07:39.007974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509504,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1032192,"data_stored":470708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509504,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1024000,"data_stored":469130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509505,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1040384,"data_stored":470812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509504,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1024000,"data_stored":469678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509504,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1032192,"data_stored":469838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509505,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1028096,"data_stored":469208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509505,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59124,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312716,"statfs":{"total":96636764160,"available":96576221184,"internally_reserved":0,"allocated":1613824,"data_stored":1059464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36928,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334912,"statfs":{"total":96636764160,"available":96598949888,"internally_reserved":0,"allocated":1617920,"data_stored":1059486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:07:46.531 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:07:46.532 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:07:46.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.729+0000 7f5b10400640 1 Processor -- start 2024-04-25T09:07:46.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.729+0000 7f5b10400640 1 -- start start 2024-04-25T09:07:46.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.729+0000 7f5b10400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5b08159f00 0x7f5b080cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.729+0000 7f5b10400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0815ddd0 con 0x7f5b080cff40 2024-04-25T09:07:46.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.729+0000 7f5b10400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0815e0b0 con 0x7f5b080cda00 2024-04-25T09:07:46.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.729+0000 7f5b10400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0815e390 con 0x7f5b08159f00 2024-04-25T09:07:46.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.733+0000 7f5b0da00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5b08159f00 0x7f5b080cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.733+0000 7f5b0d000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f5b080cff40 0x7f5b080cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:52628/0 (socket says 172.21.15.173:52628) 2024-04-25T09:07:46.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.733+0000 7f5b0d000640 1 -- 172.21.15.173:0/3678352615 learned_addr learned my addr 172.21.15.173:0/3678352615 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:46.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.733+0000 7f5b0da00640 1 -- 172.21.15.173:0/3678352615 >> v1:172.21.15.194:6789/0 conn(0x7f5b080cda00 legacy=0x7f5b08071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:46.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.733+0000 7f5b0da00640 1 -- 172.21.15.173:0/3678352615 >> v1:172.21.15.173:6789/0 conn(0x7f5b080cff40 legacy=0x7f5b080cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.733+0000 7f5b07e00640 1 -- 172.21.15.173:0/3678352615 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828753702 0 0) 0x7f5b0815ddd0 con 0x7f5b080cff40 2024-04-25T09:07:46.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.733+0000 7f5b0da00640 1 -- 172.21.15.173:0/3678352615 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0815e670 con 0x7f5b08159f00 2024-04-25T09:07:46.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.733+0000 7f5b0da00640 1 --2- 172.21.15.173:0/3678352615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b08159f00 0x7f5b080cb960 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0097c0 tx=0x7f5afc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7391f9529ac90823 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:46.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.733+0000 7f5b07e00640 1 -- 172.21.15.173:0/3678352615 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0b1070 con 0x7f5b08159f00 2024-04-25T09:07:46.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.733+0000 7f5b07e00640 1 -- 172.21.15.173:0/3678352615 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc0ac410 con 0x7f5b08159f00 2024-04-25T09:07:46.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.733+0000 7f5b07e00640 1 -- 172.21.15.173:0/3678352615 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0ac7e0 con 0x7f5b08159f00 2024-04-25T09:07:46.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b10400640 1 -- 172.21.15.173:0/3678352615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b08159f00 msgr2=0x7f5b080cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b10400640 1 --2- 172.21.15.173:0/3678352615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b08159f00 0x7f5b080cb960 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0097c0 tx=0x7f5afc01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b10400640 1 -- 172.21.15.173:0/3678352615 shutdown_connections 2024-04-25T09:07:46.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b10400640 1 --2- 172.21.15.173:0/3678352615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b08159f00 0x7f5b080cb960 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b10400640 1 -- 172.21.15.173:0/3678352615 >> 172.21.15.173:0/3678352615 conn(0x7f5b0806ac90 msgr2=0x7f5b0806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:46.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b10400640 1 -- 172.21.15.173:0/3678352615 shutdown_connections 2024-04-25T09:07:46.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b10400640 1 -- 172.21.15.173:0/3678352615 wait complete. 2024-04-25T09:07:46.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b10400640 1 Processor -- start 2024-04-25T09:07:46.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b10400640 1 -- start start 2024-04-25T09:07:46.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b10400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b080cda00 0x7f5b0814d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b10400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b080cff40 0x7f5b081fa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b10400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b08159f00 0x7f5b081f9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b10400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b080cc230 con 0x7f5b080cda00 2024-04-25T09:07:46.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b10400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b080cc0b0 con 0x7f5b080cff40 2024-04-25T09:07:46.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b10400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b080cc3b0 con 0x7f5b08159f00 2024-04-25T09:07:46.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b0da00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b080cda00 0x7f5b0814d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b0da00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b080cda00 0x7f5b0814d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58864/0 (socket says 172.21.15.173:58864) 2024-04-25T09:07:46.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b0da00640 1 -- 172.21.15.173:0/3140989392 learned_addr learned my addr 172.21.15.173:0/3140989392 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:46.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b0d000640 1 --2- 172.21.15.173:0/3140989392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b080cff40 0x7f5b081fa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b0e400640 1 --2- 172.21.15.173:0/3140989392 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b08159f00 0x7f5b081f9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b0da00640 1 -- 172.21.15.173:0/3140989392 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b08159f00 msgr2=0x7f5b081f9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b0da00640 1 --2- 172.21.15.173:0/3140989392 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b08159f00 0x7f5b081f9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b0da00640 1 -- 172.21.15.173:0/3140989392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b080cff40 msgr2=0x7f5b081fa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b0da00640 1 --2- 172.21.15.173:0/3140989392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b080cff40 0x7f5b081fa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.737+0000 7f5b0da00640 1 -- 172.21.15.173:0/3140989392 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0814a400 con 0x7f5b080cda00 2024-04-25T09:07:46.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.741+0000 7f5b0da00640 1 --2- 172.21.15.173:0/3140989392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b080cda00 0x7f5b0814d170 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0af040 tx=0x7f5afc019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:46.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.741+0000 7f5b05600640 1 -- 172.21.15.173:0/3140989392 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0b1040 con 0x7f5b080cda00 2024-04-25T09:07:46.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.741+0000 7f5b05600640 1 -- 172.21.15.173:0/3140989392 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc0bb070 con 0x7f5b080cda00 2024-04-25T09:07:46.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.741+0000 7f5b10400640 1 -- 172.21.15.173:0/3140989392 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0814a6e0 con 0x7f5b080cda00 2024-04-25T09:07:46.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.741+0000 7f5b05600640 1 -- 172.21.15.173:0/3140989392 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0b5670 con 0x7f5b080cda00 2024-04-25T09:07:46.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.741+0000 7f5b10400640 1 -- 172.21.15.173:0/3140989392 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0814aca0 con 0x7f5b080cda00 2024-04-25T09:07:46.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.741+0000 7f5b10400640 1 -- 172.21.15.173:0/3140989392 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b08073ab0 con 0x7f5b080cda00 2024-04-25T09:07:46.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.741+0000 7f5b05600640 1 -- 172.21.15.173:0/3140989392 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5afc0b5810 con 0x7f5b080cda00 2024-04-25T09:07:46.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.741+0000 7f5b05600640 1 --2- 172.21.15.173:0/3140989392 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5ae8066f60 0x7f5ae8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.741+0000 7f5b05600640 1 -- 172.21.15.173:0/3140989392 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5afc11ef30 con 0x7f5b080cda00 2024-04-25T09:07:46.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.741+0000 7f5b0d000640 1 --2- 172.21.15.173:0/3140989392 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5ae8066f60 0x7f5ae8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.741+0000 7f5b0d000640 1 --2- 172.21.15.173:0/3140989392 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5ae8066f60 0x7f5ae8069420 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5af4007fd0 tx=0x7f5af4007ba0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:46.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.745+0000 7f5b05600640 1 -- 172.21.15.173:0/3140989392 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5afc016090 con 0x7f5b080cda00 2024-04-25T09:07:46.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.953+0000 7f5b10400640 1 -- 172.21.15.173:0/3140989392 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5b0815d720 con 0x7f5b080cda00 2024-04-25T09:07:46.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.957+0000 7f5b05600640 1 -- 172.21.15.173:0/3140989392 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+147 (secure 0 0 0) 0x7f5afc0efc80 con 0x7f5b080cda00 2024-04-25T09:07:46.946 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2024-04-25T09:07:46.946 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w== 2024-04-25T09:07:46.946 INFO:teuthology.orchestra.run.smithi173.stdout: caps mds = "allow" 2024-04-25T09:07:46.946 INFO:teuthology.orchestra.run.smithi173.stdout: caps mon = "allow r" 2024-04-25T09:07:46.946 INFO:teuthology.orchestra.run.smithi173.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:07:46.946 INFO:teuthology.orchestra.run.smithi173.stderr:updated caps for client.0 2024-04-25T09:07:46.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.961+0000 7f5b10400640 1 -- 172.21.15.173:0/3140989392 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5ae8066f60 msgr2=0x7f5ae8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.961+0000 7f5b10400640 1 --2- 172.21.15.173:0/3140989392 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5ae8066f60 0x7f5ae8069420 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5af4007fd0 tx=0x7f5af4007ba0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.961+0000 7f5b10400640 1 -- 172.21.15.173:0/3140989392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b080cda00 msgr2=0x7f5b0814d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.961+0000 7f5b10400640 1 --2- 172.21.15.173:0/3140989392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b080cda00 0x7f5b0814d170 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0af040 tx=0x7f5afc019240 comp rx=0 tx=0).stop 2024-04-25T09:07:46.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.961+0000 7f5b10400640 1 -- 172.21.15.173:0/3140989392 shutdown_connections 2024-04-25T09:07:46.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.961+0000 7f5b10400640 1 --2- 172.21.15.173:0/3140989392 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5ae8066f60 0x7f5ae8069420 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.961+0000 7f5b10400640 1 --2- 172.21.15.173:0/3140989392 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b08159f00 0x7f5b081f9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.961+0000 7f5b10400640 1 --2- 172.21.15.173:0/3140989392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b080cff40 0x7f5b081fa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.961+0000 7f5b10400640 1 --2- 172.21.15.173:0/3140989392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b080cda00 0x7f5b0814d170 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.961+0000 7f5b10400640 1 -- 172.21.15.173:0/3140989392 >> 172.21.15.173:0/3140989392 conn(0x7f5b0806ac90 msgr2=0x7f5b0814f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:46.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.961+0000 7f5b10400640 1 -- 172.21.15.173:0/3140989392 shutdown_connections 2024-04-25T09:07:46.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:46.961+0000 7f5b10400640 1 -- 172.21.15.173:0/3140989392 wait complete. 2024-04-25T09:07:46.967 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:47.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.113+0000 7f3a5fc00640 1 Processor -- start 2024-04-25T09:07:47.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.113+0000 7f3a5fc00640 1 -- start start 2024-04-25T09:07:47.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.117+0000 7f3a5fc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a580b3e70 0x7f3a580b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.117+0000 7f3a5fc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3a580aefa0 0x7f3a580b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.117+0000 7f3a5fc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3a5815edd0 0x7f3a580b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.117+0000 7f3a5fc00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5806dd50 con 0x7f3a5815edd0 2024-04-25T09:07:47.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.117+0000 7f3a5fc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a580b4790 con 0x7f3a580aefa0 2024-04-25T09:07:47.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.117+0000 7f3a5fc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5815f320 con 0x7f3a580b3e70 2024-04-25T09:07:47.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.117+0000 7f3a5dc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3a5815edd0 0x7f3a580b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.117+0000 7f3a5dc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3a5815edd0 0x7f3a580b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58876/0 (socket says 172.21.15.173:58876) 2024-04-25T09:07:47.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.117+0000 7f3a5dc00640 1 -- 172.21.15.173:0/428928999 learned_addr learned my addr 172.21.15.173:0/428928999 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:47.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.117+0000 7f3a57e00640 1 --2- 172.21.15.173:0/428928999 >> v2:172.21.15.194:3300/0 conn(0x7f3a580aefa0 0x7f3a580b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.117+0000 7f3a5d200640 1 --2- 172.21.15.173:0/428928999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a580b3e70 0x7f3a580b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.117+0000 7f3a5dc00640 1 -- 172.21.15.173:0/428928999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a580b3e70 msgr2=0x7f3a580b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:47.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.117+0000 7f3a5dc00640 1 --2- 172.21.15.173:0/428928999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a580b3e70 0x7f3a580b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.117+0000 7f3a5dc00640 1 -- 172.21.15.173:0/428928999 >> v2:172.21.15.194:3300/0 conn(0x7f3a580aefa0 msgr2=0x7f3a580b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:47.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.117+0000 7f3a5dc00640 1 --2- 172.21.15.173:0/428928999 >> v2:172.21.15.194:3300/0 conn(0x7f3a580aefa0 0x7f3a580b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.117+0000 7f3a5dc00640 1 -- 172.21.15.173:0/428928999 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5806d420 con 0x7f3a5815edd0 2024-04-25T09:07:47.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.117+0000 7f3a5d200640 1 --2- 172.21.15.173:0/428928999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a580b3e70 0x7f3a580b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:47.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.121+0000 7f3a5dc00640 1 --2- 172.21.15.173:0/428928999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a5815edd0 0x7f3a580b2cb0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f3a58062550 tx=0x7f3a5001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4638e41ee92f1c97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:47.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.121+0000 7f3a57400640 1 -- 172.21.15.173:0/428928999 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a500aa430 con 0x7f3a5815edd0 2024-04-25T09:07:47.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.121+0000 7f3a57400640 1 -- 172.21.15.173:0/428928999 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a500af070 con 0x7f3a5815edd0 2024-04-25T09:07:47.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.121+0000 7f3a57400640 1 -- 172.21.15.173:0/428928999 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a500aa7f0 con 0x7f3a5815edd0 2024-04-25T09:07:47.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.121+0000 7f3a5fc00640 1 -- 172.21.15.173:0/428928999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a5815edd0 msgr2=0x7f3a580b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.121+0000 7f3a5fc00640 1 --2- 172.21.15.173:0/428928999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a5815edd0 0x7f3a580b2cb0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f3a58062550 tx=0x7f3a5001c4f0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.121+0000 7f3a5fc00640 1 -- 172.21.15.173:0/428928999 shutdown_connections 2024-04-25T09:07:47.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.121+0000 7f3a5fc00640 1 --2- 172.21.15.173:0/428928999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a5815edd0 0x7f3a580b2cb0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.121+0000 7f3a5fc00640 1 --2- 172.21.15.173:0/428928999 >> v2:172.21.15.194:3300/0 conn(0x7f3a580aefa0 0x7f3a580b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.121+0000 7f3a5fc00640 1 --2- 172.21.15.173:0/428928999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a580b3e70 0x7f3a580b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.121+0000 7f3a5fc00640 1 -- 172.21.15.173:0/428928999 >> 172.21.15.173:0/428928999 conn(0x7f3a5806ac90 msgr2=0x7f3a5806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:47.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.121+0000 7f3a5fc00640 1 -- 172.21.15.173:0/428928999 shutdown_connections 2024-04-25T09:07:47.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.121+0000 7f3a5fc00640 1 -- 172.21.15.173:0/428928999 wait complete. 2024-04-25T09:07:47.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.121+0000 7f3a5fc00640 1 Processor -- start 2024-04-25T09:07:47.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.121+0000 7f3a5fc00640 1 -- start start 2024-04-25T09:07:47.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a5fc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a580aefa0 0x7f3a5814de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a5fc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a580b3e70 0x7f3a580cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a5fc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5815edd0 0x7f3a580d0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a5fc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5806e1c0 con 0x7f3a580b3e70 2024-04-25T09:07:47.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a5fc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580b3600 con 0x7f3a5815edd0 2024-04-25T09:07:47.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a5fc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5806e340 con 0x7f3a580aefa0 2024-04-25T09:07:47.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a57e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a580b3e70 0x7f3a580cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a57e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a580b3e70 0x7f3a580cfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58888/0 (socket says 172.21.15.173:58888) 2024-04-25T09:07:47.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a57e00640 1 -- 172.21.15.173:0/2973096133 learned_addr learned my addr 172.21.15.173:0/2973096133 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:47.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a5d200640 1 --2- 172.21.15.173:0/2973096133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a580aefa0 0x7f3a5814de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a5dc00640 1 --2- 172.21.15.173:0/2973096133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5815edd0 0x7f3a580d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a57e00640 1 -- 172.21.15.173:0/2973096133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a580aefa0 msgr2=0x7f3a5814de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a57e00640 1 --2- 172.21.15.173:0/2973096133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a580aefa0 0x7f3a5814de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a57e00640 1 -- 172.21.15.173:0/2973096133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5815edd0 msgr2=0x7f3a580d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a57e00640 1 --2- 172.21.15.173:0/2973096133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5815edd0 0x7f3a580d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a57e00640 1 -- 172.21.15.173:0/2973096133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5814e3d0 con 0x7f3a580b3e70 2024-04-25T09:07:47.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a57e00640 1 --2- 172.21.15.173:0/2973096133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a580b3e70 0x7f3a580cfd10 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400d830 tx=0x7f3a4400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:47.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a54c00640 1 -- 172.21.15.173:0/2973096133 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44018030 con 0x7f3a580b3e70 2024-04-25T09:07:47.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a54c00640 1 -- 172.21.15.173:0/2973096133 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4400be10 con 0x7f3a580b3e70 2024-04-25T09:07:47.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a54c00640 1 -- 172.21.15.173:0/2973096133 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a440098b0 con 0x7f3a580b3e70 2024-04-25T09:07:47.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a5fc00640 1 -- 172.21.15.173:0/2973096133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5815c740 con 0x7f3a580b3e70 2024-04-25T09:07:47.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a5fc00640 1 -- 172.21.15.173:0/2973096133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5815cd00 con 0x7f3a580b3e70 2024-04-25T09:07:47.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a5fc00640 1 -- 172.21.15.173:0/2973096133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a58073a40 con 0x7f3a580b3e70 2024-04-25T09:07:47.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.125+0000 7f3a54c00640 1 -- 172.21.15.173:0/2973096133 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3a4401b070 con 0x7f3a580b3e70 2024-04-25T09:07:47.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.129+0000 7f3a54c00640 1 --2- 172.21.15.173:0/2973096133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3a38066f90 0x7f3a38069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.129+0000 7f3a54c00640 1 -- 172.21.15.173:0/2973096133 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3a44085250 con 0x7f3a580b3e70 2024-04-25T09:07:47.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.129+0000 7f3a5d200640 1 --2- 172.21.15.173:0/2973096133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3a38066f90 0x7f3a38069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.129+0000 7f3a5d200640 1 --2- 172.21.15.173:0/2973096133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3a38066f90 0x7f3a38069450 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3a4800f500 tx=0x7f3a48007770 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:47.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.133+0000 7f3a54c00640 1 -- 172.21.15.173:0/2973096133 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3a440559e0 con 0x7f3a580b3e70 2024-04-25T09:07:47.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.321+0000 7f3a5fc00640 1 -- 172.21.15.173:0/2973096133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a5806e540 con 0x7f3a580b3e70 2024-04-25T09:07:47.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.321+0000 7f3a54c00640 1 -- 172.21.15.173:0/2973096133 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f3a44059a80 con 0x7f3a580b3e70 2024-04-25T09:07:47.309 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:07:47.309 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":55,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2817126227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2817126227},{"type":"v1","addr":"172.21.15.194:6835","nonce":2817126227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":6772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3100146198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3100146198},{"type":"v1","addr":"172.21.15.194:6834","nonce":3100146198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":7251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3600648366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3600648366},{"type":"v1","addr":"172.21.15.173:6835","nonce":3600648366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:36.982841+0000","modified":"2024-04-25T09:07:40.013688+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7263":{"gid":7263,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/2444108646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2444108646},{"type":"v1","addr":"172.21.15.173:6837","nonce":2444108646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:07:47.309 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 55 2024-04-25T09:07:47.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.321+0000 7f3a5fc00640 1 -- 172.21.15.173:0/2973096133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3a38066f90 msgr2=0x7f3a38069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.321+0000 7f3a5fc00640 1 --2- 172.21.15.173:0/2973096133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3a38066f90 0x7f3a38069450 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3a4800f500 tx=0x7f3a48007770 comp rx=0 tx=0).stop 2024-04-25T09:07:47.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.321+0000 7f3a5fc00640 1 -- 172.21.15.173:0/2973096133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a580b3e70 msgr2=0x7f3a580cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.321+0000 7f3a5fc00640 1 --2- 172.21.15.173:0/2973096133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a580b3e70 0x7f3a580cfd10 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400d830 tx=0x7f3a4400dcf0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.321+0000 7f3a5fc00640 1 -- 172.21.15.173:0/2973096133 shutdown_connections 2024-04-25T09:07:47.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.321+0000 7f3a5fc00640 1 --2- 172.21.15.173:0/2973096133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3a38066f90 0x7f3a38069450 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.321+0000 7f3a5fc00640 1 --2- 172.21.15.173:0/2973096133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a5815edd0 0x7f3a580d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.321+0000 7f3a5fc00640 1 --2- 172.21.15.173:0/2973096133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a580b3e70 0x7f3a580cfd10 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.321+0000 7f3a5fc00640 1 --2- 172.21.15.173:0/2973096133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a580aefa0 0x7f3a5814de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.321+0000 7f3a5fc00640 1 -- 172.21.15.173:0/2973096133 >> 172.21.15.173:0/2973096133 conn(0x7f3a5806ac90 msgr2=0x7f3a580adbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:47.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.321+0000 7f3a5fc00640 1 -- 172.21.15.173:0/2973096133 shutdown_connections 2024-04-25T09:07:47.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.321+0000 7f3a5fc00640 1 -- 172.21.15.173:0/2973096133 wait complete. 2024-04-25T09:07:47.732 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:07:36.982841+0000', 'modified': '2024-04-25T09:07:40.013688+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7263}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7263': {'gid': 7263, 'name': 'a', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.173:6837/2444108646', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6836', 'nonce': 2444108646}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 2444108646}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:07:47.732 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:07:47.733 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:07:47.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.885+0000 7fbd54200640 1 Processor -- start 2024-04-25T09:07:47.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.885+0000 7fbd54200640 1 -- start start 2024-04-25T09:07:47.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.885+0000 7fbd54200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbd4c06f5b0 0x7fbd4c0aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.885+0000 7fbd54200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c06fa20 con 0x7fbd4c0ad3f0 2024-04-25T09:07:47.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.885+0000 7fbd54200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c06ae30 con 0x7fbd4c06e1c0 2024-04-25T09:07:47.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.885+0000 7fbd54200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c0b3170 con 0x7fbd4c06f5b0 2024-04-25T09:07:47.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.885+0000 7fbd52200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fbd4c0ad3f0 0x7fbd4c1677c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:52636/0 (socket says 172.21.15.173:52636) 2024-04-25T09:07:47.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.885+0000 7fbd52200640 1 -- 172.21.15.173:0/2561589109 learned_addr learned my addr 172.21.15.173:0/2561589109 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:07:47.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.885+0000 7fbd50e00640 1 --2- 172.21.15.173:0/2561589109 >> v2:172.21.15.194:3300/0 conn(0x7fbd4c06f5b0 0x7fbd4c0aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.885+0000 7fbd4be00640 1 -- 172.21.15.173:0/2561589109 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270295000 0 0) 0x7fbd4c06fa20 con 0x7fbd4c0ad3f0 2024-04-25T09:07:47.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.885+0000 7fbd4be00640 1 -- 172.21.15.173:0/2561589109 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd34003530 con 0x7fbd4c0ad3f0 2024-04-25T09:07:47.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.885+0000 7fbd50e00640 1 -- 172.21.15.173:0/2561589109 >> v1:172.21.15.194:6789/0 conn(0x7fbd4c06e1c0 legacy=0x7fbd4c06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.885+0000 7fbd50e00640 1 -- 172.21.15.173:0/2561589109 >> v1:172.21.15.173:6789/0 conn(0x7fbd4c0ad3f0 legacy=0x7fbd4c1677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.885+0000 7fbd50e00640 1 -- 172.21.15.173:0/2561589109 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c06b110 con 0x7fbd4c06f5b0 2024-04-25T09:07:47.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.889+0000 7fbd50e00640 1 --2- 172.21.15.173:0/2561589109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd4c06f5b0 0x7fbd4c0aceb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbd380097c0 tx=0x7fbd3801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=778f6d27f452c872 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:47.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.889+0000 7fbd4be00640 1 -- 172.21.15.173:0/2561589109 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd380b5070 con 0x7fbd4c06f5b0 2024-04-25T09:07:47.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.889+0000 7fbd4be00640 1 -- 172.21.15.173:0/2561589109 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd380a8990 con 0x7fbd4c06f5b0 2024-04-25T09:07:47.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.889+0000 7fbd4be00640 1 -- 172.21.15.173:0/2561589109 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd380a8d60 con 0x7fbd4c06f5b0 2024-04-25T09:07:47.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.889+0000 7fbd54200640 1 -- 172.21.15.173:0/2561589109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd4c06f5b0 msgr2=0x7fbd4c0aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.889+0000 7fbd54200640 1 --2- 172.21.15.173:0/2561589109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd4c06f5b0 0x7fbd4c0aceb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbd380097c0 tx=0x7fbd3801ec90 comp rx=0 tx=0).stop 2024-04-25T09:07:47.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.889+0000 7fbd54200640 1 -- 172.21.15.173:0/2561589109 shutdown_connections 2024-04-25T09:07:47.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.889+0000 7fbd54200640 1 --2- 172.21.15.173:0/2561589109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd4c06f5b0 0x7fbd4c0aceb0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.889+0000 7fbd54200640 1 -- 172.21.15.173:0/2561589109 >> 172.21.15.173:0/2561589109 conn(0x7fbd4c0cfed0 msgr2=0x7fbd4c0d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:47.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.889+0000 7fbd54200640 1 -- 172.21.15.173:0/2561589109 shutdown_connections 2024-04-25T09:07:47.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.889+0000 7fbd54200640 1 -- 172.21.15.173:0/2561589109 wait complete. 2024-04-25T09:07:47.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd54200640 1 Processor -- start 2024-04-25T09:07:47.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd54200640 1 -- start start 2024-04-25T09:07:47.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd54200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd4c06e1c0 0x7fbd4c1f7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd54200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd4c06f5b0 0x7fbd4c145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd54200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd4c0ad3f0 0x7fbd4c145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd54200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c06b6d0 con 0x7fbd4c06e1c0 2024-04-25T09:07:47.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd54200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c15e070 con 0x7fbd4c0ad3f0 2024-04-25T09:07:47.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd54200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c06b9b0 con 0x7fbd4c06f5b0 2024-04-25T09:07:47.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd51800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd4c06e1c0 0x7fbd4c1f7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd51800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd4c06e1c0 0x7fbd4c1f7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58894/0 (socket says 172.21.15.173:58894) 2024-04-25T09:07:47.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd51800640 1 -- 172.21.15.173:0/3132660202 learned_addr learned my addr 172.21.15.173:0/3132660202 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:47.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd50e00640 1 --2- 172.21.15.173:0/3132660202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd4c06f5b0 0x7fbd4c145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd52200640 1 --2- 172.21.15.173:0/3132660202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd4c0ad3f0 0x7fbd4c145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd51800640 1 -- 172.21.15.173:0/3132660202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd4c06f5b0 msgr2=0x7fbd4c145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd51800640 1 --2- 172.21.15.173:0/3132660202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd4c06f5b0 0x7fbd4c145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd51800640 1 -- 172.21.15.173:0/3132660202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd4c0ad3f0 msgr2=0x7fbd4c145050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd51800640 1 --2- 172.21.15.173:0/3132660202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd4c0ad3f0 0x7fbd4c145050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd51800640 1 -- 172.21.15.173:0/3132660202 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c1f7d80 con 0x7fbd4c06e1c0 2024-04-25T09:07:47.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd52200640 1 --2- 172.21.15.173:0/3132660202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd4c0ad3f0 0x7fbd4c145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:47.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd51800640 1 --2- 172.21.15.173:0/3132660202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd4c06e1c0 0x7fbd4c1f7840 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000c420 tx=0x7fbd4000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:47.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd49600640 1 -- 172.21.15.173:0/3132660202 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd400052d0 con 0x7fbd4c06e1c0 2024-04-25T09:07:47.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd49600640 1 -- 172.21.15.173:0/3132660202 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd40005470 con 0x7fbd4c06e1c0 2024-04-25T09:07:47.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd54200640 1 -- 172.21.15.173:0/3132660202 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4c15a860 con 0x7fbd4c06e1c0 2024-04-25T09:07:47.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd49600640 1 -- 172.21.15.173:0/3132660202 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40007260 con 0x7fbd4c06e1c0 2024-04-25T09:07:47.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.893+0000 7fbd54200640 1 -- 172.21.15.173:0/3132660202 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4c1551b0 con 0x7fbd4c06e1c0 2024-04-25T09:07:47.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.897+0000 7fbd49600640 1 -- 172.21.15.173:0/3132660202 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbd40007400 con 0x7fbd4c06e1c0 2024-04-25T09:07:47.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.897+0000 7fbd49600640 1 --2- 172.21.15.173:0/3132660202 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbd2c066f60 0x7fbd2c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.897+0000 7fbd49600640 1 -- 172.21.15.173:0/3132660202 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbd400846c0 con 0x7fbd4c06e1c0 2024-04-25T09:07:47.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.897+0000 7fbd50e00640 1 --2- 172.21.15.173:0/3132660202 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbd2c066f60 0x7fbd2c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.897+0000 7fbd5772b000 1 Processor -- start 2024-04-25T09:07:47.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.897+0000 7fbd5772b000 1 -- start start 2024-04-25T09:07:47.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.897+0000 7fbd50e00640 1 --2- 172.21.15.173:0/3132660202 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbd2c066f60 0x7fbd2c069420 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbd380b2000 tx=0x7fbd38008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:47.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.897+0000 7fbd5772b000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006fa5920 0x55b006fa5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.897+0000 7fbd5772b000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006fa6240 0x55b006f5b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.897+0000 7fbd5772b000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006f5bf30 0x55b006f5c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.897+0000 7fbd5772b000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b006e435f0 con 0x55b006f5bf30 2024-04-25T09:07:47.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.897+0000 7fbd5772b000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b006daada0 con 0x55b006fa6240 2024-04-25T09:07:47.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.897+0000 7fbd5772b000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b006d33150 con 0x55b006fa5920 2024-04-25T09:07:47.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.897+0000 7fbd52200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006f5bf30 0x55b006f5c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.897+0000 7fbd52200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006f5bf30 0x55b006f5c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58906/0 (socket says 172.21.15.173:58906) 2024-04-25T09:07:47.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.897+0000 7fbd52200640 1 -- 172.21.15.173:0/4033260149 learned_addr learned my addr 172.21.15.173:0/4033260149 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:47.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.897+0000 7fbd51800640 1 --2- 172.21.15.173:0/4033260149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006fa5920 0x55b006fa5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.897+0000 7fbd50e00640 1 --2- 172.21.15.173:0/4033260149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006fa6240 0x55b006f5b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd52200640 1 -- 172.21.15.173:0/4033260149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006fa5920 msgr2=0x55b006fa5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:47.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd52200640 1 --2- 172.21.15.173:0/4033260149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006fa5920 0x55b006fa5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd52200640 1 -- 172.21.15.173:0/4033260149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006fa6240 msgr2=0x55b006f5b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:47.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd52200640 1 --2- 172.21.15.173:0/4033260149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006fa6240 0x55b006f5b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd52200640 1 -- 172.21.15.173:0/4033260149 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b006d4cca0 con 0x55b006f5bf30 2024-04-25T09:07:47.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd52200640 1 --2- 172.21.15.173:0/4033260149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006f5bf30 0x55b006f5c310 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fbd44002180 tx=0x7fbd4400d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a285727dc42c04ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:47.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd3e000640 1 -- 172.21.15.173:0/4033260149 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44018070 con 0x55b006f5bf30 2024-04-25T09:07:47.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd3e000640 1 -- 172.21.15.173:0/4033260149 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd44013670 con 0x55b006f5bf30 2024-04-25T09:07:47.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd3e000640 1 -- 172.21.15.173:0/4033260149 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44013a20 con 0x55b006f5bf30 2024-04-25T09:07:47.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd5772b000 1 -- 172.21.15.173:0/4033260149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006f5bf30 msgr2=0x55b006f5c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd5772b000 1 --2- 172.21.15.173:0/4033260149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006f5bf30 0x55b006f5c310 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fbd44002180 tx=0x7fbd4400d520 comp rx=0 tx=0).stop 2024-04-25T09:07:47.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd5772b000 1 -- 172.21.15.173:0/4033260149 shutdown_connections 2024-04-25T09:07:47.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd5772b000 1 --2- 172.21.15.173:0/4033260149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006f5bf30 0x55b006f5c310 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd5772b000 1 --2- 172.21.15.173:0/4033260149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006fa6240 0x55b006f5b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd5772b000 1 --2- 172.21.15.173:0/4033260149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006fa5920 0x55b006fa5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd5772b000 1 -- 172.21.15.173:0/4033260149 >> 172.21.15.173:0/4033260149 conn(0x55b006f622a0 msgr2=0x55b006f5a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:47.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd5772b000 1 -- 172.21.15.173:0/4033260149 shutdown_connections 2024-04-25T09:07:47.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd5772b000 1 -- 172.21.15.173:0/4033260149 wait complete. 2024-04-25T09:07:47.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd5772b000 1 -- start start 2024-04-25T09:07:47.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd5772b000 1 Processor -- start 2024-04-25T09:07:47.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd5772b000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006f5bf30 0x55b006faccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd5772b000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006fa5920 0x55b006fad230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd5772b000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006fa6240 0x55b006f5faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd5772b000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b006d65990 con 0x55b006fa5920 2024-04-25T09:07:47.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd5772b000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b006da6e40 con 0x55b006f5bf30 2024-04-25T09:07:47.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd5772b000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b006d36900 con 0x55b006fa6240 2024-04-25T09:07:47.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd5772b000 10 client.0 _ll_register_callbacks cb 0x55b006e5e1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:47.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd50e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006fa5920 0x55b006fad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd50e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006fa5920 0x55b006fad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58914/0 (socket says 172.21.15.173:58914) 2024-04-25T09:07:47.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd50e00640 1 -- 172.21.15.173:0/150053662 learned_addr learned my addr 172.21.15.173:0/150053662 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:47.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd51800640 1 --2- 172.21.15.173:0/150053662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006f5bf30 0x55b006faccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.901+0000 7fbd52200640 1 --2- 172.21.15.173:0/150053662 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006fa6240 0x55b006f5faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd50e00640 1 -- 172.21.15.173:0/150053662 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006fa6240 msgr2=0x55b006f5faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:47.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd50e00640 1 --2- 172.21.15.173:0/150053662 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006fa6240 0x55b006f5faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd50e00640 1 -- 172.21.15.173:0/150053662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006f5bf30 msgr2=0x55b006faccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:47.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd50e00640 1 --2- 172.21.15.173:0/150053662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006f5bf30 0x55b006faccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd50e00640 1 -- 172.21.15.173:0/150053662 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b006d63630 con 0x55b006fa5920 2024-04-25T09:07:47.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd52200640 1 --2- 172.21.15.173:0/150053662 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006fa6240 0x55b006f5faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:47.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd50e00640 1 --2- 172.21.15.173:0/150053662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006fa5920 0x55b006fad230 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fbd38000c10 tx=0x7fbd380046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72363604c188890 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:47.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd32a00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:07:47.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd32a00640 1 -- 172.21.15.173:0/150053662 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd380b09d0 con 0x55b006fa5920 2024-04-25T09:07:47.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 1 -- 172.21.15.173:0/150053662 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd44013670 con 0x55b006fa5920 2024-04-25T09:07:47.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd32a00640 1 -- 172.21.15.173:0/150053662 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbd380b0b70 con 0x55b006fa5920 2024-04-25T09:07:47.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd32a00640 1 -- 172.21.15.173:0/150053662 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd380d3050 con 0x55b006fa5920 2024-04-25T09:07:47.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 10 client.7425 fetch_fsmap learned FSMap version 55 2024-04-25T09:07:47.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 1 -- 172.21.15.173:0/150053662 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55b006d333a0 con 0x55b006fa5920 2024-04-25T09:07:47.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd32a00640 1 -- 172.21.15.173:0/150053662 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd44013670 con 0x55b006fa5920 2024-04-25T09:07:47.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd32a00640 1 -- 172.21.15.173:0/150053662 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbd380d6020 con 0x55b006fa5920 2024-04-25T09:07:47.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 10 client.7425 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:07:47.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 10 client.7425 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:07:47.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 20 client.7425 populate_metadata read hostname 'smithi173' 2024-04-25T09:07:47.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 1 --2- 172.21.15.173:0/150053662 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55b006f61160 0x55b006fb6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 4 client.7425 mds_command: new command op to 7263 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:07:47.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 1 -- 172.21.15.173:0/150053662 --> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b006d46a50 con 0x55b006f61160 2024-04-25T09:07:47.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd51800640 1 --2- 172.21.15.173:0/150053662 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55b006f61160 0x55b006fb6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd51800640 1 --2- 172.21.15.173:0/150053662 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55b006f61160 0x55b006fb6d50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2a0d66810388a31 server_cookie=2359a6ad18355c91 in_seq=0 out_seq=0 2024-04-25T09:07:47.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd32a00640 10 client.7425 ms_handle_connect on v2:172.21.15.173:6836/2444108646 2024-04-25T09:07:47.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd32a00640 1 -- 172.21.15.173:0/150053662 <== mds.0 v2:172.21.15.173:6836/2444108646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b006d46a50 con 0x55b006f61160 2024-04-25T09:07:47.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd32a00640 10 client.7425 handle_command_reply: tid=0 2024-04-25T09:07:47.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 1 client.7425 shutdown 2024-04-25T09:07:47.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 1 -- 172.21.15.173:0/150053662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006fa5920 msgr2=0x55b006fad230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 1 --2- 172.21.15.173:0/150053662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006fa5920 0x55b006fad230 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fbd38000c10 tx=0x7fbd380046d0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 1 -- 172.21.15.173:0/150053662 shutdown_connections 2024-04-25T09:07:47.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 1 --2- 172.21.15.173:0/150053662 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55b006f61160 0x55b006fb6d50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 1 --2- 172.21.15.173:0/150053662 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006fa6240 0x55b006f5faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 1 --2- 172.21.15.173:0/150053662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006fa5920 0x55b006fad230 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd32a00640 0 client.7425 ms_handle_reset on v2:172.21.15.173:6836/2444108646 2024-04-25T09:07:47.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 1 --2- 172.21.15.173:0/150053662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006f5bf30 0x55b006faccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 1 -- 172.21.15.173:0/150053662 >> 172.21.15.173:0/150053662 conn(0x55b006f622a0 msgr2=0x55b006f5a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:47.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 1 -- 172.21.15.173:0/150053662 shutdown_connections 2024-04-25T09:07:47.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 1 -- 172.21.15.173:0/150053662 wait complete. 2024-04-25T09:07:47.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.905+0000 7fbd5772b000 20 client.7425 trim_cache size 0 max 16384 2024-04-25T09:07:47.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.921+0000 7fbd5772b000 1 Processor -- start 2024-04-25T09:07:47.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.921+0000 7fbd5772b000 1 -- start start 2024-04-25T09:07:47.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.921+0000 7fbd5772b000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006f5bf30 0x55b006f5f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.921+0000 7fbd5772b000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006fa5920 0x55b006f5f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.921+0000 7fbd5772b000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006fa6240 0x55b006faf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.921+0000 7fbd5772b000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c147fd0 con 0x55b006f5bf30 2024-04-25T09:07:47.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.921+0000 7fbd5772b000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c156800 con 0x55b006fa5920 2024-04-25T09:07:47.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.921+0000 7fbd5772b000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c14b980 con 0x55b006fa6240 2024-04-25T09:07:47.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.921+0000 7fbd51800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006f5bf30 0x55b006f5f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.921+0000 7fbd51800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006f5bf30 0x55b006f5f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58924/0 (socket says 172.21.15.173:58924) 2024-04-25T09:07:47.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.921+0000 7fbd51800640 1 -- 172.21.15.173:0/2289220560 learned_addr learned my addr 172.21.15.173:0/2289220560 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:47.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd51800640 1 -- 172.21.15.173:0/2289220560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006fa6240 msgr2=0x55b006faf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:47.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd51800640 1 --2- 172.21.15.173:0/2289220560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006fa6240 0x55b006faf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd51800640 1 -- 172.21.15.173:0/2289220560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006fa5920 msgr2=0x55b006f5f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:47.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd51800640 1 --2- 172.21.15.173:0/2289220560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006fa5920 0x55b006f5f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd51800640 1 -- 172.21.15.173:0/2289220560 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b006fa6070 con 0x55b006f5bf30 2024-04-25T09:07:47.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd51800640 1 --2- 172.21.15.173:0/2289220560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006f5bf30 0x55b006f5f330 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fbd40054dd0 tx=0x7fbd40084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c791ebc15bf71fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:47.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd3d600640 1 -- 172.21.15.173:0/2289220560 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40057040 con 0x55b006f5bf30 2024-04-25T09:07:47.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd3d600640 1 -- 172.21.15.173:0/2289220560 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd40058040 con 0x55b006f5bf30 2024-04-25T09:07:47.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd3d600640 1 -- 172.21.15.173:0/2289220560 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4006cbd0 con 0x55b006f5bf30 2024-04-25T09:07:47.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd5772b000 1 -- 172.21.15.173:0/2289220560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006f5bf30 msgr2=0x55b006f5f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd5772b000 1 --2- 172.21.15.173:0/2289220560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006f5bf30 0x55b006f5f330 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fbd40054dd0 tx=0x7fbd40084040 comp rx=0 tx=0).stop 2024-04-25T09:07:47.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd5772b000 1 -- 172.21.15.173:0/2289220560 shutdown_connections 2024-04-25T09:07:47.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd5772b000 1 --2- 172.21.15.173:0/2289220560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006fa6240 0x55b006faf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd5772b000 1 --2- 172.21.15.173:0/2289220560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006fa5920 0x55b006f5f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd5772b000 1 --2- 172.21.15.173:0/2289220560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006f5bf30 0x55b006f5f330 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd5772b000 1 -- 172.21.15.173:0/2289220560 >> 172.21.15.173:0/2289220560 conn(0x55b006f622a0 msgr2=0x55b006f92010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:47.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd5772b000 1 -- 172.21.15.173:0/2289220560 shutdown_connections 2024-04-25T09:07:47.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd5772b000 1 -- 172.21.15.173:0/2289220560 wait complete. 2024-04-25T09:07:47.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd5772b000 1 -- start start 2024-04-25T09:07:47.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd5772b000 1 Processor -- start 2024-04-25T09:07:47.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd5772b000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006f5bf30 0x55b006fb28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd5772b000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006fa5920 0x55b006fb2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd5772b000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006fa6240 0x55b006fea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd5772b000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b006daf3d0 con 0x55b006fa5920 2024-04-25T09:07:47.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd5772b000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b006e66d50 con 0x55b006fa6240 2024-04-25T09:07:47.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd5772b000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b006d45980 con 0x55b006f5bf30 2024-04-25T09:07:47.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd5772b000 10 client.0 _ll_register_callbacks cb 0x7fbd440019d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:47.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd50e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006fa5920 0x55b006fb2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd50e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006fa5920 0x55b006fb2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58928/0 (socket says 172.21.15.173:58928) 2024-04-25T09:07:47.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd50e00640 1 -- 172.21.15.173:0/3323184632 learned_addr learned my addr 172.21.15.173:0/3323184632 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:47.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd51800640 1 --2- 172.21.15.173:0/3323184632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006f5bf30 0x55b006fb28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd52200640 1 --2- 172.21.15.173:0/3323184632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006fa6240 0x55b006fea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd50e00640 1 -- 172.21.15.173:0/3323184632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006f5bf30 msgr2=0x55b006fb28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:47.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd50e00640 1 --2- 172.21.15.173:0/3323184632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006f5bf30 0x55b006fb28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd50e00640 1 -- 172.21.15.173:0/3323184632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006fa6240 msgr2=0x55b006fea2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:47.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd50e00640 1 --2- 172.21.15.173:0/3323184632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006fa6240 0x55b006fea2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd50e00640 1 -- 172.21.15.173:0/3323184632 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b006e2c600 con 0x55b006fa5920 2024-04-25T09:07:47.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd52200640 1 --2- 172.21.15.173:0/3323184632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006fa6240 0x55b006fea2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:47.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.925+0000 7fbd51800640 1 --2- 172.21.15.173:0/3323184632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006f5bf30 0x55b006fb28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:47.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd50e00640 1 --2- 172.21.15.173:0/3323184632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006fa5920 0x55b006fb2de0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fbd380b3040 tx=0x7fbd3801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8736d1902319e8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:47.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd32a00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:07:47.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd32a00640 1 -- 172.21.15.173:0/3323184632 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd380bcc40 con 0x55b006fa5920 2024-04-25T09:07:47.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd32a00640 1 -- 172.21.15.173:0/3323184632 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbd380bcde0 con 0x55b006fa5920 2024-04-25T09:07:47.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 1 -- 172.21.15.173:0/3323184632 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd40058040 con 0x55b006fa5920 2024-04-25T09:07:47.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd32a00640 1 -- 172.21.15.173:0/3323184632 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd380e6050 con 0x55b006fa5920 2024-04-25T09:07:47.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 10 client.7431 fetch_fsmap learned FSMap version 55 2024-04-25T09:07:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 1 -- 172.21.15.173:0/3323184632 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55b006d3f9b0 con 0x55b006fa5920 2024-04-25T09:07:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd32a00640 1 -- 172.21.15.173:0/3323184632 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd40058040 con 0x55b006fa5920 2024-04-25T09:07:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd32a00640 1 -- 172.21.15.173:0/3323184632 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbd380e9020 con 0x55b006fa5920 2024-04-25T09:07:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 10 client.7431 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:07:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 10 client.7431 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:07:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 20 client.7431 populate_metadata read hostname 'smithi173' 2024-04-25T09:07:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 1 --2- 172.21.15.173:0/3323184632 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55b006fea7e0 0x55b006feabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 4 client.7431 mds_command: new command op to 7263 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:07:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 1 -- 172.21.15.173:0/3323184632 --> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b006db82e0 con 0x55b006fea7e0 2024-04-25T09:07:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd51800640 1 --2- 172.21.15.173:0/3323184632 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55b006fea7e0 0x55b006feabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd51800640 1 --2- 172.21.15.173:0/3323184632 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55b006fea7e0 0x55b006feabc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e85ca43792d39f06 server_cookie=74132865db379ecb in_seq=0 out_seq=0 2024-04-25T09:07:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd32a00640 10 client.7431 ms_handle_connect on v2:172.21.15.173:6836/2444108646 2024-04-25T09:07:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd32a00640 1 -- 172.21.15.173:0/3323184632 <== mds.0 v2:172.21.15.173:6836/2444108646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55b006db82e0 con 0x55b006fea7e0 2024-04-25T09:07:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd32a00640 10 client.7431 handle_command_reply: tid=0 2024-04-25T09:07:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 1 client.7431 shutdown 2024-04-25T09:07:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 1 -- 172.21.15.173:0/3323184632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006fa5920 msgr2=0x55b006fb2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 1 --2- 172.21.15.173:0/3323184632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006fa5920 0x55b006fb2de0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fbd380b3040 tx=0x7fbd3801ba30 comp rx=0 tx=0).stop 2024-04-25T09:07:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 1 -- 172.21.15.173:0/3323184632 shutdown_connections 2024-04-25T09:07:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 1 --2- 172.21.15.173:0/3323184632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b006fa6240 0x55b006fea2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 1 --2- 172.21.15.173:0/3323184632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b006fa5920 0x55b006fb2de0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 1 --2- 172.21.15.173:0/3323184632 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55b006fea7e0 0x55b006feabc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 1 --2- 172.21.15.173:0/3323184632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b006f5bf30 0x55b006fb28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd32a00640 0 client.7431 ms_handle_reset on v2:172.21.15.173:6836/2444108646 2024-04-25T09:07:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 1 -- 172.21.15.173:0/3323184632 >> 172.21.15.173:0/3323184632 conn(0x55b006f622a0 msgr2=0x55b006f5e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 1 -- 172.21.15.173:0/3323184632 shutdown_connections 2024-04-25T09:07:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 1 -- 172.21.15.173:0/3323184632 wait complete. 2024-04-25T09:07:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd5772b000 20 client.7431 trim_cache size 0 max 16384 2024-04-25T09:07:47.922 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:07:47.922 INFO:teuthology.orchestra.run.smithi173.stdout: "cluster_fsid": "ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6", 2024-04-25T09:07:47.922 INFO:teuthology.orchestra.run.smithi173.stdout: "whoami": 0, 2024-04-25T09:07:47.922 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 7263, 2024-04-25T09:07:47.922 INFO:teuthology.orchestra.run.smithi173.stdout: "want_state": "up:active", 2024-04-25T09:07:47.922 INFO:teuthology.orchestra.run.smithi173.stdout: "state": "up:active", 2024-04-25T09:07:47.922 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs", 2024-04-25T09:07:47.922 INFO:teuthology.orchestra.run.smithi173.stdout: "rank_uptime": 10.314117668, 2024-04-25T09:07:47.922 INFO:teuthology.orchestra.run.smithi173.stdout: "mdsmap_epoch": 55, 2024-04-25T09:07:47.922 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch": 84, 2024-04-25T09:07:47.922 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch_barrier": 84, 2024-04-25T09:07:47.922 INFO:teuthology.orchestra.run.smithi173.stdout: "uptime": 15.214135431000001 2024-04-25T09:07:47.922 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:07:47.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd54200640 1 -- 172.21.15.173:0/3132660202 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbd2c066f60 msgr2=0x7fbd2c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd54200640 1 --2- 172.21.15.173:0/3132660202 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbd2c066f60 0x7fbd2c069420 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbd380b2000 tx=0x7fbd38008040 comp rx=0 tx=0).stop 2024-04-25T09:07:47.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd54200640 1 -- 172.21.15.173:0/3132660202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd4c06e1c0 msgr2=0x7fbd4c1f7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd54200640 1 --2- 172.21.15.173:0/3132660202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd4c06e1c0 0x7fbd4c1f7840 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000c420 tx=0x7fbd4000c8e0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd54200640 1 -- 172.21.15.173:0/3132660202 shutdown_connections 2024-04-25T09:07:47.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd54200640 1 --2- 172.21.15.173:0/3132660202 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbd2c066f60 0x7fbd2c069420 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd54200640 1 --2- 172.21.15.173:0/3132660202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd4c0ad3f0 0x7fbd4c145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd54200640 1 --2- 172.21.15.173:0/3132660202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd4c06f5b0 0x7fbd4c145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd54200640 1 --2- 172.21.15.173:0/3132660202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd4c06e1c0 0x7fbd4c1f7840 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd54200640 1 -- 172.21.15.173:0/3132660202 >> 172.21.15.173:0/3132660202 conn(0x7fbd4c0cfed0 msgr2=0x7fbd4c0afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:47.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd54200640 1 -- 172.21.15.173:0/3132660202 shutdown_connections 2024-04-25T09:07:47.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:47.929+0000 7fbd54200640 1 -- 172.21.15.173:0/3132660202 wait complete. 2024-04-25T09:07:47.937 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:07:48.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.085+0000 7fb221200640 1 Processor -- start 2024-04-25T09:07:48.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.085+0000 7fb221200640 1 -- start start 2024-04-25T09:07:48.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.085+0000 7fb221200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb21c145250 0x7fb21c15c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:48.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.085+0000 7fb221200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb21c0ccd30 0x7fb21c071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:48.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.085+0000 7fb221200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb21c15cec0 con 0x7fb21c0cc8b0 2024-04-25T09:07:48.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.085+0000 7fb221200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb21c06e7c0 con 0x7fb21c145250 2024-04-25T09:07:48.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.085+0000 7fb221200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c06d720 con 0x7fb21c0ccd30 2024-04-25T09:07:48.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.085+0000 7fb21a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb21c0ccd30 0x7fb21c071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:48.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.085+0000 7fb21a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb21c0ccd30 0x7fb21c071a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:57818/0 (socket says 172.21.15.173:57818) 2024-04-25T09:07:48.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.085+0000 7fb219400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fb21c0cc8b0 0x7fb21c071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:32906/0 (socket says 172.21.15.173:32906) 2024-04-25T09:07:48.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.085+0000 7fb21a800640 1 -- 172.21.15.173:0/3908181174 learned_addr learned my addr 172.21.15.173:0/3908181174 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:48.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.085+0000 7fb219e00640 1 --2- 172.21.15.173:0/3908181174 >> v2:172.21.15.194:3300/0 conn(0x7fb21c145250 0x7fb21c15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:48.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.085+0000 7fb21a800640 1 -- 172.21.15.173:0/3908181174 >> v2:172.21.15.194:3300/0 conn(0x7fb21c145250 msgr2=0x7fb21c15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:48.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.085+0000 7fb21a800640 1 --2- 172.21.15.173:0/3908181174 >> v2:172.21.15.194:3300/0 conn(0x7fb21c145250 0x7fb21c15c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.085+0000 7fb21a800640 1 -- 172.21.15.173:0/3908181174 >> v1:172.21.15.194:6789/0 conn(0x7fb21c0cc8b0 legacy=0x7fb21c071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:48.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.085+0000 7fb218a00640 1 -- 172.21.15.173:0/3908181174 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472236487 0 0) 0x7fb208001120 con 0x7fb21c0cc8b0 2024-04-25T09:07:48.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.085+0000 7fb21a800640 1 -- 172.21.15.173:0/3908181174 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c06da00 con 0x7fb21c0ccd30 2024-04-25T09:07:48.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.089+0000 7fb21a800640 1 --2- 172.21.15.173:0/3908181174 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb21c0ccd30 0x7fb21c071a30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb214009e50 tx=0x7fb21401ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=902380f7d5448f15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:48.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.089+0000 7fb218a00640 1 -- 172.21.15.173:0/3908181174 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2140a58d0 con 0x7fb21c0ccd30 2024-04-25T09:07:48.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.089+0000 7fb218a00640 1 -- 172.21.15.173:0/3908181174 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2140a5a70 con 0x7fb21c0ccd30 2024-04-25T09:07:48.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.089+0000 7fb218a00640 1 -- 172.21.15.173:0/3908181174 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2140a5e40 con 0x7fb21c0ccd30 2024-04-25T09:07:48.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.089+0000 7fb221200640 1 -- 172.21.15.173:0/3908181174 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb21c0ccd30 msgr2=0x7fb21c071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:48.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.089+0000 7fb221200640 1 --2- 172.21.15.173:0/3908181174 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb21c0ccd30 0x7fb21c071a30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb214009e50 tx=0x7fb21401ca00 comp rx=0 tx=0).stop 2024-04-25T09:07:48.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.089+0000 7fb221200640 1 -- 172.21.15.173:0/3908181174 shutdown_connections 2024-04-25T09:07:48.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.089+0000 7fb221200640 1 --2- 172.21.15.173:0/3908181174 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb21c0ccd30 0x7fb21c071a30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.089+0000 7fb221200640 1 --2- 172.21.15.173:0/3908181174 >> v2:172.21.15.194:3300/0 conn(0x7fb21c145250 0x7fb21c15c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.089+0000 7fb221200640 1 -- 172.21.15.173:0/3908181174 >> 172.21.15.173:0/3908181174 conn(0x7fb21c06ac90 msgr2=0x7fb21c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:48.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.089+0000 7fb221200640 1 -- 172.21.15.173:0/3908181174 shutdown_connections 2024-04-25T09:07:48.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.089+0000 7fb221200640 1 -- 172.21.15.173:0/3908181174 wait complete. 2024-04-25T09:07:48.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb221200640 1 Processor -- start 2024-04-25T09:07:48.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb221200640 1 -- start start 2024-04-25T09:07:48.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb221200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb21c0cc8b0 0x7fb21c0b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:48.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb221200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb21c0ccd30 0x7fb21c13eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:48.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb221200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb21c145250 0x7fb21c141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:48.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb221200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c0cd180 con 0x7fb21c0cc8b0 2024-04-25T09:07:48.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb221200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c145630 con 0x7fb21c0ccd30 2024-04-25T09:07:48.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb221200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c06ef80 con 0x7fb21c145250 2024-04-25T09:07:48.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb219e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb21c0cc8b0 0x7fb21c0b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:48.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb219e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb21c0cc8b0 0x7fb21c0b38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58944/0 (socket says 172.21.15.173:58944) 2024-04-25T09:07:48.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb219e00640 1 -- 172.21.15.173:0/283447741 learned_addr learned my addr 172.21.15.173:0/283447741 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:48.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb219400640 1 --2- 172.21.15.173:0/283447741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb21c0ccd30 0x7fb21c13eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:48.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb21a800640 1 --2- 172.21.15.173:0/283447741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb21c145250 0x7fb21c141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:48.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb219e00640 1 -- 172.21.15.173:0/283447741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb21c145250 msgr2=0x7fb21c141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:48.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb219e00640 1 --2- 172.21.15.173:0/283447741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb21c145250 0x7fb21c141300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb219e00640 1 -- 172.21.15.173:0/283447741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb21c0ccd30 msgr2=0x7fb21c13eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:48.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb219e00640 1 --2- 172.21.15.173:0/283447741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb21c0ccd30 0x7fb21c13eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb219e00640 1 -- 172.21.15.173:0/283447741 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c13f660 con 0x7fb21c0cc8b0 2024-04-25T09:07:48.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb219400640 1 --2- 172.21.15.173:0/283447741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb21c0ccd30 0x7fb21c13eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:48.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb21a800640 1 --2- 172.21.15.173:0/283447741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb21c145250 0x7fb21c141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:48.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb219e00640 1 --2- 172.21.15.173:0/283447741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb21c0cc8b0 0x7fb21c0b38f0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00e960 tx=0x7fb20c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:48.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb212000640 1 -- 172.21.15.173:0/283447741 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c017070 con 0x7fb21c0cc8b0 2024-04-25T09:07:48.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb212000640 1 -- 172.21.15.173:0/283447741 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20c00ca00 con 0x7fb21c0cc8b0 2024-04-25T09:07:48.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb212000640 1 -- 172.21.15.173:0/283447741 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c00cdb0 con 0x7fb21c0cc8b0 2024-04-25T09:07:48.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb221200640 1 -- 172.21.15.173:0/283447741 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21c0b2850 con 0x7fb21c0cc8b0 2024-04-25T09:07:48.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb221200640 1 -- 172.21.15.173:0/283447741 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21c0b2e10 con 0x7fb21c0cc8b0 2024-04-25T09:07:48.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.093+0000 7fb221200640 1 -- 172.21.15.173:0/283447741 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb21c073a40 con 0x7fb21c0cc8b0 2024-04-25T09:07:48.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.097+0000 7fb212000640 1 -- 172.21.15.173:0/283447741 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb20c01a070 con 0x7fb21c0cc8b0 2024-04-25T09:07:48.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.097+0000 7fb212000640 1 --2- 172.21.15.173:0/283447741 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb1fc066f60 0x7fb1fc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:48.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.097+0000 7fb212000640 1 -- 172.21.15.173:0/283447741 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb20c085290 con 0x7fb21c0cc8b0 2024-04-25T09:07:48.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.097+0000 7fb219400640 1 --2- 172.21.15.173:0/283447741 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb1fc066f60 0x7fb1fc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:48.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.097+0000 7fb219400640 1 --2- 172.21.15.173:0/283447741 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb1fc066f60 0x7fb1fc069420 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb208007fd0 tx=0x7fb208009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:48.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.101+0000 7fb212000640 1 -- 172.21.15.173:0/283447741 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb20c056080 con 0x7fb21c0cc8b0 2024-04-25T09:07:48.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.285+0000 7fb221200640 1 -- 172.21.15.173:0/283447741 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb21c1436b0 con 0x7fb21c0cc8b0 2024-04-25T09:07:48.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.285+0000 7fb212000640 1 -- 172.21.15.173:0/283447741 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb20c055980 con 0x7fb21c0cc8b0 2024-04-25T09:07:48.275 INFO:teuthology.orchestra.run.smithi173.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:07:48.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.289+0000 7fb221200640 1 -- 172.21.15.173:0/283447741 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb1fc066f60 msgr2=0x7fb1fc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:48.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.289+0000 7fb221200640 1 --2- 172.21.15.173:0/283447741 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb1fc066f60 0x7fb1fc069420 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb208007fd0 tx=0x7fb208009040 comp rx=0 tx=0).stop 2024-04-25T09:07:48.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.289+0000 7fb221200640 1 -- 172.21.15.173:0/283447741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb21c0cc8b0 msgr2=0x7fb21c0b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:48.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.289+0000 7fb221200640 1 --2- 172.21.15.173:0/283447741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb21c0cc8b0 0x7fb21c0b38f0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00e960 tx=0x7fb20c00ee20 comp rx=0 tx=0).stop 2024-04-25T09:07:48.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.289+0000 7fb221200640 1 -- 172.21.15.173:0/283447741 shutdown_connections 2024-04-25T09:07:48.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.289+0000 7fb221200640 1 --2- 172.21.15.173:0/283447741 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb1fc066f60 0x7fb1fc069420 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.289+0000 7fb221200640 1 --2- 172.21.15.173:0/283447741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb21c145250 0x7fb21c141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.289+0000 7fb221200640 1 --2- 172.21.15.173:0/283447741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb21c0ccd30 0x7fb21c13eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.289+0000 7fb221200640 1 --2- 172.21.15.173:0/283447741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb21c0cc8b0 0x7fb21c0b38f0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.289+0000 7fb221200640 1 -- 172.21.15.173:0/283447741 >> 172.21.15.173:0/283447741 conn(0x7fb21c06ac90 msgr2=0x7fb21c0b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:48.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.289+0000 7fb221200640 1 -- 172.21.15.173:0/283447741 shutdown_connections 2024-04-25T09:07:48.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:48.289+0000 7fb221200640 1 -- 172.21.15.173:0/283447741 wait complete. 2024-04-25T09:07:48.297 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:07:48.297 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:07:48.297 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2024-04-25T09:07:48.297 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:07:48.297 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:48.298 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:07:48.298 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:07:48.298 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:07:48.298 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:07:48.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:48.298 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2024-04-25T09:07:48.307 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:07:48.307 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:07:48.307 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:07:48.307 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:48.307 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-25T09:07:48.307 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:48.308 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:07:48.308 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:48.308 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2024-04-25T09:07:48.308 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:07:48.308 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:48.308 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2024-04-25T09:07:48.308 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:07:48.308 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:48.308 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:07:48.308 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:48.308 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:07:48.308 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 42150sec preferred_lft 42150sec 2024-04-25T09:07:48.308 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2024-04-25T09:07:48.308 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:48.309 INFO:teuthology.orchestra.run.smithi173.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:07:48.309 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 02:42:00:0e:60:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:48.309 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:07:48.309 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:48.309 INFO:teuthology.orchestra.run.smithi173.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:07:48.309 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:48.309 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:07:48.309 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:48.309 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:07:48.309 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:48.309 INFO:teuthology.orchestra.run.smithi173.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:07:48.309 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:07:48.309 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:07:48.309 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:48.309 INFO:teuthology.orchestra.run.smithi173.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:07:48.310 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:07:48.310 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:07:48.310 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:48.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:48.311 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:07:48.373 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-04-25T09:07:48.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:48.375 DEBUG:teuthology.orchestra.run.smithi173:> route 2024-04-25T09:07:48.426 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2024-04-25T09:07:48.426 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:07:48.426 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:07:48.426 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:07:48.426 INFO:teuthology.orchestra.run.smithi173.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:07:48.426 INFO:teuthology.orchestra.run.smithi173.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:07:48.427 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:07:48.427 INFO:teuthology.orchestra.run.smithi173.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:07:48.427 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:07:48.427 INFO:teuthology.orchestra.run.smithi173.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:07:48.427 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:07:48.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:48.427 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:07:48.427 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:07:48.427 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:07:48.427 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:07:48.427 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:07:48.428 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:07:48.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:48.520 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-25T09:07:48.576 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:07:48.576 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:07:48.576 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:07:48.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:48.576 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2024-04-25T09:07:48.642 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:07:48.642 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:48.691 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:07:48.692 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:07:48.692 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:48.742 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:07:48.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:48.742 DEBUG:teuthology.orchestra.run.smithi173:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:07:48.831 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:07:48.831 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:07:48.831 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:07:48.848 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:07:48.848 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:07:48.848 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:07:48.848 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:07:48.848 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:07:48.855 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:07:48.855 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:07:48.855 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:07:48.855 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:07:48.855 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:07:48.855 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-04-25T09:07:48.855 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-04-25T09:07:48.855 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6" will pass to kernel 2024-04-25T09:07:48.859 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:07:48.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:48.859 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:48.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:48.878 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:07:48.938 INFO:teuthology.orchestra.run.smithi173.stdout:client7437 2024-04-25T09:07:48.939 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:07:48.939 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:48.991 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-04-25T09:07:49.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.185+0000 7f6c14e00640 1 Processor -- start 2024-04-25T09:07:49.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.185+0000 7f6c14e00640 1 -- start start 2024-04-25T09:07:49.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.189+0000 7f6c14e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6c10145290 0x7f6c1015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:49.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.189+0000 7f6c14e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6c100cc260 0x7f6c100cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:49.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.189+0000 7f6c14e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1015c5f0 con 0x7f6c100b3fe0 2024-04-25T09:07:49.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.189+0000 7f6c14e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1006d4b0 con 0x7f6c100cc260 2024-04-25T09:07:49.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.189+0000 7f6c14e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1006d790 con 0x7f6c10145290 2024-04-25T09:07:49.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.189+0000 7f6c0e800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6c100cc260 0x7f6c100cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:49.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.189+0000 7f6c0e800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6c100cc260 0x7f6c100cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58958/0 (socket says 172.21.15.173:58958) 2024-04-25T09:07:49.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.189+0000 7f6c0e800640 1 -- 172.21.15.173:0/668205233 learned_addr learned my addr 172.21.15.173:0/668205233 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:49.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.189+0000 7f6c0e800640 1 -- 172.21.15.173:0/668205233 >> v2:172.21.15.194:3300/0 conn(0x7f6c10145290 msgr2=0x7f6c1015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:49.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.189+0000 7f6c0de00640 1 --2- 172.21.15.173:0/668205233 >> v2:172.21.15.194:3300/0 conn(0x7f6c10145290 0x7f6c1015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:49.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.189+0000 7f6c0e800640 1 --2- 172.21.15.173:0/668205233 >> v2:172.21.15.194:3300/0 conn(0x7f6c10145290 0x7f6c1015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.189+0000 7f6c0e800640 1 -- 172.21.15.173:0/668205233 >> v1:172.21.15.194:6789/0 conn(0x7f6c100b3fe0 legacy=0x7f6c100b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:49.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.189+0000 7f6c0e800640 1 -- 172.21.15.173:0/668205233 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1006da70 con 0x7f6c100cc260 2024-04-25T09:07:49.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.189+0000 7f6c0de00640 1 --2- 172.21.15.173:0/668205233 >> v2:172.21.15.194:3300/0 conn(0x7f6c10145290 0x7f6c1015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:49.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.189+0000 7f6c0e800640 1 --2- 172.21.15.173:0/668205233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c100cc260 0x7f6c100cc670 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f6c1015f5b0 tx=0x7f6c0801c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c551ed47761d880f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:49.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.189+0000 7f6c0d400640 1 -- 172.21.15.173:0/668205233 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c080ac020 con 0x7f6c100cc260 2024-04-25T09:07:49.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c0d400640 1 -- 172.21.15.173:0/668205233 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c080a6470 con 0x7f6c100cc260 2024-04-25T09:07:49.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c0d400640 1 -- 172.21.15.173:0/668205233 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c080a6840 con 0x7f6c100cc260 2024-04-25T09:07:49.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c14e00640 1 -- 172.21.15.173:0/668205233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c100cc260 msgr2=0x7f6c100cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:49.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c14e00640 1 --2- 172.21.15.173:0/668205233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c100cc260 0x7f6c100cc670 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f6c1015f5b0 tx=0x7f6c0801c690 comp rx=0 tx=0).stop 2024-04-25T09:07:49.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c14e00640 1 -- 172.21.15.173:0/668205233 shutdown_connections 2024-04-25T09:07:49.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c14e00640 1 --2- 172.21.15.173:0/668205233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c100cc260 0x7f6c100cc670 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c14e00640 1 --2- 172.21.15.173:0/668205233 >> v2:172.21.15.194:3300/0 conn(0x7f6c10145290 0x7f6c1015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c14e00640 1 -- 172.21.15.173:0/668205233 >> 172.21.15.173:0/668205233 conn(0x7f6c1006ac90 msgr2=0x7f6c1006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:49.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c14e00640 1 -- 172.21.15.173:0/668205233 shutdown_connections 2024-04-25T09:07:49.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c14e00640 1 -- 172.21.15.173:0/668205233 wait complete. 2024-04-25T09:07:49.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c14e00640 1 Processor -- start 2024-04-25T09:07:49.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c14e00640 1 -- start start 2024-04-25T09:07:49.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c14e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c100b3fe0 0x7f6c1015b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:49.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c14e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c100cc260 0x7f6c10134f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:49.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c14e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c10145290 0x7f6c101f83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:49.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c14e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1006eee0 con 0x7f6c100cc260 2024-04-25T09:07:49.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c14e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1006ed60 con 0x7f6c100b3fe0 2024-04-25T09:07:49.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c14e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1006f060 con 0x7f6c10145290 2024-04-25T09:07:49.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c05400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c100cc260 0x7f6c10134f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:49.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c05400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c100cc260 0x7f6c10134f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58974/0 (socket says 172.21.15.173:58974) 2024-04-25T09:07:49.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c05400640 1 -- 172.21.15.173:0/228827887 learned_addr learned my addr 172.21.15.173:0/228827887 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:07:49.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c0de00640 1 --2- 172.21.15.173:0/228827887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c100b3fe0 0x7f6c1015b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:49.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.193+0000 7f6c0e800640 1 --2- 172.21.15.173:0/228827887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c10145290 0x7f6c101f83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:49.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.197+0000 7f6c05400640 1 -- 172.21.15.173:0/228827887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c10145290 msgr2=0x7f6c101f83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:49.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.197+0000 7f6c05400640 1 --2- 172.21.15.173:0/228827887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c10145290 0x7f6c101f83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.197+0000 7f6c05400640 1 -- 172.21.15.173:0/228827887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c100b3fe0 msgr2=0x7f6c1015b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:49.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.197+0000 7f6c05400640 1 --2- 172.21.15.173:0/228827887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c100b3fe0 0x7f6c1015b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.197+0000 7f6c05400640 1 -- 172.21.15.173:0/228827887 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c10135bf0 con 0x7f6c100cc260 2024-04-25T09:07:49.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.197+0000 7f6c05400640 1 --2- 172.21.15.173:0/228827887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c100cc260 0x7f6c10134f90 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800b440 tx=0x7f6bf800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:49.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.197+0000 7f6c06a00640 1 -- 172.21.15.173:0/228827887 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8015020 con 0x7f6c100cc260 2024-04-25T09:07:49.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.197+0000 7f6c06a00640 1 -- 172.21.15.173:0/228827887 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf8011890 con 0x7f6c100cc260 2024-04-25T09:07:49.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.197+0000 7f6c14e00640 1 -- 172.21.15.173:0/228827887 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c10135ed0 con 0x7f6c100cc260 2024-04-25T09:07:49.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.197+0000 7f6c06a00640 1 -- 172.21.15.173:0/228827887 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8011c80 con 0x7f6c100cc260 2024-04-25T09:07:49.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.197+0000 7f6c14e00640 1 -- 172.21.15.173:0/228827887 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c101358a0 con 0x7f6c100cc260 2024-04-25T09:07:49.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.197+0000 7f6c14e00640 1 -- 172.21.15.173:0/228827887 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c10073ab0 con 0x7f6c100cc260 2024-04-25T09:07:49.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.197+0000 7f6c06a00640 1 -- 172.21.15.173:0/228827887 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6bf8018020 con 0x7f6c100cc260 2024-04-25T09:07:49.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.197+0000 7f6c06a00640 1 --2- 172.21.15.173:0/228827887 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6bec066f60 0x7f6bec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:49.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.197+0000 7f6c06a00640 1 -- 172.21.15.173:0/228827887 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6bf8084ee0 con 0x7f6c100cc260 2024-04-25T09:07:49.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.197+0000 7f6c0de00640 1 --2- 172.21.15.173:0/228827887 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6bec066f60 0x7f6bec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:49.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.201+0000 7f6c0de00640 1 --2- 172.21.15.173:0/228827887 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6bec066f60 0x7f6bec069420 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6c00006fd0 tx=0x7f6c00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:49.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.201+0000 7f6c06a00640 1 -- 172.21.15.173:0/228827887 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6bf801f030 con 0x7f6c100cc260 2024-04-25T09:07:49.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.393+0000 7f6c14e00640 1 -- 172.21.15.173:0/228827887 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6c101f7d30 con 0x7f6c100cc260 2024-04-25T09:07:49.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.669+0000 7f6c06a00640 1 -- 172.21.15.173:0/228827887 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v56) v1 ==== 167+0+0 (secure 0 0 0) 0x7f6bf800d040 con 0x7f6c100cc260 2024-04-25T09:07:49.656 INFO:teuthology.orchestra.run.smithi173.stderr:enabled new snapshots 2024-04-25T09:07:49.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.669+0000 7f6c14e00640 1 -- 172.21.15.173:0/228827887 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6bec066f60 msgr2=0x7f6bec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:49.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.669+0000 7f6c14e00640 1 --2- 172.21.15.173:0/228827887 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6bec066f60 0x7f6bec069420 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6c00006fd0 tx=0x7f6c00008040 comp rx=0 tx=0).stop 2024-04-25T09:07:49.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.669+0000 7f6c14e00640 1 -- 172.21.15.173:0/228827887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c100cc260 msgr2=0x7f6c10134f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:49.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.669+0000 7f6c14e00640 1 --2- 172.21.15.173:0/228827887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c100cc260 0x7f6c10134f90 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800b440 tx=0x7f6bf800b900 comp rx=0 tx=0).stop 2024-04-25T09:07:49.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.669+0000 7f6c14e00640 1 -- 172.21.15.173:0/228827887 shutdown_connections 2024-04-25T09:07:49.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.669+0000 7f6c14e00640 1 --2- 172.21.15.173:0/228827887 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6bec066f60 0x7f6bec069420 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.669+0000 7f6c14e00640 1 --2- 172.21.15.173:0/228827887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c10145290 0x7f6c101f83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.669+0000 7f6c14e00640 1 --2- 172.21.15.173:0/228827887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c100cc260 0x7f6c10134f90 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.669+0000 7f6c14e00640 1 --2- 172.21.15.173:0/228827887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c100b3fe0 0x7f6c1015b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.669+0000 7f6c14e00640 1 -- 172.21.15.173:0/228827887 >> 172.21.15.173:0/228827887 conn(0x7f6c1006ac90 msgr2=0x7f6c1013e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:49.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.669+0000 7f6c14e00640 1 -- 172.21.15.173:0/228827887 shutdown_connections 2024-04-25T09:07:49.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:07:49.669+0000 7f6c14e00640 1 -- 172.21.15.173:0/228827887 wait complete. 2024-04-25T09:07:49.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:49.678 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-04-25T09:07:49.694 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:07:49.695 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:49.743 DEBUG:teuthology.orchestra.run.smithi173:> stdin-killer -- python3 -c ' 2024-04-25T09:07:49.743 DEBUG:teuthology.orchestra.run.smithi173:> import os 2024-04-25T09:07:49.743 DEBUG:teuthology.orchestra.run.smithi173:> import uuid 2024-04-25T09:07:49.744 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:07:49.744 DEBUG:teuthology.orchestra.run.smithi173:> n = 2000 2024-04-25T09:07:49.744 DEBUG:teuthology.orchestra.run.smithi173:> create_hard_links = False 2024-04-25T09:07:49.744 DEBUG:teuthology.orchestra.run.smithi173:> if 3 > 0: 2024-04-25T09:07:49.744 DEBUG:teuthology.orchestra.run.smithi173:> create_hard_links = True 2024-04-25T09:07:49.744 DEBUG:teuthology.orchestra.run.smithi173:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-04-25T09:07:49.744 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:07:49.744 DEBUG:teuthology.orchestra.run.smithi173:> dpath = os.path.dirname(path) 2024-04-25T09:07:49.744 DEBUG:teuthology.orchestra.run.smithi173:> fnameprefix = os.path.basename(path) 2024-04-25T09:07:49.744 DEBUG:teuthology.orchestra.run.smithi173:> os.makedirs(dpath, exist_ok=True) 2024-04-25T09:07:49.744 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:07:49.744 DEBUG:teuthology.orchestra.run.smithi173:> try: 2024-04-25T09:07:49.744 DEBUG:teuthology.orchestra.run.smithi173:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-04-25T09:07:49.744 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-25T09:07:49.744 DEBUG:teuthology.orchestra.run.smithi173:> for i in range(n): 2024-04-25T09:07:49.744 DEBUG:teuthology.orchestra.run.smithi173:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-04-25T09:07:49.744 DEBUG:teuthology.orchestra.run.smithi173:> with open(fpath, '"'"'w'"'"') as f: 2024-04-25T09:07:49.744 DEBUG:teuthology.orchestra.run.smithi173:> f.write(f"{i}") 2024-04-25T09:07:49.745 DEBUG:teuthology.orchestra.run.smithi173:> if False: 2024-04-25T09:07:49.745 DEBUG:teuthology.orchestra.run.smithi173:> f.flush() 2024-04-25T09:07:49.745 DEBUG:teuthology.orchestra.run.smithi173:> os.fsync(f.fileno()) 2024-04-25T09:07:49.745 DEBUG:teuthology.orchestra.run.smithi173:> if False: 2024-04-25T09:07:49.745 DEBUG:teuthology.orchestra.run.smithi173:> os.unlink(fpath) 2024-04-25T09:07:49.745 DEBUG:teuthology.orchestra.run.smithi173:> if False: 2024-04-25T09:07:49.745 DEBUG:teuthology.orchestra.run.smithi173:> os.fsync(dirfd) 2024-04-25T09:07:49.745 DEBUG:teuthology.orchestra.run.smithi173:> if create_hard_links: 2024-04-25T09:07:49.745 DEBUG:teuthology.orchestra.run.smithi173:> for j in range(3): 2024-04-25T09:07:49.745 DEBUG:teuthology.orchestra.run.smithi173:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-04-25T09:07:49.745 DEBUG:teuthology.orchestra.run.smithi173:> if False: 2024-04-25T09:07:49.745 DEBUG:teuthology.orchestra.run.smithi173:> os.fsync(dirfd) 2024-04-25T09:07:49.745 DEBUG:teuthology.orchestra.run.smithi173:> finally: 2024-04-25T09:07:49.745 DEBUG:teuthology.orchestra.run.smithi173:> os.close(dirfd) 2024-04-25T09:07:49.746 DEBUG:teuthology.orchestra.run.smithi173:> ' 2024-04-25T09:08:11.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:08:11.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:11.144 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-04-25T09:08:11.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:11.208 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-04-25T09:08:14.791 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:08:14.795 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:08:37.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:37.579 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-04-25T09:08:37.601 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:08:37.601 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 perf dump 2024-04-25T09:08:37.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.797+0000 7fdb06800640 1 Processor -- start 2024-04-25T09:08:37.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.797+0000 7fdb06800640 1 -- start start 2024-04-25T09:08:37.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.797+0000 7fdb06800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdb000cc7e0 0x7fdb000cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.797+0000 7fdb06800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdb000aef70 0x7fdb000ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.797+0000 7fdb06800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb00071570 con 0x7fdb000aeb90 2024-04-25T09:08:37.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.797+0000 7fdb06800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb00071320 con 0x7fdb000aef70 2024-04-25T09:08:37.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.797+0000 7fdb06800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb00072330 con 0x7fdb000cc7e0 2024-04-25T09:08:37.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.797+0000 7fdaffe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdb000aef70 0x7fdb000ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.797+0000 7fdaff400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fdb000aeb90 0x7fdb000cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49916/0 (socket says 172.21.15.173:49916) 2024-04-25T09:08:37.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.797+0000 7fdaff400640 1 -- 172.21.15.173:0/1536667118 learned_addr learned my addr 172.21.15.173:0/1536667118 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:08:37.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.797+0000 7fdaf7e00640 1 --2- 172.21.15.173:0/1536667118 >> v2:172.21.15.194:3300/0 conn(0x7fdb000cc7e0 0x7fdb000cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.797+0000 7fdaffe00640 1 -- 172.21.15.173:0/1536667118 >> v2:172.21.15.194:3300/0 conn(0x7fdb000cc7e0 msgr2=0x7fdb000cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.797+0000 7fdaffe00640 1 --2- 172.21.15.173:0/1536667118 >> v2:172.21.15.194:3300/0 conn(0x7fdb000cc7e0 0x7fdb000cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.797+0000 7fdaffe00640 1 -- 172.21.15.173:0/1536667118 >> v1:172.21.15.173:6789/0 conn(0x7fdb000aeb90 legacy=0x7fdb000cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.797+0000 7fdaffe00640 1 -- 172.21.15.173:0/1536667118 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb00071850 con 0x7fdb000aef70 2024-04-25T09:08:37.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.797+0000 7fdafea00640 1 -- 172.21.15.173:0/1536667118 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054900503 0 0) 0x7fdb00071570 con 0x7fdb000aeb90 2024-04-25T09:08:37.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.801+0000 7fdaffe00640 1 --2- 172.21.15.173:0/1536667118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb000aef70 0x7fdb000ce0e0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fdb000cd960 tx=0x7fdaf801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93330ce7ac5e93f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.801+0000 7fdafea00640 1 -- 172.21.15.173:0/1536667118 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf80b2070 con 0x7fdb000aef70 2024-04-25T09:08:37.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.801+0000 7fdafea00640 1 -- 172.21.15.173:0/1536667118 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf80a5750 con 0x7fdb000aef70 2024-04-25T09:08:37.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.801+0000 7fdafea00640 1 -- 172.21.15.173:0/1536667118 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf80a5b20 con 0x7fdb000aef70 2024-04-25T09:08:37.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.801+0000 7fdb06800640 1 -- 172.21.15.173:0/1536667118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb000aef70 msgr2=0x7fdb000ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.801+0000 7fdb06800640 1 --2- 172.21.15.173:0/1536667118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb000aef70 0x7fdb000ce0e0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fdb000cd960 tx=0x7fdaf801c8a0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.801+0000 7fdb06800640 1 -- 172.21.15.173:0/1536667118 shutdown_connections 2024-04-25T09:08:37.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.801+0000 7fdb06800640 1 --2- 172.21.15.173:0/1536667118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb000aef70 0x7fdb000ce0e0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.801+0000 7fdb06800640 1 --2- 172.21.15.173:0/1536667118 >> v2:172.21.15.194:3300/0 conn(0x7fdb000cc7e0 0x7fdb000cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.801+0000 7fdb06800640 1 -- 172.21.15.173:0/1536667118 >> 172.21.15.173:0/1536667118 conn(0x7fdb0006ac90 msgr2=0x7fdb0006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.801+0000 7fdb06800640 1 -- 172.21.15.173:0/1536667118 shutdown_connections 2024-04-25T09:08:37.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.801+0000 7fdb06800640 1 -- 172.21.15.173:0/1536667118 wait complete. 2024-04-25T09:08:37.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.801+0000 7fdb06800640 1 Processor -- start 2024-04-25T09:08:37.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.801+0000 7fdb06800640 1 -- start start 2024-04-25T09:08:37.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdb06800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb000aeb90 0x7fdb0015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdb06800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb000aef70 0x7fdb0014b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdb06800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb000cc7e0 0x7fdb000b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdb06800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0015bb30 con 0x7fdb000cc7e0 2024-04-25T09:08:37.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdb06800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0015b9b0 con 0x7fdb000aeb90 2024-04-25T09:08:37.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdb06800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0015bcb0 con 0x7fdb000aef70 2024-04-25T09:08:37.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdaffe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb000cc7e0 0x7fdb000b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdaffe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb000cc7e0 0x7fdb000b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58788/0 (socket says 172.21.15.173:58788) 2024-04-25T09:08:37.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdaffe00640 1 -- 172.21.15.173:0/1859962226 learned_addr learned my addr 172.21.15.173:0/1859962226 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:08:37.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdaff400640 1 --2- 172.21.15.173:0/1859962226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb000aeb90 0x7fdb0015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdaf7e00640 1 --2- 172.21.15.173:0/1859962226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb000aef70 0x7fdb0014b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdaffe00640 1 -- 172.21.15.173:0/1859962226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb000aef70 msgr2=0x7fdb0014b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdaffe00640 1 --2- 172.21.15.173:0/1859962226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb000aef70 0x7fdb0014b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdaffe00640 1 -- 172.21.15.173:0/1859962226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb000aeb90 msgr2=0x7fdb0015a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdaffe00640 1 --2- 172.21.15.173:0/1859962226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb000aeb90 0x7fdb0015a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdaffe00640 1 -- 172.21.15.173:0/1859962226 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb00068730 con 0x7fdb000cc7e0 2024-04-25T09:08:37.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdaffe00640 1 --2- 172.21.15.173:0/1859962226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb000cc7e0 0x7fdb000b13f0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fdaf801a4d0 tx=0x7fdaf8019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdaf7400640 1 -- 172.21.15.173:0/1859962226 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf80bd020 con 0x7fdb000cc7e0 2024-04-25T09:08:37.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdaf7400640 1 -- 172.21.15.173:0/1859962226 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf80b8470 con 0x7fdb000cc7e0 2024-04-25T09:08:37.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdb06800640 1 -- 172.21.15.173:0/1859962226 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb000add10 con 0x7fdb000cc7e0 2024-04-25T09:08:37.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdaf7400640 1 -- 172.21.15.173:0/1859962226 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf80b2040 con 0x7fdb000cc7e0 2024-04-25T09:08:37.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.805+0000 7fdb06800640 1 -- 172.21.15.173:0/1859962226 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb000ad800 con 0x7fdb000cc7e0 2024-04-25T09:08:37.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaf7400640 1 -- 172.21.15.173:0/1859962226 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdaf80c0020 con 0x7fdb000cc7e0 2024-04-25T09:08:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaf7400640 1 --2- 172.21.15.173:0/1859962226 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdadc066f60 0x7fdadc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaf7400640 1 -- 172.21.15.173:0/1859962226 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdaf8120070 con 0x7fdb000cc7e0 2024-04-25T09:08:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaff400640 1 --2- 172.21.15.173:0/1859962226 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdadc066f60 0x7fdadc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdb09d42000 1 Processor -- start 2024-04-25T09:08:37.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdb09d42000 1 -- start start 2024-04-25T09:08:37.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaff400640 1 --2- 172.21.15.173:0/1859962226 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdadc066f60 0x7fdadc069420 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0007fd0 tx=0x7fdaf0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdb09d42000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba445a40 0x55cfba445e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdb09d42000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba446360 0x55cfba400850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdb09d42000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba400d90 0x55cfba401170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdb09d42000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfba2e31f0 con 0x55cfba446360 2024-04-25T09:08:37.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdb09d42000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfba249e90 con 0x55cfba400d90 2024-04-25T09:08:37.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdb09d42000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cfba1d1f50 con 0x55cfba445a40 2024-04-25T09:08:37.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaf7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba446360 0x55cfba400850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaff400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba445a40 0x55cfba445e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaf7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba446360 0x55cfba400850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58798/0 (socket says 172.21.15.173:58798) 2024-04-25T09:08:37.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaf7e00640 1 -- 172.21.15.173:0/4263131507 learned_addr learned my addr 172.21.15.173:0/4263131507 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:08:37.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaffe00640 1 --2- 172.21.15.173:0/4263131507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba400d90 0x55cfba401170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaf7e00640 1 -- 172.21.15.173:0/4263131507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba445a40 msgr2=0x55cfba445e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaf7e00640 1 --2- 172.21.15.173:0/4263131507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba445a40 0x55cfba445e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaf7e00640 1 -- 172.21.15.173:0/4263131507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba400d90 msgr2=0x55cfba401170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaf7e00640 1 --2- 172.21.15.173:0/4263131507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba400d90 0x55cfba401170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaf7e00640 1 -- 172.21.15.173:0/4263131507 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfba2218b0 con 0x55cfba446360 2024-04-25T09:08:37.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaf7e00640 1 --2- 172.21.15.173:0/4263131507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba446360 0x55cfba400850 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009b70 tx=0x7fdae8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8574f25f6c123db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaefe00640 1 -- 172.21.15.173:0/4263131507 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae8019070 con 0x55cfba446360 2024-04-25T09:08:37.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaefe00640 1 -- 172.21.15.173:0/4263131507 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae8009c60 con 0x55cfba446360 2024-04-25T09:08:37.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.809+0000 7fdaefe00640 1 -- 172.21.15.173:0/4263131507 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae80156a0 con 0x55cfba446360 2024-04-25T09:08:37.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 -- 172.21.15.173:0/4263131507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba446360 msgr2=0x55cfba400850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 --2- 172.21.15.173:0/4263131507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba446360 0x55cfba400850 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009b70 tx=0x7fdae8009190 comp rx=0 tx=0).stop 2024-04-25T09:08:37.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 -- 172.21.15.173:0/4263131507 shutdown_connections 2024-04-25T09:08:37.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 --2- 172.21.15.173:0/4263131507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba400d90 0x55cfba401170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 --2- 172.21.15.173:0/4263131507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba446360 0x55cfba400850 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 --2- 172.21.15.173:0/4263131507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba445a40 0x55cfba445e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 -- 172.21.15.173:0/4263131507 >> 172.21.15.173:0/4263131507 conn(0x55cfba3fcd40 msgr2=0x55cfba3ff130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 -- 172.21.15.173:0/4263131507 shutdown_connections 2024-04-25T09:08:37.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 -- 172.21.15.173:0/4263131507 wait complete. 2024-04-25T09:08:37.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 -- start start 2024-04-25T09:08:37.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 Processor -- start 2024-04-25T09:08:37.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba400d90 0x55cfba44d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba445a40 0x55cfba44d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba446360 0x55cfba406dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfba204540 con 0x55cfba400d90 2024-04-25T09:08:37.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfba245f30 con 0x55cfba445a40 2024-04-25T09:08:37.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cfba1ed2d0 con 0x55cfba446360 2024-04-25T09:08:37.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 10 client.0 _ll_register_callbacks cb 0x55cfba2fe180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:37.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdaff400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba400d90 0x55cfba44d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdaff400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba400d90 0x55cfba44d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58808/0 (socket says 172.21.15.173:58808) 2024-04-25T09:08:37.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdaff400640 1 -- 172.21.15.173:0/3424965862 learned_addr learned my addr 172.21.15.173:0/3424965862 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:08:37.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdaf7e00640 1 --2- 172.21.15.173:0/3424965862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba445a40 0x55cfba44d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdaffe00640 1 --2- 172.21.15.173:0/3424965862 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba446360 0x55cfba406dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdaff400640 1 -- 172.21.15.173:0/3424965862 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba446360 msgr2=0x55cfba406dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdaff400640 1 --2- 172.21.15.173:0/3424965862 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba446360 0x55cfba406dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdaff400640 1 -- 172.21.15.173:0/3424965862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba445a40 msgr2=0x55cfba44d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdaff400640 1 --2- 172.21.15.173:0/3424965862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba445a40 0x55cfba44d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdaff400640 1 -- 172.21.15.173:0/3424965862 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cfba1d21a0 con 0x55cfba400d90 2024-04-25T09:08:37.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdaff400640 1 --2- 172.21.15.173:0/3424965862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba400d90 0x55cfba44d1c0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0005f20 tx=0x7fdaf0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7910fa3caef75110 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdaecc00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:08:37.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdaecc00640 1 -- 172.21.15.173:0/3424965862 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0028060 con 0x55cfba400d90 2024-04-25T09:08:37.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdaecc00640 1 -- 172.21.15.173:0/3424965862 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdaf0010040 con 0x55cfba400d90 2024-04-25T09:08:37.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 -- 172.21.15.173:0/3424965862 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdae8009c60 con 0x55cfba400d90 2024-04-25T09:08:37.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdaecc00640 1 -- 172.21.15.173:0/3424965862 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdaf0007560 con 0x55cfba400d90 2024-04-25T09:08:37.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 10 client.7458 fetch_fsmap learned FSMap version 56 2024-04-25T09:08:37.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.813+0000 7fdb09d42000 1 -- 172.21.15.173:0/3424965862 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55cfba2cc840 con 0x55cfba400d90 2024-04-25T09:08:37.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdaecc00640 1 -- 172.21.15.173:0/3424965862 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae8009c60 con 0x55cfba400d90 2024-04-25T09:08:37.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdaecc00640 1 -- 172.21.15.173:0/3424965862 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdaf0013420 con 0x55cfba400d90 2024-04-25T09:08:37.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdb09d42000 10 client.7458 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T09:08:37.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdb09d42000 10 client.7458 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:08:37.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdb09d42000 20 client.7458 populate_metadata read hostname 'smithi173' 2024-04-25T09:08:37.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdb09d42000 1 --2- 172.21.15.173:0/3424965862 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55cfba407b30 0x55cfba407f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdb09d42000 4 client.7458 mds_command: new command op to 7263 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:08:37.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdb09d42000 1 -- 172.21.15.173:0/3424965862 --> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cfba1e5be0 con 0x55cfba407b30 2024-04-25T09:08:37.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdaf7e00640 1 --2- 172.21.15.173:0/3424965862 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55cfba407b30 0x55cfba407f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdaf7e00640 1 --2- 172.21.15.173:0/3424965862 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55cfba407b30 0x55cfba407f40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fe99d6fa518e94c server_cookie=d99d04a240c5ee2e in_seq=0 out_seq=0 2024-04-25T09:08:37.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdaecc00640 10 client.7458 ms_handle_connect on v2:172.21.15.173:6836/2444108646 2024-04-25T09:08:37.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdaecc00640 1 -- 172.21.15.173:0/3424965862 <== mds.0 v2:172.21.15.173:6836/2444108646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cfba1e5be0 con 0x55cfba407b30 2024-04-25T09:08:37.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdaecc00640 10 client.7458 handle_command_reply: tid=0 2024-04-25T09:08:37.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdb09d42000 1 client.7458 shutdown 2024-04-25T09:08:37.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdb09d42000 1 -- 172.21.15.173:0/3424965862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba400d90 msgr2=0x55cfba44d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdb09d42000 1 --2- 172.21.15.173:0/3424965862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba400d90 0x55cfba44d1c0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0005f20 tx=0x7fdaf0005800 comp rx=0 tx=0).stop 2024-04-25T09:08:37.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdb09d42000 1 -- 172.21.15.173:0/3424965862 shutdown_connections 2024-04-25T09:08:37.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdb09d42000 1 --2- 172.21.15.173:0/3424965862 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55cfba407b30 0x55cfba407f40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdb09d42000 1 --2- 172.21.15.173:0/3424965862 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba446360 0x55cfba406dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdb09d42000 1 --2- 172.21.15.173:0/3424965862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba445a40 0x55cfba44d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdb09d42000 1 --2- 172.21.15.173:0/3424965862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba400d90 0x55cfba44d1c0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdaecc00640 0 client.7458 ms_handle_reset on v2:172.21.15.173:6836/2444108646 2024-04-25T09:08:37.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdb09d42000 1 -- 172.21.15.173:0/3424965862 >> 172.21.15.173:0/3424965862 conn(0x55cfba3fcd40 msgr2=0x55cfba3ff9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdb09d42000 1 -- 172.21.15.173:0/3424965862 shutdown_connections 2024-04-25T09:08:37.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdb09d42000 1 -- 172.21.15.173:0/3424965862 wait complete. 2024-04-25T09:08:37.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.817+0000 7fdb09d42000 20 client.7458 trim_cache size 0 max 16384 2024-04-25T09:08:37.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 Processor -- start 2024-04-25T09:08:37.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 -- start start 2024-04-25T09:08:37.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba400d90 0x55cfba4004a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba445a40 0x55cfba3ff130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba446360 0x55cfba3ff670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb002030c0 con 0x55cfba445a40 2024-04-25T09:08:37.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb00202200 con 0x55cfba400d90 2024-04-25T09:08:37.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb00201630 con 0x55cfba446360 2024-04-25T09:08:37.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdaf7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba445a40 0x55cfba3ff130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdaf7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba445a40 0x55cfba3ff130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58818/0 (socket says 172.21.15.173:58818) 2024-04-25T09:08:37.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdaf7e00640 1 -- 172.21.15.173:0/1232257377 learned_addr learned my addr 172.21.15.173:0/1232257377 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:08:37.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdaff400640 1 --2- 172.21.15.173:0/1232257377 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba400d90 0x55cfba4004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdaffe00640 1 --2- 172.21.15.173:0/1232257377 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba446360 0x55cfba3ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdaf7e00640 1 -- 172.21.15.173:0/1232257377 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba446360 msgr2=0x55cfba3ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdaf7e00640 1 --2- 172.21.15.173:0/1232257377 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba446360 0x55cfba3ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdaf7e00640 1 -- 172.21.15.173:0/1232257377 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba400d90 msgr2=0x55cfba4004a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdaf7e00640 1 --2- 172.21.15.173:0/1232257377 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba400d90 0x55cfba4004a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdaf7e00640 1 -- 172.21.15.173:0/1232257377 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfba446190 con 0x55cfba445a40 2024-04-25T09:08:37.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdaffe00640 1 --2- 172.21.15.173:0/1232257377 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba446360 0x55cfba3ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:37.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdaff400640 1 --2- 172.21.15.173:0/1232257377 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba400d90 0x55cfba4004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:37.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdaf7e00640 1 --2- 172.21.15.173:0/1232257377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba445a40 0x55cfba3ff130 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fdae8018000 tx=0x7fdae800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe09a659df4a4d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdaef400640 1 -- 172.21.15.173:0/1232257377 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae8019040 con 0x55cfba445a40 2024-04-25T09:08:37.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdaef400640 1 -- 172.21.15.173:0/1232257377 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae8004040 con 0x55cfba445a40 2024-04-25T09:08:37.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdaef400640 1 -- 172.21.15.173:0/1232257377 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae8004450 con 0x55cfba445a40 2024-04-25T09:08:37.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 -- 172.21.15.173:0/1232257377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba445a40 msgr2=0x55cfba3ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 --2- 172.21.15.173:0/1232257377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba445a40 0x55cfba3ff130 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fdae8018000 tx=0x7fdae800f000 comp rx=0 tx=0).stop 2024-04-25T09:08:37.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 -- 172.21.15.173:0/1232257377 shutdown_connections 2024-04-25T09:08:37.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 --2- 172.21.15.173:0/1232257377 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba446360 0x55cfba3ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 --2- 172.21.15.173:0/1232257377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba445a40 0x55cfba3ff130 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 --2- 172.21.15.173:0/1232257377 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba400d90 0x55cfba4004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 -- 172.21.15.173:0/1232257377 >> 172.21.15.173:0/1232257377 conn(0x55cfba3fcd40 msgr2=0x55cfba444120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 -- 172.21.15.173:0/1232257377 shutdown_connections 2024-04-25T09:08:37.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 -- 172.21.15.173:0/1232257377 wait complete. 2024-04-25T09:08:37.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 -- start start 2024-04-25T09:08:37.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.833+0000 7fdb09d42000 1 Processor -- start 2024-04-25T09:08:37.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba400d90 0x55cfba4aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba445a40 0x55cfba4af200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba446360 0x55cfba44aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfba3fcbc0 con 0x55cfba445a40 2024-04-25T09:08:37.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb00201c30 con 0x55cfba446360 2024-04-25T09:08:37.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cfba245f30 con 0x55cfba400d90 2024-04-25T09:08:37.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 10 client.0 _ll_register_callbacks cb 0x55cfba20ca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:37.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaf7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba445a40 0x55cfba4af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaf7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba445a40 0x55cfba4af200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58826/0 (socket says 172.21.15.173:58826) 2024-04-25T09:08:37.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaf7e00640 1 -- 172.21.15.173:0/2852829998 learned_addr learned my addr 172.21.15.173:0/2852829998 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:08:37.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaffe00640 1 --2- 172.21.15.173:0/2852829998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba446360 0x55cfba44aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaff400640 1 --2- 172.21.15.173:0/2852829998 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba400d90 0x55cfba4aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaf7e00640 1 -- 172.21.15.173:0/2852829998 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba400d90 msgr2=0x55cfba4aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaf7e00640 1 --2- 172.21.15.173:0/2852829998 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba400d90 0x55cfba4aecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaf7e00640 1 -- 172.21.15.173:0/2852829998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba446360 msgr2=0x55cfba44aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaf7e00640 1 --2- 172.21.15.173:0/2852829998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba446360 0x55cfba44aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaf7e00640 1 -- 172.21.15.173:0/2852829998 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cfba2a3a10 con 0x55cfba445a40 2024-04-25T09:08:37.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaffe00640 1 --2- 172.21.15.173:0/2852829998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba446360 0x55cfba44aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:37.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaf7e00640 1 --2- 172.21.15.173:0/2852829998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba445a40 0x55cfba4af200 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009de0 tx=0x7fdae8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f3e5d7c51eb628 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaecc00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:08:37.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaecc00640 1 -- 172.21.15.173:0/2852829998 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae8019070 con 0x55cfba445a40 2024-04-25T09:08:37.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaecc00640 1 -- 172.21.15.173:0/2852829998 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdae8004480 con 0x55cfba445a40 2024-04-25T09:08:37.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 -- 172.21.15.173:0/2852829998 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdae8004040 con 0x55cfba445a40 2024-04-25T09:08:37.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaecc00640 1 -- 172.21.15.173:0/2852829998 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdae803a050 con 0x55cfba445a40 2024-04-25T09:08:37.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 10 client.7464 fetch_fsmap learned FSMap version 56 2024-04-25T09:08:37.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 -- 172.21.15.173:0/2852829998 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55cfba1deb00 con 0x55cfba445a40 2024-04-25T09:08:37.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaecc00640 1 -- 172.21.15.173:0/2852829998 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae8004040 con 0x55cfba445a40 2024-04-25T09:08:37.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaecc00640 1 -- 172.21.15.173:0/2852829998 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdae803d020 con 0x55cfba445a40 2024-04-25T09:08:37.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 10 client.7464 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T09:08:37.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 10 client.7464 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:08:37.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 20 client.7464 populate_metadata read hostname 'smithi173' 2024-04-25T09:08:37.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 --2- 172.21.15.173:0/2852829998 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55cfba44b890 0x55cfba44bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 4 client.7464 mds_command: new command op to 7263 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-04-25T09:08:37.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 -- 172.21.15.173:0/2852829998 --> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x55cfba2573d0 con 0x55cfba44b890 2024-04-25T09:08:37.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaff400640 1 --2- 172.21.15.173:0/2852829998 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55cfba44b890 0x55cfba44bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaecc00640 10 client.7464 ms_handle_connect on v2:172.21.15.173:6836/2444108646 2024-04-25T09:08:37.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaff400640 1 --2- 172.21.15.173:0/2852829998 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55cfba44b890 0x55cfba44bca0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1665bf450a49f192 server_cookie=fd6403cb6cde1160 in_seq=0 out_seq=0 2024-04-25T09:08:37.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaecc00640 1 -- 172.21.15.173:0/2852829998 <== mds.0 v2:172.21.15.173:6836/2444108646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17920 (crc 0 0 0) 0x55cfba2573d0 con 0x55cfba44b890 2024-04-25T09:08:37.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaecc00640 10 client.7464 handle_command_reply: tid=0 2024-04-25T09:08:37.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 client.7464 shutdown 2024-04-25T09:08:37.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 -- 172.21.15.173:0/2852829998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba445a40 msgr2=0x55cfba4af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 --2- 172.21.15.173:0/2852829998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba445a40 0x55cfba4af200 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009de0 tx=0x7fdae8004740 comp rx=0 tx=0).stop 2024-04-25T09:08:37.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 -- 172.21.15.173:0/2852829998 shutdown_connections 2024-04-25T09:08:37.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 --2- 172.21.15.173:0/2852829998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfba446360 0x55cfba44aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 --2- 172.21.15.173:0/2852829998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfba445a40 0x55cfba4af200 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 --2- 172.21.15.173:0/2852829998 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55cfba44b890 0x55cfba44bca0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 --2- 172.21.15.173:0/2852829998 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55cfba400d90 0x55cfba4aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdaecc00640 0 client.7464 ms_handle_reset on v2:172.21.15.173:6836/2444108646 2024-04-25T09:08:37.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 -- 172.21.15.173:0/2852829998 >> 172.21.15.173:0/2852829998 conn(0x55cfba3fcd40 msgr2=0x55cfba4449b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.837+0000 7fdb09d42000 1 -- 172.21.15.173:0/2852829998 shutdown_connections 2024-04-25T09:08:37.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.841+0000 7fdb09d42000 1 -- 172.21.15.173:0/2852829998 wait complete. 2024-04-25T09:08:37.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.841+0000 7fdb09d42000 20 client.7464 trim_cache size 0 max 16384 2024-04-25T09:08:37.831 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:08:37.831 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T09:08:37.832 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 1616, 2024-04-25T09:08:37.832 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 1617, 2024-04-25T09:08:37.832 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 607341, 2024-04-25T09:08:37.832 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 15005449, 2024-04-25T09:08:37.832 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 9, 2024-04-25T09:08:37.832 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 3, 2024-04-25T09:08:37.832 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.207697080, 2024-04-25T09:08:37.832 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.093440030, 2024-04-25T09:08:37.832 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.038898373, 2024-04-25T09:08:37.832 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.054503341, 2024-04-25T09:08:37.832 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T09:08:37.832 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1616, 2024-04-25T09:08:37.832 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.391320511, 2024-04-25T09:08:37.833 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000242153 2024-04-25T09:08:37.833 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.833 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-04-25T09:08:37.833 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2, 2024-04-25T09:08:37.833 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000262, 2024-04-25T09:08:37.833 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000131 2024-04-25T09:08:37.833 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.833 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T09:08:37.833 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T09:08:37.833 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.833 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T09:08:37.833 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 29000, 2024-04-25T09:08:37.833 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 49732, 2024-04-25T09:08:37.833 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 10174520, 2024-04-25T09:08:37.833 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 44644275, 2024-04-25T09:08:37.833 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 7, 2024-04-25T09:08:37.833 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 4, 2024-04-25T09:08:37.834 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 3.488502762, 2024-04-25T09:08:37.834 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 2.578096423, 2024-04-25T09:08:37.834 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 1.096649710, 2024-04-25T09:08:37.834 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.046183079, 2024-04-25T09:08:37.834 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T09:08:37.834 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 49732, 2024-04-25T09:08:37.834 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.545149170, 2024-04-25T09:08:37.834 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000031069 2024-04-25T09:08:37.834 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.834 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-04-25T09:08:37.834 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 46165, 2024-04-25T09:08:37.834 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.008975107, 2024-04-25T09:08:37.835 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000194 2024-04-25T09:08:37.835 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.835 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 114080, 2024-04-25T09:08:37.835 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 17648 2024-04-25T09:08:37.835 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.835 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T09:08:37.835 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 3136, 2024-04-25T09:08:37.835 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 3151, 2024-04-25T09:08:37.835 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 776836, 2024-04-25T09:08:37.835 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 47124556, 2024-04-25T09:08:37.835 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 6, 2024-04-25T09:08:37.835 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 4, 2024-04-25T09:08:37.835 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.380391497, 2024-04-25T09:08:37.835 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.197000714, 2024-04-25T09:08:37.835 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.069445676, 2024-04-25T09:08:37.836 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.088256351, 2024-04-25T09:08:37.836 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T09:08:37.836 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3149, 2024-04-25T09:08:37.836 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.371840415, 2024-04-25T09:08:37.836 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000118082 2024-04-25T09:08:37.836 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.836 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-04-25T09:08:37.836 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.837 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.837 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.837 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.837 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-25T09:08:37.837 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 108368 2024-04-25T09:08:37.837 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.837 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-04-25T09:08:37.837 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-04-25T09:08:37.837 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-04-25T09:08:37.837 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.837 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-04-25T09:08:37.838 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-04-25T09:08:37.838 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-04-25T09:08:37.838 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3986, 2024-04-25T09:08:37.838 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 13.436349718, 2024-04-25T09:08:37.838 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.003370885 2024-04-25T09:08:37.838 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:08:37.838 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.838 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-04-25T09:08:37.838 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-04-25T09:08:37.838 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-04-25T09:08:37.838 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1895, 2024-04-25T09:08:37.838 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.742763726, 2024-04-25T09:08:37.838 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000391959 2024-04-25T09:08:37.838 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:08:37.838 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.839 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-04-25T09:08:37.839 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 25579, 2024-04-25T09:08:37.839 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 25579, 2024-04-25T09:08:37.839 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-04-25T09:08:37.839 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 25579, 2024-04-25T09:08:37.839 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 321.974623534, 2024-04-25T09:08:37.839 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.012587459 2024-04-25T09:08:37.839 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.839 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-04-25T09:08:37.839 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 0, 2024-04-25T09:08:37.839 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-04-25T09:08:37.839 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-04-25T09:08:37.839 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 12, 2024-04-25T09:08:37.839 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 0, 2024-04-25T09:08:37.839 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-04-25T09:08:37.839 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 19853, 2024-04-25T09:08:37.839 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 0, 2024-04-25T09:08:37.840 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 19853, 2024-04-25T09:08:37.840 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 0, 2024-04-25T09:08:37.840 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 19853, 2024-04-25T09:08:37.840 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 0, 2024-04-25T09:08:37.840 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 162, 2024-04-25T09:08:37.840 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 162, 2024-04-25T09:08:37.840 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 2, 2024-04-25T09:08:37.840 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 47417, 2024-04-25T09:08:37.840 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 46933, 2024-04-25T09:08:37.840 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 0, 2024-04-25T09:08:37.840 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 0, 2024-04-25T09:08:37.840 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-04-25T09:08:37.840 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-04-25T09:08:37.840 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 134, 2024-04-25T09:08:37.840 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 0, 2024-04-25T09:08:37.840 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 0, 2024-04-25T09:08:37.841 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 0, 2024-04-25T09:08:37.841 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 0, 2024-04-25T09:08:37.841 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 0, 2024-04-25T09:08:37.841 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 0, 2024-04-25T09:08:37.841 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-04-25T09:08:37.841 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 0, 2024-04-25T09:08:37.841 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-04-25T09:08:37.841 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 0, 2024-04-25T09:08:37.841 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 0, 2024-04-25T09:08:37.841 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 0, 2024-04-25T09:08:37.841 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T09:08:37.841 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-04-25T09:08:37.841 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T09:08:37.841 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-04-25T09:08:37.841 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2024-04-25T09:08:37.841 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T09:08:37.841 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T09:08:37.842 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 0, 2024-04-25T09:08:37.842 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 0, 2024-04-25T09:08:37.842 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 896, 2024-04-25T09:08:37.842 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 4021, 2024-04-25T09:08:37.842 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T09:08:37.842 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T09:08:37.842 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T09:08:37.842 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 4078, 2024-04-25T09:08:37.842 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 2000, 2024-04-25T09:08:37.842 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 56, 2024-04-25T09:08:37.842 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 13997 2024-04-25T09:08:37.842 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.842 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-04-25T09:08:37.842 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 0, 2024-04-25T09:08:37.842 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 0, 2024-04-25T09:08:37.843 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 0, 2024-04-25T09:08:37.843 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 0, 2024-04-25T09:08:37.843 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 0, 2024-04-25T09:08:37.843 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 2000, 2024-04-25T09:08:37.843 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 2, 2024-04-25T09:08:37.843 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-04-25T09:08:37.843 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 4138, 2024-04-25T09:08:37.843 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 1840, 2024-04-25T09:08:37.843 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 2227, 2024-04-25T09:08:37.843 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-04-25T09:08:37.843 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-04-25T09:08:37.843 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-04-25T09:08:37.843 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-04-25T09:08:37.843 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-04-25T09:08:37.843 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-04-25T09:08:37.843 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T09:08:37.843 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 0, 2024-04-25T09:08:37.844 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-04-25T09:08:37.844 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 0, 2024-04-25T09:08:37.844 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-04-25T09:08:37.844 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2024-04-25T09:08:37.844 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.844 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-04-25T09:08:37.844 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-04-25T09:08:37.844 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 24438, 2024-04-25T09:08:37.844 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-04-25T09:08:37.844 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-04-25T09:08:37.844 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 24438, 2024-04-25T09:08:37.844 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-04-25T09:08:37.844 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-04-25T09:08:37.844 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 33, 2024-04-25T09:08:37.844 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-04-25T09:08:37.844 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-04-25T09:08:37.845 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 33, 2024-04-25T09:08:37.845 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 3, 2024-04-25T09:08:37.845 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-04-25T09:08:37.845 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-04-25T09:08:37.845 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-04-25T09:08:37.845 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 88996504, 2024-04-25T09:08:37.845 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 0, 2024-04-25T09:08:37.845 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-04-25T09:08:37.845 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4030, 2024-04-25T09:08:37.845 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 107.454671769, 2024-04-25T09:08:37.845 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.026663690 2024-04-25T09:08:37.845 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.845 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 0 2024-04-25T09:08:37.845 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.845 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-04-25T09:08:37.845 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 2014, 2024-04-25T09:08:37.846 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 2014, 2024-04-25T09:08:37.846 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 0, 2024-04-25T09:08:37.846 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 13, 2024-04-25T09:08:37.846 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 13, 2024-04-25T09:08:37.846 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 0, 2024-04-25T09:08:37.846 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 19853, 2024-04-25T09:08:37.846 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 19854, 2024-04-25T09:08:37.846 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 1, 2024-04-25T09:08:37.846 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 162, 2024-04-25T09:08:37.846 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 8085, 2024-04-25T09:08:37.846 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 7923, 2024-04-25T09:08:37.846 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 111600, 2024-04-25T09:08:37.846 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 215340 2024-04-25T09:08:37.846 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.846 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-04-25T09:08:37.847 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 28962, 2024-04-25T09:08:37.847 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 0, 2024-04-25T09:08:37.847 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 25579, 2024-04-25T09:08:37.847 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 3, 2024-04-25T09:08:37.847 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 0, 2024-04-25T09:08:37.847 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-04-25T09:08:37.847 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2000, 2024-04-25T09:08:37.847 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.457912527, 2024-04-25T09:08:37.847 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000728956 2024-04-25T09:08:37.847 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.848 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-04-25T09:08:37.848 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 28, 2024-04-25T09:08:37.848 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.004176946, 2024-04-25T09:08:37.848 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000149176 2024-04-25T09:08:37.848 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.848 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-04-25T09:08:37.848 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.848 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.848 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.848 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.848 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-04-25T09:08:37.848 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 6000, 2024-04-25T09:08:37.848 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 7.003710437, 2024-04-25T09:08:37.848 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001167285 2024-04-25T09:08:37.849 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.849 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-04-25T09:08:37.849 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 7311, 2024-04-25T09:08:37.849 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 6.425681608, 2024-04-25T09:08:37.849 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000878905 2024-04-25T09:08:37.849 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.849 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-04-25T09:08:37.849 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.849 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.849 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.849 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.849 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-04-25T09:08:37.849 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.849 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.849 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.850 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.850 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-04-25T09:08:37.850 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.850 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.850 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.850 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.850 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-04-25T09:08:37.850 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.850 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.850 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.850 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.850 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-04-25T09:08:37.850 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:08:37.851 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000055637, 2024-04-25T09:08:37.851 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000055637 2024-04-25T09:08:37.851 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.851 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-04-25T09:08:37.851 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.851 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.851 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.851 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.851 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-04-25T09:08:37.851 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:08:37.851 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.003348710, 2024-04-25T09:08:37.851 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.003348710 2024-04-25T09:08:37.851 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.851 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-04-25T09:08:37.852 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.852 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.852 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.852 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.852 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-04-25T09:08:37.852 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:08:37.852 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.007880591, 2024-04-25T09:08:37.852 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.007880591 2024-04-25T09:08:37.852 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.852 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-04-25T09:08:37.852 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.852 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.852 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.852 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.852 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-04-25T09:08:37.853 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 8, 2024-04-25T09:08:37.853 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.162261902, 2024-04-25T09:08:37.853 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.020282737 2024-04-25T09:08:37.853 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.853 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-04-25T09:08:37.853 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2227, 2024-04-25T09:08:37.853 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 290.712379890, 2024-04-25T09:08:37.853 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.130539910 2024-04-25T09:08:37.853 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.853 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-04-25T09:08:37.853 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.853 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.853 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.853 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.853 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-04-25T09:08:37.854 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.854 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.854 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.854 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.854 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-04-25T09:08:37.854 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.854 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.854 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.854 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.854 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-04-25T09:08:37.854 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:08:37.854 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.012462139, 2024-04-25T09:08:37.854 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.012462139 2024-04-25T09:08:37.854 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.854 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-04-25T09:08:37.855 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.855 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.855 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.855 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.855 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-04-25T09:08:37.855 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:08:37.855 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000264369, 2024-04-25T09:08:37.855 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000264369 2024-04-25T09:08:37.855 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.855 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-04-25T09:08:37.855 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.855 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.855 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.855 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.855 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-04-25T09:08:37.856 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.856 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.856 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.856 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.856 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-04-25T09:08:37.856 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.856 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.856 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.856 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.856 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-04-25T09:08:37.856 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.856 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.856 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.856 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.856 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-04-25T09:08:37.857 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.857 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.857 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.857 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.857 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-04-25T09:08:37.857 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 8000, 2024-04-25T09:08:37.857 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 16.184488778, 2024-04-25T09:08:37.857 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.002023061 2024-04-25T09:08:37.857 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.857 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-04-25T09:08:37.857 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-04-25T09:08:37.857 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-04-25T09:08:37.857 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.857 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.858 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.858 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:08:37.858 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.858 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-04-25T09:08:37.858 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 1, 2024-04-25T09:08:37.858 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 1, 2024-04-25T09:08:37.858 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 0, 2024-04-25T09:08:37.858 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 1, 2024-04-25T09:08:37.858 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-04-25T09:08:37.858 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 18463, 2024-04-25T09:08:37.858 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 18463, 2024-04-25T09:08:37.858 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 48, 2024-04-25T09:08:37.858 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-04-25T09:08:37.858 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.858 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-04-25T09:08:37.859 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-04-25T09:08:37.859 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-04-25T09:08:37.859 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T09:08:37.859 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-04-25T09:08:37.859 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T09:08:37.859 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-04-25T09:08:37.859 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T09:08:37.859 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T09:08:37.859 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T09:08:37.859 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T09:08:37.859 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T09:08:37.859 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-04-25T09:08:37.859 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T09:08:37.859 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T09:08:37.859 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-04-25T09:08:37.860 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-04-25T09:08:37.860 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-04-25T09:08:37.860 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-04-25T09:08:37.860 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T09:08:37.860 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T09:08:37.860 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T09:08:37.860 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T09:08:37.860 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T09:08:37.860 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-04-25T09:08:37.860 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-04-25T09:08:37.860 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-04-25T09:08:37.860 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T09:08:37.860 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T09:08:37.860 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-04-25T09:08:37.860 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-04-25T09:08:37.860 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-04-25T09:08:37.861 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-04-25T09:08:37.861 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T09:08:37.861 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-04-25T09:08:37.861 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T09:08:37.861 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-04-25T09:08:37.861 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 16443282, 2024-04-25T09:08:37.861 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 4132, 2024-04-25T09:08:37.861 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-04-25T09:08:37.861 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-04-25T09:08:37.861 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-04-25T09:08:37.861 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-04-25T09:08:37.861 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-04-25T09:08:37.861 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-04-25T09:08:37.861 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-04-25T09:08:37.861 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-04-25T09:08:37.861 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 5424, 2024-04-25T09:08:37.862 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 76, 2024-04-25T09:08:37.862 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T09:08:37.862 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-04-25T09:08:37.862 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-04-25T09:08:37.862 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-04-25T09:08:37.862 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 20973501, 2024-04-25T09:08:37.862 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 813079, 2024-04-25T09:08:37.862 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-04-25T09:08:37.862 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-04-25T09:08:37.862 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-04-25T09:08:37.862 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-04-25T09:08:37.862 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.862 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-04-25T09:08:37.862 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-04-25T09:08:37.862 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-04-25T09:08:37.863 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 6111, 2024-04-25T09:08:37.863 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 85235155, 2024-04-25T09:08:37.863 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 25, 2024-04-25T09:08:37.863 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 6111, 2024-04-25T09:08:37.863 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-04-25T09:08:37.863 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 6111, 2024-04-25T09:08:37.863 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 26.935563638, 2024-04-25T09:08:37.863 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.004407717 2024-04-25T09:08:37.863 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.863 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-04-25T09:08:37.863 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-04-25T09:08:37.863 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 6111, 2024-04-25T09:08:37.863 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 6198 2024-04-25T09:08:37.863 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.864 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 6111, 2024-04-25T09:08:37.864 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 52, 2024-04-25T09:08:37.864 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 6059, 2024-04-25T09:08:37.864 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-04-25T09:08:37.864 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-04-25T09:08:37.864 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 0, 2024-04-25T09:08:37.864 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 11, 2024-04-25T09:08:37.864 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 52, 2024-04-25T09:08:37.864 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 4082, 2024-04-25T09:08:37.864 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 34, 2024-04-25T09:08:37.864 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-04-25T09:08:37.864 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-04-25T09:08:37.864 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 1840, 2024-04-25T09:08:37.864 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 0, 2024-04-25T09:08:37.864 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 32, 2024-04-25T09:08:37.864 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-04-25T09:08:37.864 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-04-25T09:08:37.865 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-04-25T09:08:37.865 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 0, 2024-04-25T09:08:37.865 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 22, 2024-04-25T09:08:37.865 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-04-25T09:08:37.865 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-04-25T09:08:37.865 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-04-25T09:08:37.865 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-04-25T09:08:37.865 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-04-25T09:08:37.865 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-04-25T09:08:37.865 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T09:08:37.865 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-04-25T09:08:37.865 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-04-25T09:08:37.865 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-04-25T09:08:37.865 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-04-25T09:08:37.865 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-04-25T09:08:37.865 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-04-25T09:08:37.866 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-04-25T09:08:37.866 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-04-25T09:08:37.866 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-04-25T09:08:37.866 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-04-25T09:08:37.866 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-04-25T09:08:37.866 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-04-25T09:08:37.866 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-04-25T09:08:37.866 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-04-25T09:08:37.866 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-04-25T09:08:37.866 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-04-25T09:08:37.866 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-04-25T09:08:37.866 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-04-25T09:08:37.866 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-04-25T09:08:37.866 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 84, 2024-04-25T09:08:37.867 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-04-25T09:08:37.867 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 1, 2024-04-25T09:08:37.867 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 8, 2024-04-25T09:08:37.867 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 8, 2024-04-25T09:08:37.867 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-04-25T09:08:37.867 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-04-25T09:08:37.867 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 105, 2024-04-25T09:08:37.867 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 0, 2024-04-25T09:08:37.867 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 20 2024-04-25T09:08:37.867 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.867 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-04-25T09:08:37.867 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 1, 2024-04-25T09:08:37.867 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-04-25T09:08:37.867 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-04-25T09:08:37.867 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-04-25T09:08:37.867 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.867 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2024-04-25T09:08:37.868 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 0 2024-04-25T09:08:37.868 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.868 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-04-25T09:08:37.868 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-04-25T09:08:37.868 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 32, 2024-04-25T09:08:37.868 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-04-25T09:08:37.868 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 32, 2024-04-25T09:08:37.868 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 1840, 2024-04-25T09:08:37.868 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 1840, 2024-04-25T09:08:37.868 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-04-25T09:08:37.868 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.868 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T09:08:37.868 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-04-25T09:08:37.868 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-04-25T09:08:37.868 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:08:37.868 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 33747, 2024-04-25T09:08:37.869 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 8958126, 2024-04-25T09:08:37.869 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:08:37.869 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 33747, 2024-04-25T09:08:37.869 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-04-25T09:08:37.869 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-04-25T09:08:37.869 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 33747, 2024-04-25T09:08:37.869 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 8958126, 2024-04-25T09:08:37.869 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:08:37.869 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.869 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.869 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.869 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:08:37.869 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.869 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-04-25T09:08:37.869 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-04-25T09:08:37.869 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-04-25T09:08:37.869 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:08:37.870 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-04-25T09:08:37.870 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-04-25T09:08:37.870 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:08:37.870 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-04-25T09:08:37.870 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 6111, 2024-04-25T09:08:37.870 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 85435715, 2024-04-25T09:08:37.870 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 6111, 2024-04-25T09:08:37.870 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 85435715, 2024-04-25T09:08:37.870 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:08:37.870 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.870 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.870 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.870 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:08:37.870 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.870 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-04-25T09:08:37.871 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-04-25T09:08:37.871 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-04-25T09:08:37.871 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:08:37.871 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-04-25T09:08:37.871 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-04-25T09:08:37.871 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:08:37.871 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-04-25T09:08:37.871 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 6111, 2024-04-25T09:08:37.871 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 6111, 2024-04-25T09:08:37.871 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 6111, 2024-04-25T09:08:37.871 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 6111, 2024-04-25T09:08:37.871 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:08:37.871 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.872 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.872 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.872 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:08:37.872 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.872 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-04-25T09:08:37.872 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-04-25T09:08:37.872 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-04-25T09:08:37.872 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:08:37.872 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 1840, 2024-04-25T09:08:37.872 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 200560, 2024-04-25T09:08:37.872 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:08:37.872 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 1840, 2024-04-25T09:08:37.872 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-04-25T09:08:37.872 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-04-25T09:08:37.873 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 52, 2024-04-25T09:08:37.873 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 200560, 2024-04-25T09:08:37.873 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:08:37.873 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.873 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.873 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.873 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:08:37.873 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:08:37.873 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x55afd5578a00": { 2024-04-25T09:08:37.873 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 60, 2024-04-25T09:08:37.873 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-04-25T09:08:37.873 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:08:37.873 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 24438, 2024-04-25T09:08:37.873 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 84802200, 2024-04-25T09:08:37.874 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:08:37.874 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 24438, 2024-04-25T09:08:37.874 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-04-25T09:08:37.874 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-04-25T09:08:37.874 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 4030, 2024-04-25T09:08:37.874 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 84802140, 2024-04-25T09:08:37.874 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:08:37.874 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:08:37.874 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:08:37.874 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:08:37.874 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:08:37.874 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:08:37.874 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:08:37.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.841+0000 7fdb06800640 1 -- 172.21.15.173:0/1859962226 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdadc066f60 msgr2=0x7fdadc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.841+0000 7fdb06800640 1 --2- 172.21.15.173:0/1859962226 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdadc066f60 0x7fdadc069420 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0007fd0 tx=0x7fdaf0009040 comp rx=0 tx=0).stop 2024-04-25T09:08:37.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.841+0000 7fdb06800640 1 -- 172.21.15.173:0/1859962226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb000cc7e0 msgr2=0x7fdb000b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.841+0000 7fdb06800640 1 --2- 172.21.15.173:0/1859962226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb000cc7e0 0x7fdb000b13f0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fdaf801a4d0 tx=0x7fdaf8019640 comp rx=0 tx=0).stop 2024-04-25T09:08:37.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.841+0000 7fdb06800640 1 -- 172.21.15.173:0/1859962226 shutdown_connections 2024-04-25T09:08:37.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.841+0000 7fdb06800640 1 --2- 172.21.15.173:0/1859962226 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdadc066f60 0x7fdadc069420 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.841+0000 7fdb06800640 1 --2- 172.21.15.173:0/1859962226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb000cc7e0 0x7fdb000b13f0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.841+0000 7fdb06800640 1 --2- 172.21.15.173:0/1859962226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb000aef70 0x7fdb0014b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.841+0000 7fdb06800640 1 --2- 172.21.15.173:0/1859962226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb000aeb90 0x7fdb0015a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.841+0000 7fdb06800640 1 -- 172.21.15.173:0/1859962226 >> 172.21.15.173:0/1859962226 conn(0x7fdb0006ac90 msgr2=0x7fdb000cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.841+0000 7fdb06800640 1 -- 172.21.15.173:0/1859962226 shutdown_connections 2024-04-25T09:08:37.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:37.841+0000 7fdb06800640 1 -- 172.21.15.173:0/1859962226 wait complete. 2024-04-25T09:08:37.877 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-04-25T09:08:37.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:37.877 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start '~mdsdir' recursive 2024-04-25T09:08:38.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.029+0000 7f7e98200640 1 Processor -- start 2024-04-25T09:08:38.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.029+0000 7f7e98200640 1 -- start start 2024-04-25T09:08:38.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.029+0000 7f7e98200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7e90145290 0x7f7e9015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.029+0000 7f7e98200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e900cc260 0x7f7e900cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.029+0000 7f7e98200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9015c5f0 con 0x7f7e900b3fe0 2024-04-25T09:08:38.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.029+0000 7f7e98200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9006d4b0 con 0x7f7e90145290 2024-04-25T09:08:38.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.029+0000 7f7e98200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9006d790 con 0x7f7e900cc260 2024-04-25T09:08:38.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.029+0000 7f7e95800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7e90145290 0x7f7e9015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.029+0000 7f7e94e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f7e900b3fe0 0x7f7e900b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49924/0 (socket says 172.21.15.173:49924) 2024-04-25T09:08:38.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.029+0000 7f7e94e00640 1 -- 172.21.15.173:0/221440978 learned_addr learned my addr 172.21.15.173:0/221440978 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:08:38.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.029+0000 7f7e96200640 1 --2- 172.21.15.173:0/221440978 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e900cc260 0x7f7e900cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.033+0000 7f7e95800640 1 -- 172.21.15.173:0/221440978 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e900cc260 msgr2=0x7f7e900cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.033+0000 7f7e95800640 1 --2- 172.21.15.173:0/221440978 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e900cc260 0x7f7e900cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.033+0000 7f7e95800640 1 -- 172.21.15.173:0/221440978 >> v1:172.21.15.173:6789/0 conn(0x7f7e900b3fe0 legacy=0x7f7e900b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.033+0000 7f7e95800640 1 -- 172.21.15.173:0/221440978 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9006da70 con 0x7f7e90145290 2024-04-25T09:08:38.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.033+0000 7f7e95800640 1 --2- 172.21.15.173:0/221440978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e90145290 0x7f7e9015c0b0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f7e840097c0 tx=0x7f7e8401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f130fa95c86f715 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.033+0000 7f7e8fe00640 1 -- 172.21.15.173:0/221440978 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e840b0070 con 0x7f7e90145290 2024-04-25T09:08:38.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.033+0000 7f7e8fe00640 1 -- 172.21.15.173:0/221440978 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e840ab600 con 0x7f7e90145290 2024-04-25T09:08:38.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.033+0000 7f7e8fe00640 1 -- 172.21.15.173:0/221440978 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e840ab9d0 con 0x7f7e90145290 2024-04-25T09:08:38.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.033+0000 7f7e98200640 1 -- 172.21.15.173:0/221440978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e90145290 msgr2=0x7f7e9015c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.033+0000 7f7e98200640 1 --2- 172.21.15.173:0/221440978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e90145290 0x7f7e9015c0b0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f7e840097c0 tx=0x7f7e8401c380 comp rx=0 tx=0).stop 2024-04-25T09:08:38.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e98200640 1 -- 172.21.15.173:0/221440978 shutdown_connections 2024-04-25T09:08:38.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e98200640 1 --2- 172.21.15.173:0/221440978 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e900cc260 0x7f7e900cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e98200640 1 --2- 172.21.15.173:0/221440978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e90145290 0x7f7e9015c0b0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e98200640 1 -- 172.21.15.173:0/221440978 >> 172.21.15.173:0/221440978 conn(0x7f7e9006ac90 msgr2=0x7f7e9006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e98200640 1 -- 172.21.15.173:0/221440978 shutdown_connections 2024-04-25T09:08:38.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e98200640 1 -- 172.21.15.173:0/221440978 wait complete. 2024-04-25T09:08:38.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e98200640 1 Processor -- start 2024-04-25T09:08:38.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e98200640 1 -- start start 2024-04-25T09:08:38.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e98200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e900b3fe0 0x7f7e9015adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e98200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e900cc260 0x7f7e901408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e98200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e90145290 0x7f7e901439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e98200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9006ed60 con 0x7f7e90145290 2024-04-25T09:08:38.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e98200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9006eee0 con 0x7f7e900cc260 2024-04-25T09:08:38.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e98200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9006f060 con 0x7f7e900b3fe0 2024-04-25T09:08:38.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e96200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e90145290 0x7f7e901439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e96200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e90145290 0x7f7e901439b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58834/0 (socket says 172.21.15.173:58834) 2024-04-25T09:08:38.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e96200640 1 -- 172.21.15.173:0/1433188179 learned_addr learned my addr 172.21.15.173:0/1433188179 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:08:38.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e95800640 1 --2- 172.21.15.173:0/1433188179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e900b3fe0 0x7f7e9015adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e94e00640 1 --2- 172.21.15.173:0/1433188179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e900cc260 0x7f7e901408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e96200640 1 -- 172.21.15.173:0/1433188179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e900b3fe0 msgr2=0x7f7e9015adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e96200640 1 --2- 172.21.15.173:0/1433188179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e900b3fe0 0x7f7e9015adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e96200640 1 -- 172.21.15.173:0/1433188179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e900cc260 msgr2=0x7f7e901408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e96200640 1 --2- 172.21.15.173:0/1433188179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e900cc260 0x7f7e901408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e96200640 1 -- 172.21.15.173:0/1433188179 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e900ac960 con 0x7f7e90145290 2024-04-25T09:08:38.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.037+0000 7f7e96200640 1 --2- 172.21.15.173:0/1433188179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e90145290 0x7f7e901439b0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f7e8800efc0 tx=0x7f7e8800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.041+0000 7f7e8d600640 1 -- 172.21.15.173:0/1433188179 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88018020 con 0x7f7e90145290 2024-04-25T09:08:38.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.041+0000 7f7e8d600640 1 -- 172.21.15.173:0/1433188179 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e88014480 con 0x7f7e90145290 2024-04-25T09:08:38.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.041+0000 7f7e8d600640 1 -- 172.21.15.173:0/1433188179 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88014870 con 0x7f7e90145290 2024-04-25T09:08:38.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.041+0000 7f7e98200640 1 -- 172.21.15.173:0/1433188179 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e90143260 con 0x7f7e90145290 2024-04-25T09:08:38.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.041+0000 7f7e98200640 1 -- 172.21.15.173:0/1433188179 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e90143540 con 0x7f7e90145290 2024-04-25T09:08:38.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.041+0000 7f7e8d600640 1 -- 172.21.15.173:0/1433188179 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7e8801b020 con 0x7f7e90145290 2024-04-25T09:08:38.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.041+0000 7f7e8d600640 1 --2- 172.21.15.173:0/1433188179 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7e70066f60 0x7f7e70069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.041+0000 7f7e8d600640 1 -- 172.21.15.173:0/1433188179 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7e88085ac0 con 0x7f7e90145290 2024-04-25T09:08:38.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.041+0000 7f7e95800640 1 --2- 172.21.15.173:0/1433188179 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7e70066f60 0x7f7e70069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e95800640 1 --2- 172.21.15.173:0/1433188179 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7e70066f60 0x7f7e70069420 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7e840ad000 tx=0x7f7e840a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e9b642000 1 Processor -- start 2024-04-25T09:08:38.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e9b642000 1 -- start start 2024-04-25T09:08:38.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e9b642000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ad8c0 0x5635658adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e9b642000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635658ae1e0 0x563565863110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e9b642000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563565863650 0x563565863a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e9b642000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635656b1dd0 con 0x5635658ae1e0 2024-04-25T09:08:38.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e9b642000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56356563a010 con 0x5635658ad8c0 2024-04-25T09:08:38.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e9b642000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5635656ade70 con 0x563565863650 2024-04-25T09:08:38.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e94e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635658ae1e0 0x563565863110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e94e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635658ae1e0 0x563565863110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58850/0 (socket says 172.21.15.173:58850) 2024-04-25T09:08:38.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e94e00640 1 -- 172.21.15.173:0/1582221350 learned_addr learned my addr 172.21.15.173:0/1582221350 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:08:38.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e95800640 1 --2- 172.21.15.173:0/1582221350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ad8c0 0x5635658adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e96200640 1 --2- 172.21.15.173:0/1582221350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563565863650 0x563565863a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e94e00640 1 -- 172.21.15.173:0/1582221350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563565863650 msgr2=0x563565863a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e94e00640 1 --2- 172.21.15.173:0/1582221350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563565863650 0x563565863a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e94e00640 1 -- 172.21.15.173:0/1582221350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ad8c0 msgr2=0x5635658adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e94e00640 1 --2- 172.21.15.173:0/1582221350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ad8c0 0x5635658adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e94e00640 1 -- 172.21.15.173:0/1582221350 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56356566a9c0 con 0x5635658ae1e0 2024-04-25T09:08:38.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e96200640 1 --2- 172.21.15.173:0/1582221350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563565863650 0x563565863a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:38.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e94e00640 1 --2- 172.21.15.173:0/1582221350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635658ae1e0 0x563565863110 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c000f70 tx=0x7f7e7c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f688e887d2949e55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e82000640 1 -- 172.21.15.173:0/1582221350 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0017b0 con 0x5635658ae1e0 2024-04-25T09:08:38.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e82000640 1 -- 172.21.15.173:0/1582221350 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c018070 con 0x5635658ae1e0 2024-04-25T09:08:38.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e82000640 1 -- 172.21.15.173:0/1582221350 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c001b50 con 0x5635658ae1e0 2024-04-25T09:08:38.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e9b642000 1 -- 172.21.15.173:0/1582221350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635658ae1e0 msgr2=0x563565863110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e9b642000 1 --2- 172.21.15.173:0/1582221350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635658ae1e0 0x563565863110 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c000f70 tx=0x7f7e7c007430 comp rx=0 tx=0).stop 2024-04-25T09:08:38.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e9b642000 1 -- 172.21.15.173:0/1582221350 shutdown_connections 2024-04-25T09:08:38.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e9b642000 1 --2- 172.21.15.173:0/1582221350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x563565863650 0x563565863a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e9b642000 1 --2- 172.21.15.173:0/1582221350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635658ae1e0 0x563565863110 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e9b642000 1 --2- 172.21.15.173:0/1582221350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ad8c0 0x5635658adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e9b642000 1 -- 172.21.15.173:0/1582221350 >> 172.21.15.173:0/1582221350 conn(0x56356574b870 msgr2=0x5635658619f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e9b642000 1 -- 172.21.15.173:0/1582221350 shutdown_connections 2024-04-25T09:08:38.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e9b642000 1 -- 172.21.15.173:0/1582221350 wait complete. 2024-04-25T09:08:38.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.045+0000 7f7e9b642000 1 -- start start 2024-04-25T09:08:38.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e9b642000 1 Processor -- start 2024-04-25T09:08:38.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e9b642000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 0x563565867f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e9b642000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5635658ad8c0 0x5635658684b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e9b642000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ae1e0 0x5635658689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e9b642000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56356566c420 con 0x563565863650 2024-04-25T09:08:38.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e9b642000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635656b6400 con 0x5635658ae1e0 2024-04-25T09:08:38.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e9b642000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x563565658ae0 con 0x5635658ad8c0 2024-04-25T09:08:38.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e9b642000 10 client.0 _ll_register_callbacks cb 0x56356584ef90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:38.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e95800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 0x563565867f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e95800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 0x563565867f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58860/0 (socket says 172.21.15.173:58860) 2024-04-25T09:08:38.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e95800640 1 -- 172.21.15.173:0/3615921104 learned_addr learned my addr 172.21.15.173:0/3615921104 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:08:38.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e94e00640 1 --2- 172.21.15.173:0/3615921104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5635658ad8c0 0x5635658684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e96200640 1 --2- 172.21.15.173:0/3615921104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ae1e0 0x5635658689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e95800640 1 -- 172.21.15.173:0/3615921104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5635658ad8c0 msgr2=0x5635658684b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e95800640 1 --2- 172.21.15.173:0/3615921104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5635658ad8c0 0x5635658684b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e95800640 1 -- 172.21.15.173:0/3615921104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ae1e0 msgr2=0x5635658689f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e95800640 1 --2- 172.21.15.173:0/3615921104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ae1e0 0x5635658689f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e95800640 1 -- 172.21.15.173:0/3615921104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56356563a260 con 0x563565863650 2024-04-25T09:08:38.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e95800640 1 --2- 172.21.15.173:0/3615921104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 0x563565867f70 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009580 tx=0x7f7e8401abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17af2536f8ac40d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e76a00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:08:38.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e76a00640 1 -- 172.21.15.173:0/3615921104 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e840c8020 con 0x563565863650 2024-04-25T09:08:38.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e76a00640 1 -- 172.21.15.173:0/3615921104 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7e840c4450 con 0x563565863650 2024-04-25T09:08:38.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e9b642000 1 -- 172.21.15.173:0/3615921104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e7c018070 con 0x563565863650 2024-04-25T09:08:38.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e76a00640 1 -- 172.21.15.173:0/3615921104 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e840d2050 con 0x563565863650 2024-04-25T09:08:38.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e9b642000 10 client.7479 fetch_fsmap learned FSMap version 56 2024-04-25T09:08:38.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e9b642000 1 -- 172.21.15.173:0/3615921104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x56356566cb30 con 0x563565863650 2024-04-25T09:08:38.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e76a00640 1 -- 172.21.15.173:0/3615921104 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c018070 con 0x563565863650 2024-04-25T09:08:38.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e76a00640 1 -- 172.21.15.173:0/3615921104 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7e840d5020 con 0x563565863650 2024-04-25T09:08:38.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e9b642000 10 client.7479 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T09:08:38.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e9b642000 10 client.7479 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:08:38.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e9b642000 20 client.7479 populate_metadata read hostname 'smithi173' 2024-04-25T09:08:38.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e9b642000 1 --2- 172.21.15.173:0/3615921104 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x563565869400 0x5635658be960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e9b642000 4 client.7479 mds_command: new command op to 7263 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:08:38.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e9b642000 1 -- 172.21.15.173:0/3615921104 --> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56356564dc80 con 0x563565869400 2024-04-25T09:08:38.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e94e00640 1 --2- 172.21.15.173:0/3615921104 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x563565869400 0x5635658be960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e94e00640 1 --2- 172.21.15.173:0/3615921104 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x563565869400 0x5635658be960 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2f4564f22ce142d server_cookie=5635462dae513253 in_seq=0 out_seq=0 2024-04-25T09:08:38.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.049+0000 7f7e76a00640 10 client.7479 ms_handle_connect on v2:172.21.15.173:6836/2444108646 2024-04-25T09:08:38.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.053+0000 7f7e76a00640 1 -- 172.21.15.173:0/3615921104 <== mds.0 v2:172.21.15.173:6836/2444108646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56356564dc80 con 0x563565869400 2024-04-25T09:08:38.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.053+0000 7f7e76a00640 10 client.7479 handle_command_reply: tid=0 2024-04-25T09:08:38.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.053+0000 7f7e9b642000 1 client.7479 shutdown 2024-04-25T09:08:38.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.053+0000 7f7e9b642000 1 -- 172.21.15.173:0/3615921104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 msgr2=0x563565867f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.053+0000 7f7e9b642000 1 --2- 172.21.15.173:0/3615921104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 0x563565867f70 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009580 tx=0x7f7e8401abc0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.053+0000 7f7e9b642000 1 -- 172.21.15.173:0/3615921104 shutdown_connections 2024-04-25T09:08:38.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.053+0000 7f7e9b642000 1 --2- 172.21.15.173:0/3615921104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ae1e0 0x5635658689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.053+0000 7f7e9b642000 1 --2- 172.21.15.173:0/3615921104 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x563565869400 0x5635658be960 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.053+0000 7f7e9b642000 1 --2- 172.21.15.173:0/3615921104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5635658ad8c0 0x5635658684b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.053+0000 7f7e9b642000 1 --2- 172.21.15.173:0/3615921104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 0x563565867f70 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.053+0000 7f7e76a00640 0 client.7479 ms_handle_reset on v2:172.21.15.173:6836/2444108646 2024-04-25T09:08:38.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.053+0000 7f7e9b642000 1 -- 172.21.15.173:0/3615921104 >> 172.21.15.173:0/3615921104 conn(0x56356574b870 msgr2=0x5635658619f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.053+0000 7f7e9b642000 1 -- 172.21.15.173:0/3615921104 shutdown_connections 2024-04-25T09:08:38.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.053+0000 7f7e9b642000 1 -- 172.21.15.173:0/3615921104 wait complete. 2024-04-25T09:08:38.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.053+0000 7f7e9b642000 20 client.7479 trim_cache size 0 max 16384 2024-04-25T09:08:38.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.065+0000 7f7e9b642000 1 Processor -- start 2024-04-25T09:08:38.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.065+0000 7f7e9b642000 1 -- start start 2024-04-25T09:08:38.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e9b642000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 0x5635658ac910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e9b642000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5635658ad8c0 0x5635658ace50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e9b642000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ae1e0 0x5635658bd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e9b642000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e90203450 con 0x563565863650 2024-04-25T09:08:38.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e9b642000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e902025f0 con 0x5635658ae1e0 2024-04-25T09:08:38.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e9b642000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e901fae10 con 0x5635658ad8c0 2024-04-25T09:08:38.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e95800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 0x5635658ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e95800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 0x5635658ac910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58866/0 (socket says 172.21.15.173:58866) 2024-04-25T09:08:38.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e95800640 1 -- 172.21.15.173:0/1567781387 learned_addr learned my addr 172.21.15.173:0/1567781387 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:08:38.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e96200640 1 --2- 172.21.15.173:0/1567781387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ae1e0 0x5635658bd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e94e00640 1 --2- 172.21.15.173:0/1567781387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5635658ad8c0 0x5635658ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e95800640 1 -- 172.21.15.173:0/1567781387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5635658ad8c0 msgr2=0x5635658ace50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e95800640 1 --2- 172.21.15.173:0/1567781387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5635658ad8c0 0x5635658ace50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e95800640 1 -- 172.21.15.173:0/1567781387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ae1e0 msgr2=0x5635658bd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e95800640 1 --2- 172.21.15.173:0/1567781387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ae1e0 0x5635658bd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e95800640 1 -- 172.21.15.173:0/1567781387 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635657376d0 con 0x563565863650 2024-04-25T09:08:38.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e96200640 1 --2- 172.21.15.173:0/1567781387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ae1e0 0x5635658bd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:38.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e94e00640 1 --2- 172.21.15.173:0/1567781387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5635658ad8c0 0x5635658ace50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:38.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e95800640 1 --2- 172.21.15.173:0/1567781387 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 0x5635658ac910 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f7e8401aa30 tx=0x7f7e840c1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d02eb2c61322cf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e81600640 1 -- 172.21.15.173:0/1567781387 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e840ba030 con 0x563565863650 2024-04-25T09:08:38.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e81600640 1 -- 172.21.15.173:0/1567781387 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e840b1040 con 0x563565863650 2024-04-25T09:08:38.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e81600640 1 -- 172.21.15.173:0/1567781387 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e840c8040 con 0x563565863650 2024-04-25T09:08:38.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e9b642000 1 -- 172.21.15.173:0/1567781387 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 msgr2=0x5635658ac910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e9b642000 1 --2- 172.21.15.173:0/1567781387 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 0x5635658ac910 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f7e8401aa30 tx=0x7f7e840c1000 comp rx=0 tx=0).stop 2024-04-25T09:08:38.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e9b642000 1 -- 172.21.15.173:0/1567781387 shutdown_connections 2024-04-25T09:08:38.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e9b642000 1 --2- 172.21.15.173:0/1567781387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ae1e0 0x5635658bd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e9b642000 1 --2- 172.21.15.173:0/1567781387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5635658ad8c0 0x5635658ace50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e9b642000 1 --2- 172.21.15.173:0/1567781387 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 0x5635658ac910 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e9b642000 1 -- 172.21.15.173:0/1567781387 >> 172.21.15.173:0/1567781387 conn(0x56356574b870 msgr2=0x5635658ac200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e9b642000 1 -- 172.21.15.173:0/1567781387 shutdown_connections 2024-04-25T09:08:38.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e9b642000 1 -- 172.21.15.173:0/1567781387 wait complete. 2024-04-25T09:08:38.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e9b642000 1 -- start start 2024-04-25T09:08:38.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.069+0000 7f7e9b642000 1 Processor -- start 2024-04-25T09:08:38.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e9b642000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 0x56356590dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e9b642000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5635658ad8c0 0x56356590e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e9b642000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ae1e0 0x56356590e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e9b642000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635656b10e0 con 0x563565863650 2024-04-25T09:08:38.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e9b642000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e900ae170 con 0x5635658ae1e0 2024-04-25T09:08:38.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e9b642000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56356586cc20 con 0x5635658ad8c0 2024-04-25T09:08:38.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e9b642000 10 client.0 _ll_register_callbacks cb 0x56356564e200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:38.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e95800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 0x56356590dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e95800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 0x56356590dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58872/0 (socket says 172.21.15.173:58872) 2024-04-25T09:08:38.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e95800640 1 -- 172.21.15.173:0/2695227664 learned_addr learned my addr 172.21.15.173:0/2695227664 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:08:38.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e94e00640 1 --2- 172.21.15.173:0/2695227664 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5635658ad8c0 0x56356590e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e96200640 1 --2- 172.21.15.173:0/2695227664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ae1e0 0x56356590e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e95800640 1 -- 172.21.15.173:0/2695227664 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5635658ad8c0 msgr2=0x56356590e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e95800640 1 --2- 172.21.15.173:0/2695227664 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5635658ad8c0 0x56356590e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e95800640 1 -- 172.21.15.173:0/2695227664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ae1e0 msgr2=0x56356590e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e95800640 1 --2- 172.21.15.173:0/2695227664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ae1e0 0x56356590e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e95800640 1 -- 172.21.15.173:0/2695227664 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563565734900 con 0x563565863650 2024-04-25T09:08:38.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e95800640 1 --2- 172.21.15.173:0/2695227664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 0x56356590dc70 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f7e8401c860 tx=0x7f7e84008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0fa96d803d63f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e76a00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:08:38.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e76a00640 1 -- 172.21.15.173:0/2695227664 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e840da070 con 0x563565863650 2024-04-25T09:08:38.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e76a00640 1 -- 172.21.15.173:0/2695227664 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7e840c4d80 con 0x563565863650 2024-04-25T09:08:38.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e9b642000 1 -- 172.21.15.173:0/2695227664 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e840b1040 con 0x563565863650 2024-04-25T09:08:38.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e76a00640 1 -- 172.21.15.173:0/2695227664 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e840e6050 con 0x563565863650 2024-04-25T09:08:38.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e9b642000 10 client.7485 fetch_fsmap learned FSMap version 56 2024-04-25T09:08:38.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e9b642000 1 -- 172.21.15.173:0/2695227664 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x563565658f20 con 0x563565863650 2024-04-25T09:08:38.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e76a00640 1 -- 172.21.15.173:0/2695227664 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e840b1040 con 0x563565863650 2024-04-25T09:08:38.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e76a00640 1 -- 172.21.15.173:0/2695227664 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7e840e9020 con 0x563565863650 2024-04-25T09:08:38.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e9b642000 10 client.7485 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T09:08:38.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e9b642000 10 client.7485 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:08:38.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e9b642000 20 client.7485 populate_metadata read hostname 'smithi173' 2024-04-25T09:08:38.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e9b642000 1 --2- 172.21.15.173:0/2695227664 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x56356590ab30 0x56356590af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e9b642000 4 client.7485 mds_command: new command op to 7263 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-04-25T09:08:38.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e9b642000 1 -- 172.21.15.173:0/2695227664 --> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) v1 -- 0x5635656bf310 con 0x56356590ab30 2024-04-25T09:08:38.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e94e00640 1 --2- 172.21.15.173:0/2695227664 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x56356590ab30 0x56356590af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e76a00640 10 client.7485 ms_handle_connect on v2:172.21.15.173:6836/2444108646 2024-04-25T09:08:38.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.073+0000 7f7e94e00640 1 --2- 172.21.15.173:0/2695227664 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x56356590ab30 0x56356590af40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e064bb2668fa024 server_cookie=cbc467e1e7f20ed5 in_seq=0 out_seq=0 2024-04-25T09:08:38.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.081+0000 7f7e76a00640 1 -- 172.21.15.173:0/2695227664 <== mds.0 v2:172.21.15.173:6836/2444108646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5635656bf310 con 0x56356590ab30 2024-04-25T09:08:38.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.081+0000 7f7e76a00640 10 client.7485 handle_command_reply: tid=0 2024-04-25T09:08:38.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.081+0000 7f7e9b642000 1 client.7485 shutdown 2024-04-25T09:08:38.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.081+0000 7f7e9b642000 1 -- 172.21.15.173:0/2695227664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 msgr2=0x56356590dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.081+0000 7f7e9b642000 1 --2- 172.21.15.173:0/2695227664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 0x56356590dc70 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f7e8401c860 tx=0x7f7e84008040 comp rx=0 tx=0).stop 2024-04-25T09:08:38.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.081+0000 7f7e9b642000 1 -- 172.21.15.173:0/2695227664 shutdown_connections 2024-04-25T09:08:38.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.081+0000 7f7e9b642000 1 --2- 172.21.15.173:0/2695227664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5635658ae1e0 0x56356590e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.081+0000 7f7e9b642000 1 --2- 172.21.15.173:0/2695227664 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x56356590ab30 0x56356590af40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.081+0000 7f7e9b642000 1 --2- 172.21.15.173:0/2695227664 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5635658ad8c0 0x56356590e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.081+0000 7f7e9b642000 1 --2- 172.21.15.173:0/2695227664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563565863650 0x56356590dc70 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.081+0000 7f7e76a00640 0 client.7485 ms_handle_reset on v2:172.21.15.173:6836/2444108646 2024-04-25T09:08:38.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.081+0000 7f7e9b642000 1 -- 172.21.15.173:0/2695227664 >> 172.21.15.173:0/2695227664 conn(0x56356574b870 msgr2=0x5635658ac910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.081+0000 7f7e9b642000 1 -- 172.21.15.173:0/2695227664 shutdown_connections 2024-04-25T09:08:38.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.081+0000 7f7e9b642000 1 -- 172.21.15.173:0/2695227664 wait complete. 2024-04-25T09:08:38.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.081+0000 7f7e9b642000 20 client.7485 trim_cache size 0 max 16384 2024-04-25T09:08:38.072 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:08:38.072 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0, 2024-04-25T09:08:38.072 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_tag": "aca8521e-b142-4e50-ac0d-26aa51e5c597", 2024-04-25T09:08:38.072 INFO:teuthology.orchestra.run.smithi173.stdout: "mode": "asynchronous" 2024-04-25T09:08:38.072 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:08:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.085+0000 7f7e98200640 1 -- 172.21.15.173:0/1433188179 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7e70066f60 msgr2=0x7f7e70069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.085+0000 7f7e98200640 1 --2- 172.21.15.173:0/1433188179 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7e70066f60 0x7f7e70069420 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7e840ad000 tx=0x7f7e840a6000 comp rx=0 tx=0).stop 2024-04-25T09:08:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.085+0000 7f7e98200640 1 -- 172.21.15.173:0/1433188179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e90145290 msgr2=0x7f7e901439b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.085+0000 7f7e98200640 1 --2- 172.21.15.173:0/1433188179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e90145290 0x7f7e901439b0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f7e8800efc0 tx=0x7f7e8800c490 comp rx=0 tx=0).stop 2024-04-25T09:08:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.085+0000 7f7e98200640 1 -- 172.21.15.173:0/1433188179 shutdown_connections 2024-04-25T09:08:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.085+0000 7f7e98200640 1 --2- 172.21.15.173:0/1433188179 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7e70066f60 0x7f7e70069420 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.085+0000 7f7e98200640 1 --2- 172.21.15.173:0/1433188179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e90145290 0x7f7e901439b0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.085+0000 7f7e98200640 1 --2- 172.21.15.173:0/1433188179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e900cc260 0x7f7e901408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.085+0000 7f7e98200640 1 --2- 172.21.15.173:0/1433188179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e900b3fe0 0x7f7e9015adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.085+0000 7f7e98200640 1 -- 172.21.15.173:0/1433188179 >> 172.21.15.173:0/1433188179 conn(0x7f7e9006ac90 msgr2=0x7f7e9015c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.085+0000 7f7e98200640 1 -- 172.21.15.173:0/1433188179 shutdown_connections 2024-04-25T09:08:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.085+0000 7f7e98200640 1 -- 172.21.15.173:0/1433188179 wait complete. 2024-04-25T09:08:38.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:38.091 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T09:08:38.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.329+0000 7fae43000640 1 Processor -- start 2024-04-25T09:08:38.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.329+0000 7fae43000640 1 -- start start 2024-04-25T09:08:38.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.329+0000 7fae43000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae3c0ce930 0x7fae3c15ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.329+0000 7fae43000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fae3c0b8b90 0x7fae3c0b9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.333+0000 7fae41200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae3c0ce930 0x7fae3c15ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.333+0000 7fae41200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae3c0ce930 0x7fae3c15ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:54762/0 (socket says 172.21.15.173:54762) 2024-04-25T09:08:38.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.333+0000 7fae42600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fae3c0b8b90 0x7fae3c0b9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.333+0000 7fae42600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fae3c0b8b90 0x7fae3c0b9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58880/0 (socket says 172.21.15.173:58880) 2024-04-25T09:08:38.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.333+0000 7fae43000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c161720 con 0x7fae3c0b53e0 2024-04-25T09:08:38.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.333+0000 7fae43000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3c1619e0 con 0x7fae3c0b8b90 2024-04-25T09:08:38.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.333+0000 7fae43000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c161cc0 con 0x7fae3c0ce930 2024-04-25T09:08:38.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.333+0000 7fae41200640 1 -- 172.21.15.173:0/2086784036 learned_addr learned my addr 172.21.15.173:0/2086784036 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:08:38.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.333+0000 7fae41200640 1 -- 172.21.15.173:0/2086784036 >> v2:172.21.15.173:3300/0 conn(0x7fae3c0b8b90 msgr2=0x7fae3c0b9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.333+0000 7fae41200640 1 --2- 172.21.15.173:0/2086784036 >> v2:172.21.15.173:3300/0 conn(0x7fae3c0b8b90 0x7fae3c0b9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.333+0000 7fae41200640 1 -- 172.21.15.173:0/2086784036 >> v1:172.21.15.194:6789/0 conn(0x7fae3c0b53e0 legacy=0x7fae3c0b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.333+0000 7fae41200640 1 -- 172.21.15.173:0/2086784036 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c161fa0 con 0x7fae3c0ce930 2024-04-25T09:08:38.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.341+0000 7fae41200640 1 --2- 172.21.15.173:0/2086784036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae3c0ce930 0x7fae3c15ea30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fae30009870 tx=0x7fae3001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6e7c3db983b4c77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.341+0000 7fae3be00640 1 -- 172.21.15.173:0/2086784036 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae300b0070 con 0x7fae3c0ce930 2024-04-25T09:08:38.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.341+0000 7fae3be00640 1 -- 172.21.15.173:0/2086784036 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae300ab600 con 0x7fae3c0ce930 2024-04-25T09:08:38.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.341+0000 7fae3be00640 1 -- 172.21.15.173:0/2086784036 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae300ab9d0 con 0x7fae3c0ce930 2024-04-25T09:08:38.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.341+0000 7fae43000640 1 -- 172.21.15.173:0/2086784036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae3c0ce930 msgr2=0x7fae3c15ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.341+0000 7fae43000640 1 --2- 172.21.15.173:0/2086784036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae3c0ce930 0x7fae3c15ea30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fae30009870 tx=0x7fae3001c4d0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.341+0000 7fae43000640 1 -- 172.21.15.173:0/2086784036 shutdown_connections 2024-04-25T09:08:38.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.341+0000 7fae43000640 1 --2- 172.21.15.173:0/2086784036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae3c0ce930 0x7fae3c15ea30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.341+0000 7fae43000640 1 --2- 172.21.15.173:0/2086784036 >> v2:172.21.15.173:3300/0 conn(0x7fae3c0b8b90 0x7fae3c0b9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.341+0000 7fae43000640 1 -- 172.21.15.173:0/2086784036 >> 172.21.15.173:0/2086784036 conn(0x7fae3c0d03e0 msgr2=0x7fae3c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.341+0000 7fae43000640 1 -- 172.21.15.173:0/2086784036 shutdown_connections 2024-04-25T09:08:38.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.345+0000 7fae43000640 1 -- 172.21.15.173:0/2086784036 wait complete. 2024-04-25T09:08:38.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.345+0000 7fae43000640 1 Processor -- start 2024-04-25T09:08:38.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.345+0000 7fae43000640 1 -- start start 2024-04-25T09:08:38.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.349+0000 7fae43000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae3c0b53e0 0x7fae3c159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.349+0000 7fae43000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae3c0b8b90 0x7fae3c0c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.349+0000 7fae43000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae3c0ce930 0x7fae3c0c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.349+0000 7fae43000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0d29b0 con 0x7fae3c0ce930 2024-04-25T09:08:38.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.349+0000 7fae43000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0d2830 con 0x7fae3c0b8b90 2024-04-25T09:08:38.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.349+0000 7fae43000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0d2b30 con 0x7fae3c0b53e0 2024-04-25T09:08:38.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.349+0000 7fae41c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae3c0b53e0 0x7fae3c159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.349+0000 7fae41c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae3c0b53e0 0x7fae3c159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:54772/0 (socket says 172.21.15.173:54772) 2024-04-25T09:08:38.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.349+0000 7fae41c00640 1 -- 172.21.15.173:0/3449751772 learned_addr learned my addr 172.21.15.173:0/3449751772 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:08:38.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.349+0000 7fae41200640 1 --2- 172.21.15.173:0/3449751772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae3c0b8b90 0x7fae3c0c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.349+0000 7fae41200640 1 -- 172.21.15.173:0/3449751772 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae3c0b53e0 msgr2=0x7fae3c159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.349+0000 7fae41200640 1 --2- 172.21.15.173:0/3449751772 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae3c0b53e0 0x7fae3c159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.349+0000 7fae41200640 1 -- 172.21.15.173:0/3449751772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae3c0ce930 msgr2=0x7fae3c0c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.349+0000 7fae41200640 1 --2- 172.21.15.173:0/3449751772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae3c0ce930 0x7fae3c0c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.349+0000 7fae41200640 1 -- 172.21.15.173:0/3449751772 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c0c7c80 con 0x7fae3c0b8b90 2024-04-25T09:08:38.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.353+0000 7fae41200640 1 --2- 172.21.15.173:0/3449751772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae3c0b8b90 0x7fae3c0c7450 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fae300ab000 tx=0x7fae30019270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.353+0000 7fae39600640 1 -- 172.21.15.173:0/3449751772 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae300b0070 con 0x7fae3c0b8b90 2024-04-25T09:08:38.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.353+0000 7fae39600640 1 -- 172.21.15.173:0/3449751772 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae300b1040 con 0x7fae3c0b8b90 2024-04-25T09:08:38.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.353+0000 7fae39600640 1 -- 172.21.15.173:0/3449751772 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae300b7690 con 0x7fae3c0b8b90 2024-04-25T09:08:38.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.353+0000 7fae43000640 1 -- 172.21.15.173:0/3449751772 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3c0c7f60 con 0x7fae3c0b8b90 2024-04-25T09:08:38.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.353+0000 7fae43000640 1 -- 172.21.15.173:0/3449751772 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3c0c8520 con 0x7fae3c0b8b90 2024-04-25T09:08:38.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.361+0000 7fae39600640 1 -- 172.21.15.173:0/3449751772 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fae300bf030 con 0x7fae3c0b8b90 2024-04-25T09:08:38.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.361+0000 7fae479dd000 1 Processor -- start 2024-04-25T09:08:38.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.361+0000 7fae39600640 1 --2- 172.21.15.173:0/3449751772 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fae1c067030 0x7fae1c0694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.361+0000 7fae39600640 1 -- 172.21.15.173:0/3449751772 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fae3011f170 con 0x7fae3c0b8b90 2024-04-25T09:08:38.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.365+0000 7fae479dd000 1 -- start start 2024-04-25T09:08:38.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.365+0000 7fae479dd000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e6779d0 0x55ad4e677db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.365+0000 7fae479dd000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e6782f0 0x55ad4e62db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.365+0000 7fae479dd000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e62e0a0 0x55ad4e62e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.365+0000 7fae479dd000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad4e47aff0 con 0x55ad4e6779d0 2024-04-25T09:08:38.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.365+0000 7fae479dd000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad4e403150 con 0x55ad4e62e0a0 2024-04-25T09:08:38.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.365+0000 7fae479dd000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ad4e477090 con 0x55ad4e6782f0 2024-04-25T09:08:38.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.365+0000 7fae41200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e6782f0 0x55ad4e62db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.365+0000 7fae41200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e6782f0 0x55ad4e62db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:54784/0 (socket says 172.21.15.173:54784) 2024-04-25T09:08:38.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.365+0000 7fae41200640 1 -- 172.21.15.173:0/2001195146 learned_addr learned my addr 172.21.15.173:0/2001195146 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:08:38.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.369+0000 7fae41200640 1 -- 172.21.15.173:0/2001195146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e62e0a0 msgr2=0x55ad4e62e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.369+0000 7fae41200640 1 --2- 172.21.15.173:0/2001195146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e62e0a0 0x55ad4e62e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.369+0000 7fae41200640 1 -- 172.21.15.173:0/2001195146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e6779d0 msgr2=0x55ad4e677db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.369+0000 7fae41200640 1 --2- 172.21.15.173:0/2001195146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e6779d0 0x55ad4e677db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.369+0000 7fae41200640 1 -- 172.21.15.173:0/2001195146 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad4e6110d0 con 0x55ad4e6782f0 2024-04-25T09:08:38.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.369+0000 7fae42600640 1 --2- 172.21.15.173:0/3449751772 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fae1c067030 0x7fae1c0694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.369+0000 7fae41200640 1 --2- 172.21.15.173:0/2001195146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e6782f0 0x55ad4e62db60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fae3001a100 tx=0x7fae300ef6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffc6f3ccbe4b0af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.369+0000 7fae2e000640 1 -- 172.21.15.173:0/2001195146 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae300efa80 con 0x55ad4e6782f0 2024-04-25T09:08:38.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.369+0000 7fae2e000640 1 -- 172.21.15.173:0/2001195146 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae30000e50 con 0x55ad4e6782f0 2024-04-25T09:08:38.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.369+0000 7fae2e000640 1 -- 172.21.15.173:0/2001195146 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae300f3bd0 con 0x55ad4e6782f0 2024-04-25T09:08:38.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.369+0000 7fae479dd000 1 -- 172.21.15.173:0/2001195146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e6782f0 msgr2=0x55ad4e62db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.369+0000 7fae479dd000 1 --2- 172.21.15.173:0/2001195146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e6782f0 0x55ad4e62db60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fae3001a100 tx=0x7fae300ef6f0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.369+0000 7fae479dd000 1 -- 172.21.15.173:0/2001195146 shutdown_connections 2024-04-25T09:08:38.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.369+0000 7fae479dd000 1 --2- 172.21.15.173:0/2001195146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e62e0a0 0x55ad4e62e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.369+0000 7fae479dd000 1 --2- 172.21.15.173:0/2001195146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e6782f0 0x55ad4e62db60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.369+0000 7fae479dd000 1 --2- 172.21.15.173:0/2001195146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e6779d0 0x55ad4e677db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.369+0000 7fae479dd000 1 -- 172.21.15.173:0/2001195146 >> 172.21.15.173:0/2001195146 conn(0x55ad4e62a020 msgr2=0x55ad4e62c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.373+0000 7fae479dd000 1 -- 172.21.15.173:0/2001195146 shutdown_connections 2024-04-25T09:08:38.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.373+0000 7fae479dd000 1 -- 172.21.15.173:0/2001195146 wait complete. 2024-04-25T09:08:38.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.373+0000 7fae42600640 1 --2- 172.21.15.173:0/3449751772 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fae1c067030 0x7fae1c0694f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fae340070b0 tx=0x7fae3400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.373+0000 7fae479dd000 1 -- start start 2024-04-25T09:08:38.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.373+0000 7fae479dd000 1 Processor -- start 2024-04-25T09:08:38.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.373+0000 7fae479dd000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e62e0a0 0x55ad4e65c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.373+0000 7fae479dd000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e6779d0 0x55ad4e65cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.373+0000 7fae479dd000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e6782f0 0x55ad4e65d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.373+0000 7fae41c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e62e0a0 0x55ad4e65c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.373+0000 7fae41c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e62e0a0 0x55ad4e65c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:53378/0 (socket says 172.21.15.173:53378) 2024-04-25T09:08:38.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.373+0000 7fae41c00640 1 -- 172.21.15.173:0/3296032272 learned_addr learned my addr 172.21.15.173:0/3296032272 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:08:38.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.373+0000 7fae42600640 1 --2- 172.21.15.173:0/3296032272 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e6782f0 0x55ad4e65d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.373+0000 7fae41200640 1 --2- 172.21.15.173:0/3296032272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e6779d0 0x55ad4e65cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.373+0000 7fae479dd000 1 -- 172.21.15.173:0/3296032272 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad4e43f250 con 0x55ad4e6782f0 2024-04-25T09:08:38.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.373+0000 7fae479dd000 1 -- 172.21.15.173:0/3296032272 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad4e435690 con 0x55ad4e62e0a0 2024-04-25T09:08:38.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.373+0000 7fae479dd000 1 -- 172.21.15.173:0/3296032272 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ad4e403a40 con 0x55ad4e6779d0 2024-04-25T09:08:38.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.373+0000 7fae479dd000 10 client.0 _ll_register_callbacks cb 0x55ad4e618e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:38.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.377+0000 7fae41c00640 1 -- 172.21.15.173:0/3296032272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e6779d0 msgr2=0x55ad4e65cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.377+0000 7fae41c00640 1 --2- 172.21.15.173:0/3296032272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e6779d0 0x55ad4e65cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.377+0000 7fae41c00640 1 -- 172.21.15.173:0/3296032272 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e6782f0 msgr2=0x55ad4e65d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.377+0000 7fae41c00640 1 --2- 172.21.15.173:0/3296032272 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e6782f0 0x55ad4e65d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.377+0000 7fae41c00640 1 -- 172.21.15.173:0/3296032272 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ad4e5281c0 con 0x55ad4e62e0a0 2024-04-25T09:08:38.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.377+0000 7fae41c00640 1 --2- 172.21.15.173:0/3296032272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e62e0a0 0x55ad4e65c7f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fae28001e70 tx=0x7fae2800e530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f7cca0ff57a012b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.377+0000 7fae22a00640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-04-25T09:08:38.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.377+0000 7fae22a00640 1 -- 172.21.15.173:0/3296032272 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28019060 con 0x55ad4e62e0a0 2024-04-25T09:08:38.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.377+0000 7fae22a00640 1 -- 172.21.15.173:0/3296032272 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fae280050d0 con 0x55ad4e62e0a0 2024-04-25T09:08:38.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.377+0000 7fae479dd000 1 -- 172.21.15.173:0/3296032272 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae30000e50 con 0x55ad4e62e0a0 2024-04-25T09:08:38.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.377+0000 7fae22a00640 1 -- 172.21.15.173:0/3296032272 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae2801f050 con 0x55ad4e62e0a0 2024-04-25T09:08:38.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.377+0000 7fae479dd000 10 client.6961 fetch_fsmap learned FSMap version 56 2024-04-25T09:08:38.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.377+0000 7fae479dd000 1 -- 172.21.15.173:0/3296032272 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55ad4e524170 con 0x55ad4e62e0a0 2024-04-25T09:08:38.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.377+0000 7fae22a00640 1 -- 172.21.15.173:0/3296032272 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae30000e50 con 0x55ad4e62e0a0 2024-04-25T09:08:38.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.381+0000 7fae22a00640 1 -- 172.21.15.173:0/3296032272 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fae28022020 con 0x55ad4e62e0a0 2024-04-25T09:08:38.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.381+0000 7fae479dd000 10 client.6961 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T09:08:38.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.381+0000 7fae479dd000 10 client.6961 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:08:38.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.381+0000 7fae479dd000 20 client.6961 populate_metadata read hostname 'smithi173' 2024-04-25T09:08:38.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.381+0000 7fae479dd000 1 --2- 172.21.15.173:0/3296032272 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55ad4e687c80 0x55ad4e68a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.381+0000 7fae479dd000 4 client.6961 mds_command: new command op to 7263 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:08:38.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.381+0000 7fae479dd000 1 -- 172.21.15.173:0/3296032272 --> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad4e416c60 con 0x55ad4e687c80 2024-04-25T09:08:38.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.381+0000 7fae41200640 1 --2- 172.21.15.173:0/3296032272 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55ad4e687c80 0x55ad4e68a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.381+0000 7fae41200640 1 --2- 172.21.15.173:0/3296032272 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55ad4e687c80 0x55ad4e68a070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b23d3e1b5c7eca78 server_cookie=4bc960d074c2021b in_seq=0 out_seq=0 2024-04-25T09:08:38.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.381+0000 7fae22a00640 10 client.6961 ms_handle_connect on v2:172.21.15.173:6836/2444108646 2024-04-25T09:08:38.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.385+0000 7fae22a00640 1 -- 172.21.15.173:0/3296032272 <== mds.0 v2:172.21.15.173:6836/2444108646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ad4e416c60 con 0x55ad4e687c80 2024-04-25T09:08:38.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.385+0000 7fae22a00640 10 client.6961 handle_command_reply: tid=0 2024-04-25T09:08:38.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.385+0000 7fae479dd000 1 client.6961 shutdown 2024-04-25T09:08:38.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.385+0000 7fae479dd000 1 -- 172.21.15.173:0/3296032272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e62e0a0 msgr2=0x55ad4e65c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.385+0000 7fae479dd000 1 --2- 172.21.15.173:0/3296032272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e62e0a0 0x55ad4e65c7f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fae28001e70 tx=0x7fae2800e530 comp rx=0 tx=0).stop 2024-04-25T09:08:38.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.385+0000 7fae479dd000 1 -- 172.21.15.173:0/3296032272 shutdown_connections 2024-04-25T09:08:38.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.385+0000 7fae479dd000 1 --2- 172.21.15.173:0/3296032272 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e6782f0 0x55ad4e65d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.385+0000 7fae479dd000 1 --2- 172.21.15.173:0/3296032272 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55ad4e687c80 0x55ad4e68a070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.385+0000 7fae22a00640 0 client.6961 ms_handle_reset on v2:172.21.15.173:6836/2444108646 2024-04-25T09:08:38.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.385+0000 7fae479dd000 1 --2- 172.21.15.173:0/3296032272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e6779d0 0x55ad4e65cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.385+0000 7fae479dd000 1 --2- 172.21.15.173:0/3296032272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e62e0a0 0x55ad4e65c7f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.385+0000 7fae479dd000 1 -- 172.21.15.173:0/3296032272 >> 172.21.15.173:0/3296032272 conn(0x55ad4e62a020 msgr2=0x55ad4e62cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.385+0000 7fae479dd000 1 -- 172.21.15.173:0/3296032272 shutdown_connections 2024-04-25T09:08:38.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.385+0000 7fae479dd000 1 -- 172.21.15.173:0/3296032272 wait complete. 2024-04-25T09:08:38.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.385+0000 7fae479dd000 20 client.6961 trim_cache size 0 max 16384 2024-04-25T09:08:38.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.409+0000 7fae479dd000 1 Processor -- start 2024-04-25T09:08:38.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.409+0000 7fae479dd000 1 -- start start 2024-04-25T09:08:38.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.409+0000 7fae479dd000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e62e0a0 0x55ad4e6d4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.409+0000 7fae479dd000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e6779d0 0x55ad4e6d4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.409+0000 7fae479dd000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e6782f0 0x55ad4e6d4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.409+0000 7fae479dd000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0cb420 con 0x55ad4e62e0a0 2024-04-25T09:08:38.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.409+0000 7fae479dd000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c1530f0 con 0x55ad4e6782f0 2024-04-25T09:08:38.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.409+0000 7fae479dd000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c1524f0 con 0x55ad4e6779d0 2024-04-25T09:08:38.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.413+0000 7fae41c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e62e0a0 0x55ad4e6d4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.413+0000 7fae41c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e62e0a0 0x55ad4e6d4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:58916/0 (socket says 172.21.15.173:58916) 2024-04-25T09:08:38.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.413+0000 7fae41c00640 1 -- 172.21.15.173:0/1155622912 learned_addr learned my addr 172.21.15.173:0/1155622912 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:08:38.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.413+0000 7fae42600640 1 --2- 172.21.15.173:0/1155622912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e6782f0 0x55ad4e6d4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.413+0000 7fae41200640 1 --2- 172.21.15.173:0/1155622912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e6779d0 0x55ad4e6d4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.413+0000 7fae41c00640 1 -- 172.21.15.173:0/1155622912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e6779d0 msgr2=0x55ad4e6d4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.413+0000 7fae41c00640 1 --2- 172.21.15.173:0/1155622912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e6779d0 0x55ad4e6d4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.413+0000 7fae41c00640 1 -- 172.21.15.173:0/1155622912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e6782f0 msgr2=0x55ad4e6d4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.413+0000 7fae41c00640 1 --2- 172.21.15.173:0/1155622912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e6782f0 0x55ad4e6d4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.413+0000 7fae41c00640 1 -- 172.21.15.173:0/1155622912 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad4e4c1de0 con 0x55ad4e62e0a0 2024-04-25T09:08:38.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.413+0000 7fae41200640 1 --2- 172.21.15.173:0/1155622912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e6779d0 0x55ad4e6d4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:38.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.413+0000 7fae41c00640 1 --2- 172.21.15.173:0/1155622912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e62e0a0 0x55ad4e6d4300 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fae28007fa0 tx=0x7fae2800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e59b4e3cda86ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.413+0000 7fae2d600640 1 -- 172.21.15.173:0/1155622912 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2800ea30 con 0x55ad4e62e0a0 2024-04-25T09:08:38.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.413+0000 7fae2d600640 1 -- 172.21.15.173:0/1155622912 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae280050d0 con 0x55ad4e62e0a0 2024-04-25T09:08:38.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.413+0000 7fae2d600640 1 -- 172.21.15.173:0/1155622912 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28006a20 con 0x55ad4e62e0a0 2024-04-25T09:08:38.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.413+0000 7fae479dd000 1 -- 172.21.15.173:0/1155622912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e62e0a0 msgr2=0x55ad4e6d4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.413+0000 7fae479dd000 1 --2- 172.21.15.173:0/1155622912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e62e0a0 0x55ad4e6d4300 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fae28007fa0 tx=0x7fae2800a000 comp rx=0 tx=0).stop 2024-04-25T09:08:38.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.417+0000 7fae479dd000 1 -- 172.21.15.173:0/1155622912 shutdown_connections 2024-04-25T09:08:38.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.417+0000 7fae479dd000 1 --2- 172.21.15.173:0/1155622912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e6782f0 0x55ad4e6d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.417+0000 7fae479dd000 1 --2- 172.21.15.173:0/1155622912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e6779d0 0x55ad4e6d4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.417+0000 7fae479dd000 1 --2- 172.21.15.173:0/1155622912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e62e0a0 0x55ad4e6d4300 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.417+0000 7fae479dd000 1 -- 172.21.15.173:0/1155622912 >> 172.21.15.173:0/1155622912 conn(0x55ad4e62a020 msgr2=0x55ad4e6760d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.417+0000 7fae479dd000 1 -- 172.21.15.173:0/1155622912 shutdown_connections 2024-04-25T09:08:38.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.417+0000 7fae479dd000 1 -- 172.21.15.173:0/1155622912 wait complete. 2024-04-25T09:08:38.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.417+0000 7fae479dd000 1 -- start start 2024-04-25T09:08:38.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.417+0000 7fae479dd000 1 Processor -- start 2024-04-25T09:08:38.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.417+0000 7fae479dd000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e62e0a0 0x55ad4e68a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.417+0000 7fae479dd000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e6779d0 0x55ad4e68acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.417+0000 7fae479dd000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e6782f0 0x55ad4e68b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.417+0000 7fae479dd000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad4e415e00 con 0x55ad4e6779d0 2024-04-25T09:08:38.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.417+0000 7fae479dd000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c152af0 con 0x55ad4e6782f0 2024-04-25T09:08:38.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.417+0000 7fae479dd000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ad4e47a300 con 0x55ad4e62e0a0 2024-04-25T09:08:38.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.417+0000 7fae479dd000 10 client.0 _ll_register_callbacks cb 0x55ad4e5f9040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:38.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae42600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e6782f0 0x55ad4e68b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae41200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e6779d0 0x55ad4e68acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae42600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e6782f0 0x55ad4e68b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:53396/0 (socket says 172.21.15.173:53396) 2024-04-25T09:08:38.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae42600640 1 -- 172.21.15.173:0/4251364623 learned_addr learned my addr 172.21.15.173:0/4251364623 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:08:38.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae41c00640 1 --2- 172.21.15.173:0/4251364623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e62e0a0 0x55ad4e68a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae41200640 1 -- 172.21.15.173:0/4251364623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e62e0a0 msgr2=0x55ad4e68a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae41200640 1 --2- 172.21.15.173:0/4251364623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e62e0a0 0x55ad4e68a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae41200640 1 -- 172.21.15.173:0/4251364623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e6782f0 msgr2=0x55ad4e68b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae41200640 1 --2- 172.21.15.173:0/4251364623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e6782f0 0x55ad4e68b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae41200640 1 -- 172.21.15.173:0/4251364623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ad4e41c8e0 con 0x55ad4e6779d0 2024-04-25T09:08:38.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae41200640 1 --2- 172.21.15.173:0/4251364623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e6779d0 0x55ad4e68acb0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fae3011d580 tx=0x7fae300f2070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4834cb15e36ccc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae22a00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:08:38.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae22a00640 1 -- 172.21.15.173:0/4251364623 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3011a040 con 0x55ad4e6779d0 2024-04-25T09:08:38.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae22a00640 1 -- 172.21.15.173:0/4251364623 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fae300ec0f0 con 0x55ad4e6779d0 2024-04-25T09:08:38.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae479dd000 1 -- 172.21.15.173:0/4251364623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae280050d0 con 0x55ad4e6779d0 2024-04-25T09:08:38.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae22a00640 1 -- 172.21.15.173:0/4251364623 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae300f3bd0 con 0x55ad4e6779d0 2024-04-25T09:08:38.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae479dd000 10 client.7497 fetch_fsmap learned FSMap version 56 2024-04-25T09:08:38.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae479dd000 1 -- 172.21.15.173:0/4251364623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55ad4e4d48f0 con 0x55ad4e6779d0 2024-04-25T09:08:38.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae22a00640 1 -- 172.21.15.173:0/4251364623 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae280050d0 con 0x55ad4e6779d0 2024-04-25T09:08:38.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae22a00640 1 -- 172.21.15.173:0/4251364623 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fae300efce0 con 0x55ad4e6779d0 2024-04-25T09:08:38.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae479dd000 10 client.7497 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T09:08:38.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae479dd000 10 client.7497 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:08:38.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.421+0000 7fae479dd000 20 client.7497 populate_metadata read hostname 'smithi173' 2024-04-25T09:08:38.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.425+0000 7fae479dd000 1 --2- 172.21.15.173:0/4251364623 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55ad4e687c80 0x55ad4e6dff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.425+0000 7fae479dd000 4 client.7497 mds_command: new command op to 7263 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:08:38.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.425+0000 7fae479dd000 1 -- 172.21.15.173:0/4251364623 --> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ad4e488530 con 0x55ad4e687c80 2024-04-25T09:08:38.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.425+0000 7fae41c00640 1 --2- 172.21.15.173:0/4251364623 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55ad4e687c80 0x55ad4e6dff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.433+0000 7fae22a00640 10 client.7497 ms_handle_connect on v2:172.21.15.173:6836/2444108646 2024-04-25T09:08:38.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.433+0000 7fae41c00640 1 --2- 172.21.15.173:0/4251364623 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55ad4e687c80 0x55ad4e6dff60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7ece58023ee869f server_cookie=aa7dc947265e3f98 in_seq=0 out_seq=0 2024-04-25T09:08:38.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.437+0000 7fae22a00640 1 -- 172.21.15.173:0/4251364623 <== mds.0 v2:172.21.15.173:6836/2444108646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55ad4e488530 con 0x55ad4e687c80 2024-04-25T09:08:38.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.437+0000 7fae22a00640 10 client.7497 handle_command_reply: tid=0 2024-04-25T09:08:38.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.437+0000 7fae479dd000 1 client.7497 shutdown 2024-04-25T09:08:38.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.437+0000 7fae479dd000 1 -- 172.21.15.173:0/4251364623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e6779d0 msgr2=0x55ad4e68acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.437+0000 7fae479dd000 1 --2- 172.21.15.173:0/4251364623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e6779d0 0x55ad4e68acb0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fae3011d580 tx=0x7fae300f2070 comp rx=0 tx=0).stop 2024-04-25T09:08:38.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.437+0000 7fae479dd000 1 -- 172.21.15.173:0/4251364623 shutdown_connections 2024-04-25T09:08:38.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.437+0000 7fae479dd000 1 --2- 172.21.15.173:0/4251364623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad4e6782f0 0x55ad4e68b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.437+0000 7fae479dd000 1 --2- 172.21.15.173:0/4251364623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4e6779d0 0x55ad4e68acb0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.437+0000 7fae479dd000 1 --2- 172.21.15.173:0/4251364623 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55ad4e687c80 0x55ad4e6dff60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.437+0000 7fae479dd000 1 --2- 172.21.15.173:0/4251364623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ad4e62e0a0 0x55ad4e68a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.437+0000 7fae479dd000 1 -- 172.21.15.173:0/4251364623 >> 172.21.15.173:0/4251364623 conn(0x55ad4e62a020 msgr2=0x55ad4e676960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.437+0000 7fae22a00640 0 client.7497 ms_handle_reset on v2:172.21.15.173:6836/2444108646 2024-04-25T09:08:38.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.437+0000 7fae479dd000 1 -- 172.21.15.173:0/4251364623 shutdown_connections 2024-04-25T09:08:38.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.441+0000 7fae479dd000 1 -- 172.21.15.173:0/4251364623 wait complete. 2024-04-25T09:08:38.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.441+0000 7fae479dd000 20 client.7497 trim_cache size 0 max 16384 2024-04-25T09:08:38.434 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:08:38.434 INFO:teuthology.orchestra.run.smithi173.stdout: "status": "scrub active (682 inodes in the stack)", 2024-04-25T09:08:38.434 INFO:teuthology.orchestra.run.smithi173.stdout: "scrubs": { 2024-04-25T09:08:38.434 INFO:teuthology.orchestra.run.smithi173.stdout: "aca8521e-b142-4e50-ac0d-26aa51e5c597": { 2024-04-25T09:08:38.434 INFO:teuthology.orchestra.run.smithi173.stdout: "path": "~mds0", 2024-04-25T09:08:38.434 INFO:teuthology.orchestra.run.smithi173.stdout: "tag": "aca8521e-b142-4e50-ac0d-26aa51e5c597", 2024-04-25T09:08:38.434 INFO:teuthology.orchestra.run.smithi173.stdout: "options": "recursive" 2024-04-25T09:08:38.434 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:08:38.434 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:08:38.434 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:08:38.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.445+0000 7fae43000640 1 -- 172.21.15.173:0/3449751772 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fae1c067030 msgr2=0x7fae1c0694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.445+0000 7fae43000640 1 --2- 172.21.15.173:0/3449751772 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fae1c067030 0x7fae1c0694f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fae340070b0 tx=0x7fae3400b040 comp rx=0 tx=0).stop 2024-04-25T09:08:38.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.445+0000 7fae43000640 1 -- 172.21.15.173:0/3449751772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae3c0b8b90 msgr2=0x7fae3c0c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.445+0000 7fae43000640 1 --2- 172.21.15.173:0/3449751772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae3c0b8b90 0x7fae3c0c7450 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fae300ab000 tx=0x7fae30019270 comp rx=0 tx=0).stop 2024-04-25T09:08:38.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.445+0000 7fae43000640 1 -- 172.21.15.173:0/3449751772 shutdown_connections 2024-04-25T09:08:38.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.445+0000 7fae43000640 1 --2- 172.21.15.173:0/3449751772 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fae1c067030 0x7fae1c0694f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.445+0000 7fae43000640 1 --2- 172.21.15.173:0/3449751772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae3c0ce930 0x7fae3c0c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.445+0000 7fae43000640 1 --2- 172.21.15.173:0/3449751772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae3c0b8b90 0x7fae3c0c7450 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.445+0000 7fae43000640 1 --2- 172.21.15.173:0/3449751772 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae3c0b53e0 0x7fae3c159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.445+0000 7fae43000640 1 -- 172.21.15.173:0/3449751772 >> 172.21.15.173:0/3449751772 conn(0x7fae3c0d03e0 msgr2=0x7fae3c15e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.449+0000 7fae43000640 1 -- 172.21.15.173:0/3449751772 shutdown_connections 2024-04-25T09:08:38.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:08:38.449+0000 7fae43000640 1 -- 172.21.15.173:0/3449751772 wait complete. 2024-04-25T09:08:38.469 INFO:tasks.cephfs.filesystem:scrub status for tag:aca8521e-b142-4e50-ac0d-26aa51e5c597 - {'path': '~mds0', 'tag': 'aca8521e-b142-4e50-ac0d-26aa51e5c597', 'options': 'recursive'} 2024-04-25T09:08:44.871 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:08:44.874 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:09:08.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:08.470 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T09:09:08.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.632+0000 7f3f00800640 1 Processor -- start 2024-04-25T09:09:08.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.632+0000 7f3f00800640 1 -- start start 2024-04-25T09:09:08.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.632+0000 7f3f00800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3ef8145290 0x7f3ef815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.632+0000 7f3f00800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ef80cc260 0x7f3ef80cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.632+0000 7f3f00800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef815c5f0 con 0x7f3ef80b3fe0 2024-04-25T09:09:08.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.632+0000 7f3f00800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef806d4b0 con 0x7f3ef8145290 2024-04-25T09:09:08.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.632+0000 7f3f00800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef806d790 con 0x7f3ef80cc260 2024-04-25T09:09:08.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.632+0000 7f3efde00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3ef8145290 0x7f3ef815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.632+0000 7f3efd400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f3ef80b3fe0 0x7f3ef80b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:51284/0 (socket says 172.21.15.173:51284) 2024-04-25T09:09:08.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.632+0000 7f3efd400640 1 -- 172.21.15.173:0/2501460644 learned_addr learned my addr 172.21.15.173:0/2501460644 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:08.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.632+0000 7f3efde00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3ef8145290 0x7f3ef815c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45322/0 (socket says 172.21.15.173:45322) 2024-04-25T09:09:08.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.632+0000 7f3efe800640 1 --2- 172.21.15.173:0/2501460644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ef80cc260 0x7f3ef80cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.632+0000 7f3efde00640 1 -- 172.21.15.173:0/2501460644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ef80cc260 msgr2=0x7f3ef80cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.632+0000 7f3efde00640 1 --2- 172.21.15.173:0/2501460644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ef80cc260 0x7f3ef80cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.632+0000 7f3efde00640 1 -- 172.21.15.173:0/2501460644 >> v1:172.21.15.173:6789/0 conn(0x7f3ef80b3fe0 legacy=0x7f3ef80b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.632+0000 7f3efde00640 1 -- 172.21.15.173:0/2501460644 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef806da70 con 0x7f3ef8145290 2024-04-25T09:09:08.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.632+0000 7f3efca00640 1 -- 172.21.15.173:0/2501460644 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645277007 0 0) 0x7f3ee8001120 con 0x7f3ef80b3fe0 2024-04-25T09:09:08.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.636+0000 7f3efde00640 1 --2- 172.21.15.173:0/2501460644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ef8145290 0x7f3ef815c0b0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0097c0 tx=0x7f3eec01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a668cf33bc55f745 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.636+0000 7f3efca00640 1 -- 172.21.15.173:0/2501460644 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0b0070 con 0x7f3ef8145290 2024-04-25T09:09:08.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.636+0000 7f3efca00640 1 -- 172.21.15.173:0/2501460644 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec0ab600 con 0x7f3ef8145290 2024-04-25T09:09:08.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.636+0000 7f3efca00640 1 -- 172.21.15.173:0/2501460644 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0ab9d0 con 0x7f3ef8145290 2024-04-25T09:09:08.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.636+0000 7f3f00800640 1 -- 172.21.15.173:0/2501460644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ef8145290 msgr2=0x7f3ef815c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.636+0000 7f3f00800640 1 --2- 172.21.15.173:0/2501460644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ef8145290 0x7f3ef815c0b0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0097c0 tx=0x7f3eec01c380 comp rx=0 tx=0).stop 2024-04-25T09:09:08.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.636+0000 7f3f00800640 1 -- 172.21.15.173:0/2501460644 shutdown_connections 2024-04-25T09:09:08.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.636+0000 7f3f00800640 1 --2- 172.21.15.173:0/2501460644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ef80cc260 0x7f3ef80cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.636+0000 7f3f00800640 1 --2- 172.21.15.173:0/2501460644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ef8145290 0x7f3ef815c0b0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.636+0000 7f3f00800640 1 -- 172.21.15.173:0/2501460644 >> 172.21.15.173:0/2501460644 conn(0x7f3ef806ac90 msgr2=0x7f3ef806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.636+0000 7f3f00800640 1 -- 172.21.15.173:0/2501460644 shutdown_connections 2024-04-25T09:09:08.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.636+0000 7f3f00800640 1 -- 172.21.15.173:0/2501460644 wait complete. 2024-04-25T09:09:08.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.636+0000 7f3f00800640 1 Processor -- start 2024-04-25T09:09:08.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.636+0000 7f3f00800640 1 -- start start 2024-04-25T09:09:08.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3f00800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ef80b3fe0 0x7f3ef813f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3f00800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ef80cc260 0x7f3ef815b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3f00800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ef8145290 0x7f3ef8141c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3f00800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef806ed60 con 0x7f3ef80b3fe0 2024-04-25T09:09:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3f00800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef806eee0 con 0x7f3ef80cc260 2024-04-25T09:09:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3f00800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef806f060 con 0x7f3ef8145290 2024-04-25T09:09:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3efde00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ef80b3fe0 0x7f3ef813f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3efde00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ef80b3fe0 0x7f3ef813f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45338/0 (socket says 172.21.15.173:45338) 2024-04-25T09:09:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3efde00640 1 -- 172.21.15.173:0/4163339663 learned_addr learned my addr 172.21.15.173:0/4163339663 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3efe800640 1 --2- 172.21.15.173:0/4163339663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ef8145290 0x7f3ef8141c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3efd400640 1 --2- 172.21.15.173:0/4163339663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ef80cc260 0x7f3ef815b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3efde00640 1 -- 172.21.15.173:0/4163339663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ef8145290 msgr2=0x7f3ef8141c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3efde00640 1 --2- 172.21.15.173:0/4163339663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ef8145290 0x7f3ef8141c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3efde00640 1 -- 172.21.15.173:0/4163339663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ef80cc260 msgr2=0x7f3ef815b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3efde00640 1 --2- 172.21.15.173:0/4163339663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ef80cc260 0x7f3ef815b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3efde00640 1 -- 172.21.15.173:0/4163339663 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef815b980 con 0x7f3ef80b3fe0 2024-04-25T09:09:08.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3efd400640 1 --2- 172.21.15.173:0/4163339663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ef80cc260 0x7f3ef815b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:08.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3efde00640 1 --2- 172.21.15.173:0/4163339663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ef80b3fe0 0x7f3ef813f090 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0ae040 tx=0x7f3eec01abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3ef2000640 1 -- 172.21.15.173:0/4163339663 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0b0050 con 0x7f3ef80b3fe0 2024-04-25T09:09:08.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3ef2000640 1 -- 172.21.15.173:0/4163339663 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec0bc070 con 0x7f3ef80b3fe0 2024-04-25T09:09:08.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3f00800640 1 -- 172.21.15.173:0/4163339663 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef8142160 con 0x7f3ef80b3fe0 2024-04-25T09:09:08.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3ef2000640 1 -- 172.21.15.173:0/4163339663 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0b5850 con 0x7f3ef80b3fe0 2024-04-25T09:09:08.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3f00800640 1 -- 172.21.15.173:0/4163339663 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef8142400 con 0x7f3ef80b3fe0 2024-04-25T09:09:08.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.640+0000 7f3ef2000640 1 -- 172.21.15.173:0/4163339663 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3eec0b59f0 con 0x7f3ef80b3fe0 2024-04-25T09:09:08.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3ef2000640 1 --2- 172.21.15.173:0/4163339663 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3edc066f60 0x7f3edc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3ef2000640 1 -- 172.21.15.173:0/4163339663 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f3eec11f890 con 0x7f3ef80b3fe0 2024-04-25T09:09:08.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3efd400640 1 --2- 172.21.15.173:0/4163339663 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3edc066f60 0x7f3edc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3f03cf6000 1 Processor -- start 2024-04-25T09:09:08.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3f03cf6000 1 -- start start 2024-04-25T09:09:08.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3efd400640 1 --2- 172.21.15.173:0/4163339663 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3edc066f60 0x7f3edc069420 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8007fd0 tx=0x7f3ee8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3f03cf6000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef755b49d0 0x55ef755b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3f03cf6000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b52f0 0x55ef7556ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3f03cf6000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef7556b0a0 0x55ef7556b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3f03cf6000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef753b7ff0 con 0x55ef755b52f0 2024-04-25T09:09:08.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3f03cf6000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef75340150 con 0x55ef7556b0a0 2024-04-25T09:09:08.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3f03cf6000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ef753b4090 con 0x55ef755b49d0 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3efd400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b52f0 0x55ef7556ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3efd400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b52f0 0x55ef7556ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45354/0 (socket says 172.21.15.173:45354) 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3efd400640 1 -- 172.21.15.173:0/1907380348 learned_addr learned my addr 172.21.15.173:0/1907380348 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3efde00640 1 --2- 172.21.15.173:0/1907380348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef755b49d0 0x55ef755b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3efd400640 1 -- 172.21.15.173:0/1907380348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef755b49d0 msgr2=0x55ef755b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3efd400640 1 --2- 172.21.15.173:0/1907380348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef755b49d0 0x55ef755b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3efd400640 1 -- 172.21.15.173:0/1907380348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef7556b0a0 msgr2=0x55ef7556b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3efd400640 1 --2- 172.21.15.173:0/1907380348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef7556b0a0 0x55ef7556b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3efd400640 1 -- 172.21.15.173:0/1907380348 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef7554e0d0 con 0x55ef755b52f0 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3efd400640 1 --2- 172.21.15.173:0/1907380348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b52f0 0x55ef7556ab60 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8007390 tx=0x7f3ee8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c99acb6a7f3827 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3ee6a00640 1 -- 172.21.15.173:0/1907380348 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee800dbb0 con 0x55ef755b52f0 2024-04-25T09:09:08.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3ee6a00640 1 -- 172.21.15.173:0/1907380348 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee800dd70 con 0x55ef755b52f0 2024-04-25T09:09:08.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.644+0000 7f3ee6a00640 1 -- 172.21.15.173:0/1907380348 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8020690 con 0x55ef755b52f0 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1907380348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b52f0 msgr2=0x55ef7556ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/1907380348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b52f0 0x55ef7556ab60 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8007390 tx=0x7f3ee8010000 comp rx=0 tx=0).stop 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1907380348 shutdown_connections 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/1907380348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef7556b0a0 0x55ef7556b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/1907380348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b52f0 0x55ef7556ab60 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/1907380348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef755b49d0 0x55ef755b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1907380348 >> 172.21.15.173:0/1907380348 conn(0x55ef75567020 msgr2=0x55ef75569440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1907380348 shutdown_connections 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1907380348 wait complete. 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 -- start start 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 Processor -- start 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef7556b0a0 0x55ef755997f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b49d0 0x55ef75599d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef755b52f0 0x55ef7559a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7537c250 con 0x55ef755b49d0 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef75372690 con 0x55ef755b52f0 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ef75340a40 con 0x55ef7556b0a0 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 10 client.0 _ll_register_callbacks cb 0x55ef75555e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3efd400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b49d0 0x55ef75599d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3efd400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b49d0 0x55ef75599d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45362/0 (socket says 172.21.15.173:45362) 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3efd400640 1 -- 172.21.15.173:0/1906544484 learned_addr learned my addr 172.21.15.173:0/1906544484 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:08.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3efe800640 1 --2- 172.21.15.173:0/1906544484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef755b52f0 0x55ef7559a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3efde00640 1 --2- 172.21.15.173:0/1906544484 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef7556b0a0 0x55ef755997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3efd400640 1 -- 172.21.15.173:0/1906544484 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef7556b0a0 msgr2=0x55ef755997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3efd400640 1 --2- 172.21.15.173:0/1906544484 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef7556b0a0 0x55ef755997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3efd400640 1 -- 172.21.15.173:0/1906544484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef755b52f0 msgr2=0x55ef7559a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3efd400640 1 --2- 172.21.15.173:0/1906544484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef755b52f0 0x55ef7559a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3efd400640 1 -- 172.21.15.173:0/1906544484 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef754651c0 con 0x55ef755b49d0 2024-04-25T09:09:08.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3efd400640 1 --2- 172.21.15.173:0/1906544484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b49d0 0x55ef75599d30 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x55ef753743d0 tx=0x7f3ee8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d24dad048ab169 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3edb400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:09:08.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3edb400640 1 -- 172.21.15.173:0/1906544484 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8020c90 con 0x55ef755b49d0 2024-04-25T09:09:08.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3edb400640 1 -- 172.21.15.173:0/1906544484 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f3ee802dc50 con 0x55ef755b49d0 2024-04-25T09:09:08.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1906544484 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ee800dd70 con 0x55ef755b49d0 2024-04-25T09:09:08.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3edb400640 1 -- 172.21.15.173:0/1906544484 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ee8034050 con 0x55ef755b49d0 2024-04-25T09:09:08.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 10 client.7512 fetch_fsmap learned FSMap version 56 2024-04-25T09:09:08.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1906544484 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55ef75461170 con 0x55ef755b49d0 2024-04-25T09:09:08.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3edb400640 1 -- 172.21.15.173:0/1906544484 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee800dd70 con 0x55ef755b49d0 2024-04-25T09:09:08.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.648+0000 7f3edb400640 1 -- 172.21.15.173:0/1906544484 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3ee8037020 con 0x55ef755b49d0 2024-04-25T09:09:08.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3f03cf6000 10 client.7512 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T09:09:08.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3f03cf6000 10 client.7512 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:09:08.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3f03cf6000 20 client.7512 populate_metadata read hostname 'smithi173' 2024-04-25T09:09:08.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/1906544484 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55ef755c4c80 0x55ef755c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3f03cf6000 4 client.7512 mds_command: new command op to 7263 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:08.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1906544484 --> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ef75353c60 con 0x55ef755c4c80 2024-04-25T09:09:08.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3efde00640 1 --2- 172.21.15.173:0/1906544484 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55ef755c4c80 0x55ef755c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3efde00640 1 --2- 172.21.15.173:0/1906544484 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55ef755c4c80 0x55ef755c7070 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d413fd020842929b server_cookie=d4e019bc35f58bf in_seq=0 out_seq=0 2024-04-25T09:09:08.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3edb400640 10 client.7512 ms_handle_connect on v2:172.21.15.173:6836/2444108646 2024-04-25T09:09:08.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3edb400640 1 -- 172.21.15.173:0/1906544484 <== mds.0 v2:172.21.15.173:6836/2444108646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ef75353c60 con 0x55ef755c4c80 2024-04-25T09:09:08.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3edb400640 10 client.7512 handle_command_reply: tid=0 2024-04-25T09:09:08.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3f03cf6000 1 client.7512 shutdown 2024-04-25T09:09:08.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1906544484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b49d0 msgr2=0x55ef75599d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/1906544484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b49d0 0x55ef75599d30 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x55ef753743d0 tx=0x7f3ee8012000 comp rx=0 tx=0).stop 2024-04-25T09:09:08.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1906544484 shutdown_connections 2024-04-25T09:09:08.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/1906544484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef755b52f0 0x55ef7559a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/1906544484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b49d0 0x55ef75599d30 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/1906544484 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55ef755c4c80 0x55ef755c7070 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/1906544484 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef7556b0a0 0x55ef755997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1906544484 >> 172.21.15.173:0/1906544484 conn(0x55ef75567020 msgr2=0x55ef75569ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3edb400640 0 client.7512 ms_handle_reset on v2:172.21.15.173:6836/2444108646 2024-04-25T09:09:08.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1906544484 shutdown_connections 2024-04-25T09:09:08.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1906544484 wait complete. 2024-04-25T09:09:08.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.652+0000 7f3f03cf6000 20 client.7512 trim_cache size 0 max 16384 2024-04-25T09:09:08.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3f03cf6000 1 Processor -- start 2024-04-25T09:09:08.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3f03cf6000 1 -- start start 2024-04-25T09:09:08.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3f03cf6000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef7556b0a0 0x55ef75569410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3f03cf6000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef755b49d0 0x55ef75569950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3f03cf6000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef755b52f0 0x55ef755b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3f03cf6000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef8203280 con 0x55ef7556b0a0 2024-04-25T09:09:08.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3f03cf6000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef8202460 con 0x55ef755b52f0 2024-04-25T09:09:08.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3f03cf6000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef81f7a30 con 0x55ef755b49d0 2024-04-25T09:09:08.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3efde00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef7556b0a0 0x55ef75569410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3efde00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef7556b0a0 0x55ef75569410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45370/0 (socket says 172.21.15.173:45370) 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3efde00640 1 -- 172.21.15.173:0/3389483909 learned_addr learned my addr 172.21.15.173:0/3389483909 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3efe800640 1 --2- 172.21.15.173:0/3389483909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef755b52f0 0x55ef755b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3efde00640 1 -- 172.21.15.173:0/3389483909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef755b49d0 msgr2=0x55ef75569950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3efd400640 1 --2- 172.21.15.173:0/3389483909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef755b49d0 0x55ef75569950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3efde00640 1 --2- 172.21.15.173:0/3389483909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef755b49d0 0x55ef75569950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3efde00640 1 -- 172.21.15.173:0/3389483909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef755b52f0 msgr2=0x55ef755b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3efde00640 1 --2- 172.21.15.173:0/3389483909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef755b52f0 0x55ef755b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3efde00640 1 -- 172.21.15.173:0/3389483909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef753fede0 con 0x55ef7556b0a0 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3efe800640 1 --2- 172.21.15.173:0/3389483909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef755b52f0 0x55ef755b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:08.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3efd400640 1 --2- 172.21.15.173:0/3389483909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef755b49d0 0x55ef75569950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:08.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3efde00640 1 --2- 172.21.15.173:0/3389483909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef7556b0a0 0x55ef75569410 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f3eec01c8f0 tx=0x7f3eec0b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f6363d84f0df2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3ee6000640 1 -- 172.21.15.173:0/3389483909 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec11c070 con 0x55ef7556b0a0 2024-04-25T09:09:08.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3ee6000640 1 -- 172.21.15.173:0/3389483909 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec0b1040 con 0x55ef7556b0a0 2024-04-25T09:09:08.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3ee6000640 1 -- 172.21.15.173:0/3389483909 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0effe0 con 0x55ef7556b0a0 2024-04-25T09:09:08.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3f03cf6000 1 -- 172.21.15.173:0/3389483909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef7556b0a0 msgr2=0x55ef75569410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/3389483909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef7556b0a0 0x55ef75569410 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f3eec01c8f0 tx=0x7f3eec0b9040 comp rx=0 tx=0).stop 2024-04-25T09:09:08.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3f03cf6000 1 -- 172.21.15.173:0/3389483909 shutdown_connections 2024-04-25T09:09:08.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/3389483909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef755b52f0 0x55ef755b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/3389483909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef755b49d0 0x55ef75569950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/3389483909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef7556b0a0 0x55ef75569410 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3f03cf6000 1 -- 172.21.15.173:0/3389483909 >> 172.21.15.173:0/3389483909 conn(0x55ef75567020 msgr2=0x55ef755c92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3f03cf6000 1 -- 172.21.15.173:0/3389483909 shutdown_connections 2024-04-25T09:09:08.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3f03cf6000 1 -- 172.21.15.173:0/3389483909 wait complete. 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.668+0000 7f3f03cf6000 1 -- start start 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 Processor -- start 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef7556b0a0 0x55ef7561d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef755b49d0 0x55ef7561d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b52f0 0x55ef755c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef75352e00 con 0x55ef755b52f0 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef81f8030 con 0x55ef755b49d0 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ef753b7300 con 0x55ef7556b0a0 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 10 client.0 _ll_register_callbacks cb 0x55ef75536040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3efe800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b52f0 0x55ef755c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3efe800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b52f0 0x55ef755c60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45384/0 (socket says 172.21.15.173:45384) 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3efe800640 1 -- 172.21.15.173:0/1291053749 learned_addr learned my addr 172.21.15.173:0/1291053749 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3efde00640 1 --2- 172.21.15.173:0/1291053749 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef7556b0a0 0x55ef7561d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3efd400640 1 --2- 172.21.15.173:0/1291053749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef755b49d0 0x55ef7561d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3efe800640 1 -- 172.21.15.173:0/1291053749 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef7556b0a0 msgr2=0x55ef7561d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3efe800640 1 --2- 172.21.15.173:0/1291053749 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef7556b0a0 0x55ef7561d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3efe800640 1 -- 172.21.15.173:0/1291053749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef755b49d0 msgr2=0x55ef7561d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3efe800640 1 --2- 172.21.15.173:0/1291053749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef755b49d0 0x55ef7561d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3efe800640 1 -- 172.21.15.173:0/1291053749 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef753598e0 con 0x55ef755b52f0 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3efd400640 1 --2- 172.21.15.173:0/1291053749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef755b49d0 0x55ef7561d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3efe800640 1 --2- 172.21.15.173:0/1291053749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b52f0 0x55ef755c60b0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4007950 tx=0x7f3ef4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4688d72e6a44e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3edb400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3edb400640 1 -- 172.21.15.173:0/1291053749 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef401c020 con 0x55ef755b52f0 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3edb400640 1 -- 172.21.15.173:0/1291053749 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f3ef4012bb0 con 0x55ef755b52f0 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1291053749 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3eec0b1040 con 0x55ef755b52f0 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3edb400640 1 -- 172.21.15.173:0/1291053749 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ef4026050 con 0x55ef755b52f0 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 10 client.7518 fetch_fsmap learned FSMap version 56 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1291053749 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55ef754118f0 con 0x55ef755b52f0 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3edb400640 1 -- 172.21.15.173:0/1291053749 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec0b1040 con 0x55ef755b52f0 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3edb400640 1 -- 172.21.15.173:0/1291053749 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3ef4029020 con 0x55ef755b52f0 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 10 client.7518 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 10 client.7518 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 20 client.7518 populate_metadata read hostname 'smithi173' 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/1291053749 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55ef755c6de0 0x55ef755c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 4 client.7518 mds_command: new command op to 7263 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1291053749 --> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ef753c5530 con 0x55ef755c6de0 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3efde00640 1 --2- 172.21.15.173:0/1291053749 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55ef755c6de0 0x55ef755c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3efde00640 1 --2- 172.21.15.173:0/1291053749 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55ef755c6de0 0x55ef755c71f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40d927fade3c0706 server_cookie=60c5c5ebad746415 in_seq=0 out_seq=0 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3edb400640 10 client.7518 ms_handle_connect on v2:172.21.15.173:6836/2444108646 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3edb400640 1 -- 172.21.15.173:0/1291053749 <== mds.0 v2:172.21.15.173:6836/2444108646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ef753c5530 con 0x55ef755c6de0 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3edb400640 10 client.7518 handle_command_reply: tid=0 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 client.7518 shutdown 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1291053749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b52f0 msgr2=0x55ef755c60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/1291053749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b52f0 0x55ef755c60b0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4007950 tx=0x7f3ef4007e10 comp rx=0 tx=0).stop 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1291053749 shutdown_connections 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/1291053749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ef755b52f0 0x55ef755c60b0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/1291053749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ef755b49d0 0x55ef7561d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/1291053749 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x55ef755c6de0 0x55ef755c71f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3f03cf6000 1 --2- 172.21.15.173:0/1291053749 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ef7556b0a0 0x55ef7561d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.672+0000 7f3edb400640 0 client.7518 ms_handle_reset on v2:172.21.15.173:6836/2444108646 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.676+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1291053749 >> 172.21.15.173:0/1291053749 conn(0x55ef75567020 msgr2=0x55ef755c1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.676+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1291053749 shutdown_connections 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.676+0000 7f3f03cf6000 1 -- 172.21.15.173:0/1291053749 wait complete. 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.676+0000 7f3f03cf6000 20 client.7518 trim_cache size 0 max 16384 2024-04-25T09:09:08.669 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:09:08.669 INFO:teuthology.orchestra.run.smithi173.stdout: "status": "no active scrubs running", 2024-04-25T09:09:08.669 INFO:teuthology.orchestra.run.smithi173.stdout: "scrubs": {} 2024-04-25T09:09:08.669 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:09:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.676+0000 7f3f00800640 1 -- 172.21.15.173:0/4163339663 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3edc066f60 msgr2=0x7f3edc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.676+0000 7f3f00800640 1 --2- 172.21.15.173:0/4163339663 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3edc066f60 0x7f3edc069420 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8007fd0 tx=0x7f3ee8009040 comp rx=0 tx=0).stop 2024-04-25T09:09:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.676+0000 7f3f00800640 1 -- 172.21.15.173:0/4163339663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ef80b3fe0 msgr2=0x7f3ef813f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.676+0000 7f3f00800640 1 --2- 172.21.15.173:0/4163339663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ef80b3fe0 0x7f3ef813f090 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0ae040 tx=0x7f3eec01abc0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.676+0000 7f3f00800640 1 -- 172.21.15.173:0/4163339663 shutdown_connections 2024-04-25T09:09:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.676+0000 7f3f00800640 1 --2- 172.21.15.173:0/4163339663 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3edc066f60 0x7f3edc069420 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.676+0000 7f3f00800640 1 --2- 172.21.15.173:0/4163339663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ef8145290 0x7f3ef8141c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.676+0000 7f3f00800640 1 --2- 172.21.15.173:0/4163339663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ef80cc260 0x7f3ef815b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.676+0000 7f3f00800640 1 --2- 172.21.15.173:0/4163339663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ef80b3fe0 0x7f3ef813f090 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.676+0000 7f3f00800640 1 -- 172.21.15.173:0/4163339663 >> 172.21.15.173:0/4163339663 conn(0x7f3ef806ac90 msgr2=0x7f3ef80cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.676+0000 7f3f00800640 1 -- 172.21.15.173:0/4163339663 shutdown_connections 2024-04-25T09:09:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.676+0000 7f3f00800640 1 -- 172.21.15.173:0/4163339663 wait complete. 2024-04-25T09:09:08.682 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:09:08.683 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:09:08.683 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 perf dump 2024-04-25T09:09:08.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.832+0000 7f2c16a00640 1 Processor -- start 2024-04-25T09:09:08.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.832+0000 7f2c16a00640 1 -- start start 2024-04-25T09:09:08.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.832+0000 7f2c16a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2c10099a50 0x7f2c10099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.832+0000 7f2c16a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2c1006c220 0x7f2c1015e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.832+0000 7f2c16a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1009a370 con 0x7f2c1006bda0 2024-04-25T09:09:08.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.832+0000 7f2c16a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c10161570 con 0x7f2c10099a50 2024-04-25T09:09:08.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.832+0000 7f2c16a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c10161850 con 0x7f2c1006c220 2024-04-25T09:09:08.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.836+0000 7f2c16000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2c1006c220 0x7f2c1015e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.836+0000 7f2c16000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2c1006c220 0x7f2c1015e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:39606/0 (socket says 172.21.15.173:39606) 2024-04-25T09:09:08.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.836+0000 7f2c16000640 1 -- 172.21.15.173:0/584965760 learned_addr learned my addr 172.21.15.173:0/584965760 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:08.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.836+0000 7f2c15600640 1 --2- 172.21.15.173:0/584965760 >> v2:172.21.15.194:3300/0 conn(0x7f2c10099a50 0x7f2c10099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.836+0000 7f2c16000640 1 -- 172.21.15.173:0/584965760 >> v2:172.21.15.194:3300/0 conn(0x7f2c10099a50 msgr2=0x7f2c10099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.836+0000 7f2c16000640 1 --2- 172.21.15.173:0/584965760 >> v2:172.21.15.194:3300/0 conn(0x7f2c10099a50 0x7f2c10099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.836+0000 7f2c16000640 1 -- 172.21.15.173:0/584965760 >> v1:172.21.15.194:6789/0 conn(0x7f2c1006bda0 legacy=0x7f2c1015dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.836+0000 7f2c16000640 1 -- 172.21.15.173:0/584965760 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c10161b30 con 0x7f2c1006c220 2024-04-25T09:09:08.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.836+0000 7f2c15600640 1 --2- 172.21.15.173:0/584965760 >> v2:172.21.15.194:3300/0 conn(0x7f2c10099a50 0x7f2c10099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:08.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.836+0000 7f2c16000640 1 --2- 172.21.15.173:0/584965760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2c1006c220 0x7f2c1015e440 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009e50 tx=0x7f2c0801ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38cd4dbe7a21b221 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.836+0000 7f2c0fe00640 1 -- 172.21.15.173:0/584965760 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c080a57e0 con 0x7f2c1006c220 2024-04-25T09:09:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.836+0000 7f2c0fe00640 1 -- 172.21.15.173:0/584965760 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c080a5980 con 0x7f2c1006c220 2024-04-25T09:09:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.836+0000 7f2c0fe00640 1 -- 172.21.15.173:0/584965760 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c080a5d50 con 0x7f2c1006c220 2024-04-25T09:09:08.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c16a00640 1 -- 172.21.15.173:0/584965760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2c1006c220 msgr2=0x7f2c1015e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c16a00640 1 --2- 172.21.15.173:0/584965760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2c1006c220 0x7f2c1015e440 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009e50 tx=0x7f2c0801ca00 comp rx=0 tx=0).stop 2024-04-25T09:09:08.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c16a00640 1 -- 172.21.15.173:0/584965760 shutdown_connections 2024-04-25T09:09:08.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c16a00640 1 --2- 172.21.15.173:0/584965760 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2c1006c220 0x7f2c1015e440 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c16a00640 1 --2- 172.21.15.173:0/584965760 >> v2:172.21.15.194:3300/0 conn(0x7f2c10099a50 0x7f2c10099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c16a00640 1 -- 172.21.15.173:0/584965760 >> 172.21.15.173:0/584965760 conn(0x7f2c100b31d0 msgr2=0x7f2c100b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c16a00640 1 -- 172.21.15.173:0/584965760 shutdown_connections 2024-04-25T09:09:08.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c16a00640 1 -- 172.21.15.173:0/584965760 wait complete. 2024-04-25T09:09:08.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c16a00640 1 Processor -- start 2024-04-25T09:09:08.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c16a00640 1 -- start start 2024-04-25T09:09:08.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c16a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c1006bda0 0x7f2c1015bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c16a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c1006c220 0x7f2c100b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c16a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2c10099a50 0x7f2c101595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c16a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1009ae40 con 0x7f2c1006c220 2024-04-25T09:09:08.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c16a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1009acc0 con 0x7f2c1006bda0 2024-04-25T09:09:08.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c16a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1016b120 con 0x7f2c10099a50 2024-04-25T09:09:08.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c14c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c1006c220 0x7f2c100b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c14c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c1006c220 0x7f2c100b6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45388/0 (socket says 172.21.15.173:45388) 2024-04-25T09:09:08.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c14c00640 1 -- 172.21.15.173:0/2724351935 learned_addr learned my addr 172.21.15.173:0/2724351935 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:08.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c16000640 1 --2- 172.21.15.173:0/2724351935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2c10099a50 0x7f2c101595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.840+0000 7f2c15600640 1 --2- 172.21.15.173:0/2724351935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c1006bda0 0x7f2c1015bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.844+0000 7f2c14c00640 1 -- 172.21.15.173:0/2724351935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2c10099a50 msgr2=0x7f2c101595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.844+0000 7f2c14c00640 1 --2- 172.21.15.173:0/2724351935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2c10099a50 0x7f2c101595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.844+0000 7f2c14c00640 1 -- 172.21.15.173:0/2724351935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c1006bda0 msgr2=0x7f2c1015bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.844+0000 7f2c14c00640 1 --2- 172.21.15.173:0/2724351935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c1006bda0 0x7f2c1015bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.844+0000 7f2c14c00640 1 -- 172.21.15.173:0/2724351935 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c10159b00 con 0x7f2c1006c220 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.844+0000 7f2c16000640 1 --2- 172.21.15.173:0/2724351935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2c10099a50 0x7f2c101595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.844+0000 7f2c15600640 1 --2- 172.21.15.173:0/2724351935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c1006bda0 0x7f2c1015bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.844+0000 7f2c14c00640 1 --2- 172.21.15.173:0/2724351935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c1006c220 0x7f2c100b6ea0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400c3a0 tx=0x7f2c0400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.844+0000 7f2c0d600640 1 -- 172.21.15.173:0/2724351935 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c040052d0 con 0x7f2c1006c220 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.844+0000 7f2c0d600640 1 -- 172.21.15.173:0/2724351935 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c04005470 con 0x7f2c1006c220 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.844+0000 7f2c0d600640 1 -- 172.21.15.173:0/2724351935 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04007260 con 0x7f2c1006c220 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.844+0000 7f2c16a00640 1 -- 172.21.15.173:0/2724351935 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1015c220 con 0x7f2c1006c220 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.844+0000 7f2c16a00640 1 -- 172.21.15.173:0/2724351935 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1015c7e0 con 0x7f2c1006c220 2024-04-25T09:09:08.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.844+0000 7f2c0d600640 1 -- 172.21.15.173:0/2724351935 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2c04007400 con 0x7f2c1006c220 2024-04-25T09:09:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c0d600640 1 --2- 172.21.15.173:0/2724351935 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2bf4066f60 0x7f2bf4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c0d600640 1 -- 172.21.15.173:0/2724351935 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f2c04084720 con 0x7f2c1006c220 2024-04-25T09:09:08.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c1b455000 1 Processor -- start 2024-04-25T09:09:08.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c15600640 1 --2- 172.21.15.173:0/2724351935 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2bf4066f60 0x7f2bf4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c1b455000 1 -- start start 2024-04-25T09:09:08.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c15600640 1 --2- 172.21.15.173:0/2724351935 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2bf4066f60 0x7f2bf4069420 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2c000079d0 tx=0x7f2c00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c1b455000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b435a40 0x56328b435e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c1b455000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b436360 0x56328b3f0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c1b455000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b3f0d90 0x56328b3f1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c1b455000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56328b2d31f0 con 0x56328b3f0d90 2024-04-25T09:09:08.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c1b455000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56328b239e90 con 0x56328b436360 2024-04-25T09:09:08.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c1b455000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56328b1c1f50 con 0x56328b435a40 2024-04-25T09:09:08.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c16000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b3f0d90 0x56328b3f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c16000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b3f0d90 0x56328b3f1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45390/0 (socket says 172.21.15.173:45390) 2024-04-25T09:09:08.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c16000640 1 -- 172.21.15.173:0/1065683903 learned_addr learned my addr 172.21.15.173:0/1065683903 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:08.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c14c00640 1 --2- 172.21.15.173:0/1065683903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b436360 0x56328b3f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c15600640 1 --2- 172.21.15.173:0/1065683903 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b435a40 0x56328b435e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c16000640 1 -- 172.21.15.173:0/1065683903 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b435a40 msgr2=0x56328b435e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c16000640 1 --2- 172.21.15.173:0/1065683903 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b435a40 0x56328b435e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c16000640 1 -- 172.21.15.173:0/1065683903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b436360 msgr2=0x56328b3f0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c16000640 1 --2- 172.21.15.173:0/1065683903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b436360 0x56328b3f0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c16000640 1 -- 172.21.15.173:0/1065683903 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56328b2118b0 con 0x56328b3f0d90 2024-04-25T09:09:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c16000640 1 --2- 172.21.15.173:0/1065683903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b3f0d90 0x56328b3f1170 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f2c080af040 tx=0x7f2c08004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4bf377418beb4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2bfe000640 1 -- 172.21.15.173:0/1065683903 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c080a57e0 con 0x56328b3f0d90 2024-04-25T09:09:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2bfe000640 1 -- 172.21.15.173:0/1065683903 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c080a5980 con 0x56328b3f0d90 2024-04-25T09:09:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2bfe000640 1 -- 172.21.15.173:0/1065683903 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c080a5d30 con 0x56328b3f0d90 2024-04-25T09:09:08.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c1b455000 1 -- 172.21.15.173:0/1065683903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b3f0d90 msgr2=0x56328b3f1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c1b455000 1 --2- 172.21.15.173:0/1065683903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b3f0d90 0x56328b3f1170 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f2c080af040 tx=0x7f2c08004ac0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c1b455000 1 -- 172.21.15.173:0/1065683903 shutdown_connections 2024-04-25T09:09:08.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c1b455000 1 --2- 172.21.15.173:0/1065683903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b3f0d90 0x56328b3f1170 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c1b455000 1 --2- 172.21.15.173:0/1065683903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b436360 0x56328b3f0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c1b455000 1 --2- 172.21.15.173:0/1065683903 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b435a40 0x56328b435e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c1b455000 1 -- 172.21.15.173:0/1065683903 >> 172.21.15.173:0/1065683903 conn(0x56328b3ecd40 msgr2=0x56328b3ef130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c1b455000 1 -- 172.21.15.173:0/1065683903 shutdown_connections 2024-04-25T09:09:08.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.848+0000 7f2c1b455000 1 -- 172.21.15.173:0/1065683903 wait complete. 2024-04-25T09:09:08.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c1b455000 1 -- start start 2024-04-25T09:09:08.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c1b455000 1 Processor -- start 2024-04-25T09:09:08.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c1b455000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b3f0d90 0x56328b43d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c1b455000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b435a40 0x56328b43d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c1b455000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b436360 0x56328b3f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c1b455000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56328b1f4540 con 0x56328b436360 2024-04-25T09:09:08.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c1b455000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56328b235f30 con 0x56328b435a40 2024-04-25T09:09:08.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c1b455000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56328b3d75b0 con 0x56328b3f0d90 2024-04-25T09:09:08.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c1b455000 10 client.0 _ll_register_callbacks cb 0x56328b2ee180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:08.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c16000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b436360 0x56328b3f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c16000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b436360 0x56328b3f6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45398/0 (socket says 172.21.15.173:45398) 2024-04-25T09:09:08.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c16000640 1 -- 172.21.15.173:0/2948849166 learned_addr learned my addr 172.21.15.173:0/2948849166 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:08.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c15600640 1 --2- 172.21.15.173:0/2948849166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b3f0d90 0x56328b43d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c14c00640 1 --2- 172.21.15.173:0/2948849166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b435a40 0x56328b43d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c16000640 1 -- 172.21.15.173:0/2948849166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b3f0d90 msgr2=0x56328b43d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c16000640 1 --2- 172.21.15.173:0/2948849166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b3f0d90 0x56328b43d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c16000640 1 -- 172.21.15.173:0/2948849166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b435a40 msgr2=0x56328b43d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c16000640 1 --2- 172.21.15.173:0/2948849166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b435a40 0x56328b43d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c16000640 1 -- 172.21.15.173:0/2948849166 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56328b1c21a0 con 0x56328b436360 2024-04-25T09:09:08.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c14c00640 1 --2- 172.21.15.173:0/2948849166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b435a40 0x56328b43d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:08.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c16000640 1 --2- 172.21.15.173:0/2948849166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b436360 0x56328b3f6eb0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f2c0801d2a0 tx=0x7f2c0801b240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b94bca4158712ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2bf2a00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:09:08.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2bf2a00640 1 -- 172.21.15.173:0/2948849166 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c080ba040 con 0x56328b436360 2024-04-25T09:09:08.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2bf2a00640 1 -- 172.21.15.173:0/2948849166 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f2c080039a0 con 0x56328b436360 2024-04-25T09:09:08.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c1b455000 1 -- 172.21.15.173:0/2948849166 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c080a5980 con 0x56328b436360 2024-04-25T09:09:08.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2bf2a00640 1 -- 172.21.15.173:0/2948849166 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c080d0050 con 0x56328b436360 2024-04-25T09:09:08.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c1b455000 10 client.7527 fetch_fsmap learned FSMap version 56 2024-04-25T09:09:08.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c1b455000 1 -- 172.21.15.173:0/2948849166 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x56328b2bc840 con 0x56328b436360 2024-04-25T09:09:08.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2bf2a00640 1 -- 172.21.15.173:0/2948849166 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c080a5980 con 0x56328b436360 2024-04-25T09:09:08.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2bf2a00640 1 -- 172.21.15.173:0/2948849166 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2c080d3020 con 0x56328b436360 2024-04-25T09:09:08.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c1b455000 10 client.7527 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T09:09:08.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c1b455000 10 client.7527 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:09:08.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c1b455000 20 client.7527 populate_metadata read hostname 'smithi173' 2024-04-25T09:09:08.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c1b455000 1 --2- 172.21.15.173:0/2948849166 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x56328b3f7c50 0x56328b3f8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c1b455000 4 client.7527 mds_command: new command op to 7263 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:08.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c1b455000 1 -- 172.21.15.173:0/2948849166 --> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56328b1d5be0 con 0x56328b3f7c50 2024-04-25T09:09:08.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.852+0000 7f2c15600640 1 --2- 172.21.15.173:0/2948849166 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x56328b3f7c50 0x56328b3f8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.856+0000 7f2c15600640 1 --2- 172.21.15.173:0/2948849166 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x56328b3f7c50 0x56328b3f8030 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc349bb972e85213 server_cookie=2ee1e09ea33cbcb4 in_seq=0 out_seq=0 2024-04-25T09:09:08.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.856+0000 7f2bf2a00640 10 client.7527 ms_handle_connect on v2:172.21.15.173:6836/2444108646 2024-04-25T09:09:08.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.856+0000 7f2bf2a00640 1 -- 172.21.15.173:0/2948849166 <== mds.0 v2:172.21.15.173:6836/2444108646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56328b1d5be0 con 0x56328b3f7c50 2024-04-25T09:09:08.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.856+0000 7f2bf2a00640 10 client.7527 handle_command_reply: tid=0 2024-04-25T09:09:08.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.856+0000 7f2c1b455000 1 client.7527 shutdown 2024-04-25T09:09:08.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.856+0000 7f2c1b455000 1 -- 172.21.15.173:0/2948849166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b436360 msgr2=0x56328b3f6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.856+0000 7f2c1b455000 1 --2- 172.21.15.173:0/2948849166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b436360 0x56328b3f6eb0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f2c0801d2a0 tx=0x7f2c0801b240 comp rx=0 tx=0).stop 2024-04-25T09:09:08.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.856+0000 7f2c1b455000 1 -- 172.21.15.173:0/2948849166 shutdown_connections 2024-04-25T09:09:08.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.856+0000 7f2c1b455000 1 --2- 172.21.15.173:0/2948849166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b436360 0x56328b3f6eb0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.856+0000 7f2c1b455000 1 --2- 172.21.15.173:0/2948849166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b435a40 0x56328b43d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.856+0000 7f2c1b455000 1 --2- 172.21.15.173:0/2948849166 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x56328b3f7c50 0x56328b3f8030 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.856+0000 7f2c1b455000 1 --2- 172.21.15.173:0/2948849166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b3f0d90 0x56328b43d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.856+0000 7f2c1b455000 1 -- 172.21.15.173:0/2948849166 >> 172.21.15.173:0/2948849166 conn(0x56328b3ecd40 msgr2=0x56328b3ef9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.856+0000 7f2bf2a00640 0 client.7527 ms_handle_reset on v2:172.21.15.173:6836/2444108646 2024-04-25T09:09:08.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.856+0000 7f2c1b455000 1 -- 172.21.15.173:0/2948849166 shutdown_connections 2024-04-25T09:09:08.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.856+0000 7f2c1b455000 1 -- 172.21.15.173:0/2948849166 wait complete. 2024-04-25T09:09:08.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.856+0000 7f2c1b455000 20 client.7527 trim_cache size 0 max 16384 2024-04-25T09:09:08.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.868+0000 7f2c1b455000 1 Processor -- start 2024-04-25T09:09:08.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.868+0000 7f2c1b455000 1 -- start start 2024-04-25T09:09:08.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b3f0d90 0x56328b4924a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b435a40 0x56328b4929e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b436360 0x56328b492f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c10203be0 con 0x56328b435a40 2024-04-25T09:09:08.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c10158e40 con 0x56328b3f0d90 2024-04-25T09:09:08.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c100b5ed0 con 0x56328b436360 2024-04-25T09:09:08.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c14c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b435a40 0x56328b4929e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c14c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b435a40 0x56328b4929e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45412/0 (socket says 172.21.15.173:45412) 2024-04-25T09:09:08.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c14c00640 1 -- 172.21.15.173:0/3964051208 learned_addr learned my addr 172.21.15.173:0/3964051208 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:08.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c14c00640 1 -- 172.21.15.173:0/3964051208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b436360 msgr2=0x56328b492f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c14c00640 1 --2- 172.21.15.173:0/3964051208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b436360 0x56328b492f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c14c00640 1 -- 172.21.15.173:0/3964051208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b3f0d90 msgr2=0x56328b4924a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c14c00640 1 --2- 172.21.15.173:0/3964051208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b3f0d90 0x56328b4924a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c14c00640 1 -- 172.21.15.173:0/3964051208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56328b293a10 con 0x56328b435a40 2024-04-25T09:09:08.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c14c00640 1 --2- 172.21.15.173:0/3964051208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b435a40 0x56328b4929e0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400a040 tx=0x7f2c0405b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711a9bcfcf6e3663 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2bfd600640 1 -- 172.21.15.173:0/3964051208 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04082e60 con 0x56328b435a40 2024-04-25T09:09:08.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2bfd600640 1 -- 172.21.15.173:0/3964051208 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c040530f0 con 0x56328b435a40 2024-04-25T09:09:08.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2bfd600640 1 -- 172.21.15.173:0/3964051208 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04059e60 con 0x56328b435a40 2024-04-25T09:09:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 -- 172.21.15.173:0/3964051208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b435a40 msgr2=0x56328b4929e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 --2- 172.21.15.173:0/3964051208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b435a40 0x56328b4929e0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400a040 tx=0x7f2c0405b040 comp rx=0 tx=0).stop 2024-04-25T09:09:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 -- 172.21.15.173:0/3964051208 shutdown_connections 2024-04-25T09:09:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 --2- 172.21.15.173:0/3964051208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b436360 0x56328b492f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 --2- 172.21.15.173:0/3964051208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b435a40 0x56328b4929e0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 --2- 172.21.15.173:0/3964051208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b3f0d90 0x56328b4924a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 -- 172.21.15.173:0/3964051208 >> 172.21.15.173:0/3964051208 conn(0x56328b3ecd40 msgr2=0x56328b434210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 -- 172.21.15.173:0/3964051208 shutdown_connections 2024-04-25T09:09:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 -- 172.21.15.173:0/3964051208 wait complete. 2024-04-25T09:09:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 -- start start 2024-04-25T09:09:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 Processor -- start 2024-04-25T09:09:08.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b3f0d90 0x56328b4966c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b435a40 0x56328b496c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b436360 0x56328b43aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56328b1dd2d0 con 0x56328b435a40 2024-04-25T09:09:08.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c10158840 con 0x56328b3f0d90 2024-04-25T09:09:08.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56328b235f30 con 0x56328b436360 2024-04-25T09:09:08.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c1b455000 10 client.0 _ll_register_callbacks cb 0x56328b1fca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:08.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c14c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b435a40 0x56328b496c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c14c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b435a40 0x56328b496c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45422/0 (socket says 172.21.15.173:45422) 2024-04-25T09:09:08.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c14c00640 1 -- 172.21.15.173:0/2106676568 learned_addr learned my addr 172.21.15.173:0/2106676568 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:08.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c16000640 1 --2- 172.21.15.173:0/2106676568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b436360 0x56328b43aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c15600640 1 --2- 172.21.15.173:0/2106676568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b3f0d90 0x56328b4966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.872+0000 7f2c14c00640 1 -- 172.21.15.173:0/2106676568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b436360 msgr2=0x56328b43aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c14c00640 1 --2- 172.21.15.173:0/2106676568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b436360 0x56328b43aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c14c00640 1 -- 172.21.15.173:0/2106676568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b3f0d90 msgr2=0x56328b4966c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c14c00640 1 --2- 172.21.15.173:0/2106676568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b3f0d90 0x56328b4966c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c14c00640 1 -- 172.21.15.173:0/2106676568 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56328b1ceb00 con 0x56328b435a40 2024-04-25T09:09:08.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c15600640 1 --2- 172.21.15.173:0/2106676568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b3f0d90 0x56328b4966c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:08.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c14c00640 1 --2- 172.21.15.173:0/2106676568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b435a40 0x56328b496c00 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f2c0405cfd0 tx=0x7f2c04082960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef5c47596964f3e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2bf2a00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:09:08.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2bf2a00640 1 -- 172.21.15.173:0/2106676568 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04082e60 con 0x56328b435a40 2024-04-25T09:09:08.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2bf2a00640 1 -- 172.21.15.173:0/2106676568 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f2c04013c80 con 0x56328b435a40 2024-04-25T09:09:08.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 1 -- 172.21.15.173:0/2106676568 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c040530f0 con 0x56328b435a40 2024-04-25T09:09:08.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2bf2a00640 1 -- 172.21.15.173:0/2106676568 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c04059e60 con 0x56328b435a40 2024-04-25T09:09:08.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 10 client.7533 fetch_fsmap learned FSMap version 56 2024-04-25T09:09:08.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 1 -- 172.21.15.173:0/2106676568 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x56328b1e0f80 con 0x56328b435a40 2024-04-25T09:09:08.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2bf2a00640 1 -- 172.21.15.173:0/2106676568 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c040530f0 con 0x56328b435a40 2024-04-25T09:09:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2bf2a00640 1 -- 172.21.15.173:0/2106676568 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2c0406cb80 con 0x56328b435a40 2024-04-25T09:09:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 10 client.7533 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T09:09:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 10 client.7533 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:09:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 20 client.7533 populate_metadata read hostname 'smithi173' 2024-04-25T09:09:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 1 --2- 172.21.15.173:0/2106676568 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x56328b43b800 0x56328b43bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 4 client.7533 mds_command: new command op to 7263 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-04-25T09:09:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 1 -- 172.21.15.173:0/2106676568 --> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x56328b2473d0 con 0x56328b43b800 2024-04-25T09:09:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c15600640 1 --2- 172.21.15.173:0/2106676568 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x56328b43b800 0x56328b43bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c15600640 1 --2- 172.21.15.173:0/2106676568 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x56328b43b800 0x56328b43bc10 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90b5fe3d75b75642 server_cookie=45d3bfe70a69fbff in_seq=0 out_seq=0 2024-04-25T09:09:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2bf2a00640 10 client.7533 ms_handle_connect on v2:172.21.15.173:6836/2444108646 2024-04-25T09:09:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2bf2a00640 1 -- 172.21.15.173:0/2106676568 <== mds.0 v2:172.21.15.173:6836/2444108646 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17944 (crc 0 0 0) 0x56328b2473d0 con 0x56328b43b800 2024-04-25T09:09:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2bf2a00640 10 client.7533 handle_command_reply: tid=0 2024-04-25T09:09:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 1 client.7533 shutdown 2024-04-25T09:09:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 1 -- 172.21.15.173:0/2106676568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b435a40 msgr2=0x56328b496c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 1 --2- 172.21.15.173:0/2106676568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b435a40 0x56328b496c00 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f2c0405cfd0 tx=0x7f2c04082960 comp rx=0 tx=0).stop 2024-04-25T09:09:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 1 -- 172.21.15.173:0/2106676568 shutdown_connections 2024-04-25T09:09:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 1 --2- 172.21.15.173:0/2106676568 >> [v2:172.21.15.173:6836/2444108646,v1:172.21.15.173:6837/2444108646] conn(0x56328b43b800 0x56328b43bc10 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 1 --2- 172.21.15.173:0/2106676568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56328b436360 0x56328b43aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 1 --2- 172.21.15.173:0/2106676568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56328b435a40 0x56328b496c00 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2bf2a00640 0 client.7533 ms_handle_reset on v2:172.21.15.173:6836/2444108646 2024-04-25T09:09:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 1 --2- 172.21.15.173:0/2106676568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56328b3f0d90 0x56328b4966c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 1 -- 172.21.15.173:0/2106676568 >> 172.21.15.173:0/2106676568 conn(0x56328b3ecd40 msgr2=0x56328b434aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 1 -- 172.21.15.173:0/2106676568 shutdown_connections 2024-04-25T09:09:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 1 -- 172.21.15.173:0/2106676568 wait complete. 2024-04-25T09:09:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c1b455000 20 client.7533 trim_cache size 0 max 16384 2024-04-25T09:09:08.871 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:09:08.871 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T09:09:08.871 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 3351, 2024-04-25T09:09:08.871 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 3352, 2024-04-25T09:09:08.871 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 1249503, 2024-04-25T09:09:08.871 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 15871361, 2024-04-25T09:09:08.871 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 17, 2024-04-25T09:09:08.871 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 6, 2024-04-25T09:09:08.871 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.662138083, 2024-04-25T09:09:08.871 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.157186496, 2024-04-25T09:09:08.871 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.076711337, 2024-04-25T09:09:08.872 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.393640306, 2024-04-25T09:09:08.872 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T09:09:08.872 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3351, 2024-04-25T09:09:08.872 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.820562055, 2024-04-25T09:09:08.872 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000244870 2024-04-25T09:09:08.872 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.872 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-04-25T09:09:08.872 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 10, 2024-04-25T09:09:08.872 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000001239, 2024-04-25T09:09:08.872 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000123 2024-04-25T09:09:08.872 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.872 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T09:09:08.872 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T09:09:08.872 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.872 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T09:09:08.873 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 29963, 2024-04-25T09:09:08.873 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 50663, 2024-04-25T09:09:08.873 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 10428134, 2024-04-25T09:09:08.873 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 46164537, 2024-04-25T09:09:08.873 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 7, 2024-04-25T09:09:08.873 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 4, 2024-04-25T09:09:08.873 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 3.861153105, 2024-04-25T09:09:08.873 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 2.612607988, 2024-04-25T09:09:08.873 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 1.117464252, 2024-04-25T09:09:08.873 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.356803783, 2024-04-25T09:09:08.873 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T09:09:08.873 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 50663, 2024-04-25T09:09:08.873 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.716416468, 2024-04-25T09:09:08.873 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000033879 2024-04-25T09:09:08.873 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.874 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-04-25T09:09:08.874 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 46167, 2024-04-25T09:09:08.874 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.008976648, 2024-04-25T09:09:08.874 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000194 2024-04-25T09:09:08.874 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.874 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 117952, 2024-04-25T09:09:08.874 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 23888 2024-04-25T09:09:08.874 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.874 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T09:09:08.874 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 4533, 2024-04-25T09:09:08.874 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 4554, 2024-04-25T09:09:08.874 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 1132314, 2024-04-25T09:09:08.874 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 47595211, 2024-04-25T09:09:08.874 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 6, 2024-04-25T09:09:08.875 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 4, 2024-04-25T09:09:08.875 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.517631377, 2024-04-25T09:09:08.875 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.254180759, 2024-04-25T09:09:08.875 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.100110204, 2024-04-25T09:09:08.875 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.124795886, 2024-04-25T09:09:08.875 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T09:09:08.875 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4552, 2024-04-25T09:09:08.875 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.708643061, 2024-04-25T09:09:08.875 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000155677 2024-04-25T09:09:08.875 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.875 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-04-25T09:09:08.875 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.875 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.875 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.875 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.876 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-25T09:09:08.876 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 119120 2024-04-25T09:09:08.876 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.876 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-04-25T09:09:08.876 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-04-25T09:09:08.876 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-04-25T09:09:08.876 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.876 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-04-25T09:09:08.876 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-04-25T09:09:08.876 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-04-25T09:09:08.876 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 5292, 2024-04-25T09:09:08.876 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 13.948157843, 2024-04-25T09:09:08.876 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.002635706 2024-04-25T09:09:08.876 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:08.876 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.877 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-04-25T09:09:08.877 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-04-25T09:09:08.877 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-04-25T09:09:08.877 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3311, 2024-04-25T09:09:08.877 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.399160708, 2024-04-25T09:09:08.877 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000422579 2024-04-25T09:09:08.877 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:08.877 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.877 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-04-25T09:09:08.877 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 25579, 2024-04-25T09:09:08.877 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 25579, 2024-04-25T09:09:08.877 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-04-25T09:09:08.877 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 25579, 2024-04-25T09:09:08.877 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 321.974623534, 2024-04-25T09:09:08.877 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.012587459 2024-04-25T09:09:08.877 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.877 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-04-25T09:09:08.878 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 0, 2024-04-25T09:09:08.878 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-04-25T09:09:08.878 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-04-25T09:09:08.878 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 12, 2024-04-25T09:09:08.878 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 0, 2024-04-25T09:09:08.878 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-04-25T09:09:08.878 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 17853, 2024-04-25T09:09:08.878 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 0, 2024-04-25T09:09:08.878 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 17853, 2024-04-25T09:09:08.878 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 0, 2024-04-25T09:09:08.878 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 17853, 2024-04-25T09:09:08.878 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 0, 2024-04-25T09:09:08.878 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 2, 2024-04-25T09:09:08.878 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 2, 2024-04-25T09:09:08.878 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 2, 2024-04-25T09:09:08.879 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 47418, 2024-04-25T09:09:08.879 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 46934, 2024-04-25T09:09:08.879 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 0, 2024-04-25T09:09:08.879 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 0, 2024-04-25T09:09:08.879 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-04-25T09:09:08.879 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-04-25T09:09:08.879 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 134, 2024-04-25T09:09:08.879 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 0, 2024-04-25T09:09:08.879 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 0, 2024-04-25T09:09:08.879 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 0, 2024-04-25T09:09:08.879 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 0, 2024-04-25T09:09:08.879 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 0, 2024-04-25T09:09:08.879 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 0, 2024-04-25T09:09:08.879 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-04-25T09:09:08.879 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 2011, 2024-04-25T09:09:08.879 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-04-25T09:09:08.879 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 0, 2024-04-25T09:09:08.880 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 0, 2024-04-25T09:09:08.880 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 0, 2024-04-25T09:09:08.880 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 2011, 2024-04-25T09:09:08.880 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-04-25T09:09:08.880 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T09:09:08.880 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-04-25T09:09:08.880 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 11, 2024-04-25T09:09:08.880 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 1, 2024-04-25T09:09:08.880 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 10, 2024-04-25T09:09:08.880 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 2000, 2024-04-25T09:09:08.880 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 0, 2024-04-25T09:09:08.880 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 896, 2024-04-25T09:09:08.880 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 4021, 2024-04-25T09:09:08.880 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T09:09:08.880 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T09:09:08.880 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T09:09:08.880 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 4078, 2024-04-25T09:09:08.881 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 2000, 2024-04-25T09:09:08.881 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 57, 2024-04-25T09:09:08.881 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 13997 2024-04-25T09:09:08.881 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.881 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-04-25T09:09:08.881 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 0, 2024-04-25T09:09:08.881 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 0, 2024-04-25T09:09:08.881 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 0, 2024-04-25T09:09:08.881 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 0, 2024-04-25T09:09:08.881 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 0, 2024-04-25T09:09:08.881 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 0, 2024-04-25T09:09:08.881 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-04-25T09:09:08.881 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-04-25T09:09:08.881 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 4138, 2024-04-25T09:09:08.881 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 3840, 2024-04-25T09:09:08.881 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 2227, 2024-04-25T09:09:08.882 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-04-25T09:09:08.882 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-04-25T09:09:08.882 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-04-25T09:09:08.882 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-04-25T09:09:08.882 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-04-25T09:09:08.882 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-04-25T09:09:08.882 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 1, 2024-04-25T09:09:08.882 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 0, 2024-04-25T09:09:08.882 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-04-25T09:09:08.882 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 0, 2024-04-25T09:09:08.882 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-04-25T09:09:08.882 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2024-04-25T09:09:08.882 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.882 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-04-25T09:09:08.882 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-04-25T09:09:08.883 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 26442, 2024-04-25T09:09:08.883 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-04-25T09:09:08.883 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-04-25T09:09:08.883 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 26442, 2024-04-25T09:09:08.883 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-04-25T09:09:08.883 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-04-25T09:09:08.883 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 35, 2024-04-25T09:09:08.883 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-04-25T09:09:08.883 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-04-25T09:09:08.883 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 35, 2024-04-25T09:09:08.883 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 4, 2024-04-25T09:09:08.883 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-04-25T09:09:08.883 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-04-25T09:09:08.883 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-04-25T09:09:08.883 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 90208928, 2024-04-25T09:09:08.884 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 0, 2024-04-25T09:09:08.884 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-04-25T09:09:08.884 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4032, 2024-04-25T09:09:08.884 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 107.472147647, 2024-04-25T09:09:08.884 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.026654798 2024-04-25T09:09:08.884 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.884 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 0 2024-04-25T09:09:08.884 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.884 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-04-25T09:09:08.884 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 14, 2024-04-25T09:09:08.884 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 2015, 2024-04-25T09:09:08.884 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 2001, 2024-04-25T09:09:08.884 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 13, 2024-04-25T09:09:08.884 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 13, 2024-04-25T09:09:08.884 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 0, 2024-04-25T09:09:08.885 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 17853, 2024-04-25T09:09:08.885 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 19854, 2024-04-25T09:09:08.885 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 2001, 2024-04-25T09:09:08.885 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 2, 2024-04-25T09:09:08.885 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 8085, 2024-04-25T09:09:08.885 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 8083, 2024-04-25T09:09:08.885 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 100176, 2024-04-25T09:09:08.885 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 215340 2024-04-25T09:09:08.885 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.885 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-04-25T09:09:08.885 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 28962, 2024-04-25T09:09:08.885 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 0, 2024-04-25T09:09:08.885 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 25579, 2024-04-25T09:09:08.885 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 5, 2024-04-25T09:09:08.885 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 0, 2024-04-25T09:09:08.886 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-04-25T09:09:08.886 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2000, 2024-04-25T09:09:08.886 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.457912527, 2024-04-25T09:09:08.886 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000728956 2024-04-25T09:09:08.886 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.886 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-04-25T09:09:08.886 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 28, 2024-04-25T09:09:08.886 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.004176946, 2024-04-25T09:09:08.886 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000149176 2024-04-25T09:09:08.886 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.886 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-04-25T09:09:08.886 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.886 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.886 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.887 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.887 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-04-25T09:09:08.887 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 6000, 2024-04-25T09:09:08.887 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 7.003710437, 2024-04-25T09:09:08.887 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001167285 2024-04-25T09:09:08.887 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.887 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-04-25T09:09:08.887 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 7311, 2024-04-25T09:09:08.887 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 6.425681608, 2024-04-25T09:09:08.887 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000878905 2024-04-25T09:09:08.887 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.887 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-04-25T09:09:08.887 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.887 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.887 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.887 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.888 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-04-25T09:09:08.888 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.888 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.888 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.888 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.888 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-04-25T09:09:08.888 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.888 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.888 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.888 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.888 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-04-25T09:09:08.888 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.889 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.889 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.889 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.889 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-04-25T09:09:08.889 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:09:08.889 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000055637, 2024-04-25T09:09:08.889 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000055637 2024-04-25T09:09:08.889 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.889 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-04-25T09:09:08.889 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.889 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.889 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.889 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.889 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-04-25T09:09:08.889 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:09:08.890 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.003348710, 2024-04-25T09:09:08.890 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.003348710 2024-04-25T09:09:08.890 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.890 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-04-25T09:09:08.890 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.890 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.890 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.890 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.890 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-04-25T09:09:08.890 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:09:08.890 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.007880591, 2024-04-25T09:09:08.890 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.007880591 2024-04-25T09:09:08.890 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.890 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-04-25T09:09:08.890 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.890 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.891 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.891 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.891 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-04-25T09:09:08.891 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 8, 2024-04-25T09:09:08.891 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.162261902, 2024-04-25T09:09:08.891 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.020282737 2024-04-25T09:09:08.891 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.891 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-04-25T09:09:08.891 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2227, 2024-04-25T09:09:08.891 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 290.712379890, 2024-04-25T09:09:08.891 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.130539910 2024-04-25T09:09:08.891 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.891 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-04-25T09:09:08.891 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.891 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.891 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.891 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.892 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-04-25T09:09:08.892 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.892 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.892 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.892 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.892 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-04-25T09:09:08.892 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.892 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.892 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.892 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.892 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-04-25T09:09:08.892 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:09:08.892 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.012462139, 2024-04-25T09:09:08.892 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.012462139 2024-04-25T09:09:08.892 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.892 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-04-25T09:09:08.892 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.893 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.893 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.893 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.893 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-04-25T09:09:08.893 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-04-25T09:09:08.893 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000264369, 2024-04-25T09:09:08.893 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000264369 2024-04-25T09:09:08.893 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.893 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-04-25T09:09:08.893 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.893 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.893 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.893 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.893 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-04-25T09:09:08.893 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.893 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.893 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.894 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.894 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-04-25T09:09:08.894 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.894 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.894 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.894 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.894 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-04-25T09:09:08.894 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.894 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.894 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.894 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.894 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-04-25T09:09:08.894 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.894 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.894 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.894 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.895 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-04-25T09:09:08.895 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 8000, 2024-04-25T09:09:08.895 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 16.184488778, 2024-04-25T09:09:08.895 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.002023061 2024-04-25T09:09:08.895 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.895 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-04-25T09:09:08.895 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-04-25T09:09:08.895 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-04-25T09:09:08.895 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.895 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.895 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.895 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:08.895 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.895 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-04-25T09:09:08.895 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 1, 2024-04-25T09:09:08.895 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 1, 2024-04-25T09:09:08.896 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 0, 2024-04-25T09:09:08.896 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 1, 2024-04-25T09:09:08.896 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-04-25T09:09:08.896 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 18463, 2024-04-25T09:09:08.896 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 18463, 2024-04-25T09:09:08.896 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 78, 2024-04-25T09:09:08.896 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-04-25T09:09:08.896 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.896 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-04-25T09:09:08.896 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-04-25T09:09:08.896 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-04-25T09:09:08.896 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T09:09:08.896 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-04-25T09:09:08.896 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T09:09:08.896 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-04-25T09:09:08.896 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T09:09:08.896 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T09:09:08.897 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T09:09:08.897 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T09:09:08.897 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T09:09:08.897 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-04-25T09:09:08.897 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T09:09:08.897 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T09:09:08.897 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-04-25T09:09:08.897 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-04-25T09:09:08.897 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-04-25T09:09:08.897 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-04-25T09:09:08.897 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T09:09:08.897 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T09:09:08.897 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T09:09:08.897 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T09:09:08.897 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T09:09:08.897 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-04-25T09:09:08.897 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-04-25T09:09:08.898 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-04-25T09:09:08.898 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T09:09:08.898 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T09:09:08.898 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-04-25T09:09:08.898 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-04-25T09:09:08.898 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-04-25T09:09:08.898 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-04-25T09:09:08.898 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T09:09:08.898 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-04-25T09:09:08.898 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T09:09:08.898 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-04-25T09:09:08.898 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 250610, 2024-04-25T09:09:08.898 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 86, 2024-04-25T09:09:08.899 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-04-25T09:09:08.899 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-04-25T09:09:08.899 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-04-25T09:09:08.899 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-04-25T09:09:08.899 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-04-25T09:09:08.899 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-04-25T09:09:08.899 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-04-25T09:09:08.899 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-04-25T09:09:08.899 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 5528, 2024-04-25T09:09:08.899 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 78, 2024-04-25T09:09:08.899 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T09:09:08.899 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-04-25T09:09:08.899 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-04-25T09:09:08.899 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-04-25T09:09:08.900 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 13442748, 2024-04-25T09:09:08.900 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 661026, 2024-04-25T09:09:08.900 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-04-25T09:09:08.900 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-04-25T09:09:08.900 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-04-25T09:09:08.900 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-04-25T09:09:08.900 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.900 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-04-25T09:09:08.900 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-04-25T09:09:08.900 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-04-25T09:09:08.900 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 10151, 2024-04-25T09:09:08.900 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 86662500, 2024-04-25T09:09:08.900 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 25, 2024-04-25T09:09:08.900 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 10151, 2024-04-25T09:09:08.900 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-04-25T09:09:08.900 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 10151, 2024-04-25T09:09:08.900 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 42.615297707, 2024-04-25T09:09:08.901 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.004198137 2024-04-25T09:09:08.901 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.901 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-04-25T09:09:08.901 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-04-25T09:09:08.901 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 10151, 2024-04-25T09:09:08.901 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 10241 2024-04-25T09:09:08.901 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.901 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 10151, 2024-04-25T09:09:08.901 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 2074, 2024-04-25T09:09:08.901 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 8077, 2024-04-25T09:09:08.901 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-04-25T09:09:08.901 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-04-25T09:09:08.901 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 0, 2024-04-25T09:09:08.901 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 11, 2024-04-25T09:09:08.901 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 62, 2024-04-25T09:09:08.901 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 4093, 2024-04-25T09:09:08.901 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 38, 2024-04-25T09:09:08.902 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-04-25T09:09:08.902 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-04-25T09:09:08.902 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 1840, 2024-04-25T09:09:08.902 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 0, 2024-04-25T09:09:08.902 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 2032, 2024-04-25T09:09:08.902 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-04-25T09:09:08.902 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-04-25T09:09:08.902 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-04-25T09:09:08.902 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 2012, 2024-04-25T09:09:08.902 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 22, 2024-04-25T09:09:08.902 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-04-25T09:09:08.902 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-04-25T09:09:08.902 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-04-25T09:09:08.902 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-04-25T09:09:08.902 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-04-25T09:09:08.902 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-04-25T09:09:08.903 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T09:09:08.903 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-04-25T09:09:08.903 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-04-25T09:09:08.903 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-04-25T09:09:08.903 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-04-25T09:09:08.903 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-04-25T09:09:08.903 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-04-25T09:09:08.903 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-04-25T09:09:08.903 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-04-25T09:09:08.903 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-04-25T09:09:08.903 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-04-25T09:09:08.903 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-04-25T09:09:08.903 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-04-25T09:09:08.903 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-04-25T09:09:08.903 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-04-25T09:09:08.903 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-04-25T09:09:08.904 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-04-25T09:09:08.904 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-04-25T09:09:08.904 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-04-25T09:09:08.904 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-04-25T09:09:08.904 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 86, 2024-04-25T09:09:08.904 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-04-25T09:09:08.904 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 3, 2024-04-25T09:09:08.904 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 8, 2024-04-25T09:09:08.904 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 8, 2024-04-25T09:09:08.904 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-04-25T09:09:08.904 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-04-25T09:09:08.904 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 109, 2024-04-25T09:09:08.904 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 0, 2024-04-25T09:09:08.904 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 22 2024-04-25T09:09:08.904 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.905 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-04-25T09:09:08.905 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 1, 2024-04-25T09:09:08.905 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-04-25T09:09:08.905 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-04-25T09:09:08.905 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-04-25T09:09:08.905 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.905 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2024-04-25T09:09:08.905 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 0 2024-04-25T09:09:08.905 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.905 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-04-25T09:09:08.905 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-04-25T09:09:08.905 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 32, 2024-04-25T09:09:08.905 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-04-25T09:09:08.905 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 32, 2024-04-25T09:09:08.905 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 3840, 2024-04-25T09:09:08.905 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 3840, 2024-04-25T09:09:08.906 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-04-25T09:09:08.906 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.906 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T09:09:08.906 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-04-25T09:09:08.906 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-04-25T09:09:08.906 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:09:08.906 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 37842, 2024-04-25T09:09:08.906 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 9840753, 2024-04-25T09:09:08.906 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:09:08.906 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 37842, 2024-04-25T09:09:08.906 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-04-25T09:09:08.906 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-04-25T09:09:08.906 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 37842, 2024-04-25T09:09:08.906 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 9840753, 2024-04-25T09:09:08.906 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:09:08.907 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.907 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.907 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.907 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:08.907 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.907 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-04-25T09:09:08.907 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-04-25T09:09:08.907 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-04-25T09:09:08.907 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:09:08.907 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-04-25T09:09:08.907 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-04-25T09:09:08.907 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:09:08.907 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-04-25T09:09:08.907 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 10151, 2024-04-25T09:09:08.908 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 87065060, 2024-04-25T09:09:08.908 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 10151, 2024-04-25T09:09:08.908 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 87065060, 2024-04-25T09:09:08.908 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:09:08.908 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.908 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.908 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.908 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:08.908 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.908 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-04-25T09:09:08.908 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-04-25T09:09:08.908 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-04-25T09:09:08.908 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:09:08.908 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-04-25T09:09:08.908 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-04-25T09:09:08.908 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:09:08.909 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-04-25T09:09:08.909 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 10151, 2024-04-25T09:09:08.909 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 10151, 2024-04-25T09:09:08.909 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 10151, 2024-04-25T09:09:08.909 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 10151, 2024-04-25T09:09:08.909 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:09:08.909 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.909 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.909 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.909 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:08.909 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.909 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-04-25T09:09:08.909 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-04-25T09:09:08.909 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-04-25T09:09:08.909 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:09:08.909 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 3840, 2024-04-25T09:09:08.909 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 402560, 2024-04-25T09:09:08.910 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:09:08.910 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 3840, 2024-04-25T09:09:08.910 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-04-25T09:09:08.910 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-04-25T09:09:08.910 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 61, 2024-04-25T09:09:08.910 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 402560, 2024-04-25T09:09:08.910 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:09:08.910 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.910 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.910 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.910 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:08.911 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:08.911 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x55afd5578a00": { 2024-04-25T09:09:08.911 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-04-25T09:09:08.911 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-04-25T09:09:08.911 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-04-25T09:09:08.911 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 26442, 2024-04-25T09:09:08.911 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 86014624, 2024-04-25T09:09:08.911 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-04-25T09:09:08.911 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 26442, 2024-04-25T09:09:08.911 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-04-25T09:09:08.911 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-04-25T09:09:08.911 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 4032, 2024-04-25T09:09:08.911 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 86014624, 2024-04-25T09:09:08.912 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-04-25T09:09:08.912 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-04-25T09:09:08.912 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-04-25T09:09:08.912 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-04-25T09:09:08.912 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:08.912 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:08.912 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:09:08.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c16a00640 1 -- 172.21.15.173:0/2724351935 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2bf4066f60 msgr2=0x7f2bf4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c16a00640 1 --2- 172.21.15.173:0/2724351935 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2bf4066f60 0x7f2bf4069420 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2c000079d0 tx=0x7f2c00008040 comp rx=0 tx=0).stop 2024-04-25T09:09:08.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c16a00640 1 -- 172.21.15.173:0/2724351935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c1006c220 msgr2=0x7f2c100b6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c16a00640 1 --2- 172.21.15.173:0/2724351935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c1006c220 0x7f2c100b6ea0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400c3a0 tx=0x7f2c0400c860 comp rx=0 tx=0).stop 2024-04-25T09:09:08.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c16a00640 1 -- 172.21.15.173:0/2724351935 shutdown_connections 2024-04-25T09:09:08.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c16a00640 1 --2- 172.21.15.173:0/2724351935 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2bf4066f60 0x7f2bf4069420 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c16a00640 1 --2- 172.21.15.173:0/2724351935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2c10099a50 0x7f2c101595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c16a00640 1 --2- 172.21.15.173:0/2724351935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c1006c220 0x7f2c100b6ea0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c16a00640 1 --2- 172.21.15.173:0/2724351935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c1006bda0 0x7f2c1015bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c16a00640 1 -- 172.21.15.173:0/2724351935 >> 172.21.15.173:0/2724351935 conn(0x7f2c100b31d0 msgr2=0x7f2c10070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c16a00640 1 -- 172.21.15.173:0/2724351935 shutdown_connections 2024-04-25T09:09:08.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:08.876+0000 7f2c16a00640 1 -- 172.21.15.173:0/2724351935 wait complete. 2024-04-25T09:09:08.915 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:09:08.915 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:09:08.974 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:09:09.074 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:09:09.074 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:09:09.075 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:09.083 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:09:09.083 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:09.134 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:09.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.320+0000 7fad80600640 1 Processor -- start 2024-04-25T09:09:09.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.320+0000 7fad80600640 1 -- start start 2024-04-25T09:09:09.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.320+0000 7fad80600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fad7815e040 0x7fad780ace10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.320+0000 7fad80600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad780ad350 0x7fad780ae810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.320+0000 7fad80600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7815e8e0 con 0x7fad7815dc60 2024-04-25T09:09:09.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.320+0000 7fad80600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad78071450 con 0x7fad7815e040 2024-04-25T09:09:09.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.320+0000 7fad80600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7815ebc0 con 0x7fad780ad350 2024-04-25T09:09:09.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.320+0000 7fad7d200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fad7815e040 0x7fad780ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.324+0000 7fad7d200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fad7815e040 0x7fad780ace10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45426/0 (socket says 172.21.15.173:45426) 2024-04-25T09:09:09.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.324+0000 7fad7d200640 1 -- 172.21.15.173:0/3044906670 learned_addr learned my addr 172.21.15.173:0/3044906670 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:09.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.324+0000 7fad7e600640 1 --2- 172.21.15.173:0/3044906670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad780ad350 0x7fad780ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.324+0000 7fad7d200640 1 -- 172.21.15.173:0/3044906670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad780ad350 msgr2=0x7fad780ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:09.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.324+0000 7fad7d200640 1 --2- 172.21.15.173:0/3044906670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad780ad350 0x7fad780ae810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.324+0000 7fad7d200640 1 -- 172.21.15.173:0/3044906670 >> v1:172.21.15.194:6789/0 conn(0x7fad7815dc60 legacy=0x7fad780b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:09.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.324+0000 7fad7d200640 1 -- 172.21.15.173:0/3044906670 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7815eea0 con 0x7fad7815e040 2024-04-25T09:09:09.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.324+0000 7fad7e600640 1 --2- 172.21.15.173:0/3044906670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad780ad350 0x7fad780ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:09.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.324+0000 7fad7d200640 1 --2- 172.21.15.173:0/3044906670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad7815e040 0x7fad780ace10 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fad64009870 tx=0x7fad6401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c0f84fc6d9c6b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.324+0000 7fad77e00640 1 -- 172.21.15.173:0/3044906670 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad640b0070 con 0x7fad7815e040 2024-04-25T09:09:09.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.324+0000 7fad77e00640 1 -- 172.21.15.173:0/3044906670 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad640ab600 con 0x7fad7815e040 2024-04-25T09:09:09.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.324+0000 7fad77e00640 1 -- 172.21.15.173:0/3044906670 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad640ab9d0 con 0x7fad7815e040 2024-04-25T09:09:09.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad80600640 1 -- 172.21.15.173:0/3044906670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad7815e040 msgr2=0x7fad780ace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad80600640 1 --2- 172.21.15.173:0/3044906670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad7815e040 0x7fad780ace10 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fad64009870 tx=0x7fad6401c520 comp rx=0 tx=0).stop 2024-04-25T09:09:09.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad80600640 1 -- 172.21.15.173:0/3044906670 shutdown_connections 2024-04-25T09:09:09.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad80600640 1 --2- 172.21.15.173:0/3044906670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad780ad350 0x7fad780ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad80600640 1 --2- 172.21.15.173:0/3044906670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad7815e040 0x7fad780ace10 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad80600640 1 -- 172.21.15.173:0/3044906670 >> 172.21.15.173:0/3044906670 conn(0x7fad7806ac90 msgr2=0x7fad7806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:09.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad80600640 1 -- 172.21.15.173:0/3044906670 shutdown_connections 2024-04-25T09:09:09.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad80600640 1 -- 172.21.15.173:0/3044906670 wait complete. 2024-04-25T09:09:09.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad80600640 1 Processor -- start 2024-04-25T09:09:09.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad80600640 1 -- start start 2024-04-25T09:09:09.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad80600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad780ad350 0x7fad781430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad80600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad7815dc60 0x7fad78151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad80600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad7815e040 0x7fad7815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad80600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7816ab90 con 0x7fad7815dc60 2024-04-25T09:09:09.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad80600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7815e6c0 con 0x7fad780ad350 2024-04-25T09:09:09.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad80600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7816ad10 con 0x7fad7815e040 2024-04-25T09:09:09.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad7d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad7815dc60 0x7fad78151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad7d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad7815dc60 0x7fad78151230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45432/0 (socket says 172.21.15.173:45432) 2024-04-25T09:09:09.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad7d200640 1 -- 172.21.15.173:0/321947441 learned_addr learned my addr 172.21.15.173:0/321947441 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:09.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad7dc00640 1 --2- 172.21.15.173:0/321947441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad780ad350 0x7fad781430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad7e600640 1 --2- 172.21.15.173:0/321947441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad7815e040 0x7fad7815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad7d200640 1 -- 172.21.15.173:0/321947441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad7815e040 msgr2=0x7fad7815ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad7d200640 1 --2- 172.21.15.173:0/321947441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad7815e040 0x7fad7815ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad7d200640 1 -- 172.21.15.173:0/321947441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad780ad350 msgr2=0x7fad781430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad7d200640 1 --2- 172.21.15.173:0/321947441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad780ad350 0x7fad781430c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad7d200640 1 -- 172.21.15.173:0/321947441 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad78152520 con 0x7fad7815dc60 2024-04-25T09:09:09.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad7d200640 1 --2- 172.21.15.173:0/321947441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad7815dc60 0x7fad78151230 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fad6401abd0 tx=0x7fad640192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad75600640 1 -- 172.21.15.173:0/321947441 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad640ba070 con 0x7fad7815dc60 2024-04-25T09:09:09.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad75600640 1 -- 172.21.15.173:0/321947441 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad640b4620 con 0x7fad7815dc60 2024-04-25T09:09:09.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.328+0000 7fad75600640 1 -- 172.21.15.173:0/321947441 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad640b0040 con 0x7fad7815dc60 2024-04-25T09:09:09.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.332+0000 7fad80600640 1 -- 172.21.15.173:0/321947441 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad78151c80 con 0x7fad7815dc60 2024-04-25T09:09:09.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.332+0000 7fad80600640 1 -- 172.21.15.173:0/321947441 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad78152240 con 0x7fad7815dc60 2024-04-25T09:09:09.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.332+0000 7fad80600640 1 -- 172.21.15.173:0/321947441 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad78073a40 con 0x7fad7815dc60 2024-04-25T09:09:09.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.332+0000 7fad75600640 1 -- 172.21.15.173:0/321947441 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fad640bd070 con 0x7fad7815dc60 2024-04-25T09:09:09.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.332+0000 7fad75600640 1 --2- 172.21.15.173:0/321947441 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fad58066f60 0x7fad58069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.332+0000 7fad75600640 1 -- 172.21.15.173:0/321947441 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7fad6411e360 con 0x7fad7815dc60 2024-04-25T09:09:09.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.332+0000 7fad7dc00640 1 --2- 172.21.15.173:0/321947441 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fad58066f60 0x7fad58069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.332+0000 7fad7dc00640 1 --2- 172.21.15.173:0/321947441 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fad58066f60 0x7fad58069420 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fad6c004e30 tx=0x7fad6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.336+0000 7fad75600640 1 -- 172.21.15.173:0/321947441 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fad64016110 con 0x7fad7815dc60 2024-04-25T09:09:09.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.492+0000 7fad80600640 1 -- 172.21.15.173:0/321947441 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad7806b070 con 0x7fad7815dc60 2024-04-25T09:09:09.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.492+0000 7fad75600640 1 -- 172.21.15.173:0/321947441 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+17071 (secure 0 0 0) 0x7fad640ef120 con 0x7fad7815dc60 2024-04-25T09:09:09.481 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:09.481 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":86,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:08:50.466636+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:07:35.343920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:07:35.976786+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":85,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:09.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.492+0000 7fad80600640 1 -- 172.21.15.173:0/321947441 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fad58066f60 msgr2=0x7fad58069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.492+0000 7fad80600640 1 --2- 172.21.15.173:0/321947441 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fad58066f60 0x7fad58069420 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fad6c004e30 tx=0x7fad6c009040 comp rx=0 tx=0).stop 2024-04-25T09:09:09.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.492+0000 7fad80600640 1 -- 172.21.15.173:0/321947441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad7815dc60 msgr2=0x7fad78151230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.492+0000 7fad80600640 1 --2- 172.21.15.173:0/321947441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad7815dc60 0x7fad78151230 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fad6401abd0 tx=0x7fad640192c0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.496+0000 7fad80600640 1 -- 172.21.15.173:0/321947441 shutdown_connections 2024-04-25T09:09:09.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.496+0000 7fad80600640 1 --2- 172.21.15.173:0/321947441 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fad58066f60 0x7fad58069420 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.496+0000 7fad80600640 1 --2- 172.21.15.173:0/321947441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad7815e040 0x7fad7815ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.496+0000 7fad80600640 1 --2- 172.21.15.173:0/321947441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad7815dc60 0x7fad78151230 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.496+0000 7fad80600640 1 --2- 172.21.15.173:0/321947441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad780ad350 0x7fad781430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.496+0000 7fad80600640 1 -- 172.21.15.173:0/321947441 >> 172.21.15.173:0/321947441 conn(0x7fad7806ac90 msgr2=0x7fad780cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:09.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.496+0000 7fad80600640 1 -- 172.21.15.173:0/321947441 shutdown_connections 2024-04-25T09:09:09.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.496+0000 7fad80600640 1 -- 172.21.15.173:0/321947441 wait complete. 2024-04-25T09:09:09.503 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:07:35.343920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:07:35.976786+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 85, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:09:09.503 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:09:09.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.652+0000 7f39b1c00640 1 Processor -- start 2024-04-25T09:09:09.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.652+0000 7f39b1c00640 1 -- start start 2024-04-25T09:09:09.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.656+0000 7f39b1c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f39ac0cc7e0 0x7f39ac0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.656+0000 7f39b1c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39ac0aef70 0x7f39ac0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.656+0000 7f39b1c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39ac071570 con 0x7f39ac0aeb90 2024-04-25T09:09:09.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.656+0000 7f39b1c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39ac071320 con 0x7f39ac0cc7e0 2024-04-25T09:09:09.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.656+0000 7f39b1c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac072330 con 0x7f39ac0aef70 2024-04-25T09:09:09.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.656+0000 7f39aa000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f39ac0cc7e0 0x7f39ac0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.656+0000 7f39aa000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f39ac0cc7e0 0x7f39ac0cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45434/0 (socket says 172.21.15.173:45434) 2024-04-25T09:09:09.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.656+0000 7f39aa000640 1 -- 172.21.15.173:0/2295056326 learned_addr learned my addr 172.21.15.173:0/2295056326 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:09.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.656+0000 7f39ab400640 1 --2- 172.21.15.173:0/2295056326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39ac0aef70 0x7f39ac0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.656+0000 7f39aa000640 1 -- 172.21.15.173:0/2295056326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39ac0aef70 msgr2=0x7f39ac0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:09.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.656+0000 7f39aa000640 1 --2- 172.21.15.173:0/2295056326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39ac0aef70 0x7f39ac0ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.656+0000 7f39aa000640 1 -- 172.21.15.173:0/2295056326 >> v1:172.21.15.194:6789/0 conn(0x7f39ac0aeb90 legacy=0x7f39ac0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.656+0000 7f39aa000640 1 -- 172.21.15.173:0/2295056326 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac071850 con 0x7f39ac0cc7e0 2024-04-25T09:09:09.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39aa000640 1 --2- 172.21.15.173:0/2295056326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39ac0cc7e0 0x7f39ac0cdba0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f3998009870 tx=0x7f399801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3b3cd26d42b061 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39a9600640 1 -- 172.21.15.173:0/2295056326 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39980b0070 con 0x7f39ac0cc7e0 2024-04-25T09:09:09.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39a9600640 1 -- 172.21.15.173:0/2295056326 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39980ab600 con 0x7f39ac0cc7e0 2024-04-25T09:09:09.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39a9600640 1 -- 172.21.15.173:0/2295056326 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39980ab9d0 con 0x7f39ac0cc7e0 2024-04-25T09:09:09.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39b1c00640 1 -- 172.21.15.173:0/2295056326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39ac0cc7e0 msgr2=0x7f39ac0cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39b1c00640 1 --2- 172.21.15.173:0/2295056326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39ac0cc7e0 0x7f39ac0cdba0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f3998009870 tx=0x7f399801c4d0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39b1c00640 1 -- 172.21.15.173:0/2295056326 shutdown_connections 2024-04-25T09:09:09.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39b1c00640 1 --2- 172.21.15.173:0/2295056326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39ac0aef70 0x7f39ac0ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39b1c00640 1 --2- 172.21.15.173:0/2295056326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39ac0cc7e0 0x7f39ac0cdba0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39b1c00640 1 -- 172.21.15.173:0/2295056326 >> 172.21.15.173:0/2295056326 conn(0x7f39ac06ac90 msgr2=0x7f39ac06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:09.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39b1c00640 1 -- 172.21.15.173:0/2295056326 shutdown_connections 2024-04-25T09:09:09.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39b1c00640 1 -- 172.21.15.173:0/2295056326 wait complete. 2024-04-25T09:09:09.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39b1c00640 1 Processor -- start 2024-04-25T09:09:09.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39b1c00640 1 -- start start 2024-04-25T09:09:09.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39b1c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39ac0aeb90 0x7f39ac0cd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39b1c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39ac0aef70 0x7f39ac13f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39b1c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39ac0cc7e0 0x7f39ac13fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39b1c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac15bb30 con 0x7f39ac0cc7e0 2024-04-25T09:09:09.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39b1c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac15b9b0 con 0x7f39ac0aef70 2024-04-25T09:09:09.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.660+0000 7f39b1c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac15bcb0 con 0x7f39ac0aeb90 2024-04-25T09:09:09.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.664+0000 7f39ab400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39ac0cc7e0 0x7f39ac13fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.664+0000 7f39ab400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39ac0cc7e0 0x7f39ac13fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45440/0 (socket says 172.21.15.173:45440) 2024-04-25T09:09:09.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.664+0000 7f39ab400640 1 -- 172.21.15.173:0/181472469 learned_addr learned my addr 172.21.15.173:0/181472469 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:09.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.664+0000 7f39aaa00640 1 --2- 172.21.15.173:0/181472469 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39ac0aeb90 0x7f39ac0cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.664+0000 7f39aa000640 1 --2- 172.21.15.173:0/181472469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39ac0aef70 0x7f39ac13f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.664+0000 7f39ab400640 1 -- 172.21.15.173:0/181472469 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39ac0aeb90 msgr2=0x7f39ac0cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.664+0000 7f39ab400640 1 --2- 172.21.15.173:0/181472469 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39ac0aeb90 0x7f39ac0cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.664+0000 7f39ab400640 1 -- 172.21.15.173:0/181472469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39ac0aef70 msgr2=0x7f39ac13f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.664+0000 7f39ab400640 1 --2- 172.21.15.173:0/181472469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39ac0aef70 0x7f39ac13f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.664+0000 7f39ab400640 1 -- 172.21.15.173:0/181472469 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac141dd0 con 0x7f39ac0cc7e0 2024-04-25T09:09:09.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.664+0000 7f39ab400640 1 --2- 172.21.15.173:0/181472469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39ac0cc7e0 0x7f39ac13fb80 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f39a400d800 tx=0x7f39a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.664+0000 7f39a2a00640 1 -- 172.21.15.173:0/181472469 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a400b6c0 con 0x7f39ac0cc7e0 2024-04-25T09:09:09.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.664+0000 7f39a2a00640 1 -- 172.21.15.173:0/181472469 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a4019070 con 0x7f39ac0cc7e0 2024-04-25T09:09:09.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.664+0000 7f39a2a00640 1 -- 172.21.15.173:0/181472469 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a400baa0 con 0x7f39ac0cc7e0 2024-04-25T09:09:09.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.664+0000 7f39b1c00640 1 -- 172.21.15.173:0/181472469 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ac151780 con 0x7f39ac0cc7e0 2024-04-25T09:09:09.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.664+0000 7f39b1c00640 1 -- 172.21.15.173:0/181472469 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ac142370 con 0x7f39ac0cc7e0 2024-04-25T09:09:09.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.664+0000 7f39b1c00640 1 -- 172.21.15.173:0/181472469 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39ac073ab0 con 0x7f39ac0cc7e0 2024-04-25T09:09:09.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.664+0000 7f39a2a00640 1 -- 172.21.15.173:0/181472469 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f39a400bc40 con 0x7f39ac0cc7e0 2024-04-25T09:09:09.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.668+0000 7f39a2a00640 1 --2- 172.21.15.173:0/181472469 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f398c066f60 0x7f398c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.668+0000 7f39a2a00640 1 -- 172.21.15.173:0/181472469 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f39a40854d0 con 0x7f39ac0cc7e0 2024-04-25T09:09:09.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.668+0000 7f39aaa00640 1 --2- 172.21.15.173:0/181472469 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f398c066f60 0x7f398c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.668+0000 7f39aaa00640 1 --2- 172.21.15.173:0/181472469 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f398c066f60 0x7f398c069420 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f399c001e00 tx=0x7f399c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.672+0000 7f39a2a00640 1 -- 172.21.15.173:0/181472469 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f39a4055cd0 con 0x7f39ac0cc7e0 2024-04-25T09:09:09.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.828+0000 7f39b1c00640 1 -- 172.21.15.173:0/181472469 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39ac0b46c0 con 0x7f39ac0cc7e0 2024-04-25T09:09:09.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.828+0000 7f39a2a00640 1 -- 172.21.15.173:0/181472469 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39a4059d70 con 0x7f39ac0cc7e0 2024-04-25T09:09:09.816 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:09:09.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.828+0000 7f39b1c00640 1 -- 172.21.15.173:0/181472469 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f398c066f60 msgr2=0x7f398c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.828+0000 7f39b1c00640 1 --2- 172.21.15.173:0/181472469 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f398c066f60 0x7f398c069420 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f399c001e00 tx=0x7f399c009040 comp rx=0 tx=0).stop 2024-04-25T09:09:09.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.828+0000 7f39b1c00640 1 -- 172.21.15.173:0/181472469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39ac0cc7e0 msgr2=0x7f39ac13fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.828+0000 7f39b1c00640 1 --2- 172.21.15.173:0/181472469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39ac0cc7e0 0x7f39ac13fb80 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f39a400d800 tx=0x7f39a400dcc0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.828+0000 7f39b1c00640 1 -- 172.21.15.173:0/181472469 shutdown_connections 2024-04-25T09:09:09.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.828+0000 7f39b1c00640 1 --2- 172.21.15.173:0/181472469 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f398c066f60 0x7f398c069420 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.828+0000 7f39b1c00640 1 --2- 172.21.15.173:0/181472469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39ac0cc7e0 0x7f39ac13fb80 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.828+0000 7f39b1c00640 1 --2- 172.21.15.173:0/181472469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39ac0aef70 0x7f39ac13f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.828+0000 7f39b1c00640 1 --2- 172.21.15.173:0/181472469 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39ac0aeb90 0x7f39ac0cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.828+0000 7f39b1c00640 1 -- 172.21.15.173:0/181472469 >> 172.21.15.173:0/181472469 conn(0x7f39ac06ac90 msgr2=0x7f39ac15c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:09.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.832+0000 7f39b1c00640 1 -- 172.21.15.173:0/181472469 shutdown_connections 2024-04-25T09:09:09.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.832+0000 7f39b1c00640 1 -- 172.21.15.173:0/181472469 wait complete. 2024-04-25T09:09:09.838 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:09:09.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.988+0000 7f21c4400640 1 Processor -- start 2024-04-25T09:09:09.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.988+0000 7f21c4400640 1 -- start start 2024-04-25T09:09:09.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.988+0000 7f21c4400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f21bc0cc7e0 0x7f21bc0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.988+0000 7f21c4400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f21bc0aef70 0x7f21bc0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.988+0000 7f21c4400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21bc071570 con 0x7f21bc0aeb90 2024-04-25T09:09:09.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.988+0000 7f21c4400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc071320 con 0x7f21bc0aef70 2024-04-25T09:09:09.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.988+0000 7f21c4400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc072330 con 0x7f21bc0cc7e0 2024-04-25T09:09:09.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.988+0000 7f21c2400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f21bc0aef70 0x7f21bc0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.988+0000 7f21c2400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f21bc0aef70 0x7f21bc0ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45444/0 (socket says 172.21.15.173:45444) 2024-04-25T09:09:09.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.988+0000 7f21c2400640 1 -- 172.21.15.173:0/4222033745 learned_addr learned my addr 172.21.15.173:0/4222033745 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:09.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.988+0000 7f21c1000640 1 --2- 172.21.15.173:0/4222033745 >> v2:172.21.15.194:3300/0 conn(0x7f21bc0cc7e0 0x7f21bc0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.992+0000 7f21c2400640 1 -- 172.21.15.173:0/4222033745 >> v2:172.21.15.194:3300/0 conn(0x7f21bc0cc7e0 msgr2=0x7f21bc0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:09.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.992+0000 7f21c2400640 1 --2- 172.21.15.173:0/4222033745 >> v2:172.21.15.194:3300/0 conn(0x7f21bc0cc7e0 0x7f21bc0cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.992+0000 7f21c2400640 1 -- 172.21.15.173:0/4222033745 >> v1:172.21.15.194:6789/0 conn(0x7f21bc0aeb90 legacy=0x7f21bc0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.992+0000 7f21c2400640 1 -- 172.21.15.173:0/4222033745 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc071850 con 0x7f21bc0aef70 2024-04-25T09:09:09.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.992+0000 7f21bbe00640 1 -- 172.21.15.173:0/4222033745 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143825834 0 0) 0x7f21bc071570 con 0x7f21bc0aeb90 2024-04-25T09:09:09.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.992+0000 7f21c2400640 1 --2- 172.21.15.173:0/4222033745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21bc0aef70 0x7f21bc0ce0e0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0cd960 tx=0x7f21b401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a403c17955734f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.992+0000 7f21bbe00640 1 -- 172.21.15.173:0/4222033745 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b40a5610 con 0x7f21bc0aef70 2024-04-25T09:09:09.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.992+0000 7f21bbe00640 1 -- 172.21.15.173:0/4222033745 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b40a57b0 con 0x7f21bc0aef70 2024-04-25T09:09:09.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.992+0000 7f21bbe00640 1 -- 172.21.15.173:0/4222033745 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b40a5b80 con 0x7f21bc0aef70 2024-04-25T09:09:09.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.992+0000 7f21c4400640 1 -- 172.21.15.173:0/4222033745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21bc0aef70 msgr2=0x7f21bc0ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.992+0000 7f21c4400640 1 --2- 172.21.15.173:0/4222033745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21bc0aef70 0x7f21bc0ce0e0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0cd960 tx=0x7f21b401c960 comp rx=0 tx=0).stop 2024-04-25T09:09:09.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c4400640 1 -- 172.21.15.173:0/4222033745 shutdown_connections 2024-04-25T09:09:09.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c4400640 1 --2- 172.21.15.173:0/4222033745 >> v2:172.21.15.194:3300/0 conn(0x7f21bc0cc7e0 0x7f21bc0cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c4400640 1 --2- 172.21.15.173:0/4222033745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21bc0aef70 0x7f21bc0ce0e0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c4400640 1 -- 172.21.15.173:0/4222033745 >> 172.21.15.173:0/4222033745 conn(0x7f21bc06ac90 msgr2=0x7f21bc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:09.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c4400640 1 -- 172.21.15.173:0/4222033745 shutdown_connections 2024-04-25T09:09:09.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c4400640 1 -- 172.21.15.173:0/4222033745 wait complete. 2024-04-25T09:09:09.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c4400640 1 Processor -- start 2024-04-25T09:09:09.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c4400640 1 -- start start 2024-04-25T09:09:09.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c4400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21bc0aeb90 0x7f21bc14b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c4400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21bc0aef70 0x7f21bc14acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c4400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21bc0cc7e0 0x7f21bc145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c4400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc15bb30 con 0x7f21bc0aeb90 2024-04-25T09:09:09.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c4400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc15b9b0 con 0x7f21bc0cc7e0 2024-04-25T09:09:09.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c4400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc15bcb0 con 0x7f21bc0aef70 2024-04-25T09:09:09.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c1a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21bc0aeb90 0x7f21bc14b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c1a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21bc0aeb90 0x7f21bc14b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45452/0 (socket says 172.21.15.173:45452) 2024-04-25T09:09:09.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c1a00640 1 -- 172.21.15.173:0/2023384417 learned_addr learned my addr 172.21.15.173:0/2023384417 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:09.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c2400640 1 --2- 172.21.15.173:0/2023384417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21bc0cc7e0 0x7f21bc145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c1000640 1 --2- 172.21.15.173:0/2023384417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21bc0aef70 0x7f21bc14acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c1a00640 1 -- 172.21.15.173:0/2023384417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21bc0aef70 msgr2=0x7f21bc14acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c1a00640 1 --2- 172.21.15.173:0/2023384417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21bc0aef70 0x7f21bc14acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c1a00640 1 -- 172.21.15.173:0/2023384417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21bc0cc7e0 msgr2=0x7f21bc145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c1a00640 1 --2- 172.21.15.173:0/2023384417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21bc0cc7e0 0x7f21bc145480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c1a00640 1 -- 172.21.15.173:0/2023384417 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc14ece0 con 0x7f21bc0aeb90 2024-04-25T09:09:09.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:09.996+0000 7f21c1a00640 1 --2- 172.21.15.173:0/2023384417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21bc0aeb90 0x7f21bc14b6a0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f21b000c420 tx=0x7f21b000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.000+0000 7f21b9600640 1 -- 172.21.15.173:0/2023384417 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0017070 con 0x7f21bc0aeb90 2024-04-25T09:09:09.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.000+0000 7f21b9600640 1 -- 172.21.15.173:0/2023384417 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b00052f0 con 0x7f21bc0aeb90 2024-04-25T09:09:09.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.000+0000 7f21b9600640 1 -- 172.21.15.173:0/2023384417 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0003860 con 0x7f21bc0aeb90 2024-04-25T09:09:09.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.000+0000 7f21c4400640 1 -- 172.21.15.173:0/2023384417 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21bc14efc0 con 0x7f21bc0aeb90 2024-04-25T09:09:09.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.000+0000 7f21c4400640 1 -- 172.21.15.173:0/2023384417 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21bc14f580 con 0x7f21bc0aeb90 2024-04-25T09:09:09.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.000+0000 7f21c4400640 1 -- 172.21.15.173:0/2023384417 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21bc06f1f0 con 0x7f21bc0aeb90 2024-04-25T09:09:09.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.000+0000 7f21b9600640 1 -- 172.21.15.173:0/2023384417 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f21b001a070 con 0x7f21bc0aeb90 2024-04-25T09:09:09.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.000+0000 7f21b9600640 1 --2- 172.21.15.173:0/2023384417 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f219c066f60 0x7f219c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.000+0000 7f21b9600640 1 -- 172.21.15.173:0/2023384417 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f21b00844f0 con 0x7f21bc0aeb90 2024-04-25T09:09:09.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.000+0000 7f21c1000640 1 --2- 172.21.15.173:0/2023384417 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f219c066f60 0x7f219c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.004+0000 7f21c1000640 1 --2- 172.21.15.173:0/2023384417 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f219c066f60 0x7f219c069420 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f21bc14a710 tx=0x7f21a8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.004+0000 7f21b9600640 1 -- 172.21.15.173:0/2023384417 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f21b0054cf0 con 0x7f21bc0aeb90 2024-04-25T09:09:10.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.160+0000 7f21c4400640 1 -- 172.21.15.173:0/2023384417 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21bc0ae400 con 0x7f21bc0aeb90 2024-04-25T09:09:10.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.160+0000 7f21b9600640 1 -- 172.21.15.173:0/2023384417 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21b0058d90 con 0x7f21bc0aeb90 2024-04-25T09:09:10.148 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:09:10.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.160+0000 7f21c4400640 1 -- 172.21.15.173:0/2023384417 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f219c066f60 msgr2=0x7f219c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.160+0000 7f21c4400640 1 --2- 172.21.15.173:0/2023384417 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f219c066f60 0x7f219c069420 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f21bc14a710 tx=0x7f21a8009190 comp rx=0 tx=0).stop 2024-04-25T09:09:10.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.160+0000 7f21c4400640 1 -- 172.21.15.173:0/2023384417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21bc0aeb90 msgr2=0x7f21bc14b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.160+0000 7f21c4400640 1 --2- 172.21.15.173:0/2023384417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21bc0aeb90 0x7f21bc14b6a0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f21b000c420 tx=0x7f21b000c8e0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.160+0000 7f21c4400640 1 -- 172.21.15.173:0/2023384417 shutdown_connections 2024-04-25T09:09:10.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.160+0000 7f21c4400640 1 --2- 172.21.15.173:0/2023384417 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f219c066f60 0x7f219c069420 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.160+0000 7f21c4400640 1 --2- 172.21.15.173:0/2023384417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21bc0cc7e0 0x7f21bc145480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.160+0000 7f21c4400640 1 --2- 172.21.15.173:0/2023384417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21bc0aef70 0x7f21bc14acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.160+0000 7f21c4400640 1 --2- 172.21.15.173:0/2023384417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21bc0aeb90 0x7f21bc14b6a0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.160+0000 7f21c4400640 1 -- 172.21.15.173:0/2023384417 >> 172.21.15.173:0/2023384417 conn(0x7f21bc06ac90 msgr2=0x7f21bc06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:10.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.160+0000 7f21c4400640 1 -- 172.21.15.173:0/2023384417 shutdown_connections 2024-04-25T09:09:10.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.160+0000 7f21c4400640 1 -- 172.21.15.173:0/2023384417 wait complete. 2024-04-25T09:09:10.169 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:09:10.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.320+0000 7fb20ee00640 1 Processor -- start 2024-04-25T09:09:10.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.320+0000 7fb20ee00640 1 -- start start 2024-04-25T09:09:10.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.320+0000 7fb20ee00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb208145290 0x7fb20815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.320+0000 7fb20ee00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb2080b3fe0 0x7fb2080b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.320+0000 7fb20ee00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20815c5f0 con 0x7fb2080cc260 2024-04-25T09:09:10.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.320+0000 7fb20ee00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2080ccd80 con 0x7fb2080b3fe0 2024-04-25T09:09:10.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.320+0000 7fb20ee00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20806d4b0 con 0x7fb208145290 2024-04-25T09:09:10.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.320+0000 7fb207400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb2080b3fe0 0x7fb2080b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.320+0000 7fb207400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb2080b3fe0 0x7fb2080b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45468/0 (socket says 172.21.15.173:45468) 2024-04-25T09:09:10.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.320+0000 7fb207400640 1 -- 172.21.15.173:0/2329170639 learned_addr learned my addr 172.21.15.173:0/2329170639 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:10.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.320+0000 7fb207e00640 1 --2- 172.21.15.173:0/2329170639 >> v2:172.21.15.194:3300/0 conn(0x7fb208145290 0x7fb20815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.320+0000 7fb207400640 1 -- 172.21.15.173:0/2329170639 >> v2:172.21.15.194:3300/0 conn(0x7fb208145290 msgr2=0x7fb20815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:10.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.320+0000 7fb207400640 1 --2- 172.21.15.173:0/2329170639 >> v2:172.21.15.194:3300/0 conn(0x7fb208145290 0x7fb20815c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.320+0000 7fb207400640 1 -- 172.21.15.173:0/2329170639 >> v1:172.21.15.194:6789/0 conn(0x7fb2080cc260 legacy=0x7fb2080cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.320+0000 7fb207400640 1 -- 172.21.15.173:0/2329170639 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20806d790 con 0x7fb2080b3fe0 2024-04-25T09:09:10.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.324+0000 7fb207400640 1 --2- 172.21.15.173:0/2329170639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2080b3fe0 0x7fb2080b4450 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fb2080d0800 tx=0x7fb1f401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2443fe2f496243 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:10.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.324+0000 7fb206a00640 1 -- 172.21.15.173:0/2329170639 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40b1070 con 0x7fb2080b3fe0 2024-04-25T09:09:10.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.324+0000 7fb206a00640 1 -- 172.21.15.173:0/2329170639 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f40ac640 con 0x7fb2080b3fe0 2024-04-25T09:09:10.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.324+0000 7fb206a00640 1 -- 172.21.15.173:0/2329170639 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40aca10 con 0x7fb2080b3fe0 2024-04-25T09:09:10.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.324+0000 7fb20ee00640 1 -- 172.21.15.173:0/2329170639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2080b3fe0 msgr2=0x7fb2080b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.324+0000 7fb20ee00640 1 --2- 172.21.15.173:0/2329170639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2080b3fe0 0x7fb2080b4450 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fb2080d0800 tx=0x7fb1f401c400 comp rx=0 tx=0).stop 2024-04-25T09:09:10.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.324+0000 7fb20ee00640 1 -- 172.21.15.173:0/2329170639 shutdown_connections 2024-04-25T09:09:10.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.324+0000 7fb20ee00640 1 --2- 172.21.15.173:0/2329170639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2080b3fe0 0x7fb2080b4450 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.324+0000 7fb20ee00640 1 --2- 172.21.15.173:0/2329170639 >> v2:172.21.15.194:3300/0 conn(0x7fb208145290 0x7fb20815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.324+0000 7fb20ee00640 1 -- 172.21.15.173:0/2329170639 >> 172.21.15.173:0/2329170639 conn(0x7fb20806ac90 msgr2=0x7fb20806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:10.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.324+0000 7fb20ee00640 1 -- 172.21.15.173:0/2329170639 shutdown_connections 2024-04-25T09:09:10.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.324+0000 7fb20ee00640 1 -- 172.21.15.173:0/2329170639 wait complete. 2024-04-25T09:09:10.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.324+0000 7fb20ee00640 1 Processor -- start 2024-04-25T09:09:10.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.324+0000 7fb20ee00640 1 -- start start 2024-04-25T09:09:10.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb20ee00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2080b3fe0 0x7fb208130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb20ee00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2080cc260 0x7fb2080ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb20ee00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb208145290 0x7fb2080ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb20ee00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2081457f0 con 0x7fb2080b3fe0 2024-04-25T09:09:10.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb20ee00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb208145670 con 0x7fb208145290 2024-04-25T09:09:10.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb20ee00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20806ed60 con 0x7fb2080cc260 2024-04-25T09:09:10.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb207e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2080b3fe0 0x7fb208130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb207e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2080b3fe0 0x7fb208130f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45472/0 (socket says 172.21.15.173:45472) 2024-04-25T09:09:10.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb207e00640 1 -- 172.21.15.173:0/3728101237 learned_addr learned my addr 172.21.15.173:0/3728101237 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:10.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb207400640 1 --2- 172.21.15.173:0/3728101237 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2080cc260 0x7fb2080ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb20ce00640 1 --2- 172.21.15.173:0/3728101237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb208145290 0x7fb2080ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb207e00640 1 -- 172.21.15.173:0/3728101237 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2080cc260 msgr2=0x7fb2080ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb207e00640 1 --2- 172.21.15.173:0/3728101237 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2080cc260 0x7fb2080ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb207e00640 1 -- 172.21.15.173:0/3728101237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb208145290 msgr2=0x7fb2080ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb207e00640 1 --2- 172.21.15.173:0/3728101237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb208145290 0x7fb2080ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb207e00640 1 -- 172.21.15.173:0/3728101237 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2080ad280 con 0x7fb2080b3fe0 2024-04-25T09:09:10.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb207e00640 1 --2- 172.21.15.173:0/3728101237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2080b3fe0 0x7fb208130f20 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800d5f0 tx=0x7fb1f800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:10.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb1ffe00640 1 -- 172.21.15.173:0/3728101237 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f80125f0 con 0x7fb2080b3fe0 2024-04-25T09:09:10.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb1ffe00640 1 -- 172.21.15.173:0/3728101237 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f8019070 con 0x7fb2080b3fe0 2024-04-25T09:09:10.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb1ffe00640 1 -- 172.21.15.173:0/3728101237 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f80129d0 con 0x7fb2080b3fe0 2024-04-25T09:09:10.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb20ee00640 1 -- 172.21.15.173:0/3728101237 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2080ad560 con 0x7fb2080b3fe0 2024-04-25T09:09:10.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb20ee00640 1 -- 172.21.15.173:0/3728101237 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2080adb20 con 0x7fb2080b3fe0 2024-04-25T09:09:10.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.328+0000 7fb20ee00640 1 -- 172.21.15.173:0/3728101237 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb208073ab0 con 0x7fb2080b3fe0 2024-04-25T09:09:10.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.332+0000 7fb1ffe00640 1 -- 172.21.15.173:0/3728101237 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb1f8012b70 con 0x7fb2080b3fe0 2024-04-25T09:09:10.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.332+0000 7fb1ffe00640 1 --2- 172.21.15.173:0/3728101237 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb1e8066f60 0x7fb1e8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.332+0000 7fb1ffe00640 1 -- 172.21.15.173:0/3728101237 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7fb1f80857c0 con 0x7fb2080b3fe0 2024-04-25T09:09:10.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.332+0000 7fb207400640 1 --2- 172.21.15.173:0/3728101237 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb1e8066f60 0x7fb1e8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.332+0000 7fb207400640 1 --2- 172.21.15.173:0/3728101237 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb1e8066f60 0x7fb1e8069420 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40ae000 tx=0x7fb1f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.336+0000 7fb1ffe00640 1 -- 172.21.15.173:0/3728101237 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb1f80564f0 con 0x7fb2080b3fe0 2024-04-25T09:09:10.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.488+0000 7fb20ee00640 1 -- 172.21.15.173:0/3728101237 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb208131460 con 0x7fb2080b3fe0 2024-04-25T09:09:10.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.488+0000 7fb1ffe00640 1 -- 172.21.15.173:0/3728101237 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb1f8055df0 con 0x7fb2080b3fe0 2024-04-25T09:09:10.479 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:09:10.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.492+0000 7fb20ee00640 1 -- 172.21.15.173:0/3728101237 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb1e8066f60 msgr2=0x7fb1e8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.492+0000 7fb20ee00640 1 --2- 172.21.15.173:0/3728101237 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb1e8066f60 0x7fb1e8069420 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40ae000 tx=0x7fb1f4008040 comp rx=0 tx=0).stop 2024-04-25T09:09:10.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.492+0000 7fb20ee00640 1 -- 172.21.15.173:0/3728101237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2080b3fe0 msgr2=0x7fb208130f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.492+0000 7fb20ee00640 1 --2- 172.21.15.173:0/3728101237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2080b3fe0 0x7fb208130f20 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800d5f0 tx=0x7fb1f800dab0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.492+0000 7fb20ee00640 1 -- 172.21.15.173:0/3728101237 shutdown_connections 2024-04-25T09:09:10.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.492+0000 7fb20ee00640 1 --2- 172.21.15.173:0/3728101237 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb1e8066f60 0x7fb1e8069420 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.492+0000 7fb20ee00640 1 --2- 172.21.15.173:0/3728101237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb208145290 0x7fb2080ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.492+0000 7fb20ee00640 1 --2- 172.21.15.173:0/3728101237 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2080cc260 0x7fb2080ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.492+0000 7fb20ee00640 1 --2- 172.21.15.173:0/3728101237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2080b3fe0 0x7fb208130f20 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.492+0000 7fb20ee00640 1 -- 172.21.15.173:0/3728101237 >> 172.21.15.173:0/3728101237 conn(0x7fb20806ac90 msgr2=0x7fb2080ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:10.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.492+0000 7fb20ee00640 1 -- 172.21.15.173:0/3728101237 shutdown_connections 2024-04-25T09:09:10.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.492+0000 7fb20ee00640 1 -- 172.21.15.173:0/3728101237 wait complete. 2024-04-25T09:09:10.500 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:09:10.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f526d800640 1 Processor -- start 2024-04-25T09:09:10.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f526d800640 1 -- start start 2024-04-25T09:09:10.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f526d800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f52680ce6d0 0x7f526815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f526d800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52680cc730 con 0x7f5268160100 2024-04-25T09:09:10.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f526d800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526815bfe0 con 0x7f5268155ea0 2024-04-25T09:09:10.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f526d800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52680cc4f0 con 0x7f52680ce6d0 2024-04-25T09:09:10.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f525e000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f5268160100 0x7f52680cdfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:51290/0 (socket says 172.21.15.173:51290) 2024-04-25T09:09:10.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f525e000640 1 -- 172.21.15.173:0/377743578 learned_addr learned my addr 172.21.15.173:0/377743578 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:10.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f5267400640 1 --2- 172.21.15.173:0/377743578 >> v2:172.21.15.194:3300/0 conn(0x7f52680ce6d0 0x7f526815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f5266000640 1 -- 172.21.15.173:0/377743578 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184050509 0 0) 0x7f52680cc730 con 0x7f5268160100 2024-04-25T09:09:10.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f5266000640 1 -- 172.21.15.173:0/377743578 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f524c003530 con 0x7f5268160100 2024-04-25T09:09:10.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f5266000640 1 -- 172.21.15.173:0/377743578 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1365410824 0 0) 0x7f524c003530 con 0x7f5268160100 2024-04-25T09:09:10.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f5266000640 1 -- 172.21.15.173:0/377743578 >> v2:172.21.15.194:3300/0 conn(0x7f52680ce6d0 msgr2=0x7f526815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:10.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f5266000640 1 --2- 172.21.15.173:0/377743578 >> v2:172.21.15.194:3300/0 conn(0x7f52680ce6d0 0x7f526815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f5266000640 1 -- 172.21.15.173:0/377743578 >> v1:172.21.15.194:6789/0 conn(0x7f5268155ea0 legacy=0x7f52680cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f5266000640 1 -- 172.21.15.173:0/377743578 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526815c2c0 con 0x7f5268160100 2024-04-25T09:09:10.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f5266000640 1 -- 172.21.15.173:0/377743578 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f5250001680 con 0x7f5268160100 2024-04-25T09:09:10.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f5266000640 1 -- 172.21.15.173:0/377743578 >> v1:172.21.15.173:6789/0 conn(0x7f5268160100 legacy=0x7f52680cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f5266000640 1 --2- 172.21.15.173:0/377743578 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f524c0039c0 0x7f524c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f5266000640 1 --2- 172.21.15.173:0/377743578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f524c004810 0x7f524c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f5266000640 1 --2- 172.21.15.173:0/377743578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f524c0051d0 0x7f524c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f5266000640 1 -- 172.21.15.173:0/377743578 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680cc4f0 con 0x7f524c004810 2024-04-25T09:09:10.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f5266000640 1 -- 172.21.15.173:0/377743578 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c00c070 con 0x7f524c0051d0 2024-04-25T09:09:10.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.648+0000 7f5266000640 1 -- 172.21.15.173:0/377743578 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524c00c270 con 0x7f524c0039c0 2024-04-25T09:09:10.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.652+0000 7f525e000640 1 --2- 172.21.15.173:0/377743578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f524c004810 0x7f524c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.652+0000 7f5266a00640 1 --2- 172.21.15.173:0/377743578 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f524c0039c0 0x7f524c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.652+0000 7f5267400640 1 --2- 172.21.15.173:0/377743578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f524c0051d0 0x7f524c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.652+0000 7f525e000640 1 -- 172.21.15.173:0/377743578 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f524c0039c0 msgr2=0x7f524c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:10.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.652+0000 7f525e000640 1 --2- 172.21.15.173:0/377743578 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f524c0039c0 0x7f524c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.652+0000 7f525e000640 1 -- 172.21.15.173:0/377743578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f524c0051d0 msgr2=0x7f524c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:10.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.652+0000 7f525e000640 1 --2- 172.21.15.173:0/377743578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f524c0051d0 0x7f524c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.652+0000 7f525e000640 1 -- 172.21.15.173:0/377743578 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c003530 con 0x7f524c004810 2024-04-25T09:09:10.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.652+0000 7f5267400640 1 -- 172.21.15.173:0/377743578 reap_dead start 2024-04-25T09:09:10.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.652+0000 7f525e000640 1 --2- 172.21.15.173:0/377743578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f524c004810 0x7f524c004c90 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f525000c190 tx=0x7f525001f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f2dc719f022579 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:10.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.652+0000 7f5266000640 1 -- 172.21.15.173:0/377743578 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250007d00 con 0x7f524c004810 2024-04-25T09:09:10.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.652+0000 7f5266000640 1 -- 172.21.15.173:0/377743578 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5250005b00 con 0x7f524c004810 2024-04-25T09:09:10.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.652+0000 7f5266000640 1 -- 172.21.15.173:0/377743578 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250007070 con 0x7f524c004810 2024-04-25T09:09:10.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.652+0000 7f526d800640 1 -- 172.21.15.173:0/377743578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f524c004810 msgr2=0x7f524c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.652+0000 7f526d800640 1 --2- 172.21.15.173:0/377743578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f524c004810 0x7f524c004c90 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f525000c190 tx=0x7f525001f310 comp rx=0 tx=0).stop 2024-04-25T09:09:10.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f526d800640 1 -- 172.21.15.173:0/377743578 shutdown_connections 2024-04-25T09:09:10.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f526d800640 1 --2- 172.21.15.173:0/377743578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f524c004810 0x7f524c004c90 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f526d800640 1 -- 172.21.15.173:0/377743578 >> 172.21.15.173:0/377743578 conn(0x7f52680b3460 msgr2=0x7f52680b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:10.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f526d800640 1 -- 172.21.15.173:0/377743578 shutdown_connections 2024-04-25T09:09:10.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f526d800640 1 -- 172.21.15.173:0/377743578 wait complete. 2024-04-25T09:09:10.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f526d800640 1 Processor -- start 2024-04-25T09:09:10.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f526d800640 1 -- start start 2024-04-25T09:09:10.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f526d800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f524c004810 0x7f52680cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f526d800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52680b6660 0x7f5268146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f526d800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52680b6ae0 0x7f5268147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f526d800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680cca10 con 0x7f52680b6ae0 2024-04-25T09:09:10.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f526d800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5268156280 con 0x7f524c004810 2024-04-25T09:09:10.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f526d800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52680ccb90 con 0x7f52680b6660 2024-04-25T09:09:10.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f5267400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52680b6ae0 0x7f5268147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f5267400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52680b6ae0 0x7f5268147090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45496/0 (socket says 172.21.15.173:45496) 2024-04-25T09:09:10.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f5267400640 1 -- 172.21.15.173:0/3018806771 learned_addr learned my addr 172.21.15.173:0/3018806771 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:10.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f525e000640 1 --2- 172.21.15.173:0/3018806771 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52680b6660 0x7f5268146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f5266a00640 1 --2- 172.21.15.173:0/3018806771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f524c004810 0x7f52680cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f5267400640 1 -- 172.21.15.173:0/3018806771 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52680b6660 msgr2=0x7f5268146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f5267400640 1 --2- 172.21.15.173:0/3018806771 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52680b6660 0x7f5268146b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f5267400640 1 -- 172.21.15.173:0/3018806771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f524c004810 msgr2=0x7f52680cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f5267400640 1 --2- 172.21.15.173:0/3018806771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f524c004810 0x7f52680cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f5267400640 1 -- 172.21.15.173:0/3018806771 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52681f6e70 con 0x7f52680b6ae0 2024-04-25T09:09:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f525e000640 1 --2- 172.21.15.173:0/3018806771 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52680b6660 0x7f5268146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f5266a00640 1 --2- 172.21.15.173:0/3018806771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f524c004810 0x7f52680cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f5267400640 1 --2- 172.21.15.173:0/3018806771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52680b6ae0 0x7f5268147090 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f52680b7010 tx=0x7f5260011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f525f400640 1 -- 172.21.15.173:0/3018806771 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260019020 con 0x7f52680b6ae0 2024-04-25T09:09:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f525f400640 1 -- 172.21.15.173:0/3018806771 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5260004030 con 0x7f52680b6ae0 2024-04-25T09:09:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f526d800640 1 -- 172.21.15.173:0/3018806771 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52681f7110 con 0x7f52680b6ae0 2024-04-25T09:09:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.656+0000 7f525f400640 1 -- 172.21.15.173:0/3018806771 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260004400 con 0x7f52680b6ae0 2024-04-25T09:09:10.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.660+0000 7f526d800640 1 -- 172.21.15.173:0/3018806771 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52681f76d0 con 0x7f52680b6ae0 2024-04-25T09:09:10.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.660+0000 7f526d800640 1 -- 172.21.15.173:0/3018806771 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5268073ab0 con 0x7f52680b6ae0 2024-04-25T09:09:10.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.660+0000 7f525f400640 1 -- 172.21.15.173:0/3018806771 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f526001c020 con 0x7f52680b6ae0 2024-04-25T09:09:10.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.660+0000 7f525f400640 1 --2- 172.21.15.173:0/3018806771 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5244066f60 0x7f5244069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.660+0000 7f525f400640 1 -- 172.21.15.173:0/3018806771 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f5260085860 con 0x7f52680b6ae0 2024-04-25T09:09:10.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.660+0000 7f5266a00640 1 --2- 172.21.15.173:0/3018806771 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5244066f60 0x7f5244069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.660+0000 7f5266a00640 1 --2- 172.21.15.173:0/3018806771 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5244066f60 0x7f5244069420 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5258000f90 tx=0x7f5258009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:10.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.664+0000 7f525f400640 1 -- 172.21.15.173:0/3018806771 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5260023020 con 0x7f52680b6ae0 2024-04-25T09:09:10.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.832+0000 7f526d800640 1 -- 172.21.15.173:0/3018806771 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f52680cf030 con 0x7f52680b6ae0 2024-04-25T09:09:10.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.832+0000 7f525f400640 1 -- 172.21.15.173:0/3018806771 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v86) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5260012330 con 0x7f52680b6ae0 2024-04-25T09:09:10.823 INFO:teuthology.orchestra.run.smithi173.stderr:listed 0 entries 2024-04-25T09:09:10.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.836+0000 7f526d800640 1 -- 172.21.15.173:0/3018806771 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5244066f60 msgr2=0x7f5244069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.836+0000 7f526d800640 1 --2- 172.21.15.173:0/3018806771 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5244066f60 0x7f5244069420 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5258000f90 tx=0x7f5258009040 comp rx=0 tx=0).stop 2024-04-25T09:09:10.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.836+0000 7f526d800640 1 -- 172.21.15.173:0/3018806771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52680b6ae0 msgr2=0x7f5268147090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.836+0000 7f526d800640 1 --2- 172.21.15.173:0/3018806771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52680b6ae0 0x7f5268147090 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f52680b7010 tx=0x7f5260011cf0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.836+0000 7f526d800640 1 -- 172.21.15.173:0/3018806771 shutdown_connections 2024-04-25T09:09:10.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.836+0000 7f526d800640 1 --2- 172.21.15.173:0/3018806771 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5244066f60 0x7f5244069420 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.836+0000 7f526d800640 1 --2- 172.21.15.173:0/3018806771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52680b6ae0 0x7f5268147090 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.836+0000 7f526d800640 1 --2- 172.21.15.173:0/3018806771 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52680b6660 0x7f5268146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.836+0000 7f526d800640 1 --2- 172.21.15.173:0/3018806771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f524c004810 0x7f52680cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.836+0000 7f526d800640 1 -- 172.21.15.173:0/3018806771 >> 172.21.15.173:0/3018806771 conn(0x7f52680b3460 msgr2=0x7f52680b72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:10.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.836+0000 7f526d800640 1 -- 172.21.15.173:0/3018806771 shutdown_connections 2024-04-25T09:09:10.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:10.836+0000 7f526d800640 1 -- 172.21.15.173:0/3018806771 wait complete. 2024-04-25T09:09:10.844 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:09:10.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:10.844 DEBUG:teuthology.orchestra.run.smithi173:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:09:10.878 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:09:10.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:10.878 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:09:10.931 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:09:10.931 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:10.940 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:09:10.940 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:09:10.940 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:10.982 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:09:10.982 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:09:10.982 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:10.991 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:09:10.991 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:11.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.168+0000 7f74d1800640 1 Processor -- start 2024-04-25T09:09:11.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.168+0000 7f74d1800640 1 -- start start 2024-04-25T09:09:11.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.168+0000 7f74d1800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74cc0cc8b0 0x7f74cc0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.168+0000 7f74d1800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f74cc0ce8f0 0x7f74cc0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.168+0000 7f74d1800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74cc06e7c0 con 0x7f74cc145250 2024-04-25T09:09:11.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.168+0000 7f74d1800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74cc06d720 con 0x7f74cc0ce8f0 2024-04-25T09:09:11.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.168+0000 7f74d1800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc06da00 con 0x7f74cc0cc8b0 2024-04-25T09:09:11.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.168+0000 7f74caa00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f74cc145250 0x7f74cc15c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:51294/0 (socket says 172.21.15.173:51294) 2024-04-25T09:09:11.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.168+0000 7f74caa00640 1 -- 172.21.15.173:0/197678287 learned_addr learned my addr 172.21.15.173:0/197678287 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:11.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.168+0000 7f74cb400640 1 --2- 172.21.15.173:0/197678287 >> v2:172.21.15.173:3300/0 conn(0x7f74cc0ce8f0 0x7f74cc0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.168+0000 7f74c2000640 1 --2- 172.21.15.173:0/197678287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74cc0cc8b0 0x7f74cc0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.172+0000 7f74ca000640 1 -- 172.21.15.173:0/197678287 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960281392 0 0) 0x7f74cc06e7c0 con 0x7f74cc145250 2024-04-25T09:09:11.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.172+0000 7f74ca000640 1 -- 172.21.15.173:0/197678287 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74b0003530 con 0x7f74cc145250 2024-04-25T09:09:11.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.172+0000 7f74cb400640 1 -- 172.21.15.173:0/197678287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74cc0cc8b0 msgr2=0x7f74cc0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:11.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.172+0000 7f74cb400640 1 --2- 172.21.15.173:0/197678287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74cc0cc8b0 0x7f74cc0ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.172+0000 7f74cb400640 1 -- 172.21.15.173:0/197678287 >> v1:172.21.15.173:6789/0 conn(0x7f74cc145250 legacy=0x7f74cc15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.172+0000 7f74cb400640 1 -- 172.21.15.173:0/197678287 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc06dce0 con 0x7f74cc0ce8f0 2024-04-25T09:09:11.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.172+0000 7f74cb400640 1 --2- 172.21.15.173:0/197678287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74cc0ce8f0 0x7f74cc0ced60 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009d90 tx=0x7f74c401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f114173cf8e617 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.172+0000 7f74ca000640 1 -- 172.21.15.173:0/197678287 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c40b2070 con 0x7f74cc0ce8f0 2024-04-25T09:09:11.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.172+0000 7f74ca000640 1 -- 172.21.15.173:0/197678287 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c40a5920 con 0x7f74cc0ce8f0 2024-04-25T09:09:11.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.172+0000 7f74ca000640 1 -- 172.21.15.173:0/197678287 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c40a5cf0 con 0x7f74cc0ce8f0 2024-04-25T09:09:11.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.172+0000 7f74d1800640 1 -- 172.21.15.173:0/197678287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74cc0ce8f0 msgr2=0x7f74cc0ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.172+0000 7f74d1800640 1 --2- 172.21.15.173:0/197678287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74cc0ce8f0 0x7f74cc0ced60 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009d90 tx=0x7f74c401c970 comp rx=0 tx=0).stop 2024-04-25T09:09:11.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.172+0000 7f74d1800640 1 -- 172.21.15.173:0/197678287 shutdown_connections 2024-04-25T09:09:11.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.172+0000 7f74d1800640 1 --2- 172.21.15.173:0/197678287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74cc0ce8f0 0x7f74cc0ced60 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.172+0000 7f74d1800640 1 --2- 172.21.15.173:0/197678287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74cc0cc8b0 0x7f74cc0ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.172+0000 7f74d1800640 1 -- 172.21.15.173:0/197678287 >> 172.21.15.173:0/197678287 conn(0x7f74cc06ac90 msgr2=0x7f74cc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:11.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.172+0000 7f74d1800640 1 -- 172.21.15.173:0/197678287 shutdown_connections 2024-04-25T09:09:11.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.172+0000 7f74d1800640 1 -- 172.21.15.173:0/197678287 wait complete. 2024-04-25T09:09:11.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74d1800640 1 Processor -- start 2024-04-25T09:09:11.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74d1800640 1 -- start start 2024-04-25T09:09:11.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74d1800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74cc0cc8b0 0x7f74cc13d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74d1800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74cc0ce8f0 0x7f74cc140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74d1800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74cc145250 0x7f74cc141070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74d1800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc06d380 con 0x7f74cc145250 2024-04-25T09:09:11.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74d1800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc06ef80 con 0x7f74cc0cc8b0 2024-04-25T09:09:11.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74d1800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc06d500 con 0x7f74cc0ce8f0 2024-04-25T09:09:11.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74cb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74cc145250 0x7f74cc141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74cb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74cc145250 0x7f74cc141070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45510/0 (socket says 172.21.15.173:45510) 2024-04-25T09:09:11.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74cb400640 1 -- 172.21.15.173:0/2493492097 learned_addr learned my addr 172.21.15.173:0/2493492097 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:11.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74c2000640 1 --2- 172.21.15.173:0/2493492097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74cc0ce8f0 0x7f74cc140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74caa00640 1 --2- 172.21.15.173:0/2493492097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74cc0cc8b0 0x7f74cc13d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74cb400640 1 -- 172.21.15.173:0/2493492097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74cc0ce8f0 msgr2=0x7f74cc140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74cb400640 1 --2- 172.21.15.173:0/2493492097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74cc0ce8f0 0x7f74cc140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74cb400640 1 -- 172.21.15.173:0/2493492097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74cc0cc8b0 msgr2=0x7f74cc13d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74cb400640 1 --2- 172.21.15.173:0/2493492097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74cc0cc8b0 0x7f74cc13d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74cb400640 1 -- 172.21.15.173:0/2493492097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc13db60 con 0x7f74cc145250 2024-04-25T09:09:11.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74c2000640 1 --2- 172.21.15.173:0/2493492097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74cc0ce8f0 0x7f74cc140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:11.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74cb400640 1 --2- 172.21.15.173:0/2493492097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74cc145250 0x7f74cc141070 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f74c401b020 tx=0x7f74c4019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74c3400640 1 -- 172.21.15.173:0/2493492097 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c40b2050 con 0x7f74cc145250 2024-04-25T09:09:11.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74c3400640 1 -- 172.21.15.173:0/2493492097 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c40be070 con 0x7f74cc145250 2024-04-25T09:09:11.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74c3400640 1 -- 172.21.15.173:0/2493492097 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c40ada50 con 0x7f74cc145250 2024-04-25T09:09:11.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74d1800640 1 -- 172.21.15.173:0/2493492097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74cc13e540 con 0x7f74cc145250 2024-04-25T09:09:11.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.176+0000 7f74d1800640 1 -- 172.21.15.173:0/2493492097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74cc13eb00 con 0x7f74cc145250 2024-04-25T09:09:11.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.180+0000 7f74d1800640 1 -- 172.21.15.173:0/2493492097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74cc073a40 con 0x7f74cc145250 2024-04-25T09:09:11.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.180+0000 7f74c3400640 1 -- 172.21.15.173:0/2493492097 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f74c40adbf0 con 0x7f74cc145250 2024-04-25T09:09:11.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.180+0000 7f74c3400640 1 --2- 172.21.15.173:0/2493492097 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f74a8066f60 0x7f74a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.180+0000 7f74c3400640 1 -- 172.21.15.173:0/2493492097 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f74c41204a0 con 0x7f74cc145250 2024-04-25T09:09:11.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.180+0000 7f74caa00640 1 --2- 172.21.15.173:0/2493492097 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f74a8066f60 0x7f74a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.180+0000 7f74caa00640 1 --2- 172.21.15.173:0/2493492097 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f74a8066f60 0x7f74a8069420 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f74bc005890 tx=0x7f74bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.184+0000 7f74c3400640 1 -- 172.21.15.173:0/2493492097 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f74c4016560 con 0x7f74cc145250 2024-04-25T09:09:11.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.372+0000 7f74d1800640 1 -- 172.21.15.173:0/2493492097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74cc0b0f90 con 0x7f74cc145250 2024-04-25T09:09:11.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.372+0000 7f74c3400640 1 -- 172.21.15.173:0/2493492097 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f74c40ab340 con 0x7f74cc145250 2024-04-25T09:09:11.359 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:11.360 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":56,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2817126227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2817126227},{"type":"v1","addr":"172.21.15.194:6835","nonce":2817126227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":6772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3100146198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3100146198},{"type":"v1","addr":"172.21.15.194:6834","nonce":3100146198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":7251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3600648366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3600648366},{"type":"v1","addr":"172.21.15.173:6835","nonce":3600648366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T09:07:36.982841+0000","modified":"2024-04-25T09:07:49.396454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7263":{"gid":7263,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/2444108646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2444108646},{"type":"v1","addr":"172.21.15.173:6837","nonce":2444108646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:09:11.360 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 56 2024-04-25T09:09:11.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.372+0000 7f74d1800640 1 -- 172.21.15.173:0/2493492097 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f74a8066f60 msgr2=0x7f74a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.372+0000 7f74d1800640 1 --2- 172.21.15.173:0/2493492097 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f74a8066f60 0x7f74a8069420 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f74bc005890 tx=0x7f74bc009040 comp rx=0 tx=0).stop 2024-04-25T09:09:11.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.372+0000 7f74d1800640 1 -- 172.21.15.173:0/2493492097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74cc145250 msgr2=0x7f74cc141070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.372+0000 7f74d1800640 1 --2- 172.21.15.173:0/2493492097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74cc145250 0x7f74cc141070 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f74c401b020 tx=0x7f74c4019710 comp rx=0 tx=0).stop 2024-04-25T09:09:11.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.372+0000 7f74d1800640 1 -- 172.21.15.173:0/2493492097 shutdown_connections 2024-04-25T09:09:11.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.372+0000 7f74d1800640 1 --2- 172.21.15.173:0/2493492097 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f74a8066f60 0x7f74a8069420 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.372+0000 7f74d1800640 1 --2- 172.21.15.173:0/2493492097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74cc145250 0x7f74cc141070 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.372+0000 7f74d1800640 1 --2- 172.21.15.173:0/2493492097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74cc0ce8f0 0x7f74cc140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.372+0000 7f74d1800640 1 --2- 172.21.15.173:0/2493492097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74cc0cc8b0 0x7f74cc13d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.372+0000 7f74d1800640 1 -- 172.21.15.173:0/2493492097 >> 172.21.15.173:0/2493492097 conn(0x7f74cc06ac90 msgr2=0x7f74cc0b0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:11.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.372+0000 7f74d1800640 1 -- 172.21.15.173:0/2493492097 shutdown_connections 2024-04-25T09:09:11.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.372+0000 7f74d1800640 1 -- 172.21.15.173:0/2493492097 wait complete. 2024-04-25T09:09:11.380 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:11.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.528+0000 7f54d2400640 1 Processor -- start 2024-04-25T09:09:11.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.528+0000 7f54d2400640 1 -- start start 2024-04-25T09:09:11.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.528+0000 7f54d2400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f54cc06fba0 0x7f54cc0b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.528+0000 7f54d2400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54cc070230 con 0x7f54cc06ac90 2024-04-25T09:09:11.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.528+0000 7f54d2400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54cc070510 con 0x7f54cc15ea80 2024-04-25T09:09:11.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.528+0000 7f54d2400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54cc070000 con 0x7f54cc06fba0 2024-04-25T09:09:11.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.528+0000 7f54caa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f54cc06fba0 0x7f54cc0b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.528+0000 7f54cb400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f54cc06ac90 0x7f54cc06b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:51310/0 (socket says 172.21.15.173:51310) 2024-04-25T09:09:11.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.528+0000 7f54caa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f54cc06fba0 0x7f54cc0b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45524/0 (socket says 172.21.15.173:45524) 2024-04-25T09:09:11.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.528+0000 7f54cb400640 1 -- 172.21.15.173:0/1469695466 learned_addr learned my addr 172.21.15.173:0/1469695466 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:11.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.528+0000 7f54caa00640 1 -- 172.21.15.173:0/1469695466 >> v1:172.21.15.194:6789/0 conn(0x7f54cc15ea80 legacy=0x7f54cc15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.528+0000 7f54caa00640 1 -- 172.21.15.173:0/1469695466 >> v1:172.21.15.173:6789/0 conn(0x7f54cc06ac90 legacy=0x7f54cc06b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.528+0000 7f54caa00640 1 -- 172.21.15.173:0/1469695466 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc15e280 con 0x7f54cc06fba0 2024-04-25T09:09:11.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.532+0000 7f54caa00640 1 --2- 172.21.15.173:0/1469695466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54cc06fba0 0x7f54cc0b3920 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f54b80097c0 tx=0x7f54b801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33299c3d94fb5a0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.532+0000 7f54ca000640 1 -- 172.21.15.173:0/1469695466 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80b0070 con 0x7f54cc06fba0 2024-04-25T09:09:11.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.532+0000 7f54ca000640 1 -- 172.21.15.173:0/1469695466 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b80ab600 con 0x7f54cc06fba0 2024-04-25T09:09:11.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.532+0000 7f54ca000640 1 -- 172.21.15.173:0/1469695466 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80ab9d0 con 0x7f54cc06fba0 2024-04-25T09:09:11.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.532+0000 7f54d2400640 1 -- 172.21.15.173:0/1469695466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54cc06fba0 msgr2=0x7f54cc0b3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.532+0000 7f54d2400640 1 --2- 172.21.15.173:0/1469695466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54cc06fba0 0x7f54cc0b3920 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f54b80097c0 tx=0x7f54b801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.532+0000 7f54d2400640 1 -- 172.21.15.173:0/1469695466 shutdown_connections 2024-04-25T09:09:11.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.532+0000 7f54d2400640 1 --2- 172.21.15.173:0/1469695466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54cc06fba0 0x7f54cc0b3920 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.532+0000 7f54d2400640 1 -- 172.21.15.173:0/1469695466 >> 172.21.15.173:0/1469695466 conn(0x7f54cc0b23f0 msgr2=0x7f54cc0b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:11.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.532+0000 7f54d2400640 1 -- 172.21.15.173:0/1469695466 shutdown_connections 2024-04-25T09:09:11.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.532+0000 7f54d2400640 1 -- 172.21.15.173:0/1469695466 wait complete. 2024-04-25T09:09:11.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54d2400640 1 Processor -- start 2024-04-25T09:09:11.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54d2400640 1 -- start start 2024-04-25T09:09:11.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54d2400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54cc06ac90 0x7f54cc157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54d2400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54cc06fba0 0x7f54cc15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54d2400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54cc15ea80 0x7f54cc15cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54d2400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc16bed0 con 0x7f54cc06fba0 2024-04-25T09:09:11.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54d2400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc0b01a0 con 0x7f54cc06ac90 2024-04-25T09:09:11.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54d2400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc16c050 con 0x7f54cc15ea80 2024-04-25T09:09:11.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54caa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54cc06fba0 0x7f54cc15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54caa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54cc06fba0 0x7f54cc15ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45526/0 (socket says 172.21.15.173:45526) 2024-04-25T09:09:11.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54caa00640 1 -- 172.21.15.173:0/3970039147 learned_addr learned my addr 172.21.15.173:0/3970039147 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:11.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54cb400640 1 --2- 172.21.15.173:0/3970039147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54cc06ac90 0x7f54cc157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54cbe00640 1 --2- 172.21.15.173:0/3970039147 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54cc15ea80 0x7f54cc15cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54caa00640 1 -- 172.21.15.173:0/3970039147 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54cc15ea80 msgr2=0x7f54cc15cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54caa00640 1 --2- 172.21.15.173:0/3970039147 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54cc15ea80 0x7f54cc15cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54caa00640 1 -- 172.21.15.173:0/3970039147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54cc06ac90 msgr2=0x7f54cc157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54caa00640 1 --2- 172.21.15.173:0/3970039147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54cc06ac90 0x7f54cc157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54caa00640 1 -- 172.21.15.173:0/3970039147 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc1585f0 con 0x7f54cc06fba0 2024-04-25T09:09:11.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54cb400640 1 --2- 172.21.15.173:0/3970039147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54cc06ac90 0x7f54cc157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:11.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54caa00640 1 --2- 172.21.15.173:0/3970039147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54cc06fba0 0x7f54cc15ae20 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f54b80190b0 tx=0x7f54b8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54c3400640 1 -- 172.21.15.173:0/3970039147 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80b0040 con 0x7f54cc06fba0 2024-04-25T09:09:11.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54c3400640 1 -- 172.21.15.173:0/3970039147 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b80ba070 con 0x7f54cc06fba0 2024-04-25T09:09:11.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54d2400640 1 -- 172.21.15.173:0/3970039147 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54cc1588d0 con 0x7f54cc06fba0 2024-04-25T09:09:11.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54c3400640 1 -- 172.21.15.173:0/3970039147 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80b4870 con 0x7f54cc06fba0 2024-04-25T09:09:11.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54d2400640 1 -- 172.21.15.173:0/3970039147 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54cc158e90 con 0x7f54cc06fba0 2024-04-25T09:09:11.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.536+0000 7f54d2400640 1 -- 172.21.15.173:0/3970039147 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54cc073a40 con 0x7f54cc06fba0 2024-04-25T09:09:11.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.540+0000 7f54c3400640 1 -- 172.21.15.173:0/3970039147 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f54b80ab480 con 0x7f54cc06fba0 2024-04-25T09:09:11.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.540+0000 7f54c3400640 1 --2- 172.21.15.173:0/3970039147 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54ac066f60 0x7f54ac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.540+0000 7f54c3400640 1 -- 172.21.15.173:0/3970039147 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f54b811f060 con 0x7f54cc06fba0 2024-04-25T09:09:11.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.540+0000 7f54cb400640 1 --2- 172.21.15.173:0/3970039147 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54ac066f60 0x7f54ac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.540+0000 7f54cb400640 1 --2- 172.21.15.173:0/3970039147 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54ac066f60 0x7f54ac069420 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f54bc007fd0 tx=0x7f54bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.544+0000 7f54c3400640 1 -- 172.21.15.173:0/3970039147 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f54b8016090 con 0x7f54cc06fba0 2024-04-25T09:09:11.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.696+0000 7f54d2400640 1 -- 172.21.15.173:0/3970039147 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54cc0732d0 con 0x7f54cc06fba0 2024-04-25T09:09:11.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.700+0000 7f54c3400640 1 -- 172.21.15.173:0/3970039147 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f54b80efe20 con 0x7f54cc06fba0 2024-04-25T09:09:11.688 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:11.688 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":86,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:08:50.466636+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:07:35.343920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:07:35.976786+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":85,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:11.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.700+0000 7f54d2400640 1 -- 172.21.15.173:0/3970039147 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54ac066f60 msgr2=0x7f54ac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.700+0000 7f54d2400640 1 --2- 172.21.15.173:0/3970039147 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54ac066f60 0x7f54ac069420 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f54bc007fd0 tx=0x7f54bc009040 comp rx=0 tx=0).stop 2024-04-25T09:09:11.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.700+0000 7f54d2400640 1 -- 172.21.15.173:0/3970039147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54cc06fba0 msgr2=0x7f54cc15ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.700+0000 7f54d2400640 1 --2- 172.21.15.173:0/3970039147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54cc06fba0 0x7f54cc15ae20 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f54b80190b0 tx=0x7f54b8019240 comp rx=0 tx=0).stop 2024-04-25T09:09:11.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.700+0000 7f54d2400640 1 -- 172.21.15.173:0/3970039147 shutdown_connections 2024-04-25T09:09:11.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.700+0000 7f54d2400640 1 --2- 172.21.15.173:0/3970039147 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54ac066f60 0x7f54ac069420 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.700+0000 7f54d2400640 1 --2- 172.21.15.173:0/3970039147 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54cc15ea80 0x7f54cc15cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.700+0000 7f54d2400640 1 --2- 172.21.15.173:0/3970039147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54cc06fba0 0x7f54cc15ae20 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.700+0000 7f54d2400640 1 --2- 172.21.15.173:0/3970039147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54cc06ac90 0x7f54cc157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.700+0000 7f54d2400640 1 -- 172.21.15.173:0/3970039147 >> 172.21.15.173:0/3970039147 conn(0x7f54cc0b23f0 msgr2=0x7f54cc06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:11.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.700+0000 7f54d2400640 1 -- 172.21.15.173:0/3970039147 shutdown_connections 2024-04-25T09:09:11.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.700+0000 7f54d2400640 1 -- 172.21.15.173:0/3970039147 wait complete. 2024-04-25T09:09:11.708 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:07:35.343920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:07:35.976786+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 85, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:09:11.709 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:09:11.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.860+0000 7f700ae00640 1 Processor -- start 2024-04-25T09:09:11.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.860+0000 7f700ae00640 1 -- start start 2024-04-25T09:09:11.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.860+0000 7f700ae00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7004145290 0x7f700415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.860+0000 7f700ae00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f70040b3fe0 0x7f70040b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.860+0000 7f700ae00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f700415c5f0 con 0x7f70040cc260 2024-04-25T09:09:11.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.860+0000 7f700ae00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70040ccd80 con 0x7f70040b3fe0 2024-04-25T09:09:11.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.860+0000 7f700ae00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f700406d4b0 con 0x7f7004145290 2024-04-25T09:09:11.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.860+0000 7f7003400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f70040b3fe0 0x7f70040b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.860+0000 7f7003400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f70040b3fe0 0x7f70040b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45530/0 (socket says 172.21.15.173:45530) 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.860+0000 7f7003400640 1 -- 172.21.15.173:0/2108133652 learned_addr learned my addr 172.21.15.173:0/2108133652 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.860+0000 7f7003e00640 1 --2- 172.21.15.173:0/2108133652 >> v2:172.21.15.194:3300/0 conn(0x7f7004145290 0x7f700415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.860+0000 7f7003400640 1 -- 172.21.15.173:0/2108133652 >> v2:172.21.15.194:3300/0 conn(0x7f7004145290 msgr2=0x7f700415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.860+0000 7f7003400640 1 --2- 172.21.15.173:0/2108133652 >> v2:172.21.15.194:3300/0 conn(0x7f7004145290 0x7f700415c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.860+0000 7f7003400640 1 -- 172.21.15.173:0/2108133652 >> v1:172.21.15.194:6789/0 conn(0x7f70040cc260 legacy=0x7f70040cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.860+0000 7f7003400640 1 -- 172.21.15.173:0/2108133652 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700406d790 con 0x7f70040b3fe0 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.864+0000 7f7003400640 1 --2- 172.21.15.173:0/2108133652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70040b3fe0 0x7f70040b4450 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f70040d0800 tx=0x7f6ff001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2a4c02472307af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.864+0000 7f7002a00640 1 -- 172.21.15.173:0/2108133652 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff00b1070 con 0x7f70040b3fe0 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.864+0000 7f7002a00640 1 -- 172.21.15.173:0/2108133652 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff00ac640 con 0x7f70040b3fe0 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.864+0000 7f7002a00640 1 -- 172.21.15.173:0/2108133652 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff00aca10 con 0x7f70040b3fe0 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.864+0000 7f700ae00640 1 -- 172.21.15.173:0/2108133652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70040b3fe0 msgr2=0x7f70040b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.864+0000 7f700ae00640 1 --2- 172.21.15.173:0/2108133652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70040b3fe0 0x7f70040b4450 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f70040d0800 tx=0x7f6ff001c400 comp rx=0 tx=0).stop 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.864+0000 7f700ae00640 1 -- 172.21.15.173:0/2108133652 shutdown_connections 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.864+0000 7f700ae00640 1 --2- 172.21.15.173:0/2108133652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70040b3fe0 0x7f70040b4450 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.864+0000 7f700ae00640 1 --2- 172.21.15.173:0/2108133652 >> v2:172.21.15.194:3300/0 conn(0x7f7004145290 0x7f700415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.864+0000 7f700ae00640 1 -- 172.21.15.173:0/2108133652 >> 172.21.15.173:0/2108133652 conn(0x7f700406ac90 msgr2=0x7f700406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.864+0000 7f700ae00640 1 -- 172.21.15.173:0/2108133652 shutdown_connections 2024-04-25T09:09:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.864+0000 7f700ae00640 1 -- 172.21.15.173:0/2108133652 wait complete. 2024-04-25T09:09:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f700ae00640 1 Processor -- start 2024-04-25T09:09:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f700ae00640 1 -- start start 2024-04-25T09:09:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f700ae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70040b3fe0 0x7f700415b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f700ae00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70040cc260 0x7f70041376c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f700ae00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7004145290 0x7f70041592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f700ae00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70041457f0 con 0x7f70040cc260 2024-04-25T09:09:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f700ae00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7004145670 con 0x7f7004145290 2024-04-25T09:09:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f700ae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700406ed60 con 0x7f70040b3fe0 2024-04-25T09:09:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f7003400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70040cc260 0x7f70041376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f7003400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70040cc260 0x7f70041376c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45542/0 (socket says 172.21.15.173:45542) 2024-04-25T09:09:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f7003400640 1 -- 172.21.15.173:0/2325372791 learned_addr learned my addr 172.21.15.173:0/2325372791 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:11.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f7003e00640 1 --2- 172.21.15.173:0/2325372791 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70040b3fe0 0x7f700415b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f7008e00640 1 --2- 172.21.15.173:0/2325372791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7004145290 0x7f70041592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f7003400640 1 -- 172.21.15.173:0/2325372791 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70040b3fe0 msgr2=0x7f700415b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f7003400640 1 --2- 172.21.15.173:0/2325372791 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70040b3fe0 0x7f700415b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f7003400640 1 -- 172.21.15.173:0/2325372791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7004145290 msgr2=0x7f70041592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f7003400640 1 --2- 172.21.15.173:0/2325372791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7004145290 0x7f70041592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f7003400640 1 -- 172.21.15.173:0/2325372791 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7004134e10 con 0x7f70040cc260 2024-04-25T09:09:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f7003e00640 1 --2- 172.21.15.173:0/2325372791 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70040b3fe0 0x7f700415b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f7008e00640 1 --2- 172.21.15.173:0/2325372791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7004145290 0x7f70041592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f7003400640 1 --2- 172.21.15.173:0/2325372791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70040cc260 0x7f70041376c0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0019010 tx=0x7f6ff00191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f6ffbe00640 1 -- 172.21.15.173:0/2325372791 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff00b1040 con 0x7f70040cc260 2024-04-25T09:09:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f6ffbe00640 1 -- 172.21.15.173:0/2325372791 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff00ba070 con 0x7f70040cc260 2024-04-25T09:09:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f700ae00640 1 -- 172.21.15.173:0/2325372791 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f700415b1a0 con 0x7f70040cc260 2024-04-25T09:09:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f6ffbe00640 1 -- 172.21.15.173:0/2325372791 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff00b5660 con 0x7f70040cc260 2024-04-25T09:09:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.868+0000 7f700ae00640 1 -- 172.21.15.173:0/2325372791 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7004142410 con 0x7f70040cc260 2024-04-25T09:09:11.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.872+0000 7f700ae00640 1 -- 172.21.15.173:0/2325372791 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70041352f0 con 0x7f70040cc260 2024-04-25T09:09:11.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.872+0000 7f6ffbe00640 1 -- 172.21.15.173:0/2325372791 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6ff00b5800 con 0x7f70040cc260 2024-04-25T09:09:11.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.872+0000 7f6ffbe00640 1 --2- 172.21.15.173:0/2325372791 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6fe4066f60 0x7f6fe4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.872+0000 7f6ffbe00640 1 -- 172.21.15.173:0/2325372791 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f6ff011ef60 con 0x7f70040cc260 2024-04-25T09:09:11.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.872+0000 7f7003e00640 1 --2- 172.21.15.173:0/2325372791 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6fe4066f60 0x7f6fe4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.872+0000 7f7003e00640 1 --2- 172.21.15.173:0/2325372791 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6fe4066f60 0x7f6fe4069420 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6ff400b9f0 tx=0x7f6ff4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:11.876+0000 7f6ffbe00640 1 -- 172.21.15.173:0/2325372791 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f70041352f0 con 0x7f70040cc260 2024-04-25T09:09:12.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.032+0000 7f700ae00640 1 -- 172.21.15.173:0/2325372791 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7004073ab0 con 0x7f70040cc260 2024-04-25T09:09:12.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.032+0000 7f6ffbe00640 1 -- 172.21.15.173:0/2325372791 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ff0016110 con 0x7f70040cc260 2024-04-25T09:09:12.019 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:09:12.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.032+0000 7f700ae00640 1 -- 172.21.15.173:0/2325372791 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6fe4066f60 msgr2=0x7f6fe4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.032+0000 7f700ae00640 1 --2- 172.21.15.173:0/2325372791 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6fe4066f60 0x7f6fe4069420 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6ff400b9f0 tx=0x7f6ff4008040 comp rx=0 tx=0).stop 2024-04-25T09:09:12.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.032+0000 7f700ae00640 1 -- 172.21.15.173:0/2325372791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70040cc260 msgr2=0x7f70041376c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.032+0000 7f700ae00640 1 --2- 172.21.15.173:0/2325372791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70040cc260 0x7f70041376c0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0019010 tx=0x7f6ff00191a0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.032+0000 7f700ae00640 1 -- 172.21.15.173:0/2325372791 shutdown_connections 2024-04-25T09:09:12.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.032+0000 7f700ae00640 1 --2- 172.21.15.173:0/2325372791 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6fe4066f60 0x7f6fe4069420 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.032+0000 7f700ae00640 1 --2- 172.21.15.173:0/2325372791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7004145290 0x7f70041592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.032+0000 7f700ae00640 1 --2- 172.21.15.173:0/2325372791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70040cc260 0x7f70041376c0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.032+0000 7f700ae00640 1 --2- 172.21.15.173:0/2325372791 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70040b3fe0 0x7f700415b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.032+0000 7f700ae00640 1 -- 172.21.15.173:0/2325372791 >> 172.21.15.173:0/2325372791 conn(0x7f700406ac90 msgr2=0x7f7004144490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.032+0000 7f700ae00640 1 -- 172.21.15.173:0/2325372791 shutdown_connections 2024-04-25T09:09:12.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.032+0000 7f700ae00640 1 -- 172.21.15.173:0/2325372791 wait complete. 2024-04-25T09:09:12.040 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:09:12.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.188+0000 7ff16d800640 1 Processor -- start 2024-04-25T09:09:12.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.188+0000 7ff16d800640 1 -- start start 2024-04-25T09:09:12.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff16d800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff1680cc7e0 0x7ff1680cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff16d800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff168071570 con 0x7ff1680aeb90 2024-04-25T09:09:12.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff16d800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff168071850 con 0x7ff1680aef70 2024-04-25T09:09:12.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff16d800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff168071320 con 0x7ff1680cc7e0 2024-04-25T09:09:12.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff166a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ff1680aeb90 0x7ff1680cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:51324/0 (socket says 172.21.15.173:51324) 2024-04-25T09:09:12.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff166a00640 1 -- 172.21.15.173:0/2946438632 learned_addr learned my addr 172.21.15.173:0/2946438632 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:12.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff166000640 1 --2- 172.21.15.173:0/2946438632 >> v2:172.21.15.194:3300/0 conn(0x7ff1680cc7e0 0x7ff1680cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff165600640 1 -- 172.21.15.173:0/2946438632 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247297376 0 0) 0x7ff168071570 con 0x7ff1680aeb90 2024-04-25T09:09:12.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff165600640 1 -- 172.21.15.173:0/2946438632 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff14c005740 con 0x7ff1680aeb90 2024-04-25T09:09:12.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff165600640 1 -- 172.21.15.173:0/2946438632 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124103265 0 0) 0x7ff168071850 con 0x7ff1680aef70 2024-04-25T09:09:12.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff165600640 1 -- 172.21.15.173:0/2946438632 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff168071570 con 0x7ff1680aef70 2024-04-25T09:09:12.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff165600640 1 -- 172.21.15.173:0/2946438632 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2175927400 0 0) 0x7ff14c005740 con 0x7ff1680aeb90 2024-04-25T09:09:12.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff165600640 1 -- 172.21.15.173:0/2946438632 >> v2:172.21.15.194:3300/0 conn(0x7ff1680cc7e0 msgr2=0x7ff1680cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff165600640 1 --2- 172.21.15.173:0/2946438632 >> v2:172.21.15.194:3300/0 conn(0x7ff1680cc7e0 0x7ff1680cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff165600640 1 -- 172.21.15.173:0/2946438632 >> v1:172.21.15.194:6789/0 conn(0x7ff1680aef70 legacy=0x7ff16815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff165600640 1 -- 172.21.15.173:0/2946438632 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff168071b30 con 0x7ff1680aeb90 2024-04-25T09:09:12.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff165600640 1 -- 172.21.15.173:0/2946438632 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7ff158001a20 con 0x7ff1680aeb90 2024-04-25T09:09:12.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff165600640 1 -- 172.21.15.173:0/2946438632 >> v1:172.21.15.173:6789/0 conn(0x7ff1680aeb90 legacy=0x7ff1680cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff165600640 1 --2- 172.21.15.173:0/2946438632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff14c005d60 0x7ff14c006160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff165600640 1 --2- 172.21.15.173:0/2946438632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff14c006a20 0x7ff14c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff165600640 1 --2- 172.21.15.173:0/2946438632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff14c0073e0 0x7ff14c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff165600640 1 -- 172.21.15.173:0/2946438632 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff168071320 con 0x7ff14c005d60 2024-04-25T09:09:12.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff165600640 1 -- 172.21.15.173:0/2946438632 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c00e310 con 0x7ff14c0073e0 2024-04-25T09:09:12.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff165600640 1 -- 172.21.15.173:0/2946438632 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c00e510 con 0x7ff14c006a20 2024-04-25T09:09:12.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff166000640 1 --2- 172.21.15.173:0/2946438632 >> v2:172.21.15.194:3300/0 conn(0x7ff1680cc7e0 0x7ff1680cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:12.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff166a00640 1 --2- 172.21.15.173:0/2946438632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff14c005d60 0x7ff14c006160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff167400640 1 --2- 172.21.15.173:0/2946438632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff14c0073e0 0x7ff14c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff166000640 1 --2- 172.21.15.173:0/2946438632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff14c006a20 0x7ff14c006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff166a00640 1 -- 172.21.15.173:0/2946438632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff14c006a20 msgr2=0x7ff14c006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff166a00640 1 --2- 172.21.15.173:0/2946438632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff14c006a20 0x7ff14c006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff166a00640 1 -- 172.21.15.173:0/2946438632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff14c0073e0 msgr2=0x7ff14c00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff166a00640 1 --2- 172.21.15.173:0/2946438632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff14c0073e0 0x7ff14c00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff166a00640 1 -- 172.21.15.173:0/2946438632 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c005740 con 0x7ff14c005d60 2024-04-25T09:09:12.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff167400640 1 --2- 172.21.15.173:0/2946438632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff14c0073e0 0x7ff14c00dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:12.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.192+0000 7ff167400640 1 -- 172.21.15.173:0/2946438632 reap_dead start 2024-04-25T09:09:12.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.196+0000 7ff166a00640 1 --2- 172.21.15.173:0/2946438632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff14c005d60 0x7ff14c006160 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7ff15800a800 tx=0x7ff15801d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0db9c2280638c13 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.196+0000 7ff165600640 1 -- 172.21.15.173:0/2946438632 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15800a450 con 0x7ff14c005d60 2024-04-25T09:09:12.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.196+0000 7ff165600640 1 -- 172.21.15.173:0/2946438632 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1580072f0 con 0x7ff14c005d60 2024-04-25T09:09:12.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.196+0000 7ff165600640 1 -- 172.21.15.173:0/2946438632 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1580076e0 con 0x7ff14c005d60 2024-04-25T09:09:12.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.196+0000 7ff16d800640 1 -- 172.21.15.173:0/2946438632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff14c005d60 msgr2=0x7ff14c006160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.196+0000 7ff16d800640 1 --2- 172.21.15.173:0/2946438632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff14c005d60 0x7ff14c006160 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7ff15800a800 tx=0x7ff15801d2e0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.196+0000 7ff16d800640 1 -- 172.21.15.173:0/2946438632 shutdown_connections 2024-04-25T09:09:12.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.196+0000 7ff16d800640 1 --2- 172.21.15.173:0/2946438632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff14c005d60 0x7ff14c006160 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.196+0000 7ff16d800640 1 -- 172.21.15.173:0/2946438632 >> 172.21.15.173:0/2946438632 conn(0x7ff16806ac90 msgr2=0x7ff16806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.196+0000 7ff16d800640 1 -- 172.21.15.173:0/2946438632 shutdown_connections 2024-04-25T09:09:12.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.196+0000 7ff16d800640 1 -- 172.21.15.173:0/2946438632 wait complete. 2024-04-25T09:09:12.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.196+0000 7ff16d800640 1 Processor -- start 2024-04-25T09:09:12.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.196+0000 7ff16d800640 1 -- start start 2024-04-25T09:09:12.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff16d800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff14c005d60 0x7ff16814cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff16d800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff16814d560 0x7ff1680a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff16d800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1680a9400 0x7ff1680aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff16d800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16815e940 con 0x7ff1680a9400 2024-04-25T09:09:12.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff16d800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16815e7c0 con 0x7ff16814d560 2024-04-25T09:09:12.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff16d800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16815eac0 con 0x7ff14c005d60 2024-04-25T09:09:12.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff167400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1680a9400 0x7ff1680aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff167400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1680a9400 0x7ff1680aabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45552/0 (socket says 172.21.15.173:45552) 2024-04-25T09:09:12.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff167400640 1 -- 172.21.15.173:0/3386215336 learned_addr learned my addr 172.21.15.173:0/3386215336 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:12.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff166a00640 1 --2- 172.21.15.173:0/3386215336 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff14c005d60 0x7ff16814cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff166000640 1 --2- 172.21.15.173:0/3386215336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff16814d560 0x7ff1680a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff167400640 1 -- 172.21.15.173:0/3386215336 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff14c005d60 msgr2=0x7ff16814cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff167400640 1 --2- 172.21.15.173:0/3386215336 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff14c005d60 0x7ff16814cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff167400640 1 -- 172.21.15.173:0/3386215336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff16814d560 msgr2=0x7ff1680a8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff167400640 1 --2- 172.21.15.173:0/3386215336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff16814d560 0x7ff1680a8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff167400640 1 -- 172.21.15.173:0/3386215336 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1680a9e10 con 0x7ff1680a9400 2024-04-25T09:09:12.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff167400640 1 --2- 172.21.15.173:0/3386215336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1680a9400 0x7ff1680aabd0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7ff1680af380 tx=0x7ff16000e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff15ea00640 1 -- 172.21.15.173:0/3386215336 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff160019070 con 0x7ff1680a9400 2024-04-25T09:09:12.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff15ea00640 1 -- 172.21.15.173:0/3386215336 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1600052e0 con 0x7ff1680a9400 2024-04-25T09:09:12.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff16d800640 1 -- 172.21.15.173:0/3386215336 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1680aa0f0 con 0x7ff1680a9400 2024-04-25T09:09:12.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff15ea00640 1 -- 172.21.15.173:0/3386215336 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff160003820 con 0x7ff1680a9400 2024-04-25T09:09:12.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff16d800640 1 -- 172.21.15.173:0/3386215336 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1680a98a0 con 0x7ff1680a9400 2024-04-25T09:09:12.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff16d800640 1 -- 172.21.15.173:0/3386215336 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff168073ab0 con 0x7ff1680a9400 2024-04-25T09:09:12.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.200+0000 7ff15ea00640 1 -- 172.21.15.173:0/3386215336 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff16001c070 con 0x7ff1680a9400 2024-04-25T09:09:12.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.204+0000 7ff15ea00640 1 --2- 172.21.15.173:0/3386215336 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff148066f90 0x7ff148069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.204+0000 7ff15ea00640 1 -- 172.21.15.173:0/3386215336 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7ff160084520 con 0x7ff1680a9400 2024-04-25T09:09:12.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.204+0000 7ff166a00640 1 --2- 172.21.15.173:0/3386215336 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff148066f90 0x7ff148069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.204+0000 7ff166a00640 1 --2- 172.21.15.173:0/3386215336 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff148066f90 0x7ff148069450 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff1580ad000 tx=0x7ff158001d70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.208+0000 7ff15ea00640 1 -- 172.21.15.173:0/3386215336 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff1600552e0 con 0x7ff1680a9400 2024-04-25T09:09:12.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.360+0000 7ff16d800640 1 -- 172.21.15.173:0/3386215336 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff16806e9c0 con 0x7ff1680a9400 2024-04-25T09:09:12.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.360+0000 7ff15ea00640 1 -- 172.21.15.173:0/3386215336 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff160054be0 con 0x7ff1680a9400 2024-04-25T09:09:12.349 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.364+0000 7ff16d800640 1 -- 172.21.15.173:0/3386215336 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff148066f90 msgr2=0x7ff148069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.364+0000 7ff16d800640 1 --2- 172.21.15.173:0/3386215336 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff148066f90 0x7ff148069450 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff1580ad000 tx=0x7ff158001d70 comp rx=0 tx=0).stop 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.364+0000 7ff16d800640 1 -- 172.21.15.173:0/3386215336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1680a9400 msgr2=0x7ff1680aabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.364+0000 7ff16d800640 1 --2- 172.21.15.173:0/3386215336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1680a9400 0x7ff1680aabd0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7ff1680af380 tx=0x7ff16000e890 comp rx=0 tx=0).stop 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.364+0000 7ff16d800640 1 -- 172.21.15.173:0/3386215336 shutdown_connections 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.364+0000 7ff16d800640 1 --2- 172.21.15.173:0/3386215336 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff148066f90 0x7ff148069450 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.364+0000 7ff16d800640 1 --2- 172.21.15.173:0/3386215336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1680a9400 0x7ff1680aabd0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.364+0000 7ff16d800640 1 --2- 172.21.15.173:0/3386215336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff16814d560 0x7ff1680a8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.364+0000 7ff16d800640 1 --2- 172.21.15.173:0/3386215336 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff14c005d60 0x7ff16814cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.364+0000 7ff16d800640 1 -- 172.21.15.173:0/3386215336 >> 172.21.15.173:0/3386215336 conn(0x7ff16806ac90 msgr2=0x7ff1680af910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.364+0000 7ff16d800640 1 -- 172.21.15.173:0/3386215336 shutdown_connections 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.364+0000 7ff16d800640 1 -- 172.21.15.173:0/3386215336 wait complete. 2024-04-25T09:09:12.371 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:09:12.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.520+0000 7f161d400640 1 Processor -- start 2024-04-25T09:09:12.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.520+0000 7f161d400640 1 -- start start 2024-04-25T09:09:12.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.520+0000 7f161d400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1618145290 0x7f161815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.520+0000 7f161d400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f16180b3fe0 0x7f16180b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.520+0000 7f161d400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161815c5f0 con 0x7f16180cc260 2024-04-25T09:09:12.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.520+0000 7f161d400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16180ccd80 con 0x7f1618145290 2024-04-25T09:09:12.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.520+0000 7f161d400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161806d4b0 con 0x7f16180b3fe0 2024-04-25T09:09:12.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.520+0000 7f1616800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1618145290 0x7f161815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.520+0000 7f1616800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1618145290 0x7f161815c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45554/0 (socket says 172.21.15.173:45554) 2024-04-25T09:09:12.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.520+0000 7f1616800640 1 -- 172.21.15.173:0/593330514 learned_addr learned my addr 172.21.15.173:0/593330514 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:12.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.520+0000 7f1615e00640 1 --2- 172.21.15.173:0/593330514 >> v2:172.21.15.194:3300/0 conn(0x7f16180b3fe0 0x7f16180b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.520+0000 7f1616800640 1 -- 172.21.15.173:0/593330514 >> v2:172.21.15.194:3300/0 conn(0x7f16180b3fe0 msgr2=0x7f16180b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.520+0000 7f1616800640 1 --2- 172.21.15.173:0/593330514 >> v2:172.21.15.194:3300/0 conn(0x7f16180b3fe0 0x7f16180b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.520+0000 7f1616800640 1 -- 172.21.15.173:0/593330514 >> v1:172.21.15.194:6789/0 conn(0x7f16180cc260 legacy=0x7f16180cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.520+0000 7f1616800640 1 -- 172.21.15.173:0/593330514 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161806d790 con 0x7f1618145290 2024-04-25T09:09:12.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.520+0000 7f1615e00640 1 --2- 172.21.15.173:0/593330514 >> v2:172.21.15.194:3300/0 conn(0x7f16180b3fe0 0x7f16180b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:12.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.524+0000 7f1616800640 1 --2- 172.21.15.173:0/593330514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1618145290 0x7f161815c0b0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f1618071100 tx=0x7f160801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b399768df209b476 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.524+0000 7f1615400640 1 -- 172.21.15.173:0/593330514 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16080b1070 con 0x7f1618145290 2024-04-25T09:09:12.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.524+0000 7f1615400640 1 -- 172.21.15.173:0/593330514 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16080ac640 con 0x7f1618145290 2024-04-25T09:09:12.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.524+0000 7f1615400640 1 -- 172.21.15.173:0/593330514 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16080aca10 con 0x7f1618145290 2024-04-25T09:09:12.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.524+0000 7f161d400640 1 -- 172.21.15.173:0/593330514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1618145290 msgr2=0x7f161815c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.524+0000 7f161d400640 1 --2- 172.21.15.173:0/593330514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1618145290 0x7f161815c0b0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f1618071100 tx=0x7f160801c400 comp rx=0 tx=0).stop 2024-04-25T09:09:12.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.524+0000 7f161d400640 1 -- 172.21.15.173:0/593330514 shutdown_connections 2024-04-25T09:09:12.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.524+0000 7f161d400640 1 --2- 172.21.15.173:0/593330514 >> v2:172.21.15.194:3300/0 conn(0x7f16180b3fe0 0x7f16180b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.524+0000 7f161d400640 1 --2- 172.21.15.173:0/593330514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1618145290 0x7f161815c0b0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.524+0000 7f161d400640 1 -- 172.21.15.173:0/593330514 >> 172.21.15.173:0/593330514 conn(0x7f161806ac90 msgr2=0x7f161806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.524+0000 7f161d400640 1 -- 172.21.15.173:0/593330514 shutdown_connections 2024-04-25T09:09:12.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.524+0000 7f161d400640 1 -- 172.21.15.173:0/593330514 wait complete. 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f161d400640 1 Processor -- start 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f161d400640 1 -- start start 2024-04-25T09:09:12.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f161d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16180b3fe0 0x7f16180cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f161d400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16180cc260 0x7f161812f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f161d400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1618145290 0x7f1618159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f161d400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16181457f0 con 0x7f16180b3fe0 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f161d400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1618145670 con 0x7f1618145290 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f161d400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161806ed60 con 0x7f16180cc260 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f1616800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16180b3fe0 0x7f16180cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f1616800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16180b3fe0 0x7f16180cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45566/0 (socket says 172.21.15.173:45566) 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f1616800640 1 -- 172.21.15.173:0/1477262666 learned_addr learned my addr 172.21.15.173:0/1477262666 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f1617200640 1 --2- 172.21.15.173:0/1477262666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1618145290 0x7f1618159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f1615e00640 1 --2- 172.21.15.173:0/1477262666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16180cc260 0x7f161812f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f1616800640 1 -- 172.21.15.173:0/1477262666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16180cc260 msgr2=0x7f161812f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f1616800640 1 --2- 172.21.15.173:0/1477262666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16180cc260 0x7f161812f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f1616800640 1 -- 172.21.15.173:0/1477262666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1618145290 msgr2=0x7f1618159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f1616800640 1 --2- 172.21.15.173:0/1477262666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1618145290 0x7f1618159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f1616800640 1 -- 172.21.15.173:0/1477262666 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161813f700 con 0x7f16180b3fe0 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f1616800640 1 --2- 172.21.15.173:0/1477262666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16180b3fe0 0x7f16180cd2f0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f1608019010 tx=0x7f16080191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f160ea00640 1 -- 172.21.15.173:0/1477262666 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16080b1040 con 0x7f16180b3fe0 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f160ea00640 1 -- 172.21.15.173:0/1477262666 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16080b5620 con 0x7f16180b3fe0 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f161d400640 1 -- 172.21.15.173:0/1477262666 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1618130100 con 0x7f16180b3fe0 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f160ea00640 1 -- 172.21.15.173:0/1477262666 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16080b5a10 con 0x7f16180b3fe0 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.528+0000 7f161d400640 1 -- 172.21.15.173:0/1477262666 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16181306c0 con 0x7f16180b3fe0 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.532+0000 7f161d400640 1 -- 172.21.15.173:0/1477262666 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1618073ab0 con 0x7f16180b3fe0 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.532+0000 7f160ea00640 1 -- 172.21.15.173:0/1477262666 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f16080ac500 con 0x7f16180b3fe0 2024-04-25T09:09:12.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.532+0000 7f160ea00640 1 --2- 172.21.15.173:0/1477262666 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f15f8066f60 0x7f15f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.532+0000 7f160ea00640 1 -- 172.21.15.173:0/1477262666 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f160811ecc0 con 0x7f16180b3fe0 2024-04-25T09:09:12.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.532+0000 7f1615e00640 1 --2- 172.21.15.173:0/1477262666 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f15f8066f60 0x7f15f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.532+0000 7f1615e00640 1 --2- 172.21.15.173:0/1477262666 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f15f8066f60 0x7f15f8069420 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f16180ccd50 tx=0x7f1604008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.536+0000 7f160ea00640 1 -- 172.21.15.173:0/1477262666 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1608125080 con 0x7f16180b3fe0 2024-04-25T09:09:12.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.692+0000 7f161d400640 1 -- 172.21.15.173:0/1477262666 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f161806f390 con 0x7f16180b3fe0 2024-04-25T09:09:12.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.692+0000 7f160ea00640 1 -- 172.21.15.173:0/1477262666 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1608016110 con 0x7f16180b3fe0 2024-04-25T09:09:12.682 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:09:12.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.696+0000 7f161d400640 1 -- 172.21.15.173:0/1477262666 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f15f8066f60 msgr2=0x7f15f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.696+0000 7f161d400640 1 --2- 172.21.15.173:0/1477262666 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f15f8066f60 0x7f15f8069420 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f16180ccd50 tx=0x7f1604008040 comp rx=0 tx=0).stop 2024-04-25T09:09:12.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.696+0000 7f161d400640 1 -- 172.21.15.173:0/1477262666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16180b3fe0 msgr2=0x7f16180cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.696+0000 7f161d400640 1 --2- 172.21.15.173:0/1477262666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16180b3fe0 0x7f16180cd2f0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f1608019010 tx=0x7f16080191a0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.696+0000 7f161d400640 1 -- 172.21.15.173:0/1477262666 shutdown_connections 2024-04-25T09:09:12.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.696+0000 7f161d400640 1 --2- 172.21.15.173:0/1477262666 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f15f8066f60 0x7f15f8069420 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.696+0000 7f161d400640 1 --2- 172.21.15.173:0/1477262666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1618145290 0x7f1618159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.696+0000 7f161d400640 1 --2- 172.21.15.173:0/1477262666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16180cc260 0x7f161812f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.696+0000 7f161d400640 1 --2- 172.21.15.173:0/1477262666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16180b3fe0 0x7f16180cd2f0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.696+0000 7f161d400640 1 -- 172.21.15.173:0/1477262666 >> 172.21.15.173:0/1477262666 conn(0x7f161806ac90 msgr2=0x7f161815cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.696+0000 7f161d400640 1 -- 172.21.15.173:0/1477262666 shutdown_connections 2024-04-25T09:09:12.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.696+0000 7f161d400640 1 -- 172.21.15.173:0/1477262666 wait complete. 2024-04-25T09:09:12.703 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:12.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.852+0000 7f047da00640 1 Processor -- start 2024-04-25T09:09:12.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.852+0000 7f047da00640 1 -- start start 2024-04-25T09:09:12.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.852+0000 7f047da00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f047815dbb0 0x7f047815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.852+0000 7f047da00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04780d2130 0x7f047806c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.852+0000 7f047da00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047806d870 con 0x7f047806c7b0 2024-04-25T09:09:12.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.852+0000 7f047da00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04780d2590 con 0x7f047815dbb0 2024-04-25T09:09:12.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.852+0000 7f047da00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047815e5c0 con 0x7f04780d2130 2024-04-25T09:09:12.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.852+0000 7f0476a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f047815dbb0 0x7f047815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.852+0000 7f0476a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f047815dbb0 0x7f047815df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45576/0 (socket says 172.21.15.173:45576) 2024-04-25T09:09:12.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.852+0000 7f0477400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f047806c7b0 0x7f047806f830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:51336/0 (socket says 172.21.15.173:51336) 2024-04-25T09:09:12.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.852+0000 7f0477400640 1 -- 172.21.15.173:0/675728430 learned_addr learned my addr 172.21.15.173:0/675728430 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:12.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.852+0000 7f046e000640 1 --2- 172.21.15.173:0/675728430 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04780d2130 0x7f047806c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.852+0000 7f0476a00640 1 -- 172.21.15.173:0/675728430 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04780d2130 msgr2=0x7f047806c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.852+0000 7f0476a00640 1 --2- 172.21.15.173:0/675728430 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04780d2130 0x7f047806c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.852+0000 7f0476a00640 1 -- 172.21.15.173:0/675728430 >> v1:172.21.15.173:6789/0 conn(0x7f047806c7b0 legacy=0x7f047806f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.852+0000 7f0476a00640 1 -- 172.21.15.173:0/675728430 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0478161690 con 0x7f047815dbb0 2024-04-25T09:09:12.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.852+0000 7f0476000640 1 -- 172.21.15.173:0/675728430 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96329968 0 0) 0x7f047806d870 con 0x7f047806c7b0 2024-04-25T09:09:12.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.856+0000 7f0476a00640 1 --2- 172.21.15.173:0/675728430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f047815dbb0 0x7f047815df90 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f0468009d90 tx=0x7f046801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae97dd402e29b02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.856+0000 7f0476000640 1 -- 172.21.15.173:0/675728430 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04680b2070 con 0x7f047815dbb0 2024-04-25T09:09:12.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.856+0000 7f0476000640 1 -- 172.21.15.173:0/675728430 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04680a5a00 con 0x7f047815dbb0 2024-04-25T09:09:12.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.856+0000 7f0476000640 1 -- 172.21.15.173:0/675728430 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04680a5dd0 con 0x7f047815dbb0 2024-04-25T09:09:12.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.856+0000 7f047da00640 1 -- 172.21.15.173:0/675728430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f047815dbb0 msgr2=0x7f047815df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.856+0000 7f047da00640 1 --2- 172.21.15.173:0/675728430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f047815dbb0 0x7f047815df90 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f0468009d90 tx=0x7f046801c940 comp rx=0 tx=0).stop 2024-04-25T09:09:12.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.856+0000 7f047da00640 1 -- 172.21.15.173:0/675728430 shutdown_connections 2024-04-25T09:09:12.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.856+0000 7f047da00640 1 --2- 172.21.15.173:0/675728430 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04780d2130 0x7f047806c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.856+0000 7f047da00640 1 --2- 172.21.15.173:0/675728430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f047815dbb0 0x7f047815df90 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.856+0000 7f047da00640 1 -- 172.21.15.173:0/675728430 >> 172.21.15.173:0/675728430 conn(0x7f0478061880 msgr2=0x7f0478061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.856+0000 7f047da00640 1 -- 172.21.15.173:0/675728430 shutdown_connections 2024-04-25T09:09:12.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.856+0000 7f047da00640 1 -- 172.21.15.173:0/675728430 wait complete. 2024-04-25T09:09:12.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f047da00640 1 Processor -- start 2024-04-25T09:09:12.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f047da00640 1 -- start start 2024-04-25T09:09:12.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f047da00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f047806c7b0 0x7f04780b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f047da00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04780d2130 0x7f0478152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f047da00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f047815dbb0 0x7f04780b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f047da00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04781624d0 con 0x7f04780d2130 2024-04-25T09:09:12.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f047da00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0478162350 con 0x7f047806c7b0 2024-04-25T09:09:12.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f047da00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047806ff40 con 0x7f047815dbb0 2024-04-25T09:09:12.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f046e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04780d2130 0x7f0478152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f046e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04780d2130 0x7f0478152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45582/0 (socket says 172.21.15.173:45582) 2024-04-25T09:09:12.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f046e000640 1 -- 172.21.15.173:0/1144312490 learned_addr learned my addr 172.21.15.173:0/1144312490 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:12.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f0476a00640 1 --2- 172.21.15.173:0/1144312490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f047806c7b0 0x7f04780b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f0477400640 1 --2- 172.21.15.173:0/1144312490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f047815dbb0 0x7f04780b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f046e000640 1 -- 172.21.15.173:0/1144312490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f047815dbb0 msgr2=0x7f04780b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f046e000640 1 --2- 172.21.15.173:0/1144312490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f047815dbb0 0x7f04780b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f046e000640 1 -- 172.21.15.173:0/1144312490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f047806c7b0 msgr2=0x7f04780b67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f046e000640 1 --2- 172.21.15.173:0/1144312490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f047806c7b0 0x7f04780b67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f046e000640 1 -- 172.21.15.173:0/1144312490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0478154cf0 con 0x7f04780d2130 2024-04-25T09:09:12.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f0476a00640 1 --2- 172.21.15.173:0/1144312490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f047806c7b0 0x7f04780b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:12.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f0477400640 1 --2- 172.21.15.173:0/1144312490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f047815dbb0 0x7f04780b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:12.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f046e000640 1 --2- 172.21.15.173:0/1144312490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04780d2130 0x7f0478152d30 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f046000e960 tx=0x7f046000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f046f400640 1 -- 172.21.15.173:0/1144312490 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0460017070 con 0x7f04780d2130 2024-04-25T09:09:12.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f046f400640 1 -- 172.21.15.173:0/1144312490 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046000ca00 con 0x7f04780d2130 2024-04-25T09:09:12.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f046f400640 1 -- 172.21.15.173:0/1144312490 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046000cdb0 con 0x7f04780d2130 2024-04-25T09:09:12.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f047da00640 1 -- 172.21.15.173:0/1144312490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04780b5290 con 0x7f04780d2130 2024-04-25T09:09:12.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f047da00640 1 -- 172.21.15.173:0/1144312490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04780b5ce0 con 0x7f04780d2130 2024-04-25T09:09:12.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.860+0000 7f047da00640 1 -- 172.21.15.173:0/1144312490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0478073a40 con 0x7f04780d2130 2024-04-25T09:09:12.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.864+0000 7f046f400640 1 -- 172.21.15.173:0/1144312490 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f046001a070 con 0x7f04780d2130 2024-04-25T09:09:12.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.864+0000 7f046f400640 1 --2- 172.21.15.173:0/1144312490 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0454066f60 0x7f0454069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.864+0000 7f046f400640 1 -- 172.21.15.173:0/1144312490 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f04600852c0 con 0x7f04780d2130 2024-04-25T09:09:12.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.864+0000 7f0476a00640 1 --2- 172.21.15.173:0/1144312490 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0454066f60 0x7f0454069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.864+0000 7f0476a00640 1 --2- 172.21.15.173:0/1144312490 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0454066f60 0x7f0454069420 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f04680af000 tx=0x7f04680a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:12.868+0000 7f046f400640 1 -- 172.21.15.173:0/1144312490 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0460056080 con 0x7f04780d2130 2024-04-25T09:09:13.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.052+0000 7f047da00640 1 -- 172.21.15.173:0/1144312490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04780cf020 con 0x7f04780d2130 2024-04-25T09:09:13.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.056+0000 7f046f400640 1 -- 172.21.15.173:0/1144312490 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f0460055980 con 0x7f04780d2130 2024-04-25T09:09:13.043 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:13.043 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":56,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2817126227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2817126227},{"type":"v1","addr":"172.21.15.194:6835","nonce":2817126227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":6772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3100146198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3100146198},{"type":"v1","addr":"172.21.15.194:6834","nonce":3100146198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":7251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3600648366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3600648366},{"type":"v1","addr":"172.21.15.173:6835","nonce":3600648366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T09:07:36.982841+0000","modified":"2024-04-25T09:07:49.396454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7263":{"gid":7263,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/2444108646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2444108646},{"type":"v1","addr":"172.21.15.173:6837","nonce":2444108646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:09:13.043 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 56 2024-04-25T09:09:13.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.056+0000 7f047da00640 1 -- 172.21.15.173:0/1144312490 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0454066f60 msgr2=0x7f0454069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.056+0000 7f047da00640 1 --2- 172.21.15.173:0/1144312490 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0454066f60 0x7f0454069420 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f04680af000 tx=0x7f04680a7070 comp rx=0 tx=0).stop 2024-04-25T09:09:13.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.056+0000 7f047da00640 1 -- 172.21.15.173:0/1144312490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04780d2130 msgr2=0x7f0478152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.056+0000 7f047da00640 1 --2- 172.21.15.173:0/1144312490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04780d2130 0x7f0478152d30 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f046000e960 tx=0x7f046000ee20 comp rx=0 tx=0).stop 2024-04-25T09:09:13.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.056+0000 7f047da00640 1 -- 172.21.15.173:0/1144312490 shutdown_connections 2024-04-25T09:09:13.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.056+0000 7f047da00640 1 --2- 172.21.15.173:0/1144312490 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0454066f60 0x7f0454069420 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.056+0000 7f047da00640 1 --2- 172.21.15.173:0/1144312490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f047815dbb0 0x7f04780b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.056+0000 7f047da00640 1 --2- 172.21.15.173:0/1144312490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04780d2130 0x7f0478152d30 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.056+0000 7f047da00640 1 --2- 172.21.15.173:0/1144312490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f047806c7b0 0x7f04780b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.056+0000 7f047da00640 1 -- 172.21.15.173:0/1144312490 >> 172.21.15.173:0/1144312490 conn(0x7f0478061880 msgr2=0x7f047806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:13.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.056+0000 7f047da00640 1 -- 172.21.15.173:0/1144312490 shutdown_connections 2024-04-25T09:09:13.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.056+0000 7f047da00640 1 -- 172.21.15.173:0/1144312490 wait complete. 2024-04-25T09:09:13.064 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:13.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e8a600640 1 Processor -- start 2024-04-25T09:09:13.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e8a600640 1 -- start start 2024-04-25T09:09:13.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e8a600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e84145250 0x7f5e8415c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e8a600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5e840cc8b0 0x7f5e840ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e8a600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8415cec0 con 0x7f5e84071320 2024-04-25T09:09:13.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e8a600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8406e7c0 con 0x7f5e840cc8b0 2024-04-25T09:09:13.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e8a600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8406d720 con 0x7f5e84145250 2024-04-25T09:09:13.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e82a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5e840cc8b0 0x7f5e840ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e83e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f5e84071320 0x7f5e84071790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:51350/0 (socket says 172.21.15.173:51350) 2024-04-25T09:09:13.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e83e00640 1 -- 172.21.15.173:0/1017094957 learned_addr learned my addr 172.21.15.173:0/1017094957 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:13.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e82a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5e840cc8b0 0x7f5e840ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45592/0 (socket says 172.21.15.173:45592) 2024-04-25T09:09:13.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e83400640 1 --2- 172.21.15.173:0/1017094957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e84145250 0x7f5e8415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e82000640 1 -- 172.21.15.173:0/1017094957 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857177182 0 0) 0x7f5e7c001120 con 0x7f5e84071320 2024-04-25T09:09:13.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e82000640 1 -- 172.21.15.173:0/1017094957 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e68003530 con 0x7f5e84071320 2024-04-25T09:09:13.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e82a00640 1 -- 172.21.15.173:0/1017094957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e84145250 msgr2=0x7f5e8415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:13.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e82a00640 1 --2- 172.21.15.173:0/1017094957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e84145250 0x7f5e8415c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e82a00640 1 -- 172.21.15.173:0/1017094957 >> v1:172.21.15.173:6789/0 conn(0x7f5e84071320 legacy=0x7f5e84071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e82a00640 1 -- 172.21.15.173:0/1017094957 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8406da00 con 0x7f5e840cc8b0 2024-04-25T09:09:13.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.212+0000 7f5e83400640 1 --2- 172.21.15.173:0/1017094957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e84145250 0x7f5e8415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:13.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.216+0000 7f5e82a00640 1 --2- 172.21.15.173:0/1017094957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e840cc8b0 0x7f5e840ccd30 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f5e700097c0 tx=0x7f5e7001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827e3584cde09732 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.216+0000 7f5e82000640 1 -- 172.21.15.173:0/1017094957 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e700b2070 con 0x7f5e840cc8b0 2024-04-25T09:09:13.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.216+0000 7f5e82000640 1 -- 172.21.15.173:0/1017094957 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e700ad640 con 0x7f5e840cc8b0 2024-04-25T09:09:13.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.216+0000 7f5e82000640 1 -- 172.21.15.173:0/1017094957 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e700ada10 con 0x7f5e840cc8b0 2024-04-25T09:09:13.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.216+0000 7f5e8a600640 1 -- 172.21.15.173:0/1017094957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e840cc8b0 msgr2=0x7f5e840ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.216+0000 7f5e8a600640 1 --2- 172.21.15.173:0/1017094957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e840cc8b0 0x7f5e840ccd30 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f5e700097c0 tx=0x7f5e7001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.216+0000 7f5e8a600640 1 -- 172.21.15.173:0/1017094957 shutdown_connections 2024-04-25T09:09:13.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.216+0000 7f5e8a600640 1 --2- 172.21.15.173:0/1017094957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e840cc8b0 0x7f5e840ccd30 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.216+0000 7f5e8a600640 1 --2- 172.21.15.173:0/1017094957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e84145250 0x7f5e8415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.216+0000 7f5e8a600640 1 -- 172.21.15.173:0/1017094957 >> 172.21.15.173:0/1017094957 conn(0x7f5e8406ac90 msgr2=0x7f5e8406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:13.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.216+0000 7f5e8a600640 1 -- 172.21.15.173:0/1017094957 shutdown_connections 2024-04-25T09:09:13.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.216+0000 7f5e8a600640 1 -- 172.21.15.173:0/1017094957 wait complete. 2024-04-25T09:09:13.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e8a600640 1 Processor -- start 2024-04-25T09:09:13.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e8a600640 1 -- start start 2024-04-25T09:09:13.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e8a600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e84071320 0x7f5e8413ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e8a600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e840cc8b0 0x7f5e840cf780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e8a600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e84145250 0x7f5e840cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e8a600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8406ef80 con 0x7f5e84145250 2024-04-25T09:09:13.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e8a600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e84145630 con 0x7f5e84071320 2024-04-25T09:09:13.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e8a600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8406d380 con 0x7f5e840cc8b0 2024-04-25T09:09:13.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e83e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e84145250 0x7f5e840cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e83e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e84145250 0x7f5e840cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45602/0 (socket says 172.21.15.173:45602) 2024-04-25T09:09:13.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e83e00640 1 -- 172.21.15.173:0/757736680 learned_addr learned my addr 172.21.15.173:0/757736680 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:13.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e83400640 1 --2- 172.21.15.173:0/757736680 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e84071320 0x7f5e8413ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e82a00640 1 --2- 172.21.15.173:0/757736680 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e840cc8b0 0x7f5e840cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e83e00640 1 -- 172.21.15.173:0/757736680 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e840cc8b0 msgr2=0x7f5e840cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e83e00640 1 --2- 172.21.15.173:0/757736680 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e840cc8b0 0x7f5e840cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e83e00640 1 -- 172.21.15.173:0/757736680 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e84071320 msgr2=0x7f5e8413ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e83e00640 1 --2- 172.21.15.173:0/757736680 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e84071320 0x7f5e8413ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e83e00640 1 -- 172.21.15.173:0/757736680 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e84142cb0 con 0x7f5e84145250 2024-04-25T09:09:13.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e83e00640 1 --2- 172.21.15.173:0/757736680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e84145250 0x7f5e840cfcc0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00c3c0 tx=0x7f5e7c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e7b400640 1 -- 172.21.15.173:0/757736680 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c017070 con 0x7f5e84145250 2024-04-25T09:09:13.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e7b400640 1 -- 172.21.15.173:0/757736680 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c005cf0 con 0x7f5e84145250 2024-04-25T09:09:13.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e7b400640 1 -- 172.21.15.173:0/757736680 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c0072f0 con 0x7f5e84145250 2024-04-25T09:09:13.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e8a600640 1 -- 172.21.15.173:0/757736680 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e84142f90 con 0x7f5e84145250 2024-04-25T09:09:13.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e8a600640 1 -- 172.21.15.173:0/757736680 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e84143550 con 0x7f5e84145250 2024-04-25T09:09:13.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.220+0000 7f5e8a600640 1 -- 172.21.15.173:0/757736680 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e84073a40 con 0x7f5e84145250 2024-04-25T09:09:13.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.224+0000 7f5e7b400640 1 -- 172.21.15.173:0/757736680 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5e7c01a070 con 0x7f5e84145250 2024-04-25T09:09:13.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.224+0000 7f5e7b400640 1 --2- 172.21.15.173:0/757736680 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5e64066f60 0x7f5e64069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.224+0000 7f5e7b400640 1 -- 172.21.15.173:0/757736680 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f5e7c0845b0 con 0x7f5e84145250 2024-04-25T09:09:13.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.224+0000 7f5e83400640 1 --2- 172.21.15.173:0/757736680 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5e64066f60 0x7f5e64069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.224+0000 7f5e83400640 1 --2- 172.21.15.173:0/757736680 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5e64066f60 0x7f5e64069420 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5e8415f430 tx=0x7f5e740097f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.228+0000 7f5e7b400640 1 -- 172.21.15.173:0/757736680 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5e8415cec0 con 0x7f5e84145250 2024-04-25T09:09:13.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.380+0000 7f5e8a600640 1 -- 172.21.15.173:0/757736680 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e841407e0 con 0x7f5e84145250 2024-04-25T09:09:13.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.384+0000 7f5e7b400640 1 -- 172.21.15.173:0/757736680 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f5e7c054d20 con 0x7f5e84145250 2024-04-25T09:09:13.372 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:13.372 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":86,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:08:50.466636+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:07:35.343920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:07:35.976786+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":85,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:13.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.384+0000 7f5e8a600640 1 -- 172.21.15.173:0/757736680 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5e64066f60 msgr2=0x7f5e64069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.384+0000 7f5e8a600640 1 --2- 172.21.15.173:0/757736680 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5e64066f60 0x7f5e64069420 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5e8415f430 tx=0x7f5e740097f0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.384+0000 7f5e8a600640 1 -- 172.21.15.173:0/757736680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e84145250 msgr2=0x7f5e840cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.384+0000 7f5e8a600640 1 --2- 172.21.15.173:0/757736680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e84145250 0x7f5e840cfcc0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00c3c0 tx=0x7f5e7c00c880 comp rx=0 tx=0).stop 2024-04-25T09:09:13.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.384+0000 7f5e8a600640 1 -- 172.21.15.173:0/757736680 shutdown_connections 2024-04-25T09:09:13.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.384+0000 7f5e8a600640 1 --2- 172.21.15.173:0/757736680 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5e64066f60 0x7f5e64069420 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.384+0000 7f5e8a600640 1 --2- 172.21.15.173:0/757736680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e84145250 0x7f5e840cfcc0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.384+0000 7f5e8a600640 1 --2- 172.21.15.173:0/757736680 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e840cc8b0 0x7f5e840cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.384+0000 7f5e8a600640 1 --2- 172.21.15.173:0/757736680 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e84071320 0x7f5e8413ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.384+0000 7f5e8a600640 1 -- 172.21.15.173:0/757736680 >> 172.21.15.173:0/757736680 conn(0x7f5e8406ac90 msgr2=0x7f5e8406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:13.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.384+0000 7f5e8a600640 1 -- 172.21.15.173:0/757736680 shutdown_connections 2024-04-25T09:09:13.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.384+0000 7f5e8a600640 1 -- 172.21.15.173:0/757736680 wait complete. 2024-04-25T09:09:13.393 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:09:13.393 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:13.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.540+0000 7f54de800640 1 Processor -- start 2024-04-25T09:09:13.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.544+0000 7f54de800640 1 -- start start 2024-04-25T09:09:13.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.544+0000 7f54de800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d8157f00 0x7f54d80b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.544+0000 7f54de800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f54d80b36c0 0x7f54d806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.544+0000 7f54de800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f54d806ac90 0x7f54d806b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.544+0000 7f54de800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d806b640 con 0x7f54d80b36c0 2024-04-25T09:09:13.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.544+0000 7f54de800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d80b55b0 con 0x7f54d806ac90 2024-04-25T09:09:13.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.544+0000 7f54de800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d815e010 con 0x7f54d8157f00 2024-04-25T09:09:13.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.544+0000 7f54cfe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f54d80b36c0 0x7f54d806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.544+0000 7f54cfe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f54d80b36c0 0x7f54d806e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46616/0 (socket says 172.21.15.173:46616) 2024-04-25T09:09:13.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.544+0000 7f54cfe00640 1 -- 172.21.15.173:0/72534298 learned_addr learned my addr 172.21.15.173:0/72534298 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:13.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.544+0000 7f54d7400640 1 --2- 172.21.15.173:0/72534298 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d8157f00 0x7f54d80b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.544+0000 7f54d7e00640 1 --2- 172.21.15.173:0/72534298 >> v2:172.21.15.194:3300/0 conn(0x7f54d806ac90 0x7f54d806b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.544+0000 7f54cfe00640 1 -- 172.21.15.173:0/72534298 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d8157f00 msgr2=0x7f54d80b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:13.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.544+0000 7f54cfe00640 1 --2- 172.21.15.173:0/72534298 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d8157f00 0x7f54d80b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.544+0000 7f54cfe00640 1 -- 172.21.15.173:0/72534298 >> v2:172.21.15.194:3300/0 conn(0x7f54d806ac90 msgr2=0x7f54d806b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:13.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.544+0000 7f54cfe00640 1 --2- 172.21.15.173:0/72534298 >> v2:172.21.15.194:3300/0 conn(0x7f54d806ac90 0x7f54d806b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.544+0000 7f54cfe00640 1 -- 172.21.15.173:0/72534298 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d80b57e0 con 0x7f54d80b36c0 2024-04-25T09:09:13.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.544+0000 7f54d7e00640 1 --2- 172.21.15.173:0/72534298 >> v2:172.21.15.194:3300/0 conn(0x7f54d806ac90 0x7f54d806b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:13.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.548+0000 7f54cfe00640 1 --2- 172.21.15.173:0/72534298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d80b36c0 0x7f54d806e4d0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f54d8062660 tx=0x7f54c001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d6ec5e41187c19 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.548+0000 7f54d6a00640 1 -- 172.21.15.173:0/72534298 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c00aa610 con 0x7f54d80b36c0 2024-04-25T09:09:13.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.548+0000 7f54d6a00640 1 -- 172.21.15.173:0/72534298 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c00af070 con 0x7f54d80b36c0 2024-04-25T09:09:13.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.548+0000 7f54d6a00640 1 -- 172.21.15.173:0/72534298 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c00aa9d0 con 0x7f54d80b36c0 2024-04-25T09:09:13.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.548+0000 7f54de800640 1 -- 172.21.15.173:0/72534298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d80b36c0 msgr2=0x7f54d806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.548+0000 7f54de800640 1 --2- 172.21.15.173:0/72534298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d80b36c0 0x7f54d806e4d0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f54d8062660 tx=0x7f54c001c4f0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.548+0000 7f54de800640 1 -- 172.21.15.173:0/72534298 shutdown_connections 2024-04-25T09:09:13.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.548+0000 7f54de800640 1 --2- 172.21.15.173:0/72534298 >> v2:172.21.15.194:3300/0 conn(0x7f54d806ac90 0x7f54d806b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.548+0000 7f54de800640 1 --2- 172.21.15.173:0/72534298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d80b36c0 0x7f54d806e4d0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.548+0000 7f54de800640 1 --2- 172.21.15.173:0/72534298 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d8157f00 0x7f54d80b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.548+0000 7f54de800640 1 -- 172.21.15.173:0/72534298 >> 172.21.15.173:0/72534298 conn(0x7f54d8099a50 msgr2=0x7f54d80b5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:13.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.548+0000 7f54de800640 1 -- 172.21.15.173:0/72534298 shutdown_connections 2024-04-25T09:09:13.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.548+0000 7f54de800640 1 -- 172.21.15.173:0/72534298 wait complete. 2024-04-25T09:09:13.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.548+0000 7f54de800640 1 Processor -- start 2024-04-25T09:09:13.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.548+0000 7f54de800640 1 -- start start 2024-04-25T09:09:13.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54de800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d806ac90 0x7f54d814ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54de800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d80b36c0 0x7f54d814e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54de800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d8157f00 0x7f54d814c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54de800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d81582e0 con 0x7f54d80b36c0 2024-04-25T09:09:13.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54de800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d80b3b40 con 0x7f54d806ac90 2024-04-25T09:09:13.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54de800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d8158460 con 0x7f54d8157f00 2024-04-25T09:09:13.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54cfe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d80b36c0 0x7f54d814e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54d7400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d806ac90 0x7f54d814ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54cfe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d80b36c0 0x7f54d814e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46630/0 (socket says 172.21.15.173:46630) 2024-04-25T09:09:13.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54cfe00640 1 -- 172.21.15.173:0/2312514819 learned_addr learned my addr 172.21.15.173:0/2312514819 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:13.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54d7e00640 1 --2- 172.21.15.173:0/2312514819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d8157f00 0x7f54d814c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54cfe00640 1 -- 172.21.15.173:0/2312514819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d8157f00 msgr2=0x7f54d814c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54cfe00640 1 --2- 172.21.15.173:0/2312514819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d8157f00 0x7f54d814c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54cfe00640 1 -- 172.21.15.173:0/2312514819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d806ac90 msgr2=0x7f54d814ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54cfe00640 1 --2- 172.21.15.173:0/2312514819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d806ac90 0x7f54d814ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54cfe00640 1 -- 172.21.15.173:0/2312514819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d814e6e0 con 0x7f54d80b36c0 2024-04-25T09:09:13.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54cfe00640 1 --2- 172.21.15.173:0/2312514819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d80b36c0 0x7f54d814e1a0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f54c001aba0 tx=0x7f54c001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54cf400640 1 -- 172.21.15.173:0/2312514819 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c00aae60 con 0x7f54d80b36c0 2024-04-25T09:09:13.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54cf400640 1 -- 172.21.15.173:0/2312514819 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c00bd5f0 con 0x7f54d80b36c0 2024-04-25T09:09:13.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54de800640 1 -- 172.21.15.173:0/2312514819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d80b2b30 con 0x7f54d80b36c0 2024-04-25T09:09:13.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54cf400640 1 -- 172.21.15.173:0/2312514819 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c00bd9e0 con 0x7f54d80b36c0 2024-04-25T09:09:13.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54de800640 1 -- 172.21.15.173:0/2312514819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d80af1d0 con 0x7f54d80b36c0 2024-04-25T09:09:13.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54de800640 1 -- 172.21.15.173:0/2312514819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d8073a40 con 0x7f54d80b36c0 2024-04-25T09:09:13.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.552+0000 7f54cf400640 1 -- 172.21.15.173:0/2312514819 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f54c00b33f0 con 0x7f54d80b36c0 2024-04-25T09:09:13.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.556+0000 7f54cf400640 1 --2- 172.21.15.173:0/2312514819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54b4066f60 0x7f54b4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.556+0000 7f54cf400640 1 -- 172.21.15.173:0/2312514819 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f54c011f510 con 0x7f54d80b36c0 2024-04-25T09:09:13.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.556+0000 7f54d7400640 1 --2- 172.21.15.173:0/2312514819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54b4066f60 0x7f54b4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.556+0000 7f54d7400640 1 --2- 172.21.15.173:0/2312514819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54b4066f60 0x7f54b4069420 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f54c8009ae0 tx=0x7f54c8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.560+0000 7f54cf400640 1 -- 172.21.15.173:0/2312514819 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f54c00c3060 con 0x7f54d80b36c0 2024-04-25T09:09:13.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.752+0000 7f54de800640 1 -- 172.21.15.173:0/2312514819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54d8099f30 con 0x7f54d80b36c0 2024-04-25T09:09:13.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.752+0000 7f54cf400640 1 -- 172.21.15.173:0/2312514819 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f54c00a7070 con 0x7f54d80b36c0 2024-04-25T09:09:13.741 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:13.741 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":56,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2817126227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2817126227},{"type":"v1","addr":"172.21.15.194:6835","nonce":2817126227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":6772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3100146198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3100146198},{"type":"v1","addr":"172.21.15.194:6834","nonce":3100146198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":7251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3600648366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3600648366},{"type":"v1","addr":"172.21.15.173:6835","nonce":3600648366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T09:07:36.982841+0000","modified":"2024-04-25T09:07:49.396454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7263":{"gid":7263,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/2444108646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2444108646},{"type":"v1","addr":"172.21.15.173:6837","nonce":2444108646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:09:13.741 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 56 2024-04-25T09:09:13.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.752+0000 7f54de800640 1 -- 172.21.15.173:0/2312514819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54b4066f60 msgr2=0x7f54b4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.752+0000 7f54de800640 1 --2- 172.21.15.173:0/2312514819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54b4066f60 0x7f54b4069420 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f54c8009ae0 tx=0x7f54c8009190 comp rx=0 tx=0).stop 2024-04-25T09:09:13.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.752+0000 7f54de800640 1 -- 172.21.15.173:0/2312514819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d80b36c0 msgr2=0x7f54d814e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.752+0000 7f54de800640 1 --2- 172.21.15.173:0/2312514819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d80b36c0 0x7f54d814e1a0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f54c001aba0 tx=0x7f54c001ad30 comp rx=0 tx=0).stop 2024-04-25T09:09:13.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.752+0000 7f54de800640 1 -- 172.21.15.173:0/2312514819 shutdown_connections 2024-04-25T09:09:13.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.752+0000 7f54de800640 1 --2- 172.21.15.173:0/2312514819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f54b4066f60 0x7f54b4069420 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.752+0000 7f54de800640 1 --2- 172.21.15.173:0/2312514819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54d8157f00 0x7f54d814c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.752+0000 7f54de800640 1 --2- 172.21.15.173:0/2312514819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d80b36c0 0x7f54d814e1a0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.752+0000 7f54de800640 1 --2- 172.21.15.173:0/2312514819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d806ac90 0x7f54d814ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.752+0000 7f54de800640 1 -- 172.21.15.173:0/2312514819 >> 172.21.15.173:0/2312514819 conn(0x7f54d8099a50 msgr2=0x7f54d806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:13.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.752+0000 7f54de800640 1 -- 172.21.15.173:0/2312514819 shutdown_connections 2024-04-25T09:09:13.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.752+0000 7f54de800640 1 -- 172.21.15.173:0/2312514819 wait complete. 2024-04-25T09:09:13.761 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:13.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.908+0000 7f0028a00640 1 Processor -- start 2024-04-25T09:09:13.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.908+0000 7f0028a00640 1 -- start start 2024-04-25T09:09:13.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.908+0000 7f0028a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f00240b3e70 0x7f00240b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.908+0000 7f0028a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00240aefa0 0x7f00240b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.908+0000 7f0028a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f002415edd0 0x7f00240b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.908+0000 7f0028a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f002406dd50 con 0x7f002415edd0 2024-04-25T09:09:13.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.908+0000 7f0028a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00240b4790 con 0x7f00240b3e70 2024-04-25T09:09:13.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.908+0000 7f0028a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002415f320 con 0x7f00240aefa0 2024-04-25T09:09:13.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.908+0000 7f0022800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f002415edd0 0x7f00240b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.908+0000 7f0021e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f00240b3e70 0x7f00240b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.908+0000 7f0022800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f002415edd0 0x7f00240b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46636/0 (socket says 172.21.15.173:46636) 2024-04-25T09:09:13.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.908+0000 7f0022800640 1 -- 172.21.15.173:0/4120791484 learned_addr learned my addr 172.21.15.173:0/4120791484 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:13.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.908+0000 7f0021400640 1 --2- 172.21.15.173:0/4120791484 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00240aefa0 0x7f00240b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0022800640 1 -- 172.21.15.173:0/4120791484 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00240aefa0 msgr2=0x7f00240b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:13.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0022800640 1 --2- 172.21.15.173:0/4120791484 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00240aefa0 0x7f00240b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0022800640 1 -- 172.21.15.173:0/4120791484 >> v2:172.21.15.194:3300/0 conn(0x7f00240b3e70 msgr2=0x7f00240b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:13.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0022800640 1 --2- 172.21.15.173:0/4120791484 >> v2:172.21.15.194:3300/0 conn(0x7f00240b3e70 0x7f00240b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0022800640 1 -- 172.21.15.173:0/4120791484 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002406d420 con 0x7f002415edd0 2024-04-25T09:09:13.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0021e00640 1 --2- 172.21.15.173:0/4120791484 >> v2:172.21.15.194:3300/0 conn(0x7f00240b3e70 0x7f00240b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:13.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0022800640 1 --2- 172.21.15.173:0/4120791484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f002415edd0 0x7f00240b2cb0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f002406bca0 tx=0x7f001c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd448e674ab2efc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0020a00640 1 -- 172.21.15.173:0/4120791484 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c0b1070 con 0x7f002415edd0 2024-04-25T09:09:13.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0020a00640 1 -- 172.21.15.173:0/4120791484 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001c0ac630 con 0x7f002415edd0 2024-04-25T09:09:13.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0020a00640 1 -- 172.21.15.173:0/4120791484 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c0a8050 con 0x7f002415edd0 2024-04-25T09:09:13.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0028a00640 1 -- 172.21.15.173:0/4120791484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f002415edd0 msgr2=0x7f00240b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0028a00640 1 --2- 172.21.15.173:0/4120791484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f002415edd0 0x7f00240b2cb0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f002406bca0 tx=0x7f001c01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0028a00640 1 -- 172.21.15.173:0/4120791484 shutdown_connections 2024-04-25T09:09:13.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0028a00640 1 --2- 172.21.15.173:0/4120791484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f002415edd0 0x7f00240b2cb0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0028a00640 1 --2- 172.21.15.173:0/4120791484 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00240aefa0 0x7f00240b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0028a00640 1 --2- 172.21.15.173:0/4120791484 >> v2:172.21.15.194:3300/0 conn(0x7f00240b3e70 0x7f00240b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0028a00640 1 -- 172.21.15.173:0/4120791484 >> 172.21.15.173:0/4120791484 conn(0x7f002406ac90 msgr2=0x7f002406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:13.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0028a00640 1 -- 172.21.15.173:0/4120791484 shutdown_connections 2024-04-25T09:09:13.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.912+0000 7f0028a00640 1 -- 172.21.15.173:0/4120791484 wait complete. 2024-04-25T09:09:13.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0028a00640 1 Processor -- start 2024-04-25T09:09:13.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0028a00640 1 -- start start 2024-04-25T09:09:13.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0028a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00240aefa0 0x7f0024140420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0028a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00240b3e70 0x7f002415ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0028a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f002415edd0 0x7f002415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0028a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002406e1c0 con 0x7f002415edd0 2024-04-25T09:09:13.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0028a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00240b3600 con 0x7f00240aefa0 2024-04-25T09:09:13.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0028a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002406e340 con 0x7f00240b3e70 2024-04-25T09:09:13.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0022800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f002415edd0 0x7f002415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0022800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f002415edd0 0x7f002415bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46650/0 (socket says 172.21.15.173:46650) 2024-04-25T09:09:13.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0022800640 1 -- 172.21.15.173:0/4174596163 learned_addr learned my addr 172.21.15.173:0/4174596163 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:13.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0021e00640 1 --2- 172.21.15.173:0/4174596163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00240aefa0 0x7f0024140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0021400640 1 --2- 172.21.15.173:0/4174596163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00240b3e70 0x7f002415ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0022800640 1 -- 172.21.15.173:0/4174596163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00240b3e70 msgr2=0x7f002415ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0022800640 1 --2- 172.21.15.173:0/4174596163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00240b3e70 0x7f002415ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0022800640 1 -- 172.21.15.173:0/4174596163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00240aefa0 msgr2=0x7f0024140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0022800640 1 --2- 172.21.15.173:0/4174596163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00240aefa0 0x7f0024140420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0022800640 1 -- 172.21.15.173:0/4174596163 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002415aee0 con 0x7f002415edd0 2024-04-25T09:09:13.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0021400640 1 --2- 172.21.15.173:0/4174596163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00240b3e70 0x7f002415ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:13.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0022800640 1 --2- 172.21.15.173:0/4174596163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f002415edd0 0x7f002415bc60 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f001c0af040 tx=0x7f001c019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f001a000640 1 -- 172.21.15.173:0/4174596163 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c0a8050 con 0x7f002415edd0 2024-04-25T09:09:13.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f001a000640 1 -- 172.21.15.173:0/4174596163 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001c0bc070 con 0x7f002415edd0 2024-04-25T09:09:13.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f001a000640 1 -- 172.21.15.173:0/4174596163 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c0b1040 con 0x7f002415edd0 2024-04-25T09:09:13.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.916+0000 7f0028a00640 1 -- 172.21.15.173:0/4174596163 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002415b180 con 0x7f002415edd0 2024-04-25T09:09:13.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.920+0000 7f0028a00640 1 -- 172.21.15.173:0/4174596163 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002415b740 con 0x7f002415edd0 2024-04-25T09:09:13.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.920+0000 7f0028a00640 1 -- 172.21.15.173:0/4174596163 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0024073a40 con 0x7f002415edd0 2024-04-25T09:09:13.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.920+0000 7f001a000640 1 -- 172.21.15.173:0/4174596163 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f001c0c1460 con 0x7f002415edd0 2024-04-25T09:09:13.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.920+0000 7f001a000640 1 --2- 172.21.15.173:0/4174596163 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0004066f90 0x7f0004069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.920+0000 7f001a000640 1 -- 172.21.15.173:0/4174596163 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f001c11f420 con 0x7f002415edd0 2024-04-25T09:09:13.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.920+0000 7f0021e00640 1 --2- 172.21.15.173:0/4174596163 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0004066f90 0x7f0004069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.920+0000 7f0021e00640 1 --2- 172.21.15.173:0/4174596163 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0004066f90 0x7f0004069450 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f00240b4600 tx=0x7f001400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:13.924+0000 7f001a000640 1 -- 172.21.15.173:0/4174596163 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f001c016110 con 0x7f002415edd0 2024-04-25T09:09:14.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.112+0000 7f0028a00640 1 -- 172.21.15.173:0/4174596163 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f002406f1c0 con 0x7f002415edd0 2024-04-25T09:09:14.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.112+0000 7f001a000640 1 -- 172.21.15.173:0/4174596163 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f001c0f0300 con 0x7f002415edd0 2024-04-25T09:09:14.100 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:14.101 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":56,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2817126227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2817126227},{"type":"v1","addr":"172.21.15.194:6835","nonce":2817126227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":6772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3100146198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3100146198},{"type":"v1","addr":"172.21.15.194:6834","nonce":3100146198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":7251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3600648366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3600648366},{"type":"v1","addr":"172.21.15.173:6835","nonce":3600648366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T09:07:36.982841+0000","modified":"2024-04-25T09:07:49.396454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7263":{"gid":7263,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/2444108646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2444108646},{"type":"v1","addr":"172.21.15.173:6837","nonce":2444108646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:09:14.101 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 56 2024-04-25T09:09:14.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.112+0000 7f0028a00640 1 -- 172.21.15.173:0/4174596163 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0004066f90 msgr2=0x7f0004069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:14.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.112+0000 7f0028a00640 1 --2- 172.21.15.173:0/4174596163 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0004066f90 0x7f0004069450 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f00240b4600 tx=0x7f001400b040 comp rx=0 tx=0).stop 2024-04-25T09:09:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.112+0000 7f0028a00640 1 -- 172.21.15.173:0/4174596163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f002415edd0 msgr2=0x7f002415bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.112+0000 7f0028a00640 1 --2- 172.21.15.173:0/4174596163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f002415edd0 0x7f002415bc60 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f001c0af040 tx=0x7f001c019290 comp rx=0 tx=0).stop 2024-04-25T09:09:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.112+0000 7f0028a00640 1 -- 172.21.15.173:0/4174596163 shutdown_connections 2024-04-25T09:09:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.112+0000 7f0028a00640 1 --2- 172.21.15.173:0/4174596163 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0004066f90 0x7f0004069450 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.112+0000 7f0028a00640 1 --2- 172.21.15.173:0/4174596163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f002415edd0 0x7f002415bc60 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.112+0000 7f0028a00640 1 --2- 172.21.15.173:0/4174596163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00240b3e70 0x7f002415ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.112+0000 7f0028a00640 1 --2- 172.21.15.173:0/4174596163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00240aefa0 0x7f0024140420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.112+0000 7f0028a00640 1 -- 172.21.15.173:0/4174596163 >> 172.21.15.173:0/4174596163 conn(0x7f002406ac90 msgr2=0x7f0024155860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.112+0000 7f0028a00640 1 -- 172.21.15.173:0/4174596163 shutdown_connections 2024-04-25T09:09:14.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.112+0000 7f0028a00640 1 -- 172.21.15.173:0/4174596163 wait complete. 2024-04-25T09:09:14.121 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:14.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.268+0000 7fba8a000640 1 Processor -- start 2024-04-25T09:09:14.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.268+0000 7fba8a000640 1 -- start start 2024-04-25T09:09:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.272+0000 7fba8a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba840aefa0 0x7fba840cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.272+0000 7fba8a000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fba8415edd0 0x7fba840cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.272+0000 7fba8a000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8415f320 con 0x7fba840b3e70 2024-04-25T09:09:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.272+0000 7fba8a000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8406dd50 con 0x7fba8415edd0 2024-04-25T09:09:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.272+0000 7fba8a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8406d420 con 0x7fba840aefa0 2024-04-25T09:09:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.272+0000 7fba83e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fba8415edd0 0x7fba840cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.272+0000 7fba83400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fba840b3e70 0x7fba840b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54664/0 (socket says 172.21.15.173:54664) 2024-04-25T09:09:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.272+0000 7fba83400640 1 -- 172.21.15.173:0/3271682659 learned_addr learned my addr 172.21.15.173:0/3271682659 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.272+0000 7fba7aa00640 1 --2- 172.21.15.173:0/3271682659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba840aefa0 0x7fba840cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.272+0000 7fba83e00640 1 -- 172.21.15.173:0/3271682659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba840aefa0 msgr2=0x7fba840cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.272+0000 7fba83e00640 1 --2- 172.21.15.173:0/3271682659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba840aefa0 0x7fba840cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.272+0000 7fba83e00640 1 -- 172.21.15.173:0/3271682659 >> v1:172.21.15.173:6789/0 conn(0x7fba840b3e70 legacy=0x7fba840b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.272+0000 7fba83e00640 1 -- 172.21.15.173:0/3271682659 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8406d700 con 0x7fba8415edd0 2024-04-25T09:09:14.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.272+0000 7fba83e00640 1 --2- 172.21.15.173:0/3271682659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba8415edd0 0x7fba840cdce0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009d90 tx=0x7fba7c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915c4e3140b44f75 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:14.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.272+0000 7fba82a00640 1 -- 172.21.15.173:0/3271682659 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0b2070 con 0x7fba8415edd0 2024-04-25T09:09:14.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.272+0000 7fba82a00640 1 -- 172.21.15.173:0/3271682659 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c0a59f0 con 0x7fba8415edd0 2024-04-25T09:09:14.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.272+0000 7fba82a00640 1 -- 172.21.15.173:0/3271682659 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0a5dc0 con 0x7fba8415edd0 2024-04-25T09:09:14.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba8a000640 1 -- 172.21.15.173:0/3271682659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba8415edd0 msgr2=0x7fba840cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:14.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba8a000640 1 --2- 172.21.15.173:0/3271682659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba8415edd0 0x7fba840cdce0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009d90 tx=0x7fba7c01c940 comp rx=0 tx=0).stop 2024-04-25T09:09:14.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba8a000640 1 -- 172.21.15.173:0/3271682659 shutdown_connections 2024-04-25T09:09:14.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba8a000640 1 --2- 172.21.15.173:0/3271682659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba8415edd0 0x7fba840cdce0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba8a000640 1 --2- 172.21.15.173:0/3271682659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba840aefa0 0x7fba840cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba8a000640 1 -- 172.21.15.173:0/3271682659 >> 172.21.15.173:0/3271682659 conn(0x7fba8406ac90 msgr2=0x7fba8406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:14.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba8a000640 1 -- 172.21.15.173:0/3271682659 shutdown_connections 2024-04-25T09:09:14.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba8a000640 1 -- 172.21.15.173:0/3271682659 wait complete. 2024-04-25T09:09:14.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba8a000640 1 Processor -- start 2024-04-25T09:09:14.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba8a000640 1 -- start start 2024-04-25T09:09:14.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba8a000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba840aefa0 0x7fba8415ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:14.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba8a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba840b3e70 0x7fba8413f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:14.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba8a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba8415edd0 0x7fba84158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:14.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba8a000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba84167930 con 0x7fba840b3e70 2024-04-25T09:09:14.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba8a000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba841677b0 con 0x7fba840aefa0 2024-04-25T09:09:14.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba8a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba84167ab0 con 0x7fba8415edd0 2024-04-25T09:09:14.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba7aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba840b3e70 0x7fba8413f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:14.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba7aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba840b3e70 0x7fba8413f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46678/0 (socket says 172.21.15.173:46678) 2024-04-25T09:09:14.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba7aa00640 1 -- 172.21.15.173:0/1398391400 learned_addr learned my addr 172.21.15.173:0/1398391400 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:14.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba83400640 1 --2- 172.21.15.173:0/1398391400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba840aefa0 0x7fba8415ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:14.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.276+0000 7fba83e00640 1 --2- 172.21.15.173:0/1398391400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba8415edd0 0x7fba84158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:14.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.280+0000 7fba7aa00640 1 -- 172.21.15.173:0/1398391400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba8415edd0 msgr2=0x7fba84158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:14.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.280+0000 7fba7aa00640 1 --2- 172.21.15.173:0/1398391400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba8415edd0 0x7fba84158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.280+0000 7fba7aa00640 1 -- 172.21.15.173:0/1398391400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba840aefa0 msgr2=0x7fba8415ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:14.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.280+0000 7fba7aa00640 1 --2- 172.21.15.173:0/1398391400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba840aefa0 0x7fba8415ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.280+0000 7fba7aa00640 1 -- 172.21.15.173:0/1398391400 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8415b980 con 0x7fba840b3e70 2024-04-25T09:09:14.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.280+0000 7fba83400640 1 --2- 172.21.15.173:0/1398391400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba840aefa0 0x7fba8415ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:14.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.280+0000 7fba83e00640 1 --2- 172.21.15.173:0/1398391400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba8415edd0 0x7fba84158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:14.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.280+0000 7fba7aa00640 1 --2- 172.21.15.173:0/1398391400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba840b3e70 0x7fba8413f1f0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00d800 tx=0x7fba6c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:14.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.280+0000 7fba7be00640 1 -- 172.21.15.173:0/1398391400 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c00b660 con 0x7fba840b3e70 2024-04-25T09:09:14.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.280+0000 7fba7be00640 1 -- 172.21.15.173:0/1398391400 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c019070 con 0x7fba840b3e70 2024-04-25T09:09:14.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.280+0000 7fba8a000640 1 -- 172.21.15.173:0/1398391400 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8415bc60 con 0x7fba840b3e70 2024-04-25T09:09:14.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.280+0000 7fba7be00640 1 -- 172.21.15.173:0/1398391400 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c00ba00 con 0x7fba840b3e70 2024-04-25T09:09:14.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.280+0000 7fba8a000640 1 -- 172.21.15.173:0/1398391400 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8415c220 con 0x7fba840b3e70 2024-04-25T09:09:14.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.280+0000 7fba8a000640 1 -- 172.21.15.173:0/1398391400 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba84073a40 con 0x7fba840b3e70 2024-04-25T09:09:14.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.280+0000 7fba7be00640 1 -- 172.21.15.173:0/1398391400 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fba6c00bba0 con 0x7fba840b3e70 2024-04-25T09:09:14.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.280+0000 7fba7be00640 1 --2- 172.21.15.173:0/1398391400 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba60066f60 0x7fba60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:14.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.280+0000 7fba7be00640 1 -- 172.21.15.173:0/1398391400 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7fba6c085600 con 0x7fba840b3e70 2024-04-25T09:09:14.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.280+0000 7fba83400640 1 --2- 172.21.15.173:0/1398391400 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba60066f60 0x7fba60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:14.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.284+0000 7fba83400640 1 --2- 172.21.15.173:0/1398391400 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba60066f60 0x7fba60069420 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fba74000f70 tx=0x7fba74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:14.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.284+0000 7fba7be00640 1 -- 172.21.15.173:0/1398391400 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fba6c056450 con 0x7fba840b3e70 2024-04-25T09:09:14.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.440+0000 7fba8a000640 1 -- 172.21.15.173:0/1398391400 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba8406f1c0 con 0x7fba840b3e70 2024-04-25T09:09:14.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.440+0000 7fba7be00640 1 -- 172.21.15.173:0/1398391400 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+17071 (secure 0 0 0) 0x7fba6c055d50 con 0x7fba840b3e70 2024-04-25T09:09:14.430 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:14.430 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":86,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:08:50.466636+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:07:35.343920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:07:35.976786+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":85,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:14.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.444+0000 7fba8a000640 1 -- 172.21.15.173:0/1398391400 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba60066f60 msgr2=0x7fba60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:14.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.444+0000 7fba8a000640 1 --2- 172.21.15.173:0/1398391400 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba60066f60 0x7fba60069420 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fba74000f70 tx=0x7fba74009040 comp rx=0 tx=0).stop 2024-04-25T09:09:14.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.444+0000 7fba8a000640 1 -- 172.21.15.173:0/1398391400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba840b3e70 msgr2=0x7fba8413f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:14.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.444+0000 7fba8a000640 1 --2- 172.21.15.173:0/1398391400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba840b3e70 0x7fba8413f1f0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00d800 tx=0x7fba6c00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.444+0000 7fba8a000640 1 -- 172.21.15.173:0/1398391400 shutdown_connections 2024-04-25T09:09:14.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.444+0000 7fba8a000640 1 --2- 172.21.15.173:0/1398391400 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba60066f60 0x7fba60069420 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.444+0000 7fba8a000640 1 --2- 172.21.15.173:0/1398391400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba8415edd0 0x7fba84158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.444+0000 7fba8a000640 1 --2- 172.21.15.173:0/1398391400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba840b3e70 0x7fba8413f1f0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.444+0000 7fba8a000640 1 --2- 172.21.15.173:0/1398391400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba840aefa0 0x7fba8415ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.444+0000 7fba8a000640 1 -- 172.21.15.173:0/1398391400 >> 172.21.15.173:0/1398391400 conn(0x7fba8406ac90 msgr2=0x7fba840cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:14.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.444+0000 7fba8a000640 1 -- 172.21.15.173:0/1398391400 shutdown_connections 2024-04-25T09:09:14.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.444+0000 7fba8a000640 1 -- 172.21.15.173:0/1398391400 wait complete. 2024-04-25T09:09:14.452 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:09:14.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.600+0000 7f0e0d800640 1 Processor -- start 2024-04-25T09:09:14.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.600+0000 7f0e0d800640 1 -- start start 2024-04-25T09:09:14.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.600+0000 7f0e0d800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0e080cff40 0x7f0e080cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:14.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.600+0000 7f0e0d800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e0815a2e0 0x7f0e080cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:14.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.600+0000 7f0e0d800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0815ddd0 con 0x7f0e08159f00 2024-04-25T09:09:14.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.600+0000 7f0e0d800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e08072330 con 0x7f0e080cff40 2024-04-25T09:09:14.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.600+0000 7f0e0d800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0815e0b0 con 0x7f0e0815a2e0 2024-04-25T09:09:14.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.600+0000 7f0dfe000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0e080cff40 0x7f0e080cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:14.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.600+0000 7f0e06a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f0e08159f00 0x7f0e080cb960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54672/0 (socket says 172.21.15.173:54672) 2024-04-25T09:09:14.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.600+0000 7f0e06a00640 1 -- 172.21.15.173:0/1353058352 learned_addr learned my addr 172.21.15.173:0/1353058352 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:14.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.604+0000 7f0dfe000640 1 -- 172.21.15.173:0/1353058352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e0815a2e0 msgr2=0x7f0e080cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:14.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.604+0000 7f0e07400640 1 --2- 172.21.15.173:0/1353058352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e0815a2e0 0x7f0e080cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:14.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.604+0000 7f0dfe000640 1 --2- 172.21.15.173:0/1353058352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e0815a2e0 0x7f0e080cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.604+0000 7f0dfe000640 1 -- 172.21.15.173:0/1353058352 >> v1:172.21.15.173:6789/0 conn(0x7f0e08159f00 legacy=0x7f0e080cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:14.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.604+0000 7f0dfe000640 1 -- 172.21.15.173:0/1353058352 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0815e390 con 0x7f0e080cff40 2024-04-25T09:09:14.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.604+0000 7f0e07400640 1 --2- 172.21.15.173:0/1353058352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e0815a2e0 0x7f0e080cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:14.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.604+0000 7f0dfe000640 1 --2- 172.21.15.173:0/1353058352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e080cff40 0x7f0e080cd2f0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f0df00097c0 tx=0x7f0df001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40d1290fc4afaea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:14.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.604+0000 7f0e06000640 1 -- 172.21.15.173:0/1353058352 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df00b1070 con 0x7f0e080cff40 2024-04-25T09:09:14.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.604+0000 7f0e06000640 1 -- 172.21.15.173:0/1353058352 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df00ac410 con 0x7f0e080cff40 2024-04-25T09:09:14.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.604+0000 7f0e06000640 1 -- 172.21.15.173:0/1353058352 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df00ac7e0 con 0x7f0e080cff40 2024-04-25T09:09:14.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.604+0000 7f0e0d800640 1 -- 172.21.15.173:0/1353058352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e080cff40 msgr2=0x7f0e080cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:14.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e0d800640 1 --2- 172.21.15.173:0/1353058352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e080cff40 0x7f0e080cd2f0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f0df00097c0 tx=0x7f0df001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e0d800640 1 -- 172.21.15.173:0/1353058352 shutdown_connections 2024-04-25T09:09:14.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e0d800640 1 --2- 172.21.15.173:0/1353058352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e0815a2e0 0x7f0e080cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e0d800640 1 --2- 172.21.15.173:0/1353058352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e080cff40 0x7f0e080cd2f0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e0d800640 1 -- 172.21.15.173:0/1353058352 >> 172.21.15.173:0/1353058352 conn(0x7f0e0806ac90 msgr2=0x7f0e0806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:14.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e0d800640 1 -- 172.21.15.173:0/1353058352 shutdown_connections 2024-04-25T09:09:14.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e0d800640 1 -- 172.21.15.173:0/1353058352 wait complete. 2024-04-25T09:09:14.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e0d800640 1 Processor -- start 2024-04-25T09:09:14.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e0d800640 1 -- start start 2024-04-25T09:09:14.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e0d800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e080cff40 0x7f0e0815b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:14.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e0d800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e08159f00 0x7f0e0806d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:14.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e0d800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e0815a2e0 0x7f0e08149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:14.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e0d800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080716b0 con 0x7f0e080cff40 2024-04-25T09:09:14.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e0d800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e08071530 con 0x7f0e08159f00 2024-04-25T09:09:14.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e0d800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e08071830 con 0x7f0e0815a2e0 2024-04-25T09:09:14.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e06a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e080cff40 0x7f0e0815b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:14.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e06a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e080cff40 0x7f0e0815b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46698/0 (socket says 172.21.15.173:46698) 2024-04-25T09:09:14.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e06a00640 1 -- 172.21.15.173:0/3173999624 learned_addr learned my addr 172.21.15.173:0/3173999624 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:14.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e06a00640 1 -- 172.21.15.173:0/3173999624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e0815a2e0 msgr2=0x7f0e08149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:14.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e06a00640 1 --2- 172.21.15.173:0/3173999624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e0815a2e0 0x7f0e08149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e06a00640 1 -- 172.21.15.173:0/3173999624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e08159f00 msgr2=0x7f0e0806d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:14.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e06a00640 1 --2- 172.21.15.173:0/3173999624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e08159f00 0x7f0e0806d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e06a00640 1 -- 172.21.15.173:0/3173999624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0815c550 con 0x7f0e080cff40 2024-04-25T09:09:14.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.608+0000 7f0e06a00640 1 --2- 172.21.15.173:0/3173999624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e080cff40 0x7f0e0815b0d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f0df800cb10 tx=0x7f0df800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:14.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.612+0000 7f0dff400640 1 -- 172.21.15.173:0/3173999624 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df8017070 con 0x7f0e080cff40 2024-04-25T09:09:14.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.612+0000 7f0dff400640 1 -- 172.21.15.173:0/3173999624 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df800ac90 con 0x7f0e080cff40 2024-04-25T09:09:14.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.612+0000 7f0e0d800640 1 -- 172.21.15.173:0/3173999624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0815b9d0 con 0x7f0e080cff40 2024-04-25T09:09:14.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.612+0000 7f0dff400640 1 -- 172.21.15.173:0/3173999624 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df8012640 con 0x7f0e080cff40 2024-04-25T09:09:14.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.612+0000 7f0e0d800640 1 -- 172.21.15.173:0/3173999624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0815bf90 con 0x7f0e080cff40 2024-04-25T09:09:14.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.612+0000 7f0e0d800640 1 -- 172.21.15.173:0/3173999624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e08073ab0 con 0x7f0e080cff40 2024-04-25T09:09:14.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.612+0000 7f0dff400640 1 -- 172.21.15.173:0/3173999624 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0df801a070 con 0x7f0e080cff40 2024-04-25T09:09:14.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.612+0000 7f0dff400640 1 --2- 172.21.15.173:0/3173999624 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0de4066f90 0x7f0de4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:14.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.612+0000 7f0dff400640 1 -- 172.21.15.173:0/3173999624 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f0df8084ef0 con 0x7f0e080cff40 2024-04-25T09:09:14.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.612+0000 7f0dfe000640 1 --2- 172.21.15.173:0/3173999624 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0de4066f90 0x7f0de4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:14.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.616+0000 7f0dfe000640 1 --2- 172.21.15.173:0/3173999624 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0de4066f90 0x7f0de4069450 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0df00ae000 tx=0x7f0df0004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:14.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.616+0000 7f0dff400640 1 -- 172.21.15.173:0/3173999624 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0df8055d40 con 0x7f0e080cff40 2024-04-25T09:09:14.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.804+0000 7f0e0d800640 1 -- 172.21.15.173:0/3173999624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0e080ccb20 con 0x7f0e080cff40 2024-04-25T09:09:14.795 INFO:tasks.ceph.mon.a.smithi173.stderr:2024-04-25T09:09:14.808+0000 7f537be00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:09:14.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.808+0000 7f0dff400640 1 -- 172.21.15.173:0/3173999624 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0df8055640 con 0x7f0e080cff40 2024-04-25T09:09:14.798 INFO:teuthology.orchestra.run.smithi173.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:09:14.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.812+0000 7f0e0d800640 1 -- 172.21.15.173:0/3173999624 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0de4066f90 msgr2=0x7f0de4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:14.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.812+0000 7f0e0d800640 1 --2- 172.21.15.173:0/3173999624 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0de4066f90 0x7f0de4069450 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0df00ae000 tx=0x7f0df0004740 comp rx=0 tx=0).stop 2024-04-25T09:09:14.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.812+0000 7f0e0d800640 1 -- 172.21.15.173:0/3173999624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e080cff40 msgr2=0x7f0e0815b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:14.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.812+0000 7f0e0d800640 1 --2- 172.21.15.173:0/3173999624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e080cff40 0x7f0e0815b0d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f0df800cb10 tx=0x7f0df800a060 comp rx=0 tx=0).stop 2024-04-25T09:09:14.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.812+0000 7f0e0d800640 1 -- 172.21.15.173:0/3173999624 shutdown_connections 2024-04-25T09:09:14.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.812+0000 7f0e0d800640 1 --2- 172.21.15.173:0/3173999624 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0de4066f90 0x7f0de4069450 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.812+0000 7f0e0d800640 1 --2- 172.21.15.173:0/3173999624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e0815a2e0 0x7f0e08149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.812+0000 7f0e0d800640 1 --2- 172.21.15.173:0/3173999624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e08159f00 0x7f0e0806d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.812+0000 7f0e0d800640 1 --2- 172.21.15.173:0/3173999624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e080cff40 0x7f0e0815b0d0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.812+0000 7f0e0d800640 1 -- 172.21.15.173:0/3173999624 >> 172.21.15.173:0/3173999624 conn(0x7f0e0806ac90 msgr2=0x7f0e0814fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:14.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.812+0000 7f0e0d800640 1 -- 172.21.15.173:0/3173999624 shutdown_connections 2024-04-25T09:09:14.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.812+0000 7f0e0d800640 1 -- 172.21.15.173:0/3173999624 wait complete. 2024-04-25T09:09:14.823 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:09:14.873 INFO:tasks.ceph.mds.a.smithi173.stdout:starting mds.a at 2024-04-25T09:09:14.926 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:09:14.929 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:09:14.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.980+0000 7fede9a00640 1 Processor -- start 2024-04-25T09:09:14.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.980+0000 7fede9a00640 1 -- start start 2024-04-25T09:09:14.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.980+0000 7fede9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fede4158340 0x7fede40b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:14.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.980+0000 7fede9a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fede40af810 0x7fede40d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:14.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.980+0000 7fede9a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede40b5120 con 0x7fede40af3b0 2024-04-25T09:09:14.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.980+0000 7fede9a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede40b53c0 con 0x7fede40af810 2024-04-25T09:09:14.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.980+0000 7fede9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede40b56a0 con 0x7fede4158340 2024-04-25T09:09:14.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.980+0000 7fede3400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fede40af810 0x7fede40d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:14.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.980+0000 7fede3400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fede40af810 0x7fede40d0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46738/0 (socket says 172.21.15.173:46738) 2024-04-25T09:09:14.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.980+0000 7fede3400640 1 -- 172.21.15.173:0/540103219 learned_addr learned my addr 172.21.15.173:0/540103219 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:14.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.980+0000 7fede2a00640 1 --2- 172.21.15.173:0/540103219 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fede4158340 0x7fede40b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:14.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.980+0000 7fede3400640 1 -- 172.21.15.173:0/540103219 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fede4158340 msgr2=0x7fede40b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:14.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.980+0000 7fede3400640 1 --2- 172.21.15.173:0/540103219 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fede4158340 0x7fede40b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.980+0000 7fede3400640 1 -- 172.21.15.173:0/540103219 >> v1:172.21.15.194:6789/0 conn(0x7fede40af3b0 legacy=0x7fede40d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:14.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.980+0000 7fede3400640 1 -- 172.21.15.173:0/540103219 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede406ff60 con 0x7fede40af810 2024-04-25T09:09:14.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.984+0000 7fede3400640 1 --2- 172.21.15.173:0/540103219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede40af810 0x7fede40d0dd0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7feddc009e50 tx=0x7feddc01d450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4bbc469941f03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:14.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.984+0000 7fede1600640 1 -- 172.21.15.173:0/540103219 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc0a5780 con 0x7fede40af810 2024-04-25T09:09:14.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.984+0000 7fede1600640 1 -- 172.21.15.173:0/540103219 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc0a5920 con 0x7fede40af810 2024-04-25T09:09:14.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.984+0000 7fede1600640 1 -- 172.21.15.173:0/540103219 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc0a5cf0 con 0x7fede40af810 2024-04-25T09:09:14.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.984+0000 7fede9a00640 1 -- 172.21.15.173:0/540103219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede40af810 msgr2=0x7fede40d0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:14.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.984+0000 7fede9a00640 1 --2- 172.21.15.173:0/540103219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede40af810 0x7fede40d0dd0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7feddc009e50 tx=0x7feddc01d450 comp rx=0 tx=0).stop 2024-04-25T09:09:14.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.984+0000 7fede9a00640 1 -- 172.21.15.173:0/540103219 shutdown_connections 2024-04-25T09:09:14.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.984+0000 7fede9a00640 1 --2- 172.21.15.173:0/540103219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede40af810 0x7fede40d0dd0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.984+0000 7fede9a00640 1 --2- 172.21.15.173:0/540103219 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fede4158340 0x7fede40b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.984+0000 7fede9a00640 1 -- 172.21.15.173:0/540103219 >> 172.21.15.173:0/540103219 conn(0x7fede40b5b00 msgr2=0x7fede40b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:14.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.984+0000 7fede9a00640 1 -- 172.21.15.173:0/540103219 shutdown_connections 2024-04-25T09:09:14.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.984+0000 7fede9a00640 1 -- 172.21.15.173:0/540103219 wait complete. 2024-04-25T09:09:14.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede9a00640 1 Processor -- start 2024-04-25T09:09:14.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede9a00640 1 -- start start 2024-04-25T09:09:14.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede9a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede40af3b0 0x7fede41526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:14.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede9a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fede40af810 0x7fede413e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:14.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fede4158340 0x7fede4160620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:14.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede9a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede40b3c60 con 0x7fede40af3b0 2024-04-25T09:09:14.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede9a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede40b3ae0 con 0x7fede40af810 2024-04-25T09:09:14.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede40d1310 con 0x7fede4158340 2024-04-25T09:09:14.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede40af3b0 0x7fede41526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:14.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede40af3b0 0x7fede41526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46754/0 (socket says 172.21.15.173:46754) 2024-04-25T09:09:14.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede2a00640 1 -- 172.21.15.173:0/2791425836 learned_addr learned my addr 172.21.15.173:0/2791425836 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede2000640 1 --2- 172.21.15.173:0/2791425836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fede40af810 0x7fede413e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede3400640 1 --2- 172.21.15.173:0/2791425836 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fede4158340 0x7fede4160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede2a00640 1 -- 172.21.15.173:0/2791425836 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fede4158340 msgr2=0x7fede4160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede2a00640 1 --2- 172.21.15.173:0/2791425836 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fede4158340 0x7fede4160620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede2a00640 1 -- 172.21.15.173:0/2791425836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fede40af810 msgr2=0x7fede413e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede2a00640 1 --2- 172.21.15.173:0/2791425836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fede40af810 0x7fede413e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede2a00640 1 -- 172.21.15.173:0/2791425836 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede4147aa0 con 0x7fede40af3b0 2024-04-25T09:09:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede2a00640 1 --2- 172.21.15.173:0/2791425836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede40af3b0 0x7fede41526b0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fedd400d5f0 tx=0x7fedd400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7feddaa00640 1 -- 172.21.15.173:0/2791425836 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd40125f0 con 0x7fede40af3b0 2024-04-25T09:09:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7feddaa00640 1 -- 172.21.15.173:0/2791425836 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd4019070 con 0x7fede40af3b0 2024-04-25T09:09:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7feddaa00640 1 -- 172.21.15.173:0/2791425836 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd40129b0 con 0x7fede40af3b0 2024-04-25T09:09:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede9a00640 1 -- 172.21.15.173:0/2791425836 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede4150be0 con 0x7fede40af3b0 2024-04-25T09:09:14.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.988+0000 7fede9a00640 1 -- 172.21.15.173:0/2791425836 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede41409d0 con 0x7fede40af3b0 2024-04-25T09:09:14.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.992+0000 7fede9a00640 1 -- 172.21.15.173:0/2791425836 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede406cd30 con 0x7fede40af3b0 2024-04-25T09:09:14.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.992+0000 7feddaa00640 1 -- 172.21.15.173:0/2791425836 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fedd4012b50 con 0x7fede40af3b0 2024-04-25T09:09:14.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.992+0000 7feddaa00640 1 --2- 172.21.15.173:0/2791425836 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fedc4066f60 0x7fedc4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:14.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.992+0000 7feddaa00640 1 -- 172.21.15.173:0/2791425836 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fedd40856f0 con 0x7fede40af3b0 2024-04-25T09:09:14.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.992+0000 7fede2000640 1 --2- 172.21.15.173:0/2791425836 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fedc4066f60 0x7fedc4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:14.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.992+0000 7fede2000640 1 --2- 172.21.15.173:0/2791425836 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fedc4066f60 0x7fedc4069420 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fede414f4c0 tx=0x7fedd0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:14.996+0000 7feddaa00640 1 -- 172.21.15.173:0/2791425836 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fedd40563f0 con 0x7fede40af3b0 2024-04-25T09:09:15.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:15.184+0000 7fede9a00640 1 -- 172.21.15.173:0/2791425836 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fede4073ab0 con 0x7fede40af3b0 2024-04-25T09:09:15.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:15.812+0000 7feddaa00640 1 -- 172.21.15.173:0/2791425836 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) v1 ==== 104+0+0 (secure 0 0 0) 0x7fedd4055cf0 con 0x7fede40af3b0 2024-04-25T09:09:15.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:15.816+0000 7fede9a00640 1 -- 172.21.15.173:0/2791425836 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fedc4066f60 msgr2=0x7fedc4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:15.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:15.816+0000 7fede9a00640 1 --2- 172.21.15.173:0/2791425836 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fedc4066f60 0x7fedc4069420 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fede414f4c0 tx=0x7fedd0009040 comp rx=0 tx=0).stop 2024-04-25T09:09:15.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:15.816+0000 7fede9a00640 1 -- 172.21.15.173:0/2791425836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede40af3b0 msgr2=0x7fede41526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:15.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:15.816+0000 7fede9a00640 1 --2- 172.21.15.173:0/2791425836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede40af3b0 0x7fede41526b0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fedd400d5f0 tx=0x7fedd400dab0 comp rx=0 tx=0).stop 2024-04-25T09:09:15.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:15.816+0000 7fede9a00640 1 -- 172.21.15.173:0/2791425836 shutdown_connections 2024-04-25T09:09:15.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:15.816+0000 7fede9a00640 1 --2- 172.21.15.173:0/2791425836 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fedc4066f60 0x7fedc4069420 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:15.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:15.816+0000 7fede9a00640 1 --2- 172.21.15.173:0/2791425836 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fede4158340 0x7fede4160620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:15.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:15.816+0000 7fede9a00640 1 --2- 172.21.15.173:0/2791425836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fede40af810 0x7fede413e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:15.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:15.816+0000 7fede9a00640 1 --2- 172.21.15.173:0/2791425836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede40af3b0 0x7fede41526b0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:15.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:15.816+0000 7fede9a00640 1 -- 172.21.15.173:0/2791425836 >> 172.21.15.173:0/2791425836 conn(0x7fede40b5b00 msgr2=0x7fede40b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:15.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:15.816+0000 7fede9a00640 1 -- 172.21.15.173:0/2791425836 shutdown_connections 2024-04-25T09:09:15.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:15.816+0000 7fede9a00640 1 -- 172.21.15.173:0/2791425836 wait complete. 2024-04-25T09:09:15.823 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:09:16.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.016+0000 7f8399c00640 1 Processor -- start 2024-04-25T09:09:16.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.016+0000 7f8399c00640 1 -- start start 2024-04-25T09:09:16.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.016+0000 7f8399c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f83940cff40 0x7f83940cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.016+0000 7f8399c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f839415a2e0 0x7f83940cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.016+0000 7f8399c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839415ddd0 con 0x7f8394159f00 2024-04-25T09:09:16.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.016+0000 7f8399c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8394072330 con 0x7f83940cff40 2024-04-25T09:09:16.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.016+0000 7f8399c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839415e0b0 con 0x7f839415a2e0 2024-04-25T09:09:16.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.016+0000 7f838a000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f83940cff40 0x7f83940cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:16.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.016+0000 7f838a000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f83940cff40 0x7f83940cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46764/0 (socket says 172.21.15.173:46764) 2024-04-25T09:09:16.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.016+0000 7f838a000640 1 -- 172.21.15.173:0/772888065 learned_addr learned my addr 172.21.15.173:0/772888065 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:16.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.016+0000 7f8392a00640 1 --1- 172.21.15.173:0/772888065 >> v1:172.21.15.173:6789/0 conn(0x7f8394159f00 0x7f83940cb960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54692/0 (socket says 172.21.15.173:54692) 2024-04-25T09:09:16.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.020+0000 7f8393400640 1 --2- 172.21.15.173:0/772888065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f839415a2e0 0x7f83940cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:16.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.020+0000 7f838a000640 1 -- 172.21.15.173:0/772888065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f839415a2e0 msgr2=0x7f83940cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:16.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.020+0000 7f838a000640 1 --2- 172.21.15.173:0/772888065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f839415a2e0 0x7f83940cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.020+0000 7f838a000640 1 -- 172.21.15.173:0/772888065 >> v1:172.21.15.173:6789/0 conn(0x7f8394159f00 legacy=0x7f83940cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:16.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.020+0000 7f838a000640 1 -- 172.21.15.173:0/772888065 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839415e390 con 0x7f83940cff40 2024-04-25T09:09:16.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.020+0000 7f8392000640 1 -- 172.21.15.173:0/772888065 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329328785 0 0) 0x7f839415ddd0 con 0x7f8394159f00 2024-04-25T09:09:16.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.020+0000 7f838a000640 1 --2- 172.21.15.173:0/772888065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83940cff40 0x7f83940cd2f0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f837c00bb10 tx=0x7f837c01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3adc959fe489b39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:16.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.020+0000 7f8392000640 1 -- 172.21.15.173:0/772888065 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c0b4070 con 0x7f83940cff40 2024-04-25T09:09:16.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.020+0000 7f8392000640 1 -- 172.21.15.173:0/772888065 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c0a7c10 con 0x7f83940cff40 2024-04-25T09:09:16.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.020+0000 7f8392000640 1 -- 172.21.15.173:0/772888065 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c0af440 con 0x7f83940cff40 2024-04-25T09:09:16.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8399c00640 1 -- 172.21.15.173:0/772888065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83940cff40 msgr2=0x7f83940cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:16.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8399c00640 1 --2- 172.21.15.173:0/772888065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83940cff40 0x7f83940cd2f0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f837c00bb10 tx=0x7f837c01ec30 comp rx=0 tx=0).stop 2024-04-25T09:09:16.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8399c00640 1 -- 172.21.15.173:0/772888065 shutdown_connections 2024-04-25T09:09:16.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8399c00640 1 --2- 172.21.15.173:0/772888065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f839415a2e0 0x7f83940cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8399c00640 1 --2- 172.21.15.173:0/772888065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83940cff40 0x7f83940cd2f0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8399c00640 1 -- 172.21.15.173:0/772888065 >> 172.21.15.173:0/772888065 conn(0x7f839406ac90 msgr2=0x7f839406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:16.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8399c00640 1 -- 172.21.15.173:0/772888065 shutdown_connections 2024-04-25T09:09:16.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8399c00640 1 -- 172.21.15.173:0/772888065 wait complete. 2024-04-25T09:09:16.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8399c00640 1 Processor -- start 2024-04-25T09:09:16.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8399c00640 1 -- start start 2024-04-25T09:09:16.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8399c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83940cff40 0x7f839414c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8399c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8394159f00 0x7f8394148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8399c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f839415a2e0 0x7f8394141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8399c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83940716b0 con 0x7f839415a2e0 2024-04-25T09:09:16.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8399c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8394071530 con 0x7f83940cff40 2024-04-25T09:09:16.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8399c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8394071830 con 0x7f8394159f00 2024-04-25T09:09:16.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8393400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f839415a2e0 0x7f8394141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:16.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8393400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f839415a2e0 0x7f8394141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46776/0 (socket says 172.21.15.173:46776) 2024-04-25T09:09:16.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8393400640 1 -- 172.21.15.173:0/1330184589 learned_addr learned my addr 172.21.15.173:0/1330184589 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:16.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8393400640 1 -- 172.21.15.173:0/1330184589 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8394159f00 msgr2=0x7f8394148800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:16.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8393400640 1 --2- 172.21.15.173:0/1330184589 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8394159f00 0x7f8394148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8393400640 1 -- 172.21.15.173:0/1330184589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83940cff40 msgr2=0x7f839414c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:16.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8393400640 1 --2- 172.21.15.173:0/1330184589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83940cff40 0x7f839414c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8393400640 1 -- 172.21.15.173:0/1330184589 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839414c700 con 0x7f839415a2e0 2024-04-25T09:09:16.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8393400640 1 --2- 172.21.15.173:0/1330184589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f839415a2e0 0x7f8394141fa0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f838c007e90 tx=0x7f838c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:16.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f838b400640 1 -- 172.21.15.173:0/1330184589 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c014420 con 0x7f839415a2e0 2024-04-25T09:09:16.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f838b400640 1 -- 172.21.15.173:0/1330184589 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c019070 con 0x7f839415a2e0 2024-04-25T09:09:16.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f838b400640 1 -- 172.21.15.173:0/1330184589 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c014800 con 0x7f839415a2e0 2024-04-25T09:09:16.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.024+0000 7f8399c00640 1 -- 172.21.15.173:0/1330184589 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839414c9e0 con 0x7f839415a2e0 2024-04-25T09:09:16.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.028+0000 7f8399c00640 1 -- 172.21.15.173:0/1330184589 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839414cfa0 con 0x7f839415a2e0 2024-04-25T09:09:16.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.028+0000 7f8399c00640 1 -- 172.21.15.173:0/1330184589 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8394073ab0 con 0x7f839415a2e0 2024-04-25T09:09:16.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.028+0000 7f838b400640 1 -- 172.21.15.173:0/1330184589 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f838c0149a0 con 0x7f839415a2e0 2024-04-25T09:09:16.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.028+0000 7f838b400640 1 --2- 172.21.15.173:0/1330184589 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8370066f60 0x7f8370069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.028+0000 7f838b400640 1 -- 172.21.15.173:0/1330184589 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f838c085ae0 con 0x7f839415a2e0 2024-04-25T09:09:16.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.028+0000 7f8392a00640 1 --2- 172.21.15.173:0/1330184589 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8370066f60 0x7f8370069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:16.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.028+0000 7f8392a00640 1 --2- 172.21.15.173:0/1330184589 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8370066f60 0x7f8370069420 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f83840011f0 tx=0x7f8384007950 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:16.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.032+0000 7f838b400640 1 -- 172.21.15.173:0/1330184589 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f838c056870 con 0x7f839415a2e0 2024-04-25T09:09:16.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.188+0000 7f8399c00640 1 -- 172.21.15.173:0/1330184589 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f83940ccb20 con 0x7f839415a2e0 2024-04-25T09:09:16.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.816+0000 7f838b400640 1 -- 172.21.15.173:0/1330184589 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v88) v1 ==== 181+0+0 (secure 0 0 0) 0x7f838c085020 con 0x7f839415a2e0 2024-04-25T09:09:16.803 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:09:16.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.816+0000 7f8399c00640 1 -- 172.21.15.173:0/1330184589 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8370066f60 msgr2=0x7f8370069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:16.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.816+0000 7f8399c00640 1 --2- 172.21.15.173:0/1330184589 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8370066f60 0x7f8370069420 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f83840011f0 tx=0x7f8384007950 comp rx=0 tx=0).stop 2024-04-25T09:09:16.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.816+0000 7f8399c00640 1 -- 172.21.15.173:0/1330184589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f839415a2e0 msgr2=0x7f8394141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:16.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.816+0000 7f8399c00640 1 --2- 172.21.15.173:0/1330184589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f839415a2e0 0x7f8394141fa0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f838c007e90 tx=0x7f838c00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.816+0000 7f8399c00640 1 -- 172.21.15.173:0/1330184589 shutdown_connections 2024-04-25T09:09:16.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.816+0000 7f8399c00640 1 --2- 172.21.15.173:0/1330184589 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8370066f60 0x7f8370069420 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.816+0000 7f8399c00640 1 --2- 172.21.15.173:0/1330184589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f839415a2e0 0x7f8394141fa0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.816+0000 7f8399c00640 1 --2- 172.21.15.173:0/1330184589 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8394159f00 0x7f8394148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.816+0000 7f8399c00640 1 --2- 172.21.15.173:0/1330184589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83940cff40 0x7f839414c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.816+0000 7f8399c00640 1 -- 172.21.15.173:0/1330184589 >> 172.21.15.173:0/1330184589 conn(0x7f839406ac90 msgr2=0x7f839406d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:16.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.816+0000 7f8399c00640 1 -- 172.21.15.173:0/1330184589 shutdown_connections 2024-04-25T09:09:16.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.816+0000 7f8399c00640 1 -- 172.21.15.173:0/1330184589 wait complete. 2024-04-25T09:09:16.838 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:09:16.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.988+0000 7fc40f200640 1 Processor -- start 2024-04-25T09:09:16.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.988+0000 7fc40f200640 1 -- start start 2024-04-25T09:09:16.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.992+0000 7fc40f200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc4080aeb90 0x7fc4080cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.992+0000 7fc40f200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc4080ce2b0 0x7fc4080cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.992+0000 7fc40f200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc408071570 con 0x7fc4080aef70 2024-04-25T09:09:16.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.992+0000 7fc40f200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc408071320 con 0x7fc4080aeb90 2024-04-25T09:09:16.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.992+0000 7fc40f200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc408072330 con 0x7fc4080ce2b0 2024-04-25T09:09:16.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.992+0000 7fc407e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc4080aeb90 0x7fc4080cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:16.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.992+0000 7fc407e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc4080aeb90 0x7fc4080cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46786/0 (socket says 172.21.15.173:46786) 2024-04-25T09:09:16.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.992+0000 7fc407e00640 1 -- 172.21.15.173:0/1126618470 learned_addr learned my addr 172.21.15.173:0/1126618470 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:16.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.992+0000 7fc407e00640 1 -- 172.21.15.173:0/1126618470 >> v2:172.21.15.194:3300/0 conn(0x7fc4080ce2b0 msgr2=0x7fc4080cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:16.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.992+0000 7fc407e00640 1 --2- 172.21.15.173:0/1126618470 >> v2:172.21.15.194:3300/0 conn(0x7fc4080ce2b0 0x7fc4080cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.992+0000 7fc407e00640 1 -- 172.21.15.173:0/1126618470 >> v1:172.21.15.173:6789/0 conn(0x7fc4080aef70 legacy=0x7fc4080cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:16.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.992+0000 7fc407e00640 1 -- 172.21.15.173:0/1126618470 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc408071850 con 0x7fc4080aeb90 2024-04-25T09:09:16.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc407e00640 1 --2- 172.21.15.173:0/1126618470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4080aeb90 0x7fc4080cc0d0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fc40815e4f0 tx=0x7fc3f801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f1f9261e72cdf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:16.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc406a00640 1 -- 172.21.15.173:0/1126618470 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f80a56f0 con 0x7fc4080aeb90 2024-04-25T09:09:16.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc406a00640 1 -- 172.21.15.173:0/1126618470 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f80a5890 con 0x7fc4080aeb90 2024-04-25T09:09:16.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc406a00640 1 -- 172.21.15.173:0/1126618470 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f80a5c60 con 0x7fc4080aeb90 2024-04-25T09:09:16.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40f200640 1 -- 172.21.15.173:0/1126618470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4080aeb90 msgr2=0x7fc4080cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:16.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40f200640 1 --2- 172.21.15.173:0/1126618470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4080aeb90 0x7fc4080cc0d0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fc40815e4f0 tx=0x7fc3f801c930 comp rx=0 tx=0).stop 2024-04-25T09:09:16.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40f200640 1 -- 172.21.15.173:0/1126618470 shutdown_connections 2024-04-25T09:09:16.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40f200640 1 --2- 172.21.15.173:0/1126618470 >> v2:172.21.15.194:3300/0 conn(0x7fc4080ce2b0 0x7fc4080cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40f200640 1 --2- 172.21.15.173:0/1126618470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4080aeb90 0x7fc4080cc0d0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40f200640 1 -- 172.21.15.173:0/1126618470 >> 172.21.15.173:0/1126618470 conn(0x7fc40806ac90 msgr2=0x7fc40806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:16.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40f200640 1 -- 172.21.15.173:0/1126618470 shutdown_connections 2024-04-25T09:09:16.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40f200640 1 -- 172.21.15.173:0/1126618470 wait complete. 2024-04-25T09:09:16.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40f200640 1 Processor -- start 2024-04-25T09:09:16.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40f200640 1 -- start start 2024-04-25T09:09:16.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4080aeb90 0x7fc40814b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4080aef70 0x7fc408143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40f200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4080ce2b0 0x7fc4080b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40f200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40815bb30 con 0x7fc4080ce2b0 2024-04-25T09:09:16.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40815b9b0 con 0x7fc4080aef70 2024-04-25T09:09:16.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40815bcb0 con 0x7fc4080aeb90 2024-04-25T09:09:16.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4080ce2b0 0x7fc4080b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:16.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4080ce2b0 0x7fc4080b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46790/0 (socket says 172.21.15.173:46790) 2024-04-25T09:09:16.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:16.996+0000 7fc40d200640 1 -- 172.21.15.173:0/1034214044 learned_addr learned my addr 172.21.15.173:0/1034214044 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:16.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.000+0000 7fc407e00640 1 --2- 172.21.15.173:0/1034214044 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4080aeb90 0x7fc40814b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:16.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.000+0000 7fc407400640 1 --2- 172.21.15.173:0/1034214044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4080aef70 0x7fc408143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:16.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.000+0000 7fc40d200640 1 -- 172.21.15.173:0/1034214044 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4080aeb90 msgr2=0x7fc40814b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:16.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.000+0000 7fc40d200640 1 --2- 172.21.15.173:0/1034214044 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4080aeb90 0x7fc40814b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.000+0000 7fc40d200640 1 -- 172.21.15.173:0/1034214044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4080aef70 msgr2=0x7fc408143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:16.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.000+0000 7fc40d200640 1 --2- 172.21.15.173:0/1034214044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4080aef70 0x7fc408143590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.000+0000 7fc40d200640 1 -- 172.21.15.173:0/1034214044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4080b17c0 con 0x7fc4080ce2b0 2024-04-25T09:09:16.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.000+0000 7fc40d200640 1 --2- 172.21.15.173:0/1034214044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4080ce2b0 0x7fc4080b2d80 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fc40000b460 tx=0x7fc40000b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:16.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.000+0000 7fc3ffe00640 1 -- 172.21.15.173:0/1034214044 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc400015020 con 0x7fc4080ce2b0 2024-04-25T09:09:16.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.000+0000 7fc3ffe00640 1 -- 172.21.15.173:0/1034214044 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc400011890 con 0x7fc4080ce2b0 2024-04-25T09:09:16.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.000+0000 7fc3ffe00640 1 -- 172.21.15.173:0/1034214044 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc400011c80 con 0x7fc4080ce2b0 2024-04-25T09:09:16.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.000+0000 7fc40f200640 1 -- 172.21.15.173:0/1034214044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4080b1aa0 con 0x7fc4080ce2b0 2024-04-25T09:09:16.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.000+0000 7fc40f200640 1 -- 172.21.15.173:0/1034214044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4080b2060 con 0x7fc4080ce2b0 2024-04-25T09:09:16.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.000+0000 7fc40f200640 1 -- 172.21.15.173:0/1034214044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc408073ab0 con 0x7fc4080ce2b0 2024-04-25T09:09:16.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.000+0000 7fc3ffe00640 1 -- 172.21.15.173:0/1034214044 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc400018020 con 0x7fc4080ce2b0 2024-04-25T09:09:16.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.004+0000 7fc3ffe00640 1 --2- 172.21.15.173:0/1034214044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc3e8066f60 0x7fc3e8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.004+0000 7fc3ffe00640 1 -- 172.21.15.173:0/1034214044 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5749+0+0 (secure 0 0 0) 0x7fc400085220 con 0x7fc4080ce2b0 2024-04-25T09:09:16.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.004+0000 7fc407e00640 1 --2- 172.21.15.173:0/1034214044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc3e8066f60 0x7fc3e8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:16.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.004+0000 7fc407e00640 1 --2- 172.21.15.173:0/1034214044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc3e8066f60 0x7fc3e8069420 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc3f80ae000 tx=0x7fc3f80a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:16.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.004+0000 7fc3ffe00640 1 -- 172.21.15.173:0/1034214044 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc40001f020 con 0x7fc4080ce2b0 2024-04-25T09:09:17.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.160+0000 7fc40f200640 1 -- 172.21.15.173:0/1034214044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc4080686c0 con 0x7fc4080ce2b0 2024-04-25T09:09:17.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.816+0000 7fc3ffe00640 1 -- 172.21.15.173:0/1034214044 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v89) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc40000d040 con 0x7fc4080ce2b0 2024-04-25T09:09:17.805 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' removed 2024-04-25T09:09:17.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.820+0000 7fc40f200640 1 -- 172.21.15.173:0/1034214044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc3e8066f60 msgr2=0x7fc3e8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.820+0000 7fc40f200640 1 --2- 172.21.15.173:0/1034214044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc3e8066f60 0x7fc3e8069420 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc3f80ae000 tx=0x7fc3f80a7070 comp rx=0 tx=0).stop 2024-04-25T09:09:17.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.820+0000 7fc40f200640 1 -- 172.21.15.173:0/1034214044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4080ce2b0 msgr2=0x7fc4080b2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.820+0000 7fc40f200640 1 --2- 172.21.15.173:0/1034214044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4080ce2b0 0x7fc4080b2d80 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fc40000b460 tx=0x7fc40000b920 comp rx=0 tx=0).stop 2024-04-25T09:09:17.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.820+0000 7fc40f200640 1 -- 172.21.15.173:0/1034214044 shutdown_connections 2024-04-25T09:09:17.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.820+0000 7fc40f200640 1 --2- 172.21.15.173:0/1034214044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc3e8066f60 0x7fc3e8069420 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.820+0000 7fc40f200640 1 --2- 172.21.15.173:0/1034214044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4080ce2b0 0x7fc4080b2d80 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.820+0000 7fc40f200640 1 --2- 172.21.15.173:0/1034214044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4080aef70 0x7fc408143590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.820+0000 7fc40f200640 1 --2- 172.21.15.173:0/1034214044 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4080aeb90 0x7fc40814b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.820+0000 7fc40f200640 1 -- 172.21.15.173:0/1034214044 >> 172.21.15.173:0/1034214044 conn(0x7fc40806ac90 msgr2=0x7fc40814c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:17.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.820+0000 7fc40f200640 1 -- 172.21.15.173:0/1034214044 shutdown_connections 2024-04-25T09:09:17.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.824+0000 7fc40f200640 1 -- 172.21.15.173:0/1034214044 wait complete. 2024-04-25T09:09:17.838 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:09:17.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.988+0000 7f88fb200640 1 Processor -- start 2024-04-25T09:09:17.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.988+0000 7f88fb200640 1 -- start start 2024-04-25T09:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.988+0000 7f88fb200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f406c3b0 0x7f88f40ad880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.988+0000 7f88fb200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f40728b0 con 0x7f88f406f650 2024-04-25T09:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.988+0000 7f88fb200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f4072b90 con 0x7f88f415b980 2024-04-25T09:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.988+0000 7f88fb200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40af4c0 con 0x7f88f406c3b0 2024-04-25T09:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.988+0000 7f88fa800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f88f406f650 0x7f88f406dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54702/0 (socket says 172.21.15.173:54702) 2024-04-25T09:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.988+0000 7f88fa800640 1 -- 172.21.15.173:0/3848007579 learned_addr learned my addr 172.21.15.173:0/3848007579 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.988+0000 7f88f9400640 1 --2- 172.21.15.173:0/3848007579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f406c3b0 0x7f88f40ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.988+0000 7f88f8a00640 1 -- 172.21.15.173:0/3848007579 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900704257 0 0) 0x7f88f40728b0 con 0x7f88f406f650 2024-04-25T09:09:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88f8a00640 1 -- 172.21.15.173:0/3848007579 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88dc003530 con 0x7f88f406f650 2024-04-25T09:09:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88f8a00640 1 -- 172.21.15.173:0/3848007579 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2853552505 0 0) 0x7f88dc003530 con 0x7f88f406f650 2024-04-25T09:09:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88f8a00640 1 -- 172.21.15.173:0/3848007579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f406c3b0 msgr2=0x7f88f40ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88f8a00640 1 --2- 172.21.15.173:0/3848007579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f406c3b0 0x7f88f40ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88f8a00640 1 -- 172.21.15.173:0/3848007579 >> v1:172.21.15.194:6789/0 conn(0x7f88f415b980 legacy=0x7f88f406bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88f8a00640 1 -- 172.21.15.173:0/3848007579 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f40af120 con 0x7f88f406f650 2024-04-25T09:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88f8a00640 1 -- 172.21.15.173:0/3848007579 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f88f0001a00 con 0x7f88f406f650 2024-04-25T09:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88f8a00640 1 -- 172.21.15.173:0/3848007579 >> v1:172.21.15.173:6789/0 conn(0x7f88f406f650 legacy=0x7f88f406dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88f8a00640 1 --2- 172.21.15.173:0/3848007579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f406c3b0 0x7f88dc0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88f8a00640 1 --2- 172.21.15.173:0/3848007579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88dc003f70 0x7f88dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88f8a00640 1 --2- 172.21.15.173:0/3848007579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88dc004d50 0x7f88dc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88f8a00640 1 -- 172.21.15.173:0/3848007579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40af4c0 con 0x7f88dc004d50 2024-04-25T09:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88f8a00640 1 -- 172.21.15.173:0/3848007579 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc00bab0 con 0x7f88dc003f70 2024-04-25T09:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88f8a00640 1 -- 172.21.15.173:0/3848007579 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc00bcb0 con 0x7f88f406c3b0 2024-04-25T09:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88fa800640 1 --2- 172.21.15.173:0/3848007579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88dc004d50 0x7f88dc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88f9e00640 1 --2- 172.21.15.173:0/3848007579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f406c3b0 0x7f88dc0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88f9400640 1 --2- 172.21.15.173:0/3848007579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88dc003f70 0x7f88dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88fa800640 1 -- 172.21.15.173:0/3848007579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f406c3b0 msgr2=0x7f88dc0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88fa800640 1 --2- 172.21.15.173:0/3848007579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f406c3b0 0x7f88dc0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88fa800640 1 -- 172.21.15.173:0/3848007579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88dc003f70 msgr2=0x7f88dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88fa800640 1 --2- 172.21.15.173:0/3848007579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88dc003f70 0x7f88dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88fa800640 1 -- 172.21.15.173:0/3848007579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc003530 con 0x7f88dc004d50 2024-04-25T09:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88f9e00640 1 --2- 172.21.15.173:0/3848007579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f406c3b0 0x7f88dc0039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:17.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.992+0000 7f88fa800640 1 --2- 172.21.15.173:0/3848007579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88dc004d50 0x7f88dc0051d0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f88f000a850 tx=0x7f88f001d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38399a03bac1ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:17.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88f8a00640 1 -- 172.21.15.173:0/3848007579 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f000a4a0 con 0x7f88dc004d50 2024-04-25T09:09:17.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88f8a00640 1 -- 172.21.15.173:0/3848007579 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f00ad650 con 0x7f88dc004d50 2024-04-25T09:09:17.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88f8a00640 1 -- 172.21.15.173:0/3848007579 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f00ada80 con 0x7f88dc004d50 2024-04-25T09:09:17.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88fb200640 1 -- 172.21.15.173:0/3848007579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88dc004d50 msgr2=0x7f88dc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88fb200640 1 --2- 172.21.15.173:0/3848007579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88dc004d50 0x7f88dc0051d0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f88f000a850 tx=0x7f88f001d3a0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88fa800640 1 -- 172.21.15.173:0/3848007579 reap_dead start 2024-04-25T09:09:17.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88fb200640 1 -- 172.21.15.173:0/3848007579 shutdown_connections 2024-04-25T09:09:17.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88fb200640 1 -- 172.21.15.173:0/3848007579 >> 172.21.15.173:0/3848007579 conn(0x7f88f4071b80 msgr2=0x7f88f4071f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:17.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88fb200640 1 -- 172.21.15.173:0/3848007579 shutdown_connections 2024-04-25T09:09:17.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88fb200640 1 -- 172.21.15.173:0/3848007579 wait complete. 2024-04-25T09:09:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88fb200640 1 Processor -- start 2024-04-25T09:09:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88fb200640 1 -- start start 2024-04-25T09:09:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88fb200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88dc004d50 0x7f88f40ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88fb200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f4099cb0 0x7f88f4159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88fb200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f409a130 0x7f88f415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88fb200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f406e2e0 con 0x7f88f4099cb0 2024-04-25T09:09:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88fb200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40adb10 con 0x7f88dc004d50 2024-04-25T09:09:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88fb200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f406e460 con 0x7f88f409a130 2024-04-25T09:09:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88f9400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f4099cb0 0x7f88f4159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88f9400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f4099cb0 0x7f88f4159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46810/0 (socket says 172.21.15.173:46810) 2024-04-25T09:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88f9400640 1 -- 172.21.15.173:0/584993474 learned_addr learned my addr 172.21.15.173:0/584993474 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88f9e00640 1 --2- 172.21.15.173:0/584993474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88dc004d50 0x7f88f40ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:17.996+0000 7f88fa800640 1 --2- 172.21.15.173:0/584993474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f409a130 0x7f88f415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.000+0000 7f88f9400640 1 -- 172.21.15.173:0/584993474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f409a130 msgr2=0x7f88f415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.000+0000 7f88f9400640 1 --2- 172.21.15.173:0/584993474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f409a130 0x7f88f415a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.000+0000 7f88f9400640 1 -- 172.21.15.173:0/584993474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88dc004d50 msgr2=0x7f88f40ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.000+0000 7f88f9400640 1 --2- 172.21.15.173:0/584993474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88dc004d50 0x7f88f40ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.000+0000 7f88f9400640 1 -- 172.21.15.173:0/584993474 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f409ba00 con 0x7f88f4099cb0 2024-04-25T09:09:17.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.000+0000 7f88f9400640 1 --2- 172.21.15.173:0/584993474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f4099cb0 0x7f88f4159f70 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f88e4011590 tx=0x7f88e4011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:17.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.000+0000 7f88ee000640 1 -- 172.21.15.173:0/584993474 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4015930 con 0x7f88f4099cb0 2024-04-25T09:09:17.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.000+0000 7f88ee000640 1 -- 172.21.15.173:0/584993474 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e4015ad0 con 0x7f88f4099cb0 2024-04-25T09:09:17.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.000+0000 7f88ee000640 1 -- 172.21.15.173:0/584993474 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e400f460 con 0x7f88f4099cb0 2024-04-25T09:09:17.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.000+0000 7f88fb200640 1 -- 172.21.15.173:0/584993474 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f409bca0 con 0x7f88f4099cb0 2024-04-25T09:09:17.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.000+0000 7f88fb200640 1 -- 172.21.15.173:0/584993474 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f409c260 con 0x7f88f4099cb0 2024-04-25T09:09:17.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.000+0000 7f88fb200640 1 -- 172.21.15.173:0/584993474 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f4073a40 con 0x7f88f4099cb0 2024-04-25T09:09:17.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.000+0000 7f88ee000640 1 -- 172.21.15.173:0/584993474 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f88e400f600 con 0x7f88f4099cb0 2024-04-25T09:09:17.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.000+0000 7f88ee000640 1 --2- 172.21.15.173:0/584993474 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88d8066f60 0x7f88d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.004+0000 7f88ee000640 1 -- 172.21.15.173:0/584993474 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f88e4085720 con 0x7f88f4099cb0 2024-04-25T09:09:17.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.004+0000 7f88f9e00640 1 --2- 172.21.15.173:0/584993474 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88d8066f60 0x7f88d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.004+0000 7f88f9e00640 1 --2- 172.21.15.173:0/584993474 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88d8066f60 0x7f88d8069420 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f88e8007fd0 tx=0x7f88e8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:17.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.004+0000 7f88ee000640 1 -- 172.21.15.173:0/584993474 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f88e4019030 con 0x7f88f4099cb0 2024-04-25T09:09:18.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.172+0000 7f88fb200640 1 -- 172.21.15.173:0/584993474 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f88f40afae0 con 0x7f88f4099cb0 2024-04-25T09:09:18.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.176+0000 7f88ee000640 1 -- 172.21.15.173:0/584993474 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f88e40561b0 con 0x7f88f4099cb0 2024-04-25T09:09:18.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.176+0000 7f88fb200640 1 -- 172.21.15.173:0/584993474 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88d8066f60 msgr2=0x7f88d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.176+0000 7f88fb200640 1 --2- 172.21.15.173:0/584993474 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88d8066f60 0x7f88d8069420 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f88e8007fd0 tx=0x7f88e8009040 comp rx=0 tx=0).stop 2024-04-25T09:09:18.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.176+0000 7f88fb200640 1 -- 172.21.15.173:0/584993474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f4099cb0 msgr2=0x7f88f4159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.176+0000 7f88fb200640 1 --2- 172.21.15.173:0/584993474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f4099cb0 0x7f88f4159f70 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f88e4011590 tx=0x7f88e4011a50 comp rx=0 tx=0).stop 2024-04-25T09:09:18.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.176+0000 7f88fb200640 1 -- 172.21.15.173:0/584993474 shutdown_connections 2024-04-25T09:09:18.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.176+0000 7f88fb200640 1 --2- 172.21.15.173:0/584993474 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88d8066f60 0x7f88d8069420 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.176+0000 7f88fb200640 1 --2- 172.21.15.173:0/584993474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88f409a130 0x7f88f415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.176+0000 7f88fb200640 1 --2- 172.21.15.173:0/584993474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f4099cb0 0x7f88f4159f70 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.176+0000 7f88fb200640 1 --2- 172.21.15.173:0/584993474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88dc004d50 0x7f88f40ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.176+0000 7f88fb200640 1 -- 172.21.15.173:0/584993474 >> 172.21.15.173:0/584993474 conn(0x7f88f4071b80 msgr2=0x7f88f415e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:18.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.176+0000 7f88fb200640 1 -- 172.21.15.173:0/584993474 shutdown_connections 2024-04-25T09:09:18.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.176+0000 7f88fb200640 1 -- 172.21.15.173:0/584993474 wait complete. 2024-04-25T09:09:18.184 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-04-25T09:09:18.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.332+0000 7efc01a00640 1 Processor -- start 2024-04-25T09:09:18.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.332+0000 7efc01a00640 1 -- start start 2024-04-25T09:09:18.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.332+0000 7efc01a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efbfc0af6b0 0x7efbfc0b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.332+0000 7efc01a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbfc15e070 con 0x7efbfc06b3a0 2024-04-25T09:09:18.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.332+0000 7efc01a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbfc070000 con 0x7efbfc15dc90 2024-04-25T09:09:18.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.332+0000 7efc01a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbfc0b3ab0 con 0x7efbfc0af6b0 2024-04-25T09:09:18.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.332+0000 7efbfa000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7efbfc06b3a0 0x7efbfc0adf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54718/0 (socket says 172.21.15.173:54718) 2024-04-25T09:09:18.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.332+0000 7efbfa000640 1 -- 172.21.15.173:0/3066472011 learned_addr learned my addr 172.21.15.173:0/3066472011 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:18.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.332+0000 7efbfb400640 1 --2- 172.21.15.173:0/3066472011 >> v2:172.21.15.194:3300/0 conn(0x7efbfc0af6b0 0x7efbfc0b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.332+0000 7efbf9600640 1 -- 172.21.15.173:0/3066472011 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927230315 0 0) 0x7efbfc15e070 con 0x7efbfc06b3a0 2024-04-25T09:09:18.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.332+0000 7efbf9600640 1 -- 172.21.15.173:0/3066472011 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbe0003530 con 0x7efbfc06b3a0 2024-04-25T09:09:18.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.332+0000 7efbfb400640 1 -- 172.21.15.173:0/3066472011 >> v1:172.21.15.194:6789/0 conn(0x7efbfc15dc90 legacy=0x7efbfc06ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.332+0000 7efbfb400640 1 -- 172.21.15.173:0/3066472011 >> v1:172.21.15.173:6789/0 conn(0x7efbfc06b3a0 legacy=0x7efbfc0adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.332+0000 7efbfb400640 1 -- 172.21.15.173:0/3066472011 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc0702e0 con 0x7efbfc0af6b0 2024-04-25T09:09:18.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.336+0000 7efbfb400640 1 --2- 172.21.15.173:0/3066472011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efbfc0af6b0 0x7efbfc0b53b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7efbf40097c0 tx=0x7efbf401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddb5c5959aaa5345 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:18.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.336+0000 7efbf9600640 1 -- 172.21.15.173:0/3066472011 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf40b0070 con 0x7efbfc0af6b0 2024-04-25T09:09:18.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.336+0000 7efbf9600640 1 -- 172.21.15.173:0/3066472011 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf40ab600 con 0x7efbfc0af6b0 2024-04-25T09:09:18.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.336+0000 7efbf9600640 1 -- 172.21.15.173:0/3066472011 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf40ab9d0 con 0x7efbfc0af6b0 2024-04-25T09:09:18.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.336+0000 7efc01a00640 1 -- 172.21.15.173:0/3066472011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efbfc0af6b0 msgr2=0x7efbfc0b53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.336+0000 7efc01a00640 1 --2- 172.21.15.173:0/3066472011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efbfc0af6b0 0x7efbfc0b53b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7efbf40097c0 tx=0x7efbf401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.336+0000 7efc01a00640 1 -- 172.21.15.173:0/3066472011 shutdown_connections 2024-04-25T09:09:18.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.336+0000 7efc01a00640 1 --2- 172.21.15.173:0/3066472011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efbfc0af6b0 0x7efbfc0b53b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.336+0000 7efc01a00640 1 -- 172.21.15.173:0/3066472011 >> 172.21.15.173:0/3066472011 conn(0x7efbfc099a50 msgr2=0x7efbfc0b5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:18.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.336+0000 7efc01a00640 1 -- 172.21.15.173:0/3066472011 shutdown_connections 2024-04-25T09:09:18.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.336+0000 7efc01a00640 1 -- 172.21.15.173:0/3066472011 wait complete. 2024-04-25T09:09:18.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efc01a00640 1 Processor -- start 2024-04-25T09:09:18.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efc01a00640 1 -- start start 2024-04-25T09:09:18.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efc01a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efbfc06b3a0 0x7efbfc14ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efc01a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efbfc0af6b0 0x7efbfc151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efc01a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efbfc15dc90 0x7efbfc146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efc01a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc16c180 con 0x7efbfc0af6b0 2024-04-25T09:09:18.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efc01a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc16c000 con 0x7efbfc06b3a0 2024-04-25T09:09:18.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efc01a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc16c300 con 0x7efbfc15dc90 2024-04-25T09:09:18.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efbfa000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efbfc0af6b0 0x7efbfc151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efbfa000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efbfc0af6b0 0x7efbfc151dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46812/0 (socket says 172.21.15.173:46812) 2024-04-25T09:09:18.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efbfa000640 1 -- 172.21.15.173:0/3662760067 learned_addr learned my addr 172.21.15.173:0/3662760067 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efbfaa00640 1 --2- 172.21.15.173:0/3662760067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efbfc06b3a0 0x7efbfc14ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efbfb400640 1 --2- 172.21.15.173:0/3662760067 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efbfc15dc90 0x7efbfc146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efbfa000640 1 -- 172.21.15.173:0/3662760067 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efbfc15dc90 msgr2=0x7efbfc146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efbfa000640 1 --2- 172.21.15.173:0/3662760067 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efbfc15dc90 0x7efbfc146660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efbfa000640 1 -- 172.21.15.173:0/3662760067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efbfc06b3a0 msgr2=0x7efbfc14ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efbfa000640 1 --2- 172.21.15.173:0/3662760067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efbfc06b3a0 0x7efbfc14ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efbfa000640 1 -- 172.21.15.173:0/3662760067 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc150a70 con 0x7efbfc0af6b0 2024-04-25T09:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efbfb400640 1 --2- 172.21.15.173:0/3662760067 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efbfc15dc90 0x7efbfc146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efbfa000640 1 --2- 172.21.15.173:0/3662760067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efbfc0af6b0 0x7efbfc151dd0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7efbe400c3c0 tx=0x7efbe400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efbf2a00640 1 -- 172.21.15.173:0/3662760067 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe4017070 con 0x7efbfc0af6b0 2024-04-25T09:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efbf2a00640 1 -- 172.21.15.173:0/3662760067 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe4005cf0 con 0x7efbfc0af6b0 2024-04-25T09:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efc01a00640 1 -- 172.21.15.173:0/3662760067 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbfc150d30 con 0x7efbfc0af6b0 2024-04-25T09:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efbf2a00640 1 -- 172.21.15.173:0/3662760067 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe40072f0 con 0x7efbfc0af6b0 2024-04-25T09:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.340+0000 7efc01a00640 1 -- 172.21.15.173:0/3662760067 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbfc1512f0 con 0x7efbfc0af6b0 2024-04-25T09:09:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.344+0000 7efc01a00640 1 -- 172.21.15.173:0/3662760067 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbfc073a40 con 0x7efbfc0af6b0 2024-04-25T09:09:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.344+0000 7efbf2a00640 1 -- 172.21.15.173:0/3662760067 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efbe401a070 con 0x7efbfc0af6b0 2024-04-25T09:09:18.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.344+0000 7efbf2a00640 1 --2- 172.21.15.173:0/3662760067 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efbd8066f90 0x7efbd8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.344+0000 7efbf2a00640 1 -- 172.21.15.173:0/3662760067 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5335+0+0 (secure 0 0 0) 0x7efbe40843c0 con 0x7efbfc0af6b0 2024-04-25T09:09:18.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.344+0000 7efbfaa00640 1 --2- 172.21.15.173:0/3662760067 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efbd8066f90 0x7efbd8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.344+0000 7efbfaa00640 1 --2- 172.21.15.173:0/3662760067 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efbd8066f90 0x7efbd8069450 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efbec001d50 tx=0x7efbec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:18.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.348+0000 7efbf2a00640 1 -- 172.21.15.173:0/3662760067 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efbe4055410 con 0x7efbfc0af6b0 2024-04-25T09:09:18.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.568+0000 7efc01a00640 1 -- 172.21.15.173:0/3662760067 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) v1 -- 0x7efbfc15e830 con 0x7efbfc0af6b0 2024-04-25T09:09:18.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.828+0000 7efbf2a00640 1 -- 172.21.15.173:0/3662760067 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v317) v1 ==== 158+0+0 (secure 0 0 0) 0x7efbe4054d10 con 0x7efbfc0af6b0 2024-04-25T09:09:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.828+0000 7efc01a00640 1 -- 172.21.15.173:0/3662760067 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efbd8066f90 msgr2=0x7efbd8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.828+0000 7efc01a00640 1 --2- 172.21.15.173:0/3662760067 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efbd8066f90 0x7efbd8069450 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efbec001d50 tx=0x7efbec009040 comp rx=0 tx=0).stop 2024-04-25T09:09:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.828+0000 7efc01a00640 1 -- 172.21.15.173:0/3662760067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efbfc0af6b0 msgr2=0x7efbfc151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.828+0000 7efc01a00640 1 --2- 172.21.15.173:0/3662760067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efbfc0af6b0 0x7efbfc151dd0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7efbe400c3c0 tx=0x7efbe400c880 comp rx=0 tx=0).stop 2024-04-25T09:09:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.828+0000 7efc01a00640 1 -- 172.21.15.173:0/3662760067 shutdown_connections 2024-04-25T09:09:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.828+0000 7efc01a00640 1 --2- 172.21.15.173:0/3662760067 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efbd8066f90 0x7efbd8069450 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.828+0000 7efc01a00640 1 --2- 172.21.15.173:0/3662760067 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efbfc15dc90 0x7efbfc146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.828+0000 7efc01a00640 1 --2- 172.21.15.173:0/3662760067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efbfc0af6b0 0x7efbfc151dd0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.828+0000 7efc01a00640 1 --2- 172.21.15.173:0/3662760067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efbfc06b3a0 0x7efbfc14ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.828+0000 7efc01a00640 1 -- 172.21.15.173:0/3662760067 >> 172.21.15.173:0/3662760067 conn(0x7efbfc099a50 msgr2=0x7efbfc15ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.832+0000 7efc01a00640 1 -- 172.21.15.173:0/3662760067 shutdown_connections 2024-04-25T09:09:18.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.832+0000 7efc01a00640 1 -- 172.21.15.173:0/3662760067 wait complete. 2024-04-25T09:09:18.839 INFO:tasks.cephfs_test_runner:test that scrub can iterate over ~mdsdir and evaluate strays ... ok 2024-04-25T09:09:18.839 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T09:09:18.840 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:18.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.988+0000 7fa522400640 1 Processor -- start 2024-04-25T09:09:18.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.988+0000 7fa522400640 1 -- start start 2024-04-25T09:09:18.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.988+0000 7fa522400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa51c145250 0x7fa51c15c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.988+0000 7fa522400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51c15cec0 con 0x7fa51c0ccd30 2024-04-25T09:09:18.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.988+0000 7fa522400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51c06e7c0 con 0x7fa51c0cc8b0 2024-04-25T09:09:18.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.988+0000 7fa522400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51c072140 con 0x7fa51c145250 2024-04-25T09:09:18.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.988+0000 7fa51be00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa51c0ccd30 0x7fa51c071a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54722/0 (socket says 172.21.15.173:54722) 2024-04-25T09:09:18.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.988+0000 7fa51be00640 1 -- 172.21.15.173:0/2658338854 learned_addr learned my addr 172.21.15.173:0/2658338854 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:18.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.988+0000 7fa51b400640 1 --2- 172.21.15.173:0/2658338854 >> v2:172.21.15.194:3300/0 conn(0x7fa51c145250 0x7fa51c15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.988+0000 7fa51aa00640 1 -- 172.21.15.173:0/2658338854 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856321676 0 0) 0x7fa5140014a0 con 0x7fa51c0ccd30 2024-04-25T09:09:18.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.988+0000 7fa51aa00640 1 -- 172.21.15.173:0/2658338854 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa500003530 con 0x7fa51c0ccd30 2024-04-25T09:09:18.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.988+0000 7fa51aa00640 1 -- 172.21.15.173:0/2658338854 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3179186967 0 0) 0x7fa500003530 con 0x7fa51c0ccd30 2024-04-25T09:09:18.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.988+0000 7fa51aa00640 1 -- 172.21.15.173:0/2658338854 >> v2:172.21.15.194:3300/0 conn(0x7fa51c145250 msgr2=0x7fa51c15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:18.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51aa00640 1 --2- 172.21.15.173:0/2658338854 >> v2:172.21.15.194:3300/0 conn(0x7fa51c145250 0x7fa51c15c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51aa00640 1 -- 172.21.15.173:0/2658338854 >> v1:172.21.15.194:6789/0 conn(0x7fa51c0cc8b0 legacy=0x7fa51c071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51aa00640 1 -- 172.21.15.173:0/2658338854 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c06d720 con 0x7fa51c0ccd30 2024-04-25T09:09:18.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51aa00640 1 -- 172.21.15.173:0/2658338854 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fa514001bd0 con 0x7fa51c0ccd30 2024-04-25T09:09:18.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51aa00640 1 -- 172.21.15.173:0/2658338854 >> v1:172.21.15.173:6789/0 conn(0x7fa51c0ccd30 legacy=0x7fa51c071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51aa00640 1 --2- 172.21.15.173:0/2658338854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5000039c0 0x7fa500003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51aa00640 1 --2- 172.21.15.173:0/2658338854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa500004810 0x7fa500004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51aa00640 1 --2- 172.21.15.173:0/2658338854 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5000051d0 0x7fa50000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51aa00640 1 -- 172.21.15.173:0/2658338854 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c072140 con 0x7fa5000039c0 2024-04-25T09:09:18.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51aa00640 1 -- 172.21.15.173:0/2658338854 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50000c070 con 0x7fa500004810 2024-04-25T09:09:18.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51aa00640 1 -- 172.21.15.173:0/2658338854 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50000c270 con 0x7fa5000051d0 2024-04-25T09:09:18.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51b400640 1 --2- 172.21.15.173:0/2658338854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5000039c0 0x7fa500003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa512a00640 1 --2- 172.21.15.173:0/2658338854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa500004810 0x7fa500004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51be00640 1 --2- 172.21.15.173:0/2658338854 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5000051d0 0x7fa50000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51b400640 1 -- 172.21.15.173:0/2658338854 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5000051d0 msgr2=0x7fa50000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:18.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51b400640 1 --2- 172.21.15.173:0/2658338854 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5000051d0 0x7fa50000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51b400640 1 -- 172.21.15.173:0/2658338854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa500004810 msgr2=0x7fa500004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:18.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51b400640 1 --2- 172.21.15.173:0/2658338854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa500004810 0x7fa500004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51b400640 1 -- 172.21.15.173:0/2658338854 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa500003530 con 0x7fa5000039c0 2024-04-25T09:09:18.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51be00640 1 -- 172.21.15.173:0/2658338854 reap_dead start 2024-04-25T09:09:18.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51b400640 1 --2- 172.21.15.173:0/2658338854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5000039c0 0x7fa500003de0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009ae0 tx=0x7fa50c01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61333012ca6708cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:18.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51aa00640 1 -- 172.21.15.173:0/2658338854 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c0b2070 con 0x7fa5000039c0 2024-04-25T09:09:18.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51aa00640 1 -- 172.21.15.173:0/2658338854 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50c0a56e0 con 0x7fa5000039c0 2024-04-25T09:09:18.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.992+0000 7fa51aa00640 1 -- 172.21.15.173:0/2658338854 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c0096b0 con 0x7fa5000039c0 2024-04-25T09:09:18.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.996+0000 7fa522400640 1 -- 172.21.15.173:0/2658338854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5000039c0 msgr2=0x7fa500003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.996+0000 7fa522400640 1 --2- 172.21.15.173:0/2658338854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5000039c0 0x7fa500003de0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009ae0 tx=0x7fa50c01ca60 comp rx=0 tx=0).stop 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.996+0000 7fa522400640 1 -- 172.21.15.173:0/2658338854 shutdown_connections 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.996+0000 7fa522400640 1 --2- 172.21.15.173:0/2658338854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5000039c0 0x7fa500003de0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.996+0000 7fa522400640 1 -- 172.21.15.173:0/2658338854 >> 172.21.15.173:0/2658338854 conn(0x7fa51c06ac90 msgr2=0x7fa51c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.996+0000 7fa522400640 1 -- 172.21.15.173:0/2658338854 shutdown_connections 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.996+0000 7fa522400640 1 -- 172.21.15.173:0/2658338854 wait complete. 2024-04-25T09:09:18.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.996+0000 7fa522400640 1 Processor -- start 2024-04-25T09:09:18.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.996+0000 7fa522400640 1 -- start start 2024-04-25T09:09:18.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.996+0000 7fa522400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5000039c0 0x7fa51c142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.996+0000 7fa522400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa51c0b3580 0x7fa51c0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.996+0000 7fa522400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa51c1f67c0 0x7fa51c1f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.996+0000 7fa522400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c06e2a0 con 0x7fa51c1f67c0 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.996+0000 7fa522400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c06dfc0 con 0x7fa51c0b3580 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.996+0000 7fa522400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c145630 con 0x7fa5000039c0 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.996+0000 7fa51be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa51c1f67c0 0x7fa51c1f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.996+0000 7fa51be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa51c1f67c0 0x7fa51c1f6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46830/0 (socket says 172.21.15.173:46830) 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:18.996+0000 7fa51be00640 1 -- 172.21.15.173:0/1555190849 learned_addr learned my addr 172.21.15.173:0/1555190849 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa51b400640 1 --2- 172.21.15.173:0/1555190849 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5000039c0 0x7fa51c142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa512a00640 1 --2- 172.21.15.173:0/1555190849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa51c0b3580 0x7fa51c0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa51be00640 1 -- 172.21.15.173:0/1555190849 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5000039c0 msgr2=0x7fa51c142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa51be00640 1 --2- 172.21.15.173:0/1555190849 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5000039c0 0x7fa51c142ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa51be00640 1 -- 172.21.15.173:0/1555190849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa51c0b3580 msgr2=0x7fa51c0b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa51be00640 1 --2- 172.21.15.173:0/1555190849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa51c0b3580 0x7fa51c0b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa51be00640 1 -- 172.21.15.173:0/1555190849 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c143220 con 0x7fa51c1f67c0 2024-04-25T09:09:18.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa512a00640 1 --2- 172.21.15.173:0/1555190849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa51c0b3580 0x7fa51c0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:18.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa51be00640 1 --2- 172.21.15.173:0/1555190849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa51c1f67c0 0x7fa51c1f6c40 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fa51c0b4c40 tx=0x7fa51400e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:18.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa513e00640 1 -- 172.21.15.173:0/1555190849 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514019070 con 0x7fa51c1f67c0 2024-04-25T09:09:18.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa513e00640 1 -- 172.21.15.173:0/1555190849 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51400eb10 con 0x7fa51c1f67c0 2024-04-25T09:09:18.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa513e00640 1 -- 172.21.15.173:0/1555190849 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514014480 con 0x7fa51c1f67c0 2024-04-25T09:09:18.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa522400640 1 -- 172.21.15.173:0/1555190849 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51c1e8c80 con 0x7fa51c1f67c0 2024-04-25T09:09:18.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa522400640 1 -- 172.21.15.173:0/1555190849 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51c1e9240 con 0x7fa51c1f67c0 2024-04-25T09:09:18.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa522400640 1 -- 172.21.15.173:0/1555190849 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51c073a40 con 0x7fa51c1f67c0 2024-04-25T09:09:18.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa513e00640 1 -- 172.21.15.173:0/1555190849 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa51401c070 con 0x7fa51c1f67c0 2024-04-25T09:09:18.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa513e00640 1 --2- 172.21.15.173:0/1555190849 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa4f8066f60 0x7fa4f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa513e00640 1 -- 172.21.15.173:0/1555190849 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fa5140849e0 con 0x7fa51c1f67c0 2024-04-25T09:09:18.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.000+0000 7fa51b400640 1 --2- 172.21.15.173:0/1555190849 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa4f8066f60 0x7fa4f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.004+0000 7fa51b400640 1 --2- 172.21.15.173:0/1555190849 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa4f8066f60 0x7fa4f8069420 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0af000 tx=0x7fa50c0046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:18.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.004+0000 7fa513e00640 1 -- 172.21.15.173:0/1555190849 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa51c143220 con 0x7fa51c1f67c0 2024-04-25T09:09:19.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.160+0000 7fa522400640 1 -- 172.21.15.173:0/1555190849 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa51c0cbc80 con 0x7fa51c1f67c0 2024-04-25T09:09:19.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.160+0000 7fa513e00640 1 -- 172.21.15.173:0/1555190849 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+13356 (secure 0 0 0) 0x7fa51c15cec0 con 0x7fa51c1f67c0 2024-04-25T09:09:19.148 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:19.149 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":89,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:09:17.819046+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:6837/2444108646":"2024-04-26T09:09:14.811159+0000","172.21.15.173:6836/2444108646":"2024-04-26T09:09:14.811159+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:19.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.160+0000 7fa522400640 1 -- 172.21.15.173:0/1555190849 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa4f8066f60 msgr2=0x7fa4f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.160+0000 7fa522400640 1 --2- 172.21.15.173:0/1555190849 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa4f8066f60 0x7fa4f8069420 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0af000 tx=0x7fa50c0046d0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.160+0000 7fa522400640 1 -- 172.21.15.173:0/1555190849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa51c1f67c0 msgr2=0x7fa51c1f6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.160+0000 7fa522400640 1 --2- 172.21.15.173:0/1555190849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa51c1f67c0 0x7fa51c1f6c40 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fa51c0b4c40 tx=0x7fa51400e160 comp rx=0 tx=0).stop 2024-04-25T09:09:19.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.160+0000 7fa522400640 1 -- 172.21.15.173:0/1555190849 shutdown_connections 2024-04-25T09:09:19.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.160+0000 7fa522400640 1 --2- 172.21.15.173:0/1555190849 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa4f8066f60 0x7fa4f8069420 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.160+0000 7fa522400640 1 --2- 172.21.15.173:0/1555190849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa51c1f67c0 0x7fa51c1f6c40 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.160+0000 7fa522400640 1 --2- 172.21.15.173:0/1555190849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa51c0b3580 0x7fa51c0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.160+0000 7fa522400640 1 --2- 172.21.15.173:0/1555190849 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5000039c0 0x7fa51c142ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.160+0000 7fa522400640 1 -- 172.21.15.173:0/1555190849 >> 172.21.15.173:0/1555190849 conn(0x7fa51c06ac90 msgr2=0x7fa51c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:19.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.160+0000 7fa522400640 1 -- 172.21.15.173:0/1555190849 shutdown_connections 2024-04-25T09:09:19.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.160+0000 7fa522400640 1 -- 172.21.15.173:0/1555190849 wait complete. 2024-04-25T09:09:19.170 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:09:19.171 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:09:19.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.320+0000 7fc0a9600640 1 Processor -- start 2024-04-25T09:09:19.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.320+0000 7fc0a9600640 1 -- start start 2024-04-25T09:09:19.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.324+0000 7fc0a9600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc0a40aeb90 0x7fc0a40cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.324+0000 7fc0a9600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a40ce2b0 0x7fc0a40cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.324+0000 7fc0a9600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a4071570 con 0x7fc0a40aef70 2024-04-25T09:09:19.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.324+0000 7fc0a9600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a4071320 con 0x7fc0a40aeb90 2024-04-25T09:09:19.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.324+0000 7fc0a9600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a4072330 con 0x7fc0a40ce2b0 2024-04-25T09:09:19.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.324+0000 7fc0a3400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a40ce2b0 0x7fc0a40cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.324+0000 7fc09a000640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fc0a40aef70 0x7fc0a40cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:52166/0 (socket says 172.21.15.173:52166) 2024-04-25T09:09:19.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.324+0000 7fc09a000640 1 -- 172.21.15.173:0/153429051 learned_addr learned my addr 172.21.15.173:0/153429051 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:19.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.324+0000 7fc0a2a00640 1 --2- 172.21.15.173:0/153429051 >> v2:172.21.15.194:3300/0 conn(0x7fc0a40aeb90 0x7fc0a40cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.324+0000 7fc0a2000640 1 -- 172.21.15.173:0/153429051 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083172846 0 0) 0x7fc0a4071570 con 0x7fc0a40aef70 2024-04-25T09:09:19.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.324+0000 7fc0a3400640 1 -- 172.21.15.173:0/153429051 >> v2:172.21.15.194:3300/0 conn(0x7fc0a40aeb90 msgr2=0x7fc0a40cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:19.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.324+0000 7fc0a3400640 1 --2- 172.21.15.173:0/153429051 >> v2:172.21.15.194:3300/0 conn(0x7fc0a40aeb90 0x7fc0a40cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.324+0000 7fc0a3400640 1 -- 172.21.15.173:0/153429051 >> v1:172.21.15.194:6789/0 conn(0x7fc0a40aef70 legacy=0x7fc0a40cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.324+0000 7fc0a3400640 1 -- 172.21.15.173:0/153429051 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4071850 con 0x7fc0a40ce2b0 2024-04-25T09:09:19.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.328+0000 7fc0a3400640 1 --2- 172.21.15.173:0/153429051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a40ce2b0 0x7fc0a40cc610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0097c0 tx=0x7fc09c01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=222bb196bc81ff5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:19.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.328+0000 7fc0a2000640 1 -- 172.21.15.173:0/153429051 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0b0070 con 0x7fc0a40ce2b0 2024-04-25T09:09:19.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.328+0000 7fc0a2000640 1 -- 172.21.15.173:0/153429051 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c0ab600 con 0x7fc0a40ce2b0 2024-04-25T09:09:19.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.328+0000 7fc0a2000640 1 -- 172.21.15.173:0/153429051 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0ab9d0 con 0x7fc0a40ce2b0 2024-04-25T09:09:19.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.328+0000 7fc0a9600640 1 -- 172.21.15.173:0/153429051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a40ce2b0 msgr2=0x7fc0a40cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.328+0000 7fc0a9600640 1 --2- 172.21.15.173:0/153429051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a40ce2b0 0x7fc0a40cc610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0097c0 tx=0x7fc09c01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.328+0000 7fc0a9600640 1 -- 172.21.15.173:0/153429051 shutdown_connections 2024-04-25T09:09:19.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.328+0000 7fc0a9600640 1 --2- 172.21.15.173:0/153429051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a40ce2b0 0x7fc0a40cc610 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.328+0000 7fc0a9600640 1 --2- 172.21.15.173:0/153429051 >> v2:172.21.15.194:3300/0 conn(0x7fc0a40aeb90 0x7fc0a40cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.328+0000 7fc0a9600640 1 -- 172.21.15.173:0/153429051 >> 172.21.15.173:0/153429051 conn(0x7fc0a406ac90 msgr2=0x7fc0a406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:19.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.328+0000 7fc0a9600640 1 -- 172.21.15.173:0/153429051 shutdown_connections 2024-04-25T09:09:19.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.328+0000 7fc0a9600640 1 -- 172.21.15.173:0/153429051 wait complete. 2024-04-25T09:09:19.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.328+0000 7fc0a9600640 1 Processor -- start 2024-04-25T09:09:19.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.328+0000 7fc0a9600640 1 -- start start 2024-04-25T09:09:19.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a9600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a40aeb90 0x7fc0a4149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a9600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0a40aef70 0x7fc0a4153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a9600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0a40ce2b0 0x7fc0a4153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a9600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a415bb30 con 0x7fc0a40aef70 2024-04-25T09:09:19.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a9600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a415b9b0 con 0x7fc0a40ce2b0 2024-04-25T09:09:19.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a9600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a415bcb0 con 0x7fc0a40aeb90 2024-04-25T09:09:19.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc09a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0a40aef70 0x7fc0a4153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0a40ce2b0 0x7fc0a4153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a2a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a40aeb90 0x7fc0a4149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc09a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0a40aef70 0x7fc0a4153220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46838/0 (socket says 172.21.15.173:46838) 2024-04-25T09:09:19.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0a40ce2b0 0x7fc0a4153760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:45156/0 (socket says 172.21.15.173:45156) 2024-04-25T09:09:19.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a2a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a40aeb90 0x7fc0a4149720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:57880/0 (socket says 172.21.15.173:57880) 2024-04-25T09:09:19.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc09a000640 1 -- 172.21.15.173:0/7994100 learned_addr learned my addr 172.21.15.173:0/7994100 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:19.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a3400640 1 -- 172.21.15.173:0/7994100 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a40aeb90 msgr2=0x7fc0a4149720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a3400640 1 --2- 172.21.15.173:0/7994100 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a40aeb90 0x7fc0a4149720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a3400640 1 -- 172.21.15.173:0/7994100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0a40aef70 msgr2=0x7fc0a4153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a3400640 1 --2- 172.21.15.173:0/7994100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0a40aef70 0x7fc0a4153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a3400640 1 -- 172.21.15.173:0/7994100 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4153de0 con 0x7fc0a40ce2b0 2024-04-25T09:09:19.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a3400640 1 --2- 172.21.15.173:0/7994100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0a40ce2b0 0x7fc0a4153760 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4158b20 tx=0x7fc09c019180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:19.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc09b400640 1 -- 172.21.15.173:0/7994100 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0b0040 con 0x7fc0a40ce2b0 2024-04-25T09:09:19.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc09b400640 1 -- 172.21.15.173:0/7994100 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c0b9070 con 0x7fc0a40ce2b0 2024-04-25T09:09:19.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a9600640 1 -- 172.21.15.173:0/7994100 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a41540c0 con 0x7fc0a40ce2b0 2024-04-25T09:09:19.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc09b400640 1 -- 172.21.15.173:0/7994100 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0b4690 con 0x7fc0a40ce2b0 2024-04-25T09:09:19.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a9600640 1 -- 172.21.15.173:0/7994100 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a4154680 con 0x7fc0a40ce2b0 2024-04-25T09:09:19.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc0a9600640 1 -- 172.21.15.173:0/7994100 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a4154a60 con 0x7fc0a40ce2b0 2024-04-25T09:09:19.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.332+0000 7fc09b400640 1 -- 172.21.15.173:0/7994100 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc09c0b4830 con 0x7fc0a40ce2b0 2024-04-25T09:09:19.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.336+0000 7fc09b400640 1 --2- 172.21.15.173:0/7994100 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc080066f60 0x7fc080069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.336+0000 7fc09b400640 1 -- 172.21.15.173:0/7994100 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc09c11ea10 con 0x7fc0a40ce2b0 2024-04-25T09:09:19.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.336+0000 7fc0a2a00640 1 --2- 172.21.15.173:0/7994100 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc080066f60 0x7fc080069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.336+0000 7fc0a2a00640 1 --2- 172.21.15.173:0/7994100 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc080066f60 0x7fc080069420 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc094011340 tx=0x7fc09400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:19.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.340+0000 7fc09b400640 1 -- 172.21.15.173:0/7994100 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc09c016090 con 0x7fc0a40ce2b0 2024-04-25T09:09:19.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.496+0000 7fc0a9600640 1 -- 172.21.15.173:0/7994100 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc0a4073ab0 con 0x7fc0a40ce2b0 2024-04-25T09:09:19.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.496+0000 7fc09b400640 1 -- 172.21.15.173:0/7994100 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc09c0ef530 con 0x7fc0a40ce2b0 2024-04-25T09:09:19.484 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:09:19.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.496+0000 7fc0a9600640 1 -- 172.21.15.173:0/7994100 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc080066f60 msgr2=0x7fc080069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.496+0000 7fc0a9600640 1 --2- 172.21.15.173:0/7994100 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc080066f60 0x7fc080069420 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc094011340 tx=0x7fc09400b040 comp rx=0 tx=0).stop 2024-04-25T09:09:19.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.496+0000 7fc0a9600640 1 -- 172.21.15.173:0/7994100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0a40ce2b0 msgr2=0x7fc0a4153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.496+0000 7fc0a9600640 1 --2- 172.21.15.173:0/7994100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0a40ce2b0 0x7fc0a4153760 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4158b20 tx=0x7fc09c019180 comp rx=0 tx=0).stop 2024-04-25T09:09:19.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.496+0000 7fc0a9600640 1 -- 172.21.15.173:0/7994100 shutdown_connections 2024-04-25T09:09:19.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.496+0000 7fc0a9600640 1 --2- 172.21.15.173:0/7994100 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc080066f60 0x7fc080069420 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.496+0000 7fc0a9600640 1 --2- 172.21.15.173:0/7994100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0a40ce2b0 0x7fc0a4153760 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.496+0000 7fc0a9600640 1 --2- 172.21.15.173:0/7994100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0a40aef70 0x7fc0a4153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.496+0000 7fc0a9600640 1 --2- 172.21.15.173:0/7994100 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a40aeb90 0x7fc0a4149720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.496+0000 7fc0a9600640 1 -- 172.21.15.173:0/7994100 >> 172.21.15.173:0/7994100 conn(0x7fc0a406ac90 msgr2=0x7fc0a406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:19.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.500+0000 7fc0a9600640 1 -- 172.21.15.173:0/7994100 shutdown_connections 2024-04-25T09:09:19.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.500+0000 7fc0a9600640 1 -- 172.21.15.173:0/7994100 wait complete. 2024-04-25T09:09:19.506 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-04-25T09:09:19.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.652+0000 7f01f5c00640 1 Processor -- start 2024-04-25T09:09:19.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.652+0000 7f01f5c00640 1 -- start start 2024-04-25T09:09:19.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.656+0000 7f01f5c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f01f00aefa0 0x7f01f00cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.656+0000 7f01f5c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f015f320 con 0x7f01f00b3e70 2024-04-25T09:09:19.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.656+0000 7f01f5c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f006d420 con 0x7f01f015edd0 2024-04-25T09:09:19.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.656+0000 7f01f5c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f006dd50 con 0x7f01f00aefa0 2024-04-25T09:09:19.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.656+0000 7f01e6000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f01f00aefa0 0x7f01f00cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.656+0000 7f01e6000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f01f00aefa0 0x7f01f00cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46852/0 (socket says 172.21.15.173:46852) 2024-04-25T09:09:19.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.656+0000 7f01eea00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f01f00b3e70 0x7f01f00b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54736/0 (socket says 172.21.15.173:54736) 2024-04-25T09:09:19.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.656+0000 7f01e6000640 1 -- 172.21.15.173:0/1779783174 learned_addr learned my addr 172.21.15.173:0/1779783174 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:19.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.656+0000 7f01e6000640 1 -- 172.21.15.173:0/1779783174 >> v1:172.21.15.194:6789/0 conn(0x7f01f015edd0 legacy=0x7f01f00cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.656+0000 7f01e6000640 1 -- 172.21.15.173:0/1779783174 >> v1:172.21.15.173:6789/0 conn(0x7f01f00b3e70 legacy=0x7f01f00b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.656+0000 7f01e6000640 1 -- 172.21.15.173:0/1779783174 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f006d700 con 0x7f01f00aefa0 2024-04-25T09:09:19.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.656+0000 7f01ee000640 1 -- 172.21.15.173:0/1779783174 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191745640 0 0) 0x7f01f015f320 con 0x7f01f00b3e70 2024-04-25T09:09:19.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.660+0000 7f01e6000640 1 --2- 172.21.15.173:0/1779783174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f00aefa0 0x7f01f00cd7a0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009870 tx=0x7f01d801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf457087d2bd677 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:19.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.660+0000 7f01ee000640 1 -- 172.21.15.173:0/1779783174 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d80a9610 con 0x7f01f00aefa0 2024-04-25T09:09:19.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.660+0000 7f01ee000640 1 -- 172.21.15.173:0/1779783174 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d80a97b0 con 0x7f01f00aefa0 2024-04-25T09:09:19.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.660+0000 7f01ee000640 1 -- 172.21.15.173:0/1779783174 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d80a9b80 con 0x7f01f00aefa0 2024-04-25T09:09:19.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.660+0000 7f01f5c00640 1 -- 172.21.15.173:0/1779783174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f00aefa0 msgr2=0x7f01f00cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.660+0000 7f01f5c00640 1 --2- 172.21.15.173:0/1779783174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f00aefa0 0x7f01f00cd7a0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009870 tx=0x7f01d801c530 comp rx=0 tx=0).stop 2024-04-25T09:09:19.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.660+0000 7f01f5c00640 1 -- 172.21.15.173:0/1779783174 shutdown_connections 2024-04-25T09:09:19.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.660+0000 7f01f5c00640 1 --2- 172.21.15.173:0/1779783174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f00aefa0 0x7f01f00cd7a0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.660+0000 7f01f5c00640 1 -- 172.21.15.173:0/1779783174 >> 172.21.15.173:0/1779783174 conn(0x7f01f006ac90 msgr2=0x7f01f006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:19.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.660+0000 7f01f5c00640 1 -- 172.21.15.173:0/1779783174 shutdown_connections 2024-04-25T09:09:19.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.660+0000 7f01f5c00640 1 -- 172.21.15.173:0/1779783174 wait complete. 2024-04-25T09:09:19.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.660+0000 7f01f5c00640 1 Processor -- start 2024-04-25T09:09:19.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.660+0000 7f01f5c00640 1 -- start start 2024-04-25T09:09:19.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01f5c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f00aefa0 0x7f01f0149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01f5c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01f00b3e70 0x7f01f01428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01f5c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f015edd0 0x7f01f0142df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01f5c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f006e360 con 0x7f01f00aefa0 2024-04-25T09:09:19.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01f5c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f006e1e0 con 0x7f01f00b3e70 2024-04-25T09:09:19.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01f5c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f0168fd0 con 0x7f01f015edd0 2024-04-25T09:09:19.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01eea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f00aefa0 0x7f01f0149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01eea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f00aefa0 0x7f01f0149e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46868/0 (socket says 172.21.15.173:46868) 2024-04-25T09:09:19.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01eea00640 1 -- 172.21.15.173:0/2252913026 learned_addr learned my addr 172.21.15.173:0/2252913026 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:19.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01e6000640 1 --2- 172.21.15.173:0/2252913026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01f00b3e70 0x7f01f01428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01ef400640 1 --2- 172.21.15.173:0/2252913026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f015edd0 0x7f01f0142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01eea00640 1 -- 172.21.15.173:0/2252913026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f015edd0 msgr2=0x7f01f0142df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01eea00640 1 --2- 172.21.15.173:0/2252913026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f015edd0 0x7f01f0142df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01eea00640 1 -- 172.21.15.173:0/2252913026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01f00b3e70 msgr2=0x7f01f01428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01eea00640 1 --2- 172.21.15.173:0/2252913026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01f00b3e70 0x7f01f01428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01eea00640 1 -- 172.21.15.173:0/2252913026 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f0146bb0 con 0x7f01f00aefa0 2024-04-25T09:09:19.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01e6000640 1 --2- 172.21.15.173:0/2252913026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01f00b3e70 0x7f01f01428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:19.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01eea00640 1 --2- 172.21.15.173:0/2252913026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f00aefa0 0x7f01f0149e70 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f01e000c410 tx=0x7f01e000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:19.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01e7400640 1 -- 172.21.15.173:0/2252913026 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e00074e0 con 0x7f01f00aefa0 2024-04-25T09:09:19.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01e7400640 1 -- 172.21.15.173:0/2252913026 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e00047f0 con 0x7f01f00aefa0 2024-04-25T09:09:19.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01f5c00640 1 -- 172.21.15.173:0/2252913026 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f0146e90 con 0x7f01f00aefa0 2024-04-25T09:09:19.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01e7400640 1 -- 172.21.15.173:0/2252913026 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0007680 con 0x7f01f00aefa0 2024-04-25T09:09:19.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01f5c00640 1 -- 172.21.15.173:0/2252913026 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f0147450 con 0x7f01f00aefa0 2024-04-25T09:09:19.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01f5c00640 1 -- 172.21.15.173:0/2252913026 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f0073a40 con 0x7f01f00aefa0 2024-04-25T09:09:19.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.664+0000 7f01e7400640 1 -- 172.21.15.173:0/2252913026 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f01e0011070 con 0x7f01f00aefa0 2024-04-25T09:09:19.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.668+0000 7f01e7400640 1 --2- 172.21.15.173:0/2252913026 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01cc066f60 0x7f01cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.668+0000 7f01e7400640 1 -- 172.21.15.173:0/2252913026 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f01e0084b30 con 0x7f01f00aefa0 2024-04-25T09:09:19.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.668+0000 7f01e6000640 1 --2- 172.21.15.173:0/2252913026 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01cc066f60 0x7f01cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.668+0000 7f01e6000640 1 --2- 172.21.15.173:0/2252913026 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01cc066f60 0x7f01cc069420 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f01d80ae000 tx=0x7f01d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:19.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.672+0000 7f01e7400640 1 -- 172.21.15.173:0/2252913026 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f01e0055ca0 con 0x7f01f00aefa0 2024-04-25T09:09:19.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:19.880+0000 7f01f5c00640 1 -- 172.21.15.173:0/2252913026 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) v1 -- 0x7f01f015d850 con 0x7f01f00aefa0 2024-04-25T09:09:20.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:20.840+0000 7f01e7400640 1 -- 172.21.15.173:0/2252913026 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v319) v1 ==== 147+0+0 (secure 0 0 0) 0x7f01e00555a0 con 0x7f01f00aefa0 2024-04-25T09:09:20.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:20.840+0000 7f01f5c00640 1 -- 172.21.15.173:0/2252913026 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01cc066f60 msgr2=0x7f01cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:20.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:20.840+0000 7f01f5c00640 1 --2- 172.21.15.173:0/2252913026 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01cc066f60 0x7f01cc069420 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f01d80ae000 tx=0x7f01d8009040 comp rx=0 tx=0).stop 2024-04-25T09:09:20.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:20.840+0000 7f01f5c00640 1 -- 172.21.15.173:0/2252913026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f00aefa0 msgr2=0x7f01f0149e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:20.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:20.840+0000 7f01f5c00640 1 --2- 172.21.15.173:0/2252913026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f00aefa0 0x7f01f0149e70 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f01e000c410 tx=0x7f01e000c8d0 comp rx=0 tx=0).stop 2024-04-25T09:09:20.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:20.840+0000 7f01f5c00640 1 -- 172.21.15.173:0/2252913026 shutdown_connections 2024-04-25T09:09:20.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:20.840+0000 7f01f5c00640 1 --2- 172.21.15.173:0/2252913026 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01cc066f60 0x7f01cc069420 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:20.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:20.840+0000 7f01f5c00640 1 --2- 172.21.15.173:0/2252913026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f015edd0 0x7f01f0142df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:20.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:20.840+0000 7f01f5c00640 1 --2- 172.21.15.173:0/2252913026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01f00b3e70 0x7f01f01428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:20.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:20.840+0000 7f01f5c00640 1 --2- 172.21.15.173:0/2252913026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f00aefa0 0x7f01f0149e70 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:20.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:20.840+0000 7f01f5c00640 1 -- 172.21.15.173:0/2252913026 >> 172.21.15.173:0/2252913026 conn(0x7f01f006ac90 msgr2=0x7f01f00b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:20.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:20.840+0000 7f01f5c00640 1 -- 172.21.15.173:0/2252913026 shutdown_connections 2024-04-25T09:09:20.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:20.840+0000 7f01f5c00640 1 -- 172.21.15.173:0/2252913026 wait complete. 2024-04-25T09:09:20.853 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:09:20.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.004+0000 7f8884a00640 1 Processor -- start 2024-04-25T09:09:20.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.004+0000 7f8884a00640 1 -- start start 2024-04-25T09:09:20.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.008+0000 7f8884a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f888006bda0 0x7f88800cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:20.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.008+0000 7f8884a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f888006c220 0x7f88800cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:20.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.008+0000 7f8884a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8880161570 con 0x7f8880099a50 2024-04-25T09:09:20.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.008+0000 7f8884a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8880161850 con 0x7f888006c220 2024-04-25T09:09:20.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.008+0000 7f8884a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8880161b30 con 0x7f888006bda0 2024-04-25T09:09:20.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.008+0000 7f887f200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f888006c220 0x7f88800cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:20.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.008+0000 7f887f200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f888006c220 0x7f88800cfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46876/0 (socket says 172.21.15.173:46876) 2024-04-25T09:09:20.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.008+0000 7f887f200640 1 -- 172.21.15.173:0/1601410999 learned_addr learned my addr 172.21.15.173:0/1601410999 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:20.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.008+0000 7f8877e00640 1 --2- 172.21.15.173:0/1601410999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f888006bda0 0x7f88800cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:20.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.008+0000 7f887f200640 1 -- 172.21.15.173:0/1601410999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f888006bda0 msgr2=0x7f88800cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:20.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.008+0000 7f887f200640 1 --2- 172.21.15.173:0/1601410999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f888006bda0 0x7f88800cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:20.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.008+0000 7f887f200640 1 -- 172.21.15.173:0/1601410999 >> v1:172.21.15.194:6789/0 conn(0x7f8880099a50 legacy=0x7f8880099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:20.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.008+0000 7f887f200640 1 -- 172.21.15.173:0/1601410999 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8880161e10 con 0x7f888006c220 2024-04-25T09:09:20.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.012+0000 7f887f200640 1 --2- 172.21.15.173:0/1601410999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f888006c220 0x7f88800cfce0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f8878009e50 tx=0x7f887801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c57cc4a5f1f79a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:20.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.012+0000 7f887de00640 1 -- 172.21.15.173:0/1601410999 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88780a58f0 con 0x7f888006c220 2024-04-25T09:09:20.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.012+0000 7f887de00640 1 -- 172.21.15.173:0/1601410999 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88780a5a90 con 0x7f888006c220 2024-04-25T09:09:20.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.012+0000 7f887de00640 1 -- 172.21.15.173:0/1601410999 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88780a5e60 con 0x7f888006c220 2024-04-25T09:09:21.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.012+0000 7f8884a00640 1 -- 172.21.15.173:0/1601410999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f888006c220 msgr2=0x7f88800cfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:21.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.012+0000 7f8884a00640 1 --2- 172.21.15.173:0/1601410999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f888006c220 0x7f88800cfce0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f8878009e50 tx=0x7f887801ca00 comp rx=0 tx=0).stop 2024-04-25T09:09:21.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.012+0000 7f8884a00640 1 -- 172.21.15.173:0/1601410999 shutdown_connections 2024-04-25T09:09:21.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.012+0000 7f8884a00640 1 --2- 172.21.15.173:0/1601410999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f888006bda0 0x7f88800cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.012+0000 7f8884a00640 1 --2- 172.21.15.173:0/1601410999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f888006c220 0x7f88800cfce0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.012+0000 7f8884a00640 1 -- 172.21.15.173:0/1601410999 >> 172.21.15.173:0/1601410999 conn(0x7f88800b31d0 msgr2=0x7f88800b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:21.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.012+0000 7f8884a00640 1 -- 172.21.15.173:0/1601410999 shutdown_connections 2024-04-25T09:09:21.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.012+0000 7f8884a00640 1 -- 172.21.15.173:0/1601410999 wait complete. 2024-04-25T09:09:21.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.012+0000 7f8884a00640 1 Processor -- start 2024-04-25T09:09:21.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.012+0000 7f8884a00640 1 -- start start 2024-04-25T09:09:21.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.012+0000 7f8884a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f888006bda0 0x7f888013fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:21.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.012+0000 7f8884a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f888006c220 0x7f88800b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:21.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f8884a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8880099a50 0x7f888014ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:21.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f8884a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888016a910 con 0x7f8880099a50 2024-04-25T09:09:21.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f8884a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888009aed0 con 0x7f888006c220 2024-04-25T09:09:21.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f8884a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888016aa90 con 0x7f888006bda0 2024-04-25T09:09:21.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f887f200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8880099a50 0x7f888014ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:21.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f887f200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8880099a50 0x7f888014ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46880/0 (socket says 172.21.15.173:46880) 2024-04-25T09:09:21.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f887f200640 1 -- 172.21.15.173:0/2861378300 learned_addr learned my addr 172.21.15.173:0/2861378300 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:21.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f887e800640 1 --2- 172.21.15.173:0/2861378300 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f888006bda0 0x7f888013fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:21.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f8877e00640 1 --2- 172.21.15.173:0/2861378300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f888006c220 0x7f88800b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:21.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f887f200640 1 -- 172.21.15.173:0/2861378300 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f888006bda0 msgr2=0x7f888013fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:21.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f887f200640 1 --2- 172.21.15.173:0/2861378300 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f888006bda0 0x7f888013fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f887f200640 1 -- 172.21.15.173:0/2861378300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f888006c220 msgr2=0x7f88800b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:21.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f887f200640 1 --2- 172.21.15.173:0/2861378300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f888006c220 0x7f88800b5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f887f200640 1 -- 172.21.15.173:0/2861378300 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88800b6880 con 0x7f8880099a50 2024-04-25T09:09:21.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f887f200640 1 --2- 172.21.15.173:0/2861378300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8880099a50 0x7f888014ee80 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f887801a630 tx=0x7f88780197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:21.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f8876a00640 1 -- 172.21.15.173:0/2861378300 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88780bc020 con 0x7f8880099a50 2024-04-25T09:09:21.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f8876a00640 1 -- 172.21.15.173:0/2861378300 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8878007d50 con 0x7f8880099a50 2024-04-25T09:09:21.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f8876a00640 1 -- 172.21.15.173:0/2861378300 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88780a58f0 con 0x7f8880099a50 2024-04-25T09:09:21.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f8884a00640 1 -- 172.21.15.173:0/2861378300 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88801548a0 con 0x7f8880099a50 2024-04-25T09:09:21.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f8884a00640 1 -- 172.21.15.173:0/2861378300 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8880154e60 con 0x7f8880099a50 2024-04-25T09:09:21.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f8884a00640 1 -- 172.21.15.173:0/2861378300 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8880073a40 con 0x7f8880099a50 2024-04-25T09:09:21.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.016+0000 7f8876a00640 1 -- 172.21.15.173:0/2861378300 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f88780bf020 con 0x7f8880099a50 2024-04-25T09:09:21.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.020+0000 7f8876a00640 1 --2- 172.21.15.173:0/2861378300 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f885c066f60 0x7f885c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:21.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.020+0000 7f8876a00640 1 -- 172.21.15.173:0/2861378300 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f8878120200 con 0x7f8880099a50 2024-04-25T09:09:21.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.020+0000 7f887e800640 1 --2- 172.21.15.173:0/2861378300 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f885c066f60 0x7f885c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:21.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.020+0000 7f887e800640 1 --2- 172.21.15.173:0/2861378300 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f885c066f60 0x7f885c069420 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8870001810 tx=0x7f8870009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:21.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.024+0000 7f8876a00640 1 -- 172.21.15.173:0/2861378300 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f88780c6030 con 0x7f8880099a50 2024-04-25T09:09:21.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.176+0000 7f8884a00640 1 -- 172.21.15.173:0/2861378300 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f88800d10a0 con 0x7f8880099a50 2024-04-25T09:09:21.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.180+0000 7f8876a00640 1 -- 172.21.15.173:0/2861378300 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8878016620 con 0x7f8880099a50 2024-04-25T09:09:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.184+0000 7f8884a00640 1 -- 172.21.15.173:0/2861378300 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f885c066f60 msgr2=0x7f885c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.184+0000 7f8884a00640 1 --2- 172.21.15.173:0/2861378300 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f885c066f60 0x7f885c069420 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8870001810 tx=0x7f8870009040 comp rx=0 tx=0).stop 2024-04-25T09:09:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.184+0000 7f8884a00640 1 -- 172.21.15.173:0/2861378300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8880099a50 msgr2=0x7f888014ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.184+0000 7f8884a00640 1 --2- 172.21.15.173:0/2861378300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8880099a50 0x7f888014ee80 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f887801a630 tx=0x7f88780197a0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.184+0000 7f8884a00640 1 -- 172.21.15.173:0/2861378300 shutdown_connections 2024-04-25T09:09:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.184+0000 7f8884a00640 1 --2- 172.21.15.173:0/2861378300 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f885c066f60 0x7f885c069420 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.184+0000 7f8884a00640 1 --2- 172.21.15.173:0/2861378300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8880099a50 0x7f888014ee80 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.184+0000 7f8884a00640 1 --2- 172.21.15.173:0/2861378300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f888006c220 0x7f88800b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.184+0000 7f8884a00640 1 --2- 172.21.15.173:0/2861378300 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f888006bda0 0x7f888013fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.184+0000 7f8884a00640 1 -- 172.21.15.173:0/2861378300 >> 172.21.15.173:0/2861378300 conn(0x7f88800b31d0 msgr2=0x7f888006c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:21.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.184+0000 7f8884a00640 1 -- 172.21.15.173:0/2861378300 shutdown_connections 2024-04-25T09:09:21.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.184+0000 7f8884a00640 1 -- 172.21.15.173:0/2861378300 wait complete. 2024-04-25T09:09:21.191 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:09:21.191 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:09:21.237 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:09:21.326 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:09:21.327 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:09:21.327 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:21.335 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:09:21.335 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:09:21.335 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:21.344 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:09:21.344 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:09:21.344 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:21.389 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:09:21.390 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:09:21.390 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:21.399 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:09:21.399 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:09:21.399 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:21.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e21400640 1 Processor -- start 2024-04-25T09:09:21.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e21400640 1 -- start start 2024-04-25T09:09:21.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e21400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8e1c0b3e70 0x7f8e1c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:21.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e21400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e1c0aefa0 0x7f8e1c0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:21.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e21400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8e1c15edd0 0x7f8e1c0b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:21.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e21400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1c06dd50 con 0x7f8e1c15edd0 2024-04-25T09:09:21.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e21400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1c0b4790 con 0x7f8e1c0b3e70 2024-04-25T09:09:21.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e21400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c15f320 con 0x7f8e1c0aefa0 2024-04-25T09:09:21.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e1b200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8e1c15edd0 0x7f8e1c0b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:21.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e1b200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8e1c15edd0 0x7f8e1c0b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46888/0 (socket says 172.21.15.173:46888) 2024-04-25T09:09:21.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e1b200640 1 -- 172.21.15.173:0/1726538762 learned_addr learned my addr 172.21.15.173:0/1726538762 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:21.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e1a800640 1 --2- 172.21.15.173:0/1726538762 >> v2:172.21.15.194:3300/0 conn(0x7f8e1c0b3e70 0x7f8e1c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:21.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e19e00640 1 --2- 172.21.15.173:0/1726538762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e1c0aefa0 0x7f8e1c0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:21.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e1b200640 1 -- 172.21.15.173:0/1726538762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e1c0aefa0 msgr2=0x7f8e1c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:21.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e1b200640 1 --2- 172.21.15.173:0/1726538762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e1c0aefa0 0x7f8e1c0b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e1b200640 1 -- 172.21.15.173:0/1726538762 >> v2:172.21.15.194:3300/0 conn(0x7f8e1c0b3e70 msgr2=0x7f8e1c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:21.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e1b200640 1 --2- 172.21.15.173:0/1726538762 >> v2:172.21.15.194:3300/0 conn(0x7f8e1c0b3e70 0x7f8e1c0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e1b200640 1 -- 172.21.15.173:0/1726538762 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c06d420 con 0x7f8e1c15edd0 2024-04-25T09:09:21.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e1a800640 1 --2- 172.21.15.173:0/1726538762 >> v2:172.21.15.194:3300/0 conn(0x7f8e1c0b3e70 0x7f8e1c0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:21.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.576+0000 7f8e19e00640 1 --2- 172.21.15.173:0/1726538762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e1c0aefa0 0x7f8e1c0b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:21.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.580+0000 7f8e1b200640 1 --2- 172.21.15.173:0/1726538762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e1c15edd0 0x7f8e1c0b2cb0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c06bca0 tx=0x7f8e1401e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7c7b06eef397ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:21.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.580+0000 7f8e19400640 1 -- 172.21.15.173:0/1726538762 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140aa610 con 0x7f8e1c15edd0 2024-04-25T09:09:21.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.580+0000 7f8e19400640 1 -- 172.21.15.173:0/1726538762 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e140aa7b0 con 0x7f8e1c15edd0 2024-04-25T09:09:21.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.580+0000 7f8e19400640 1 -- 172.21.15.173:0/1726538762 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140aab80 con 0x7f8e1c15edd0 2024-04-25T09:09:21.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.580+0000 7f8e21400640 1 -- 172.21.15.173:0/1726538762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e1c15edd0 msgr2=0x7f8e1c0b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:21.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.580+0000 7f8e21400640 1 --2- 172.21.15.173:0/1726538762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e1c15edd0 0x7f8e1c0b2cb0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c06bca0 tx=0x7f8e1401e700 comp rx=0 tx=0).stop 2024-04-25T09:09:21.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.580+0000 7f8e21400640 1 -- 172.21.15.173:0/1726538762 shutdown_connections 2024-04-25T09:09:21.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.580+0000 7f8e21400640 1 --2- 172.21.15.173:0/1726538762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e1c15edd0 0x7f8e1c0b2cb0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.580+0000 7f8e21400640 1 --2- 172.21.15.173:0/1726538762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e1c0aefa0 0x7f8e1c0b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.580+0000 7f8e21400640 1 --2- 172.21.15.173:0/1726538762 >> v2:172.21.15.194:3300/0 conn(0x7f8e1c0b3e70 0x7f8e1c0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.580+0000 7f8e21400640 1 -- 172.21.15.173:0/1726538762 >> 172.21.15.173:0/1726538762 conn(0x7f8e1c06ac90 msgr2=0x7f8e1c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:21.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.580+0000 7f8e21400640 1 -- 172.21.15.173:0/1726538762 shutdown_connections 2024-04-25T09:09:21.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.580+0000 7f8e21400640 1 -- 172.21.15.173:0/1726538762 wait complete. 2024-04-25T09:09:21.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e21400640 1 Processor -- start 2024-04-25T09:09:21.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e21400640 1 -- start start 2024-04-25T09:09:21.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e21400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e1c0aefa0 0x7f8e1c151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:21.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e21400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e1c0b3e70 0x7f8e1c0a8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:21.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e21400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e1c15edd0 0x7f8e1c14bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:21.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e21400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c06e1c0 con 0x7f8e1c0aefa0 2024-04-25T09:09:21.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e21400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0b3600 con 0x7f8e1c15edd0 2024-04-25T09:09:21.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e21400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c06e340 con 0x7f8e1c0b3e70 2024-04-25T09:09:21.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e1a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e1c0aefa0 0x7f8e1c151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:21.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e1a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e1c0aefa0 0x7f8e1c151c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46892/0 (socket says 172.21.15.173:46892) 2024-04-25T09:09:21.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e1a800640 1 -- 172.21.15.173:0/2269944785 learned_addr learned my addr 172.21.15.173:0/2269944785 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:21.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e1b200640 1 --2- 172.21.15.173:0/2269944785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e1c15edd0 0x7f8e1c14bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:21.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e1a800640 1 -- 172.21.15.173:0/2269944785 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e1c0b3e70 msgr2=0x7f8e1c0a8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:21.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e1a800640 1 --2- 172.21.15.173:0/2269944785 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e1c0b3e70 0x7f8e1c0a8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e1a800640 1 -- 172.21.15.173:0/2269944785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e1c15edd0 msgr2=0x7f8e1c14bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:21.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e1a800640 1 --2- 172.21.15.173:0/2269944785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e1c15edd0 0x7f8e1c14bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e1a800640 1 -- 172.21.15.173:0/2269944785 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c0aacc0 con 0x7f8e1c0aefa0 2024-04-25T09:09:21.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e1b200640 1 --2- 172.21.15.173:0/2269944785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e1c15edd0 0x7f8e1c14bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:21.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e1a800640 1 --2- 172.21.15.173:0/2269944785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e1c0aefa0 0x7f8e1c151c80 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c007ef0 tx=0x7f8e0c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:21.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e12a00640 1 -- 172.21.15.173:0/2269944785 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c01a070 con 0x7f8e1c0aefa0 2024-04-25T09:09:21.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e12a00640 1 -- 172.21.15.173:0/2269944785 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c003ba0 con 0x7f8e1c0aefa0 2024-04-25T09:09:21.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e12a00640 1 -- 172.21.15.173:0/2269944785 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c004030 con 0x7f8e1c0aefa0 2024-04-25T09:09:21.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e21400640 1 -- 172.21.15.173:0/2269944785 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1c0b0270 con 0x7f8e1c0aefa0 2024-04-25T09:09:21.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.584+0000 7f8e21400640 1 -- 172.21.15.173:0/2269944785 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1c0b0b10 con 0x7f8e1c0aefa0 2024-04-25T09:09:21.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.588+0000 7f8e21400640 1 -- 172.21.15.173:0/2269944785 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1c0b0660 con 0x7f8e1c0aefa0 2024-04-25T09:09:21.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.588+0000 7f8e12a00640 1 -- 172.21.15.173:0/2269944785 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8e0c01d070 con 0x7f8e1c0aefa0 2024-04-25T09:09:21.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.588+0000 7f8e12a00640 1 --2- 172.21.15.173:0/2269944785 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8dfc066f90 0x7f8dfc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:21.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.588+0000 7f8e12a00640 1 -- 172.21.15.173:0/2269944785 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f8e0c084fe0 con 0x7f8e1c0aefa0 2024-04-25T09:09:21.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.588+0000 7f8e19e00640 1 --2- 172.21.15.173:0/2269944785 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8dfc066f90 0x7f8dfc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:21.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.588+0000 7f8e19e00640 1 --2- 172.21.15.173:0/2269944785 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8dfc066f90 0x7f8dfc069450 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0b1050 tx=0x7f8e08008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:21.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.592+0000 7f8e12a00640 1 -- 172.21.15.173:0/2269944785 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8e0c010070 con 0x7f8e1c0aefa0 2024-04-25T09:09:21.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.780+0000 7f8e21400640 1 -- 172.21.15.173:0/2269944785 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e1c06f1c0 con 0x7f8e1c0aefa0 2024-04-25T09:09:21.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.784+0000 7f8e12a00640 1 -- 172.21.15.173:0/2269944785 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3708 (secure 0 0 0) 0x7f8e0c055b40 con 0x7f8e1c0aefa0 2024-04-25T09:09:21.771 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:21.771 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":58,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2817126227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2817126227},{"type":"v1","addr":"172.21.15.194:6835","nonce":2817126227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":6772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3100146198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3100146198},{"type":"v1","addr":"172.21.15.194:6834","nonce":3100146198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50},{"gid":7251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3600648366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3600648366},{"type":"v1","addr":"172.21.15.173:6835","nonce":3600648366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7656,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/782712910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":782712910},{"type":"v1","addr":"172.21.15.173:6837","nonce":782712910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58}],"filesystems":[]} 2024-04-25T09:09:21.771 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 58 2024-04-25T09:09:21.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.784+0000 7f8e21400640 1 -- 172.21.15.173:0/2269944785 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8dfc066f90 msgr2=0x7f8dfc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:21.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.784+0000 7f8e21400640 1 --2- 172.21.15.173:0/2269944785 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8dfc066f90 0x7f8dfc069450 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0b1050 tx=0x7f8e08008040 comp rx=0 tx=0).stop 2024-04-25T09:09:21.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.784+0000 7f8e21400640 1 -- 172.21.15.173:0/2269944785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e1c0aefa0 msgr2=0x7f8e1c151c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:21.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.784+0000 7f8e21400640 1 --2- 172.21.15.173:0/2269944785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e1c0aefa0 0x7f8e1c151c80 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c007ef0 tx=0x7f8e0c00d4a0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.784+0000 7f8e21400640 1 -- 172.21.15.173:0/2269944785 shutdown_connections 2024-04-25T09:09:21.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.784+0000 7f8e21400640 1 --2- 172.21.15.173:0/2269944785 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8dfc066f90 0x7f8dfc069450 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.784+0000 7f8e21400640 1 --2- 172.21.15.173:0/2269944785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e1c15edd0 0x7f8e1c14bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.784+0000 7f8e21400640 1 --2- 172.21.15.173:0/2269944785 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e1c0b3e70 0x7f8e1c0a8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.784+0000 7f8e21400640 1 --2- 172.21.15.173:0/2269944785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e1c0aefa0 0x7f8e1c151c80 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:21.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.784+0000 7f8e21400640 1 -- 172.21.15.173:0/2269944785 >> 172.21.15.173:0/2269944785 conn(0x7f8e1c06ac90 msgr2=0x7f8e1c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:21.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.784+0000 7f8e21400640 1 -- 172.21.15.173:0/2269944785 shutdown_connections 2024-04-25T09:09:21.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:21.784+0000 7f8e21400640 1 -- 172.21.15.173:0/2269944785 wait complete. 2024-04-25T09:09:21.792 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:09:21.792 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:09:21.792 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:09:21.792 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:09:21.793 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:09:21.793 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:09:21.793 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:09:21.793 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:09:21.793 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:09:21.793 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:09:21.793 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:09:21.793 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:09:21.794 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:09:21.794 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:09:21.794 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:09:21.794 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:09:21.805 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:09:21.806 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:09:21.806 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:09:21.807 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:09:21.809 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:09:21.809 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:09:21.809 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:09:21.810 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:09:21.849 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:09:21.849 DEBUG:teuthology.parallel:result is None 2024-04-25T09:09:21.850 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:09:21.851 DEBUG:teuthology.parallel:result is None 2024-04-25T09:09:21.854 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:09:21.854 DEBUG:teuthology.parallel:result is None 2024-04-25T09:09:21.855 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:09:21.855 DEBUG:teuthology.parallel:result is None 2024-04-25T09:09:21.856 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:09:21.936 INFO:tasks.ceph.mds.c.smithi173.stdout:starting mds.c at 2024-04-25T09:09:21.938 INFO:tasks.ceph.mds.a.smithi173.stdout:starting mds.a at 2024-04-25T09:09:21.941 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-04-25T09:09:21.942 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-04-25T09:09:21.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.012+0000 7f6a17400640 1 Processor -- start 2024-04-25T09:09:21.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.012+0000 7f6a17400640 1 -- start start 2024-04-25T09:09:22.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.012+0000 7f6a17400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a10145290 0x7f6a1015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:22.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.012+0000 7f6a17400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1015c5f0 con 0x7f6a100cc260 2024-04-25T09:09:22.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.012+0000 7f6a17400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1006d4b0 con 0x7f6a100b3fe0 2024-04-25T09:09:22.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.012+0000 7f6a17400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1006d790 con 0x7f6a10145290 2024-04-25T09:09:22.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.012+0000 7f6a15400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f6a100cc260 0x7f6a100cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54762/0 (socket says 172.21.15.173:54762) 2024-04-25T09:09:22.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.012+0000 7f6a15400640 1 -- 172.21.15.173:0/707428503 learned_addr learned my addr 172.21.15.173:0/707428503 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:22.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.012+0000 7f6a14a00640 1 --2- 172.21.15.173:0/707428503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a10145290 0x7f6a1015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:22.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.012+0000 7f6a0fe00640 1 -- 172.21.15.173:0/707428503 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668717251 0 0) 0x7f6a080014a0 con 0x7f6a100cc260 2024-04-25T09:09:22.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.012+0000 7f6a0fe00640 1 -- 172.21.15.173:0/707428503 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69f4003530 con 0x7f6a100cc260 2024-04-25T09:09:22.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.012+0000 7f6a0fe00640 1 -- 172.21.15.173:0/707428503 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718578398 0 0) 0x7f6a1006d4b0 con 0x7f6a100b3fe0 2024-04-25T09:09:22.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.012+0000 7f6a0fe00640 1 -- 172.21.15.173:0/707428503 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a080014a0 con 0x7f6a100b3fe0 2024-04-25T09:09:22.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.012+0000 7f6a14a00640 1 -- 172.21.15.173:0/707428503 >> v1:172.21.15.194:6789/0 conn(0x7f6a100b3fe0 legacy=0x7f6a100b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:22.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.012+0000 7f6a14a00640 1 -- 172.21.15.173:0/707428503 >> v1:172.21.15.173:6789/0 conn(0x7f6a100cc260 legacy=0x7f6a100cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:22.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.012+0000 7f6a14a00640 1 -- 172.21.15.173:0/707428503 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1006da70 con 0x7f6a10145290 2024-04-25T09:09:22.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.016+0000 7f6a14a00640 1 --2- 172.21.15.173:0/707428503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a10145290 0x7f6a1015c0b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6a000097f0 tx=0x7f6a0001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7a9429db406e541 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:22.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.016+0000 7f6a0fe00640 1 -- 172.21.15.173:0/707428503 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000b0070 con 0x7f6a10145290 2024-04-25T09:09:22.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.016+0000 7f6a0fe00640 1 -- 172.21.15.173:0/707428503 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a000ab600 con 0x7f6a10145290 2024-04-25T09:09:22.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.016+0000 7f6a0fe00640 1 -- 172.21.15.173:0/707428503 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000ab9b0 con 0x7f6a10145290 2024-04-25T09:09:22.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.016+0000 7f6a17400640 1 -- 172.21.15.173:0/707428503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a10145290 msgr2=0x7f6a1015c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:22.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.016+0000 7f6a17400640 1 --2- 172.21.15.173:0/707428503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a10145290 0x7f6a1015c0b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6a000097f0 tx=0x7f6a0001c3c0 comp rx=0 tx=0).stop 2024-04-25T09:09:22.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.016+0000 7f6a17400640 1 -- 172.21.15.173:0/707428503 shutdown_connections 2024-04-25T09:09:22.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.016+0000 7f6a17400640 1 --2- 172.21.15.173:0/707428503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a10145290 0x7f6a1015c0b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:22.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.016+0000 7f6a17400640 1 -- 172.21.15.173:0/707428503 >> 172.21.15.173:0/707428503 conn(0x7f6a1006ac90 msgr2=0x7f6a1006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:22.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.016+0000 7f6a17400640 1 -- 172.21.15.173:0/707428503 shutdown_connections 2024-04-25T09:09:22.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.016+0000 7f6a17400640 1 -- 172.21.15.173:0/707428503 wait complete. 2024-04-25T09:09:22.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a17400640 1 Processor -- start 2024-04-25T09:09:22.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a17400640 1 -- start start 2024-04-25T09:09:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a17400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a100b3fe0 0x7f6a101361f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a17400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a100cc260 0x7f6a10136730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a17400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a10145290 0x7f6a10134a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a17400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1006f130 con 0x7f6a10145290 2024-04-25T09:09:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a17400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1006efb0 con 0x7f6a100b3fe0 2024-04-25T09:09:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a17400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a10135760 con 0x7f6a100cc260 2024-04-25T09:09:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a15400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a10145290 0x7f6a10134a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a15400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a10145290 0x7f6a10134a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46934/0 (socket says 172.21.15.173:46934) 2024-04-25T09:09:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a15400640 1 -- 172.21.15.173:0/3066723450 learned_addr learned my addr 172.21.15.173:0/3066723450 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a14a00640 1 --2- 172.21.15.173:0/3066723450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a100b3fe0 0x7f6a101361f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a07e00640 1 --2- 172.21.15.173:0/3066723450 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a100cc260 0x7f6a10136730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a15400640 1 -- 172.21.15.173:0/3066723450 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a100cc260 msgr2=0x7f6a10136730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a15400640 1 --2- 172.21.15.173:0/3066723450 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a100cc260 0x7f6a10136730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:22.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a15400640 1 -- 172.21.15.173:0/3066723450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a100b3fe0 msgr2=0x7f6a101361f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:22.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a15400640 1 --2- 172.21.15.173:0/3066723450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a100b3fe0 0x7f6a101361f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:22.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a15400640 1 -- 172.21.15.173:0/3066723450 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a10135a40 con 0x7f6a10145290 2024-04-25T09:09:22.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a15400640 1 --2- 172.21.15.173:0/3066723450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a10145290 0x7f6a10134a10 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f6a08001f00 tx=0x7f6a0800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:22.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a0d600640 1 -- 172.21.15.173:0/3066723450 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08017070 con 0x7f6a10145290 2024-04-25T09:09:22.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a0d600640 1 -- 172.21.15.173:0/3066723450 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a08012400 con 0x7f6a10145290 2024-04-25T09:09:22.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a17400640 1 -- 172.21.15.173:0/3066723450 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1013afa0 con 0x7f6a10145290 2024-04-25T09:09:22.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a0d600640 1 -- 172.21.15.173:0/3066723450 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a080127b0 con 0x7f6a10145290 2024-04-25T09:09:22.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a17400640 1 -- 172.21.15.173:0/3066723450 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a10135d20 con 0x7f6a10145290 2024-04-25T09:09:22.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.020+0000 7f6a17400640 1 -- 172.21.15.173:0/3066723450 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a10073ab0 con 0x7f6a10145290 2024-04-25T09:09:22.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.024+0000 7f6a0d600640 1 -- 172.21.15.173:0/3066723450 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6a0801a070 con 0x7f6a10145290 2024-04-25T09:09:22.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.024+0000 7f6a0d600640 1 --2- 172.21.15.173:0/3066723450 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f69ec066f60 0x7f69ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:22.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.024+0000 7f6a0d600640 1 -- 172.21.15.173:0/3066723450 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f6a08085190 con 0x7f6a10145290 2024-04-25T09:09:22.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.024+0000 7f6a14a00640 1 --2- 172.21.15.173:0/3066723450 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f69ec066f60 0x7f69ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:22.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.024+0000 7f6a14a00640 1 --2- 172.21.15.173:0/3066723450 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f69ec066f60 0x7f69ec069420 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6a000ad000 tx=0x7f6a000a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:22.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.028+0000 7f6a0d600640 1 -- 172.21.15.173:0/3066723450 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6a1015c5f0 con 0x7f6a10145290 2024-04-25T09:09:22.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.192+0000 7f6a17400640 1 -- 172.21.15.173:0/3066723450 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6a100aefc0 con 0x7f6a10145290 2024-04-25T09:09:22.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.856+0000 7f6a0d600640 1 -- 172.21.15.173:0/3066723450 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v91) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6a08055d30 con 0x7f6a10145290 2024-04-25T09:09:22.843 INFO:teuthology.orchestra.run.smithi173.stderr: removed all blocklist entries 2024-04-25T09:09:22.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.856+0000 7f6a17400640 1 -- 172.21.15.173:0/3066723450 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f69ec066f60 msgr2=0x7f69ec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:22.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.856+0000 7f6a17400640 1 --2- 172.21.15.173:0/3066723450 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f69ec066f60 0x7f69ec069420 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6a000ad000 tx=0x7f6a000a6000 comp rx=0 tx=0).stop 2024-04-25T09:09:22.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.856+0000 7f6a17400640 1 -- 172.21.15.173:0/3066723450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a10145290 msgr2=0x7f6a10134a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:22.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.856+0000 7f6a17400640 1 --2- 172.21.15.173:0/3066723450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a10145290 0x7f6a10134a10 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f6a08001f00 tx=0x7f6a0800a430 comp rx=0 tx=0).stop 2024-04-25T09:09:22.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.856+0000 7f6a17400640 1 -- 172.21.15.173:0/3066723450 shutdown_connections 2024-04-25T09:09:22.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.856+0000 7f6a17400640 1 --2- 172.21.15.173:0/3066723450 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f69ec066f60 0x7f69ec069420 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:22.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.856+0000 7f6a17400640 1 --2- 172.21.15.173:0/3066723450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a10145290 0x7f6a10134a10 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:22.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.856+0000 7f6a17400640 1 --2- 172.21.15.173:0/3066723450 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a100cc260 0x7f6a10136730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:22.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.856+0000 7f6a17400640 1 --2- 172.21.15.173:0/3066723450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a100b3fe0 0x7f6a101361f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:22.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.856+0000 7f6a17400640 1 -- 172.21.15.173:0/3066723450 >> 172.21.15.173:0/3066723450 conn(0x7f6a1006ac90 msgr2=0x7f6a1015cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:22.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.856+0000 7f6a17400640 1 -- 172.21.15.173:0/3066723450 shutdown_connections 2024-04-25T09:09:22.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:22.856+0000 7f6a17400640 1 -- 172.21.15.173:0/3066723450 wait complete. 2024-04-25T09:09:22.871 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:09:23.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.020+0000 7f590de00640 1 Processor -- start 2024-04-25T09:09:23.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.020+0000 7f590de00640 1 -- start start 2024-04-25T09:09:23.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.020+0000 7f590de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f59080cc8b0 0x7f59080ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:23.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.020+0000 7f590de00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f590806e7c0 con 0x7f5908145250 2024-04-25T09:09:23.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.020+0000 7f590de00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f590806d720 con 0x7f59080ce8f0 2024-04-25T09:09:23.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.020+0000 7f590de00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590806da00 con 0x7f59080cc8b0 2024-04-25T09:09:23.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.020+0000 7f5906a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f5908145250 0x7f590815c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54778/0 (socket says 172.21.15.173:54778) 2024-04-25T09:09:23.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.020+0000 7f5906a00640 1 -- 172.21.15.173:0/1352397108 learned_addr learned my addr 172.21.15.173:0/1352397108 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:23.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.020+0000 7f5906000640 1 --2- 172.21.15.173:0/1352397108 >> v2:172.21.15.194:3300/0 conn(0x7f59080cc8b0 0x7f59080ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:23.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.020+0000 7f5905600640 1 -- 172.21.15.173:0/1352397108 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773514620 0 0) 0x7f590806e7c0 con 0x7f5908145250 2024-04-25T09:09:23.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.020+0000 7f5905600640 1 -- 172.21.15.173:0/1352397108 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58ec003530 con 0x7f5908145250 2024-04-25T09:09:23.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.024+0000 7f5906000640 1 -- 172.21.15.173:0/1352397108 >> v1:172.21.15.194:6789/0 conn(0x7f59080ce8f0 legacy=0x7f59080ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:23.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.024+0000 7f5906000640 1 -- 172.21.15.173:0/1352397108 >> v1:172.21.15.173:6789/0 conn(0x7f5908145250 legacy=0x7f590815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:23.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.024+0000 7f5906000640 1 -- 172.21.15.173:0/1352397108 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590806dce0 con 0x7f59080cc8b0 2024-04-25T09:09:23.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.024+0000 7f5906000640 1 --2- 172.21.15.173:0/1352397108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59080cc8b0 0x7f59080ccd30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f58f40097c0 tx=0x7f58f401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3ac8e9ebcdf5c74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:23.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.024+0000 7f5905600640 1 -- 172.21.15.173:0/1352397108 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f40b1070 con 0x7f59080cc8b0 2024-04-25T09:09:23.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.024+0000 7f5905600640 1 -- 172.21.15.173:0/1352397108 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f40ac5f0 con 0x7f59080cc8b0 2024-04-25T09:09:23.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.024+0000 7f5905600640 1 -- 172.21.15.173:0/1352397108 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f40ac9c0 con 0x7f59080cc8b0 2024-04-25T09:09:23.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.024+0000 7f590de00640 1 -- 172.21.15.173:0/1352397108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59080cc8b0 msgr2=0x7f59080ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:23.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.024+0000 7f590de00640 1 --2- 172.21.15.173:0/1352397108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59080cc8b0 0x7f59080ccd30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f58f40097c0 tx=0x7f58f401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.024+0000 7f590de00640 1 -- 172.21.15.173:0/1352397108 shutdown_connections 2024-04-25T09:09:23.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.024+0000 7f590de00640 1 --2- 172.21.15.173:0/1352397108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59080cc8b0 0x7f59080ccd30 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.024+0000 7f590de00640 1 -- 172.21.15.173:0/1352397108 >> 172.21.15.173:0/1352397108 conn(0x7f590806ac90 msgr2=0x7f590806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:23.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f590de00640 1 -- 172.21.15.173:0/1352397108 shutdown_connections 2024-04-25T09:09:23.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f590de00640 1 -- 172.21.15.173:0/1352397108 wait complete. 2024-04-25T09:09:23.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f590de00640 1 Processor -- start 2024-04-25T09:09:23.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f590de00640 1 -- start start 2024-04-25T09:09:23.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f590de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59080cc8b0 0x7f59081435c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:23.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f590de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59080ce8f0 0x7f5908136b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:23.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f590de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5908145250 0x7f59081583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:23.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f590de00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590806d380 con 0x7f59080ce8f0 2024-04-25T09:09:23.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f590de00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590806ef80 con 0x7f59080cc8b0 2024-04-25T09:09:23.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f590de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590806d500 con 0x7f5908145250 2024-04-25T09:09:23.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f5906000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59080ce8f0 0x7f5908136b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:23.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f5906000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59080ce8f0 0x7f5908136b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46938/0 (socket says 172.21.15.173:46938) 2024-04-25T09:09:23.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f5906000640 1 -- 172.21.15.173:0/1968734921 learned_addr learned my addr 172.21.15.173:0/1968734921 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:23.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f5906000640 1 -- 172.21.15.173:0/1968734921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5908145250 msgr2=0x7f59081583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:23.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f5906000640 1 --2- 172.21.15.173:0/1968734921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5908145250 0x7f59081583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f5906000640 1 -- 172.21.15.173:0/1968734921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59080cc8b0 msgr2=0x7f59081435c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:23.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f5906000640 1 --2- 172.21.15.173:0/1968734921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59080cc8b0 0x7f59081435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f5906000640 1 -- 172.21.15.173:0/1968734921 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59081445b0 con 0x7f59080ce8f0 2024-04-25T09:09:23.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f5906000640 1 --2- 172.21.15.173:0/1968734921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59080ce8f0 0x7f5908136b50 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f58f401ab50 tx=0x7f58f4019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:23.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f58ff400640 1 -- 172.21.15.173:0/1968734921 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f40b1040 con 0x7f59080ce8f0 2024-04-25T09:09:23.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f58ff400640 1 -- 172.21.15.173:0/1968734921 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f40bb070 con 0x7f59080ce8f0 2024-04-25T09:09:23.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f590de00640 1 -- 172.21.15.173:0/1968734921 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5908158910 con 0x7f59080ce8f0 2024-04-25T09:09:23.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f58ff400640 1 -- 172.21.15.173:0/1968734921 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4006e20 con 0x7f59080ce8f0 2024-04-25T09:09:23.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.028+0000 7f590de00640 1 -- 172.21.15.173:0/1968734921 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590813aa00 con 0x7f59080ce8f0 2024-04-25T09:09:23.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.032+0000 7f590de00640 1 -- 172.21.15.173:0/1968734921 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5908073a40 con 0x7f59080ce8f0 2024-04-25T09:09:23.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.032+0000 7f58ff400640 1 -- 172.21.15.173:0/1968734921 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f58f40b5650 con 0x7f59080ce8f0 2024-04-25T09:09:23.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.032+0000 7f58ff400640 1 --2- 172.21.15.173:0/1968734921 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f58e8066f60 0x7f58e8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:23.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.032+0000 7f58ff400640 1 -- 172.21.15.173:0/1968734921 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f58f411eb50 con 0x7f59080ce8f0 2024-04-25T09:09:23.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.032+0000 7f5906a00640 1 --2- 172.21.15.173:0/1968734921 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f58e8066f60 0x7f58e8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:23.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.032+0000 7f5906a00640 1 --2- 172.21.15.173:0/1968734921 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f58e8066f60 0x7f58e8069420 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f58f8007fd0 tx=0x7f58f8007940 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:23.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.036+0000 7f58ff400640 1 -- 172.21.15.173:0/1968734921 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f59081445b0 con 0x7f59080ce8f0 2024-04-25T09:09:23.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.248+0000 7f590de00640 1 -- 172.21.15.173:0/1968734921 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f590815c770 con 0x7f59080ce8f0 2024-04-25T09:09:23.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.252+0000 7f58ff400640 1 -- 172.21.15.173:0/1968734921 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f58f40a9070 con 0x7f59080ce8f0 2024-04-25T09:09:23.239 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:23.239 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:09:23.239 INFO:teuthology.orchestra.run.smithi173.stdout: "auth_dump": [ 2024-04-25T09:09:23.240 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.240 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.a", 2024-04-25T09:09:23.240 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmnVr3EhAAn+C0Mb/MrYSZuQyr5QTXig==", 2024-04-25T09:09:23.240 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.240 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:09:23.240 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:09:23.240 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:09:23.240 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:09:23.240 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.240 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:23.240 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.240 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.b", 2024-04-25T09:09:23.240 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6Gypm0QfFHhAAuP8xE/8pvSZMcP8N33OB9Q==", 2024-04-25T09:09:23.240 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.240 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:09:23.241 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:09:23.241 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:09:23.241 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:09:23.241 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.241 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:23.241 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.241 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.c", 2024-04-25T09:09:23.241 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmQsv4GRAATNiD7udOvl8xRDIx64O5jg==", 2024-04-25T09:09:23.241 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.241 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:09:23.241 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:09:23.241 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:09:23.241 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:09:23.241 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.241 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:23.242 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.242 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.d", 2024-04-25T09:09:23.242 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmtGMSJhAAonqLeuSsNrgyZks1eoJ1Gg==", 2024-04-25T09:09:23.242 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.242 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:09:23.242 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:09:23.242 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:09:23.242 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:09:23.242 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.242 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:23.242 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.242 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.0", 2024-04-25T09:09:23.242 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD9Gypm+Yw7LBAAnOFUKU3w1ltre7aHMWZ/SQ==", 2024-04-25T09:09:23.242 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.243 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:09:23.243 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:09:23.243 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:09:23.243 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.243 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:23.243 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.243 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.1", 2024-04-25T09:09:23.243 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAAHCpm4BUIOBAAmbfWUWCun/una5WoemhL6Q==", 2024-04-25T09:09:23.243 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.243 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:09:23.243 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:09:23.243 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:09:23.243 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.243 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:23.243 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.244 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.2", 2024-04-25T09:09:23.244 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAEHCpmFXIaBRAA0cN2GdLSS3jJC+x4RVUUlw==", 2024-04-25T09:09:23.244 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.244 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:09:23.244 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:09:23.244 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:09:23.244 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.244 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:23.244 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.244 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.3", 2024-04-25T09:09:23.244 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAHHCpmUD+YDxAALPvf1wLzhuQmFPo3/vJkdQ==", 2024-04-25T09:09:23.244 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.244 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:09:23.244 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:09:23.244 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:09:23.245 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.245 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:23.245 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.245 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.4", 2024-04-25T09:09:23.245 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQANHCpmLQ0fCBAA1Shz0Pfns+rj5r601hzOnQ==", 2024-04-25T09:09:23.245 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.245 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:09:23.245 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:09:23.245 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:09:23.245 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.245 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:23.245 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.245 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.5", 2024-04-25T09:09:23.245 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAQHCpmyMj1ERAAMRvZ3PFQa9oe6oGemLvfxw==", 2024-04-25T09:09:23.245 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.246 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:09:23.246 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:09:23.246 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:09:23.246 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.246 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:23.246 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.246 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.6", 2024-04-25T09:09:23.246 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQATHCpmKha6GxAAF4zfdFDlylGHHhGI5tVpGA==", 2024-04-25T09:09:23.246 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.246 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:09:23.246 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:09:23.246 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:09:23.246 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.246 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:23.246 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.247 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.7", 2024-04-25T09:09:23.247 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAWHCpmB2lFJhAA3sYYsjS5DIC5fCDz6ur0tA==", 2024-04-25T09:09:23.247 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.247 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:09:23.247 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:09:23.247 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:09:23.247 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.247 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:23.247 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.247 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.0", 2024-04-25T09:09:23.247 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w==", 2024-04-25T09:09:23.247 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.247 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:09:23.247 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow r", 2024-04-25T09:09:23.247 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:09:23.247 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.248 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:23.248 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.248 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.1", 2024-04-25T09:09:23.248 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6Gypm1PbHMxAAXMrgpR/xgzfQuuNrculQxA==", 2024-04-25T09:09:23.248 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.248 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:09:23.248 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:09:23.248 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:09:23.248 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:09:23.248 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.248 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:23.248 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.248 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.2", 2024-04-25T09:09:23.248 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmrTxjMBAAaqwDl5uiLxhaDIk7m6oDIw==", 2024-04-25T09:09:23.248 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.248 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:09:23.249 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:09:23.249 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:09:23.249 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:09:23.249 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.249 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:23.249 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.249 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.3", 2024-04-25T09:09:23.249 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmlAS9ORAAvYbwLnUaDHXOqvEBwJJJcQ==", 2024-04-25T09:09:23.249 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.249 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:09:23.249 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:09:23.249 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:09:23.249 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:09:23.249 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.249 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:23.249 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.250 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.admin", 2024-04-25T09:09:23.250 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD5GypmYFhkMhAACwSsE+B9l263vnlJ0LjFkQ==", 2024-04-25T09:09:23.250 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.250 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:09:23.250 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:09:23.250 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:09:23.250 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:09:23.250 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.250 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:23.250 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.250 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mgr.x", 2024-04-25T09:09:23.250 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmMSqHDhAAe0nkrXbT7dBbAbI89ExUmw==", 2024-04-25T09:09:23.250 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.250 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:09:23.250 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile mgr", 2024-04-25T09:09:23.250 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:09:23.251 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.251 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:09:23.251 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:23.251 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mgr.y", 2024-04-25T09:09:23.251 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmjCuzChAAomjH5vLVICqSFpyDVQeB4w==", 2024-04-25T09:09:23.251 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:09:23.251 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:09:23.251 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile mgr", 2024-04-25T09:09:23.251 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:09:23.251 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.251 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:23.251 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-04-25T09:09:23.251 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:09:23.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.252+0000 7f590de00640 1 -- 172.21.15.173:0/1968734921 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f58e8066f60 msgr2=0x7f58e8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:23.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.252+0000 7f590de00640 1 --2- 172.21.15.173:0/1968734921 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f58e8066f60 0x7f58e8069420 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f58f8007fd0 tx=0x7f58f8007940 comp rx=0 tx=0).stop 2024-04-25T09:09:23.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.252+0000 7f590de00640 1 -- 172.21.15.173:0/1968734921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59080ce8f0 msgr2=0x7f5908136b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:23.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.252+0000 7f590de00640 1 --2- 172.21.15.173:0/1968734921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59080ce8f0 0x7f5908136b50 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f58f401ab50 tx=0x7f58f4019240 comp rx=0 tx=0).stop 2024-04-25T09:09:23.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.252+0000 7f590de00640 1 -- 172.21.15.173:0/1968734921 shutdown_connections 2024-04-25T09:09:23.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.252+0000 7f590de00640 1 --2- 172.21.15.173:0/1968734921 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f58e8066f60 0x7f58e8069420 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.252+0000 7f590de00640 1 --2- 172.21.15.173:0/1968734921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5908145250 0x7f59081583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.252+0000 7f590de00640 1 --2- 172.21.15.173:0/1968734921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59080ce8f0 0x7f5908136b50 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.252+0000 7f590de00640 1 --2- 172.21.15.173:0/1968734921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59080cc8b0 0x7f59081435c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.252+0000 7f590de00640 1 -- 172.21.15.173:0/1968734921 >> 172.21.15.173:0/1968734921 conn(0x7f590806ac90 msgr2=0x7f5908140ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:23.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.252+0000 7f590de00640 1 -- 172.21.15.173:0/1968734921 shutdown_connections 2024-04-25T09:09:23.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.252+0000 7f590de00640 1 -- 172.21.15.173:0/1968734921 wait complete. 2024-04-25T09:09:23.261 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:23.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa751000640 1 Processor -- start 2024-04-25T09:09:23.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa751000640 1 -- start start 2024-04-25T09:09:23.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa751000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa74c15dbb0 0x7fa74c15df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:23.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa751000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74c0d2130 0x7fa74c06c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:23.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa751000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa74c06c7b0 0x7fa74c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:23.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa751000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74c06d870 con 0x7fa74c06c7b0 2024-04-25T09:09:23.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa751000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74c161690 con 0x7fa74c15dbb0 2024-04-25T09:09:23.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa751000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c0d2590 con 0x7fa74c0d2130 2024-04-25T09:09:23.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa74a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa74c06c7b0 0x7fa74c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:23.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa74a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa74c06c7b0 0x7fa74c06f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42110/0 (socket says 172.21.15.173:42110) 2024-04-25T09:09:23.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa74a800640 1 -- 172.21.15.173:0/436425732 learned_addr learned my addr 172.21.15.173:0/436425732 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:23.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa741400640 1 --2- 172.21.15.173:0/436425732 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74c0d2130 0x7fa74c06c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:23.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa749e00640 1 --2- 172.21.15.173:0/436425732 >> v2:172.21.15.194:3300/0 conn(0x7fa74c15dbb0 0x7fa74c15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:23.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa74a800640 1 -- 172.21.15.173:0/436425732 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74c0d2130 msgr2=0x7fa74c06c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:23.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa74a800640 1 --2- 172.21.15.173:0/436425732 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74c0d2130 0x7fa74c06c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa74a800640 1 -- 172.21.15.173:0/436425732 >> v2:172.21.15.194:3300/0 conn(0x7fa74c15dbb0 msgr2=0x7fa74c15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:23.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa74a800640 1 --2- 172.21.15.173:0/436425732 >> v2:172.21.15.194:3300/0 conn(0x7fa74c15dbb0 0x7fa74c15df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa74a800640 1 -- 172.21.15.173:0/436425732 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c15e5c0 con 0x7fa74c06c7b0 2024-04-25T09:09:23.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.408+0000 7fa749e00640 1 --2- 172.21.15.173:0/436425732 >> v2:172.21.15.194:3300/0 conn(0x7fa74c15dbb0 0x7fa74c15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:23.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.412+0000 7fa74a800640 1 --2- 172.21.15.173:0/436425732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74c06c7b0 0x7fa74c06f830 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fa74c0625e0 tx=0x7fa74401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22559d40bc381ca9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:23.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.412+0000 7fa749400640 1 -- 172.21.15.173:0/436425732 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7440a5750 con 0x7fa74c06c7b0 2024-04-25T09:09:23.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.412+0000 7fa749400640 1 -- 172.21.15.173:0/436425732 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7440a58f0 con 0x7fa74c06c7b0 2024-04-25T09:09:23.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.412+0000 7fa749400640 1 -- 172.21.15.173:0/436425732 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7440a5cc0 con 0x7fa74c06c7b0 2024-04-25T09:09:23.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.412+0000 7fa751000640 1 -- 172.21.15.173:0/436425732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74c06c7b0 msgr2=0x7fa74c06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:23.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.412+0000 7fa751000640 1 --2- 172.21.15.173:0/436425732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74c06c7b0 0x7fa74c06f830 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fa74c0625e0 tx=0x7fa74401c9c0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.412+0000 7fa751000640 1 -- 172.21.15.173:0/436425732 shutdown_connections 2024-04-25T09:09:23.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.412+0000 7fa751000640 1 --2- 172.21.15.173:0/436425732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74c06c7b0 0x7fa74c06f830 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.412+0000 7fa751000640 1 --2- 172.21.15.173:0/436425732 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74c0d2130 0x7fa74c06c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.412+0000 7fa751000640 1 --2- 172.21.15.173:0/436425732 >> v2:172.21.15.194:3300/0 conn(0x7fa74c15dbb0 0x7fa74c15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.412+0000 7fa751000640 1 -- 172.21.15.173:0/436425732 >> 172.21.15.173:0/436425732 conn(0x7fa74c061880 msgr2=0x7fa74c061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:23.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.412+0000 7fa751000640 1 -- 172.21.15.173:0/436425732 shutdown_connections 2024-04-25T09:09:23.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.412+0000 7fa751000640 1 -- 172.21.15.173:0/436425732 wait complete. 2024-04-25T09:09:23.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa751000640 1 Processor -- start 2024-04-25T09:09:23.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa751000640 1 -- start start 2024-04-25T09:09:23.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa751000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74c06c7b0 0x7fa74c0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:23.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa751000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa74c0d2130 0x7fa74c14aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:23.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa751000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74c15dbb0 0x7fa74c14b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:23.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa751000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c0cf4e0 con 0x7fa74c15dbb0 2024-04-25T09:09:23.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa751000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c0cf360 con 0x7fa74c0d2130 2024-04-25T09:09:23.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa751000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c0cf660 con 0x7fa74c06c7b0 2024-04-25T09:09:23.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa74a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74c15dbb0 0x7fa74c14b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:23.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa74a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74c15dbb0 0x7fa74c14b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42120/0 (socket says 172.21.15.173:42120) 2024-04-25T09:09:23.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa74a800640 1 -- 172.21.15.173:0/2809834812 learned_addr learned my addr 172.21.15.173:0/2809834812 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:23.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa74a800640 1 -- 172.21.15.173:0/2809834812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74c06c7b0 msgr2=0x7fa74c0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:23.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa74a800640 1 --2- 172.21.15.173:0/2809834812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74c06c7b0 0x7fa74c0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa74a800640 1 -- 172.21.15.173:0/2809834812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa74c0d2130 msgr2=0x7fa74c14aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:23.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa74a800640 1 --2- 172.21.15.173:0/2809834812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa74c0d2130 0x7fa74c14aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa74a800640 1 -- 172.21.15.173:0/2809834812 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c14bab0 con 0x7fa74c15dbb0 2024-04-25T09:09:23.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa74a800640 1 --2- 172.21.15.173:0/2809834812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74c15dbb0 0x7fa74c14b400 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fa7440af040 tx=0x7fa744019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:23.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa742a00640 1 -- 172.21.15.173:0/2809834812 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7440b8670 con 0x7fa74c15dbb0 2024-04-25T09:09:23.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa742a00640 1 -- 172.21.15.173:0/2809834812 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7440be070 con 0x7fa74c15dbb0 2024-04-25T09:09:23.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa742a00640 1 -- 172.21.15.173:0/2809834812 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7440b8a50 con 0x7fa74c15dbb0 2024-04-25T09:09:23.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa751000640 1 -- 172.21.15.173:0/2809834812 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74c14bd90 con 0x7fa74c15dbb0 2024-04-25T09:09:23.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.416+0000 7fa751000640 1 -- 172.21.15.173:0/2809834812 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74c14c350 con 0x7fa74c15dbb0 2024-04-25T09:09:23.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.420+0000 7fa751000640 1 -- 172.21.15.173:0/2809834812 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74c073a40 con 0x7fa74c15dbb0 2024-04-25T09:09:23.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.420+0000 7fa742a00640 1 -- 172.21.15.173:0/2809834812 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa7440b8bf0 con 0x7fa74c15dbb0 2024-04-25T09:09:23.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.420+0000 7fa742a00640 1 --2- 172.21.15.173:0/2809834812 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa728066f60 0x7fa728069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:23.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.420+0000 7fa742a00640 1 -- 172.21.15.173:0/2809834812 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fa744120150 con 0x7fa74c15dbb0 2024-04-25T09:09:23.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.420+0000 7fa749e00640 1 --2- 172.21.15.173:0/2809834812 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa728066f60 0x7fa728069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:23.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.420+0000 7fa749e00640 1 --2- 172.21.15.173:0/2809834812 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa728066f60 0x7fa728069420 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa73c006f10 tx=0x7fa73c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:23.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.424+0000 7fa742a00640 1 -- 172.21.15.173:0/2809834812 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa7440165e0 con 0x7fa74c15dbb0 2024-04-25T09:09:23.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.580+0000 7fa751000640 1 -- 172.21.15.173:0/2809834812 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa74c0cf020 con 0x7fa74c15dbb0 2024-04-25T09:09:23.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.580+0000 7fa742a00640 1 -- 172.21.15.173:0/2809834812 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+13225 (secure 0 0 0) 0x7fa7440f13a0 con 0x7fa74c15dbb0 2024-04-25T09:09:23.569 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:23.569 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":93,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:09:22.866815+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:23.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.584+0000 7fa751000640 1 -- 172.21.15.173:0/2809834812 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa728066f60 msgr2=0x7fa728069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:23.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.584+0000 7fa751000640 1 --2- 172.21.15.173:0/2809834812 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa728066f60 0x7fa728069420 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa73c006f10 tx=0x7fa73c008040 comp rx=0 tx=0).stop 2024-04-25T09:09:23.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.584+0000 7fa751000640 1 -- 172.21.15.173:0/2809834812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74c15dbb0 msgr2=0x7fa74c14b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:23.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.584+0000 7fa751000640 1 --2- 172.21.15.173:0/2809834812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74c15dbb0 0x7fa74c14b400 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fa7440af040 tx=0x7fa744019760 comp rx=0 tx=0).stop 2024-04-25T09:09:23.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.584+0000 7fa751000640 1 -- 172.21.15.173:0/2809834812 shutdown_connections 2024-04-25T09:09:23.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.584+0000 7fa751000640 1 --2- 172.21.15.173:0/2809834812 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa728066f60 0x7fa728069420 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.584+0000 7fa751000640 1 --2- 172.21.15.173:0/2809834812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa74c15dbb0 0x7fa74c14b400 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.584+0000 7fa751000640 1 --2- 172.21.15.173:0/2809834812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa74c0d2130 0x7fa74c14aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.584+0000 7fa751000640 1 --2- 172.21.15.173:0/2809834812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74c06c7b0 0x7fa74c0cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.584+0000 7fa751000640 1 -- 172.21.15.173:0/2809834812 >> 172.21.15.173:0/2809834812 conn(0x7fa74c061880 msgr2=0x7fa74c15f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:23.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.584+0000 7fa751000640 1 -- 172.21.15.173:0/2809834812 shutdown_connections 2024-04-25T09:09:23.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.584+0000 7fa751000640 1 -- 172.21.15.173:0/2809834812 wait complete. 2024-04-25T09:09:23.591 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:09:23.591 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:09:23.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.740+0000 7f45da800640 1 Processor -- start 2024-04-25T09:09:23.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.740+0000 7f45da800640 1 -- start start 2024-04-25T09:09:23.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.744+0000 7f45da800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45d4145290 0x7f45d415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:23.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.744+0000 7f45da800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f45d40cc260 0x7f45d40cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:23.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.744+0000 7f45da800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d415c5f0 con 0x7f45d40b3fe0 2024-04-25T09:09:23.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.744+0000 7f45da800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d406d4b0 con 0x7f45d40cc260 2024-04-25T09:09:23.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.744+0000 7f45da800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d406d790 con 0x7f45d4145290 2024-04-25T09:09:23.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.744+0000 7f45cbe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f45d40b3fe0 0x7f45d40b4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60582/0 (socket says 172.21.15.173:60582) 2024-04-25T09:09:23.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.744+0000 7f45cbe00640 1 -- 172.21.15.173:0/2340290173 learned_addr learned my addr 172.21.15.173:0/2340290173 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:23.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.744+0000 7f45d3e00640 1 --2- 172.21.15.173:0/2340290173 >> v2:172.21.15.194:3300/0 conn(0x7f45d40cc260 0x7f45d40cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:23.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.744+0000 7f45d3400640 1 --2- 172.21.15.173:0/2340290173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45d4145290 0x7f45d415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:23.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.744+0000 7f45d2a00640 1 -- 172.21.15.173:0/2340290173 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114846393 0 0) 0x7f45bc001120 con 0x7f45d40b3fe0 2024-04-25T09:09:23.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.744+0000 7f45d2a00640 1 -- 172.21.15.173:0/2340290173 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45b8003530 con 0x7f45d40b3fe0 2024-04-25T09:09:23.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.744+0000 7f45d3e00640 1 -- 172.21.15.173:0/2340290173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45d4145290 msgr2=0x7f45d415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:23.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.744+0000 7f45d3e00640 1 --2- 172.21.15.173:0/2340290173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45d4145290 0x7f45d415c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.744+0000 7f45d3e00640 1 -- 172.21.15.173:0/2340290173 >> v1:172.21.15.173:6789/0 conn(0x7f45d40b3fe0 legacy=0x7f45d40b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:23.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.744+0000 7f45d2a00640 1 -- 172.21.15.173:0/2340290173 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3494335435 0 0) 0x7f45b8003530 con 0x7f45d40b3fe0 2024-04-25T09:09:23.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.744+0000 7f45d3e00640 1 -- 172.21.15.173:0/2340290173 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d406da70 con 0x7f45d40cc260 2024-04-25T09:09:23.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.748+0000 7f45d3e00640 1 --2- 172.21.15.173:0/2340290173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45d40cc260 0x7f45d40cc6b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009d90 tx=0x7f45cc01c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c219453c09bf0eee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:23.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.748+0000 7f45d2a00640 1 -- 172.21.15.173:0/2340290173 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0ac070 con 0x7f45d40cc260 2024-04-25T09:09:23.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.748+0000 7f45d2a00640 1 -- 172.21.15.173:0/2340290173 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45cc0a6490 con 0x7f45d40cc260 2024-04-25T09:09:23.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.748+0000 7f45d2a00640 1 -- 172.21.15.173:0/2340290173 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc001850 con 0x7f45d40cc260 2024-04-25T09:09:23.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.748+0000 7f45da800640 1 -- 172.21.15.173:0/2340290173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45d40cc260 msgr2=0x7f45d40cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:23.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.748+0000 7f45da800640 1 --2- 172.21.15.173:0/2340290173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45d40cc260 0x7f45d40cc6b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009d90 tx=0x7f45cc01c770 comp rx=0 tx=0).stop 2024-04-25T09:09:23.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.748+0000 7f45da800640 1 -- 172.21.15.173:0/2340290173 shutdown_connections 2024-04-25T09:09:23.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.748+0000 7f45da800640 1 --2- 172.21.15.173:0/2340290173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45d40cc260 0x7f45d40cc6b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.748+0000 7f45da800640 1 --2- 172.21.15.173:0/2340290173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45d4145290 0x7f45d415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.748+0000 7f45da800640 1 -- 172.21.15.173:0/2340290173 >> 172.21.15.173:0/2340290173 conn(0x7f45d406ac90 msgr2=0x7f45d406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:23.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.748+0000 7f45da800640 1 -- 172.21.15.173:0/2340290173 shutdown_connections 2024-04-25T09:09:23.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.748+0000 7f45da800640 1 -- 172.21.15.173:0/2340290173 wait complete. 2024-04-25T09:09:23.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.748+0000 7f45da800640 1 Processor -- start 2024-04-25T09:09:23.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.748+0000 7f45da800640 1 -- start start 2024-04-25T09:09:23.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45da800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45d40b3fe0 0x7f45d413d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:23.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45da800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45d40cc260 0x7f45d40ced00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:23.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45da800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45d4145290 0x7f45d40cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:23.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45da800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d406eee0 con 0x7f45d4145290 2024-04-25T09:09:23.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45da800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d406ed60 con 0x7f45d40cc260 2024-04-25T09:09:23.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45da800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d406f060 con 0x7f45d40b3fe0 2024-04-25T09:09:23.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45d3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45d4145290 0x7f45d40cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:23.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45d3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45d4145290 0x7f45d40cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42136/0 (socket says 172.21.15.173:42136) 2024-04-25T09:09:23.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45d3e00640 1 -- 172.21.15.173:0/1906700292 learned_addr learned my addr 172.21.15.173:0/1906700292 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:23.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45cbe00640 1 --2- 172.21.15.173:0/1906700292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45d40cc260 0x7f45d40ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:23.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45d3400640 1 --2- 172.21.15.173:0/1906700292 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45d40b3fe0 0x7f45d413d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:23.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45d3e00640 1 -- 172.21.15.173:0/1906700292 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45d40b3fe0 msgr2=0x7f45d413d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:23.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45d3e00640 1 --2- 172.21.15.173:0/1906700292 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45d40b3fe0 0x7f45d413d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45d3e00640 1 -- 172.21.15.173:0/1906700292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45d40cc260 msgr2=0x7f45d40ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:23.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45d3e00640 1 --2- 172.21.15.173:0/1906700292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45d40cc260 0x7f45d40ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45d3e00640 1 -- 172.21.15.173:0/1906700292 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d413d7e0 con 0x7f45d4145290 2024-04-25T09:09:23.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45d3e00640 1 --2- 172.21.15.173:0/1906700292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45d4145290 0x7f45d40cd2f0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009d90 tx=0x7f45cc019510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:23.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45cb400640 1 -- 172.21.15.173:0/1906700292 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0c0070 con 0x7f45d4145290 2024-04-25T09:09:23.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45cb400640 1 -- 172.21.15.173:0/1906700292 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45cc0bb470 con 0x7f45d4145290 2024-04-25T09:09:23.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45cb400640 1 -- 172.21.15.173:0/1906700292 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0ac050 con 0x7f45d4145290 2024-04-25T09:09:23.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45da800640 1 -- 172.21.15.173:0/1906700292 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d40cdc60 con 0x7f45d4145290 2024-04-25T09:09:23.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45da800640 1 -- 172.21.15.173:0/1906700292 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d40ce220 con 0x7f45d4145290 2024-04-25T09:09:23.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.752+0000 7f45da800640 1 -- 172.21.15.173:0/1906700292 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d4073ab0 con 0x7f45d4145290 2024-04-25T09:09:23.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.756+0000 7f45cb400640 1 -- 172.21.15.173:0/1906700292 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f45cc0af070 con 0x7f45d4145290 2024-04-25T09:09:23.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.756+0000 7f45cb400640 1 --2- 172.21.15.173:0/1906700292 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f45b0066f60 0x7f45b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:23.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.756+0000 7f45cb400640 1 -- 172.21.15.173:0/1906700292 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f45cc11f0e0 con 0x7f45d4145290 2024-04-25T09:09:23.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.756+0000 7f45d3400640 1 --2- 172.21.15.173:0/1906700292 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f45b0066f60 0x7f45b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:23.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.756+0000 7f45d3400640 1 --2- 172.21.15.173:0/1906700292 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f45b0066f60 0x7f45b0069420 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009b60 tx=0x7f45c4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:23.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.760+0000 7f45cb400640 1 -- 172.21.15.173:0/1906700292 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f45cc016480 con 0x7f45d4145290 2024-04-25T09:09:23.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.916+0000 7f45da800640 1 -- 172.21.15.173:0/1906700292 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f45d40cc750 con 0x7f45d4145290 2024-04-25T09:09:23.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.916+0000 7f45cb400640 1 -- 172.21.15.173:0/1906700292 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7f45cc0efc50 con 0x7f45d4145290 2024-04-25T09:09:23.906 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:09:23.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.920+0000 7f45da800640 1 -- 172.21.15.173:0/1906700292 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f45b0066f60 msgr2=0x7f45b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:23.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.920+0000 7f45da800640 1 --2- 172.21.15.173:0/1906700292 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f45b0066f60 0x7f45b0069420 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009b60 tx=0x7f45c4009190 comp rx=0 tx=0).stop 2024-04-25T09:09:23.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.920+0000 7f45da800640 1 -- 172.21.15.173:0/1906700292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45d4145290 msgr2=0x7f45d40cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:23.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.920+0000 7f45da800640 1 --2- 172.21.15.173:0/1906700292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45d4145290 0x7f45d40cd2f0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009d90 tx=0x7f45cc019510 comp rx=0 tx=0).stop 2024-04-25T09:09:23.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.920+0000 7f45da800640 1 -- 172.21.15.173:0/1906700292 shutdown_connections 2024-04-25T09:09:23.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.920+0000 7f45da800640 1 --2- 172.21.15.173:0/1906700292 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f45b0066f60 0x7f45b0069420 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.920+0000 7f45da800640 1 --2- 172.21.15.173:0/1906700292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45d4145290 0x7f45d40cd2f0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.920+0000 7f45da800640 1 --2- 172.21.15.173:0/1906700292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45d40cc260 0x7f45d40ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.920+0000 7f45da800640 1 --2- 172.21.15.173:0/1906700292 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45d40b3fe0 0x7f45d413d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:23.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.920+0000 7f45da800640 1 -- 172.21.15.173:0/1906700292 >> 172.21.15.173:0/1906700292 conn(0x7f45d406ac90 msgr2=0x7f45d406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:23.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.920+0000 7f45da800640 1 -- 172.21.15.173:0/1906700292 shutdown_connections 2024-04-25T09:09:23.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:23.920+0000 7f45da800640 1 -- 172.21.15.173:0/1906700292 wait complete. 2024-04-25T09:09:23.928 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:09:24.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.076+0000 7fa76a200640 1 Processor -- start 2024-04-25T09:09:24.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.076+0000 7fa76a200640 1 -- start start 2024-04-25T09:09:24.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.076+0000 7fa76a200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa7640d1270 0x7fa7640cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:24.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.076+0000 7fa76a200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa764099b30 0x7fa764099fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:24.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.076+0000 7fa76a200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7640d01d0 con 0x7fa7640cd7e0 2024-04-25T09:09:24.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.076+0000 7fa76a200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7640cffa0 con 0x7fa7640d1270 2024-04-25T09:09:24.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.076+0000 7fa76a200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7640d04b0 con 0x7fa764099b30 2024-04-25T09:09:24.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.076+0000 7fa763e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa764099b30 0x7fa764099fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:24.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.076+0000 7fa762a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa7640d1270 0x7fa7640cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:24.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.076+0000 7fa763400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa7640cd7e0 0x7fa76406cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:57258/0 (socket says 172.21.15.173:57258) 2024-04-25T09:09:24.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.076+0000 7fa763400640 1 -- 172.21.15.173:0/3364904224 learned_addr learned my addr 172.21.15.173:0/3364904224 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:24.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.076+0000 7fa763e00640 1 -- 172.21.15.173:0/3364904224 >> v2:172.21.15.194:3300/0 conn(0x7fa7640d1270 msgr2=0x7fa7640cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:24.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.076+0000 7fa763e00640 1 --2- 172.21.15.173:0/3364904224 >> v2:172.21.15.194:3300/0 conn(0x7fa7640d1270 0x7fa7640cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.076+0000 7fa762000640 1 -- 172.21.15.173:0/3364904224 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786549215 0 0) 0x7fa7640d01d0 con 0x7fa7640cd7e0 2024-04-25T09:09:24.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.076+0000 7fa763e00640 1 -- 172.21.15.173:0/3364904224 >> v1:172.21.15.194:6789/0 conn(0x7fa7640cd7e0 legacy=0x7fa76406cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:24.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.076+0000 7fa763e00640 1 -- 172.21.15.173:0/3364904224 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7640d0790 con 0x7fa764099b30 2024-04-25T09:09:24.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.076+0000 7fa762a00640 1 --2- 172.21.15.173:0/3364904224 >> v2:172.21.15.194:3300/0 conn(0x7fa7640d1270 0x7fa7640cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:24.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.080+0000 7fa763e00640 1 --2- 172.21.15.173:0/3364904224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa764099b30 0x7fa764099fc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009d90 tx=0x7fa75c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10fe19697074a814 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:24.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.080+0000 7fa762000640 1 -- 172.21.15.173:0/3364904224 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0b2070 con 0x7fa764099b30 2024-04-25T09:09:24.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.080+0000 7fa762000640 1 -- 172.21.15.173:0/3364904224 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c0a5920 con 0x7fa764099b30 2024-04-25T09:09:24.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.080+0000 7fa762000640 1 -- 172.21.15.173:0/3364904224 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0a5cf0 con 0x7fa764099b30 2024-04-25T09:09:24.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.080+0000 7fa76a200640 1 -- 172.21.15.173:0/3364904224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa764099b30 msgr2=0x7fa764099fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:24.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.080+0000 7fa76a200640 1 --2- 172.21.15.173:0/3364904224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa764099b30 0x7fa764099fc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009d90 tx=0x7fa75c01c970 comp rx=0 tx=0).stop 2024-04-25T09:09:24.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.080+0000 7fa76a200640 1 -- 172.21.15.173:0/3364904224 shutdown_connections 2024-04-25T09:09:24.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.080+0000 7fa76a200640 1 --2- 172.21.15.173:0/3364904224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa764099b30 0x7fa764099fc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.080+0000 7fa76a200640 1 --2- 172.21.15.173:0/3364904224 >> v2:172.21.15.194:3300/0 conn(0x7fa7640d1270 0x7fa7640cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.080+0000 7fa76a200640 1 -- 172.21.15.173:0/3364904224 >> 172.21.15.173:0/3364904224 conn(0x7fa7640b33a0 msgr2=0x7fa7640b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:24.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.080+0000 7fa76a200640 1 -- 172.21.15.173:0/3364904224 shutdown_connections 2024-04-25T09:09:24.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.080+0000 7fa76a200640 1 -- 172.21.15.173:0/3364904224 wait complete. 2024-04-25T09:09:24.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa76a200640 1 Processor -- start 2024-04-25T09:09:24.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa76a200640 1 -- start start 2024-04-25T09:09:24.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa76a200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa764099b30 0x7fa7641543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:24.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa76a200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7640cd7e0 0x7fa7640b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:24.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa76a200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7640d1270 0x7fa7640b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:24.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa76a200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76415deb0 con 0x7fa7640d1270 2024-04-25T09:09:24.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa76a200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76415dd30 con 0x7fa764099b30 2024-04-25T09:09:24.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa76a200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76415e030 con 0x7fa7640cd7e0 2024-04-25T09:09:24.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa763e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7640d1270 0x7fa7640b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:24.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa763e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7640d1270 0x7fa7640b2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42152/0 (socket says 172.21.15.173:42152) 2024-04-25T09:09:24.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa763e00640 1 -- 172.21.15.173:0/2810040279 learned_addr learned my addr 172.21.15.173:0/2810040279 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:24.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa762a00640 1 --2- 172.21.15.173:0/2810040279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7640cd7e0 0x7fa7640b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:24.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa763400640 1 --2- 172.21.15.173:0/2810040279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa764099b30 0x7fa7641543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:24.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa763e00640 1 -- 172.21.15.173:0/2810040279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7640cd7e0 msgr2=0x7fa7640b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:24.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa763e00640 1 --2- 172.21.15.173:0/2810040279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7640cd7e0 0x7fa7640b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa763e00640 1 -- 172.21.15.173:0/2810040279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa764099b30 msgr2=0x7fa7641543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:24.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa763e00640 1 --2- 172.21.15.173:0/2810040279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa764099b30 0x7fa7641543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa763e00640 1 -- 172.21.15.173:0/2810040279 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7640b1420 con 0x7fa7640d1270 2024-04-25T09:09:24.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa763e00640 1 --2- 172.21.15.173:0/2810040279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7640d1270 0x7fa7640b2720 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009d90 tx=0x7fa75c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:24.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa75b400640 1 -- 172.21.15.173:0/2810040279 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0bd020 con 0x7fa7640d1270 2024-04-25T09:09:24.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa75b400640 1 -- 172.21.15.173:0/2810040279 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c0b3040 con 0x7fa7640d1270 2024-04-25T09:09:24.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa76a200640 1 -- 172.21.15.173:0/2810040279 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7640b1700 con 0x7fa7640d1270 2024-04-25T09:09:24.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa75b400640 1 -- 172.21.15.173:0/2810040279 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0b2050 con 0x7fa7640d1270 2024-04-25T09:09:24.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.084+0000 7fa76a200640 1 -- 172.21.15.173:0/2810040279 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7640b1cc0 con 0x7fa7640d1270 2024-04-25T09:09:24.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.088+0000 7fa76a200640 1 -- 172.21.15.173:0/2810040279 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa764073a40 con 0x7fa7640d1270 2024-04-25T09:09:24.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.088+0000 7fa75b400640 1 -- 172.21.15.173:0/2810040279 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa75c0ad650 con 0x7fa7640d1270 2024-04-25T09:09:24.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.088+0000 7fa75b400640 1 --2- 172.21.15.173:0/2810040279 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa740066f60 0x7fa740069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:24.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.088+0000 7fa75b400640 1 -- 172.21.15.173:0/2810040279 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fa75c11f950 con 0x7fa7640d1270 2024-04-25T09:09:24.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.088+0000 7fa763400640 1 --2- 172.21.15.173:0/2810040279 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa740066f60 0x7fa740069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:24.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.092+0000 7fa763400640 1 --2- 172.21.15.173:0/2810040279 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa740066f60 0x7fa740069420 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa74c007fd0 tx=0x7fa74c007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:24.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.092+0000 7fa75b400640 1 -- 172.21.15.173:0/2810040279 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa75c0c7020 con 0x7fa7640d1270 2024-04-25T09:09:24.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.248+0000 7fa76a200640 1 -- 172.21.15.173:0/2810040279 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa7640b1e90 con 0x7fa7640d1270 2024-04-25T09:09:24.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.252+0000 7fa75b400640 1 -- 172.21.15.173:0/2810040279 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v93) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa75c016560 con 0x7fa7640d1270 2024-04-25T09:09:24.239 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:24.239 INFO:teuthology.orchestra.run.smithi173.stdout:[ 2024-04-25T09:09:24.239 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:09:24.239 INFO:teuthology.orchestra.run.smithi173.stdout: "poolnum": 1, 2024-04-25T09:09:24.239 INFO:teuthology.orchestra.run.smithi173.stdout: "poolname": ".mgr" 2024-04-25T09:09:24.240 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:24.240 INFO:teuthology.orchestra.run.smithi173.stdout:] 2024-04-25T09:09:24.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.252+0000 7fa76a200640 1 -- 172.21.15.173:0/2810040279 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa740066f60 msgr2=0x7fa740069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:24.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.252+0000 7fa76a200640 1 --2- 172.21.15.173:0/2810040279 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa740066f60 0x7fa740069420 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa74c007fd0 tx=0x7fa74c007d60 comp rx=0 tx=0).stop 2024-04-25T09:09:24.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.252+0000 7fa76a200640 1 -- 172.21.15.173:0/2810040279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7640d1270 msgr2=0x7fa7640b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:24.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.252+0000 7fa76a200640 1 --2- 172.21.15.173:0/2810040279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7640d1270 0x7fa7640b2720 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009d90 tx=0x7fa75c019710 comp rx=0 tx=0).stop 2024-04-25T09:09:24.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.252+0000 7fa76a200640 1 -- 172.21.15.173:0/2810040279 shutdown_connections 2024-04-25T09:09:24.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.252+0000 7fa76a200640 1 --2- 172.21.15.173:0/2810040279 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa740066f60 0x7fa740069420 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.252+0000 7fa76a200640 1 --2- 172.21.15.173:0/2810040279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7640d1270 0x7fa7640b2720 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.252+0000 7fa76a200640 1 --2- 172.21.15.173:0/2810040279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7640cd7e0 0x7fa7640b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.252+0000 7fa76a200640 1 --2- 172.21.15.173:0/2810040279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa764099b30 0x7fa7641543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.252+0000 7fa76a200640 1 -- 172.21.15.173:0/2810040279 >> 172.21.15.173:0/2810040279 conn(0x7fa7640b33a0 msgr2=0x7fa76406cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:24.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.252+0000 7fa76a200640 1 -- 172.21.15.173:0/2810040279 shutdown_connections 2024-04-25T09:09:24.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.252+0000 7fa76a200640 1 -- 172.21.15.173:0/2810040279 wait complete. 2024-04-25T09:09:24.260 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:09:24.260 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:09:24.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.408+0000 7fa97a200640 1 Processor -- start 2024-04-25T09:09:24.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.408+0000 7fa97a200640 1 -- start start 2024-04-25T09:09:24.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.412+0000 7fa97a200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa974145290 0x7fa97415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:24.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.412+0000 7fa97a200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa9740b3fe0 0x7fa9740b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:24.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.412+0000 7fa97a200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97415c5f0 con 0x7fa9740cc260 2024-04-25T09:09:24.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.412+0000 7fa97a200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa97406d4b0 con 0x7fa9740b3fe0 2024-04-25T09:09:24.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.412+0000 7fa97a200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97406d790 con 0x7fa974145290 2024-04-25T09:09:24.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.412+0000 7fa96aa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa9740b3fe0 0x7fa9740b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:24.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.412+0000 7fa973e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa9740cc260 0x7fa9740cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60590/0 (socket says 172.21.15.173:60590) 2024-04-25T09:09:24.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.412+0000 7fa973e00640 1 -- 172.21.15.173:0/3885554762 learned_addr learned my addr 172.21.15.173:0/3885554762 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:24.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.412+0000 7fa973400640 1 --2- 172.21.15.173:0/3885554762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa974145290 0x7fa97415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:24.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.412+0000 7fa972a00640 1 -- 172.21.15.173:0/3885554762 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180814670 0 0) 0x7fa96c0014a0 con 0x7fa9740cc260 2024-04-25T09:09:24.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.412+0000 7fa972a00640 1 -- 172.21.15.173:0/3885554762 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa958003530 con 0x7fa9740cc260 2024-04-25T09:09:24.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.412+0000 7fa96aa00640 1 -- 172.21.15.173:0/3885554762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa974145290 msgr2=0x7fa97415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:24.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.412+0000 7fa96aa00640 1 --2- 172.21.15.173:0/3885554762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa974145290 0x7fa97415c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.412+0000 7fa96aa00640 1 -- 172.21.15.173:0/3885554762 >> v1:172.21.15.173:6789/0 conn(0x7fa9740cc260 legacy=0x7fa9740cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:24.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.412+0000 7fa96aa00640 1 -- 172.21.15.173:0/3885554762 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97406da70 con 0x7fa9740b3fe0 2024-04-25T09:09:24.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.412+0000 7fa973400640 1 --2- 172.21.15.173:0/3885554762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa974145290 0x7fa97415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:24.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.416+0000 7fa96aa00640 1 --2- 172.21.15.173:0/3885554762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9740b3fe0 0x7fa9740b4420 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0097c0 tx=0x7fa95c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51f9222e2eba2a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:24.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.416+0000 7fa972a00640 1 -- 172.21.15.173:0/3885554762 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c0b0070 con 0x7fa9740b3fe0 2024-04-25T09:09:24.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.416+0000 7fa972a00640 1 -- 172.21.15.173:0/3885554762 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95c0ab600 con 0x7fa9740b3fe0 2024-04-25T09:09:24.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.416+0000 7fa972a00640 1 -- 172.21.15.173:0/3885554762 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c0ab9b0 con 0x7fa9740b3fe0 2024-04-25T09:09:24.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.416+0000 7fa97a200640 1 -- 172.21.15.173:0/3885554762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9740b3fe0 msgr2=0x7fa9740b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:24.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.416+0000 7fa97a200640 1 --2- 172.21.15.173:0/3885554762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9740b3fe0 0x7fa9740b4420 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0097c0 tx=0x7fa95c01c380 comp rx=0 tx=0).stop 2024-04-25T09:09:24.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.416+0000 7fa97a200640 1 -- 172.21.15.173:0/3885554762 shutdown_connections 2024-04-25T09:09:24.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.416+0000 7fa97a200640 1 --2- 172.21.15.173:0/3885554762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9740b3fe0 0x7fa9740b4420 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.416+0000 7fa97a200640 1 --2- 172.21.15.173:0/3885554762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa974145290 0x7fa97415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.416+0000 7fa97a200640 1 -- 172.21.15.173:0/3885554762 >> 172.21.15.173:0/3885554762 conn(0x7fa97406ac90 msgr2=0x7fa97406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:24.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.416+0000 7fa97a200640 1 -- 172.21.15.173:0/3885554762 shutdown_connections 2024-04-25T09:09:24.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.416+0000 7fa97a200640 1 -- 172.21.15.173:0/3885554762 wait complete. 2024-04-25T09:09:24.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.416+0000 7fa97a200640 1 Processor -- start 2024-04-25T09:09:24.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.416+0000 7fa97a200640 1 -- start start 2024-04-25T09:09:24.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa97a200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9740b3fe0 0x7fa97415ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:24.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa97a200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9740cc260 0x7fa974141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:24.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa97a200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa974145290 0x7fa974141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:24.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa97a200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97406eee0 con 0x7fa9740b3fe0 2024-04-25T09:09:24.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa97a200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97406ed60 con 0x7fa974145290 2024-04-25T09:09:24.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa97a200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97406f060 con 0x7fa9740cc260 2024-04-25T09:09:24.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa973400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9740b3fe0 0x7fa97415ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:24.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa973400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9740b3fe0 0x7fa97415ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42182/0 (socket says 172.21.15.173:42182) 2024-04-25T09:09:24.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa973400640 1 -- 172.21.15.173:0/3394397875 learned_addr learned my addr 172.21.15.173:0/3394397875 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:24.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa96aa00640 1 --2- 172.21.15.173:0/3394397875 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9740cc260 0x7fa974141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:24.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa973e00640 1 --2- 172.21.15.173:0/3394397875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa974145290 0x7fa974141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:24.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa973400640 1 -- 172.21.15.173:0/3394397875 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9740cc260 msgr2=0x7fa974141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:24.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa973400640 1 --2- 172.21.15.173:0/3394397875 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9740cc260 0x7fa974141060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa973400640 1 -- 172.21.15.173:0/3394397875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa974145290 msgr2=0x7fa974141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:24.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa973400640 1 --2- 172.21.15.173:0/3394397875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa974145290 0x7fa974141ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa973400640 1 -- 172.21.15.173:0/3394397875 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9741402a0 con 0x7fa9740b3fe0 2024-04-25T09:09:24.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa973e00640 1 --2- 172.21.15.173:0/3394397875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa974145290 0x7fa974141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:24.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa973400640 1 --2- 172.21.15.173:0/3394397875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9740b3fe0 0x7fa97415ad90 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fa96400d800 tx=0x7fa96400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:24.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa96be00640 1 -- 172.21.15.173:0/3394397875 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa964018020 con 0x7fa9740b3fe0 2024-04-25T09:09:24.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa96be00640 1 -- 172.21.15.173:0/3394397875 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9640096c0 con 0x7fa9740b3fe0 2024-04-25T09:09:24.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa96be00640 1 -- 172.21.15.173:0/3394397875 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa964009ab0 con 0x7fa9740b3fe0 2024-04-25T09:09:24.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa97a200640 1 -- 172.21.15.173:0/3394397875 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa974140580 con 0x7fa9740b3fe0 2024-04-25T09:09:24.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa97a200640 1 -- 172.21.15.173:0/3394397875 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa974140b40 con 0x7fa9740b3fe0 2024-04-25T09:09:24.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa97a200640 1 -- 172.21.15.173:0/3394397875 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa974073ab0 con 0x7fa9740b3fe0 2024-04-25T09:09:24.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.420+0000 7fa96be00640 1 -- 172.21.15.173:0/3394397875 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa96401b020 con 0x7fa9740b3fe0 2024-04-25T09:09:24.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.424+0000 7fa96be00640 1 --2- 172.21.15.173:0/3394397875 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa950066f90 0x7fa950069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:24.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.424+0000 7fa96be00640 1 -- 172.21.15.173:0/3394397875 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fa964085300 con 0x7fa9740b3fe0 2024-04-25T09:09:24.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.424+0000 7fa96aa00640 1 --2- 172.21.15.173:0/3394397875 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa950066f90 0x7fa950069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:24.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.424+0000 7fa96aa00640 1 --2- 172.21.15.173:0/3394397875 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa950066f90 0x7fa950069450 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0ad000 tx=0x7fa95c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:24.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.428+0000 7fa96be00640 1 -- 172.21.15.173:0/3394397875 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa964022020 con 0x7fa9740b3fe0 2024-04-25T09:09:24.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.580+0000 7fa97a200640 1 -- 172.21.15.173:0/3394397875 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa9740cc040 con 0x7fa9740b3fe0 2024-04-25T09:09:24.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.856+0000 7fa96be00640 1 -- 172.21.15.173:0/3394397875 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v94) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa9640564d0 con 0x7fa9740b3fe0 2024-04-25T09:09:24.847 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' created 2024-04-25T09:09:24.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.860+0000 7fa97a200640 1 -- 172.21.15.173:0/3394397875 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa950066f90 msgr2=0x7fa950069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:24.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.860+0000 7fa97a200640 1 --2- 172.21.15.173:0/3394397875 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa950066f90 0x7fa950069450 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0ad000 tx=0x7fa95c008040 comp rx=0 tx=0).stop 2024-04-25T09:09:24.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.860+0000 7fa97a200640 1 -- 172.21.15.173:0/3394397875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9740b3fe0 msgr2=0x7fa97415ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:24.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.860+0000 7fa97a200640 1 --2- 172.21.15.173:0/3394397875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9740b3fe0 0x7fa97415ad90 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fa96400d800 tx=0x7fa96400dcc0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.860+0000 7fa97a200640 1 -- 172.21.15.173:0/3394397875 shutdown_connections 2024-04-25T09:09:24.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.860+0000 7fa97a200640 1 --2- 172.21.15.173:0/3394397875 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa950066f90 0x7fa950069450 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.860+0000 7fa97a200640 1 --2- 172.21.15.173:0/3394397875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa974145290 0x7fa974141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.860+0000 7fa97a200640 1 --2- 172.21.15.173:0/3394397875 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9740cc260 0x7fa974141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.860+0000 7fa97a200640 1 --2- 172.21.15.173:0/3394397875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9740b3fe0 0x7fa97415ad90 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:24.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.860+0000 7fa97a200640 1 -- 172.21.15.173:0/3394397875 >> 172.21.15.173:0/3394397875 conn(0x7fa97406ac90 msgr2=0x7fa9741433b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:24.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.860+0000 7fa97a200640 1 -- 172.21.15.173:0/3394397875 shutdown_connections 2024-04-25T09:09:24.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:24.860+0000 7fa97a200640 1 -- 172.21.15.173:0/3394397875 wait complete. 2024-04-25T09:09:24.874 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:09:25.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.028+0000 7f2cbdc00640 1 Processor -- start 2024-04-25T09:09:25.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.028+0000 7f2cbdc00640 1 -- start start 2024-04-25T09:09:25.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.028+0000 7f2cbdc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb8145290 0x7f2cb815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:25.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.028+0000 7f2cbdc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2cb80b3fe0 0x7f2cb80b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:25.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.028+0000 7f2cbdc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2cb80cc260 0x7f2cb80cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:25.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.028+0000 7f2cbdc00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb815c5f0 con 0x7f2cb80cc260 2024-04-25T09:09:25.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.028+0000 7f2cbdc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb806d4b0 con 0x7f2cb80b3fe0 2024-04-25T09:09:25.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.028+0000 7f2cbdc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb806d790 con 0x7f2cb8145290 2024-04-25T09:09:25.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.032+0000 7f2cb7400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2cb80cc260 0x7f2cb80cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:25.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.032+0000 7f2cb7400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2cb80cc260 0x7f2cb80cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42184/0 (socket says 172.21.15.173:42184) 2024-04-25T09:09:25.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.032+0000 7f2cb7400640 1 -- 172.21.15.173:0/2037982281 learned_addr learned my addr 172.21.15.173:0/2037982281 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:25.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.032+0000 7f2cb6a00640 1 --2- 172.21.15.173:0/2037982281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb8145290 0x7f2cb815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:25.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.032+0000 7f2cb6000640 1 --2- 172.21.15.173:0/2037982281 >> v2:172.21.15.194:3300/0 conn(0x7f2cb80b3fe0 0x7f2cb80b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:25.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.032+0000 7f2cb7400640 1 -- 172.21.15.173:0/2037982281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb8145290 msgr2=0x7f2cb815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:25.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.032+0000 7f2cb7400640 1 --2- 172.21.15.173:0/2037982281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb8145290 0x7f2cb815c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:25.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.032+0000 7f2cb7400640 1 -- 172.21.15.173:0/2037982281 >> v2:172.21.15.194:3300/0 conn(0x7f2cb80b3fe0 msgr2=0x7f2cb80b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:25.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.032+0000 7f2cb7400640 1 --2- 172.21.15.173:0/2037982281 >> v2:172.21.15.194:3300/0 conn(0x7f2cb80b3fe0 0x7f2cb80b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:25.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.032+0000 7f2cb7400640 1 -- 172.21.15.173:0/2037982281 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb806da70 con 0x7f2cb80cc260 2024-04-25T09:09:25.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.032+0000 7f2cb7400640 1 --2- 172.21.15.173:0/2037982281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cb80cc260 0x7f2cb80cc6b0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f2cb80d0760 tx=0x7f2cb001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9f56101919b24f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:25.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.032+0000 7f2cb5600640 1 -- 172.21.15.173:0/2037982281 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb00b0070 con 0x7f2cb80cc260 2024-04-25T09:09:25.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.032+0000 7f2cb5600640 1 -- 172.21.15.173:0/2037982281 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb00ab600 con 0x7f2cb80cc260 2024-04-25T09:09:25.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.032+0000 7f2cb5600640 1 -- 172.21.15.173:0/2037982281 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb00ab9d0 con 0x7f2cb80cc260 2024-04-25T09:09:25.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cbdc00640 1 -- 172.21.15.173:0/2037982281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cb80cc260 msgr2=0x7f2cb80cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:25.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cbdc00640 1 --2- 172.21.15.173:0/2037982281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cb80cc260 0x7f2cb80cc6b0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f2cb80d0760 tx=0x7f2cb001c400 comp rx=0 tx=0).stop 2024-04-25T09:09:25.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cbdc00640 1 -- 172.21.15.173:0/2037982281 shutdown_connections 2024-04-25T09:09:25.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cbdc00640 1 --2- 172.21.15.173:0/2037982281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cb80cc260 0x7f2cb80cc6b0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:25.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cbdc00640 1 --2- 172.21.15.173:0/2037982281 >> v2:172.21.15.194:3300/0 conn(0x7f2cb80b3fe0 0x7f2cb80b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:25.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cbdc00640 1 --2- 172.21.15.173:0/2037982281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb8145290 0x7f2cb815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:25.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cbdc00640 1 -- 172.21.15.173:0/2037982281 >> 172.21.15.173:0/2037982281 conn(0x7f2cb806ac90 msgr2=0x7f2cb806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:25.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cbdc00640 1 -- 172.21.15.173:0/2037982281 shutdown_connections 2024-04-25T09:09:25.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cbdc00640 1 -- 172.21.15.173:0/2037982281 wait complete. 2024-04-25T09:09:25.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cbdc00640 1 Processor -- start 2024-04-25T09:09:25.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cbdc00640 1 -- start start 2024-04-25T09:09:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cbdc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb80b3fe0 0x7f2cb815d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cbdc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cb80cc260 0x7f2cb812d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cbdc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb8145290 0x7f2cb813fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cbdc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb81457f0 con 0x7f2cb80cc260 2024-04-25T09:09:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cbdc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb8145670 con 0x7f2cb80b3fe0 2024-04-25T09:09:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cbdc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb806ed60 con 0x7f2cb8145290 2024-04-25T09:09:25.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cb6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cb80cc260 0x7f2cb812d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:25.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cb6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cb80cc260 0x7f2cb812d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42192/0 (socket says 172.21.15.173:42192) 2024-04-25T09:09:25.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cb6000640 1 -- 172.21.15.173:0/3321551061 learned_addr learned my addr 172.21.15.173:0/3321551061 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:25.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cb7400640 1 --2- 172.21.15.173:0/3321551061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb8145290 0x7f2cb813fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:25.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cb6a00640 1 --2- 172.21.15.173:0/3321551061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb80b3fe0 0x7f2cb815d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:25.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cb6000640 1 -- 172.21.15.173:0/3321551061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb8145290 msgr2=0x7f2cb813fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:25.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cb6000640 1 --2- 172.21.15.173:0/3321551061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb8145290 0x7f2cb813fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:25.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cb6000640 1 -- 172.21.15.173:0/3321551061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb80b3fe0 msgr2=0x7f2cb815d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:25.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cb6000640 1 --2- 172.21.15.173:0/3321551061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb80b3fe0 0x7f2cb815d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:25.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cb6000640 1 -- 172.21.15.173:0/3321551061 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb812e0f0 con 0x7f2cb80cc260 2024-04-25T09:09:25.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cb7400640 1 --2- 172.21.15.173:0/3321551061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb8145290 0x7f2cb813fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:25.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.036+0000 7f2cb6a00640 1 --2- 172.21.15.173:0/3321551061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb80b3fe0 0x7f2cb815d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:25.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.040+0000 7f2cb6000640 1 --2- 172.21.15.173:0/3321551061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cb80cc260 0x7f2cb812d9e0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400d800 tx=0x7f2ca400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:25.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.040+0000 7f2caea00640 1 -- 172.21.15.173:0/3321551061 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4018020 con 0x7f2cb80cc260 2024-04-25T09:09:25.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.040+0000 7f2caea00640 1 -- 172.21.15.173:0/3321551061 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca40096a0 con 0x7f2cb80cc260 2024-04-25T09:09:25.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.040+0000 7f2caea00640 1 -- 172.21.15.173:0/3321551061 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4009a50 con 0x7f2cb80cc260 2024-04-25T09:09:25.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.040+0000 7f2cbdc00640 1 -- 172.21.15.173:0/3321551061 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb812e3b0 con 0x7f2cb80cc260 2024-04-25T09:09:25.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.040+0000 7f2cbdc00640 1 -- 172.21.15.173:0/3321551061 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb8140430 con 0x7f2cb80cc260 2024-04-25T09:09:25.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.040+0000 7f2cbdc00640 1 -- 172.21.15.173:0/3321551061 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb8073ab0 con 0x7f2cb80cc260 2024-04-25T09:09:25.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.040+0000 7f2caea00640 1 -- 172.21.15.173:0/3321551061 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2ca401b020 con 0x7f2cb80cc260 2024-04-25T09:09:25.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.040+0000 7f2caea00640 1 --2- 172.21.15.173:0/3321551061 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2c98066f60 0x7f2c98069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:25.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.040+0000 7f2caea00640 1 -- 172.21.15.173:0/3321551061 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f2ca40855f0 con 0x7f2cb80cc260 2024-04-25T09:09:25.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.040+0000 7f2cb6a00640 1 --2- 172.21.15.173:0/3321551061 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2c98066f60 0x7f2c98069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:25.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.044+0000 7f2cb6a00640 1 --2- 172.21.15.173:0/3321551061 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2c98066f60 0x7f2c98069420 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009f50 tx=0x7f2ca800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:25.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.044+0000 7f2caea00640 1 -- 172.21.15.173:0/3321551061 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2ca4022020 con 0x7f2cb80cc260 2024-04-25T09:09:25.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.200+0000 7f2cbdc00640 1 -- 172.21.15.173:0/3321551061 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2cb8140dc0 con 0x7f2cb80cc260 2024-04-25T09:09:25.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.864+0000 7f2caea00640 1 -- 172.21.15.173:0/3321551061 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v95) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2ca40565b0 con 0x7f2cb80cc260 2024-04-25T09:09:25.855 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' created 2024-04-25T09:09:25.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.868+0000 7f2cbdc00640 1 -- 172.21.15.173:0/3321551061 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2c98066f60 msgr2=0x7f2c98069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:25.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.868+0000 7f2cbdc00640 1 --2- 172.21.15.173:0/3321551061 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2c98066f60 0x7f2c98069420 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009f50 tx=0x7f2ca800b040 comp rx=0 tx=0).stop 2024-04-25T09:09:25.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.868+0000 7f2cbdc00640 1 -- 172.21.15.173:0/3321551061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cb80cc260 msgr2=0x7f2cb812d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:25.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.868+0000 7f2cbdc00640 1 --2- 172.21.15.173:0/3321551061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cb80cc260 0x7f2cb812d9e0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400d800 tx=0x7f2ca400dcc0 comp rx=0 tx=0).stop 2024-04-25T09:09:25.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.868+0000 7f2cbdc00640 1 -- 172.21.15.173:0/3321551061 shutdown_connections 2024-04-25T09:09:25.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.868+0000 7f2cbdc00640 1 --2- 172.21.15.173:0/3321551061 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2c98066f60 0x7f2c98069420 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:25.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.868+0000 7f2cbdc00640 1 --2- 172.21.15.173:0/3321551061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb8145290 0x7f2cb813fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:25.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.868+0000 7f2cbdc00640 1 --2- 172.21.15.173:0/3321551061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cb80cc260 0x7f2cb812d9e0 secure :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400d800 tx=0x7f2ca400dcc0 comp rx=0 tx=0).stop 2024-04-25T09:09:25.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.868+0000 7f2cbdc00640 1 --2- 172.21.15.173:0/3321551061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb80b3fe0 0x7f2cb815d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:25.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.868+0000 7f2cbdc00640 1 -- 172.21.15.173:0/3321551061 >> 172.21.15.173:0/3321551061 conn(0x7f2cb806ac90 msgr2=0x7f2cb80b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:25.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.872+0000 7f2cbdc00640 1 -- 172.21.15.173:0/3321551061 shutdown_connections 2024-04-25T09:09:25.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:25.872+0000 7f2cbdc00640 1 -- 172.21.15.173:0/3321551061 wait complete. 2024-04-25T09:09:25.898 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:09:26.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.048+0000 7f0a7ec00640 1 Processor -- start 2024-04-25T09:09:26.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.048+0000 7f0a7ec00640 1 -- start start 2024-04-25T09:09:26.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.052+0000 7f0a7ec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a780aeb90 0x7f0a780cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:26.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.052+0000 7f0a7ec00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0a780ce2b0 0x7f0a780cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:26.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.052+0000 7f0a7ec00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a78071570 con 0x7f0a780aef70 2024-04-25T09:09:26.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.052+0000 7f0a7ec00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a78071320 con 0x7f0a780ce2b0 2024-04-25T09:09:26.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.052+0000 7f0a7ec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a78072330 con 0x7f0a780aeb90 2024-04-25T09:09:26.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.052+0000 7f0a7cc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0a780ce2b0 0x7f0a780cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:26.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.052+0000 7f0a7cc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0a780ce2b0 0x7f0a780cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42206/0 (socket says 172.21.15.173:42206) 2024-04-25T09:09:26.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.052+0000 7f0a7cc00640 1 -- 172.21.15.173:0/2902490172 learned_addr learned my addr 172.21.15.173:0/2902490172 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:26.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.052+0000 7f0a77e00640 1 --2- 172.21.15.173:0/2902490172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a780aeb90 0x7f0a780cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:26.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.052+0000 7f0a7cc00640 1 -- 172.21.15.173:0/2902490172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a780aeb90 msgr2=0x7f0a780cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:26.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.052+0000 7f0a7cc00640 1 --2- 172.21.15.173:0/2902490172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a780aeb90 0x7f0a780cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:26.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.052+0000 7f0a7cc00640 1 -- 172.21.15.173:0/2902490172 >> v1:172.21.15.194:6789/0 conn(0x7f0a780aef70 legacy=0x7f0a780cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:26.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.052+0000 7f0a7cc00640 1 -- 172.21.15.173:0/2902490172 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a78071850 con 0x7f0a780ce2b0 2024-04-25T09:09:26.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.056+0000 7f0a7cc00640 1 --2- 172.21.15.173:0/2902490172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a780ce2b0 0x7f0a780cc610 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009e50 tx=0x7f0a7001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6758380b042f866e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:26.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.056+0000 7f0a76a00640 1 -- 172.21.15.173:0/2902490172 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a700a5730 con 0x7f0a780ce2b0 2024-04-25T09:09:26.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.056+0000 7f0a76a00640 1 -- 172.21.15.173:0/2902490172 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a700a58d0 con 0x7f0a780ce2b0 2024-04-25T09:09:26.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.056+0000 7f0a76a00640 1 -- 172.21.15.173:0/2902490172 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a700a5ca0 con 0x7f0a780ce2b0 2024-04-25T09:09:26.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.056+0000 7f0a7ec00640 1 -- 172.21.15.173:0/2902490172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a780ce2b0 msgr2=0x7f0a780cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:26.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.056+0000 7f0a7ec00640 1 --2- 172.21.15.173:0/2902490172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a780ce2b0 0x7f0a780cc610 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009e50 tx=0x7f0a7001c970 comp rx=0 tx=0).stop 2024-04-25T09:09:26.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.056+0000 7f0a7ec00640 1 -- 172.21.15.173:0/2902490172 shutdown_connections 2024-04-25T09:09:26.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.056+0000 7f0a7ec00640 1 --2- 172.21.15.173:0/2902490172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a780ce2b0 0x7f0a780cc610 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:26.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.056+0000 7f0a7ec00640 1 --2- 172.21.15.173:0/2902490172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a780aeb90 0x7f0a780cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:26.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.056+0000 7f0a7ec00640 1 -- 172.21.15.173:0/2902490172 >> 172.21.15.173:0/2902490172 conn(0x7f0a7806ac90 msgr2=0x7f0a7806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:26.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.056+0000 7f0a7ec00640 1 -- 172.21.15.173:0/2902490172 shutdown_connections 2024-04-25T09:09:26.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.056+0000 7f0a7ec00640 1 -- 172.21.15.173:0/2902490172 wait complete. 2024-04-25T09:09:26.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.056+0000 7f0a7ec00640 1 Processor -- start 2024-04-25T09:09:26.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.056+0000 7f0a7ec00640 1 -- start start 2024-04-25T09:09:26.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a7ec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a780aeb90 0x7f0a78150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:26.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a7ec00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a780aef70 0x7f0a78149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:26.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a7ec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a780ce2b0 0x7f0a78158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:26.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a7ec00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7815bb30 con 0x7f0a780aef70 2024-04-25T09:09:26.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a7ec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7815b9b0 con 0x7f0a780aeb90 2024-04-25T09:09:26.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a7ec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7815bcb0 con 0x7f0a780ce2b0 2024-04-25T09:09:26.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a77400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a780aef70 0x7f0a78149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:26.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a77400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a780aef70 0x7f0a78149720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42220/0 (socket says 172.21.15.173:42220) 2024-04-25T09:09:26.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a77400640 1 -- 172.21.15.173:0/3300971922 learned_addr learned my addr 172.21.15.173:0/3300971922 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:26.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a77e00640 1 --2- 172.21.15.173:0/3300971922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a780aeb90 0x7f0a78150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:26.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a7cc00640 1 --2- 172.21.15.173:0/3300971922 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a780ce2b0 0x7f0a78158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:26.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a77400640 1 -- 172.21.15.173:0/3300971922 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a780ce2b0 msgr2=0x7f0a78158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:26.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a77400640 1 --2- 172.21.15.173:0/3300971922 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a780ce2b0 0x7f0a78158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:26.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a77400640 1 -- 172.21.15.173:0/3300971922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a780aeb90 msgr2=0x7f0a78150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:26.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a77400640 1 --2- 172.21.15.173:0/3300971922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a780aeb90 0x7f0a78150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:26.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a77400640 1 -- 172.21.15.173:0/3300971922 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a78155400 con 0x7f0a780aef70 2024-04-25T09:09:26.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a77400640 1 --2- 172.21.15.173:0/3300971922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a780aef70 0x7f0a78149720 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800c340 tx=0x7f0a6800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:26.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a6fe00640 1 -- 172.21.15.173:0/3300971922 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a680052d0 con 0x7f0a780aef70 2024-04-25T09:09:26.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a6fe00640 1 -- 172.21.15.173:0/3300971922 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a68005470 con 0x7f0a780aef70 2024-04-25T09:09:26.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a7ec00640 1 -- 172.21.15.173:0/3300971922 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a78156250 con 0x7f0a780aef70 2024-04-25T09:09:26.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a6fe00640 1 -- 172.21.15.173:0/3300971922 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68007260 con 0x7f0a780aef70 2024-04-25T09:09:26.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a7ec00640 1 -- 172.21.15.173:0/3300971922 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a78156810 con 0x7f0a780aef70 2024-04-25T09:09:26.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a7ec00640 1 -- 172.21.15.173:0/3300971922 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a78073ab0 con 0x7f0a780aef70 2024-04-25T09:09:26.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.060+0000 7f0a6fe00640 1 -- 172.21.15.173:0/3300971922 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0a68007400 con 0x7f0a780aef70 2024-04-25T09:09:26.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.064+0000 7f0a6fe00640 1 --2- 172.21.15.173:0/3300971922 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0a54066f60 0x7f0a54069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:26.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.064+0000 7f0a6fe00640 1 -- 172.21.15.173:0/3300971922 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f0a68084d50 con 0x7f0a780aef70 2024-04-25T09:09:26.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.064+0000 7f0a77e00640 1 --2- 172.21.15.173:0/3300971922 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0a54066f60 0x7f0a54069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:26.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.064+0000 7f0a77e00640 1 --2- 172.21.15.173:0/3300971922 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0a54066f60 0x7f0a54069420 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0a600079c0 tx=0x7f0a60008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:26.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.068+0000 7f0a6fe00640 1 -- 172.21.15.173:0/3300971922 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0a68055650 con 0x7f0a780aef70 2024-04-25T09:09:26.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.252+0000 7f0a7ec00640 1 -- 172.21.15.173:0/3300971922 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0a7806b3f0 con 0x7f0a780aef70 2024-04-25T09:09:26.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.868+0000 7f0a6fe00640 1 -- 172.21.15.173:0/3300971922 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v61) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0a680596f0 con 0x7f0a780aef70 2024-04-25T09:09:26.857 INFO:teuthology.orchestra.run.smithi173.stderr:new fs with metadata pool 13 and data pool 14 2024-04-25T09:09:26.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.872+0000 7f0a7ec00640 1 -- 172.21.15.173:0/3300971922 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0a54066f60 msgr2=0x7f0a54069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:26.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.872+0000 7f0a7ec00640 1 --2- 172.21.15.173:0/3300971922 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0a54066f60 0x7f0a54069420 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0a600079c0 tx=0x7f0a60008040 comp rx=0 tx=0).stop 2024-04-25T09:09:26.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.872+0000 7f0a7ec00640 1 -- 172.21.15.173:0/3300971922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a780aef70 msgr2=0x7f0a78149720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:26.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.872+0000 7f0a7ec00640 1 --2- 172.21.15.173:0/3300971922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a780aef70 0x7f0a78149720 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800c340 tx=0x7f0a6800c800 comp rx=0 tx=0).stop 2024-04-25T09:09:26.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.872+0000 7f0a7ec00640 1 -- 172.21.15.173:0/3300971922 shutdown_connections 2024-04-25T09:09:26.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.872+0000 7f0a7ec00640 1 --2- 172.21.15.173:0/3300971922 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0a54066f60 0x7f0a54069420 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:26.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.872+0000 7f0a7ec00640 1 --2- 172.21.15.173:0/3300971922 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a780ce2b0 0x7f0a78158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:26.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.872+0000 7f0a7ec00640 1 --2- 172.21.15.173:0/3300971922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a780aef70 0x7f0a78149720 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:26.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.872+0000 7f0a7ec00640 1 --2- 172.21.15.173:0/3300971922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a780aeb90 0x7f0a78150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:26.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.872+0000 7f0a7ec00640 1 -- 172.21.15.173:0/3300971922 >> 172.21.15.173:0/3300971922 conn(0x7f0a7806ac90 msgr2=0x7f0a7815d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:26.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.872+0000 7f0a7ec00640 1 -- 172.21.15.173:0/3300971922 shutdown_connections 2024-04-25T09:09:26.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:26.872+0000 7f0a7ec00640 1 -- 172.21.15.173:0/3300971922 wait complete. 2024-04-25T09:09:26.910 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:27.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.060+0000 7f3d08600640 1 Processor -- start 2024-04-25T09:09:27.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.060+0000 7f3d08600640 1 -- start start 2024-04-25T09:09:27.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.060+0000 7f3d08600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3d0006b100 0x7f3d000cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:27.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.060+0000 7f3d08600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d0015cd70 con 0x7f3d0015b980 2024-04-25T09:09:27.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.060+0000 7f3d08600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d000ccfb0 con 0x7f3d0006ac90 2024-04-25T09:09:27.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.060+0000 7f3d08600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d000cd290 con 0x7f3d0006b100 2024-04-25T09:09:27.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.060+0000 7f3d05c00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f3d0015b980 0x7f3d000707c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60596/0 (socket says 172.21.15.173:60596) 2024-04-25T09:09:27.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.060+0000 7f3d05c00640 1 -- 172.21.15.173:0/2398868705 learned_addr learned my addr 172.21.15.173:0/2398868705 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:27.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.060+0000 7f3d06600640 1 --2- 172.21.15.173:0/2398868705 >> v2:172.21.15.194:3300/0 conn(0x7f3d0006b100 0x7f3d000cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:27.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.060+0000 7f3cffe00640 1 -- 172.21.15.173:0/2398868705 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297539438 0 0) 0x7f3d0015cd70 con 0x7f3d0015b980 2024-04-25T09:09:27.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.060+0000 7f3cffe00640 1 -- 172.21.15.173:0/2398868705 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ce8003530 con 0x7f3d0015b980 2024-04-25T09:09:27.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.060+0000 7f3d06600640 1 -- 172.21.15.173:0/2398868705 >> v1:172.21.15.194:6789/0 conn(0x7f3d0006ac90 legacy=0x7f3d000cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:27.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.060+0000 7f3d06600640 1 -- 172.21.15.173:0/2398868705 >> v1:172.21.15.173:6789/0 conn(0x7f3d0015b980 legacy=0x7f3d000707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:27.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.060+0000 7f3d06600640 1 -- 172.21.15.173:0/2398868705 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d000cd570 con 0x7f3d0006b100 2024-04-25T09:09:27.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.064+0000 7f3d06600640 1 --2- 172.21.15.173:0/2398868705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0006b100 0x7f3d000cfe80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009d90 tx=0x7f3cf801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81f11964efb21561 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:27.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.064+0000 7f3cffe00640 1 -- 172.21.15.173:0/2398868705 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf80b2070 con 0x7f3d0006b100 2024-04-25T09:09:27.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.064+0000 7f3cffe00640 1 -- 172.21.15.173:0/2398868705 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf80a59a0 con 0x7f3d0006b100 2024-04-25T09:09:27.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.064+0000 7f3cffe00640 1 -- 172.21.15.173:0/2398868705 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf80a5d70 con 0x7f3d0006b100 2024-04-25T09:09:27.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.064+0000 7f3d08600640 1 -- 172.21.15.173:0/2398868705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0006b100 msgr2=0x7f3d000cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:27.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.064+0000 7f3d08600640 1 --2- 172.21.15.173:0/2398868705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0006b100 0x7f3d000cfe80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009d90 tx=0x7f3cf801c8e0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.064+0000 7f3d08600640 1 -- 172.21.15.173:0/2398868705 shutdown_connections 2024-04-25T09:09:27.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.064+0000 7f3d08600640 1 --2- 172.21.15.173:0/2398868705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0006b100 0x7f3d000cfe80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.064+0000 7f3d08600640 1 -- 172.21.15.173:0/2398868705 >> 172.21.15.173:0/2398868705 conn(0x7f3d000b23f0 msgr2=0x7f3d000b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:27.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.064+0000 7f3d08600640 1 -- 172.21.15.173:0/2398868705 shutdown_connections 2024-04-25T09:09:27.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.064+0000 7f3d08600640 1 -- 172.21.15.173:0/2398868705 wait complete. 2024-04-25T09:09:27.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d08600640 1 Processor -- start 2024-04-25T09:09:27.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d08600640 1 -- start start 2024-04-25T09:09:27.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d08600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d0006ac90 0x7f3d00156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:27.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d08600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0006b100 0x7f3d00157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:27.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d08600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d0015b980 0x7f3d0015cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:27.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d08600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d00072600 con 0x7f3d0006ac90 2024-04-25T09:09:27.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d08600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0006b510 con 0x7f3d0006b100 2024-04-25T09:09:27.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d08600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d00072780 con 0x7f3d0015b980 2024-04-25T09:09:27.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d05c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d0006ac90 0x7f3d00156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:27.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d05c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d0006ac90 0x7f3d00156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42228/0 (socket says 172.21.15.173:42228) 2024-04-25T09:09:27.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d05c00640 1 -- 172.21.15.173:0/2649772508 learned_addr learned my addr 172.21.15.173:0/2649772508 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:27.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d06600640 1 --2- 172.21.15.173:0/2649772508 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d0015b980 0x7f3d0015cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:27.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d05200640 1 --2- 172.21.15.173:0/2649772508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0006b100 0x7f3d00157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:27.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d05c00640 1 -- 172.21.15.173:0/2649772508 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d0015b980 msgr2=0x7f3d0015cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:27.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d05c00640 1 --2- 172.21.15.173:0/2649772508 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d0015b980 0x7f3d0015cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d05c00640 1 -- 172.21.15.173:0/2649772508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0006b100 msgr2=0x7f3d00157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:27.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d05c00640 1 --2- 172.21.15.173:0/2649772508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0006b100 0x7f3d00157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d05c00640 1 -- 172.21.15.173:0/2649772508 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d00159d20 con 0x7f3d0006ac90 2024-04-25T09:09:27.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d05c00640 1 --2- 172.21.15.173:0/2649772508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d0006ac90 0x7f3d00156af0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000c4d0 tx=0x7f3cf000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:27.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3cfd600640 1 -- 172.21.15.173:0/2649772508 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0017070 con 0x7f3d0006ac90 2024-04-25T09:09:27.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3cfd600640 1 -- 172.21.15.173:0/2649772508 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf0005cf0 con 0x7f3d0006ac90 2024-04-25T09:09:27.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3cfd600640 1 -- 172.21.15.173:0/2649772508 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0007270 con 0x7f3d0006ac90 2024-04-25T09:09:27.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d08600640 1 -- 172.21.15.173:0/2649772508 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d000b3990 con 0x7f3d0006ac90 2024-04-25T09:09:27.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d08600640 1 -- 172.21.15.173:0/2649772508 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d000b3f10 con 0x7f3d0006ac90 2024-04-25T09:09:27.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.068+0000 7f3d08600640 1 -- 172.21.15.173:0/2649772508 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d00073a40 con 0x7f3d0006ac90 2024-04-25T09:09:27.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.072+0000 7f3cfd600640 1 -- 172.21.15.173:0/2649772508 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3cf001a070 con 0x7f3d0006ac90 2024-04-25T09:09:27.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.072+0000 7f3cfd600640 1 --2- 172.21.15.173:0/2649772508 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3ce4066f60 0x7f3ce4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:27.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.072+0000 7f3cfd600640 1 -- 172.21.15.173:0/2649772508 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3cf00844b0 con 0x7f3d0006ac90 2024-04-25T09:09:27.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.072+0000 7f3d05200640 1 --2- 172.21.15.173:0/2649772508 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3ce4066f60 0x7f3ce4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:27.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.072+0000 7f3d05200640 1 --2- 172.21.15.173:0/2649772508 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3ce4066f60 0x7f3ce4069420 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3d000b2a60 tx=0x7f3cf4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:27.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.076+0000 7f3cfd600640 1 -- 172.21.15.173:0/2649772508 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3cf0054cd0 con 0x7f3d0006ac90 2024-04-25T09:09:27.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.232+0000 7f3d08600640 1 -- 172.21.15.173:0/2649772508 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d0006b7c0 con 0x7f3d0006ac90 2024-04-25T09:09:27.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.232+0000 7f3cfd600640 1 -- 172.21.15.173:0/2649772508 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+16958 (secure 0 0 0) 0x7f3cf0058d70 con 0x7f3d0006ac90 2024-04-25T09:09:27.220 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:27.220 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":96,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:09:26.256956+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:09:24.629351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T09:09:25.248841+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:27.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.232+0000 7f3d08600640 1 -- 172.21.15.173:0/2649772508 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3ce4066f60 msgr2=0x7f3ce4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:27.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.232+0000 7f3d08600640 1 --2- 172.21.15.173:0/2649772508 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3ce4066f60 0x7f3ce4069420 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3d000b2a60 tx=0x7f3cf4009040 comp rx=0 tx=0).stop 2024-04-25T09:09:27.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.232+0000 7f3d08600640 1 -- 172.21.15.173:0/2649772508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d0006ac90 msgr2=0x7f3d00156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:27.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.232+0000 7f3d08600640 1 --2- 172.21.15.173:0/2649772508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d0006ac90 0x7f3d00156af0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000c4d0 tx=0x7f3cf000c990 comp rx=0 tx=0).stop 2024-04-25T09:09:27.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.232+0000 7f3d08600640 1 -- 172.21.15.173:0/2649772508 shutdown_connections 2024-04-25T09:09:27.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.232+0000 7f3d08600640 1 --2- 172.21.15.173:0/2649772508 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3ce4066f60 0x7f3ce4069420 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.232+0000 7f3d08600640 1 --2- 172.21.15.173:0/2649772508 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d0015b980 0x7f3d0015cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.232+0000 7f3d08600640 1 --2- 172.21.15.173:0/2649772508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0006b100 0x7f3d00157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.232+0000 7f3d08600640 1 --2- 172.21.15.173:0/2649772508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d0006ac90 0x7f3d00156af0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.232+0000 7f3d08600640 1 -- 172.21.15.173:0/2649772508 >> 172.21.15.173:0/2649772508 conn(0x7f3d000b23f0 msgr2=0x7f3d000cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:27.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.232+0000 7f3d08600640 1 -- 172.21.15.173:0/2649772508 shutdown_connections 2024-04-25T09:09:27.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.232+0000 7f3d08600640 1 -- 172.21.15.173:0/2649772508 wait complete. 2024-04-25T09:09:27.242 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:27.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.388+0000 7f6fc6600640 1 Processor -- start 2024-04-25T09:09:27.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.388+0000 7f6fc6600640 1 -- start start 2024-04-25T09:09:27.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.388+0000 7f6fc6600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc00cc8b0 0x7f6fc00ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:27.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.388+0000 7f6fc6600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6fc00ce8f0 0x7f6fc00ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:27.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.392+0000 7f6fc6600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc006e7c0 con 0x7f6fc0145250 2024-04-25T09:09:27.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.392+0000 7f6fc6600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc006d720 con 0x7f6fc00ce8f0 2024-04-25T09:09:27.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.392+0000 7f6fc6600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc006da00 con 0x7f6fc00cc8b0 2024-04-25T09:09:27.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.392+0000 7f6fb6a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc00cc8b0 0x7f6fc00ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:27.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.392+0000 7f6fbfe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6fc00ce8f0 0x7f6fc00ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:27.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.392+0000 7f6fb6a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc00cc8b0 0x7f6fc00ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:49738/0 (socket says 172.21.15.173:49738) 2024-04-25T09:09:27.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.392+0000 7f6fb6a00640 1 -- 172.21.15.173:0/3332871431 learned_addr learned my addr 172.21.15.173:0/3332871431 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:27.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.392+0000 7f6fb6a00640 1 -- 172.21.15.173:0/3332871431 >> v2:172.21.15.194:3300/0 conn(0x7f6fc00ce8f0 msgr2=0x7f6fc00ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:27.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.392+0000 7f6fb6a00640 1 --2- 172.21.15.173:0/3332871431 >> v2:172.21.15.194:3300/0 conn(0x7f6fc00ce8f0 0x7f6fc00ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.392+0000 7f6fb6a00640 1 -- 172.21.15.173:0/3332871431 >> v1:172.21.15.194:6789/0 conn(0x7f6fc0145250 legacy=0x7f6fc015c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:27.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.392+0000 7f6fb6a00640 1 -- 172.21.15.173:0/3332871431 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc006dce0 con 0x7f6fc00cc8b0 2024-04-25T09:09:27.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.392+0000 7f6fb6a00640 1 --2- 172.21.15.173:0/3332871431 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc00cc8b0 0x7f6fc00ccd30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009870 tx=0x7f6fa801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3ec612af810e3c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:27.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fbea00640 1 -- 172.21.15.173:0/3332871431 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80ab650 con 0x7f6fc00cc8b0 2024-04-25T09:09:27.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fbea00640 1 -- 172.21.15.173:0/3332871431 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa80b0070 con 0x7f6fc00cc8b0 2024-04-25T09:09:27.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fbea00640 1 -- 172.21.15.173:0/3332871431 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80aba10 con 0x7f6fc00cc8b0 2024-04-25T09:09:27.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fc6600640 1 -- 172.21.15.173:0/3332871431 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc00cc8b0 msgr2=0x7f6fc00ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:27.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fc6600640 1 --2- 172.21.15.173:0/3332871431 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc00cc8b0 0x7f6fc00ccd30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009870 tx=0x7f6fa801c560 comp rx=0 tx=0).stop 2024-04-25T09:09:27.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fc6600640 1 -- 172.21.15.173:0/3332871431 shutdown_connections 2024-04-25T09:09:27.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fc6600640 1 --2- 172.21.15.173:0/3332871431 >> v2:172.21.15.194:3300/0 conn(0x7f6fc00ce8f0 0x7f6fc00ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fc6600640 1 --2- 172.21.15.173:0/3332871431 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc00cc8b0 0x7f6fc00ccd30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fc6600640 1 -- 172.21.15.173:0/3332871431 >> 172.21.15.173:0/3332871431 conn(0x7f6fc006ac90 msgr2=0x7f6fc006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:27.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fc6600640 1 -- 172.21.15.173:0/3332871431 shutdown_connections 2024-04-25T09:09:27.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fc6600640 1 -- 172.21.15.173:0/3332871431 wait complete. 2024-04-25T09:09:27.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fc6600640 1 Processor -- start 2024-04-25T09:09:27.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fc6600640 1 -- start start 2024-04-25T09:09:27.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fc6600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6fc00cc8b0 0x7f6fc00acc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:27.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fc6600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc00ce8f0 0x7f6fc015a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:27.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fc6600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fc0145250 0x7f6fc00ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:27.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fc6600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc006d380 con 0x7f6fc00cc8b0 2024-04-25T09:09:27.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fc6600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc006ef80 con 0x7f6fc0145250 2024-04-25T09:09:27.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fc6600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc006d500 con 0x7f6fc00ce8f0 2024-04-25T09:09:27.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fbf400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6fc00cc8b0 0x7f6fc00acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:27.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fbf400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6fc00cc8b0 0x7f6fc00acc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42238/0 (socket says 172.21.15.173:42238) 2024-04-25T09:09:27.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.396+0000 7f6fbf400640 1 -- 172.21.15.173:0/881614790 learned_addr learned my addr 172.21.15.173:0/881614790 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:27.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.400+0000 7f6fb6a00640 1 --2- 172.21.15.173:0/881614790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc00ce8f0 0x7f6fc015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:27.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.400+0000 7f6fbfe00640 1 --2- 172.21.15.173:0/881614790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fc0145250 0x7f6fc00ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:27.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.400+0000 7f6fbf400640 1 -- 172.21.15.173:0/881614790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc00ce8f0 msgr2=0x7f6fc015a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:27.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.400+0000 7f6fbf400640 1 --2- 172.21.15.173:0/881614790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc00ce8f0 0x7f6fc015a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.400+0000 7f6fbf400640 1 -- 172.21.15.173:0/881614790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fc0145250 msgr2=0x7f6fc00ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:27.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.400+0000 7f6fbf400640 1 --2- 172.21.15.173:0/881614790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fc0145250 0x7f6fc00ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.400+0000 7f6fbf400640 1 -- 172.21.15.173:0/881614790 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc015d0f0 con 0x7f6fc00cc8b0 2024-04-25T09:09:27.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.400+0000 7f6fbfe00640 1 --2- 172.21.15.173:0/881614790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fc0145250 0x7f6fc00ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:27.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.400+0000 7f6fbf400640 1 --2- 172.21.15.173:0/881614790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6fc00cc8b0 0x7f6fc00acc00 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000c420 tx=0x7f6fb000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:27.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.400+0000 7f6fb7e00640 1 -- 172.21.15.173:0/881614790 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb00052d0 con 0x7f6fc00cc8b0 2024-04-25T09:09:27.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.400+0000 7f6fb7e00640 1 -- 172.21.15.173:0/881614790 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb0005470 con 0x7f6fc00cc8b0 2024-04-25T09:09:27.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.400+0000 7f6fc6600640 1 -- 172.21.15.173:0/881614790 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc00ad370 con 0x7f6fc00cc8b0 2024-04-25T09:09:27.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.400+0000 7f6fb7e00640 1 -- 172.21.15.173:0/881614790 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0007260 con 0x7f6fc00cc8b0 2024-04-25T09:09:27.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.400+0000 7f6fc6600640 1 -- 172.21.15.173:0/881614790 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc00ad930 con 0x7f6fc00cc8b0 2024-04-25T09:09:27.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.400+0000 7f6fc6600640 1 -- 172.21.15.173:0/881614790 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc0073a40 con 0x7f6fc00cc8b0 2024-04-25T09:09:27.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.400+0000 7f6fb7e00640 1 -- 172.21.15.173:0/881614790 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6fb0007400 con 0x7f6fc00cc8b0 2024-04-25T09:09:27.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.404+0000 7f6fb7e00640 1 --2- 172.21.15.173:0/881614790 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f9c066f60 0x7f6f9c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:27.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.404+0000 7f6fb7e00640 1 -- 172.21.15.173:0/881614790 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6fb0084640 con 0x7f6fc00cc8b0 2024-04-25T09:09:27.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.404+0000 7f6fb6a00640 1 --2- 172.21.15.173:0/881614790 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f9c066f60 0x7f6f9c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:27.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.404+0000 7f6fb6a00640 1 --2- 172.21.15.173:0/881614790 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f9c066f60 0x7f6f9c069420 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80af000 tx=0x7f6fa80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:27.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.408+0000 7f6fb7e00640 1 -- 172.21.15.173:0/881614790 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6fb0054e70 con 0x7f6fc00cc8b0 2024-04-25T09:09:27.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.564+0000 7f6fc6600640 1 -- 172.21.15.173:0/881614790 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fc006c300 con 0x7f6fc00cc8b0 2024-04-25T09:09:27.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.564+0000 7f6fb7e00640 1 -- 172.21.15.173:0/881614790 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+16958 (secure 0 0 0) 0x7f6fb0058f10 con 0x7f6fc00cc8b0 2024-04-25T09:09:27.552 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:27.552 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":96,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:09:26.256956+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:09:24.629351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T09:09:25.248841+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:27.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.564+0000 7f6fc6600640 1 -- 172.21.15.173:0/881614790 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f9c066f60 msgr2=0x7f6f9c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:27.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.564+0000 7f6fc6600640 1 --2- 172.21.15.173:0/881614790 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f9c066f60 0x7f6f9c069420 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80af000 tx=0x7f6fa80a7000 comp rx=0 tx=0).stop 2024-04-25T09:09:27.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.564+0000 7f6fc6600640 1 -- 172.21.15.173:0/881614790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6fc00cc8b0 msgr2=0x7f6fc00acc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:27.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.564+0000 7f6fc6600640 1 --2- 172.21.15.173:0/881614790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6fc00cc8b0 0x7f6fc00acc00 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000c420 tx=0x7f6fb000c8e0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.564+0000 7f6fc6600640 1 -- 172.21.15.173:0/881614790 shutdown_connections 2024-04-25T09:09:27.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.564+0000 7f6fc6600640 1 --2- 172.21.15.173:0/881614790 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6f9c066f60 0x7f6f9c069420 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.564+0000 7f6fc6600640 1 --2- 172.21.15.173:0/881614790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fc0145250 0x7f6fc00ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.564+0000 7f6fc6600640 1 --2- 172.21.15.173:0/881614790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc00ce8f0 0x7f6fc015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.564+0000 7f6fc6600640 1 --2- 172.21.15.173:0/881614790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6fc00cc8b0 0x7f6fc00acc00 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.564+0000 7f6fc6600640 1 -- 172.21.15.173:0/881614790 >> 172.21.15.173:0/881614790 conn(0x7f6fc006ac90 msgr2=0x7f6fc015c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:27.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.564+0000 7f6fc6600640 1 -- 172.21.15.173:0/881614790 shutdown_connections 2024-04-25T09:09:27.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.564+0000 7f6fc6600640 1 -- 172.21.15.173:0/881614790 wait complete. 2024-04-25T09:09:27.574 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:09:27.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.724+0000 7f94fc400640 1 Processor -- start 2024-04-25T09:09:27.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.724+0000 7f94fc400640 1 -- start start 2024-04-25T09:09:27.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.724+0000 7f94fc400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f94f40cf040 0x7f94f40cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:27.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.724+0000 7f94fc400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f94f40acd90 0x7f94f40ad220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:27.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.724+0000 7f94fc400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f40cda30 con 0x7f94f406bca0 2024-04-25T09:09:27.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.724+0000 7f94fc400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f40cead0 con 0x7f94f40acd90 2024-04-25T09:09:27.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.724+0000 7f94fc400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f40ce640 con 0x7f94f40cf040 2024-04-25T09:09:27.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.724+0000 7f94fa400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f94f40acd90 0x7f94f40ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:27.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.724+0000 7f94f9a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f94f406bca0 0x7f94f406c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60604/0 (socket says 172.21.15.173:60604) 2024-04-25T09:09:27.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.724+0000 7f94f9a00640 1 -- 172.21.15.173:0/1334908129 learned_addr learned my addr 172.21.15.173:0/1334908129 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:27.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.724+0000 7f94fa400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f94f40acd90 0x7f94f40ad220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42248/0 (socket says 172.21.15.173:42248) 2024-04-25T09:09:27.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.724+0000 7f94f9000640 1 --2- 172.21.15.173:0/1334908129 >> v2:172.21.15.194:3300/0 conn(0x7f94f40cf040 0x7f94f40cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:27.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.724+0000 7f94fa400640 1 -- 172.21.15.173:0/1334908129 >> v2:172.21.15.194:3300/0 conn(0x7f94f40cf040 msgr2=0x7f94f40cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:27.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.724+0000 7f94fa400640 1 --2- 172.21.15.173:0/1334908129 >> v2:172.21.15.194:3300/0 conn(0x7f94f40cf040 0x7f94f40cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.724+0000 7f94fa400640 1 -- 172.21.15.173:0/1334908129 >> v1:172.21.15.173:6789/0 conn(0x7f94f406bca0 legacy=0x7f94f406c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:27.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.724+0000 7f94fa400640 1 -- 172.21.15.173:0/1334908129 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f40cdd10 con 0x7f94f40acd90 2024-04-25T09:09:27.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.724+0000 7f94f3e00640 1 -- 172.21.15.173:0/1334908129 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693278038 0 0) 0x7f94f40cda30 con 0x7f94f406bca0 2024-04-25T09:09:27.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.728+0000 7f94fa400640 1 --2- 172.21.15.173:0/1334908129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f40acd90 0x7f94f40ad220 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f94ec009d90 tx=0x7f94ec01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf1a3ae249c0bb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:27.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.728+0000 7f94f3e00640 1 -- 172.21.15.173:0/1334908129 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec0b2070 con 0x7f94f40acd90 2024-04-25T09:09:27.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.728+0000 7f94f3e00640 1 -- 172.21.15.173:0/1334908129 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec0a5930 con 0x7f94f40acd90 2024-04-25T09:09:27.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.728+0000 7f94f3e00640 1 -- 172.21.15.173:0/1334908129 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec0a5d00 con 0x7f94f40acd90 2024-04-25T09:09:27.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.728+0000 7f94fc400640 1 -- 172.21.15.173:0/1334908129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f40acd90 msgr2=0x7f94f40ad220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:27.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.728+0000 7f94fc400640 1 --2- 172.21.15.173:0/1334908129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f40acd90 0x7f94f40ad220 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f94ec009d90 tx=0x7f94ec01c870 comp rx=0 tx=0).stop 2024-04-25T09:09:27.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.728+0000 7f94fc400640 1 -- 172.21.15.173:0/1334908129 shutdown_connections 2024-04-25T09:09:27.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.728+0000 7f94fc400640 1 --2- 172.21.15.173:0/1334908129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f40acd90 0x7f94f40ad220 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.728+0000 7f94fc400640 1 --2- 172.21.15.173:0/1334908129 >> v2:172.21.15.194:3300/0 conn(0x7f94f40cf040 0x7f94f40cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.728+0000 7f94fc400640 1 -- 172.21.15.173:0/1334908129 >> 172.21.15.173:0/1334908129 conn(0x7f94f4071ba0 msgr2=0x7f94f4071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:27.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.728+0000 7f94fc400640 1 -- 172.21.15.173:0/1334908129 shutdown_connections 2024-04-25T09:09:27.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.728+0000 7f94fc400640 1 -- 172.21.15.173:0/1334908129 wait complete. 2024-04-25T09:09:27.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94fc400640 1 Processor -- start 2024-04-25T09:09:27.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94fc400640 1 -- start start 2024-04-25T09:09:27.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94fc400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94f406bca0 0x7f94f41675c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:27.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94fc400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f40acd90 0x7f94f4149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:27.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94fc400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94f40cf040 0x7f94f40cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:27.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94fc400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f415ab90 con 0x7f94f40acd90 2024-04-25T09:09:27.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94fc400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f415aa10 con 0x7f94f406bca0 2024-04-25T09:09:27.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94fc400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f4165390 con 0x7f94f40cf040 2024-04-25T09:09:27.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94f9000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f40acd90 0x7f94f4149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:27.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94f9000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f40acd90 0x7f94f4149280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42262/0 (socket says 172.21.15.173:42262) 2024-04-25T09:09:27.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94f9000640 1 -- 172.21.15.173:0/3440602601 learned_addr learned my addr 172.21.15.173:0/3440602601 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:27.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94fa400640 1 --2- 172.21.15.173:0/3440602601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94f40cf040 0x7f94f40cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:27.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94f9a00640 1 --2- 172.21.15.173:0/3440602601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94f406bca0 0x7f94f41675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:27.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94f9000640 1 -- 172.21.15.173:0/3440602601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94f40cf040 msgr2=0x7f94f40cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:27.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94f9000640 1 --2- 172.21.15.173:0/3440602601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94f40cf040 0x7f94f40cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94f9000640 1 -- 172.21.15.173:0/3440602601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94f406bca0 msgr2=0x7f94f41675c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:27.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94f9000640 1 --2- 172.21.15.173:0/3440602601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94f406bca0 0x7f94f41675c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:27.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94f9000640 1 -- 172.21.15.173:0/3440602601 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f41497c0 con 0x7f94f40acd90 2024-04-25T09:09:27.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94f9a00640 1 --2- 172.21.15.173:0/3440602601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94f406bca0 0x7f94f41675c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:27.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94f9000640 1 --2- 172.21.15.173:0/3440602601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f40acd90 0x7f94f4149280 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f94e000d5f0 tx=0x7f94e000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:27.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94f1600640 1 -- 172.21.15.173:0/3440602601 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e00125f0 con 0x7f94f40acd90 2024-04-25T09:09:27.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94f1600640 1 -- 172.21.15.173:0/3440602601 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e0019070 con 0x7f94f40acd90 2024-04-25T09:09:27.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94fc400640 1 -- 172.21.15.173:0/3440602601 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f4165cf0 con 0x7f94f40acd90 2024-04-25T09:09:27.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94f1600640 1 -- 172.21.15.173:0/3440602601 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e00129d0 con 0x7f94f40acd90 2024-04-25T09:09:27.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94fc400640 1 -- 172.21.15.173:0/3440602601 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f41662b0 con 0x7f94f40acd90 2024-04-25T09:09:27.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.732+0000 7f94fc400640 1 -- 172.21.15.173:0/3440602601 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f4073ab0 con 0x7f94f40acd90 2024-04-25T09:09:27.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.736+0000 7f94f1600640 1 -- 172.21.15.173:0/3440602601 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f94e0012b70 con 0x7f94f40acd90 2024-04-25T09:09:27.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.736+0000 7f94f1600640 1 --2- 172.21.15.173:0/3440602601 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f94d4066f60 0x7f94d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:27.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.736+0000 7f94f1600640 1 -- 172.21.15.173:0/3440602601 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f94e0085620 con 0x7f94f40acd90 2024-04-25T09:09:27.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.736+0000 7f94f9a00640 1 --2- 172.21.15.173:0/3440602601 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f94d4066f60 0x7f94d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:27.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.736+0000 7f94f9a00640 1 --2- 172.21.15.173:0/3440602601 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f94d4066f60 0x7f94d4069420 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f94e8000f70 tx=0x7f94e8007c40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:27.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.740+0000 7f94f1600640 1 -- 172.21.15.173:0/3440602601 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f94e0056400 con 0x7f94f40acd90 2024-04-25T09:09:27.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:27.936+0000 7f94fc400640 1 -- 172.21.15.173:0/3440602601 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f94f4153aa0 con 0x7f94f40acd90 2024-04-25T09:09:28.846 INFO:tasks.ceph.mds.a.smithi173.stderr:2024-04-25T09:09:28.856+0000 7fd01e600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:09:28.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:28.904+0000 7f94f1600640 1 -- 172.21.15.173:0/3440602601 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v64) v1 ==== 118+0+0 (secure 0 0 0) 0x7f94e0055d00 con 0x7f94f40acd90 2024-04-25T09:09:28.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:28.904+0000 7f94fc400640 1 -- 172.21.15.173:0/3440602601 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f94d4066f60 msgr2=0x7f94d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:28.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:28.904+0000 7f94fc400640 1 --2- 172.21.15.173:0/3440602601 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f94d4066f60 0x7f94d4069420 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f94e8000f70 tx=0x7f94e8007c40 comp rx=0 tx=0).stop 2024-04-25T09:09:28.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:28.904+0000 7f94fc400640 1 -- 172.21.15.173:0/3440602601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f40acd90 msgr2=0x7f94f4149280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:28.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:28.904+0000 7f94fc400640 1 --2- 172.21.15.173:0/3440602601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f40acd90 0x7f94f4149280 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f94e000d5f0 tx=0x7f94e000dab0 comp rx=0 tx=0).stop 2024-04-25T09:09:28.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:28.904+0000 7f94fc400640 1 -- 172.21.15.173:0/3440602601 shutdown_connections 2024-04-25T09:09:28.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:28.904+0000 7f94fc400640 1 --2- 172.21.15.173:0/3440602601 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f94d4066f60 0x7f94d4069420 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:28.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:28.904+0000 7f94fc400640 1 --2- 172.21.15.173:0/3440602601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94f40cf040 0x7f94f40cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:28.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:28.904+0000 7f94fc400640 1 --2- 172.21.15.173:0/3440602601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f40acd90 0x7f94f4149280 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:28.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:28.904+0000 7f94fc400640 1 --2- 172.21.15.173:0/3440602601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94f406bca0 0x7f94f41675c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:28.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:28.904+0000 7f94fc400640 1 -- 172.21.15.173:0/3440602601 >> 172.21.15.173:0/3440602601 conn(0x7f94f4071ba0 msgr2=0x7f94f40b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:28.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:28.904+0000 7f94fc400640 1 -- 172.21.15.173:0/3440602601 shutdown_connections 2024-04-25T09:09:28.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:28.904+0000 7f94fc400640 1 -- 172.21.15.173:0/3440602601 wait complete. 2024-04-25T09:09:28.915 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:09:28.915 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:09:29.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.068+0000 7fa6dea00640 1 Processor -- start 2024-04-25T09:09:29.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.068+0000 7fa6dea00640 1 -- start start 2024-04-25T09:09:29.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.068+0000 7fa6dea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa6d80aeb90 0x7fa6d80cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:29.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.068+0000 7fa6dea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa6d80ce2b0 0x7fa6d80cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:29.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.068+0000 7fa6dea00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d8071570 con 0x7fa6d80aef70 2024-04-25T09:09:29.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.068+0000 7fa6dea00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d8071320 con 0x7fa6d80ce2b0 2024-04-25T09:09:29.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.068+0000 7fa6dea00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d8072330 con 0x7fa6d80aeb90 2024-04-25T09:09:29.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.068+0000 7fa6dca00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa6d80ce2b0 0x7fa6d80cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:29.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.068+0000 7fa6d7400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa6d80aef70 0x7fa6d80cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60612/0 (socket says 172.21.15.173:60612) 2024-04-25T09:09:29.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.068+0000 7fa6d7400640 1 -- 172.21.15.173:0/2261701465 learned_addr learned my addr 172.21.15.173:0/2261701465 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:29.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.068+0000 7fa6d7e00640 1 --2- 172.21.15.173:0/2261701465 >> v2:172.21.15.194:3300/0 conn(0x7fa6d80aeb90 0x7fa6d80cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:29.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.068+0000 7fa6dca00640 1 -- 172.21.15.173:0/2261701465 >> v2:172.21.15.194:3300/0 conn(0x7fa6d80aeb90 msgr2=0x7fa6d80cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:29.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.068+0000 7fa6dca00640 1 --2- 172.21.15.173:0/2261701465 >> v2:172.21.15.194:3300/0 conn(0x7fa6d80aeb90 0x7fa6d80cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:29.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.068+0000 7fa6dca00640 1 -- 172.21.15.173:0/2261701465 >> v1:172.21.15.173:6789/0 conn(0x7fa6d80aef70 legacy=0x7fa6d80cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:29.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.068+0000 7fa6d6a00640 1 -- 172.21.15.173:0/2261701465 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2238573098 0 0) 0x7fa6d8071570 con 0x7fa6d80aef70 2024-04-25T09:09:29.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.068+0000 7fa6dca00640 1 -- 172.21.15.173:0/2261701465 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d8071850 con 0x7fa6d80ce2b0 2024-04-25T09:09:29.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.072+0000 7fa6dca00640 1 --2- 172.21.15.173:0/2261701465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d80ce2b0 0x7fa6d80cc610 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80cd220 tx=0x7fa6d001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15fc5aec7d79a611 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:29.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.072+0000 7fa6d6a00640 1 -- 172.21.15.173:0/2261701465 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d00b2070 con 0x7fa6d80ce2b0 2024-04-25T09:09:29.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.072+0000 7fa6d6a00640 1 -- 172.21.15.173:0/2261701465 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d00a5830 con 0x7fa6d80ce2b0 2024-04-25T09:09:29.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.072+0000 7fa6d6a00640 1 -- 172.21.15.173:0/2261701465 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d00a5c00 con 0x7fa6d80ce2b0 2024-04-25T09:09:29.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.072+0000 7fa6dea00640 1 -- 172.21.15.173:0/2261701465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d80ce2b0 msgr2=0x7fa6d80cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:29.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.072+0000 7fa6dea00640 1 --2- 172.21.15.173:0/2261701465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d80ce2b0 0x7fa6d80cc610 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80cd220 tx=0x7fa6d001c870 comp rx=0 tx=0).stop 2024-04-25T09:09:29.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.072+0000 7fa6dea00640 1 -- 172.21.15.173:0/2261701465 shutdown_connections 2024-04-25T09:09:29.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.072+0000 7fa6dea00640 1 --2- 172.21.15.173:0/2261701465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d80ce2b0 0x7fa6d80cc610 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:29.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.072+0000 7fa6dea00640 1 --2- 172.21.15.173:0/2261701465 >> v2:172.21.15.194:3300/0 conn(0x7fa6d80aeb90 0x7fa6d80cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:29.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.072+0000 7fa6dea00640 1 -- 172.21.15.173:0/2261701465 >> 172.21.15.173:0/2261701465 conn(0x7fa6d806ac90 msgr2=0x7fa6d806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:29.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.072+0000 7fa6dea00640 1 -- 172.21.15.173:0/2261701465 shutdown_connections 2024-04-25T09:09:29.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.072+0000 7fa6dea00640 1 -- 172.21.15.173:0/2261701465 wait complete. 2024-04-25T09:09:29.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.072+0000 7fa6dea00640 1 Processor -- start 2024-04-25T09:09:29.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.072+0000 7fa6dea00640 1 -- start start 2024-04-25T09:09:29.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6dea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6d80aeb90 0x7fa6d8159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:29.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6dea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d80aef70 0x7fa6d81555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:29.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6dea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d80ce2b0 0x7fa6d80af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:29.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6dea00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d815bb30 con 0x7fa6d80aef70 2024-04-25T09:09:29.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6dea00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d815b9b0 con 0x7fa6d80ce2b0 2024-04-25T09:09:29.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6dea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d815bcb0 con 0x7fa6d80aeb90 2024-04-25T09:09:29.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6d7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d80aef70 0x7fa6d81555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:29.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6d7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d80aef70 0x7fa6d81555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42286/0 (socket says 172.21.15.173:42286) 2024-04-25T09:09:29.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6d7400640 1 -- 172.21.15.173:0/1795777008 learned_addr learned my addr 172.21.15.173:0/1795777008 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:29.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6d7e00640 1 --2- 172.21.15.173:0/1795777008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6d80aeb90 0x7fa6d8159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:29.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6dca00640 1 --2- 172.21.15.173:0/1795777008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d80ce2b0 0x7fa6d80af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:29.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6d7400640 1 -- 172.21.15.173:0/1795777008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6d80aeb90 msgr2=0x7fa6d8159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:29.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6d7400640 1 --2- 172.21.15.173:0/1795777008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6d80aeb90 0x7fa6d8159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:29.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6d7400640 1 -- 172.21.15.173:0/1795777008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d80ce2b0 msgr2=0x7fa6d80af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:29.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6d7400640 1 --2- 172.21.15.173:0/1795777008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d80ce2b0 0x7fa6d80af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:29.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6d7400640 1 -- 172.21.15.173:0/1795777008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d80afb40 con 0x7fa6d80aef70 2024-04-25T09:09:29.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6d7400640 1 --2- 172.21.15.173:0/1795777008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d80aef70 0x7fa6d81555f0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40011f0 tx=0x7fa6c400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:29.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6cfe00640 1 -- 172.21.15.173:0/1795777008 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4018070 con 0x7fa6d80aef70 2024-04-25T09:09:29.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6cfe00640 1 -- 172.21.15.173:0/1795777008 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c40074e0 con 0x7fa6d80aef70 2024-04-25T09:09:29.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6cfe00640 1 -- 172.21.15.173:0/1795777008 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4004a10 con 0x7fa6d80aef70 2024-04-25T09:09:29.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6dea00640 1 -- 172.21.15.173:0/1795777008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d80afe20 con 0x7fa6d80aef70 2024-04-25T09:09:29.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6dea00640 1 -- 172.21.15.173:0/1795777008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d81f5a50 con 0x7fa6d80aef70 2024-04-25T09:09:29.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.076+0000 7fa6dea00640 1 -- 172.21.15.173:0/1795777008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d8073ab0 con 0x7fa6d80aef70 2024-04-25T09:09:29.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.080+0000 7fa6cfe00640 1 -- 172.21.15.173:0/1795777008 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa6c4004bb0 con 0x7fa6d80aef70 2024-04-25T09:09:29.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.080+0000 7fa6cfe00640 1 --2- 172.21.15.173:0/1795777008 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa6b8066f60 0x7fa6b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:29.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.080+0000 7fa6cfe00640 1 -- 172.21.15.173:0/1795777008 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa6c40844f0 con 0x7fa6d80aef70 2024-04-25T09:09:29.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.080+0000 7fa6d7e00640 1 --2- 172.21.15.173:0/1795777008 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa6b8066f60 0x7fa6b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:29.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.080+0000 7fa6d7e00640 1 --2- 172.21.15.173:0/1795777008 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa6b8066f60 0x7fa6b8069420 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80079c0 tx=0x7fa6c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:29.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.084+0000 7fa6cfe00640 1 -- 172.21.15.173:0/1795777008 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa6c4054c80 con 0x7fa6d80aef70 2024-04-25T09:09:29.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.272+0000 7fa6dea00640 1 -- 172.21.15.173:0/1795777008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa6d815a770 con 0x7fa6d80aef70 2024-04-25T09:09:29.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.908+0000 7fa6cfe00640 1 -- 172.21.15.173:0/1795777008 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v65) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa6c4058d20 con 0x7fa6d80aef70 2024-04-25T09:09:29.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.912+0000 7fa6dea00640 1 -- 172.21.15.173:0/1795777008 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa6b8066f60 msgr2=0x7fa6b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:29.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.912+0000 7fa6dea00640 1 --2- 172.21.15.173:0/1795777008 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa6b8066f60 0x7fa6b8069420 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80079c0 tx=0x7fa6c8008040 comp rx=0 tx=0).stop 2024-04-25T09:09:29.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.912+0000 7fa6dea00640 1 -- 172.21.15.173:0/1795777008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d80aef70 msgr2=0x7fa6d81555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:29.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.912+0000 7fa6dea00640 1 --2- 172.21.15.173:0/1795777008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d80aef70 0x7fa6d81555f0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40011f0 tx=0x7fa6c400c9b0 comp rx=0 tx=0).stop 2024-04-25T09:09:29.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.912+0000 7fa6dea00640 1 -- 172.21.15.173:0/1795777008 shutdown_connections 2024-04-25T09:09:29.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.912+0000 7fa6dea00640 1 --2- 172.21.15.173:0/1795777008 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa6b8066f60 0x7fa6b8069420 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:29.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.912+0000 7fa6dea00640 1 --2- 172.21.15.173:0/1795777008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d80ce2b0 0x7fa6d80af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:29.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.912+0000 7fa6dea00640 1 --2- 172.21.15.173:0/1795777008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d80aef70 0x7fa6d81555f0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:29.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.912+0000 7fa6dea00640 1 --2- 172.21.15.173:0/1795777008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6d80aeb90 0x7fa6d8159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:29.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.912+0000 7fa6dea00640 1 -- 172.21.15.173:0/1795777008 >> 172.21.15.173:0/1795777008 conn(0x7fa6d806ac90 msgr2=0x7fa6d8151280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:29.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.912+0000 7fa6dea00640 1 -- 172.21.15.173:0/1795777008 shutdown_connections 2024-04-25T09:09:29.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:29.912+0000 7fa6dea00640 1 -- 172.21.15.173:0/1795777008 wait complete. 2024-04-25T09:09:29.919 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:09:29.920 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:30.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.068+0000 7f7b95000640 1 Processor -- start 2024-04-25T09:09:30.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.068+0000 7f7b95000640 1 -- start start 2024-04-25T09:09:30.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.068+0000 7f7b95000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b900b2c80 0x7f7b9006e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:30.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.068+0000 7f7b95000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7b9006e750 0x7f7b900711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:30.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.068+0000 7f7b95000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9015ac90 con 0x7f7b900cef40 2024-04-25T09:09:30.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.068+0000 7f7b95000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9015b8a0 con 0x7f7b9006e750 2024-04-25T09:09:30.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.068+0000 7f7b95000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9015af70 con 0x7f7b900b2c80 2024-04-25T09:09:30.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.068+0000 7f7b8fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7b9006e750 0x7f7b900711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:30.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.068+0000 7f7b8fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7b9006e750 0x7f7b900711e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42288/0 (socket says 172.21.15.173:42288) 2024-04-25T09:09:30.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.068+0000 7f7b8fe00640 1 -- 172.21.15.173:0/3276921491 learned_addr learned my addr 172.21.15.173:0/3276921491 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:30.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.072+0000 7f7b8fe00640 1 -- 172.21.15.173:0/3276921491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b900b2c80 msgr2=0x7f7b9006e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:30.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.072+0000 7f7b8ea00640 1 --2- 172.21.15.173:0/3276921491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b900b2c80 0x7f7b9006e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:30.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.072+0000 7f7b8fe00640 1 --2- 172.21.15.173:0/3276921491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b900b2c80 0x7f7b9006e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.072+0000 7f7b8fe00640 1 -- 172.21.15.173:0/3276921491 >> v1:172.21.15.194:6789/0 conn(0x7f7b900cef40 legacy=0x7f7b900cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.072+0000 7f7b8fe00640 1 -- 172.21.15.173:0/3276921491 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9015b250 con 0x7f7b9006e750 2024-04-25T09:09:30.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.072+0000 7f7b8ea00640 1 --2- 172.21.15.173:0/3276921491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b900b2c80 0x7f7b9006e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:30.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.072+0000 7f7b8fe00640 1 --2- 172.21.15.173:0/3276921491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9006e750 0x7f7b900711e0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f7b8800bb10 tx=0x7f7b8801f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d078a7b401e106 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:30.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.072+0000 7f7b8e000640 1 -- 172.21.15.173:0/3276921491 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b880b4070 con 0x7f7b9006e750 2024-04-25T09:09:30.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.072+0000 7f7b8e000640 1 -- 172.21.15.173:0/3276921491 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b880a7c10 con 0x7f7b9006e750 2024-04-25T09:09:30.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.072+0000 7f7b8e000640 1 -- 172.21.15.173:0/3276921491 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b880af440 con 0x7f7b9006e750 2024-04-25T09:09:30.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.072+0000 7f7b95000640 1 -- 172.21.15.173:0/3276921491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9006e750 msgr2=0x7f7b900711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.072+0000 7f7b95000640 1 --2- 172.21.15.173:0/3276921491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9006e750 0x7f7b900711e0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f7b8800bb10 tx=0x7f7b8801f690 comp rx=0 tx=0).stop 2024-04-25T09:09:30.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.072+0000 7f7b95000640 1 -- 172.21.15.173:0/3276921491 shutdown_connections 2024-04-25T09:09:30.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.072+0000 7f7b95000640 1 --2- 172.21.15.173:0/3276921491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b900b2c80 0x7f7b9006e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.072+0000 7f7b95000640 1 --2- 172.21.15.173:0/3276921491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9006e750 0x7f7b900711e0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.072+0000 7f7b95000640 1 -- 172.21.15.173:0/3276921491 >> 172.21.15.173:0/3276921491 conn(0x7f7b9006ac90 msgr2=0x7f7b9006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:30.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b95000640 1 -- 172.21.15.173:0/3276921491 shutdown_connections 2024-04-25T09:09:30.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b95000640 1 -- 172.21.15.173:0/3276921491 wait complete. 2024-04-25T09:09:30.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b95000640 1 Processor -- start 2024-04-25T09:09:30.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b95000640 1 -- start start 2024-04-25T09:09:30.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b95000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b9006e750 0x7f7b90151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:30.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b95000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b900b2c80 0x7f7b90142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:30.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b95000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b900cef40 0x7f7b9015e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:30.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b95000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9006d280 con 0x7f7b900b2c80 2024-04-25T09:09:30.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b95000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9006d100 con 0x7f7b900cef40 2024-04-25T09:09:30.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b95000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9006d400 con 0x7f7b9006e750 2024-04-25T09:09:30.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b8ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b900b2c80 0x7f7b90142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:30.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b8ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b900b2c80 0x7f7b90142b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42298/0 (socket says 172.21.15.173:42298) 2024-04-25T09:09:30.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b8ea00640 1 -- 172.21.15.173:0/3753946827 learned_addr learned my addr 172.21.15.173:0/3753946827 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:30.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b8f400640 1 --2- 172.21.15.173:0/3753946827 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b9006e750 0x7f7b90151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:30.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b8fe00640 1 --2- 172.21.15.173:0/3753946827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b900cef40 0x7f7b9015e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:30.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b8ea00640 1 -- 172.21.15.173:0/3753946827 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b9006e750 msgr2=0x7f7b90151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b8ea00640 1 --2- 172.21.15.173:0/3753946827 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b9006e750 0x7f7b90151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b8ea00640 1 -- 172.21.15.173:0/3753946827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b900cef40 msgr2=0x7f7b9015e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b8ea00640 1 --2- 172.21.15.173:0/3753946827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b900cef40 0x7f7b9015e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b8ea00640 1 -- 172.21.15.173:0/3753946827 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b90151ff0 con 0x7f7b900b2c80 2024-04-25T09:09:30.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.076+0000 7f7b8ea00640 1 --2- 172.21.15.173:0/3753946827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b900b2c80 0x7f7b90142b10 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00c7f0 tx=0x7f7b7c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:30.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.080+0000 7f7b87400640 1 -- 172.21.15.173:0/3753946827 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c015070 con 0x7f7b900b2c80 2024-04-25T09:09:30.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.080+0000 7f7b87400640 1 -- 172.21.15.173:0/3753946827 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7c007a30 con 0x7f7b900b2c80 2024-04-25T09:09:30.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.080+0000 7f7b87400640 1 -- 172.21.15.173:0/3753946827 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c007e00 con 0x7f7b900b2c80 2024-04-25T09:09:30.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.080+0000 7f7b95000640 1 -- 172.21.15.173:0/3753946827 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b901522d0 con 0x7f7b900b2c80 2024-04-25T09:09:30.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.080+0000 7f7b95000640 1 -- 172.21.15.173:0/3753946827 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b90152890 con 0x7f7b900b2c80 2024-04-25T09:09:30.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.080+0000 7f7b95000640 1 -- 172.21.15.173:0/3753946827 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b90073a40 con 0x7f7b900b2c80 2024-04-25T09:09:30.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.080+0000 7f7b87400640 1 -- 172.21.15.173:0/3753946827 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7b7c018070 con 0x7f7b900b2c80 2024-04-25T09:09:30.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.080+0000 7f7b87400640 1 --2- 172.21.15.173:0/3753946827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7b70066f60 0x7f7b70069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:30.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.080+0000 7f7b87400640 1 -- 172.21.15.173:0/3753946827 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7b7c085120 con 0x7f7b900b2c80 2024-04-25T09:09:30.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.080+0000 7f7b8f400640 1 --2- 172.21.15.173:0/3753946827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7b70066f60 0x7f7b70069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:30.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.084+0000 7f7b8f400640 1 --2- 172.21.15.173:0/3753946827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7b70066f60 0x7f7b70069420 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7b80001e00 tx=0x7f7b80009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:30.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.084+0000 7f7b87400640 1 -- 172.21.15.173:0/3753946827 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7b7c0558b0 con 0x7f7b900b2c80 2024-04-25T09:09:30.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.268+0000 7f7b95000640 1 -- 172.21.15.173:0/3753946827 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b900b27a0 con 0x7f7b900b2c80 2024-04-25T09:09:30.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.272+0000 7f7b87400640 1 -- 172.21.15.173:0/3753946827 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f7b7c059950 con 0x7f7b900b2c80 2024-04-25T09:09:30.259 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:30.259 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/556010437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":556010437},{"type":"v1","addr":"172.21.15.173:6835","nonce":556010437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":6524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4077641924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4077641924},{"type":"v1","addr":"172.21.15.194:6834","nonce":4077641924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7162,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2938501478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2938501478},{"type":"v1","addr":"172.21.15.194:6835","nonce":2938501478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:09:26.257282+0000","modified":"2024-04-25T09:09:29.275838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/555490935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":555490935},{"type":"v1","addr":"172.21.15.173:6837","nonce":555490935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:09:30.259 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 65 2024-04-25T09:09:30.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.272+0000 7f7b95000640 1 -- 172.21.15.173:0/3753946827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7b70066f60 msgr2=0x7f7b70069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.272+0000 7f7b95000640 1 --2- 172.21.15.173:0/3753946827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7b70066f60 0x7f7b70069420 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7b80001e00 tx=0x7f7b80009040 comp rx=0 tx=0).stop 2024-04-25T09:09:30.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.272+0000 7f7b95000640 1 -- 172.21.15.173:0/3753946827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b900b2c80 msgr2=0x7f7b90142b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.272+0000 7f7b95000640 1 --2- 172.21.15.173:0/3753946827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b900b2c80 0x7f7b90142b10 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00c7f0 tx=0x7f7b7c00ccb0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.272+0000 7f7b95000640 1 -- 172.21.15.173:0/3753946827 shutdown_connections 2024-04-25T09:09:30.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.272+0000 7f7b95000640 1 --2- 172.21.15.173:0/3753946827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7b70066f60 0x7f7b70069420 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.272+0000 7f7b95000640 1 --2- 172.21.15.173:0/3753946827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b900cef40 0x7f7b9015e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.272+0000 7f7b95000640 1 --2- 172.21.15.173:0/3753946827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b900b2c80 0x7f7b90142b10 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.272+0000 7f7b95000640 1 --2- 172.21.15.173:0/3753946827 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b9006e750 0x7f7b90151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.272+0000 7f7b95000640 1 -- 172.21.15.173:0/3753946827 >> 172.21.15.173:0/3753946827 conn(0x7f7b9006ac90 msgr2=0x7f7b90158780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:30.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.272+0000 7f7b95000640 1 -- 172.21.15.173:0/3753946827 shutdown_connections 2024-04-25T09:09:30.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.272+0000 7f7b95000640 1 -- 172.21.15.173:0/3753946827 wait complete. 2024-04-25T09:09:30.279 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:30.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.424+0000 7f6a10800640 1 Processor -- start 2024-04-25T09:09:30.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.424+0000 7f6a10800640 1 -- start start 2024-04-25T09:09:30.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.428+0000 7f6a10800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6a08145250 0x7f6a0815c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:30.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.428+0000 7f6a10800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6a080cc8b0 0x7f6a080ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:30.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.428+0000 7f6a10800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a0815cec0 con 0x7f6a08071320 2024-04-25T09:09:30.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.428+0000 7f6a10800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0806e7c0 con 0x7f6a08145250 2024-04-25T09:09:30.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.428+0000 7f6a10800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0806d720 con 0x7f6a080cc8b0 2024-04-25T09:09:30.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.428+0000 7f6a0de00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6a08145250 0x7f6a0815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:30.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.428+0000 7f6a0de00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6a08145250 0x7f6a0815c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42308/0 (socket says 172.21.15.173:42308) 2024-04-25T09:09:30.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.428+0000 7f6a0de00640 1 -- 172.21.15.173:0/4244224749 learned_addr learned my addr 172.21.15.173:0/4244224749 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:30.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.428+0000 7f6a0d400640 1 --2- 172.21.15.173:0/4244224749 >> v2:172.21.15.194:3300/0 conn(0x7f6a080cc8b0 0x7f6a080ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:30.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.428+0000 7f6a0de00640 1 -- 172.21.15.173:0/4244224749 >> v2:172.21.15.194:3300/0 conn(0x7f6a080cc8b0 msgr2=0x7f6a080ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:30.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.428+0000 7f6a0de00640 1 --2- 172.21.15.173:0/4244224749 >> v2:172.21.15.194:3300/0 conn(0x7f6a080cc8b0 0x7f6a080ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.428+0000 7f6a0de00640 1 -- 172.21.15.173:0/4244224749 >> v1:172.21.15.194:6789/0 conn(0x7f6a08071320 legacy=0x7f6a08071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.428+0000 7f6a0de00640 1 -- 172.21.15.173:0/4244224749 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0806da00 con 0x7f6a08145250 2024-04-25T09:09:30.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.428+0000 7f6a0d400640 1 --2- 172.21.15.173:0/4244224749 >> v2:172.21.15.194:3300/0 conn(0x7f6a080cc8b0 0x7f6a080ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:30.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a0de00640 1 --2- 172.21.15.173:0/4244224749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a08145250 0x7f6a0815c980 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f6a08062640 tx=0x7f69fc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c291c902d829eff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:30.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a0ca00640 1 -- 172.21.15.173:0/4244224749 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc0ab610 con 0x7f6a08145250 2024-04-25T09:09:30.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a0ca00640 1 -- 172.21.15.173:0/4244224749 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc0b0070 con 0x7f6a08145250 2024-04-25T09:09:30.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a0ca00640 1 -- 172.21.15.173:0/4244224749 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc0ab9d0 con 0x7f6a08145250 2024-04-25T09:09:30.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a10800640 1 -- 172.21.15.173:0/4244224749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a08145250 msgr2=0x7f6a0815c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a10800640 1 --2- 172.21.15.173:0/4244224749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a08145250 0x7f6a0815c980 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f6a08062640 tx=0x7f69fc01c520 comp rx=0 tx=0).stop 2024-04-25T09:09:30.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a10800640 1 -- 172.21.15.173:0/4244224749 shutdown_connections 2024-04-25T09:09:30.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a10800640 1 --2- 172.21.15.173:0/4244224749 >> v2:172.21.15.194:3300/0 conn(0x7f6a080cc8b0 0x7f6a080ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a10800640 1 --2- 172.21.15.173:0/4244224749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a08145250 0x7f6a0815c980 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a10800640 1 -- 172.21.15.173:0/4244224749 >> 172.21.15.173:0/4244224749 conn(0x7f6a0806ac90 msgr2=0x7f6a0806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:30.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a10800640 1 -- 172.21.15.173:0/4244224749 shutdown_connections 2024-04-25T09:09:30.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a10800640 1 -- 172.21.15.173:0/4244224749 wait complete. 2024-04-25T09:09:30.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a10800640 1 Processor -- start 2024-04-25T09:09:30.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a10800640 1 -- start start 2024-04-25T09:09:30.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a10800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a08071320 0x7f6a080c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:30.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a10800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a080cc8b0 0x7f6a080adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:30.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a10800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a08145250 0x7f6a080c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:30.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a10800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0806ef80 con 0x7f6a08145250 2024-04-25T09:09:30.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a10800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a08145630 con 0x7f6a08071320 2024-04-25T09:09:30.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a10800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0806d380 con 0x7f6a080cc8b0 2024-04-25T09:09:30.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a0e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a08145250 0x7f6a080c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:30.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.432+0000 7f6a0e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a08145250 0x7f6a080c62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42314/0 (socket says 172.21.15.173:42314) 2024-04-25T09:09:30.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.436+0000 7f6a0de00640 1 --2- 172.21.15.173:0/1914345202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a08071320 0x7f6a080c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:30.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.436+0000 7f6a0e800640 1 -- 172.21.15.173:0/1914345202 learned_addr learned my addr 172.21.15.173:0/1914345202 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:30.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.436+0000 7f6a0d400640 1 --2- 172.21.15.173:0/1914345202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a080cc8b0 0x7f6a080adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:30.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.436+0000 7f6a0de00640 1 -- 172.21.15.173:0/1914345202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a080cc8b0 msgr2=0x7f6a080adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.436+0000 7f6a0de00640 1 --2- 172.21.15.173:0/1914345202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a080cc8b0 0x7f6a080adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.436+0000 7f6a0de00640 1 -- 172.21.15.173:0/1914345202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a08145250 msgr2=0x7f6a080c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.436+0000 7f6a0de00640 1 --2- 172.21.15.173:0/1914345202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a08145250 0x7f6a080c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.436+0000 7f6a0de00640 1 -- 172.21.15.173:0/1914345202 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a080c5b80 con 0x7f6a08071320 2024-04-25T09:09:30.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.436+0000 7f6a0e800640 1 --2- 172.21.15.173:0/1914345202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a08145250 0x7f6a080c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:30.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.436+0000 7f6a0de00640 1 --2- 172.21.15.173:0/1914345202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a08071320 0x7f6a080c5640 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0ac000 tx=0x7f69fc01ad60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:30.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.436+0000 7f6a02000640 1 -- 172.21.15.173:0/1914345202 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc0be5f0 con 0x7f6a08071320 2024-04-25T09:09:30.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.436+0000 7f6a10800640 1 -- 172.21.15.173:0/1914345202 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a080c4880 con 0x7f6a08071320 2024-04-25T09:09:30.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.436+0000 7f6a02000640 1 -- 172.21.15.173:0/1914345202 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc0be7b0 con 0x7f6a08071320 2024-04-25T09:09:30.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.436+0000 7f6a02000640 1 -- 172.21.15.173:0/1914345202 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc0beba0 con 0x7f6a08071320 2024-04-25T09:09:30.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.436+0000 7f6a10800640 1 -- 172.21.15.173:0/1914345202 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a080c4e40 con 0x7f6a08071320 2024-04-25T09:09:30.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.436+0000 7f6a10800640 1 -- 172.21.15.173:0/1914345202 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a08073a40 con 0x7f6a08071320 2024-04-25T09:09:30.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.436+0000 7f6a02000640 1 -- 172.21.15.173:0/1914345202 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f69fc0b43f0 con 0x7f6a08071320 2024-04-25T09:09:30.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.436+0000 7f6a02000640 1 --2- 172.21.15.173:0/1914345202 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f69ec066f60 0x7f69ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:30.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.440+0000 7f6a02000640 1 -- 172.21.15.173:0/1914345202 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f69fc11f9b0 con 0x7f6a08071320 2024-04-25T09:09:30.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.440+0000 7f6a0d400640 1 --2- 172.21.15.173:0/1914345202 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f69ec066f60 0x7f69ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:30.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.440+0000 7f6a0d400640 1 --2- 172.21.15.173:0/1914345202 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f69ec066f60 0x7f69ec069420 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6a081f9c60 tx=0x7f69f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:30.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.444+0000 7f6a02000640 1 -- 172.21.15.173:0/1914345202 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f69fc0a8050 con 0x7f6a08071320 2024-04-25T09:09:30.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.600+0000 7f6a10800640 1 -- 172.21.15.173:0/1914345202 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a081417a0 con 0x7f6a08071320 2024-04-25T09:09:30.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.600+0000 7f6a02000640 1 -- 172.21.15.173:0/1914345202 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16945 (secure 0 0 0) 0x7f69fc016110 con 0x7f6a08071320 2024-04-25T09:09:30.589 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:30.589 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":97,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:09:27.873210+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:09:24.629351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T09:09:25.248841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:30.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.600+0000 7f6a10800640 1 -- 172.21.15.173:0/1914345202 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f69ec066f60 msgr2=0x7f69ec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.600+0000 7f6a10800640 1 --2- 172.21.15.173:0/1914345202 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f69ec066f60 0x7f69ec069420 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6a081f9c60 tx=0x7f69f8008040 comp rx=0 tx=0).stop 2024-04-25T09:09:30.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.600+0000 7f6a10800640 1 -- 172.21.15.173:0/1914345202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a08071320 msgr2=0x7f6a080c5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.600+0000 7f6a10800640 1 --2- 172.21.15.173:0/1914345202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a08071320 0x7f6a080c5640 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0ac000 tx=0x7f69fc01ad60 comp rx=0 tx=0).stop 2024-04-25T09:09:30.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.600+0000 7f6a10800640 1 -- 172.21.15.173:0/1914345202 shutdown_connections 2024-04-25T09:09:30.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.600+0000 7f6a10800640 1 --2- 172.21.15.173:0/1914345202 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f69ec066f60 0x7f69ec069420 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.600+0000 7f6a10800640 1 --2- 172.21.15.173:0/1914345202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a08145250 0x7f6a080c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.600+0000 7f6a10800640 1 --2- 172.21.15.173:0/1914345202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a080cc8b0 0x7f6a080adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.600+0000 7f6a10800640 1 --2- 172.21.15.173:0/1914345202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a08071320 0x7f6a080c5640 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.600+0000 7f6a10800640 1 -- 172.21.15.173:0/1914345202 >> 172.21.15.173:0/1914345202 conn(0x7f6a0806ac90 msgr2=0x7f6a080aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:30.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.604+0000 7f6a10800640 1 -- 172.21.15.173:0/1914345202 shutdown_connections 2024-04-25T09:09:30.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.604+0000 7f6a10800640 1 -- 172.21.15.173:0/1914345202 wait complete. 2024-04-25T09:09:30.610 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:09:30.610 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:09:30.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.760+0000 7f88f0a00640 1 Processor -- start 2024-04-25T09:09:30.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.760+0000 7f88f0a00640 1 -- start start 2024-04-25T09:09:30.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.760+0000 7f88f0a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f88ec0cc8b0 0x7f88ec0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:30.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.760+0000 7f88f0a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ec06e7c0 con 0x7f88ec145250 2024-04-25T09:09:30.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.760+0000 7f88f0a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ec06d720 con 0x7f88ec0ce8f0 2024-04-25T09:09:30.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.760+0000 7f88f0a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ec06da00 con 0x7f88ec0cc8b0 2024-04-25T09:09:30.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.760+0000 7f88e9400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f88ec0cc8b0 0x7f88ec0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:30.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.760+0000 7f88e9e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f88ec145250 0x7f88ec15c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60620/0 (socket says 172.21.15.173:60620) 2024-04-25T09:09:30.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.760+0000 7f88e9400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f88ec0cc8b0 0x7f88ec0ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42330/0 (socket says 172.21.15.173:42330) 2024-04-25T09:09:30.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.760+0000 7f88e9e00640 1 -- 172.21.15.173:0/2895314756 learned_addr learned my addr 172.21.15.173:0/2895314756 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:30.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.760+0000 7f88e9400640 1 -- 172.21.15.173:0/2895314756 >> v1:172.21.15.194:6789/0 conn(0x7f88ec0ce8f0 legacy=0x7f88ec0ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.760+0000 7f88e9400640 1 -- 172.21.15.173:0/2895314756 >> v1:172.21.15.173:6789/0 conn(0x7f88ec145250 legacy=0x7f88ec15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.760+0000 7f88e9400640 1 -- 172.21.15.173:0/2895314756 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec06dce0 con 0x7f88ec0cc8b0 2024-04-25T09:09:30.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.764+0000 7f88e9400640 1 --2- 172.21.15.173:0/2895314756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88ec0cc8b0 0x7f88ec0ccd30 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0097c0 tx=0x7f88dc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ebf28409506ced server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:30.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.764+0000 7f88e8a00640 1 -- 172.21.15.173:0/2895314756 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0b1070 con 0x7f88ec0cc8b0 2024-04-25T09:09:30.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.764+0000 7f88e8a00640 1 -- 172.21.15.173:0/2895314756 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc0ac5f0 con 0x7f88ec0cc8b0 2024-04-25T09:09:30.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.764+0000 7f88e8a00640 1 -- 172.21.15.173:0/2895314756 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0ac9c0 con 0x7f88ec0cc8b0 2024-04-25T09:09:30.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.764+0000 7f88f0a00640 1 -- 172.21.15.173:0/2895314756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88ec0cc8b0 msgr2=0x7f88ec0ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.764+0000 7f88f0a00640 1 --2- 172.21.15.173:0/2895314756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88ec0cc8b0 0x7f88ec0ccd30 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0097c0 tx=0x7f88dc01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.764+0000 7f88f0a00640 1 -- 172.21.15.173:0/2895314756 shutdown_connections 2024-04-25T09:09:30.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.764+0000 7f88f0a00640 1 --2- 172.21.15.173:0/2895314756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88ec0cc8b0 0x7f88ec0ccd30 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.764+0000 7f88f0a00640 1 -- 172.21.15.173:0/2895314756 >> 172.21.15.173:0/2895314756 conn(0x7f88ec06ac90 msgr2=0x7f88ec06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:30.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.764+0000 7f88f0a00640 1 -- 172.21.15.173:0/2895314756 shutdown_connections 2024-04-25T09:09:30.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.764+0000 7f88f0a00640 1 -- 172.21.15.173:0/2895314756 wait complete. 2024-04-25T09:09:30.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88f0a00640 1 Processor -- start 2024-04-25T09:09:30.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88f0a00640 1 -- start start 2024-04-25T09:09:30.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88f0a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88ec0cc8b0 0x7f88ec159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:30.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88f0a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88ec0ce8f0 0x7f88ec144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:30.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88f0a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88ec145250 0x7f88ec1445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88f0a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec06d380 con 0x7f88ec145250 2024-04-25T09:09:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88f0a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec06ef80 con 0x7f88ec0cc8b0 2024-04-25T09:09:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88f0a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec06d500 con 0x7f88ec0ce8f0 2024-04-25T09:09:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88ea800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88ec145250 0x7f88ec1445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88ea800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88ec145250 0x7f88ec1445d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42346/0 (socket says 172.21.15.173:42346) 2024-04-25T09:09:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88ea800640 1 -- 172.21.15.173:0/3716587464 learned_addr learned my addr 172.21.15.173:0/3716587464 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88e9e00640 1 --2- 172.21.15.173:0/3716587464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88ec0cc8b0 0x7f88ec159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88e9400640 1 --2- 172.21.15.173:0/3716587464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88ec0ce8f0 0x7f88ec144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88ea800640 1 -- 172.21.15.173:0/3716587464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88ec0ce8f0 msgr2=0x7f88ec144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88ea800640 1 --2- 172.21.15.173:0/3716587464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88ec0ce8f0 0x7f88ec144090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88ea800640 1 -- 172.21.15.173:0/3716587464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88ec0cc8b0 msgr2=0x7f88ec159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88ea800640 1 --2- 172.21.15.173:0/3716587464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88ec0cc8b0 0x7f88ec159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88ea800640 1 -- 172.21.15.173:0/3716587464 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec15a670 con 0x7f88ec145250 2024-04-25T09:09:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88e9e00640 1 --2- 172.21.15.173:0/3716587464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88ec0cc8b0 0x7f88ec159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88ea800640 1 --2- 172.21.15.173:0/3716587464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88ec145250 0x7f88ec1445d0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f88e400c7a0 tx=0x7f88e400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:30.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88e2000640 1 -- 172.21.15.173:0/3716587464 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4003b80 con 0x7f88ec145250 2024-04-25T09:09:30.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88e2000640 1 -- 172.21.15.173:0/3716587464 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e4003d20 con 0x7f88ec145250 2024-04-25T09:09:30.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88e2000640 1 -- 172.21.15.173:0/3716587464 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e400aa90 con 0x7f88ec145250 2024-04-25T09:09:30.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88f0a00640 1 -- 172.21.15.173:0/3716587464 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ec15dd40 con 0x7f88ec145250 2024-04-25T09:09:30.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88f0a00640 1 -- 172.21.15.173:0/3716587464 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ec15e300 con 0x7f88ec145250 2024-04-25T09:09:30.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.768+0000 7f88f0a00640 1 -- 172.21.15.173:0/3716587464 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ec073a40 con 0x7f88ec145250 2024-04-25T09:09:30.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.772+0000 7f88e2000640 1 -- 172.21.15.173:0/3716587464 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f88e400ac30 con 0x7f88ec145250 2024-04-25T09:09:30.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.772+0000 7f88e2000640 1 --2- 172.21.15.173:0/3716587464 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88c8066f90 0x7f88c8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:30.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.772+0000 7f88e2000640 1 -- 172.21.15.173:0/3716587464 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f88e40850f0 con 0x7f88ec145250 2024-04-25T09:09:30.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.772+0000 7f88e9e00640 1 --2- 172.21.15.173:0/3716587464 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88c8066f90 0x7f88c8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:30.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.772+0000 7f88e9e00640 1 --2- 172.21.15.173:0/3716587464 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88c8066f90 0x7f88c8069450 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f88d4005890 tx=0x7f88d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:30.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.776+0000 7f88e2000640 1 -- 172.21.15.173:0/3716587464 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f88e4055ed0 con 0x7f88ec145250 2024-04-25T09:09:30.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.928+0000 7f88f0a00640 1 -- 172.21.15.173:0/3716587464 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88ec15bec0 con 0x7f88c8066f90 2024-04-25T09:09:30.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.932+0000 7f88e2000640 1 -- 172.21.15.173:0/3716587464 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251651 (secure 0 0 0) 0x7f88ec15bec0 con 0x7f88c8066f90 2024-04-25T09:09:30.925 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:30.927 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:09:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.936+0000 7f88f0a00640 1 -- 172.21.15.173:0/3716587464 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88c8066f90 msgr2=0x7f88c8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.936+0000 7f88f0a00640 1 --2- 172.21.15.173:0/3716587464 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88c8066f90 0x7f88c8069450 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f88d4005890 tx=0x7f88d4009040 comp rx=0 tx=0).stop 2024-04-25T09:09:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.936+0000 7f88f0a00640 1 -- 172.21.15.173:0/3716587464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88ec145250 msgr2=0x7f88ec1445d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.936+0000 7f88f0a00640 1 --2- 172.21.15.173:0/3716587464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88ec145250 0x7f88ec1445d0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f88e400c7a0 tx=0x7f88e400cc60 comp rx=0 tx=0).stop 2024-04-25T09:09:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.936+0000 7f88f0a00640 1 -- 172.21.15.173:0/3716587464 shutdown_connections 2024-04-25T09:09:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.936+0000 7f88f0a00640 1 --2- 172.21.15.173:0/3716587464 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88c8066f90 0x7f88c8069450 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.936+0000 7f88f0a00640 1 --2- 172.21.15.173:0/3716587464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88ec145250 0x7f88ec1445d0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.936+0000 7f88f0a00640 1 --2- 172.21.15.173:0/3716587464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88ec0ce8f0 0x7f88ec144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.936+0000 7f88f0a00640 1 --2- 172.21.15.173:0/3716587464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88ec0cc8b0 0x7f88ec159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:30.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.936+0000 7f88f0a00640 1 -- 172.21.15.173:0/3716587464 >> 172.21.15.173:0/3716587464 conn(0x7f88ec06ac90 msgr2=0x7f88ec142c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:30.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.936+0000 7f88f0a00640 1 -- 172.21.15.173:0/3716587464 shutdown_connections 2024-04-25T09:09:30.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:30.936+0000 7f88f0a00640 1 -- 172.21.15.173:0/3716587464 wait complete. 2024-04-25T09:09:30.946 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2024-04-25T09:09:30.815176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592744,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400140,"kb_used_data":10436,"kb_used_omap":12,"kb_used_meta":389555,"kb_avail":754574580,"statfs":{"total":773094113280,"available":772684369920,"internally_reserved":0,"allocated":10686464,"data_stored":5549493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":398904880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2376,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.951964"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694625+0000","last_change":"2024-04-25T09:09:26.896499+0000","last_active":"2024-04-25T09:09:28.694625+0000","last_peered":"2024-04-25T09:09:28.694625+0000","last_clean":"2024-04-25T09:09:28.694625+0000","last_became_active":"2024-04-25T09:09:26.896226+0000","last_became_peered":"2024-04-25T09:09:26.896226+0000","last_unstale":"2024-04-25T09:09:28.694625+0000","last_undegraded":"2024-04-25T09:09:28.694625+0000","last_fullsized":"2024-04-25T09:09:28.694625+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:50.131196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694036+0000","last_change":"2024-04-25T09:09:26.897460+0000","last_active":"2024-04-25T09:09:28.694036+0000","last_peered":"2024-04-25T09:09:28.694036+0000","last_clean":"2024-04-25T09:09:28.694036+0000","last_became_active":"2024-04-25T09:09:26.897103+0000","last_became_peered":"2024-04-25T09:09:26.897103+0000","last_unstale":"2024-04-25T09:09:28.694036+0000","last_undegraded":"2024-04-25T09:09:28.694036+0000","last_fullsized":"2024-04-25T09:09:28.694036+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:21.216175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694439+0000","last_change":"2024-04-25T09:09:26.893748+0000","last_active":"2024-04-25T09:09:28.694439+0000","last_peered":"2024-04-25T09:09:28.694439+0000","last_clean":"2024-04-25T09:09:28.694439+0000","last_became_active":"2024-04-25T09:09:26.893515+0000","last_became_peered":"2024-04-25T09:09:26.893515+0000","last_unstale":"2024-04-25T09:09:28.694439+0000","last_undegraded":"2024-04-25T09:09:28.694439+0000","last_fullsized":"2024-04-25T09:09:28.694439+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:42.021859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694920+0000","last_change":"2024-04-25T09:09:26.910061+0000","last_active":"2024-04-25T09:09:28.694920+0000","last_peered":"2024-04-25T09:09:28.694920+0000","last_clean":"2024-04-25T09:09:28.694920+0000","last_became_active":"2024-04-25T09:09:26.909795+0000","last_became_peered":"2024-04-25T09:09:26.909795+0000","last_unstale":"2024-04-25T09:09:28.694920+0000","last_undegraded":"2024-04-25T09:09:28.694920+0000","last_fullsized":"2024-04-25T09:09:28.694920+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:05.780038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878204+0000","last_change":"2024-04-25T09:09:26.882500+0000","last_active":"2024-04-25T09:09:27.878204+0000","last_peered":"2024-04-25T09:09:27.878204+0000","last_clean":"2024-04-25T09:09:27.878204+0000","last_became_active":"2024-04-25T09:09:26.882178+0000","last_became_peered":"2024-04-25T09:09:26.882178+0000","last_unstale":"2024-04-25T09:09:27.878204+0000","last_undegraded":"2024-04-25T09:09:27.878204+0000","last_fullsized":"2024-04-25T09:09:27.878204+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:11.302067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877603+0000","last_change":"2024-04-25T09:09:26.913022+0000","last_active":"2024-04-25T09:09:27.877603+0000","last_peered":"2024-04-25T09:09:27.877603+0000","last_clean":"2024-04-25T09:09:27.877603+0000","last_became_active":"2024-04-25T09:09:26.912555+0000","last_became_peered":"2024-04-25T09:09:26.912555+0000","last_unstale":"2024-04-25T09:09:27.877603+0000","last_undegraded":"2024-04-25T09:09:27.877603+0000","last_fullsized":"2024-04-25T09:09:27.877603+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:09.924416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.882866+0000","last_change":"2024-04-25T09:09:25.882866+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.882866+0000","last_undegraded":"2024-04-25T09:09:25.882866+0000","last_fullsized":"2024-04-25T09:09:25.882866+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694274+0000","last_change":"2024-04-25T09:09:26.914654+0000","last_active":"2024-04-25T09:09:28.694274+0000","last_peered":"2024-04-25T09:09:28.694274+0000","last_clean":"2024-04-25T09:09:28.694274+0000","last_became_active":"2024-04-25T09:09:26.914011+0000","last_became_peered":"2024-04-25T09:09:26.914011+0000","last_unstale":"2024-04-25T09:09:28.694274+0000","last_undegraded":"2024-04-25T09:09:28.694274+0000","last_fullsized":"2024-04-25T09:09:28.694274+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:54.978670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878504+0000","last_change":"2024-04-25T09:09:26.892861+0000","last_active":"2024-04-25T09:09:27.878504+0000","last_peered":"2024-04-25T09:09:27.878504+0000","last_clean":"2024-04-25T09:09:27.878504+0000","last_became_active":"2024-04-25T09:09:26.892013+0000","last_became_peered":"2024-04-25T09:09:26.892013+0000","last_unstale":"2024-04-25T09:09:27.878504+0000","last_undegraded":"2024-04-25T09:09:27.878504+0000","last_fullsized":"2024-04-25T09:09:27.878504+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:27.027122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879193+0000","last_change":"2024-04-25T09:09:26.917328+0000","last_active":"2024-04-25T09:09:27.879193+0000","last_peered":"2024-04-25T09:09:27.879193+0000","last_clean":"2024-04-25T09:09:27.879193+0000","last_became_active":"2024-04-25T09:09:26.916317+0000","last_became_peered":"2024-04-25T09:09:26.916317+0000","last_unstale":"2024-04-25T09:09:27.879193+0000","last_undegraded":"2024-04-25T09:09:27.879193+0000","last_fullsized":"2024-04-25T09:09:27.879193+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:25.900567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878527+0000","last_change":"2024-04-25T09:09:26.893466+0000","last_active":"2024-04-25T09:09:27.878527+0000","last_peered":"2024-04-25T09:09:27.878527+0000","last_clean":"2024-04-25T09:09:27.878527+0000","last_became_active":"2024-04-25T09:09:26.893066+0000","last_became_peered":"2024-04-25T09:09:26.893066+0000","last_unstale":"2024-04-25T09:09:27.878527+0000","last_undegraded":"2024-04-25T09:09:27.878527+0000","last_fullsized":"2024-04-25T09:09:27.878527+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:30.604324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879051+0000","last_change":"2024-04-25T09:09:26.895964+0000","last_active":"2024-04-25T09:09:27.879051+0000","last_peered":"2024-04-25T09:09:27.879051+0000","last_clean":"2024-04-25T09:09:27.879051+0000","last_became_active":"2024-04-25T09:09:26.895695+0000","last_became_peered":"2024-04-25T09:09:26.895695+0000","last_unstale":"2024-04-25T09:09:27.879051+0000","last_undegraded":"2024-04-25T09:09:27.879051+0000","last_fullsized":"2024-04-25T09:09:27.879051+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:51.062011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694360+0000","last_change":"2024-04-25T09:09:26.913085+0000","last_active":"2024-04-25T09:09:28.694360+0000","last_peered":"2024-04-25T09:09:28.694360+0000","last_clean":"2024-04-25T09:09:28.694360+0000","last_became_active":"2024-04-25T09:09:26.912780+0000","last_became_peered":"2024-04-25T09:09:26.912780+0000","last_unstale":"2024-04-25T09:09:28.694360+0000","last_undegraded":"2024-04-25T09:09:28.694360+0000","last_fullsized":"2024-04-25T09:09:28.694360+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:11.765250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877970+0000","last_change":"2024-04-25T09:09:26.911169+0000","last_active":"2024-04-25T09:09:27.877970+0000","last_peered":"2024-04-25T09:09:27.877970+0000","last_clean":"2024-04-25T09:09:27.877970+0000","last_became_active":"2024-04-25T09:09:26.910649+0000","last_became_peered":"2024-04-25T09:09:26.910649+0000","last_unstale":"2024-04-25T09:09:27.877970+0000","last_undegraded":"2024-04-25T09:09:27.877970+0000","last_fullsized":"2024-04-25T09:09:27.877970+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:43.383066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694367+0000","last_change":"2024-04-25T09:09:26.909778+0000","last_active":"2024-04-25T09:09:28.694367+0000","last_peered":"2024-04-25T09:09:28.694367+0000","last_clean":"2024-04-25T09:09:28.694367+0000","last_became_active":"2024-04-25T09:09:26.909495+0000","last_became_peered":"2024-04-25T09:09:26.909495+0000","last_unstale":"2024-04-25T09:09:28.694367+0000","last_undegraded":"2024-04-25T09:09:28.694367+0000","last_fullsized":"2024-04-25T09:09:28.694367+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:15.564347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877754+0000","last_change":"2024-04-25T09:09:26.890288+0000","last_active":"2024-04-25T09:09:27.877754+0000","last_peered":"2024-04-25T09:09:27.877754+0000","last_clean":"2024-04-25T09:09:27.877754+0000","last_became_active":"2024-04-25T09:09:26.889997+0000","last_became_peered":"2024-04-25T09:09:26.889997+0000","last_unstale":"2024-04-25T09:09:27.877754+0000","last_undegraded":"2024-04-25T09:09:27.877754+0000","last_fullsized":"2024-04-25T09:09:27.877754+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:46.747064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878504+0000","last_change":"2024-04-25T09:09:26.890210+0000","last_active":"2024-04-25T09:09:27.878504+0000","last_peered":"2024-04-25T09:09:27.878504+0000","last_clean":"2024-04-25T09:09:27.878504+0000","last_became_active":"2024-04-25T09:09:26.889939+0000","last_became_peered":"2024-04-25T09:09:26.889939+0000","last_unstale":"2024-04-25T09:09:27.878504+0000","last_undegraded":"2024-04-25T09:09:27.878504+0000","last_fullsized":"2024-04-25T09:09:27.878504+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:23.740183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694624+0000","last_change":"2024-04-25T09:09:26.893150+0000","last_active":"2024-04-25T09:09:28.694624+0000","last_peered":"2024-04-25T09:09:28.694624+0000","last_clean":"2024-04-25T09:09:28.694624+0000","last_became_active":"2024-04-25T09:09:26.892878+0000","last_became_peered":"2024-04-25T09:09:26.892878+0000","last_unstale":"2024-04-25T09:09:28.694624+0000","last_undegraded":"2024-04-25T09:09:28.694624+0000","last_fullsized":"2024-04-25T09:09:28.694624+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:12.002802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878727+0000","last_change":"2024-04-25T09:09:26.907546+0000","last_active":"2024-04-25T09:09:27.878727+0000","last_peered":"2024-04-25T09:09:27.878727+0000","last_clean":"2024-04-25T09:09:27.878727+0000","last_became_active":"2024-04-25T09:09:26.907067+0000","last_became_peered":"2024-04-25T09:09:26.907067+0000","last_unstale":"2024-04-25T09:09:27.878727+0000","last_undegraded":"2024-04-25T09:09:27.878727+0000","last_fullsized":"2024-04-25T09:09:27.878727+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:16.612907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695210+0000","last_change":"2024-04-25T09:09:26.915859+0000","last_active":"2024-04-25T09:09:28.695210+0000","last_peered":"2024-04-25T09:09:28.695210+0000","last_clean":"2024-04-25T09:09:28.695210+0000","last_became_active":"2024-04-25T09:09:26.915582+0000","last_became_peered":"2024-04-25T09:09:26.915582+0000","last_unstale":"2024-04-25T09:09:28.695210+0000","last_undegraded":"2024-04-25T09:09:28.695210+0000","last_fullsized":"2024-04-25T09:09:28.695210+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:36.548327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878530+0000","last_change":"2024-04-25T09:09:26.889501+0000","last_active":"2024-04-25T09:09:27.878530+0000","last_peered":"2024-04-25T09:09:27.878530+0000","last_clean":"2024-04-25T09:09:27.878530+0000","last_became_active":"2024-04-25T09:09:26.889203+0000","last_became_peered":"2024-04-25T09:09:26.889203+0000","last_unstale":"2024-04-25T09:09:27.878530+0000","last_undegraded":"2024-04-25T09:09:27.878530+0000","last_fullsized":"2024-04-25T09:09:27.878530+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:47.910831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878007+0000","last_change":"2024-04-25T09:09:26.911728+0000","last_active":"2024-04-25T09:09:27.878007+0000","last_peered":"2024-04-25T09:09:27.878007+0000","last_clean":"2024-04-25T09:09:27.878007+0000","last_became_active":"2024-04-25T09:09:26.911326+0000","last_became_peered":"2024-04-25T09:09:26.911326+0000","last_unstale":"2024-04-25T09:09:27.878007+0000","last_undegraded":"2024-04-25T09:09:27.878007+0000","last_fullsized":"2024-04-25T09:09:27.878007+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:04.056308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694105+0000","last_change":"2024-04-25T09:09:26.911084+0000","last_active":"2024-04-25T09:09:28.694105+0000","last_peered":"2024-04-25T09:09:28.694105+0000","last_clean":"2024-04-25T09:09:28.694105+0000","last_became_active":"2024-04-25T09:09:26.910797+0000","last_became_peered":"2024-04-25T09:09:26.910797+0000","last_unstale":"2024-04-25T09:09:28.694105+0000","last_undegraded":"2024-04-25T09:09:28.694105+0000","last_fullsized":"2024-04-25T09:09:28.694105+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:39.999904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694346+0000","last_change":"2024-04-25T09:09:26.892545+0000","last_active":"2024-04-25T09:09:28.694346+0000","last_peered":"2024-04-25T09:09:28.694346+0000","last_clean":"2024-04-25T09:09:28.694346+0000","last_became_active":"2024-04-25T09:09:26.892292+0000","last_became_peered":"2024-04-25T09:09:26.892292+0000","last_unstale":"2024-04-25T09:09:28.694346+0000","last_undegraded":"2024-04-25T09:09:28.694346+0000","last_fullsized":"2024-04-25T09:09:28.694346+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:45.556771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694403+0000","last_change":"2024-04-25T09:09:26.891490+0000","last_active":"2024-04-25T09:09:28.694403+0000","last_peered":"2024-04-25T09:09:28.694403+0000","last_clean":"2024-04-25T09:09:28.694403+0000","last_became_active":"2024-04-25T09:09:26.890866+0000","last_became_peered":"2024-04-25T09:09:26.890866+0000","last_unstale":"2024-04-25T09:09:28.694403+0000","last_undegraded":"2024-04-25T09:09:28.694403+0000","last_fullsized":"2024-04-25T09:09:28.694403+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:47.875102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878629+0000","last_change":"2024-04-25T09:09:26.915924+0000","last_active":"2024-04-25T09:09:27.878629+0000","last_peered":"2024-04-25T09:09:27.878629+0000","last_clean":"2024-04-25T09:09:27.878629+0000","last_became_active":"2024-04-25T09:09:26.915617+0000","last_became_peered":"2024-04-25T09:09:26.915617+0000","last_unstale":"2024-04-25T09:09:27.878629+0000","last_undegraded":"2024-04-25T09:09:27.878629+0000","last_fullsized":"2024-04-25T09:09:27.878629+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:46.270829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879087+0000","last_change":"2024-04-25T09:09:26.900162+0000","last_active":"2024-04-25T09:09:27.879087+0000","last_peered":"2024-04-25T09:09:27.879087+0000","last_clean":"2024-04-25T09:09:27.879087+0000","last_became_active":"2024-04-25T09:09:26.899697+0000","last_became_peered":"2024-04-25T09:09:26.899697+0000","last_unstale":"2024-04-25T09:09:27.879087+0000","last_undegraded":"2024-04-25T09:09:27.879087+0000","last_fullsized":"2024-04-25T09:09:27.879087+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:41.618620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695320+0000","last_change":"2024-04-25T09:09:26.909249+0000","last_active":"2024-04-25T09:09:28.695320+0000","last_peered":"2024-04-25T09:09:28.695320+0000","last_clean":"2024-04-25T09:09:28.695320+0000","last_became_active":"2024-04-25T09:09:26.908995+0000","last_became_peered":"2024-04-25T09:09:26.908995+0000","last_unstale":"2024-04-25T09:09:28.695320+0000","last_undegraded":"2024-04-25T09:09:28.695320+0000","last_fullsized":"2024-04-25T09:09:28.695320+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:48.941318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.882413+0000","last_change":"2024-04-25T09:09:25.882413+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.882413+0000","last_undegraded":"2024-04-25T09:09:25.882413+0000","last_fullsized":"2024-04-25T09:09:25.882413+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878423+0000","last_change":"2024-04-25T09:09:26.892277+0000","last_active":"2024-04-25T09:09:27.878423+0000","last_peered":"2024-04-25T09:09:27.878423+0000","last_clean":"2024-04-25T09:09:27.878423+0000","last_became_active":"2024-04-25T09:09:26.891967+0000","last_became_peered":"2024-04-25T09:09:26.891967+0000","last_unstale":"2024-04-25T09:09:27.878423+0000","last_undegraded":"2024-04-25T09:09:27.878423+0000","last_fullsized":"2024-04-25T09:09:27.878423+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:15.199604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694617+0000","last_change":"2024-04-25T09:09:26.912200+0000","last_active":"2024-04-25T09:09:28.694617+0000","last_peered":"2024-04-25T09:09:28.694617+0000","last_clean":"2024-04-25T09:09:28.694617+0000","last_became_active":"2024-04-25T09:09:26.911878+0000","last_became_peered":"2024-04-25T09:09:26.911878+0000","last_unstale":"2024-04-25T09:09:28.694617+0000","last_undegraded":"2024-04-25T09:09:28.694617+0000","last_fullsized":"2024-04-25T09:09:28.694617+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:56.330021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877597+0000","last_change":"2024-04-25T09:09:26.890855+0000","last_active":"2024-04-25T09:09:27.877597+0000","last_peered":"2024-04-25T09:09:27.877597+0000","last_clean":"2024-04-25T09:09:27.877597+0000","last_became_active":"2024-04-25T09:09:26.890600+0000","last_became_peered":"2024-04-25T09:09:26.890600+0000","last_unstale":"2024-04-25T09:09:27.877597+0000","last_undegraded":"2024-04-25T09:09:27.877597+0000","last_fullsized":"2024-04-25T09:09:27.877597+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:29.370531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877890+0000","last_change":"2024-04-25T09:09:26.884423+0000","last_active":"2024-04-25T09:09:27.877890+0000","last_peered":"2024-04-25T09:09:27.877890+0000","last_clean":"2024-04-25T09:09:27.877890+0000","last_became_active":"2024-04-25T09:09:26.884029+0000","last_became_peered":"2024-04-25T09:09:26.884029+0000","last_unstale":"2024-04-25T09:09:27.877890+0000","last_undegraded":"2024-04-25T09:09:27.877890+0000","last_fullsized":"2024-04-25T09:09:27.877890+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:09.825442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"96'4","reported_seq":18,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695112+0000","last_change":"2024-04-25T09:09:25.891328+0000","last_active":"2024-04-25T09:09:28.695112+0000","last_peered":"2024-04-25T09:09:28.695112+0000","last_clean":"2024-04-25T09:09:28.695112+0000","last_became_active":"2024-04-25T09:09:25.891055+0000","last_became_peered":"2024-04-25T09:09:25.891055+0000","last_unstale":"2024-04-25T09:09:28.695112+0000","last_undegraded":"2024-04-25T09:09:28.695112+0000","last_fullsized":"2024-04-25T09:09:28.695112+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:26.020961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878066+0000","last_change":"2024-04-25T09:09:26.901370+0000","last_active":"2024-04-25T09:09:27.878066+0000","last_peered":"2024-04-25T09:09:27.878066+0000","last_clean":"2024-04-25T09:09:27.878066+0000","last_became_active":"2024-04-25T09:09:26.901014+0000","last_became_peered":"2024-04-25T09:09:26.901014+0000","last_unstale":"2024-04-25T09:09:27.878066+0000","last_undegraded":"2024-04-25T09:09:27.878066+0000","last_fullsized":"2024-04-25T09:09:27.878066+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:54.558905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878756+0000","last_change":"2024-04-25T09:09:25.891301+0000","last_active":"2024-04-25T09:09:27.878756+0000","last_peered":"2024-04-25T09:09:27.878756+0000","last_clean":"2024-04-25T09:09:27.878756+0000","last_became_active":"2024-04-25T09:09:25.891027+0000","last_became_peered":"2024-04-25T09:09:25.891027+0000","last_unstale":"2024-04-25T09:09:27.878756+0000","last_undegraded":"2024-04-25T09:09:27.878756+0000","last_fullsized":"2024-04-25T09:09:27.878756+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:29.460046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.883382+0000","last_change":"2024-04-25T09:09:25.883382+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.883382+0000","last_undegraded":"2024-04-25T09:09:25.883382+0000","last_fullsized":"2024-04-25T09:09:25.883382+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.896967+0000","last_change":"2024-04-25T09:09:25.895316+0000","last_active":"2024-04-25T09:09:25.896967+0000","last_peered":"2024-04-25T09:09:25.896967+0000","last_clean":"2024-04-25T09:09:25.896967+0000","last_became_active":"2024-04-25T09:09:25.895025+0000","last_became_peered":"2024-04-25T09:09:25.895025+0000","last_unstale":"2024-04-25T09:09:25.896967+0000","last_undegraded":"2024-04-25T09:09:25.896967+0000","last_fullsized":"2024-04-25T09:09:25.896967+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:12.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878561+0000","last_change":"2024-04-25T09:09:26.893173+0000","last_active":"2024-04-25T09:09:27.878561+0000","last_peered":"2024-04-25T09:09:27.878561+0000","last_clean":"2024-04-25T09:09:27.878561+0000","last_became_active":"2024-04-25T09:09:26.892420+0000","last_became_peered":"2024-04-25T09:09:26.892420+0000","last_unstale":"2024-04-25T09:09:27.878561+0000","last_undegraded":"2024-04-25T09:09:27.878561+0000","last_fullsized":"2024-04-25T09:09:27.878561+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:20.008848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694910+0000","last_change":"2024-04-25T09:09:25.893538+0000","last_active":"2024-04-25T09:09:28.694910+0000","last_peered":"2024-04-25T09:09:28.694910+0000","last_clean":"2024-04-25T09:09:28.694910+0000","last_became_active":"2024-04-25T09:09:25.893014+0000","last_became_peered":"2024-04-25T09:09:25.893014+0000","last_unstale":"2024-04-25T09:09:28.694910+0000","last_undegraded":"2024-04-25T09:09:28.694910+0000","last_fullsized":"2024-04-25T09:09:28.694910+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:10.295905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694427+0000","last_change":"2024-04-25T09:09:26.909690+0000","last_active":"2024-04-25T09:09:28.694427+0000","last_peered":"2024-04-25T09:09:28.694427+0000","last_clean":"2024-04-25T09:09:28.694427+0000","last_became_active":"2024-04-25T09:09:26.909399+0000","last_became_peered":"2024-04-25T09:09:26.909399+0000","last_unstale":"2024-04-25T09:09:28.694427+0000","last_undegraded":"2024-04-25T09:09:28.694427+0000","last_fullsized":"2024-04-25T09:09:28.694427+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:53.115977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878346+0000","last_change":"2024-04-25T09:09:25.888297+0000","last_active":"2024-04-25T09:09:27.878346+0000","last_peered":"2024-04-25T09:09:27.878346+0000","last_clean":"2024-04-25T09:09:27.878346+0000","last_became_active":"2024-04-25T09:09:25.887706+0000","last_became_peered":"2024-04-25T09:09:25.887706+0000","last_unstale":"2024-04-25T09:09:27.878346+0000","last_undegraded":"2024-04-25T09:09:27.878346+0000","last_fullsized":"2024-04-25T09:09:27.878346+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:00.496547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694277+0000","last_change":"2024-04-25T09:09:26.894500+0000","last_active":"2024-04-25T09:09:28.694277+0000","last_peered":"2024-04-25T09:09:28.694277+0000","last_clean":"2024-04-25T09:09:28.694277+0000","last_became_active":"2024-04-25T09:09:26.893339+0000","last_became_peered":"2024-04-25T09:09:26.893339+0000","last_unstale":"2024-04-25T09:09:28.694277+0000","last_undegraded":"2024-04-25T09:09:28.694277+0000","last_fullsized":"2024-04-25T09:09:28.694277+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:21.216175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695215+0000","last_change":"2024-04-25T09:09:25.888636+0000","last_active":"2024-04-25T09:09:28.695215+0000","last_peered":"2024-04-25T09:09:28.695215+0000","last_clean":"2024-04-25T09:09:28.695215+0000","last_became_active":"2024-04-25T09:09:25.888332+0000","last_became_peered":"2024-04-25T09:09:25.888332+0000","last_unstale":"2024-04-25T09:09:28.695215+0000","last_undegraded":"2024-04-25T09:09:28.695215+0000","last_fullsized":"2024-04-25T09:09:28.695215+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:59.063251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878062+0000","last_change":"2024-04-25T09:09:26.912804+0000","last_active":"2024-04-25T09:09:27.878062+0000","last_peered":"2024-04-25T09:09:27.878062+0000","last_clean":"2024-04-25T09:09:27.878062+0000","last_became_active":"2024-04-25T09:09:26.912208+0000","last_became_peered":"2024-04-25T09:09:26.912208+0000","last_unstale":"2024-04-25T09:09:27.878062+0000","last_undegraded":"2024-04-25T09:09:27.878062+0000","last_fullsized":"2024-04-25T09:09:27.878062+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:33:39.777394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694925+0000","last_change":"2024-04-25T09:09:25.891312+0000","last_active":"2024-04-25T09:09:28.694925+0000","last_peered":"2024-04-25T09:09:28.694925+0000","last_clean":"2024-04-25T09:09:28.694925+0000","last_became_active":"2024-04-25T09:09:25.890959+0000","last_became_peered":"2024-04-25T09:09:25.890959+0000","last_unstale":"2024-04-25T09:09:28.694925+0000","last_undegraded":"2024-04-25T09:09:28.694925+0000","last_fullsized":"2024-04-25T09:09:28.694925+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:12.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694573+0000","last_change":"2024-04-25T09:09:26.907307+0000","last_active":"2024-04-25T09:09:28.694573+0000","last_peered":"2024-04-25T09:09:28.694573+0000","last_clean":"2024-04-25T09:09:28.694573+0000","last_became_active":"2024-04-25T09:09:26.907053+0000","last_became_peered":"2024-04-25T09:09:26.907053+0000","last_unstale":"2024-04-25T09:09:28.694573+0000","last_undegraded":"2024-04-25T09:09:28.694573+0000","last_fullsized":"2024-04-25T09:09:28.694573+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:48.603667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.896738+0000","last_change":"2024-04-25T09:09:25.893856+0000","last_active":"2024-04-25T09:09:25.896738+0000","last_peered":"2024-04-25T09:09:25.896738+0000","last_clean":"2024-04-25T09:09:25.896738+0000","last_became_active":"2024-04-25T09:09:25.893562+0000","last_became_peered":"2024-04-25T09:09:25.893562+0000","last_unstale":"2024-04-25T09:09:25.896738+0000","last_undegraded":"2024-04-25T09:09:25.896738+0000","last_fullsized":"2024-04-25T09:09:25.896738+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:19.211371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878454+0000","last_change":"2024-04-25T09:09:26.895908+0000","last_active":"2024-04-25T09:09:27.878454+0000","last_peered":"2024-04-25T09:09:27.878454+0000","last_clean":"2024-04-25T09:09:27.878454+0000","last_became_active":"2024-04-25T09:09:26.895544+0000","last_became_peered":"2024-04-25T09:09:26.895544+0000","last_unstale":"2024-04-25T09:09:27.878454+0000","last_undegraded":"2024-04-25T09:09:27.878454+0000","last_fullsized":"2024-04-25T09:09:27.878454+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:15.682654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694584+0000","last_change":"2024-04-25T09:09:25.892399+0000","last_active":"2024-04-25T09:09:28.694584+0000","last_peered":"2024-04-25T09:09:28.694584+0000","last_clean":"2024-04-25T09:09:28.694584+0000","last_became_active":"2024-04-25T09:09:25.892107+0000","last_became_peered":"2024-04-25T09:09:25.892107+0000","last_unstale":"2024-04-25T09:09:28.694584+0000","last_undegraded":"2024-04-25T09:09:28.694584+0000","last_fullsized":"2024-04-25T09:09:28.694584+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:14.676493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.882297+0000","last_change":"2024-04-25T09:09:25.882297+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.882297+0000","last_undegraded":"2024-04-25T09:09:25.882297+0000","last_fullsized":"2024-04-25T09:09:25.882297+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694758+0000","last_change":"2024-04-25T09:09:25.891693+0000","last_active":"2024-04-25T09:09:28.694758+0000","last_peered":"2024-04-25T09:09:28.694758+0000","last_clean":"2024-04-25T09:09:28.694758+0000","last_became_active":"2024-04-25T09:09:25.891465+0000","last_became_peered":"2024-04-25T09:09:25.891465+0000","last_unstale":"2024-04-25T09:09:28.694758+0000","last_undegraded":"2024-04-25T09:09:28.694758+0000","last_fullsized":"2024-04-25T09:09:28.694758+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:26.140967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694812+0000","last_change":"2024-04-25T09:09:26.897388+0000","last_active":"2024-04-25T09:09:28.694812+0000","last_peered":"2024-04-25T09:09:28.694812+0000","last_clean":"2024-04-25T09:09:28.694812+0000","last_became_active":"2024-04-25T09:09:26.897138+0000","last_became_peered":"2024-04-25T09:09:26.897138+0000","last_unstale":"2024-04-25T09:09:28.694812+0000","last_undegraded":"2024-04-25T09:09:28.694812+0000","last_fullsized":"2024-04-25T09:09:28.694812+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:07.845041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"96'3","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878807+0000","last_change":"2024-04-25T09:09:25.890611+0000","last_active":"2024-04-25T09:09:27.878807+0000","last_peered":"2024-04-25T09:09:27.878807+0000","last_clean":"2024-04-25T09:09:27.878807+0000","last_became_active":"2024-04-25T09:09:25.889897+0000","last_became_peered":"2024-04-25T09:09:25.889897+0000","last_unstale":"2024-04-25T09:09:27.878807+0000","last_undegraded":"2024-04-25T09:09:27.878807+0000","last_fullsized":"2024-04-25T09:09:27.878807+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:00.689979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695142+0000","last_change":"2024-04-25T09:09:26.906211+0000","last_active":"2024-04-25T09:09:28.695142+0000","last_peered":"2024-04-25T09:09:28.695142+0000","last_clean":"2024-04-25T09:09:28.695142+0000","last_became_active":"2024-04-25T09:09:26.905774+0000","last_became_peered":"2024-04-25T09:09:26.905774+0000","last_unstale":"2024-04-25T09:09:28.695142+0000","last_undegraded":"2024-04-25T09:09:28.695142+0000","last_fullsized":"2024-04-25T09:09:28.695142+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:39.497239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"96'6","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878178+0000","last_change":"2024-04-25T09:09:25.892734+0000","last_active":"2024-04-25T09:09:27.878178+0000","last_peered":"2024-04-25T09:09:27.878178+0000","last_clean":"2024-04-25T09:09:27.878178+0000","last_became_active":"2024-04-25T09:09:25.892486+0000","last_became_peered":"2024-04-25T09:09:25.892486+0000","last_unstale":"2024-04-25T09:09:27.878178+0000","last_undegraded":"2024-04-25T09:09:27.878178+0000","last_fullsized":"2024-04-25T09:09:27.878178+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:28.617165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694564+0000","last_change":"2024-04-25T09:09:26.914455+0000","last_active":"2024-04-25T09:09:28.694564+0000","last_peered":"2024-04-25T09:09:28.694564+0000","last_clean":"2024-04-25T09:09:28.694564+0000","last_became_active":"2024-04-25T09:09:26.912881+0000","last_became_peered":"2024-04-25T09:09:26.912881+0000","last_unstale":"2024-04-25T09:09:28.694564+0000","last_undegraded":"2024-04-25T09:09:28.694564+0000","last_fullsized":"2024-04-25T09:09:28.694564+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:32.128756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.897005+0000","last_change":"2024-04-25T09:09:25.895891+0000","last_active":"2024-04-25T09:09:25.897005+0000","last_peered":"2024-04-25T09:09:25.897005+0000","last_clean":"2024-04-25T09:09:25.897005+0000","last_became_active":"2024-04-25T09:09:25.894219+0000","last_became_peered":"2024-04-25T09:09:25.894219+0000","last_unstale":"2024-04-25T09:09:25.897005+0000","last_undegraded":"2024-04-25T09:09:25.897005+0000","last_fullsized":"2024-04-25T09:09:25.897005+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:26.140967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877982+0000","last_change":"2024-04-25T09:09:26.882098+0000","last_active":"2024-04-25T09:09:27.877982+0000","last_peered":"2024-04-25T09:09:27.877982+0000","last_clean":"2024-04-25T09:09:27.877982+0000","last_became_active":"2024-04-25T09:09:26.881774+0000","last_became_peered":"2024-04-25T09:09:26.881774+0000","last_unstale":"2024-04-25T09:09:27.877982+0000","last_undegraded":"2024-04-25T09:09:27.877982+0000","last_fullsized":"2024-04-25T09:09:27.877982+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:38.604466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877730+0000","last_change":"2024-04-25T09:09:25.888905+0000","last_active":"2024-04-25T09:09:27.877730+0000","last_peered":"2024-04-25T09:09:27.877730+0000","last_clean":"2024-04-25T09:09:27.877730+0000","last_became_active":"2024-04-25T09:09:25.887974+0000","last_became_peered":"2024-04-25T09:09:25.887974+0000","last_unstale":"2024-04-25T09:09:27.877730+0000","last_undegraded":"2024-04-25T09:09:27.877730+0000","last_fullsized":"2024-04-25T09:09:27.877730+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:15.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879185+0000","last_change":"2024-04-25T09:09:26.916502+0000","last_active":"2024-04-25T09:09:27.879185+0000","last_peered":"2024-04-25T09:09:27.879185+0000","last_clean":"2024-04-25T09:09:27.879185+0000","last_became_active":"2024-04-25T09:09:26.916269+0000","last_became_peered":"2024-04-25T09:09:26.916269+0000","last_unstale":"2024-04-25T09:09:27.879185+0000","last_undegraded":"2024-04-25T09:09:27.879185+0000","last_fullsized":"2024-04-25T09:09:27.879185+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:29.397203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694554+0000","last_change":"2024-04-25T09:09:25.893744+0000","last_active":"2024-04-25T09:09:28.694554+0000","last_peered":"2024-04-25T09:09:28.694554+0000","last_clean":"2024-04-25T09:09:28.694554+0000","last_became_active":"2024-04-25T09:09:25.892844+0000","last_became_peered":"2024-04-25T09:09:25.892844+0000","last_unstale":"2024-04-25T09:09:28.694554+0000","last_undegraded":"2024-04-25T09:09:28.694554+0000","last_fullsized":"2024-04-25T09:09:28.694554+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:56.231571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879077+0000","last_change":"2024-04-25T09:09:26.898749+0000","last_active":"2024-04-25T09:09:27.879077+0000","last_peered":"2024-04-25T09:09:27.879077+0000","last_clean":"2024-04-25T09:09:27.879077+0000","last_became_active":"2024-04-25T09:09:26.898150+0000","last_became_peered":"2024-04-25T09:09:26.898150+0000","last_unstale":"2024-04-25T09:09:27.879077+0000","last_undegraded":"2024-04-25T09:09:27.879077+0000","last_fullsized":"2024-04-25T09:09:27.879077+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:03.772159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"96'8","reported_seq":22,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694543+0000","last_change":"2024-04-25T09:09:25.894818+0000","last_active":"2024-04-25T09:09:28.694543+0000","last_peered":"2024-04-25T09:09:28.694543+0000","last_clean":"2024-04-25T09:09:28.694543+0000","last_became_active":"2024-04-25T09:09:25.894535+0000","last_became_peered":"2024-04-25T09:09:25.894535+0000","last_unstale":"2024-04-25T09:09:28.694543+0000","last_undegraded":"2024-04-25T09:09:28.694543+0000","last_fullsized":"2024-04-25T09:09:28.694543+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:36.631220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878063+0000","last_change":"2024-04-25T09:09:26.892885+0000","last_active":"2024-04-25T09:09:27.878063+0000","last_peered":"2024-04-25T09:09:27.878063+0000","last_clean":"2024-04-25T09:09:27.878063+0000","last_became_active":"2024-04-25T09:09:26.892623+0000","last_became_peered":"2024-04-25T09:09:26.892623+0000","last_unstale":"2024-04-25T09:09:27.878063+0000","last_undegraded":"2024-04-25T09:09:27.878063+0000","last_fullsized":"2024-04-25T09:09:27.878063+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:14.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695130+0000","last_change":"2024-04-25T09:09:25.893625+0000","last_active":"2024-04-25T09:09:28.695130+0000","last_peered":"2024-04-25T09:09:28.695130+0000","last_clean":"2024-04-25T09:09:28.695130+0000","last_became_active":"2024-04-25T09:09:25.893276+0000","last_became_peered":"2024-04-25T09:09:25.893276+0000","last_unstale":"2024-04-25T09:09:28.695130+0000","last_undegraded":"2024-04-25T09:09:28.695130+0000","last_fullsized":"2024-04-25T09:09:28.695130+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:29.598163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695021+0000","last_change":"2024-04-25T09:09:26.891031+0000","last_active":"2024-04-25T09:09:28.695021+0000","last_peered":"2024-04-25T09:09:28.695021+0000","last_clean":"2024-04-25T09:09:28.695021+0000","last_became_active":"2024-04-25T09:09:26.890788+0000","last_became_peered":"2024-04-25T09:09:26.890788+0000","last_unstale":"2024-04-25T09:09:28.695021+0000","last_undegraded":"2024-04-25T09:09:28.695021+0000","last_fullsized":"2024-04-25T09:09:28.695021+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:09.501598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.898067+0000","last_change":"2024-04-25T09:09:25.897420+0000","last_active":"2024-04-25T09:09:25.898067+0000","last_peered":"2024-04-25T09:09:25.898067+0000","last_clean":"2024-04-25T09:09:25.898067+0000","last_became_active":"2024-04-25T09:09:25.896968+0000","last_became_peered":"2024-04-25T09:09:25.896968+0000","last_unstale":"2024-04-25T09:09:25.898067+0000","last_undegraded":"2024-04-25T09:09:25.898067+0000","last_fullsized":"2024-04-25T09:09:25.898067+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:54.038096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878728+0000","last_change":"2024-04-25T09:09:26.902520+0000","last_active":"2024-04-25T09:09:27.878728+0000","last_peered":"2024-04-25T09:09:27.878728+0000","last_clean":"2024-04-25T09:09:27.878728+0000","last_became_active":"2024-04-25T09:09:26.902128+0000","last_became_peered":"2024-04-25T09:09:26.902128+0000","last_unstale":"2024-04-25T09:09:27.878728+0000","last_undegraded":"2024-04-25T09:09:27.878728+0000","last_fullsized":"2024-04-25T09:09:27.878728+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:04.360175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878847+0000","last_change":"2024-04-25T09:09:25.890897+0000","last_active":"2024-04-25T09:09:27.878847+0000","last_peered":"2024-04-25T09:09:27.878847+0000","last_clean":"2024-04-25T09:09:27.878847+0000","last_became_active":"2024-04-25T09:09:25.890283+0000","last_became_peered":"2024-04-25T09:09:25.890283+0000","last_unstale":"2024-04-25T09:09:27.878847+0000","last_undegraded":"2024-04-25T09:09:27.878847+0000","last_fullsized":"2024-04-25T09:09:27.878847+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:13.142222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877758+0000","last_change":"2024-04-25T09:09:26.910678+0000","last_active":"2024-04-25T09:09:27.877758+0000","last_peered":"2024-04-25T09:09:27.877758+0000","last_clean":"2024-04-25T09:09:27.877758+0000","last_became_active":"2024-04-25T09:09:26.910403+0000","last_became_peered":"2024-04-25T09:09:26.910403+0000","last_unstale":"2024-04-25T09:09:27.877758+0000","last_undegraded":"2024-04-25T09:09:27.877758+0000","last_fullsized":"2024-04-25T09:09:27.877758+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:43.004790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.693883+0000","last_change":"2024-04-25T09:09:25.889771+0000","last_active":"2024-04-25T09:09:28.693883+0000","last_peered":"2024-04-25T09:09:28.693883+0000","last_clean":"2024-04-25T09:09:28.693883+0000","last_became_active":"2024-04-25T09:09:25.889426+0000","last_became_peered":"2024-04-25T09:09:25.889426+0000","last_unstale":"2024-04-25T09:09:28.693883+0000","last_undegraded":"2024-04-25T09:09:28.693883+0000","last_fullsized":"2024-04-25T09:09:28.693883+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:14.193442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.693923+0000","last_change":"2024-04-25T09:09:26.895859+0000","last_active":"2024-04-25T09:09:28.693923+0000","last_peered":"2024-04-25T09:09:28.693923+0000","last_clean":"2024-04-25T09:09:28.693923+0000","last_became_active":"2024-04-25T09:09:26.895588+0000","last_became_peered":"2024-04-25T09:09:26.895588+0000","last_unstale":"2024-04-25T09:09:28.693923+0000","last_undegraded":"2024-04-25T09:09:28.693923+0000","last_fullsized":"2024-04-25T09:09:28.693923+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:39.999904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879040+0000","last_change":"2024-04-25T09:09:25.894259+0000","last_active":"2024-04-25T09:09:27.879040+0000","last_peered":"2024-04-25T09:09:27.879040+0000","last_clean":"2024-04-25T09:09:27.879040+0000","last_became_active":"2024-04-25T09:09:25.893924+0000","last_became_peered":"2024-04-25T09:09:25.893924+0000","last_unstale":"2024-04-25T09:09:27.879040+0000","last_undegraded":"2024-04-25T09:09:27.879040+0000","last_fullsized":"2024-04-25T09:09:27.879040+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:06.938535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694592+0000","last_change":"2024-04-25T09:09:26.912210+0000","last_active":"2024-04-25T09:09:28.694592+0000","last_peered":"2024-04-25T09:09:28.694592+0000","last_clean":"2024-04-25T09:09:28.694592+0000","last_became_active":"2024-04-25T09:09:26.911858+0000","last_became_peered":"2024-04-25T09:09:26.911858+0000","last_unstale":"2024-04-25T09:09:28.694592+0000","last_undegraded":"2024-04-25T09:09:28.694592+0000","last_fullsized":"2024-04-25T09:09:28.694592+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:09.501598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694050+0000","last_change":"2024-04-25T09:09:25.888456+0000","last_active":"2024-04-25T09:09:28.694050+0000","last_peered":"2024-04-25T09:09:28.694050+0000","last_clean":"2024-04-25T09:09:28.694050+0000","last_became_active":"2024-04-25T09:09:25.888121+0000","last_became_peered":"2024-04-25T09:09:25.888121+0000","last_unstale":"2024-04-25T09:09:28.694050+0000","last_undegraded":"2024-04-25T09:09:28.694050+0000","last_fullsized":"2024-04-25T09:09:28.694050+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:10.295905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878097+0000","last_change":"2024-04-25T09:09:26.893393+0000","last_active":"2024-04-25T09:09:27.878097+0000","last_peered":"2024-04-25T09:09:27.878097+0000","last_clean":"2024-04-25T09:09:27.878097+0000","last_became_active":"2024-04-25T09:09:26.892289+0000","last_became_peered":"2024-04-25T09:09:26.892289+0000","last_unstale":"2024-04-25T09:09:27.878097+0000","last_undegraded":"2024-04-25T09:09:27.878097+0000","last_fullsized":"2024-04-25T09:09:27.878097+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:06.636882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878720+0000","last_change":"2024-04-25T09:09:25.883924+0000","last_active":"2024-04-25T09:09:27.878720+0000","last_peered":"2024-04-25T09:09:27.878720+0000","last_clean":"2024-04-25T09:09:27.878720+0000","last_became_active":"2024-04-25T09:09:25.883059+0000","last_became_peered":"2024-04-25T09:09:25.883059+0000","last_unstale":"2024-04-25T09:09:27.878720+0000","last_undegraded":"2024-04-25T09:09:27.878720+0000","last_fullsized":"2024-04-25T09:09:27.878720+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:20.403420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694644+0000","last_change":"2024-04-25T09:09:26.890528+0000","last_active":"2024-04-25T09:09:28.694644+0000","last_peered":"2024-04-25T09:09:28.694644+0000","last_clean":"2024-04-25T09:09:28.694644+0000","last_became_active":"2024-04-25T09:09:26.889103+0000","last_became_peered":"2024-04-25T09:09:26.889103+0000","last_unstale":"2024-04-25T09:09:28.694644+0000","last_undegraded":"2024-04-25T09:09:28.694644+0000","last_fullsized":"2024-04-25T09:09:28.694644+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:15.833064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.897033+0000","last_change":"2024-04-25T09:09:25.895283+0000","last_active":"2024-04-25T09:09:25.897033+0000","last_peered":"2024-04-25T09:09:25.897033+0000","last_clean":"2024-04-25T09:09:25.897033+0000","last_became_active":"2024-04-25T09:09:25.894675+0000","last_became_peered":"2024-04-25T09:09:25.894675+0000","last_unstale":"2024-04-25T09:09:25.897033+0000","last_undegraded":"2024-04-25T09:09:25.897033+0000","last_fullsized":"2024-04-25T09:09:25.897033+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:54.808752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878253+0000","last_change":"2024-04-25T09:09:26.884176+0000","last_active":"2024-04-25T09:09:27.878253+0000","last_peered":"2024-04-25T09:09:27.878253+0000","last_clean":"2024-04-25T09:09:27.878253+0000","last_became_active":"2024-04-25T09:09:26.883416+0000","last_became_peered":"2024-04-25T09:09:26.883416+0000","last_unstale":"2024-04-25T09:09:27.878253+0000","last_undegraded":"2024-04-25T09:09:27.878253+0000","last_fullsized":"2024-04-25T09:09:27.878253+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:16.248502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"97'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.881364+0000","last_change":"2024-04-25T09:09:25.888575+0000","last_active":"2024-04-25T09:09:28.881364+0000","last_peered":"2024-04-25T09:09:28.881364+0000","last_clean":"2024-04-25T09:09:28.881364+0000","last_became_active":"2024-04-25T09:09:25.888130+0000","last_became_peered":"2024-04-25T09:09:25.888130+0000","last_unstale":"2024-04-25T09:09:28.881364+0000","last_undegraded":"2024-04-25T09:09:28.881364+0000","last_fullsized":"2024-04-25T09:09:28.881364+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:22.025116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878336+0000","last_change":"2024-04-25T09:09:26.907788+0000","last_active":"2024-04-25T09:09:27.878336+0000","last_peered":"2024-04-25T09:09:27.878336+0000","last_clean":"2024-04-25T09:09:27.878336+0000","last_became_active":"2024-04-25T09:09:26.907509+0000","last_became_peered":"2024-04-25T09:09:26.907509+0000","last_unstale":"2024-04-25T09:09:27.878336+0000","last_undegraded":"2024-04-25T09:09:27.878336+0000","last_fullsized":"2024-04-25T09:09:27.878336+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:59.022383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878920+0000","last_change":"2024-04-25T09:09:25.885545+0000","last_active":"2024-04-25T09:09:27.878920+0000","last_peered":"2024-04-25T09:09:27.878920+0000","last_clean":"2024-04-25T09:09:27.878920+0000","last_became_active":"2024-04-25T09:09:25.885204+0000","last_became_peered":"2024-04-25T09:09:25.885204+0000","last_unstale":"2024-04-25T09:09:27.878920+0000","last_undegraded":"2024-04-25T09:09:27.878920+0000","last_fullsized":"2024-04-25T09:09:27.878920+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:33.311698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694576+0000","last_change":"2024-04-25T09:09:26.891717+0000","last_active":"2024-04-25T09:09:28.694576+0000","last_peered":"2024-04-25T09:09:28.694576+0000","last_clean":"2024-04-25T09:09:28.694576+0000","last_became_active":"2024-04-25T09:09:26.891183+0000","last_became_peered":"2024-04-25T09:09:26.891183+0000","last_unstale":"2024-04-25T09:09:28.694576+0000","last_undegraded":"2024-04-25T09:09:28.694576+0000","last_fullsized":"2024-04-25T09:09:28.694576+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:15.833064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694888+0000","last_change":"2024-04-25T09:09:25.890769+0000","last_active":"2024-04-25T09:09:28.694888+0000","last_peered":"2024-04-25T09:09:28.694888+0000","last_clean":"2024-04-25T09:09:28.694888+0000","last_became_active":"2024-04-25T09:09:25.890367+0000","last_became_peered":"2024-04-25T09:09:25.890367+0000","last_unstale":"2024-04-25T09:09:28.694888+0000","last_undegraded":"2024-04-25T09:09:28.694888+0000","last_fullsized":"2024-04-25T09:09:28.694888+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:14.193442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878771+0000","last_change":"2024-04-25T09:09:26.899314+0000","last_active":"2024-04-25T09:09:27.878771+0000","last_peered":"2024-04-25T09:09:27.878771+0000","last_clean":"2024-04-25T09:09:27.878771+0000","last_became_active":"2024-04-25T09:09:26.898556+0000","last_became_peered":"2024-04-25T09:09:26.898556+0000","last_unstale":"2024-04-25T09:09:27.878771+0000","last_undegraded":"2024-04-25T09:09:27.878771+0000","last_fullsized":"2024-04-25T09:09:27.878771+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:14.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877854+0000","last_change":"2024-04-25T09:09:25.887331+0000","last_active":"2024-04-25T09:09:27.877854+0000","last_peered":"2024-04-25T09:09:27.877854+0000","last_clean":"2024-04-25T09:09:27.877854+0000","last_became_active":"2024-04-25T09:09:25.886093+0000","last_became_peered":"2024-04-25T09:09:25.886093+0000","last_unstale":"2024-04-25T09:09:27.877854+0000","last_undegraded":"2024-04-25T09:09:27.877854+0000","last_fullsized":"2024-04-25T09:09:27.877854+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:23:28.244528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694280+0000","last_change":"2024-04-25T09:09:26.910027+0000","last_active":"2024-04-25T09:09:28.694280+0000","last_peered":"2024-04-25T09:09:28.694280+0000","last_clean":"2024-04-25T09:09:28.694280+0000","last_became_active":"2024-04-25T09:09:26.909711+0000","last_became_peered":"2024-04-25T09:09:26.909711+0000","last_unstale":"2024-04-25T09:09:28.694280+0000","last_undegraded":"2024-04-25T09:09:28.694280+0000","last_fullsized":"2024-04-25T09:09:28.694280+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:27.191034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694700+0000","last_change":"2024-04-25T09:09:25.888899+0000","last_active":"2024-04-25T09:09:28.694700+0000","last_peered":"2024-04-25T09:09:28.694700+0000","last_clean":"2024-04-25T09:09:28.694700+0000","last_became_active":"2024-04-25T09:09:25.887727+0000","last_became_peered":"2024-04-25T09:09:25.887727+0000","last_unstale":"2024-04-25T09:09:28.694700+0000","last_undegraded":"2024-04-25T09:09:28.694700+0000","last_fullsized":"2024-04-25T09:09:28.694700+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:26.020961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694318+0000","last_change":"2024-04-25T09:09:26.911233+0000","last_active":"2024-04-25T09:09:28.694318+0000","last_peered":"2024-04-25T09:09:28.694318+0000","last_clean":"2024-04-25T09:09:28.694318+0000","last_became_active":"2024-04-25T09:09:26.910962+0000","last_became_peered":"2024-04-25T09:09:26.910962+0000","last_unstale":"2024-04-25T09:09:28.694318+0000","last_undegraded":"2024-04-25T09:09:28.694318+0000","last_fullsized":"2024-04-25T09:09:28.694318+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:47.875102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694383+0000","last_change":"2024-04-25T09:09:25.886416+0000","last_active":"2024-04-25T09:09:28.694383+0000","last_peered":"2024-04-25T09:09:28.694383+0000","last_clean":"2024-04-25T09:09:28.694383+0000","last_became_active":"2024-04-25T09:09:25.886138+0000","last_became_peered":"2024-04-25T09:09:25.886138+0000","last_unstale":"2024-04-25T09:09:28.694383+0000","last_undegraded":"2024-04-25T09:09:28.694383+0000","last_fullsized":"2024-04-25T09:09:28.694383+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:14.676493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877763+0000","last_change":"2024-04-25T09:09:26.895912+0000","last_active":"2024-04-25T09:09:27.877763+0000","last_peered":"2024-04-25T09:09:27.877763+0000","last_clean":"2024-04-25T09:09:27.877763+0000","last_became_active":"2024-04-25T09:09:26.894861+0000","last_became_peered":"2024-04-25T09:09:26.894861+0000","last_unstale":"2024-04-25T09:09:27.877763+0000","last_undegraded":"2024-04-25T09:09:27.877763+0000","last_fullsized":"2024-04-25T09:09:27.877763+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:20.609762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.897356+0000","last_change":"2024-04-25T09:09:25.896492+0000","last_active":"2024-04-25T09:09:25.897356+0000","last_peered":"2024-04-25T09:09:25.897356+0000","last_clean":"2024-04-25T09:09:25.897356+0000","last_became_active":"2024-04-25T09:09:25.896219+0000","last_became_peered":"2024-04-25T09:09:25.896219+0000","last_unstale":"2024-04-25T09:09:25.897356+0000","last_undegraded":"2024-04-25T09:09:25.897356+0000","last_fullsized":"2024-04-25T09:09:25.897356+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:44.101788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.882446+0000","last_change":"2024-04-25T09:09:25.882446+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.882446+0000","last_undegraded":"2024-04-25T09:09:25.882446+0000","last_fullsized":"2024-04-25T09:09:25.882446+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695290+0000","last_change":"2024-04-25T09:09:25.896662+0000","last_active":"2024-04-25T09:09:28.695290+0000","last_peered":"2024-04-25T09:09:28.695290+0000","last_clean":"2024-04-25T09:09:28.695290+0000","last_became_active":"2024-04-25T09:09:25.896367+0000","last_became_peered":"2024-04-25T09:09:25.896367+0000","last_unstale":"2024-04-25T09:09:28.695290+0000","last_undegraded":"2024-04-25T09:09:28.695290+0000","last_fullsized":"2024-04-25T09:09:28.695290+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:27.332997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":305,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.886563+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:09:25.886563+0000","last_peered":"2024-04-25T09:09:25.886563+0000","last_clean":"2024-04-25T09:09:25.886563+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:09:25.886563+0000","last_undegraded":"2024-04-25T09:09:25.886563+0000","last_fullsized":"2024-04-25T09:09:25.886563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2376,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509525,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50404,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321436,"statfs":{"total":96636764160,"available":96585150464,"internally_reserved":0,"allocated":1196032,"data_stored":545265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509525,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46224,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325616,"statfs":{"total":96636764160,"available":96589430784,"internally_reserved":0,"allocated":1175552,"data_stored":543049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509526,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54560,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317280,"statfs":{"total":96636764160,"available":96580894720,"internally_reserved":0,"allocated":1196032,"data_stored":549901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509525,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54540,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317300,"statfs":{"total":96636764160,"available":96580915200,"internally_reserved":0,"allocated":1175552,"data_stored":543049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509525,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50388,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321452,"statfs":{"total":96636764160,"available":96585166848,"internally_reserved":0,"allocated":1187840,"data_stored":549741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509526,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46236,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325604,"statfs":{"total":96636764160,"available":96589418496,"internally_reserved":0,"allocated":1191936,"data_stored":549811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509526,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50996,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320844,"statfs":{"total":96636764160,"available":96584544256,"internally_reserved":0,"allocated":1806336,"data_stored":1142427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574933,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46792,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325048,"statfs":{"total":96636764160,"available":96588849152,"internally_reserved":0,"allocated":1757184,"data_stored":1126250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:09:30.950 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:09:31.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.132+0000 7f2ecc800640 1 Processor -- start 2024-04-25T09:09:31.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.132+0000 7f2ecc800640 1 -- start start 2024-04-25T09:09:31.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.132+0000 7f2ecc800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2ec40cee20 0x7f2ec40cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.132+0000 7f2ecc800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec40b1340 0x7f2ec40b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.132+0000 7f2ecc800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec40b0bb0 con 0x7f2ec415e150 2024-04-25T09:09:31.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.132+0000 7f2ecc800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec40b1110 con 0x7f2ec40cee20 2024-04-25T09:09:31.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.132+0000 7f2ecc800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec40b0e30 con 0x7f2ec40b1340 2024-04-25T09:09:31.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.132+0000 7f2ec9400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2ec40cee20 0x7f2ec40cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.132+0000 7f2ec9400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2ec40cee20 0x7f2ec40cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42352/0 (socket says 172.21.15.173:42352) 2024-04-25T09:09:31.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.132+0000 7f2ec9400640 1 -- 172.21.15.173:0/260255896 learned_addr learned my addr 172.21.15.173:0/260255896 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:31.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.132+0000 7f2eca800640 1 --2- 172.21.15.173:0/260255896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec40b1340 0x7f2ec40b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.132+0000 7f2ec9400640 1 -- 172.21.15.173:0/260255896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec40b1340 msgr2=0x7f2ec40b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:31.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.132+0000 7f2ec9400640 1 --2- 172.21.15.173:0/260255896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec40b1340 0x7f2ec40b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.132+0000 7f2ec9400640 1 -- 172.21.15.173:0/260255896 >> v1:172.21.15.194:6789/0 conn(0x7f2ec415e150 legacy=0x7f2ec40ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:31.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.132+0000 7f2ec9400640 1 -- 172.21.15.173:0/260255896 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec40ae0c0 con 0x7f2ec40cee20 2024-04-25T09:09:31.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.136+0000 7f2ec9400640 1 --2- 172.21.15.173:0/260255896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ec40cee20 0x7f2ec40cb0f0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4009870 tx=0x7f2eb401c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e4fbf5231f88da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:31.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.136+0000 7f2ec8a00640 1 -- 172.21.15.173:0/260255896 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40b0070 con 0x7f2ec40cee20 2024-04-25T09:09:31.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.136+0000 7f2ec8a00640 1 -- 172.21.15.173:0/260255896 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb40ab600 con 0x7f2ec40cee20 2024-04-25T09:09:31.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.136+0000 7f2ec8a00640 1 -- 172.21.15.173:0/260255896 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40ab9d0 con 0x7f2ec40cee20 2024-04-25T09:09:31.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.136+0000 7f2ecc800640 1 -- 172.21.15.173:0/260255896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ec40cee20 msgr2=0x7f2ec40cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:31.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.136+0000 7f2ecc800640 1 --2- 172.21.15.173:0/260255896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ec40cee20 0x7f2ec40cb0f0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4009870 tx=0x7f2eb401c2b0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.136+0000 7f2ecc800640 1 -- 172.21.15.173:0/260255896 shutdown_connections 2024-04-25T09:09:31.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.136+0000 7f2ecc800640 1 --2- 172.21.15.173:0/260255896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec40b1340 0x7f2ec40b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.136+0000 7f2ecc800640 1 --2- 172.21.15.173:0/260255896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ec40cee20 0x7f2ec40cb0f0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.136+0000 7f2ecc800640 1 -- 172.21.15.173:0/260255896 >> 172.21.15.173:0/260255896 conn(0x7f2ec40b22a0 msgr2=0x7f2ec40b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:31.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.136+0000 7f2ecc800640 1 -- 172.21.15.173:0/260255896 shutdown_connections 2024-04-25T09:09:31.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.136+0000 7f2ecc800640 1 -- 172.21.15.173:0/260255896 wait complete. 2024-04-25T09:09:31.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ecc800640 1 Processor -- start 2024-04-25T09:09:31.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ecc800640 1 -- start start 2024-04-25T09:09:31.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ecc800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ec40b1340 0x7f2ec40ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ecc800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ec40cee20 0x7f2ec40c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ecc800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec415e150 0x7f2ec415b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ecc800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec41671e0 con 0x7f2ec40cee20 2024-04-25T09:09:31.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ecc800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec4167060 con 0x7f2ec40b1340 2024-04-25T09:09:31.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ecc800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec4167360 con 0x7f2ec415e150 2024-04-25T09:09:31.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ec9400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ec40cee20 0x7f2ec40c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ec9400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ec40cee20 0x7f2ec40c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42356/0 (socket says 172.21.15.173:42356) 2024-04-25T09:09:31.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ec9400640 1 -- 172.21.15.173:0/2898650158 learned_addr learned my addr 172.21.15.173:0/2898650158 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:31.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2eca800640 1 --2- 172.21.15.173:0/2898650158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec415e150 0x7f2ec415b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ec9e00640 1 --2- 172.21.15.173:0/2898650158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ec40b1340 0x7f2ec40ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ec9400640 1 -- 172.21.15.173:0/2898650158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec415e150 msgr2=0x7f2ec415b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:31.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ec9400640 1 --2- 172.21.15.173:0/2898650158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec415e150 0x7f2ec415b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ec9400640 1 -- 172.21.15.173:0/2898650158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ec40b1340 msgr2=0x7f2ec40ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:31.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ec9400640 1 --2- 172.21.15.173:0/2898650158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ec40b1340 0x7f2ec40ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ec9400640 1 -- 172.21.15.173:0/2898650158 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec40c9230 con 0x7f2ec40cee20 2024-04-25T09:09:31.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ec9e00640 1 --2- 172.21.15.173:0/2898650158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ec40b1340 0x7f2ec40ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:31.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2eca800640 1 --2- 172.21.15.173:0/2898650158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec415e150 0x7f2ec415b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:31.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ec9400640 1 --2- 172.21.15.173:0/2898650158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ec40cee20 0x7f2ec40c81a0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f2eb40ae040 tx=0x7f2eb401aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:31.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ebe000640 1 -- 172.21.15.173:0/2898650158 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40ba020 con 0x7f2ec40cee20 2024-04-25T09:09:31.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ebe000640 1 -- 172.21.15.173:0/2898650158 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb40b6620 con 0x7f2ec40cee20 2024-04-25T09:09:31.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ecc800640 1 -- 172.21.15.173:0/2898650158 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec40c9510 con 0x7f2ec40cee20 2024-04-25T09:09:31.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ebe000640 1 -- 172.21.15.173:0/2898650158 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40b0040 con 0x7f2ec40cee20 2024-04-25T09:09:31.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.140+0000 7f2ecc800640 1 -- 172.21.15.173:0/2898650158 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec40c9ad0 con 0x7f2ec40cee20 2024-04-25T09:09:31.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.144+0000 7f2ecc800640 1 -- 172.21.15.173:0/2898650158 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec406cd30 con 0x7f2ec40cee20 2024-04-25T09:09:31.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.144+0000 7f2ebe000640 1 -- 172.21.15.173:0/2898650158 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2eb40bd020 con 0x7f2ec40cee20 2024-04-25T09:09:31.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.144+0000 7f2ebe000640 1 --2- 172.21.15.173:0/2898650158 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2ea8066f60 0x7f2ea8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.144+0000 7f2ebe000640 1 -- 172.21.15.173:0/2898650158 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2eb411f310 con 0x7f2ec40cee20 2024-04-25T09:09:31.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.144+0000 7f2ec9e00640 1 --2- 172.21.15.173:0/2898650158 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2ea8066f60 0x7f2ea8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.144+0000 7f2ec9e00640 1 --2- 172.21.15.173:0/2898650158 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2ea8066f60 0x7f2ea8069420 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8003ec0 tx=0x7f2eb8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:31.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.148+0000 7f2ebe000640 1 -- 172.21.15.173:0/2898650158 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2eb40c4030 con 0x7f2ec40cee20 2024-04-25T09:09:31.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.296+0000 7f2ecc800640 1 -- 172.21.15.173:0/2898650158 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ec40cfbf0 con 0x7f2ea8066f60 2024-04-25T09:09:31.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.304+0000 7f2ebe000640 1 -- 172.21.15.173:0/2898650158 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251651 (secure 0 0 0) 0x7f2eb8056720 con 0x7f2ea8066f60 2024-04-25T09:09:31.295 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:31.296 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:09:31.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.308+0000 7f2ecc800640 1 -- 172.21.15.173:0/2898650158 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2ea8066f60 msgr2=0x7f2ea8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:31.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.308+0000 7f2ecc800640 1 --2- 172.21.15.173:0/2898650158 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2ea8066f60 0x7f2ea8069420 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8003ec0 tx=0x7f2eb8009040 comp rx=0 tx=0).stop 2024-04-25T09:09:31.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.308+0000 7f2ecc800640 1 -- 172.21.15.173:0/2898650158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ec40cee20 msgr2=0x7f2ec40c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:31.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.308+0000 7f2ecc800640 1 --2- 172.21.15.173:0/2898650158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ec40cee20 0x7f2ec40c81a0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f2eb40ae040 tx=0x7f2eb401aaf0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.308+0000 7f2ecc800640 1 -- 172.21.15.173:0/2898650158 shutdown_connections 2024-04-25T09:09:31.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.308+0000 7f2ecc800640 1 --2- 172.21.15.173:0/2898650158 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2ea8066f60 0x7f2ea8069420 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.308+0000 7f2ecc800640 1 --2- 172.21.15.173:0/2898650158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec415e150 0x7f2ec415b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.308+0000 7f2ecc800640 1 --2- 172.21.15.173:0/2898650158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ec40cee20 0x7f2ec40c81a0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.308+0000 7f2ecc800640 1 --2- 172.21.15.173:0/2898650158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ec40b1340 0x7f2ec40ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.308+0000 7f2ecc800640 1 -- 172.21.15.173:0/2898650158 >> 172.21.15.173:0/2898650158 conn(0x7f2ec40b22a0 msgr2=0x7f2ec40aef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:31.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.308+0000 7f2ecc800640 1 -- 172.21.15.173:0/2898650158 shutdown_connections 2024-04-25T09:09:31.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.308+0000 7f2ecc800640 1 -- 172.21.15.173:0/2898650158 wait complete. 2024-04-25T09:09:31.315 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2024-04-25T09:09:30.815176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592744,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400140,"kb_used_data":10436,"kb_used_omap":12,"kb_used_meta":389555,"kb_avail":754574580,"statfs":{"total":773094113280,"available":772684369920,"internally_reserved":0,"allocated":10686464,"data_stored":5549493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":398904880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2376,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.951964"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694625+0000","last_change":"2024-04-25T09:09:26.896499+0000","last_active":"2024-04-25T09:09:28.694625+0000","last_peered":"2024-04-25T09:09:28.694625+0000","last_clean":"2024-04-25T09:09:28.694625+0000","last_became_active":"2024-04-25T09:09:26.896226+0000","last_became_peered":"2024-04-25T09:09:26.896226+0000","last_unstale":"2024-04-25T09:09:28.694625+0000","last_undegraded":"2024-04-25T09:09:28.694625+0000","last_fullsized":"2024-04-25T09:09:28.694625+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:50.131196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694036+0000","last_change":"2024-04-25T09:09:26.897460+0000","last_active":"2024-04-25T09:09:28.694036+0000","last_peered":"2024-04-25T09:09:28.694036+0000","last_clean":"2024-04-25T09:09:28.694036+0000","last_became_active":"2024-04-25T09:09:26.897103+0000","last_became_peered":"2024-04-25T09:09:26.897103+0000","last_unstale":"2024-04-25T09:09:28.694036+0000","last_undegraded":"2024-04-25T09:09:28.694036+0000","last_fullsized":"2024-04-25T09:09:28.694036+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:21.216175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694439+0000","last_change":"2024-04-25T09:09:26.893748+0000","last_active":"2024-04-25T09:09:28.694439+0000","last_peered":"2024-04-25T09:09:28.694439+0000","last_clean":"2024-04-25T09:09:28.694439+0000","last_became_active":"2024-04-25T09:09:26.893515+0000","last_became_peered":"2024-04-25T09:09:26.893515+0000","last_unstale":"2024-04-25T09:09:28.694439+0000","last_undegraded":"2024-04-25T09:09:28.694439+0000","last_fullsized":"2024-04-25T09:09:28.694439+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:42.021859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694920+0000","last_change":"2024-04-25T09:09:26.910061+0000","last_active":"2024-04-25T09:09:28.694920+0000","last_peered":"2024-04-25T09:09:28.694920+0000","last_clean":"2024-04-25T09:09:28.694920+0000","last_became_active":"2024-04-25T09:09:26.909795+0000","last_became_peered":"2024-04-25T09:09:26.909795+0000","last_unstale":"2024-04-25T09:09:28.694920+0000","last_undegraded":"2024-04-25T09:09:28.694920+0000","last_fullsized":"2024-04-25T09:09:28.694920+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:05.780038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878204+0000","last_change":"2024-04-25T09:09:26.882500+0000","last_active":"2024-04-25T09:09:27.878204+0000","last_peered":"2024-04-25T09:09:27.878204+0000","last_clean":"2024-04-25T09:09:27.878204+0000","last_became_active":"2024-04-25T09:09:26.882178+0000","last_became_peered":"2024-04-25T09:09:26.882178+0000","last_unstale":"2024-04-25T09:09:27.878204+0000","last_undegraded":"2024-04-25T09:09:27.878204+0000","last_fullsized":"2024-04-25T09:09:27.878204+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:11.302067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877603+0000","last_change":"2024-04-25T09:09:26.913022+0000","last_active":"2024-04-25T09:09:27.877603+0000","last_peered":"2024-04-25T09:09:27.877603+0000","last_clean":"2024-04-25T09:09:27.877603+0000","last_became_active":"2024-04-25T09:09:26.912555+0000","last_became_peered":"2024-04-25T09:09:26.912555+0000","last_unstale":"2024-04-25T09:09:27.877603+0000","last_undegraded":"2024-04-25T09:09:27.877603+0000","last_fullsized":"2024-04-25T09:09:27.877603+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:09.924416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.882866+0000","last_change":"2024-04-25T09:09:25.882866+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.882866+0000","last_undegraded":"2024-04-25T09:09:25.882866+0000","last_fullsized":"2024-04-25T09:09:25.882866+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694274+0000","last_change":"2024-04-25T09:09:26.914654+0000","last_active":"2024-04-25T09:09:28.694274+0000","last_peered":"2024-04-25T09:09:28.694274+0000","last_clean":"2024-04-25T09:09:28.694274+0000","last_became_active":"2024-04-25T09:09:26.914011+0000","last_became_peered":"2024-04-25T09:09:26.914011+0000","last_unstale":"2024-04-25T09:09:28.694274+0000","last_undegraded":"2024-04-25T09:09:28.694274+0000","last_fullsized":"2024-04-25T09:09:28.694274+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:54.978670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878504+0000","last_change":"2024-04-25T09:09:26.892861+0000","last_active":"2024-04-25T09:09:27.878504+0000","last_peered":"2024-04-25T09:09:27.878504+0000","last_clean":"2024-04-25T09:09:27.878504+0000","last_became_active":"2024-04-25T09:09:26.892013+0000","last_became_peered":"2024-04-25T09:09:26.892013+0000","last_unstale":"2024-04-25T09:09:27.878504+0000","last_undegraded":"2024-04-25T09:09:27.878504+0000","last_fullsized":"2024-04-25T09:09:27.878504+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:27.027122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879193+0000","last_change":"2024-04-25T09:09:26.917328+0000","last_active":"2024-04-25T09:09:27.879193+0000","last_peered":"2024-04-25T09:09:27.879193+0000","last_clean":"2024-04-25T09:09:27.879193+0000","last_became_active":"2024-04-25T09:09:26.916317+0000","last_became_peered":"2024-04-25T09:09:26.916317+0000","last_unstale":"2024-04-25T09:09:27.879193+0000","last_undegraded":"2024-04-25T09:09:27.879193+0000","last_fullsized":"2024-04-25T09:09:27.879193+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:25.900567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878527+0000","last_change":"2024-04-25T09:09:26.893466+0000","last_active":"2024-04-25T09:09:27.878527+0000","last_peered":"2024-04-25T09:09:27.878527+0000","last_clean":"2024-04-25T09:09:27.878527+0000","last_became_active":"2024-04-25T09:09:26.893066+0000","last_became_peered":"2024-04-25T09:09:26.893066+0000","last_unstale":"2024-04-25T09:09:27.878527+0000","last_undegraded":"2024-04-25T09:09:27.878527+0000","last_fullsized":"2024-04-25T09:09:27.878527+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:30.604324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879051+0000","last_change":"2024-04-25T09:09:26.895964+0000","last_active":"2024-04-25T09:09:27.879051+0000","last_peered":"2024-04-25T09:09:27.879051+0000","last_clean":"2024-04-25T09:09:27.879051+0000","last_became_active":"2024-04-25T09:09:26.895695+0000","last_became_peered":"2024-04-25T09:09:26.895695+0000","last_unstale":"2024-04-25T09:09:27.879051+0000","last_undegraded":"2024-04-25T09:09:27.879051+0000","last_fullsized":"2024-04-25T09:09:27.879051+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:51.062011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694360+0000","last_change":"2024-04-25T09:09:26.913085+0000","last_active":"2024-04-25T09:09:28.694360+0000","last_peered":"2024-04-25T09:09:28.694360+0000","last_clean":"2024-04-25T09:09:28.694360+0000","last_became_active":"2024-04-25T09:09:26.912780+0000","last_became_peered":"2024-04-25T09:09:26.912780+0000","last_unstale":"2024-04-25T09:09:28.694360+0000","last_undegraded":"2024-04-25T09:09:28.694360+0000","last_fullsized":"2024-04-25T09:09:28.694360+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:11.765250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877970+0000","last_change":"2024-04-25T09:09:26.911169+0000","last_active":"2024-04-25T09:09:27.877970+0000","last_peered":"2024-04-25T09:09:27.877970+0000","last_clean":"2024-04-25T09:09:27.877970+0000","last_became_active":"2024-04-25T09:09:26.910649+0000","last_became_peered":"2024-04-25T09:09:26.910649+0000","last_unstale":"2024-04-25T09:09:27.877970+0000","last_undegraded":"2024-04-25T09:09:27.877970+0000","last_fullsized":"2024-04-25T09:09:27.877970+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:43.383066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694367+0000","last_change":"2024-04-25T09:09:26.909778+0000","last_active":"2024-04-25T09:09:28.694367+0000","last_peered":"2024-04-25T09:09:28.694367+0000","last_clean":"2024-04-25T09:09:28.694367+0000","last_became_active":"2024-04-25T09:09:26.909495+0000","last_became_peered":"2024-04-25T09:09:26.909495+0000","last_unstale":"2024-04-25T09:09:28.694367+0000","last_undegraded":"2024-04-25T09:09:28.694367+0000","last_fullsized":"2024-04-25T09:09:28.694367+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:15.564347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877754+0000","last_change":"2024-04-25T09:09:26.890288+0000","last_active":"2024-04-25T09:09:27.877754+0000","last_peered":"2024-04-25T09:09:27.877754+0000","last_clean":"2024-04-25T09:09:27.877754+0000","last_became_active":"2024-04-25T09:09:26.889997+0000","last_became_peered":"2024-04-25T09:09:26.889997+0000","last_unstale":"2024-04-25T09:09:27.877754+0000","last_undegraded":"2024-04-25T09:09:27.877754+0000","last_fullsized":"2024-04-25T09:09:27.877754+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:46.747064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878504+0000","last_change":"2024-04-25T09:09:26.890210+0000","last_active":"2024-04-25T09:09:27.878504+0000","last_peered":"2024-04-25T09:09:27.878504+0000","last_clean":"2024-04-25T09:09:27.878504+0000","last_became_active":"2024-04-25T09:09:26.889939+0000","last_became_peered":"2024-04-25T09:09:26.889939+0000","last_unstale":"2024-04-25T09:09:27.878504+0000","last_undegraded":"2024-04-25T09:09:27.878504+0000","last_fullsized":"2024-04-25T09:09:27.878504+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:23.740183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694624+0000","last_change":"2024-04-25T09:09:26.893150+0000","last_active":"2024-04-25T09:09:28.694624+0000","last_peered":"2024-04-25T09:09:28.694624+0000","last_clean":"2024-04-25T09:09:28.694624+0000","last_became_active":"2024-04-25T09:09:26.892878+0000","last_became_peered":"2024-04-25T09:09:26.892878+0000","last_unstale":"2024-04-25T09:09:28.694624+0000","last_undegraded":"2024-04-25T09:09:28.694624+0000","last_fullsized":"2024-04-25T09:09:28.694624+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:12.002802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878727+0000","last_change":"2024-04-25T09:09:26.907546+0000","last_active":"2024-04-25T09:09:27.878727+0000","last_peered":"2024-04-25T09:09:27.878727+0000","last_clean":"2024-04-25T09:09:27.878727+0000","last_became_active":"2024-04-25T09:09:26.907067+0000","last_became_peered":"2024-04-25T09:09:26.907067+0000","last_unstale":"2024-04-25T09:09:27.878727+0000","last_undegraded":"2024-04-25T09:09:27.878727+0000","last_fullsized":"2024-04-25T09:09:27.878727+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:16.612907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695210+0000","last_change":"2024-04-25T09:09:26.915859+0000","last_active":"2024-04-25T09:09:28.695210+0000","last_peered":"2024-04-25T09:09:28.695210+0000","last_clean":"2024-04-25T09:09:28.695210+0000","last_became_active":"2024-04-25T09:09:26.915582+0000","last_became_peered":"2024-04-25T09:09:26.915582+0000","last_unstale":"2024-04-25T09:09:28.695210+0000","last_undegraded":"2024-04-25T09:09:28.695210+0000","last_fullsized":"2024-04-25T09:09:28.695210+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:36.548327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878530+0000","last_change":"2024-04-25T09:09:26.889501+0000","last_active":"2024-04-25T09:09:27.878530+0000","last_peered":"2024-04-25T09:09:27.878530+0000","last_clean":"2024-04-25T09:09:27.878530+0000","last_became_active":"2024-04-25T09:09:26.889203+0000","last_became_peered":"2024-04-25T09:09:26.889203+0000","last_unstale":"2024-04-25T09:09:27.878530+0000","last_undegraded":"2024-04-25T09:09:27.878530+0000","last_fullsized":"2024-04-25T09:09:27.878530+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:47.910831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878007+0000","last_change":"2024-04-25T09:09:26.911728+0000","last_active":"2024-04-25T09:09:27.878007+0000","last_peered":"2024-04-25T09:09:27.878007+0000","last_clean":"2024-04-25T09:09:27.878007+0000","last_became_active":"2024-04-25T09:09:26.911326+0000","last_became_peered":"2024-04-25T09:09:26.911326+0000","last_unstale":"2024-04-25T09:09:27.878007+0000","last_undegraded":"2024-04-25T09:09:27.878007+0000","last_fullsized":"2024-04-25T09:09:27.878007+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:04.056308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694105+0000","last_change":"2024-04-25T09:09:26.911084+0000","last_active":"2024-04-25T09:09:28.694105+0000","last_peered":"2024-04-25T09:09:28.694105+0000","last_clean":"2024-04-25T09:09:28.694105+0000","last_became_active":"2024-04-25T09:09:26.910797+0000","last_became_peered":"2024-04-25T09:09:26.910797+0000","last_unstale":"2024-04-25T09:09:28.694105+0000","last_undegraded":"2024-04-25T09:09:28.694105+0000","last_fullsized":"2024-04-25T09:09:28.694105+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:39.999904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694346+0000","last_change":"2024-04-25T09:09:26.892545+0000","last_active":"2024-04-25T09:09:28.694346+0000","last_peered":"2024-04-25T09:09:28.694346+0000","last_clean":"2024-04-25T09:09:28.694346+0000","last_became_active":"2024-04-25T09:09:26.892292+0000","last_became_peered":"2024-04-25T09:09:26.892292+0000","last_unstale":"2024-04-25T09:09:28.694346+0000","last_undegraded":"2024-04-25T09:09:28.694346+0000","last_fullsized":"2024-04-25T09:09:28.694346+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:45.556771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694403+0000","last_change":"2024-04-25T09:09:26.891490+0000","last_active":"2024-04-25T09:09:28.694403+0000","last_peered":"2024-04-25T09:09:28.694403+0000","last_clean":"2024-04-25T09:09:28.694403+0000","last_became_active":"2024-04-25T09:09:26.890866+0000","last_became_peered":"2024-04-25T09:09:26.890866+0000","last_unstale":"2024-04-25T09:09:28.694403+0000","last_undegraded":"2024-04-25T09:09:28.694403+0000","last_fullsized":"2024-04-25T09:09:28.694403+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:47.875102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878629+0000","last_change":"2024-04-25T09:09:26.915924+0000","last_active":"2024-04-25T09:09:27.878629+0000","last_peered":"2024-04-25T09:09:27.878629+0000","last_clean":"2024-04-25T09:09:27.878629+0000","last_became_active":"2024-04-25T09:09:26.915617+0000","last_became_peered":"2024-04-25T09:09:26.915617+0000","last_unstale":"2024-04-25T09:09:27.878629+0000","last_undegraded":"2024-04-25T09:09:27.878629+0000","last_fullsized":"2024-04-25T09:09:27.878629+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:46.270829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879087+0000","last_change":"2024-04-25T09:09:26.900162+0000","last_active":"2024-04-25T09:09:27.879087+0000","last_peered":"2024-04-25T09:09:27.879087+0000","last_clean":"2024-04-25T09:09:27.879087+0000","last_became_active":"2024-04-25T09:09:26.899697+0000","last_became_peered":"2024-04-25T09:09:26.899697+0000","last_unstale":"2024-04-25T09:09:27.879087+0000","last_undegraded":"2024-04-25T09:09:27.879087+0000","last_fullsized":"2024-04-25T09:09:27.879087+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:41.618620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695320+0000","last_change":"2024-04-25T09:09:26.909249+0000","last_active":"2024-04-25T09:09:28.695320+0000","last_peered":"2024-04-25T09:09:28.695320+0000","last_clean":"2024-04-25T09:09:28.695320+0000","last_became_active":"2024-04-25T09:09:26.908995+0000","last_became_peered":"2024-04-25T09:09:26.908995+0000","last_unstale":"2024-04-25T09:09:28.695320+0000","last_undegraded":"2024-04-25T09:09:28.695320+0000","last_fullsized":"2024-04-25T09:09:28.695320+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:48.941318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.882413+0000","last_change":"2024-04-25T09:09:25.882413+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.882413+0000","last_undegraded":"2024-04-25T09:09:25.882413+0000","last_fullsized":"2024-04-25T09:09:25.882413+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878423+0000","last_change":"2024-04-25T09:09:26.892277+0000","last_active":"2024-04-25T09:09:27.878423+0000","last_peered":"2024-04-25T09:09:27.878423+0000","last_clean":"2024-04-25T09:09:27.878423+0000","last_became_active":"2024-04-25T09:09:26.891967+0000","last_became_peered":"2024-04-25T09:09:26.891967+0000","last_unstale":"2024-04-25T09:09:27.878423+0000","last_undegraded":"2024-04-25T09:09:27.878423+0000","last_fullsized":"2024-04-25T09:09:27.878423+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:15.199604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694617+0000","last_change":"2024-04-25T09:09:26.912200+0000","last_active":"2024-04-25T09:09:28.694617+0000","last_peered":"2024-04-25T09:09:28.694617+0000","last_clean":"2024-04-25T09:09:28.694617+0000","last_became_active":"2024-04-25T09:09:26.911878+0000","last_became_peered":"2024-04-25T09:09:26.911878+0000","last_unstale":"2024-04-25T09:09:28.694617+0000","last_undegraded":"2024-04-25T09:09:28.694617+0000","last_fullsized":"2024-04-25T09:09:28.694617+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:56.330021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877597+0000","last_change":"2024-04-25T09:09:26.890855+0000","last_active":"2024-04-25T09:09:27.877597+0000","last_peered":"2024-04-25T09:09:27.877597+0000","last_clean":"2024-04-25T09:09:27.877597+0000","last_became_active":"2024-04-25T09:09:26.890600+0000","last_became_peered":"2024-04-25T09:09:26.890600+0000","last_unstale":"2024-04-25T09:09:27.877597+0000","last_undegraded":"2024-04-25T09:09:27.877597+0000","last_fullsized":"2024-04-25T09:09:27.877597+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:29.370531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877890+0000","last_change":"2024-04-25T09:09:26.884423+0000","last_active":"2024-04-25T09:09:27.877890+0000","last_peered":"2024-04-25T09:09:27.877890+0000","last_clean":"2024-04-25T09:09:27.877890+0000","last_became_active":"2024-04-25T09:09:26.884029+0000","last_became_peered":"2024-04-25T09:09:26.884029+0000","last_unstale":"2024-04-25T09:09:27.877890+0000","last_undegraded":"2024-04-25T09:09:27.877890+0000","last_fullsized":"2024-04-25T09:09:27.877890+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:09.825442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"96'4","reported_seq":18,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695112+0000","last_change":"2024-04-25T09:09:25.891328+0000","last_active":"2024-04-25T09:09:28.695112+0000","last_peered":"2024-04-25T09:09:28.695112+0000","last_clean":"2024-04-25T09:09:28.695112+0000","last_became_active":"2024-04-25T09:09:25.891055+0000","last_became_peered":"2024-04-25T09:09:25.891055+0000","last_unstale":"2024-04-25T09:09:28.695112+0000","last_undegraded":"2024-04-25T09:09:28.695112+0000","last_fullsized":"2024-04-25T09:09:28.695112+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:26.020961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878066+0000","last_change":"2024-04-25T09:09:26.901370+0000","last_active":"2024-04-25T09:09:27.878066+0000","last_peered":"2024-04-25T09:09:27.878066+0000","last_clean":"2024-04-25T09:09:27.878066+0000","last_became_active":"2024-04-25T09:09:26.901014+0000","last_became_peered":"2024-04-25T09:09:26.901014+0000","last_unstale":"2024-04-25T09:09:27.878066+0000","last_undegraded":"2024-04-25T09:09:27.878066+0000","last_fullsized":"2024-04-25T09:09:27.878066+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:54.558905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878756+0000","last_change":"2024-04-25T09:09:25.891301+0000","last_active":"2024-04-25T09:09:27.878756+0000","last_peered":"2024-04-25T09:09:27.878756+0000","last_clean":"2024-04-25T09:09:27.878756+0000","last_became_active":"2024-04-25T09:09:25.891027+0000","last_became_peered":"2024-04-25T09:09:25.891027+0000","last_unstale":"2024-04-25T09:09:27.878756+0000","last_undegraded":"2024-04-25T09:09:27.878756+0000","last_fullsized":"2024-04-25T09:09:27.878756+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:29.460046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.883382+0000","last_change":"2024-04-25T09:09:25.883382+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.883382+0000","last_undegraded":"2024-04-25T09:09:25.883382+0000","last_fullsized":"2024-04-25T09:09:25.883382+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.896967+0000","last_change":"2024-04-25T09:09:25.895316+0000","last_active":"2024-04-25T09:09:25.896967+0000","last_peered":"2024-04-25T09:09:25.896967+0000","last_clean":"2024-04-25T09:09:25.896967+0000","last_became_active":"2024-04-25T09:09:25.895025+0000","last_became_peered":"2024-04-25T09:09:25.895025+0000","last_unstale":"2024-04-25T09:09:25.896967+0000","last_undegraded":"2024-04-25T09:09:25.896967+0000","last_fullsized":"2024-04-25T09:09:25.896967+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:12.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878561+0000","last_change":"2024-04-25T09:09:26.893173+0000","last_active":"2024-04-25T09:09:27.878561+0000","last_peered":"2024-04-25T09:09:27.878561+0000","last_clean":"2024-04-25T09:09:27.878561+0000","last_became_active":"2024-04-25T09:09:26.892420+0000","last_became_peered":"2024-04-25T09:09:26.892420+0000","last_unstale":"2024-04-25T09:09:27.878561+0000","last_undegraded":"2024-04-25T09:09:27.878561+0000","last_fullsized":"2024-04-25T09:09:27.878561+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:20.008848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694910+0000","last_change":"2024-04-25T09:09:25.893538+0000","last_active":"2024-04-25T09:09:28.694910+0000","last_peered":"2024-04-25T09:09:28.694910+0000","last_clean":"2024-04-25T09:09:28.694910+0000","last_became_active":"2024-04-25T09:09:25.893014+0000","last_became_peered":"2024-04-25T09:09:25.893014+0000","last_unstale":"2024-04-25T09:09:28.694910+0000","last_undegraded":"2024-04-25T09:09:28.694910+0000","last_fullsized":"2024-04-25T09:09:28.694910+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:10.295905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694427+0000","last_change":"2024-04-25T09:09:26.909690+0000","last_active":"2024-04-25T09:09:28.694427+0000","last_peered":"2024-04-25T09:09:28.694427+0000","last_clean":"2024-04-25T09:09:28.694427+0000","last_became_active":"2024-04-25T09:09:26.909399+0000","last_became_peered":"2024-04-25T09:09:26.909399+0000","last_unstale":"2024-04-25T09:09:28.694427+0000","last_undegraded":"2024-04-25T09:09:28.694427+0000","last_fullsized":"2024-04-25T09:09:28.694427+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:53.115977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878346+0000","last_change":"2024-04-25T09:09:25.888297+0000","last_active":"2024-04-25T09:09:27.878346+0000","last_peered":"2024-04-25T09:09:27.878346+0000","last_clean":"2024-04-25T09:09:27.878346+0000","last_became_active":"2024-04-25T09:09:25.887706+0000","last_became_peered":"2024-04-25T09:09:25.887706+0000","last_unstale":"2024-04-25T09:09:27.878346+0000","last_undegraded":"2024-04-25T09:09:27.878346+0000","last_fullsized":"2024-04-25T09:09:27.878346+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:00.496547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694277+0000","last_change":"2024-04-25T09:09:26.894500+0000","last_active":"2024-04-25T09:09:28.694277+0000","last_peered":"2024-04-25T09:09:28.694277+0000","last_clean":"2024-04-25T09:09:28.694277+0000","last_became_active":"2024-04-25T09:09:26.893339+0000","last_became_peered":"2024-04-25T09:09:26.893339+0000","last_unstale":"2024-04-25T09:09:28.694277+0000","last_undegraded":"2024-04-25T09:09:28.694277+0000","last_fullsized":"2024-04-25T09:09:28.694277+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:21.216175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695215+0000","last_change":"2024-04-25T09:09:25.888636+0000","last_active":"2024-04-25T09:09:28.695215+0000","last_peered":"2024-04-25T09:09:28.695215+0000","last_clean":"2024-04-25T09:09:28.695215+0000","last_became_active":"2024-04-25T09:09:25.888332+0000","last_became_peered":"2024-04-25T09:09:25.888332+0000","last_unstale":"2024-04-25T09:09:28.695215+0000","last_undegraded":"2024-04-25T09:09:28.695215+0000","last_fullsized":"2024-04-25T09:09:28.695215+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:59.063251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878062+0000","last_change":"2024-04-25T09:09:26.912804+0000","last_active":"2024-04-25T09:09:27.878062+0000","last_peered":"2024-04-25T09:09:27.878062+0000","last_clean":"2024-04-25T09:09:27.878062+0000","last_became_active":"2024-04-25T09:09:26.912208+0000","last_became_peered":"2024-04-25T09:09:26.912208+0000","last_unstale":"2024-04-25T09:09:27.878062+0000","last_undegraded":"2024-04-25T09:09:27.878062+0000","last_fullsized":"2024-04-25T09:09:27.878062+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:33:39.777394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694925+0000","last_change":"2024-04-25T09:09:25.891312+0000","last_active":"2024-04-25T09:09:28.694925+0000","last_peered":"2024-04-25T09:09:28.694925+0000","last_clean":"2024-04-25T09:09:28.694925+0000","last_became_active":"2024-04-25T09:09:25.890959+0000","last_became_peered":"2024-04-25T09:09:25.890959+0000","last_unstale":"2024-04-25T09:09:28.694925+0000","last_undegraded":"2024-04-25T09:09:28.694925+0000","last_fullsized":"2024-04-25T09:09:28.694925+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:12.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694573+0000","last_change":"2024-04-25T09:09:26.907307+0000","last_active":"2024-04-25T09:09:28.694573+0000","last_peered":"2024-04-25T09:09:28.694573+0000","last_clean":"2024-04-25T09:09:28.694573+0000","last_became_active":"2024-04-25T09:09:26.907053+0000","last_became_peered":"2024-04-25T09:09:26.907053+0000","last_unstale":"2024-04-25T09:09:28.694573+0000","last_undegraded":"2024-04-25T09:09:28.694573+0000","last_fullsized":"2024-04-25T09:09:28.694573+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:48.603667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.896738+0000","last_change":"2024-04-25T09:09:25.893856+0000","last_active":"2024-04-25T09:09:25.896738+0000","last_peered":"2024-04-25T09:09:25.896738+0000","last_clean":"2024-04-25T09:09:25.896738+0000","last_became_active":"2024-04-25T09:09:25.893562+0000","last_became_peered":"2024-04-25T09:09:25.893562+0000","last_unstale":"2024-04-25T09:09:25.896738+0000","last_undegraded":"2024-04-25T09:09:25.896738+0000","last_fullsized":"2024-04-25T09:09:25.896738+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:19.211371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878454+0000","last_change":"2024-04-25T09:09:26.895908+0000","last_active":"2024-04-25T09:09:27.878454+0000","last_peered":"2024-04-25T09:09:27.878454+0000","last_clean":"2024-04-25T09:09:27.878454+0000","last_became_active":"2024-04-25T09:09:26.895544+0000","last_became_peered":"2024-04-25T09:09:26.895544+0000","last_unstale":"2024-04-25T09:09:27.878454+0000","last_undegraded":"2024-04-25T09:09:27.878454+0000","last_fullsized":"2024-04-25T09:09:27.878454+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:15.682654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694584+0000","last_change":"2024-04-25T09:09:25.892399+0000","last_active":"2024-04-25T09:09:28.694584+0000","last_peered":"2024-04-25T09:09:28.694584+0000","last_clean":"2024-04-25T09:09:28.694584+0000","last_became_active":"2024-04-25T09:09:25.892107+0000","last_became_peered":"2024-04-25T09:09:25.892107+0000","last_unstale":"2024-04-25T09:09:28.694584+0000","last_undegraded":"2024-04-25T09:09:28.694584+0000","last_fullsized":"2024-04-25T09:09:28.694584+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:14.676493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.882297+0000","last_change":"2024-04-25T09:09:25.882297+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.882297+0000","last_undegraded":"2024-04-25T09:09:25.882297+0000","last_fullsized":"2024-04-25T09:09:25.882297+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694758+0000","last_change":"2024-04-25T09:09:25.891693+0000","last_active":"2024-04-25T09:09:28.694758+0000","last_peered":"2024-04-25T09:09:28.694758+0000","last_clean":"2024-04-25T09:09:28.694758+0000","last_became_active":"2024-04-25T09:09:25.891465+0000","last_became_peered":"2024-04-25T09:09:25.891465+0000","last_unstale":"2024-04-25T09:09:28.694758+0000","last_undegraded":"2024-04-25T09:09:28.694758+0000","last_fullsized":"2024-04-25T09:09:28.694758+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:26.140967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694812+0000","last_change":"2024-04-25T09:09:26.897388+0000","last_active":"2024-04-25T09:09:28.694812+0000","last_peered":"2024-04-25T09:09:28.694812+0000","last_clean":"2024-04-25T09:09:28.694812+0000","last_became_active":"2024-04-25T09:09:26.897138+0000","last_became_peered":"2024-04-25T09:09:26.897138+0000","last_unstale":"2024-04-25T09:09:28.694812+0000","last_undegraded":"2024-04-25T09:09:28.694812+0000","last_fullsized":"2024-04-25T09:09:28.694812+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:07.845041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"96'3","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878807+0000","last_change":"2024-04-25T09:09:25.890611+0000","last_active":"2024-04-25T09:09:27.878807+0000","last_peered":"2024-04-25T09:09:27.878807+0000","last_clean":"2024-04-25T09:09:27.878807+0000","last_became_active":"2024-04-25T09:09:25.889897+0000","last_became_peered":"2024-04-25T09:09:25.889897+0000","last_unstale":"2024-04-25T09:09:27.878807+0000","last_undegraded":"2024-04-25T09:09:27.878807+0000","last_fullsized":"2024-04-25T09:09:27.878807+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:00.689979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695142+0000","last_change":"2024-04-25T09:09:26.906211+0000","last_active":"2024-04-25T09:09:28.695142+0000","last_peered":"2024-04-25T09:09:28.695142+0000","last_clean":"2024-04-25T09:09:28.695142+0000","last_became_active":"2024-04-25T09:09:26.905774+0000","last_became_peered":"2024-04-25T09:09:26.905774+0000","last_unstale":"2024-04-25T09:09:28.695142+0000","last_undegraded":"2024-04-25T09:09:28.695142+0000","last_fullsized":"2024-04-25T09:09:28.695142+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:39.497239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"96'6","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878178+0000","last_change":"2024-04-25T09:09:25.892734+0000","last_active":"2024-04-25T09:09:27.878178+0000","last_peered":"2024-04-25T09:09:27.878178+0000","last_clean":"2024-04-25T09:09:27.878178+0000","last_became_active":"2024-04-25T09:09:25.892486+0000","last_became_peered":"2024-04-25T09:09:25.892486+0000","last_unstale":"2024-04-25T09:09:27.878178+0000","last_undegraded":"2024-04-25T09:09:27.878178+0000","last_fullsized":"2024-04-25T09:09:27.878178+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:28.617165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694564+0000","last_change":"2024-04-25T09:09:26.914455+0000","last_active":"2024-04-25T09:09:28.694564+0000","last_peered":"2024-04-25T09:09:28.694564+0000","last_clean":"2024-04-25T09:09:28.694564+0000","last_became_active":"2024-04-25T09:09:26.912881+0000","last_became_peered":"2024-04-25T09:09:26.912881+0000","last_unstale":"2024-04-25T09:09:28.694564+0000","last_undegraded":"2024-04-25T09:09:28.694564+0000","last_fullsized":"2024-04-25T09:09:28.694564+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:32.128756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.897005+0000","last_change":"2024-04-25T09:09:25.895891+0000","last_active":"2024-04-25T09:09:25.897005+0000","last_peered":"2024-04-25T09:09:25.897005+0000","last_clean":"2024-04-25T09:09:25.897005+0000","last_became_active":"2024-04-25T09:09:25.894219+0000","last_became_peered":"2024-04-25T09:09:25.894219+0000","last_unstale":"2024-04-25T09:09:25.897005+0000","last_undegraded":"2024-04-25T09:09:25.897005+0000","last_fullsized":"2024-04-25T09:09:25.897005+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:26.140967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877982+0000","last_change":"2024-04-25T09:09:26.882098+0000","last_active":"2024-04-25T09:09:27.877982+0000","last_peered":"2024-04-25T09:09:27.877982+0000","last_clean":"2024-04-25T09:09:27.877982+0000","last_became_active":"2024-04-25T09:09:26.881774+0000","last_became_peered":"2024-04-25T09:09:26.881774+0000","last_unstale":"2024-04-25T09:09:27.877982+0000","last_undegraded":"2024-04-25T09:09:27.877982+0000","last_fullsized":"2024-04-25T09:09:27.877982+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:38.604466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877730+0000","last_change":"2024-04-25T09:09:25.888905+0000","last_active":"2024-04-25T09:09:27.877730+0000","last_peered":"2024-04-25T09:09:27.877730+0000","last_clean":"2024-04-25T09:09:27.877730+0000","last_became_active":"2024-04-25T09:09:25.887974+0000","last_became_peered":"2024-04-25T09:09:25.887974+0000","last_unstale":"2024-04-25T09:09:27.877730+0000","last_undegraded":"2024-04-25T09:09:27.877730+0000","last_fullsized":"2024-04-25T09:09:27.877730+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:15.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879185+0000","last_change":"2024-04-25T09:09:26.916502+0000","last_active":"2024-04-25T09:09:27.879185+0000","last_peered":"2024-04-25T09:09:27.879185+0000","last_clean":"2024-04-25T09:09:27.879185+0000","last_became_active":"2024-04-25T09:09:26.916269+0000","last_became_peered":"2024-04-25T09:09:26.916269+0000","last_unstale":"2024-04-25T09:09:27.879185+0000","last_undegraded":"2024-04-25T09:09:27.879185+0000","last_fullsized":"2024-04-25T09:09:27.879185+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:29.397203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694554+0000","last_change":"2024-04-25T09:09:25.893744+0000","last_active":"2024-04-25T09:09:28.694554+0000","last_peered":"2024-04-25T09:09:28.694554+0000","last_clean":"2024-04-25T09:09:28.694554+0000","last_became_active":"2024-04-25T09:09:25.892844+0000","last_became_peered":"2024-04-25T09:09:25.892844+0000","last_unstale":"2024-04-25T09:09:28.694554+0000","last_undegraded":"2024-04-25T09:09:28.694554+0000","last_fullsized":"2024-04-25T09:09:28.694554+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:56.231571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879077+0000","last_change":"2024-04-25T09:09:26.898749+0000","last_active":"2024-04-25T09:09:27.879077+0000","last_peered":"2024-04-25T09:09:27.879077+0000","last_clean":"2024-04-25T09:09:27.879077+0000","last_became_active":"2024-04-25T09:09:26.898150+0000","last_became_peered":"2024-04-25T09:09:26.898150+0000","last_unstale":"2024-04-25T09:09:27.879077+0000","last_undegraded":"2024-04-25T09:09:27.879077+0000","last_fullsized":"2024-04-25T09:09:27.879077+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:03.772159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"96'8","reported_seq":22,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694543+0000","last_change":"2024-04-25T09:09:25.894818+0000","last_active":"2024-04-25T09:09:28.694543+0000","last_peered":"2024-04-25T09:09:28.694543+0000","last_clean":"2024-04-25T09:09:28.694543+0000","last_became_active":"2024-04-25T09:09:25.894535+0000","last_became_peered":"2024-04-25T09:09:25.894535+0000","last_unstale":"2024-04-25T09:09:28.694543+0000","last_undegraded":"2024-04-25T09:09:28.694543+0000","last_fullsized":"2024-04-25T09:09:28.694543+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:36.631220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878063+0000","last_change":"2024-04-25T09:09:26.892885+0000","last_active":"2024-04-25T09:09:27.878063+0000","last_peered":"2024-04-25T09:09:27.878063+0000","last_clean":"2024-04-25T09:09:27.878063+0000","last_became_active":"2024-04-25T09:09:26.892623+0000","last_became_peered":"2024-04-25T09:09:26.892623+0000","last_unstale":"2024-04-25T09:09:27.878063+0000","last_undegraded":"2024-04-25T09:09:27.878063+0000","last_fullsized":"2024-04-25T09:09:27.878063+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:14.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695130+0000","last_change":"2024-04-25T09:09:25.893625+0000","last_active":"2024-04-25T09:09:28.695130+0000","last_peered":"2024-04-25T09:09:28.695130+0000","last_clean":"2024-04-25T09:09:28.695130+0000","last_became_active":"2024-04-25T09:09:25.893276+0000","last_became_peered":"2024-04-25T09:09:25.893276+0000","last_unstale":"2024-04-25T09:09:28.695130+0000","last_undegraded":"2024-04-25T09:09:28.695130+0000","last_fullsized":"2024-04-25T09:09:28.695130+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:29.598163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695021+0000","last_change":"2024-04-25T09:09:26.891031+0000","last_active":"2024-04-25T09:09:28.695021+0000","last_peered":"2024-04-25T09:09:28.695021+0000","last_clean":"2024-04-25T09:09:28.695021+0000","last_became_active":"2024-04-25T09:09:26.890788+0000","last_became_peered":"2024-04-25T09:09:26.890788+0000","last_unstale":"2024-04-25T09:09:28.695021+0000","last_undegraded":"2024-04-25T09:09:28.695021+0000","last_fullsized":"2024-04-25T09:09:28.695021+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:09.501598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.898067+0000","last_change":"2024-04-25T09:09:25.897420+0000","last_active":"2024-04-25T09:09:25.898067+0000","last_peered":"2024-04-25T09:09:25.898067+0000","last_clean":"2024-04-25T09:09:25.898067+0000","last_became_active":"2024-04-25T09:09:25.896968+0000","last_became_peered":"2024-04-25T09:09:25.896968+0000","last_unstale":"2024-04-25T09:09:25.898067+0000","last_undegraded":"2024-04-25T09:09:25.898067+0000","last_fullsized":"2024-04-25T09:09:25.898067+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:54.038096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878728+0000","last_change":"2024-04-25T09:09:26.902520+0000","last_active":"2024-04-25T09:09:27.878728+0000","last_peered":"2024-04-25T09:09:27.878728+0000","last_clean":"2024-04-25T09:09:27.878728+0000","last_became_active":"2024-04-25T09:09:26.902128+0000","last_became_peered":"2024-04-25T09:09:26.902128+0000","last_unstale":"2024-04-25T09:09:27.878728+0000","last_undegraded":"2024-04-25T09:09:27.878728+0000","last_fullsized":"2024-04-25T09:09:27.878728+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:04.360175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878847+0000","last_change":"2024-04-25T09:09:25.890897+0000","last_active":"2024-04-25T09:09:27.878847+0000","last_peered":"2024-04-25T09:09:27.878847+0000","last_clean":"2024-04-25T09:09:27.878847+0000","last_became_active":"2024-04-25T09:09:25.890283+0000","last_became_peered":"2024-04-25T09:09:25.890283+0000","last_unstale":"2024-04-25T09:09:27.878847+0000","last_undegraded":"2024-04-25T09:09:27.878847+0000","last_fullsized":"2024-04-25T09:09:27.878847+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:13.142222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877758+0000","last_change":"2024-04-25T09:09:26.910678+0000","last_active":"2024-04-25T09:09:27.877758+0000","last_peered":"2024-04-25T09:09:27.877758+0000","last_clean":"2024-04-25T09:09:27.877758+0000","last_became_active":"2024-04-25T09:09:26.910403+0000","last_became_peered":"2024-04-25T09:09:26.910403+0000","last_unstale":"2024-04-25T09:09:27.877758+0000","last_undegraded":"2024-04-25T09:09:27.877758+0000","last_fullsized":"2024-04-25T09:09:27.877758+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:43.004790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.693883+0000","last_change":"2024-04-25T09:09:25.889771+0000","last_active":"2024-04-25T09:09:28.693883+0000","last_peered":"2024-04-25T09:09:28.693883+0000","last_clean":"2024-04-25T09:09:28.693883+0000","last_became_active":"2024-04-25T09:09:25.889426+0000","last_became_peered":"2024-04-25T09:09:25.889426+0000","last_unstale":"2024-04-25T09:09:28.693883+0000","last_undegraded":"2024-04-25T09:09:28.693883+0000","last_fullsized":"2024-04-25T09:09:28.693883+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:14.193442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.693923+0000","last_change":"2024-04-25T09:09:26.895859+0000","last_active":"2024-04-25T09:09:28.693923+0000","last_peered":"2024-04-25T09:09:28.693923+0000","last_clean":"2024-04-25T09:09:28.693923+0000","last_became_active":"2024-04-25T09:09:26.895588+0000","last_became_peered":"2024-04-25T09:09:26.895588+0000","last_unstale":"2024-04-25T09:09:28.693923+0000","last_undegraded":"2024-04-25T09:09:28.693923+0000","last_fullsized":"2024-04-25T09:09:28.693923+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:39.999904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879040+0000","last_change":"2024-04-25T09:09:25.894259+0000","last_active":"2024-04-25T09:09:27.879040+0000","last_peered":"2024-04-25T09:09:27.879040+0000","last_clean":"2024-04-25T09:09:27.879040+0000","last_became_active":"2024-04-25T09:09:25.893924+0000","last_became_peered":"2024-04-25T09:09:25.893924+0000","last_unstale":"2024-04-25T09:09:27.879040+0000","last_undegraded":"2024-04-25T09:09:27.879040+0000","last_fullsized":"2024-04-25T09:09:27.879040+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:06.938535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694592+0000","last_change":"2024-04-25T09:09:26.912210+0000","last_active":"2024-04-25T09:09:28.694592+0000","last_peered":"2024-04-25T09:09:28.694592+0000","last_clean":"2024-04-25T09:09:28.694592+0000","last_became_active":"2024-04-25T09:09:26.911858+0000","last_became_peered":"2024-04-25T09:09:26.911858+0000","last_unstale":"2024-04-25T09:09:28.694592+0000","last_undegraded":"2024-04-25T09:09:28.694592+0000","last_fullsized":"2024-04-25T09:09:28.694592+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:09.501598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694050+0000","last_change":"2024-04-25T09:09:25.888456+0000","last_active":"2024-04-25T09:09:28.694050+0000","last_peered":"2024-04-25T09:09:28.694050+0000","last_clean":"2024-04-25T09:09:28.694050+0000","last_became_active":"2024-04-25T09:09:25.888121+0000","last_became_peered":"2024-04-25T09:09:25.888121+0000","last_unstale":"2024-04-25T09:09:28.694050+0000","last_undegraded":"2024-04-25T09:09:28.694050+0000","last_fullsized":"2024-04-25T09:09:28.694050+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:10.295905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878097+0000","last_change":"2024-04-25T09:09:26.893393+0000","last_active":"2024-04-25T09:09:27.878097+0000","last_peered":"2024-04-25T09:09:27.878097+0000","last_clean":"2024-04-25T09:09:27.878097+0000","last_became_active":"2024-04-25T09:09:26.892289+0000","last_became_peered":"2024-04-25T09:09:26.892289+0000","last_unstale":"2024-04-25T09:09:27.878097+0000","last_undegraded":"2024-04-25T09:09:27.878097+0000","last_fullsized":"2024-04-25T09:09:27.878097+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:06.636882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878720+0000","last_change":"2024-04-25T09:09:25.883924+0000","last_active":"2024-04-25T09:09:27.878720+0000","last_peered":"2024-04-25T09:09:27.878720+0000","last_clean":"2024-04-25T09:09:27.878720+0000","last_became_active":"2024-04-25T09:09:25.883059+0000","last_became_peered":"2024-04-25T09:09:25.883059+0000","last_unstale":"2024-04-25T09:09:27.878720+0000","last_undegraded":"2024-04-25T09:09:27.878720+0000","last_fullsized":"2024-04-25T09:09:27.878720+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:20.403420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694644+0000","last_change":"2024-04-25T09:09:26.890528+0000","last_active":"2024-04-25T09:09:28.694644+0000","last_peered":"2024-04-25T09:09:28.694644+0000","last_clean":"2024-04-25T09:09:28.694644+0000","last_became_active":"2024-04-25T09:09:26.889103+0000","last_became_peered":"2024-04-25T09:09:26.889103+0000","last_unstale":"2024-04-25T09:09:28.694644+0000","last_undegraded":"2024-04-25T09:09:28.694644+0000","last_fullsized":"2024-04-25T09:09:28.694644+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:15.833064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.897033+0000","last_change":"2024-04-25T09:09:25.895283+0000","last_active":"2024-04-25T09:09:25.897033+0000","last_peered":"2024-04-25T09:09:25.897033+0000","last_clean":"2024-04-25T09:09:25.897033+0000","last_became_active":"2024-04-25T09:09:25.894675+0000","last_became_peered":"2024-04-25T09:09:25.894675+0000","last_unstale":"2024-04-25T09:09:25.897033+0000","last_undegraded":"2024-04-25T09:09:25.897033+0000","last_fullsized":"2024-04-25T09:09:25.897033+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:54.808752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878253+0000","last_change":"2024-04-25T09:09:26.884176+0000","last_active":"2024-04-25T09:09:27.878253+0000","last_peered":"2024-04-25T09:09:27.878253+0000","last_clean":"2024-04-25T09:09:27.878253+0000","last_became_active":"2024-04-25T09:09:26.883416+0000","last_became_peered":"2024-04-25T09:09:26.883416+0000","last_unstale":"2024-04-25T09:09:27.878253+0000","last_undegraded":"2024-04-25T09:09:27.878253+0000","last_fullsized":"2024-04-25T09:09:27.878253+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:16.248502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"97'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.881364+0000","last_change":"2024-04-25T09:09:25.888575+0000","last_active":"2024-04-25T09:09:28.881364+0000","last_peered":"2024-04-25T09:09:28.881364+0000","last_clean":"2024-04-25T09:09:28.881364+0000","last_became_active":"2024-04-25T09:09:25.888130+0000","last_became_peered":"2024-04-25T09:09:25.888130+0000","last_unstale":"2024-04-25T09:09:28.881364+0000","last_undegraded":"2024-04-25T09:09:28.881364+0000","last_fullsized":"2024-04-25T09:09:28.881364+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:22.025116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878336+0000","last_change":"2024-04-25T09:09:26.907788+0000","last_active":"2024-04-25T09:09:27.878336+0000","last_peered":"2024-04-25T09:09:27.878336+0000","last_clean":"2024-04-25T09:09:27.878336+0000","last_became_active":"2024-04-25T09:09:26.907509+0000","last_became_peered":"2024-04-25T09:09:26.907509+0000","last_unstale":"2024-04-25T09:09:27.878336+0000","last_undegraded":"2024-04-25T09:09:27.878336+0000","last_fullsized":"2024-04-25T09:09:27.878336+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:59.022383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878920+0000","last_change":"2024-04-25T09:09:25.885545+0000","last_active":"2024-04-25T09:09:27.878920+0000","last_peered":"2024-04-25T09:09:27.878920+0000","last_clean":"2024-04-25T09:09:27.878920+0000","last_became_active":"2024-04-25T09:09:25.885204+0000","last_became_peered":"2024-04-25T09:09:25.885204+0000","last_unstale":"2024-04-25T09:09:27.878920+0000","last_undegraded":"2024-04-25T09:09:27.878920+0000","last_fullsized":"2024-04-25T09:09:27.878920+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:33.311698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694576+0000","last_change":"2024-04-25T09:09:26.891717+0000","last_active":"2024-04-25T09:09:28.694576+0000","last_peered":"2024-04-25T09:09:28.694576+0000","last_clean":"2024-04-25T09:09:28.694576+0000","last_became_active":"2024-04-25T09:09:26.891183+0000","last_became_peered":"2024-04-25T09:09:26.891183+0000","last_unstale":"2024-04-25T09:09:28.694576+0000","last_undegraded":"2024-04-25T09:09:28.694576+0000","last_fullsized":"2024-04-25T09:09:28.694576+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:15.833064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694888+0000","last_change":"2024-04-25T09:09:25.890769+0000","last_active":"2024-04-25T09:09:28.694888+0000","last_peered":"2024-04-25T09:09:28.694888+0000","last_clean":"2024-04-25T09:09:28.694888+0000","last_became_active":"2024-04-25T09:09:25.890367+0000","last_became_peered":"2024-04-25T09:09:25.890367+0000","last_unstale":"2024-04-25T09:09:28.694888+0000","last_undegraded":"2024-04-25T09:09:28.694888+0000","last_fullsized":"2024-04-25T09:09:28.694888+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:14.193442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878771+0000","last_change":"2024-04-25T09:09:26.899314+0000","last_active":"2024-04-25T09:09:27.878771+0000","last_peered":"2024-04-25T09:09:27.878771+0000","last_clean":"2024-04-25T09:09:27.878771+0000","last_became_active":"2024-04-25T09:09:26.898556+0000","last_became_peered":"2024-04-25T09:09:26.898556+0000","last_unstale":"2024-04-25T09:09:27.878771+0000","last_undegraded":"2024-04-25T09:09:27.878771+0000","last_fullsized":"2024-04-25T09:09:27.878771+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:14.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877854+0000","last_change":"2024-04-25T09:09:25.887331+0000","last_active":"2024-04-25T09:09:27.877854+0000","last_peered":"2024-04-25T09:09:27.877854+0000","last_clean":"2024-04-25T09:09:27.877854+0000","last_became_active":"2024-04-25T09:09:25.886093+0000","last_became_peered":"2024-04-25T09:09:25.886093+0000","last_unstale":"2024-04-25T09:09:27.877854+0000","last_undegraded":"2024-04-25T09:09:27.877854+0000","last_fullsized":"2024-04-25T09:09:27.877854+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:23:28.244528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694280+0000","last_change":"2024-04-25T09:09:26.910027+0000","last_active":"2024-04-25T09:09:28.694280+0000","last_peered":"2024-04-25T09:09:28.694280+0000","last_clean":"2024-04-25T09:09:28.694280+0000","last_became_active":"2024-04-25T09:09:26.909711+0000","last_became_peered":"2024-04-25T09:09:26.909711+0000","last_unstale":"2024-04-25T09:09:28.694280+0000","last_undegraded":"2024-04-25T09:09:28.694280+0000","last_fullsized":"2024-04-25T09:09:28.694280+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:27.191034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694700+0000","last_change":"2024-04-25T09:09:25.888899+0000","last_active":"2024-04-25T09:09:28.694700+0000","last_peered":"2024-04-25T09:09:28.694700+0000","last_clean":"2024-04-25T09:09:28.694700+0000","last_became_active":"2024-04-25T09:09:25.887727+0000","last_became_peered":"2024-04-25T09:09:25.887727+0000","last_unstale":"2024-04-25T09:09:28.694700+0000","last_undegraded":"2024-04-25T09:09:28.694700+0000","last_fullsized":"2024-04-25T09:09:28.694700+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:26.020961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694318+0000","last_change":"2024-04-25T09:09:26.911233+0000","last_active":"2024-04-25T09:09:28.694318+0000","last_peered":"2024-04-25T09:09:28.694318+0000","last_clean":"2024-04-25T09:09:28.694318+0000","last_became_active":"2024-04-25T09:09:26.910962+0000","last_became_peered":"2024-04-25T09:09:26.910962+0000","last_unstale":"2024-04-25T09:09:28.694318+0000","last_undegraded":"2024-04-25T09:09:28.694318+0000","last_fullsized":"2024-04-25T09:09:28.694318+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:47.875102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694383+0000","last_change":"2024-04-25T09:09:25.886416+0000","last_active":"2024-04-25T09:09:28.694383+0000","last_peered":"2024-04-25T09:09:28.694383+0000","last_clean":"2024-04-25T09:09:28.694383+0000","last_became_active":"2024-04-25T09:09:25.886138+0000","last_became_peered":"2024-04-25T09:09:25.886138+0000","last_unstale":"2024-04-25T09:09:28.694383+0000","last_undegraded":"2024-04-25T09:09:28.694383+0000","last_fullsized":"2024-04-25T09:09:28.694383+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:14.676493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877763+0000","last_change":"2024-04-25T09:09:26.895912+0000","last_active":"2024-04-25T09:09:27.877763+0000","last_peered":"2024-04-25T09:09:27.877763+0000","last_clean":"2024-04-25T09:09:27.877763+0000","last_became_active":"2024-04-25T09:09:26.894861+0000","last_became_peered":"2024-04-25T09:09:26.894861+0000","last_unstale":"2024-04-25T09:09:27.877763+0000","last_undegraded":"2024-04-25T09:09:27.877763+0000","last_fullsized":"2024-04-25T09:09:27.877763+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:20.609762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.897356+0000","last_change":"2024-04-25T09:09:25.896492+0000","last_active":"2024-04-25T09:09:25.897356+0000","last_peered":"2024-04-25T09:09:25.897356+0000","last_clean":"2024-04-25T09:09:25.897356+0000","last_became_active":"2024-04-25T09:09:25.896219+0000","last_became_peered":"2024-04-25T09:09:25.896219+0000","last_unstale":"2024-04-25T09:09:25.897356+0000","last_undegraded":"2024-04-25T09:09:25.897356+0000","last_fullsized":"2024-04-25T09:09:25.897356+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:44.101788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.882446+0000","last_change":"2024-04-25T09:09:25.882446+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.882446+0000","last_undegraded":"2024-04-25T09:09:25.882446+0000","last_fullsized":"2024-04-25T09:09:25.882446+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695290+0000","last_change":"2024-04-25T09:09:25.896662+0000","last_active":"2024-04-25T09:09:28.695290+0000","last_peered":"2024-04-25T09:09:28.695290+0000","last_clean":"2024-04-25T09:09:28.695290+0000","last_became_active":"2024-04-25T09:09:25.896367+0000","last_became_peered":"2024-04-25T09:09:25.896367+0000","last_unstale":"2024-04-25T09:09:28.695290+0000","last_undegraded":"2024-04-25T09:09:28.695290+0000","last_fullsized":"2024-04-25T09:09:28.695290+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:27.332997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":305,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.886563+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:09:25.886563+0000","last_peered":"2024-04-25T09:09:25.886563+0000","last_clean":"2024-04-25T09:09:25.886563+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:09:25.886563+0000","last_undegraded":"2024-04-25T09:09:25.886563+0000","last_fullsized":"2024-04-25T09:09:25.886563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2376,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509525,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50404,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321436,"statfs":{"total":96636764160,"available":96585150464,"internally_reserved":0,"allocated":1196032,"data_stored":545265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509525,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46224,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325616,"statfs":{"total":96636764160,"available":96589430784,"internally_reserved":0,"allocated":1175552,"data_stored":543049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509526,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54560,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317280,"statfs":{"total":96636764160,"available":96580894720,"internally_reserved":0,"allocated":1196032,"data_stored":549901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509525,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54540,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317300,"statfs":{"total":96636764160,"available":96580915200,"internally_reserved":0,"allocated":1175552,"data_stored":543049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509525,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50388,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321452,"statfs":{"total":96636764160,"available":96585166848,"internally_reserved":0,"allocated":1187840,"data_stored":549741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509526,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46236,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325604,"statfs":{"total":96636764160,"available":96589418496,"internally_reserved":0,"allocated":1191936,"data_stored":549811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509526,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50996,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320844,"statfs":{"total":96636764160,"available":96584544256,"internally_reserved":0,"allocated":1806336,"data_stored":1142427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574933,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46792,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325048,"statfs":{"total":96636764160,"available":96588849152,"internally_reserved":0,"allocated":1757184,"data_stored":1126250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:09:31.319 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:09:31.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.504+0000 7f2efd800640 1 Processor -- start 2024-04-25T09:09:31.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.504+0000 7f2efd800640 1 -- start start 2024-04-25T09:09:31.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.504+0000 7f2efd800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ef8145250 0x7f2ef815c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.504+0000 7f2efd800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2ef80cc8b0 0x7f2ef80ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.504+0000 7f2efd800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef815cec0 con 0x7f2ef8071320 2024-04-25T09:09:31.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.504+0000 7f2efd800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef806e7c0 con 0x7f2ef80cc8b0 2024-04-25T09:09:31.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.504+0000 7f2efd800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef806d720 con 0x7f2ef8145250 2024-04-25T09:09:31.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.504+0000 7f2ef7400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f2ef8071320 0x7f2ef8071790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60632/0 (socket says 172.21.15.173:60632) 2024-04-25T09:09:31.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.504+0000 7f2ef7400640 1 -- 172.21.15.173:0/1287489945 learned_addr learned my addr 172.21.15.173:0/1287489945 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:31.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.504+0000 7f2ef6a00640 1 --2- 172.21.15.173:0/1287489945 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ef8145250 0x7f2ef815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.504+0000 7f2ef6000640 1 --2- 172.21.15.173:0/1287489945 >> v2:172.21.15.194:3300/0 conn(0x7f2ef80cc8b0 0x7f2ef80ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.504+0000 7f2ef5600640 1 -- 172.21.15.173:0/1287489945 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229723009 0 0) 0x7f2ef0001120 con 0x7f2ef8071320 2024-04-25T09:09:31.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.504+0000 7f2ef5600640 1 -- 172.21.15.173:0/1287489945 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2edc003530 con 0x7f2ef8071320 2024-04-25T09:09:31.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef5600640 1 -- 172.21.15.173:0/1287489945 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1357976336 0 0) 0x7f2edc003530 con 0x7f2ef8071320 2024-04-25T09:09:31.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef5600640 1 -- 172.21.15.173:0/1287489945 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ef8145250 msgr2=0x7f2ef815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:31.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef5600640 1 --2- 172.21.15.173:0/1287489945 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ef8145250 0x7f2ef815c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef5600640 1 -- 172.21.15.173:0/1287489945 >> v2:172.21.15.194:3300/0 conn(0x7f2ef80cc8b0 msgr2=0x7f2ef80ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:31.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef5600640 1 --2- 172.21.15.173:0/1287489945 >> v2:172.21.15.194:3300/0 conn(0x7f2ef80cc8b0 0x7f2ef80ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef5600640 1 -- 172.21.15.173:0/1287489945 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef806da00 con 0x7f2ef8071320 2024-04-25T09:09:31.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef5600640 1 -- 172.21.15.173:0/1287489945 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f2ef0001850 con 0x7f2ef8071320 2024-04-25T09:09:31.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef5600640 1 -- 172.21.15.173:0/1287489945 >> v1:172.21.15.173:6789/0 conn(0x7f2ef8071320 legacy=0x7f2ef8071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:31.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef5600640 1 --2- 172.21.15.173:0/1287489945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2edc0039c0 0x7f2edc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef5600640 1 --2- 172.21.15.173:0/1287489945 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ef8145250 0x7f2edc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef5600640 1 --2- 172.21.15.173:0/1287489945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc004d50 0x7f2edc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef5600640 1 -- 172.21.15.173:0/1287489945 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef806e7c0 con 0x7f2edc0039c0 2024-04-25T09:09:31.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef5600640 1 -- 172.21.15.173:0/1287489945 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef806d720 con 0x7f2edc004d50 2024-04-25T09:09:31.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef5600640 1 -- 172.21.15.173:0/1287489945 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc00b9d0 con 0x7f2ef8145250 2024-04-25T09:09:31.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef6000640 1 --2- 172.21.15.173:0/1287489945 >> v2:172.21.15.194:3300/0 conn(0x7f2ef80cc8b0 0x7f2ef80ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:31.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef6a00640 1 --2- 172.21.15.173:0/1287489945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2edc0039c0 0x7f2edc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef7400640 1 --2- 172.21.15.173:0/1287489945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc004d50 0x7f2edc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef6000640 1 --2- 172.21.15.173:0/1287489945 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ef8145250 0x7f2edc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef6a00640 1 -- 172.21.15.173:0/1287489945 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ef8145250 msgr2=0x7f2edc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:31.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef6a00640 1 --2- 172.21.15.173:0/1287489945 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ef8145250 0x7f2edc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef6a00640 1 -- 172.21.15.173:0/1287489945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc004d50 msgr2=0x7f2edc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:31.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef6a00640 1 --2- 172.21.15.173:0/1287489945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc004d50 0x7f2edc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef6a00640 1 -- 172.21.15.173:0/1287489945 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc003530 con 0x7f2edc0039c0 2024-04-25T09:09:31.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef6000640 1 --2- 172.21.15.173:0/1287489945 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ef8145250 0x7f2edc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:31.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef7400640 1 --2- 172.21.15.173:0/1287489945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc004d50 0x7f2edc0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:31.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef6a00640 1 --2- 172.21.15.173:0/1287489945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2edc0039c0 0x7f2edc003de0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009fc0 tx=0x7f2ee801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb0f9da99066e30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:31.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.508+0000 7f2ef5600640 1 -- 172.21.15.173:0/1287489945 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80b2070 con 0x7f2edc0039c0 2024-04-25T09:09:31.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2ef5600640 1 -- 172.21.15.173:0/1287489945 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee80a5b60 con 0x7f2edc0039c0 2024-04-25T09:09:31.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2ef5600640 1 -- 172.21.15.173:0/1287489945 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8009c10 con 0x7f2edc0039c0 2024-04-25T09:09:31.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2efd800640 1 -- 172.21.15.173:0/1287489945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2edc0039c0 msgr2=0x7f2edc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:31.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2efd800640 1 --2- 172.21.15.173:0/1287489945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2edc0039c0 0x7f2edc003de0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009fc0 tx=0x7f2ee801cc80 comp rx=0 tx=0).stop 2024-04-25T09:09:31.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2ef7400640 1 -- 172.21.15.173:0/1287489945 reap_dead start 2024-04-25T09:09:31.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2efd800640 1 -- 172.21.15.173:0/1287489945 shutdown_connections 2024-04-25T09:09:31.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2efd800640 1 -- 172.21.15.173:0/1287489945 >> 172.21.15.173:0/1287489945 conn(0x7f2ef806ac90 msgr2=0x7f2ef806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:31.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2efd800640 1 -- 172.21.15.173:0/1287489945 shutdown_connections 2024-04-25T09:09:31.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2efd800640 1 -- 172.21.15.173:0/1287489945 wait complete. 2024-04-25T09:09:31.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2efd800640 1 Processor -- start 2024-04-25T09:09:31.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2efd800640 1 -- start start 2024-04-25T09:09:31.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2efd800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc0039c0 0x7f2ef81349e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2efd800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ef80c51f0 0x7f2ef80cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2efd800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ef8132f60 0x7f2ef80b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2efd800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef806ef80 con 0x7f2ef8132f60 2024-04-25T09:09:31.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2efd800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef8145630 con 0x7f2edc0039c0 2024-04-25T09:09:31.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2efd800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef806d380 con 0x7f2ef80c51f0 2024-04-25T09:09:31.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2ef7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ef8132f60 0x7f2ef80b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2ef7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ef8132f60 0x7f2ef80b0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42372/0 (socket says 172.21.15.173:42372) 2024-04-25T09:09:31.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2ef7400640 1 -- 172.21.15.173:0/4158739524 learned_addr learned my addr 172.21.15.173:0/4158739524 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:31.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2ef6000640 1 --2- 172.21.15.173:0/4158739524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ef80c51f0 0x7f2ef80cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2ef6a00640 1 --2- 172.21.15.173:0/4158739524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc0039c0 0x7f2ef81349e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2ef7400640 1 -- 172.21.15.173:0/4158739524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ef80c51f0 msgr2=0x7f2ef80cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:31.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2ef7400640 1 --2- 172.21.15.173:0/4158739524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ef80c51f0 0x7f2ef80cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2ef7400640 1 -- 172.21.15.173:0/4158739524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc0039c0 msgr2=0x7f2ef81349e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:31.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2ef7400640 1 --2- 172.21.15.173:0/4158739524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc0039c0 0x7f2ef81349e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2ef7400640 1 -- 172.21.15.173:0/4158739524 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef8133940 con 0x7f2ef8132f60 2024-04-25T09:09:31.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2ef6000640 1 --2- 172.21.15.173:0/4158739524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ef80c51f0 0x7f2ef80cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:31.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.512+0000 7f2ef6a00640 1 --2- 172.21.15.173:0/4158739524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc0039c0 0x7f2ef81349e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:31.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.516+0000 7f2ef7400640 1 --2- 172.21.15.173:0/4158739524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ef8132f60 0x7f2ef80b0890 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80d0420 tx=0x7f2ef0007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:31.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.516+0000 7f2eeea00640 1 -- 172.21.15.173:0/4158739524 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0007760 con 0x7f2ef8132f60 2024-04-25T09:09:31.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.516+0000 7f2eeea00640 1 -- 172.21.15.173:0/4158739524 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef0018070 con 0x7f2ef8132f60 2024-04-25T09:09:31.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.516+0000 7f2eeea00640 1 -- 172.21.15.173:0/4158739524 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef000e8b0 con 0x7f2ef8132f60 2024-04-25T09:09:31.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.516+0000 7f2efd800640 1 -- 172.21.15.173:0/4158739524 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef8133c20 con 0x7f2ef8132f60 2024-04-25T09:09:31.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.516+0000 7f2efd800640 1 -- 172.21.15.173:0/4158739524 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef81341e0 con 0x7f2ef8132f60 2024-04-25T09:09:31.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.516+0000 7f2efd800640 1 -- 172.21.15.173:0/4158739524 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef8073a40 con 0x7f2ef8132f60 2024-04-25T09:09:31.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.516+0000 7f2eeea00640 1 -- 172.21.15.173:0/4158739524 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2ef000ea50 con 0x7f2ef8132f60 2024-04-25T09:09:31.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.516+0000 7f2eeea00640 1 --2- 172.21.15.173:0/4158739524 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2ed8066f60 0x7f2ed8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.516+0000 7f2eeea00640 1 -- 172.21.15.173:0/4158739524 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2ef0084ed0 con 0x7f2ef8132f60 2024-04-25T09:09:31.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.516+0000 7f2ef6a00640 1 --2- 172.21.15.173:0/4158739524 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2ed8066f60 0x7f2ed8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.520+0000 7f2ef6a00640 1 --2- 172.21.15.173:0/4158739524 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2ed8066f60 0x7f2ed8069420 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80af000 tx=0x7f2ee80a7040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:31.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.520+0000 7f2eeea00640 1 -- 172.21.15.173:0/4158739524 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2ef815cec0 con 0x7f2ef8132f60 2024-04-25T09:09:31.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.672+0000 7f2efd800640 1 -- 172.21.15.173:0/4158739524 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ef806c300 con 0x7f2ed8066f60 2024-04-25T09:09:31.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.680+0000 7f2eeea00640 1 -- 172.21.15.173:0/4158739524 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251651 (secure 0 0 0) 0x7f2ef806c300 con 0x7f2ed8066f60 2024-04-25T09:09:31.669 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:31.670 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:09:31.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.680+0000 7f2efd800640 1 -- 172.21.15.173:0/4158739524 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2ed8066f60 msgr2=0x7f2ed8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:31.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.680+0000 7f2efd800640 1 --2- 172.21.15.173:0/4158739524 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2ed8066f60 0x7f2ed8069420 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80af000 tx=0x7f2ee80a7040 comp rx=0 tx=0).stop 2024-04-25T09:09:31.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.680+0000 7f2efd800640 1 -- 172.21.15.173:0/4158739524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ef8132f60 msgr2=0x7f2ef80b0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:31.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.680+0000 7f2efd800640 1 --2- 172.21.15.173:0/4158739524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ef8132f60 0x7f2ef80b0890 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80d0420 tx=0x7f2ef0007420 comp rx=0 tx=0).stop 2024-04-25T09:09:31.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.680+0000 7f2efd800640 1 -- 172.21.15.173:0/4158739524 shutdown_connections 2024-04-25T09:09:31.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.680+0000 7f2efd800640 1 --2- 172.21.15.173:0/4158739524 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2ed8066f60 0x7f2ed8069420 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.680+0000 7f2efd800640 1 --2- 172.21.15.173:0/4158739524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ef8132f60 0x7f2ef80b0890 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.680+0000 7f2efd800640 1 --2- 172.21.15.173:0/4158739524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ef80c51f0 0x7f2ef80cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.680+0000 7f2efd800640 1 --2- 172.21.15.173:0/4158739524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc0039c0 0x7f2ef81349e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.680+0000 7f2efd800640 1 -- 172.21.15.173:0/4158739524 >> 172.21.15.173:0/4158739524 conn(0x7f2ef806ac90 msgr2=0x7f2ef806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:31.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.680+0000 7f2efd800640 1 -- 172.21.15.173:0/4158739524 shutdown_connections 2024-04-25T09:09:31.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.680+0000 7f2efd800640 1 -- 172.21.15.173:0/4158739524 wait complete. 2024-04-25T09:09:31.689 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2024-04-25T09:09:30.815176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592744,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400140,"kb_used_data":10436,"kb_used_omap":12,"kb_used_meta":389555,"kb_avail":754574580,"statfs":{"total":773094113280,"available":772684369920,"internally_reserved":0,"allocated":10686464,"data_stored":5549493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":398904880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2376,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.951964"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694625+0000","last_change":"2024-04-25T09:09:26.896499+0000","last_active":"2024-04-25T09:09:28.694625+0000","last_peered":"2024-04-25T09:09:28.694625+0000","last_clean":"2024-04-25T09:09:28.694625+0000","last_became_active":"2024-04-25T09:09:26.896226+0000","last_became_peered":"2024-04-25T09:09:26.896226+0000","last_unstale":"2024-04-25T09:09:28.694625+0000","last_undegraded":"2024-04-25T09:09:28.694625+0000","last_fullsized":"2024-04-25T09:09:28.694625+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:50.131196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694036+0000","last_change":"2024-04-25T09:09:26.897460+0000","last_active":"2024-04-25T09:09:28.694036+0000","last_peered":"2024-04-25T09:09:28.694036+0000","last_clean":"2024-04-25T09:09:28.694036+0000","last_became_active":"2024-04-25T09:09:26.897103+0000","last_became_peered":"2024-04-25T09:09:26.897103+0000","last_unstale":"2024-04-25T09:09:28.694036+0000","last_undegraded":"2024-04-25T09:09:28.694036+0000","last_fullsized":"2024-04-25T09:09:28.694036+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:21.216175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694439+0000","last_change":"2024-04-25T09:09:26.893748+0000","last_active":"2024-04-25T09:09:28.694439+0000","last_peered":"2024-04-25T09:09:28.694439+0000","last_clean":"2024-04-25T09:09:28.694439+0000","last_became_active":"2024-04-25T09:09:26.893515+0000","last_became_peered":"2024-04-25T09:09:26.893515+0000","last_unstale":"2024-04-25T09:09:28.694439+0000","last_undegraded":"2024-04-25T09:09:28.694439+0000","last_fullsized":"2024-04-25T09:09:28.694439+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:42.021859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694920+0000","last_change":"2024-04-25T09:09:26.910061+0000","last_active":"2024-04-25T09:09:28.694920+0000","last_peered":"2024-04-25T09:09:28.694920+0000","last_clean":"2024-04-25T09:09:28.694920+0000","last_became_active":"2024-04-25T09:09:26.909795+0000","last_became_peered":"2024-04-25T09:09:26.909795+0000","last_unstale":"2024-04-25T09:09:28.694920+0000","last_undegraded":"2024-04-25T09:09:28.694920+0000","last_fullsized":"2024-04-25T09:09:28.694920+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:05.780038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878204+0000","last_change":"2024-04-25T09:09:26.882500+0000","last_active":"2024-04-25T09:09:27.878204+0000","last_peered":"2024-04-25T09:09:27.878204+0000","last_clean":"2024-04-25T09:09:27.878204+0000","last_became_active":"2024-04-25T09:09:26.882178+0000","last_became_peered":"2024-04-25T09:09:26.882178+0000","last_unstale":"2024-04-25T09:09:27.878204+0000","last_undegraded":"2024-04-25T09:09:27.878204+0000","last_fullsized":"2024-04-25T09:09:27.878204+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:11.302067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877603+0000","last_change":"2024-04-25T09:09:26.913022+0000","last_active":"2024-04-25T09:09:27.877603+0000","last_peered":"2024-04-25T09:09:27.877603+0000","last_clean":"2024-04-25T09:09:27.877603+0000","last_became_active":"2024-04-25T09:09:26.912555+0000","last_became_peered":"2024-04-25T09:09:26.912555+0000","last_unstale":"2024-04-25T09:09:27.877603+0000","last_undegraded":"2024-04-25T09:09:27.877603+0000","last_fullsized":"2024-04-25T09:09:27.877603+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:09.924416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.882866+0000","last_change":"2024-04-25T09:09:25.882866+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.882866+0000","last_undegraded":"2024-04-25T09:09:25.882866+0000","last_fullsized":"2024-04-25T09:09:25.882866+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694274+0000","last_change":"2024-04-25T09:09:26.914654+0000","last_active":"2024-04-25T09:09:28.694274+0000","last_peered":"2024-04-25T09:09:28.694274+0000","last_clean":"2024-04-25T09:09:28.694274+0000","last_became_active":"2024-04-25T09:09:26.914011+0000","last_became_peered":"2024-04-25T09:09:26.914011+0000","last_unstale":"2024-04-25T09:09:28.694274+0000","last_undegraded":"2024-04-25T09:09:28.694274+0000","last_fullsized":"2024-04-25T09:09:28.694274+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:54.978670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878504+0000","last_change":"2024-04-25T09:09:26.892861+0000","last_active":"2024-04-25T09:09:27.878504+0000","last_peered":"2024-04-25T09:09:27.878504+0000","last_clean":"2024-04-25T09:09:27.878504+0000","last_became_active":"2024-04-25T09:09:26.892013+0000","last_became_peered":"2024-04-25T09:09:26.892013+0000","last_unstale":"2024-04-25T09:09:27.878504+0000","last_undegraded":"2024-04-25T09:09:27.878504+0000","last_fullsized":"2024-04-25T09:09:27.878504+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:27.027122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879193+0000","last_change":"2024-04-25T09:09:26.917328+0000","last_active":"2024-04-25T09:09:27.879193+0000","last_peered":"2024-04-25T09:09:27.879193+0000","last_clean":"2024-04-25T09:09:27.879193+0000","last_became_active":"2024-04-25T09:09:26.916317+0000","last_became_peered":"2024-04-25T09:09:26.916317+0000","last_unstale":"2024-04-25T09:09:27.879193+0000","last_undegraded":"2024-04-25T09:09:27.879193+0000","last_fullsized":"2024-04-25T09:09:27.879193+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:25.900567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878527+0000","last_change":"2024-04-25T09:09:26.893466+0000","last_active":"2024-04-25T09:09:27.878527+0000","last_peered":"2024-04-25T09:09:27.878527+0000","last_clean":"2024-04-25T09:09:27.878527+0000","last_became_active":"2024-04-25T09:09:26.893066+0000","last_became_peered":"2024-04-25T09:09:26.893066+0000","last_unstale":"2024-04-25T09:09:27.878527+0000","last_undegraded":"2024-04-25T09:09:27.878527+0000","last_fullsized":"2024-04-25T09:09:27.878527+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:30.604324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879051+0000","last_change":"2024-04-25T09:09:26.895964+0000","last_active":"2024-04-25T09:09:27.879051+0000","last_peered":"2024-04-25T09:09:27.879051+0000","last_clean":"2024-04-25T09:09:27.879051+0000","last_became_active":"2024-04-25T09:09:26.895695+0000","last_became_peered":"2024-04-25T09:09:26.895695+0000","last_unstale":"2024-04-25T09:09:27.879051+0000","last_undegraded":"2024-04-25T09:09:27.879051+0000","last_fullsized":"2024-04-25T09:09:27.879051+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:51.062011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694360+0000","last_change":"2024-04-25T09:09:26.913085+0000","last_active":"2024-04-25T09:09:28.694360+0000","last_peered":"2024-04-25T09:09:28.694360+0000","last_clean":"2024-04-25T09:09:28.694360+0000","last_became_active":"2024-04-25T09:09:26.912780+0000","last_became_peered":"2024-04-25T09:09:26.912780+0000","last_unstale":"2024-04-25T09:09:28.694360+0000","last_undegraded":"2024-04-25T09:09:28.694360+0000","last_fullsized":"2024-04-25T09:09:28.694360+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:11.765250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877970+0000","last_change":"2024-04-25T09:09:26.911169+0000","last_active":"2024-04-25T09:09:27.877970+0000","last_peered":"2024-04-25T09:09:27.877970+0000","last_clean":"2024-04-25T09:09:27.877970+0000","last_became_active":"2024-04-25T09:09:26.910649+0000","last_became_peered":"2024-04-25T09:09:26.910649+0000","last_unstale":"2024-04-25T09:09:27.877970+0000","last_undegraded":"2024-04-25T09:09:27.877970+0000","last_fullsized":"2024-04-25T09:09:27.877970+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:43.383066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694367+0000","last_change":"2024-04-25T09:09:26.909778+0000","last_active":"2024-04-25T09:09:28.694367+0000","last_peered":"2024-04-25T09:09:28.694367+0000","last_clean":"2024-04-25T09:09:28.694367+0000","last_became_active":"2024-04-25T09:09:26.909495+0000","last_became_peered":"2024-04-25T09:09:26.909495+0000","last_unstale":"2024-04-25T09:09:28.694367+0000","last_undegraded":"2024-04-25T09:09:28.694367+0000","last_fullsized":"2024-04-25T09:09:28.694367+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:15.564347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877754+0000","last_change":"2024-04-25T09:09:26.890288+0000","last_active":"2024-04-25T09:09:27.877754+0000","last_peered":"2024-04-25T09:09:27.877754+0000","last_clean":"2024-04-25T09:09:27.877754+0000","last_became_active":"2024-04-25T09:09:26.889997+0000","last_became_peered":"2024-04-25T09:09:26.889997+0000","last_unstale":"2024-04-25T09:09:27.877754+0000","last_undegraded":"2024-04-25T09:09:27.877754+0000","last_fullsized":"2024-04-25T09:09:27.877754+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:46.747064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878504+0000","last_change":"2024-04-25T09:09:26.890210+0000","last_active":"2024-04-25T09:09:27.878504+0000","last_peered":"2024-04-25T09:09:27.878504+0000","last_clean":"2024-04-25T09:09:27.878504+0000","last_became_active":"2024-04-25T09:09:26.889939+0000","last_became_peered":"2024-04-25T09:09:26.889939+0000","last_unstale":"2024-04-25T09:09:27.878504+0000","last_undegraded":"2024-04-25T09:09:27.878504+0000","last_fullsized":"2024-04-25T09:09:27.878504+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:23.740183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694624+0000","last_change":"2024-04-25T09:09:26.893150+0000","last_active":"2024-04-25T09:09:28.694624+0000","last_peered":"2024-04-25T09:09:28.694624+0000","last_clean":"2024-04-25T09:09:28.694624+0000","last_became_active":"2024-04-25T09:09:26.892878+0000","last_became_peered":"2024-04-25T09:09:26.892878+0000","last_unstale":"2024-04-25T09:09:28.694624+0000","last_undegraded":"2024-04-25T09:09:28.694624+0000","last_fullsized":"2024-04-25T09:09:28.694624+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:12.002802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878727+0000","last_change":"2024-04-25T09:09:26.907546+0000","last_active":"2024-04-25T09:09:27.878727+0000","last_peered":"2024-04-25T09:09:27.878727+0000","last_clean":"2024-04-25T09:09:27.878727+0000","last_became_active":"2024-04-25T09:09:26.907067+0000","last_became_peered":"2024-04-25T09:09:26.907067+0000","last_unstale":"2024-04-25T09:09:27.878727+0000","last_undegraded":"2024-04-25T09:09:27.878727+0000","last_fullsized":"2024-04-25T09:09:27.878727+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:16.612907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695210+0000","last_change":"2024-04-25T09:09:26.915859+0000","last_active":"2024-04-25T09:09:28.695210+0000","last_peered":"2024-04-25T09:09:28.695210+0000","last_clean":"2024-04-25T09:09:28.695210+0000","last_became_active":"2024-04-25T09:09:26.915582+0000","last_became_peered":"2024-04-25T09:09:26.915582+0000","last_unstale":"2024-04-25T09:09:28.695210+0000","last_undegraded":"2024-04-25T09:09:28.695210+0000","last_fullsized":"2024-04-25T09:09:28.695210+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:36.548327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878530+0000","last_change":"2024-04-25T09:09:26.889501+0000","last_active":"2024-04-25T09:09:27.878530+0000","last_peered":"2024-04-25T09:09:27.878530+0000","last_clean":"2024-04-25T09:09:27.878530+0000","last_became_active":"2024-04-25T09:09:26.889203+0000","last_became_peered":"2024-04-25T09:09:26.889203+0000","last_unstale":"2024-04-25T09:09:27.878530+0000","last_undegraded":"2024-04-25T09:09:27.878530+0000","last_fullsized":"2024-04-25T09:09:27.878530+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:47.910831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878007+0000","last_change":"2024-04-25T09:09:26.911728+0000","last_active":"2024-04-25T09:09:27.878007+0000","last_peered":"2024-04-25T09:09:27.878007+0000","last_clean":"2024-04-25T09:09:27.878007+0000","last_became_active":"2024-04-25T09:09:26.911326+0000","last_became_peered":"2024-04-25T09:09:26.911326+0000","last_unstale":"2024-04-25T09:09:27.878007+0000","last_undegraded":"2024-04-25T09:09:27.878007+0000","last_fullsized":"2024-04-25T09:09:27.878007+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:04.056308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694105+0000","last_change":"2024-04-25T09:09:26.911084+0000","last_active":"2024-04-25T09:09:28.694105+0000","last_peered":"2024-04-25T09:09:28.694105+0000","last_clean":"2024-04-25T09:09:28.694105+0000","last_became_active":"2024-04-25T09:09:26.910797+0000","last_became_peered":"2024-04-25T09:09:26.910797+0000","last_unstale":"2024-04-25T09:09:28.694105+0000","last_undegraded":"2024-04-25T09:09:28.694105+0000","last_fullsized":"2024-04-25T09:09:28.694105+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:39.999904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694346+0000","last_change":"2024-04-25T09:09:26.892545+0000","last_active":"2024-04-25T09:09:28.694346+0000","last_peered":"2024-04-25T09:09:28.694346+0000","last_clean":"2024-04-25T09:09:28.694346+0000","last_became_active":"2024-04-25T09:09:26.892292+0000","last_became_peered":"2024-04-25T09:09:26.892292+0000","last_unstale":"2024-04-25T09:09:28.694346+0000","last_undegraded":"2024-04-25T09:09:28.694346+0000","last_fullsized":"2024-04-25T09:09:28.694346+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:45.556771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694403+0000","last_change":"2024-04-25T09:09:26.891490+0000","last_active":"2024-04-25T09:09:28.694403+0000","last_peered":"2024-04-25T09:09:28.694403+0000","last_clean":"2024-04-25T09:09:28.694403+0000","last_became_active":"2024-04-25T09:09:26.890866+0000","last_became_peered":"2024-04-25T09:09:26.890866+0000","last_unstale":"2024-04-25T09:09:28.694403+0000","last_undegraded":"2024-04-25T09:09:28.694403+0000","last_fullsized":"2024-04-25T09:09:28.694403+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:47.875102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878629+0000","last_change":"2024-04-25T09:09:26.915924+0000","last_active":"2024-04-25T09:09:27.878629+0000","last_peered":"2024-04-25T09:09:27.878629+0000","last_clean":"2024-04-25T09:09:27.878629+0000","last_became_active":"2024-04-25T09:09:26.915617+0000","last_became_peered":"2024-04-25T09:09:26.915617+0000","last_unstale":"2024-04-25T09:09:27.878629+0000","last_undegraded":"2024-04-25T09:09:27.878629+0000","last_fullsized":"2024-04-25T09:09:27.878629+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:46.270829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879087+0000","last_change":"2024-04-25T09:09:26.900162+0000","last_active":"2024-04-25T09:09:27.879087+0000","last_peered":"2024-04-25T09:09:27.879087+0000","last_clean":"2024-04-25T09:09:27.879087+0000","last_became_active":"2024-04-25T09:09:26.899697+0000","last_became_peered":"2024-04-25T09:09:26.899697+0000","last_unstale":"2024-04-25T09:09:27.879087+0000","last_undegraded":"2024-04-25T09:09:27.879087+0000","last_fullsized":"2024-04-25T09:09:27.879087+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:41.618620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695320+0000","last_change":"2024-04-25T09:09:26.909249+0000","last_active":"2024-04-25T09:09:28.695320+0000","last_peered":"2024-04-25T09:09:28.695320+0000","last_clean":"2024-04-25T09:09:28.695320+0000","last_became_active":"2024-04-25T09:09:26.908995+0000","last_became_peered":"2024-04-25T09:09:26.908995+0000","last_unstale":"2024-04-25T09:09:28.695320+0000","last_undegraded":"2024-04-25T09:09:28.695320+0000","last_fullsized":"2024-04-25T09:09:28.695320+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:48.941318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.882413+0000","last_change":"2024-04-25T09:09:25.882413+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.882413+0000","last_undegraded":"2024-04-25T09:09:25.882413+0000","last_fullsized":"2024-04-25T09:09:25.882413+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878423+0000","last_change":"2024-04-25T09:09:26.892277+0000","last_active":"2024-04-25T09:09:27.878423+0000","last_peered":"2024-04-25T09:09:27.878423+0000","last_clean":"2024-04-25T09:09:27.878423+0000","last_became_active":"2024-04-25T09:09:26.891967+0000","last_became_peered":"2024-04-25T09:09:26.891967+0000","last_unstale":"2024-04-25T09:09:27.878423+0000","last_undegraded":"2024-04-25T09:09:27.878423+0000","last_fullsized":"2024-04-25T09:09:27.878423+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:15.199604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694617+0000","last_change":"2024-04-25T09:09:26.912200+0000","last_active":"2024-04-25T09:09:28.694617+0000","last_peered":"2024-04-25T09:09:28.694617+0000","last_clean":"2024-04-25T09:09:28.694617+0000","last_became_active":"2024-04-25T09:09:26.911878+0000","last_became_peered":"2024-04-25T09:09:26.911878+0000","last_unstale":"2024-04-25T09:09:28.694617+0000","last_undegraded":"2024-04-25T09:09:28.694617+0000","last_fullsized":"2024-04-25T09:09:28.694617+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:56.330021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877597+0000","last_change":"2024-04-25T09:09:26.890855+0000","last_active":"2024-04-25T09:09:27.877597+0000","last_peered":"2024-04-25T09:09:27.877597+0000","last_clean":"2024-04-25T09:09:27.877597+0000","last_became_active":"2024-04-25T09:09:26.890600+0000","last_became_peered":"2024-04-25T09:09:26.890600+0000","last_unstale":"2024-04-25T09:09:27.877597+0000","last_undegraded":"2024-04-25T09:09:27.877597+0000","last_fullsized":"2024-04-25T09:09:27.877597+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:29.370531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877890+0000","last_change":"2024-04-25T09:09:26.884423+0000","last_active":"2024-04-25T09:09:27.877890+0000","last_peered":"2024-04-25T09:09:27.877890+0000","last_clean":"2024-04-25T09:09:27.877890+0000","last_became_active":"2024-04-25T09:09:26.884029+0000","last_became_peered":"2024-04-25T09:09:26.884029+0000","last_unstale":"2024-04-25T09:09:27.877890+0000","last_undegraded":"2024-04-25T09:09:27.877890+0000","last_fullsized":"2024-04-25T09:09:27.877890+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:09.825442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"96'4","reported_seq":18,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695112+0000","last_change":"2024-04-25T09:09:25.891328+0000","last_active":"2024-04-25T09:09:28.695112+0000","last_peered":"2024-04-25T09:09:28.695112+0000","last_clean":"2024-04-25T09:09:28.695112+0000","last_became_active":"2024-04-25T09:09:25.891055+0000","last_became_peered":"2024-04-25T09:09:25.891055+0000","last_unstale":"2024-04-25T09:09:28.695112+0000","last_undegraded":"2024-04-25T09:09:28.695112+0000","last_fullsized":"2024-04-25T09:09:28.695112+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:26.020961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878066+0000","last_change":"2024-04-25T09:09:26.901370+0000","last_active":"2024-04-25T09:09:27.878066+0000","last_peered":"2024-04-25T09:09:27.878066+0000","last_clean":"2024-04-25T09:09:27.878066+0000","last_became_active":"2024-04-25T09:09:26.901014+0000","last_became_peered":"2024-04-25T09:09:26.901014+0000","last_unstale":"2024-04-25T09:09:27.878066+0000","last_undegraded":"2024-04-25T09:09:27.878066+0000","last_fullsized":"2024-04-25T09:09:27.878066+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:54.558905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878756+0000","last_change":"2024-04-25T09:09:25.891301+0000","last_active":"2024-04-25T09:09:27.878756+0000","last_peered":"2024-04-25T09:09:27.878756+0000","last_clean":"2024-04-25T09:09:27.878756+0000","last_became_active":"2024-04-25T09:09:25.891027+0000","last_became_peered":"2024-04-25T09:09:25.891027+0000","last_unstale":"2024-04-25T09:09:27.878756+0000","last_undegraded":"2024-04-25T09:09:27.878756+0000","last_fullsized":"2024-04-25T09:09:27.878756+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:29.460046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.883382+0000","last_change":"2024-04-25T09:09:25.883382+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.883382+0000","last_undegraded":"2024-04-25T09:09:25.883382+0000","last_fullsized":"2024-04-25T09:09:25.883382+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.896967+0000","last_change":"2024-04-25T09:09:25.895316+0000","last_active":"2024-04-25T09:09:25.896967+0000","last_peered":"2024-04-25T09:09:25.896967+0000","last_clean":"2024-04-25T09:09:25.896967+0000","last_became_active":"2024-04-25T09:09:25.895025+0000","last_became_peered":"2024-04-25T09:09:25.895025+0000","last_unstale":"2024-04-25T09:09:25.896967+0000","last_undegraded":"2024-04-25T09:09:25.896967+0000","last_fullsized":"2024-04-25T09:09:25.896967+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:12.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878561+0000","last_change":"2024-04-25T09:09:26.893173+0000","last_active":"2024-04-25T09:09:27.878561+0000","last_peered":"2024-04-25T09:09:27.878561+0000","last_clean":"2024-04-25T09:09:27.878561+0000","last_became_active":"2024-04-25T09:09:26.892420+0000","last_became_peered":"2024-04-25T09:09:26.892420+0000","last_unstale":"2024-04-25T09:09:27.878561+0000","last_undegraded":"2024-04-25T09:09:27.878561+0000","last_fullsized":"2024-04-25T09:09:27.878561+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:20.008848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694910+0000","last_change":"2024-04-25T09:09:25.893538+0000","last_active":"2024-04-25T09:09:28.694910+0000","last_peered":"2024-04-25T09:09:28.694910+0000","last_clean":"2024-04-25T09:09:28.694910+0000","last_became_active":"2024-04-25T09:09:25.893014+0000","last_became_peered":"2024-04-25T09:09:25.893014+0000","last_unstale":"2024-04-25T09:09:28.694910+0000","last_undegraded":"2024-04-25T09:09:28.694910+0000","last_fullsized":"2024-04-25T09:09:28.694910+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:10.295905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694427+0000","last_change":"2024-04-25T09:09:26.909690+0000","last_active":"2024-04-25T09:09:28.694427+0000","last_peered":"2024-04-25T09:09:28.694427+0000","last_clean":"2024-04-25T09:09:28.694427+0000","last_became_active":"2024-04-25T09:09:26.909399+0000","last_became_peered":"2024-04-25T09:09:26.909399+0000","last_unstale":"2024-04-25T09:09:28.694427+0000","last_undegraded":"2024-04-25T09:09:28.694427+0000","last_fullsized":"2024-04-25T09:09:28.694427+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:53.115977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878346+0000","last_change":"2024-04-25T09:09:25.888297+0000","last_active":"2024-04-25T09:09:27.878346+0000","last_peered":"2024-04-25T09:09:27.878346+0000","last_clean":"2024-04-25T09:09:27.878346+0000","last_became_active":"2024-04-25T09:09:25.887706+0000","last_became_peered":"2024-04-25T09:09:25.887706+0000","last_unstale":"2024-04-25T09:09:27.878346+0000","last_undegraded":"2024-04-25T09:09:27.878346+0000","last_fullsized":"2024-04-25T09:09:27.878346+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:00.496547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694277+0000","last_change":"2024-04-25T09:09:26.894500+0000","last_active":"2024-04-25T09:09:28.694277+0000","last_peered":"2024-04-25T09:09:28.694277+0000","last_clean":"2024-04-25T09:09:28.694277+0000","last_became_active":"2024-04-25T09:09:26.893339+0000","last_became_peered":"2024-04-25T09:09:26.893339+0000","last_unstale":"2024-04-25T09:09:28.694277+0000","last_undegraded":"2024-04-25T09:09:28.694277+0000","last_fullsized":"2024-04-25T09:09:28.694277+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:21.216175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695215+0000","last_change":"2024-04-25T09:09:25.888636+0000","last_active":"2024-04-25T09:09:28.695215+0000","last_peered":"2024-04-25T09:09:28.695215+0000","last_clean":"2024-04-25T09:09:28.695215+0000","last_became_active":"2024-04-25T09:09:25.888332+0000","last_became_peered":"2024-04-25T09:09:25.888332+0000","last_unstale":"2024-04-25T09:09:28.695215+0000","last_undegraded":"2024-04-25T09:09:28.695215+0000","last_fullsized":"2024-04-25T09:09:28.695215+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:59.063251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878062+0000","last_change":"2024-04-25T09:09:26.912804+0000","last_active":"2024-04-25T09:09:27.878062+0000","last_peered":"2024-04-25T09:09:27.878062+0000","last_clean":"2024-04-25T09:09:27.878062+0000","last_became_active":"2024-04-25T09:09:26.912208+0000","last_became_peered":"2024-04-25T09:09:26.912208+0000","last_unstale":"2024-04-25T09:09:27.878062+0000","last_undegraded":"2024-04-25T09:09:27.878062+0000","last_fullsized":"2024-04-25T09:09:27.878062+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:33:39.777394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694925+0000","last_change":"2024-04-25T09:09:25.891312+0000","last_active":"2024-04-25T09:09:28.694925+0000","last_peered":"2024-04-25T09:09:28.694925+0000","last_clean":"2024-04-25T09:09:28.694925+0000","last_became_active":"2024-04-25T09:09:25.890959+0000","last_became_peered":"2024-04-25T09:09:25.890959+0000","last_unstale":"2024-04-25T09:09:28.694925+0000","last_undegraded":"2024-04-25T09:09:28.694925+0000","last_fullsized":"2024-04-25T09:09:28.694925+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:12.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694573+0000","last_change":"2024-04-25T09:09:26.907307+0000","last_active":"2024-04-25T09:09:28.694573+0000","last_peered":"2024-04-25T09:09:28.694573+0000","last_clean":"2024-04-25T09:09:28.694573+0000","last_became_active":"2024-04-25T09:09:26.907053+0000","last_became_peered":"2024-04-25T09:09:26.907053+0000","last_unstale":"2024-04-25T09:09:28.694573+0000","last_undegraded":"2024-04-25T09:09:28.694573+0000","last_fullsized":"2024-04-25T09:09:28.694573+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:48.603667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.896738+0000","last_change":"2024-04-25T09:09:25.893856+0000","last_active":"2024-04-25T09:09:25.896738+0000","last_peered":"2024-04-25T09:09:25.896738+0000","last_clean":"2024-04-25T09:09:25.896738+0000","last_became_active":"2024-04-25T09:09:25.893562+0000","last_became_peered":"2024-04-25T09:09:25.893562+0000","last_unstale":"2024-04-25T09:09:25.896738+0000","last_undegraded":"2024-04-25T09:09:25.896738+0000","last_fullsized":"2024-04-25T09:09:25.896738+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:19.211371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878454+0000","last_change":"2024-04-25T09:09:26.895908+0000","last_active":"2024-04-25T09:09:27.878454+0000","last_peered":"2024-04-25T09:09:27.878454+0000","last_clean":"2024-04-25T09:09:27.878454+0000","last_became_active":"2024-04-25T09:09:26.895544+0000","last_became_peered":"2024-04-25T09:09:26.895544+0000","last_unstale":"2024-04-25T09:09:27.878454+0000","last_undegraded":"2024-04-25T09:09:27.878454+0000","last_fullsized":"2024-04-25T09:09:27.878454+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:15.682654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694584+0000","last_change":"2024-04-25T09:09:25.892399+0000","last_active":"2024-04-25T09:09:28.694584+0000","last_peered":"2024-04-25T09:09:28.694584+0000","last_clean":"2024-04-25T09:09:28.694584+0000","last_became_active":"2024-04-25T09:09:25.892107+0000","last_became_peered":"2024-04-25T09:09:25.892107+0000","last_unstale":"2024-04-25T09:09:28.694584+0000","last_undegraded":"2024-04-25T09:09:28.694584+0000","last_fullsized":"2024-04-25T09:09:28.694584+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:14.676493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.882297+0000","last_change":"2024-04-25T09:09:25.882297+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.882297+0000","last_undegraded":"2024-04-25T09:09:25.882297+0000","last_fullsized":"2024-04-25T09:09:25.882297+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694758+0000","last_change":"2024-04-25T09:09:25.891693+0000","last_active":"2024-04-25T09:09:28.694758+0000","last_peered":"2024-04-25T09:09:28.694758+0000","last_clean":"2024-04-25T09:09:28.694758+0000","last_became_active":"2024-04-25T09:09:25.891465+0000","last_became_peered":"2024-04-25T09:09:25.891465+0000","last_unstale":"2024-04-25T09:09:28.694758+0000","last_undegraded":"2024-04-25T09:09:28.694758+0000","last_fullsized":"2024-04-25T09:09:28.694758+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:26.140967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694812+0000","last_change":"2024-04-25T09:09:26.897388+0000","last_active":"2024-04-25T09:09:28.694812+0000","last_peered":"2024-04-25T09:09:28.694812+0000","last_clean":"2024-04-25T09:09:28.694812+0000","last_became_active":"2024-04-25T09:09:26.897138+0000","last_became_peered":"2024-04-25T09:09:26.897138+0000","last_unstale":"2024-04-25T09:09:28.694812+0000","last_undegraded":"2024-04-25T09:09:28.694812+0000","last_fullsized":"2024-04-25T09:09:28.694812+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:07.845041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"96'3","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878807+0000","last_change":"2024-04-25T09:09:25.890611+0000","last_active":"2024-04-25T09:09:27.878807+0000","last_peered":"2024-04-25T09:09:27.878807+0000","last_clean":"2024-04-25T09:09:27.878807+0000","last_became_active":"2024-04-25T09:09:25.889897+0000","last_became_peered":"2024-04-25T09:09:25.889897+0000","last_unstale":"2024-04-25T09:09:27.878807+0000","last_undegraded":"2024-04-25T09:09:27.878807+0000","last_fullsized":"2024-04-25T09:09:27.878807+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:00.689979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695142+0000","last_change":"2024-04-25T09:09:26.906211+0000","last_active":"2024-04-25T09:09:28.695142+0000","last_peered":"2024-04-25T09:09:28.695142+0000","last_clean":"2024-04-25T09:09:28.695142+0000","last_became_active":"2024-04-25T09:09:26.905774+0000","last_became_peered":"2024-04-25T09:09:26.905774+0000","last_unstale":"2024-04-25T09:09:28.695142+0000","last_undegraded":"2024-04-25T09:09:28.695142+0000","last_fullsized":"2024-04-25T09:09:28.695142+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:39.497239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"96'6","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878178+0000","last_change":"2024-04-25T09:09:25.892734+0000","last_active":"2024-04-25T09:09:27.878178+0000","last_peered":"2024-04-25T09:09:27.878178+0000","last_clean":"2024-04-25T09:09:27.878178+0000","last_became_active":"2024-04-25T09:09:25.892486+0000","last_became_peered":"2024-04-25T09:09:25.892486+0000","last_unstale":"2024-04-25T09:09:27.878178+0000","last_undegraded":"2024-04-25T09:09:27.878178+0000","last_fullsized":"2024-04-25T09:09:27.878178+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:28.617165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694564+0000","last_change":"2024-04-25T09:09:26.914455+0000","last_active":"2024-04-25T09:09:28.694564+0000","last_peered":"2024-04-25T09:09:28.694564+0000","last_clean":"2024-04-25T09:09:28.694564+0000","last_became_active":"2024-04-25T09:09:26.912881+0000","last_became_peered":"2024-04-25T09:09:26.912881+0000","last_unstale":"2024-04-25T09:09:28.694564+0000","last_undegraded":"2024-04-25T09:09:28.694564+0000","last_fullsized":"2024-04-25T09:09:28.694564+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:32.128756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.897005+0000","last_change":"2024-04-25T09:09:25.895891+0000","last_active":"2024-04-25T09:09:25.897005+0000","last_peered":"2024-04-25T09:09:25.897005+0000","last_clean":"2024-04-25T09:09:25.897005+0000","last_became_active":"2024-04-25T09:09:25.894219+0000","last_became_peered":"2024-04-25T09:09:25.894219+0000","last_unstale":"2024-04-25T09:09:25.897005+0000","last_undegraded":"2024-04-25T09:09:25.897005+0000","last_fullsized":"2024-04-25T09:09:25.897005+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:26.140967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877982+0000","last_change":"2024-04-25T09:09:26.882098+0000","last_active":"2024-04-25T09:09:27.877982+0000","last_peered":"2024-04-25T09:09:27.877982+0000","last_clean":"2024-04-25T09:09:27.877982+0000","last_became_active":"2024-04-25T09:09:26.881774+0000","last_became_peered":"2024-04-25T09:09:26.881774+0000","last_unstale":"2024-04-25T09:09:27.877982+0000","last_undegraded":"2024-04-25T09:09:27.877982+0000","last_fullsized":"2024-04-25T09:09:27.877982+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:38.604466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877730+0000","last_change":"2024-04-25T09:09:25.888905+0000","last_active":"2024-04-25T09:09:27.877730+0000","last_peered":"2024-04-25T09:09:27.877730+0000","last_clean":"2024-04-25T09:09:27.877730+0000","last_became_active":"2024-04-25T09:09:25.887974+0000","last_became_peered":"2024-04-25T09:09:25.887974+0000","last_unstale":"2024-04-25T09:09:27.877730+0000","last_undegraded":"2024-04-25T09:09:27.877730+0000","last_fullsized":"2024-04-25T09:09:27.877730+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:15.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879185+0000","last_change":"2024-04-25T09:09:26.916502+0000","last_active":"2024-04-25T09:09:27.879185+0000","last_peered":"2024-04-25T09:09:27.879185+0000","last_clean":"2024-04-25T09:09:27.879185+0000","last_became_active":"2024-04-25T09:09:26.916269+0000","last_became_peered":"2024-04-25T09:09:26.916269+0000","last_unstale":"2024-04-25T09:09:27.879185+0000","last_undegraded":"2024-04-25T09:09:27.879185+0000","last_fullsized":"2024-04-25T09:09:27.879185+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:29.397203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694554+0000","last_change":"2024-04-25T09:09:25.893744+0000","last_active":"2024-04-25T09:09:28.694554+0000","last_peered":"2024-04-25T09:09:28.694554+0000","last_clean":"2024-04-25T09:09:28.694554+0000","last_became_active":"2024-04-25T09:09:25.892844+0000","last_became_peered":"2024-04-25T09:09:25.892844+0000","last_unstale":"2024-04-25T09:09:28.694554+0000","last_undegraded":"2024-04-25T09:09:28.694554+0000","last_fullsized":"2024-04-25T09:09:28.694554+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:56.231571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879077+0000","last_change":"2024-04-25T09:09:26.898749+0000","last_active":"2024-04-25T09:09:27.879077+0000","last_peered":"2024-04-25T09:09:27.879077+0000","last_clean":"2024-04-25T09:09:27.879077+0000","last_became_active":"2024-04-25T09:09:26.898150+0000","last_became_peered":"2024-04-25T09:09:26.898150+0000","last_unstale":"2024-04-25T09:09:27.879077+0000","last_undegraded":"2024-04-25T09:09:27.879077+0000","last_fullsized":"2024-04-25T09:09:27.879077+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:03.772159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"96'8","reported_seq":22,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694543+0000","last_change":"2024-04-25T09:09:25.894818+0000","last_active":"2024-04-25T09:09:28.694543+0000","last_peered":"2024-04-25T09:09:28.694543+0000","last_clean":"2024-04-25T09:09:28.694543+0000","last_became_active":"2024-04-25T09:09:25.894535+0000","last_became_peered":"2024-04-25T09:09:25.894535+0000","last_unstale":"2024-04-25T09:09:28.694543+0000","last_undegraded":"2024-04-25T09:09:28.694543+0000","last_fullsized":"2024-04-25T09:09:28.694543+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:36.631220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878063+0000","last_change":"2024-04-25T09:09:26.892885+0000","last_active":"2024-04-25T09:09:27.878063+0000","last_peered":"2024-04-25T09:09:27.878063+0000","last_clean":"2024-04-25T09:09:27.878063+0000","last_became_active":"2024-04-25T09:09:26.892623+0000","last_became_peered":"2024-04-25T09:09:26.892623+0000","last_unstale":"2024-04-25T09:09:27.878063+0000","last_undegraded":"2024-04-25T09:09:27.878063+0000","last_fullsized":"2024-04-25T09:09:27.878063+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:14.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695130+0000","last_change":"2024-04-25T09:09:25.893625+0000","last_active":"2024-04-25T09:09:28.695130+0000","last_peered":"2024-04-25T09:09:28.695130+0000","last_clean":"2024-04-25T09:09:28.695130+0000","last_became_active":"2024-04-25T09:09:25.893276+0000","last_became_peered":"2024-04-25T09:09:25.893276+0000","last_unstale":"2024-04-25T09:09:28.695130+0000","last_undegraded":"2024-04-25T09:09:28.695130+0000","last_fullsized":"2024-04-25T09:09:28.695130+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:29.598163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695021+0000","last_change":"2024-04-25T09:09:26.891031+0000","last_active":"2024-04-25T09:09:28.695021+0000","last_peered":"2024-04-25T09:09:28.695021+0000","last_clean":"2024-04-25T09:09:28.695021+0000","last_became_active":"2024-04-25T09:09:26.890788+0000","last_became_peered":"2024-04-25T09:09:26.890788+0000","last_unstale":"2024-04-25T09:09:28.695021+0000","last_undegraded":"2024-04-25T09:09:28.695021+0000","last_fullsized":"2024-04-25T09:09:28.695021+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:09.501598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.898067+0000","last_change":"2024-04-25T09:09:25.897420+0000","last_active":"2024-04-25T09:09:25.898067+0000","last_peered":"2024-04-25T09:09:25.898067+0000","last_clean":"2024-04-25T09:09:25.898067+0000","last_became_active":"2024-04-25T09:09:25.896968+0000","last_became_peered":"2024-04-25T09:09:25.896968+0000","last_unstale":"2024-04-25T09:09:25.898067+0000","last_undegraded":"2024-04-25T09:09:25.898067+0000","last_fullsized":"2024-04-25T09:09:25.898067+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:54.038096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878728+0000","last_change":"2024-04-25T09:09:26.902520+0000","last_active":"2024-04-25T09:09:27.878728+0000","last_peered":"2024-04-25T09:09:27.878728+0000","last_clean":"2024-04-25T09:09:27.878728+0000","last_became_active":"2024-04-25T09:09:26.902128+0000","last_became_peered":"2024-04-25T09:09:26.902128+0000","last_unstale":"2024-04-25T09:09:27.878728+0000","last_undegraded":"2024-04-25T09:09:27.878728+0000","last_fullsized":"2024-04-25T09:09:27.878728+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:04.360175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878847+0000","last_change":"2024-04-25T09:09:25.890897+0000","last_active":"2024-04-25T09:09:27.878847+0000","last_peered":"2024-04-25T09:09:27.878847+0000","last_clean":"2024-04-25T09:09:27.878847+0000","last_became_active":"2024-04-25T09:09:25.890283+0000","last_became_peered":"2024-04-25T09:09:25.890283+0000","last_unstale":"2024-04-25T09:09:27.878847+0000","last_undegraded":"2024-04-25T09:09:27.878847+0000","last_fullsized":"2024-04-25T09:09:27.878847+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:13.142222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877758+0000","last_change":"2024-04-25T09:09:26.910678+0000","last_active":"2024-04-25T09:09:27.877758+0000","last_peered":"2024-04-25T09:09:27.877758+0000","last_clean":"2024-04-25T09:09:27.877758+0000","last_became_active":"2024-04-25T09:09:26.910403+0000","last_became_peered":"2024-04-25T09:09:26.910403+0000","last_unstale":"2024-04-25T09:09:27.877758+0000","last_undegraded":"2024-04-25T09:09:27.877758+0000","last_fullsized":"2024-04-25T09:09:27.877758+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:43.004790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.693883+0000","last_change":"2024-04-25T09:09:25.889771+0000","last_active":"2024-04-25T09:09:28.693883+0000","last_peered":"2024-04-25T09:09:28.693883+0000","last_clean":"2024-04-25T09:09:28.693883+0000","last_became_active":"2024-04-25T09:09:25.889426+0000","last_became_peered":"2024-04-25T09:09:25.889426+0000","last_unstale":"2024-04-25T09:09:28.693883+0000","last_undegraded":"2024-04-25T09:09:28.693883+0000","last_fullsized":"2024-04-25T09:09:28.693883+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:14.193442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.693923+0000","last_change":"2024-04-25T09:09:26.895859+0000","last_active":"2024-04-25T09:09:28.693923+0000","last_peered":"2024-04-25T09:09:28.693923+0000","last_clean":"2024-04-25T09:09:28.693923+0000","last_became_active":"2024-04-25T09:09:26.895588+0000","last_became_peered":"2024-04-25T09:09:26.895588+0000","last_unstale":"2024-04-25T09:09:28.693923+0000","last_undegraded":"2024-04-25T09:09:28.693923+0000","last_fullsized":"2024-04-25T09:09:28.693923+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:39.999904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879040+0000","last_change":"2024-04-25T09:09:25.894259+0000","last_active":"2024-04-25T09:09:27.879040+0000","last_peered":"2024-04-25T09:09:27.879040+0000","last_clean":"2024-04-25T09:09:27.879040+0000","last_became_active":"2024-04-25T09:09:25.893924+0000","last_became_peered":"2024-04-25T09:09:25.893924+0000","last_unstale":"2024-04-25T09:09:27.879040+0000","last_undegraded":"2024-04-25T09:09:27.879040+0000","last_fullsized":"2024-04-25T09:09:27.879040+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:06.938535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694592+0000","last_change":"2024-04-25T09:09:26.912210+0000","last_active":"2024-04-25T09:09:28.694592+0000","last_peered":"2024-04-25T09:09:28.694592+0000","last_clean":"2024-04-25T09:09:28.694592+0000","last_became_active":"2024-04-25T09:09:26.911858+0000","last_became_peered":"2024-04-25T09:09:26.911858+0000","last_unstale":"2024-04-25T09:09:28.694592+0000","last_undegraded":"2024-04-25T09:09:28.694592+0000","last_fullsized":"2024-04-25T09:09:28.694592+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:09.501598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694050+0000","last_change":"2024-04-25T09:09:25.888456+0000","last_active":"2024-04-25T09:09:28.694050+0000","last_peered":"2024-04-25T09:09:28.694050+0000","last_clean":"2024-04-25T09:09:28.694050+0000","last_became_active":"2024-04-25T09:09:25.888121+0000","last_became_peered":"2024-04-25T09:09:25.888121+0000","last_unstale":"2024-04-25T09:09:28.694050+0000","last_undegraded":"2024-04-25T09:09:28.694050+0000","last_fullsized":"2024-04-25T09:09:28.694050+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:10.295905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878097+0000","last_change":"2024-04-25T09:09:26.893393+0000","last_active":"2024-04-25T09:09:27.878097+0000","last_peered":"2024-04-25T09:09:27.878097+0000","last_clean":"2024-04-25T09:09:27.878097+0000","last_became_active":"2024-04-25T09:09:26.892289+0000","last_became_peered":"2024-04-25T09:09:26.892289+0000","last_unstale":"2024-04-25T09:09:27.878097+0000","last_undegraded":"2024-04-25T09:09:27.878097+0000","last_fullsized":"2024-04-25T09:09:27.878097+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:06.636882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878720+0000","last_change":"2024-04-25T09:09:25.883924+0000","last_active":"2024-04-25T09:09:27.878720+0000","last_peered":"2024-04-25T09:09:27.878720+0000","last_clean":"2024-04-25T09:09:27.878720+0000","last_became_active":"2024-04-25T09:09:25.883059+0000","last_became_peered":"2024-04-25T09:09:25.883059+0000","last_unstale":"2024-04-25T09:09:27.878720+0000","last_undegraded":"2024-04-25T09:09:27.878720+0000","last_fullsized":"2024-04-25T09:09:27.878720+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:20.403420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694644+0000","last_change":"2024-04-25T09:09:26.890528+0000","last_active":"2024-04-25T09:09:28.694644+0000","last_peered":"2024-04-25T09:09:28.694644+0000","last_clean":"2024-04-25T09:09:28.694644+0000","last_became_active":"2024-04-25T09:09:26.889103+0000","last_became_peered":"2024-04-25T09:09:26.889103+0000","last_unstale":"2024-04-25T09:09:28.694644+0000","last_undegraded":"2024-04-25T09:09:28.694644+0000","last_fullsized":"2024-04-25T09:09:28.694644+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:15.833064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.897033+0000","last_change":"2024-04-25T09:09:25.895283+0000","last_active":"2024-04-25T09:09:25.897033+0000","last_peered":"2024-04-25T09:09:25.897033+0000","last_clean":"2024-04-25T09:09:25.897033+0000","last_became_active":"2024-04-25T09:09:25.894675+0000","last_became_peered":"2024-04-25T09:09:25.894675+0000","last_unstale":"2024-04-25T09:09:25.897033+0000","last_undegraded":"2024-04-25T09:09:25.897033+0000","last_fullsized":"2024-04-25T09:09:25.897033+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:54.808752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878253+0000","last_change":"2024-04-25T09:09:26.884176+0000","last_active":"2024-04-25T09:09:27.878253+0000","last_peered":"2024-04-25T09:09:27.878253+0000","last_clean":"2024-04-25T09:09:27.878253+0000","last_became_active":"2024-04-25T09:09:26.883416+0000","last_became_peered":"2024-04-25T09:09:26.883416+0000","last_unstale":"2024-04-25T09:09:27.878253+0000","last_undegraded":"2024-04-25T09:09:27.878253+0000","last_fullsized":"2024-04-25T09:09:27.878253+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:16.248502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"97'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.881364+0000","last_change":"2024-04-25T09:09:25.888575+0000","last_active":"2024-04-25T09:09:28.881364+0000","last_peered":"2024-04-25T09:09:28.881364+0000","last_clean":"2024-04-25T09:09:28.881364+0000","last_became_active":"2024-04-25T09:09:25.888130+0000","last_became_peered":"2024-04-25T09:09:25.888130+0000","last_unstale":"2024-04-25T09:09:28.881364+0000","last_undegraded":"2024-04-25T09:09:28.881364+0000","last_fullsized":"2024-04-25T09:09:28.881364+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:22.025116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878336+0000","last_change":"2024-04-25T09:09:26.907788+0000","last_active":"2024-04-25T09:09:27.878336+0000","last_peered":"2024-04-25T09:09:27.878336+0000","last_clean":"2024-04-25T09:09:27.878336+0000","last_became_active":"2024-04-25T09:09:26.907509+0000","last_became_peered":"2024-04-25T09:09:26.907509+0000","last_unstale":"2024-04-25T09:09:27.878336+0000","last_undegraded":"2024-04-25T09:09:27.878336+0000","last_fullsized":"2024-04-25T09:09:27.878336+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:59.022383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878920+0000","last_change":"2024-04-25T09:09:25.885545+0000","last_active":"2024-04-25T09:09:27.878920+0000","last_peered":"2024-04-25T09:09:27.878920+0000","last_clean":"2024-04-25T09:09:27.878920+0000","last_became_active":"2024-04-25T09:09:25.885204+0000","last_became_peered":"2024-04-25T09:09:25.885204+0000","last_unstale":"2024-04-25T09:09:27.878920+0000","last_undegraded":"2024-04-25T09:09:27.878920+0000","last_fullsized":"2024-04-25T09:09:27.878920+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:33.311698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694576+0000","last_change":"2024-04-25T09:09:26.891717+0000","last_active":"2024-04-25T09:09:28.694576+0000","last_peered":"2024-04-25T09:09:28.694576+0000","last_clean":"2024-04-25T09:09:28.694576+0000","last_became_active":"2024-04-25T09:09:26.891183+0000","last_became_peered":"2024-04-25T09:09:26.891183+0000","last_unstale":"2024-04-25T09:09:28.694576+0000","last_undegraded":"2024-04-25T09:09:28.694576+0000","last_fullsized":"2024-04-25T09:09:28.694576+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:15.833064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694888+0000","last_change":"2024-04-25T09:09:25.890769+0000","last_active":"2024-04-25T09:09:28.694888+0000","last_peered":"2024-04-25T09:09:28.694888+0000","last_clean":"2024-04-25T09:09:28.694888+0000","last_became_active":"2024-04-25T09:09:25.890367+0000","last_became_peered":"2024-04-25T09:09:25.890367+0000","last_unstale":"2024-04-25T09:09:28.694888+0000","last_undegraded":"2024-04-25T09:09:28.694888+0000","last_fullsized":"2024-04-25T09:09:28.694888+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:14.193442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878771+0000","last_change":"2024-04-25T09:09:26.899314+0000","last_active":"2024-04-25T09:09:27.878771+0000","last_peered":"2024-04-25T09:09:27.878771+0000","last_clean":"2024-04-25T09:09:27.878771+0000","last_became_active":"2024-04-25T09:09:26.898556+0000","last_became_peered":"2024-04-25T09:09:26.898556+0000","last_unstale":"2024-04-25T09:09:27.878771+0000","last_undegraded":"2024-04-25T09:09:27.878771+0000","last_fullsized":"2024-04-25T09:09:27.878771+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:14.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877854+0000","last_change":"2024-04-25T09:09:25.887331+0000","last_active":"2024-04-25T09:09:27.877854+0000","last_peered":"2024-04-25T09:09:27.877854+0000","last_clean":"2024-04-25T09:09:27.877854+0000","last_became_active":"2024-04-25T09:09:25.886093+0000","last_became_peered":"2024-04-25T09:09:25.886093+0000","last_unstale":"2024-04-25T09:09:27.877854+0000","last_undegraded":"2024-04-25T09:09:27.877854+0000","last_fullsized":"2024-04-25T09:09:27.877854+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:23:28.244528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694280+0000","last_change":"2024-04-25T09:09:26.910027+0000","last_active":"2024-04-25T09:09:28.694280+0000","last_peered":"2024-04-25T09:09:28.694280+0000","last_clean":"2024-04-25T09:09:28.694280+0000","last_became_active":"2024-04-25T09:09:26.909711+0000","last_became_peered":"2024-04-25T09:09:26.909711+0000","last_unstale":"2024-04-25T09:09:28.694280+0000","last_undegraded":"2024-04-25T09:09:28.694280+0000","last_fullsized":"2024-04-25T09:09:28.694280+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:27.191034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694700+0000","last_change":"2024-04-25T09:09:25.888899+0000","last_active":"2024-04-25T09:09:28.694700+0000","last_peered":"2024-04-25T09:09:28.694700+0000","last_clean":"2024-04-25T09:09:28.694700+0000","last_became_active":"2024-04-25T09:09:25.887727+0000","last_became_peered":"2024-04-25T09:09:25.887727+0000","last_unstale":"2024-04-25T09:09:28.694700+0000","last_undegraded":"2024-04-25T09:09:28.694700+0000","last_fullsized":"2024-04-25T09:09:28.694700+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:26.020961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694318+0000","last_change":"2024-04-25T09:09:26.911233+0000","last_active":"2024-04-25T09:09:28.694318+0000","last_peered":"2024-04-25T09:09:28.694318+0000","last_clean":"2024-04-25T09:09:28.694318+0000","last_became_active":"2024-04-25T09:09:26.910962+0000","last_became_peered":"2024-04-25T09:09:26.910962+0000","last_unstale":"2024-04-25T09:09:28.694318+0000","last_undegraded":"2024-04-25T09:09:28.694318+0000","last_fullsized":"2024-04-25T09:09:28.694318+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:47.875102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694383+0000","last_change":"2024-04-25T09:09:25.886416+0000","last_active":"2024-04-25T09:09:28.694383+0000","last_peered":"2024-04-25T09:09:28.694383+0000","last_clean":"2024-04-25T09:09:28.694383+0000","last_became_active":"2024-04-25T09:09:25.886138+0000","last_became_peered":"2024-04-25T09:09:25.886138+0000","last_unstale":"2024-04-25T09:09:28.694383+0000","last_undegraded":"2024-04-25T09:09:28.694383+0000","last_fullsized":"2024-04-25T09:09:28.694383+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:14.676493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877763+0000","last_change":"2024-04-25T09:09:26.895912+0000","last_active":"2024-04-25T09:09:27.877763+0000","last_peered":"2024-04-25T09:09:27.877763+0000","last_clean":"2024-04-25T09:09:27.877763+0000","last_became_active":"2024-04-25T09:09:26.894861+0000","last_became_peered":"2024-04-25T09:09:26.894861+0000","last_unstale":"2024-04-25T09:09:27.877763+0000","last_undegraded":"2024-04-25T09:09:27.877763+0000","last_fullsized":"2024-04-25T09:09:27.877763+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:20.609762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.897356+0000","last_change":"2024-04-25T09:09:25.896492+0000","last_active":"2024-04-25T09:09:25.897356+0000","last_peered":"2024-04-25T09:09:25.897356+0000","last_clean":"2024-04-25T09:09:25.897356+0000","last_became_active":"2024-04-25T09:09:25.896219+0000","last_became_peered":"2024-04-25T09:09:25.896219+0000","last_unstale":"2024-04-25T09:09:25.897356+0000","last_undegraded":"2024-04-25T09:09:25.897356+0000","last_fullsized":"2024-04-25T09:09:25.897356+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:44.101788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.882446+0000","last_change":"2024-04-25T09:09:25.882446+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.882446+0000","last_undegraded":"2024-04-25T09:09:25.882446+0000","last_fullsized":"2024-04-25T09:09:25.882446+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695290+0000","last_change":"2024-04-25T09:09:25.896662+0000","last_active":"2024-04-25T09:09:28.695290+0000","last_peered":"2024-04-25T09:09:28.695290+0000","last_clean":"2024-04-25T09:09:28.695290+0000","last_became_active":"2024-04-25T09:09:25.896367+0000","last_became_peered":"2024-04-25T09:09:25.896367+0000","last_unstale":"2024-04-25T09:09:28.695290+0000","last_undegraded":"2024-04-25T09:09:28.695290+0000","last_fullsized":"2024-04-25T09:09:28.695290+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:27.332997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":305,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.886563+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:09:25.886563+0000","last_peered":"2024-04-25T09:09:25.886563+0000","last_clean":"2024-04-25T09:09:25.886563+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:09:25.886563+0000","last_undegraded":"2024-04-25T09:09:25.886563+0000","last_fullsized":"2024-04-25T09:09:25.886563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2376,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509525,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50404,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321436,"statfs":{"total":96636764160,"available":96585150464,"internally_reserved":0,"allocated":1196032,"data_stored":545265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509525,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46224,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325616,"statfs":{"total":96636764160,"available":96589430784,"internally_reserved":0,"allocated":1175552,"data_stored":543049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509526,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54560,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317280,"statfs":{"total":96636764160,"available":96580894720,"internally_reserved":0,"allocated":1196032,"data_stored":549901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509525,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54540,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317300,"statfs":{"total":96636764160,"available":96580915200,"internally_reserved":0,"allocated":1175552,"data_stored":543049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509525,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50388,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321452,"statfs":{"total":96636764160,"available":96585166848,"internally_reserved":0,"allocated":1187840,"data_stored":549741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509526,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46236,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325604,"statfs":{"total":96636764160,"available":96589418496,"internally_reserved":0,"allocated":1191936,"data_stored":549811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509526,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50996,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320844,"statfs":{"total":96636764160,"available":96584544256,"internally_reserved":0,"allocated":1806336,"data_stored":1142427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574933,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46792,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325048,"statfs":{"total":96636764160,"available":96588849152,"internally_reserved":0,"allocated":1757184,"data_stored":1126250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:09:31.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.39 is not active+clean 2024-04-25T09:09:31.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 95, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:09:25.882866+0000', 'last_change': '2024-04-25T09:09:25.882866+0000', 'last_active': '2024-04-25T09:09:25.862960+0000', 'last_peered': '2024-04-25T09:09:25.862960+0000', 'last_clean': '2024-04-25T09:09:25.862960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:09:25.882866+0000', 'last_undegraded': '2024-04-25T09:09:25.882866+0000', 'last_fullsized': '2024-04-25T09:09:25.882866+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:09:25.862960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:09:25.862960+0000', 'last_clean_scrub_stamp': '2024-04-25T09:09:25.862960+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:09:31.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.23 is not active+clean 2024-04-25T09:09:31.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 95, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:09:25.882413+0000', 'last_change': '2024-04-25T09:09:25.882413+0000', 'last_active': '2024-04-25T09:09:25.862960+0000', 'last_peered': '2024-04-25T09:09:25.862960+0000', 'last_clean': '2024-04-25T09:09:25.862960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:09:25.882413+0000', 'last_undegraded': '2024-04-25T09:09:25.882413+0000', 'last_fullsized': '2024-04-25T09:09:25.882413+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:09:25.862960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:09:25.862960+0000', 'last_clean_scrub_stamp': '2024-04-25T09:09:25.862960+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:09:31.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2024-04-25T09:09:31.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 95, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:09:25.883382+0000', 'last_change': '2024-04-25T09:09:25.883382+0000', 'last_active': '2024-04-25T09:09:25.862960+0000', 'last_peered': '2024-04-25T09:09:25.862960+0000', 'last_clean': '2024-04-25T09:09:25.862960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:09:25.883382+0000', 'last_undegraded': '2024-04-25T09:09:25.883382+0000', 'last_fullsized': '2024-04-25T09:09:25.883382+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:09:25.862960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:09:25.862960+0000', 'last_clean_scrub_stamp': '2024-04-25T09:09:25.862960+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:09:31.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2024-04-25T09:09:31.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 95, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:09:25.882297+0000', 'last_change': '2024-04-25T09:09:25.882297+0000', 'last_active': '2024-04-25T09:09:25.862960+0000', 'last_peered': '2024-04-25T09:09:25.862960+0000', 'last_clean': '2024-04-25T09:09:25.862960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:09:25.882297+0000', 'last_undegraded': '2024-04-25T09:09:25.882297+0000', 'last_fullsized': '2024-04-25T09:09:25.882297+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:09:25.862960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:09:25.862960+0000', 'last_clean_scrub_stamp': '2024-04-25T09:09:25.862960+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:09:31.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2024-04-25T09:09:31.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 95, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:09:25.882446+0000', 'last_change': '2024-04-25T09:09:25.882446+0000', 'last_active': '2024-04-25T09:09:25.862960+0000', 'last_peered': '2024-04-25T09:09:25.862960+0000', 'last_clean': '2024-04-25T09:09:25.862960+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:09:25.882446+0000', 'last_undegraded': '2024-04-25T09:09:25.882446+0000', 'last_fullsized': '2024-04-25T09:09:25.882446+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:09:25.862960+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:09:25.862960+0000', 'last_clean_scrub_stamp': '2024-04-25T09:09:25.862960+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:09:31.695 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:09:31.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.880+0000 7fa069000640 1 Processor -- start 2024-04-25T09:09:31.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.880+0000 7fa069000640 1 -- start start 2024-04-25T09:09:31.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.880+0000 7fa069000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa06415a180 0x7fa0640b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.880+0000 7fa069000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06406e860 con 0x7fa064071a30 2024-04-25T09:09:31.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.880+0000 7fa069000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06406eb20 con 0x7fa0640b2ca0 2024-04-25T09:09:31.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.880+0000 7fa069000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640af230 con 0x7fa06415a180 2024-04-25T09:09:31.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.880+0000 7fa062800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa064071a30 0x7fa06406d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:60636/0 (socket says 172.21.15.173:60636) 2024-04-25T09:09:31.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.880+0000 7fa062800640 1 -- 172.21.15.173:0/1933240660 learned_addr learned my addr 172.21.15.173:0/1933240660 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:31.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.884+0000 7fa061e00640 1 --2- 172.21.15.173:0/1933240660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa06415a180 0x7fa0640b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.884+0000 7fa060a00640 1 -- 172.21.15.173:0/1933240660 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003693277 0 0) 0x7fa06406e860 con 0x7fa064071a30 2024-04-25T09:09:31.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.884+0000 7fa060a00640 1 -- 172.21.15.173:0/1933240660 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa048003530 con 0x7fa064071a30 2024-04-25T09:09:31.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.884+0000 7fa060a00640 1 -- 172.21.15.173:0/1933240660 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473432621 0 0) 0x7fa06406eb20 con 0x7fa0640b2ca0 2024-04-25T09:09:31.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.884+0000 7fa060a00640 1 -- 172.21.15.173:0/1933240660 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa06406e860 con 0x7fa0640b2ca0 2024-04-25T09:09:31.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.884+0000 7fa061e00640 1 -- 172.21.15.173:0/1933240660 >> v1:172.21.15.194:6789/0 conn(0x7fa0640b2ca0 legacy=0x7fa064071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:31.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.884+0000 7fa061e00640 1 -- 172.21.15.173:0/1933240660 >> v1:172.21.15.173:6789/0 conn(0x7fa064071a30 legacy=0x7fa06406d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:31.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.884+0000 7fa061e00640 1 -- 172.21.15.173:0/1933240660 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0640aebe0 con 0x7fa06415a180 2024-04-25T09:09:31.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.884+0000 7fa061e00640 1 --2- 172.21.15.173:0/1933240660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa06415a180 0x7fa0640b40e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa054009dc0 tx=0x7fa05401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec3c2fcf15e24ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:31.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.884+0000 7fa060a00640 1 -- 172.21.15.173:0/1933240660 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540b2070 con 0x7fa06415a180 2024-04-25T09:09:31.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.884+0000 7fa060a00640 1 -- 172.21.15.173:0/1933240660 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0540a5930 con 0x7fa06415a180 2024-04-25T09:09:31.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.884+0000 7fa060a00640 1 -- 172.21.15.173:0/1933240660 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540a5ce0 con 0x7fa06415a180 2024-04-25T09:09:31.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa069000640 1 -- 172.21.15.173:0/1933240660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa06415a180 msgr2=0x7fa0640b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:31.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa069000640 1 --2- 172.21.15.173:0/1933240660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa06415a180 0x7fa0640b40e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa054009dc0 tx=0x7fa05401c990 comp rx=0 tx=0).stop 2024-04-25T09:09:31.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa069000640 1 -- 172.21.15.173:0/1933240660 shutdown_connections 2024-04-25T09:09:31.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa069000640 1 --2- 172.21.15.173:0/1933240660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa06415a180 0x7fa0640b40e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa069000640 1 -- 172.21.15.173:0/1933240660 >> 172.21.15.173:0/1933240660 conn(0x7fa06406ac90 msgr2=0x7fa06406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:31.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa069000640 1 -- 172.21.15.173:0/1933240660 shutdown_connections 2024-04-25T09:09:31.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa069000640 1 -- 172.21.15.173:0/1933240660 wait complete. 2024-04-25T09:09:31.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa069000640 1 Processor -- start 2024-04-25T09:09:31.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa069000640 1 -- start start 2024-04-25T09:09:31.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa069000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa064071a30 0x7fa06414ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa069000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0640b2ca0 0x7fa0641521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa069000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa06415a180 0x7fa0640cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa069000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640cfb30 con 0x7fa06415a180 2024-04-25T09:09:31.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa069000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640cf9b0 con 0x7fa0640b2ca0 2024-04-25T09:09:31.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa069000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640cfcb0 con 0x7fa064071a30 2024-04-25T09:09:31.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa062800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa06415a180 0x7fa0640cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa062800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa06415a180 0x7fa0640cde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42386/0 (socket says 172.21.15.173:42386) 2024-04-25T09:09:31.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa062800640 1 -- 172.21.15.173:0/1101707909 learned_addr learned my addr 172.21.15.173:0/1101707909 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:31.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa061e00640 1 --2- 172.21.15.173:0/1101707909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa064071a30 0x7fa06414ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa061400640 1 --2- 172.21.15.173:0/1101707909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0640b2ca0 0x7fa0641521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa062800640 1 -- 172.21.15.173:0/1101707909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa064071a30 msgr2=0x7fa06414ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:31.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa062800640 1 --2- 172.21.15.173:0/1101707909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa064071a30 0x7fa06414ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa062800640 1 -- 172.21.15.173:0/1101707909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0640b2ca0 msgr2=0x7fa0641521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:31.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa062800640 1 --2- 172.21.15.173:0/1101707909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0640b2ca0 0x7fa0641521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:31.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.888+0000 7fa062800640 1 -- 172.21.15.173:0/1101707909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa064152ae0 con 0x7fa06415a180 2024-04-25T09:09:31.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.892+0000 7fa062800640 1 --2- 172.21.15.173:0/1101707909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa06415a180 0x7fa0640cde40 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00c390 tx=0x7fa05c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:31.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.892+0000 7fa05a000640 1 -- 172.21.15.173:0/1101707909 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c017070 con 0x7fa06415a180 2024-04-25T09:09:31.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.892+0000 7fa05a000640 1 -- 172.21.15.173:0/1101707909 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c005db0 con 0x7fa06415a180 2024-04-25T09:09:31.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.892+0000 7fa069000640 1 -- 172.21.15.173:0/1101707909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa064152dc0 con 0x7fa06415a180 2024-04-25T09:09:31.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.892+0000 7fa05a000640 1 -- 172.21.15.173:0/1101707909 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c007310 con 0x7fa06415a180 2024-04-25T09:09:31.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.892+0000 7fa069000640 1 -- 172.21.15.173:0/1101707909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0640cd640 con 0x7fa06415a180 2024-04-25T09:09:31.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.892+0000 7fa069000640 1 -- 172.21.15.173:0/1101707909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0640cc270 con 0x7fa06415a180 2024-04-25T09:09:31.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.892+0000 7fa05a000640 1 -- 172.21.15.173:0/1101707909 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa05c01a070 con 0x7fa06415a180 2024-04-25T09:09:31.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.892+0000 7fa05a000640 1 --2- 172.21.15.173:0/1101707909 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa044066f60 0x7fa044069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:31.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.892+0000 7fa05a000640 1 -- 172.21.15.173:0/1101707909 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa05c0845d0 con 0x7fa06415a180 2024-04-25T09:09:31.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.892+0000 7fa061e00640 1 --2- 172.21.15.173:0/1101707909 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa044066f60 0x7fa044069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:31.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.896+0000 7fa061e00640 1 --2- 172.21.15.173:0/1101707909 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa044066f60 0x7fa044069420 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa0540af000 tx=0x7fa0540a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:31.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:31.896+0000 7fa05a000640 1 -- 172.21.15.173:0/1101707909 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa05c054d60 con 0x7fa06415a180 2024-04-25T09:09:32.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.108+0000 7fa069000640 1 -- 172.21.15.173:0/1101707909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa06406e640 con 0x7fa06415a180 2024-04-25T09:09:32.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.108+0000 7fa05a000640 1 -- 172.21.15.173:0/1101707909 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1261 (secure 0 0 0) 0x7fa05c058e00 con 0x7fa06415a180 2024-04-25T09:09:32.095 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:32.096 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":426,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":97,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":92},{"state_name":"creating+peering","count":5}],"num_pgs":97,"num_pools":3,"num_objects":19,"data_bytes":592744,"bytes_used":409743360,"bytes_avail":772684369920,"bytes_total":773094113280,"inactive_pgs_ratio":0.051546391099691391,"write_bytes_sec":1204,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":65,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7743}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-04-25T09:08:34.801401+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:09:32.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.108+0000 7fa069000640 1 -- 172.21.15.173:0/1101707909 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa044066f60 msgr2=0x7fa044069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:32.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.108+0000 7fa069000640 1 --2- 172.21.15.173:0/1101707909 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa044066f60 0x7fa044069420 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa0540af000 tx=0x7fa0540a7070 comp rx=0 tx=0).stop 2024-04-25T09:09:32.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.108+0000 7fa069000640 1 -- 172.21.15.173:0/1101707909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa06415a180 msgr2=0x7fa0640cde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:32.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.108+0000 7fa069000640 1 --2- 172.21.15.173:0/1101707909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa06415a180 0x7fa0640cde40 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00c390 tx=0x7fa05c00c850 comp rx=0 tx=0).stop 2024-04-25T09:09:32.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.108+0000 7fa069000640 1 -- 172.21.15.173:0/1101707909 shutdown_connections 2024-04-25T09:09:32.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.108+0000 7fa069000640 1 --2- 172.21.15.173:0/1101707909 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa044066f60 0x7fa044069420 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:32.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.108+0000 7fa069000640 1 --2- 172.21.15.173:0/1101707909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa06415a180 0x7fa0640cde40 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:32.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.108+0000 7fa069000640 1 --2- 172.21.15.173:0/1101707909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0640b2ca0 0x7fa0641521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:32.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.108+0000 7fa069000640 1 --2- 172.21.15.173:0/1101707909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa064071a30 0x7fa06414ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:32.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.108+0000 7fa069000640 1 -- 172.21.15.173:0/1101707909 >> 172.21.15.173:0/1101707909 conn(0x7fa06406ac90 msgr2=0x7fa06415db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:32.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.108+0000 7fa069000640 1 -- 172.21.15.173:0/1101707909 shutdown_connections 2024-04-25T09:09:32.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.108+0000 7fa069000640 1 -- 172.21.15.173:0/1101707909 wait complete. 2024-04-25T09:09:32.116 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:09:32.116 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:09:32.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.264+0000 7f3d75400640 1 Processor -- start 2024-04-25T09:09:32.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.264+0000 7f3d75400640 1 -- start start 2024-04-25T09:09:32.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.264+0000 7f3d75400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3d700b3e70 0x7f3d700b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:32.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.264+0000 7f3d75400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d7015edd0 0x7f3d700b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:32.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.264+0000 7f3d75400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d700b4790 con 0x7f3d700aefa0 2024-04-25T09:09:32.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.264+0000 7f3d75400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d7006dd50 con 0x7f3d700b3e70 2024-04-25T09:09:32.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.264+0000 7f3d75400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7015f320 con 0x7f3d7015edd0 2024-04-25T09:09:32.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.264+0000 7f3d6e800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3d700b3e70 0x7f3d700b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:32.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.264+0000 7f3d6e800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3d700b3e70 0x7f3d700b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42388/0 (socket says 172.21.15.173:42388) 2024-04-25T09:09:32.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.264+0000 7f3d6e800640 1 -- 172.21.15.173:0/3124121632 learned_addr learned my addr 172.21.15.173:0/3124121632 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:32.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.264+0000 7f3d6e800640 1 -- 172.21.15.173:0/3124121632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d7015edd0 msgr2=0x7f3d700b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:32.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.264+0000 7f3d6e800640 1 --2- 172.21.15.173:0/3124121632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d7015edd0 0x7f3d700b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:32.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.264+0000 7f3d6e800640 1 -- 172.21.15.173:0/3124121632 >> v1:172.21.15.194:6789/0 conn(0x7f3d700aefa0 legacy=0x7f3d700b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:32.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.264+0000 7f3d6e800640 1 -- 172.21.15.173:0/3124121632 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7006d420 con 0x7f3d700b3e70 2024-04-25T09:09:32.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.268+0000 7f3d6e800640 1 --2- 172.21.15.173:0/3124121632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d700b3e70 0x7f3d700b4250 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f3d60009870 tx=0x7f3d6001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4283db9d33801d35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:32.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.268+0000 7f3d6de00640 1 -- 172.21.15.173:0/3124121632 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600aa430 con 0x7f3d700b3e70 2024-04-25T09:09:32.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.268+0000 7f3d6de00640 1 -- 172.21.15.173:0/3124121632 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d600af070 con 0x7f3d700b3e70 2024-04-25T09:09:32.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.268+0000 7f3d6de00640 1 -- 172.21.15.173:0/3124121632 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600aa7f0 con 0x7f3d700b3e70 2024-04-25T09:09:32.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.268+0000 7f3d75400640 1 -- 172.21.15.173:0/3124121632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d700b3e70 msgr2=0x7f3d700b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:32.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.268+0000 7f3d75400640 1 --2- 172.21.15.173:0/3124121632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d700b3e70 0x7f3d700b4250 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f3d60009870 tx=0x7f3d6001c4f0 comp rx=0 tx=0).stop 2024-04-25T09:09:32.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.268+0000 7f3d75400640 1 -- 172.21.15.173:0/3124121632 shutdown_connections 2024-04-25T09:09:32.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.268+0000 7f3d75400640 1 --2- 172.21.15.173:0/3124121632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d7015edd0 0x7f3d700b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:32.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.268+0000 7f3d75400640 1 --2- 172.21.15.173:0/3124121632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d700b3e70 0x7f3d700b4250 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:32.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.268+0000 7f3d75400640 1 -- 172.21.15.173:0/3124121632 >> 172.21.15.173:0/3124121632 conn(0x7f3d7006ac90 msgr2=0x7f3d7006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:32.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.268+0000 7f3d75400640 1 -- 172.21.15.173:0/3124121632 shutdown_connections 2024-04-25T09:09:32.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.268+0000 7f3d75400640 1 -- 172.21.15.173:0/3124121632 wait complete. 2024-04-25T09:09:32.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.268+0000 7f3d75400640 1 Processor -- start 2024-04-25T09:09:32.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.268+0000 7f3d75400640 1 -- start start 2024-04-25T09:09:32.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d75400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d700aefa0 0x7f3d700cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:32.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d75400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d700b3e70 0x7f3d70146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:32.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d75400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d7015edd0 0x7f3d7015c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:32.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d75400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7006e1e0 con 0x7f3d700b3e70 2024-04-25T09:09:32.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d75400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7015aba0 con 0x7f3d7015edd0 2024-04-25T09:09:32.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d75400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7006e360 con 0x7f3d700aefa0 2024-04-25T09:09:32.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d67e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d700b3e70 0x7f3d70146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:32.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d67e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d700b3e70 0x7f3d70146b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42392/0 (socket says 172.21.15.173:42392) 2024-04-25T09:09:32.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d67e00640 1 -- 172.21.15.173:0/2173628162 learned_addr learned my addr 172.21.15.173:0/2173628162 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:32.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d6e800640 1 --2- 172.21.15.173:0/2173628162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d700aefa0 0x7f3d700cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:32.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d6f200640 1 --2- 172.21.15.173:0/2173628162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d7015edd0 0x7f3d7015c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:32.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d67e00640 1 -- 172.21.15.173:0/2173628162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d700aefa0 msgr2=0x7f3d700cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:32.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d67e00640 1 --2- 172.21.15.173:0/2173628162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d700aefa0 0x7f3d700cbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:32.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d67e00640 1 -- 172.21.15.173:0/2173628162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d7015edd0 msgr2=0x7f3d7015c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:32.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d67e00640 1 --2- 172.21.15.173:0/2173628162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d7015edd0 0x7f3d7015c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:32.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d67e00640 1 -- 172.21.15.173:0/2173628162 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7014d570 con 0x7f3d700b3e70 2024-04-25T09:09:32.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d6e800640 1 --2- 172.21.15.173:0/2173628162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d700aefa0 0x7f3d700cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:32.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d67e00640 1 --2- 172.21.15.173:0/2173628162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d700b3e70 0x7f3d70146b90 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800b3e0 tx=0x7f3d5800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:32.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d66a00640 1 -- 172.21.15.173:0/2173628162 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58015020 con 0x7f3d700b3e70 2024-04-25T09:09:32.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d66a00640 1 -- 172.21.15.173:0/2173628162 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d58011850 con 0x7f3d700b3e70 2024-04-25T09:09:32.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d75400640 1 -- 172.21.15.173:0/2173628162 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d7014d7f0 con 0x7f3d700b3e70 2024-04-25T09:09:32.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d66a00640 1 -- 172.21.15.173:0/2173628162 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58011c40 con 0x7f3d700b3e70 2024-04-25T09:09:32.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d75400640 1 -- 172.21.15.173:0/2173628162 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d7014ddb0 con 0x7f3d700b3e70 2024-04-25T09:09:32.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d75400640 1 -- 172.21.15.173:0/2173628162 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d70073a40 con 0x7f3d700b3e70 2024-04-25T09:09:32.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.272+0000 7f3d66a00640 1 -- 172.21.15.173:0/2173628162 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3d58018020 con 0x7f3d700b3e70 2024-04-25T09:09:32.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.276+0000 7f3d66a00640 1 --2- 172.21.15.173:0/2173628162 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3d4c066f60 0x7f3d4c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:32.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.276+0000 7f3d66a00640 1 -- 172.21.15.173:0/2173628162 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3d58085180 con 0x7f3d700b3e70 2024-04-25T09:09:32.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.276+0000 7f3d6e800640 1 --2- 172.21.15.173:0/2173628162 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3d4c066f60 0x7f3d4c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:32.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.276+0000 7f3d6e800640 1 --2- 172.21.15.173:0/2173628162 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3d4c066f60 0x7f3d4c069420 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3d600ae000 tx=0x7f3d600a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:32.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.280+0000 7f3d66a00640 1 -- 172.21.15.173:0/2173628162 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3d5801f020 con 0x7f3d700b3e70 2024-04-25T09:09:32.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.428+0000 7f3d75400640 1 -- 172.21.15.173:0/2173628162 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d7015c8f0 con 0x7f3d4c066f60 2024-04-25T09:09:32.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.436+0000 7f3d66a00640 1 -- 172.21.15.173:0/2173628162 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251651 (secure 0 0 0) 0x7f3d600af040 con 0x7f3d4c066f60 2024-04-25T09:09:32.425 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:32.427 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:09:32.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.436+0000 7f3d75400640 1 -- 172.21.15.173:0/2173628162 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3d4c066f60 msgr2=0x7f3d4c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:32.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.436+0000 7f3d75400640 1 --2- 172.21.15.173:0/2173628162 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3d4c066f60 0x7f3d4c069420 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3d600ae000 tx=0x7f3d600a7000 comp rx=0 tx=0).stop 2024-04-25T09:09:32.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.436+0000 7f3d75400640 1 -- 172.21.15.173:0/2173628162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d700b3e70 msgr2=0x7f3d70146b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:32.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.436+0000 7f3d75400640 1 --2- 172.21.15.173:0/2173628162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d700b3e70 0x7f3d70146b90 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800b3e0 tx=0x7f3d5800b8a0 comp rx=0 tx=0).stop 2024-04-25T09:09:32.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.436+0000 7f3d75400640 1 -- 172.21.15.173:0/2173628162 shutdown_connections 2024-04-25T09:09:32.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.436+0000 7f3d75400640 1 --2- 172.21.15.173:0/2173628162 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3d4c066f60 0x7f3d4c069420 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:32.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.436+0000 7f3d75400640 1 --2- 172.21.15.173:0/2173628162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d7015edd0 0x7f3d7015c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:32.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.436+0000 7f3d75400640 1 --2- 172.21.15.173:0/2173628162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d700b3e70 0x7f3d70146b90 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:32.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.436+0000 7f3d75400640 1 --2- 172.21.15.173:0/2173628162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d700aefa0 0x7f3d700cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:32.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.436+0000 7f3d75400640 1 -- 172.21.15.173:0/2173628162 >> 172.21.15.173:0/2173628162 conn(0x7f3d7006ac90 msgr2=0x7f3d70151950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:32.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.440+0000 7f3d75400640 1 -- 172.21.15.173:0/2173628162 shutdown_connections 2024-04-25T09:09:32.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:32.440+0000 7f3d75400640 1 -- 172.21.15.173:0/2173628162 wait complete. 2024-04-25T09:09:32.445 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2024-04-25T09:09:30.815176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592744,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400140,"kb_used_data":10436,"kb_used_omap":12,"kb_used_meta":389555,"kb_avail":754574580,"statfs":{"total":773094113280,"available":772684369920,"internally_reserved":0,"allocated":10686464,"data_stored":5549493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":398904880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2376,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.951964"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694625+0000","last_change":"2024-04-25T09:09:26.896499+0000","last_active":"2024-04-25T09:09:28.694625+0000","last_peered":"2024-04-25T09:09:28.694625+0000","last_clean":"2024-04-25T09:09:28.694625+0000","last_became_active":"2024-04-25T09:09:26.896226+0000","last_became_peered":"2024-04-25T09:09:26.896226+0000","last_unstale":"2024-04-25T09:09:28.694625+0000","last_undegraded":"2024-04-25T09:09:28.694625+0000","last_fullsized":"2024-04-25T09:09:28.694625+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:50.131196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694036+0000","last_change":"2024-04-25T09:09:26.897460+0000","last_active":"2024-04-25T09:09:28.694036+0000","last_peered":"2024-04-25T09:09:28.694036+0000","last_clean":"2024-04-25T09:09:28.694036+0000","last_became_active":"2024-04-25T09:09:26.897103+0000","last_became_peered":"2024-04-25T09:09:26.897103+0000","last_unstale":"2024-04-25T09:09:28.694036+0000","last_undegraded":"2024-04-25T09:09:28.694036+0000","last_fullsized":"2024-04-25T09:09:28.694036+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:21.216175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694439+0000","last_change":"2024-04-25T09:09:26.893748+0000","last_active":"2024-04-25T09:09:28.694439+0000","last_peered":"2024-04-25T09:09:28.694439+0000","last_clean":"2024-04-25T09:09:28.694439+0000","last_became_active":"2024-04-25T09:09:26.893515+0000","last_became_peered":"2024-04-25T09:09:26.893515+0000","last_unstale":"2024-04-25T09:09:28.694439+0000","last_undegraded":"2024-04-25T09:09:28.694439+0000","last_fullsized":"2024-04-25T09:09:28.694439+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:42.021859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694920+0000","last_change":"2024-04-25T09:09:26.910061+0000","last_active":"2024-04-25T09:09:28.694920+0000","last_peered":"2024-04-25T09:09:28.694920+0000","last_clean":"2024-04-25T09:09:28.694920+0000","last_became_active":"2024-04-25T09:09:26.909795+0000","last_became_peered":"2024-04-25T09:09:26.909795+0000","last_unstale":"2024-04-25T09:09:28.694920+0000","last_undegraded":"2024-04-25T09:09:28.694920+0000","last_fullsized":"2024-04-25T09:09:28.694920+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:05.780038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878204+0000","last_change":"2024-04-25T09:09:26.882500+0000","last_active":"2024-04-25T09:09:27.878204+0000","last_peered":"2024-04-25T09:09:27.878204+0000","last_clean":"2024-04-25T09:09:27.878204+0000","last_became_active":"2024-04-25T09:09:26.882178+0000","last_became_peered":"2024-04-25T09:09:26.882178+0000","last_unstale":"2024-04-25T09:09:27.878204+0000","last_undegraded":"2024-04-25T09:09:27.878204+0000","last_fullsized":"2024-04-25T09:09:27.878204+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:11.302067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877603+0000","last_change":"2024-04-25T09:09:26.913022+0000","last_active":"2024-04-25T09:09:27.877603+0000","last_peered":"2024-04-25T09:09:27.877603+0000","last_clean":"2024-04-25T09:09:27.877603+0000","last_became_active":"2024-04-25T09:09:26.912555+0000","last_became_peered":"2024-04-25T09:09:26.912555+0000","last_unstale":"2024-04-25T09:09:27.877603+0000","last_undegraded":"2024-04-25T09:09:27.877603+0000","last_fullsized":"2024-04-25T09:09:27.877603+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:09.924416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.882866+0000","last_change":"2024-04-25T09:09:25.882866+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.882866+0000","last_undegraded":"2024-04-25T09:09:25.882866+0000","last_fullsized":"2024-04-25T09:09:25.882866+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694274+0000","last_change":"2024-04-25T09:09:26.914654+0000","last_active":"2024-04-25T09:09:28.694274+0000","last_peered":"2024-04-25T09:09:28.694274+0000","last_clean":"2024-04-25T09:09:28.694274+0000","last_became_active":"2024-04-25T09:09:26.914011+0000","last_became_peered":"2024-04-25T09:09:26.914011+0000","last_unstale":"2024-04-25T09:09:28.694274+0000","last_undegraded":"2024-04-25T09:09:28.694274+0000","last_fullsized":"2024-04-25T09:09:28.694274+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:54.978670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878504+0000","last_change":"2024-04-25T09:09:26.892861+0000","last_active":"2024-04-25T09:09:27.878504+0000","last_peered":"2024-04-25T09:09:27.878504+0000","last_clean":"2024-04-25T09:09:27.878504+0000","last_became_active":"2024-04-25T09:09:26.892013+0000","last_became_peered":"2024-04-25T09:09:26.892013+0000","last_unstale":"2024-04-25T09:09:27.878504+0000","last_undegraded":"2024-04-25T09:09:27.878504+0000","last_fullsized":"2024-04-25T09:09:27.878504+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:27.027122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879193+0000","last_change":"2024-04-25T09:09:26.917328+0000","last_active":"2024-04-25T09:09:27.879193+0000","last_peered":"2024-04-25T09:09:27.879193+0000","last_clean":"2024-04-25T09:09:27.879193+0000","last_became_active":"2024-04-25T09:09:26.916317+0000","last_became_peered":"2024-04-25T09:09:26.916317+0000","last_unstale":"2024-04-25T09:09:27.879193+0000","last_undegraded":"2024-04-25T09:09:27.879193+0000","last_fullsized":"2024-04-25T09:09:27.879193+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:25.900567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878527+0000","last_change":"2024-04-25T09:09:26.893466+0000","last_active":"2024-04-25T09:09:27.878527+0000","last_peered":"2024-04-25T09:09:27.878527+0000","last_clean":"2024-04-25T09:09:27.878527+0000","last_became_active":"2024-04-25T09:09:26.893066+0000","last_became_peered":"2024-04-25T09:09:26.893066+0000","last_unstale":"2024-04-25T09:09:27.878527+0000","last_undegraded":"2024-04-25T09:09:27.878527+0000","last_fullsized":"2024-04-25T09:09:27.878527+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:30.604324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879051+0000","last_change":"2024-04-25T09:09:26.895964+0000","last_active":"2024-04-25T09:09:27.879051+0000","last_peered":"2024-04-25T09:09:27.879051+0000","last_clean":"2024-04-25T09:09:27.879051+0000","last_became_active":"2024-04-25T09:09:26.895695+0000","last_became_peered":"2024-04-25T09:09:26.895695+0000","last_unstale":"2024-04-25T09:09:27.879051+0000","last_undegraded":"2024-04-25T09:09:27.879051+0000","last_fullsized":"2024-04-25T09:09:27.879051+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:51.062011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694360+0000","last_change":"2024-04-25T09:09:26.913085+0000","last_active":"2024-04-25T09:09:28.694360+0000","last_peered":"2024-04-25T09:09:28.694360+0000","last_clean":"2024-04-25T09:09:28.694360+0000","last_became_active":"2024-04-25T09:09:26.912780+0000","last_became_peered":"2024-04-25T09:09:26.912780+0000","last_unstale":"2024-04-25T09:09:28.694360+0000","last_undegraded":"2024-04-25T09:09:28.694360+0000","last_fullsized":"2024-04-25T09:09:28.694360+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:11.765250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877970+0000","last_change":"2024-04-25T09:09:26.911169+0000","last_active":"2024-04-25T09:09:27.877970+0000","last_peered":"2024-04-25T09:09:27.877970+0000","last_clean":"2024-04-25T09:09:27.877970+0000","last_became_active":"2024-04-25T09:09:26.910649+0000","last_became_peered":"2024-04-25T09:09:26.910649+0000","last_unstale":"2024-04-25T09:09:27.877970+0000","last_undegraded":"2024-04-25T09:09:27.877970+0000","last_fullsized":"2024-04-25T09:09:27.877970+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:43.383066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694367+0000","last_change":"2024-04-25T09:09:26.909778+0000","last_active":"2024-04-25T09:09:28.694367+0000","last_peered":"2024-04-25T09:09:28.694367+0000","last_clean":"2024-04-25T09:09:28.694367+0000","last_became_active":"2024-04-25T09:09:26.909495+0000","last_became_peered":"2024-04-25T09:09:26.909495+0000","last_unstale":"2024-04-25T09:09:28.694367+0000","last_undegraded":"2024-04-25T09:09:28.694367+0000","last_fullsized":"2024-04-25T09:09:28.694367+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:15.564347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877754+0000","last_change":"2024-04-25T09:09:26.890288+0000","last_active":"2024-04-25T09:09:27.877754+0000","last_peered":"2024-04-25T09:09:27.877754+0000","last_clean":"2024-04-25T09:09:27.877754+0000","last_became_active":"2024-04-25T09:09:26.889997+0000","last_became_peered":"2024-04-25T09:09:26.889997+0000","last_unstale":"2024-04-25T09:09:27.877754+0000","last_undegraded":"2024-04-25T09:09:27.877754+0000","last_fullsized":"2024-04-25T09:09:27.877754+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:46.747064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878504+0000","last_change":"2024-04-25T09:09:26.890210+0000","last_active":"2024-04-25T09:09:27.878504+0000","last_peered":"2024-04-25T09:09:27.878504+0000","last_clean":"2024-04-25T09:09:27.878504+0000","last_became_active":"2024-04-25T09:09:26.889939+0000","last_became_peered":"2024-04-25T09:09:26.889939+0000","last_unstale":"2024-04-25T09:09:27.878504+0000","last_undegraded":"2024-04-25T09:09:27.878504+0000","last_fullsized":"2024-04-25T09:09:27.878504+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:23.740183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694624+0000","last_change":"2024-04-25T09:09:26.893150+0000","last_active":"2024-04-25T09:09:28.694624+0000","last_peered":"2024-04-25T09:09:28.694624+0000","last_clean":"2024-04-25T09:09:28.694624+0000","last_became_active":"2024-04-25T09:09:26.892878+0000","last_became_peered":"2024-04-25T09:09:26.892878+0000","last_unstale":"2024-04-25T09:09:28.694624+0000","last_undegraded":"2024-04-25T09:09:28.694624+0000","last_fullsized":"2024-04-25T09:09:28.694624+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:12.002802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878727+0000","last_change":"2024-04-25T09:09:26.907546+0000","last_active":"2024-04-25T09:09:27.878727+0000","last_peered":"2024-04-25T09:09:27.878727+0000","last_clean":"2024-04-25T09:09:27.878727+0000","last_became_active":"2024-04-25T09:09:26.907067+0000","last_became_peered":"2024-04-25T09:09:26.907067+0000","last_unstale":"2024-04-25T09:09:27.878727+0000","last_undegraded":"2024-04-25T09:09:27.878727+0000","last_fullsized":"2024-04-25T09:09:27.878727+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:16.612907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695210+0000","last_change":"2024-04-25T09:09:26.915859+0000","last_active":"2024-04-25T09:09:28.695210+0000","last_peered":"2024-04-25T09:09:28.695210+0000","last_clean":"2024-04-25T09:09:28.695210+0000","last_became_active":"2024-04-25T09:09:26.915582+0000","last_became_peered":"2024-04-25T09:09:26.915582+0000","last_unstale":"2024-04-25T09:09:28.695210+0000","last_undegraded":"2024-04-25T09:09:28.695210+0000","last_fullsized":"2024-04-25T09:09:28.695210+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:36.548327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878530+0000","last_change":"2024-04-25T09:09:26.889501+0000","last_active":"2024-04-25T09:09:27.878530+0000","last_peered":"2024-04-25T09:09:27.878530+0000","last_clean":"2024-04-25T09:09:27.878530+0000","last_became_active":"2024-04-25T09:09:26.889203+0000","last_became_peered":"2024-04-25T09:09:26.889203+0000","last_unstale":"2024-04-25T09:09:27.878530+0000","last_undegraded":"2024-04-25T09:09:27.878530+0000","last_fullsized":"2024-04-25T09:09:27.878530+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:47.910831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878007+0000","last_change":"2024-04-25T09:09:26.911728+0000","last_active":"2024-04-25T09:09:27.878007+0000","last_peered":"2024-04-25T09:09:27.878007+0000","last_clean":"2024-04-25T09:09:27.878007+0000","last_became_active":"2024-04-25T09:09:26.911326+0000","last_became_peered":"2024-04-25T09:09:26.911326+0000","last_unstale":"2024-04-25T09:09:27.878007+0000","last_undegraded":"2024-04-25T09:09:27.878007+0000","last_fullsized":"2024-04-25T09:09:27.878007+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:04.056308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694105+0000","last_change":"2024-04-25T09:09:26.911084+0000","last_active":"2024-04-25T09:09:28.694105+0000","last_peered":"2024-04-25T09:09:28.694105+0000","last_clean":"2024-04-25T09:09:28.694105+0000","last_became_active":"2024-04-25T09:09:26.910797+0000","last_became_peered":"2024-04-25T09:09:26.910797+0000","last_unstale":"2024-04-25T09:09:28.694105+0000","last_undegraded":"2024-04-25T09:09:28.694105+0000","last_fullsized":"2024-04-25T09:09:28.694105+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:39.999904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694346+0000","last_change":"2024-04-25T09:09:26.892545+0000","last_active":"2024-04-25T09:09:28.694346+0000","last_peered":"2024-04-25T09:09:28.694346+0000","last_clean":"2024-04-25T09:09:28.694346+0000","last_became_active":"2024-04-25T09:09:26.892292+0000","last_became_peered":"2024-04-25T09:09:26.892292+0000","last_unstale":"2024-04-25T09:09:28.694346+0000","last_undegraded":"2024-04-25T09:09:28.694346+0000","last_fullsized":"2024-04-25T09:09:28.694346+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:45.556771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694403+0000","last_change":"2024-04-25T09:09:26.891490+0000","last_active":"2024-04-25T09:09:28.694403+0000","last_peered":"2024-04-25T09:09:28.694403+0000","last_clean":"2024-04-25T09:09:28.694403+0000","last_became_active":"2024-04-25T09:09:26.890866+0000","last_became_peered":"2024-04-25T09:09:26.890866+0000","last_unstale":"2024-04-25T09:09:28.694403+0000","last_undegraded":"2024-04-25T09:09:28.694403+0000","last_fullsized":"2024-04-25T09:09:28.694403+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:47.875102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878629+0000","last_change":"2024-04-25T09:09:26.915924+0000","last_active":"2024-04-25T09:09:27.878629+0000","last_peered":"2024-04-25T09:09:27.878629+0000","last_clean":"2024-04-25T09:09:27.878629+0000","last_became_active":"2024-04-25T09:09:26.915617+0000","last_became_peered":"2024-04-25T09:09:26.915617+0000","last_unstale":"2024-04-25T09:09:27.878629+0000","last_undegraded":"2024-04-25T09:09:27.878629+0000","last_fullsized":"2024-04-25T09:09:27.878629+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:46.270829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879087+0000","last_change":"2024-04-25T09:09:26.900162+0000","last_active":"2024-04-25T09:09:27.879087+0000","last_peered":"2024-04-25T09:09:27.879087+0000","last_clean":"2024-04-25T09:09:27.879087+0000","last_became_active":"2024-04-25T09:09:26.899697+0000","last_became_peered":"2024-04-25T09:09:26.899697+0000","last_unstale":"2024-04-25T09:09:27.879087+0000","last_undegraded":"2024-04-25T09:09:27.879087+0000","last_fullsized":"2024-04-25T09:09:27.879087+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:41.618620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695320+0000","last_change":"2024-04-25T09:09:26.909249+0000","last_active":"2024-04-25T09:09:28.695320+0000","last_peered":"2024-04-25T09:09:28.695320+0000","last_clean":"2024-04-25T09:09:28.695320+0000","last_became_active":"2024-04-25T09:09:26.908995+0000","last_became_peered":"2024-04-25T09:09:26.908995+0000","last_unstale":"2024-04-25T09:09:28.695320+0000","last_undegraded":"2024-04-25T09:09:28.695320+0000","last_fullsized":"2024-04-25T09:09:28.695320+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:48.941318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.882413+0000","last_change":"2024-04-25T09:09:25.882413+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.882413+0000","last_undegraded":"2024-04-25T09:09:25.882413+0000","last_fullsized":"2024-04-25T09:09:25.882413+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878423+0000","last_change":"2024-04-25T09:09:26.892277+0000","last_active":"2024-04-25T09:09:27.878423+0000","last_peered":"2024-04-25T09:09:27.878423+0000","last_clean":"2024-04-25T09:09:27.878423+0000","last_became_active":"2024-04-25T09:09:26.891967+0000","last_became_peered":"2024-04-25T09:09:26.891967+0000","last_unstale":"2024-04-25T09:09:27.878423+0000","last_undegraded":"2024-04-25T09:09:27.878423+0000","last_fullsized":"2024-04-25T09:09:27.878423+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:15.199604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694617+0000","last_change":"2024-04-25T09:09:26.912200+0000","last_active":"2024-04-25T09:09:28.694617+0000","last_peered":"2024-04-25T09:09:28.694617+0000","last_clean":"2024-04-25T09:09:28.694617+0000","last_became_active":"2024-04-25T09:09:26.911878+0000","last_became_peered":"2024-04-25T09:09:26.911878+0000","last_unstale":"2024-04-25T09:09:28.694617+0000","last_undegraded":"2024-04-25T09:09:28.694617+0000","last_fullsized":"2024-04-25T09:09:28.694617+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:56.330021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877597+0000","last_change":"2024-04-25T09:09:26.890855+0000","last_active":"2024-04-25T09:09:27.877597+0000","last_peered":"2024-04-25T09:09:27.877597+0000","last_clean":"2024-04-25T09:09:27.877597+0000","last_became_active":"2024-04-25T09:09:26.890600+0000","last_became_peered":"2024-04-25T09:09:26.890600+0000","last_unstale":"2024-04-25T09:09:27.877597+0000","last_undegraded":"2024-04-25T09:09:27.877597+0000","last_fullsized":"2024-04-25T09:09:27.877597+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:29.370531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877890+0000","last_change":"2024-04-25T09:09:26.884423+0000","last_active":"2024-04-25T09:09:27.877890+0000","last_peered":"2024-04-25T09:09:27.877890+0000","last_clean":"2024-04-25T09:09:27.877890+0000","last_became_active":"2024-04-25T09:09:26.884029+0000","last_became_peered":"2024-04-25T09:09:26.884029+0000","last_unstale":"2024-04-25T09:09:27.877890+0000","last_undegraded":"2024-04-25T09:09:27.877890+0000","last_fullsized":"2024-04-25T09:09:27.877890+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:09.825442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"96'4","reported_seq":18,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695112+0000","last_change":"2024-04-25T09:09:25.891328+0000","last_active":"2024-04-25T09:09:28.695112+0000","last_peered":"2024-04-25T09:09:28.695112+0000","last_clean":"2024-04-25T09:09:28.695112+0000","last_became_active":"2024-04-25T09:09:25.891055+0000","last_became_peered":"2024-04-25T09:09:25.891055+0000","last_unstale":"2024-04-25T09:09:28.695112+0000","last_undegraded":"2024-04-25T09:09:28.695112+0000","last_fullsized":"2024-04-25T09:09:28.695112+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:26.020961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878066+0000","last_change":"2024-04-25T09:09:26.901370+0000","last_active":"2024-04-25T09:09:27.878066+0000","last_peered":"2024-04-25T09:09:27.878066+0000","last_clean":"2024-04-25T09:09:27.878066+0000","last_became_active":"2024-04-25T09:09:26.901014+0000","last_became_peered":"2024-04-25T09:09:26.901014+0000","last_unstale":"2024-04-25T09:09:27.878066+0000","last_undegraded":"2024-04-25T09:09:27.878066+0000","last_fullsized":"2024-04-25T09:09:27.878066+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:54.558905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878756+0000","last_change":"2024-04-25T09:09:25.891301+0000","last_active":"2024-04-25T09:09:27.878756+0000","last_peered":"2024-04-25T09:09:27.878756+0000","last_clean":"2024-04-25T09:09:27.878756+0000","last_became_active":"2024-04-25T09:09:25.891027+0000","last_became_peered":"2024-04-25T09:09:25.891027+0000","last_unstale":"2024-04-25T09:09:27.878756+0000","last_undegraded":"2024-04-25T09:09:27.878756+0000","last_fullsized":"2024-04-25T09:09:27.878756+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:29.460046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.883382+0000","last_change":"2024-04-25T09:09:25.883382+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.883382+0000","last_undegraded":"2024-04-25T09:09:25.883382+0000","last_fullsized":"2024-04-25T09:09:25.883382+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.896967+0000","last_change":"2024-04-25T09:09:25.895316+0000","last_active":"2024-04-25T09:09:25.896967+0000","last_peered":"2024-04-25T09:09:25.896967+0000","last_clean":"2024-04-25T09:09:25.896967+0000","last_became_active":"2024-04-25T09:09:25.895025+0000","last_became_peered":"2024-04-25T09:09:25.895025+0000","last_unstale":"2024-04-25T09:09:25.896967+0000","last_undegraded":"2024-04-25T09:09:25.896967+0000","last_fullsized":"2024-04-25T09:09:25.896967+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:12.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878561+0000","last_change":"2024-04-25T09:09:26.893173+0000","last_active":"2024-04-25T09:09:27.878561+0000","last_peered":"2024-04-25T09:09:27.878561+0000","last_clean":"2024-04-25T09:09:27.878561+0000","last_became_active":"2024-04-25T09:09:26.892420+0000","last_became_peered":"2024-04-25T09:09:26.892420+0000","last_unstale":"2024-04-25T09:09:27.878561+0000","last_undegraded":"2024-04-25T09:09:27.878561+0000","last_fullsized":"2024-04-25T09:09:27.878561+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:20.008848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694910+0000","last_change":"2024-04-25T09:09:25.893538+0000","last_active":"2024-04-25T09:09:28.694910+0000","last_peered":"2024-04-25T09:09:28.694910+0000","last_clean":"2024-04-25T09:09:28.694910+0000","last_became_active":"2024-04-25T09:09:25.893014+0000","last_became_peered":"2024-04-25T09:09:25.893014+0000","last_unstale":"2024-04-25T09:09:28.694910+0000","last_undegraded":"2024-04-25T09:09:28.694910+0000","last_fullsized":"2024-04-25T09:09:28.694910+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:10.295905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694427+0000","last_change":"2024-04-25T09:09:26.909690+0000","last_active":"2024-04-25T09:09:28.694427+0000","last_peered":"2024-04-25T09:09:28.694427+0000","last_clean":"2024-04-25T09:09:28.694427+0000","last_became_active":"2024-04-25T09:09:26.909399+0000","last_became_peered":"2024-04-25T09:09:26.909399+0000","last_unstale":"2024-04-25T09:09:28.694427+0000","last_undegraded":"2024-04-25T09:09:28.694427+0000","last_fullsized":"2024-04-25T09:09:28.694427+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:53.115977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878346+0000","last_change":"2024-04-25T09:09:25.888297+0000","last_active":"2024-04-25T09:09:27.878346+0000","last_peered":"2024-04-25T09:09:27.878346+0000","last_clean":"2024-04-25T09:09:27.878346+0000","last_became_active":"2024-04-25T09:09:25.887706+0000","last_became_peered":"2024-04-25T09:09:25.887706+0000","last_unstale":"2024-04-25T09:09:27.878346+0000","last_undegraded":"2024-04-25T09:09:27.878346+0000","last_fullsized":"2024-04-25T09:09:27.878346+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:00.496547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694277+0000","last_change":"2024-04-25T09:09:26.894500+0000","last_active":"2024-04-25T09:09:28.694277+0000","last_peered":"2024-04-25T09:09:28.694277+0000","last_clean":"2024-04-25T09:09:28.694277+0000","last_became_active":"2024-04-25T09:09:26.893339+0000","last_became_peered":"2024-04-25T09:09:26.893339+0000","last_unstale":"2024-04-25T09:09:28.694277+0000","last_undegraded":"2024-04-25T09:09:28.694277+0000","last_fullsized":"2024-04-25T09:09:28.694277+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:21.216175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695215+0000","last_change":"2024-04-25T09:09:25.888636+0000","last_active":"2024-04-25T09:09:28.695215+0000","last_peered":"2024-04-25T09:09:28.695215+0000","last_clean":"2024-04-25T09:09:28.695215+0000","last_became_active":"2024-04-25T09:09:25.888332+0000","last_became_peered":"2024-04-25T09:09:25.888332+0000","last_unstale":"2024-04-25T09:09:28.695215+0000","last_undegraded":"2024-04-25T09:09:28.695215+0000","last_fullsized":"2024-04-25T09:09:28.695215+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:59.063251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878062+0000","last_change":"2024-04-25T09:09:26.912804+0000","last_active":"2024-04-25T09:09:27.878062+0000","last_peered":"2024-04-25T09:09:27.878062+0000","last_clean":"2024-04-25T09:09:27.878062+0000","last_became_active":"2024-04-25T09:09:26.912208+0000","last_became_peered":"2024-04-25T09:09:26.912208+0000","last_unstale":"2024-04-25T09:09:27.878062+0000","last_undegraded":"2024-04-25T09:09:27.878062+0000","last_fullsized":"2024-04-25T09:09:27.878062+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:33:39.777394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694925+0000","last_change":"2024-04-25T09:09:25.891312+0000","last_active":"2024-04-25T09:09:28.694925+0000","last_peered":"2024-04-25T09:09:28.694925+0000","last_clean":"2024-04-25T09:09:28.694925+0000","last_became_active":"2024-04-25T09:09:25.890959+0000","last_became_peered":"2024-04-25T09:09:25.890959+0000","last_unstale":"2024-04-25T09:09:28.694925+0000","last_undegraded":"2024-04-25T09:09:28.694925+0000","last_fullsized":"2024-04-25T09:09:28.694925+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:12.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694573+0000","last_change":"2024-04-25T09:09:26.907307+0000","last_active":"2024-04-25T09:09:28.694573+0000","last_peered":"2024-04-25T09:09:28.694573+0000","last_clean":"2024-04-25T09:09:28.694573+0000","last_became_active":"2024-04-25T09:09:26.907053+0000","last_became_peered":"2024-04-25T09:09:26.907053+0000","last_unstale":"2024-04-25T09:09:28.694573+0000","last_undegraded":"2024-04-25T09:09:28.694573+0000","last_fullsized":"2024-04-25T09:09:28.694573+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:48.603667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.896738+0000","last_change":"2024-04-25T09:09:25.893856+0000","last_active":"2024-04-25T09:09:25.896738+0000","last_peered":"2024-04-25T09:09:25.896738+0000","last_clean":"2024-04-25T09:09:25.896738+0000","last_became_active":"2024-04-25T09:09:25.893562+0000","last_became_peered":"2024-04-25T09:09:25.893562+0000","last_unstale":"2024-04-25T09:09:25.896738+0000","last_undegraded":"2024-04-25T09:09:25.896738+0000","last_fullsized":"2024-04-25T09:09:25.896738+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:19.211371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878454+0000","last_change":"2024-04-25T09:09:26.895908+0000","last_active":"2024-04-25T09:09:27.878454+0000","last_peered":"2024-04-25T09:09:27.878454+0000","last_clean":"2024-04-25T09:09:27.878454+0000","last_became_active":"2024-04-25T09:09:26.895544+0000","last_became_peered":"2024-04-25T09:09:26.895544+0000","last_unstale":"2024-04-25T09:09:27.878454+0000","last_undegraded":"2024-04-25T09:09:27.878454+0000","last_fullsized":"2024-04-25T09:09:27.878454+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:15.682654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694584+0000","last_change":"2024-04-25T09:09:25.892399+0000","last_active":"2024-04-25T09:09:28.694584+0000","last_peered":"2024-04-25T09:09:28.694584+0000","last_clean":"2024-04-25T09:09:28.694584+0000","last_became_active":"2024-04-25T09:09:25.892107+0000","last_became_peered":"2024-04-25T09:09:25.892107+0000","last_unstale":"2024-04-25T09:09:28.694584+0000","last_undegraded":"2024-04-25T09:09:28.694584+0000","last_fullsized":"2024-04-25T09:09:28.694584+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:14.676493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.882297+0000","last_change":"2024-04-25T09:09:25.882297+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.882297+0000","last_undegraded":"2024-04-25T09:09:25.882297+0000","last_fullsized":"2024-04-25T09:09:25.882297+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694758+0000","last_change":"2024-04-25T09:09:25.891693+0000","last_active":"2024-04-25T09:09:28.694758+0000","last_peered":"2024-04-25T09:09:28.694758+0000","last_clean":"2024-04-25T09:09:28.694758+0000","last_became_active":"2024-04-25T09:09:25.891465+0000","last_became_peered":"2024-04-25T09:09:25.891465+0000","last_unstale":"2024-04-25T09:09:28.694758+0000","last_undegraded":"2024-04-25T09:09:28.694758+0000","last_fullsized":"2024-04-25T09:09:28.694758+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:26.140967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694812+0000","last_change":"2024-04-25T09:09:26.897388+0000","last_active":"2024-04-25T09:09:28.694812+0000","last_peered":"2024-04-25T09:09:28.694812+0000","last_clean":"2024-04-25T09:09:28.694812+0000","last_became_active":"2024-04-25T09:09:26.897138+0000","last_became_peered":"2024-04-25T09:09:26.897138+0000","last_unstale":"2024-04-25T09:09:28.694812+0000","last_undegraded":"2024-04-25T09:09:28.694812+0000","last_fullsized":"2024-04-25T09:09:28.694812+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:07.845041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"96'3","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878807+0000","last_change":"2024-04-25T09:09:25.890611+0000","last_active":"2024-04-25T09:09:27.878807+0000","last_peered":"2024-04-25T09:09:27.878807+0000","last_clean":"2024-04-25T09:09:27.878807+0000","last_became_active":"2024-04-25T09:09:25.889897+0000","last_became_peered":"2024-04-25T09:09:25.889897+0000","last_unstale":"2024-04-25T09:09:27.878807+0000","last_undegraded":"2024-04-25T09:09:27.878807+0000","last_fullsized":"2024-04-25T09:09:27.878807+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:00.689979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695142+0000","last_change":"2024-04-25T09:09:26.906211+0000","last_active":"2024-04-25T09:09:28.695142+0000","last_peered":"2024-04-25T09:09:28.695142+0000","last_clean":"2024-04-25T09:09:28.695142+0000","last_became_active":"2024-04-25T09:09:26.905774+0000","last_became_peered":"2024-04-25T09:09:26.905774+0000","last_unstale":"2024-04-25T09:09:28.695142+0000","last_undegraded":"2024-04-25T09:09:28.695142+0000","last_fullsized":"2024-04-25T09:09:28.695142+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:39.497239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"96'6","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878178+0000","last_change":"2024-04-25T09:09:25.892734+0000","last_active":"2024-04-25T09:09:27.878178+0000","last_peered":"2024-04-25T09:09:27.878178+0000","last_clean":"2024-04-25T09:09:27.878178+0000","last_became_active":"2024-04-25T09:09:25.892486+0000","last_became_peered":"2024-04-25T09:09:25.892486+0000","last_unstale":"2024-04-25T09:09:27.878178+0000","last_undegraded":"2024-04-25T09:09:27.878178+0000","last_fullsized":"2024-04-25T09:09:27.878178+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:28.617165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694564+0000","last_change":"2024-04-25T09:09:26.914455+0000","last_active":"2024-04-25T09:09:28.694564+0000","last_peered":"2024-04-25T09:09:28.694564+0000","last_clean":"2024-04-25T09:09:28.694564+0000","last_became_active":"2024-04-25T09:09:26.912881+0000","last_became_peered":"2024-04-25T09:09:26.912881+0000","last_unstale":"2024-04-25T09:09:28.694564+0000","last_undegraded":"2024-04-25T09:09:28.694564+0000","last_fullsized":"2024-04-25T09:09:28.694564+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:32.128756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.897005+0000","last_change":"2024-04-25T09:09:25.895891+0000","last_active":"2024-04-25T09:09:25.897005+0000","last_peered":"2024-04-25T09:09:25.897005+0000","last_clean":"2024-04-25T09:09:25.897005+0000","last_became_active":"2024-04-25T09:09:25.894219+0000","last_became_peered":"2024-04-25T09:09:25.894219+0000","last_unstale":"2024-04-25T09:09:25.897005+0000","last_undegraded":"2024-04-25T09:09:25.897005+0000","last_fullsized":"2024-04-25T09:09:25.897005+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:26.140967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877982+0000","last_change":"2024-04-25T09:09:26.882098+0000","last_active":"2024-04-25T09:09:27.877982+0000","last_peered":"2024-04-25T09:09:27.877982+0000","last_clean":"2024-04-25T09:09:27.877982+0000","last_became_active":"2024-04-25T09:09:26.881774+0000","last_became_peered":"2024-04-25T09:09:26.881774+0000","last_unstale":"2024-04-25T09:09:27.877982+0000","last_undegraded":"2024-04-25T09:09:27.877982+0000","last_fullsized":"2024-04-25T09:09:27.877982+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:38.604466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877730+0000","last_change":"2024-04-25T09:09:25.888905+0000","last_active":"2024-04-25T09:09:27.877730+0000","last_peered":"2024-04-25T09:09:27.877730+0000","last_clean":"2024-04-25T09:09:27.877730+0000","last_became_active":"2024-04-25T09:09:25.887974+0000","last_became_peered":"2024-04-25T09:09:25.887974+0000","last_unstale":"2024-04-25T09:09:27.877730+0000","last_undegraded":"2024-04-25T09:09:27.877730+0000","last_fullsized":"2024-04-25T09:09:27.877730+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:15.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879185+0000","last_change":"2024-04-25T09:09:26.916502+0000","last_active":"2024-04-25T09:09:27.879185+0000","last_peered":"2024-04-25T09:09:27.879185+0000","last_clean":"2024-04-25T09:09:27.879185+0000","last_became_active":"2024-04-25T09:09:26.916269+0000","last_became_peered":"2024-04-25T09:09:26.916269+0000","last_unstale":"2024-04-25T09:09:27.879185+0000","last_undegraded":"2024-04-25T09:09:27.879185+0000","last_fullsized":"2024-04-25T09:09:27.879185+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:29.397203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694554+0000","last_change":"2024-04-25T09:09:25.893744+0000","last_active":"2024-04-25T09:09:28.694554+0000","last_peered":"2024-04-25T09:09:28.694554+0000","last_clean":"2024-04-25T09:09:28.694554+0000","last_became_active":"2024-04-25T09:09:25.892844+0000","last_became_peered":"2024-04-25T09:09:25.892844+0000","last_unstale":"2024-04-25T09:09:28.694554+0000","last_undegraded":"2024-04-25T09:09:28.694554+0000","last_fullsized":"2024-04-25T09:09:28.694554+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:56.231571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879077+0000","last_change":"2024-04-25T09:09:26.898749+0000","last_active":"2024-04-25T09:09:27.879077+0000","last_peered":"2024-04-25T09:09:27.879077+0000","last_clean":"2024-04-25T09:09:27.879077+0000","last_became_active":"2024-04-25T09:09:26.898150+0000","last_became_peered":"2024-04-25T09:09:26.898150+0000","last_unstale":"2024-04-25T09:09:27.879077+0000","last_undegraded":"2024-04-25T09:09:27.879077+0000","last_fullsized":"2024-04-25T09:09:27.879077+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:03.772159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"96'8","reported_seq":22,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694543+0000","last_change":"2024-04-25T09:09:25.894818+0000","last_active":"2024-04-25T09:09:28.694543+0000","last_peered":"2024-04-25T09:09:28.694543+0000","last_clean":"2024-04-25T09:09:28.694543+0000","last_became_active":"2024-04-25T09:09:25.894535+0000","last_became_peered":"2024-04-25T09:09:25.894535+0000","last_unstale":"2024-04-25T09:09:28.694543+0000","last_undegraded":"2024-04-25T09:09:28.694543+0000","last_fullsized":"2024-04-25T09:09:28.694543+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:36.631220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878063+0000","last_change":"2024-04-25T09:09:26.892885+0000","last_active":"2024-04-25T09:09:27.878063+0000","last_peered":"2024-04-25T09:09:27.878063+0000","last_clean":"2024-04-25T09:09:27.878063+0000","last_became_active":"2024-04-25T09:09:26.892623+0000","last_became_peered":"2024-04-25T09:09:26.892623+0000","last_unstale":"2024-04-25T09:09:27.878063+0000","last_undegraded":"2024-04-25T09:09:27.878063+0000","last_fullsized":"2024-04-25T09:09:27.878063+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:14.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695130+0000","last_change":"2024-04-25T09:09:25.893625+0000","last_active":"2024-04-25T09:09:28.695130+0000","last_peered":"2024-04-25T09:09:28.695130+0000","last_clean":"2024-04-25T09:09:28.695130+0000","last_became_active":"2024-04-25T09:09:25.893276+0000","last_became_peered":"2024-04-25T09:09:25.893276+0000","last_unstale":"2024-04-25T09:09:28.695130+0000","last_undegraded":"2024-04-25T09:09:28.695130+0000","last_fullsized":"2024-04-25T09:09:28.695130+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:29.598163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695021+0000","last_change":"2024-04-25T09:09:26.891031+0000","last_active":"2024-04-25T09:09:28.695021+0000","last_peered":"2024-04-25T09:09:28.695021+0000","last_clean":"2024-04-25T09:09:28.695021+0000","last_became_active":"2024-04-25T09:09:26.890788+0000","last_became_peered":"2024-04-25T09:09:26.890788+0000","last_unstale":"2024-04-25T09:09:28.695021+0000","last_undegraded":"2024-04-25T09:09:28.695021+0000","last_fullsized":"2024-04-25T09:09:28.695021+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:09.501598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.898067+0000","last_change":"2024-04-25T09:09:25.897420+0000","last_active":"2024-04-25T09:09:25.898067+0000","last_peered":"2024-04-25T09:09:25.898067+0000","last_clean":"2024-04-25T09:09:25.898067+0000","last_became_active":"2024-04-25T09:09:25.896968+0000","last_became_peered":"2024-04-25T09:09:25.896968+0000","last_unstale":"2024-04-25T09:09:25.898067+0000","last_undegraded":"2024-04-25T09:09:25.898067+0000","last_fullsized":"2024-04-25T09:09:25.898067+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:54.038096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878728+0000","last_change":"2024-04-25T09:09:26.902520+0000","last_active":"2024-04-25T09:09:27.878728+0000","last_peered":"2024-04-25T09:09:27.878728+0000","last_clean":"2024-04-25T09:09:27.878728+0000","last_became_active":"2024-04-25T09:09:26.902128+0000","last_became_peered":"2024-04-25T09:09:26.902128+0000","last_unstale":"2024-04-25T09:09:27.878728+0000","last_undegraded":"2024-04-25T09:09:27.878728+0000","last_fullsized":"2024-04-25T09:09:27.878728+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:04.360175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878847+0000","last_change":"2024-04-25T09:09:25.890897+0000","last_active":"2024-04-25T09:09:27.878847+0000","last_peered":"2024-04-25T09:09:27.878847+0000","last_clean":"2024-04-25T09:09:27.878847+0000","last_became_active":"2024-04-25T09:09:25.890283+0000","last_became_peered":"2024-04-25T09:09:25.890283+0000","last_unstale":"2024-04-25T09:09:27.878847+0000","last_undegraded":"2024-04-25T09:09:27.878847+0000","last_fullsized":"2024-04-25T09:09:27.878847+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:13.142222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877758+0000","last_change":"2024-04-25T09:09:26.910678+0000","last_active":"2024-04-25T09:09:27.877758+0000","last_peered":"2024-04-25T09:09:27.877758+0000","last_clean":"2024-04-25T09:09:27.877758+0000","last_became_active":"2024-04-25T09:09:26.910403+0000","last_became_peered":"2024-04-25T09:09:26.910403+0000","last_unstale":"2024-04-25T09:09:27.877758+0000","last_undegraded":"2024-04-25T09:09:27.877758+0000","last_fullsized":"2024-04-25T09:09:27.877758+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:43.004790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.693883+0000","last_change":"2024-04-25T09:09:25.889771+0000","last_active":"2024-04-25T09:09:28.693883+0000","last_peered":"2024-04-25T09:09:28.693883+0000","last_clean":"2024-04-25T09:09:28.693883+0000","last_became_active":"2024-04-25T09:09:25.889426+0000","last_became_peered":"2024-04-25T09:09:25.889426+0000","last_unstale":"2024-04-25T09:09:28.693883+0000","last_undegraded":"2024-04-25T09:09:28.693883+0000","last_fullsized":"2024-04-25T09:09:28.693883+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:14.193442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.693923+0000","last_change":"2024-04-25T09:09:26.895859+0000","last_active":"2024-04-25T09:09:28.693923+0000","last_peered":"2024-04-25T09:09:28.693923+0000","last_clean":"2024-04-25T09:09:28.693923+0000","last_became_active":"2024-04-25T09:09:26.895588+0000","last_became_peered":"2024-04-25T09:09:26.895588+0000","last_unstale":"2024-04-25T09:09:28.693923+0000","last_undegraded":"2024-04-25T09:09:28.693923+0000","last_fullsized":"2024-04-25T09:09:28.693923+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:39.999904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879040+0000","last_change":"2024-04-25T09:09:25.894259+0000","last_active":"2024-04-25T09:09:27.879040+0000","last_peered":"2024-04-25T09:09:27.879040+0000","last_clean":"2024-04-25T09:09:27.879040+0000","last_became_active":"2024-04-25T09:09:25.893924+0000","last_became_peered":"2024-04-25T09:09:25.893924+0000","last_unstale":"2024-04-25T09:09:27.879040+0000","last_undegraded":"2024-04-25T09:09:27.879040+0000","last_fullsized":"2024-04-25T09:09:27.879040+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:06.938535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694592+0000","last_change":"2024-04-25T09:09:26.912210+0000","last_active":"2024-04-25T09:09:28.694592+0000","last_peered":"2024-04-25T09:09:28.694592+0000","last_clean":"2024-04-25T09:09:28.694592+0000","last_became_active":"2024-04-25T09:09:26.911858+0000","last_became_peered":"2024-04-25T09:09:26.911858+0000","last_unstale":"2024-04-25T09:09:28.694592+0000","last_undegraded":"2024-04-25T09:09:28.694592+0000","last_fullsized":"2024-04-25T09:09:28.694592+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:09.501598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694050+0000","last_change":"2024-04-25T09:09:25.888456+0000","last_active":"2024-04-25T09:09:28.694050+0000","last_peered":"2024-04-25T09:09:28.694050+0000","last_clean":"2024-04-25T09:09:28.694050+0000","last_became_active":"2024-04-25T09:09:25.888121+0000","last_became_peered":"2024-04-25T09:09:25.888121+0000","last_unstale":"2024-04-25T09:09:28.694050+0000","last_undegraded":"2024-04-25T09:09:28.694050+0000","last_fullsized":"2024-04-25T09:09:28.694050+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:10.295905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878097+0000","last_change":"2024-04-25T09:09:26.893393+0000","last_active":"2024-04-25T09:09:27.878097+0000","last_peered":"2024-04-25T09:09:27.878097+0000","last_clean":"2024-04-25T09:09:27.878097+0000","last_became_active":"2024-04-25T09:09:26.892289+0000","last_became_peered":"2024-04-25T09:09:26.892289+0000","last_unstale":"2024-04-25T09:09:27.878097+0000","last_undegraded":"2024-04-25T09:09:27.878097+0000","last_fullsized":"2024-04-25T09:09:27.878097+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:06.636882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878720+0000","last_change":"2024-04-25T09:09:25.883924+0000","last_active":"2024-04-25T09:09:27.878720+0000","last_peered":"2024-04-25T09:09:27.878720+0000","last_clean":"2024-04-25T09:09:27.878720+0000","last_became_active":"2024-04-25T09:09:25.883059+0000","last_became_peered":"2024-04-25T09:09:25.883059+0000","last_unstale":"2024-04-25T09:09:27.878720+0000","last_undegraded":"2024-04-25T09:09:27.878720+0000","last_fullsized":"2024-04-25T09:09:27.878720+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:20.403420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694644+0000","last_change":"2024-04-25T09:09:26.890528+0000","last_active":"2024-04-25T09:09:28.694644+0000","last_peered":"2024-04-25T09:09:28.694644+0000","last_clean":"2024-04-25T09:09:28.694644+0000","last_became_active":"2024-04-25T09:09:26.889103+0000","last_became_peered":"2024-04-25T09:09:26.889103+0000","last_unstale":"2024-04-25T09:09:28.694644+0000","last_undegraded":"2024-04-25T09:09:28.694644+0000","last_fullsized":"2024-04-25T09:09:28.694644+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:15.833064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.897033+0000","last_change":"2024-04-25T09:09:25.895283+0000","last_active":"2024-04-25T09:09:25.897033+0000","last_peered":"2024-04-25T09:09:25.897033+0000","last_clean":"2024-04-25T09:09:25.897033+0000","last_became_active":"2024-04-25T09:09:25.894675+0000","last_became_peered":"2024-04-25T09:09:25.894675+0000","last_unstale":"2024-04-25T09:09:25.897033+0000","last_undegraded":"2024-04-25T09:09:25.897033+0000","last_fullsized":"2024-04-25T09:09:25.897033+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:54.808752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878253+0000","last_change":"2024-04-25T09:09:26.884176+0000","last_active":"2024-04-25T09:09:27.878253+0000","last_peered":"2024-04-25T09:09:27.878253+0000","last_clean":"2024-04-25T09:09:27.878253+0000","last_became_active":"2024-04-25T09:09:26.883416+0000","last_became_peered":"2024-04-25T09:09:26.883416+0000","last_unstale":"2024-04-25T09:09:27.878253+0000","last_undegraded":"2024-04-25T09:09:27.878253+0000","last_fullsized":"2024-04-25T09:09:27.878253+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:16.248502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"97'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.881364+0000","last_change":"2024-04-25T09:09:25.888575+0000","last_active":"2024-04-25T09:09:28.881364+0000","last_peered":"2024-04-25T09:09:28.881364+0000","last_clean":"2024-04-25T09:09:28.881364+0000","last_became_active":"2024-04-25T09:09:25.888130+0000","last_became_peered":"2024-04-25T09:09:25.888130+0000","last_unstale":"2024-04-25T09:09:28.881364+0000","last_undegraded":"2024-04-25T09:09:28.881364+0000","last_fullsized":"2024-04-25T09:09:28.881364+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:22.025116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878336+0000","last_change":"2024-04-25T09:09:26.907788+0000","last_active":"2024-04-25T09:09:27.878336+0000","last_peered":"2024-04-25T09:09:27.878336+0000","last_clean":"2024-04-25T09:09:27.878336+0000","last_became_active":"2024-04-25T09:09:26.907509+0000","last_became_peered":"2024-04-25T09:09:26.907509+0000","last_unstale":"2024-04-25T09:09:27.878336+0000","last_undegraded":"2024-04-25T09:09:27.878336+0000","last_fullsized":"2024-04-25T09:09:27.878336+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:59.022383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878920+0000","last_change":"2024-04-25T09:09:25.885545+0000","last_active":"2024-04-25T09:09:27.878920+0000","last_peered":"2024-04-25T09:09:27.878920+0000","last_clean":"2024-04-25T09:09:27.878920+0000","last_became_active":"2024-04-25T09:09:25.885204+0000","last_became_peered":"2024-04-25T09:09:25.885204+0000","last_unstale":"2024-04-25T09:09:27.878920+0000","last_undegraded":"2024-04-25T09:09:27.878920+0000","last_fullsized":"2024-04-25T09:09:27.878920+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:33.311698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694576+0000","last_change":"2024-04-25T09:09:26.891717+0000","last_active":"2024-04-25T09:09:28.694576+0000","last_peered":"2024-04-25T09:09:28.694576+0000","last_clean":"2024-04-25T09:09:28.694576+0000","last_became_active":"2024-04-25T09:09:26.891183+0000","last_became_peered":"2024-04-25T09:09:26.891183+0000","last_unstale":"2024-04-25T09:09:28.694576+0000","last_undegraded":"2024-04-25T09:09:28.694576+0000","last_fullsized":"2024-04-25T09:09:28.694576+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:15.833064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694888+0000","last_change":"2024-04-25T09:09:25.890769+0000","last_active":"2024-04-25T09:09:28.694888+0000","last_peered":"2024-04-25T09:09:28.694888+0000","last_clean":"2024-04-25T09:09:28.694888+0000","last_became_active":"2024-04-25T09:09:25.890367+0000","last_became_peered":"2024-04-25T09:09:25.890367+0000","last_unstale":"2024-04-25T09:09:28.694888+0000","last_undegraded":"2024-04-25T09:09:28.694888+0000","last_fullsized":"2024-04-25T09:09:28.694888+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:14.193442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878771+0000","last_change":"2024-04-25T09:09:26.899314+0000","last_active":"2024-04-25T09:09:27.878771+0000","last_peered":"2024-04-25T09:09:27.878771+0000","last_clean":"2024-04-25T09:09:27.878771+0000","last_became_active":"2024-04-25T09:09:26.898556+0000","last_became_peered":"2024-04-25T09:09:26.898556+0000","last_unstale":"2024-04-25T09:09:27.878771+0000","last_undegraded":"2024-04-25T09:09:27.878771+0000","last_fullsized":"2024-04-25T09:09:27.878771+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:14.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877854+0000","last_change":"2024-04-25T09:09:25.887331+0000","last_active":"2024-04-25T09:09:27.877854+0000","last_peered":"2024-04-25T09:09:27.877854+0000","last_clean":"2024-04-25T09:09:27.877854+0000","last_became_active":"2024-04-25T09:09:25.886093+0000","last_became_peered":"2024-04-25T09:09:25.886093+0000","last_unstale":"2024-04-25T09:09:27.877854+0000","last_undegraded":"2024-04-25T09:09:27.877854+0000","last_fullsized":"2024-04-25T09:09:27.877854+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:23:28.244528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694280+0000","last_change":"2024-04-25T09:09:26.910027+0000","last_active":"2024-04-25T09:09:28.694280+0000","last_peered":"2024-04-25T09:09:28.694280+0000","last_clean":"2024-04-25T09:09:28.694280+0000","last_became_active":"2024-04-25T09:09:26.909711+0000","last_became_peered":"2024-04-25T09:09:26.909711+0000","last_unstale":"2024-04-25T09:09:28.694280+0000","last_undegraded":"2024-04-25T09:09:28.694280+0000","last_fullsized":"2024-04-25T09:09:28.694280+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:27.191034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694700+0000","last_change":"2024-04-25T09:09:25.888899+0000","last_active":"2024-04-25T09:09:28.694700+0000","last_peered":"2024-04-25T09:09:28.694700+0000","last_clean":"2024-04-25T09:09:28.694700+0000","last_became_active":"2024-04-25T09:09:25.887727+0000","last_became_peered":"2024-04-25T09:09:25.887727+0000","last_unstale":"2024-04-25T09:09:28.694700+0000","last_undegraded":"2024-04-25T09:09:28.694700+0000","last_fullsized":"2024-04-25T09:09:28.694700+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:26.020961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694318+0000","last_change":"2024-04-25T09:09:26.911233+0000","last_active":"2024-04-25T09:09:28.694318+0000","last_peered":"2024-04-25T09:09:28.694318+0000","last_clean":"2024-04-25T09:09:28.694318+0000","last_became_active":"2024-04-25T09:09:26.910962+0000","last_became_peered":"2024-04-25T09:09:26.910962+0000","last_unstale":"2024-04-25T09:09:28.694318+0000","last_undegraded":"2024-04-25T09:09:28.694318+0000","last_fullsized":"2024-04-25T09:09:28.694318+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:47.875102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694383+0000","last_change":"2024-04-25T09:09:25.886416+0000","last_active":"2024-04-25T09:09:28.694383+0000","last_peered":"2024-04-25T09:09:28.694383+0000","last_clean":"2024-04-25T09:09:28.694383+0000","last_became_active":"2024-04-25T09:09:25.886138+0000","last_became_peered":"2024-04-25T09:09:25.886138+0000","last_unstale":"2024-04-25T09:09:28.694383+0000","last_undegraded":"2024-04-25T09:09:28.694383+0000","last_fullsized":"2024-04-25T09:09:28.694383+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:14.676493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877763+0000","last_change":"2024-04-25T09:09:26.895912+0000","last_active":"2024-04-25T09:09:27.877763+0000","last_peered":"2024-04-25T09:09:27.877763+0000","last_clean":"2024-04-25T09:09:27.877763+0000","last_became_active":"2024-04-25T09:09:26.894861+0000","last_became_peered":"2024-04-25T09:09:26.894861+0000","last_unstale":"2024-04-25T09:09:27.877763+0000","last_undegraded":"2024-04-25T09:09:27.877763+0000","last_fullsized":"2024-04-25T09:09:27.877763+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:20.609762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.897356+0000","last_change":"2024-04-25T09:09:25.896492+0000","last_active":"2024-04-25T09:09:25.897356+0000","last_peered":"2024-04-25T09:09:25.897356+0000","last_clean":"2024-04-25T09:09:25.897356+0000","last_became_active":"2024-04-25T09:09:25.896219+0000","last_became_peered":"2024-04-25T09:09:25.896219+0000","last_unstale":"2024-04-25T09:09:25.897356+0000","last_undegraded":"2024-04-25T09:09:25.897356+0000","last_fullsized":"2024-04-25T09:09:25.897356+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:44.101788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-04-25T09:09:25.882446+0000","last_change":"2024-04-25T09:09:25.882446+0000","last_active":"2024-04-25T09:09:25.862960+0000","last_peered":"2024-04-25T09:09:25.862960+0000","last_clean":"2024-04-25T09:09:25.862960+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:09:25.882446+0000","last_undegraded":"2024-04-25T09:09:25.882446+0000","last_fullsized":"2024-04-25T09:09:25.882446+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695290+0000","last_change":"2024-04-25T09:09:25.896662+0000","last_active":"2024-04-25T09:09:28.695290+0000","last_peered":"2024-04-25T09:09:28.695290+0000","last_clean":"2024-04-25T09:09:28.695290+0000","last_became_active":"2024-04-25T09:09:25.896367+0000","last_became_peered":"2024-04-25T09:09:25.896367+0000","last_unstale":"2024-04-25T09:09:28.695290+0000","last_undegraded":"2024-04-25T09:09:28.695290+0000","last_fullsized":"2024-04-25T09:09:28.695290+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:27.332997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":305,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T09:09:25.886563+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:09:25.886563+0000","last_peered":"2024-04-25T09:09:25.886563+0000","last_clean":"2024-04-25T09:09:25.886563+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:09:25.886563+0000","last_undegraded":"2024-04-25T09:09:25.886563+0000","last_fullsized":"2024-04-25T09:09:25.886563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2376,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509525,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50404,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321436,"statfs":{"total":96636764160,"available":96585150464,"internally_reserved":0,"allocated":1196032,"data_stored":545265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509525,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46224,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325616,"statfs":{"total":96636764160,"available":96589430784,"internally_reserved":0,"allocated":1175552,"data_stored":543049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509526,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54560,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317280,"statfs":{"total":96636764160,"available":96580894720,"internally_reserved":0,"allocated":1196032,"data_stored":549901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509525,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54540,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317300,"statfs":{"total":96636764160,"available":96580915200,"internally_reserved":0,"allocated":1175552,"data_stored":543049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509525,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50388,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321452,"statfs":{"total":96636764160,"available":96585166848,"internally_reserved":0,"allocated":1187840,"data_stored":549741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509526,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46236,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325604,"statfs":{"total":96636764160,"available":96589418496,"internally_reserved":0,"allocated":1191936,"data_stored":549811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509526,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50996,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320844,"statfs":{"total":96636764160,"available":96584544256,"internally_reserved":0,"allocated":1806336,"data_stored":1142427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574933,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46792,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325048,"statfs":{"total":96636764160,"available":96588849152,"internally_reserved":0,"allocated":1757184,"data_stored":1126250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:09:35.473 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:09:35.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb879600640 1 Processor -- start 2024-04-25T09:09:35.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb879600640 1 -- start start 2024-04-25T09:09:35.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb879600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb8740cc8b0 0x7fb8740ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:35.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb879600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8740ce8f0 0x7fb8740ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:35.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb879600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87406e7c0 con 0x7fb874145250 2024-04-25T09:09:35.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb879600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87406d720 con 0x7fb8740cc8b0 2024-04-25T09:09:35.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb879600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87406da00 con 0x7fb8740ce8f0 2024-04-25T09:09:35.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb872a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fb874145250 0x7fb87415c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54254/0 (socket says 172.21.15.173:54254) 2024-04-25T09:09:35.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb872a00640 1 -- 172.21.15.173:0/4189902134 learned_addr learned my addr 172.21.15.173:0/4189902134 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:35.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb86a000640 1 --2- 172.21.15.173:0/4189902134 >> v2:172.21.15.194:3300/0 conn(0x7fb8740cc8b0 0x7fb8740ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:35.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb873400640 1 --2- 172.21.15.173:0/4189902134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8740ce8f0 0x7fb8740ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:35.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb872000640 1 -- 172.21.15.173:0/4189902134 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210825118 0 0) 0x7fb87406e7c0 con 0x7fb874145250 2024-04-25T09:09:35.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb872000640 1 -- 172.21.15.173:0/4189902134 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb858003530 con 0x7fb874145250 2024-04-25T09:09:35.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb872000640 1 -- 172.21.15.173:0/4189902134 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2696073301 0 0) 0x7fb858003530 con 0x7fb874145250 2024-04-25T09:09:35.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb872000640 1 -- 172.21.15.173:0/4189902134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8740ce8f0 msgr2=0x7fb8740ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:35.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb872000640 1 --2- 172.21.15.173:0/4189902134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8740ce8f0 0x7fb8740ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:35.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb872000640 1 -- 172.21.15.173:0/4189902134 >> v2:172.21.15.194:3300/0 conn(0x7fb8740cc8b0 msgr2=0x7fb8740ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:35.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb872000640 1 --2- 172.21.15.173:0/4189902134 >> v2:172.21.15.194:3300/0 conn(0x7fb8740cc8b0 0x7fb8740ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:35.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb872000640 1 -- 172.21.15.173:0/4189902134 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87406dce0 con 0x7fb874145250 2024-04-25T09:09:35.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb872000640 1 -- 172.21.15.173:0/4189902134 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fb85c001680 con 0x7fb874145250 2024-04-25T09:09:35.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.632+0000 7fb872000640 1 -- 172.21.15.173:0/4189902134 >> v1:172.21.15.173:6789/0 conn(0x7fb874145250 legacy=0x7fb87415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:35.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.636+0000 7fb872000640 1 --2- 172.21.15.173:0/4189902134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8580039c0 0x7fb858003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:35.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.636+0000 7fb872000640 1 --2- 172.21.15.173:0/4189902134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8740ce8f0 0x7fb858004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:35.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.636+0000 7fb872000640 1 --2- 172.21.15.173:0/4189902134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb858004d50 0x7fb8580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:35.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.636+0000 7fb872000640 1 -- 172.21.15.173:0/4189902134 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87406d720 con 0x7fb858004d50 2024-04-25T09:09:35.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.636+0000 7fb872000640 1 -- 172.21.15.173:0/4189902134 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87406da00 con 0x7fb8580039c0 2024-04-25T09:09:35.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.636+0000 7fb872000640 1 -- 172.21.15.173:0/4189902134 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85800b9d0 con 0x7fb8740ce8f0 2024-04-25T09:09:35.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.636+0000 7fb873400640 1 --2- 172.21.15.173:0/4189902134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb858004d50 0x7fb8580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:35.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.636+0000 7fb872a00640 1 --2- 172.21.15.173:0/4189902134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8580039c0 0x7fb858003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:35.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.636+0000 7fb86a000640 1 --2- 172.21.15.173:0/4189902134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8740ce8f0 0x7fb858004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:35.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.636+0000 7fb873400640 1 -- 172.21.15.173:0/4189902134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8740ce8f0 msgr2=0x7fb858004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:35.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.636+0000 7fb873400640 1 --2- 172.21.15.173:0/4189902134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8740ce8f0 0x7fb858004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:35.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.636+0000 7fb873400640 1 -- 172.21.15.173:0/4189902134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8580039c0 msgr2=0x7fb858003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:35.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.636+0000 7fb873400640 1 --2- 172.21.15.173:0/4189902134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8580039c0 0x7fb858003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:35.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.636+0000 7fb873400640 1 -- 172.21.15.173:0/4189902134 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858003530 con 0x7fb858004d50 2024-04-25T09:09:35.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.636+0000 7fb873400640 1 --2- 172.21.15.173:0/4189902134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb858004d50 0x7fb8580051d0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fb86c009fc0 tx=0x7fb86c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d9fda67fd2ee66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:35.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.636+0000 7fb872000640 1 -- 172.21.15.173:0/4189902134 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c0b2070 con 0x7fb858004d50 2024-04-25T09:09:35.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.636+0000 7fb872000640 1 -- 172.21.15.173:0/4189902134 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c0a5c90 con 0x7fb858004d50 2024-04-25T09:09:35.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.636+0000 7fb872000640 1 -- 172.21.15.173:0/4189902134 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c009c10 con 0x7fb858004d50 2024-04-25T09:09:35.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb879600640 1 -- 172.21.15.173:0/4189902134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb858004d50 msgr2=0x7fb8580051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:35.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb879600640 1 --2- 172.21.15.173:0/4189902134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb858004d50 0x7fb8580051d0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fb86c009fc0 tx=0x7fb86c01cc80 comp rx=0 tx=0).stop 2024-04-25T09:09:35.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb873400640 1 -- 172.21.15.173:0/4189902134 reap_dead start 2024-04-25T09:09:35.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb879600640 1 -- 172.21.15.173:0/4189902134 shutdown_connections 2024-04-25T09:09:35.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb879600640 1 -- 172.21.15.173:0/4189902134 >> 172.21.15.173:0/4189902134 conn(0x7fb87406ac90 msgr2=0x7fb87406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:35.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb879600640 1 -- 172.21.15.173:0/4189902134 shutdown_connections 2024-04-25T09:09:35.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb879600640 1 -- 172.21.15.173:0/4189902134 wait complete. 2024-04-25T09:09:35.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb879600640 1 Processor -- start 2024-04-25T09:09:35.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb879600640 1 -- start start 2024-04-25T09:09:35.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb879600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb858004d50 0x7fb8741f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:35.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb879600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8740c46e0 0x7fb8741f44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:35.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb879600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb87415e1d0 0x7fb8740cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:35.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb879600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb874145630 con 0x7fb858004d50 2024-04-25T09:09:35.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb879600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87406e2a0 con 0x7fb87415e1d0 2024-04-25T09:09:35.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb879600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87406ef80 con 0x7fb8740c46e0 2024-04-25T09:09:35.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb872a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb858004d50 0x7fb8741f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:35.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb872a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb858004d50 0x7fb8741f3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45894/0 (socket says 172.21.15.173:45894) 2024-04-25T09:09:35.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb872a00640 1 -- 172.21.15.173:0/1797534291 learned_addr learned my addr 172.21.15.173:0/1797534291 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:35.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb86a000640 1 --2- 172.21.15.173:0/1797534291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8740c46e0 0x7fb8741f44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:35.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb873400640 1 --2- 172.21.15.173:0/1797534291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb87415e1d0 0x7fb8740cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:35.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb872a00640 1 -- 172.21.15.173:0/1797534291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8740c46e0 msgr2=0x7fb8741f44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:35.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb872a00640 1 --2- 172.21.15.173:0/1797534291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8740c46e0 0x7fb8741f44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:35.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb872a00640 1 -- 172.21.15.173:0/1797534291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb87415e1d0 msgr2=0x7fb8740cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:35.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb872a00640 1 --2- 172.21.15.173:0/1797534291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb87415e1d0 0x7fb8740cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:35.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.640+0000 7fb872a00640 1 -- 172.21.15.173:0/1797534291 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8741f42c0 con 0x7fb858004d50 2024-04-25T09:09:35.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.644+0000 7fb873400640 1 --2- 172.21.15.173:0/1797534291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb87415e1d0 0x7fb8740cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:35.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.644+0000 7fb872a00640 1 --2- 172.21.15.173:0/1797534291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb858004d50 0x7fb8741f3d80 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fb85c007340 tx=0x7fb85c007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:35.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.644+0000 7fb86b400640 1 -- 172.21.15.173:0/1797534291 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c01a070 con 0x7fb858004d50 2024-04-25T09:09:35.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.644+0000 7fb86b400640 1 -- 172.21.15.173:0/1797534291 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c00f9c0 con 0x7fb858004d50 2024-04-25T09:09:35.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.644+0000 7fb879600640 1 -- 172.21.15.173:0/1797534291 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8740c4be0 con 0x7fb858004d50 2024-04-25T09:09:35.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.644+0000 7fb86b400640 1 -- 172.21.15.173:0/1797534291 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c00fdb0 con 0x7fb858004d50 2024-04-25T09:09:35.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.644+0000 7fb879600640 1 -- 172.21.15.173:0/1797534291 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8740c51a0 con 0x7fb858004d50 2024-04-25T09:09:35.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.644+0000 7fb879600640 1 -- 172.21.15.173:0/1797534291 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb874073a40 con 0x7fb858004d50 2024-04-25T09:09:35.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.644+0000 7fb86b400640 1 -- 172.21.15.173:0/1797534291 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb85c01d070 con 0x7fb858004d50 2024-04-25T09:09:35.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.644+0000 7fb86b400640 1 --2- 172.21.15.173:0/1797534291 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb850066f60 0x7fb850069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:35.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.644+0000 7fb86b400640 1 -- 172.21.15.173:0/1797534291 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb85c084d00 con 0x7fb858004d50 2024-04-25T09:09:35.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.644+0000 7fb86a000640 1 --2- 172.21.15.173:0/1797534291 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb850066f60 0x7fb850069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:35.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.648+0000 7fb86a000640 1 --2- 172.21.15.173:0/1797534291 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb850066f60 0x7fb850069420 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb87415ed50 tx=0x7fb864009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:35.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.648+0000 7fb86b400640 1 -- 172.21.15.173:0/1797534291 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb8741f42c0 con 0x7fb858004d50 2024-04-25T09:09:35.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.804+0000 7fb879600640 1 -- 172.21.15.173:0/1797534291 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8740ae6f0 con 0x7fb850066f60 2024-04-25T09:09:35.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.808+0000 7fb86b400640 1 -- 172.21.15.173:0/1797534291 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251988 (secure 0 0 0) 0x7fb8740ae6f0 con 0x7fb850066f60 2024-04-25T09:09:35.800 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:35.801 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:09:35.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.812+0000 7fb879600640 1 -- 172.21.15.173:0/1797534291 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb850066f60 msgr2=0x7fb850069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:35.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.812+0000 7fb879600640 1 --2- 172.21.15.173:0/1797534291 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb850066f60 0x7fb850069420 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb87415ed50 tx=0x7fb864009190 comp rx=0 tx=0).stop 2024-04-25T09:09:35.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.812+0000 7fb879600640 1 -- 172.21.15.173:0/1797534291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb858004d50 msgr2=0x7fb8741f3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:35.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.812+0000 7fb879600640 1 --2- 172.21.15.173:0/1797534291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb858004d50 0x7fb8741f3d80 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fb85c007340 tx=0x7fb85c007740 comp rx=0 tx=0).stop 2024-04-25T09:09:35.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.812+0000 7fb879600640 1 -- 172.21.15.173:0/1797534291 shutdown_connections 2024-04-25T09:09:35.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.812+0000 7fb879600640 1 --2- 172.21.15.173:0/1797534291 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb850066f60 0x7fb850069420 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:35.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.812+0000 7fb879600640 1 --2- 172.21.15.173:0/1797534291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb87415e1d0 0x7fb8740cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:35.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.812+0000 7fb879600640 1 --2- 172.21.15.173:0/1797534291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8740c46e0 0x7fb8741f44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:35.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.812+0000 7fb879600640 1 --2- 172.21.15.173:0/1797534291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb858004d50 0x7fb8741f3d80 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:35.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.812+0000 7fb879600640 1 -- 172.21.15.173:0/1797534291 >> 172.21.15.173:0/1797534291 conn(0x7fb87406ac90 msgr2=0x7fb8740b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:35.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.812+0000 7fb879600640 1 -- 172.21.15.173:0/1797534291 shutdown_connections 2024-04-25T09:09:35.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:35.812+0000 7fb879600640 1 -- 172.21.15.173:0/1797534291 wait complete. 2024-04-25T09:09:35.820 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-04-25T09:09:34.816152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400192,"kb_used_data":10504,"kb_used_omap":12,"kb_used_meta":389555,"kb_avail":754574528,"statfs":{"total":773094113280,"available":772684316672,"internally_reserved":0,"allocated":10756096,"data_stored":5583484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":398904880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001746"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694625+0000","last_change":"2024-04-25T09:09:26.896499+0000","last_active":"2024-04-25T09:09:28.694625+0000","last_peered":"2024-04-25T09:09:28.694625+0000","last_clean":"2024-04-25T09:09:28.694625+0000","last_became_active":"2024-04-25T09:09:26.896226+0000","last_became_peered":"2024-04-25T09:09:26.896226+0000","last_unstale":"2024-04-25T09:09:28.694625+0000","last_undegraded":"2024-04-25T09:09:28.694625+0000","last_fullsized":"2024-04-25T09:09:28.694625+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:50.131196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694036+0000","last_change":"2024-04-25T09:09:26.897460+0000","last_active":"2024-04-25T09:09:28.694036+0000","last_peered":"2024-04-25T09:09:28.694036+0000","last_clean":"2024-04-25T09:09:28.694036+0000","last_became_active":"2024-04-25T09:09:26.897103+0000","last_became_peered":"2024-04-25T09:09:26.897103+0000","last_unstale":"2024-04-25T09:09:28.694036+0000","last_undegraded":"2024-04-25T09:09:28.694036+0000","last_fullsized":"2024-04-25T09:09:28.694036+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:21.216175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694439+0000","last_change":"2024-04-25T09:09:26.893748+0000","last_active":"2024-04-25T09:09:28.694439+0000","last_peered":"2024-04-25T09:09:28.694439+0000","last_clean":"2024-04-25T09:09:28.694439+0000","last_became_active":"2024-04-25T09:09:26.893515+0000","last_became_peered":"2024-04-25T09:09:26.893515+0000","last_unstale":"2024-04-25T09:09:28.694439+0000","last_undegraded":"2024-04-25T09:09:28.694439+0000","last_fullsized":"2024-04-25T09:09:28.694439+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:42.021859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694920+0000","last_change":"2024-04-25T09:09:26.910061+0000","last_active":"2024-04-25T09:09:28.694920+0000","last_peered":"2024-04-25T09:09:28.694920+0000","last_clean":"2024-04-25T09:09:28.694920+0000","last_became_active":"2024-04-25T09:09:26.909795+0000","last_became_peered":"2024-04-25T09:09:26.909795+0000","last_unstale":"2024-04-25T09:09:28.694920+0000","last_undegraded":"2024-04-25T09:09:28.694920+0000","last_fullsized":"2024-04-25T09:09:28.694920+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:05.780038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878204+0000","last_change":"2024-04-25T09:09:26.882500+0000","last_active":"2024-04-25T09:09:27.878204+0000","last_peered":"2024-04-25T09:09:27.878204+0000","last_clean":"2024-04-25T09:09:27.878204+0000","last_became_active":"2024-04-25T09:09:26.882178+0000","last_became_peered":"2024-04-25T09:09:26.882178+0000","last_unstale":"2024-04-25T09:09:27.878204+0000","last_undegraded":"2024-04-25T09:09:27.878204+0000","last_fullsized":"2024-04-25T09:09:27.878204+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:11.302067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877603+0000","last_change":"2024-04-25T09:09:26.913022+0000","last_active":"2024-04-25T09:09:27.877603+0000","last_peered":"2024-04-25T09:09:27.877603+0000","last_clean":"2024-04-25T09:09:27.877603+0000","last_became_active":"2024-04-25T09:09:26.912555+0000","last_became_peered":"2024-04-25T09:09:26.912555+0000","last_unstale":"2024-04-25T09:09:27.877603+0000","last_undegraded":"2024-04-25T09:09:27.877603+0000","last_fullsized":"2024-04-25T09:09:27.877603+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:09.924416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694332+0000","last_change":"2024-04-25T09:09:26.894751+0000","last_active":"2024-04-25T09:09:28.694332+0000","last_peered":"2024-04-25T09:09:28.694332+0000","last_clean":"2024-04-25T09:09:28.694332+0000","last_became_active":"2024-04-25T09:09:26.894421+0000","last_became_peered":"2024-04-25T09:09:26.894421+0000","last_unstale":"2024-04-25T09:09:28.694332+0000","last_undegraded":"2024-04-25T09:09:28.694332+0000","last_fullsized":"2024-04-25T09:09:28.694332+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:39.577010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694274+0000","last_change":"2024-04-25T09:09:26.914654+0000","last_active":"2024-04-25T09:09:28.694274+0000","last_peered":"2024-04-25T09:09:28.694274+0000","last_clean":"2024-04-25T09:09:28.694274+0000","last_became_active":"2024-04-25T09:09:26.914011+0000","last_became_peered":"2024-04-25T09:09:26.914011+0000","last_unstale":"2024-04-25T09:09:28.694274+0000","last_undegraded":"2024-04-25T09:09:28.694274+0000","last_fullsized":"2024-04-25T09:09:28.694274+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:54.978670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878504+0000","last_change":"2024-04-25T09:09:26.892861+0000","last_active":"2024-04-25T09:09:27.878504+0000","last_peered":"2024-04-25T09:09:27.878504+0000","last_clean":"2024-04-25T09:09:27.878504+0000","last_became_active":"2024-04-25T09:09:26.892013+0000","last_became_peered":"2024-04-25T09:09:26.892013+0000","last_unstale":"2024-04-25T09:09:27.878504+0000","last_undegraded":"2024-04-25T09:09:27.878504+0000","last_fullsized":"2024-04-25T09:09:27.878504+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:27.027122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879193+0000","last_change":"2024-04-25T09:09:26.917328+0000","last_active":"2024-04-25T09:09:27.879193+0000","last_peered":"2024-04-25T09:09:27.879193+0000","last_clean":"2024-04-25T09:09:27.879193+0000","last_became_active":"2024-04-25T09:09:26.916317+0000","last_became_peered":"2024-04-25T09:09:26.916317+0000","last_unstale":"2024-04-25T09:09:27.879193+0000","last_undegraded":"2024-04-25T09:09:27.879193+0000","last_fullsized":"2024-04-25T09:09:27.879193+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:25.900567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878527+0000","last_change":"2024-04-25T09:09:26.893466+0000","last_active":"2024-04-25T09:09:27.878527+0000","last_peered":"2024-04-25T09:09:27.878527+0000","last_clean":"2024-04-25T09:09:27.878527+0000","last_became_active":"2024-04-25T09:09:26.893066+0000","last_became_peered":"2024-04-25T09:09:26.893066+0000","last_unstale":"2024-04-25T09:09:27.878527+0000","last_undegraded":"2024-04-25T09:09:27.878527+0000","last_fullsized":"2024-04-25T09:09:27.878527+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:30.604324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879051+0000","last_change":"2024-04-25T09:09:26.895964+0000","last_active":"2024-04-25T09:09:27.879051+0000","last_peered":"2024-04-25T09:09:27.879051+0000","last_clean":"2024-04-25T09:09:27.879051+0000","last_became_active":"2024-04-25T09:09:26.895695+0000","last_became_peered":"2024-04-25T09:09:26.895695+0000","last_unstale":"2024-04-25T09:09:27.879051+0000","last_undegraded":"2024-04-25T09:09:27.879051+0000","last_fullsized":"2024-04-25T09:09:27.879051+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:51.062011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694360+0000","last_change":"2024-04-25T09:09:26.913085+0000","last_active":"2024-04-25T09:09:28.694360+0000","last_peered":"2024-04-25T09:09:28.694360+0000","last_clean":"2024-04-25T09:09:28.694360+0000","last_became_active":"2024-04-25T09:09:26.912780+0000","last_became_peered":"2024-04-25T09:09:26.912780+0000","last_unstale":"2024-04-25T09:09:28.694360+0000","last_undegraded":"2024-04-25T09:09:28.694360+0000","last_fullsized":"2024-04-25T09:09:28.694360+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:11.765250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877970+0000","last_change":"2024-04-25T09:09:26.911169+0000","last_active":"2024-04-25T09:09:27.877970+0000","last_peered":"2024-04-25T09:09:27.877970+0000","last_clean":"2024-04-25T09:09:27.877970+0000","last_became_active":"2024-04-25T09:09:26.910649+0000","last_became_peered":"2024-04-25T09:09:26.910649+0000","last_unstale":"2024-04-25T09:09:27.877970+0000","last_undegraded":"2024-04-25T09:09:27.877970+0000","last_fullsized":"2024-04-25T09:09:27.877970+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:43.383066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694367+0000","last_change":"2024-04-25T09:09:26.909778+0000","last_active":"2024-04-25T09:09:28.694367+0000","last_peered":"2024-04-25T09:09:28.694367+0000","last_clean":"2024-04-25T09:09:28.694367+0000","last_became_active":"2024-04-25T09:09:26.909495+0000","last_became_peered":"2024-04-25T09:09:26.909495+0000","last_unstale":"2024-04-25T09:09:28.694367+0000","last_undegraded":"2024-04-25T09:09:28.694367+0000","last_fullsized":"2024-04-25T09:09:28.694367+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:15.564347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877754+0000","last_change":"2024-04-25T09:09:26.890288+0000","last_active":"2024-04-25T09:09:27.877754+0000","last_peered":"2024-04-25T09:09:27.877754+0000","last_clean":"2024-04-25T09:09:27.877754+0000","last_became_active":"2024-04-25T09:09:26.889997+0000","last_became_peered":"2024-04-25T09:09:26.889997+0000","last_unstale":"2024-04-25T09:09:27.877754+0000","last_undegraded":"2024-04-25T09:09:27.877754+0000","last_fullsized":"2024-04-25T09:09:27.877754+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:46.747064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878504+0000","last_change":"2024-04-25T09:09:26.890210+0000","last_active":"2024-04-25T09:09:27.878504+0000","last_peered":"2024-04-25T09:09:27.878504+0000","last_clean":"2024-04-25T09:09:27.878504+0000","last_became_active":"2024-04-25T09:09:26.889939+0000","last_became_peered":"2024-04-25T09:09:26.889939+0000","last_unstale":"2024-04-25T09:09:27.878504+0000","last_undegraded":"2024-04-25T09:09:27.878504+0000","last_fullsized":"2024-04-25T09:09:27.878504+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:23.740183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694624+0000","last_change":"2024-04-25T09:09:26.893150+0000","last_active":"2024-04-25T09:09:28.694624+0000","last_peered":"2024-04-25T09:09:28.694624+0000","last_clean":"2024-04-25T09:09:28.694624+0000","last_became_active":"2024-04-25T09:09:26.892878+0000","last_became_peered":"2024-04-25T09:09:26.892878+0000","last_unstale":"2024-04-25T09:09:28.694624+0000","last_undegraded":"2024-04-25T09:09:28.694624+0000","last_fullsized":"2024-04-25T09:09:28.694624+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:12.002802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878727+0000","last_change":"2024-04-25T09:09:26.907546+0000","last_active":"2024-04-25T09:09:27.878727+0000","last_peered":"2024-04-25T09:09:27.878727+0000","last_clean":"2024-04-25T09:09:27.878727+0000","last_became_active":"2024-04-25T09:09:26.907067+0000","last_became_peered":"2024-04-25T09:09:26.907067+0000","last_unstale":"2024-04-25T09:09:27.878727+0000","last_undegraded":"2024-04-25T09:09:27.878727+0000","last_fullsized":"2024-04-25T09:09:27.878727+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:16.612907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695210+0000","last_change":"2024-04-25T09:09:26.915859+0000","last_active":"2024-04-25T09:09:28.695210+0000","last_peered":"2024-04-25T09:09:28.695210+0000","last_clean":"2024-04-25T09:09:28.695210+0000","last_became_active":"2024-04-25T09:09:26.915582+0000","last_became_peered":"2024-04-25T09:09:26.915582+0000","last_unstale":"2024-04-25T09:09:28.695210+0000","last_undegraded":"2024-04-25T09:09:28.695210+0000","last_fullsized":"2024-04-25T09:09:28.695210+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:36.548327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878530+0000","last_change":"2024-04-25T09:09:26.889501+0000","last_active":"2024-04-25T09:09:27.878530+0000","last_peered":"2024-04-25T09:09:27.878530+0000","last_clean":"2024-04-25T09:09:27.878530+0000","last_became_active":"2024-04-25T09:09:26.889203+0000","last_became_peered":"2024-04-25T09:09:26.889203+0000","last_unstale":"2024-04-25T09:09:27.878530+0000","last_undegraded":"2024-04-25T09:09:27.878530+0000","last_fullsized":"2024-04-25T09:09:27.878530+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:47.910831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878007+0000","last_change":"2024-04-25T09:09:26.911728+0000","last_active":"2024-04-25T09:09:27.878007+0000","last_peered":"2024-04-25T09:09:27.878007+0000","last_clean":"2024-04-25T09:09:27.878007+0000","last_became_active":"2024-04-25T09:09:26.911326+0000","last_became_peered":"2024-04-25T09:09:26.911326+0000","last_unstale":"2024-04-25T09:09:27.878007+0000","last_undegraded":"2024-04-25T09:09:27.878007+0000","last_fullsized":"2024-04-25T09:09:27.878007+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:04.056308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694105+0000","last_change":"2024-04-25T09:09:26.911084+0000","last_active":"2024-04-25T09:09:28.694105+0000","last_peered":"2024-04-25T09:09:28.694105+0000","last_clean":"2024-04-25T09:09:28.694105+0000","last_became_active":"2024-04-25T09:09:26.910797+0000","last_became_peered":"2024-04-25T09:09:26.910797+0000","last_unstale":"2024-04-25T09:09:28.694105+0000","last_undegraded":"2024-04-25T09:09:28.694105+0000","last_fullsized":"2024-04-25T09:09:28.694105+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:39.999904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694346+0000","last_change":"2024-04-25T09:09:26.892545+0000","last_active":"2024-04-25T09:09:28.694346+0000","last_peered":"2024-04-25T09:09:28.694346+0000","last_clean":"2024-04-25T09:09:28.694346+0000","last_became_active":"2024-04-25T09:09:26.892292+0000","last_became_peered":"2024-04-25T09:09:26.892292+0000","last_unstale":"2024-04-25T09:09:28.694346+0000","last_undegraded":"2024-04-25T09:09:28.694346+0000","last_fullsized":"2024-04-25T09:09:28.694346+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:45.556771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694403+0000","last_change":"2024-04-25T09:09:26.891490+0000","last_active":"2024-04-25T09:09:28.694403+0000","last_peered":"2024-04-25T09:09:28.694403+0000","last_clean":"2024-04-25T09:09:28.694403+0000","last_became_active":"2024-04-25T09:09:26.890866+0000","last_became_peered":"2024-04-25T09:09:26.890866+0000","last_unstale":"2024-04-25T09:09:28.694403+0000","last_undegraded":"2024-04-25T09:09:28.694403+0000","last_fullsized":"2024-04-25T09:09:28.694403+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:47.875102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878629+0000","last_change":"2024-04-25T09:09:26.915924+0000","last_active":"2024-04-25T09:09:27.878629+0000","last_peered":"2024-04-25T09:09:27.878629+0000","last_clean":"2024-04-25T09:09:27.878629+0000","last_became_active":"2024-04-25T09:09:26.915617+0000","last_became_peered":"2024-04-25T09:09:26.915617+0000","last_unstale":"2024-04-25T09:09:27.878629+0000","last_undegraded":"2024-04-25T09:09:27.878629+0000","last_fullsized":"2024-04-25T09:09:27.878629+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:46.270829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879087+0000","last_change":"2024-04-25T09:09:26.900162+0000","last_active":"2024-04-25T09:09:27.879087+0000","last_peered":"2024-04-25T09:09:27.879087+0000","last_clean":"2024-04-25T09:09:27.879087+0000","last_became_active":"2024-04-25T09:09:26.899697+0000","last_became_peered":"2024-04-25T09:09:26.899697+0000","last_unstale":"2024-04-25T09:09:27.879087+0000","last_undegraded":"2024-04-25T09:09:27.879087+0000","last_fullsized":"2024-04-25T09:09:27.879087+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:41.618620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695320+0000","last_change":"2024-04-25T09:09:26.909249+0000","last_active":"2024-04-25T09:09:28.695320+0000","last_peered":"2024-04-25T09:09:28.695320+0000","last_clean":"2024-04-25T09:09:28.695320+0000","last_became_active":"2024-04-25T09:09:26.908995+0000","last_became_peered":"2024-04-25T09:09:26.908995+0000","last_unstale":"2024-04-25T09:09:28.695320+0000","last_undegraded":"2024-04-25T09:09:28.695320+0000","last_fullsized":"2024-04-25T09:09:28.695320+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:48.941318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.693922+0000","last_change":"2024-04-25T09:09:26.900180+0000","last_active":"2024-04-25T09:09:28.693922+0000","last_peered":"2024-04-25T09:09:28.693922+0000","last_clean":"2024-04-25T09:09:28.693922+0000","last_became_active":"2024-04-25T09:09:26.899917+0000","last_became_peered":"2024-04-25T09:09:26.899917+0000","last_unstale":"2024-04-25T09:09:28.693922+0000","last_undegraded":"2024-04-25T09:09:28.693922+0000","last_fullsized":"2024-04-25T09:09:28.693922+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:37.202446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878423+0000","last_change":"2024-04-25T09:09:26.892277+0000","last_active":"2024-04-25T09:09:27.878423+0000","last_peered":"2024-04-25T09:09:27.878423+0000","last_clean":"2024-04-25T09:09:27.878423+0000","last_became_active":"2024-04-25T09:09:26.891967+0000","last_became_peered":"2024-04-25T09:09:26.891967+0000","last_unstale":"2024-04-25T09:09:27.878423+0000","last_undegraded":"2024-04-25T09:09:27.878423+0000","last_fullsized":"2024-04-25T09:09:27.878423+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:15.199604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694617+0000","last_change":"2024-04-25T09:09:26.912200+0000","last_active":"2024-04-25T09:09:28.694617+0000","last_peered":"2024-04-25T09:09:28.694617+0000","last_clean":"2024-04-25T09:09:28.694617+0000","last_became_active":"2024-04-25T09:09:26.911878+0000","last_became_peered":"2024-04-25T09:09:26.911878+0000","last_unstale":"2024-04-25T09:09:28.694617+0000","last_undegraded":"2024-04-25T09:09:28.694617+0000","last_fullsized":"2024-04-25T09:09:28.694617+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:56.330021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877597+0000","last_change":"2024-04-25T09:09:26.890855+0000","last_active":"2024-04-25T09:09:27.877597+0000","last_peered":"2024-04-25T09:09:27.877597+0000","last_clean":"2024-04-25T09:09:27.877597+0000","last_became_active":"2024-04-25T09:09:26.890600+0000","last_became_peered":"2024-04-25T09:09:26.890600+0000","last_unstale":"2024-04-25T09:09:27.877597+0000","last_undegraded":"2024-04-25T09:09:27.877597+0000","last_fullsized":"2024-04-25T09:09:27.877597+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:29.370531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877890+0000","last_change":"2024-04-25T09:09:26.884423+0000","last_active":"2024-04-25T09:09:27.877890+0000","last_peered":"2024-04-25T09:09:27.877890+0000","last_clean":"2024-04-25T09:09:27.877890+0000","last_became_active":"2024-04-25T09:09:26.884029+0000","last_became_peered":"2024-04-25T09:09:26.884029+0000","last_unstale":"2024-04-25T09:09:27.877890+0000","last_undegraded":"2024-04-25T09:09:27.877890+0000","last_fullsized":"2024-04-25T09:09:27.877890+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:09.825442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"96'4","reported_seq":18,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695112+0000","last_change":"2024-04-25T09:09:25.891328+0000","last_active":"2024-04-25T09:09:28.695112+0000","last_peered":"2024-04-25T09:09:28.695112+0000","last_clean":"2024-04-25T09:09:28.695112+0000","last_became_active":"2024-04-25T09:09:25.891055+0000","last_became_peered":"2024-04-25T09:09:25.891055+0000","last_unstale":"2024-04-25T09:09:28.695112+0000","last_undegraded":"2024-04-25T09:09:28.695112+0000","last_fullsized":"2024-04-25T09:09:28.695112+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:26.020961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878066+0000","last_change":"2024-04-25T09:09:26.901370+0000","last_active":"2024-04-25T09:09:27.878066+0000","last_peered":"2024-04-25T09:09:27.878066+0000","last_clean":"2024-04-25T09:09:27.878066+0000","last_became_active":"2024-04-25T09:09:26.901014+0000","last_became_peered":"2024-04-25T09:09:26.901014+0000","last_unstale":"2024-04-25T09:09:27.878066+0000","last_undegraded":"2024-04-25T09:09:27.878066+0000","last_fullsized":"2024-04-25T09:09:27.878066+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:54.558905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878756+0000","last_change":"2024-04-25T09:09:25.891301+0000","last_active":"2024-04-25T09:09:27.878756+0000","last_peered":"2024-04-25T09:09:27.878756+0000","last_clean":"2024-04-25T09:09:27.878756+0000","last_became_active":"2024-04-25T09:09:25.891027+0000","last_became_peered":"2024-04-25T09:09:25.891027+0000","last_unstale":"2024-04-25T09:09:27.878756+0000","last_undegraded":"2024-04-25T09:09:27.878756+0000","last_fullsized":"2024-04-25T09:09:27.878756+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:29.460046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694081+0000","last_change":"2024-04-25T09:09:26.915707+0000","last_active":"2024-04-25T09:09:28.694081+0000","last_peered":"2024-04-25T09:09:28.694081+0000","last_clean":"2024-04-25T09:09:28.694081+0000","last_became_active":"2024-04-25T09:09:26.915348+0000","last_became_peered":"2024-04-25T09:09:26.915348+0000","last_unstale":"2024-04-25T09:09:28.694081+0000","last_undegraded":"2024-04-25T09:09:28.694081+0000","last_fullsized":"2024-04-25T09:09:28.694081+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:57.482323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694501+0000","last_change":"2024-04-25T09:09:25.895316+0000","last_active":"2024-04-25T09:09:28.694501+0000","last_peered":"2024-04-25T09:09:28.694501+0000","last_clean":"2024-04-25T09:09:28.694501+0000","last_became_active":"2024-04-25T09:09:25.895025+0000","last_became_peered":"2024-04-25T09:09:25.895025+0000","last_unstale":"2024-04-25T09:09:28.694501+0000","last_undegraded":"2024-04-25T09:09:28.694501+0000","last_fullsized":"2024-04-25T09:09:28.694501+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:26.184872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878561+0000","last_change":"2024-04-25T09:09:26.893173+0000","last_active":"2024-04-25T09:09:27.878561+0000","last_peered":"2024-04-25T09:09:27.878561+0000","last_clean":"2024-04-25T09:09:27.878561+0000","last_became_active":"2024-04-25T09:09:26.892420+0000","last_became_peered":"2024-04-25T09:09:26.892420+0000","last_unstale":"2024-04-25T09:09:27.878561+0000","last_undegraded":"2024-04-25T09:09:27.878561+0000","last_fullsized":"2024-04-25T09:09:27.878561+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:20.008848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694910+0000","last_change":"2024-04-25T09:09:25.893538+0000","last_active":"2024-04-25T09:09:28.694910+0000","last_peered":"2024-04-25T09:09:28.694910+0000","last_clean":"2024-04-25T09:09:28.694910+0000","last_became_active":"2024-04-25T09:09:25.893014+0000","last_became_peered":"2024-04-25T09:09:25.893014+0000","last_unstale":"2024-04-25T09:09:28.694910+0000","last_undegraded":"2024-04-25T09:09:28.694910+0000","last_fullsized":"2024-04-25T09:09:28.694910+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:10.295905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694427+0000","last_change":"2024-04-25T09:09:26.909690+0000","last_active":"2024-04-25T09:09:28.694427+0000","last_peered":"2024-04-25T09:09:28.694427+0000","last_clean":"2024-04-25T09:09:28.694427+0000","last_became_active":"2024-04-25T09:09:26.909399+0000","last_became_peered":"2024-04-25T09:09:26.909399+0000","last_unstale":"2024-04-25T09:09:28.694427+0000","last_undegraded":"2024-04-25T09:09:28.694427+0000","last_fullsized":"2024-04-25T09:09:28.694427+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:53.115977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878346+0000","last_change":"2024-04-25T09:09:25.888297+0000","last_active":"2024-04-25T09:09:27.878346+0000","last_peered":"2024-04-25T09:09:27.878346+0000","last_clean":"2024-04-25T09:09:27.878346+0000","last_became_active":"2024-04-25T09:09:25.887706+0000","last_became_peered":"2024-04-25T09:09:25.887706+0000","last_unstale":"2024-04-25T09:09:27.878346+0000","last_undegraded":"2024-04-25T09:09:27.878346+0000","last_fullsized":"2024-04-25T09:09:27.878346+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:00.496547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694277+0000","last_change":"2024-04-25T09:09:26.894500+0000","last_active":"2024-04-25T09:09:28.694277+0000","last_peered":"2024-04-25T09:09:28.694277+0000","last_clean":"2024-04-25T09:09:28.694277+0000","last_became_active":"2024-04-25T09:09:26.893339+0000","last_became_peered":"2024-04-25T09:09:26.893339+0000","last_unstale":"2024-04-25T09:09:28.694277+0000","last_undegraded":"2024-04-25T09:09:28.694277+0000","last_fullsized":"2024-04-25T09:09:28.694277+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:21.216175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695215+0000","last_change":"2024-04-25T09:09:25.888636+0000","last_active":"2024-04-25T09:09:28.695215+0000","last_peered":"2024-04-25T09:09:28.695215+0000","last_clean":"2024-04-25T09:09:28.695215+0000","last_became_active":"2024-04-25T09:09:25.888332+0000","last_became_peered":"2024-04-25T09:09:25.888332+0000","last_unstale":"2024-04-25T09:09:28.695215+0000","last_undegraded":"2024-04-25T09:09:28.695215+0000","last_fullsized":"2024-04-25T09:09:28.695215+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:59.063251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878062+0000","last_change":"2024-04-25T09:09:26.912804+0000","last_active":"2024-04-25T09:09:27.878062+0000","last_peered":"2024-04-25T09:09:27.878062+0000","last_clean":"2024-04-25T09:09:27.878062+0000","last_became_active":"2024-04-25T09:09:26.912208+0000","last_became_peered":"2024-04-25T09:09:26.912208+0000","last_unstale":"2024-04-25T09:09:27.878062+0000","last_undegraded":"2024-04-25T09:09:27.878062+0000","last_fullsized":"2024-04-25T09:09:27.878062+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:33:39.777394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694925+0000","last_change":"2024-04-25T09:09:25.891312+0000","last_active":"2024-04-25T09:09:28.694925+0000","last_peered":"2024-04-25T09:09:28.694925+0000","last_clean":"2024-04-25T09:09:28.694925+0000","last_became_active":"2024-04-25T09:09:25.890959+0000","last_became_peered":"2024-04-25T09:09:25.890959+0000","last_unstale":"2024-04-25T09:09:28.694925+0000","last_undegraded":"2024-04-25T09:09:28.694925+0000","last_fullsized":"2024-04-25T09:09:28.694925+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:12.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694573+0000","last_change":"2024-04-25T09:09:26.907307+0000","last_active":"2024-04-25T09:09:28.694573+0000","last_peered":"2024-04-25T09:09:28.694573+0000","last_clean":"2024-04-25T09:09:28.694573+0000","last_became_active":"2024-04-25T09:09:26.907053+0000","last_became_peered":"2024-04-25T09:09:26.907053+0000","last_unstale":"2024-04-25T09:09:28.694573+0000","last_undegraded":"2024-04-25T09:09:28.694573+0000","last_fullsized":"2024-04-25T09:09:28.694573+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:48.603667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.693901+0000","last_change":"2024-04-25T09:09:25.893856+0000","last_active":"2024-04-25T09:09:28.693901+0000","last_peered":"2024-04-25T09:09:28.693901+0000","last_clean":"2024-04-25T09:09:28.693901+0000","last_became_active":"2024-04-25T09:09:25.893562+0000","last_became_peered":"2024-04-25T09:09:25.893562+0000","last_unstale":"2024-04-25T09:09:28.693901+0000","last_undegraded":"2024-04-25T09:09:28.693901+0000","last_fullsized":"2024-04-25T09:09:28.693901+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:28.617165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878454+0000","last_change":"2024-04-25T09:09:26.895908+0000","last_active":"2024-04-25T09:09:27.878454+0000","last_peered":"2024-04-25T09:09:27.878454+0000","last_clean":"2024-04-25T09:09:27.878454+0000","last_became_active":"2024-04-25T09:09:26.895544+0000","last_became_peered":"2024-04-25T09:09:26.895544+0000","last_unstale":"2024-04-25T09:09:27.878454+0000","last_undegraded":"2024-04-25T09:09:27.878454+0000","last_fullsized":"2024-04-25T09:09:27.878454+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:15.682654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694584+0000","last_change":"2024-04-25T09:09:25.892399+0000","last_active":"2024-04-25T09:09:28.694584+0000","last_peered":"2024-04-25T09:09:28.694584+0000","last_clean":"2024-04-25T09:09:28.694584+0000","last_became_active":"2024-04-25T09:09:25.892107+0000","last_became_peered":"2024-04-25T09:09:25.892107+0000","last_unstale":"2024-04-25T09:09:28.694584+0000","last_undegraded":"2024-04-25T09:09:28.694584+0000","last_fullsized":"2024-04-25T09:09:28.694584+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:14.676493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694387+0000","last_change":"2024-04-25T09:09:26.887741+0000","last_active":"2024-04-25T09:09:28.694387+0000","last_peered":"2024-04-25T09:09:28.694387+0000","last_clean":"2024-04-25T09:09:28.694387+0000","last_became_active":"2024-04-25T09:09:26.887417+0000","last_became_peered":"2024-04-25T09:09:26.887417+0000","last_unstale":"2024-04-25T09:09:28.694387+0000","last_undegraded":"2024-04-25T09:09:28.694387+0000","last_fullsized":"2024-04-25T09:09:28.694387+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:23.104715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694758+0000","last_change":"2024-04-25T09:09:25.891693+0000","last_active":"2024-04-25T09:09:28.694758+0000","last_peered":"2024-04-25T09:09:28.694758+0000","last_clean":"2024-04-25T09:09:28.694758+0000","last_became_active":"2024-04-25T09:09:25.891465+0000","last_became_peered":"2024-04-25T09:09:25.891465+0000","last_unstale":"2024-04-25T09:09:28.694758+0000","last_undegraded":"2024-04-25T09:09:28.694758+0000","last_fullsized":"2024-04-25T09:09:28.694758+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:26.140967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694812+0000","last_change":"2024-04-25T09:09:26.897388+0000","last_active":"2024-04-25T09:09:28.694812+0000","last_peered":"2024-04-25T09:09:28.694812+0000","last_clean":"2024-04-25T09:09:28.694812+0000","last_became_active":"2024-04-25T09:09:26.897138+0000","last_became_peered":"2024-04-25T09:09:26.897138+0000","last_unstale":"2024-04-25T09:09:28.694812+0000","last_undegraded":"2024-04-25T09:09:28.694812+0000","last_fullsized":"2024-04-25T09:09:28.694812+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:07.845041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"96'3","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878807+0000","last_change":"2024-04-25T09:09:25.890611+0000","last_active":"2024-04-25T09:09:27.878807+0000","last_peered":"2024-04-25T09:09:27.878807+0000","last_clean":"2024-04-25T09:09:27.878807+0000","last_became_active":"2024-04-25T09:09:25.889897+0000","last_became_peered":"2024-04-25T09:09:25.889897+0000","last_unstale":"2024-04-25T09:09:27.878807+0000","last_undegraded":"2024-04-25T09:09:27.878807+0000","last_fullsized":"2024-04-25T09:09:27.878807+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:00.689979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695142+0000","last_change":"2024-04-25T09:09:26.906211+0000","last_active":"2024-04-25T09:09:28.695142+0000","last_peered":"2024-04-25T09:09:28.695142+0000","last_clean":"2024-04-25T09:09:28.695142+0000","last_became_active":"2024-04-25T09:09:26.905774+0000","last_became_peered":"2024-04-25T09:09:26.905774+0000","last_unstale":"2024-04-25T09:09:28.695142+0000","last_undegraded":"2024-04-25T09:09:28.695142+0000","last_fullsized":"2024-04-25T09:09:28.695142+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:39.497239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"96'6","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878178+0000","last_change":"2024-04-25T09:09:25.892734+0000","last_active":"2024-04-25T09:09:27.878178+0000","last_peered":"2024-04-25T09:09:27.878178+0000","last_clean":"2024-04-25T09:09:27.878178+0000","last_became_active":"2024-04-25T09:09:25.892486+0000","last_became_peered":"2024-04-25T09:09:25.892486+0000","last_unstale":"2024-04-25T09:09:27.878178+0000","last_undegraded":"2024-04-25T09:09:27.878178+0000","last_fullsized":"2024-04-25T09:09:27.878178+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:28.617165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694564+0000","last_change":"2024-04-25T09:09:26.914455+0000","last_active":"2024-04-25T09:09:28.694564+0000","last_peered":"2024-04-25T09:09:28.694564+0000","last_clean":"2024-04-25T09:09:28.694564+0000","last_became_active":"2024-04-25T09:09:26.912881+0000","last_became_peered":"2024-04-25T09:09:26.912881+0000","last_unstale":"2024-04-25T09:09:28.694564+0000","last_undegraded":"2024-04-25T09:09:28.694564+0000","last_fullsized":"2024-04-25T09:09:28.694564+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:32.128756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694043+0000","last_change":"2024-04-25T09:09:25.895891+0000","last_active":"2024-04-25T09:09:28.694043+0000","last_peered":"2024-04-25T09:09:28.694043+0000","last_clean":"2024-04-25T09:09:28.694043+0000","last_became_active":"2024-04-25T09:09:25.894219+0000","last_became_peered":"2024-04-25T09:09:25.894219+0000","last_unstale":"2024-04-25T09:09:28.694043+0000","last_undegraded":"2024-04-25T09:09:28.694043+0000","last_fullsized":"2024-04-25T09:09:28.694043+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:44.550609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877982+0000","last_change":"2024-04-25T09:09:26.882098+0000","last_active":"2024-04-25T09:09:27.877982+0000","last_peered":"2024-04-25T09:09:27.877982+0000","last_clean":"2024-04-25T09:09:27.877982+0000","last_became_active":"2024-04-25T09:09:26.881774+0000","last_became_peered":"2024-04-25T09:09:26.881774+0000","last_unstale":"2024-04-25T09:09:27.877982+0000","last_undegraded":"2024-04-25T09:09:27.877982+0000","last_fullsized":"2024-04-25T09:09:27.877982+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:38.604466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877730+0000","last_change":"2024-04-25T09:09:25.888905+0000","last_active":"2024-04-25T09:09:27.877730+0000","last_peered":"2024-04-25T09:09:27.877730+0000","last_clean":"2024-04-25T09:09:27.877730+0000","last_became_active":"2024-04-25T09:09:25.887974+0000","last_became_peered":"2024-04-25T09:09:25.887974+0000","last_unstale":"2024-04-25T09:09:27.877730+0000","last_undegraded":"2024-04-25T09:09:27.877730+0000","last_fullsized":"2024-04-25T09:09:27.877730+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:15.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879185+0000","last_change":"2024-04-25T09:09:26.916502+0000","last_active":"2024-04-25T09:09:27.879185+0000","last_peered":"2024-04-25T09:09:27.879185+0000","last_clean":"2024-04-25T09:09:27.879185+0000","last_became_active":"2024-04-25T09:09:26.916269+0000","last_became_peered":"2024-04-25T09:09:26.916269+0000","last_unstale":"2024-04-25T09:09:27.879185+0000","last_undegraded":"2024-04-25T09:09:27.879185+0000","last_fullsized":"2024-04-25T09:09:27.879185+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:29.397203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694554+0000","last_change":"2024-04-25T09:09:25.893744+0000","last_active":"2024-04-25T09:09:28.694554+0000","last_peered":"2024-04-25T09:09:28.694554+0000","last_clean":"2024-04-25T09:09:28.694554+0000","last_became_active":"2024-04-25T09:09:25.892844+0000","last_became_peered":"2024-04-25T09:09:25.892844+0000","last_unstale":"2024-04-25T09:09:28.694554+0000","last_undegraded":"2024-04-25T09:09:28.694554+0000","last_fullsized":"2024-04-25T09:09:28.694554+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:56.231571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879077+0000","last_change":"2024-04-25T09:09:26.898749+0000","last_active":"2024-04-25T09:09:27.879077+0000","last_peered":"2024-04-25T09:09:27.879077+0000","last_clean":"2024-04-25T09:09:27.879077+0000","last_became_active":"2024-04-25T09:09:26.898150+0000","last_became_peered":"2024-04-25T09:09:26.898150+0000","last_unstale":"2024-04-25T09:09:27.879077+0000","last_undegraded":"2024-04-25T09:09:27.879077+0000","last_fullsized":"2024-04-25T09:09:27.879077+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:03.772159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"96'8","reported_seq":22,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694543+0000","last_change":"2024-04-25T09:09:25.894818+0000","last_active":"2024-04-25T09:09:28.694543+0000","last_peered":"2024-04-25T09:09:28.694543+0000","last_clean":"2024-04-25T09:09:28.694543+0000","last_became_active":"2024-04-25T09:09:25.894535+0000","last_became_peered":"2024-04-25T09:09:25.894535+0000","last_unstale":"2024-04-25T09:09:28.694543+0000","last_undegraded":"2024-04-25T09:09:28.694543+0000","last_fullsized":"2024-04-25T09:09:28.694543+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:36.631220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878063+0000","last_change":"2024-04-25T09:09:26.892885+0000","last_active":"2024-04-25T09:09:27.878063+0000","last_peered":"2024-04-25T09:09:27.878063+0000","last_clean":"2024-04-25T09:09:27.878063+0000","last_became_active":"2024-04-25T09:09:26.892623+0000","last_became_peered":"2024-04-25T09:09:26.892623+0000","last_unstale":"2024-04-25T09:09:27.878063+0000","last_undegraded":"2024-04-25T09:09:27.878063+0000","last_fullsized":"2024-04-25T09:09:27.878063+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:14.964354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695130+0000","last_change":"2024-04-25T09:09:25.893625+0000","last_active":"2024-04-25T09:09:28.695130+0000","last_peered":"2024-04-25T09:09:28.695130+0000","last_clean":"2024-04-25T09:09:28.695130+0000","last_became_active":"2024-04-25T09:09:25.893276+0000","last_became_peered":"2024-04-25T09:09:25.893276+0000","last_unstale":"2024-04-25T09:09:28.695130+0000","last_undegraded":"2024-04-25T09:09:28.695130+0000","last_fullsized":"2024-04-25T09:09:28.695130+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:29.598163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695021+0000","last_change":"2024-04-25T09:09:26.891031+0000","last_active":"2024-04-25T09:09:28.695021+0000","last_peered":"2024-04-25T09:09:28.695021+0000","last_clean":"2024-04-25T09:09:28.695021+0000","last_became_active":"2024-04-25T09:09:26.890788+0000","last_became_peered":"2024-04-25T09:09:26.890788+0000","last_unstale":"2024-04-25T09:09:28.695021+0000","last_undegraded":"2024-04-25T09:09:28.695021+0000","last_fullsized":"2024-04-25T09:09:28.695021+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:09.501598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694202+0000","last_change":"2024-04-25T09:09:25.897420+0000","last_active":"2024-04-25T09:09:28.694202+0000","last_peered":"2024-04-25T09:09:28.694202+0000","last_clean":"2024-04-25T09:09:28.694202+0000","last_became_active":"2024-04-25T09:09:25.896968+0000","last_became_peered":"2024-04-25T09:09:25.896968+0000","last_unstale":"2024-04-25T09:09:28.694202+0000","last_undegraded":"2024-04-25T09:09:28.694202+0000","last_fullsized":"2024-04-25T09:09:28.694202+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:23:28.244528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878728+0000","last_change":"2024-04-25T09:09:26.902520+0000","last_active":"2024-04-25T09:09:27.878728+0000","last_peered":"2024-04-25T09:09:27.878728+0000","last_clean":"2024-04-25T09:09:27.878728+0000","last_became_active":"2024-04-25T09:09:26.902128+0000","last_became_peered":"2024-04-25T09:09:26.902128+0000","last_unstale":"2024-04-25T09:09:27.878728+0000","last_undegraded":"2024-04-25T09:09:27.878728+0000","last_fullsized":"2024-04-25T09:09:27.878728+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:04.360175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878847+0000","last_change":"2024-04-25T09:09:25.890897+0000","last_active":"2024-04-25T09:09:27.878847+0000","last_peered":"2024-04-25T09:09:27.878847+0000","last_clean":"2024-04-25T09:09:27.878847+0000","last_became_active":"2024-04-25T09:09:25.890283+0000","last_became_peered":"2024-04-25T09:09:25.890283+0000","last_unstale":"2024-04-25T09:09:27.878847+0000","last_undegraded":"2024-04-25T09:09:27.878847+0000","last_fullsized":"2024-04-25T09:09:27.878847+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:13.142222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877758+0000","last_change":"2024-04-25T09:09:26.910678+0000","last_active":"2024-04-25T09:09:27.877758+0000","last_peered":"2024-04-25T09:09:27.877758+0000","last_clean":"2024-04-25T09:09:27.877758+0000","last_became_active":"2024-04-25T09:09:26.910403+0000","last_became_peered":"2024-04-25T09:09:26.910403+0000","last_unstale":"2024-04-25T09:09:27.877758+0000","last_undegraded":"2024-04-25T09:09:27.877758+0000","last_fullsized":"2024-04-25T09:09:27.877758+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:43.004790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.693883+0000","last_change":"2024-04-25T09:09:25.889771+0000","last_active":"2024-04-25T09:09:28.693883+0000","last_peered":"2024-04-25T09:09:28.693883+0000","last_clean":"2024-04-25T09:09:28.693883+0000","last_became_active":"2024-04-25T09:09:25.889426+0000","last_became_peered":"2024-04-25T09:09:25.889426+0000","last_unstale":"2024-04-25T09:09:28.693883+0000","last_undegraded":"2024-04-25T09:09:28.693883+0000","last_fullsized":"2024-04-25T09:09:28.693883+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:14.193442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.693923+0000","last_change":"2024-04-25T09:09:26.895859+0000","last_active":"2024-04-25T09:09:28.693923+0000","last_peered":"2024-04-25T09:09:28.693923+0000","last_clean":"2024-04-25T09:09:28.693923+0000","last_became_active":"2024-04-25T09:09:26.895588+0000","last_became_peered":"2024-04-25T09:09:26.895588+0000","last_unstale":"2024-04-25T09:09:28.693923+0000","last_undegraded":"2024-04-25T09:09:28.693923+0000","last_fullsized":"2024-04-25T09:09:28.693923+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:39.999904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.879040+0000","last_change":"2024-04-25T09:09:25.894259+0000","last_active":"2024-04-25T09:09:27.879040+0000","last_peered":"2024-04-25T09:09:27.879040+0000","last_clean":"2024-04-25T09:09:27.879040+0000","last_became_active":"2024-04-25T09:09:25.893924+0000","last_became_peered":"2024-04-25T09:09:25.893924+0000","last_unstale":"2024-04-25T09:09:27.879040+0000","last_undegraded":"2024-04-25T09:09:27.879040+0000","last_fullsized":"2024-04-25T09:09:27.879040+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:06.938535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694592+0000","last_change":"2024-04-25T09:09:26.912210+0000","last_active":"2024-04-25T09:09:28.694592+0000","last_peered":"2024-04-25T09:09:28.694592+0000","last_clean":"2024-04-25T09:09:28.694592+0000","last_became_active":"2024-04-25T09:09:26.911858+0000","last_became_peered":"2024-04-25T09:09:26.911858+0000","last_unstale":"2024-04-25T09:09:28.694592+0000","last_undegraded":"2024-04-25T09:09:28.694592+0000","last_fullsized":"2024-04-25T09:09:28.694592+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:09.501598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694050+0000","last_change":"2024-04-25T09:09:25.888456+0000","last_active":"2024-04-25T09:09:28.694050+0000","last_peered":"2024-04-25T09:09:28.694050+0000","last_clean":"2024-04-25T09:09:28.694050+0000","last_became_active":"2024-04-25T09:09:25.888121+0000","last_became_peered":"2024-04-25T09:09:25.888121+0000","last_unstale":"2024-04-25T09:09:28.694050+0000","last_undegraded":"2024-04-25T09:09:28.694050+0000","last_fullsized":"2024-04-25T09:09:28.694050+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:10.295905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878097+0000","last_change":"2024-04-25T09:09:26.893393+0000","last_active":"2024-04-25T09:09:27.878097+0000","last_peered":"2024-04-25T09:09:27.878097+0000","last_clean":"2024-04-25T09:09:27.878097+0000","last_became_active":"2024-04-25T09:09:26.892289+0000","last_became_peered":"2024-04-25T09:09:26.892289+0000","last_unstale":"2024-04-25T09:09:27.878097+0000","last_undegraded":"2024-04-25T09:09:27.878097+0000","last_fullsized":"2024-04-25T09:09:27.878097+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:06.636882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878720+0000","last_change":"2024-04-25T09:09:25.883924+0000","last_active":"2024-04-25T09:09:27.878720+0000","last_peered":"2024-04-25T09:09:27.878720+0000","last_clean":"2024-04-25T09:09:27.878720+0000","last_became_active":"2024-04-25T09:09:25.883059+0000","last_became_peered":"2024-04-25T09:09:25.883059+0000","last_unstale":"2024-04-25T09:09:27.878720+0000","last_undegraded":"2024-04-25T09:09:27.878720+0000","last_fullsized":"2024-04-25T09:09:27.878720+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:20.403420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694644+0000","last_change":"2024-04-25T09:09:26.890528+0000","last_active":"2024-04-25T09:09:28.694644+0000","last_peered":"2024-04-25T09:09:28.694644+0000","last_clean":"2024-04-25T09:09:28.694644+0000","last_became_active":"2024-04-25T09:09:26.889103+0000","last_became_peered":"2024-04-25T09:09:26.889103+0000","last_unstale":"2024-04-25T09:09:28.694644+0000","last_undegraded":"2024-04-25T09:09:28.694644+0000","last_fullsized":"2024-04-25T09:09:28.694644+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:15.833064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694635+0000","last_change":"2024-04-25T09:09:25.895283+0000","last_active":"2024-04-25T09:09:28.694635+0000","last_peered":"2024-04-25T09:09:28.694635+0000","last_clean":"2024-04-25T09:09:28.694635+0000","last_became_active":"2024-04-25T09:09:25.894675+0000","last_became_peered":"2024-04-25T09:09:25.894675+0000","last_unstale":"2024-04-25T09:09:28.694635+0000","last_undegraded":"2024-04-25T09:09:28.694635+0000","last_fullsized":"2024-04-25T09:09:28.694635+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:40.391565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878253+0000","last_change":"2024-04-25T09:09:26.884176+0000","last_active":"2024-04-25T09:09:27.878253+0000","last_peered":"2024-04-25T09:09:27.878253+0000","last_clean":"2024-04-25T09:09:27.878253+0000","last_became_active":"2024-04-25T09:09:26.883416+0000","last_became_peered":"2024-04-25T09:09:26.883416+0000","last_unstale":"2024-04-25T09:09:27.878253+0000","last_undegraded":"2024-04-25T09:09:27.878253+0000","last_fullsized":"2024-04-25T09:09:27.878253+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:16.248502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"97'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.881364+0000","last_change":"2024-04-25T09:09:25.888575+0000","last_active":"2024-04-25T09:09:28.881364+0000","last_peered":"2024-04-25T09:09:28.881364+0000","last_clean":"2024-04-25T09:09:28.881364+0000","last_became_active":"2024-04-25T09:09:25.888130+0000","last_became_peered":"2024-04-25T09:09:25.888130+0000","last_unstale":"2024-04-25T09:09:28.881364+0000","last_undegraded":"2024-04-25T09:09:28.881364+0000","last_fullsized":"2024-04-25T09:09:28.881364+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:22.025116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878336+0000","last_change":"2024-04-25T09:09:26.907788+0000","last_active":"2024-04-25T09:09:27.878336+0000","last_peered":"2024-04-25T09:09:27.878336+0000","last_clean":"2024-04-25T09:09:27.878336+0000","last_became_active":"2024-04-25T09:09:26.907509+0000","last_became_peered":"2024-04-25T09:09:26.907509+0000","last_unstale":"2024-04-25T09:09:27.878336+0000","last_undegraded":"2024-04-25T09:09:27.878336+0000","last_fullsized":"2024-04-25T09:09:27.878336+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:59.022383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878920+0000","last_change":"2024-04-25T09:09:25.885545+0000","last_active":"2024-04-25T09:09:27.878920+0000","last_peered":"2024-04-25T09:09:27.878920+0000","last_clean":"2024-04-25T09:09:27.878920+0000","last_became_active":"2024-04-25T09:09:25.885204+0000","last_became_peered":"2024-04-25T09:09:25.885204+0000","last_unstale":"2024-04-25T09:09:27.878920+0000","last_undegraded":"2024-04-25T09:09:27.878920+0000","last_fullsized":"2024-04-25T09:09:27.878920+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:33.311698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694576+0000","last_change":"2024-04-25T09:09:26.891717+0000","last_active":"2024-04-25T09:09:28.694576+0000","last_peered":"2024-04-25T09:09:28.694576+0000","last_clean":"2024-04-25T09:09:28.694576+0000","last_became_active":"2024-04-25T09:09:26.891183+0000","last_became_peered":"2024-04-25T09:09:26.891183+0000","last_unstale":"2024-04-25T09:09:28.694576+0000","last_undegraded":"2024-04-25T09:09:28.694576+0000","last_fullsized":"2024-04-25T09:09:28.694576+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:15.833064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694888+0000","last_change":"2024-04-25T09:09:25.890769+0000","last_active":"2024-04-25T09:09:28.694888+0000","last_peered":"2024-04-25T09:09:28.694888+0000","last_clean":"2024-04-25T09:09:28.694888+0000","last_became_active":"2024-04-25T09:09:25.890367+0000","last_became_peered":"2024-04-25T09:09:25.890367+0000","last_unstale":"2024-04-25T09:09:28.694888+0000","last_undegraded":"2024-04-25T09:09:28.694888+0000","last_fullsized":"2024-04-25T09:09:28.694888+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:14.193442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.878771+0000","last_change":"2024-04-25T09:09:26.899314+0000","last_active":"2024-04-25T09:09:27.878771+0000","last_peered":"2024-04-25T09:09:27.878771+0000","last_clean":"2024-04-25T09:09:27.878771+0000","last_became_active":"2024-04-25T09:09:26.898556+0000","last_became_peered":"2024-04-25T09:09:26.898556+0000","last_unstale":"2024-04-25T09:09:27.878771+0000","last_undegraded":"2024-04-25T09:09:27.878771+0000","last_fullsized":"2024-04-25T09:09:27.878771+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:14.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877854+0000","last_change":"2024-04-25T09:09:25.887331+0000","last_active":"2024-04-25T09:09:27.877854+0000","last_peered":"2024-04-25T09:09:27.877854+0000","last_clean":"2024-04-25T09:09:27.877854+0000","last_became_active":"2024-04-25T09:09:25.886093+0000","last_became_peered":"2024-04-25T09:09:25.886093+0000","last_unstale":"2024-04-25T09:09:27.877854+0000","last_undegraded":"2024-04-25T09:09:27.877854+0000","last_fullsized":"2024-04-25T09:09:27.877854+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:23:28.244528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694280+0000","last_change":"2024-04-25T09:09:26.910027+0000","last_active":"2024-04-25T09:09:28.694280+0000","last_peered":"2024-04-25T09:09:28.694280+0000","last_clean":"2024-04-25T09:09:28.694280+0000","last_became_active":"2024-04-25T09:09:26.909711+0000","last_became_peered":"2024-04-25T09:09:26.909711+0000","last_unstale":"2024-04-25T09:09:28.694280+0000","last_undegraded":"2024-04-25T09:09:28.694280+0000","last_fullsized":"2024-04-25T09:09:28.694280+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:27.191034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694700+0000","last_change":"2024-04-25T09:09:25.888899+0000","last_active":"2024-04-25T09:09:28.694700+0000","last_peered":"2024-04-25T09:09:28.694700+0000","last_clean":"2024-04-25T09:09:28.694700+0000","last_became_active":"2024-04-25T09:09:25.887727+0000","last_became_peered":"2024-04-25T09:09:25.887727+0000","last_unstale":"2024-04-25T09:09:28.694700+0000","last_undegraded":"2024-04-25T09:09:28.694700+0000","last_fullsized":"2024-04-25T09:09:28.694700+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:26.020961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694318+0000","last_change":"2024-04-25T09:09:26.911233+0000","last_active":"2024-04-25T09:09:28.694318+0000","last_peered":"2024-04-25T09:09:28.694318+0000","last_clean":"2024-04-25T09:09:28.694318+0000","last_became_active":"2024-04-25T09:09:26.910962+0000","last_became_peered":"2024-04-25T09:09:26.910962+0000","last_unstale":"2024-04-25T09:09:28.694318+0000","last_undegraded":"2024-04-25T09:09:28.694318+0000","last_fullsized":"2024-04-25T09:09:28.694318+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:47.875102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694383+0000","last_change":"2024-04-25T09:09:25.886416+0000","last_active":"2024-04-25T09:09:28.694383+0000","last_peered":"2024-04-25T09:09:28.694383+0000","last_clean":"2024-04-25T09:09:28.694383+0000","last_became_active":"2024-04-25T09:09:25.886138+0000","last_became_peered":"2024-04-25T09:09:25.886138+0000","last_unstale":"2024-04-25T09:09:28.694383+0000","last_undegraded":"2024-04-25T09:09:28.694383+0000","last_fullsized":"2024-04-25T09:09:28.694383+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:14.676493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:27.877763+0000","last_change":"2024-04-25T09:09:26.895912+0000","last_active":"2024-04-25T09:09:27.877763+0000","last_peered":"2024-04-25T09:09:27.877763+0000","last_clean":"2024-04-25T09:09:27.877763+0000","last_became_active":"2024-04-25T09:09:26.894861+0000","last_became_peered":"2024-04-25T09:09:26.894861+0000","last_unstale":"2024-04-25T09:09:27.877763+0000","last_undegraded":"2024-04-25T09:09:27.877763+0000","last_fullsized":"2024-04-25T09:09:27.877763+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:20.609762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694018+0000","last_change":"2024-04-25T09:09:25.896492+0000","last_active":"2024-04-25T09:09:28.694018+0000","last_peered":"2024-04-25T09:09:28.694018+0000","last_clean":"2024-04-25T09:09:28.694018+0000","last_became_active":"2024-04-25T09:09:25.896219+0000","last_became_peered":"2024-04-25T09:09:25.896219+0000","last_unstale":"2024-04-25T09:09:28.694018+0000","last_undegraded":"2024-04-25T09:09:28.694018+0000","last_fullsized":"2024-04-25T09:09:28.694018+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:15.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694256+0000","last_change":"2024-04-25T09:09:26.894745+0000","last_active":"2024-04-25T09:09:28.694256+0000","last_peered":"2024-04-25T09:09:28.694256+0000","last_clean":"2024-04-25T09:09:28.694256+0000","last_became_active":"2024-04-25T09:09:26.894413+0000","last_became_peered":"2024-04-25T09:09:26.894413+0000","last_unstale":"2024-04-25T09:09:28.694256+0000","last_undegraded":"2024-04-25T09:09:28.694256+0000","last_fullsized":"2024-04-25T09:09:28.694256+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:25.862960+0000","last_clean_scrub_stamp":"2024-04-25T09:09:25.862960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:47.183689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.695290+0000","last_change":"2024-04-25T09:09:25.896662+0000","last_active":"2024-04-25T09:09:28.695290+0000","last_peered":"2024-04-25T09:09:28.695290+0000","last_clean":"2024-04-25T09:09:28.695290+0000","last_became_active":"2024-04-25T09:09:25.896367+0000","last_became_peered":"2024-04-25T09:09:25.896367+0000","last_unstale":"2024-04-25T09:09:28.695290+0000","last_undegraded":"2024-04-25T09:09:28.695290+0000","last_fullsized":"2024-04-25T09:09:28.695290+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:09:24.856799+0000","last_clean_scrub_stamp":"2024-04-25T09:09:24.856799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:27.332997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":309,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-25T09:09:28.694122+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:09:28.694122+0000","last_peered":"2024-04-25T09:09:28.694122+0000","last_clean":"2024-04-25T09:09:28.694122+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:09:28.694122+0000","last_undegraded":"2024-04-25T09:09:28.694122+0000","last_fullsized":"2024-04-25T09:09:28.694122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509526,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50408,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321432,"statfs":{"total":96636764160,"available":96585146368,"internally_reserved":0,"allocated":1208320,"data_stored":551957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509526,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46228,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325612,"statfs":{"total":96636764160,"available":96589426688,"internally_reserved":0,"allocated":1187840,"data_stored":549741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509527,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54560,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317280,"statfs":{"total":96636764160,"available":96580894720,"internally_reserved":0,"allocated":1196032,"data_stored":549901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509526,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54556,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317284,"statfs":{"total":96636764160,"available":96580898816,"internally_reserved":0,"allocated":1187840,"data_stored":549741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509526,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50388,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321452,"statfs":{"total":96636764160,"available":96585166848,"internally_reserved":0,"allocated":1187840,"data_stored":549741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509527,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46236,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325604,"statfs":{"total":96636764160,"available":96589418496,"internally_reserved":0,"allocated":1191936,"data_stored":549811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509527,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50996,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320844,"statfs":{"total":96636764160,"available":96584544256,"internally_reserved":0,"allocated":1806336,"data_stored":1142427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574934,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46820,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325020,"statfs":{"total":96636764160,"available":96588820480,"internally_reserved":0,"allocated":1789952,"data_stored":1140165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:09:35.824 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:09:35.824 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:09:36.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.016+0000 7f651b200640 1 Processor -- start 2024-04-25T09:09:36.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.016+0000 7f651b200640 1 -- start start 2024-04-25T09:09:36.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.020+0000 7f651b200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f651c15a740 0x7f651c0ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:36.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.020+0000 7f651b200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f651c15e310 0x7f651c072710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:36.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.020+0000 7f651b200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f651c072c50 0x7f651c06bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:36.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.020+0000 7f651b200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f651c15e7a0 con 0x7f651c15e310 2024-04-25T09:09:36.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.020+0000 7f651b200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f651c15ea80 con 0x7f651c15a740 2024-04-25T09:09:36.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.020+0000 7f651b200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651c15ed60 con 0x7f651c072c50 2024-04-25T09:09:36.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.020+0000 7f6519400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f651c15e310 0x7f651c072710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:36.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.020+0000 7f6519400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f651c15e310 0x7f651c072710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45904/0 (socket says 172.21.15.173:45904) 2024-04-25T09:09:36.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.020+0000 7f6519400640 1 -- 172.21.15.173:0/1328954845 learned_addr learned my addr 172.21.15.173:0/1328954845 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:36.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.020+0000 7f6519e00640 1 --2- 172.21.15.173:0/1328954845 >> v2:172.21.15.194:3300/0 conn(0x7f651c15a740 0x7f651c0ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:36.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.020+0000 7f651a800640 1 --2- 172.21.15.173:0/1328954845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f651c072c50 0x7f651c06bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:36.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.020+0000 7f6519400640 1 -- 172.21.15.173:0/1328954845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f651c072c50 msgr2=0x7f651c06bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:36.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.020+0000 7f6519400640 1 --2- 172.21.15.173:0/1328954845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f651c072c50 0x7f651c06bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.020+0000 7f6519400640 1 -- 172.21.15.173:0/1328954845 >> v2:172.21.15.194:3300/0 conn(0x7f651c15a740 msgr2=0x7f651c0ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:36.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.020+0000 7f6519400640 1 --2- 172.21.15.173:0/1328954845 >> v2:172.21.15.194:3300/0 conn(0x7f651c15a740 0x7f651c0ae0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.020+0000 7f6519400640 1 -- 172.21.15.173:0/1328954845 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651c15f040 con 0x7f651c15e310 2024-04-25T09:09:36.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.020+0000 7f651a800640 1 --2- 172.21.15.173:0/1328954845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f651c072c50 0x7f651c06bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:36.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.020+0000 7f6519e00640 1 --2- 172.21.15.173:0/1328954845 >> v2:172.21.15.194:3300/0 conn(0x7f651c15a740 0x7f651c0ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:36.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f6519400640 1 --2- 172.21.15.173:0/1328954845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f651c15e310 0x7f651c072710 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f651c15e270 tx=0x7f650801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58f2fc6e0d9be03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:36.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f6518a00640 1 -- 172.21.15.173:0/1328954845 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65080b0070 con 0x7f651c15e310 2024-04-25T09:09:36.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f6518a00640 1 -- 172.21.15.173:0/1328954845 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65080ab600 con 0x7f651c15e310 2024-04-25T09:09:36.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f6518a00640 1 -- 172.21.15.173:0/1328954845 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65080ab9d0 con 0x7f651c15e310 2024-04-25T09:09:36.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f651b200640 1 -- 172.21.15.173:0/1328954845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f651c15e310 msgr2=0x7f651c072710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:36.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f651b200640 1 --2- 172.21.15.173:0/1328954845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f651c15e310 0x7f651c072710 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f651c15e270 tx=0x7f650801c520 comp rx=0 tx=0).stop 2024-04-25T09:09:36.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f651b200640 1 -- 172.21.15.173:0/1328954845 shutdown_connections 2024-04-25T09:09:36.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f651b200640 1 --2- 172.21.15.173:0/1328954845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f651c072c50 0x7f651c06bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f651b200640 1 --2- 172.21.15.173:0/1328954845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f651c15e310 0x7f651c072710 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f651b200640 1 --2- 172.21.15.173:0/1328954845 >> v2:172.21.15.194:3300/0 conn(0x7f651c15a740 0x7f651c0ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f651b200640 1 -- 172.21.15.173:0/1328954845 >> 172.21.15.173:0/1328954845 conn(0x7f651c071b80 msgr2=0x7f651c071f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:36.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f651b200640 1 -- 172.21.15.173:0/1328954845 shutdown_connections 2024-04-25T09:09:36.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f651b200640 1 -- 172.21.15.173:0/1328954845 wait complete. 2024-04-25T09:09:36.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f651b200640 1 Processor -- start 2024-04-25T09:09:36.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f651b200640 1 -- start start 2024-04-25T09:09:36.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f651b200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f651c072c50 0x7f651c14f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:36.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f651b200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f651c15a740 0x7f651c14aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:36.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f651b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f651c1f9fa0 0x7f651c1fa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:36.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f651b200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651c0b3e50 con 0x7f651c15a740 2024-04-25T09:09:36.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f651b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651c0b3cd0 con 0x7f651c1f9fa0 2024-04-25T09:09:36.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.024+0000 7f651b200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651c0b3fd0 con 0x7f651c072c50 2024-04-25T09:09:36.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.028+0000 7f6519400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f651c15a740 0x7f651c14aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:36.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.028+0000 7f6519400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f651c15a740 0x7f651c14aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45910/0 (socket says 172.21.15.173:45910) 2024-04-25T09:09:36.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.028+0000 7f6519400640 1 -- 172.21.15.173:0/607356095 learned_addr learned my addr 172.21.15.173:0/607356095 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:36.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.028+0000 7f6519e00640 1 --2- 172.21.15.173:0/607356095 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f651c072c50 0x7f651c14f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:36.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.028+0000 7f651a800640 1 --2- 172.21.15.173:0/607356095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f651c1f9fa0 0x7f651c1fa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:36.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.028+0000 7f6519400640 1 -- 172.21.15.173:0/607356095 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f651c072c50 msgr2=0x7f651c14f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:36.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.028+0000 7f6519400640 1 --2- 172.21.15.173:0/607356095 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f651c072c50 0x7f651c14f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.028+0000 7f6519400640 1 -- 172.21.15.173:0/607356095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f651c1f9fa0 msgr2=0x7f651c1fa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:36.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.028+0000 7f6519400640 1 --2- 172.21.15.173:0/607356095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f651c1f9fa0 0x7f651c1fa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.028+0000 7f6519400640 1 -- 172.21.15.173:0/607356095 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651c1fae20 con 0x7f651c15a740 2024-04-25T09:09:36.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.028+0000 7f6519400640 1 --2- 172.21.15.173:0/607356095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f651c15a740 0x7f651c14aab0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f65080ae040 tx=0x7f65080192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:36.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.028+0000 7f6512000640 1 -- 172.21.15.173:0/607356095 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65080b0040 con 0x7f651c15a740 2024-04-25T09:09:36.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.028+0000 7f6512000640 1 -- 172.21.15.173:0/607356095 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65080b9070 con 0x7f651c15a740 2024-04-25T09:09:36.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.028+0000 7f651b200640 1 -- 172.21.15.173:0/607356095 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f651c1fab40 con 0x7f651c15a740 2024-04-25T09:09:36.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.028+0000 7f6512000640 1 -- 172.21.15.173:0/607356095 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65080b48a0 con 0x7f651c15a740 2024-04-25T09:09:36.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.028+0000 7f651b200640 1 -- 172.21.15.173:0/607356095 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651c14eb50 con 0x7f651c15a740 2024-04-25T09:09:36.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.028+0000 7f651b200640 1 -- 172.21.15.173:0/607356095 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f651c073a40 con 0x7f651c15a740 2024-04-25T09:09:36.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.028+0000 7f6512000640 1 -- 172.21.15.173:0/607356095 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f65080b4a40 con 0x7f651c15a740 2024-04-25T09:09:36.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.032+0000 7f6512000640 1 --2- 172.21.15.173:0/607356095 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f64fc066f60 0x7f64fc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:36.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.032+0000 7f6512000640 1 -- 172.21.15.173:0/607356095 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f650811f160 con 0x7f651c15a740 2024-04-25T09:09:36.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.032+0000 7f6519e00640 1 --2- 172.21.15.173:0/607356095 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f64fc066f60 0x7f64fc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:36.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.032+0000 7f6519e00640 1 --2- 172.21.15.173:0/607356095 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f64fc066f60 0x7f64fc069420 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f650c00ab60 tx=0x7f650c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:36.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.032+0000 7f6512000640 1 -- 172.21.15.173:0/607356095 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6508016110 con 0x7f651c15a740 2024-04-25T09:09:36.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.244+0000 7f651b200640 1 -- 172.21.15.173:0/607356095 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f651c0618f0 con 0x7f651c15a740 2024-04-25T09:09:36.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.244+0000 7f6512000640 1 -- 172.21.15.173:0/607356095 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f65080ef900 con 0x7f651c15a740 2024-04-25T09:09:36.233 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2024-04-25T09:09:36.234 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w== 2024-04-25T09:09:36.234 INFO:teuthology.orchestra.run.smithi173.stdout: caps mds = "allow" 2024-04-25T09:09:36.234 INFO:teuthology.orchestra.run.smithi173.stdout: caps mon = "allow r" 2024-04-25T09:09:36.234 INFO:teuthology.orchestra.run.smithi173.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:09:36.234 INFO:teuthology.orchestra.run.smithi173.stderr:updated caps for client.0 2024-04-25T09:09:36.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.248+0000 7f651b200640 1 -- 172.21.15.173:0/607356095 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f64fc066f60 msgr2=0x7f64fc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:36.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.248+0000 7f651b200640 1 --2- 172.21.15.173:0/607356095 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f64fc066f60 0x7f64fc069420 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f650c00ab60 tx=0x7f650c008040 comp rx=0 tx=0).stop 2024-04-25T09:09:36.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.248+0000 7f651b200640 1 -- 172.21.15.173:0/607356095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f651c15a740 msgr2=0x7f651c14aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:36.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.248+0000 7f651b200640 1 --2- 172.21.15.173:0/607356095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f651c15a740 0x7f651c14aab0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f65080ae040 tx=0x7f65080192c0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.248+0000 7f651b200640 1 -- 172.21.15.173:0/607356095 shutdown_connections 2024-04-25T09:09:36.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.248+0000 7f651b200640 1 --2- 172.21.15.173:0/607356095 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f64fc066f60 0x7f64fc069420 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.248+0000 7f651b200640 1 --2- 172.21.15.173:0/607356095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f651c1f9fa0 0x7f651c1fa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.248+0000 7f651b200640 1 --2- 172.21.15.173:0/607356095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f651c15a740 0x7f651c14aab0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.248+0000 7f651b200640 1 --2- 172.21.15.173:0/607356095 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f651c072c50 0x7f651c14f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.248+0000 7f651b200640 1 -- 172.21.15.173:0/607356095 >> 172.21.15.173:0/607356095 conn(0x7f651c071b80 msgr2=0x7f651c14d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:36.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.248+0000 7f651b200640 1 -- 172.21.15.173:0/607356095 shutdown_connections 2024-04-25T09:09:36.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.248+0000 7f651b200640 1 -- 172.21.15.173:0/607356095 wait complete. 2024-04-25T09:09:36.255 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:36.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.404+0000 7ff90ba00640 1 Processor -- start 2024-04-25T09:09:36.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.404+0000 7ff90ba00640 1 -- start start 2024-04-25T09:09:36.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.404+0000 7ff90ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff90415b870 0x7ff90415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:36.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.404+0000 7ff90ba00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff90415c760 0x7ff90406ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:36.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.404+0000 7ff90ba00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9040b19d0 con 0x7ff9040b1430 2024-04-25T09:09:36.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.404+0000 7ff90ba00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9040b1cb0 con 0x7ff90415c760 2024-04-25T09:09:36.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.404+0000 7ff90ba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9040b1f90 con 0x7ff90415b870 2024-04-25T09:09:36.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.404+0000 7ff909a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff90415c760 0x7ff90406ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:36.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.404+0000 7ff909a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff90415c760 0x7ff90406ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:60524/0 (socket says 172.21.15.173:60524) 2024-04-25T09:09:36.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.404+0000 7ff909a00640 1 -- 172.21.15.173:0/3775614285 learned_addr learned my addr 172.21.15.173:0/3775614285 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:36.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.404+0000 7ff909000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff90415b870 0x7ff90415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:36.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.404+0000 7ff903e00640 1 --1- 172.21.15.173:0/3775614285 >> v1:172.21.15.194:6789/0 conn(0x7ff9040b1430 0x7ff9040b2c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:51270/0 (socket says 172.21.15.173:51270) 2024-04-25T09:09:36.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.404+0000 7ff909a00640 1 -- 172.21.15.173:0/3775614285 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff90415b870 msgr2=0x7ff90415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:36.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.404+0000 7ff909a00640 1 --2- 172.21.15.173:0/3775614285 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff90415b870 0x7ff90415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.404+0000 7ff909a00640 1 -- 172.21.15.173:0/3775614285 >> v1:172.21.15.194:6789/0 conn(0x7ff9040b1430 legacy=0x7ff9040b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:36.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.404+0000 7ff903400640 1 -- 172.21.15.173:0/3775614285 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752881323 0 0) 0x7ff9040b19d0 con 0x7ff9040b1430 2024-04-25T09:09:36.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.404+0000 7ff909a00640 1 -- 172.21.15.173:0/3775614285 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90415c240 con 0x7ff90415c760 2024-04-25T09:09:36.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.408+0000 7ff909a00640 1 --2- 172.21.15.173:0/3775614285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90415c760 0x7ff90406ac90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc009870 tx=0x7ff8fc01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c48c14d07f280fde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:36.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.408+0000 7ff903400640 1 -- 172.21.15.173:0/3775614285 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0b1070 con 0x7ff90415c760 2024-04-25T09:09:36.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.408+0000 7ff903400640 1 -- 172.21.15.173:0/3775614285 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8fc0a8050 con 0x7ff90415c760 2024-04-25T09:09:36.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.408+0000 7ff903400640 1 -- 172.21.15.173:0/3775614285 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0ac860 con 0x7ff90415c760 2024-04-25T09:09:36.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.408+0000 7ff90ba00640 1 -- 172.21.15.173:0/3775614285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90415c760 msgr2=0x7ff90406ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:36.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.408+0000 7ff90ba00640 1 --2- 172.21.15.173:0/3775614285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90415c760 0x7ff90406ac90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc009870 tx=0x7ff8fc01c4d0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.408+0000 7ff90ba00640 1 -- 172.21.15.173:0/3775614285 shutdown_connections 2024-04-25T09:09:36.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.408+0000 7ff90ba00640 1 --2- 172.21.15.173:0/3775614285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90415c760 0x7ff90406ac90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.408+0000 7ff90ba00640 1 --2- 172.21.15.173:0/3775614285 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff90415b870 0x7ff90415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.408+0000 7ff90ba00640 1 -- 172.21.15.173:0/3775614285 >> 172.21.15.173:0/3775614285 conn(0x7ff904099a50 msgr2=0x7ff9040b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:36.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.408+0000 7ff90ba00640 1 -- 172.21.15.173:0/3775614285 shutdown_connections 2024-04-25T09:09:36.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.408+0000 7ff90ba00640 1 -- 172.21.15.173:0/3775614285 wait complete. 2024-04-25T09:09:36.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff90ba00640 1 Processor -- start 2024-04-25T09:09:36.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff90ba00640 1 -- start start 2024-04-25T09:09:36.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff90ba00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9040b1430 0x7ff904159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:36.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff90ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff90415b870 0x7ff9040c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:36.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff90ba00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90415c760 0x7ff9040ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:36.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff90ba00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff904168a70 con 0x7ff9040b1430 2024-04-25T09:09:36.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff90ba00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90406b5e0 con 0x7ff90415c760 2024-04-25T09:09:36.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff90ba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff904168bf0 con 0x7ff90415b870 2024-04-25T09:09:36.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff909000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9040b1430 0x7ff904159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:36.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff909000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9040b1430 0x7ff904159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45924/0 (socket says 172.21.15.173:45924) 2024-04-25T09:09:36.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff909000640 1 -- 172.21.15.173:0/2222171077 learned_addr learned my addr 172.21.15.173:0/2222171077 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:36.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff903e00640 1 --2- 172.21.15.173:0/2222171077 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff90415b870 0x7ff9040c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:36.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff909a00640 1 --2- 172.21.15.173:0/2222171077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90415c760 0x7ff9040ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:36.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff909000640 1 -- 172.21.15.173:0/2222171077 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff90415b870 msgr2=0x7ff9040c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:36.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff909000640 1 --2- 172.21.15.173:0/2222171077 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff90415b870 0x7ff9040c6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff909000640 1 -- 172.21.15.173:0/2222171077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90415c760 msgr2=0x7ff9040ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:36.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff909000640 1 --2- 172.21.15.173:0/2222171077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90415c760 0x7ff9040ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff909000640 1 -- 172.21.15.173:0/2222171077 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9040c8a40 con 0x7ff9040b1430 2024-04-25T09:09:36.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff909000640 1 --2- 172.21.15.173:0/2222171077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9040b1430 0x7ff904159ee0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009db0 tx=0x7ff8f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:36.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff900c00640 1 -- 172.21.15.173:0/2222171077 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4018020 con 0x7ff9040b1430 2024-04-25T09:09:36.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff900c00640 1 -- 172.21.15.173:0/2222171077 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f4014480 con 0x7ff9040b1430 2024-04-25T09:09:36.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff90ba00640 1 -- 172.21.15.173:0/2222171077 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9040c8d20 con 0x7ff9040b1430 2024-04-25T09:09:36.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff900c00640 1 -- 172.21.15.173:0/2222171077 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4014850 con 0x7ff9040b1430 2024-04-25T09:09:36.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.412+0000 7ff90ba00640 1 -- 172.21.15.173:0/2222171077 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9040ae6e0 con 0x7ff9040b1430 2024-04-25T09:09:36.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.416+0000 7ff90ba00640 1 -- 172.21.15.173:0/2222171077 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff904073a40 con 0x7ff9040b1430 2024-04-25T09:09:36.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.416+0000 7ff900c00640 1 -- 172.21.15.173:0/2222171077 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff8f401b020 con 0x7ff9040b1430 2024-04-25T09:09:36.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.416+0000 7ff900c00640 1 --2- 172.21.15.173:0/2222171077 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff8e4066f60 0x7ff8e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:36.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.416+0000 7ff900c00640 1 -- 172.21.15.173:0/2222171077 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff8f4085fb0 con 0x7ff9040b1430 2024-04-25T09:09:36.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.416+0000 7ff903e00640 1 --2- 172.21.15.173:0/2222171077 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff8e4066f60 0x7ff8e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:36.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.416+0000 7ff903e00640 1 --2- 172.21.15.173:0/2222171077 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff8e4066f60 0x7ff8e4069420 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff9040cfe80 tx=0x7ff8f0007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:36.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.420+0000 7ff900c00640 1 -- 172.21.15.173:0/2222171077 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff8f4022030 con 0x7ff9040b1430 2024-04-25T09:09:36.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.604+0000 7ff90ba00640 1 -- 172.21.15.173:0/2222171077 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff90415c020 con 0x7ff9040b1430 2024-04-25T09:09:36.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.604+0000 7ff900c00640 1 -- 172.21.15.173:0/2222171077 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4946 (secure 0 0 0) 0x7ff8f4010040 con 0x7ff9040b1430 2024-04-25T09:09:36.593 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:09:36.593 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/556010437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":556010437},{"type":"v1","addr":"172.21.15.173:6835","nonce":556010437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":6524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4077641924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4077641924},{"type":"v1","addr":"172.21.15.194:6834","nonce":4077641924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7162,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2938501478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2938501478},{"type":"v1","addr":"172.21.15.194:6835","nonce":2938501478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:09:26.257282+0000","modified":"2024-04-25T09:09:29.275838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/555490935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":555490935},{"type":"v1","addr":"172.21.15.173:6837","nonce":555490935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:09:36.593 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 65 2024-04-25T09:09:36.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.608+0000 7ff90ba00640 1 -- 172.21.15.173:0/2222171077 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff8e4066f60 msgr2=0x7ff8e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:36.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.608+0000 7ff90ba00640 1 --2- 172.21.15.173:0/2222171077 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff8e4066f60 0x7ff8e4069420 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff9040cfe80 tx=0x7ff8f0007b60 comp rx=0 tx=0).stop 2024-04-25T09:09:36.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.608+0000 7ff90ba00640 1 -- 172.21.15.173:0/2222171077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9040b1430 msgr2=0x7ff904159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:36.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.608+0000 7ff90ba00640 1 --2- 172.21.15.173:0/2222171077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9040b1430 0x7ff904159ee0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009db0 tx=0x7ff8f400c490 comp rx=0 tx=0).stop 2024-04-25T09:09:36.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.608+0000 7ff90ba00640 1 -- 172.21.15.173:0/2222171077 shutdown_connections 2024-04-25T09:09:36.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.608+0000 7ff90ba00640 1 --2- 172.21.15.173:0/2222171077 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff8e4066f60 0x7ff8e4069420 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.608+0000 7ff90ba00640 1 --2- 172.21.15.173:0/2222171077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90415c760 0x7ff9040ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.608+0000 7ff90ba00640 1 --2- 172.21.15.173:0/2222171077 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff90415b870 0x7ff9040c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.608+0000 7ff90ba00640 1 --2- 172.21.15.173:0/2222171077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9040b1430 0x7ff904159ee0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:36.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.608+0000 7ff90ba00640 1 -- 172.21.15.173:0/2222171077 >> 172.21.15.173:0/2222171077 conn(0x7ff904099a50 msgr2=0x7ff9040ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:36.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.608+0000 7ff90ba00640 1 -- 172.21.15.173:0/2222171077 shutdown_connections 2024-04-25T09:09:36.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:36.608+0000 7ff90ba00640 1 -- 172.21.15.173:0/2222171077 wait complete. 2024-04-25T09:09:37.017 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:09:26.257282+0000', 'modified': '2024-04-25T09:09:29.275838+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7743}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7743': {'gid': 7743, 'name': 'a', 'rank': 0, 'incarnation': 61, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.173:6837/555490935', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6836', 'nonce': 555490935}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 555490935}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:09:37.017 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:09:37.017 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:09:37.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.168+0000 7f6ec5800640 1 Processor -- start 2024-04-25T09:09:37.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.168+0000 7f6ec5800640 1 -- start start 2024-04-25T09:09:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.168+0000 7f6ec5800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6ec0145290 0x7f6ec015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.168+0000 7f6ec5800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ec00b3fe0 0x7f6ec00b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.168+0000 7f6ec5800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec015c5f0 con 0x7f6ec00cc260 2024-04-25T09:09:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.172+0000 7f6ec5800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec006d4b0 con 0x7f6ec0145290 2024-04-25T09:09:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.172+0000 7f6ec5800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec006d790 con 0x7f6ec00b3fe0 2024-04-25T09:09:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.172+0000 7f6ebea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6ec0145290 0x7f6ec015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.172+0000 7f6ebf400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f6ec00cc260 0x7f6ec00cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54256/0 (socket says 172.21.15.173:54256) 2024-04-25T09:09:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.172+0000 7f6ebf400640 1 -- 172.21.15.173:0/1730996844 learned_addr learned my addr 172.21.15.173:0/1730996844 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:37.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.172+0000 7f6ebe000640 1 --2- 172.21.15.173:0/1730996844 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ec00b3fe0 0x7f6ec00b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.172+0000 7f6ebea00640 1 -- 172.21.15.173:0/1730996844 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ec00b3fe0 msgr2=0x7f6ec00b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:37.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.172+0000 7f6ebea00640 1 --2- 172.21.15.173:0/1730996844 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ec00b3fe0 0x7f6ec00b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.172+0000 7f6ebea00640 1 -- 172.21.15.173:0/1730996844 >> v1:172.21.15.173:6789/0 conn(0x7f6ec00cc260 legacy=0x7f6ec00cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:37.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.172+0000 7f6ebea00640 1 -- 172.21.15.173:0/1730996844 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec006da70 con 0x7f6ec0145290 2024-04-25T09:09:37.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.172+0000 7f6ebd600640 1 -- 172.21.15.173:0/1730996844 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103918108 0 0) 0x7f6eb8001120 con 0x7f6ec00cc260 2024-04-25T09:09:37.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.172+0000 7f6ebea00640 1 --2- 172.21.15.173:0/1730996844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ec0145290 0x7f6ec015c0b0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009d90 tx=0x7f6eb001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd2c0fbc3aed62a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:37.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.172+0000 7f6ebd600640 1 -- 172.21.15.173:0/1730996844 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00b2070 con 0x7f6ec0145290 2024-04-25T09:09:37.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ebd600640 1 -- 172.21.15.173:0/1730996844 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb00a5820 con 0x7f6ec0145290 2024-04-25T09:09:37.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ebd600640 1 -- 172.21.15.173:0/1730996844 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00a5bf0 con 0x7f6ec0145290 2024-04-25T09:09:37.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ec5800640 1 -- 172.21.15.173:0/1730996844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ec0145290 msgr2=0x7f6ec015c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:37.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ec5800640 1 --2- 172.21.15.173:0/1730996844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ec0145290 0x7f6ec015c0b0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009d90 tx=0x7f6eb001c850 comp rx=0 tx=0).stop 2024-04-25T09:09:37.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ec5800640 1 -- 172.21.15.173:0/1730996844 shutdown_connections 2024-04-25T09:09:37.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ec5800640 1 --2- 172.21.15.173:0/1730996844 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ec00b3fe0 0x7f6ec00b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ec5800640 1 --2- 172.21.15.173:0/1730996844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ec0145290 0x7f6ec015c0b0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ec5800640 1 -- 172.21.15.173:0/1730996844 >> 172.21.15.173:0/1730996844 conn(0x7f6ec006ac90 msgr2=0x7f6ec006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:37.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ec5800640 1 -- 172.21.15.173:0/1730996844 shutdown_connections 2024-04-25T09:09:37.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ec5800640 1 -- 172.21.15.173:0/1730996844 wait complete. 2024-04-25T09:09:37.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ec5800640 1 Processor -- start 2024-04-25T09:09:37.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ec5800640 1 -- start start 2024-04-25T09:09:37.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ec5800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ec00b3fe0 0x7f6ec015b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ec5800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ec00cc260 0x7f6ec0138280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ec5800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ec0145290 0x7f6ec0143350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ec5800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec006eee0 con 0x7f6ec00b3fe0 2024-04-25T09:09:37.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ec5800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec006ed60 con 0x7f6ec0145290 2024-04-25T09:09:37.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ec5800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec006f060 con 0x7f6ec00cc260 2024-04-25T09:09:37.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ebea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ec00b3fe0 0x7f6ec015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ebea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ec00b3fe0 0x7f6ec015b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45944/0 (socket says 172.21.15.173:45944) 2024-04-25T09:09:37.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ebea00640 1 -- 172.21.15.173:0/3211720156 learned_addr learned my addr 172.21.15.173:0/3211720156 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:37.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ebea00640 1 -- 172.21.15.173:0/3211720156 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ec00cc260 msgr2=0x7f6ec0138280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:37.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ebea00640 1 --2- 172.21.15.173:0/3211720156 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ec00cc260 0x7f6ec0138280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ebea00640 1 -- 172.21.15.173:0/3211720156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ec0145290 msgr2=0x7f6ec0143350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:37.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ebea00640 1 --2- 172.21.15.173:0/3211720156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ec0145290 0x7f6ec0143350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.176+0000 7f6ebea00640 1 -- 172.21.15.173:0/3211720156 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec0138b60 con 0x7f6ec00b3fe0 2024-04-25T09:09:37.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.180+0000 7f6ebea00640 1 --2- 172.21.15.173:0/3211720156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ec00b3fe0 0x7f6ec015b3b0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009d90 tx=0x7f6eb00195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:37.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.180+0000 7f6eb6a00640 1 -- 172.21.15.173:0/3211720156 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00bd020 con 0x7f6ec00b3fe0 2024-04-25T09:09:37.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.180+0000 7f6eb6a00640 1 -- 172.21.15.173:0/3211720156 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb00b8470 con 0x7f6ec00b3fe0 2024-04-25T09:09:37.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.180+0000 7f6ec5800640 1 -- 172.21.15.173:0/3211720156 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec0138e40 con 0x7f6ec00b3fe0 2024-04-25T09:09:37.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.180+0000 7f6eb6a00640 1 -- 172.21.15.173:0/3211720156 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00b2040 con 0x7f6ec00b3fe0 2024-04-25T09:09:37.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.180+0000 7f6ec5800640 1 -- 172.21.15.173:0/3211720156 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec0139400 con 0x7f6ec00b3fe0 2024-04-25T09:09:37.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.180+0000 7f6eb6a00640 1 -- 172.21.15.173:0/3211720156 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6eb00c0020 con 0x7f6ec00b3fe0 2024-04-25T09:09:37.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6eb6a00640 1 --2- 172.21.15.173:0/3211720156 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6ea0066f60 0x7f6ea0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6eb6a00640 1 -- 172.21.15.173:0/3211720156 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6eb011fed0 con 0x7f6ec00b3fe0 2024-04-25T09:09:37.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ebe000640 1 --2- 172.21.15.173:0/3211720156 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6ea0066f60 0x7f6ea0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ec8be5000 1 Processor -- start 2024-04-25T09:09:37.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ec8be5000 1 -- start start 2024-04-25T09:09:37.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ebe000640 1 --2- 172.21.15.173:0/3211720156 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6ea0066f60 0x7f6ea0069420 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6eac006aa0 tx=0x7f6eac006a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:37.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ec8be5000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df826920 0x5604df826d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ec8be5000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df827240 0x5604df7dc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ec8be5000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df7dcf30 0x5604df7dd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ec8be5000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604df6c45f0 con 0x5604df826920 2024-04-25T09:09:37.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ec8be5000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604df62bda0 con 0x5604df827240 2024-04-25T09:09:37.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ec8be5000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604df5b4150 con 0x5604df7dcf30 2024-04-25T09:09:37.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ebea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df826920 0x5604df826d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ebea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df826920 0x5604df826d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45946/0 (socket says 172.21.15.173:45946) 2024-04-25T09:09:37.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ebea00640 1 -- 172.21.15.173:0/168356294 learned_addr learned my addr 172.21.15.173:0/168356294 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:37.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ebf400640 1 --2- 172.21.15.173:0/168356294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df7dcf30 0x5604df7dd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ebe000640 1 --2- 172.21.15.173:0/168356294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df827240 0x5604df7dc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ebea00640 1 -- 172.21.15.173:0/168356294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df7dcf30 msgr2=0x5604df7dd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:37.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ebea00640 1 --2- 172.21.15.173:0/168356294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df7dcf30 0x5604df7dd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ebea00640 1 -- 172.21.15.173:0/168356294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df827240 msgr2=0x5604df7dc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:37.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ebea00640 1 --2- 172.21.15.173:0/168356294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df827240 0x5604df7dc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ebea00640 1 -- 172.21.15.173:0/168356294 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604df5cdca0 con 0x5604df826920 2024-04-25T09:09:37.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ebe000640 1 --2- 172.21.15.173:0/168356294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df827240 0x5604df7dc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:37.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ebf400640 1 --2- 172.21.15.173:0/168356294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df7dcf30 0x5604df7dd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:37.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ebea00640 1 --2- 172.21.15.173:0/168356294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df826920 0x5604df826d00 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00b0040 tx=0x7f6eb00f0ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2435c331fa703b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:37.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6eab400640 1 -- 172.21.15.173:0/168356294 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb0108070 con 0x5604df826920 2024-04-25T09:09:37.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6eab400640 1 -- 172.21.15.173:0/168356294 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb00f8df0 con 0x5604df826920 2024-04-25T09:09:37.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6eab400640 1 -- 172.21.15.173:0/168356294 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00ee9e0 con 0x5604df826920 2024-04-25T09:09:37.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ec8be5000 1 -- 172.21.15.173:0/168356294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df826920 msgr2=0x5604df826d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:37.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/168356294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df826920 0x5604df826d00 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00b0040 tx=0x7f6eb00f0ea0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ec8be5000 1 -- 172.21.15.173:0/168356294 shutdown_connections 2024-04-25T09:09:37.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/168356294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df7dcf30 0x5604df7dd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/168356294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df827240 0x5604df7dc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/168356294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df826920 0x5604df826d00 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ec8be5000 1 -- 172.21.15.173:0/168356294 >> 172.21.15.173:0/168356294 conn(0x5604df7e32a0 msgr2=0x5604df7db2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:37.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ec8be5000 1 -- 172.21.15.173:0/168356294 shutdown_connections 2024-04-25T09:09:37.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.184+0000 7f6ec8be5000 1 -- 172.21.15.173:0/168356294 wait complete. 2024-04-25T09:09:37.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ec8be5000 1 -- start start 2024-04-25T09:09:37.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ec8be5000 1 Processor -- start 2024-04-25T09:09:37.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ec8be5000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df7dcf30 0x5604df832190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ec8be5000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df826920 0x5604df8326d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ec8be5000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df827240 0x5604df837050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ec8be5000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604df5e6990 con 0x5604df826920 2024-04-25T09:09:37.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ec8be5000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604df627e40 con 0x5604df7dcf30 2024-04-25T09:09:37.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ec8be5000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604df5b7900 con 0x5604df827240 2024-04-25T09:09:37.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ec8be5000 10 client.0 _ll_register_callbacks cb 0x5604df6df1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:37.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ebe000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df826920 0x5604df8326d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ebe000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df826920 0x5604df8326d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45952/0 (socket says 172.21.15.173:45952) 2024-04-25T09:09:37.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ebe000640 1 -- 172.21.15.173:0/2181470622 learned_addr learned my addr 172.21.15.173:0/2181470622 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:37.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ebf400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df827240 0x5604df837050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ebea00640 1 --2- 172.21.15.173:0/2181470622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df7dcf30 0x5604df832190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ebea00640 1 -- 172.21.15.173:0/2181470622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df827240 msgr2=0x5604df837050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:37.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ebea00640 1 --2- 172.21.15.173:0/2181470622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df827240 0x5604df837050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ebea00640 1 -- 172.21.15.173:0/2181470622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df826920 msgr2=0x5604df8326d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:37.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ebea00640 1 --2- 172.21.15.173:0/2181470622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df826920 0x5604df8326d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ebea00640 1 -- 172.21.15.173:0/2181470622 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604df5e4630 con 0x5604df7dcf30 2024-04-25T09:09:37.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ebe000640 1 --2- 172.21.15.173:0/2181470622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df826920 0x5604df8326d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:37.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ebea00640 1 --2- 172.21.15.173:0/2181470622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df7dcf30 0x5604df832190 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6eb011e300 tx=0x7f6eb0000f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acd7be685ccf4231 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:37.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6e9fe00640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-04-25T09:09:37.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6e9fe00640 1 -- 172.21.15.173:0/2181470622 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb011d070 con 0x5604df7dcf30 2024-04-25T09:09:37.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6e9fe00640 1 -- 172.21.15.173:0/2181470622 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6eb00f8960 con 0x5604df7dcf30 2024-04-25T09:09:37.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ec8be5000 1 -- 172.21.15.173:0/2181470622 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6eb00f8df0 con 0x5604df7dcf30 2024-04-25T09:09:37.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6e9fe00640 1 -- 172.21.15.173:0/2181470622 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6eb0108040 con 0x5604df7dcf30 2024-04-25T09:09:37.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ec8be5000 10 client.7294 fetch_fsmap learned FSMap version 65 2024-04-25T09:09:37.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ec8be5000 1 -- 172.21.15.173:0/2181470622 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x5604df5b43a0 con 0x5604df7dcf30 2024-04-25T09:09:37.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6e9fe00640 1 -- 172.21.15.173:0/2181470622 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb00f8df0 con 0x5604df7dcf30 2024-04-25T09:09:37.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6e9fe00640 1 -- 172.21.15.173:0/2181470622 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6eb00efb30 con 0x5604df7dcf30 2024-04-25T09:09:37.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ec8be5000 10 client.7294 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:09:37.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ec8be5000 10 client.7294 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:09:37.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ec8be5000 20 client.7294 populate_metadata read hostname 'smithi173' 2024-04-25T09:09:37.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/2181470622 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x5604df839d60 0x5604df83c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ec8be5000 4 client.7294 mds_command: new command op to 7743 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:37.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ec8be5000 1 -- 172.21.15.173:0/2181470622 --> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604df5c7a50 con 0x5604df839d60 2024-04-25T09:09:37.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ebe000640 1 --2- 172.21.15.173:0/2181470622 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x5604df839d60 0x5604df83c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6ebe000640 1 --2- 172.21.15.173:0/2181470622 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x5604df839d60 0x5604df83c150 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c1645db842fe269 server_cookie=41ef17efe85dc3f5 in_seq=0 out_seq=0 2024-04-25T09:09:37.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.188+0000 7f6e9fe00640 10 client.7294 ms_handle_connect on v2:172.21.15.173:6836/555490935 2024-04-25T09:09:37.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.192+0000 7f6e9fe00640 1 -- 172.21.15.173:0/2181470622 <== mds.0 v2:172.21.15.173:6836/555490935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5604df5c7a50 con 0x5604df839d60 2024-04-25T09:09:37.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.192+0000 7f6e9fe00640 10 client.7294 handle_command_reply: tid=0 2024-04-25T09:09:37.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.192+0000 7f6ec8be5000 1 client.7294 shutdown 2024-04-25T09:09:37.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.192+0000 7f6ec8be5000 1 -- 172.21.15.173:0/2181470622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df7dcf30 msgr2=0x5604df832190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:37.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.192+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/2181470622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df7dcf30 0x5604df832190 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6eb011e300 tx=0x7f6eb0000f50 comp rx=0 tx=0).stop 2024-04-25T09:09:37.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.192+0000 7f6ec8be5000 1 -- 172.21.15.173:0/2181470622 shutdown_connections 2024-04-25T09:09:37.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.192+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/2181470622 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x5604df839d60 0x5604df83c150 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.192+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/2181470622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df827240 0x5604df837050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.192+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/2181470622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df826920 0x5604df8326d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.192+0000 7f6e9fe00640 0 client.7294 ms_handle_reset on v2:172.21.15.173:6836/555490935 2024-04-25T09:09:37.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.192+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/2181470622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df7dcf30 0x5604df832190 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.192+0000 7f6ec8be5000 1 -- 172.21.15.173:0/2181470622 >> 172.21.15.173:0/2181470622 conn(0x5604df7e32a0 msgr2=0x5604df7db9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:37.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.192+0000 7f6ec8be5000 1 -- 172.21.15.173:0/2181470622 shutdown_connections 2024-04-25T09:09:37.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.192+0000 7f6ec8be5000 1 -- 172.21.15.173:0/2181470622 wait complete. 2024-04-25T09:09:37.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.192+0000 7f6ec8be5000 20 client.7294 trim_cache size 0 max 16384 2024-04-25T09:09:37.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ec8be5000 1 Processor -- start 2024-04-25T09:09:37.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ec8be5000 1 -- start start 2024-04-25T09:09:37.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ec8be5000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df7dcf30 0x5604df886040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ec8be5000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df826920 0x5604df886580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ec8be5000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df827240 0x5604df886ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ec8be5000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec00ce500 con 0x5604df827240 2024-04-25T09:09:37.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ec8be5000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec01f58f0 con 0x5604df826920 2024-04-25T09:09:37.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ec8be5000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec01356c0 con 0x5604df7dcf30 2024-04-25T09:09:37.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ebf400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df827240 0x5604df886ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ebf400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df827240 0x5604df886ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45954/0 (socket says 172.21.15.173:45954) 2024-04-25T09:09:37.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ebf400640 1 -- 172.21.15.173:0/116033893 learned_addr learned my addr 172.21.15.173:0/116033893 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:37.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ebe000640 1 --2- 172.21.15.173:0/116033893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df826920 0x5604df886580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ebea00640 1 --2- 172.21.15.173:0/116033893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df7dcf30 0x5604df886040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ebf400640 1 -- 172.21.15.173:0/116033893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df7dcf30 msgr2=0x5604df886040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:37.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ebf400640 1 --2- 172.21.15.173:0/116033893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df7dcf30 0x5604df886040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ebf400640 1 -- 172.21.15.173:0/116033893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df826920 msgr2=0x5604df886580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:37.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ebf400640 1 --2- 172.21.15.173:0/116033893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df826920 0x5604df886580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ebf400640 1 -- 172.21.15.173:0/116033893 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604df6ad600 con 0x5604df827240 2024-04-25T09:09:37.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ebf400640 1 --2- 172.21.15.173:0/116033893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df827240 0x5604df886ac0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8007690 tx=0x7f6eb8004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992412f9ba25d2e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:37.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6eaaa00640 1 -- 172.21.15.173:0/116033893 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb80018c0 con 0x5604df827240 2024-04-25T09:09:37.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6eaaa00640 1 -- 172.21.15.173:0/116033893 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb8019070 con 0x5604df827240 2024-04-25T09:09:37.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6eaaa00640 1 -- 172.21.15.173:0/116033893 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8001cc0 con 0x5604df827240 2024-04-25T09:09:37.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ec8be5000 1 -- 172.21.15.173:0/116033893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df827240 msgr2=0x5604df886ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:37.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/116033893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df827240 0x5604df886ac0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8007690 tx=0x7f6eb8004bc0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ec8be5000 1 -- 172.21.15.173:0/116033893 shutdown_connections 2024-04-25T09:09:37.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/116033893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df827240 0x5604df886ac0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/116033893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df826920 0x5604df886580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/116033893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df7dcf30 0x5604df886040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ec8be5000 1 -- 172.21.15.173:0/116033893 >> 172.21.15.173:0/116033893 conn(0x5604df7e32a0 msgr2=0x5604df83d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:37.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ec8be5000 1 -- 172.21.15.173:0/116033893 shutdown_connections 2024-04-25T09:09:37.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.208+0000 7f6ec8be5000 1 -- 172.21.15.173:0/116033893 wait complete. 2024-04-25T09:09:37.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 1 -- start start 2024-04-25T09:09:37.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 1 Processor -- start 2024-04-25T09:09:37.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df7dcf30 0x5604df825960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df826920 0x5604df825ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df827240 0x5604df86f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604df6303d0 con 0x5604df7dcf30 2024-04-25T09:09:37.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604df6e7d50 con 0x5604df827240 2024-04-25T09:09:37.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604df5c6980 con 0x5604df826920 2024-04-25T09:09:37.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 10 client.0 _ll_register_callbacks cb 0x7f6eb00ec980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:37.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ebea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df7dcf30 0x5604df825960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ebea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df7dcf30 0x5604df825960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45962/0 (socket says 172.21.15.173:45962) 2024-04-25T09:09:37.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ebea00640 1 -- 172.21.15.173:0/2755092300 learned_addr learned my addr 172.21.15.173:0/2755092300 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:37.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ebe000640 1 --2- 172.21.15.173:0/2755092300 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df826920 0x5604df825ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ebf400640 1 --2- 172.21.15.173:0/2755092300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df827240 0x5604df86f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ebea00640 1 -- 172.21.15.173:0/2755092300 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df826920 msgr2=0x5604df825ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:37.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ebea00640 1 --2- 172.21.15.173:0/2755092300 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df826920 0x5604df825ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ebea00640 1 -- 172.21.15.173:0/2755092300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df827240 msgr2=0x5604df86f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:37.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ebea00640 1 --2- 172.21.15.173:0/2755092300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df827240 0x5604df86f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ebea00640 1 -- 172.21.15.173:0/2755092300 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604df5c09b0 con 0x5604df7dcf30 2024-04-25T09:09:37.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ebf400640 1 --2- 172.21.15.173:0/2755092300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df827240 0x5604df86f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:37.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ebea00640 1 --2- 172.21.15.173:0/2755092300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df7dcf30 0x5604df825960 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00ed060 tx=0x7f6eb0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb189cf0ad6f7dc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:37.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6e9fe00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:09:37.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6e9fe00640 1 -- 172.21.15.173:0/2755092300 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb011d070 con 0x5604df7dcf30 2024-04-25T09:09:37.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6e9fe00640 1 -- 172.21.15.173:0/2755092300 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6eb00f8b70 con 0x5604df7dcf30 2024-04-25T09:09:37.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 1 -- 172.21.15.173:0/2755092300 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6eb8019070 con 0x5604df7dcf30 2024-04-25T09:09:37.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6e9fe00640 1 -- 172.21.15.173:0/2755092300 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6eb00ee780 con 0x5604df7dcf30 2024-04-25T09:09:37.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 10 client.7905 fetch_fsmap learned FSMap version 65 2024-04-25T09:09:37.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 1 -- 172.21.15.173:0/2755092300 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x5604df5d30b0 con 0x5604df7dcf30 2024-04-25T09:09:37.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6e9fe00640 1 -- 172.21.15.173:0/2755092300 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb8019070 con 0x5604df7dcf30 2024-04-25T09:09:37.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6e9fe00640 1 -- 172.21.15.173:0/2755092300 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6eb010eb20 con 0x5604df7dcf30 2024-04-25T09:09:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 10 client.7905 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:09:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 10 client.7905 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:09:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 20 client.7905 populate_metadata read hostname 'smithi173' 2024-04-25T09:09:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/2755092300 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x5604df86f7c0 0x5604df86fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 4 client.7905 mds_command: new command op to 7743 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:09:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 1 -- 172.21.15.173:0/2755092300 --> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5604df6392e0 con 0x5604df86f7c0 2024-04-25T09:09:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ebe000640 1 --2- 172.21.15.173:0/2755092300 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x5604df86f7c0 0x5604df86fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6e9fe00640 10 client.7905 ms_handle_connect on v2:172.21.15.173:6836/555490935 2024-04-25T09:09:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ebe000640 1 --2- 172.21.15.173:0/2755092300 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x5604df86f7c0 0x5604df86fba0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb900025e7b64a91 server_cookie=a735fc82f5d4bf93 in_seq=0 out_seq=0 2024-04-25T09:09:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6e9fe00640 1 -- 172.21.15.173:0/2755092300 <== mds.0 v2:172.21.15.173:6836/555490935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5604df6392e0 con 0x5604df86f7c0 2024-04-25T09:09:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6e9fe00640 10 client.7905 handle_command_reply: tid=0 2024-04-25T09:09:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 1 client.7905 shutdown 2024-04-25T09:09:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 1 -- 172.21.15.173:0/2755092300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df7dcf30 msgr2=0x5604df825960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.212+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/2755092300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df7dcf30 0x5604df825960 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00ed060 tx=0x7f6eb0009750 comp rx=0 tx=0).stop 2024-04-25T09:09:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec8be5000 1 -- 172.21.15.173:0/2755092300 shutdown_connections 2024-04-25T09:09:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/2755092300 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x5604df86f7c0 0x5604df86fba0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/2755092300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604df827240 0x5604df86f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/2755092300 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5604df826920 0x5604df825ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec8be5000 1 --2- 172.21.15.173:0/2755092300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604df7dcf30 0x5604df825960 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec8be5000 1 -- 172.21.15.173:0/2755092300 >> 172.21.15.173:0/2755092300 conn(0x5604df7e32a0 msgr2=0x5604df83d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:37.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6e9fe00640 0 client.7905 ms_handle_reset on v2:172.21.15.173:6836/555490935 2024-04-25T09:09:37.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec8be5000 1 -- 172.21.15.173:0/2755092300 shutdown_connections 2024-04-25T09:09:37.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec8be5000 1 -- 172.21.15.173:0/2755092300 wait complete. 2024-04-25T09:09:37.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec8be5000 20 client.7905 trim_cache size 0 max 16384 2024-04-25T09:09:37.206 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:09:37.206 INFO:teuthology.orchestra.run.smithi173.stdout: "cluster_fsid": "ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6", 2024-04-25T09:09:37.206 INFO:teuthology.orchestra.run.smithi173.stdout: "whoami": 0, 2024-04-25T09:09:37.206 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 7743, 2024-04-25T09:09:37.207 INFO:teuthology.orchestra.run.smithi173.stdout: "want_state": "up:active", 2024-04-25T09:09:37.207 INFO:teuthology.orchestra.run.smithi173.stdout: "state": "up:active", 2024-04-25T09:09:37.207 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs", 2024-04-25T09:09:37.207 INFO:teuthology.orchestra.run.smithi173.stdout: "rank_uptime": 10.344386007000001, 2024-04-25T09:09:37.207 INFO:teuthology.orchestra.run.smithi173.stdout: "mdsmap_epoch": 65, 2024-04-25T09:09:37.207 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch": 97, 2024-04-25T09:09:37.207 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch_barrier": 97, 2024-04-25T09:09:37.207 INFO:teuthology.orchestra.run.smithi173.stdout: "uptime": 15.260198261999999 2024-04-25T09:09:37.207 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:09:37.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec5800640 1 -- 172.21.15.173:0/3211720156 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6ea0066f60 msgr2=0x7f6ea0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:37.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec5800640 1 --2- 172.21.15.173:0/3211720156 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6ea0066f60 0x7f6ea0069420 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6eac006aa0 tx=0x7f6eac006a30 comp rx=0 tx=0).stop 2024-04-25T09:09:37.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec5800640 1 -- 172.21.15.173:0/3211720156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ec00b3fe0 msgr2=0x7f6ec015b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:37.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec5800640 1 --2- 172.21.15.173:0/3211720156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ec00b3fe0 0x7f6ec015b3b0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009d90 tx=0x7f6eb00195f0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec5800640 1 -- 172.21.15.173:0/3211720156 shutdown_connections 2024-04-25T09:09:37.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec5800640 1 --2- 172.21.15.173:0/3211720156 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6ea0066f60 0x7f6ea0069420 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec5800640 1 --2- 172.21.15.173:0/3211720156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ec0145290 0x7f6ec0143350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec5800640 1 --2- 172.21.15.173:0/3211720156 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ec00cc260 0x7f6ec0138280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec5800640 1 --2- 172.21.15.173:0/3211720156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ec00b3fe0 0x7f6ec015b3b0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec5800640 1 -- 172.21.15.173:0/3211720156 >> 172.21.15.173:0/3211720156 conn(0x7f6ec006ac90 msgr2=0x7f6ec006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:37.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec5800640 1 -- 172.21.15.173:0/3211720156 shutdown_connections 2024-04-25T09:09:37.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.216+0000 7f6ec5800640 1 -- 172.21.15.173:0/3211720156 wait complete. 2024-04-25T09:09:37.223 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:09:37.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.372+0000 7f3f01a00640 1 Processor -- start 2024-04-25T09:09:37.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.372+0000 7f3f01a00640 1 -- start start 2024-04-25T09:09:37.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.372+0000 7f3f01a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3efc145250 0x7f3efc15c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.372+0000 7f3f01a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3efc0cc8b0 0x7f3efc0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.372+0000 7f3f01a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc15cec0 con 0x7f3efc071320 2024-04-25T09:09:37.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.372+0000 7f3f01a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3efc06e7c0 con 0x7f3efc145250 2024-04-25T09:09:37.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.372+0000 7f3f01a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3efc06d720 con 0x7f3efc0cc8b0 2024-04-25T09:09:37.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.372+0000 7f3efaa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3efc145250 0x7f3efc15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.372+0000 7f3efaa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3efc145250 0x7f3efc15c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45970/0 (socket says 172.21.15.173:45970) 2024-04-25T09:09:37.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.372+0000 7f3efaa00640 1 -- 172.21.15.173:0/2244285495 learned_addr learned my addr 172.21.15.173:0/2244285495 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:37.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.372+0000 7f3efa000640 1 --2- 172.21.15.173:0/2244285495 >> v2:172.21.15.194:3300/0 conn(0x7f3efc0cc8b0 0x7f3efc0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.372+0000 7f3efaa00640 1 -- 172.21.15.173:0/2244285495 >> v2:172.21.15.194:3300/0 conn(0x7f3efc0cc8b0 msgr2=0x7f3efc0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:37.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.372+0000 7f3efaa00640 1 --2- 172.21.15.173:0/2244285495 >> v2:172.21.15.194:3300/0 conn(0x7f3efc0cc8b0 0x7f3efc0ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.372+0000 7f3efaa00640 1 -- 172.21.15.173:0/2244285495 >> v1:172.21.15.194:6789/0 conn(0x7f3efc071320 legacy=0x7f3efc071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:37.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.372+0000 7f3efaa00640 1 -- 172.21.15.173:0/2244285495 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc06da00 con 0x7f3efc145250 2024-04-25T09:09:37.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.376+0000 7f3efaa00640 1 --2- 172.21.15.173:0/2244285495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3efc145250 0x7f3efc15c980 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f3efc062640 tx=0x7f3eec01c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26b5c3fc340d2d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:37.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.376+0000 7f3ef9600640 1 -- 172.21.15.173:0/2244285495 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0b0070 con 0x7f3efc145250 2024-04-25T09:09:37.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.376+0000 7f3ef9600640 1 -- 172.21.15.173:0/2244285495 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec0ab600 con 0x7f3efc145250 2024-04-25T09:09:37.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.376+0000 7f3ef9600640 1 -- 172.21.15.173:0/2244285495 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0ab9d0 con 0x7f3efc145250 2024-04-25T09:09:37.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.376+0000 7f3f01a00640 1 -- 172.21.15.173:0/2244285495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3efc145250 msgr2=0x7f3efc15c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:37.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.376+0000 7f3f01a00640 1 --2- 172.21.15.173:0/2244285495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3efc145250 0x7f3efc15c980 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f3efc062640 tx=0x7f3eec01c300 comp rx=0 tx=0).stop 2024-04-25T09:09:37.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.376+0000 7f3f01a00640 1 -- 172.21.15.173:0/2244285495 shutdown_connections 2024-04-25T09:09:37.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.376+0000 7f3f01a00640 1 --2- 172.21.15.173:0/2244285495 >> v2:172.21.15.194:3300/0 conn(0x7f3efc0cc8b0 0x7f3efc0ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.376+0000 7f3f01a00640 1 --2- 172.21.15.173:0/2244285495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3efc145250 0x7f3efc15c980 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.376+0000 7f3f01a00640 1 -- 172.21.15.173:0/2244285495 >> 172.21.15.173:0/2244285495 conn(0x7f3efc06ac90 msgr2=0x7f3efc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:37.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.376+0000 7f3f01a00640 1 -- 172.21.15.173:0/2244285495 shutdown_connections 2024-04-25T09:09:37.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.376+0000 7f3f01a00640 1 -- 172.21.15.173:0/2244285495 wait complete. 2024-04-25T09:09:37.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.376+0000 7f3f01a00640 1 Processor -- start 2024-04-25T09:09:37.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3f01a00640 1 -- start start 2024-04-25T09:09:37.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3f01a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3efc071320 0x7f3efc0b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3f01a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc0cc8b0 0x7f3efc165a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3f01a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3efc145250 0x7f3efc0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3f01a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc06ef80 con 0x7f3efc145250 2024-04-25T09:09:37.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3f01a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc145630 con 0x7f3efc071320 2024-04-25T09:09:37.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3f01a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc06d380 con 0x7f3efc0cc8b0 2024-04-25T09:09:37.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3efb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3efc145250 0x7f3efc0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3efb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3efc145250 0x7f3efc0afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45974/0 (socket says 172.21.15.173:45974) 2024-04-25T09:09:37.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3efb400640 1 -- 172.21.15.173:0/2128288179 learned_addr learned my addr 172.21.15.173:0/2128288179 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:37.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3efaa00640 1 --2- 172.21.15.173:0/2128288179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3efc071320 0x7f3efc0b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3efa000640 1 --2- 172.21.15.173:0/2128288179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc0cc8b0 0x7f3efc165a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3efb400640 1 -- 172.21.15.173:0/2128288179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc0cc8b0 msgr2=0x7f3efc165a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:37.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3efb400640 1 --2- 172.21.15.173:0/2128288179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc0cc8b0 0x7f3efc165a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3efb400640 1 -- 172.21.15.173:0/2128288179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3efc071320 msgr2=0x7f3efc0b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:37.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3efb400640 1 --2- 172.21.15.173:0/2128288179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3efc071320 0x7f3efc0b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3efb400640 1 -- 172.21.15.173:0/2128288179 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc0b3440 con 0x7f3efc145250 2024-04-25T09:09:37.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3efb400640 1 --2- 172.21.15.173:0/2128288179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3efc145250 0x7f3efc0afe80 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400b9a0 tx=0x7f3ef400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:37.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3ef2a00640 1 -- 172.21.15.173:0/2128288179 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4019070 con 0x7f3efc145250 2024-04-25T09:09:37.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3ef2a00640 1 -- 172.21.15.173:0/2128288179 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef400cba0 con 0x7f3efc145250 2024-04-25T09:09:37.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3f01a00640 1 -- 172.21.15.173:0/2128288179 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc0b3720 con 0x7f3efc145250 2024-04-25T09:09:37.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3ef2a00640 1 -- 172.21.15.173:0/2128288179 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4014440 con 0x7f3efc145250 2024-04-25T09:09:37.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3f01a00640 1 -- 172.21.15.173:0/2128288179 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3efc0b3ce0 con 0x7f3efc145250 2024-04-25T09:09:37.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.380+0000 7f3f01a00640 1 -- 172.21.15.173:0/2128288179 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc073a40 con 0x7f3efc145250 2024-04-25T09:09:37.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.384+0000 7f3ef2a00640 1 -- 172.21.15.173:0/2128288179 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3ef401c070 con 0x7f3efc145250 2024-04-25T09:09:37.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.384+0000 7f3ef2a00640 1 --2- 172.21.15.173:0/2128288179 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3edc066f60 0x7f3edc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:37.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.384+0000 7f3ef2a00640 1 -- 172.21.15.173:0/2128288179 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3ef4084e20 con 0x7f3efc145250 2024-04-25T09:09:37.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.384+0000 7f3efaa00640 1 --2- 172.21.15.173:0/2128288179 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3edc066f60 0x7f3edc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:37.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.384+0000 7f3efaa00640 1 --2- 172.21.15.173:0/2128288179 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3edc066f60 0x7f3edc069420 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0ad000 tx=0x7f3eec0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:37.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.388+0000 7f3ef2a00640 1 -- 172.21.15.173:0/2128288179 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3ef40555b0 con 0x7f3efc145250 2024-04-25T09:09:37.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.576+0000 7f3f01a00640 1 -- 172.21.15.173:0/2128288179 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3efc06c300 con 0x7f3efc145250 2024-04-25T09:09:37.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.576+0000 7f3ef2a00640 1 -- 172.21.15.173:0/2128288179 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v65) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3ef4059650 con 0x7f3efc145250 2024-04-25T09:09:37.569 INFO:teuthology.orchestra.run.smithi173.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:09:37.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.576+0000 7f3f01a00640 1 -- 172.21.15.173:0/2128288179 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3edc066f60 msgr2=0x7f3edc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:37.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.576+0000 7f3f01a00640 1 --2- 172.21.15.173:0/2128288179 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3edc066f60 0x7f3edc069420 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0ad000 tx=0x7f3eec0a6000 comp rx=0 tx=0).stop 2024-04-25T09:09:37.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.576+0000 7f3f01a00640 1 -- 172.21.15.173:0/2128288179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3efc145250 msgr2=0x7f3efc0afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:37.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.576+0000 7f3f01a00640 1 --2- 172.21.15.173:0/2128288179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3efc145250 0x7f3efc0afe80 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400b9a0 tx=0x7f3ef400be60 comp rx=0 tx=0).stop 2024-04-25T09:09:37.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.576+0000 7f3f01a00640 1 -- 172.21.15.173:0/2128288179 shutdown_connections 2024-04-25T09:09:37.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.576+0000 7f3f01a00640 1 --2- 172.21.15.173:0/2128288179 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3edc066f60 0x7f3edc069420 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.576+0000 7f3f01a00640 1 --2- 172.21.15.173:0/2128288179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3efc145250 0x7f3efc0afe80 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.576+0000 7f3f01a00640 1 --2- 172.21.15.173:0/2128288179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3efc0cc8b0 0x7f3efc165a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.576+0000 7f3f01a00640 1 --2- 172.21.15.173:0/2128288179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3efc071320 0x7f3efc0b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:37.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.576+0000 7f3f01a00640 1 -- 172.21.15.173:0/2128288179 >> 172.21.15.173:0/2128288179 conn(0x7f3efc06ac90 msgr2=0x7f3efc06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:37.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.580+0000 7f3f01a00640 1 -- 172.21.15.173:0/2128288179 shutdown_connections 2024-04-25T09:09:37.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:37.580+0000 7f3f01a00640 1 -- 172.21.15.173:0/2128288179 wait complete. 2024-04-25T09:09:37.586 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:09:37.586 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:09:37.586 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2024-04-25T09:09:37.586 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:09:37.586 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:09:37.586 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:09:37.586 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:09:37.586 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:09:37.586 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:09:37.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:37.587 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2024-04-25T09:09:37.598 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:09:37.598 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:09:37.598 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:09:37.598 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:37.598 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-25T09:09:37.599 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:37.599 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:09:37.599 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:09:37.599 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2024-04-25T09:09:37.599 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:09:37.599 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:09:37.599 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2024-04-25T09:09:37.599 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:09:37.599 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:09:37.599 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:09:37.599 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:09:37.599 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:09:37.599 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 42040sec preferred_lft 42040sec 2024-04-25T09:09:37.599 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2024-04-25T09:09:37.599 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:37.600 INFO:teuthology.orchestra.run.smithi173.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:09:37.600 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 02:42:00:0e:60:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:09:37.600 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:09:37.600 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:37.600 INFO:teuthology.orchestra.run.smithi173.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:09:37.600 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:09:37.600 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:09:37.600 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:37.600 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:09:37.600 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:37.600 INFO:teuthology.orchestra.run.smithi173.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:09:37.600 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:09:37.600 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:09:37.600 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:37.600 INFO:teuthology.orchestra.run.smithi173.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:09:37.601 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:09:37.601 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:09:37.601 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:37.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:37.601 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:09:37.660 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-04-25T09:09:37.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:37.663 DEBUG:teuthology.orchestra.run.smithi173:> route 2024-04-25T09:09:37.721 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2024-04-25T09:09:37.721 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:09:37.721 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:09:37.721 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:09:37.721 INFO:teuthology.orchestra.run.smithi173.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:09:37.721 INFO:teuthology.orchestra.run.smithi173.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:09:37.721 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:09:37.721 INFO:teuthology.orchestra.run.smithi173.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:09:37.722 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:09:37.722 INFO:teuthology.orchestra.run.smithi173.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:09:37.722 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:09:37.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:37.722 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:09:37.722 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:37.722 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:09:37.722 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:09:37.722 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:09:37.722 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:37.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:37.810 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-25T09:09:37.818 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:09:37.818 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:09:37.819 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:09:37.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:37.819 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2024-04-25T09:09:37.881 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:09:37.881 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:09:37.931 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:09:37.931 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:09:37.931 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:09:37.985 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:09:37.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:37.985 DEBUG:teuthology.orchestra.run.smithi173:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:09:38.073 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:09:38.073 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:09:38.073 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:09:38.089 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:09:38.089 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:09:38.089 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:09:38.089 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:09:38.089 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:09:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:09:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:09:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:09:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:09:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:09:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-04-25T09:09:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-04-25T09:09:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6" will pass to kernel 2024-04-25T09:09:38.104 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:09:38.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:38.105 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:09:38.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:38.125 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:09:38.184 INFO:teuthology.orchestra.run.smithi173.stdout:client6641 2024-04-25T09:09:38.184 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:09:38.184 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:38.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:38.234 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:38.234 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:38.234 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.0 2024-04-25T09:09:38.234 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:38.234 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:38.234 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:38.234 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:38.320 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.320 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.320 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218711 s, 47.9 MB/s 2024-04-25T09:09:38.340 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.340 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.340 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187022 s, 56.1 MB/s 2024-04-25T09:09:38.362 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.362 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.362 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199674 s, 52.5 MB/s 2024-04-25T09:09:38.382 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.383 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.383 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187771 s, 55.8 MB/s 2024-04-25T09:09:38.398 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.398 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.398 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137994 s, 76.0 MB/s 2024-04-25T09:09:38.419 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.419 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.419 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018479 s, 56.7 MB/s 2024-04-25T09:09:38.443 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.444 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.444 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234737 s, 44.7 MB/s 2024-04-25T09:09:38.464 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.464 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.464 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187 s, 56.1 MB/s 2024-04-25T09:09:38.482 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.482 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.482 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157758 s, 66.5 MB/s 2024-04-25T09:09:38.503 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.503 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.503 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191017 s, 54.9 MB/s 2024-04-25T09:09:38.523 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.523 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.523 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188534 s, 55.6 MB/s 2024-04-25T09:09:38.542 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.542 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.542 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167847 s, 62.5 MB/s 2024-04-25T09:09:38.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.559 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159251 s, 65.8 MB/s 2024-04-25T09:09:38.575 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.575 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.575 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142707 s, 73.5 MB/s 2024-04-25T09:09:38.593 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.593 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.594 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164315 s, 63.8 MB/s 2024-04-25T09:09:38.613 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.613 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.613 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176795 s, 59.3 MB/s 2024-04-25T09:09:38.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.629 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.629 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139348 s, 75.2 MB/s 2024-04-25T09:09:38.645 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.645 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.645 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148438 s, 70.6 MB/s 2024-04-25T09:09:38.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.667 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200656 s, 52.3 MB/s 2024-04-25T09:09:38.684 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.684 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.684 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151925 s, 69.0 MB/s 2024-04-25T09:09:38.709 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.709 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.709 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023189 s, 45.2 MB/s 2024-04-25T09:09:38.727 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.728 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.728 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016993 s, 61.7 MB/s 2024-04-25T09:09:38.750 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.750 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.750 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209466 s, 50.1 MB/s 2024-04-25T09:09:38.770 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.770 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.770 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176908 s, 59.3 MB/s 2024-04-25T09:09:38.788 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.788 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.788 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164807 s, 63.6 MB/s 2024-04-25T09:09:38.804 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.804 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.804 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144374 s, 72.6 MB/s 2024-04-25T09:09:38.826 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.826 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.826 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197943 s, 53.0 MB/s 2024-04-25T09:09:38.843 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.843 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.843 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148717 s, 70.5 MB/s 2024-04-25T09:09:38.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.865 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198372 s, 52.9 MB/s 2024-04-25T09:09:38.881 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.881 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.881 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143062 s, 73.3 MB/s 2024-04-25T09:09:38.900 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.900 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.900 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171108 s, 61.3 MB/s 2024-04-25T09:09:38.918 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.918 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.918 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159463 s, 65.8 MB/s 2024-04-25T09:09:38.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:38.919 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:38.919 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:38.920 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.1 2024-04-25T09:09:38.920 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:38.920 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:38.920 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:38.920 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:38.951 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.951 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.951 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175356 s, 59.8 MB/s 2024-04-25T09:09:38.966 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.966 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.967 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140867 s, 74.4 MB/s 2024-04-25T09:09:38.983 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:38.983 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:38.983 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148842 s, 70.4 MB/s 2024-04-25T09:09:39.000 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.000 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.000 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154544 s, 67.8 MB/s 2024-04-25T09:09:39.027 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.027 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.027 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247565 s, 42.4 MB/s 2024-04-25T09:09:39.046 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.047 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.047 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177137 s, 59.2 MB/s 2024-04-25T09:09:39.065 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.065 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.065 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161513 s, 64.9 MB/s 2024-04-25T09:09:39.080 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.080 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.080 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138377 s, 75.8 MB/s 2024-04-25T09:09:39.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.097 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148721 s, 70.5 MB/s 2024-04-25T09:09:39.113 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.113 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.113 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144462 s, 72.6 MB/s 2024-04-25T09:09:39.134 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.134 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.134 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190331 s, 55.1 MB/s 2024-04-25T09:09:39.152 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.152 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.152 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162598 s, 64.5 MB/s 2024-04-25T09:09:39.173 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.173 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.173 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194488 s, 53.9 MB/s 2024-04-25T09:09:39.189 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.189 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.189 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142106 s, 73.8 MB/s 2024-04-25T09:09:39.214 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.214 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.214 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230067 s, 45.6 MB/s 2024-04-25T09:09:39.231 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.231 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.231 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014874 s, 70.5 MB/s 2024-04-25T09:09:39.249 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.249 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.249 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165298 s, 63.4 MB/s 2024-04-25T09:09:39.266 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.266 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.266 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148667 s, 70.5 MB/s 2024-04-25T09:09:39.290 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.290 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.291 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229633 s, 45.7 MB/s 2024-04-25T09:09:39.313 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.313 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.314 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210434 s, 49.8 MB/s 2024-04-25T09:09:39.330 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.330 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.330 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151405 s, 69.3 MB/s 2024-04-25T09:09:39.348 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.348 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.348 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016224 s, 64.6 MB/s 2024-04-25T09:09:39.364 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.364 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.364 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139562 s, 75.1 MB/s 2024-04-25T09:09:39.382 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.382 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.382 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016451 s, 63.7 MB/s 2024-04-25T09:09:39.400 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.400 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.400 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159148 s, 65.9 MB/s 2024-04-25T09:09:39.419 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.419 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.419 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176652 s, 59.4 MB/s 2024-04-25T09:09:39.436 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.436 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.436 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149259 s, 70.3 MB/s 2024-04-25T09:09:39.452 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.452 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.452 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140372 s, 74.7 MB/s 2024-04-25T09:09:39.468 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.468 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.468 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014387 s, 72.9 MB/s 2024-04-25T09:09:39.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.484 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139434 s, 75.2 MB/s 2024-04-25T09:09:39.505 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.505 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.505 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196537 s, 53.4 MB/s 2024-04-25T09:09:39.524 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.524 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.524 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163355 s, 64.2 MB/s 2024-04-25T09:09:39.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:39.525 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:39.525 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:39.525 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.2 2024-04-25T09:09:39.525 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:39.525 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:39.525 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:39.525 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:39.597 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.597 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.597 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175159 s, 59.9 MB/s 2024-04-25T09:09:39.616 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.616 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.616 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166507 s, 63.0 MB/s 2024-04-25T09:09:39.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.632 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146412 s, 71.6 MB/s 2024-04-25T09:09:39.652 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.652 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.652 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018039 s, 58.1 MB/s 2024-04-25T09:09:39.668 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.668 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.668 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014486 s, 72.4 MB/s 2024-04-25T09:09:39.687 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.687 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.687 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166099 s, 63.1 MB/s 2024-04-25T09:09:39.709 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.709 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.709 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198778 s, 52.8 MB/s 2024-04-25T09:09:39.724 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.725 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.725 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142301 s, 73.7 MB/s 2024-04-25T09:09:39.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.741 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142676 s, 73.5 MB/s 2024-04-25T09:09:39.764 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.765 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.765 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218797 s, 47.9 MB/s 2024-04-25T09:09:39.780 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.780 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.781 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143033 s, 73.3 MB/s 2024-04-25T09:09:39.797 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.797 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.797 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142907 s, 73.4 MB/s 2024-04-25T09:09:39.816 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.816 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.816 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178865 s, 58.6 MB/s 2024-04-25T09:09:39.833 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.833 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.833 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145069 s, 72.3 MB/s 2024-04-25T09:09:39.857 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.857 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.857 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221226 s, 47.4 MB/s 2024-04-25T09:09:39.879 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.879 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.879 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199386 s, 52.6 MB/s 2024-04-25T09:09:39.896 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.896 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.896 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154459 s, 67.9 MB/s 2024-04-25T09:09:39.917 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.917 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.917 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195026 s, 53.8 MB/s 2024-04-25T09:09:39.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.934 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149137 s, 70.3 MB/s 2024-04-25T09:09:39.954 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.954 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.954 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179721 s, 58.3 MB/s 2024-04-25T09:09:39.970 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.970 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.970 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142646 s, 73.5 MB/s 2024-04-25T09:09:39.990 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:39.990 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:39.990 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176811 s, 59.3 MB/s 2024-04-25T09:09:40.006 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.006 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.006 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145473 s, 72.1 MB/s 2024-04-25T09:09:40.023 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.023 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.023 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015104 s, 69.4 MB/s 2024-04-25T09:09:40.043 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.043 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.044 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189186 s, 55.4 MB/s 2024-04-25T09:09:40.066 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.066 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.066 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205822 s, 50.9 MB/s 2024-04-25T09:09:40.082 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.082 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.082 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139381 s, 75.2 MB/s 2024-04-25T09:09:40.098 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.098 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.099 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149762 s, 70.0 MB/s 2024-04-25T09:09:40.114 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.114 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.114 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141464 s, 74.1 MB/s 2024-04-25T09:09:40.133 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.133 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.133 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169001 s, 62.0 MB/s 2024-04-25T09:09:40.157 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.157 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.157 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215498 s, 48.7 MB/s 2024-04-25T09:09:40.176 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.176 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.176 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178238 s, 58.8 MB/s 2024-04-25T09:09:40.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:40.178 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:40.178 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:40.178 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.3 2024-04-25T09:09:40.178 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:40.178 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:40.178 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:40.178 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:40.247 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.247 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.247 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155242 s, 67.5 MB/s 2024-04-25T09:09:40.262 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.263 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.263 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014095 s, 74.4 MB/s 2024-04-25T09:09:40.279 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.279 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.280 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151208 s, 69.3 MB/s 2024-04-25T09:09:40.296 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.296 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.296 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143517 s, 73.1 MB/s 2024-04-25T09:09:40.312 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.312 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.312 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149413 s, 70.2 MB/s 2024-04-25T09:09:40.328 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.328 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.328 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014114 s, 74.3 MB/s 2024-04-25T09:09:40.350 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.350 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.350 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020039 s, 52.3 MB/s 2024-04-25T09:09:40.367 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.367 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.368 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156074 s, 67.2 MB/s 2024-04-25T09:09:40.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.386 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165915 s, 63.2 MB/s 2024-04-25T09:09:40.402 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.402 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.403 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148915 s, 70.4 MB/s 2024-04-25T09:09:40.419 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.419 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.419 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143294 s, 73.2 MB/s 2024-04-25T09:09:40.434 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.434 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.435 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142081 s, 73.8 MB/s 2024-04-25T09:09:40.450 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.450 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.450 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141136 s, 74.3 MB/s 2024-04-25T09:09:40.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.469 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165227 s, 63.5 MB/s 2024-04-25T09:09:40.490 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.490 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.490 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191856 s, 54.7 MB/s 2024-04-25T09:09:40.511 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.511 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.511 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194857 s, 53.8 MB/s 2024-04-25T09:09:40.529 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.529 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.529 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169825 s, 61.7 MB/s 2024-04-25T09:09:40.546 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.546 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.546 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149035 s, 70.4 MB/s 2024-04-25T09:09:40.567 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.567 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.567 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184797 s, 56.7 MB/s 2024-04-25T09:09:40.584 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.584 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.584 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158787 s, 66.0 MB/s 2024-04-25T09:09:40.606 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.606 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.606 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199163 s, 52.6 MB/s 2024-04-25T09:09:40.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.624 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015956 s, 65.7 MB/s 2024-04-25T09:09:40.646 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.646 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.646 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204132 s, 51.4 MB/s 2024-04-25T09:09:40.668 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.668 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.669 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210305 s, 49.9 MB/s 2024-04-25T09:09:40.684 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.685 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.685 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142387 s, 73.6 MB/s 2024-04-25T09:09:40.705 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.705 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.705 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183827 s, 57.0 MB/s 2024-04-25T09:09:40.727 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.727 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.727 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206002 s, 50.9 MB/s 2024-04-25T09:09:40.746 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.746 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.746 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166299 s, 63.1 MB/s 2024-04-25T09:09:40.763 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.763 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.763 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151535 s, 69.2 MB/s 2024-04-25T09:09:40.779 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.779 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150466 s, 69.7 MB/s 2024-04-25T09:09:40.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.805 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232367 s, 45.1 MB/s 2024-04-25T09:09:40.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.821 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149327 s, 70.2 MB/s 2024-04-25T09:09:40.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:40.823 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:40.823 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:40.823 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.4 2024-04-25T09:09:40.823 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:40.823 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:40.823 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:40.823 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:40.901 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.901 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.901 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222599 s, 47.1 MB/s 2024-04-25T09:09:40.917 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.917 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.917 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145692 s, 72.0 MB/s 2024-04-25T09:09:40.933 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.934 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141783 s, 74.0 MB/s 2024-04-25T09:09:40.949 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.949 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.949 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139072 s, 75.4 MB/s 2024-04-25T09:09:40.963 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.963 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.963 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122559 s, 85.6 MB/s 2024-04-25T09:09:40.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:40.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:40.982 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167862 s, 62.5 MB/s 2024-04-25T09:09:41.003 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.003 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.003 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189868 s, 55.2 MB/s 2024-04-25T09:09:41.026 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.026 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.026 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213842 s, 49.0 MB/s 2024-04-25T09:09:41.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.042 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146605 s, 71.5 MB/s 2024-04-25T09:09:41.058 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.058 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.058 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142423 s, 73.6 MB/s 2024-04-25T09:09:41.074 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.075 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.075 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146666 s, 71.5 MB/s 2024-04-25T09:09:41.092 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.092 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.092 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152772 s, 68.6 MB/s 2024-04-25T09:09:41.109 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.109 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.109 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155559 s, 67.4 MB/s 2024-04-25T09:09:41.125 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.125 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.125 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143004 s, 73.3 MB/s 2024-04-25T09:09:41.143 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.143 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.143 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156525 s, 67.0 MB/s 2024-04-25T09:09:41.164 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.164 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.164 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195432 s, 53.7 MB/s 2024-04-25T09:09:41.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.184 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.184 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177635 s, 59.0 MB/s 2024-04-25T09:09:41.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.205 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194494 s, 53.9 MB/s 2024-04-25T09:09:41.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.225 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177572 s, 59.1 MB/s 2024-04-25T09:09:41.246 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.246 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.246 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197281 s, 53.2 MB/s 2024-04-25T09:09:41.266 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.266 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.266 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183196 s, 57.2 MB/s 2024-04-25T09:09:41.283 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.283 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.283 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146876 s, 71.4 MB/s 2024-04-25T09:09:41.303 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.304 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.304 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191627 s, 54.7 MB/s 2024-04-25T09:09:41.320 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.320 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.320 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142718 s, 73.5 MB/s 2024-04-25T09:09:41.336 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.336 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.337 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149447 s, 70.2 MB/s 2024-04-25T09:09:41.353 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.353 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.354 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153151 s, 68.5 MB/s 2024-04-25T09:09:41.371 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.371 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.371 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157632 s, 66.5 MB/s 2024-04-25T09:09:41.388 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.388 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.388 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153524 s, 68.3 MB/s 2024-04-25T09:09:41.404 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.404 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.404 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140694 s, 74.5 MB/s 2024-04-25T09:09:41.422 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.422 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.422 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162891 s, 64.4 MB/s 2024-04-25T09:09:41.438 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.438 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.438 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014175 s, 74.0 MB/s 2024-04-25T09:09:41.454 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.454 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.454 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141152 s, 74.3 MB/s 2024-04-25T09:09:41.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:41.456 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:41.456 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:41.456 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.5 2024-04-25T09:09:41.456 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:41.456 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:41.456 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:41.456 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:41.534 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.534 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.534 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229228 s, 45.7 MB/s 2024-04-25T09:09:41.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.556 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201899 s, 51.9 MB/s 2024-04-25T09:09:41.572 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.572 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.572 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146659 s, 71.5 MB/s 2024-04-25T09:09:41.590 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.590 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.590 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162634 s, 64.5 MB/s 2024-04-25T09:09:41.608 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.608 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.608 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160437 s, 65.4 MB/s 2024-04-25T09:09:41.626 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.627 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.627 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165838 s, 63.2 MB/s 2024-04-25T09:09:41.647 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194153 s, 54.0 MB/s 2024-04-25T09:09:41.671 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.671 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.671 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215554 s, 48.6 MB/s 2024-04-25T09:09:41.688 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.688 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.688 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150102 s, 69.9 MB/s 2024-04-25T09:09:41.705 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.705 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.705 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154483 s, 67.9 MB/s 2024-04-25T09:09:41.727 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.728 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.728 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204367 s, 51.3 MB/s 2024-04-25T09:09:41.744 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.744 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.744 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148302 s, 70.7 MB/s 2024-04-25T09:09:41.760 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.761 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.761 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145974 s, 71.8 MB/s 2024-04-25T09:09:41.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.777 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148684 s, 70.5 MB/s 2024-04-25T09:09:41.797 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.797 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.797 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183872 s, 57.0 MB/s 2024-04-25T09:09:41.816 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.816 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.816 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166231 s, 63.1 MB/s 2024-04-25T09:09:41.832 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.832 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.832 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144182 s, 72.7 MB/s 2024-04-25T09:09:41.850 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.850 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.850 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163771 s, 64.0 MB/s 2024-04-25T09:09:41.866 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.866 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.866 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141882 s, 73.9 MB/s 2024-04-25T09:09:41.886 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.886 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.886 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183299 s, 57.2 MB/s 2024-04-25T09:09:41.903 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.903 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.903 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146435 s, 71.6 MB/s 2024-04-25T09:09:41.919 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.919 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.919 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147559 s, 71.1 MB/s 2024-04-25T09:09:41.935 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.935 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.935 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141054 s, 74.3 MB/s 2024-04-25T09:09:41.954 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.954 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.954 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170365 s, 61.5 MB/s 2024-04-25T09:09:41.977 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:41.977 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:41.977 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206157 s, 50.9 MB/s 2024-04-25T09:09:42.000 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.000 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.000 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214211 s, 49.0 MB/s 2024-04-25T09:09:42.018 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.018 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.018 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159027 s, 65.9 MB/s 2024-04-25T09:09:42.037 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.037 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.037 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171845 s, 61.0 MB/s 2024-04-25T09:09:42.058 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.058 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.058 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192422 s, 54.5 MB/s 2024-04-25T09:09:42.074 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.074 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.074 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141838 s, 73.9 MB/s 2024-04-25T09:09:42.091 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.092 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.092 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160302 s, 65.4 MB/s 2024-04-25T09:09:42.108 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.108 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.108 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014541 s, 72.1 MB/s 2024-04-25T09:09:42.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:42.109 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:42.109 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:42.109 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.6 2024-04-25T09:09:42.109 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:42.110 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:42.110 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:42.110 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:42.181 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.181 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.181 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014313 s, 73.3 MB/s 2024-04-25T09:09:42.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.200 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165798 s, 63.2 MB/s 2024-04-25T09:09:42.216 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.216 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.216 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147167 s, 71.3 MB/s 2024-04-25T09:09:42.233 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.233 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.233 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148104 s, 70.8 MB/s 2024-04-25T09:09:42.251 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.251 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.251 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166778 s, 62.9 MB/s 2024-04-25T09:09:42.267 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.267 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.268 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141397 s, 74.2 MB/s 2024-04-25T09:09:42.284 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.284 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.284 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147002 s, 71.3 MB/s 2024-04-25T09:09:42.300 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.300 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.300 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145282 s, 72.2 MB/s 2024-04-25T09:09:42.317 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.317 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.317 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014989 s, 70.0 MB/s 2024-04-25T09:09:42.333 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.333 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.333 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134761 s, 77.8 MB/s 2024-04-25T09:09:42.350 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.350 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.350 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153724 s, 68.2 MB/s 2024-04-25T09:09:42.365 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.366 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.366 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140094 s, 74.8 MB/s 2024-04-25T09:09:42.385 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.385 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.385 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178623 s, 58.7 MB/s 2024-04-25T09:09:42.408 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.408 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.408 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208984 s, 50.2 MB/s 2024-04-25T09:09:42.428 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.429 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.429 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187961 s, 55.8 MB/s 2024-04-25T09:09:42.445 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.445 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.445 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144956 s, 72.3 MB/s 2024-04-25T09:09:42.468 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.468 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.468 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216018 s, 48.5 MB/s 2024-04-25T09:09:42.485 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.485 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.485 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149324 s, 70.2 MB/s 2024-04-25T09:09:42.503 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.503 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.503 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158837 s, 66.0 MB/s 2024-04-25T09:09:42.520 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.520 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.520 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155839 s, 67.3 MB/s 2024-04-25T09:09:42.536 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.536 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.536 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145962 s, 71.8 MB/s 2024-04-25T09:09:42.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.557 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.557 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183425 s, 57.2 MB/s 2024-04-25T09:09:42.573 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.573 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.573 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145529 s, 72.1 MB/s 2024-04-25T09:09:42.594 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.594 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.594 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018632 s, 56.3 MB/s 2024-04-25T09:09:42.609 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.610 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.610 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141118 s, 74.3 MB/s 2024-04-25T09:09:42.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.628 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165386 s, 63.4 MB/s 2024-04-25T09:09:42.644 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.644 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.644 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144834 s, 72.4 MB/s 2024-04-25T09:09:42.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.665 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187968 s, 55.8 MB/s 2024-04-25T09:09:42.684 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.684 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.684 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175122 s, 59.9 MB/s 2024-04-25T09:09:42.701 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.701 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.701 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150755 s, 69.6 MB/s 2024-04-25T09:09:42.720 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.720 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.720 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169607 s, 61.8 MB/s 2024-04-25T09:09:42.738 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.738 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.738 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161384 s, 65.0 MB/s 2024-04-25T09:09:42.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:42.742 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:42.742 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:42.742 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.7 2024-04-25T09:09:42.742 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:42.742 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:42.742 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:42.742 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:42.815 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.815 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.815 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143477 s, 73.1 MB/s 2024-04-25T09:09:42.831 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.832 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.832 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154635 s, 67.8 MB/s 2024-04-25T09:09:42.851 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.851 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.851 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017497 s, 59.9 MB/s 2024-04-25T09:09:42.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.866 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.866 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126021 s, 83.2 MB/s 2024-04-25T09:09:42.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.882 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148568 s, 70.6 MB/s 2024-04-25T09:09:42.900 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.900 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.900 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163391 s, 64.2 MB/s 2024-04-25T09:09:42.917 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.917 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.917 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150379 s, 69.7 MB/s 2024-04-25T09:09:42.933 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.933 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.933 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140988 s, 74.4 MB/s 2024-04-25T09:09:42.950 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.950 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.950 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148381 s, 70.7 MB/s 2024-04-25T09:09:42.971 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.971 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.972 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019646 s, 53.4 MB/s 2024-04-25T09:09:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186466 s, 56.2 MB/s 2024-04-25T09:09:43.009 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.009 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.009 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157893 s, 66.4 MB/s 2024-04-25T09:09:43.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.025 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138276 s, 75.8 MB/s 2024-04-25T09:09:43.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.042 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149387 s, 70.2 MB/s 2024-04-25T09:09:43.060 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.061 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.061 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170353 s, 61.6 MB/s 2024-04-25T09:09:43.082 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.082 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.082 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197506 s, 53.1 MB/s 2024-04-25T09:09:43.099 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.099 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.099 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150612 s, 69.6 MB/s 2024-04-25T09:09:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192631 s, 54.4 MB/s 2024-04-25T09:09:43.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.136 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145346 s, 72.1 MB/s 2024-04-25T09:09:43.153 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.153 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.153 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146687 s, 71.5 MB/s 2024-04-25T09:09:43.170 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.170 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.170 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159151 s, 65.9 MB/s 2024-04-25T09:09:43.188 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.188 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.188 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158534 s, 66.1 MB/s 2024-04-25T09:09:43.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.205 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151521 s, 69.2 MB/s 2024-04-25T09:09:43.221 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.221 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.222 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147117 s, 71.3 MB/s 2024-04-25T09:09:43.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.240 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169104 s, 62.0 MB/s 2024-04-25T09:09:43.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.257 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153585 s, 68.3 MB/s 2024-04-25T09:09:43.275 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.276 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.276 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016666 s, 62.9 MB/s 2024-04-25T09:09:43.291 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.292 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.292 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141442 s, 74.1 MB/s 2024-04-25T09:09:43.307 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143491 s, 73.1 MB/s 2024-04-25T09:09:43.324 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.324 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.324 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144876 s, 72.4 MB/s 2024-04-25T09:09:43.349 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.350 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.350 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237536 s, 44.1 MB/s 2024-04-25T09:09:43.366 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.366 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.366 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146719 s, 71.5 MB/s 2024-04-25T09:09:43.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:43.368 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:43.368 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:43.368 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.8 2024-04-25T09:09:43.368 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:43.368 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:43.368 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:43.368 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:43.436 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.437 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.437 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136255 s, 77.0 MB/s 2024-04-25T09:09:43.453 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.453 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.453 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150355 s, 69.7 MB/s 2024-04-25T09:09:43.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.469 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142318 s, 73.7 MB/s 2024-04-25T09:09:43.490 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.490 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.490 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190566 s, 55.0 MB/s 2024-04-25T09:09:43.508 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.508 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.509 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164583 s, 63.7 MB/s 2024-04-25T09:09:43.525 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.525 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.525 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143701 s, 73.0 MB/s 2024-04-25T09:09:43.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.540 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139428 s, 75.2 MB/s 2024-04-25T09:09:43.558 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.559 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163994 s, 63.9 MB/s 2024-04-25T09:09:43.575 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.575 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.575 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149053 s, 70.3 MB/s 2024-04-25T09:09:43.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.592 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150495 s, 69.7 MB/s 2024-04-25T09:09:43.608 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.608 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.608 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142218 s, 73.7 MB/s 2024-04-25T09:09:43.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.625 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145685 s, 72.0 MB/s 2024-04-25T09:09:43.643 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.643 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.643 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166586 s, 62.9 MB/s 2024-04-25T09:09:43.659 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.659 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.659 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140983 s, 74.4 MB/s 2024-04-25T09:09:43.675 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.675 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.675 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014418 s, 72.7 MB/s 2024-04-25T09:09:43.692 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.692 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.692 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153977 s, 68.1 MB/s 2024-04-25T09:09:43.711 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.711 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.711 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168824 s, 62.1 MB/s 2024-04-25T09:09:43.726 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.726 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.727 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138686 s, 75.6 MB/s 2024-04-25T09:09:43.745 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.745 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.746 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174146 s, 60.2 MB/s 2024-04-25T09:09:43.765 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.765 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.765 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178059 s, 58.9 MB/s 2024-04-25T09:09:43.786 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.786 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.786 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190086 s, 55.2 MB/s 2024-04-25T09:09:43.802 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.802 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.802 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144324 s, 72.7 MB/s 2024-04-25T09:09:43.823 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.823 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.823 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018708 s, 56.0 MB/s 2024-04-25T09:09:43.843 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.843 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.843 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182792 s, 57.4 MB/s 2024-04-25T09:09:43.861 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.861 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.861 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164218 s, 63.9 MB/s 2024-04-25T09:09:43.877 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.877 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.877 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146352 s, 71.6 MB/s 2024-04-25T09:09:43.893 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.893 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.893 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141551 s, 74.1 MB/s 2024-04-25T09:09:43.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.912 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167433 s, 62.6 MB/s 2024-04-25T09:09:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154055 s, 68.1 MB/s 2024-04-25T09:09:43.949 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.949 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.949 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179117 s, 58.5 MB/s 2024-04-25T09:09:43.965 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.965 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.965 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145872 s, 71.9 MB/s 2024-04-25T09:09:43.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:43.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:43.982 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147126 s, 71.3 MB/s 2024-04-25T09:09:43.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:43.983 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:43.983 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:43.984 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.9 2024-04-25T09:09:43.984 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:43.984 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:43.984 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:43.984 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:44.063 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.063 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.063 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195217 s, 53.7 MB/s 2024-04-25T09:09:44.084 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.084 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.084 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188832 s, 55.5 MB/s 2024-04-25T09:09:44.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.100 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144337 s, 72.6 MB/s 2024-04-25T09:09:44.117 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.117 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.117 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147479 s, 71.1 MB/s 2024-04-25T09:09:44.133 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.133 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.133 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014393 s, 72.9 MB/s 2024-04-25T09:09:44.150 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.150 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.150 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147671 s, 71.0 MB/s 2024-04-25T09:09:44.167 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.167 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.167 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159688 s, 65.7 MB/s 2024-04-25T09:09:44.185 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.185 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.185 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164676 s, 63.7 MB/s 2024-04-25T09:09:44.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.206 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189935 s, 55.2 MB/s 2024-04-25T09:09:44.225 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.225 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.225 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170105 s, 61.6 MB/s 2024-04-25T09:09:44.241 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.241 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.241 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145187 s, 72.2 MB/s 2024-04-25T09:09:44.262 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.262 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.262 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186623 s, 56.2 MB/s 2024-04-25T09:09:44.281 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.281 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.281 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174084 s, 60.2 MB/s 2024-04-25T09:09:44.297 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.297 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.297 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141692 s, 74.0 MB/s 2024-04-25T09:09:44.313 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.313 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.313 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141088 s, 74.3 MB/s 2024-04-25T09:09:44.330 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.330 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.330 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153577 s, 68.3 MB/s 2024-04-25T09:09:44.347 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.348 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.348 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155317 s, 67.5 MB/s 2024-04-25T09:09:44.364 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.364 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.364 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147405 s, 71.1 MB/s 2024-04-25T09:09:44.383 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.383 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.383 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169443 s, 61.9 MB/s 2024-04-25T09:09:44.401 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.401 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.401 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166948 s, 62.8 MB/s 2024-04-25T09:09:44.419 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.419 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.419 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159704 s, 65.7 MB/s 2024-04-25T09:09:44.437 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.438 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.438 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167768 s, 62.5 MB/s 2024-04-25T09:09:44.458 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.458 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.458 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190705 s, 55.0 MB/s 2024-04-25T09:09:44.477 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.477 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.477 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168931 s, 62.1 MB/s 2024-04-25T09:09:44.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.497 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185706 s, 56.5 MB/s 2024-04-25T09:09:44.514 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.514 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.514 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147989 s, 70.9 MB/s 2024-04-25T09:09:44.530 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.530 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.530 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142898 s, 73.4 MB/s 2024-04-25T09:09:44.551 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.551 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.551 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194365 s, 53.9 MB/s 2024-04-25T09:09:44.567 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.567 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.567 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142709 s, 73.5 MB/s 2024-04-25T09:09:44.584 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.584 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.584 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145457 s, 72.1 MB/s 2024-04-25T09:09:44.600 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.600 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.600 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014855 s, 70.6 MB/s 2024-04-25T09:09:44.617 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.618 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.618 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153359 s, 68.4 MB/s 2024-04-25T09:09:44.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:44.619 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:44.619 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:44.619 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.10 2024-04-25T09:09:44.619 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:44.619 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:44.619 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:44.620 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:44.691 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.691 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.691 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163861 s, 64.0 MB/s 2024-04-25T09:09:44.709 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.709 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.709 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155528 s, 67.4 MB/s 2024-04-25T09:09:44.725 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.725 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.725 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142856 s, 73.4 MB/s 2024-04-25T09:09:44.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.742 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.742 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014886 s, 70.4 MB/s 2024-04-25T09:09:44.765 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.765 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.765 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215488 s, 48.7 MB/s 2024-04-25T09:09:44.781 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.781 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.781 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141996 s, 73.8 MB/s 2024-04-25T09:09:44.802 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.802 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.802 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196488 s, 53.4 MB/s 2024-04-25T09:09:44.823 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.823 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.823 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189247 s, 55.4 MB/s 2024-04-25T09:09:44.844 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.844 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.844 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193305 s, 54.2 MB/s 2024-04-25T09:09:44.861 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.861 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.861 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145654 s, 72.0 MB/s 2024-04-25T09:09:44.878 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.878 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.878 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150906 s, 69.5 MB/s 2024-04-25T09:09:44.895 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.895 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.895 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155459 s, 67.5 MB/s 2024-04-25T09:09:44.917 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.917 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.917 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202278 s, 51.8 MB/s 2024-04-25T09:09:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141056 s, 74.3 MB/s 2024-04-25T09:09:44.949 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.949 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.949 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143085 s, 73.3 MB/s 2024-04-25T09:09:44.965 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.966 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.966 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142864 s, 73.4 MB/s 2024-04-25T09:09:44.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:44.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:44.987 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196025 s, 53.5 MB/s 2024-04-25T09:09:44.989 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:09:44.992 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:09:45.005 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.006 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.006 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016827 s, 62.3 MB/s 2024-04-25T09:09:45.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.022 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146656 s, 71.5 MB/s 2024-04-25T09:09:45.038 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.038 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.038 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143845 s, 72.9 MB/s 2024-04-25T09:09:45.055 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.055 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.055 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149293 s, 70.2 MB/s 2024-04-25T09:09:45.073 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.073 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.073 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159479 s, 65.8 MB/s 2024-04-25T09:09:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.087 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.087 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119526 s, 87.7 MB/s 2024-04-25T09:09:45.103 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.104 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.104 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153943 s, 68.1 MB/s 2024-04-25T09:09:45.121 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.121 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.121 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157617 s, 66.5 MB/s 2024-04-25T09:09:45.137 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.137 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.137 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141629 s, 74.0 MB/s 2024-04-25T09:09:45.155 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.155 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.156 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165251 s, 63.5 MB/s 2024-04-25T09:09:45.175 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.175 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.175 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177953 s, 58.9 MB/s 2024-04-25T09:09:45.193 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.193 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.193 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137258 s, 76.4 MB/s 2024-04-25T09:09:45.207 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.207 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.207 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141593 s, 74.1 MB/s 2024-04-25T09:09:45.225 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.225 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.225 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165752 s, 63.3 MB/s 2024-04-25T09:09:45.241 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.241 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.242 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145553 s, 72.0 MB/s 2024-04-25T09:09:45.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:45.243 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:45.243 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:45.243 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.11 2024-04-25T09:09:45.243 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:45.243 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:45.243 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:45.243 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:45.317 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.317 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.317 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017396 s, 60.3 MB/s 2024-04-25T09:09:45.335 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.335 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.335 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161012 s, 65.1 MB/s 2024-04-25T09:09:45.355 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.356 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.356 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189133 s, 55.4 MB/s 2024-04-25T09:09:45.374 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.374 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.374 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164098 s, 63.9 MB/s 2024-04-25T09:09:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110192 s, 95.2 MB/s 2024-04-25T09:09:45.410 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.410 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.410 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220981 s, 47.5 MB/s 2024-04-25T09:09:45.432 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.433 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.433 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204579 s, 51.3 MB/s 2024-04-25T09:09:45.448 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.448 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.448 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142974 s, 73.3 MB/s 2024-04-25T09:09:45.467 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.467 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.467 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164689 s, 63.7 MB/s 2024-04-25T09:09:45.485 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.486 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.486 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170959 s, 61.3 MB/s 2024-04-25T09:09:45.501 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.501 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.501 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139861 s, 75.0 MB/s 2024-04-25T09:09:45.518 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.518 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.518 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144232 s, 72.7 MB/s 2024-04-25T09:09:45.535 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.535 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.535 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154324 s, 67.9 MB/s 2024-04-25T09:09:45.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.556 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191238 s, 54.8 MB/s 2024-04-25T09:09:45.572 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.572 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.572 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146166 s, 71.7 MB/s 2024-04-25T09:09:45.588 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.588 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.588 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139016 s, 75.4 MB/s 2024-04-25T09:09:45.609 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.609 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.609 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190034 s, 55.2 MB/s 2024-04-25T09:09:45.625 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.625 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.626 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147343 s, 71.2 MB/s 2024-04-25T09:09:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171378 s, 61.2 MB/s 2024-04-25T09:09:45.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.661 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153172 s, 68.5 MB/s 2024-04-25T09:09:45.678 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.678 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.678 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145242 s, 72.2 MB/s 2024-04-25T09:09:45.695 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.695 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.696 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159541 s, 65.7 MB/s 2024-04-25T09:09:45.712 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.712 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.712 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146333 s, 71.7 MB/s 2024-04-25T09:09:45.732 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.732 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.732 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184016 s, 57.0 MB/s 2024-04-25T09:09:45.749 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.749 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.749 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155024 s, 67.6 MB/s 2024-04-25T09:09:45.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.766 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152485 s, 68.8 MB/s 2024-04-25T09:09:45.785 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.785 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.785 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166306 s, 63.1 MB/s 2024-04-25T09:09:45.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.805 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182407 s, 57.5 MB/s 2024-04-25T09:09:45.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.821 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144374 s, 72.6 MB/s 2024-04-25T09:09:45.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.837 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144457 s, 72.6 MB/s 2024-04-25T09:09:45.854 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.854 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.854 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151952 s, 69.0 MB/s 2024-04-25T09:09:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195962 s, 53.5 MB/s 2024-04-25T09:09:45.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:45.877 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:45.878 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:45.878 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.12 2024-04-25T09:09:45.878 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:45.878 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:45.878 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:45.878 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:45.950 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.950 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.950 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149005 s, 70.4 MB/s 2024-04-25T09:09:45.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.968 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166801 s, 62.9 MB/s 2024-04-25T09:09:45.985 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:45.985 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:45.985 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147096 s, 71.3 MB/s 2024-04-25T09:09:46.003 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.003 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.003 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162958 s, 64.3 MB/s 2024-04-25T09:09:46.019 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.019 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.020 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147495 s, 71.1 MB/s 2024-04-25T09:09:46.038 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.038 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.038 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016302 s, 64.3 MB/s 2024-04-25T09:09:46.056 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.056 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.056 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165159 s, 63.5 MB/s 2024-04-25T09:09:46.072 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.072 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.073 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149023 s, 70.4 MB/s 2024-04-25T09:09:46.091 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.091 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.091 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165474 s, 63.4 MB/s 2024-04-25T09:09:46.106 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.106 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.107 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138634 s, 75.6 MB/s 2024-04-25T09:09:46.123 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.123 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.123 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142384 s, 73.6 MB/s 2024-04-25T09:09:46.142 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.142 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.142 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175687 s, 59.7 MB/s 2024-04-25T09:09:46.159 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.159 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.159 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015592 s, 67.3 MB/s 2024-04-25T09:09:46.175 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.175 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.176 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141765 s, 74.0 MB/s 2024-04-25T09:09:46.194 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.194 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.194 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166063 s, 63.1 MB/s 2024-04-25T09:09:46.211 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.211 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.211 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155875 s, 67.3 MB/s 2024-04-25T09:09:46.227 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.227 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.227 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146283 s, 71.7 MB/s 2024-04-25T09:09:46.243 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.243 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.243 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140592 s, 74.6 MB/s 2024-04-25T09:09:46.260 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.260 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.260 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147044 s, 71.3 MB/s 2024-04-25T09:09:46.276 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.276 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.276 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140718 s, 74.5 MB/s 2024-04-25T09:09:46.299 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.299 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.299 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216551 s, 48.4 MB/s 2024-04-25T09:09:46.315 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.315 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.315 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140412 s, 74.7 MB/s 2024-04-25T09:09:46.335 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.335 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.335 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180379 s, 58.1 MB/s 2024-04-25T09:09:46.351 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.351 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.351 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146994 s, 71.3 MB/s 2024-04-25T09:09:46.368 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.368 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.368 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151803 s, 69.1 MB/s 2024-04-25T09:09:46.388 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.388 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.388 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176927 s, 59.3 MB/s 2024-04-25T09:09:46.404 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.404 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.404 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148071 s, 70.8 MB/s 2024-04-25T09:09:46.426 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.426 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.426 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185966 s, 56.4 MB/s 2024-04-25T09:09:46.441 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.441 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.441 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146249 s, 71.7 MB/s 2024-04-25T09:09:46.458 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.458 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.458 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014432 s, 72.7 MB/s 2024-04-25T09:09:46.483 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.483 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.484 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239642 s, 43.8 MB/s 2024-04-25T09:09:46.503 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.504 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.504 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183244 s, 57.2 MB/s 2024-04-25T09:09:46.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:46.505 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:46.505 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:46.505 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.13 2024-04-25T09:09:46.505 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:46.506 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:46.506 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:46.506 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:46.575 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.575 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.575 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160139 s, 65.5 MB/s 2024-04-25T09:09:46.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.592 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157037 s, 66.8 MB/s 2024-04-25T09:09:46.608 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.608 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.608 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140557 s, 74.6 MB/s 2024-04-25T09:09:46.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.625 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146062 s, 71.8 MB/s 2024-04-25T09:09:46.641 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.641 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.641 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150268 s, 69.8 MB/s 2024-04-25T09:09:46.658 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.658 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.658 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145646 s, 72.0 MB/s 2024-04-25T09:09:46.674 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.675 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.675 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149407 s, 70.2 MB/s 2024-04-25T09:09:46.693 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.693 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.693 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166946 s, 62.8 MB/s 2024-04-25T09:09:46.709 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.709 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.709 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141629 s, 74.0 MB/s 2024-04-25T09:09:46.725 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.725 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.725 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142453 s, 73.6 MB/s 2024-04-25T09:09:46.742 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.742 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.742 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156319 s, 67.1 MB/s 2024-04-25T09:09:46.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.759 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147542 s, 71.1 MB/s 2024-04-25T09:09:46.775 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.775 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.775 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139883 s, 75.0 MB/s 2024-04-25T09:09:46.791 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.791 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.791 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146928 s, 71.4 MB/s 2024-04-25T09:09:46.809 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.809 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.809 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163525 s, 64.1 MB/s 2024-04-25T09:09:46.826 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.827 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.827 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154037 s, 68.1 MB/s 2024-04-25T09:09:46.843 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.843 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.843 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146933 s, 71.4 MB/s 2024-04-25T09:09:46.862 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.862 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.863 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179652 s, 58.4 MB/s 2024-04-25T09:09:46.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.882 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180892 s, 58.0 MB/s 2024-04-25T09:09:46.902 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.902 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.902 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175481 s, 59.8 MB/s 2024-04-25T09:09:46.923 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.923 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.923 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192526 s, 54.5 MB/s 2024-04-25T09:09:46.944 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.944 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.944 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191659 s, 54.7 MB/s 2024-04-25T09:09:46.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.969 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235137 s, 44.6 MB/s 2024-04-25T09:09:46.986 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:46.986 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:46.986 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146051 s, 71.8 MB/s 2024-04-25T09:09:47.006 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.006 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.006 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185535 s, 56.5 MB/s 2024-04-25T09:09:47.026 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.026 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.026 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176793 s, 59.3 MB/s 2024-04-25T09:09:47.048 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.048 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.048 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206255 s, 50.8 MB/s 2024-04-25T09:09:47.067 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.067 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.067 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167048 s, 62.8 MB/s 2024-04-25T09:09:47.083 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.083 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.084 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149785 s, 70.0 MB/s 2024-04-25T09:09:47.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.101 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159861 s, 65.6 MB/s 2024-04-25T09:09:47.120 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.120 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.120 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169826 s, 61.7 MB/s 2024-04-25T09:09:47.138 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.138 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.138 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159609 s, 65.7 MB/s 2024-04-25T09:09:47.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:47.139 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:47.139 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:47.139 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.14 2024-04-25T09:09:47.139 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:47.140 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:47.140 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:47.140 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:47.215 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.215 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.215 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198953 s, 52.7 MB/s 2024-04-25T09:09:47.232 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.232 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.232 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154512 s, 67.9 MB/s 2024-04-25T09:09:47.248 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.248 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.248 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140916 s, 74.4 MB/s 2024-04-25T09:09:47.267 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.268 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.268 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179652 s, 58.4 MB/s 2024-04-25T09:09:47.285 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.285 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.285 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160201 s, 65.5 MB/s 2024-04-25T09:09:47.306 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.306 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.306 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193216 s, 54.3 MB/s 2024-04-25T09:09:47.322 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.322 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.322 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141495 s, 74.1 MB/s 2024-04-25T09:09:47.342 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.342 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.342 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017925 s, 58.5 MB/s 2024-04-25T09:09:47.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.360 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164513 s, 63.7 MB/s 2024-04-25T09:09:47.377 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.377 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.377 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153856 s, 68.2 MB/s 2024-04-25T09:09:47.398 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.398 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.398 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191564 s, 54.7 MB/s 2024-04-25T09:09:47.420 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.420 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.420 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197845 s, 53.0 MB/s 2024-04-25T09:09:47.434 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.434 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.434 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118839 s, 88.2 MB/s 2024-04-25T09:09:47.449 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.450 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.450 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140193 s, 74.8 MB/s 2024-04-25T09:09:47.470 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.470 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.470 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018713 s, 56.0 MB/s 2024-04-25T09:09:47.490 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.491 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.491 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187855 s, 55.8 MB/s 2024-04-25T09:09:47.506 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.507 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.507 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140542 s, 74.6 MB/s 2024-04-25T09:09:47.524 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.525 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.525 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161927 s, 64.8 MB/s 2024-04-25T09:09:47.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.541 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.541 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143866 s, 72.9 MB/s 2024-04-25T09:09:47.557 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.557 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.557 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014826 s, 70.7 MB/s 2024-04-25T09:09:47.573 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.573 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.573 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142947 s, 73.4 MB/s 2024-04-25T09:09:47.590 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.590 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.590 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145409 s, 72.1 MB/s 2024-04-25T09:09:47.606 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.606 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.606 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142288 s, 73.7 MB/s 2024-04-25T09:09:47.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.622 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144394 s, 72.6 MB/s 2024-04-25T09:09:47.640 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.640 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.641 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168548 s, 62.2 MB/s 2024-04-25T09:09:47.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.665 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223207 s, 47.0 MB/s 2024-04-25T09:09:47.685 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.686 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.686 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188442 s, 55.6 MB/s 2024-04-25T09:09:47.704 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.704 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.704 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164656 s, 63.7 MB/s 2024-04-25T09:09:47.720 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.720 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.720 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147469 s, 71.1 MB/s 2024-04-25T09:09:47.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.741 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189527 s, 55.3 MB/s 2024-04-25T09:09:47.757 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.757 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.757 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145292 s, 72.2 MB/s 2024-04-25T09:09:47.776 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.776 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.776 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170245 s, 61.6 MB/s 2024-04-25T09:09:47.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:47.778 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:47.778 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:47.778 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.15 2024-04-25T09:09:47.778 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:47.778 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:47.778 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:47.778 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:47.861 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.861 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.861 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216512 s, 48.4 MB/s 2024-04-25T09:09:47.879 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.879 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.879 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164509 s, 63.7 MB/s 2024-04-25T09:09:47.896 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.896 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.896 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152972 s, 68.5 MB/s 2024-04-25T09:09:47.913 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.913 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.913 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148758 s, 70.5 MB/s 2024-04-25T09:09:47.930 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.930 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.930 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147686 s, 71.0 MB/s 2024-04-25T09:09:47.946 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.946 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.946 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143018 s, 73.3 MB/s 2024-04-25T09:09:47.962 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.962 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.962 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01417 s, 74.0 MB/s 2024-04-25T09:09:47.984 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:47.984 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:47.984 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020049 s, 52.3 MB/s 2024-04-25T09:09:48.000 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.000 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.000 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146399 s, 71.6 MB/s 2024-04-25T09:09:48.021 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.021 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.021 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193638 s, 54.2 MB/s 2024-04-25T09:09:48.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.042 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188947 s, 55.5 MB/s 2024-04-25T09:09:48.058 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.058 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.058 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149082 s, 70.3 MB/s 2024-04-25T09:09:48.074 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.074 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.074 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140503 s, 74.6 MB/s 2024-04-25T09:09:48.090 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.090 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.090 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143407 s, 73.1 MB/s 2024-04-25T09:09:48.107 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.107 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.107 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147841 s, 70.9 MB/s 2024-04-25T09:09:48.124 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.124 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.124 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153227 s, 68.4 MB/s 2024-04-25T09:09:48.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.141 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145002 s, 72.3 MB/s 2024-04-25T09:09:48.157 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.157 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.157 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149772 s, 70.0 MB/s 2024-04-25T09:09:48.177 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.177 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.177 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175271 s, 59.8 MB/s 2024-04-25T09:09:48.197 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.197 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.198 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187595 s, 55.9 MB/s 2024-04-25T09:09:48.213 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.213 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.213 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142677 s, 73.5 MB/s 2024-04-25T09:09:48.230 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.230 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.230 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145361 s, 72.1 MB/s 2024-04-25T09:09:48.245 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.245 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.245 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137525 s, 76.2 MB/s 2024-04-25T09:09:48.263 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.263 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.263 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154342 s, 67.9 MB/s 2024-04-25T09:09:48.277 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.277 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.277 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122061 s, 85.9 MB/s 2024-04-25T09:09:48.296 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.296 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.296 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172356 s, 60.8 MB/s 2024-04-25T09:09:48.316 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.316 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.316 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186126 s, 56.3 MB/s 2024-04-25T09:09:48.336 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.336 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.336 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177576 s, 59.0 MB/s 2024-04-25T09:09:48.354 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.354 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.354 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167285 s, 62.7 MB/s 2024-04-25T09:09:48.371 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.371 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.371 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149566 s, 70.1 MB/s 2024-04-25T09:09:48.388 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.388 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.388 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150277 s, 69.8 MB/s 2024-04-25T09:09:48.404 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.404 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.404 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140478 s, 74.6 MB/s 2024-04-25T09:09:48.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:48.405 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:48.405 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:48.406 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.16 2024-04-25T09:09:48.406 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:48.406 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:48.406 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:48.406 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:48.473 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.473 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.473 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140392 s, 74.7 MB/s 2024-04-25T09:09:48.494 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.494 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.494 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194349 s, 54.0 MB/s 2024-04-25T09:09:48.512 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.512 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.512 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161544 s, 64.9 MB/s 2024-04-25T09:09:48.531 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.531 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.531 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170561 s, 61.5 MB/s 2024-04-25T09:09:48.549 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.549 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.549 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163744 s, 64.0 MB/s 2024-04-25T09:09:48.567 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.567 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.567 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162363 s, 64.6 MB/s 2024-04-25T09:09:48.588 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.588 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.588 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191327 s, 54.8 MB/s 2024-04-25T09:09:48.604 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.604 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.604 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139999 s, 74.9 MB/s 2024-04-25T09:09:48.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.622 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164692 s, 63.7 MB/s 2024-04-25T09:09:48.642 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.642 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.642 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182736 s, 57.4 MB/s 2024-04-25T09:09:48.662 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.662 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.662 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181135 s, 57.9 MB/s 2024-04-25T09:09:48.679 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.679 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.679 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156389 s, 67.0 MB/s 2024-04-25T09:09:48.697 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.697 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.698 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165711 s, 63.3 MB/s 2024-04-25T09:09:48.714 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.714 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.714 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142931 s, 73.4 MB/s 2024-04-25T09:09:48.732 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.732 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.732 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162853 s, 64.4 MB/s 2024-04-25T09:09:48.749 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.749 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.750 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160813 s, 65.2 MB/s 2024-04-25T09:09:48.767 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.767 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.767 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158425 s, 66.2 MB/s 2024-04-25T09:09:48.786 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.786 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.786 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017098 s, 61.3 MB/s 2024-04-25T09:09:48.803 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.803 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.803 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015149 s, 69.2 MB/s 2024-04-25T09:09:48.820 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.820 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.820 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146824 s, 71.4 MB/s 2024-04-25T09:09:48.835 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.835 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.836 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014198 s, 73.9 MB/s 2024-04-25T09:09:48.855 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.855 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.855 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177669 s, 59.0 MB/s 2024-04-25T09:09:48.872 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.872 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.872 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149585 s, 70.1 MB/s 2024-04-25T09:09:48.889 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.889 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.889 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150109 s, 69.9 MB/s 2024-04-25T09:09:48.906 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.907 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.907 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161549 s, 64.9 MB/s 2024-04-25T09:09:48.926 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.927 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.927 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018269 s, 57.4 MB/s 2024-04-25T09:09:48.943 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.943 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.943 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146504 s, 71.6 MB/s 2024-04-25T09:09:48.959 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.959 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.959 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144796 s, 72.4 MB/s 2024-04-25T09:09:48.975 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.975 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.975 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014449 s, 72.6 MB/s 2024-04-25T09:09:48.993 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:48.993 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:48.993 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158045 s, 66.3 MB/s 2024-04-25T09:09:49.017 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.017 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.017 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222265 s, 47.2 MB/s 2024-04-25T09:09:49.035 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.035 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.035 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165996 s, 63.2 MB/s 2024-04-25T09:09:49.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:49.037 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:49.037 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:49.037 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.17 2024-04-25T09:09:49.037 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:49.037 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:49.037 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:49.037 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:49.107 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.107 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.107 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165543 s, 63.3 MB/s 2024-04-25T09:09:49.132 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.132 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.132 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022971 s, 45.6 MB/s 2024-04-25T09:09:49.148 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.148 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146706 s, 71.5 MB/s 2024-04-25T09:09:49.165 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.165 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.165 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143845 s, 72.9 MB/s 2024-04-25T09:09:49.185 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.185 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.185 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188191 s, 55.7 MB/s 2024-04-25T09:09:49.202 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.202 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.202 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145411 s, 72.1 MB/s 2024-04-25T09:09:49.218 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.218 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.218 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141183 s, 74.3 MB/s 2024-04-25T09:09:49.233 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.234 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.234 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140841 s, 74.5 MB/s 2024-04-25T09:09:49.259 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.259 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.259 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231896 s, 45.2 MB/s 2024-04-25T09:09:49.279 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.279 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.279 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186625 s, 56.2 MB/s 2024-04-25T09:09:49.296 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.296 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.297 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155019 s, 67.6 MB/s 2024-04-25T09:09:49.313 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.314 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.314 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150673 s, 69.6 MB/s 2024-04-25T09:09:49.337 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.337 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.337 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214867 s, 48.8 MB/s 2024-04-25T09:09:49.355 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.355 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.355 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016473 s, 63.7 MB/s 2024-04-25T09:09:49.374 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.374 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.374 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173922 s, 60.3 MB/s 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185003 s, 56.7 MB/s 2024-04-25T09:09:49.411 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.411 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.411 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148782 s, 70.5 MB/s 2024-04-25T09:09:49.429 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.429 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.429 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155004 s, 67.6 MB/s 2024-04-25T09:09:49.445 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.445 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.445 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144155 s, 72.7 MB/s 2024-04-25T09:09:49.461 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.461 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.461 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143778 s, 72.9 MB/s 2024-04-25T09:09:49.477 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.477 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.477 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142927 s, 73.4 MB/s 2024-04-25T09:09:49.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.497 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182201 s, 57.6 MB/s 2024-04-25T09:09:49.516 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.516 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.516 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171679 s, 61.1 MB/s 2024-04-25T09:09:49.533 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.534 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.534 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152874 s, 68.6 MB/s 2024-04-25T09:09:49.550 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.550 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.550 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014696 s, 71.4 MB/s 2024-04-25T09:09:49.565 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.566 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.566 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014016 s, 74.8 MB/s 2024-04-25T09:09:49.587 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.587 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.587 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194656 s, 53.9 MB/s 2024-04-25T09:09:49.604 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.604 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.604 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150367 s, 69.7 MB/s 2024-04-25T09:09:49.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.622 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163713 s, 64.0 MB/s 2024-04-25T09:09:49.638 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.638 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.638 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146467 s, 71.6 MB/s 2024-04-25T09:09:49.657 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.657 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.657 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171402 s, 61.2 MB/s 2024-04-25T09:09:49.675 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.675 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.675 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161993 s, 64.7 MB/s 2024-04-25T09:09:49.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:49.677 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:49.677 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:49.677 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.18 2024-04-25T09:09:49.677 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:49.677 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:49.677 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:49.677 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:49.745 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.745 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.745 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139168 s, 75.3 MB/s 2024-04-25T09:09:49.762 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.762 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.762 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151376 s, 69.3 MB/s 2024-04-25T09:09:49.779 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.779 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.779 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154427 s, 67.9 MB/s 2024-04-25T09:09:49.795 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.795 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.795 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143818 s, 72.9 MB/s 2024-04-25T09:09:49.811 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.811 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.811 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014177 s, 74.0 MB/s 2024-04-25T09:09:49.833 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.833 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.833 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199585 s, 52.5 MB/s 2024-04-25T09:09:49.848 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.848 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.849 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138294 s, 75.8 MB/s 2024-04-25T09:09:49.862 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.862 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.862 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116184 s, 90.3 MB/s 2024-04-25T09:09:49.879 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.879 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.879 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154955 s, 67.7 MB/s 2024-04-25T09:09:49.897 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.897 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.897 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155338 s, 67.5 MB/s 2024-04-25T09:09:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165732 s, 63.3 MB/s 2024-04-25T09:09:49.933 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.933 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.933 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157881 s, 66.4 MB/s 2024-04-25T09:09:49.951 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.951 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.951 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164235 s, 63.8 MB/s 2024-04-25T09:09:49.975 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:49.975 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:49.976 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022669 s, 46.3 MB/s 2024-04-25T09:09:50.000 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.000 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.000 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229986 s, 45.6 MB/s 2024-04-25T09:09:50.018 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.018 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.019 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166207 s, 63.1 MB/s 2024-04-25T09:09:50.034 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.034 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.034 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141624 s, 74.0 MB/s 2024-04-25T09:09:50.054 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.054 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.054 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176984 s, 59.2 MB/s 2024-04-25T09:09:50.076 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.076 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.076 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020198 s, 51.9 MB/s 2024-04-25T09:09:50.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.097 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195533 s, 53.6 MB/s 2024-04-25T09:09:50.114 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.114 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.114 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149841 s, 70.0 MB/s 2024-04-25T09:09:50.131 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.131 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.131 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014944 s, 70.2 MB/s 2024-04-25T09:09:50.149 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.149 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.149 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165678 s, 63.3 MB/s 2024-04-25T09:09:50.166 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.166 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.166 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01472 s, 71.2 MB/s 2024-04-25T09:09:50.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.183 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155836 s, 67.3 MB/s 2024-04-25T09:09:50.198 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.199 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.199 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139157 s, 75.4 MB/s 2024-04-25T09:09:50.215 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.215 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.215 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149214 s, 70.3 MB/s 2024-04-25T09:09:50.231 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.231 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.231 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014054 s, 74.6 MB/s 2024-04-25T09:09:50.252 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.252 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.253 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194013 s, 54.0 MB/s 2024-04-25T09:09:50.272 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.272 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.272 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178174 s, 58.9 MB/s 2024-04-25T09:09:50.290 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.290 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.290 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165046 s, 63.5 MB/s 2024-04-25T09:09:50.306 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.306 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.306 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145237 s, 72.2 MB/s 2024-04-25T09:09:50.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:50.308 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:50.308 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:50.308 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.19 2024-04-25T09:09:50.308 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:50.308 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:50.308 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:50.308 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:50.381 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.381 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.381 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174685 s, 60.0 MB/s 2024-04-25T09:09:50.399 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.399 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.399 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161598 s, 64.9 MB/s 2024-04-25T09:09:50.415 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.415 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.415 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141885 s, 73.9 MB/s 2024-04-25T09:09:50.436 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.437 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.437 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196309 s, 53.4 MB/s 2024-04-25T09:09:50.453 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.453 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.453 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144627 s, 72.5 MB/s 2024-04-25T09:09:50.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.469 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142956 s, 73.3 MB/s 2024-04-25T09:09:50.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.484 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013599 s, 77.1 MB/s 2024-04-25T09:09:50.504 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.504 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.504 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178007 s, 58.9 MB/s 2024-04-25T09:09:50.523 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.523 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.523 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171439 s, 61.2 MB/s 2024-04-25T09:09:50.543 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.543 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.543 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180877 s, 58.0 MB/s 2024-04-25T09:09:50.561 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.561 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.561 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160749 s, 65.2 MB/s 2024-04-25T09:09:50.581 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.581 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.581 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185165 s, 56.6 MB/s 2024-04-25T09:09:50.597 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.597 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.597 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141428 s, 74.1 MB/s 2024-04-25T09:09:50.613 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.614 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.614 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145488 s, 72.1 MB/s 2024-04-25T09:09:50.630 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.630 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.630 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014538 s, 72.1 MB/s 2024-04-25T09:09:50.648 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.648 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.648 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163404 s, 64.2 MB/s 2024-04-25T09:09:50.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.665 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148604 s, 70.6 MB/s 2024-04-25T09:09:50.685 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.686 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.686 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189426 s, 55.4 MB/s 2024-04-25T09:09:50.704 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.704 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.704 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169601 s, 61.8 MB/s 2024-04-25T09:09:50.721 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.721 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.721 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153476 s, 68.3 MB/s 2024-04-25T09:09:50.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.739 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157547 s, 66.6 MB/s 2024-04-25T09:09:50.756 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.756 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.756 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150191 s, 69.8 MB/s 2024-04-25T09:09:50.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.777 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198557 s, 52.8 MB/s 2024-04-25T09:09:50.798 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.798 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.798 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190024 s, 55.2 MB/s 2024-04-25T09:09:50.815 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.815 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.815 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151179 s, 69.4 MB/s 2024-04-25T09:09:50.833 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.833 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.833 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155322 s, 67.5 MB/s 2024-04-25T09:09:50.851 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.851 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.851 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167181 s, 62.7 MB/s 2024-04-25T09:09:50.868 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.868 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.868 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150558 s, 69.6 MB/s 2024-04-25T09:09:50.887 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.888 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.888 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017719 s, 59.2 MB/s 2024-04-25T09:09:50.910 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.910 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.910 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020674 s, 50.7 MB/s 2024-04-25T09:09:50.927 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.927 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.927 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152044 s, 69.0 MB/s 2024-04-25T09:09:50.948 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:50.948 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:50.948 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019261 s, 54.4 MB/s 2024-04-25T09:09:50.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:50.950 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:50.950 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:50.950 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.20 2024-04-25T09:09:50.950 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:50.950 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:50.950 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:50.950 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:51.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.022 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151244 s, 69.3 MB/s 2024-04-25T09:09:51.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.042 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018048 s, 58.1 MB/s 2024-04-25T09:09:51.065 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.065 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.065 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021543 s, 48.7 MB/s 2024-04-25T09:09:51.084 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.084 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.084 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172951 s, 60.6 MB/s 2024-04-25T09:09:51.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.101 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147736 s, 71.0 MB/s 2024-04-25T09:09:51.116 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.116 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.116 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139262 s, 75.3 MB/s 2024-04-25T09:09:51.134 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.134 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.134 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157056 s, 66.8 MB/s 2024-04-25T09:09:51.151 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.151 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.151 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153673 s, 68.2 MB/s 2024-04-25T09:09:51.169 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.169 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.169 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016219 s, 64.7 MB/s 2024-04-25T09:09:51.188 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.188 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.188 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169572 s, 61.8 MB/s 2024-04-25T09:09:51.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.207 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168078 s, 62.4 MB/s 2024-04-25T09:09:51.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.222 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140977 s, 74.4 MB/s 2024-04-25T09:09:51.238 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.238 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.238 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141521 s, 74.1 MB/s 2024-04-25T09:09:51.255 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.255 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.255 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147326 s, 71.2 MB/s 2024-04-25T09:09:51.271 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.271 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.271 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146486 s, 71.6 MB/s 2024-04-25T09:09:51.288 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.288 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.288 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151521 s, 69.2 MB/s 2024-04-25T09:09:51.307 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.307 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.307 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168809 s, 62.1 MB/s 2024-04-25T09:09:51.332 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.332 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.332 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233347 s, 44.9 MB/s 2024-04-25T09:09:51.350 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.350 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.350 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163836 s, 64.0 MB/s 2024-04-25T09:09:51.373 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.373 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.373 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210465 s, 49.8 MB/s 2024-04-25T09:09:51.389 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.389 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.389 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142916 s, 73.4 MB/s 2024-04-25T09:09:51.407 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.407 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.407 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163289 s, 64.2 MB/s 2024-04-25T09:09:51.424 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.424 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.424 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144864 s, 72.4 MB/s 2024-04-25T09:09:51.439 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.440 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.440 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140126 s, 74.8 MB/s 2024-04-25T09:09:51.458 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.458 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.458 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166556 s, 63.0 MB/s 2024-04-25T09:09:51.478 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.478 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.479 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186057 s, 56.4 MB/s 2024-04-25T09:09:51.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.497 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165173 s, 63.5 MB/s 2024-04-25T09:09:51.518 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.518 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.518 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191324 s, 54.8 MB/s 2024-04-25T09:09:51.534 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.535 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.535 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150909 s, 69.5 MB/s 2024-04-25T09:09:51.551 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.551 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.551 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01471 s, 71.3 MB/s 2024-04-25T09:09:51.569 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.569 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.569 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158424 s, 66.2 MB/s 2024-04-25T09:09:51.587 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.587 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.587 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160156 s, 65.5 MB/s 2024-04-25T09:09:51.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:51.588 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:51.588 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:51.588 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.21 2024-04-25T09:09:51.588 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:51.589 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:51.589 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:51.589 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:51.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.661 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140567 s, 74.6 MB/s 2024-04-25T09:09:51.682 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.682 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.682 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190219 s, 55.1 MB/s 2024-04-25T09:09:51.701 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.701 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.701 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144389 s, 72.6 MB/s 2024-04-25T09:09:51.718 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.718 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.718 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175501 s, 59.7 MB/s 2024-04-25T09:09:51.737 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.737 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.737 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177183 s, 59.2 MB/s 2024-04-25T09:09:51.762 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.762 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.762 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225037 s, 46.6 MB/s 2024-04-25T09:09:51.778 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.779 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.779 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152992 s, 68.5 MB/s 2024-04-25T09:09:51.795 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.796 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.796 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148361 s, 70.7 MB/s 2024-04-25T09:09:51.812 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.812 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.812 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014866 s, 70.5 MB/s 2024-04-25T09:09:51.828 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.828 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.828 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141872 s, 73.9 MB/s 2024-04-25T09:09:51.844 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.844 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.844 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142344 s, 73.7 MB/s 2024-04-25T09:09:51.861 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.861 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.861 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015261 s, 68.7 MB/s 2024-04-25T09:09:51.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.882 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018877 s, 55.5 MB/s 2024-04-25T09:09:51.898 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.898 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.899 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151701 s, 69.1 MB/s 2024-04-25T09:09:51.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.912 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119099 s, 88.0 MB/s 2024-04-25T09:09:51.926 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.926 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.926 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121272 s, 86.5 MB/s 2024-04-25T09:09:51.943 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.943 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.943 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143648 s, 73.0 MB/s 2024-04-25T09:09:51.966 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.966 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.966 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219052 s, 47.9 MB/s 2024-04-25T09:09:51.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:51.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:51.987 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191227 s, 54.8 MB/s 2024-04-25T09:09:52.005 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.005 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.005 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153976 s, 68.1 MB/s 2024-04-25T09:09:52.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.022 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151275 s, 69.3 MB/s 2024-04-25T09:09:52.039 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.040 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.040 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156876 s, 66.8 MB/s 2024-04-25T09:09:52.057 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.058 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.058 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163107 s, 64.3 MB/s 2024-04-25T09:09:52.073 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.074 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.074 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143227 s, 73.2 MB/s 2024-04-25T09:09:52.090 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.090 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.090 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145542 s, 72.0 MB/s 2024-04-25T09:09:52.108 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.108 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.108 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166587 s, 62.9 MB/s 2024-04-25T09:09:52.126 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.127 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.127 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167171 s, 62.7 MB/s 2024-04-25T09:09:52.143 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.143 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.143 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145891 s, 71.9 MB/s 2024-04-25T09:09:52.159 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.159 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.159 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142832 s, 73.4 MB/s 2024-04-25T09:09:52.173 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.173 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.173 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121849 s, 86.1 MB/s 2024-04-25T09:09:52.189 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.190 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.190 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014584 s, 71.9 MB/s 2024-04-25T09:09:52.209 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.209 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.209 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179884 s, 58.3 MB/s 2024-04-25T09:09:52.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:52.211 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:52.211 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:52.211 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.22 2024-04-25T09:09:52.211 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:52.211 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:52.211 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:52.211 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:52.282 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.282 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.282 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014229 s, 73.7 MB/s 2024-04-25T09:09:52.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.298 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141879 s, 73.9 MB/s 2024-04-25T09:09:52.314 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.314 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.314 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139985 s, 74.9 MB/s 2024-04-25T09:09:52.334 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.334 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.334 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177582 s, 59.0 MB/s 2024-04-25T09:09:52.350 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.350 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.350 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147416 s, 71.1 MB/s 2024-04-25T09:09:52.367 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.367 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.367 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147867 s, 70.9 MB/s 2024-04-25T09:09:52.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.386 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175478 s, 59.8 MB/s 2024-04-25T09:09:52.399 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.399 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.399 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116862 s, 89.7 MB/s 2024-04-25T09:09:52.416 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.416 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.416 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148561 s, 70.6 MB/s 2024-04-25T09:09:52.432 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.432 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.432 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142482 s, 73.6 MB/s 2024-04-25T09:09:52.454 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.455 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.455 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206574 s, 50.8 MB/s 2024-04-25T09:09:52.479 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.479 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.479 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223545 s, 46.9 MB/s 2024-04-25T09:09:52.495 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.495 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.495 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145331 s, 72.2 MB/s 2024-04-25T09:09:52.515 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.515 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.515 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179649 s, 58.4 MB/s 2024-04-25T09:09:52.532 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.532 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.532 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157445 s, 66.6 MB/s 2024-04-25T09:09:52.549 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.549 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.549 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151461 s, 69.2 MB/s 2024-04-25T09:09:52.571 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.571 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.571 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203079 s, 51.6 MB/s 2024-04-25T09:09:52.587 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.587 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.587 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139976 s, 74.9 MB/s 2024-04-25T09:09:52.608 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.608 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.608 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197126 s, 53.2 MB/s 2024-04-25T09:09:52.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.624 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142141 s, 73.8 MB/s 2024-04-25T09:09:52.641 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.641 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.642 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154298 s, 68.0 MB/s 2024-04-25T09:09:52.657 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.658 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.658 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143736 s, 73.0 MB/s 2024-04-25T09:09:52.674 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.674 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.674 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146643 s, 71.5 MB/s 2024-04-25T09:09:52.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.690 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014544 s, 72.1 MB/s 2024-04-25T09:09:52.707 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.707 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.707 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150609 s, 69.6 MB/s 2024-04-25T09:09:52.724 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.724 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.724 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150682 s, 69.6 MB/s 2024-04-25T09:09:52.744 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.744 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.744 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175854 s, 59.6 MB/s 2024-04-25T09:09:52.763 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.763 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.763 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178192 s, 58.8 MB/s 2024-04-25T09:09:52.784 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.784 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.784 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191174 s, 54.8 MB/s 2024-04-25T09:09:52.800 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.801 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.801 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014831 s, 70.7 MB/s 2024-04-25T09:09:52.817 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.817 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.818 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150499 s, 69.7 MB/s 2024-04-25T09:09:52.840 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.840 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.841 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211255 s, 49.6 MB/s 2024-04-25T09:09:52.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:52.842 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:52.842 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:52.843 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.23 2024-04-25T09:09:52.843 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:52.843 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:52.843 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:52.843 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:52.919 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.919 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.919 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197232 s, 53.2 MB/s 2024-04-25T09:09:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147074 s, 71.3 MB/s 2024-04-25T09:09:52.957 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.958 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.958 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199841 s, 52.5 MB/s 2024-04-25T09:09:52.974 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.974 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.974 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145248 s, 72.2 MB/s 2024-04-25T09:09:52.989 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:52.990 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:52.990 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139151 s, 75.4 MB/s 2024-04-25T09:09:53.006 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.006 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.006 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142984 s, 73.3 MB/s 2024-04-25T09:09:53.023 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.023 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.023 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158138 s, 66.3 MB/s 2024-04-25T09:09:53.040 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.041 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.041 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153465 s, 68.3 MB/s 2024-04-25T09:09:53.061 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.061 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.061 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188397 s, 55.7 MB/s 2024-04-25T09:09:53.077 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.077 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.077 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137454 s, 76.3 MB/s 2024-04-25T09:09:53.093 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.093 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.093 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014106 s, 74.3 MB/s 2024-04-25T09:09:53.112 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.112 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.112 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175139 s, 59.9 MB/s 2024-04-25T09:09:53.130 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.130 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.130 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161038 s, 65.1 MB/s 2024-04-25T09:09:53.149 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.149 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.149 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177427 s, 59.1 MB/s 2024-04-25T09:09:53.168 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.168 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.168 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166191 s, 63.1 MB/s 2024-04-25T09:09:53.184 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.184 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.184 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145399 s, 72.1 MB/s 2024-04-25T09:09:53.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.206 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197334 s, 53.1 MB/s 2024-04-25T09:09:53.223 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.223 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.223 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154157 s, 68.0 MB/s 2024-04-25T09:09:53.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.240 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145397 s, 72.1 MB/s 2024-04-25T09:09:53.254 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.254 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.255 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136848 s, 76.6 MB/s 2024-04-25T09:09:53.272 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.272 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.272 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158183 s, 66.3 MB/s 2024-04-25T09:09:53.289 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.289 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.290 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154379 s, 67.9 MB/s 2024-04-25T09:09:53.306 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.306 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.306 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150794 s, 69.5 MB/s 2024-04-25T09:09:53.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.323 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148375 s, 70.7 MB/s 2024-04-25T09:09:53.344 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.345 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.345 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199528 s, 52.6 MB/s 2024-04-25T09:09:53.363 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.363 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.363 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169159 s, 62.0 MB/s 2024-04-25T09:09:53.382 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.382 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.382 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016793 s, 62.4 MB/s 2024-04-25T09:09:53.398 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.398 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.398 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140895 s, 74.4 MB/s 2024-04-25T09:09:53.415 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.415 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.415 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148252 s, 70.7 MB/s 2024-04-25T09:09:53.433 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.433 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.433 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164711 s, 63.7 MB/s 2024-04-25T09:09:53.448 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.449 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.449 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137768 s, 76.1 MB/s 2024-04-25T09:09:53.468 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.469 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181558 s, 57.8 MB/s 2024-04-25T09:09:53.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:53.470 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:53.470 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:53.470 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.24 2024-04-25T09:09:53.470 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:53.470 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:53.471 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:53.471 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:53.542 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.542 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.542 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151088 s, 69.4 MB/s 2024-04-25T09:09:53.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.559 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146797 s, 71.4 MB/s 2024-04-25T09:09:53.575 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.576 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148773 s, 70.5 MB/s 2024-04-25T09:09:53.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.592 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144703 s, 72.5 MB/s 2024-04-25T09:09:53.611 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.611 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.611 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170723 s, 61.4 MB/s 2024-04-25T09:09:53.625 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.625 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.625 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126107 s, 83.1 MB/s 2024-04-25T09:09:53.643 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.643 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.643 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163655 s, 64.1 MB/s 2024-04-25T09:09:53.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.661 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158887 s, 66.0 MB/s 2024-04-25T09:09:53.677 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.678 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.678 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150364 s, 69.7 MB/s 2024-04-25T09:09:53.695 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.695 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.695 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157745 s, 66.5 MB/s 2024-04-25T09:09:53.713 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.713 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.713 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159014 s, 65.9 MB/s 2024-04-25T09:09:53.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.731 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163978 s, 63.9 MB/s 2024-04-25T09:09:53.750 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.750 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.750 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178234 s, 58.8 MB/s 2024-04-25T09:09:53.773 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.774 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.774 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021442 s, 48.9 MB/s 2024-04-25T09:09:53.791 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.791 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.791 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155657 s, 67.4 MB/s 2024-04-25T09:09:53.809 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.809 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.809 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163436 s, 64.2 MB/s 2024-04-25T09:09:53.825 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.825 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.825 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146109 s, 71.8 MB/s 2024-04-25T09:09:53.846 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.846 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.846 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187367 s, 56.0 MB/s 2024-04-25T09:09:53.869 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.869 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.869 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209403 s, 50.1 MB/s 2024-04-25T09:09:53.890 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.890 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.890 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198462 s, 52.8 MB/s 2024-04-25T09:09:53.907 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.907 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.908 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153102 s, 68.5 MB/s 2024-04-25T09:09:53.925 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.925 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.925 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153945 s, 68.1 MB/s 2024-04-25T09:09:53.941 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.941 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.941 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143609 s, 73.0 MB/s 2024-04-25T09:09:53.960 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.960 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.960 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171535 s, 61.1 MB/s 2024-04-25T09:09:53.976 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.977 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.977 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146355 s, 71.6 MB/s 2024-04-25T09:09:53.993 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:53.993 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:53.993 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142363 s, 73.7 MB/s 2024-04-25T09:09:54.007 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.007 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.007 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122004 s, 85.9 MB/s 2024-04-25T09:09:54.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.025 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166661 s, 62.9 MB/s 2024-04-25T09:09:54.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.042 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147649 s, 71.0 MB/s 2024-04-25T09:09:54.059 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.059 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.059 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155825 s, 67.3 MB/s 2024-04-25T09:09:54.078 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.078 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.078 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017191 s, 61.0 MB/s 2024-04-25T09:09:54.099 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.099 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.099 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194108 s, 54.0 MB/s 2024-04-25T09:09:54.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:54.101 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:54.101 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:54.101 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.25 2024-04-25T09:09:54.101 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:54.101 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:54.101 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:54.101 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:54.171 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.171 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.171 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162061 s, 64.7 MB/s 2024-04-25T09:09:54.188 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.188 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.188 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155431 s, 67.5 MB/s 2024-04-25T09:09:54.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.206 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157799 s, 66.5 MB/s 2024-04-25T09:09:54.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.222 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144281 s, 72.7 MB/s 2024-04-25T09:09:54.238 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.238 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.238 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143842 s, 72.9 MB/s 2024-04-25T09:09:54.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.257 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017058 s, 61.5 MB/s 2024-04-25T09:09:54.276 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.276 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.276 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169113 s, 62.0 MB/s 2024-04-25T09:09:54.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.294 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164363 s, 63.8 MB/s 2024-04-25T09:09:54.312 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.312 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.312 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159499 s, 65.7 MB/s 2024-04-25T09:09:54.334 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.334 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.334 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204666 s, 51.2 MB/s 2024-04-25T09:09:54.355 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.355 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.355 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193873 s, 54.1 MB/s 2024-04-25T09:09:54.374 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.374 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.374 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170105 s, 61.6 MB/s 2024-04-25T09:09:54.390 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.390 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.390 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142237 s, 73.7 MB/s 2024-04-25T09:09:54.407 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.407 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.407 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152207 s, 68.9 MB/s 2024-04-25T09:09:54.424 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.424 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.424 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150592 s, 69.6 MB/s 2024-04-25T09:09:54.440 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.440 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.440 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143735 s, 73.0 MB/s 2024-04-25T09:09:54.456 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.456 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.456 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014073 s, 74.5 MB/s 2024-04-25T09:09:54.474 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.474 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.474 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160836 s, 65.2 MB/s 2024-04-25T09:09:54.495 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.495 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.495 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019349 s, 54.2 MB/s 2024-04-25T09:09:54.511 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.511 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.511 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139022 s, 75.4 MB/s 2024-04-25T09:09:54.531 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.531 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.531 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186667 s, 56.2 MB/s 2024-04-25T09:09:54.550 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.550 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.550 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166778 s, 62.9 MB/s 2024-04-25T09:09:54.567 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.567 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.567 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156414 s, 67.0 MB/s 2024-04-25T09:09:54.584 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.584 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.584 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150315 s, 69.8 MB/s 2024-04-25T09:09:54.603 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.603 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.603 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170316 s, 61.6 MB/s 2024-04-25T09:09:54.623 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.624 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190088 s, 55.2 MB/s 2024-04-25T09:09:54.645 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.645 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.645 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194985 s, 53.8 MB/s 2024-04-25T09:09:54.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.661 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143341 s, 73.2 MB/s 2024-04-25T09:09:54.683 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.684 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.684 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020823 s, 50.4 MB/s 2024-04-25T09:09:54.700 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.700 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.700 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146429 s, 71.6 MB/s 2024-04-25T09:09:54.716 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.717 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.717 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015055 s, 69.6 MB/s 2024-04-25T09:09:54.734 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.735 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.735 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160061 s, 65.5 MB/s 2024-04-25T09:09:54.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:54.736 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:54.736 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:54.736 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.26 2024-04-25T09:09:54.736 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:54.736 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:54.736 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:54.736 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:54.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.806 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148445 s, 70.6 MB/s 2024-04-25T09:09:54.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.821 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140229 s, 74.8 MB/s 2024-04-25T09:09:54.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.838 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151795 s, 69.1 MB/s 2024-04-25T09:09:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172542 s, 60.8 MB/s 2024-04-25T09:09:54.876 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.876 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.876 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170196 s, 61.6 MB/s 2024-04-25T09:09:54.894 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.894 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.894 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01564 s, 67.0 MB/s 2024-04-25T09:09:54.910 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.910 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.910 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145351 s, 72.1 MB/s 2024-04-25T09:09:54.926 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.926 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.926 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143321 s, 73.2 MB/s 2024-04-25T09:09:54.946 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.946 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.946 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176799 s, 59.3 MB/s 2024-04-25T09:09:54.965 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.965 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.965 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017501 s, 59.9 MB/s 2024-04-25T09:09:54.984 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.984 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.984 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167143 s, 62.7 MB/s 2024-04-25T09:09:54.999 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:54.999 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:54.999 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138757 s, 75.6 MB/s 2024-04-25T09:09:55.015 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.015 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.015 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014156 s, 74.1 MB/s 2024-04-25T09:09:55.034 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.034 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.034 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166906 s, 62.8 MB/s 2024-04-25T09:09:55.050 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.051 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.051 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149593 s, 70.1 MB/s 2024-04-25T09:09:55.066 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.067 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.067 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141816 s, 73.9 MB/s 2024-04-25T09:09:55.084 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.084 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.085 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160251 s, 65.4 MB/s 2024-04-25T09:09:55.104 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.104 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.104 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181696 s, 57.7 MB/s 2024-04-25T09:09:55.120 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.120 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.120 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139331 s, 75.3 MB/s 2024-04-25T09:09:55.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.137 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.137 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148604 s, 70.6 MB/s 2024-04-25T09:09:55.156 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.156 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.156 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017358 s, 60.4 MB/s 2024-04-25T09:09:55.173 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.173 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.174 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016035 s, 65.4 MB/s 2024-04-25T09:09:55.190 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.190 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.190 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142033 s, 73.8 MB/s 2024-04-25T09:09:55.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.206 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145877 s, 71.9 MB/s 2024-04-25T09:09:55.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.222 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014091 s, 74.4 MB/s 2024-04-25T09:09:55.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.241 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.241 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016818 s, 62.3 MB/s 2024-04-25T09:09:55.256 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.256 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.256 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137827 s, 76.1 MB/s 2024-04-25T09:09:55.274 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.274 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.274 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162757 s, 64.4 MB/s 2024-04-25T09:09:55.290 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.291 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.291 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144946 s, 72.3 MB/s 2024-04-25T09:09:55.309 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.309 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.309 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169001 s, 62.0 MB/s 2024-04-25T09:09:55.326 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.326 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.326 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151267 s, 69.3 MB/s 2024-04-25T09:09:55.342 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.342 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.342 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138578 s, 75.7 MB/s 2024-04-25T09:09:55.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:55.344 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:55.344 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:55.344 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.27 2024-04-25T09:09:55.344 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:55.344 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:55.344 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:55.344 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:55.414 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.415 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.415 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015364 s, 68.2 MB/s 2024-04-25T09:09:55.431 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.431 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.431 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014931 s, 70.2 MB/s 2024-04-25T09:09:55.447 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.447 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.447 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146221 s, 71.7 MB/s 2024-04-25T09:09:55.472 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.473 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.473 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234844 s, 44.6 MB/s 2024-04-25T09:09:55.489 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.489 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.489 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145099 s, 72.3 MB/s 2024-04-25T09:09:55.508 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.508 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.508 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173736 s, 60.4 MB/s 2024-04-25T09:09:55.524 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.525 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.525 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148898 s, 70.4 MB/s 2024-04-25T09:09:55.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.540 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137599 s, 76.2 MB/s 2024-04-25T09:09:55.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.556 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142795 s, 73.4 MB/s 2024-04-25T09:09:55.572 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.572 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.572 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140107 s, 74.8 MB/s 2024-04-25T09:09:55.589 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.589 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.589 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149769 s, 70.0 MB/s 2024-04-25T09:09:55.612 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.613 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.613 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217121 s, 48.3 MB/s 2024-04-25T09:09:55.629 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.629 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.629 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146518 s, 71.6 MB/s 2024-04-25T09:09:55.649 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.649 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.650 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184479 s, 56.8 MB/s 2024-04-25T09:09:55.666 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.666 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.666 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144401 s, 72.6 MB/s 2024-04-25T09:09:55.682 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.682 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.682 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141212 s, 74.3 MB/s 2024-04-25T09:09:55.701 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.701 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.701 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178249 s, 58.8 MB/s 2024-04-25T09:09:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147075 s, 71.3 MB/s 2024-04-25T09:09:55.734 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.735 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.735 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148613 s, 70.6 MB/s 2024-04-25T09:09:55.751 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.751 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.751 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149299 s, 70.2 MB/s 2024-04-25T09:09:55.767 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.767 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.767 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143848 s, 72.9 MB/s 2024-04-25T09:09:55.787 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.787 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.787 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175195 s, 59.9 MB/s 2024-04-25T09:09:55.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.805 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162571 s, 64.5 MB/s 2024-04-25T09:09:55.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.821 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145541 s, 72.0 MB/s 2024-04-25T09:09:55.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.838 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146465 s, 71.6 MB/s 2024-04-25T09:09:55.855 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.855 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.855 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153825 s, 68.2 MB/s 2024-04-25T09:09:55.872 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.872 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.872 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151186 s, 69.4 MB/s 2024-04-25T09:09:55.888 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.888 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.889 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01483 s, 70.7 MB/s 2024-04-25T09:09:55.905 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.905 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.905 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145708 s, 72.0 MB/s 2024-04-25T09:09:55.921 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.922 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.922 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148117 s, 70.8 MB/s 2024-04-25T09:09:55.938 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.938 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.938 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146348 s, 71.6 MB/s 2024-04-25T09:09:55.955 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:55.955 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:55.955 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147968 s, 70.9 MB/s 2024-04-25T09:09:55.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:55.956 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:55.956 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:55.956 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.28 2024-04-25T09:09:55.956 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:55.956 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:55.956 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:55.957 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143373 s, 73.1 MB/s 2024-04-25T09:09:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170575 s, 61.5 MB/s 2024-04-25T09:09:56.061 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.062 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.062 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157084 s, 66.8 MB/s 2024-04-25T09:09:56.078 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.078 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.078 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145847 s, 71.9 MB/s 2024-04-25T09:09:56.096 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.096 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.096 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163965 s, 64.0 MB/s 2024-04-25T09:09:56.112 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.112 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.112 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138948 s, 75.5 MB/s 2024-04-25T09:09:56.131 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.131 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.131 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174696 s, 60.0 MB/s 2024-04-25T09:09:56.152 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.152 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.153 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195442 s, 53.7 MB/s 2024-04-25T09:09:56.170 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.170 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.170 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153973 s, 68.1 MB/s 2024-04-25T09:09:56.190 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.190 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.190 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018924 s, 55.4 MB/s 2024-04-25T09:09:56.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.207 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143308 s, 73.2 MB/s 2024-04-25T09:09:56.225 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.225 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.225 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167155 s, 62.7 MB/s 2024-04-25T09:09:56.241 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.241 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.241 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144096 s, 72.8 MB/s 2024-04-25T09:09:56.259 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.259 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.259 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163658 s, 64.1 MB/s 2024-04-25T09:09:56.275 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.275 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.275 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143925 s, 72.9 MB/s 2024-04-25T09:09:56.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.294 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164495 s, 63.7 MB/s 2024-04-25T09:09:56.311 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.311 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.311 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155297 s, 67.5 MB/s 2024-04-25T09:09:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150325 s, 69.8 MB/s 2024-04-25T09:09:56.346 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.346 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.346 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167902 s, 62.5 MB/s 2024-04-25T09:09:56.369 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.369 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.369 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204637 s, 51.2 MB/s 2024-04-25T09:09:56.385 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.385 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.385 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142815 s, 73.4 MB/s 2024-04-25T09:09:56.402 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.402 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.402 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149937 s, 69.9 MB/s 2024-04-25T09:09:56.419 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.419 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.420 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160419 s, 65.4 MB/s 2024-04-25T09:09:56.436 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.436 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.436 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145474 s, 72.1 MB/s 2024-04-25T09:09:56.456 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.456 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.456 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184402 s, 56.9 MB/s 2024-04-25T09:09:56.475 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.475 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.476 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176675 s, 59.4 MB/s 2024-04-25T09:09:56.492 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.492 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.493 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153751 s, 68.2 MB/s 2024-04-25T09:09:56.511 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.511 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.511 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016226 s, 64.6 MB/s 2024-04-25T09:09:56.530 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.530 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.530 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017519 s, 59.9 MB/s 2024-04-25T09:09:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159386 s, 65.8 MB/s 2024-04-25T09:09:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168262 s, 62.3 MB/s 2024-04-25T09:09:56.585 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.585 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.585 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167728 s, 62.5 MB/s 2024-04-25T09:09:56.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:56.586 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:56.586 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:56.587 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.29 2024-04-25T09:09:56.587 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:56.587 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:56.587 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:56.587 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178567 s, 58.7 MB/s 2024-04-25T09:09:56.677 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.677 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.677 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145507 s, 72.1 MB/s 2024-04-25T09:09:56.694 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.695 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.695 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158228 s, 66.3 MB/s 2024-04-25T09:09:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.711 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.711 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014243 s, 73.6 MB/s 2024-04-25T09:09:56.728 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.728 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.728 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154355 s, 67.9 MB/s 2024-04-25T09:09:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142787 s, 73.4 MB/s 2024-04-25T09:09:56.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.766 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196784 s, 53.3 MB/s 2024-04-25T09:09:56.783 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.783 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.783 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015898 s, 66.0 MB/s 2024-04-25T09:09:56.800 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.800 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.800 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149673 s, 70.1 MB/s 2024-04-25T09:09:56.816 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.817 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.817 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147467 s, 71.1 MB/s 2024-04-25T09:09:56.833 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.833 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.833 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147447 s, 71.1 MB/s 2024-04-25T09:09:56.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.858 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225583 s, 46.5 MB/s 2024-04-25T09:09:56.874 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.874 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.874 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142824 s, 73.4 MB/s 2024-04-25T09:09:56.896 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.896 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.897 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206894 s, 50.7 MB/s 2024-04-25T09:09:56.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.912 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141973 s, 73.9 MB/s 2024-04-25T09:09:56.929 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.929 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.929 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149491 s, 70.1 MB/s 2024-04-25T09:09:56.947 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.947 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.947 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158628 s, 66.1 MB/s 2024-04-25T09:09:56.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.968 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191609 s, 54.7 MB/s 2024-04-25T09:09:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156943 s, 66.8 MB/s 2024-04-25T09:09:57.013 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.013 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.013 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024922 s, 42.1 MB/s 2024-04-25T09:09:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157335 s, 66.6 MB/s 2024-04-25T09:09:57.049 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.049 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.049 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164975 s, 63.6 MB/s 2024-04-25T09:09:57.067 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166001 s, 63.2 MB/s 2024-04-25T09:09:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.084 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141535 s, 74.1 MB/s 2024-04-25T09:09:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013909 s, 75.4 MB/s 2024-04-25T09:09:57.118 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.118 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.118 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169773 s, 61.8 MB/s 2024-04-25T09:09:57.142 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.142 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.142 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222172 s, 47.2 MB/s 2024-04-25T09:09:57.158 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.158 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.158 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139883 s, 75.0 MB/s 2024-04-25T09:09:57.174 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.174 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.174 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143293 s, 73.2 MB/s 2024-04-25T09:09:57.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.192 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166879 s, 62.8 MB/s 2024-04-25T09:09:57.208 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.209 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.209 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142734 s, 73.5 MB/s 2024-04-25T09:09:57.228 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.228 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.228 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177758 s, 59.0 MB/s 2024-04-25T09:09:57.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:57.230 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:57.230 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:57.230 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.30 2024-04-25T09:09:57.230 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:57.230 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:57.230 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:57.230 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:57.310 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.310 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.310 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184999 s, 56.7 MB/s 2024-04-25T09:09:57.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.323 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118599 s, 88.4 MB/s 2024-04-25T09:09:57.339 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.339 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.339 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142635 s, 73.5 MB/s 2024-04-25T09:09:57.357 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.357 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.357 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161545 s, 64.9 MB/s 2024-04-25T09:09:57.376 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.376 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.376 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169929 s, 61.7 MB/s 2024-04-25T09:09:57.394 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.395 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.395 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165253 s, 63.5 MB/s 2024-04-25T09:09:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152681 s, 68.7 MB/s 2024-04-25T09:09:57.428 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.428 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.428 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148365 s, 70.7 MB/s 2024-04-25T09:09:57.445 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.445 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.445 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015392 s, 68.1 MB/s 2024-04-25T09:09:57.462 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.462 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.462 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150028 s, 69.9 MB/s 2024-04-25T09:09:57.480 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.480 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.480 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166282 s, 63.1 MB/s 2024-04-25T09:09:57.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.497 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147525 s, 71.1 MB/s 2024-04-25T09:09:57.513 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.513 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.513 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144029 s, 72.8 MB/s 2024-04-25T09:09:57.529 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.530 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.530 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014223 s, 73.7 MB/s 2024-04-25T09:09:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161233 s, 65.0 MB/s 2024-04-25T09:09:57.565 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.566 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.566 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165694 s, 63.3 MB/s 2024-04-25T09:09:57.587 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.587 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.587 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197984 s, 53.0 MB/s 2024-04-25T09:09:57.603 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.603 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.603 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014281 s, 73.4 MB/s 2024-04-25T09:09:57.619 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.620 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.620 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144038 s, 72.8 MB/s 2024-04-25T09:09:57.636 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.636 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.636 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143552 s, 73.0 MB/s 2024-04-25T09:09:57.653 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.653 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.653 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151988 s, 69.0 MB/s 2024-04-25T09:09:57.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.667 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122042 s, 85.9 MB/s 2024-04-25T09:09:57.684 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.684 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.684 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152352 s, 68.8 MB/s 2024-04-25T09:09:57.704 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.704 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.704 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186438 s, 56.2 MB/s 2024-04-25T09:09:57.721 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.721 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.721 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148302 s, 70.7 MB/s 2024-04-25T09:09:57.734 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.734 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.735 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116437 s, 90.1 MB/s 2024-04-25T09:09:57.751 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.751 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.751 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147559 s, 71.1 MB/s 2024-04-25T09:09:57.773 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.773 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.773 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199656 s, 52.5 MB/s 2024-04-25T09:09:57.789 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.789 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.789 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014479 s, 72.4 MB/s 2024-04-25T09:09:57.810 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.810 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.810 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190335 s, 55.1 MB/s 2024-04-25T09:09:57.827 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.827 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.827 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154231 s, 68.0 MB/s 2024-04-25T09:09:57.844 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.844 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.844 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147204 s, 71.2 MB/s 2024-04-25T09:09:57.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:57.845 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:09:57.845 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:09:57.845 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.31 2024-04-25T09:09:57.845 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:09:57.845 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:09:57.846 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:09:57.846 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:09:57.917 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.917 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.917 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182884 s, 57.3 MB/s 2024-04-25T09:09:57.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.934 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155686 s, 67.4 MB/s 2024-04-25T09:09:57.955 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.955 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.955 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187133 s, 56.0 MB/s 2024-04-25T09:09:57.971 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.971 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.971 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143916 s, 72.9 MB/s 2024-04-25T09:09:57.988 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:57.988 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:57.988 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150017 s, 69.9 MB/s 2024-04-25T09:09:58.008 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.008 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.008 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182845 s, 57.3 MB/s 2024-04-25T09:09:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138218 s, 75.9 MB/s 2024-04-25T09:09:58.044 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.044 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.044 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185062 s, 56.7 MB/s 2024-04-25T09:09:58.059 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.060 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.060 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140487 s, 74.6 MB/s 2024-04-25T09:09:58.076 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.076 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.076 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146719 s, 71.5 MB/s 2024-04-25T09:09:58.096 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.096 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.096 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180164 s, 58.2 MB/s 2024-04-25T09:09:58.116 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.116 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.116 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177213 s, 59.2 MB/s 2024-04-25T09:09:58.135 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.135 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.135 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179789 s, 58.3 MB/s 2024-04-25T09:09:58.158 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.158 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.159 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215528 s, 48.7 MB/s 2024-04-25T09:09:58.175 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.175 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.175 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014691 s, 71.4 MB/s 2024-04-25T09:09:58.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.192 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154549 s, 67.8 MB/s 2024-04-25T09:09:58.211 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.211 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.211 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141933 s, 73.9 MB/s 2024-04-25T09:09:58.226 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.226 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.226 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154763 s, 67.8 MB/s 2024-04-25T09:09:58.242 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.242 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.242 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150126 s, 69.8 MB/s 2024-04-25T09:09:58.259 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.259 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.259 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145589 s, 72.0 MB/s 2024-04-25T09:09:58.278 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.278 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.278 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176253 s, 59.5 MB/s 2024-04-25T09:09:58.297 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.297 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.297 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171055 s, 61.3 MB/s 2024-04-25T09:09:58.313 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.313 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.313 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142656 s, 73.5 MB/s 2024-04-25T09:09:58.329 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.329 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.329 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140193 s, 74.8 MB/s 2024-04-25T09:09:58.345 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.345 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.346 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145563 s, 72.0 MB/s 2024-04-25T09:09:58.361 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.362 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.362 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145295 s, 72.2 MB/s 2024-04-25T09:09:58.381 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.381 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.381 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180137 s, 58.2 MB/s 2024-04-25T09:09:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168219 s, 62.3 MB/s 2024-04-25T09:09:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.421 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184152 s, 56.9 MB/s 2024-04-25T09:09:58.439 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.439 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.439 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169179 s, 62.0 MB/s 2024-04-25T09:09:58.464 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.464 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.464 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233787 s, 44.9 MB/s 2024-04-25T09:09:58.480 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:09:58.481 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:09:58.481 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148953 s, 70.4 MB/s 2024-04-25T09:09:58.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:58.482 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /scrub_control_test_path recursive 2024-04-25T09:09:58.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.676+0000 7efff4600640 1 Processor -- start 2024-04-25T09:09:58.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.676+0000 7efff4600640 1 -- start start 2024-04-25T09:09:58.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.680+0000 7efff4600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7effec0cc7e0 0x7effec0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.680+0000 7efff4600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effec0aef70 0x7effec0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.680+0000 7efff4600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec071570 con 0x7effec0aeb90 2024-04-25T09:09:58.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.680+0000 7efff4600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec071320 con 0x7effec0cc7e0 2024-04-25T09:09:58.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.680+0000 7efff4600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec072330 con 0x7effec0aef70 2024-04-25T09:09:58.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.680+0000 7efff2600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effec0aef70 0x7effec0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.680+0000 7efff1200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7effec0cc7e0 0x7effec0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.680+0000 7efff1200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7effec0cc7e0 0x7effec0cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:46740/0 (socket says 172.21.15.173:46740) 2024-04-25T09:09:58.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.680+0000 7efff1c00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7effec0aeb90 0x7effec0cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:46638/0 (socket says 172.21.15.173:46638) 2024-04-25T09:09:58.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.680+0000 7efff1200640 1 -- 172.21.15.173:0/352348761 learned_addr learned my addr 172.21.15.173:0/352348761 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:58.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.680+0000 7efff2600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effec0aef70 0x7effec0ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:47448/0 (socket says 172.21.15.173:47448) 2024-04-25T09:09:58.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.680+0000 7efff1200640 1 -- 172.21.15.173:0/352348761 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effec0aef70 msgr2=0x7effec0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.680+0000 7efff1200640 1 --2- 172.21.15.173:0/352348761 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effec0aef70 0x7effec0ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.680+0000 7efff1200640 1 -- 172.21.15.173:0/352348761 >> v1:172.21.15.194:6789/0 conn(0x7effec0aeb90 legacy=0x7effec0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.680+0000 7efff1200640 1 -- 172.21.15.173:0/352348761 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec071850 con 0x7effec0cc7e0 2024-04-25T09:09:58.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7efff1200640 1 --2- 172.21.15.173:0/352348761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effec0cc7e0 0x7effec0cdba0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7effd8009870 tx=0x7effd801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ed2813280f88e24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7effebe00640 1 -- 172.21.15.173:0/352348761 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd80b0070 con 0x7effec0cc7e0 2024-04-25T09:09:58.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7effebe00640 1 -- 172.21.15.173:0/352348761 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd80ab600 con 0x7effec0cc7e0 2024-04-25T09:09:58.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7effebe00640 1 -- 172.21.15.173:0/352348761 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd80ab9d0 con 0x7effec0cc7e0 2024-04-25T09:09:58.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7efff4600640 1 -- 172.21.15.173:0/352348761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effec0cc7e0 msgr2=0x7effec0cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7efff4600640 1 --2- 172.21.15.173:0/352348761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effec0cc7e0 0x7effec0cdba0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7effd8009870 tx=0x7effd801c360 comp rx=0 tx=0).stop 2024-04-25T09:09:58.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7efff4600640 1 -- 172.21.15.173:0/352348761 shutdown_connections 2024-04-25T09:09:58.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7efff4600640 1 --2- 172.21.15.173:0/352348761 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effec0aef70 0x7effec0ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7efff4600640 1 --2- 172.21.15.173:0/352348761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effec0cc7e0 0x7effec0cdba0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7efff4600640 1 -- 172.21.15.173:0/352348761 >> 172.21.15.173:0/352348761 conn(0x7effec06ac90 msgr2=0x7effec06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:58.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7efff4600640 1 -- 172.21.15.173:0/352348761 shutdown_connections 2024-04-25T09:09:58.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7efff4600640 1 -- 172.21.15.173:0/352348761 wait complete. 2024-04-25T09:09:58.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7efff4600640 1 Processor -- start 2024-04-25T09:09:58.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7efff4600640 1 -- start start 2024-04-25T09:09:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7efff4600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effec0aeb90 0x7effec148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7efff4600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effec0aef70 0x7effec14e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7efff4600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effec0cc7e0 0x7effec14a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7efff4600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec15bb30 con 0x7effec0aef70 2024-04-25T09:09:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7efff4600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec15b9b0 con 0x7effec0cc7e0 2024-04-25T09:09:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7efff4600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec15bcb0 con 0x7effec0aeb90 2024-04-25T09:09:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.684+0000 7efff1200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effec0aef70 0x7effec14e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7efff1200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effec0aef70 0x7effec14e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55716/0 (socket says 172.21.15.173:55716) 2024-04-25T09:09:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7efff1200640 1 -- 172.21.15.173:0/1222380155 learned_addr learned my addr 172.21.15.173:0/1222380155 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7efff2600640 1 --2- 172.21.15.173:0/1222380155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effec0cc7e0 0x7effec14a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7efff1c00640 1 --2- 172.21.15.173:0/1222380155 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effec0aeb90 0x7effec148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7efff1200640 1 -- 172.21.15.173:0/1222380155 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effec0aeb90 msgr2=0x7effec148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7efff1200640 1 --2- 172.21.15.173:0/1222380155 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effec0aeb90 0x7effec148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7efff1200640 1 -- 172.21.15.173:0/1222380155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effec0cc7e0 msgr2=0x7effec14a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7efff1200640 1 --2- 172.21.15.173:0/1222380155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effec0cc7e0 0x7effec14a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7efff1200640 1 -- 172.21.15.173:0/1222380155 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec150420 con 0x7effec0aef70 2024-04-25T09:09:58.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7efff1200640 1 --2- 172.21.15.173:0/1222380155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effec0aef70 0x7effec14e2f0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7effd801cc00 tx=0x7effd8019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7effe9600640 1 -- 172.21.15.173:0/1222380155 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd80b0040 con 0x7effec0aef70 2024-04-25T09:09:58.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7effe9600640 1 -- 172.21.15.173:0/1222380155 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd80b4420 con 0x7effec0aef70 2024-04-25T09:09:58.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7efff4600640 1 -- 172.21.15.173:0/1222380155 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effec150700 con 0x7effec0aef70 2024-04-25T09:09:58.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7effe9600640 1 -- 172.21.15.173:0/1222380155 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd80b4810 con 0x7effec0aef70 2024-04-25T09:09:58.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7efff4600640 1 -- 172.21.15.173:0/1222380155 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec150cc0 con 0x7effec0aef70 2024-04-25T09:09:58.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7effe9600640 1 -- 172.21.15.173:0/1222380155 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7effd80b49b0 con 0x7effec0aef70 2024-04-25T09:09:58.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7effe9600640 1 --2- 172.21.15.173:0/1222380155 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7effcc066f60 0x7effcc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7effe9600640 1 -- 172.21.15.173:0/1222380155 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7effd811ed20 con 0x7effec0aef70 2024-04-25T09:09:58.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.688+0000 7efff1c00640 1 --2- 172.21.15.173:0/1222380155 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7effcc066f60 0x7effcc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff7b43000 1 Processor -- start 2024-04-25T09:09:58.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff1c00640 1 --2- 172.21.15.173:0/1222380155 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7effcc066f60 0x7effcc069420 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7effe0000f70 tx=0x7effe0007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff7b43000 1 -- start start 2024-04-25T09:09:58.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff7b43000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a8924ab3f0 0x55a8924ab7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff7b43000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 0x55a892461fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff7b43000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a892462520 0x55a892462900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff7b43000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8922afd50 con 0x55a8924abd10 2024-04-25T09:09:58.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff7b43000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a892237e40 con 0x55a892462520 2024-04-25T09:09:58.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff7b43000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8922abdf0 con 0x55a8924ab3f0 2024-04-25T09:09:58.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff1200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 0x55a892461fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff1200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 0x55a892461fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55718/0 (socket says 172.21.15.173:55718) 2024-04-25T09:09:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff1200640 1 -- 172.21.15.173:0/498759266 learned_addr learned my addr 172.21.15.173:0/498759266 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff1200640 1 -- 172.21.15.173:0/498759266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a8924ab3f0 msgr2=0x55a8924ab7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff1200640 1 --2- 172.21.15.173:0/498759266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a8924ab3f0 0x55a8924ab7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff1200640 1 -- 172.21.15.173:0/498759266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a892462520 msgr2=0x55a892462900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff1200640 1 --2- 172.21.15.173:0/498759266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a892462520 0x55a892462900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff1200640 1 -- 172.21.15.173:0/498759266 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a89224cd90 con 0x55a8924abd10 2024-04-25T09:09:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff1200640 1 --2- 172.21.15.173:0/498759266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 0x55a892461fe0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7effd80f75f0 tx=0x7effd80ab600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11e93f3588f21c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7effde000640 1 -- 172.21.15.173:0/498759266 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd80f3560 con 0x55a8924abd10 2024-04-25T09:09:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7effde000640 1 -- 172.21.15.173:0/498759266 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd80f7b20 con 0x55a8924abd10 2024-04-25T09:09:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7effde000640 1 -- 172.21.15.173:0/498759266 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd80ebb30 con 0x55a8924abd10 2024-04-25T09:09:58.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff7b43000 1 -- 172.21.15.173:0/498759266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 msgr2=0x55a892461fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff7b43000 1 --2- 172.21.15.173:0/498759266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 0x55a892461fe0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7effd80f75f0 tx=0x7effd80ab600 comp rx=0 tx=0).stop 2024-04-25T09:09:58.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff7b43000 1 -- 172.21.15.173:0/498759266 shutdown_connections 2024-04-25T09:09:58.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff7b43000 1 --2- 172.21.15.173:0/498759266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a892462520 0x55a892462900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff7b43000 1 --2- 172.21.15.173:0/498759266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 0x55a892461fe0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff7b43000 1 --2- 172.21.15.173:0/498759266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a8924ab3f0 0x55a8924ab7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff7b43000 1 -- 172.21.15.173:0/498759266 >> 172.21.15.173:0/498759266 conn(0x55a89245e4d0 msgr2=0x55a8924608c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:58.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff7b43000 1 -- 172.21.15.173:0/498759266 shutdown_connections 2024-04-25T09:09:58.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.692+0000 7efff7b43000 1 -- 172.21.15.173:0/498759266 wait complete. 2024-04-25T09:09:58.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff7b43000 1 -- start start 2024-04-25T09:09:58.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff7b43000 1 Processor -- start 2024-04-25T09:09:58.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff7b43000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a892462520 0x55a8924674b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff7b43000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a8924ab3f0 0x55a892471000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff7b43000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a8924abd10 0x55a892471540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff7b43000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a892255610 con 0x55a892462520 2024-04-25T09:09:58.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff7b43000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a89226a9a0 con 0x55a8924abd10 2024-04-25T09:09:58.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff7b43000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8922b4380 con 0x55a8924ab3f0 2024-04-25T09:09:58.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff7b43000 10 client.0 _ll_register_callbacks cb 0x55a8923640d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:58.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff1c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a892462520 0x55a8924674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff1c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a892462520 0x55a8924674b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55724/0 (socket says 172.21.15.173:55724) 2024-04-25T09:09:58.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff1c00640 1 -- 172.21.15.173:0/703590946 learned_addr learned my addr 172.21.15.173:0/703590946 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:58.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff2600640 1 --2- 172.21.15.173:0/703590946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a8924abd10 0x55a892471540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff1200640 1 --2- 172.21.15.173:0/703590946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a8924ab3f0 0x55a892471000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff1c00640 1 -- 172.21.15.173:0/703590946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a8924ab3f0 msgr2=0x55a892471000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff1c00640 1 --2- 172.21.15.173:0/703590946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a8924ab3f0 0x55a892471000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff1c00640 1 -- 172.21.15.173:0/703590946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a8924abd10 msgr2=0x55a892471540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff1c00640 1 --2- 172.21.15.173:0/703590946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a8924abd10 0x55a892471540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff1c00640 1 -- 172.21.15.173:0/703590946 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a8922aad40 con 0x55a892462520 2024-04-25T09:09:58.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff1c00640 1 --2- 172.21.15.173:0/703590946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a892462520 0x55a8924674b0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7effe00071b0 tx=0x7effe0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886684c0e3937a3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7effd2a00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:09:58.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7effd2a00640 1 -- 172.21.15.173:0/703590946 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0022420 con 0x55a892462520 2024-04-25T09:09:58.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7effd2a00640 1 -- 172.21.15.173:0/703590946 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7effe0023e00 con 0x55a892462520 2024-04-25T09:09:58.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff7b43000 1 -- 172.21.15.173:0/703590946 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7effd80f7b20 con 0x55a892462520 2024-04-25T09:09:58.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7effd2a00640 1 -- 172.21.15.173:0/703590946 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7effe00133f0 con 0x55a892462520 2024-04-25T09:09:58.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff7b43000 10 client.7920 fetch_fsmap learned FSMap version 65 2024-04-25T09:09:58.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff7b43000 1 -- 172.21.15.173:0/703590946 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x55a892332f00 con 0x55a892462520 2024-04-25T09:09:58.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7effd2a00640 1 -- 172.21.15.173:0/703590946 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd80f7b20 con 0x55a892462520 2024-04-25T09:09:58.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7effd2a00640 1 -- 172.21.15.173:0/703590946 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7effe002a050 con 0x55a892462520 2024-04-25T09:09:58.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff7b43000 10 client.7920 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:09:58.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff7b43000 10 client.7920 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:09:58.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff7b43000 20 client.7920 populate_metadata read hostname 'smithi173' 2024-04-25T09:09:58.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff7b43000 1 --2- 172.21.15.173:0/703590946 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55a8924be4c0 0x55a8924c08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff7b43000 4 client.7920 mds_command: new command op to 7743 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:58.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff7b43000 1 -- 172.21.15.173:0/703590946 --> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a89224ba20 con 0x55a8924be4c0 2024-04-25T09:09:58.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff1200640 1 --2- 172.21.15.173:0/703590946 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55a8924be4c0 0x55a8924c08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7efff1200640 1 --2- 172.21.15.173:0/703590946 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55a8924be4c0 0x55a8924c08b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=892d7cffee1f7a41 server_cookie=f29869e01e4005ba in_seq=0 out_seq=0 2024-04-25T09:09:58.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.696+0000 7effd2a00640 10 client.7920 ms_handle_connect on v2:172.21.15.173:6836/555490935 2024-04-25T09:09:58.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.700+0000 7effd2a00640 1 -- 172.21.15.173:0/703590946 <== mds.0 v2:172.21.15.173:6836/555490935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a89224ba20 con 0x55a8924be4c0 2024-04-25T09:09:58.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.700+0000 7effd2a00640 10 client.7920 handle_command_reply: tid=0 2024-04-25T09:09:58.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.700+0000 7efff7b43000 1 client.7920 shutdown 2024-04-25T09:09:58.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.700+0000 7efff7b43000 1 -- 172.21.15.173:0/703590946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a892462520 msgr2=0x55a8924674b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.700+0000 7efff7b43000 1 --2- 172.21.15.173:0/703590946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a892462520 0x55a8924674b0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7effe00071b0 tx=0x7effe0000ee0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.700+0000 7efff7b43000 1 -- 172.21.15.173:0/703590946 shutdown_connections 2024-04-25T09:09:58.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.700+0000 7efff7b43000 1 --2- 172.21.15.173:0/703590946 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55a8924be4c0 0x55a8924c08b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.700+0000 7efff7b43000 1 --2- 172.21.15.173:0/703590946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a8924abd10 0x55a892471540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.700+0000 7efff7b43000 1 --2- 172.21.15.173:0/703590946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a8924ab3f0 0x55a892471000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.700+0000 7efff7b43000 1 --2- 172.21.15.173:0/703590946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a892462520 0x55a8924674b0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.700+0000 7effd2a00640 0 client.7920 ms_handle_reset on v2:172.21.15.173:6836/555490935 2024-04-25T09:09:58.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.700+0000 7efff7b43000 1 -- 172.21.15.173:0/703590946 >> 172.21.15.173:0/703590946 conn(0x55a89245e4d0 msgr2=0x55a892461150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:58.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.700+0000 7efff7b43000 1 -- 172.21.15.173:0/703590946 shutdown_connections 2024-04-25T09:09:58.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.700+0000 7efff7b43000 1 -- 172.21.15.173:0/703590946 wait complete. 2024-04-25T09:09:58.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.700+0000 7efff7b43000 20 client.7920 trim_cache size 0 max 16384 2024-04-25T09:09:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.712+0000 7efff7b43000 1 Processor -- start 2024-04-25T09:09:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.712+0000 7efff7b43000 1 -- start start 2024-04-25T09:09:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff7b43000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a892462520 0x55a8924618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff7b43000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a8924ab3f0 0x55a892461e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff7b43000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 0x55a8924c08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff7b43000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec1fee60 con 0x55a8924abd10 2024-04-25T09:09:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff7b43000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec1fe060 con 0x55a8924ab3f0 2024-04-25T09:09:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff7b43000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec152930 con 0x55a892462520 2024-04-25T09:09:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff2600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 0x55a8924c08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff2600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 0x55a8924c08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55732/0 (socket says 172.21.15.173:55732) 2024-04-25T09:09:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff2600640 1 -- 172.21.15.173:0/4010133042 learned_addr learned my addr 172.21.15.173:0/4010133042 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff2600640 1 -- 172.21.15.173:0/4010133042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a892462520 msgr2=0x55a8924618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff2600640 1 --2- 172.21.15.173:0/4010133042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a892462520 0x55a8924618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff2600640 1 -- 172.21.15.173:0/4010133042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a8924ab3f0 msgr2=0x55a892461e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff2600640 1 --2- 172.21.15.173:0/4010133042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a8924ab3f0 0x55a892461e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff2600640 1 -- 172.21.15.173:0/4010133042 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a892309330 con 0x55a8924abd10 2024-04-25T09:09:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff2600640 1 --2- 172.21.15.173:0/4010133042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 0x55a8924c08b0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7effe40146b0 tx=0x7effe4014b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d946c16a052a2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7effdd600640 1 -- 172.21.15.173:0/4010133042 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe401b020 con 0x55a8924abd10 2024-04-25T09:09:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7effdd600640 1 -- 172.21.15.173:0/4010133042 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe4014e80 con 0x55a8924abd10 2024-04-25T09:09:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7effdd600640 1 -- 172.21.15.173:0/4010133042 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe4003bc0 con 0x55a8924abd10 2024-04-25T09:09:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff7b43000 1 -- 172.21.15.173:0/4010133042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 msgr2=0x55a8924c08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff7b43000 1 --2- 172.21.15.173:0/4010133042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 0x55a8924c08b0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7effe40146b0 tx=0x7effe4014b70 comp rx=0 tx=0).stop 2024-04-25T09:09:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff7b43000 1 -- 172.21.15.173:0/4010133042 shutdown_connections 2024-04-25T09:09:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff7b43000 1 --2- 172.21.15.173:0/4010133042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 0x55a8924c08b0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff7b43000 1 --2- 172.21.15.173:0/4010133042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a8924ab3f0 0x55a892461e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff7b43000 1 --2- 172.21.15.173:0/4010133042 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a892462520 0x55a8924618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff7b43000 1 -- 172.21.15.173:0/4010133042 >> 172.21.15.173:0/4010133042 conn(0x55a89245e4d0 msgr2=0x55a892467180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff7b43000 1 -- 172.21.15.173:0/4010133042 shutdown_connections 2024-04-25T09:09:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff7b43000 1 -- 172.21.15.173:0/4010133042 wait complete. 2024-04-25T09:09:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff7b43000 1 -- start start 2024-04-25T09:09:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.716+0000 7efff7b43000 1 Processor -- start 2024-04-25T09:09:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff7b43000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a892462520 0x55a89250cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff7b43000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a8924ab3f0 0x55a89250d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff7b43000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 0x55a89250d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff7b43000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a892266dc0 con 0x55a8924abd10 2024-04-25T09:09:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff7b43000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec1fdbe0 con 0x55a8924ab3f0 2024-04-25T09:09:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff7b43000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8922af060 con 0x55a892462520 2024-04-25T09:09:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff7b43000 10 client.0 _ll_register_callbacks cb 0x7effd80eb760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff2600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 0x55a89250d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff2600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 0x55a89250d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55748/0 (socket says 172.21.15.173:55748) 2024-04-25T09:09:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff2600640 1 -- 172.21.15.173:0/4248888208 learned_addr learned my addr 172.21.15.173:0/4248888208 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff1200640 1 --2- 172.21.15.173:0/4248888208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a8924ab3f0 0x55a89250d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff1c00640 1 --2- 172.21.15.173:0/4248888208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a892462520 0x55a89250cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff2600640 1 -- 172.21.15.173:0/4248888208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a892462520 msgr2=0x55a89250cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff2600640 1 --2- 172.21.15.173:0/4248888208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a892462520 0x55a89250cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff2600640 1 -- 172.21.15.173:0/4248888208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a8924ab3f0 msgr2=0x55a89250d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff2600640 1 --2- 172.21.15.173:0/4248888208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a8924ab3f0 0x55a89250d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff2600640 1 -- 172.21.15.173:0/4248888208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a89227c5f0 con 0x55a8924abd10 2024-04-25T09:09:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff1200640 1 --2- 172.21.15.173:0/4248888208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a8924ab3f0 0x55a89250d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff2600640 1 --2- 172.21.15.173:0/4248888208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 0x55a89250d870 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x55a892342a10 tx=0x7effe4004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1f3a905a013d9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7effd2a00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:09:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7effd2a00640 1 -- 172.21.15.173:0/4248888208 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe4008c10 con 0x55a8924abd10 2024-04-25T09:09:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7effd2a00640 1 -- 172.21.15.173:0/4248888208 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7effe4008db0 con 0x55a8924abd10 2024-04-25T09:09:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff7b43000 1 -- 172.21.15.173:0/4248888208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8922bd290 con 0x55a8924abd10 2024-04-25T09:09:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7effd2a00640 1 -- 172.21.15.173:0/4248888208 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7effe4034050 con 0x55a8924abd10 2024-04-25T09:09:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff7b43000 10 client.7926 fetch_fsmap learned FSMap version 65 2024-04-25T09:09:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff7b43000 1 -- 172.21.15.173:0/4248888208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x55a892256fe0 con 0x55a8924abd10 2024-04-25T09:09:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7effd2a00640 1 -- 172.21.15.173:0/4248888208 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a8922bd290 con 0x55a8924abd10 2024-04-25T09:09:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7effd2a00640 1 -- 172.21.15.173:0/4248888208 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7effe4037020 con 0x55a8924abd10 2024-04-25T09:09:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff7b43000 10 client.7926 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:09:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff7b43000 10 client.7926 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:09:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff7b43000 20 client.7926 populate_metadata read hostname 'smithi173' 2024-04-25T09:09:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff7b43000 1 --2- 172.21.15.173:0/4248888208 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55a89250e200 0x55a8925187b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff7b43000 4 client.7926 mds_command: new command op to 7743 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-04-25T09:09:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff7b43000 1 -- 172.21.15.173:0/4248888208 --> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x55a8922b75e0 con 0x55a89250e200 2024-04-25T09:09:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff1c00640 1 --2- 172.21.15.173:0/4248888208 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55a89250e200 0x55a8925187b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7efff1c00640 1 --2- 172.21.15.173:0/4248888208 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55a89250e200 0x55a8925187b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3c216b487bc5760 server_cookie=c4b4e2706c2c1ea2 in_seq=0 out_seq=0 2024-04-25T09:09:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.720+0000 7effd2a00640 10 client.7926 ms_handle_connect on v2:172.21.15.173:6836/555490935 2024-04-25T09:09:58.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7effd2a00640 1 -- 172.21.15.173:0/4248888208 <== mds.0 v2:172.21.15.173:6836/555490935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a8922b75e0 con 0x55a89250e200 2024-04-25T09:09:58.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7effd2a00640 10 client.7926 handle_command_reply: tid=0 2024-04-25T09:09:58.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff7b43000 1 client.7926 shutdown 2024-04-25T09:09:58.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff7b43000 1 -- 172.21.15.173:0/4248888208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 msgr2=0x55a89250d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff7b43000 1 --2- 172.21.15.173:0/4248888208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 0x55a89250d870 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x55a892342a10 tx=0x7effe4004ac0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff7b43000 1 -- 172.21.15.173:0/4248888208 shutdown_connections 2024-04-25T09:09:58.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff7b43000 1 --2- 172.21.15.173:0/4248888208 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55a89250e200 0x55a8925187b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff7b43000 1 --2- 172.21.15.173:0/4248888208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8924abd10 0x55a89250d870 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff7b43000 1 --2- 172.21.15.173:0/4248888208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a8924ab3f0 0x55a89250d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff7b43000 1 --2- 172.21.15.173:0/4248888208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a892462520 0x55a89250cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff7b43000 1 -- 172.21.15.173:0/4248888208 >> 172.21.15.173:0/4248888208 conn(0x55a89245e4d0 msgr2=0x55a8924608c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:58.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7effd2a00640 0 client.7926 ms_handle_reset on v2:172.21.15.173:6836/555490935 2024-04-25T09:09:58.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff7b43000 1 -- 172.21.15.173:0/4248888208 shutdown_connections 2024-04-25T09:09:58.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff7b43000 1 -- 172.21.15.173:0/4248888208 wait complete. 2024-04-25T09:09:58.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff7b43000 20 client.7926 trim_cache size 0 max 16384 2024-04-25T09:09:58.714 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:09:58.714 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0, 2024-04-25T09:09:58.714 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_tag": "1a775209-fa19-4a0f-b156-5e5da99a1ee2", 2024-04-25T09:09:58.714 INFO:teuthology.orchestra.run.smithi173.stdout: "mode": "asynchronous" 2024-04-25T09:09:58.714 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:09:58.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff4600640 1 -- 172.21.15.173:0/1222380155 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7effcc066f60 msgr2=0x7effcc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff4600640 1 --2- 172.21.15.173:0/1222380155 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7effcc066f60 0x7effcc069420 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7effe0000f70 tx=0x7effe0007e30 comp rx=0 tx=0).stop 2024-04-25T09:09:58.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff4600640 1 -- 172.21.15.173:0/1222380155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effec0aef70 msgr2=0x7effec14e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff4600640 1 --2- 172.21.15.173:0/1222380155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effec0aef70 0x7effec14e2f0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7effd801cc00 tx=0x7effd8019100 comp rx=0 tx=0).stop 2024-04-25T09:09:58.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff4600640 1 -- 172.21.15.173:0/1222380155 shutdown_connections 2024-04-25T09:09:58.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff4600640 1 --2- 172.21.15.173:0/1222380155 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7effcc066f60 0x7effcc069420 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff4600640 1 --2- 172.21.15.173:0/1222380155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effec0cc7e0 0x7effec14a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff4600640 1 --2- 172.21.15.173:0/1222380155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effec0aef70 0x7effec14e2f0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff4600640 1 --2- 172.21.15.173:0/1222380155 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effec0aeb90 0x7effec148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff4600640 1 -- 172.21.15.173:0/1222380155 >> 172.21.15.173:0/1222380155 conn(0x7effec06ac90 msgr2=0x7effec15ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:58.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff4600640 1 -- 172.21.15.173:0/1222380155 shutdown_connections 2024-04-25T09:09:58.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.724+0000 7efff4600640 1 -- 172.21.15.173:0/1222380155 wait complete. 2024-04-25T09:09:58.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:58.738 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub abort 2024-04-25T09:09:58.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.928+0000 7f6cde600640 1 Processor -- start 2024-04-25T09:09:58.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.928+0000 7f6cde600640 1 -- start start 2024-04-25T09:09:58.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.932+0000 7f6cde600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cd806c4b0 0x7f6cd81689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.932+0000 7f6cde600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd80b1040 con 0x7f6cd809a160 2024-04-25T09:09:58.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.932+0000 7f6cde600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd806cab0 con 0x7f6cd815dbc0 2024-04-25T09:09:58.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.932+0000 7f6cde600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd80cfce0 con 0x7f6cd806c4b0 2024-04-25T09:09:58.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.932+0000 7f6ccfe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f6cd809a160 0x7f6cd806bda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:52802/0 (socket says 172.21.15.173:52802) 2024-04-25T09:09:58.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.932+0000 7f6ccfe00640 1 -- 172.21.15.173:0/2988136666 learned_addr learned my addr 172.21.15.173:0/2988136666 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:09:58.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.932+0000 7f6cddc00640 1 --2- 172.21.15.173:0/2988136666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cd806c4b0 0x7f6cd81689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.932+0000 7f6cd7e00640 1 -- 172.21.15.173:0/2988136666 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729688342 0 0) 0x7f6cc0001120 con 0x7f6cd809a160 2024-04-25T09:09:58.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.932+0000 7f6cd7e00640 1 -- 172.21.15.173:0/2988136666 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cbc003530 con 0x7f6cd809a160 2024-04-25T09:09:58.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.932+0000 7f6cd7e00640 1 -- 172.21.15.173:0/2988136666 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835644225 0 0) 0x7f6cd806cab0 con 0x7f6cd815dbc0 2024-04-25T09:09:58.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.932+0000 7f6cd7e00640 1 -- 172.21.15.173:0/2988136666 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cc0001120 con 0x7f6cd815dbc0 2024-04-25T09:09:58.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.932+0000 7f6cddc00640 1 -- 172.21.15.173:0/2988136666 >> v1:172.21.15.194:6789/0 conn(0x7f6cd815dbc0 legacy=0x7f6cd8099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.932+0000 7f6cddc00640 1 -- 172.21.15.173:0/2988136666 >> v1:172.21.15.173:6789/0 conn(0x7f6cd809a160 legacy=0x7f6cd806bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.932+0000 7f6cddc00640 1 -- 172.21.15.173:0/2988136666 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd806cd90 con 0x7f6cd806c4b0 2024-04-25T09:09:58.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.936+0000 7f6cddc00640 1 --2- 172.21.15.173:0/2988136666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cd806c4b0 0x7f6cd81689f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009dc0 tx=0x7f6cd001c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd54e55eabecb9dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.936+0000 7f6cd7e00640 1 -- 172.21.15.173:0/2988136666 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd00b2070 con 0x7f6cd806c4b0 2024-04-25T09:09:58.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.936+0000 7f6cd7e00640 1 -- 172.21.15.173:0/2988136666 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd00a5960 con 0x7f6cd806c4b0 2024-04-25T09:09:58.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.936+0000 7f6cd7e00640 1 -- 172.21.15.173:0/2988136666 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd00a5d10 con 0x7f6cd806c4b0 2024-04-25T09:09:58.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.936+0000 7f6cde600640 1 -- 172.21.15.173:0/2988136666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cd806c4b0 msgr2=0x7f6cd81689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.936+0000 7f6cde600640 1 --2- 172.21.15.173:0/2988136666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cd806c4b0 0x7f6cd81689f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009dc0 tx=0x7f6cd001c990 comp rx=0 tx=0).stop 2024-04-25T09:09:58.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.936+0000 7f6cde600640 1 -- 172.21.15.173:0/2988136666 shutdown_connections 2024-04-25T09:09:58.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.936+0000 7f6cde600640 1 --2- 172.21.15.173:0/2988136666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cd806c4b0 0x7f6cd81689f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.936+0000 7f6cde600640 1 -- 172.21.15.173:0/2988136666 >> 172.21.15.173:0/2988136666 conn(0x7f6cd80b31d0 msgr2=0x7f6cd80b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:58.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.936+0000 7f6cde600640 1 -- 172.21.15.173:0/2988136666 shutdown_connections 2024-04-25T09:09:58.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.936+0000 7f6cde600640 1 -- 172.21.15.173:0/2988136666 wait complete. 2024-04-25T09:09:58.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.936+0000 7f6cde600640 1 Processor -- start 2024-04-25T09:09:58.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.936+0000 7f6cde600640 1 -- start start 2024-04-25T09:09:58.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cde600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cd806c4b0 0x7f6cd8154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cde600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cd809a160 0x7f6cd80ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cde600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cd815dbc0 0x7f6cd80cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cde600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd816b8d0 con 0x7f6cd815dbc0 2024-04-25T09:09:58.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cde600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd816b750 con 0x7f6cd806c4b0 2024-04-25T09:09:58.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cde600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd816ba50 con 0x7f6cd809a160 2024-04-25T09:09:58.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cddc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cd815dbc0 0x7f6cd80cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cddc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cd815dbc0 0x7f6cd80cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55752/0 (socket says 172.21.15.173:55752) 2024-04-25T09:09:58.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cddc00640 1 -- 172.21.15.173:0/4201612086 learned_addr learned my addr 172.21.15.173:0/4201612086 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:58.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cdd200640 1 --2- 172.21.15.173:0/4201612086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cd806c4b0 0x7f6cd8154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6ccfe00640 1 --2- 172.21.15.173:0/4201612086 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cd809a160 0x7f6cd80ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cddc00640 1 -- 172.21.15.173:0/4201612086 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cd809a160 msgr2=0x7f6cd80ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cddc00640 1 --2- 172.21.15.173:0/4201612086 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cd809a160 0x7f6cd80ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cddc00640 1 -- 172.21.15.173:0/4201612086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cd806c4b0 msgr2=0x7f6cd8154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cddc00640 1 --2- 172.21.15.173:0/4201612086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cd806c4b0 0x7f6cd8154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cddc00640 1 -- 172.21.15.173:0/4201612086 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd80ae530 con 0x7f6cd815dbc0 2024-04-25T09:09:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cddc00640 1 --2- 172.21.15.173:0/4201612086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cd815dbc0 0x7f6cd80cd2a0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00b0040 tx=0x7f6cd0019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cd5600640 1 -- 172.21.15.173:0/4201612086 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd00b2050 con 0x7f6cd815dbc0 2024-04-25T09:09:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cd5600640 1 -- 172.21.15.173:0/4201612086 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd00be070 con 0x7f6cd815dbc0 2024-04-25T09:09:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cde600640 1 -- 172.21.15.173:0/4201612086 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd80ae810 con 0x7f6cd815dbc0 2024-04-25T09:09:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cd5600640 1 -- 172.21.15.173:0/4201612086 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd00ada90 con 0x7f6cd815dbc0 2024-04-25T09:09:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cde600640 1 -- 172.21.15.173:0/4201612086 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd80af2f0 con 0x7f6cd815dbc0 2024-04-25T09:09:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.940+0000 7f6cd5600640 1 -- 172.21.15.173:0/4201612086 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6cd00a5820 con 0x7f6cd815dbc0 2024-04-25T09:09:58.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6cd5600640 1 --2- 172.21.15.173:0/4201612086 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6cb4066f90 0x7f6cb4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6cd5600640 1 -- 172.21.15.173:0/4201612086 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6cd011fa50 con 0x7f6cd815dbc0 2024-04-25T09:09:58.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6cdd200640 1 --2- 172.21.15.173:0/4201612086 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6cb4066f90 0x7f6cb4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ce30e2000 1 Processor -- start 2024-04-25T09:09:58.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ce30e2000 1 -- start start 2024-04-25T09:09:58.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6cdd200640 1 --2- 172.21.15.173:0/4201612086 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6cb4066f90 0x7f6cb4069450 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80011f0 tx=0x7f6cc8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ce30e2000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c64a40 0x556804c64e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ce30e2000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c65360 0x556804c1f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ce30e2000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c1fd90 0x556804c20170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ce30e2000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556804b021f0 con 0x556804c65360 2024-04-25T09:09:58.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ce30e2000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556804a68e90 con 0x556804c1fd90 2024-04-25T09:09:58.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ce30e2000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568049f0f50 con 0x556804c64a40 2024-04-25T09:09:58.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ccfe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c65360 0x556804c1f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ccfe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c65360 0x556804c1f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55768/0 (socket says 172.21.15.173:55768) 2024-04-25T09:09:58.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ccfe00640 1 -- 172.21.15.173:0/1550462949 learned_addr learned my addr 172.21.15.173:0/1550462949 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:58.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6cddc00640 1 --2- 172.21.15.173:0/1550462949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c1fd90 0x556804c20170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6cdd200640 1 --2- 172.21.15.173:0/1550462949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c64a40 0x556804c64e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ccfe00640 1 -- 172.21.15.173:0/1550462949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c64a40 msgr2=0x556804c64e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ccfe00640 1 --2- 172.21.15.173:0/1550462949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c64a40 0x556804c64e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ccfe00640 1 -- 172.21.15.173:0/1550462949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c1fd90 msgr2=0x556804c20170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ccfe00640 1 --2- 172.21.15.173:0/1550462949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c1fd90 0x556804c20170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ccfe00640 1 -- 172.21.15.173:0/1550462949 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556804a408b0 con 0x556804c65360 2024-04-25T09:09:58.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6cddc00640 1 --2- 172.21.15.173:0/1550462949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c1fd90 0x556804c20170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:58.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ccfe00640 1 --2- 172.21.15.173:0/1550462949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c65360 0x556804c1f850 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00013c0 tx=0x7f6cc0007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ac641ffd129c3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ccd600640 1 -- 172.21.15.173:0/1550462949 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc001a070 con 0x556804c65360 2024-04-25T09:09:58.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ccd600640 1 -- 172.21.15.173:0/1550462949 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc0001a30 con 0x556804c65360 2024-04-25T09:09:58.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.944+0000 7f6ccd600640 1 -- 172.21.15.173:0/1550462949 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0005860 con 0x556804c65360 2024-04-25T09:09:58.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 1 -- 172.21.15.173:0/1550462949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c65360 msgr2=0x556804c1f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/1550462949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c65360 0x556804c1f850 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00013c0 tx=0x7f6cc0007410 comp rx=0 tx=0).stop 2024-04-25T09:09:58.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 1 -- 172.21.15.173:0/1550462949 shutdown_connections 2024-04-25T09:09:58.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/1550462949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c1fd90 0x556804c20170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/1550462949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c65360 0x556804c1f850 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/1550462949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c64a40 0x556804c64e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 1 -- 172.21.15.173:0/1550462949 >> 172.21.15.173:0/1550462949 conn(0x556804c1bd40 msgr2=0x556804c1e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:58.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 1 -- 172.21.15.173:0/1550462949 shutdown_connections 2024-04-25T09:09:58.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 1 -- 172.21.15.173:0/1550462949 wait complete. 2024-04-25T09:09:58.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 1 -- start start 2024-04-25T09:09:58.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 1 Processor -- start 2024-04-25T09:09:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c1fd90 0x556804c6c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c64a40 0x556804c6c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c65360 0x556804c25e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556804a23540 con 0x556804c64a40 2024-04-25T09:09:58.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556804a64f30 con 0x556804c65360 2024-04-25T09:09:58.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x556804c065b0 con 0x556804c1fd90 2024-04-25T09:09:58.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 10 client.0 _ll_register_callbacks cb 0x556804b1d180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:58.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ccfe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c64a40 0x556804c6c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6cdd200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c1fd90 0x556804c6c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6cddc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c65360 0x556804c25e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6cdd200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c1fd90 0x556804c6c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:47530/0 (socket says 172.21.15.173:47530) 2024-04-25T09:09:58.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6cdd200640 1 -- 172.21.15.173:0/3977250527 learned_addr learned my addr 172.21.15.173:0/3977250527 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:58.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ccfe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c64a40 0x556804c6c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55774/0 (socket says 172.21.15.173:55774) 2024-04-25T09:09:58.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6cdd200640 1 -- 172.21.15.173:0/3977250527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c65360 msgr2=0x556804c25e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6cdd200640 1 --2- 172.21.15.173:0/3977250527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c65360 0x556804c25e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6cdd200640 1 -- 172.21.15.173:0/3977250527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c64a40 msgr2=0x556804c6c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6cdd200640 1 --2- 172.21.15.173:0/3977250527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c64a40 0x556804c6c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6cdd200640 1 -- 172.21.15.173:0/3977250527 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568049f11a0 con 0x556804c1fd90 2024-04-25T09:09:58.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6cddc00640 1 --2- 172.21.15.173:0/3977250527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c65360 0x556804c25e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:58.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ccfe00640 1 --2- 172.21.15.173:0/3977250527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c64a40 0x556804c6c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:58.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6cdd200640 1 --2- 172.21.15.173:0/3977250527 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c1fd90 0x556804c6c1c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80146e0 tx=0x7f6cc8001160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9addb07535638cdd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6cc6000640 10 client.0 ms_handle_connect on v2:172.21.15.194:3301/0 2024-04-25T09:09:58.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6cc6000640 1 -- 172.21.15.173:0/3977250527 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8025020 con 0x556804c1fd90 2024-04-25T09:09:58.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6ce30e2000 1 -- 172.21.15.173:0/3977250527 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6cc0001a30 con 0x556804c1fd90 2024-04-25T09:09:58.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.948+0000 7f6cc6000640 1 -- 172.21.15.173:0/3977250527 <== mon.2 v2:172.21.15.194:3301/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6cc8013780 con 0x556804c1fd90 2024-04-25T09:09:58.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6cc6000640 1 -- 172.21.15.173:0/3977250527 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cc802f050 con 0x556804c1fd90 2024-04-25T09:09:58.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 10 client.6665 fetch_fsmap learned FSMap version 65 2024-04-25T09:09:58.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 1 -- 172.21.15.173:0/3977250527 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x556804aeb840 con 0x556804c1fd90 2024-04-25T09:09:58.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6cc6000640 1 -- 172.21.15.173:0/3977250527 <== mon.2 v2:172.21.15.194:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc0001a30 con 0x556804c1fd90 2024-04-25T09:09:58.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6cc6000640 1 -- 172.21.15.173:0/3977250527 <== mon.2 v2:172.21.15.194:3301/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6cc8032020 con 0x556804c1fd90 2024-04-25T09:09:58.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 10 client.6665 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:09:58.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 10 client.6665 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:09:58.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 20 client.6665 populate_metadata read hostname 'smithi173' 2024-04-25T09:09:58.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/3977250527 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x556804c26ba0 0x556804c26fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 4 client.6665 mds_command: new command op to 7743 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:58.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 1 -- 172.21.15.173:0/3977250527 --> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556804a04be0 con 0x556804c26ba0 2024-04-25T09:09:58.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ccfe00640 1 --2- 172.21.15.173:0/3977250527 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x556804c26ba0 0x556804c26fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ccfe00640 1 --2- 172.21.15.173:0/3977250527 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x556804c26ba0 0x556804c26fb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c358767bbc36cb10 server_cookie=254730cf348eb25f in_seq=0 out_seq=0 2024-04-25T09:09:58.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6cc6000640 10 client.6665 ms_handle_connect on v2:172.21.15.173:6836/555490935 2024-04-25T09:09:58.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6cc6000640 1 -- 172.21.15.173:0/3977250527 <== mds.0 v2:172.21.15.173:6836/555490935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556804a04be0 con 0x556804c26ba0 2024-04-25T09:09:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6cc6000640 10 client.6665 handle_command_reply: tid=0 2024-04-25T09:09:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 1 client.6665 shutdown 2024-04-25T09:09:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 1 -- 172.21.15.173:0/3977250527 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c1fd90 msgr2=0x556804c6c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/3977250527 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c1fd90 0x556804c6c1c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80146e0 tx=0x7f6cc8001160 comp rx=0 tx=0).stop 2024-04-25T09:09:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 1 -- 172.21.15.173:0/3977250527 shutdown_connections 2024-04-25T09:09:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/3977250527 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x556804c26ba0 0x556804c26fb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/3977250527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c65360 0x556804c25e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/3977250527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c64a40 0x556804c6c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/3977250527 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c1fd90 0x556804c6c1c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6cc6000640 0 client.6665 ms_handle_reset on v2:172.21.15.173:6836/555490935 2024-04-25T09:09:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 1 -- 172.21.15.173:0/3977250527 >> 172.21.15.173:0/3977250527 conn(0x556804c1bd40 msgr2=0x556804c1e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 1 -- 172.21.15.173:0/3977250527 shutdown_connections 2024-04-25T09:09:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 1 -- 172.21.15.173:0/3977250527 wait complete. 2024-04-25T09:09:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.952+0000 7f6ce30e2000 20 client.6665 trim_cache size 0 max 16384 2024-04-25T09:09:58.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6ce30e2000 1 Processor -- start 2024-04-25T09:09:58.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6ce30e2000 1 -- start start 2024-04-25T09:09:58.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6ce30e2000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c1fd90 0x556804c1e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6ce30e2000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c64a40 0x556804c1e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6ce30e2000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c65360 0x556804c1f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6ce30e2000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd8202fa0 con 0x556804c1fd90 2024-04-25T09:09:58.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6ce30e2000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd8202200 con 0x556804c64a40 2024-04-25T09:09:58.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6ce30e2000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd80b0560 con 0x556804c65360 2024-04-25T09:09:58.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6cdd200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c1fd90 0x556804c1e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6cdd200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c1fd90 0x556804c1e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55786/0 (socket says 172.21.15.173:55786) 2024-04-25T09:09:58.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6cdd200640 1 -- 172.21.15.173:0/2666333634 learned_addr learned my addr 172.21.15.173:0/2666333634 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:58.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6ccfe00640 1 --2- 172.21.15.173:0/2666333634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c64a40 0x556804c1e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6cddc00640 1 --2- 172.21.15.173:0/2666333634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c65360 0x556804c1f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6cdd200640 1 -- 172.21.15.173:0/2666333634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c65360 msgr2=0x556804c1f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6cdd200640 1 --2- 172.21.15.173:0/2666333634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c65360 0x556804c1f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6cdd200640 1 -- 172.21.15.173:0/2666333634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c64a40 msgr2=0x556804c1e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6cdd200640 1 --2- 172.21.15.173:0/2666333634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c64a40 0x556804c1e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6cdd200640 1 -- 172.21.15.173:0/2666333634 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556804ac2a10 con 0x556804c1fd90 2024-04-25T09:09:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6cdd200640 1 --2- 172.21.15.173:0/2666333634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c1fd90 0x556804c1e130 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80139c0 tx=0x7f6cc8021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8637b2364c4d7ad3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6cccc00640 1 -- 172.21.15.173:0/2666333634 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8025030 con 0x556804c1fd90 2024-04-25T09:09:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6cccc00640 1 -- 172.21.15.173:0/2666333634 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc801b070 con 0x556804c1fd90 2024-04-25T09:09:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6cccc00640 1 -- 172.21.15.173:0/2666333634 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8021640 con 0x556804c1fd90 2024-04-25T09:09:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6ce30e2000 1 -- 172.21.15.173:0/2666333634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c1fd90 msgr2=0x556804c1e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/2666333634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c1fd90 0x556804c1e130 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80139c0 tx=0x7f6cc8021000 comp rx=0 tx=0).stop 2024-04-25T09:09:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6ce30e2000 1 -- 172.21.15.173:0/2666333634 shutdown_connections 2024-04-25T09:09:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/2666333634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c65360 0x556804c1f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/2666333634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c64a40 0x556804c1e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/2666333634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c1fd90 0x556804c1e130 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6ce30e2000 1 -- 172.21.15.173:0/2666333634 >> 172.21.15.173:0/2666333634 conn(0x556804c1bd40 msgr2=0x556804c728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:58.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6ce30e2000 1 -- 172.21.15.173:0/2666333634 shutdown_connections 2024-04-25T09:09:58.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.968+0000 7f6ce30e2000 1 -- 172.21.15.173:0/2666333634 wait complete. 2024-04-25T09:09:58.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ce30e2000 1 -- start start 2024-04-25T09:09:58.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ce30e2000 1 Processor -- start 2024-04-25T09:09:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ce30e2000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c1fd90 0x556804c69aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ce30e2000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c64a40 0x556804c69fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ce30e2000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c65360 0x556804c6a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ce30e2000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556804a2c720 con 0x556804c64a40 2024-04-25T09:09:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ce30e2000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd80c9bc0 con 0x556804c65360 2024-04-25T09:09:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ce30e2000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x556804a64f30 con 0x556804c1fd90 2024-04-25T09:09:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ce30e2000 10 client.0 _ll_register_callbacks cb 0x556804a2ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ccfe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c64a40 0x556804c69fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ccfe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c64a40 0x556804c69fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55802/0 (socket says 172.21.15.173:55802) 2024-04-25T09:09:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ccfe00640 1 -- 172.21.15.173:0/138280497 learned_addr learned my addr 172.21.15.173:0/138280497 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6cdd200640 1 --2- 172.21.15.173:0/138280497 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c1fd90 0x556804c69aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6cddc00640 1 --2- 172.21.15.173:0/138280497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c65360 0x556804c6a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ccfe00640 1 -- 172.21.15.173:0/138280497 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c1fd90 msgr2=0x556804c69aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ccfe00640 1 --2- 172.21.15.173:0/138280497 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c1fd90 0x556804c69aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ccfe00640 1 -- 172.21.15.173:0/138280497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c65360 msgr2=0x556804c6a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ccfe00640 1 --2- 172.21.15.173:0/138280497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c65360 0x556804c6a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ccfe00640 1 -- 172.21.15.173:0/138280497 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568049fdb00 con 0x556804c64a40 2024-04-25T09:09:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ccfe00640 1 --2- 172.21.15.173:0/138280497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c64a40 0x556804c69fe0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0013000 tx=0x7f6cc0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8994acce5969b636 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6cc6000640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:09:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6cc6000640 1 -- 172.21.15.173:0/138280497 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc001a040 con 0x556804c64a40 2024-04-25T09:09:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6cc6000640 1 -- 172.21.15.173:0/138280497 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6cc0028d10 con 0x556804c64a40 2024-04-25T09:09:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ce30e2000 1 -- 172.21.15.173:0/138280497 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6cc801b070 con 0x556804c64a40 2024-04-25T09:09:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6cc6000640 1 -- 172.21.15.173:0/138280497 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cc0036050 con 0x556804c64a40 2024-04-25T09:09:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ce30e2000 10 client.7944 fetch_fsmap learned FSMap version 65 2024-04-25T09:09:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ce30e2000 1 -- 172.21.15.173:0/138280497 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x556804a0ff80 con 0x556804c64a40 2024-04-25T09:09:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6cc6000640 1 -- 172.21.15.173:0/138280497 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc801b070 con 0x556804c64a40 2024-04-25T09:09:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6cc6000640 1 -- 172.21.15.173:0/138280497 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6cc0039020 con 0x556804c64a40 2024-04-25T09:09:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ce30e2000 10 client.7944 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:09:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ce30e2000 10 client.7944 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:09:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ce30e2000 20 client.7944 populate_metadata read hostname 'smithi173' 2024-04-25T09:09:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/138280497 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x556804ccacd0 0x556804ccd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ce30e2000 4 client.7944 mds_command: new command op to 7743 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-04-25T09:09:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6ce30e2000 1 -- 172.21.15.173:0/138280497 --> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x556804a763d0 con 0x556804ccacd0 2024-04-25T09:09:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.972+0000 7f6cdd200640 1 --2- 172.21.15.173:0/138280497 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x556804ccacd0 0x556804ccd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6cc6000640 10 client.7944 ms_handle_connect on v2:172.21.15.173:6836/555490935 2024-04-25T09:09:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6cdd200640 1 --2- 172.21.15.173:0/138280497 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x556804ccacd0 0x556804ccd0c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e0492e904821ffb server_cookie=2eff0309944570c0 in_seq=0 out_seq=0 2024-04-25T09:09:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6cc6000640 1 -- 172.21.15.173:0/138280497 <== mds.0 v2:172.21.15.173:6836/555490935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x556804a763d0 con 0x556804ccacd0 2024-04-25T09:09:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6cc6000640 10 client.7944 handle_command_reply: tid=0 2024-04-25T09:09:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6ce30e2000 1 client.7944 shutdown 2024-04-25T09:09:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6ce30e2000 1 -- 172.21.15.173:0/138280497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c64a40 msgr2=0x556804c69fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/138280497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c64a40 0x556804c69fe0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0013000 tx=0x7f6cc0012000 comp rx=0 tx=0).stop 2024-04-25T09:09:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6ce30e2000 1 -- 172.21.15.173:0/138280497 shutdown_connections 2024-04-25T09:09:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/138280497 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x556804ccacd0 0x556804ccd0c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/138280497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556804c65360 0x556804c6a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/138280497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556804c64a40 0x556804c69fe0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6cc6000640 0 client.7944 ms_handle_reset on v2:172.21.15.173:6836/555490935 2024-04-25T09:09:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6ce30e2000 1 --2- 172.21.15.173:0/138280497 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556804c1fd90 0x556804c69aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6ce30e2000 1 -- 172.21.15.173:0/138280497 >> 172.21.15.173:0/138280497 conn(0x556804c1bd40 msgr2=0x556804c63190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6ce30e2000 1 -- 172.21.15.173:0/138280497 shutdown_connections 2024-04-25T09:09:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6ce30e2000 1 -- 172.21.15.173:0/138280497 wait complete. 2024-04-25T09:09:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6ce30e2000 20 client.7944 trim_cache size 0 max 16384 2024-04-25T09:09:58.969 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:09:58.969 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0 2024-04-25T09:09:58.969 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:09:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6cde600640 1 -- 172.21.15.173:0/4201612086 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6cb4066f90 msgr2=0x7f6cb4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6cde600640 1 --2- 172.21.15.173:0/4201612086 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6cb4066f90 0x7f6cb4069450 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80011f0 tx=0x7f6cc8009040 comp rx=0 tx=0).stop 2024-04-25T09:09:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6cde600640 1 -- 172.21.15.173:0/4201612086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cd815dbc0 msgr2=0x7f6cd80cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6cde600640 1 --2- 172.21.15.173:0/4201612086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cd815dbc0 0x7f6cd80cd2a0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00b0040 tx=0x7f6cd0019730 comp rx=0 tx=0).stop 2024-04-25T09:09:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6cde600640 1 -- 172.21.15.173:0/4201612086 shutdown_connections 2024-04-25T09:09:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6cde600640 1 --2- 172.21.15.173:0/4201612086 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6cb4066f90 0x7f6cb4069450 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6cde600640 1 --2- 172.21.15.173:0/4201612086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cd815dbc0 0x7f6cd80cd2a0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6cde600640 1 --2- 172.21.15.173:0/4201612086 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cd809a160 0x7f6cd80ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6cde600640 1 --2- 172.21.15.173:0/4201612086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cd806c4b0 0x7f6cd8154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6cde600640 1 -- 172.21.15.173:0/4201612086 >> 172.21.15.173:0/4201612086 conn(0x7f6cd80b31d0 msgr2=0x7f6cd8155de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:58.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6cde600640 1 -- 172.21.15.173:0/4201612086 shutdown_connections 2024-04-25T09:09:58.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:58.976+0000 7f6cde600640 1 -- 172.21.15.173:0/4201612086 wait complete. 2024-04-25T09:09:58.982 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T09:09:58.982 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:09:59.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.132+0000 7f2cdcc00640 1 Processor -- start 2024-04-25T09:09:59.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.132+0000 7f2cdcc00640 1 -- start start 2024-04-25T09:09:59.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.132+0000 7f2cdcc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2cd80b3fe0 0x7f2cd80b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.132+0000 7f2cdcc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2cd80cc260 0x7f2cd80cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.132+0000 7f2cdcc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd806d4b0 con 0x7f2cd8145290 2024-04-25T09:09:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.132+0000 7f2cdcc00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd806d790 con 0x7f2cd80b3fe0 2024-04-25T09:09:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.132+0000 7f2cdcc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd806da70 con 0x7f2cd80cc260 2024-04-25T09:09:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.132+0000 7f2cd5400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2cd80b3fe0 0x7f2cd80b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.132+0000 7f2cd5400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2cd80b3fe0 0x7f2cd80b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55804/0 (socket says 172.21.15.173:55804) 2024-04-25T09:09:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.132+0000 7f2cd5400640 1 -- 172.21.15.173:0/1253338972 learned_addr learned my addr 172.21.15.173:0/1253338972 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.132+0000 7f2cd6800640 1 --2- 172.21.15.173:0/1253338972 >> v2:172.21.15.194:3300/0 conn(0x7f2cd80cc260 0x7f2cd80cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.132+0000 7f2cd5400640 1 -- 172.21.15.173:0/1253338972 >> v2:172.21.15.194:3300/0 conn(0x7f2cd80cc260 msgr2=0x7f2cd80cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:59.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.132+0000 7f2cd5400640 1 --2- 172.21.15.173:0/1253338972 >> v2:172.21.15.194:3300/0 conn(0x7f2cd80cc260 0x7f2cd80cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.132+0000 7f2cd5400640 1 -- 172.21.15.173:0/1253338972 >> v1:172.21.15.194:6789/0 conn(0x7f2cd8145290 legacy=0x7f2cd815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.132+0000 7f2cd5400640 1 -- 172.21.15.173:0/1253338972 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd806dd50 con 0x7f2cd80b3fe0 2024-04-25T09:09:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.136+0000 7f2cd5400640 1 --2- 172.21.15.173:0/1253338972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cd80b3fe0 0x7f2cd80b4450 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f2cd815f5b0 tx=0x7f2cc401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8b04c60da2095f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.136+0000 7f2cd4a00640 1 -- 172.21.15.173:0/1253338972 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc40b1070 con 0x7f2cd80b3fe0 2024-04-25T09:09:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.136+0000 7f2cd4a00640 1 -- 172.21.15.173:0/1253338972 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc40ac640 con 0x7f2cd80b3fe0 2024-04-25T09:09:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.136+0000 7f2cd4a00640 1 -- 172.21.15.173:0/1253338972 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc40aca10 con 0x7f2cd80b3fe0 2024-04-25T09:09:59.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.136+0000 7f2cdcc00640 1 -- 172.21.15.173:0/1253338972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cd80b3fe0 msgr2=0x7f2cd80b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.136+0000 7f2cdcc00640 1 --2- 172.21.15.173:0/1253338972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cd80b3fe0 0x7f2cd80b4450 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f2cd815f5b0 tx=0x7f2cc401c400 comp rx=0 tx=0).stop 2024-04-25T09:09:59.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.136+0000 7f2cdcc00640 1 -- 172.21.15.173:0/1253338972 shutdown_connections 2024-04-25T09:09:59.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.136+0000 7f2cdcc00640 1 --2- 172.21.15.173:0/1253338972 >> v2:172.21.15.194:3300/0 conn(0x7f2cd80cc260 0x7f2cd80cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.136+0000 7f2cdcc00640 1 --2- 172.21.15.173:0/1253338972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cd80b3fe0 0x7f2cd80b4450 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.136+0000 7f2cdcc00640 1 -- 172.21.15.173:0/1253338972 >> 172.21.15.173:0/1253338972 conn(0x7f2cd806ac90 msgr2=0x7f2cd806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:59.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.136+0000 7f2cdcc00640 1 -- 172.21.15.173:0/1253338972 shutdown_connections 2024-04-25T09:09:59.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.136+0000 7f2cdcc00640 1 -- 172.21.15.173:0/1253338972 wait complete. 2024-04-25T09:09:59.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cdcc00640 1 Processor -- start 2024-04-25T09:09:59.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cdcc00640 1 -- start start 2024-04-25T09:09:59.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cdcc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cd80b3fe0 0x7f2cd8135830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cdcc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cd80cc260 0x7f2cd8138d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cdcc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cd8145290 0x7f2cd813dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cdcc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd806eee0 con 0x7f2cd80b3fe0 2024-04-25T09:09:59.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cdcc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd806ed60 con 0x7f2cd8145290 2024-04-25T09:09:59.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cdcc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd806f060 con 0x7f2cd80cc260 2024-04-25T09:09:59.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cd5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cd80b3fe0 0x7f2cd8135830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cd5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cd80b3fe0 0x7f2cd8135830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55818/0 (socket says 172.21.15.173:55818) 2024-04-25T09:09:59.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cd5e00640 1 -- 172.21.15.173:0/2628562497 learned_addr learned my addr 172.21.15.173:0/2628562497 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:59.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cd6800640 1 --2- 172.21.15.173:0/2628562497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cd8145290 0x7f2cd813dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cd5e00640 1 -- 172.21.15.173:0/2628562497 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cd80cc260 msgr2=0x7f2cd8138d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cd5400640 1 --2- 172.21.15.173:0/2628562497 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cd80cc260 0x7f2cd8138d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cd5e00640 1 --2- 172.21.15.173:0/2628562497 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cd80cc260 0x7f2cd8138d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cd5e00640 1 -- 172.21.15.173:0/2628562497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cd8145290 msgr2=0x7f2cd813dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cd5e00640 1 --2- 172.21.15.173:0/2628562497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cd8145290 0x7f2cd813dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cd5e00640 1 -- 172.21.15.173:0/2628562497 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd813b930 con 0x7f2cd80b3fe0 2024-04-25T09:09:59.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cd5400640 1 --2- 172.21.15.173:0/2628562497 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cd80cc260 0x7f2cd8138d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:59.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cd5e00640 1 --2- 172.21.15.173:0/2628562497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cd80b3fe0 0x7f2cd8135830 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800c370 tx=0x7f2cc800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:59.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cce000640 1 -- 172.21.15.173:0/2628562497 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc80052d0 con 0x7f2cd80b3fe0 2024-04-25T09:09:59.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cce000640 1 -- 172.21.15.173:0/2628562497 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc8005470 con 0x7f2cd80b3fe0 2024-04-25T09:09:59.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cce000640 1 -- 172.21.15.173:0/2628562497 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8007260 con 0x7f2cd80b3fe0 2024-04-25T09:09:59.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cdcc00640 1 -- 172.21.15.173:0/2628562497 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd813bc10 con 0x7f2cd80b3fe0 2024-04-25T09:09:59.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.140+0000 7f2cdcc00640 1 -- 172.21.15.173:0/2628562497 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd813c1d0 con 0x7f2cd80b3fe0 2024-04-25T09:09:59.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cce000640 1 -- 172.21.15.173:0/2628562497 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2cc8007400 con 0x7f2cd80b3fe0 2024-04-25T09:09:59.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cce000640 1 --2- 172.21.15.173:0/2628562497 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2cb8066f60 0x7f2cb8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cce000640 1 -- 172.21.15.173:0/2628562497 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2cc80846c0 con 0x7f2cd80b3fe0 2024-04-25T09:09:59.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cd5400640 1 --2- 172.21.15.173:0/2628562497 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2cb8066f60 0x7f2cb8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2ce00c1000 1 Processor -- start 2024-04-25T09:09:59.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2ce00c1000 1 -- start start 2024-04-25T09:09:59.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cd5400640 1 --2- 172.21.15.173:0/2628562497 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2cb8066f60 0x7f2cb8069420 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40ae000 tx=0x7f2cc4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2ce00c1000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1123e30 0x55d7d1124210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2ce00c1000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d1124750 0x55d7d10d9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2ce00c1000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d10da4b0 0x55d7d10da890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2ce00c1000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7d0f22ff0 con 0x55d7d1123e30 2024-04-25T09:09:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2ce00c1000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7d0eab150 con 0x55d7d1124750 2024-04-25T09:09:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2ce00c1000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7d0f1f090 con 0x55d7d10da4b0 2024-04-25T09:09:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cd5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1123e30 0x55d7d1124210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cd5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1123e30 0x55d7d1124210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55832/0 (socket says 172.21.15.173:55832) 2024-04-25T09:09:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cd5e00640 1 -- 172.21.15.173:0/1877897823 learned_addr learned my addr 172.21.15.173:0/1877897823 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cd5400640 1 --2- 172.21.15.173:0/1877897823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d1124750 0x55d7d10d9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cd6800640 1 --2- 172.21.15.173:0/1877897823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d10da4b0 0x55d7d10da890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cd5e00640 1 -- 172.21.15.173:0/1877897823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d10da4b0 msgr2=0x55d7d10da890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cd5e00640 1 --2- 172.21.15.173:0/1877897823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d10da4b0 0x55d7d10da890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cd5e00640 1 -- 172.21.15.173:0/1877897823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d1124750 msgr2=0x55d7d10d9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cd5e00640 1 --2- 172.21.15.173:0/1877897823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d1124750 0x55d7d10d9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cd5e00640 1 -- 172.21.15.173:0/1877897823 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7d10b90d0 con 0x55d7d1123e30 2024-04-25T09:09:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cd6800640 1 --2- 172.21.15.173:0/1877897823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d10da4b0 0x55d7d10da890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cd5e00640 1 --2- 172.21.15.173:0/1877897823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1123e30 0x55d7d1124210 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800a040 tx=0x7f2cc8055560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49a3e600283ddc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cc2a00640 1 -- 172.21.15.173:0/1877897823 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8058030 con 0x55d7d1123e30 2024-04-25T09:09:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cc2a00640 1 -- 172.21.15.173:0/1877897823 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc805d4b0 con 0x55d7d1123e30 2024-04-25T09:09:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.144+0000 7f2cc2a00640 1 -- 172.21.15.173:0/1877897823 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc805b0c0 con 0x55d7d1123e30 2024-04-25T09:09:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 -- 172.21.15.173:0/1877897823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1123e30 msgr2=0x55d7d1124210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/1877897823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1123e30 0x55d7d1124210 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800a040 tx=0x7f2cc8055560 comp rx=0 tx=0).stop 2024-04-25T09:09:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 -- 172.21.15.173:0/1877897823 shutdown_connections 2024-04-25T09:09:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/1877897823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d10da4b0 0x55d7d10da890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/1877897823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d1124750 0x55d7d10d9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/1877897823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1123e30 0x55d7d1124210 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 -- 172.21.15.173:0/1877897823 >> 172.21.15.173:0/1877897823 conn(0x55d7d10d2020 msgr2=0x55d7d10d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 -- 172.21.15.173:0/1877897823 shutdown_connections 2024-04-25T09:09:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 -- 172.21.15.173:0/1877897823 wait complete. 2024-04-25T09:09:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 -- start start 2024-04-25T09:09:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 Processor -- start 2024-04-25T09:09:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d10da4b0 0x55d7d11237b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1123e30 0x55d7d10e0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d1124750 0x55d7d10e08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7d0f27620 con 0x55d7d1123e30 2024-04-25T09:09:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7d0edd690 con 0x55d7d10da4b0 2024-04-25T09:09:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7d0eaba40 con 0x55d7d1124750 2024-04-25T09:09:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 10 client.0 _ll_register_callbacks cb 0x55d7d10c0e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:59.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2cd5400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1123e30 0x55d7d10e0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2cd5400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1123e30 0x55d7d10e0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55836/0 (socket says 172.21.15.173:55836) 2024-04-25T09:09:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2cd5400640 1 -- 172.21.15.173:0/2235988445 learned_addr learned my addr 172.21.15.173:0/2235988445 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2cd5e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d10da4b0 0x55d7d11237b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2cd6800640 1 --2- 172.21.15.173:0/2235988445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d1124750 0x55d7d10e08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2cd5400640 1 -- 172.21.15.173:0/2235988445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d1124750 msgr2=0x55d7d10e08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2cd5400640 1 --2- 172.21.15.173:0/2235988445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d1124750 0x55d7d10e08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2cd5400640 1 -- 172.21.15.173:0/2235988445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d10da4b0 msgr2=0x55d7d11237b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2cd5400640 1 --2- 172.21.15.173:0/2235988445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d10da4b0 0x55d7d11237b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2cd5400640 1 -- 172.21.15.173:0/2235988445 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7d0fd01c0 con 0x55d7d1123e30 2024-04-25T09:09:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2cd5400640 1 --2- 172.21.15.173:0/2235988445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1123e30 0x55d7d10e0360 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f2cc401c8e0 tx=0x7f2cc401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644e7ee7a9a2d48d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2cb7400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:09:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2cb7400640 1 -- 172.21.15.173:0/2235988445 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc40b1040 con 0x55d7d1123e30 2024-04-25T09:09:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2cb7400640 1 -- 172.21.15.173:0/2235988445 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2cc40c26f0 con 0x55d7d1123e30 2024-04-25T09:09:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 -- 172.21.15.173:0/2235988445 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2cc805d4b0 con 0x55d7d1123e30 2024-04-25T09:09:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2cb7400640 1 -- 172.21.15.173:0/2235988445 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cc40c28f0 con 0x55d7d1123e30 2024-04-25T09:09:59.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 10 client.7956 fetch_fsmap learned FSMap version 65 2024-04-25T09:09:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.148+0000 7f2ce00c1000 1 -- 172.21.15.173:0/2235988445 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x55d7d0fcc170 con 0x55d7d1123e30 2024-04-25T09:09:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2cb7400640 1 -- 172.21.15.173:0/2235988445 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc805d4b0 con 0x55d7d1123e30 2024-04-25T09:09:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2cb7400640 1 -- 172.21.15.173:0/2235988445 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2cc40d5080 con 0x55d7d1123e30 2024-04-25T09:09:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2ce00c1000 10 client.7956 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:09:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2ce00c1000 10 client.7956 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:09:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2ce00c1000 20 client.7956 populate_metadata read hostname 'smithi173' 2024-04-25T09:09:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/2235988445 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55d7d10e1610 0x55d7d11360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2ce00c1000 4 client.7956 mds_command: new command op to 7743 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2ce00c1000 1 -- 172.21.15.173:0/2235988445 --> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d7d0ebec60 con 0x55d7d10e1610 2024-04-25T09:09:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2cd5e00640 1 --2- 172.21.15.173:0/2235988445 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55d7d10e1610 0x55d7d11360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2cb7400640 10 client.7956 ms_handle_connect on v2:172.21.15.173:6836/555490935 2024-04-25T09:09:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2cd5e00640 1 --2- 172.21.15.173:0/2235988445 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55d7d10e1610 0x55d7d11360f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc04745120d328b4 server_cookie=20b8477141d41e86 in_seq=0 out_seq=0 2024-04-25T09:09:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2cb7400640 1 -- 172.21.15.173:0/2235988445 <== mds.0 v2:172.21.15.173:6836/555490935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d7d0ebec60 con 0x55d7d10e1610 2024-04-25T09:09:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2cb7400640 10 client.7956 handle_command_reply: tid=0 2024-04-25T09:09:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2ce00c1000 1 client.7956 shutdown 2024-04-25T09:09:59.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2ce00c1000 1 -- 172.21.15.173:0/2235988445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1123e30 msgr2=0x55d7d10e0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/2235988445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1123e30 0x55d7d10e0360 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f2cc401c8e0 tx=0x7f2cc401ac40 comp rx=0 tx=0).stop 2024-04-25T09:09:59.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2ce00c1000 1 -- 172.21.15.173:0/2235988445 shutdown_connections 2024-04-25T09:09:59.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/2235988445 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55d7d10e1610 0x55d7d11360f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/2235988445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d1124750 0x55d7d10e08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/2235988445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1123e30 0x55d7d10e0360 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/2235988445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d10da4b0 0x55d7d11237b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2cb7400640 0 client.7956 ms_handle_reset on v2:172.21.15.173:6836/555490935 2024-04-25T09:09:59.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2ce00c1000 1 -- 172.21.15.173:0/2235988445 >> 172.21.15.173:0/2235988445 conn(0x55d7d10d2020 msgr2=0x55d7d10db120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:59.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2ce00c1000 1 -- 172.21.15.173:0/2235988445 shutdown_connections 2024-04-25T09:09:59.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2ce00c1000 1 -- 172.21.15.173:0/2235988445 wait complete. 2024-04-25T09:09:59.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.152+0000 7f2ce00c1000 20 client.7956 trim_cache size 0 max 16384 2024-04-25T09:09:59.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2ce00c1000 1 Processor -- start 2024-04-25T09:09:59.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2ce00c1000 1 -- start start 2024-04-25T09:09:59.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2ce00c1000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d10da4b0 0x55d7d1138110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2ce00c1000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d1123e30 0x55d7d1138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2ce00c1000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1124750 0x55d7d1101af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2ce00c1000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd81ff000 con 0x55d7d1124750 2024-04-25T09:09:59.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2ce00c1000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd80ceb00 con 0x55d7d1123e30 2024-04-25T09:09:59.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2ce00c1000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd8136e20 con 0x55d7d10da4b0 2024-04-25T09:09:59.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2cd6800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1124750 0x55d7d1101af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2cd6800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1124750 0x55d7d1101af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55844/0 (socket says 172.21.15.173:55844) 2024-04-25T09:09:59.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2cd6800640 1 -- 172.21.15.173:0/304471030 learned_addr learned my addr 172.21.15.173:0/304471030 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:59.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2cd5400640 1 --2- 172.21.15.173:0/304471030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d1123e30 0x55d7d1138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2cd5e00640 1 --2- 172.21.15.173:0/304471030 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d10da4b0 0x55d7d1138110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2cd6800640 1 -- 172.21.15.173:0/304471030 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d10da4b0 msgr2=0x55d7d1138110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:59.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2cd6800640 1 --2- 172.21.15.173:0/304471030 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d10da4b0 0x55d7d1138110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2cd6800640 1 -- 172.21.15.173:0/304471030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d1123e30 msgr2=0x55d7d1138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:59.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2cd6800640 1 --2- 172.21.15.173:0/304471030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d1123e30 0x55d7d1138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2cd6800640 1 -- 172.21.15.173:0/304471030 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7d0f69de0 con 0x55d7d1124750 2024-04-25T09:09:59.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2cd5400640 1 --2- 172.21.15.173:0/304471030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d1123e30 0x55d7d1138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:59.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2cd6800640 1 --2- 172.21.15.173:0/304471030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1124750 0x55d7d1101af0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00155c0 tx=0x7f2cd0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eecfbf3156e75fe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:59.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2cc2000640 1 -- 172.21.15.173:0/304471030 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd00178e0 con 0x55d7d1124750 2024-04-25T09:09:59.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2cc2000640 1 -- 172.21.15.173:0/304471030 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd0017a80 con 0x55d7d1124750 2024-04-25T09:09:59.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2cc2000640 1 -- 172.21.15.173:0/304471030 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0017e50 con 0x55d7d1124750 2024-04-25T09:09:59.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2ce00c1000 1 -- 172.21.15.173:0/304471030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1124750 msgr2=0x55d7d1101af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/304471030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1124750 0x55d7d1101af0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00155c0 tx=0x7f2cd0009750 comp rx=0 tx=0).stop 2024-04-25T09:09:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2ce00c1000 1 -- 172.21.15.173:0/304471030 shutdown_connections 2024-04-25T09:09:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/304471030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d1124750 0x55d7d1101af0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/304471030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d1123e30 0x55d7d1138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/304471030 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d10da4b0 0x55d7d1138110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2ce00c1000 1 -- 172.21.15.173:0/304471030 >> 172.21.15.173:0/304471030 conn(0x55d7d10d2020 msgr2=0x55d7d1131420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2ce00c1000 1 -- 172.21.15.173:0/304471030 shutdown_connections 2024-04-25T09:09:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.168+0000 7f2ce00c1000 1 -- 172.21.15.173:0/304471030 wait complete. 2024-04-25T09:09:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2ce00c1000 1 -- start start 2024-04-25T09:09:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2ce00c1000 1 Processor -- start 2024-04-25T09:09:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2ce00c1000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d10da4b0 0x55d7d11029a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2ce00c1000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d1123e30 0x55d7d1137140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2ce00c1000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d1124750 0x55d7d1137680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2ce00c1000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7d0ebde00 con 0x55d7d10da4b0 2024-04-25T09:09:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2ce00c1000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd80ce500 con 0x55d7d1124750 2024-04-25T09:09:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2ce00c1000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7d0f22300 con 0x55d7d1123e30 2024-04-25T09:09:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2ce00c1000 10 client.0 _ll_register_callbacks cb 0x55d7d10a1040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cd5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d10da4b0 0x55d7d11029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cd5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d10da4b0 0x55d7d11029a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55858/0 (socket says 172.21.15.173:55858) 2024-04-25T09:09:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cd5e00640 1 -- 172.21.15.173:0/4078789651 learned_addr learned my addr 172.21.15.173:0/4078789651 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:09:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cd5400640 1 --2- 172.21.15.173:0/4078789651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d1123e30 0x55d7d1137140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cd6800640 1 --2- 172.21.15.173:0/4078789651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d1124750 0x55d7d1137680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cd5e00640 1 -- 172.21.15.173:0/4078789651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d1123e30 msgr2=0x55d7d1137140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cd5e00640 1 --2- 172.21.15.173:0/4078789651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d1123e30 0x55d7d1137140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cd5e00640 1 -- 172.21.15.173:0/4078789651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d1124750 msgr2=0x55d7d1137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cd5e00640 1 --2- 172.21.15.173:0/4078789651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d1124750 0x55d7d1137680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cd5e00640 1 -- 172.21.15.173:0/4078789651 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7d0ec48e0 con 0x55d7d10da4b0 2024-04-25T09:09:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cd5400640 1 --2- 172.21.15.173:0/4078789651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d1123e30 0x55d7d1137140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cd5e00640 1 --2- 172.21.15.173:0/4078789651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d10da4b0 0x55d7d11029a0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8007fd0 tx=0x7f2cc8014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4d376c1db1fb47 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cb7400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:09:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cb7400640 1 -- 172.21.15.173:0/4078789651 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8058040 con 0x55d7d10da4b0 2024-04-25T09:09:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cb7400640 1 -- 172.21.15.173:0/4078789651 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2cc8051410 con 0x55d7d10da4b0 2024-04-25T09:09:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2ce00c1000 1 -- 172.21.15.173:0/4078789651 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2cd0017a80 con 0x55d7d10da4b0 2024-04-25T09:09:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cb7400640 1 -- 172.21.15.173:0/4078789651 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cc807c050 con 0x55d7d10da4b0 2024-04-25T09:09:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2ce00c1000 10 client.7962 fetch_fsmap learned FSMap version 65 2024-04-25T09:09:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2ce00c1000 1 -- 172.21.15.173:0/4078789651 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x55d7d0f7c8f0 con 0x55d7d10da4b0 2024-04-25T09:09:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cb7400640 1 -- 172.21.15.173:0/4078789651 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd0017a80 con 0x55d7d10da4b0 2024-04-25T09:09:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cb7400640 1 -- 172.21.15.173:0/4078789651 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2cc806cb30 con 0x55d7d10da4b0 2024-04-25T09:09:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2ce00c1000 10 client.7962 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:09:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2ce00c1000 10 client.7962 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:09:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2ce00c1000 20 client.7962 populate_metadata read hostname 'smithi173' 2024-04-25T09:09:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/4078789651 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55d7d1189fd0 0x55d7d118c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2ce00c1000 4 client.7962 mds_command: new command op to 7743 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:09:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2ce00c1000 1 -- 172.21.15.173:0/4078789651 --> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d7d0f30530 con 0x55d7d1189fd0 2024-04-25T09:09:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cd5400640 1 --2- 172.21.15.173:0/4078789651 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55d7d1189fd0 0x55d7d118c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2cb7400640 10 client.7962 ms_handle_connect on v2:172.21.15.173:6836/555490935 2024-04-25T09:09:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.172+0000 7f2cd5400640 1 --2- 172.21.15.173:0/4078789651 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55d7d1189fd0 0x55d7d118c3c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74d06217e6706301 server_cookie=f76c50d572b06e25 in_seq=0 out_seq=0 2024-04-25T09:09:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2cb7400640 1 -- 172.21.15.173:0/4078789651 <== mds.0 v2:172.21.15.173:6836/555490935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x55d7d0f30530 con 0x55d7d1189fd0 2024-04-25T09:09:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2cb7400640 10 client.7962 handle_command_reply: tid=0 2024-04-25T09:09:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2ce00c1000 1 client.7962 shutdown 2024-04-25T09:09:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2ce00c1000 1 -- 172.21.15.173:0/4078789651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d10da4b0 msgr2=0x55d7d11029a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/4078789651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d10da4b0 0x55d7d11029a0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8007fd0 tx=0x7f2cc8014040 comp rx=0 tx=0).stop 2024-04-25T09:09:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2ce00c1000 1 -- 172.21.15.173:0/4078789651 shutdown_connections 2024-04-25T09:09:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/4078789651 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55d7d1189fd0 0x55d7d118c3c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/4078789651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d7d1124750 0x55d7d1137680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/4078789651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d7d1123e30 0x55d7d1137140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2ce00c1000 1 --2- 172.21.15.173:0/4078789651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7d10da4b0 0x55d7d11029a0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2cb7400640 0 client.7962 ms_handle_reset on v2:172.21.15.173:6836/555490935 2024-04-25T09:09:59.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2ce00c1000 1 -- 172.21.15.173:0/4078789651 >> 172.21.15.173:0/4078789651 conn(0x55d7d10d2020 msgr2=0x55d7d10d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:59.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2ce00c1000 1 -- 172.21.15.173:0/4078789651 shutdown_connections 2024-04-25T09:09:59.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2ce00c1000 1 -- 172.21.15.173:0/4078789651 wait complete. 2024-04-25T09:09:59.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2ce00c1000 20 client.7962 trim_cache size 0 max 16384 2024-04-25T09:09:59.167 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:09:59.167 INFO:teuthology.orchestra.run.smithi173.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:09:59.167 INFO:teuthology.orchestra.run.smithi173.stdout: "scrubs": { 2024-04-25T09:09:59.167 INFO:teuthology.orchestra.run.smithi173.stdout: "1a775209-fa19-4a0f-b156-5e5da99a1ee2": { 2024-04-25T09:09:59.167 INFO:teuthology.orchestra.run.smithi173.stdout: "path": "/scrub_control_test_path", 2024-04-25T09:09:59.167 INFO:teuthology.orchestra.run.smithi173.stdout: "tag": "1a775209-fa19-4a0f-b156-5e5da99a1ee2", 2024-04-25T09:09:59.167 INFO:teuthology.orchestra.run.smithi173.stdout: "options": "recursive" 2024-04-25T09:09:59.168 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:59.168 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:09:59.168 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:09:59.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2cdcc00640 1 -- 172.21.15.173:0/2628562497 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2cb8066f60 msgr2=0x7f2cb8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2cdcc00640 1 --2- 172.21.15.173:0/2628562497 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2cb8066f60 0x7f2cb8069420 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40ae000 tx=0x7f2cc4008040 comp rx=0 tx=0).stop 2024-04-25T09:09:59.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2cdcc00640 1 -- 172.21.15.173:0/2628562497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cd80b3fe0 msgr2=0x7f2cd8135830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2cdcc00640 1 --2- 172.21.15.173:0/2628562497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cd80b3fe0 0x7f2cd8135830 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800c370 tx=0x7f2cc800c830 comp rx=0 tx=0).stop 2024-04-25T09:09:59.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2cdcc00640 1 -- 172.21.15.173:0/2628562497 shutdown_connections 2024-04-25T09:09:59.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2cdcc00640 1 --2- 172.21.15.173:0/2628562497 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2cb8066f60 0x7f2cb8069420 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2cdcc00640 1 --2- 172.21.15.173:0/2628562497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cd8145290 0x7f2cd813dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2cdcc00640 1 --2- 172.21.15.173:0/2628562497 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cd80cc260 0x7f2cd8138d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2cdcc00640 1 --2- 172.21.15.173:0/2628562497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cd80b3fe0 0x7f2cd8135830 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2cdcc00640 1 -- 172.21.15.173:0/2628562497 >> 172.21.15.173:0/2628562497 conn(0x7f2cd806ac90 msgr2=0x7f2cd80af570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:59.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2cdcc00640 1 -- 172.21.15.173:0/2628562497 shutdown_connections 2024-04-25T09:09:59.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:09:59.176+0000 7f2cdcc00640 1 -- 172.21.15.173:0/2628562497 wait complete. 2024-04-25T09:10:04.182 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T09:10:04.182 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:10:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.343+0000 7efd80c00640 1 Processor -- start 2024-04-25T09:10:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.343+0000 7efd80c00640 1 -- start start 2024-04-25T09:10:04.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.343+0000 7efd80c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd7c0aef70 0x7efd7c06d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.343+0000 7efd80c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c071570 con 0x7efd7c0aeb90 2024-04-25T09:10:04.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.343+0000 7efd80c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c071850 con 0x7efd7c0cc7e0 2024-04-25T09:10:04.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.343+0000 7efd80c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c071320 con 0x7efd7c0aef70 2024-04-25T09:10:04.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.343+0000 7efd79e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7efd7c0aeb90 0x7efd7c0cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53576/0 (socket says 172.21.15.173:53576) 2024-04-25T09:10:04.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.343+0000 7efd79e00640 1 -- 172.21.15.173:0/442910028 learned_addr learned my addr 172.21.15.173:0/442910028 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:04.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.343+0000 7efd7a800640 1 --2- 172.21.15.173:0/442910028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd7c0aef70 0x7efd7c06d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.343+0000 7efd78a00640 1 -- 172.21.15.173:0/442910028 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4075505734 0 0) 0x7efd7c071570 con 0x7efd7c0aeb90 2024-04-25T09:10:04.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.343+0000 7efd78a00640 1 -- 172.21.15.173:0/442910028 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd60003530 con 0x7efd7c0aeb90 2024-04-25T09:10:04.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.343+0000 7efd78a00640 1 -- 172.21.15.173:0/442910028 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121230404 0 0) 0x7efd7c071850 con 0x7efd7c0cc7e0 2024-04-25T09:10:04.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.343+0000 7efd78a00640 1 -- 172.21.15.173:0/442910028 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd7c071570 con 0x7efd7c0cc7e0 2024-04-25T09:10:04.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.347+0000 7efd7a800640 1 -- 172.21.15.173:0/442910028 >> v1:172.21.15.194:6789/0 conn(0x7efd7c0cc7e0 legacy=0x7efd7c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.347+0000 7efd7a800640 1 -- 172.21.15.173:0/442910028 >> v1:172.21.15.173:6789/0 conn(0x7efd7c0aeb90 legacy=0x7efd7c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.347+0000 7efd7a800640 1 -- 172.21.15.173:0/442910028 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c071b30 con 0x7efd7c0aef70 2024-04-25T09:10:04.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.347+0000 7efd7a800640 1 --2- 172.21.15.173:0/442910028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd7c0aef70 0x7efd7c06d940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efd740097f0 tx=0x7efd7401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e54d35f0caef665c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.347+0000 7efd78a00640 1 -- 172.21.15.173:0/442910028 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd740b2070 con 0x7efd7c0aef70 2024-04-25T09:10:04.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.347+0000 7efd78a00640 1 -- 172.21.15.173:0/442910028 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd740a9070 con 0x7efd7c0aef70 2024-04-25T09:10:04.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.347+0000 7efd78a00640 1 -- 172.21.15.173:0/442910028 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd740ad880 con 0x7efd7c0aef70 2024-04-25T09:10:04.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd80c00640 1 -- 172.21.15.173:0/442910028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd7c0aef70 msgr2=0x7efd7c06d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd80c00640 1 --2- 172.21.15.173:0/442910028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd7c0aef70 0x7efd7c06d940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efd740097f0 tx=0x7efd7401c450 comp rx=0 tx=0).stop 2024-04-25T09:10:04.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd80c00640 1 -- 172.21.15.173:0/442910028 shutdown_connections 2024-04-25T09:10:04.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd80c00640 1 --2- 172.21.15.173:0/442910028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd7c0aef70 0x7efd7c06d940 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd80c00640 1 -- 172.21.15.173:0/442910028 >> 172.21.15.173:0/442910028 conn(0x7efd7c06ac90 msgr2=0x7efd7c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:04.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd80c00640 1 -- 172.21.15.173:0/442910028 shutdown_connections 2024-04-25T09:10:04.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd80c00640 1 -- 172.21.15.173:0/442910028 wait complete. 2024-04-25T09:10:04.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd80c00640 1 Processor -- start 2024-04-25T09:10:04.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd80c00640 1 -- start start 2024-04-25T09:10:04.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd80c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd7c0aeb90 0x7efd7c13bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd80c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd7c0aef70 0x7efd7c0b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd80c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd7c0cc7e0 0x7efd7c0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd80c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c06ea20 con 0x7efd7c0cc7e0 2024-04-25T09:10:04.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd80c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c06e8a0 con 0x7efd7c0aeb90 2024-04-25T09:10:04.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd80c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c168730 con 0x7efd7c0aef70 2024-04-25T09:10:04.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd79e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd7c0aeb90 0x7efd7c13bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd79400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd7c0aef70 0x7efd7c0b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd7a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd7c0cc7e0 0x7efd7c0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd79e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd7c0aeb90 0x7efd7c13bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:52262/0 (socket says 172.21.15.173:52262) 2024-04-25T09:10:04.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd7a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd7c0cc7e0 0x7efd7c0b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51254/0 (socket says 172.21.15.173:51254) 2024-04-25T09:10:04.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd79e00640 1 -- 172.21.15.173:0/1834590914 learned_addr learned my addr 172.21.15.173:0/1834590914 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:04.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd7a800640 1 -- 172.21.15.173:0/1834590914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd7c0aef70 msgr2=0x7efd7c0b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd7a800640 1 --2- 172.21.15.173:0/1834590914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd7c0aef70 0x7efd7c0b36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd7a800640 1 -- 172.21.15.173:0/1834590914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd7c0aeb90 msgr2=0x7efd7c13bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd7a800640 1 --2- 172.21.15.173:0/1834590914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd7c0aeb90 0x7efd7c13bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.351+0000 7efd7a800640 1 -- 172.21.15.173:0/1834590914 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c14a5b0 con 0x7efd7c0cc7e0 2024-04-25T09:10:04.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.355+0000 7efd7a800640 1 --2- 172.21.15.173:0/1834590914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd7c0cc7e0 0x7efd7c0b3c00 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7efd740ac000 tx=0x7efd7401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.355+0000 7efd72000640 1 -- 172.21.15.173:0/1834590914 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd740b2050 con 0x7efd7c0cc7e0 2024-04-25T09:10:04.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.355+0000 7efd72000640 1 -- 172.21.15.173:0/1834590914 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd740b3040 con 0x7efd7c0cc7e0 2024-04-25T09:10:04.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.355+0000 7efd80c00640 1 -- 172.21.15.173:0/1834590914 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7c14a890 con 0x7efd7c0cc7e0 2024-04-25T09:10:04.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.355+0000 7efd72000640 1 -- 172.21.15.173:0/1834590914 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd740b9670 con 0x7efd7c0cc7e0 2024-04-25T09:10:04.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.355+0000 7efd80c00640 1 -- 172.21.15.173:0/1834590914 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7c14ae50 con 0x7efd7c0cc7e0 2024-04-25T09:10:04.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.355+0000 7efd72000640 1 -- 172.21.15.173:0/1834590914 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efd740c0030 con 0x7efd7c0cc7e0 2024-04-25T09:10:04.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.355+0000 7efd72000640 1 --2- 172.21.15.173:0/1834590914 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd5c066f60 0x7efd5c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.355+0000 7efd72000640 1 -- 172.21.15.173:0/1834590914 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efd7411ef70 con 0x7efd7c0cc7e0 2024-04-25T09:10:04.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.355+0000 7efd79e00640 1 --2- 172.21.15.173:0/1834590914 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd5c066f60 0x7efd5c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.355+0000 7efd841a0000 1 Processor -- start 2024-04-25T09:10:04.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.355+0000 7efd841a0000 1 -- start start 2024-04-25T09:10:04.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd79e00640 1 --2- 172.21.15.173:0/1834590914 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd5c066f60 0x7efd5c069420 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0012f0 tx=0x7efd6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd841a0000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 0x5598382c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd841a0000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5598382c52f0 0x55983827ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd841a0000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55983827b0a0 0x55983827b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd841a0000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598380c7ff0 con 0x5598382c49d0 2024-04-25T09:10:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd841a0000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559838050150 con 0x55983827b0a0 2024-04-25T09:10:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd841a0000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5598380c4090 con 0x5598382c52f0 2024-04-25T09:10:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd79e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 0x5598382c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd79e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 0x5598382c4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51258/0 (socket says 172.21.15.173:51258) 2024-04-25T09:10:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd79e00640 1 -- 172.21.15.173:0/661461565 learned_addr learned my addr 172.21.15.173:0/661461565 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd79400640 1 --2- 172.21.15.173:0/661461565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5598382c52f0 0x55983827ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd79e00640 1 -- 172.21.15.173:0/661461565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5598382c52f0 msgr2=0x55983827ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd79e00640 1 --2- 172.21.15.173:0/661461565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5598382c52f0 0x55983827ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd7a800640 1 --2- 172.21.15.173:0/661461565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55983827b0a0 0x55983827b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd79e00640 1 -- 172.21.15.173:0/661461565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55983827b0a0 msgr2=0x55983827b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd79e00640 1 --2- 172.21.15.173:0/661461565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55983827b0a0 0x55983827b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd79e00640 1 -- 172.21.15.173:0/661461565 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55983825e0d0 con 0x5598382c49d0 2024-04-25T09:10:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd79400640 1 --2- 172.21.15.173:0/661461565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5598382c52f0 0x55983827ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:04.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd7a800640 1 --2- 172.21.15.173:0/661461565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55983827b0a0 0x55983827b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:04.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd79e00640 1 --2- 172.21.15.173:0/661461565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 0x5598382c4db0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0145e0 tx=0x7efd6c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f4bb19287c7c19 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd66a00640 1 -- 172.21.15.173:0/661461565 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c025070 con 0x5598382c49d0 2024-04-25T09:10:04.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd66a00640 1 -- 172.21.15.173:0/661461565 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c01b050 con 0x5598382c49d0 2024-04-25T09:10:04.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd66a00640 1 -- 172.21.15.173:0/661461565 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c013900 con 0x5598382c49d0 2024-04-25T09:10:04.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd841a0000 1 -- 172.21.15.173:0/661461565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 msgr2=0x5598382c4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd841a0000 1 --2- 172.21.15.173:0/661461565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 0x5598382c4db0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0145e0 tx=0x7efd6c012000 comp rx=0 tx=0).stop 2024-04-25T09:10:04.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd841a0000 1 -- 172.21.15.173:0/661461565 shutdown_connections 2024-04-25T09:10:04.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd841a0000 1 --2- 172.21.15.173:0/661461565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55983827b0a0 0x55983827b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd841a0000 1 --2- 172.21.15.173:0/661461565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5598382c52f0 0x55983827ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd841a0000 1 --2- 172.21.15.173:0/661461565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 0x5598382c4db0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd841a0000 1 -- 172.21.15.173:0/661461565 >> 172.21.15.173:0/661461565 conn(0x559838277020 msgr2=0x559838279440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:04.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd841a0000 1 -- 172.21.15.173:0/661461565 shutdown_connections 2024-04-25T09:10:04.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd841a0000 1 -- 172.21.15.173:0/661461565 wait complete. 2024-04-25T09:10:04.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd841a0000 1 -- start start 2024-04-25T09:10:04.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.359+0000 7efd841a0000 1 Processor -- start 2024-04-25T09:10:04.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd841a0000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55983827b0a0 0x5598382d0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd841a0000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 0x5598382d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd841a0000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5598382c52f0 0x5598382acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd841a0000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55983808c250 con 0x5598382c49d0 2024-04-25T09:10:04.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd841a0000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559838082690 con 0x55983827b0a0 2024-04-25T09:10:04.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd841a0000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x559838050a40 con 0x5598382c52f0 2024-04-25T09:10:04.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd841a0000 10 client.0 _ll_register_callbacks cb 0x559838265e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:04.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd79400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 0x5598382d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd79400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 0x5598382d06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51268/0 (socket says 172.21.15.173:51268) 2024-04-25T09:10:04.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd79400640 1 -- 172.21.15.173:0/2926980282 learned_addr learned my addr 172.21.15.173:0/2926980282 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:04.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd79e00640 1 --2- 172.21.15.173:0/2926980282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55983827b0a0 0x5598382d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd7a800640 1 --2- 172.21.15.173:0/2926980282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5598382c52f0 0x5598382acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd79400640 1 -- 172.21.15.173:0/2926980282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5598382c52f0 msgr2=0x5598382acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:04.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd79400640 1 --2- 172.21.15.173:0/2926980282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5598382c52f0 0x5598382acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd79400640 1 -- 172.21.15.173:0/2926980282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55983827b0a0 msgr2=0x5598382d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:04.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd79400640 1 --2- 172.21.15.173:0/2926980282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55983827b0a0 0x5598382d0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd79400640 1 -- 172.21.15.173:0/2926980282 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5598381751c0 con 0x5598382c49d0 2024-04-25T09:10:04.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd79400640 1 --2- 172.21.15.173:0/2926980282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 0x5598382d06d0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7efd68003b00 tx=0x7efd680055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf3855c7ba4482e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd5b400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:10:04.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd5b400640 1 -- 172.21.15.173:0/2926980282 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68001cb0 con 0x5598382c49d0 2024-04-25T09:10:04.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd5b400640 1 -- 172.21.15.173:0/2926980282 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efd68014400 con 0x5598382c49d0 2024-04-25T09:10:04.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd841a0000 1 -- 172.21.15.173:0/2926980282 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd6c01b050 con 0x5598382c49d0 2024-04-25T09:10:04.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd5b400640 1 -- 172.21.15.173:0/2926980282 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd68021050 con 0x5598382c49d0 2024-04-25T09:10:04.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd841a0000 10 client.7974 fetch_fsmap learned FSMap version 65 2024-04-25T09:10:04.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd841a0000 1 -- 172.21.15.173:0/2926980282 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x559838171170 con 0x5598382c49d0 2024-04-25T09:10:04.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd5b400640 1 -- 172.21.15.173:0/2926980282 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c01b050 con 0x5598382c49d0 2024-04-25T09:10:04.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd5b400640 1 -- 172.21.15.173:0/2926980282 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efd68024020 con 0x5598382c49d0 2024-04-25T09:10:04.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd841a0000 10 client.7974 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:10:04.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd841a0000 10 client.7974 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:10:04.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd841a0000 20 client.7974 populate_metadata read hostname 'smithi173' 2024-04-25T09:10:04.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd841a0000 1 --2- 172.21.15.173:0/2926980282 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x5598382add70 0x5598382ae180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd841a0000 4 client.7974 mds_command: new command op to 7743 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:04.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd841a0000 1 -- 172.21.15.173:0/2926980282 --> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559838063c60 con 0x5598382add70 2024-04-25T09:10:04.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd79e00640 1 --2- 172.21.15.173:0/2926980282 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x5598382add70 0x5598382ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd79e00640 1 --2- 172.21.15.173:0/2926980282 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x5598382add70 0x5598382ae180 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e6121a3fc4d1368 server_cookie=a8a4f53c292f5185 in_seq=0 out_seq=0 2024-04-25T09:10:04.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd5b400640 10 client.7974 ms_handle_connect on v2:172.21.15.173:6836/555490935 2024-04-25T09:10:04.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd5b400640 1 -- 172.21.15.173:0/2926980282 <== mds.0 v2:172.21.15.173:6836/555490935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559838063c60 con 0x5598382add70 2024-04-25T09:10:04.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd5b400640 10 client.7974 handle_command_reply: tid=0 2024-04-25T09:10:04.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.363+0000 7efd841a0000 1 client.7974 shutdown 2024-04-25T09:10:04.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.367+0000 7efd841a0000 1 -- 172.21.15.173:0/2926980282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 msgr2=0x5598382d06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.367+0000 7efd841a0000 1 --2- 172.21.15.173:0/2926980282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 0x5598382d06d0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7efd68003b00 tx=0x7efd680055e0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.367+0000 7efd841a0000 1 -- 172.21.15.173:0/2926980282 shutdown_connections 2024-04-25T09:10:04.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.367+0000 7efd841a0000 1 --2- 172.21.15.173:0/2926980282 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x5598382add70 0x5598382ae180 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.367+0000 7efd841a0000 1 --2- 172.21.15.173:0/2926980282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5598382c52f0 0x5598382acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.367+0000 7efd841a0000 1 --2- 172.21.15.173:0/2926980282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 0x5598382d06d0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.367+0000 7efd5b400640 0 client.7974 ms_handle_reset on v2:172.21.15.173:6836/555490935 2024-04-25T09:10:04.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.367+0000 7efd841a0000 1 --2- 172.21.15.173:0/2926980282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55983827b0a0 0x5598382d0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.367+0000 7efd841a0000 1 -- 172.21.15.173:0/2926980282 >> 172.21.15.173:0/2926980282 conn(0x559838277020 msgr2=0x559838279ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:04.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.367+0000 7efd841a0000 1 -- 172.21.15.173:0/2926980282 shutdown_connections 2024-04-25T09:10:04.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.367+0000 7efd841a0000 1 -- 172.21.15.173:0/2926980282 wait complete. 2024-04-25T09:10:04.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.367+0000 7efd841a0000 20 client.7974 trim_cache size 0 max 16384 2024-04-25T09:10:04.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.379+0000 7efd841a0000 1 Processor -- start 2024-04-25T09:10:04.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.379+0000 7efd841a0000 1 -- start start 2024-04-25T09:10:04.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.379+0000 7efd841a0000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55983827b0a0 0x5598382a7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.379+0000 7efd841a0000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 0x5598382df350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.379+0000 7efd841a0000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5598382c52f0 0x5598382abb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.379+0000 7efd841a0000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0b13e0 con 0x5598382c49d0 2024-04-25T09:10:04.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.379+0000 7efd841a0000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0b0600 con 0x55983827b0a0 2024-04-25T09:10:04.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.379+0000 7efd841a0000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c152a60 con 0x5598382c52f0 2024-04-25T09:10:04.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.379+0000 7efd79400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 0x5598382df350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd79400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 0x5598382df350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51272/0 (socket says 172.21.15.173:51272) 2024-04-25T09:10:04.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd79400640 1 -- 172.21.15.173:0/4282676468 learned_addr learned my addr 172.21.15.173:0/4282676468 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:04.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd79e00640 1 --2- 172.21.15.173:0/4282676468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55983827b0a0 0x5598382a7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd7a800640 1 --2- 172.21.15.173:0/4282676468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5598382c52f0 0x5598382abb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd79400640 1 -- 172.21.15.173:0/4282676468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5598382c52f0 msgr2=0x5598382abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:04.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd79400640 1 --2- 172.21.15.173:0/4282676468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5598382c52f0 0x5598382abb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd79400640 1 -- 172.21.15.173:0/4282676468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55983827b0a0 msgr2=0x5598382a7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:04.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd79400640 1 --2- 172.21.15.173:0/4282676468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55983827b0a0 0x5598382a7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd79400640 1 -- 172.21.15.173:0/4282676468 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55983810ede0 con 0x5598382c49d0 2024-04-25T09:10:04.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd79e00640 1 --2- 172.21.15.173:0/4282676468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55983827b0a0 0x5598382a7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:04.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd79400640 1 --2- 172.21.15.173:0/4282676468 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 0x5598382df350 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7efd68009010 tx=0x7efd6800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8863ea468dc62353 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd66000640 1 -- 172.21.15.173:0/4282676468 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68001770 con 0x5598382c49d0 2024-04-25T09:10:04.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd66000640 1 -- 172.21.15.173:0/4282676468 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd68019070 con 0x5598382c49d0 2024-04-25T09:10:04.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd66000640 1 -- 172.21.15.173:0/4282676468 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68007990 con 0x5598382c49d0 2024-04-25T09:10:04.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd841a0000 1 -- 172.21.15.173:0/4282676468 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 msgr2=0x5598382df350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd841a0000 1 --2- 172.21.15.173:0/4282676468 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 0x5598382df350 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7efd68009010 tx=0x7efd6800e000 comp rx=0 tx=0).stop 2024-04-25T09:10:04.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd841a0000 1 -- 172.21.15.173:0/4282676468 shutdown_connections 2024-04-25T09:10:04.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd841a0000 1 --2- 172.21.15.173:0/4282676468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5598382c52f0 0x5598382abb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd841a0000 1 --2- 172.21.15.173:0/4282676468 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c49d0 0x5598382df350 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd841a0000 1 --2- 172.21.15.173:0/4282676468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55983827b0a0 0x5598382a7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd841a0000 1 -- 172.21.15.173:0/4282676468 >> 172.21.15.173:0/4282676468 conn(0x559838277020 msgr2=0x5598382a7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:04.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd841a0000 1 -- 172.21.15.173:0/4282676468 shutdown_connections 2024-04-25T09:10:04.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd841a0000 1 -- 172.21.15.173:0/4282676468 wait complete. 2024-04-25T09:10:04.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd841a0000 1 -- start start 2024-04-25T09:10:04.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd841a0000 1 Processor -- start 2024-04-25T09:10:04.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd841a0000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55983827b0a0 0x5598382acee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd841a0000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5598382c49d0 0x55983827e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd841a0000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c52f0 0x55983827ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd841a0000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559838062e00 con 0x5598382c52f0 2024-04-25T09:10:04.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd841a0000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c153060 con 0x5598382c49d0 2024-04-25T09:10:04.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd841a0000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5598380c7300 con 0x55983827b0a0 2024-04-25T09:10:04.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd841a0000 10 client.0 _ll_register_callbacks cb 0x559838246040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:04.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd7a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c52f0 0x55983827ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd7a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c52f0 0x55983827ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51288/0 (socket says 172.21.15.173:51288) 2024-04-25T09:10:04.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd7a800640 1 -- 172.21.15.173:0/2562830493 learned_addr learned my addr 172.21.15.173:0/2562830493 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:04.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd79400640 1 --2- 172.21.15.173:0/2562830493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5598382c49d0 0x55983827e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd79e00640 1 --2- 172.21.15.173:0/2562830493 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55983827b0a0 0x5598382acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd7a800640 1 -- 172.21.15.173:0/2562830493 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55983827b0a0 msgr2=0x5598382acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:04.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.383+0000 7efd7a800640 1 --2- 172.21.15.173:0/2562830493 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55983827b0a0 0x5598382acee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd7a800640 1 -- 172.21.15.173:0/2562830493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5598382c49d0 msgr2=0x55983827e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:04.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd7a800640 1 --2- 172.21.15.173:0/2562830493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5598382c49d0 0x55983827e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd7a800640 1 -- 172.21.15.173:0/2562830493 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5598380698e0 con 0x5598382c52f0 2024-04-25T09:10:04.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd7a800640 1 --2- 172.21.15.173:0/2562830493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c52f0 0x55983827ea20 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7efd7401c930 tx=0x7efd740ef210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0881e752ef64e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd5b400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:10:04.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd5b400640 1 -- 172.21.15.173:0/2562830493 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd741072d0 con 0x5598382c52f0 2024-04-25T09:10:04.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd5b400640 1 -- 172.21.15.173:0/2562830493 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efd740f0b30 con 0x5598382c52f0 2024-04-25T09:10:04.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 1 -- 172.21.15.173:0/2562830493 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd68019070 con 0x5598382c52f0 2024-04-25T09:10:04.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd5b400640 1 -- 172.21.15.173:0/2562830493 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd740f7f10 con 0x5598382c52f0 2024-04-25T09:10:04.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 10 client.7980 fetch_fsmap learned FSMap version 65 2024-04-25T09:10:04.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 1 -- 172.21.15.173:0/2562830493 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x5598381218f0 con 0x5598382c52f0 2024-04-25T09:10:04.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd5b400640 1 -- 172.21.15.173:0/2562830493 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd68019070 con 0x5598382c52f0 2024-04-25T09:10:04.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd5b400640 1 -- 172.21.15.173:0/2562830493 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efd740eed00 con 0x5598382c52f0 2024-04-25T09:10:04.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 10 client.7980 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:10:04.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 10 client.7980 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:10:04.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 20 client.7980 populate_metadata read hostname 'smithi173' 2024-04-25T09:10:04.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 1 --2- 172.21.15.173:0/2562830493 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55983827ef60 0x559838335470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 4 client.7980 mds_command: new command op to 7743 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:10:04.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 1 -- 172.21.15.173:0/2562830493 --> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5598380d5530 con 0x55983827ef60 2024-04-25T09:10:04.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd79e00640 1 --2- 172.21.15.173:0/2562830493 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55983827ef60 0x559838335470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd79e00640 1 --2- 172.21.15.173:0/2562830493 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55983827ef60 0x559838335470 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b125a875fa19d702 server_cookie=9a2e6db2d390b870 in_seq=0 out_seq=0 2024-04-25T09:10:04.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd5b400640 10 client.7980 ms_handle_connect on v2:172.21.15.173:6836/555490935 2024-04-25T09:10:04.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd5b400640 1 -- 172.21.15.173:0/2562830493 <== mds.0 v2:172.21.15.173:6836/555490935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5598380d5530 con 0x55983827ef60 2024-04-25T09:10:04.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd5b400640 10 client.7980 handle_command_reply: tid=0 2024-04-25T09:10:04.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 1 client.7980 shutdown 2024-04-25T09:10:04.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 1 -- 172.21.15.173:0/2562830493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c52f0 msgr2=0x55983827ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 1 --2- 172.21.15.173:0/2562830493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c52f0 0x55983827ea20 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7efd7401c930 tx=0x7efd740ef210 comp rx=0 tx=0).stop 2024-04-25T09:10:04.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 1 -- 172.21.15.173:0/2562830493 shutdown_connections 2024-04-25T09:10:04.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 1 --2- 172.21.15.173:0/2562830493 >> [v2:172.21.15.173:6836/555490935,v1:172.21.15.173:6837/555490935] conn(0x55983827ef60 0x559838335470 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 1 --2- 172.21.15.173:0/2562830493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598382c52f0 0x55983827ea20 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 1 --2- 172.21.15.173:0/2562830493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5598382c49d0 0x55983827e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 1 --2- 172.21.15.173:0/2562830493 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55983827b0a0 0x5598382acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd5b400640 0 client.7980 ms_handle_reset on v2:172.21.15.173:6836/555490935 2024-04-25T09:10:04.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 1 -- 172.21.15.173:0/2562830493 >> 172.21.15.173:0/2562830493 conn(0x559838277020 msgr2=0x5598382a7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:04.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 1 -- 172.21.15.173:0/2562830493 shutdown_connections 2024-04-25T09:10:04.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 1 -- 172.21.15.173:0/2562830493 wait complete. 2024-04-25T09:10:04.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd841a0000 20 client.7980 trim_cache size 0 max 16384 2024-04-25T09:10:04.381 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:10:04.381 INFO:teuthology.orchestra.run.smithi173.stdout: "status": "no active scrubs running", 2024-04-25T09:10:04.381 INFO:teuthology.orchestra.run.smithi173.stdout: "scrubs": {} 2024-04-25T09:10:04.381 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:10:04.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd80c00640 1 -- 172.21.15.173:0/1834590914 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd5c066f60 msgr2=0x7efd5c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd80c00640 1 --2- 172.21.15.173:0/1834590914 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd5c066f60 0x7efd5c069420 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0012f0 tx=0x7efd6c009040 comp rx=0 tx=0).stop 2024-04-25T09:10:04.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd80c00640 1 -- 172.21.15.173:0/1834590914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd7c0cc7e0 msgr2=0x7efd7c0b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd80c00640 1 --2- 172.21.15.173:0/1834590914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd7c0cc7e0 0x7efd7c0b3c00 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7efd740ac000 tx=0x7efd7401ac90 comp rx=0 tx=0).stop 2024-04-25T09:10:04.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd80c00640 1 -- 172.21.15.173:0/1834590914 shutdown_connections 2024-04-25T09:10:04.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd80c00640 1 --2- 172.21.15.173:0/1834590914 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efd5c066f60 0x7efd5c069420 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd80c00640 1 --2- 172.21.15.173:0/1834590914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd7c0cc7e0 0x7efd7c0b3c00 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd80c00640 1 --2- 172.21.15.173:0/1834590914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd7c0aef70 0x7efd7c0b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd80c00640 1 --2- 172.21.15.173:0/1834590914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd7c0aeb90 0x7efd7c13bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd80c00640 1 -- 172.21.15.173:0/1834590914 >> 172.21.15.173:0/1834590914 conn(0x7efd7c06ac90 msgr2=0x7efd7c15d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:04.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd80c00640 1 -- 172.21.15.173:0/1834590914 shutdown_connections 2024-04-25T09:10:04.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.387+0000 7efd80c00640 1 -- 172.21.15.173:0/1834590914 wait complete. 2024-04-25T09:10:04.398 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:10:04.398 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:04.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.543+0000 7f883de00640 1 Processor -- start 2024-04-25T09:10:04.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.543+0000 7f883de00640 1 -- start start 2024-04-25T09:10:04.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.547+0000 7f883de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f88380aefa0 0x7f88380cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.547+0000 7f883de00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f883815edd0 0x7f88380cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.547+0000 7f883de00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883815f320 con 0x7f88380b3e70 2024-04-25T09:10:04.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.547+0000 7f883de00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883806dd50 con 0x7f883815edd0 2024-04-25T09:10:04.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.547+0000 7f883de00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883806d420 con 0x7f88380aefa0 2024-04-25T09:10:04.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.547+0000 7f8836a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f88380b3e70 0x7f88380b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53592/0 (socket says 172.21.15.173:53592) 2024-04-25T09:10:04.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.547+0000 7f8836a00640 1 -- 172.21.15.173:0/180744436 learned_addr learned my addr 172.21.15.173:0/180744436 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:04.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.547+0000 7f8837400640 1 --2- 172.21.15.173:0/180744436 >> v2:172.21.15.173:3300/0 conn(0x7f883815edd0 0x7f88380cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.547+0000 7f882e000640 1 --2- 172.21.15.173:0/180744436 >> v2:172.21.15.194:3300/0 conn(0x7f88380aefa0 0x7f88380cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.547+0000 7f8836000640 1 -- 172.21.15.173:0/180744436 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548162513 0 0) 0x7f883815f320 con 0x7f88380b3e70 2024-04-25T09:10:04.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.547+0000 7f8836000640 1 -- 172.21.15.173:0/180744436 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f881c005740 con 0x7f88380b3e70 2024-04-25T09:10:04.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.547+0000 7f8837400640 1 -- 172.21.15.173:0/180744436 >> v2:172.21.15.194:3300/0 conn(0x7f88380aefa0 msgr2=0x7f88380cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:04.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.547+0000 7f8837400640 1 --2- 172.21.15.173:0/180744436 >> v2:172.21.15.194:3300/0 conn(0x7f88380aefa0 0x7f88380cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.547+0000 7f8837400640 1 -- 172.21.15.173:0/180744436 >> v1:172.21.15.173:6789/0 conn(0x7f88380b3e70 legacy=0x7f88380b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.547+0000 7f8837400640 1 -- 172.21.15.173:0/180744436 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883806d700 con 0x7f883815edd0 2024-04-25T09:10:04.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f8837400640 1 --2- 172.21.15.173:0/180744436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f883815edd0 0x7f88380cdce0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f88380d0650 tx=0x7f883001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f37a4471f47585 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f8836000640 1 -- 172.21.15.173:0/180744436 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88300b2070 con 0x7f883815edd0 2024-04-25T09:10:04.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f8836000640 1 -- 172.21.15.173:0/180744436 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88300a59b0 con 0x7f883815edd0 2024-04-25T09:10:04.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f8836000640 1 -- 172.21.15.173:0/180744436 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88300a5d60 con 0x7f883815edd0 2024-04-25T09:10:04.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f883de00640 1 -- 172.21.15.173:0/180744436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f883815edd0 msgr2=0x7f88380cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f883de00640 1 --2- 172.21.15.173:0/180744436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f883815edd0 0x7f88380cdce0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f88380d0650 tx=0x7f883001c900 comp rx=0 tx=0).stop 2024-04-25T09:10:04.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f883de00640 1 -- 172.21.15.173:0/180744436 shutdown_connections 2024-04-25T09:10:04.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f883de00640 1 --2- 172.21.15.173:0/180744436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f883815edd0 0x7f88380cdce0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f883de00640 1 --2- 172.21.15.173:0/180744436 >> v2:172.21.15.194:3300/0 conn(0x7f88380aefa0 0x7f88380cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f883de00640 1 -- 172.21.15.173:0/180744436 >> 172.21.15.173:0/180744436 conn(0x7f883806ac90 msgr2=0x7f883806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:04.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f883de00640 1 -- 172.21.15.173:0/180744436 shutdown_connections 2024-04-25T09:10:04.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f883de00640 1 -- 172.21.15.173:0/180744436 wait complete. 2024-04-25T09:10:04.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f883de00640 1 Processor -- start 2024-04-25T09:10:04.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f883de00640 1 -- start start 2024-04-25T09:10:04.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f883de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88380aefa0 0x7f883814cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f883de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88380b3e70 0x7f883814e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f883de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f883815edd0 0x7f883813c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f883de00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88380714a0 con 0x7f88380b3e70 2024-04-25T09:10:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f883de00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8838071320 con 0x7f883815edd0 2024-04-25T09:10:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.551+0000 7f883de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8838071620 con 0x7f88380aefa0 2024-04-25T09:10:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f882e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88380b3e70 0x7f883814e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f882e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88380b3e70 0x7f883814e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51306/0 (socket says 172.21.15.173:51306) 2024-04-25T09:10:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f882e000640 1 -- 172.21.15.173:0/2764947307 learned_addr learned my addr 172.21.15.173:0/2764947307 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f8836a00640 1 --2- 172.21.15.173:0/2764947307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88380aefa0 0x7f883814cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f8837400640 1 --2- 172.21.15.173:0/2764947307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f883815edd0 0x7f883813c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f882e000640 1 -- 172.21.15.173:0/2764947307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88380aefa0 msgr2=0x7f883814cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f882e000640 1 --2- 172.21.15.173:0/2764947307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88380aefa0 0x7f883814cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f882e000640 1 -- 172.21.15.173:0/2764947307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f883815edd0 msgr2=0x7f883813c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f882e000640 1 --2- 172.21.15.173:0/2764947307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f883815edd0 0x7f883813c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f882e000640 1 -- 172.21.15.173:0/2764947307 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883814d390 con 0x7f88380b3e70 2024-04-25T09:10:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f8836a00640 1 --2- 172.21.15.173:0/2764947307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88380aefa0 0x7f883814cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:04.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f8837400640 1 --2- 172.21.15.173:0/2764947307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f883815edd0 0x7f883813c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:04.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f882e000640 1 --2- 172.21.15.173:0/2764947307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88380b3e70 0x7f883814e7f0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f882000e930 tx=0x7f882000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f882fe00640 1 -- 172.21.15.173:0/2764947307 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8820017070 con 0x7f88380b3e70 2024-04-25T09:10:04.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f882fe00640 1 -- 172.21.15.173:0/2764947307 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882000ca00 con 0x7f88380b3e70 2024-04-25T09:10:04.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f882fe00640 1 -- 172.21.15.173:0/2764947307 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882000cdb0 con 0x7f88380b3e70 2024-04-25T09:10:04.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f883de00640 1 -- 172.21.15.173:0/2764947307 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883814d670 con 0x7f88380b3e70 2024-04-25T09:10:04.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f883de00640 1 -- 172.21.15.173:0/2764947307 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883814dc30 con 0x7f88380b3e70 2024-04-25T09:10:04.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f883de00640 1 -- 172.21.15.173:0/2764947307 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8838073a40 con 0x7f88380b3e70 2024-04-25T09:10:04.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f882fe00640 1 -- 172.21.15.173:0/2764947307 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f882001a070 con 0x7f88380b3e70 2024-04-25T09:10:04.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.555+0000 7f882fe00640 1 --2- 172.21.15.173:0/2764947307 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8814066f60 0x7f8814069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.559+0000 7f882fe00640 1 -- 172.21.15.173:0/2764947307 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f88200855d0 con 0x7f88380b3e70 2024-04-25T09:10:04.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.559+0000 7f8836a00640 1 --2- 172.21.15.173:0/2764947307 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8814066f60 0x7f8814069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.559+0000 7f8836a00640 1 --2- 172.21.15.173:0/2764947307 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8814066f60 0x7f8814069420 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8828005890 tx=0x7f8828009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.563+0000 7f882fe00640 1 -- 172.21.15.173:0/2764947307 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8820056500 con 0x7f88380b3e70 2024-04-25T09:10:04.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.751+0000 7f883de00640 1 -- 172.21.15.173:0/2764947307 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88380ce000 con 0x7f88380b3e70 2024-04-25T09:10:04.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.751+0000 7f882fe00640 1 -- 172.21.15.173:0/2764947307 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f8820055e00 con 0x7f88380b3e70 2024-04-25T09:10:04.739 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:04.739 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/556010437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":556010437},{"type":"v1","addr":"172.21.15.173:6835","nonce":556010437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":6524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4077641924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4077641924},{"type":"v1","addr":"172.21.15.194:6834","nonce":4077641924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7162,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2938501478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2938501478},{"type":"v1","addr":"172.21.15.194:6835","nonce":2938501478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:09:26.257282+0000","modified":"2024-04-25T09:09:29.275838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/555490935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":555490935},{"type":"v1","addr":"172.21.15.173:6837","nonce":555490935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:10:04.740 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 65 2024-04-25T09:10:04.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.751+0000 7f883de00640 1 -- 172.21.15.173:0/2764947307 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8814066f60 msgr2=0x7f8814069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.751+0000 7f883de00640 1 --2- 172.21.15.173:0/2764947307 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8814066f60 0x7f8814069420 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8828005890 tx=0x7f8828009040 comp rx=0 tx=0).stop 2024-04-25T09:10:04.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.751+0000 7f883de00640 1 -- 172.21.15.173:0/2764947307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88380b3e70 msgr2=0x7f883814e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.751+0000 7f883de00640 1 --2- 172.21.15.173:0/2764947307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88380b3e70 0x7f883814e7f0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f882000e930 tx=0x7f882000edf0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.751+0000 7f883de00640 1 -- 172.21.15.173:0/2764947307 shutdown_connections 2024-04-25T09:10:04.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.751+0000 7f883de00640 1 --2- 172.21.15.173:0/2764947307 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8814066f60 0x7f8814069420 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.751+0000 7f883de00640 1 --2- 172.21.15.173:0/2764947307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f883815edd0 0x7f883813c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.751+0000 7f883de00640 1 --2- 172.21.15.173:0/2764947307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88380b3e70 0x7f883814e7f0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.751+0000 7f883de00640 1 --2- 172.21.15.173:0/2764947307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88380aefa0 0x7f883814cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.751+0000 7f883de00640 1 -- 172.21.15.173:0/2764947307 >> 172.21.15.173:0/2764947307 conn(0x7f883806ac90 msgr2=0x7f883814f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:04.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.751+0000 7f883de00640 1 -- 172.21.15.173:0/2764947307 shutdown_connections 2024-04-25T09:10:04.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.751+0000 7f883de00640 1 -- 172.21.15.173:0/2764947307 wait complete. 2024-04-25T09:10:04.760 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-04-25T09:10:04.761 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:10:04.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.907+0000 7f2303800640 1 Processor -- start 2024-04-25T09:10:04.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.907+0000 7f2303800640 1 -- start start 2024-04-25T09:10:04.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.907+0000 7f2303800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f22fc06fba0 0x7f22fc0b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.907+0000 7f2303800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22fc070230 con 0x7f22fc15ea80 2024-04-25T09:10:04.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.907+0000 7f2303800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22fc070510 con 0x7f22fc06ac90 2024-04-25T09:10:04.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.907+0000 7f2303800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22fc070000 con 0x7f22fc06fba0 2024-04-25T09:10:04.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.907+0000 7f2301800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f22fc15ea80 0x7f22fc15f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53596/0 (socket says 172.21.15.173:53596) 2024-04-25T09:10:04.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.907+0000 7f2301800640 1 -- 172.21.15.173:0/3741332506 learned_addr learned my addr 172.21.15.173:0/3741332506 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:04.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.907+0000 7f22fbe00640 1 --2- 172.21.15.173:0/3741332506 >> v2:172.21.15.194:3300/0 conn(0x7f22fc06fba0 0x7f22fc0b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.907+0000 7f22fb400640 1 -- 172.21.15.173:0/3741332506 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528083789 0 0) 0x7f22fc070230 con 0x7f22fc15ea80 2024-04-25T09:10:04.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.907+0000 7f22fb400640 1 -- 172.21.15.173:0/3741332506 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e4003530 con 0x7f22fc15ea80 2024-04-25T09:10:04.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f22fb400640 1 -- 172.21.15.173:0/3741332506 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290034879 0 0) 0x7f22fc070510 con 0x7f22fc06ac90 2024-04-25T09:10:04.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f22fb400640 1 -- 172.21.15.173:0/3741332506 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22fc070230 con 0x7f22fc06ac90 2024-04-25T09:10:04.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f22fb400640 1 -- 172.21.15.173:0/3741332506 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3735564813 0 0) 0x7f22e4003530 con 0x7f22fc15ea80 2024-04-25T09:10:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f22fb400640 1 -- 172.21.15.173:0/3741332506 >> v2:172.21.15.194:3300/0 conn(0x7f22fc06fba0 msgr2=0x7f22fc0b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f22fb400640 1 --2- 172.21.15.173:0/3741332506 >> v2:172.21.15.194:3300/0 conn(0x7f22fc06fba0 0x7f22fc0b3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f22fb400640 1 -- 172.21.15.173:0/3741332506 >> v1:172.21.15.194:6789/0 conn(0x7f22fc06ac90 legacy=0x7f22fc06b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f22fb400640 1 -- 172.21.15.173:0/3741332506 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc15e280 con 0x7f22fc15ea80 2024-04-25T09:10:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f22fb400640 1 -- 172.21.15.173:0/3741332506 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f22f4001a00 con 0x7f22fc15ea80 2024-04-25T09:10:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f22fb400640 1 -- 172.21.15.173:0/3741332506 >> v1:172.21.15.173:6789/0 conn(0x7f22fc15ea80 legacy=0x7f22fc15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f22fb400640 1 --2- 172.21.15.173:0/3741332506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22e4003b50 0x7f22e4003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f22fb400640 1 --2- 172.21.15.173:0/3741332506 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22e4004810 0x7f22e4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f22fb400640 1 --2- 172.21.15.173:0/3741332506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e40051d0 0x7f22e400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f22fb400640 1 -- 172.21.15.173:0/3741332506 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e400c020 con 0x7f22e40051d0 2024-04-25T09:10:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f22fb400640 1 -- 172.21.15.173:0/3741332506 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e400c1d0 con 0x7f22e4003b50 2024-04-25T09:10:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f22fb400640 1 -- 172.21.15.173:0/3741332506 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e400c3d0 con 0x7f22e4004810 2024-04-25T09:10:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f22fbe00640 1 --2- 172.21.15.173:0/3741332506 >> v2:172.21.15.194:3300/0 conn(0x7f22fc06fba0 0x7f22fc0b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f2301800640 1 --2- 172.21.15.173:0/3741332506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e40051d0 0x7f22e400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f2300e00640 1 --2- 172.21.15.173:0/3741332506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22e4003b50 0x7f22e4003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f22fbe00640 1 --2- 172.21.15.173:0/3741332506 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22e4004810 0x7f22e4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f2301800640 1 -- 172.21.15.173:0/3741332506 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22e4004810 msgr2=0x7f22e4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:04.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f2301800640 1 --2- 172.21.15.173:0/3741332506 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22e4004810 0x7f22e4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f2301800640 1 -- 172.21.15.173:0/3741332506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22e4003b50 msgr2=0x7f22e4003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:04.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f2301800640 1 --2- 172.21.15.173:0/3741332506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22e4003b50 0x7f22e4003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f2301800640 1 -- 172.21.15.173:0/3741332506 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e4003530 con 0x7f22e40051d0 2024-04-25T09:10:04.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.911+0000 7f2301800640 1 -- 172.21.15.173:0/3741332506 reap_dead start 2024-04-25T09:10:04.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f2301800640 1 --2- 172.21.15.173:0/3741332506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e40051d0 0x7f22e400b9d0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f22f400a7c0 tx=0x7f22f401fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd801e3af6845156 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f22fb400640 1 -- 172.21.15.173:0/3741332506 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f400a410 con 0x7f22e40051d0 2024-04-25T09:10:04.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f22fb400640 1 -- 172.21.15.173:0/3741332506 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f40aa690 con 0x7f22e40051d0 2024-04-25T09:10:04.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f22fb400640 1 -- 172.21.15.173:0/3741332506 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f40aaa80 con 0x7f22e40051d0 2024-04-25T09:10:04.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f2303800640 1 -- 172.21.15.173:0/3741332506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e40051d0 msgr2=0x7f22e400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f2303800640 1 --2- 172.21.15.173:0/3741332506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e40051d0 0x7f22e400b9d0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f22f400a7c0 tx=0x7f22f401fa40 comp rx=0 tx=0).stop 2024-04-25T09:10:04.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f2303800640 1 -- 172.21.15.173:0/3741332506 shutdown_connections 2024-04-25T09:10:04.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f2303800640 1 --2- 172.21.15.173:0/3741332506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e40051d0 0x7f22e400b9d0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f2303800640 1 -- 172.21.15.173:0/3741332506 >> 172.21.15.173:0/3741332506 conn(0x7f22fc0b23f0 msgr2=0x7f22fc0b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:04.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f2303800640 1 -- 172.21.15.173:0/3741332506 shutdown_connections 2024-04-25T09:10:04.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f2303800640 1 -- 172.21.15.173:0/3741332506 wait complete. 2024-04-25T09:10:04.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f2303800640 1 Processor -- start 2024-04-25T09:10:04.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f2303800640 1 -- start start 2024-04-25T09:10:04.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f2303800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e40051d0 0x7f22fc1e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f2303800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22fc1f73f0 0x7f22fc14a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f2303800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22fc1f6730 0x7f22fc1f6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f2303800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc15ef10 con 0x7f22e40051d0 2024-04-25T09:10:04.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f2303800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc0b01a0 con 0x7f22fc1f6730 2024-04-25T09:10:04.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f2303800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc15f090 con 0x7f22fc1f73f0 2024-04-25T09:10:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.915+0000 7f2300e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e40051d0 0x7f22fc1e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f2300e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e40051d0 0x7f22fc1e7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51316/0 (socket says 172.21.15.173:51316) 2024-04-25T09:10:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f2300e00640 1 -- 172.21.15.173:0/1267098051 learned_addr learned my addr 172.21.15.173:0/1267098051 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f22fbe00640 1 --2- 172.21.15.173:0/1267098051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22fc1f73f0 0x7f22fc14a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f2301800640 1 --2- 172.21.15.173:0/1267098051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22fc1f6730 0x7f22fc1f6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f2300e00640 1 -- 172.21.15.173:0/1267098051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22fc1f73f0 msgr2=0x7f22fc14a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f2300e00640 1 --2- 172.21.15.173:0/1267098051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22fc1f73f0 0x7f22fc14a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f2300e00640 1 -- 172.21.15.173:0/1267098051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22fc1f6730 msgr2=0x7f22fc1f6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f2300e00640 1 --2- 172.21.15.173:0/1267098051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22fc1f6730 0x7f22fc1f6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f2300e00640 1 -- 172.21.15.173:0/1267098051 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc1e8230 con 0x7f22e40051d0 2024-04-25T09:10:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f2301800640 1 --2- 172.21.15.173:0/1267098051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22fc1f6730 0x7f22fc1f6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f2300e00640 1 --2- 172.21.15.173:0/1267098051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e40051d0 0x7f22fc1e7cf0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f22f000f770 tx=0x7f22f000fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f22f8c00640 1 -- 172.21.15.173:0/1267098051 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f00050d0 con 0x7f22e40051d0 2024-04-25T09:10:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f22f8c00640 1 -- 172.21.15.173:0/1267098051 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f0018070 con 0x7f22e40051d0 2024-04-25T09:10:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f22f8c00640 1 -- 172.21.15.173:0/1267098051 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f00054b0 con 0x7f22e40051d0 2024-04-25T09:10:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f2303800640 1 -- 172.21.15.173:0/1267098051 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22fc15d1a0 con 0x7f22e40051d0 2024-04-25T09:10:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f2303800640 1 -- 172.21.15.173:0/1267098051 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc0cad10 con 0x7f22e40051d0 2024-04-25T09:10:04.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f2303800640 1 -- 172.21.15.173:0/1267098051 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22fc073a40 con 0x7f22e40051d0 2024-04-25T09:10:04.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f22f8c00640 1 -- 172.21.15.173:0/1267098051 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f22f000d730 con 0x7f22e40051d0 2024-04-25T09:10:04.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.919+0000 7f22f8c00640 1 --2- 172.21.15.173:0/1267098051 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f22dc067130 0x7f22dc0695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.923+0000 7f22f8c00640 1 -- 172.21.15.173:0/1267098051 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f22f0084ff0 con 0x7f22e40051d0 2024-04-25T09:10:04.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.923+0000 7f22fbe00640 1 --2- 172.21.15.173:0/1267098051 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f22dc067130 0x7f22dc0695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.923+0000 7f22fbe00640 1 --2- 172.21.15.173:0/1267098051 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f22dc067130 0x7f22dc0695f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f22fc1f7830 tx=0x7f22e8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:04.923+0000 7f22f8c00640 1 -- 172.21.15.173:0/1267098051 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f22f0055df0 con 0x7f22e40051d0 2024-04-25T09:10:05.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.135+0000 7f2303800640 1 -- 172.21.15.173:0/1267098051 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f22fc0732d0 con 0x7f22e40051d0 2024-04-25T09:10:05.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.135+0000 7f22f8c00640 1 -- 172.21.15.173:0/1267098051 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1187 (secure 0 0 0) 0x7f22f00556f0 con 0x7f22e40051d0 2024-04-25T09:10:05.124 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:05.124 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":459,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":97,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076449187,"bytes_used":2537332736,"bytes_avail":770556780544,"bytes_total":773094113280,"write_bytes_sec":43081032,"read_op_per_sec":0,"write_op_per_sec":43},"fsmap":{"epoch":65,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7743}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-04-25T09:08:34.801401+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:10:05.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.135+0000 7f2303800640 1 -- 172.21.15.173:0/1267098051 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f22dc067130 msgr2=0x7f22dc0695f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.135+0000 7f2303800640 1 --2- 172.21.15.173:0/1267098051 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f22dc067130 0x7f22dc0695f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f22fc1f7830 tx=0x7f22e8009190 comp rx=0 tx=0).stop 2024-04-25T09:10:05.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.135+0000 7f2303800640 1 -- 172.21.15.173:0/1267098051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e40051d0 msgr2=0x7f22fc1e7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.135+0000 7f2303800640 1 --2- 172.21.15.173:0/1267098051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e40051d0 0x7f22fc1e7cf0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f22f000f770 tx=0x7f22f000fc30 comp rx=0 tx=0).stop 2024-04-25T09:10:05.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.135+0000 7f2303800640 1 -- 172.21.15.173:0/1267098051 shutdown_connections 2024-04-25T09:10:05.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.135+0000 7f2303800640 1 --2- 172.21.15.173:0/1267098051 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f22dc067130 0x7f22dc0695f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.135+0000 7f2303800640 1 --2- 172.21.15.173:0/1267098051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22fc1f6730 0x7f22fc1f6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.135+0000 7f2303800640 1 --2- 172.21.15.173:0/1267098051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22fc1f73f0 0x7f22fc14a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.135+0000 7f2303800640 1 --2- 172.21.15.173:0/1267098051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e40051d0 0x7f22fc1e7cf0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.135+0000 7f2303800640 1 -- 172.21.15.173:0/1267098051 >> 172.21.15.173:0/1267098051 conn(0x7f22fc0b23f0 msgr2=0x7f22fc0b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:05.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.135+0000 7f2303800640 1 -- 172.21.15.173:0/1267098051 shutdown_connections 2024-04-25T09:10:05.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.135+0000 7f2303800640 1 -- 172.21.15.173:0/1267098051 wait complete. 2024-04-25T09:10:05.145 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:10:05.145 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:10:05.145 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:10:05.236 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:10:05.326 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:10:05.326 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:10:05.326 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:05.335 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:10:05.335 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:05.385 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:05.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.571+0000 7f296d400640 1 Processor -- start 2024-04-25T09:10:05.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.571+0000 7f296d400640 1 -- start start 2024-04-25T09:10:05.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.571+0000 7f296d400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2968145250 0x7f296815c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.571+0000 7f296d400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f29680cc8b0 0x7f29680ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.575+0000 7f296d400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f296815cec0 con 0x7f2968071320 2024-04-25T09:10:05.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.575+0000 7f296d400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296806e7c0 con 0x7f29680cc8b0 2024-04-25T09:10:05.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.575+0000 7f296d400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296806d720 con 0x7f2968145250 2024-04-25T09:10:05.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.575+0000 7f2965e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f29680cc8b0 0x7f29680ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.575+0000 7f2965e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f29680cc8b0 0x7f29680ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51326/0 (socket says 172.21.15.173:51326) 2024-04-25T09:10:05.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.575+0000 7f2965e00640 1 -- 172.21.15.173:0/2084611123 learned_addr learned my addr 172.21.15.173:0/2084611123 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:05.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.575+0000 7f2966800640 1 --2- 172.21.15.173:0/2084611123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2968145250 0x7f296815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.575+0000 7f2965e00640 1 -- 172.21.15.173:0/2084611123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2968145250 msgr2=0x7f296815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:05.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.575+0000 7f2965e00640 1 --2- 172.21.15.173:0/2084611123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2968145250 0x7f296815c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.575+0000 7f2965e00640 1 -- 172.21.15.173:0/2084611123 >> v1:172.21.15.194:6789/0 conn(0x7f2968071320 legacy=0x7f2968071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:05.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.575+0000 7f2965e00640 1 -- 172.21.15.173:0/2084611123 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296806da00 con 0x7f29680cc8b0 2024-04-25T09:10:05.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.575+0000 7f2965e00640 1 --2- 172.21.15.173:0/2084611123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29680cc8b0 0x7f29680ccd30 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f2954009870 tx=0x7f295401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7d5ccb62b95433 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:05.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.575+0000 7f2965400640 1 -- 172.21.15.173:0/2084611123 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29540b0070 con 0x7f29680cc8b0 2024-04-25T09:10:05.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.575+0000 7f2965400640 1 -- 172.21.15.173:0/2084611123 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29540ab600 con 0x7f29680cc8b0 2024-04-25T09:10:05.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.575+0000 7f2965400640 1 -- 172.21.15.173:0/2084611123 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29540ab9d0 con 0x7f29680cc8b0 2024-04-25T09:10:05.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f296d400640 1 -- 172.21.15.173:0/2084611123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29680cc8b0 msgr2=0x7f29680ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f296d400640 1 --2- 172.21.15.173:0/2084611123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29680cc8b0 0x7f29680ccd30 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f2954009870 tx=0x7f295401c340 comp rx=0 tx=0).stop 2024-04-25T09:10:05.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f296d400640 1 -- 172.21.15.173:0/2084611123 shutdown_connections 2024-04-25T09:10:05.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f296d400640 1 --2- 172.21.15.173:0/2084611123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29680cc8b0 0x7f29680ccd30 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f296d400640 1 --2- 172.21.15.173:0/2084611123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2968145250 0x7f296815c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f296d400640 1 -- 172.21.15.173:0/2084611123 >> 172.21.15.173:0/2084611123 conn(0x7f296806ac90 msgr2=0x7f296806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:05.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f296d400640 1 -- 172.21.15.173:0/2084611123 shutdown_connections 2024-04-25T09:10:05.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f296d400640 1 -- 172.21.15.173:0/2084611123 wait complete. 2024-04-25T09:10:05.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f296d400640 1 Processor -- start 2024-04-25T09:10:05.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f296d400640 1 -- start start 2024-04-25T09:10:05.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f296d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2968071320 0x7f29680b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f296d400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f29680cc8b0 0x7f29681f6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f296d400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2968145250 0x7f29680ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f296d400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296806ef80 con 0x7f2968071320 2024-04-25T09:10:05.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f296d400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2968145630 con 0x7f2968145250 2024-04-25T09:10:05.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f296d400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296806d380 con 0x7f29680cc8b0 2024-04-25T09:10:05.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f2966800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2968071320 0x7f29680b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f2966800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2968071320 0x7f29680b0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51340/0 (socket says 172.21.15.173:51340) 2024-04-25T09:10:05.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f2966800640 1 -- 172.21.15.173:0/2102277134 learned_addr learned my addr 172.21.15.173:0/2102277134 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:05.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f2965e00640 1 --2- 172.21.15.173:0/2102277134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f29680cc8b0 0x7f29681f6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f2967200640 1 --2- 172.21.15.173:0/2102277134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2968145250 0x7f29680ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f2966800640 1 -- 172.21.15.173:0/2102277134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f29680cc8b0 msgr2=0x7f29681f6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f2966800640 1 --2- 172.21.15.173:0/2102277134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f29680cc8b0 0x7f29681f6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f2966800640 1 -- 172.21.15.173:0/2102277134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2968145250 msgr2=0x7f29680ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f2966800640 1 --2- 172.21.15.173:0/2102277134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2968145250 0x7f29680ceb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.579+0000 7f2966800640 1 -- 172.21.15.173:0/2102277134 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2968141410 con 0x7f2968071320 2024-04-25T09:10:05.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.583+0000 7f2966800640 1 --2- 172.21.15.173:0/2102277134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2968071320 0x7f29680b0ac0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f2958007e70 tx=0x7f295800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:05.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.583+0000 7f295ea00640 1 -- 172.21.15.173:0/2102277134 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2958014420 con 0x7f2968071320 2024-04-25T09:10:05.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.583+0000 7f295ea00640 1 -- 172.21.15.173:0/2102277134 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2958019070 con 0x7f2968071320 2024-04-25T09:10:05.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.583+0000 7f295ea00640 1 -- 172.21.15.173:0/2102277134 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2958014800 con 0x7f2968071320 2024-04-25T09:10:05.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.583+0000 7f296d400640 1 -- 172.21.15.173:0/2102277134 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29681416f0 con 0x7f2968071320 2024-04-25T09:10:05.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.583+0000 7f296d400640 1 -- 172.21.15.173:0/2102277134 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2968141cb0 con 0x7f2968071320 2024-04-25T09:10:05.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.583+0000 7f296d400640 1 -- 172.21.15.173:0/2102277134 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2968073a40 con 0x7f2968071320 2024-04-25T09:10:05.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.583+0000 7f295ea00640 1 -- 172.21.15.173:0/2102277134 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f29580149a0 con 0x7f2968071320 2024-04-25T09:10:05.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.583+0000 7f295ea00640 1 --2- 172.21.15.173:0/2102277134 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2948066f60 0x7f2948069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.583+0000 7f295ea00640 1 -- 172.21.15.173:0/2102277134 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2958085870 con 0x7f2968071320 2024-04-25T09:10:05.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.583+0000 7f2965e00640 1 --2- 172.21.15.173:0/2102277134 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2948066f60 0x7f2948069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.587+0000 7f2965e00640 1 --2- 172.21.15.173:0/2102277134 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2948066f60 0x7f2948069420 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f29540ad000 tx=0x7f2954008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:05.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.587+0000 7f295ea00640 1 -- 172.21.15.173:0/2102277134 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2958056090 con 0x7f2968071320 2024-04-25T09:10:05.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.743+0000 7f296d400640 1 -- 172.21.15.173:0/2102277134 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29680b4640 con 0x7f2968071320 2024-04-25T09:10:05.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.743+0000 7f295ea00640 1 -- 172.21.15.173:0/2102277134 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16945 (secure 0 0 0) 0x7f295805a130 con 0x7f2968071320 2024-04-25T09:10:05.733 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:05.733 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":97,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:09:27.873210+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:09:24.629351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T09:09:25.248841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:05.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.747+0000 7f296d400640 1 -- 172.21.15.173:0/2102277134 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2948066f60 msgr2=0x7f2948069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.747+0000 7f296d400640 1 --2- 172.21.15.173:0/2102277134 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2948066f60 0x7f2948069420 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f29540ad000 tx=0x7f2954008040 comp rx=0 tx=0).stop 2024-04-25T09:10:05.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.747+0000 7f296d400640 1 -- 172.21.15.173:0/2102277134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2968071320 msgr2=0x7f29680b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.747+0000 7f296d400640 1 --2- 172.21.15.173:0/2102277134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2968071320 0x7f29680b0ac0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f2958007e70 tx=0x7f295800e4b0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.747+0000 7f296d400640 1 -- 172.21.15.173:0/2102277134 shutdown_connections 2024-04-25T09:10:05.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.747+0000 7f296d400640 1 --2- 172.21.15.173:0/2102277134 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2948066f60 0x7f2948069420 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.747+0000 7f296d400640 1 --2- 172.21.15.173:0/2102277134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2968145250 0x7f29680ceb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.747+0000 7f296d400640 1 --2- 172.21.15.173:0/2102277134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f29680cc8b0 0x7f29681f6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.747+0000 7f296d400640 1 --2- 172.21.15.173:0/2102277134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2968071320 0x7f29680b0ac0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.747+0000 7f296d400640 1 -- 172.21.15.173:0/2102277134 >> 172.21.15.173:0/2102277134 conn(0x7f296806ac90 msgr2=0x7f2968144420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:05.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.747+0000 7f296d400640 1 -- 172.21.15.173:0/2102277134 shutdown_connections 2024-04-25T09:10:05.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.747+0000 7f296d400640 1 -- 172.21.15.173:0/2102277134 wait complete. 2024-04-25T09:10:05.754 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:09:24.629351+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:09:25.248841+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:10:05.754 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:10:05.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.907+0000 7f72e1400640 1 Processor -- start 2024-04-25T09:10:05.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.907+0000 7f72e1400640 1 -- start start 2024-04-25T09:10:05.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.907+0000 7f72e1400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f72dc1594c0 0x7f72dc15be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.907+0000 7f72e1400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72dc15c3d0 0x7f72dc0cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.907+0000 7f72e1400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72dc1598a0 con 0x7f72dc0cfbe0 2024-04-25T09:10:05.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.907+0000 7f72e1400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc0c6ba0 con 0x7f72dc1594c0 2024-04-25T09:10:05.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.907+0000 7f72e1400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc0c8600 con 0x7f72dc15c3d0 2024-04-25T09:10:05.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.907+0000 7f72da800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f72dc1594c0 0x7f72dc15be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.907+0000 7f72da800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f72dc1594c0 0x7f72dc15be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51346/0 (socket says 172.21.15.173:51346) 2024-04-25T09:10:05.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.907+0000 7f72da800640 1 -- 172.21.15.173:0/2404446307 learned_addr learned my addr 172.21.15.173:0/2404446307 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:05.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.907+0000 7f72d1e00640 1 --2- 172.21.15.173:0/2404446307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72dc15c3d0 0x7f72dc0cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.907+0000 7f72da800640 1 -- 172.21.15.173:0/2404446307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72dc15c3d0 msgr2=0x7f72dc0cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:05.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.907+0000 7f72da800640 1 --2- 172.21.15.173:0/2404446307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72dc15c3d0 0x7f72dc0cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.907+0000 7f72da800640 1 -- 172.21.15.173:0/2404446307 >> v1:172.21.15.194:6789/0 conn(0x7f72dc0cfbe0 legacy=0x7f72dc070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:05.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.907+0000 7f72da800640 1 -- 172.21.15.173:0/2404446307 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc15c9d0 con 0x7f72dc1594c0 2024-04-25T09:10:05.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.911+0000 7f72da800640 1 --2- 172.21.15.173:0/2404446307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72dc1594c0 0x7f72dc15be90 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009870 tx=0x7f72cc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df226b3d1ce0edf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:05.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.911+0000 7f72d9e00640 1 -- 172.21.15.173:0/2404446307 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0b2070 con 0x7f72dc1594c0 2024-04-25T09:10:05.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.911+0000 7f72d9e00640 1 -- 172.21.15.173:0/2404446307 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc0ad640 con 0x7f72dc1594c0 2024-04-25T09:10:05.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.911+0000 7f72d9e00640 1 -- 172.21.15.173:0/2404446307 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0ada10 con 0x7f72dc1594c0 2024-04-25T09:10:05.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.911+0000 7f72e1400640 1 -- 172.21.15.173:0/2404446307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72dc1594c0 msgr2=0x7f72dc15be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.911+0000 7f72e1400640 1 --2- 172.21.15.173:0/2404446307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72dc1594c0 0x7f72dc15be90 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009870 tx=0x7f72cc01c560 comp rx=0 tx=0).stop 2024-04-25T09:10:05.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.911+0000 7f72e1400640 1 -- 172.21.15.173:0/2404446307 shutdown_connections 2024-04-25T09:10:05.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.911+0000 7f72e1400640 1 --2- 172.21.15.173:0/2404446307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72dc15c3d0 0x7f72dc0cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.911+0000 7f72e1400640 1 --2- 172.21.15.173:0/2404446307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72dc1594c0 0x7f72dc15be90 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.911+0000 7f72e1400640 1 -- 172.21.15.173:0/2404446307 >> 172.21.15.173:0/2404446307 conn(0x7f72dc06f5b0 msgr2=0x7f72dc06f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:05.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.911+0000 7f72e1400640 1 -- 172.21.15.173:0/2404446307 shutdown_connections 2024-04-25T09:10:05.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.911+0000 7f72e1400640 1 -- 172.21.15.173:0/2404446307 wait complete. 2024-04-25T09:10:05.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72e1400640 1 Processor -- start 2024-04-25T09:10:05.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72e1400640 1 -- start start 2024-04-25T09:10:05.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72e1400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72dc0cfbe0 0x7f72dc0ce930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72e1400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72dc1594c0 0x7f72dc1454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72e1400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72dc15c3d0 0x7f72dc15b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72e1400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc15cf90 con 0x7f72dc0cfbe0 2024-04-25T09:10:05.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72e1400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc0cfff0 con 0x7f72dc1594c0 2024-04-25T09:10:05.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72e1400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc15d110 con 0x7f72dc15c3d0 2024-04-25T09:10:05.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72da800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72dc0cfbe0 0x7f72dc0ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72da800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72dc0cfbe0 0x7f72dc0ce930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51352/0 (socket says 172.21.15.173:51352) 2024-04-25T09:10:05.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72da800640 1 -- 172.21.15.173:0/2651233525 learned_addr learned my addr 172.21.15.173:0/2651233525 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:05.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72d1e00640 1 --2- 172.21.15.173:0/2651233525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72dc1594c0 0x7f72dc1454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72db200640 1 --2- 172.21.15.173:0/2651233525 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72dc15c3d0 0x7f72dc15b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72da800640 1 -- 172.21.15.173:0/2651233525 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72dc15c3d0 msgr2=0x7f72dc15b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72da800640 1 --2- 172.21.15.173:0/2651233525 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72dc15c3d0 0x7f72dc15b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72da800640 1 -- 172.21.15.173:0/2651233525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72dc1594c0 msgr2=0x7f72dc1454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72da800640 1 --2- 172.21.15.173:0/2651233525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72dc1594c0 0x7f72dc1454a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72da800640 1 -- 172.21.15.173:0/2651233525 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc1459e0 con 0x7f72dc0cfbe0 2024-04-25T09:10:05.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72da800640 1 --2- 172.21.15.173:0/2651233525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72dc0cfbe0 0x7f72dc0ce930 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0b0040 tx=0x7f72cc019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72d3400640 1 -- 172.21.15.173:0/2651233525 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0b2040 con 0x7f72dc0cfbe0 2024-04-25T09:10:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72d3400640 1 -- 172.21.15.173:0/2651233525 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc0bb070 con 0x7f72dc0cfbe0 2024-04-25T09:10:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72d3400640 1 -- 172.21.15.173:0/2651233525 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0b6880 con 0x7f72dc0cfbe0 2024-04-25T09:10:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72e1400640 1 -- 172.21.15.173:0/2651233525 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72dc159a70 con 0x7f72dc0cfbe0 2024-04-25T09:10:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72e1400640 1 -- 172.21.15.173:0/2651233525 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72dc15a030 con 0x7f72dc0cfbe0 2024-04-25T09:10:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.915+0000 7f72e1400640 1 -- 172.21.15.173:0/2651233525 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72dc073ab0 con 0x7f72dc0cfbe0 2024-04-25T09:10:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.919+0000 7f72d3400640 1 -- 172.21.15.173:0/2651233525 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f72cc0ad4c0 con 0x7f72dc0cfbe0 2024-04-25T09:10:05.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.919+0000 7f72d3400640 1 --2- 172.21.15.173:0/2651233525 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f72b8066f60 0x7f72b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.919+0000 7f72d3400640 1 -- 172.21.15.173:0/2651233525 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f72cc11f130 con 0x7f72dc0cfbe0 2024-04-25T09:10:05.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.919+0000 7f72d1e00640 1 --2- 172.21.15.173:0/2651233525 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f72b8066f60 0x7f72b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.919+0000 7f72d1e00640 1 --2- 172.21.15.173:0/2651233525 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f72b8066f60 0x7f72b8069420 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f72dc1f9f70 tx=0x7f72c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:05.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:05.923+0000 7f72d3400640 1 -- 172.21.15.173:0/2651233525 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f72cc016150 con 0x7f72dc0cfbe0 2024-04-25T09:10:06.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.075+0000 7f72e1400640 1 -- 172.21.15.173:0/2651233525 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72dc0cf160 con 0x7f72dc0cfbe0 2024-04-25T09:10:06.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.075+0000 7f72d3400640 1 -- 172.21.15.173:0/2651233525 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7f72cc0f00c0 con 0x7f72dc0cfbe0 2024-04-25T09:10:06.066 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:10:06.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.079+0000 7f72e1400640 1 -- 172.21.15.173:0/2651233525 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f72b8066f60 msgr2=0x7f72b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.079+0000 7f72e1400640 1 --2- 172.21.15.173:0/2651233525 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f72b8066f60 0x7f72b8069420 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f72dc1f9f70 tx=0x7f72c4008040 comp rx=0 tx=0).stop 2024-04-25T09:10:06.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.079+0000 7f72e1400640 1 -- 172.21.15.173:0/2651233525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72dc0cfbe0 msgr2=0x7f72dc0ce930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.079+0000 7f72e1400640 1 --2- 172.21.15.173:0/2651233525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72dc0cfbe0 0x7f72dc0ce930 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0b0040 tx=0x7f72cc019300 comp rx=0 tx=0).stop 2024-04-25T09:10:06.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.079+0000 7f72e1400640 1 -- 172.21.15.173:0/2651233525 shutdown_connections 2024-04-25T09:10:06.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.079+0000 7f72e1400640 1 --2- 172.21.15.173:0/2651233525 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f72b8066f60 0x7f72b8069420 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.079+0000 7f72e1400640 1 --2- 172.21.15.173:0/2651233525 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72dc15c3d0 0x7f72dc15b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.079+0000 7f72e1400640 1 --2- 172.21.15.173:0/2651233525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72dc1594c0 0x7f72dc1454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.079+0000 7f72e1400640 1 --2- 172.21.15.173:0/2651233525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72dc0cfbe0 0x7f72dc0ce930 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.079+0000 7f72e1400640 1 -- 172.21.15.173:0/2651233525 >> 172.21.15.173:0/2651233525 conn(0x7f72dc06f5b0 msgr2=0x7f72dc151ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:06.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.079+0000 7f72e1400640 1 -- 172.21.15.173:0/2651233525 shutdown_connections 2024-04-25T09:10:06.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.079+0000 7f72e1400640 1 -- 172.21.15.173:0/2651233525 wait complete. 2024-04-25T09:10:06.087 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:10:06.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.235+0000 7fa24c800640 1 Processor -- start 2024-04-25T09:10:06.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.235+0000 7fa24c800640 1 -- start start 2024-04-25T09:10:06.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.235+0000 7fa24c800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa244145290 0x7fa24415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.235+0000 7fa24c800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa2440cc260 0x7fa2440cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.235+0000 7fa24c800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24415c5f0 con 0x7fa2440b3fe0 2024-04-25T09:10:06.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.235+0000 7fa24c800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24406d4b0 con 0x7fa2440cc260 2024-04-25T09:10:06.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.235+0000 7fa24c800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24406d790 con 0x7fa244145290 2024-04-25T09:10:06.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.239+0000 7fa24a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa2440cc260 0x7fa2440cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.239+0000 7fa249400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa2440b3fe0 0x7fa2440b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53604/0 (socket says 172.21.15.173:53604) 2024-04-25T09:10:06.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.239+0000 7fa249400640 1 -- 172.21.15.173:0/3619966115 learned_addr learned my addr 172.21.15.173:0/3619966115 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:06.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.239+0000 7fa249e00640 1 --2- 172.21.15.173:0/3619966115 >> v2:172.21.15.194:3300/0 conn(0x7fa244145290 0x7fa24415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.239+0000 7fa24a800640 1 -- 172.21.15.173:0/3619966115 >> v2:172.21.15.194:3300/0 conn(0x7fa244145290 msgr2=0x7fa24415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:06.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.239+0000 7fa24a800640 1 --2- 172.21.15.173:0/3619966115 >> v2:172.21.15.194:3300/0 conn(0x7fa244145290 0x7fa24415c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.239+0000 7fa24a800640 1 -- 172.21.15.173:0/3619966115 >> v1:172.21.15.173:6789/0 conn(0x7fa2440b3fe0 legacy=0x7fa2440b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.239+0000 7fa24a800640 1 -- 172.21.15.173:0/3619966115 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24406da70 con 0x7fa2440cc260 2024-04-25T09:10:06.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.239+0000 7fa248a00640 1 -- 172.21.15.173:0/3619966115 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2921291097 0 0) 0x7fa234001120 con 0x7fa2440b3fe0 2024-04-25T09:10:06.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.239+0000 7fa24a800640 1 --2- 172.21.15.173:0/3619966115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2440cc260 0x7fa2440cc670 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fa2440d0800 tx=0x7fa24001c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465fb950d381118d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:06.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.239+0000 7fa248a00640 1 -- 172.21.15.173:0/3619966115 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2400b2070 con 0x7fa2440cc260 2024-04-25T09:10:06.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa248a00640 1 -- 172.21.15.173:0/3619966115 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2400a57e0 con 0x7fa2440cc260 2024-04-25T09:10:06.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa248a00640 1 -- 172.21.15.173:0/3619966115 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2400a5bb0 con 0x7fa2440cc260 2024-04-25T09:10:06.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa24c800640 1 -- 172.21.15.173:0/3619966115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2440cc260 msgr2=0x7fa2440cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa24c800640 1 --2- 172.21.15.173:0/3619966115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2440cc260 0x7fa2440cc670 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fa2440d0800 tx=0x7fa24001c810 comp rx=0 tx=0).stop 2024-04-25T09:10:06.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa24c800640 1 -- 172.21.15.173:0/3619966115 shutdown_connections 2024-04-25T09:10:06.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa24c800640 1 --2- 172.21.15.173:0/3619966115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2440cc260 0x7fa2440cc670 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa24c800640 1 --2- 172.21.15.173:0/3619966115 >> v2:172.21.15.194:3300/0 conn(0x7fa244145290 0x7fa24415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa24c800640 1 -- 172.21.15.173:0/3619966115 >> 172.21.15.173:0/3619966115 conn(0x7fa24406ac90 msgr2=0x7fa24406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:06.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa24c800640 1 -- 172.21.15.173:0/3619966115 shutdown_connections 2024-04-25T09:10:06.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa24c800640 1 -- 172.21.15.173:0/3619966115 wait complete. 2024-04-25T09:10:06.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa24c800640 1 Processor -- start 2024-04-25T09:10:06.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa24c800640 1 -- start start 2024-04-25T09:10:06.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa24c800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2440b3fe0 0x7fa244160510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa24c800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2440cc260 0x7fa2441416a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa24c800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa244145290 0x7fa244143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa24c800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24406ed60 con 0x7fa2440cc260 2024-04-25T09:10:06.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa24c800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24406eee0 con 0x7fa244145290 2024-04-25T09:10:06.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa24c800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24406f060 con 0x7fa2440b3fe0 2024-04-25T09:10:06.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa249400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2440cc260 0x7fa2441416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa249400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2440cc260 0x7fa2441416a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51368/0 (socket says 172.21.15.173:51368) 2024-04-25T09:10:06.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa249400640 1 -- 172.21.15.173:0/2894849112 learned_addr learned my addr 172.21.15.173:0/2894849112 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:06.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa249400640 1 -- 172.21.15.173:0/2894849112 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2440b3fe0 msgr2=0x7fa244160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa249400640 1 --2- 172.21.15.173:0/2894849112 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2440b3fe0 0x7fa244160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa24a800640 1 --2- 172.21.15.173:0/2894849112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa244145290 0x7fa244143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.243+0000 7fa249400640 1 -- 172.21.15.173:0/2894849112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa244145290 msgr2=0x7fa244143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.247+0000 7fa249400640 1 --2- 172.21.15.173:0/2894849112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa244145290 0x7fa244143e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.247+0000 7fa249400640 1 -- 172.21.15.173:0/2894849112 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24415f750 con 0x7fa2440cc260 2024-04-25T09:10:06.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.247+0000 7fa24a800640 1 --2- 172.21.15.173:0/2894849112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa244145290 0x7fa244143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:06.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.247+0000 7fa249400640 1 --2- 172.21.15.173:0/2894849112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2440cc260 0x7fa2441416a0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fa234007fd0 tx=0x7fa23400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:06.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.247+0000 7fa23e000640 1 -- 172.21.15.173:0/2894849112 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa234017070 con 0x7fa2440cc260 2024-04-25T09:10:06.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.247+0000 7fa23e000640 1 -- 172.21.15.173:0/2894849112 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa234005d10 con 0x7fa2440cc260 2024-04-25T09:10:06.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.247+0000 7fa24c800640 1 -- 172.21.15.173:0/2894849112 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24415fa30 con 0x7fa2440cc260 2024-04-25T09:10:06.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.247+0000 7fa23e000640 1 -- 172.21.15.173:0/2894849112 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa234007310 con 0x7fa2440cc260 2024-04-25T09:10:06.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.247+0000 7fa24c800640 1 -- 172.21.15.173:0/2894849112 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24415fff0 con 0x7fa2440cc260 2024-04-25T09:10:06.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.247+0000 7fa24c800640 1 -- 172.21.15.173:0/2894849112 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa244073ab0 con 0x7fa2440cc260 2024-04-25T09:10:06.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.247+0000 7fa23e000640 1 -- 172.21.15.173:0/2894849112 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa23401a070 con 0x7fa2440cc260 2024-04-25T09:10:06.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.247+0000 7fa23e000640 1 --2- 172.21.15.173:0/2894849112 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa228066f60 0x7fa228069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.247+0000 7fa23e000640 1 -- 172.21.15.173:0/2894849112 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa2340845e0 con 0x7fa2440cc260 2024-04-25T09:10:06.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.247+0000 7fa249e00640 1 --2- 172.21.15.173:0/2894849112 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa228066f60 0x7fa228069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.251+0000 7fa249e00640 1 --2- 172.21.15.173:0/2894849112 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa228066f60 0x7fa228069420 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa23800b850 tx=0x7fa238008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:06.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.251+0000 7fa23e000640 1 -- 172.21.15.173:0/2894849112 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa24415c5f0 con 0x7fa2440cc260 2024-04-25T09:10:06.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.407+0000 7fa24c800640 1 -- 172.21.15.173:0/2894849112 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa24415e600 con 0x7fa2440cc260 2024-04-25T09:10:06.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.411+0000 7fa23e000640 1 -- 172.21.15.173:0/2894849112 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa234055460 con 0x7fa2440cc260 2024-04-25T09:10:06.399 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:10:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.411+0000 7fa24c800640 1 -- 172.21.15.173:0/2894849112 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa228066f60 msgr2=0x7fa228069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.411+0000 7fa24c800640 1 --2- 172.21.15.173:0/2894849112 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa228066f60 0x7fa228069420 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa23800b850 tx=0x7fa238008040 comp rx=0 tx=0).stop 2024-04-25T09:10:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.411+0000 7fa24c800640 1 -- 172.21.15.173:0/2894849112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2440cc260 msgr2=0x7fa2441416a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.411+0000 7fa24c800640 1 --2- 172.21.15.173:0/2894849112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2440cc260 0x7fa2441416a0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fa234007fd0 tx=0x7fa23400c8e0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.411+0000 7fa24c800640 1 -- 172.21.15.173:0/2894849112 shutdown_connections 2024-04-25T09:10:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.411+0000 7fa24c800640 1 --2- 172.21.15.173:0/2894849112 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa228066f60 0x7fa228069420 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.411+0000 7fa24c800640 1 --2- 172.21.15.173:0/2894849112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa244145290 0x7fa244143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.411+0000 7fa24c800640 1 --2- 172.21.15.173:0/2894849112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2440cc260 0x7fa2441416a0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.411+0000 7fa24c800640 1 --2- 172.21.15.173:0/2894849112 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2440b3fe0 0x7fa244160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.411+0000 7fa24c800640 1 -- 172.21.15.173:0/2894849112 >> 172.21.15.173:0/2894849112 conn(0x7fa24406ac90 msgr2=0x7fa24406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.411+0000 7fa24c800640 1 -- 172.21.15.173:0/2894849112 shutdown_connections 2024-04-25T09:10:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.411+0000 7fa24c800640 1 -- 172.21.15.173:0/2894849112 wait complete. 2024-04-25T09:10:06.420 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:10:06.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.567+0000 7fda68400640 1 Processor -- start 2024-04-25T09:10:06.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.567+0000 7fda68400640 1 -- start start 2024-04-25T09:10:06.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.567+0000 7fda68400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fda600aeb90 0x7fda600cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.571+0000 7fda68400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda60071570 con 0x7fda600aef70 2024-04-25T09:10:06.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.571+0000 7fda68400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda60071850 con 0x7fda600ce2b0 2024-04-25T09:10:06.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.571+0000 7fda68400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda60071320 con 0x7fda600aeb90 2024-04-25T09:10:06.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.571+0000 7fda65000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fda600aef70 0x7fda600cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53616/0 (socket says 172.21.15.173:53616) 2024-04-25T09:10:06.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.571+0000 7fda65000640 1 -- 172.21.15.173:0/65906772 learned_addr learned my addr 172.21.15.173:0/65906772 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:06.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.571+0000 7fda65a00640 1 --2- 172.21.15.173:0/65906772 >> v2:172.21.15.194:3300/0 conn(0x7fda600aeb90 0x7fda600cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.571+0000 7fda5fe00640 1 -- 172.21.15.173:0/65906772 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267955517 0 0) 0x7fda60071570 con 0x7fda600aef70 2024-04-25T09:10:06.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.571+0000 7fda5fe00640 1 -- 172.21.15.173:0/65906772 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda48005740 con 0x7fda600aef70 2024-04-25T09:10:06.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.571+0000 7fda65a00640 1 -- 172.21.15.173:0/65906772 >> v1:172.21.15.194:6789/0 conn(0x7fda600ce2b0 legacy=0x7fda6015af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.571+0000 7fda65a00640 1 -- 172.21.15.173:0/65906772 >> v1:172.21.15.173:6789/0 conn(0x7fda600aef70 legacy=0x7fda600cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.571+0000 7fda65a00640 1 -- 172.21.15.173:0/65906772 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda60071b30 con 0x7fda600aeb90 2024-04-25T09:10:06.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.571+0000 7fda65a00640 1 --2- 172.21.15.173:0/65906772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda600aeb90 0x7fda600cc0d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fda540097c0 tx=0x7fda5401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b20236bf16aa53fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:06.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda5fe00640 1 -- 172.21.15.173:0/65906772 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda540b0070 con 0x7fda600aeb90 2024-04-25T09:10:06.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda5fe00640 1 -- 172.21.15.173:0/65906772 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda540ab600 con 0x7fda600aeb90 2024-04-25T09:10:06.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda5fe00640 1 -- 172.21.15.173:0/65906772 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda540ab9b0 con 0x7fda600aeb90 2024-04-25T09:10:06.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda68400640 1 -- 172.21.15.173:0/65906772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda600aeb90 msgr2=0x7fda600cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda68400640 1 --2- 172.21.15.173:0/65906772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda600aeb90 0x7fda600cc0d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fda540097c0 tx=0x7fda5401c410 comp rx=0 tx=0).stop 2024-04-25T09:10:06.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda68400640 1 -- 172.21.15.173:0/65906772 shutdown_connections 2024-04-25T09:10:06.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda68400640 1 --2- 172.21.15.173:0/65906772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda600aeb90 0x7fda600cc0d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda68400640 1 -- 172.21.15.173:0/65906772 >> 172.21.15.173:0/65906772 conn(0x7fda6006ac90 msgr2=0x7fda6006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:06.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda68400640 1 -- 172.21.15.173:0/65906772 shutdown_connections 2024-04-25T09:10:06.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda68400640 1 -- 172.21.15.173:0/65906772 wait complete. 2024-04-25T09:10:06.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda68400640 1 Processor -- start 2024-04-25T09:10:06.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda68400640 1 -- start start 2024-04-25T09:10:06.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda68400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda600aeb90 0x7fda601f66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda68400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda600aef70 0x7fda60150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda68400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda600ce2b0 0x7fda60159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda68400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda600cfab0 con 0x7fda600ce2b0 2024-04-25T09:10:06.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda68400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda600cf930 con 0x7fda600aeb90 2024-04-25T09:10:06.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda68400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda600cfc30 con 0x7fda600aef70 2024-04-25T09:10:06.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda66400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda600ce2b0 0x7fda60159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda66400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda600ce2b0 0x7fda60159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51370/0 (socket says 172.21.15.173:51370) 2024-04-25T09:10:06.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda66400640 1 -- 172.21.15.173:0/2977383827 learned_addr learned my addr 172.21.15.173:0/2977383827 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:06.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda65a00640 1 --2- 172.21.15.173:0/2977383827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda600aeb90 0x7fda601f66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.575+0000 7fda65000640 1 --2- 172.21.15.173:0/2977383827 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda600aef70 0x7fda60150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.579+0000 7fda66400640 1 -- 172.21.15.173:0/2977383827 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda600aef70 msgr2=0x7fda60150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.579+0000 7fda66400640 1 --2- 172.21.15.173:0/2977383827 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda600aef70 0x7fda60150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.579+0000 7fda66400640 1 -- 172.21.15.173:0/2977383827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda600aeb90 msgr2=0x7fda601f66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.579+0000 7fda66400640 1 --2- 172.21.15.173:0/2977383827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda600aeb90 0x7fda601f66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.579+0000 7fda66400640 1 -- 172.21.15.173:0/2977383827 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda601f6c30 con 0x7fda600ce2b0 2024-04-25T09:10:06.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.579+0000 7fda66400640 1 --2- 172.21.15.173:0/2977383827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda600ce2b0 0x7fda60159a00 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fda5800c7a0 tx=0x7fda5800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:06.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.579+0000 7fda5d600640 1 -- 172.21.15.173:0/2977383827 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58003b80 con 0x7fda600ce2b0 2024-04-25T09:10:06.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.579+0000 7fda5d600640 1 -- 172.21.15.173:0/2977383827 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda58003d20 con 0x7fda600ce2b0 2024-04-25T09:10:06.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.579+0000 7fda5d600640 1 -- 172.21.15.173:0/2977383827 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5800aa30 con 0x7fda600ce2b0 2024-04-25T09:10:06.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.579+0000 7fda68400640 1 -- 172.21.15.173:0/2977383827 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda60151670 con 0x7fda600ce2b0 2024-04-25T09:10:06.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.579+0000 7fda68400640 1 -- 172.21.15.173:0/2977383827 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda600a9160 con 0x7fda600ce2b0 2024-04-25T09:10:06.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.579+0000 7fda68400640 1 -- 172.21.15.173:0/2977383827 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda60073ab0 con 0x7fda600ce2b0 2024-04-25T09:10:06.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.579+0000 7fda5d600640 1 -- 172.21.15.173:0/2977383827 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fda5800abd0 con 0x7fda600ce2b0 2024-04-25T09:10:06.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.579+0000 7fda5d600640 1 --2- 172.21.15.173:0/2977383827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fda40066f60 0x7fda40069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.579+0000 7fda5d600640 1 -- 172.21.15.173:0/2977383827 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fda58084e80 con 0x7fda600ce2b0 2024-04-25T09:10:06.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.579+0000 7fda65a00640 1 --2- 172.21.15.173:0/2977383827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fda40066f60 0x7fda40069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.583+0000 7fda65a00640 1 --2- 172.21.15.173:0/2977383827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fda40066f60 0x7fda40069420 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fda540ad000 tx=0x7fda540a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:06.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.583+0000 7fda5d600640 1 -- 172.21.15.173:0/2977383827 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fda58055740 con 0x7fda600ce2b0 2024-04-25T09:10:06.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.739+0000 7fda68400640 1 -- 172.21.15.173:0/2977383827 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fda6006c300 con 0x7fda600ce2b0 2024-04-25T09:10:06.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.739+0000 7fda5d600640 1 -- 172.21.15.173:0/2977383827 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) v1 ==== 100+0+11 (secure 0 0 0) 0x7fda580597e0 con 0x7fda600ce2b0 2024-04-25T09:10:06.728 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:10:06.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.739+0000 7fda68400640 1 -- 172.21.15.173:0/2977383827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fda40066f60 msgr2=0x7fda40069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.739+0000 7fda68400640 1 --2- 172.21.15.173:0/2977383827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fda40066f60 0x7fda40069420 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fda540ad000 tx=0x7fda540a6000 comp rx=0 tx=0).stop 2024-04-25T09:10:06.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.739+0000 7fda68400640 1 -- 172.21.15.173:0/2977383827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda600ce2b0 msgr2=0x7fda60159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.739+0000 7fda68400640 1 --2- 172.21.15.173:0/2977383827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda600ce2b0 0x7fda60159a00 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fda5800c7a0 tx=0x7fda5800cc60 comp rx=0 tx=0).stop 2024-04-25T09:10:06.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.739+0000 7fda68400640 1 -- 172.21.15.173:0/2977383827 shutdown_connections 2024-04-25T09:10:06.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.739+0000 7fda68400640 1 --2- 172.21.15.173:0/2977383827 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fda40066f60 0x7fda40069420 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.739+0000 7fda68400640 1 --2- 172.21.15.173:0/2977383827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda600ce2b0 0x7fda60159a00 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.739+0000 7fda68400640 1 --2- 172.21.15.173:0/2977383827 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda600aef70 0x7fda60150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.739+0000 7fda68400640 1 --2- 172.21.15.173:0/2977383827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda600aeb90 0x7fda601f66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.739+0000 7fda68400640 1 -- 172.21.15.173:0/2977383827 >> 172.21.15.173:0/2977383827 conn(0x7fda6006ac90 msgr2=0x7fda600b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:06.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.739+0000 7fda68400640 1 -- 172.21.15.173:0/2977383827 shutdown_connections 2024-04-25T09:10:06.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.739+0000 7fda68400640 1 -- 172.21.15.173:0/2977383827 wait complete. 2024-04-25T09:10:06.749 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:10:06.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.899+0000 7fbadb800640 1 Processor -- start 2024-04-25T09:10:06.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.899+0000 7fbadb800640 1 -- start start 2024-04-25T09:10:06.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.899+0000 7fbadb800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbad409a160 0x7fbad40c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.899+0000 7fbadb800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad40cc7a0 con 0x7fbad415bab0 2024-04-25T09:10:06.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.899+0000 7fbadb800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad40cca80 con 0x7fbad40d02a0 2024-04-25T09:10:06.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.899+0000 7fbadb800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad40ccd60 con 0x7fbad409a160 2024-04-25T09:10:06.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.899+0000 7fbad8e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fbad415bab0 0x7fbad40cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53622/0 (socket says 172.21.15.173:53622) 2024-04-25T09:10:06.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.899+0000 7fbad8e00640 1 -- 172.21.15.173:0/3693460018 learned_addr learned my addr 172.21.15.173:0/3693460018 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:06.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.899+0000 7fbad9800640 1 --2- 172.21.15.173:0/3693460018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbad409a160 0x7fbad40c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.899+0000 7fbad3e00640 1 -- 172.21.15.173:0/3693460018 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2356749304 0 0) 0x7fbad40cc7a0 con 0x7fbad415bab0 2024-04-25T09:10:06.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.899+0000 7fbad3e00640 1 -- 172.21.15.173:0/3693460018 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbab8003530 con 0x7fbad415bab0 2024-04-25T09:10:06.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.899+0000 7fbad3e00640 1 -- 172.21.15.173:0/3693460018 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970247429 0 0) 0x7fbad40cca80 con 0x7fbad40d02a0 2024-04-25T09:10:06.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.899+0000 7fbad3e00640 1 -- 172.21.15.173:0/3693460018 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbad40cc7a0 con 0x7fbad40d02a0 2024-04-25T09:10:06.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.899+0000 7fbad9800640 1 -- 172.21.15.173:0/3693460018 >> v1:172.21.15.194:6789/0 conn(0x7fbad40d02a0 legacy=0x7fbad4099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.899+0000 7fbad9800640 1 -- 172.21.15.173:0/3693460018 >> v1:172.21.15.173:6789/0 conn(0x7fbad415bab0 legacy=0x7fbad40cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.899+0000 7fbad9800640 1 -- 172.21.15.173:0/3693460018 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad40cd040 con 0x7fbad409a160 2024-04-25T09:10:06.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.903+0000 7fbad9800640 1 --2- 172.21.15.173:0/3693460018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbad409a160 0x7fbad40c5300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0097f0 tx=0x7fbacc01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5a95ab6cc62f77e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:06.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.903+0000 7fbad3e00640 1 -- 172.21.15.173:0/3693460018 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc0b1070 con 0x7fbad409a160 2024-04-25T09:10:06.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.903+0000 7fbad3e00640 1 -- 172.21.15.173:0/3693460018 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbacc0a8050 con 0x7fbad409a160 2024-04-25T09:10:06.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.903+0000 7fbad3e00640 1 -- 172.21.15.173:0/3693460018 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc0ac860 con 0x7fbad409a160 2024-04-25T09:10:06.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbadb800640 1 -- 172.21.15.173:0/3693460018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbad409a160 msgr2=0x7fbad40c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbadb800640 1 --2- 172.21.15.173:0/3693460018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbad409a160 0x7fbad40c5300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0097f0 tx=0x7fbacc01c4b0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbadb800640 1 -- 172.21.15.173:0/3693460018 shutdown_connections 2024-04-25T09:10:06.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbadb800640 1 --2- 172.21.15.173:0/3693460018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbad409a160 0x7fbad40c5300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbadb800640 1 -- 172.21.15.173:0/3693460018 >> 172.21.15.173:0/3693460018 conn(0x7fbad40b32a0 msgr2=0x7fbad40b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:06.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbadb800640 1 -- 172.21.15.173:0/3693460018 shutdown_connections 2024-04-25T09:10:06.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbadb800640 1 -- 172.21.15.173:0/3693460018 wait complete. 2024-04-25T09:10:06.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbadb800640 1 Processor -- start 2024-04-25T09:10:06.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbadb800640 1 -- start start 2024-04-25T09:10:06.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbadb800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbad409a160 0x7fbad4147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbadb800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbad40d02a0 0x7fbad4156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbadb800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbad415bab0 0x7fbad4156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbadb800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad40cc540 con 0x7fbad409a160 2024-04-25T09:10:06.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbadb800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad40cc3c0 con 0x7fbad415bab0 2024-04-25T09:10:06.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbadb800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad40cf540 con 0x7fbad40d02a0 2024-04-25T09:10:06.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbad8e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbad409a160 0x7fbad4147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbacbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbad40d02a0 0x7fbad4156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbad8e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbad409a160 0x7fbad4147ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51374/0 (socket says 172.21.15.173:51374) 2024-04-25T09:10:06.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbad8e00640 1 -- 172.21.15.173:0/3492078939 learned_addr learned my addr 172.21.15.173:0/3492078939 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:06.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.907+0000 7fbad9800640 1 --2- 172.21.15.173:0/3492078939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbad415bab0 0x7fbad4156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.911+0000 7fbad8e00640 1 -- 172.21.15.173:0/3492078939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbad40d02a0 msgr2=0x7fbad4156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.911+0000 7fbad8e00640 1 --2- 172.21.15.173:0/3492078939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbad40d02a0 0x7fbad4156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.911+0000 7fbad8e00640 1 -- 172.21.15.173:0/3492078939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbad415bab0 msgr2=0x7fbad4156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.911+0000 7fbad8e00640 1 --2- 172.21.15.173:0/3492078939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbad415bab0 0x7fbad4156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.911+0000 7fbad8e00640 1 -- 172.21.15.173:0/3492078939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad41480e0 con 0x7fbad409a160 2024-04-25T09:10:06.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.911+0000 7fbad8e00640 1 --2- 172.21.15.173:0/3492078939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbad409a160 0x7fbad4147ba0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fbac400cbc0 tx=0x7fbac400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:06.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.911+0000 7fbad1600640 1 -- 172.21.15.173:0/3492078939 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4017070 con 0x7fbad409a160 2024-04-25T09:10:06.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.911+0000 7fbad1600640 1 -- 172.21.15.173:0/3492078939 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac400ad40 con 0x7fbad409a160 2024-04-25T09:10:06.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.911+0000 7fbadb800640 1 -- 172.21.15.173:0/3492078939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad4166aa0 con 0x7fbad409a160 2024-04-25T09:10:06.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.911+0000 7fbad1600640 1 -- 172.21.15.173:0/3492078939 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4012640 con 0x7fbad409a160 2024-04-25T09:10:06.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.911+0000 7fbadb800640 1 -- 172.21.15.173:0/3492078939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad4164f10 con 0x7fbad409a160 2024-04-25T09:10:06.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.911+0000 7fbadb800640 1 -- 172.21.15.173:0/3492078939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad4073ab0 con 0x7fbad409a160 2024-04-25T09:10:06.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.911+0000 7fbad1600640 1 -- 172.21.15.173:0/3492078939 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbac401a070 con 0x7fbad409a160 2024-04-25T09:10:06.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.911+0000 7fbad1600640 1 --2- 172.21.15.173:0/3492078939 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbab0066f60 0x7fbab0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.915+0000 7fbad1600640 1 -- 172.21.15.173:0/3492078939 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbac4084fb0 con 0x7fbad409a160 2024-04-25T09:10:06.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.915+0000 7fbacbe00640 1 --2- 172.21.15.173:0/3492078939 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbab0066f60 0x7fbab0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.915+0000 7fbacbe00640 1 --2- 172.21.15.173:0/3492078939 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbab0066f60 0x7fbab0069420 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbad40b2ad0 tx=0x7fbabc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:06.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:06.915+0000 7fbad1600640 1 -- 172.21.15.173:0/3492078939 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbac40557d0 con 0x7fbad409a160 2024-04-25T09:10:07.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:07.083+0000 7fbadb800640 1 -- 172.21.15.173:0/3492078939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbad40b2b20 con 0x7fbad409a160 2024-04-25T09:10:07.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:07.083+0000 7fbad1600640 1 -- 172.21.15.173:0/3492078939 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v97) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbac4059870 con 0x7fbad409a160 2024-04-25T09:10:07.073 INFO:teuthology.orchestra.run.smithi173.stderr:listed 0 entries 2024-04-25T09:10:07.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:07.087+0000 7fbadb800640 1 -- 172.21.15.173:0/3492078939 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbab0066f60 msgr2=0x7fbab0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:07.087+0000 7fbadb800640 1 --2- 172.21.15.173:0/3492078939 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbab0066f60 0x7fbab0069420 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbad40b2ad0 tx=0x7fbabc009040 comp rx=0 tx=0).stop 2024-04-25T09:10:07.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:07.087+0000 7fbadb800640 1 -- 172.21.15.173:0/3492078939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbad409a160 msgr2=0x7fbad4147ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:07.087+0000 7fbadb800640 1 --2- 172.21.15.173:0/3492078939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbad409a160 0x7fbad4147ba0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fbac400cbc0 tx=0x7fbac400a430 comp rx=0 tx=0).stop 2024-04-25T09:10:07.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:07.087+0000 7fbadb800640 1 -- 172.21.15.173:0/3492078939 shutdown_connections 2024-04-25T09:10:07.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:07.087+0000 7fbadb800640 1 --2- 172.21.15.173:0/3492078939 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbab0066f60 0x7fbab0069420 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:07.087+0000 7fbadb800640 1 --2- 172.21.15.173:0/3492078939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbad415bab0 0x7fbad4156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:07.087+0000 7fbadb800640 1 --2- 172.21.15.173:0/3492078939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbad40d02a0 0x7fbad4156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:07.087+0000 7fbadb800640 1 --2- 172.21.15.173:0/3492078939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbad409a160 0x7fbad4147ba0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:07.087+0000 7fbadb800640 1 -- 172.21.15.173:0/3492078939 >> 172.21.15.173:0/3492078939 conn(0x7fbad40b32a0 msgr2=0x7fbad40c7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:07.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:07.087+0000 7fbadb800640 1 -- 172.21.15.173:0/3492078939 shutdown_connections 2024-04-25T09:10:07.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:07.087+0000 7fbadb800640 1 -- 172.21.15.173:0/3492078939 wait complete. 2024-04-25T09:10:07.094 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:10:07.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:07.094 DEBUG:teuthology.orchestra.run.smithi173:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:07.780 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:10:07.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:07.780 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:10:07.789 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:10:07.789 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:07.798 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:10:07.798 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:10:07.798 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:07.837 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:10:07.838 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:10:07.838 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:07.847 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:10:07.847 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:08.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.031+0000 7fbbf9e00640 1 Processor -- start 2024-04-25T09:10:08.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.031+0000 7fbbf9e00640 1 -- start start 2024-04-25T09:10:08.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.031+0000 7fbbf9e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbf415dbb0 0x7fbbf415df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.031+0000 7fbbf9e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbbf406f830 0x7fbbf406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.031+0000 7fbbf9e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf406d870 con 0x7fbbf40d2130 2024-04-25T09:10:08.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.031+0000 7fbbf9e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf40d2590 con 0x7fbbf406f830 2024-04-25T09:10:08.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.031+0000 7fbbf9e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf415e5c0 con 0x7fbbf415dbb0 2024-04-25T09:10:08.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.031+0000 7fbbf3400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbbf406f830 0x7fbbf406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.031+0000 7fbbf3400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbbf406f830 0x7fbbf406fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51378/0 (socket says 172.21.15.173:51378) 2024-04-25T09:10:08.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.031+0000 7fbbf3400640 1 -- 172.21.15.173:0/1272953893 learned_addr learned my addr 172.21.15.173:0/1272953893 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:08.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.031+0000 7fbbf2000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fbbf40d2130 0x7fbbf406c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53626/0 (socket says 172.21.15.173:53626) 2024-04-25T09:10:08.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.031+0000 7fbbf2a00640 1 --2- 172.21.15.173:0/1272953893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbf415dbb0 0x7fbbf415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.031+0000 7fbbf3400640 1 -- 172.21.15.173:0/1272953893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbf415dbb0 msgr2=0x7fbbf415df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:08.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.031+0000 7fbbf3400640 1 --2- 172.21.15.173:0/1272953893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbf415dbb0 0x7fbbf415df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.031+0000 7fbbf3400640 1 -- 172.21.15.173:0/1272953893 >> v1:172.21.15.173:6789/0 conn(0x7fbbf40d2130 legacy=0x7fbbf406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.031+0000 7fbbf3400640 1 -- 172.21.15.173:0/1272953893 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf4161690 con 0x7fbbf406f830 2024-04-25T09:10:08.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.035+0000 7fbbf3400640 1 --2- 172.21.15.173:0/1272953893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbf406f830 0x7fbbf406fcc0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009e50 tx=0x7fbbec01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d735eae8d04f13 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:08.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.035+0000 7fbbf1600640 1 -- 172.21.15.173:0/1272953893 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0a57f0 con 0x7fbbf406f830 2024-04-25T09:10:08.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.035+0000 7fbbf1600640 1 -- 172.21.15.173:0/1272953893 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec0a5990 con 0x7fbbf406f830 2024-04-25T09:10:08.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.035+0000 7fbbf1600640 1 -- 172.21.15.173:0/1272953893 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0a5d60 con 0x7fbbf406f830 2024-04-25T09:10:08.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.035+0000 7fbbf9e00640 1 -- 172.21.15.173:0/1272953893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbf406f830 msgr2=0x7fbbf406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.035+0000 7fbbf9e00640 1 --2- 172.21.15.173:0/1272953893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbf406f830 0x7fbbf406fcc0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009e50 tx=0x7fbbec01ca30 comp rx=0 tx=0).stop 2024-04-25T09:10:08.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.035+0000 7fbbf9e00640 1 -- 172.21.15.173:0/1272953893 shutdown_connections 2024-04-25T09:10:08.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.035+0000 7fbbf9e00640 1 --2- 172.21.15.173:0/1272953893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbf406f830 0x7fbbf406fcc0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.035+0000 7fbbf9e00640 1 --2- 172.21.15.173:0/1272953893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbf415dbb0 0x7fbbf415df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.035+0000 7fbbf9e00640 1 -- 172.21.15.173:0/1272953893 >> 172.21.15.173:0/1272953893 conn(0x7fbbf4061880 msgr2=0x7fbbf4061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:08.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.035+0000 7fbbf9e00640 1 -- 172.21.15.173:0/1272953893 shutdown_connections 2024-04-25T09:10:08.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.035+0000 7fbbf9e00640 1 -- 172.21.15.173:0/1272953893 wait complete. 2024-04-25T09:10:08.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf9e00640 1 Processor -- start 2024-04-25T09:10:08.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf9e00640 1 -- start start 2024-04-25T09:10:08.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf9e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbf406f830 0x7fbbf40caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf9e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbf40d2130 0x7fbbf414e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf9e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbf415dbb0 0x7fbbf415c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf9e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf416a990 con 0x7fbbf406f830 2024-04-25T09:10:08.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf9e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf415ee60 con 0x7fbbf40d2130 2024-04-25T09:10:08.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf9e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf416ab10 con 0x7fbbf415dbb0 2024-04-25T09:10:08.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbf406f830 0x7fbbf40caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbf406f830 0x7fbbf40caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51390/0 (socket says 172.21.15.173:51390) 2024-04-25T09:10:08.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf2a00640 1 -- 172.21.15.173:0/1415704871 learned_addr learned my addr 172.21.15.173:0/1415704871 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:08.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf2000640 1 --2- 172.21.15.173:0/1415704871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbf40d2130 0x7fbbf414e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf3400640 1 --2- 172.21.15.173:0/1415704871 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbf415dbb0 0x7fbbf415c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf2a00640 1 -- 172.21.15.173:0/1415704871 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbf415dbb0 msgr2=0x7fbbf415c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf2a00640 1 --2- 172.21.15.173:0/1415704871 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbf415dbb0 0x7fbbf415c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf2a00640 1 -- 172.21.15.173:0/1415704871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbf40d2130 msgr2=0x7fbbf414e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf2a00640 1 --2- 172.21.15.173:0/1415704871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbf40d2130 0x7fbbf414e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf2a00640 1 -- 172.21.15.173:0/1415704871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf4155be0 con 0x7fbbf406f830 2024-04-25T09:10:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf2a00640 1 --2- 172.21.15.173:0/1415704871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbf406f830 0x7fbbf40caaf0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fbbe400d5f0 tx=0x7fbbe400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbeb400640 1 -- 172.21.15.173:0/1415704871 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40125f0 con 0x7fbbf406f830 2024-04-25T09:10:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbeb400640 1 -- 172.21.15.173:0/1415704871 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4019070 con 0x7fbbf406f830 2024-04-25T09:10:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf9e00640 1 -- 172.21.15.173:0/1415704871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf414ed70 con 0x7fbbf406f830 2024-04-25T09:10:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbeb400640 1 -- 172.21.15.173:0/1415704871 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40129b0 con 0x7fbbf406f830 2024-04-25T09:10:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf9e00640 1 -- 172.21.15.173:0/1415704871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf40cb6b0 con 0x7fbbf406f830 2024-04-25T09:10:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.039+0000 7fbbf9e00640 1 -- 172.21.15.173:0/1415704871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf4073a40 con 0x7fbbf406f830 2024-04-25T09:10:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.043+0000 7fbbeb400640 1 -- 172.21.15.173:0/1415704871 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbbe4012b50 con 0x7fbbf406f830 2024-04-25T09:10:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.043+0000 7fbbeb400640 1 --2- 172.21.15.173:0/1415704871 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbbd4066f90 0x7fbbd4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.043+0000 7fbbeb400640 1 -- 172.21.15.173:0/1415704871 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbbe4085540 con 0x7fbbf406f830 2024-04-25T09:10:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.043+0000 7fbbf2000640 1 --2- 172.21.15.173:0/1415704871 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbbd4066f90 0x7fbbd4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.043+0000 7fbbf2000640 1 --2- 172.21.15.173:0/1415704871 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbbd4066f90 0x7fbbd4069450 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40c75d0 tx=0x7fbbe0007cf0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:08.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.047+0000 7fbbeb400640 1 -- 172.21.15.173:0/1415704871 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbbe4056450 con 0x7fbbf406f830 2024-04-25T09:10:08.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.231+0000 7fbbf9e00640 1 -- 172.21.15.173:0/1415704871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbf415e090 con 0x7fbbf406f830 2024-04-25T09:10:08.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.231+0000 7fbbeb400640 1 -- 172.21.15.173:0/1415704871 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fbbe4055d50 con 0x7fbbf406f830 2024-04-25T09:10:08.221 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:08.221 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/556010437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":556010437},{"type":"v1","addr":"172.21.15.173:6835","nonce":556010437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":6524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4077641924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4077641924},{"type":"v1","addr":"172.21.15.194:6834","nonce":4077641924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7162,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2938501478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2938501478},{"type":"v1","addr":"172.21.15.194:6835","nonce":2938501478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:09:26.257282+0000","modified":"2024-04-25T09:09:29.275838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/555490935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":555490935},{"type":"v1","addr":"172.21.15.173:6837","nonce":555490935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:10:08.222 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 65 2024-04-25T09:10:08.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.235+0000 7fbbf9e00640 1 -- 172.21.15.173:0/1415704871 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbbd4066f90 msgr2=0x7fbbd4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.235+0000 7fbbf9e00640 1 --2- 172.21.15.173:0/1415704871 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbbd4066f90 0x7fbbd4069450 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40c75d0 tx=0x7fbbe0007cf0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.235+0000 7fbbf9e00640 1 -- 172.21.15.173:0/1415704871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbf406f830 msgr2=0x7fbbf40caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.235+0000 7fbbf9e00640 1 --2- 172.21.15.173:0/1415704871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbf406f830 0x7fbbf40caaf0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fbbe400d5f0 tx=0x7fbbe400dab0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.235+0000 7fbbf9e00640 1 -- 172.21.15.173:0/1415704871 shutdown_connections 2024-04-25T09:10:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.235+0000 7fbbf9e00640 1 --2- 172.21.15.173:0/1415704871 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbbd4066f90 0x7fbbd4069450 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.235+0000 7fbbf9e00640 1 --2- 172.21.15.173:0/1415704871 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbf415dbb0 0x7fbbf415c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.235+0000 7fbbf9e00640 1 --2- 172.21.15.173:0/1415704871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbf40d2130 0x7fbbf414e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.235+0000 7fbbf9e00640 1 --2- 172.21.15.173:0/1415704871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbf406f830 0x7fbbf40caaf0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.235+0000 7fbbf9e00640 1 -- 172.21.15.173:0/1415704871 >> 172.21.15.173:0/1415704871 conn(0x7fbbf4061880 msgr2=0x7fbbf406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.235+0000 7fbbf9e00640 1 -- 172.21.15.173:0/1415704871 shutdown_connections 2024-04-25T09:10:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.235+0000 7fbbf9e00640 1 -- 172.21.15.173:0/1415704871 wait complete. 2024-04-25T09:10:08.243 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:08.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.391+0000 7f9318400640 1 Processor -- start 2024-04-25T09:10:08.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.391+0000 7f9318400640 1 -- start start 2024-04-25T09:10:08.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.391+0000 7f9318400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f931015dbb0 0x7f931015df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.391+0000 7f9318400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f931006f830 0x7f931006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.391+0000 7f9318400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f931006d870 con 0x7f93100d2130 2024-04-25T09:10:08.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.391+0000 7f9318400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93100d2590 con 0x7f931015dbb0 2024-04-25T09:10:08.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.391+0000 7f9318400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931015e5c0 con 0x7f931006f830 2024-04-25T09:10:08.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.391+0000 7f9315a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f931015dbb0 0x7f931015df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.391+0000 7f9315000640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f93100d2130 0x7f931006c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:38930/0 (socket says 172.21.15.173:38930) 2024-04-25T09:10:08.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.391+0000 7f9315000640 1 -- 172.21.15.173:0/2002385562 learned_addr learned my addr 172.21.15.173:0/2002385562 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:08.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.391+0000 7f9316400640 1 --2- 172.21.15.173:0/2002385562 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f931006f830 0x7f931006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.391+0000 7f9315a00640 1 -- 172.21.15.173:0/2002385562 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f931006f830 msgr2=0x7f931006fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:08.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.391+0000 7f9315a00640 1 --2- 172.21.15.173:0/2002385562 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f931006f830 0x7f931006fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.391+0000 7f9315a00640 1 -- 172.21.15.173:0/2002385562 >> v1:172.21.15.194:6789/0 conn(0x7f93100d2130 legacy=0x7f931006c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.391+0000 7f9315a00640 1 -- 172.21.15.173:0/2002385562 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9310161690 con 0x7f931015dbb0 2024-04-25T09:10:08.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.395+0000 7f9315a00640 1 --2- 172.21.15.173:0/2002385562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f931015dbb0 0x7f931015df90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9300009d90 tx=0x7f930001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cd478724f0e2a4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:08.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.395+0000 7f930fe00640 1 -- 172.21.15.173:0/2002385562 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93000b2070 con 0x7f931015dbb0 2024-04-25T09:10:08.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.395+0000 7f930fe00640 1 -- 172.21.15.173:0/2002385562 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93000a5920 con 0x7f931015dbb0 2024-04-25T09:10:08.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.395+0000 7f930fe00640 1 -- 172.21.15.173:0/2002385562 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93000a5cf0 con 0x7f931015dbb0 2024-04-25T09:10:08.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.395+0000 7f9318400640 1 -- 172.21.15.173:0/2002385562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f931015dbb0 msgr2=0x7f931015df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.395+0000 7f9318400640 1 --2- 172.21.15.173:0/2002385562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f931015dbb0 0x7f931015df90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9300009d90 tx=0x7f930001c970 comp rx=0 tx=0).stop 2024-04-25T09:10:08.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.395+0000 7f9318400640 1 -- 172.21.15.173:0/2002385562 shutdown_connections 2024-04-25T09:10:08.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.395+0000 7f9318400640 1 --2- 172.21.15.173:0/2002385562 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f931006f830 0x7f931006fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.395+0000 7f9318400640 1 --2- 172.21.15.173:0/2002385562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f931015dbb0 0x7f931015df90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.395+0000 7f9318400640 1 -- 172.21.15.173:0/2002385562 >> 172.21.15.173:0/2002385562 conn(0x7f9310061880 msgr2=0x7f9310061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:08.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.395+0000 7f9318400640 1 -- 172.21.15.173:0/2002385562 shutdown_connections 2024-04-25T09:10:08.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.395+0000 7f9318400640 1 -- 172.21.15.173:0/2002385562 wait complete. 2024-04-25T09:10:08.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9318400640 1 Processor -- start 2024-04-25T09:10:08.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9318400640 1 -- start start 2024-04-25T09:10:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9318400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f931006f830 0x7f9310155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9318400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93100d2130 0x7f93100c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9318400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f931015dbb0 0x7f93100c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9318400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931016a990 con 0x7f931015dbb0 2024-04-25T09:10:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9318400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931015ee60 con 0x7f93100d2130 2024-04-25T09:10:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9318400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931016ab10 con 0x7f931006f830 2024-04-25T09:10:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9316400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f931015dbb0 0x7f93100c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9316400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f931015dbb0 0x7f93100c7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51396/0 (socket says 172.21.15.173:51396) 2024-04-25T09:10:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9316400640 1 -- 172.21.15.173:0/906311424 learned_addr learned my addr 172.21.15.173:0/906311424 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9315000640 1 --2- 172.21.15.173:0/906311424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93100d2130 0x7f93100c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9315a00640 1 --2- 172.21.15.173:0/906311424 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f931006f830 0x7f9310155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9316400640 1 -- 172.21.15.173:0/906311424 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f931006f830 msgr2=0x7f9310155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9316400640 1 --2- 172.21.15.173:0/906311424 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f931006f830 0x7f9310155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9316400640 1 -- 172.21.15.173:0/906311424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93100d2130 msgr2=0x7f93100c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9316400640 1 --2- 172.21.15.173:0/906311424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93100d2130 0x7f93100c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9316400640 1 -- 172.21.15.173:0/906311424 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93100c7940 con 0x7f931015dbb0 2024-04-25T09:10:08.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9316400640 1 --2- 172.21.15.173:0/906311424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f931015dbb0 0x7f93100c7400 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f930800e7f0 tx=0x7f930800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:08.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f930d600640 1 -- 172.21.15.173:0/906311424 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9308017070 con 0x7f931015dbb0 2024-04-25T09:10:08.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f930d600640 1 -- 172.21.15.173:0/906311424 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930800c940 con 0x7f931015dbb0 2024-04-25T09:10:08.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f930d600640 1 -- 172.21.15.173:0/906311424 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930800eea0 con 0x7f931015dbb0 2024-04-25T09:10:08.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9318400640 1 -- 172.21.15.173:0/906311424 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9310159a70 con 0x7f931015dbb0 2024-04-25T09:10:08.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.399+0000 7f9318400640 1 -- 172.21.15.173:0/906311424 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931015a030 con 0x7f931015dbb0 2024-04-25T09:10:08.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.403+0000 7f9318400640 1 -- 172.21.15.173:0/906311424 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9310073a40 con 0x7f931015dbb0 2024-04-25T09:10:08.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.403+0000 7f930d600640 1 -- 172.21.15.173:0/906311424 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f930801a070 con 0x7f931015dbb0 2024-04-25T09:10:08.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.403+0000 7f930d600640 1 --2- 172.21.15.173:0/906311424 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92f0066f90 0x7f92f0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.403+0000 7f930d600640 1 -- 172.21.15.173:0/906311424 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9308084ff0 con 0x7f931015dbb0 2024-04-25T09:10:08.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.403+0000 7f9315a00640 1 --2- 172.21.15.173:0/906311424 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92f0066f90 0x7f92f0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.403+0000 7f9315a00640 1 --2- 172.21.15.173:0/906311424 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92f0066f90 0x7f92f0069450 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f93000af000 tx=0x7f93000a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:08.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.407+0000 7f930d600640 1 -- 172.21.15.173:0/906311424 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9308055710 con 0x7f931015dbb0 2024-04-25T09:10:08.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.559+0000 7f9318400640 1 -- 172.21.15.173:0/906311424 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93100cf020 con 0x7f931015dbb0 2024-04-25T09:10:08.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.563+0000 7f930d600640 1 -- 172.21.15.173:0/906311424 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16945 (secure 0 0 0) 0x7f93080597b0 con 0x7f931015dbb0 2024-04-25T09:10:08.551 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:08.551 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":97,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:09:27.873210+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:09:24.629351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T09:09:25.248841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:08.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.563+0000 7f9318400640 1 -- 172.21.15.173:0/906311424 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92f0066f90 msgr2=0x7f92f0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.563+0000 7f9318400640 1 --2- 172.21.15.173:0/906311424 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92f0066f90 0x7f92f0069450 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f93000af000 tx=0x7f93000a7070 comp rx=0 tx=0).stop 2024-04-25T09:10:08.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.563+0000 7f9318400640 1 -- 172.21.15.173:0/906311424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f931015dbb0 msgr2=0x7f93100c7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.563+0000 7f9318400640 1 --2- 172.21.15.173:0/906311424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f931015dbb0 0x7f93100c7400 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f930800e7f0 tx=0x7f930800ecb0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.563+0000 7f9318400640 1 -- 172.21.15.173:0/906311424 shutdown_connections 2024-04-25T09:10:08.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.563+0000 7f9318400640 1 --2- 172.21.15.173:0/906311424 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92f0066f90 0x7f92f0069450 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.563+0000 7f9318400640 1 --2- 172.21.15.173:0/906311424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f931015dbb0 0x7f93100c7400 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.563+0000 7f9318400640 1 --2- 172.21.15.173:0/906311424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93100d2130 0x7f93100c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.563+0000 7f9318400640 1 --2- 172.21.15.173:0/906311424 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f931006f830 0x7f9310155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.563+0000 7f9318400640 1 -- 172.21.15.173:0/906311424 >> 172.21.15.173:0/906311424 conn(0x7f9310061880 msgr2=0x7f93100b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:08.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.563+0000 7f9318400640 1 -- 172.21.15.173:0/906311424 shutdown_connections 2024-04-25T09:10:08.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.563+0000 7f9318400640 1 -- 172.21.15.173:0/906311424 wait complete. 2024-04-25T09:10:08.573 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:09:24.629351+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:09:25.248841+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:10:08.573 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:10:08.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.723+0000 7fa6eba00640 1 Processor -- start 2024-04-25T09:10:08.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.723+0000 7fa6eba00640 1 -- start start 2024-04-25T09:10:08.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.723+0000 7fa6eba00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa6e4145290 0x7fa6e415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.723+0000 7fa6eba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6e40cc260 0x7fa6e40cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.723+0000 7fa6eba00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e415c5f0 con 0x7fa6e40b3fe0 2024-04-25T09:10:08.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.723+0000 7fa6eba00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e406d4b0 con 0x7fa6e4145290 2024-04-25T09:10:08.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.723+0000 7fa6eba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e406d790 con 0x7fa6e40cc260 2024-04-25T09:10:08.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.723+0000 7fa6e9000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa6e4145290 0x7fa6e415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.723+0000 7fa6e9000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa6e4145290 0x7fa6e415c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51410/0 (socket says 172.21.15.173:51410) 2024-04-25T09:10:08.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.723+0000 7fa6e9000640 1 -- 172.21.15.173:0/2095305489 learned_addr learned my addr 172.21.15.173:0/2095305489 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:08.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.723+0000 7fa6e9a00640 1 --2- 172.21.15.173:0/2095305489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6e40cc260 0x7fa6e40cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.723+0000 7fa6e9000640 1 -- 172.21.15.173:0/2095305489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6e40cc260 msgr2=0x7fa6e40cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:08.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.723+0000 7fa6e9000640 1 --2- 172.21.15.173:0/2095305489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6e40cc260 0x7fa6e40cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.723+0000 7fa6e9000640 1 -- 172.21.15.173:0/2095305489 >> v1:172.21.15.194:6789/0 conn(0x7fa6e40b3fe0 legacy=0x7fa6e40b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.723+0000 7fa6e9000640 1 -- 172.21.15.173:0/2095305489 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e406da70 con 0x7fa6e4145290 2024-04-25T09:10:08.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.723+0000 7fa6e9a00640 1 --2- 172.21.15.173:0/2095305489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6e40cc260 0x7fa6e40cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:08.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.727+0000 7fa6e9000640 1 --2- 172.21.15.173:0/2095305489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6e4145290 0x7fa6e415c0b0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8009870 tx=0x7fa6d801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b64d1a4828e81c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:08.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.727+0000 7fa6e3400640 1 -- 172.21.15.173:0/2095305489 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d80b0070 con 0x7fa6e4145290 2024-04-25T09:10:08.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.727+0000 7fa6e3400640 1 -- 172.21.15.173:0/2095305489 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d8004230 con 0x7fa6e4145290 2024-04-25T09:10:08.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.727+0000 7fa6e3400640 1 -- 172.21.15.173:0/2095305489 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8003620 con 0x7fa6e4145290 2024-04-25T09:10:08.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.727+0000 7fa6eba00640 1 -- 172.21.15.173:0/2095305489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6e4145290 msgr2=0x7fa6e415c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.727+0000 7fa6eba00640 1 --2- 172.21.15.173:0/2095305489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6e4145290 0x7fa6e415c0b0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8009870 tx=0x7fa6d801c440 comp rx=0 tx=0).stop 2024-04-25T09:10:08.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.727+0000 7fa6eba00640 1 -- 172.21.15.173:0/2095305489 shutdown_connections 2024-04-25T09:10:08.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.727+0000 7fa6eba00640 1 --2- 172.21.15.173:0/2095305489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6e40cc260 0x7fa6e40cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.727+0000 7fa6eba00640 1 --2- 172.21.15.173:0/2095305489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6e4145290 0x7fa6e415c0b0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.727+0000 7fa6eba00640 1 -- 172.21.15.173:0/2095305489 >> 172.21.15.173:0/2095305489 conn(0x7fa6e406ac90 msgr2=0x7fa6e406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:08.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.727+0000 7fa6eba00640 1 -- 172.21.15.173:0/2095305489 shutdown_connections 2024-04-25T09:10:08.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.727+0000 7fa6eba00640 1 -- 172.21.15.173:0/2095305489 wait complete. 2024-04-25T09:10:08.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6eba00640 1 Processor -- start 2024-04-25T09:10:08.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6eba00640 1 -- start start 2024-04-25T09:10:08.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6eba00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6e40b3fe0 0x7fa6e4159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6eba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6e40cc260 0x7fa6e415ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6eba00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6e4145290 0x7fa6e4142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6eba00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e406ed60 con 0x7fa6e40b3fe0 2024-04-25T09:10:08.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6eba00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e406eee0 con 0x7fa6e4145290 2024-04-25T09:10:08.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6eba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e406f060 con 0x7fa6e40cc260 2024-04-25T09:10:08.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6e9000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6e40b3fe0 0x7fa6e4159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6e9000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6e40b3fe0 0x7fa6e4159b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51418/0 (socket says 172.21.15.173:51418) 2024-04-25T09:10:08.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6e9000640 1 -- 172.21.15.173:0/1720581310 learned_addr learned my addr 172.21.15.173:0/1720581310 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:08.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6e9a00640 1 --2- 172.21.15.173:0/1720581310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6e4145290 0x7fa6e4142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6e3e00640 1 --2- 172.21.15.173:0/1720581310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6e40cc260 0x7fa6e415ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6e9000640 1 -- 172.21.15.173:0/1720581310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6e40cc260 msgr2=0x7fa6e415ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6e9000640 1 --2- 172.21.15.173:0/1720581310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6e40cc260 0x7fa6e415ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6e9000640 1 -- 172.21.15.173:0/1720581310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6e4145290 msgr2=0x7fa6e4142c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6e9000640 1 --2- 172.21.15.173:0/1720581310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6e4145290 0x7fa6e4142c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6e9000640 1 -- 172.21.15.173:0/1720581310 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e41350a0 con 0x7fa6e40b3fe0 2024-04-25T09:10:08.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6e9a00640 1 --2- 172.21.15.173:0/1720581310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6e4145290 0x7fa6e4142c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:08.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6e9000640 1 --2- 172.21.15.173:0/1720581310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6e40b3fe0 0x7fa6e4159b00 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fa6d801a070 tx=0x7fa6d80191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:08.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6e0c00640 1 -- 172.21.15.173:0/1720581310 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d80b9020 con 0x7fa6e40b3fe0 2024-04-25T09:10:08.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6e0c00640 1 -- 172.21.15.173:0/1720581310 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d80b1040 con 0x7fa6e40b3fe0 2024-04-25T09:10:08.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6eba00640 1 -- 172.21.15.173:0/1720581310 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e4135380 con 0x7fa6e40b3fe0 2024-04-25T09:10:08.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6e0c00640 1 -- 172.21.15.173:0/1720581310 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d80b0050 con 0x7fa6e40b3fe0 2024-04-25T09:10:08.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.731+0000 7fa6eba00640 1 -- 172.21.15.173:0/1720581310 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e4137f10 con 0x7fa6e40b3fe0 2024-04-25T09:10:08.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.735+0000 7fa6eba00640 1 -- 172.21.15.173:0/1720581310 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e4073ab0 con 0x7fa6e40b3fe0 2024-04-25T09:10:08.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.735+0000 7fa6e0c00640 1 -- 172.21.15.173:0/1720581310 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa6d80bc020 con 0x7fa6e40b3fe0 2024-04-25T09:10:08.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.735+0000 7fa6e0c00640 1 --2- 172.21.15.173:0/1720581310 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa6c4066f90 0x7fa6c4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.735+0000 7fa6e0c00640 1 -- 172.21.15.173:0/1720581310 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa6d811ed60 con 0x7fa6e40b3fe0 2024-04-25T09:10:08.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.735+0000 7fa6e3e00640 1 --2- 172.21.15.173:0/1720581310 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa6c4066f90 0x7fa6c4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.735+0000 7fa6e3e00640 1 --2- 172.21.15.173:0/1720581310 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa6c4066f90 0x7fa6c4069450 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40cb900 tx=0x7fa6d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:08.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.739+0000 7fa6e0c00640 1 -- 172.21.15.173:0/1720581310 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa6d80c3030 con 0x7fa6e40b3fe0 2024-04-25T09:10:08.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.899+0000 7fa6eba00640 1 -- 172.21.15.173:0/1720581310 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa6e413e720 con 0x7fa6e40b3fe0 2024-04-25T09:10:08.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.899+0000 7fa6e0c00640 1 -- 172.21.15.173:0/1720581310 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa6d8016150 con 0x7fa6e40b3fe0 2024-04-25T09:10:08.889 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:10:08.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.903+0000 7fa6eba00640 1 -- 172.21.15.173:0/1720581310 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa6c4066f90 msgr2=0x7fa6c4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.903+0000 7fa6eba00640 1 --2- 172.21.15.173:0/1720581310 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa6c4066f90 0x7fa6c4069450 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40cb900 tx=0x7fa6d0009040 comp rx=0 tx=0).stop 2024-04-25T09:10:08.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.903+0000 7fa6eba00640 1 -- 172.21.15.173:0/1720581310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6e40b3fe0 msgr2=0x7fa6e4159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.903+0000 7fa6eba00640 1 --2- 172.21.15.173:0/1720581310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6e40b3fe0 0x7fa6e4159b00 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fa6d801a070 tx=0x7fa6d80191e0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.903+0000 7fa6eba00640 1 -- 172.21.15.173:0/1720581310 shutdown_connections 2024-04-25T09:10:08.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.903+0000 7fa6eba00640 1 --2- 172.21.15.173:0/1720581310 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa6c4066f90 0x7fa6c4069450 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.903+0000 7fa6eba00640 1 --2- 172.21.15.173:0/1720581310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6e4145290 0x7fa6e4142c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.903+0000 7fa6eba00640 1 --2- 172.21.15.173:0/1720581310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6e40cc260 0x7fa6e415ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.903+0000 7fa6eba00640 1 --2- 172.21.15.173:0/1720581310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6e40b3fe0 0x7fa6e4159b00 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.903+0000 7fa6eba00640 1 -- 172.21.15.173:0/1720581310 >> 172.21.15.173:0/1720581310 conn(0x7fa6e406ac90 msgr2=0x7fa6e41419b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:08.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.903+0000 7fa6eba00640 1 -- 172.21.15.173:0/1720581310 shutdown_connections 2024-04-25T09:10:08.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:08.903+0000 7fa6eba00640 1 -- 172.21.15.173:0/1720581310 wait complete. 2024-04-25T09:10:08.911 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:10:09.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.059+0000 7fe173c00640 1 Processor -- start 2024-04-25T09:10:09.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.059+0000 7fe173c00640 1 -- start start 2024-04-25T09:10:09.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.059+0000 7fe173c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe16c0cc7e0 0x7fe16c0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.059+0000 7fe173c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16c071570 con 0x7fe16c0aef70 2024-04-25T09:10:09.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.059+0000 7fe173c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16c071850 con 0x7fe16c0aeb90 2024-04-25T09:10:09.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.059+0000 7fe173c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16c071320 con 0x7fe16c0cc7e0 2024-04-25T09:10:09.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.059+0000 7fe171c00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe16c0aef70 0x7fe16c15af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53632/0 (socket says 172.21.15.173:53632) 2024-04-25T09:10:09.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe171c00640 1 -- 172.21.15.173:0/3617400150 learned_addr learned my addr 172.21.15.173:0/3617400150 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:09.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe163e00640 1 --2- 172.21.15.173:0/3617400150 >> v2:172.21.15.194:3300/0 conn(0x7fe16c0cc7e0 0x7fe16c0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe16be00640 1 -- 172.21.15.173:0/3617400150 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 528451603 0 0) 0x7fe16c071570 con 0x7fe16c0aef70 2024-04-25T09:10:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe16be00640 1 -- 172.21.15.173:0/3617400150 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe150005740 con 0x7fe16c0aef70 2024-04-25T09:10:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe16be00640 1 -- 172.21.15.173:0/3617400150 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350498242 0 0) 0x7fe16c071850 con 0x7fe16c0aeb90 2024-04-25T09:10:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe16be00640 1 -- 172.21.15.173:0/3617400150 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe16c071570 con 0x7fe16c0aeb90 2024-04-25T09:10:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe16be00640 1 -- 172.21.15.173:0/3617400150 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 320844338 0 0) 0x7fe150005740 con 0x7fe16c0aef70 2024-04-25T09:10:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe16be00640 1 -- 172.21.15.173:0/3617400150 >> v2:172.21.15.194:3300/0 conn(0x7fe16c0cc7e0 msgr2=0x7fe16c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe16be00640 1 --2- 172.21.15.173:0/3617400150 >> v2:172.21.15.194:3300/0 conn(0x7fe16c0cc7e0 0x7fe16c0cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe16be00640 1 -- 172.21.15.173:0/3617400150 >> v1:172.21.15.194:6789/0 conn(0x7fe16c0aeb90 legacy=0x7fe16c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe16be00640 1 -- 172.21.15.173:0/3617400150 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c071b30 con 0x7fe16c0aef70 2024-04-25T09:10:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe16be00640 1 -- 172.21.15.173:0/3617400150 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fe164001a20 con 0x7fe16c0aef70 2024-04-25T09:10:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe163e00640 1 --2- 172.21.15.173:0/3617400150 >> v2:172.21.15.194:3300/0 conn(0x7fe16c0cc7e0 0x7fe16c0cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe16be00640 1 -- 172.21.15.173:0/3617400150 >> v1:172.21.15.173:6789/0 conn(0x7fe16c0aef70 legacy=0x7fe16c15af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe16be00640 1 --2- 172.21.15.173:0/3617400150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe150005d60 0x7fe150006160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe16be00640 1 --2- 172.21.15.173:0/3617400150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe150006a20 0x7fe150006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe16be00640 1 --2- 172.21.15.173:0/3617400150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1500073e0 0x7fe15000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe16be00640 1 -- 172.21.15.173:0/3617400150 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c071320 con 0x7fe150006a20 2024-04-25T09:10:09.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe16be00640 1 -- 172.21.15.173:0/3617400150 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15000e310 con 0x7fe150005d60 2024-04-25T09:10:09.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe16be00640 1 -- 172.21.15.173:0/3617400150 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15000e510 con 0x7fe1500073e0 2024-04-25T09:10:09.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe163e00640 1 --2- 172.21.15.173:0/3617400150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe150006a20 0x7fe150006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe171200640 1 --2- 172.21.15.173:0/3617400150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe150005d60 0x7fe150006160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe171c00640 1 --2- 172.21.15.173:0/3617400150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1500073e0 0x7fe15000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe163e00640 1 -- 172.21.15.173:0/3617400150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1500073e0 msgr2=0x7fe15000dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:09.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe163e00640 1 --2- 172.21.15.173:0/3617400150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1500073e0 0x7fe15000dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe163e00640 1 -- 172.21.15.173:0/3617400150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe150005d60 msgr2=0x7fe150006160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:09.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe163e00640 1 --2- 172.21.15.173:0/3617400150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe150005d60 0x7fe150006160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe163e00640 1 -- 172.21.15.173:0/3617400150 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe150005740 con 0x7fe150006a20 2024-04-25T09:10:09.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.063+0000 7fe171c00640 1 -- 172.21.15.173:0/3617400150 reap_dead start 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.067+0000 7fe163e00640 1 --2- 172.21.15.173:0/3617400150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe150006a20 0x7fe150006ea0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fe154009cb0 tx=0x7fe15401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481dcbff980206ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.067+0000 7fe16be00640 1 -- 172.21.15.173:0/3617400150 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1540b2070 con 0x7fe150006a20 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.067+0000 7fe16be00640 1 -- 172.21.15.173:0/3617400150 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1540a57e0 con 0x7fe150006a20 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.067+0000 7fe16be00640 1 -- 172.21.15.173:0/3617400150 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe154009880 con 0x7fe150006a20 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.067+0000 7fe173c00640 1 -- 172.21.15.173:0/3617400150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe150006a20 msgr2=0x7fe150006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.067+0000 7fe173c00640 1 --2- 172.21.15.173:0/3617400150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe150006a20 0x7fe150006ea0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fe154009cb0 tx=0x7fe15401cc30 comp rx=0 tx=0).stop 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.067+0000 7fe173c00640 1 -- 172.21.15.173:0/3617400150 shutdown_connections 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.067+0000 7fe173c00640 1 --2- 172.21.15.173:0/3617400150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe150006a20 0x7fe150006ea0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.067+0000 7fe173c00640 1 -- 172.21.15.173:0/3617400150 >> 172.21.15.173:0/3617400150 conn(0x7fe16c06ac90 msgr2=0x7fe16c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.067+0000 7fe173c00640 1 -- 172.21.15.173:0/3617400150 shutdown_connections 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.067+0000 7fe173c00640 1 -- 172.21.15.173:0/3617400150 wait complete. 2024-04-25T09:10:09.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.067+0000 7fe173c00640 1 Processor -- start 2024-04-25T09:10:09.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.067+0000 7fe173c00640 1 -- start start 2024-04-25T09:10:09.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe173c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe150006a20 0x7fe16c149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe173c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe16c1503d0 0x7fe16c1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe173c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe16c0b13f0 0x7fe16c0b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe173c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c15e940 con 0x7fe16c0b13f0 2024-04-25T09:10:09.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe173c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c15e7c0 con 0x7fe150006a20 2024-04-25T09:10:09.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe173c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c15eac0 con 0x7fe16c1503d0 2024-04-25T09:10:09.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe171c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe16c0b13f0 0x7fe16c0b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe171200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe150006a20 0x7fe16c149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe171c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe16c0b13f0 0x7fe16c0b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51432/0 (socket says 172.21.15.173:51432) 2024-04-25T09:10:09.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe171c00640 1 -- 172.21.15.173:0/1154171497 learned_addr learned my addr 172.21.15.173:0/1154171497 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:09.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe163e00640 1 --2- 172.21.15.173:0/1154171497 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe16c1503d0 0x7fe16c1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe171c00640 1 -- 172.21.15.173:0/1154171497 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe16c1503d0 msgr2=0x7fe16c1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe171c00640 1 --2- 172.21.15.173:0/1154171497 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe16c1503d0 0x7fe16c1549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe171c00640 1 -- 172.21.15.173:0/1154171497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe150006a20 msgr2=0x7fe16c149240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe171c00640 1 --2- 172.21.15.173:0/1154171497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe150006a20 0x7fe16c149240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe171c00640 1 -- 172.21.15.173:0/1154171497 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c153900 con 0x7fe16c0b13f0 2024-04-25T09:10:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe171c00640 1 --2- 172.21.15.173:0/1154171497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe16c0b13f0 0x7fe16c0b1880 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0af380 tx=0x7fe164007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe169600640 1 -- 172.21.15.173:0/1154171497 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16400aa90 con 0x7fe16c0b13f0 2024-04-25T09:10:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe169600640 1 -- 172.21.15.173:0/1154171497 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe164019070 con 0x7fe16c0b13f0 2024-04-25T09:10:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe173c00640 1 -- 172.21.15.173:0/1154171497 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe16c153be0 con 0x7fe16c0b13f0 2024-04-25T09:10:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe169600640 1 -- 172.21.15.173:0/1154171497 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1640133f0 con 0x7fe16c0b13f0 2024-04-25T09:10:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe173c00640 1 -- 172.21.15.173:0/1154171497 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16c1541a0 con 0x7fe16c0b13f0 2024-04-25T09:10:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe173c00640 1 -- 172.21.15.173:0/1154171497 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe16c073ab0 con 0x7fe16c0b13f0 2024-04-25T09:10:09.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.071+0000 7fe169600640 1 -- 172.21.15.173:0/1154171497 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe164013590 con 0x7fe16c0b13f0 2024-04-25T09:10:09.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.075+0000 7fe169600640 1 --2- 172.21.15.173:0/1154171497 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe148066f60 0x7fe148069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.075+0000 7fe169600640 1 -- 172.21.15.173:0/1154171497 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe164085590 con 0x7fe16c0b13f0 2024-04-25T09:10:09.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.075+0000 7fe171200640 1 --2- 172.21.15.173:0/1154171497 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe148066f60 0x7fe148069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.075+0000 7fe171200640 1 --2- 172.21.15.173:0/1154171497 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe148066f60 0x7fe148069420 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe15c007fd0 tx=0x7fe15c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.079+0000 7fe169600640 1 -- 172.21.15.173:0/1154171497 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe164056370 con 0x7fe16c0b13f0 2024-04-25T09:10:09.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.231+0000 7fe173c00640 1 -- 172.21.15.173:0/1154171497 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe16c15b9d0 con 0x7fe16c0b13f0 2024-04-25T09:10:09.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.231+0000 7fe169600640 1 -- 172.21.15.173:0/1154171497 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe164055c70 con 0x7fe16c0b13f0 2024-04-25T09:10:09.221 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:10:09.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.235+0000 7fe173c00640 1 -- 172.21.15.173:0/1154171497 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe148066f60 msgr2=0x7fe148069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.235+0000 7fe173c00640 1 --2- 172.21.15.173:0/1154171497 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe148066f60 0x7fe148069420 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe15c007fd0 tx=0x7fe15c009040 comp rx=0 tx=0).stop 2024-04-25T09:10:09.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.235+0000 7fe173c00640 1 -- 172.21.15.173:0/1154171497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe16c0b13f0 msgr2=0x7fe16c0b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.235+0000 7fe173c00640 1 --2- 172.21.15.173:0/1154171497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe16c0b13f0 0x7fe16c0b1880 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0af380 tx=0x7fe164007a40 comp rx=0 tx=0).stop 2024-04-25T09:10:09.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.235+0000 7fe173c00640 1 -- 172.21.15.173:0/1154171497 shutdown_connections 2024-04-25T09:10:09.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.235+0000 7fe173c00640 1 --2- 172.21.15.173:0/1154171497 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe148066f60 0x7fe148069420 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.235+0000 7fe173c00640 1 --2- 172.21.15.173:0/1154171497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe16c0b13f0 0x7fe16c0b1880 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.235+0000 7fe173c00640 1 --2- 172.21.15.173:0/1154171497 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe16c1503d0 0x7fe16c1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.235+0000 7fe173c00640 1 --2- 172.21.15.173:0/1154171497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe150006a20 0x7fe16c149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.235+0000 7fe173c00640 1 -- 172.21.15.173:0/1154171497 >> 172.21.15.173:0/1154171497 conn(0x7fe16c06ac90 msgr2=0x7fe16c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:09.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.235+0000 7fe173c00640 1 -- 172.21.15.173:0/1154171497 shutdown_connections 2024-04-25T09:10:09.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.235+0000 7fe173c00640 1 -- 172.21.15.173:0/1154171497 wait complete. 2024-04-25T09:10:09.242 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:10:09.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.395+0000 7f18fec00640 1 Processor -- start 2024-04-25T09:10:09.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.395+0000 7f18fec00640 1 -- start start 2024-04-25T09:10:09.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.395+0000 7f18fec00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f18f815f060 0x7f18f80b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.395+0000 7f18fec00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f18f809aa60 0x7f18f815f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.395+0000 7f18fec00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f80b1530 con 0x7f18f80b2910 2024-04-25T09:10:09.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.395+0000 7f18fec00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f80cfd60 con 0x7f18f809aa60 2024-04-25T09:10:09.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.395+0000 7f18fec00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f80d0040 con 0x7f18f815f060 2024-04-25T09:10:09.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.395+0000 7f18fe200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f18f809aa60 0x7f18f815f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.395+0000 7f18fe200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f18f809aa60 0x7f18f815f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51440/0 (socket says 172.21.15.173:51440) 2024-04-25T09:10:09.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.395+0000 7f18fe200640 1 -- 172.21.15.173:0/1258221161 learned_addr learned my addr 172.21.15.173:0/1258221161 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:09.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.395+0000 7f18fd800640 1 --2- 172.21.15.173:0/1258221161 >> v2:172.21.15.194:3300/0 conn(0x7f18f815f060 0x7f18f80b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.395+0000 7f18fe200640 1 -- 172.21.15.173:0/1258221161 >> v2:172.21.15.194:3300/0 conn(0x7f18f815f060 msgr2=0x7f18f80b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:09.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.395+0000 7f18fe200640 1 --2- 172.21.15.173:0/1258221161 >> v2:172.21.15.194:3300/0 conn(0x7f18f815f060 0x7f18f80b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.395+0000 7f18fe200640 1 -- 172.21.15.173:0/1258221161 >> v1:172.21.15.194:6789/0 conn(0x7f18f80b2910 legacy=0x7f18f80ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.395+0000 7f18fe200640 1 -- 172.21.15.173:0/1258221161 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f80cf350 con 0x7f18f809aa60 2024-04-25T09:10:09.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.399+0000 7f18fe200640 1 --2- 172.21.15.173:0/1258221161 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18f809aa60 0x7f18f815f4e0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f18f806f240 tx=0x7f18f001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883e15bd271456ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.399+0000 7f18f7e00640 1 -- 172.21.15.173:0/1258221161 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f00aa610 con 0x7f18f809aa60 2024-04-25T09:10:09.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.399+0000 7f18f7e00640 1 -- 172.21.15.173:0/1258221161 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f00af070 con 0x7f18f809aa60 2024-04-25T09:10:09.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.399+0000 7f18f7e00640 1 -- 172.21.15.173:0/1258221161 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f00aa9d0 con 0x7f18f809aa60 2024-04-25T09:10:09.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.399+0000 7f18fec00640 1 -- 172.21.15.173:0/1258221161 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18f809aa60 msgr2=0x7f18f815f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.399+0000 7f18fec00640 1 --2- 172.21.15.173:0/1258221161 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18f809aa60 0x7f18f815f4e0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f18f806f240 tx=0x7f18f001c490 comp rx=0 tx=0).stop 2024-04-25T09:10:09.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.399+0000 7f18fec00640 1 -- 172.21.15.173:0/1258221161 shutdown_connections 2024-04-25T09:10:09.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.399+0000 7f18fec00640 1 --2- 172.21.15.173:0/1258221161 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18f809aa60 0x7f18f815f4e0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.399+0000 7f18fec00640 1 --2- 172.21.15.173:0/1258221161 >> v2:172.21.15.194:3300/0 conn(0x7f18f815f060 0x7f18f80b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.399+0000 7f18fec00640 1 -- 172.21.15.173:0/1258221161 >> 172.21.15.173:0/1258221161 conn(0x7f18f80b31d0 msgr2=0x7f18f80b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:09.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.399+0000 7f18fec00640 1 -- 172.21.15.173:0/1258221161 shutdown_connections 2024-04-25T09:10:09.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.399+0000 7f18fec00640 1 -- 172.21.15.173:0/1258221161 wait complete. 2024-04-25T09:10:09.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fec00640 1 Processor -- start 2024-04-25T09:10:09.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fec00640 1 -- start start 2024-04-25T09:10:09.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fec00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18f809aa60 0x7f18f80b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18f80b2910 0x7f18f81fa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18f815f060 0x7f18f81fa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fec00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f80cf870 con 0x7f18f809aa60 2024-04-25T09:10:09.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f815fe30 con 0x7f18f80b2910 2024-04-25T09:10:09.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f80aee40 con 0x7f18f815f060 2024-04-25T09:10:09.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fd800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18f809aa60 0x7f18f80b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fd800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18f809aa60 0x7f18f80b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51450/0 (socket says 172.21.15.173:51450) 2024-04-25T09:10:09.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fd800640 1 -- 172.21.15.173:0/3136993695 learned_addr learned my addr 172.21.15.173:0/3136993695 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:09.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fce00640 1 --2- 172.21.15.173:0/3136993695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18f80b2910 0x7f18f81fa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fe200640 1 --2- 172.21.15.173:0/3136993695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18f815f060 0x7f18f81fa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fd800640 1 -- 172.21.15.173:0/3136993695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18f815f060 msgr2=0x7f18f81fa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fd800640 1 --2- 172.21.15.173:0/3136993695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18f815f060 0x7f18f81fa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fd800640 1 -- 172.21.15.173:0/3136993695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18f80b2910 msgr2=0x7f18f81fa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fd800640 1 --2- 172.21.15.173:0/3136993695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18f80b2910 0x7f18f81fa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fd800640 1 -- 172.21.15.173:0/3136993695 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f80af120 con 0x7f18f809aa60 2024-04-25T09:10:09.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fce00640 1 --2- 172.21.15.173:0/3136993695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18f80b2910 0x7f18f81fa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:09.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fe200640 1 --2- 172.21.15.173:0/3136993695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18f815f060 0x7f18f81fa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:09.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fd800640 1 --2- 172.21.15.173:0/3136993695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18f809aa60 0x7f18f80b4df0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00efc0 tx=0x7f18ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18f5600640 1 -- 172.21.15.173:0/3136993695 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec018020 con 0x7f18f809aa60 2024-04-25T09:10:09.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18f5600640 1 -- 172.21.15.173:0/3136993695 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec014480 con 0x7f18f809aa60 2024-04-25T09:10:09.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18f5600640 1 -- 172.21.15.173:0/3136993695 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec014850 con 0x7f18f809aa60 2024-04-25T09:10:09.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fec00640 1 -- 172.21.15.173:0/3136993695 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f80af400 con 0x7f18f809aa60 2024-04-25T09:10:09.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.403+0000 7f18fec00640 1 -- 172.21.15.173:0/3136993695 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f80af9c0 con 0x7f18f809aa60 2024-04-25T09:10:09.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.407+0000 7f18fec00640 1 -- 172.21.15.173:0/3136993695 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f8073a40 con 0x7f18f809aa60 2024-04-25T09:10:09.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.407+0000 7f18f5600640 1 -- 172.21.15.173:0/3136993695 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f18ec01b020 con 0x7f18f809aa60 2024-04-25T09:10:09.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.407+0000 7f18f5600640 1 --2- 172.21.15.173:0/3136993695 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f18d8066f60 0x7f18d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.407+0000 7f18f5600640 1 -- 172.21.15.173:0/3136993695 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f18ec085c80 con 0x7f18f809aa60 2024-04-25T09:10:09.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.407+0000 7f18fce00640 1 --2- 172.21.15.173:0/3136993695 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f18d8066f60 0x7f18d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.407+0000 7f18fce00640 1 --2- 172.21.15.173:0/3136993695 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f18d8066f60 0x7f18d8069420 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f18f80b4470 tx=0x7f18e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.411+0000 7f18f5600640 1 -- 172.21.15.173:0/3136993695 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f18ec022070 con 0x7f18f809aa60 2024-04-25T09:10:09.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.567+0000 7f18fec00640 1 -- 172.21.15.173:0/3136993695 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18f80b1b60 con 0x7f18f809aa60 2024-04-25T09:10:09.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.567+0000 7f18f5600640 1 -- 172.21.15.173:0/3136993695 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) v1 ==== 100+0+11 (secure 0 0 0) 0x7f18ec010040 con 0x7f18f809aa60 2024-04-25T09:10:09.556 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:10:09.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.567+0000 7f18fec00640 1 -- 172.21.15.173:0/3136993695 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f18d8066f60 msgr2=0x7f18d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.567+0000 7f18fec00640 1 --2- 172.21.15.173:0/3136993695 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f18d8066f60 0x7f18d8069420 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f18f80b4470 tx=0x7f18e4009040 comp rx=0 tx=0).stop 2024-04-25T09:10:09.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.567+0000 7f18fec00640 1 -- 172.21.15.173:0/3136993695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18f809aa60 msgr2=0x7f18f80b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.567+0000 7f18fec00640 1 --2- 172.21.15.173:0/3136993695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18f809aa60 0x7f18f80b4df0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00efc0 tx=0x7f18ec00c490 comp rx=0 tx=0).stop 2024-04-25T09:10:09.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.567+0000 7f18fec00640 1 -- 172.21.15.173:0/3136993695 shutdown_connections 2024-04-25T09:10:09.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.567+0000 7f18fec00640 1 --2- 172.21.15.173:0/3136993695 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f18d8066f60 0x7f18d8069420 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.567+0000 7f18fec00640 1 --2- 172.21.15.173:0/3136993695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18f815f060 0x7f18f81fa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.567+0000 7f18fec00640 1 --2- 172.21.15.173:0/3136993695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18f80b2910 0x7f18f81fa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.567+0000 7f18fec00640 1 --2- 172.21.15.173:0/3136993695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18f809aa60 0x7f18f80b4df0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.567+0000 7f18fec00640 1 -- 172.21.15.173:0/3136993695 >> 172.21.15.173:0/3136993695 conn(0x7f18f80b31d0 msgr2=0x7f18f80b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:09.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.567+0000 7f18fec00640 1 -- 172.21.15.173:0/3136993695 shutdown_connections 2024-04-25T09:10:09.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.567+0000 7f18fec00640 1 -- 172.21.15.173:0/3136993695 wait complete. 2024-04-25T09:10:09.578 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:09.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.727+0000 7fc363800640 1 Processor -- start 2024-04-25T09:10:09.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.727+0000 7fc363800640 1 -- start start 2024-04-25T09:10:09.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.727+0000 7fc363800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc35c06dac0 0x7fc35c0ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.727+0000 7fc363800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc35c06bca0 0x7fc35c06c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.727+0000 7fc363800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c061d60 con 0x7fc35c160fe0 2024-04-25T09:10:09.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.727+0000 7fc363800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c06c640 con 0x7fc35c06bca0 2024-04-25T09:10:09.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.727+0000 7fc363800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c1613c0 con 0x7fc35c06dac0 2024-04-25T09:10:09.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.727+0000 7fc35be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc35c06dac0 0x7fc35c0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.727+0000 7fc361800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc35c06bca0 0x7fc35c06c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.727+0000 7fc360e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fc35c160fe0 0x7fc35c161fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:38960/0 (socket says 172.21.15.173:38960) 2024-04-25T09:10:09.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.727+0000 7fc360e00640 1 -- 172.21.15.173:0/759498005 learned_addr learned my addr 172.21.15.173:0/759498005 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:09.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.727+0000 7fc35b400640 1 -- 172.21.15.173:0/759498005 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1726766765 0 0) 0x7fc34c0014a0 con 0x7fc35c160fe0 2024-04-25T09:10:09.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.727+0000 7fc35b400640 1 -- 172.21.15.173:0/759498005 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc340003530 con 0x7fc35c160fe0 2024-04-25T09:10:09.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.727+0000 7fc35be00640 1 -- 172.21.15.173:0/759498005 >> v2:172.21.15.194:3300/0 conn(0x7fc35c06bca0 msgr2=0x7fc35c06c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:09.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.727+0000 7fc35be00640 1 --2- 172.21.15.173:0/759498005 >> v2:172.21.15.194:3300/0 conn(0x7fc35c06bca0 0x7fc35c06c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.727+0000 7fc35be00640 1 -- 172.21.15.173:0/759498005 >> v1:172.21.15.194:6789/0 conn(0x7fc35c160fe0 legacy=0x7fc35c161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.727+0000 7fc35be00640 1 -- 172.21.15.173:0/759498005 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c06dfa0 con 0x7fc35c06dac0 2024-04-25T09:10:09.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.727+0000 7fc361800640 1 --2- 172.21.15.173:0/759498005 >> v2:172.21.15.194:3300/0 conn(0x7fc35c06bca0 0x7fc35c06c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:09.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.731+0000 7fc35be00640 1 --2- 172.21.15.173:0/759498005 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc35c06dac0 0x7fc35c0ace00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc3480097c0 tx=0x7fc34801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e943dfaba9172b7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.731+0000 7fc35b400640 1 -- 172.21.15.173:0/759498005 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3480b1070 con 0x7fc35c06dac0 2024-04-25T09:10:09.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.731+0000 7fc35b400640 1 -- 172.21.15.173:0/759498005 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3480a8050 con 0x7fc35c06dac0 2024-04-25T09:10:09.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.731+0000 7fc35b400640 1 -- 172.21.15.173:0/759498005 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3480ac860 con 0x7fc35c06dac0 2024-04-25T09:10:09.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.731+0000 7fc363800640 1 -- 172.21.15.173:0/759498005 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc35c06dac0 msgr2=0x7fc35c0ace00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.731+0000 7fc363800640 1 --2- 172.21.15.173:0/759498005 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc35c06dac0 0x7fc35c0ace00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc3480097c0 tx=0x7fc34801c3e0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.731+0000 7fc363800640 1 -- 172.21.15.173:0/759498005 shutdown_connections 2024-04-25T09:10:09.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.731+0000 7fc363800640 1 --2- 172.21.15.173:0/759498005 >> v2:172.21.15.194:3300/0 conn(0x7fc35c06bca0 0x7fc35c06c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.731+0000 7fc363800640 1 --2- 172.21.15.173:0/759498005 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc35c06dac0 0x7fc35c0ace00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.731+0000 7fc363800640 1 -- 172.21.15.173:0/759498005 >> 172.21.15.173:0/759498005 conn(0x7fc35c071c20 msgr2=0x7fc35c072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:09.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.731+0000 7fc363800640 1 -- 172.21.15.173:0/759498005 shutdown_connections 2024-04-25T09:10:09.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.731+0000 7fc363800640 1 -- 172.21.15.173:0/759498005 wait complete. 2024-04-25T09:10:09.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc363800640 1 Processor -- start 2024-04-25T09:10:09.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc363800640 1 -- start start 2024-04-25T09:10:09.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc363800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc35c06bca0 0x7fc35c149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc363800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc35c06dac0 0x7fc35c14b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc363800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc35c160fe0 0x7fc35c14be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc363800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0ad340 con 0x7fc35c06dac0 2024-04-25T09:10:09.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc363800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c06eb20 con 0x7fc35c160fe0 2024-04-25T09:10:09.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc363800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0ad4c0 con 0x7fc35c06bca0 2024-04-25T09:10:09.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc35be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc35c06dac0 0x7fc35c14b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc360e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc35c06bca0 0x7fc35c149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc35be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc35c06dac0 0x7fc35c14b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51460/0 (socket says 172.21.15.173:51460) 2024-04-25T09:10:09.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc361800640 1 --2- 172.21.15.173:0/517281623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc35c160fe0 0x7fc35c14be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc35be00640 1 -- 172.21.15.173:0/517281623 learned_addr learned my addr 172.21.15.173:0/517281623 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:09.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc35be00640 1 -- 172.21.15.173:0/517281623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc35c06bca0 msgr2=0x7fc35c149250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc35be00640 1 --2- 172.21.15.173:0/517281623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc35c06bca0 0x7fc35c149250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc35be00640 1 -- 172.21.15.173:0/517281623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc35c160fe0 msgr2=0x7fc35c14be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc35be00640 1 --2- 172.21.15.173:0/517281623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc35c160fe0 0x7fc35c14be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc35be00640 1 -- 172.21.15.173:0/517281623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c1556c0 con 0x7fc35c06dac0 2024-04-25T09:10:09.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc35be00640 1 --2- 172.21.15.173:0/517281623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc35c06dac0 0x7fc35c14b8d0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fc3480af040 tx=0x7fc348019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc358c00640 1 -- 172.21.15.173:0/517281623 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3480b1040 con 0x7fc35c06dac0 2024-04-25T09:10:09.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc358c00640 1 -- 172.21.15.173:0/517281623 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3480bb070 con 0x7fc35c06dac0 2024-04-25T09:10:09.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc363800640 1 -- 172.21.15.173:0/517281623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c1521b0 con 0x7fc35c06dac0 2024-04-25T09:10:09.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc358c00640 1 -- 172.21.15.173:0/517281623 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3480b5410 con 0x7fc35c06dac0 2024-04-25T09:10:09.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.735+0000 7fc363800640 1 -- 172.21.15.173:0/517281623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c152770 con 0x7fc35c06dac0 2024-04-25T09:10:09.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.739+0000 7fc363800640 1 -- 172.21.15.173:0/517281623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c073a40 con 0x7fc35c06dac0 2024-04-25T09:10:09.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.739+0000 7fc358c00640 1 -- 172.21.15.173:0/517281623 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc3480b55b0 con 0x7fc35c06dac0 2024-04-25T09:10:09.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.739+0000 7fc358c00640 1 --2- 172.21.15.173:0/517281623 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc33c066f90 0x7fc33c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.739+0000 7fc358c00640 1 -- 172.21.15.173:0/517281623 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc34811edb0 con 0x7fc35c06dac0 2024-04-25T09:10:09.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.739+0000 7fc360e00640 1 --2- 172.21.15.173:0/517281623 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc33c066f90 0x7fc33c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.739+0000 7fc360e00640 1 --2- 172.21.15.173:0/517281623 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc33c066f90 0x7fc33c069450 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc34c005c10 tx=0x7fc34c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.743+0000 7fc358c00640 1 -- 172.21.15.173:0/517281623 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc3480c5020 con 0x7fc35c06dac0 2024-04-25T09:10:09.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.935+0000 7fc363800640 1 -- 172.21.15.173:0/517281623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc35c0cf6c0 con 0x7fc35c06dac0 2024-04-25T09:10:09.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.935+0000 7fc358c00640 1 -- 172.21.15.173:0/517281623 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fc35c1556c0 con 0x7fc35c06dac0 2024-04-25T09:10:09.923 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:09.923 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/556010437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":556010437},{"type":"v1","addr":"172.21.15.173:6835","nonce":556010437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":6524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4077641924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4077641924},{"type":"v1","addr":"172.21.15.194:6834","nonce":4077641924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7162,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2938501478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2938501478},{"type":"v1","addr":"172.21.15.194:6835","nonce":2938501478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:09:26.257282+0000","modified":"2024-04-25T09:09:29.275838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/555490935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":555490935},{"type":"v1","addr":"172.21.15.173:6837","nonce":555490935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:10:09.924 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 65 2024-04-25T09:10:09.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.935+0000 7fc363800640 1 -- 172.21.15.173:0/517281623 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc33c066f90 msgr2=0x7fc33c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.935+0000 7fc363800640 1 --2- 172.21.15.173:0/517281623 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc33c066f90 0x7fc33c069450 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc34c005c10 tx=0x7fc34c009040 comp rx=0 tx=0).stop 2024-04-25T09:10:09.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.935+0000 7fc363800640 1 -- 172.21.15.173:0/517281623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc35c06dac0 msgr2=0x7fc35c14b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.935+0000 7fc363800640 1 --2- 172.21.15.173:0/517281623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc35c06dac0 0x7fc35c14b8d0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fc3480af040 tx=0x7fc348019180 comp rx=0 tx=0).stop 2024-04-25T09:10:09.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.935+0000 7fc363800640 1 -- 172.21.15.173:0/517281623 shutdown_connections 2024-04-25T09:10:09.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.935+0000 7fc363800640 1 --2- 172.21.15.173:0/517281623 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc33c066f90 0x7fc33c069450 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.935+0000 7fc363800640 1 --2- 172.21.15.173:0/517281623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc35c160fe0 0x7fc35c14be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.935+0000 7fc363800640 1 --2- 172.21.15.173:0/517281623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc35c06dac0 0x7fc35c14b8d0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.935+0000 7fc363800640 1 --2- 172.21.15.173:0/517281623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc35c06bca0 0x7fc35c149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.935+0000 7fc363800640 1 -- 172.21.15.173:0/517281623 >> 172.21.15.173:0/517281623 conn(0x7fc35c071c20 msgr2=0x7fc35c14d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:09.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.935+0000 7fc363800640 1 -- 172.21.15.173:0/517281623 shutdown_connections 2024-04-25T09:10:09.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:09.935+0000 7fc363800640 1 -- 172.21.15.173:0/517281623 wait complete. 2024-04-25T09:10:09.944 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:10.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.091+0000 7fb7dba00640 1 Processor -- start 2024-04-25T09:10:10.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.091+0000 7fb7dba00640 1 -- start start 2024-04-25T09:10:10.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.091+0000 7fb7dba00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb7d408a560 0x7fb7d406e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.091+0000 7fb7dba00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb7d40b3870 0x7fb7d416aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.091+0000 7fb7dba00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d416b5f0 con 0x7fb7d408a940 2024-04-25T09:10:10.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.091+0000 7fb7dba00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d406dbe0 con 0x7fb7d40b3870 2024-04-25T09:10:10.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.091+0000 7fb7dba00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d416b8d0 con 0x7fb7d408a560 2024-04-25T09:10:10.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.091+0000 7fb7d9a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb7d40b3870 0x7fb7d416aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.091+0000 7fb7d9a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb7d40b3870 0x7fb7d416aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51476/0 (socket says 172.21.15.173:51476) 2024-04-25T09:10:10.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.091+0000 7fb7d9a00640 1 -- 172.21.15.173:0/1623168670 learned_addr learned my addr 172.21.15.173:0/1623168670 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:10.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.091+0000 7fb7d9000640 1 --2- 172.21.15.173:0/1623168670 >> v2:172.21.15.194:3300/0 conn(0x7fb7d408a560 0x7fb7d406e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.095+0000 7fb7d3400640 1 -- 172.21.15.173:0/1623168670 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428170427 0 0) 0x7fb7d416b5f0 con 0x7fb7d408a940 2024-04-25T09:10:10.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.323+0000 7fb7d3400640 1 -- 172.21.15.173:0/1623168670 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7bc003530 con 0x7fb7d408a940 2024-04-25T09:10:10.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.323+0000 7fb7d9a00640 1 -- 172.21.15.173:0/1623168670 >> v2:172.21.15.194:3300/0 conn(0x7fb7d408a560 msgr2=0x7fb7d406e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:10.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.323+0000 7fb7d9a00640 1 --2- 172.21.15.173:0/1623168670 >> v2:172.21.15.194:3300/0 conn(0x7fb7d408a560 0x7fb7d406e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.323+0000 7fb7d9a00640 1 -- 172.21.15.173:0/1623168670 >> v1:172.21.15.194:6789/0 conn(0x7fb7d408a940 legacy=0x7fb7d40b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.323+0000 7fb7d9a00640 1 -- 172.21.15.173:0/1623168670 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d416bbb0 con 0x7fb7d40b3870 2024-04-25T09:10:10.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.327+0000 7fb7d9a00640 1 --2- 172.21.15.173:0/1623168670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7d40b3870 0x7fb7d416aea0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4072b20 tx=0x7fb7cc01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f7c09a152fd81f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.327+0000 7fb7d3400640 1 -- 172.21.15.173:0/1623168670 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc0a5620 con 0x7fb7d40b3870 2024-04-25T09:10:10.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.327+0000 7fb7d3400640 1 -- 172.21.15.173:0/1623168670 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc0a57c0 con 0x7fb7d40b3870 2024-04-25T09:10:10.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.327+0000 7fb7d3400640 1 -- 172.21.15.173:0/1623168670 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc0a5b90 con 0x7fb7d40b3870 2024-04-25T09:10:10.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.327+0000 7fb7dba00640 1 -- 172.21.15.173:0/1623168670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7d40b3870 msgr2=0x7fb7d416aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.327+0000 7fb7dba00640 1 --2- 172.21.15.173:0/1623168670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7d40b3870 0x7fb7d416aea0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4072b20 tx=0x7fb7cc01c960 comp rx=0 tx=0).stop 2024-04-25T09:10:10.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.327+0000 7fb7dba00640 1 -- 172.21.15.173:0/1623168670 shutdown_connections 2024-04-25T09:10:10.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.327+0000 7fb7dba00640 1 --2- 172.21.15.173:0/1623168670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7d40b3870 0x7fb7d416aea0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.327+0000 7fb7dba00640 1 --2- 172.21.15.173:0/1623168670 >> v2:172.21.15.194:3300/0 conn(0x7fb7d408a560 0x7fb7d406e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.327+0000 7fb7dba00640 1 -- 172.21.15.173:0/1623168670 >> 172.21.15.173:0/1623168670 conn(0x7fb7d406ac90 msgr2=0x7fb7d406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:10.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.327+0000 7fb7dba00640 1 -- 172.21.15.173:0/1623168670 shutdown_connections 2024-04-25T09:10:10.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.327+0000 7fb7dba00640 1 -- 172.21.15.173:0/1623168670 wait complete. 2024-04-25T09:10:10.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7dba00640 1 Processor -- start 2024-04-25T09:10:10.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7dba00640 1 -- start start 2024-04-25T09:10:10.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7dba00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7d408a560 0x7fb7d4089550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7dba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7d408a940 0x7fb7d4161000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7dba00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7d40b3870 0x7fb7d4161540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7dba00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d40af130 con 0x7fb7d40b3870 2024-04-25T09:10:10.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7dba00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d40aefb0 con 0x7fb7d408a560 2024-04-25T09:10:10.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7dba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d416c690 con 0x7fb7d408a940 2024-04-25T09:10:10.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7d9a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7d40b3870 0x7fb7d4161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7d9a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7d40b3870 0x7fb7d4161540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51480/0 (socket says 172.21.15.173:51480) 2024-04-25T09:10:10.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7d9a00640 1 -- 172.21.15.173:0/664528819 learned_addr learned my addr 172.21.15.173:0/664528819 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:10.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7d9000640 1 --2- 172.21.15.173:0/664528819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7d408a560 0x7fb7d4089550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7d3e00640 1 --2- 172.21.15.173:0/664528819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7d408a940 0x7fb7d4161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7d9a00640 1 -- 172.21.15.173:0/664528819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7d408a940 msgr2=0x7fb7d4161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7d9a00640 1 --2- 172.21.15.173:0/664528819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7d408a940 0x7fb7d4161000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7d9a00640 1 -- 172.21.15.173:0/664528819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7d408a560 msgr2=0x7fb7d4089550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7d9a00640 1 --2- 172.21.15.173:0/664528819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7d408a560 0x7fb7d4089550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7d9a00640 1 -- 172.21.15.173:0/664528819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d4165d00 con 0x7fb7d40b3870 2024-04-25T09:10:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.331+0000 7fb7d9a00640 1 --2- 172.21.15.173:0/664528819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7d40b3870 0x7fb7d4161540 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc019570 tx=0x7fb7cc019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.335+0000 7fb7d0c00640 1 -- 172.21.15.173:0/664528819 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc0bc020 con 0x7fb7d40b3870 2024-04-25T09:10:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.335+0000 7fb7d0c00640 1 -- 172.21.15.173:0/664528819 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc0b8690 con 0x7fb7d40b3870 2024-04-25T09:10:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.335+0000 7fb7dba00640 1 -- 172.21.15.173:0/664528819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d415e250 con 0x7fb7d40b3870 2024-04-25T09:10:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.335+0000 7fb7d0c00640 1 -- 172.21.15.173:0/664528819 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc0a5620 con 0x7fb7d40b3870 2024-04-25T09:10:10.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.335+0000 7fb7dba00640 1 -- 172.21.15.173:0/664528819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d4089a90 con 0x7fb7d40b3870 2024-04-25T09:10:10.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.335+0000 7fb7dba00640 1 -- 172.21.15.173:0/664528819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d4073a40 con 0x7fb7d40b3870 2024-04-25T09:10:10.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.335+0000 7fb7d0c00640 1 -- 172.21.15.173:0/664528819 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb7cc0bf020 con 0x7fb7d40b3870 2024-04-25T09:10:10.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.335+0000 7fb7d0c00640 1 --2- 172.21.15.173:0/664528819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb7b4066f90 0x7fb7b4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.335+0000 7fb7d0c00640 1 -- 172.21.15.173:0/664528819 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb7cc11fd00 con 0x7fb7d40b3870 2024-04-25T09:10:10.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.335+0000 7fb7d9000640 1 --2- 172.21.15.173:0/664528819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb7b4066f90 0x7fb7b4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.339+0000 7fb7d9000640 1 --2- 172.21.15.173:0/664528819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb7b4066f90 0x7fb7b4069450 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8009d60 tx=0x7fb7c800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.339+0000 7fb7d0c00640 1 -- 172.21.15.173:0/664528819 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb7cc0c6030 con 0x7fb7d40b3870 2024-04-25T09:10:10.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.499+0000 7fb7dba00640 1 -- 172.21.15.173:0/664528819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7d40b3ec0 con 0x7fb7d40b3870 2024-04-25T09:10:10.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.499+0000 7fb7d0c00640 1 -- 172.21.15.173:0/664528819 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16945 (secure 0 0 0) 0x7fb7cc0165e0 con 0x7fb7d40b3870 2024-04-25T09:10:10.490 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:10.490 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":97,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:09:27.873210+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:09:24.629351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T09:09:25.248841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:10.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.503+0000 7fb7dba00640 1 -- 172.21.15.173:0/664528819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb7b4066f90 msgr2=0x7fb7b4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.503+0000 7fb7dba00640 1 --2- 172.21.15.173:0/664528819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb7b4066f90 0x7fb7b4069450 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8009d60 tx=0x7fb7c800b040 comp rx=0 tx=0).stop 2024-04-25T09:10:10.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.503+0000 7fb7dba00640 1 -- 172.21.15.173:0/664528819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7d40b3870 msgr2=0x7fb7d4161540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.503+0000 7fb7dba00640 1 --2- 172.21.15.173:0/664528819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7d40b3870 0x7fb7d4161540 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc019570 tx=0x7fb7cc019700 comp rx=0 tx=0).stop 2024-04-25T09:10:10.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.503+0000 7fb7dba00640 1 -- 172.21.15.173:0/664528819 shutdown_connections 2024-04-25T09:10:10.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.503+0000 7fb7dba00640 1 --2- 172.21.15.173:0/664528819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb7b4066f90 0x7fb7b4069450 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.503+0000 7fb7dba00640 1 --2- 172.21.15.173:0/664528819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7d40b3870 0x7fb7d4161540 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.503+0000 7fb7dba00640 1 --2- 172.21.15.173:0/664528819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7d408a940 0x7fb7d4161000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.503+0000 7fb7dba00640 1 --2- 172.21.15.173:0/664528819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7d408a560 0x7fb7d4089550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.503+0000 7fb7dba00640 1 -- 172.21.15.173:0/664528819 >> 172.21.15.173:0/664528819 conn(0x7fb7d406ac90 msgr2=0x7fb7d40cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:10.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.503+0000 7fb7dba00640 1 -- 172.21.15.173:0/664528819 shutdown_connections 2024-04-25T09:10:10.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.503+0000 7fb7dba00640 1 -- 172.21.15.173:0/664528819 wait complete. 2024-04-25T09:10:10.511 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:10:10.511 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:10.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.659+0000 7fdcfbe00640 1 Processor -- start 2024-04-25T09:10:10.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.659+0000 7fdcfbe00640 1 -- start start 2024-04-25T09:10:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.659+0000 7fdcfbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdcfc06c270 0x7fdcfc06c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.659+0000 7fdcfbe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdcfc06ccf0 0x7fdcfc0b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.659+0000 7fdcfbe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcfc09ad60 con 0x7fdcfc15da60 2024-04-25T09:10:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.659+0000 7fdcfbe00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcfc09ab40 con 0x7fdcfc06c270 2024-04-25T09:10:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.659+0000 7fdcfbe00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcfc06d140 con 0x7fdcfc06ccf0 2024-04-25T09:10:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.659+0000 7fdcf2000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdcfc06c270 0x7fdcfc06c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.659+0000 7fdcf2000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdcfc06c270 0x7fdcfc06c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51490/0 (socket says 172.21.15.173:51490) 2024-04-25T09:10:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.659+0000 7fdcf2000640 1 -- 172.21.15.173:0/4186424859 learned_addr learned my addr 172.21.15.173:0/4186424859 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:10.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.659+0000 7fdcfb400640 1 --2- 172.21.15.173:0/4186424859 >> v2:172.21.15.194:3300/0 conn(0x7fdcfc06ccf0 0x7fdcfc0b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.659+0000 7fdcf2000640 1 -- 172.21.15.173:0/4186424859 >> v2:172.21.15.194:3300/0 conn(0x7fdcfc06ccf0 msgr2=0x7fdcfc0b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:10.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.659+0000 7fdcf2000640 1 --2- 172.21.15.173:0/4186424859 >> v2:172.21.15.194:3300/0 conn(0x7fdcfc06ccf0 0x7fdcfc0b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.659+0000 7fdcf2000640 1 -- 172.21.15.173:0/4186424859 >> v1:172.21.15.194:6789/0 conn(0x7fdcfc15da60 legacy=0x7fdcfc09a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.659+0000 7fdcf2000640 1 -- 172.21.15.173:0/4186424859 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc0cbd30 con 0x7fdcfc06c270 2024-04-25T09:10:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.663+0000 7fdcf2000640 1 --2- 172.21.15.173:0/4186424859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc06c270 0x7fdcfc06c7b0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc072550 tx=0x7fdce401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdaca0db4a3a3569 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.663+0000 7fdcfa000640 1 -- 172.21.15.173:0/4186424859 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40ab610 con 0x7fdcfc06c270 2024-04-25T09:10:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.663+0000 7fdcfa000640 1 -- 172.21.15.173:0/4186424859 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce40b0070 con 0x7fdcfc06c270 2024-04-25T09:10:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.663+0000 7fdcfa000640 1 -- 172.21.15.173:0/4186424859 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40ab9d0 con 0x7fdcfc06c270 2024-04-25T09:10:10.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.663+0000 7fdcfbe00640 1 -- 172.21.15.173:0/4186424859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc06c270 msgr2=0x7fdcfc06c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.663+0000 7fdcfbe00640 1 --2- 172.21.15.173:0/4186424859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc06c270 0x7fdcfc06c7b0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc072550 tx=0x7fdce401c520 comp rx=0 tx=0).stop 2024-04-25T09:10:10.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.663+0000 7fdcfbe00640 1 -- 172.21.15.173:0/4186424859 shutdown_connections 2024-04-25T09:10:10.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.663+0000 7fdcfbe00640 1 --2- 172.21.15.173:0/4186424859 >> v2:172.21.15.194:3300/0 conn(0x7fdcfc06ccf0 0x7fdcfc0b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.663+0000 7fdcfbe00640 1 --2- 172.21.15.173:0/4186424859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc06c270 0x7fdcfc06c7b0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.663+0000 7fdcfbe00640 1 -- 172.21.15.173:0/4186424859 >> 172.21.15.173:0/4186424859 conn(0x7fdcfc0b3130 msgr2=0x7fdcfc0b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:10.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.663+0000 7fdcfbe00640 1 -- 172.21.15.173:0/4186424859 shutdown_connections 2024-04-25T09:10:10.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.663+0000 7fdcfbe00640 1 -- 172.21.15.173:0/4186424859 wait complete. 2024-04-25T09:10:10.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.663+0000 7fdcfbe00640 1 Processor -- start 2024-04-25T09:10:10.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.663+0000 7fdcfbe00640 1 -- start start 2024-04-25T09:10:10.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcfc06c270 0x7fdcfc14be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcfc06ccf0 0x7fdcfc159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc15da60 0x7fdcfc0cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfbe00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc15dfc0 con 0x7fdcfc15da60 2024-04-25T09:10:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfbe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc15de40 con 0x7fdcfc06c270 2024-04-25T09:10:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfbe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc0ccad0 con 0x7fdcfc06ccf0 2024-04-25T09:10:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc15da60 0x7fdcfc0cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc15da60 0x7fdcfc0cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51498/0 (socket says 172.21.15.173:51498) 2024-04-25T09:10:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfb400640 1 -- 172.21.15.173:0/794253719 learned_addr learned my addr 172.21.15.173:0/794253719 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfaa00640 1 --2- 172.21.15.173:0/794253719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcfc06c270 0x7fdcfc14be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcf2000640 1 --2- 172.21.15.173:0/794253719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcfc06ccf0 0x7fdcfc159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfb400640 1 -- 172.21.15.173:0/794253719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcfc06ccf0 msgr2=0x7fdcfc159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfb400640 1 --2- 172.21.15.173:0/794253719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcfc06ccf0 0x7fdcfc159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfb400640 1 -- 172.21.15.173:0/794253719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcfc06c270 msgr2=0x7fdcfc14be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfb400640 1 --2- 172.21.15.173:0/794253719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcfc06c270 0x7fdcfc14be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfb400640 1 -- 172.21.15.173:0/794253719 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc0af1a0 con 0x7fdcfc15da60 2024-04-25T09:10:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfaa00640 1 --2- 172.21.15.173:0/794253719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcfc06c270 0x7fdcfc14be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfb400640 1 --2- 172.21.15.173:0/794253719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc15da60 0x7fdcfc0cae00 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400efc0 tx=0x7fdcf400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcf3400640 1 -- 172.21.15.173:0/794253719 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4018020 con 0x7fdcfc15da60 2024-04-25T09:10:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcf3400640 1 -- 172.21.15.173:0/794253719 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf4014480 con 0x7fdcfc15da60 2024-04-25T09:10:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcf3400640 1 -- 172.21.15.173:0/794253719 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4014870 con 0x7fdcfc15da60 2024-04-25T09:10:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfbe00640 1 -- 172.21.15.173:0/794253719 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc0c92c0 con 0x7fdcfc15da60 2024-04-25T09:10:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfbe00640 1 -- 172.21.15.173:0/794253719 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcfc0af440 con 0x7fdcfc15da60 2024-04-25T09:10:10.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcfbe00640 1 -- 172.21.15.173:0/794253719 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcfc073a40 con 0x7fdcfc15da60 2024-04-25T09:10:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.667+0000 7fdcf3400640 1 -- 172.21.15.173:0/794253719 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdcf401b020 con 0x7fdcfc15da60 2024-04-25T09:10:10.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.671+0000 7fdcf3400640 1 --2- 172.21.15.173:0/794253719 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdcd8066f60 0x7fdcd8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.671+0000 7fdcf3400640 1 -- 172.21.15.173:0/794253719 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdcf4085c90 con 0x7fdcfc15da60 2024-04-25T09:10:10.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.671+0000 7fdcfaa00640 1 --2- 172.21.15.173:0/794253719 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdcd8066f60 0x7fdcd8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.671+0000 7fdcfaa00640 1 --2- 172.21.15.173:0/794253719 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdcd8066f60 0x7fdcd8069420 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fdcec001670 tx=0x7fdcec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.675+0000 7fdcf3400640 1 -- 172.21.15.173:0/794253719 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdcf4022070 con 0x7fdcfc15da60 2024-04-25T09:10:10.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.859+0000 7fdcfbe00640 1 -- 172.21.15.173:0/794253719 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcfc155890 con 0x7fdcfc15da60 2024-04-25T09:10:10.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.859+0000 7fdcf3400640 1 -- 172.21.15.173:0/794253719 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fdcf4010040 con 0x7fdcfc15da60 2024-04-25T09:10:10.850 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:10.850 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/556010437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":556010437},{"type":"v1","addr":"172.21.15.173:6835","nonce":556010437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":6524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4077641924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4077641924},{"type":"v1","addr":"172.21.15.194:6834","nonce":4077641924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7162,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2938501478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2938501478},{"type":"v1","addr":"172.21.15.194:6835","nonce":2938501478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:09:26.257282+0000","modified":"2024-04-25T09:09:29.275838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/555490935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":555490935},{"type":"v1","addr":"172.21.15.173:6837","nonce":555490935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:10:10.850 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 65 2024-04-25T09:10:10.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.863+0000 7fdcfbe00640 1 -- 172.21.15.173:0/794253719 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdcd8066f60 msgr2=0x7fdcd8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.863+0000 7fdcfbe00640 1 --2- 172.21.15.173:0/794253719 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdcd8066f60 0x7fdcd8069420 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fdcec001670 tx=0x7fdcec009040 comp rx=0 tx=0).stop 2024-04-25T09:10:10.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.863+0000 7fdcfbe00640 1 -- 172.21.15.173:0/794253719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc15da60 msgr2=0x7fdcfc0cae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.863+0000 7fdcfbe00640 1 --2- 172.21.15.173:0/794253719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc15da60 0x7fdcfc0cae00 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400efc0 tx=0x7fdcf400c490 comp rx=0 tx=0).stop 2024-04-25T09:10:10.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.863+0000 7fdcfbe00640 1 -- 172.21.15.173:0/794253719 shutdown_connections 2024-04-25T09:10:10.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.863+0000 7fdcfbe00640 1 --2- 172.21.15.173:0/794253719 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdcd8066f60 0x7fdcd8069420 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.863+0000 7fdcfbe00640 1 --2- 172.21.15.173:0/794253719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc15da60 0x7fdcfc0cae00 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.863+0000 7fdcfbe00640 1 --2- 172.21.15.173:0/794253719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcfc06ccf0 0x7fdcfc159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.863+0000 7fdcfbe00640 1 --2- 172.21.15.173:0/794253719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcfc06c270 0x7fdcfc14be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.863+0000 7fdcfbe00640 1 -- 172.21.15.173:0/794253719 >> 172.21.15.173:0/794253719 conn(0x7fdcfc0b3130 msgr2=0x7fdcfc0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:10.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.863+0000 7fdcfbe00640 1 -- 172.21.15.173:0/794253719 shutdown_connections 2024-04-25T09:10:10.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:10.863+0000 7fdcfbe00640 1 -- 172.21.15.173:0/794253719 wait complete. 2024-04-25T09:10:10.872 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:11.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.019+0000 7fcb85c00640 1 Processor -- start 2024-04-25T09:10:11.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.019+0000 7fcb85c00640 1 -- start start 2024-04-25T09:10:11.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.019+0000 7fcb85c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb8015dc60 0x7fcb800b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.019+0000 7fcb85c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8015e8e0 con 0x7fcb800ae810 2024-04-25T09:10:11.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.019+0000 7fcb85c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8015ebc0 con 0x7fcb8015e040 2024-04-25T09:10:11.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.019+0000 7fcb85c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb80071450 con 0x7fcb8015dc60 2024-04-25T09:10:11.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.019+0000 7fcb7f400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fcb800ae810 0x7fcb800718e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53642/0 (socket says 172.21.15.173:53642) 2024-04-25T09:10:11.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.019+0000 7fcb7f400640 1 -- 172.21.15.173:0/633852558 learned_addr learned my addr 172.21.15.173:0/633852558 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:11.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.019+0000 7fcb7ea00640 1 --2- 172.21.15.173:0/633852558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb8015dc60 0x7fcb800b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.019+0000 7fcb7e000640 1 -- 172.21.15.173:0/633852558 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995162113 0 0) 0x7fcb8015e8e0 con 0x7fcb800ae810 2024-04-25T09:10:11.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7e000640 1 -- 172.21.15.173:0/633852558 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb64003530 con 0x7fcb800ae810 2024-04-25T09:10:11.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7e000640 1 -- 172.21.15.173:0/633852558 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2861229048 0 0) 0x7fcb64003530 con 0x7fcb800ae810 2024-04-25T09:10:11.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7e000640 1 -- 172.21.15.173:0/633852558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb8015dc60 msgr2=0x7fcb800b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:11.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7e000640 1 --2- 172.21.15.173:0/633852558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb8015dc60 0x7fcb800b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7e000640 1 -- 172.21.15.173:0/633852558 >> v1:172.21.15.194:6789/0 conn(0x7fcb8015e040 legacy=0x7fcb800ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7e000640 1 -- 172.21.15.173:0/633852558 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8015eea0 con 0x7fcb800ae810 2024-04-25T09:10:11.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7e000640 1 -- 172.21.15.173:0/633852558 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fcb78001680 con 0x7fcb800ae810 2024-04-25T09:10:11.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7e000640 1 -- 172.21.15.173:0/633852558 >> v1:172.21.15.173:6789/0 conn(0x7fcb800ae810 legacy=0x7fcb800718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7e000640 1 --2- 172.21.15.173:0/633852558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb640039f0 0x7fcb64003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7e000640 1 --2- 172.21.15.173:0/633852558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb8015dc60 0x7fcb64004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7e000640 1 --2- 172.21.15.173:0/633852558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb64004d50 0x7fcb640051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7e000640 1 -- 172.21.15.173:0/633852558 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb80071450 con 0x7fcb64004d50 2024-04-25T09:10:11.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7e000640 1 -- 172.21.15.173:0/633852558 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6400ba80 con 0x7fcb640039f0 2024-04-25T09:10:11.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7e000640 1 -- 172.21.15.173:0/633852558 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6400bc80 con 0x7fcb8015dc60 2024-04-25T09:10:11.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7f400640 1 --2- 172.21.15.173:0/633852558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb64004d50 0x7fcb640051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb76000640 1 --2- 172.21.15.173:0/633852558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb8015dc60 0x7fcb64004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7ea00640 1 --2- 172.21.15.173:0/633852558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb640039f0 0x7fcb64003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7ea00640 1 -- 172.21.15.173:0/633852558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb8015dc60 msgr2=0x7fcb64004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:11.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7ea00640 1 --2- 172.21.15.173:0/633852558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb8015dc60 0x7fcb64004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7ea00640 1 -- 172.21.15.173:0/633852558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb64004d50 msgr2=0x7fcb640051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:11.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7ea00640 1 --2- 172.21.15.173:0/633852558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb64004d50 0x7fcb640051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7ea00640 1 -- 172.21.15.173:0/633852558 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb64003530 con 0x7fcb640039f0 2024-04-25T09:10:11.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.023+0000 7fcb7f400640 1 --2- 172.21.15.173:0/633852558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb64004d50 0x7fcb640051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:11.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.027+0000 7fcb7ea00640 1 --2- 172.21.15.173:0/633852558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb640039f0 0x7fcb64003e10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009f90 tx=0x7fcb7001cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc2886fa60cca63a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:11.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.027+0000 7fcb7e000640 1 -- 172.21.15.173:0/633852558 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb700b2070 con 0x7fcb640039f0 2024-04-25T09:10:11.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.027+0000 7fcb7e000640 1 -- 172.21.15.173:0/633852558 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb700a5c50 con 0x7fcb640039f0 2024-04-25T09:10:11.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.027+0000 7fcb7e000640 1 -- 172.21.15.173:0/633852558 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70009c10 con 0x7fcb640039f0 2024-04-25T09:10:11.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.027+0000 7fcb85c00640 1 -- 172.21.15.173:0/633852558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb640039f0 msgr2=0x7fcb64003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.027+0000 7fcb85c00640 1 --2- 172.21.15.173:0/633852558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb640039f0 0x7fcb64003e10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009f90 tx=0x7fcb7001cc40 comp rx=0 tx=0).stop 2024-04-25T09:10:11.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.027+0000 7fcb7f400640 1 -- 172.21.15.173:0/633852558 reap_dead start 2024-04-25T09:10:11.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.027+0000 7fcb85c00640 1 -- 172.21.15.173:0/633852558 shutdown_connections 2024-04-25T09:10:11.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.027+0000 7fcb85c00640 1 -- 172.21.15.173:0/633852558 >> 172.21.15.173:0/633852558 conn(0x7fcb8006ac90 msgr2=0x7fcb8006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:11.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.027+0000 7fcb85c00640 1 -- 172.21.15.173:0/633852558 shutdown_connections 2024-04-25T09:10:11.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.027+0000 7fcb85c00640 1 -- 172.21.15.173:0/633852558 wait complete. 2024-04-25T09:10:11.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.027+0000 7fcb85c00640 1 Processor -- start 2024-04-25T09:10:11.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.027+0000 7fcb85c00640 1 -- start start 2024-04-25T09:10:11.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb85c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb640039f0 0x7fcb80152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb85c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb800ce860 0x7fcb800b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb85c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb80158870 0x7fcb80158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb85c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8015e480 con 0x7fcb640039f0 2024-04-25T09:10:11.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb85c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb800ad520 con 0x7fcb80158870 2024-04-25T09:10:11.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb85c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8015e600 con 0x7fcb800ce860 2024-04-25T09:10:11.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb7ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb640039f0 0x7fcb80152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb7ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb640039f0 0x7fcb80152220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51516/0 (socket says 172.21.15.173:51516) 2024-04-25T09:10:11.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb7ea00640 1 -- 172.21.15.173:0/3341765164 learned_addr learned my addr 172.21.15.173:0/3341765164 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:11.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb7f400640 1 --2- 172.21.15.173:0/3341765164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb80158870 0x7fcb80158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb76000640 1 --2- 172.21.15.173:0/3341765164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb800ce860 0x7fcb800b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb7ea00640 1 -- 172.21.15.173:0/3341765164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb800ce860 msgr2=0x7fcb800b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb7ea00640 1 --2- 172.21.15.173:0/3341765164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb800ce860 0x7fcb800b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb7ea00640 1 -- 172.21.15.173:0/3341765164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb80158870 msgr2=0x7fcb80158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb7ea00640 1 --2- 172.21.15.173:0/3341765164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb80158870 0x7fcb80158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb7ea00640 1 -- 172.21.15.173:0/3341765164 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb800b2090 con 0x7fcb640039f0 2024-04-25T09:10:11.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb76000640 1 --2- 172.21.15.173:0/3341765164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb800ce860 0x7fcb800b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:11.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb7ea00640 1 --2- 172.21.15.173:0/3341765164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb640039f0 0x7fcb80152220 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fcb7001ca70 tx=0x7fcb70009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:11.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb77400640 1 -- 172.21.15.173:0/3341765164 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb700ba070 con 0x7fcb640039f0 2024-04-25T09:10:11.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb77400640 1 -- 172.21.15.173:0/3341765164 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb700a5a50 con 0x7fcb640039f0 2024-04-25T09:10:11.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb85c00640 1 -- 172.21.15.173:0/3341765164 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb80156910 con 0x7fcb640039f0 2024-04-25T09:10:11.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb77400640 1 -- 172.21.15.173:0/3341765164 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb700b2040 con 0x7fcb640039f0 2024-04-25T09:10:11.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb85c00640 1 -- 172.21.15.173:0/3341765164 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb80152760 con 0x7fcb640039f0 2024-04-25T09:10:11.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb85c00640 1 -- 172.21.15.173:0/3341765164 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb80073a40 con 0x7fcb640039f0 2024-04-25T09:10:11.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.031+0000 7fcb77400640 1 -- 172.21.15.173:0/3341765164 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcb700bd070 con 0x7fcb640039f0 2024-04-25T09:10:11.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.035+0000 7fcb77400640 1 --2- 172.21.15.173:0/3341765164 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcb5c066f60 0x7fcb5c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.035+0000 7fcb77400640 1 -- 172.21.15.173:0/3341765164 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcb7011fbe0 con 0x7fcb640039f0 2024-04-25T09:10:11.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.035+0000 7fcb76000640 1 --2- 172.21.15.173:0/3341765164 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcb5c066f60 0x7fcb5c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.035+0000 7fcb76000640 1 --2- 172.21.15.173:0/3341765164 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcb5c066f60 0x7fcb5c069420 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcb68000c10 tx=0x7fcb68009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:11.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.039+0000 7fcb77400640 1 -- 172.21.15.173:0/3341765164 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcb70016950 con 0x7fcb640039f0 2024-04-25T09:10:11.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.223+0000 7fcb85c00640 1 -- 172.21.15.173:0/3341765164 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb8015fcd0 con 0x7fcb640039f0 2024-04-25T09:10:11.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.223+0000 7fcb77400640 1 -- 172.21.15.173:0/3341765164 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fcb700a5c20 con 0x7fcb640039f0 2024-04-25T09:10:11.214 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:11.214 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/556010437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":556010437},{"type":"v1","addr":"172.21.15.173:6835","nonce":556010437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":6524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4077641924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4077641924},{"type":"v1","addr":"172.21.15.194:6834","nonce":4077641924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7162,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2938501478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2938501478},{"type":"v1","addr":"172.21.15.194:6835","nonce":2938501478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:09:26.257282+0000","modified":"2024-04-25T09:09:29.275838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7743":{"gid":7743,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/555490935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":555490935},{"type":"v1","addr":"172.21.15.173:6837","nonce":555490935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:10:11.214 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 65 2024-04-25T09:10:11.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.227+0000 7fcb85c00640 1 -- 172.21.15.173:0/3341765164 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcb5c066f60 msgr2=0x7fcb5c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.227+0000 7fcb85c00640 1 --2- 172.21.15.173:0/3341765164 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcb5c066f60 0x7fcb5c069420 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcb68000c10 tx=0x7fcb68009040 comp rx=0 tx=0).stop 2024-04-25T09:10:11.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.227+0000 7fcb85c00640 1 -- 172.21.15.173:0/3341765164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb640039f0 msgr2=0x7fcb80152220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.227+0000 7fcb85c00640 1 --2- 172.21.15.173:0/3341765164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb640039f0 0x7fcb80152220 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fcb7001ca70 tx=0x7fcb70009750 comp rx=0 tx=0).stop 2024-04-25T09:10:11.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.227+0000 7fcb85c00640 1 -- 172.21.15.173:0/3341765164 shutdown_connections 2024-04-25T09:10:11.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.227+0000 7fcb85c00640 1 --2- 172.21.15.173:0/3341765164 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcb5c066f60 0x7fcb5c069420 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.227+0000 7fcb85c00640 1 --2- 172.21.15.173:0/3341765164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb80158870 0x7fcb80158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.227+0000 7fcb85c00640 1 --2- 172.21.15.173:0/3341765164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb800ce860 0x7fcb800b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.227+0000 7fcb85c00640 1 --2- 172.21.15.173:0/3341765164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb640039f0 0x7fcb80152220 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.227+0000 7fcb85c00640 1 -- 172.21.15.173:0/3341765164 >> 172.21.15.173:0/3341765164 conn(0x7fcb8006ac90 msgr2=0x7fcb8015f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:11.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.227+0000 7fcb85c00640 1 -- 172.21.15.173:0/3341765164 shutdown_connections 2024-04-25T09:10:11.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.227+0000 7fcb85c00640 1 -- 172.21.15.173:0/3341765164 wait complete. 2024-04-25T09:10:11.234 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:11.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e12e00640 1 Processor -- start 2024-04-25T09:10:11.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e12e00640 1 -- start start 2024-04-25T09:10:11.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e12e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8e0c15dbb0 0x7f8e0c15df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e12e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e0c0d2130 0x7f8e0c06c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e12e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8e0c06c7b0 0x7f8e0c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e12e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0c06d870 con 0x7f8e0c06c7b0 2024-04-25T09:10:11.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e12e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0c161690 con 0x7f8e0c15dbb0 2024-04-25T09:10:11.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e12e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c0d2590 con 0x7f8e0c0d2130 2024-04-25T09:10:11.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e10e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8e0c06c7b0 0x7f8e0c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e10e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8e0c06c7b0 0x7f8e0c06f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51518/0 (socket says 172.21.15.173:51518) 2024-04-25T09:10:11.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e10e00640 1 -- 172.21.15.173:0/44279973 learned_addr learned my addr 172.21.15.173:0/44279973 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:11.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e0be00640 1 --2- 172.21.15.173:0/44279973 >> v2:172.21.15.194:3300/0 conn(0x7f8e0c15dbb0 0x7f8e0c15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e03400640 1 --2- 172.21.15.173:0/44279973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e0c0d2130 0x7f8e0c06c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e10e00640 1 -- 172.21.15.173:0/44279973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e0c0d2130 msgr2=0x7f8e0c06c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:11.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e10e00640 1 --2- 172.21.15.173:0/44279973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e0c0d2130 0x7f8e0c06c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e10e00640 1 -- 172.21.15.173:0/44279973 >> v2:172.21.15.194:3300/0 conn(0x7f8e0c15dbb0 msgr2=0x7f8e0c15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:11.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e10e00640 1 --2- 172.21.15.173:0/44279973 >> v2:172.21.15.194:3300/0 conn(0x7f8e0c15dbb0 0x7f8e0c15df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e10e00640 1 -- 172.21.15.173:0/44279973 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c15e5c0 con 0x7f8e0c06c7b0 2024-04-25T09:10:11.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.383+0000 7f8e03400640 1 --2- 172.21.15.173:0/44279973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e0c0d2130 0x7f8e0c06c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:11.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.387+0000 7f8e10e00640 1 --2- 172.21.15.173:0/44279973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e0c06c7b0 0x7f8e0c06f830 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0625e0 tx=0x7f8e0401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa72e45d3015ae90 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:11.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.387+0000 7f8e0b400640 1 -- 172.21.15.173:0/44279973 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e040a5750 con 0x7f8e0c06c7b0 2024-04-25T09:10:11.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.387+0000 7f8e0b400640 1 -- 172.21.15.173:0/44279973 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e040a58f0 con 0x7f8e0c06c7b0 2024-04-25T09:10:11.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.387+0000 7f8e0b400640 1 -- 172.21.15.173:0/44279973 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e040a5cc0 con 0x7f8e0c06c7b0 2024-04-25T09:10:11.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.387+0000 7f8e12e00640 1 -- 172.21.15.173:0/44279973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e0c06c7b0 msgr2=0x7f8e0c06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.387+0000 7f8e12e00640 1 --2- 172.21.15.173:0/44279973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e0c06c7b0 0x7f8e0c06f830 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0625e0 tx=0x7f8e0401c9c0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.387+0000 7f8e12e00640 1 -- 172.21.15.173:0/44279973 shutdown_connections 2024-04-25T09:10:11.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.387+0000 7f8e12e00640 1 --2- 172.21.15.173:0/44279973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e0c06c7b0 0x7f8e0c06f830 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.387+0000 7f8e12e00640 1 --2- 172.21.15.173:0/44279973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e0c0d2130 0x7f8e0c06c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.387+0000 7f8e12e00640 1 --2- 172.21.15.173:0/44279973 >> v2:172.21.15.194:3300/0 conn(0x7f8e0c15dbb0 0x7f8e0c15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.387+0000 7f8e12e00640 1 -- 172.21.15.173:0/44279973 >> 172.21.15.173:0/44279973 conn(0x7f8e0c061880 msgr2=0x7f8e0c061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:11.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.387+0000 7f8e12e00640 1 -- 172.21.15.173:0/44279973 shutdown_connections 2024-04-25T09:10:11.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.387+0000 7f8e12e00640 1 -- 172.21.15.173:0/44279973 wait complete. 2024-04-25T09:10:11.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e12e00640 1 Processor -- start 2024-04-25T09:10:11.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e12e00640 1 -- start start 2024-04-25T09:10:11.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e12e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e0c06c7b0 0x7f8e0c14bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e12e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e0c0d2130 0x7f8e0c159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e12e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e0c15dbb0 0x7f8e0c15a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e12e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c0cf4e0 con 0x7f8e0c06c7b0 2024-04-25T09:10:11.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e12e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c0cf360 con 0x7f8e0c15dbb0 2024-04-25T09:10:11.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e12e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c0cf660 con 0x7f8e0c0d2130 2024-04-25T09:10:11.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e0be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e0c06c7b0 0x7f8e0c14bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e0be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e0c06c7b0 0x7f8e0c14bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51534/0 (socket says 172.21.15.173:51534) 2024-04-25T09:10:11.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e0be00640 1 -- 172.21.15.173:0/3622757374 learned_addr learned my addr 172.21.15.173:0/3622757374 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:11.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e03400640 1 --2- 172.21.15.173:0/3622757374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e0c0d2130 0x7f8e0c159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e10e00640 1 --2- 172.21.15.173:0/3622757374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e0c15dbb0 0x7f8e0c15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e0be00640 1 -- 172.21.15.173:0/3622757374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e0c0d2130 msgr2=0x7f8e0c159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e0be00640 1 --2- 172.21.15.173:0/3622757374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e0c0d2130 0x7f8e0c159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e0be00640 1 -- 172.21.15.173:0/3622757374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e0c15dbb0 msgr2=0x7f8e0c15a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e0be00640 1 --2- 172.21.15.173:0/3622757374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e0c15dbb0 0x7f8e0c15a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e0be00640 1 -- 172.21.15.173:0/3622757374 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c0ad380 con 0x7f8e0c06c7b0 2024-04-25T09:10:11.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e0be00640 1 --2- 172.21.15.173:0/3622757374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e0c06c7b0 0x7f8e0c14bde0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00d620 tx=0x7f8dfc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:11.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e08c00640 1 -- 172.21.15.173:0/3622757374 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc00b620 con 0x7f8e0c06c7b0 2024-04-25T09:10:11.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e08c00640 1 -- 172.21.15.173:0/3622757374 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dfc019070 con 0x7f8e0c06c7b0 2024-04-25T09:10:11.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e12e00640 1 -- 172.21.15.173:0/3622757374 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e0c0ad660 con 0x7f8e0c06c7b0 2024-04-25T09:10:11.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e08c00640 1 -- 172.21.15.173:0/3622757374 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc00b9e0 con 0x7f8e0c06c7b0 2024-04-25T09:10:11.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.391+0000 7f8e12e00640 1 -- 172.21.15.173:0/3622757374 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0c0adc20 con 0x7f8e0c06c7b0 2024-04-25T09:10:11.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.395+0000 7f8e12e00640 1 -- 172.21.15.173:0/3622757374 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0c073a40 con 0x7f8e0c06c7b0 2024-04-25T09:10:11.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.395+0000 7f8e08c00640 1 -- 172.21.15.173:0/3622757374 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8dfc00bb80 con 0x7f8e0c06c7b0 2024-04-25T09:10:11.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.395+0000 7f8e08c00640 1 --2- 172.21.15.173:0/3622757374 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8de8066f60 0x7f8de8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.395+0000 7f8e08c00640 1 -- 172.21.15.173:0/3622757374 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8dfc085450 con 0x7f8e0c06c7b0 2024-04-25T09:10:11.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.395+0000 7f8e03400640 1 --2- 172.21.15.173:0/3622757374 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8de8066f60 0x7f8de8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.395+0000 7f8e03400640 1 --2- 172.21.15.173:0/3622757374 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8de8066f60 0x7f8de8069420 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c15f9c0 tx=0x7f8df4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:11.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.399+0000 7f8e08c00640 1 -- 172.21.15.173:0/3622757374 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8dfc055c80 con 0x7f8e0c06c7b0 2024-04-25T09:10:11.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.555+0000 7f8e12e00640 1 -- 172.21.15.173:0/3622757374 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e0c0d11b0 con 0x7f8e0c06c7b0 2024-04-25T09:10:11.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.555+0000 7f8e08c00640 1 -- 172.21.15.173:0/3622757374 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16945 (secure 0 0 0) 0x7f8dfc059d20 con 0x7f8e0c06c7b0 2024-04-25T09:10:11.545 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:11.545 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":97,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:09:27.873210+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:09:24.629351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T09:09:25.248841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:11.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.559+0000 7f8e12e00640 1 -- 172.21.15.173:0/3622757374 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8de8066f60 msgr2=0x7f8de8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.559+0000 7f8e12e00640 1 --2- 172.21.15.173:0/3622757374 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8de8066f60 0x7f8de8069420 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c15f9c0 tx=0x7f8df4008040 comp rx=0 tx=0).stop 2024-04-25T09:10:11.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.559+0000 7f8e12e00640 1 -- 172.21.15.173:0/3622757374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e0c06c7b0 msgr2=0x7f8e0c14bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.559+0000 7f8e12e00640 1 --2- 172.21.15.173:0/3622757374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e0c06c7b0 0x7f8e0c14bde0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00d620 tx=0x7f8dfc00dae0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.559+0000 7f8e12e00640 1 -- 172.21.15.173:0/3622757374 shutdown_connections 2024-04-25T09:10:11.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.559+0000 7f8e12e00640 1 --2- 172.21.15.173:0/3622757374 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8de8066f60 0x7f8de8069420 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.559+0000 7f8e12e00640 1 --2- 172.21.15.173:0/3622757374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e0c15dbb0 0x7f8e0c15a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.559+0000 7f8e12e00640 1 --2- 172.21.15.173:0/3622757374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e0c0d2130 0x7f8e0c159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.559+0000 7f8e12e00640 1 --2- 172.21.15.173:0/3622757374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e0c06c7b0 0x7f8e0c14bde0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.559+0000 7f8e12e00640 1 -- 172.21.15.173:0/3622757374 >> 172.21.15.173:0/3622757374 conn(0x7f8e0c061880 msgr2=0x7f8e0c0b6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:11.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.559+0000 7f8e12e00640 1 -- 172.21.15.173:0/3622757374 shutdown_connections 2024-04-25T09:10:11.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.559+0000 7f8e12e00640 1 -- 172.21.15.173:0/3622757374 wait complete. 2024-04-25T09:10:11.567 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:10:11.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.715+0000 7f3a16200640 1 Processor -- start 2024-04-25T09:10:11.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.715+0000 7f3a16200640 1 -- start start 2024-04-25T09:10:11.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.715+0000 7f3a16200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3a1009a160 0x7f3a1006bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.715+0000 7f3a16200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3a1006c2e0 0x7f3a100d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.715+0000 7f3a16200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a100b1040 con 0x7f3a1015dbc0 2024-04-25T09:10:11.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.715+0000 7f3a16200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a100cfce0 con 0x7f3a1006c2e0 2024-04-25T09:10:11.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.715+0000 7f3a16200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1006cab0 con 0x7f3a1009a160 2024-04-25T09:10:11.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.715+0000 7f3a14e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f3a1015dbc0 0x7f3a10099a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53656/0 (socket says 172.21.15.173:53656) 2024-04-25T09:10:11.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.715+0000 7f3a14e00640 1 -- 172.21.15.173:0/178937751 learned_addr learned my addr 172.21.15.173:0/178937751 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:11.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.715+0000 7f3a15800640 1 --2- 172.21.15.173:0/178937751 >> v2:172.21.15.173:3300/0 conn(0x7f3a1006c2e0 0x7f3a100d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.715+0000 7f3a07e00640 1 --2- 172.21.15.173:0/178937751 >> v2:172.21.15.194:3300/0 conn(0x7f3a1009a160 0x7f3a1006bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.715+0000 7f3a0fe00640 1 -- 172.21.15.173:0/178937751 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737506107 0 0) 0x7f3a00001120 con 0x7f3a1015dbc0 2024-04-25T09:10:11.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.715+0000 7f3a0fe00640 1 -- 172.21.15.173:0/178937751 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39f4003530 con 0x7f3a1015dbc0 2024-04-25T09:10:11.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.715+0000 7f3a15800640 1 -- 172.21.15.173:0/178937751 >> v2:172.21.15.194:3300/0 conn(0x7f3a1009a160 msgr2=0x7f3a1006bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:11.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.715+0000 7f3a15800640 1 --2- 172.21.15.173:0/178937751 >> v2:172.21.15.194:3300/0 conn(0x7f3a1009a160 0x7f3a1006bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.715+0000 7f3a15800640 1 -- 172.21.15.173:0/178937751 >> v1:172.21.15.173:6789/0 conn(0x7f3a1015dbc0 legacy=0x7f3a10099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.715+0000 7f3a15800640 1 -- 172.21.15.173:0/178937751 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1006cd90 con 0x7f3a1006c2e0 2024-04-25T09:10:11.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.719+0000 7f3a15800640 1 --2- 172.21.15.173:0/178937751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a1006c2e0 0x7f3a100d0170 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f3a1006dbc0 tx=0x7f3a0801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154119d9750c1cd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:11.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.719+0000 7f3a0fe00640 1 -- 172.21.15.173:0/178937751 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a080b2070 con 0x7f3a1006c2e0 2024-04-25T09:10:11.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.719+0000 7f3a0fe00640 1 -- 172.21.15.173:0/178937751 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a080a5900 con 0x7f3a1006c2e0 2024-04-25T09:10:11.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.719+0000 7f3a0fe00640 1 -- 172.21.15.173:0/178937751 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a080a5cd0 con 0x7f3a1006c2e0 2024-04-25T09:10:11.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.719+0000 7f3a16200640 1 -- 172.21.15.173:0/178937751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a1006c2e0 msgr2=0x7f3a100d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.719+0000 7f3a16200640 1 --2- 172.21.15.173:0/178937751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a1006c2e0 0x7f3a100d0170 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f3a1006dbc0 tx=0x7f3a0801c930 comp rx=0 tx=0).stop 2024-04-25T09:10:11.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.719+0000 7f3a16200640 1 -- 172.21.15.173:0/178937751 shutdown_connections 2024-04-25T09:10:11.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.719+0000 7f3a16200640 1 --2- 172.21.15.173:0/178937751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a1006c2e0 0x7f3a100d0170 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.719+0000 7f3a16200640 1 --2- 172.21.15.173:0/178937751 >> v2:172.21.15.194:3300/0 conn(0x7f3a1009a160 0x7f3a1006bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.719+0000 7f3a16200640 1 -- 172.21.15.173:0/178937751 >> 172.21.15.173:0/178937751 conn(0x7f3a100b31d0 msgr2=0x7f3a100b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:11.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.719+0000 7f3a16200640 1 -- 172.21.15.173:0/178937751 shutdown_connections 2024-04-25T09:10:11.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.719+0000 7f3a16200640 1 -- 172.21.15.173:0/178937751 wait complete. 2024-04-25T09:10:11.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a16200640 1 Processor -- start 2024-04-25T09:10:11.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a16200640 1 -- start start 2024-04-25T09:10:11.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a16200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a1006c2e0 0x7f3a100b6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a16200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a1009a160 0x7f3a100c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a16200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a1015dbc0 0x7f3a100c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a16200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a100d1040 con 0x7f3a1015dbc0 2024-04-25T09:10:11.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a16200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a100d0ec0 con 0x7f3a1006c2e0 2024-04-25T09:10:11.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a16200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a100d11c0 con 0x7f3a1009a160 2024-04-25T09:10:11.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a15800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a1015dbc0 0x7f3a100c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a15800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a1015dbc0 0x7f3a100c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51556/0 (socket says 172.21.15.173:51556) 2024-04-25T09:10:11.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a15800640 1 -- 172.21.15.173:0/947376180 learned_addr learned my addr 172.21.15.173:0/947376180 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:11.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a14e00640 1 --2- 172.21.15.173:0/947376180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a1006c2e0 0x7f3a100b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a07e00640 1 --2- 172.21.15.173:0/947376180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a1009a160 0x7f3a100c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a15800640 1 -- 172.21.15.173:0/947376180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a1009a160 msgr2=0x7f3a100c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a15800640 1 --2- 172.21.15.173:0/947376180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a1009a160 0x7f3a100c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a15800640 1 -- 172.21.15.173:0/947376180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a1006c2e0 msgr2=0x7f3a100b6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a15800640 1 --2- 172.21.15.173:0/947376180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a1006c2e0 0x7f3a100b6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a15800640 1 -- 172.21.15.173:0/947376180 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a100c97a0 con 0x7f3a1015dbc0 2024-04-25T09:10:11.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a14e00640 1 --2- 172.21.15.173:0/947376180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a1006c2e0 0x7f3a100b6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:11.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a15800640 1 --2- 172.21.15.173:0/947376180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a1015dbc0 0x7f3a100c87b0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f3a08019540 tx=0x7f3a080196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:11.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a0d600640 1 -- 172.21.15.173:0/947376180 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a080b2050 con 0x7f3a1015dbc0 2024-04-25T09:10:11.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a0d600640 1 -- 172.21.15.173:0/947376180 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a080be070 con 0x7f3a1015dbc0 2024-04-25T09:10:11.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a0d600640 1 -- 172.21.15.173:0/947376180 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a080ad890 con 0x7f3a1015dbc0 2024-04-25T09:10:11.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a16200640 1 -- 172.21.15.173:0/947376180 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a100c8f00 con 0x7f3a1015dbc0 2024-04-25T09:10:11.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.723+0000 7f3a16200640 1 -- 172.21.15.173:0/947376180 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a100c94c0 con 0x7f3a1015dbc0 2024-04-25T09:10:11.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.727+0000 7f3a16200640 1 -- 172.21.15.173:0/947376180 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a10073a40 con 0x7f3a1015dbc0 2024-04-25T09:10:11.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.727+0000 7f3a0d600640 1 -- 172.21.15.173:0/947376180 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3a080ada30 con 0x7f3a1015dbc0 2024-04-25T09:10:11.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.727+0000 7f3a0d600640 1 --2- 172.21.15.173:0/947376180 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f39ec066f60 0x7f39ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.727+0000 7f3a0d600640 1 -- 172.21.15.173:0/947376180 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3a081201a0 con 0x7f3a1015dbc0 2024-04-25T09:10:11.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.727+0000 7f3a14e00640 1 --2- 172.21.15.173:0/947376180 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f39ec066f60 0x7f39ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.727+0000 7f3a14e00640 1 --2- 172.21.15.173:0/947376180 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f39ec066f60 0x7f39ec069420 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3a00005890 tx=0x7f3a00009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:11.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.731+0000 7f3a0d600640 1 -- 172.21.15.173:0/947376180 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3a08016520 con 0x7f3a1015dbc0 2024-04-25T09:10:11.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.923+0000 7f3a16200640 1 -- 172.21.15.173:0/947376180 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3a100b4030 con 0x7f3a1015dbc0 2024-04-25T09:10:11.911 INFO:tasks.ceph.mon.a.smithi173.stderr:2024-04-25T09:10:11.923+0000 7f537be00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:10:11.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.923+0000 7f3a0d600640 1 -- 172.21.15.173:0/947376180 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v66) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3a080f0f90 con 0x7f3a1015dbc0 2024-04-25T09:10:11.913 INFO:teuthology.orchestra.run.smithi173.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:10:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.927+0000 7f3a16200640 1 -- 172.21.15.173:0/947376180 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f39ec066f60 msgr2=0x7f39ec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.927+0000 7f3a16200640 1 --2- 172.21.15.173:0/947376180 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f39ec066f60 0x7f39ec069420 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3a00005890 tx=0x7f3a00009040 comp rx=0 tx=0).stop 2024-04-25T09:10:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.927+0000 7f3a16200640 1 -- 172.21.15.173:0/947376180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a1015dbc0 msgr2=0x7f3a100c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.927+0000 7f3a16200640 1 --2- 172.21.15.173:0/947376180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a1015dbc0 0x7f3a100c87b0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f3a08019540 tx=0x7f3a080196d0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.927+0000 7f3a16200640 1 -- 172.21.15.173:0/947376180 shutdown_connections 2024-04-25T09:10:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.927+0000 7f3a16200640 1 --2- 172.21.15.173:0/947376180 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f39ec066f60 0x7f39ec069420 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.927+0000 7f3a16200640 1 --2- 172.21.15.173:0/947376180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a1015dbc0 0x7f3a100c87b0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.927+0000 7f3a16200640 1 --2- 172.21.15.173:0/947376180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a1009a160 0x7f3a100c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.927+0000 7f3a16200640 1 --2- 172.21.15.173:0/947376180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a1006c2e0 0x7f3a100b6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.927+0000 7f3a16200640 1 -- 172.21.15.173:0/947376180 >> 172.21.15.173:0/947376180 conn(0x7f3a100b31d0 msgr2=0x7f3a100cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.927+0000 7f3a16200640 1 -- 172.21.15.173:0/947376180 shutdown_connections 2024-04-25T09:10:11.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:11.927+0000 7f3a16200640 1 -- 172.21.15.173:0/947376180 wait complete. 2024-04-25T09:10:11.938 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:10:11.984 INFO:tasks.ceph.mds.a.smithi173.stdout:starting mds.a at 2024-04-25T09:10:12.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa95e400640 1 Processor -- start 2024-04-25T09:10:12.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa95e400640 1 -- start start 2024-04-25T09:10:12.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa95e400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa9580aef70 0x7fa95806d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa95e400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa958071570 con 0x7fa9580aeb90 2024-04-25T09:10:12.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa95e400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa958071850 con 0x7fa9580cc7e0 2024-04-25T09:10:12.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa95e400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa958071320 con 0x7fa9580aef70 2024-04-25T09:10:12.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa957400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa9580aeb90 0x7fa9580cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53670/0 (socket says 172.21.15.173:53670) 2024-04-25T09:10:12.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa957400640 1 -- 172.21.15.173:0/1732180297 learned_addr learned my addr 172.21.15.173:0/1732180297 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:12.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa957e00640 1 --2- 172.21.15.173:0/1732180297 >> v2:172.21.15.194:3300/0 conn(0x7fa9580aef70 0x7fa95806d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa956000640 1 -- 172.21.15.173:0/1732180297 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631630400 0 0) 0x7fa958071570 con 0x7fa9580aeb90 2024-04-25T09:10:12.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa956000640 1 -- 172.21.15.173:0/1732180297 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa93c003530 con 0x7fa9580aeb90 2024-04-25T09:10:12.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa956000640 1 -- 172.21.15.173:0/1732180297 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2089936665 0 0) 0x7fa93c003530 con 0x7fa9580aeb90 2024-04-25T09:10:12.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa956000640 1 -- 172.21.15.173:0/1732180297 >> v2:172.21.15.194:3300/0 conn(0x7fa9580aef70 msgr2=0x7fa95806d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:12.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa956000640 1 --2- 172.21.15.173:0/1732180297 >> v2:172.21.15.194:3300/0 conn(0x7fa9580aef70 0x7fa95806d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa956000640 1 -- 172.21.15.173:0/1732180297 >> v1:172.21.15.194:6789/0 conn(0x7fa9580cc7e0 legacy=0x7fa9580cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa956000640 1 -- 172.21.15.173:0/1732180297 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa958071b30 con 0x7fa9580aeb90 2024-04-25T09:10:12.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa956000640 1 -- 172.21.15.173:0/1732180297 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fa9480016a0 con 0x7fa9580aeb90 2024-04-25T09:10:12.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa956000640 1 -- 172.21.15.173:0/1732180297 >> v1:172.21.15.173:6789/0 conn(0x7fa9580aeb90 legacy=0x7fa9580cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa956000640 1 --2- 172.21.15.173:0/1732180297 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa93c0039c0 0x7fa93c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa956000640 1 --2- 172.21.15.173:0/1732180297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa93c004810 0x7fa93c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa956000640 1 --2- 172.21.15.173:0/1732180297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa93c0051d0 0x7fa93c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa956000640 1 -- 172.21.15.173:0/1732180297 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa958071320 con 0x7fa93c004810 2024-04-25T09:10:12.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa956000640 1 -- 172.21.15.173:0/1732180297 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c00c170 con 0x7fa93c0051d0 2024-04-25T09:10:12.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa956000640 1 -- 172.21.15.173:0/1732180297 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c00e580 con 0x7fa93c0039c0 2024-04-25T09:10:12.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa956a00640 1 --2- 172.21.15.173:0/1732180297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa93c004810 0x7fa93c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa957e00640 1 --2- 172.21.15.173:0/1732180297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa93c0051d0 0x7fa93c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.091+0000 7fa957400640 1 --2- 172.21.15.173:0/1732180297 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa93c0039c0 0x7fa93c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.095+0000 7fa956a00640 1 -- 172.21.15.173:0/1732180297 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa93c0039c0 msgr2=0x7fa93c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:12.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.095+0000 7fa956a00640 1 --2- 172.21.15.173:0/1732180297 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa93c0039c0 0x7fa93c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.095+0000 7fa956a00640 1 -- 172.21.15.173:0/1732180297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa93c0051d0 msgr2=0x7fa93c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:12.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.095+0000 7fa956a00640 1 --2- 172.21.15.173:0/1732180297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa93c0051d0 0x7fa93c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.095+0000 7fa956a00640 1 -- 172.21.15.173:0/1732180297 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c003530 con 0x7fa93c004810 2024-04-25T09:10:12.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.095+0000 7fa957e00640 1 -- 172.21.15.173:0/1732180297 reap_dead start 2024-04-25T09:10:12.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.095+0000 7fa956a00640 1 --2- 172.21.15.173:0/1732180297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa93c004810 0x7fa93c004c90 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fa944001780 tx=0x7fa94401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8a5cd9a183cc97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.095+0000 7fa956000640 1 -- 172.21.15.173:0/1732180297 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9440013a0 con 0x7fa93c004810 2024-04-25T09:10:12.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.095+0000 7fa956000640 1 -- 172.21.15.173:0/1732180297 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9440052f0 con 0x7fa93c004810 2024-04-25T09:10:12.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.095+0000 7fa956000640 1 -- 172.21.15.173:0/1732180297 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944003840 con 0x7fa93c004810 2024-04-25T09:10:12.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.095+0000 7fa95e400640 1 -- 172.21.15.173:0/1732180297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa93c004810 msgr2=0x7fa93c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.095+0000 7fa95e400640 1 --2- 172.21.15.173:0/1732180297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa93c004810 0x7fa93c004c90 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fa944001780 tx=0x7fa94401c400 comp rx=0 tx=0).stop 2024-04-25T09:10:12.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.095+0000 7fa95e400640 1 -- 172.21.15.173:0/1732180297 shutdown_connections 2024-04-25T09:10:12.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.095+0000 7fa95e400640 1 --2- 172.21.15.173:0/1732180297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa93c004810 0x7fa93c004c90 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.095+0000 7fa95e400640 1 -- 172.21.15.173:0/1732180297 >> 172.21.15.173:0/1732180297 conn(0x7fa95806ac90 msgr2=0x7fa95806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:12.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.095+0000 7fa95e400640 1 -- 172.21.15.173:0/1732180297 shutdown_connections 2024-04-25T09:10:12.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.095+0000 7fa95e400640 1 -- 172.21.15.173:0/1732180297 wait complete. 2024-04-25T09:10:12.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa95e400640 1 Processor -- start 2024-04-25T09:10:12.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa95e400640 1 -- start start 2024-04-25T09:10:12.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa95e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa93c004810 0x7fa958153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa95e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa958150bd0 0x7fa9580b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa95e400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa958154850 0x7fa958154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa95e400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95815e940 con 0x7fa958154850 2024-04-25T09:10:12.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa95e400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95815e7c0 con 0x7fa958150bd0 2024-04-25T09:10:12.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa95e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95815eac0 con 0x7fa93c004810 2024-04-25T09:10:12.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa957e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa958154850 0x7fa958154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa957e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa958154850 0x7fa958154cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51590/0 (socket says 172.21.15.173:51590) 2024-04-25T09:10:12.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa957e00640 1 -- 172.21.15.173:0/3309212676 learned_addr learned my addr 172.21.15.173:0/3309212676 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:12.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa956a00640 1 --2- 172.21.15.173:0/3309212676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa958150bd0 0x7fa9580b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa957400640 1 --2- 172.21.15.173:0/3309212676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa93c004810 0x7fa958153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa957e00640 1 -- 172.21.15.173:0/3309212676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa93c004810 msgr2=0x7fa958153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa957e00640 1 --2- 172.21.15.173:0/3309212676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa93c004810 0x7fa958153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa957e00640 1 -- 172.21.15.173:0/3309212676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa958150bd0 msgr2=0x7fa9580b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa957e00640 1 --2- 172.21.15.173:0/3309212676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa958150bd0 0x7fa9580b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa957e00640 1 -- 172.21.15.173:0/3309212676 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa958153670 con 0x7fa958154850 2024-04-25T09:10:12.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa957e00640 1 --2- 172.21.15.173:0/3309212676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa958154850 0x7fa958154cd0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fa9580af380 tx=0x7fa95000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa94f400640 1 -- 172.21.15.173:0/3309212676 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95000fd80 con 0x7fa958154850 2024-04-25T09:10:12.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa94f400640 1 -- 172.21.15.173:0/3309212676 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95001d070 con 0x7fa958154850 2024-04-25T09:10:12.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa94f400640 1 -- 172.21.15.173:0/3309212676 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa950015670 con 0x7fa958154850 2024-04-25T09:10:12.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.099+0000 7fa95e400640 1 -- 172.21.15.173:0/3309212676 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa958153950 con 0x7fa958154850 2024-04-25T09:10:12.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.103+0000 7fa95e400640 1 -- 172.21.15.173:0/3309212676 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa958153f10 con 0x7fa958154850 2024-04-25T09:10:12.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.103+0000 7fa95e400640 1 -- 172.21.15.173:0/3309212676 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa958073ab0 con 0x7fa958154850 2024-04-25T09:10:12.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.103+0000 7fa94f400640 1 -- 172.21.15.173:0/3309212676 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa950015810 con 0x7fa958154850 2024-04-25T09:10:12.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.103+0000 7fa94f400640 1 --2- 172.21.15.173:0/3309212676 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa938066f60 0x7fa938069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.103+0000 7fa94f400640 1 -- 172.21.15.173:0/3309212676 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fa950085e10 con 0x7fa958154850 2024-04-25T09:10:12.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.103+0000 7fa957400640 1 --2- 172.21.15.173:0/3309212676 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa938066f60 0x7fa938069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.103+0000 7fa957400640 1 --2- 172.21.15.173:0/3309212676 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa938066f60 0x7fa938069420 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa948001cf0 tx=0x7fa948007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.107+0000 7fa94f400640 1 -- 172.21.15.173:0/3309212676 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa950089030 con 0x7fa958154850 2024-04-25T09:10:12.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.295+0000 7fa95e400640 1 -- 172.21.15.173:0/3309212676 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa958150fb0 con 0x7fa958154850 2024-04-25T09:10:12.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.927+0000 7fa94f400640 1 -- 172.21.15.173:0/3309212676 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v67) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa950027020 con 0x7fa958154850 2024-04-25T09:10:12.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.927+0000 7fa95e400640 1 -- 172.21.15.173:0/3309212676 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa938066f60 msgr2=0x7fa938069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.927+0000 7fa95e400640 1 --2- 172.21.15.173:0/3309212676 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa938066f60 0x7fa938069420 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa948001cf0 tx=0x7fa948007040 comp rx=0 tx=0).stop 2024-04-25T09:10:12.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.927+0000 7fa95e400640 1 -- 172.21.15.173:0/3309212676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa958154850 msgr2=0x7fa958154cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.927+0000 7fa95e400640 1 --2- 172.21.15.173:0/3309212676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa958154850 0x7fa958154cd0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fa9580af380 tx=0x7fa95000f580 comp rx=0 tx=0).stop 2024-04-25T09:10:12.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.927+0000 7fa95e400640 1 -- 172.21.15.173:0/3309212676 shutdown_connections 2024-04-25T09:10:12.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.927+0000 7fa95e400640 1 --2- 172.21.15.173:0/3309212676 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa938066f60 0x7fa938069420 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.927+0000 7fa95e400640 1 --2- 172.21.15.173:0/3309212676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa958154850 0x7fa958154cd0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.927+0000 7fa95e400640 1 --2- 172.21.15.173:0/3309212676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa958150bd0 0x7fa9580b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.927+0000 7fa95e400640 1 --2- 172.21.15.173:0/3309212676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa93c004810 0x7fa958153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.927+0000 7fa95e400640 1 -- 172.21.15.173:0/3309212676 >> 172.21.15.173:0/3309212676 conn(0x7fa95806ac90 msgr2=0x7fa95815fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:12.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.927+0000 7fa95e400640 1 -- 172.21.15.173:0/3309212676 shutdown_connections 2024-04-25T09:10:12.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:12.927+0000 7fa95e400640 1 -- 172.21.15.173:0/3309212676 wait complete. 2024-04-25T09:10:12.939 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:10:13.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.091+0000 7f08a5e00640 1 Processor -- start 2024-04-25T09:10:13.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.091+0000 7f08a5e00640 1 -- start start 2024-04-25T09:10:13.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.091+0000 7f08a5e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f08a015bab0 0x7f08a00d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.091+0000 7f08a5e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f08a00cd840 0x7f08a0099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.091+0000 7f08a5e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a00cc7a0 con 0x7f08a0099f90 2024-04-25T09:10:13.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.091+0000 7f08a5e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a00d07e0 con 0x7f08a015bab0 2024-04-25T09:10:13.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.091+0000 7f08a5e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a00cca80 con 0x7f08a00cd840 2024-04-25T09:10:13.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.091+0000 7f089ea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f08a015bab0 0x7f08a00d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.091+0000 7f089f400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f08a0099f90 0x7f08a00c5300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53672/0 (socket says 172.21.15.173:53672) 2024-04-25T09:10:13.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.091+0000 7f089f400640 1 -- 172.21.15.173:0/763261922 learned_addr learned my addr 172.21.15.173:0/763261922 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:13.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.091+0000 7f089ea00640 1 -- 172.21.15.173:0/763261922 >> v2:172.21.15.194:3300/0 conn(0x7f08a00cd840 msgr2=0x7f08a0099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:13.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.091+0000 7f089e000640 1 --2- 172.21.15.173:0/763261922 >> v2:172.21.15.194:3300/0 conn(0x7f08a00cd840 0x7f08a0099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.091+0000 7f089ea00640 1 --2- 172.21.15.173:0/763261922 >> v2:172.21.15.194:3300/0 conn(0x7f08a00cd840 0x7f08a0099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.091+0000 7f089ea00640 1 -- 172.21.15.173:0/763261922 >> v1:172.21.15.173:6789/0 conn(0x7f08a0099f90 legacy=0x7f08a00c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.091+0000 7f089ea00640 1 -- 172.21.15.173:0/763261922 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a00ccd60 con 0x7f08a015bab0 2024-04-25T09:10:13.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.091+0000 7f089e000640 1 --2- 172.21.15.173:0/763261922 >> v2:172.21.15.194:3300/0 conn(0x7f08a00cd840 0x7f08a0099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:13.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.091+0000 7f089d600640 1 -- 172.21.15.173:0/763261922 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401073257 0 0) 0x7f08a00cc7a0 con 0x7f08a0099f90 2024-04-25T09:10:13.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.095+0000 7f089ea00640 1 --2- 172.21.15.173:0/763261922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08a015bab0 0x7f08a00d02a0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f08a0072750 tx=0x7f089001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f93783c174ab7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:13.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.095+0000 7f089d600640 1 -- 172.21.15.173:0/763261922 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08900b0070 con 0x7f08a015bab0 2024-04-25T09:10:13.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.095+0000 7f089d600640 1 -- 172.21.15.173:0/763261922 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08900ab600 con 0x7f08a015bab0 2024-04-25T09:10:13.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.095+0000 7f089d600640 1 -- 172.21.15.173:0/763261922 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08900ab9d0 con 0x7f08a015bab0 2024-04-25T09:10:13.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.095+0000 7f08a5e00640 1 -- 172.21.15.173:0/763261922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08a015bab0 msgr2=0x7f08a00d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.095+0000 7f08a5e00640 1 --2- 172.21.15.173:0/763261922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08a015bab0 0x7f08a00d02a0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f08a0072750 tx=0x7f089001c480 comp rx=0 tx=0).stop 2024-04-25T09:10:13.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.095+0000 7f08a5e00640 1 -- 172.21.15.173:0/763261922 shutdown_connections 2024-04-25T09:10:13.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.095+0000 7f08a5e00640 1 --2- 172.21.15.173:0/763261922 >> v2:172.21.15.194:3300/0 conn(0x7f08a00cd840 0x7f08a0099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.095+0000 7f08a5e00640 1 --2- 172.21.15.173:0/763261922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08a015bab0 0x7f08a00d02a0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.095+0000 7f08a5e00640 1 -- 172.21.15.173:0/763261922 >> 172.21.15.173:0/763261922 conn(0x7f08a00b32a0 msgr2=0x7f08a00b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:13.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.095+0000 7f08a5e00640 1 -- 172.21.15.173:0/763261922 shutdown_connections 2024-04-25T09:10:13.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.095+0000 7f08a5e00640 1 -- 172.21.15.173:0/763261922 wait complete. 2024-04-25T09:10:13.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f08a5e00640 1 Processor -- start 2024-04-25T09:10:13.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f08a5e00640 1 -- start start 2024-04-25T09:10:13.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f08a5e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08a0099f90 0x7f08a006c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f08a5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08a00cd840 0x7f08a014e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f08a5e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08a015bab0 0x7f08a01fa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f08a5e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a015c010 con 0x7f08a00cd840 2024-04-25T09:10:13.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f08a5e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a015be90 con 0x7f08a015bab0 2024-04-25T09:10:13.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f08a5e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a00cc3c0 con 0x7f08a0099f90 2024-04-25T09:10:13.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f089e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08a00cd840 0x7f08a014e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f089e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08a00cd840 0x7f08a014e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51594/0 (socket says 172.21.15.173:51594) 2024-04-25T09:10:13.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f089e000640 1 -- 172.21.15.173:0/2582935490 learned_addr learned my addr 172.21.15.173:0/2582935490 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:13.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f089ea00640 1 --2- 172.21.15.173:0/2582935490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08a0099f90 0x7f08a006c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f089f400640 1 --2- 172.21.15.173:0/2582935490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08a015bab0 0x7f08a01fa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f089e000640 1 -- 172.21.15.173:0/2582935490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08a0099f90 msgr2=0x7f08a006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f089e000640 1 --2- 172.21.15.173:0/2582935490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08a0099f90 0x7f08a006c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f089e000640 1 -- 172.21.15.173:0/2582935490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08a015bab0 msgr2=0x7f08a01fa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f089e000640 1 --2- 172.21.15.173:0/2582935490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08a015bab0 0x7f08a01fa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f089e000640 1 -- 172.21.15.173:0/2582935490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a0151ce0 con 0x7f08a00cd840 2024-04-25T09:10:13.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f089e000640 1 --2- 172.21.15.173:0/2582935490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08a00cd840 0x7f08a014e5e0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f088c00c7c0 tx=0x7f088c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:13.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f0897400640 1 -- 172.21.15.173:0/2582935490 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c007a30 con 0x7f08a00cd840 2024-04-25T09:10:13.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f0897400640 1 -- 172.21.15.173:0/2582935490 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088c007bd0 con 0x7f08a00cd840 2024-04-25T09:10:13.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f0897400640 1 -- 172.21.15.173:0/2582935490 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c0113f0 con 0x7f08a00cd840 2024-04-25T09:10:13.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f08a5e00640 1 -- 172.21.15.173:0/2582935490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a0151fc0 con 0x7f08a00cd840 2024-04-25T09:10:13.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f08a5e00640 1 -- 172.21.15.173:0/2582935490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a006c9d0 con 0x7f08a00cd840 2024-04-25T09:10:13.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.099+0000 7f08a5e00640 1 -- 172.21.15.173:0/2582935490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a0073ab0 con 0x7f08a00cd840 2024-04-25T09:10:13.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.103+0000 7f0897400640 1 -- 172.21.15.173:0/2582935490 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f088c011590 con 0x7f08a00cd840 2024-04-25T09:10:13.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.103+0000 7f0897400640 1 --2- 172.21.15.173:0/2582935490 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0880066f60 0x7f0880069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.103+0000 7f0897400640 1 -- 172.21.15.173:0/2582935490 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f088c085420 con 0x7f08a00cd840 2024-04-25T09:10:13.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.103+0000 7f089ea00640 1 --2- 172.21.15.173:0/2582935490 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0880066f60 0x7f0880069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.103+0000 7f089ea00640 1 --2- 172.21.15.173:0/2582935490 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0880066f60 0x7f0880069420 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f08900ad000 tx=0x7f08900a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:13.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.107+0000 7f0897400640 1 -- 172.21.15.173:0/2582935490 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f088c015020 con 0x7f08a00cd840 2024-04-25T09:10:13.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.263+0000 7f08a5e00640 1 -- 172.21.15.173:0/2582935490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f08a00cf000 con 0x7f08a00cd840 2024-04-25T09:10:13.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.927+0000 7f0897400640 1 -- 172.21.15.173:0/2582935490 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v99) v1 ==== 181+0+0 (secure 0 0 0) 0x7f088c055b60 con 0x7f08a00cd840 2024-04-25T09:10:13.917 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:10:13.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.931+0000 7f08a5e00640 1 -- 172.21.15.173:0/2582935490 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0880066f60 msgr2=0x7f0880069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.931+0000 7f08a5e00640 1 --2- 172.21.15.173:0/2582935490 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0880066f60 0x7f0880069420 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f08900ad000 tx=0x7f08900a6000 comp rx=0 tx=0).stop 2024-04-25T09:10:13.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.931+0000 7f08a5e00640 1 -- 172.21.15.173:0/2582935490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08a00cd840 msgr2=0x7f08a014e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.931+0000 7f08a5e00640 1 --2- 172.21.15.173:0/2582935490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08a00cd840 0x7f08a014e5e0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f088c00c7c0 tx=0x7f088c00cc80 comp rx=0 tx=0).stop 2024-04-25T09:10:13.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.931+0000 7f08a5e00640 1 -- 172.21.15.173:0/2582935490 shutdown_connections 2024-04-25T09:10:13.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.931+0000 7f08a5e00640 1 --2- 172.21.15.173:0/2582935490 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0880066f60 0x7f0880069420 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.931+0000 7f08a5e00640 1 --2- 172.21.15.173:0/2582935490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08a015bab0 0x7f08a01fa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.931+0000 7f08a5e00640 1 --2- 172.21.15.173:0/2582935490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08a00cd840 0x7f08a014e5e0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.931+0000 7f08a5e00640 1 --2- 172.21.15.173:0/2582935490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08a0099f90 0x7f08a006c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.931+0000 7f08a5e00640 1 -- 172.21.15.173:0/2582935490 >> 172.21.15.173:0/2582935490 conn(0x7f08a00b32a0 msgr2=0x7f08a00c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:13.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.931+0000 7f08a5e00640 1 -- 172.21.15.173:0/2582935490 shutdown_connections 2024-04-25T09:10:13.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:13.931+0000 7f08a5e00640 1 -- 172.21.15.173:0/2582935490 wait complete. 2024-04-25T09:10:13.945 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:10:14.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.095+0000 7fc7e4600640 1 Processor -- start 2024-04-25T09:10:14.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.095+0000 7fc7e4600640 1 -- start start 2024-04-25T09:10:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.099+0000 7fc7e4600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc7dc0b5050 0x7fc7dc15fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.099+0000 7fc7e4600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7dc06b120 0x7fc7dc06b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.099+0000 7fc7e4600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7dc15f3c0 con 0x7fc7dc15efe0 2024-04-25T09:10:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.099+0000 7fc7e4600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7dc06ac90 con 0x7fc7dc0b5050 2024-04-25T09:10:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.099+0000 7fc7e4600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc0ad780 con 0x7fc7dc06b120 2024-04-25T09:10:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.099+0000 7fc7e1200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc7dc0b5050 0x7fc7dc15fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.099+0000 7fc7e1c00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc7dc15efe0 0x7fc7dc15f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53320/0 (socket says 172.21.15.173:53320) 2024-04-25T09:10:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.099+0000 7fc7e1c00640 1 -- 172.21.15.173:0/3455861207 learned_addr learned my addr 172.21.15.173:0/3455861207 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.099+0000 7fc7e2600640 1 --2- 172.21.15.173:0/3455861207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7dc06b120 0x7fc7dc06b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.099+0000 7fc7e1200640 1 -- 172.21.15.173:0/3455861207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7dc06b120 msgr2=0x7fc7dc06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.099+0000 7fc7e1200640 1 --2- 172.21.15.173:0/3455861207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7dc06b120 0x7fc7dc06b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.099+0000 7fc7e1200640 1 -- 172.21.15.173:0/3455861207 >> v1:172.21.15.173:6789/0 conn(0x7fc7dc15efe0 legacy=0x7fc7dc15f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.099+0000 7fc7e1200640 1 -- 172.21.15.173:0/3455861207 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc0af730 con 0x7fc7dc0b5050 2024-04-25T09:10:14.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.099+0000 7fc7dbe00640 1 -- 172.21.15.173:0/3455861207 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3348907113 0 0) 0x7fc7dc15f3c0 con 0x7fc7dc15efe0 2024-04-25T09:10:14.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.103+0000 7fc7e1200640 1 --2- 172.21.15.173:0/3455861207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7dc0b5050 0x7fc7dc15fd10 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80097c0 tx=0x7fc7c801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c777410f2ec6d86d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.103+0000 7fc7dbe00640 1 -- 172.21.15.173:0/3455861207 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c80aa600 con 0x7fc7dc0b5050 2024-04-25T09:10:14.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.103+0000 7fc7dbe00640 1 -- 172.21.15.173:0/3455861207 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c80af070 con 0x7fc7dc0b5050 2024-04-25T09:10:14.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.103+0000 7fc7dbe00640 1 -- 172.21.15.173:0/3455861207 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c80aa9c0 con 0x7fc7dc0b5050 2024-04-25T09:10:14.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.103+0000 7fc7e4600640 1 -- 172.21.15.173:0/3455861207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7dc0b5050 msgr2=0x7fc7dc15fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.103+0000 7fc7e4600640 1 --2- 172.21.15.173:0/3455861207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7dc0b5050 0x7fc7dc15fd10 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80097c0 tx=0x7fc7c801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.103+0000 7fc7e4600640 1 -- 172.21.15.173:0/3455861207 shutdown_connections 2024-04-25T09:10:14.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.103+0000 7fc7e4600640 1 --2- 172.21.15.173:0/3455861207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7dc06b120 0x7fc7dc06b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.103+0000 7fc7e4600640 1 --2- 172.21.15.173:0/3455861207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7dc0b5050 0x7fc7dc15fd10 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.103+0000 7fc7e4600640 1 -- 172.21.15.173:0/3455861207 >> 172.21.15.173:0/3455861207 conn(0x7fc7dc0cfed0 msgr2=0x7fc7dc0d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.103+0000 7fc7e4600640 1 -- 172.21.15.173:0/3455861207 shutdown_connections 2024-04-25T09:10:14.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.103+0000 7fc7e4600640 1 -- 172.21.15.173:0/3455861207 wait complete. 2024-04-25T09:10:14.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.103+0000 7fc7e4600640 1 Processor -- start 2024-04-25T09:10:14.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.103+0000 7fc7e4600640 1 -- start start 2024-04-25T09:10:14.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e4600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7dc06b120 0x7fc7dc14f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e4600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7dc0b5050 0x7fc7dc13b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e4600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7dc15efe0 0x7fc7dc14b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e4600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc1603d0 con 0x7fc7dc0b5050 2024-04-25T09:10:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e4600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc160250 con 0x7fc7dc15efe0 2024-04-25T09:10:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e4600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc1689a0 con 0x7fc7dc06b120 2024-04-25T09:10:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e1200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7dc0b5050 0x7fc7dc13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e1200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7dc0b5050 0x7fc7dc13b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45264/0 (socket says 172.21.15.173:45264) 2024-04-25T09:10:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e1200640 1 -- 172.21.15.173:0/2572850581 learned_addr learned my addr 172.21.15.173:0/2572850581 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e1c00640 1 --2- 172.21.15.173:0/2572850581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7dc06b120 0x7fc7dc14f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e2600640 1 --2- 172.21.15.173:0/2572850581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7dc15efe0 0x7fc7dc14b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e1200640 1 -- 172.21.15.173:0/2572850581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7dc06b120 msgr2=0x7fc7dc14f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e1200640 1 --2- 172.21.15.173:0/2572850581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7dc06b120 0x7fc7dc14f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e1200640 1 -- 172.21.15.173:0/2572850581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7dc15efe0 msgr2=0x7fc7dc14b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e1200640 1 --2- 172.21.15.173:0/2572850581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7dc15efe0 0x7fc7dc14b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e1200640 1 -- 172.21.15.173:0/2572850581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc14a930 con 0x7fc7dc0b5050 2024-04-25T09:10:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e1200640 1 --2- 172.21.15.173:0/2572850581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7dc0b5050 0x7fc7dc13b990 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80ac040 tx=0x7fc7c801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7d9600640 1 -- 172.21.15.173:0/2572850581 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c80be610 con 0x7fc7dc0b5050 2024-04-25T09:10:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7d9600640 1 -- 172.21.15.173:0/2572850581 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c80be7d0 con 0x7fc7dc0b5050 2024-04-25T09:10:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7d9600640 1 -- 172.21.15.173:0/2572850581 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c80bebc0 con 0x7fc7dc0b5050 2024-04-25T09:10:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e4600640 1 -- 172.21.15.173:0/2572850581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7dc14ac10 con 0x7fc7dc0b5050 2024-04-25T09:10:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e4600640 1 -- 172.21.15.173:0/2572850581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7dc14d1d0 con 0x7fc7dc0b5050 2024-04-25T09:10:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7e4600640 1 -- 172.21.15.173:0/2572850581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7dc073ab0 con 0x7fc7dc0b5050 2024-04-25T09:10:14.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.107+0000 7fc7d9600640 1 -- 172.21.15.173:0/2572850581 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc7c80bc020 con 0x7fc7dc0b5050 2024-04-25T09:10:14.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.111+0000 7fc7d9600640 1 --2- 172.21.15.173:0/2572850581 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc7bc066f60 0x7fc7bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.111+0000 7fc7d9600640 1 -- 172.21.15.173:0/2572850581 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5749+0+0 (secure 0 0 0) 0x7fc7c811f2b0 con 0x7fc7dc0b5050 2024-04-25T09:10:14.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.111+0000 7fc7e1c00640 1 --2- 172.21.15.173:0/2572850581 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc7bc066f60 0x7fc7bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.111+0000 7fc7e1c00640 1 --2- 172.21.15.173:0/2572850581 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc7bc066f60 0x7fc7bc069420 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00012f0 tx=0x7fc7d0001690 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.115+0000 7fc7d9600640 1 -- 172.21.15.173:0/2572850581 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc7c80c5030 con 0x7fc7dc0b5050 2024-04-25T09:10:14.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.271+0000 7fc7e4600640 1 -- 172.21.15.173:0/2572850581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc7dc0b3210 con 0x7fc7dc0b5050 2024-04-25T09:10:14.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.931+0000 7fc7d9600640 1 -- 172.21.15.173:0/2572850581 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v100) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc7c8016090 con 0x7fc7dc0b5050 2024-04-25T09:10:14.919 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' removed 2024-04-25T09:10:14.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.939+0000 7fc7e4600640 1 -- 172.21.15.173:0/2572850581 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc7bc066f60 msgr2=0x7fc7bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.939+0000 7fc7e4600640 1 --2- 172.21.15.173:0/2572850581 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc7bc066f60 0x7fc7bc069420 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00012f0 tx=0x7fc7d0001690 comp rx=0 tx=0).stop 2024-04-25T09:10:14.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.939+0000 7fc7e4600640 1 -- 172.21.15.173:0/2572850581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7dc0b5050 msgr2=0x7fc7dc13b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.939+0000 7fc7e4600640 1 --2- 172.21.15.173:0/2572850581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7dc0b5050 0x7fc7dc13b990 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80ac040 tx=0x7fc7c801ace0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.939+0000 7fc7e4600640 1 -- 172.21.15.173:0/2572850581 shutdown_connections 2024-04-25T09:10:14.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.939+0000 7fc7e4600640 1 --2- 172.21.15.173:0/2572850581 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc7bc066f60 0x7fc7bc069420 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.939+0000 7fc7e4600640 1 --2- 172.21.15.173:0/2572850581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7dc15efe0 0x7fc7dc14b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.939+0000 7fc7e4600640 1 --2- 172.21.15.173:0/2572850581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7dc0b5050 0x7fc7dc13b990 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.939+0000 7fc7e4600640 1 --2- 172.21.15.173:0/2572850581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7dc06b120 0x7fc7dc14f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.939+0000 7fc7e4600640 1 -- 172.21.15.173:0/2572850581 >> 172.21.15.173:0/2572850581 conn(0x7fc7dc0cfed0 msgr2=0x7fc7dc0cc730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.939+0000 7fc7e4600640 1 -- 172.21.15.173:0/2572850581 shutdown_connections 2024-04-25T09:10:14.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:14.939+0000 7fc7e4600640 1 -- 172.21.15.173:0/2572850581 wait complete. 2024-04-25T09:10:14.964 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:10:15.047 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:10:15.050 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:10:15.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.123+0000 7f583ba00640 1 Processor -- start 2024-04-25T09:10:15.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.123+0000 7f583ba00640 1 -- start start 2024-04-25T09:10:15.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.127+0000 7f583ba00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f58340b3fe0 0x7f58340b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:15.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.127+0000 7f583ba00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583406d4b0 con 0x7f58340cc260 2024-04-25T09:10:15.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.127+0000 7f583ba00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583406d790 con 0x7f5834145290 2024-04-25T09:10:15.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.127+0000 7f583ba00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58340ccd80 con 0x7f58340b3fe0 2024-04-25T09:10:15.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.127+0000 7f5839a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f58340cc260 0x7f58340cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53322/0 (socket says 172.21.15.173:53322) 2024-04-25T09:10:15.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.127+0000 7f5839a00640 1 -- 172.21.15.173:0/4220274999 learned_addr learned my addr 172.21.15.173:0/4220274999 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:15.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.127+0000 7f582be00640 1 --2- 172.21.15.173:0/4220274999 >> v2:172.21.15.194:3300/0 conn(0x7f58340b3fe0 0x7f58340b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:15.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.127+0000 7f5833e00640 1 -- 172.21.15.173:0/4220274999 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467717501 0 0) 0x7f583406d4b0 con 0x7f58340cc260 2024-04-25T09:10:15.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.127+0000 7f5833e00640 1 -- 172.21.15.173:0/4220274999 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5818003530 con 0x7f58340cc260 2024-04-25T09:10:15.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.127+0000 7f5833e00640 1 -- 172.21.15.173:0/4220274999 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 231845738 0 0) 0x7f5818003530 con 0x7f58340cc260 2024-04-25T09:10:15.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.127+0000 7f582be00640 1 -- 172.21.15.173:0/4220274999 >> v1:172.21.15.194:6789/0 conn(0x7f5834145290 legacy=0x7f583415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.127+0000 7f582be00640 1 -- 172.21.15.173:0/4220274999 >> v1:172.21.15.173:6789/0 conn(0x7f58340cc260 legacy=0x7f58340cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.127+0000 7f582be00640 1 -- 172.21.15.173:0/4220274999 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583406da70 con 0x7f58340b3fe0 2024-04-25T09:10:15.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.131+0000 7f582be00640 1 --2- 172.21.15.173:0/4220274999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58340b3fe0 0x7f58340b4450 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f581c0097c0 tx=0x7f581c01bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e0a5b037b93872a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:15.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.131+0000 7f5833e00640 1 -- 172.21.15.173:0/4220274999 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c001680 con 0x7f58340b3fe0 2024-04-25T09:10:15.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.131+0000 7f5833e00640 1 -- 172.21.15.173:0/4220274999 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c0a7420 con 0x7f58340b3fe0 2024-04-25T09:10:15.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.131+0000 7f5833e00640 1 -- 172.21.15.173:0/4220274999 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0a77f0 con 0x7f58340b3fe0 2024-04-25T09:10:15.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.131+0000 7f583ba00640 1 -- 172.21.15.173:0/4220274999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58340b3fe0 msgr2=0x7f58340b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.131+0000 7f583ba00640 1 --2- 172.21.15.173:0/4220274999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58340b3fe0 0x7f58340b4450 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f581c0097c0 tx=0x7f581c01bec0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.131+0000 7f583ba00640 1 -- 172.21.15.173:0/4220274999 shutdown_connections 2024-04-25T09:10:15.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.131+0000 7f583ba00640 1 --2- 172.21.15.173:0/4220274999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58340b3fe0 0x7f58340b4450 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.131+0000 7f583ba00640 1 -- 172.21.15.173:0/4220274999 >> 172.21.15.173:0/4220274999 conn(0x7f583406ac90 msgr2=0x7f583406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:15.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.131+0000 7f583ba00640 1 -- 172.21.15.173:0/4220274999 shutdown_connections 2024-04-25T09:10:15.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.131+0000 7f583ba00640 1 -- 172.21.15.173:0/4220274999 wait complete. 2024-04-25T09:10:15.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.131+0000 7f583ba00640 1 Processor -- start 2024-04-25T09:10:15.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.131+0000 7f583ba00640 1 -- start start 2024-04-25T09:10:15.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f583ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58340b3fe0 0x7f583415b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:15.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f583ba00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58340cc260 0x7f58340ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:15.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f583ba00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5834145290 0x7f58341402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:15.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f583ba00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583416a270 con 0x7f5834145290 2024-04-25T09:10:15.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f583ba00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583416a0f0 con 0x7f58340cc260 2024-04-25T09:10:15.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f583ba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583416a3f0 con 0x7f58340b3fe0 2024-04-25T09:10:15.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f5839a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5834145290 0x7f58341402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:15.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f5839a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5834145290 0x7f58341402d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45278/0 (socket says 172.21.15.173:45278) 2024-04-25T09:10:15.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f5839a00640 1 -- 172.21.15.173:0/2226851860 learned_addr learned my addr 172.21.15.173:0/2226851860 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:15.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f5839000640 1 --2- 172.21.15.173:0/2226851860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58340b3fe0 0x7f583415b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:15.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f582be00640 1 --2- 172.21.15.173:0/2226851860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58340cc260 0x7f58340ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:15.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f5839a00640 1 -- 172.21.15.173:0/2226851860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58340b3fe0 msgr2=0x7f583415b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f5839a00640 1 --2- 172.21.15.173:0/2226851860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58340b3fe0 0x7f583415b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f5839a00640 1 -- 172.21.15.173:0/2226851860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58340cc260 msgr2=0x7f58340ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f5839a00640 1 --2- 172.21.15.173:0/2226851860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58340cc260 0x7f58340ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f5839a00640 1 -- 172.21.15.173:0/2226851860 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5834143be0 con 0x7f5834145290 2024-04-25T09:10:15.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f582be00640 1 --2- 172.21.15.173:0/2226851860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58340cc260 0x7f58340ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:15.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f5839a00640 1 --2- 172.21.15.173:0/2226851860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5834145290 0x7f58341402d0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f582c00c500 tx=0x7f582c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:15.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f5831600640 1 -- 172.21.15.173:0/2226851860 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c018070 con 0x7f5834145290 2024-04-25T09:10:15.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f5831600640 1 -- 172.21.15.173:0/2226851860 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c007580 con 0x7f5834145290 2024-04-25T09:10:15.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f5831600640 1 -- 172.21.15.173:0/2226851860 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c004a30 con 0x7f5834145290 2024-04-25T09:10:15.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f583ba00640 1 -- 172.21.15.173:0/2226851860 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5834143ec0 con 0x7f5834145290 2024-04-25T09:10:15.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f583ba00640 1 -- 172.21.15.173:0/2226851860 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5834144480 con 0x7f5834145290 2024-04-25T09:10:15.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f583ba00640 1 -- 172.21.15.173:0/2226851860 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5834073ab0 con 0x7f5834145290 2024-04-25T09:10:15.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.135+0000 7f5831600640 1 -- 172.21.15.173:0/2226851860 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f582c004bd0 con 0x7f5834145290 2024-04-25T09:10:15.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.139+0000 7f5831600640 1 --2- 172.21.15.173:0/2226851860 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5810066f60 0x7f5810069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:15.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.139+0000 7f5831600640 1 -- 172.21.15.173:0/2226851860 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f582c084290 con 0x7f5834145290 2024-04-25T09:10:15.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.139+0000 7f5839000640 1 --2- 172.21.15.173:0/2226851860 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5810066f60 0x7f5810069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:15.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.139+0000 7f5839000640 1 --2- 172.21.15.173:0/2226851860 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5810066f60 0x7f5810069420 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f58240012f0 tx=0x7f5824009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:15.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.143+0000 7f5831600640 1 -- 172.21.15.173:0/2226851860 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f582c055400 con 0x7f5834145290 2024-04-25T09:10:15.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.295+0000 7f583ba00640 1 -- 172.21.15.173:0/2226851860 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f58340b10c0 con 0x7f5834145290 2024-04-25T09:10:15.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.299+0000 7f5831600640 1 -- 172.21.15.173:0/2226851860 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f582c054d00 con 0x7f5834145290 2024-04-25T09:10:15.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.303+0000 7f583ba00640 1 -- 172.21.15.173:0/2226851860 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5810066f60 msgr2=0x7f5810069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.303+0000 7f583ba00640 1 --2- 172.21.15.173:0/2226851860 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5810066f60 0x7f5810069420 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f58240012f0 tx=0x7f5824009040 comp rx=0 tx=0).stop 2024-04-25T09:10:15.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.303+0000 7f583ba00640 1 -- 172.21.15.173:0/2226851860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5834145290 msgr2=0x7f58341402d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.303+0000 7f583ba00640 1 --2- 172.21.15.173:0/2226851860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5834145290 0x7f58341402d0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f582c00c500 tx=0x7f582c00c9c0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.303+0000 7f583ba00640 1 -- 172.21.15.173:0/2226851860 shutdown_connections 2024-04-25T09:10:15.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.303+0000 7f583ba00640 1 --2- 172.21.15.173:0/2226851860 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5810066f60 0x7f5810069420 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.303+0000 7f583ba00640 1 --2- 172.21.15.173:0/2226851860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5834145290 0x7f58341402d0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.303+0000 7f583ba00640 1 --2- 172.21.15.173:0/2226851860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58340cc260 0x7f58340ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.303+0000 7f583ba00640 1 --2- 172.21.15.173:0/2226851860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58340b3fe0 0x7f583415b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.303+0000 7f583ba00640 1 -- 172.21.15.173:0/2226851860 >> 172.21.15.173:0/2226851860 conn(0x7f583406ac90 msgr2=0x7f583415e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:15.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.303+0000 7f583ba00640 1 -- 172.21.15.173:0/2226851860 shutdown_connections 2024-04-25T09:10:15.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.303+0000 7f583ba00640 1 -- 172.21.15.173:0/2226851860 wait complete. 2024-04-25T09:10:15.310 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-04-25T09:10:15.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.499+0000 7f7dcae00640 1 Processor -- start 2024-04-25T09:10:15.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.499+0000 7f7dcae00640 1 -- start start 2024-04-25T09:10:15.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.503+0000 7f7dcae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7dc4145250 0x7f7dc415c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:15.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.503+0000 7f7dcae00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc415cec0 con 0x7f7dc40ccd30 2024-04-25T09:10:15.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.503+0000 7f7dcae00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc406e7c0 con 0x7f7dc40cc8b0 2024-04-25T09:10:15.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.503+0000 7f7dcae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc4072140 con 0x7f7dc4145250 2024-04-25T09:10:15.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.503+0000 7f7dc8e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f7dc40ccd30 0x7f7dc4071a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53330/0 (socket says 172.21.15.173:53330) 2024-04-25T09:10:15.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.503+0000 7f7dc8e00640 1 -- 172.21.15.173:0/4188454952 learned_addr learned my addr 172.21.15.173:0/4188454952 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:15.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.503+0000 7f7dc3e00640 1 --2- 172.21.15.173:0/4188454952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7dc4145250 0x7f7dc415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:15.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.503+0000 7f7dc2a00640 1 -- 172.21.15.173:0/4188454952 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702896557 0 0) 0x7f7dbc0014a0 con 0x7f7dc40ccd30 2024-04-25T09:10:15.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.503+0000 7f7dc2a00640 1 -- 172.21.15.173:0/4188454952 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7da8003530 con 0x7f7dc40ccd30 2024-04-25T09:10:15.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.503+0000 7f7dc2a00640 1 -- 172.21.15.173:0/4188454952 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379826716 0 0) 0x7f7dc406e7c0 con 0x7f7dc40cc8b0 2024-04-25T09:10:15.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.503+0000 7f7dc2a00640 1 -- 172.21.15.173:0/4188454952 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dbc0014a0 con 0x7f7dc40cc8b0 2024-04-25T09:10:15.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.503+0000 7f7dc3e00640 1 -- 172.21.15.173:0/4188454952 >> v1:172.21.15.194:6789/0 conn(0x7f7dc40cc8b0 legacy=0x7f7dc4071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.503+0000 7f7dc2a00640 1 -- 172.21.15.173:0/4188454952 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1879558926 0 0) 0x7f7da8003530 con 0x7f7dc40ccd30 2024-04-25T09:10:15.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.503+0000 7f7dc3e00640 1 -- 172.21.15.173:0/4188454952 >> v1:172.21.15.173:6789/0 conn(0x7f7dc40ccd30 legacy=0x7f7dc4071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.503+0000 7f7dc3e00640 1 -- 172.21.15.173:0/4188454952 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc406d720 con 0x7f7dc4145250 2024-04-25T09:10:15.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.507+0000 7f7dc3e00640 1 --2- 172.21.15.173:0/4188454952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7dc4145250 0x7f7dc415c980 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7db40097f0 tx=0x7f7db401c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33f535bfff638218 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:15.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.507+0000 7f7dc2a00640 1 -- 172.21.15.173:0/4188454952 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db40b0070 con 0x7f7dc4145250 2024-04-25T09:10:15.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.507+0000 7f7dc2a00640 1 -- 172.21.15.173:0/4188454952 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db4004030 con 0x7f7dc4145250 2024-04-25T09:10:15.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.507+0000 7f7dc2a00640 1 -- 172.21.15.173:0/4188454952 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc001bd0 con 0x7f7dc4145250 2024-04-25T09:10:15.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.507+0000 7f7dcae00640 1 -- 172.21.15.173:0/4188454952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7dc4145250 msgr2=0x7f7dc415c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.507+0000 7f7dcae00640 1 --2- 172.21.15.173:0/4188454952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7dc4145250 0x7f7dc415c980 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7db40097f0 tx=0x7f7db401c3d0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.507+0000 7f7dcae00640 1 -- 172.21.15.173:0/4188454952 shutdown_connections 2024-04-25T09:10:15.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.507+0000 7f7dcae00640 1 --2- 172.21.15.173:0/4188454952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7dc4145250 0x7f7dc415c980 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.507+0000 7f7dcae00640 1 -- 172.21.15.173:0/4188454952 >> 172.21.15.173:0/4188454952 conn(0x7f7dc406ac90 msgr2=0x7f7dc406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:15.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.507+0000 7f7dcae00640 1 -- 172.21.15.173:0/4188454952 shutdown_connections 2024-04-25T09:10:15.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.507+0000 7f7dcae00640 1 -- 172.21.15.173:0/4188454952 wait complete. 2024-04-25T09:10:15.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dcae00640 1 Processor -- start 2024-04-25T09:10:15.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dcae00640 1 -- start start 2024-04-25T09:10:15.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dcae00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7dc40cc8b0 0x7f7dc4159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:15.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dcae00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7dc40ccd30 0x7f7dc413ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:15.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dcae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7dc4145250 0x7f7dc413f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:15.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dcae00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc40cd1a0 con 0x7f7dc40ccd30 2024-04-25T09:10:15.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dcae00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc406e2a0 con 0x7f7dc40cc8b0 2024-04-25T09:10:15.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dcae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc4145630 con 0x7f7dc4145250 2024-04-25T09:10:15.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dc3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7dc40ccd30 0x7f7dc413ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:15.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dc3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7dc40ccd30 0x7f7dc413ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45294/0 (socket says 172.21.15.173:45294) 2024-04-25T09:10:15.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dc3400640 1 -- 172.21.15.173:0/2659715338 learned_addr learned my addr 172.21.15.173:0/2659715338 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:15.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dc3e00640 1 --2- 172.21.15.173:0/2659715338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7dc40cc8b0 0x7f7dc4159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:15.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dc8e00640 1 --2- 172.21.15.173:0/2659715338 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7dc4145250 0x7f7dc413f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:15.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dc3400640 1 -- 172.21.15.173:0/2659715338 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7dc4145250 msgr2=0x7f7dc413f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dc3400640 1 --2- 172.21.15.173:0/2659715338 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7dc4145250 0x7f7dc413f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dc3400640 1 -- 172.21.15.173:0/2659715338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7dc40cc8b0 msgr2=0x7f7dc4159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dc3400640 1 --2- 172.21.15.173:0/2659715338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7dc40cc8b0 0x7f7dc4159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dc3400640 1 -- 172.21.15.173:0/2659715338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc415b260 con 0x7f7dc40ccd30 2024-04-25T09:10:15.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dc3400640 1 --2- 172.21.15.173:0/2659715338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7dc40ccd30 0x7f7dc413ec40 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f7db000c430 tx=0x7f7db000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:15.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dbbe00640 1 -- 172.21.15.173:0/2659715338 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0017070 con 0x7f7dc40ccd30 2024-04-25T09:10:15.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dbbe00640 1 -- 172.21.15.173:0/2659715338 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db00052f0 con 0x7f7dc40ccd30 2024-04-25T09:10:15.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dbbe00640 1 -- 172.21.15.173:0/2659715338 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0003840 con 0x7f7dc40ccd30 2024-04-25T09:10:15.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dcae00640 1 -- 172.21.15.173:0/2659715338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc415b540 con 0x7f7dc40ccd30 2024-04-25T09:10:15.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dcae00640 1 -- 172.21.15.173:0/2659715338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc413fd40 con 0x7f7dc40ccd30 2024-04-25T09:10:15.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.511+0000 7f7dcae00640 1 -- 172.21.15.173:0/2659715338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc4073a40 con 0x7f7dc40ccd30 2024-04-25T09:10:15.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.515+0000 7f7dbbe00640 1 -- 172.21.15.173:0/2659715338 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7db001a070 con 0x7f7dc40ccd30 2024-04-25T09:10:15.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.515+0000 7f7dbbe00640 1 --2- 172.21.15.173:0/2659715338 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7da4066f90 0x7f7da4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:15.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.515+0000 7f7dbbe00640 1 -- 172.21.15.173:0/2659715338 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f7db0084220 con 0x7f7dc40ccd30 2024-04-25T09:10:15.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.515+0000 7f7dc3e00640 1 --2- 172.21.15.173:0/2659715338 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7da4066f90 0x7f7da4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:15.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.515+0000 7f7dc3e00640 1 --2- 172.21.15.173:0/2659715338 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7da4066f90 0x7f7da4069450 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7db40ad000 tx=0x7f7db4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:15.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.519+0000 7f7dbbe00640 1 -- 172.21.15.173:0/2659715338 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7db0054d40 con 0x7f7dc40ccd30 2024-04-25T09:10:15.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.731+0000 7f7dcae00640 1 -- 172.21.15.173:0/2659715338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) v1 -- 0x7f7dc40af3e0 con 0x7f7dc40ccd30 2024-04-25T09:10:15.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.931+0000 7f7dbbe00640 1 -- 172.21.15.173:0/2659715338 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v360) v1 ==== 144+0+0 (secure 0 0 0) 0x7f7db0058de0 con 0x7f7dc40ccd30 2024-04-25T09:10:15.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.935+0000 7f7dcae00640 1 -- 172.21.15.173:0/2659715338 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7da4066f90 msgr2=0x7f7da4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.935+0000 7f7dcae00640 1 --2- 172.21.15.173:0/2659715338 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7da4066f90 0x7f7da4069450 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7db40ad000 tx=0x7f7db4008040 comp rx=0 tx=0).stop 2024-04-25T09:10:15.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.935+0000 7f7dcae00640 1 -- 172.21.15.173:0/2659715338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7dc40ccd30 msgr2=0x7f7dc413ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.935+0000 7f7dcae00640 1 --2- 172.21.15.173:0/2659715338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7dc40ccd30 0x7f7dc413ec40 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f7db000c430 tx=0x7f7db000c8f0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.935+0000 7f7dcae00640 1 -- 172.21.15.173:0/2659715338 shutdown_connections 2024-04-25T09:10:15.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.935+0000 7f7dcae00640 1 --2- 172.21.15.173:0/2659715338 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7da4066f90 0x7f7da4069450 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.935+0000 7f7dcae00640 1 --2- 172.21.15.173:0/2659715338 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7dc4145250 0x7f7dc413f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.935+0000 7f7dcae00640 1 --2- 172.21.15.173:0/2659715338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7dc40ccd30 0x7f7dc413ec40 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.935+0000 7f7dcae00640 1 --2- 172.21.15.173:0/2659715338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7dc40cc8b0 0x7f7dc4159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.935+0000 7f7dcae00640 1 -- 172.21.15.173:0/2659715338 >> 172.21.15.173:0/2659715338 conn(0x7f7dc406ac90 msgr2=0x7f7dc406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:15.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.935+0000 7f7dcae00640 1 -- 172.21.15.173:0/2659715338 shutdown_connections 2024-04-25T09:10:15.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:15.935+0000 7f7dcae00640 1 -- 172.21.15.173:0/2659715338 wait complete. 2024-04-25T09:10:15.945 INFO:tasks.cephfs_test_runner:test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-04-25T09:10:15.946 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T09:10:15.946 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:16.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.091+0000 7ff82e600640 1 Processor -- start 2024-04-25T09:10:16.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.095+0000 7ff82e600640 1 -- start start 2024-04-25T09:10:16.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.095+0000 7ff82e600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff828159d70 0x7ff82806dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.095+0000 7ff82e600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff828071930 0x7ff828071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.095+0000 7ff82e600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82806ed50 con 0x7ff82806e7e0 2024-04-25T09:10:16.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.095+0000 7ff82e600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82815a150 con 0x7ff828159d70 2024-04-25T09:10:16.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.095+0000 7ff82e600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8280cc710 con 0x7ff828071930 2024-04-25T09:10:16.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.095+0000 7ff82d200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff828159d70 0x7ff82806dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.095+0000 7ff827e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ff82806e7e0 0x7ff8280cc000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53342/0 (socket says 172.21.15.173:53342) 2024-04-25T09:10:16.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.095+0000 7ff827e00640 1 -- 172.21.15.173:0/228582142 learned_addr learned my addr 172.21.15.173:0/228582142 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:16.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.095+0000 7ff82dc00640 1 --2- 172.21.15.173:0/228582142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff828071930 0x7ff828071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.095+0000 7ff82d200640 1 -- 172.21.15.173:0/228582142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff828071930 msgr2=0x7ff828071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:16.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.095+0000 7ff82d200640 1 --2- 172.21.15.173:0/228582142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff828071930 0x7ff828071dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.095+0000 7ff82d200640 1 -- 172.21.15.173:0/228582142 >> v1:172.21.15.173:6789/0 conn(0x7ff82806e7e0 legacy=0x7ff8280cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.095+0000 7ff827400640 1 -- 172.21.15.173:0/228582142 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753696226 0 0) 0x7ff82806ed50 con 0x7ff82806e7e0 2024-04-25T09:10:16.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.095+0000 7ff82d200640 1 -- 172.21.15.173:0/228582142 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82806d280 con 0x7ff828159d70 2024-04-25T09:10:16.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.099+0000 7ff82d200640 1 --2- 172.21.15.173:0/228582142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff828159d70 0x7ff82806dd60 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7ff8180097c0 tx=0x7ff81801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ac84a4c1bf1d8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:16.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.099+0000 7ff827400640 1 -- 172.21.15.173:0/228582142 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8180b2070 con 0x7ff828159d70 2024-04-25T09:10:16.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.099+0000 7ff827400640 1 -- 172.21.15.173:0/228582142 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8180ad640 con 0x7ff828159d70 2024-04-25T09:10:16.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.099+0000 7ff827400640 1 -- 172.21.15.173:0/228582142 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8180ada10 con 0x7ff828159d70 2024-04-25T09:10:16.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.099+0000 7ff82e600640 1 -- 172.21.15.173:0/228582142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff828159d70 msgr2=0x7ff82806dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.099+0000 7ff82e600640 1 --2- 172.21.15.173:0/228582142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff828159d70 0x7ff82806dd60 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7ff8180097c0 tx=0x7ff81801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.099+0000 7ff82e600640 1 -- 172.21.15.173:0/228582142 shutdown_connections 2024-04-25T09:10:16.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.099+0000 7ff82e600640 1 --2- 172.21.15.173:0/228582142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff828071930 0x7ff828071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.099+0000 7ff82e600640 1 --2- 172.21.15.173:0/228582142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff828159d70 0x7ff82806dd60 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.099+0000 7ff82e600640 1 -- 172.21.15.173:0/228582142 >> 172.21.15.173:0/228582142 conn(0x7ff82806ac90 msgr2=0x7ff82806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:16.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.099+0000 7ff82e600640 1 -- 172.21.15.173:0/228582142 shutdown_connections 2024-04-25T09:10:16.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.099+0000 7ff82e600640 1 -- 172.21.15.173:0/228582142 wait complete. 2024-04-25T09:10:16.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.099+0000 7ff82e600640 1 Processor -- start 2024-04-25T09:10:16.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.099+0000 7ff82e600640 1 -- start start 2024-04-25T09:10:16.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff82e600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff82806e7e0 0x7ff828144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff82e600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff828071930 0x7ff828155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff82e600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff828159d70 0x7ff8281561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff82e600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8280ce760 con 0x7ff828071930 2024-04-25T09:10:16.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff82e600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8280ce5e0 con 0x7ff828159d70 2024-04-25T09:10:16.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff82e600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8280ce8e0 con 0x7ff82806e7e0 2024-04-25T09:10:16.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff827e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff828071930 0x7ff828155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff827e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff828071930 0x7ff828155c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45306/0 (socket says 172.21.15.173:45306) 2024-04-25T09:10:16.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff827e00640 1 -- 172.21.15.173:0/1069205520 learned_addr learned my addr 172.21.15.173:0/1069205520 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:16.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff82d200640 1 --2- 172.21.15.173:0/1069205520 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff82806e7e0 0x7ff828144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff82dc00640 1 --2- 172.21.15.173:0/1069205520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff828159d70 0x7ff8281561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff827e00640 1 -- 172.21.15.173:0/1069205520 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff82806e7e0 msgr2=0x7ff828144f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff827e00640 1 --2- 172.21.15.173:0/1069205520 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff82806e7e0 0x7ff828144f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff827e00640 1 -- 172.21.15.173:0/1069205520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff828159d70 msgr2=0x7ff8281561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff827e00640 1 --2- 172.21.15.173:0/1069205520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff828159d70 0x7ff8281561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff827e00640 1 -- 172.21.15.173:0/1069205520 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82814a810 con 0x7ff828071930 2024-04-25T09:10:16.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff82dc00640 1 --2- 172.21.15.173:0/1069205520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff828159d70 0x7ff8281561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:16.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff827e00640 1 --2- 172.21.15.173:0/1069205520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff828071930 0x7ff828155c90 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7ff81400c480 tx=0x7ff81400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:16.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff824c00640 1 -- 172.21.15.173:0/1069205520 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814018070 con 0x7ff828071930 2024-04-25T09:10:16.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff824c00640 1 -- 172.21.15.173:0/1069205520 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff814007500 con 0x7ff828071930 2024-04-25T09:10:16.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff82e600640 1 -- 172.21.15.173:0/1069205520 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82814aaf0 con 0x7ff828071930 2024-04-25T09:10:16.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff824c00640 1 -- 172.21.15.173:0/1069205520 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814004a30 con 0x7ff828071930 2024-04-25T09:10:16.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff82e600640 1 -- 172.21.15.173:0/1069205520 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82814b0b0 con 0x7ff828071930 2024-04-25T09:10:16.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.103+0000 7ff82e600640 1 -- 172.21.15.173:0/1069205520 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff828073a40 con 0x7ff828071930 2024-04-25T09:10:16.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.107+0000 7ff824c00640 1 -- 172.21.15.173:0/1069205520 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff81401b070 con 0x7ff828071930 2024-04-25T09:10:16.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.107+0000 7ff824c00640 1 --2- 172.21.15.173:0/1069205520 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff808066f90 0x7ff808069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.107+0000 7ff824c00640 1 -- 172.21.15.173:0/1069205520 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5335+0+0 (secure 0 0 0) 0x7ff814084260 con 0x7ff828071930 2024-04-25T09:10:16.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.107+0000 7ff82d200640 1 --2- 172.21.15.173:0/1069205520 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff808066f90 0x7ff808069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.107+0000 7ff82d200640 1 --2- 172.21.15.173:0/1069205520 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff808066f90 0x7ff808069450 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff8180af000 tx=0x7ff8180a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:16.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.111+0000 7ff824c00640 1 -- 172.21.15.173:0/1069205520 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff8140553d0 con 0x7ff828071930 2024-04-25T09:10:16.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.263+0000 7ff82e600640 1 -- 172.21.15.173:0/1069205520 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff82806dfb0 con 0x7ff828071930 2024-04-25T09:10:16.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.263+0000 7ff824c00640 1 -- 172.21.15.173:0/1069205520 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+13355 (secure 0 0 0) 0x7ff814054cd0 con 0x7ff828071930 2024-04-25T09:10:16.254 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:16.254 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":100,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:10:14.933698+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:6837/555490935":"2024-04-26T09:10:11.927805+0000","172.21.15.173:6836/555490935":"2024-04-26T09:10:11.927805+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:16.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.267+0000 7ff82e600640 1 -- 172.21.15.173:0/1069205520 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff808066f90 msgr2=0x7ff808069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.267+0000 7ff82e600640 1 --2- 172.21.15.173:0/1069205520 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff808066f90 0x7ff808069450 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff8180af000 tx=0x7ff8180a7070 comp rx=0 tx=0).stop 2024-04-25T09:10:16.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.267+0000 7ff82e600640 1 -- 172.21.15.173:0/1069205520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff828071930 msgr2=0x7ff828155c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.267+0000 7ff82e600640 1 --2- 172.21.15.173:0/1069205520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff828071930 0x7ff828155c90 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7ff81400c480 tx=0x7ff81400c940 comp rx=0 tx=0).stop 2024-04-25T09:10:16.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.267+0000 7ff82e600640 1 -- 172.21.15.173:0/1069205520 shutdown_connections 2024-04-25T09:10:16.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.267+0000 7ff82e600640 1 --2- 172.21.15.173:0/1069205520 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff808066f90 0x7ff808069450 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.267+0000 7ff82e600640 1 --2- 172.21.15.173:0/1069205520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff828159d70 0x7ff8281561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.267+0000 7ff82e600640 1 --2- 172.21.15.173:0/1069205520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff828071930 0x7ff828155c90 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.267+0000 7ff82e600640 1 --2- 172.21.15.173:0/1069205520 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff82806e7e0 0x7ff828144f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.267+0000 7ff82e600640 1 -- 172.21.15.173:0/1069205520 >> 172.21.15.173:0/1069205520 conn(0x7ff82806ac90 msgr2=0x7ff8280af720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:16.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.267+0000 7ff82e600640 1 -- 172.21.15.173:0/1069205520 shutdown_connections 2024-04-25T09:10:16.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.267+0000 7ff82e600640 1 -- 172.21.15.173:0/1069205520 wait complete. 2024-04-25T09:10:16.275 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:10:16.275 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:10:16.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.423+0000 7f2705e00640 1 Processor -- start 2024-04-25T09:10:16.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.423+0000 7f2705e00640 1 -- start start 2024-04-25T09:10:16.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.423+0000 7f2705e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f27000aeb90 0x7f27000cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.423+0000 7f2705e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000ce2b0 0x7f27000cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.423+0000 7f2705e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2700071570 con 0x7f27000aef70 2024-04-25T09:10:16.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.423+0000 7f2705e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2700071320 con 0x7f27000aeb90 2024-04-25T09:10:16.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.423+0000 7f2705e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2700072330 con 0x7f27000ce2b0 2024-04-25T09:10:16.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.427+0000 7f26fea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f27000aeb90 0x7f27000cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.427+0000 7f26fea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f27000aeb90 0x7f27000cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45312/0 (socket says 172.21.15.173:45312) 2024-04-25T09:10:16.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.427+0000 7f26fea00640 1 -- 172.21.15.173:0/3817868591 learned_addr learned my addr 172.21.15.173:0/3817868591 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:16.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.427+0000 7f26ff400640 1 --2- 172.21.15.173:0/3817868591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000ce2b0 0x7f27000cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.427+0000 7f26fea00640 1 -- 172.21.15.173:0/3817868591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000ce2b0 msgr2=0x7f27000cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:16.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.427+0000 7f26fea00640 1 --2- 172.21.15.173:0/3817868591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000ce2b0 0x7f27000cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.427+0000 7f26fea00640 1 -- 172.21.15.173:0/3817868591 >> v1:172.21.15.194:6789/0 conn(0x7f27000aef70 legacy=0x7f27000cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.427+0000 7f26fea00640 1 -- 172.21.15.173:0/3817868591 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2700071850 con 0x7f27000aeb90 2024-04-25T09:10:16.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.427+0000 7f26fea00640 1 --2- 172.21.15.173:0/3817868591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27000aeb90 0x7f27000cc0d0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f26f0009e50 tx=0x7f26f001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa99fed83df04746 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:16.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.427+0000 7f26fd600640 1 -- 172.21.15.173:0/3817868591 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f00a5730 con 0x7f27000aeb90 2024-04-25T09:10:16.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.427+0000 7f26fd600640 1 -- 172.21.15.173:0/3817868591 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f00a58d0 con 0x7f27000aeb90 2024-04-25T09:10:16.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.427+0000 7f26fd600640 1 -- 172.21.15.173:0/3817868591 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f00a5ca0 con 0x7f27000aeb90 2024-04-25T09:10:16.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f2705e00640 1 -- 172.21.15.173:0/3817868591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27000aeb90 msgr2=0x7f27000cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f2705e00640 1 --2- 172.21.15.173:0/3817868591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27000aeb90 0x7f27000cc0d0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f26f0009e50 tx=0x7f26f001c970 comp rx=0 tx=0).stop 2024-04-25T09:10:16.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f2705e00640 1 -- 172.21.15.173:0/3817868591 shutdown_connections 2024-04-25T09:10:16.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f2705e00640 1 --2- 172.21.15.173:0/3817868591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000ce2b0 0x7f27000cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f2705e00640 1 --2- 172.21.15.173:0/3817868591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27000aeb90 0x7f27000cc0d0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f2705e00640 1 -- 172.21.15.173:0/3817868591 >> 172.21.15.173:0/3817868591 conn(0x7f270006ac90 msgr2=0x7f270006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:16.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f2705e00640 1 -- 172.21.15.173:0/3817868591 shutdown_connections 2024-04-25T09:10:16.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f2705e00640 1 -- 172.21.15.173:0/3817868591 wait complete. 2024-04-25T09:10:16.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f2705e00640 1 Processor -- start 2024-04-25T09:10:16.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f2705e00640 1 -- start start 2024-04-25T09:10:16.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f2705e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000aeb90 0x7f27001399d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f2705e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27000aef70 0x7f2700136660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f2705e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27000ce2b0 0x7f2700159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f2705e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270015bb70 con 0x7f27000aef70 2024-04-25T09:10:16.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f2705e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270015b9f0 con 0x7f27000ce2b0 2024-04-25T09:10:16.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f2705e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270015bcf0 con 0x7f27000aeb90 2024-04-25T09:10:16.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f26fe000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27000aef70 0x7f2700136660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f26fe000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27000aef70 0x7f2700136660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45318/0 (socket says 172.21.15.173:45318) 2024-04-25T09:10:16.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f26fe000640 1 -- 172.21.15.173:0/222146712 learned_addr learned my addr 172.21.15.173:0/222146712 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:16.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f26fea00640 1 --2- 172.21.15.173:0/222146712 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000aeb90 0x7f27001399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f26ff400640 1 --2- 172.21.15.173:0/222146712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27000ce2b0 0x7f2700159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f26fe000640 1 -- 172.21.15.173:0/222146712 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000aeb90 msgr2=0x7f27001399d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f26fe000640 1 --2- 172.21.15.173:0/222146712 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000aeb90 0x7f27001399d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f26fe000640 1 -- 172.21.15.173:0/222146712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27000ce2b0 msgr2=0x7f2700159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f26fe000640 1 --2- 172.21.15.173:0/222146712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27000ce2b0 0x7f2700159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f26fe000640 1 -- 172.21.15.173:0/222146712 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2700139f10 con 0x7f27000aef70 2024-04-25T09:10:16.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f26fe000640 1 --2- 172.21.15.173:0/222146712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27000aef70 0x7f2700136660 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f26ec00c3a0 tx=0x7f26ec00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:16.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.431+0000 7f26f7400640 1 -- 172.21.15.173:0/222146712 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec0052d0 con 0x7f27000aef70 2024-04-25T09:10:16.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.435+0000 7f26f7400640 1 -- 172.21.15.173:0/222146712 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ec005470 con 0x7f27000aef70 2024-04-25T09:10:16.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.435+0000 7f2705e00640 1 -- 172.21.15.173:0/222146712 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27000af710 con 0x7f27000aef70 2024-04-25T09:10:16.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.435+0000 7f26f7400640 1 -- 172.21.15.173:0/222146712 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec007260 con 0x7f27000aef70 2024-04-25T09:10:16.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.435+0000 7f2705e00640 1 -- 172.21.15.173:0/222146712 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27000b13b0 con 0x7f27000aef70 2024-04-25T09:10:16.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.435+0000 7f2705e00640 1 -- 172.21.15.173:0/222146712 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2700073ab0 con 0x7f27000aef70 2024-04-25T09:10:16.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.435+0000 7f26f7400640 1 -- 172.21.15.173:0/222146712 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f26ec007400 con 0x7f27000aef70 2024-04-25T09:10:16.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.435+0000 7f26f7400640 1 --2- 172.21.15.173:0/222146712 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f26e0066f60 0x7f26e0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.435+0000 7f26f7400640 1 -- 172.21.15.173:0/222146712 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f26ec0843f0 con 0x7f27000aef70 2024-04-25T09:10:16.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.435+0000 7f26fea00640 1 --2- 172.21.15.173:0/222146712 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f26e0066f60 0x7f26e0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.435+0000 7f26fea00640 1 --2- 172.21.15.173:0/222146712 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f26e0066f60 0x7f26e0069420 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f26f00ae000 tx=0x7f26f00a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:16.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.439+0000 7f26f7400640 1 -- 172.21.15.173:0/222146712 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f26ec0554d0 con 0x7f27000aef70 2024-04-25T09:10:16.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.615+0000 7f2705e00640 1 -- 172.21.15.173:0/222146712 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f270014b4d0 con 0x7f27000aef70 2024-04-25T09:10:16.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.615+0000 7f26f7400640 1 -- 172.21.15.173:0/222146712 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v100) v1 ==== 93+0+10 (secure 0 0 0) 0x7f26ec054dd0 con 0x7f27000aef70 2024-04-25T09:10:16.605 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:10:16.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.619+0000 7f2705e00640 1 -- 172.21.15.173:0/222146712 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f26e0066f60 msgr2=0x7f26e0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.619+0000 7f2705e00640 1 --2- 172.21.15.173:0/222146712 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f26e0066f60 0x7f26e0069420 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f26f00ae000 tx=0x7f26f00a7070 comp rx=0 tx=0).stop 2024-04-25T09:10:16.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.619+0000 7f2705e00640 1 -- 172.21.15.173:0/222146712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27000aef70 msgr2=0x7f2700136660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.619+0000 7f2705e00640 1 --2- 172.21.15.173:0/222146712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27000aef70 0x7f2700136660 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f26ec00c3a0 tx=0x7f26ec00c860 comp rx=0 tx=0).stop 2024-04-25T09:10:16.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.619+0000 7f2705e00640 1 -- 172.21.15.173:0/222146712 shutdown_connections 2024-04-25T09:10:16.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.619+0000 7f2705e00640 1 --2- 172.21.15.173:0/222146712 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f26e0066f60 0x7f26e0069420 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.619+0000 7f2705e00640 1 --2- 172.21.15.173:0/222146712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27000ce2b0 0x7f2700159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.619+0000 7f2705e00640 1 --2- 172.21.15.173:0/222146712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27000aef70 0x7f2700136660 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.619+0000 7f2705e00640 1 --2- 172.21.15.173:0/222146712 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27000aeb90 0x7f27001399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.619+0000 7f2705e00640 1 -- 172.21.15.173:0/222146712 >> 172.21.15.173:0/222146712 conn(0x7f270006ac90 msgr2=0x7f270015d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:16.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.619+0000 7f2705e00640 1 -- 172.21.15.173:0/222146712 shutdown_connections 2024-04-25T09:10:16.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.619+0000 7f2705e00640 1 -- 172.21.15.173:0/222146712 wait complete. 2024-04-25T09:10:16.627 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-04-25T09:10:16.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.819+0000 7fd2e0200640 1 Processor -- start 2024-04-25T09:10:16.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.819+0000 7fd2e0200640 1 -- start start 2024-04-25T09:10:16.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.819+0000 7fd2e0200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd2d81583f0 0x7fd2d80d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.819+0000 7fd2e0200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2d8162210 0x7fd2d80d1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.819+0000 7fd2e0200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d80cc080 con 0x7fd2d80cce20 2024-04-25T09:10:16.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.819+0000 7fd2e0200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d8162650 con 0x7fd2d81583f0 2024-04-25T09:10:16.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.819+0000 7fd2e0200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d8162870 con 0x7fd2d8162210 2024-04-25T09:10:16.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.819+0000 7fd2dd800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd2d81583f0 0x7fd2d80d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.819+0000 7fd2dd800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd2d81583f0 0x7fd2d80d17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45320/0 (socket says 172.21.15.173:45320) 2024-04-25T09:10:16.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.819+0000 7fd2dd800640 1 -- 172.21.15.173:0/1338527106 learned_addr learned my addr 172.21.15.173:0/1338527106 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:16.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.819+0000 7fd2de200640 1 --2- 172.21.15.173:0/1338527106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2d8162210 0x7fd2d80d1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.819+0000 7fd2dd800640 1 -- 172.21.15.173:0/1338527106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2d8162210 msgr2=0x7fd2d80d1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:16.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.819+0000 7fd2dd800640 1 --2- 172.21.15.173:0/1338527106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2d8162210 0x7fd2d80d1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.819+0000 7fd2dd800640 1 -- 172.21.15.173:0/1338527106 >> v1:172.21.15.194:6789/0 conn(0x7fd2d80cce20 legacy=0x7fd2d8161b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.819+0000 7fd2dd800640 1 -- 172.21.15.173:0/1338527106 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d80cc340 con 0x7fd2d81583f0 2024-04-25T09:10:16.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.823+0000 7fd2dd800640 1 --2- 172.21.15.173:0/1338527106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d81583f0 0x7fd2d80d17b0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc009870 tx=0x7fd2cc01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4538be8c8bea47b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:16.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.823+0000 7fd2d7e00640 1 -- 172.21.15.173:0/1338527106 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc0a95f0 con 0x7fd2d81583f0 2024-04-25T09:10:16.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.823+0000 7fd2d7e00640 1 -- 172.21.15.173:0/1338527106 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2cc0a9790 con 0x7fd2d81583f0 2024-04-25T09:10:16.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.823+0000 7fd2d7e00640 1 -- 172.21.15.173:0/1338527106 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc0a9b60 con 0x7fd2d81583f0 2024-04-25T09:10:16.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.823+0000 7fd2e0200640 1 -- 172.21.15.173:0/1338527106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d81583f0 msgr2=0x7fd2d80d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.823+0000 7fd2e0200640 1 --2- 172.21.15.173:0/1338527106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d81583f0 0x7fd2d80d17b0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc009870 tx=0x7fd2cc01c530 comp rx=0 tx=0).stop 2024-04-25T09:10:16.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.823+0000 7fd2e0200640 1 -- 172.21.15.173:0/1338527106 shutdown_connections 2024-04-25T09:10:16.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.823+0000 7fd2e0200640 1 --2- 172.21.15.173:0/1338527106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2d8162210 0x7fd2d80d1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.823+0000 7fd2e0200640 1 --2- 172.21.15.173:0/1338527106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d81583f0 0x7fd2d80d17b0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.823+0000 7fd2e0200640 1 -- 172.21.15.173:0/1338527106 >> 172.21.15.173:0/1338527106 conn(0x7fd2d806f600 msgr2=0x7fd2d806fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:16.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.823+0000 7fd2e0200640 1 -- 172.21.15.173:0/1338527106 shutdown_connections 2024-04-25T09:10:16.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.823+0000 7fd2e0200640 1 -- 172.21.15.173:0/1338527106 wait complete. 2024-04-25T09:10:16.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2e0200640 1 Processor -- start 2024-04-25T09:10:16.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2e0200640 1 -- start start 2024-04-25T09:10:16.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2e0200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d80cce20 0x7fd2d80c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2e0200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2d81583f0 0x7fd2d80c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2e0200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2d8162210 0x7fd2d80c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2e0200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80cea70 con 0x7fd2d80cce20 2024-04-25T09:10:16.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2e0200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80ce8f0 con 0x7fd2d8162210 2024-04-25T09:10:16.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2e0200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80cebf0 con 0x7fd2d81583f0 2024-04-25T09:10:16.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2dd800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d80cce20 0x7fd2d80c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2dd800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d80cce20 0x7fd2d80c9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45326/0 (socket says 172.21.15.173:45326) 2024-04-25T09:10:16.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2dd800640 1 -- 172.21.15.173:0/1579592633 learned_addr learned my addr 172.21.15.173:0/1579592633 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:16.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2de200640 1 --2- 172.21.15.173:0/1579592633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2d8162210 0x7fd2d80c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2dce00640 1 --2- 172.21.15.173:0/1579592633 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2d81583f0 0x7fd2d80c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2dd800640 1 -- 172.21.15.173:0/1579592633 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2d81583f0 msgr2=0x7fd2d80c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2dd800640 1 --2- 172.21.15.173:0/1579592633 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2d81583f0 0x7fd2d80c9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2dd800640 1 -- 172.21.15.173:0/1579592633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2d8162210 msgr2=0x7fd2d80c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2dd800640 1 --2- 172.21.15.173:0/1579592633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2d8162210 0x7fd2d80c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2dd800640 1 -- 172.21.15.173:0/1579592633 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d80c8990 con 0x7fd2d80cce20 2024-04-25T09:10:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2dd800640 1 --2- 172.21.15.173:0/1579592633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d80cce20 0x7fd2d80c9430 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0ab040 tx=0x7fd2cc01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2d5600640 1 -- 172.21.15.173:0/1579592633 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc0b1800 con 0x7fd2d80cce20 2024-04-25T09:10:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2d5600640 1 -- 172.21.15.173:0/1579592633 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2cc0b19c0 con 0x7fd2d80cce20 2024-04-25T09:10:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2e0200640 1 -- 172.21.15.173:0/1579592633 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d80cb380 con 0x7fd2d80cce20 2024-04-25T09:10:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2d5600640 1 -- 172.21.15.173:0/1579592633 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc0b1db0 con 0x7fd2d80cce20 2024-04-25T09:10:16.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.827+0000 7fd2e0200640 1 -- 172.21.15.173:0/1579592633 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d80c8f10 con 0x7fd2d80cce20 2024-04-25T09:10:16.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.831+0000 7fd2e0200640 1 -- 172.21.15.173:0/1579592633 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d8073a40 con 0x7fd2d80cce20 2024-04-25T09:10:16.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.831+0000 7fd2d5600640 1 -- 172.21.15.173:0/1579592633 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd2cc0bc450 con 0x7fd2d80cce20 2024-04-25T09:10:16.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.831+0000 7fd2d5600640 1 --2- 172.21.15.173:0/1579592633 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd2b8066f60 0x7fd2b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.831+0000 7fd2d5600640 1 -- 172.21.15.173:0/1579592633 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fd2cc11f840 con 0x7fd2d80cce20 2024-04-25T09:10:16.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.831+0000 7fd2dce00640 1 --2- 172.21.15.173:0/1579592633 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd2b8066f60 0x7fd2b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.831+0000 7fd2dce00640 1 --2- 172.21.15.173:0/1579592633 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd2b8066f60 0x7fd2b8069420 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80cbe00 tx=0x7fd2c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:16.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:16.835+0000 7fd2d5600640 1 -- 172.21.15.173:0/1579592633 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd2cc0ad020 con 0x7fd2d80cce20 2024-04-25T09:10:17.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:17.047+0000 7fd2e0200640 1 -- 172.21.15.173:0/1579592633 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) v1 -- 0x7fd2d80cfb60 con 0x7fd2d80cce20 2024-04-25T09:10:17.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:17.939+0000 7fd2d5600640 1 -- 172.21.15.173:0/1579592633 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v362) v1 ==== 158+0+0 (secure 0 0 0) 0x7fd2cc016150 con 0x7fd2d80cce20 2024-04-25T09:10:17.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:17.943+0000 7fd2e0200640 1 -- 172.21.15.173:0/1579592633 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd2b8066f60 msgr2=0x7fd2b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:17.943+0000 7fd2e0200640 1 --2- 172.21.15.173:0/1579592633 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd2b8066f60 0x7fd2b8069420 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80cbe00 tx=0x7fd2c4009040 comp rx=0 tx=0).stop 2024-04-25T09:10:17.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:17.943+0000 7fd2e0200640 1 -- 172.21.15.173:0/1579592633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d80cce20 msgr2=0x7fd2d80c9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:17.943+0000 7fd2e0200640 1 --2- 172.21.15.173:0/1579592633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d80cce20 0x7fd2d80c9430 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0ab040 tx=0x7fd2cc01ad70 comp rx=0 tx=0).stop 2024-04-25T09:10:17.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:17.943+0000 7fd2e0200640 1 -- 172.21.15.173:0/1579592633 shutdown_connections 2024-04-25T09:10:17.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:17.943+0000 7fd2e0200640 1 --2- 172.21.15.173:0/1579592633 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd2b8066f60 0x7fd2b8069420 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:17.943+0000 7fd2e0200640 1 --2- 172.21.15.173:0/1579592633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2d8162210 0x7fd2d80c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:17.943+0000 7fd2e0200640 1 --2- 172.21.15.173:0/1579592633 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2d81583f0 0x7fd2d80c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:17.943+0000 7fd2e0200640 1 --2- 172.21.15.173:0/1579592633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2d80cce20 0x7fd2d80c9430 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:17.943+0000 7fd2e0200640 1 -- 172.21.15.173:0/1579592633 >> 172.21.15.173:0/1579592633 conn(0x7fd2d806f600 msgr2=0x7fd2d80b1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:17.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:17.943+0000 7fd2e0200640 1 -- 172.21.15.173:0/1579592633 shutdown_connections 2024-04-25T09:10:17.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:17.943+0000 7fd2e0200640 1 -- 172.21.15.173:0/1579592633 wait complete. 2024-04-25T09:10:17.956 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:10:18.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.111+0000 7f9701a00640 1 Processor -- start 2024-04-25T09:10:18.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.111+0000 7f9701a00640 1 -- start start 2024-04-25T09:10:18.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.111+0000 7f9701a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f96fc0cc7e0 0x7f96fc0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.111+0000 7f9701a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96fc071570 con 0x7f96fc0aeb90 2024-04-25T09:10:18.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.111+0000 7f9701a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96fc071850 con 0x7f96fc0aef70 2024-04-25T09:10:18.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.111+0000 7f9701a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96fc071320 con 0x7f96fc0cc7e0 2024-04-25T09:10:18.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.111+0000 7f96faa00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f96fc0aeb90 0x7f96fc0cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53356/0 (socket says 172.21.15.173:53356) 2024-04-25T09:10:18.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.111+0000 7f96faa00640 1 -- 172.21.15.173:0/3399180292 learned_addr learned my addr 172.21.15.173:0/3399180292 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:18.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.111+0000 7f96fa000640 1 --2- 172.21.15.173:0/3399180292 >> v2:172.21.15.173:3300/0 conn(0x7f96fc0cc7e0 0x7f96fc0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.111+0000 7f96fa000640 1 -- 172.21.15.173:0/3399180292 >> v1:172.21.15.194:6789/0 conn(0x7f96fc0aef70 legacy=0x7f96fc15af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:18.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.111+0000 7f96fa000640 1 -- 172.21.15.173:0/3399180292 >> v1:172.21.15.173:6789/0 conn(0x7f96fc0aeb90 legacy=0x7f96fc0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.111+0000 7f96fa000640 1 -- 172.21.15.173:0/3399180292 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc071b30 con 0x7f96fc0cc7e0 2024-04-25T09:10:18.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.111+0000 7f96f9600640 1 -- 172.21.15.173:0/3399180292 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128545685 0 0) 0x7f96fc071570 con 0x7f96fc0aeb90 2024-04-25T09:10:18.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.115+0000 7f96fa000640 1 --2- 172.21.15.173:0/3399180292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96fc0cc7e0 0x7f96fc0cdba0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f96e80097c0 tx=0x7f96e801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d94d9d0b8918bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:18.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.115+0000 7f96f9600640 1 -- 172.21.15.173:0/3399180292 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e80b0070 con 0x7f96fc0cc7e0 2024-04-25T09:10:18.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.115+0000 7f96f9600640 1 -- 172.21.15.173:0/3399180292 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e80ab600 con 0x7f96fc0cc7e0 2024-04-25T09:10:18.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.115+0000 7f96f9600640 1 -- 172.21.15.173:0/3399180292 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e80ab9d0 con 0x7f96fc0cc7e0 2024-04-25T09:10:18.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.115+0000 7f9701a00640 1 -- 172.21.15.173:0/3399180292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96fc0cc7e0 msgr2=0x7f96fc0cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.115+0000 7f9701a00640 1 --2- 172.21.15.173:0/3399180292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96fc0cc7e0 0x7f96fc0cdba0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f96e80097c0 tx=0x7f96e801c410 comp rx=0 tx=0).stop 2024-04-25T09:10:18.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.115+0000 7f9701a00640 1 -- 172.21.15.173:0/3399180292 shutdown_connections 2024-04-25T09:10:18.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.115+0000 7f9701a00640 1 --2- 172.21.15.173:0/3399180292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96fc0cc7e0 0x7f96fc0cdba0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.115+0000 7f9701a00640 1 -- 172.21.15.173:0/3399180292 >> 172.21.15.173:0/3399180292 conn(0x7f96fc06ac90 msgr2=0x7f96fc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:18.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.115+0000 7f9701a00640 1 -- 172.21.15.173:0/3399180292 shutdown_connections 2024-04-25T09:10:18.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.115+0000 7f9701a00640 1 -- 172.21.15.173:0/3399180292 wait complete. 2024-04-25T09:10:18.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.115+0000 7f9701a00640 1 Processor -- start 2024-04-25T09:10:18.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.115+0000 7f9701a00640 1 -- start start 2024-04-25T09:10:18.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f9701a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96fc0aeb90 0x7f96fc14f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f9701a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96fc0aef70 0x7f96fc145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f9701a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96fc0cc7e0 0x7f96fc0affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f9701a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc1688b0 con 0x7f96fc0cc7e0 2024-04-25T09:10:18.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f9701a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc168730 con 0x7f96fc0aeb90 2024-04-25T09:10:18.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f9701a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc168a30 con 0x7f96fc0aef70 2024-04-25T09:10:18.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f96fb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96fc0cc7e0 0x7f96fc0affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f96fb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96fc0cc7e0 0x7f96fc0affd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45346/0 (socket says 172.21.15.173:45346) 2024-04-25T09:10:18.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f96fb400640 1 -- 172.21.15.173:0/2629500275 learned_addr learned my addr 172.21.15.173:0/2629500275 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:18.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f96faa00640 1 --2- 172.21.15.173:0/2629500275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96fc0aeb90 0x7f96fc14f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f96fa000640 1 --2- 172.21.15.173:0/2629500275 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96fc0aef70 0x7f96fc145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f96fb400640 1 -- 172.21.15.173:0/2629500275 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96fc0aef70 msgr2=0x7f96fc145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f96fb400640 1 --2- 172.21.15.173:0/2629500275 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96fc0aef70 0x7f96fc145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f96fb400640 1 -- 172.21.15.173:0/2629500275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96fc0aeb90 msgr2=0x7f96fc14f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f96fb400640 1 --2- 172.21.15.173:0/2629500275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96fc0aeb90 0x7f96fc14f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f96fb400640 1 -- 172.21.15.173:0/2629500275 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc1555f0 con 0x7f96fc0cc7e0 2024-04-25T09:10:18.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f96fa000640 1 --2- 172.21.15.173:0/2629500275 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96fc0aef70 0x7f96fc145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:18.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f96fb400640 1 --2- 172.21.15.173:0/2629500275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96fc0cc7e0 0x7f96fc0affd0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f96f400c770 tx=0x7f96f400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:18.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f96f2a00640 1 -- 172.21.15.173:0/2629500275 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f4003b80 con 0x7f96fc0cc7e0 2024-04-25T09:10:18.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f96f2a00640 1 -- 172.21.15.173:0/2629500275 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f4003d20 con 0x7f96fc0cc7e0 2024-04-25T09:10:18.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f9701a00640 1 -- 172.21.15.173:0/2629500275 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96fc0b06f0 con 0x7f96fc0cc7e0 2024-04-25T09:10:18.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f96f2a00640 1 -- 172.21.15.173:0/2629500275 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f400aa90 con 0x7f96fc0cc7e0 2024-04-25T09:10:18.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f9701a00640 1 -- 172.21.15.173:0/2629500275 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96fc0b0cb0 con 0x7f96fc0cc7e0 2024-04-25T09:10:18.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f9701a00640 1 -- 172.21.15.173:0/2629500275 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96fc073ab0 con 0x7f96fc0cc7e0 2024-04-25T09:10:18.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.119+0000 7f96f2a00640 1 -- 172.21.15.173:0/2629500275 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f96f400ac30 con 0x7f96fc0cc7e0 2024-04-25T09:10:18.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.123+0000 7f96f2a00640 1 --2- 172.21.15.173:0/2629500275 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f96dc066f60 0x7f96dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.123+0000 7f96f2a00640 1 -- 172.21.15.173:0/2629500275 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f96f4084e20 con 0x7f96fc0cc7e0 2024-04-25T09:10:18.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.123+0000 7f96faa00640 1 --2- 172.21.15.173:0/2629500275 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f96dc066f60 0x7f96dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.123+0000 7f96faa00640 1 --2- 172.21.15.173:0/2629500275 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f96dc066f60 0x7f96dc069420 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f96ec000f70 tx=0x7f96ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:18.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.127+0000 7f96f2a00640 1 -- 172.21.15.173:0/2629500275 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f96f4055f90 con 0x7f96fc0cc7e0 2024-04-25T09:10:18.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.279+0000 7f9701a00640 1 -- 172.21.15.173:0/2629500275 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f96fc150eb0 con 0x7f96fc0cc7e0 2024-04-25T09:10:18.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.283+0000 7f96f2a00640 1 -- 172.21.15.173:0/2629500275 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f96f4055890 con 0x7f96fc0cc7e0 2024-04-25T09:10:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.287+0000 7f9701a00640 1 -- 172.21.15.173:0/2629500275 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f96dc066f60 msgr2=0x7f96dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.287+0000 7f9701a00640 1 --2- 172.21.15.173:0/2629500275 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f96dc066f60 0x7f96dc069420 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f96ec000f70 tx=0x7f96ec009040 comp rx=0 tx=0).stop 2024-04-25T09:10:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.287+0000 7f9701a00640 1 -- 172.21.15.173:0/2629500275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96fc0cc7e0 msgr2=0x7f96fc0affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.287+0000 7f9701a00640 1 --2- 172.21.15.173:0/2629500275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96fc0cc7e0 0x7f96fc0affd0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f96f400c770 tx=0x7f96f400cc30 comp rx=0 tx=0).stop 2024-04-25T09:10:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.287+0000 7f9701a00640 1 -- 172.21.15.173:0/2629500275 shutdown_connections 2024-04-25T09:10:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.287+0000 7f9701a00640 1 --2- 172.21.15.173:0/2629500275 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f96dc066f60 0x7f96dc069420 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.287+0000 7f9701a00640 1 --2- 172.21.15.173:0/2629500275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96fc0cc7e0 0x7f96fc0affd0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.287+0000 7f9701a00640 1 --2- 172.21.15.173:0/2629500275 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96fc0aef70 0x7f96fc145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.287+0000 7f9701a00640 1 --2- 172.21.15.173:0/2629500275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96fc0aeb90 0x7f96fc14f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.287+0000 7f9701a00640 1 -- 172.21.15.173:0/2629500275 >> 172.21.15.173:0/2629500275 conn(0x7f96fc06ac90 msgr2=0x7f96fc0ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.287+0000 7f9701a00640 1 -- 172.21.15.173:0/2629500275 shutdown_connections 2024-04-25T09:10:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.287+0000 7f9701a00640 1 -- 172.21.15.173:0/2629500275 wait complete. 2024-04-25T09:10:18.295 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:10:18.295 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:10:18.405 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:10:18.494 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:10:18.494 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:10:18.494 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:18.503 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:10:18.503 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:10:18.503 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:18.512 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:10:18.512 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:10:18.512 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:18.557 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:10:18.557 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:10:18.557 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:18.566 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:10:18.566 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:10:18.566 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:18.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.743+0000 7f02bee00640 1 Processor -- start 2024-04-25T09:10:18.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.743+0000 7f02bee00640 1 -- start start 2024-04-25T09:10:18.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.747+0000 7f02bee00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f02b8144240 0x7f02b80cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.747+0000 7f02bee00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02b80717b0 0x7f02b806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.747+0000 7f02bee00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b80ce080 con 0x7f02b81449b0 2024-04-25T09:10:18.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.747+0000 7f02bee00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b815f3d0 con 0x7f02b8144240 2024-04-25T09:10:18.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.747+0000 7f02bee00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b815f6b0 con 0x7f02b80717b0 2024-04-25T09:10:18.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.747+0000 7f02bda00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f02b8144240 0x7f02b80cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.747+0000 7f02bd000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f02b81449b0 0x7f02b80710a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53362/0 (socket says 172.21.15.173:53362) 2024-04-25T09:10:18.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.747+0000 7f02bd000640 1 -- 172.21.15.173:0/2187447837 learned_addr learned my addr 172.21.15.173:0/2187447837 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:18.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.747+0000 7f02be400640 1 --2- 172.21.15.173:0/2187447837 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02b80717b0 0x7f02b806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.747+0000 7f02bda00640 1 -- 172.21.15.173:0/2187447837 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02b80717b0 msgr2=0x7f02b806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:18.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.747+0000 7f02bda00640 1 --2- 172.21.15.173:0/2187447837 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02b80717b0 0x7f02b806d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.747+0000 7f02bda00640 1 -- 172.21.15.173:0/2187447837 >> v1:172.21.15.173:6789/0 conn(0x7f02b81449b0 legacy=0x7f02b80710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.747+0000 7f02bda00640 1 -- 172.21.15.173:0/2187447837 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b815f990 con 0x7f02b8144240 2024-04-25T09:10:18.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.751+0000 7f02bda00640 1 --2- 172.21.15.173:0/2187447837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02b8144240 0x7f02b80cdb40 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0097c0 tx=0x7f02ac01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc1dfee03a54cdd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:18.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.751+0000 7f02b7e00640 1 -- 172.21.15.173:0/2187447837 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0a7070 con 0x7f02b8144240 2024-04-25T09:10:18.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.751+0000 7f02b7e00640 1 -- 172.21.15.173:0/2187447837 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac0b0070 con 0x7f02b8144240 2024-04-25T09:10:18.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.751+0000 7f02b7e00640 1 -- 172.21.15.173:0/2187447837 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0ab890 con 0x7f02b8144240 2024-04-25T09:10:18.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.751+0000 7f02bee00640 1 -- 172.21.15.173:0/2187447837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02b8144240 msgr2=0x7f02b80cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.751+0000 7f02bee00640 1 --2- 172.21.15.173:0/2187447837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02b8144240 0x7f02b80cdb40 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0097c0 tx=0x7f02ac01c470 comp rx=0 tx=0).stop 2024-04-25T09:10:18.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.751+0000 7f02bee00640 1 -- 172.21.15.173:0/2187447837 shutdown_connections 2024-04-25T09:10:18.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.751+0000 7f02bee00640 1 --2- 172.21.15.173:0/2187447837 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02b80717b0 0x7f02b806d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.751+0000 7f02bee00640 1 --2- 172.21.15.173:0/2187447837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02b8144240 0x7f02b80cdb40 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.751+0000 7f02bee00640 1 -- 172.21.15.173:0/2187447837 >> 172.21.15.173:0/2187447837 conn(0x7f02b806ac90 msgr2=0x7f02b806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:18.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.751+0000 7f02bee00640 1 -- 172.21.15.173:0/2187447837 shutdown_connections 2024-04-25T09:10:18.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.751+0000 7f02bee00640 1 -- 172.21.15.173:0/2187447837 wait complete. 2024-04-25T09:10:18.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.751+0000 7f02bee00640 1 Processor -- start 2024-04-25T09:10:18.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.751+0000 7f02bee00640 1 -- start start 2024-04-25T09:10:18.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bee00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02b80717b0 0x7f02b8156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bee00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02b8144240 0x7f02b8138260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bee00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02b81449b0 0x7f02b8141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bee00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b806e0b0 con 0x7f02b80717b0 2024-04-25T09:10:18.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bee00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b806df30 con 0x7f02b81449b0 2024-04-25T09:10:18.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bee00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b806e230 con 0x7f02b8144240 2024-04-25T09:10:18.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bda00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02b80717b0 0x7f02b8156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bda00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02b80717b0 0x7f02b8156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45364/0 (socket says 172.21.15.173:45364) 2024-04-25T09:10:18.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bda00640 1 -- 172.21.15.173:0/2421463044 learned_addr learned my addr 172.21.15.173:0/2421463044 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:18.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02be400640 1 --2- 172.21.15.173:0/2421463044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02b81449b0 0x7f02b8141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bda00640 1 -- 172.21.15.173:0/2421463044 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02b8144240 msgr2=0x7f02b8138260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bd000640 1 --2- 172.21.15.173:0/2421463044 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02b8144240 0x7f02b8138260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bda00640 1 --2- 172.21.15.173:0/2421463044 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02b8144240 0x7f02b8138260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bda00640 1 -- 172.21.15.173:0/2421463044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02b81449b0 msgr2=0x7f02b8141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bda00640 1 --2- 172.21.15.173:0/2421463044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02b81449b0 0x7f02b8141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bda00640 1 -- 172.21.15.173:0/2421463044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b813a9f0 con 0x7f02b80717b0 2024-04-25T09:10:18.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02be400640 1 --2- 172.21.15.173:0/2421463044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02b81449b0 0x7f02b8141fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:18.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bd000640 1 --2- 172.21.15.173:0/2421463044 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02b8144240 0x7f02b8138260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:18.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bda00640 1 --2- 172.21.15.173:0/2421463044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02b80717b0 0x7f02b8156920 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0ad040 tx=0x7f02ac01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:18.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02b5600640 1 -- 172.21.15.173:0/2421463044 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0bf610 con 0x7f02b80717b0 2024-04-25T09:10:18.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02b5600640 1 -- 172.21.15.173:0/2421463044 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac0bf7d0 con 0x7f02b80717b0 2024-04-25T09:10:18.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bee00640 1 -- 172.21.15.173:0/2421463044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b8155be0 con 0x7f02b80717b0 2024-04-25T09:10:18.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02b5600640 1 -- 172.21.15.173:0/2421463044 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0bfbc0 con 0x7f02b80717b0 2024-04-25T09:10:18.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bee00640 1 -- 172.21.15.173:0/2421463044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b81387a0 con 0x7f02b80717b0 2024-04-25T09:10:18.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02bee00640 1 -- 172.21.15.173:0/2421463044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b8073a40 con 0x7f02b80717b0 2024-04-25T09:10:18.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.755+0000 7f02b5600640 1 -- 172.21.15.173:0/2421463044 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f02ac0bd020 con 0x7f02b80717b0 2024-04-25T09:10:18.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.759+0000 7f02b5600640 1 --2- 172.21.15.173:0/2421463044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0298066f90 0x7f0298069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.759+0000 7f02b5600640 1 -- 172.21.15.173:0/2421463044 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f02ac11f790 con 0x7f02b80717b0 2024-04-25T09:10:18.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.759+0000 7f02bd000640 1 --2- 172.21.15.173:0/2421463044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0298066f90 0x7f0298069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.759+0000 7f02bd000640 1 --2- 172.21.15.173:0/2421463044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0298066f90 0x7f0298069450 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f02a4007fd0 tx=0x7f02a4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:18.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.763+0000 7f02b5600640 1 -- 172.21.15.173:0/2421463044 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f02ac016090 con 0x7f02b80717b0 2024-04-25T09:10:18.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.947+0000 7f02bee00640 1 -- 172.21.15.173:0/2421463044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02b80722b0 con 0x7f02b80717b0 2024-04-25T09:10:18.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.947+0000 7f02b5600640 1 -- 172.21.15.173:0/2421463044 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+3708 (secure 0 0 0) 0x7f02ac0f0a30 con 0x7f02b80717b0 2024-04-25T09:10:18.938 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:18.938 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":67,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/556010437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":556010437},{"type":"v1","addr":"172.21.15.173:6835","nonce":556010437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":6524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4077641924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4077641924},{"type":"v1","addr":"172.21.15.194:6834","nonce":4077641924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7162,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2938501478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2938501478},{"type":"v1","addr":"172.21.15.194:6835","nonce":2938501478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":8103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2498128455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2498128455},{"type":"v1","addr":"172.21.15.173:6837","nonce":2498128455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67}],"filesystems":[]} 2024-04-25T09:10:18.938 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 67 2024-04-25T09:10:18.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.951+0000 7f02bee00640 1 -- 172.21.15.173:0/2421463044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0298066f90 msgr2=0x7f0298069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.951+0000 7f02bee00640 1 --2- 172.21.15.173:0/2421463044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0298066f90 0x7f0298069450 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f02a4007fd0 tx=0x7f02a4009040 comp rx=0 tx=0).stop 2024-04-25T09:10:18.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.951+0000 7f02bee00640 1 -- 172.21.15.173:0/2421463044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02b80717b0 msgr2=0x7f02b8156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.951+0000 7f02bee00640 1 --2- 172.21.15.173:0/2421463044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02b80717b0 0x7f02b8156920 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0ad040 tx=0x7f02ac01acb0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.951+0000 7f02bee00640 1 -- 172.21.15.173:0/2421463044 shutdown_connections 2024-04-25T09:10:18.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.951+0000 7f02bee00640 1 --2- 172.21.15.173:0/2421463044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0298066f90 0x7f0298069450 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.951+0000 7f02bee00640 1 --2- 172.21.15.173:0/2421463044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02b81449b0 0x7f02b8141fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.951+0000 7f02bee00640 1 --2- 172.21.15.173:0/2421463044 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02b8144240 0x7f02b8138260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.951+0000 7f02bee00640 1 --2- 172.21.15.173:0/2421463044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02b80717b0 0x7f02b8156920 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.951+0000 7f02bee00640 1 -- 172.21.15.173:0/2421463044 >> 172.21.15.173:0/2421463044 conn(0x7f02b806ac90 msgr2=0x7f02b8143040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:18.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.951+0000 7f02bee00640 1 -- 172.21.15.173:0/2421463044 shutdown_connections 2024-04-25T09:10:18.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:18.951+0000 7f02bee00640 1 -- 172.21.15.173:0/2421463044 wait complete. 2024-04-25T09:10:18.960 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:10:18.960 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:10:18.960 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:10:18.960 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:10:18.960 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:10:18.960 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:10:18.960 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:10:18.961 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:10:18.961 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:10:18.961 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:10:18.961 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:10:18.961 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:10:18.961 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:10:18.961 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:10:18.961 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:10:18.961 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:10:18.974 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:10:18.974 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:10:18.975 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:10:18.975 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:10:18.976 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:10:18.976 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:10:18.977 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:10:18.977 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:10:19.020 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:10:19.021 DEBUG:teuthology.parallel:result is None 2024-04-25T09:10:19.022 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:10:19.022 DEBUG:teuthology.parallel:result is None 2024-04-25T09:10:19.026 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:10:19.026 DEBUG:teuthology.parallel:result is None 2024-04-25T09:10:19.027 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:10:19.027 DEBUG:teuthology.parallel:result is None 2024-04-25T09:10:19.028 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:10:19.107 INFO:tasks.ceph.mds.c.smithi173.stdout:starting mds.c at 2024-04-25T09:10:19.108 INFO:tasks.ceph.mds.a.smithi173.stdout:starting mds.a at 2024-04-25T09:10:19.115 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-04-25T09:10:19.117 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-04-25T09:10:19.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.183+0000 7f1a5aa00640 1 Processor -- start 2024-04-25T09:10:19.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.183+0000 7f1a5aa00640 1 -- start start 2024-04-25T09:10:19.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.183+0000 7f1a5aa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1a54145290 0x7f1a5415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.183+0000 7f1a5aa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a540b3fe0 0x7f1a540b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.187+0000 7f1a5aa00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5415c5f0 con 0x7f1a540cc260 2024-04-25T09:10:19.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.187+0000 7f1a5aa00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5406d4b0 con 0x7f1a54145290 2024-04-25T09:10:19.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.187+0000 7f1a5aa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5406d790 con 0x7f1a540b3fe0 2024-04-25T09:10:19.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.187+0000 7f1a58a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f1a540cc260 0x7f1a540cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53388/0 (socket says 172.21.15.173:53388) 2024-04-25T09:10:19.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.187+0000 7f1a58a00640 1 -- 172.21.15.173:0/488740683 learned_addr learned my addr 172.21.15.173:0/488740683 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:19.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.187+0000 7f1a53e00640 1 --2- 172.21.15.173:0/488740683 >> v2:172.21.15.194:3300/0 conn(0x7f1a54145290 0x7f1a5415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.187+0000 7f1a4b400640 1 --2- 172.21.15.173:0/488740683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a540b3fe0 0x7f1a540b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.187+0000 7f1a53400640 1 -- 172.21.15.173:0/488740683 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173436988 0 0) 0x7f1a4c0014a0 con 0x7f1a540cc260 2024-04-25T09:10:19.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.187+0000 7f1a53400640 1 -- 172.21.15.173:0/488740683 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a38003530 con 0x7f1a540cc260 2024-04-25T09:10:19.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.187+0000 7f1a53e00640 1 -- 172.21.15.173:0/488740683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a540b3fe0 msgr2=0x7f1a540b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:19.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.187+0000 7f1a53e00640 1 --2- 172.21.15.173:0/488740683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a540b3fe0 0x7f1a540b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.187+0000 7f1a53e00640 1 -- 172.21.15.173:0/488740683 >> v1:172.21.15.173:6789/0 conn(0x7f1a540cc260 legacy=0x7f1a540cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.187+0000 7f1a53e00640 1 -- 172.21.15.173:0/488740683 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5406da70 con 0x7f1a54145290 2024-04-25T09:10:19.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a53e00640 1 --2- 172.21.15.173:0/488740683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a54145290 0x7f1a5415c0b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0097c0 tx=0x7f1a3c01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c49adf1894f160bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:19.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a53400640 1 -- 172.21.15.173:0/488740683 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0b0070 con 0x7f1a54145290 2024-04-25T09:10:19.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a53400640 1 -- 172.21.15.173:0/488740683 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c0ab600 con 0x7f1a54145290 2024-04-25T09:10:19.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a53400640 1 -- 172.21.15.173:0/488740683 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0ab9d0 con 0x7f1a54145290 2024-04-25T09:10:19.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a5aa00640 1 -- 172.21.15.173:0/488740683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a54145290 msgr2=0x7f1a5415c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a5aa00640 1 --2- 172.21.15.173:0/488740683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a54145290 0x7f1a5415c0b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0097c0 tx=0x7f1a3c01c380 comp rx=0 tx=0).stop 2024-04-25T09:10:19.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a5aa00640 1 -- 172.21.15.173:0/488740683 shutdown_connections 2024-04-25T09:10:19.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a5aa00640 1 --2- 172.21.15.173:0/488740683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a540b3fe0 0x7f1a540b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a5aa00640 1 --2- 172.21.15.173:0/488740683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a54145290 0x7f1a5415c0b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a5aa00640 1 -- 172.21.15.173:0/488740683 >> 172.21.15.173:0/488740683 conn(0x7f1a5406ac90 msgr2=0x7f1a5406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:19.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a5aa00640 1 -- 172.21.15.173:0/488740683 shutdown_connections 2024-04-25T09:10:19.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a5aa00640 1 -- 172.21.15.173:0/488740683 wait complete. 2024-04-25T09:10:19.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a5aa00640 1 Processor -- start 2024-04-25T09:10:19.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a5aa00640 1 -- start start 2024-04-25T09:10:19.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a5aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a540b3fe0 0x7f1a54159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a5aa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a540cc260 0x7f1a5415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a5aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a54145290 0x7f1a541354a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a5aa00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5406eee0 con 0x7f1a54145290 2024-04-25T09:10:19.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a5aa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5406ed60 con 0x7f1a540b3fe0 2024-04-25T09:10:19.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a5aa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5406f060 con 0x7f1a540cc260 2024-04-25T09:10:19.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a58a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a54145290 0x7f1a541354a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a58a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a54145290 0x7f1a541354a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45420/0 (socket says 172.21.15.173:45420) 2024-04-25T09:10:19.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a58a00640 1 -- 172.21.15.173:0/2059003773 learned_addr learned my addr 172.21.15.173:0/2059003773 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:19.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a53e00640 1 --2- 172.21.15.173:0/2059003773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a540b3fe0 0x7f1a54159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.191+0000 7f1a4b400640 1 --2- 172.21.15.173:0/2059003773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a540cc260 0x7f1a5415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.195+0000 7f1a58a00640 1 -- 172.21.15.173:0/2059003773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a540cc260 msgr2=0x7f1a5415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.195+0000 7f1a58a00640 1 --2- 172.21.15.173:0/2059003773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a540cc260 0x7f1a5415b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.195+0000 7f1a58a00640 1 -- 172.21.15.173:0/2059003773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a540b3fe0 msgr2=0x7f1a54159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.195+0000 7f1a58a00640 1 --2- 172.21.15.173:0/2059003773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a540b3fe0 0x7f1a54159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.195+0000 7f1a58a00640 1 -- 172.21.15.173:0/2059003773 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a54136240 con 0x7f1a54145290 2024-04-25T09:10:19.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.195+0000 7f1a53e00640 1 --2- 172.21.15.173:0/2059003773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a540b3fe0 0x7f1a54159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:19.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.195+0000 7f1a58a00640 1 --2- 172.21.15.173:0/2059003773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a54145290 0x7f1a541354a0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00cb10 tx=0x7f1a4c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:19.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.195+0000 7f1a50c00640 1 -- 172.21.15.173:0/2059003773 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c017070 con 0x7f1a54145290 2024-04-25T09:10:19.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.195+0000 7f1a50c00640 1 -- 172.21.15.173:0/2059003773 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c00ac10 con 0x7f1a54145290 2024-04-25T09:10:19.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.195+0000 7f1a50c00640 1 -- 172.21.15.173:0/2059003773 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c012400 con 0x7f1a54145290 2024-04-25T09:10:19.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.195+0000 7f1a5aa00640 1 -- 172.21.15.173:0/2059003773 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a54135f60 con 0x7f1a54145290 2024-04-25T09:10:19.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.195+0000 7f1a5aa00640 1 -- 172.21.15.173:0/2059003773 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5415a8e0 con 0x7f1a54145290 2024-04-25T09:10:19.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.195+0000 7f1a5aa00640 1 -- 172.21.15.173:0/2059003773 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a54073ab0 con 0x7f1a54145290 2024-04-25T09:10:19.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.195+0000 7f1a50c00640 1 -- 172.21.15.173:0/2059003773 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1a4c01a070 con 0x7f1a54145290 2024-04-25T09:10:19.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.195+0000 7f1a50c00640 1 --2- 172.21.15.173:0/2059003773 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1a30066f60 0x7f1a30069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.195+0000 7f1a50c00640 1 -- 172.21.15.173:0/2059003773 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f1a4c084c00 con 0x7f1a54145290 2024-04-25T09:10:19.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.195+0000 7f1a53e00640 1 --2- 172.21.15.173:0/2059003773 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1a30066f60 0x7f1a30069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.199+0000 7f1a53e00640 1 --2- 172.21.15.173:0/2059003773 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1a30066f60 0x7f1a30069420 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0ad000 tx=0x7f1a3c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:19.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.199+0000 7f1a50c00640 1 -- 172.21.15.173:0/2059003773 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1a5415c5f0 con 0x7f1a54145290 2024-04-25T09:10:19.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:19.367+0000 7f1a5aa00640 1 -- 172.21.15.173:0/2059003773 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1a5413ecf0 con 0x7f1a54145290 2024-04-25T09:10:20.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.295+0000 7f1a50c00640 1 -- 172.21.15.173:0/2059003773 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v105) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1a4c055690 con 0x7f1a54145290 2024-04-25T09:10:20.286 INFO:teuthology.orchestra.run.smithi173.stderr: removed all blocklist entries 2024-04-25T09:10:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.299+0000 7f1a5aa00640 1 -- 172.21.15.173:0/2059003773 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1a30066f60 msgr2=0x7f1a30069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.299+0000 7f1a5aa00640 1 --2- 172.21.15.173:0/2059003773 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1a30066f60 0x7f1a30069420 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0ad000 tx=0x7f1a3c008040 comp rx=0 tx=0).stop 2024-04-25T09:10:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.299+0000 7f1a5aa00640 1 -- 172.21.15.173:0/2059003773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a54145290 msgr2=0x7f1a541354a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.299+0000 7f1a5aa00640 1 --2- 172.21.15.173:0/2059003773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a54145290 0x7f1a541354a0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00cb10 tx=0x7f1a4c00a060 comp rx=0 tx=0).stop 2024-04-25T09:10:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.299+0000 7f1a5aa00640 1 -- 172.21.15.173:0/2059003773 shutdown_connections 2024-04-25T09:10:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.299+0000 7f1a5aa00640 1 --2- 172.21.15.173:0/2059003773 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1a30066f60 0x7f1a30069420 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.299+0000 7f1a5aa00640 1 --2- 172.21.15.173:0/2059003773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a54145290 0x7f1a541354a0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.299+0000 7f1a5aa00640 1 --2- 172.21.15.173:0/2059003773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a540cc260 0x7f1a5415b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.299+0000 7f1a5aa00640 1 --2- 172.21.15.173:0/2059003773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a540b3fe0 0x7f1a54159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.299+0000 7f1a5aa00640 1 -- 172.21.15.173:0/2059003773 >> 172.21.15.173:0/2059003773 conn(0x7f1a5406ac90 msgr2=0x7f1a540cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.299+0000 7f1a5aa00640 1 -- 172.21.15.173:0/2059003773 shutdown_connections 2024-04-25T09:10:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.299+0000 7f1a5aa00640 1 -- 172.21.15.173:0/2059003773 wait complete. 2024-04-25T09:10:20.309 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:10:20.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.455+0000 7f64a4a00640 1 Processor -- start 2024-04-25T09:10:20.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.455+0000 7f64a4a00640 1 -- start start 2024-04-25T09:10:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.455+0000 7f64a4a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f64a00b3e70 0x7f64a00b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.455+0000 7f64a4a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a015edd0 0x7f64a00b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.455+0000 7f64a4a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a00b4790 con 0x7f64a00aefa0 2024-04-25T09:10:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.455+0000 7f64a4a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a006dd50 con 0x7f64a00b3e70 2024-04-25T09:10:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.455+0000 7f64a4a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a015f320 con 0x7f64a015edd0 2024-04-25T09:10:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.455+0000 7f649de00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f64a00b3e70 0x7f64a00b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.455+0000 7f649de00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f64a00b3e70 0x7f64a00b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45424/0 (socket says 172.21.15.173:45424) 2024-04-25T09:10:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.455+0000 7f649de00640 1 -- 172.21.15.173:0/996247579 learned_addr learned my addr 172.21.15.173:0/996247579 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:20.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.459+0000 7f649e800640 1 --2- 172.21.15.173:0/996247579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a015edd0 0x7f64a00b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.459+0000 7f649de00640 1 -- 172.21.15.173:0/996247579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a015edd0 msgr2=0x7f64a00b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:20.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.459+0000 7f649de00640 1 --2- 172.21.15.173:0/996247579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a015edd0 0x7f64a00b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.459+0000 7f649de00640 1 -- 172.21.15.173:0/996247579 >> v1:172.21.15.194:6789/0 conn(0x7f64a00aefa0 legacy=0x7f64a00b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.459+0000 7f649de00640 1 -- 172.21.15.173:0/996247579 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a006d420 con 0x7f64a00b3e70 2024-04-25T09:10:20.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.459+0000 7f649de00640 1 --2- 172.21.15.173:0/996247579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a00b3e70 0x7f64a00b4250 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f6490009870 tx=0x7f649001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abba4df5f9c22873 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:20.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.459+0000 7f649ca00640 1 -- 172.21.15.173:0/996247579 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64900a9610 con 0x7f64a00b3e70 2024-04-25T09:10:20.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.459+0000 7f649ca00640 1 -- 172.21.15.173:0/996247579 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64900a97b0 con 0x7f64a00b3e70 2024-04-25T09:10:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.459+0000 7f649ca00640 1 -- 172.21.15.173:0/996247579 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64900a9b80 con 0x7f64a00b3e70 2024-04-25T09:10:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f64a4a00640 1 -- 172.21.15.173:0/996247579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a00b3e70 msgr2=0x7f64a00b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f64a4a00640 1 --2- 172.21.15.173:0/996247579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a00b3e70 0x7f64a00b4250 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f6490009870 tx=0x7f649001c530 comp rx=0 tx=0).stop 2024-04-25T09:10:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f64a4a00640 1 -- 172.21.15.173:0/996247579 shutdown_connections 2024-04-25T09:10:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f64a4a00640 1 --2- 172.21.15.173:0/996247579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a015edd0 0x7f64a00b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f64a4a00640 1 --2- 172.21.15.173:0/996247579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a00b3e70 0x7f64a00b4250 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f64a4a00640 1 -- 172.21.15.173:0/996247579 >> 172.21.15.173:0/996247579 conn(0x7f64a006ac90 msgr2=0x7f64a006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:20.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f64a4a00640 1 -- 172.21.15.173:0/996247579 shutdown_connections 2024-04-25T09:10:20.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f64a4a00640 1 -- 172.21.15.173:0/996247579 wait complete. 2024-04-25T09:10:20.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f64a4a00640 1 Processor -- start 2024-04-25T09:10:20.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f64a4a00640 1 -- start start 2024-04-25T09:10:20.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f64a4a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a00aefa0 0x7f64a01466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f64a4a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a00b3e70 0x7f64a00cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f64a4a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a015edd0 0x7f64a014ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f64a4a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a006e1e0 con 0x7f64a00b3e70 2024-04-25T09:10:20.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f64a4a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a015aba0 con 0x7f64a015edd0 2024-04-25T09:10:20.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f64a4a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a006e360 con 0x7f64a00aefa0 2024-04-25T09:10:20.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f649d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a00b3e70 0x7f64a00cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f649d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a00b3e70 0x7f64a00cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45436/0 (socket says 172.21.15.173:45436) 2024-04-25T09:10:20.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f649d400640 1 -- 172.21.15.173:0/821809540 learned_addr learned my addr 172.21.15.173:0/821809540 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:20.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f649e800640 1 --2- 172.21.15.173:0/821809540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a015edd0 0x7f64a014ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f649de00640 1 --2- 172.21.15.173:0/821809540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a00aefa0 0x7f64a01466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f649d400640 1 -- 172.21.15.173:0/821809540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a00aefa0 msgr2=0x7f64a01466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f649d400640 1 --2- 172.21.15.173:0/821809540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a00aefa0 0x7f64a01466b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f649d400640 1 -- 172.21.15.173:0/821809540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a015edd0 msgr2=0x7f64a014ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f649d400640 1 --2- 172.21.15.173:0/821809540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a015edd0 0x7f64a014ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f649d400640 1 -- 172.21.15.173:0/821809540 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a00cbfc0 con 0x7f64a00b3e70 2024-04-25T09:10:20.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f649de00640 1 --2- 172.21.15.173:0/821809540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a00aefa0 0x7f64a01466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:20.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f649e800640 1 --2- 172.21.15.173:0/821809540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a015edd0 0x7f64a014ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:20.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.463+0000 7f649d400640 1 --2- 172.21.15.173:0/821809540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a00b3e70 0x7f64a00cba80 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f648c00c370 tx=0x7f648c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:20.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.467+0000 7f6496000640 1 -- 172.21.15.173:0/821809540 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c0052d0 con 0x7f64a00b3e70 2024-04-25T09:10:20.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.467+0000 7f6496000640 1 -- 172.21.15.173:0/821809540 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c005470 con 0x7f64a00b3e70 2024-04-25T09:10:20.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.467+0000 7f6496000640 1 -- 172.21.15.173:0/821809540 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c007260 con 0x7f64a00b3e70 2024-04-25T09:10:20.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.467+0000 7f64a4a00640 1 -- 172.21.15.173:0/821809540 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a014bf50 con 0x7f64a00b3e70 2024-04-25T09:10:20.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.467+0000 7f64a4a00640 1 -- 172.21.15.173:0/821809540 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a01511d0 con 0x7f64a00b3e70 2024-04-25T09:10:20.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.467+0000 7f64a4a00640 1 -- 172.21.15.173:0/821809540 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a0073a40 con 0x7f64a00b3e70 2024-04-25T09:10:20.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.467+0000 7f6496000640 1 -- 172.21.15.173:0/821809540 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f648c007400 con 0x7f64a00b3e70 2024-04-25T09:10:20.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.467+0000 7f6496000640 1 --2- 172.21.15.173:0/821809540 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6480066f60 0x7f6480069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.467+0000 7f6496000640 1 -- 172.21.15.173:0/821809540 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f648c084370 con 0x7f64a00b3e70 2024-04-25T09:10:20.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.467+0000 7f649de00640 1 --2- 172.21.15.173:0/821809540 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6480066f60 0x7f6480069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.467+0000 7f649de00640 1 --2- 172.21.15.173:0/821809540 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6480066f60 0x7f6480069420 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f64900ae000 tx=0x7f6490009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:20.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.471+0000 7f6496000640 1 -- 172.21.15.173:0/821809540 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f648c0554a0 con 0x7f64a00b3e70 2024-04-25T09:10:20.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.679+0000 7f64a4a00640 1 -- 172.21.15.173:0/821809540 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f64a006e540 con 0x7f64a00b3e70 2024-04-25T09:10:20.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.679+0000 7f6496000640 1 -- 172.21.15.173:0/821809540 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f648c054da0 con 0x7f64a00b3e70 2024-04-25T09:10:20.668 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:20.669 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:10:20.669 INFO:teuthology.orchestra.run.smithi173.stdout: "auth_dump": [ 2024-04-25T09:10:20.669 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.669 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.a", 2024-04-25T09:10:20.669 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmnVr3EhAAn+C0Mb/MrYSZuQyr5QTXig==", 2024-04-25T09:10:20.669 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.669 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:10:20.669 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:10:20.669 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:10:20.669 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:10:20.669 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.669 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:10:20.669 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.670 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.b", 2024-04-25T09:10:20.670 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6Gypm0QfFHhAAuP8xE/8pvSZMcP8N33OB9Q==", 2024-04-25T09:10:20.670 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.670 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:10:20.670 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:10:20.670 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:10:20.670 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:10:20.670 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.670 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:10:20.670 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.670 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.c", 2024-04-25T09:10:20.670 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmQsv4GRAATNiD7udOvl8xRDIx64O5jg==", 2024-04-25T09:10:20.670 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.671 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:10:20.671 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:10:20.671 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:10:20.671 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:10:20.671 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.671 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:10:20.671 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.671 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.d", 2024-04-25T09:10:20.671 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmtGMSJhAAonqLeuSsNrgyZks1eoJ1Gg==", 2024-04-25T09:10:20.671 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.671 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:10:20.671 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:10:20.671 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:10:20.671 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:10:20.671 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.672 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:10:20.672 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.672 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.0", 2024-04-25T09:10:20.672 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD9Gypm+Yw7LBAAnOFUKU3w1ltre7aHMWZ/SQ==", 2024-04-25T09:10:20.672 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.672 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:20.672 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:10:20.672 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:10:20.672 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.672 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:10:20.672 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.672 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.1", 2024-04-25T09:10:20.672 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAAHCpm4BUIOBAAmbfWUWCun/una5WoemhL6Q==", 2024-04-25T09:10:20.672 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.673 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:20.673 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:10:20.673 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:10:20.673 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.673 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:10:20.673 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.673 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.2", 2024-04-25T09:10:20.673 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAEHCpmFXIaBRAA0cN2GdLSS3jJC+x4RVUUlw==", 2024-04-25T09:10:20.673 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.673 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:20.673 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:10:20.673 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:10:20.673 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.673 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:10:20.673 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.674 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.3", 2024-04-25T09:10:20.674 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAHHCpmUD+YDxAALPvf1wLzhuQmFPo3/vJkdQ==", 2024-04-25T09:10:20.674 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.674 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:20.674 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:10:20.674 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:10:20.674 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.674 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:10:20.674 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.674 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.4", 2024-04-25T09:10:20.674 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQANHCpmLQ0fCBAA1Shz0Pfns+rj5r601hzOnQ==", 2024-04-25T09:10:20.674 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.674 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:20.674 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:10:20.675 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:10:20.675 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:10:20.675 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.675 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.5", 2024-04-25T09:10:20.675 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAQHCpmyMj1ERAAMRvZ3PFQa9oe6oGemLvfxw==", 2024-04-25T09:10:20.675 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.675 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:20.675 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:10:20.675 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:10:20.675 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:10:20.675 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.675 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.6", 2024-04-25T09:10:20.676 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQATHCpmKha6GxAAF4zfdFDlylGHHhGI5tVpGA==", 2024-04-25T09:10:20.676 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.676 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:20.676 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:10:20.676 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:10:20.676 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.676 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:10:20.676 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.676 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.7", 2024-04-25T09:10:20.676 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAWHCpmB2lFJhAA3sYYsjS5DIC5fCDz6ur0tA==", 2024-04-25T09:10:20.676 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.676 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:20.676 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:10:20.677 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:10:20.677 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.677 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:10:20.677 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.677 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.0", 2024-04-25T09:10:20.677 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w==", 2024-04-25T09:10:20.677 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.677 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:10:20.677 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow r", 2024-04-25T09:10:20.677 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:10:20.677 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.677 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:10:20.677 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.677 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.1", 2024-04-25T09:10:20.677 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6Gypm1PbHMxAAXMrgpR/xgzfQuuNrculQxA==", 2024-04-25T09:10:20.678 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.678 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:10:20.678 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:10:20.678 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:10:20.678 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:10:20.678 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.678 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:10:20.678 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.678 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.2", 2024-04-25T09:10:20.678 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmrTxjMBAAaqwDl5uiLxhaDIk7m6oDIw==", 2024-04-25T09:10:20.678 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.678 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:10:20.678 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:10:20.678 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:10:20.679 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:10:20.679 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.679 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:10:20.679 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.679 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.3", 2024-04-25T09:10:20.679 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmlAS9ORAAvYbwLnUaDHXOqvEBwJJJcQ==", 2024-04-25T09:10:20.679 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.679 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:10:20.679 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:10:20.679 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:10:20.679 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:10:20.679 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.679 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:10:20.679 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.679 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.admin", 2024-04-25T09:10:20.680 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD5GypmYFhkMhAACwSsE+B9l263vnlJ0LjFkQ==", 2024-04-25T09:10:20.680 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.680 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:10:20.680 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:10:20.680 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:10:20.680 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:10:20.680 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.680 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:10:20.680 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.680 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mgr.x", 2024-04-25T09:10:20.680 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmMSqHDhAAe0nkrXbT7dBbAbI89ExUmw==", 2024-04-25T09:10:20.680 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.680 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:10:20.680 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile mgr", 2024-04-25T09:10:20.681 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:10:20.681 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.681 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:10:20.681 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:20.681 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mgr.y", 2024-04-25T09:10:20.681 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmjCuzChAAomjH5vLVICqSFpyDVQeB4w==", 2024-04-25T09:10:20.681 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:10:20.681 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:10:20.681 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile mgr", 2024-04-25T09:10:20.681 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:10:20.681 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.681 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:20.681 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-04-25T09:10:20.681 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:10:20.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.683+0000 7f64a4a00640 1 -- 172.21.15.173:0/821809540 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6480066f60 msgr2=0x7f6480069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.683+0000 7f64a4a00640 1 --2- 172.21.15.173:0/821809540 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6480066f60 0x7f6480069420 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f64900ae000 tx=0x7f6490009040 comp rx=0 tx=0).stop 2024-04-25T09:10:20.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.683+0000 7f64a4a00640 1 -- 172.21.15.173:0/821809540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a00b3e70 msgr2=0x7f64a00cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.683+0000 7f64a4a00640 1 --2- 172.21.15.173:0/821809540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a00b3e70 0x7f64a00cba80 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f648c00c370 tx=0x7f648c00c830 comp rx=0 tx=0).stop 2024-04-25T09:10:20.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.683+0000 7f64a4a00640 1 -- 172.21.15.173:0/821809540 shutdown_connections 2024-04-25T09:10:20.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.683+0000 7f64a4a00640 1 --2- 172.21.15.173:0/821809540 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6480066f60 0x7f6480069420 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.683+0000 7f64a4a00640 1 --2- 172.21.15.173:0/821809540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64a015edd0 0x7f64a014ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.683+0000 7f64a4a00640 1 --2- 172.21.15.173:0/821809540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a00b3e70 0x7f64a00cba80 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.683+0000 7f64a4a00640 1 --2- 172.21.15.173:0/821809540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64a00aefa0 0x7f64a01466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.683+0000 7f64a4a00640 1 -- 172.21.15.173:0/821809540 >> 172.21.15.173:0/821809540 conn(0x7f64a006ac90 msgr2=0x7f64a0157620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:20.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.683+0000 7f64a4a00640 1 -- 172.21.15.173:0/821809540 shutdown_connections 2024-04-25T09:10:20.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.683+0000 7f64a4a00640 1 -- 172.21.15.173:0/821809540 wait complete. 2024-04-25T09:10:20.689 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:20.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.839+0000 7f6e4fe00640 1 Processor -- start 2024-04-25T09:10:20.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.839+0000 7f6e4fe00640 1 -- start start 2024-04-25T09:10:20.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.839+0000 7f6e4fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e5006fd80 0x7f6e500cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.839+0000 7f6e4fe00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e500cf6d0 con 0x7f6e5006b3a0 2024-04-25T09:10:20.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.839+0000 7f6e4fe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e500cbf60 con 0x7f6e5006e270 2024-04-25T09:10:20.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.839+0000 7f6e4fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e500cf970 con 0x7f6e5006fd80 2024-04-25T09:10:20.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.839+0000 7f6e4f400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f6e5006b3a0 0x7f6e5015d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53394/0 (socket says 172.21.15.173:53394) 2024-04-25T09:10:20.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.839+0000 7f6e4f400640 1 -- 172.21.15.173:0/1841140012 learned_addr learned my addr 172.21.15.173:0/1841140012 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.839+0000 7f6e4ea00640 1 --2- 172.21.15.173:0/1841140012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e5006fd80 0x7f6e500cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.839+0000 7f6e4d600640 1 -- 172.21.15.173:0/1841140012 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979707306 0 0) 0x7f6e500cbf60 con 0x7f6e5006e270 2024-04-25T09:10:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.839+0000 7f6e4d600640 1 -- 172.21.15.173:0/1841140012 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e34003530 con 0x7f6e5006e270 2024-04-25T09:10:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.839+0000 7f6e4ea00640 1 -- 172.21.15.173:0/1841140012 >> v1:172.21.15.194:6789/0 conn(0x7f6e5006e270 legacy=0x7f6e5006ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.839+0000 7f6e4ea00640 1 -- 172.21.15.173:0/1841140012 >> v1:172.21.15.173:6789/0 conn(0x7f6e5006b3a0 legacy=0x7f6e5015d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.839+0000 7f6e4ea00640 1 -- 172.21.15.173:0/1841140012 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e500cfc50 con 0x7f6e5006fd80 2024-04-25T09:10:20.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.843+0000 7f6e4ea00640 1 --2- 172.21.15.173:0/1841140012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e5006fd80 0x7f6e500cb4e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6e400097f0 tx=0x7f6e4001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41c6acec2dec0a49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:20.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.843+0000 7f6e4d600640 1 -- 172.21.15.173:0/1841140012 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e400b0070 con 0x7f6e5006fd80 2024-04-25T09:10:20.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.843+0000 7f6e4d600640 1 -- 172.21.15.173:0/1841140012 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e400ab600 con 0x7f6e5006fd80 2024-04-25T09:10:20.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.843+0000 7f6e4d600640 1 -- 172.21.15.173:0/1841140012 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e400ab9d0 con 0x7f6e5006fd80 2024-04-25T09:10:20.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.843+0000 7f6e4fe00640 1 -- 172.21.15.173:0/1841140012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e5006fd80 msgr2=0x7f6e500cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.843+0000 7f6e4fe00640 1 --2- 172.21.15.173:0/1841140012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e5006fd80 0x7f6e500cb4e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6e400097f0 tx=0x7f6e4001c4e0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.843+0000 7f6e4fe00640 1 -- 172.21.15.173:0/1841140012 shutdown_connections 2024-04-25T09:10:20.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.843+0000 7f6e4fe00640 1 --2- 172.21.15.173:0/1841140012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e5006fd80 0x7f6e500cb4e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.843+0000 7f6e4fe00640 1 -- 172.21.15.173:0/1841140012 >> 172.21.15.173:0/1841140012 conn(0x7f6e50072710 msgr2=0x7f6e50099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:20.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.843+0000 7f6e4fe00640 1 -- 172.21.15.173:0/1841140012 shutdown_connections 2024-04-25T09:10:20.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.843+0000 7f6e4fe00640 1 -- 172.21.15.173:0/1841140012 wait complete. 2024-04-25T09:10:20.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.843+0000 7f6e4fe00640 1 Processor -- start 2024-04-25T09:10:20.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4fe00640 1 -- start start 2024-04-25T09:10:20.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e5006b3a0 0x7f6e50153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e5006e270 0x7f6e501570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e5006fd80 0x7f6e501575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4fe00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5016b980 con 0x7f6e5006e270 2024-04-25T09:10:20.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4fe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e50070370 con 0x7f6e5006fd80 2024-04-25T09:10:20.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5016bb00 con 0x7f6e5006b3a0 2024-04-25T09:10:20.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e5006e270 0x7f6e501570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e5006e270 0x7f6e501570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45442/0 (socket says 172.21.15.173:45442) 2024-04-25T09:10:20.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4e000640 1 -- 172.21.15.173:0/3091937111 learned_addr learned my addr 172.21.15.173:0/3091937111 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:20.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4ea00640 1 --2- 172.21.15.173:0/3091937111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e5006b3a0 0x7f6e50153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4f400640 1 --2- 172.21.15.173:0/3091937111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e5006fd80 0x7f6e501575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4e000640 1 -- 172.21.15.173:0/3091937111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e5006b3a0 msgr2=0x7f6e50153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4e000640 1 --2- 172.21.15.173:0/3091937111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e5006b3a0 0x7f6e50153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4e000640 1 -- 172.21.15.173:0/3091937111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e5006fd80 msgr2=0x7f6e501575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4e000640 1 --2- 172.21.15.173:0/3091937111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e5006fd80 0x7f6e501575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4e000640 1 -- 172.21.15.173:0/3091937111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5015ff40 con 0x7f6e5006e270 2024-04-25T09:10:20.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4e000640 1 --2- 172.21.15.173:0/3091937111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e5006e270 0x7f6e501570b0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00c410 tx=0x7f6e3c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:20.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e46a00640 1 -- 172.21.15.173:0/3091937111 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c017070 con 0x7f6e5006e270 2024-04-25T09:10:20.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e46a00640 1 -- 172.21.15.173:0/3091937111 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c0052f0 con 0x7f6e5006e270 2024-04-25T09:10:20.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e46a00640 1 -- 172.21.15.173:0/3091937111 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c003840 con 0x7f6e5006e270 2024-04-25T09:10:20.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4fe00640 1 -- 172.21.15.173:0/3091937111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e50160220 con 0x7f6e5006e270 2024-04-25T09:10:20.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4fe00640 1 -- 172.21.15.173:0/3091937111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e500c8820 con 0x7f6e5006e270 2024-04-25T09:10:20.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.847+0000 7f6e4fe00640 1 -- 172.21.15.173:0/3091937111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e50073a40 con 0x7f6e5006e270 2024-04-25T09:10:20.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.851+0000 7f6e46a00640 1 -- 172.21.15.173:0/3091937111 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6e3c01a070 con 0x7f6e5006e270 2024-04-25T09:10:20.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.851+0000 7f6e46a00640 1 --2- 172.21.15.173:0/3091937111 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6e30066f60 0x7f6e30069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.851+0000 7f6e46a00640 1 -- 172.21.15.173:0/3091937111 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f6e3c0841e0 con 0x7f6e5006e270 2024-04-25T09:10:20.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.851+0000 7f6e4ea00640 1 --2- 172.21.15.173:0/3091937111 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6e30066f60 0x7f6e30069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.851+0000 7f6e4ea00640 1 --2- 172.21.15.173:0/3091937111 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6e30066f60 0x7f6e30069420 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6e400ad000 tx=0x7f6e400a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:20.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:20.855+0000 7f6e46a00640 1 -- 172.21.15.173:0/3091937111 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6e3c054d50 con 0x7f6e5006e270 2024-04-25T09:10:20.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.007+0000 7f6e4fe00640 1 -- 172.21.15.173:0/3091937111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e500cd0a0 con 0x7f6e5006e270 2024-04-25T09:10:20.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.011+0000 7f6e46a00640 1 -- 172.21.15.173:0/3091937111 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+13226 (secure 0 0 0) 0x7f6e3c058df0 con 0x7f6e5006e270 2024-04-25T09:10:20.999 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:20.999 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":105,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:10:20.300409+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:21.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.011+0000 7f6e4fe00640 1 -- 172.21.15.173:0/3091937111 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6e30066f60 msgr2=0x7f6e30069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.011+0000 7f6e4fe00640 1 --2- 172.21.15.173:0/3091937111 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6e30066f60 0x7f6e30069420 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6e400ad000 tx=0x7f6e400a6000 comp rx=0 tx=0).stop 2024-04-25T09:10:21.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.011+0000 7f6e4fe00640 1 -- 172.21.15.173:0/3091937111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e5006e270 msgr2=0x7f6e501570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.011+0000 7f6e4fe00640 1 --2- 172.21.15.173:0/3091937111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e5006e270 0x7f6e501570b0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00c410 tx=0x7f6e3c00c8d0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.011+0000 7f6e4fe00640 1 -- 172.21.15.173:0/3091937111 shutdown_connections 2024-04-25T09:10:21.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.011+0000 7f6e4fe00640 1 --2- 172.21.15.173:0/3091937111 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6e30066f60 0x7f6e30069420 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.011+0000 7f6e4fe00640 1 --2- 172.21.15.173:0/3091937111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e5006fd80 0x7f6e501575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.011+0000 7f6e4fe00640 1 --2- 172.21.15.173:0/3091937111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e5006e270 0x7f6e501570b0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.011+0000 7f6e4fe00640 1 --2- 172.21.15.173:0/3091937111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e5006b3a0 0x7f6e50153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.011+0000 7f6e4fe00640 1 -- 172.21.15.173:0/3091937111 >> 172.21.15.173:0/3091937111 conn(0x7f6e50072710 msgr2=0x7f6e5006e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.011+0000 7f6e4fe00640 1 -- 172.21.15.173:0/3091937111 shutdown_connections 2024-04-25T09:10:21.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.011+0000 7f6e4fe00640 1 -- 172.21.15.173:0/3091937111 wait complete. 2024-04-25T09:10:21.021 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:10:21.021 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:10:21.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.171+0000 7f0f12000640 1 Processor -- start 2024-04-25T09:10:21.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.171+0000 7f0f12000640 1 -- start start 2024-04-25T09:10:21.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.175+0000 7f0f12000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0f0c1452f0 0x7f0f0c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.175+0000 7f0f12000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0f0c0ce420 0x7f0f0c0ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.175+0000 7f0f12000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0c0720a0 con 0x7f0f0c144f10 2024-04-25T09:10:21.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.175+0000 7f0f12000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0c0cedd0 con 0x7f0f0c1452f0 2024-04-25T09:10:21.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.175+0000 7f0f12000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0c15fa40 con 0x7f0f0c0ce420 2024-04-25T09:10:21.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.175+0000 7f0f0be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0f0c1452f0 0x7f0f0c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.175+0000 7f0f10c00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f0f0c144f10 0x7f0f0c06ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53410/0 (socket says 172.21.15.173:53410) 2024-04-25T09:10:21.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.175+0000 7f0f10c00640 1 -- 172.21.15.173:0/158005074 learned_addr learned my addr 172.21.15.173:0/158005074 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:21.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.175+0000 7f0f0be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0f0c1452f0 0x7f0f0c15f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45458/0 (socket says 172.21.15.173:45458) 2024-04-25T09:10:21.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.175+0000 7f0f11600640 1 --2- 172.21.15.173:0/158005074 >> v2:172.21.15.194:3300/0 conn(0x7f0f0c0ce420 0x7f0f0c0ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.175+0000 7f0f0be00640 1 -- 172.21.15.173:0/158005074 >> v2:172.21.15.194:3300/0 conn(0x7f0f0c0ce420 msgr2=0x7f0f0c0ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.175+0000 7f0f0be00640 1 --2- 172.21.15.173:0/158005074 >> v2:172.21.15.194:3300/0 conn(0x7f0f0c0ce420 0x7f0f0c0ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.175+0000 7f0f0be00640 1 -- 172.21.15.173:0/158005074 >> v1:172.21.15.173:6789/0 conn(0x7f0f0c144f10 legacy=0x7f0f0c06ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.175+0000 7f0f0be00640 1 -- 172.21.15.173:0/158005074 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c071490 con 0x7f0f0c1452f0 2024-04-25T09:10:21.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.175+0000 7f0f0b400640 1 -- 172.21.15.173:0/158005074 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368155607 0 0) 0x7f0f0c0720a0 con 0x7f0f0c144f10 2024-04-25T09:10:21.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.175+0000 7f0f11600640 1 --2- 172.21.15.173:0/158005074 >> v2:172.21.15.194:3300/0 conn(0x7f0f0c0ce420 0x7f0f0c0ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:21.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f0be00640 1 --2- 172.21.15.173:0/158005074 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f0c1452f0 0x7f0f0c15f500 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c071210 tx=0x7f0ef801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4e0815f0b36229 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f0b400640 1 -- 172.21.15.173:0/158005074 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80b0070 con 0x7f0f0c1452f0 2024-04-25T09:10:21.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f0b400640 1 -- 172.21.15.173:0/158005074 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef80ab600 con 0x7f0f0c1452f0 2024-04-25T09:10:21.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f0b400640 1 -- 172.21.15.173:0/158005074 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80ab9d0 con 0x7f0f0c1452f0 2024-04-25T09:10:21.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f12000640 1 -- 172.21.15.173:0/158005074 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f0c1452f0 msgr2=0x7f0f0c15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f12000640 1 --2- 172.21.15.173:0/158005074 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f0c1452f0 0x7f0f0c15f500 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c071210 tx=0x7f0ef801c480 comp rx=0 tx=0).stop 2024-04-25T09:10:21.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f12000640 1 -- 172.21.15.173:0/158005074 shutdown_connections 2024-04-25T09:10:21.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f12000640 1 --2- 172.21.15.173:0/158005074 >> v2:172.21.15.194:3300/0 conn(0x7f0f0c0ce420 0x7f0f0c0ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f12000640 1 --2- 172.21.15.173:0/158005074 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f0c1452f0 0x7f0f0c15f500 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f12000640 1 -- 172.21.15.173:0/158005074 >> 172.21.15.173:0/158005074 conn(0x7f0f0c061d40 msgr2=0x7f0f0c06ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f12000640 1 -- 172.21.15.173:0/158005074 shutdown_connections 2024-04-25T09:10:21.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f12000640 1 -- 172.21.15.173:0/158005074 wait complete. 2024-04-25T09:10:21.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f12000640 1 Processor -- start 2024-04-25T09:10:21.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f12000640 1 -- start start 2024-04-25T09:10:21.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f12000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f0c0ce420 0x7f0f0c13b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f12000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f0c144f10 0x7f0f0c13fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f12000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f0c1452f0 0x7f0f0c1402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f12000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c15ca30 con 0x7f0f0c0ce420 2024-04-25T09:10:21.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f12000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c06e6c0 con 0x7f0f0c1452f0 2024-04-25T09:10:21.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f12000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c15cbb0 con 0x7f0f0c144f10 2024-04-25T09:10:21.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.179+0000 7f0f10c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f0c0ce420 0x7f0f0c13b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f10c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f0c0ce420 0x7f0f0c13b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45464/0 (socket says 172.21.15.173:45464) 2024-04-25T09:10:21.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f10c00640 1 -- 172.21.15.173:0/3383321709 learned_addr learned my addr 172.21.15.173:0/3383321709 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:21.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f11600640 1 --2- 172.21.15.173:0/3383321709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f0c1452f0 0x7f0f0c1402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f0be00640 1 --2- 172.21.15.173:0/3383321709 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f0c144f10 0x7f0f0c13fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f10c00640 1 -- 172.21.15.173:0/3383321709 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f0c144f10 msgr2=0x7f0f0c13fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f10c00640 1 --2- 172.21.15.173:0/3383321709 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f0c144f10 0x7f0f0c13fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f10c00640 1 -- 172.21.15.173:0/3383321709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f0c1452f0 msgr2=0x7f0f0c1402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f10c00640 1 --2- 172.21.15.173:0/3383321709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f0c1452f0 0x7f0f0c1402c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f10c00640 1 -- 172.21.15.173:0/3383321709 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c143a10 con 0x7f0f0c0ce420 2024-04-25T09:10:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f0be00640 1 --2- 172.21.15.173:0/3383321709 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f0c144f10 0x7f0f0c13fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f11600640 1 --2- 172.21.15.173:0/3383321709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f0c1452f0 0x7f0f0c1402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f10c00640 1 --2- 172.21.15.173:0/3383321709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f0c0ce420 0x7f0f0c13b130 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f0efc001570 tx=0x7f0efc00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f08c00640 1 -- 172.21.15.173:0/3383321709 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc018070 con 0x7f0f0c0ce420 2024-04-25T09:10:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f08c00640 1 -- 172.21.15.173:0/3383321709 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc00a640 con 0x7f0f0c0ce420 2024-04-25T09:10:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f12000640 1 -- 172.21.15.173:0/3383321709 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0c13c980 con 0x7f0f0c0ce420 2024-04-25T09:10:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f08c00640 1 -- 172.21.15.173:0/3383321709 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc00aa30 con 0x7f0f0c0ce420 2024-04-25T09:10:21.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f12000640 1 -- 172.21.15.173:0/3383321709 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0c13b670 con 0x7f0f0c0ce420 2024-04-25T09:10:21.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f12000640 1 -- 172.21.15.173:0/3383321709 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0c073a40 con 0x7f0f0c0ce420 2024-04-25T09:10:21.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f08c00640 1 -- 172.21.15.173:0/3383321709 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0efc01b070 con 0x7f0f0c0ce420 2024-04-25T09:10:21.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f08c00640 1 --2- 172.21.15.173:0/3383321709 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0eec066f60 0x7f0eec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.183+0000 7f0f08c00640 1 -- 172.21.15.173:0/3383321709 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f0efc0844b0 con 0x7f0f0c0ce420 2024-04-25T09:10:21.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.187+0000 7f0f0be00640 1 --2- 172.21.15.173:0/3383321709 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0eec066f60 0x7f0eec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.187+0000 7f0f0be00640 1 --2- 172.21.15.173:0/3383321709 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0eec066f60 0x7f0eec069420 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80ad000 tx=0x7f0ef80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.187+0000 7f0f08c00640 1 -- 172.21.15.173:0/3383321709 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0efc055710 con 0x7f0f0c0ce420 2024-04-25T09:10:21.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.343+0000 7f0f12000640 1 -- 172.21.15.173:0/3383321709 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f0c15ab80 con 0x7f0f0c0ce420 2024-04-25T09:10:21.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.347+0000 7f0f08c00640 1 -- 172.21.15.173:0/3383321709 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v105) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0efc055010 con 0x7f0f0c0ce420 2024-04-25T09:10:21.335 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:10:21.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.347+0000 7f0f12000640 1 -- 172.21.15.173:0/3383321709 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0eec066f60 msgr2=0x7f0eec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.347+0000 7f0f12000640 1 --2- 172.21.15.173:0/3383321709 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0eec066f60 0x7f0eec069420 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80ad000 tx=0x7f0ef80a6000 comp rx=0 tx=0).stop 2024-04-25T09:10:21.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.347+0000 7f0f12000640 1 -- 172.21.15.173:0/3383321709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f0c0ce420 msgr2=0x7f0f0c13b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.347+0000 7f0f12000640 1 --2- 172.21.15.173:0/3383321709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f0c0ce420 0x7f0f0c13b130 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f0efc001570 tx=0x7f0efc00cd20 comp rx=0 tx=0).stop 2024-04-25T09:10:21.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.347+0000 7f0f12000640 1 -- 172.21.15.173:0/3383321709 shutdown_connections 2024-04-25T09:10:21.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.347+0000 7f0f12000640 1 --2- 172.21.15.173:0/3383321709 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0eec066f60 0x7f0eec069420 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.347+0000 7f0f12000640 1 --2- 172.21.15.173:0/3383321709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f0c1452f0 0x7f0f0c1402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.347+0000 7f0f12000640 1 --2- 172.21.15.173:0/3383321709 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f0c144f10 0x7f0f0c13fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.347+0000 7f0f12000640 1 --2- 172.21.15.173:0/3383321709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f0c0ce420 0x7f0f0c13b130 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.347+0000 7f0f12000640 1 -- 172.21.15.173:0/3383321709 >> 172.21.15.173:0/3383321709 conn(0x7f0f0c061d40 msgr2=0x7f0f0c15b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.347+0000 7f0f12000640 1 -- 172.21.15.173:0/3383321709 shutdown_connections 2024-04-25T09:10:21.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.347+0000 7f0f12000640 1 -- 172.21.15.173:0/3383321709 wait complete. 2024-04-25T09:10:21.356 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:10:21.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.503+0000 7f7650000640 1 Processor -- start 2024-04-25T09:10:21.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.503+0000 7f7650000640 1 -- start start 2024-04-25T09:10:21.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.503+0000 7f7650000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f764815ba20 0x7f764815be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.503+0000 7f7650000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7648070070 0x7f76480d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.503+0000 7f7650000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764815c460 con 0x7f76480b70f0 2024-04-25T09:10:21.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.503+0000 7f7650000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764815c740 con 0x7f7648070070 2024-04-25T09:10:21.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.503+0000 7f7650000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764815ca20 con 0x7f764815ba20 2024-04-25T09:10:21.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.503+0000 7f764e000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7648070070 0x7f76480d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.503+0000 7f764cc00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f76480b70f0 0x7f764806f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53420/0 (socket says 172.21.15.173:53420) 2024-04-25T09:10:21.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.503+0000 7f764e000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7648070070 0x7f76480d1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45470/0 (socket says 172.21.15.173:45470) 2024-04-25T09:10:21.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.503+0000 7f764cc00640 1 -- 172.21.15.173:0/587194734 learned_addr learned my addr 172.21.15.173:0/587194734 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:21.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.503+0000 7f764d600640 1 --2- 172.21.15.173:0/587194734 >> v2:172.21.15.194:3300/0 conn(0x7f764815ba20 0x7f764815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.503+0000 7f764e000640 1 -- 172.21.15.173:0/587194734 >> v2:172.21.15.194:3300/0 conn(0x7f764815ba20 msgr2=0x7f764815be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.503+0000 7f764e000640 1 --2- 172.21.15.173:0/587194734 >> v2:172.21.15.194:3300/0 conn(0x7f764815ba20 0x7f764815be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.503+0000 7f764e000640 1 -- 172.21.15.173:0/587194734 >> v1:172.21.15.173:6789/0 conn(0x7f76480b70f0 legacy=0x7f764806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.503+0000 7f764e000640 1 -- 172.21.15.173:0/587194734 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764815cd00 con 0x7f7648070070 2024-04-25T09:10:21.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.507+0000 7f764e000640 1 --2- 172.21.15.173:0/587194734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7648070070 0x7f76480d1a80 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f76400097c0 tx=0x7f764001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab61181c398adc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.507+0000 7f7647e00640 1 -- 172.21.15.173:0/587194734 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76400ab650 con 0x7f7648070070 2024-04-25T09:10:21.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.507+0000 7f7647e00640 1 -- 172.21.15.173:0/587194734 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76400b0070 con 0x7f7648070070 2024-04-25T09:10:21.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.507+0000 7f7647e00640 1 -- 172.21.15.173:0/587194734 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76400aba10 con 0x7f7648070070 2024-04-25T09:10:21.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.507+0000 7f7650000640 1 -- 172.21.15.173:0/587194734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7648070070 msgr2=0x7f76480d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.507+0000 7f7650000640 1 --2- 172.21.15.173:0/587194734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7648070070 0x7f76480d1a80 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f76400097c0 tx=0x7f764001c430 comp rx=0 tx=0).stop 2024-04-25T09:10:21.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.507+0000 7f7650000640 1 -- 172.21.15.173:0/587194734 shutdown_connections 2024-04-25T09:10:21.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.507+0000 7f7650000640 1 --2- 172.21.15.173:0/587194734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7648070070 0x7f76480d1a80 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.507+0000 7f7650000640 1 --2- 172.21.15.173:0/587194734 >> v2:172.21.15.194:3300/0 conn(0x7f764815ba20 0x7f764815be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.507+0000 7f7650000640 1 -- 172.21.15.173:0/587194734 >> 172.21.15.173:0/587194734 conn(0x7f7648061880 msgr2=0x7f7648061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.507+0000 7f7650000640 1 -- 172.21.15.173:0/587194734 shutdown_connections 2024-04-25T09:10:21.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.507+0000 7f7650000640 1 -- 172.21.15.173:0/587194734 wait complete. 2024-04-25T09:10:21.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f7650000640 1 Processor -- start 2024-04-25T09:10:21.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f7650000640 1 -- start start 2024-04-25T09:10:21.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f7650000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7648070070 0x7f76480c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f7650000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76480b70f0 0x7f76480c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f7650000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f764815ba20 0x7f76480c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f7650000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764815e2b0 con 0x7f764815ba20 2024-04-25T09:10:21.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f7650000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764815e130 con 0x7f7648070070 2024-04-25T09:10:21.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f7650000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764815e430 con 0x7f76480b70f0 2024-04-25T09:10:21.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f764e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f764815ba20 0x7f76480c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f764e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f764815ba20 0x7f76480c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45472/0 (socket says 172.21.15.173:45472) 2024-04-25T09:10:21.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f764e000640 1 -- 172.21.15.173:0/853131304 learned_addr learned my addr 172.21.15.173:0/853131304 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:21.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f764d600640 1 --2- 172.21.15.173:0/853131304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7648070070 0x7f76480c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f764cc00640 1 --2- 172.21.15.173:0/853131304 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76480b70f0 0x7f76480c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f764e000640 1 -- 172.21.15.173:0/853131304 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76480b70f0 msgr2=0x7f76480c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f764e000640 1 --2- 172.21.15.173:0/853131304 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76480b70f0 0x7f76480c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f764e000640 1 -- 172.21.15.173:0/853131304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7648070070 msgr2=0x7f76480c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f764e000640 1 --2- 172.21.15.173:0/853131304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7648070070 0x7f76480c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f764e000640 1 -- 172.21.15.173:0/853131304 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76480ad5c0 con 0x7f764815ba20 2024-04-25T09:10:21.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f764e000640 1 --2- 172.21.15.173:0/853131304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f764815ba20 0x7f76480c9360 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f76400ad040 tx=0x7f764001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f7645600640 1 -- 172.21.15.173:0/853131304 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76400bf610 con 0x7f764815ba20 2024-04-25T09:10:21.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f7645600640 1 -- 172.21.15.173:0/853131304 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76400bf7b0 con 0x7f764815ba20 2024-04-25T09:10:21.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f7645600640 1 -- 172.21.15.173:0/853131304 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76400bfb80 con 0x7f764815ba20 2024-04-25T09:10:21.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f7650000640 1 -- 172.21.15.173:0/853131304 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76480ad8a0 con 0x7f764815ba20 2024-04-25T09:10:21.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.511+0000 7f7650000640 1 -- 172.21.15.173:0/853131304 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76480ade60 con 0x7f764815ba20 2024-04-25T09:10:21.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.515+0000 7f7650000640 1 -- 172.21.15.173:0/853131304 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7648073a40 con 0x7f764815ba20 2024-04-25T09:10:21.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.515+0000 7f7645600640 1 -- 172.21.15.173:0/853131304 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f76400bd020 con 0x7f764815ba20 2024-04-25T09:10:21.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.515+0000 7f7645600640 1 --2- 172.21.15.173:0/853131304 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7628066f60 0x7f7628069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.515+0000 7f7645600640 1 -- 172.21.15.173:0/853131304 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f764011f3b0 con 0x7f764815ba20 2024-04-25T09:10:21.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.515+0000 7f764d600640 1 --2- 172.21.15.173:0/853131304 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7628066f60 0x7f7628069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.515+0000 7f764d600640 1 --2- 172.21.15.173:0/853131304 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7628066f60 0x7f7628069420 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f76480afd70 tx=0x7f763c009830 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.519+0000 7f7645600640 1 -- 172.21.15.173:0/853131304 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f76400c6030 con 0x7f764815ba20 2024-04-25T09:10:21.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.675+0000 7f7650000640 1 -- 172.21.15.173:0/853131304 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f76480d0260 con 0x7f764815ba20 2024-04-25T09:10:21.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.675+0000 7f7645600640 1 -- 172.21.15.173:0/853131304 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v105) v1 ==== 84+0+65 (secure 0 0 0) 0x7f764011de20 con 0x7f764815ba20 2024-04-25T09:10:21.665 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:21.665 INFO:teuthology.orchestra.run.smithi173.stdout:[ 2024-04-25T09:10:21.665 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:10:21.665 INFO:teuthology.orchestra.run.smithi173.stdout: "poolnum": 1, 2024-04-25T09:10:21.666 INFO:teuthology.orchestra.run.smithi173.stdout: "poolname": ".mgr" 2024-04-25T09:10:21.666 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:21.666 INFO:teuthology.orchestra.run.smithi173.stdout:] 2024-04-25T09:10:21.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.679+0000 7f7650000640 1 -- 172.21.15.173:0/853131304 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7628066f60 msgr2=0x7f7628069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.679+0000 7f7650000640 1 --2- 172.21.15.173:0/853131304 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7628066f60 0x7f7628069420 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f76480afd70 tx=0x7f763c009830 comp rx=0 tx=0).stop 2024-04-25T09:10:21.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.679+0000 7f7650000640 1 -- 172.21.15.173:0/853131304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f764815ba20 msgr2=0x7f76480c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.679+0000 7f7650000640 1 --2- 172.21.15.173:0/853131304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f764815ba20 0x7f76480c9360 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f76400ad040 tx=0x7f764001ac70 comp rx=0 tx=0).stop 2024-04-25T09:10:21.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.679+0000 7f7650000640 1 -- 172.21.15.173:0/853131304 shutdown_connections 2024-04-25T09:10:21.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.679+0000 7f7650000640 1 --2- 172.21.15.173:0/853131304 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7628066f60 0x7f7628069420 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.679+0000 7f7650000640 1 --2- 172.21.15.173:0/853131304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f764815ba20 0x7f76480c9360 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.679+0000 7f7650000640 1 --2- 172.21.15.173:0/853131304 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76480b70f0 0x7f76480c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.679+0000 7f7650000640 1 --2- 172.21.15.173:0/853131304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7648070070 0x7f76480c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.679+0000 7f7650000640 1 -- 172.21.15.173:0/853131304 >> 172.21.15.173:0/853131304 conn(0x7f7648061880 msgr2=0x7f764815acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.679+0000 7f7650000640 1 -- 172.21.15.173:0/853131304 shutdown_connections 2024-04-25T09:10:21.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.679+0000 7f7650000640 1 -- 172.21.15.173:0/853131304 wait complete. 2024-04-25T09:10:21.686 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:10:21.686 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:10:21.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.839+0000 7fc381800640 1 Processor -- start 2024-04-25T09:10:21.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.839+0000 7fc381800640 1 -- start start 2024-04-25T09:10:21.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.839+0000 7fc381800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc37c0b3fe0 0x7fc37c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.839+0000 7fc381800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c06d4b0 con 0x7fc37c0cc260 2024-04-25T09:10:21.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.839+0000 7fc381800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c06d790 con 0x7fc37c145290 2024-04-25T09:10:21.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.839+0000 7fc381800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37c0ccd80 con 0x7fc37c0b3fe0 2024-04-25T09:10:21.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.839+0000 7fc37b400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc37c0cc260 0x7fc37c0cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53428/0 (socket says 172.21.15.173:53428) 2024-04-25T09:10:21.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.839+0000 7fc37b400640 1 -- 172.21.15.173:0/3922127569 learned_addr learned my addr 172.21.15.173:0/3922127569 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:21.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.839+0000 7fc37a000640 1 --2- 172.21.15.173:0/3922127569 >> v2:172.21.15.194:3300/0 conn(0x7fc37c0b3fe0 0x7fc37c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.839+0000 7fc379600640 1 -- 172.21.15.173:0/3922127569 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990412937 0 0) 0x7fc37c06d4b0 con 0x7fc37c0cc260 2024-04-25T09:10:21.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.839+0000 7fc379600640 1 -- 172.21.15.173:0/3922127569 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc360003530 con 0x7fc37c0cc260 2024-04-25T09:10:21.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.839+0000 7fc379600640 1 -- 172.21.15.173:0/3922127569 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1126414529 0 0) 0x7fc360003530 con 0x7fc37c0cc260 2024-04-25T09:10:21.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.839+0000 7fc379600640 1 -- 172.21.15.173:0/3922127569 >> v2:172.21.15.194:3300/0 conn(0x7fc37c0b3fe0 msgr2=0x7fc37c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.839+0000 7fc379600640 1 --2- 172.21.15.173:0/3922127569 >> v2:172.21.15.194:3300/0 conn(0x7fc37c0b3fe0 0x7fc37c0b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.839+0000 7fc379600640 1 -- 172.21.15.173:0/3922127569 >> v1:172.21.15.194:6789/0 conn(0x7fc37c145290 legacy=0x7fc37c15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.839+0000 7fc379600640 1 -- 172.21.15.173:0/3922127569 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c06da70 con 0x7fc37c0cc260 2024-04-25T09:10:21.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.839+0000 7fc379600640 1 -- 172.21.15.173:0/3922127569 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fc374001a00 con 0x7fc37c0cc260 2024-04-25T09:10:21.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.839+0000 7fc379600640 1 -- 172.21.15.173:0/3922127569 >> v1:172.21.15.173:6789/0 conn(0x7fc37c0cc260 legacy=0x7fc37c0cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc379600640 1 --2- 172.21.15.173:0/3922127569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc360003a10 0x7fc360003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc379600640 1 --2- 172.21.15.173:0/3922127569 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc360004810 0x7fc360004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc379600640 1 --2- 172.21.15.173:0/3922127569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3600052f0 0x7fc36000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc379600640 1 -- 172.21.15.173:0/3922127569 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0ccd80 con 0x7fc3600052f0 2024-04-25T09:10:21.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc379600640 1 -- 172.21.15.173:0/3922127569 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36000c1f0 con 0x7fc360003a10 2024-04-25T09:10:21.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc379600640 1 -- 172.21.15.173:0/3922127569 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36000c3f0 con 0x7fc360004810 2024-04-25T09:10:21.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc37b400640 1 --2- 172.21.15.173:0/3922127569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3600052f0 0x7fc36000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc37aa00640 1 --2- 172.21.15.173:0/3922127569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc360003a10 0x7fc360003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc37a000640 1 --2- 172.21.15.173:0/3922127569 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc360004810 0x7fc360004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc37b400640 1 -- 172.21.15.173:0/3922127569 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc360004810 msgr2=0x7fc360004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc37b400640 1 --2- 172.21.15.173:0/3922127569 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc360004810 0x7fc360004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc37b400640 1 -- 172.21.15.173:0/3922127569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc360003a10 msgr2=0x7fc360003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc37b400640 1 --2- 172.21.15.173:0/3922127569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc360003a10 0x7fc360003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc37b400640 1 -- 172.21.15.173:0/3922127569 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc360003530 con 0x7fc3600052f0 2024-04-25T09:10:21.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc37b400640 1 -- 172.21.15.173:0/3922127569 reap_dead start 2024-04-25T09:10:21.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc37b400640 1 --2- 172.21.15.173:0/3922127569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3600052f0 0x7fc36000b9d0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fc37400a770 tx=0x7fc37401d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d16d412f737709 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc379600640 1 -- 172.21.15.173:0/3922127569 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37400a390 con 0x7fc3600052f0 2024-04-25T09:10:21.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc379600640 1 -- 172.21.15.173:0/3922127569 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3740ac420 con 0x7fc3600052f0 2024-04-25T09:10:21.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.843+0000 7fc379600640 1 -- 172.21.15.173:0/3922127569 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3740ac830 con 0x7fc3600052f0 2024-04-25T09:10:21.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc381800640 1 -- 172.21.15.173:0/3922127569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3600052f0 msgr2=0x7fc36000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc381800640 1 --2- 172.21.15.173:0/3922127569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3600052f0 0x7fc36000b9d0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fc37400a770 tx=0x7fc37401d2a0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc381800640 1 -- 172.21.15.173:0/3922127569 shutdown_connections 2024-04-25T09:10:21.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc381800640 1 --2- 172.21.15.173:0/3922127569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3600052f0 0x7fc36000b9d0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc381800640 1 -- 172.21.15.173:0/3922127569 >> 172.21.15.173:0/3922127569 conn(0x7fc37c06ac90 msgr2=0x7fc37c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc381800640 1 -- 172.21.15.173:0/3922127569 shutdown_connections 2024-04-25T09:10:21.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc381800640 1 -- 172.21.15.173:0/3922127569 wait complete. 2024-04-25T09:10:21.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc381800640 1 Processor -- start 2024-04-25T09:10:21.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc381800640 1 -- start start 2024-04-25T09:10:21.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc381800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3600052f0 0x7fc37c1f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc381800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c13f940 0x7fc37c15b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc381800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc37c0afaa0 0x7fc37c0aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc381800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0b43f0 con 0x7fc3600052f0 2024-04-25T09:10:21.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc381800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0b4570 con 0x7fc37c0afaa0 2024-04-25T09:10:21.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc381800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0b46f0 con 0x7fc37c13f940 2024-04-25T09:10:21.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc37aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3600052f0 0x7fc37c1f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc37aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3600052f0 0x7fc37c1f2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45496/0 (socket says 172.21.15.173:45496) 2024-04-25T09:10:21.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc37aa00640 1 -- 172.21.15.173:0/2571507418 learned_addr learned my addr 172.21.15.173:0/2571507418 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:21.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc37aa00640 1 -- 172.21.15.173:0/2571507418 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c13f940 msgr2=0x7fc37c15b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc37aa00640 1 --2- 172.21.15.173:0/2571507418 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c13f940 0x7fc37c15b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc37aa00640 1 -- 172.21.15.173:0/2571507418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc37c0afaa0 msgr2=0x7fc37c0aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc37aa00640 1 --2- 172.21.15.173:0/2571507418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc37c0afaa0 0x7fc37c0aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc37aa00640 1 -- 172.21.15.173:0/2571507418 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c13fdc0 con 0x7fc3600052f0 2024-04-25T09:10:21.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc37aa00640 1 --2- 172.21.15.173:0/2571507418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3600052f0 0x7fc37c1f2f20 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00f7f0 tx=0x7fc36c00fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.847+0000 7fc372a00640 1 -- 172.21.15.173:0/2571507418 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c0050d0 con 0x7fc3600052f0 2024-04-25T09:10:21.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.851+0000 7fc372a00640 1 -- 172.21.15.173:0/2571507418 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36c018070 con 0x7fc3600052f0 2024-04-25T09:10:21.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.851+0000 7fc372a00640 1 -- 172.21.15.173:0/2571507418 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c005490 con 0x7fc3600052f0 2024-04-25T09:10:21.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.851+0000 7fc381800640 1 -- 172.21.15.173:0/2571507418 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37c13f2f0 con 0x7fc3600052f0 2024-04-25T09:10:21.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.851+0000 7fc381800640 1 -- 172.21.15.173:0/2571507418 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37c1f2440 con 0x7fc3600052f0 2024-04-25T09:10:21.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.851+0000 7fc381800640 1 -- 172.21.15.173:0/2571507418 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37c073ab0 con 0x7fc3600052f0 2024-04-25T09:10:21.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.851+0000 7fc372a00640 1 -- 172.21.15.173:0/2571507418 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc36c00d730 con 0x7fc3600052f0 2024-04-25T09:10:21.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.851+0000 7fc372a00640 1 --2- 172.21.15.173:0/2571507418 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc35c067100 0x7fc35c0695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.851+0000 7fc372a00640 1 -- 172.21.15.173:0/2571507418 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fc36c084bf0 con 0x7fc3600052f0 2024-04-25T09:10:21.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.851+0000 7fc37a000640 1 --2- 172.21.15.173:0/2571507418 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc35c067100 0x7fc35c0695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.851+0000 7fc37a000640 1 --2- 172.21.15.173:0/2571507418 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc35c067100 0x7fc35c0695c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc37c1e4e30 tx=0x7fc368009340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:21.855+0000 7fc372a00640 1 -- 172.21.15.173:0/2571507418 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc37c13fdc0 con 0x7fc3600052f0 2024-04-25T09:10:22.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:22.011+0000 7fc381800640 1 -- 172.21.15.173:0/2571507418 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc37c0af580 con 0x7fc3600052f0 2024-04-25T09:10:22.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:22.959+0000 7fc372a00640 1 -- 172.21.15.173:0/2571507418 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v106) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc36c055e50 con 0x7fc3600052f0 2024-04-25T09:10:22.948 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' created 2024-04-25T09:10:22.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:22.963+0000 7fc381800640 1 -- 172.21.15.173:0/2571507418 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc35c067100 msgr2=0x7fc35c0695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:22.963+0000 7fc381800640 1 --2- 172.21.15.173:0/2571507418 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc35c067100 0x7fc35c0695c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc37c1e4e30 tx=0x7fc368009340 comp rx=0 tx=0).stop 2024-04-25T09:10:22.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:22.963+0000 7fc381800640 1 -- 172.21.15.173:0/2571507418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3600052f0 msgr2=0x7fc37c1f2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:22.963+0000 7fc381800640 1 --2- 172.21.15.173:0/2571507418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3600052f0 0x7fc37c1f2f20 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00f7f0 tx=0x7fc36c00fcb0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:22.963+0000 7fc381800640 1 -- 172.21.15.173:0/2571507418 shutdown_connections 2024-04-25T09:10:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:22.963+0000 7fc381800640 1 --2- 172.21.15.173:0/2571507418 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc35c067100 0x7fc35c0695c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:22.963+0000 7fc381800640 1 --2- 172.21.15.173:0/2571507418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc37c0afaa0 0x7fc37c0aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:22.963+0000 7fc381800640 1 --2- 172.21.15.173:0/2571507418 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c13f940 0x7fc37c15b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:22.963+0000 7fc381800640 1 --2- 172.21.15.173:0/2571507418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3600052f0 0x7fc37c1f2f20 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:22.963+0000 7fc381800640 1 -- 172.21.15.173:0/2571507418 >> 172.21.15.173:0/2571507418 conn(0x7fc37c06ac90 msgr2=0x7fc37c0cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:22.963+0000 7fc381800640 1 -- 172.21.15.173:0/2571507418 shutdown_connections 2024-04-25T09:10:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:22.963+0000 7fc381800640 1 -- 172.21.15.173:0/2571507418 wait complete. 2024-04-25T09:10:22.978 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:10:23.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.135+0000 7f9d80e00640 1 Processor -- start 2024-04-25T09:10:23.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.135+0000 7f9d80e00640 1 -- start start 2024-04-25T09:10:23.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d80e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d7c06d200 0x7f9d7c0b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d80e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9d7c09a160 0x7f9d7c0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d80e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c0d1490 con 0x7f9d7c15e120 2024-04-25T09:10:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d80e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7c0d0bf0 con 0x7f9d7c09a160 2024-04-25T09:10:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d80e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0d0ed0 con 0x7f9d7c06d200 2024-04-25T09:10:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d79e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f9d7c15e120 0x7f9d7c099a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:53436/0 (socket says 172.21.15.173:53436) 2024-04-25T09:10:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d79e00640 1 -- 172.21.15.173:0/2919362856 learned_addr learned my addr 172.21.15.173:0/2919362856 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d79400640 1 --2- 172.21.15.173:0/2919362856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d7c06d200 0x7f9d7c0b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d78a00640 1 -- 172.21.15.173:0/2919362856 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132270961 0 0) 0x7f9d7c0d1490 con 0x7f9d7c15e120 2024-04-25T09:10:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d7a800640 1 --2- 172.21.15.173:0/2919362856 >> v2:172.21.15.194:3300/0 conn(0x7f9d7c09a160 0x7f9d7c0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d78a00640 1 -- 172.21.15.173:0/2919362856 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d60003530 con 0x7f9d7c15e120 2024-04-25T09:10:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d78a00640 1 -- 172.21.15.173:0/2919362856 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2863938732 0 0) 0x7f9d60003530 con 0x7f9d7c15e120 2024-04-25T09:10:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d78a00640 1 -- 172.21.15.173:0/2919362856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d7c06d200 msgr2=0x7f9d7c0b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d78a00640 1 --2- 172.21.15.173:0/2919362856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d7c06d200 0x7f9d7c0b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d78a00640 1 -- 172.21.15.173:0/2919362856 >> v2:172.21.15.194:3300/0 conn(0x7f9d7c09a160 msgr2=0x7f9d7c0cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d78a00640 1 --2- 172.21.15.173:0/2919362856 >> v2:172.21.15.194:3300/0 conn(0x7f9d7c09a160 0x7f9d7c0cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d78a00640 1 -- 172.21.15.173:0/2919362856 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c0d11b0 con 0x7f9d7c15e120 2024-04-25T09:10:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d78a00640 1 -- 172.21.15.173:0/2919362856 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f9d6c001a00 con 0x7f9d7c15e120 2024-04-25T09:10:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d78a00640 1 -- 172.21.15.173:0/2919362856 >> v1:172.21.15.173:6789/0 conn(0x7f9d7c15e120 legacy=0x7f9d7c099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d78a00640 1 --2- 172.21.15.173:0/2919362856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d600039c0 0x7f9d60003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d78a00640 1 --2- 172.21.15.173:0/2919362856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d7c06d200 0x7f9d60004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d78a00640 1 --2- 172.21.15.173:0/2919362856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d60004d50 0x7f9d600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d78a00640 1 -- 172.21.15.173:0/2919362856 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0d0bf0 con 0x7f9d600039c0 2024-04-25T09:10:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d78a00640 1 -- 172.21.15.173:0/2919362856 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0d0ed0 con 0x7f9d60004d50 2024-04-25T09:10:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d78a00640 1 -- 172.21.15.173:0/2919362856 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6000b9d0 con 0x7f9d7c06d200 2024-04-25T09:10:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d79e00640 1 --2- 172.21.15.173:0/2919362856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d600039c0 0x7f9d60003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d79400640 1 --2- 172.21.15.173:0/2919362856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d7c06d200 0x7f9d60004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d7a800640 1 --2- 172.21.15.173:0/2919362856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d60004d50 0x7f9d600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d79e00640 1 -- 172.21.15.173:0/2919362856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d7c06d200 msgr2=0x7f9d60004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d79e00640 1 --2- 172.21.15.173:0/2919362856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d7c06d200 0x7f9d60004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d79e00640 1 -- 172.21.15.173:0/2919362856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d60004d50 msgr2=0x7f9d600051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d79e00640 1 --2- 172.21.15.173:0/2919362856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d60004d50 0x7f9d600051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.139+0000 7f9d79e00640 1 -- 172.21.15.173:0/2919362856 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d60003530 con 0x7f9d600039c0 2024-04-25T09:10:23.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.143+0000 7f9d79e00640 1 --2- 172.21.15.173:0/2919362856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d600039c0 0x7f9d60003de0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00a8a0 tx=0x7f9d6c01d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66f7b340848a57a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.143+0000 7f9d78a00640 1 -- 172.21.15.173:0/2919362856 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c00a4c0 con 0x7f9d600039c0 2024-04-25T09:10:23.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.143+0000 7f9d78a00640 1 -- 172.21.15.173:0/2919362856 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c0ad650 con 0x7f9d600039c0 2024-04-25T09:10:23.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.143+0000 7f9d78a00640 1 -- 172.21.15.173:0/2919362856 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c0ada40 con 0x7f9d600039c0 2024-04-25T09:10:23.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.143+0000 7f9d80e00640 1 -- 172.21.15.173:0/2919362856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d600039c0 msgr2=0x7f9d60003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.143+0000 7f9d80e00640 1 --2- 172.21.15.173:0/2919362856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d600039c0 0x7f9d60003de0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00a8a0 tx=0x7f9d6c01d3c0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.143+0000 7f9d7a800640 1 -- 172.21.15.173:0/2919362856 reap_dead start 2024-04-25T09:10:23.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.143+0000 7f9d80e00640 1 -- 172.21.15.173:0/2919362856 shutdown_connections 2024-04-25T09:10:23.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.143+0000 7f9d80e00640 1 -- 172.21.15.173:0/2919362856 >> 172.21.15.173:0/2919362856 conn(0x7f9d7c0b32a0 msgr2=0x7f9d7c0b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:23.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.143+0000 7f9d80e00640 1 -- 172.21.15.173:0/2919362856 shutdown_connections 2024-04-25T09:10:23.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.143+0000 7f9d80e00640 1 -- 172.21.15.173:0/2919362856 wait complete. 2024-04-25T09:10:23.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.143+0000 7f9d80e00640 1 Processor -- start 2024-04-25T09:10:23.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.143+0000 7f9d80e00640 1 -- start start 2024-04-25T09:10:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d80e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d600039c0 0x7f9d7c149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d80e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d7c0c7f70 0x7f9d7c0c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d80e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c163e10 0x7f9d7c159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d80e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0cd510 con 0x7f9d600039c0 2024-04-25T09:10:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d80e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0cd390 con 0x7f9d7c163e10 2024-04-25T09:10:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d80e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0cd690 con 0x7f9d7c0c7f70 2024-04-25T09:10:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d79e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d600039c0 0x7f9d7c149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d79e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d600039c0 0x7f9d7c149a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:45512/0 (socket says 172.21.15.173:45512) 2024-04-25T09:10:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d79e00640 1 -- 172.21.15.173:0/2363163706 learned_addr learned my addr 172.21.15.173:0/2363163706 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d7a800640 1 --2- 172.21.15.173:0/2363163706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c163e10 0x7f9d7c159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d79400640 1 --2- 172.21.15.173:0/2363163706 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d7c0c7f70 0x7f9d7c0c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d79e00640 1 -- 172.21.15.173:0/2363163706 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d7c0c7f70 msgr2=0x7f9d7c0c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d79e00640 1 --2- 172.21.15.173:0/2363163706 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d7c0c7f70 0x7f9d7c0c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d79e00640 1 -- 172.21.15.173:0/2363163706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c163e10 msgr2=0x7f9d7c159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d79e00640 1 --2- 172.21.15.173:0/2363163706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c163e10 0x7f9d7c159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d79e00640 1 -- 172.21.15.173:0/2363163706 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c149f60 con 0x7f9d600039c0 2024-04-25T09:10:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d79e00640 1 --2- 172.21.15.173:0/2363163706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d600039c0 0x7f9d7c149a20 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00a8a0 tx=0x7f9d60005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d72000640 1 -- 172.21.15.173:0/2363163706 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c0ad800 con 0x7f9d600039c0 2024-04-25T09:10:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d72000640 1 -- 172.21.15.173:0/2363163706 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c0ba070 con 0x7f9d600039c0 2024-04-25T09:10:23.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d80e00640 1 -- 172.21.15.173:0/2363163706 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7c162d70 con 0x7f9d600039c0 2024-04-25T09:10:23.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d72000640 1 -- 172.21.15.173:0/2363163706 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c0017c0 con 0x7f9d600039c0 2024-04-25T09:10:23.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d80e00640 1 -- 172.21.15.173:0/2363163706 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c163330 con 0x7f9d600039c0 2024-04-25T09:10:23.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.147+0000 7f9d80e00640 1 -- 172.21.15.173:0/2363163706 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7c073ab0 con 0x7f9d600039c0 2024-04-25T09:10:23.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.151+0000 7f9d72000640 1 -- 172.21.15.173:0/2363163706 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9d6c0ada20 con 0x7f9d600039c0 2024-04-25T09:10:23.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.151+0000 7f9d72000640 1 --2- 172.21.15.173:0/2363163706 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9d5c066f90 0x7f9d5c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.151+0000 7f9d72000640 1 -- 172.21.15.173:0/2363163706 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f9d6c120410 con 0x7f9d600039c0 2024-04-25T09:10:23.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.151+0000 7f9d79400640 1 --2- 172.21.15.173:0/2363163706 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9d5c066f90 0x7f9d5c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.151+0000 7f9d79400640 1 --2- 172.21.15.173:0/2363163706 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9d5c066f90 0x7f9d5c069450 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0c8350 tx=0x7f9d68009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.155+0000 7f9d72000640 1 -- 172.21.15.173:0/2363163706 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9d6c0170d0 con 0x7f9d600039c0 2024-04-25T09:10:23.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.307+0000 7f9d80e00640 1 -- 172.21.15.173:0/2363163706 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9d7c070fa0 con 0x7f9d600039c0 2024-04-25T09:10:23.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.963+0000 7f9d72000640 1 -- 172.21.15.173:0/2363163706 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v107) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9d6c0f1630 con 0x7f9d600039c0 2024-04-25T09:10:23.952 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' created 2024-04-25T09:10:23.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.967+0000 7f9d80e00640 1 -- 172.21.15.173:0/2363163706 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9d5c066f90 msgr2=0x7f9d5c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.967+0000 7f9d80e00640 1 --2- 172.21.15.173:0/2363163706 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9d5c066f90 0x7f9d5c069450 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0c8350 tx=0x7f9d68009190 comp rx=0 tx=0).stop 2024-04-25T09:10:23.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.967+0000 7f9d80e00640 1 -- 172.21.15.173:0/2363163706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d600039c0 msgr2=0x7f9d7c149a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.967+0000 7f9d80e00640 1 --2- 172.21.15.173:0/2363163706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d600039c0 0x7f9d7c149a20 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00a8a0 tx=0x7f9d60005840 comp rx=0 tx=0).stop 2024-04-25T09:10:23.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.967+0000 7f9d80e00640 1 -- 172.21.15.173:0/2363163706 shutdown_connections 2024-04-25T09:10:23.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.967+0000 7f9d80e00640 1 --2- 172.21.15.173:0/2363163706 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9d5c066f90 0x7f9d5c069450 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.967+0000 7f9d80e00640 1 --2- 172.21.15.173:0/2363163706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c163e10 0x7f9d7c159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.967+0000 7f9d80e00640 1 --2- 172.21.15.173:0/2363163706 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d7c0c7f70 0x7f9d7c0c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.967+0000 7f9d80e00640 1 --2- 172.21.15.173:0/2363163706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d600039c0 0x7f9d7c149a20 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.967+0000 7f9d80e00640 1 -- 172.21.15.173:0/2363163706 >> 172.21.15.173:0/2363163706 conn(0x7f9d7c0b32a0 msgr2=0x7f9d7c0b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:23.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.967+0000 7f9d80e00640 1 -- 172.21.15.173:0/2363163706 shutdown_connections 2024-04-25T09:10:23.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:23.967+0000 7f9d80e00640 1 -- 172.21.15.173:0/2363163706 wait complete. 2024-04-25T09:10:23.991 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:10:24.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.143+0000 7fd118e00640 1 Processor -- start 2024-04-25T09:10:24.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.143+0000 7fd118e00640 1 -- start start 2024-04-25T09:10:24.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.147+0000 7fd118e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd114161300 0x7fd11415f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.147+0000 7fd118e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd11415ec70 0x7fd1140b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.147+0000 7fd118e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11406ba70 con 0x7fd1140b44d0 2024-04-25T09:10:24.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.147+0000 7fd118e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1140b2ef0 con 0x7fd114161300 2024-04-25T09:10:24.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.147+0000 7fd118e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140b31d0 con 0x7fd11415ec70 2024-04-25T09:10:24.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.147+0000 7fd111e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd114161300 0x7fd11415f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.147+0000 7fd111400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd11415ec70 0x7fd1140b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.147+0000 7fd112800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fd1140b44d0 0x7fd11406d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:35012/0 (socket says 172.21.15.173:35012) 2024-04-25T09:10:24.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.147+0000 7fd112800640 1 -- 172.21.15.173:0/2809580207 learned_addr learned my addr 172.21.15.173:0/2809580207 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:24.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.147+0000 7fd111e00640 1 -- 172.21.15.173:0/2809580207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd11415ec70 msgr2=0x7fd1140b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:24.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.147+0000 7fd111e00640 1 --2- 172.21.15.173:0/2809580207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd11415ec70 0x7fd1140b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.147+0000 7fd111e00640 1 -- 172.21.15.173:0/2809580207 >> v1:172.21.15.194:6789/0 conn(0x7fd1140b44d0 legacy=0x7fd11406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.147+0000 7fd111e00640 1 -- 172.21.15.173:0/2809580207 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1140b34b0 con 0x7fd114161300 2024-04-25T09:10:24.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.151+0000 7fd111e00640 1 --2- 172.21.15.173:0/2809580207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd114161300 0x7fd11415f3b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd104009d90 tx=0x7fd10401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a372a0d46771ae20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.151+0000 7fd110a00640 1 -- 172.21.15.173:0/2809580207 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1040b2070 con 0x7fd114161300 2024-04-25T09:10:24.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.151+0000 7fd110a00640 1 -- 172.21.15.173:0/2809580207 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1040a59a0 con 0x7fd114161300 2024-04-25T09:10:24.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.151+0000 7fd110a00640 1 -- 172.21.15.173:0/2809580207 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1040a5d70 con 0x7fd114161300 2024-04-25T09:10:24.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.151+0000 7fd118e00640 1 -- 172.21.15.173:0/2809580207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd114161300 msgr2=0x7fd11415f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.151+0000 7fd118e00640 1 --2- 172.21.15.173:0/2809580207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd114161300 0x7fd11415f3b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd104009d90 tx=0x7fd10401c8e0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.151+0000 7fd118e00640 1 -- 172.21.15.173:0/2809580207 shutdown_connections 2024-04-25T09:10:24.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.151+0000 7fd118e00640 1 --2- 172.21.15.173:0/2809580207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd11415ec70 0x7fd1140b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.151+0000 7fd118e00640 1 --2- 172.21.15.173:0/2809580207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd114161300 0x7fd11415f3b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.151+0000 7fd118e00640 1 -- 172.21.15.173:0/2809580207 >> 172.21.15.173:0/2809580207 conn(0x7fd11406ac90 msgr2=0x7fd11406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:24.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.151+0000 7fd118e00640 1 -- 172.21.15.173:0/2809580207 shutdown_connections 2024-04-25T09:10:24.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.151+0000 7fd118e00640 1 -- 172.21.15.173:0/2809580207 wait complete. 2024-04-25T09:10:24.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.151+0000 7fd118e00640 1 Processor -- start 2024-04-25T09:10:24.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.151+0000 7fd118e00640 1 -- start start 2024-04-25T09:10:24.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd118e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1140b44d0 0x7fd1141516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd118e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd11415ec70 0x7fd1140b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd118e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd114161300 0x7fd11414c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd118e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140b2c20 con 0x7fd11415ec70 2024-04-25T09:10:24.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd118e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140b2aa0 con 0x7fd1140b44d0 2024-04-25T09:10:24.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd118e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11416b040 con 0x7fd114161300 2024-04-25T09:10:24.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd111400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd11415ec70 0x7fd1140b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd111400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd11415ec70 0x7fd1140b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52154/0 (socket says 172.21.15.173:52154) 2024-04-25T09:10:24.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd111400640 1 -- 172.21.15.173:0/973535929 learned_addr learned my addr 172.21.15.173:0/973535929 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:24.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd112800640 1 --2- 172.21.15.173:0/973535929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd114161300 0x7fd11414c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd111e00640 1 --2- 172.21.15.173:0/973535929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1140b44d0 0x7fd1141516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd111400640 1 -- 172.21.15.173:0/973535929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd114161300 msgr2=0x7fd11414c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd111400640 1 --2- 172.21.15.173:0/973535929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd114161300 0x7fd11414c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd111400640 1 -- 172.21.15.173:0/973535929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1140b44d0 msgr2=0x7fd1141516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd111400640 1 --2- 172.21.15.173:0/973535929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1140b44d0 0x7fd1141516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd111400640 1 -- 172.21.15.173:0/973535929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1140b10c0 con 0x7fd11415ec70 2024-04-25T09:10:24.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd112800640 1 --2- 172.21.15.173:0/973535929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd114161300 0x7fd11414c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:24.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd111e00640 1 --2- 172.21.15.173:0/973535929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1140b44d0 0x7fd1141516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:24.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd111400640 1 --2- 172.21.15.173:0/973535929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd11415ec70 0x7fd1140b00f0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fd10000e930 tx=0x7fd10000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd10a000640 1 -- 172.21.15.173:0/973535929 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100017070 con 0x7fd11415ec70 2024-04-25T09:10:24.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd10a000640 1 -- 172.21.15.173:0/973535929 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10000ca00 con 0x7fd11415ec70 2024-04-25T09:10:24.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd118e00640 1 -- 172.21.15.173:0/973535929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1140b0820 con 0x7fd11415ec70 2024-04-25T09:10:24.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd10a000640 1 -- 172.21.15.173:0/973535929 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10000cdb0 con 0x7fd11415ec70 2024-04-25T09:10:24.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd118e00640 1 -- 172.21.15.173:0/973535929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1140b0de0 con 0x7fd11415ec70 2024-04-25T09:10:24.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.155+0000 7fd118e00640 1 -- 172.21.15.173:0/973535929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd114073ab0 con 0x7fd11415ec70 2024-04-25T09:10:24.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.159+0000 7fd10a000640 1 -- 172.21.15.173:0/973535929 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd10001a070 con 0x7fd11415ec70 2024-04-25T09:10:24.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.159+0000 7fd10a000640 1 --2- 172.21.15.173:0/973535929 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd0f4066f60 0x7fd0f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.159+0000 7fd10a000640 1 -- 172.21.15.173:0/973535929 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fd100085970 con 0x7fd11415ec70 2024-04-25T09:10:24.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.159+0000 7fd111e00640 1 --2- 172.21.15.173:0/973535929 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd0f4066f60 0x7fd0f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.159+0000 7fd111e00640 1 --2- 172.21.15.173:0/973535929 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd0f4066f60 0x7fd0f4069420 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd1040af000 tx=0x7fd1040a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.163+0000 7fd10a000640 1 -- 172.21.15.173:0/973535929 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd1000568f0 con 0x7fd11415ec70 2024-04-25T09:10:24.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.347+0000 7fd118e00640 1 -- 172.21.15.173:0/973535929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd11406b3f0 con 0x7fd11415ec70 2024-04-25T09:10:24.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:24.999+0000 7fd10a000640 1 -- 172.21.15.173:0/973535929 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v69) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd1000561f0 con 0x7fd11415ec70 2024-04-25T09:10:24.993 INFO:teuthology.orchestra.run.smithi173.stderr:new fs with metadata pool 15 and data pool 16 2024-04-25T09:10:25.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.011+0000 7fd118e00640 1 -- 172.21.15.173:0/973535929 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd0f4066f60 msgr2=0x7fd0f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.011+0000 7fd118e00640 1 --2- 172.21.15.173:0/973535929 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd0f4066f60 0x7fd0f4069420 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd1040af000 tx=0x7fd1040a7070 comp rx=0 tx=0).stop 2024-04-25T09:10:25.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.011+0000 7fd118e00640 1 -- 172.21.15.173:0/973535929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd11415ec70 msgr2=0x7fd1140b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.011+0000 7fd118e00640 1 --2- 172.21.15.173:0/973535929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd11415ec70 0x7fd1140b00f0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fd10000e930 tx=0x7fd10000edf0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.011+0000 7fd118e00640 1 -- 172.21.15.173:0/973535929 shutdown_connections 2024-04-25T09:10:25.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.011+0000 7fd118e00640 1 --2- 172.21.15.173:0/973535929 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd0f4066f60 0x7fd0f4069420 secure :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd1040af000 tx=0x7fd1040a7070 comp rx=0 tx=0).stop 2024-04-25T09:10:25.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.011+0000 7fd118e00640 1 --2- 172.21.15.173:0/973535929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd114161300 0x7fd11414c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.011+0000 7fd118e00640 1 --2- 172.21.15.173:0/973535929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd11415ec70 0x7fd1140b00f0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.011+0000 7fd118e00640 1 --2- 172.21.15.173:0/973535929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1140b44d0 0x7fd1141516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.011+0000 7fd118e00640 1 -- 172.21.15.173:0/973535929 >> 172.21.15.173:0/973535929 conn(0x7fd11406ac90 msgr2=0x7fd1140ad300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:25.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.011+0000 7fd118e00640 1 -- 172.21.15.173:0/973535929 shutdown_connections 2024-04-25T09:10:25.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.011+0000 7fd118e00640 1 -- 172.21.15.173:0/973535929 wait complete. 2024-04-25T09:10:25.029 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:25.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.175+0000 7f561a800640 1 Processor -- start 2024-04-25T09:10:25.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.175+0000 7f561a800640 1 -- start start 2024-04-25T09:10:25.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.179+0000 7f561a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56140ae810 0x7f56140aec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.179+0000 7f561a800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56140af160 con 0x7f561415dc60 2024-04-25T09:10:25.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.179+0000 7f561a800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561415e8e0 con 0x7f561415e040 2024-04-25T09:10:25.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.179+0000 7f561a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5614071450 con 0x7f56140ae810 2024-04-25T09:10:25.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.179+0000 7f5613400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f561415dc60 0x7f56140b3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49746/0 (socket says 172.21.15.173:49746) 2024-04-25T09:10:25.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.179+0000 7f5613400640 1 -- 172.21.15.173:0/1368841519 learned_addr learned my addr 172.21.15.173:0/1368841519 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:25.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.179+0000 7f5613e00640 1 --2- 172.21.15.173:0/1368841519 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56140ae810 0x7f56140aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.179+0000 7f5612000640 1 -- 172.21.15.173:0/1368841519 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052159232 0 0) 0x7f56040014a0 con 0x7f561415dc60 2024-04-25T09:10:25.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.179+0000 7f5612000640 1 -- 172.21.15.173:0/1368841519 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f8003530 con 0x7f561415dc60 2024-04-25T09:10:25.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.179+0000 7f5612000640 1 -- 172.21.15.173:0/1368841519 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806088798 0 0) 0x7f561415e8e0 con 0x7f561415e040 2024-04-25T09:10:25.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.179+0000 7f5612000640 1 -- 172.21.15.173:0/1368841519 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56040014a0 con 0x7f561415e040 2024-04-25T09:10:25.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.179+0000 7f5613e00640 1 -- 172.21.15.173:0/1368841519 >> v1:172.21.15.194:6789/0 conn(0x7f561415e040 legacy=0x7f56140ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.179+0000 7f5613e00640 1 -- 172.21.15.173:0/1368841519 >> v1:172.21.15.173:6789/0 conn(0x7f561415dc60 legacy=0x7f56140b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.179+0000 7f5613e00640 1 -- 172.21.15.173:0/1368841519 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561415ebc0 con 0x7f56140ae810 2024-04-25T09:10:25.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f5613e00640 1 --2- 172.21.15.173:0/1368841519 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56140ae810 0x7f56140aec20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f56140715d0 tx=0x7f560c01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8306ec166b0c8bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:25.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f5612000640 1 -- 172.21.15.173:0/1368841519 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c0b1070 con 0x7f56140ae810 2024-04-25T09:10:25.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f5612000640 1 -- 172.21.15.173:0/1368841519 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560c0ac410 con 0x7f56140ae810 2024-04-25T09:10:25.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f5612000640 1 -- 172.21.15.173:0/1368841519 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c0ac7e0 con 0x7f56140ae810 2024-04-25T09:10:25.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f561a800640 1 -- 172.21.15.173:0/1368841519 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56140ae810 msgr2=0x7f56140aec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f561a800640 1 --2- 172.21.15.173:0/1368841519 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56140ae810 0x7f56140aec20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f56140715d0 tx=0x7f560c01c4c0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f561a800640 1 -- 172.21.15.173:0/1368841519 shutdown_connections 2024-04-25T09:10:25.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f561a800640 1 --2- 172.21.15.173:0/1368841519 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56140ae810 0x7f56140aec20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f561a800640 1 -- 172.21.15.173:0/1368841519 >> 172.21.15.173:0/1368841519 conn(0x7f561406ac90 msgr2=0x7f561406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:25.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f561a800640 1 -- 172.21.15.173:0/1368841519 shutdown_connections 2024-04-25T09:10:25.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f561a800640 1 -- 172.21.15.173:0/1368841519 wait complete. 2024-04-25T09:10:25.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f561a800640 1 Processor -- start 2024-04-25T09:10:25.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f561a800640 1 -- start start 2024-04-25T09:10:25.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f561a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56140ae810 0x7f5614148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f561a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f561415dc60 0x7f561406e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f561a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f561415e040 0x7f561415c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f561a800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561415e5d0 con 0x7f561415e040 2024-04-25T09:10:25.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f561a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561415e450 con 0x7f56140ae810 2024-04-25T09:10:25.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.183+0000 7f561a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56140720d0 con 0x7f561415dc60 2024-04-25T09:10:25.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f5613e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f561415e040 0x7f561415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f5613e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f561415e040 0x7f561415c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52168/0 (socket says 172.21.15.173:52168) 2024-04-25T09:10:25.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f5613e00640 1 -- 172.21.15.173:0/3573098980 learned_addr learned my addr 172.21.15.173:0/3573098980 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:25.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f5612a00640 1 --2- 172.21.15.173:0/3573098980 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f561415dc60 0x7f561406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f5613400640 1 --2- 172.21.15.173:0/3573098980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56140ae810 0x7f5614148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f5613e00640 1 -- 172.21.15.173:0/3573098980 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f561415dc60 msgr2=0x7f561406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f5613e00640 1 --2- 172.21.15.173:0/3573098980 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f561415dc60 0x7f561406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f5613e00640 1 -- 172.21.15.173:0/3573098980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56140ae810 msgr2=0x7f5614148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f5613e00640 1 --2- 172.21.15.173:0/3573098980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56140ae810 0x7f5614148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f5613e00640 1 -- 172.21.15.173:0/3573098980 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5614157200 con 0x7f561415e040 2024-04-25T09:10:25.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f5613e00640 1 --2- 172.21.15.173:0/3573098980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f561415e040 0x7f561415c070 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f560c0af040 tx=0x7f560c019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:25.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f560b400640 1 -- 172.21.15.173:0/3573098980 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c0b9070 con 0x7f561415e040 2024-04-25T09:10:25.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f560b400640 1 -- 172.21.15.173:0/3573098980 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560c0acc40 con 0x7f561415e040 2024-04-25T09:10:25.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f560b400640 1 -- 172.21.15.173:0/3573098980 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c0b1040 con 0x7f561415e040 2024-04-25T09:10:25.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f561a800640 1 -- 172.21.15.173:0/3573098980 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56141574e0 con 0x7f561415e040 2024-04-25T09:10:25.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f561a800640 1 -- 172.21.15.173:0/3573098980 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5614157aa0 con 0x7f561415e040 2024-04-25T09:10:25.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f561a800640 1 -- 172.21.15.173:0/3573098980 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5614073a40 con 0x7f561415e040 2024-04-25T09:10:25.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f560b400640 1 -- 172.21.15.173:0/3573098980 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f560c0bc070 con 0x7f561415e040 2024-04-25T09:10:25.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f560b400640 1 --2- 172.21.15.173:0/3573098980 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f55f4066f90 0x7f55f4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.187+0000 7f560b400640 1 -- 172.21.15.173:0/3573098980 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f560c11e770 con 0x7f561415e040 2024-04-25T09:10:25.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.191+0000 7f5613400640 1 --2- 172.21.15.173:0/3573098980 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f55f4066f90 0x7f55f4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.191+0000 7f5613400640 1 --2- 172.21.15.173:0/3573098980 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f55f4066f90 0x7f55f4069450 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5604002240 tx=0x7f5604001c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:25.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.191+0000 7f560b400640 1 -- 172.21.15.173:0/3573098980 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f560c0c3070 con 0x7f561415e040 2024-04-25T09:10:25.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.347+0000 7f561a800640 1 -- 172.21.15.173:0/3573098980 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56141690b0 con 0x7f561415e040 2024-04-25T09:10:25.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.347+0000 7f560b400640 1 -- 172.21.15.173:0/3573098980 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16957 (secure 0 0 0) 0x7f560c0160b0 con 0x7f561415e040 2024-04-25T09:10:25.337 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:25.337 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":108,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:10:24.354610+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:22.062377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:23.359080+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:25.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.351+0000 7f561a800640 1 -- 172.21.15.173:0/3573098980 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f55f4066f90 msgr2=0x7f55f4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.351+0000 7f561a800640 1 --2- 172.21.15.173:0/3573098980 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f55f4066f90 0x7f55f4069450 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5604002240 tx=0x7f5604001c90 comp rx=0 tx=0).stop 2024-04-25T09:10:25.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.351+0000 7f561a800640 1 -- 172.21.15.173:0/3573098980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f561415e040 msgr2=0x7f561415c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.351+0000 7f561a800640 1 --2- 172.21.15.173:0/3573098980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f561415e040 0x7f561415c070 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f560c0af040 tx=0x7f560c019260 comp rx=0 tx=0).stop 2024-04-25T09:10:25.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.351+0000 7f561a800640 1 -- 172.21.15.173:0/3573098980 shutdown_connections 2024-04-25T09:10:25.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.351+0000 7f561a800640 1 --2- 172.21.15.173:0/3573098980 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f55f4066f90 0x7f55f4069450 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.351+0000 7f561a800640 1 --2- 172.21.15.173:0/3573098980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f561415e040 0x7f561415c070 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.351+0000 7f561a800640 1 --2- 172.21.15.173:0/3573098980 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f561415dc60 0x7f561406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.351+0000 7f561a800640 1 --2- 172.21.15.173:0/3573098980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56140ae810 0x7f5614148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.351+0000 7f561a800640 1 -- 172.21.15.173:0/3573098980 >> 172.21.15.173:0/3573098980 conn(0x7f561406ac90 msgr2=0x7f5614159230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:25.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.351+0000 7f561a800640 1 -- 172.21.15.173:0/3573098980 shutdown_connections 2024-04-25T09:10:25.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.351+0000 7f561a800640 1 -- 172.21.15.173:0/3573098980 wait complete. 2024-04-25T09:10:25.359 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:25.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.507+0000 7f1b43400640 1 Processor -- start 2024-04-25T09:10:25.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.507+0000 7f1b43400640 1 -- start start 2024-04-25T09:10:25.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.507+0000 7f1b43400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b3c162140 0x7f1b3c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.507+0000 7f1b43400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1b3c0c4660 0x7f1b3c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.507+0000 7f1b43400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1b3c0d2330 0x7f1b3c06fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.507+0000 7f1b43400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3c0d02b0 con 0x7f1b3c0d2330 2024-04-25T09:10:25.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.507+0000 7f1b43400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3c06ddb0 con 0x7f1b3c0c4660 2024-04-25T09:10:25.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.507+0000 7f1b43400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c06d7f0 con 0x7f1b3c162140 2024-04-25T09:10:25.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.507+0000 7f1b41400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1b3c0d2330 0x7f1b3c06fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.507+0000 7f1b41400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1b3c0d2330 0x7f1b3c06fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52184/0 (socket says 172.21.15.173:52184) 2024-04-25T09:10:25.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.507+0000 7f1b41400640 1 -- 172.21.15.173:0/741381188 learned_addr learned my addr 172.21.15.173:0/741381188 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:25.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.507+0000 7f1b40a00640 1 --2- 172.21.15.173:0/741381188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b3c162140 0x7f1b3c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.507+0000 7f1b33e00640 1 --2- 172.21.15.173:0/741381188 >> v2:172.21.15.194:3300/0 conn(0x7f1b3c0c4660 0x7f1b3c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.507+0000 7f1b41400640 1 -- 172.21.15.173:0/741381188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b3c162140 msgr2=0x7f1b3c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:25.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.507+0000 7f1b41400640 1 --2- 172.21.15.173:0/741381188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b3c162140 0x7f1b3c0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.507+0000 7f1b41400640 1 -- 172.21.15.173:0/741381188 >> v2:172.21.15.194:3300/0 conn(0x7f1b3c0c4660 msgr2=0x7f1b3c06f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:25.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.507+0000 7f1b41400640 1 --2- 172.21.15.173:0/741381188 >> v2:172.21.15.194:3300/0 conn(0x7f1b3c0c4660 0x7f1b3c06f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.507+0000 7f1b41400640 1 -- 172.21.15.173:0/741381188 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c06dad0 con 0x7f1b3c0d2330 2024-04-25T09:10:25.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.511+0000 7f1b41400640 1 --2- 172.21.15.173:0/741381188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b3c0d2330 0x7f1b3c06fd70 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c062540 tx=0x7f1b3401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702b7af12c7c97f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:25.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.511+0000 7f1b3be00640 1 -- 172.21.15.173:0/741381188 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b340a5840 con 0x7f1b3c0d2330 2024-04-25T09:10:25.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.511+0000 7f1b3be00640 1 -- 172.21.15.173:0/741381188 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b340a59e0 con 0x7f1b3c0d2330 2024-04-25T09:10:25.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.511+0000 7f1b3be00640 1 -- 172.21.15.173:0/741381188 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b340a5db0 con 0x7f1b3c0d2330 2024-04-25T09:10:25.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.511+0000 7f1b43400640 1 -- 172.21.15.173:0/741381188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b3c0d2330 msgr2=0x7f1b3c06fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.511+0000 7f1b43400640 1 --2- 172.21.15.173:0/741381188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b3c0d2330 0x7f1b3c06fd70 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c062540 tx=0x7f1b3401c9c0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.511+0000 7f1b43400640 1 -- 172.21.15.173:0/741381188 shutdown_connections 2024-04-25T09:10:25.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.511+0000 7f1b43400640 1 --2- 172.21.15.173:0/741381188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b3c0d2330 0x7f1b3c06fd70 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.511+0000 7f1b43400640 1 --2- 172.21.15.173:0/741381188 >> v2:172.21.15.194:3300/0 conn(0x7f1b3c0c4660 0x7f1b3c06f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.511+0000 7f1b43400640 1 --2- 172.21.15.173:0/741381188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b3c162140 0x7f1b3c0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.511+0000 7f1b43400640 1 -- 172.21.15.173:0/741381188 >> 172.21.15.173:0/741381188 conn(0x7f1b3c061880 msgr2=0x7f1b3c061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:25.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.511+0000 7f1b43400640 1 -- 172.21.15.173:0/741381188 shutdown_connections 2024-04-25T09:10:25.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.511+0000 7f1b43400640 1 -- 172.21.15.173:0/741381188 wait complete. 2024-04-25T09:10:25.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b43400640 1 Processor -- start 2024-04-25T09:10:25.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b43400640 1 -- start start 2024-04-25T09:10:25.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b43400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b3c0c4660 0x7f1b3c0b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b43400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b3c0d2330 0x7f1b3c0b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b43400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b3c162140 0x7f1b3c1642a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b43400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c06cc00 con 0x7f1b3c162140 2024-04-25T09:10:25.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b43400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c06ca80 con 0x7f1b3c0c4660 2024-04-25T09:10:25.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b43400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c06cd80 con 0x7f1b3c0d2330 2024-04-25T09:10:25.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b41400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b3c162140 0x7f1b3c1642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b41400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b3c162140 0x7f1b3c1642a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52192/0 (socket says 172.21.15.173:52192) 2024-04-25T09:10:25.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b41400640 1 -- 172.21.15.173:0/718499909 learned_addr learned my addr 172.21.15.173:0/718499909 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:25.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b40a00640 1 --2- 172.21.15.173:0/718499909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b3c0c4660 0x7f1b3c0b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b33e00640 1 --2- 172.21.15.173:0/718499909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b3c0d2330 0x7f1b3c0b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b41400640 1 -- 172.21.15.173:0/718499909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b3c0d2330 msgr2=0x7f1b3c0b6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b41400640 1 --2- 172.21.15.173:0/718499909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b3c0d2330 0x7f1b3c0b6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b41400640 1 -- 172.21.15.173:0/718499909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b3c0c4660 msgr2=0x7f1b3c0b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b41400640 1 --2- 172.21.15.173:0/718499909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b3c0c4660 0x7f1b3c0b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b41400640 1 -- 172.21.15.173:0/718499909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c0c6140 con 0x7f1b3c162140 2024-04-25T09:10:25.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b40a00640 1 --2- 172.21.15.173:0/718499909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b3c0c4660 0x7f1b3c0b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:25.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b33e00640 1 --2- 172.21.15.173:0/718499909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b3c0d2330 0x7f1b3c0b6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:25.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b41400640 1 --2- 172.21.15.173:0/718499909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b3c162140 0x7f1b3c1642a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f1b340af040 tx=0x7f1b34019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:25.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b39600640 1 -- 172.21.15.173:0/718499909 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b340b8670 con 0x7f1b3c162140 2024-04-25T09:10:25.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b39600640 1 -- 172.21.15.173:0/718499909 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b340be070 con 0x7f1b3c162140 2024-04-25T09:10:25.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b43400640 1 -- 172.21.15.173:0/718499909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3c0c5380 con 0x7f1b3c162140 2024-04-25T09:10:25.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b39600640 1 -- 172.21.15.173:0/718499909 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b340b8a90 con 0x7f1b3c162140 2024-04-25T09:10:25.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.515+0000 7f1b43400640 1 -- 172.21.15.173:0/718499909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3c0c5940 con 0x7f1b3c162140 2024-04-25T09:10:25.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.519+0000 7f1b43400640 1 -- 172.21.15.173:0/718499909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3c073a40 con 0x7f1b3c162140 2024-04-25T09:10:25.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.519+0000 7f1b39600640 1 -- 172.21.15.173:0/718499909 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1b340b8c30 con 0x7f1b3c162140 2024-04-25T09:10:25.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.519+0000 7f1b39600640 1 --2- 172.21.15.173:0/718499909 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1b18066f90 0x7f1b18069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.519+0000 7f1b39600640 1 -- 172.21.15.173:0/718499909 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1b34120490 con 0x7f1b3c162140 2024-04-25T09:10:25.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.519+0000 7f1b40a00640 1 --2- 172.21.15.173:0/718499909 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1b18066f90 0x7f1b18069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.519+0000 7f1b40a00640 1 --2- 172.21.15.173:0/718499909 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1b18066f90 0x7f1b18069450 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009a90 tx=0x7f1b2c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:25.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.523+0000 7f1b39600640 1 -- 172.21.15.173:0/718499909 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1b340165e0 con 0x7f1b3c162140 2024-04-25T09:10:25.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.675+0000 7f1b43400640 1 -- 172.21.15.173:0/718499909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b3c0cf020 con 0x7f1b3c162140 2024-04-25T09:10:25.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.679+0000 7f1b39600640 1 -- 172.21.15.173:0/718499909 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16957 (secure 0 0 0) 0x7f1b340f1450 con 0x7f1b3c162140 2024-04-25T09:10:25.667 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:25.668 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":108,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:10:24.354610+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:22.062377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:23.359080+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:25.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.679+0000 7f1b43400640 1 -- 172.21.15.173:0/718499909 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1b18066f90 msgr2=0x7f1b18069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.679+0000 7f1b43400640 1 --2- 172.21.15.173:0/718499909 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1b18066f90 0x7f1b18069450 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009a90 tx=0x7f1b2c008040 comp rx=0 tx=0).stop 2024-04-25T09:10:25.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.679+0000 7f1b43400640 1 -- 172.21.15.173:0/718499909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b3c162140 msgr2=0x7f1b3c1642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.679+0000 7f1b43400640 1 --2- 172.21.15.173:0/718499909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b3c162140 0x7f1b3c1642a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f1b340af040 tx=0x7f1b34019760 comp rx=0 tx=0).stop 2024-04-25T09:10:25.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.679+0000 7f1b43400640 1 -- 172.21.15.173:0/718499909 shutdown_connections 2024-04-25T09:10:25.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.679+0000 7f1b43400640 1 --2- 172.21.15.173:0/718499909 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1b18066f90 0x7f1b18069450 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.679+0000 7f1b43400640 1 --2- 172.21.15.173:0/718499909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b3c162140 0x7f1b3c1642a0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.679+0000 7f1b43400640 1 --2- 172.21.15.173:0/718499909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b3c0d2330 0x7f1b3c0b6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.679+0000 7f1b43400640 1 --2- 172.21.15.173:0/718499909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b3c0c4660 0x7f1b3c0b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.679+0000 7f1b43400640 1 -- 172.21.15.173:0/718499909 >> 172.21.15.173:0/718499909 conn(0x7f1b3c061880 msgr2=0x7f1b3c0b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:25.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.679+0000 7f1b43400640 1 -- 172.21.15.173:0/718499909 shutdown_connections 2024-04-25T09:10:25.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.679+0000 7f1b43400640 1 -- 172.21.15.173:0/718499909 wait complete. 2024-04-25T09:10:25.688 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:10:25.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.839+0000 7f35c7e00640 1 Processor -- start 2024-04-25T09:10:25.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.839+0000 7f35c7e00640 1 -- start start 2024-04-25T09:10:25.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.839+0000 7f35c7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c015b710 0x7f35c0071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.839+0000 7f35c7e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f35c00cd3d0 0x7f35c00cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.839+0000 7f35c7e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c00ccaa0 con 0x7f35c00cc670 2024-04-25T09:10:25.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.839+0000 7f35c7e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c015eea0 con 0x7f35c00cd3d0 2024-04-25T09:10:25.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.839+0000 7f35c7e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c015e2d0 con 0x7f35c015b710 2024-04-25T09:10:25.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.839+0000 7f35c4a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f35c00cd3d0 0x7f35c00cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.839+0000 7f35c4a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f35c00cd3d0 0x7f35c00cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52200/0 (socket says 172.21.15.173:52200) 2024-04-25T09:10:25.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.839+0000 7f35c4a00640 1 -- 172.21.15.173:0/2672173357 learned_addr learned my addr 172.21.15.173:0/2672173357 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:25.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.839+0000 7f35c5400640 1 --2- 172.21.15.173:0/2672173357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c015b710 0x7f35c0071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.839+0000 7f35c4a00640 1 -- 172.21.15.173:0/2672173357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c015b710 msgr2=0x7f35c0071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:25.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.839+0000 7f35c4a00640 1 --2- 172.21.15.173:0/2672173357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c015b710 0x7f35c0071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.839+0000 7f35c4a00640 1 -- 172.21.15.173:0/2672173357 >> v1:172.21.15.194:6789/0 conn(0x7f35c00cc670 legacy=0x7f35c006d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.839+0000 7f35c4a00640 1 -- 172.21.15.173:0/2672173357 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c015e570 con 0x7f35c00cd3d0 2024-04-25T09:10:25.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.843+0000 7f35c4a00640 1 --2- 172.21.15.173:0/2672173357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c00cd3d0 0x7f35c00cc130 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f35ac009870 tx=0x7f35ac01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea97ac16eceb466b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:25.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.843+0000 7f35bfe00640 1 -- 172.21.15.173:0/2672173357 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac0ab640 con 0x7f35c00cd3d0 2024-04-25T09:10:25.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.843+0000 7f35bfe00640 1 -- 172.21.15.173:0/2672173357 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac0b0070 con 0x7f35c00cd3d0 2024-04-25T09:10:25.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.843+0000 7f35bfe00640 1 -- 172.21.15.173:0/2672173357 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac0aba00 con 0x7f35c00cd3d0 2024-04-25T09:10:25.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.843+0000 7f35c7e00640 1 -- 172.21.15.173:0/2672173357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c00cd3d0 msgr2=0x7f35c00cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.843+0000 7f35c7e00640 1 --2- 172.21.15.173:0/2672173357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c00cd3d0 0x7f35c00cc130 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f35ac009870 tx=0x7f35ac01c530 comp rx=0 tx=0).stop 2024-04-25T09:10:25.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.843+0000 7f35c7e00640 1 -- 172.21.15.173:0/2672173357 shutdown_connections 2024-04-25T09:10:25.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.843+0000 7f35c7e00640 1 --2- 172.21.15.173:0/2672173357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c00cd3d0 0x7f35c00cc130 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.843+0000 7f35c7e00640 1 --2- 172.21.15.173:0/2672173357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c015b710 0x7f35c0071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.843+0000 7f35c7e00640 1 -- 172.21.15.173:0/2672173357 >> 172.21.15.173:0/2672173357 conn(0x7f35c006ac90 msgr2=0x7f35c006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:25.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.843+0000 7f35c7e00640 1 -- 172.21.15.173:0/2672173357 shutdown_connections 2024-04-25T09:10:25.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.843+0000 7f35c7e00640 1 -- 172.21.15.173:0/2672173357 wait complete. 2024-04-25T09:10:25.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c7e00640 1 Processor -- start 2024-04-25T09:10:25.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c7e00640 1 -- start start 2024-04-25T09:10:25.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c00cc670 0x7f35c013e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35c00cd3d0 0x7f35c014bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c015b710 0x7f35c00b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c7e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c0072540 con 0x7f35c015b710 2024-04-25T09:10:25.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c7e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00723c0 con 0x7f35c00cd3d0 2024-04-25T09:10:25.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c7e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c016a800 con 0x7f35c00cc670 2024-04-25T09:10:25.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c015b710 0x7f35c00b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c015b710 0x7f35c00b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52216/0 (socket says 172.21.15.173:52216) 2024-04-25T09:10:25.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c5e00640 1 -- 172.21.15.173:0/2239586474 learned_addr learned my addr 172.21.15.173:0/2239586474 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:25.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c4a00640 1 --2- 172.21.15.173:0/2239586474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35c00cd3d0 0x7f35c014bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c5400640 1 --2- 172.21.15.173:0/2239586474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c00cc670 0x7f35c013e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c5e00640 1 -- 172.21.15.173:0/2239586474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c00cc670 msgr2=0x7f35c013e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c5e00640 1 --2- 172.21.15.173:0/2239586474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c00cc670 0x7f35c013e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c5e00640 1 -- 172.21.15.173:0/2239586474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35c00cd3d0 msgr2=0x7f35c014bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c5e00640 1 --2- 172.21.15.173:0/2239586474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35c00cd3d0 0x7f35c014bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c5e00640 1 -- 172.21.15.173:0/2239586474 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c00ce740 con 0x7f35c015b710 2024-04-25T09:10:25.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c5e00640 1 --2- 172.21.15.173:0/2239586474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c015b710 0x7f35c00b2530 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f35b800c770 tx=0x7f35b800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:25.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35bd600640 1 -- 172.21.15.173:0/2239586474 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b8003b80 con 0x7f35c015b710 2024-04-25T09:10:25.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35bd600640 1 -- 172.21.15.173:0/2239586474 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b8003d20 con 0x7f35c015b710 2024-04-25T09:10:25.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35bd600640 1 -- 172.21.15.173:0/2239586474 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b800aa90 con 0x7f35c015b710 2024-04-25T09:10:25.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c7e00640 1 -- 172.21.15.173:0/2239586474 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c014c9d0 con 0x7f35c015b710 2024-04-25T09:10:25.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.847+0000 7f35c7e00640 1 -- 172.21.15.173:0/2239586474 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c014cf90 con 0x7f35c015b710 2024-04-25T09:10:25.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.851+0000 7f35c7e00640 1 -- 172.21.15.173:0/2239586474 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c0073ab0 con 0x7f35c015b710 2024-04-25T09:10:25.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.851+0000 7f35bd600640 1 -- 172.21.15.173:0/2239586474 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f35b800ac30 con 0x7f35c015b710 2024-04-25T09:10:25.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.851+0000 7f35bd600640 1 --2- 172.21.15.173:0/2239586474 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f35a0066f60 0x7f35a0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.851+0000 7f35bd600640 1 -- 172.21.15.173:0/2239586474 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f35b8084fc0 con 0x7f35c015b710 2024-04-25T09:10:25.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.851+0000 7f35c5400640 1 --2- 172.21.15.173:0/2239586474 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f35a0066f60 0x7f35a0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.851+0000 7f35c5400640 1 --2- 172.21.15.173:0/2239586474 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f35a0066f60 0x7f35a0069420 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009ac0 tx=0x7f35b4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:25.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:25.855+0000 7f35bd600640 1 -- 172.21.15.173:0/2239586474 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f35c00ccaa0 con 0x7f35c015b710 2024-04-25T09:10:26.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:26.047+0000 7f35c7e00640 1 -- 172.21.15.173:0/2239586474 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f35c00d02e0 con 0x7f35c015b710 2024-04-25T09:10:26.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.011+0000 7f35bd600640 1 -- 172.21.15.173:0/2239586474 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v71) v1 ==== 118+0+0 (secure 0 0 0) 0x7f35b80557e0 con 0x7f35c015b710 2024-04-25T09:10:27.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.015+0000 7f35c7e00640 1 -- 172.21.15.173:0/2239586474 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f35a0066f60 msgr2=0x7f35a0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:27.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.015+0000 7f35c7e00640 1 --2- 172.21.15.173:0/2239586474 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f35a0066f60 0x7f35a0069420 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009ac0 tx=0x7f35b4009190 comp rx=0 tx=0).stop 2024-04-25T09:10:27.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.015+0000 7f35c7e00640 1 -- 172.21.15.173:0/2239586474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c015b710 msgr2=0x7f35c00b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:27.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.015+0000 7f35c7e00640 1 --2- 172.21.15.173:0/2239586474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c015b710 0x7f35c00b2530 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f35b800c770 tx=0x7f35b800cc30 comp rx=0 tx=0).stop 2024-04-25T09:10:27.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.015+0000 7f35c7e00640 1 -- 172.21.15.173:0/2239586474 shutdown_connections 2024-04-25T09:10:27.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.015+0000 7f35c7e00640 1 --2- 172.21.15.173:0/2239586474 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f35a0066f60 0x7f35a0069420 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.015+0000 7f35c7e00640 1 --2- 172.21.15.173:0/2239586474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c015b710 0x7f35c00b2530 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.015+0000 7f35c7e00640 1 --2- 172.21.15.173:0/2239586474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35c00cd3d0 0x7f35c014bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.015+0000 7f35c7e00640 1 --2- 172.21.15.173:0/2239586474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c00cc670 0x7f35c013e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.015+0000 7f35c7e00640 1 -- 172.21.15.173:0/2239586474 >> 172.21.15.173:0/2239586474 conn(0x7f35c006ac90 msgr2=0x7f35c006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:27.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.015+0000 7f35c7e00640 1 -- 172.21.15.173:0/2239586474 shutdown_connections 2024-04-25T09:10:27.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.015+0000 7f35c7e00640 1 -- 172.21.15.173:0/2239586474 wait complete. 2024-04-25T09:10:27.026 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:10:27.026 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:10:27.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.179+0000 7f85c9e00640 1 Processor -- start 2024-04-25T09:10:27.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.179+0000 7f85c9e00640 1 -- start start 2024-04-25T09:10:27.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c9e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c41452f0 0x7f85c415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:27.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c9e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f85c40ce420 0x7f85c40ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:27.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c9e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c40720a0 con 0x7f85c4144f10 2024-04-25T09:10:27.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c9e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c415fa40 con 0x7f85c40ce420 2024-04-25T09:10:27.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c9e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c406f190 con 0x7f85c41452f0 2024-04-25T09:10:27.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c8a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f85c4144f10 0x7f85c406ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49752/0 (socket says 172.21.15.173:49752) 2024-04-25T09:10:27.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c8a00640 1 -- 172.21.15.173:0/387290921 learned_addr learned my addr 172.21.15.173:0/387290921 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:27.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c3e00640 1 --2- 172.21.15.173:0/387290921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c41452f0 0x7f85c415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:27.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c9400640 1 --2- 172.21.15.173:0/387290921 >> v2:172.21.15.194:3300/0 conn(0x7f85c40ce420 0x7f85c40ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:27.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c3400640 1 -- 172.21.15.173:0/387290921 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974994130 0 0) 0x7f85c40720a0 con 0x7f85c4144f10 2024-04-25T09:10:27.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c3400640 1 -- 172.21.15.173:0/387290921 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85a8003530 con 0x7f85c4144f10 2024-04-25T09:10:27.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c3400640 1 -- 172.21.15.173:0/387290921 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 640796228 0 0) 0x7f85a8003530 con 0x7f85c4144f10 2024-04-25T09:10:27.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c3400640 1 -- 172.21.15.173:0/387290921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c41452f0 msgr2=0x7f85c415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:27.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c3400640 1 --2- 172.21.15.173:0/387290921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c41452f0 0x7f85c415f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c3400640 1 -- 172.21.15.173:0/387290921 >> v2:172.21.15.194:3300/0 conn(0x7f85c40ce420 msgr2=0x7f85c40ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:27.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c3400640 1 --2- 172.21.15.173:0/387290921 >> v2:172.21.15.194:3300/0 conn(0x7f85c40ce420 0x7f85c40ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c3400640 1 -- 172.21.15.173:0/387290921 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c4071490 con 0x7f85c4144f10 2024-04-25T09:10:27.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c3400640 1 -- 172.21.15.173:0/387290921 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f85b4001a00 con 0x7f85c4144f10 2024-04-25T09:10:27.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c3400640 1 -- 172.21.15.173:0/387290921 >> v1:172.21.15.173:6789/0 conn(0x7f85c4144f10 legacy=0x7f85c406ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:27.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c3400640 1 --2- 172.21.15.173:0/387290921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85a80039c0 0x7f85a8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:27.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c3400640 1 --2- 172.21.15.173:0/387290921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c41452f0 0x7f85a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:27.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c3400640 1 --2- 172.21.15.173:0/387290921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85a8004d50 0x7f85a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:27.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c3400640 1 -- 172.21.15.173:0/387290921 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c406f190 con 0x7f85a8004d50 2024-04-25T09:10:27.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c3400640 1 -- 172.21.15.173:0/387290921 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a800b9d0 con 0x7f85a80039c0 2024-04-25T09:10:27.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c3400640 1 -- 172.21.15.173:0/387290921 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a800bb50 con 0x7f85c41452f0 2024-04-25T09:10:27.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c8a00640 1 --2- 172.21.15.173:0/387290921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85a80039c0 0x7f85a8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:27.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c9400640 1 --2- 172.21.15.173:0/387290921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85a8004d50 0x7f85a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:27.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c3e00640 1 --2- 172.21.15.173:0/387290921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c41452f0 0x7f85a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:27.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c8a00640 1 -- 172.21.15.173:0/387290921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c41452f0 msgr2=0x7f85a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:27.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c8a00640 1 --2- 172.21.15.173:0/387290921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c41452f0 0x7f85a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c8a00640 1 -- 172.21.15.173:0/387290921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85a8004d50 msgr2=0x7f85a80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:27.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c8a00640 1 --2- 172.21.15.173:0/387290921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85a8004d50 0x7f85a80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c8a00640 1 -- 172.21.15.173:0/387290921 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a8003530 con 0x7f85a80039c0 2024-04-25T09:10:27.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.183+0000 7f85c9400640 1 --2- 172.21.15.173:0/387290921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85a8004d50 0x7f85a80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:27.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.187+0000 7f85c8a00640 1 --2- 172.21.15.173:0/387290921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85a80039c0 0x7f85a8003de0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f85b400a920 tx=0x7f85b401d440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=858fa3929c3b9464 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:27.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.187+0000 7f85c3400640 1 -- 172.21.15.173:0/387290921 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b400a4c0 con 0x7f85a80039c0 2024-04-25T09:10:27.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.187+0000 7f85c3400640 1 -- 172.21.15.173:0/387290921 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b40072f0 con 0x7f85a80039c0 2024-04-25T09:10:27.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.187+0000 7f85c3400640 1 -- 172.21.15.173:0/387290921 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b40076e0 con 0x7f85a80039c0 2024-04-25T09:10:27.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.187+0000 7f85c9e00640 1 -- 172.21.15.173:0/387290921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85a80039c0 msgr2=0x7f85a8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:27.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.187+0000 7f85c9e00640 1 --2- 172.21.15.173:0/387290921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85a80039c0 0x7f85a8003de0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f85b400a920 tx=0x7f85b401d440 comp rx=0 tx=0).stop 2024-04-25T09:10:27.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.187+0000 7f85c9400640 1 -- 172.21.15.173:0/387290921 reap_dead start 2024-04-25T09:10:27.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.187+0000 7f85c9e00640 1 -- 172.21.15.173:0/387290921 shutdown_connections 2024-04-25T09:10:27.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.187+0000 7f85c9e00640 1 -- 172.21.15.173:0/387290921 >> 172.21.15.173:0/387290921 conn(0x7f85c4061d40 msgr2=0x7f85c406ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:27.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.187+0000 7f85c9e00640 1 -- 172.21.15.173:0/387290921 shutdown_connections 2024-04-25T09:10:27.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.187+0000 7f85c9e00640 1 -- 172.21.15.173:0/387290921 wait complete. 2024-04-25T09:10:27.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c9e00640 1 Processor -- start 2024-04-25T09:10:27.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c9e00640 1 -- start start 2024-04-25T09:10:27.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c9e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85a80039c0 0x7f85c40cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:27.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c9e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85c413d880 0x7f85c40cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:27.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c9e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c413cfa0 0x7f85c4140890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:27.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c9e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4071d30 con 0x7f85c413d880 2024-04-25T09:10:27.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c9e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4071a50 con 0x7f85a80039c0 2024-04-25T09:10:27.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c9e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c406e6c0 con 0x7f85c413cfa0 2024-04-25T09:10:27.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85c413d880 0x7f85c40cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:27.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85c413d880 0x7f85c40cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52236/0 (socket says 172.21.15.173:52236) 2024-04-25T09:10:27.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c3e00640 1 -- 172.21.15.173:0/4274459256 learned_addr learned my addr 172.21.15.173:0/4274459256 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:27.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c8a00640 1 --2- 172.21.15.173:0/4274459256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85a80039c0 0x7f85c40cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:27.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c9400640 1 --2- 172.21.15.173:0/4274459256 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c413cfa0 0x7f85c4140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:27.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c3e00640 1 -- 172.21.15.173:0/4274459256 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c413cfa0 msgr2=0x7f85c4140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:27.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c3e00640 1 --2- 172.21.15.173:0/4274459256 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c413cfa0 0x7f85c4140890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c3e00640 1 -- 172.21.15.173:0/4274459256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85a80039c0 msgr2=0x7f85c40cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:27.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c3e00640 1 --2- 172.21.15.173:0/4274459256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85a80039c0 0x7f85c40cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c3e00640 1 -- 172.21.15.173:0/4274459256 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c40ce1d0 con 0x7f85c413d880 2024-04-25T09:10:27.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c8a00640 1 --2- 172.21.15.173:0/4274459256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85a80039c0 0x7f85c40cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:27.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c9400640 1 --2- 172.21.15.173:0/4274459256 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c413cfa0 0x7f85c4140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:27.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c3e00640 1 --2- 172.21.15.173:0/4274459256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85c413d880 0x7f85c40cc360 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f85b00119d0 tx=0x7f85b0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:27.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c0c00640 1 -- 172.21.15.173:0/4274459256 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b000fb50 con 0x7f85c413d880 2024-04-25T09:10:27.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c0c00640 1 -- 172.21.15.173:0/4274459256 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b000fcf0 con 0x7f85c413d880 2024-04-25T09:10:27.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c9e00640 1 -- 172.21.15.173:0/4274459256 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c40ccbf0 con 0x7f85c413d880 2024-04-25T09:10:27.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c0c00640 1 -- 172.21.15.173:0/4274459256 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b000fea0 con 0x7f85c413d880 2024-04-25T09:10:27.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c9e00640 1 -- 172.21.15.173:0/4274459256 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c40cd490 con 0x7f85c413d880 2024-04-25T09:10:27.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.191+0000 7f85c9e00640 1 -- 172.21.15.173:0/4274459256 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c4073a40 con 0x7f85c413d880 2024-04-25T09:10:27.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.195+0000 7f85c0c00640 1 -- 172.21.15.173:0/4274459256 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f85b0012040 con 0x7f85c413d880 2024-04-25T09:10:27.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.195+0000 7f85c0c00640 1 --2- 172.21.15.173:0/4274459256 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f85a4066f90 0x7f85a4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:27.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.195+0000 7f85c0c00640 1 -- 172.21.15.173:0/4274459256 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f85b0085940 con 0x7f85c413d880 2024-04-25T09:10:27.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.195+0000 7f85c8a00640 1 --2- 172.21.15.173:0/4274459256 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f85a4066f90 0x7f85a4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:27.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.195+0000 7f85c8a00640 1 --2- 172.21.15.173:0/4274459256 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f85a4066f90 0x7f85a4069450 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f85b40aa000 tx=0x7f85b4001dd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:27.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.199+0000 7f85c0c00640 1 -- 172.21.15.173:0/4274459256 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f85b0019030 con 0x7f85c413d880 2024-04-25T09:10:27.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:27.387+0000 7f85c9e00640 1 -- 172.21.15.173:0/4274459256 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f85c406b640 con 0x7f85c413d880 2024-04-25T09:10:28.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.011+0000 7f85c0c00640 1 -- 172.21.15.173:0/4274459256 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v72) v1 ==== 122+0+0 (secure 0 0 0) 0x7f85b0056100 con 0x7f85c413d880 2024-04-25T09:10:28.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.015+0000 7f85c9e00640 1 -- 172.21.15.173:0/4274459256 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f85a4066f90 msgr2=0x7f85a4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.015+0000 7f85c9e00640 1 --2- 172.21.15.173:0/4274459256 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f85a4066f90 0x7f85a4069450 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f85b40aa000 tx=0x7f85b4001dd0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.015+0000 7f85c9e00640 1 -- 172.21.15.173:0/4274459256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85c413d880 msgr2=0x7f85c40cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.015+0000 7f85c9e00640 1 --2- 172.21.15.173:0/4274459256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85c413d880 0x7f85c40cc360 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f85b00119d0 tx=0x7f85b0011e90 comp rx=0 tx=0).stop 2024-04-25T09:10:28.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.015+0000 7f85c9e00640 1 -- 172.21.15.173:0/4274459256 shutdown_connections 2024-04-25T09:10:28.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.015+0000 7f85c9e00640 1 --2- 172.21.15.173:0/4274459256 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f85a4066f90 0x7f85a4069450 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.015+0000 7f85c9e00640 1 --2- 172.21.15.173:0/4274459256 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c413cfa0 0x7f85c4140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.015+0000 7f85c9e00640 1 --2- 172.21.15.173:0/4274459256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85c413d880 0x7f85c40cc360 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.015+0000 7f85c9e00640 1 --2- 172.21.15.173:0/4274459256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85a80039c0 0x7f85c40cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.015+0000 7f85c9e00640 1 -- 172.21.15.173:0/4274459256 >> 172.21.15.173:0/4274459256 conn(0x7f85c4061d40 msgr2=0x7f85c40b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:28.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.015+0000 7f85c9e00640 1 -- 172.21.15.173:0/4274459256 shutdown_connections 2024-04-25T09:10:28.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.015+0000 7f85c9e00640 1 -- 172.21.15.173:0/4274459256 wait complete. 2024-04-25T09:10:28.027 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:10:28.027 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:28.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.179+0000 7fba6b200640 1 Processor -- start 2024-04-25T09:10:28.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.179+0000 7fba6b200640 1 -- start start 2024-04-25T09:10:28.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.179+0000 7fba6b200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba6c15a590 0x7fba6c15b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:28.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.179+0000 7fba6b200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba6c15e320 con 0x7fba6c0cea90 2024-04-25T09:10:28.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.179+0000 7fba6b200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba6c15e5c0 con 0x7fba6c0d0a70 2024-04-25T09:10:28.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.179+0000 7fba6b200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c06f650 con 0x7fba6c15a590 2024-04-25T09:10:28.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.179+0000 7fba69400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fba6c0cea90 0x7fba6c0d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49764/0 (socket says 172.21.15.173:49764) 2024-04-25T09:10:28.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.179+0000 7fba69400640 1 -- 172.21.15.173:0/3589165437 learned_addr learned my addr 172.21.15.173:0/3589165437 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:28.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.179+0000 7fba69e00640 1 --2- 172.21.15.173:0/3589165437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba6c15a590 0x7fba6c15b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:28.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.179+0000 7fba68a00640 1 -- 172.21.15.173:0/3589165437 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3404936808 0 0) 0x7fba6c15e320 con 0x7fba6c0cea90 2024-04-25T09:10:28.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.179+0000 7fba68a00640 1 -- 172.21.15.173:0/3589165437 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba50003530 con 0x7fba6c0cea90 2024-04-25T09:10:28.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.179+0000 7fba68a00640 1 -- 172.21.15.173:0/3589165437 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402231444 0 0) 0x7fba6c15e5c0 con 0x7fba6c0d0a70 2024-04-25T09:10:28.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.179+0000 7fba68a00640 1 -- 172.21.15.173:0/3589165437 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba6c15e320 con 0x7fba6c0d0a70 2024-04-25T09:10:28.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.179+0000 7fba69e00640 1 -- 172.21.15.173:0/3589165437 >> v1:172.21.15.194:6789/0 conn(0x7fba6c0d0a70 legacy=0x7fba6c0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.179+0000 7fba69e00640 1 -- 172.21.15.173:0/3589165437 >> v1:172.21.15.173:6789/0 conn(0x7fba6c0cea90 legacy=0x7fba6c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.179+0000 7fba69e00640 1 -- 172.21.15.173:0/3589165437 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6c15e8a0 con 0x7fba6c15a590 2024-04-25T09:10:28.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.183+0000 7fba69e00640 1 --2- 172.21.15.173:0/3589165437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba6c15a590 0x7fba6c15b850 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0097f0 tx=0x7fba5c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f1dcbdb1def560e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:28.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.183+0000 7fba68a00640 1 -- 172.21.15.173:0/3589165437 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c0ab640 con 0x7fba6c15a590 2024-04-25T09:10:28.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.183+0000 7fba68a00640 1 -- 172.21.15.173:0/3589165437 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c0b0070 con 0x7fba6c15a590 2024-04-25T09:10:28.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.183+0000 7fba68a00640 1 -- 172.21.15.173:0/3589165437 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c0aba00 con 0x7fba6c15a590 2024-04-25T09:10:28.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.183+0000 7fba6b200640 1 -- 172.21.15.173:0/3589165437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba6c15a590 msgr2=0x7fba6c15b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.183+0000 7fba6b200640 1 --2- 172.21.15.173:0/3589165437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba6c15a590 0x7fba6c15b850 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0097f0 tx=0x7fba5c01c4b0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.183+0000 7fba6b200640 1 -- 172.21.15.173:0/3589165437 shutdown_connections 2024-04-25T09:10:28.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.183+0000 7fba6b200640 1 --2- 172.21.15.173:0/3589165437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba6c15a590 0x7fba6c15b850 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.183+0000 7fba6b200640 1 -- 172.21.15.173:0/3589165437 >> 172.21.15.173:0/3589165437 conn(0x7fba6c072710 msgr2=0x7fba6c099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:28.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.183+0000 7fba6b200640 1 -- 172.21.15.173:0/3589165437 shutdown_connections 2024-04-25T09:10:28.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.183+0000 7fba6b200640 1 -- 172.21.15.173:0/3589165437 wait complete. 2024-04-25T09:10:28.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6b200640 1 Processor -- start 2024-04-25T09:10:28.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6b200640 1 -- start start 2024-04-25T09:10:28.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba6c0cea90 0x7fba6c0c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:28.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6b200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba6c0d0a70 0x7fba6c155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:28.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6b200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba6c15a590 0x7fba6c0cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:28.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6b200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c15f0a0 con 0x7fba6c15a590 2024-04-25T09:10:28.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c0cee70 con 0x7fba6c0cea90 2024-04-25T09:10:28.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6b200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c0b2660 con 0x7fba6c0d0a70 2024-04-25T09:10:28.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba6c15a590 0x7fba6c0cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:28.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba6c15a590 0x7fba6c0cb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52252/0 (socket says 172.21.15.173:52252) 2024-04-25T09:10:28.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6a800640 1 -- 172.21.15.173:0/218146552 learned_addr learned my addr 172.21.15.173:0/218146552 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:28.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba69400640 1 --2- 172.21.15.173:0/218146552 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba6c0d0a70 0x7fba6c155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:28.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba69e00640 1 --2- 172.21.15.173:0/218146552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba6c0cea90 0x7fba6c0c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:28.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6a800640 1 -- 172.21.15.173:0/218146552 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba6c0d0a70 msgr2=0x7fba6c155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6a800640 1 --2- 172.21.15.173:0/218146552 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba6c0d0a70 0x7fba6c155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6a800640 1 -- 172.21.15.173:0/218146552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba6c0cea90 msgr2=0x7fba6c0c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6a800640 1 --2- 172.21.15.173:0/218146552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba6c0cea90 0x7fba6c0c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6a800640 1 -- 172.21.15.173:0/218146552 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6c0b20a0 con 0x7fba6c15a590 2024-04-25T09:10:28.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6a800640 1 --2- 172.21.15.173:0/218146552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba6c15a590 0x7fba6c0cb510 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fba6400c7a0 tx=0x7fba6400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:28.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba62000640 1 -- 172.21.15.173:0/218146552 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba64003b80 con 0x7fba6c15a590 2024-04-25T09:10:28.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba62000640 1 -- 172.21.15.173:0/218146552 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba64003d20 con 0x7fba6c15a590 2024-04-25T09:10:28.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba62000640 1 -- 172.21.15.173:0/218146552 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6400aa90 con 0x7fba6c15a590 2024-04-25T09:10:28.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6b200640 1 -- 172.21.15.173:0/218146552 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba6c0b2380 con 0x7fba6c15a590 2024-04-25T09:10:28.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6b200640 1 -- 172.21.15.173:0/218146552 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba6c155f10 con 0x7fba6c15a590 2024-04-25T09:10:28.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.187+0000 7fba6b200640 1 -- 172.21.15.173:0/218146552 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6c073a40 con 0x7fba6c15a590 2024-04-25T09:10:28.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.191+0000 7fba62000640 1 -- 172.21.15.173:0/218146552 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fba6400ac30 con 0x7fba6c15a590 2024-04-25T09:10:28.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.191+0000 7fba62000640 1 --2- 172.21.15.173:0/218146552 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba4c066f60 0x7fba4c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:28.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.191+0000 7fba62000640 1 -- 172.21.15.173:0/218146552 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fba64084fb0 con 0x7fba6c15a590 2024-04-25T09:10:28.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.191+0000 7fba69e00640 1 --2- 172.21.15.173:0/218146552 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba4c066f60 0x7fba4c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:28.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.191+0000 7fba69e00640 1 --2- 172.21.15.173:0/218146552 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba4c066f60 0x7fba4c069420 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0af000 tx=0x7fba5c0b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:28.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.195+0000 7fba62000640 1 -- 172.21.15.173:0/218146552 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fba64055870 con 0x7fba6c15a590 2024-04-25T09:10:28.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.379+0000 7fba6b200640 1 -- 172.21.15.173:0/218146552 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba6c0c7340 con 0x7fba6c15a590 2024-04-25T09:10:28.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.379+0000 7fba62000640 1 -- 172.21.15.173:0/218146552 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4949 (secure 0 0 0) 0x7fba64059910 con 0x7fba6c15a590 2024-04-25T09:10:28.369 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:28.369 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1519522112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1519522112},{"type":"v1","addr":"172.21.15.194:6835","nonce":1519522112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7555,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/548680290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":548680290},{"type":"v1","addr":"172.21.15.173:6836","nonce":548680290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2602621503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2602621503},{"type":"v1","addr":"172.21.15.194:6833","nonce":2602621503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:24.354981+0000","modified":"2024-04-25T09:10:27.392053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/1492125936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":1492125936},{"type":"v1","addr":"172.21.15.173:6837","nonce":1492125936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:10:28.369 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 72 2024-04-25T09:10:28.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.383+0000 7fba6b200640 1 -- 172.21.15.173:0/218146552 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba4c066f60 msgr2=0x7fba4c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.383+0000 7fba6b200640 1 --2- 172.21.15.173:0/218146552 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba4c066f60 0x7fba4c069420 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0af000 tx=0x7fba5c0b6040 comp rx=0 tx=0).stop 2024-04-25T09:10:28.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.383+0000 7fba6b200640 1 -- 172.21.15.173:0/218146552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba6c15a590 msgr2=0x7fba6c0cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.383+0000 7fba6b200640 1 --2- 172.21.15.173:0/218146552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba6c15a590 0x7fba6c0cb510 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fba6400c7a0 tx=0x7fba6400cc60 comp rx=0 tx=0).stop 2024-04-25T09:10:28.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.383+0000 7fba6b200640 1 -- 172.21.15.173:0/218146552 shutdown_connections 2024-04-25T09:10:28.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.383+0000 7fba6b200640 1 --2- 172.21.15.173:0/218146552 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba4c066f60 0x7fba4c069420 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.383+0000 7fba6b200640 1 --2- 172.21.15.173:0/218146552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba6c15a590 0x7fba6c0cb510 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.383+0000 7fba6b200640 1 --2- 172.21.15.173:0/218146552 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba6c0d0a70 0x7fba6c155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.383+0000 7fba6b200640 1 --2- 172.21.15.173:0/218146552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba6c0cea90 0x7fba6c0c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.383+0000 7fba6b200640 1 -- 172.21.15.173:0/218146552 >> 172.21.15.173:0/218146552 conn(0x7fba6c072710 msgr2=0x7fba6c0d0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:28.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.383+0000 7fba6b200640 1 -- 172.21.15.173:0/218146552 shutdown_connections 2024-04-25T09:10:28.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.383+0000 7fba6b200640 1 -- 172.21.15.173:0/218146552 wait complete. 2024-04-25T09:10:28.389 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:28.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.535+0000 7f74aae00640 1 Processor -- start 2024-04-25T09:10:28.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.535+0000 7f74aae00640 1 -- start start 2024-04-25T09:10:28.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.535+0000 7f74aae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74a40b3e70 0x7f74a40b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:28.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.535+0000 7f74aae00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f74a40aefa0 0x7f74a40b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:28.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.535+0000 7f74aae00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a40b4790 con 0x7f74a415edd0 2024-04-25T09:10:28.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.535+0000 7f74aae00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a406dd50 con 0x7f74a40aefa0 2024-04-25T09:10:28.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.535+0000 7f74aae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a415f320 con 0x7f74a40b3e70 2024-04-25T09:10:28.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.539+0000 7f749b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f74a40aefa0 0x7f74a40b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:28.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.539+0000 7f749b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f74a40aefa0 0x7f74a40b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52254/0 (socket says 172.21.15.173:52254) 2024-04-25T09:10:28.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.539+0000 7f749b400640 1 -- 172.21.15.173:0/1921326489 learned_addr learned my addr 172.21.15.173:0/1921326489 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:28.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.539+0000 7f74a3e00640 1 --2- 172.21.15.173:0/1921326489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74a40b3e70 0x7f74a40b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:28.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.539+0000 7f749b400640 1 -- 172.21.15.173:0/1921326489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74a40b3e70 msgr2=0x7f74a40b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:28.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.539+0000 7f749b400640 1 --2- 172.21.15.173:0/1921326489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74a40b3e70 0x7f74a40b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.539+0000 7f749b400640 1 -- 172.21.15.173:0/1921326489 >> v1:172.21.15.194:6789/0 conn(0x7f74a415edd0 legacy=0x7f74a40b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.539+0000 7f749b400640 1 -- 172.21.15.173:0/1921326489 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a406d420 con 0x7f74a40aefa0 2024-04-25T09:10:28.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.539+0000 7f749b400640 1 --2- 172.21.15.173:0/1921326489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74a40aefa0 0x7f74a40b2770 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f748c009e50 tx=0x7f748c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c4285a175d21b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:28.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.539+0000 7f74a3400640 1 -- 172.21.15.173:0/1921326489 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c0a58f0 con 0x7f74a40aefa0 2024-04-25T09:10:28.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.539+0000 7f74a3400640 1 -- 172.21.15.173:0/1921326489 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c0a5a90 con 0x7f74a40aefa0 2024-04-25T09:10:28.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.539+0000 7f74a3400640 1 -- 172.21.15.173:0/1921326489 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c0a5e60 con 0x7f74a40aefa0 2024-04-25T09:10:28.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74aae00640 1 -- 172.21.15.173:0/1921326489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74a40aefa0 msgr2=0x7f74a40b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74aae00640 1 --2- 172.21.15.173:0/1921326489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74a40aefa0 0x7f74a40b2770 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f748c009e50 tx=0x7f748c01ca00 comp rx=0 tx=0).stop 2024-04-25T09:10:28.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74aae00640 1 -- 172.21.15.173:0/1921326489 shutdown_connections 2024-04-25T09:10:28.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74aae00640 1 --2- 172.21.15.173:0/1921326489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74a40aefa0 0x7f74a40b2770 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74aae00640 1 --2- 172.21.15.173:0/1921326489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74a40b3e70 0x7f74a40b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74aae00640 1 -- 172.21.15.173:0/1921326489 >> 172.21.15.173:0/1921326489 conn(0x7f74a406ac90 msgr2=0x7f74a406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:28.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74aae00640 1 -- 172.21.15.173:0/1921326489 shutdown_connections 2024-04-25T09:10:28.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74aae00640 1 -- 172.21.15.173:0/1921326489 wait complete. 2024-04-25T09:10:28.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74aae00640 1 Processor -- start 2024-04-25T09:10:28.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74aae00640 1 -- start start 2024-04-25T09:10:28.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74aae00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74a40aefa0 0x7f74a4138f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:28.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74aae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74a40b3e70 0x7f74a415b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:28.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74aae00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74a415edd0 0x7f74a415bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:28.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74aae00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a406e1c0 con 0x7f74a415edd0 2024-04-25T09:10:28.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74aae00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a415aba0 con 0x7f74a40aefa0 2024-04-25T09:10:28.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74aae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a406e340 con 0x7f74a40b3e70 2024-04-25T09:10:28.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74a8e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74a415edd0 0x7f74a415bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:28.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74a8e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74a415edd0 0x7f74a415bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52260/0 (socket says 172.21.15.173:52260) 2024-04-25T09:10:28.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74a8e00640 1 -- 172.21.15.173:0/920448284 learned_addr learned my addr 172.21.15.173:0/920448284 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:28.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f74a3e00640 1 --2- 172.21.15.173:0/920448284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74a40aefa0 0x7f74a4138f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:28.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.543+0000 7f749b400640 1 --2- 172.21.15.173:0/920448284 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74a40b3e70 0x7f74a415b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:28.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.547+0000 7f74a8e00640 1 -- 172.21.15.173:0/920448284 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74a40b3e70 msgr2=0x7f74a415b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.547+0000 7f74a8e00640 1 --2- 172.21.15.173:0/920448284 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74a40b3e70 0x7f74a415b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.547+0000 7f74a8e00640 1 -- 172.21.15.173:0/920448284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74a40aefa0 msgr2=0x7f74a4138f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.547+0000 7f74a8e00640 1 --2- 172.21.15.173:0/920448284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74a40aefa0 0x7f74a4138f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.547+0000 7f74a8e00640 1 -- 172.21.15.173:0/920448284 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a415c2a0 con 0x7f74a415edd0 2024-04-25T09:10:28.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.547+0000 7f74a3e00640 1 --2- 172.21.15.173:0/920448284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74a40aefa0 0x7f74a4138f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:28.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.547+0000 7f749b400640 1 --2- 172.21.15.173:0/920448284 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74a40b3e70 0x7f74a415b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:28.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.547+0000 7f74a8e00640 1 --2- 172.21.15.173:0/920448284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74a415edd0 0x7f74a415bc90 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f749c00c430 tx=0x7f749c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:28.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.547+0000 7f74a0c00640 1 -- 172.21.15.173:0/920448284 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c005220 con 0x7f74a415edd0 2024-04-25T09:10:28.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.547+0000 7f74a0c00640 1 -- 172.21.15.173:0/920448284 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749c0053c0 con 0x7f74a415edd0 2024-04-25T09:10:28.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.547+0000 7f74a0c00640 1 -- 172.21.15.173:0/920448284 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c007270 con 0x7f74a415edd0 2024-04-25T09:10:28.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.547+0000 7f74aae00640 1 -- 172.21.15.173:0/920448284 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a415c580 con 0x7f74a415edd0 2024-04-25T09:10:28.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.547+0000 7f74aae00640 1 -- 172.21.15.173:0/920448284 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a415cb40 con 0x7f74a415edd0 2024-04-25T09:10:28.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.547+0000 7f74aae00640 1 -- 172.21.15.173:0/920448284 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a4073a40 con 0x7f74a415edd0 2024-04-25T09:10:28.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.547+0000 7f74a0c00640 1 -- 172.21.15.173:0/920448284 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f749c019020 con 0x7f74a415edd0 2024-04-25T09:10:28.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.547+0000 7f74a0c00640 1 --2- 172.21.15.173:0/920448284 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7480066fb0 0x7f7480069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:28.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.547+0000 7f74a0c00640 1 -- 172.21.15.173:0/920448284 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f749c084580 con 0x7f74a415edd0 2024-04-25T09:10:28.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.547+0000 7f74a3e00640 1 --2- 172.21.15.173:0/920448284 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7480066fb0 0x7f7480069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:28.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.551+0000 7f74a3e00640 1 --2- 172.21.15.173:0/920448284 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7480066fb0 0x7f7480069470 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f74a40ae4e0 tx=0x7f7494008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:28.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.555+0000 7f74a0c00640 1 -- 172.21.15.173:0/920448284 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f749c0553e0 con 0x7f74a415edd0 2024-04-25T09:10:28.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.707+0000 7f74aae00640 1 -- 172.21.15.173:0/920448284 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74a406f1c0 con 0x7f74a415edd0 2024-04-25T09:10:28.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.707+0000 7f74a0c00640 1 -- 172.21.15.173:0/920448284 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16944 (secure 0 0 0) 0x7f749c054ce0 con 0x7f74a415edd0 2024-04-25T09:10:28.697 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:28.698 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":109,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:10:25.985670+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:22.062377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:23.359080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:28.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.711+0000 7f74aae00640 1 -- 172.21.15.173:0/920448284 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7480066fb0 msgr2=0x7f7480069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.711+0000 7f74aae00640 1 --2- 172.21.15.173:0/920448284 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7480066fb0 0x7f7480069470 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f74a40ae4e0 tx=0x7f7494008040 comp rx=0 tx=0).stop 2024-04-25T09:10:28.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.711+0000 7f74aae00640 1 -- 172.21.15.173:0/920448284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74a415edd0 msgr2=0x7f74a415bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.711+0000 7f74aae00640 1 --2- 172.21.15.173:0/920448284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74a415edd0 0x7f74a415bc90 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f749c00c430 tx=0x7f749c00c8f0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.711+0000 7f74aae00640 1 -- 172.21.15.173:0/920448284 shutdown_connections 2024-04-25T09:10:28.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.711+0000 7f74aae00640 1 --2- 172.21.15.173:0/920448284 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7480066fb0 0x7f7480069470 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.711+0000 7f74aae00640 1 --2- 172.21.15.173:0/920448284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74a415edd0 0x7f74a415bc90 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.711+0000 7f74aae00640 1 --2- 172.21.15.173:0/920448284 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74a40b3e70 0x7f74a415b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.711+0000 7f74aae00640 1 --2- 172.21.15.173:0/920448284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74a40aefa0 0x7f74a4138f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.711+0000 7f74aae00640 1 -- 172.21.15.173:0/920448284 >> 172.21.15.173:0/920448284 conn(0x7f74a406ac90 msgr2=0x7f74a414fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:28.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.711+0000 7f74aae00640 1 -- 172.21.15.173:0/920448284 shutdown_connections 2024-04-25T09:10:28.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.711+0000 7f74aae00640 1 -- 172.21.15.173:0/920448284 wait complete. 2024-04-25T09:10:28.719 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:10:28.719 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:10:28.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.867+0000 7fdd03800640 1 Processor -- start 2024-04-25T09:10:28.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.867+0000 7fdd03800640 1 -- start start 2024-04-25T09:10:28.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.867+0000 7fdd03800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcfc0aefa0 0x7fdcfc0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:28.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.867+0000 7fdd03800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdcfc15edd0 0x7fdcfc0cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:28.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.867+0000 7fdd03800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcfc15f320 con 0x7fdcfc0b3e70 2024-04-25T09:10:28.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.867+0000 7fdd03800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcfc06dd50 con 0x7fdcfc15edd0 2024-04-25T09:10:28.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.867+0000 7fdd03800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc06d420 con 0x7fdcfc0aefa0 2024-04-25T09:10:28.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.867+0000 7fdd00e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fdcfc0b3e70 0x7fdcfc0b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49768/0 (socket says 172.21.15.173:49768) 2024-04-25T09:10:28.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.867+0000 7fdd00e00640 1 -- 172.21.15.173:0/1006519041 learned_addr learned my addr 172.21.15.173:0/1006519041 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:28.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.867+0000 7fdd01800640 1 --2- 172.21.15.173:0/1006519041 >> v2:172.21.15.173:3300/0 conn(0x7fdcfc15edd0 0x7fdcfc0cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:28.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.867+0000 7fdcf3e00640 1 --2- 172.21.15.173:0/1006519041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcfc0aefa0 0x7fdcfc0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:28.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.867+0000 7fdcfbe00640 1 -- 172.21.15.173:0/1006519041 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953717827 0 0) 0x7fdcfc15f320 con 0x7fdcfc0b3e70 2024-04-25T09:10:28.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.867+0000 7fdcfbe00640 1 -- 172.21.15.173:0/1006519041 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdce0003530 con 0x7fdcfc0b3e70 2024-04-25T09:10:28.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.867+0000 7fdd01800640 1 -- 172.21.15.173:0/1006519041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcfc0aefa0 msgr2=0x7fdcfc0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:28.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.867+0000 7fdd01800640 1 --2- 172.21.15.173:0/1006519041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcfc0aefa0 0x7fdcfc0cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.867+0000 7fdd01800640 1 -- 172.21.15.173:0/1006519041 >> v1:172.21.15.173:6789/0 conn(0x7fdcfc0b3e70 legacy=0x7fdcfc0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.867+0000 7fdd01800640 1 -- 172.21.15.173:0/1006519041 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc06d700 con 0x7fdcfc15edd0 2024-04-25T09:10:28.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.871+0000 7fdd01800640 1 --2- 172.21.15.173:0/1006519041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc15edd0 0x7fdcfc0cdce0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009d90 tx=0x7fdcf401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c73decbe499f95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:28.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.871+0000 7fdcfbe00640 1 -- 172.21.15.173:0/1006519041 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf40b2070 con 0x7fdcfc15edd0 2024-04-25T09:10:28.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.871+0000 7fdcfbe00640 1 -- 172.21.15.173:0/1006519041 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf40a59f0 con 0x7fdcfc15edd0 2024-04-25T09:10:28.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.871+0000 7fdcfbe00640 1 -- 172.21.15.173:0/1006519041 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf40a5dc0 con 0x7fdcfc15edd0 2024-04-25T09:10:28.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.871+0000 7fdd03800640 1 -- 172.21.15.173:0/1006519041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc15edd0 msgr2=0x7fdcfc0cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.871+0000 7fdd03800640 1 --2- 172.21.15.173:0/1006519041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc15edd0 0x7fdcfc0cdce0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009d90 tx=0x7fdcf401c940 comp rx=0 tx=0).stop 2024-04-25T09:10:28.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.871+0000 7fdd03800640 1 -- 172.21.15.173:0/1006519041 shutdown_connections 2024-04-25T09:10:28.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.871+0000 7fdd03800640 1 --2- 172.21.15.173:0/1006519041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc15edd0 0x7fdcfc0cdce0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.871+0000 7fdd03800640 1 --2- 172.21.15.173:0/1006519041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcfc0aefa0 0x7fdcfc0cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.871+0000 7fdd03800640 1 -- 172.21.15.173:0/1006519041 >> 172.21.15.173:0/1006519041 conn(0x7fdcfc06ac90 msgr2=0x7fdcfc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:28.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.871+0000 7fdd03800640 1 -- 172.21.15.173:0/1006519041 shutdown_connections 2024-04-25T09:10:28.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.871+0000 7fdd03800640 1 -- 172.21.15.173:0/1006519041 wait complete. 2024-04-25T09:10:28.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdd03800640 1 Processor -- start 2024-04-25T09:10:28.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdd03800640 1 -- start start 2024-04-25T09:10:28.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdd03800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcfc0aefa0 0x7fdcfc14fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:28.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdd03800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc0b3e70 0x7fdcfc15d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:28.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdd03800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcfc15edd0 0x7fdcfc13d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:28.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdd03800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc167930 con 0x7fdcfc0b3e70 2024-04-25T09:10:28.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdd03800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc1677b0 con 0x7fdcfc0aefa0 2024-04-25T09:10:28.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdd03800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc167ab0 con 0x7fdcfc15edd0 2024-04-25T09:10:28.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdcf3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc0b3e70 0x7fdcfc15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:28.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdcf3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc0b3e70 0x7fdcfc15d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52286/0 (socket says 172.21.15.173:52286) 2024-04-25T09:10:28.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdcf3e00640 1 -- 172.21.15.173:0/3729339276 learned_addr learned my addr 172.21.15.173:0/3729339276 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:28.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdd00e00640 1 --2- 172.21.15.173:0/3729339276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcfc0aefa0 0x7fdcfc14fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:28.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdd01800640 1 --2- 172.21.15.173:0/3729339276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcfc15edd0 0x7fdcfc13d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:28.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdcf3e00640 1 -- 172.21.15.173:0/3729339276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcfc15edd0 msgr2=0x7fdcfc13d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdcf3e00640 1 --2- 172.21.15.173:0/3729339276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcfc15edd0 0x7fdcfc13d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdcf3e00640 1 -- 172.21.15.173:0/3729339276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcfc0aefa0 msgr2=0x7fdcfc14fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:28.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdcf3e00640 1 --2- 172.21.15.173:0/3729339276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcfc0aefa0 0x7fdcfc14fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:28.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdcf3e00640 1 -- 172.21.15.173:0/3729339276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc15db70 con 0x7fdcfc0b3e70 2024-04-25T09:10:28.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdd01800640 1 --2- 172.21.15.173:0/3729339276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcfc15edd0 0x7fdcfc13d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:28.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdcf3e00640 1 --2- 172.21.15.173:0/3729339276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc0b3e70 0x7fdcfc15d170 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fdce400e930 tx=0x7fdce400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:28.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdcf9600640 1 -- 172.21.15.173:0/3729339276 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce4017070 con 0x7fdcfc0b3e70 2024-04-25T09:10:28.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdcf9600640 1 -- 172.21.15.173:0/3729339276 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce400ca00 con 0x7fdcfc0b3e70 2024-04-25T09:10:28.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdcf9600640 1 -- 172.21.15.173:0/3729339276 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce400cdb0 con 0x7fdcfc0b3e70 2024-04-25T09:10:28.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdd03800640 1 -- 172.21.15.173:0/3729339276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc13dfc0 con 0x7fdcfc0b3e70 2024-04-25T09:10:28.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdd03800640 1 -- 172.21.15.173:0/3729339276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcfc150290 con 0x7fdcfc0b3e70 2024-04-25T09:10:28.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.875+0000 7fdd03800640 1 -- 172.21.15.173:0/3729339276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcfc073a40 con 0x7fdcfc0b3e70 2024-04-25T09:10:28.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.879+0000 7fdcf9600640 1 -- 172.21.15.173:0/3729339276 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdce401a070 con 0x7fdcfc0b3e70 2024-04-25T09:10:28.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.879+0000 7fdcf9600640 1 --2- 172.21.15.173:0/3729339276 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdcd8066f60 0x7fdcd8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:28.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.879+0000 7fdcf9600640 1 -- 172.21.15.173:0/3729339276 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdce40855b0 con 0x7fdcfc0b3e70 2024-04-25T09:10:28.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.879+0000 7fdd00e00640 1 --2- 172.21.15.173:0/3729339276 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdcd8066f60 0x7fdcd8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:28.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.879+0000 7fdd00e00640 1 --2- 172.21.15.173:0/3729339276 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdcd8066f60 0x7fdcd8069420 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fdcec007fd0 tx=0x7fdcec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:28.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:28.883+0000 7fdcf9600640 1 -- 172.21.15.173:0/3729339276 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdce4055e00 con 0x7fdcfc0b3e70 2024-04-25T09:10:29.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.035+0000 7fdd03800640 1 -- 172.21.15.173:0/3729339276 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdcfc06f1c0 con 0x7fdcd8066f60 2024-04-25T09:10:29.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.043+0000 7fdcf9600640 1 -- 172.21.15.173:0/3729339276 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243976 (secure 0 0 0) 0x7fdcfc06f1c0 con 0x7fdcd8066f60 2024-04-25T09:10:29.034 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:29.035 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:10:29.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.047+0000 7fdd03800640 1 -- 172.21.15.173:0/3729339276 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdcd8066f60 msgr2=0x7fdcd8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.047+0000 7fdd03800640 1 --2- 172.21.15.173:0/3729339276 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdcd8066f60 0x7fdcd8069420 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fdcec007fd0 tx=0x7fdcec009040 comp rx=0 tx=0).stop 2024-04-25T09:10:29.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.047+0000 7fdd03800640 1 -- 172.21.15.173:0/3729339276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc0b3e70 msgr2=0x7fdcfc15d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.047+0000 7fdd03800640 1 --2- 172.21.15.173:0/3729339276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc0b3e70 0x7fdcfc15d170 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fdce400e930 tx=0x7fdce400edf0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.047+0000 7fdd03800640 1 -- 172.21.15.173:0/3729339276 shutdown_connections 2024-04-25T09:10:29.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.047+0000 7fdd03800640 1 --2- 172.21.15.173:0/3729339276 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdcd8066f60 0x7fdcd8069420 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.047+0000 7fdd03800640 1 --2- 172.21.15.173:0/3729339276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcfc15edd0 0x7fdcfc13d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.047+0000 7fdd03800640 1 --2- 172.21.15.173:0/3729339276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdcfc0b3e70 0x7fdcfc15d170 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.047+0000 7fdd03800640 1 --2- 172.21.15.173:0/3729339276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcfc0aefa0 0x7fdcfc14fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.047+0000 7fdd03800640 1 -- 172.21.15.173:0/3729339276 >> 172.21.15.173:0/3729339276 conn(0x7fdcfc06ac90 msgr2=0x7fdcfc151790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:29.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.047+0000 7fdd03800640 1 -- 172.21.15.173:0/3729339276 shutdown_connections 2024-04-25T09:10:29.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.047+0000 7fdd03800640 1 -- 172.21.15.173:0/3729339276 wait complete. 2024-04-25T09:10:29.054 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-04-25T09:10:28.828465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":168,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":110,"acting":110,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":417768,"kb_used_data":11452,"kb_used_omap":12,"kb_used_meta":406195,"kb_avail":754556952,"statfs":{"total":773094113280,"available":772666318848,"internally_reserved":0,"allocated":11726848,"data_stored":6041454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":415944240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.862895"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.980631+0000","last_change":"2024-04-25T09:10:23.980631+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.980631+0000","last_undegraded":"2024-04-25T09:10:23.980631+0000","last_fullsized":"2024-04-25T09:10:23.980631+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992093+0000","last_change":"2024-04-25T09:10:25.004287+0000","last_active":"2024-04-25T09:10:25.992093+0000","last_peered":"2024-04-25T09:10:25.992093+0000","last_clean":"2024-04-25T09:10:25.992093+0000","last_became_active":"2024-04-25T09:10:25.002537+0000","last_became_peered":"2024-04-25T09:10:25.002537+0000","last_unstale":"2024-04-25T09:10:25.992093+0000","last_undegraded":"2024-04-25T09:10:25.992093+0000","last_fullsized":"2024-04-25T09:10:25.992093+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:25.248880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.979654+0000","last_change":"2024-04-25T09:10:23.979654+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.979654+0000","last_undegraded":"2024-04-25T09:10:23.979654+0000","last_fullsized":"2024-04-25T09:10:23.979654+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153900+0000","last_change":"2024-04-25T09:10:25.005698+0000","last_active":"2024-04-25T09:10:26.153900+0000","last_peered":"2024-04-25T09:10:26.153900+0000","last_clean":"2024-04-25T09:10:26.153900+0000","last_became_active":"2024-04-25T09:10:25.005083+0000","last_became_peered":"2024-04-25T09:10:25.005083+0000","last_unstale":"2024-04-25T09:10:26.153900+0000","last_undegraded":"2024-04-25T09:10:26.153900+0000","last_fullsized":"2024-04-25T09:10:26.153900+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:37.012652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153563+0000","last_change":"2024-04-25T09:10:25.010387+0000","last_active":"2024-04-25T09:10:26.153563+0000","last_peered":"2024-04-25T09:10:26.153563+0000","last_clean":"2024-04-25T09:10:26.153563+0000","last_became_active":"2024-04-25T09:10:25.008940+0000","last_became_peered":"2024-04-25T09:10:25.008940+0000","last_unstale":"2024-04-25T09:10:26.153563+0000","last_undegraded":"2024-04-25T09:10:26.153563+0000","last_fullsized":"2024-04-25T09:10:26.153563+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:40.367585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153361+0000","last_change":"2024-04-25T09:10:25.005571+0000","last_active":"2024-04-25T09:10:26.153361+0000","last_peered":"2024-04-25T09:10:26.153361+0000","last_clean":"2024-04-25T09:10:26.153361+0000","last_became_active":"2024-04-25T09:10:25.005263+0000","last_became_peered":"2024-04-25T09:10:25.005263+0000","last_unstale":"2024-04-25T09:10:26.153361+0000","last_undegraded":"2024-04-25T09:10:26.153361+0000","last_fullsized":"2024-04-25T09:10:26.153361+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:07.504059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992691+0000","last_change":"2024-04-25T09:10:25.003489+0000","last_active":"2024-04-25T09:10:25.992691+0000","last_peered":"2024-04-25T09:10:25.992691+0000","last_clean":"2024-04-25T09:10:25.992691+0000","last_became_active":"2024-04-25T09:10:25.003239+0000","last_became_peered":"2024-04-25T09:10:25.003239+0000","last_unstale":"2024-04-25T09:10:25.992691+0000","last_undegraded":"2024-04-25T09:10:25.992691+0000","last_fullsized":"2024-04-25T09:10:25.992691+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:27.352442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.979790+0000","last_change":"2024-04-25T09:10:23.979790+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.979790+0000","last_undegraded":"2024-04-25T09:10:23.979790+0000","last_fullsized":"2024-04-25T09:10:23.979790+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.978749+0000","last_change":"2024-04-25T09:10:23.978749+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.978749+0000","last_undegraded":"2024-04-25T09:10:23.978749+0000","last_fullsized":"2024-04-25T09:10:23.978749+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992737+0000","last_change":"2024-04-25T09:10:25.009613+0000","last_active":"2024-04-25T09:10:25.992737+0000","last_peered":"2024-04-25T09:10:25.992737+0000","last_clean":"2024-04-25T09:10:25.992737+0000","last_became_active":"2024-04-25T09:10:25.009123+0000","last_became_peered":"2024-04-25T09:10:25.009123+0000","last_unstale":"2024-04-25T09:10:25.992737+0000","last_undegraded":"2024-04-25T09:10:25.992737+0000","last_fullsized":"2024-04-25T09:10:25.992737+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:25.292786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992145+0000","last_change":"2024-04-25T09:10:24.998492+0000","last_active":"2024-04-25T09:10:25.992145+0000","last_peered":"2024-04-25T09:10:25.992145+0000","last_clean":"2024-04-25T09:10:25.992145+0000","last_became_active":"2024-04-25T09:10:24.998110+0000","last_became_peered":"2024-04-25T09:10:24.998110+0000","last_unstale":"2024-04-25T09:10:25.992145+0000","last_undegraded":"2024-04-25T09:10:25.992145+0000","last_fullsized":"2024-04-25T09:10:25.992145+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:43.209701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968945+0000","last_change":"2024-04-25T09:10:22.968945+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968945+0000","last_undegraded":"2024-04-25T09:10:22.968945+0000","last_fullsized":"2024-04-25T09:10:22.968945+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992257+0000","last_change":"2024-04-25T09:10:25.001829+0000","last_active":"2024-04-25T09:10:25.992257+0000","last_peered":"2024-04-25T09:10:25.992257+0000","last_clean":"2024-04-25T09:10:25.992257+0000","last_became_active":"2024-04-25T09:10:25.001529+0000","last_became_peered":"2024-04-25T09:10:25.001529+0000","last_unstale":"2024-04-25T09:10:25.992257+0000","last_undegraded":"2024-04-25T09:10:25.992257+0000","last_fullsized":"2024-04-25T09:10:25.992257+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:27.725078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993011+0000","last_change":"2024-04-25T09:10:23.997442+0000","last_active":"2024-04-25T09:10:25.993011+0000","last_peered":"2024-04-25T09:10:25.993011+0000","last_clean":"2024-04-25T09:10:25.993011+0000","last_became_active":"2024-04-25T09:10:23.994906+0000","last_became_peered":"2024-04-25T09:10:23.994906+0000","last_unstale":"2024-04-25T09:10:25.993011+0000","last_undegraded":"2024-04-25T09:10:25.993011+0000","last_fullsized":"2024-04-25T09:10:25.993011+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:08.860155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968321+0000","last_change":"2024-04-25T09:10:22.968321+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968321+0000","last_undegraded":"2024-04-25T09:10:22.968321+0000","last_fullsized":"2024-04-25T09:10:22.968321+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":4,"reported_epoch":107,"state":"creating+activating","last_fresh":"2024-04-25T09:10:23.981437+0000","last_change":"2024-04-25T09:10:23.975454+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.981437+0000","last_undegraded":"2024-04-25T09:10:23.981437+0000","last_fullsized":"2024-04-25T09:10:23.981437+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153708+0000","last_change":"2024-04-25T09:10:23.988905+0000","last_active":"2024-04-25T09:10:26.153708+0000","last_peered":"2024-04-25T09:10:26.153708+0000","last_clean":"2024-04-25T09:10:26.153708+0000","last_became_active":"2024-04-25T09:10:23.988625+0000","last_became_peered":"2024-04-25T09:10:23.988625+0000","last_unstale":"2024-04-25T09:10:26.153708+0000","last_undegraded":"2024-04-25T09:10:26.153708+0000","last_fullsized":"2024-04-25T09:10:26.153708+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:48.797438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.971948+0000","last_change":"2024-04-25T09:10:22.971948+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.971948+0000","last_undegraded":"2024-04-25T09:10:22.971948+0000","last_fullsized":"2024-04-25T09:10:22.971948+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.967751+0000","last_change":"2024-04-25T09:10:22.967751+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.967751+0000","last_undegraded":"2024-04-25T09:10:22.967751+0000","last_fullsized":"2024-04-25T09:10:22.967751+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968945+0000","last_change":"2024-04-25T09:10:22.968945+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968945+0000","last_undegraded":"2024-04-25T09:10:22.968945+0000","last_fullsized":"2024-04-25T09:10:22.968945+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.969147+0000","last_change":"2024-04-25T09:10:22.969147+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.969147+0000","last_undegraded":"2024-04-25T09:10:22.969147+0000","last_fullsized":"2024-04-25T09:10:22.969147+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.974851+0000","last_change":"2024-04-25T09:10:23.974851+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.974851+0000","last_undegraded":"2024-04-25T09:10:23.974851+0000","last_fullsized":"2024-04-25T09:10:23.974851+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.973104+0000","last_change":"2024-04-25T09:10:22.973104+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.973104+0000","last_undegraded":"2024-04-25T09:10:22.973104+0000","last_fullsized":"2024-04-25T09:10:22.973104+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992521+0000","last_change":"2024-04-25T09:10:25.009042+0000","last_active":"2024-04-25T09:10:25.992521+0000","last_peered":"2024-04-25T09:10:25.992521+0000","last_clean":"2024-04-25T09:10:25.992521+0000","last_became_active":"2024-04-25T09:10:25.008796+0000","last_became_peered":"2024-04-25T09:10:25.008796+0000","last_unstale":"2024-04-25T09:10:25.992521+0000","last_undegraded":"2024-04-25T09:10:25.992521+0000","last_fullsized":"2024-04-25T09:10:25.992521+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:14.584473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"108'3","reported_seq":17,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153816+0000","last_change":"2024-04-25T09:10:23.987279+0000","last_active":"2024-04-25T09:10:26.153816+0000","last_peered":"2024-04-25T09:10:26.153816+0000","last_clean":"2024-04-25T09:10:26.153816+0000","last_became_active":"2024-04-25T09:10:23.986988+0000","last_became_peered":"2024-04-25T09:10:23.986988+0000","last_unstale":"2024-04-25T09:10:26.153816+0000","last_undegraded":"2024-04-25T09:10:26.153816+0000","last_fullsized":"2024-04-25T09:10:26.153816+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:08.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.976158+0000","last_change":"2024-04-25T09:10:23.976158+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.976158+0000","last_undegraded":"2024-04-25T09:10:23.976158+0000","last_fullsized":"2024-04-25T09:10:23.976158+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.969158+0000","last_change":"2024-04-25T09:10:22.969158+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.969158+0000","last_undegraded":"2024-04-25T09:10:22.969158+0000","last_fullsized":"2024-04-25T09:10:22.969158+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":3,"reported_epoch":107,"state":"creating+activating","last_fresh":"2024-04-25T09:10:23.975281+0000","last_change":"2024-04-25T09:10:23.975281+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.975281+0000","last_undegraded":"2024-04-25T09:10:23.975281+0000","last_fullsized":"2024-04-25T09:10:23.975281+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.969374+0000","last_change":"2024-04-25T09:10:22.969374+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.969374+0000","last_undegraded":"2024-04-25T09:10:22.969374+0000","last_fullsized":"2024-04-25T09:10:22.969374+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993005+0000","last_change":"2024-04-25T09:10:24.995940+0000","last_active":"2024-04-25T09:10:25.993005+0000","last_peered":"2024-04-25T09:10:25.993005+0000","last_clean":"2024-04-25T09:10:25.993005+0000","last_became_active":"2024-04-25T09:10:24.995666+0000","last_became_peered":"2024-04-25T09:10:24.995666+0000","last_unstale":"2024-04-25T09:10:25.993005+0000","last_undegraded":"2024-04-25T09:10:25.993005+0000","last_fullsized":"2024-04-25T09:10:25.993005+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:10.104554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992353+0000","last_change":"2024-04-25T09:10:23.990205+0000","last_active":"2024-04-25T09:10:25.992353+0000","last_peered":"2024-04-25T09:10:25.992353+0000","last_clean":"2024-04-25T09:10:25.992353+0000","last_became_active":"2024-04-25T09:10:23.989778+0000","last_became_peered":"2024-04-25T09:10:23.989778+0000","last_unstale":"2024-04-25T09:10:25.992353+0000","last_undegraded":"2024-04-25T09:10:25.992353+0000","last_fullsized":"2024-04-25T09:10:25.992353+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:43.287970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968775+0000","last_change":"2024-04-25T09:10:22.968775+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968775+0000","last_undegraded":"2024-04-25T09:10:22.968775+0000","last_fullsized":"2024-04-25T09:10:22.968775+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992235+0000","last_change":"2024-04-25T09:10:25.002077+0000","last_active":"2024-04-25T09:10:25.992235+0000","last_peered":"2024-04-25T09:10:25.992235+0000","last_clean":"2024-04-25T09:10:25.992235+0000","last_became_active":"2024-04-25T09:10:25.001788+0000","last_became_peered":"2024-04-25T09:10:25.001788+0000","last_unstale":"2024-04-25T09:10:25.992235+0000","last_undegraded":"2024-04-25T09:10:25.992235+0000","last_fullsized":"2024-04-25T09:10:25.992235+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:53.146010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968012+0000","last_change":"2024-04-25T09:10:22.968012+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968012+0000","last_undegraded":"2024-04-25T09:10:22.968012+0000","last_fullsized":"2024-04-25T09:10:22.968012+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153935+0000","last_change":"2024-04-25T09:10:23.985775+0000","last_active":"2024-04-25T09:10:26.153935+0000","last_peered":"2024-04-25T09:10:26.153935+0000","last_clean":"2024-04-25T09:10:26.153935+0000","last_became_active":"2024-04-25T09:10:23.985439+0000","last_became_peered":"2024-04-25T09:10:23.985439+0000","last_unstale":"2024-04-25T09:10:26.153935+0000","last_undegraded":"2024-04-25T09:10:26.153935+0000","last_fullsized":"2024-04-25T09:10:26.153935+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:34.204925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.976865+0000","last_change":"2024-04-25T09:10:23.976865+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.976865+0000","last_undegraded":"2024-04-25T09:10:23.976865+0000","last_fullsized":"2024-04-25T09:10:23.976865+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.971957+0000","last_change":"2024-04-25T09:10:22.971957+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.971957+0000","last_undegraded":"2024-04-25T09:10:22.971957+0000","last_fullsized":"2024-04-25T09:10:22.971957+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992790+0000","last_change":"2024-04-25T09:10:23.993992+0000","last_active":"2024-04-25T09:10:25.992790+0000","last_peered":"2024-04-25T09:10:25.992790+0000","last_clean":"2024-04-25T09:10:25.992790+0000","last_became_active":"2024-04-25T09:10:23.993527+0000","last_became_peered":"2024-04-25T09:10:23.993527+0000","last_unstale":"2024-04-25T09:10:25.992790+0000","last_undegraded":"2024-04-25T09:10:25.992790+0000","last_fullsized":"2024-04-25T09:10:25.992790+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:12.659252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992387+0000","last_change":"2024-04-25T09:10:23.993352+0000","last_active":"2024-04-25T09:10:25.992387+0000","last_peered":"2024-04-25T09:10:25.992387+0000","last_clean":"2024-04-25T09:10:25.992387+0000","last_became_active":"2024-04-25T09:10:23.993098+0000","last_became_peered":"2024-04-25T09:10:23.993098+0000","last_unstale":"2024-04-25T09:10:25.992387+0000","last_undegraded":"2024-04-25T09:10:25.992387+0000","last_fullsized":"2024-04-25T09:10:25.992387+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:48.781048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968321+0000","last_change":"2024-04-25T09:10:22.968321+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968321+0000","last_undegraded":"2024-04-25T09:10:22.968321+0000","last_fullsized":"2024-04-25T09:10:22.968321+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992978+0000","last_change":"2024-04-25T09:10:25.011971+0000","last_active":"2024-04-25T09:10:25.992978+0000","last_peered":"2024-04-25T09:10:25.992978+0000","last_clean":"2024-04-25T09:10:25.992978+0000","last_became_active":"2024-04-25T09:10:25.011686+0000","last_became_peered":"2024-04-25T09:10:25.011686+0000","last_unstale":"2024-04-25T09:10:25.992978+0000","last_undegraded":"2024-04-25T09:10:25.992978+0000","last_fullsized":"2024-04-25T09:10:25.992978+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:40.123611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992195+0000","last_change":"2024-04-25T09:10:23.997986+0000","last_active":"2024-04-25T09:10:25.992195+0000","last_peered":"2024-04-25T09:10:25.992195+0000","last_clean":"2024-04-25T09:10:25.992195+0000","last_became_active":"2024-04-25T09:10:23.997682+0000","last_became_peered":"2024-04-25T09:10:23.997682+0000","last_unstale":"2024-04-25T09:10:25.992195+0000","last_undegraded":"2024-04-25T09:10:25.992195+0000","last_fullsized":"2024-04-25T09:10:25.992195+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:45.716419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":3,"reported_epoch":107,"state":"creating+activating","last_fresh":"2024-04-25T09:10:23.975258+0000","last_change":"2024-04-25T09:10:23.975258+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.975258+0000","last_undegraded":"2024-04-25T09:10:23.975258+0000","last_fullsized":"2024-04-25T09:10:23.975258+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.972613+0000","last_change":"2024-04-25T09:10:22.972613+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.972613+0000","last_undegraded":"2024-04-25T09:10:22.972613+0000","last_fullsized":"2024-04-25T09:10:22.972613+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968620+0000","last_change":"2024-04-25T09:10:22.968620+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968620+0000","last_undegraded":"2024-04-25T09:10:22.968620+0000","last_fullsized":"2024-04-25T09:10:22.968620+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":3,"reported_epoch":107,"state":"creating+activating","last_fresh":"2024-04-25T09:10:23.975038+0000","last_change":"2024-04-25T09:10:23.975038+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.975038+0000","last_undegraded":"2024-04-25T09:10:23.975038+0000","last_fullsized":"2024-04-25T09:10:23.975038+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992710+0000","last_change":"2024-04-25T09:10:25.009607+0000","last_active":"2024-04-25T09:10:25.992710+0000","last_peered":"2024-04-25T09:10:25.992710+0000","last_clean":"2024-04-25T09:10:25.992710+0000","last_became_active":"2024-04-25T09:10:25.009341+0000","last_became_peered":"2024-04-25T09:10:25.009341+0000","last_unstale":"2024-04-25T09:10:25.992710+0000","last_undegraded":"2024-04-25T09:10:25.992710+0000","last_fullsized":"2024-04-25T09:10:25.992710+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:39.499479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.967933+0000","last_change":"2024-04-25T09:10:22.967933+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.967933+0000","last_undegraded":"2024-04-25T09:10:22.967933+0000","last_fullsized":"2024-04-25T09:10:22.967933+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992782+0000","last_change":"2024-04-25T09:10:25.007602+0000","last_active":"2024-04-25T09:10:25.992782+0000","last_peered":"2024-04-25T09:10:25.992782+0000","last_clean":"2024-04-25T09:10:25.992782+0000","last_became_active":"2024-04-25T09:10:25.007332+0000","last_became_peered":"2024-04-25T09:10:25.007332+0000","last_unstale":"2024-04-25T09:10:25.992782+0000","last_undegraded":"2024-04-25T09:10:25.992782+0000","last_fullsized":"2024-04-25T09:10:25.992782+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:43.658523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992525+0000","last_change":"2024-04-25T09:10:23.991862+0000","last_active":"2024-04-25T09:10:25.992525+0000","last_peered":"2024-04-25T09:10:25.992525+0000","last_clean":"2024-04-25T09:10:25.992525+0000","last_became_active":"2024-04-25T09:10:23.991596+0000","last_became_peered":"2024-04-25T09:10:23.991596+0000","last_unstale":"2024-04-25T09:10:25.992525+0000","last_undegraded":"2024-04-25T09:10:25.992525+0000","last_fullsized":"2024-04-25T09:10:25.992525+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:45.678832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.154004+0000","last_change":"2024-04-25T09:10:25.009496+0000","last_active":"2024-04-25T09:10:26.154004+0000","last_peered":"2024-04-25T09:10:26.154004+0000","last_clean":"2024-04-25T09:10:26.154004+0000","last_became_active":"2024-04-25T09:10:25.009219+0000","last_became_peered":"2024-04-25T09:10:25.009219+0000","last_unstale":"2024-04-25T09:10:26.154004+0000","last_undegraded":"2024-04-25T09:10:26.154004+0000","last_fullsized":"2024-04-25T09:10:26.154004+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:48.471105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.967759+0000","last_change":"2024-04-25T09:10:22.967759+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.967759+0000","last_undegraded":"2024-04-25T09:10:22.967759+0000","last_fullsized":"2024-04-25T09:10:22.967759+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992285+0000","last_change":"2024-04-25T09:10:23.990620+0000","last_active":"2024-04-25T09:10:25.992285+0000","last_peered":"2024-04-25T09:10:25.992285+0000","last_clean":"2024-04-25T09:10:25.992285+0000","last_became_active":"2024-04-25T09:10:23.990318+0000","last_became_peered":"2024-04-25T09:10:23.990318+0000","last_unstale":"2024-04-25T09:10:25.992285+0000","last_undegraded":"2024-04-25T09:10:25.992285+0000","last_fullsized":"2024-04-25T09:10:25.992285+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:52.073575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992908+0000","last_change":"2024-04-25T09:10:23.997830+0000","last_active":"2024-04-25T09:10:25.992908+0000","last_peered":"2024-04-25T09:10:25.992908+0000","last_clean":"2024-04-25T09:10:25.992908+0000","last_became_active":"2024-04-25T09:10:23.997524+0000","last_became_peered":"2024-04-25T09:10:23.997524+0000","last_unstale":"2024-04-25T09:10:25.992908+0000","last_undegraded":"2024-04-25T09:10:25.992908+0000","last_fullsized":"2024-04-25T09:10:25.992908+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:52.315270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":331,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153397+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:10:26.153397+0000","last_peered":"2024-04-25T09:10:26.153397+0000","last_clean":"2024-04-25T09:10:26.153397+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:10:26.153397+0000","last_undegraded":"2024-04-25T09:10:26.153397+0000","last_fullsized":"2024-04-25T09:10:26.153397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":44,"acting":44,"num_store_stats":3},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50504,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321336,"statfs":{"total":96636764160,"available":96585048064,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46344,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325496,"statfs":{"total":96636764160,"available":96589307904,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54668,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317172,"statfs":{"total":96636764160,"available":96580784128,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54664,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317176,"statfs":{"total":96636764160,"available":96580788224,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509537,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54708,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317132,"statfs":{"total":96636764160,"available":96580743168,"internally_reserved":0,"allocated":1347584,"data_stored":622994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509537,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50508,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321332,"statfs":{"total":96636764160,"available":96585043968,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55244,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316596,"statfs":{"total":96636764160,"available":96580194304,"internally_reserved":0,"allocated":1900544,"data_stored":1192802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51128,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320712,"statfs":{"total":96636764160,"available":96584409088,"internally_reserved":0,"allocated":1945600,"data_stored":1213488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:10:29.058 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:10:29.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.247+0000 7fc381600640 1 Processor -- start 2024-04-25T09:10:29.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.247+0000 7fc381600640 1 -- start start 2024-04-25T09:10:29.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.247+0000 7fc381600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c0aefa0 0x7fc37c0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.247+0000 7fc381600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c15f320 con 0x7fc37c15edd0 2024-04-25T09:10:29.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.247+0000 7fc381600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c06d420 con 0x7fc37c0b3e70 2024-04-25T09:10:29.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.247+0000 7fc381600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c06dd50 con 0x7fc37c0aefa0 2024-04-25T09:10:29.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.247+0000 7fc37b400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc37c15edd0 0x7fc37c0cdce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49784/0 (socket says 172.21.15.173:49784) 2024-04-25T09:10:29.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.247+0000 7fc37b400640 1 -- 172.21.15.173:0/393844758 learned_addr learned my addr 172.21.15.173:0/393844758 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:29.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc372000640 1 --2- 172.21.15.173:0/393844758 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c0aefa0 0x7fc37c0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37a000640 1 -- 172.21.15.173:0/393844758 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028379835 0 0) 0x7fc37c15f320 con 0x7fc37c15edd0 2024-04-25T09:10:29.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37a000640 1 -- 172.21.15.173:0/393844758 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc360005740 con 0x7fc37c15edd0 2024-04-25T09:10:29.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37a000640 1 -- 172.21.15.173:0/393844758 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2594334886 0 0) 0x7fc360005740 con 0x7fc37c15edd0 2024-04-25T09:10:29.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37a000640 1 -- 172.21.15.173:0/393844758 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c0aefa0 msgr2=0x7fc37c0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:29.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37a000640 1 --2- 172.21.15.173:0/393844758 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c0aefa0 0x7fc37c0cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37a000640 1 -- 172.21.15.173:0/393844758 >> v1:172.21.15.194:6789/0 conn(0x7fc37c0b3e70 legacy=0x7fc37c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37a000640 1 -- 172.21.15.173:0/393844758 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c06d700 con 0x7fc37c15edd0 2024-04-25T09:10:29.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37a000640 1 -- 172.21.15.173:0/393844758 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fc374001680 con 0x7fc37c15edd0 2024-04-25T09:10:29.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37a000640 1 -- 172.21.15.173:0/393844758 >> v1:172.21.15.173:6789/0 conn(0x7fc37c15edd0 legacy=0x7fc37c0cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37a000640 1 --2- 172.21.15.173:0/393844758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc360005c00 0x7fc360005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37a000640 1 --2- 172.21.15.173:0/393844758 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c0aefa0 0x7fc360006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37a000640 1 --2- 172.21.15.173:0/393844758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc360006f60 0x7fc3600073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37a000640 1 -- 172.21.15.173:0/393844758 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c06dd50 con 0x7fc360006f60 2024-04-25T09:10:29.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37a000640 1 -- 172.21.15.173:0/393844758 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36000dbe0 con 0x7fc360005c00 2024-04-25T09:10:29.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37a000640 1 -- 172.21.15.173:0/393844758 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36000dde0 con 0x7fc37c0aefa0 2024-04-25T09:10:29.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37b400640 1 --2- 172.21.15.173:0/393844758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc360006f60 0x7fc3600073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37aa00640 1 --2- 172.21.15.173:0/393844758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc360005c00 0x7fc360005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc372000640 1 --2- 172.21.15.173:0/393844758 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c0aefa0 0x7fc360006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37b400640 1 -- 172.21.15.173:0/393844758 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c0aefa0 msgr2=0x7fc360006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:29.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37b400640 1 --2- 172.21.15.173:0/393844758 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c0aefa0 0x7fc360006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37b400640 1 -- 172.21.15.173:0/393844758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc360005c00 msgr2=0x7fc360005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:29.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37b400640 1 --2- 172.21.15.173:0/393844758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc360005c00 0x7fc360005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc37b400640 1 -- 172.21.15.173:0/393844758 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc360005740 con 0x7fc360006f60 2024-04-25T09:10:29.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.251+0000 7fc372000640 1 --2- 172.21.15.173:0/393844758 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c0aefa0 0x7fc360006a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:29.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc37b400640 1 --2- 172.21.15.173:0/393844758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc360006f60 0x7fc3600073e0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fc37400c210 tx=0x7fc37401f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6249e05c37535b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:29.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc37a000640 1 -- 172.21.15.173:0/393844758 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374007cf0 con 0x7fc360006f60 2024-04-25T09:10:29.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc37a000640 1 -- 172.21.15.173:0/393844758 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc374005b00 con 0x7fc360006f60 2024-04-25T09:10:29.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc37a000640 1 -- 172.21.15.173:0/393844758 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374007070 con 0x7fc360006f60 2024-04-25T09:10:29.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc381600640 1 -- 172.21.15.173:0/393844758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc360006f60 msgr2=0x7fc3600073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc381600640 1 --2- 172.21.15.173:0/393844758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc360006f60 0x7fc3600073e0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fc37400c210 tx=0x7fc37401f370 comp rx=0 tx=0).stop 2024-04-25T09:10:29.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc37b400640 1 -- 172.21.15.173:0/393844758 reap_dead start 2024-04-25T09:10:29.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc381600640 1 -- 172.21.15.173:0/393844758 shutdown_connections 2024-04-25T09:10:29.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc381600640 1 -- 172.21.15.173:0/393844758 >> 172.21.15.173:0/393844758 conn(0x7fc37c06ac90 msgr2=0x7fc37c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:29.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc381600640 1 -- 172.21.15.173:0/393844758 shutdown_connections 2024-04-25T09:10:29.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc381600640 1 -- 172.21.15.173:0/393844758 wait complete. 2024-04-25T09:10:29.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc381600640 1 Processor -- start 2024-04-25T09:10:29.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc381600640 1 -- start start 2024-04-25T09:10:29.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc381600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc360006f60 0x7fc37c150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc381600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c151760 0x7fc37c15d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc381600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc37c14add0 0x7fc37c15b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc381600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c06e1e0 con 0x7fc360006f60 2024-04-25T09:10:29.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc381600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c15aba0 con 0x7fc37c14add0 2024-04-25T09:10:29.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.255+0000 7fc381600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c06e360 con 0x7fc37c151760 2024-04-25T09:10:29.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc37aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc360006f60 0x7fc37c150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc37aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc360006f60 0x7fc37c150c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52304/0 (socket says 172.21.15.173:52304) 2024-04-25T09:10:29.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc37aa00640 1 -- 172.21.15.173:0/4067375266 learned_addr learned my addr 172.21.15.173:0/4067375266 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:29.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc372000640 1 --2- 172.21.15.173:0/4067375266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c151760 0x7fc37c15d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc37b400640 1 --2- 172.21.15.173:0/4067375266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc37c14add0 0x7fc37c15b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc37aa00640 1 -- 172.21.15.173:0/4067375266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c151760 msgr2=0x7fc37c15d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc37aa00640 1 --2- 172.21.15.173:0/4067375266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c151760 0x7fc37c15d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc37aa00640 1 -- 172.21.15.173:0/4067375266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc37c14add0 msgr2=0x7fc37c15b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc37aa00640 1 --2- 172.21.15.173:0/4067375266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc37c14add0 0x7fc37c15b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc37aa00640 1 -- 172.21.15.173:0/4067375266 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c14fe70 con 0x7fc360006f60 2024-04-25T09:10:29.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc372000640 1 --2- 172.21.15.173:0/4067375266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c151760 0x7fc37c15d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:29.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc37aa00640 1 --2- 172.21.15.173:0/4067375266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc360006f60 0x7fc37c150c30 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00fb60 tx=0x7fc36c00d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:29.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc373400640 1 -- 172.21.15.173:0/4067375266 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c01a070 con 0x7fc360006f60 2024-04-25T09:10:29.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc373400640 1 -- 172.21.15.173:0/4067375266 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36c00dc30 con 0x7fc360006f60 2024-04-25T09:10:29.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc381600640 1 -- 172.21.15.173:0/4067375266 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37c150150 con 0x7fc360006f60 2024-04-25T09:10:29.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc373400640 1 -- 172.21.15.173:0/4067375266 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c006b60 con 0x7fc360006f60 2024-04-25T09:10:29.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc381600640 1 -- 172.21.15.173:0/4067375266 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37c150710 con 0x7fc360006f60 2024-04-25T09:10:29.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc381600640 1 -- 172.21.15.173:0/4067375266 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37c150910 con 0x7fc360006f60 2024-04-25T09:10:29.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc373400640 1 -- 172.21.15.173:0/4067375266 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc36c01d070 con 0x7fc360006f60 2024-04-25T09:10:29.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc373400640 1 --2- 172.21.15.173:0/4067375266 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc358066f60 0x7fc358069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc373400640 1 -- 172.21.15.173:0/4067375266 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc36c084d80 con 0x7fc360006f60 2024-04-25T09:10:29.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.259+0000 7fc372000640 1 --2- 172.21.15.173:0/4067375266 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc358066f60 0x7fc358069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.263+0000 7fc372000640 1 --2- 172.21.15.173:0/4067375266 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc358066f60 0x7fc358069420 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0b3140 tx=0x7fc364008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:29.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.263+0000 7fc373400640 1 -- 172.21.15.173:0/4067375266 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc37c150910 con 0x7fc360006f60 2024-04-25T09:10:29.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.415+0000 7fc381600640 1 -- 172.21.15.173:0/4067375266 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc37c073a40 con 0x7fc358066f60 2024-04-25T09:10:29.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.423+0000 7fc373400640 1 -- 172.21.15.173:0/4067375266 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243976 (secure 0 0 0) 0x7fc37c073a40 con 0x7fc358066f60 2024-04-25T09:10:29.413 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:29.414 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:10:29.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.423+0000 7fc381600640 1 -- 172.21.15.173:0/4067375266 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc358066f60 msgr2=0x7fc358069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.423+0000 7fc381600640 1 --2- 172.21.15.173:0/4067375266 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc358066f60 0x7fc358069420 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0b3140 tx=0x7fc364008040 comp rx=0 tx=0).stop 2024-04-25T09:10:29.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.423+0000 7fc381600640 1 -- 172.21.15.173:0/4067375266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc360006f60 msgr2=0x7fc37c150c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.423+0000 7fc381600640 1 --2- 172.21.15.173:0/4067375266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc360006f60 0x7fc37c150c30 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00fb60 tx=0x7fc36c00d520 comp rx=0 tx=0).stop 2024-04-25T09:10:29.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.423+0000 7fc381600640 1 -- 172.21.15.173:0/4067375266 shutdown_connections 2024-04-25T09:10:29.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.423+0000 7fc381600640 1 --2- 172.21.15.173:0/4067375266 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc358066f60 0x7fc358069420 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.423+0000 7fc381600640 1 --2- 172.21.15.173:0/4067375266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc37c14add0 0x7fc37c15b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.423+0000 7fc381600640 1 --2- 172.21.15.173:0/4067375266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc37c151760 0x7fc37c15d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.423+0000 7fc381600640 1 --2- 172.21.15.173:0/4067375266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc360006f60 0x7fc37c150c30 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.423+0000 7fc381600640 1 -- 172.21.15.173:0/4067375266 >> 172.21.15.173:0/4067375266 conn(0x7fc37c06ac90 msgr2=0x7fc37c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:29.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.423+0000 7fc381600640 1 -- 172.21.15.173:0/4067375266 shutdown_connections 2024-04-25T09:10:29.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.423+0000 7fc381600640 1 -- 172.21.15.173:0/4067375266 wait complete. 2024-04-25T09:10:29.435 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-04-25T09:10:28.828465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":168,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":110,"acting":110,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":417768,"kb_used_data":11452,"kb_used_omap":12,"kb_used_meta":406195,"kb_avail":754556952,"statfs":{"total":773094113280,"available":772666318848,"internally_reserved":0,"allocated":11726848,"data_stored":6041454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":415944240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.862895"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.980631+0000","last_change":"2024-04-25T09:10:23.980631+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.980631+0000","last_undegraded":"2024-04-25T09:10:23.980631+0000","last_fullsized":"2024-04-25T09:10:23.980631+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992093+0000","last_change":"2024-04-25T09:10:25.004287+0000","last_active":"2024-04-25T09:10:25.992093+0000","last_peered":"2024-04-25T09:10:25.992093+0000","last_clean":"2024-04-25T09:10:25.992093+0000","last_became_active":"2024-04-25T09:10:25.002537+0000","last_became_peered":"2024-04-25T09:10:25.002537+0000","last_unstale":"2024-04-25T09:10:25.992093+0000","last_undegraded":"2024-04-25T09:10:25.992093+0000","last_fullsized":"2024-04-25T09:10:25.992093+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:25.248880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.979654+0000","last_change":"2024-04-25T09:10:23.979654+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.979654+0000","last_undegraded":"2024-04-25T09:10:23.979654+0000","last_fullsized":"2024-04-25T09:10:23.979654+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153900+0000","last_change":"2024-04-25T09:10:25.005698+0000","last_active":"2024-04-25T09:10:26.153900+0000","last_peered":"2024-04-25T09:10:26.153900+0000","last_clean":"2024-04-25T09:10:26.153900+0000","last_became_active":"2024-04-25T09:10:25.005083+0000","last_became_peered":"2024-04-25T09:10:25.005083+0000","last_unstale":"2024-04-25T09:10:26.153900+0000","last_undegraded":"2024-04-25T09:10:26.153900+0000","last_fullsized":"2024-04-25T09:10:26.153900+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:37.012652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153563+0000","last_change":"2024-04-25T09:10:25.010387+0000","last_active":"2024-04-25T09:10:26.153563+0000","last_peered":"2024-04-25T09:10:26.153563+0000","last_clean":"2024-04-25T09:10:26.153563+0000","last_became_active":"2024-04-25T09:10:25.008940+0000","last_became_peered":"2024-04-25T09:10:25.008940+0000","last_unstale":"2024-04-25T09:10:26.153563+0000","last_undegraded":"2024-04-25T09:10:26.153563+0000","last_fullsized":"2024-04-25T09:10:26.153563+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:40.367585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153361+0000","last_change":"2024-04-25T09:10:25.005571+0000","last_active":"2024-04-25T09:10:26.153361+0000","last_peered":"2024-04-25T09:10:26.153361+0000","last_clean":"2024-04-25T09:10:26.153361+0000","last_became_active":"2024-04-25T09:10:25.005263+0000","last_became_peered":"2024-04-25T09:10:25.005263+0000","last_unstale":"2024-04-25T09:10:26.153361+0000","last_undegraded":"2024-04-25T09:10:26.153361+0000","last_fullsized":"2024-04-25T09:10:26.153361+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:07.504059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992691+0000","last_change":"2024-04-25T09:10:25.003489+0000","last_active":"2024-04-25T09:10:25.992691+0000","last_peered":"2024-04-25T09:10:25.992691+0000","last_clean":"2024-04-25T09:10:25.992691+0000","last_became_active":"2024-04-25T09:10:25.003239+0000","last_became_peered":"2024-04-25T09:10:25.003239+0000","last_unstale":"2024-04-25T09:10:25.992691+0000","last_undegraded":"2024-04-25T09:10:25.992691+0000","last_fullsized":"2024-04-25T09:10:25.992691+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:27.352442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.979790+0000","last_change":"2024-04-25T09:10:23.979790+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.979790+0000","last_undegraded":"2024-04-25T09:10:23.979790+0000","last_fullsized":"2024-04-25T09:10:23.979790+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.978749+0000","last_change":"2024-04-25T09:10:23.978749+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.978749+0000","last_undegraded":"2024-04-25T09:10:23.978749+0000","last_fullsized":"2024-04-25T09:10:23.978749+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992737+0000","last_change":"2024-04-25T09:10:25.009613+0000","last_active":"2024-04-25T09:10:25.992737+0000","last_peered":"2024-04-25T09:10:25.992737+0000","last_clean":"2024-04-25T09:10:25.992737+0000","last_became_active":"2024-04-25T09:10:25.009123+0000","last_became_peered":"2024-04-25T09:10:25.009123+0000","last_unstale":"2024-04-25T09:10:25.992737+0000","last_undegraded":"2024-04-25T09:10:25.992737+0000","last_fullsized":"2024-04-25T09:10:25.992737+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:25.292786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992145+0000","last_change":"2024-04-25T09:10:24.998492+0000","last_active":"2024-04-25T09:10:25.992145+0000","last_peered":"2024-04-25T09:10:25.992145+0000","last_clean":"2024-04-25T09:10:25.992145+0000","last_became_active":"2024-04-25T09:10:24.998110+0000","last_became_peered":"2024-04-25T09:10:24.998110+0000","last_unstale":"2024-04-25T09:10:25.992145+0000","last_undegraded":"2024-04-25T09:10:25.992145+0000","last_fullsized":"2024-04-25T09:10:25.992145+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:43.209701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968945+0000","last_change":"2024-04-25T09:10:22.968945+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968945+0000","last_undegraded":"2024-04-25T09:10:22.968945+0000","last_fullsized":"2024-04-25T09:10:22.968945+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992257+0000","last_change":"2024-04-25T09:10:25.001829+0000","last_active":"2024-04-25T09:10:25.992257+0000","last_peered":"2024-04-25T09:10:25.992257+0000","last_clean":"2024-04-25T09:10:25.992257+0000","last_became_active":"2024-04-25T09:10:25.001529+0000","last_became_peered":"2024-04-25T09:10:25.001529+0000","last_unstale":"2024-04-25T09:10:25.992257+0000","last_undegraded":"2024-04-25T09:10:25.992257+0000","last_fullsized":"2024-04-25T09:10:25.992257+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:27.725078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993011+0000","last_change":"2024-04-25T09:10:23.997442+0000","last_active":"2024-04-25T09:10:25.993011+0000","last_peered":"2024-04-25T09:10:25.993011+0000","last_clean":"2024-04-25T09:10:25.993011+0000","last_became_active":"2024-04-25T09:10:23.994906+0000","last_became_peered":"2024-04-25T09:10:23.994906+0000","last_unstale":"2024-04-25T09:10:25.993011+0000","last_undegraded":"2024-04-25T09:10:25.993011+0000","last_fullsized":"2024-04-25T09:10:25.993011+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:08.860155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968321+0000","last_change":"2024-04-25T09:10:22.968321+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968321+0000","last_undegraded":"2024-04-25T09:10:22.968321+0000","last_fullsized":"2024-04-25T09:10:22.968321+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":4,"reported_epoch":107,"state":"creating+activating","last_fresh":"2024-04-25T09:10:23.981437+0000","last_change":"2024-04-25T09:10:23.975454+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.981437+0000","last_undegraded":"2024-04-25T09:10:23.981437+0000","last_fullsized":"2024-04-25T09:10:23.981437+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153708+0000","last_change":"2024-04-25T09:10:23.988905+0000","last_active":"2024-04-25T09:10:26.153708+0000","last_peered":"2024-04-25T09:10:26.153708+0000","last_clean":"2024-04-25T09:10:26.153708+0000","last_became_active":"2024-04-25T09:10:23.988625+0000","last_became_peered":"2024-04-25T09:10:23.988625+0000","last_unstale":"2024-04-25T09:10:26.153708+0000","last_undegraded":"2024-04-25T09:10:26.153708+0000","last_fullsized":"2024-04-25T09:10:26.153708+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:48.797438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.971948+0000","last_change":"2024-04-25T09:10:22.971948+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.971948+0000","last_undegraded":"2024-04-25T09:10:22.971948+0000","last_fullsized":"2024-04-25T09:10:22.971948+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.967751+0000","last_change":"2024-04-25T09:10:22.967751+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.967751+0000","last_undegraded":"2024-04-25T09:10:22.967751+0000","last_fullsized":"2024-04-25T09:10:22.967751+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968945+0000","last_change":"2024-04-25T09:10:22.968945+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968945+0000","last_undegraded":"2024-04-25T09:10:22.968945+0000","last_fullsized":"2024-04-25T09:10:22.968945+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.969147+0000","last_change":"2024-04-25T09:10:22.969147+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.969147+0000","last_undegraded":"2024-04-25T09:10:22.969147+0000","last_fullsized":"2024-04-25T09:10:22.969147+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.974851+0000","last_change":"2024-04-25T09:10:23.974851+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.974851+0000","last_undegraded":"2024-04-25T09:10:23.974851+0000","last_fullsized":"2024-04-25T09:10:23.974851+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.973104+0000","last_change":"2024-04-25T09:10:22.973104+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.973104+0000","last_undegraded":"2024-04-25T09:10:22.973104+0000","last_fullsized":"2024-04-25T09:10:22.973104+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992521+0000","last_change":"2024-04-25T09:10:25.009042+0000","last_active":"2024-04-25T09:10:25.992521+0000","last_peered":"2024-04-25T09:10:25.992521+0000","last_clean":"2024-04-25T09:10:25.992521+0000","last_became_active":"2024-04-25T09:10:25.008796+0000","last_became_peered":"2024-04-25T09:10:25.008796+0000","last_unstale":"2024-04-25T09:10:25.992521+0000","last_undegraded":"2024-04-25T09:10:25.992521+0000","last_fullsized":"2024-04-25T09:10:25.992521+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:14.584473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"108'3","reported_seq":17,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153816+0000","last_change":"2024-04-25T09:10:23.987279+0000","last_active":"2024-04-25T09:10:26.153816+0000","last_peered":"2024-04-25T09:10:26.153816+0000","last_clean":"2024-04-25T09:10:26.153816+0000","last_became_active":"2024-04-25T09:10:23.986988+0000","last_became_peered":"2024-04-25T09:10:23.986988+0000","last_unstale":"2024-04-25T09:10:26.153816+0000","last_undegraded":"2024-04-25T09:10:26.153816+0000","last_fullsized":"2024-04-25T09:10:26.153816+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:08.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.976158+0000","last_change":"2024-04-25T09:10:23.976158+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.976158+0000","last_undegraded":"2024-04-25T09:10:23.976158+0000","last_fullsized":"2024-04-25T09:10:23.976158+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.969158+0000","last_change":"2024-04-25T09:10:22.969158+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.969158+0000","last_undegraded":"2024-04-25T09:10:22.969158+0000","last_fullsized":"2024-04-25T09:10:22.969158+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":3,"reported_epoch":107,"state":"creating+activating","last_fresh":"2024-04-25T09:10:23.975281+0000","last_change":"2024-04-25T09:10:23.975281+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.975281+0000","last_undegraded":"2024-04-25T09:10:23.975281+0000","last_fullsized":"2024-04-25T09:10:23.975281+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.969374+0000","last_change":"2024-04-25T09:10:22.969374+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.969374+0000","last_undegraded":"2024-04-25T09:10:22.969374+0000","last_fullsized":"2024-04-25T09:10:22.969374+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993005+0000","last_change":"2024-04-25T09:10:24.995940+0000","last_active":"2024-04-25T09:10:25.993005+0000","last_peered":"2024-04-25T09:10:25.993005+0000","last_clean":"2024-04-25T09:10:25.993005+0000","last_became_active":"2024-04-25T09:10:24.995666+0000","last_became_peered":"2024-04-25T09:10:24.995666+0000","last_unstale":"2024-04-25T09:10:25.993005+0000","last_undegraded":"2024-04-25T09:10:25.993005+0000","last_fullsized":"2024-04-25T09:10:25.993005+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:10.104554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992353+0000","last_change":"2024-04-25T09:10:23.990205+0000","last_active":"2024-04-25T09:10:25.992353+0000","last_peered":"2024-04-25T09:10:25.992353+0000","last_clean":"2024-04-25T09:10:25.992353+0000","last_became_active":"2024-04-25T09:10:23.989778+0000","last_became_peered":"2024-04-25T09:10:23.989778+0000","last_unstale":"2024-04-25T09:10:25.992353+0000","last_undegraded":"2024-04-25T09:10:25.992353+0000","last_fullsized":"2024-04-25T09:10:25.992353+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:43.287970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968775+0000","last_change":"2024-04-25T09:10:22.968775+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968775+0000","last_undegraded":"2024-04-25T09:10:22.968775+0000","last_fullsized":"2024-04-25T09:10:22.968775+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992235+0000","last_change":"2024-04-25T09:10:25.002077+0000","last_active":"2024-04-25T09:10:25.992235+0000","last_peered":"2024-04-25T09:10:25.992235+0000","last_clean":"2024-04-25T09:10:25.992235+0000","last_became_active":"2024-04-25T09:10:25.001788+0000","last_became_peered":"2024-04-25T09:10:25.001788+0000","last_unstale":"2024-04-25T09:10:25.992235+0000","last_undegraded":"2024-04-25T09:10:25.992235+0000","last_fullsized":"2024-04-25T09:10:25.992235+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:53.146010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968012+0000","last_change":"2024-04-25T09:10:22.968012+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968012+0000","last_undegraded":"2024-04-25T09:10:22.968012+0000","last_fullsized":"2024-04-25T09:10:22.968012+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153935+0000","last_change":"2024-04-25T09:10:23.985775+0000","last_active":"2024-04-25T09:10:26.153935+0000","last_peered":"2024-04-25T09:10:26.153935+0000","last_clean":"2024-04-25T09:10:26.153935+0000","last_became_active":"2024-04-25T09:10:23.985439+0000","last_became_peered":"2024-04-25T09:10:23.985439+0000","last_unstale":"2024-04-25T09:10:26.153935+0000","last_undegraded":"2024-04-25T09:10:26.153935+0000","last_fullsized":"2024-04-25T09:10:26.153935+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:34.204925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.976865+0000","last_change":"2024-04-25T09:10:23.976865+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.976865+0000","last_undegraded":"2024-04-25T09:10:23.976865+0000","last_fullsized":"2024-04-25T09:10:23.976865+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.971957+0000","last_change":"2024-04-25T09:10:22.971957+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.971957+0000","last_undegraded":"2024-04-25T09:10:22.971957+0000","last_fullsized":"2024-04-25T09:10:22.971957+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992790+0000","last_change":"2024-04-25T09:10:23.993992+0000","last_active":"2024-04-25T09:10:25.992790+0000","last_peered":"2024-04-25T09:10:25.992790+0000","last_clean":"2024-04-25T09:10:25.992790+0000","last_became_active":"2024-04-25T09:10:23.993527+0000","last_became_peered":"2024-04-25T09:10:23.993527+0000","last_unstale":"2024-04-25T09:10:25.992790+0000","last_undegraded":"2024-04-25T09:10:25.992790+0000","last_fullsized":"2024-04-25T09:10:25.992790+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:12.659252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992387+0000","last_change":"2024-04-25T09:10:23.993352+0000","last_active":"2024-04-25T09:10:25.992387+0000","last_peered":"2024-04-25T09:10:25.992387+0000","last_clean":"2024-04-25T09:10:25.992387+0000","last_became_active":"2024-04-25T09:10:23.993098+0000","last_became_peered":"2024-04-25T09:10:23.993098+0000","last_unstale":"2024-04-25T09:10:25.992387+0000","last_undegraded":"2024-04-25T09:10:25.992387+0000","last_fullsized":"2024-04-25T09:10:25.992387+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:48.781048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968321+0000","last_change":"2024-04-25T09:10:22.968321+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968321+0000","last_undegraded":"2024-04-25T09:10:22.968321+0000","last_fullsized":"2024-04-25T09:10:22.968321+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992978+0000","last_change":"2024-04-25T09:10:25.011971+0000","last_active":"2024-04-25T09:10:25.992978+0000","last_peered":"2024-04-25T09:10:25.992978+0000","last_clean":"2024-04-25T09:10:25.992978+0000","last_became_active":"2024-04-25T09:10:25.011686+0000","last_became_peered":"2024-04-25T09:10:25.011686+0000","last_unstale":"2024-04-25T09:10:25.992978+0000","last_undegraded":"2024-04-25T09:10:25.992978+0000","last_fullsized":"2024-04-25T09:10:25.992978+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:40.123611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992195+0000","last_change":"2024-04-25T09:10:23.997986+0000","last_active":"2024-04-25T09:10:25.992195+0000","last_peered":"2024-04-25T09:10:25.992195+0000","last_clean":"2024-04-25T09:10:25.992195+0000","last_became_active":"2024-04-25T09:10:23.997682+0000","last_became_peered":"2024-04-25T09:10:23.997682+0000","last_unstale":"2024-04-25T09:10:25.992195+0000","last_undegraded":"2024-04-25T09:10:25.992195+0000","last_fullsized":"2024-04-25T09:10:25.992195+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:45.716419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":3,"reported_epoch":107,"state":"creating+activating","last_fresh":"2024-04-25T09:10:23.975258+0000","last_change":"2024-04-25T09:10:23.975258+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.975258+0000","last_undegraded":"2024-04-25T09:10:23.975258+0000","last_fullsized":"2024-04-25T09:10:23.975258+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.972613+0000","last_change":"2024-04-25T09:10:22.972613+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.972613+0000","last_undegraded":"2024-04-25T09:10:22.972613+0000","last_fullsized":"2024-04-25T09:10:22.972613+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968620+0000","last_change":"2024-04-25T09:10:22.968620+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968620+0000","last_undegraded":"2024-04-25T09:10:22.968620+0000","last_fullsized":"2024-04-25T09:10:22.968620+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":3,"reported_epoch":107,"state":"creating+activating","last_fresh":"2024-04-25T09:10:23.975038+0000","last_change":"2024-04-25T09:10:23.975038+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.975038+0000","last_undegraded":"2024-04-25T09:10:23.975038+0000","last_fullsized":"2024-04-25T09:10:23.975038+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992710+0000","last_change":"2024-04-25T09:10:25.009607+0000","last_active":"2024-04-25T09:10:25.992710+0000","last_peered":"2024-04-25T09:10:25.992710+0000","last_clean":"2024-04-25T09:10:25.992710+0000","last_became_active":"2024-04-25T09:10:25.009341+0000","last_became_peered":"2024-04-25T09:10:25.009341+0000","last_unstale":"2024-04-25T09:10:25.992710+0000","last_undegraded":"2024-04-25T09:10:25.992710+0000","last_fullsized":"2024-04-25T09:10:25.992710+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:39.499479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.967933+0000","last_change":"2024-04-25T09:10:22.967933+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.967933+0000","last_undegraded":"2024-04-25T09:10:22.967933+0000","last_fullsized":"2024-04-25T09:10:22.967933+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992782+0000","last_change":"2024-04-25T09:10:25.007602+0000","last_active":"2024-04-25T09:10:25.992782+0000","last_peered":"2024-04-25T09:10:25.992782+0000","last_clean":"2024-04-25T09:10:25.992782+0000","last_became_active":"2024-04-25T09:10:25.007332+0000","last_became_peered":"2024-04-25T09:10:25.007332+0000","last_unstale":"2024-04-25T09:10:25.992782+0000","last_undegraded":"2024-04-25T09:10:25.992782+0000","last_fullsized":"2024-04-25T09:10:25.992782+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:43.658523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992525+0000","last_change":"2024-04-25T09:10:23.991862+0000","last_active":"2024-04-25T09:10:25.992525+0000","last_peered":"2024-04-25T09:10:25.992525+0000","last_clean":"2024-04-25T09:10:25.992525+0000","last_became_active":"2024-04-25T09:10:23.991596+0000","last_became_peered":"2024-04-25T09:10:23.991596+0000","last_unstale":"2024-04-25T09:10:25.992525+0000","last_undegraded":"2024-04-25T09:10:25.992525+0000","last_fullsized":"2024-04-25T09:10:25.992525+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:45.678832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.154004+0000","last_change":"2024-04-25T09:10:25.009496+0000","last_active":"2024-04-25T09:10:26.154004+0000","last_peered":"2024-04-25T09:10:26.154004+0000","last_clean":"2024-04-25T09:10:26.154004+0000","last_became_active":"2024-04-25T09:10:25.009219+0000","last_became_peered":"2024-04-25T09:10:25.009219+0000","last_unstale":"2024-04-25T09:10:26.154004+0000","last_undegraded":"2024-04-25T09:10:26.154004+0000","last_fullsized":"2024-04-25T09:10:26.154004+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:48.471105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.967759+0000","last_change":"2024-04-25T09:10:22.967759+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.967759+0000","last_undegraded":"2024-04-25T09:10:22.967759+0000","last_fullsized":"2024-04-25T09:10:22.967759+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992285+0000","last_change":"2024-04-25T09:10:23.990620+0000","last_active":"2024-04-25T09:10:25.992285+0000","last_peered":"2024-04-25T09:10:25.992285+0000","last_clean":"2024-04-25T09:10:25.992285+0000","last_became_active":"2024-04-25T09:10:23.990318+0000","last_became_peered":"2024-04-25T09:10:23.990318+0000","last_unstale":"2024-04-25T09:10:25.992285+0000","last_undegraded":"2024-04-25T09:10:25.992285+0000","last_fullsized":"2024-04-25T09:10:25.992285+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:52.073575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992908+0000","last_change":"2024-04-25T09:10:23.997830+0000","last_active":"2024-04-25T09:10:25.992908+0000","last_peered":"2024-04-25T09:10:25.992908+0000","last_clean":"2024-04-25T09:10:25.992908+0000","last_became_active":"2024-04-25T09:10:23.997524+0000","last_became_peered":"2024-04-25T09:10:23.997524+0000","last_unstale":"2024-04-25T09:10:25.992908+0000","last_undegraded":"2024-04-25T09:10:25.992908+0000","last_fullsized":"2024-04-25T09:10:25.992908+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:52.315270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":331,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153397+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:10:26.153397+0000","last_peered":"2024-04-25T09:10:26.153397+0000","last_clean":"2024-04-25T09:10:26.153397+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:10:26.153397+0000","last_undegraded":"2024-04-25T09:10:26.153397+0000","last_fullsized":"2024-04-25T09:10:26.153397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":44,"acting":44,"num_store_stats":3},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50504,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321336,"statfs":{"total":96636764160,"available":96585048064,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46344,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325496,"statfs":{"total":96636764160,"available":96589307904,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54668,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317172,"statfs":{"total":96636764160,"available":96580784128,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54664,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317176,"statfs":{"total":96636764160,"available":96580788224,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509537,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54708,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317132,"statfs":{"total":96636764160,"available":96580743168,"internally_reserved":0,"allocated":1347584,"data_stored":622994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509537,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50508,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321332,"statfs":{"total":96636764160,"available":96585043968,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55244,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316596,"statfs":{"total":96636764160,"available":96580194304,"internally_reserved":0,"allocated":1900544,"data_stored":1192802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51128,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320712,"statfs":{"total":96636764160,"available":96584409088,"internally_reserved":0,"allocated":1945600,"data_stored":1213488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:10:29.439 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:10:29.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.627+0000 7f1dc2e00640 1 Processor -- start 2024-04-25T09:10:29.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.627+0000 7f1dc2e00640 1 -- start start 2024-04-25T09:10:29.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.627+0000 7f1dc2e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1dbc0aefa0 0x7f1dbc0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.627+0000 7f1dc2e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dbc15edd0 0x7f1dbc0cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.627+0000 7f1dc2e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dbc15f320 con 0x7f1dbc0b3e70 2024-04-25T09:10:29.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.627+0000 7f1dc2e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dbc06dd50 con 0x7f1dbc0aefa0 2024-04-25T09:10:29.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.627+0000 7f1dc2e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc06d420 con 0x7f1dbc15edd0 2024-04-25T09:10:29.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.627+0000 7f1db3400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1dbc0aefa0 0x7f1dbc0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.627+0000 7f1db3400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1dbc0aefa0 0x7f1dbc0cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52316/0 (socket says 172.21.15.173:52316) 2024-04-25T09:10:29.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.627+0000 7f1db3400640 1 -- 172.21.15.173:0/3372029755 learned_addr learned my addr 172.21.15.173:0/3372029755 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:29.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.627+0000 7f1dc0e00640 1 --2- 172.21.15.173:0/3372029755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dbc15edd0 0x7f1dbc0cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.627+0000 7f1db3400640 1 -- 172.21.15.173:0/3372029755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dbc15edd0 msgr2=0x7f1dbc0cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:29.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.627+0000 7f1db3400640 1 --2- 172.21.15.173:0/3372029755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dbc15edd0 0x7f1dbc0cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.627+0000 7f1db3400640 1 -- 172.21.15.173:0/3372029755 >> v1:172.21.15.194:6789/0 conn(0x7f1dbc0b3e70 legacy=0x7f1dbc0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.627+0000 7f1db3400640 1 -- 172.21.15.173:0/3372029755 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc06d700 con 0x7f1dbc0aefa0 2024-04-25T09:10:29.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.631+0000 7f1db3400640 1 --2- 172.21.15.173:0/3372029755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dbc0aefa0 0x7f1dbc0cd7a0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f1da400bb10 tx=0x7f1da401ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9c0b4bfee583be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:29.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.631+0000 7f1dbb400640 1 -- 172.21.15.173:0/3372029755 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da40b4070 con 0x7f1dbc0aefa0 2024-04-25T09:10:29.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.631+0000 7f1dbb400640 1 -- 172.21.15.173:0/3372029755 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da40a7cc0 con 0x7f1dbc0aefa0 2024-04-25T09:10:29.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.631+0000 7f1dbb400640 1 -- 172.21.15.173:0/3372029755 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da40af660 con 0x7f1dbc0aefa0 2024-04-25T09:10:29.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.631+0000 7f1dc2e00640 1 -- 172.21.15.173:0/3372029755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dbc0aefa0 msgr2=0x7f1dbc0cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.631+0000 7f1dc2e00640 1 --2- 172.21.15.173:0/3372029755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dbc0aefa0 0x7f1dbc0cd7a0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f1da400bb10 tx=0x7f1da401ec00 comp rx=0 tx=0).stop 2024-04-25T09:10:29.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.631+0000 7f1dc2e00640 1 -- 172.21.15.173:0/3372029755 shutdown_connections 2024-04-25T09:10:29.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.631+0000 7f1dc2e00640 1 --2- 172.21.15.173:0/3372029755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dbc15edd0 0x7f1dbc0cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.631+0000 7f1dc2e00640 1 --2- 172.21.15.173:0/3372029755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dbc0aefa0 0x7f1dbc0cd7a0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.631+0000 7f1dc2e00640 1 -- 172.21.15.173:0/3372029755 >> 172.21.15.173:0/3372029755 conn(0x7f1dbc06ac90 msgr2=0x7f1dbc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:29.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.631+0000 7f1dc2e00640 1 -- 172.21.15.173:0/3372029755 shutdown_connections 2024-04-25T09:10:29.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.631+0000 7f1dc2e00640 1 -- 172.21.15.173:0/3372029755 wait complete. 2024-04-25T09:10:29.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1dc2e00640 1 Processor -- start 2024-04-25T09:10:29.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1dc2e00640 1 -- start start 2024-04-25T09:10:29.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1dc2e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dbc0aefa0 0x7f1dbc158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1dc2e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dbc0b3e70 0x7f1dbc157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1dc2e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1dbc15edd0 0x7f1dbc1f6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1dc2e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc0714a0 con 0x7f1dbc0b3e70 2024-04-25T09:10:29.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1dc2e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc071320 con 0x7f1dbc15edd0 2024-04-25T09:10:29.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1dc2e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc071620 con 0x7f1dbc0aefa0 2024-04-25T09:10:29.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1db3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dbc0b3e70 0x7f1dbc157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1db3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dbc0b3e70 0x7f1dbc157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52322/0 (socket says 172.21.15.173:52322) 2024-04-25T09:10:29.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1db3400640 1 -- 172.21.15.173:0/1395385415 learned_addr learned my addr 172.21.15.173:0/1395385415 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:29.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1dbbe00640 1 --2- 172.21.15.173:0/1395385415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dbc0aefa0 0x7f1dbc158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1dc0e00640 1 --2- 172.21.15.173:0/1395385415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1dbc15edd0 0x7f1dbc1f6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1db3400640 1 -- 172.21.15.173:0/1395385415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dbc0aefa0 msgr2=0x7f1dbc158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1db3400640 1 --2- 172.21.15.173:0/1395385415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dbc0aefa0 0x7f1dbc158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1db3400640 1 -- 172.21.15.173:0/1395385415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1dbc15edd0 msgr2=0x7f1dbc1f6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1db3400640 1 --2- 172.21.15.173:0/1395385415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1dbc15edd0 0x7f1dbc1f6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1db3400640 1 -- 172.21.15.173:0/1395385415 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc157e70 con 0x7f1dbc0b3e70 2024-04-25T09:10:29.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1dbbe00640 1 --2- 172.21.15.173:0/1395385415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dbc0aefa0 0x7f1dbc158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:29.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1dc0e00640 1 --2- 172.21.15.173:0/1395385415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1dbc15edd0 0x7f1dbc1f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:29.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1db3400640 1 --2- 172.21.15.173:0/1395385415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dbc0b3e70 0x7f1dbc157490 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f1da400b2c0 tx=0x7f1da401d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:29.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1db8c00640 1 -- 172.21.15.173:0/1395385415 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da40bf070 con 0x7f1dbc0b3e70 2024-04-25T09:10:29.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1db8c00640 1 -- 172.21.15.173:0/1395385415 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da40ba440 con 0x7f1dbc0b3e70 2024-04-25T09:10:29.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1db8c00640 1 -- 172.21.15.173:0/1395385415 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da40b4070 con 0x7f1dbc0b3e70 2024-04-25T09:10:29.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1dc2e00640 1 -- 172.21.15.173:0/1395385415 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dbc158150 con 0x7f1dbc0b3e70 2024-04-25T09:10:29.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.635+0000 7f1dc2e00640 1 -- 172.21.15.173:0/1395385415 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dbc158710 con 0x7f1dbc0b3e70 2024-04-25T09:10:29.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.639+0000 7f1dc2e00640 1 -- 172.21.15.173:0/1395385415 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dbc073a40 con 0x7f1dbc0b3e70 2024-04-25T09:10:29.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.639+0000 7f1db8c00640 1 -- 172.21.15.173:0/1395385415 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1da40b93e0 con 0x7f1dbc0b3e70 2024-04-25T09:10:29.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.639+0000 7f1db8c00640 1 --2- 172.21.15.173:0/1395385415 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1d98066f60 0x7f1d98069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.639+0000 7f1db8c00640 1 -- 172.21.15.173:0/1395385415 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1da411f860 con 0x7f1dbc0b3e70 2024-04-25T09:10:29.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.639+0000 7f1dbbe00640 1 --2- 172.21.15.173:0/1395385415 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1d98066f60 0x7f1d98069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.639+0000 7f1dbbe00640 1 --2- 172.21.15.173:0/1395385415 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1d98066f60 0x7f1d98069420 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1dac007fd0 tx=0x7f1dac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:29.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.643+0000 7f1db8c00640 1 -- 172.21.15.173:0/1395385415 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1da4018820 con 0x7f1dbc0b3e70 2024-04-25T09:10:29.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.795+0000 7f1dc2e00640 1 -- 172.21.15.173:0/1395385415 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1dbc06f1c0 con 0x7f1d98066f60 2024-04-25T09:10:29.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.799+0000 7f1db8c00640 1 -- 172.21.15.173:0/1395385415 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243976 (secure 0 0 0) 0x7f1dbc06f1c0 con 0x7f1d98066f60 2024-04-25T09:10:29.790 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:29.792 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:10:29.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.803+0000 7f1dc2e00640 1 -- 172.21.15.173:0/1395385415 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1d98066f60 msgr2=0x7f1d98069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.803+0000 7f1dc2e00640 1 --2- 172.21.15.173:0/1395385415 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1d98066f60 0x7f1d98069420 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1dac007fd0 tx=0x7f1dac009040 comp rx=0 tx=0).stop 2024-04-25T09:10:29.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.803+0000 7f1dc2e00640 1 -- 172.21.15.173:0/1395385415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dbc0b3e70 msgr2=0x7f1dbc157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.803+0000 7f1dc2e00640 1 --2- 172.21.15.173:0/1395385415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dbc0b3e70 0x7f1dbc157490 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f1da400b2c0 tx=0x7f1da401d440 comp rx=0 tx=0).stop 2024-04-25T09:10:29.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.803+0000 7f1dc2e00640 1 -- 172.21.15.173:0/1395385415 shutdown_connections 2024-04-25T09:10:29.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.803+0000 7f1dc2e00640 1 --2- 172.21.15.173:0/1395385415 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1d98066f60 0x7f1d98069420 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.803+0000 7f1dc2e00640 1 --2- 172.21.15.173:0/1395385415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1dbc15edd0 0x7f1dbc1f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.803+0000 7f1dc2e00640 1 --2- 172.21.15.173:0/1395385415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1dbc0b3e70 0x7f1dbc157490 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.803+0000 7f1dc2e00640 1 --2- 172.21.15.173:0/1395385415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1dbc0aefa0 0x7f1dbc158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.803+0000 7f1dc2e00640 1 -- 172.21.15.173:0/1395385415 >> 172.21.15.173:0/1395385415 conn(0x7f1dbc06ac90 msgr2=0x7f1dbc0af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:29.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.803+0000 7f1dc2e00640 1 -- 172.21.15.173:0/1395385415 shutdown_connections 2024-04-25T09:10:29.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:29.803+0000 7f1dc2e00640 1 -- 172.21.15.173:0/1395385415 wait complete. 2024-04-25T09:10:29.811 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-04-25T09:10:28.828465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":168,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":110,"acting":110,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":417768,"kb_used_data":11452,"kb_used_omap":12,"kb_used_meta":406195,"kb_avail":754556952,"statfs":{"total":773094113280,"available":772666318848,"internally_reserved":0,"allocated":11726848,"data_stored":6041454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":415944240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.862895"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.980631+0000","last_change":"2024-04-25T09:10:23.980631+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.980631+0000","last_undegraded":"2024-04-25T09:10:23.980631+0000","last_fullsized":"2024-04-25T09:10:23.980631+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992093+0000","last_change":"2024-04-25T09:10:25.004287+0000","last_active":"2024-04-25T09:10:25.992093+0000","last_peered":"2024-04-25T09:10:25.992093+0000","last_clean":"2024-04-25T09:10:25.992093+0000","last_became_active":"2024-04-25T09:10:25.002537+0000","last_became_peered":"2024-04-25T09:10:25.002537+0000","last_unstale":"2024-04-25T09:10:25.992093+0000","last_undegraded":"2024-04-25T09:10:25.992093+0000","last_fullsized":"2024-04-25T09:10:25.992093+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:25.248880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.979654+0000","last_change":"2024-04-25T09:10:23.979654+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.979654+0000","last_undegraded":"2024-04-25T09:10:23.979654+0000","last_fullsized":"2024-04-25T09:10:23.979654+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153900+0000","last_change":"2024-04-25T09:10:25.005698+0000","last_active":"2024-04-25T09:10:26.153900+0000","last_peered":"2024-04-25T09:10:26.153900+0000","last_clean":"2024-04-25T09:10:26.153900+0000","last_became_active":"2024-04-25T09:10:25.005083+0000","last_became_peered":"2024-04-25T09:10:25.005083+0000","last_unstale":"2024-04-25T09:10:26.153900+0000","last_undegraded":"2024-04-25T09:10:26.153900+0000","last_fullsized":"2024-04-25T09:10:26.153900+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:37.012652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153563+0000","last_change":"2024-04-25T09:10:25.010387+0000","last_active":"2024-04-25T09:10:26.153563+0000","last_peered":"2024-04-25T09:10:26.153563+0000","last_clean":"2024-04-25T09:10:26.153563+0000","last_became_active":"2024-04-25T09:10:25.008940+0000","last_became_peered":"2024-04-25T09:10:25.008940+0000","last_unstale":"2024-04-25T09:10:26.153563+0000","last_undegraded":"2024-04-25T09:10:26.153563+0000","last_fullsized":"2024-04-25T09:10:26.153563+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:40.367585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153361+0000","last_change":"2024-04-25T09:10:25.005571+0000","last_active":"2024-04-25T09:10:26.153361+0000","last_peered":"2024-04-25T09:10:26.153361+0000","last_clean":"2024-04-25T09:10:26.153361+0000","last_became_active":"2024-04-25T09:10:25.005263+0000","last_became_peered":"2024-04-25T09:10:25.005263+0000","last_unstale":"2024-04-25T09:10:26.153361+0000","last_undegraded":"2024-04-25T09:10:26.153361+0000","last_fullsized":"2024-04-25T09:10:26.153361+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:07.504059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992691+0000","last_change":"2024-04-25T09:10:25.003489+0000","last_active":"2024-04-25T09:10:25.992691+0000","last_peered":"2024-04-25T09:10:25.992691+0000","last_clean":"2024-04-25T09:10:25.992691+0000","last_became_active":"2024-04-25T09:10:25.003239+0000","last_became_peered":"2024-04-25T09:10:25.003239+0000","last_unstale":"2024-04-25T09:10:25.992691+0000","last_undegraded":"2024-04-25T09:10:25.992691+0000","last_fullsized":"2024-04-25T09:10:25.992691+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:27.352442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.979790+0000","last_change":"2024-04-25T09:10:23.979790+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.979790+0000","last_undegraded":"2024-04-25T09:10:23.979790+0000","last_fullsized":"2024-04-25T09:10:23.979790+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.978749+0000","last_change":"2024-04-25T09:10:23.978749+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.978749+0000","last_undegraded":"2024-04-25T09:10:23.978749+0000","last_fullsized":"2024-04-25T09:10:23.978749+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992737+0000","last_change":"2024-04-25T09:10:25.009613+0000","last_active":"2024-04-25T09:10:25.992737+0000","last_peered":"2024-04-25T09:10:25.992737+0000","last_clean":"2024-04-25T09:10:25.992737+0000","last_became_active":"2024-04-25T09:10:25.009123+0000","last_became_peered":"2024-04-25T09:10:25.009123+0000","last_unstale":"2024-04-25T09:10:25.992737+0000","last_undegraded":"2024-04-25T09:10:25.992737+0000","last_fullsized":"2024-04-25T09:10:25.992737+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:25.292786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992145+0000","last_change":"2024-04-25T09:10:24.998492+0000","last_active":"2024-04-25T09:10:25.992145+0000","last_peered":"2024-04-25T09:10:25.992145+0000","last_clean":"2024-04-25T09:10:25.992145+0000","last_became_active":"2024-04-25T09:10:24.998110+0000","last_became_peered":"2024-04-25T09:10:24.998110+0000","last_unstale":"2024-04-25T09:10:25.992145+0000","last_undegraded":"2024-04-25T09:10:25.992145+0000","last_fullsized":"2024-04-25T09:10:25.992145+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:43.209701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968945+0000","last_change":"2024-04-25T09:10:22.968945+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968945+0000","last_undegraded":"2024-04-25T09:10:22.968945+0000","last_fullsized":"2024-04-25T09:10:22.968945+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992257+0000","last_change":"2024-04-25T09:10:25.001829+0000","last_active":"2024-04-25T09:10:25.992257+0000","last_peered":"2024-04-25T09:10:25.992257+0000","last_clean":"2024-04-25T09:10:25.992257+0000","last_became_active":"2024-04-25T09:10:25.001529+0000","last_became_peered":"2024-04-25T09:10:25.001529+0000","last_unstale":"2024-04-25T09:10:25.992257+0000","last_undegraded":"2024-04-25T09:10:25.992257+0000","last_fullsized":"2024-04-25T09:10:25.992257+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:27.725078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993011+0000","last_change":"2024-04-25T09:10:23.997442+0000","last_active":"2024-04-25T09:10:25.993011+0000","last_peered":"2024-04-25T09:10:25.993011+0000","last_clean":"2024-04-25T09:10:25.993011+0000","last_became_active":"2024-04-25T09:10:23.994906+0000","last_became_peered":"2024-04-25T09:10:23.994906+0000","last_unstale":"2024-04-25T09:10:25.993011+0000","last_undegraded":"2024-04-25T09:10:25.993011+0000","last_fullsized":"2024-04-25T09:10:25.993011+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:08.860155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968321+0000","last_change":"2024-04-25T09:10:22.968321+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968321+0000","last_undegraded":"2024-04-25T09:10:22.968321+0000","last_fullsized":"2024-04-25T09:10:22.968321+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":4,"reported_epoch":107,"state":"creating+activating","last_fresh":"2024-04-25T09:10:23.981437+0000","last_change":"2024-04-25T09:10:23.975454+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.981437+0000","last_undegraded":"2024-04-25T09:10:23.981437+0000","last_fullsized":"2024-04-25T09:10:23.981437+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153708+0000","last_change":"2024-04-25T09:10:23.988905+0000","last_active":"2024-04-25T09:10:26.153708+0000","last_peered":"2024-04-25T09:10:26.153708+0000","last_clean":"2024-04-25T09:10:26.153708+0000","last_became_active":"2024-04-25T09:10:23.988625+0000","last_became_peered":"2024-04-25T09:10:23.988625+0000","last_unstale":"2024-04-25T09:10:26.153708+0000","last_undegraded":"2024-04-25T09:10:26.153708+0000","last_fullsized":"2024-04-25T09:10:26.153708+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:48.797438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.971948+0000","last_change":"2024-04-25T09:10:22.971948+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.971948+0000","last_undegraded":"2024-04-25T09:10:22.971948+0000","last_fullsized":"2024-04-25T09:10:22.971948+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.967751+0000","last_change":"2024-04-25T09:10:22.967751+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.967751+0000","last_undegraded":"2024-04-25T09:10:22.967751+0000","last_fullsized":"2024-04-25T09:10:22.967751+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968945+0000","last_change":"2024-04-25T09:10:22.968945+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968945+0000","last_undegraded":"2024-04-25T09:10:22.968945+0000","last_fullsized":"2024-04-25T09:10:22.968945+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.969147+0000","last_change":"2024-04-25T09:10:22.969147+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.969147+0000","last_undegraded":"2024-04-25T09:10:22.969147+0000","last_fullsized":"2024-04-25T09:10:22.969147+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.974851+0000","last_change":"2024-04-25T09:10:23.974851+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.974851+0000","last_undegraded":"2024-04-25T09:10:23.974851+0000","last_fullsized":"2024-04-25T09:10:23.974851+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.973104+0000","last_change":"2024-04-25T09:10:22.973104+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.973104+0000","last_undegraded":"2024-04-25T09:10:22.973104+0000","last_fullsized":"2024-04-25T09:10:22.973104+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992521+0000","last_change":"2024-04-25T09:10:25.009042+0000","last_active":"2024-04-25T09:10:25.992521+0000","last_peered":"2024-04-25T09:10:25.992521+0000","last_clean":"2024-04-25T09:10:25.992521+0000","last_became_active":"2024-04-25T09:10:25.008796+0000","last_became_peered":"2024-04-25T09:10:25.008796+0000","last_unstale":"2024-04-25T09:10:25.992521+0000","last_undegraded":"2024-04-25T09:10:25.992521+0000","last_fullsized":"2024-04-25T09:10:25.992521+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:14.584473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"108'3","reported_seq":17,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153816+0000","last_change":"2024-04-25T09:10:23.987279+0000","last_active":"2024-04-25T09:10:26.153816+0000","last_peered":"2024-04-25T09:10:26.153816+0000","last_clean":"2024-04-25T09:10:26.153816+0000","last_became_active":"2024-04-25T09:10:23.986988+0000","last_became_peered":"2024-04-25T09:10:23.986988+0000","last_unstale":"2024-04-25T09:10:26.153816+0000","last_undegraded":"2024-04-25T09:10:26.153816+0000","last_fullsized":"2024-04-25T09:10:26.153816+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:08.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.976158+0000","last_change":"2024-04-25T09:10:23.976158+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.976158+0000","last_undegraded":"2024-04-25T09:10:23.976158+0000","last_fullsized":"2024-04-25T09:10:23.976158+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.969158+0000","last_change":"2024-04-25T09:10:22.969158+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.969158+0000","last_undegraded":"2024-04-25T09:10:22.969158+0000","last_fullsized":"2024-04-25T09:10:22.969158+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":3,"reported_epoch":107,"state":"creating+activating","last_fresh":"2024-04-25T09:10:23.975281+0000","last_change":"2024-04-25T09:10:23.975281+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.975281+0000","last_undegraded":"2024-04-25T09:10:23.975281+0000","last_fullsized":"2024-04-25T09:10:23.975281+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.969374+0000","last_change":"2024-04-25T09:10:22.969374+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.969374+0000","last_undegraded":"2024-04-25T09:10:22.969374+0000","last_fullsized":"2024-04-25T09:10:22.969374+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993005+0000","last_change":"2024-04-25T09:10:24.995940+0000","last_active":"2024-04-25T09:10:25.993005+0000","last_peered":"2024-04-25T09:10:25.993005+0000","last_clean":"2024-04-25T09:10:25.993005+0000","last_became_active":"2024-04-25T09:10:24.995666+0000","last_became_peered":"2024-04-25T09:10:24.995666+0000","last_unstale":"2024-04-25T09:10:25.993005+0000","last_undegraded":"2024-04-25T09:10:25.993005+0000","last_fullsized":"2024-04-25T09:10:25.993005+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:10.104554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992353+0000","last_change":"2024-04-25T09:10:23.990205+0000","last_active":"2024-04-25T09:10:25.992353+0000","last_peered":"2024-04-25T09:10:25.992353+0000","last_clean":"2024-04-25T09:10:25.992353+0000","last_became_active":"2024-04-25T09:10:23.989778+0000","last_became_peered":"2024-04-25T09:10:23.989778+0000","last_unstale":"2024-04-25T09:10:25.992353+0000","last_undegraded":"2024-04-25T09:10:25.992353+0000","last_fullsized":"2024-04-25T09:10:25.992353+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:43.287970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968775+0000","last_change":"2024-04-25T09:10:22.968775+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968775+0000","last_undegraded":"2024-04-25T09:10:22.968775+0000","last_fullsized":"2024-04-25T09:10:22.968775+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992235+0000","last_change":"2024-04-25T09:10:25.002077+0000","last_active":"2024-04-25T09:10:25.992235+0000","last_peered":"2024-04-25T09:10:25.992235+0000","last_clean":"2024-04-25T09:10:25.992235+0000","last_became_active":"2024-04-25T09:10:25.001788+0000","last_became_peered":"2024-04-25T09:10:25.001788+0000","last_unstale":"2024-04-25T09:10:25.992235+0000","last_undegraded":"2024-04-25T09:10:25.992235+0000","last_fullsized":"2024-04-25T09:10:25.992235+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:53.146010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968012+0000","last_change":"2024-04-25T09:10:22.968012+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968012+0000","last_undegraded":"2024-04-25T09:10:22.968012+0000","last_fullsized":"2024-04-25T09:10:22.968012+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153935+0000","last_change":"2024-04-25T09:10:23.985775+0000","last_active":"2024-04-25T09:10:26.153935+0000","last_peered":"2024-04-25T09:10:26.153935+0000","last_clean":"2024-04-25T09:10:26.153935+0000","last_became_active":"2024-04-25T09:10:23.985439+0000","last_became_peered":"2024-04-25T09:10:23.985439+0000","last_unstale":"2024-04-25T09:10:26.153935+0000","last_undegraded":"2024-04-25T09:10:26.153935+0000","last_fullsized":"2024-04-25T09:10:26.153935+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:34.204925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.976865+0000","last_change":"2024-04-25T09:10:23.976865+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.976865+0000","last_undegraded":"2024-04-25T09:10:23.976865+0000","last_fullsized":"2024-04-25T09:10:23.976865+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.971957+0000","last_change":"2024-04-25T09:10:22.971957+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.971957+0000","last_undegraded":"2024-04-25T09:10:22.971957+0000","last_fullsized":"2024-04-25T09:10:22.971957+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992790+0000","last_change":"2024-04-25T09:10:23.993992+0000","last_active":"2024-04-25T09:10:25.992790+0000","last_peered":"2024-04-25T09:10:25.992790+0000","last_clean":"2024-04-25T09:10:25.992790+0000","last_became_active":"2024-04-25T09:10:23.993527+0000","last_became_peered":"2024-04-25T09:10:23.993527+0000","last_unstale":"2024-04-25T09:10:25.992790+0000","last_undegraded":"2024-04-25T09:10:25.992790+0000","last_fullsized":"2024-04-25T09:10:25.992790+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:12.659252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992387+0000","last_change":"2024-04-25T09:10:23.993352+0000","last_active":"2024-04-25T09:10:25.992387+0000","last_peered":"2024-04-25T09:10:25.992387+0000","last_clean":"2024-04-25T09:10:25.992387+0000","last_became_active":"2024-04-25T09:10:23.993098+0000","last_became_peered":"2024-04-25T09:10:23.993098+0000","last_unstale":"2024-04-25T09:10:25.992387+0000","last_undegraded":"2024-04-25T09:10:25.992387+0000","last_fullsized":"2024-04-25T09:10:25.992387+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:48.781048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968321+0000","last_change":"2024-04-25T09:10:22.968321+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968321+0000","last_undegraded":"2024-04-25T09:10:22.968321+0000","last_fullsized":"2024-04-25T09:10:22.968321+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992978+0000","last_change":"2024-04-25T09:10:25.011971+0000","last_active":"2024-04-25T09:10:25.992978+0000","last_peered":"2024-04-25T09:10:25.992978+0000","last_clean":"2024-04-25T09:10:25.992978+0000","last_became_active":"2024-04-25T09:10:25.011686+0000","last_became_peered":"2024-04-25T09:10:25.011686+0000","last_unstale":"2024-04-25T09:10:25.992978+0000","last_undegraded":"2024-04-25T09:10:25.992978+0000","last_fullsized":"2024-04-25T09:10:25.992978+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:40.123611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992195+0000","last_change":"2024-04-25T09:10:23.997986+0000","last_active":"2024-04-25T09:10:25.992195+0000","last_peered":"2024-04-25T09:10:25.992195+0000","last_clean":"2024-04-25T09:10:25.992195+0000","last_became_active":"2024-04-25T09:10:23.997682+0000","last_became_peered":"2024-04-25T09:10:23.997682+0000","last_unstale":"2024-04-25T09:10:25.992195+0000","last_undegraded":"2024-04-25T09:10:25.992195+0000","last_fullsized":"2024-04-25T09:10:25.992195+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:45.716419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":3,"reported_epoch":107,"state":"creating+activating","last_fresh":"2024-04-25T09:10:23.975258+0000","last_change":"2024-04-25T09:10:23.975258+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.975258+0000","last_undegraded":"2024-04-25T09:10:23.975258+0000","last_fullsized":"2024-04-25T09:10:23.975258+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.972613+0000","last_change":"2024-04-25T09:10:22.972613+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.972613+0000","last_undegraded":"2024-04-25T09:10:22.972613+0000","last_fullsized":"2024-04-25T09:10:22.972613+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968620+0000","last_change":"2024-04-25T09:10:22.968620+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968620+0000","last_undegraded":"2024-04-25T09:10:22.968620+0000","last_fullsized":"2024-04-25T09:10:22.968620+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":3,"reported_epoch":107,"state":"creating+activating","last_fresh":"2024-04-25T09:10:23.975038+0000","last_change":"2024-04-25T09:10:23.975038+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.975038+0000","last_undegraded":"2024-04-25T09:10:23.975038+0000","last_fullsized":"2024-04-25T09:10:23.975038+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992710+0000","last_change":"2024-04-25T09:10:25.009607+0000","last_active":"2024-04-25T09:10:25.992710+0000","last_peered":"2024-04-25T09:10:25.992710+0000","last_clean":"2024-04-25T09:10:25.992710+0000","last_became_active":"2024-04-25T09:10:25.009341+0000","last_became_peered":"2024-04-25T09:10:25.009341+0000","last_unstale":"2024-04-25T09:10:25.992710+0000","last_undegraded":"2024-04-25T09:10:25.992710+0000","last_fullsized":"2024-04-25T09:10:25.992710+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:39.499479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.967933+0000","last_change":"2024-04-25T09:10:22.967933+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.967933+0000","last_undegraded":"2024-04-25T09:10:22.967933+0000","last_fullsized":"2024-04-25T09:10:22.967933+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992782+0000","last_change":"2024-04-25T09:10:25.007602+0000","last_active":"2024-04-25T09:10:25.992782+0000","last_peered":"2024-04-25T09:10:25.992782+0000","last_clean":"2024-04-25T09:10:25.992782+0000","last_became_active":"2024-04-25T09:10:25.007332+0000","last_became_peered":"2024-04-25T09:10:25.007332+0000","last_unstale":"2024-04-25T09:10:25.992782+0000","last_undegraded":"2024-04-25T09:10:25.992782+0000","last_fullsized":"2024-04-25T09:10:25.992782+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:43.658523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992525+0000","last_change":"2024-04-25T09:10:23.991862+0000","last_active":"2024-04-25T09:10:25.992525+0000","last_peered":"2024-04-25T09:10:25.992525+0000","last_clean":"2024-04-25T09:10:25.992525+0000","last_became_active":"2024-04-25T09:10:23.991596+0000","last_became_peered":"2024-04-25T09:10:23.991596+0000","last_unstale":"2024-04-25T09:10:25.992525+0000","last_undegraded":"2024-04-25T09:10:25.992525+0000","last_fullsized":"2024-04-25T09:10:25.992525+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:45.678832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.154004+0000","last_change":"2024-04-25T09:10:25.009496+0000","last_active":"2024-04-25T09:10:26.154004+0000","last_peered":"2024-04-25T09:10:26.154004+0000","last_clean":"2024-04-25T09:10:26.154004+0000","last_became_active":"2024-04-25T09:10:25.009219+0000","last_became_peered":"2024-04-25T09:10:25.009219+0000","last_unstale":"2024-04-25T09:10:26.154004+0000","last_undegraded":"2024-04-25T09:10:26.154004+0000","last_fullsized":"2024-04-25T09:10:26.154004+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:48.471105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.967759+0000","last_change":"2024-04-25T09:10:22.967759+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.967759+0000","last_undegraded":"2024-04-25T09:10:22.967759+0000","last_fullsized":"2024-04-25T09:10:22.967759+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992285+0000","last_change":"2024-04-25T09:10:23.990620+0000","last_active":"2024-04-25T09:10:25.992285+0000","last_peered":"2024-04-25T09:10:25.992285+0000","last_clean":"2024-04-25T09:10:25.992285+0000","last_became_active":"2024-04-25T09:10:23.990318+0000","last_became_peered":"2024-04-25T09:10:23.990318+0000","last_unstale":"2024-04-25T09:10:25.992285+0000","last_undegraded":"2024-04-25T09:10:25.992285+0000","last_fullsized":"2024-04-25T09:10:25.992285+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:52.073575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992908+0000","last_change":"2024-04-25T09:10:23.997830+0000","last_active":"2024-04-25T09:10:25.992908+0000","last_peered":"2024-04-25T09:10:25.992908+0000","last_clean":"2024-04-25T09:10:25.992908+0000","last_became_active":"2024-04-25T09:10:23.997524+0000","last_became_peered":"2024-04-25T09:10:23.997524+0000","last_unstale":"2024-04-25T09:10:25.992908+0000","last_undegraded":"2024-04-25T09:10:25.992908+0000","last_fullsized":"2024-04-25T09:10:25.992908+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:52.315270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":331,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153397+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:10:26.153397+0000","last_peered":"2024-04-25T09:10:26.153397+0000","last_clean":"2024-04-25T09:10:26.153397+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:10:26.153397+0000","last_undegraded":"2024-04-25T09:10:26.153397+0000","last_fullsized":"2024-04-25T09:10:26.153397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":44,"acting":44,"num_store_stats":3},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50504,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321336,"statfs":{"total":96636764160,"available":96585048064,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46344,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325496,"statfs":{"total":96636764160,"available":96589307904,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54668,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317172,"statfs":{"total":96636764160,"available":96580784128,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54664,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317176,"statfs":{"total":96636764160,"available":96580788224,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509537,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54708,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317132,"statfs":{"total":96636764160,"available":96580743168,"internally_reserved":0,"allocated":1347584,"data_stored":622994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509537,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50508,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321332,"statfs":{"total":96636764160,"available":96585043968,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55244,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316596,"statfs":{"total":96636764160,"available":96580194304,"internally_reserved":0,"allocated":1900544,"data_stored":1192802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51128,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320712,"statfs":{"total":96636764160,"available":96584409088,"internally_reserved":0,"allocated":1945600,"data_stored":1213488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:10:29.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3f is not active+clean 2024-04-25T09:10:29.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3e is not active+clean 2024-04-25T09:10:29.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3d is not active+clean 2024-04-25T09:10:29.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3c is not active+clean 2024-04-25T09:10:29.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3b is not active+clean 2024-04-25T09:10:29.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:23.980631+0000', 'last_change': '2024-04-25T09:10:23.980631+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.980631+0000', 'last_undegraded': '2024-04-25T09:10:23.980631+0000', 'last_fullsized': '2024-04-25T09:10:23.980631+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:10:29.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3a is not active+clean 2024-04-25T09:10:29.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.39 is not active+clean 2024-04-25T09:10:29.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.37 is not active+clean 2024-04-25T09:10:29.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.36 is not active+clean 2024-04-25T09:10:29.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:23.979654+0000', 'last_change': '2024-04-25T09:10:23.979654+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.979654+0000', 'last_undegraded': '2024-04-25T09:10:23.979654+0000', 'last_fullsized': '2024-04-25T09:10:23.979654+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:10:29.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.35 is not active+clean 2024-04-25T09:10:29.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.34 is not active+clean 2024-04-25T09:10:29.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.33 is not active+clean 2024-04-25T09:10:29.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2f is not active+clean 2024-04-25T09:10:29.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2e is not active+clean 2024-04-25T09:10:29.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2d is not active+clean 2024-04-25T09:10:29.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2c is not active+clean 2024-04-25T09:10:29.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2a is not active+clean 2024-04-25T09:10:29.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:23.979790+0000', 'last_change': '2024-04-25T09:10:23.979790+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.979790+0000', 'last_undegraded': '2024-04-25T09:10:23.979790+0000', 'last_fullsized': '2024-04-25T09:10:23.979790+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:10:29.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.29 is not active+clean 2024-04-25T09:10:29.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.28 is not active+clean 2024-04-25T09:10:29.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:23.978749+0000', 'last_change': '2024-04-25T09:10:23.978749+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.978749+0000', 'last_undegraded': '2024-04-25T09:10:23.978749+0000', 'last_fullsized': '2024-04-25T09:10:23.978749+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:10:29.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.27 is not active+clean 2024-04-25T09:10:29.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.26 is not active+clean 2024-04-25T09:10:29.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.25 is not active+clean 2024-04-25T09:10:29.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.24 is not active+clean 2024-04-25T09:10:29.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.22 is not active+clean 2024-04-25T09:10:29.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.21 is not active+clean 2024-04-25T09:10:29.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2024-04-25T09:10:29.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2024-04-25T09:10:29.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 106, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:22.968945+0000', 'last_change': '2024-04-25T09:10:22.968945+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:22.968945+0000', 'last_undegraded': '2024-04-25T09:10:22.968945+0000', 'last_fullsized': '2024-04-25T09:10:22.968945+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:10:29.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2024-04-25T09:10:29.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2024-04-25T09:10:29.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 106, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:22.968321+0000', 'last_change': '2024-04-25T09:10:22.968321+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:22.968321+0000', 'last_undegraded': '2024-04-25T09:10:22.968321+0000', 'last_fullsized': '2024-04-25T09:10:22.968321+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:10:29.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2024-04-25T09:10:29.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2024-04-25T09:10:29.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 107, 'state': 'creating+activating', 'last_fresh': '2024-04-25T09:10:23.981437+0000', 'last_change': '2024-04-25T09:10:23.975454+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.981437+0000', 'last_undegraded': '2024-04-25T09:10:23.981437+0000', 'last_fullsized': '2024-04-25T09:10:23.981437+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': ['1', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:10:29.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2024-04-25T09:10:29.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2024-04-25T09:10:29.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2024-04-25T09:10:29.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 106, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:22.971948+0000', 'last_change': '2024-04-25T09:10:22.971948+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:22.971948+0000', 'last_undegraded': '2024-04-25T09:10:22.971948+0000', 'last_fullsized': '2024-04-25T09:10:22.971948+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:10:29.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2024-04-25T09:10:29.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2024-04-25T09:10:29.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 106, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:22.967751+0000', 'last_change': '2024-04-25T09:10:22.967751+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:22.967751+0000', 'last_undegraded': '2024-04-25T09:10:22.967751+0000', 'last_fullsized': '2024-04-25T09:10:22.967751+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:10:29.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2024-04-25T09:10:29.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2024-04-25T09:10:29.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 106, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:22.968945+0000', 'last_change': '2024-04-25T09:10:22.968945+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:22.968945+0000', 'last_undegraded': '2024-04-25T09:10:22.968945+0000', 'last_fullsized': '2024-04-25T09:10:22.968945+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:10:29.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2024-04-25T09:10:29.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2024-04-25T09:10:29.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 106, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:22.969147+0000', 'last_change': '2024-04-25T09:10:22.969147+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:22.969147+0000', 'last_undegraded': '2024-04-25T09:10:22.969147+0000', 'last_fullsized': '2024-04-25T09:10:22.969147+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:10:29.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2024-04-25T09:10:29.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:23.974851+0000', 'last_change': '2024-04-25T09:10:23.974851+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.974851+0000', 'last_undegraded': '2024-04-25T09:10:23.974851+0000', 'last_fullsized': '2024-04-25T09:10:23.974851+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:10:29.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2024-04-25T09:10:29.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 106, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:22.973104+0000', 'last_change': '2024-04-25T09:10:22.973104+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:22.973104+0000', 'last_undegraded': '2024-04-25T09:10:22.973104+0000', 'last_fullsized': '2024-04-25T09:10:22.973104+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:10:29.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2024-04-25T09:10:29.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:23.976158+0000', 'last_change': '2024-04-25T09:10:23.976158+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.976158+0000', 'last_undegraded': '2024-04-25T09:10:23.976158+0000', 'last_fullsized': '2024-04-25T09:10:23.976158+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:10:29.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2024-04-25T09:10:29.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 106, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:22.969158+0000', 'last_change': '2024-04-25T09:10:22.969158+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:22.969158+0000', 'last_undegraded': '2024-04-25T09:10:22.969158+0000', 'last_fullsized': '2024-04-25T09:10:22.969158+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:10:29.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2024-04-25T09:10:29.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2024-04-25T09:10:29.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 107, 'state': 'creating+activating', 'last_fresh': '2024-04-25T09:10:23.975281+0000', 'last_change': '2024-04-25T09:10:23.975281+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.975281+0000', 'last_undegraded': '2024-04-25T09:10:23.975281+0000', 'last_fullsized': '2024-04-25T09:10:23.975281+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': ['1', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:10:29.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2024-04-25T09:10:29.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2024-04-25T09:10:29.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 106, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:22.969374+0000', 'last_change': '2024-04-25T09:10:22.969374+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:22.969374+0000', 'last_undegraded': '2024-04-25T09:10:22.969374+0000', 'last_fullsized': '2024-04-25T09:10:22.969374+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:10:29.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2024-04-25T09:10:29.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2024-04-25T09:10:29.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 106, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:22.968775+0000', 'last_change': '2024-04-25T09:10:22.968775+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:22.968775+0000', 'last_undegraded': '2024-04-25T09:10:22.968775+0000', 'last_fullsized': '2024-04-25T09:10:22.968775+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:10:29.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2024-04-25T09:10:29.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 106, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:22.968012+0000', 'last_change': '2024-04-25T09:10:22.968012+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:22.968012+0000', 'last_undegraded': '2024-04-25T09:10:22.968012+0000', 'last_fullsized': '2024-04-25T09:10:22.968012+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:10:29.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2024-04-25T09:10:29.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2024-04-25T09:10:29.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:23.976865+0000', 'last_change': '2024-04-25T09:10:23.976865+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.976865+0000', 'last_undegraded': '2024-04-25T09:10:23.976865+0000', 'last_fullsized': '2024-04-25T09:10:23.976865+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:10:29.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2024-04-25T09:10:29.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 106, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:22.971957+0000', 'last_change': '2024-04-25T09:10:22.971957+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:22.971957+0000', 'last_undegraded': '2024-04-25T09:10:22.971957+0000', 'last_fullsized': '2024-04-25T09:10:22.971957+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:10:29.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2024-04-25T09:10:29.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2024-04-25T09:10:29.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2024-04-25T09:10:29.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2024-04-25T09:10:29.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 106, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:22.968321+0000', 'last_change': '2024-04-25T09:10:22.968321+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:22.968321+0000', 'last_undegraded': '2024-04-25T09:10:22.968321+0000', 'last_fullsized': '2024-04-25T09:10:22.968321+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:10:29.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2024-04-25T09:10:29.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2024-04-25T09:10:29.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 107, 'state': 'creating+activating', 'last_fresh': '2024-04-25T09:10:23.975258+0000', 'last_change': '2024-04-25T09:10:23.975258+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.975258+0000', 'last_undegraded': '2024-04-25T09:10:23.975258+0000', 'last_fullsized': '2024-04-25T09:10:23.975258+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': ['1', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:10:29.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2024-04-25T09:10:29.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2024-04-25T09:10:29.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 106, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:22.972613+0000', 'last_change': '2024-04-25T09:10:22.972613+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:22.972613+0000', 'last_undegraded': '2024-04-25T09:10:22.972613+0000', 'last_fullsized': '2024-04-25T09:10:22.972613+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:10:29.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2024-04-25T09:10:29.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2024-04-25T09:10:29.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 106, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:22.968620+0000', 'last_change': '2024-04-25T09:10:22.968620+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:22.968620+0000', 'last_undegraded': '2024-04-25T09:10:22.968620+0000', 'last_fullsized': '2024-04-25T09:10:22.968620+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:10:29.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2024-04-25T09:10:29.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2024-04-25T09:10:29.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 107, 'state': 'creating+activating', 'last_fresh': '2024-04-25T09:10:23.975038+0000', 'last_change': '2024-04-25T09:10:23.975038+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.975038+0000', 'last_undegraded': '2024-04-25T09:10:23.975038+0000', 'last_fullsized': '2024-04-25T09:10:23.975038+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': ['1', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:10:29.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2024-04-25T09:10:29.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 106, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:22.967933+0000', 'last_change': '2024-04-25T09:10:22.967933+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:22.967933+0000', 'last_undegraded': '2024-04-25T09:10:22.967933+0000', 'last_fullsized': '2024-04-25T09:10:22.967933+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:10:29.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2024-04-25T09:10:29.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 106, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:10:22.967759+0000', 'last_change': '2024-04-25T09:10:22.967759+0000', 'last_active': '2024-04-25T09:10:22.957866+0000', 'last_peered': '2024-04-25T09:10:22.957866+0000', 'last_clean': '2024-04-25T09:10:22.957866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:22.967759+0000', 'last_undegraded': '2024-04-25T09:10:22.967759+0000', 'last_fullsized': '2024-04-25T09:10:22.967759+0000', 'mapping_epoch': 106, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 106, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:22.957866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:10:29.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2024-04-25T09:10:29.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2024-04-25T09:10:29.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:10:23.964712+0000', 'last_change': '2024-04-25T09:10:23.964712+0000', 'last_active': '2024-04-25T09:10:23.964712+0000', 'last_peered': '2024-04-25T09:10:23.964712+0000', 'last_clean': '2024-04-25T09:10:23.964712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:10:23.964712+0000', 'last_undegraded': '2024-04-25T09:10:23.964712+0000', 'last_fullsized': '2024-04-25T09:10:23.964712+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'last_clean_scrub_stamp': '2024-04-25T09:10:23.964712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:10:29.827 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:10:29.944 INFO:tasks.ceph.mds.c.smithi173.stderr:2024-04-25T09:10:29.955+0000 7f759e400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:10:29.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.003+0000 7fd497400640 1 Processor -- start 2024-04-25T09:10:29.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.003+0000 7fd497400640 1 -- start start 2024-04-25T09:10:29.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.003+0000 7fd497400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd49015ba20 0x7fd49015be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.003+0000 7fd497400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd4900b70f0 0x7fd49006f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.003+0000 7fd497400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd4900b7550 0x7fd49006fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.003+0000 7fd497400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49015c460 con 0x7fd4900b70f0 2024-04-25T09:10:29.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.003+0000 7fd497400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49015c740 con 0x7fd4900b7550 2024-04-25T09:10:29.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.003+0000 7fd497400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49015ca20 con 0x7fd49015ba20 2024-04-25T09:10:29.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.003+0000 7fd48fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd4900b70f0 0x7fd49006f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.003+0000 7fd48fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd4900b70f0 0x7fd49006f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52330/0 (socket says 172.21.15.173:52330) 2024-04-25T09:10:29.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.003+0000 7fd48fe00640 1 -- 172.21.15.173:0/3570779204 learned_addr learned my addr 172.21.15.173:0/3570779204 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:29.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.003+0000 7fd494a00640 1 --2- 172.21.15.173:0/3570779204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd49015ba20 0x7fd49015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.003+0000 7fd495400640 1 --2- 172.21.15.173:0/3570779204 >> v2:172.21.15.194:3300/0 conn(0x7fd4900b7550 0x7fd49006fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.003+0000 7fd48fe00640 1 -- 172.21.15.173:0/3570779204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd49015ba20 msgr2=0x7fd49015be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:29.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.003+0000 7fd48fe00640 1 --2- 172.21.15.173:0/3570779204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd49015ba20 0x7fd49015be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.003+0000 7fd48fe00640 1 -- 172.21.15.173:0/3570779204 >> v2:172.21.15.194:3300/0 conn(0x7fd4900b7550 msgr2=0x7fd49006fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:29.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.003+0000 7fd48fe00640 1 --2- 172.21.15.173:0/3570779204 >> v2:172.21.15.194:3300/0 conn(0x7fd4900b7550 0x7fd49006fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.003+0000 7fd48fe00640 1 -- 172.21.15.173:0/3570779204 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49015cd00 con 0x7fd4900b70f0 2024-04-25T09:10:29.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.007+0000 7fd48fe00640 1 --2- 172.21.15.173:0/3570779204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4900b70f0 0x7fd49006f960 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fd4900b6bf0 tx=0x7fd47c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f29af95f713d5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:29.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.007+0000 7fd48f400640 1 -- 172.21.15.173:0/3570779204 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c0aa430 con 0x7fd4900b70f0 2024-04-25T09:10:29.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.007+0000 7fd48f400640 1 -- 172.21.15.173:0/3570779204 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c0af070 con 0x7fd4900b70f0 2024-04-25T09:10:29.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.007+0000 7fd48f400640 1 -- 172.21.15.173:0/3570779204 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c0aa7f0 con 0x7fd4900b70f0 2024-04-25T09:10:29.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.007+0000 7fd497400640 1 -- 172.21.15.173:0/3570779204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4900b70f0 msgr2=0x7fd49006f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.007+0000 7fd497400640 1 --2- 172.21.15.173:0/3570779204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4900b70f0 0x7fd49006f960 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fd4900b6bf0 tx=0x7fd47c01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.007+0000 7fd497400640 1 -- 172.21.15.173:0/3570779204 shutdown_connections 2024-04-25T09:10:29.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.007+0000 7fd497400640 1 --2- 172.21.15.173:0/3570779204 >> v2:172.21.15.194:3300/0 conn(0x7fd4900b7550 0x7fd49006fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.007+0000 7fd497400640 1 --2- 172.21.15.173:0/3570779204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4900b70f0 0x7fd49006f960 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.007+0000 7fd497400640 1 --2- 172.21.15.173:0/3570779204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd49015ba20 0x7fd49015be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.007+0000 7fd497400640 1 -- 172.21.15.173:0/3570779204 >> 172.21.15.173:0/3570779204 conn(0x7fd490061880 msgr2=0x7fd490061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:29.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.007+0000 7fd497400640 1 -- 172.21.15.173:0/3570779204 shutdown_connections 2024-04-25T09:10:29.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.007+0000 7fd497400640 1 -- 172.21.15.173:0/3570779204 wait complete. 2024-04-25T09:10:30.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd497400640 1 Processor -- start 2024-04-25T09:10:30.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd497400640 1 -- start start 2024-04-25T09:10:30.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd497400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4900b70f0 0x7fd4901fab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd497400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd49015ba20 0x7fd490153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd497400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd490152500 0x7fd490154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd497400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4900d2620 con 0x7fd490152500 2024-04-25T09:10:30.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd497400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4900d24a0 con 0x7fd4900b70f0 2024-04-25T09:10:30.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd497400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49015f3f0 con 0x7fd49015ba20 2024-04-25T09:10:30.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd495400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd490152500 0x7fd490154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd495400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd490152500 0x7fd490154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52332/0 (socket says 172.21.15.173:52332) 2024-04-25T09:10:30.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd495400640 1 -- 172.21.15.173:0/1939871353 learned_addr learned my addr 172.21.15.173:0/1939871353 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:30.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd494a00640 1 --2- 172.21.15.173:0/1939871353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4900b70f0 0x7fd4901fab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd48fe00640 1 --2- 172.21.15.173:0/1939871353 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd49015ba20 0x7fd490153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd495400640 1 -- 172.21.15.173:0/1939871353 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd49015ba20 msgr2=0x7fd490153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd495400640 1 --2- 172.21.15.173:0/1939871353 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd49015ba20 0x7fd490153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd495400640 1 -- 172.21.15.173:0/1939871353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4900b70f0 msgr2=0x7fd4901fab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd495400640 1 --2- 172.21.15.173:0/1939871353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4900b70f0 0x7fd4901fab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd495400640 1 -- 172.21.15.173:0/1939871353 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd490159c50 con 0x7fd490152500 2024-04-25T09:10:30.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd495400640 1 --2- 172.21.15.173:0/1939871353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd490152500 0x7fd490154db0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fd488007e30 tx=0x7fd48800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd48cc00640 1 -- 172.21.15.173:0/1939871353 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488014420 con 0x7fd490152500 2024-04-25T09:10:30.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd48cc00640 1 -- 172.21.15.173:0/1939871353 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd488019070 con 0x7fd490152500 2024-04-25T09:10:30.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd48cc00640 1 -- 172.21.15.173:0/1939871353 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488014800 con 0x7fd490152500 2024-04-25T09:10:30.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd497400640 1 -- 172.21.15.173:0/1939871353 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd490154400 con 0x7fd490152500 2024-04-25T09:10:30.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd497400640 1 -- 172.21.15.173:0/1939871353 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4901fa020 con 0x7fd490152500 2024-04-25T09:10:30.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.011+0000 7fd497400640 1 -- 172.21.15.173:0/1939871353 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd490073a40 con 0x7fd490152500 2024-04-25T09:10:30.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.015+0000 7fd48cc00640 1 -- 172.21.15.173:0/1939871353 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd4880149a0 con 0x7fd490152500 2024-04-25T09:10:30.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.015+0000 7fd48cc00640 1 --2- 172.21.15.173:0/1939871353 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd470066f90 0x7fd470069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.015+0000 7fd48cc00640 1 -- 172.21.15.173:0/1939871353 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd488085920 con 0x7fd490152500 2024-04-25T09:10:30.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.015+0000 7fd494a00640 1 --2- 172.21.15.173:0/1939871353 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd470066f90 0x7fd470069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.015+0000 7fd494a00640 1 --2- 172.21.15.173:0/1939871353 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd470066f90 0x7fd470069450 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd4840079c0 tx=0x7fd484008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.019+0000 7fd48cc00640 1 -- 172.21.15.173:0/1939871353 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd490159c50 con 0x7fd490152500 2024-04-25T09:10:30.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.227+0000 7fd497400640 1 -- 172.21.15.173:0/1939871353 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd4900cefc0 con 0x7fd490152500 2024-04-25T09:10:30.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.227+0000 7fd48cc00640 1 -- 172.21.15.173:0/1939871353 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1640 (secure 0 0 0) 0x7fd4880560b0 con 0x7fd490152500 2024-04-25T09:10:30.217 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:30.217 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":484,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":109,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":42},{"state_name":"active+clean","count":27},{"state_name":"creating+peering","count":24},{"state_name":"creating+activating","count":4}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":590528,"bytes_used":427794432,"bytes_avail":772666318848,"bytes_total":773094113280,"unknown_pgs_ratio":0.4329896867275238,"inactive_pgs_ratio":0.28865978121757507,"write_bytes_sec":349,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":72,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8193}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-04-25T09:10:12.824831+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:10:30.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.231+0000 7fd497400640 1 -- 172.21.15.173:0/1939871353 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd470066f90 msgr2=0x7fd470069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.231+0000 7fd497400640 1 --2- 172.21.15.173:0/1939871353 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd470066f90 0x7fd470069450 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd4840079c0 tx=0x7fd484008040 comp rx=0 tx=0).stop 2024-04-25T09:10:30.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.231+0000 7fd497400640 1 -- 172.21.15.173:0/1939871353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd490152500 msgr2=0x7fd490154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.231+0000 7fd497400640 1 --2- 172.21.15.173:0/1939871353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd490152500 0x7fd490154db0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fd488007e30 tx=0x7fd48800e4b0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.231+0000 7fd497400640 1 -- 172.21.15.173:0/1939871353 shutdown_connections 2024-04-25T09:10:30.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.231+0000 7fd497400640 1 --2- 172.21.15.173:0/1939871353 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd470066f90 0x7fd470069450 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.231+0000 7fd497400640 1 --2- 172.21.15.173:0/1939871353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd490152500 0x7fd490154db0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.231+0000 7fd497400640 1 --2- 172.21.15.173:0/1939871353 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd49015ba20 0x7fd490153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.231+0000 7fd497400640 1 --2- 172.21.15.173:0/1939871353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4900b70f0 0x7fd4901fab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.231+0000 7fd497400640 1 -- 172.21.15.173:0/1939871353 >> 172.21.15.173:0/1939871353 conn(0x7fd490061880 msgr2=0x7fd4900b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.231+0000 7fd497400640 1 -- 172.21.15.173:0/1939871353 shutdown_connections 2024-04-25T09:10:30.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.231+0000 7fd497400640 1 -- 172.21.15.173:0/1939871353 wait complete. 2024-04-25T09:10:30.239 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:10:30.239 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:10:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.387+0000 7f4110800640 1 Processor -- start 2024-04-25T09:10:30.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.387+0000 7f4110800640 1 -- start start 2024-04-25T09:10:30.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.387+0000 7f4110800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f410815dbb0 0x7f410815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.387+0000 7f4110800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f41080d2130 0x7f410806c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.387+0000 7f4110800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f410806c7b0 0x7f410806f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.387+0000 7f4110800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410806d870 con 0x7f410815dbb0 2024-04-25T09:10:30.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.387+0000 7f4110800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4108161690 con 0x7f41080d2130 2024-04-25T09:10:30.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.387+0000 7f4110800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41080d2590 con 0x7f410806c7b0 2024-04-25T09:10:30.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.387+0000 7f410de00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f410815dbb0 0x7f410815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.387+0000 7f410de00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f410815dbb0 0x7f410815df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52348/0 (socket says 172.21.15.173:52348) 2024-04-25T09:10:30.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.387+0000 7f410de00640 1 -- 172.21.15.173:0/98620422 learned_addr learned my addr 172.21.15.173:0/98620422 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:30.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.387+0000 7f410e800640 1 --2- 172.21.15.173:0/98620422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f410806c7b0 0x7f410806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.387+0000 7f410d400640 1 --2- 172.21.15.173:0/98620422 >> v2:172.21.15.194:3300/0 conn(0x7f41080d2130 0x7f410806c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.387+0000 7f410de00640 1 -- 172.21.15.173:0/98620422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f410806c7b0 msgr2=0x7f410806f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.387+0000 7f410de00640 1 --2- 172.21.15.173:0/98620422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f410806c7b0 0x7f410806f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.387+0000 7f410de00640 1 -- 172.21.15.173:0/98620422 >> v2:172.21.15.194:3300/0 conn(0x7f41080d2130 msgr2=0x7f410806c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.387+0000 7f410de00640 1 --2- 172.21.15.173:0/98620422 >> v2:172.21.15.194:3300/0 conn(0x7f41080d2130 0x7f410806c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.387+0000 7f410de00640 1 -- 172.21.15.173:0/98620422 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410815e5c0 con 0x7f410815dbb0 2024-04-25T09:10:30.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.391+0000 7f410de00640 1 --2- 172.21.15.173:0/98620422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f410815dbb0 0x7f410815df90 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f4108070590 tx=0x7f40fc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771faa1c23354287 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.391+0000 7f410ca00640 1 -- 172.21.15.173:0/98620422 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc0b1070 con 0x7f410815dbb0 2024-04-25T09:10:30.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.391+0000 7f410ca00640 1 -- 172.21.15.173:0/98620422 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40fc0ac620 con 0x7f410815dbb0 2024-04-25T09:10:30.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.391+0000 7f410ca00640 1 -- 172.21.15.173:0/98620422 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc0ac9f0 con 0x7f410815dbb0 2024-04-25T09:10:30.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.391+0000 7f4110800640 1 -- 172.21.15.173:0/98620422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f410815dbb0 msgr2=0x7f410815df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.391+0000 7f4110800640 1 --2- 172.21.15.173:0/98620422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f410815dbb0 0x7f410815df90 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f4108070590 tx=0x7f40fc01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.391+0000 7f4110800640 1 -- 172.21.15.173:0/98620422 shutdown_connections 2024-04-25T09:10:30.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.391+0000 7f4110800640 1 --2- 172.21.15.173:0/98620422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f410806c7b0 0x7f410806f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.391+0000 7f4110800640 1 --2- 172.21.15.173:0/98620422 >> v2:172.21.15.194:3300/0 conn(0x7f41080d2130 0x7f410806c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.391+0000 7f4110800640 1 --2- 172.21.15.173:0/98620422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f410815dbb0 0x7f410815df90 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.391+0000 7f4110800640 1 -- 172.21.15.173:0/98620422 >> 172.21.15.173:0/98620422 conn(0x7f4108061880 msgr2=0x7f4108061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.391+0000 7f4110800640 1 -- 172.21.15.173:0/98620422 shutdown_connections 2024-04-25T09:10:30.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.391+0000 7f4110800640 1 -- 172.21.15.173:0/98620422 wait complete. 2024-04-25T09:10:30.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f4110800640 1 Processor -- start 2024-04-25T09:10:30.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f4110800640 1 -- start start 2024-04-25T09:10:30.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f4110800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f410806c7b0 0x7f4108158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f4110800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41080d2130 0x7f41080ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f4110800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f410815dbb0 0x7f41080c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f4110800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41080cf4e0 con 0x7f41080d2130 2024-04-25T09:10:30.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f4110800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41080cf360 con 0x7f410806c7b0 2024-04-25T09:10:30.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f4110800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41080cf660 con 0x7f410815dbb0 2024-04-25T09:10:30.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f410d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41080d2130 0x7f41080ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f410d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41080d2130 0x7f41080ca230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52358/0 (socket says 172.21.15.173:52358) 2024-04-25T09:10:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f410d400640 1 -- 172.21.15.173:0/443859565 learned_addr learned my addr 172.21.15.173:0/443859565 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f410de00640 1 --2- 172.21.15.173:0/443859565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f410806c7b0 0x7f4108158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f410e800640 1 --2- 172.21.15.173:0/443859565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f410815dbb0 0x7f41080c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f410d400640 1 -- 172.21.15.173:0/443859565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f410815dbb0 msgr2=0x7f41080c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f410d400640 1 --2- 172.21.15.173:0/443859565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f410815dbb0 0x7f41080c6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f410d400640 1 -- 172.21.15.173:0/443859565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f410806c7b0 msgr2=0x7f4108158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f410d400640 1 --2- 172.21.15.173:0/443859565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f410806c7b0 0x7f4108158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f410d400640 1 -- 172.21.15.173:0/443859565 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41080cc420 con 0x7f41080d2130 2024-04-25T09:10:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f410d400640 1 --2- 172.21.15.173:0/443859565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41080d2130 0x7f41080ca230 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f40f800d800 tx=0x7f40f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f4102000640 1 -- 172.21.15.173:0/443859565 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f800b6c0 con 0x7f41080d2130 2024-04-25T09:10:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f4102000640 1 -- 172.21.15.173:0/443859565 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f8019070 con 0x7f41080d2130 2024-04-25T09:10:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f4110800640 1 -- 172.21.15.173:0/443859565 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41080ad920 con 0x7f41080d2130 2024-04-25T09:10:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f4102000640 1 -- 172.21.15.173:0/443859565 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f800ba60 con 0x7f41080d2130 2024-04-25T09:10:30.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.395+0000 7f4110800640 1 -- 172.21.15.173:0/443859565 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41080cac80 con 0x7f41080d2130 2024-04-25T09:10:30.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.399+0000 7f4110800640 1 -- 172.21.15.173:0/443859565 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4108073a40 con 0x7f41080d2130 2024-04-25T09:10:30.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.399+0000 7f4102000640 1 -- 172.21.15.173:0/443859565 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f40f800bc00 con 0x7f41080d2130 2024-04-25T09:10:30.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.399+0000 7f4102000640 1 --2- 172.21.15.173:0/443859565 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40ec066f90 0x7f40ec069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.399+0000 7f4102000640 1 -- 172.21.15.173:0/443859565 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f40f80854a0 con 0x7f41080d2130 2024-04-25T09:10:30.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.399+0000 7f410de00640 1 --2- 172.21.15.173:0/443859565 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40ec066f90 0x7f40ec069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.399+0000 7f410de00640 1 --2- 172.21.15.173:0/443859565 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40ec066f90 0x7f40ec069450 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0ae000 tx=0x7f40fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.403+0000 7f4102000640 1 -- 172.21.15.173:0/443859565 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f40f8055d60 con 0x7f41080d2130 2024-04-25T09:10:30.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.555+0000 7f4110800640 1 -- 172.21.15.173:0/443859565 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f410806c380 con 0x7f40ec066f90 2024-04-25T09:10:30.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.559+0000 7f4102000640 1 -- 172.21.15.173:0/443859565 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243976 (secure 0 0 0) 0x7f410806c380 con 0x7f40ec066f90 2024-04-25T09:10:30.551 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:30.552 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:10:30.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.563+0000 7f4110800640 1 -- 172.21.15.173:0/443859565 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40ec066f90 msgr2=0x7f40ec069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.563+0000 7f4110800640 1 --2- 172.21.15.173:0/443859565 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40ec066f90 0x7f40ec069450 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0ae000 tx=0x7f40fc008040 comp rx=0 tx=0).stop 2024-04-25T09:10:30.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.563+0000 7f4110800640 1 -- 172.21.15.173:0/443859565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41080d2130 msgr2=0x7f41080ca230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.563+0000 7f4110800640 1 --2- 172.21.15.173:0/443859565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41080d2130 0x7f41080ca230 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f40f800d800 tx=0x7f40f800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.563+0000 7f4110800640 1 -- 172.21.15.173:0/443859565 shutdown_connections 2024-04-25T09:10:30.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.563+0000 7f4110800640 1 --2- 172.21.15.173:0/443859565 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40ec066f90 0x7f40ec069450 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.563+0000 7f4110800640 1 --2- 172.21.15.173:0/443859565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f410815dbb0 0x7f41080c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.563+0000 7f4110800640 1 --2- 172.21.15.173:0/443859565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41080d2130 0x7f41080ca230 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.563+0000 7f4110800640 1 --2- 172.21.15.173:0/443859565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f410806c7b0 0x7f4108158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.563+0000 7f4110800640 1 -- 172.21.15.173:0/443859565 >> 172.21.15.173:0/443859565 conn(0x7f4108061880 msgr2=0x7f41080d1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.563+0000 7f4110800640 1 -- 172.21.15.173:0/443859565 shutdown_connections 2024-04-25T09:10:30.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:30.563+0000 7f4110800640 1 -- 172.21.15.173:0/443859565 wait complete. 2024-04-25T09:10:30.572 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-04-25T09:10:28.828465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":168,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":110,"acting":110,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":417768,"kb_used_data":11452,"kb_used_omap":12,"kb_used_meta":406195,"kb_avail":754556952,"statfs":{"total":773094113280,"available":772666318848,"internally_reserved":0,"allocated":11726848,"data_stored":6041454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":415944240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.862895"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.980631+0000","last_change":"2024-04-25T09:10:23.980631+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.980631+0000","last_undegraded":"2024-04-25T09:10:23.980631+0000","last_fullsized":"2024-04-25T09:10:23.980631+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992093+0000","last_change":"2024-04-25T09:10:25.004287+0000","last_active":"2024-04-25T09:10:25.992093+0000","last_peered":"2024-04-25T09:10:25.992093+0000","last_clean":"2024-04-25T09:10:25.992093+0000","last_became_active":"2024-04-25T09:10:25.002537+0000","last_became_peered":"2024-04-25T09:10:25.002537+0000","last_unstale":"2024-04-25T09:10:25.992093+0000","last_undegraded":"2024-04-25T09:10:25.992093+0000","last_fullsized":"2024-04-25T09:10:25.992093+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:25.248880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.979654+0000","last_change":"2024-04-25T09:10:23.979654+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.979654+0000","last_undegraded":"2024-04-25T09:10:23.979654+0000","last_fullsized":"2024-04-25T09:10:23.979654+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153900+0000","last_change":"2024-04-25T09:10:25.005698+0000","last_active":"2024-04-25T09:10:26.153900+0000","last_peered":"2024-04-25T09:10:26.153900+0000","last_clean":"2024-04-25T09:10:26.153900+0000","last_became_active":"2024-04-25T09:10:25.005083+0000","last_became_peered":"2024-04-25T09:10:25.005083+0000","last_unstale":"2024-04-25T09:10:26.153900+0000","last_undegraded":"2024-04-25T09:10:26.153900+0000","last_fullsized":"2024-04-25T09:10:26.153900+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:37.012652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153563+0000","last_change":"2024-04-25T09:10:25.010387+0000","last_active":"2024-04-25T09:10:26.153563+0000","last_peered":"2024-04-25T09:10:26.153563+0000","last_clean":"2024-04-25T09:10:26.153563+0000","last_became_active":"2024-04-25T09:10:25.008940+0000","last_became_peered":"2024-04-25T09:10:25.008940+0000","last_unstale":"2024-04-25T09:10:26.153563+0000","last_undegraded":"2024-04-25T09:10:26.153563+0000","last_fullsized":"2024-04-25T09:10:26.153563+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:40.367585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153361+0000","last_change":"2024-04-25T09:10:25.005571+0000","last_active":"2024-04-25T09:10:26.153361+0000","last_peered":"2024-04-25T09:10:26.153361+0000","last_clean":"2024-04-25T09:10:26.153361+0000","last_became_active":"2024-04-25T09:10:25.005263+0000","last_became_peered":"2024-04-25T09:10:25.005263+0000","last_unstale":"2024-04-25T09:10:26.153361+0000","last_undegraded":"2024-04-25T09:10:26.153361+0000","last_fullsized":"2024-04-25T09:10:26.153361+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:07.504059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992691+0000","last_change":"2024-04-25T09:10:25.003489+0000","last_active":"2024-04-25T09:10:25.992691+0000","last_peered":"2024-04-25T09:10:25.992691+0000","last_clean":"2024-04-25T09:10:25.992691+0000","last_became_active":"2024-04-25T09:10:25.003239+0000","last_became_peered":"2024-04-25T09:10:25.003239+0000","last_unstale":"2024-04-25T09:10:25.992691+0000","last_undegraded":"2024-04-25T09:10:25.992691+0000","last_fullsized":"2024-04-25T09:10:25.992691+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:27.352442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.979790+0000","last_change":"2024-04-25T09:10:23.979790+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.979790+0000","last_undegraded":"2024-04-25T09:10:23.979790+0000","last_fullsized":"2024-04-25T09:10:23.979790+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.978749+0000","last_change":"2024-04-25T09:10:23.978749+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.978749+0000","last_undegraded":"2024-04-25T09:10:23.978749+0000","last_fullsized":"2024-04-25T09:10:23.978749+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992737+0000","last_change":"2024-04-25T09:10:25.009613+0000","last_active":"2024-04-25T09:10:25.992737+0000","last_peered":"2024-04-25T09:10:25.992737+0000","last_clean":"2024-04-25T09:10:25.992737+0000","last_became_active":"2024-04-25T09:10:25.009123+0000","last_became_peered":"2024-04-25T09:10:25.009123+0000","last_unstale":"2024-04-25T09:10:25.992737+0000","last_undegraded":"2024-04-25T09:10:25.992737+0000","last_fullsized":"2024-04-25T09:10:25.992737+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:25.292786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992145+0000","last_change":"2024-04-25T09:10:24.998492+0000","last_active":"2024-04-25T09:10:25.992145+0000","last_peered":"2024-04-25T09:10:25.992145+0000","last_clean":"2024-04-25T09:10:25.992145+0000","last_became_active":"2024-04-25T09:10:24.998110+0000","last_became_peered":"2024-04-25T09:10:24.998110+0000","last_unstale":"2024-04-25T09:10:25.992145+0000","last_undegraded":"2024-04-25T09:10:25.992145+0000","last_fullsized":"2024-04-25T09:10:25.992145+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:43.209701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968945+0000","last_change":"2024-04-25T09:10:22.968945+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968945+0000","last_undegraded":"2024-04-25T09:10:22.968945+0000","last_fullsized":"2024-04-25T09:10:22.968945+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992257+0000","last_change":"2024-04-25T09:10:25.001829+0000","last_active":"2024-04-25T09:10:25.992257+0000","last_peered":"2024-04-25T09:10:25.992257+0000","last_clean":"2024-04-25T09:10:25.992257+0000","last_became_active":"2024-04-25T09:10:25.001529+0000","last_became_peered":"2024-04-25T09:10:25.001529+0000","last_unstale":"2024-04-25T09:10:25.992257+0000","last_undegraded":"2024-04-25T09:10:25.992257+0000","last_fullsized":"2024-04-25T09:10:25.992257+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:27.725078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993011+0000","last_change":"2024-04-25T09:10:23.997442+0000","last_active":"2024-04-25T09:10:25.993011+0000","last_peered":"2024-04-25T09:10:25.993011+0000","last_clean":"2024-04-25T09:10:25.993011+0000","last_became_active":"2024-04-25T09:10:23.994906+0000","last_became_peered":"2024-04-25T09:10:23.994906+0000","last_unstale":"2024-04-25T09:10:25.993011+0000","last_undegraded":"2024-04-25T09:10:25.993011+0000","last_fullsized":"2024-04-25T09:10:25.993011+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:08.860155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968321+0000","last_change":"2024-04-25T09:10:22.968321+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968321+0000","last_undegraded":"2024-04-25T09:10:22.968321+0000","last_fullsized":"2024-04-25T09:10:22.968321+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":4,"reported_epoch":107,"state":"creating+activating","last_fresh":"2024-04-25T09:10:23.981437+0000","last_change":"2024-04-25T09:10:23.975454+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.981437+0000","last_undegraded":"2024-04-25T09:10:23.981437+0000","last_fullsized":"2024-04-25T09:10:23.981437+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153708+0000","last_change":"2024-04-25T09:10:23.988905+0000","last_active":"2024-04-25T09:10:26.153708+0000","last_peered":"2024-04-25T09:10:26.153708+0000","last_clean":"2024-04-25T09:10:26.153708+0000","last_became_active":"2024-04-25T09:10:23.988625+0000","last_became_peered":"2024-04-25T09:10:23.988625+0000","last_unstale":"2024-04-25T09:10:26.153708+0000","last_undegraded":"2024-04-25T09:10:26.153708+0000","last_fullsized":"2024-04-25T09:10:26.153708+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:48.797438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.971948+0000","last_change":"2024-04-25T09:10:22.971948+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.971948+0000","last_undegraded":"2024-04-25T09:10:22.971948+0000","last_fullsized":"2024-04-25T09:10:22.971948+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.967751+0000","last_change":"2024-04-25T09:10:22.967751+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.967751+0000","last_undegraded":"2024-04-25T09:10:22.967751+0000","last_fullsized":"2024-04-25T09:10:22.967751+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968945+0000","last_change":"2024-04-25T09:10:22.968945+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968945+0000","last_undegraded":"2024-04-25T09:10:22.968945+0000","last_fullsized":"2024-04-25T09:10:22.968945+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.969147+0000","last_change":"2024-04-25T09:10:22.969147+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.969147+0000","last_undegraded":"2024-04-25T09:10:22.969147+0000","last_fullsized":"2024-04-25T09:10:22.969147+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.974851+0000","last_change":"2024-04-25T09:10:23.974851+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.974851+0000","last_undegraded":"2024-04-25T09:10:23.974851+0000","last_fullsized":"2024-04-25T09:10:23.974851+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.973104+0000","last_change":"2024-04-25T09:10:22.973104+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.973104+0000","last_undegraded":"2024-04-25T09:10:22.973104+0000","last_fullsized":"2024-04-25T09:10:22.973104+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992521+0000","last_change":"2024-04-25T09:10:25.009042+0000","last_active":"2024-04-25T09:10:25.992521+0000","last_peered":"2024-04-25T09:10:25.992521+0000","last_clean":"2024-04-25T09:10:25.992521+0000","last_became_active":"2024-04-25T09:10:25.008796+0000","last_became_peered":"2024-04-25T09:10:25.008796+0000","last_unstale":"2024-04-25T09:10:25.992521+0000","last_undegraded":"2024-04-25T09:10:25.992521+0000","last_fullsized":"2024-04-25T09:10:25.992521+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:14.584473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"108'3","reported_seq":17,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153816+0000","last_change":"2024-04-25T09:10:23.987279+0000","last_active":"2024-04-25T09:10:26.153816+0000","last_peered":"2024-04-25T09:10:26.153816+0000","last_clean":"2024-04-25T09:10:26.153816+0000","last_became_active":"2024-04-25T09:10:23.986988+0000","last_became_peered":"2024-04-25T09:10:23.986988+0000","last_unstale":"2024-04-25T09:10:26.153816+0000","last_undegraded":"2024-04-25T09:10:26.153816+0000","last_fullsized":"2024-04-25T09:10:26.153816+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:08.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.976158+0000","last_change":"2024-04-25T09:10:23.976158+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.976158+0000","last_undegraded":"2024-04-25T09:10:23.976158+0000","last_fullsized":"2024-04-25T09:10:23.976158+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.969158+0000","last_change":"2024-04-25T09:10:22.969158+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.969158+0000","last_undegraded":"2024-04-25T09:10:22.969158+0000","last_fullsized":"2024-04-25T09:10:22.969158+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":3,"reported_epoch":107,"state":"creating+activating","last_fresh":"2024-04-25T09:10:23.975281+0000","last_change":"2024-04-25T09:10:23.975281+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.975281+0000","last_undegraded":"2024-04-25T09:10:23.975281+0000","last_fullsized":"2024-04-25T09:10:23.975281+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.969374+0000","last_change":"2024-04-25T09:10:22.969374+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.969374+0000","last_undegraded":"2024-04-25T09:10:22.969374+0000","last_fullsized":"2024-04-25T09:10:22.969374+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993005+0000","last_change":"2024-04-25T09:10:24.995940+0000","last_active":"2024-04-25T09:10:25.993005+0000","last_peered":"2024-04-25T09:10:25.993005+0000","last_clean":"2024-04-25T09:10:25.993005+0000","last_became_active":"2024-04-25T09:10:24.995666+0000","last_became_peered":"2024-04-25T09:10:24.995666+0000","last_unstale":"2024-04-25T09:10:25.993005+0000","last_undegraded":"2024-04-25T09:10:25.993005+0000","last_fullsized":"2024-04-25T09:10:25.993005+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:10.104554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992353+0000","last_change":"2024-04-25T09:10:23.990205+0000","last_active":"2024-04-25T09:10:25.992353+0000","last_peered":"2024-04-25T09:10:25.992353+0000","last_clean":"2024-04-25T09:10:25.992353+0000","last_became_active":"2024-04-25T09:10:23.989778+0000","last_became_peered":"2024-04-25T09:10:23.989778+0000","last_unstale":"2024-04-25T09:10:25.992353+0000","last_undegraded":"2024-04-25T09:10:25.992353+0000","last_fullsized":"2024-04-25T09:10:25.992353+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:43.287970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968775+0000","last_change":"2024-04-25T09:10:22.968775+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968775+0000","last_undegraded":"2024-04-25T09:10:22.968775+0000","last_fullsized":"2024-04-25T09:10:22.968775+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992235+0000","last_change":"2024-04-25T09:10:25.002077+0000","last_active":"2024-04-25T09:10:25.992235+0000","last_peered":"2024-04-25T09:10:25.992235+0000","last_clean":"2024-04-25T09:10:25.992235+0000","last_became_active":"2024-04-25T09:10:25.001788+0000","last_became_peered":"2024-04-25T09:10:25.001788+0000","last_unstale":"2024-04-25T09:10:25.992235+0000","last_undegraded":"2024-04-25T09:10:25.992235+0000","last_fullsized":"2024-04-25T09:10:25.992235+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:53.146010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968012+0000","last_change":"2024-04-25T09:10:22.968012+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968012+0000","last_undegraded":"2024-04-25T09:10:22.968012+0000","last_fullsized":"2024-04-25T09:10:22.968012+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153935+0000","last_change":"2024-04-25T09:10:23.985775+0000","last_active":"2024-04-25T09:10:26.153935+0000","last_peered":"2024-04-25T09:10:26.153935+0000","last_clean":"2024-04-25T09:10:26.153935+0000","last_became_active":"2024-04-25T09:10:23.985439+0000","last_became_peered":"2024-04-25T09:10:23.985439+0000","last_unstale":"2024-04-25T09:10:26.153935+0000","last_undegraded":"2024-04-25T09:10:26.153935+0000","last_fullsized":"2024-04-25T09:10:26.153935+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:34.204925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-04-25T09:10:23.976865+0000","last_change":"2024-04-25T09:10:23.976865+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.976865+0000","last_undegraded":"2024-04-25T09:10:23.976865+0000","last_fullsized":"2024-04-25T09:10:23.976865+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.971957+0000","last_change":"2024-04-25T09:10:22.971957+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.971957+0000","last_undegraded":"2024-04-25T09:10:22.971957+0000","last_fullsized":"2024-04-25T09:10:22.971957+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992790+0000","last_change":"2024-04-25T09:10:23.993992+0000","last_active":"2024-04-25T09:10:25.992790+0000","last_peered":"2024-04-25T09:10:25.992790+0000","last_clean":"2024-04-25T09:10:25.992790+0000","last_became_active":"2024-04-25T09:10:23.993527+0000","last_became_peered":"2024-04-25T09:10:23.993527+0000","last_unstale":"2024-04-25T09:10:25.992790+0000","last_undegraded":"2024-04-25T09:10:25.992790+0000","last_fullsized":"2024-04-25T09:10:25.992790+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:12.659252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992387+0000","last_change":"2024-04-25T09:10:23.993352+0000","last_active":"2024-04-25T09:10:25.992387+0000","last_peered":"2024-04-25T09:10:25.992387+0000","last_clean":"2024-04-25T09:10:25.992387+0000","last_became_active":"2024-04-25T09:10:23.993098+0000","last_became_peered":"2024-04-25T09:10:23.993098+0000","last_unstale":"2024-04-25T09:10:25.992387+0000","last_undegraded":"2024-04-25T09:10:25.992387+0000","last_fullsized":"2024-04-25T09:10:25.992387+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:48.781048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968321+0000","last_change":"2024-04-25T09:10:22.968321+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968321+0000","last_undegraded":"2024-04-25T09:10:22.968321+0000","last_fullsized":"2024-04-25T09:10:22.968321+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992978+0000","last_change":"2024-04-25T09:10:25.011971+0000","last_active":"2024-04-25T09:10:25.992978+0000","last_peered":"2024-04-25T09:10:25.992978+0000","last_clean":"2024-04-25T09:10:25.992978+0000","last_became_active":"2024-04-25T09:10:25.011686+0000","last_became_peered":"2024-04-25T09:10:25.011686+0000","last_unstale":"2024-04-25T09:10:25.992978+0000","last_undegraded":"2024-04-25T09:10:25.992978+0000","last_fullsized":"2024-04-25T09:10:25.992978+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:40.123611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992195+0000","last_change":"2024-04-25T09:10:23.997986+0000","last_active":"2024-04-25T09:10:25.992195+0000","last_peered":"2024-04-25T09:10:25.992195+0000","last_clean":"2024-04-25T09:10:25.992195+0000","last_became_active":"2024-04-25T09:10:23.997682+0000","last_became_peered":"2024-04-25T09:10:23.997682+0000","last_unstale":"2024-04-25T09:10:25.992195+0000","last_undegraded":"2024-04-25T09:10:25.992195+0000","last_fullsized":"2024-04-25T09:10:25.992195+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:45.716419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":3,"reported_epoch":107,"state":"creating+activating","last_fresh":"2024-04-25T09:10:23.975258+0000","last_change":"2024-04-25T09:10:23.975258+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.975258+0000","last_undegraded":"2024-04-25T09:10:23.975258+0000","last_fullsized":"2024-04-25T09:10:23.975258+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.972613+0000","last_change":"2024-04-25T09:10:22.972613+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.972613+0000","last_undegraded":"2024-04-25T09:10:22.972613+0000","last_fullsized":"2024-04-25T09:10:22.972613+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.968620+0000","last_change":"2024-04-25T09:10:22.968620+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.968620+0000","last_undegraded":"2024-04-25T09:10:22.968620+0000","last_fullsized":"2024-04-25T09:10:22.968620+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":3,"reported_epoch":107,"state":"creating+activating","last_fresh":"2024-04-25T09:10:23.975038+0000","last_change":"2024-04-25T09:10:23.975038+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.975038+0000","last_undegraded":"2024-04-25T09:10:23.975038+0000","last_fullsized":"2024-04-25T09:10:23.975038+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992710+0000","last_change":"2024-04-25T09:10:25.009607+0000","last_active":"2024-04-25T09:10:25.992710+0000","last_peered":"2024-04-25T09:10:25.992710+0000","last_clean":"2024-04-25T09:10:25.992710+0000","last_became_active":"2024-04-25T09:10:25.009341+0000","last_became_peered":"2024-04-25T09:10:25.009341+0000","last_unstale":"2024-04-25T09:10:25.992710+0000","last_undegraded":"2024-04-25T09:10:25.992710+0000","last_fullsized":"2024-04-25T09:10:25.992710+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:39.499479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.967933+0000","last_change":"2024-04-25T09:10:22.967933+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.967933+0000","last_undegraded":"2024-04-25T09:10:22.967933+0000","last_fullsized":"2024-04-25T09:10:22.967933+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992782+0000","last_change":"2024-04-25T09:10:25.007602+0000","last_active":"2024-04-25T09:10:25.992782+0000","last_peered":"2024-04-25T09:10:25.992782+0000","last_clean":"2024-04-25T09:10:25.992782+0000","last_became_active":"2024-04-25T09:10:25.007332+0000","last_became_peered":"2024-04-25T09:10:25.007332+0000","last_unstale":"2024-04-25T09:10:25.992782+0000","last_undegraded":"2024-04-25T09:10:25.992782+0000","last_fullsized":"2024-04-25T09:10:25.992782+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:43.658523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992525+0000","last_change":"2024-04-25T09:10:23.991862+0000","last_active":"2024-04-25T09:10:25.992525+0000","last_peered":"2024-04-25T09:10:25.992525+0000","last_clean":"2024-04-25T09:10:25.992525+0000","last_became_active":"2024-04-25T09:10:23.991596+0000","last_became_peered":"2024-04-25T09:10:23.991596+0000","last_unstale":"2024-04-25T09:10:25.992525+0000","last_undegraded":"2024-04-25T09:10:25.992525+0000","last_fullsized":"2024-04-25T09:10:25.992525+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:45.678832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.154004+0000","last_change":"2024-04-25T09:10:25.009496+0000","last_active":"2024-04-25T09:10:26.154004+0000","last_peered":"2024-04-25T09:10:26.154004+0000","last_clean":"2024-04-25T09:10:26.154004+0000","last_became_active":"2024-04-25T09:10:25.009219+0000","last_became_peered":"2024-04-25T09:10:25.009219+0000","last_unstale":"2024-04-25T09:10:26.154004+0000","last_undegraded":"2024-04-25T09:10:26.154004+0000","last_fullsized":"2024-04-25T09:10:26.154004+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:48.471105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T09:10:22.967759+0000","last_change":"2024-04-25T09:10:22.967759+0000","last_active":"2024-04-25T09:10:22.957866+0000","last_peered":"2024-04-25T09:10:22.957866+0000","last_clean":"2024-04-25T09:10:22.957866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:22.967759+0000","last_undegraded":"2024-04-25T09:10:22.967759+0000","last_fullsized":"2024-04-25T09:10:22.967759+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992285+0000","last_change":"2024-04-25T09:10:23.990620+0000","last_active":"2024-04-25T09:10:25.992285+0000","last_peered":"2024-04-25T09:10:25.992285+0000","last_clean":"2024-04-25T09:10:25.992285+0000","last_became_active":"2024-04-25T09:10:23.990318+0000","last_became_peered":"2024-04-25T09:10:23.990318+0000","last_unstale":"2024-04-25T09:10:25.992285+0000","last_undegraded":"2024-04-25T09:10:25.992285+0000","last_fullsized":"2024-04-25T09:10:25.992285+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:52.073575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:10:23.964712+0000","last_change":"2024-04-25T09:10:23.964712+0000","last_active":"2024-04-25T09:10:23.964712+0000","last_peered":"2024-04-25T09:10:23.964712+0000","last_clean":"2024-04-25T09:10:23.964712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:10:23.964712+0000","last_undegraded":"2024-04-25T09:10:23.964712+0000","last_fullsized":"2024-04-25T09:10:23.964712+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992908+0000","last_change":"2024-04-25T09:10:23.997830+0000","last_active":"2024-04-25T09:10:25.992908+0000","last_peered":"2024-04-25T09:10:25.992908+0000","last_clean":"2024-04-25T09:10:25.992908+0000","last_became_active":"2024-04-25T09:10:23.997524+0000","last_became_peered":"2024-04-25T09:10:23.997524+0000","last_unstale":"2024-04-25T09:10:25.992908+0000","last_undegraded":"2024-04-25T09:10:25.992908+0000","last_fullsized":"2024-04-25T09:10:25.992908+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:52.315270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":331,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153397+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:10:26.153397+0000","last_peered":"2024-04-25T09:10:26.153397+0000","last_clean":"2024-04-25T09:10:26.153397+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:10:26.153397+0000","last_undegraded":"2024-04-25T09:10:26.153397+0000","last_fullsized":"2024-04-25T09:10:26.153397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":44,"acting":44,"num_store_stats":3},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50504,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321336,"statfs":{"total":96636764160,"available":96585048064,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46344,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325496,"statfs":{"total":96636764160,"available":96589307904,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54668,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317172,"statfs":{"total":96636764160,"available":96580784128,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54664,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317176,"statfs":{"total":96636764160,"available":96580788224,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509537,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54708,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317132,"statfs":{"total":96636764160,"available":96580743168,"internally_reserved":0,"allocated":1347584,"data_stored":622994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509537,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50508,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321332,"statfs":{"total":96636764160,"available":96585043968,"internally_reserved":0,"allocated":1306624,"data_stored":602434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55244,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316596,"statfs":{"total":96636764160,"available":96580194304,"internally_reserved":0,"allocated":1900544,"data_stored":1192802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51128,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320712,"statfs":{"total":96636764160,"available":96584409088,"internally_reserved":0,"allocated":1945600,"data_stored":1213488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:10:33.577 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:10:33.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.739+0000 7fe2ff200640 1 Processor -- start 2024-04-25T09:10:33.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.739+0000 7fe2ff200640 1 -- start start 2024-04-25T09:10:33.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.739+0000 7fe2ff200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe300099a50 0x7fe300099ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:33.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.739+0000 7fe2ff200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30006c2e0 con 0x7fe3000b2ac0 2024-04-25T09:10:33.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.739+0000 7fe2ff200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3000b2ea0 con 0x7fe3000cbc20 2024-04-25T09:10:33.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.739+0000 7fe2ff200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3000d0b30 con 0x7fe300099a50 2024-04-25T09:10:33.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.739+0000 7fe2fde00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe3000b2ac0 0x7fe30009a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41898/0 (socket says 172.21.15.173:41898) 2024-04-25T09:10:33.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.739+0000 7fe2fde00640 1 -- 172.21.15.173:0/677817016 learned_addr learned my addr 172.21.15.173:0/677817016 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:33.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.739+0000 7fe2fd400640 1 --2- 172.21.15.173:0/677817016 >> v2:172.21.15.173:3300/0 conn(0x7fe300099a50 0x7fe300099ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:33.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.739+0000 7fe2fca00640 1 -- 172.21.15.173:0/677817016 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257703187 0 0) 0x7fe2f00014a0 con 0x7fe3000b2ac0 2024-04-25T09:10:33.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.739+0000 7fe2fca00640 1 -- 172.21.15.173:0/677817016 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2e4003530 con 0x7fe3000b2ac0 2024-04-25T09:10:33.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.739+0000 7fe2fd400640 1 -- 172.21.15.173:0/677817016 >> v1:172.21.15.194:6789/0 conn(0x7fe3000cbc20 legacy=0x7fe3000cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:33.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.739+0000 7fe2fd400640 1 -- 172.21.15.173:0/677817016 >> v1:172.21.15.173:6789/0 conn(0x7fe3000b2ac0 legacy=0x7fe30009a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:33.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.739+0000 7fe2fd400640 1 -- 172.21.15.173:0/677817016 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3000cfa90 con 0x7fe300099a50 2024-04-25T09:10:33.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.743+0000 7fe2fd400640 1 --2- 172.21.15.173:0/677817016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe300099a50 0x7fe300099ee0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0097c0 tx=0x7fe2ec01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9aec875fd58cf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:33.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.743+0000 7fe2fca00640 1 -- 172.21.15.173:0/677817016 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0b0070 con 0x7fe300099a50 2024-04-25T09:10:33.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.743+0000 7fe2fca00640 1 -- 172.21.15.173:0/677817016 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec0ab600 con 0x7fe300099a50 2024-04-25T09:10:33.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.743+0000 7fe2fca00640 1 -- 172.21.15.173:0/677817016 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0ab9b0 con 0x7fe300099a50 2024-04-25T09:10:33.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.743+0000 7fe2ff200640 1 -- 172.21.15.173:0/677817016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe300099a50 msgr2=0x7fe300099ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:33.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.743+0000 7fe2ff200640 1 --2- 172.21.15.173:0/677817016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe300099a50 0x7fe300099ee0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0097c0 tx=0x7fe2ec01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:10:33.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.743+0000 7fe2ff200640 1 -- 172.21.15.173:0/677817016 shutdown_connections 2024-04-25T09:10:33.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.743+0000 7fe2ff200640 1 --2- 172.21.15.173:0/677817016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe300099a50 0x7fe300099ee0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:33.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.743+0000 7fe2ff200640 1 -- 172.21.15.173:0/677817016 >> 172.21.15.173:0/677817016 conn(0x7fe3000b30c0 msgr2=0x7fe3000b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:33.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.743+0000 7fe2ff200640 1 -- 172.21.15.173:0/677817016 shutdown_connections 2024-04-25T09:10:33.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.743+0000 7fe2ff200640 1 -- 172.21.15.173:0/677817016 wait complete. 2024-04-25T09:10:33.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2ff200640 1 Processor -- start 2024-04-25T09:10:33.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2ff200640 1 -- start start 2024-04-25T09:10:33.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2ff200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe300099a50 0x7fe300154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:33.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2ff200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3000b2ac0 0x7fe30014f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:33.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2ff200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3000cbc20 0x7fe30014fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2ff200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3000cf740 con 0x7fe3000b2ac0 2024-04-25T09:10:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2ff200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30009ade0 con 0x7fe300099a50 2024-04-25T09:10:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2ff200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3000ccbb0 con 0x7fe3000cbc20 2024-04-25T09:10:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2fd400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3000b2ac0 0x7fe30014f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2fd400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3000b2ac0 0x7fe30014f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36904/0 (socket says 172.21.15.173:36904) 2024-04-25T09:10:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2fd400640 1 -- 172.21.15.173:0/542766503 learned_addr learned my addr 172.21.15.173:0/542766503 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2fde00640 1 --2- 172.21.15.173:0/542766503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe300099a50 0x7fe300154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2fe800640 1 --2- 172.21.15.173:0/542766503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3000cbc20 0x7fe30014fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2fd400640 1 -- 172.21.15.173:0/542766503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3000cbc20 msgr2=0x7fe30014fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2fd400640 1 --2- 172.21.15.173:0/542766503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3000cbc20 0x7fe30014fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2fd400640 1 -- 172.21.15.173:0/542766503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe300099a50 msgr2=0x7fe300154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2fd400640 1 --2- 172.21.15.173:0/542766503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe300099a50 0x7fe300154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2fd400640 1 -- 172.21.15.173:0/542766503 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe300159d60 con 0x7fe3000b2ac0 2024-04-25T09:10:33.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2fe800640 1 --2- 172.21.15.173:0/542766503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3000cbc20 0x7fe30014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:33.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2fd400640 1 --2- 172.21.15.173:0/542766503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3000b2ac0 0x7fe30014f830 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0ae040 tx=0x7fe2ec01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:33.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2f6000640 1 -- 172.21.15.173:0/542766503 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0bc070 con 0x7fe3000b2ac0 2024-04-25T09:10:33.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2f6000640 1 -- 172.21.15.173:0/542766503 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec0b1040 con 0x7fe3000b2ac0 2024-04-25T09:10:33.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2f6000640 1 -- 172.21.15.173:0/542766503 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0b0050 con 0x7fe3000b2ac0 2024-04-25T09:10:33.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2ff200640 1 -- 172.21.15.173:0/542766503 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30015a040 con 0x7fe3000b2ac0 2024-04-25T09:10:33.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2ff200640 1 -- 172.21.15.173:0/542766503 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3000c5630 con 0x7fe3000b2ac0 2024-04-25T09:10:33.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.747+0000 7fe2ff200640 1 -- 172.21.15.173:0/542766503 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3000685c0 con 0x7fe3000b2ac0 2024-04-25T09:10:33.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.751+0000 7fe2f6000640 1 -- 172.21.15.173:0/542766503 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe2ec004230 con 0x7fe3000b2ac0 2024-04-25T09:10:33.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.751+0000 7fe2f6000640 1 --2- 172.21.15.173:0/542766503 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe2e0066f60 0x7fe2e0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:33.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.751+0000 7fe2f6000640 1 -- 172.21.15.173:0/542766503 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fe2ec11eb30 con 0x7fe3000b2ac0 2024-04-25T09:10:33.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.751+0000 7fe2fde00640 1 --2- 172.21.15.173:0/542766503 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe2e0066f60 0x7fe2e0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:33.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.751+0000 7fe2fde00640 1 --2- 172.21.15.173:0/542766503 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe2e0066f60 0x7fe2e0069420 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0001640 tx=0x7fe2f0001ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:33.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.755+0000 7fe2f6000640 1 -- 172.21.15.173:0/542766503 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe2ec016090 con 0x7fe3000b2ac0 2024-04-25T09:10:33.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.907+0000 7fe2ff200640 1 -- 172.21.15.173:0/542766503 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe300073a40 con 0x7fe2e0066f60 2024-04-25T09:10:33.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.911+0000 7fe2f6000640 1 -- 172.21.15.173:0/542766503 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252474 (secure 0 0 0) 0x7fe300073a40 con 0x7fe2e0066f60 2024-04-25T09:10:33.904 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:33.905 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:10:33.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.915+0000 7fe2ff200640 1 -- 172.21.15.173:0/542766503 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe2e0066f60 msgr2=0x7fe2e0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:33.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.915+0000 7fe2ff200640 1 --2- 172.21.15.173:0/542766503 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe2e0066f60 0x7fe2e0069420 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0001640 tx=0x7fe2f0001ab0 comp rx=0 tx=0).stop 2024-04-25T09:10:33.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.915+0000 7fe2ff200640 1 -- 172.21.15.173:0/542766503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3000b2ac0 msgr2=0x7fe30014f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:33.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.915+0000 7fe2ff200640 1 --2- 172.21.15.173:0/542766503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3000b2ac0 0x7fe30014f830 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0ae040 tx=0x7fe2ec01ace0 comp rx=0 tx=0).stop 2024-04-25T09:10:33.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.915+0000 7fe2ff200640 1 -- 172.21.15.173:0/542766503 shutdown_connections 2024-04-25T09:10:33.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.915+0000 7fe2ff200640 1 --2- 172.21.15.173:0/542766503 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe2e0066f60 0x7fe2e0069420 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:33.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.915+0000 7fe2ff200640 1 --2- 172.21.15.173:0/542766503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3000cbc20 0x7fe30014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:33.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.915+0000 7fe2ff200640 1 --2- 172.21.15.173:0/542766503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3000b2ac0 0x7fe30014f830 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:33.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.915+0000 7fe2ff200640 1 --2- 172.21.15.173:0/542766503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe300099a50 0x7fe300154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:33.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.915+0000 7fe2ff200640 1 -- 172.21.15.173:0/542766503 >> 172.21.15.173:0/542766503 conn(0x7fe3000b30c0 msgr2=0x7fe3000cab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:33.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.915+0000 7fe2ff200640 1 -- 172.21.15.173:0/542766503 shutdown_connections 2024-04-25T09:10:33.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:33.915+0000 7fe2ff200640 1 -- 172.21.15.173:0/542766503 wait complete. 2024-04-25T09:10:33.924 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-04-25T09:10:33.498056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":422220,"kb_used_data":11720,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754552500,"statfs":{"total":773094113280,"available":772661760000,"internally_reserved":0,"allocated":12001280,"data_stored":6169236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.511291"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.018229+0000","last_change":"2024-04-25T09:10:25.004954+0000","last_active":"2024-04-25T09:10:26.018229+0000","last_peered":"2024-04-25T09:10:26.018229+0000","last_clean":"2024-04-25T09:10:26.018229+0000","last_became_active":"2024-04-25T09:10:25.002548+0000","last_became_peered":"2024-04-25T09:10:25.002548+0000","last_unstale":"2024-04-25T09:10:26.018229+0000","last_undegraded":"2024-04-25T09:10:26.018229+0000","last_fullsized":"2024-04-25T09:10:26.018229+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:51.956649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.154512+0000","last_change":"2024-04-25T09:10:25.007676+0000","last_active":"2024-04-25T09:10:26.154512+0000","last_peered":"2024-04-25T09:10:26.154512+0000","last_clean":"2024-04-25T09:10:26.154512+0000","last_became_active":"2024-04-25T09:10:25.007408+0000","last_became_peered":"2024-04-25T09:10:25.007408+0000","last_unstale":"2024-04-25T09:10:26.154512+0000","last_undegraded":"2024-04-25T09:10:26.154512+0000","last_fullsized":"2024-04-25T09:10:26.154512+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:49:09.635947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.017974+0000","last_change":"2024-04-25T09:10:25.005071+0000","last_active":"2024-04-25T09:10:26.017974+0000","last_peered":"2024-04-25T09:10:26.017974+0000","last_clean":"2024-04-25T09:10:26.017974+0000","last_became_active":"2024-04-25T09:10:25.004827+0000","last_became_peered":"2024-04-25T09:10:25.004827+0000","last_unstale":"2024-04-25T09:10:26.017974+0000","last_undegraded":"2024-04-25T09:10:26.017974+0000","last_fullsized":"2024-04-25T09:10:26.017974+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:24.973898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993665+0000","last_change":"2024-04-25T09:10:24.994347+0000","last_active":"2024-04-25T09:10:25.993665+0000","last_peered":"2024-04-25T09:10:25.993665+0000","last_clean":"2024-04-25T09:10:25.993665+0000","last_became_active":"2024-04-25T09:10:24.993802+0000","last_became_peered":"2024-04-25T09:10:24.993802+0000","last_unstale":"2024-04-25T09:10:25.993665+0000","last_undegraded":"2024-04-25T09:10:25.993665+0000","last_fullsized":"2024-04-25T09:10:25.993665+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:07.504059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153379+0000","last_change":"2024-04-25T09:10:25.016032+0000","last_active":"2024-04-25T09:10:26.153379+0000","last_peered":"2024-04-25T09:10:26.153379+0000","last_clean":"2024-04-25T09:10:26.153379+0000","last_became_active":"2024-04-25T09:10:25.015687+0000","last_became_peered":"2024-04-25T09:10:25.015687+0000","last_unstale":"2024-04-25T09:10:26.153379+0000","last_undegraded":"2024-04-25T09:10:26.153379+0000","last_fullsized":"2024-04-25T09:10:26.153379+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:14.350254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153702+0000","last_change":"2024-04-25T09:10:25.008241+0000","last_active":"2024-04-25T09:10:26.153702+0000","last_peered":"2024-04-25T09:10:26.153702+0000","last_clean":"2024-04-25T09:10:26.153702+0000","last_became_active":"2024-04-25T09:10:25.007989+0000","last_became_peered":"2024-04-25T09:10:25.007989+0000","last_unstale":"2024-04-25T09:10:26.153702+0000","last_undegraded":"2024-04-25T09:10:26.153702+0000","last_fullsized":"2024-04-25T09:10:26.153702+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:06.261900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153372+0000","last_change":"2024-04-25T09:10:25.003961+0000","last_active":"2024-04-25T09:10:26.153372+0000","last_peered":"2024-04-25T09:10:26.153372+0000","last_clean":"2024-04-25T09:10:26.153372+0000","last_became_active":"2024-04-25T09:10:25.003571+0000","last_became_peered":"2024-04-25T09:10:25.003571+0000","last_unstale":"2024-04-25T09:10:26.153372+0000","last_undegraded":"2024-04-25T09:10:26.153372+0000","last_fullsized":"2024-04-25T09:10:26.153372+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:36.444841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992093+0000","last_change":"2024-04-25T09:10:25.004287+0000","last_active":"2024-04-25T09:10:25.992093+0000","last_peered":"2024-04-25T09:10:25.992093+0000","last_clean":"2024-04-25T09:10:25.992093+0000","last_became_active":"2024-04-25T09:10:25.002537+0000","last_became_peered":"2024-04-25T09:10:25.002537+0000","last_unstale":"2024-04-25T09:10:25.992093+0000","last_undegraded":"2024-04-25T09:10:25.992093+0000","last_fullsized":"2024-04-25T09:10:25.992093+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:25.248880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.154268+0000","last_change":"2024-04-25T09:10:25.003982+0000","last_active":"2024-04-25T09:10:26.154268+0000","last_peered":"2024-04-25T09:10:26.154268+0000","last_clean":"2024-04-25T09:10:26.154268+0000","last_became_active":"2024-04-25T09:10:25.003631+0000","last_became_peered":"2024-04-25T09:10:25.003631+0000","last_unstale":"2024-04-25T09:10:26.154268+0000","last_undegraded":"2024-04-25T09:10:26.154268+0000","last_fullsized":"2024-04-25T09:10:26.154268+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:23.839695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153703+0000","last_change":"2024-04-25T09:10:25.011247+0000","last_active":"2024-04-25T09:10:26.153703+0000","last_peered":"2024-04-25T09:10:26.153703+0000","last_clean":"2024-04-25T09:10:26.153703+0000","last_became_active":"2024-04-25T09:10:25.010759+0000","last_became_peered":"2024-04-25T09:10:25.010759+0000","last_unstale":"2024-04-25T09:10:26.153703+0000","last_undegraded":"2024-04-25T09:10:26.153703+0000","last_fullsized":"2024-04-25T09:10:26.153703+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:18.110600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.020204+0000","last_change":"2024-04-25T09:10:25.012950+0000","last_active":"2024-04-25T09:10:26.020204+0000","last_peered":"2024-04-25T09:10:26.020204+0000","last_clean":"2024-04-25T09:10:26.020204+0000","last_became_active":"2024-04-25T09:10:25.011323+0000","last_became_peered":"2024-04-25T09:10:25.011323+0000","last_unstale":"2024-04-25T09:10:26.020204+0000","last_undegraded":"2024-04-25T09:10:26.020204+0000","last_fullsized":"2024-04-25T09:10:26.020204+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:28.472658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992574+0000","last_change":"2024-04-25T09:10:24.994998+0000","last_active":"2024-04-25T09:10:25.992574+0000","last_peered":"2024-04-25T09:10:25.992574+0000","last_clean":"2024-04-25T09:10:25.992574+0000","last_became_active":"2024-04-25T09:10:24.994480+0000","last_became_peered":"2024-04-25T09:10:24.994480+0000","last_unstale":"2024-04-25T09:10:25.992574+0000","last_undegraded":"2024-04-25T09:10:25.992574+0000","last_fullsized":"2024-04-25T09:10:25.992574+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:11.902086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993503+0000","last_change":"2024-04-25T09:10:25.010118+0000","last_active":"2024-04-25T09:10:25.993503+0000","last_peered":"2024-04-25T09:10:25.993503+0000","last_clean":"2024-04-25T09:10:25.993503+0000","last_became_active":"2024-04-25T09:10:25.009839+0000","last_became_peered":"2024-04-25T09:10:25.009839+0000","last_unstale":"2024-04-25T09:10:25.993503+0000","last_undegraded":"2024-04-25T09:10:25.993503+0000","last_fullsized":"2024-04-25T09:10:25.993503+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:51:15.691923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153900+0000","last_change":"2024-04-25T09:10:25.005698+0000","last_active":"2024-04-25T09:10:26.153900+0000","last_peered":"2024-04-25T09:10:26.153900+0000","last_clean":"2024-04-25T09:10:26.153900+0000","last_became_active":"2024-04-25T09:10:25.005083+0000","last_became_peered":"2024-04-25T09:10:25.005083+0000","last_unstale":"2024-04-25T09:10:26.153900+0000","last_undegraded":"2024-04-25T09:10:26.153900+0000","last_fullsized":"2024-04-25T09:10:26.153900+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:37.012652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153563+0000","last_change":"2024-04-25T09:10:25.010387+0000","last_active":"2024-04-25T09:10:26.153563+0000","last_peered":"2024-04-25T09:10:26.153563+0000","last_clean":"2024-04-25T09:10:26.153563+0000","last_became_active":"2024-04-25T09:10:25.008940+0000","last_became_peered":"2024-04-25T09:10:25.008940+0000","last_unstale":"2024-04-25T09:10:26.153563+0000","last_undegraded":"2024-04-25T09:10:26.153563+0000","last_fullsized":"2024-04-25T09:10:26.153563+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:40.367585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153361+0000","last_change":"2024-04-25T09:10:25.005571+0000","last_active":"2024-04-25T09:10:26.153361+0000","last_peered":"2024-04-25T09:10:26.153361+0000","last_clean":"2024-04-25T09:10:26.153361+0000","last_became_active":"2024-04-25T09:10:25.005263+0000","last_became_peered":"2024-04-25T09:10:25.005263+0000","last_unstale":"2024-04-25T09:10:26.153361+0000","last_undegraded":"2024-04-25T09:10:26.153361+0000","last_fullsized":"2024-04-25T09:10:26.153361+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:07.504059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.018032+0000","last_change":"2024-04-25T09:10:25.009952+0000","last_active":"2024-04-25T09:10:26.018032+0000","last_peered":"2024-04-25T09:10:26.018032+0000","last_clean":"2024-04-25T09:10:26.018032+0000","last_became_active":"2024-04-25T09:10:25.009691+0000","last_became_peered":"2024-04-25T09:10:25.009691+0000","last_unstale":"2024-04-25T09:10:26.018032+0000","last_undegraded":"2024-04-25T09:10:26.018032+0000","last_fullsized":"2024-04-25T09:10:26.018032+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:15.814766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.154557+0000","last_change":"2024-04-25T09:10:25.015180+0000","last_active":"2024-04-25T09:10:26.154557+0000","last_peered":"2024-04-25T09:10:26.154557+0000","last_clean":"2024-04-25T09:10:26.154557+0000","last_became_active":"2024-04-25T09:10:25.014880+0000","last_became_peered":"2024-04-25T09:10:25.014880+0000","last_unstale":"2024-04-25T09:10:26.154557+0000","last_undegraded":"2024-04-25T09:10:26.154557+0000","last_fullsized":"2024-04-25T09:10:26.154557+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:47.943185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.018035+0000","last_change":"2024-04-25T09:10:25.014385+0000","last_active":"2024-04-25T09:10:26.018035+0000","last_peered":"2024-04-25T09:10:26.018035+0000","last_clean":"2024-04-25T09:10:26.018035+0000","last_became_active":"2024-04-25T09:10:25.012564+0000","last_became_peered":"2024-04-25T09:10:25.012564+0000","last_unstale":"2024-04-25T09:10:26.018035+0000","last_undegraded":"2024-04-25T09:10:26.018035+0000","last_fullsized":"2024-04-25T09:10:26.018035+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:40.524969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992583+0000","last_change":"2024-04-25T09:10:25.006604+0000","last_active":"2024-04-25T09:10:25.992583+0000","last_peered":"2024-04-25T09:10:25.992583+0000","last_clean":"2024-04-25T09:10:25.992583+0000","last_became_active":"2024-04-25T09:10:25.004070+0000","last_became_peered":"2024-04-25T09:10:25.004070+0000","last_unstale":"2024-04-25T09:10:25.992583+0000","last_undegraded":"2024-04-25T09:10:25.992583+0000","last_fullsized":"2024-04-25T09:10:25.992583+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:12.402325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992691+0000","last_change":"2024-04-25T09:10:25.003489+0000","last_active":"2024-04-25T09:10:25.992691+0000","last_peered":"2024-04-25T09:10:25.992691+0000","last_clean":"2024-04-25T09:10:25.992691+0000","last_became_active":"2024-04-25T09:10:25.003239+0000","last_became_peered":"2024-04-25T09:10:25.003239+0000","last_unstale":"2024-04-25T09:10:25.992691+0000","last_undegraded":"2024-04-25T09:10:25.992691+0000","last_fullsized":"2024-04-25T09:10:25.992691+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:27.352442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153311+0000","last_change":"2024-04-25T09:10:25.008383+0000","last_active":"2024-04-25T09:10:26.153311+0000","last_peered":"2024-04-25T09:10:26.153311+0000","last_clean":"2024-04-25T09:10:26.153311+0000","last_became_active":"2024-04-25T09:10:25.008130+0000","last_became_peered":"2024-04-25T09:10:25.008130+0000","last_unstale":"2024-04-25T09:10:26.153311+0000","last_undegraded":"2024-04-25T09:10:26.153311+0000","last_fullsized":"2024-04-25T09:10:26.153311+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:37.879146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.017732+0000","last_change":"2024-04-25T09:10:25.004127+0000","last_active":"2024-04-25T09:10:26.017732+0000","last_peered":"2024-04-25T09:10:26.017732+0000","last_clean":"2024-04-25T09:10:26.017732+0000","last_became_active":"2024-04-25T09:10:25.003806+0000","last_became_peered":"2024-04-25T09:10:25.003806+0000","last_unstale":"2024-04-25T09:10:26.017732+0000","last_undegraded":"2024-04-25T09:10:26.017732+0000","last_fullsized":"2024-04-25T09:10:26.017732+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:29.277909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153236+0000","last_change":"2024-04-25T09:10:25.004301+0000","last_active":"2024-04-25T09:10:26.153236+0000","last_peered":"2024-04-25T09:10:26.153236+0000","last_clean":"2024-04-25T09:10:26.153236+0000","last_became_active":"2024-04-25T09:10:25.003879+0000","last_became_peered":"2024-04-25T09:10:25.003879+0000","last_unstale":"2024-04-25T09:10:26.153236+0000","last_undegraded":"2024-04-25T09:10:26.153236+0000","last_fullsized":"2024-04-25T09:10:26.153236+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:13.066106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992716+0000","last_change":"2024-04-25T09:10:25.008518+0000","last_active":"2024-04-25T09:10:25.992716+0000","last_peered":"2024-04-25T09:10:25.992716+0000","last_clean":"2024-04-25T09:10:25.992716+0000","last_became_active":"2024-04-25T09:10:25.008222+0000","last_became_peered":"2024-04-25T09:10:25.008222+0000","last_unstale":"2024-04-25T09:10:25.992716+0000","last_undegraded":"2024-04-25T09:10:25.992716+0000","last_fullsized":"2024-04-25T09:10:25.992716+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:28.472658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992682+0000","last_change":"2024-04-25T09:10:25.002305+0000","last_active":"2024-04-25T09:10:25.992682+0000","last_peered":"2024-04-25T09:10:25.992682+0000","last_clean":"2024-04-25T09:10:25.992682+0000","last_became_active":"2024-04-25T09:10:25.002006+0000","last_became_peered":"2024-04-25T09:10:25.002006+0000","last_unstale":"2024-04-25T09:10:25.992682+0000","last_undegraded":"2024-04-25T09:10:25.992682+0000","last_fullsized":"2024-04-25T09:10:25.992682+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:47.075229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.020295+0000","last_change":"2024-04-25T09:10:25.008000+0000","last_active":"2024-04-25T09:10:26.020295+0000","last_peered":"2024-04-25T09:10:26.020295+0000","last_clean":"2024-04-25T09:10:26.020295+0000","last_became_active":"2024-04-25T09:10:25.007488+0000","last_became_peered":"2024-04-25T09:10:25.007488+0000","last_unstale":"2024-04-25T09:10:26.020295+0000","last_undegraded":"2024-04-25T09:10:26.020295+0000","last_fullsized":"2024-04-25T09:10:26.020295+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:58.842316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.154188+0000","last_change":"2024-04-25T09:10:25.000803+0000","last_active":"2024-04-25T09:10:26.154188+0000","last_peered":"2024-04-25T09:10:26.154188+0000","last_clean":"2024-04-25T09:10:26.154188+0000","last_became_active":"2024-04-25T09:10:25.000423+0000","last_became_peered":"2024-04-25T09:10:25.000423+0000","last_unstale":"2024-04-25T09:10:26.154188+0000","last_undegraded":"2024-04-25T09:10:26.154188+0000","last_fullsized":"2024-04-25T09:10:26.154188+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:41.501246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992737+0000","last_change":"2024-04-25T09:10:25.009613+0000","last_active":"2024-04-25T09:10:25.992737+0000","last_peered":"2024-04-25T09:10:25.992737+0000","last_clean":"2024-04-25T09:10:25.992737+0000","last_became_active":"2024-04-25T09:10:25.009123+0000","last_became_peered":"2024-04-25T09:10:25.009123+0000","last_unstale":"2024-04-25T09:10:25.992737+0000","last_undegraded":"2024-04-25T09:10:25.992737+0000","last_fullsized":"2024-04-25T09:10:25.992737+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:25.292786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992049+0000","last_change":"2024-04-25T09:10:25.007066+0000","last_active":"2024-04-25T09:10:25.992049+0000","last_peered":"2024-04-25T09:10:25.992049+0000","last_clean":"2024-04-25T09:10:25.992049+0000","last_became_active":"2024-04-25T09:10:25.001794+0000","last_became_peered":"2024-04-25T09:10:25.001794+0000","last_unstale":"2024-04-25T09:10:25.992049+0000","last_undegraded":"2024-04-25T09:10:25.992049+0000","last_fullsized":"2024-04-25T09:10:25.992049+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:41.935284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153398+0000","last_change":"2024-04-25T09:10:25.004263+0000","last_active":"2024-04-25T09:10:26.153398+0000","last_peered":"2024-04-25T09:10:26.153398+0000","last_clean":"2024-04-25T09:10:26.153398+0000","last_became_active":"2024-04-25T09:10:25.001283+0000","last_became_peered":"2024-04-25T09:10:25.001283+0000","last_unstale":"2024-04-25T09:10:26.153398+0000","last_undegraded":"2024-04-25T09:10:26.153398+0000","last_fullsized":"2024-04-25T09:10:26.153398+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:17.256311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992145+0000","last_change":"2024-04-25T09:10:24.998492+0000","last_active":"2024-04-25T09:10:25.992145+0000","last_peered":"2024-04-25T09:10:25.992145+0000","last_clean":"2024-04-25T09:10:25.992145+0000","last_became_active":"2024-04-25T09:10:24.998110+0000","last_became_peered":"2024-04-25T09:10:24.998110+0000","last_unstale":"2024-04-25T09:10:25.992145+0000","last_undegraded":"2024-04-25T09:10:25.992145+0000","last_fullsized":"2024-04-25T09:10:25.992145+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:43.209701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.018259+0000","last_change":"2024-04-25T09:10:25.010725+0000","last_active":"2024-04-25T09:10:26.018259+0000","last_peered":"2024-04-25T09:10:26.018259+0000","last_clean":"2024-04-25T09:10:26.018259+0000","last_became_active":"2024-04-25T09:10:25.010466+0000","last_became_peered":"2024-04-25T09:10:25.010466+0000","last_unstale":"2024-04-25T09:10:26.018259+0000","last_undegraded":"2024-04-25T09:10:26.018259+0000","last_fullsized":"2024-04-25T09:10:26.018259+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:52.360008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"108'4","reported_seq":18,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993734+0000","last_change":"2024-04-25T09:10:23.992103+0000","last_active":"2024-04-25T09:10:25.993734+0000","last_peered":"2024-04-25T09:10:25.993734+0000","last_clean":"2024-04-25T09:10:25.993734+0000","last_became_active":"2024-04-25T09:10:23.990789+0000","last_became_peered":"2024-04-25T09:10:23.990789+0000","last_unstale":"2024-04-25T09:10:25.993734+0000","last_undegraded":"2024-04-25T09:10:25.993734+0000","last_fullsized":"2024-04-25T09:10:25.993734+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:43.916628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992257+0000","last_change":"2024-04-25T09:10:25.001829+0000","last_active":"2024-04-25T09:10:25.992257+0000","last_peered":"2024-04-25T09:10:25.992257+0000","last_clean":"2024-04-25T09:10:25.992257+0000","last_became_active":"2024-04-25T09:10:25.001529+0000","last_became_peered":"2024-04-25T09:10:25.001529+0000","last_unstale":"2024-04-25T09:10:25.992257+0000","last_undegraded":"2024-04-25T09:10:25.992257+0000","last_fullsized":"2024-04-25T09:10:25.992257+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:27.725078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993011+0000","last_change":"2024-04-25T09:10:23.997442+0000","last_active":"2024-04-25T09:10:25.993011+0000","last_peered":"2024-04-25T09:10:25.993011+0000","last_clean":"2024-04-25T09:10:25.993011+0000","last_became_active":"2024-04-25T09:10:23.994906+0000","last_became_peered":"2024-04-25T09:10:23.994906+0000","last_unstale":"2024-04-25T09:10:25.993011+0000","last_undegraded":"2024-04-25T09:10:25.993011+0000","last_fullsized":"2024-04-25T09:10:25.993011+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:08.860155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992176+0000","last_change":"2024-04-25T09:10:25.008032+0000","last_active":"2024-04-25T09:10:25.992176+0000","last_peered":"2024-04-25T09:10:25.992176+0000","last_clean":"2024-04-25T09:10:25.992176+0000","last_became_active":"2024-04-25T09:10:25.007702+0000","last_became_peered":"2024-04-25T09:10:25.007702+0000","last_unstale":"2024-04-25T09:10:25.992176+0000","last_undegraded":"2024-04-25T09:10:25.992176+0000","last_fullsized":"2024-04-25T09:10:25.992176+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:39.445928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992407+0000","last_change":"2024-04-25T09:10:23.983689+0000","last_active":"2024-04-25T09:10:25.992407+0000","last_peered":"2024-04-25T09:10:25.992407+0000","last_clean":"2024-04-25T09:10:25.992407+0000","last_became_active":"2024-04-25T09:10:23.983232+0000","last_became_peered":"2024-04-25T09:10:23.983232+0000","last_unstale":"2024-04-25T09:10:25.992407+0000","last_undegraded":"2024-04-25T09:10:25.992407+0000","last_fullsized":"2024-04-25T09:10:25.992407+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:32.500442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.020054+0000","last_change":"2024-04-25T09:10:25.010076+0000","last_active":"2024-04-25T09:10:26.020054+0000","last_peered":"2024-04-25T09:10:26.020054+0000","last_clean":"2024-04-25T09:10:26.020054+0000","last_became_active":"2024-04-25T09:10:25.007226+0000","last_became_peered":"2024-04-25T09:10:25.007226+0000","last_unstale":"2024-04-25T09:10:26.020054+0000","last_undegraded":"2024-04-25T09:10:26.020054+0000","last_fullsized":"2024-04-25T09:10:26.020054+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:11.902086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153486+0000","last_change":"2024-04-25T09:10:23.989412+0000","last_active":"2024-04-25T09:10:26.153486+0000","last_peered":"2024-04-25T09:10:26.153486+0000","last_clean":"2024-04-25T09:10:26.153486+0000","last_became_active":"2024-04-25T09:10:23.988874+0000","last_became_peered":"2024-04-25T09:10:23.988874+0000","last_unstale":"2024-04-25T09:10:26.153486+0000","last_undegraded":"2024-04-25T09:10:26.153486+0000","last_fullsized":"2024-04-25T09:10:26.153486+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:26.465436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993879+0000","last_change":"2024-04-25T09:10:25.009952+0000","last_active":"2024-04-25T09:10:25.993879+0000","last_peered":"2024-04-25T09:10:25.993879+0000","last_clean":"2024-04-25T09:10:25.993879+0000","last_became_active":"2024-04-25T09:10:25.009647+0000","last_became_peered":"2024-04-25T09:10:25.009647+0000","last_unstale":"2024-04-25T09:10:25.993879+0000","last_undegraded":"2024-04-25T09:10:25.993879+0000","last_fullsized":"2024-04-25T09:10:25.993879+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:43.875136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153708+0000","last_change":"2024-04-25T09:10:23.988905+0000","last_active":"2024-04-25T09:10:26.153708+0000","last_peered":"2024-04-25T09:10:26.153708+0000","last_clean":"2024-04-25T09:10:26.153708+0000","last_became_active":"2024-04-25T09:10:23.988625+0000","last_became_peered":"2024-04-25T09:10:23.988625+0000","last_unstale":"2024-04-25T09:10:26.153708+0000","last_undegraded":"2024-04-25T09:10:26.153708+0000","last_fullsized":"2024-04-25T09:10:26.153708+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:48.797438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.018214+0000","last_change":"2024-04-25T09:10:25.006647+0000","last_active":"2024-04-25T09:10:26.018214+0000","last_peered":"2024-04-25T09:10:26.018214+0000","last_clean":"2024-04-25T09:10:26.018214+0000","last_became_active":"2024-04-25T09:10:25.006314+0000","last_became_peered":"2024-04-25T09:10:25.006314+0000","last_unstale":"2024-04-25T09:10:26.018214+0000","last_undegraded":"2024-04-25T09:10:26.018214+0000","last_fullsized":"2024-04-25T09:10:26.018214+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:45.640063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.019840+0000","last_change":"2024-04-25T09:10:23.988031+0000","last_active":"2024-04-25T09:10:26.019840+0000","last_peered":"2024-04-25T09:10:26.019840+0000","last_clean":"2024-04-25T09:10:26.019840+0000","last_became_active":"2024-04-25T09:10:23.987757+0000","last_became_peered":"2024-04-25T09:10:23.987757+0000","last_unstale":"2024-04-25T09:10:26.019840+0000","last_undegraded":"2024-04-25T09:10:26.019840+0000","last_fullsized":"2024-04-25T09:10:26.019840+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:55.834840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.154605+0000","last_change":"2024-04-25T09:10:25.007217+0000","last_active":"2024-04-25T09:10:26.154605+0000","last_peered":"2024-04-25T09:10:26.154605+0000","last_clean":"2024-04-25T09:10:26.154605+0000","last_became_active":"2024-04-25T09:10:25.006913+0000","last_became_peered":"2024-04-25T09:10:25.006913+0000","last_unstale":"2024-04-25T09:10:26.154605+0000","last_undegraded":"2024-04-25T09:10:26.154605+0000","last_fullsized":"2024-04-25T09:10:26.154605+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:15.963996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.991825+0000","last_change":"2024-04-25T09:10:23.991172+0000","last_active":"2024-04-25T09:10:25.991825+0000","last_peered":"2024-04-25T09:10:25.991825+0000","last_clean":"2024-04-25T09:10:25.991825+0000","last_became_active":"2024-04-25T09:10:23.990901+0000","last_became_peered":"2024-04-25T09:10:23.990901+0000","last_unstale":"2024-04-25T09:10:25.991825+0000","last_undegraded":"2024-04-25T09:10:25.991825+0000","last_fullsized":"2024-04-25T09:10:25.991825+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:19.105609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993785+0000","last_change":"2024-04-25T09:10:24.998033+0000","last_active":"2024-04-25T09:10:25.993785+0000","last_peered":"2024-04-25T09:10:25.993785+0000","last_clean":"2024-04-25T09:10:25.993785+0000","last_became_active":"2024-04-25T09:10:24.997704+0000","last_became_peered":"2024-04-25T09:10:24.997704+0000","last_unstale":"2024-04-25T09:10:25.993785+0000","last_undegraded":"2024-04-25T09:10:25.993785+0000","last_fullsized":"2024-04-25T09:10:25.993785+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:37.012652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993317+0000","last_change":"2024-04-25T09:10:23.996406+0000","last_active":"2024-04-25T09:10:25.993317+0000","last_peered":"2024-04-25T09:10:25.993317+0000","last_clean":"2024-04-25T09:10:25.993317+0000","last_became_active":"2024-04-25T09:10:23.995206+0000","last_became_peered":"2024-04-25T09:10:23.995206+0000","last_unstale":"2024-04-25T09:10:25.993317+0000","last_undegraded":"2024-04-25T09:10:25.993317+0000","last_fullsized":"2024-04-25T09:10:25.993317+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:48.065103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.017668+0000","last_change":"2024-04-25T09:10:25.015527+0000","last_active":"2024-04-25T09:10:26.017668+0000","last_peered":"2024-04-25T09:10:26.017668+0000","last_clean":"2024-04-25T09:10:26.017668+0000","last_became_active":"2024-04-25T09:10:25.012834+0000","last_became_peered":"2024-04-25T09:10:25.012834+0000","last_unstale":"2024-04-25T09:10:26.017668+0000","last_undegraded":"2024-04-25T09:10:26.017668+0000","last_fullsized":"2024-04-25T09:10:26.017668+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:59.134345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992652+0000","last_change":"2024-04-25T09:10:23.991449+0000","last_active":"2024-04-25T09:10:25.992652+0000","last_peered":"2024-04-25T09:10:25.992652+0000","last_clean":"2024-04-25T09:10:25.992652+0000","last_became_active":"2024-04-25T09:10:23.991142+0000","last_became_peered":"2024-04-25T09:10:23.991142+0000","last_unstale":"2024-04-25T09:10:25.992652+0000","last_undegraded":"2024-04-25T09:10:25.992652+0000","last_fullsized":"2024-04-25T09:10:25.992652+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:33.664603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153308+0000","last_change":"2024-04-25T09:10:25.004891+0000","last_active":"2024-04-25T09:10:26.153308+0000","last_peered":"2024-04-25T09:10:26.153308+0000","last_clean":"2024-04-25T09:10:26.153308+0000","last_became_active":"2024-04-25T09:10:25.004623+0000","last_became_peered":"2024-04-25T09:10:25.004623+0000","last_unstale":"2024-04-25T09:10:26.153308+0000","last_undegraded":"2024-04-25T09:10:26.153308+0000","last_fullsized":"2024-04-25T09:10:26.153308+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:52.660657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.018194+0000","last_change":"2024-04-25T09:10:23.979652+0000","last_active":"2024-04-25T09:10:26.018194+0000","last_peered":"2024-04-25T09:10:26.018194+0000","last_clean":"2024-04-25T09:10:26.018194+0000","last_became_active":"2024-04-25T09:10:23.978727+0000","last_became_peered":"2024-04-25T09:10:23.978727+0000","last_unstale":"2024-04-25T09:10:26.018194+0000","last_undegraded":"2024-04-25T09:10:26.018194+0000","last_fullsized":"2024-04-25T09:10:26.018194+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:42.868289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992521+0000","last_change":"2024-04-25T09:10:25.009042+0000","last_active":"2024-04-25T09:10:25.992521+0000","last_peered":"2024-04-25T09:10:25.992521+0000","last_clean":"2024-04-25T09:10:25.992521+0000","last_became_active":"2024-04-25T09:10:25.008796+0000","last_became_peered":"2024-04-25T09:10:25.008796+0000","last_unstale":"2024-04-25T09:10:25.992521+0000","last_undegraded":"2024-04-25T09:10:25.992521+0000","last_fullsized":"2024-04-25T09:10:25.992521+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:14.584473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"108'3","reported_seq":17,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153816+0000","last_change":"2024-04-25T09:10:23.987279+0000","last_active":"2024-04-25T09:10:26.153816+0000","last_peered":"2024-04-25T09:10:26.153816+0000","last_clean":"2024-04-25T09:10:26.153816+0000","last_became_active":"2024-04-25T09:10:23.986988+0000","last_became_peered":"2024-04-25T09:10:23.986988+0000","last_unstale":"2024-04-25T09:10:26.153816+0000","last_undegraded":"2024-04-25T09:10:26.153816+0000","last_fullsized":"2024-04-25T09:10:26.153816+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:08.184843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153548+0000","last_change":"2024-04-25T09:10:25.007054+0000","last_active":"2024-04-25T09:10:26.153548+0000","last_peered":"2024-04-25T09:10:26.153548+0000","last_clean":"2024-04-25T09:10:26.153548+0000","last_became_active":"2024-04-25T09:10:25.006781+0000","last_became_peered":"2024-04-25T09:10:25.006781+0000","last_unstale":"2024-04-25T09:10:26.153548+0000","last_undegraded":"2024-04-25T09:10:26.153548+0000","last_fullsized":"2024-04-25T09:10:26.153548+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:21.841934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"108'6","reported_seq":20,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.154071+0000","last_change":"2024-04-25T09:10:23.979997+0000","last_active":"2024-04-25T09:10:26.154071+0000","last_peered":"2024-04-25T09:10:26.154071+0000","last_clean":"2024-04-25T09:10:26.154071+0000","last_became_active":"2024-04-25T09:10:23.979717+0000","last_became_peered":"2024-04-25T09:10:23.979717+0000","last_unstale":"2024-04-25T09:10:26.154071+0000","last_undegraded":"2024-04-25T09:10:26.154071+0000","last_fullsized":"2024-04-25T09:10:26.154071+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:31.903427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.020121+0000","last_change":"2024-04-25T09:10:25.005617+0000","last_active":"2024-04-25T09:10:26.020121+0000","last_peered":"2024-04-25T09:10:26.020121+0000","last_clean":"2024-04-25T09:10:26.020121+0000","last_became_active":"2024-04-25T09:10:25.005337+0000","last_became_peered":"2024-04-25T09:10:25.005337+0000","last_unstale":"2024-04-25T09:10:26.020121+0000","last_undegraded":"2024-04-25T09:10:26.020121+0000","last_fullsized":"2024-04-25T09:10:26.020121+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:47.075229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153526+0000","last_change":"2024-04-25T09:10:23.998293+0000","last_active":"2024-04-25T09:10:26.153526+0000","last_peered":"2024-04-25T09:10:26.153526+0000","last_clean":"2024-04-25T09:10:26.153526+0000","last_became_active":"2024-04-25T09:10:23.997758+0000","last_became_peered":"2024-04-25T09:10:23.997758+0000","last_unstale":"2024-04-25T09:10:26.153526+0000","last_undegraded":"2024-04-25T09:10:26.153526+0000","last_fullsized":"2024-04-25T09:10:26.153526+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:20.199621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.154562+0000","last_change":"2024-04-25T09:10:25.004235+0000","last_active":"2024-04-25T09:10:26.154562+0000","last_peered":"2024-04-25T09:10:26.154562+0000","last_clean":"2024-04-25T09:10:26.154562+0000","last_became_active":"2024-04-25T09:10:25.003775+0000","last_became_peered":"2024-04-25T09:10:25.003775+0000","last_unstale":"2024-04-25T09:10:26.154562+0000","last_undegraded":"2024-04-25T09:10:26.154562+0000","last_fullsized":"2024-04-25T09:10:26.154562+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:51:11.118308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993773+0000","last_change":"2024-04-25T09:10:23.984451+0000","last_active":"2024-04-25T09:10:25.993773+0000","last_peered":"2024-04-25T09:10:25.993773+0000","last_clean":"2024-04-25T09:10:25.993773+0000","last_became_active":"2024-04-25T09:10:23.984170+0000","last_became_peered":"2024-04-25T09:10:23.984170+0000","last_unstale":"2024-04-25T09:10:25.993773+0000","last_undegraded":"2024-04-25T09:10:25.993773+0000","last_fullsized":"2024-04-25T09:10:25.993773+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:48.797438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993005+0000","last_change":"2024-04-25T09:10:24.995940+0000","last_active":"2024-04-25T09:10:25.993005+0000","last_peered":"2024-04-25T09:10:25.993005+0000","last_clean":"2024-04-25T09:10:25.993005+0000","last_became_active":"2024-04-25T09:10:24.995666+0000","last_became_peered":"2024-04-25T09:10:24.995666+0000","last_unstale":"2024-04-25T09:10:25.993005+0000","last_undegraded":"2024-04-25T09:10:25.993005+0000","last_fullsized":"2024-04-25T09:10:25.993005+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:10.104554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992353+0000","last_change":"2024-04-25T09:10:23.990205+0000","last_active":"2024-04-25T09:10:25.992353+0000","last_peered":"2024-04-25T09:10:25.992353+0000","last_clean":"2024-04-25T09:10:25.992353+0000","last_became_active":"2024-04-25T09:10:23.989778+0000","last_became_peered":"2024-04-25T09:10:23.989778+0000","last_unstale":"2024-04-25T09:10:25.992353+0000","last_undegraded":"2024-04-25T09:10:25.992353+0000","last_fullsized":"2024-04-25T09:10:25.992353+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:43.287970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.018214+0000","last_change":"2024-04-25T09:10:25.010095+0000","last_active":"2024-04-25T09:10:26.018214+0000","last_peered":"2024-04-25T09:10:26.018214+0000","last_clean":"2024-04-25T09:10:26.018214+0000","last_became_active":"2024-04-25T09:10:25.009847+0000","last_became_peered":"2024-04-25T09:10:25.009847+0000","last_unstale":"2024-04-25T09:10:26.018214+0000","last_undegraded":"2024-04-25T09:10:26.018214+0000","last_fullsized":"2024-04-25T09:10:26.018214+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:00.632817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"108'8","reported_seq":22,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.991823+0000","last_change":"2024-04-25T09:10:23.987328+0000","last_active":"2024-04-25T09:10:25.991823+0000","last_peered":"2024-04-25T09:10:25.991823+0000","last_clean":"2024-04-25T09:10:25.991823+0000","last_became_active":"2024-04-25T09:10:23.987057+0000","last_became_peered":"2024-04-25T09:10:23.987057+0000","last_unstale":"2024-04-25T09:10:25.991823+0000","last_undegraded":"2024-04-25T09:10:25.991823+0000","last_fullsized":"2024-04-25T09:10:25.991823+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:51.093476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992235+0000","last_change":"2024-04-25T09:10:25.002077+0000","last_active":"2024-04-25T09:10:25.992235+0000","last_peered":"2024-04-25T09:10:25.992235+0000","last_clean":"2024-04-25T09:10:25.992235+0000","last_became_active":"2024-04-25T09:10:25.001788+0000","last_became_peered":"2024-04-25T09:10:25.001788+0000","last_unstale":"2024-04-25T09:10:25.992235+0000","last_undegraded":"2024-04-25T09:10:25.992235+0000","last_fullsized":"2024-04-25T09:10:25.992235+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:53.146010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.154299+0000","last_change":"2024-04-25T09:10:23.980244+0000","last_active":"2024-04-25T09:10:26.154299+0000","last_peered":"2024-04-25T09:10:26.154299+0000","last_clean":"2024-04-25T09:10:26.154299+0000","last_became_active":"2024-04-25T09:10:23.979939+0000","last_became_peered":"2024-04-25T09:10:23.979939+0000","last_unstale":"2024-04-25T09:10:26.154299+0000","last_undegraded":"2024-04-25T09:10:26.154299+0000","last_fullsized":"2024-04-25T09:10:26.154299+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:46.068383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.154366+0000","last_change":"2024-04-25T09:10:25.004787+0000","last_active":"2024-04-25T09:10:26.154366+0000","last_peered":"2024-04-25T09:10:26.154366+0000","last_clean":"2024-04-25T09:10:26.154366+0000","last_became_active":"2024-04-25T09:10:25.004487+0000","last_became_peered":"2024-04-25T09:10:25.004487+0000","last_unstale":"2024-04-25T09:10:26.154366+0000","last_undegraded":"2024-04-25T09:10:26.154366+0000","last_fullsized":"2024-04-25T09:10:26.154366+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:32.319361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153935+0000","last_change":"2024-04-25T09:10:23.985775+0000","last_active":"2024-04-25T09:10:26.153935+0000","last_peered":"2024-04-25T09:10:26.153935+0000","last_clean":"2024-04-25T09:10:26.153935+0000","last_became_active":"2024-04-25T09:10:23.985439+0000","last_became_peered":"2024-04-25T09:10:23.985439+0000","last_unstale":"2024-04-25T09:10:26.153935+0000","last_undegraded":"2024-04-25T09:10:26.153935+0000","last_fullsized":"2024-04-25T09:10:26.153935+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:34.204925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153410+0000","last_change":"2024-04-25T09:10:25.012492+0000","last_active":"2024-04-25T09:10:26.153410+0000","last_peered":"2024-04-25T09:10:26.153410+0000","last_clean":"2024-04-25T09:10:26.153410+0000","last_became_active":"2024-04-25T09:10:25.012202+0000","last_became_peered":"2024-04-25T09:10:25.012202+0000","last_unstale":"2024-04-25T09:10:26.153410+0000","last_undegraded":"2024-04-25T09:10:26.153410+0000","last_fullsized":"2024-04-25T09:10:26.153410+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:57.124135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.019983+0000","last_change":"2024-04-25T09:10:23.987171+0000","last_active":"2024-04-25T09:10:26.019983+0000","last_peered":"2024-04-25T09:10:26.019983+0000","last_clean":"2024-04-25T09:10:26.019983+0000","last_became_active":"2024-04-25T09:10:23.986918+0000","last_became_peered":"2024-04-25T09:10:23.986918+0000","last_unstale":"2024-04-25T09:10:26.019983+0000","last_undegraded":"2024-04-25T09:10:26.019983+0000","last_fullsized":"2024-04-25T09:10:26.019983+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:22:41.153460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.017839+0000","last_change":"2024-04-25T09:10:25.001738+0000","last_active":"2024-04-25T09:10:26.017839+0000","last_peered":"2024-04-25T09:10:26.017839+0000","last_clean":"2024-04-25T09:10:26.017839+0000","last_became_active":"2024-04-25T09:10:25.000899+0000","last_became_peered":"2024-04-25T09:10:25.000899+0000","last_unstale":"2024-04-25T09:10:26.017839+0000","last_undegraded":"2024-04-25T09:10:26.017839+0000","last_fullsized":"2024-04-25T09:10:26.017839+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:30.587789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992790+0000","last_change":"2024-04-25T09:10:23.993992+0000","last_active":"2024-04-25T09:10:25.992790+0000","last_peered":"2024-04-25T09:10:25.992790+0000","last_clean":"2024-04-25T09:10:25.992790+0000","last_became_active":"2024-04-25T09:10:23.993527+0000","last_became_peered":"2024-04-25T09:10:23.993527+0000","last_unstale":"2024-04-25T09:10:25.992790+0000","last_undegraded":"2024-04-25T09:10:25.992790+0000","last_fullsized":"2024-04-25T09:10:25.992790+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:12.659252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.018136+0000","last_change":"2024-04-25T09:10:25.006313+0000","last_active":"2024-04-25T09:10:26.018136+0000","last_peered":"2024-04-25T09:10:26.018136+0000","last_clean":"2024-04-25T09:10:26.018136+0000","last_became_active":"2024-04-25T09:10:25.006029+0000","last_became_peered":"2024-04-25T09:10:25.006029+0000","last_unstale":"2024-04-25T09:10:26.018136+0000","last_undegraded":"2024-04-25T09:10:26.018136+0000","last_fullsized":"2024-04-25T09:10:26.018136+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:32.795531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992387+0000","last_change":"2024-04-25T09:10:23.993352+0000","last_active":"2024-04-25T09:10:25.992387+0000","last_peered":"2024-04-25T09:10:25.992387+0000","last_clean":"2024-04-25T09:10:25.992387+0000","last_became_active":"2024-04-25T09:10:23.993098+0000","last_became_peered":"2024-04-25T09:10:23.993098+0000","last_unstale":"2024-04-25T09:10:25.992387+0000","last_undegraded":"2024-04-25T09:10:25.992387+0000","last_fullsized":"2024-04-25T09:10:25.992387+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:48.781048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993703+0000","last_change":"2024-04-25T09:10:25.002441+0000","last_active":"2024-04-25T09:10:25.993703+0000","last_peered":"2024-04-25T09:10:25.993703+0000","last_clean":"2024-04-25T09:10:25.993703+0000","last_became_active":"2024-04-25T09:10:25.002111+0000","last_became_peered":"2024-04-25T09:10:25.002111+0000","last_unstale":"2024-04-25T09:10:25.993703+0000","last_undegraded":"2024-04-25T09:10:25.993703+0000","last_fullsized":"2024-04-25T09:10:25.993703+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:40.367585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153500+0000","last_change":"2024-04-25T09:10:23.994808+0000","last_active":"2024-04-25T09:10:26.153500+0000","last_peered":"2024-04-25T09:10:26.153500+0000","last_clean":"2024-04-25T09:10:26.153500+0000","last_became_active":"2024-04-25T09:10:23.994517+0000","last_became_peered":"2024-04-25T09:10:23.994517+0000","last_unstale":"2024-04-25T09:10:26.153500+0000","last_undegraded":"2024-04-25T09:10:26.153500+0000","last_fullsized":"2024-04-25T09:10:26.153500+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:54.072452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992978+0000","last_change":"2024-04-25T09:10:25.011971+0000","last_active":"2024-04-25T09:10:25.992978+0000","last_peered":"2024-04-25T09:10:25.992978+0000","last_clean":"2024-04-25T09:10:25.992978+0000","last_became_active":"2024-04-25T09:10:25.011686+0000","last_became_peered":"2024-04-25T09:10:25.011686+0000","last_unstale":"2024-04-25T09:10:25.992978+0000","last_undegraded":"2024-04-25T09:10:25.992978+0000","last_fullsized":"2024-04-25T09:10:25.992978+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:40.123611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992195+0000","last_change":"2024-04-25T09:10:23.997986+0000","last_active":"2024-04-25T09:10:25.992195+0000","last_peered":"2024-04-25T09:10:25.992195+0000","last_clean":"2024-04-25T09:10:25.992195+0000","last_became_active":"2024-04-25T09:10:23.997682+0000","last_became_peered":"2024-04-25T09:10:23.997682+0000","last_unstale":"2024-04-25T09:10:25.992195+0000","last_undegraded":"2024-04-25T09:10:25.992195+0000","last_fullsized":"2024-04-25T09:10:25.992195+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:45.716419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.017635+0000","last_change":"2024-04-25T09:10:25.001127+0000","last_active":"2024-04-25T09:10:26.017635+0000","last_peered":"2024-04-25T09:10:26.017635+0000","last_clean":"2024-04-25T09:10:26.017635+0000","last_became_active":"2024-04-25T09:10:25.000875+0000","last_became_peered":"2024-04-25T09:10:25.000875+0000","last_unstale":"2024-04-25T09:10:26.017635+0000","last_undegraded":"2024-04-25T09:10:26.017635+0000","last_fullsized":"2024-04-25T09:10:26.017635+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:09.629026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153678+0000","last_change":"2024-04-25T09:10:23.991562+0000","last_active":"2024-04-25T09:10:26.153678+0000","last_peered":"2024-04-25T09:10:26.153678+0000","last_clean":"2024-04-25T09:10:26.153678+0000","last_became_active":"2024-04-25T09:10:23.991301+0000","last_became_peered":"2024-04-25T09:10:23.991301+0000","last_unstale":"2024-04-25T09:10:26.153678+0000","last_undegraded":"2024-04-25T09:10:26.153678+0000","last_fullsized":"2024-04-25T09:10:26.153678+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:03.924912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992018+0000","last_change":"2024-04-25T09:10:24.994723+0000","last_active":"2024-04-25T09:10:25.992018+0000","last_peered":"2024-04-25T09:10:25.992018+0000","last_clean":"2024-04-25T09:10:25.992018+0000","last_became_active":"2024-04-25T09:10:24.994417+0000","last_became_peered":"2024-04-25T09:10:24.994417+0000","last_unstale":"2024-04-25T09:10:25.992018+0000","last_undegraded":"2024-04-25T09:10:25.992018+0000","last_fullsized":"2024-04-25T09:10:25.992018+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:28.263468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"109'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.018169+0000","last_change":"2024-04-25T09:10:23.992345+0000","last_active":"2024-04-25T09:10:26.018169+0000","last_peered":"2024-04-25T09:10:26.018169+0000","last_clean":"2024-04-25T09:10:26.018169+0000","last_became_active":"2024-04-25T09:10:23.991115+0000","last_became_peered":"2024-04-25T09:10:23.991115+0000","last_unstale":"2024-04-25T09:10:26.018169+0000","last_undegraded":"2024-04-25T09:10:26.018169+0000","last_fullsized":"2024-04-25T09:10:26.018169+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:26:20.067241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.993793+0000","last_change":"2024-04-25T09:10:24.997534+0000","last_active":"2024-04-25T09:10:25.993793+0000","last_peered":"2024-04-25T09:10:25.993793+0000","last_clean":"2024-04-25T09:10:25.993793+0000","last_became_active":"2024-04-25T09:10:24.997255+0000","last_became_peered":"2024-04-25T09:10:24.997255+0000","last_unstale":"2024-04-25T09:10:25.993793+0000","last_undegraded":"2024-04-25T09:10:25.993793+0000","last_fullsized":"2024-04-25T09:10:25.993793+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:48.471105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.154363+0000","last_change":"2024-04-25T09:10:23.987107+0000","last_active":"2024-04-25T09:10:26.154363+0000","last_peered":"2024-04-25T09:10:26.154363+0000","last_clean":"2024-04-25T09:10:26.154363+0000","last_became_active":"2024-04-25T09:10:23.986816+0000","last_became_peered":"2024-04-25T09:10:23.986816+0000","last_unstale":"2024-04-25T09:10:26.154363+0000","last_undegraded":"2024-04-25T09:10:26.154363+0000","last_fullsized":"2024-04-25T09:10:26.154363+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:48.468978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.020059+0000","last_change":"2024-04-25T09:10:25.012728+0000","last_active":"2024-04-25T09:10:26.020059+0000","last_peered":"2024-04-25T09:10:26.020059+0000","last_clean":"2024-04-25T09:10:26.020059+0000","last_became_active":"2024-04-25T09:10:25.011248+0000","last_became_peered":"2024-04-25T09:10:25.011248+0000","last_unstale":"2024-04-25T09:10:26.020059+0000","last_undegraded":"2024-04-25T09:10:26.020059+0000","last_fullsized":"2024-04-25T09:10:26.020059+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:12.402325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153580+0000","last_change":"2024-04-25T09:10:23.988994+0000","last_active":"2024-04-25T09:10:26.153580+0000","last_peered":"2024-04-25T09:10:26.153580+0000","last_clean":"2024-04-25T09:10:26.153580+0000","last_became_active":"2024-04-25T09:10:23.988713+0000","last_became_peered":"2024-04-25T09:10:23.988713+0000","last_unstale":"2024-04-25T09:10:26.153580+0000","last_undegraded":"2024-04-25T09:10:26.153580+0000","last_fullsized":"2024-04-25T09:10:26.153580+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:07.019321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992710+0000","last_change":"2024-04-25T09:10:25.009607+0000","last_active":"2024-04-25T09:10:25.992710+0000","last_peered":"2024-04-25T09:10:25.992710+0000","last_clean":"2024-04-25T09:10:25.992710+0000","last_became_active":"2024-04-25T09:10:25.009341+0000","last_became_peered":"2024-04-25T09:10:25.009341+0000","last_unstale":"2024-04-25T09:10:25.992710+0000","last_undegraded":"2024-04-25T09:10:25.992710+0000","last_fullsized":"2024-04-25T09:10:25.992710+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:39.499479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992141+0000","last_change":"2024-04-25T09:10:23.982766+0000","last_active":"2024-04-25T09:10:25.992141+0000","last_peered":"2024-04-25T09:10:25.992141+0000","last_clean":"2024-04-25T09:10:25.992141+0000","last_became_active":"2024-04-25T09:10:23.982407+0000","last_became_peered":"2024-04-25T09:10:23.982407+0000","last_unstale":"2024-04-25T09:10:25.992141+0000","last_undegraded":"2024-04-25T09:10:25.992141+0000","last_fullsized":"2024-04-25T09:10:25.992141+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:29.285915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992782+0000","last_change":"2024-04-25T09:10:25.007602+0000","last_active":"2024-04-25T09:10:25.992782+0000","last_peered":"2024-04-25T09:10:25.992782+0000","last_clean":"2024-04-25T09:10:25.992782+0000","last_became_active":"2024-04-25T09:10:25.007332+0000","last_became_peered":"2024-04-25T09:10:25.007332+0000","last_unstale":"2024-04-25T09:10:25.992782+0000","last_undegraded":"2024-04-25T09:10:25.992782+0000","last_fullsized":"2024-04-25T09:10:25.992782+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:43.658523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992525+0000","last_change":"2024-04-25T09:10:23.991862+0000","last_active":"2024-04-25T09:10:25.992525+0000","last_peered":"2024-04-25T09:10:25.992525+0000","last_clean":"2024-04-25T09:10:25.992525+0000","last_became_active":"2024-04-25T09:10:23.991596+0000","last_became_peered":"2024-04-25T09:10:23.991596+0000","last_unstale":"2024-04-25T09:10:25.992525+0000","last_undegraded":"2024-04-25T09:10:25.992525+0000","last_fullsized":"2024-04-25T09:10:25.992525+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:45.678832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.154004+0000","last_change":"2024-04-25T09:10:25.009496+0000","last_active":"2024-04-25T09:10:26.154004+0000","last_peered":"2024-04-25T09:10:26.154004+0000","last_clean":"2024-04-25T09:10:26.154004+0000","last_became_active":"2024-04-25T09:10:25.009219+0000","last_became_peered":"2024-04-25T09:10:25.009219+0000","last_unstale":"2024-04-25T09:10:26.154004+0000","last_undegraded":"2024-04-25T09:10:26.154004+0000","last_fullsized":"2024-04-25T09:10:26.154004+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:48.471105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153613+0000","last_change":"2024-04-25T09:10:23.987725+0000","last_active":"2024-04-25T09:10:26.153613+0000","last_peered":"2024-04-25T09:10:26.153613+0000","last_clean":"2024-04-25T09:10:26.153613+0000","last_became_active":"2024-04-25T09:10:23.986339+0000","last_became_peered":"2024-04-25T09:10:23.986339+0000","last_unstale":"2024-04-25T09:10:26.153613+0000","last_undegraded":"2024-04-25T09:10:26.153613+0000","last_fullsized":"2024-04-25T09:10:26.153613+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:34.332034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.020311+0000","last_change":"2024-04-25T09:10:25.008457+0000","last_active":"2024-04-25T09:10:26.020311+0000","last_peered":"2024-04-25T09:10:26.020311+0000","last_clean":"2024-04-25T09:10:26.020311+0000","last_became_active":"2024-04-25T09:10:25.007319+0000","last_became_peered":"2024-04-25T09:10:25.007319+0000","last_unstale":"2024-04-25T09:10:26.020311+0000","last_undegraded":"2024-04-25T09:10:26.020311+0000","last_fullsized":"2024-04-25T09:10:26.020311+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:45.435628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992285+0000","last_change":"2024-04-25T09:10:23.990620+0000","last_active":"2024-04-25T09:10:25.992285+0000","last_peered":"2024-04-25T09:10:25.992285+0000","last_clean":"2024-04-25T09:10:25.992285+0000","last_became_active":"2024-04-25T09:10:23.990318+0000","last_became_peered":"2024-04-25T09:10:23.990318+0000","last_unstale":"2024-04-25T09:10:25.992285+0000","last_undegraded":"2024-04-25T09:10:25.992285+0000","last_fullsized":"2024-04-25T09:10:25.992285+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:52.073575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.019892+0000","last_change":"2024-04-25T09:10:25.002471+0000","last_active":"2024-04-25T09:10:26.019892+0000","last_peered":"2024-04-25T09:10:26.019892+0000","last_clean":"2024-04-25T09:10:26.019892+0000","last_became_active":"2024-04-25T09:10:25.001918+0000","last_became_peered":"2024-04-25T09:10:25.001918+0000","last_unstale":"2024-04-25T09:10:26.019892+0000","last_undegraded":"2024-04-25T09:10:26.019892+0000","last_fullsized":"2024-04-25T09:10:26.019892+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:23.964712+0000","last_clean_scrub_stamp":"2024-04-25T09:10:23.964712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:39.445928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:25.992908+0000","last_change":"2024-04-25T09:10:23.997830+0000","last_active":"2024-04-25T09:10:25.992908+0000","last_peered":"2024-04-25T09:10:25.992908+0000","last_clean":"2024-04-25T09:10:25.992908+0000","last_became_active":"2024-04-25T09:10:23.997524+0000","last_became_peered":"2024-04-25T09:10:23.997524+0000","last_unstale":"2024-04-25T09:10:25.992908+0000","last_undegraded":"2024-04-25T09:10:25.992908+0000","last_fullsized":"2024-04-25T09:10:25.992908+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:22.957866+0000","last_clean_scrub_stamp":"2024-04-25T09:10:22.957866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:52.315270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":331,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-25T09:10:26.153397+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:10:26.153397+0000","last_peered":"2024-04-25T09:10:26.153397+0000","last_clean":"2024-04-25T09:10:26.153397+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:10:26.153397+0000","last_undegraded":"2024-04-25T09:10:26.153397+0000","last_fullsized":"2024-04-25T09:10:26.153397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509537,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50564,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321276,"statfs":{"total":96636764160,"available":96584986624,"internally_reserved":0,"allocated":1363968,"data_stored":625176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509537,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46384,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325456,"statfs":{"total":96636764160,"available":96589266944,"internally_reserved":0,"allocated":1343488,"data_stored":622960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509538,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58876,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312964,"statfs":{"total":96636764160,"available":96576475136,"internally_reserved":0,"allocated":1351680,"data_stored":623052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509537,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54704,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317136,"statfs":{"total":96636764160,"available":96580747264,"internally_reserved":0,"allocated":1347584,"data_stored":623542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509537,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54708,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317132,"statfs":{"total":96636764160,"available":96580743168,"internally_reserved":0,"allocated":1347584,"data_stored":622994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509538,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50552,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321288,"statfs":{"total":96636764160,"available":96584998912,"internally_reserved":0,"allocated":1347584,"data_stored":622994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509538,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55304,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316536,"statfs":{"total":96636764160,"available":96580132864,"internally_reserved":0,"allocated":1953792,"data_stored":1215030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51128,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320712,"statfs":{"total":96636764160,"available":96584409088,"internally_reserved":0,"allocated":1945600,"data_stored":1213488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:10:33.928 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:10:33.928 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:10:34.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.123+0000 7f40d7600640 1 Processor -- start 2024-04-25T09:10:34.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.123+0000 7f40d7600640 1 -- start start 2024-04-25T09:10:34.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.123+0000 7f40d7600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f40d00b3fe0 0x7f40d00b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:34.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.123+0000 7f40d7600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40d00cc260 0x7f40d00cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:34.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.123+0000 7f40d7600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d006d4b0 con 0x7f40d0145290 2024-04-25T09:10:34.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.123+0000 7f40d7600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d006d790 con 0x7f40d00b3fe0 2024-04-25T09:10:34.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.123+0000 7f40d7600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d006da70 con 0x7f40d00cc260 2024-04-25T09:10:34.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.123+0000 7f40cfe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f40d00b3fe0 0x7f40d00b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:34.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.123+0000 7f40d5600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40d00cc260 0x7f40d00cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:34.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.123+0000 7f40d5600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40d00cc260 0x7f40d00cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:36818/0 (socket says 172.21.15.173:36818) 2024-04-25T09:10:34.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.123+0000 7f40d5600640 1 -- 172.21.15.173:0/2701637710 learned_addr learned my addr 172.21.15.173:0/2701637710 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:34.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.127+0000 7f40d5600640 1 -- 172.21.15.173:0/2701637710 >> v2:172.21.15.194:3300/0 conn(0x7f40d00b3fe0 msgr2=0x7f40d00b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:34.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.127+0000 7f40d5600640 1 --2- 172.21.15.173:0/2701637710 >> v2:172.21.15.194:3300/0 conn(0x7f40d00b3fe0 0x7f40d00b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.127+0000 7f40d5600640 1 -- 172.21.15.173:0/2701637710 >> v1:172.21.15.194:6789/0 conn(0x7f40d0145290 legacy=0x7f40d015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:34.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.127+0000 7f40d5600640 1 -- 172.21.15.173:0/2701637710 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d006dd50 con 0x7f40d00cc260 2024-04-25T09:10:34.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.127+0000 7f40cfe00640 1 --2- 172.21.15.173:0/2701637710 >> v2:172.21.15.194:3300/0 conn(0x7f40d00b3fe0 0x7f40d00b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:34.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.127+0000 7f40d5600640 1 --2- 172.21.15.173:0/2701637710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40d00cc260 0x7f40d00cc6b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009e50 tx=0x7f40c801c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c01cc8e743239d52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:34.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.127+0000 7f40cf400640 1 -- 172.21.15.173:0/2701637710 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c80a56e0 con 0x7f40d00cc260 2024-04-25T09:10:34.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.127+0000 7f40cf400640 1 -- 172.21.15.173:0/2701637710 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c80a5880 con 0x7f40d00cc260 2024-04-25T09:10:34.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.127+0000 7f40cf400640 1 -- 172.21.15.173:0/2701637710 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c80a5c50 con 0x7f40d00cc260 2024-04-25T09:10:34.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.127+0000 7f40d7600640 1 -- 172.21.15.173:0/2701637710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40d00cc260 msgr2=0x7f40d00cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:34.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.127+0000 7f40d7600640 1 --2- 172.21.15.173:0/2701637710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40d00cc260 0x7f40d00cc6b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009e50 tx=0x7f40c801c910 comp rx=0 tx=0).stop 2024-04-25T09:10:34.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.127+0000 7f40d7600640 1 -- 172.21.15.173:0/2701637710 shutdown_connections 2024-04-25T09:10:34.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.127+0000 7f40d7600640 1 --2- 172.21.15.173:0/2701637710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40d00cc260 0x7f40d00cc6b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.127+0000 7f40d7600640 1 --2- 172.21.15.173:0/2701637710 >> v2:172.21.15.194:3300/0 conn(0x7f40d00b3fe0 0x7f40d00b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.127+0000 7f40d7600640 1 -- 172.21.15.173:0/2701637710 >> 172.21.15.173:0/2701637710 conn(0x7f40d006ac90 msgr2=0x7f40d006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:34.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d7600640 1 -- 172.21.15.173:0/2701637710 shutdown_connections 2024-04-25T09:10:34.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d7600640 1 -- 172.21.15.173:0/2701637710 wait complete. 2024-04-25T09:10:34.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d7600640 1 Processor -- start 2024-04-25T09:10:34.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d7600640 1 -- start start 2024-04-25T09:10:34.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d7600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40d00b3fe0 0x7f40d013d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:34.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d7600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40d00cc260 0x7f40d00b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:34.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d7600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40d0145290 0x7f40d00b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:34.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d7600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d006eee0 con 0x7f40d0145290 2024-04-25T09:10:34.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d7600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d006ed60 con 0x7f40d00b3fe0 2024-04-25T09:10:34.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d7600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d006f060 con 0x7f40d00cc260 2024-04-25T09:10:34.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d5600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40d0145290 0x7f40d00b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:34.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d5600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40d0145290 0x7f40d00b0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36906/0 (socket says 172.21.15.173:36906) 2024-04-25T09:10:34.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d5600640 1 -- 172.21.15.173:0/636472177 learned_addr learned my addr 172.21.15.173:0/636472177 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:34.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40cfe00640 1 --2- 172.21.15.173:0/636472177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40d00cc260 0x7f40d00b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:34.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d4c00640 1 --2- 172.21.15.173:0/636472177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40d00b3fe0 0x7f40d013d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:34.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d5600640 1 -- 172.21.15.173:0/636472177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40d00cc260 msgr2=0x7f40d00b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:34.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d5600640 1 --2- 172.21.15.173:0/636472177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40d00cc260 0x7f40d00b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d5600640 1 -- 172.21.15.173:0/636472177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40d00b3fe0 msgr2=0x7f40d013d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:34.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d5600640 1 --2- 172.21.15.173:0/636472177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40d00b3fe0 0x7f40d013d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d5600640 1 -- 172.21.15.173:0/636472177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d00ace50 con 0x7f40d0145290 2024-04-25T09:10:34.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40d5600640 1 --2- 172.21.15.173:0/636472177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40d0145290 0x7f40d00b0a80 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f40c80af040 tx=0x7f40c80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:34.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.131+0000 7f40ccc00640 1 -- 172.21.15.173:0/636472177 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c80bc020 con 0x7f40d0145290 2024-04-25T09:10:34.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.135+0000 7f40ccc00640 1 -- 172.21.15.173:0/636472177 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c80b8670 con 0x7f40d0145290 2024-04-25T09:10:34.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.135+0000 7f40ccc00640 1 -- 172.21.15.173:0/636472177 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8009510 con 0x7f40d0145290 2024-04-25T09:10:34.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.135+0000 7f40d7600640 1 -- 172.21.15.173:0/636472177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d015ad90 con 0x7f40d0145290 2024-04-25T09:10:34.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.135+0000 7f40d7600640 1 -- 172.21.15.173:0/636472177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d00ad0d0 con 0x7f40d0145290 2024-04-25T09:10:34.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.135+0000 7f40d7600640 1 -- 172.21.15.173:0/636472177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d0073ab0 con 0x7f40d0145290 2024-04-25T09:10:34.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.135+0000 7f40ccc00640 1 -- 172.21.15.173:0/636472177 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f40c80bf020 con 0x7f40d0145290 2024-04-25T09:10:34.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.135+0000 7f40ccc00640 1 --2- 172.21.15.173:0/636472177 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40b0066f60 0x7f40b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:34.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.135+0000 7f40ccc00640 1 -- 172.21.15.173:0/636472177 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f40c811fef0 con 0x7f40d0145290 2024-04-25T09:10:34.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.135+0000 7f40d4c00640 1 --2- 172.21.15.173:0/636472177 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40b0066f60 0x7f40b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:34.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.135+0000 7f40d4c00640 1 --2- 172.21.15.173:0/636472177 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40b0066f60 0x7f40b0069420 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f40d00aa960 tx=0x7f40c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:34.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.139+0000 7f40ccc00640 1 -- 172.21.15.173:0/636472177 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f40c80c6030 con 0x7f40d0145290 2024-04-25T09:10:34.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.347+0000 7f40d7600640 1 -- 172.21.15.173:0/636472177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f40d0140d90 con 0x7f40d0145290 2024-04-25T09:10:34.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.351+0000 7f40ccc00640 1 -- 172.21.15.173:0/636472177 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f40d00ace50 con 0x7f40d0145290 2024-04-25T09:10:34.338 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2024-04-25T09:10:34.339 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w== 2024-04-25T09:10:34.339 INFO:teuthology.orchestra.run.smithi173.stdout: caps mds = "allow" 2024-04-25T09:10:34.339 INFO:teuthology.orchestra.run.smithi173.stdout: caps mon = "allow r" 2024-04-25T09:10:34.339 INFO:teuthology.orchestra.run.smithi173.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:10:34.339 INFO:teuthology.orchestra.run.smithi173.stderr:updated caps for client.0 2024-04-25T09:10:34.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.351+0000 7f40d7600640 1 -- 172.21.15.173:0/636472177 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40b0066f60 msgr2=0x7f40b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:34.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.351+0000 7f40d7600640 1 --2- 172.21.15.173:0/636472177 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40b0066f60 0x7f40b0069420 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f40d00aa960 tx=0x7f40c4009040 comp rx=0 tx=0).stop 2024-04-25T09:10:34.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.351+0000 7f40d7600640 1 -- 172.21.15.173:0/636472177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40d0145290 msgr2=0x7f40d00b0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:34.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.351+0000 7f40d7600640 1 --2- 172.21.15.173:0/636472177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40d0145290 0x7f40d00b0a80 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f40c80af040 tx=0x7f40c80196b0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.351+0000 7f40d7600640 1 -- 172.21.15.173:0/636472177 shutdown_connections 2024-04-25T09:10:34.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.351+0000 7f40d7600640 1 --2- 172.21.15.173:0/636472177 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40b0066f60 0x7f40b0069420 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.351+0000 7f40d7600640 1 --2- 172.21.15.173:0/636472177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40d0145290 0x7f40d00b0a80 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.351+0000 7f40d7600640 1 --2- 172.21.15.173:0/636472177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40d00cc260 0x7f40d00b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.351+0000 7f40d7600640 1 --2- 172.21.15.173:0/636472177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40d00b3fe0 0x7f40d013d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.351+0000 7f40d7600640 1 -- 172.21.15.173:0/636472177 >> 172.21.15.173:0/636472177 conn(0x7f40d006ac90 msgr2=0x7f40d015e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:34.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.351+0000 7f40d7600640 1 -- 172.21.15.173:0/636472177 shutdown_connections 2024-04-25T09:10:34.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.351+0000 7f40d7600640 1 -- 172.21.15.173:0/636472177 wait complete. 2024-04-25T09:10:34.360 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:34.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.507+0000 7f2661400640 1 Processor -- start 2024-04-25T09:10:34.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.507+0000 7f2661400640 1 -- start start 2024-04-25T09:10:34.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.507+0000 7f2661400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f265c0b3e70 0x7f265c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:34.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.507+0000 7f2661400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f265c0aefa0 0x7f265c0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:34.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.507+0000 7f2661400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f265c15edd0 0x7f265c0b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:34.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.507+0000 7f2661400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f265c06dd50 con 0x7f265c15edd0 2024-04-25T09:10:34.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.507+0000 7f2661400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f265c0b4790 con 0x7f265c0aefa0 2024-04-25T09:10:34.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.507+0000 7f2661400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265c15f320 con 0x7f265c0b3e70 2024-04-25T09:10:34.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.507+0000 7f265b200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f265c15edd0 0x7f265c0b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:34.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.507+0000 7f265b200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f265c15edd0 0x7f265c0b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36918/0 (socket says 172.21.15.173:36918) 2024-04-25T09:10:34.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.507+0000 7f265b200640 1 -- 172.21.15.173:0/923991142 learned_addr learned my addr 172.21.15.173:0/923991142 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:34.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.507+0000 7f265a800640 1 --2- 172.21.15.173:0/923991142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f265c0b3e70 0x7f265c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:34.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.507+0000 7f2659e00640 1 --2- 172.21.15.173:0/923991142 >> v2:172.21.15.194:3300/0 conn(0x7f265c0aefa0 0x7f265c0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:34.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.507+0000 7f265b200640 1 -- 172.21.15.173:0/923991142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f265c0b3e70 msgr2=0x7f265c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:34.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.507+0000 7f265b200640 1 --2- 172.21.15.173:0/923991142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f265c0b3e70 0x7f265c0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.507+0000 7f265b200640 1 -- 172.21.15.173:0/923991142 >> v2:172.21.15.194:3300/0 conn(0x7f265c0aefa0 msgr2=0x7f265c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:34.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.507+0000 7f265b200640 1 --2- 172.21.15.173:0/923991142 >> v2:172.21.15.194:3300/0 conn(0x7f265c0aefa0 0x7f265c0b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.511+0000 7f265b200640 1 -- 172.21.15.173:0/923991142 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c06d420 con 0x7f265c15edd0 2024-04-25T09:10:34.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.511+0000 7f265b200640 1 --2- 172.21.15.173:0/923991142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f265c15edd0 0x7f265c0b2cb0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f265c062550 tx=0x7f265401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa4c9de78f1a51d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:34.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.511+0000 7f2659400640 1 -- 172.21.15.173:0/923991142 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26540a5860 con 0x7f265c15edd0 2024-04-25T09:10:34.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.511+0000 7f2659400640 1 -- 172.21.15.173:0/923991142 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26540a5a00 con 0x7f265c15edd0 2024-04-25T09:10:34.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.511+0000 7f2659400640 1 -- 172.21.15.173:0/923991142 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26540a5dd0 con 0x7f265c15edd0 2024-04-25T09:10:34.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.511+0000 7f2661400640 1 -- 172.21.15.173:0/923991142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f265c15edd0 msgr2=0x7f265c0b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:34.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.511+0000 7f2661400640 1 --2- 172.21.15.173:0/923991142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f265c15edd0 0x7f265c0b2cb0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f265c062550 tx=0x7f265401c9c0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.511+0000 7f2661400640 1 -- 172.21.15.173:0/923991142 shutdown_connections 2024-04-25T09:10:34.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.511+0000 7f2661400640 1 --2- 172.21.15.173:0/923991142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f265c15edd0 0x7f265c0b2cb0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.511+0000 7f2661400640 1 --2- 172.21.15.173:0/923991142 >> v2:172.21.15.194:3300/0 conn(0x7f265c0aefa0 0x7f265c0b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.511+0000 7f2661400640 1 --2- 172.21.15.173:0/923991142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f265c0b3e70 0x7f265c0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.511+0000 7f2661400640 1 -- 172.21.15.173:0/923991142 >> 172.21.15.173:0/923991142 conn(0x7f265c06ac90 msgr2=0x7f265c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:34.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.511+0000 7f2661400640 1 -- 172.21.15.173:0/923991142 shutdown_connections 2024-04-25T09:10:34.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.511+0000 7f2661400640 1 -- 172.21.15.173:0/923991142 wait complete. 2024-04-25T09:10:34.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f2661400640 1 Processor -- start 2024-04-25T09:10:34.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f2661400640 1 -- start start 2024-04-25T09:10:34.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f2661400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f265c0aefa0 0x7f265c15d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:34.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f2661400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f265c0b3e70 0x7f265c0cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:34.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f2661400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f265c15edd0 0x7f265c14ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:34.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f2661400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c06e1c0 con 0x7f265c0aefa0 2024-04-25T09:10:34.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f2661400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c0b3600 con 0x7f265c0b3e70 2024-04-25T09:10:34.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f2661400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265c06e340 con 0x7f265c15edd0 2024-04-25T09:10:34.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f265a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f265c0aefa0 0x7f265c15d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:34.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f265a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f265c0aefa0 0x7f265c15d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36934/0 (socket says 172.21.15.173:36934) 2024-04-25T09:10:34.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f265a800640 1 -- 172.21.15.173:0/48607797 learned_addr learned my addr 172.21.15.173:0/48607797 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:34.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f2659e00640 1 --2- 172.21.15.173:0/48607797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f265c0b3e70 0x7f265c0cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:34.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f265b200640 1 --2- 172.21.15.173:0/48607797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f265c15edd0 0x7f265c14ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:34.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f265a800640 1 -- 172.21.15.173:0/48607797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f265c15edd0 msgr2=0x7f265c14ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:34.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f265a800640 1 --2- 172.21.15.173:0/48607797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f265c15edd0 0x7f265c14ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f265a800640 1 -- 172.21.15.173:0/48607797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f265c0b3e70 msgr2=0x7f265c0cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:34.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f265a800640 1 --2- 172.21.15.173:0/48607797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f265c0b3e70 0x7f265c0cfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f265a800640 1 -- 172.21.15.173:0/48607797 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c0ceb00 con 0x7f265c0aefa0 2024-04-25T09:10:34.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f265a800640 1 --2- 172.21.15.173:0/48607797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f265c0aefa0 0x7f265c15d8c0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f264c00e870 tx=0x7f264c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:34.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f2652a00640 1 -- 172.21.15.173:0/48607797 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c017070 con 0x7f265c0aefa0 2024-04-25T09:10:34.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f2652a00640 1 -- 172.21.15.173:0/48607797 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c00c940 con 0x7f265c0aefa0 2024-04-25T09:10:34.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f2652a00640 1 -- 172.21.15.173:0/48607797 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c00ccf0 con 0x7f265c0aefa0 2024-04-25T09:10:34.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.515+0000 7f2661400640 1 -- 172.21.15.173:0/48607797 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265c0cede0 con 0x7f265c0aefa0 2024-04-25T09:10:34.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.519+0000 7f2661400640 1 -- 172.21.15.173:0/48607797 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265c0cf3a0 con 0x7f265c0aefa0 2024-04-25T09:10:34.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.519+0000 7f2661400640 1 -- 172.21.15.173:0/48607797 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265c073a40 con 0x7f265c0aefa0 2024-04-25T09:10:34.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.519+0000 7f2652a00640 1 -- 172.21.15.173:0/48607797 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f264c01a070 con 0x7f265c0aefa0 2024-04-25T09:10:34.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.519+0000 7f2652a00640 1 --2- 172.21.15.173:0/48607797 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f263c066f60 0x7f263c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:34.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.519+0000 7f2652a00640 1 -- 172.21.15.173:0/48607797 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f264c0853d0 con 0x7f265c0aefa0 2024-04-25T09:10:34.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.519+0000 7f2659e00640 1 --2- 172.21.15.173:0/48607797 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f263c066f60 0x7f263c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:34.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.519+0000 7f2659e00640 1 --2- 172.21.15.173:0/48607797 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f263c066f60 0x7f263c069420 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f265c13ff20 tx=0x7f2648008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:34.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.523+0000 7f2652a00640 1 -- 172.21.15.173:0/48607797 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f264c0562c0 con 0x7f265c0aefa0 2024-04-25T09:10:34.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.707+0000 7f2661400640 1 -- 172.21.15.173:0/48607797 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f265c06f1c0 con 0x7f265c0aefa0 2024-04-25T09:10:34.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.707+0000 7f2652a00640 1 -- 172.21.15.173:0/48607797 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f264c055bc0 con 0x7f265c0aefa0 2024-04-25T09:10:34.698 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:34.698 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1519522112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1519522112},{"type":"v1","addr":"172.21.15.194:6835","nonce":1519522112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7555,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/548680290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":548680290},{"type":"v1","addr":"172.21.15.173:6836","nonce":548680290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2602621503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2602621503},{"type":"v1","addr":"172.21.15.194:6833","nonce":2602621503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:24.354981+0000","modified":"2024-04-25T09:10:27.392053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/1492125936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":1492125936},{"type":"v1","addr":"172.21.15.173:6837","nonce":1492125936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:10:34.698 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 72 2024-04-25T09:10:34.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.711+0000 7f2661400640 1 -- 172.21.15.173:0/48607797 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f263c066f60 msgr2=0x7f263c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:34.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.711+0000 7f2661400640 1 --2- 172.21.15.173:0/48607797 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f263c066f60 0x7f263c069420 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f265c13ff20 tx=0x7f2648008040 comp rx=0 tx=0).stop 2024-04-25T09:10:34.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.711+0000 7f2661400640 1 -- 172.21.15.173:0/48607797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f265c0aefa0 msgr2=0x7f265c15d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:34.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.711+0000 7f2661400640 1 --2- 172.21.15.173:0/48607797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f265c0aefa0 0x7f265c15d8c0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f264c00e870 tx=0x7f264c00ec70 comp rx=0 tx=0).stop 2024-04-25T09:10:34.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.711+0000 7f2661400640 1 -- 172.21.15.173:0/48607797 shutdown_connections 2024-04-25T09:10:34.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.711+0000 7f2661400640 1 --2- 172.21.15.173:0/48607797 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f263c066f60 0x7f263c069420 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.711+0000 7f2661400640 1 --2- 172.21.15.173:0/48607797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f265c15edd0 0x7f265c14ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.711+0000 7f2661400640 1 --2- 172.21.15.173:0/48607797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f265c0b3e70 0x7f265c0cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.711+0000 7f2661400640 1 --2- 172.21.15.173:0/48607797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f265c0aefa0 0x7f265c15d8c0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:34.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.711+0000 7f2661400640 1 -- 172.21.15.173:0/48607797 >> 172.21.15.173:0/48607797 conn(0x7f265c06ac90 msgr2=0x7f265c0b0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:34.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.711+0000 7f2661400640 1 -- 172.21.15.173:0/48607797 shutdown_connections 2024-04-25T09:10:34.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:34.711+0000 7f2661400640 1 -- 172.21.15.173:0/48607797 wait complete. 2024-04-25T09:10:35.122 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:10:24.354981+0000', 'modified': '2024-04-25T09:10:27.392053+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8193': {'gid': 8193, 'name': 'c', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.173:6837/1492125936', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6835', 'nonce': 1492125936}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 1492125936}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:10:35.122 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:10:35.122 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:10:35.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9f200640 1 Processor -- start 2024-04-25T09:10:35.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9f200640 1 -- start start 2024-04-25T09:10:35.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9f200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4aa006c4b0 0x7f4aa01689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9f200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa00b1040 con 0x7f4aa015dbc0 2024-04-25T09:10:35.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9f200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa006cab0 con 0x7f4aa009a160 2024-04-25T09:10:35.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9f200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa00cfce0 con 0x7f4aa006c4b0 2024-04-25T09:10:35.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9de00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4aa015dbc0 0x7f4aa0099a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41908/0 (socket says 172.21.15.173:41908) 2024-04-25T09:10:35.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9de00640 1 -- 172.21.15.173:0/4019026839 learned_addr learned my addr 172.21.15.173:0/4019026839 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:35.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9e800640 1 --2- 172.21.15.173:0/4019026839 >> v2:172.21.15.194:3300/0 conn(0x7f4aa006c4b0 0x7f4aa01689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9d400640 1 -- 172.21.15.173:0/4019026839 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753500885 0 0) 0x7f4a90001120 con 0x7f4aa015dbc0 2024-04-25T09:10:35.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9d400640 1 -- 172.21.15.173:0/4019026839 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a84003530 con 0x7f4aa015dbc0 2024-04-25T09:10:35.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9d400640 1 -- 172.21.15.173:0/4019026839 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 557152876 0 0) 0x7f4a84003530 con 0x7f4aa015dbc0 2024-04-25T09:10:35.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9d400640 1 -- 172.21.15.173:0/4019026839 >> v2:172.21.15.194:3300/0 conn(0x7f4aa006c4b0 msgr2=0x7f4aa01689f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:35.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9d400640 1 --2- 172.21.15.173:0/4019026839 >> v2:172.21.15.194:3300/0 conn(0x7f4aa006c4b0 0x7f4aa01689f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9d400640 1 -- 172.21.15.173:0/4019026839 >> v1:172.21.15.194:6789/0 conn(0x7f4aa009a160 legacy=0x7f4aa006bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:35.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9d400640 1 -- 172.21.15.173:0/4019026839 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa006cd90 con 0x7f4aa015dbc0 2024-04-25T09:10:35.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9d400640 1 -- 172.21.15.173:0/4019026839 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f4a90001850 con 0x7f4aa015dbc0 2024-04-25T09:10:35.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9d400640 1 -- 172.21.15.173:0/4019026839 >> v1:172.21.15.173:6789/0 conn(0x7f4aa015dbc0 legacy=0x7f4aa0099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:35.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9d400640 1 --2- 172.21.15.173:0/4019026839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840039c0 0x7f4a84003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9d400640 1 --2- 172.21.15.173:0/4019026839 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a84004810 0x7f4a84004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9d400640 1 --2- 172.21.15.173:0/4019026839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a840051d0 0x7f4a8400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9d400640 1 -- 172.21.15.173:0/4019026839 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa00cfce0 con 0x7f4a840039c0 2024-04-25T09:10:35.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9d400640 1 -- 172.21.15.173:0/4019026839 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8400c070 con 0x7f4a840051d0 2024-04-25T09:10:35.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9d400640 1 -- 172.21.15.173:0/4019026839 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8400c270 con 0x7f4a84004810 2024-04-25T09:10:35.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.271+0000 7f4a9de00640 1 --2- 172.21.15.173:0/4019026839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840039c0 0x7f4a84003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.275+0000 7f4a95400640 1 --2- 172.21.15.173:0/4019026839 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a84004810 0x7f4a84004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.275+0000 7f4a9e800640 1 --2- 172.21.15.173:0/4019026839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a840051d0 0x7f4a8400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.275+0000 7f4a9de00640 1 -- 172.21.15.173:0/4019026839 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a84004810 msgr2=0x7f4a84004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:35.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.275+0000 7f4a9de00640 1 --2- 172.21.15.173:0/4019026839 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a84004810 0x7f4a84004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.275+0000 7f4a9de00640 1 -- 172.21.15.173:0/4019026839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a840051d0 msgr2=0x7f4a8400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:35.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.275+0000 7f4a9de00640 1 --2- 172.21.15.173:0/4019026839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a840051d0 0x7f4a8400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.275+0000 7f4a9de00640 1 -- 172.21.15.173:0/4019026839 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a84003530 con 0x7f4a840039c0 2024-04-25T09:10:35.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.275+0000 7f4a9e800640 1 -- 172.21.15.173:0/4019026839 reap_dead start 2024-04-25T09:10:35.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.275+0000 7f4a9de00640 1 --2- 172.21.15.173:0/4019026839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840039c0 0x7f4a84003de0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000c4c0 tx=0x7f4a9001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece7307dc8a801ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:35.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.275+0000 7f4a9d400640 1 -- 172.21.15.173:0/4019026839 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9000c0e0 con 0x7f4a840039c0 2024-04-25T09:10:35.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.275+0000 7f4a9d400640 1 -- 172.21.15.173:0/4019026839 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a900a9070 con 0x7f4a840039c0 2024-04-25T09:10:35.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.275+0000 7f4a9d400640 1 -- 172.21.15.173:0/4019026839 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a90005d80 con 0x7f4a840039c0 2024-04-25T09:10:35.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.275+0000 7f4a9f200640 1 -- 172.21.15.173:0/4019026839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840039c0 msgr2=0x7f4a84003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:35.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.275+0000 7f4a9f200640 1 --2- 172.21.15.173:0/4019026839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840039c0 0x7f4a84003de0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000c4c0 tx=0x7f4a9001cc60 comp rx=0 tx=0).stop 2024-04-25T09:10:35.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.275+0000 7f4a9f200640 1 -- 172.21.15.173:0/4019026839 shutdown_connections 2024-04-25T09:10:35.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.275+0000 7f4a9f200640 1 --2- 172.21.15.173:0/4019026839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840039c0 0x7f4a84003de0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.275+0000 7f4a9f200640 1 -- 172.21.15.173:0/4019026839 >> 172.21.15.173:0/4019026839 conn(0x7f4aa00b31d0 msgr2=0x7f4aa00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:35.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9f200640 1 -- 172.21.15.173:0/4019026839 shutdown_connections 2024-04-25T09:10:35.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9f200640 1 -- 172.21.15.173:0/4019026839 wait complete. 2024-04-25T09:10:35.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9f200640 1 Processor -- start 2024-04-25T09:10:35.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9f200640 1 -- start start 2024-04-25T09:10:35.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9f200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840039c0 0x7f4aa015e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aa0148f00 0x7f4aa00c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aa0149360 0x7f4aa00c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9f200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa0161e70 con 0x7f4a840039c0 2024-04-25T09:10:35.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa006c890 con 0x7f4aa0148f00 2024-04-25T09:10:35.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa0161ff0 con 0x7f4aa0149360 2024-04-25T09:10:35.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840039c0 0x7f4aa015e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840039c0 0x7f4aa015e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36958/0 (socket says 172.21.15.173:36958) 2024-04-25T09:10:35.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9de00640 1 -- 172.21.15.173:0/700648681 learned_addr learned my addr 172.21.15.173:0/700648681 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:35.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9e800640 1 --2- 172.21.15.173:0/700648681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aa0149360 0x7f4aa00c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a95400640 1 --2- 172.21.15.173:0/700648681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aa0148f00 0x7f4aa00c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9de00640 1 -- 172.21.15.173:0/700648681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aa0149360 msgr2=0x7f4aa00c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:35.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9de00640 1 --2- 172.21.15.173:0/700648681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aa0149360 0x7f4aa00c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9de00640 1 -- 172.21.15.173:0/700648681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aa0148f00 msgr2=0x7f4aa00c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:35.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9de00640 1 --2- 172.21.15.173:0/700648681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aa0148f00 0x7f4aa00c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9de00640 1 -- 172.21.15.173:0/700648681 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa00b5720 con 0x7f4a840039c0 2024-04-25T09:10:35.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9de00640 1 --2- 172.21.15.173:0/700648681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840039c0 0x7f4aa015e720 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f4a9001ca90 tx=0x7f4a84005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:35.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a96a00640 1 -- 172.21.15.173:0/700648681 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a900a58e0 con 0x7f4a840039c0 2024-04-25T09:10:35.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a96a00640 1 -- 172.21.15.173:0/700648681 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a900a5a80 con 0x7f4a840039c0 2024-04-25T09:10:35.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a9f200640 1 -- 172.21.15.173:0/700648681 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa00c82a0 con 0x7f4a840039c0 2024-04-25T09:10:35.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.279+0000 7f4a96a00640 1 -- 172.21.15.173:0/700648681 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a900a5e30 con 0x7f4a840039c0 2024-04-25T09:10:35.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.283+0000 7f4a9f200640 1 -- 172.21.15.173:0/700648681 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa00c7550 con 0x7f4a840039c0 2024-04-25T09:10:35.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.283+0000 7f4a96a00640 1 -- 172.21.15.173:0/700648681 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4a900047f0 con 0x7f4a840039c0 2024-04-25T09:10:35.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.283+0000 7f4a96a00640 1 --2- 172.21.15.173:0/700648681 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4a7c066f60 0x7f4a7c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.283+0000 7f4a96a00640 1 -- 172.21.15.173:0/700648681 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f4a9011ebd0 con 0x7f4a840039c0 2024-04-25T09:10:35.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.283+0000 7f4a95400640 1 --2- 172.21.15.173:0/700648681 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4a7c066f60 0x7f4a7c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.283+0000 7f4aa7ffa000 1 Processor -- start 2024-04-25T09:10:35.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.283+0000 7f4aa7ffa000 1 -- start start 2024-04-25T09:10:35.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.283+0000 7f4a95400640 1 --2- 172.21.15.173:0/700648681 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4a7c066f60 0x7f4a7c069420 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f4aa015e460 tx=0x7f4a88009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:35.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a90a920 0x558b7a90ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a90b240 0x558b7a8c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a8c0f30 0x558b7a8c1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b7a7a85f0 con 0x558b7a8c0f30 2024-04-25T09:10:35.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b7a70fda0 con 0x558b7a90a920 2024-04-25T09:10:35.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b7a698150 con 0x558b7a90b240 2024-04-25T09:10:35.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4a9e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a8c0f30 0x558b7a8c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4a9e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a8c0f30 0x558b7a8c1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36962/0 (socket says 172.21.15.173:36962) 2024-04-25T09:10:35.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4a9e800640 1 -- 172.21.15.173:0/2446762111 learned_addr learned my addr 172.21.15.173:0/2446762111 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:35.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4a95400640 1 --2- 172.21.15.173:0/2446762111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a90b240 0x558b7a8c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4a9de00640 1 --2- 172.21.15.173:0/2446762111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a90a920 0x558b7a90ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4a9e800640 1 -- 172.21.15.173:0/2446762111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a90b240 msgr2=0x558b7a8c09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4a9e800640 1 --2- 172.21.15.173:0/2446762111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a90b240 0x558b7a8c09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4a9e800640 1 -- 172.21.15.173:0/2446762111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a90a920 msgr2=0x558b7a90ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4a9e800640 1 --2- 172.21.15.173:0/2446762111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a90a920 0x558b7a90ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4a9e800640 1 -- 172.21.15.173:0/2446762111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b7a6b1ca0 con 0x558b7a8c0f30 2024-04-25T09:10:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4a95400640 1 --2- 172.21.15.173:0/2446762111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a90b240 0x558b7a8c09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4a9de00640 1 --2- 172.21.15.173:0/2446762111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a90a920 0x558b7a90ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4a9e800640 1 --2- 172.21.15.173:0/2446762111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a8c0f30 0x558b7a8c1310 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0073440 tx=0x7f4a98009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b701769aabd5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4a8ea00640 1 -- 172.21.15.173:0/2446762111 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9801a020 con 0x558b7a8c0f30 2024-04-25T09:10:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4a8ea00640 1 -- 172.21.15.173:0/2446762111 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a98016660 con 0x558b7a8c0f30 2024-04-25T09:10:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4a8ea00640 1 -- 172.21.15.173:0/2446762111 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98016a10 con 0x558b7a8c0f30 2024-04-25T09:10:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/2446762111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a8c0f30 msgr2=0x558b7a8c1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/2446762111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a8c0f30 0x558b7a8c1310 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0073440 tx=0x7f4a98009750 comp rx=0 tx=0).stop 2024-04-25T09:10:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/2446762111 shutdown_connections 2024-04-25T09:10:35.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/2446762111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a8c0f30 0x558b7a8c1310 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/2446762111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a90b240 0x558b7a8c09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/2446762111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a90a920 0x558b7a90ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/2446762111 >> 172.21.15.173:0/2446762111 conn(0x558b7a8c72a0 msgr2=0x558b7a8bf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:35.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/2446762111 shutdown_connections 2024-04-25T09:10:35.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/2446762111 wait complete. 2024-04-25T09:10:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 -- start start 2024-04-25T09:10:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 Processor -- start 2024-04-25T09:10:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a8c0f30 0x558b7a911ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a90a920 0x558b7a912410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a90b240 0x558b7a8c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b7a6ca990 con 0x558b7a90a920 2024-04-25T09:10:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b7a70be40 con 0x558b7a90b240 2024-04-25T09:10:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b7a69b900 con 0x558b7a8c0f30 2024-04-25T09:10:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.287+0000 7f4aa7ffa000 10 client.0 _ll_register_callbacks cb 0x558b7a7c31c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a95400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a90a920 0x558b7a912410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a95400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a90a920 0x558b7a912410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36966/0 (socket says 172.21.15.173:36966) 2024-04-25T09:10:35.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a95400640 1 -- 172.21.15.173:0/3566329180 learned_addr learned my addr 172.21.15.173:0/3566329180 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:35.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a9de00640 1 --2- 172.21.15.173:0/3566329180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a8c0f30 0x558b7a911ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a9e800640 1 --2- 172.21.15.173:0/3566329180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a90b240 0x558b7a8c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a95400640 1 -- 172.21.15.173:0/3566329180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a8c0f30 msgr2=0x558b7a911ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:35.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a95400640 1 --2- 172.21.15.173:0/3566329180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a8c0f30 0x558b7a911ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a95400640 1 -- 172.21.15.173:0/3566329180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a90b240 msgr2=0x558b7a8c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:35.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a95400640 1 --2- 172.21.15.173:0/3566329180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a90b240 0x558b7a8c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a95400640 1 -- 172.21.15.173:0/3566329180 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b7a6c8630 con 0x558b7a90a920 2024-04-25T09:10:35.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a9de00640 1 --2- 172.21.15.173:0/3566329180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a8c0f30 0x558b7a911ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:35.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a95400640 1 --2- 172.21.15.173:0/3566329180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a90a920 0x558b7a912410 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f4a88001ba0 tx=0x7f4a88001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a020e65320d17b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:35.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a83400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:10:35.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a83400640 1 -- 172.21.15.173:0/3566329180 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a88022400 con 0x558b7a90a920 2024-04-25T09:10:35.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a83400640 1 -- 172.21.15.173:0/3566329180 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f4a880248d0 con 0x558b7a90a920 2024-04-25T09:10:35.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/3566329180 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a98016660 con 0x558b7a90a920 2024-04-25T09:10:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a83400640 1 -- 172.21.15.173:0/3566329180 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a88024ad0 con 0x558b7a90a920 2024-04-25T09:10:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 10 client.8349 fetch_fsmap learned FSMap version 72 2024-04-25T09:10:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/3566329180 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x558b7a6983a0 con 0x558b7a90a920 2024-04-25T09:10:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a83400640 1 -- 172.21.15.173:0/3566329180 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a98016660 con 0x558b7a90a920 2024-04-25T09:10:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a83400640 1 -- 172.21.15.173:0/3566329180 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4a88024c70 con 0x558b7a90a920 2024-04-25T09:10:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 10 client.8349 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:10:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 10 client.8349 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:10:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 20 client.8349 populate_metadata read hostname 'smithi173' 2024-04-25T09:10:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/3566329180 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x558b7a8c6160 0x558b7a91bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 4 client.8349 mds_command: new command op to 8193 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/3566329180 --> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558b7a6aba50 con 0x558b7a8c6160 2024-04-25T09:10:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a9de00640 1 --2- 172.21.15.173:0/3566329180 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x558b7a8c6160 0x558b7a91bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a83400640 10 client.8349 ms_handle_connect on v2:172.21.15.173:6835/1492125936 2024-04-25T09:10:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a9de00640 1 --2- 172.21.15.173:0/3566329180 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x558b7a8c6160 0x558b7a91bf30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9edeb6b263e0959a server_cookie=e5d8b7a5d6a2843d in_seq=0 out_seq=0 2024-04-25T09:10:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a83400640 1 -- 172.21.15.173:0/3566329180 <== mds.0 v2:172.21.15.173:6835/1492125936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558b7a6aba50 con 0x558b7a8c6160 2024-04-25T09:10:35.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a83400640 10 client.8349 handle_command_reply: tid=0 2024-04-25T09:10:35.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 1 client.8349 shutdown 2024-04-25T09:10:35.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/3566329180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a90a920 msgr2=0x558b7a912410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:35.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/3566329180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a90a920 0x558b7a912410 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f4a88001ba0 tx=0x7f4a88001130 comp rx=0 tx=0).stop 2024-04-25T09:10:35.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/3566329180 shutdown_connections 2024-04-25T09:10:35.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/3566329180 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x558b7a8c6160 0x558b7a91bf30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/3566329180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a90b240 0x558b7a8c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/3566329180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a90a920 0x558b7a912410 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4a83400640 0 client.8349 ms_handle_reset on v2:172.21.15.173:6835/1492125936 2024-04-25T09:10:35.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/3566329180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a8c0f30 0x558b7a911ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/3566329180 >> 172.21.15.173:0/3566329180 conn(0x558b7a8c72a0 msgr2=0x558b7a8bf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:35.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/3566329180 shutdown_connections 2024-04-25T09:10:35.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/3566329180 wait complete. 2024-04-25T09:10:35.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.291+0000 7f4aa7ffa000 20 client.8349 trim_cache size 0 max 16384 2024-04-25T09:10:35.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.307+0000 7f4aa7ffa000 1 Processor -- start 2024-04-25T09:10:35.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.307+0000 7f4aa7ffa000 1 -- start start 2024-04-25T09:10:35.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.307+0000 7f4aa7ffa000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a8c0f30 0x558b7a965db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.307+0000 7f4aa7ffa000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a90a920 0x558b7a9662f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.307+0000 7f4aa7ffa000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a90b240 0x558b7a966830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.307+0000 7f4aa7ffa000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa02034e0 con 0x558b7a90b240 2024-04-25T09:10:35.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.307+0000 7f4aa7ffa000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa01fb580 con 0x558b7a8c0f30 2024-04-25T09:10:35.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.307+0000 7f4aa7ffa000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa0202f60 con 0x558b7a90a920 2024-04-25T09:10:35.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.307+0000 7f4a9e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a90b240 0x558b7a966830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.307+0000 7f4a9e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a90b240 0x558b7a966830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36974/0 (socket says 172.21.15.173:36974) 2024-04-25T09:10:35.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.307+0000 7f4a9e800640 1 -- 172.21.15.173:0/1660796900 learned_addr learned my addr 172.21.15.173:0/1660796900 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:35.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a9de00640 1 --2- 172.21.15.173:0/1660796900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a8c0f30 0x558b7a965db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a95400640 1 --2- 172.21.15.173:0/1660796900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a90a920 0x558b7a9662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a9e800640 1 -- 172.21.15.173:0/1660796900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a90a920 msgr2=0x558b7a9662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:35.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a9e800640 1 --2- 172.21.15.173:0/1660796900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a90a920 0x558b7a9662f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a9e800640 1 -- 172.21.15.173:0/1660796900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a8c0f30 msgr2=0x558b7a965db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:35.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a9e800640 1 --2- 172.21.15.173:0/1660796900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a8c0f30 0x558b7a965db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a9e800640 1 -- 172.21.15.173:0/1660796900 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b7a90b070 con 0x558b7a90b240 2024-04-25T09:10:35.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a9de00640 1 --2- 172.21.15.173:0/1660796900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a8c0f30 0x558b7a965db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:35.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a9e800640 1 --2- 172.21.15.173:0/1660796900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a90b240 0x558b7a966830 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800b010 tx=0x7f4a98016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0743c87dcd040f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:35.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a8e000640 1 -- 172.21.15.173:0/1660796900 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9802e070 con 0x558b7a90b240 2024-04-25T09:10:35.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a8e000640 1 -- 172.21.15.173:0/1660796900 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a98029470 con 0x558b7a90b240 2024-04-25T09:10:35.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a8e000640 1 -- 172.21.15.173:0/1660796900 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9801a050 con 0x558b7a90b240 2024-04-25T09:10:35.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/1660796900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a90b240 msgr2=0x558b7a966830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:35.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/1660796900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a90b240 0x558b7a966830 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800b010 tx=0x7f4a98016000 comp rx=0 tx=0).stop 2024-04-25T09:10:35.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/1660796900 shutdown_connections 2024-04-25T09:10:35.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/1660796900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a90b240 0x558b7a966830 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/1660796900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a90a920 0x558b7a9662f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/1660796900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a8c0f30 0x558b7a965db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/1660796900 >> 172.21.15.173:0/1660796900 conn(0x558b7a8c72a0 msgr2=0x558b7a8c3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:35.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/1660796900 shutdown_connections 2024-04-25T09:10:35.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/1660796900 wait complete. 2024-04-25T09:10:35.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4aa7ffa000 1 -- start start 2024-04-25T09:10:35.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4aa7ffa000 1 Processor -- start 2024-04-25T09:10:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4aa7ffa000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a8c0f30 0x558b7a94eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4aa7ffa000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a90a920 0x558b7a91dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4aa7ffa000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a90b240 0x558b7a91e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4aa7ffa000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b7a7143d0 con 0x558b7a8c0f30 2024-04-25T09:10:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4aa7ffa000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b7a7cbd50 con 0x558b7a90b240 2024-04-25T09:10:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4aa7ffa000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b7a6aa980 con 0x558b7a90a920 2024-04-25T09:10:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4aa7ffa000 10 client.0 _ll_register_callbacks cb 0x7f4a84004710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a9de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a8c0f30 0x558b7a94eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a9de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a8c0f30 0x558b7a94eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36976/0 (socket says 172.21.15.173:36976) 2024-04-25T09:10:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a9de00640 1 -- 172.21.15.173:0/314687677 learned_addr learned my addr 172.21.15.173:0/314687677 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a9e800640 1 --2- 172.21.15.173:0/314687677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a90b240 0x558b7a91e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a95400640 1 --2- 172.21.15.173:0/314687677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a90a920 0x558b7a91dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a9de00640 1 -- 172.21.15.173:0/314687677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a90a920 msgr2=0x558b7a91dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:35.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a9de00640 1 --2- 172.21.15.173:0/314687677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a90a920 0x558b7a91dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a9de00640 1 -- 172.21.15.173:0/314687677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a90b240 msgr2=0x558b7a91e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a9de00640 1 --2- 172.21.15.173:0/314687677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a90b240 0x558b7a91e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a9de00640 1 -- 172.21.15.173:0/314687677 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b7a791600 con 0x558b7a8c0f30 2024-04-25T09:10:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a95400640 1 --2- 172.21.15.173:0/314687677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a90a920 0x558b7a91dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.311+0000 7f4a9e800640 1 --2- 172.21.15.173:0/314687677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a90b240 0x558b7a91e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a9de00640 1 --2- 172.21.15.173:0/314687677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a8c0f30 0x558b7a94eb90 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f4a9001d140 tx=0x7f4a900adf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71725b43cfc3ea45 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a83400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:10:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a83400640 1 -- 172.21.15.173:0/314687677 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a900f3470 con 0x558b7a8c0f30 2024-04-25T09:10:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a83400640 1 -- 172.21.15.173:0/314687677 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f4a9011cf70 con 0x558b7a8c0f30 2024-04-25T09:10:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/314687677 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a98029470 con 0x558b7a8c0f30 2024-04-25T09:10:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a83400640 1 -- 172.21.15.173:0/314687677 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a900f7a30 con 0x558b7a8c0f30 2024-04-25T09:10:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 10 client.8355 fetch_fsmap learned FSMap version 72 2024-04-25T09:10:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/314687677 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x558b7a6a49b0 con 0x558b7a8c0f30 2024-04-25T09:10:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a83400640 1 -- 172.21.15.173:0/314687677 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a98029470 con 0x558b7a8c0f30 2024-04-25T09:10:35.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a83400640 1 -- 172.21.15.173:0/314687677 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4a900c2030 con 0x558b7a8c0f30 2024-04-25T09:10:35.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 10 client.8355 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:10:35.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 10 client.8355 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:10:35.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 20 client.8355 populate_metadata read hostname 'smithi173' 2024-04-25T09:10:35.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/314687677 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x558b7a94f480 0x558b7a94f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 4 client.8355 mds_command: new command op to 8193 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:10:35.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/314687677 --> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558b7a71d2e0 con 0x558b7a94f480 2024-04-25T09:10:35.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a95400640 1 --2- 172.21.15.173:0/314687677 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x558b7a94f480 0x558b7a94f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a95400640 1 --2- 172.21.15.173:0/314687677 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x558b7a94f480 0x558b7a94f860 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=947a4440fc4761a2 server_cookie=4903efe99ee9277d in_seq=0 out_seq=0 2024-04-25T09:10:35.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a83400640 10 client.8355 ms_handle_connect on v2:172.21.15.173:6835/1492125936 2024-04-25T09:10:35.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a83400640 1 -- 172.21.15.173:0/314687677 <== mds.0 v2:172.21.15.173:6835/1492125936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x558b7a71d2e0 con 0x558b7a94f480 2024-04-25T09:10:35.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a83400640 10 client.8355 handle_command_reply: tid=0 2024-04-25T09:10:35.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 1 client.8355 shutdown 2024-04-25T09:10:35.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/314687677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a8c0f30 msgr2=0x558b7a94eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:35.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/314687677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a8c0f30 0x558b7a94eb90 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f4a9001d140 tx=0x7f4a900adf60 comp rx=0 tx=0).stop 2024-04-25T09:10:35.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/314687677 shutdown_connections 2024-04-25T09:10:35.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/314687677 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x558b7a94f480 0x558b7a94f860 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/314687677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558b7a90b240 0x558b7a91e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/314687677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x558b7a90a920 0x558b7a91dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 1 --2- 172.21.15.173:0/314687677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558b7a8c0f30 0x558b7a94eb90 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a83400640 0 client.8355 ms_handle_reset on v2:172.21.15.173:6835/1492125936 2024-04-25T09:10:35.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/314687677 >> 172.21.15.173:0/314687677 conn(0x558b7a8c72a0 msgr2=0x558b7a8c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:35.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/314687677 shutdown_connections 2024-04-25T09:10:35.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 1 -- 172.21.15.173:0/314687677 wait complete. 2024-04-25T09:10:35.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4aa7ffa000 20 client.8355 trim_cache size 0 max 16384 2024-04-25T09:10:35.308 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:10:35.308 INFO:teuthology.orchestra.run.smithi173.stdout: "cluster_fsid": "ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6", 2024-04-25T09:10:35.309 INFO:teuthology.orchestra.run.smithi173.stdout: "whoami": 0, 2024-04-25T09:10:35.309 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 8193, 2024-04-25T09:10:35.309 INFO:teuthology.orchestra.run.smithi173.stdout: "want_state": "up:active", 2024-04-25T09:10:35.309 INFO:teuthology.orchestra.run.smithi173.stdout: "state": "up:active", 2024-04-25T09:10:35.309 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs", 2024-04-25T09:10:35.309 INFO:teuthology.orchestra.run.smithi173.stdout: "rank_uptime": 10.311980833, 2024-04-25T09:10:35.309 INFO:teuthology.orchestra.run.smithi173.stdout: "mdsmap_epoch": 72, 2024-04-25T09:10:35.309 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch": 111, 2024-04-25T09:10:35.309 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch_barrier": 109, 2024-04-25T09:10:35.309 INFO:teuthology.orchestra.run.smithi173.stdout: "uptime": 16.191558275999999 2024-04-25T09:10:35.309 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:10:35.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a9f200640 1 -- 172.21.15.173:0/700648681 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4a7c066f60 msgr2=0x7f4a7c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:35.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a9f200640 1 --2- 172.21.15.173:0/700648681 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4a7c066f60 0x7f4a7c069420 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f4aa015e460 tx=0x7f4a88009040 comp rx=0 tx=0).stop 2024-04-25T09:10:35.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a9f200640 1 -- 172.21.15.173:0/700648681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840039c0 msgr2=0x7f4aa015e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:35.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a9f200640 1 --2- 172.21.15.173:0/700648681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840039c0 0x7f4aa015e720 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f4a9001ca90 tx=0x7f4a84005840 comp rx=0 tx=0).stop 2024-04-25T09:10:35.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a9f200640 1 -- 172.21.15.173:0/700648681 shutdown_connections 2024-04-25T09:10:35.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a9f200640 1 --2- 172.21.15.173:0/700648681 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4a7c066f60 0x7f4a7c069420 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a9f200640 1 --2- 172.21.15.173:0/700648681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aa0149360 0x7f4aa00c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a9f200640 1 --2- 172.21.15.173:0/700648681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aa0148f00 0x7f4aa00c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a9f200640 1 --2- 172.21.15.173:0/700648681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a840039c0 0x7f4aa015e720 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a9f200640 1 -- 172.21.15.173:0/700648681 >> 172.21.15.173:0/700648681 conn(0x7f4aa00b31d0 msgr2=0x7f4aa015ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:35.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a9f200640 1 -- 172.21.15.173:0/700648681 shutdown_connections 2024-04-25T09:10:35.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.315+0000 7f4a9f200640 1 -- 172.21.15.173:0/700648681 wait complete. 2024-04-25T09:10:35.324 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:10:35.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.471+0000 7f8f03000640 1 Processor -- start 2024-04-25T09:10:35.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.471+0000 7f8f03000640 1 -- start start 2024-04-25T09:10:35.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.471+0000 7f8f03000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8efc15ba20 0x7f8efc15be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.471+0000 7f8f03000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8efc0b7550 0x7f8efc0d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.471+0000 7f8f03000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8efc15c460 con 0x7f8efc0b70f0 2024-04-25T09:10:35.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.471+0000 7f8f03000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8efc15c740 con 0x7f8efc0b7550 2024-04-25T09:10:35.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.471+0000 7f8f03000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc15ca20 con 0x7f8efc15ba20 2024-04-25T09:10:35.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.471+0000 7f8f01000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8efc0b7550 0x7f8efc0d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.471+0000 7f8f01000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8efc0b7550 0x7f8efc0d1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36992/0 (socket says 172.21.15.173:36992) 2024-04-25T09:10:35.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.471+0000 7f8f01000640 1 -- 172.21.15.173:0/463393378 learned_addr learned my addr 172.21.15.173:0/463393378 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:35.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.471+0000 7f8efb400640 1 --1- 172.21.15.173:0/463393378 >> v1:172.21.15.173:6789/0 conn(0x7f8efc0b70f0 0x7f8efc06f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41924/0 (socket says 172.21.15.173:41924) 2024-04-25T09:10:35.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.471+0000 7f8efbe00640 1 --2- 172.21.15.173:0/463393378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8efc15ba20 0x7f8efc15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.471+0000 7f8f01000640 1 -- 172.21.15.173:0/463393378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8efc15ba20 msgr2=0x7f8efc15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:35.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.471+0000 7f8f01000640 1 --2- 172.21.15.173:0/463393378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8efc15ba20 0x7f8efc15be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.471+0000 7f8f01000640 1 -- 172.21.15.173:0/463393378 >> v1:172.21.15.173:6789/0 conn(0x7f8efc0b70f0 legacy=0x7f8efc06f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:35.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.471+0000 7f8f01000640 1 -- 172.21.15.173:0/463393378 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc15cd00 con 0x7f8efc0b7550 2024-04-25T09:10:35.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.475+0000 7f8f01000640 1 --2- 172.21.15.173:0/463393378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8efc0b7550 0x7f8efc0d1a80 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009870 tx=0x7f8ef401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d02779ba5ebc681 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:35.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.475+0000 7f8efaa00640 1 -- 172.21.15.173:0/463393378 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef40a9610 con 0x7f8efc0b7550 2024-04-25T09:10:35.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.475+0000 7f8efaa00640 1 -- 172.21.15.173:0/463393378 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef40a97b0 con 0x7f8efc0b7550 2024-04-25T09:10:35.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.475+0000 7f8efaa00640 1 -- 172.21.15.173:0/463393378 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef40a9b80 con 0x7f8efc0b7550 2024-04-25T09:10:35.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.475+0000 7f8f03000640 1 -- 172.21.15.173:0/463393378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8efc0b7550 msgr2=0x7f8efc0d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:35.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.475+0000 7f8f03000640 1 --2- 172.21.15.173:0/463393378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8efc0b7550 0x7f8efc0d1a80 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009870 tx=0x7f8ef401c530 comp rx=0 tx=0).stop 2024-04-25T09:10:35.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.475+0000 7f8f03000640 1 -- 172.21.15.173:0/463393378 shutdown_connections 2024-04-25T09:10:35.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.475+0000 7f8f03000640 1 --2- 172.21.15.173:0/463393378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8efc0b7550 0x7f8efc0d1a80 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.475+0000 7f8f03000640 1 --2- 172.21.15.173:0/463393378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8efc15ba20 0x7f8efc15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.475+0000 7f8f03000640 1 -- 172.21.15.173:0/463393378 >> 172.21.15.173:0/463393378 conn(0x7f8efc061880 msgr2=0x7f8efc061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:35.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.475+0000 7f8f03000640 1 -- 172.21.15.173:0/463393378 shutdown_connections 2024-04-25T09:10:35.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.475+0000 7f8f03000640 1 -- 172.21.15.173:0/463393378 wait complete. 2024-04-25T09:10:35.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8f03000640 1 Processor -- start 2024-04-25T09:10:35.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8f03000640 1 -- start start 2024-04-25T09:10:35.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8f03000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8efc0b70f0 0x7f8efc0cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8f03000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8efc15ba20 0x7f8efc0b6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8f03000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8efc0c8860 0x7f8efc0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8f03000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc15df20 con 0x7f8efc0b70f0 2024-04-25T09:10:35.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8f03000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc0d25e0 con 0x7f8efc15ba20 2024-04-25T09:10:35.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8f03000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc15e0a0 con 0x7f8efc0c8860 2024-04-25T09:10:35.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8efbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8efc0b70f0 0x7f8efc0cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8efbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8efc0b70f0 0x7f8efc0cb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36996/0 (socket says 172.21.15.173:36996) 2024-04-25T09:10:35.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8efbe00640 1 -- 172.21.15.173:0/1805270357 learned_addr learned my addr 172.21.15.173:0/1805270357 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:35.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8f01000640 1 --2- 172.21.15.173:0/1805270357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8efc0c8860 0x7f8efc0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8efb400640 1 --2- 172.21.15.173:0/1805270357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8efc15ba20 0x7f8efc0b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8efbe00640 1 -- 172.21.15.173:0/1805270357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8efc0c8860 msgr2=0x7f8efc0b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:35.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8efbe00640 1 --2- 172.21.15.173:0/1805270357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8efc0c8860 0x7f8efc0b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8efbe00640 1 -- 172.21.15.173:0/1805270357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8efc15ba20 msgr2=0x7f8efc0b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:35.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8efbe00640 1 --2- 172.21.15.173:0/1805270357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8efc15ba20 0x7f8efc0b6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8efbe00640 1 -- 172.21.15.173:0/1805270357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc0b6ec0 con 0x7f8efc0b70f0 2024-04-25T09:10:35.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8efb400640 1 --2- 172.21.15.173:0/1805270357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8efc15ba20 0x7f8efc0b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:35.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8efbe00640 1 --2- 172.21.15.173:0/1805270357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8efc0b70f0 0x7f8efc0cb2e0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f8eec007e40 tx=0x7f8eec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:35.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8ef3e00640 1 -- 172.21.15.173:0/1805270357 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec014620 con 0x7f8efc0b70f0 2024-04-25T09:10:35.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8ef3e00640 1 -- 172.21.15.173:0/1805270357 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec019070 con 0x7f8efc0b70f0 2024-04-25T09:10:35.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8ef3e00640 1 -- 172.21.15.173:0/1805270357 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec014a00 con 0x7f8efc0b70f0 2024-04-25T09:10:35.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8f03000640 1 -- 172.21.15.173:0/1805270357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8efc0c8e20 con 0x7f8efc0b70f0 2024-04-25T09:10:35.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.479+0000 7f8f03000640 1 -- 172.21.15.173:0/1805270357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8efc0caae0 con 0x7f8efc0b70f0 2024-04-25T09:10:35.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.483+0000 7f8f03000640 1 -- 172.21.15.173:0/1805270357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8efc073a40 con 0x7f8efc0b70f0 2024-04-25T09:10:35.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.483+0000 7f8ef3e00640 1 -- 172.21.15.173:0/1805270357 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8eec014ba0 con 0x7f8efc0b70f0 2024-04-25T09:10:35.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.483+0000 7f8ef3e00640 1 --2- 172.21.15.173:0/1805270357 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8edc066f60 0x7f8edc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:35.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.483+0000 7f8ef3e00640 1 -- 172.21.15.173:0/1805270357 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f8eec085900 con 0x7f8efc0b70f0 2024-04-25T09:10:35.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.483+0000 7f8efb400640 1 --2- 172.21.15.173:0/1805270357 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8edc066f60 0x7f8edc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:35.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.483+0000 7f8efb400640 1 --2- 172.21.15.173:0/1805270357 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8edc066f60 0x7f8edc069420 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8efc14ecf0 tx=0x7f8ee8007d70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:35.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.487+0000 7f8ef3e00640 1 -- 172.21.15.173:0/1805270357 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8eec0567f0 con 0x7f8efc0b70f0 2024-04-25T09:10:35.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.675+0000 7f8f03000640 1 -- 172.21.15.173:0/1805270357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8efc167480 con 0x7f8efc0b70f0 2024-04-25T09:10:35.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.679+0000 7f8ef3e00640 1 -- 172.21.15.173:0/1805270357 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8eec0560f0 con 0x7f8efc0b70f0 2024-04-25T09:10:35.666 INFO:teuthology.orchestra.run.smithi173.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:10:35.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.679+0000 7f8f03000640 1 -- 172.21.15.173:0/1805270357 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8edc066f60 msgr2=0x7f8edc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:35.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.679+0000 7f8f03000640 1 --2- 172.21.15.173:0/1805270357 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8edc066f60 0x7f8edc069420 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8efc14ecf0 tx=0x7f8ee8007d70 comp rx=0 tx=0).stop 2024-04-25T09:10:35.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.679+0000 7f8f03000640 1 -- 172.21.15.173:0/1805270357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8efc0b70f0 msgr2=0x7f8efc0cb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:35.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.679+0000 7f8f03000640 1 --2- 172.21.15.173:0/1805270357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8efc0b70f0 0x7f8efc0cb2e0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f8eec007e40 tx=0x7f8eec00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.679+0000 7f8f03000640 1 -- 172.21.15.173:0/1805270357 shutdown_connections 2024-04-25T09:10:35.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.679+0000 7f8f03000640 1 --2- 172.21.15.173:0/1805270357 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8edc066f60 0x7f8edc069420 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.679+0000 7f8f03000640 1 --2- 172.21.15.173:0/1805270357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8efc0c8860 0x7f8efc0b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.679+0000 7f8f03000640 1 --2- 172.21.15.173:0/1805270357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8efc15ba20 0x7f8efc0b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.679+0000 7f8f03000640 1 --2- 172.21.15.173:0/1805270357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8efc0b70f0 0x7f8efc0cb2e0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:35.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.679+0000 7f8f03000640 1 -- 172.21.15.173:0/1805270357 >> 172.21.15.173:0/1805270357 conn(0x7f8efc061880 msgr2=0x7f8efc153c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:35.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.679+0000 7f8f03000640 1 -- 172.21.15.173:0/1805270357 shutdown_connections 2024-04-25T09:10:35.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:35.679+0000 7f8f03000640 1 -- 172.21.15.173:0/1805270357 wait complete. 2024-04-25T09:10:35.688 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:10:35.688 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:10:35.688 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2024-04-25T09:10:35.688 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:10:35.688 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:35.688 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:10:35.688 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:10:35.688 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:10:35.688 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:10:35.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:35.688 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2024-04-25T09:10:35.697 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:10:35.697 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:10:35.697 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:10:35.697 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:35.697 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-25T09:10:35.697 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:35.697 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:10:35.697 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:35.697 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2024-04-25T09:10:35.697 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:10:35.697 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:35.697 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2024-04-25T09:10:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:10:35.698 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:10:35.698 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:35.698 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:10:35.698 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 41982sec preferred_lft 41982sec 2024-04-25T09:10:35.698 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2024-04-25T09:10:35.698 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:10:35.698 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 02:42:00:0e:60:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:35.698 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:10:35.698 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:10:35.698 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:35.699 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:10:35.699 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:35.699 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:10:35.699 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:35.699 INFO:teuthology.orchestra.run.smithi173.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:10:35.699 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:10:35.699 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:10:35.699 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:35.699 INFO:teuthology.orchestra.run.smithi173.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:10:35.699 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:10:35.699 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:10:35.699 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:35.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:35.700 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:10:35.759 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-04-25T09:10:35.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:35.761 DEBUG:teuthology.orchestra.run.smithi173:> route 2024-04-25T09:10:35.813 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2024-04-25T09:10:35.813 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:10:35.813 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:10:35.813 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:10:35.813 INFO:teuthology.orchestra.run.smithi173.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:10:35.813 INFO:teuthology.orchestra.run.smithi173.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:10:35.813 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:10:35.813 INFO:teuthology.orchestra.run.smithi173.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:10:35.813 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:10:35.813 INFO:teuthology.orchestra.run.smithi173.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:10:35.813 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:10:35.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:35.814 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:10:35.814 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:35.814 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:10:35.814 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:10:35.814 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:10:35.814 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:35.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:35.902 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-25T09:10:35.958 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:10:35.958 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:10:35.959 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:10:35.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:35.959 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2024-04-25T09:10:36.021 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:10:36.021 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:36.073 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:10:36.074 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:10:36.074 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:36.124 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:10:36.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:36.125 DEBUG:teuthology.orchestra.run.smithi173:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:36.213 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:36.213 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:10:36.213 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:10:36.228 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:36.228 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:10:36.228 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:10:36.228 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:10:36.228 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:10:36.237 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:36.237 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:10:36.237 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:10:36.238 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:10:36.238 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:10:36.238 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-04-25T09:10:36.238 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-04-25T09:10:36.238 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6" will pass to kernel 2024-04-25T09:10:36.241 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:10:36.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:36.241 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:36.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:36.262 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:10:36.322 INFO:teuthology.orchestra.run.smithi173.stdout:client7717 2024-04-25T09:10:36.322 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:10:36.322 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:36.377 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:36.377 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_control_test_path 2024-04-25T09:10:36.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:36.378 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:36.378 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:36.378 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.0 2024-04-25T09:10:36.378 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:36.378 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:36.378 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:36.378 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:36.454 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.454 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.454 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167374 s, 62.6 MB/s 2024-04-25T09:10:36.470 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.470 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.470 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143046 s, 73.3 MB/s 2024-04-25T09:10:36.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.498 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.498 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255121 s, 41.1 MB/s 2024-04-25T09:10:36.519 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.519 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.519 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192649 s, 54.4 MB/s 2024-04-25T09:10:36.541 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.541 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.541 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207175 s, 50.6 MB/s 2024-04-25T09:10:36.563 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.563 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.563 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201659 s, 52.0 MB/s 2024-04-25T09:10:36.582 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.582 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.582 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174329 s, 60.1 MB/s 2024-04-25T09:10:36.603 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.603 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.603 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191615 s, 54.7 MB/s 2024-04-25T09:10:36.617 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.617 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.617 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012391 s, 84.6 MB/s 2024-04-25T09:10:36.644 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.644 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.644 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247327 s, 42.4 MB/s 2024-04-25T09:10:36.662 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.662 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.663 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164269 s, 63.8 MB/s 2024-04-25T09:10:36.682 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.682 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.682 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172388 s, 60.8 MB/s 2024-04-25T09:10:36.703 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.703 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.703 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199077 s, 52.7 MB/s 2024-04-25T09:10:36.722 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.722 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.722 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016726 s, 62.7 MB/s 2024-04-25T09:10:36.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.739 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157745 s, 66.5 MB/s 2024-04-25T09:10:36.757 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.757 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.757 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160409 s, 65.4 MB/s 2024-04-25T09:10:36.776 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.776 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.776 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169548 s, 61.8 MB/s 2024-04-25T09:10:36.798 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.798 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.798 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196765 s, 53.3 MB/s 2024-04-25T09:10:36.813 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.813 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.813 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140321 s, 74.7 MB/s 2024-04-25T09:10:36.834 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.834 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.834 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191751 s, 54.7 MB/s 2024-04-25T09:10:36.850 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.850 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.850 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139637 s, 75.1 MB/s 2024-04-25T09:10:36.874 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.874 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.874 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223055 s, 47.0 MB/s 2024-04-25T09:10:36.895 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.895 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.895 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190617 s, 55.0 MB/s 2024-04-25T09:10:36.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.914 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172188 s, 60.9 MB/s 2024-04-25T09:10:36.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.934 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180143 s, 58.2 MB/s 2024-04-25T09:10:36.950 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.950 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.950 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014456 s, 72.5 MB/s 2024-04-25T09:10:36.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.970 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.970 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177059 s, 59.2 MB/s 2024-04-25T09:10:36.986 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:36.986 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:36.986 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146787 s, 71.4 MB/s 2024-04-25T09:10:37.011 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.012 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.012 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023723 s, 44.2 MB/s 2024-04-25T09:10:37.031 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.031 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.031 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174151 s, 60.2 MB/s 2024-04-25T09:10:37.045 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.045 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.045 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125036 s, 83.9 MB/s 2024-04-25T09:10:37.061 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.062 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.062 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146879 s, 71.4 MB/s 2024-04-25T09:10:37.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:37.063 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:37.063 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:37.063 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.1 2024-04-25T09:10:37.063 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:37.063 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:37.064 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:37.064 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:37.135 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.136 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132836 s, 78.9 MB/s 2024-04-25T09:10:37.156 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.156 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.156 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188153 s, 55.7 MB/s 2024-04-25T09:10:37.173 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.173 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.173 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145922 s, 71.9 MB/s 2024-04-25T09:10:37.189 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.189 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.189 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144345 s, 72.6 MB/s 2024-04-25T09:10:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.205 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143922 s, 72.9 MB/s 2024-04-25T09:10:37.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.222 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01457 s, 72.0 MB/s 2024-04-25T09:10:37.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.241 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.241 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170836 s, 61.4 MB/s 2024-04-25T09:10:37.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.257 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146307 s, 71.7 MB/s 2024-04-25T09:10:37.277 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.277 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.277 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178912 s, 58.6 MB/s 2024-04-25T09:10:37.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.298 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190932 s, 54.9 MB/s 2024-04-25T09:10:37.319 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.319 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.319 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193726 s, 54.1 MB/s 2024-04-25T09:10:37.338 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.338 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.339 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177267 s, 59.2 MB/s 2024-04-25T09:10:37.359 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.359 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.359 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192012 s, 54.6 MB/s 2024-04-25T09:10:37.379 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.379 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.379 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01826 s, 57.4 MB/s 2024-04-25T09:10:37.396 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.396 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.396 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151584 s, 69.2 MB/s 2024-04-25T09:10:37.414 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.414 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.414 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161576 s, 64.9 MB/s 2024-04-25T09:10:37.433 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.433 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.433 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169623 s, 61.8 MB/s 2024-04-25T09:10:37.454 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.454 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.454 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019868 s, 52.8 MB/s 2024-04-25T09:10:37.468 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.468 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.468 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122046 s, 85.9 MB/s 2024-04-25T09:10:37.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.484 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01399 s, 75.0 MB/s 2024-04-25T09:10:37.507 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.507 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.507 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165462 s, 63.4 MB/s 2024-04-25T09:10:37.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.522 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173108 s, 60.6 MB/s 2024-04-25T09:10:37.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.540 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016327 s, 64.2 MB/s 2024-04-25T09:10:37.561 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.561 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.561 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019339 s, 54.2 MB/s 2024-04-25T09:10:37.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.579 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157388 s, 66.6 MB/s 2024-04-25T09:10:37.601 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.602 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.602 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214288 s, 48.9 MB/s 2024-04-25T09:10:37.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.624 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205135 s, 51.1 MB/s 2024-04-25T09:10:37.641 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.641 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.641 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014915 s, 70.3 MB/s 2024-04-25T09:10:37.658 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.658 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.658 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157609 s, 66.5 MB/s 2024-04-25T09:10:37.676 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.676 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.676 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159433 s, 65.8 MB/s 2024-04-25T09:10:37.695 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.695 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.695 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169123 s, 62.0 MB/s 2024-04-25T09:10:37.715 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.716 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.716 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019057 s, 55.0 MB/s 2024-04-25T09:10:37.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:37.717 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:37.717 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:37.717 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.2 2024-04-25T09:10:37.717 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:37.717 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:37.717 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:37.717 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:37.784 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.784 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.784 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01392 s, 75.3 MB/s 2024-04-25T09:10:37.801 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.801 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.801 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144364 s, 72.6 MB/s 2024-04-25T09:10:37.819 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.819 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.819 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164609 s, 63.7 MB/s 2024-04-25T09:10:37.839 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.839 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.839 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186882 s, 56.1 MB/s 2024-04-25T09:10:37.855 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.855 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.855 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141637 s, 74.0 MB/s 2024-04-25T09:10:37.872 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.872 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.872 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149818 s, 70.0 MB/s 2024-04-25T09:10:37.893 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.893 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.893 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191475 s, 54.8 MB/s 2024-04-25T09:10:37.909 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.909 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.909 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143591 s, 73.0 MB/s 2024-04-25T09:10:37.927 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.927 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.927 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016319 s, 64.3 MB/s 2024-04-25T09:10:37.943 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.943 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.943 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141617 s, 74.0 MB/s 2024-04-25T09:10:37.963 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.963 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.964 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187585 s, 55.9 MB/s 2024-04-25T09:10:37.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:37.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:37.982 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017084 s, 61.4 MB/s 2024-04-25T09:10:38.005 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.005 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.005 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206359 s, 50.8 MB/s 2024-04-25T09:10:38.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.025 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185862 s, 56.4 MB/s 2024-04-25T09:10:38.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.042 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150553 s, 69.6 MB/s 2024-04-25T09:10:38.064 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.064 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.064 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201387 s, 52.1 MB/s 2024-04-25T09:10:38.079 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.080 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.080 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140183 s, 74.8 MB/s 2024-04-25T09:10:38.098 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.099 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.099 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169462 s, 61.9 MB/s 2024-04-25T09:10:38.119 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.119 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.119 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190374 s, 55.1 MB/s 2024-04-25T09:10:38.139 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.140 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183407 s, 57.2 MB/s 2024-04-25T09:10:38.156 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.156 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.156 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147072 s, 71.3 MB/s 2024-04-25T09:10:38.175 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.175 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.175 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170234 s, 61.6 MB/s 2024-04-25T09:10:38.191 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.191 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.191 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143655 s, 73.0 MB/s 2024-04-25T09:10:38.208 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.208 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.208 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152468 s, 68.8 MB/s 2024-04-25T09:10:38.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.224 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139857 s, 75.0 MB/s 2024-04-25T09:10:38.242 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.242 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.242 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162447 s, 64.5 MB/s 2024-04-25T09:10:38.258 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.258 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.258 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140286 s, 74.7 MB/s 2024-04-25T09:10:38.276 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.276 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.276 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167094 s, 62.8 MB/s 2024-04-25T09:10:38.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.298 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198552 s, 52.8 MB/s 2024-04-25T09:10:38.315 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.315 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.315 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157239 s, 66.7 MB/s 2024-04-25T09:10:38.334 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.334 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.334 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166151 s, 63.1 MB/s 2024-04-25T09:10:38.350 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.350 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.350 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144599 s, 72.5 MB/s 2024-04-25T09:10:38.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:38.351 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:38.351 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:38.352 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.3 2024-04-25T09:10:38.352 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:38.352 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:38.352 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:38.352 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:38.426 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.426 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.426 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197071 s, 53.2 MB/s 2024-04-25T09:10:38.444 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.444 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.444 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015871 s, 66.1 MB/s 2024-04-25T09:10:38.464 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.464 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.464 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018888 s, 55.5 MB/s 2024-04-25T09:10:38.482 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.482 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.482 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161722 s, 64.8 MB/s 2024-04-25T09:10:38.504 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.504 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.505 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202493 s, 51.8 MB/s 2024-04-25T09:10:38.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.522 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155453 s, 67.5 MB/s 2024-04-25T09:10:38.542 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.543 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.543 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187611 s, 55.9 MB/s 2024-04-25T09:10:38.561 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.561 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.561 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165621 s, 63.3 MB/s 2024-04-25T09:10:38.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.579 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158719 s, 66.1 MB/s 2024-04-25T09:10:38.599 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.599 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.599 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185429 s, 56.5 MB/s 2024-04-25T09:10:38.620 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.620 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.620 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196813 s, 53.3 MB/s 2024-04-25T09:10:38.638 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.638 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.638 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163938 s, 64.0 MB/s 2024-04-25T09:10:38.654 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.654 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.654 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142047 s, 73.8 MB/s 2024-04-25T09:10:38.671 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.671 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.671 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147449 s, 71.1 MB/s 2024-04-25T09:10:38.691 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.691 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.692 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187993 s, 55.8 MB/s 2024-04-25T09:10:38.710 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.710 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.710 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169089 s, 62.0 MB/s 2024-04-25T09:10:38.728 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.728 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.728 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156502 s, 67.0 MB/s 2024-04-25T09:10:38.744 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.744 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.744 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142362 s, 73.7 MB/s 2024-04-25T09:10:38.760 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.760 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.760 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142973 s, 73.3 MB/s 2024-04-25T09:10:38.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.777 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153807 s, 68.2 MB/s 2024-04-25T09:10:38.794 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.794 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.794 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146405 s, 71.6 MB/s 2024-04-25T09:10:38.812 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.812 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.812 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167591 s, 62.6 MB/s 2024-04-25T09:10:38.829 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.829 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.829 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150006 s, 69.9 MB/s 2024-04-25T09:10:38.850 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.850 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.850 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191526 s, 54.7 MB/s 2024-04-25T09:10:38.866 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.866 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.866 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142509 s, 73.6 MB/s 2024-04-25T09:10:38.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.968 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147515 s, 71.1 MB/s 2024-04-25T09:10:38.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.969 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198104 s, 52.9 MB/s 2024-04-25T09:10:38.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.969 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202085 s, 51.9 MB/s 2024-04-25T09:10:38.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.970 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.970 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150123 s, 69.8 MB/s 2024-04-25T09:10:38.970 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.970 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.970 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139613 s, 75.1 MB/s 2024-04-25T09:10:38.976 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.977 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.977 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016027 s, 65.4 MB/s 2024-04-25T09:10:38.996 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:38.996 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:38.997 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181956 s, 57.6 MB/s 2024-04-25T09:10:38.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:38.998 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:38.999 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:38.999 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.4 2024-04-25T09:10:38.999 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:38.999 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:38.999 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:38.999 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:39.069 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.069 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.069 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146931 s, 71.4 MB/s 2024-04-25T09:10:39.087 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.087 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.087 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162663 s, 64.5 MB/s 2024-04-25T09:10:39.108 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.108 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.108 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018975 s, 55.3 MB/s 2024-04-25T09:10:39.128 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.128 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.129 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188648 s, 55.6 MB/s 2024-04-25T09:10:39.149 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.149 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.149 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018635 s, 56.3 MB/s 2024-04-25T09:10:39.167 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.167 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.167 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162258 s, 64.6 MB/s 2024-04-25T09:10:39.184 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.184 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.184 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151677 s, 69.1 MB/s 2024-04-25T09:10:39.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.200 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146399 s, 71.6 MB/s 2024-04-25T09:10:39.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.222 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194178 s, 54.0 MB/s 2024-04-25T09:10:39.238 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.238 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.238 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147246 s, 71.2 MB/s 2024-04-25T09:10:39.256 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.256 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.256 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158107 s, 66.3 MB/s 2024-04-25T09:10:39.277 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.277 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.277 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194164 s, 54.0 MB/s 2024-04-25T09:10:39.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.298 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197313 s, 53.1 MB/s 2024-04-25T09:10:39.315 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.315 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.315 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015191 s, 69.0 MB/s 2024-04-25T09:10:39.332 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.332 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.332 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015147 s, 69.2 MB/s 2024-04-25T09:10:39.349 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.349 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.349 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151909 s, 69.0 MB/s 2024-04-25T09:10:39.373 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.373 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.373 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219789 s, 47.7 MB/s 2024-04-25T09:10:39.389 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.389 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.389 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143283 s, 73.2 MB/s 2024-04-25T09:10:39.406 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.406 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.406 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150137 s, 69.8 MB/s 2024-04-25T09:10:39.421 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.422 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.422 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139634 s, 75.1 MB/s 2024-04-25T09:10:39.445 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.445 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.445 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217579 s, 48.2 MB/s 2024-04-25T09:10:39.466 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.466 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.466 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018991 s, 55.2 MB/s 2024-04-25T09:10:39.486 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.486 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.486 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183891 s, 57.0 MB/s 2024-04-25T09:10:39.505 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.506 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.506 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177355 s, 59.1 MB/s 2024-04-25T09:10:39.526 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.526 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.526 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018805 s, 55.8 MB/s 2024-04-25T09:10:39.546 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.546 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.546 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176213 s, 59.5 MB/s 2024-04-25T09:10:39.560 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.560 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.560 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125543 s, 83.5 MB/s 2024-04-25T09:10:39.584 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.584 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.584 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224718 s, 46.7 MB/s 2024-04-25T09:10:39.605 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.605 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.605 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018486 s, 56.7 MB/s 2024-04-25T09:10:39.621 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.621 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.622 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148455 s, 70.6 MB/s 2024-04-25T09:10:39.641 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.641 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.641 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181158 s, 57.9 MB/s 2024-04-25T09:10:39.658 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.658 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.658 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148377 s, 70.7 MB/s 2024-04-25T09:10:39.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:39.659 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:39.659 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:39.659 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.5 2024-04-25T09:10:39.660 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:39.660 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:39.660 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:39.660 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:39.732 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.732 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.732 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167993 s, 62.4 MB/s 2024-04-25T09:10:39.749 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.749 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.750 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155972 s, 67.2 MB/s 2024-04-25T09:10:39.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.766 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146115 s, 71.8 MB/s 2024-04-25T09:10:39.782 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.782 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.782 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147277 s, 71.2 MB/s 2024-04-25T09:10:39.798 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.798 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.798 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140354 s, 74.7 MB/s 2024-04-25T09:10:39.819 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.819 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.819 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189018 s, 55.5 MB/s 2024-04-25T09:10:39.834 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.834 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.834 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137677 s, 76.2 MB/s 2024-04-25T09:10:39.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.858 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211081 s, 49.7 MB/s 2024-04-25T09:10:39.874 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.875 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.875 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014947 s, 70.2 MB/s 2024-04-25T09:10:39.892 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.892 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.892 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015939 s, 65.8 MB/s 2024-04-25T09:10:39.909 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.909 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.909 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146173 s, 71.7 MB/s 2024-04-25T09:10:39.925 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.925 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.925 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145005 s, 72.3 MB/s 2024-04-25T09:10:39.944 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.944 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.944 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172265 s, 60.9 MB/s 2024-04-25T09:10:39.960 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.960 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.960 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014527 s, 72.2 MB/s 2024-04-25T09:10:39.977 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:39.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:39.978 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152907 s, 68.6 MB/s 2024-04-25T09:10:40.006 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.006 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.006 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026031 s, 40.3 MB/s 2024-04-25T09:10:40.026 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.026 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.026 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184678 s, 56.8 MB/s 2024-04-25T09:10:40.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.042 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140237 s, 74.8 MB/s 2024-04-25T09:10:40.058 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.058 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.058 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145195 s, 72.2 MB/s 2024-04-25T09:10:40.076 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.076 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.076 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166444 s, 63.0 MB/s 2024-04-25T09:10:40.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.097 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186709 s, 56.2 MB/s 2024-04-25T09:10:40.114 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.114 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.114 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153578 s, 68.3 MB/s 2024-04-25T09:10:40.130 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.130 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.130 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141968 s, 73.9 MB/s 2024-04-25T09:10:40.146 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.146 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.146 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142596 s, 73.5 MB/s 2024-04-25T09:10:40.163 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.163 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.163 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149425 s, 70.2 MB/s 2024-04-25T09:10:40.182 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.183 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179099 s, 58.5 MB/s 2024-04-25T09:10:40.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.200 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155906 s, 67.3 MB/s 2024-04-25T09:10:40.216 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.216 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.216 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143993 s, 72.8 MB/s 2024-04-25T09:10:40.232 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.232 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.232 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142468 s, 73.6 MB/s 2024-04-25T09:10:40.248 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.248 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.248 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139031 s, 75.4 MB/s 2024-04-25T09:10:40.264 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.264 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.264 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136983 s, 76.5 MB/s 2024-04-25T09:10:40.279 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.279 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.279 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138334 s, 75.8 MB/s 2024-04-25T09:10:40.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:40.281 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:40.281 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:40.281 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.6 2024-04-25T09:10:40.281 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:40.281 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:40.281 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:40.281 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:40.354 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.354 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.354 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014504 s, 72.3 MB/s 2024-04-25T09:10:40.379 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.379 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.379 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233535 s, 44.9 MB/s 2024-04-25T09:10:40.395 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.395 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.395 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147077 s, 71.3 MB/s 2024-04-25T09:10:40.412 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.412 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.412 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151474 s, 69.2 MB/s 2024-04-25T09:10:40.431 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.431 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.431 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168719 s, 62.1 MB/s 2024-04-25T09:10:40.447 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.447 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.447 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140871 s, 74.4 MB/s 2024-04-25T09:10:40.465 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.465 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.465 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159855 s, 65.6 MB/s 2024-04-25T09:10:40.488 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.489 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.489 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222263 s, 47.2 MB/s 2024-04-25T09:10:40.505 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.505 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.505 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146005 s, 71.8 MB/s 2024-04-25T09:10:40.521 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.522 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146582 s, 71.5 MB/s 2024-04-25T09:10:40.537 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.537 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.537 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139263 s, 75.3 MB/s 2024-04-25T09:10:40.554 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.554 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.554 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147292 s, 71.2 MB/s 2024-04-25T09:10:40.570 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.570 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.570 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145039 s, 72.3 MB/s 2024-04-25T09:10:40.589 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.589 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.589 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170414 s, 61.5 MB/s 2024-04-25T09:10:40.607 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.608 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.608 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167897 s, 62.5 MB/s 2024-04-25T09:10:40.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.632 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225934 s, 46.4 MB/s 2024-04-25T09:10:40.648 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.648 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.648 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01404 s, 74.7 MB/s 2024-04-25T09:10:40.664 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.664 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.664 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146674 s, 71.5 MB/s 2024-04-25T09:10:40.685 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.685 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.685 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191055 s, 54.9 MB/s 2024-04-25T09:10:40.703 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.703 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.703 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164517 s, 63.7 MB/s 2024-04-25T09:10:40.725 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.725 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.725 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197168 s, 53.2 MB/s 2024-04-25T09:10:40.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.742 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014703 s, 71.3 MB/s 2024-04-25T09:10:40.757 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.757 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.757 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138948 s, 75.5 MB/s 2024-04-25T09:10:40.773 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.773 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.773 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139169 s, 75.3 MB/s 2024-04-25T09:10:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145329 s, 72.2 MB/s 2024-04-25T09:10:40.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.806 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.806 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145355 s, 72.1 MB/s 2024-04-25T09:10:40.822 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.822 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.822 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147215 s, 71.2 MB/s 2024-04-25T09:10:40.839 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.839 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.839 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146946 s, 71.4 MB/s 2024-04-25T09:10:40.852 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.852 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.853 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011969 s, 87.6 MB/s 2024-04-25T09:10:40.868 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.868 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.869 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142069 s, 73.8 MB/s 2024-04-25T09:10:40.887 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.887 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.887 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166738 s, 62.9 MB/s 2024-04-25T09:10:40.904 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.904 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.904 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148625 s, 70.6 MB/s 2024-04-25T09:10:40.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:40.905 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:40.905 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:40.905 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.7 2024-04-25T09:10:40.905 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:40.905 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:40.906 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:40.906 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:40.977 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.977 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.977 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145301 s, 72.2 MB/s 2024-04-25T09:10:40.996 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:40.997 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:40.997 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177153 s, 59.2 MB/s 2024-04-25T09:10:41.021 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.021 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.021 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228422 s, 45.9 MB/s 2024-04-25T09:10:41.037 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.038 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.038 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142772 s, 73.4 MB/s 2024-04-25T09:10:41.054 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.054 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.054 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145395 s, 72.1 MB/s 2024-04-25T09:10:41.073 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.073 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.073 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173064 s, 60.6 MB/s 2024-04-25T09:10:41.089 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.089 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.089 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014329 s, 73.2 MB/s 2024-04-25T09:10:41.103 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.103 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.103 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119469 s, 87.8 MB/s 2024-04-25T09:10:41.122 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.122 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.122 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177357 s, 59.1 MB/s 2024-04-25T09:10:41.141 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.141 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.141 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171047 s, 61.3 MB/s 2024-04-25T09:10:41.157 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.157 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.157 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145886 s, 71.9 MB/s 2024-04-25T09:10:41.176 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.176 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.176 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165399 s, 63.4 MB/s 2024-04-25T09:10:41.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.192 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147271 s, 71.2 MB/s 2024-04-25T09:10:41.211 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.211 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.211 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170893 s, 61.4 MB/s 2024-04-25T09:10:41.228 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.228 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.228 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151135 s, 69.4 MB/s 2024-04-25T09:10:41.244 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.245 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.245 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145894 s, 71.9 MB/s 2024-04-25T09:10:41.260 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.260 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.260 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133546 s, 78.5 MB/s 2024-04-25T09:10:41.275 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.275 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.275 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130115 s, 80.6 MB/s 2024-04-25T09:10:41.290 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.290 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.290 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140709 s, 74.5 MB/s 2024-04-25T09:10:41.310 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.310 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.310 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176543 s, 59.4 MB/s 2024-04-25T09:10:41.326 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.326 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.327 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148477 s, 70.6 MB/s 2024-04-25T09:10:41.345 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.346 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.346 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172424 s, 60.8 MB/s 2024-04-25T09:10:41.362 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.362 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.362 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143538 s, 73.1 MB/s 2024-04-25T09:10:41.382 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.382 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.382 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187945 s, 55.8 MB/s 2024-04-25T09:10:41.401 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.401 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.401 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170672 s, 61.4 MB/s 2024-04-25T09:10:41.418 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.418 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.418 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148899 s, 70.4 MB/s 2024-04-25T09:10:41.434 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.435 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.435 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149489 s, 70.1 MB/s 2024-04-25T09:10:41.455 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.455 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.455 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185011 s, 56.7 MB/s 2024-04-25T09:10:41.473 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.473 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.474 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167373 s, 62.6 MB/s 2024-04-25T09:10:41.491 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.491 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.491 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015435 s, 67.9 MB/s 2024-04-25T09:10:41.508 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.508 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.508 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150889 s, 69.5 MB/s 2024-04-25T09:10:41.526 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.527 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.527 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170128 s, 61.6 MB/s 2024-04-25T09:10:41.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:41.528 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:41.528 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:41.528 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.8 2024-04-25T09:10:41.528 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:41.528 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:41.528 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:41.528 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:41.598 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.598 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.598 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014967 s, 70.1 MB/s 2024-04-25T09:10:41.614 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.614 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.615 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150338 s, 69.7 MB/s 2024-04-25T09:10:41.631 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.631 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.631 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151759 s, 69.1 MB/s 2024-04-25T09:10:41.649 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.649 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.649 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154692 s, 67.8 MB/s 2024-04-25T09:10:41.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.665 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143629 s, 73.0 MB/s 2024-04-25T09:10:41.682 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.682 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.682 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151243 s, 69.3 MB/s 2024-04-25T09:10:41.699 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.699 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.699 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015348 s, 68.3 MB/s 2024-04-25T09:10:41.717 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.717 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.717 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162339 s, 64.6 MB/s 2024-04-25T09:10:41.733 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.733 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.733 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145472 s, 72.1 MB/s 2024-04-25T09:10:41.757 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.757 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.757 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220871 s, 47.5 MB/s 2024-04-25T09:10:41.773 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.773 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.773 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145325 s, 72.2 MB/s 2024-04-25T09:10:41.790 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.790 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.790 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147697 s, 71.0 MB/s 2024-04-25T09:10:41.806 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.806 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.806 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145084 s, 72.3 MB/s 2024-04-25T09:10:41.822 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.822 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.822 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143235 s, 73.2 MB/s 2024-04-25T09:10:41.844 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.844 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.844 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198118 s, 52.9 MB/s 2024-04-25T09:10:41.863 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.863 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.863 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167473 s, 62.6 MB/s 2024-04-25T09:10:41.879 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.879 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.879 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148386 s, 70.7 MB/s 2024-04-25T09:10:41.895 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.895 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.896 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142851 s, 73.4 MB/s 2024-04-25T09:10:41.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.914 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170386 s, 61.5 MB/s 2024-04-25T09:10:41.929 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.929 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.929 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125835 s, 83.3 MB/s 2024-04-25T09:10:41.945 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.945 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.945 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143531 s, 73.1 MB/s 2024-04-25T09:10:41.966 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.966 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.966 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197591 s, 53.1 MB/s 2024-04-25T09:10:41.983 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:41.984 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:41.984 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156439 s, 67.0 MB/s 2024-04-25T09:10:42.002 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.002 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.002 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167457 s, 62.6 MB/s 2024-04-25T09:10:42.018 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.018 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.018 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144034 s, 72.8 MB/s 2024-04-25T09:10:42.041 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.041 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.041 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206021 s, 50.9 MB/s 2024-04-25T09:10:42.057 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.057 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.057 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145239 s, 72.2 MB/s 2024-04-25T09:10:42.074 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.074 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.074 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148255 s, 70.7 MB/s 2024-04-25T09:10:42.090 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.091 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.091 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151943 s, 69.0 MB/s 2024-04-25T09:10:42.107 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.107 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.107 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149617 s, 70.1 MB/s 2024-04-25T09:10:42.128 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.128 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.128 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192842 s, 54.4 MB/s 2024-04-25T09:10:42.146 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.146 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.146 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157122 s, 66.7 MB/s 2024-04-25T09:10:42.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:42.147 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:42.147 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:42.147 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.9 2024-04-25T09:10:42.147 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:42.147 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:42.148 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:42.148 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:42.221 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.221 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.221 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185059 s, 56.7 MB/s 2024-04-25T09:10:42.237 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.237 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.237 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145485 s, 72.1 MB/s 2024-04-25T09:10:42.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.258 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183187 s, 57.2 MB/s 2024-04-25T09:10:42.273 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.273 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.273 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141705 s, 74.0 MB/s 2024-04-25T09:10:42.297 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.297 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.297 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022073 s, 47.5 MB/s 2024-04-25T09:10:42.316 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.317 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.317 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177212 s, 59.2 MB/s 2024-04-25T09:10:42.334 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.334 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.334 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157014 s, 66.8 MB/s 2024-04-25T09:10:42.351 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.351 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.351 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146919 s, 71.4 MB/s 2024-04-25T09:10:42.368 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.368 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.368 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015618 s, 67.1 MB/s 2024-04-25T09:10:42.394 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.394 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.394 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238284 s, 44.0 MB/s 2024-04-25T09:10:42.414 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.414 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.414 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180949 s, 57.9 MB/s 2024-04-25T09:10:42.429 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.429 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.430 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138275 s, 75.8 MB/s 2024-04-25T09:10:42.446 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.446 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.446 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147946 s, 70.9 MB/s 2024-04-25T09:10:42.467 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.468 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.468 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197681 s, 53.0 MB/s 2024-04-25T09:10:42.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.484 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148606 s, 70.6 MB/s 2024-04-25T09:10:42.505 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.506 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.506 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198324 s, 52.9 MB/s 2024-04-25T09:10:42.521 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.521 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.521 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140128 s, 74.8 MB/s 2024-04-25T09:10:42.537 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.537 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.537 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01427 s, 73.5 MB/s 2024-04-25T09:10:42.554 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.554 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.554 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014396 s, 72.8 MB/s 2024-04-25T09:10:42.571 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.571 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.571 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015136 s, 69.3 MB/s 2024-04-25T09:10:42.595 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.595 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.595 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228316 s, 45.9 MB/s 2024-04-25T09:10:42.616 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.616 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.616 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191571 s, 54.7 MB/s 2024-04-25T09:10:42.633 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.633 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.633 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147776 s, 71.0 MB/s 2024-04-25T09:10:42.649 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.649 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.649 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139776 s, 75.0 MB/s 2024-04-25T09:10:42.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.667 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164323 s, 63.8 MB/s 2024-04-25T09:10:42.683 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.683 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.683 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144678 s, 72.5 MB/s 2024-04-25T09:10:42.700 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.700 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.700 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151836 s, 69.1 MB/s 2024-04-25T09:10:42.721 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.721 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.721 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187092 s, 56.0 MB/s 2024-04-25T09:10:42.737 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.737 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.737 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142064 s, 73.8 MB/s 2024-04-25T09:10:42.752 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.752 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.753 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138807 s, 75.5 MB/s 2024-04-25T09:10:42.772 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.772 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.772 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177606 s, 59.0 MB/s 2024-04-25T09:10:42.793 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.793 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.793 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186661 s, 56.2 MB/s 2024-04-25T09:10:42.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:42.794 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:42.795 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:42.795 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.10 2024-04-25T09:10:42.795 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:42.795 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:42.795 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:42.795 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:42.868 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.868 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.868 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137186 s, 76.4 MB/s 2024-04-25T09:10:42.885 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.885 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.885 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146559 s, 71.5 MB/s 2024-04-25T09:10:42.902 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.902 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.902 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150917 s, 69.5 MB/s 2024-04-25T09:10:42.918 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.918 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.918 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148615 s, 70.6 MB/s 2024-04-25T09:10:42.939 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.939 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.939 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189048 s, 55.5 MB/s 2024-04-25T09:10:42.956 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.956 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.956 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147249 s, 71.2 MB/s 2024-04-25T09:10:42.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.978 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204547 s, 51.3 MB/s 2024-04-25T09:10:42.994 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:42.994 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:42.994 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148643 s, 70.5 MB/s 2024-04-25T09:10:43.011 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.012 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.012 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154948 s, 67.7 MB/s 2024-04-25T09:10:43.031 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.031 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.031 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173583 s, 60.4 MB/s 2024-04-25T09:10:43.047 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.047 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.047 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146883 s, 71.4 MB/s 2024-04-25T09:10:43.064 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.065 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.065 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152274 s, 68.9 MB/s 2024-04-25T09:10:43.088 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.088 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.088 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222052 s, 47.2 MB/s 2024-04-25T09:10:43.104 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.104 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.105 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143935 s, 72.9 MB/s 2024-04-25T09:10:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140933 s, 74.4 MB/s 2024-04-25T09:10:43.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.140 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174196 s, 60.2 MB/s 2024-04-25T09:10:43.158 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.158 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.158 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016669 s, 62.9 MB/s 2024-04-25T09:10:43.176 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.176 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.176 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164355 s, 63.8 MB/s 2024-04-25T09:10:43.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.192 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143969 s, 72.8 MB/s 2024-04-25T09:10:43.212 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.212 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.213 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181861 s, 57.7 MB/s 2024-04-25T09:10:43.229 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.229 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.229 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145213 s, 72.2 MB/s 2024-04-25T09:10:43.250 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.250 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.251 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196797 s, 53.3 MB/s 2024-04-25T09:10:43.266 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.266 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.267 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141326 s, 74.2 MB/s 2024-04-25T09:10:43.281 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.281 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.281 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124222 s, 84.4 MB/s 2024-04-25T09:10:43.301 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.302 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.302 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191713 s, 54.7 MB/s 2024-04-25T09:10:43.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.324 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199413 s, 52.6 MB/s 2024-04-25T09:10:43.343 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.343 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.344 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182894 s, 57.3 MB/s 2024-04-25T09:10:43.359 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.359 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.359 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140261 s, 74.8 MB/s 2024-04-25T09:10:43.376 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.376 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.376 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149878 s, 70.0 MB/s 2024-04-25T09:10:43.392 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.392 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.392 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146647 s, 71.5 MB/s 2024-04-25T09:10:43.408 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.408 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.408 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143214 s, 73.2 MB/s 2024-04-25T09:10:43.426 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.426 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.426 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015804 s, 66.3 MB/s 2024-04-25T09:10:43.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:43.427 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:43.427 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:43.428 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.11 2024-04-25T09:10:43.428 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:43.428 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:43.428 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:43.428 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:43.502 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.502 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.502 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159607 s, 65.7 MB/s 2024-04-25T09:10:43.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.522 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178508 s, 58.7 MB/s 2024-04-25T09:10:43.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.540 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166967 s, 62.8 MB/s 2024-04-25T09:10:43.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.556 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143465 s, 73.1 MB/s 2024-04-25T09:10:43.577 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.577 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.577 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191189 s, 54.8 MB/s 2024-04-25T09:10:43.594 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.594 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.594 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014644 s, 71.6 MB/s 2024-04-25T09:10:43.610 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.610 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.610 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144571 s, 72.5 MB/s 2024-04-25T09:10:43.627 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.627 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.627 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146151 s, 71.7 MB/s 2024-04-25T09:10:43.643 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.643 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.643 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142899 s, 73.4 MB/s 2024-04-25T09:10:43.664 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.664 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.664 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197493 s, 53.1 MB/s 2024-04-25T09:10:43.685 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.685 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.685 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186047 s, 56.4 MB/s 2024-04-25T09:10:43.700 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.701 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.701 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142792 s, 73.4 MB/s 2024-04-25T09:10:43.717 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.717 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.717 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145505 s, 72.1 MB/s 2024-04-25T09:10:43.735 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.735 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.735 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162219 s, 64.6 MB/s 2024-04-25T09:10:43.751 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.752 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.752 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148376 s, 70.7 MB/s 2024-04-25T09:10:43.768 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.768 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.768 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143837 s, 72.9 MB/s 2024-04-25T09:10:43.783 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.783 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.783 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139426 s, 75.2 MB/s 2024-04-25T09:10:43.806 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.806 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.807 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212041 s, 49.5 MB/s 2024-04-25T09:10:43.823 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.823 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.823 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014869 s, 70.5 MB/s 2024-04-25T09:10:43.847 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.847 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.847 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223106 s, 47.0 MB/s 2024-04-25T09:10:43.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.865 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163934 s, 64.0 MB/s 2024-04-25T09:10:43.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.882 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148751 s, 70.5 MB/s 2024-04-25T09:10:43.900 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.900 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.900 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160593 s, 65.3 MB/s 2024-04-25T09:10:43.920 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.920 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.920 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185679 s, 56.5 MB/s 2024-04-25T09:10:43.936 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.936 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.936 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144327 s, 72.7 MB/s 2024-04-25T09:10:43.950 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.950 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.950 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119867 s, 87.5 MB/s 2024-04-25T09:10:43.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.968 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155675 s, 67.4 MB/s 2024-04-25T09:10:43.988 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:43.989 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:43.989 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193869 s, 54.1 MB/s 2024-04-25T09:10:44.005 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.005 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.005 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145073 s, 72.3 MB/s 2024-04-25T09:10:44.021 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.021 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.021 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147054 s, 71.3 MB/s 2024-04-25T09:10:44.039 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.039 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.039 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160052 s, 65.5 MB/s 2024-04-25T09:10:44.059 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.059 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.059 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181957 s, 57.6 MB/s 2024-04-25T09:10:44.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:44.061 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:44.061 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:44.061 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.12 2024-04-25T09:10:44.061 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:44.061 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:44.061 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:44.061 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:44.145 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.145 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.145 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303273 s, 34.6 MB/s 2024-04-25T09:10:44.163 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.163 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.163 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166011 s, 63.2 MB/s 2024-04-25T09:10:44.191 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.191 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.191 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256728 s, 40.8 MB/s 2024-04-25T09:10:44.210 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.210 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.210 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016853 s, 62.2 MB/s 2024-04-25T09:10:44.230 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.230 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.230 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182554 s, 57.4 MB/s 2024-04-25T09:10:44.246 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.246 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.246 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144215 s, 72.7 MB/s 2024-04-25T09:10:44.264 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.264 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.264 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167073 s, 62.8 MB/s 2024-04-25T09:10:44.282 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.282 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.282 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157177 s, 66.7 MB/s 2024-04-25T09:10:44.299 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.299 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.299 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153049 s, 68.5 MB/s 2024-04-25T09:10:44.321 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.321 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.321 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193918 s, 54.1 MB/s 2024-04-25T09:10:44.342 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.342 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.342 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019517 s, 53.7 MB/s 2024-04-25T09:10:44.361 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.361 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.361 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017556 s, 59.7 MB/s 2024-04-25T09:10:44.379 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.379 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.380 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164442 s, 63.8 MB/s 2024-04-25T09:10:44.395 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.396 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.396 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144325 s, 72.7 MB/s 2024-04-25T09:10:44.418 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.418 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.418 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204967 s, 51.2 MB/s 2024-04-25T09:10:44.434 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.434 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.434 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147564 s, 71.1 MB/s 2024-04-25T09:10:44.453 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.454 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.454 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176226 s, 59.5 MB/s 2024-04-25T09:10:44.473 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.473 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.473 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171469 s, 61.2 MB/s 2024-04-25T09:10:44.493 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.493 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.493 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191192 s, 54.8 MB/s 2024-04-25T09:10:44.511 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.511 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164444 s, 63.8 MB/s 2024-04-25T09:10:44.524 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.525 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.525 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113368 s, 92.5 MB/s 2024-04-25T09:10:44.542 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.542 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.542 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158938 s, 66.0 MB/s 2024-04-25T09:10:44.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.559 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147112 s, 71.3 MB/s 2024-04-25T09:10:44.577 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.577 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.577 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162416 s, 64.6 MB/s 2024-04-25T09:10:44.593 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.593 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.593 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147296 s, 71.2 MB/s 2024-04-25T09:10:44.612 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.612 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.612 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167359 s, 62.7 MB/s 2024-04-25T09:10:44.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.628 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146153 s, 71.7 MB/s 2024-04-25T09:10:44.646 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.646 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.646 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158729 s, 66.1 MB/s 2024-04-25T09:10:44.662 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.663 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.663 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148478 s, 70.6 MB/s 2024-04-25T09:10:44.678 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.679 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.679 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014252 s, 73.6 MB/s 2024-04-25T09:10:44.696 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.697 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.697 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160462 s, 65.3 MB/s 2024-04-25T09:10:44.715 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.715 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.715 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169676 s, 61.8 MB/s 2024-04-25T09:10:44.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:44.717 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:44.717 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:44.717 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.13 2024-04-25T09:10:44.717 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:44.717 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:44.718 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:44.718 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:44.785 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.785 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.785 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145217 s, 72.2 MB/s 2024-04-25T09:10:44.803 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.803 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.803 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168394 s, 62.3 MB/s 2024-04-25T09:10:44.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.821 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154276 s, 68.0 MB/s 2024-04-25T09:10:44.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.838 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152603 s, 68.7 MB/s 2024-04-25T09:10:44.855 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.856 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.856 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160949 s, 65.1 MB/s 2024-04-25T09:10:44.876 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.876 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.876 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186166 s, 56.3 MB/s 2024-04-25T09:10:44.897 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.897 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.897 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190567 s, 55.0 MB/s 2024-04-25T09:10:44.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.913 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013897 s, 75.5 MB/s 2024-04-25T09:10:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183928 s, 57.0 MB/s 2024-04-25T09:10:44.949 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.949 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.949 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144632 s, 72.5 MB/s 2024-04-25T09:10:44.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.969 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179167 s, 58.5 MB/s 2024-04-25T09:10:44.986 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:44.986 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:44.986 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151951 s, 69.0 MB/s 2024-04-25T09:10:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145059 s, 72.3 MB/s 2024-04-25T09:10:45.021 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.021 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.021 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172772 s, 60.7 MB/s 2024-04-25T09:10:45.040 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.041 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.041 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176183 s, 59.5 MB/s 2024-04-25T09:10:45.059 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.059 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.059 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166197 s, 63.1 MB/s 2024-04-25T09:10:45.076 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.076 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.076 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147281 s, 71.2 MB/s 2024-04-25T09:10:45.094 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.094 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.094 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166972 s, 62.8 MB/s 2024-04-25T09:10:45.100 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:10:45.103 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:10:45.111 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.111 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.111 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150957 s, 69.5 MB/s 2024-04-25T09:10:45.131 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.131 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.131 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180759 s, 58.0 MB/s 2024-04-25T09:10:45.154 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.154 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.154 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214977 s, 48.8 MB/s 2024-04-25T09:10:45.170 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.170 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.170 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143809 s, 72.9 MB/s 2024-04-25T09:10:45.191 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.192 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197326 s, 53.1 MB/s 2024-04-25T09:10:45.208 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.208 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.208 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148432 s, 70.6 MB/s 2024-04-25T09:10:45.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.225 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.225 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148087 s, 70.8 MB/s 2024-04-25T09:10:45.245 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.245 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.245 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182053 s, 57.6 MB/s 2024-04-25T09:10:45.262 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.262 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.262 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152967 s, 68.5 MB/s 2024-04-25T09:10:45.281 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.281 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.281 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176825 s, 59.3 MB/s 2024-04-25T09:10:45.297 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.297 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.297 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142358 s, 73.7 MB/s 2024-04-25T09:10:45.316 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.316 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.316 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169398 s, 61.9 MB/s 2024-04-25T09:10:45.332 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.332 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.332 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142527 s, 73.6 MB/s 2024-04-25T09:10:45.348 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.348 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.348 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137174 s, 76.4 MB/s 2024-04-25T09:10:45.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:45.349 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:45.349 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:45.349 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.14 2024-04-25T09:10:45.350 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:45.350 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:45.350 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:45.350 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:45.417 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.417 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.417 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150999 s, 69.4 MB/s 2024-04-25T09:10:45.433 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.433 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.433 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140949 s, 74.4 MB/s 2024-04-25T09:10:45.452 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.452 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.453 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175732 s, 59.7 MB/s 2024-04-25T09:10:45.474 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.474 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.474 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200901 s, 52.2 MB/s 2024-04-25T09:10:45.496 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.496 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.496 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199412 s, 52.6 MB/s 2024-04-25T09:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217124 s, 48.3 MB/s 2024-04-25T09:10:45.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.540 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187499 s, 55.9 MB/s 2024-04-25T09:10:45.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.557 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143791 s, 72.9 MB/s 2024-04-25T09:10:45.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.578 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196417 s, 53.4 MB/s 2024-04-25T09:10:45.594 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.595 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.595 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146599 s, 71.5 MB/s 2024-04-25T09:10:45.611 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.611 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.611 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148758 s, 70.5 MB/s 2024-04-25T09:10:45.630 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.630 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.631 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175289 s, 59.8 MB/s 2024-04-25T09:10:45.649 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.649 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.649 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169686 s, 61.8 MB/s 2024-04-25T09:10:45.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.665 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143762 s, 72.9 MB/s 2024-04-25T09:10:45.686 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.686 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.686 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186122 s, 56.3 MB/s 2024-04-25T09:10:45.702 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.702 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.702 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145097 s, 72.3 MB/s 2024-04-25T09:10:45.723 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.723 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.723 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189053 s, 55.5 MB/s 2024-04-25T09:10:45.743 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.743 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.743 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184008 s, 57.0 MB/s 2024-04-25T09:10:45.756 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.756 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.756 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116766 s, 89.8 MB/s 2024-04-25T09:10:45.773 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.773 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.773 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146261 s, 71.7 MB/s 2024-04-25T09:10:45.789 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.789 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.789 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144142 s, 72.7 MB/s 2024-04-25T09:10:45.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.805 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141371 s, 74.2 MB/s 2024-04-25T09:10:45.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.821 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141798 s, 73.9 MB/s 2024-04-25T09:10:45.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.837 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146147 s, 71.7 MB/s 2024-04-25T09:10:45.857 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.858 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185928 s, 56.4 MB/s 2024-04-25T09:10:45.878 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.878 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.878 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190921 s, 54.9 MB/s 2024-04-25T09:10:45.895 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.895 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.895 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147445 s, 71.1 MB/s 2024-04-25T09:10:45.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.912 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151019 s, 69.4 MB/s 2024-04-25T09:10:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173673 s, 60.4 MB/s 2024-04-25T09:10:45.947 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.947 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.947 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144929 s, 72.4 MB/s 2024-04-25T09:10:45.963 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.963 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.964 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014466 s, 72.5 MB/s 2024-04-25T09:10:45.984 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:45.984 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:45.984 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185653 s, 56.5 MB/s 2024-04-25T09:10:45.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:45.986 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:45.986 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:45.986 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.15 2024-04-25T09:10:45.986 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:45.986 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:45.986 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:45.986 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:46.064 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.064 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.065 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178387 s, 58.8 MB/s 2024-04-25T09:10:46.079 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.079 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.079 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124609 s, 84.1 MB/s 2024-04-25T09:10:46.095 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.095 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.095 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145385 s, 72.1 MB/s 2024-04-25T09:10:46.112 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.112 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.112 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148612 s, 70.6 MB/s 2024-04-25T09:10:46.128 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.128 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.128 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143301 s, 73.2 MB/s 2024-04-25T09:10:46.143 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.144 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.144 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139263 s, 75.3 MB/s 2024-04-25T09:10:46.161 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.161 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.161 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160017 s, 65.5 MB/s 2024-04-25T09:10:46.182 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.182 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.182 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190723 s, 55.0 MB/s 2024-04-25T09:10:46.203 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.203 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.203 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190998 s, 54.9 MB/s 2024-04-25T09:10:46.218 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.218 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.219 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139753 s, 75.0 MB/s 2024-04-25T09:10:46.236 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.237 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.237 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162794 s, 64.4 MB/s 2024-04-25T09:10:46.254 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.255 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.255 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162286 s, 64.6 MB/s 2024-04-25T09:10:46.276 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.276 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.277 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201878 s, 51.9 MB/s 2024-04-25T09:10:46.301 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.301 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.301 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022436 s, 46.7 MB/s 2024-04-25T09:10:46.319 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.319 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.319 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161509 s, 64.9 MB/s 2024-04-25T09:10:46.335 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.335 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.335 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015036 s, 69.7 MB/s 2024-04-25T09:10:46.354 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.354 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.354 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166722 s, 62.9 MB/s 2024-04-25T09:10:46.370 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.370 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.370 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147585 s, 71.0 MB/s 2024-04-25T09:10:46.387 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.387 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.388 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151108 s, 69.4 MB/s 2024-04-25T09:10:46.404 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.404 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.404 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147676 s, 71.0 MB/s 2024-04-25T09:10:46.421 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.422 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.422 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01597 s, 65.7 MB/s 2024-04-25T09:10:46.438 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.438 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.438 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147091 s, 71.3 MB/s 2024-04-25T09:10:46.463 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.463 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.463 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227194 s, 46.2 MB/s 2024-04-25T09:10:46.478 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.478 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.478 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138348 s, 75.8 MB/s 2024-04-25T09:10:46.498 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.499 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.499 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184822 s, 56.7 MB/s 2024-04-25T09:10:46.515 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.515 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.515 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014744 s, 71.1 MB/s 2024-04-25T09:10:46.531 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.531 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.531 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145138 s, 72.2 MB/s 2024-04-25T09:10:46.550 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.550 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.550 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169045 s, 62.0 MB/s 2024-04-25T09:10:46.566 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.566 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.566 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144888 s, 72.4 MB/s 2024-04-25T09:10:46.583 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.583 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.583 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146903 s, 71.4 MB/s 2024-04-25T09:10:46.599 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.599 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.599 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147346 s, 71.2 MB/s 2024-04-25T09:10:46.615 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.616 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.616 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143172 s, 73.2 MB/s 2024-04-25T09:10:46.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:46.617 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:46.617 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:46.617 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.16 2024-04-25T09:10:46.617 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:46.617 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:46.617 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:46.617 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:46.687 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.687 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.687 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168259 s, 62.3 MB/s 2024-04-25T09:10:46.704 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.704 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.704 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015041 s, 69.7 MB/s 2024-04-25T09:10:46.720 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.720 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.720 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145438 s, 72.1 MB/s 2024-04-25T09:10:46.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.739 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173588 s, 60.4 MB/s 2024-04-25T09:10:46.757 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.757 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.757 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158239 s, 66.3 MB/s 2024-04-25T09:10:46.773 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.773 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.773 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140408 s, 74.7 MB/s 2024-04-25T09:10:46.790 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.790 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.790 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151752 s, 69.1 MB/s 2024-04-25T09:10:46.808 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.808 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.808 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161092 s, 65.1 MB/s 2024-04-25T09:10:46.824 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.824 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.824 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148692 s, 70.5 MB/s 2024-04-25T09:10:46.841 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.842 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.842 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153834 s, 68.2 MB/s 2024-04-25T09:10:46.866 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.866 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.866 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223639 s, 46.9 MB/s 2024-04-25T09:10:46.886 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.886 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.886 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187129 s, 56.0 MB/s 2024-04-25T09:10:46.902 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.903 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.903 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147632 s, 71.0 MB/s 2024-04-25T09:10:46.919 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.919 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.919 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014387 s, 72.9 MB/s 2024-04-25T09:10:46.936 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.936 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.937 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160178 s, 65.5 MB/s 2024-04-25T09:10:46.956 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.956 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.956 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181475 s, 57.8 MB/s 2024-04-25T09:10:46.975 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.975 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.975 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167255 s, 62.7 MB/s 2024-04-25T09:10:46.991 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:46.991 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:46.991 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142799 s, 73.4 MB/s 2024-04-25T09:10:47.004 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.004 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.004 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113657 s, 92.3 MB/s 2024-04-25T09:10:47.021 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.021 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.021 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147056 s, 71.3 MB/s 2024-04-25T09:10:47.038 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.038 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.038 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158653 s, 66.1 MB/s 2024-04-25T09:10:47.055 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.055 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.055 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148595 s, 70.6 MB/s 2024-04-25T09:10:47.073 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.073 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.073 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161323 s, 65.0 MB/s 2024-04-25T09:10:47.089 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.089 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.089 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144743 s, 72.4 MB/s 2024-04-25T09:10:47.107 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.107 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.107 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159126 s, 65.9 MB/s 2024-04-25T09:10:47.127 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.127 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.127 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183922 s, 57.0 MB/s 2024-04-25T09:10:47.146 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.146 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.146 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175536 s, 59.7 MB/s 2024-04-25T09:10:47.165 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.165 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.165 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166608 s, 62.9 MB/s 2024-04-25T09:10:47.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.183 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164294 s, 63.8 MB/s 2024-04-25T09:10:47.199 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.200 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149843 s, 70.0 MB/s 2024-04-25T09:10:47.215 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.216 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.216 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141459 s, 74.1 MB/s 2024-04-25T09:10:47.232 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.232 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.232 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148653 s, 70.5 MB/s 2024-04-25T09:10:47.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:47.234 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:47.234 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:47.235 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.17 2024-04-25T09:10:47.235 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:47.235 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:47.235 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:47.235 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:47.305 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.305 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.305 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014841 s, 70.7 MB/s 2024-04-25T09:10:47.324 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.324 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.324 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168587 s, 62.2 MB/s 2024-04-25T09:10:47.338 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.338 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.338 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124276 s, 84.4 MB/s 2024-04-25T09:10:47.355 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.355 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.356 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155947 s, 67.2 MB/s 2024-04-25T09:10:47.379 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.379 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.379 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216772 s, 48.4 MB/s 2024-04-25T09:10:47.396 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.396 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.396 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148893 s, 70.4 MB/s 2024-04-25T09:10:47.414 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.414 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.414 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164695 s, 63.7 MB/s 2024-04-25T09:10:47.431 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.431 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.432 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157314 s, 66.7 MB/s 2024-04-25T09:10:47.451 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.451 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.451 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177672 s, 59.0 MB/s 2024-04-25T09:10:47.467 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.467 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.467 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146728 s, 71.5 MB/s 2024-04-25T09:10:47.485 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.485 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.485 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163172 s, 64.3 MB/s 2024-04-25T09:10:47.506 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.506 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.506 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189074 s, 55.5 MB/s 2024-04-25T09:10:47.523 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.523 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.523 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154274 s, 68.0 MB/s 2024-04-25T09:10:47.539 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.539 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.539 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145492 s, 72.1 MB/s 2024-04-25T09:10:47.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.556 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150064 s, 69.9 MB/s 2024-04-25T09:10:47.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.576 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178636 s, 58.7 MB/s 2024-04-25T09:10:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180647 s, 58.0 MB/s 2024-04-25T09:10:47.611 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.612 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.612 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142553 s, 73.6 MB/s 2024-04-25T09:10:47.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.628 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01429 s, 73.4 MB/s 2024-04-25T09:10:47.641 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.641 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.641 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112053 s, 93.6 MB/s 2024-04-25T09:10:47.657 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.657 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.657 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142717 s, 73.5 MB/s 2024-04-25T09:10:47.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.673 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.673 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140376 s, 74.7 MB/s 2024-04-25T09:10:47.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.691 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161013 s, 65.1 MB/s 2024-04-25T09:10:47.707 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.707 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.707 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144457 s, 72.6 MB/s 2024-04-25T09:10:47.723 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.723 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.723 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015068 s, 69.6 MB/s 2024-04-25T09:10:47.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.741 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155104 s, 67.6 MB/s 2024-04-25T09:10:47.757 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.757 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.757 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141365 s, 74.2 MB/s 2024-04-25T09:10:47.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.777 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018295 s, 57.3 MB/s 2024-04-25T09:10:47.797 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.797 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.797 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181975 s, 57.6 MB/s 2024-04-25T09:10:47.816 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.817 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.817 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181087 s, 57.9 MB/s 2024-04-25T09:10:47.833 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.833 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.833 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143501 s, 73.1 MB/s 2024-04-25T09:10:47.849 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.849 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.849 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147317 s, 71.2 MB/s 2024-04-25T09:10:47.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:47.851 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:47.851 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:47.851 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.18 2024-04-25T09:10:47.851 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:47.851 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:47.851 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:47.851 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:47.922 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.922 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.922 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143309 s, 73.2 MB/s 2024-04-25T09:10:47.939 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.939 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.939 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149713 s, 70.0 MB/s 2024-04-25T09:10:47.957 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.957 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.957 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170949 s, 61.3 MB/s 2024-04-25T09:10:47.979 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.979 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.979 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020214 s, 51.9 MB/s 2024-04-25T09:10:47.999 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:47.999 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:47.999 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174514 s, 60.1 MB/s 2024-04-25T09:10:48.016 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.016 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.016 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015181 s, 69.1 MB/s 2024-04-25T09:10:48.032 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.032 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.032 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141115 s, 74.3 MB/s 2024-04-25T09:10:48.048 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.048 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.049 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149845 s, 70.0 MB/s 2024-04-25T09:10:48.065 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.065 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.065 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148729 s, 70.5 MB/s 2024-04-25T09:10:48.084 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.084 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.084 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165364 s, 63.4 MB/s 2024-04-25T09:10:48.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.100 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143973 s, 72.8 MB/s 2024-04-25T09:10:48.116 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.116 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.116 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143816 s, 72.9 MB/s 2024-04-25T09:10:48.139 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.139 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.139 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211314 s, 49.6 MB/s 2024-04-25T09:10:48.155 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.155 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.155 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145148 s, 72.2 MB/s 2024-04-25T09:10:48.177 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.177 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.177 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197912 s, 53.0 MB/s 2024-04-25T09:10:48.197 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.197 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.197 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181582 s, 57.7 MB/s 2024-04-25T09:10:48.215 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.215 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.215 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163417 s, 64.2 MB/s 2024-04-25T09:10:48.235 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.235 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.235 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182861 s, 57.3 MB/s 2024-04-25T09:10:48.253 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.253 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.253 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168931 s, 62.1 MB/s 2024-04-25T09:10:48.270 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.270 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.270 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145577 s, 72.0 MB/s 2024-04-25T09:10:48.287 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.287 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.287 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152964 s, 68.6 MB/s 2024-04-25T09:10:48.307 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.307 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.307 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184046 s, 57.0 MB/s 2024-04-25T09:10:48.328 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.328 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.328 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191145 s, 54.9 MB/s 2024-04-25T09:10:48.344 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.344 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.344 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014227 s, 73.7 MB/s 2024-04-25T09:10:48.366 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.366 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.366 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200752 s, 52.2 MB/s 2024-04-25T09:10:48.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.386 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177781 s, 59.0 MB/s 2024-04-25T09:10:48.402 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.402 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.402 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147139 s, 71.3 MB/s 2024-04-25T09:10:48.419 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.419 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.419 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150502 s, 69.7 MB/s 2024-04-25T09:10:48.443 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.443 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.443 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021678 s, 48.4 MB/s 2024-04-25T09:10:48.460 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.460 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.460 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151843 s, 69.1 MB/s 2024-04-25T09:10:48.480 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.480 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.480 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183952 s, 57.0 MB/s 2024-04-25T09:10:48.498 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.499 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.499 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168912 s, 62.1 MB/s 2024-04-25T09:10:48.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:48.500 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:48.501 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:48.501 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.19 2024-04-25T09:10:48.501 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:48.501 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:48.501 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:48.501 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:48.574 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.574 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.574 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189348 s, 55.4 MB/s 2024-04-25T09:10:48.591 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.591 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.591 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155373 s, 67.5 MB/s 2024-04-25T09:10:48.610 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.610 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.610 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169052 s, 62.0 MB/s 2024-04-25T09:10:48.626 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.627 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.627 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152611 s, 68.7 MB/s 2024-04-25T09:10:48.645 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.645 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.645 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165975 s, 63.2 MB/s 2024-04-25T09:10:48.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.661 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146437 s, 71.6 MB/s 2024-04-25T09:10:48.682 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.682 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.682 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018754 s, 55.9 MB/s 2024-04-25T09:10:48.698 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.699 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.699 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151936 s, 69.0 MB/s 2024-04-25T09:10:48.717 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.717 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.717 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168722 s, 62.1 MB/s 2024-04-25T09:10:48.734 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.734 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.734 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152132 s, 68.9 MB/s 2024-04-25T09:10:48.756 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.756 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.756 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200209 s, 52.4 MB/s 2024-04-25T09:10:48.774 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.774 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.775 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167148 s, 62.7 MB/s 2024-04-25T09:10:48.791 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.791 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.791 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151393 s, 69.3 MB/s 2024-04-25T09:10:48.811 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.811 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.811 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180117 s, 58.2 MB/s 2024-04-25T09:10:48.828 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.828 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.828 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147878 s, 70.9 MB/s 2024-04-25T09:10:48.849 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.849 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.849 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190964 s, 54.9 MB/s 2024-04-25T09:10:48.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.865 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143406 s, 73.1 MB/s 2024-04-25T09:10:48.881 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.881 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.882 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147616 s, 71.0 MB/s 2024-04-25T09:10:48.895 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.895 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.895 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117332 s, 89.4 MB/s 2024-04-25T09:10:48.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.912 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150385 s, 69.7 MB/s 2024-04-25T09:10:48.928 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.928 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.928 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139623 s, 75.1 MB/s 2024-04-25T09:10:48.944 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.944 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.944 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144824 s, 72.4 MB/s 2024-04-25T09:10:48.964 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.964 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.964 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185057 s, 56.7 MB/s 2024-04-25T09:10:48.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:48.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:48.987 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206339 s, 50.8 MB/s 2024-04-25T09:10:49.007 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.007 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.007 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178208 s, 58.8 MB/s 2024-04-25T09:10:49.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.025 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165846 s, 63.2 MB/s 2024-04-25T09:10:49.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.042 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146686 s, 71.5 MB/s 2024-04-25T09:10:49.062 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.062 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.063 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185162 s, 56.6 MB/s 2024-04-25T09:10:49.078 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.079 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.079 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146512 s, 71.6 MB/s 2024-04-25T09:10:49.095 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.095 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.095 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146584 s, 71.5 MB/s 2024-04-25T09:10:49.111 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.111 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.112 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146801 s, 71.4 MB/s 2024-04-25T09:10:49.134 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.134 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.134 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208622 s, 50.3 MB/s 2024-04-25T09:10:49.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:49.136 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:49.136 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:49.136 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.20 2024-04-25T09:10:49.136 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:49.136 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:49.136 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:49.136 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:49.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.206 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119908 s, 87.4 MB/s 2024-04-25T09:10:49.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.224 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157942 s, 66.4 MB/s 2024-04-25T09:10:49.243 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.243 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.243 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170806 s, 61.4 MB/s 2024-04-25T09:10:49.262 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.262 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.262 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171766 s, 61.0 MB/s 2024-04-25T09:10:49.278 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.278 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.278 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146499 s, 71.6 MB/s 2024-04-25T09:10:49.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.295 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.295 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144822 s, 72.4 MB/s 2024-04-25T09:10:49.310 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.310 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.310 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140464 s, 74.7 MB/s 2024-04-25T09:10:49.331 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.331 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.331 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187737 s, 55.9 MB/s 2024-04-25T09:10:49.348 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.348 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.348 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157107 s, 66.7 MB/s 2024-04-25T09:10:49.367 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.367 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.367 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165209 s, 63.5 MB/s 2024-04-25T09:10:49.381 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.381 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.381 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130618 s, 80.3 MB/s 2024-04-25T09:10:49.397 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.398 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.398 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014477 s, 72.4 MB/s 2024-04-25T09:10:49.415 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.415 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.415 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156227 s, 67.1 MB/s 2024-04-25T09:10:49.433 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.433 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.433 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164922 s, 63.6 MB/s 2024-04-25T09:10:49.449 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.449 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.449 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144798 s, 72.4 MB/s 2024-04-25T09:10:49.468 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.468 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.468 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164929 s, 63.6 MB/s 2024-04-25T09:10:49.487 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.487 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.487 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017298 s, 60.6 MB/s 2024-04-25T09:10:49.502 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.503 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.503 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139323 s, 75.3 MB/s 2024-04-25T09:10:49.523 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.523 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.523 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183239 s, 57.2 MB/s 2024-04-25T09:10:49.541 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.541 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.541 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164594 s, 63.7 MB/s 2024-04-25T09:10:49.560 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.561 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.561 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179656 s, 58.4 MB/s 2024-04-25T09:10:49.577 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.577 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.577 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144859 s, 72.4 MB/s 2024-04-25T09:10:49.593 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.593 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.593 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142249 s, 73.7 MB/s 2024-04-25T09:10:49.611 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.611 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.611 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164775 s, 63.6 MB/s 2024-04-25T09:10:49.633 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.633 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.633 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020375 s, 51.5 MB/s 2024-04-25T09:10:49.650 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.650 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.650 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146695 s, 71.5 MB/s 2024-04-25T09:10:49.666 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.667 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147492 s, 71.1 MB/s 2024-04-25T09:10:49.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.690 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021654 s, 48.4 MB/s 2024-04-25T09:10:49.706 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.706 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.706 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145023 s, 72.3 MB/s 2024-04-25T09:10:49.722 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.722 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.722 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140575 s, 74.6 MB/s 2024-04-25T09:10:49.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.739 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154991 s, 67.7 MB/s 2024-04-25T09:10:49.755 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.755 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.756 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142715 s, 73.5 MB/s 2024-04-25T09:10:49.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:49.757 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:49.757 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:49.757 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.21 2024-04-25T09:10:49.757 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:49.757 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:49.757 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:49.757 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:49.825 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.825 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.825 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146282 s, 71.7 MB/s 2024-04-25T09:10:49.840 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.841 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.841 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135901 s, 77.2 MB/s 2024-04-25T09:10:49.864 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.864 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.864 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219958 s, 47.7 MB/s 2024-04-25T09:10:49.881 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.881 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.881 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152404 s, 68.8 MB/s 2024-04-25T09:10:49.898 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.898 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.898 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146267 s, 71.7 MB/s 2024-04-25T09:10:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155075 s, 67.6 MB/s 2024-04-25T09:10:49.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.934 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017492 s, 59.9 MB/s 2024-04-25T09:10:49.951 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.951 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.951 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151025 s, 69.4 MB/s 2024-04-25T09:10:49.971 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.971 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.971 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176229 s, 59.5 MB/s 2024-04-25T09:10:49.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:49.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:49.987 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149009 s, 70.4 MB/s 2024-04-25T09:10:50.005 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.005 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.005 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155805 s, 67.3 MB/s 2024-04-25T09:10:50.027 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.027 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.028 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203234 s, 51.6 MB/s 2024-04-25T09:10:50.046 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.046 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.046 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165488 s, 63.4 MB/s 2024-04-25T09:10:50.068 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.068 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.068 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209708 s, 50.0 MB/s 2024-04-25T09:10:50.086 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.086 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.087 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163443 s, 64.2 MB/s 2024-04-25T09:10:50.109 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.109 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.109 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210954 s, 49.7 MB/s 2024-04-25T09:10:50.129 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.129 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.129 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181581 s, 57.7 MB/s 2024-04-25T09:10:50.145 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.145 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.145 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142585 s, 73.5 MB/s 2024-04-25T09:10:50.166 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.166 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195203 s, 53.7 MB/s 2024-04-25T09:10:50.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.183 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148249 s, 70.7 MB/s 2024-04-25T09:10:50.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.206 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211882 s, 49.5 MB/s 2024-04-25T09:10:50.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.224 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163476 s, 64.1 MB/s 2024-04-25T09:10:50.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.240 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143762 s, 72.9 MB/s 2024-04-25T09:10:50.256 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.256 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.256 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139487 s, 75.2 MB/s 2024-04-25T09:10:50.279 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.279 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.279 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212303 s, 49.4 MB/s 2024-04-25T09:10:50.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.298 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173102 s, 60.6 MB/s 2024-04-25T09:10:50.316 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.316 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.316 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154232 s, 68.0 MB/s 2024-04-25T09:10:50.334 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.334 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.335 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170302 s, 61.6 MB/s 2024-04-25T09:10:50.351 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.351 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.351 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150536 s, 69.7 MB/s 2024-04-25T09:10:50.370 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.370 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.370 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016945 s, 61.9 MB/s 2024-04-25T09:10:50.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.386 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143365 s, 73.1 MB/s 2024-04-25T09:10:50.405 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.405 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.405 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170362 s, 61.5 MB/s 2024-04-25T09:10:50.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:50.407 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:50.407 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:50.407 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.22 2024-04-25T09:10:50.407 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:50.407 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:50.407 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:50.407 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:50.481 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.481 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.482 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146983 s, 71.3 MB/s 2024-04-25T09:10:50.498 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.498 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.498 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147065 s, 71.3 MB/s 2024-04-25T09:10:50.520 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.520 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.520 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203003 s, 51.7 MB/s 2024-04-25T09:10:50.538 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.538 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.538 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156154 s, 67.2 MB/s 2024-04-25T09:10:50.554 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.555 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.555 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149395 s, 70.2 MB/s 2024-04-25T09:10:50.573 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.573 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.573 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167914 s, 62.4 MB/s 2024-04-25T09:10:50.591 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.591 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.591 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159458 s, 65.8 MB/s 2024-04-25T09:10:50.611 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.611 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.611 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186361 s, 56.3 MB/s 2024-04-25T09:10:50.630 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.630 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.630 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175102 s, 59.9 MB/s 2024-04-25T09:10:50.647 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.647 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.647 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146949 s, 71.4 MB/s 2024-04-25T09:10:50.668 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.668 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.668 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190767 s, 55.0 MB/s 2024-04-25T09:10:50.689 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.689 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.689 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191457 s, 54.8 MB/s 2024-04-25T09:10:50.705 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.705 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.705 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142597 s, 73.5 MB/s 2024-04-25T09:10:50.720 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.721 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.721 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140673 s, 74.5 MB/s 2024-04-25T09:10:50.742 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.742 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.743 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200152 s, 52.4 MB/s 2024-04-25T09:10:50.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.759 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014742 s, 71.1 MB/s 2024-04-25T09:10:50.779 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.779 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.779 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182792 s, 57.4 MB/s 2024-04-25T09:10:50.795 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.795 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.796 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146562 s, 71.5 MB/s 2024-04-25T09:10:50.814 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.814 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.814 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169711 s, 61.8 MB/s 2024-04-25T09:10:50.830 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.831 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.831 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145027 s, 72.3 MB/s 2024-04-25T09:10:50.848 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.848 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.848 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155976 s, 67.2 MB/s 2024-04-25T09:10:50.864 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.864 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.864 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139701 s, 75.1 MB/s 2024-04-25T09:10:50.885 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.885 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.885 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196737 s, 53.3 MB/s 2024-04-25T09:10:50.906 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.906 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.906 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019244 s, 54.5 MB/s 2024-04-25T09:10:50.923 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.923 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.923 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147698 s, 71.0 MB/s 2024-04-25T09:10:50.941 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.941 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.941 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162516 s, 64.5 MB/s 2024-04-25T09:10:50.959 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.959 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.959 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167886 s, 62.5 MB/s 2024-04-25T09:10:50.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.978 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170325 s, 61.6 MB/s 2024-04-25T09:10:50.999 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:50.999 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:50.999 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192382 s, 54.5 MB/s 2024-04-25T09:10:51.017 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.018 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.018 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165964 s, 63.2 MB/s 2024-04-25T09:10:51.034 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.034 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.034 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150972 s, 69.5 MB/s 2024-04-25T09:10:51.055 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.055 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.055 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190916 s, 54.9 MB/s 2024-04-25T09:10:51.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:51.057 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:51.057 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:51.057 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.23 2024-04-25T09:10:51.057 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:51.057 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:51.057 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:51.057 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:51.129 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.129 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.129 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147836 s, 70.9 MB/s 2024-04-25T09:10:51.145 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.145 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.145 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144192 s, 72.7 MB/s 2024-04-25T09:10:51.161 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.161 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.161 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142248 s, 73.7 MB/s 2024-04-25T09:10:51.179 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.179 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.179 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161471 s, 64.9 MB/s 2024-04-25T09:10:51.196 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.196 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.196 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157192 s, 66.7 MB/s 2024-04-25T09:10:51.212 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.213 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.213 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142921 s, 73.4 MB/s 2024-04-25T09:10:51.228 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.228 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.228 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136521 s, 76.8 MB/s 2024-04-25T09:10:51.245 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.245 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.245 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153083 s, 68.5 MB/s 2024-04-25T09:10:51.265 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.265 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.265 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175903 s, 59.6 MB/s 2024-04-25T09:10:51.280 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.280 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.281 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141451 s, 74.1 MB/s 2024-04-25T09:10:51.297 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.297 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.297 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144077 s, 72.8 MB/s 2024-04-25T09:10:51.318 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.318 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.318 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195677 s, 53.6 MB/s 2024-04-25T09:10:51.337 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.337 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.337 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170024 s, 61.7 MB/s 2024-04-25T09:10:51.353 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.353 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.353 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145526 s, 72.1 MB/s 2024-04-25T09:10:51.370 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.370 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.370 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148681 s, 70.5 MB/s 2024-04-25T09:10:51.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.387 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.387 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148068 s, 70.8 MB/s 2024-04-25T09:10:51.407 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.407 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.407 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187477 s, 55.9 MB/s 2024-04-25T09:10:51.423 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.423 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.423 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140531 s, 74.6 MB/s 2024-04-25T09:10:51.440 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.440 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.440 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151856 s, 69.1 MB/s 2024-04-25T09:10:51.455 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.456 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.456 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142395 s, 73.6 MB/s 2024-04-25T09:10:51.472 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.472 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.472 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014964 s, 70.1 MB/s 2024-04-25T09:10:51.495 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.495 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.496 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211866 s, 49.5 MB/s 2024-04-25T09:10:51.516 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.516 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.516 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188562 s, 55.6 MB/s 2024-04-25T09:10:51.533 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.534 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.534 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157556 s, 66.6 MB/s 2024-04-25T09:10:51.550 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.550 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.551 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150051 s, 69.9 MB/s 2024-04-25T09:10:51.571 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.571 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.572 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191901 s, 54.6 MB/s 2024-04-25T09:10:51.591 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.591 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.591 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018042 s, 58.1 MB/s 2024-04-25T09:10:51.607 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.607 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.608 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143605 s, 73.0 MB/s 2024-04-25T09:10:51.623 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.624 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143355 s, 73.1 MB/s 2024-04-25T09:10:51.644 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.644 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.644 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182299 s, 57.5 MB/s 2024-04-25T09:10:51.660 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.660 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.660 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144262 s, 72.7 MB/s 2024-04-25T09:10:51.676 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.676 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.676 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140792 s, 74.5 MB/s 2024-04-25T09:10:51.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:51.677 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:51.677 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:51.677 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.24 2024-04-25T09:10:51.677 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:51.678 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:51.678 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:51.678 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:51.749 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.750 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.750 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150065 s, 69.9 MB/s 2024-04-25T09:10:51.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.767 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150762 s, 69.6 MB/s 2024-04-25T09:10:51.784 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.785 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.785 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016559 s, 63.3 MB/s 2024-04-25T09:10:51.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.805 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183486 s, 57.1 MB/s 2024-04-25T09:10:51.822 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.822 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.822 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155567 s, 67.4 MB/s 2024-04-25T09:10:51.840 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.840 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.840 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015617 s, 67.1 MB/s 2024-04-25T09:10:51.856 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.856 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.856 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148956 s, 70.4 MB/s 2024-04-25T09:10:51.879 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.879 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.879 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209176 s, 50.1 MB/s 2024-04-25T09:10:51.898 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.898 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.898 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170449 s, 61.5 MB/s 2024-04-25T09:10:51.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.914 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147906 s, 70.9 MB/s 2024-04-25T09:10:51.931 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.931 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.931 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152094 s, 68.9 MB/s 2024-04-25T09:10:51.952 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.952 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.952 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187516 s, 55.9 MB/s 2024-04-25T09:10:51.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.968 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144969 s, 72.3 MB/s 2024-04-25T09:10:51.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:51.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:51.987 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169724 s, 61.8 MB/s 2024-04-25T09:10:52.004 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.004 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.004 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152702 s, 68.7 MB/s 2024-04-25T09:10:52.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.023 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.023 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163963 s, 64.0 MB/s 2024-04-25T09:10:52.038 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.038 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.039 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142536 s, 73.6 MB/s 2024-04-25T09:10:52.059 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.059 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.059 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187589 s, 55.9 MB/s 2024-04-25T09:10:52.080 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.080 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.080 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194104 s, 54.0 MB/s 2024-04-25T09:10:52.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.101 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190679 s, 55.0 MB/s 2024-04-25T09:10:52.118 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.118 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.118 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150776 s, 69.5 MB/s 2024-04-25T09:10:52.135 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.135 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.135 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152847 s, 68.6 MB/s 2024-04-25T09:10:52.151 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.152 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.152 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147616 s, 71.0 MB/s 2024-04-25T09:10:52.169 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.169 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.169 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153737 s, 68.2 MB/s 2024-04-25T09:10:52.185 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.185 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.185 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146016 s, 71.8 MB/s 2024-04-25T09:10:52.207 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.207 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.207 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199223 s, 52.6 MB/s 2024-04-25T09:10:52.223 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.223 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.223 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146651 s, 71.5 MB/s 2024-04-25T09:10:52.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.241 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153076 s, 68.5 MB/s 2024-04-25T09:10:52.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.257 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151157 s, 69.4 MB/s 2024-04-25T09:10:52.276 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.276 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.276 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167204 s, 62.7 MB/s 2024-04-25T09:10:52.292 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.292 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.293 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147014 s, 71.3 MB/s 2024-04-25T09:10:52.310 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.310 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.310 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162705 s, 64.4 MB/s 2024-04-25T09:10:52.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:52.312 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:52.312 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:52.312 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.25 2024-04-25T09:10:52.312 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:52.312 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:52.312 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:52.312 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:52.383 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.383 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.383 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016681 s, 62.9 MB/s 2024-04-25T09:10:52.399 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.399 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.399 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143938 s, 72.8 MB/s 2024-04-25T09:10:52.416 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.417 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.417 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154354 s, 67.9 MB/s 2024-04-25T09:10:52.433 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.433 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.433 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142852 s, 73.4 MB/s 2024-04-25T09:10:52.448 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.448 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.449 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141921 s, 73.9 MB/s 2024-04-25T09:10:52.466 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.466 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.466 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156906 s, 66.8 MB/s 2024-04-25T09:10:52.485 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.485 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.485 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176921 s, 59.3 MB/s 2024-04-25T09:10:52.507 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.507 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.507 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019946 s, 52.6 MB/s 2024-04-25T09:10:52.524 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.525 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.525 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158352 s, 66.2 MB/s 2024-04-25T09:10:52.541 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.541 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.541 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142955 s, 73.3 MB/s 2024-04-25T09:10:52.561 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.561 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.562 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188791 s, 55.5 MB/s 2024-04-25T09:10:52.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.579 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152307 s, 68.8 MB/s 2024-04-25T09:10:52.596 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.596 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.596 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157483 s, 66.6 MB/s 2024-04-25T09:10:52.609 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.609 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.609 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113603 s, 92.3 MB/s 2024-04-25T09:10:52.627 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.627 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.627 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165483 s, 63.4 MB/s 2024-04-25T09:10:52.645 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.645 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.645 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160329 s, 65.4 MB/s 2024-04-25T09:10:52.662 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.662 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.662 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148858 s, 70.4 MB/s 2024-04-25T09:10:52.679 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.679 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.679 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152642 s, 68.7 MB/s 2024-04-25T09:10:52.693 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.693 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.693 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119808 s, 87.5 MB/s 2024-04-25T09:10:52.708 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.708 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.709 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142949 s, 73.4 MB/s 2024-04-25T09:10:52.726 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.726 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.726 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015688 s, 66.8 MB/s 2024-04-25T09:10:52.745 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.745 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.745 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171676 s, 61.1 MB/s 2024-04-25T09:10:52.767 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.767 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.767 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200284 s, 52.4 MB/s 2024-04-25T09:10:52.783 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.783 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.783 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144157 s, 72.7 MB/s 2024-04-25T09:10:52.800 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.800 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.800 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149305 s, 70.2 MB/s 2024-04-25T09:10:52.816 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.816 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.816 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145083 s, 72.3 MB/s 2024-04-25T09:10:52.840 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.840 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.840 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221407 s, 47.4 MB/s 2024-04-25T09:10:52.857 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.857 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.857 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153611 s, 68.3 MB/s 2024-04-25T09:10:52.877 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.877 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.878 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185569 s, 56.5 MB/s 2024-04-25T09:10:52.894 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.894 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.894 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145141 s, 72.2 MB/s 2024-04-25T09:10:52.911 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.911 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.911 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154153 s, 68.0 MB/s 2024-04-25T09:10:52.924 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.924 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.924 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113599 s, 92.3 MB/s 2024-04-25T09:10:52.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:52.926 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:52.926 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:52.926 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.26 2024-04-25T09:10:52.926 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:52.926 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:52.926 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:52.926 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:52.998 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:52.998 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:52.998 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160775 s, 65.2 MB/s 2024-04-25T09:10:53.016 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.016 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.016 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016341 s, 64.2 MB/s 2024-04-25T09:10:53.033 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.033 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.033 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148159 s, 70.8 MB/s 2024-04-25T09:10:53.049 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.050 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.050 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014946 s, 70.2 MB/s 2024-04-25T09:10:53.066 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.066 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.066 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150939 s, 69.5 MB/s 2024-04-25T09:10:53.084 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.084 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.084 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162256 s, 64.6 MB/s 2024-04-25T09:10:53.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.102 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.102 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155939 s, 67.2 MB/s 2024-04-25T09:10:53.123 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.123 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.123 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019507 s, 53.8 MB/s 2024-04-25T09:10:53.139 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.139 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.139 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147242 s, 71.2 MB/s 2024-04-25T09:10:53.158 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.158 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.158 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017005 s, 61.7 MB/s 2024-04-25T09:10:53.182 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.183 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022843 s, 45.9 MB/s 2024-04-25T09:10:53.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.200 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153657 s, 68.2 MB/s 2024-04-25T09:10:53.218 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.218 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.218 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016058 s, 65.3 MB/s 2024-04-25T09:10:53.234 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.235 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.235 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152036 s, 69.0 MB/s 2024-04-25T09:10:53.251 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.251 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.251 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143098 s, 73.3 MB/s 2024-04-25T09:10:53.267 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.267 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.267 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146721 s, 71.5 MB/s 2024-04-25T09:10:53.286 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.286 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.287 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017658 s, 59.4 MB/s 2024-04-25T09:10:53.304 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.304 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.304 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158225 s, 66.3 MB/s 2024-04-25T09:10:53.324 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.324 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.324 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01832 s, 57.2 MB/s 2024-04-25T09:10:53.340 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.340 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.340 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139356 s, 75.2 MB/s 2024-04-25T09:10:53.357 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.357 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.357 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015264 s, 68.7 MB/s 2024-04-25T09:10:53.375 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.375 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.375 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168317 s, 62.3 MB/s 2024-04-25T09:10:53.392 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.392 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.392 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145309 s, 72.2 MB/s 2024-04-25T09:10:53.411 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.411 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.411 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169691 s, 61.8 MB/s 2024-04-25T09:10:53.427 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.427 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.427 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141704 s, 74.0 MB/s 2024-04-25T09:10:53.445 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.445 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.445 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167127 s, 62.7 MB/s 2024-04-25T09:10:53.460 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.460 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.460 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138624 s, 75.6 MB/s 2024-04-25T09:10:53.477 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.477 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.477 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148587 s, 70.6 MB/s 2024-04-25T09:10:53.498 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.498 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.498 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187261 s, 56.0 MB/s 2024-04-25T09:10:53.514 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.515 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.515 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150869 s, 69.5 MB/s 2024-04-25T09:10:53.534 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.534 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.534 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174344 s, 60.1 MB/s 2024-04-25T09:10:53.550 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.550 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.550 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145576 s, 72.0 MB/s 2024-04-25T09:10:53.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:53.552 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:53.552 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:53.552 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.27 2024-04-25T09:10:53.552 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:53.552 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:53.552 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:53.552 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:53.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.624 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165884 s, 63.2 MB/s 2024-04-25T09:10:53.640 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.641 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.641 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151144 s, 69.4 MB/s 2024-04-25T09:10:53.657 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.657 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.657 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014719 s, 71.2 MB/s 2024-04-25T09:10:53.681 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.682 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.682 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224566 s, 46.7 MB/s 2024-04-25T09:10:53.703 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.704 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.704 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02034 s, 51.6 MB/s 2024-04-25T09:10:53.722 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.722 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.722 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166822 s, 62.9 MB/s 2024-04-25T09:10:53.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.739 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153835 s, 68.2 MB/s 2024-04-25T09:10:53.756 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.756 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.756 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147674 s, 71.0 MB/s 2024-04-25T09:10:53.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.777 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186577 s, 56.2 MB/s 2024-04-25T09:10:53.794 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.794 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.794 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153563 s, 68.3 MB/s 2024-04-25T09:10:53.816 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.817 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.817 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212763 s, 49.3 MB/s 2024-04-25T09:10:53.833 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.833 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.833 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146832 s, 71.4 MB/s 2024-04-25T09:10:53.851 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.851 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.851 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157238 s, 66.7 MB/s 2024-04-25T09:10:53.867 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.867 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.867 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143291 s, 73.2 MB/s 2024-04-25T09:10:53.884 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.884 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.884 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014977 s, 70.0 MB/s 2024-04-25T09:10:53.900 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.900 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.900 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143096 s, 73.3 MB/s 2024-04-25T09:10:53.918 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.918 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.919 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165785 s, 63.2 MB/s 2024-04-25T09:10:53.940 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.940 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.940 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200802 s, 52.2 MB/s 2024-04-25T09:10:53.956 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.956 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.956 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145757 s, 71.9 MB/s 2024-04-25T09:10:53.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.969 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110227 s, 95.1 MB/s 2024-04-25T09:10:53.986 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:53.986 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:53.986 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147137 s, 71.3 MB/s 2024-04-25T09:10:54.002 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.003 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.003 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149515 s, 70.1 MB/s 2024-04-25T09:10:54.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.022 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172048 s, 60.9 MB/s 2024-04-25T09:10:54.040 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.040 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.040 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163693 s, 64.1 MB/s 2024-04-25T09:10:54.058 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.058 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.058 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159943 s, 65.6 MB/s 2024-04-25T09:10:54.076 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.076 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.076 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166564 s, 63.0 MB/s 2024-04-25T09:10:54.092 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.092 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.092 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142582 s, 73.5 MB/s 2024-04-25T09:10:54.108 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.108 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.108 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140982 s, 74.4 MB/s 2024-04-25T09:10:54.123 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.123 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.123 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128233 s, 81.8 MB/s 2024-04-25T09:10:54.147 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.147 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.147 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215449 s, 48.7 MB/s 2024-04-25T09:10:54.169 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.169 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.169 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198451 s, 52.8 MB/s 2024-04-25T09:10:54.190 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.191 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.191 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196324 s, 53.4 MB/s 2024-04-25T09:10:54.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:54.192 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:54.192 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:54.192 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.28 2024-04-25T09:10:54.192 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:54.192 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:54.192 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:54.192 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:54.265 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.265 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.265 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147451 s, 71.1 MB/s 2024-04-25T09:10:54.284 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.284 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.284 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169353 s, 61.9 MB/s 2024-04-25T09:10:54.301 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.301 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.301 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151953 s, 69.0 MB/s 2024-04-25T09:10:54.317 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.317 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.317 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141015 s, 74.4 MB/s 2024-04-25T09:10:54.331 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.331 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.331 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126174 s, 83.1 MB/s 2024-04-25T09:10:54.353 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.353 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.353 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201931 s, 51.9 MB/s 2024-04-25T09:10:54.372 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.372 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.372 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171942 s, 61.0 MB/s 2024-04-25T09:10:54.390 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.390 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.390 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167029 s, 62.8 MB/s 2024-04-25T09:10:54.406 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.406 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.407 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144002 s, 72.8 MB/s 2024-04-25T09:10:54.424 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.424 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.424 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158334 s, 66.2 MB/s 2024-04-25T09:10:54.443 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.443 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.443 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016458 s, 63.7 MB/s 2024-04-25T09:10:54.459 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.459 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.459 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014485 s, 72.4 MB/s 2024-04-25T09:10:54.475 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.476 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.476 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149716 s, 70.0 MB/s 2024-04-25T09:10:54.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.497 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196568 s, 53.3 MB/s 2024-04-25T09:10:54.513 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.513 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.513 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144935 s, 72.3 MB/s 2024-04-25T09:10:54.534 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.534 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.534 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191129 s, 54.9 MB/s 2024-04-25T09:10:54.551 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.551 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.551 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153355 s, 68.4 MB/s 2024-04-25T09:10:54.568 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.568 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.568 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149942 s, 69.9 MB/s 2024-04-25T09:10:54.586 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.586 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.586 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165927 s, 63.2 MB/s 2024-04-25T09:10:54.604 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.604 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.604 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016176 s, 64.8 MB/s 2024-04-25T09:10:54.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.622 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160548 s, 65.3 MB/s 2024-04-25T09:10:54.645 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.646 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.646 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216169 s, 48.5 MB/s 2024-04-25T09:10:54.662 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.662 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.662 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014384 s, 72.9 MB/s 2024-04-25T09:10:54.683 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.683 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.683 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191372 s, 54.8 MB/s 2024-04-25T09:10:54.698 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.698 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.698 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138516 s, 75.7 MB/s 2024-04-25T09:10:54.716 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.716 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.717 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01622 s, 64.6 MB/s 2024-04-25T09:10:54.738 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.738 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.738 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196003 s, 53.5 MB/s 2024-04-25T09:10:54.754 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.754 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.754 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140385 s, 74.7 MB/s 2024-04-25T09:10:54.770 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.770 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.770 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145724 s, 72.0 MB/s 2024-04-25T09:10:54.789 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.789 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.789 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171171 s, 61.3 MB/s 2024-04-25T09:10:54.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.806 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146912 s, 71.4 MB/s 2024-04-25T09:10:54.829 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.829 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.829 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215891 s, 48.6 MB/s 2024-04-25T09:10:54.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:54.831 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:54.831 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:54.831 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.29 2024-04-25T09:10:54.831 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:54.831 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:54.831 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:54.831 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:54.901 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.901 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.901 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145264 s, 72.2 MB/s 2024-04-25T09:10:54.921 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.921 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.921 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183931 s, 57.0 MB/s 2024-04-25T09:10:54.938 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.938 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.938 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147447 s, 71.1 MB/s 2024-04-25T09:10:54.961 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.961 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.961 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216596 s, 48.4 MB/s 2024-04-25T09:10:54.979 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.979 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.979 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016263 s, 64.5 MB/s 2024-04-25T09:10:54.995 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:54.995 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:54.996 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147334 s, 71.2 MB/s 2024-04-25T09:10:55.012 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.012 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.012 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146564 s, 71.5 MB/s 2024-04-25T09:10:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139646 s, 75.1 MB/s 2024-04-25T09:10:55.045 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.046 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.046 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159917 s, 65.6 MB/s 2024-04-25T09:10:55.063 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.063 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.063 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152717 s, 68.7 MB/s 2024-04-25T09:10:55.079 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.079 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.079 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142627 s, 73.5 MB/s 2024-04-25T09:10:55.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.101 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202369 s, 51.8 MB/s 2024-04-25T09:10:55.121 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.121 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.121 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187202 s, 56.0 MB/s 2024-04-25T09:10:55.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.140 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166036 s, 63.2 MB/s 2024-04-25T09:10:55.156 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.156 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.156 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014722 s, 71.2 MB/s 2024-04-25T09:10:55.172 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.173 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.173 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148263 s, 70.7 MB/s 2024-04-25T09:10:55.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.192 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174545 s, 60.1 MB/s 2024-04-25T09:10:55.215 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.215 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.215 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209898 s, 50.0 MB/s 2024-04-25T09:10:55.233 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.233 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.233 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164761 s, 63.6 MB/s 2024-04-25T09:10:55.254 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.254 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.254 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187418 s, 55.9 MB/s 2024-04-25T09:10:55.272 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.272 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.272 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163318 s, 64.2 MB/s 2024-04-25T09:10:55.289 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.289 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.289 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153987 s, 68.1 MB/s 2024-04-25T09:10:55.306 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.307 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.307 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161495 s, 64.9 MB/s 2024-04-25T09:10:55.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.323 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146206 s, 71.7 MB/s 2024-04-25T09:10:55.339 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.339 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.339 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145762 s, 71.9 MB/s 2024-04-25T09:10:55.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.360 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194207 s, 54.0 MB/s 2024-04-25T09:10:55.378 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.378 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.378 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157807 s, 66.4 MB/s 2024-04-25T09:10:55.394 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.394 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.394 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144376 s, 72.6 MB/s 2024-04-25T09:10:55.410 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.410 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.410 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141289 s, 74.2 MB/s 2024-04-25T09:10:55.427 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.427 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.427 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148477 s, 70.6 MB/s 2024-04-25T09:10:55.443 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.443 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.443 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150222 s, 69.8 MB/s 2024-04-25T09:10:55.462 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.462 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.462 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164493 s, 63.7 MB/s 2024-04-25T09:10:55.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:55.463 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:55.463 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:55.463 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.30 2024-04-25T09:10:55.463 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:55.463 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:55.463 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:55.463 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:55.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.540 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217528 s, 48.2 MB/s 2024-04-25T09:10:55.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.557 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145287 s, 72.2 MB/s 2024-04-25T09:10:55.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.578 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196814 s, 53.3 MB/s 2024-04-25T09:10:55.599 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.599 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.599 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197208 s, 53.2 MB/s 2024-04-25T09:10:55.621 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.621 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.621 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019762 s, 53.1 MB/s 2024-04-25T09:10:55.639 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.639 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.639 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159499 s, 65.7 MB/s 2024-04-25T09:10:55.655 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.655 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.655 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148633 s, 70.5 MB/s 2024-04-25T09:10:55.671 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.671 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.671 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014436 s, 72.6 MB/s 2024-04-25T09:10:55.689 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.689 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.689 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016429 s, 63.8 MB/s 2024-04-25T09:10:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208975 s, 50.2 MB/s 2024-04-25T09:10:55.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.731 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168743 s, 62.1 MB/s 2024-04-25T09:10:55.748 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.748 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.748 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152753 s, 68.6 MB/s 2024-04-25T09:10:55.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.766 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163135 s, 64.3 MB/s 2024-04-25T09:10:55.784 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.784 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.784 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166043 s, 63.2 MB/s 2024-04-25T09:10:55.801 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.802 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.802 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152567 s, 68.7 MB/s 2024-04-25T09:10:55.819 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.819 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.819 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154287 s, 68.0 MB/s 2024-04-25T09:10:55.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.837 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169868 s, 61.7 MB/s 2024-04-25T09:10:55.856 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.857 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.857 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172386 s, 60.8 MB/s 2024-04-25T09:10:55.873 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.873 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.873 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149009 s, 70.4 MB/s 2024-04-25T09:10:55.894 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.894 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.894 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019574 s, 53.6 MB/s 2024-04-25T09:10:55.911 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.911 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.911 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148363 s, 70.7 MB/s 2024-04-25T09:10:55.933 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.933 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.934 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204217 s, 51.3 MB/s 2024-04-25T09:10:55.950 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.951 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.951 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152073 s, 69.0 MB/s 2024-04-25T09:10:55.967 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.967 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.967 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150786 s, 69.5 MB/s 2024-04-25T09:10:55.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:55.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:55.987 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176422 s, 59.4 MB/s 2024-04-25T09:10:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145104 s, 72.3 MB/s 2024-04-25T09:10:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211441 s, 49.6 MB/s 2024-04-25T09:10:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179824 s, 58.3 MB/s 2024-04-25T09:10:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167184 s, 62.7 MB/s 2024-04-25T09:10:56.080 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.080 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.080 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141511 s, 74.1 MB/s 2024-04-25T09:10:56.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.097 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152509 s, 68.8 MB/s 2024-04-25T09:10:56.117 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.117 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.117 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180976 s, 57.9 MB/s 2024-04-25T09:10:56.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:56.119 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:10:56.119 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:10:56.119 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.31 2024-04-25T09:10:56.119 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:10:56.119 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:10:56.119 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:10:56.119 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:10:56.197 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.197 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.197 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018182 s, 57.7 MB/s 2024-04-25T09:10:56.216 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.216 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.216 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177037 s, 59.2 MB/s 2024-04-25T09:10:56.233 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.233 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.233 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150753 s, 69.6 MB/s 2024-04-25T09:10:56.254 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.254 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.254 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019085 s, 54.9 MB/s 2024-04-25T09:10:56.274 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.274 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.274 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183428 s, 57.2 MB/s 2024-04-25T09:10:56.292 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.292 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.292 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156232 s, 67.1 MB/s 2024-04-25T09:10:56.308 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.308 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.308 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146815 s, 71.4 MB/s 2024-04-25T09:10:56.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.323 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127857 s, 82.0 MB/s 2024-04-25T09:10:56.347 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.347 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.347 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225393 s, 46.5 MB/s 2024-04-25T09:10:56.363 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.363 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.363 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014544 s, 72.1 MB/s 2024-04-25T09:10:56.383 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.384 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.384 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187713 s, 55.9 MB/s 2024-04-25T09:10:56.405 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.405 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.405 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196396 s, 53.4 MB/s 2024-04-25T09:10:56.429 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.429 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.429 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220411 s, 47.6 MB/s 2024-04-25T09:10:56.447 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.447 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.447 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167009 s, 62.8 MB/s 2024-04-25T09:10:56.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.469 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199488 s, 52.6 MB/s 2024-04-25T09:10:56.485 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.486 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.486 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148181 s, 70.8 MB/s 2024-04-25T09:10:56.502 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.502 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.502 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151999 s, 69.0 MB/s 2024-04-25T09:10:56.518 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.518 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.518 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140602 s, 74.6 MB/s 2024-04-25T09:10:56.535 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.535 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.535 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150715 s, 69.6 MB/s 2024-04-25T09:10:56.552 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.552 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.552 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144967 s, 72.3 MB/s 2024-04-25T09:10:56.569 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.569 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.569 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01564 s, 67.0 MB/s 2024-04-25T09:10:56.588 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.589 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.589 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176485 s, 59.4 MB/s 2024-04-25T09:10:56.612 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.613 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.613 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221088 s, 47.4 MB/s 2024-04-25T09:10:56.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.628 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141512 s, 74.1 MB/s 2024-04-25T09:10:56.645 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.645 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.645 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149028 s, 70.4 MB/s 2024-04-25T09:10:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146672 s, 71.5 MB/s 2024-04-25T09:10:56.679 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.679 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.679 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159177 s, 65.9 MB/s 2024-04-25T09:10:56.696 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.696 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.696 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151527 s, 69.2 MB/s 2024-04-25T09:10:56.713 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.713 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.713 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152272 s, 68.9 MB/s 2024-04-25T09:10:56.736 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.736 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.736 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206801 s, 50.7 MB/s 2024-04-25T09:10:56.757 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.757 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.757 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192845 s, 54.4 MB/s 2024-04-25T09:10:56.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:10:56.778 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:10:56.778 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190638 s, 55.0 MB/s 2024-04-25T09:10:56.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:56.779 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start /scrub_control_test_path recursive 2024-04-25T09:10:56.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.975+0000 7ff932000640 1 Processor -- start 2024-04-25T09:10:56.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.975+0000 7ff932000640 1 -- start start 2024-04-25T09:10:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff932000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff92c0cc260 0x7ff92c0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff932000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92c06d4b0 con 0x7ff92c145290 2024-04-25T09:10:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff932000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92c06d790 con 0x7ff92c0b3fe0 2024-04-25T09:10:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff932000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c06da70 con 0x7ff92c0cc260 2024-04-25T09:10:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92b400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ff92c145290 0x7ff92c15c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36710/0 (socket says 172.21.15.173:36710) 2024-04-25T09:10:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92b400640 1 -- 172.21.15.173:0/3706030611 learned_addr learned my addr 172.21.15.173:0/3706030611 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92be00640 1 --2- 172.21.15.173:0/3706030611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff92c0cc260 0x7ff92c0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92a000640 1 -- 172.21.15.173:0/3706030611 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1590964296 0 0) 0x7ff92c06d4b0 con 0x7ff92c145290 2024-04-25T09:10:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92a000640 1 -- 172.21.15.173:0/3706030611 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff910003530 con 0x7ff92c145290 2024-04-25T09:10:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92a000640 1 -- 172.21.15.173:0/3706030611 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3363427074 0 0) 0x7ff910003530 con 0x7ff92c145290 2024-04-25T09:10:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92a000640 1 -- 172.21.15.173:0/3706030611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff92c0cc260 msgr2=0x7ff92c0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92a000640 1 --2- 172.21.15.173:0/3706030611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff92c0cc260 0x7ff92c0cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92a000640 1 -- 172.21.15.173:0/3706030611 >> v1:172.21.15.194:6789/0 conn(0x7ff92c0b3fe0 legacy=0x7ff92c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92a000640 1 -- 172.21.15.173:0/3706030611 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c06dd50 con 0x7ff92c145290 2024-04-25T09:10:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92a000640 1 -- 172.21.15.173:0/3706030611 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7ff91c001a00 con 0x7ff92c145290 2024-04-25T09:10:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92a000640 1 -- 172.21.15.173:0/3706030611 >> v1:172.21.15.173:6789/0 conn(0x7ff92c145290 legacy=0x7ff92c15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92a000640 1 --2- 172.21.15.173:0/3706030611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9100039f0 0x7ff910003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92a000640 1 --2- 172.21.15.173:0/3706030611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff92c0cc260 0x7ff910004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92a000640 1 --2- 172.21.15.173:0/3706030611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff910004d50 0x7ff9100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92a000640 1 -- 172.21.15.173:0/3706030611 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c06da70 con 0x7ff9100039f0 2024-04-25T09:10:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92a000640 1 -- 172.21.15.173:0/3706030611 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91000bb60 con 0x7ff910004d50 2024-04-25T09:10:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92a000640 1 -- 172.21.15.173:0/3706030611 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91000bd60 con 0x7ff92c0cc260 2024-04-25T09:10:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92b400640 1 --2- 172.21.15.173:0/3706030611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9100039f0 0x7ff910003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92be00640 1 --2- 172.21.15.173:0/3706030611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff910004d50 0x7ff9100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92aa00640 1 --2- 172.21.15.173:0/3706030611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff92c0cc260 0x7ff910004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92b400640 1 -- 172.21.15.173:0/3706030611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff92c0cc260 msgr2=0x7ff910004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92b400640 1 --2- 172.21.15.173:0/3706030611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff92c0cc260 0x7ff910004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92b400640 1 -- 172.21.15.173:0/3706030611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff910004d50 msgr2=0x7ff9100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92b400640 1 --2- 172.21.15.173:0/3706030611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff910004d50 0x7ff9100051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.979+0000 7ff92b400640 1 -- 172.21.15.173:0/3706030611 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff910003530 con 0x7ff9100039f0 2024-04-25T09:10:56.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.983+0000 7ff92b400640 1 --2- 172.21.15.173:0/3706030611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9100039f0 0x7ff910003dd0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7ff91c00a790 tx=0x7ff91c01d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229c126c5e8b3e04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:56.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.983+0000 7ff92a000640 1 -- 172.21.15.173:0/3706030611 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c00a3b0 con 0x7ff9100039f0 2024-04-25T09:10:56.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.983+0000 7ff92a000640 1 -- 172.21.15.173:0/3706030611 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c0ad650 con 0x7ff9100039f0 2024-04-25T09:10:56.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.983+0000 7ff92a000640 1 -- 172.21.15.173:0/3706030611 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c0ada40 con 0x7ff9100039f0 2024-04-25T09:10:56.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.983+0000 7ff932000640 1 -- 172.21.15.173:0/3706030611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9100039f0 msgr2=0x7ff910003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:56.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.983+0000 7ff932000640 1 --2- 172.21.15.173:0/3706030611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9100039f0 0x7ff910003dd0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7ff91c00a790 tx=0x7ff91c01d2c0 comp rx=0 tx=0).stop 2024-04-25T09:10:56.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.983+0000 7ff92be00640 1 -- 172.21.15.173:0/3706030611 reap_dead start 2024-04-25T09:10:56.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.983+0000 7ff932000640 1 -- 172.21.15.173:0/3706030611 shutdown_connections 2024-04-25T09:10:56.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.983+0000 7ff932000640 1 -- 172.21.15.173:0/3706030611 >> 172.21.15.173:0/3706030611 conn(0x7ff92c06ac90 msgr2=0x7ff92c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:56.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.983+0000 7ff932000640 1 -- 172.21.15.173:0/3706030611 shutdown_connections 2024-04-25T09:10:56.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.983+0000 7ff932000640 1 -- 172.21.15.173:0/3706030611 wait complete. 2024-04-25T09:10:56.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff932000640 1 Processor -- start 2024-04-25T09:10:56.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff932000640 1 -- start start 2024-04-25T09:10:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff932000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9100039f0 0x7ff92c15c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff932000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff92c15d990 0x7ff92c15adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff932000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff92c0af3c0 0x7ff92c0af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff932000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c06f130 con 0x7ff9100039f0 2024-04-25T09:10:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff932000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c06efb0 con 0x7ff92c0af3c0 2024-04-25T09:10:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff932000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c162c40 con 0x7ff92c15d990 2024-04-25T09:10:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff92b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9100039f0 0x7ff92c15c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff92b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9100039f0 0x7ff92c15c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56488/0 (socket says 172.21.15.173:56488) 2024-04-25T09:10:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff92b400640 1 -- 172.21.15.173:0/3484281244 learned_addr learned my addr 172.21.15.173:0/3484281244 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff92aa00640 1 --2- 172.21.15.173:0/3484281244 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff92c15d990 0x7ff92c15adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff92b400640 1 -- 172.21.15.173:0/3484281244 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff92c15d990 msgr2=0x7ff92c15adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff92be00640 1 --2- 172.21.15.173:0/3484281244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff92c0af3c0 0x7ff92c0af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff92b400640 1 --2- 172.21.15.173:0/3484281244 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff92c15d990 0x7ff92c15adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff92b400640 1 -- 172.21.15.173:0/3484281244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff92c0af3c0 msgr2=0x7ff92c0af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff92b400640 1 --2- 172.21.15.173:0/3484281244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff92c0af3c0 0x7ff92c0af870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff92b400640 1 -- 172.21.15.173:0/3484281244 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c15cfb0 con 0x7ff9100039f0 2024-04-25T09:10:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff92be00640 1 --2- 172.21.15.173:0/3484281244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff92c0af3c0 0x7ff92c0af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff92aa00640 1 --2- 172.21.15.173:0/3484281244 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff92c15d990 0x7ff92c15adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff92b400640 1 --2- 172.21.15.173:0/3484281244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9100039f0 0x7ff92c15c940 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7ff91c01d0f0 tx=0x7ff910005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:56.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff923400640 1 -- 172.21.15.173:0/3484281244 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c0ad430 con 0x7ff9100039f0 2024-04-25T09:10:56.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff923400640 1 -- 172.21.15.173:0/3484281244 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c001260 con 0x7ff9100039f0 2024-04-25T09:10:56.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff932000640 1 -- 172.21.15.173:0/3484281244 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92c15d290 con 0x7ff9100039f0 2024-04-25T09:10:56.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff923400640 1 -- 172.21.15.173:0/3484281244 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c001960 con 0x7ff9100039f0 2024-04-25T09:10:56.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.987+0000 7ff932000640 1 -- 172.21.15.173:0/3484281244 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92c1631c0 con 0x7ff9100039f0 2024-04-25T09:10:56.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.991+0000 7ff923400640 1 -- 172.21.15.173:0/3484281244 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff91c0be060 con 0x7ff9100039f0 2024-04-25T09:10:56.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.991+0000 7ff923400640 1 --2- 172.21.15.173:0/3484281244 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff90c066f90 0x7ff90c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:56.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.991+0000 7ff923400640 1 -- 172.21.15.173:0/3484281244 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7ff91c11ee90 con 0x7ff9100039f0 2024-04-25T09:10:56.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.991+0000 7ff92aa00640 1 --2- 172.21.15.173:0/3484281244 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff90c066f90 0x7ff90c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:56.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.991+0000 7ff935420000 1 Processor -- start 2024-04-25T09:10:56.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.991+0000 7ff935420000 1 -- start start 2024-04-25T09:10:56.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.991+0000 7ff92aa00640 1 --2- 172.21.15.173:0/3484281244 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff90c066f90 0x7ff90c069450 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff918000c10 tx=0x7ff918009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:56.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.991+0000 7ff935420000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d84e3f0 0x56519d84e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:56.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.991+0000 7ff935420000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d84ed10 0x56519d804fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:56.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.991+0000 7ff935420000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d805520 0x56519d805900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:56.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.991+0000 7ff935420000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56519d652d50 con 0x56519d805520 2024-04-25T09:10:56.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.991+0000 7ff935420000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56519d5dae40 con 0x56519d84ed10 2024-04-25T09:10:56.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.991+0000 7ff935420000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56519d64edf0 con 0x56519d84e3f0 2024-04-25T09:10:56.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.991+0000 7ff92be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d805520 0x56519d805900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:56.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff92be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d805520 0x56519d805900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56504/0 (socket says 172.21.15.173:56504) 2024-04-25T09:10:56.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff92be00640 1 -- 172.21.15.173:0/4052090979 learned_addr learned my addr 172.21.15.173:0/4052090979 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:56.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff92b400640 1 --2- 172.21.15.173:0/4052090979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d84e3f0 0x56519d84e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:56.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff92aa00640 1 --2- 172.21.15.173:0/4052090979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d84ed10 0x56519d804fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:56.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff92be00640 1 -- 172.21.15.173:0/4052090979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d84e3f0 msgr2=0x56519d84e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:56.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff92be00640 1 --2- 172.21.15.173:0/4052090979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d84e3f0 0x56519d84e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:56.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff92be00640 1 -- 172.21.15.173:0/4052090979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d84ed10 msgr2=0x56519d804fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:56.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff92be00640 1 --2- 172.21.15.173:0/4052090979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d84ed10 0x56519d804fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:56.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff92be00640 1 -- 172.21.15.173:0/4052090979 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56519d5efd90 con 0x56519d805520 2024-04-25T09:10:56.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff92be00640 1 --2- 172.21.15.173:0/4052090979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d805520 0x56519d805900 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0727c0 tx=0x7ff924009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ffd7bf8f5d10d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:56.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff917e00640 1 -- 172.21.15.173:0/4052090979 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924004240 con 0x56519d805520 2024-04-25T09:10:56.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff917e00640 1 -- 172.21.15.173:0/4052090979 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9240043e0 con 0x56519d805520 2024-04-25T09:10:56.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff917e00640 1 -- 172.21.15.173:0/4052090979 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9240139b0 con 0x56519d805520 2024-04-25T09:10:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff935420000 1 -- 172.21.15.173:0/4052090979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d805520 msgr2=0x56519d805900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff935420000 1 --2- 172.21.15.173:0/4052090979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d805520 0x56519d805900 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0727c0 tx=0x7ff924009190 comp rx=0 tx=0).stop 2024-04-25T09:10:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff935420000 1 -- 172.21.15.173:0/4052090979 shutdown_connections 2024-04-25T09:10:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff935420000 1 --2- 172.21.15.173:0/4052090979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d805520 0x56519d805900 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff935420000 1 --2- 172.21.15.173:0/4052090979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d84ed10 0x56519d804fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff935420000 1 --2- 172.21.15.173:0/4052090979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d84e3f0 0x56519d84e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff935420000 1 -- 172.21.15.173:0/4052090979 >> 172.21.15.173:0/4052090979 conn(0x56519d8014d0 msgr2=0x56519d8038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff935420000 1 -- 172.21.15.173:0/4052090979 shutdown_connections 2024-04-25T09:10:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff935420000 1 -- 172.21.15.173:0/4052090979 wait complete. 2024-04-25T09:10:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff935420000 1 -- start start 2024-04-25T09:10:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff935420000 1 Processor -- start 2024-04-25T09:10:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff935420000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d805520 0x56519d859bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff935420000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d84e3f0 0x56519d85a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff935420000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d84ed10 0x56519d840430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff935420000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56519d5f8610 con 0x56519d84ed10 2024-04-25T09:10:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff935420000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56519d60d9a0 con 0x56519d84e3f0 2024-04-25T09:10:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.995+0000 7ff935420000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56519d657380 con 0x56519d805520 2024-04-25T09:10:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff935420000 10 client.0 _ll_register_callbacks cb 0x56519d7070d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff92aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d84e3f0 0x56519d85a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff92be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d84ed10 0x56519d840430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff92aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d84e3f0 0x56519d85a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:54268/0 (socket says 172.21.15.173:54268) 2024-04-25T09:10:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff92aa00640 1 -- 172.21.15.173:0/991375881 learned_addr learned my addr 172.21.15.173:0/991375881 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff92b400640 1 --2- 172.21.15.173:0/991375881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d805520 0x56519d859bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff92be00640 1 -- 172.21.15.173:0/991375881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d805520 msgr2=0x56519d859bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff92be00640 1 --2- 172.21.15.173:0/991375881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d805520 0x56519d859bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff92be00640 1 -- 172.21.15.173:0/991375881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d84e3f0 msgr2=0x56519d85a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff92be00640 1 --2- 172.21.15.173:0/991375881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d84e3f0 0x56519d85a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff92be00640 1 -- 172.21.15.173:0/991375881 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56519d64dd40 con 0x56519d84ed10 2024-04-25T09:10:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff92be00640 1 --2- 172.21.15.173:0/991375881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d84ed10 0x56519d840430 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0d0730 tx=0x7ff9240046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d67ed952ee076 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff914c00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:10:56.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff914c00640 1 -- 172.21.15.173:0/991375881 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924013ce0 con 0x56519d84ed10 2024-04-25T09:10:56.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff914c00640 1 -- 172.21.15.173:0/991375881 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7ff92402ccd0 con 0x56519d84ed10 2024-04-25T09:10:56.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff935420000 1 -- 172.21.15.173:0/991375881 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff9240043e0 con 0x56519d84ed10 2024-04-25T09:10:56.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff914c00640 1 -- 172.21.15.173:0/991375881 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff924013e80 con 0x56519d84ed10 2024-04-25T09:10:56.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff935420000 10 client.8376 fetch_fsmap learned FSMap version 72 2024-04-25T09:10:56.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff935420000 1 -- 172.21.15.173:0/991375881 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x56519d6d5f00 con 0x56519d84ed10 2024-04-25T09:10:56.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff914c00640 1 -- 172.21.15.173:0/991375881 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9240043e0 con 0x56519d84ed10 2024-04-25T09:10:56.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff914c00640 1 -- 172.21.15.173:0/991375881 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff924003620 con 0x56519d84ed10 2024-04-25T09:10:56.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff935420000 10 client.8376 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:10:56.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff935420000 10 client.8376 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:10:56.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff935420000 20 client.8376 populate_metadata read hostname 'smithi173' 2024-04-25T09:10:56.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff935420000 1 --2- 172.21.15.173:0/991375881 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x56519d8411a0 0x56519d841580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:56.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff935420000 4 client.8376 mds_command: new command op to 8193 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:56.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff935420000 1 -- 172.21.15.173:0/991375881 --> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56519d5eea20 con 0x56519d8411a0 2024-04-25T09:10:56.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff92b400640 1 --2- 172.21.15.173:0/991375881 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x56519d8411a0 0x56519d841580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:56.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff914c00640 10 client.8376 ms_handle_connect on v2:172.21.15.173:6835/1492125936 2024-04-25T09:10:56.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff92b400640 1 --2- 172.21.15.173:0/991375881 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x56519d8411a0 0x56519d841580 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cb9d2eec4a859bd server_cookie=55f80adc47435805 in_seq=0 out_seq=0 2024-04-25T09:10:56.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff914c00640 1 -- 172.21.15.173:0/991375881 <== mds.0 v2:172.21.15.173:6835/1492125936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56519d5eea20 con 0x56519d8411a0 2024-04-25T09:10:56.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff914c00640 10 client.8376 handle_command_reply: tid=0 2024-04-25T09:10:56.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:56.999+0000 7ff935420000 1 client.8376 shutdown 2024-04-25T09:10:56.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.003+0000 7ff935420000 1 -- 172.21.15.173:0/991375881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d84ed10 msgr2=0x56519d840430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:56.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.003+0000 7ff935420000 1 --2- 172.21.15.173:0/991375881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d84ed10 0x56519d840430 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0d0730 tx=0x7ff9240046d0 comp rx=0 tx=0).stop 2024-04-25T09:10:56.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.003+0000 7ff935420000 1 -- 172.21.15.173:0/991375881 shutdown_connections 2024-04-25T09:10:56.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.003+0000 7ff935420000 1 --2- 172.21.15.173:0/991375881 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x56519d8411a0 0x56519d841580 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:56.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.003+0000 7ff935420000 1 --2- 172.21.15.173:0/991375881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d84ed10 0x56519d840430 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:56.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.003+0000 7ff914c00640 0 client.8376 ms_handle_reset on v2:172.21.15.173:6835/1492125936 2024-04-25T09:10:56.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.003+0000 7ff935420000 1 --2- 172.21.15.173:0/991375881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d84e3f0 0x56519d85a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:56.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.003+0000 7ff935420000 1 --2- 172.21.15.173:0/991375881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d805520 0x56519d859bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:56.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.003+0000 7ff935420000 1 -- 172.21.15.173:0/991375881 >> 172.21.15.173:0/991375881 conn(0x56519d8014d0 msgr2=0x56519d804150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:56.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.003+0000 7ff935420000 1 -- 172.21.15.173:0/991375881 shutdown_connections 2024-04-25T09:10:56.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.003+0000 7ff935420000 1 -- 172.21.15.173:0/991375881 wait complete. 2024-04-25T09:10:56.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.003+0000 7ff935420000 20 client.8376 trim_cache size 0 max 16384 2024-04-25T09:10:57.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff935420000 1 Processor -- start 2024-04-25T09:10:57.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff935420000 1 -- start start 2024-04-25T09:10:57.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff935420000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d805520 0x56519d80ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff935420000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d84e3f0 0x56519d80b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff935420000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d84ed10 0x56519d85fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff935420000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c1ff990 con 0x56519d84e3f0 2024-04-25T09:10:57.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff935420000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c0cf180 con 0x56519d805520 2024-04-25T09:10:57.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff935420000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c0ce580 con 0x56519d84ed10 2024-04-25T09:10:57.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff92aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d84e3f0 0x56519d80b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff92aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d84e3f0 0x56519d80b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56512/0 (socket says 172.21.15.173:56512) 2024-04-25T09:10:57.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff92aa00640 1 -- 172.21.15.173:0/2483609371 learned_addr learned my addr 172.21.15.173:0/2483609371 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:57.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff92b400640 1 --2- 172.21.15.173:0/2483609371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d805520 0x56519d80ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff92be00640 1 --2- 172.21.15.173:0/2483609371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d84ed10 0x56519d85fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff92aa00640 1 -- 172.21.15.173:0/2483609371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d84ed10 msgr2=0x56519d85fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff92aa00640 1 --2- 172.21.15.173:0/2483609371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d84ed10 0x56519d85fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff92aa00640 1 -- 172.21.15.173:0/2483609371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d805520 msgr2=0x56519d80ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff92aa00640 1 --2- 172.21.15.173:0/2483609371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d805520 0x56519d80ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff92aa00640 1 -- 172.21.15.173:0/2483609371 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56519d6ac330 con 0x56519d84e3f0 2024-04-25T09:10:57.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff92aa00640 1 --2- 172.21.15.173:0/2483609371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d84e3f0 0x56519d80b260 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7ff918001850 tx=0x7ff91800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503fec446862b237 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff917400640 1 -- 172.21.15.173:0/2483609371 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918028030 con 0x56519d84e3f0 2024-04-25T09:10:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff917400640 1 -- 172.21.15.173:0/2483609371 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff918001d10 con 0x56519d84e3f0 2024-04-25T09:10:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.019+0000 7ff917400640 1 -- 172.21.15.173:0/2483609371 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918014ba0 con 0x56519d84e3f0 2024-04-25T09:10:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 -- 172.21.15.173:0/2483609371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d84e3f0 msgr2=0x56519d80b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 --2- 172.21.15.173:0/2483609371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d84e3f0 0x56519d80b260 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7ff918001850 tx=0x7ff91800c000 comp rx=0 tx=0).stop 2024-04-25T09:10:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 -- 172.21.15.173:0/2483609371 shutdown_connections 2024-04-25T09:10:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 --2- 172.21.15.173:0/2483609371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d84ed10 0x56519d85fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 --2- 172.21.15.173:0/2483609371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d84e3f0 0x56519d80b260 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 --2- 172.21.15.173:0/2483609371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d805520 0x56519d80ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 -- 172.21.15.173:0/2483609371 >> 172.21.15.173:0/2483609371 conn(0x56519d8014d0 msgr2=0x56519d804150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 -- 172.21.15.173:0/2483609371 shutdown_connections 2024-04-25T09:10:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 -- 172.21.15.173:0/2483609371 wait complete. 2024-04-25T09:10:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 -- start start 2024-04-25T09:10:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 Processor -- start 2024-04-25T09:10:57.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d805520 0x56519d8b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d84e3f0 0x56519d8b3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d84ed10 0x56519d867040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56519d609dc0 con 0x56519d805520 2024-04-25T09:10:57.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c0ceb80 con 0x56519d84ed10 2024-04-25T09:10:57.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56519d652060 con 0x56519d84e3f0 2024-04-25T09:10:57.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 10 client.0 _ll_register_callbacks cb 0x7ff910004710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:57.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff92b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d805520 0x56519d8b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff92b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d805520 0x56519d8b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56528/0 (socket says 172.21.15.173:56528) 2024-04-25T09:10:57.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff92b400640 1 -- 172.21.15.173:0/3012026863 learned_addr learned my addr 172.21.15.173:0/3012026863 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:57.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff92be00640 1 --2- 172.21.15.173:0/3012026863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d84ed10 0x56519d867040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff92b400640 1 -- 172.21.15.173:0/3012026863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d84e3f0 msgr2=0x56519d8b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff92aa00640 1 --2- 172.21.15.173:0/3012026863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d84e3f0 0x56519d8b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff92b400640 1 --2- 172.21.15.173:0/3012026863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d84e3f0 0x56519d8b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff92b400640 1 -- 172.21.15.173:0/3012026863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d84ed10 msgr2=0x56519d867040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff92b400640 1 --2- 172.21.15.173:0/3012026863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d84ed10 0x56519d867040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff92b400640 1 -- 172.21.15.173:0/3012026863 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56519d61f5f0 con 0x56519d805520 2024-04-25T09:10:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff92be00640 1 --2- 172.21.15.173:0/3012026863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d84ed10 0x56519d867040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff92aa00640 1 --2- 172.21.15.173:0/3012026863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d84e3f0 0x56519d8b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff92b400640 1 --2- 172.21.15.173:0/3012026863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d805520 0x56519d8b3030 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0ef2e0 tx=0x7ff91c0f3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2bb8ed10487dd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff914c00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:10:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff914c00640 1 -- 172.21.15.173:0/3012026863 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c0f7cf0 con 0x56519d805520 2024-04-25T09:10:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff914c00640 1 -- 172.21.15.173:0/3012026863 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7ff91c11d280 con 0x56519d805520 2024-04-25T09:10:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 -- 172.21.15.173:0/3012026863 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff918001d10 con 0x56519d805520 2024-04-25T09:10:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff914c00640 1 -- 172.21.15.173:0/3012026863 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff91c107120 con 0x56519d805520 2024-04-25T09:10:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 10 client.8382 fetch_fsmap learned FSMap version 72 2024-04-25T09:10:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 -- 172.21.15.173:0/3012026863 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x56519d5f9fe0 con 0x56519d805520 2024-04-25T09:10:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff914c00640 1 -- 172.21.15.173:0/3012026863 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff918001d10 con 0x56519d805520 2024-04-25T09:10:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff914c00640 1 -- 172.21.15.173:0/3012026863 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff91c0ebc50 con 0x56519d805520 2024-04-25T09:10:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 10 client.8382 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:10:57.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 10 client.8382 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:10:57.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 20 client.8382 populate_metadata read hostname 'smithi173' 2024-04-25T09:10:57.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 --2- 172.21.15.173:0/3012026863 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x56519d867a00 0x56519d867de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 4 client.8382 mds_command: new command op to 8193 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-04-25T09:10:57.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff935420000 1 -- 172.21.15.173:0/3012026863 --> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x56519d660290 con 0x56519d867a00 2024-04-25T09:10:57.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.023+0000 7ff92aa00640 1 --2- 172.21.15.173:0/3012026863 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x56519d867a00 0x56519d867de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.027+0000 7ff92aa00640 1 --2- 172.21.15.173:0/3012026863 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x56519d867a00 0x56519d867de0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=509c0255a24bc67f server_cookie=fc919971039f02df in_seq=0 out_seq=0 2024-04-25T09:10:57.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.027+0000 7ff914c00640 10 client.8382 ms_handle_connect on v2:172.21.15.173:6835/1492125936 2024-04-25T09:10:57.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.027+0000 7ff914c00640 1 -- 172.21.15.173:0/3012026863 <== mds.0 v2:172.21.15.173:6835/1492125936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56519d660290 con 0x56519d867a00 2024-04-25T09:10:57.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.027+0000 7ff914c00640 10 client.8382 handle_command_reply: tid=0 2024-04-25T09:10:57.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.027+0000 7ff935420000 1 client.8382 shutdown 2024-04-25T09:10:57.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.027+0000 7ff935420000 1 -- 172.21.15.173:0/3012026863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d805520 msgr2=0x56519d8b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.027+0000 7ff935420000 1 --2- 172.21.15.173:0/3012026863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d805520 0x56519d8b3030 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0ef2e0 tx=0x7ff91c0f3040 comp rx=0 tx=0).stop 2024-04-25T09:10:57.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.027+0000 7ff935420000 1 -- 172.21.15.173:0/3012026863 shutdown_connections 2024-04-25T09:10:57.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.027+0000 7ff935420000 1 --2- 172.21.15.173:0/3012026863 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x56519d867a00 0x56519d867de0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.027+0000 7ff935420000 1 --2- 172.21.15.173:0/3012026863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56519d84ed10 0x56519d867040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.027+0000 7ff935420000 1 --2- 172.21.15.173:0/3012026863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56519d84e3f0 0x56519d8b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.027+0000 7ff935420000 1 --2- 172.21.15.173:0/3012026863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56519d805520 0x56519d8b3030 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.027+0000 7ff935420000 1 -- 172.21.15.173:0/3012026863 >> 172.21.15.173:0/3012026863 conn(0x56519d8014d0 msgr2=0x56519d85fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:57.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.027+0000 7ff914c00640 0 client.8382 ms_handle_reset on v2:172.21.15.173:6835/1492125936 2024-04-25T09:10:57.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.027+0000 7ff935420000 1 -- 172.21.15.173:0/3012026863 shutdown_connections 2024-04-25T09:10:57.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.027+0000 7ff935420000 1 -- 172.21.15.173:0/3012026863 wait complete. 2024-04-25T09:10:57.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.027+0000 7ff935420000 20 client.8382 trim_cache size 0 max 16384 2024-04-25T09:10:57.018 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:10:57.019 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0, 2024-04-25T09:10:57.019 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_tag": "cf3e1b42-457e-4b40-832a-fa842918a107", 2024-04-25T09:10:57.019 INFO:teuthology.orchestra.run.smithi173.stdout: "mode": "asynchronous" 2024-04-25T09:10:57.019 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:10:57.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.031+0000 7ff932000640 1 -- 172.21.15.173:0/3484281244 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff90c066f90 msgr2=0x7ff90c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.031+0000 7ff932000640 1 --2- 172.21.15.173:0/3484281244 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff90c066f90 0x7ff90c069450 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff918000c10 tx=0x7ff918009040 comp rx=0 tx=0).stop 2024-04-25T09:10:57.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.031+0000 7ff932000640 1 -- 172.21.15.173:0/3484281244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9100039f0 msgr2=0x7ff92c15c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.031+0000 7ff932000640 1 --2- 172.21.15.173:0/3484281244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9100039f0 0x7ff92c15c940 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7ff91c01d0f0 tx=0x7ff910005840 comp rx=0 tx=0).stop 2024-04-25T09:10:57.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.031+0000 7ff932000640 1 -- 172.21.15.173:0/3484281244 shutdown_connections 2024-04-25T09:10:57.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.031+0000 7ff932000640 1 --2- 172.21.15.173:0/3484281244 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff90c066f90 0x7ff90c069450 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.031+0000 7ff932000640 1 --2- 172.21.15.173:0/3484281244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff92c0af3c0 0x7ff92c0af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.031+0000 7ff932000640 1 --2- 172.21.15.173:0/3484281244 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff92c15d990 0x7ff92c15adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.031+0000 7ff932000640 1 --2- 172.21.15.173:0/3484281244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9100039f0 0x7ff92c15c940 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.031+0000 7ff932000640 1 -- 172.21.15.173:0/3484281244 >> 172.21.15.173:0/3484281244 conn(0x7ff92c06ac90 msgr2=0x7ff92c13f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:57.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.031+0000 7ff932000640 1 -- 172.21.15.173:0/3484281244 shutdown_connections 2024-04-25T09:10:57.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.031+0000 7ff932000640 1 -- 172.21.15.173:0/3484281244 wait complete. 2024-04-25T09:10:57.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:57.043 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub pause 2024-04-25T09:10:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.227+0000 7fed01600640 1 Processor -- start 2024-04-25T09:10:57.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.227+0000 7fed01600640 1 -- start start 2024-04-25T09:10:57.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.231+0000 7fed01600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fecfc1616e0 0x7fecfc161b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.231+0000 7fed01600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecfc162160 con 0x7fecfc0ce0b0 2024-04-25T09:10:57.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.231+0000 7fed01600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecfc162440 con 0x7fecfc15dc70 2024-04-25T09:10:57.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.231+0000 7fed01600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecfc15e050 con 0x7fecfc1616e0 2024-04-25T09:10:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.231+0000 7fecf3e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fecfc1616e0 0x7fecfc161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.231+0000 7fecfb400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fecfc0ce0b0 0x7fecfc0d00d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36714/0 (socket says 172.21.15.173:36714) 2024-04-25T09:10:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.231+0000 7fecfb400640 1 -- 172.21.15.173:0/285660596 learned_addr learned my addr 172.21.15.173:0/285660596 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.231+0000 7fecfa000640 1 -- 172.21.15.173:0/285660596 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213579903 0 0) 0x7fecfc162160 con 0x7fecfc0ce0b0 2024-04-25T09:10:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.231+0000 7fecf3e00640 1 -- 172.21.15.173:0/285660596 >> v1:172.21.15.194:6789/0 conn(0x7fecfc15dc70 legacy=0x7fecfc06bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.231+0000 7fecf3e00640 1 -- 172.21.15.173:0/285660596 >> v1:172.21.15.173:6789/0 conn(0x7fecfc0ce0b0 legacy=0x7fecfc0d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.231+0000 7fecf3e00640 1 -- 172.21.15.173:0/285660596 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc0cf8d0 con 0x7fecfc1616e0 2024-04-25T09:10:57.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.235+0000 7fecf3e00640 1 --2- 172.21.15.173:0/285660596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecfc1616e0 0x7fecfc161b50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fece40097f0 tx=0x7fece401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce57f71f28e5b01b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.235+0000 7fecfa000640 1 -- 172.21.15.173:0/285660596 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece40b5070 con 0x7fecfc1616e0 2024-04-25T09:10:57.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.235+0000 7fecfa000640 1 -- 172.21.15.173:0/285660596 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece40a8990 con 0x7fecfc1616e0 2024-04-25T09:10:57.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.235+0000 7fecfa000640 1 -- 172.21.15.173:0/285660596 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece40a8d60 con 0x7fecfc1616e0 2024-04-25T09:10:57.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.235+0000 7fed01600640 1 -- 172.21.15.173:0/285660596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecfc1616e0 msgr2=0x7fecfc161b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.235+0000 7fed01600640 1 --2- 172.21.15.173:0/285660596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecfc1616e0 0x7fecfc161b50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fece40097f0 tx=0x7fece401ec90 comp rx=0 tx=0).stop 2024-04-25T09:10:57.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.235+0000 7fed01600640 1 -- 172.21.15.173:0/285660596 shutdown_connections 2024-04-25T09:10:57.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.235+0000 7fed01600640 1 --2- 172.21.15.173:0/285660596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecfc1616e0 0x7fecfc161b50 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.235+0000 7fed01600640 1 -- 172.21.15.173:0/285660596 >> 172.21.15.173:0/285660596 conn(0x7fecfc06f5b0 msgr2=0x7fecfc06f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:57.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.235+0000 7fed01600640 1 -- 172.21.15.173:0/285660596 shutdown_connections 2024-04-25T09:10:57.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.235+0000 7fed01600640 1 -- 172.21.15.173:0/285660596 wait complete. 2024-04-25T09:10:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.235+0000 7fed01600640 1 Processor -- start 2024-04-25T09:10:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fed01600640 1 -- start start 2024-04-25T09:10:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fed01600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecfc0ce0b0 0x7fecfc1522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fed01600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecfc15dc70 0x7fecfc0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fed01600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fecfc1616e0 0x7fecfc0b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fed01600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0cfc40 con 0x7fecfc15dc70 2024-04-25T09:10:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fed01600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0d07e0 con 0x7fecfc0ce0b0 2024-04-25T09:10:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fed01600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0d0960 con 0x7fecfc1616e0 2024-04-25T09:10:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fecf3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecfc15dc70 0x7fecfc0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fecf3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecfc15dc70 0x7fecfc0b4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56544/0 (socket says 172.21.15.173:56544) 2024-04-25T09:10:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fecf3e00640 1 -- 172.21.15.173:0/4082320492 learned_addr learned my addr 172.21.15.173:0/4082320492 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fecfb400640 1 --2- 172.21.15.173:0/4082320492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fecfc1616e0 0x7fecfc0b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fecfaa00640 1 --2- 172.21.15.173:0/4082320492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecfc0ce0b0 0x7fecfc1522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fecf3e00640 1 -- 172.21.15.173:0/4082320492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fecfc1616e0 msgr2=0x7fecfc0b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fecf3e00640 1 --2- 172.21.15.173:0/4082320492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fecfc1616e0 0x7fecfc0b6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fecf3e00640 1 -- 172.21.15.173:0/4082320492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecfc0ce0b0 msgr2=0x7fecfc1522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fecf3e00640 1 --2- 172.21.15.173:0/4082320492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecfc0ce0b0 0x7fecfc1522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fecf3e00640 1 -- 172.21.15.173:0/4082320492 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc156cf0 con 0x7fecfc15dc70 2024-04-25T09:10:57.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fecf3e00640 1 --2- 172.21.15.173:0/4082320492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecfc15dc70 0x7fecfc0b4cb0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fece4009740 tx=0x7fece401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fecf2a00640 1 -- 172.21.15.173:0/4082320492 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece40c1070 con 0x7fecfc15dc70 2024-04-25T09:10:57.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fecf2a00640 1 -- 172.21.15.173:0/4082320492 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece40b0880 con 0x7fecfc15dc70 2024-04-25T09:10:57.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fecf2a00640 1 -- 172.21.15.173:0/4082320492 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece40b5040 con 0x7fecfc15dc70 2024-04-25T09:10:57.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fed01600640 1 -- 172.21.15.173:0/4082320492 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecfc156fd0 con 0x7fecfc15dc70 2024-04-25T09:10:57.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.239+0000 7fed01600640 1 -- 172.21.15.173:0/4082320492 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecfc157590 con 0x7fecfc15dc70 2024-04-25T09:10:57.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fecf2a00640 1 -- 172.21.15.173:0/4082320492 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fece40b0c70 con 0x7fecfc15dc70 2024-04-25T09:10:57.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fed04a01000 1 Processor -- start 2024-04-25T09:10:57.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fed04a01000 1 -- start start 2024-04-25T09:10:57.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fecf2a00640 1 --2- 172.21.15.173:0/4082320492 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fecd8066f90 0x7fecd8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fecf2a00640 1 -- 172.21.15.173:0/4082320492 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fece41222c0 con 0x7fecfc15dc70 2024-04-25T09:10:57.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fecfb400640 1 --2- 172.21.15.173:0/4082320492 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fecd8066f90 0x7fecd8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fed04a01000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161cda40 0x556b161cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fed04a01000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b161ce360 0x556b16188850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fed04a01000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 0x556b16189170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fed04a01000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b1606b1f0 con 0x556b16188d90 2024-04-25T09:10:57.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fed04a01000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b15fd1e90 con 0x556b161cda40 2024-04-25T09:10:57.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fed04a01000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x556b15f59f50 con 0x556b161ce360 2024-04-25T09:10:57.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fecfaa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161cda40 0x556b161cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fecf3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b161ce360 0x556b16188850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fecfb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 0x556b16189170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fecfaa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161cda40 0x556b161cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:54316/0 (socket says 172.21.15.173:54316) 2024-04-25T09:10:57.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fecfaa00640 1 -- 172.21.15.173:0/400314353 learned_addr learned my addr 172.21.15.173:0/400314353 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:57.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fecf3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b161ce360 0x556b16188850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:53190/0 (socket says 172.21.15.173:53190) 2024-04-25T09:10:57.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.243+0000 7fecfb400640 1 --2- 172.21.15.173:0/4082320492 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fecd8066f90 0x7fecd8069450 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fecfc1e7ed0 tx=0x7fecf4007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fecfaa00640 1 -- 172.21.15.173:0/400314353 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b161ce360 msgr2=0x556b16188850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fecfaa00640 1 --2- 172.21.15.173:0/400314353 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b161ce360 0x556b16188850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fecfaa00640 1 -- 172.21.15.173:0/400314353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 msgr2=0x556b16189170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fecfaa00640 1 --2- 172.21.15.173:0/400314353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 0x556b16189170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fecfaa00640 1 -- 172.21.15.173:0/400314353 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b15fa98b0 con 0x556b161cda40 2024-04-25T09:10:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fecfaa00640 1 --2- 172.21.15.173:0/400314353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161cda40 0x556b161cde20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fecec0015e0 tx=0x7fecec001aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ce184cfc0294097 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7feceb400640 1 -- 172.21.15.173:0/400314353 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec019070 con 0x556b161cda40 2024-04-25T09:10:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7feceb400640 1 -- 172.21.15.173:0/400314353 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec001cf0 con 0x556b161cda40 2024-04-25T09:10:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7feceb400640 1 -- 172.21.15.173:0/400314353 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec00e740 con 0x556b161cda40 2024-04-25T09:10:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fed04a01000 1 -- 172.21.15.173:0/400314353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161cda40 msgr2=0x556b161cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fed04a01000 1 --2- 172.21.15.173:0/400314353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161cda40 0x556b161cde20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fecec0015e0 tx=0x7fecec001aa0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fed04a01000 1 -- 172.21.15.173:0/400314353 shutdown_connections 2024-04-25T09:10:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fed04a01000 1 --2- 172.21.15.173:0/400314353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 0x556b16189170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fed04a01000 1 --2- 172.21.15.173:0/400314353 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b161ce360 0x556b16188850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fed04a01000 1 --2- 172.21.15.173:0/400314353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161cda40 0x556b161cde20 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fed04a01000 1 -- 172.21.15.173:0/400314353 >> 172.21.15.173:0/400314353 conn(0x556b16184d40 msgr2=0x556b16187130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fed04a01000 1 -- 172.21.15.173:0/400314353 shutdown_connections 2024-04-25T09:10:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fed04a01000 1 -- 172.21.15.173:0/400314353 wait complete. 2024-04-25T09:10:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fed04a01000 1 -- start start 2024-04-25T09:10:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fed04a01000 1 Processor -- start 2024-04-25T09:10:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fed04a01000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b16188d90 0x556b161d51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fed04a01000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b161cda40 0x556b161d5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fed04a01000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161ce360 0x556b1618ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fed04a01000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b15f8c540 con 0x556b161cda40 2024-04-25T09:10:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fed04a01000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b15fcdf30 con 0x556b161ce360 2024-04-25T09:10:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fed04a01000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x556b15f7d260 con 0x556b16188d90 2024-04-25T09:10:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fed04a01000 10 client.0 _ll_register_callbacks cb 0x556b16086180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fecf3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b161cda40 0x556b161d5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fecf3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b161cda40 0x556b161d5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56558/0 (socket says 172.21.15.173:56558) 2024-04-25T09:10:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fecf3e00640 1 -- 172.21.15.173:0/1324090194 learned_addr learned my addr 172.21.15.173:0/1324090194 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fecfaa00640 1 --2- 172.21.15.173:0/1324090194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b16188d90 0x556b161d51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fecfb400640 1 --2- 172.21.15.173:0/1324090194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161ce360 0x556b1618ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fecf3e00640 1 -- 172.21.15.173:0/1324090194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b16188d90 msgr2=0x556b161d51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fecf3e00640 1 --2- 172.21.15.173:0/1324090194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b16188d90 0x556b161d51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fecf3e00640 1 -- 172.21.15.173:0/1324090194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161ce360 msgr2=0x556b1618ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fecf3e00640 1 --2- 172.21.15.173:0/1324090194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161ce360 0x556b1618ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.247+0000 7fecf3e00640 1 -- 172.21.15.173:0/1324090194 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556b15f5a1a0 con 0x556b161cda40 2024-04-25T09:10:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fecf3e00640 1 --2- 172.21.15.173:0/1324090194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b161cda40 0x556b161d5700 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fece40b0fd0 tx=0x7fece40f2430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8466362c13468012 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fecdfe00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:10:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fecdfe00640 1 -- 172.21.15.173:0/1324090194 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece40f6b60 con 0x556b161cda40 2024-04-25T09:10:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fecdfe00640 1 -- 172.21.15.173:0/1324090194 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fece40f2c70 con 0x556b161cda40 2024-04-25T09:10:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 1 -- 172.21.15.173:0/1324090194 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fecec001cf0 con 0x556b161cda40 2024-04-25T09:10:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fecdfe00640 1 -- 172.21.15.173:0/1324090194 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7fece40fb120 con 0x556b161cda40 2024-04-25T09:10:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 10 client.8394 fetch_fsmap learned FSMap version 72 2024-04-25T09:10:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 1 -- 172.21.15.173:0/1324090194 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x556b16054840 con 0x556b161cda40 2024-04-25T09:10:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fecdfe00640 1 -- 172.21.15.173:0/1324090194 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec001cf0 con 0x556b161cda40 2024-04-25T09:10:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fecdfe00640 1 -- 172.21.15.173:0/1324090194 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fece40b8070 con 0x556b161cda40 2024-04-25T09:10:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 10 client.8394 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:10:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 10 client.8394 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:10:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 20 client.8394 populate_metadata read hostname 'smithi173' 2024-04-25T09:10:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 1 --2- 172.21.15.173:0/1324090194 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x556b1618fbe0 0x556b1618ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 4 client.8394 mds_command: new command op to 8193 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 1 -- 172.21.15.173:0/1324090194 --> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556b15f6dbe0 con 0x556b1618fbe0 2024-04-25T09:10:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fecfaa00640 1 --2- 172.21.15.173:0/1324090194 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x556b1618fbe0 0x556b1618ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fecfaa00640 1 --2- 172.21.15.173:0/1324090194 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x556b1618fbe0 0x556b1618ffc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c9a9bfe22861b20 server_cookie=4d13d3c36d1996ac in_seq=0 out_seq=0 2024-04-25T09:10:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fecdfe00640 10 client.8394 ms_handle_connect on v2:172.21.15.173:6835/1492125936 2024-04-25T09:10:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fecdfe00640 1 -- 172.21.15.173:0/1324090194 <== mds.0 v2:172.21.15.173:6835/1492125936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556b15f6dbe0 con 0x556b1618fbe0 2024-04-25T09:10:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fecdfe00640 10 client.8394 handle_command_reply: tid=0 2024-04-25T09:10:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 1 client.8394 shutdown 2024-04-25T09:10:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 1 -- 172.21.15.173:0/1324090194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b161cda40 msgr2=0x556b161d5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 1 --2- 172.21.15.173:0/1324090194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b161cda40 0x556b161d5700 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fece40b0fd0 tx=0x7fece40f2430 comp rx=0 tx=0).stop 2024-04-25T09:10:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 1 -- 172.21.15.173:0/1324090194 shutdown_connections 2024-04-25T09:10:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 1 --2- 172.21.15.173:0/1324090194 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x556b1618fbe0 0x556b1618ffc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 1 --2- 172.21.15.173:0/1324090194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161ce360 0x556b1618ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 1 --2- 172.21.15.173:0/1324090194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b161cda40 0x556b161d5700 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 1 --2- 172.21.15.173:0/1324090194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b16188d90 0x556b161d51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 1 -- 172.21.15.173:0/1324090194 >> 172.21.15.173:0/1324090194 conn(0x556b16184d40 msgr2=0x556b161879c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fecdfe00640 0 client.8394 ms_handle_reset on v2:172.21.15.173:6835/1492125936 2024-04-25T09:10:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 1 -- 172.21.15.173:0/1324090194 shutdown_connections 2024-04-25T09:10:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 1 -- 172.21.15.173:0/1324090194 wait complete. 2024-04-25T09:10:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.251+0000 7fed04a01000 20 client.8394 trim_cache size 0 max 16384 2024-04-25T09:10:57.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fed04a01000 1 Processor -- start 2024-04-25T09:10:57.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fed04a01000 1 -- start start 2024-04-25T09:10:57.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fed04a01000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 0x556b1622a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fed04a01000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161cda40 0x556b1622a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fed04a01000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b161ce360 0x556b1622ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fed04a01000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc200480 con 0x556b16188d90 2024-04-25T09:10:57.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fed04a01000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc1e93f0 con 0x556b161cda40 2024-04-25T09:10:57.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fed04a01000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc1f82e0 con 0x556b161ce360 2024-04-25T09:10:57.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fecfaa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 0x556b1622a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fecfaa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 0x556b1622a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56572/0 (socket says 172.21.15.173:56572) 2024-04-25T09:10:57.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fecfaa00640 1 -- 172.21.15.173:0/2403081715 learned_addr learned my addr 172.21.15.173:0/2403081715 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:57.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fecfb400640 1 --2- 172.21.15.173:0/2403081715 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b161ce360 0x556b1622ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fecf3e00640 1 --2- 172.21.15.173:0/2403081715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161cda40 0x556b1622a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fecfaa00640 1 -- 172.21.15.173:0/2403081715 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b161ce360 msgr2=0x556b1622ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fecfaa00640 1 --2- 172.21.15.173:0/2403081715 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b161ce360 0x556b1622ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fecfaa00640 1 -- 172.21.15.173:0/2403081715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161cda40 msgr2=0x556b1622a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fecfaa00640 1 --2- 172.21.15.173:0/2403081715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161cda40 0x556b1622a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fecfaa00640 1 -- 172.21.15.173:0/2403081715 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b1602ba10 con 0x556b16188d90 2024-04-25T09:10:57.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fecfaa00640 1 --2- 172.21.15.173:0/2403081715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 0x556b1622a290 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fecec013000 tx=0x7fecec00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f1391af5f6ca07 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7feceaa00640 1 -- 172.21.15.173:0/2403081715 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec02a070 con 0x556b16188d90 2024-04-25T09:10:57.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7feceaa00640 1 -- 172.21.15.173:0/2403081715 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec0011d0 con 0x556b16188d90 2024-04-25T09:10:57.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7feceaa00640 1 -- 172.21.15.173:0/2403081715 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec019040 con 0x556b16188d90 2024-04-25T09:10:57.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fed04a01000 1 -- 172.21.15.173:0/2403081715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 msgr2=0x556b1622a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fed04a01000 1 --2- 172.21.15.173:0/2403081715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 0x556b1622a290 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fecec013000 tx=0x7fecec00a000 comp rx=0 tx=0).stop 2024-04-25T09:10:57.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fed04a01000 1 -- 172.21.15.173:0/2403081715 shutdown_connections 2024-04-25T09:10:57.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fed04a01000 1 --2- 172.21.15.173:0/2403081715 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b161ce360 0x556b1622ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fed04a01000 1 --2- 172.21.15.173:0/2403081715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161cda40 0x556b1622a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fed04a01000 1 --2- 172.21.15.173:0/2403081715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 0x556b1622a290 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.267+0000 7fed04a01000 1 -- 172.21.15.173:0/2403081715 >> 172.21.15.173:0/2403081715 conn(0x556b16184d40 msgr2=0x556b161cc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:57.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 1 -- 172.21.15.173:0/2403081715 shutdown_connections 2024-04-25T09:10:57.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 1 -- 172.21.15.173:0/2403081715 wait complete. 2024-04-25T09:10:57.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 1 -- start start 2024-04-25T09:10:57.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 1 Processor -- start 2024-04-25T09:10:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 0x556b1622e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161cda40 0x556b1622e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b161ce360 0x556b161d2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b1608ed10 con 0x556b16188d90 2024-04-25T09:10:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc1e8df0 con 0x556b161cda40 2024-04-25T09:10:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x556b1616f5b0 con 0x556b161ce360 2024-04-25T09:10:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 10 client.0 _ll_register_callbacks cb 0x556b15f94a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fecfaa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 0x556b1622e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fecfaa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 0x556b1622e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56584/0 (socket says 172.21.15.173:56584) 2024-04-25T09:10:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fecfaa00640 1 -- 172.21.15.173:0/2554406419 learned_addr learned my addr 172.21.15.173:0/2554406419 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fecfaa00640 1 -- 172.21.15.173:0/2554406419 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b161ce360 msgr2=0x556b161d2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fecfaa00640 1 --2- 172.21.15.173:0/2554406419 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b161ce360 0x556b161d2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fecfaa00640 1 -- 172.21.15.173:0/2554406419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161cda40 msgr2=0x556b1622e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fecfaa00640 1 --2- 172.21.15.173:0/2554406419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161cda40 0x556b1622e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fecfaa00640 1 -- 172.21.15.173:0/2554406419 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556b15f66b00 con 0x556b16188d90 2024-04-25T09:10:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fecfaa00640 1 --2- 172.21.15.173:0/2554406419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 0x556b1622e2a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fecec001ae0 tx=0x7fecec000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1ab144c66f4728 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fecdfe00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:10:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fecdfe00640 1 -- 172.21.15.173:0/2554406419 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec019070 con 0x556b16188d90 2024-04-25T09:10:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fecdfe00640 1 -- 172.21.15.173:0/2554406419 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fecec001cf0 con 0x556b16188d90 2024-04-25T09:10:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 1 -- 172.21.15.173:0/2554406419 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fecec0011d0 con 0x556b16188d90 2024-04-25T09:10:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fecdfe00640 1 -- 172.21.15.173:0/2554406419 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecec036050 con 0x556b16188d90 2024-04-25T09:10:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 10 client.8400 fetch_fsmap learned FSMap version 72 2024-04-25T09:10:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 1 -- 172.21.15.173:0/2554406419 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x556b15f78f80 con 0x556b16188d90 2024-04-25T09:10:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fecdfe00640 1 -- 172.21.15.173:0/2554406419 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec0011d0 con 0x556b16188d90 2024-04-25T09:10:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fecdfe00640 1 -- 172.21.15.173:0/2554406419 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fecec039020 con 0x556b16188d90 2024-04-25T09:10:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 10 client.8400 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:10:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 10 client.8400 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:10:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 20 client.8400 populate_metadata read hostname 'smithi173' 2024-04-25T09:10:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 1 --2- 172.21.15.173:0/2554406419 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x556b161d3890 0x556b161d3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 4 client.8400 mds_command: new command op to 8193 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-04-25T09:10:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fed04a01000 1 -- 172.21.15.173:0/2554406419 --> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x556b15fdf3d0 con 0x556b161d3890 2024-04-25T09:10:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.271+0000 7fecf3e00640 1 --2- 172.21.15.173:0/2554406419 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x556b161d3890 0x556b161d3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fecf3e00640 1 --2- 172.21.15.173:0/2554406419 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x556b161d3890 0x556b161d3c70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e193b0b7c834a88 server_cookie=f851b15c95636b16 in_seq=0 out_seq=0 2024-04-25T09:10:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fecdfe00640 10 client.8400 ms_handle_connect on v2:172.21.15.173:6835/1492125936 2024-04-25T09:10:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fecdfe00640 1 -- 172.21.15.173:0/2554406419 <== mds.0 v2:172.21.15.173:6835/1492125936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x556b15fdf3d0 con 0x556b161d3890 2024-04-25T09:10:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fecdfe00640 10 client.8400 handle_command_reply: tid=0 2024-04-25T09:10:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed04a01000 1 client.8400 shutdown 2024-04-25T09:10:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed04a01000 1 -- 172.21.15.173:0/2554406419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 msgr2=0x556b1622e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed04a01000 1 --2- 172.21.15.173:0/2554406419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 0x556b1622e2a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fecec001ae0 tx=0x7fecec000ee0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed04a01000 1 -- 172.21.15.173:0/2554406419 shutdown_connections 2024-04-25T09:10:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed04a01000 1 --2- 172.21.15.173:0/2554406419 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x556b161d3890 0x556b161d3c70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed04a01000 1 --2- 172.21.15.173:0/2554406419 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556b161ce360 0x556b161d2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed04a01000 1 --2- 172.21.15.173:0/2554406419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556b161cda40 0x556b1622e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed04a01000 1 --2- 172.21.15.173:0/2554406419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b16188d90 0x556b1622e2a0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fecdfe00640 0 client.8400 ms_handle_reset on v2:172.21.15.173:6835/1492125936 2024-04-25T09:10:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed04a01000 1 -- 172.21.15.173:0/2554406419 >> 172.21.15.173:0/2554406419 conn(0x556b16184d40 msgr2=0x556b161cca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed04a01000 1 -- 172.21.15.173:0/2554406419 shutdown_connections 2024-04-25T09:10:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed04a01000 1 -- 172.21.15.173:0/2554406419 wait complete. 2024-04-25T09:10:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed04a01000 20 client.8400 trim_cache size 0 max 16384 2024-04-25T09:10:57.267 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:10:57.267 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0 2024-04-25T09:10:57.267 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:10:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed01600640 1 -- 172.21.15.173:0/4082320492 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fecd8066f90 msgr2=0x7fecd8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed01600640 1 --2- 172.21.15.173:0/4082320492 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fecd8066f90 0x7fecd8069450 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fecfc1e7ed0 tx=0x7fecf4007e90 comp rx=0 tx=0).stop 2024-04-25T09:10:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed01600640 1 -- 172.21.15.173:0/4082320492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecfc15dc70 msgr2=0x7fecfc0b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed01600640 1 --2- 172.21.15.173:0/4082320492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecfc15dc70 0x7fecfc0b4cb0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fece4009740 tx=0x7fece401ba30 comp rx=0 tx=0).stop 2024-04-25T09:10:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed01600640 1 -- 172.21.15.173:0/4082320492 shutdown_connections 2024-04-25T09:10:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed01600640 1 --2- 172.21.15.173:0/4082320492 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fecd8066f90 0x7fecd8069450 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed01600640 1 --2- 172.21.15.173:0/4082320492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fecfc1616e0 0x7fecfc0b6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed01600640 1 --2- 172.21.15.173:0/4082320492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecfc15dc70 0x7fecfc0b4cb0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed01600640 1 --2- 172.21.15.173:0/4082320492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecfc0ce0b0 0x7fecfc1522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed01600640 1 -- 172.21.15.173:0/4082320492 >> 172.21.15.173:0/4082320492 conn(0x7fecfc06f5b0 msgr2=0x7fecfc0d2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed01600640 1 -- 172.21.15.173:0/4082320492 shutdown_connections 2024-04-25T09:10:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.275+0000 7fed01600640 1 -- 172.21.15.173:0/4082320492 wait complete. 2024-04-25T09:10:57.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:57.282 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T09:10:57.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.431+0000 7fce2bc00640 1 Processor -- start 2024-04-25T09:10:57.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.431+0000 7fce2bc00640 1 -- start start 2024-04-25T09:10:57.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.431+0000 7fce2bc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fce240b3fe0 0x7fce240b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.431+0000 7fce2bc00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce2406d4b0 con 0x7fce240cc260 2024-04-25T09:10:57.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.431+0000 7fce2bc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce2406d790 con 0x7fce24145290 2024-04-25T09:10:57.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.431+0000 7fce2bc00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce240ccd80 con 0x7fce240b3fe0 2024-04-25T09:10:57.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.435+0000 7fce23e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fce240b3fe0 0x7fce240b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.435+0000 7fce29c00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fce240cc260 0x7fce240cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36716/0 (socket says 172.21.15.173:36716) 2024-04-25T09:10:57.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.435+0000 7fce29c00640 1 -- 172.21.15.173:0/4252693906 learned_addr learned my addr 172.21.15.173:0/4252693906 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:57.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.435+0000 7fce23e00640 1 -- 172.21.15.173:0/4252693906 >> v1:172.21.15.194:6789/0 conn(0x7fce24145290 legacy=0x7fce2415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.435+0000 7fce23e00640 1 -- 172.21.15.173:0/4252693906 >> v1:172.21.15.173:6789/0 conn(0x7fce240cc260 legacy=0x7fce240cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.435+0000 7fce23e00640 1 -- 172.21.15.173:0/4252693906 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2406da70 con 0x7fce240b3fe0 2024-04-25T09:10:57.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.435+0000 7fce23400640 1 -- 172.21.15.173:0/4252693906 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898322410 0 0) 0x7fce2406d4b0 con 0x7fce240cc260 2024-04-25T09:10:57.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.435+0000 7fce23e00640 1 --2- 172.21.15.173:0/4252693906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce240b3fe0 0x7fce240b4450 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fce100097c0 tx=0x7fce1001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3069d022241844c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.435+0000 7fce23400640 1 -- 172.21.15.173:0/4252693906 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce100b0070 con 0x7fce240b3fe0 2024-04-25T09:10:57.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.435+0000 7fce23400640 1 -- 172.21.15.173:0/4252693906 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce100ab600 con 0x7fce240b3fe0 2024-04-25T09:10:57.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.435+0000 7fce23400640 1 -- 172.21.15.173:0/4252693906 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce100ab9d0 con 0x7fce240b3fe0 2024-04-25T09:10:57.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce2bc00640 1 -- 172.21.15.173:0/4252693906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce240b3fe0 msgr2=0x7fce240b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce2bc00640 1 --2- 172.21.15.173:0/4252693906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce240b3fe0 0x7fce240b4450 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fce100097c0 tx=0x7fce1001c380 comp rx=0 tx=0).stop 2024-04-25T09:10:57.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce2bc00640 1 -- 172.21.15.173:0/4252693906 shutdown_connections 2024-04-25T09:10:57.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce2bc00640 1 --2- 172.21.15.173:0/4252693906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce240b3fe0 0x7fce240b4450 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce2bc00640 1 -- 172.21.15.173:0/4252693906 >> 172.21.15.173:0/4252693906 conn(0x7fce2406ac90 msgr2=0x7fce2406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:57.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce2bc00640 1 -- 172.21.15.173:0/4252693906 shutdown_connections 2024-04-25T09:10:57.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce2bc00640 1 -- 172.21.15.173:0/4252693906 wait complete. 2024-04-25T09:10:57.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce2bc00640 1 Processor -- start 2024-04-25T09:10:57.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce2bc00640 1 -- start start 2024-04-25T09:10:57.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce2bc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce240b3fe0 0x7fce2415ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce2bc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce240cc260 0x7fce2413e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce2bc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce24145290 0x7fce2413eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce2bc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2406eee0 con 0x7fce240b3fe0 2024-04-25T09:10:57.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce2bc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2406ed60 con 0x7fce240cc260 2024-04-25T09:10:57.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce2bc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2406f060 con 0x7fce24145290 2024-04-25T09:10:57.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce29200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce240b3fe0 0x7fce2415ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce29200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce240b3fe0 0x7fce2415ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56606/0 (socket says 172.21.15.173:56606) 2024-04-25T09:10:57.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce29200640 1 -- 172.21.15.173:0/4284534330 learned_addr learned my addr 172.21.15.173:0/4284534330 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce29c00640 1 --2- 172.21.15.173:0/4284534330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce24145290 0x7fce2413eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce23e00640 1 --2- 172.21.15.173:0/4284534330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce240cc260 0x7fce2413e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce29200640 1 -- 172.21.15.173:0/4284534330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce24145290 msgr2=0x7fce2413eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce29200640 1 --2- 172.21.15.173:0/4284534330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce24145290 0x7fce2413eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce29200640 1 -- 172.21.15.173:0/4284534330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce240cc260 msgr2=0x7fce2413e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce29200640 1 --2- 172.21.15.173:0/4284534330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce240cc260 0x7fce2413e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce29200640 1 -- 172.21.15.173:0/4284534330 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2415c990 con 0x7fce240b3fe0 2024-04-25T09:10:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.439+0000 7fce23e00640 1 --2- 172.21.15.173:0/4284534330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce240cc260 0x7fce2413e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.443+0000 7fce29200640 1 --2- 172.21.15.173:0/4284534330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce240b3fe0 0x7fce2415ab90 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fce1800c500 tx=0x7fce1800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.443+0000 7fce20c00640 1 -- 172.21.15.173:0/4284534330 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18016020 con 0x7fce240b3fe0 2024-04-25T09:10:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.443+0000 7fce20c00640 1 -- 172.21.15.173:0/4284534330 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce18005220 con 0x7fce240b3fe0 2024-04-25T09:10:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.443+0000 7fce20c00640 1 -- 172.21.15.173:0/4284534330 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18007030 con 0x7fce240b3fe0 2024-04-25T09:10:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.443+0000 7fce2bc00640 1 -- 172.21.15.173:0/4284534330 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2415cc70 con 0x7fce240b3fe0 2024-04-25T09:10:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.443+0000 7fce2bc00640 1 -- 172.21.15.173:0/4284534330 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce2415d230 con 0x7fce240b3fe0 2024-04-25T09:10:57.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.443+0000 7fce20c00640 1 -- 172.21.15.173:0/4284534330 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fce180071d0 con 0x7fce240b3fe0 2024-04-25T09:10:57.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.443+0000 7fce20c00640 1 --2- 172.21.15.173:0/4284534330 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce04066f60 0x7fce04069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.443+0000 7fce20c00640 1 -- 172.21.15.173:0/4284534330 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fce18084c60 con 0x7fce240b3fe0 2024-04-25T09:10:57.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.443+0000 7fce23e00640 1 --2- 172.21.15.173:0/4284534330 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce04066f60 0x7fce04069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.443+0000 7fce2f15d000 1 Processor -- start 2024-04-25T09:10:57.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.443+0000 7fce2f15d000 1 -- start start 2024-04-25T09:10:57.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce23e00640 1 --2- 172.21.15.173:0/4284534330 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce04066f60 0x7fce04069420 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fce100ad000 tx=0x7fce10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce2f15d000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c59d0 0x55ee915c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce2f15d000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c62f0 0x55ee9157bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce2f15d000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee9157c0a0 0x55ee9157c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce2f15d000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee913c8ff0 con 0x55ee915c59d0 2024-04-25T09:10:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce2f15d000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee91351150 con 0x55ee915c62f0 2024-04-25T09:10:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce2f15d000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee913c5090 con 0x55ee9157c0a0 2024-04-25T09:10:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce29200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c59d0 0x55ee915c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce29200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c59d0 0x55ee915c5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56620/0 (socket says 172.21.15.173:56620) 2024-04-25T09:10:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce29200640 1 -- 172.21.15.173:0/2601580295 learned_addr learned my addr 172.21.15.173:0/2601580295 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce29c00640 1 --2- 172.21.15.173:0/2601580295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee9157c0a0 0x55ee9157c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce23e00640 1 --2- 172.21.15.173:0/2601580295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c62f0 0x55ee9157bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce29200640 1 -- 172.21.15.173:0/2601580295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee9157c0a0 msgr2=0x55ee9157c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce29200640 1 --2- 172.21.15.173:0/2601580295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee9157c0a0 0x55ee9157c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce29200640 1 -- 172.21.15.173:0/2601580295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c62f0 msgr2=0x55ee9157bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce29200640 1 --2- 172.21.15.173:0/2601580295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c62f0 0x55ee9157bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce29200640 1 -- 172.21.15.173:0/2601580295 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee9155f0d0 con 0x55ee915c59d0 2024-04-25T09:10:57.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce29200640 1 --2- 172.21.15.173:0/2601580295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c59d0 0x55ee915c5db0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fce18082f40 tx=0x7fce18054f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b12842d6d262e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce15600640 1 -- 172.21.15.173:0/2601580295 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1805da40 con 0x55ee915c59d0 2024-04-25T09:10:57.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce15600640 1 -- 172.21.15.173:0/2601580295 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce18083050 con 0x55ee915c59d0 2024-04-25T09:10:57.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce15600640 1 -- 172.21.15.173:0/2601580295 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18010d70 con 0x55ee915c59d0 2024-04-25T09:10:57.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce2f15d000 1 -- 172.21.15.173:0/2601580295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c59d0 msgr2=0x55ee915c5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce2f15d000 1 --2- 172.21.15.173:0/2601580295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c59d0 0x55ee915c5db0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fce18082f40 tx=0x7fce18054f70 comp rx=0 tx=0).stop 2024-04-25T09:10:57.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce2f15d000 1 -- 172.21.15.173:0/2601580295 shutdown_connections 2024-04-25T09:10:57.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce2f15d000 1 --2- 172.21.15.173:0/2601580295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee9157c0a0 0x55ee9157c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce2f15d000 1 --2- 172.21.15.173:0/2601580295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c62f0 0x55ee9157bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce2f15d000 1 --2- 172.21.15.173:0/2601580295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c59d0 0x55ee915c5db0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce2f15d000 1 -- 172.21.15.173:0/2601580295 >> 172.21.15.173:0/2601580295 conn(0x55ee91578020 msgr2=0x55ee9157a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:57.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce2f15d000 1 -- 172.21.15.173:0/2601580295 shutdown_connections 2024-04-25T09:10:57.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce2f15d000 1 -- 172.21.15.173:0/2601580295 wait complete. 2024-04-25T09:10:57.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce2f15d000 1 -- start start 2024-04-25T09:10:57.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.447+0000 7fce2f15d000 1 Processor -- start 2024-04-25T09:10:57.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce2f15d000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee9157c0a0 0x55ee915aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce2f15d000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c59d0 0x55ee915aad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce2f15d000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c62f0 0x55ee915ab270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce2f15d000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee9138d250 con 0x55ee915c59d0 2024-04-25T09:10:57.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce2f15d000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee91383690 con 0x55ee915c62f0 2024-04-25T09:10:57.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce2f15d000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee91351a40 con 0x55ee9157c0a0 2024-04-25T09:10:57.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce2f15d000 10 client.0 _ll_register_callbacks cb 0x55ee91566e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:57.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce23e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c59d0 0x55ee915aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce23e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c59d0 0x55ee915aad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56628/0 (socket says 172.21.15.173:56628) 2024-04-25T09:10:57.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce29200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee9157c0a0 0x55ee915aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce23e00640 1 -- 172.21.15.173:0/1263083252 learned_addr learned my addr 172.21.15.173:0/1263083252 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:57.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce29c00640 1 --2- 172.21.15.173:0/1263083252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c62f0 0x55ee915ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce23e00640 1 -- 172.21.15.173:0/1263083252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee9157c0a0 msgr2=0x55ee915aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce23e00640 1 --2- 172.21.15.173:0/1263083252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee9157c0a0 0x55ee915aa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce23e00640 1 -- 172.21.15.173:0/1263083252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c62f0 msgr2=0x55ee915ab270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce23e00640 1 --2- 172.21.15.173:0/1263083252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c62f0 0x55ee915ab270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce23e00640 1 -- 172.21.15.173:0/1263083252 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee914761c0 con 0x55ee915c59d0 2024-04-25T09:10:57.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce23e00640 1 --2- 172.21.15.173:0/1263083252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c59d0 0x55ee915aad30 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fce10018f90 tx=0x7fce1001abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d721d630807e020 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce0a000640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:10:57.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce0a000640 1 -- 172.21.15.173:0/1263083252 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce100c26f0 con 0x55ee915c59d0 2024-04-25T09:10:57.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce0a000640 1 -- 172.21.15.173:0/1263083252 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fce100c2890 con 0x55ee915c59d0 2024-04-25T09:10:57.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce2f15d000 1 -- 172.21.15.173:0/1263083252 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fce18083050 con 0x55ee915c59d0 2024-04-25T09:10:57.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce0a000640 1 -- 172.21.15.173:0/1263083252 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce100d1050 con 0x55ee915c59d0 2024-04-25T09:10:57.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce2f15d000 10 client.8415 fetch_fsmap learned FSMap version 72 2024-04-25T09:10:57.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce2f15d000 1 -- 172.21.15.173:0/1263083252 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x55ee91472170 con 0x55ee915c59d0 2024-04-25T09:10:57.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce0a000640 1 -- 172.21.15.173:0/1263083252 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce18083050 con 0x55ee915c59d0 2024-04-25T09:10:57.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce0a000640 1 -- 172.21.15.173:0/1263083252 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fce100d4020 con 0x55ee915c59d0 2024-04-25T09:10:57.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce2f15d000 10 client.8415 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:10:57.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce2f15d000 10 client.8415 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:10:57.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce2f15d000 20 client.8415 populate_metadata read hostname 'smithi173' 2024-04-25T09:10:57.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce2f15d000 1 --2- 172.21.15.173:0/1263083252 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x55ee915d5c80 0x55ee915d8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce2f15d000 4 client.8415 mds_command: new command op to 8193 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:57.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce2f15d000 1 -- 172.21.15.173:0/1263083252 --> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee91364c60 con 0x55ee915d5c80 2024-04-25T09:10:57.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce29200640 1 --2- 172.21.15.173:0/1263083252 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x55ee915d5c80 0x55ee915d8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce29200640 1 --2- 172.21.15.173:0/1263083252 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x55ee915d5c80 0x55ee915d8070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=856a3d73ee2a73ed server_cookie=691ccd381f58ae40 in_seq=0 out_seq=0 2024-04-25T09:10:57.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce0a000640 10 client.8415 ms_handle_connect on v2:172.21.15.173:6835/1492125936 2024-04-25T09:10:57.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce0a000640 1 -- 172.21.15.173:0/1263083252 <== mds.0 v2:172.21.15.173:6835/1492125936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ee91364c60 con 0x55ee915d5c80 2024-04-25T09:10:57.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce0a000640 10 client.8415 handle_command_reply: tid=0 2024-04-25T09:10:57.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.451+0000 7fce2f15d000 1 client.8415 shutdown 2024-04-25T09:10:57.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.455+0000 7fce2f15d000 1 -- 172.21.15.173:0/1263083252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c59d0 msgr2=0x55ee915aad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.455+0000 7fce2f15d000 1 --2- 172.21.15.173:0/1263083252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c59d0 0x55ee915aad30 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fce10018f90 tx=0x7fce1001abc0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.455+0000 7fce2f15d000 1 -- 172.21.15.173:0/1263083252 shutdown_connections 2024-04-25T09:10:57.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.455+0000 7fce2f15d000 1 --2- 172.21.15.173:0/1263083252 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x55ee915d5c80 0x55ee915d8070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.455+0000 7fce2f15d000 1 --2- 172.21.15.173:0/1263083252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c62f0 0x55ee915ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.455+0000 7fce2f15d000 1 --2- 172.21.15.173:0/1263083252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c59d0 0x55ee915aad30 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.455+0000 7fce2f15d000 1 --2- 172.21.15.173:0/1263083252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee9157c0a0 0x55ee915aa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.455+0000 7fce2f15d000 1 -- 172.21.15.173:0/1263083252 >> 172.21.15.173:0/1263083252 conn(0x55ee91578020 msgr2=0x55ee9157aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:57.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.455+0000 7fce0a000640 0 client.8415 ms_handle_reset on v2:172.21.15.173:6835/1492125936 2024-04-25T09:10:57.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.455+0000 7fce2f15d000 1 -- 172.21.15.173:0/1263083252 shutdown_connections 2024-04-25T09:10:57.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.455+0000 7fce2f15d000 1 -- 172.21.15.173:0/1263083252 wait complete. 2024-04-25T09:10:57.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.455+0000 7fce2f15d000 20 client.8415 trim_cache size 0 max 16384 2024-04-25T09:10:57.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.467+0000 7fce2f15d000 1 Processor -- start 2024-04-25T09:10:57.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.467+0000 7fce2f15d000 1 -- start start 2024-04-25T09:10:57.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.467+0000 7fce2f15d000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee9157c0a0 0x55ee915c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.467+0000 7fce2f15d000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c59d0 0x55ee9157b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.467+0000 7fce2f15d000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee915c62f0 0x55ee9157b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.467+0000 7fce2f15d000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce24203270 con 0x55ee9157c0a0 2024-04-25T09:10:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.467+0000 7fce2f15d000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce24202410 con 0x55ee915c59d0 2024-04-25T09:10:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.467+0000 7fce2f15d000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2413c0d0 con 0x55ee915c62f0 2024-04-25T09:10:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce29200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee9157c0a0 0x55ee915c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce29200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee9157c0a0 0x55ee915c4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56634/0 (socket says 172.21.15.173:56634) 2024-04-25T09:10:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce29200640 1 -- 172.21.15.173:0/638603858 learned_addr learned my addr 172.21.15.173:0/638603858 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce29200640 1 -- 172.21.15.173:0/638603858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee915c62f0 msgr2=0x55ee9157b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce29200640 1 --2- 172.21.15.173:0/638603858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee915c62f0 0x55ee9157b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce29200640 1 -- 172.21.15.173:0/638603858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c59d0 msgr2=0x55ee9157b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce23e00640 1 --2- 172.21.15.173:0/638603858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c59d0 0x55ee9157b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce29200640 1 --2- 172.21.15.173:0/638603858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c59d0 0x55ee9157b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce29200640 1 -- 172.21.15.173:0/638603858 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee9140fde0 con 0x55ee9157c0a0 2024-04-25T09:10:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce23e00640 1 --2- 172.21.15.173:0/638603858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c59d0 0x55ee9157b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce29200640 1 --2- 172.21.15.173:0/638603858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee9157c0a0 0x55ee915c4e10 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fce18000fc0 tx=0x7fce18055230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1709cbd92c2592a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce14c00640 1 -- 172.21.15.173:0/638603858 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1805da40 con 0x55ee9157c0a0 2024-04-25T09:10:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce14c00640 1 -- 172.21.15.173:0/638603858 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce18059150 con 0x55ee9157c0a0 2024-04-25T09:10:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce14c00640 1 -- 172.21.15.173:0/638603858 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce180519a0 con 0x55ee9157c0a0 2024-04-25T09:10:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce2f15d000 1 -- 172.21.15.173:0/638603858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee9157c0a0 msgr2=0x55ee915c4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce2f15d000 1 --2- 172.21.15.173:0/638603858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee9157c0a0 0x55ee915c4e10 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fce18000fc0 tx=0x7fce18055230 comp rx=0 tx=0).stop 2024-04-25T09:10:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce2f15d000 1 -- 172.21.15.173:0/638603858 shutdown_connections 2024-04-25T09:10:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce2f15d000 1 --2- 172.21.15.173:0/638603858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee915c62f0 0x55ee9157b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce2f15d000 1 --2- 172.21.15.173:0/638603858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c59d0 0x55ee9157b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce2f15d000 1 --2- 172.21.15.173:0/638603858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee9157c0a0 0x55ee915c4e10 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce2f15d000 1 -- 172.21.15.173:0/638603858 >> 172.21.15.173:0/638603858 conn(0x55ee91578020 msgr2=0x55ee915c40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce2f15d000 1 -- 172.21.15.173:0/638603858 shutdown_connections 2024-04-25T09:10:57.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce2f15d000 1 -- 172.21.15.173:0/638603858 wait complete. 2024-04-25T09:10:57.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce2f15d000 1 -- start start 2024-04-25T09:10:57.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce2f15d000 1 Processor -- start 2024-04-25T09:10:57.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce2f15d000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee9157c0a0 0x55ee91626520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce2f15d000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c59d0 0x55ee91626a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce2f15d000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c62f0 0x55ee915d8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce2f15d000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee91363e00 con 0x55ee915c62f0 2024-04-25T09:10:57.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce2f15d000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce24201e70 con 0x55ee915c59d0 2024-04-25T09:10:57.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce2f15d000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee913c8300 con 0x55ee9157c0a0 2024-04-25T09:10:57.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce2f15d000 10 client.0 _ll_register_callbacks cb 0x55ee91547040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:57.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce29c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c62f0 0x55ee915d8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce29c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c62f0 0x55ee915d8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56642/0 (socket says 172.21.15.173:56642) 2024-04-25T09:10:57.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce29c00640 1 -- 172.21.15.173:0/3414163977 learned_addr learned my addr 172.21.15.173:0/3414163977 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:57.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce29200640 1 --2- 172.21.15.173:0/3414163977 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee9157c0a0 0x55ee91626520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.471+0000 7fce23e00640 1 --2- 172.21.15.173:0/3414163977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c59d0 0x55ee91626a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce29c00640 1 -- 172.21.15.173:0/3414163977 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee9157c0a0 msgr2=0x55ee91626520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce29c00640 1 --2- 172.21.15.173:0/3414163977 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee9157c0a0 0x55ee91626520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce29c00640 1 -- 172.21.15.173:0/3414163977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c59d0 msgr2=0x55ee91626a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce29c00640 1 --2- 172.21.15.173:0/3414163977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c59d0 0x55ee91626a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce29c00640 1 -- 172.21.15.173:0/3414163977 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee9136a8e0 con 0x55ee915c62f0 2024-04-25T09:10:57.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce29c00640 1 --2- 172.21.15.173:0/3414163977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c62f0 0x55ee915d8380 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fce1c014650 tx=0x7fce1c014b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1981d5e74ffda73c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce0a000640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:10:57.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce0a000640 1 -- 172.21.15.173:0/3414163977 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c012820 con 0x55ee915c62f0 2024-04-25T09:10:57.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce0a000640 1 -- 172.21.15.173:0/3414163977 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fce1c0129c0 con 0x55ee915c62f0 2024-04-25T09:10:57.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 1 -- 172.21.15.173:0/3414163977 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fce18059150 con 0x55ee915c62f0 2024-04-25T09:10:57.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce0a000640 1 -- 172.21.15.173:0/3414163977 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce1c026050 con 0x55ee915c62f0 2024-04-25T09:10:57.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 10 client.8421 fetch_fsmap learned FSMap version 72 2024-04-25T09:10:57.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 1 -- 172.21.15.173:0/3414163977 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x55ee914228f0 con 0x55ee915c62f0 2024-04-25T09:10:57.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce0a000640 1 -- 172.21.15.173:0/3414163977 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce18059150 con 0x55ee915c62f0 2024-04-25T09:10:57.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce0a000640 1 -- 172.21.15.173:0/3414163977 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fce1c029020 con 0x55ee915c62f0 2024-04-25T09:10:57.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 10 client.8421 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:10:57.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 10 client.8421 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:10:57.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 20 client.8421 populate_metadata read hostname 'smithi173' 2024-04-25T09:10:57.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 1 --2- 172.21.15.173:0/3414163977 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x55ee915d8f90 0x55ee915d93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 4 client.8421 mds_command: new command op to 8193 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:10:57.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 1 -- 172.21.15.173:0/3414163977 --> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ee913d6530 con 0x55ee915d8f90 2024-04-25T09:10:57.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce29200640 1 --2- 172.21.15.173:0/3414163977 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x55ee915d8f90 0x55ee915d93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce29200640 1 --2- 172.21.15.173:0/3414163977 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x55ee915d8f90 0x55ee915d93a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=985259652b8f2fa1 server_cookie=8187a9f0dd2f816d in_seq=0 out_seq=0 2024-04-25T09:10:57.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce0a000640 10 client.8421 ms_handle_connect on v2:172.21.15.173:6835/1492125936 2024-04-25T09:10:57.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce0a000640 1 -- 172.21.15.173:0/3414163977 <== mds.0 v2:172.21.15.173:6835/1492125936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x55ee913d6530 con 0x55ee915d8f90 2024-04-25T09:10:57.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce0a000640 10 client.8421 handle_command_reply: tid=0 2024-04-25T09:10:57.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 1 client.8421 shutdown 2024-04-25T09:10:57.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 1 -- 172.21.15.173:0/3414163977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c62f0 msgr2=0x55ee915d8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 1 --2- 172.21.15.173:0/3414163977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c62f0 0x55ee915d8380 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fce1c014650 tx=0x7fce1c014b10 comp rx=0 tx=0).stop 2024-04-25T09:10:57.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 1 -- 172.21.15.173:0/3414163977 shutdown_connections 2024-04-25T09:10:57.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 1 --2- 172.21.15.173:0/3414163977 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x55ee915d8f90 0x55ee915d93a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 1 --2- 172.21.15.173:0/3414163977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee915c62f0 0x55ee915d8380 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 1 --2- 172.21.15.173:0/3414163977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ee915c59d0 0x55ee91626a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 1 --2- 172.21.15.173:0/3414163977 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ee9157c0a0 0x55ee91626520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 1 -- 172.21.15.173:0/3414163977 >> 172.21.15.173:0/3414163977 conn(0x55ee91578020 msgr2=0x55ee915c4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:57.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce0a000640 0 client.8421 ms_handle_reset on v2:172.21.15.173:6835/1492125936 2024-04-25T09:10:57.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 1 -- 172.21.15.173:0/3414163977 shutdown_connections 2024-04-25T09:10:57.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 1 -- 172.21.15.173:0/3414163977 wait complete. 2024-04-25T09:10:57.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2f15d000 20 client.8421 trim_cache size 0 max 16384 2024-04-25T09:10:57.469 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:10:57.469 INFO:teuthology.orchestra.run.smithi173.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-04-25T09:10:57.469 INFO:teuthology.orchestra.run.smithi173.stdout: "scrubs": { 2024-04-25T09:10:57.469 INFO:teuthology.orchestra.run.smithi173.stdout: "cf3e1b42-457e-4b40-832a-fa842918a107": { 2024-04-25T09:10:57.469 INFO:teuthology.orchestra.run.smithi173.stdout: "path": "/scrub_control_test_path", 2024-04-25T09:10:57.469 INFO:teuthology.orchestra.run.smithi173.stdout: "tag": "cf3e1b42-457e-4b40-832a-fa842918a107", 2024-04-25T09:10:57.469 INFO:teuthology.orchestra.run.smithi173.stdout: "options": "recursive" 2024-04-25T09:10:57.469 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:57.469 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:10:57.470 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:10:57.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2bc00640 1 -- 172.21.15.173:0/4284534330 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce04066f60 msgr2=0x7fce04069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2bc00640 1 --2- 172.21.15.173:0/4284534330 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce04066f60 0x7fce04069420 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fce100ad000 tx=0x7fce10008040 comp rx=0 tx=0).stop 2024-04-25T09:10:57.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2bc00640 1 -- 172.21.15.173:0/4284534330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce240b3fe0 msgr2=0x7fce2415ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2bc00640 1 --2- 172.21.15.173:0/4284534330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce240b3fe0 0x7fce2415ab90 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fce1800c500 tx=0x7fce1800c9c0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2bc00640 1 -- 172.21.15.173:0/4284534330 shutdown_connections 2024-04-25T09:10:57.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2bc00640 1 --2- 172.21.15.173:0/4284534330 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce04066f60 0x7fce04069420 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2bc00640 1 --2- 172.21.15.173:0/4284534330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce24145290 0x7fce2413eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2bc00640 1 --2- 172.21.15.173:0/4284534330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce240cc260 0x7fce2413e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2bc00640 1 --2- 172.21.15.173:0/4284534330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce240b3fe0 0x7fce2415ab90 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2bc00640 1 -- 172.21.15.173:0/4284534330 >> 172.21.15.173:0/4284534330 conn(0x7fce2406ac90 msgr2=0x7fce240cda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:57.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2bc00640 1 -- 172.21.15.173:0/4284534330 shutdown_connections 2024-04-25T09:10:57.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.475+0000 7fce2bc00640 1 -- 172.21.15.173:0/4284534330 wait complete. 2024-04-25T09:10:57.484 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:57.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.631+0000 7f6682600640 1 Processor -- start 2024-04-25T09:10:57.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.631+0000 7f6682600640 1 -- start start 2024-04-25T09:10:57.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f6682600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f667c15a180 0x7f667c0b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f6682600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c06e860 con 0x7f667c071a30 2024-04-25T09:10:57.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f6682600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c06eb20 con 0x7f667c0b2ca0 2024-04-25T09:10:57.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f6682600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c0af230 con 0x7f667c15a180 2024-04-25T09:10:57.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667be00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f667c071a30 0x7f667c06d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36732/0 (socket says 172.21.15.173:36732) 2024-04-25T09:10:57.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667be00640 1 -- 172.21.15.173:0/2082906643 learned_addr learned my addr 172.21.15.173:0/2082906643 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:57.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667b400640 1 --2- 172.21.15.173:0/2082906643 >> v2:172.21.15.194:3300/0 conn(0x7f667c15a180 0x7f667c0b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667a000640 1 -- 172.21.15.173:0/2082906643 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901367216 0 0) 0x7f667c06e860 con 0x7f667c071a30 2024-04-25T09:10:57.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667a000640 1 -- 172.21.15.173:0/2082906643 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6660003530 con 0x7f667c071a30 2024-04-25T09:10:57.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667a000640 1 -- 172.21.15.173:0/2082906643 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 30133792 0 0) 0x7f6660003530 con 0x7f667c071a30 2024-04-25T09:10:57.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667a000640 1 -- 172.21.15.173:0/2082906643 >> v2:172.21.15.194:3300/0 conn(0x7f667c15a180 msgr2=0x7f667c0b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667a000640 1 --2- 172.21.15.173:0/2082906643 >> v2:172.21.15.194:3300/0 conn(0x7f667c15a180 0x7f667c0b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667a000640 1 -- 172.21.15.173:0/2082906643 >> v1:172.21.15.194:6789/0 conn(0x7f667c0b2ca0 legacy=0x7f667c071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667a000640 1 -- 172.21.15.173:0/2082906643 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c0aebe0 con 0x7f667c071a30 2024-04-25T09:10:57.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667a000640 1 -- 172.21.15.173:0/2082906643 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f6674001a00 con 0x7f667c071a30 2024-04-25T09:10:57.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667a000640 1 -- 172.21.15.173:0/2082906643 >> v1:172.21.15.173:6789/0 conn(0x7f667c071a30 legacy=0x7f667c06d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667a000640 1 --2- 172.21.15.173:0/2082906643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66600039c0 0x7f6660003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667a000640 1 --2- 172.21.15.173:0/2082906643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6660004810 0x7f6660004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667a000640 1 --2- 172.21.15.173:0/2082906643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66600051d0 0x7f666000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667a000640 1 -- 172.21.15.173:0/2082906643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0af230 con 0x7f6660004810 2024-04-25T09:10:57.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667a000640 1 -- 172.21.15.173:0/2082906643 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666000d180 con 0x7f66600039c0 2024-04-25T09:10:57.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667a000640 1 -- 172.21.15.173:0/2082906643 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666000d380 con 0x7f66600051d0 2024-04-25T09:10:57.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667aa00640 1 --2- 172.21.15.173:0/2082906643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6660004810 0x7f6660004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667b400640 1 --2- 172.21.15.173:0/2082906643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66600039c0 0x7f6660003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667be00640 1 --2- 172.21.15.173:0/2082906643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66600051d0 0x7f666000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667aa00640 1 -- 172.21.15.173:0/2082906643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66600051d0 msgr2=0x7f666000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667aa00640 1 --2- 172.21.15.173:0/2082906643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66600051d0 0x7f666000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667aa00640 1 -- 172.21.15.173:0/2082906643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66600039c0 msgr2=0x7f6660003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667aa00640 1 --2- 172.21.15.173:0/2082906643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66600039c0 0x7f6660003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667aa00640 1 -- 172.21.15.173:0/2082906643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6660003530 con 0x7f6660004810 2024-04-25T09:10:57.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.635+0000 7f667be00640 1 -- 172.21.15.173:0/2082906643 reap_dead start 2024-04-25T09:10:57.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.639+0000 7f667aa00640 1 --2- 172.21.15.173:0/2082906643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6660004810 0x7f6660004c90 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f6664001780 tx=0x7f666401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c08837235c8308 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.639+0000 7f667a000640 1 -- 172.21.15.173:0/2082906643 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66640013a0 con 0x7f6660004810 2024-04-25T09:10:57.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.639+0000 7f667a000640 1 -- 172.21.15.173:0/2082906643 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66640052f0 con 0x7f6660004810 2024-04-25T09:10:57.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.639+0000 7f667a000640 1 -- 172.21.15.173:0/2082906643 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6664003840 con 0x7f6660004810 2024-04-25T09:10:57.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.639+0000 7f6682600640 1 -- 172.21.15.173:0/2082906643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6660004810 msgr2=0x7f6660004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.639+0000 7f6682600640 1 --2- 172.21.15.173:0/2082906643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6660004810 0x7f6660004c90 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f6664001780 tx=0x7f666401c400 comp rx=0 tx=0).stop 2024-04-25T09:10:57.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.639+0000 7f6682600640 1 -- 172.21.15.173:0/2082906643 shutdown_connections 2024-04-25T09:10:57.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.639+0000 7f6682600640 1 --2- 172.21.15.173:0/2082906643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6660004810 0x7f6660004c90 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.639+0000 7f6682600640 1 -- 172.21.15.173:0/2082906643 >> 172.21.15.173:0/2082906643 conn(0x7f667c06ac90 msgr2=0x7f667c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:57.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.639+0000 7f6682600640 1 -- 172.21.15.173:0/2082906643 shutdown_connections 2024-04-25T09:10:57.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.639+0000 7f6682600640 1 -- 172.21.15.173:0/2082906643 wait complete. 2024-04-25T09:10:57.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f6682600640 1 Processor -- start 2024-04-25T09:10:57.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f6682600640 1 -- start start 2024-04-25T09:10:57.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f6682600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6660004810 0x7f667c151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f6682600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f667c0ceba0 0x7f667c1f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f6682600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f667c1574e0 0x7f667c157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f6682600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0b4260 con 0x7f667c1574e0 2024-04-25T09:10:57.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f6682600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0b40e0 con 0x7f667c0ceba0 2024-04-25T09:10:57.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f6682600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0b43e0 con 0x7f6660004810 2024-04-25T09:10:57.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f667be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f667c1574e0 0x7f667c157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f667aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f667c0ceba0 0x7f667c1f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f667be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f667c1574e0 0x7f667c157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56666/0 (socket says 172.21.15.173:56666) 2024-04-25T09:10:57.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f667be00640 1 -- 172.21.15.173:0/1711443101 learned_addr learned my addr 172.21.15.173:0/1711443101 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:57.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f667b400640 1 --2- 172.21.15.173:0/1711443101 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6660004810 0x7f667c151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f667be00640 1 -- 172.21.15.173:0/1711443101 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6660004810 msgr2=0x7f667c151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f667be00640 1 --2- 172.21.15.173:0/1711443101 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6660004810 0x7f667c151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f667be00640 1 -- 172.21.15.173:0/1711443101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f667c0ceba0 msgr2=0x7f667c1f30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f667be00640 1 --2- 172.21.15.173:0/1711443101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f667c0ceba0 0x7f667c1f30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f667be00640 1 -- 172.21.15.173:0/1711443101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c154430 con 0x7f667c1574e0 2024-04-25T09:10:57.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f667aa00640 1 --2- 172.21.15.173:0/1711443101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f667c0ceba0 0x7f667c1f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:57.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f667be00640 1 --2- 172.21.15.173:0/1711443101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f667c1574e0 0x7f667c157960 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f667c0b4c40 tx=0x7f66740079b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f6673400640 1 -- 172.21.15.173:0/1711443101 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667401c070 con 0x7f667c1574e0 2024-04-25T09:10:57.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f6673400640 1 -- 172.21.15.173:0/1711443101 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6674011720 con 0x7f667c1574e0 2024-04-25T09:10:57.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f6682600640 1 -- 172.21.15.173:0/1711443101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667c1546d0 con 0x7f667c1574e0 2024-04-25T09:10:57.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f6673400640 1 -- 172.21.15.173:0/1711443101 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674010040 con 0x7f667c1574e0 2024-04-25T09:10:57.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f6682600640 1 -- 172.21.15.173:0/1711443101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667c154c90 con 0x7f667c1574e0 2024-04-25T09:10:57.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.643+0000 7f6682600640 1 -- 172.21.15.173:0/1711443101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667c157ea0 con 0x7f667c1574e0 2024-04-25T09:10:57.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.647+0000 7f6673400640 1 -- 172.21.15.173:0/1711443101 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f667401f070 con 0x7f667c1574e0 2024-04-25T09:10:57.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.647+0000 7f6673400640 1 --2- 172.21.15.173:0/1711443101 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6658066f60 0x7f6658069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.647+0000 7f6673400640 1 -- 172.21.15.173:0/1711443101 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f6674087eb0 con 0x7f667c1574e0 2024-04-25T09:10:57.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.647+0000 7f667b400640 1 --2- 172.21.15.173:0/1711443101 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6658066f60 0x7f6658069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.647+0000 7f667b400640 1 --2- 172.21.15.173:0/1711443101 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6658066f60 0x7f6658069420 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f667c0ce410 tx=0x7f666c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.651+0000 7f6673400640 1 -- 172.21.15.173:0/1711443101 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f66740586b0 con 0x7f667c1574e0 2024-04-25T09:10:57.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.839+0000 7f6682600640 1 -- 172.21.15.173:0/1711443101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f667c06e640 con 0x7f667c1574e0 2024-04-25T09:10:57.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.839+0000 7f6673400640 1 -- 172.21.15.173:0/1711443101 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f667405c750 con 0x7f667c1574e0 2024-04-25T09:10:57.829 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:57.829 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1519522112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1519522112},{"type":"v1","addr":"172.21.15.194:6835","nonce":1519522112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7555,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/548680290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":548680290},{"type":"v1","addr":"172.21.15.173:6836","nonce":548680290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2602621503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2602621503},{"type":"v1","addr":"172.21.15.194:6833","nonce":2602621503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:24.354981+0000","modified":"2024-04-25T09:10:27.392053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/1492125936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":1492125936},{"type":"v1","addr":"172.21.15.173:6837","nonce":1492125936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:10:57.831 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 72 2024-04-25T09:10:57.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.843+0000 7f6682600640 1 -- 172.21.15.173:0/1711443101 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6658066f60 msgr2=0x7f6658069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.843+0000 7f6682600640 1 --2- 172.21.15.173:0/1711443101 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6658066f60 0x7f6658069420 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f667c0ce410 tx=0x7f666c009190 comp rx=0 tx=0).stop 2024-04-25T09:10:57.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.843+0000 7f6682600640 1 -- 172.21.15.173:0/1711443101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f667c1574e0 msgr2=0x7f667c157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.843+0000 7f6682600640 1 --2- 172.21.15.173:0/1711443101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f667c1574e0 0x7f667c157960 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f667c0b4c40 tx=0x7f66740079b0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.843+0000 7f6682600640 1 -- 172.21.15.173:0/1711443101 shutdown_connections 2024-04-25T09:10:57.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.843+0000 7f6682600640 1 --2- 172.21.15.173:0/1711443101 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6658066f60 0x7f6658069420 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.843+0000 7f6682600640 1 --2- 172.21.15.173:0/1711443101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f667c1574e0 0x7f667c157960 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.843+0000 7f6682600640 1 --2- 172.21.15.173:0/1711443101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f667c0ceba0 0x7f667c1f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.843+0000 7f6682600640 1 --2- 172.21.15.173:0/1711443101 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6660004810 0x7f667c151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.843+0000 7f6682600640 1 -- 172.21.15.173:0/1711443101 >> 172.21.15.173:0/1711443101 conn(0x7f667c06ac90 msgr2=0x7f667c15c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.843+0000 7f6682600640 1 -- 172.21.15.173:0/1711443101 shutdown_connections 2024-04-25T09:10:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.843+0000 7f6682600640 1 -- 172.21.15.173:0/1711443101 wait complete. 2024-04-25T09:10:57.849 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:10:57.849 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:10:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efca0200640 1 Processor -- start 2024-04-25T09:10:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efca0200640 1 -- start start 2024-04-25T09:10:57.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efca0200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efc9815ba20 0x7efc9815be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efca0200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc980b70f0 0x7efc9806f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efca0200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efc980b7550 0x7efc9806fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efca0200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9815c460 con 0x7efc9815ba20 2024-04-25T09:10:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efca0200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9815c740 con 0x7efc980b7550 2024-04-25T09:10:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efca0200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9815ca20 con 0x7efc980b70f0 2024-04-25T09:10:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efc9d800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efc9815ba20 0x7efc9815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efc9d800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efc9815ba20 0x7efc9815be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56682/0 (socket says 172.21.15.173:56682) 2024-04-25T09:10:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efc9d800640 1 -- 172.21.15.173:0/3110213022 learned_addr learned my addr 172.21.15.173:0/3110213022 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efc9e200640 1 --2- 172.21.15.173:0/3110213022 >> v2:172.21.15.194:3300/0 conn(0x7efc980b7550 0x7efc9806fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efc9ce00640 1 --2- 172.21.15.173:0/3110213022 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc980b70f0 0x7efc9806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efc9d800640 1 -- 172.21.15.173:0/3110213022 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc980b70f0 msgr2=0x7efc9806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efc9d800640 1 --2- 172.21.15.173:0/3110213022 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc980b70f0 0x7efc9806f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efc9d800640 1 -- 172.21.15.173:0/3110213022 >> v2:172.21.15.194:3300/0 conn(0x7efc980b7550 msgr2=0x7efc9806fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efc9d800640 1 --2- 172.21.15.173:0/3110213022 >> v2:172.21.15.194:3300/0 conn(0x7efc980b7550 0x7efc9806fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efc9d800640 1 -- 172.21.15.173:0/3110213022 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9815cd00 con 0x7efc9815ba20 2024-04-25T09:10:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efc9e200640 1 --2- 172.21.15.173:0/3110213022 >> v2:172.21.15.194:3300/0 conn(0x7efc980b7550 0x7efc9806fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:57.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.995+0000 7efc9ce00640 1 --2- 172.21.15.173:0/3110213022 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc980b70f0 0x7efc9806f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:57.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.999+0000 7efc9d800640 1 --2- 172.21.15.173:0/3110213022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc9815ba20 0x7efc9815be00 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7efc980b6bf0 tx=0x7efc8c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38a598031cd245a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.999+0000 7efc97e00640 1 -- 172.21.15.173:0/3110213022 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0a5860 con 0x7efc9815ba20 2024-04-25T09:10:57.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.999+0000 7efc97e00640 1 -- 172.21.15.173:0/3110213022 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c0a5a00 con 0x7efc9815ba20 2024-04-25T09:10:57.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.999+0000 7efc97e00640 1 -- 172.21.15.173:0/3110213022 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0a5dd0 con 0x7efc9815ba20 2024-04-25T09:10:57.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.999+0000 7efca0200640 1 -- 172.21.15.173:0/3110213022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc9815ba20 msgr2=0x7efc9815be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.999+0000 7efca0200640 1 --2- 172.21.15.173:0/3110213022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc9815ba20 0x7efc9815be00 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7efc980b6bf0 tx=0x7efc8c01c9c0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.999+0000 7efca0200640 1 -- 172.21.15.173:0/3110213022 shutdown_connections 2024-04-25T09:10:57.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.999+0000 7efca0200640 1 --2- 172.21.15.173:0/3110213022 >> v2:172.21.15.194:3300/0 conn(0x7efc980b7550 0x7efc9806fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.999+0000 7efca0200640 1 --2- 172.21.15.173:0/3110213022 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc980b70f0 0x7efc9806f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.999+0000 7efca0200640 1 --2- 172.21.15.173:0/3110213022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc9815ba20 0x7efc9815be00 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.999+0000 7efca0200640 1 -- 172.21.15.173:0/3110213022 >> 172.21.15.173:0/3110213022 conn(0x7efc98061880 msgr2=0x7efc98061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:57.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.999+0000 7efca0200640 1 -- 172.21.15.173:0/3110213022 shutdown_connections 2024-04-25T09:10:57.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:57.999+0000 7efca0200640 1 -- 172.21.15.173:0/3110213022 wait complete. 2024-04-25T09:10:57.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efca0200640 1 Processor -- start 2024-04-25T09:10:57.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efca0200640 1 -- start start 2024-04-25T09:10:57.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efca0200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc980b70f0 0x7efc981662b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efca0200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc9815ba20 0x7efc98153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efca0200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc98156500 0x7efc980d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efca0200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc980d2620 con 0x7efc98156500 2024-04-25T09:10:57.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efca0200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc980d24a0 con 0x7efc980b70f0 2024-04-25T09:10:57.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efca0200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9815f3f0 con 0x7efc9815ba20 2024-04-25T09:10:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efc9e200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc98156500 0x7efc980d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efc9e200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc98156500 0x7efc980d0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56684/0 (socket says 172.21.15.173:56684) 2024-04-25T09:10:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efc9e200640 1 -- 172.21.15.173:0/3227207795 learned_addr learned my addr 172.21.15.173:0/3227207795 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efc9ce00640 1 --2- 172.21.15.173:0/3227207795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc9815ba20 0x7efc98153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efc9d800640 1 --2- 172.21.15.173:0/3227207795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc980b70f0 0x7efc981662b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efc9e200640 1 -- 172.21.15.173:0/3227207795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc9815ba20 msgr2=0x7efc98153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efc9e200640 1 --2- 172.21.15.173:0/3227207795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc9815ba20 0x7efc98153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efc9e200640 1 -- 172.21.15.173:0/3227207795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc980b70f0 msgr2=0x7efc981662b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efc9e200640 1 --2- 172.21.15.173:0/3227207795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc980b70f0 0x7efc981662b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:57.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efc9e200640 1 -- 172.21.15.173:0/3227207795 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc98153220 con 0x7efc98156500 2024-04-25T09:10:57.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efc9e200640 1 --2- 172.21.15.173:0/3227207795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc98156500 0x7efc980d0b50 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7efc9000e630 tx=0x7efc9000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efc95600640 1 -- 172.21.15.173:0/3227207795 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90017070 con 0x7efc98156500 2024-04-25T09:10:57.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efc95600640 1 -- 172.21.15.173:0/3227207795 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9000c620 con 0x7efc98156500 2024-04-25T09:10:57.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efc95600640 1 -- 172.21.15.173:0/3227207795 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9000f040 con 0x7efc98156500 2024-04-25T09:10:57.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efca0200640 1 -- 172.21.15.173:0/3227207795 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc98153500 con 0x7efc98156500 2024-04-25T09:10:57.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efca0200640 1 -- 172.21.15.173:0/3227207795 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc980d1090 con 0x7efc98156500 2024-04-25T09:10:57.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.003+0000 7efca0200640 1 -- 172.21.15.173:0/3227207795 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc98073a40 con 0x7efc98156500 2024-04-25T09:10:57.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.007+0000 7efc95600640 1 -- 172.21.15.173:0/3227207795 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efc9001a070 con 0x7efc98156500 2024-04-25T09:10:57.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.007+0000 7efc95600640 1 --2- 172.21.15.173:0/3227207795 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efc78066f60 0x7efc78069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:57.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.007+0000 7efc95600640 1 -- 172.21.15.173:0/3227207795 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7efc90084df0 con 0x7efc98156500 2024-04-25T09:10:57.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.007+0000 7efc9d800640 1 --2- 172.21.15.173:0/3227207795 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efc78066f60 0x7efc78069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:57.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.007+0000 7efc9d800640 1 --2- 172.21.15.173:0/3227207795 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efc78066f60 0x7efc78069420 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0ae000 tx=0x7efc8c0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:57.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.011+0000 7efc95600640 1 -- 172.21.15.173:0/3227207795 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efc90055c40 con 0x7efc98156500 2024-04-25T09:10:58.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.219+0000 7efca0200640 1 -- 172.21.15.173:0/3227207795 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7efc9815c000 con 0x7efc98156500 2024-04-25T09:10:58.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.219+0000 7efc95600640 1 -- 172.21.15.173:0/3227207795 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1444 (secure 0 0 0) 0x7efc90055540 con 0x7efc98156500 2024-04-25T09:10:58.208 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:58.209 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":512,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":111,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":920,"data_bytes":941548941,"bytes_used":2252521472,"bytes_avail":770841591808,"bytes_total":773094113280,"write_bytes_sec":46663353,"read_op_per_sec":0,"write_op_per_sec":46},"fsmap":{"epoch":72,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8193}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-04-25T09:10:12.824831+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:10:58.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.223+0000 7efca0200640 1 -- 172.21.15.173:0/3227207795 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efc78066f60 msgr2=0x7efc78069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:58.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.223+0000 7efca0200640 1 --2- 172.21.15.173:0/3227207795 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efc78066f60 0x7efc78069420 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0ae000 tx=0x7efc8c0a7070 comp rx=0 tx=0).stop 2024-04-25T09:10:58.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.223+0000 7efca0200640 1 -- 172.21.15.173:0/3227207795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc98156500 msgr2=0x7efc980d0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:58.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.223+0000 7efca0200640 1 --2- 172.21.15.173:0/3227207795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc98156500 0x7efc980d0b50 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7efc9000e630 tx=0x7efc9000eaf0 comp rx=0 tx=0).stop 2024-04-25T09:10:58.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.223+0000 7efca0200640 1 -- 172.21.15.173:0/3227207795 shutdown_connections 2024-04-25T09:10:58.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.223+0000 7efca0200640 1 --2- 172.21.15.173:0/3227207795 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efc78066f60 0x7efc78069420 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:58.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.223+0000 7efca0200640 1 --2- 172.21.15.173:0/3227207795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc98156500 0x7efc980d0b50 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:58.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.223+0000 7efca0200640 1 --2- 172.21.15.173:0/3227207795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc9815ba20 0x7efc98153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:58.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.223+0000 7efca0200640 1 --2- 172.21.15.173:0/3227207795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc980b70f0 0x7efc981662b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:58.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.223+0000 7efca0200640 1 -- 172.21.15.173:0/3227207795 >> 172.21.15.173:0/3227207795 conn(0x7efc98061880 msgr2=0x7efc980b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:58.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.223+0000 7efca0200640 1 -- 172.21.15.173:0/3227207795 shutdown_connections 2024-04-25T09:10:58.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:58.223+0000 7efca0200640 1 -- 172.21.15.173:0/3227207795 wait complete. 2024-04-25T09:10:58.229 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:10:59.229 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:59.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.379+0000 7fce85c00640 1 Processor -- start 2024-04-25T09:10:59.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.379+0000 7fce85c00640 1 -- start start 2024-04-25T09:10:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce85c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fce800aefa0 0x7fce800cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce85c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce8015edd0 0x7fce800cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce85c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8015f320 con 0x7fce800b3e70 2024-04-25T09:10:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce85c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8006dd50 con 0x7fce800aefa0 2024-04-25T09:10:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce85c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8006d420 con 0x7fce8015edd0 2024-04-25T09:10:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7ea00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fce800b3e70 0x7fce800b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36736/0 (socket says 172.21.15.173:36736) 2024-04-25T09:10:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7ea00640 1 -- 172.21.15.173:0/5717697 learned_addr learned my addr 172.21.15.173:0/5717697 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7e000640 1 --2- 172.21.15.173:0/5717697 >> v2:172.21.15.194:3300/0 conn(0x7fce800aefa0 0x7fce800cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7f400640 1 --2- 172.21.15.173:0/5717697 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce8015edd0 0x7fce800cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:59.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7d600640 1 -- 172.21.15.173:0/5717697 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377703204 0 0) 0x7fce8015f320 con 0x7fce800b3e70 2024-04-25T09:10:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7d600640 1 -- 172.21.15.173:0/5717697 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce64003530 con 0x7fce800b3e70 2024-04-25T09:10:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7d600640 1 -- 172.21.15.173:0/5717697 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4216869004 0 0) 0x7fce64003530 con 0x7fce800b3e70 2024-04-25T09:10:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7d600640 1 -- 172.21.15.173:0/5717697 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce8015edd0 msgr2=0x7fce800cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7d600640 1 --2- 172.21.15.173:0/5717697 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce8015edd0 0x7fce800cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7d600640 1 -- 172.21.15.173:0/5717697 >> v2:172.21.15.194:3300/0 conn(0x7fce800aefa0 msgr2=0x7fce800cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7d600640 1 --2- 172.21.15.173:0/5717697 >> v2:172.21.15.194:3300/0 conn(0x7fce800aefa0 0x7fce800cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7d600640 1 -- 172.21.15.173:0/5717697 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8006d700 con 0x7fce800b3e70 2024-04-25T09:10:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7d600640 1 -- 172.21.15.173:0/5717697 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fce70001a00 con 0x7fce800b3e70 2024-04-25T09:10:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7d600640 1 -- 172.21.15.173:0/5717697 >> v1:172.21.15.173:6789/0 conn(0x7fce800b3e70 legacy=0x7fce800b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7d600640 1 --2- 172.21.15.173:0/5717697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce640039c0 0x7fce64003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7d600640 1 --2- 172.21.15.173:0/5717697 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce64004810 0x7fce64004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7d600640 1 --2- 172.21.15.173:0/5717697 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce640051d0 0x7fce6400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7d600640 1 -- 172.21.15.173:0/5717697 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8006dd50 con 0x7fce640039c0 2024-04-25T09:10:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7d600640 1 -- 172.21.15.173:0/5717697 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8006d420 con 0x7fce64004810 2024-04-25T09:10:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7d600640 1 -- 172.21.15.173:0/5717697 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6400bf10 con 0x7fce640051d0 2024-04-25T09:10:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7e000640 1 --2- 172.21.15.173:0/5717697 >> v2:172.21.15.194:3300/0 conn(0x7fce800aefa0 0x7fce800cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7f400640 1 --2- 172.21.15.173:0/5717697 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce8015edd0 0x7fce800cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7ea00640 1 --2- 172.21.15.173:0/5717697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce640039c0 0x7fce64003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7e000640 1 --2- 172.21.15.173:0/5717697 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce64004810 0x7fce64004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7f400640 1 --2- 172.21.15.173:0/5717697 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce640051d0 0x7fce6400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7ea00640 1 -- 172.21.15.173:0/5717697 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce640051d0 msgr2=0x7fce6400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7ea00640 1 --2- 172.21.15.173:0/5717697 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce640051d0 0x7fce6400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7ea00640 1 -- 172.21.15.173:0/5717697 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce64004810 msgr2=0x7fce64004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7ea00640 1 --2- 172.21.15.173:0/5717697 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce64004810 0x7fce64004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7ea00640 1 -- 172.21.15.173:0/5717697 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce64003530 con 0x7fce640039c0 2024-04-25T09:10:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.383+0000 7fce7f400640 1 --2- 172.21.15.173:0/5717697 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce640051d0 0x7fce6400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.387+0000 7fce7ea00640 1 --2- 172.21.15.173:0/5717697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce640039c0 0x7fce64003de0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fce7000a950 tx=0x7fce7001d410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14976ce4707ebe53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.387+0000 7fce7d600640 1 -- 172.21.15.173:0/5717697 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7000a4c0 con 0x7fce640039c0 2024-04-25T09:10:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.387+0000 7fce7d600640 1 -- 172.21.15.173:0/5717697 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce700ad650 con 0x7fce640039c0 2024-04-25T09:10:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.387+0000 7fce7d600640 1 -- 172.21.15.173:0/5717697 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700ada40 con 0x7fce640039c0 2024-04-25T09:10:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.387+0000 7fce85c00640 1 -- 172.21.15.173:0/5717697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce640039c0 msgr2=0x7fce64003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.387+0000 7fce85c00640 1 --2- 172.21.15.173:0/5717697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce640039c0 0x7fce64003de0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fce7000a950 tx=0x7fce7001d410 comp rx=0 tx=0).stop 2024-04-25T09:10:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.387+0000 7fce7f400640 1 -- 172.21.15.173:0/5717697 reap_dead start 2024-04-25T09:10:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.387+0000 7fce85c00640 1 -- 172.21.15.173:0/5717697 shutdown_connections 2024-04-25T09:10:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.387+0000 7fce85c00640 1 -- 172.21.15.173:0/5717697 >> 172.21.15.173:0/5717697 conn(0x7fce8006ac90 msgr2=0x7fce8006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.387+0000 7fce85c00640 1 -- 172.21.15.173:0/5717697 shutdown_connections 2024-04-25T09:10:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.387+0000 7fce85c00640 1 -- 172.21.15.173:0/5717697 wait complete. 2024-04-25T09:10:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce85c00640 1 Processor -- start 2024-04-25T09:10:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce85c00640 1 -- start start 2024-04-25T09:10:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce85c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce640039c0 0x7fce801fabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce85c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce800a84b0 0x7fce8015c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce85c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce80146ce0 0x7fce80147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce85c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce800ce670 con 0x7fce640039c0 2024-04-25T09:10:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce85c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce800ce4f0 con 0x7fce80146ce0 2024-04-25T09:10:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce85c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce800ce7f0 con 0x7fce800a84b0 2024-04-25T09:10:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce7ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce640039c0 0x7fce801fabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce7ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce640039c0 0x7fce801fabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56712/0 (socket says 172.21.15.173:56712) 2024-04-25T09:10:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce7ea00640 1 -- 172.21.15.173:0/3710519644 learned_addr learned my addr 172.21.15.173:0/3710519644 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce7e000640 1 --2- 172.21.15.173:0/3710519644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce800a84b0 0x7fce8015c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce7f400640 1 --2- 172.21.15.173:0/3710519644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce80146ce0 0x7fce80147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce7ea00640 1 -- 172.21.15.173:0/3710519644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce800a84b0 msgr2=0x7fce8015c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce7ea00640 1 --2- 172.21.15.173:0/3710519644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce800a84b0 0x7fce8015c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce7ea00640 1 -- 172.21.15.173:0/3710519644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce80146ce0 msgr2=0x7fce80147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce7ea00640 1 --2- 172.21.15.173:0/3710519644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce80146ce0 0x7fce80147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce7ea00640 1 -- 172.21.15.173:0/3710519644 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce801476a0 con 0x7fce640039c0 2024-04-25T09:10:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce7ea00640 1 --2- 172.21.15.173:0/3710519644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce640039c0 0x7fce801fabd0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fce7001d240 tx=0x7fce64005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce76a00640 1 -- 172.21.15.173:0/3710519644 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700ad430 con 0x7fce640039c0 2024-04-25T09:10:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce76a00640 1 -- 172.21.15.173:0/3710519644 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce70004b70 con 0x7fce640039c0 2024-04-25T09:10:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce76a00640 1 -- 172.21.15.173:0/3710519644 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700ada20 con 0x7fce640039c0 2024-04-25T09:10:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce85c00640 1 -- 172.21.15.173:0/3710519644 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce800a8c90 con 0x7fce640039c0 2024-04-25T09:10:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce85c00640 1 -- 172.21.15.173:0/3710519644 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce800a9250 con 0x7fce640039c0 2024-04-25T09:10:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.391+0000 7fce85c00640 1 -- 172.21.15.173:0/3710519644 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce80073a40 con 0x7fce640039c0 2024-04-25T09:10:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.395+0000 7fce76a00640 1 -- 172.21.15.173:0/3710519644 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fce700b5070 con 0x7fce640039c0 2024-04-25T09:10:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.395+0000 7fce76a00640 1 --2- 172.21.15.173:0/3710519644 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce60066f60 0x7fce60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:59.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.395+0000 7fce76a00640 1 -- 172.21.15.173:0/3710519644 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fce700bb070 con 0x7fce640039c0 2024-04-25T09:10:59.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.395+0000 7fce7e000640 1 --2- 172.21.15.173:0/3710519644 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce60066f60 0x7fce60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:59.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.395+0000 7fce7e000640 1 --2- 172.21.15.173:0/3710519644 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce60066f60 0x7fce60069420 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fce801ea630 tx=0x7fce6c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:59.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.399+0000 7fce76a00640 1 -- 172.21.15.173:0/3710519644 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fce70017150 con 0x7fce640039c0 2024-04-25T09:10:59.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.587+0000 7fce85c00640 1 -- 172.21.15.173:0/3710519644 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce8006e540 con 0x7fce640039c0 2024-04-25T09:10:59.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.587+0000 7fce76a00640 1 -- 172.21.15.173:0/3710519644 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4949 (secure 0 0 0) 0x7fce700ef390 con 0x7fce640039c0 2024-04-25T09:10:59.577 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:59.577 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1519522112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1519522112},{"type":"v1","addr":"172.21.15.194:6835","nonce":1519522112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7555,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/548680290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":548680290},{"type":"v1","addr":"172.21.15.173:6836","nonce":548680290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2602621503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2602621503},{"type":"v1","addr":"172.21.15.194:6833","nonce":2602621503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:24.354981+0000","modified":"2024-04-25T09:10:27.392053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/1492125936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":1492125936},{"type":"v1","addr":"172.21.15.173:6837","nonce":1492125936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:10:59.577 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 72 2024-04-25T09:10:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.591+0000 7fce85c00640 1 -- 172.21.15.173:0/3710519644 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce60066f60 msgr2=0x7fce60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.591+0000 7fce85c00640 1 --2- 172.21.15.173:0/3710519644 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce60066f60 0x7fce60069420 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fce801ea630 tx=0x7fce6c009190 comp rx=0 tx=0).stop 2024-04-25T09:10:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.591+0000 7fce85c00640 1 -- 172.21.15.173:0/3710519644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce640039c0 msgr2=0x7fce801fabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.591+0000 7fce85c00640 1 --2- 172.21.15.173:0/3710519644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce640039c0 0x7fce801fabd0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fce7001d240 tx=0x7fce64005840 comp rx=0 tx=0).stop 2024-04-25T09:10:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.591+0000 7fce85c00640 1 -- 172.21.15.173:0/3710519644 shutdown_connections 2024-04-25T09:10:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.591+0000 7fce85c00640 1 --2- 172.21.15.173:0/3710519644 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fce60066f60 0x7fce60069420 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.591+0000 7fce85c00640 1 --2- 172.21.15.173:0/3710519644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce80146ce0 0x7fce80147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.591+0000 7fce85c00640 1 --2- 172.21.15.173:0/3710519644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce800a84b0 0x7fce8015c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.591+0000 7fce85c00640 1 --2- 172.21.15.173:0/3710519644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce640039c0 0x7fce801fabd0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.591+0000 7fce85c00640 1 -- 172.21.15.173:0/3710519644 >> 172.21.15.173:0/3710519644 conn(0x7fce8006ac90 msgr2=0x7fce800af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:59.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.591+0000 7fce85c00640 1 -- 172.21.15.173:0/3710519644 shutdown_connections 2024-04-25T09:10:59.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.591+0000 7fce85c00640 1 -- 172.21.15.173:0/3710519644 wait complete. 2024-04-25T09:10:59.597 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:10:59.598 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:10:59.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.743+0000 7f822b800640 1 Processor -- start 2024-04-25T09:10:59.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.743+0000 7f822b800640 1 -- start start 2024-04-25T09:10:59.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.747+0000 7f822b800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f822415dbb0 0x7f822415df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:59.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.747+0000 7f822b800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822406d870 con 0x7f82240d2130 2024-04-25T09:10:59.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.747+0000 7f822b800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8224161690 con 0x7f822406f830 2024-04-25T09:10:59.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.747+0000 7f822b800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82240d2590 con 0x7f822415dbb0 2024-04-25T09:10:59.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.747+0000 7f8223e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f82240d2130 0x7f822406c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36738/0 (socket says 172.21.15.173:36738) 2024-04-25T09:10:59.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.747+0000 7f8223e00640 1 -- 172.21.15.173:0/1950952725 learned_addr learned my addr 172.21.15.173:0/1950952725 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:10:59.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.747+0000 7f8228e00640 1 --2- 172.21.15.173:0/1950952725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f822415dbb0 0x7f822415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:59.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.747+0000 7f8223400640 1 -- 172.21.15.173:0/1950952725 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627008957 0 0) 0x7f822406d870 con 0x7f82240d2130 2024-04-25T09:10:59.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.747+0000 7f8223400640 1 -- 172.21.15.173:0/1950952725 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8208003530 con 0x7f82240d2130 2024-04-25T09:10:59.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.747+0000 7f8223400640 1 -- 172.21.15.173:0/1950952725 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882437226 0 0) 0x7f8224161690 con 0x7f822406f830 2024-04-25T09:10:59.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.747+0000 7f8223400640 1 -- 172.21.15.173:0/1950952725 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f822406d870 con 0x7f822406f830 2024-04-25T09:10:59.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.747+0000 7f8228e00640 1 -- 172.21.15.173:0/1950952725 >> v1:172.21.15.194:6789/0 conn(0x7f822406f830 legacy=0x7f8224161b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:59.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.747+0000 7f8223400640 1 -- 172.21.15.173:0/1950952725 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1945864362 0 0) 0x7f8208003530 con 0x7f82240d2130 2024-04-25T09:10:59.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.747+0000 7f8228e00640 1 -- 172.21.15.173:0/1950952725 >> v1:172.21.15.173:6789/0 conn(0x7f82240d2130 legacy=0x7f822406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:59.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.747+0000 7f8228e00640 1 -- 172.21.15.173:0/1950952725 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822415e5c0 con 0x7f822415dbb0 2024-04-25T09:10:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.751+0000 7f8228e00640 1 --2- 172.21.15.173:0/1950952725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f822415dbb0 0x7f822415df90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8214009dc0 tx=0x7f821401c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1494c09e1190de6f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.751+0000 7f8223400640 1 -- 172.21.15.173:0/1950952725 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82140b2070 con 0x7f822415dbb0 2024-04-25T09:10:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.751+0000 7f8223400640 1 -- 172.21.15.173:0/1950952725 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82140a56c0 con 0x7f822415dbb0 2024-04-25T09:10:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.751+0000 7f8223400640 1 -- 172.21.15.173:0/1950952725 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8210001680 con 0x7f822415dbb0 2024-04-25T09:10:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.751+0000 7f822b800640 1 -- 172.21.15.173:0/1950952725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f822415dbb0 msgr2=0x7f822415df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.751+0000 7f822b800640 1 --2- 172.21.15.173:0/1950952725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f822415dbb0 0x7f822415df90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8214009dc0 tx=0x7f821401c880 comp rx=0 tx=0).stop 2024-04-25T09:10:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.751+0000 7f822b800640 1 -- 172.21.15.173:0/1950952725 shutdown_connections 2024-04-25T09:10:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.751+0000 7f822b800640 1 --2- 172.21.15.173:0/1950952725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f822415dbb0 0x7f822415df90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.751+0000 7f822b800640 1 -- 172.21.15.173:0/1950952725 >> 172.21.15.173:0/1950952725 conn(0x7f8224061880 msgr2=0x7f8224061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.751+0000 7f822b800640 1 -- 172.21.15.173:0/1950952725 shutdown_connections 2024-04-25T09:10:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.751+0000 7f822b800640 1 -- 172.21.15.173:0/1950952725 wait complete. 2024-04-25T09:10:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.751+0000 7f822b800640 1 Processor -- start 2024-04-25T09:10:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.751+0000 7f822b800640 1 -- start start 2024-04-25T09:10:59.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f822b800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f822406f830 0x7f822415ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:59.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f822b800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82240d2130 0x7f82241533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:59.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f822b800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f822415dbb0 0x7f82240b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:59.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f822b800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8224070050 con 0x7f822406f830 2024-04-25T09:10:59.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f822b800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822415ee60 con 0x7f82240d2130 2024-04-25T09:10:59.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f822b800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822415be10 con 0x7f822415dbb0 2024-04-25T09:10:59.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f8228e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f822406f830 0x7f822415ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:59.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f8228e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f822406f830 0x7f822415ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56728/0 (socket says 172.21.15.173:56728) 2024-04-25T09:10:59.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f8228e00640 1 -- 172.21.15.173:0/2253235442 learned_addr learned my addr 172.21.15.173:0/2253235442 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:10:59.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f8223e00640 1 --2- 172.21.15.173:0/2253235442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82240d2130 0x7f82241533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:59.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f8229800640 1 --2- 172.21.15.173:0/2253235442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f822415dbb0 0x7f82240b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:59.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f8228e00640 1 -- 172.21.15.173:0/2253235442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f822415dbb0 msgr2=0x7f82240b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:59.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f8228e00640 1 --2- 172.21.15.173:0/2253235442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f822415dbb0 0x7f82240b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:59.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f8228e00640 1 -- 172.21.15.173:0/2253235442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82240d2130 msgr2=0x7f82241533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:59.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f8228e00640 1 --2- 172.21.15.173:0/2253235442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82240d2130 0x7f82241533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:59.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f8228e00640 1 -- 172.21.15.173:0/2253235442 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822415c0f0 con 0x7f822406f830 2024-04-25T09:10:59.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f8228e00640 1 --2- 172.21.15.173:0/2253235442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f822406f830 0x7f822415ceb0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f821401a4b0 tx=0x7f8214019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:59.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f8220c00640 1 -- 172.21.15.173:0/2253235442 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82140b2070 con 0x7f822406f830 2024-04-25T09:10:59.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f8220c00640 1 -- 172.21.15.173:0/2253235442 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82140b3040 con 0x7f822406f830 2024-04-25T09:10:59.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f8220c00640 1 -- 172.21.15.173:0/2253235442 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82140b98d0 con 0x7f822406f830 2024-04-25T09:10:59.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f822b800640 1 -- 172.21.15.173:0/2253235442 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822415c3d0 con 0x7f822406f830 2024-04-25T09:10:59.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f822b800640 1 -- 172.21.15.173:0/2253235442 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822415c990 con 0x7f822406f830 2024-04-25T09:10:59.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f822b800640 1 -- 172.21.15.173:0/2253235442 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8224073a40 con 0x7f822406f830 2024-04-25T09:10:59.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.755+0000 7f8220c00640 1 -- 172.21.15.173:0/2253235442 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f82140c1030 con 0x7f822406f830 2024-04-25T09:10:59.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.759+0000 7f8220c00640 1 --2- 172.21.15.173:0/2253235442 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8204066f60 0x7f8204069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:59.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.759+0000 7f8220c00640 1 -- 172.21.15.173:0/2253235442 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f821411f8a0 con 0x7f822406f830 2024-04-25T09:10:59.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.759+0000 7f8223e00640 1 --2- 172.21.15.173:0/2253235442 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8204066f60 0x7f8204069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:59.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.759+0000 7f8223e00640 1 --2- 172.21.15.173:0/2253235442 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8204066f60 0x7f8204069420 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f82240cd650 tx=0x7f8210009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:59.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.763+0000 7f8220c00640 1 -- 172.21.15.173:0/2253235442 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f82140c8060 con 0x7f822406f830 2024-04-25T09:10:59.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.967+0000 7f822b800640 1 -- 172.21.15.173:0/2253235442 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f82240cf020 con 0x7f822406f830 2024-04-25T09:10:59.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.967+0000 7f8220c00640 1 -- 172.21.15.173:0/2253235442 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1444 (secure 0 0 0) 0x7f82140164a0 con 0x7f822406f830 2024-04-25T09:10:59.957 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:10:59.957 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":514,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":111,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":941,"data_bytes":963569037,"bytes_used":2282930176,"bytes_avail":770811183104,"bytes_total":773094113280,"write_bytes_sec":47012875,"read_op_per_sec":0,"write_op_per_sec":46},"fsmap":{"epoch":72,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8193}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-04-25T09:10:12.824831+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:10:59.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.971+0000 7f822b800640 1 -- 172.21.15.173:0/2253235442 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8204066f60 msgr2=0x7f8204069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.971+0000 7f822b800640 1 --2- 172.21.15.173:0/2253235442 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8204066f60 0x7f8204069420 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f82240cd650 tx=0x7f8210009040 comp rx=0 tx=0).stop 2024-04-25T09:10:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.971+0000 7f822b800640 1 -- 172.21.15.173:0/2253235442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f822406f830 msgr2=0x7f822415ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.971+0000 7f822b800640 1 --2- 172.21.15.173:0/2253235442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f822406f830 0x7f822415ceb0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f821401a4b0 tx=0x7f8214019620 comp rx=0 tx=0).stop 2024-04-25T09:10:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.971+0000 7f822b800640 1 -- 172.21.15.173:0/2253235442 shutdown_connections 2024-04-25T09:10:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.971+0000 7f822b800640 1 --2- 172.21.15.173:0/2253235442 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8204066f60 0x7f8204069420 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.971+0000 7f822b800640 1 --2- 172.21.15.173:0/2253235442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f822415dbb0 0x7f82240b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.971+0000 7f822b800640 1 --2- 172.21.15.173:0/2253235442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82240d2130 0x7f82241533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.971+0000 7f822b800640 1 --2- 172.21.15.173:0/2253235442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f822406f830 0x7f822415ceb0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.971+0000 7f822b800640 1 -- 172.21.15.173:0/2253235442 >> 172.21.15.173:0/2253235442 conn(0x7f8224061880 msgr2=0x7f822406c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.971+0000 7f822b800640 1 -- 172.21.15.173:0/2253235442 shutdown_connections 2024-04-25T09:10:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:10:59.971+0000 7f822b800640 1 -- 172.21.15.173:0/2253235442 wait complete. 2024-04-25T09:10:59.978 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:11:00.978 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:01.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.139+0000 7f21a1000640 1 Processor -- start 2024-04-25T09:11:01.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.139+0000 7f21a1000640 1 -- start start 2024-04-25T09:11:01.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.139+0000 7f21a1000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f219c0ccd30 0x7f219c0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.139+0000 7f21a1000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219c06e7c0 con 0x7f219c145250 2024-04-25T09:11:01.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.139+0000 7f21a1000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219c06d720 con 0x7f219c0cc8b0 2024-04-25T09:11:01.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.139+0000 7f21a1000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f219c06da00 con 0x7f219c0ccd30 2024-04-25T09:11:01.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.139+0000 7f219a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f219c0ccd30 0x7f219c0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.139+0000 7f219a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f219c0ccd30 0x7f219c0cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56738/0 (socket says 172.21.15.173:56738) 2024-04-25T09:11:01.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.139+0000 7f2199e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f219c145250 0x7f219c15c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36748/0 (socket says 172.21.15.173:36748) 2024-04-25T09:11:01.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.139+0000 7f219a800640 1 -- 172.21.15.173:0/2797690537 learned_addr learned my addr 172.21.15.173:0/2797690537 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:01.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.139+0000 7f219a800640 1 -- 172.21.15.173:0/2797690537 >> v1:172.21.15.194:6789/0 conn(0x7f219c0cc8b0 legacy=0x7f219c0ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:01.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.139+0000 7f219a800640 1 -- 172.21.15.173:0/2797690537 >> v1:172.21.15.173:6789/0 conn(0x7f219c145250 legacy=0x7f219c15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.139+0000 7f219a800640 1 -- 172.21.15.173:0/2797690537 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c06dce0 con 0x7f219c0ccd30 2024-04-25T09:11:01.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.143+0000 7f219a800640 1 --2- 172.21.15.173:0/2797690537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f219c0ccd30 0x7f219c0cf000 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f2194009870 tx=0x7f219401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41f1efcfdde38ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.143+0000 7f2198a00640 1 -- 172.21.15.173:0/2797690537 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21940aa650 con 0x7f219c0ccd30 2024-04-25T09:11:01.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.143+0000 7f2198a00640 1 -- 172.21.15.173:0/2797690537 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21940af070 con 0x7f219c0ccd30 2024-04-25T09:11:01.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.143+0000 7f2198a00640 1 -- 172.21.15.173:0/2797690537 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21940aaa10 con 0x7f219c0ccd30 2024-04-25T09:11:01.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.143+0000 7f21a1000640 1 -- 172.21.15.173:0/2797690537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f219c0ccd30 msgr2=0x7f219c0cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.143+0000 7f21a1000640 1 --2- 172.21.15.173:0/2797690537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f219c0ccd30 0x7f219c0cf000 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f2194009870 tx=0x7f219401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.143+0000 7f21a1000640 1 -- 172.21.15.173:0/2797690537 shutdown_connections 2024-04-25T09:11:01.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.143+0000 7f21a1000640 1 --2- 172.21.15.173:0/2797690537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f219c0ccd30 0x7f219c0cf000 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.143+0000 7f21a1000640 1 -- 172.21.15.173:0/2797690537 >> 172.21.15.173:0/2797690537 conn(0x7f219c06ac90 msgr2=0x7f219c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:01.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.143+0000 7f21a1000640 1 -- 172.21.15.173:0/2797690537 shutdown_connections 2024-04-25T09:11:01.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.143+0000 7f21a1000640 1 -- 172.21.15.173:0/2797690537 wait complete. 2024-04-25T09:11:01.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f21a1000640 1 Processor -- start 2024-04-25T09:11:01.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f21a1000640 1 -- start start 2024-04-25T09:11:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f21a1000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f219c0cc8b0 0x7f219c13c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f21a1000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f219c0ccd30 0x7f219c15a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f21a1000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f219c145250 0x7f219c0b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f21a1000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219c0cd140 con 0x7f219c0ccd30 2024-04-25T09:11:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f21a1000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219c06ef80 con 0x7f219c145250 2024-04-25T09:11:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f21a1000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219c06d380 con 0x7f219c0cc8b0 2024-04-25T09:11:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f2199400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f219c0ccd30 0x7f219c15a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f2199400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f219c0ccd30 0x7f219c15a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56752/0 (socket says 172.21.15.173:56752) 2024-04-25T09:11:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f2199400640 1 -- 172.21.15.173:0/4151851446 learned_addr learned my addr 172.21.15.173:0/4151851446 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f219a800640 1 --2- 172.21.15.173:0/4151851446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f219c145250 0x7f219c0b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f2199e00640 1 --2- 172.21.15.173:0/4151851446 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f219c0cc8b0 0x7f219c13c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f2199400640 1 -- 172.21.15.173:0/4151851446 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f219c0cc8b0 msgr2=0x7f219c13c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f2199400640 1 --2- 172.21.15.173:0/4151851446 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f219c0cc8b0 0x7f219c13c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f2199400640 1 -- 172.21.15.173:0/4151851446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f219c145250 msgr2=0x7f219c0b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f2199400640 1 --2- 172.21.15.173:0/4151851446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f219c145250 0x7f219c0b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f2199400640 1 -- 172.21.15.173:0/4151851446 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c15aa50 con 0x7f219c0ccd30 2024-04-25T09:11:01.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f219a800640 1 --2- 172.21.15.173:0/4151851446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f219c145250 0x7f219c0b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:01.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f2199e00640 1 --2- 172.21.15.173:0/4151851446 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f219c0cc8b0 0x7f219c13c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:01.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f2199400640 1 --2- 172.21.15.173:0/4151851446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f219c0ccd30 0x7f219c15a510 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f218800c4c0 tx=0x7f2188001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f2192000640 1 -- 172.21.15.173:0/4151851446 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188017070 con 0x7f219c0ccd30 2024-04-25T09:11:01.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f2192000640 1 -- 172.21.15.173:0/4151851446 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2188003600 con 0x7f219c0ccd30 2024-04-25T09:11:01.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f2192000640 1 -- 172.21.15.173:0/4151851446 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21880039f0 con 0x7f219c0ccd30 2024-04-25T09:11:01.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f21a1000640 1 -- 172.21.15.173:0/4151851446 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f219c13cfd0 con 0x7f219c0ccd30 2024-04-25T09:11:01.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f21a1000640 1 -- 172.21.15.173:0/4151851446 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219c15ead0 con 0x7f219c0ccd30 2024-04-25T09:11:01.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.147+0000 7f21a1000640 1 -- 172.21.15.173:0/4151851446 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f219c073a40 con 0x7f219c0ccd30 2024-04-25T09:11:01.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.151+0000 7f2192000640 1 -- 172.21.15.173:0/4151851446 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f218801a070 con 0x7f219c0ccd30 2024-04-25T09:11:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.151+0000 7f2192000640 1 --2- 172.21.15.173:0/4151851446 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f217c066f60 0x7f217c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.151+0000 7f2192000640 1 -- 172.21.15.173:0/4151851446 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f2188084620 con 0x7f219c0ccd30 2024-04-25T09:11:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.151+0000 7f2199e00640 1 --2- 172.21.15.173:0/4151851446 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f217c066f60 0x7f217c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.151+0000 7f2199e00640 1 --2- 172.21.15.173:0/4151851446 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f217c066f60 0x7f217c069420 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f218c005fd0 tx=0x7f218c005ba0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.155+0000 7f2192000640 1 -- 172.21.15.173:0/4151851446 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f21880553e0 con 0x7f219c0ccd30 2024-04-25T09:11:01.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.343+0000 7f21a1000640 1 -- 172.21.15.173:0/4151851446 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f219c15aed0 con 0x7f219c0ccd30 2024-04-25T09:11:01.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.343+0000 7f2192000640 1 -- 172.21.15.173:0/4151851446 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f2188054ce0 con 0x7f219c0ccd30 2024-04-25T09:11:01.334 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:01.334 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1519522112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1519522112},{"type":"v1","addr":"172.21.15.194:6835","nonce":1519522112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7555,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/548680290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":548680290},{"type":"v1","addr":"172.21.15.173:6836","nonce":548680290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2602621503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2602621503},{"type":"v1","addr":"172.21.15.194:6833","nonce":2602621503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:24.354981+0000","modified":"2024-04-25T09:10:27.392053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/1492125936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":1492125936},{"type":"v1","addr":"172.21.15.173:6837","nonce":1492125936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:11:01.334 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 72 2024-04-25T09:11:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.347+0000 7f21a1000640 1 -- 172.21.15.173:0/4151851446 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f217c066f60 msgr2=0x7f217c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.347+0000 7f21a1000640 1 --2- 172.21.15.173:0/4151851446 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f217c066f60 0x7f217c069420 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f218c005fd0 tx=0x7f218c005ba0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.347+0000 7f21a1000640 1 -- 172.21.15.173:0/4151851446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f219c0ccd30 msgr2=0x7f219c15a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.347+0000 7f21a1000640 1 --2- 172.21.15.173:0/4151851446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f219c0ccd30 0x7f219c15a510 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f218800c4c0 tx=0x7f2188001e80 comp rx=0 tx=0).stop 2024-04-25T09:11:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.347+0000 7f21a1000640 1 -- 172.21.15.173:0/4151851446 shutdown_connections 2024-04-25T09:11:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.347+0000 7f21a1000640 1 --2- 172.21.15.173:0/4151851446 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f217c066f60 0x7f217c069420 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.347+0000 7f21a1000640 1 --2- 172.21.15.173:0/4151851446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f219c145250 0x7f219c0b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.347+0000 7f21a1000640 1 --2- 172.21.15.173:0/4151851446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f219c0ccd30 0x7f219c15a510 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.347+0000 7f21a1000640 1 --2- 172.21.15.173:0/4151851446 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f219c0cc8b0 0x7f219c13c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.347+0000 7f21a1000640 1 -- 172.21.15.173:0/4151851446 >> 172.21.15.173:0/4151851446 conn(0x7f219c06ac90 msgr2=0x7f219c15bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.347+0000 7f21a1000640 1 -- 172.21.15.173:0/4151851446 shutdown_connections 2024-04-25T09:11:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.347+0000 7f21a1000640 1 -- 172.21.15.173:0/4151851446 wait complete. 2024-04-25T09:11:01.353 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:11:01.354 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:11:01.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.499+0000 7fcd30c00640 1 Processor -- start 2024-04-25T09:11:01.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.499+0000 7fcd30c00640 1 -- start start 2024-04-25T09:11:01.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.503+0000 7fcd30c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcd2c0ccd30 0x7fcd2c0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.503+0000 7fcd30c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2c06e7c0 con 0x7fcd2c0cc8b0 2024-04-25T09:11:01.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.503+0000 7fcd30c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2c06d720 con 0x7fcd2c145250 2024-04-25T09:11:01.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.503+0000 7fcd30c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2c06da00 con 0x7fcd2c0ccd30 2024-04-25T09:11:01.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.503+0000 7fcd2a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcd2c0ccd30 0x7fcd2c0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.503+0000 7fcd21400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fcd2c0cc8b0 0x7fcd2c0ce8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36762/0 (socket says 172.21.15.173:36762) 2024-04-25T09:11:01.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.503+0000 7fcd2a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcd2c0ccd30 0x7fcd2c0cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56768/0 (socket says 172.21.15.173:56768) 2024-04-25T09:11:01.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.503+0000 7fcd21400640 1 -- 172.21.15.173:0/1552646056 learned_addr learned my addr 172.21.15.173:0/1552646056 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:01.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.503+0000 7fcd2a800640 1 -- 172.21.15.173:0/1552646056 >> v1:172.21.15.194:6789/0 conn(0x7fcd2c145250 legacy=0x7fcd2c15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.503+0000 7fcd2a800640 1 -- 172.21.15.173:0/1552646056 >> v1:172.21.15.173:6789/0 conn(0x7fcd2c0cc8b0 legacy=0x7fcd2c0ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.503+0000 7fcd2a800640 1 -- 172.21.15.173:0/1552646056 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c06dce0 con 0x7fcd2c0ccd30 2024-04-25T09:11:01.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.503+0000 7fcd2a800640 1 --2- 172.21.15.173:0/1552646056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd2c0ccd30 0x7fcd2c0cf000 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009d90 tx=0x7fcd2401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8291c0b053f2a65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.503+0000 7fcd29400640 1 -- 172.21.15.173:0/1552646056 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd240b2070 con 0x7fcd2c0ccd30 2024-04-25T09:11:01.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.503+0000 7fcd29400640 1 -- 172.21.15.173:0/1552646056 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd240a5a00 con 0x7fcd2c0ccd30 2024-04-25T09:11:01.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd29400640 1 -- 172.21.15.173:0/1552646056 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd240a5dd0 con 0x7fcd2c0ccd30 2024-04-25T09:11:01.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd30c00640 1 -- 172.21.15.173:0/1552646056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd2c0ccd30 msgr2=0x7fcd2c0cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd30c00640 1 --2- 172.21.15.173:0/1552646056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd2c0ccd30 0x7fcd2c0cf000 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009d90 tx=0x7fcd2401c940 comp rx=0 tx=0).stop 2024-04-25T09:11:01.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd30c00640 1 -- 172.21.15.173:0/1552646056 shutdown_connections 2024-04-25T09:11:01.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd30c00640 1 --2- 172.21.15.173:0/1552646056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd2c0ccd30 0x7fcd2c0cf000 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd30c00640 1 -- 172.21.15.173:0/1552646056 >> 172.21.15.173:0/1552646056 conn(0x7fcd2c06ac90 msgr2=0x7fcd2c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:01.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd30c00640 1 -- 172.21.15.173:0/1552646056 shutdown_connections 2024-04-25T09:11:01.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd30c00640 1 -- 172.21.15.173:0/1552646056 wait complete. 2024-04-25T09:11:01.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd30c00640 1 Processor -- start 2024-04-25T09:11:01.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd30c00640 1 -- start start 2024-04-25T09:11:01.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd30c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd2c0cc8b0 0x7fcd2c15d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd30c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd2c0ccd30 0x7fcd2c0adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd30c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd2c145250 0x7fcd2c0b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd30c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0cd140 con 0x7fcd2c0ccd30 2024-04-25T09:11:01.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd30c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c06ef80 con 0x7fcd2c0cc8b0 2024-04-25T09:11:01.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd30c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c06d380 con 0x7fcd2c145250 2024-04-25T09:11:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd21400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd2c0ccd30 0x7fcd2c0adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd21400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd2c0ccd30 0x7fcd2c0adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56782/0 (socket says 172.21.15.173:56782) 2024-04-25T09:11:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd21400640 1 -- 172.21.15.173:0/3384130178 learned_addr learned my addr 172.21.15.173:0/3384130178 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd21400640 1 -- 172.21.15.173:0/3384130178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd2c145250 msgr2=0x7fcd2c0b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd21400640 1 --2- 172.21.15.173:0/3384130178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd2c145250 0x7fcd2c0b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd21400640 1 -- 172.21.15.173:0/3384130178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd2c0cc8b0 msgr2=0x7fcd2c15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.507+0000 7fcd29e00640 1 --2- 172.21.15.173:0/3384130178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd2c0cc8b0 0x7fcd2c15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.511+0000 7fcd21400640 1 --2- 172.21.15.173:0/3384130178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd2c0cc8b0 0x7fcd2c15d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.511+0000 7fcd21400640 1 -- 172.21.15.173:0/3384130178 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c15d8d0 con 0x7fcd2c0ccd30 2024-04-25T09:11:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.511+0000 7fcd29e00640 1 --2- 172.21.15.173:0/3384130178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd2c0cc8b0 0x7fcd2c15d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.511+0000 7fcd21400640 1 --2- 172.21.15.173:0/3384130178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd2c0ccd30 0x7fcd2c0adfb0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400c430 tx=0x7fcd1400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.511+0000 7fcd22a00640 1 -- 172.21.15.173:0/3384130178 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd14017070 con 0x7fcd2c0ccd30 2024-04-25T09:11:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.511+0000 7fcd22a00640 1 -- 172.21.15.173:0/3384130178 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd14005cf0 con 0x7fcd2c0ccd30 2024-04-25T09:11:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.511+0000 7fcd22a00640 1 -- 172.21.15.173:0/3384130178 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd140072d0 con 0x7fcd2c0ccd30 2024-04-25T09:11:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.511+0000 7fcd30c00640 1 -- 172.21.15.173:0/3384130178 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2c15e4b0 con 0x7fcd2c0ccd30 2024-04-25T09:11:01.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.511+0000 7fcd30c00640 1 -- 172.21.15.173:0/3384130178 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2c15ea70 con 0x7fcd2c0ccd30 2024-04-25T09:11:01.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.511+0000 7fcd30c00640 1 -- 172.21.15.173:0/3384130178 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2c073a40 con 0x7fcd2c0ccd30 2024-04-25T09:11:01.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.511+0000 7fcd22a00640 1 -- 172.21.15.173:0/3384130178 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcd1401a070 con 0x7fcd2c0ccd30 2024-04-25T09:11:01.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.511+0000 7fcd22a00640 1 --2- 172.21.15.173:0/3384130178 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd08066f60 0x7fcd08069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.511+0000 7fcd22a00640 1 -- 172.21.15.173:0/3384130178 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fcd14084520 con 0x7fcd2c0ccd30 2024-04-25T09:11:01.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.511+0000 7fcd29e00640 1 --2- 172.21.15.173:0/3384130178 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd08066f60 0x7fcd08069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.515+0000 7fcd29e00640 1 --2- 172.21.15.173:0/3384130178 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd08066f60 0x7fcd08069420 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c000f70 tx=0x7fcd1c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.515+0000 7fcd22a00640 1 -- 172.21.15.173:0/3384130178 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcd14054c90 con 0x7fcd2c0ccd30 2024-04-25T09:11:01.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.723+0000 7fcd30c00640 1 -- 172.21.15.173:0/3384130178 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fcd2c15bcc0 con 0x7fcd2c0ccd30 2024-04-25T09:11:01.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.727+0000 7fcd22a00640 1 -- 172.21.15.173:0/3384130178 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1631 (secure 0 0 0) 0x7fcd14058d30 con 0x7fcd2c0ccd30 2024-04-25T09:11:01.714 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:01.714 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":516,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":111,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076353747,"bytes_used":2578759680,"bytes_avail":770515353600,"bytes_total":773094113280,"write_bytes_sec":52480010,"read_op_per_sec":0,"write_op_per_sec":53},"fsmap":{"epoch":72,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8193}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-04-25T09:11:00.835975+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:11:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.727+0000 7fcd30c00640 1 -- 172.21.15.173:0/3384130178 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd08066f60 msgr2=0x7fcd08069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.727+0000 7fcd30c00640 1 --2- 172.21.15.173:0/3384130178 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd08066f60 0x7fcd08069420 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c000f70 tx=0x7fcd1c009040 comp rx=0 tx=0).stop 2024-04-25T09:11:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.727+0000 7fcd30c00640 1 -- 172.21.15.173:0/3384130178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd2c0ccd30 msgr2=0x7fcd2c0adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.727+0000 7fcd30c00640 1 --2- 172.21.15.173:0/3384130178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd2c0ccd30 0x7fcd2c0adfb0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400c430 tx=0x7fcd1400c8f0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.727+0000 7fcd30c00640 1 -- 172.21.15.173:0/3384130178 shutdown_connections 2024-04-25T09:11:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.727+0000 7fcd30c00640 1 --2- 172.21.15.173:0/3384130178 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd08066f60 0x7fcd08069420 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.727+0000 7fcd30c00640 1 --2- 172.21.15.173:0/3384130178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd2c145250 0x7fcd2c0b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.727+0000 7fcd30c00640 1 --2- 172.21.15.173:0/3384130178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd2c0ccd30 0x7fcd2c0adfb0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.727+0000 7fcd30c00640 1 --2- 172.21.15.173:0/3384130178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd2c0cc8b0 0x7fcd2c15d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.727+0000 7fcd30c00640 1 -- 172.21.15.173:0/3384130178 >> 172.21.15.173:0/3384130178 conn(0x7fcd2c06ac90 msgr2=0x7fcd2c071320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:01.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.727+0000 7fcd30c00640 1 -- 172.21.15.173:0/3384130178 shutdown_connections 2024-04-25T09:11:01.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.727+0000 7fcd30c00640 1 -- 172.21.15.173:0/3384130178 wait complete. 2024-04-25T09:11:01.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused paths [/scrub_control_test_path]'} 2024-04-25T09:11:01.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:01.734 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub resume 2024-04-25T09:11:01.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.883+0000 7f40f6c00640 1 Processor -- start 2024-04-25T09:11:01.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.883+0000 7f40f6c00640 1 -- start start 2024-04-25T09:11:01.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.883+0000 7f40f6c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f40f015efe0 0x7f40f015f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.883+0000 7f40f6c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f40f00b5050 0x7f40f015fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.883+0000 7f40f6c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f015f3c0 con 0x7f40f0160080 2024-04-25T09:11:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.883+0000 7f40f6c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f006ac90 con 0x7f40f00b5050 2024-04-25T09:11:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.883+0000 7f40f6c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f00ad780 con 0x7f40f015efe0 2024-04-25T09:11:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.883+0000 7f40ef400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f40f00b5050 0x7f40f015fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.887+0000 7f40ef400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f40f00b5050 0x7f40f015fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56792/0 (socket says 172.21.15.173:56792) 2024-04-25T09:11:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.887+0000 7f40ef400640 1 -- 172.21.15.173:0/3105463375 learned_addr learned my addr 172.21.15.173:0/3105463375 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.887+0000 7f40f4c00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f40f0160080 0x7f40f00b3660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36774/0 (socket says 172.21.15.173:36774) 2024-04-25T09:11:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.887+0000 7f40efe00640 1 --2- 172.21.15.173:0/3105463375 >> v2:172.21.15.194:3300/0 conn(0x7f40f015efe0 0x7f40f015f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.887+0000 7f40eea00640 1 -- 172.21.15.173:0/3105463375 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160138332 0 0) 0x7f40f015f3c0 con 0x7f40f0160080 2024-04-25T09:11:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.887+0000 7f40eea00640 1 -- 172.21.15.173:0/3105463375 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40d4003530 con 0x7f40f0160080 2024-04-25T09:11:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.887+0000 7f40ef400640 1 -- 172.21.15.173:0/3105463375 >> v2:172.21.15.194:3300/0 conn(0x7f40f015efe0 msgr2=0x7f40f015f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.887+0000 7f40ef400640 1 --2- 172.21.15.173:0/3105463375 >> v2:172.21.15.194:3300/0 conn(0x7f40f015efe0 0x7f40f015f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.887+0000 7f40ef400640 1 -- 172.21.15.173:0/3105463375 >> v1:172.21.15.173:6789/0 conn(0x7f40f0160080 legacy=0x7f40f00b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.887+0000 7f40ef400640 1 -- 172.21.15.173:0/3105463375 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f00af730 con 0x7f40f00b5050 2024-04-25T09:11:01.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.887+0000 7f40ef400640 1 --2- 172.21.15.173:0/3105463375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f00b5050 0x7f40f015fb40 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f40f00d0b00 tx=0x7f40dc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773fa12587dc87e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.887+0000 7f40eea00640 1 -- 172.21.15.173:0/3105463375 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc0ab430 con 0x7f40f00b5050 2024-04-25T09:11:01.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.887+0000 7f40eea00640 1 -- 172.21.15.173:0/3105463375 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc0b0070 con 0x7f40f00b5050 2024-04-25T09:11:01.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.887+0000 7f40eea00640 1 -- 172.21.15.173:0/3105463375 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc0ab7f0 con 0x7f40f00b5050 2024-04-25T09:11:01.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40f6c00640 1 -- 172.21.15.173:0/3105463375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f00b5050 msgr2=0x7f40f015fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40f6c00640 1 --2- 172.21.15.173:0/3105463375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f00b5050 0x7f40f015fb40 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f40f00d0b00 tx=0x7f40dc01c520 comp rx=0 tx=0).stop 2024-04-25T09:11:01.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40f6c00640 1 -- 172.21.15.173:0/3105463375 shutdown_connections 2024-04-25T09:11:01.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40f6c00640 1 --2- 172.21.15.173:0/3105463375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f00b5050 0x7f40f015fb40 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40f6c00640 1 --2- 172.21.15.173:0/3105463375 >> v2:172.21.15.194:3300/0 conn(0x7f40f015efe0 0x7f40f015f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40f6c00640 1 -- 172.21.15.173:0/3105463375 >> 172.21.15.173:0/3105463375 conn(0x7f40f00cfed0 msgr2=0x7f40f00d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:01.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40f6c00640 1 -- 172.21.15.173:0/3105463375 shutdown_connections 2024-04-25T09:11:01.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40f6c00640 1 -- 172.21.15.173:0/3105463375 wait complete. 2024-04-25T09:11:01.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40f6c00640 1 Processor -- start 2024-04-25T09:11:01.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40f6c00640 1 -- start start 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40f6c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40f00b5050 0x7f40f015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40f6c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f015efe0 0x7f40f006f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40f6c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40f0160080 0x7f40f0148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40f6c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0168b20 con 0x7f40f015efe0 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40f6c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f01689a0 con 0x7f40f0160080 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40f6c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0168ca0 con 0x7f40f00b5050 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40ef400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f015efe0 0x7f40f006f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40ef400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f015efe0 0x7f40f006f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56806/0 (socket says 172.21.15.173:56806) 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40ef400640 1 -- 172.21.15.173:0/1642683973 learned_addr learned my addr 172.21.15.173:0/1642683973 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:01.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40efe00640 1 --2- 172.21.15.173:0/1642683973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40f00b5050 0x7f40f015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40f4c00640 1 --2- 172.21.15.173:0/1642683973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40f0160080 0x7f40f0148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40ef400640 1 -- 172.21.15.173:0/1642683973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40f00b5050 msgr2=0x7f40f015d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40ef400640 1 --2- 172.21.15.173:0/1642683973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40f00b5050 0x7f40f015d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40ef400640 1 -- 172.21.15.173:0/1642683973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40f0160080 msgr2=0x7f40f0148560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40ef400640 1 --2- 172.21.15.173:0/1642683973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40f0160080 0x7f40f0148560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40ef400640 1 -- 172.21.15.173:0/1642683973 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f009b7d0 con 0x7f40f015efe0 2024-04-25T09:11:01.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.891+0000 7f40efe00640 1 --2- 172.21.15.173:0/1642683973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40f00b5050 0x7f40f015d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:01.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.895+0000 7f40ef400640 1 --2- 172.21.15.173:0/1642683973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f015efe0 0x7f40f006f2c0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f40dc01a150 tx=0x7f40dc01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.895+0000 7f40e7e00640 1 -- 172.21.15.173:0/1642683973 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc0be3f0 con 0x7f40f015efe0 2024-04-25T09:11:01.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.895+0000 7f40e7e00640 1 -- 172.21.15.173:0/1642683973 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc0be590 con 0x7f40f015efe0 2024-04-25T09:11:01.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.895+0000 7f40e7e00640 1 -- 172.21.15.173:0/1642683973 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc0be960 con 0x7f40f015efe0 2024-04-25T09:11:01.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.895+0000 7f40f6c00640 1 -- 172.21.15.173:0/1642683973 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f009bab0 con 0x7f40f015efe0 2024-04-25T09:11:01.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.895+0000 7f40f6c00640 1 -- 172.21.15.173:0/1642683973 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f009c070 con 0x7f40f015efe0 2024-04-25T09:11:01.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.895+0000 7f40e7e00640 1 -- 172.21.15.173:0/1642683973 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f40dc0b43f0 con 0x7f40f015efe0 2024-04-25T09:11:01.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.895+0000 7f40e7e00640 1 --2- 172.21.15.173:0/1642683973 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40d0066f60 0x7f40d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.895+0000 7f40e7e00640 1 -- 172.21.15.173:0/1642683973 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f40dc0a8030 con 0x7f40f015efe0 2024-04-25T09:11:01.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.895+0000 7f40efe00640 1 --2- 172.21.15.173:0/1642683973 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40d0066f60 0x7f40d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.895+0000 7f40fa1a2000 1 Processor -- start 2024-04-25T09:11:01.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.895+0000 7f40fa1a2000 1 -- start start 2024-04-25T09:11:01.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40efe00640 1 --2- 172.21.15.173:0/1642683973 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40d0066f60 0x7f40d0069420 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f40e00074c0 tx=0x7f40e000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40fa1a2000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f549d0 0x562d23f54db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40fa1a2000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f552f0 0x562d23f0ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40fa1a2000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f0b0a0 0x562d23f0b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40fa1a2000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d23d57ff0 con 0x562d23f552f0 2024-04-25T09:11:01.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40fa1a2000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d23ce0150 con 0x562d23f0b0a0 2024-04-25T09:11:01.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40fa1a2000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d23d54090 con 0x562d23f549d0 2024-04-25T09:11:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40ef400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f552f0 0x562d23f0ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40ef400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f552f0 0x562d23f0ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56818/0 (socket says 172.21.15.173:56818) 2024-04-25T09:11:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40ef400640 1 -- 172.21.15.173:0/3356955287 learned_addr learned my addr 172.21.15.173:0/3356955287 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40efe00640 1 --2- 172.21.15.173:0/3356955287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f549d0 0x562d23f54db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40f4c00640 1 --2- 172.21.15.173:0/3356955287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f0b0a0 0x562d23f0b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40ef400640 1 -- 172.21.15.173:0/3356955287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f549d0 msgr2=0x562d23f54db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40ef400640 1 --2- 172.21.15.173:0/3356955287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f549d0 0x562d23f54db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40ef400640 1 -- 172.21.15.173:0/3356955287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f0b0a0 msgr2=0x562d23f0b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40ef400640 1 --2- 172.21.15.173:0/3356955287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f0b0a0 0x562d23f0b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40ef400640 1 -- 172.21.15.173:0/3356955287 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d23eee0d0 con 0x562d23f552f0 2024-04-25T09:11:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40ef400640 1 --2- 172.21.15.173:0/3356955287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f552f0 0x562d23f0ab60 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f40dc01ca90 tx=0x7f40dc0ef390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a2d8862be17c54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40e4c00640 1 -- 172.21.15.173:0/3356955287 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc0f8010 con 0x562d23f552f0 2024-04-25T09:11:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40e4c00640 1 -- 172.21.15.173:0/3356955287 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc0b0070 con 0x562d23f552f0 2024-04-25T09:11:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40e4c00640 1 -- 172.21.15.173:0/3356955287 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc0ebf70 con 0x562d23f552f0 2024-04-25T09:11:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40fa1a2000 1 -- 172.21.15.173:0/3356955287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f552f0 msgr2=0x562d23f0ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/3356955287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f552f0 0x562d23f0ab60 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f40dc01ca90 tx=0x7f40dc0ef390 comp rx=0 tx=0).stop 2024-04-25T09:11:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40fa1a2000 1 -- 172.21.15.173:0/3356955287 shutdown_connections 2024-04-25T09:11:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/3356955287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f0b0a0 0x562d23f0b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/3356955287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f552f0 0x562d23f0ab60 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/3356955287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f549d0 0x562d23f54db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40fa1a2000 1 -- 172.21.15.173:0/3356955287 >> 172.21.15.173:0/3356955287 conn(0x562d23f07020 msgr2=0x562d23f09440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40fa1a2000 1 -- 172.21.15.173:0/3356955287 shutdown_connections 2024-04-25T09:11:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40fa1a2000 1 -- 172.21.15.173:0/3356955287 wait complete. 2024-04-25T09:11:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40fa1a2000 1 -- start start 2024-04-25T09:11:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.899+0000 7f40fa1a2000 1 Processor -- start 2024-04-25T09:11:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f0b0a0 0x562d23f397f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f549d0 0x562d23f39d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f552f0 0x562d23f3a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d23d1c250 con 0x562d23f0b0a0 2024-04-25T09:11:01.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d23d12690 con 0x562d23f552f0 2024-04-25T09:11:01.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d23ce0a40 con 0x562d23f549d0 2024-04-25T09:11:01.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 10 client.0 _ll_register_callbacks cb 0x562d23ef5e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:01.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40efe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f0b0a0 0x562d23f397f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40efe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f0b0a0 0x562d23f397f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56832/0 (socket says 172.21.15.173:56832) 2024-04-25T09:11:01.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40efe00640 1 -- 172.21.15.173:0/2015881530 learned_addr learned my addr 172.21.15.173:0/2015881530 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:01.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40ef400640 1 --2- 172.21.15.173:0/2015881530 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f549d0 0x562d23f39d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40f4c00640 1 --2- 172.21.15.173:0/2015881530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f552f0 0x562d23f3a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40efe00640 1 -- 172.21.15.173:0/2015881530 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f549d0 msgr2=0x562d23f39d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:01.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40efe00640 1 --2- 172.21.15.173:0/2015881530 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f549d0 0x562d23f39d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40efe00640 1 -- 172.21.15.173:0/2015881530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f552f0 msgr2=0x562d23f3a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40efe00640 1 --2- 172.21.15.173:0/2015881530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f552f0 0x562d23f3a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40efe00640 1 -- 172.21.15.173:0/2015881530 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d23e051c0 con 0x562d23f0b0a0 2024-04-25T09:11:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40efe00640 1 --2- 172.21.15.173:0/2015881530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f0b0a0 0x562d23f397f0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f40e00045e0 tx=0x7f40e0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c976f30e1c0a73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40d9600640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:11:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40d9600640 1 -- 172.21.15.173:0/2015881530 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e0018c30 con 0x562d23f0b0a0 2024-04-25T09:11:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40d9600640 1 -- 172.21.15.173:0/2015881530 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f40e0012040 con 0x562d23f0b0a0 2024-04-25T09:11:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 -- 172.21.15.173:0/2015881530 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40dc0b0070 con 0x562d23f0b0a0 2024-04-25T09:11:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40d9600640 1 -- 172.21.15.173:0/2015881530 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40e0031050 con 0x562d23f0b0a0 2024-04-25T09:11:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 10 client.8478 fetch_fsmap learned FSMap version 72 2024-04-25T09:11:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 -- 172.21.15.173:0/2015881530 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x562d23e01170 con 0x562d23f0b0a0 2024-04-25T09:11:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40d9600640 1 -- 172.21.15.173:0/2015881530 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc0b0070 con 0x562d23f0b0a0 2024-04-25T09:11:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40d9600640 1 -- 172.21.15.173:0/2015881530 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f40e0034020 con 0x562d23f0b0a0 2024-04-25T09:11:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 10 client.8478 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:11:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 10 client.8478 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:11:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 20 client.8478 populate_metadata read hostname 'smithi173' 2024-04-25T09:11:01.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/2015881530 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x562d23f64c80 0x562d23f67070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 4 client.8478 mds_command: new command op to 8193 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:11:01.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 -- 172.21.15.173:0/2015881530 --> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d23cf3c60 con 0x562d23f64c80 2024-04-25T09:11:01.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40ef400640 1 --2- 172.21.15.173:0/2015881530 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x562d23f64c80 0x562d23f67070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40d9600640 10 client.8478 ms_handle_connect on v2:172.21.15.173:6835/1492125936 2024-04-25T09:11:01.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40ef400640 1 --2- 172.21.15.173:0/2015881530 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x562d23f64c80 0x562d23f67070 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e1fc20d757ca94 server_cookie=517a9e27cc6189bd in_seq=0 out_seq=0 2024-04-25T09:11:01.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40d9600640 1 -- 172.21.15.173:0/2015881530 <== mds.0 v2:172.21.15.173:6835/1492125936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562d23cf3c60 con 0x562d23f64c80 2024-04-25T09:11:01.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40d9600640 10 client.8478 handle_command_reply: tid=0 2024-04-25T09:11:01.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 client.8478 shutdown 2024-04-25T09:11:01.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 -- 172.21.15.173:0/2015881530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f0b0a0 msgr2=0x562d23f397f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/2015881530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f0b0a0 0x562d23f397f0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f40e00045e0 tx=0x7f40e0004ac0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 -- 172.21.15.173:0/2015881530 shutdown_connections 2024-04-25T09:11:01.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/2015881530 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x562d23f64c80 0x562d23f67070 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/2015881530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f552f0 0x562d23f3a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/2015881530 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f549d0 0x562d23f39d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40d9600640 0 client.8478 ms_handle_reset on v2:172.21.15.173:6835/1492125936 2024-04-25T09:11:01.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/2015881530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f0b0a0 0x562d23f397f0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 -- 172.21.15.173:0/2015881530 >> 172.21.15.173:0/2015881530 conn(0x562d23f07020 msgr2=0x562d23f09ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:01.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 -- 172.21.15.173:0/2015881530 shutdown_connections 2024-04-25T09:11:01.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 1 -- 172.21.15.173:0/2015881530 wait complete. 2024-04-25T09:11:01.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.903+0000 7f40fa1a2000 20 client.8478 trim_cache size 0 max 16384 2024-04-25T09:11:01.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.919+0000 7f40fa1a2000 1 Processor -- start 2024-04-25T09:11:01.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.919+0000 7f40fa1a2000 1 -- start start 2024-04-25T09:11:01.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.919+0000 7f40fa1a2000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f0b0a0 0x562d23fb1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.919+0000 7f40fa1a2000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f549d0 0x562d23fb1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.919+0000 7f40fa1a2000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f552f0 0x562d23fb1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.919+0000 7f40fa1a2000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f02035b0 con 0x562d23f0b0a0 2024-04-25T09:11:01.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.919+0000 7f40fa1a2000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f02027b0 con 0x562d23f549d0 2024-04-25T09:11:01.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.919+0000 7f40fa1a2000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f01f7c30 con 0x562d23f552f0 2024-04-25T09:11:01.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.919+0000 7f40efe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f0b0a0 0x562d23fb1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.919+0000 7f40efe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f0b0a0 0x562d23fb1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56842/0 (socket says 172.21.15.173:56842) 2024-04-25T09:11:01.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.919+0000 7f40efe00640 1 -- 172.21.15.173:0/3540312999 learned_addr learned my addr 172.21.15.173:0/3540312999 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:01.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.919+0000 7f40efe00640 1 -- 172.21.15.173:0/3540312999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f552f0 msgr2=0x562d23fb1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:01.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.919+0000 7f40efe00640 1 --2- 172.21.15.173:0/3540312999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f552f0 0x562d23fb1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.919+0000 7f40efe00640 1 -- 172.21.15.173:0/3540312999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f549d0 msgr2=0x562d23fb1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:01.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.919+0000 7f40efe00640 1 --2- 172.21.15.173:0/3540312999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f549d0 0x562d23fb1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.919+0000 7f40efe00640 1 -- 172.21.15.173:0/3540312999 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d23d9ede0 con 0x562d23f0b0a0 2024-04-25T09:11:01.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.919+0000 7f40efe00640 1 --2- 172.21.15.173:0/3540312999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f0b0a0 0x562d23fb1300 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f40e0004a20 tx=0x7f40e0022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7849a9f4f7454373 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40dbe00640 1 -- 172.21.15.173:0/3540312999 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e003a070 con 0x562d23f0b0a0 2024-04-25T09:11:01.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40dbe00640 1 -- 172.21.15.173:0/3540312999 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e0029070 con 0x562d23f0b0a0 2024-04-25T09:11:01.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40dbe00640 1 -- 172.21.15.173:0/3540312999 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e0018c30 con 0x562d23f0b0a0 2024-04-25T09:11:01.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 1 -- 172.21.15.173:0/3540312999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f0b0a0 msgr2=0x562d23fb1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/3540312999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f0b0a0 0x562d23fb1300 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f40e0004a20 tx=0x7f40e0022000 comp rx=0 tx=0).stop 2024-04-25T09:11:01.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 1 -- 172.21.15.173:0/3540312999 shutdown_connections 2024-04-25T09:11:01.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/3540312999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f552f0 0x562d23fb1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/3540312999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f549d0 0x562d23fb1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/3540312999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f0b0a0 0x562d23fb1300 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 1 -- 172.21.15.173:0/3540312999 >> 172.21.15.173:0/3540312999 conn(0x562d23f07020 msgr2=0x562d23f61fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:01.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 1 -- 172.21.15.173:0/3540312999 shutdown_connections 2024-04-25T09:11:01.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 1 -- 172.21.15.173:0/3540312999 wait complete. 2024-04-25T09:11:01.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 1 -- start start 2024-04-25T09:11:01.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 1 Processor -- start 2024-04-25T09:11:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f0b0a0 0x562d23f67770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f549d0 0x562d23f67cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f552f0 0x562d23f681f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d23d57300 con 0x562d23f552f0 2024-04-25T09:11:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d23cf2e00 con 0x562d23f0b0a0 2024-04-25T09:11:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d23d5c620 con 0x562d23f549d0 2024-04-25T09:11:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 10 client.0 _ll_register_callbacks cb 0x562d23ed6040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40f4c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f552f0 0x562d23f681f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40f4c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f552f0 0x562d23f681f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56844/0 (socket says 172.21.15.173:56844) 2024-04-25T09:11:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40f4c00640 1 -- 172.21.15.173:0/4124355877 learned_addr learned my addr 172.21.15.173:0/4124355877 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40ef400640 1 --2- 172.21.15.173:0/4124355877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f549d0 0x562d23f67cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40efe00640 1 --2- 172.21.15.173:0/4124355877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f0b0a0 0x562d23f67770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40f4c00640 1 -- 172.21.15.173:0/4124355877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f549d0 msgr2=0x562d23f67cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40f4c00640 1 --2- 172.21.15.173:0/4124355877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f549d0 0x562d23f67cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40f4c00640 1 -- 172.21.15.173:0/4124355877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f0b0a0 msgr2=0x562d23f67770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40f4c00640 1 --2- 172.21.15.173:0/4124355877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f0b0a0 0x562d23f67770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40f4c00640 1 -- 172.21.15.173:0/4124355877 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d23cf98e0 con 0x562d23f552f0 2024-04-25T09:11:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40f4c00640 1 --2- 172.21.15.173:0/4124355877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f552f0 0x562d23f681f0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f40e80011c0 tx=0x7f40e8005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a75116e8de8e64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40d9600640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:11:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40d9600640 1 -- 172.21.15.173:0/4124355877 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e801a020 con 0x562d23f552f0 2024-04-25T09:11:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40d9600640 1 -- 172.21.15.173:0/4124355877 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f40e8001b70 con 0x562d23f552f0 2024-04-25T09:11:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.923+0000 7f40fa1a2000 1 -- 172.21.15.173:0/4124355877 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40e0029070 con 0x562d23f552f0 2024-04-25T09:11:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40d9600640 1 -- 172.21.15.173:0/4124355877 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40e8024050 con 0x562d23f552f0 2024-04-25T09:11:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 10 client.8484 fetch_fsmap learned FSMap version 72 2024-04-25T09:11:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 1 -- 172.21.15.173:0/4124355877 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x562d23db18f0 con 0x562d23f552f0 2024-04-25T09:11:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40d9600640 1 -- 172.21.15.173:0/4124355877 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e0029070 con 0x562d23f552f0 2024-04-25T09:11:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40d9600640 1 -- 172.21.15.173:0/4124355877 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f40e8027020 con 0x562d23f552f0 2024-04-25T09:11:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 10 client.8484 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:11:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 10 client.8484 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:11:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 20 client.8484 populate_metadata read hostname 'smithi173' 2024-04-25T09:11:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/4124355877 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x562d23fbaf50 0x562d23fbd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 4 client.8484 mds_command: new command op to 8193 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-04-25T09:11:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 1 -- 172.21.15.173:0/4124355877 --> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x562d23d65530 con 0x562d23fbaf50 2024-04-25T09:11:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40efe00640 1 --2- 172.21.15.173:0/4124355877 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x562d23fbaf50 0x562d23fbd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40efe00640 1 --2- 172.21.15.173:0/4124355877 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x562d23fbaf50 0x562d23fbd340 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c6d1a970c255375 server_cookie=80cb2b8ab204c530 in_seq=0 out_seq=0 2024-04-25T09:11:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40d9600640 10 client.8484 ms_handle_connect on v2:172.21.15.173:6835/1492125936 2024-04-25T09:11:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40d9600640 1 -- 172.21.15.173:0/4124355877 <== mds.0 v2:172.21.15.173:6835/1492125936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x562d23d65530 con 0x562d23fbaf50 2024-04-25T09:11:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40d9600640 10 client.8484 handle_command_reply: tid=0 2024-04-25T09:11:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 1 client.8484 shutdown 2024-04-25T09:11:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 1 -- 172.21.15.173:0/4124355877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f552f0 msgr2=0x562d23f681f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/4124355877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f552f0 0x562d23f681f0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f40e80011c0 tx=0x7f40e8005f40 comp rx=0 tx=0).stop 2024-04-25T09:11:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 1 -- 172.21.15.173:0/4124355877 shutdown_connections 2024-04-25T09:11:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/4124355877 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x562d23fbaf50 0x562d23fbd340 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/4124355877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d23f552f0 0x562d23f681f0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/4124355877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x562d23f549d0 0x562d23f67cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 1 --2- 172.21.15.173:0/4124355877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d23f0b0a0 0x562d23f67770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40d9600640 0 client.8484 ms_handle_reset on v2:172.21.15.173:6835/1492125936 2024-04-25T09:11:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 1 -- 172.21.15.173:0/4124355877 >> 172.21.15.173:0/4124355877 conn(0x562d23f07020 msgr2=0x562d23f530d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 1 -- 172.21.15.173:0/4124355877 shutdown_connections 2024-04-25T09:11:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 1 -- 172.21.15.173:0/4124355877 wait complete. 2024-04-25T09:11:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40fa1a2000 20 client.8484 trim_cache size 0 max 16384 2024-04-25T09:11:01.920 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:11:01.920 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0 2024-04-25T09:11:01.920 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:11:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40f6c00640 1 -- 172.21.15.173:0/1642683973 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40d0066f60 msgr2=0x7f40d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40f6c00640 1 --2- 172.21.15.173:0/1642683973 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40d0066f60 0x7f40d0069420 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f40e00074c0 tx=0x7f40e000b040 comp rx=0 tx=0).stop 2024-04-25T09:11:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40f6c00640 1 -- 172.21.15.173:0/1642683973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f015efe0 msgr2=0x7f40f006f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40f6c00640 1 --2- 172.21.15.173:0/1642683973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f015efe0 0x7f40f006f2c0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f40dc01a150 tx=0x7f40dc01ad60 comp rx=0 tx=0).stop 2024-04-25T09:11:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40f6c00640 1 -- 172.21.15.173:0/1642683973 shutdown_connections 2024-04-25T09:11:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40f6c00640 1 --2- 172.21.15.173:0/1642683973 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40d0066f60 0x7f40d0069420 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40f6c00640 1 --2- 172.21.15.173:0/1642683973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40f0160080 0x7f40f0148560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40f6c00640 1 --2- 172.21.15.173:0/1642683973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f015efe0 0x7f40f006f2c0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40f6c00640 1 --2- 172.21.15.173:0/1642683973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40f00b5050 0x7f40f015d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40f6c00640 1 -- 172.21.15.173:0/1642683973 >> 172.21.15.173:0/1642683973 conn(0x7f40f00cfed0 msgr2=0x7f40f00cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40f6c00640 1 -- 172.21.15.173:0/1642683973 shutdown_connections 2024-04-25T09:11:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:01.927+0000 7f40f6c00640 1 -- 172.21.15.173:0/1642683973 wait complete. 2024-04-25T09:11:01.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:01.934 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T09:11:02.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.083+0000 7f742f200640 1 Processor -- start 2024-04-25T09:11:02.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.083+0000 7f742f200640 1 -- start start 2024-04-25T09:11:02.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742f200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f743006e4c0 0x7f7430161d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742f200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7430071d30 con 0x7f74300b0ac0 2024-04-25T09:11:02.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742f200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743006e950 con 0x7f7430162290 2024-04-25T09:11:02.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742f200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743006ec30 con 0x7f743006e4c0 2024-04-25T09:11:02.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742de00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f74300b0ac0 0x7f7430071620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36784/0 (socket says 172.21.15.173:36784) 2024-04-25T09:11:02.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742de00640 1 -- 172.21.15.173:0/3626741034 learned_addr learned my addr 172.21.15.173:0/3626741034 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:02.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f7427e00640 1 --2- 172.21.15.173:0/3626741034 >> v2:172.21.15.194:3300/0 conn(0x7f743006e4c0 0x7f7430161d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742d400640 1 -- 172.21.15.173:0/3626741034 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465597092 0 0) 0x7f7430071d30 con 0x7f74300b0ac0 2024-04-25T09:11:02.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742d400640 1 -- 172.21.15.173:0/3626741034 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7414003530 con 0x7f74300b0ac0 2024-04-25T09:11:02.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742d400640 1 -- 172.21.15.173:0/3626741034 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3434942681 0 0) 0x7f7414003530 con 0x7f74300b0ac0 2024-04-25T09:11:02.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742d400640 1 -- 172.21.15.173:0/3626741034 >> v2:172.21.15.194:3300/0 conn(0x7f743006e4c0 msgr2=0x7f7430161d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:02.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742d400640 1 --2- 172.21.15.173:0/3626741034 >> v2:172.21.15.194:3300/0 conn(0x7f743006e4c0 0x7f7430161d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742d400640 1 -- 172.21.15.173:0/3626741034 >> v1:172.21.15.194:6789/0 conn(0x7f7430162290 legacy=0x7f743015e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742d400640 1 -- 172.21.15.173:0/3626741034 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743006ef10 con 0x7f74300b0ac0 2024-04-25T09:11:02.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742d400640 1 -- 172.21.15.173:0/3626741034 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f7420001680 con 0x7f74300b0ac0 2024-04-25T09:11:02.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742d400640 1 -- 172.21.15.173:0/3626741034 >> v1:172.21.15.173:6789/0 conn(0x7f74300b0ac0 legacy=0x7f7430071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742d400640 1 --2- 172.21.15.173:0/3626741034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74140039c0 0x7f7414003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742d400640 1 --2- 172.21.15.173:0/3626741034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7414004810 0x7f7414004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742d400640 1 --2- 172.21.15.173:0/3626741034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74140051d0 0x7f741400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742d400640 1 -- 172.21.15.173:0/3626741034 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743006ec30 con 0x7f7414004810 2024-04-25T09:11:02.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742d400640 1 -- 172.21.15.173:0/3626741034 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741400c170 con 0x7f74140039c0 2024-04-25T09:11:02.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742d400640 1 -- 172.21.15.173:0/3626741034 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741400c370 con 0x7f74140051d0 2024-04-25T09:11:02.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f7427e00640 1 --2- 172.21.15.173:0/3626741034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7414004810 0x7f7414004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742de00640 1 --2- 172.21.15.173:0/3626741034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74140039c0 0x7f7414003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742e800640 1 --2- 172.21.15.173:0/3626741034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74140051d0 0x7f741400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f7427e00640 1 -- 172.21.15.173:0/3626741034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74140051d0 msgr2=0x7f741400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:02.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f7427e00640 1 --2- 172.21.15.173:0/3626741034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74140051d0 0x7f741400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f7427e00640 1 -- 172.21.15.173:0/3626741034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74140039c0 msgr2=0x7f7414003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:02.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f7427e00640 1 --2- 172.21.15.173:0/3626741034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74140039c0 0x7f7414003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f7427e00640 1 -- 172.21.15.173:0/3626741034 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7414003530 con 0x7f7414004810 2024-04-25T09:11:02.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742e800640 1 --2- 172.21.15.173:0/3626741034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74140051d0 0x7f741400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:02.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.087+0000 7f742e800640 1 -- 172.21.15.173:0/3626741034 reap_dead start 2024-04-25T09:11:02.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.091+0000 7f7427e00640 1 --2- 172.21.15.173:0/3626741034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7414004810 0x7f7414004c90 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f743015bc00 tx=0x7f741801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6751ba42b02f9fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.091+0000 7f742d400640 1 -- 172.21.15.173:0/3626741034 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74180096b0 con 0x7f7414004810 2024-04-25T09:11:02.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.091+0000 7f742d400640 1 -- 172.21.15.173:0/3626741034 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74180a6500 con 0x7f7414004810 2024-04-25T09:11:02.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.091+0000 7f742d400640 1 -- 172.21.15.173:0/3626741034 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74180a68f0 con 0x7f7414004810 2024-04-25T09:11:02.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.091+0000 7f742f200640 1 -- 172.21.15.173:0/3626741034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7414004810 msgr2=0x7f7414004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.091+0000 7f742f200640 1 --2- 172.21.15.173:0/3626741034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7414004810 0x7f7414004c90 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f743015bc00 tx=0x7f741801ca10 comp rx=0 tx=0).stop 2024-04-25T09:11:02.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.091+0000 7f742f200640 1 -- 172.21.15.173:0/3626741034 shutdown_connections 2024-04-25T09:11:02.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.091+0000 7f742f200640 1 --2- 172.21.15.173:0/3626741034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7414004810 0x7f7414004c90 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.091+0000 7f742f200640 1 -- 172.21.15.173:0/3626741034 >> 172.21.15.173:0/3626741034 conn(0x7f7430061d40 msgr2=0x7f743006ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:02.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.091+0000 7f742f200640 1 -- 172.21.15.173:0/3626741034 shutdown_connections 2024-04-25T09:11:02.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.091+0000 7f742f200640 1 -- 172.21.15.173:0/3626741034 wait complete. 2024-04-25T09:11:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742f200640 1 Processor -- start 2024-04-25T09:11:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742f200640 1 -- start start 2024-04-25T09:11:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7414004810 0x7f7430156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f743015a310 0x7f74301ea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742f200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7430160980 0x7f7430160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742f200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743015ea30 con 0x7f7430160980 2024-04-25T09:11:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743015e8b0 con 0x7f7414004810 2024-04-25T09:11:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7430157b50 con 0x7f743015a310 2024-04-25T09:11:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7430160980 0x7f7430160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7430160980 0x7f7430160e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56862/0 (socket says 172.21.15.173:56862) 2024-04-25T09:11:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742e800640 1 -- 172.21.15.173:0/529788490 learned_addr learned my addr 172.21.15.173:0/529788490 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f7427e00640 1 --2- 172.21.15.173:0/529788490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f743015a310 0x7f74301ea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742de00640 1 --2- 172.21.15.173:0/529788490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7414004810 0x7f7430156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742e800640 1 -- 172.21.15.173:0/529788490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f743015a310 msgr2=0x7f74301ea0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742e800640 1 --2- 172.21.15.173:0/529788490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f743015a310 0x7f74301ea0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742e800640 1 -- 172.21.15.173:0/529788490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7414004810 msgr2=0x7f7430156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742e800640 1 --2- 172.21.15.173:0/529788490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7414004810 0x7f7430156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742e800640 1 -- 172.21.15.173:0/529788490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74301ea970 con 0x7f7430160980 2024-04-25T09:11:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742de00640 1 --2- 172.21.15.173:0/529788490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7414004810 0x7f7430156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742e800640 1 --2- 172.21.15.173:0/529788490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7430160980 0x7f7430160e30 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f74300ce520 tx=0x7f742800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f7426000640 1 -- 172.21.15.173:0/529788490 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428003980 con 0x7f7430160980 2024-04-25T09:11:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f7426000640 1 -- 172.21.15.173:0/529788490 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7428018070 con 0x7f7430160980 2024-04-25T09:11:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f7426000640 1 -- 172.21.15.173:0/529788490 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428003d60 con 0x7f7430160980 2024-04-25T09:11:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742f200640 1 -- 172.21.15.173:0/529788490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74301eac50 con 0x7f7430160980 2024-04-25T09:11:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.095+0000 7f742f200640 1 -- 172.21.15.173:0/529788490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74301eb210 con 0x7f7430160980 2024-04-25T09:11:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f7426000640 1 -- 172.21.15.173:0/529788490 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7428005070 con 0x7f7430160980 2024-04-25T09:11:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f7426000640 1 --2- 172.21.15.173:0/529788490 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f740c066f90 0x7f740c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f7426000640 1 -- 172.21.15.173:0/529788490 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f7428084790 con 0x7f7430160980 2024-04-25T09:11:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f742de00640 1 --2- 172.21.15.173:0/529788490 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f740c066f90 0x7f740c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f74383f4000 1 Processor -- start 2024-04-25T09:11:02.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f74383f4000 1 -- start start 2024-04-25T09:11:02.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f742de00640 1 --2- 172.21.15.173:0/529788490 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f740c066f90 0x7f740c069450 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7420000c10 tx=0x7f7420009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f74383f4000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777e9d0 0x559ba777edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f74383f4000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba777f2f0 0x559ba7734b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f74383f4000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba77350a0 0x559ba7735480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f74383f4000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ba7581ff0 con 0x559ba777e9d0 2024-04-25T09:11:02.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f74383f4000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ba750a150 con 0x559ba777f2f0 2024-04-25T09:11:02.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f74383f4000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ba757e090 con 0x559ba77350a0 2024-04-25T09:11:02.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f742de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777e9d0 0x559ba777edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f742de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777e9d0 0x559ba777edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56864/0 (socket says 172.21.15.173:56864) 2024-04-25T09:11:02.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f742de00640 1 -- 172.21.15.173:0/564482852 learned_addr learned my addr 172.21.15.173:0/564482852 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:02.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f7427e00640 1 --2- 172.21.15.173:0/564482852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba777f2f0 0x559ba7734b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f742e800640 1 --2- 172.21.15.173:0/564482852 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba77350a0 0x559ba7735480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f742de00640 1 -- 172.21.15.173:0/564482852 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba77350a0 msgr2=0x559ba7735480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:02.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f742de00640 1 --2- 172.21.15.173:0/564482852 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba77350a0 0x559ba7735480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f742de00640 1 -- 172.21.15.173:0/564482852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba777f2f0 msgr2=0x559ba7734b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:02.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f742de00640 1 --2- 172.21.15.173:0/564482852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba777f2f0 0x559ba7734b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f742de00640 1 -- 172.21.15.173:0/564482852 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ba77180d0 con 0x559ba777e9d0 2024-04-25T09:11:02.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.099+0000 7f742de00640 1 --2- 172.21.15.173:0/564482852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777e9d0 0x559ba777edb0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f7420001710 tx=0x7f7420014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daff181357126143 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f741ea00640 1 -- 172.21.15.173:0/564482852 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7420021450 con 0x559ba777e9d0 2024-04-25T09:11:02.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f741ea00640 1 -- 172.21.15.173:0/564482852 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7420026070 con 0x559ba777e9d0 2024-04-25T09:11:02.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f741ea00640 1 -- 172.21.15.173:0/564482852 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7420021810 con 0x559ba777e9d0 2024-04-25T09:11:02.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 -- 172.21.15.173:0/564482852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777e9d0 msgr2=0x559ba777edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 --2- 172.21.15.173:0/564482852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777e9d0 0x559ba777edb0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f7420001710 tx=0x7f7420014000 comp rx=0 tx=0).stop 2024-04-25T09:11:02.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 -- 172.21.15.173:0/564482852 shutdown_connections 2024-04-25T09:11:02.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 --2- 172.21.15.173:0/564482852 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba77350a0 0x559ba7735480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 --2- 172.21.15.173:0/564482852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba777f2f0 0x559ba7734b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 --2- 172.21.15.173:0/564482852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777e9d0 0x559ba777edb0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 -- 172.21.15.173:0/564482852 >> 172.21.15.173:0/564482852 conn(0x559ba7731020 msgr2=0x559ba7733440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:02.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 -- 172.21.15.173:0/564482852 shutdown_connections 2024-04-25T09:11:02.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 -- 172.21.15.173:0/564482852 wait complete. 2024-04-25T09:11:02.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 -- start start 2024-04-25T09:11:02.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 Processor -- start 2024-04-25T09:11:02.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba77350a0 0x559ba77637f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba777e9d0 0x559ba7763d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba777f2f0 0x559ba7764270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ba7546250 con 0x559ba77350a0 2024-04-25T09:11:02.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ba753c690 con 0x559ba777f2f0 2024-04-25T09:11:02.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ba750aa40 con 0x559ba777e9d0 2024-04-25T09:11:02.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 10 client.0 _ll_register_callbacks cb 0x559ba771fe90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:02.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f742de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba77350a0 0x559ba77637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f742de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba77350a0 0x559ba77637f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56870/0 (socket says 172.21.15.173:56870) 2024-04-25T09:11:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f742de00640 1 -- 172.21.15.173:0/2348950136 learned_addr learned my addr 172.21.15.173:0/2348950136 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f742e800640 1 --2- 172.21.15.173:0/2348950136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba777f2f0 0x559ba7764270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f7427e00640 1 --2- 172.21.15.173:0/2348950136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba777e9d0 0x559ba7763d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f742de00640 1 -- 172.21.15.173:0/2348950136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba777e9d0 msgr2=0x559ba7763d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f742de00640 1 --2- 172.21.15.173:0/2348950136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba777e9d0 0x559ba7763d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f742de00640 1 -- 172.21.15.173:0/2348950136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba777f2f0 msgr2=0x559ba7764270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f742de00640 1 --2- 172.21.15.173:0/2348950136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba777f2f0 0x559ba7764270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f742de00640 1 -- 172.21.15.173:0/2348950136 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ba762f1c0 con 0x559ba77350a0 2024-04-25T09:11:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f7427e00640 1 --2- 172.21.15.173:0/2348950136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba777e9d0 0x559ba7763d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f742de00640 1 --2- 172.21.15.173:0/2348950136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba77350a0 0x559ba77637f0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x559ba753e3d0 tx=0x7f743006f0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e88867530476ca0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f7413400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:11:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f7413400640 1 -- 172.21.15.173:0/2348950136 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742002b600 con 0x559ba77350a0 2024-04-25T09:11:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f7413400640 1 -- 172.21.15.173:0/2348950136 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f742002b7a0 con 0x559ba77350a0 2024-04-25T09:11:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 -- 172.21.15.173:0/2348950136 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7420026070 con 0x559ba77350a0 2024-04-25T09:11:02.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f7413400640 1 -- 172.21.15.173:0/2348950136 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f742002b9e0 con 0x559ba77350a0 2024-04-25T09:11:02.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 10 client.8496 fetch_fsmap learned FSMap version 72 2024-04-25T09:11:02.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.103+0000 7f74383f4000 1 -- 172.21.15.173:0/2348950136 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x559ba762b170 con 0x559ba77350a0 2024-04-25T09:11:02.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f7413400640 1 -- 172.21.15.173:0/2348950136 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7420026070 con 0x559ba77350a0 2024-04-25T09:11:02.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f7413400640 1 -- 172.21.15.173:0/2348950136 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f742002bb80 con 0x559ba77350a0 2024-04-25T09:11:02.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f74383f4000 10 client.8496 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:11:02.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f74383f4000 10 client.8496 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:11:02.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f74383f4000 20 client.8496 populate_metadata read hostname 'smithi173' 2024-04-25T09:11:02.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f74383f4000 1 --2- 172.21.15.173:0/2348950136 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x559ba778ec80 0x559ba7791070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f74383f4000 4 client.8496 mds_command: new command op to 8193 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:11:02.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f74383f4000 1 -- 172.21.15.173:0/2348950136 --> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ba751dc60 con 0x559ba778ec80 2024-04-25T09:11:02.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f7427e00640 1 --2- 172.21.15.173:0/2348950136 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x559ba778ec80 0x559ba7791070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f7427e00640 1 --2- 172.21.15.173:0/2348950136 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x559ba778ec80 0x559ba7791070 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78ff31981026e24b server_cookie=b14e84676e75ff7b in_seq=0 out_seq=0 2024-04-25T09:11:02.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f7413400640 10 client.8496 ms_handle_connect on v2:172.21.15.173:6835/1492125936 2024-04-25T09:11:02.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f7413400640 1 -- 172.21.15.173:0/2348950136 <== mds.0 v2:172.21.15.173:6835/1492125936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559ba751dc60 con 0x559ba778ec80 2024-04-25T09:11:02.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f7413400640 10 client.8496 handle_command_reply: tid=0 2024-04-25T09:11:02.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f74383f4000 1 client.8496 shutdown 2024-04-25T09:11:02.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f74383f4000 1 -- 172.21.15.173:0/2348950136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba77350a0 msgr2=0x559ba77637f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f74383f4000 1 --2- 172.21.15.173:0/2348950136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba77350a0 0x559ba77637f0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x559ba753e3d0 tx=0x7f743006f0e0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f74383f4000 1 -- 172.21.15.173:0/2348950136 shutdown_connections 2024-04-25T09:11:02.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f74383f4000 1 --2- 172.21.15.173:0/2348950136 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x559ba778ec80 0x559ba7791070 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f74383f4000 1 --2- 172.21.15.173:0/2348950136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba777f2f0 0x559ba7764270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f74383f4000 1 --2- 172.21.15.173:0/2348950136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba777e9d0 0x559ba7763d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f7413400640 0 client.8496 ms_handle_reset on v2:172.21.15.173:6835/1492125936 2024-04-25T09:11:02.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f74383f4000 1 --2- 172.21.15.173:0/2348950136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba77350a0 0x559ba77637f0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f74383f4000 1 -- 172.21.15.173:0/2348950136 >> 172.21.15.173:0/2348950136 conn(0x559ba7731020 msgr2=0x559ba7733ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:02.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f74383f4000 1 -- 172.21.15.173:0/2348950136 shutdown_connections 2024-04-25T09:11:02.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f74383f4000 1 -- 172.21.15.173:0/2348950136 wait complete. 2024-04-25T09:11:02.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.107+0000 7f74383f4000 20 client.8496 trim_cache size 0 max 16384 2024-04-25T09:11:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f74383f4000 1 Processor -- start 2024-04-25T09:11:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f74383f4000 1 -- start start 2024-04-25T09:11:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f74383f4000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba77350a0 0x559ba7734570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f74383f4000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777e9d0 0x559ba7733410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f74383f4000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba777f2f0 0x559ba7733950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f74383f4000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7430204290 con 0x559ba777e9d0 2024-04-25T09:11:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f74383f4000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7430203470 con 0x559ba77350a0 2024-04-25T09:11:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f74383f4000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74302028a0 con 0x559ba777f2f0 2024-04-25T09:11:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f7427e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777e9d0 0x559ba7733410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f7427e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777e9d0 0x559ba7733410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56872/0 (socket says 172.21.15.173:56872) 2024-04-25T09:11:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f7427e00640 1 -- 172.21.15.173:0/1763377162 learned_addr learned my addr 172.21.15.173:0/1763377162 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f742de00640 1 --2- 172.21.15.173:0/1763377162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba77350a0 0x559ba7734570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f742e800640 1 --2- 172.21.15.173:0/1763377162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba777f2f0 0x559ba7733950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f7427e00640 1 -- 172.21.15.173:0/1763377162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba777f2f0 msgr2=0x559ba7733950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f7427e00640 1 --2- 172.21.15.173:0/1763377162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba777f2f0 0x559ba7733950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f7427e00640 1 -- 172.21.15.173:0/1763377162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba77350a0 msgr2=0x559ba7734570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f7427e00640 1 --2- 172.21.15.173:0/1763377162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba77350a0 0x559ba7734570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f7427e00640 1 -- 172.21.15.173:0/1763377162 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ba75c8de0 con 0x559ba777e9d0 2024-04-25T09:11:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f742e800640 1 --2- 172.21.15.173:0/1763377162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba777f2f0 0x559ba7733950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f7427e00640 1 --2- 172.21.15.173:0/1763377162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777e9d0 0x559ba7733410 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f741801d2b0 tx=0x7f74180046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b99f4d7c300c1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f741e000640 1 -- 172.21.15.173:0/1763377162 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74180c5070 con 0x559ba777e9d0 2024-04-25T09:11:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f741e000640 1 -- 172.21.15.173:0/1763377162 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74180be070 con 0x559ba777e9d0 2024-04-25T09:11:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f741e000640 1 -- 172.21.15.173:0/1763377162 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7418006040 con 0x559ba777e9d0 2024-04-25T09:11:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f74383f4000 1 -- 172.21.15.173:0/1763377162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777e9d0 msgr2=0x559ba7733410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f74383f4000 1 --2- 172.21.15.173:0/1763377162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777e9d0 0x559ba7733410 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f741801d2b0 tx=0x7f74180046d0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f74383f4000 1 -- 172.21.15.173:0/1763377162 shutdown_connections 2024-04-25T09:11:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f74383f4000 1 --2- 172.21.15.173:0/1763377162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba777f2f0 0x559ba7733950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f74383f4000 1 --2- 172.21.15.173:0/1763377162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777e9d0 0x559ba7733410 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f74383f4000 1 --2- 172.21.15.173:0/1763377162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba77350a0 0x559ba7734570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f74383f4000 1 -- 172.21.15.173:0/1763377162 >> 172.21.15.173:0/1763377162 conn(0x559ba7731020 msgr2=0x559ba778bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f74383f4000 1 -- 172.21.15.173:0/1763377162 shutdown_connections 2024-04-25T09:11:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.123+0000 7f74383f4000 1 -- 172.21.15.173:0/1763377162 wait complete. 2024-04-25T09:11:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f74383f4000 1 -- start start 2024-04-25T09:11:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f74383f4000 1 Processor -- start 2024-04-25T09:11:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f74383f4000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba77350a0 0x559ba7791590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f74383f4000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba777e9d0 0x559ba7791ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f74383f4000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777f2f0 0x559ba7792010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f74383f4000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ba751ce00 con 0x559ba777f2f0 2024-04-25T09:11:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f74383f4000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7430202ea0 con 0x559ba777e9d0 2024-04-25T09:11:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f74383f4000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ba7581300 con 0x559ba77350a0 2024-04-25T09:11:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f74383f4000 10 client.0 _ll_register_callbacks cb 0x559ba7700040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f742e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777f2f0 0x559ba7792010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f742e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777f2f0 0x559ba7792010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56888/0 (socket says 172.21.15.173:56888) 2024-04-25T09:11:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f742e800640 1 -- 172.21.15.173:0/3555609853 learned_addr learned my addr 172.21.15.173:0/3555609853 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f7427e00640 1 --2- 172.21.15.173:0/3555609853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba777e9d0 0x559ba7791ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f742de00640 1 --2- 172.21.15.173:0/3555609853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba77350a0 0x559ba7791590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f742e800640 1 -- 172.21.15.173:0/3555609853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba77350a0 msgr2=0x559ba7791590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f742e800640 1 --2- 172.21.15.173:0/3555609853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba77350a0 0x559ba7791590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f742e800640 1 -- 172.21.15.173:0/3555609853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba777e9d0 msgr2=0x559ba7791ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f742e800640 1 --2- 172.21.15.173:0/3555609853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba777e9d0 0x559ba7791ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f742e800640 1 -- 172.21.15.173:0/3555609853 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ba75238e0 con 0x559ba777f2f0 2024-04-25T09:11:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f7427e00640 1 --2- 172.21.15.173:0/3555609853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba777e9d0 0x559ba7791ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f742de00640 1 --2- 172.21.15.173:0/3555609853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba77350a0 0x559ba7791590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f742e800640 1 --2- 172.21.15.173:0/3555609853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777f2f0 0x559ba7792010 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f74280512b0 tx=0x7f7428055610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6866d03aca47d3be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f7413400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:11:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f7413400640 1 -- 172.21.15.173:0/3555609853 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742805d560 con 0x559ba777f2f0 2024-04-25T09:11:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f7413400640 1 -- 172.21.15.173:0/3555609853 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f742805b0b0 con 0x559ba777f2f0 2024-04-25T09:11:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f74383f4000 1 -- 172.21.15.173:0/3555609853 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f74180be070 con 0x559ba777f2f0 2024-04-25T09:11:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f7413400640 1 -- 172.21.15.173:0/3555609853 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7428071050 con 0x559ba777f2f0 2024-04-25T09:11:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f74383f4000 10 client.8502 fetch_fsmap learned FSMap version 72 2024-04-25T09:11:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f74383f4000 1 -- 172.21.15.173:0/3555609853 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x559ba75db8f0 con 0x559ba777f2f0 2024-04-25T09:11:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f7413400640 1 -- 172.21.15.173:0/3555609853 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74180be070 con 0x559ba777f2f0 2024-04-25T09:11:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f7413400640 1 -- 172.21.15.173:0/3555609853 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f742806cbe0 con 0x559ba777f2f0 2024-04-25T09:11:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f74383f4000 10 client.8502 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:11:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f74383f4000 10 client.8502 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-25T09:11:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f74383f4000 20 client.8502 populate_metadata read hostname 'smithi173' 2024-04-25T09:11:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f74383f4000 1 --2- 172.21.15.173:0/3555609853 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x559ba77e4f50 0x559ba77e7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f74383f4000 4 client.8502 mds_command: new command op to 8193 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:11:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f74383f4000 1 -- 172.21.15.173:0/3555609853 --> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559ba758f530 con 0x559ba77e4f50 2024-04-25T09:11:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f742de00640 1 --2- 172.21.15.173:0/3555609853 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x559ba77e4f50 0x559ba77e7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f742de00640 1 --2- 172.21.15.173:0/3555609853 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x559ba77e4f50 0x559ba77e7340 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf13e368092158f6 server_cookie=6f922bae8c9ca6a1 in_seq=0 out_seq=0 2024-04-25T09:11:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.127+0000 7f7413400640 10 client.8502 ms_handle_connect on v2:172.21.15.173:6835/1492125936 2024-04-25T09:11:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f7413400640 1 -- 172.21.15.173:0/3555609853 <== mds.0 v2:172.21.15.173:6835/1492125936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x559ba758f530 con 0x559ba77e4f50 2024-04-25T09:11:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f7413400640 10 client.8502 handle_command_reply: tid=0 2024-04-25T09:11:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f74383f4000 1 client.8502 shutdown 2024-04-25T09:11:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f74383f4000 1 -- 172.21.15.173:0/3555609853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777f2f0 msgr2=0x559ba7792010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f74383f4000 1 --2- 172.21.15.173:0/3555609853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777f2f0 0x559ba7792010 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f74280512b0 tx=0x7f7428055610 comp rx=0 tx=0).stop 2024-04-25T09:11:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f74383f4000 1 -- 172.21.15.173:0/3555609853 shutdown_connections 2024-04-25T09:11:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f74383f4000 1 --2- 172.21.15.173:0/3555609853 >> [v2:172.21.15.173:6835/1492125936,v1:172.21.15.173:6837/1492125936] conn(0x559ba77e4f50 0x559ba77e7340 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f74383f4000 1 --2- 172.21.15.173:0/3555609853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ba777f2f0 0x559ba7792010 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f74383f4000 1 --2- 172.21.15.173:0/3555609853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ba777e9d0 0x559ba7791ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f7413400640 0 client.8502 ms_handle_reset on v2:172.21.15.173:6835/1492125936 2024-04-25T09:11:02.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f74383f4000 1 --2- 172.21.15.173:0/3555609853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559ba77350a0 0x559ba7791590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f74383f4000 1 -- 172.21.15.173:0/3555609853 >> 172.21.15.173:0/3555609853 conn(0x559ba7731020 msgr2=0x559ba777d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:02.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f74383f4000 1 -- 172.21.15.173:0/3555609853 shutdown_connections 2024-04-25T09:11:02.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f74383f4000 1 -- 172.21.15.173:0/3555609853 wait complete. 2024-04-25T09:11:02.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f74383f4000 20 client.8502 trim_cache size 0 max 16384 2024-04-25T09:11:02.124 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:11:02.124 INFO:teuthology.orchestra.run.smithi173.stdout: "status": "no active scrubs running", 2024-04-25T09:11:02.124 INFO:teuthology.orchestra.run.smithi173.stdout: "scrubs": {} 2024-04-25T09:11:02.125 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:11:02.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f742f200640 1 -- 172.21.15.173:0/529788490 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f740c066f90 msgr2=0x7f740c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f742f200640 1 --2- 172.21.15.173:0/529788490 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f740c066f90 0x7f740c069450 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7420000c10 tx=0x7f7420009040 comp rx=0 tx=0).stop 2024-04-25T09:11:02.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f742f200640 1 -- 172.21.15.173:0/529788490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7430160980 msgr2=0x7f7430160e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f742f200640 1 --2- 172.21.15.173:0/529788490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7430160980 0x7f7430160e30 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f74300ce520 tx=0x7f742800eb90 comp rx=0 tx=0).stop 2024-04-25T09:11:02.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f742f200640 1 -- 172.21.15.173:0/529788490 shutdown_connections 2024-04-25T09:11:02.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f742f200640 1 --2- 172.21.15.173:0/529788490 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f740c066f90 0x7f740c069450 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f742f200640 1 --2- 172.21.15.173:0/529788490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7430160980 0x7f7430160e30 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f742f200640 1 --2- 172.21.15.173:0/529788490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f743015a310 0x7f74301ea0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f742f200640 1 --2- 172.21.15.173:0/529788490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7414004810 0x7f7430156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f742f200640 1 -- 172.21.15.173:0/529788490 >> 172.21.15.173:0/529788490 conn(0x7f7430061d40 msgr2=0x7f74300b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:02.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f742f200640 1 -- 172.21.15.173:0/529788490 shutdown_connections 2024-04-25T09:11:02.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.131+0000 7f742f200640 1 -- 172.21.15.173:0/529788490 wait complete. 2024-04-25T09:11:02.138 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:02.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.287+0000 7fa1b3c00640 1 Processor -- start 2024-04-25T09:11:02.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.287+0000 7fa1b3c00640 1 -- start start 2024-04-25T09:11:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.287+0000 7fa1b3c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa1ac15dbb0 0x7fa1ac15df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.287+0000 7fa1b3c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa1ac06f830 0x7fa1ac06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.287+0000 7fa1b3c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1ac06d870 con 0x7fa1ac0d2130 2024-04-25T09:11:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.287+0000 7fa1b3c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1ac0701e0 con 0x7fa1ac15dbb0 2024-04-25T09:11:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.287+0000 7fa1b3c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1ac0d2590 con 0x7fa1ac06f830 2024-04-25T09:11:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.287+0000 7fa1b1200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa1ac15dbb0 0x7fa1ac15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.287+0000 7fa1b1200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa1ac15dbb0 0x7fa1ac15df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56890/0 (socket says 172.21.15.173:56890) 2024-04-25T09:11:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.287+0000 7fa1b1200640 1 -- 172.21.15.173:0/2623626109 learned_addr learned my addr 172.21.15.173:0/2623626109 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.287+0000 7fa1b1c00640 1 --2- 172.21.15.173:0/2623626109 >> v2:172.21.15.194:3300/0 conn(0x7fa1ac06f830 0x7fa1ac06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.287+0000 7fa1b1200640 1 -- 172.21.15.173:0/2623626109 >> v2:172.21.15.194:3300/0 conn(0x7fa1ac06f830 msgr2=0x7fa1ac06fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.287+0000 7fa1b1200640 1 --2- 172.21.15.173:0/2623626109 >> v2:172.21.15.194:3300/0 conn(0x7fa1ac06f830 0x7fa1ac06fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.287+0000 7fa1b1200640 1 -- 172.21.15.173:0/2623626109 >> v1:172.21.15.194:6789/0 conn(0x7fa1ac0d2130 legacy=0x7fa1ac06c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.287+0000 7fa1b1200640 1 -- 172.21.15.173:0/2623626109 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac161690 con 0x7fa1ac15dbb0 2024-04-25T09:11:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.291+0000 7fa1b1200640 1 --2- 172.21.15.173:0/2623626109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1ac15dbb0 0x7fa1ac15df90 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac062610 tx=0x7fa19801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2c130d867f3411 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.291+0000 7fa1ab400640 1 -- 172.21.15.173:0/2623626109 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1980aa650 con 0x7fa1ac15dbb0 2024-04-25T09:11:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.291+0000 7fa1ab400640 1 -- 172.21.15.173:0/2623626109 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1980af070 con 0x7fa1ac15dbb0 2024-04-25T09:11:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.291+0000 7fa1ab400640 1 -- 172.21.15.173:0/2623626109 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1980aaa10 con 0x7fa1ac15dbb0 2024-04-25T09:11:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.291+0000 7fa1b3c00640 1 -- 172.21.15.173:0/2623626109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1ac15dbb0 msgr2=0x7fa1ac15df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.291+0000 7fa1b3c00640 1 --2- 172.21.15.173:0/2623626109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1ac15dbb0 0x7fa1ac15df90 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac062610 tx=0x7fa19801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.291+0000 7fa1b3c00640 1 -- 172.21.15.173:0/2623626109 shutdown_connections 2024-04-25T09:11:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.291+0000 7fa1b3c00640 1 --2- 172.21.15.173:0/2623626109 >> v2:172.21.15.194:3300/0 conn(0x7fa1ac06f830 0x7fa1ac06fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.291+0000 7fa1b3c00640 1 --2- 172.21.15.173:0/2623626109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1ac15dbb0 0x7fa1ac15df90 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.291+0000 7fa1b3c00640 1 -- 172.21.15.173:0/2623626109 >> 172.21.15.173:0/2623626109 conn(0x7fa1ac061880 msgr2=0x7fa1ac061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.291+0000 7fa1b3c00640 1 -- 172.21.15.173:0/2623626109 shutdown_connections 2024-04-25T09:11:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.291+0000 7fa1b3c00640 1 -- 172.21.15.173:0/2623626109 wait complete. 2024-04-25T09:11:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b3c00640 1 Processor -- start 2024-04-25T09:11:02.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b3c00640 1 -- start start 2024-04-25T09:11:02.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b3c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac06f830 0x7fa1ac14cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b3c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0d2130 0x7fa1ac0ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b3c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1ac15dbb0 0x7fa1ac0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b3c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac15ee60 con 0x7fa1ac15dbb0 2024-04-25T09:11:02.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b3c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac06c980 con 0x7fa1ac06f830 2024-04-25T09:11:02.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b3c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac16a990 con 0x7fa1ac0d2130 2024-04-25T09:11:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b1c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1ac15dbb0 0x7fa1ac0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b1c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1ac15dbb0 0x7fa1ac0b4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56892/0 (socket says 172.21.15.173:56892) 2024-04-25T09:11:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b1c00640 1 -- 172.21.15.173:0/1787202177 learned_addr learned my addr 172.21.15.173:0/1787202177 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1abe00640 1 --2- 172.21.15.173:0/1787202177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0d2130 0x7fa1ac0ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b1200640 1 --2- 172.21.15.173:0/1787202177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac06f830 0x7fa1ac14cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b1c00640 1 -- 172.21.15.173:0/1787202177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0d2130 msgr2=0x7fa1ac0ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b1c00640 1 --2- 172.21.15.173:0/1787202177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0d2130 0x7fa1ac0ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b1c00640 1 -- 172.21.15.173:0/1787202177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac06f830 msgr2=0x7fa1ac14cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b1c00640 1 --2- 172.21.15.173:0/1787202177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac06f830 0x7fa1ac14cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b1c00640 1 -- 172.21.15.173:0/1787202177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac0c9950 con 0x7fa1ac15dbb0 2024-04-25T09:11:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b1c00640 1 --2- 172.21.15.173:0/1787202177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1ac15dbb0 0x7fa1ac0b4f60 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4007e60 tx=0x7fa1a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1a8c00640 1 -- 172.21.15.173:0/1787202177 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4014420 con 0x7fa1ac15dbb0 2024-04-25T09:11:02.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1a8c00640 1 -- 172.21.15.173:0/1787202177 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a4019070 con 0x7fa1ac15dbb0 2024-04-25T09:11:02.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b3c00640 1 -- 172.21.15.173:0/1787202177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ac0c9c30 con 0x7fa1ac15dbb0 2024-04-25T09:11:02.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1a8c00640 1 -- 172.21.15.173:0/1787202177 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4014820 con 0x7fa1ac15dbb0 2024-04-25T09:11:02.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b3c00640 1 -- 172.21.15.173:0/1787202177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ac0ca1f0 con 0x7fa1ac15dbb0 2024-04-25T09:11:02.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.295+0000 7fa1b3c00640 1 -- 172.21.15.173:0/1787202177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1ac073a40 con 0x7fa1ac15dbb0 2024-04-25T09:11:02.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.299+0000 7fa1a8c00640 1 -- 172.21.15.173:0/1787202177 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa1a40149c0 con 0x7fa1ac15dbb0 2024-04-25T09:11:02.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.299+0000 7fa1a8c00640 1 --2- 172.21.15.173:0/1787202177 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa18c066f60 0x7fa18c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.299+0000 7fa1a8c00640 1 -- 172.21.15.173:0/1787202177 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fa1a4085990 con 0x7fa1ac15dbb0 2024-04-25T09:11:02.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.299+0000 7fa1b1200640 1 --2- 172.21.15.173:0/1787202177 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa18c066f60 0x7fa18c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.299+0000 7fa1b1200640 1 --2- 172.21.15.173:0/1787202177 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa18c066f60 0x7fa18c069420 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa1980ae000 tx=0x7fa1980a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.303+0000 7fa1a8c00640 1 -- 172.21.15.173:0/1787202177 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa1a4056100 con 0x7fa1ac15dbb0 2024-04-25T09:11:02.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.491+0000 7fa1b3c00640 1 -- 172.21.15.173:0/1787202177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1ac0cf020 con 0x7fa1ac15dbb0 2024-04-25T09:11:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.491+0000 7fa1a8c00640 1 -- 172.21.15.173:0/1787202177 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4949 (secure 0 0 0) 0x7fa1a405a1a0 con 0x7fa1ac15dbb0 2024-04-25T09:11:02.480 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:02.480 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1519522112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1519522112},{"type":"v1","addr":"172.21.15.194:6835","nonce":1519522112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7555,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/548680290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":548680290},{"type":"v1","addr":"172.21.15.173:6836","nonce":548680290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2602621503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2602621503},{"type":"v1","addr":"172.21.15.194:6833","nonce":2602621503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:24.354981+0000","modified":"2024-04-25T09:10:27.392053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/1492125936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":1492125936},{"type":"v1","addr":"172.21.15.173:6837","nonce":1492125936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:11:02.481 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 72 2024-04-25T09:11:02.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.495+0000 7fa1b3c00640 1 -- 172.21.15.173:0/1787202177 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa18c066f60 msgr2=0x7fa18c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.495+0000 7fa1b3c00640 1 --2- 172.21.15.173:0/1787202177 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa18c066f60 0x7fa18c069420 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa1980ae000 tx=0x7fa1980a7000 comp rx=0 tx=0).stop 2024-04-25T09:11:02.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.495+0000 7fa1b3c00640 1 -- 172.21.15.173:0/1787202177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1ac15dbb0 msgr2=0x7fa1ac0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.495+0000 7fa1b3c00640 1 --2- 172.21.15.173:0/1787202177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1ac15dbb0 0x7fa1ac0b4f60 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4007e60 tx=0x7fa1a400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.495+0000 7fa1b3c00640 1 -- 172.21.15.173:0/1787202177 shutdown_connections 2024-04-25T09:11:02.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.495+0000 7fa1b3c00640 1 --2- 172.21.15.173:0/1787202177 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa18c066f60 0x7fa18c069420 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.495+0000 7fa1b3c00640 1 --2- 172.21.15.173:0/1787202177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1ac15dbb0 0x7fa1ac0b4f60 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.495+0000 7fa1b3c00640 1 --2- 172.21.15.173:0/1787202177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1ac0d2130 0x7fa1ac0ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.495+0000 7fa1b3c00640 1 --2- 172.21.15.173:0/1787202177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac06f830 0x7fa1ac14cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.495+0000 7fa1b3c00640 1 -- 172.21.15.173:0/1787202177 >> 172.21.15.173:0/1787202177 conn(0x7fa1ac061880 msgr2=0x7fa1ac15c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:02.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.495+0000 7fa1b3c00640 1 -- 172.21.15.173:0/1787202177 shutdown_connections 2024-04-25T09:11:02.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.495+0000 7fa1b3c00640 1 -- 172.21.15.173:0/1787202177 wait complete. 2024-04-25T09:11:02.501 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:11:02.501 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:11:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.647+0000 7ff7bda00640 1 Processor -- start 2024-04-25T09:11:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.651+0000 7ff7bda00640 1 -- start start 2024-04-25T09:11:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.651+0000 7ff7bda00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff7b806ff40 0x7ff7b80d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.651+0000 7ff7bda00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b806d870 con 0x7ff7b815dbb0 2024-04-25T09:11:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.651+0000 7ff7bda00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b8161690 con 0x7ff7b815df90 2024-04-25T09:11:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.651+0000 7ff7bda00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b815e5c0 con 0x7ff7b806ff40 2024-04-25T09:11:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.651+0000 7ff7b7400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff7b806ff40 0x7ff7b80d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.651+0000 7ff7b6a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ff7b815dbb0 0x7ff7b806c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36786/0 (socket says 172.21.15.173:36786) 2024-04-25T09:11:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.651+0000 7ff7b6a00640 1 -- 172.21.15.173:0/835246863 learned_addr learned my addr 172.21.15.173:0/835246863 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.651+0000 7ff7b5600640 1 -- 172.21.15.173:0/835246863 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634090235 0 0) 0x7ff7b806d870 con 0x7ff7b815dbb0 2024-04-25T09:11:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.651+0000 7ff7b5600640 1 -- 172.21.15.173:0/835246863 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff79c003530 con 0x7ff7b815dbb0 2024-04-25T09:11:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.651+0000 7ff7b7400640 1 -- 172.21.15.173:0/835246863 >> v1:172.21.15.194:6789/0 conn(0x7ff7b815df90 legacy=0x7ff7b806f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.651+0000 7ff7b7400640 1 -- 172.21.15.173:0/835246863 >> v1:172.21.15.173:6789/0 conn(0x7ff7b815dbb0 legacy=0x7ff7b806c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.651+0000 7ff7b7400640 1 -- 172.21.15.173:0/835246863 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b815e8a0 con 0x7ff7b806ff40 2024-04-25T09:11:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.655+0000 7ff7b7400640 1 --2- 172.21.15.173:0/835246863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7b806ff40 0x7ff7b80d2130 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00097c0 tx=0x7ff7b001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b71c8f9e8bcc68a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.655+0000 7ff7b5600640 1 -- 172.21.15.173:0/835246863 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b00b0070 con 0x7ff7b806ff40 2024-04-25T09:11:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.655+0000 7ff7b5600640 1 -- 172.21.15.173:0/835246863 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b00ab600 con 0x7ff7b806ff40 2024-04-25T09:11:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.655+0000 7ff7b5600640 1 -- 172.21.15.173:0/835246863 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b00ab9d0 con 0x7ff7b806ff40 2024-04-25T09:11:02.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.655+0000 7ff7bda00640 1 -- 172.21.15.173:0/835246863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7b806ff40 msgr2=0x7ff7b80d2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.655+0000 7ff7bda00640 1 --2- 172.21.15.173:0/835246863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7b806ff40 0x7ff7b80d2130 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00097c0 tx=0x7ff7b001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.655+0000 7ff7bda00640 1 -- 172.21.15.173:0/835246863 shutdown_connections 2024-04-25T09:11:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.655+0000 7ff7bda00640 1 --2- 172.21.15.173:0/835246863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7b806ff40 0x7ff7b80d2130 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.655+0000 7ff7bda00640 1 -- 172.21.15.173:0/835246863 >> 172.21.15.173:0/835246863 conn(0x7ff7b8061880 msgr2=0x7ff7b8061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.655+0000 7ff7bda00640 1 -- 172.21.15.173:0/835246863 shutdown_connections 2024-04-25T09:11:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.655+0000 7ff7bda00640 1 -- 172.21.15.173:0/835246863 wait complete. 2024-04-25T09:11:02.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.655+0000 7ff7bda00640 1 Processor -- start 2024-04-25T09:11:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.655+0000 7ff7bda00640 1 -- start start 2024-04-25T09:11:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7bda00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7b806ff40 0x7ff7b80c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7bda00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7b815dbb0 0x7ff7b80c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7bda00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7b815df90 0x7ff7b8150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7bda00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b816bb20 con 0x7ff7b815dbb0 2024-04-25T09:11:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7bda00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b816b9a0 con 0x7ff7b815df90 2024-04-25T09:11:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7bda00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b816bca0 con 0x7ff7b806ff40 2024-04-25T09:11:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7b6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7b815dbb0 0x7ff7b80c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7b6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7b815dbb0 0x7ff7b80c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56906/0 (socket says 172.21.15.173:56906) 2024-04-25T09:11:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7b6000640 1 -- 172.21.15.173:0/3164215274 learned_addr learned my addr 172.21.15.173:0/3164215274 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7b6a00640 1 --2- 172.21.15.173:0/3164215274 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7b806ff40 0x7ff7b80c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7b7400640 1 --2- 172.21.15.173:0/3164215274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7b815df90 0x7ff7b8150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7b6000640 1 -- 172.21.15.173:0/3164215274 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7b806ff40 msgr2=0x7ff7b80c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7b6000640 1 --2- 172.21.15.173:0/3164215274 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7b806ff40 0x7ff7b80c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7b6000640 1 -- 172.21.15.173:0/3164215274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7b815df90 msgr2=0x7ff7b8150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7b6000640 1 --2- 172.21.15.173:0/3164215274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7b815df90 0x7ff7b8150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7b6000640 1 -- 172.21.15.173:0/3164215274 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b8151250 con 0x7ff7b815dbb0 2024-04-25T09:11:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7b6000640 1 --2- 172.21.15.173:0/3164215274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7b815dbb0 0x7ff7b80c6b30 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400c420 tx=0x7ff7a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7aea00640 1 -- 172.21.15.173:0/3164215274 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a40052d0 con 0x7ff7b815dbb0 2024-04-25T09:11:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7aea00640 1 -- 172.21.15.173:0/3164215274 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a4005470 con 0x7ff7b815dbb0 2024-04-25T09:11:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7aea00640 1 -- 172.21.15.173:0/3164215274 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4007260 con 0x7ff7b815dbb0 2024-04-25T09:11:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7bda00640 1 -- 172.21.15.173:0/3164215274 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b80c71c0 con 0x7ff7b815dbb0 2024-04-25T09:11:02.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7bda00640 1 -- 172.21.15.173:0/3164215274 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b8158b70 con 0x7ff7b815dbb0 2024-04-25T09:11:02.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7bda00640 1 -- 172.21.15.173:0/3164215274 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b8073a40 con 0x7ff7b815dbb0 2024-04-25T09:11:02.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.659+0000 7ff7aea00640 1 -- 172.21.15.173:0/3164215274 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff7a4007400 con 0x7ff7b815dbb0 2024-04-25T09:11:02.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.663+0000 7ff7aea00640 1 --2- 172.21.15.173:0/3164215274 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff798066f60 0x7ff798069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.663+0000 7ff7aea00640 1 -- 172.21.15.173:0/3164215274 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7ff7a4084600 con 0x7ff7b815dbb0 2024-04-25T09:11:02.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.663+0000 7ff7b6a00640 1 --2- 172.21.15.173:0/3164215274 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff798066f60 0x7ff798069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.663+0000 7ff7b6a00640 1 --2- 172.21.15.173:0/3164215274 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff798066f60 0x7ff798069420 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8001570 tx=0x7ff7a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.667+0000 7ff7aea00640 1 -- 172.21.15.173:0/3164215274 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff7a40554f0 con 0x7ff7b815dbb0 2024-04-25T09:11:02.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.875+0000 7ff7bda00640 1 -- 172.21.15.173:0/3164215274 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff7b80cf020 con 0x7ff7b815dbb0 2024-04-25T09:11:02.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.879+0000 7ff7aea00640 1 -- 172.21.15.173:0/3164215274 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1631 (secure 0 0 0) 0x7ff7a4054df0 con 0x7ff7b815dbb0 2024-04-25T09:11:02.866 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:02.866 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":517,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":111,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076353747,"bytes_used":2578759680,"bytes_avail":770515353600,"bytes_total":773094113280,"write_bytes_sec":52480010,"read_op_per_sec":0,"write_op_per_sec":53},"fsmap":{"epoch":72,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8193}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-04-25T09:11:00.835975+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:11:02.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.879+0000 7ff7bda00640 1 -- 172.21.15.173:0/3164215274 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff798066f60 msgr2=0x7ff798069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.879+0000 7ff7bda00640 1 --2- 172.21.15.173:0/3164215274 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff798066f60 0x7ff798069420 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8001570 tx=0x7ff7a8009040 comp rx=0 tx=0).stop 2024-04-25T09:11:02.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.879+0000 7ff7bda00640 1 -- 172.21.15.173:0/3164215274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7b815dbb0 msgr2=0x7ff7b80c6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.879+0000 7ff7bda00640 1 --2- 172.21.15.173:0/3164215274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7b815dbb0 0x7ff7b80c6b30 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400c420 tx=0x7ff7a400c8e0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.879+0000 7ff7bda00640 1 -- 172.21.15.173:0/3164215274 shutdown_connections 2024-04-25T09:11:02.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.879+0000 7ff7bda00640 1 --2- 172.21.15.173:0/3164215274 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff798066f60 0x7ff798069420 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.879+0000 7ff7bda00640 1 --2- 172.21.15.173:0/3164215274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7b815df90 0x7ff7b8150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.879+0000 7ff7bda00640 1 --2- 172.21.15.173:0/3164215274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7b815dbb0 0x7ff7b80c6b30 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.879+0000 7ff7bda00640 1 --2- 172.21.15.173:0/3164215274 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7b806ff40 0x7ff7b80c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.879+0000 7ff7bda00640 1 -- 172.21.15.173:0/3164215274 >> 172.21.15.173:0/3164215274 conn(0x7ff7b8061880 msgr2=0x7ff7b8061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:02.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.879+0000 7ff7bda00640 1 -- 172.21.15.173:0/3164215274 shutdown_connections 2024-04-25T09:11:02.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:02.879+0000 7ff7bda00640 1 -- 172.21.15.173:0/3164215274 wait complete. 2024-04-25T09:11:02.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused paths [/scrub_control_test_path]'} 2024-04-25T09:11:03.888 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:04.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.047+0000 7f0ea8400640 1 Processor -- start 2024-04-25T09:11:04.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.047+0000 7f0ea8400640 1 -- start start 2024-04-25T09:11:04.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.047+0000 7f0ea8400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0ea00aefa0 0x7f0ea00cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.047+0000 7f0ea8400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea015f320 con 0x7f0ea015edd0 2024-04-25T09:11:04.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.047+0000 7f0ea8400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea006d420 con 0x7f0ea00b3e70 2024-04-25T09:11:04.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.047+0000 7f0ea8400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea006dd50 con 0x7f0ea00aefa0 2024-04-25T09:11:04.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.047+0000 7f0ea5000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0ea00aefa0 0x7f0ea00cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.051+0000 7f0ea6400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f0ea015edd0 0x7f0ea00cdce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44332/0 (socket says 172.21.15.173:44332) 2024-04-25T09:11:04.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.051+0000 7f0ea5000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0ea00aefa0 0x7f0ea00cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44270/0 (socket says 172.21.15.173:44270) 2024-04-25T09:11:04.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.051+0000 7f0ea6400640 1 -- 172.21.15.173:0/2164352887 learned_addr learned my addr 172.21.15.173:0/2164352887 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:04.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.051+0000 7f0ea5000640 1 -- 172.21.15.173:0/2164352887 >> v1:172.21.15.194:6789/0 conn(0x7f0ea00b3e70 legacy=0x7f0ea00b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:04.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.051+0000 7f0ea5000640 1 -- 172.21.15.173:0/2164352887 >> v1:172.21.15.173:6789/0 conn(0x7f0ea015edd0 legacy=0x7f0ea00cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.051+0000 7f0ea5000640 1 -- 172.21.15.173:0/2164352887 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea006d700 con 0x7f0ea00aefa0 2024-04-25T09:11:04.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.051+0000 7f0e9fe00640 1 -- 172.21.15.173:0/2164352887 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371158825 0 0) 0x7f0ea015f320 con 0x7f0ea015edd0 2024-04-25T09:11:04.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.051+0000 7f0ea5000640 1 --2- 172.21.15.173:0/2164352887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea00aefa0 0x7f0ea00cd7a0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0097c0 tx=0x7f0e8c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb669b882d49ca9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:04.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.051+0000 7f0e9fe00640 1 -- 172.21.15.173:0/2164352887 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c0aa5f0 con 0x7f0ea00aefa0 2024-04-25T09:11:04.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.051+0000 7f0e9fe00640 1 -- 172.21.15.173:0/2164352887 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c0af070 con 0x7f0ea00aefa0 2024-04-25T09:11:04.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.051+0000 7f0e9fe00640 1 -- 172.21.15.173:0/2164352887 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c0aa9b0 con 0x7f0ea00aefa0 2024-04-25T09:11:04.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea8400640 1 -- 172.21.15.173:0/2164352887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea00aefa0 msgr2=0x7f0ea00cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea8400640 1 --2- 172.21.15.173:0/2164352887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea00aefa0 0x7f0ea00cd7a0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0097c0 tx=0x7f0e8c01c470 comp rx=0 tx=0).stop 2024-04-25T09:11:04.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea8400640 1 -- 172.21.15.173:0/2164352887 shutdown_connections 2024-04-25T09:11:04.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea8400640 1 --2- 172.21.15.173:0/2164352887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea00aefa0 0x7f0ea00cd7a0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea8400640 1 -- 172.21.15.173:0/2164352887 >> 172.21.15.173:0/2164352887 conn(0x7f0ea006ac90 msgr2=0x7f0ea006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:04.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea8400640 1 -- 172.21.15.173:0/2164352887 shutdown_connections 2024-04-25T09:11:04.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea8400640 1 -- 172.21.15.173:0/2164352887 wait complete. 2024-04-25T09:11:04.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea8400640 1 Processor -- start 2024-04-25T09:11:04.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea8400640 1 -- start start 2024-04-25T09:11:04.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea8400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ea00aefa0 0x7f0ea014f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea8400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ea00b3e70 0x7f0ea0150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea8400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea015edd0 0x7f0ea0150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea8400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea006e340 con 0x7f0ea015edd0 2024-04-25T09:11:04.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea8400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea006e1c0 con 0x7f0ea00aefa0 2024-04-25T09:11:04.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea8400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea0168fd0 con 0x7f0ea00b3e70 2024-04-25T09:11:04.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea6400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea015edd0 0x7f0ea0150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea6400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea015edd0 0x7f0ea0150e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44286/0 (socket says 172.21.15.173:44286) 2024-04-25T09:11:04.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea6400640 1 -- 172.21.15.173:0/2558309116 learned_addr learned my addr 172.21.15.173:0/2558309116 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:04.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea5a00640 1 --2- 172.21.15.173:0/2558309116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ea00aefa0 0x7f0ea014f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea5000640 1 --2- 172.21.15.173:0/2558309116 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ea00b3e70 0x7f0ea0150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea6400640 1 -- 172.21.15.173:0/2558309116 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ea00b3e70 msgr2=0x7f0ea0150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea6400640 1 --2- 172.21.15.173:0/2558309116 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ea00b3e70 0x7f0ea0150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea6400640 1 -- 172.21.15.173:0/2558309116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ea00aefa0 msgr2=0x7f0ea014f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea6400640 1 --2- 172.21.15.173:0/2558309116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ea00aefa0 0x7f0ea014f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea6400640 1 -- 172.21.15.173:0/2558309116 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea01f7410 con 0x7f0ea015edd0 2024-04-25T09:11:04.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea5a00640 1 --2- 172.21.15.173:0/2558309116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ea00aefa0 0x7f0ea014f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:04.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.055+0000 7f0ea6400640 1 --2- 172.21.15.173:0/2558309116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea015edd0 0x7f0ea0150e50 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800c480 tx=0x7f0e9800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:04.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.059+0000 7f0e9d600640 1 -- 172.21.15.173:0/2558309116 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98018070 con 0x7f0ea015edd0 2024-04-25T09:11:04.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.059+0000 7f0ea8400640 1 -- 172.21.15.173:0/2558309116 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea01f76f0 con 0x7f0ea015edd0 2024-04-25T09:11:04.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.059+0000 7f0e9d600640 1 -- 172.21.15.173:0/2558309116 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e980074e0 con 0x7f0ea015edd0 2024-04-25T09:11:04.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.059+0000 7f0e9d600640 1 -- 172.21.15.173:0/2558309116 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98004a30 con 0x7f0ea015edd0 2024-04-25T09:11:04.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.059+0000 7f0ea8400640 1 -- 172.21.15.173:0/2558309116 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea01f7cb0 con 0x7f0ea015edd0 2024-04-25T09:11:04.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.059+0000 7f0ea8400640 1 -- 172.21.15.173:0/2558309116 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea0073a40 con 0x7f0ea015edd0 2024-04-25T09:11:04.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.059+0000 7f0e9d600640 1 -- 172.21.15.173:0/2558309116 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0e98004bd0 con 0x7f0ea015edd0 2024-04-25T09:11:04.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.059+0000 7f0e9d600640 1 --2- 172.21.15.173:0/2558309116 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e80066f60 0x7f0e80069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.059+0000 7f0e9d600640 1 -- 172.21.15.173:0/2558309116 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f0e980845d0 con 0x7f0ea015edd0 2024-04-25T09:11:04.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.059+0000 7f0ea5a00640 1 --2- 172.21.15.173:0/2558309116 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e80066f60 0x7f0e80069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.059+0000 7f0ea5a00640 1 --2- 172.21.15.173:0/2558309116 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e80066f60 0x7f0e80069420 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0e940012f0 tx=0x7f0e94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:04.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.063+0000 7f0e9d600640 1 -- 172.21.15.173:0/2558309116 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0e980553a0 con 0x7f0ea015edd0 2024-04-25T09:11:04.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.251+0000 7f0ea8400640 1 -- 172.21.15.173:0/2558309116 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ea006f1c0 con 0x7f0ea015edd0 2024-04-25T09:11:04.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.251+0000 7f0e9d600640 1 -- 172.21.15.173:0/2558309116 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f0e98054ca0 con 0x7f0ea015edd0 2024-04-25T09:11:04.240 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:04.240 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1519522112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1519522112},{"type":"v1","addr":"172.21.15.194:6835","nonce":1519522112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7555,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/548680290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":548680290},{"type":"v1","addr":"172.21.15.173:6836","nonce":548680290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2602621503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2602621503},{"type":"v1","addr":"172.21.15.194:6833","nonce":2602621503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:24.354981+0000","modified":"2024-04-25T09:10:27.392053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/1492125936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":1492125936},{"type":"v1","addr":"172.21.15.173:6837","nonce":1492125936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:11:04.240 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 72 2024-04-25T09:11:04.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.255+0000 7f0ea8400640 1 -- 172.21.15.173:0/2558309116 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e80066f60 msgr2=0x7f0e80069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.255+0000 7f0ea8400640 1 --2- 172.21.15.173:0/2558309116 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e80066f60 0x7f0e80069420 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0e940012f0 tx=0x7f0e94009040 comp rx=0 tx=0).stop 2024-04-25T09:11:04.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.255+0000 7f0ea8400640 1 -- 172.21.15.173:0/2558309116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea015edd0 msgr2=0x7f0ea0150e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.255+0000 7f0ea8400640 1 --2- 172.21.15.173:0/2558309116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea015edd0 0x7f0ea0150e50 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800c480 tx=0x7f0e9800c940 comp rx=0 tx=0).stop 2024-04-25T09:11:04.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.255+0000 7f0ea8400640 1 -- 172.21.15.173:0/2558309116 shutdown_connections 2024-04-25T09:11:04.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.255+0000 7f0ea8400640 1 --2- 172.21.15.173:0/2558309116 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e80066f60 0x7f0e80069420 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.255+0000 7f0ea8400640 1 --2- 172.21.15.173:0/2558309116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea015edd0 0x7f0ea0150e50 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.255+0000 7f0ea8400640 1 --2- 172.21.15.173:0/2558309116 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ea00b3e70 0x7f0ea0150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.255+0000 7f0ea8400640 1 --2- 172.21.15.173:0/2558309116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ea00aefa0 0x7f0ea014f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.255+0000 7f0ea8400640 1 -- 172.21.15.173:0/2558309116 >> 172.21.15.173:0/2558309116 conn(0x7f0ea006ac90 msgr2=0x7f0ea00af4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:04.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.255+0000 7f0ea8400640 1 -- 172.21.15.173:0/2558309116 shutdown_connections 2024-04-25T09:11:04.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.255+0000 7f0ea8400640 1 -- 172.21.15.173:0/2558309116 wait complete. 2024-04-25T09:11:04.261 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:11:04.262 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:11:04.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.407+0000 7fd4dd400640 1 Processor -- start 2024-04-25T09:11:04.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.407+0000 7fd4dd400640 1 -- start start 2024-04-25T09:11:04.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.407+0000 7fd4dd400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4d80b3e70 0x7fd4d80b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.407+0000 7fd4dd400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd4d80aefa0 0x7fd4d80b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.407+0000 7fd4dd400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d80b4790 con 0x7fd4d815edd0 2024-04-25T09:11:04.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.407+0000 7fd4dd400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d806dd50 con 0x7fd4d80aefa0 2024-04-25T09:11:04.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.407+0000 7fd4dd400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d815f320 con 0x7fd4d80b3e70 2024-04-25T09:11:04.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.407+0000 7fd4d6800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4d80b3e70 0x7fd4d80b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.407+0000 7fd4d5e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd4d80aefa0 0x7fd4d80b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.407+0000 7fd4d7200640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fd4d815edd0 0x7fd4d80b2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:50568/0 (socket says 172.21.15.173:50568) 2024-04-25T09:11:04.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.407+0000 7fd4d7200640 1 -- 172.21.15.173:0/842889231 learned_addr learned my addr 172.21.15.173:0/842889231 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:04.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.407+0000 7fd4d6800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4d80b3e70 0x7fd4d80b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:38604/0 (socket says 172.21.15.173:38604) 2024-04-25T09:11:04.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.411+0000 7fd4d5e00640 1 -- 172.21.15.173:0/842889231 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4d80b3e70 msgr2=0x7fd4d80b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:04.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.411+0000 7fd4d5e00640 1 --2- 172.21.15.173:0/842889231 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4d80b3e70 0x7fd4d80b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.411+0000 7fd4d5e00640 1 -- 172.21.15.173:0/842889231 >> v1:172.21.15.194:6789/0 conn(0x7fd4d815edd0 legacy=0x7fd4d80b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.411+0000 7fd4d5e00640 1 -- 172.21.15.173:0/842889231 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d806d420 con 0x7fd4d80aefa0 2024-04-25T09:11:04.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.411+0000 7fd4d5400640 1 -- 172.21.15.173:0/842889231 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840109308 0 0) 0x7fd4d80b4790 con 0x7fd4d815edd0 2024-04-25T09:11:04.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.411+0000 7fd4d5e00640 1 --2- 172.21.15.173:0/842889231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4d80aefa0 0x7fd4d80b2770 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40097c0 tx=0x7fd4c401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b15b6d2f0d4f5fb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:04.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.411+0000 7fd4d5400640 1 -- 172.21.15.173:0/842889231 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c40aa5f0 con 0x7fd4d80aefa0 2024-04-25T09:11:04.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.411+0000 7fd4d5400640 1 -- 172.21.15.173:0/842889231 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c40af070 con 0x7fd4d80aefa0 2024-04-25T09:11:04.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.411+0000 7fd4d5400640 1 -- 172.21.15.173:0/842889231 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c40aa9b0 con 0x7fd4d80aefa0 2024-04-25T09:11:04.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4dd400640 1 -- 172.21.15.173:0/842889231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4d80aefa0 msgr2=0x7fd4d80b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4dd400640 1 --2- 172.21.15.173:0/842889231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4d80aefa0 0x7fd4d80b2770 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40097c0 tx=0x7fd4c401c470 comp rx=0 tx=0).stop 2024-04-25T09:11:04.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4dd400640 1 -- 172.21.15.173:0/842889231 shutdown_connections 2024-04-25T09:11:04.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4dd400640 1 --2- 172.21.15.173:0/842889231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4d80aefa0 0x7fd4d80b2770 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4dd400640 1 --2- 172.21.15.173:0/842889231 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4d80b3e70 0x7fd4d80b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4dd400640 1 -- 172.21.15.173:0/842889231 >> 172.21.15.173:0/842889231 conn(0x7fd4d806ac90 msgr2=0x7fd4d806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:04.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4dd400640 1 -- 172.21.15.173:0/842889231 shutdown_connections 2024-04-25T09:11:04.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4dd400640 1 -- 172.21.15.173:0/842889231 wait complete. 2024-04-25T09:11:04.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4dd400640 1 Processor -- start 2024-04-25T09:11:04.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4dd400640 1 -- start start 2024-04-25T09:11:04.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4dd400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4d80aefa0 0x7fd4d81529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4dd400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4d80b3e70 0x7fd4d815d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4dd400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4d815edd0 0x7fd4d814fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4dd400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d806e1c0 con 0x7fd4d80b3e70 2024-04-25T09:11:04.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4dd400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d815aba0 con 0x7fd4d815edd0 2024-04-25T09:11:04.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4dd400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d806e340 con 0x7fd4d80aefa0 2024-04-25T09:11:04.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4d5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4d80b3e70 0x7fd4d815d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4d5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4d80b3e70 0x7fd4d815d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44294/0 (socket says 172.21.15.173:44294) 2024-04-25T09:11:04.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4d5e00640 1 -- 172.21.15.173:0/2596036015 learned_addr learned my addr 172.21.15.173:0/2596036015 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:04.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4d6800640 1 --2- 172.21.15.173:0/2596036015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4d80aefa0 0x7fd4d81529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4d7200640 1 --2- 172.21.15.173:0/2596036015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4d815edd0 0x7fd4d814fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4d5e00640 1 -- 172.21.15.173:0/2596036015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4d80aefa0 msgr2=0x7fd4d81529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4d5e00640 1 --2- 172.21.15.173:0/2596036015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4d80aefa0 0x7fd4d81529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4d5e00640 1 -- 172.21.15.173:0/2596036015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4d815edd0 msgr2=0x7fd4d814fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4d5e00640 1 --2- 172.21.15.173:0/2596036015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4d815edd0 0x7fd4d814fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4d5e00640 1 -- 172.21.15.173:0/2596036015 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d8137df0 con 0x7fd4d80b3e70 2024-04-25T09:11:04.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.415+0000 7fd4d5e00640 1 --2- 172.21.15.173:0/2596036015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4d80b3e70 0x7fd4d815d4f0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40ac040 tx=0x7fd4c401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:04.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.419+0000 7fd4cea00640 1 -- 172.21.15.173:0/2596036015 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c40be610 con 0x7fd4d80b3e70 2024-04-25T09:11:04.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.419+0000 7fd4cea00640 1 -- 172.21.15.173:0/2596036015 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c40be7d0 con 0x7fd4d80b3e70 2024-04-25T09:11:04.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.419+0000 7fd4cea00640 1 -- 172.21.15.173:0/2596036015 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c40bebc0 con 0x7fd4d80b3e70 2024-04-25T09:11:04.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.419+0000 7fd4dd400640 1 -- 172.21.15.173:0/2596036015 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d8151ec0 con 0x7fd4d80b3e70 2024-04-25T09:11:04.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.419+0000 7fd4dd400640 1 -- 172.21.15.173:0/2596036015 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d8152ee0 con 0x7fd4d80b3e70 2024-04-25T09:11:04.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.419+0000 7fd4dd400640 1 -- 172.21.15.173:0/2596036015 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d8073a40 con 0x7fd4d80b3e70 2024-04-25T09:11:04.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.419+0000 7fd4cea00640 1 -- 172.21.15.173:0/2596036015 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd4c40bc020 con 0x7fd4d80b3e70 2024-04-25T09:11:04.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.419+0000 7fd4cea00640 1 --2- 172.21.15.173:0/2596036015 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd4b8066f60 0x7fd4b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.419+0000 7fd4cea00640 1 -- 172.21.15.173:0/2596036015 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fd4c411f850 con 0x7fd4d80b3e70 2024-04-25T09:11:04.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.419+0000 7fd4d6800640 1 --2- 172.21.15.173:0/2596036015 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd4b8066f60 0x7fd4b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.419+0000 7fd4d6800640 1 --2- 172.21.15.173:0/2596036015 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd4b8066f60 0x7fd4b8069420 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8011340 tx=0x7fd4c800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:04.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.423+0000 7fd4cea00640 1 -- 172.21.15.173:0/2596036015 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd4c4016090 con 0x7fd4d80b3e70 2024-04-25T09:11:04.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.631+0000 7fd4dd400640 1 -- 172.21.15.173:0/2596036015 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd4d806e540 con 0x7fd4d80b3e70 2024-04-25T09:11:04.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.631+0000 7fd4cea00640 1 -- 172.21.15.173:0/2596036015 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1631 (secure 0 0 0) 0x7fd4c40effc0 con 0x7fd4d80b3e70 2024-04-25T09:11:04.620 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:04.620 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":518,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":111,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076353747,"bytes_used":2584002560,"bytes_avail":770510110720,"bytes_total":773094113280,"write_bytes_sec":35655587,"read_op_per_sec":0,"write_op_per_sec":35},"fsmap":{"epoch":72,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8193}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-04-25T09:11:00.835975+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:11:04.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.631+0000 7fd4dd400640 1 -- 172.21.15.173:0/2596036015 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd4b8066f60 msgr2=0x7fd4b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.631+0000 7fd4dd400640 1 --2- 172.21.15.173:0/2596036015 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd4b8066f60 0x7fd4b8069420 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8011340 tx=0x7fd4c800b040 comp rx=0 tx=0).stop 2024-04-25T09:11:04.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.631+0000 7fd4dd400640 1 -- 172.21.15.173:0/2596036015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4d80b3e70 msgr2=0x7fd4d815d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.631+0000 7fd4dd400640 1 --2- 172.21.15.173:0/2596036015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4d80b3e70 0x7fd4d815d4f0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40ac040 tx=0x7fd4c401acb0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.631+0000 7fd4dd400640 1 -- 172.21.15.173:0/2596036015 shutdown_connections 2024-04-25T09:11:04.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.631+0000 7fd4dd400640 1 --2- 172.21.15.173:0/2596036015 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd4b8066f60 0x7fd4b8069420 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.631+0000 7fd4dd400640 1 --2- 172.21.15.173:0/2596036015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4d815edd0 0x7fd4d814fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.631+0000 7fd4dd400640 1 --2- 172.21.15.173:0/2596036015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4d80b3e70 0x7fd4d815d4f0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.631+0000 7fd4dd400640 1 --2- 172.21.15.173:0/2596036015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4d80aefa0 0x7fd4d81529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.631+0000 7fd4dd400640 1 -- 172.21.15.173:0/2596036015 >> 172.21.15.173:0/2596036015 conn(0x7fd4d806ac90 msgr2=0x7fd4d814ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:04.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.631+0000 7fd4dd400640 1 -- 172.21.15.173:0/2596036015 shutdown_connections 2024-04-25T09:11:04.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:04.631+0000 7fd4dd400640 1 -- 172.21.15.173:0/2596036015 wait complete. 2024-04-25T09:11:04.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused paths [/scrub_control_test_path]'} 2024-04-25T09:11:05.641 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:05.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.799+0000 7fe969c00640 1 Processor -- start 2024-04-25T09:11:05.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.799+0000 7fe969c00640 1 -- start start 2024-04-25T09:11:05.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.803+0000 7fe969c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe964160fe0 0x7fe964161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:05.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.803+0000 7fe969c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe96406bca0 0x7fe96406c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:05.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.803+0000 7fe969c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe964061d60 con 0x7fe96406dac0 2024-04-25T09:11:05.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.803+0000 7fe969c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9640ad510 con 0x7fe96406bca0 2024-04-25T09:11:05.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.803+0000 7fe969c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96406c640 con 0x7fe964160fe0 2024-04-25T09:11:05.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.803+0000 7fe963400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe96406bca0 0x7fe96406c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:05.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.803+0000 7fe963400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe96406bca0 0x7fe96406c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44302/0 (socket says 172.21.15.173:44302) 2024-04-25T09:11:05.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.803+0000 7fe963400640 1 -- 172.21.15.173:0/1910903826 learned_addr learned my addr 172.21.15.173:0/1910903826 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:05.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.803+0000 7fe962a00640 1 --2- 172.21.15.173:0/1910903826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe964160fe0 0x7fe964161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:05.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.803+0000 7fe963400640 1 -- 172.21.15.173:0/1910903826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe964160fe0 msgr2=0x7fe964161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:05.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.803+0000 7fe963400640 1 --2- 172.21.15.173:0/1910903826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe964160fe0 0x7fe964161fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.803+0000 7fe963400640 1 -- 172.21.15.173:0/1910903826 >> v1:172.21.15.194:6789/0 conn(0x7fe96406dac0 legacy=0x7fe9640ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:05.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.803+0000 7fe963400640 1 -- 172.21.15.173:0/1910903826 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96406dfa0 con 0x7fe96406bca0 2024-04-25T09:11:05.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.803+0000 7fe962a00640 1 --2- 172.21.15.173:0/1910903826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe964160fe0 0x7fe964161fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:05.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.807+0000 7fe963400640 1 --2- 172.21.15.173:0/1910903826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe96406bca0 0x7fe96406c100 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009e50 tx=0x7fe95c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a05295d89bfaa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:05.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.807+0000 7fe961600640 1 -- 172.21.15.173:0/1910903826 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c0a5750 con 0x7fe96406bca0 2024-04-25T09:11:05.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.807+0000 7fe961600640 1 -- 172.21.15.173:0/1910903826 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c0a58f0 con 0x7fe96406bca0 2024-04-25T09:11:05.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.807+0000 7fe961600640 1 -- 172.21.15.173:0/1910903826 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c0a5cc0 con 0x7fe96406bca0 2024-04-25T09:11:05.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.807+0000 7fe969c00640 1 -- 172.21.15.173:0/1910903826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe96406bca0 msgr2=0x7fe96406c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.807+0000 7fe969c00640 1 --2- 172.21.15.173:0/1910903826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe96406bca0 0x7fe96406c100 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009e50 tx=0x7fe95c01c9a0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.807+0000 7fe969c00640 1 -- 172.21.15.173:0/1910903826 shutdown_connections 2024-04-25T09:11:05.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.807+0000 7fe969c00640 1 --2- 172.21.15.173:0/1910903826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe96406bca0 0x7fe96406c100 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.807+0000 7fe969c00640 1 --2- 172.21.15.173:0/1910903826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe964160fe0 0x7fe964161fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.807+0000 7fe969c00640 1 -- 172.21.15.173:0/1910903826 >> 172.21.15.173:0/1910903826 conn(0x7fe964071c20 msgr2=0x7fe964072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:05.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.807+0000 7fe969c00640 1 -- 172.21.15.173:0/1910903826 shutdown_connections 2024-04-25T09:11:05.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.807+0000 7fe969c00640 1 -- 172.21.15.173:0/1910903826 wait complete. 2024-04-25T09:11:05.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.807+0000 7fe969c00640 1 Processor -- start 2024-04-25T09:11:05.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.807+0000 7fe969c00640 1 -- start start 2024-04-25T09:11:05.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe969c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe96406bca0 0x7fe964139480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:05.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe969c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe96406dac0 0x7fe96414c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:05.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe969c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe964160fe0 0x7fe964148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:05.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe969c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9641624f0 con 0x7fe964160fe0 2024-04-25T09:11:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe969c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96406eb20 con 0x7fe96406dac0 2024-04-25T09:11:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe969c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96406f850 con 0x7fe96406bca0 2024-04-25T09:11:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe963400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe964160fe0 0x7fe964148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe963400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe964160fe0 0x7fe964148590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44316/0 (socket says 172.21.15.173:44316) 2024-04-25T09:11:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe963400640 1 -- 172.21.15.173:0/1277365751 learned_addr learned my addr 172.21.15.173:0/1277365751 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe962a00640 1 --2- 172.21.15.173:0/1277365751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe96406bca0 0x7fe964139480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe962000640 1 --2- 172.21.15.173:0/1277365751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe96406dac0 0x7fe96414c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe963400640 1 -- 172.21.15.173:0/1277365751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe96406bca0 msgr2=0x7fe964139480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe963400640 1 --2- 172.21.15.173:0/1277365751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe96406bca0 0x7fe964139480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe963400640 1 -- 172.21.15.173:0/1277365751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe96406dac0 msgr2=0x7fe96414c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe963400640 1 --2- 172.21.15.173:0/1277365751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe96406dac0 0x7fe96414c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe963400640 1 -- 172.21.15.173:0/1277365751 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96414b620 con 0x7fe964160fe0 2024-04-25T09:11:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe962a00640 1 --2- 172.21.15.173:0/1277365751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe96406bca0 0x7fe964139480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe962000640 1 --2- 172.21.15.173:0/1277365751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe96406dac0 0x7fe96414c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe963400640 1 --2- 172.21.15.173:0/1277365751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe964160fe0 0x7fe964148590 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fe95c0af040 tx=0x7fe95c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe95aa00640 1 -- 172.21.15.173:0/1277365751 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c0bc030 con 0x7fe964160fe0 2024-04-25T09:11:05.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe95aa00640 1 -- 172.21.15.173:0/1277365751 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c0b8470 con 0x7fe964160fe0 2024-04-25T09:11:05.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe95aa00640 1 -- 172.21.15.173:0/1277365751 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c0b88a0 con 0x7fe964160fe0 2024-04-25T09:11:05.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe969c00640 1 -- 172.21.15.173:0/1277365751 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96414b900 con 0x7fe964160fe0 2024-04-25T09:11:05.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe969c00640 1 -- 172.21.15.173:0/1277365751 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96414bec0 con 0x7fe964160fe0 2024-04-25T09:11:05.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe969c00640 1 -- 172.21.15.173:0/1277365751 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe964073a40 con 0x7fe964160fe0 2024-04-25T09:11:05.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.811+0000 7fe95aa00640 1 -- 172.21.15.173:0/1277365751 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe95c0bf070 con 0x7fe964160fe0 2024-04-25T09:11:05.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.815+0000 7fe95aa00640 1 --2- 172.21.15.173:0/1277365751 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe944066f60 0x7fe944069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:05.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.815+0000 7fe95aa00640 1 -- 172.21.15.173:0/1277365751 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fe95c1201d0 con 0x7fe964160fe0 2024-04-25T09:11:05.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.815+0000 7fe962a00640 1 --2- 172.21.15.173:0/1277365751 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe944066f60 0x7fe944069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:05.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.815+0000 7fe962a00640 1 --2- 172.21.15.173:0/1277365751 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe944066f60 0x7fe944069420 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe95400a9b0 tx=0x7fe954008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:05.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:05.819+0000 7fe95aa00640 1 -- 172.21.15.173:0/1277365751 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe95c016620 con 0x7fe964160fe0 2024-04-25T09:11:05.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.003+0000 7fe969c00640 1 -- 172.21.15.173:0/1277365751 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9640cf6c0 con 0x7fe964160fe0 2024-04-25T09:11:05.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.003+0000 7fe95aa00640 1 -- 172.21.15.173:0/1277365751 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4949 (secure 0 0 0) 0x7fe95c0f1170 con 0x7fe964160fe0 2024-04-25T09:11:05.991 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:05.992 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1519522112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1519522112},{"type":"v1","addr":"172.21.15.194:6835","nonce":1519522112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7555,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/548680290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":548680290},{"type":"v1","addr":"172.21.15.173:6836","nonce":548680290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2602621503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2602621503},{"type":"v1","addr":"172.21.15.194:6833","nonce":2602621503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:24.354981+0000","modified":"2024-04-25T09:10:27.392053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/1492125936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":1492125936},{"type":"v1","addr":"172.21.15.173:6837","nonce":1492125936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:11:05.992 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 72 2024-04-25T09:11:05.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.003+0000 7fe969c00640 1 -- 172.21.15.173:0/1277365751 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe944066f60 msgr2=0x7fe944069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.003+0000 7fe969c00640 1 --2- 172.21.15.173:0/1277365751 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe944066f60 0x7fe944069420 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe95400a9b0 tx=0x7fe954008040 comp rx=0 tx=0).stop 2024-04-25T09:11:05.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.003+0000 7fe969c00640 1 -- 172.21.15.173:0/1277365751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe964160fe0 msgr2=0x7fe964148590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.003+0000 7fe969c00640 1 --2- 172.21.15.173:0/1277365751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe964160fe0 0x7fe964148590 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fe95c0af040 tx=0x7fe95c019740 comp rx=0 tx=0).stop 2024-04-25T09:11:05.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.003+0000 7fe969c00640 1 -- 172.21.15.173:0/1277365751 shutdown_connections 2024-04-25T09:11:05.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.003+0000 7fe969c00640 1 --2- 172.21.15.173:0/1277365751 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe944066f60 0x7fe944069420 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.003+0000 7fe969c00640 1 --2- 172.21.15.173:0/1277365751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe964160fe0 0x7fe964148590 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.003+0000 7fe969c00640 1 --2- 172.21.15.173:0/1277365751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe96406dac0 0x7fe96414c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.003+0000 7fe969c00640 1 --2- 172.21.15.173:0/1277365751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe96406bca0 0x7fe964139480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.003+0000 7fe969c00640 1 -- 172.21.15.173:0/1277365751 >> 172.21.15.173:0/1277365751 conn(0x7fe964071c20 msgr2=0x7fe9640b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:05.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.003+0000 7fe969c00640 1 -- 172.21.15.173:0/1277365751 shutdown_connections 2024-04-25T09:11:05.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.003+0000 7fe969c00640 1 -- 172.21.15.173:0/1277365751 wait complete. 2024-04-25T09:11:06.012 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:11:06.012 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:11:06.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.159+0000 7f01d7e00640 1 Processor -- start 2024-04-25T09:11:06.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.159+0000 7f01d7e00640 1 -- start start 2024-04-25T09:11:06.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.159+0000 7f01d7e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f01d006ac90 0x7f01d006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:06.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.159+0000 7f01d7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01d015ea80 0x7f01d015f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:06.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.159+0000 7f01d7e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d0070230 con 0x7f01d00b3920 2024-04-25T09:11:06.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.159+0000 7f01d7e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d00b01a0 con 0x7f01d006ac90 2024-04-25T09:11:06.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.159+0000 7f01d7e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d0070510 con 0x7f01d015ea80 2024-04-25T09:11:06.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.159+0000 7f01d4a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f01d00b3920 0x7f01d006b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44334/0 (socket says 172.21.15.173:44334) 2024-04-25T09:11:06.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.159+0000 7f01d4a00640 1 -- 172.21.15.173:0/2881532653 learned_addr learned my addr 172.21.15.173:0/2881532653 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:06.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.159+0000 7f01d5e00640 1 --2- 172.21.15.173:0/2881532653 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01d015ea80 0x7f01d015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:06.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.159+0000 7f01d5400640 1 --2- 172.21.15.173:0/2881532653 >> v2:172.21.15.194:3300/0 conn(0x7f01d006ac90 0x7f01d006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:06.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.159+0000 7f01cfe00640 1 -- 172.21.15.173:0/2881532653 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925741015 0 0) 0x7f01d0070230 con 0x7f01d00b3920 2024-04-25T09:11:06.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.159+0000 7f01cfe00640 1 -- 172.21.15.173:0/2881532653 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01b8003530 con 0x7f01d00b3920 2024-04-25T09:11:06.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.159+0000 7f01d5400640 1 -- 172.21.15.173:0/2881532653 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01d015ea80 msgr2=0x7f01d015f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:06.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.159+0000 7f01d5400640 1 --2- 172.21.15.173:0/2881532653 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01d015ea80 0x7f01d015f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.159+0000 7f01d5400640 1 -- 172.21.15.173:0/2881532653 >> v1:172.21.15.173:6789/0 conn(0x7f01d00b3920 legacy=0x7f01d006b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:06.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.159+0000 7f01d5400640 1 -- 172.21.15.173:0/2881532653 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d015e280 con 0x7f01d006ac90 2024-04-25T09:11:06.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.159+0000 7f01d5e00640 1 --2- 172.21.15.173:0/2881532653 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01d015ea80 0x7f01d015f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:06.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.163+0000 7f01d5400640 1 --2- 172.21.15.173:0/2881532653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01d006ac90 0x7f01d006fba0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f01c40097c0 tx=0x7f01c401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6e22407d5d1ef38 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:06.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.163+0000 7f01cfe00640 1 -- 172.21.15.173:0/2881532653 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c40b0070 con 0x7f01d006ac90 2024-04-25T09:11:06.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.163+0000 7f01cfe00640 1 -- 172.21.15.173:0/2881532653 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c40ab600 con 0x7f01d006ac90 2024-04-25T09:11:06.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.163+0000 7f01cfe00640 1 -- 172.21.15.173:0/2881532653 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c40ab9d0 con 0x7f01d006ac90 2024-04-25T09:11:06.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.163+0000 7f01d7e00640 1 -- 172.21.15.173:0/2881532653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01d006ac90 msgr2=0x7f01d006fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:06.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.163+0000 7f01d7e00640 1 --2- 172.21.15.173:0/2881532653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01d006ac90 0x7f01d006fba0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f01c40097c0 tx=0x7f01c401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.163+0000 7f01d7e00640 1 -- 172.21.15.173:0/2881532653 shutdown_connections 2024-04-25T09:11:06.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.163+0000 7f01d7e00640 1 --2- 172.21.15.173:0/2881532653 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01d015ea80 0x7f01d015f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.163+0000 7f01d7e00640 1 --2- 172.21.15.173:0/2881532653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01d006ac90 0x7f01d006fba0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.163+0000 7f01d7e00640 1 -- 172.21.15.173:0/2881532653 >> 172.21.15.173:0/2881532653 conn(0x7f01d00b23f0 msgr2=0x7f01d00b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:06.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.163+0000 7f01d7e00640 1 -- 172.21.15.173:0/2881532653 shutdown_connections 2024-04-25T09:11:06.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.163+0000 7f01d7e00640 1 -- 172.21.15.173:0/2881532653 wait complete. 2024-04-25T09:11:06.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d7e00640 1 Processor -- start 2024-04-25T09:11:06.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d7e00640 1 -- start start 2024-04-25T09:11:06.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01d006ac90 0x7f01d0158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:06.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01d00b3920 0x7f01d0140950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:06.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01d015ea80 0x7f01d013dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:06.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d7e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d016a830 con 0x7f01d006ac90 2024-04-25T09:11:06.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d7e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d016a6b0 con 0x7f01d00b3920 2024-04-25T09:11:06.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d7e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d016a9b0 con 0x7f01d015ea80 2024-04-25T09:11:06.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d5400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01d006ac90 0x7f01d0158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:06.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d5400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01d006ac90 0x7f01d0158220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44318/0 (socket says 172.21.15.173:44318) 2024-04-25T09:11:06.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d5400640 1 -- 172.21.15.173:0/1327810654 learned_addr learned my addr 172.21.15.173:0/1327810654 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:06.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d5e00640 1 --2- 172.21.15.173:0/1327810654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01d015ea80 0x7f01d013dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:06.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d4a00640 1 --2- 172.21.15.173:0/1327810654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01d00b3920 0x7f01d0140950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:06.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d5400640 1 -- 172.21.15.173:0/1327810654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01d015ea80 msgr2=0x7f01d013dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:06.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d5400640 1 --2- 172.21.15.173:0/1327810654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01d015ea80 0x7f01d013dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d5400640 1 -- 172.21.15.173:0/1327810654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01d00b3920 msgr2=0x7f01d0140950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:06.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d5400640 1 --2- 172.21.15.173:0/1327810654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01d00b3920 0x7f01d0140950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d5400640 1 -- 172.21.15.173:0/1327810654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d013ea80 con 0x7f01d006ac90 2024-04-25T09:11:06.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d4a00640 1 --2- 172.21.15.173:0/1327810654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01d00b3920 0x7f01d0140950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:06.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d5400640 1 --2- 172.21.15.173:0/1327810654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01d006ac90 0x7f01d0158220 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f01c40ae040 tx=0x7f01c401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:06.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01cd600640 1 -- 172.21.15.173:0/1327810654 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c40b0050 con 0x7f01d006ac90 2024-04-25T09:11:06.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01cd600640 1 -- 172.21.15.173:0/1327810654 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c40bc070 con 0x7f01d006ac90 2024-04-25T09:11:06.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d7e00640 1 -- 172.21.15.173:0/1327810654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d01413e0 con 0x7f01d006ac90 2024-04-25T09:11:06.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01cd600640 1 -- 172.21.15.173:0/1327810654 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4006e20 con 0x7f01d006ac90 2024-04-25T09:11:06.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d7e00640 1 -- 172.21.15.173:0/1327810654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d0158760 con 0x7f01d006ac90 2024-04-25T09:11:06.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.167+0000 7f01d7e00640 1 -- 172.21.15.173:0/1327810654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d0073a40 con 0x7f01d006ac90 2024-04-25T09:11:06.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.171+0000 7f01cd600640 1 -- 172.21.15.173:0/1327810654 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f01c40b5830 con 0x7f01d006ac90 2024-04-25T09:11:06.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.171+0000 7f01cd600640 1 --2- 172.21.15.173:0/1327810654 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01b0066f60 0x7f01b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:06.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.171+0000 7f01cd600640 1 -- 172.21.15.173:0/1327810654 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f01c411f7c0 con 0x7f01d006ac90 2024-04-25T09:11:06.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.171+0000 7f01d4a00640 1 --2- 172.21.15.173:0/1327810654 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01b0066f60 0x7f01b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:06.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.171+0000 7f01d4a00640 1 --2- 172.21.15.173:0/1327810654 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01b0066f60 0x7f01b0069420 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f01d0158b80 tx=0x7f01bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:06.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.175+0000 7f01cd600640 1 -- 172.21.15.173:0/1327810654 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f01c4016090 con 0x7f01d006ac90 2024-04-25T09:11:06.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.379+0000 7f01d7e00640 1 -- 172.21.15.173:0/1327810654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f01d00732d0 con 0x7f01d006ac90 2024-04-25T09:11:06.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.379+0000 7f01cd600640 1 -- 172.21.15.173:0/1327810654 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1631 (secure 0 0 0) 0x7f01c40f0620 con 0x7f01d006ac90 2024-04-25T09:11:06.369 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:06.369 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":520,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":111,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076641223,"bytes_used":2584576000,"bytes_avail":770509537280,"bytes_total":773094113280,"write_bytes_sec":34108139,"read_op_per_sec":0,"write_op_per_sec":34},"fsmap":{"epoch":72,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8193}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-04-25T09:11:00.835975+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:11:06.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.383+0000 7f01d7e00640 1 -- 172.21.15.173:0/1327810654 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01b0066f60 msgr2=0x7f01b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:06.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.383+0000 7f01d7e00640 1 --2- 172.21.15.173:0/1327810654 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01b0066f60 0x7f01b0069420 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f01d0158b80 tx=0x7f01bc009040 comp rx=0 tx=0).stop 2024-04-25T09:11:06.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.383+0000 7f01d7e00640 1 -- 172.21.15.173:0/1327810654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01d006ac90 msgr2=0x7f01d0158220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:06.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.383+0000 7f01d7e00640 1 --2- 172.21.15.173:0/1327810654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01d006ac90 0x7f01d0158220 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f01c40ae040 tx=0x7f01c401ace0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.383+0000 7f01d7e00640 1 -- 172.21.15.173:0/1327810654 shutdown_connections 2024-04-25T09:11:06.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.383+0000 7f01d7e00640 1 --2- 172.21.15.173:0/1327810654 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01b0066f60 0x7f01b0069420 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.383+0000 7f01d7e00640 1 --2- 172.21.15.173:0/1327810654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01d015ea80 0x7f01d013dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.383+0000 7f01d7e00640 1 --2- 172.21.15.173:0/1327810654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01d00b3920 0x7f01d0140950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.383+0000 7f01d7e00640 1 --2- 172.21.15.173:0/1327810654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01d006ac90 0x7f01d0158220 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.383+0000 7f01d7e00640 1 -- 172.21.15.173:0/1327810654 >> 172.21.15.173:0/1327810654 conn(0x7f01d00b23f0 msgr2=0x7f01d00d0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:06.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.383+0000 7f01d7e00640 1 -- 172.21.15.173:0/1327810654 shutdown_connections 2024-04-25T09:11:06.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:06.383+0000 7f01d7e00640 1 -- 172.21.15.173:0/1327810654 wait complete. 2024-04-25T09:11:06.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused paths [/scrub_control_test_path]'} 2024-04-25T09:11:07.391 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:07.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.551+0000 7fb261e00640 1 Processor -- start 2024-04-25T09:11:07.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.551+0000 7fb261e00640 1 -- start start 2024-04-25T09:11:07.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.551+0000 7fb261e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb25c0b3e70 0x7fb25c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:07.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.551+0000 7fb261e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb25c15edd0 0x7fb25c0b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:07.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.551+0000 7fb261e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb25c0b4790 con 0x7fb25c0aefa0 2024-04-25T09:11:07.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.551+0000 7fb261e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb25c06dd50 con 0x7fb25c15edd0 2024-04-25T09:11:07.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.551+0000 7fb261e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb25c15f320 con 0x7fb25c0b3e70 2024-04-25T09:11:07.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.551+0000 7fb25b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb25c15edd0 0x7fb25c0b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:07.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.555+0000 7fb25a000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fb25c0aefa0 0x7fb25c0b2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44340/0 (socket says 172.21.15.173:44340) 2024-04-25T09:11:07.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.555+0000 7fb25a000640 1 -- 172.21.15.173:0/2968809929 learned_addr learned my addr 172.21.15.173:0/2968809929 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:07.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.555+0000 7fb25aa00640 1 --2- 172.21.15.173:0/2968809929 >> v2:172.21.15.194:3300/0 conn(0x7fb25c0b3e70 0x7fb25c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:07.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.555+0000 7fb25b400640 1 -- 172.21.15.173:0/2968809929 >> v2:172.21.15.194:3300/0 conn(0x7fb25c0b3e70 msgr2=0x7fb25c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:07.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.555+0000 7fb25b400640 1 --2- 172.21.15.173:0/2968809929 >> v2:172.21.15.194:3300/0 conn(0x7fb25c0b3e70 0x7fb25c0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.555+0000 7fb25b400640 1 -- 172.21.15.173:0/2968809929 >> v1:172.21.15.173:6789/0 conn(0x7fb25c0aefa0 legacy=0x7fb25c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:07.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.555+0000 7fb25b400640 1 -- 172.21.15.173:0/2968809929 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25c06d420 con 0x7fb25c15edd0 2024-04-25T09:11:07.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.555+0000 7fb259600640 1 -- 172.21.15.173:0/2968809929 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4086975867 0 0) 0x7fb25c0b4790 con 0x7fb25c0aefa0 2024-04-25T09:11:07.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.555+0000 7fb25b400640 1 --2- 172.21.15.173:0/2968809929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb25c15edd0 0x7fb25c0b2e80 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fb25c06bca0 tx=0x7fb25401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27d46bc536bfe54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:07.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.555+0000 7fb259600640 1 -- 172.21.15.173:0/2968809929 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2540b2070 con 0x7fb25c15edd0 2024-04-25T09:11:07.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.555+0000 7fb259600640 1 -- 172.21.15.173:0/2968809929 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2540a59e0 con 0x7fb25c15edd0 2024-04-25T09:11:07.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.555+0000 7fb259600640 1 -- 172.21.15.173:0/2968809929 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2540a5db0 con 0x7fb25c15edd0 2024-04-25T09:11:07.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb261e00640 1 -- 172.21.15.173:0/2968809929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb25c15edd0 msgr2=0x7fb25c0b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:07.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb261e00640 1 --2- 172.21.15.173:0/2968809929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb25c15edd0 0x7fb25c0b2e80 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fb25c06bca0 tx=0x7fb25401c900 comp rx=0 tx=0).stop 2024-04-25T09:11:07.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb261e00640 1 -- 172.21.15.173:0/2968809929 shutdown_connections 2024-04-25T09:11:07.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb261e00640 1 --2- 172.21.15.173:0/2968809929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb25c15edd0 0x7fb25c0b2e80 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb261e00640 1 --2- 172.21.15.173:0/2968809929 >> v2:172.21.15.194:3300/0 conn(0x7fb25c0b3e70 0x7fb25c0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb261e00640 1 -- 172.21.15.173:0/2968809929 >> 172.21.15.173:0/2968809929 conn(0x7fb25c06ac90 msgr2=0x7fb25c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:07.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb261e00640 1 -- 172.21.15.173:0/2968809929 shutdown_connections 2024-04-25T09:11:07.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb261e00640 1 -- 172.21.15.173:0/2968809929 wait complete. 2024-04-25T09:11:07.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb261e00640 1 Processor -- start 2024-04-25T09:11:07.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb261e00640 1 -- start start 2024-04-25T09:11:07.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb261e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb25c0aefa0 0x7fb25c14eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:07.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb261e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb25c0b3e70 0x7fb25c1f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:07.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb261e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb25c15edd0 0x7fb25c14e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:07.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb261e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c06e1c0 con 0x7fb25c0b3e70 2024-04-25T09:11:07.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb261e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c15aba0 con 0x7fb25c0aefa0 2024-04-25T09:11:07.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb261e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c06e340 con 0x7fb25c15edd0 2024-04-25T09:11:07.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb25a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb25c0b3e70 0x7fb25c1f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb25a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb25c0b3e70 0x7fb25c1f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44342/0 (socket says 172.21.15.173:44342) 2024-04-25T09:11:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb25a000640 1 -- 172.21.15.173:0/4065221224 learned_addr learned my addr 172.21.15.173:0/4065221224 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb25b400640 1 --2- 172.21.15.173:0/4065221224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb25c15edd0 0x7fb25c14e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb25aa00640 1 --2- 172.21.15.173:0/4065221224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb25c0aefa0 0x7fb25c14eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb25a000640 1 -- 172.21.15.173:0/4065221224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb25c15edd0 msgr2=0x7fb25c14e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb25a000640 1 --2- 172.21.15.173:0/4065221224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb25c15edd0 0x7fb25c14e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb25a000640 1 -- 172.21.15.173:0/4065221224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb25c0aefa0 msgr2=0x7fb25c14eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb25a000640 1 --2- 172.21.15.173:0/4065221224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb25c0aefa0 0x7fb25c14eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb25a000640 1 -- 172.21.15.173:0/4065221224 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25c1f69f0 con 0x7fb25c0b3e70 2024-04-25T09:11:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb25b400640 1 --2- 172.21.15.173:0/4065221224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb25c15edd0 0x7fb25c14e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb25aa00640 1 --2- 172.21.15.173:0/4065221224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb25c0aefa0 0x7fb25c14eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.559+0000 7fb25a000640 1 --2- 172.21.15.173:0/4065221224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb25c0b3e70 0x7fb25c1f64b0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb24800c480 tx=0x7fb24800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:07.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.563+0000 7fb253400640 1 -- 172.21.15.173:0/4065221224 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248018070 con 0x7fb25c0b3e70 2024-04-25T09:11:07.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.563+0000 7fb253400640 1 -- 172.21.15.173:0/4065221224 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb248007500 con 0x7fb25c0b3e70 2024-04-25T09:11:07.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.563+0000 7fb253400640 1 -- 172.21.15.173:0/4065221224 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248004a30 con 0x7fb25c0b3e70 2024-04-25T09:11:07.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.563+0000 7fb261e00640 1 -- 172.21.15.173:0/4065221224 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb25c14f0a0 con 0x7fb25c0b3e70 2024-04-25T09:11:07.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.563+0000 7fb261e00640 1 -- 172.21.15.173:0/4065221224 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25c14d8c0 con 0x7fb25c0b3e70 2024-04-25T09:11:07.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.563+0000 7fb261e00640 1 -- 172.21.15.173:0/4065221224 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb25c073a40 con 0x7fb25c0b3e70 2024-04-25T09:11:07.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.563+0000 7fb253400640 1 -- 172.21.15.173:0/4065221224 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb248004bd0 con 0x7fb25c0b3e70 2024-04-25T09:11:07.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.563+0000 7fb253400640 1 --2- 172.21.15.173:0/4065221224 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb23c066f60 0x7fb23c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:07.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.563+0000 7fb253400640 1 -- 172.21.15.173:0/4065221224 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fb248084490 con 0x7fb25c0b3e70 2024-04-25T09:11:07.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.563+0000 7fb25aa00640 1 --2- 172.21.15.173:0/4065221224 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb23c066f60 0x7fb23c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:07.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.563+0000 7fb25aa00640 1 --2- 172.21.15.173:0/4065221224 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb23c066f60 0x7fb23c069420 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00b9f0 tx=0x7fb24c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:07.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.567+0000 7fb253400640 1 -- 172.21.15.173:0/4065221224 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb25c1f69f0 con 0x7fb25c0b3e70 2024-04-25T09:11:07.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.755+0000 7fb261e00640 1 -- 172.21.15.173:0/4065221224 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb25c06e540 con 0x7fb25c0b3e70 2024-04-25T09:11:07.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.755+0000 7fb253400640 1 -- 172.21.15.173:0/4065221224 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4949 (secure 0 0 0) 0x7fb2480552e0 con 0x7fb25c0b3e70 2024-04-25T09:11:07.743 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:07.743 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1519522112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1519522112},{"type":"v1","addr":"172.21.15.194:6835","nonce":1519522112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7555,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/548680290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":548680290},{"type":"v1","addr":"172.21.15.173:6836","nonce":548680290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2602621503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2602621503},{"type":"v1","addr":"172.21.15.194:6833","nonce":2602621503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:24.354981+0000","modified":"2024-04-25T09:10:27.392053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/1492125936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":1492125936},{"type":"v1","addr":"172.21.15.173:6837","nonce":1492125936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:11:07.743 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 72 2024-04-25T09:11:07.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.755+0000 7fb261e00640 1 -- 172.21.15.173:0/4065221224 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb23c066f60 msgr2=0x7fb23c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:07.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.755+0000 7fb261e00640 1 --2- 172.21.15.173:0/4065221224 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb23c066f60 0x7fb23c069420 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00b9f0 tx=0x7fb24c008040 comp rx=0 tx=0).stop 2024-04-25T09:11:07.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.755+0000 7fb261e00640 1 -- 172.21.15.173:0/4065221224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb25c0b3e70 msgr2=0x7fb25c1f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:07.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.755+0000 7fb261e00640 1 --2- 172.21.15.173:0/4065221224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb25c0b3e70 0x7fb25c1f64b0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb24800c480 tx=0x7fb24800c940 comp rx=0 tx=0).stop 2024-04-25T09:11:07.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.755+0000 7fb261e00640 1 -- 172.21.15.173:0/4065221224 shutdown_connections 2024-04-25T09:11:07.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.755+0000 7fb261e00640 1 --2- 172.21.15.173:0/4065221224 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb23c066f60 0x7fb23c069420 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.755+0000 7fb261e00640 1 --2- 172.21.15.173:0/4065221224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb25c15edd0 0x7fb25c14e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.755+0000 7fb261e00640 1 --2- 172.21.15.173:0/4065221224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb25c0b3e70 0x7fb25c1f64b0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.755+0000 7fb261e00640 1 --2- 172.21.15.173:0/4065221224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb25c0aefa0 0x7fb25c14eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.755+0000 7fb261e00640 1 -- 172.21.15.173:0/4065221224 >> 172.21.15.173:0/4065221224 conn(0x7fb25c06ac90 msgr2=0x7fb25c0b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:07.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.755+0000 7fb261e00640 1 -- 172.21.15.173:0/4065221224 shutdown_connections 2024-04-25T09:11:07.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.755+0000 7fb261e00640 1 -- 172.21.15.173:0/4065221224 wait complete. 2024-04-25T09:11:07.765 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:11:07.765 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:11:07.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.911+0000 7f89f7200640 1 Processor -- start 2024-04-25T09:11:07.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.911+0000 7f89f7200640 1 -- start start 2024-04-25T09:11:07.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.911+0000 7f89f7200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f89f0145250 0x7f89f015c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:07.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.911+0000 7f89f7200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89f00cc8b0 0x7f89f00ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:07.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.911+0000 7f89f7200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f015cec0 con 0x7f89f0071320 2024-04-25T09:11:07.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.911+0000 7f89f7200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f006e7c0 con 0x7f89f0145250 2024-04-25T09:11:07.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.911+0000 7f89f7200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f006d720 con 0x7f89f00cc8b0 2024-04-25T09:11:07.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.911+0000 7f89efe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f89f0145250 0x7f89f015c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:07.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.911+0000 7f89f5200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f89f0071320 0x7f89f0071790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44342/0 (socket says 172.21.15.173:44342) 2024-04-25T09:11:07.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.911+0000 7f89f5200640 1 -- 172.21.15.173:0/1241085887 learned_addr learned my addr 172.21.15.173:0/1241085887 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:07.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.911+0000 7f89ef400640 1 --2- 172.21.15.173:0/1241085887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89f00cc8b0 0x7f89f00ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:07.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.911+0000 7f89efe00640 1 -- 172.21.15.173:0/1241085887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89f00cc8b0 msgr2=0x7f89f00ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:07.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.911+0000 7f89efe00640 1 --2- 172.21.15.173:0/1241085887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89f00cc8b0 0x7f89f00ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.911+0000 7f89efe00640 1 -- 172.21.15.173:0/1241085887 >> v1:172.21.15.173:6789/0 conn(0x7f89f0071320 legacy=0x7f89f0071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:07.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.911+0000 7f89efe00640 1 -- 172.21.15.173:0/1241085887 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f006da00 con 0x7f89f0145250 2024-04-25T09:11:07.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.915+0000 7f89efe00640 1 --2- 172.21.15.173:0/1241085887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89f0145250 0x7f89f015c980 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f89d80097c0 tx=0x7f89d801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556b1c46006f5c73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:07.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.915+0000 7f89eea00640 1 -- 172.21.15.173:0/1241085887 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d80b2070 con 0x7f89f0145250 2024-04-25T09:11:07.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.915+0000 7f89eea00640 1 -- 172.21.15.173:0/1241085887 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d80ad640 con 0x7f89f0145250 2024-04-25T09:11:07.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.915+0000 7f89eea00640 1 -- 172.21.15.173:0/1241085887 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d80ada10 con 0x7f89f0145250 2024-04-25T09:11:07.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.915+0000 7f89f7200640 1 -- 172.21.15.173:0/1241085887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89f0145250 msgr2=0x7f89f015c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:07.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.915+0000 7f89f7200640 1 --2- 172.21.15.173:0/1241085887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89f0145250 0x7f89f015c980 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f89d80097c0 tx=0x7f89d801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.915+0000 7f89f7200640 1 -- 172.21.15.173:0/1241085887 shutdown_connections 2024-04-25T09:11:07.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.915+0000 7f89f7200640 1 --2- 172.21.15.173:0/1241085887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89f00cc8b0 0x7f89f00ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.915+0000 7f89f7200640 1 --2- 172.21.15.173:0/1241085887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89f0145250 0x7f89f015c980 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.915+0000 7f89f7200640 1 -- 172.21.15.173:0/1241085887 >> 172.21.15.173:0/1241085887 conn(0x7f89f006ac90 msgr2=0x7f89f006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:07.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.915+0000 7f89f7200640 1 -- 172.21.15.173:0/1241085887 shutdown_connections 2024-04-25T09:11:07.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.915+0000 7f89f7200640 1 -- 172.21.15.173:0/1241085887 wait complete. 2024-04-25T09:11:07.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89f7200640 1 Processor -- start 2024-04-25T09:11:07.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89f7200640 1 -- start start 2024-04-25T09:11:07.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89f7200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f0071320 0x7f89f00b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:07.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89f7200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89f00cc8b0 0x7f89f01fa780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:07.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89f7200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89f0145250 0x7f89f015f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:07.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89f7200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f006ef80 con 0x7f89f00cc8b0 2024-04-25T09:11:07.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89f7200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f0145630 con 0x7f89f0071320 2024-04-25T09:11:07.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89f7200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f006d380 con 0x7f89f0145250 2024-04-25T09:11:07.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89ef400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89f00cc8b0 0x7f89f01fa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:07.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89ef400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89f00cc8b0 0x7f89f01fa780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44360/0 (socket says 172.21.15.173:44360) 2024-04-25T09:11:07.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89ef400640 1 -- 172.21.15.173:0/1176352920 learned_addr learned my addr 172.21.15.173:0/1176352920 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:07.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89f5200640 1 --2- 172.21.15.173:0/1176352920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89f0145250 0x7f89f015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:07.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89efe00640 1 --2- 172.21.15.173:0/1176352920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f0071320 0x7f89f00b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89ef400640 1 -- 172.21.15.173:0/1176352920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89f0145250 msgr2=0x7f89f015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89ef400640 1 --2- 172.21.15.173:0/1176352920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89f0145250 0x7f89f015f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89ef400640 1 -- 172.21.15.173:0/1176352920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f0071320 msgr2=0x7f89f00b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89ef400640 1 --2- 172.21.15.173:0/1176352920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f0071320 0x7f89f00b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89ef400640 1 -- 172.21.15.173:0/1176352920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f0144ad0 con 0x7f89f00cc8b0 2024-04-25T09:11:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89ef400640 1 --2- 172.21.15.173:0/1176352920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89f00cc8b0 0x7f89f01fa780 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f89e000d620 tx=0x7f89e000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89e7e00640 1 -- 172.21.15.173:0/1176352920 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e00125f0 con 0x7f89f00cc8b0 2024-04-25T09:11:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89e7e00640 1 -- 172.21.15.173:0/1176352920 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e0019070 con 0x7f89f00cc8b0 2024-04-25T09:11:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89f7200640 1 -- 172.21.15.173:0/1176352920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f00af2e0 con 0x7f89f00cc8b0 2024-04-25T09:11:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89e7e00640 1 -- 172.21.15.173:0/1176352920 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e00129b0 con 0x7f89f00cc8b0 2024-04-25T09:11:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.919+0000 7f89f7200640 1 -- 172.21.15.173:0/1176352920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f00af8a0 con 0x7f89f00cc8b0 2024-04-25T09:11:07.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.923+0000 7f89f7200640 1 -- 172.21.15.173:0/1176352920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f0073a40 con 0x7f89f00cc8b0 2024-04-25T09:11:07.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.923+0000 7f89e7e00640 1 -- 172.21.15.173:0/1176352920 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f89e0012b50 con 0x7f89f00cc8b0 2024-04-25T09:11:07.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.923+0000 7f89e7e00640 1 --2- 172.21.15.173:0/1176352920 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f89cc066f60 0x7f89cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:07.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.923+0000 7f89e7e00640 1 -- 172.21.15.173:0/1176352920 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f89e00855c0 con 0x7f89f00cc8b0 2024-04-25T09:11:07.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.923+0000 7f89efe00640 1 --2- 172.21.15.173:0/1176352920 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f89cc066f60 0x7f89cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:07.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.923+0000 7f89efe00640 1 --2- 172.21.15.173:0/1176352920 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f89cc066f60 0x7f89cc069420 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f89d80af000 tx=0x7f89d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:07.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:07.927+0000 7f89e7e00640 1 -- 172.21.15.173:0/1176352920 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f89e0056420 con 0x7f89f00cc8b0 2024-04-25T09:11:08.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.135+0000 7f89f7200640 1 -- 172.21.15.173:0/1176352920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f89f01facc0 con 0x7f89f00cc8b0 2024-04-25T09:11:08.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.135+0000 7f89e7e00640 1 -- 172.21.15.173:0/1176352920 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1575 (secure 0 0 0) 0x7f89e0055d20 con 0x7f89f00cc8b0 2024-04-25T09:11:08.122 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:08.122 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":522,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":111,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076641223,"bytes_used":2584576000,"bytes_avail":770509537280,"bytes_total":773094113280,"write_bytes_sec":13529354,"read_op_per_sec":0,"write_op_per_sec":14},"fsmap":{"epoch":72,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8193}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-04-25T09:11:06.837293+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:11:08.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.135+0000 7f89f7200640 1 -- 172.21.15.173:0/1176352920 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f89cc066f60 msgr2=0x7f89cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.135+0000 7f89f7200640 1 --2- 172.21.15.173:0/1176352920 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f89cc066f60 0x7f89cc069420 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f89d80af000 tx=0x7f89d8008040 comp rx=0 tx=0).stop 2024-04-25T09:11:08.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.135+0000 7f89f7200640 1 -- 172.21.15.173:0/1176352920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89f00cc8b0 msgr2=0x7f89f01fa780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.135+0000 7f89f7200640 1 --2- 172.21.15.173:0/1176352920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89f00cc8b0 0x7f89f01fa780 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f89e000d620 tx=0x7f89e000dae0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.135+0000 7f89f7200640 1 -- 172.21.15.173:0/1176352920 shutdown_connections 2024-04-25T09:11:08.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.135+0000 7f89f7200640 1 --2- 172.21.15.173:0/1176352920 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f89cc066f60 0x7f89cc069420 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.135+0000 7f89f7200640 1 --2- 172.21.15.173:0/1176352920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89f0145250 0x7f89f015f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.135+0000 7f89f7200640 1 --2- 172.21.15.173:0/1176352920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89f00cc8b0 0x7f89f01fa780 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.135+0000 7f89f7200640 1 --2- 172.21.15.173:0/1176352920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89f0071320 0x7f89f00b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.135+0000 7f89f7200640 1 -- 172.21.15.173:0/1176352920 >> 172.21.15.173:0/1176352920 conn(0x7f89f006ac90 msgr2=0x7f89f015e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:08.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.135+0000 7f89f7200640 1 -- 172.21.15.173:0/1176352920 shutdown_connections 2024-04-25T09:11:08.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.135+0000 7f89f7200640 1 -- 172.21.15.173:0/1176352920 wait complete. 2024-04-25T09:11:08.143 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:11:08.143 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:11:08.144 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:11:08.224 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:11:08.313 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:11:08.313 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:11:08.313 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:08.322 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:11:08.322 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:08.373 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:08.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.563+0000 7f722ae00640 1 Processor -- start 2024-04-25T09:11:08.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.563+0000 7f722ae00640 1 -- start start 2024-04-25T09:11:08.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.567+0000 7f722ae00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f72240b3e70 0x7f72240b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.567+0000 7f722ae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72240aefa0 0x7f72240b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.567+0000 7f722ae00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f722415edd0 0x7f72240b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.567+0000 7f722ae00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f722406dd50 con 0x7f72240b3e70 2024-04-25T09:11:08.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.567+0000 7f722ae00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72240b4790 con 0x7f722415edd0 2024-04-25T09:11:08.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.567+0000 7f722ae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f722415f320 con 0x7f72240aefa0 2024-04-25T09:11:08.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.567+0000 7f7223e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f72240b3e70 0x7f72240b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:08.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.567+0000 7f7223e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f72240b3e70 0x7f72240b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44366/0 (socket says 172.21.15.173:44366) 2024-04-25T09:11:08.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.567+0000 7f7223e00640 1 -- 172.21.15.173:0/2782674651 learned_addr learned my addr 172.21.15.173:0/2782674651 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:08.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.567+0000 7f7223e00640 1 -- 172.21.15.173:0/2782674651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72240aefa0 msgr2=0x7f72240b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:08.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.567+0000 7f7223e00640 1 --2- 172.21.15.173:0/2782674651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72240aefa0 0x7f72240b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.567+0000 7f7223e00640 1 -- 172.21.15.173:0/2782674651 >> v2:172.21.15.194:3300/0 conn(0x7f722415edd0 msgr2=0x7f72240b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:08.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.567+0000 7f7223e00640 1 --2- 172.21.15.173:0/2782674651 >> v2:172.21.15.194:3300/0 conn(0x7f722415edd0 0x7f72240b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.567+0000 7f7223e00640 1 -- 172.21.15.173:0/2782674651 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722406d420 con 0x7f72240b3e70 2024-04-25T09:11:08.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.567+0000 7f7223e00640 1 --2- 172.21.15.173:0/2782674651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72240b3e70 0x7f72240b4250 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f722406bbf0 tx=0x7f721401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b010230e269d0dd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:08.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.567+0000 7f7223400640 1 -- 172.21.15.173:0/2782674651 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72140aa430 con 0x7f72240b3e70 2024-04-25T09:11:08.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.567+0000 7f7223400640 1 -- 172.21.15.173:0/2782674651 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72140af070 con 0x7f72240b3e70 2024-04-25T09:11:08.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f7223400640 1 -- 172.21.15.173:0/2782674651 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72140aa7f0 con 0x7f72240b3e70 2024-04-25T09:11:08.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f722ae00640 1 -- 172.21.15.173:0/2782674651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72240b3e70 msgr2=0x7f72240b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f722ae00640 1 --2- 172.21.15.173:0/2782674651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72240b3e70 0x7f72240b4250 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f722406bbf0 tx=0x7f721401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f722ae00640 1 -- 172.21.15.173:0/2782674651 shutdown_connections 2024-04-25T09:11:08.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f722ae00640 1 --2- 172.21.15.173:0/2782674651 >> v2:172.21.15.194:3300/0 conn(0x7f722415edd0 0x7f72240b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f722ae00640 1 --2- 172.21.15.173:0/2782674651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72240aefa0 0x7f72240b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f722ae00640 1 --2- 172.21.15.173:0/2782674651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72240b3e70 0x7f72240b4250 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f722ae00640 1 -- 172.21.15.173:0/2782674651 >> 172.21.15.173:0/2782674651 conn(0x7f722406ac90 msgr2=0x7f722406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:08.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f722ae00640 1 -- 172.21.15.173:0/2782674651 shutdown_connections 2024-04-25T09:11:08.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f722ae00640 1 -- 172.21.15.173:0/2782674651 wait complete. 2024-04-25T09:11:08.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f722ae00640 1 Processor -- start 2024-04-25T09:11:08.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f722ae00640 1 -- start start 2024-04-25T09:11:08.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f722ae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72240aefa0 0x7f72240ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f722ae00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72240b3e70 0x7f722414e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f722ae00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f722415edd0 0x7f722414ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f722ae00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722406e1e0 con 0x7f722415edd0 2024-04-25T09:11:08.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f722ae00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72240b3600 con 0x7f72240b3e70 2024-04-25T09:11:08.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f722ae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f722406e360 con 0x7f72240aefa0 2024-04-25T09:11:08.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f7228e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f722415edd0 0x7f722414ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:08.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f7228e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f722415edd0 0x7f722414ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44376/0 (socket says 172.21.15.173:44376) 2024-04-25T09:11:08.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f7228e00640 1 -- 172.21.15.173:0/355500404 learned_addr learned my addr 172.21.15.173:0/355500404 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:08.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f7223e00640 1 --2- 172.21.15.173:0/355500404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72240aefa0 0x7f72240ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:08.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f721b400640 1 --2- 172.21.15.173:0/355500404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72240b3e70 0x7f722414e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:08.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f7228e00640 1 -- 172.21.15.173:0/355500404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72240aefa0 msgr2=0x7f72240ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.571+0000 7f7228e00640 1 --2- 172.21.15.173:0/355500404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72240aefa0 0x7f72240ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.575+0000 7f7228e00640 1 -- 172.21.15.173:0/355500404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72240b3e70 msgr2=0x7f722414e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.575+0000 7f7228e00640 1 --2- 172.21.15.173:0/355500404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72240b3e70 0x7f722414e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.575+0000 7f7228e00640 1 -- 172.21.15.173:0/355500404 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72240acea0 con 0x7f722415edd0 2024-04-25T09:11:08.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.575+0000 7f7228e00640 1 --2- 172.21.15.173:0/355500404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f722415edd0 0x7f722414ebe0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f721c00b970 tx=0x7f721c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:08.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.575+0000 7f7220c00640 1 -- 172.21.15.173:0/355500404 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c019070 con 0x7f722415edd0 2024-04-25T09:11:08.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.575+0000 7f7220c00640 1 -- 172.21.15.173:0/355500404 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721c00cb60 con 0x7f722415edd0 2024-04-25T09:11:08.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.575+0000 7f7220c00640 1 -- 172.21.15.173:0/355500404 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c014440 con 0x7f722415edd0 2024-04-25T09:11:08.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.575+0000 7f722ae00640 1 -- 172.21.15.173:0/355500404 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72240ad180 con 0x7f722415edd0 2024-04-25T09:11:08.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.575+0000 7f722ae00640 1 -- 172.21.15.173:0/355500404 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72240ad740 con 0x7f722415edd0 2024-04-25T09:11:08.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.575+0000 7f722ae00640 1 -- 172.21.15.173:0/355500404 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7224073a40 con 0x7f722415edd0 2024-04-25T09:11:08.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.575+0000 7f7220c00640 1 -- 172.21.15.173:0/355500404 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f721c01c070 con 0x7f722415edd0 2024-04-25T09:11:08.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.575+0000 7f7220c00640 1 --2- 172.21.15.173:0/355500404 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7200066f60 0x7f7200069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.575+0000 7f7220c00640 1 -- 172.21.15.173:0/355500404 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f721c084ea0 con 0x7f722415edd0 2024-04-25T09:11:08.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.575+0000 7f7223e00640 1 --2- 172.21.15.173:0/355500404 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7200066f60 0x7f7200069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:08.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.579+0000 7f7223e00640 1 --2- 172.21.15.173:0/355500404 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7200066f60 0x7f7200069420 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f72140ae000 tx=0x7f72140a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:08.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.579+0000 7f7220c00640 1 -- 172.21.15.173:0/355500404 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f721c0556a0 con 0x7f722415edd0 2024-04-25T09:11:08.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.735+0000 7f722ae00640 1 -- 172.21.15.173:0/355500404 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f722406e540 con 0x7f722415edd0 2024-04-25T09:11:08.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.735+0000 7f7220c00640 1 -- 172.21.15.173:0/355500404 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16994 (secure 0 0 0) 0x7f721c059740 con 0x7f722415edd0 2024-04-25T09:11:08.724 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:08.724 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":111,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:10:34.497380+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:22.062377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:23.359080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.35","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:08.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.739+0000 7f722ae00640 1 -- 172.21.15.173:0/355500404 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7200066f60 msgr2=0x7f7200069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.739+0000 7f722ae00640 1 --2- 172.21.15.173:0/355500404 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7200066f60 0x7f7200069420 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f72140ae000 tx=0x7f72140a7000 comp rx=0 tx=0).stop 2024-04-25T09:11:08.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.739+0000 7f722ae00640 1 -- 172.21.15.173:0/355500404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f722415edd0 msgr2=0x7f722414ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.739+0000 7f722ae00640 1 --2- 172.21.15.173:0/355500404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f722415edd0 0x7f722414ebe0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f721c00b970 tx=0x7f721c00be30 comp rx=0 tx=0).stop 2024-04-25T09:11:08.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.739+0000 7f722ae00640 1 -- 172.21.15.173:0/355500404 shutdown_connections 2024-04-25T09:11:08.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.739+0000 7f722ae00640 1 --2- 172.21.15.173:0/355500404 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7200066f60 0x7f7200069420 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.739+0000 7f722ae00640 1 --2- 172.21.15.173:0/355500404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f722415edd0 0x7f722414ebe0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.739+0000 7f722ae00640 1 --2- 172.21.15.173:0/355500404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72240b3e70 0x7f722414e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.739+0000 7f722ae00640 1 --2- 172.21.15.173:0/355500404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72240aefa0 0x7f72240ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.739+0000 7f722ae00640 1 -- 172.21.15.173:0/355500404 >> 172.21.15.173:0/355500404 conn(0x7f722406ac90 msgr2=0x7f72240cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:08.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.739+0000 7f722ae00640 1 -- 172.21.15.173:0/355500404 shutdown_connections 2024-04-25T09:11:08.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.739+0000 7f722ae00640 1 -- 172.21.15.173:0/355500404 wait complete. 2024-04-25T09:11:08.746 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:10:22.062377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:10:23.359080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:11:08.747 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:11:08.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.899+0000 7fe27e400640 1 Processor -- start 2024-04-25T09:11:08.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.899+0000 7fe27e400640 1 -- start start 2024-04-25T09:11:08.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.899+0000 7fe27e400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe27815e120 0x7fe2780b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.899+0000 7fe27e400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe27806d200 0x7fe278099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.899+0000 7fe27e400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2780d1490 con 0x7fe2780d0630 2024-04-25T09:11:08.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.899+0000 7fe27e400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2780d0bf0 con 0x7fe27815e120 2024-04-25T09:11:08.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.899+0000 7fe27e400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2780d0ed0 con 0x7fe27806d200 2024-04-25T09:11:08.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.899+0000 7fe277400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe27815e120 0x7fe2780b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:08.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.899+0000 7fe277400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe27815e120 0x7fe2780b2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44380/0 (socket says 172.21.15.173:44380) 2024-04-25T09:11:08.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.899+0000 7fe277400640 1 -- 172.21.15.173:0/884634104 learned_addr learned my addr 172.21.15.173:0/884634104 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:08.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.899+0000 7fe276a00640 1 --2- 172.21.15.173:0/884634104 >> v2:172.21.15.194:3300/0 conn(0x7fe27806d200 0x7fe278099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:08.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.899+0000 7fe277400640 1 -- 172.21.15.173:0/884634104 >> v2:172.21.15.194:3300/0 conn(0x7fe27806d200 msgr2=0x7fe278099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:08.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.899+0000 7fe277400640 1 --2- 172.21.15.173:0/884634104 >> v2:172.21.15.194:3300/0 conn(0x7fe27806d200 0x7fe278099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.899+0000 7fe277400640 1 -- 172.21.15.173:0/884634104 >> v1:172.21.15.194:6789/0 conn(0x7fe2780d0630 legacy=0x7fe27806c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.899+0000 7fe277400640 1 -- 172.21.15.173:0/884634104 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2780d11b0 con 0x7fe27815e120 2024-04-25T09:11:08.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.903+0000 7fe277400640 1 --2- 172.21.15.173:0/884634104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe27815e120 0x7fe2780b2a00 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fe278072750 tx=0x7fe26801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686827b7fa705687 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:08.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.903+0000 7fe276000640 1 -- 172.21.15.173:0/884634104 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680a5620 con 0x7fe27815e120 2024-04-25T09:11:08.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.903+0000 7fe276000640 1 -- 172.21.15.173:0/884634104 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2680a57c0 con 0x7fe27815e120 2024-04-25T09:11:08.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.903+0000 7fe276000640 1 -- 172.21.15.173:0/884634104 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680a5b90 con 0x7fe27815e120 2024-04-25T09:11:08.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.903+0000 7fe27e400640 1 -- 172.21.15.173:0/884634104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe27815e120 msgr2=0x7fe2780b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.903+0000 7fe27e400640 1 --2- 172.21.15.173:0/884634104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe27815e120 0x7fe2780b2a00 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fe278072750 tx=0x7fe26801c960 comp rx=0 tx=0).stop 2024-04-25T09:11:08.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.903+0000 7fe27e400640 1 -- 172.21.15.173:0/884634104 shutdown_connections 2024-04-25T09:11:08.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.903+0000 7fe27e400640 1 --2- 172.21.15.173:0/884634104 >> v2:172.21.15.194:3300/0 conn(0x7fe27806d200 0x7fe278099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.903+0000 7fe27e400640 1 --2- 172.21.15.173:0/884634104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe27815e120 0x7fe2780b2a00 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.903+0000 7fe27e400640 1 -- 172.21.15.173:0/884634104 >> 172.21.15.173:0/884634104 conn(0x7fe2780b32a0 msgr2=0x7fe2780b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:08.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.903+0000 7fe27e400640 1 -- 172.21.15.173:0/884634104 shutdown_connections 2024-04-25T09:11:08.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.903+0000 7fe27e400640 1 -- 172.21.15.173:0/884634104 wait complete. 2024-04-25T09:11:08.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe27e400640 1 Processor -- start 2024-04-25T09:11:08.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe27e400640 1 -- start start 2024-04-25T09:11:08.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe27e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe27806d200 0x7fe278155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe27e400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2780d0630 0x7fe27815f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe27e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe27815e120 0x7fe278160b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe27e400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27816aef0 con 0x7fe2780d0630 2024-04-25T09:11:08.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe27e400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27816ad70 con 0x7fe27806d200 2024-04-25T09:11:08.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe27e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27816b070 con 0x7fe27815e120 2024-04-25T09:11:08.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe276a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2780d0630 0x7fe27815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:08.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe276a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2780d0630 0x7fe27815f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44390/0 (socket says 172.21.15.173:44390) 2024-04-25T09:11:08.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe276a00640 1 -- 172.21.15.173:0/3434170011 learned_addr learned my addr 172.21.15.173:0/3434170011 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:08.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe277400640 1 --2- 172.21.15.173:0/3434170011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe27806d200 0x7fe278155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:08.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe277e00640 1 --2- 172.21.15.173:0/3434170011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe27815e120 0x7fe278160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:08.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe276a00640 1 -- 172.21.15.173:0/3434170011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe27815e120 msgr2=0x7fe278160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe276a00640 1 --2- 172.21.15.173:0/3434170011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe27815e120 0x7fe278160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe276a00640 1 -- 172.21.15.173:0/3434170011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe27806d200 msgr2=0x7fe278155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe276a00640 1 --2- 172.21.15.173:0/3434170011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe27806d200 0x7fe278155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe276a00640 1 -- 172.21.15.173:0/3434170011 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe278161050 con 0x7fe2780d0630 2024-04-25T09:11:08.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe277e00640 1 --2- 172.21.15.173:0/3434170011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe27815e120 0x7fe278160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:08.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe276a00640 1 --2- 172.21.15.173:0/3434170011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2780d0630 0x7fe27815f570 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fe26400d5f0 tx=0x7fe26400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:08.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe26f400640 1 -- 172.21.15.173:0/3434170011 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2640125f0 con 0x7fe2780d0630 2024-04-25T09:11:08.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe26f400640 1 -- 172.21.15.173:0/3434170011 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe264019070 con 0x7fe2780d0630 2024-04-25T09:11:08.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe26f400640 1 -- 172.21.15.173:0/3434170011 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2640129b0 con 0x7fe2780d0630 2024-04-25T09:11:08.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe27e400640 1 -- 172.21.15.173:0/3434170011 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27815e7b0 con 0x7fe2780d0630 2024-04-25T09:11:08.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe27e400640 1 -- 172.21.15.173:0/3434170011 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27815ed70 con 0x7fe2780d0630 2024-04-25T09:11:08.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.907+0000 7fe27e400640 1 -- 172.21.15.173:0/3434170011 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe278073ab0 con 0x7fe2780d0630 2024-04-25T09:11:08.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.911+0000 7fe26f400640 1 -- 172.21.15.173:0/3434170011 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe264012b50 con 0x7fe2780d0630 2024-04-25T09:11:08.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.911+0000 7fe26f400640 1 --2- 172.21.15.173:0/3434170011 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe258066f60 0x7fe258069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.911+0000 7fe26f400640 1 -- 172.21.15.173:0/3434170011 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fe264085560 con 0x7fe2780d0630 2024-04-25T09:11:08.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.911+0000 7fe277400640 1 --2- 172.21.15.173:0/3434170011 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe258066f60 0x7fe258069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:08.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.911+0000 7fe277400640 1 --2- 172.21.15.173:0/3434170011 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe258066f60 0x7fe258069420 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe2680ae000 tx=0x7fe2680a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:08.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:08.915+0000 7fe26f400640 1 -- 172.21.15.173:0/3434170011 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe278161050 con 0x7fe2780d0630 2024-04-25T09:11:09.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.071+0000 7fe27e400640 1 -- 172.21.15.173:0/3434170011 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2780cbb70 con 0x7fe2780d0630 2024-04-25T09:11:09.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.071+0000 7fe26f400640 1 -- 172.21.15.173:0/3434170011 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2640563b0 con 0x7fe2780d0630 2024-04-25T09:11:09.059 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:11:09.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.071+0000 7fe27e400640 1 -- 172.21.15.173:0/3434170011 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe258066f60 msgr2=0x7fe258069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.071+0000 7fe27e400640 1 --2- 172.21.15.173:0/3434170011 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe258066f60 0x7fe258069420 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe2680ae000 tx=0x7fe2680a7070 comp rx=0 tx=0).stop 2024-04-25T09:11:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.071+0000 7fe27e400640 1 -- 172.21.15.173:0/3434170011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2780d0630 msgr2=0x7fe27815f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.071+0000 7fe27e400640 1 --2- 172.21.15.173:0/3434170011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2780d0630 0x7fe27815f570 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fe26400d5f0 tx=0x7fe26400dab0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.071+0000 7fe27e400640 1 -- 172.21.15.173:0/3434170011 shutdown_connections 2024-04-25T09:11:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.071+0000 7fe27e400640 1 --2- 172.21.15.173:0/3434170011 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe258066f60 0x7fe258069420 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.071+0000 7fe27e400640 1 --2- 172.21.15.173:0/3434170011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe27815e120 0x7fe278160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.071+0000 7fe27e400640 1 --2- 172.21.15.173:0/3434170011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2780d0630 0x7fe27815f570 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.071+0000 7fe27e400640 1 --2- 172.21.15.173:0/3434170011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe27806d200 0x7fe278155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.071+0000 7fe27e400640 1 -- 172.21.15.173:0/3434170011 >> 172.21.15.173:0/3434170011 conn(0x7fe2780b32a0 msgr2=0x7fe27806bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.071+0000 7fe27e400640 1 -- 172.21.15.173:0/3434170011 shutdown_connections 2024-04-25T09:11:09.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.071+0000 7fe27e400640 1 -- 172.21.15.173:0/3434170011 wait complete. 2024-04-25T09:11:09.080 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:11:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.231+0000 7fe8c2c00640 1 Processor -- start 2024-04-25T09:11:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.231+0000 7fe8c2c00640 1 -- start start 2024-04-25T09:11:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.231+0000 7fe8c2c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe8bc145290 0x7fe8bc15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.231+0000 7fe8c2c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe8bc0b3fe0 0x7fe8bc0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.231+0000 7fe8c2c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8bc15c5f0 con 0x7fe8bc0cc260 2024-04-25T09:11:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.231+0000 7fe8c2c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8bc0ccd80 con 0x7fe8bc145290 2024-04-25T09:11:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.231+0000 7fe8c2c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8bc06d4b0 con 0x7fe8bc0b3fe0 2024-04-25T09:11:09.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.231+0000 7fe8bbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe8bc145290 0x7fe8bc15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.231+0000 7fe8c0c00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe8bc0cc260 0x7fe8bc0cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44354/0 (socket says 172.21.15.173:44354) 2024-04-25T09:11:09.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.231+0000 7fe8c0c00640 1 -- 172.21.15.173:0/3363095887 learned_addr learned my addr 172.21.15.173:0/3363095887 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:09.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.231+0000 7fe8b3400640 1 --2- 172.21.15.173:0/3363095887 >> v2:172.21.15.194:3300/0 conn(0x7fe8bc0b3fe0 0x7fe8bc0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.231+0000 7fe8bbe00640 1 -- 172.21.15.173:0/3363095887 >> v2:172.21.15.194:3300/0 conn(0x7fe8bc0b3fe0 msgr2=0x7fe8bc0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:09.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.231+0000 7fe8bbe00640 1 --2- 172.21.15.173:0/3363095887 >> v2:172.21.15.194:3300/0 conn(0x7fe8bc0b3fe0 0x7fe8bc0b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.231+0000 7fe8bbe00640 1 -- 172.21.15.173:0/3363095887 >> v1:172.21.15.173:6789/0 conn(0x7fe8bc0cc260 legacy=0x7fe8bc0cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.231+0000 7fe8bbe00640 1 -- 172.21.15.173:0/3363095887 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc06d790 con 0x7fe8bc145290 2024-04-25T09:11:09.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.235+0000 7fe8bbe00640 1 --2- 172.21.15.173:0/3363095887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8bc145290 0x7fe8bc15c0b0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc071100 tx=0x7fe8ac01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff26db7ea3ba0db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:09.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.235+0000 7fe8bb400640 1 -- 172.21.15.173:0/3363095887 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac0b0070 con 0x7fe8bc145290 2024-04-25T09:11:09.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.235+0000 7fe8bb400640 1 -- 172.21.15.173:0/3363095887 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac0ab600 con 0x7fe8bc145290 2024-04-25T09:11:09.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.235+0000 7fe8bb400640 1 -- 172.21.15.173:0/3363095887 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac0ab9d0 con 0x7fe8bc145290 2024-04-25T09:11:09.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.235+0000 7fe8c2c00640 1 -- 172.21.15.173:0/3363095887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8bc145290 msgr2=0x7fe8bc15c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.235+0000 7fe8c2c00640 1 --2- 172.21.15.173:0/3363095887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8bc145290 0x7fe8bc15c0b0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc071100 tx=0x7fe8ac01c360 comp rx=0 tx=0).stop 2024-04-25T09:11:09.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.235+0000 7fe8c2c00640 1 -- 172.21.15.173:0/3363095887 shutdown_connections 2024-04-25T09:11:09.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.235+0000 7fe8c2c00640 1 --2- 172.21.15.173:0/3363095887 >> v2:172.21.15.194:3300/0 conn(0x7fe8bc0b3fe0 0x7fe8bc0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.235+0000 7fe8c2c00640 1 --2- 172.21.15.173:0/3363095887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8bc145290 0x7fe8bc15c0b0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.235+0000 7fe8c2c00640 1 -- 172.21.15.173:0/3363095887 >> 172.21.15.173:0/3363095887 conn(0x7fe8bc06ac90 msgr2=0x7fe8bc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:09.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.235+0000 7fe8c2c00640 1 -- 172.21.15.173:0/3363095887 shutdown_connections 2024-04-25T09:11:09.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.235+0000 7fe8c2c00640 1 -- 172.21.15.173:0/3363095887 wait complete. 2024-04-25T09:11:09.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.235+0000 7fe8c2c00640 1 Processor -- start 2024-04-25T09:11:09.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.235+0000 7fe8c2c00640 1 -- start start 2024-04-25T09:11:09.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8c2c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8bc0b3fe0 0x7fe8bc15b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8c2c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8bc0cc260 0x7fe8bc1582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8c2c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8bc145290 0x7fe8bc0ad720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8c2c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc1457f0 con 0x7fe8bc145290 2024-04-25T09:11:09.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8c2c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc145670 con 0x7fe8bc0cc260 2024-04-25T09:11:09.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8c2c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc06ed60 con 0x7fe8bc0b3fe0 2024-04-25T09:11:09.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8c0c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8bc145290 0x7fe8bc0ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8bbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8bc0b3fe0 0x7fe8bc15b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8c0c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8bc145290 0x7fe8bc0ad720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44406/0 (socket says 172.21.15.173:44406) 2024-04-25T09:11:09.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8c0c00640 1 -- 172.21.15.173:0/581790080 learned_addr learned my addr 172.21.15.173:0/581790080 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:09.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8b3400640 1 --2- 172.21.15.173:0/581790080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8bc0cc260 0x7fe8bc1582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8c0c00640 1 -- 172.21.15.173:0/581790080 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8bc0b3fe0 msgr2=0x7fe8bc15b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8c0c00640 1 --2- 172.21.15.173:0/581790080 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8bc0b3fe0 0x7fe8bc15b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8c0c00640 1 -- 172.21.15.173:0/581790080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8bc0cc260 msgr2=0x7fe8bc1582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8c0c00640 1 --2- 172.21.15.173:0/581790080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8bc0cc260 0x7fe8bc1582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8c0c00640 1 -- 172.21.15.173:0/581790080 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc15a740 con 0x7fe8bc145290 2024-04-25T09:11:09.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8c0c00640 1 --2- 172.21.15.173:0/581790080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8bc145290 0x7fe8bc0ad720 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400cbc0 tx=0x7fe8b400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:09.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8b8c00640 1 -- 172.21.15.173:0/581790080 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4017070 con 0x7fe8bc145290 2024-04-25T09:11:09.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8b8c00640 1 -- 172.21.15.173:0/581790080 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b400ad40 con 0x7fe8bc145290 2024-04-25T09:11:09.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8c2c00640 1 -- 172.21.15.173:0/581790080 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8bc13d5a0 con 0x7fe8bc145290 2024-04-25T09:11:09.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8b8c00640 1 -- 172.21.15.173:0/581790080 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4012600 con 0x7fe8bc145290 2024-04-25T09:11:09.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8c2c00640 1 -- 172.21.15.173:0/581790080 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8bc15a9b0 con 0x7fe8bc145290 2024-04-25T09:11:09.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.239+0000 7fe8c2c00640 1 -- 172.21.15.173:0/581790080 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8bc073ab0 con 0x7fe8bc145290 2024-04-25T09:11:09.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.243+0000 7fe8b8c00640 1 -- 172.21.15.173:0/581790080 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe8b401a070 con 0x7fe8bc145290 2024-04-25T09:11:09.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.243+0000 7fe8b8c00640 1 --2- 172.21.15.173:0/581790080 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe898066f60 0x7fe898069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.243+0000 7fe8b8c00640 1 -- 172.21.15.173:0/581790080 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fe8b4084e20 con 0x7fe8bc145290 2024-04-25T09:11:09.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.243+0000 7fe8bbe00640 1 --2- 172.21.15.173:0/581790080 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe898066f60 0x7fe898069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.243+0000 7fe8bbe00640 1 --2- 172.21.15.173:0/581790080 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe898066f60 0x7fe898069420 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac0ad000 tx=0x7fe8ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:09.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.247+0000 7fe8b8c00640 1 -- 172.21.15.173:0/581790080 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe8bc15c5f0 con 0x7fe8bc145290 2024-04-25T09:11:09.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.399+0000 7fe8c2c00640 1 -- 172.21.15.173:0/581790080 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8bc06b350 con 0x7fe8bc145290 2024-04-25T09:11:09.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.403+0000 7fe8b8c00640 1 -- 172.21.15.173:0/581790080 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v111) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe8b4055630 con 0x7fe8bc145290 2024-04-25T09:11:09.390 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:11:09.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.403+0000 7fe8c2c00640 1 -- 172.21.15.173:0/581790080 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe898066f60 msgr2=0x7fe898069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.403+0000 7fe8c2c00640 1 --2- 172.21.15.173:0/581790080 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe898066f60 0x7fe898069420 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac0ad000 tx=0x7fe8ac008040 comp rx=0 tx=0).stop 2024-04-25T09:11:09.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.403+0000 7fe8c2c00640 1 -- 172.21.15.173:0/581790080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8bc145290 msgr2=0x7fe8bc0ad720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.403+0000 7fe8c2c00640 1 --2- 172.21.15.173:0/581790080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8bc145290 0x7fe8bc0ad720 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400cbc0 tx=0x7fe8b400a430 comp rx=0 tx=0).stop 2024-04-25T09:11:09.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.403+0000 7fe8c2c00640 1 -- 172.21.15.173:0/581790080 shutdown_connections 2024-04-25T09:11:09.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.403+0000 7fe8c2c00640 1 --2- 172.21.15.173:0/581790080 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe898066f60 0x7fe898069420 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.403+0000 7fe8c2c00640 1 --2- 172.21.15.173:0/581790080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8bc145290 0x7fe8bc0ad720 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.403+0000 7fe8c2c00640 1 --2- 172.21.15.173:0/581790080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8bc0cc260 0x7fe8bc1582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.403+0000 7fe8c2c00640 1 --2- 172.21.15.173:0/581790080 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8bc0b3fe0 0x7fe8bc15b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.403+0000 7fe8c2c00640 1 -- 172.21.15.173:0/581790080 >> 172.21.15.173:0/581790080 conn(0x7fe8bc06ac90 msgr2=0x7fe8bc15cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:09.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.403+0000 7fe8c2c00640 1 -- 172.21.15.173:0/581790080 shutdown_connections 2024-04-25T09:11:09.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.403+0000 7fe8c2c00640 1 -- 172.21.15.173:0/581790080 wait complete. 2024-04-25T09:11:09.411 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:11:09.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.559+0000 7fdbd7200640 1 Processor -- start 2024-04-25T09:11:09.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.559+0000 7fdbd7200640 1 -- start start 2024-04-25T09:11:09.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.563+0000 7fdbd7200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdbd00cff40 0x7fdbd00cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.563+0000 7fdbd7200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbd015a2e0 0x7fdbd00cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.563+0000 7fdbd7200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd015ddd0 con 0x7fdbd0159f00 2024-04-25T09:11:09.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.563+0000 7fdbd7200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd0072330 con 0x7fdbd00cff40 2024-04-25T09:11:09.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.563+0000 7fdbd7200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd015e0b0 con 0x7fdbd015a2e0 2024-04-25T09:11:09.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.563+0000 7fdbd5200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbd015a2e0 0x7fdbd00cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.563+0000 7fdbc7400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdbd00cff40 0x7fdbd00cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.563+0000 7fdbc7400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdbd00cff40 0x7fdbd00cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:59638/0 (socket says 172.21.15.173:59638) 2024-04-25T09:11:09.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.563+0000 7fdbc7400640 1 -- 172.21.15.173:0/534936799 learned_addr learned my addr 172.21.15.173:0/534936799 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:09.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.563+0000 7fdbd5200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbd015a2e0 0x7fdbd00cd830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:38698/0 (socket says 172.21.15.173:38698) 2024-04-25T09:11:09.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.563+0000 7fdbc7400640 1 -- 172.21.15.173:0/534936799 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbd015a2e0 msgr2=0x7fdbd00cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:09.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.563+0000 7fdbc7400640 1 --2- 172.21.15.173:0/534936799 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbd015a2e0 0x7fdbd00cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.563+0000 7fdbc7400640 1 -- 172.21.15.173:0/534936799 >> v1:172.21.15.194:6789/0 conn(0x7fdbd0159f00 legacy=0x7fdbd00cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.563+0000 7fdbc7400640 1 -- 172.21.15.173:0/534936799 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd015e390 con 0x7fdbd00cff40 2024-04-25T09:11:09.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.567+0000 7fdbc7400640 1 --2- 172.21.15.173:0/534936799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd00cff40 0x7fdbd00cd2f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009870 tx=0x7fdbc001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a4713cc77af86d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:09.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.567+0000 7fdbcf400640 1 -- 172.21.15.173:0/534936799 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc00a7070 con 0x7fdbd00cff40 2024-04-25T09:11:09.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.567+0000 7fdbcf400640 1 -- 172.21.15.173:0/534936799 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc00b0070 con 0x7fdbd00cff40 2024-04-25T09:11:09.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.567+0000 7fdbcf400640 1 -- 172.21.15.173:0/534936799 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc00ab890 con 0x7fdbd00cff40 2024-04-25T09:11:09.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.567+0000 7fdbd7200640 1 -- 172.21.15.173:0/534936799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd00cff40 msgr2=0x7fdbd00cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.567+0000 7fdbd7200640 1 --2- 172.21.15.173:0/534936799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd00cff40 0x7fdbd00cd2f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009870 tx=0x7fdbc001c560 comp rx=0 tx=0).stop 2024-04-25T09:11:09.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.567+0000 7fdbd7200640 1 -- 172.21.15.173:0/534936799 shutdown_connections 2024-04-25T09:11:09.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.567+0000 7fdbd7200640 1 --2- 172.21.15.173:0/534936799 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbd015a2e0 0x7fdbd00cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.567+0000 7fdbd7200640 1 --2- 172.21.15.173:0/534936799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd00cff40 0x7fdbd00cd2f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.567+0000 7fdbd7200640 1 -- 172.21.15.173:0/534936799 >> 172.21.15.173:0/534936799 conn(0x7fdbd006ac90 msgr2=0x7fdbd006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:09.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.567+0000 7fdbd7200640 1 -- 172.21.15.173:0/534936799 shutdown_connections 2024-04-25T09:11:09.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.567+0000 7fdbd7200640 1 -- 172.21.15.173:0/534936799 wait complete. 2024-04-25T09:11:09.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.567+0000 7fdbd7200640 1 Processor -- start 2024-04-25T09:11:09.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.567+0000 7fdbd7200640 1 -- start start 2024-04-25T09:11:09.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbd7200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbd00cff40 0x7fdbd0156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbd7200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbd0159f00 0x7fdbd014d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbd7200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd015a2e0 0x7fdbd00b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbd7200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd00716b0 con 0x7fdbd0159f00 2024-04-25T09:11:09.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbd7200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd0071530 con 0x7fdbd015a2e0 2024-04-25T09:11:09.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbd7200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd0071830 con 0x7fdbd00cff40 2024-04-25T09:11:09.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbc7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbd0159f00 0x7fdbd014d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbc7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbd0159f00 0x7fdbd014d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44410/0 (socket says 172.21.15.173:44410) 2024-04-25T09:11:09.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbc7400640 1 -- 172.21.15.173:0/1827860953 learned_addr learned my addr 172.21.15.173:0/1827860953 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:09.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbcfe00640 1 --2- 172.21.15.173:0/1827860953 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbd00cff40 0x7fdbd0156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbd5200640 1 --2- 172.21.15.173:0/1827860953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd015a2e0 0x7fdbd00b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbc7400640 1 -- 172.21.15.173:0/1827860953 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbd00cff40 msgr2=0x7fdbd0156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbc7400640 1 --2- 172.21.15.173:0/1827860953 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbd00cff40 0x7fdbd0156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbc7400640 1 -- 172.21.15.173:0/1827860953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd015a2e0 msgr2=0x7fdbd00b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbc7400640 1 --2- 172.21.15.173:0/1827860953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd015a2e0 0x7fdbd00b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbc7400640 1 -- 172.21.15.173:0/1827860953 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd014d950 con 0x7fdbd0159f00 2024-04-25T09:11:09.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbc7400640 1 --2- 172.21.15.173:0/1827860953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbd0159f00 0x7fdbd014d410 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fdbc001ac10 tx=0x7fdbc001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:09.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbccc00640 1 -- 172.21.15.173:0/1827860953 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc00be5f0 con 0x7fdbd0159f00 2024-04-25T09:11:09.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbccc00640 1 -- 172.21.15.173:0/1827860953 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc00be790 con 0x7fdbd0159f00 2024-04-25T09:11:09.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbccc00640 1 -- 172.21.15.173:0/1827860953 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc00beb80 con 0x7fdbd0159f00 2024-04-25T09:11:09.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbd7200640 1 -- 172.21.15.173:0/1827860953 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd01567e0 con 0x7fdbd0159f00 2024-04-25T09:11:09.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbd7200640 1 -- 172.21.15.173:0/1827860953 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd0151790 con 0x7fdbd0159f00 2024-04-25T09:11:09.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.571+0000 7fdbd7200640 1 -- 172.21.15.173:0/1827860953 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd0073ab0 con 0x7fdbd0159f00 2024-04-25T09:11:09.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.575+0000 7fdbccc00640 1 -- 172.21.15.173:0/1827860953 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdbc00c7440 con 0x7fdbd0159f00 2024-04-25T09:11:09.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.575+0000 7fdbccc00640 1 --2- 172.21.15.173:0/1827860953 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdbac066f90 0x7fdbac069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.575+0000 7fdbccc00640 1 -- 172.21.15.173:0/1827860953 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fdbc011fb20 con 0x7fdbd0159f00 2024-04-25T09:11:09.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.575+0000 7fdbcfe00640 1 --2- 172.21.15.173:0/1827860953 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdbac066f90 0x7fdbac069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.575+0000 7fdbcfe00640 1 --2- 172.21.15.173:0/1827860953 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdbac066f90 0x7fdbac069450 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0158f00 tx=0x7fdbb8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:09.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.579+0000 7fdbccc00640 1 -- 172.21.15.173:0/1827860953 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdbd01567e0 con 0x7fdbd0159f00 2024-04-25T09:11:09.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.734+0000 7fdbd7200640 1 -- 172.21.15.173:0/1827860953 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdbd00ae8d0 con 0x7fdbd0159f00 2024-04-25T09:11:09.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.734+0000 7fdbccc00640 1 -- 172.21.15.173:0/1827860953 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v111) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdbc0016150 con 0x7fdbd0159f00 2024-04-25T09:11:09.724 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:11:09.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.738+0000 7fdbd7200640 1 -- 172.21.15.173:0/1827860953 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdbac066f90 msgr2=0x7fdbac069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.738+0000 7fdbd7200640 1 --2- 172.21.15.173:0/1827860953 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdbac066f90 0x7fdbac069450 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0158f00 tx=0x7fdbb8009040 comp rx=0 tx=0).stop 2024-04-25T09:11:09.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.738+0000 7fdbd7200640 1 -- 172.21.15.173:0/1827860953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbd0159f00 msgr2=0x7fdbd014d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.738+0000 7fdbd7200640 1 --2- 172.21.15.173:0/1827860953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbd0159f00 0x7fdbd014d410 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fdbc001ac10 tx=0x7fdbc001ada0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.738+0000 7fdbd7200640 1 -- 172.21.15.173:0/1827860953 shutdown_connections 2024-04-25T09:11:09.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.738+0000 7fdbd7200640 1 --2- 172.21.15.173:0/1827860953 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdbac066f90 0x7fdbac069450 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.738+0000 7fdbd7200640 1 --2- 172.21.15.173:0/1827860953 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd015a2e0 0x7fdbd00b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.738+0000 7fdbd7200640 1 --2- 172.21.15.173:0/1827860953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbd0159f00 0x7fdbd014d410 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.738+0000 7fdbd7200640 1 --2- 172.21.15.173:0/1827860953 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbd00cff40 0x7fdbd0156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.738+0000 7fdbd7200640 1 -- 172.21.15.173:0/1827860953 >> 172.21.15.173:0/1827860953 conn(0x7fdbd006ac90 msgr2=0x7fdbd01501d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:09.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.738+0000 7fdbd7200640 1 -- 172.21.15.173:0/1827860953 shutdown_connections 2024-04-25T09:11:09.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.738+0000 7fdbd7200640 1 -- 172.21.15.173:0/1827860953 wait complete. 2024-04-25T09:11:09.746 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:11:09.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.890+0000 7ff11be00640 1 Processor -- start 2024-04-25T09:11:09.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.890+0000 7ff11be00640 1 -- start start 2024-04-25T09:11:09.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.894+0000 7ff11be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff114145290 0x7ff11415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.894+0000 7ff11be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1140b3fe0 0x7ff1140b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.894+0000 7ff11be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff1140cc260 0x7ff1140cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.894+0000 7ff11be00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11415c5f0 con 0x7ff1140cc260 2024-04-25T09:11:09.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.894+0000 7ff11be00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11406d4b0 con 0x7ff114145290 2024-04-25T09:11:09.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.894+0000 7ff11be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11406d790 con 0x7ff1140b3fe0 2024-04-25T09:11:09.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.894+0000 7ff119e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff1140cc260 0x7ff1140cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.894+0000 7ff119e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff1140cc260 0x7ff1140cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44416/0 (socket says 172.21.15.173:44416) 2024-04-25T09:11:09.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.894+0000 7ff119e00640 1 -- 172.21.15.173:0/1554906343 learned_addr learned my addr 172.21.15.173:0/1554906343 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:09.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.894+0000 7ff118a00640 1 --2- 172.21.15.173:0/1554906343 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1140b3fe0 0x7ff1140b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.894+0000 7ff119400640 1 --2- 172.21.15.173:0/1554906343 >> v2:172.21.15.194:3300/0 conn(0x7ff114145290 0x7ff11415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.894+0000 7ff119e00640 1 -- 172.21.15.173:0/1554906343 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1140b3fe0 msgr2=0x7ff1140b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:09.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.894+0000 7ff119e00640 1 --2- 172.21.15.173:0/1554906343 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1140b3fe0 0x7ff1140b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.894+0000 7ff119e00640 1 -- 172.21.15.173:0/1554906343 >> v2:172.21.15.194:3300/0 conn(0x7ff114145290 msgr2=0x7ff11415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:09.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.894+0000 7ff119e00640 1 --2- 172.21.15.173:0/1554906343 >> v2:172.21.15.194:3300/0 conn(0x7ff114145290 0x7ff11415c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.894+0000 7ff119e00640 1 -- 172.21.15.173:0/1554906343 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11406da70 con 0x7ff1140cc260 2024-04-25T09:11:09.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.898+0000 7ff119e00640 1 --2- 172.21.15.173:0/1554906343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1140cc260 0x7ff1140cc6b0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7ff1140d0800 tx=0x7ff10c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27e876397de75aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:09.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.898+0000 7ff113e00640 1 -- 172.21.15.173:0/1554906343 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c0a5660 con 0x7ff1140cc260 2024-04-25T09:11:09.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.898+0000 7ff113e00640 1 -- 172.21.15.173:0/1554906343 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10c0a5800 con 0x7ff1140cc260 2024-04-25T09:11:09.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.898+0000 7ff113e00640 1 -- 172.21.15.173:0/1554906343 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c0a5bd0 con 0x7ff1140cc260 2024-04-25T09:11:09.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.898+0000 7ff11be00640 1 -- 172.21.15.173:0/1554906343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1140cc260 msgr2=0x7ff1140cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.898+0000 7ff11be00640 1 --2- 172.21.15.173:0/1554906343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1140cc260 0x7ff1140cc6b0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7ff1140d0800 tx=0x7ff10c01c8d0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.898+0000 7ff11be00640 1 -- 172.21.15.173:0/1554906343 shutdown_connections 2024-04-25T09:11:09.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.898+0000 7ff11be00640 1 --2- 172.21.15.173:0/1554906343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1140cc260 0x7ff1140cc6b0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.898+0000 7ff11be00640 1 --2- 172.21.15.173:0/1554906343 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1140b3fe0 0x7ff1140b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.898+0000 7ff11be00640 1 --2- 172.21.15.173:0/1554906343 >> v2:172.21.15.194:3300/0 conn(0x7ff114145290 0x7ff11415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.898+0000 7ff11be00640 1 -- 172.21.15.173:0/1554906343 >> 172.21.15.173:0/1554906343 conn(0x7ff11406ac90 msgr2=0x7ff11406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:09.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.898+0000 7ff11be00640 1 -- 172.21.15.173:0/1554906343 shutdown_connections 2024-04-25T09:11:09.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.898+0000 7ff11be00640 1 -- 172.21.15.173:0/1554906343 wait complete. 2024-04-25T09:11:09.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.898+0000 7ff11be00640 1 Processor -- start 2024-04-25T09:11:09.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.898+0000 7ff11be00640 1 -- start start 2024-04-25T09:11:09.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff11be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1140b3fe0 0x7ff1140ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff11be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1140cc260 0x7ff1140ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff11be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff114145290 0x7ff1140ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff11be00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1141457f0 con 0x7ff1140b3fe0 2024-04-25T09:11:09.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff11be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff114145670 con 0x7ff1140cc260 2024-04-25T09:11:09.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff11be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11406ed60 con 0x7ff114145290 2024-04-25T09:11:09.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff119400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1140b3fe0 0x7ff1140ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff119400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1140b3fe0 0x7ff1140ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44430/0 (socket says 172.21.15.173:44430) 2024-04-25T09:11:09.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff119400640 1 -- 172.21.15.173:0/3714207460 learned_addr learned my addr 172.21.15.173:0/3714207460 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:09.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff119e00640 1 --2- 172.21.15.173:0/3714207460 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff114145290 0x7ff1140ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff118a00640 1 --2- 172.21.15.173:0/3714207460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1140cc260 0x7ff1140ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff119400640 1 -- 172.21.15.173:0/3714207460 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff114145290 msgr2=0x7ff1140ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff119400640 1 --2- 172.21.15.173:0/3714207460 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff114145290 0x7ff1140ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff119400640 1 -- 172.21.15.173:0/3714207460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1140cc260 msgr2=0x7ff1140ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff119400640 1 --2- 172.21.15.173:0/3714207460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1140cc260 0x7ff1140ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff119400640 1 -- 172.21.15.173:0/3714207460 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1140cf200 con 0x7ff1140b3fe0 2024-04-25T09:11:09.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff119e00640 1 --2- 172.21.15.173:0/3714207460 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff114145290 0x7ff1140ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:09.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff119400640 1 --2- 172.21.15.173:0/3714207460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1140b3fe0 0x7ff1140ce3f0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7ff10800e870 tx=0x7ff10800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:09.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff111600640 1 -- 172.21.15.173:0/3714207460 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff108017070 con 0x7ff1140b3fe0 2024-04-25T09:11:09.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff111600640 1 -- 172.21.15.173:0/3714207460 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10800c940 con 0x7ff1140b3fe0 2024-04-25T09:11:09.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff11be00640 1 -- 172.21.15.173:0/3714207460 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1140ad430 con 0x7ff1140b3fe0 2024-04-25T09:11:09.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff111600640 1 -- 172.21.15.173:0/3714207460 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10800ccf0 con 0x7ff1140b3fe0 2024-04-25T09:11:09.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff11be00640 1 -- 172.21.15.173:0/3714207460 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1140adcd0 con 0x7ff1140b3fe0 2024-04-25T09:11:09.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff11be00640 1 -- 172.21.15.173:0/3714207460 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff114073ab0 con 0x7ff1140b3fe0 2024-04-25T09:11:09.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.902+0000 7ff111600640 1 -- 172.21.15.173:0/3714207460 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff10801a070 con 0x7ff1140b3fe0 2024-04-25T09:11:09.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.906+0000 7ff111600640 1 --2- 172.21.15.173:0/3714207460 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff0f4066f60 0x7ff0f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.906+0000 7ff111600640 1 -- 172.21.15.173:0/3714207460 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7ff1080850c0 con 0x7ff1140b3fe0 2024-04-25T09:11:09.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.906+0000 7ff118a00640 1 --2- 172.21.15.173:0/3714207460 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff0f4066f60 0x7ff0f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.906+0000 7ff118a00640 1 --2- 172.21.15.173:0/3714207460 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff0f4066f60 0x7ff0f4069420 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff1141f9e00 tx=0x7ff100008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:09.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:09.910+0000 7ff111600640 1 -- 172.21.15.173:0/3714207460 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff108055f20 con 0x7ff1140b3fe0 2024-04-25T09:11:10.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:10.074+0000 7ff11be00640 1 -- 172.21.15.173:0/3714207460 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff11415bd90 con 0x7ff1140b3fe0 2024-04-25T09:11:10.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:10.074+0000 7ff111600640 1 -- 172.21.15.173:0/3714207460 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v111) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff108055820 con 0x7ff1140b3fe0 2024-04-25T09:11:10.064 INFO:teuthology.orchestra.run.smithi173.stderr:listed 0 entries 2024-04-25T09:11:10.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:10.074+0000 7ff11be00640 1 -- 172.21.15.173:0/3714207460 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff0f4066f60 msgr2=0x7ff0f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:10.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:10.074+0000 7ff11be00640 1 --2- 172.21.15.173:0/3714207460 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff0f4066f60 0x7ff0f4069420 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff1141f9e00 tx=0x7ff100008040 comp rx=0 tx=0).stop 2024-04-25T09:11:10.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:10.074+0000 7ff11be00640 1 -- 172.21.15.173:0/3714207460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1140b3fe0 msgr2=0x7ff1140ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:10.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:10.074+0000 7ff11be00640 1 --2- 172.21.15.173:0/3714207460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1140b3fe0 0x7ff1140ce3f0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7ff10800e870 tx=0x7ff10800ec70 comp rx=0 tx=0).stop 2024-04-25T09:11:10.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:10.074+0000 7ff11be00640 1 -- 172.21.15.173:0/3714207460 shutdown_connections 2024-04-25T09:11:10.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:10.074+0000 7ff11be00640 1 --2- 172.21.15.173:0/3714207460 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff0f4066f60 0x7ff0f4069420 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:10.074+0000 7ff11be00640 1 --2- 172.21.15.173:0/3714207460 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff114145290 0x7ff1140ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:10.074+0000 7ff11be00640 1 --2- 172.21.15.173:0/3714207460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1140cc260 0x7ff1140ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:10.074+0000 7ff11be00640 1 --2- 172.21.15.173:0/3714207460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1140b3fe0 0x7ff1140ce3f0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:10.074+0000 7ff11be00640 1 -- 172.21.15.173:0/3714207460 >> 172.21.15.173:0/3714207460 conn(0x7ff11406ac90 msgr2=0x7ff11415cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:10.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:10.074+0000 7ff11be00640 1 -- 172.21.15.173:0/3714207460 shutdown_connections 2024-04-25T09:11:10.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:10.074+0000 7ff11be00640 1 -- 172.21.15.173:0/3714207460 wait complete. 2024-04-25T09:11:10.085 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:11:10.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:10.085 DEBUG:teuthology.orchestra.run.smithi173:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:10.790 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:11:10.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:10.790 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:11:10.799 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:11:10.799 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:10.809 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:11:10.809 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:11:10.809 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:10.853 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:11:10.853 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:11:10.853 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:10.863 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:11:10.863 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:11.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.046+0000 7f1247a00640 1 Processor -- start 2024-04-25T09:11:11.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.046+0000 7f1247a00640 1 -- start start 2024-04-25T09:11:11.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.046+0000 7f1247a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f124015dc60 0x7f12400b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.046+0000 7f1247a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f12400ae810 0x7f12400aec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.046+0000 7f1247a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12400af160 con 0x7f124015e040 2024-04-25T09:11:11.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.046+0000 7f1247a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1240071450 con 0x7f12400ae810 2024-04-25T09:11:11.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.046+0000 7f1247a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f124015e8e0 con 0x7f124015dc60 2024-04-25T09:11:11.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.046+0000 7f1245a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f12400ae810 0x7f12400aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.046+0000 7f1245a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f12400ae810 0x7f12400aec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44440/0 (socket says 172.21.15.173:44440) 2024-04-25T09:11:11.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.046+0000 7f1245a00640 1 -- 172.21.15.173:0/297028626 learned_addr learned my addr 172.21.15.173:0/297028626 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:11.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.046+0000 7f123fe00640 1 --1- 172.21.15.173:0/297028626 >> v1:172.21.15.173:6789/0 conn(0x7f124015e040 0x7f12400ace10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44362/0 (socket says 172.21.15.173:44362) 2024-04-25T09:11:11.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.046+0000 7f1245000640 1 --2- 172.21.15.173:0/297028626 >> v2:172.21.15.194:3300/0 conn(0x7f124015dc60 0x7f12400b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.046+0000 7f1245a00640 1 -- 172.21.15.173:0/297028626 >> v2:172.21.15.194:3300/0 conn(0x7f124015dc60 msgr2=0x7f12400b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:11.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.046+0000 7f1245a00640 1 --2- 172.21.15.173:0/297028626 >> v2:172.21.15.194:3300/0 conn(0x7f124015dc60 0x7f12400b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.046+0000 7f1245a00640 1 -- 172.21.15.173:0/297028626 >> v1:172.21.15.173:6789/0 conn(0x7f124015e040 legacy=0x7f12400ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.046+0000 7f1245a00640 1 -- 172.21.15.173:0/297028626 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124015ebc0 con 0x7f12400ae810 2024-04-25T09:11:11.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.046+0000 7f1245000640 1 --2- 172.21.15.173:0/297028626 >> v2:172.21.15.194:3300/0 conn(0x7f124015dc60 0x7f12400b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:11.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.046+0000 7f1245a00640 1 --2- 172.21.15.173:0/297028626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12400ae810 0x7f12400aec20 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f1240072730 tx=0x7f123801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e987042d9831d67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:11.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f123f400640 1 -- 172.21.15.173:0/297028626 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12380ab610 con 0x7f12400ae810 2024-04-25T09:11:11.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f123f400640 1 -- 172.21.15.173:0/297028626 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12380b0070 con 0x7f12400ae810 2024-04-25T09:11:11.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f123f400640 1 -- 172.21.15.173:0/297028626 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12380ab9d0 con 0x7f12400ae810 2024-04-25T09:11:11.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f1247a00640 1 -- 172.21.15.173:0/297028626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12400ae810 msgr2=0x7f12400aec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f1247a00640 1 --2- 172.21.15.173:0/297028626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12400ae810 0x7f12400aec20 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f1240072730 tx=0x7f123801c520 comp rx=0 tx=0).stop 2024-04-25T09:11:11.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f1247a00640 1 -- 172.21.15.173:0/297028626 shutdown_connections 2024-04-25T09:11:11.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f1247a00640 1 --2- 172.21.15.173:0/297028626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12400ae810 0x7f12400aec20 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f1247a00640 1 --2- 172.21.15.173:0/297028626 >> v2:172.21.15.194:3300/0 conn(0x7f124015dc60 0x7f12400b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f1247a00640 1 -- 172.21.15.173:0/297028626 >> 172.21.15.173:0/297028626 conn(0x7f124006ac90 msgr2=0x7f124006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:11.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f1247a00640 1 -- 172.21.15.173:0/297028626 shutdown_connections 2024-04-25T09:11:11.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f1247a00640 1 -- 172.21.15.173:0/297028626 wait complete. 2024-04-25T09:11:11.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f1247a00640 1 Processor -- start 2024-04-25T09:11:11.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f1247a00640 1 -- start start 2024-04-25T09:11:11.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f1247a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12400ae810 0x7f1240151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f1247a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f124015dc60 0x7f1240152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f1247a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f124015e040 0x7f12401512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f1247a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124015e450 con 0x7f124015dc60 2024-04-25T09:11:11.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f1247a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12400ad520 con 0x7f124015e040 2024-04-25T09:11:11.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f1247a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124015e5d0 con 0x7f12400ae810 2024-04-25T09:11:11.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f123fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f124015dc60 0x7f1240152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f123fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f124015dc60 0x7f1240152740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44456/0 (socket says 172.21.15.173:44456) 2024-04-25T09:11:11.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f123fe00640 1 -- 172.21.15.173:0/249636591 learned_addr learned my addr 172.21.15.173:0/249636591 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:11.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f1245000640 1 --2- 172.21.15.173:0/249636591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12400ae810 0x7f1240151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.050+0000 7f1245a00640 1 --2- 172.21.15.173:0/249636591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f124015e040 0x7f12401512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.054+0000 7f123fe00640 1 -- 172.21.15.173:0/249636591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12400ae810 msgr2=0x7f1240151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.054+0000 7f123fe00640 1 --2- 172.21.15.173:0/249636591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12400ae810 0x7f1240151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.054+0000 7f123fe00640 1 -- 172.21.15.173:0/249636591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f124015e040 msgr2=0x7f12401512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.054+0000 7f123fe00640 1 --2- 172.21.15.173:0/249636591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f124015e040 0x7f12401512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.054+0000 7f123fe00640 1 -- 172.21.15.173:0/249636591 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12400aee00 con 0x7f124015dc60 2024-04-25T09:11:11.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.054+0000 7f123fe00640 1 --2- 172.21.15.173:0/249636591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f124015dc60 0x7f1240152740 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f122c00c370 tx=0x7f122c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:11.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.054+0000 7f123cc00640 1 -- 172.21.15.173:0/249636591 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c0074e0 con 0x7f124015dc60 2024-04-25T09:11:11.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.054+0000 7f123cc00640 1 -- 172.21.15.173:0/249636591 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c007680 con 0x7f124015dc60 2024-04-25T09:11:11.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.054+0000 7f123cc00640 1 -- 172.21.15.173:0/249636591 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c004a30 con 0x7f124015dc60 2024-04-25T09:11:11.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.054+0000 7f1247a00640 1 -- 172.21.15.173:0/249636591 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124015bad0 con 0x7f124015dc60 2024-04-25T09:11:11.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.054+0000 7f1247a00640 1 -- 172.21.15.173:0/249636591 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124015c090 con 0x7f124015dc60 2024-04-25T09:11:11.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.054+0000 7f1247a00640 1 -- 172.21.15.173:0/249636591 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1240073a40 con 0x7f124015dc60 2024-04-25T09:11:11.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.054+0000 7f123cc00640 1 -- 172.21.15.173:0/249636591 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f122c01a020 con 0x7f124015dc60 2024-04-25T09:11:11.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.058+0000 7f123cc00640 1 --2- 172.21.15.173:0/249636591 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1220066f60 0x7f1220069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.058+0000 7f123cc00640 1 -- 172.21.15.173:0/249636591 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f122c084900 con 0x7f124015dc60 2024-04-25T09:11:11.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.058+0000 7f1245000640 1 --2- 172.21.15.173:0/249636591 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1220066f60 0x7f1220069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.058+0000 7f1245000640 1 --2- 172.21.15.173:0/249636591 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1220066f60 0x7f1220069420 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1240156cf0 tx=0x7f1230007810 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:11.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.062+0000 7f123cc00640 1 -- 172.21.15.173:0/249636591 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f12400af160 con 0x7f124015dc60 2024-04-25T09:11:11.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.250+0000 7f1247a00640 1 -- 172.21.15.173:0/249636591 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f124015f450 con 0x7f124015dc60 2024-04-25T09:11:11.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.250+0000 7f123cc00640 1 -- 172.21.15.173:0/249636591 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f122c055070 con 0x7f124015dc60 2024-04-25T09:11:11.239 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:11.239 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1519522112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1519522112},{"type":"v1","addr":"172.21.15.194:6835","nonce":1519522112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7555,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/548680290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":548680290},{"type":"v1","addr":"172.21.15.173:6836","nonce":548680290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2602621503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2602621503},{"type":"v1","addr":"172.21.15.194:6833","nonce":2602621503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:24.354981+0000","modified":"2024-04-25T09:10:27.392053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/1492125936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":1492125936},{"type":"v1","addr":"172.21.15.173:6837","nonce":1492125936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:11:11.239 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 72 2024-04-25T09:11:11.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.250+0000 7f1247a00640 1 -- 172.21.15.173:0/249636591 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1220066f60 msgr2=0x7f1220069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.250+0000 7f1247a00640 1 --2- 172.21.15.173:0/249636591 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1220066f60 0x7f1220069420 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1240156cf0 tx=0x7f1230007810 comp rx=0 tx=0).stop 2024-04-25T09:11:11.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.250+0000 7f1247a00640 1 -- 172.21.15.173:0/249636591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f124015dc60 msgr2=0x7f1240152740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.250+0000 7f1247a00640 1 --2- 172.21.15.173:0/249636591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f124015dc60 0x7f1240152740 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f122c00c370 tx=0x7f122c00c830 comp rx=0 tx=0).stop 2024-04-25T09:11:11.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.250+0000 7f1247a00640 1 -- 172.21.15.173:0/249636591 shutdown_connections 2024-04-25T09:11:11.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.250+0000 7f1247a00640 1 --2- 172.21.15.173:0/249636591 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1220066f60 0x7f1220069420 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.250+0000 7f1247a00640 1 --2- 172.21.15.173:0/249636591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f124015e040 0x7f12401512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.250+0000 7f1247a00640 1 --2- 172.21.15.173:0/249636591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f124015dc60 0x7f1240152740 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.250+0000 7f1247a00640 1 --2- 172.21.15.173:0/249636591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12400ae810 0x7f1240151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.250+0000 7f1247a00640 1 -- 172.21.15.173:0/249636591 >> 172.21.15.173:0/249636591 conn(0x7f124006ac90 msgr2=0x7f12400720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:11.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.250+0000 7f1247a00640 1 -- 172.21.15.173:0/249636591 shutdown_connections 2024-04-25T09:11:11.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.250+0000 7f1247a00640 1 -- 172.21.15.173:0/249636591 wait complete. 2024-04-25T09:11:11.260 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:11.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.406+0000 7fdf6f800640 1 Processor -- start 2024-04-25T09:11:11.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.406+0000 7fdf6f800640 1 -- start start 2024-04-25T09:11:11.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.406+0000 7fdf6f800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdf680b3e70 0x7fdf680b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.406+0000 7fdf6f800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdf6815edd0 0x7fdf680b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.406+0000 7fdf6f800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf680b4790 con 0x7fdf680aefa0 2024-04-25T09:11:11.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.406+0000 7fdf6f800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6806dd50 con 0x7fdf680b3e70 2024-04-25T09:11:11.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.406+0000 7fdf6f800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6815f320 con 0x7fdf6815edd0 2024-04-25T09:11:11.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.406+0000 7fdf6ce00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdf680b3e70 0x7fdf680b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.406+0000 7fdf6ce00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdf680b3e70 0x7fdf680b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44464/0 (socket says 172.21.15.173:44464) 2024-04-25T09:11:11.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.406+0000 7fdf6ce00640 1 -- 172.21.15.173:0/473740705 learned_addr learned my addr 172.21.15.173:0/473740705 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:11.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.406+0000 7fdf5fe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fdf680aefa0 0x7fdf680b2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44364/0 (socket says 172.21.15.173:44364) 2024-04-25T09:11:11.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.406+0000 7fdf6d800640 1 --2- 172.21.15.173:0/473740705 >> v2:172.21.15.194:3300/0 conn(0x7fdf6815edd0 0x7fdf680b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.406+0000 7fdf6ce00640 1 -- 172.21.15.173:0/473740705 >> v2:172.21.15.194:3300/0 conn(0x7fdf6815edd0 msgr2=0x7fdf680b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:11.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.406+0000 7fdf6ce00640 1 --2- 172.21.15.173:0/473740705 >> v2:172.21.15.194:3300/0 conn(0x7fdf6815edd0 0x7fdf680b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.406+0000 7fdf6ce00640 1 -- 172.21.15.173:0/473740705 >> v1:172.21.15.173:6789/0 conn(0x7fdf680aefa0 legacy=0x7fdf680b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.406+0000 7fdf6ce00640 1 -- 172.21.15.173:0/473740705 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6806d420 con 0x7fdf680b3e70 2024-04-25T09:11:11.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.406+0000 7fdf67e00640 1 -- 172.21.15.173:0/473740705 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327124175 0 0) 0x7fdf680b4790 con 0x7fdf680aefa0 2024-04-25T09:11:11.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.410+0000 7fdf6ce00640 1 --2- 172.21.15.173:0/473740705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf680b3e70 0x7fdf680b4250 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fdf6806ef40 tx=0x7fdf5801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380938676a880132 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:11.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.410+0000 7fdf67e00640 1 -- 172.21.15.173:0/473740705 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf580aa670 con 0x7fdf680b3e70 2024-04-25T09:11:11.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.410+0000 7fdf67e00640 1 -- 172.21.15.173:0/473740705 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf580af070 con 0x7fdf680b3e70 2024-04-25T09:11:11.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.410+0000 7fdf67e00640 1 -- 172.21.15.173:0/473740705 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf580aaa30 con 0x7fdf680b3e70 2024-04-25T09:11:11.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.410+0000 7fdf6f800640 1 -- 172.21.15.173:0/473740705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf680b3e70 msgr2=0x7fdf680b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.410+0000 7fdf6f800640 1 --2- 172.21.15.173:0/473740705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf680b3e70 0x7fdf680b4250 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fdf6806ef40 tx=0x7fdf5801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.410+0000 7fdf6f800640 1 -- 172.21.15.173:0/473740705 shutdown_connections 2024-04-25T09:11:11.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.410+0000 7fdf6f800640 1 --2- 172.21.15.173:0/473740705 >> v2:172.21.15.194:3300/0 conn(0x7fdf6815edd0 0x7fdf680b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.410+0000 7fdf6f800640 1 --2- 172.21.15.173:0/473740705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf680b3e70 0x7fdf680b4250 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.410+0000 7fdf6f800640 1 -- 172.21.15.173:0/473740705 >> 172.21.15.173:0/473740705 conn(0x7fdf6806ac90 msgr2=0x7fdf6806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:11.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.410+0000 7fdf6f800640 1 -- 172.21.15.173:0/473740705 shutdown_connections 2024-04-25T09:11:11.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.410+0000 7fdf6f800640 1 -- 172.21.15.173:0/473740705 wait complete. 2024-04-25T09:11:11.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6f800640 1 Processor -- start 2024-04-25T09:11:11.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6f800640 1 -- start start 2024-04-25T09:11:11.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6f800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf680aefa0 0x7fdf6813b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6f800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf680b3e70 0x7fdf6814dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6f800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf6815edd0 0x7fdf6814b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6f800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6806e1e0 con 0x7fdf680aefa0 2024-04-25T09:11:11.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6f800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6815aba0 con 0x7fdf680b3e70 2024-04-25T09:11:11.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6f800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6806e360 con 0x7fdf6815edd0 2024-04-25T09:11:11.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6ce00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf680aefa0 0x7fdf6813b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6ce00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf680aefa0 0x7fdf6813b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44472/0 (socket says 172.21.15.173:44472) 2024-04-25T09:11:11.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6ce00640 1 -- 172.21.15.173:0/2555465964 learned_addr learned my addr 172.21.15.173:0/2555465964 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:11.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf5fe00640 1 --2- 172.21.15.173:0/2555465964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf680b3e70 0x7fdf6814dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6d800640 1 --2- 172.21.15.173:0/2555465964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf6815edd0 0x7fdf6814b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6ce00640 1 -- 172.21.15.173:0/2555465964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf6815edd0 msgr2=0x7fdf6814b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6ce00640 1 --2- 172.21.15.173:0/2555465964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf6815edd0 0x7fdf6814b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6ce00640 1 -- 172.21.15.173:0/2555465964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf680b3e70 msgr2=0x7fdf6814dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6ce00640 1 --2- 172.21.15.173:0/2555465964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf680b3e70 0x7fdf6814dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6ce00640 1 -- 172.21.15.173:0/2555465964 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6806ebb0 con 0x7fdf680aefa0 2024-04-25T09:11:11.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6d800640 1 --2- 172.21.15.173:0/2555465964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf6815edd0 0x7fdf6814b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:11.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf5fe00640 1 --2- 172.21.15.173:0/2555465964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf680b3e70 0x7fdf6814dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:11.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6ce00640 1 --2- 172.21.15.173:0/2555465964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf680aefa0 0x7fdf6813b000 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fdf580ac040 tx=0x7fdf5801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:11.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf65600640 1 -- 172.21.15.173:0/2555465964 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf580bd5f0 con 0x7fdf680aefa0 2024-04-25T09:11:11.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf65600640 1 -- 172.21.15.173:0/2555465964 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf580bd7b0 con 0x7fdf680aefa0 2024-04-25T09:11:11.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf65600640 1 -- 172.21.15.173:0/2555465964 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf580bdba0 con 0x7fdf680aefa0 2024-04-25T09:11:11.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6f800640 1 -- 172.21.15.173:0/2555465964 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf6815ba00 con 0x7fdf680aefa0 2024-04-25T09:11:11.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6f800640 1 -- 172.21.15.173:0/2555465964 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6814b1c0 con 0x7fdf680aefa0 2024-04-25T09:11:11.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.414+0000 7fdf6f800640 1 -- 172.21.15.173:0/2555465964 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf68073a40 con 0x7fdf680aefa0 2024-04-25T09:11:11.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.418+0000 7fdf65600640 1 -- 172.21.15.173:0/2555465964 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdf580b33f0 con 0x7fdf680aefa0 2024-04-25T09:11:11.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.418+0000 7fdf65600640 1 --2- 172.21.15.173:0/2555465964 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdf44066f90 0x7fdf44069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.418+0000 7fdf65600640 1 -- 172.21.15.173:0/2555465964 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fdf5811fb40 con 0x7fdf680aefa0 2024-04-25T09:11:11.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.418+0000 7fdf5fe00640 1 --2- 172.21.15.173:0/2555465964 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdf44066f90 0x7fdf44069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.418+0000 7fdf5fe00640 1 --2- 172.21.15.173:0/2555465964 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdf44066f90 0x7fdf44069450 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fdf6815dd10 tx=0x7fdf50007cb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:11.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.422+0000 7fdf65600640 1 -- 172.21.15.173:0/2555465964 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdf58016110 con 0x7fdf680aefa0 2024-04-25T09:11:11.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.574+0000 7fdf6f800640 1 -- 172.21.15.173:0/2555465964 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf6806f1c0 con 0x7fdf680aefa0 2024-04-25T09:11:11.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.574+0000 7fdf65600640 1 -- 172.21.15.173:0/2555465964 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16994 (secure 0 0 0) 0x7fdf580f0500 con 0x7fdf680aefa0 2024-04-25T09:11:11.565 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:11.565 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":111,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:10:34.497380+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:22.062377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:23.359080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.35","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:11.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.578+0000 7fdf6f800640 1 -- 172.21.15.173:0/2555465964 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdf44066f90 msgr2=0x7fdf44069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.578+0000 7fdf6f800640 1 --2- 172.21.15.173:0/2555465964 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdf44066f90 0x7fdf44069450 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fdf6815dd10 tx=0x7fdf50007cb0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.578+0000 7fdf6f800640 1 -- 172.21.15.173:0/2555465964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf680aefa0 msgr2=0x7fdf6813b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.578+0000 7fdf6f800640 1 --2- 172.21.15.173:0/2555465964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf680aefa0 0x7fdf6813b000 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fdf580ac040 tx=0x7fdf5801ad30 comp rx=0 tx=0).stop 2024-04-25T09:11:11.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.578+0000 7fdf6f800640 1 -- 172.21.15.173:0/2555465964 shutdown_connections 2024-04-25T09:11:11.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.578+0000 7fdf6f800640 1 --2- 172.21.15.173:0/2555465964 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdf44066f90 0x7fdf44069450 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.578+0000 7fdf6f800640 1 --2- 172.21.15.173:0/2555465964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf6815edd0 0x7fdf6814b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.578+0000 7fdf6f800640 1 --2- 172.21.15.173:0/2555465964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf680b3e70 0x7fdf6814dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.578+0000 7fdf6f800640 1 --2- 172.21.15.173:0/2555465964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf680aefa0 0x7fdf6813b000 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.578+0000 7fdf6f800640 1 -- 172.21.15.173:0/2555465964 >> 172.21.15.173:0/2555465964 conn(0x7fdf6806ac90 msgr2=0x7fdf681542e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:11.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.578+0000 7fdf6f800640 1 -- 172.21.15.173:0/2555465964 shutdown_connections 2024-04-25T09:11:11.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.578+0000 7fdf6f800640 1 -- 172.21.15.173:0/2555465964 wait complete. 2024-04-25T09:11:11.587 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:10:22.062377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:10:23.359080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:11:11.587 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:11:11.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f231e200640 1 Processor -- start 2024-04-25T09:11:11.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f231e200640 1 -- start start 2024-04-25T09:11:11.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f231e200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f231809a580 0x7f231806c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f231e200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23180d0100 con 0x7f23180cd910 2024-04-25T09:11:11.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f231e200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23180d03d0 con 0x7f231806ccf0 2024-04-25T09:11:11.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f231e200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23180cce10 con 0x7f231809a580 2024-04-25T09:11:11.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f2317400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f23180cd910 0x7f23180cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44366/0 (socket says 172.21.15.173:44366) 2024-04-25T09:11:11.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f2317400640 1 -- 172.21.15.173:0/3021046580 learned_addr learned my addr 172.21.15.173:0/3021046580 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:11.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f2316a00640 1 --2- 172.21.15.173:0/3021046580 >> v2:172.21.15.173:3300/0 conn(0x7f231809a580 0x7f231806c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f2316a00640 1 -- 172.21.15.173:0/3021046580 >> v1:172.21.15.194:6789/0 conn(0x7f231806ccf0 legacy=0x7f231815d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:11.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f2316a00640 1 -- 172.21.15.173:0/3021046580 >> v1:172.21.15.173:6789/0 conn(0x7f23180cd910 legacy=0x7f23180cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f2316a00640 1 -- 172.21.15.173:0/3021046580 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23180d06b0 con 0x7f231809a580 2024-04-25T09:11:11.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f2316000640 1 -- 172.21.15.173:0/3021046580 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43539801 0 0) 0x7f23180d0100 con 0x7f23180cd910 2024-04-25T09:11:11.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f2316a00640 1 --2- 172.21.15.173:0/3021046580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f231809a580 0x7f231806c7b0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f23040097f0 tx=0x7f230401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30680c113c40e4dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:11.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f2316000640 1 -- 172.21.15.173:0/3021046580 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23040b0070 con 0x7f231809a580 2024-04-25T09:11:11.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f2316000640 1 -- 172.21.15.173:0/3021046580 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23040ab600 con 0x7f231809a580 2024-04-25T09:11:11.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f2316000640 1 -- 172.21.15.173:0/3021046580 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23040ab9d0 con 0x7f231809a580 2024-04-25T09:11:11.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f231e200640 1 -- 172.21.15.173:0/3021046580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f231809a580 msgr2=0x7f231806c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f231e200640 1 --2- 172.21.15.173:0/3021046580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f231809a580 0x7f231806c7b0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f23040097f0 tx=0x7f230401c470 comp rx=0 tx=0).stop 2024-04-25T09:11:11.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f231e200640 1 -- 172.21.15.173:0/3021046580 shutdown_connections 2024-04-25T09:11:11.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f231e200640 1 --2- 172.21.15.173:0/3021046580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f231809a580 0x7f231806c7b0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f231e200640 1 -- 172.21.15.173:0/3021046580 >> 172.21.15.173:0/3021046580 conn(0x7f23180b32a0 msgr2=0x7f23180b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:11.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f231e200640 1 -- 172.21.15.173:0/3021046580 shutdown_connections 2024-04-25T09:11:11.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f231e200640 1 -- 172.21.15.173:0/3021046580 wait complete. 2024-04-25T09:11:11.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f231e200640 1 Processor -- start 2024-04-25T09:11:11.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.742+0000 7f231e200640 1 -- start start 2024-04-25T09:11:11.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f231e200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f231806ccf0 0x7f2318160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f231e200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f231809a580 0x7f231815fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f231e200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23180cd910 0x7f231814ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f231e200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23180d15f0 con 0x7f23180cd910 2024-04-25T09:11:11.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f231e200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23180d1470 con 0x7f231806ccf0 2024-04-25T09:11:11.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f231e200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231816bbc0 con 0x7f231809a580 2024-04-25T09:11:11.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f2317e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23180cd910 0x7f231814ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f2317e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23180cd910 0x7f231814ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44500/0 (socket says 172.21.15.173:44500) 2024-04-25T09:11:11.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f2317e00640 1 -- 172.21.15.173:0/242715894 learned_addr learned my addr 172.21.15.173:0/242715894 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:11.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f2317400640 1 --2- 172.21.15.173:0/242715894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f231806ccf0 0x7f2318160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f2316a00640 1 --2- 172.21.15.173:0/242715894 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f231809a580 0x7f231815fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f2317e00640 1 -- 172.21.15.173:0/242715894 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f231809a580 msgr2=0x7f231815fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f2317e00640 1 --2- 172.21.15.173:0/242715894 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f231809a580 0x7f231815fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f2317e00640 1 -- 172.21.15.173:0/242715894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f231806ccf0 msgr2=0x7f2318160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f2317e00640 1 --2- 172.21.15.173:0/242715894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f231806ccf0 0x7f2318160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f2317e00640 1 -- 172.21.15.173:0/242715894 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2318154850 con 0x7f23180cd910 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f2317400640 1 --2- 172.21.15.173:0/242715894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f231806ccf0 0x7f2318160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f2317e00640 1 --2- 172.21.15.173:0/242715894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23180cd910 0x7f231814ffa0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f231000c760 tx=0x7f231000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f230f400640 1 -- 172.21.15.173:0/242715894 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310003b80 con 0x7f23180cd910 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f230f400640 1 -- 172.21.15.173:0/242715894 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2310003d20 con 0x7f23180cd910 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f230f400640 1 -- 172.21.15.173:0/242715894 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231000aa30 con 0x7f23180cd910 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f231e200640 1 -- 172.21.15.173:0/242715894 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2318154b30 con 0x7f23180cd910 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f231e200640 1 -- 172.21.15.173:0/242715894 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2318155610 con 0x7f23180cd910 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f231e200640 1 -- 172.21.15.173:0/242715894 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2318073ab0 con 0x7f23180cd910 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.746+0000 7f230f400640 1 -- 172.21.15.173:0/242715894 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f231000abd0 con 0x7f23180cd910 2024-04-25T09:11:11.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.750+0000 7f230f400640 1 --2- 172.21.15.173:0/242715894 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f22f8066f60 0x7f22f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.750+0000 7f230f400640 1 -- 172.21.15.173:0/242715894 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f2310084fe0 con 0x7f23180cd910 2024-04-25T09:11:11.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.750+0000 7f2317400640 1 --2- 172.21.15.173:0/242715894 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f22f8066f60 0x7f22f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.750+0000 7f2317400640 1 --2- 172.21.15.173:0/242715894 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f22f8066f60 0x7f22f8069420 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2308000f70 tx=0x7f2308007c60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:11.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.754+0000 7f230f400640 1 -- 172.21.15.173:0/242715894 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2310055e50 con 0x7f23180cd910 2024-04-25T09:11:11.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.906+0000 7f231e200640 1 -- 172.21.15.173:0/242715894 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2318159d00 con 0x7f23180cd910 2024-04-25T09:11:11.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.906+0000 7f230f400640 1 -- 172.21.15.173:0/242715894 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2310055750 con 0x7f23180cd910 2024-04-25T09:11:11.897 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:11:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.910+0000 7f231e200640 1 -- 172.21.15.173:0/242715894 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f22f8066f60 msgr2=0x7f22f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.910+0000 7f231e200640 1 --2- 172.21.15.173:0/242715894 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f22f8066f60 0x7f22f8069420 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2308000f70 tx=0x7f2308007c60 comp rx=0 tx=0).stop 2024-04-25T09:11:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.910+0000 7f231e200640 1 -- 172.21.15.173:0/242715894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23180cd910 msgr2=0x7f231814ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.910+0000 7f231e200640 1 --2- 172.21.15.173:0/242715894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23180cd910 0x7f231814ffa0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f231000c760 tx=0x7f231000cc20 comp rx=0 tx=0).stop 2024-04-25T09:11:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.910+0000 7f231e200640 1 -- 172.21.15.173:0/242715894 shutdown_connections 2024-04-25T09:11:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.910+0000 7f231e200640 1 --2- 172.21.15.173:0/242715894 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f22f8066f60 0x7f22f8069420 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.910+0000 7f231e200640 1 --2- 172.21.15.173:0/242715894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23180cd910 0x7f231814ffa0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.910+0000 7f231e200640 1 --2- 172.21.15.173:0/242715894 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f231809a580 0x7f231815fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.910+0000 7f231e200640 1 --2- 172.21.15.173:0/242715894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f231806ccf0 0x7f2318160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.910+0000 7f231e200640 1 -- 172.21.15.173:0/242715894 >> 172.21.15.173:0/242715894 conn(0x7f23180b32a0 msgr2=0x7f2318158d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.910+0000 7f231e200640 1 -- 172.21.15.173:0/242715894 shutdown_connections 2024-04-25T09:11:11.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:11.910+0000 7f231e200640 1 -- 172.21.15.173:0/242715894 wait complete. 2024-04-25T09:11:11.918 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:11:12.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c53c00640 1 Processor -- start 2024-04-25T09:11:12.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c53c00640 1 -- start start 2024-04-25T09:11:12.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c53c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6c4c145290 0x7f6c4c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c53c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6c4c0b3fe0 0x7f6c4c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c53c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c4c0cc260 0x7f6c4c0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c53c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4c15c5f0 con 0x7f6c4c145290 2024-04-25T09:11:12.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c53c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4c06d4b0 con 0x7f6c4c0b3fe0 2024-04-25T09:11:12.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c53c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c06d790 con 0x7f6c4c0cc260 2024-04-25T09:11:12.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c51200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6c4c145290 0x7f6c4c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c51200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6c4c145290 0x7f6c4c15c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44510/0 (socket says 172.21.15.173:44510) 2024-04-25T09:11:12.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c51200640 1 -- 172.21.15.173:0/566851225 learned_addr learned my addr 172.21.15.173:0/566851225 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:12.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c51c00640 1 --2- 172.21.15.173:0/566851225 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c4c0cc260 0x7f6c4c0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c4be00640 1 --2- 172.21.15.173:0/566851225 >> v2:172.21.15.194:3300/0 conn(0x7f6c4c0b3fe0 0x7f6c4c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c51200640 1 -- 172.21.15.173:0/566851225 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c4c0cc260 msgr2=0x7f6c4c0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:12.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c51200640 1 --2- 172.21.15.173:0/566851225 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c4c0cc260 0x7f6c4c0cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c51200640 1 -- 172.21.15.173:0/566851225 >> v2:172.21.15.194:3300/0 conn(0x7f6c4c0b3fe0 msgr2=0x7f6c4c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:12.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c51200640 1 --2- 172.21.15.173:0/566851225 >> v2:172.21.15.194:3300/0 conn(0x7f6c4c0b3fe0 0x7f6c4c0b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c51200640 1 -- 172.21.15.173:0/566851225 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c06da70 con 0x7f6c4c145290 2024-04-25T09:11:12.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.070+0000 7f6c4be00640 1 --2- 172.21.15.173:0/566851225 >> v2:172.21.15.194:3300/0 conn(0x7f6c4c0b3fe0 0x7f6c4c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:12.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.074+0000 7f6c51200640 1 --2- 172.21.15.173:0/566851225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c145290 0x7f6c4c15c0b0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c071100 tx=0x7f6c3c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24c49e533e0e2fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:12.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.074+0000 7f6c4b400640 1 -- 172.21.15.173:0/566851225 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0b0070 con 0x7f6c4c145290 2024-04-25T09:11:12.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.074+0000 7f6c4b400640 1 -- 172.21.15.173:0/566851225 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c0ab600 con 0x7f6c4c145290 2024-04-25T09:11:12.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.074+0000 7f6c4b400640 1 -- 172.21.15.173:0/566851225 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0ab9d0 con 0x7f6c4c145290 2024-04-25T09:11:12.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.074+0000 7f6c53c00640 1 -- 172.21.15.173:0/566851225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c145290 msgr2=0x7f6c4c15c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.074+0000 7f6c53c00640 1 --2- 172.21.15.173:0/566851225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c145290 0x7f6c4c15c0b0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c071100 tx=0x7f6c3c01c400 comp rx=0 tx=0).stop 2024-04-25T09:11:12.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.074+0000 7f6c53c00640 1 -- 172.21.15.173:0/566851225 shutdown_connections 2024-04-25T09:11:12.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.074+0000 7f6c53c00640 1 --2- 172.21.15.173:0/566851225 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c4c0cc260 0x7f6c4c0cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.074+0000 7f6c53c00640 1 --2- 172.21.15.173:0/566851225 >> v2:172.21.15.194:3300/0 conn(0x7f6c4c0b3fe0 0x7f6c4c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.074+0000 7f6c53c00640 1 --2- 172.21.15.173:0/566851225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c145290 0x7f6c4c15c0b0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.074+0000 7f6c53c00640 1 -- 172.21.15.173:0/566851225 >> 172.21.15.173:0/566851225 conn(0x7f6c4c06ac90 msgr2=0x7f6c4c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:12.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.074+0000 7f6c53c00640 1 -- 172.21.15.173:0/566851225 shutdown_connections 2024-04-25T09:11:12.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.074+0000 7f6c53c00640 1 -- 172.21.15.173:0/566851225 wait complete. 2024-04-25T09:11:12.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c53c00640 1 Processor -- start 2024-04-25T09:11:12.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c53c00640 1 -- start start 2024-04-25T09:11:12.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c53c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c4c0b3fe0 0x7f6c4c143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c53c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c4c0cc260 0x7f6c4c13d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c53c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c145290 0x7f6c4c13df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c53c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c1457f0 con 0x7f6c4c145290 2024-04-25T09:11:12.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c53c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c145670 con 0x7f6c4c0cc260 2024-04-25T09:11:12.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c53c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c06ed60 con 0x7f6c4c0b3fe0 2024-04-25T09:11:12.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c51c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c145290 0x7f6c4c13df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c51c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c145290 0x7f6c4c13df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44526/0 (socket says 172.21.15.173:44526) 2024-04-25T09:11:12.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c51c00640 1 -- 172.21.15.173:0/4276850329 learned_addr learned my addr 172.21.15.173:0/4276850329 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:12.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c4be00640 1 --2- 172.21.15.173:0/4276850329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c4c0cc260 0x7f6c4c13d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c51200640 1 --2- 172.21.15.173:0/4276850329 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c4c0b3fe0 0x7f6c4c143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c51c00640 1 -- 172.21.15.173:0/4276850329 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c4c0b3fe0 msgr2=0x7f6c4c143b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c51c00640 1 --2- 172.21.15.173:0/4276850329 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c4c0b3fe0 0x7f6c4c143b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c51c00640 1 -- 172.21.15.173:0/4276850329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c4c0cc260 msgr2=0x7f6c4c13d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c51c00640 1 --2- 172.21.15.173:0/4276850329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c4c0cc260 0x7f6c4c13d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c51c00640 1 -- 172.21.15.173:0/4276850329 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c0ac960 con 0x7f6c4c145290 2024-04-25T09:11:12.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c51c00640 1 --2- 172.21.15.173:0/4276850329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c145290 0x7f6c4c13df10 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f6c44007e40 tx=0x7f6c4400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:12.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c48c00640 1 -- 172.21.15.173:0/4276850329 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44014620 con 0x7f6c4c145290 2024-04-25T09:11:12.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c48c00640 1 -- 172.21.15.173:0/4276850329 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c44019070 con 0x7f6c4c145290 2024-04-25T09:11:12.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c48c00640 1 -- 172.21.15.173:0/4276850329 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44014a20 con 0x7f6c4c145290 2024-04-25T09:11:12.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c53c00640 1 -- 172.21.15.173:0/4276850329 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c0acc00 con 0x7f6c4c145290 2024-04-25T09:11:12.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c53c00640 1 -- 172.21.15.173:0/4276850329 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4c0ad1c0 con 0x7f6c4c145290 2024-04-25T09:11:12.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.078+0000 7f6c53c00640 1 -- 172.21.15.173:0/4276850329 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4c073ab0 con 0x7f6c4c145290 2024-04-25T09:11:12.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.082+0000 7f6c48c00640 1 -- 172.21.15.173:0/4276850329 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6c44014bc0 con 0x7f6c4c145290 2024-04-25T09:11:12.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.082+0000 7f6c48c00640 1 --2- 172.21.15.173:0/4276850329 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6c2c066f60 0x7f6c2c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.082+0000 7f6c48c00640 1 -- 172.21.15.173:0/4276850329 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f6c44085ad0 con 0x7f6c4c145290 2024-04-25T09:11:12.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.082+0000 7f6c51200640 1 --2- 172.21.15.173:0/4276850329 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6c2c066f60 0x7f6c2c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.082+0000 7f6c51200640 1 --2- 172.21.15.173:0/4276850329 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6c2c066f60 0x7f6c2c069420 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0ad000 tx=0x7f6c3c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:12.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.086+0000 7f6c48c00640 1 -- 172.21.15.173:0/4276850329 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6c44056920 con 0x7f6c4c145290 2024-04-25T09:11:12.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.242+0000 7f6c53c00640 1 -- 172.21.15.173:0/4276850329 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c4c144830 con 0x7f6c4c145290 2024-04-25T09:11:12.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.242+0000 7f6c48c00640 1 -- 172.21.15.173:0/4276850329 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v111) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c44056220 con 0x7f6c4c145290 2024-04-25T09:11:12.231 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:11:12.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.242+0000 7f6c53c00640 1 -- 172.21.15.173:0/4276850329 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6c2c066f60 msgr2=0x7f6c2c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.242+0000 7f6c53c00640 1 --2- 172.21.15.173:0/4276850329 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6c2c066f60 0x7f6c2c069420 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0ad000 tx=0x7f6c3c008040 comp rx=0 tx=0).stop 2024-04-25T09:11:12.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.242+0000 7f6c53c00640 1 -- 172.21.15.173:0/4276850329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c145290 msgr2=0x7f6c4c13df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.242+0000 7f6c53c00640 1 --2- 172.21.15.173:0/4276850329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c145290 0x7f6c4c13df10 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f6c44007e40 tx=0x7f6c4400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.242+0000 7f6c53c00640 1 -- 172.21.15.173:0/4276850329 shutdown_connections 2024-04-25T09:11:12.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.242+0000 7f6c53c00640 1 --2- 172.21.15.173:0/4276850329 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6c2c066f60 0x7f6c2c069420 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.242+0000 7f6c53c00640 1 --2- 172.21.15.173:0/4276850329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c4c145290 0x7f6c4c13df10 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.242+0000 7f6c53c00640 1 --2- 172.21.15.173:0/4276850329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c4c0cc260 0x7f6c4c13d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.242+0000 7f6c53c00640 1 --2- 172.21.15.173:0/4276850329 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c4c0b3fe0 0x7f6c4c143b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.242+0000 7f6c53c00640 1 -- 172.21.15.173:0/4276850329 >> 172.21.15.173:0/4276850329 conn(0x7f6c4c06ac90 msgr2=0x7f6c4c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:12.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.242+0000 7f6c53c00640 1 -- 172.21.15.173:0/4276850329 shutdown_connections 2024-04-25T09:11:12.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.242+0000 7f6c53c00640 1 -- 172.21.15.173:0/4276850329 wait complete. 2024-04-25T09:11:12.252 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:11:12.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.406+0000 7f4f1d200640 1 Processor -- start 2024-04-25T09:11:12.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.406+0000 7f4f1d200640 1 -- start start 2024-04-25T09:11:12.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.406+0000 7f4f1d200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4f180aeb90 0x7f4f180cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.406+0000 7f4f1d200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f180ce2b0 0x7f4f180cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.406+0000 7f4f1d200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f18071570 con 0x7f4f180aef70 2024-04-25T09:11:12.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.406+0000 7f4f1d200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f18071320 con 0x7f4f180aeb90 2024-04-25T09:11:12.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.406+0000 7f4f1d200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f18072330 con 0x7f4f180ce2b0 2024-04-25T09:11:12.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.406+0000 7f4f15e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4f180aeb90 0x7f4f180cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.406+0000 7f4f15400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4f180aef70 0x7f4f180cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44374/0 (socket says 172.21.15.173:44374) 2024-04-25T09:11:12.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.406+0000 7f4f15400640 1 -- 172.21.15.173:0/2979391657 learned_addr learned my addr 172.21.15.173:0/2979391657 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:12.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.406+0000 7f4f16800640 1 --2- 172.21.15.173:0/2979391657 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f180ce2b0 0x7f4f180cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.406+0000 7f4f15e00640 1 -- 172.21.15.173:0/2979391657 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f180ce2b0 msgr2=0x7f4f180cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:12.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.406+0000 7f4f15e00640 1 --2- 172.21.15.173:0/2979391657 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f180ce2b0 0x7f4f180cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.406+0000 7f4f15e00640 1 -- 172.21.15.173:0/2979391657 >> v1:172.21.15.173:6789/0 conn(0x7f4f180aef70 legacy=0x7f4f180cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.406+0000 7f4f15e00640 1 -- 172.21.15.173:0/2979391657 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f18071850 con 0x7f4f180aeb90 2024-04-25T09:11:12.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.406+0000 7f4f14a00640 1 -- 172.21.15.173:0/2979391657 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190674129 0 0) 0x7f4f18071570 con 0x7f4f180aef70 2024-04-25T09:11:12.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.410+0000 7f4f15e00640 1 --2- 172.21.15.173:0/2979391657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f180aeb90 0x7f4f180cc0d0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009d90 tx=0x7f4f0801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57a4c5fea72f146 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:12.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.410+0000 7f4f14a00640 1 -- 172.21.15.173:0/2979391657 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f080b2070 con 0x7f4f180aeb90 2024-04-25T09:11:12.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.410+0000 7f4f14a00640 1 -- 172.21.15.173:0/2979391657 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f080a5870 con 0x7f4f180aeb90 2024-04-25T09:11:12.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.410+0000 7f4f14a00640 1 -- 172.21.15.173:0/2979391657 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f080a5c40 con 0x7f4f180aeb90 2024-04-25T09:11:12.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.410+0000 7f4f1d200640 1 -- 172.21.15.173:0/2979391657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f180aeb90 msgr2=0x7f4f180cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.410+0000 7f4f1d200640 1 --2- 172.21.15.173:0/2979391657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f180aeb90 0x7f4f180cc0d0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009d90 tx=0x7f4f0801c8b0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.410+0000 7f4f1d200640 1 -- 172.21.15.173:0/2979391657 shutdown_connections 2024-04-25T09:11:12.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.410+0000 7f4f1d200640 1 --2- 172.21.15.173:0/2979391657 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f180ce2b0 0x7f4f180cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.410+0000 7f4f1d200640 1 --2- 172.21.15.173:0/2979391657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f180aeb90 0x7f4f180cc0d0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.410+0000 7f4f1d200640 1 -- 172.21.15.173:0/2979391657 >> 172.21.15.173:0/2979391657 conn(0x7f4f1806ac90 msgr2=0x7f4f1806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:12.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.410+0000 7f4f1d200640 1 -- 172.21.15.173:0/2979391657 shutdown_connections 2024-04-25T09:11:12.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.410+0000 7f4f1d200640 1 -- 172.21.15.173:0/2979391657 wait complete. 2024-04-25T09:11:12.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.410+0000 7f4f1d200640 1 Processor -- start 2024-04-25T09:11:12.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.410+0000 7f4f1d200640 1 -- start start 2024-04-25T09:11:12.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f1d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f180aeb90 0x7f4f180af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f1d200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f180aef70 0x7f4f1813e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f1d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f180ce2b0 0x7f4f180b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f1d200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1815bb70 con 0x7f4f180ce2b0 2024-04-25T09:11:12.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f1d200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1815b9f0 con 0x7f4f180aeb90 2024-04-25T09:11:12.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f1d200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1815bcf0 con 0x7f4f180aef70 2024-04-25T09:11:12.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f16800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f180ce2b0 0x7f4f180b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f16800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f180ce2b0 0x7f4f180b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44538/0 (socket says 172.21.15.173:44538) 2024-04-25T09:11:12.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f16800640 1 -- 172.21.15.173:0/1333631124 learned_addr learned my addr 172.21.15.173:0/1333631124 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:12.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f15e00640 1 --2- 172.21.15.173:0/1333631124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f180aeb90 0x7f4f180af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f15400640 1 --2- 172.21.15.173:0/1333631124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f180aef70 0x7f4f1813e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f16800640 1 -- 172.21.15.173:0/1333631124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f180aef70 msgr2=0x7f4f1813e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f16800640 1 --2- 172.21.15.173:0/1333631124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f180aef70 0x7f4f1813e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f16800640 1 -- 172.21.15.173:0/1333631124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f180aeb90 msgr2=0x7f4f180af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f16800640 1 --2- 172.21.15.173:0/1333631124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f180aeb90 0x7f4f180af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f16800640 1 -- 172.21.15.173:0/1333631124 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f180afc70 con 0x7f4f180ce2b0 2024-04-25T09:11:12.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f16800640 1 --2- 172.21.15.173:0/1333631124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f180ce2b0 0x7f4f180b0d10 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000d5d0 tx=0x7f4f1000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:12.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f0e000640 1 -- 172.21.15.173:0/1333631124 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f100125f0 con 0x7f4f180ce2b0 2024-04-25T09:11:12.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f0e000640 1 -- 172.21.15.173:0/1333631124 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f10019070 con 0x7f4f180ce2b0 2024-04-25T09:11:12.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f0e000640 1 -- 172.21.15.173:0/1333631124 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f100129f0 con 0x7f4f180ce2b0 2024-04-25T09:11:12.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f1d200640 1 -- 172.21.15.173:0/1333631124 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f180aff50 con 0x7f4f180ce2b0 2024-04-25T09:11:12.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f1d200640 1 -- 172.21.15.173:0/1333631124 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f180b07f0 con 0x7f4f180ce2b0 2024-04-25T09:11:12.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.414+0000 7f4f1d200640 1 -- 172.21.15.173:0/1333631124 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f180b0120 con 0x7f4f180ce2b0 2024-04-25T09:11:12.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.418+0000 7f4f0e000640 1 -- 172.21.15.173:0/1333631124 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4f10012b90 con 0x7f4f180ce2b0 2024-04-25T09:11:12.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.418+0000 7f4f0e000640 1 --2- 172.21.15.173:0/1333631124 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4ef8066f60 0x7f4ef8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.418+0000 7f4f0e000640 1 -- 172.21.15.173:0/1333631124 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f4f10085510 con 0x7f4f180ce2b0 2024-04-25T09:11:12.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.418+0000 7f4f15e00640 1 --2- 172.21.15.173:0/1333631124 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4ef8066f60 0x7f4ef8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.418+0000 7f4f15e00640 1 --2- 172.21.15.173:0/1333631124 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4ef8066f60 0x7f4ef8069420 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4f080af000 tx=0x7f4f080a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:12.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.422+0000 7f4f0e000640 1 -- 172.21.15.173:0/1333631124 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4f10055d10 con 0x7f4f180ce2b0 2024-04-25T09:11:12.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.574+0000 7f4f1d200640 1 -- 172.21.15.173:0/1333631124 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f18073ab0 con 0x7f4f180ce2b0 2024-04-25T09:11:12.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.574+0000 7f4f0e000640 1 -- 172.21.15.173:0/1333631124 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v111) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f10059db0 con 0x7f4f180ce2b0 2024-04-25T09:11:12.558 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:11:12.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.574+0000 7f4f1d200640 1 -- 172.21.15.173:0/1333631124 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4ef8066f60 msgr2=0x7f4ef8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.574+0000 7f4f1d200640 1 --2- 172.21.15.173:0/1333631124 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4ef8066f60 0x7f4ef8069420 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4f080af000 tx=0x7f4f080a7070 comp rx=0 tx=0).stop 2024-04-25T09:11:12.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.574+0000 7f4f1d200640 1 -- 172.21.15.173:0/1333631124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f180ce2b0 msgr2=0x7f4f180b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.574+0000 7f4f1d200640 1 --2- 172.21.15.173:0/1333631124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f180ce2b0 0x7f4f180b0d10 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000d5d0 tx=0x7f4f1000da90 comp rx=0 tx=0).stop 2024-04-25T09:11:12.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.574+0000 7f4f1d200640 1 -- 172.21.15.173:0/1333631124 shutdown_connections 2024-04-25T09:11:12.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.574+0000 7f4f1d200640 1 --2- 172.21.15.173:0/1333631124 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4ef8066f60 0x7f4ef8069420 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.574+0000 7f4f1d200640 1 --2- 172.21.15.173:0/1333631124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f180ce2b0 0x7f4f180b0d10 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.574+0000 7f4f1d200640 1 --2- 172.21.15.173:0/1333631124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f180aef70 0x7f4f1813e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.574+0000 7f4f1d200640 1 --2- 172.21.15.173:0/1333631124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f180aeb90 0x7f4f180af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.574+0000 7f4f1d200640 1 -- 172.21.15.173:0/1333631124 >> 172.21.15.173:0/1333631124 conn(0x7f4f1806ac90 msgr2=0x7f4f180b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:12.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.574+0000 7f4f1d200640 1 -- 172.21.15.173:0/1333631124 shutdown_connections 2024-04-25T09:11:12.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.574+0000 7f4f1d200640 1 -- 172.21.15.173:0/1333631124 wait complete. 2024-04-25T09:11:12.580 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:12.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.734+0000 7fe8a9a00640 1 Processor -- start 2024-04-25T09:11:12.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.734+0000 7fe8a9a00640 1 -- start start 2024-04-25T09:11:12.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.734+0000 7fe8a9a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe8a415dbb0 0x7fe8a415df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.734+0000 7fe8a9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8a406f830 0x7fe8a406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.734+0000 7fe8a9a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a406d870 con 0x7fe8a40d2130 2024-04-25T09:11:12.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.734+0000 7fe8a9a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a40d2590 con 0x7fe8a415dbb0 2024-04-25T09:11:12.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.734+0000 7fe8a9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a415e5c0 con 0x7fe8a406f830 2024-04-25T09:11:12.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.734+0000 7fe8a2a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe8a415dbb0 0x7fe8a415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.734+0000 7fe89a000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe8a40d2130 0x7fe8a406c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44388/0 (socket says 172.21.15.173:44388) 2024-04-25T09:11:12.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.734+0000 7fe89a000640 1 -- 172.21.15.173:0/1938558470 learned_addr learned my addr 172.21.15.173:0/1938558470 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:12.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.734+0000 7fe8a2a00640 1 -- 172.21.15.173:0/1938558470 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8a406f830 msgr2=0x7fe8a406fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:12.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.734+0000 7fe8a2a00640 1 --2- 172.21.15.173:0/1938558470 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8a406f830 0x7fe8a406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.734+0000 7fe8a2a00640 1 -- 172.21.15.173:0/1938558470 >> v1:172.21.15.173:6789/0 conn(0x7fe8a40d2130 legacy=0x7fe8a406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.734+0000 7fe8a2a00640 1 -- 172.21.15.173:0/1938558470 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a4161690 con 0x7fe8a415dbb0 2024-04-25T09:11:12.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.734+0000 7fe8a2000640 1 -- 172.21.15.173:0/1938558470 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021945060 0 0) 0x7fe8a406d870 con 0x7fe8a40d2130 2024-04-25T09:11:12.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.738+0000 7fe8a2a00640 1 --2- 172.21.15.173:0/1938558470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a415dbb0 0x7fe8a415df90 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fe8940097c0 tx=0x7fe89401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e9d728fcb2da1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:12.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.738+0000 7fe8a2000640 1 -- 172.21.15.173:0/1938558470 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8940b2070 con 0x7fe8a415dbb0 2024-04-25T09:11:12.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.738+0000 7fe8a2000640 1 -- 172.21.15.173:0/1938558470 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8940ad640 con 0x7fe8a415dbb0 2024-04-25T09:11:12.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.738+0000 7fe8a2000640 1 -- 172.21.15.173:0/1938558470 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8940ada10 con 0x7fe8a415dbb0 2024-04-25T09:11:12.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.738+0000 7fe8a9a00640 1 -- 172.21.15.173:0/1938558470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a415dbb0 msgr2=0x7fe8a415df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.738+0000 7fe8a9a00640 1 --2- 172.21.15.173:0/1938558470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a415dbb0 0x7fe8a415df90 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fe8940097c0 tx=0x7fe89401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.738+0000 7fe8a9a00640 1 -- 172.21.15.173:0/1938558470 shutdown_connections 2024-04-25T09:11:12.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.738+0000 7fe8a9a00640 1 --2- 172.21.15.173:0/1938558470 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8a406f830 0x7fe8a406fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.738+0000 7fe8a9a00640 1 --2- 172.21.15.173:0/1938558470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a415dbb0 0x7fe8a415df90 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.738+0000 7fe8a9a00640 1 -- 172.21.15.173:0/1938558470 >> 172.21.15.173:0/1938558470 conn(0x7fe8a4061880 msgr2=0x7fe8a4061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:12.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.738+0000 7fe8a9a00640 1 -- 172.21.15.173:0/1938558470 shutdown_connections 2024-04-25T09:11:12.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.738+0000 7fe8a9a00640 1 -- 172.21.15.173:0/1938558470 wait complete. 2024-04-25T09:11:12.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe8a9a00640 1 Processor -- start 2024-04-25T09:11:12.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe8a9a00640 1 -- start start 2024-04-25T09:11:12.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe8a9a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8a406f830 0x7fe8a41fa060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe8a9a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a40d2130 0x7fe8a41fa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe8a9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8a415dbb0 0x7fe8a41faae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe8a9a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a416a990 con 0x7fe8a40d2130 2024-04-25T09:11:12.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe8a9a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a415ee60 con 0x7fe8a406f830 2024-04-25T09:11:12.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe8a9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a416ab10 con 0x7fe8a415dbb0 2024-04-25T09:11:12.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe89a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a40d2130 0x7fe8a41fa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe89a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a40d2130 0x7fe8a41fa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44564/0 (socket says 172.21.15.173:44564) 2024-04-25T09:11:12.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe89a000640 1 -- 172.21.15.173:0/2339377577 learned_addr learned my addr 172.21.15.173:0/2339377577 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:12.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe8a2a00640 1 --2- 172.21.15.173:0/2339377577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8a406f830 0x7fe8a41fa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe8a3400640 1 --2- 172.21.15.173:0/2339377577 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8a415dbb0 0x7fe8a41faae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe89a000640 1 -- 172.21.15.173:0/2339377577 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8a415dbb0 msgr2=0x7fe8a41faae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe89a000640 1 --2- 172.21.15.173:0/2339377577 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8a415dbb0 0x7fe8a41faae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe89a000640 1 -- 172.21.15.173:0/2339377577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8a406f830 msgr2=0x7fe8a41fa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe89a000640 1 --2- 172.21.15.173:0/2339377577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8a406f830 0x7fe8a41fa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe89a000640 1 -- 172.21.15.173:0/2339377577 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a40ad610 con 0x7fe8a40d2130 2024-04-25T09:11:12.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe8a3400640 1 --2- 172.21.15.173:0/2339377577 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8a415dbb0 0x7fe8a41faae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:12.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe89a000640 1 --2- 172.21.15.173:0/2339377577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a40d2130 0x7fe8a41fa5a0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fe88c0011f0 tx=0x7fe88c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:12.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe89b400640 1 -- 172.21.15.173:0/2339377577 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c018070 con 0x7fe8a40d2130 2024-04-25T09:11:12.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe89b400640 1 -- 172.21.15.173:0/2339377577 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c0074e0 con 0x7fe8a40d2130 2024-04-25T09:11:12.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe89b400640 1 -- 172.21.15.173:0/2339377577 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c004a10 con 0x7fe8a40d2130 2024-04-25T09:11:12.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe8a9a00640 1 -- 172.21.15.173:0/2339377577 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a40ad8b0 con 0x7fe8a40d2130 2024-04-25T09:11:12.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe8a9a00640 1 -- 172.21.15.173:0/2339377577 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a40ade70 con 0x7fe8a40d2130 2024-04-25T09:11:12.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.742+0000 7fe8a9a00640 1 -- 172.21.15.173:0/2339377577 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a4073a40 con 0x7fe8a40d2130 2024-04-25T09:11:12.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.746+0000 7fe89b400640 1 -- 172.21.15.173:0/2339377577 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe88c004bb0 con 0x7fe8a40d2130 2024-04-25T09:11:12.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.746+0000 7fe89b400640 1 --2- 172.21.15.173:0/2339377577 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe880066f60 0x7fe880069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.746+0000 7fe89b400640 1 -- 172.21.15.173:0/2339377577 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fe88c084600 con 0x7fe8a40d2130 2024-04-25T09:11:12.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.746+0000 7fe8a2a00640 1 --2- 172.21.15.173:0/2339377577 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe880066f60 0x7fe880069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.746+0000 7fe8a2a00640 1 --2- 172.21.15.173:0/2339377577 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe880066f60 0x7fe880069420 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe8940af000 tx=0x7fe894008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:12.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.750+0000 7fe89b400640 1 -- 172.21.15.173:0/2339377577 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe88c0553c0 con 0x7fe8a40d2130 2024-04-25T09:11:12.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.934+0000 7fe8a9a00640 1 -- 172.21.15.173:0/2339377577 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8a406da10 con 0x7fe8a40d2130 2024-04-25T09:11:12.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.934+0000 7fe89b400640 1 -- 172.21.15.173:0/2339377577 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4949 (secure 0 0 0) 0x7fe88c054cc0 con 0x7fe8a40d2130 2024-04-25T09:11:12.921 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:12.921 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1519522112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1519522112},{"type":"v1","addr":"172.21.15.194:6835","nonce":1519522112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7555,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/548680290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":548680290},{"type":"v1","addr":"172.21.15.173:6836","nonce":548680290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2602621503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2602621503},{"type":"v1","addr":"172.21.15.194:6833","nonce":2602621503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:24.354981+0000","modified":"2024-04-25T09:10:27.392053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/1492125936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":1492125936},{"type":"v1","addr":"172.21.15.173:6837","nonce":1492125936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:11:12.921 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 72 2024-04-25T09:11:12.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.938+0000 7fe8a9a00640 1 -- 172.21.15.173:0/2339377577 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe880066f60 msgr2=0x7fe880069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.938+0000 7fe8a9a00640 1 --2- 172.21.15.173:0/2339377577 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe880066f60 0x7fe880069420 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe8940af000 tx=0x7fe894008040 comp rx=0 tx=0).stop 2024-04-25T09:11:12.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.938+0000 7fe8a9a00640 1 -- 172.21.15.173:0/2339377577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a40d2130 msgr2=0x7fe8a41fa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.938+0000 7fe8a9a00640 1 --2- 172.21.15.173:0/2339377577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a40d2130 0x7fe8a41fa5a0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fe88c0011f0 tx=0x7fe88c00c9b0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.938+0000 7fe8a9a00640 1 -- 172.21.15.173:0/2339377577 shutdown_connections 2024-04-25T09:11:12.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.938+0000 7fe8a9a00640 1 --2- 172.21.15.173:0/2339377577 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe880066f60 0x7fe880069420 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.938+0000 7fe8a9a00640 1 --2- 172.21.15.173:0/2339377577 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8a415dbb0 0x7fe8a41faae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.938+0000 7fe8a9a00640 1 --2- 172.21.15.173:0/2339377577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a40d2130 0x7fe8a41fa5a0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.938+0000 7fe8a9a00640 1 --2- 172.21.15.173:0/2339377577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8a406f830 0x7fe8a41fa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.938+0000 7fe8a9a00640 1 -- 172.21.15.173:0/2339377577 >> 172.21.15.173:0/2339377577 conn(0x7fe8a4061880 msgr2=0x7fe8a4061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:12.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.938+0000 7fe8a9a00640 1 -- 172.21.15.173:0/2339377577 shutdown_connections 2024-04-25T09:11:12.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:12.938+0000 7fe8a9a00640 1 -- 172.21.15.173:0/2339377577 wait complete. 2024-04-25T09:11:12.942 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:13.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.098+0000 7fd46ac00640 1 Processor -- start 2024-04-25T09:11:13.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.098+0000 7fd46ac00640 1 -- start start 2024-04-25T09:11:13.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.098+0000 7fd46ac00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd4640cf850 0x7fd4640616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.098+0000 7fd46ac00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640af3c0 0x7fd46415f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.098+0000 7fd46ac00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4640af810 con 0x7fd46406ffa0 2024-04-25T09:11:13.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.098+0000 7fd46ac00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4640ad0e0 con 0x7fd4640cf850 2024-04-25T09:11:13.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.098+0000 7fd46ac00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd464061c90 con 0x7fd4640af3c0 2024-04-25T09:11:13.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.098+0000 7fd468e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd4640cf850 0x7fd4640616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.098+0000 7fd469800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd46406ffa0 0x7fd4640cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44396/0 (socket says 172.21.15.173:44396) 2024-04-25T09:11:13.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.098+0000 7fd469800640 1 -- 172.21.15.173:0/988045705 learned_addr learned my addr 172.21.15.173:0/988045705 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:13.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.098+0000 7fd46a200640 1 --2- 172.21.15.173:0/988045705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640af3c0 0x7fd46415f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.098+0000 7fd468e00640 1 -- 172.21.15.173:0/988045705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640af3c0 msgr2=0x7fd46415f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:13.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.098+0000 7fd468e00640 1 --2- 172.21.15.173:0/988045705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640af3c0 0x7fd46415f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.098+0000 7fd468e00640 1 -- 172.21.15.173:0/988045705 >> v1:172.21.15.173:6789/0 conn(0x7fd46406ffa0 legacy=0x7fd4640cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.098+0000 7fd468e00640 1 -- 172.21.15.173:0/988045705 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46415bf10 con 0x7fd4640cf850 2024-04-25T09:11:13.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.098+0000 7fd46a200640 1 --2- 172.21.15.173:0/988045705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640af3c0 0x7fd46415f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:13.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.102+0000 7fd468e00640 1 --2- 172.21.15.173:0/988045705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4640cf850 0x7fd4640616b0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fd4500097c0 tx=0x7fd45001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22174eb9c83127b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:13.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.102+0000 7fd463e00640 1 -- 172.21.15.173:0/988045705 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4500b2070 con 0x7fd4640cf850 2024-04-25T09:11:13.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.102+0000 7fd463e00640 1 -- 172.21.15.173:0/988045705 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4500ad640 con 0x7fd4640cf850 2024-04-25T09:11:13.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.102+0000 7fd463e00640 1 -- 172.21.15.173:0/988045705 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4500ada10 con 0x7fd4640cf850 2024-04-25T09:11:13.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.102+0000 7fd46ac00640 1 -- 172.21.15.173:0/988045705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4640cf850 msgr2=0x7fd4640616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.102+0000 7fd46ac00640 1 --2- 172.21.15.173:0/988045705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4640cf850 0x7fd4640616b0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fd4500097c0 tx=0x7fd45001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.102+0000 7fd46ac00640 1 -- 172.21.15.173:0/988045705 shutdown_connections 2024-04-25T09:11:13.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.102+0000 7fd46ac00640 1 --2- 172.21.15.173:0/988045705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640af3c0 0x7fd46415f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.102+0000 7fd46ac00640 1 --2- 172.21.15.173:0/988045705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4640cf850 0x7fd4640616b0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.102+0000 7fd46ac00640 1 -- 172.21.15.173:0/988045705 >> 172.21.15.173:0/988045705 conn(0x7fd4640cc800 msgr2=0x7fd4640ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:13.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.102+0000 7fd46ac00640 1 -- 172.21.15.173:0/988045705 shutdown_connections 2024-04-25T09:11:13.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.102+0000 7fd46ac00640 1 -- 172.21.15.173:0/988045705 wait complete. 2024-04-25T09:11:13.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.102+0000 7fd46ac00640 1 Processor -- start 2024-04-25T09:11:13.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.102+0000 7fd46ac00640 1 -- start start 2024-04-25T09:11:13.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd46ac00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46406ffa0 0x7fd464155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd46ac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4640af3c0 0x7fd46415a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd46ac00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640cf850 0x7fd46415ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd46ac00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd464168790 con 0x7fd46406ffa0 2024-04-25T09:11:13.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd46ac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46415ccd0 con 0x7fd4640af3c0 2024-04-25T09:11:13.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd46ac00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd464168910 con 0x7fd4640cf850 2024-04-25T09:11:13.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd469800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46406ffa0 0x7fd464155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd469800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46406ffa0 0x7fd464155850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44580/0 (socket says 172.21.15.173:44580) 2024-04-25T09:11:13.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd469800640 1 -- 172.21.15.173:0/3728701242 learned_addr learned my addr 172.21.15.173:0/3728701242 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:13.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd469800640 1 -- 172.21.15.173:0/3728701242 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640cf850 msgr2=0x7fd46415ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd469800640 1 --2- 172.21.15.173:0/3728701242 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640cf850 0x7fd46415ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd469800640 1 -- 172.21.15.173:0/3728701242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4640af3c0 msgr2=0x7fd46415a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd469800640 1 --2- 172.21.15.173:0/3728701242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4640af3c0 0x7fd46415a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd469800640 1 -- 172.21.15.173:0/3728701242 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4640b3b50 con 0x7fd46406ffa0 2024-04-25T09:11:13.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd469800640 1 --2- 172.21.15.173:0/3728701242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46406ffa0 0x7fd464155850 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fd45800c370 tx=0x7fd45800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:13.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd461600640 1 -- 172.21.15.173:0/3728701242 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458017070 con 0x7fd46406ffa0 2024-04-25T09:11:13.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd461600640 1 -- 172.21.15.173:0/3728701242 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd458005cf0 con 0x7fd46406ffa0 2024-04-25T09:11:13.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd461600640 1 -- 172.21.15.173:0/3728701242 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4580072f0 con 0x7fd46406ffa0 2024-04-25T09:11:13.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd46ac00640 1 -- 172.21.15.173:0/3728701242 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4640b3e30 con 0x7fd46406ffa0 2024-04-25T09:11:13.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd46ac00640 1 -- 172.21.15.173:0/3728701242 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4640b43f0 con 0x7fd46406ffa0 2024-04-25T09:11:13.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd46ac00640 1 -- 172.21.15.173:0/3728701242 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4640b47d0 con 0x7fd46406ffa0 2024-04-25T09:11:13.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.106+0000 7fd461600640 1 -- 172.21.15.173:0/3728701242 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd45801a070 con 0x7fd46406ffa0 2024-04-25T09:11:13.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.110+0000 7fd461600640 1 --2- 172.21.15.173:0/3728701242 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd444066f60 0x7fd444069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.110+0000 7fd461600640 1 -- 172.21.15.173:0/3728701242 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fd458084540 con 0x7fd46406ffa0 2024-04-25T09:11:13.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.110+0000 7fd468e00640 1 --2- 172.21.15.173:0/3728701242 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd444066f60 0x7fd444069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.110+0000 7fd468e00640 1 --2- 172.21.15.173:0/3728701242 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd444066f60 0x7fd444069420 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd4500af000 tx=0x7fd450004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:13.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.114+0000 7fd461600640 1 -- 172.21.15.173:0/3728701242 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd4640b47d0 con 0x7fd46406ffa0 2024-04-25T09:11:13.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.270+0000 7fd46ac00640 1 -- 172.21.15.173:0/3728701242 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd46409db20 con 0x7fd46406ffa0 2024-04-25T09:11:13.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.270+0000 7fd461600640 1 -- 172.21.15.173:0/3728701242 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16994 (secure 0 0 0) 0x7fd458055390 con 0x7fd46406ffa0 2024-04-25T09:11:13.256 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:13.256 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":111,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:10:34.497380+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:22.062377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:23.359080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.35","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:13.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.274+0000 7fd46ac00640 1 -- 172.21.15.173:0/3728701242 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd444066f60 msgr2=0x7fd444069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.274+0000 7fd46ac00640 1 --2- 172.21.15.173:0/3728701242 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd444066f60 0x7fd444069420 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd4500af000 tx=0x7fd450004740 comp rx=0 tx=0).stop 2024-04-25T09:11:13.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.274+0000 7fd46ac00640 1 -- 172.21.15.173:0/3728701242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46406ffa0 msgr2=0x7fd464155850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.274+0000 7fd46ac00640 1 --2- 172.21.15.173:0/3728701242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46406ffa0 0x7fd464155850 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fd45800c370 tx=0x7fd45800c830 comp rx=0 tx=0).stop 2024-04-25T09:11:13.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.274+0000 7fd46ac00640 1 -- 172.21.15.173:0/3728701242 shutdown_connections 2024-04-25T09:11:13.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.274+0000 7fd46ac00640 1 --2- 172.21.15.173:0/3728701242 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd444066f60 0x7fd444069420 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.274+0000 7fd46ac00640 1 --2- 172.21.15.173:0/3728701242 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4640cf850 0x7fd46415ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.274+0000 7fd46ac00640 1 --2- 172.21.15.173:0/3728701242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4640af3c0 0x7fd46415a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.274+0000 7fd46ac00640 1 --2- 172.21.15.173:0/3728701242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd46406ffa0 0x7fd464155850 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.274+0000 7fd46ac00640 1 -- 172.21.15.173:0/3728701242 >> 172.21.15.173:0/3728701242 conn(0x7fd4640cc800 msgr2=0x7fd4640b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:13.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.274+0000 7fd46ac00640 1 -- 172.21.15.173:0/3728701242 shutdown_connections 2024-04-25T09:11:13.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.274+0000 7fd46ac00640 1 -- 172.21.15.173:0/3728701242 wait complete. 2024-04-25T09:11:13.277 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:11:13.277 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:13.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.426+0000 7ff08f200640 1 Processor -- start 2024-04-25T09:11:13.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.426+0000 7ff08f200640 1 -- start start 2024-04-25T09:11:13.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.430+0000 7ff08f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0880b3e70 0x7ff0880b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.430+0000 7ff08f200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff0880aefa0 0x7ff0880b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.430+0000 7ff08f200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0880b4790 con 0x7ff08815edd0 2024-04-25T09:11:13.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.430+0000 7ff08f200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff08806dd50 con 0x7ff0880aefa0 2024-04-25T09:11:13.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.430+0000 7ff08f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08815f320 con 0x7ff0880b3e70 2024-04-25T09:11:13.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.430+0000 7ff07f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff0880aefa0 0x7ff0880b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.430+0000 7ff07f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff0880aefa0 0x7ff0880b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41394/0 (socket says 172.21.15.173:41394) 2024-04-25T09:11:13.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.430+0000 7ff07f400640 1 -- 172.21.15.173:0/2318403350 learned_addr learned my addr 172.21.15.173:0/2318403350 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:13.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.430+0000 7ff08d200640 1 --1- 172.21.15.173:0/2318403350 >> v1:172.21.15.173:6789/0 conn(0x7ff08815edd0 0x7ff0880b2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41532/0 (socket says 172.21.15.173:41532) 2024-04-25T09:11:13.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.430+0000 7ff087e00640 1 --2- 172.21.15.173:0/2318403350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0880b3e70 0x7ff0880b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.430+0000 7ff07f400640 1 -- 172.21.15.173:0/2318403350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0880b3e70 msgr2=0x7ff0880b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:13.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.430+0000 7ff07f400640 1 --2- 172.21.15.173:0/2318403350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0880b3e70 0x7ff0880b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.430+0000 7ff07f400640 1 -- 172.21.15.173:0/2318403350 >> v1:172.21.15.173:6789/0 conn(0x7ff08815edd0 legacy=0x7ff0880b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.430+0000 7ff07f400640 1 -- 172.21.15.173:0/2318403350 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08806d420 con 0x7ff0880aefa0 2024-04-25T09:11:13.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.430+0000 7ff087400640 1 -- 172.21.15.173:0/2318403350 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124006268 0 0) 0x7ff0880b4790 con 0x7ff08815edd0 2024-04-25T09:11:13.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff07f400640 1 --2- 172.21.15.173:0/2318403350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0880aefa0 0x7ff0880b2770 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7ff070009870 tx=0x7ff07001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40820fdb33e4948 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:13.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff087400640 1 -- 172.21.15.173:0/2318403350 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0700a9610 con 0x7ff0880aefa0 2024-04-25T09:11:13.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff087400640 1 -- 172.21.15.173:0/2318403350 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0700a97b0 con 0x7ff0880aefa0 2024-04-25T09:11:13.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff087400640 1 -- 172.21.15.173:0/2318403350 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0700a9b80 con 0x7ff0880aefa0 2024-04-25T09:11:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff08f200640 1 -- 172.21.15.173:0/2318403350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0880aefa0 msgr2=0x7ff0880b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff08f200640 1 --2- 172.21.15.173:0/2318403350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0880aefa0 0x7ff0880b2770 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7ff070009870 tx=0x7ff07001c530 comp rx=0 tx=0).stop 2024-04-25T09:11:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff08f200640 1 -- 172.21.15.173:0/2318403350 shutdown_connections 2024-04-25T09:11:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff08f200640 1 --2- 172.21.15.173:0/2318403350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0880aefa0 0x7ff0880b2770 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff08f200640 1 --2- 172.21.15.173:0/2318403350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0880b3e70 0x7ff0880b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff08f200640 1 -- 172.21.15.173:0/2318403350 >> 172.21.15.173:0/2318403350 conn(0x7ff08806ac90 msgr2=0x7ff08806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff08f200640 1 -- 172.21.15.173:0/2318403350 shutdown_connections 2024-04-25T09:11:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff08f200640 1 -- 172.21.15.173:0/2318403350 wait complete. 2024-04-25T09:11:13.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff08f200640 1 Processor -- start 2024-04-25T09:11:13.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff08f200640 1 -- start start 2024-04-25T09:11:13.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff08f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0880aefa0 0x7ff0880b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff08f200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0880b3e70 0x7ff088159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff08f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff08815edd0 0x7ff088159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff08f200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08806e1c0 con 0x7ff0880b3e70 2024-04-25T09:11:13.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff08f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08815aba0 con 0x7ff08815edd0 2024-04-25T09:11:13.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.434+0000 7ff08f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08806e340 con 0x7ff0880aefa0 2024-04-25T09:11:13.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff07f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0880b3e70 0x7ff088159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff07f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0880b3e70 0x7ff088159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41410/0 (socket says 172.21.15.173:41410) 2024-04-25T09:11:13.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff07f400640 1 -- 172.21.15.173:0/4124703108 learned_addr learned my addr 172.21.15.173:0/4124703108 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:13.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff087e00640 1 --2- 172.21.15.173:0/4124703108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0880aefa0 0x7ff0880b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff08d200640 1 --2- 172.21.15.173:0/4124703108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff08815edd0 0x7ff088159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff07f400640 1 -- 172.21.15.173:0/4124703108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0880aefa0 msgr2=0x7ff0880b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff07f400640 1 --2- 172.21.15.173:0/4124703108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0880aefa0 0x7ff0880b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff07f400640 1 -- 172.21.15.173:0/4124703108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff08815edd0 msgr2=0x7ff088159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff07f400640 1 --2- 172.21.15.173:0/4124703108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff08815edd0 0x7ff088159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff07f400640 1 -- 172.21.15.173:0/4124703108 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff088166d00 con 0x7ff0880b3e70 2024-04-25T09:11:13.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff087e00640 1 --2- 172.21.15.173:0/4124703108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0880aefa0 0x7ff0880b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:13.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff08d200640 1 --2- 172.21.15.173:0/4124703108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff08815edd0 0x7ff088159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:13.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff07f400640 1 --2- 172.21.15.173:0/4124703108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0880b3e70 0x7ff088159a30 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7ff07001abe0 tx=0x7ff0700192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:13.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff084c00640 1 -- 172.21.15.173:0/4124703108 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0700b9630 con 0x7ff0880b3e70 2024-04-25T09:11:13.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff084c00640 1 -- 172.21.15.173:0/4124703108 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0700b97d0 con 0x7ff0880b3e70 2024-04-25T09:11:13.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff08f200640 1 -- 172.21.15.173:0/4124703108 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0880ae000 con 0x7ff0880b3e70 2024-04-25T09:11:13.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff084c00640 1 -- 172.21.15.173:0/4124703108 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0700b9ba0 con 0x7ff0880b3e70 2024-04-25T09:11:13.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff08f200640 1 -- 172.21.15.173:0/4124703108 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0881672a0 con 0x7ff0880b3e70 2024-04-25T09:11:13.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff08f200640 1 -- 172.21.15.173:0/4124703108 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff088073a40 con 0x7ff0880b3e70 2024-04-25T09:11:13.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff084c00640 1 -- 172.21.15.173:0/4124703108 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff0700c23f0 con 0x7ff0880b3e70 2024-04-25T09:11:13.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.438+0000 7ff084c00640 1 --2- 172.21.15.173:0/4124703108 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff064066f60 0x7ff064069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.442+0000 7ff084c00640 1 -- 172.21.15.173:0/4124703108 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7ff07011f4f0 con 0x7ff0880b3e70 2024-04-25T09:11:13.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.442+0000 7ff087e00640 1 --2- 172.21.15.173:0/4124703108 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff064066f60 0x7ff064069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.442+0000 7ff087e00640 1 --2- 172.21.15.173:0/4124703108 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff064066f60 0x7ff064069420 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff07800b9f0 tx=0x7ff078008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:13.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.442+0000 7ff084c00640 1 -- 172.21.15.173:0/4124703108 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff0700ad020 con 0x7ff0880b3e70 2024-04-25T09:11:13.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.634+0000 7ff08f200640 1 -- 172.21.15.173:0/4124703108 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0880b42c0 con 0x7ff0880b3e70 2024-04-25T09:11:13.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.634+0000 7ff084c00640 1 -- 172.21.15.173:0/4124703108 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4949 (secure 0 0 0) 0x7ff070016150 con 0x7ff0880b3e70 2024-04-25T09:11:13.620 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:13.620 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1519522112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1519522112},{"type":"v1","addr":"172.21.15.194:6835","nonce":1519522112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7555,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/548680290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":548680290},{"type":"v1","addr":"172.21.15.173:6836","nonce":548680290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2602621503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2602621503},{"type":"v1","addr":"172.21.15.194:6833","nonce":2602621503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:24.354981+0000","modified":"2024-04-25T09:10:27.392053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/1492125936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":1492125936},{"type":"v1","addr":"172.21.15.173:6837","nonce":1492125936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:11:13.620 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 72 2024-04-25T09:11:13.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.634+0000 7ff08f200640 1 -- 172.21.15.173:0/4124703108 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff064066f60 msgr2=0x7ff064069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.634+0000 7ff08f200640 1 --2- 172.21.15.173:0/4124703108 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff064066f60 0x7ff064069420 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff07800b9f0 tx=0x7ff078008040 comp rx=0 tx=0).stop 2024-04-25T09:11:13.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.634+0000 7ff08f200640 1 -- 172.21.15.173:0/4124703108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0880b3e70 msgr2=0x7ff088159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.634+0000 7ff08f200640 1 --2- 172.21.15.173:0/4124703108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0880b3e70 0x7ff088159a30 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7ff07001abe0 tx=0x7ff0700192d0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.638+0000 7ff08f200640 1 -- 172.21.15.173:0/4124703108 shutdown_connections 2024-04-25T09:11:13.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.638+0000 7ff08f200640 1 --2- 172.21.15.173:0/4124703108 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff064066f60 0x7ff064069420 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.638+0000 7ff08f200640 1 --2- 172.21.15.173:0/4124703108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff08815edd0 0x7ff088159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.638+0000 7ff08f200640 1 --2- 172.21.15.173:0/4124703108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0880b3e70 0x7ff088159a30 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.638+0000 7ff08f200640 1 --2- 172.21.15.173:0/4124703108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0880aefa0 0x7ff0880b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.638+0000 7ff08f200640 1 -- 172.21.15.173:0/4124703108 >> 172.21.15.173:0/4124703108 conn(0x7ff08806ac90 msgr2=0x7ff0880aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:13.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.638+0000 7ff08f200640 1 -- 172.21.15.173:0/4124703108 shutdown_connections 2024-04-25T09:11:13.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.638+0000 7ff08f200640 1 -- 172.21.15.173:0/4124703108 wait complete. 2024-04-25T09:11:13.641 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:13.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.790+0000 7fec21800640 1 Processor -- start 2024-04-25T09:11:13.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.790+0000 7fec21800640 1 -- start start 2024-04-25T09:11:13.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec21800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec1c0aefa0 0x7fec1c0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec21800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fec1c15edd0 0x7fec1c0cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec21800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1c15f320 con 0x7fec1c0b3e70 2024-04-25T09:11:13.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec21800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1c06dd50 con 0x7fec1c15edd0 2024-04-25T09:11:13.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec21800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c06d420 con 0x7fec1c0aefa0 2024-04-25T09:11:13.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec1aa00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fec1c0b3e70 0x7fec1c0b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41536/0 (socket says 172.21.15.173:41536) 2024-04-25T09:11:13.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec1aa00640 1 -- 172.21.15.173:0/1952279554 learned_addr learned my addr 172.21.15.173:0/1952279554 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:13.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec19600640 1 -- 172.21.15.173:0/1952279554 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678493646 0 0) 0x7fec1c15f320 con 0x7fec1c0b3e70 2024-04-25T09:11:13.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec19600640 1 -- 172.21.15.173:0/1952279554 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec00003530 con 0x7fec1c0b3e70 2024-04-25T09:11:13.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec1a000640 1 --2- 172.21.15.173:0/1952279554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec1c0aefa0 0x7fec1c0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec1b400640 1 --2- 172.21.15.173:0/1952279554 >> v2:172.21.15.194:3300/0 conn(0x7fec1c15edd0 0x7fec1c0cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec19600640 1 -- 172.21.15.173:0/1952279554 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1210922217 0 0) 0x7fec00003530 con 0x7fec1c0b3e70 2024-04-25T09:11:13.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec19600640 1 -- 172.21.15.173:0/1952279554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec1c0aefa0 msgr2=0x7fec1c0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:13.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec19600640 1 --2- 172.21.15.173:0/1952279554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec1c0aefa0 0x7fec1c0cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec19600640 1 -- 172.21.15.173:0/1952279554 >> v2:172.21.15.194:3300/0 conn(0x7fec1c15edd0 msgr2=0x7fec1c0cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:13.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec19600640 1 --2- 172.21.15.173:0/1952279554 >> v2:172.21.15.194:3300/0 conn(0x7fec1c15edd0 0x7fec1c0cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec19600640 1 -- 172.21.15.173:0/1952279554 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c06d700 con 0x7fec1c0b3e70 2024-04-25T09:11:13.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec19600640 1 -- 172.21.15.173:0/1952279554 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fec0c001a00 con 0x7fec1c0b3e70 2024-04-25T09:11:13.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec1b400640 1 --2- 172.21.15.173:0/1952279554 >> v2:172.21.15.194:3300/0 conn(0x7fec1c15edd0 0x7fec1c0cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:13.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec19600640 1 -- 172.21.15.173:0/1952279554 >> v1:172.21.15.173:6789/0 conn(0x7fec1c0b3e70 legacy=0x7fec1c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec19600640 1 --2- 172.21.15.173:0/1952279554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec000039c0 0x7fec00003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec19600640 1 --2- 172.21.15.173:0/1952279554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec1c0aefa0 0x7fec00004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec19600640 1 --2- 172.21.15.173:0/1952279554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec00004d50 0x7fec000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec19600640 1 -- 172.21.15.173:0/1952279554 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c06dd50 con 0x7fec00004d50 2024-04-25T09:11:13.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec19600640 1 -- 172.21.15.173:0/1952279554 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c06d420 con 0x7fec000039c0 2024-04-25T09:11:13.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec19600640 1 -- 172.21.15.173:0/1952279554 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0000ba80 con 0x7fec1c0aefa0 2024-04-25T09:11:13.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec1b400640 1 --2- 172.21.15.173:0/1952279554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec00004d50 0x7fec000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec1a000640 1 --2- 172.21.15.173:0/1952279554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec1c0aefa0 0x7fec00004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec1aa00640 1 --2- 172.21.15.173:0/1952279554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec000039c0 0x7fec00003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec1b400640 1 -- 172.21.15.173:0/1952279554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec1c0aefa0 msgr2=0x7fec00004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:13.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec1b400640 1 --2- 172.21.15.173:0/1952279554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec1c0aefa0 0x7fec00004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec1b400640 1 -- 172.21.15.173:0/1952279554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec000039c0 msgr2=0x7fec00003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:13.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec1b400640 1 --2- 172.21.15.173:0/1952279554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec000039c0 0x7fec00003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.794+0000 7fec1b400640 1 -- 172.21.15.173:0/1952279554 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec00003530 con 0x7fec00004d50 2024-04-25T09:11:13.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.798+0000 7fec1b400640 1 --2- 172.21.15.173:0/1952279554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec00004d50 0x7fec000051d0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fec14009900 tx=0x7fec1401c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e007b006b153012 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:13.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.798+0000 7fec19600640 1 -- 172.21.15.173:0/1952279554 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec140ac070 con 0x7fec00004d50 2024-04-25T09:11:13.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.798+0000 7fec19600640 1 -- 172.21.15.173:0/1952279554 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec140a6640 con 0x7fec00004d50 2024-04-25T09:11:13.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.798+0000 7fec19600640 1 -- 172.21.15.173:0/1952279554 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400f040 con 0x7fec00004d50 2024-04-25T09:11:13.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.798+0000 7fec21800640 1 -- 172.21.15.173:0/1952279554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec00004d50 msgr2=0x7fec000051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.798+0000 7fec21800640 1 --2- 172.21.15.173:0/1952279554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec00004d50 0x7fec000051d0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fec14009900 tx=0x7fec1401c630 comp rx=0 tx=0).stop 2024-04-25T09:11:13.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.798+0000 7fec1b400640 1 -- 172.21.15.173:0/1952279554 reap_dead start 2024-04-25T09:11:13.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.798+0000 7fec21800640 1 -- 172.21.15.173:0/1952279554 shutdown_connections 2024-04-25T09:11:13.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.798+0000 7fec21800640 1 -- 172.21.15.173:0/1952279554 >> 172.21.15.173:0/1952279554 conn(0x7fec1c06ac90 msgr2=0x7fec1c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:13.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.798+0000 7fec21800640 1 -- 172.21.15.173:0/1952279554 shutdown_connections 2024-04-25T09:11:13.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.798+0000 7fec21800640 1 -- 172.21.15.173:0/1952279554 wait complete. 2024-04-25T09:11:13.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.798+0000 7fec21800640 1 Processor -- start 2024-04-25T09:11:13.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.798+0000 7fec21800640 1 -- start start 2024-04-25T09:11:13.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec21800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec00004d50 0x7fec1c149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec21800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec1c15cf80 0x7fec1c15d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec21800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec1c0ac8c0 0x7fec1c0acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec21800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c06e1e0 con 0x7fec1c0ac8c0 2024-04-25T09:11:13.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec21800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c15aba0 con 0x7fec00004d50 2024-04-25T09:11:13.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec21800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c06e360 con 0x7fec1c15cf80 2024-04-25T09:11:13.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec1b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec1c0ac8c0 0x7fec1c0acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec1b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec1c0ac8c0 0x7fec1c0acd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41438/0 (socket says 172.21.15.173:41438) 2024-04-25T09:11:13.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec1b400640 1 -- 172.21.15.173:0/1940756409 learned_addr learned my addr 172.21.15.173:0/1940756409 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:13.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec1aa00640 1 --2- 172.21.15.173:0/1940756409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec00004d50 0x7fec1c149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec1a000640 1 --2- 172.21.15.173:0/1940756409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec1c15cf80 0x7fec1c15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec1b400640 1 -- 172.21.15.173:0/1940756409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec1c15cf80 msgr2=0x7fec1c15d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec1b400640 1 --2- 172.21.15.173:0/1940756409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec1c15cf80 0x7fec1c15d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec1b400640 1 -- 172.21.15.173:0/1940756409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec00004d50 msgr2=0x7fec1c149650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec1b400640 1 --2- 172.21.15.173:0/1940756409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec00004d50 0x7fec1c149650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec1b400640 1 -- 172.21.15.173:0/1940756409 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c1595c0 con 0x7fec1c0ac8c0 2024-04-25T09:11:13.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec1b400640 1 --2- 172.21.15.173:0/1940756409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec1c0ac8c0 0x7fec1c0acd70 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fec14009900 tx=0x7fec140193d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:13.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec12a00640 1 -- 172.21.15.173:0/1940756409 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec140ac070 con 0x7fec1c0ac8c0 2024-04-25T09:11:13.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec12a00640 1 -- 172.21.15.173:0/1940756409 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec14000e50 con 0x7fec1c0ac8c0 2024-04-25T09:11:13.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec21800640 1 -- 172.21.15.173:0/1940756409 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1c0ad4a0 con 0x7fec1c0ac8c0 2024-04-25T09:11:13.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec12a00640 1 -- 172.21.15.173:0/1940756409 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec140a6e30 con 0x7fec1c0ac8c0 2024-04-25T09:11:13.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec21800640 1 -- 172.21.15.173:0/1940756409 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c0b16f0 con 0x7fec1c0ac8c0 2024-04-25T09:11:13.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.802+0000 7fec21800640 1 -- 172.21.15.173:0/1940756409 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1c073a40 con 0x7fec1c0ac8c0 2024-04-25T09:11:13.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.806+0000 7fec12a00640 1 -- 172.21.15.173:0/1940756409 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fec140b8070 con 0x7fec1c0ac8c0 2024-04-25T09:11:13.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.806+0000 7fec12a00640 1 --2- 172.21.15.173:0/1940756409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7febfc066f60 0x7febfc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.806+0000 7fec12a00640 1 -- 172.21.15.173:0/1940756409 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fec1411ed90 con 0x7fec1c0ac8c0 2024-04-25T09:11:13.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.806+0000 7fec1aa00640 1 --2- 172.21.15.173:0/1940756409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7febfc066f60 0x7febfc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.806+0000 7fec1aa00640 1 --2- 172.21.15.173:0/1940756409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7febfc066f60 0x7febfc069420 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0b1500 tx=0x7fec0c006040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:13.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.810+0000 7fec12a00640 1 -- 172.21.15.173:0/1940756409 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fec1c1595c0 con 0x7fec1c0ac8c0 2024-04-25T09:11:13.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.994+0000 7fec21800640 1 -- 172.21.15.173:0/1940756409 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec1c06f1c0 con 0x7fec1c0ac8c0 2024-04-25T09:11:13.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.998+0000 7fec12a00640 1 -- 172.21.15.173:0/1940756409 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4949 (secure 0 0 0) 0x7fec14016340 con 0x7fec1c0ac8c0 2024-04-25T09:11:13.982 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:13.982 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1519522112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1519522112},{"type":"v1","addr":"172.21.15.194:6835","nonce":1519522112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7555,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/548680290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":548680290},{"type":"v1","addr":"172.21.15.173:6836","nonce":548680290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2602621503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2602621503},{"type":"v1","addr":"172.21.15.194:6833","nonce":2602621503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:24.354981+0000","modified":"2024-04-25T09:10:27.392053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8193":{"gid":8193,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/1492125936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":1492125936},{"type":"v1","addr":"172.21.15.173:6837","nonce":1492125936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:11:13.982 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 72 2024-04-25T09:11:13.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.998+0000 7fec21800640 1 -- 172.21.15.173:0/1940756409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7febfc066f60 msgr2=0x7febfc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.998+0000 7fec21800640 1 --2- 172.21.15.173:0/1940756409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7febfc066f60 0x7febfc069420 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0b1500 tx=0x7fec0c006040 comp rx=0 tx=0).stop 2024-04-25T09:11:13.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.998+0000 7fec21800640 1 -- 172.21.15.173:0/1940756409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec1c0ac8c0 msgr2=0x7fec1c0acd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.998+0000 7fec21800640 1 --2- 172.21.15.173:0/1940756409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec1c0ac8c0 0x7fec1c0acd70 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fec14009900 tx=0x7fec140193d0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.998+0000 7fec21800640 1 -- 172.21.15.173:0/1940756409 shutdown_connections 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.998+0000 7fec21800640 1 --2- 172.21.15.173:0/1940756409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7febfc066f60 0x7febfc069420 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.998+0000 7fec21800640 1 --2- 172.21.15.173:0/1940756409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec1c0ac8c0 0x7fec1c0acd70 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.998+0000 7fec21800640 1 --2- 172.21.15.173:0/1940756409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec1c15cf80 0x7fec1c15d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.998+0000 7fec21800640 1 --2- 172.21.15.173:0/1940756409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec00004d50 0x7fec1c149650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.998+0000 7fec21800640 1 -- 172.21.15.173:0/1940756409 >> 172.21.15.173:0/1940756409 conn(0x7fec1c06ac90 msgr2=0x7fec1c0ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.998+0000 7fec21800640 1 -- 172.21.15.173:0/1940756409 shutdown_connections 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:13.998+0000 7fec21800640 1 -- 172.21.15.173:0/1940756409 wait complete. 2024-04-25T09:11:14.003 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:14.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.154+0000 7f9128800640 1 Processor -- start 2024-04-25T09:11:14.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.154+0000 7f9128800640 1 -- start start 2024-04-25T09:11:14.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.154+0000 7f9128800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f912015e040 0x7f91200ace10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.154+0000 7f9128800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912015e8e0 con 0x7f91200ad350 2024-04-25T09:11:14.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.154+0000 7f9128800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912015ebc0 con 0x7f912015dc60 2024-04-25T09:11:14.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.154+0000 7f9128800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9120071450 con 0x7f912015e040 2024-04-25T09:11:14.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.154+0000 7f9125400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f912015e040 0x7f91200ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.154+0000 7f9126800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f91200ad350 0x7f91200ae810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41540/0 (socket says 172.21.15.173:41540) 2024-04-25T09:11:14.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.154+0000 7f9126800640 1 -- 172.21.15.173:0/3980261065 learned_addr learned my addr 172.21.15.173:0/3980261065 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:14.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.154+0000 7f9125400640 1 -- 172.21.15.173:0/3980261065 >> v1:172.21.15.194:6789/0 conn(0x7f912015dc60 legacy=0x7f91200b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.154+0000 7f9125400640 1 -- 172.21.15.173:0/3980261065 >> v1:172.21.15.173:6789/0 conn(0x7f91200ad350 legacy=0x7f91200ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.154+0000 7f9125400640 1 -- 172.21.15.173:0/3980261065 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912015eea0 con 0x7f912015e040 2024-04-25T09:11:14.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.158+0000 7f9125400640 1 --2- 172.21.15.173:0/3980261065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f912015e040 0x7f91200ace10 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f91100097c0 tx=0x7f911001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc351b41344f85be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:14.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.158+0000 7f9124a00640 1 -- 172.21.15.173:0/3980261065 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91100b1070 con 0x7f912015e040 2024-04-25T09:11:14.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.158+0000 7f9124a00640 1 -- 172.21.15.173:0/3980261065 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91100ac410 con 0x7f912015e040 2024-04-25T09:11:14.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.158+0000 7f9124a00640 1 -- 172.21.15.173:0/3980261065 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91100ac7e0 con 0x7f912015e040 2024-04-25T09:11:14.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.158+0000 7f9128800640 1 -- 172.21.15.173:0/3980261065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f912015e040 msgr2=0x7f91200ace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.158+0000 7f9128800640 1 --2- 172.21.15.173:0/3980261065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f912015e040 0x7f91200ace10 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f91100097c0 tx=0x7f911001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.158+0000 7f9128800640 1 -- 172.21.15.173:0/3980261065 shutdown_connections 2024-04-25T09:11:14.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.158+0000 7f9128800640 1 --2- 172.21.15.173:0/3980261065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f912015e040 0x7f91200ace10 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.158+0000 7f9128800640 1 -- 172.21.15.173:0/3980261065 >> 172.21.15.173:0/3980261065 conn(0x7f912006ac90 msgr2=0x7f912006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:14.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.158+0000 7f9128800640 1 -- 172.21.15.173:0/3980261065 shutdown_connections 2024-04-25T09:11:14.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.158+0000 7f9128800640 1 -- 172.21.15.173:0/3980261065 wait complete. 2024-04-25T09:11:14.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9128800640 1 Processor -- start 2024-04-25T09:11:14.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9128800640 1 -- start start 2024-04-25T09:11:14.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9128800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91200ad350 0x7f9120143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9128800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f912015dc60 0x7f91201544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9128800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912015e040 0x7f912015f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9128800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91200720d0 con 0x7f91200ad350 2024-04-25T09:11:14.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9128800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91200af130 con 0x7f912015dc60 2024-04-25T09:11:14.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9128800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9120072250 con 0x7f912015e040 2024-04-25T09:11:14.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9125e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91200ad350 0x7f9120143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9125e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91200ad350 0x7f9120143130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41448/0 (socket says 172.21.15.173:41448) 2024-04-25T09:11:14.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9125e00640 1 -- 172.21.15.173:0/274904857 learned_addr learned my addr 172.21.15.173:0/274904857 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:14.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9125400640 1 --2- 172.21.15.173:0/274904857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f912015dc60 0x7f91201544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9126800640 1 --2- 172.21.15.173:0/274904857 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912015e040 0x7f912015f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9125e00640 1 -- 172.21.15.173:0/274904857 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912015e040 msgr2=0x7f912015f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9125e00640 1 --2- 172.21.15.173:0/274904857 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912015e040 0x7f912015f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9125e00640 1 -- 172.21.15.173:0/274904857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f912015dc60 msgr2=0x7f91201544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9125e00640 1 --2- 172.21.15.173:0/274904857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f912015dc60 0x7f91201544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9125e00640 1 -- 172.21.15.173:0/274904857 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9120158cf0 con 0x7f91200ad350 2024-04-25T09:11:14.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9126800640 1 --2- 172.21.15.173:0/274904857 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912015e040 0x7f912015f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:14.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9125e00640 1 --2- 172.21.15.173:0/274904857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91200ad350 0x7f9120143130 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f911400c450 tx=0x7f911400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:14.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f911a000640 1 -- 172.21.15.173:0/274904857 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9114016020 con 0x7f91200ad350 2024-04-25T09:11:14.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f911a000640 1 -- 172.21.15.173:0/274904857 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91140052d0 con 0x7f91200ad350 2024-04-25T09:11:14.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f911a000640 1 -- 172.21.15.173:0/274904857 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9114007260 con 0x7f91200ad350 2024-04-25T09:11:14.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9128800640 1 -- 172.21.15.173:0/274904857 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9120143670 con 0x7f91200ad350 2024-04-25T09:11:14.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.162+0000 7f9128800640 1 -- 172.21.15.173:0/274904857 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91200cdb70 con 0x7f91200ad350 2024-04-25T09:11:14.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.166+0000 7f9128800640 1 -- 172.21.15.173:0/274904857 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9120073a40 con 0x7f91200ad350 2024-04-25T09:11:14.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.166+0000 7f911a000640 1 -- 172.21.15.173:0/274904857 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9114007400 con 0x7f91200ad350 2024-04-25T09:11:14.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.166+0000 7f911a000640 1 --2- 172.21.15.173:0/274904857 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9104066f60 0x7f9104069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.166+0000 7f911a000640 1 -- 172.21.15.173:0/274904857 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f9114084a40 con 0x7f91200ad350 2024-04-25T09:11:14.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.166+0000 7f9125400640 1 --2- 172.21.15.173:0/274904857 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9104066f60 0x7f9104069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.166+0000 7f9125400640 1 --2- 172.21.15.173:0/274904857 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9104066f60 0x7f9104069420 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f91100ae000 tx=0x7f9110008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:14.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.170+0000 7f911a000640 1 -- 172.21.15.173:0/274904857 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9114020020 con 0x7f91200ad350 2024-04-25T09:11:14.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.326+0000 7f9128800640 1 -- 172.21.15.173:0/274904857 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91200b2ec0 con 0x7f91200ad350 2024-04-25T09:11:14.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.326+0000 7f911a000640 1 -- 172.21.15.173:0/274904857 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16994 (secure 0 0 0) 0x7f9114005480 con 0x7f91200ad350 2024-04-25T09:11:14.312 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:14.312 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":111,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:10:34.497380+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:22.062377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:23.359080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.35","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:14.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.330+0000 7f9128800640 1 -- 172.21.15.173:0/274904857 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9104066f60 msgr2=0x7f9104069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.330+0000 7f9128800640 1 --2- 172.21.15.173:0/274904857 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9104066f60 0x7f9104069420 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f91100ae000 tx=0x7f9110008040 comp rx=0 tx=0).stop 2024-04-25T09:11:14.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.330+0000 7f9128800640 1 -- 172.21.15.173:0/274904857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91200ad350 msgr2=0x7f9120143130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.330+0000 7f9128800640 1 --2- 172.21.15.173:0/274904857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91200ad350 0x7f9120143130 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f911400c450 tx=0x7f911400c910 comp rx=0 tx=0).stop 2024-04-25T09:11:14.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.330+0000 7f9128800640 1 -- 172.21.15.173:0/274904857 shutdown_connections 2024-04-25T09:11:14.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.330+0000 7f9128800640 1 --2- 172.21.15.173:0/274904857 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9104066f60 0x7f9104069420 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.330+0000 7f9128800640 1 --2- 172.21.15.173:0/274904857 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912015e040 0x7f912015f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.330+0000 7f9128800640 1 --2- 172.21.15.173:0/274904857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f912015dc60 0x7f91201544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.330+0000 7f9128800640 1 --2- 172.21.15.173:0/274904857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91200ad350 0x7f9120143130 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.330+0000 7f9128800640 1 -- 172.21.15.173:0/274904857 >> 172.21.15.173:0/274904857 conn(0x7f912006ac90 msgr2=0x7f912006e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:14.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.330+0000 7f9128800640 1 -- 172.21.15.173:0/274904857 shutdown_connections 2024-04-25T09:11:14.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.330+0000 7f9128800640 1 -- 172.21.15.173:0/274904857 wait complete. 2024-04-25T09:11:14.333 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:11:14.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.486+0000 7f9508400640 1 Processor -- start 2024-04-25T09:11:14.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.486+0000 7f9508400640 1 -- start start 2024-04-25T09:11:14.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.486+0000 7f9508400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95000aeb90 0x7f95000cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.486+0000 7f9508400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f95000ce2b0 0x7f95000cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.486+0000 7f9508400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9500071570 con 0x7f95000aef70 2024-04-25T09:11:14.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.486+0000 7f9508400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9500071320 con 0x7f95000ce2b0 2024-04-25T09:11:14.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.486+0000 7f9508400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9500072330 con 0x7f95000aeb90 2024-04-25T09:11:14.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.486+0000 7f9506400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f95000ce2b0 0x7f95000cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.486+0000 7f9505000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f95000aef70 0x7f95000cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41548/0 (socket says 172.21.15.173:41548) 2024-04-25T09:11:14.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.486+0000 7f9505000640 1 -- 172.21.15.173:0/1465903583 learned_addr learned my addr 172.21.15.173:0/1465903583 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:14.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.486+0000 7f9505a00640 1 --2- 172.21.15.173:0/1465903583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95000aeb90 0x7f95000cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.486+0000 7f9506400640 1 -- 172.21.15.173:0/1465903583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95000aeb90 msgr2=0x7f95000cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:14.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.486+0000 7f9506400640 1 --2- 172.21.15.173:0/1465903583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95000aeb90 0x7f95000cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.486+0000 7f9506400640 1 -- 172.21.15.173:0/1465903583 >> v1:172.21.15.173:6789/0 conn(0x7f95000aef70 legacy=0x7f95000cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.486+0000 7f9506400640 1 -- 172.21.15.173:0/1465903583 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9500071850 con 0x7f95000ce2b0 2024-04-25T09:11:14.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.486+0000 7f94ffe00640 1 -- 172.21.15.173:0/1465903583 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783182657 0 0) 0x7f9500071570 con 0x7f95000aef70 2024-04-25T09:11:14.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.490+0000 7f9506400640 1 --2- 172.21.15.173:0/1465903583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95000ce2b0 0x7f95000cc610 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009d90 tx=0x7f94f801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3f04c789ad3ca2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:14.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.490+0000 7f94ffe00640 1 -- 172.21.15.173:0/1465903583 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f80b2070 con 0x7f95000ce2b0 2024-04-25T09:11:14.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.490+0000 7f94ffe00640 1 -- 172.21.15.173:0/1465903583 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f80a5870 con 0x7f95000ce2b0 2024-04-25T09:11:14.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.490+0000 7f94ffe00640 1 -- 172.21.15.173:0/1465903583 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f80a5c40 con 0x7f95000ce2b0 2024-04-25T09:11:14.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.490+0000 7f9508400640 1 -- 172.21.15.173:0/1465903583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95000ce2b0 msgr2=0x7f95000cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.490+0000 7f9508400640 1 --2- 172.21.15.173:0/1465903583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95000ce2b0 0x7f95000cc610 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009d90 tx=0x7f94f801c8b0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.490+0000 7f9508400640 1 -- 172.21.15.173:0/1465903583 shutdown_connections 2024-04-25T09:11:14.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.490+0000 7f9508400640 1 --2- 172.21.15.173:0/1465903583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95000ce2b0 0x7f95000cc610 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.490+0000 7f9508400640 1 --2- 172.21.15.173:0/1465903583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95000aeb90 0x7f95000cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.490+0000 7f9508400640 1 -- 172.21.15.173:0/1465903583 >> 172.21.15.173:0/1465903583 conn(0x7f950006ac90 msgr2=0x7f950006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:14.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.490+0000 7f9508400640 1 -- 172.21.15.173:0/1465903583 shutdown_connections 2024-04-25T09:11:14.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.490+0000 7f9508400640 1 -- 172.21.15.173:0/1465903583 wait complete. 2024-04-25T09:11:14.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.490+0000 7f9508400640 1 Processor -- start 2024-04-25T09:11:14.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.490+0000 7f9508400640 1 -- start start 2024-04-25T09:11:14.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9508400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95000aeb90 0x7f95000adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9508400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95000aef70 0x7f950014e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9508400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95000ce2b0 0x7f950014e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9508400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950015bb30 con 0x7f95000ce2b0 2024-04-25T09:11:14.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9508400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950015b9b0 con 0x7f95000aef70 2024-04-25T09:11:14.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9508400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950015bcb0 con 0x7f95000aeb90 2024-04-25T09:11:14.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9506400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95000ce2b0 0x7f950014e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9506400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95000ce2b0 0x7f950014e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41464/0 (socket says 172.21.15.173:41464) 2024-04-25T09:11:14.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9506400640 1 -- 172.21.15.173:0/3400573463 learned_addr learned my addr 172.21.15.173:0/3400573463 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:14.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9505a00640 1 --2- 172.21.15.173:0/3400573463 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95000aeb90 0x7f95000adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9505000640 1 --2- 172.21.15.173:0/3400573463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95000aef70 0x7f950014e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9506400640 1 -- 172.21.15.173:0/3400573463 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95000aeb90 msgr2=0x7f95000adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9506400640 1 --2- 172.21.15.173:0/3400573463 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95000aeb90 0x7f95000adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9506400640 1 -- 172.21.15.173:0/3400573463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95000aef70 msgr2=0x7f950014e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9506400640 1 --2- 172.21.15.173:0/3400573463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95000aef70 0x7f950014e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9506400640 1 -- 172.21.15.173:0/3400573463 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95001553a0 con 0x7f95000ce2b0 2024-04-25T09:11:14.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9505000640 1 --2- 172.21.15.173:0/3400573463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95000aef70 0x7f950014e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:14.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9506400640 1 --2- 172.21.15.173:0/3400573463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95000ce2b0 0x7f950014e790 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009d90 tx=0x7f94f8019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:14.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f94fd600640 1 -- 172.21.15.173:0/3400573463 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f80bd020 con 0x7f95000ce2b0 2024-04-25T09:11:14.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f94fd600640 1 -- 172.21.15.173:0/3400573463 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f80b3040 con 0x7f95000ce2b0 2024-04-25T09:11:14.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9508400640 1 -- 172.21.15.173:0/3400573463 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95000ae1d0 con 0x7f95000ce2b0 2024-04-25T09:11:14.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f94fd600640 1 -- 172.21.15.173:0/3400573463 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f80b2050 con 0x7f95000ce2b0 2024-04-25T09:11:14.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9508400640 1 -- 172.21.15.173:0/3400573463 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9500156d40 con 0x7f95000ce2b0 2024-04-25T09:11:14.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.494+0000 7f9508400640 1 -- 172.21.15.173:0/3400573463 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9500073ab0 con 0x7f95000ce2b0 2024-04-25T09:11:14.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.498+0000 7f94fd600640 1 -- 172.21.15.173:0/3400573463 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f94f80ad650 con 0x7f95000ce2b0 2024-04-25T09:11:14.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.498+0000 7f94fd600640 1 --2- 172.21.15.173:0/3400573463 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f94e0066f60 0x7f94e0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.498+0000 7f94fd600640 1 -- 172.21.15.173:0/3400573463 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f94f811fd70 con 0x7f95000ce2b0 2024-04-25T09:11:14.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.498+0000 7f9505a00640 1 --2- 172.21.15.173:0/3400573463 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f94e0066f60 0x7f94e0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.498+0000 7f9505a00640 1 --2- 172.21.15.173:0/3400573463 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f94e0066f60 0x7f94e0069420 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f94f40079c0 tx=0x7f94f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:14.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.502+0000 7f94fd600640 1 -- 172.21.15.173:0/3400573463 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f94f80c7060 con 0x7f95000ce2b0 2024-04-25T09:11:14.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.690+0000 7f9508400640 1 -- 172.21.15.173:0/3400573463 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f950006c300 con 0x7f95000ce2b0 2024-04-25T09:11:14.674 INFO:tasks.ceph.mon.a.smithi173.stderr:2024-04-25T09:11:14.690+0000 7f537be00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:11:14.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.690+0000 7f94fd600640 1 -- 172.21.15.173:0/3400573463 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) v1 ==== 161+0+0 (secure 0 0 0) 0x7f94f8016560 con 0x7f95000ce2b0 2024-04-25T09:11:14.676 INFO:teuthology.orchestra.run.smithi173.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:11:14.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.694+0000 7f9508400640 1 -- 172.21.15.173:0/3400573463 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f94e0066f60 msgr2=0x7f94e0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.694+0000 7f9508400640 1 --2- 172.21.15.173:0/3400573463 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f94e0066f60 0x7f94e0069420 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f94f40079c0 tx=0x7f94f4008040 comp rx=0 tx=0).stop 2024-04-25T09:11:14.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.694+0000 7f9508400640 1 -- 172.21.15.173:0/3400573463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95000ce2b0 msgr2=0x7f950014e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.694+0000 7f9508400640 1 --2- 172.21.15.173:0/3400573463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95000ce2b0 0x7f950014e790 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009d90 tx=0x7f94f8019650 comp rx=0 tx=0).stop 2024-04-25T09:11:14.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.694+0000 7f9508400640 1 -- 172.21.15.173:0/3400573463 shutdown_connections 2024-04-25T09:11:14.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.694+0000 7f9508400640 1 --2- 172.21.15.173:0/3400573463 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f94e0066f60 0x7f94e0069420 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.694+0000 7f9508400640 1 --2- 172.21.15.173:0/3400573463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95000ce2b0 0x7f950014e790 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.694+0000 7f9508400640 1 --2- 172.21.15.173:0/3400573463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95000aef70 0x7f950014e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.694+0000 7f9508400640 1 --2- 172.21.15.173:0/3400573463 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95000aeb90 0x7f95000adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.694+0000 7f9508400640 1 -- 172.21.15.173:0/3400573463 >> 172.21.15.173:0/3400573463 conn(0x7f950006ac90 msgr2=0x7f950015d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:14.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.694+0000 7f9508400640 1 -- 172.21.15.173:0/3400573463 shutdown_connections 2024-04-25T09:11:14.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.694+0000 7f9508400640 1 -- 172.21.15.173:0/3400573463 wait complete. 2024-04-25T09:11:14.699 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:11:14.748 INFO:tasks.ceph.mds.c.smithi173.stdout:starting mds.c at 2024-04-25T09:11:14.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.854+0000 7fcaed200640 1 Processor -- start 2024-04-25T09:11:14.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.854+0000 7fcaed200640 1 -- start start 2024-04-25T09:11:14.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.858+0000 7fcaed200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae8158210 0x7fcae80b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.858+0000 7fcaed200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcae8071580 0x7fcae80b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.858+0000 7fcaed200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae80b1190 con 0x7fcae80b0cf0 2024-04-25T09:11:14.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.858+0000 7fcaed200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae815e5d0 con 0x7fcae8071580 2024-04-25T09:11:14.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.858+0000 7fcaed200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae815e8b0 con 0x7fcae8158210 2024-04-25T09:11:14.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.858+0000 7fcae6800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcae8071580 0x7fcae80b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.858+0000 7fcae6800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcae8071580 0x7fcae80b5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41474/0 (socket says 172.21.15.173:41474) 2024-04-25T09:11:14.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.858+0000 7fcae6800640 1 -- 172.21.15.173:0/2242239899 learned_addr learned my addr 172.21.15.173:0/2242239899 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:14.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.858+0000 7fcae5e00640 1 --2- 172.21.15.173:0/2242239899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae8158210 0x7fcae80b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.858+0000 7fcae6800640 1 -- 172.21.15.173:0/2242239899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae8158210 msgr2=0x7fcae80b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:14.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.858+0000 7fcae6800640 1 --2- 172.21.15.173:0/2242239899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae8158210 0x7fcae80b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.858+0000 7fcae6800640 1 -- 172.21.15.173:0/2242239899 >> v1:172.21.15.194:6789/0 conn(0x7fcae80b0cf0 legacy=0x7fcae8070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:14.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.858+0000 7fcae6800640 1 -- 172.21.15.173:0/2242239899 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae815eb90 con 0x7fcae8071580 2024-04-25T09:11:14.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.858+0000 7fcae5e00640 1 --2- 172.21.15.173:0/2242239899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae8158210 0x7fcae80b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:14.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcae6800640 1 --2- 172.21.15.173:0/2242239899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcae8071580 0x7fcae80b5a60 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fcae0009e50 tx=0x7fcae001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86bdf431a6e04090 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:14.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcae5400640 1 -- 172.21.15.173:0/2242239899 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae00a5800 con 0x7fcae8071580 2024-04-25T09:11:14.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcae5400640 1 -- 172.21.15.173:0/2242239899 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae80b67b0 con 0x7fcae8071580 2024-04-25T09:11:14.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcae5400640 1 -- 172.21.15.173:0/2242239899 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae00a5bc0 con 0x7fcae8071580 2024-04-25T09:11:14.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcaed200640 1 -- 172.21.15.173:0/2242239899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcae8071580 msgr2=0x7fcae80b5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcaed200640 1 --2- 172.21.15.173:0/2242239899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcae8071580 0x7fcae80b5a60 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fcae0009e50 tx=0x7fcae001c920 comp rx=0 tx=0).stop 2024-04-25T09:11:14.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcaed200640 1 -- 172.21.15.173:0/2242239899 shutdown_connections 2024-04-25T09:11:14.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcaed200640 1 --2- 172.21.15.173:0/2242239899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcae8071580 0x7fcae80b5a60 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcaed200640 1 --2- 172.21.15.173:0/2242239899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae8158210 0x7fcae80b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcaed200640 1 -- 172.21.15.173:0/2242239899 >> 172.21.15.173:0/2242239899 conn(0x7fcae80b3540 msgr2=0x7fcae80b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:14.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcaed200640 1 -- 172.21.15.173:0/2242239899 shutdown_connections 2024-04-25T09:11:14.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcaed200640 1 -- 172.21.15.173:0/2242239899 wait complete. 2024-04-25T09:11:14.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcaed200640 1 Processor -- start 2024-04-25T09:11:14.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcaed200640 1 -- start start 2024-04-25T09:11:14.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcaed200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcae8071580 0x7fcae8160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcaed200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcae80b0cf0 0x7fcae80cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcaed200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae8158210 0x7fcae80b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcaed200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae806cd60 con 0x7fcae8071580 2024-04-25T09:11:14.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcaed200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae815f2c0 con 0x7fcae80b0cf0 2024-04-25T09:11:14.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcaed200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae806cee0 con 0x7fcae8158210 2024-04-25T09:11:14.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.862+0000 7fcae5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcae8071580 0x7fcae8160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcae5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcae8071580 0x7fcae8160ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41488/0 (socket says 172.21.15.173:41488) 2024-04-25T09:11:14.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcae5e00640 1 -- 172.21.15.173:0/3793316280 learned_addr learned my addr 172.21.15.173:0/3793316280 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:14.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcae6800640 1 --2- 172.21.15.173:0/3793316280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae8158210 0x7fcae80b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcadd400640 1 --2- 172.21.15.173:0/3793316280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcae80b0cf0 0x7fcae80cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcae5e00640 1 -- 172.21.15.173:0/3793316280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae8158210 msgr2=0x7fcae80b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcae5e00640 1 --2- 172.21.15.173:0/3793316280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae8158210 0x7fcae80b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcae5e00640 1 -- 172.21.15.173:0/3793316280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcae80b0cf0 msgr2=0x7fcae80cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcae5e00640 1 --2- 172.21.15.173:0/3793316280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcae80b0cf0 0x7fcae80cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcae5e00640 1 -- 172.21.15.173:0/3793316280 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae8161230 con 0x7fcae8071580 2024-04-25T09:11:14.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcae5e00640 1 --2- 172.21.15.173:0/3793316280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcae8071580 0x7fcae8160ba0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fcad800c7f0 tx=0x7fcad800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:14.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcadea00640 1 -- 172.21.15.173:0/3793316280 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8015070 con 0x7fcae8071580 2024-04-25T09:11:14.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcadea00640 1 -- 172.21.15.173:0/3793316280 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad8007820 con 0x7fcae8071580 2024-04-25T09:11:14.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcaed200640 1 -- 172.21.15.173:0/3793316280 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae80b39c0 con 0x7fcae8071580 2024-04-25T09:11:14.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcadea00640 1 -- 172.21.15.173:0/3793316280 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8007c10 con 0x7fcae8071580 2024-04-25T09:11:14.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcaed200640 1 -- 172.21.15.173:0/3793316280 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae80b3f80 con 0x7fcae8071580 2024-04-25T09:11:14.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcaed200640 1 -- 172.21.15.173:0/3793316280 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae8073ab0 con 0x7fcae8071580 2024-04-25T09:11:14.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcadea00640 1 -- 172.21.15.173:0/3793316280 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcad8018070 con 0x7fcae8071580 2024-04-25T09:11:14.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcadea00640 1 --2- 172.21.15.173:0/3793316280 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcac4066f60 0x7fcac4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcadea00640 1 -- 172.21.15.173:0/3793316280 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6216+0+0 (secure 0 0 0) 0x7fcad8085390 con 0x7fcae8071580 2024-04-25T09:11:14.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.866+0000 7fcadd400640 1 --2- 172.21.15.173:0/3793316280 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcac4066f60 0x7fcac4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.870+0000 7fcadd400640 1 --2- 172.21.15.173:0/3793316280 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcac4066f60 0x7fcac4069420 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcae80cc430 tx=0x7fcad0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:14.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:14.870+0000 7fcadea00640 1 -- 172.21.15.173:0/3793316280 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcad8056100 con 0x7fcae8071580 2024-04-25T09:11:15.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.058+0000 7fcaed200640 1 -- 172.21.15.173:0/3793316280 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcae8071080 con 0x7fcae8071580 2024-04-25T09:11:15.189 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:11:15.193 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:11:15.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.698+0000 7fcadea00640 1 -- 172.21.15.173:0/3793316280 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v74) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcad8055a00 con 0x7fcae8071580 2024-04-25T09:11:15.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.702+0000 7fcaed200640 1 -- 172.21.15.173:0/3793316280 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcac4066f60 msgr2=0x7fcac4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.702+0000 7fcaed200640 1 --2- 172.21.15.173:0/3793316280 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcac4066f60 0x7fcac4069420 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcae80cc430 tx=0x7fcad0009040 comp rx=0 tx=0).stop 2024-04-25T09:11:15.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.702+0000 7fcaed200640 1 -- 172.21.15.173:0/3793316280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcae8071580 msgr2=0x7fcae8160ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.702+0000 7fcaed200640 1 --2- 172.21.15.173:0/3793316280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcae8071580 0x7fcae8160ba0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fcad800c7f0 tx=0x7fcad800ccb0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.702+0000 7fcaed200640 1 -- 172.21.15.173:0/3793316280 shutdown_connections 2024-04-25T09:11:15.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.702+0000 7fcaed200640 1 --2- 172.21.15.173:0/3793316280 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcac4066f60 0x7fcac4069420 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.702+0000 7fcaed200640 1 --2- 172.21.15.173:0/3793316280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcae8158210 0x7fcae80b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.702+0000 7fcaed200640 1 --2- 172.21.15.173:0/3793316280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcae80b0cf0 0x7fcae80cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.702+0000 7fcaed200640 1 --2- 172.21.15.173:0/3793316280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcae8071580 0x7fcae8160ba0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.702+0000 7fcaed200640 1 -- 172.21.15.173:0/3793316280 >> 172.21.15.173:0/3793316280 conn(0x7fcae80b3540 msgr2=0x7fcae80d1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:15.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.702+0000 7fcaed200640 1 -- 172.21.15.173:0/3793316280 shutdown_connections 2024-04-25T09:11:15.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.702+0000 7fcaed200640 1 -- 172.21.15.173:0/3793316280 wait complete. 2024-04-25T09:11:15.709 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:11:15.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.862+0000 7f9a5c400640 1 Processor -- start 2024-04-25T09:11:15.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.862+0000 7f9a5c400640 1 -- start start 2024-04-25T09:11:15.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a5c400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a540cda00 0x7f9a541650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a5c400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5415ddd0 con 0x7f9a540cff40 2024-04-25T09:11:15.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a5c400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5415e0b0 con 0x7f9a54159f00 2024-04-25T09:11:15.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a5c400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a54072330 con 0x7f9a540cda00 2024-04-25T09:11:15.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a59000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f9a540cff40 0x7f9a540cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41566/0 (socket says 172.21.15.173:41566) 2024-04-25T09:11:15.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a59000640 1 -- 172.21.15.173:0/3236976828 learned_addr learned my addr 172.21.15.173:0/3236976828 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:15.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a5a400640 1 --2- 172.21.15.173:0/3236976828 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a540cda00 0x7f9a541650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a53e00640 1 -- 172.21.15.173:0/3236976828 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015967645 0 0) 0x7f9a5415ddd0 con 0x7f9a540cff40 2024-04-25T09:11:15.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a53e00640 1 -- 172.21.15.173:0/3236976828 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a3c003450 con 0x7f9a540cff40 2024-04-25T09:11:15.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a53e00640 1 -- 172.21.15.173:0/3236976828 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730768903 0 0) 0x7f9a5415e0b0 con 0x7f9a54159f00 2024-04-25T09:11:15.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a53e00640 1 -- 172.21.15.173:0/3236976828 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a5415ddd0 con 0x7f9a54159f00 2024-04-25T09:11:15.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a53e00640 1 -- 172.21.15.173:0/3236976828 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 121042342 0 0) 0x7f9a3c003450 con 0x7f9a540cff40 2024-04-25T09:11:15.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a53e00640 1 -- 172.21.15.173:0/3236976828 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a540cda00 msgr2=0x7f9a541650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:15.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a53e00640 1 --2- 172.21.15.173:0/3236976828 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a540cda00 0x7f9a541650c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a53e00640 1 -- 172.21.15.173:0/3236976828 >> v1:172.21.15.194:6789/0 conn(0x7f9a54159f00 legacy=0x7f9a540cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a53e00640 1 -- 172.21.15.173:0/3236976828 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5415e390 con 0x7f9a540cff40 2024-04-25T09:11:15.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a53e00640 1 -- 172.21.15.173:0/3236976828 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f9a40001680 con 0x7f9a540cff40 2024-04-25T09:11:15.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a53e00640 1 -- 172.21.15.173:0/3236976828 >> v1:172.21.15.173:6789/0 conn(0x7f9a540cff40 legacy=0x7f9a540cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a53e00640 1 --2- 172.21.15.173:0/3236976828 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a540cda00 0x7f9a3c003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a53e00640 1 --2- 172.21.15.173:0/3236976828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a3c008860 0x7f9a3c00ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a53e00640 1 --2- 172.21.15.173:0/3236976828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a3c00b190 0x7f9a3c00d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a53e00640 1 -- 172.21.15.173:0/3236976828 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c00dc80 con 0x7f9a3c00b190 2024-04-25T09:11:15.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a53e00640 1 -- 172.21.15.173:0/3236976828 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c00de30 con 0x7f9a3c008860 2024-04-25T09:11:15.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a53e00640 1 -- 172.21.15.173:0/3236976828 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c00e030 con 0x7f9a540cda00 2024-04-25T09:11:15.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a5a400640 1 --2- 172.21.15.173:0/3236976828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a3c00b190 0x7f9a3c00d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a59000640 1 --2- 172.21.15.173:0/3236976828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a3c008860 0x7f9a3c00ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a59a00640 1 --2- 172.21.15.173:0/3236976828 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a540cda00 0x7f9a3c003c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a5a400640 1 -- 172.21.15.173:0/3236976828 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a540cda00 msgr2=0x7f9a3c003c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:15.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a5a400640 1 --2- 172.21.15.173:0/3236976828 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a540cda00 0x7f9a3c003c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a5a400640 1 -- 172.21.15.173:0/3236976828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a3c008860 msgr2=0x7f9a3c00ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:15.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a5a400640 1 --2- 172.21.15.173:0/3236976828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a3c008860 0x7f9a3c00ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.866+0000 7f9a5a400640 1 -- 172.21.15.173:0/3236976828 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c003450 con 0x7f9a3c00b190 2024-04-25T09:11:15.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.870+0000 7f9a5a400640 1 --2- 172.21.15.173:0/3236976828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a3c00b190 0x7f9a3c00d580 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009ab0 tx=0x7f9a4c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a4d5ff4f2804ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:15.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.870+0000 7f9a53e00640 1 -- 172.21.15.173:0/3236976828 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c0b2070 con 0x7f9a3c00b190 2024-04-25T09:11:15.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.870+0000 7f9a53e00640 1 -- 172.21.15.173:0/3236976828 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4c0a5530 con 0x7f9a3c00b190 2024-04-25T09:11:15.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.870+0000 7f9a53e00640 1 -- 172.21.15.173:0/3236976828 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c0096b0 con 0x7f9a3c00b190 2024-04-25T09:11:15.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.870+0000 7f9a5c400640 1 -- 172.21.15.173:0/3236976828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a3c00b190 msgr2=0x7f9a3c00d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.870+0000 7f9a5c400640 1 --2- 172.21.15.173:0/3236976828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a3c00b190 0x7f9a3c00d580 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009ab0 tx=0x7f9a4c01ca50 comp rx=0 tx=0).stop 2024-04-25T09:11:15.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.870+0000 7f9a5a400640 1 -- 172.21.15.173:0/3236976828 reap_dead start 2024-04-25T09:11:15.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.870+0000 7f9a5c400640 1 -- 172.21.15.173:0/3236976828 shutdown_connections 2024-04-25T09:11:15.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.870+0000 7f9a5c400640 1 -- 172.21.15.173:0/3236976828 >> 172.21.15.173:0/3236976828 conn(0x7f9a5406ac90 msgr2=0x7f9a5406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:15.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.870+0000 7f9a5c400640 1 -- 172.21.15.173:0/3236976828 shutdown_connections 2024-04-25T09:11:15.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.870+0000 7f9a5c400640 1 -- 172.21.15.173:0/3236976828 wait complete. 2024-04-25T09:11:15.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a5c400640 1 Processor -- start 2024-04-25T09:11:15.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a5c400640 1 -- start start 2024-04-25T09:11:15.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a5c400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a5414c930 0x7f9a5415b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a5c400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a5414cd10 0x7f9a5415c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a5c400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a540ca270 0x7f9a540ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a5c400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a540b28f0 con 0x7f9a5414c930 2024-04-25T09:11:15.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a5c400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a540b2770 con 0x7f9a540ca270 2024-04-25T09:11:15.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a5c400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5415a2e0 con 0x7f9a5414cd10 2024-04-25T09:11:15.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a59a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a5414c930 0x7f9a5415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a59a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a5414c930 0x7f9a5415b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41508/0 (socket says 172.21.15.173:41508) 2024-04-25T09:11:15.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a59a00640 1 -- 172.21.15.173:0/1604466874 learned_addr learned my addr 172.21.15.173:0/1604466874 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:15.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a59000640 1 --2- 172.21.15.173:0/1604466874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a5414cd10 0x7f9a5415c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a5a400640 1 --2- 172.21.15.173:0/1604466874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a540ca270 0x7f9a540ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a59a00640 1 -- 172.21.15.173:0/1604466874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a5414cd10 msgr2=0x7f9a5415c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a59a00640 1 --2- 172.21.15.173:0/1604466874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a5414cd10 0x7f9a5415c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a59a00640 1 -- 172.21.15.173:0/1604466874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a540ca270 msgr2=0x7f9a540ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a59a00640 1 --2- 172.21.15.173:0/1604466874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a540ca270 0x7f9a540ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a59a00640 1 -- 172.21.15.173:0/1604466874 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5415cf70 con 0x7f9a5414c930 2024-04-25T09:11:15.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a5a400640 1 --2- 172.21.15.173:0/1604466874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a540ca270 0x7f9a540ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:15.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a59000640 1 --2- 172.21.15.173:0/1604466874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a5414cd10 0x7f9a5415c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:15.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a59a00640 1 --2- 172.21.15.173:0/1604466874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a5414c930 0x7f9a5415b300 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f9a4800eb20 tx=0x7f9a480020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:15.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a51600640 1 -- 172.21.15.173:0/1604466874 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a48003b90 con 0x7f9a5414c930 2024-04-25T09:11:15.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a51600640 1 -- 172.21.15.173:0/1604466874 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a48018070 con 0x7f9a5414c930 2024-04-25T09:11:15.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a5c400640 1 -- 172.21.15.173:0/1604466874 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5415d250 con 0x7f9a5414c930 2024-04-25T09:11:15.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a51600640 1 -- 172.21.15.173:0/1604466874 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4800c780 con 0x7f9a5414c930 2024-04-25T09:11:15.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a5c400640 1 -- 172.21.15.173:0/1604466874 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a541e6c30 con 0x7f9a5414c930 2024-04-25T09:11:15.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.874+0000 7f9a5c400640 1 -- 172.21.15.173:0/1604466874 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a540cac20 con 0x7f9a5414c930 2024-04-25T09:11:15.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.878+0000 7f9a51600640 1 -- 172.21.15.173:0/1604466874 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9a4800c920 con 0x7f9a5414c930 2024-04-25T09:11:15.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.878+0000 7f9a51600640 1 --2- 172.21.15.173:0/1604466874 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9a34066f60 0x7f9a34069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.878+0000 7f9a51600640 1 -- 172.21.15.173:0/1604466874 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6216+0+0 (secure 0 0 0) 0x7f9a48085400 con 0x7f9a5414c930 2024-04-25T09:11:15.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.878+0000 7f9a59000640 1 --2- 172.21.15.173:0/1604466874 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9a34066f60 0x7f9a34069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.878+0000 7f9a59000640 1 --2- 172.21.15.173:0/1604466874 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9a34066f60 0x7f9a34069420 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9a541f7cf0 tx=0x7f9a40009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:15.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:15.882+0000 7f9a51600640 1 -- 172.21.15.173:0/1604466874 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9a540cac20 con 0x7f9a5414c930 2024-04-25T09:11:16.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.042+0000 7f9a5c400640 1 -- 172.21.15.173:0/1604466874 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9a54073ab0 con 0x7f9a5414c930 2024-04-25T09:11:16.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.702+0000 7f9a51600640 1 -- 172.21.15.173:0/1604466874 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v113) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9a48056200 con 0x7f9a5414c930 2024-04-25T09:11:16.687 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:11:16.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.706+0000 7f9a5c400640 1 -- 172.21.15.173:0/1604466874 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9a34066f60 msgr2=0x7f9a34069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:16.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.706+0000 7f9a5c400640 1 --2- 172.21.15.173:0/1604466874 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9a34066f60 0x7f9a34069420 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9a541f7cf0 tx=0x7f9a40009040 comp rx=0 tx=0).stop 2024-04-25T09:11:16.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.706+0000 7f9a5c400640 1 -- 172.21.15.173:0/1604466874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a5414c930 msgr2=0x7f9a5415b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:16.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.706+0000 7f9a5c400640 1 --2- 172.21.15.173:0/1604466874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a5414c930 0x7f9a5415b300 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f9a4800eb20 tx=0x7f9a480020e0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.706+0000 7f9a5c400640 1 -- 172.21.15.173:0/1604466874 shutdown_connections 2024-04-25T09:11:16.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.706+0000 7f9a5c400640 1 --2- 172.21.15.173:0/1604466874 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9a34066f60 0x7f9a34069420 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.706+0000 7f9a5c400640 1 --2- 172.21.15.173:0/1604466874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a540ca270 0x7f9a540ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.706+0000 7f9a5c400640 1 --2- 172.21.15.173:0/1604466874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a5414cd10 0x7f9a5415c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.706+0000 7f9a5c400640 1 --2- 172.21.15.173:0/1604466874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a5414c930 0x7f9a5415b300 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.706+0000 7f9a5c400640 1 -- 172.21.15.173:0/1604466874 >> 172.21.15.173:0/1604466874 conn(0x7f9a5406ac90 msgr2=0x7f9a5406e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:16.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.706+0000 7f9a5c400640 1 -- 172.21.15.173:0/1604466874 shutdown_connections 2024-04-25T09:11:16.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.706+0000 7f9a5c400640 1 -- 172.21.15.173:0/1604466874 wait complete. 2024-04-25T09:11:16.713 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:11:16.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.870+0000 7f3f4b600640 1 Processor -- start 2024-04-25T09:11:16.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.870+0000 7f3f4b600640 1 -- start start 2024-04-25T09:11:16.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.874+0000 7f3f4b600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f44145290 0x7f3f4415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:16.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.874+0000 7f3f4b600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3f440b3fe0 0x7f3f440b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:16.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.874+0000 7f3f4b600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4415c5f0 con 0x7f3f440cc260 2024-04-25T09:11:16.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.874+0000 7f3f4b600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f4406d4b0 con 0x7f3f440b3fe0 2024-04-25T09:11:16.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.874+0000 7f3f4b600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4406d790 con 0x7f3f44145290 2024-04-25T09:11:16.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.874+0000 7f3f43e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3f440b3fe0 0x7f3f440b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:16.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.874+0000 7f3f49600640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f3f440cc260 0x7f3f440cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41568/0 (socket says 172.21.15.173:41568) 2024-04-25T09:11:16.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.874+0000 7f3f49600640 1 -- 172.21.15.173:0/748976692 learned_addr learned my addr 172.21.15.173:0/748976692 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:16.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.874+0000 7f3f43e00640 1 -- 172.21.15.173:0/748976692 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f44145290 msgr2=0x7f3f4415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:16.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.874+0000 7f3f48c00640 1 --2- 172.21.15.173:0/748976692 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f44145290 0x7f3f4415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:16.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.874+0000 7f3f43400640 1 -- 172.21.15.173:0/748976692 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342086262 0 0) 0x7f3f3c001120 con 0x7f3f440cc260 2024-04-25T09:11:16.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.874+0000 7f3f43e00640 1 --2- 172.21.15.173:0/748976692 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f44145290 0x7f3f4415c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.874+0000 7f3f43e00640 1 -- 172.21.15.173:0/748976692 >> v1:172.21.15.173:6789/0 conn(0x7f3f440cc260 legacy=0x7f3f440cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:16.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.874+0000 7f3f43e00640 1 -- 172.21.15.173:0/748976692 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4406da70 con 0x7f3f440b3fe0 2024-04-25T09:11:16.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.874+0000 7f3f48c00640 1 --2- 172.21.15.173:0/748976692 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f44145290 0x7f3f4415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:16.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f43e00640 1 --2- 172.21.15.173:0/748976692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f440b3fe0 0x7f3f440b4420 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f3f300097c0 tx=0x7f3f3001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa88999d521bd326 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:16.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f43400640 1 -- 172.21.15.173:0/748976692 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f300b0070 con 0x7f3f440b3fe0 2024-04-25T09:11:16.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f43400640 1 -- 172.21.15.173:0/748976692 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f300ab600 con 0x7f3f440b3fe0 2024-04-25T09:11:16.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f43400640 1 -- 172.21.15.173:0/748976692 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f300ab9d0 con 0x7f3f440b3fe0 2024-04-25T09:11:16.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f4b600640 1 -- 172.21.15.173:0/748976692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f440b3fe0 msgr2=0x7f3f440b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:16.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f4b600640 1 --2- 172.21.15.173:0/748976692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f440b3fe0 0x7f3f440b4420 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f3f300097c0 tx=0x7f3f3001c380 comp rx=0 tx=0).stop 2024-04-25T09:11:16.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f4b600640 1 -- 172.21.15.173:0/748976692 shutdown_connections 2024-04-25T09:11:16.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f4b600640 1 --2- 172.21.15.173:0/748976692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f440b3fe0 0x7f3f440b4420 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f4b600640 1 --2- 172.21.15.173:0/748976692 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f44145290 0x7f3f4415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f4b600640 1 -- 172.21.15.173:0/748976692 >> 172.21.15.173:0/748976692 conn(0x7f3f4406ac90 msgr2=0x7f3f4406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:16.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f4b600640 1 -- 172.21.15.173:0/748976692 shutdown_connections 2024-04-25T09:11:16.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f4b600640 1 -- 172.21.15.173:0/748976692 wait complete. 2024-04-25T09:11:16.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f4b600640 1 Processor -- start 2024-04-25T09:11:16.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f4b600640 1 -- start start 2024-04-25T09:11:16.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f4b600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f440b3fe0 0x7f3f441411f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:16.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f4b600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f440cc260 0x7f3f441f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:16.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f4b600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f44145290 0x7f3f44141df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:16.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f4b600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4406eee0 con 0x7f3f440cc260 2024-04-25T09:11:16.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f4b600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4406ed60 con 0x7f3f440b3fe0 2024-04-25T09:11:16.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f4b600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4406f060 con 0x7f3f44145290 2024-04-25T09:11:16.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f43e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f440cc260 0x7f3f441f6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:16.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f43e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f440cc260 0x7f3f441f6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41536/0 (socket says 172.21.15.173:41536) 2024-04-25T09:11:16.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.878+0000 7f3f43e00640 1 -- 172.21.15.173:0/304079903 learned_addr learned my addr 172.21.15.173:0/304079903 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:16.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.882+0000 7f3f43e00640 1 -- 172.21.15.173:0/304079903 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f44145290 msgr2=0x7f3f44141df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:16.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.882+0000 7f3f43e00640 1 --2- 172.21.15.173:0/304079903 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f44145290 0x7f3f44141df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.882+0000 7f3f43e00640 1 -- 172.21.15.173:0/304079903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f440b3fe0 msgr2=0x7f3f441411f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:16.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.882+0000 7f3f48c00640 1 --2- 172.21.15.173:0/304079903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f440b3fe0 0x7f3f441411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:16.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.882+0000 7f3f43e00640 1 --2- 172.21.15.173:0/304079903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f440b3fe0 0x7f3f441411f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.882+0000 7f3f43e00640 1 -- 172.21.15.173:0/304079903 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f440af4f0 con 0x7f3f440cc260 2024-04-25T09:11:16.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.882+0000 7f3f48c00640 1 --2- 172.21.15.173:0/304079903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f440b3fe0 0x7f3f441411f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:16.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.882+0000 7f3f43e00640 1 --2- 172.21.15.173:0/304079903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f440cc260 0x7f3f441f6c50 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f3f300097c0 tx=0x7f3f3001abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:16.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.882+0000 7f3f40c00640 1 -- 172.21.15.173:0/304079903 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f300b0050 con 0x7f3f440cc260 2024-04-25T09:11:16.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.882+0000 7f3f40c00640 1 -- 172.21.15.173:0/304079903 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f300b1040 con 0x7f3f440cc260 2024-04-25T09:11:16.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.882+0000 7f3f4b600640 1 -- 172.21.15.173:0/304079903 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f440af7d0 con 0x7f3f440cc260 2024-04-25T09:11:16.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.882+0000 7f3f40c00640 1 -- 172.21.15.173:0/304079903 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f30004260 con 0x7f3f440cc260 2024-04-25T09:11:16.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.882+0000 7f3f4b600640 1 -- 172.21.15.173:0/304079903 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f440afd90 con 0x7f3f440cc260 2024-04-25T09:11:16.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.882+0000 7f3f4b600640 1 -- 172.21.15.173:0/304079903 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f44073ab0 con 0x7f3f440cc260 2024-04-25T09:11:16.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.882+0000 7f3f40c00640 1 -- 172.21.15.173:0/304079903 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3f300be060 con 0x7f3f440cc260 2024-04-25T09:11:16.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.882+0000 7f3f40c00640 1 --2- 172.21.15.173:0/304079903 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f24066f60 0x7f3f24069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:16.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.882+0000 7f3f40c00640 1 -- 172.21.15.173:0/304079903 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5778+0+0 (secure 0 0 0) 0x7f3f3011e950 con 0x7f3f440cc260 2024-04-25T09:11:16.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.882+0000 7f3f48c00640 1 --2- 172.21.15.173:0/304079903 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f24066f60 0x7f3f24069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:16.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.886+0000 7f3f48c00640 1 --2- 172.21.15.173:0/304079903 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f24066f60 0x7f3f24069420 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3f34007f40 tx=0x7f3f34007490 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:16.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:16.886+0000 7f3f40c00640 1 -- 172.21.15.173:0/304079903 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3f30016090 con 0x7f3f440cc260 2024-04-25T09:11:17.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.042+0000 7f3f4b600640 1 -- 172.21.15.173:0/304079903 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3f4406c300 con 0x7f3f440cc260 2024-04-25T09:11:17.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.706+0000 7f3f40c00640 1 -- 172.21.15.173:0/304079903 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v114) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3f3011e030 con 0x7f3f440cc260 2024-04-25T09:11:17.693 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' removed 2024-04-25T09:11:17.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.714+0000 7f3f4b600640 1 -- 172.21.15.173:0/304079903 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f24066f60 msgr2=0x7f3f24069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:17.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.714+0000 7f3f4b600640 1 --2- 172.21.15.173:0/304079903 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f24066f60 0x7f3f24069420 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3f34007f40 tx=0x7f3f34007490 comp rx=0 tx=0).stop 2024-04-25T09:11:17.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.714+0000 7f3f4b600640 1 -- 172.21.15.173:0/304079903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f440cc260 msgr2=0x7f3f441f6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:17.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.714+0000 7f3f4b600640 1 --2- 172.21.15.173:0/304079903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f440cc260 0x7f3f441f6c50 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f3f300097c0 tx=0x7f3f3001abc0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.714+0000 7f3f4b600640 1 -- 172.21.15.173:0/304079903 shutdown_connections 2024-04-25T09:11:17.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.714+0000 7f3f4b600640 1 --2- 172.21.15.173:0/304079903 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f24066f60 0x7f3f24069420 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.714+0000 7f3f4b600640 1 --2- 172.21.15.173:0/304079903 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f44145290 0x7f3f44141df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.714+0000 7f3f4b600640 1 --2- 172.21.15.173:0/304079903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f440cc260 0x7f3f441f6c50 secure :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f3f300097c0 tx=0x7f3f3001abc0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.714+0000 7f3f4b600640 1 --2- 172.21.15.173:0/304079903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f440b3fe0 0x7f3f441411f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.714+0000 7f3f4b600640 1 -- 172.21.15.173:0/304079903 >> 172.21.15.173:0/304079903 conn(0x7f3f4406ac90 msgr2=0x7f3f44143d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:17.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.714+0000 7f3f4b600640 1 -- 172.21.15.173:0/304079903 shutdown_connections 2024-04-25T09:11:17.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.714+0000 7f3f4b600640 1 -- 172.21.15.173:0/304079903 wait complete. 2024-04-25T09:11:17.735 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:11:17.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.894+0000 7f4af7200640 1 Processor -- start 2024-04-25T09:11:17.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.894+0000 7f4af7200640 1 -- start start 2024-04-25T09:11:17.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.894+0000 7f4af7200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4af0159f00 0x7f4af00cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:17.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.894+0000 7f4af7200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4af00cda00 0x7f4af0071320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:17.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.894+0000 7f4af7200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af015ddd0 con 0x7f4af00cff40 2024-04-25T09:11:17.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.894+0000 7f4af7200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af015e0b0 con 0x7f4af0159f00 2024-04-25T09:11:17.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.894+0000 7f4af7200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af015e390 con 0x7f4af00cda00 2024-04-25T09:11:17.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.894+0000 7f4aefe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4af0159f00 0x7f4af00cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:17.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.894+0000 7f4aefe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4af0159f00 0x7f4af00cb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41546/0 (socket says 172.21.15.173:41546) 2024-04-25T09:11:17.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.894+0000 7f4aefe00640 1 -- 172.21.15.173:0/415260378 learned_addr learned my addr 172.21.15.173:0/415260378 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:17.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.898+0000 7f4af5200640 1 --2- 172.21.15.173:0/415260378 >> v2:172.21.15.194:3300/0 conn(0x7f4af00cda00 0x7f4af0071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:17.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.898+0000 7f4aefe00640 1 -- 172.21.15.173:0/415260378 >> v2:172.21.15.194:3300/0 conn(0x7f4af00cda00 msgr2=0x7f4af0071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:17.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.898+0000 7f4aefe00640 1 --2- 172.21.15.173:0/415260378 >> v2:172.21.15.194:3300/0 conn(0x7f4af00cda00 0x7f4af0071320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.898+0000 7f4aefe00640 1 -- 172.21.15.173:0/415260378 >> v1:172.21.15.194:6789/0 conn(0x7f4af00cff40 legacy=0x7f4af00cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:17.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.898+0000 7f4aefe00640 1 -- 172.21.15.173:0/415260378 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af015e670 con 0x7f4af0159f00 2024-04-25T09:11:17.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.898+0000 7f4aefe00640 1 --2- 172.21.15.173:0/415260378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af0159f00 0x7f4af00cb960 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f4af00cd270 tx=0x7f4ae001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9887e2bda0512ced server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:17.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.898+0000 7f4aeea00640 1 -- 172.21.15.173:0/415260378 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00b0070 con 0x7f4af0159f00 2024-04-25T09:11:17.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.898+0000 7f4aeea00640 1 -- 172.21.15.173:0/415260378 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae00ab600 con 0x7f4af0159f00 2024-04-25T09:11:17.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.898+0000 7f4aeea00640 1 -- 172.21.15.173:0/415260378 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00ab9d0 con 0x7f4af0159f00 2024-04-25T09:11:17.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.898+0000 7f4af7200640 1 -- 172.21.15.173:0/415260378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af0159f00 msgr2=0x7f4af00cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:17.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.898+0000 7f4af7200640 1 --2- 172.21.15.173:0/415260378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af0159f00 0x7f4af00cb960 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f4af00cd270 tx=0x7f4ae001c4e0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af7200640 1 -- 172.21.15.173:0/415260378 shutdown_connections 2024-04-25T09:11:17.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af7200640 1 --2- 172.21.15.173:0/415260378 >> v2:172.21.15.194:3300/0 conn(0x7f4af00cda00 0x7f4af0071320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af7200640 1 --2- 172.21.15.173:0/415260378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af0159f00 0x7f4af00cb960 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af7200640 1 -- 172.21.15.173:0/415260378 >> 172.21.15.173:0/415260378 conn(0x7f4af006ac90 msgr2=0x7f4af006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:17.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af7200640 1 -- 172.21.15.173:0/415260378 shutdown_connections 2024-04-25T09:11:17.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af7200640 1 -- 172.21.15.173:0/415260378 wait complete. 2024-04-25T09:11:17.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af7200640 1 Processor -- start 2024-04-25T09:11:17.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af7200640 1 -- start start 2024-04-25T09:11:17.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af7200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4af00cda00 0x7f4af00cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:17.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af7200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af00cff40 0x7f4af014bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:17.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af7200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af0159f00 0x7f4af014c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:17.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af7200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af0071bf0 con 0x7f4af0159f00 2024-04-25T09:11:17.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af7200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af0071a70 con 0x7f4af00cda00 2024-04-25T09:11:17.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af7200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af0071d70 con 0x7f4af00cff40 2024-04-25T09:11:17.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af5200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af0159f00 0x7f4af014c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:17.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af5200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af0159f00 0x7f4af014c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41562/0 (socket says 172.21.15.173:41562) 2024-04-25T09:11:17.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af5200640 1 -- 172.21.15.173:0/3433585834 learned_addr learned my addr 172.21.15.173:0/3433585834 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:17.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4aefe00640 1 --2- 172.21.15.173:0/3433585834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4af00cda00 0x7f4af00cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:17.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4aef400640 1 --2- 172.21.15.173:0/3433585834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af00cff40 0x7f4af014bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:17.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af5200640 1 -- 172.21.15.173:0/3433585834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af00cff40 msgr2=0x7f4af014bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:17.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af5200640 1 --2- 172.21.15.173:0/3433585834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af00cff40 0x7f4af014bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af5200640 1 -- 172.21.15.173:0/3433585834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4af00cda00 msgr2=0x7f4af00cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:17.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af5200640 1 --2- 172.21.15.173:0/3433585834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4af00cda00 0x7f4af00cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af5200640 1 -- 172.21.15.173:0/3433585834 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af0164120 con 0x7f4af0159f00 2024-04-25T09:11:17.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4af5200640 1 --2- 172.21.15.173:0/3433585834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af0159f00 0x7f4af014c460 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8007e40 tx=0x7f4ae800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:17.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.902+0000 7f4ae7e00640 1 -- 172.21.15.173:0/3433585834 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8014620 con 0x7f4af0159f00 2024-04-25T09:11:17.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.906+0000 7f4ae7e00640 1 -- 172.21.15.173:0/3433585834 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae8019070 con 0x7f4af0159f00 2024-04-25T09:11:17.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.906+0000 7f4ae7e00640 1 -- 172.21.15.173:0/3433585834 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8014a20 con 0x7f4af0159f00 2024-04-25T09:11:17.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.906+0000 7f4af7200640 1 -- 172.21.15.173:0/3433585834 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af0164400 con 0x7f4af0159f00 2024-04-25T09:11:17.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.906+0000 7f4af7200640 1 -- 172.21.15.173:0/3433585834 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af01649c0 con 0x7f4af0159f00 2024-04-25T09:11:17.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.906+0000 7f4af7200640 1 -- 172.21.15.173:0/3433585834 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af0073ab0 con 0x7f4af0159f00 2024-04-25T09:11:17.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.906+0000 7f4ae7e00640 1 -- 172.21.15.173:0/3433585834 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4ae8014bc0 con 0x7f4af0159f00 2024-04-25T09:11:17.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.906+0000 7f4ae7e00640 1 --2- 172.21.15.173:0/3433585834 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4ad0066f60 0x7f4ad0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:17.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.906+0000 7f4ae7e00640 1 -- 172.21.15.173:0/3433585834 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f4ae8085640 con 0x7f4af0159f00 2024-04-25T09:11:17.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.906+0000 7f4aefe00640 1 --2- 172.21.15.173:0/3433585834 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4ad0066f60 0x7f4ad0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:17.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.910+0000 7f4aefe00640 1 --2- 172.21.15.173:0/3433585834 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4ad0066f60 0x7f4ad0069420 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00ad000 tx=0x7f4ae0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:17.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:17.910+0000 7f4ae7e00640 1 -- 172.21.15.173:0/3433585834 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4ae8056160 con 0x7f4af0159f00 2024-04-25T09:11:18.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.066+0000 7f4af7200640 1 -- 172.21.15.173:0/3433585834 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4af00ccb20 con 0x7f4af0159f00 2024-04-25T09:11:18.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.070+0000 7f4ae7e00640 1 -- 172.21.15.173:0/3433585834 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4ae805a200 con 0x7f4af0159f00 2024-04-25T09:11:18.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.074+0000 7f4af7200640 1 -- 172.21.15.173:0/3433585834 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4ad0066f60 msgr2=0x7f4ad0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.074+0000 7f4af7200640 1 --2- 172.21.15.173:0/3433585834 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4ad0066f60 0x7f4ad0069420 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00ad000 tx=0x7f4ae0008040 comp rx=0 tx=0).stop 2024-04-25T09:11:18.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.074+0000 7f4af7200640 1 -- 172.21.15.173:0/3433585834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af0159f00 msgr2=0x7f4af014c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.074+0000 7f4af7200640 1 --2- 172.21.15.173:0/3433585834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af0159f00 0x7f4af014c460 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8007e40 tx=0x7f4ae800e4b0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.074+0000 7f4af7200640 1 -- 172.21.15.173:0/3433585834 shutdown_connections 2024-04-25T09:11:18.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.074+0000 7f4af7200640 1 --2- 172.21.15.173:0/3433585834 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4ad0066f60 0x7f4ad0069420 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.074+0000 7f4af7200640 1 --2- 172.21.15.173:0/3433585834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af0159f00 0x7f4af014c460 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.074+0000 7f4af7200640 1 --2- 172.21.15.173:0/3433585834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af00cff40 0x7f4af014bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.074+0000 7f4af7200640 1 --2- 172.21.15.173:0/3433585834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4af00cda00 0x7f4af00cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.074+0000 7f4af7200640 1 -- 172.21.15.173:0/3433585834 >> 172.21.15.173:0/3433585834 conn(0x7f4af006ac90 msgr2=0x7f4af00b44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:18.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.074+0000 7f4af7200640 1 -- 172.21.15.173:0/3433585834 shutdown_connections 2024-04-25T09:11:18.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.074+0000 7f4af7200640 1 -- 172.21.15.173:0/3433585834 wait complete. 2024-04-25T09:11:18.078 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-04-25T09:11:18.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.230+0000 7f814ac00640 1 Processor -- start 2024-04-25T09:11:18.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.230+0000 7f814ac00640 1 -- start start 2024-04-25T09:11:18.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.230+0000 7f814ac00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8144160fe0 0x7f8144161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.230+0000 7f814ac00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f814406bca0 0x7f814406c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.230+0000 7f814ac00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8144061d60 con 0x7f814406dac0 2024-04-25T09:11:18.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.230+0000 7f814ac00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81440ad510 con 0x7f814406bca0 2024-04-25T09:11:18.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.230+0000 7f814ac00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81441613c0 con 0x7f8144160fe0 2024-04-25T09:11:18.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.230+0000 7f8143400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f814406dac0 0x7f81440ace00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41576/0 (socket says 172.21.15.173:41576) 2024-04-25T09:11:18.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.230+0000 7f8143400640 1 -- 172.21.15.173:0/2737740727 learned_addr learned my addr 172.21.15.173:0/2737740727 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:18.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.230+0000 7f8148c00640 1 --2- 172.21.15.173:0/2737740727 >> v2:172.21.15.173:3300/0 conn(0x7f814406bca0 0x7f814406c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.230+0000 7f8143e00640 1 --2- 172.21.15.173:0/2737740727 >> v2:172.21.15.194:3300/0 conn(0x7f8144160fe0 0x7f8144161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.230+0000 7f8142a00640 1 -- 172.21.15.173:0/2737740727 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048644846 0 0) 0x7f8130001120 con 0x7f814406dac0 2024-04-25T09:11:18.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.230+0000 7f8142a00640 1 -- 172.21.15.173:0/2737740727 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8128003530 con 0x7f814406dac0 2024-04-25T09:11:18.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.230+0000 7f8148c00640 1 -- 172.21.15.173:0/2737740727 >> v2:172.21.15.194:3300/0 conn(0x7f8144160fe0 msgr2=0x7f8144161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:18.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.230+0000 7f8148c00640 1 --2- 172.21.15.173:0/2737740727 >> v2:172.21.15.194:3300/0 conn(0x7f8144160fe0 0x7f8144161fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.230+0000 7f8148c00640 1 -- 172.21.15.173:0/2737740727 >> v1:172.21.15.173:6789/0 conn(0x7f814406dac0 legacy=0x7f81440ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.230+0000 7f8148c00640 1 -- 172.21.15.173:0/2737740727 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814406dfa0 con 0x7f814406bca0 2024-04-25T09:11:18.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.234+0000 7f8148c00640 1 --2- 172.21.15.173:0/2737740727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f814406bca0 0x7f814406c130 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f8144071070 tx=0x7f813c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cfcb52071bdc558 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:18.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.234+0000 7f8142a00640 1 -- 172.21.15.173:0/2737740727 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c0b0070 con 0x7f814406bca0 2024-04-25T09:11:18.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.234+0000 7f8142a00640 1 -- 172.21.15.173:0/2737740727 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813c0ab600 con 0x7f814406bca0 2024-04-25T09:11:18.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.234+0000 7f8142a00640 1 -- 172.21.15.173:0/2737740727 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c0ab9b0 con 0x7f814406bca0 2024-04-25T09:11:18.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.234+0000 7f814ac00640 1 -- 172.21.15.173:0/2737740727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f814406bca0 msgr2=0x7f814406c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.234+0000 7f814ac00640 1 --2- 172.21.15.173:0/2737740727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f814406bca0 0x7f814406c130 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f8144071070 tx=0x7f813c01c3d0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.234+0000 7f814ac00640 1 -- 172.21.15.173:0/2737740727 shutdown_connections 2024-04-25T09:11:18.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.234+0000 7f814ac00640 1 --2- 172.21.15.173:0/2737740727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f814406bca0 0x7f814406c130 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.234+0000 7f814ac00640 1 --2- 172.21.15.173:0/2737740727 >> v2:172.21.15.194:3300/0 conn(0x7f8144160fe0 0x7f8144161fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.234+0000 7f814ac00640 1 -- 172.21.15.173:0/2737740727 >> 172.21.15.173:0/2737740727 conn(0x7f8144071c20 msgr2=0x7f8144072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:18.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.234+0000 7f814ac00640 1 -- 172.21.15.173:0/2737740727 shutdown_connections 2024-04-25T09:11:18.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.234+0000 7f814ac00640 1 -- 172.21.15.173:0/2737740727 wait complete. 2024-04-25T09:11:18.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f814ac00640 1 Processor -- start 2024-04-25T09:11:18.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f814ac00640 1 -- start start 2024-04-25T09:11:18.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f814ac00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f814406bca0 0x7f814414eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f814ac00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f814406dac0 0x7f814415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f814ac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8144160fe0 0x7f81441512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f814ac00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81441624f0 con 0x7f814406dac0 2024-04-25T09:11:18.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f814ac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814406eb20 con 0x7f8144160fe0 2024-04-25T09:11:18.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f814ac00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814406f850 con 0x7f814406bca0 2024-04-25T09:11:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f8143400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f814406dac0 0x7f814415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f8143400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f814406dac0 0x7f814415dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41580/0 (socket says 172.21.15.173:41580) 2024-04-25T09:11:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f8143400640 1 -- 172.21.15.173:0/3339865962 learned_addr learned my addr 172.21.15.173:0/3339865962 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f8143e00640 1 --2- 172.21.15.173:0/3339865962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f814406bca0 0x7f814414eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f8148c00640 1 --2- 172.21.15.173:0/3339865962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8144160fe0 0x7f81441512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f8143400640 1 -- 172.21.15.173:0/3339865962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f814406bca0 msgr2=0x7f814414eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f8143400640 1 --2- 172.21.15.173:0/3339865962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f814406bca0 0x7f814414eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f8143400640 1 -- 172.21.15.173:0/3339865962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8144160fe0 msgr2=0x7f81441512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f8143400640 1 --2- 172.21.15.173:0/3339865962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8144160fe0 0x7f81441512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f8143400640 1 -- 172.21.15.173:0/3339865962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8144148930 con 0x7f814406dac0 2024-04-25T09:11:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f8148c00640 1 --2- 172.21.15.173:0/3339865962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8144160fe0 0x7f81441512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f8143400640 1 --2- 172.21.15.173:0/3339865962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f814406dac0 0x7f814415dec0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f813000c730 tx=0x7f813000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f813be00640 1 -- 172.21.15.173:0/3339865962 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130017070 con 0x7f814406dac0 2024-04-25T09:11:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f813be00640 1 -- 172.21.15.173:0/3339865962 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8130005ae0 con 0x7f814406dac0 2024-04-25T09:11:18.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f814ac00640 1 -- 172.21.15.173:0/3339865962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814414f540 con 0x7f814406dac0 2024-04-25T09:11:18.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f813be00640 1 -- 172.21.15.173:0/3339865962 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130007e30 con 0x7f814406dac0 2024-04-25T09:11:18.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f814ac00640 1 -- 172.21.15.173:0/3339865962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81441523a0 con 0x7f814406dac0 2024-04-25T09:11:18.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.238+0000 7f814ac00640 1 -- 172.21.15.173:0/3339865962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8144073a40 con 0x7f814406dac0 2024-04-25T09:11:18.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.242+0000 7f813be00640 1 -- 172.21.15.173:0/3339865962 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f813001a070 con 0x7f814406dac0 2024-04-25T09:11:18.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.242+0000 7f813be00640 1 --2- 172.21.15.173:0/3339865962 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8124066f60 0x7f8124069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.242+0000 7f813be00640 1 -- 172.21.15.173:0/3339865962 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f8130084230 con 0x7f814406dac0 2024-04-25T09:11:18.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.242+0000 7f8143e00640 1 --2- 172.21.15.173:0/3339865962 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8124066f60 0x7f8124069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.242+0000 7f8143e00640 1 --2- 172.21.15.173:0/3339865962 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8124066f60 0x7f8124069420 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f81440b1070 tx=0x7f813400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:18.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.246+0000 7f813be00640 1 -- 172.21.15.173:0/3339865962 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f814414f540 con 0x7f814406dac0 2024-04-25T09:11:18.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.494+0000 7f814ac00640 1 -- 172.21.15.173:0/3339865962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) v1 -- 0x7f81440cf6c0 con 0x7f814406dac0 2024-04-25T09:11:18.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.710+0000 7f813be00640 1 -- 172.21.15.173:0/3339865962 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v411) v1 ==== 155+0+0 (secure 0 0 0) 0x7f8144061d60 con 0x7f814406dac0 2024-04-25T09:11:18.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.710+0000 7f814ac00640 1 -- 172.21.15.173:0/3339865962 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8124066f60 msgr2=0x7f8124069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.710+0000 7f814ac00640 1 --2- 172.21.15.173:0/3339865962 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8124066f60 0x7f8124069420 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f81440b1070 tx=0x7f813400b040 comp rx=0 tx=0).stop 2024-04-25T09:11:18.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.710+0000 7f814ac00640 1 -- 172.21.15.173:0/3339865962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f814406dac0 msgr2=0x7f814415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.710+0000 7f814ac00640 1 --2- 172.21.15.173:0/3339865962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f814406dac0 0x7f814415dec0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f813000c730 tx=0x7f813000cbf0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.710+0000 7f814ac00640 1 -- 172.21.15.173:0/3339865962 shutdown_connections 2024-04-25T09:11:18.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.710+0000 7f814ac00640 1 --2- 172.21.15.173:0/3339865962 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8124066f60 0x7f8124069420 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.710+0000 7f814ac00640 1 --2- 172.21.15.173:0/3339865962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8144160fe0 0x7f81441512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.710+0000 7f814ac00640 1 --2- 172.21.15.173:0/3339865962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f814406dac0 0x7f814415dec0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.710+0000 7f814ac00640 1 --2- 172.21.15.173:0/3339865962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f814406bca0 0x7f814414eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.710+0000 7f814ac00640 1 -- 172.21.15.173:0/3339865962 >> 172.21.15.173:0/3339865962 conn(0x7f8144071c20 msgr2=0x7f814406b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:18.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.710+0000 7f814ac00640 1 -- 172.21.15.173:0/3339865962 shutdown_connections 2024-04-25T09:11:18.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.710+0000 7f814ac00640 1 -- 172.21.15.173:0/3339865962 wait complete. 2024-04-25T09:11:18.716 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-04-25T09:11:18.717 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T09:11:18.717 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:18.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.870+0000 7f292dc00640 1 Processor -- start 2024-04-25T09:11:18.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.870+0000 7f292dc00640 1 -- start start 2024-04-25T09:11:18.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.870+0000 7f292dc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2928145250 0x7f292815c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.870+0000 7f292dc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f29280cc8b0 0x7f29280ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.870+0000 7f292dc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2928071320 0x7f2928071770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.870+0000 7f292dc00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f292815cec0 con 0x7f29280cc8b0 2024-04-25T09:11:18.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.870+0000 7f292dc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f292806e7c0 con 0x7f2928145250 2024-04-25T09:11:18.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.870+0000 7f292dc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292806d720 con 0x7f2928071320 2024-04-25T09:11:18.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.870+0000 7f2926000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f29280cc8b0 0x7f29280ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.870+0000 7f2926000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f29280cc8b0 0x7f29280ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41596/0 (socket says 172.21.15.173:41596) 2024-04-25T09:11:18.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.870+0000 7f2926000640 1 -- 172.21.15.173:0/3553638109 learned_addr learned my addr 172.21.15.173:0/3553638109 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:18.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.870+0000 7f2926a00640 1 --2- 172.21.15.173:0/3553638109 >> v2:172.21.15.194:3300/0 conn(0x7f2928145250 0x7f292815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.870+0000 7f2927400640 1 --2- 172.21.15.173:0/3553638109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2928071320 0x7f2928071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.870+0000 7f2926000640 1 -- 172.21.15.173:0/3553638109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2928071320 msgr2=0x7f2928071770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:18.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.870+0000 7f2926000640 1 --2- 172.21.15.173:0/3553638109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2928071320 0x7f2928071770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.870+0000 7f2926000640 1 -- 172.21.15.173:0/3553638109 >> v2:172.21.15.194:3300/0 conn(0x7f2928145250 msgr2=0x7f292815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:18.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.870+0000 7f2926000640 1 --2- 172.21.15.173:0/3553638109 >> v2:172.21.15.194:3300/0 conn(0x7f2928145250 0x7f292815c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.870+0000 7f2926000640 1 -- 172.21.15.173:0/3553638109 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292806da00 con 0x7f29280cc8b0 2024-04-25T09:11:18.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.874+0000 7f2926000640 1 --2- 172.21.15.173:0/3553638109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29280cc8b0 0x7f29280ccd30 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f29280d0420 tx=0x7f291401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81224b8de0958f67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:18.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.874+0000 7f2925600640 1 -- 172.21.15.173:0/3553638109 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29140b1070 con 0x7f29280cc8b0 2024-04-25T09:11:18.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.874+0000 7f2925600640 1 -- 172.21.15.173:0/3553638109 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29140ac630 con 0x7f29280cc8b0 2024-04-25T09:11:18.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.874+0000 7f2925600640 1 -- 172.21.15.173:0/3553638109 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29140a8050 con 0x7f29280cc8b0 2024-04-25T09:11:18.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.874+0000 7f292dc00640 1 -- 172.21.15.173:0/3553638109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29280cc8b0 msgr2=0x7f29280ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.874+0000 7f292dc00640 1 --2- 172.21.15.173:0/3553638109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29280cc8b0 0x7f29280ccd30 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f29280d0420 tx=0x7f291401c520 comp rx=0 tx=0).stop 2024-04-25T09:11:18.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.874+0000 7f292dc00640 1 -- 172.21.15.173:0/3553638109 shutdown_connections 2024-04-25T09:11:18.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.874+0000 7f292dc00640 1 --2- 172.21.15.173:0/3553638109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2928071320 0x7f2928071770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.874+0000 7f292dc00640 1 --2- 172.21.15.173:0/3553638109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29280cc8b0 0x7f29280ccd30 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.874+0000 7f292dc00640 1 --2- 172.21.15.173:0/3553638109 >> v2:172.21.15.194:3300/0 conn(0x7f2928145250 0x7f292815c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.874+0000 7f292dc00640 1 -- 172.21.15.173:0/3553638109 >> 172.21.15.173:0/3553638109 conn(0x7f292806ac90 msgr2=0x7f292806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:18.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.874+0000 7f292dc00640 1 -- 172.21.15.173:0/3553638109 shutdown_connections 2024-04-25T09:11:18.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.874+0000 7f292dc00640 1 -- 172.21.15.173:0/3553638109 wait complete. 2024-04-25T09:11:18.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f292dc00640 1 Processor -- start 2024-04-25T09:11:18.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f292dc00640 1 -- start start 2024-04-25T09:11:18.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f292dc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2928071320 0x7f292815f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f292dc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29280cc8b0 0x7f29281408a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f292dc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2928145250 0x7f292813e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f292dc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292806ef80 con 0x7f29280cc8b0 2024-04-25T09:11:18.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f292dc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2928145630 con 0x7f2928145250 2024-04-25T09:11:18.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f292dc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29280720c0 con 0x7f2928071320 2024-04-25T09:11:18.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f2926000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29280cc8b0 0x7f29281408a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f2926000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29280cc8b0 0x7f29281408a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41610/0 (socket says 172.21.15.173:41610) 2024-04-25T09:11:18.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f2926000640 1 -- 172.21.15.173:0/3730220118 learned_addr learned my addr 172.21.15.173:0/3730220118 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:18.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f2926a00640 1 --2- 172.21.15.173:0/3730220118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2928071320 0x7f292815f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f2927400640 1 --2- 172.21.15.173:0/3730220118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2928145250 0x7f292813e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f2926000640 1 -- 172.21.15.173:0/3730220118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2928071320 msgr2=0x7f292815f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f2926000640 1 --2- 172.21.15.173:0/3730220118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2928071320 0x7f292815f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f2926000640 1 -- 172.21.15.173:0/3730220118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2928145250 msgr2=0x7f292813e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f2926000640 1 --2- 172.21.15.173:0/3730220118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2928145250 0x7f292813e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f2926000640 1 -- 172.21.15.173:0/3730220118 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292806f590 con 0x7f29280cc8b0 2024-04-25T09:11:18.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f2927400640 1 --2- 172.21.15.173:0/3730220118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2928145250 0x7f292813e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:18.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f2926000640 1 --2- 172.21.15.173:0/3730220118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29280cc8b0 0x7f29281408a0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f291401abd0 tx=0x7f29140192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:18.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f291ea00640 1 -- 172.21.15.173:0/3730220118 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29140bc070 con 0x7f29280cc8b0 2024-04-25T09:11:18.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f291ea00640 1 -- 172.21.15.173:0/3730220118 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29140ab5e0 con 0x7f29280cc8b0 2024-04-25T09:11:18.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f291ea00640 1 -- 172.21.15.173:0/3730220118 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29140b1070 con 0x7f29280cc8b0 2024-04-25T09:11:18.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f292dc00640 1 -- 172.21.15.173:0/3730220118 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2928141010 con 0x7f29280cc8b0 2024-04-25T09:11:18.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f292dc00640 1 -- 172.21.15.173:0/3730220118 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29281415d0 con 0x7f29280cc8b0 2024-04-25T09:11:18.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.878+0000 7f292dc00640 1 -- 172.21.15.173:0/3730220118 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2928073a40 con 0x7f29280cc8b0 2024-04-25T09:11:18.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.882+0000 7f291ea00640 1 -- 172.21.15.173:0/3730220118 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f29140ab9d0 con 0x7f29280cc8b0 2024-04-25T09:11:18.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.882+0000 7f291ea00640 1 --2- 172.21.15.173:0/3730220118 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2908066f60 0x7f2908069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.882+0000 7f291ea00640 1 -- 172.21.15.173:0/3730220118 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f291411e830 con 0x7f29280cc8b0 2024-04-25T09:11:18.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.882+0000 7f2926a00640 1 --2- 172.21.15.173:0/3730220118 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2908066f60 0x7f2908069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.882+0000 7f2926a00640 1 --2- 172.21.15.173:0/3730220118 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2908066f60 0x7f2908069420 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2918007a60 tx=0x7f2918008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:18.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:18.886+0000 7f291ea00640 1 -- 172.21.15.173:0/3730220118 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2914016110 con 0x7f29280cc8b0 2024-04-25T09:11:19.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.042+0000 7f292dc00640 1 -- 172.21.15.173:0/3730220118 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29280aede0 con 0x7f29280cc8b0 2024-04-25T09:11:19.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.042+0000 7f291ea00640 1 -- 172.21.15.173:0/3730220118 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+13365 (secure 0 0 0) 0x7f29140ef350 con 0x7f29280cc8b0 2024-04-25T09:11:19.027 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:19.027 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":114,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:11:17.704390+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:6837/1492125936":"2024-04-26T09:11:14.691633+0000","172.21.15.173:6835/1492125936":"2024-04-26T09:11:14.691633+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:19.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.042+0000 7f292dc00640 1 -- 172.21.15.173:0/3730220118 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2908066f60 msgr2=0x7f2908069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:19.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.042+0000 7f292dc00640 1 --2- 172.21.15.173:0/3730220118 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2908066f60 0x7f2908069420 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2918007a60 tx=0x7f2918008040 comp rx=0 tx=0).stop 2024-04-25T09:11:19.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.042+0000 7f292dc00640 1 -- 172.21.15.173:0/3730220118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29280cc8b0 msgr2=0x7f29281408a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:19.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.042+0000 7f292dc00640 1 --2- 172.21.15.173:0/3730220118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29280cc8b0 0x7f29281408a0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f291401abd0 tx=0x7f29140192c0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.042+0000 7f292dc00640 1 -- 172.21.15.173:0/3730220118 shutdown_connections 2024-04-25T09:11:19.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.042+0000 7f292dc00640 1 --2- 172.21.15.173:0/3730220118 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2908066f60 0x7f2908069420 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.042+0000 7f292dc00640 1 --2- 172.21.15.173:0/3730220118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2928145250 0x7f292813e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.042+0000 7f292dc00640 1 --2- 172.21.15.173:0/3730220118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29280cc8b0 0x7f29281408a0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.042+0000 7f292dc00640 1 --2- 172.21.15.173:0/3730220118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2928071320 0x7f292815f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.042+0000 7f292dc00640 1 -- 172.21.15.173:0/3730220118 >> 172.21.15.173:0/3730220118 conn(0x7f292806ac90 msgr2=0x7f29280b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:19.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.046+0000 7f292dc00640 1 -- 172.21.15.173:0/3730220118 shutdown_connections 2024-04-25T09:11:19.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.046+0000 7f292dc00640 1 -- 172.21.15.173:0/3730220118 wait complete. 2024-04-25T09:11:19.048 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:11:19.049 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:11:19.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.202+0000 7f32b0400640 1 Processor -- start 2024-04-25T09:11:19.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.202+0000 7f32b0400640 1 -- start start 2024-04-25T09:11:19.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.202+0000 7f32b0400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f32a80cc7e0 0x7f32a80cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:19.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.202+0000 7f32b0400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f32a80aef70 0x7f32a80ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:19.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.202+0000 7f32b0400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a8071570 con 0x7f32a80aeb90 2024-04-25T09:11:19.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.202+0000 7f32b0400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a8071320 con 0x7f32a80aef70 2024-04-25T09:11:19.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.202+0000 7f32b0400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a8072330 con 0x7f32a80cc7e0 2024-04-25T09:11:19.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.206+0000 7f32ae400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f32a80aef70 0x7f32a80ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:19.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.206+0000 7f32ae400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f32a80aef70 0x7f32a80ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41612/0 (socket says 172.21.15.173:41612) 2024-04-25T09:11:19.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.206+0000 7f32ae400640 1 -- 172.21.15.173:0/1610330163 learned_addr learned my addr 172.21.15.173:0/1610330163 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:19.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.206+0000 7f32ad000640 1 --2- 172.21.15.173:0/1610330163 >> v2:172.21.15.194:3300/0 conn(0x7f32a80cc7e0 0x7f32a80cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:19.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.206+0000 7f32ae400640 1 -- 172.21.15.173:0/1610330163 >> v2:172.21.15.194:3300/0 conn(0x7f32a80cc7e0 msgr2=0x7f32a80cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:19.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.206+0000 7f32ae400640 1 --2- 172.21.15.173:0/1610330163 >> v2:172.21.15.194:3300/0 conn(0x7f32a80cc7e0 0x7f32a80cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.206+0000 7f32ae400640 1 -- 172.21.15.173:0/1610330163 >> v1:172.21.15.194:6789/0 conn(0x7f32a80aeb90 legacy=0x7f32a80cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:19.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.206+0000 7f32ae400640 1 -- 172.21.15.173:0/1610330163 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a8071850 con 0x7f32a80aef70 2024-04-25T09:11:19.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.206+0000 7f32ae400640 1 --2- 172.21.15.173:0/1610330163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a80aef70 0x7f32a80ce0e0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f32a80cd960 tx=0x7f32a001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae224c75e35611 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:19.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.206+0000 7f32a7e00640 1 -- 172.21.15.173:0/1610330163 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a00a5610 con 0x7f32a80aef70 2024-04-25T09:11:19.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.206+0000 7f32a7e00640 1 -- 172.21.15.173:0/1610330163 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a00a57b0 con 0x7f32a80aef70 2024-04-25T09:11:19.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.206+0000 7f32a7e00640 1 -- 172.21.15.173:0/1610330163 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a00a5b80 con 0x7f32a80aef70 2024-04-25T09:11:19.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32b0400640 1 -- 172.21.15.173:0/1610330163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a80aef70 msgr2=0x7f32a80ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:19.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32b0400640 1 --2- 172.21.15.173:0/1610330163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a80aef70 0x7f32a80ce0e0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f32a80cd960 tx=0x7f32a001c960 comp rx=0 tx=0).stop 2024-04-25T09:11:19.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32b0400640 1 -- 172.21.15.173:0/1610330163 shutdown_connections 2024-04-25T09:11:19.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32b0400640 1 --2- 172.21.15.173:0/1610330163 >> v2:172.21.15.194:3300/0 conn(0x7f32a80cc7e0 0x7f32a80cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32b0400640 1 --2- 172.21.15.173:0/1610330163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a80aef70 0x7f32a80ce0e0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32b0400640 1 -- 172.21.15.173:0/1610330163 >> 172.21.15.173:0/1610330163 conn(0x7f32a806ac90 msgr2=0x7f32a806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:19.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32b0400640 1 -- 172.21.15.173:0/1610330163 shutdown_connections 2024-04-25T09:11:19.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32b0400640 1 -- 172.21.15.173:0/1610330163 wait complete. 2024-04-25T09:11:19.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32b0400640 1 Processor -- start 2024-04-25T09:11:19.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32b0400640 1 -- start start 2024-04-25T09:11:19.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32b0400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32a80aeb90 0x7f32a814a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:19.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32b0400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32a80aef70 0x7f32a814dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:19.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32b0400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a80cc7e0 0x7f32a814e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:19.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32b0400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a815bb30 con 0x7f32a80cc7e0 2024-04-25T09:11:19.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32b0400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a815b9b0 con 0x7f32a80aeb90 2024-04-25T09:11:19.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32b0400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a815bcb0 con 0x7f32a80aef70 2024-04-25T09:11:19.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32ae400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a80cc7e0 0x7f32a814e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:19.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32ae400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a80cc7e0 0x7f32a814e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41626/0 (socket says 172.21.15.173:41626) 2024-04-25T09:11:19.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32ae400640 1 -- 172.21.15.173:0/3715642626 learned_addr learned my addr 172.21.15.173:0/3715642626 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:19.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32ada00640 1 --2- 172.21.15.173:0/3715642626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32a80aeb90 0x7f32a814a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:19.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32ad000640 1 --2- 172.21.15.173:0/3715642626 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32a80aef70 0x7f32a814dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:19.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32ae400640 1 -- 172.21.15.173:0/3715642626 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32a80aef70 msgr2=0x7f32a814dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:19.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.210+0000 7f32ae400640 1 --2- 172.21.15.173:0/3715642626 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32a80aef70 0x7f32a814dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.214+0000 7f32ae400640 1 -- 172.21.15.173:0/3715642626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32a80aeb90 msgr2=0x7f32a814a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:19.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.214+0000 7f32ae400640 1 --2- 172.21.15.173:0/3715642626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32a80aeb90 0x7f32a814a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.214+0000 7f32ae400640 1 -- 172.21.15.173:0/3715642626 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a80b0870 con 0x7f32a80cc7e0 2024-04-25T09:11:19.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.214+0000 7f32ae400640 1 --2- 172.21.15.173:0/3715642626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a80cc7e0 0x7f32a814e2b0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f32a0019570 tx=0x7f32a0019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:19.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.214+0000 7f32a5600640 1 -- 172.21.15.173:0/3715642626 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a00bc020 con 0x7f32a80cc7e0 2024-04-25T09:11:19.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.214+0000 7f32a5600640 1 -- 172.21.15.173:0/3715642626 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a00b8690 con 0x7f32a80cc7e0 2024-04-25T09:11:19.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.214+0000 7f32a5600640 1 -- 172.21.15.173:0/3715642626 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a0009510 con 0x7f32a80cc7e0 2024-04-25T09:11:19.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.214+0000 7f32b0400640 1 -- 172.21.15.173:0/3715642626 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a80b0b50 con 0x7f32a80cc7e0 2024-04-25T09:11:19.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.214+0000 7f32b0400640 1 -- 172.21.15.173:0/3715642626 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a8158eb0 con 0x7f32a80cc7e0 2024-04-25T09:11:19.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.214+0000 7f32b0400640 1 -- 172.21.15.173:0/3715642626 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a8073ab0 con 0x7f32a80cc7e0 2024-04-25T09:11:19.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.214+0000 7f32a5600640 1 -- 172.21.15.173:0/3715642626 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f32a00bf020 con 0x7f32a80cc7e0 2024-04-25T09:11:19.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.214+0000 7f32a5600640 1 --2- 172.21.15.173:0/3715642626 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3288066f60 0x7f3288069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:19.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.214+0000 7f32a5600640 1 -- 172.21.15.173:0/3715642626 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f32a011fc20 con 0x7f32a80cc7e0 2024-04-25T09:11:19.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.214+0000 7f32ada00640 1 --2- 172.21.15.173:0/3715642626 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3288066f60 0x7f3288069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:19.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.218+0000 7f32ada00640 1 --2- 172.21.15.173:0/3715642626 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3288066f60 0x7f3288069420 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f329c007fd0 tx=0x7f329c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:19.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.218+0000 7f32a5600640 1 -- 172.21.15.173:0/3715642626 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f32a00c6030 con 0x7f32a80cc7e0 2024-04-25T09:11:19.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.374+0000 7f32b0400640 1 -- 172.21.15.173:0/3715642626 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32a806c300 con 0x7f32a80cc7e0 2024-04-25T09:11:19.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.374+0000 7f32a5600640 1 -- 172.21.15.173:0/3715642626 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v114) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32a00165e0 con 0x7f32a80cc7e0 2024-04-25T09:11:19.359 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:11:19.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.374+0000 7f32b0400640 1 -- 172.21.15.173:0/3715642626 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3288066f60 msgr2=0x7f3288069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:19.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.374+0000 7f32b0400640 1 --2- 172.21.15.173:0/3715642626 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3288066f60 0x7f3288069420 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f329c007fd0 tx=0x7f329c009040 comp rx=0 tx=0).stop 2024-04-25T09:11:19.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.374+0000 7f32b0400640 1 -- 172.21.15.173:0/3715642626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a80cc7e0 msgr2=0x7f32a814e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:19.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.374+0000 7f32b0400640 1 --2- 172.21.15.173:0/3715642626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a80cc7e0 0x7f32a814e2b0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f32a0019570 tx=0x7f32a0019700 comp rx=0 tx=0).stop 2024-04-25T09:11:19.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.374+0000 7f32b0400640 1 -- 172.21.15.173:0/3715642626 shutdown_connections 2024-04-25T09:11:19.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.374+0000 7f32b0400640 1 --2- 172.21.15.173:0/3715642626 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3288066f60 0x7f3288069420 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.374+0000 7f32b0400640 1 --2- 172.21.15.173:0/3715642626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a80cc7e0 0x7f32a814e2b0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.374+0000 7f32b0400640 1 --2- 172.21.15.173:0/3715642626 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32a80aef70 0x7f32a814dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.374+0000 7f32b0400640 1 --2- 172.21.15.173:0/3715642626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32a80aeb90 0x7f32a814a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.374+0000 7f32b0400640 1 -- 172.21.15.173:0/3715642626 >> 172.21.15.173:0/3715642626 conn(0x7f32a806ac90 msgr2=0x7f32a814b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:19.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.374+0000 7f32b0400640 1 -- 172.21.15.173:0/3715642626 shutdown_connections 2024-04-25T09:11:19.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.374+0000 7f32b0400640 1 -- 172.21.15.173:0/3715642626 wait complete. 2024-04-25T09:11:19.380 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-04-25T09:11:19.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.530+0000 7fe117600640 1 Processor -- start 2024-04-25T09:11:19.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.530+0000 7fe117600640 1 -- start start 2024-04-25T09:11:19.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.530+0000 7fe117600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe11015db30 0x7fe110162140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:19.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.530+0000 7fe117600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe1100b2d50 0x7fe1100ad510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:19.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.530+0000 7fe117600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe110070000 con 0x7fe1100afc10 2024-04-25T09:11:19.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.530+0000 7fe117600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1101616f0 con 0x7fe1100b2d50 2024-04-25T09:11:19.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.530+0000 7fe117600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1100702e0 con 0x7fe11015db30 2024-04-25T09:11:19.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.530+0000 7fe10fe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe1100afc10 0x7fe1100cf990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41584/0 (socket says 172.21.15.173:41584) 2024-04-25T09:11:19.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.530+0000 7fe10fe00640 1 -- 172.21.15.173:0/3129917413 learned_addr learned my addr 172.21.15.173:0/3129917413 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:19.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.530+0000 7fe114c00640 1 --2- 172.21.15.173:0/3129917413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe11015db30 0x7fe110162140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:19.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.530+0000 7fe115600640 1 --2- 172.21.15.173:0/3129917413 >> v2:172.21.15.194:3300/0 conn(0x7fe1100b2d50 0x7fe1100ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:19.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.530+0000 7fe10f400640 1 -- 172.21.15.173:0/3129917413 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690511681 0 0) 0x7fe110070000 con 0x7fe1100afc10 2024-04-25T09:11:19.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.530+0000 7fe10f400640 1 -- 172.21.15.173:0/3129917413 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0f4003530 con 0x7fe1100afc10 2024-04-25T09:11:19.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.530+0000 7fe114c00640 1 -- 172.21.15.173:0/3129917413 >> v2:172.21.15.194:3300/0 conn(0x7fe1100b2d50 msgr2=0x7fe1100ad510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:19.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.530+0000 7fe114c00640 1 --2- 172.21.15.173:0/3129917413 >> v2:172.21.15.194:3300/0 conn(0x7fe1100b2d50 0x7fe1100ad510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.530+0000 7fe114c00640 1 -- 172.21.15.173:0/3129917413 >> v1:172.21.15.173:6789/0 conn(0x7fe1100afc10 legacy=0x7fe1100cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:19.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.530+0000 7fe114c00640 1 -- 172.21.15.173:0/3129917413 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe110161940 con 0x7fe11015db30 2024-04-25T09:11:19.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.534+0000 7fe114c00640 1 --2- 172.21.15.173:0/3129917413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe11015db30 0x7fe110162140 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe1000097c0 tx=0x7fe10001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f9c5806243d2775 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:19.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.534+0000 7fe10f400640 1 -- 172.21.15.173:0/3129917413 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1000b0070 con 0x7fe11015db30 2024-04-25T09:11:19.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.534+0000 7fe10f400640 1 -- 172.21.15.173:0/3129917413 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1000ab600 con 0x7fe11015db30 2024-04-25T09:11:19.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.534+0000 7fe10f400640 1 -- 172.21.15.173:0/3129917413 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1000ab9d0 con 0x7fe11015db30 2024-04-25T09:11:19.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.534+0000 7fe117600640 1 -- 172.21.15.173:0/3129917413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe11015db30 msgr2=0x7fe110162140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:19.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.534+0000 7fe117600640 1 --2- 172.21.15.173:0/3129917413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe11015db30 0x7fe110162140 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe1000097c0 tx=0x7fe10001c3e0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.534+0000 7fe117600640 1 -- 172.21.15.173:0/3129917413 shutdown_connections 2024-04-25T09:11:19.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.534+0000 7fe117600640 1 --2- 172.21.15.173:0/3129917413 >> v2:172.21.15.194:3300/0 conn(0x7fe1100b2d50 0x7fe1100ad510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.534+0000 7fe117600640 1 --2- 172.21.15.173:0/3129917413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe11015db30 0x7fe110162140 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.534+0000 7fe117600640 1 -- 172.21.15.173:0/3129917413 >> 172.21.15.173:0/3129917413 conn(0x7fe1100b2230 msgr2=0x7fe1100b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:19.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.534+0000 7fe117600640 1 -- 172.21.15.173:0/3129917413 shutdown_connections 2024-04-25T09:11:19.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.534+0000 7fe117600640 1 -- 172.21.15.173:0/3129917413 wait complete. 2024-04-25T09:11:19.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe117600640 1 Processor -- start 2024-04-25T09:11:19.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe117600640 1 -- start start 2024-04-25T09:11:19.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe117600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1100afc10 0x7fe110155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:19.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe117600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1100b2d50 0x7fe110153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:19.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe117600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe11015db30 0x7fe110158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:19.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe117600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11016abb0 con 0x7fe11015db30 2024-04-25T09:11:19.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe117600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11016aa30 con 0x7fe1100afc10 2024-04-25T09:11:19.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe117600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11016ad30 con 0x7fe1100b2d50 2024-04-25T09:11:19.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe115600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe11015db30 0x7fe110158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:19.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe115600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe11015db30 0x7fe110158730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41642/0 (socket says 172.21.15.173:41642) 2024-04-25T09:11:19.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe115600640 1 -- 172.21.15.173:0/1657756512 learned_addr learned my addr 172.21.15.173:0/1657756512 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:19.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe10fe00640 1 --2- 172.21.15.173:0/1657756512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1100b2d50 0x7fe110153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:19.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe114c00640 1 --2- 172.21.15.173:0/1657756512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1100afc10 0x7fe110155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:19.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe115600640 1 -- 172.21.15.173:0/1657756512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1100b2d50 msgr2=0x7fe110153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:19.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe115600640 1 --2- 172.21.15.173:0/1657756512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1100b2d50 0x7fe110153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe115600640 1 -- 172.21.15.173:0/1657756512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1100afc10 msgr2=0x7fe110155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:19.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe115600640 1 --2- 172.21.15.173:0/1657756512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1100afc10 0x7fe110155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe115600640 1 -- 172.21.15.173:0/1657756512 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe110154490 con 0x7fe11015db30 2024-04-25T09:11:19.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe115600640 1 --2- 172.21.15.173:0/1657756512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe11015db30 0x7fe110158730 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fe10800efc0 tx=0x7fe10800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:19.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe10cc00640 1 -- 172.21.15.173:0/1657756512 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe108018020 con 0x7fe11015db30 2024-04-25T09:11:19.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe10cc00640 1 -- 172.21.15.173:0/1657756512 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe108014480 con 0x7fe11015db30 2024-04-25T09:11:19.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe10cc00640 1 -- 172.21.15.173:0/1657756512 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe108014870 con 0x7fe11015db30 2024-04-25T09:11:19.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe117600640 1 -- 172.21.15.173:0/1657756512 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11015e1c0 con 0x7fe11015db30 2024-04-25T09:11:19.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.538+0000 7fe117600640 1 -- 172.21.15.173:0/1657756512 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1100b4470 con 0x7fe11015db30 2024-04-25T09:11:19.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.542+0000 7fe117600640 1 -- 172.21.15.173:0/1657756512 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe110073a40 con 0x7fe11015db30 2024-04-25T09:11:19.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.542+0000 7fe10cc00640 1 -- 172.21.15.173:0/1657756512 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe10801b020 con 0x7fe11015db30 2024-04-25T09:11:19.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.542+0000 7fe10cc00640 1 --2- 172.21.15.173:0/1657756512 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0f0066f90 0x7fe0f0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:19.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.542+0000 7fe10cc00640 1 -- 172.21.15.173:0/1657756512 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe108085a80 con 0x7fe11015db30 2024-04-25T09:11:19.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.542+0000 7fe114c00640 1 --2- 172.21.15.173:0/1657756512 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0f0066f90 0x7fe0f0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:19.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.542+0000 7fe114c00640 1 --2- 172.21.15.173:0/1657756512 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0f0066f90 0x7fe0f0069450 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe1000ad000 tx=0x7fe1000a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:19.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.546+0000 7fe10cc00640 1 -- 172.21.15.173:0/1657756512 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe108022030 con 0x7fe11015db30 2024-04-25T09:11:19.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:19.758+0000 7fe117600640 1 -- 172.21.15.173:0/1657756512 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) v1 -- 0x7fe1100b6680 con 0x7fe11015db30 2024-04-25T09:11:20.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.718+0000 7fe10cc00640 1 -- 172.21.15.173:0/1657756512 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v413) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe108010040 con 0x7fe11015db30 2024-04-25T09:11:20.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.722+0000 7fe117600640 1 -- 172.21.15.173:0/1657756512 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0f0066f90 msgr2=0x7fe0f0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:20.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.722+0000 7fe117600640 1 --2- 172.21.15.173:0/1657756512 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0f0066f90 0x7fe0f0069450 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe1000ad000 tx=0x7fe1000a6000 comp rx=0 tx=0).stop 2024-04-25T09:11:20.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.722+0000 7fe117600640 1 -- 172.21.15.173:0/1657756512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe11015db30 msgr2=0x7fe110158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:20.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.722+0000 7fe117600640 1 --2- 172.21.15.173:0/1657756512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe11015db30 0x7fe110158730 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fe10800efc0 tx=0x7fe10800c490 comp rx=0 tx=0).stop 2024-04-25T09:11:20.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.722+0000 7fe117600640 1 -- 172.21.15.173:0/1657756512 shutdown_connections 2024-04-25T09:11:20.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.722+0000 7fe117600640 1 --2- 172.21.15.173:0/1657756512 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0f0066f90 0x7fe0f0069450 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:20.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.722+0000 7fe117600640 1 --2- 172.21.15.173:0/1657756512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe11015db30 0x7fe110158730 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:20.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.722+0000 7fe117600640 1 --2- 172.21.15.173:0/1657756512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1100b2d50 0x7fe110153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:20.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.722+0000 7fe117600640 1 --2- 172.21.15.173:0/1657756512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1100afc10 0x7fe110155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:20.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.722+0000 7fe117600640 1 -- 172.21.15.173:0/1657756512 >> 172.21.15.173:0/1657756512 conn(0x7fe1100b2230 msgr2=0x7fe1100b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:20.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.722+0000 7fe117600640 1 -- 172.21.15.173:0/1657756512 shutdown_connections 2024-04-25T09:11:20.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.722+0000 7fe117600640 1 -- 172.21.15.173:0/1657756512 wait complete. 2024-04-25T09:11:20.732 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:11:20.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.890+0000 7f063d000640 1 Processor -- start 2024-04-25T09:11:20.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.890+0000 7f063d000640 1 -- start start 2024-04-25T09:11:20.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.890+0000 7f063d000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f06380aef70 0x7f063806d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:20.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.890+0000 7f063d000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0638071570 con 0x7f06380aeb90 2024-04-25T09:11:20.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.890+0000 7f063d000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0638071850 con 0x7f06380cc7e0 2024-04-25T09:11:20.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.890+0000 7f063d000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0638071320 con 0x7f06380aef70 2024-04-25T09:11:20.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.890+0000 7f0636800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f06380aef70 0x7f063806d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:20.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.890+0000 7f0635e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f06380aeb90 0x7f06380cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41596/0 (socket says 172.21.15.173:41596) 2024-04-25T09:11:20.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.890+0000 7f0635e00640 1 -- 172.21.15.173:0/2361953300 learned_addr learned my addr 172.21.15.173:0/2361953300 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:20.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.890+0000 7f0636800640 1 -- 172.21.15.173:0/2361953300 >> v1:172.21.15.194:6789/0 conn(0x7f06380cc7e0 legacy=0x7f06380cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:20.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.890+0000 7f0636800640 1 -- 172.21.15.173:0/2361953300 >> v1:172.21.15.173:6789/0 conn(0x7f06380aeb90 legacy=0x7f06380cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:20.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.890+0000 7f0636800640 1 -- 172.21.15.173:0/2361953300 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0638071b30 con 0x7f06380aef70 2024-04-25T09:11:20.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.890+0000 7f0634a00640 1 -- 172.21.15.173:0/2361953300 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3395059476 0 0) 0x7f0638071570 con 0x7f06380aeb90 2024-04-25T09:11:20.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.894+0000 7f0636800640 1 --2- 172.21.15.173:0/2361953300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06380aef70 0x7f063806d940 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f0630009d90 tx=0x7f063001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5673558c025c496 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:20.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.894+0000 7f0634a00640 1 -- 172.21.15.173:0/2361953300 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06300b2070 con 0x7f06380aef70 2024-04-25T09:11:20.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.894+0000 7f0634a00640 1 -- 172.21.15.173:0/2361953300 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06300a58b0 con 0x7f06380aef70 2024-04-25T09:11:20.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.894+0000 7f0634a00640 1 -- 172.21.15.173:0/2361953300 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06300a5c80 con 0x7f06380aef70 2024-04-25T09:11:20.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.894+0000 7f063d000640 1 -- 172.21.15.173:0/2361953300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06380aef70 msgr2=0x7f063806d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:20.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.894+0000 7f063d000640 1 --2- 172.21.15.173:0/2361953300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06380aef70 0x7f063806d940 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f0630009d90 tx=0x7f063001c8e0 comp rx=0 tx=0).stop 2024-04-25T09:11:20.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.894+0000 7f063d000640 1 -- 172.21.15.173:0/2361953300 shutdown_connections 2024-04-25T09:11:20.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.894+0000 7f063d000640 1 --2- 172.21.15.173:0/2361953300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06380aef70 0x7f063806d940 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:20.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.894+0000 7f063d000640 1 -- 172.21.15.173:0/2361953300 >> 172.21.15.173:0/2361953300 conn(0x7f063806ac90 msgr2=0x7f063806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:20.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.894+0000 7f063d000640 1 -- 172.21.15.173:0/2361953300 shutdown_connections 2024-04-25T09:11:20.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.894+0000 7f063d000640 1 -- 172.21.15.173:0/2361953300 wait complete. 2024-04-25T09:11:20.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f063d000640 1 Processor -- start 2024-04-25T09:11:20.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f063d000640 1 -- start start 2024-04-25T09:11:20.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f063d000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06380aeb90 0x7f063814c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:20.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f063d000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06380aef70 0x7f06381440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:20.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f063d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06380cc7e0 0x7f0638149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:20.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f063d000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063806ea20 con 0x7f06380aef70 2024-04-25T09:11:20.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f063d000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063806e8a0 con 0x7f06380aeb90 2024-04-25T09:11:20.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f063d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0638168730 con 0x7f06380cc7e0 2024-04-25T09:11:20.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f0635400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06380aef70 0x7f06381440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:20.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f0635400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06380aef70 0x7f06381440d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41658/0 (socket says 172.21.15.173:41658) 2024-04-25T09:11:20.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f0635400640 1 -- 172.21.15.173:0/4127554083 learned_addr learned my addr 172.21.15.173:0/4127554083 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:20.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f0635e00640 1 --2- 172.21.15.173:0/4127554083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06380aeb90 0x7f063814c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:20.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f0636800640 1 --2- 172.21.15.173:0/4127554083 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06380cc7e0 0x7f0638149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:20.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f0635400640 1 -- 172.21.15.173:0/4127554083 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06380cc7e0 msgr2=0x7f0638149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:20.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f0635400640 1 --2- 172.21.15.173:0/4127554083 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06380cc7e0 0x7f0638149830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:20.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f0635400640 1 -- 172.21.15.173:0/4127554083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06380aeb90 msgr2=0x7f063814c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:20.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f0635400640 1 --2- 172.21.15.173:0/4127554083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06380aeb90 0x7f063814c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:20.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f0635400640 1 -- 172.21.15.173:0/4127554083 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0638148790 con 0x7f06380aef70 2024-04-25T09:11:20.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f0635e00640 1 --2- 172.21.15.173:0/4127554083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06380aeb90 0x7f063814c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:20.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f0635400640 1 --2- 172.21.15.173:0/4127554083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06380aef70 0x7f06381440d0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f062400c500 tx=0x7f062400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:20.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f062e000640 1 -- 172.21.15.173:0/4127554083 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624016020 con 0x7f06380aef70 2024-04-25T09:11:20.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f062e000640 1 -- 172.21.15.173:0/4127554083 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0624005220 con 0x7f06380aef70 2024-04-25T09:11:20.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f063d000640 1 -- 172.21.15.173:0/4127554083 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0638148a70 con 0x7f06380aef70 2024-04-25T09:11:20.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f062e000640 1 -- 172.21.15.173:0/4127554083 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624007030 con 0x7f06380aef70 2024-04-25T09:11:20.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f063d000640 1 -- 172.21.15.173:0/4127554083 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0638149030 con 0x7f06380aef70 2024-04-25T09:11:20.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.898+0000 7f063d000640 1 -- 172.21.15.173:0/4127554083 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0638073ab0 con 0x7f06380aef70 2024-04-25T09:11:20.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.902+0000 7f062e000640 1 -- 172.21.15.173:0/4127554083 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f06240071f0 con 0x7f06380aef70 2024-04-25T09:11:20.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.902+0000 7f062e000640 1 --2- 172.21.15.173:0/4127554083 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0618066f90 0x7f0618069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:20.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.902+0000 7f062e000640 1 -- 172.21.15.173:0/4127554083 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f0624084900 con 0x7f06380aef70 2024-04-25T09:11:20.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.902+0000 7f0635e00640 1 --2- 172.21.15.173:0/4127554083 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0618066f90 0x7f0618069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:20.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.902+0000 7f0635e00640 1 --2- 172.21.15.173:0/4127554083 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0618066f90 0x7f0618069450 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0628000f70 tx=0x7f0628009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:20.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:20.906+0000 7f062e000640 1 -- 172.21.15.173:0/4127554083 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0624020020 con 0x7f06380aef70 2024-04-25T09:11:21.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.058+0000 7f063d000640 1 -- 172.21.15.173:0/4127554083 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0638150d00 con 0x7f06380aef70 2024-04-25T09:11:21.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.062+0000 7f062e000640 1 -- 172.21.15.173:0/4127554083 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f06240559f0 con 0x7f06380aef70 2024-04-25T09:11:21.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.066+0000 7f063d000640 1 -- 172.21.15.173:0/4127554083 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0618066f90 msgr2=0x7f0618069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.066+0000 7f063d000640 1 --2- 172.21.15.173:0/4127554083 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0618066f90 0x7f0618069450 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0628000f70 tx=0x7f0628009040 comp rx=0 tx=0).stop 2024-04-25T09:11:21.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.066+0000 7f063d000640 1 -- 172.21.15.173:0/4127554083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06380aef70 msgr2=0x7f06381440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.066+0000 7f063d000640 1 --2- 172.21.15.173:0/4127554083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06380aef70 0x7f06381440d0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f062400c500 tx=0x7f062400c9c0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.066+0000 7f063d000640 1 -- 172.21.15.173:0/4127554083 shutdown_connections 2024-04-25T09:11:21.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.066+0000 7f063d000640 1 --2- 172.21.15.173:0/4127554083 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0618066f90 0x7f0618069450 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.066+0000 7f063d000640 1 --2- 172.21.15.173:0/4127554083 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06380cc7e0 0x7f0638149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.066+0000 7f063d000640 1 --2- 172.21.15.173:0/4127554083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06380aef70 0x7f06381440d0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.066+0000 7f063d000640 1 --2- 172.21.15.173:0/4127554083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06380aeb90 0x7f063814c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.066+0000 7f063d000640 1 -- 172.21.15.173:0/4127554083 >> 172.21.15.173:0/4127554083 conn(0x7f063806ac90 msgr2=0x7f063815c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:21.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.066+0000 7f063d000640 1 -- 172.21.15.173:0/4127554083 shutdown_connections 2024-04-25T09:11:21.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.066+0000 7f063d000640 1 -- 172.21.15.173:0/4127554083 wait complete. 2024-04-25T09:11:21.070 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:11:21.070 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:11:21.156 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:11:21.237 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:11:21.237 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:11:21.238 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:21.246 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:11:21.246 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:11:21.246 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:21.256 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:11:21.256 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:11:21.256 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:21.301 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:11:21.301 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:11:21.301 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:21.310 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:11:21.310 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:11:21.310 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:21.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.498+0000 7feb46000640 1 Processor -- start 2024-04-25T09:11:21.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.498+0000 7feb46000640 1 -- start start 2024-04-25T09:11:21.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.498+0000 7feb46000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4015df90 0x7feb400d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.498+0000 7feb46000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7feb4006f830 0x7feb4006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.498+0000 7feb46000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4006d870 con 0x7feb4015dbb0 2024-04-25T09:11:21.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.498+0000 7feb46000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb4015e5c0 con 0x7feb4006f830 2024-04-25T09:11:21.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.498+0000 7feb46000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4015e8a0 con 0x7feb4015df90 2024-04-25T09:11:21.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.502+0000 7feb3fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7feb4006f830 0x7feb4006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.502+0000 7feb3fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7feb4006f830 0x7feb4006fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41674/0 (socket says 172.21.15.173:41674) 2024-04-25T09:11:21.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.502+0000 7feb3fe00640 1 -- 172.21.15.173:0/3650120885 learned_addr learned my addr 172.21.15.173:0/3650120885 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:21.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.502+0000 7feb3ea00640 1 --2- 172.21.15.173:0/3650120885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4015df90 0x7feb400d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.502+0000 7feb3fe00640 1 -- 172.21.15.173:0/3650120885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4015df90 msgr2=0x7feb400d2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:21.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.502+0000 7feb3fe00640 1 --2- 172.21.15.173:0/3650120885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4015df90 0x7feb400d2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.502+0000 7feb3fe00640 1 -- 172.21.15.173:0/3650120885 >> v1:172.21.15.194:6789/0 conn(0x7feb4015dbb0 legacy=0x7feb4006c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.502+0000 7feb3fe00640 1 -- 172.21.15.173:0/3650120885 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb40161690 con 0x7feb4006f830 2024-04-25T09:11:21.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.502+0000 7feb3fe00640 1 --2- 172.21.15.173:0/3650120885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb4006f830 0x7feb4006fcc0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7feb38009870 tx=0x7feb3801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe0dee44911cb17 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:21.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.502+0000 7feb3e000640 1 -- 172.21.15.173:0/3650120885 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb380b2070 con 0x7feb4006f830 2024-04-25T09:11:21.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.502+0000 7feb3e000640 1 -- 172.21.15.173:0/3650120885 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb380a9070 con 0x7feb4006f830 2024-04-25T09:11:21.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.502+0000 7feb3e000640 1 -- 172.21.15.173:0/3650120885 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb380ad880 con 0x7feb4006f830 2024-04-25T09:11:21.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb46000640 1 -- 172.21.15.173:0/3650120885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb4006f830 msgr2=0x7feb4006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb46000640 1 --2- 172.21.15.173:0/3650120885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb4006f830 0x7feb4006fcc0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7feb38009870 tx=0x7feb3801c560 comp rx=0 tx=0).stop 2024-04-25T09:11:21.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb46000640 1 -- 172.21.15.173:0/3650120885 shutdown_connections 2024-04-25T09:11:21.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb46000640 1 --2- 172.21.15.173:0/3650120885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4015df90 0x7feb400d2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb46000640 1 --2- 172.21.15.173:0/3650120885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb4006f830 0x7feb4006fcc0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb46000640 1 -- 172.21.15.173:0/3650120885 >> 172.21.15.173:0/3650120885 conn(0x7feb40061880 msgr2=0x7feb40061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:21.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb46000640 1 -- 172.21.15.173:0/3650120885 shutdown_connections 2024-04-25T09:11:21.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb46000640 1 -- 172.21.15.173:0/3650120885 wait complete. 2024-04-25T09:11:21.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb46000640 1 Processor -- start 2024-04-25T09:11:21.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb46000640 1 -- start start 2024-04-25T09:11:21.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb46000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb4006f830 0x7feb40155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb46000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4015dbb0 0x7feb400c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb46000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb4015df90 0x7feb401477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb46000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4016ab10 con 0x7feb4006f830 2024-04-25T09:11:21.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb46000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4016a990 con 0x7feb4015df90 2024-04-25T09:11:21.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb46000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4016ac90 con 0x7feb4015dbb0 2024-04-25T09:11:21.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb3f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb4006f830 0x7feb40155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb3f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb4006f830 0x7feb40155d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41680/0 (socket says 172.21.15.173:41680) 2024-04-25T09:11:21.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb3f400640 1 -- 172.21.15.173:0/2205820028 learned_addr learned my addr 172.21.15.173:0/2205820028 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:21.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb3ea00640 1 --2- 172.21.15.173:0/2205820028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4015dbb0 0x7feb400c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb3fe00640 1 --2- 172.21.15.173:0/2205820028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb4015df90 0x7feb401477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb3f400640 1 -- 172.21.15.173:0/2205820028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4015dbb0 msgr2=0x7feb400c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb3f400640 1 --2- 172.21.15.173:0/2205820028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4015dbb0 0x7feb400c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb3f400640 1 -- 172.21.15.173:0/2205820028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb4015df90 msgr2=0x7feb401477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb3f400640 1 --2- 172.21.15.173:0/2205820028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb4015df90 0x7feb401477d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.506+0000 7feb3f400640 1 -- 172.21.15.173:0/2205820028 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb40156610 con 0x7feb4006f830 2024-04-25T09:11:21.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.510+0000 7feb3f400640 1 --2- 172.21.15.173:0/2205820028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb4006f830 0x7feb40155d10 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7feb3000c790 tx=0x7feb3000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:21.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.510+0000 7feb37400640 1 -- 172.21.15.173:0/2205820028 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30016020 con 0x7feb4006f830 2024-04-25T09:11:21.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.510+0000 7feb37400640 1 -- 172.21.15.173:0/2205820028 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb30006d60 con 0x7feb4006f830 2024-04-25T09:11:21.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.510+0000 7feb46000640 1 -- 172.21.15.173:0/2205820028 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb401568f0 con 0x7feb4006f830 2024-04-25T09:11:21.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.510+0000 7feb37400640 1 -- 172.21.15.173:0/2205820028 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30003bc0 con 0x7feb4006f830 2024-04-25T09:11:21.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.510+0000 7feb46000640 1 -- 172.21.15.173:0/2205820028 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb40156eb0 con 0x7feb4006f830 2024-04-25T09:11:21.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.510+0000 7feb46000640 1 -- 172.21.15.173:0/2205820028 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb40073a40 con 0x7feb4006f830 2024-04-25T09:11:21.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.510+0000 7feb37400640 1 -- 172.21.15.173:0/2205820028 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feb3000a850 con 0x7feb4006f830 2024-04-25T09:11:21.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.510+0000 7feb37400640 1 --2- 172.21.15.173:0/2205820028 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb20066f60 0x7feb20069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.510+0000 7feb37400640 1 -- 172.21.15.173:0/2205820028 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5335+0+0 (secure 0 0 0) 0x7feb30084a30 con 0x7feb4006f830 2024-04-25T09:11:21.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.510+0000 7feb3ea00640 1 --2- 172.21.15.173:0/2205820028 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb20066f60 0x7feb20069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.514+0000 7feb3ea00640 1 --2- 172.21.15.173:0/2205820028 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb20066f60 0x7feb20069420 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7feb400b76f0 tx=0x7feb2c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:21.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.514+0000 7feb37400640 1 -- 172.21.15.173:0/2205820028 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feb30020020 con 0x7feb4006f830 2024-04-25T09:11:21.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.702+0000 7feb46000640 1 -- 172.21.15.173:0/2205820028 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb400cdb80 con 0x7feb4006f830 2024-04-25T09:11:21.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.702+0000 7feb37400640 1 -- 172.21.15.173:0/2205820028 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+3705 (secure 0 0 0) 0x7feb300555f0 con 0x7feb4006f830 2024-04-25T09:11:21.687 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:21.687 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":74,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1519522112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1519522112},{"type":"v1","addr":"172.21.15.194:6835","nonce":1519522112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7555,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/548680290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":548680290},{"type":"v1","addr":"172.21.15.173:6836","nonce":548680290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":7561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2602621503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2602621503},{"type":"v1","addr":"172.21.15.194:6833","nonce":2602621503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":8688,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/700002857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":700002857},{"type":"v1","addr":"172.21.15.173:6837","nonce":700002857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[]} 2024-04-25T09:11:21.687 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 74 2024-04-25T09:11:21.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.702+0000 7feb46000640 1 -- 172.21.15.173:0/2205820028 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb20066f60 msgr2=0x7feb20069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.702+0000 7feb46000640 1 --2- 172.21.15.173:0/2205820028 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb20066f60 0x7feb20069420 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7feb400b76f0 tx=0x7feb2c008040 comp rx=0 tx=0).stop 2024-04-25T09:11:21.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.702+0000 7feb46000640 1 -- 172.21.15.173:0/2205820028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb4006f830 msgr2=0x7feb40155d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.702+0000 7feb46000640 1 --2- 172.21.15.173:0/2205820028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb4006f830 0x7feb40155d10 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7feb3000c790 tx=0x7feb3000cc50 comp rx=0 tx=0).stop 2024-04-25T09:11:21.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.702+0000 7feb46000640 1 -- 172.21.15.173:0/2205820028 shutdown_connections 2024-04-25T09:11:21.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.702+0000 7feb46000640 1 --2- 172.21.15.173:0/2205820028 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb20066f60 0x7feb20069420 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.702+0000 7feb46000640 1 --2- 172.21.15.173:0/2205820028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb4015df90 0x7feb401477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.702+0000 7feb46000640 1 --2- 172.21.15.173:0/2205820028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4015dbb0 0x7feb400c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.702+0000 7feb46000640 1 --2- 172.21.15.173:0/2205820028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb4006f830 0x7feb40155d10 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.702+0000 7feb46000640 1 -- 172.21.15.173:0/2205820028 >> 172.21.15.173:0/2205820028 conn(0x7feb40061880 msgr2=0x7feb40061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:21.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.702+0000 7feb46000640 1 -- 172.21.15.173:0/2205820028 shutdown_connections 2024-04-25T09:11:21.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.702+0000 7feb46000640 1 -- 172.21.15.173:0/2205820028 wait complete. 2024-04-25T09:11:21.708 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:11:21.708 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:11:21.708 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:11:21.709 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:11:21.709 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:11:21.709 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:11:21.709 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:11:21.709 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:11:21.709 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:11:21.709 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:11:21.709 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:11:21.710 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:11:21.710 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:11:21.710 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:11:21.710 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:11:21.710 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:11:21.722 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:11:21.723 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:11:21.724 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:11:21.724 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:11:21.725 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:11:21.726 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:11:21.726 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:11:21.726 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:11:21.767 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:11:21.768 DEBUG:teuthology.parallel:result is None 2024-04-25T09:11:21.769 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:11:21.770 DEBUG:teuthology.parallel:result is None 2024-04-25T09:11:21.770 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:11:21.770 DEBUG:teuthology.parallel:result is None 2024-04-25T09:11:21.771 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:11:21.771 DEBUG:teuthology.parallel:result is None 2024-04-25T09:11:21.771 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:11:21.855 INFO:tasks.ceph.mds.a.smithi173.stdout:starting mds.a at 2024-04-25T09:11:21.856 INFO:tasks.ceph.mds.c.smithi173.stdout:starting mds.c at 2024-04-25T09:11:21.861 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-04-25T09:11:21.861 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-04-25T09:11:21.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.930+0000 7fb07e800640 1 Processor -- start 2024-04-25T09:11:21.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.930+0000 7fb07e800640 1 -- start start 2024-04-25T09:11:21.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.930+0000 7fb07e800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb0780aeb90 0x7fb0780cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.930+0000 7fb07e800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb0780aef70 0x7fb0780cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.930+0000 7fb07e800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb078071570 con 0x7fb0780cdba0 2024-04-25T09:11:21.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.930+0000 7fb07e800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb078071320 con 0x7fb0780aef70 2024-04-25T09:11:21.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.930+0000 7fb07e800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb078072330 con 0x7fb0780aeb90 2024-04-25T09:11:21.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.930+0000 7fb076a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb0780aef70 0x7fb0780cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.930+0000 7fb076a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb0780aef70 0x7fb0780cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41716/0 (socket says 172.21.15.173:41716) 2024-04-25T09:11:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.930+0000 7fb076a00640 1 -- 172.21.15.173:0/3157350788 learned_addr learned my addr 172.21.15.173:0/3157350788 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.930+0000 7fb077400640 1 --2- 172.21.15.173:0/3157350788 >> v2:172.21.15.194:3300/0 conn(0x7fb0780aeb90 0x7fb0780cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.930+0000 7fb076a00640 1 -- 172.21.15.173:0/3157350788 >> v2:172.21.15.194:3300/0 conn(0x7fb0780aeb90 msgr2=0x7fb0780cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.930+0000 7fb076a00640 1 --2- 172.21.15.173:0/3157350788 >> v2:172.21.15.194:3300/0 conn(0x7fb0780aeb90 0x7fb0780cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.930+0000 7fb076a00640 1 -- 172.21.15.173:0/3157350788 >> v1:172.21.15.194:6789/0 conn(0x7fb0780cdba0 legacy=0x7fb0780cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:21.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.934+0000 7fb076a00640 1 -- 172.21.15.173:0/3157350788 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb078071850 con 0x7fb0780aef70 2024-04-25T09:11:21.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.934+0000 7fb076a00640 1 --2- 172.21.15.173:0/3157350788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0780aef70 0x7fb0780cc610 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fb0780cd220 tx=0x7fb06401eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24665f446857fe4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:21.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.934+0000 7fb076000640 1 -- 172.21.15.173:0/3157350788 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0640b4070 con 0x7fb0780aef70 2024-04-25T09:11:21.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.934+0000 7fb076000640 1 -- 172.21.15.173:0/3157350788 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0640a7b00 con 0x7fb0780aef70 2024-04-25T09:11:21.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.934+0000 7fb076000640 1 -- 172.21.15.173:0/3157350788 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0640af440 con 0x7fb0780aef70 2024-04-25T09:11:21.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.934+0000 7fb07e800640 1 -- 172.21.15.173:0/3157350788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0780aef70 msgr2=0x7fb0780cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.934+0000 7fb07e800640 1 --2- 172.21.15.173:0/3157350788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0780aef70 0x7fb0780cc610 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fb0780cd220 tx=0x7fb06401eb30 comp rx=0 tx=0).stop 2024-04-25T09:11:21.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.934+0000 7fb07e800640 1 -- 172.21.15.173:0/3157350788 shutdown_connections 2024-04-25T09:11:21.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.934+0000 7fb07e800640 1 --2- 172.21.15.173:0/3157350788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0780aef70 0x7fb0780cc610 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.934+0000 7fb07e800640 1 --2- 172.21.15.173:0/3157350788 >> v2:172.21.15.194:3300/0 conn(0x7fb0780aeb90 0x7fb0780cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.934+0000 7fb07e800640 1 -- 172.21.15.173:0/3157350788 >> 172.21.15.173:0/3157350788 conn(0x7fb07806ac90 msgr2=0x7fb07806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:21.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.934+0000 7fb07e800640 1 -- 172.21.15.173:0/3157350788 shutdown_connections 2024-04-25T09:11:21.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.934+0000 7fb07e800640 1 -- 172.21.15.173:0/3157350788 wait complete. 2024-04-25T09:11:21.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb07e800640 1 Processor -- start 2024-04-25T09:11:21.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb07e800640 1 -- start start 2024-04-25T09:11:21.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb07e800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0780aeb90 0x7fb07814eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb07e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0780aef70 0x7fb07814cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb07e800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0780cdba0 0x7fb078154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb07e800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07815bb30 con 0x7fb0780aef70 2024-04-25T09:11:21.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb07e800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07815b9b0 con 0x7fb0780aeb90 2024-04-25T09:11:21.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb07e800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07815bcb0 con 0x7fb0780cdba0 2024-04-25T09:11:21.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb076a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0780aef70 0x7fb07814cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb076a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0780aef70 0x7fb07814cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41718/0 (socket says 172.21.15.173:41718) 2024-04-25T09:11:21.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb076a00640 1 -- 172.21.15.173:0/2443457382 learned_addr learned my addr 172.21.15.173:0/2443457382 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:21.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb077400640 1 --2- 172.21.15.173:0/2443457382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0780aeb90 0x7fb07814eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb077e00640 1 --2- 172.21.15.173:0/2443457382 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0780cdba0 0x7fb078154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb076a00640 1 -- 172.21.15.173:0/2443457382 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0780cdba0 msgr2=0x7fb078154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb076a00640 1 --2- 172.21.15.173:0/2443457382 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0780cdba0 0x7fb078154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb076a00640 1 -- 172.21.15.173:0/2443457382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0780aeb90 msgr2=0x7fb07814eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb076a00640 1 --2- 172.21.15.173:0/2443457382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0780aeb90 0x7fb07814eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb076a00640 1 -- 172.21.15.173:0/2443457382 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07814f2e0 con 0x7fb0780aef70 2024-04-25T09:11:21.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb076a00640 1 --2- 172.21.15.173:0/2443457382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0780aef70 0x7fb07814cd00 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fb06401b740 tx=0x7fb06401b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:21.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb06f400640 1 -- 172.21.15.173:0/2443457382 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0640b4030 con 0x7fb0780aef70 2024-04-25T09:11:21.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb06f400640 1 -- 172.21.15.173:0/2443457382 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0640b6070 con 0x7fb0780aef70 2024-04-25T09:11:21.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb07e800640 1 -- 172.21.15.173:0/2443457382 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07814dd00 con 0x7fb0780aef70 2024-04-25T09:11:21.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.938+0000 7fb06f400640 1 -- 172.21.15.173:0/2443457382 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0640ad550 con 0x7fb0780aef70 2024-04-25T09:11:21.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.942+0000 7fb07e800640 1 -- 172.21.15.173:0/2443457382 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07814e2c0 con 0x7fb0780aef70 2024-04-25T09:11:21.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.942+0000 7fb07e800640 1 -- 172.21.15.173:0/2443457382 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb078073ab0 con 0x7fb0780aef70 2024-04-25T09:11:21.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.942+0000 7fb06f400640 1 -- 172.21.15.173:0/2443457382 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb0640c1060 con 0x7fb0780aef70 2024-04-25T09:11:21.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.942+0000 7fb06f400640 1 --2- 172.21.15.173:0/2443457382 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb058066f60 0x7fb058069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.942+0000 7fb06f400640 1 -- 172.21.15.173:0/2443457382 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fb06411f2c0 con 0x7fb0780aef70 2024-04-25T09:11:21.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.942+0000 7fb077400640 1 --2- 172.21.15.173:0/2443457382 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb058066f60 0x7fb058069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.928 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-04-25T09:11:21.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-04-25T09:11:21.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-04-25T09:11:21.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.942+0000 7fb077400640 1 --2- 172.21.15.173:0/2443457382 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb058066f60 0x7fb058069420 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb0680079c0 tx=0x7fb068008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:21.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:21.946+0000 7fb06f400640 1 -- 172.21.15.173:0/2443457382 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb0640187e0 con 0x7fb0780aef70 2024-04-25T09:11:22.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.114+0000 7fb07e800640 1 -- 172.21.15.173:0/2443457382 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb07806b3b0 con 0x7fb0780aef70 2024-04-25T09:11:22.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.734+0000 7fb06f400640 1 -- 172.21.15.173:0/2443457382 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v116) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb0640f0430 con 0x7fb0780aef70 2024-04-25T09:11:22.721 INFO:teuthology.orchestra.run.smithi173.stderr: removed all blocklist entries 2024-04-25T09:11:22.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.738+0000 7fb07e800640 1 -- 172.21.15.173:0/2443457382 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb058066f60 msgr2=0x7fb058069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.738+0000 7fb07e800640 1 --2- 172.21.15.173:0/2443457382 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb058066f60 0x7fb058069420 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb0680079c0 tx=0x7fb068008040 comp rx=0 tx=0).stop 2024-04-25T09:11:22.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.738+0000 7fb07e800640 1 -- 172.21.15.173:0/2443457382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0780aef70 msgr2=0x7fb07814cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.738+0000 7fb07e800640 1 --2- 172.21.15.173:0/2443457382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0780aef70 0x7fb07814cd00 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fb06401b740 tx=0x7fb06401b8d0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.738+0000 7fb07e800640 1 -- 172.21.15.173:0/2443457382 shutdown_connections 2024-04-25T09:11:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.738+0000 7fb07e800640 1 --2- 172.21.15.173:0/2443457382 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb058066f60 0x7fb058069420 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.738+0000 7fb07e800640 1 --2- 172.21.15.173:0/2443457382 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0780cdba0 0x7fb078154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.738+0000 7fb07e800640 1 --2- 172.21.15.173:0/2443457382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0780aef70 0x7fb07814cd00 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.738+0000 7fb07e800640 1 --2- 172.21.15.173:0/2443457382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0780aeb90 0x7fb07814eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.738+0000 7fb07e800640 1 -- 172.21.15.173:0/2443457382 >> 172.21.15.173:0/2443457382 conn(0x7fb07806ac90 msgr2=0x7fb07806e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.738+0000 7fb07e800640 1 -- 172.21.15.173:0/2443457382 shutdown_connections 2024-04-25T09:11:22.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.738+0000 7fb07e800640 1 -- 172.21.15.173:0/2443457382 wait complete. 2024-04-25T09:11:22.749 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:11:22.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.902+0000 7f05b8c00640 1 Processor -- start 2024-04-25T09:11:22.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.902+0000 7f05b8c00640 1 -- start start 2024-04-25T09:11:22.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.902+0000 7f05b8c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b40b3e70 0x7f05b40b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.902+0000 7f05b8c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b40b3590 con 0x7f05b415edd0 2024-04-25T09:11:22.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.902+0000 7f05b8c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b40b4790 con 0x7f05b40aefa0 2024-04-25T09:11:22.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.902+0000 7f05b8c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b406dd50 con 0x7f05b40b3e70 2024-04-25T09:11:22.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b2800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f05b415edd0 0x7f05b40b2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41626/0 (socket says 172.21.15.173:41626) 2024-04-25T09:11:22.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b2800640 1 -- 172.21.15.173:0/2588864214 learned_addr learned my addr 172.21.15.173:0/2588864214 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:22.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b1e00640 1 --2- 172.21.15.173:0/2588864214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b40b3e70 0x7f05b40b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b0a00640 1 -- 172.21.15.173:0/2588864214 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382508418 0 0) 0x7f05b40b3590 con 0x7f05b415edd0 2024-04-25T09:11:22.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b0a00640 1 -- 172.21.15.173:0/2588864214 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0598005740 con 0x7f05b415edd0 2024-04-25T09:11:22.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b0a00640 1 -- 172.21.15.173:0/2588864214 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1338873488 0 0) 0x7f0598005740 con 0x7f05b415edd0 2024-04-25T09:11:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b0a00640 1 -- 172.21.15.173:0/2588864214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b40b3e70 msgr2=0x7f05b40b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b0a00640 1 --2- 172.21.15.173:0/2588864214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b40b3e70 0x7f05b40b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b0a00640 1 -- 172.21.15.173:0/2588864214 >> v1:172.21.15.194:6789/0 conn(0x7f05b40aefa0 legacy=0x7f05b40b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b0a00640 1 -- 172.21.15.173:0/2588864214 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b415f320 con 0x7f05b415edd0 2024-04-25T09:11:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b0a00640 1 -- 172.21.15.173:0/2588864214 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f05ac001a00 con 0x7f05b415edd0 2024-04-25T09:11:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b0a00640 1 -- 172.21.15.173:0/2588864214 >> v1:172.21.15.173:6789/0 conn(0x7f05b415edd0 legacy=0x7f05b40b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b0a00640 1 --2- 172.21.15.173:0/2588864214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0598005c00 0x7f0598005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b0a00640 1 --2- 172.21.15.173:0/2588864214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05980065b0 0x7f0598006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b0a00640 1 --2- 172.21.15.173:0/2588864214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b40b3e70 0x7f05980072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b0a00640 1 -- 172.21.15.173:0/2588864214 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b406dd50 con 0x7f05980065b0 2024-04-25T09:11:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b0a00640 1 -- 172.21.15.173:0/2588864214 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059800dbe0 con 0x7f0598005c00 2024-04-25T09:11:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b0a00640 1 -- 172.21.15.173:0/2588864214 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059800dde0 con 0x7f05b40b3e70 2024-04-25T09:11:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b1400640 1 --2- 172.21.15.173:0/2588864214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05980065b0 0x7f0598006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b2800640 1 --2- 172.21.15.173:0/2588864214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b40b3e70 0x7f05980072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b1e00640 1 --2- 172.21.15.173:0/2588864214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0598005c00 0x7f0598005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b1400640 1 -- 172.21.15.173:0/2588864214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b40b3e70 msgr2=0x7f05980072e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:22.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b1400640 1 --2- 172.21.15.173:0/2588864214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b40b3e70 0x7f05980072e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b1400640 1 -- 172.21.15.173:0/2588864214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0598005c00 msgr2=0x7f0598005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:22.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b1400640 1 --2- 172.21.15.173:0/2588864214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0598005c00 0x7f0598005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b1400640 1 -- 172.21.15.173:0/2588864214 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0598005740 con 0x7f05980065b0 2024-04-25T09:11:22.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.906+0000 7f05b1e00640 1 --2- 172.21.15.173:0/2588864214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0598005c00 0x7f0598005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:22.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.910+0000 7f05b1400640 1 --2- 172.21.15.173:0/2588864214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05980065b0 0x7f0598006a80 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f05a0001860 tx=0x7f05a001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e362b0433e4675 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:22.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.910+0000 7f05b0a00640 1 -- 172.21.15.173:0/2588864214 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a00b1070 con 0x7f05980065b0 2024-04-25T09:11:22.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.910+0000 7f05b0a00640 1 -- 172.21.15.173:0/2588864214 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a00ac640 con 0x7f05980065b0 2024-04-25T09:11:22.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.910+0000 7f05b0a00640 1 -- 172.21.15.173:0/2588864214 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0001460 con 0x7f05980065b0 2024-04-25T09:11:22.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.910+0000 7f05b8c00640 1 -- 172.21.15.173:0/2588864214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05980065b0 msgr2=0x7f0598006a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.910+0000 7f05b8c00640 1 --2- 172.21.15.173:0/2588864214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05980065b0 0x7f0598006a80 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f05a0001860 tx=0x7f05a001c4d0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.910+0000 7f05b2800640 1 -- 172.21.15.173:0/2588864214 reap_dead start 2024-04-25T09:11:22.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.910+0000 7f05b8c00640 1 -- 172.21.15.173:0/2588864214 shutdown_connections 2024-04-25T09:11:22.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.910+0000 7f05b8c00640 1 -- 172.21.15.173:0/2588864214 >> 172.21.15.173:0/2588864214 conn(0x7f05b406ac90 msgr2=0x7f05b406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:22.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.910+0000 7f05b8c00640 1 -- 172.21.15.173:0/2588864214 shutdown_connections 2024-04-25T09:11:22.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.910+0000 7f05b8c00640 1 -- 172.21.15.173:0/2588864214 wait complete. 2024-04-25T09:11:22.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.910+0000 7f05b8c00640 1 Processor -- start 2024-04-25T09:11:22.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.910+0000 7f05b8c00640 1 -- start start 2024-04-25T09:11:22.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b8c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05980065b0 0x7f05b4146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b8c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05b4157930 0x7f05b4157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b8c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b41596f0 0x7f05b4159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b8c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b415aba0 con 0x7f05b41596f0 2024-04-25T09:11:22.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b8c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40ce7b0 con 0x7f05b4157930 2024-04-25T09:11:22.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b8c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b406e1c0 con 0x7f05980065b0 2024-04-25T09:11:22.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b2800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b41596f0 0x7f05b4159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b2800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b41596f0 0x7f05b4159b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41746/0 (socket says 172.21.15.173:41746) 2024-04-25T09:11:22.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b2800640 1 -- 172.21.15.173:0/1866733545 learned_addr learned my addr 172.21.15.173:0/1866733545 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:22.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b1e00640 1 --2- 172.21.15.173:0/1866733545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05980065b0 0x7f05b4146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b1400640 1 --2- 172.21.15.173:0/1866733545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05b4157930 0x7f05b4157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b2800640 1 -- 172.21.15.173:0/1866733545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05980065b0 msgr2=0x7f05b4146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b2800640 1 --2- 172.21.15.173:0/1866733545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05980065b0 0x7f05b4146410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b2800640 1 -- 172.21.15.173:0/1866733545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05b4157930 msgr2=0x7f05b4157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b2800640 1 --2- 172.21.15.173:0/1866733545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05b4157930 0x7f05b4157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b2800640 1 -- 172.21.15.173:0/1866733545 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b41583d0 con 0x7f05b41596f0 2024-04-25T09:11:22.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b2800640 1 --2- 172.21.15.173:0/1866733545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b41596f0 0x7f05b4159b70 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f05b40625d0 tx=0x7f05ac007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:22.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05aa000640 1 -- 172.21.15.173:0/1866733545 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac00ea80 con 0x7f05b41596f0 2024-04-25T09:11:22.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05aa000640 1 -- 172.21.15.173:0/1866733545 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac018070 con 0x7f05b41596f0 2024-04-25T09:11:22.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b8c00640 1 -- 172.21.15.173:0/1866733545 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b41586b0 con 0x7f05b41596f0 2024-04-25T09:11:22.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05aa000640 1 -- 172.21.15.173:0/1866733545 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac00ee60 con 0x7f05b41596f0 2024-04-25T09:11:22.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b8c00640 1 -- 172.21.15.173:0/1866733545 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b4147180 con 0x7f05b41596f0 2024-04-25T09:11:22.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05b8c00640 1 -- 172.21.15.173:0/1866733545 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b4073a40 con 0x7f05b41596f0 2024-04-25T09:11:22.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.914+0000 7f05aa000640 1 -- 172.21.15.173:0/1866733545 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f05ac01d460 con 0x7f05b41596f0 2024-04-25T09:11:22.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.918+0000 7f05aa000640 1 --2- 172.21.15.173:0/1866733545 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0594066f90 0x7f0594069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.918+0000 7f05aa000640 1 -- 172.21.15.173:0/1866733545 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f05ac084fb0 con 0x7f05b41596f0 2024-04-25T09:11:22.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.918+0000 7f05b1e00640 1 --2- 172.21.15.173:0/1866733545 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0594066f90 0x7f0594069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.918+0000 7f05b1e00640 1 --2- 172.21.15.173:0/1866733545 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0594066f90 0x7f0594069450 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009b60 tx=0x7f05a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:22.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:22.922+0000 7f05aa000640 1 -- 172.21.15.173:0/1866733545 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f05ac055a90 con 0x7f05b41596f0 2024-04-25T09:11:23.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.126+0000 7f05b8c00640 1 -- 172.21.15.173:0/1866733545 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f05b40d0540 con 0x7f05b41596f0 2024-04-25T09:11:23.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.130+0000 7f05aa000640 1 -- 172.21.15.173:0/1866733545 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f05ac059b30 con 0x7f05b41596f0 2024-04-25T09:11:23.113 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:23.114 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:11:23.114 INFO:teuthology.orchestra.run.smithi173.stdout: "auth_dump": [ 2024-04-25T09:11:23.114 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.114 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.a", 2024-04-25T09:11:23.114 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmnVr3EhAAn+C0Mb/MrYSZuQyr5QTXig==", 2024-04-25T09:11:23.114 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.114 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:11:23.114 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:11:23.114 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:11:23.114 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:11:23.114 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.114 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:11:23.114 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.114 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.b", 2024-04-25T09:11:23.114 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6Gypm0QfFHhAAuP8xE/8pvSZMcP8N33OB9Q==", 2024-04-25T09:11:23.115 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.115 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:11:23.115 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:11:23.115 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:11:23.115 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:11:23.115 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.115 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:11:23.115 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.115 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.c", 2024-04-25T09:11:23.115 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmQsv4GRAATNiD7udOvl8xRDIx64O5jg==", 2024-04-25T09:11:23.115 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.115 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:11:23.115 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:11:23.115 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:11:23.115 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:11:23.115 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.116 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:11:23.116 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.116 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.d", 2024-04-25T09:11:23.116 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmtGMSJhAAonqLeuSsNrgyZks1eoJ1Gg==", 2024-04-25T09:11:23.116 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.116 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:11:23.116 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:11:23.116 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:11:23.116 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:11:23.116 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.116 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:11:23.116 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.116 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.0", 2024-04-25T09:11:23.116 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD9Gypm+Yw7LBAAnOFUKU3w1ltre7aHMWZ/SQ==", 2024-04-25T09:11:23.116 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.117 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:11:23.117 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:11:23.117 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:11:23.117 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.117 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:11:23.117 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.117 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.1", 2024-04-25T09:11:23.117 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAAHCpm4BUIOBAAmbfWUWCun/una5WoemhL6Q==", 2024-04-25T09:11:23.117 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.117 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:11:23.117 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:11:23.117 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:11:23.117 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.117 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:11:23.117 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.117 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.2", 2024-04-25T09:11:23.118 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAEHCpmFXIaBRAA0cN2GdLSS3jJC+x4RVUUlw==", 2024-04-25T09:11:23.118 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.118 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:11:23.118 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:11:23.118 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:11:23.118 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.118 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:11:23.118 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.118 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.3", 2024-04-25T09:11:23.118 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAHHCpmUD+YDxAALPvf1wLzhuQmFPo3/vJkdQ==", 2024-04-25T09:11:23.118 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.118 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:11:23.118 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:11:23.118 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:11:23.118 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.118 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:11:23.118 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.119 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.4", 2024-04-25T09:11:23.119 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQANHCpmLQ0fCBAA1Shz0Pfns+rj5r601hzOnQ==", 2024-04-25T09:11:23.119 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.119 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:11:23.119 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:11:23.119 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:11:23.119 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.119 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:11:23.119 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.119 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.5", 2024-04-25T09:11:23.119 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAQHCpmyMj1ERAAMRvZ3PFQa9oe6oGemLvfxw==", 2024-04-25T09:11:23.119 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.119 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:11:23.119 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:11:23.119 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:11:23.119 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.119 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:11:23.120 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.120 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.6", 2024-04-25T09:11:23.120 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQATHCpmKha6GxAAF4zfdFDlylGHHhGI5tVpGA==", 2024-04-25T09:11:23.120 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.120 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:11:23.120 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:11:23.120 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:11:23.120 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.120 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:11:23.120 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.120 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.7", 2024-04-25T09:11:23.120 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAWHCpmB2lFJhAA3sYYsjS5DIC5fCDz6ur0tA==", 2024-04-25T09:11:23.120 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.120 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:11:23.120 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:11:23.120 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:11:23.121 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.121 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:11:23.121 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.121 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.0", 2024-04-25T09:11:23.121 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w==", 2024-04-25T09:11:23.121 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.121 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:11:23.121 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow r", 2024-04-25T09:11:23.121 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:11:23.121 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.121 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:11:23.121 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.121 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.1", 2024-04-25T09:11:23.121 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6Gypm1PbHMxAAXMrgpR/xgzfQuuNrculQxA==", 2024-04-25T09:11:23.121 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.121 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:11:23.121 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:11:23.122 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:11:23.122 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:11:23.122 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.122 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:11:23.122 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.122 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.2", 2024-04-25T09:11:23.122 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmrTxjMBAAaqwDl5uiLxhaDIk7m6oDIw==", 2024-04-25T09:11:23.122 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.122 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:11:23.122 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:11:23.122 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:11:23.122 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:11:23.122 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.122 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:11:23.122 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.122 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.3", 2024-04-25T09:11:23.123 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmlAS9ORAAvYbwLnUaDHXOqvEBwJJJcQ==", 2024-04-25T09:11:23.123 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.123 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:11:23.123 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:11:23.123 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:11:23.123 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:11:23.123 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.123 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:11:23.123 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.123 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.admin", 2024-04-25T09:11:23.123 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD5GypmYFhkMhAACwSsE+B9l263vnlJ0LjFkQ==", 2024-04-25T09:11:23.123 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.123 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:11:23.123 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:11:23.123 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:11:23.123 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:11:23.124 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.124 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:11:23.124 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.124 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mgr.x", 2024-04-25T09:11:23.124 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmMSqHDhAAe0nkrXbT7dBbAbI89ExUmw==", 2024-04-25T09:11:23.124 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.124 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:11:23.124 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile mgr", 2024-04-25T09:11:23.124 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:11:23.124 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.124 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:11:23.124 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:23.124 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mgr.y", 2024-04-25T09:11:23.124 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmjCuzChAAomjH5vLVICqSFpyDVQeB4w==", 2024-04-25T09:11:23.124 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:11:23.124 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:11:23.124 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile mgr", 2024-04-25T09:11:23.125 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:11:23.125 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.125 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:23.125 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-04-25T09:11:23.125 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:11:23.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.130+0000 7f05b8c00640 1 -- 172.21.15.173:0/1866733545 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0594066f90 msgr2=0x7f0594069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.130+0000 7f05b8c00640 1 --2- 172.21.15.173:0/1866733545 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0594066f90 0x7f0594069450 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009b60 tx=0x7f05a4008040 comp rx=0 tx=0).stop 2024-04-25T09:11:23.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.130+0000 7f05b8c00640 1 -- 172.21.15.173:0/1866733545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b41596f0 msgr2=0x7f05b4159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.130+0000 7f05b8c00640 1 --2- 172.21.15.173:0/1866733545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b41596f0 0x7f05b4159b70 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f05b40625d0 tx=0x7f05ac007bc0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.130+0000 7f05b8c00640 1 -- 172.21.15.173:0/1866733545 shutdown_connections 2024-04-25T09:11:23.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.130+0000 7f05b8c00640 1 --2- 172.21.15.173:0/1866733545 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0594066f90 0x7f0594069450 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.130+0000 7f05b8c00640 1 --2- 172.21.15.173:0/1866733545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b41596f0 0x7f05b4159b70 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.130+0000 7f05b8c00640 1 --2- 172.21.15.173:0/1866733545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05b4157930 0x7f05b4157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.130+0000 7f05b8c00640 1 --2- 172.21.15.173:0/1866733545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05980065b0 0x7f05b4146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.130+0000 7f05b8c00640 1 -- 172.21.15.173:0/1866733545 >> 172.21.15.173:0/1866733545 conn(0x7f05b406ac90 msgr2=0x7f05b40cbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.130+0000 7f05b8c00640 1 -- 172.21.15.173:0/1866733545 shutdown_connections 2024-04-25T09:11:23.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.130+0000 7f05b8c00640 1 -- 172.21.15.173:0/1866733545 wait complete. 2024-04-25T09:11:23.134 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:23.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.282+0000 7f553e200640 1 Processor -- start 2024-04-25T09:11:23.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.282+0000 7f553e200640 1 -- start start 2024-04-25T09:11:23.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.286+0000 7f553e200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5538157f00 0x7f55380b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.286+0000 7f553e200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f553806ac90 0x7f553806b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.286+0000 7f553e200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f553815e010 con 0x7f55380b36c0 2024-04-25T09:11:23.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.286+0000 7f553e200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55380b55b0 con 0x7f553806ac90 2024-04-25T09:11:23.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.286+0000 7f553e200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f553806ebe0 con 0x7f5538157f00 2024-04-25T09:11:23.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.286+0000 7f5537e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f553806ac90 0x7f553806b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.286+0000 7f5536a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f55380b36c0 0x7f553806e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46390/0 (socket says 172.21.15.173:46390) 2024-04-25T09:11:23.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.286+0000 7f5536a00640 1 -- 172.21.15.173:0/3289583028 learned_addr learned my addr 172.21.15.173:0/3289583028 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:23.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.286+0000 7f5537400640 1 --2- 172.21.15.173:0/3289583028 >> v2:172.21.15.194:3300/0 conn(0x7f5538157f00 0x7f55380b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.286+0000 7f5537e00640 1 -- 172.21.15.173:0/3289583028 >> v2:172.21.15.194:3300/0 conn(0x7f5538157f00 msgr2=0x7f55380b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.286+0000 7f5537e00640 1 --2- 172.21.15.173:0/3289583028 >> v2:172.21.15.194:3300/0 conn(0x7f5538157f00 0x7f55380b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.286+0000 7f5537e00640 1 -- 172.21.15.173:0/3289583028 >> v1:172.21.15.173:6789/0 conn(0x7f55380b36c0 legacy=0x7f553806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.286+0000 7f5537e00640 1 -- 172.21.15.173:0/3289583028 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55380b57e0 con 0x7f553806ac90 2024-04-25T09:11:23.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.286+0000 7f5536000640 1 -- 172.21.15.173:0/3289583028 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337047480 0 0) 0x7f553815e010 con 0x7f55380b36c0 2024-04-25T09:11:23.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.290+0000 7f5537e00640 1 --2- 172.21.15.173:0/3289583028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f553806ac90 0x7f553806b0c0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f55380720f0 tx=0x7f553001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9f97a330be5507 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.290+0000 7f5536000640 1 -- 172.21.15.173:0/3289583028 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300b2070 con 0x7f553806ac90 2024-04-25T09:11:23.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.290+0000 7f5536000640 1 -- 172.21.15.173:0/3289583028 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55300a58e0 con 0x7f553806ac90 2024-04-25T09:11:23.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.290+0000 7f5536000640 1 -- 172.21.15.173:0/3289583028 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300a5cb0 con 0x7f553806ac90 2024-04-25T09:11:23.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.290+0000 7f553e200640 1 -- 172.21.15.173:0/3289583028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f553806ac90 msgr2=0x7f553806b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.290+0000 7f553e200640 1 --2- 172.21.15.173:0/3289583028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f553806ac90 0x7f553806b0c0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f55380720f0 tx=0x7f553001c930 comp rx=0 tx=0).stop 2024-04-25T09:11:23.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.290+0000 7f553e200640 1 -- 172.21.15.173:0/3289583028 shutdown_connections 2024-04-25T09:11:23.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.290+0000 7f553e200640 1 --2- 172.21.15.173:0/3289583028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f553806ac90 0x7f553806b0c0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.290+0000 7f553e200640 1 --2- 172.21.15.173:0/3289583028 >> v2:172.21.15.194:3300/0 conn(0x7f5538157f00 0x7f55380b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.290+0000 7f553e200640 1 -- 172.21.15.173:0/3289583028 >> 172.21.15.173:0/3289583028 conn(0x7f5538099a50 msgr2=0x7f55380b5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.290+0000 7f553e200640 1 -- 172.21.15.173:0/3289583028 shutdown_connections 2024-04-25T09:11:23.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.290+0000 7f553e200640 1 -- 172.21.15.173:0/3289583028 wait complete. 2024-04-25T09:11:23.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.290+0000 7f553e200640 1 Processor -- start 2024-04-25T09:11:23.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.290+0000 7f553e200640 1 -- start start 2024-04-25T09:11:23.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f553e200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f553806ac90 0x7f5538150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f553e200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55380b36c0 0x7f553809df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f553e200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5538157f00 0x7f553809a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f553e200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55381582e0 con 0x7f553806ac90 2024-04-25T09:11:23.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f553e200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55380b3b30 con 0x7f5538157f00 2024-04-25T09:11:23.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f553e200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5538158460 con 0x7f55380b36c0 2024-04-25T09:11:23.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f5537400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f553806ac90 0x7f5538150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f5537400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f553806ac90 0x7f5538150220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36606/0 (socket says 172.21.15.173:36606) 2024-04-25T09:11:23.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f5537400640 1 -- 172.21.15.173:0/913052447 learned_addr learned my addr 172.21.15.173:0/913052447 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:23.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f5537400640 1 -- 172.21.15.173:0/913052447 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55380b36c0 msgr2=0x7f553809df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f5537400640 1 --2- 172.21.15.173:0/913052447 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55380b36c0 0x7f553809df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f5537400640 1 -- 172.21.15.173:0/913052447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5538157f00 msgr2=0x7f553809a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f5537400640 1 --2- 172.21.15.173:0/913052447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5538157f00 0x7f553809a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f5537400640 1 -- 172.21.15.173:0/913052447 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55381f7ed0 con 0x7f553806ac90 2024-04-25T09:11:23.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f5537400640 1 --2- 172.21.15.173:0/913052447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f553806ac90 0x7f5538150220 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f552800d5f0 tx=0x7f552800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f552f400640 1 -- 172.21.15.173:0/913052447 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55280125f0 con 0x7f553806ac90 2024-04-25T09:11:23.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f552f400640 1 -- 172.21.15.173:0/913052447 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5528019070 con 0x7f553806ac90 2024-04-25T09:11:23.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f552f400640 1 -- 172.21.15.173:0/913052447 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55280129b0 con 0x7f553806ac90 2024-04-25T09:11:23.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f553e200640 1 -- 172.21.15.173:0/913052447 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55381f81b0 con 0x7f553806ac90 2024-04-25T09:11:23.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f553e200640 1 -- 172.21.15.173:0/913052447 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55381f8770 con 0x7f553806ac90 2024-04-25T09:11:23.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f553e200640 1 -- 172.21.15.173:0/913052447 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5538073a40 con 0x7f553806ac90 2024-04-25T09:11:23.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.294+0000 7f552f400640 1 -- 172.21.15.173:0/913052447 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5528012b50 con 0x7f553806ac90 2024-04-25T09:11:23.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.298+0000 7f552f400640 1 --2- 172.21.15.173:0/913052447 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5514066f60 0x7f5514069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.298+0000 7f552f400640 1 -- 172.21.15.173:0/913052447 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f55280852b0 con 0x7f553806ac90 2024-04-25T09:11:23.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.298+0000 7f5536a00640 1 --2- 172.21.15.173:0/913052447 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5514066f60 0x7f5514069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.298+0000 7f5536a00640 1 --2- 172.21.15.173:0/913052447 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5514066f60 0x7f5514069420 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f55200011f0 tx=0x7f5520007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.302+0000 7f552f400640 1 -- 172.21.15.173:0/913052447 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5528056460 con 0x7f553806ac90 2024-04-25T09:11:23.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.454+0000 7f553e200640 1 -- 172.21.15.173:0/913052447 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f553815b3f0 con 0x7f553806ac90 2024-04-25T09:11:23.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.454+0000 7f552f400640 1 -- 172.21.15.173:0/913052447 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+13234 (secure 0 0 0) 0x7f5528055d60 con 0x7f553806ac90 2024-04-25T09:11:23.441 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:23.441 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":118,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:11:22.745909+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:23.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.458+0000 7f553e200640 1 -- 172.21.15.173:0/913052447 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5514066f60 msgr2=0x7f5514069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.458+0000 7f553e200640 1 --2- 172.21.15.173:0/913052447 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5514066f60 0x7f5514069420 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f55200011f0 tx=0x7f5520007930 comp rx=0 tx=0).stop 2024-04-25T09:11:23.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.458+0000 7f553e200640 1 -- 172.21.15.173:0/913052447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f553806ac90 msgr2=0x7f5538150220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.458+0000 7f553e200640 1 --2- 172.21.15.173:0/913052447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f553806ac90 0x7f5538150220 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f552800d5f0 tx=0x7f552800dab0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.458+0000 7f553e200640 1 -- 172.21.15.173:0/913052447 shutdown_connections 2024-04-25T09:11:23.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.458+0000 7f553e200640 1 --2- 172.21.15.173:0/913052447 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5514066f60 0x7f5514069420 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.458+0000 7f553e200640 1 --2- 172.21.15.173:0/913052447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5538157f00 0x7f553809a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.458+0000 7f553e200640 1 --2- 172.21.15.173:0/913052447 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55380b36c0 0x7f553809df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.458+0000 7f553e200640 1 --2- 172.21.15.173:0/913052447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f553806ac90 0x7f5538150220 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.458+0000 7f553e200640 1 -- 172.21.15.173:0/913052447 >> 172.21.15.173:0/913052447 conn(0x7f5538099a50 msgr2=0x7f55380b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.458+0000 7f553e200640 1 -- 172.21.15.173:0/913052447 shutdown_connections 2024-04-25T09:11:23.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.458+0000 7f553e200640 1 -- 172.21.15.173:0/913052447 wait complete. 2024-04-25T09:11:23.462 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:11:23.462 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:11:23.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.618+0000 7fd6d3c00640 1 Processor -- start 2024-04-25T09:11:23.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.618+0000 7fd6d3c00640 1 -- start start 2024-04-25T09:11:23.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.618+0000 7fd6d3c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6cc145290 0x7fd6cc15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.618+0000 7fd6d3c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd6cc0b3fe0 0x7fd6cc0b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.618+0000 7fd6d3c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6cc15c5f0 con 0x7fd6cc0cc260 2024-04-25T09:11:23.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.618+0000 7fd6d3c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6cc06d4b0 con 0x7fd6cc0b3fe0 2024-04-25T09:11:23.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.618+0000 7fd6d3c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc06d790 con 0x7fd6cc145290 2024-04-25T09:11:23.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.618+0000 7fd6cbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd6cc0b3fe0 0x7fd6cc0b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.618+0000 7fd6cbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd6cc0b3fe0 0x7fd6cc0b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36614/0 (socket says 172.21.15.173:36614) 2024-04-25T09:11:23.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.618+0000 7fd6cbe00640 1 -- 172.21.15.173:0/1835201849 learned_addr learned my addr 172.21.15.173:0/1835201849 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:23.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.618+0000 7fd6d1c00640 1 --1- 172.21.15.173:0/1835201849 >> v1:172.21.15.173:6789/0 conn(0x7fd6cc0cc260 0x7fd6cc0cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46396/0 (socket says 172.21.15.173:46396) 2024-04-25T09:11:23.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.618+0000 7fd6d1200640 1 --2- 172.21.15.173:0/1835201849 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6cc145290 0x7fd6cc15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.618+0000 7fd6cbe00640 1 -- 172.21.15.173:0/1835201849 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6cc145290 msgr2=0x7fd6cc15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.618+0000 7fd6cbe00640 1 --2- 172.21.15.173:0/1835201849 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6cc145290 0x7fd6cc15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.618+0000 7fd6cbe00640 1 -- 172.21.15.173:0/1835201849 >> v1:172.21.15.173:6789/0 conn(0x7fd6cc0cc260 legacy=0x7fd6cc0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.618+0000 7fd6cbe00640 1 -- 172.21.15.173:0/1835201849 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc06da70 con 0x7fd6cc0b3fe0 2024-04-25T09:11:23.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.618+0000 7fd6cb400640 1 -- 172.21.15.173:0/1835201849 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374609698 0 0) 0x7fd6c40014a0 con 0x7fd6cc0cc260 2024-04-25T09:11:23.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.622+0000 7fd6cbe00640 1 --2- 172.21.15.173:0/1835201849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6cc0b3fe0 0x7fd6cc0b4420 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8009870 tx=0x7fd6b801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246ff7b0d41d9331 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.622+0000 7fd6cb400640 1 -- 172.21.15.173:0/1835201849 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b80b0070 con 0x7fd6cc0b3fe0 2024-04-25T09:11:23.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.622+0000 7fd6cb400640 1 -- 172.21.15.173:0/1835201849 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b8004230 con 0x7fd6cc0b3fe0 2024-04-25T09:11:23.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.622+0000 7fd6cb400640 1 -- 172.21.15.173:0/1835201849 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8003620 con 0x7fd6cc0b3fe0 2024-04-25T09:11:23.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.622+0000 7fd6d3c00640 1 -- 172.21.15.173:0/1835201849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6cc0b3fe0 msgr2=0x7fd6cc0b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.622+0000 7fd6d3c00640 1 --2- 172.21.15.173:0/1835201849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6cc0b3fe0 0x7fd6cc0b4420 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8009870 tx=0x7fd6b801c440 comp rx=0 tx=0).stop 2024-04-25T09:11:23.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.622+0000 7fd6d3c00640 1 -- 172.21.15.173:0/1835201849 shutdown_connections 2024-04-25T09:11:23.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.622+0000 7fd6d3c00640 1 --2- 172.21.15.173:0/1835201849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6cc0b3fe0 0x7fd6cc0b4420 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.622+0000 7fd6d3c00640 1 --2- 172.21.15.173:0/1835201849 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6cc145290 0x7fd6cc15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.622+0000 7fd6d3c00640 1 -- 172.21.15.173:0/1835201849 >> 172.21.15.173:0/1835201849 conn(0x7fd6cc06ac90 msgr2=0x7fd6cc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.622+0000 7fd6d3c00640 1 -- 172.21.15.173:0/1835201849 shutdown_connections 2024-04-25T09:11:23.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.622+0000 7fd6d3c00640 1 -- 172.21.15.173:0/1835201849 wait complete. 2024-04-25T09:11:23.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.622+0000 7fd6d3c00640 1 Processor -- start 2024-04-25T09:11:23.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6d3c00640 1 -- start start 2024-04-25T09:11:23.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6d3c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6cc0b3fe0 0x7fd6cc144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6d3c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6cc0cc260 0x7fd6cc15afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6d3c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6cc145290 0x7fd6cc15dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6d3c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc06eee0 con 0x7fd6cc0cc260 2024-04-25T09:11:23.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6d3c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc06ed60 con 0x7fd6cc0b3fe0 2024-04-25T09:11:23.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6d3c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc06f060 con 0x7fd6cc145290 2024-04-25T09:11:23.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6cbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6cc0cc260 0x7fd6cc15afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6cbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6cc0cc260 0x7fd6cc15afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36616/0 (socket says 172.21.15.173:36616) 2024-04-25T09:11:23.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6cbe00640 1 -- 172.21.15.173:0/2399444607 learned_addr learned my addr 172.21.15.173:0/2399444607 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:23.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6d1c00640 1 --2- 172.21.15.173:0/2399444607 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6cc145290 0x7fd6cc15dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6d1200640 1 --2- 172.21.15.173:0/2399444607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6cc0b3fe0 0x7fd6cc144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6cbe00640 1 -- 172.21.15.173:0/2399444607 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6cc145290 msgr2=0x7fd6cc15dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6cbe00640 1 --2- 172.21.15.173:0/2399444607 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6cc145290 0x7fd6cc15dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6cbe00640 1 -- 172.21.15.173:0/2399444607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6cc0b3fe0 msgr2=0x7fd6cc144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6cbe00640 1 --2- 172.21.15.173:0/2399444607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6cc0b3fe0 0x7fd6cc144550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6cbe00640 1 -- 172.21.15.173:0/2399444607 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc0ad410 con 0x7fd6cc0cc260 2024-04-25T09:11:23.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6cbe00640 1 --2- 172.21.15.173:0/2399444607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6cc0cc260 0x7fd6cc15afd0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fd6b80ae040 tx=0x7fd6b80191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6c8c00640 1 -- 172.21.15.173:0/2399444607 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b80b0040 con 0x7fd6cc0cc260 2024-04-25T09:11:23.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6c8c00640 1 -- 172.21.15.173:0/2399444607 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b80043e0 con 0x7fd6cc0cc260 2024-04-25T09:11:23.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6d3c00640 1 -- 172.21.15.173:0/2399444607 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6cc0ad6f0 con 0x7fd6cc0cc260 2024-04-25T09:11:23.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6c8c00640 1 -- 172.21.15.173:0/2399444607 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8003e60 con 0x7fd6cc0cc260 2024-04-25T09:11:23.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6d3c00640 1 -- 172.21.15.173:0/2399444607 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6cc0adcb0 con 0x7fd6cc0cc260 2024-04-25T09:11:23.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.626+0000 7fd6d3c00640 1 -- 172.21.15.173:0/2399444607 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6cc073ab0 con 0x7fd6cc0cc260 2024-04-25T09:11:23.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.630+0000 7fd6c8c00640 1 -- 172.21.15.173:0/2399444607 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd6b80bd060 con 0x7fd6cc0cc260 2024-04-25T09:11:23.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.630+0000 7fd6c8c00640 1 --2- 172.21.15.173:0/2399444607 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd6ac066f90 0x7fd6ac069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.630+0000 7fd6c8c00640 1 -- 172.21.15.173:0/2399444607 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fd6b811e4d0 con 0x7fd6cc0cc260 2024-04-25T09:11:23.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.630+0000 7fd6d1200640 1 --2- 172.21.15.173:0/2399444607 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd6ac066f90 0x7fd6ac069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.630+0000 7fd6d1200640 1 --2- 172.21.15.173:0/2399444607 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd6ac066f90 0x7fd6ac069450 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0007a60 tx=0x7fd6c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.634+0000 7fd6c8c00640 1 -- 172.21.15.173:0/2399444607 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd6b8016150 con 0x7fd6cc0cc260 2024-04-25T09:11:23.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.794+0000 7fd6d3c00640 1 -- 172.21.15.173:0/2399444607 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6cc142270 con 0x7fd6cc0cc260 2024-04-25T09:11:23.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.794+0000 7fd6c8c00640 1 -- 172.21.15.173:0/2399444607 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v118) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6b80eefb0 con 0x7fd6cc0cc260 2024-04-25T09:11:23.778 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:11:23.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.794+0000 7fd6d3c00640 1 -- 172.21.15.173:0/2399444607 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd6ac066f90 msgr2=0x7fd6ac069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.794+0000 7fd6d3c00640 1 --2- 172.21.15.173:0/2399444607 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd6ac066f90 0x7fd6ac069450 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0007a60 tx=0x7fd6c0008040 comp rx=0 tx=0).stop 2024-04-25T09:11:23.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.794+0000 7fd6d3c00640 1 -- 172.21.15.173:0/2399444607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6cc0cc260 msgr2=0x7fd6cc15afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.794+0000 7fd6d3c00640 1 --2- 172.21.15.173:0/2399444607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6cc0cc260 0x7fd6cc15afd0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fd6b80ae040 tx=0x7fd6b80191e0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.794+0000 7fd6d3c00640 1 -- 172.21.15.173:0/2399444607 shutdown_connections 2024-04-25T09:11:23.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.794+0000 7fd6d3c00640 1 --2- 172.21.15.173:0/2399444607 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd6ac066f90 0x7fd6ac069450 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.794+0000 7fd6d3c00640 1 --2- 172.21.15.173:0/2399444607 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6cc145290 0x7fd6cc15dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.794+0000 7fd6d3c00640 1 --2- 172.21.15.173:0/2399444607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6cc0cc260 0x7fd6cc15afd0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.794+0000 7fd6d3c00640 1 --2- 172.21.15.173:0/2399444607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6cc0b3fe0 0x7fd6cc144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.794+0000 7fd6d3c00640 1 -- 172.21.15.173:0/2399444607 >> 172.21.15.173:0/2399444607 conn(0x7fd6cc06ac90 msgr2=0x7fd6cc1413d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.794+0000 7fd6d3c00640 1 -- 172.21.15.173:0/2399444607 shutdown_connections 2024-04-25T09:11:23.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.794+0000 7fd6d3c00640 1 -- 172.21.15.173:0/2399444607 wait complete. 2024-04-25T09:11:23.800 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:11:23.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4ba600640 1 Processor -- start 2024-04-25T09:11:23.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4ba600640 1 -- start start 2024-04-25T09:11:23.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4ba600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4b415ba20 0x7fc4b415be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4ba600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc4b40b70f0 0x7fc4b406f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4ba600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b415c460 con 0x7fc4b40b7550 2024-04-25T09:11:23.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4ba600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b415c740 con 0x7fc4b40b70f0 2024-04-25T09:11:23.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4ba600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b415ca20 con 0x7fc4b415ba20 2024-04-25T09:11:23.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b3e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc4b40b7550 0x7fc4b40d1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46398/0 (socket says 172.21.15.173:46398) 2024-04-25T09:11:23.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b3e00640 1 -- 172.21.15.173:0/3155175166 learned_addr learned my addr 172.21.15.173:0/3155175166 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:23.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b3400640 1 --2- 172.21.15.173:0/3155175166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4b415ba20 0x7fc4b415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4aaa00640 1 --2- 172.21.15.173:0/3155175166 >> v2:172.21.15.194:3300/0 conn(0x7fc4b40b70f0 0x7fc4b406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b2a00640 1 -- 172.21.15.173:0/3155175166 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012562106 0 0) 0x7fc4b415c460 con 0x7fc4b40b7550 2024-04-25T09:11:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b2a00640 1 -- 172.21.15.173:0/3155175166 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc498003530 con 0x7fc4b40b7550 2024-04-25T09:11:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b2a00640 1 -- 172.21.15.173:0/3155175166 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1717058324 0 0) 0x7fc498003530 con 0x7fc4b40b7550 2024-04-25T09:11:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b2a00640 1 -- 172.21.15.173:0/3155175166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4b415ba20 msgr2=0x7fc4b415be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b2a00640 1 --2- 172.21.15.173:0/3155175166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4b415ba20 0x7fc4b415be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b2a00640 1 -- 172.21.15.173:0/3155175166 >> v2:172.21.15.194:3300/0 conn(0x7fc4b40b70f0 msgr2=0x7fc4b406f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b2a00640 1 --2- 172.21.15.173:0/3155175166 >> v2:172.21.15.194:3300/0 conn(0x7fc4b40b70f0 0x7fc4b406f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b2a00640 1 -- 172.21.15.173:0/3155175166 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b415cd00 con 0x7fc4b40b7550 2024-04-25T09:11:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b2a00640 1 -- 172.21.15.173:0/3155175166 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fc4ac001680 con 0x7fc4b40b7550 2024-04-25T09:11:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b2a00640 1 -- 172.21.15.173:0/3155175166 >> v1:172.21.15.173:6789/0 conn(0x7fc4b40b7550 legacy=0x7fc4b40d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b2a00640 1 --2- 172.21.15.173:0/3155175166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4980039c0 0x7fc498003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b2a00640 1 --2- 172.21.15.173:0/3155175166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc498004810 0x7fc498004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b2a00640 1 --2- 172.21.15.173:0/3155175166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4b415ba20 0x7fc4980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b2a00640 1 -- 172.21.15.173:0/3155175166 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b415c740 con 0x7fc498004810 2024-04-25T09:11:23.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b2a00640 1 -- 172.21.15.173:0/3155175166 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b415ca20 con 0x7fc4980039c0 2024-04-25T09:11:23.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.950+0000 7fc4b2a00640 1 -- 172.21.15.173:0/3155175166 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49800b9d0 con 0x7fc4b415ba20 2024-04-25T09:11:23.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.954+0000 7fc4b3400640 1 --2- 172.21.15.173:0/3155175166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4980039c0 0x7fc498003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.954+0000 7fc4aaa00640 1 --2- 172.21.15.173:0/3155175166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc498004810 0x7fc498004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.954+0000 7fc4b3e00640 1 --2- 172.21.15.173:0/3155175166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4b415ba20 0x7fc4980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.954+0000 7fc4aaa00640 1 -- 172.21.15.173:0/3155175166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4b415ba20 msgr2=0x7fc4980051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.954+0000 7fc4aaa00640 1 --2- 172.21.15.173:0/3155175166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4b415ba20 0x7fc4980051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.954+0000 7fc4aaa00640 1 -- 172.21.15.173:0/3155175166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4980039c0 msgr2=0x7fc498003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.954+0000 7fc4aaa00640 1 --2- 172.21.15.173:0/3155175166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4980039c0 0x7fc498003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.954+0000 7fc4aaa00640 1 -- 172.21.15.173:0/3155175166 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc498003530 con 0x7fc498004810 2024-04-25T09:11:23.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.954+0000 7fc4b3e00640 1 --2- 172.21.15.173:0/3155175166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4b415ba20 0x7fc4980051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:23.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.954+0000 7fc4aaa00640 1 --2- 172.21.15.173:0/3155175166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc498004810 0x7fc498004c90 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fc49c009ae0 tx=0x7fc49c01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6118fab75985c9bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.954+0000 7fc4b2a00640 1 -- 172.21.15.173:0/3155175166 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c0b2070 con 0x7fc498004810 2024-04-25T09:11:23.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.954+0000 7fc4b2a00640 1 -- 172.21.15.173:0/3155175166 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c0a55c0 con 0x7fc498004810 2024-04-25T09:11:23.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.954+0000 7fc4b2a00640 1 -- 172.21.15.173:0/3155175166 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c0096b0 con 0x7fc498004810 2024-04-25T09:11:23.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4ba600640 1 -- 172.21.15.173:0/3155175166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc498004810 msgr2=0x7fc498004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4ba600640 1 --2- 172.21.15.173:0/3155175166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc498004810 0x7fc498004c90 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fc49c009ae0 tx=0x7fc49c01cab0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4b3e00640 1 -- 172.21.15.173:0/3155175166 reap_dead start 2024-04-25T09:11:23.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4ba600640 1 -- 172.21.15.173:0/3155175166 shutdown_connections 2024-04-25T09:11:23.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4ba600640 1 -- 172.21.15.173:0/3155175166 >> 172.21.15.173:0/3155175166 conn(0x7fc4b4061880 msgr2=0x7fc4b4061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4ba600640 1 -- 172.21.15.173:0/3155175166 shutdown_connections 2024-04-25T09:11:23.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4ba600640 1 -- 172.21.15.173:0/3155175166 wait complete. 2024-04-25T09:11:23.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4ba600640 1 Processor -- start 2024-04-25T09:11:23.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4ba600640 1 -- start start 2024-04-25T09:11:23.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4ba600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc498004810 0x7fc4b414fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4ba600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4b40b5510 0x7fc4b40b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4ba600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4b40af690 0x7fc4b40afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4ba600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b415bf80 con 0x7fc4b40b5510 2024-04-25T09:11:23.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4ba600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b415be00 con 0x7fc498004810 2024-04-25T09:11:23.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4ba600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b415c100 con 0x7fc4b40af690 2024-04-25T09:11:23.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4aaa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4b40b5510 0x7fc4b40b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4aaa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4b40b5510 0x7fc4b40b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36630/0 (socket says 172.21.15.173:36630) 2024-04-25T09:11:23.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4aaa00640 1 -- 172.21.15.173:0/1187811034 learned_addr learned my addr 172.21.15.173:0/1187811034 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:23.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4b3e00640 1 --2- 172.21.15.173:0/1187811034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4b40af690 0x7fc4b40afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4aaa00640 1 -- 172.21.15.173:0/1187811034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4b40af690 msgr2=0x7fc4b40afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4b3400640 1 --2- 172.21.15.173:0/1187811034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc498004810 0x7fc4b414fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4aaa00640 1 --2- 172.21.15.173:0/1187811034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4b40af690 0x7fc4b40afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4aaa00640 1 -- 172.21.15.173:0/1187811034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc498004810 msgr2=0x7fc4b414fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4aaa00640 1 --2- 172.21.15.173:0/1187811034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc498004810 0x7fc4b414fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4aaa00640 1 -- 172.21.15.173:0/1187811034 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b40acd30 con 0x7fc4b40b5510 2024-04-25T09:11:23.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4b3400640 1 --2- 172.21.15.173:0/1187811034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc498004810 0x7fc4b414fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:23.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4b3e00640 1 --2- 172.21.15.173:0/1187811034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4b40af690 0x7fc4b40afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:23.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4aaa00640 1 --2- 172.21.15.173:0/1187811034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4b40b5510 0x7fc4b40b5990 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fc49c009ae0 tx=0x7fc498005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4abe00640 1 -- 172.21.15.173:0/1187811034 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c0b2040 con 0x7fc4b40b5510 2024-04-25T09:11:23.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.958+0000 7fc4abe00640 1 -- 172.21.15.173:0/1187811034 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c00f000 con 0x7fc4b40b5510 2024-04-25T09:11:23.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.962+0000 7fc4abe00640 1 -- 172.21.15.173:0/1187811034 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c004220 con 0x7fc4b40b5510 2024-04-25T09:11:23.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.962+0000 7fc4ba600640 1 -- 172.21.15.173:0/1187811034 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b40ad010 con 0x7fc4b40b5510 2024-04-25T09:11:23.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.962+0000 7fc4ba600640 1 -- 172.21.15.173:0/1187811034 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b40ad5d0 con 0x7fc4b40b5510 2024-04-25T09:11:23.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.962+0000 7fc4ba600640 1 -- 172.21.15.173:0/1187811034 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b4073a40 con 0x7fc4b40b5510 2024-04-25T09:11:23.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.962+0000 7fc4abe00640 1 -- 172.21.15.173:0/1187811034 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc49c0c0030 con 0x7fc4b40b5510 2024-04-25T09:11:23.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.962+0000 7fc4abe00640 1 --2- 172.21.15.173:0/1187811034 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc490066f60 0x7fc490069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.962+0000 7fc4abe00640 1 -- 172.21.15.173:0/1187811034 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fc49c11ed20 con 0x7fc4b40b5510 2024-04-25T09:11:23.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.962+0000 7fc4b3400640 1 --2- 172.21.15.173:0/1187811034 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc490066f60 0x7fc490069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.962+0000 7fc4b3400640 1 --2- 172.21.15.173:0/1187811034 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc490066f60 0x7fc490069420 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4012290 tx=0x7fc4a400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:23.966+0000 7fc4abe00640 1 -- 172.21.15.173:0/1187811034 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc49c0c7060 con 0x7fc4b40b5510 2024-04-25T09:11:24.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.122+0000 7fc4ba600640 1 -- 172.21.15.173:0/1187811034 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc4b40cefc0 con 0x7fc4b40b5510 2024-04-25T09:11:24.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.122+0000 7fc4abe00640 1 -- 172.21.15.173:0/1187811034 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v118) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc49c0167c0 con 0x7fc4b40b5510 2024-04-25T09:11:24.109 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:24.109 INFO:teuthology.orchestra.run.smithi173.stdout:[ 2024-04-25T09:11:24.109 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:11:24.109 INFO:teuthology.orchestra.run.smithi173.stdout: "poolnum": 1, 2024-04-25T09:11:24.109 INFO:teuthology.orchestra.run.smithi173.stdout: "poolname": ".mgr" 2024-04-25T09:11:24.110 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:24.110 INFO:teuthology.orchestra.run.smithi173.stdout:] 2024-04-25T09:11:24.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.126+0000 7fc4ba600640 1 -- 172.21.15.173:0/1187811034 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc490066f60 msgr2=0x7fc490069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.126+0000 7fc4ba600640 1 --2- 172.21.15.173:0/1187811034 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc490066f60 0x7fc490069420 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4012290 tx=0x7fc4a400b040 comp rx=0 tx=0).stop 2024-04-25T09:11:24.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.126+0000 7fc4ba600640 1 -- 172.21.15.173:0/1187811034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4b40b5510 msgr2=0x7fc4b40b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.126+0000 7fc4ba600640 1 --2- 172.21.15.173:0/1187811034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4b40b5510 0x7fc4b40b5990 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fc49c009ae0 tx=0x7fc498005840 comp rx=0 tx=0).stop 2024-04-25T09:11:24.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.126+0000 7fc4ba600640 1 -- 172.21.15.173:0/1187811034 shutdown_connections 2024-04-25T09:11:24.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.126+0000 7fc4ba600640 1 --2- 172.21.15.173:0/1187811034 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc490066f60 0x7fc490069420 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.126+0000 7fc4ba600640 1 --2- 172.21.15.173:0/1187811034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4b40af690 0x7fc4b40afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.126+0000 7fc4ba600640 1 --2- 172.21.15.173:0/1187811034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4b40b5510 0x7fc4b40b5990 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.126+0000 7fc4ba600640 1 --2- 172.21.15.173:0/1187811034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc498004810 0x7fc4b414fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.126+0000 7fc4ba600640 1 -- 172.21.15.173:0/1187811034 >> 172.21.15.173:0/1187811034 conn(0x7fc4b4061880 msgr2=0x7fc4b40cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:24.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.126+0000 7fc4ba600640 1 -- 172.21.15.173:0/1187811034 shutdown_connections 2024-04-25T09:11:24.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.126+0000 7fc4ba600640 1 -- 172.21.15.173:0/1187811034 wait complete. 2024-04-25T09:11:24.131 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:11:24.131 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:11:24.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.286+0000 7fb1c0a00640 1 Processor -- start 2024-04-25T09:11:24.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.286+0000 7fb1c0a00640 1 -- start start 2024-04-25T09:11:24.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.286+0000 7fb1c0a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1bc15a740 0x7fb1bc0ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.286+0000 7fb1c0a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb1bc15e310 0x7fb1bc072710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.286+0000 7fb1c0a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1bc15e7a0 con 0x7fb1bc072c50 2024-04-25T09:11:24.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.286+0000 7fb1c0a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1bc15ea80 con 0x7fb1bc15e310 2024-04-25T09:11:24.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.286+0000 7fb1c0a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc15ed60 con 0x7fb1bc15a740 2024-04-25T09:11:24.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.286+0000 7fb1baa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb1bc15e310 0x7fb1bc072710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.286+0000 7fb1bbe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fb1bc072c50 0x7fb1bc06bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46404/0 (socket says 172.21.15.173:46404) 2024-04-25T09:11:24.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.286+0000 7fb1bbe00640 1 -- 172.21.15.173:0/3174500405 learned_addr learned my addr 172.21.15.173:0/3174500405 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:24.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.286+0000 7fb1bb400640 1 --2- 172.21.15.173:0/3174500405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1bc15a740 0x7fb1bc0ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.286+0000 7fb1baa00640 1 -- 172.21.15.173:0/3174500405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1bc15a740 msgr2=0x7fb1bc0ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:24.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.286+0000 7fb1baa00640 1 --2- 172.21.15.173:0/3174500405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1bc15a740 0x7fb1bc0ae0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.286+0000 7fb1baa00640 1 -- 172.21.15.173:0/3174500405 >> v1:172.21.15.173:6789/0 conn(0x7fb1bc072c50 legacy=0x7fb1bc06bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.286+0000 7fb1baa00640 1 -- 172.21.15.173:0/3174500405 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc15f040 con 0x7fb1bc15e310 2024-04-25T09:11:24.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.286+0000 7fb1bb400640 1 --2- 172.21.15.173:0/3174500405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1bc15a740 0x7fb1bc0ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:24.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.290+0000 7fb1baa00640 1 --2- 172.21.15.173:0/3174500405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1bc15e310 0x7fb1bc072710 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80097c0 tx=0x7fb1a801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb448346d0fe66de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:24.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.290+0000 7fb1ba000640 1 -- 172.21.15.173:0/3174500405 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a80b1070 con 0x7fb1bc15e310 2024-04-25T09:11:24.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.290+0000 7fb1ba000640 1 -- 172.21.15.173:0/3174500405 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a80ac410 con 0x7fb1bc15e310 2024-04-25T09:11:24.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.290+0000 7fb1ba000640 1 -- 172.21.15.173:0/3174500405 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a80ac7e0 con 0x7fb1bc15e310 2024-04-25T09:11:24.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.290+0000 7fb1c0a00640 1 -- 172.21.15.173:0/3174500405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1bc15e310 msgr2=0x7fb1bc072710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.290+0000 7fb1c0a00640 1 --2- 172.21.15.173:0/3174500405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1bc15e310 0x7fb1bc072710 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80097c0 tx=0x7fb1a801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.290+0000 7fb1c0a00640 1 -- 172.21.15.173:0/3174500405 shutdown_connections 2024-04-25T09:11:24.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.290+0000 7fb1c0a00640 1 --2- 172.21.15.173:0/3174500405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1bc15e310 0x7fb1bc072710 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.290+0000 7fb1c0a00640 1 --2- 172.21.15.173:0/3174500405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1bc15a740 0x7fb1bc0ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.290+0000 7fb1c0a00640 1 -- 172.21.15.173:0/3174500405 >> 172.21.15.173:0/3174500405 conn(0x7fb1bc071b80 msgr2=0x7fb1bc071f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:24.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.290+0000 7fb1c0a00640 1 -- 172.21.15.173:0/3174500405 shutdown_connections 2024-04-25T09:11:24.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.290+0000 7fb1c0a00640 1 -- 172.21.15.173:0/3174500405 wait complete. 2024-04-25T09:11:24.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.290+0000 7fb1c0a00640 1 Processor -- start 2024-04-25T09:11:24.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.290+0000 7fb1c0a00640 1 -- start start 2024-04-25T09:11:24.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1c0a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1bc072c50 0x7fb1bc0afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1c0a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1bc15a740 0x7fb1bc14c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1c0a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1bc164f10 0x7fb1bc14a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1c0a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc0b3e10 con 0x7fb1bc072c50 2024-04-25T09:11:24.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1c0a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc0b3c90 con 0x7fb1bc15a740 2024-04-25T09:11:24.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1c0a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc0b3f90 con 0x7fb1bc164f10 2024-04-25T09:11:24.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1bb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1bc072c50 0x7fb1bc0afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1bb400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1bc072c50 0x7fb1bc0afb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36644/0 (socket says 172.21.15.173:36644) 2024-04-25T09:11:24.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1bb400640 1 -- 172.21.15.173:0/608695426 learned_addr learned my addr 172.21.15.173:0/608695426 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:24.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1bb400640 1 -- 172.21.15.173:0/608695426 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1bc164f10 msgr2=0x7fb1bc14a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1bb400640 1 --2- 172.21.15.173:0/608695426 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1bc164f10 0x7fb1bc14a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1bb400640 1 -- 172.21.15.173:0/608695426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1bc15a740 msgr2=0x7fb1bc14c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1bb400640 1 --2- 172.21.15.173:0/608695426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1bc15a740 0x7fb1bc14c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1bb400640 1 -- 172.21.15.173:0/608695426 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc14f120 con 0x7fb1bc072c50 2024-04-25T09:11:24.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1bb400640 1 --2- 172.21.15.173:0/608695426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1bc072c50 0x7fb1bc0afb20 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00cf60 tx=0x7fb1ac00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:24.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1b3400640 1 -- 172.21.15.173:0/608695426 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac01a070 con 0x7fb1bc072c50 2024-04-25T09:11:24.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1b3400640 1 -- 172.21.15.173:0/608695426 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac00d840 con 0x7fb1bc072c50 2024-04-25T09:11:24.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1c0a00640 1 -- 172.21.15.173:0/608695426 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1bc0b0350 con 0x7fb1bc072c50 2024-04-25T09:11:24.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1b3400640 1 -- 172.21.15.173:0/608695426 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac00dc10 con 0x7fb1bc072c50 2024-04-25T09:11:24.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1c0a00640 1 -- 172.21.15.173:0/608695426 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1bc14ec00 con 0x7fb1bc072c50 2024-04-25T09:11:24.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.294+0000 7fb1c0a00640 1 -- 172.21.15.173:0/608695426 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1bc14e750 con 0x7fb1bc072c50 2024-04-25T09:11:24.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.298+0000 7fb1b3400640 1 -- 172.21.15.173:0/608695426 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb1ac01d070 con 0x7fb1bc072c50 2024-04-25T09:11:24.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.298+0000 7fb1b3400640 1 --2- 172.21.15.173:0/608695426 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb19c066f60 0x7fb19c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.298+0000 7fb1b3400640 1 -- 172.21.15.173:0/608695426 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fb1ac085700 con 0x7fb1bc072c50 2024-04-25T09:11:24.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.298+0000 7fb1baa00640 1 --2- 172.21.15.173:0/608695426 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb19c066f60 0x7fb19c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.298+0000 7fb1baa00640 1 --2- 172.21.15.173:0/608695426 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb19c066f60 0x7fb19c069420 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80ae000 tx=0x7fb1a8004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:24.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.302+0000 7fb1b3400640 1 -- 172.21.15.173:0/608695426 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb1ac0561e0 con 0x7fb1bc072c50 2024-04-25T09:11:24.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.454+0000 7fb1c0a00640 1 -- 172.21.15.173:0/608695426 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb1bc073a40 con 0x7fb1bc072c50 2024-04-25T09:11:24.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.750+0000 7fb1b3400640 1 -- 172.21.15.173:0/608695426 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v119) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb1ac085030 con 0x7fb1bc072c50 2024-04-25T09:11:24.735 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' created 2024-04-25T09:11:24.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.754+0000 7fb1c0a00640 1 -- 172.21.15.173:0/608695426 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb19c066f60 msgr2=0x7fb19c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.754+0000 7fb1c0a00640 1 --2- 172.21.15.173:0/608695426 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb19c066f60 0x7fb19c069420 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80ae000 tx=0x7fb1a8004740 comp rx=0 tx=0).stop 2024-04-25T09:11:24.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.754+0000 7fb1c0a00640 1 -- 172.21.15.173:0/608695426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1bc072c50 msgr2=0x7fb1bc0afb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.754+0000 7fb1c0a00640 1 --2- 172.21.15.173:0/608695426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1bc072c50 0x7fb1bc0afb20 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00cf60 tx=0x7fb1ac00cf90 comp rx=0 tx=0).stop 2024-04-25T09:11:24.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.754+0000 7fb1c0a00640 1 -- 172.21.15.173:0/608695426 shutdown_connections 2024-04-25T09:11:24.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.754+0000 7fb1c0a00640 1 --2- 172.21.15.173:0/608695426 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb19c066f60 0x7fb19c069420 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.754+0000 7fb1c0a00640 1 --2- 172.21.15.173:0/608695426 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1bc164f10 0x7fb1bc14a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.754+0000 7fb1c0a00640 1 --2- 172.21.15.173:0/608695426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1bc15a740 0x7fb1bc14c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.754+0000 7fb1c0a00640 1 --2- 172.21.15.173:0/608695426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1bc072c50 0x7fb1bc0afb20 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.754+0000 7fb1c0a00640 1 -- 172.21.15.173:0/608695426 >> 172.21.15.173:0/608695426 conn(0x7fb1bc071b80 msgr2=0x7fb1bc0b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:24.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.754+0000 7fb1c0a00640 1 -- 172.21.15.173:0/608695426 shutdown_connections 2024-04-25T09:11:24.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.754+0000 7fb1c0a00640 1 -- 172.21.15.173:0/608695426 wait complete. 2024-04-25T09:11:24.762 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:11:24.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.922+0000 7f40fec00640 1 Processor -- start 2024-04-25T09:11:24.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.922+0000 7f40fec00640 1 -- start start 2024-04-25T09:11:24.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.922+0000 7f40fec00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f40f815bab0 0x7f40f80d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.922+0000 7f40fec00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f80cc7a0 con 0x7f40f809a160 2024-04-25T09:11:24.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.922+0000 7f40fec00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f80cca80 con 0x7f40f80cd840 2024-04-25T09:11:24.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.922+0000 7f40fec00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f80d07e0 con 0x7f40f815bab0 2024-04-25T09:11:24.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.922+0000 7f40f7e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f40f815bab0 0x7f40f80d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.922+0000 7f40fcc00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f40f809a160 0x7f40f80c5300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46416/0 (socket says 172.21.15.173:46416) 2024-04-25T09:11:24.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.922+0000 7f40fcc00640 1 -- 172.21.15.173:0/955254898 learned_addr learned my addr 172.21.15.173:0/955254898 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:24.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.922+0000 7f40f7e00640 1 -- 172.21.15.173:0/955254898 >> v1:172.21.15.194:6789/0 conn(0x7f40f80cd840 legacy=0x7f40f8099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:24.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.922+0000 7f40f7e00640 1 -- 172.21.15.173:0/955254898 >> v1:172.21.15.173:6789/0 conn(0x7f40f809a160 legacy=0x7f40f80c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.922+0000 7f40f7e00640 1 -- 172.21.15.173:0/955254898 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f80ccd60 con 0x7f40f815bab0 2024-04-25T09:11:24.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.926+0000 7f40f7e00640 1 --2- 172.21.15.173:0/955254898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f815bab0 0x7f40f80d02a0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f40e80097c0 tx=0x7f40e801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b239604ae0defaaf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:24.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.926+0000 7f40f6a00640 1 -- 172.21.15.173:0/955254898 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e80ab650 con 0x7f40f815bab0 2024-04-25T09:11:24.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.926+0000 7f40f6a00640 1 -- 172.21.15.173:0/955254898 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e80b0070 con 0x7f40f815bab0 2024-04-25T09:11:24.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.926+0000 7f40f6a00640 1 -- 172.21.15.173:0/955254898 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e80aba10 con 0x7f40f815bab0 2024-04-25T09:11:24.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.926+0000 7f40fec00640 1 -- 172.21.15.173:0/955254898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f815bab0 msgr2=0x7f40f80d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.926+0000 7f40fec00640 1 --2- 172.21.15.173:0/955254898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f815bab0 0x7f40f80d02a0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f40e80097c0 tx=0x7f40e801c430 comp rx=0 tx=0).stop 2024-04-25T09:11:24.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.926+0000 7f40fec00640 1 -- 172.21.15.173:0/955254898 shutdown_connections 2024-04-25T09:11:24.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.926+0000 7f40fec00640 1 --2- 172.21.15.173:0/955254898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f815bab0 0x7f40f80d02a0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.926+0000 7f40fec00640 1 -- 172.21.15.173:0/955254898 >> 172.21.15.173:0/955254898 conn(0x7f40f80b32a0 msgr2=0x7f40f80b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:24.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.926+0000 7f40fec00640 1 -- 172.21.15.173:0/955254898 shutdown_connections 2024-04-25T09:11:24.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.926+0000 7f40fec00640 1 -- 172.21.15.173:0/955254898 wait complete. 2024-04-25T09:11:24.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.926+0000 7f40fec00640 1 Processor -- start 2024-04-25T09:11:24.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fec00640 1 -- start start 2024-04-25T09:11:24.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40f809a160 0x7f40f8165360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40f80cd840 0x7f40f80b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fec00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f815bab0 0x7f40f80b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fec00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f815c010 con 0x7f40f815bab0 2024-04-25T09:11:24.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f815be90 con 0x7f40f809a160 2024-04-25T09:11:24.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f80cc3c0 con 0x7f40f80cd840 2024-04-25T09:11:24.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fcc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f815bab0 0x7f40f80b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fcc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f815bab0 0x7f40f80b6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36652/0 (socket says 172.21.15.173:36652) 2024-04-25T09:11:24.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fcc00640 1 -- 172.21.15.173:0/1010311516 learned_addr learned my addr 172.21.15.173:0/1010311516 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:24.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40f7e00640 1 --2- 172.21.15.173:0/1010311516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40f809a160 0x7f40f8165360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40f7400640 1 --2- 172.21.15.173:0/1010311516 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40f80cd840 0x7f40f80b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fcc00640 1 -- 172.21.15.173:0/1010311516 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40f80cd840 msgr2=0x7f40f80b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fcc00640 1 --2- 172.21.15.173:0/1010311516 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40f80cd840 0x7f40f80b66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fcc00640 1 -- 172.21.15.173:0/1010311516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40f809a160 msgr2=0x7f40f8165360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fcc00640 1 --2- 172.21.15.173:0/1010311516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40f809a160 0x7f40f8165360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fcc00640 1 -- 172.21.15.173:0/1010311516 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f81658a0 con 0x7f40f815bab0 2024-04-25T09:11:24.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40f7400640 1 --2- 172.21.15.173:0/1010311516 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40f80cd840 0x7f40f80b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:24.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fcc00640 1 --2- 172.21.15.173:0/1010311516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f815bab0 0x7f40f80b6be0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f40f000caf0 tx=0x7f40f000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:24.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40efe00640 1 -- 172.21.15.173:0/1010311516 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f0017070 con 0x7f40f815bab0 2024-04-25T09:11:24.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40efe00640 1 -- 172.21.15.173:0/1010311516 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f000aca0 con 0x7f40f815bab0 2024-04-25T09:11:24.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40efe00640 1 -- 172.21.15.173:0/1010311516 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f0012600 con 0x7f40f815bab0 2024-04-25T09:11:24.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fec00640 1 -- 172.21.15.173:0/1010311516 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f80b4470 con 0x7f40f815bab0 2024-04-25T09:11:24.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fec00640 1 -- 172.21.15.173:0/1010311516 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f80b4710 con 0x7f40f815bab0 2024-04-25T09:11:24.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.930+0000 7f40fec00640 1 -- 172.21.15.173:0/1010311516 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f8073ab0 con 0x7f40f815bab0 2024-04-25T09:11:24.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.934+0000 7f40efe00640 1 -- 172.21.15.173:0/1010311516 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f40f001a070 con 0x7f40f815bab0 2024-04-25T09:11:24.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.934+0000 7f40efe00640 1 --2- 172.21.15.173:0/1010311516 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40d8066f90 0x7f40d8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.934+0000 7f40efe00640 1 -- 172.21.15.173:0/1010311516 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f40f0084cd0 con 0x7f40f815bab0 2024-04-25T09:11:24.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.934+0000 7f40f7e00640 1 --2- 172.21.15.173:0/1010311516 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40d8066f90 0x7f40d8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.934+0000 7f40f7e00640 1 --2- 172.21.15.173:0/1010311516 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40d8066f90 0x7f40d8069450 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f40e80af000 tx=0x7f40e80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:24.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:24.938+0000 7f40efe00640 1 -- 172.21.15.173:0/1010311516 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f40f81658a0 con 0x7f40f815bab0 2024-04-25T09:11:25.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.094+0000 7f40fec00640 1 -- 172.21.15.173:0/1010311516 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f40f8153880 con 0x7f40f815bab0 2024-04-25T09:11:25.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.758+0000 7f40efe00640 1 -- 172.21.15.173:0/1010311516 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v120) v1 ==== 170+0+0 (secure 0 0 0) 0x7f40f0055640 con 0x7f40f815bab0 2024-04-25T09:11:25.744 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' created 2024-04-25T09:11:25.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.762+0000 7f40fec00640 1 -- 172.21.15.173:0/1010311516 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40d8066f90 msgr2=0x7f40d8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.762+0000 7f40fec00640 1 --2- 172.21.15.173:0/1010311516 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40d8066f90 0x7f40d8069450 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f40e80af000 tx=0x7f40e80a7000 comp rx=0 tx=0).stop 2024-04-25T09:11:25.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.762+0000 7f40fec00640 1 -- 172.21.15.173:0/1010311516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f815bab0 msgr2=0x7f40f80b6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.762+0000 7f40fec00640 1 --2- 172.21.15.173:0/1010311516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f815bab0 0x7f40f80b6be0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f40f000caf0 tx=0x7f40f000a060 comp rx=0 tx=0).stop 2024-04-25T09:11:25.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.762+0000 7f40fec00640 1 -- 172.21.15.173:0/1010311516 shutdown_connections 2024-04-25T09:11:25.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.762+0000 7f40fec00640 1 --2- 172.21.15.173:0/1010311516 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f40d8066f90 0x7f40d8069450 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.762+0000 7f40fec00640 1 --2- 172.21.15.173:0/1010311516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40f815bab0 0x7f40f80b6be0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.762+0000 7f40fec00640 1 --2- 172.21.15.173:0/1010311516 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40f80cd840 0x7f40f80b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.762+0000 7f40fec00640 1 --2- 172.21.15.173:0/1010311516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40f809a160 0x7f40f8165360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.762+0000 7f40fec00640 1 -- 172.21.15.173:0/1010311516 >> 172.21.15.173:0/1010311516 conn(0x7f40f80b32a0 msgr2=0x7f40f8152cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:25.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.762+0000 7f40fec00640 1 -- 172.21.15.173:0/1010311516 shutdown_connections 2024-04-25T09:11:25.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.762+0000 7f40fec00640 1 -- 172.21.15.173:0/1010311516 wait complete. 2024-04-25T09:11:25.783 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:11:25.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.938+0000 7f4007400640 1 Processor -- start 2024-04-25T09:11:25.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.938+0000 7f4007400640 1 -- start start 2024-04-25T09:11:25.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.938+0000 7f4007400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4000145290 0x7f400015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.938+0000 7f4007400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f40000b3fe0 0x7f40000b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.938+0000 7f4007400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f400015c5f0 con 0x7f40000cc260 2024-04-25T09:11:25.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.938+0000 7f4007400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400006d4b0 con 0x7f40000b3fe0 2024-04-25T09:11:25.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.938+0000 7f4007400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400006d790 con 0x7f4000145290 2024-04-25T09:11:25.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.938+0000 7f3ff7e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f40000b3fe0 0x7f40000b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.938+0000 7f3ff7e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f40000b3fe0 0x7f40000b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:60102/0 (socket says 172.21.15.173:60102) 2024-04-25T09:11:25.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.938+0000 7f3ff7e00640 1 -- 172.21.15.173:0/4117218817 learned_addr learned my addr 172.21.15.173:0/4117218817 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:25.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.938+0000 7f4004a00640 1 --2- 172.21.15.173:0/4117218817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4000145290 0x7f400015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.938+0000 7f3ff7e00640 1 -- 172.21.15.173:0/4117218817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4000145290 msgr2=0x7f400015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:25.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.938+0000 7f3ff7e00640 1 --2- 172.21.15.173:0/4117218817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4000145290 0x7f400015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.938+0000 7f3ff7e00640 1 -- 172.21.15.173:0/4117218817 >> v1:172.21.15.194:6789/0 conn(0x7f40000cc260 legacy=0x7f40000cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.938+0000 7f3ff7e00640 1 -- 172.21.15.173:0/4117218817 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400006da70 con 0x7f40000b3fe0 2024-04-25T09:11:25.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.942+0000 7f3ff7e00640 1 --2- 172.21.15.173:0/4117218817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40000b3fe0 0x7f40000b4420 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009870 tx=0x7f3fe801c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d9ef5bbe7b4a991 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:25.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.942+0000 7f3fffe00640 1 -- 172.21.15.173:0/4117218817 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe80b0070 con 0x7f40000b3fe0 2024-04-25T09:11:25.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.942+0000 7f3fffe00640 1 -- 172.21.15.173:0/4117218817 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe8004230 con 0x7f40000b3fe0 2024-04-25T09:11:25.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.942+0000 7f3fffe00640 1 -- 172.21.15.173:0/4117218817 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8003620 con 0x7f40000b3fe0 2024-04-25T09:11:25.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.942+0000 7f4007400640 1 -- 172.21.15.173:0/4117218817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40000b3fe0 msgr2=0x7f40000b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.942+0000 7f4007400640 1 --2- 172.21.15.173:0/4117218817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40000b3fe0 0x7f40000b4420 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009870 tx=0x7f3fe801c440 comp rx=0 tx=0).stop 2024-04-25T09:11:25.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.942+0000 7f4007400640 1 -- 172.21.15.173:0/4117218817 shutdown_connections 2024-04-25T09:11:25.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.942+0000 7f4007400640 1 --2- 172.21.15.173:0/4117218817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40000b3fe0 0x7f40000b4420 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.942+0000 7f4007400640 1 --2- 172.21.15.173:0/4117218817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4000145290 0x7f400015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.942+0000 7f4007400640 1 -- 172.21.15.173:0/4117218817 >> 172.21.15.173:0/4117218817 conn(0x7f400006ac90 msgr2=0x7f400006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:25.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.942+0000 7f4007400640 1 -- 172.21.15.173:0/4117218817 shutdown_connections 2024-04-25T09:11:25.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.942+0000 7f4007400640 1 -- 172.21.15.173:0/4117218817 wait complete. 2024-04-25T09:11:25.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4007400640 1 Processor -- start 2024-04-25T09:11:25.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4007400640 1 -- start start 2024-04-25T09:11:25.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4007400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40000b3fe0 0x7f400015b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4007400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40000cc260 0x7f4000144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4007400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4000145290 0x7f4000142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4007400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400006eee0 con 0x7f4000145290 2024-04-25T09:11:25.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4007400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400006ed60 con 0x7f40000b3fe0 2024-04-25T09:11:25.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4007400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400006f060 con 0x7f40000cc260 2024-04-25T09:11:25.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4005400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4000145290 0x7f4000142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4005400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4000145290 0x7f4000142420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36662/0 (socket says 172.21.15.173:36662) 2024-04-25T09:11:25.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4005400640 1 -- 172.21.15.173:0/929127518 learned_addr learned my addr 172.21.15.173:0/929127518 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:25.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4004a00640 1 --2- 172.21.15.173:0/929127518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40000b3fe0 0x7f400015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f3ff7e00640 1 --2- 172.21.15.173:0/929127518 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40000cc260 0x7f4000144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4005400640 1 -- 172.21.15.173:0/929127518 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40000cc260 msgr2=0x7f4000144330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4005400640 1 --2- 172.21.15.173:0/929127518 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40000cc260 0x7f4000144330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4005400640 1 -- 172.21.15.173:0/929127518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40000b3fe0 msgr2=0x7f400015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4005400640 1 --2- 172.21.15.173:0/929127518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40000b3fe0 0x7f400015b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4005400640 1 -- 172.21.15.173:0/929127518 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400015bcd0 con 0x7f4000145290 2024-04-25T09:11:25.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4004a00640 1 --2- 172.21.15.173:0/929127518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40000b3fe0 0x7f400015b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:25.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4005400640 1 --2- 172.21.15.173:0/929127518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4000145290 0x7f4000142420 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800c760 tx=0x7f3ff800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:25.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f3ffd600640 1 -- 172.21.15.173:0/929127518 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8003b80 con 0x7f4000145290 2024-04-25T09:11:25.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f3ffd600640 1 -- 172.21.15.173:0/929127518 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff8003d20 con 0x7f4000145290 2024-04-25T09:11:25.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4007400640 1 -- 172.21.15.173:0/929127518 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40000acad0 con 0x7f4000145290 2024-04-25T09:11:25.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f3ffd600640 1 -- 172.21.15.173:0/929127518 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff800aa30 con 0x7f4000145290 2024-04-25T09:11:25.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4007400640 1 -- 172.21.15.173:0/929127518 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40000ad090 con 0x7f4000145290 2024-04-25T09:11:25.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.946+0000 7f4007400640 1 -- 172.21.15.173:0/929127518 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4000073ab0 con 0x7f4000145290 2024-04-25T09:11:25.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.950+0000 7f3ffd600640 1 -- 172.21.15.173:0/929127518 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3ff800abd0 con 0x7f4000145290 2024-04-25T09:11:25.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.950+0000 7f3ffd600640 1 --2- 172.21.15.173:0/929127518 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3fdc066f60 0x7f3fdc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.950+0000 7f3ffd600640 1 -- 172.21.15.173:0/929127518 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f3ff8084f30 con 0x7f4000145290 2024-04-25T09:11:25.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.950+0000 7f4004a00640 1 --2- 172.21.15.173:0/929127518 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3fdc066f60 0x7f3fdc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.950+0000 7f4004a00640 1 --2- 172.21.15.173:0/929127518 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3fdc066f60 0x7f3fdc069420 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0009f50 tx=0x7f3ff0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:25.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:25.954+0000 7f3ffd600640 1 -- 172.21.15.173:0/929127518 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f400015c5f0 con 0x7f4000145290 2024-04-25T09:11:26.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.146+0000 7f4007400640 1 -- 172.21.15.173:0/929127518 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f400013e9f0 con 0x7f4000145290 2024-04-25T09:11:26.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.762+0000 7f3ffd600640 1 -- 172.21.15.173:0/929127518 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v77) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3ff8055720 con 0x7f4000145290 2024-04-25T09:11:26.746 INFO:teuthology.orchestra.run.smithi173.stderr:new fs with metadata pool 17 and data pool 18 2024-04-25T09:11:26.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.766+0000 7f4007400640 1 -- 172.21.15.173:0/929127518 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3fdc066f60 msgr2=0x7f3fdc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.766+0000 7f4007400640 1 --2- 172.21.15.173:0/929127518 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3fdc066f60 0x7f3fdc069420 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0009f50 tx=0x7f3ff0009190 comp rx=0 tx=0).stop 2024-04-25T09:11:26.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.766+0000 7f4007400640 1 -- 172.21.15.173:0/929127518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4000145290 msgr2=0x7f4000142420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.766+0000 7f4007400640 1 --2- 172.21.15.173:0/929127518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4000145290 0x7f4000142420 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800c760 tx=0x7f3ff800cc20 comp rx=0 tx=0).stop 2024-04-25T09:11:26.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.766+0000 7f4007400640 1 -- 172.21.15.173:0/929127518 shutdown_connections 2024-04-25T09:11:26.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.766+0000 7f4007400640 1 --2- 172.21.15.173:0/929127518 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3fdc066f60 0x7f3fdc069420 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.766+0000 7f4007400640 1 --2- 172.21.15.173:0/929127518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4000145290 0x7f4000142420 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.766+0000 7f4007400640 1 --2- 172.21.15.173:0/929127518 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40000cc260 0x7f4000144330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.766+0000 7f4007400640 1 --2- 172.21.15.173:0/929127518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40000b3fe0 0x7f400015b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.766+0000 7f4007400640 1 -- 172.21.15.173:0/929127518 >> 172.21.15.173:0/929127518 conn(0x7f400006ac90 msgr2=0x7f4000141b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:26.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.766+0000 7f4007400640 1 -- 172.21.15.173:0/929127518 shutdown_connections 2024-04-25T09:11:26.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.766+0000 7f4007400640 1 -- 172.21.15.173:0/929127518 wait complete. 2024-04-25T09:11:26.791 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:26.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.942+0000 7f4fcda00640 1 Processor -- start 2024-04-25T09:11:26.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.942+0000 7f4fcda00640 1 -- start start 2024-04-25T09:11:26.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.942+0000 7f4fcda00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4fc815a180 0x7f4fc80b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.942+0000 7f4fcda00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4fc8071a30 0x7f4fc80ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.942+0000 7f4fcda00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc806e860 con 0x7f4fc80b2ca0 2024-04-25T09:11:26.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.942+0000 7f4fcda00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc80af230 con 0x7f4fc8071a30 2024-04-25T09:11:26.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.942+0000 7f4fcda00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc806eb20 con 0x7f4fc815a180 2024-04-25T09:11:26.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.946+0000 7f4fc7400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4fc8071a30 0x7f4fc80ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.946+0000 7f4fc6a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4fc815a180 0x7f4fc80b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.946+0000 7f4fc6000640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f4fc80b2ca0 0x7f4fc8071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:56152/0 (socket says 172.21.15.173:56152) 2024-04-25T09:11:26.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.946+0000 7f4fc6000640 1 -- 172.21.15.173:0/2820584714 learned_addr learned my addr 172.21.15.173:0/2820584714 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:26.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.946+0000 7f4fc5600640 1 -- 172.21.15.173:0/2820584714 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083406500 0 0) 0x7f4fc806e860 con 0x7f4fc80b2ca0 2024-04-25T09:11:26.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.946+0000 7f4fc5600640 1 -- 172.21.15.173:0/2820584714 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fac005740 con 0x7f4fc80b2ca0 2024-04-25T09:11:26.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.946+0000 7f4fc6a00640 1 -- 172.21.15.173:0/2820584714 >> v2:172.21.15.194:3300/0 conn(0x7f4fc8071a30 msgr2=0x7f4fc80ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:26.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.946+0000 7f4fc6a00640 1 --2- 172.21.15.173:0/2820584714 >> v2:172.21.15.194:3300/0 conn(0x7f4fc8071a30 0x7f4fc80ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.946+0000 7f4fc6a00640 1 -- 172.21.15.173:0/2820584714 >> v1:172.21.15.194:6789/0 conn(0x7f4fc80b2ca0 legacy=0x7f4fc8071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.946+0000 7f4fc6a00640 1 -- 172.21.15.173:0/2820584714 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc80aebe0 con 0x7f4fc815a180 2024-04-25T09:11:26.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.946+0000 7f4fc7400640 1 --2- 172.21.15.173:0/2820584714 >> v2:172.21.15.194:3300/0 conn(0x7f4fc8071a30 0x7f4fc80ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:26.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.946+0000 7f4fc6a00640 1 --2- 172.21.15.173:0/2820584714 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4fc815a180 0x7f4fc80b40e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80af3b0 tx=0x7f4fb801c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48dc6661581a8c5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fc5600640 1 -- 172.21.15.173:0/2820584714 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb80b2070 con 0x7f4fc815a180 2024-04-25T09:11:26.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fc5600640 1 -- 172.21.15.173:0/2820584714 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb80a5740 con 0x7f4fc815a180 2024-04-25T09:11:26.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fc5600640 1 -- 172.21.15.173:0/2820584714 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb800b040 con 0x7f4fc815a180 2024-04-25T09:11:26.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fcda00640 1 -- 172.21.15.173:0/2820584714 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4fc815a180 msgr2=0x7f4fc80b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fcda00640 1 --2- 172.21.15.173:0/2820584714 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4fc815a180 0x7f4fc80b40e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80af3b0 tx=0x7f4fb801c770 comp rx=0 tx=0).stop 2024-04-25T09:11:26.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fcda00640 1 -- 172.21.15.173:0/2820584714 shutdown_connections 2024-04-25T09:11:26.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fcda00640 1 --2- 172.21.15.173:0/2820584714 >> v2:172.21.15.194:3300/0 conn(0x7f4fc8071a30 0x7f4fc80ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fcda00640 1 --2- 172.21.15.173:0/2820584714 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4fc815a180 0x7f4fc80b40e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fcda00640 1 -- 172.21.15.173:0/2820584714 >> 172.21.15.173:0/2820584714 conn(0x7f4fc806ac90 msgr2=0x7f4fc806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:26.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fcda00640 1 -- 172.21.15.173:0/2820584714 shutdown_connections 2024-04-25T09:11:26.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fcda00640 1 -- 172.21.15.173:0/2820584714 wait complete. 2024-04-25T09:11:26.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fcda00640 1 Processor -- start 2024-04-25T09:11:26.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fcda00640 1 -- start start 2024-04-25T09:11:26.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fcda00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4fc8071a30 0x7f4fc814c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fcda00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc80b2ca0 0x7f4fc80afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fcda00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fc815a180 0x7f4fc81f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fcda00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc806e240 con 0x7f4fc80b2ca0 2024-04-25T09:11:26.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fcda00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc806e0c0 con 0x7f4fc815a180 2024-04-25T09:11:26.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fcda00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc806e3c0 con 0x7f4fc8071a30 2024-04-25T09:11:26.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fc6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc80b2ca0 0x7f4fc80afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fc6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc80b2ca0 0x7f4fc80afaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36668/0 (socket says 172.21.15.173:36668) 2024-04-25T09:11:26.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fc6a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4fc8071a30 0x7f4fc814c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fc6000640 1 -- 172.21.15.173:0/2194473044 learned_addr learned my addr 172.21.15.173:0/2194473044 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:26.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.950+0000 7f4fc7400640 1 --2- 172.21.15.173:0/2194473044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fc815a180 0x7f4fc81f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.954+0000 7f4fc6000640 1 -- 172.21.15.173:0/2194473044 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4fc8071a30 msgr2=0x7f4fc814c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.954+0000 7f4fc6000640 1 --2- 172.21.15.173:0/2194473044 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4fc8071a30 0x7f4fc814c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.954+0000 7f4fc6000640 1 -- 172.21.15.173:0/2194473044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fc815a180 msgr2=0x7f4fc81f6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.954+0000 7f4fc6000640 1 --2- 172.21.15.173:0/2194473044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fc815a180 0x7f4fc81f6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.954+0000 7f4fc6000640 1 -- 172.21.15.173:0/2194473044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc81546a0 con 0x7f4fc80b2ca0 2024-04-25T09:11:26.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.954+0000 7f4fc6000640 1 --2- 172.21.15.173:0/2194473044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc80b2ca0 0x7f4fc80afaf0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400c3c0 tx=0x7f4fb400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.954+0000 7f4fbea00640 1 -- 172.21.15.173:0/2194473044 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4017070 con 0x7f4fc80b2ca0 2024-04-25T09:11:26.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.954+0000 7f4fbea00640 1 -- 172.21.15.173:0/2194473044 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb4005db0 con 0x7f4fc80b2ca0 2024-04-25T09:11:26.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.954+0000 7f4fbea00640 1 -- 172.21.15.173:0/2194473044 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40072f0 con 0x7f4fc80b2ca0 2024-04-25T09:11:26.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.954+0000 7f4fcda00640 1 -- 172.21.15.173:0/2194473044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc814f670 con 0x7f4fc80b2ca0 2024-04-25T09:11:26.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.954+0000 7f4fcda00640 1 -- 172.21.15.173:0/2194473044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc80b0e90 con 0x7f4fc80b2ca0 2024-04-25T09:11:26.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.954+0000 7f4fcda00640 1 -- 172.21.15.173:0/2194473044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc8073a40 con 0x7f4fc80b2ca0 2024-04-25T09:11:26.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.954+0000 7f4fbea00640 1 -- 172.21.15.173:0/2194473044 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4fb401a070 con 0x7f4fc80b2ca0 2024-04-25T09:11:26.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.954+0000 7f4fbea00640 1 --2- 172.21.15.173:0/2194473044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4fa8066f60 0x7f4fa8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.954+0000 7f4fbea00640 1 -- 172.21.15.173:0/2194473044 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4fb4084540 con 0x7f4fc80b2ca0 2024-04-25T09:11:26.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.954+0000 7f4fc6a00640 1 --2- 172.21.15.173:0/2194473044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4fa8066f60 0x7f4fa8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.958+0000 7f4fc6a00640 1 --2- 172.21.15.173:0/2194473044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4fa8066f60 0x7f4fa8069420 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4fb80af000 tx=0x7f4fb800c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:26.958+0000 7f4fbea00640 1 -- 172.21.15.173:0/2194473044 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4fb4054d60 con 0x7f4fc80b2ca0 2024-04-25T09:11:27.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.114+0000 7f4fcda00640 1 -- 172.21.15.173:0/2194473044 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fc806e640 con 0x7f4fc80b2ca0 2024-04-25T09:11:27.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.114+0000 7f4fbea00640 1 -- 172.21.15.173:0/2194473044 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+17025 (secure 0 0 0) 0x7f4fb4058e00 con 0x7f4fc80b2ca0 2024-04-25T09:11:27.100 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:27.100 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":121,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:11:26.148527+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:11:24.499900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T09:11:25.140140+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:27.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.118+0000 7f4fcda00640 1 -- 172.21.15.173:0/2194473044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4fa8066f60 msgr2=0x7f4fa8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.118+0000 7f4fcda00640 1 --2- 172.21.15.173:0/2194473044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4fa8066f60 0x7f4fa8069420 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4fb80af000 tx=0x7f4fb800c040 comp rx=0 tx=0).stop 2024-04-25T09:11:27.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.118+0000 7f4fcda00640 1 -- 172.21.15.173:0/2194473044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc80b2ca0 msgr2=0x7f4fc80afaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.118+0000 7f4fcda00640 1 --2- 172.21.15.173:0/2194473044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc80b2ca0 0x7f4fc80afaf0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400c3c0 tx=0x7f4fb400c7c0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.118+0000 7f4fcda00640 1 -- 172.21.15.173:0/2194473044 shutdown_connections 2024-04-25T09:11:27.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.118+0000 7f4fcda00640 1 --2- 172.21.15.173:0/2194473044 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4fa8066f60 0x7f4fa8069420 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.118+0000 7f4fcda00640 1 --2- 172.21.15.173:0/2194473044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4fc815a180 0x7f4fc81f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.118+0000 7f4fcda00640 1 --2- 172.21.15.173:0/2194473044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fc80b2ca0 0x7f4fc80afaf0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.118+0000 7f4fcda00640 1 --2- 172.21.15.173:0/2194473044 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4fc8071a30 0x7f4fc814c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.118+0000 7f4fcda00640 1 -- 172.21.15.173:0/2194473044 >> 172.21.15.173:0/2194473044 conn(0x7f4fc806ac90 msgr2=0x7f4fc81529a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.118+0000 7f4fcda00640 1 -- 172.21.15.173:0/2194473044 shutdown_connections 2024-04-25T09:11:27.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.118+0000 7f4fcda00640 1 -- 172.21.15.173:0/2194473044 wait complete. 2024-04-25T09:11:27.122 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:27.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.270+0000 7f7e17000640 1 Processor -- start 2024-04-25T09:11:27.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.270+0000 7f7e17000640 1 -- start start 2024-04-25T09:11:27.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.274+0000 7f7e17000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7e101449b0 0x7f7e100710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.274+0000 7f7e17000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7e100715e0 0x7f7e1006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.274+0000 7f7e17000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1015f3d0 con 0x7f7e10144240 2024-04-25T09:11:27.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.274+0000 7f7e17000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1015f6b0 con 0x7f7e100715e0 2024-04-25T09:11:27.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.274+0000 7f7e17000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1015f990 con 0x7f7e101449b0 2024-04-25T09:11:27.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.274+0000 7f7e16600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7e100715e0 0x7f7e1006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.274+0000 7f7e16600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7e100715e0 0x7f7e1006d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36674/0 (socket says 172.21.15.173:36674) 2024-04-25T09:11:27.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.274+0000 7f7e15c00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f7e10144240 0x7f7e100cdb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46424/0 (socket says 172.21.15.173:46424) 2024-04-25T09:11:27.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.274+0000 7f7e16600640 1 -- 172.21.15.173:0/2203831869 learned_addr learned my addr 172.21.15.173:0/2203831869 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:27.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.274+0000 7f7e15200640 1 --2- 172.21.15.173:0/2203831869 >> v2:172.21.15.194:3300/0 conn(0x7f7e101449b0 0x7f7e100710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.274+0000 7f7e16600640 1 -- 172.21.15.173:0/2203831869 >> v2:172.21.15.194:3300/0 conn(0x7f7e101449b0 msgr2=0x7f7e100710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.274+0000 7f7e16600640 1 --2- 172.21.15.173:0/2203831869 >> v2:172.21.15.194:3300/0 conn(0x7f7e101449b0 0x7f7e100710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.274+0000 7f7e16600640 1 -- 172.21.15.173:0/2203831869 >> v1:172.21.15.173:6789/0 conn(0x7f7e10144240 legacy=0x7f7e100cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.274+0000 7f7e16600640 1 -- 172.21.15.173:0/2203831869 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1015fc70 con 0x7f7e100715e0 2024-04-25T09:11:27.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.274+0000 7f7e0fe00640 1 -- 172.21.15.173:0/2203831869 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679257367 0 0) 0x7f7e1015f3d0 con 0x7f7e10144240 2024-04-25T09:11:27.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.278+0000 7f7e16600640 1 --2- 172.21.15.173:0/2203831869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e100715e0 0x7f7e1006d1e0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009e50 tx=0x7f7e0801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f6b3cd9555e300 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.278+0000 7f7e0fe00640 1 -- 172.21.15.173:0/2203831869 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e080a56e0 con 0x7f7e100715e0 2024-04-25T09:11:27.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.278+0000 7f7e0fe00640 1 -- 172.21.15.173:0/2203831869 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e080a5880 con 0x7f7e100715e0 2024-04-25T09:11:27.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.278+0000 7f7e0fe00640 1 -- 172.21.15.173:0/2203831869 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e080a5c50 con 0x7f7e100715e0 2024-04-25T09:11:27.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.278+0000 7f7e17000640 1 -- 172.21.15.173:0/2203831869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e100715e0 msgr2=0x7f7e1006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.278+0000 7f7e17000640 1 --2- 172.21.15.173:0/2203831869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e100715e0 0x7f7e1006d1e0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009e50 tx=0x7f7e0801c9f0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.278+0000 7f7e17000640 1 -- 172.21.15.173:0/2203831869 shutdown_connections 2024-04-25T09:11:27.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.278+0000 7f7e17000640 1 --2- 172.21.15.173:0/2203831869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e100715e0 0x7f7e1006d1e0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.278+0000 7f7e17000640 1 --2- 172.21.15.173:0/2203831869 >> v2:172.21.15.194:3300/0 conn(0x7f7e101449b0 0x7f7e100710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.278+0000 7f7e17000640 1 -- 172.21.15.173:0/2203831869 >> 172.21.15.173:0/2203831869 conn(0x7f7e1006ac90 msgr2=0x7f7e1006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.278+0000 7f7e17000640 1 -- 172.21.15.173:0/2203831869 shutdown_connections 2024-04-25T09:11:27.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.278+0000 7f7e17000640 1 -- 172.21.15.173:0/2203831869 wait complete. 2024-04-25T09:11:27.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.278+0000 7f7e17000640 1 Processor -- start 2024-04-25T09:11:27.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.278+0000 7f7e17000640 1 -- start start 2024-04-25T09:11:27.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e17000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e100715e0 0x7f7e1015ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e17000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e10144240 0x7f7e1015a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e17000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e101449b0 0x7f7e1013b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e17000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1006e2c0 con 0x7f7e100715e0 2024-04-25T09:11:27.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e17000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1006e140 con 0x7f7e101449b0 2024-04-25T09:11:27.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e17000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1006e440 con 0x7f7e10144240 2024-04-25T09:11:27.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e15c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e100715e0 0x7f7e1015ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e15c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e100715e0 0x7f7e1015ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36684/0 (socket says 172.21.15.173:36684) 2024-04-25T09:11:27.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e15c00640 1 -- 172.21.15.173:0/2421864876 learned_addr learned my addr 172.21.15.173:0/2421864876 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:27.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e16600640 1 --2- 172.21.15.173:0/2421864876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e101449b0 0x7f7e1013b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e15200640 1 --2- 172.21.15.173:0/2421864876 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e10144240 0x7f7e1015a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e15c00640 1 -- 172.21.15.173:0/2421864876 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e10144240 msgr2=0x7f7e1015a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e15c00640 1 --2- 172.21.15.173:0/2421864876 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e10144240 0x7f7e1015a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e15c00640 1 -- 172.21.15.173:0/2421864876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e101449b0 msgr2=0x7f7e1013b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e15c00640 1 --2- 172.21.15.173:0/2421864876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e101449b0 0x7f7e1013b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e15c00640 1 -- 172.21.15.173:0/2421864876 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1015a9c0 con 0x7f7e100715e0 2024-04-25T09:11:27.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e16600640 1 --2- 172.21.15.173:0/2421864876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e101449b0 0x7f7e1013b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:27.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e15c00640 1 --2- 172.21.15.173:0/2421864876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e100715e0 0x7f7e1015ac00 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400c480 tx=0x7f7e0400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e0d600640 1 -- 172.21.15.173:0/2421864876 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04018070 con 0x7f7e100715e0 2024-04-25T09:11:27.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e0d600640 1 -- 172.21.15.173:0/2421864876 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e04007500 con 0x7f7e100715e0 2024-04-25T09:11:27.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e0d600640 1 -- 172.21.15.173:0/2421864876 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04004a30 con 0x7f7e100715e0 2024-04-25T09:11:27.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e17000640 1 -- 172.21.15.173:0/2421864876 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e100b0380 con 0x7f7e100715e0 2024-04-25T09:11:27.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e17000640 1 -- 172.21.15.173:0/2421864876 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e100b0c20 con 0x7f7e100715e0 2024-04-25T09:11:27.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e17000640 1 -- 172.21.15.173:0/2421864876 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e10073a40 con 0x7f7e100715e0 2024-04-25T09:11:27.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e0d600640 1 -- 172.21.15.173:0/2421864876 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7e04004bd0 con 0x7f7e100715e0 2024-04-25T09:11:27.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.282+0000 7f7e0d600640 1 --2- 172.21.15.173:0/2421864876 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7df0066f60 0x7f7df0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.286+0000 7f7e0d600640 1 -- 172.21.15.173:0/2421864876 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7e040843d0 con 0x7f7e100715e0 2024-04-25T09:11:27.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.286+0000 7f7e15200640 1 --2- 172.21.15.173:0/2421864876 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7df0066f60 0x7f7df0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.286+0000 7f7e15200640 1 --2- 172.21.15.173:0/2421864876 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7df0066f60 0x7f7df0069420 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7e10139670 tx=0x7f7dfc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.286+0000 7f7e0d600640 1 -- 172.21.15.173:0/2421864876 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7e040552e0 con 0x7f7e100715e0 2024-04-25T09:11:27.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.442+0000 7f7e17000640 1 -- 172.21.15.173:0/2421864876 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e10141600 con 0x7f7e100715e0 2024-04-25T09:11:27.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.442+0000 7f7e0d600640 1 -- 172.21.15.173:0/2421864876 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+17025 (secure 0 0 0) 0x7f7e04054be0 con 0x7f7e100715e0 2024-04-25T09:11:27.429 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:27.429 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":121,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:11:26.148527+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:11:24.499900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T09:11:25.140140+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:27.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.446+0000 7f7e17000640 1 -- 172.21.15.173:0/2421864876 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7df0066f60 msgr2=0x7f7df0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.446+0000 7f7e17000640 1 --2- 172.21.15.173:0/2421864876 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7df0066f60 0x7f7df0069420 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7e10139670 tx=0x7f7dfc008040 comp rx=0 tx=0).stop 2024-04-25T09:11:27.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.446+0000 7f7e17000640 1 -- 172.21.15.173:0/2421864876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e100715e0 msgr2=0x7f7e1015ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.446+0000 7f7e17000640 1 --2- 172.21.15.173:0/2421864876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e100715e0 0x7f7e1015ac00 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400c480 tx=0x7f7e0400c940 comp rx=0 tx=0).stop 2024-04-25T09:11:27.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.446+0000 7f7e17000640 1 -- 172.21.15.173:0/2421864876 shutdown_connections 2024-04-25T09:11:27.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.446+0000 7f7e17000640 1 --2- 172.21.15.173:0/2421864876 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7df0066f60 0x7f7df0069420 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.446+0000 7f7e17000640 1 --2- 172.21.15.173:0/2421864876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e101449b0 0x7f7e1013b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.446+0000 7f7e17000640 1 --2- 172.21.15.173:0/2421864876 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e10144240 0x7f7e1015a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.446+0000 7f7e17000640 1 --2- 172.21.15.173:0/2421864876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e100715e0 0x7f7e1015ac00 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.446+0000 7f7e17000640 1 -- 172.21.15.173:0/2421864876 >> 172.21.15.173:0/2421864876 conn(0x7f7e1006ac90 msgr2=0x7f7e1013d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.446+0000 7f7e17000640 1 -- 172.21.15.173:0/2421864876 shutdown_connections 2024-04-25T09:11:27.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.446+0000 7f7e17000640 1 -- 172.21.15.173:0/2421864876 wait complete. 2024-04-25T09:11:27.451 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:11:27.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59dd800640 1 Processor -- start 2024-04-25T09:11:27.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59dd800640 1 -- start start 2024-04-25T09:11:27.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59dd800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f59d80ced90 0x7f59d80cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59dd800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d80cdaa0 con 0x7f59d80ccff0 2024-04-25T09:11:27.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59dd800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d815b3a0 con 0x7f59d80b0d70 2024-04-25T09:11:27.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59dd800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d806d3d0 con 0x7f59d80ced90 2024-04-25T09:11:27.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d7400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f59d80ccff0 0x7f59d80ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46436/0 (socket says 172.21.15.173:46436) 2024-04-25T09:11:27.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d7400640 1 -- 172.21.15.173:0/2626076816 learned_addr learned my addr 172.21.15.173:0/2626076816 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:27.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59dce00640 1 --2- 172.21.15.173:0/2626076816 >> v2:172.21.15.194:3300/0 conn(0x7f59d80ced90 0x7f59d80cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d6a00640 1 -- 172.21.15.173:0/2626076816 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112483958 0 0) 0x7f59d80cdaa0 con 0x7f59d80ccff0 2024-04-25T09:11:27.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d6a00640 1 -- 172.21.15.173:0/2626076816 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59bc003530 con 0x7f59d80ccff0 2024-04-25T09:11:27.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d6a00640 1 -- 172.21.15.173:0/2626076816 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317262942 0 0) 0x7f59d815b3a0 con 0x7f59d80b0d70 2024-04-25T09:11:27.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d6a00640 1 -- 172.21.15.173:0/2626076816 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d80cdaa0 con 0x7f59d80b0d70 2024-04-25T09:11:27.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d6a00640 1 -- 172.21.15.173:0/2626076816 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1332916724 0 0) 0x7f59bc003530 con 0x7f59d80ccff0 2024-04-25T09:11:27.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d6a00640 1 -- 172.21.15.173:0/2626076816 >> v2:172.21.15.194:3300/0 conn(0x7f59d80ced90 msgr2=0x7f59d80cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d6a00640 1 --2- 172.21.15.173:0/2626076816 >> v2:172.21.15.194:3300/0 conn(0x7f59d80ced90 0x7f59d80cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d6a00640 1 -- 172.21.15.173:0/2626076816 >> v1:172.21.15.194:6789/0 conn(0x7f59d80b0d70 legacy=0x7f59d815ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d6a00640 1 -- 172.21.15.173:0/2626076816 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d806d670 con 0x7f59d80ccff0 2024-04-25T09:11:27.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d6a00640 1 -- 172.21.15.173:0/2626076816 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f59c4001680 con 0x7f59d80ccff0 2024-04-25T09:11:27.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d6a00640 1 -- 172.21.15.173:0/2626076816 >> v1:172.21.15.173:6789/0 conn(0x7f59d80ccff0 legacy=0x7f59d80ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d6a00640 1 --2- 172.21.15.173:0/2626076816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59bc003ba0 0x7f59bc003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d6a00640 1 --2- 172.21.15.173:0/2626076816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59bc004810 0x7f59bc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d6a00640 1 --2- 172.21.15.173:0/2626076816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59bc005220 0x7f59bc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d6a00640 1 -- 172.21.15.173:0/2626076816 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d806d3d0 con 0x7f59bc005220 2024-04-25T09:11:27.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d6a00640 1 -- 172.21.15.173:0/2626076816 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc00c150 con 0x7f59bc004810 2024-04-25T09:11:27.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d6a00640 1 -- 172.21.15.173:0/2626076816 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc00c350 con 0x7f59bc003ba0 2024-04-25T09:11:27.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59dce00640 1 --2- 172.21.15.173:0/2626076816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59bc005220 0x7f59bc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d7400640 1 --2- 172.21.15.173:0/2626076816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59bc004810 0x7f59bc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59d7e00640 1 --2- 172.21.15.173:0/2626076816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59bc003ba0 0x7f59bc003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59dce00640 1 -- 172.21.15.173:0/2626076816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59bc003ba0 msgr2=0x7f59bc003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59dce00640 1 --2- 172.21.15.173:0/2626076816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59bc003ba0 0x7f59bc003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59dce00640 1 -- 172.21.15.173:0/2626076816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59bc004810 msgr2=0x7f59bc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59dce00640 1 --2- 172.21.15.173:0/2626076816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59bc004810 0x7f59bc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.606+0000 7f59dce00640 1 -- 172.21.15.173:0/2626076816 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc003530 con 0x7f59bc005220 2024-04-25T09:11:27.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.610+0000 7f59dce00640 1 -- 172.21.15.173:0/2626076816 reap_dead start 2024-04-25T09:11:27.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.610+0000 7f59dce00640 1 --2- 172.21.15.173:0/2626076816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59bc005220 0x7f59bc00b9d0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f59d815f340 tx=0x7f59d001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa723eaadb30ba5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.610+0000 7f59d6a00640 1 -- 172.21.15.173:0/2626076816 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d0009c10 con 0x7f59bc005220 2024-04-25T09:11:27.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.610+0000 7f59d6a00640 1 -- 172.21.15.173:0/2626076816 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d00a5c70 con 0x7f59bc005220 2024-04-25T09:11:27.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.610+0000 7f59d6a00640 1 -- 172.21.15.173:0/2626076816 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d0003be0 con 0x7f59bc005220 2024-04-25T09:11:27.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.610+0000 7f59dd800640 1 -- 172.21.15.173:0/2626076816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59bc005220 msgr2=0x7f59bc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.610+0000 7f59dd800640 1 --2- 172.21.15.173:0/2626076816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59bc005220 0x7f59bc00b9d0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f59d815f340 tx=0x7f59d001cc60 comp rx=0 tx=0).stop 2024-04-25T09:11:27.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.610+0000 7f59dd800640 1 -- 172.21.15.173:0/2626076816 shutdown_connections 2024-04-25T09:11:27.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.610+0000 7f59dd800640 1 --2- 172.21.15.173:0/2626076816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59bc005220 0x7f59bc00b9d0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.610+0000 7f59dd800640 1 -- 172.21.15.173:0/2626076816 >> 172.21.15.173:0/2626076816 conn(0x7f59d8061d40 msgr2=0x7f59d806ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.610+0000 7f59dd800640 1 -- 172.21.15.173:0/2626076816 shutdown_connections 2024-04-25T09:11:27.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.610+0000 7f59dd800640 1 -- 172.21.15.173:0/2626076816 wait complete. 2024-04-25T09:11:27.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59dd800640 1 Processor -- start 2024-04-25T09:11:27.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59dd800640 1 -- start start 2024-04-25T09:11:27.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59dd800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59bc005220 0x7f59d813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59dd800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59d81387d0 0x7f59d8154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59dd800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59d8135790 0x7f59d8153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59dd800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80b1150 con 0x7f59d81387d0 2024-04-25T09:11:27.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59dd800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d806dc30 con 0x7f59bc005220 2024-04-25T09:11:27.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59dd800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d8143d90 con 0x7f59d8135790 2024-04-25T09:11:27.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59d7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59d81387d0 0x7f59d8154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59d7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59d81387d0 0x7f59d8154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36702/0 (socket says 172.21.15.173:36702) 2024-04-25T09:11:27.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59d7400640 1 -- 172.21.15.173:0/180630176 learned_addr learned my addr 172.21.15.173:0/180630176 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:27.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59dce00640 1 --2- 172.21.15.173:0/180630176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59d8135790 0x7f59d8153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59d7e00640 1 --2- 172.21.15.173:0/180630176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59bc005220 0x7f59d813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59d7400640 1 -- 172.21.15.173:0/180630176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59d8135790 msgr2=0x7f59d8153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59d7400640 1 --2- 172.21.15.173:0/180630176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59d8135790 0x7f59d8153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59d7400640 1 -- 172.21.15.173:0/180630176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59bc005220 msgr2=0x7f59d813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59d7400640 1 --2- 172.21.15.173:0/180630176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59bc005220 0x7f59d813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59d7400640 1 -- 172.21.15.173:0/180630176 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d81f38e0 con 0x7f59d81387d0 2024-04-25T09:11:27.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59dce00640 1 --2- 172.21.15.173:0/180630176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59d8135790 0x7f59d8153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:27.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59d7e00640 1 --2- 172.21.15.173:0/180630176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59bc005220 0x7f59d813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:27.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59d7400640 1 --2- 172.21.15.173:0/180630176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59d81387d0 0x7f59d8154540 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f59c400e550 tx=0x7f59c400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59cfe00640 1 -- 172.21.15.173:0/180630176 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4012590 con 0x7f59d81387d0 2024-04-25T09:11:27.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59cfe00640 1 -- 172.21.15.173:0/180630176 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c4018070 con 0x7f59d81387d0 2024-04-25T09:11:27.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59dd800640 1 -- 172.21.15.173:0/180630176 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d8135c10 con 0x7f59d81387d0 2024-04-25T09:11:27.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59cfe00640 1 -- 172.21.15.173:0/180630176 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4012930 con 0x7f59d81387d0 2024-04-25T09:11:27.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59dd800640 1 -- 172.21.15.173:0/180630176 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d8137cf0 con 0x7f59d81387d0 2024-04-25T09:11:27.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.614+0000 7f59dd800640 1 -- 172.21.15.173:0/180630176 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d8073a40 con 0x7f59d81387d0 2024-04-25T09:11:27.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.618+0000 7f59cfe00640 1 -- 172.21.15.173:0/180630176 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f59c4012ad0 con 0x7f59d81387d0 2024-04-25T09:11:27.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.618+0000 7f59cfe00640 1 --2- 172.21.15.173:0/180630176 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59b8066f60 0x7f59b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.618+0000 7f59cfe00640 1 -- 172.21.15.173:0/180630176 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f59c4084e90 con 0x7f59d81387d0 2024-04-25T09:11:27.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.618+0000 7f59d7e00640 1 --2- 172.21.15.173:0/180630176 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59b8066f60 0x7f59b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.618+0000 7f59d7e00640 1 --2- 172.21.15.173:0/180630176 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59b8066f60 0x7f59b8069420 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f59c8007b70 tx=0x7f59c8007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.622+0000 7f59cfe00640 1 -- 172.21.15.173:0/180630176 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f59c40112e0 con 0x7f59d81387d0 2024-04-25T09:11:27.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:27.810+0000 7f59dd800640 1 -- 172.21.15.173:0/180630176 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f59d806ba50 con 0x7f59d81387d0 2024-04-25T09:11:28.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-04-25T09:11:28.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-04-25T09:11:28.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-04-25T09:11:28.725 INFO:tasks.ceph.mds.c.smithi173.stderr:2024-04-25T09:11:28.738+0000 7feff9a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:11:28.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.786+0000 7f59cfe00640 1 -- 172.21.15.173:0/180630176 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v80) v1 ==== 118+0+0 (secure 0 0 0) 0x7f59c4086070 con 0x7f59d81387d0 2024-04-25T09:11:28.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.790+0000 7f59dd800640 1 -- 172.21.15.173:0/180630176 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59b8066f60 msgr2=0x7f59b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:28.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.790+0000 7f59dd800640 1 --2- 172.21.15.173:0/180630176 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59b8066f60 0x7f59b8069420 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f59c8007b70 tx=0x7f59c8007aa0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.790+0000 7f59dd800640 1 -- 172.21.15.173:0/180630176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59d81387d0 msgr2=0x7f59d8154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:28.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.790+0000 7f59dd800640 1 --2- 172.21.15.173:0/180630176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59d81387d0 0x7f59d8154540 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f59c400e550 tx=0x7f59c400ea10 comp rx=0 tx=0).stop 2024-04-25T09:11:28.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.790+0000 7f59dd800640 1 -- 172.21.15.173:0/180630176 shutdown_connections 2024-04-25T09:11:28.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.790+0000 7f59dd800640 1 --2- 172.21.15.173:0/180630176 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59b8066f60 0x7f59b8069420 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.790+0000 7f59dd800640 1 --2- 172.21.15.173:0/180630176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59d8135790 0x7f59d8153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.790+0000 7f59dd800640 1 --2- 172.21.15.173:0/180630176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59d81387d0 0x7f59d8154540 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.790+0000 7f59dd800640 1 --2- 172.21.15.173:0/180630176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59bc005220 0x7f59d813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.790+0000 7f59dd800640 1 -- 172.21.15.173:0/180630176 >> 172.21.15.173:0/180630176 conn(0x7f59d8061d40 msgr2=0x7f59d813fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:28.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.790+0000 7f59dd800640 1 -- 172.21.15.173:0/180630176 shutdown_connections 2024-04-25T09:11:28.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.790+0000 7f59dd800640 1 -- 172.21.15.173:0/180630176 wait complete. 2024-04-25T09:11:28.798 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:11:28.799 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:11:28.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f7765c00640 1 Processor -- start 2024-04-25T09:11:28.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f7765c00640 1 -- start start 2024-04-25T09:11:28.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f7765c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77600b3fe0 0x7f77600b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:28.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f7765c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f776006d4b0 con 0x7f77600cc260 2024-04-25T09:11:28.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f7765c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f776006d790 con 0x7f7760145290 2024-04-25T09:11:28.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f7765c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776006da70 con 0x7f77600b3fe0 2024-04-25T09:11:28.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775f400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f77600cc260 0x7f77600cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46446/0 (socket says 172.21.15.173:46446) 2024-04-25T09:11:28.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775f400640 1 -- 172.21.15.173:0/750926688 learned_addr learned my addr 172.21.15.173:0/750926688 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:28.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775e000640 1 --2- 172.21.15.173:0/750926688 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77600b3fe0 0x7f77600b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:28.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775d600640 1 -- 172.21.15.173:0/750926688 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062196758 0 0) 0x7f776006d4b0 con 0x7f77600cc260 2024-04-25T09:11:28.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775d600640 1 -- 172.21.15.173:0/750926688 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7744003530 con 0x7f77600cc260 2024-04-25T09:11:28.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775d600640 1 -- 172.21.15.173:0/750926688 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40664635 0 0) 0x7f776006d790 con 0x7f7760145290 2024-04-25T09:11:28.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775d600640 1 -- 172.21.15.173:0/750926688 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f776006d4b0 con 0x7f7760145290 2024-04-25T09:11:28.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775d600640 1 -- 172.21.15.173:0/750926688 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3566665353 0 0) 0x7f7744003530 con 0x7f77600cc260 2024-04-25T09:11:28.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775d600640 1 -- 172.21.15.173:0/750926688 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77600b3fe0 msgr2=0x7f77600b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:28.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775d600640 1 --2- 172.21.15.173:0/750926688 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77600b3fe0 0x7f77600b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775d600640 1 -- 172.21.15.173:0/750926688 >> v1:172.21.15.194:6789/0 conn(0x7f7760145290 legacy=0x7f776015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:28.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775d600640 1 -- 172.21.15.173:0/750926688 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776006dd50 con 0x7f77600cc260 2024-04-25T09:11:28.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775d600640 1 -- 172.21.15.173:0/750926688 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f7758001a00 con 0x7f77600cc260 2024-04-25T09:11:28.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775d600640 1 -- 172.21.15.173:0/750926688 >> v1:172.21.15.173:6789/0 conn(0x7f77600cc260 legacy=0x7f77600cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:28.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775d600640 1 --2- 172.21.15.173:0/750926688 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77600b3fe0 0x7f7744003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:28.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775d600640 1 --2- 172.21.15.173:0/750926688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77440040e0 0x7f7744004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:28.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775d600640 1 --2- 172.21.15.173:0/750926688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7744004d50 0x7f77440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:28.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775d600640 1 -- 172.21.15.173:0/750926688 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776006da70 con 0x7f77440040e0 2024-04-25T09:11:28.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775d600640 1 -- 172.21.15.173:0/750926688 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774400bbe0 con 0x7f7744004d50 2024-04-25T09:11:28.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775d600640 1 -- 172.21.15.173:0/750926688 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774400bde0 con 0x7f77600b3fe0 2024-04-25T09:11:28.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775e000640 1 --2- 172.21.15.173:0/750926688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77440040e0 0x7f7744004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:28.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775ea00640 1 --2- 172.21.15.173:0/750926688 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77600b3fe0 0x7f7744003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:28.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.958+0000 7f775f400640 1 --2- 172.21.15.173:0/750926688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7744004d50 0x7f77440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:28.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.962+0000 7f775e000640 1 -- 172.21.15.173:0/750926688 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77600b3fe0 msgr2=0x7f7744003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:28.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.962+0000 7f775e000640 1 --2- 172.21.15.173:0/750926688 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77600b3fe0 0x7f7744003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.962+0000 7f775e000640 1 -- 172.21.15.173:0/750926688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7744004d50 msgr2=0x7f77440051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:28.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.962+0000 7f775e000640 1 --2- 172.21.15.173:0/750926688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7744004d50 0x7f77440051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.962+0000 7f775e000640 1 -- 172.21.15.173:0/750926688 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7744003530 con 0x7f77440040e0 2024-04-25T09:11:28.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.962+0000 7f775e000640 1 --2- 172.21.15.173:0/750926688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77440040e0 0x7f7744004810 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f774c009ae0 tx=0x7f774c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d902da34307f5fc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:28.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.962+0000 7f775d600640 1 -- 172.21.15.173:0/750926688 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c0b2070 con 0x7f77440040e0 2024-04-25T09:11:28.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.962+0000 7f775d600640 1 -- 172.21.15.173:0/750926688 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774c0a5530 con 0x7f77440040e0 2024-04-25T09:11:28.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.962+0000 7f775d600640 1 -- 172.21.15.173:0/750926688 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c0096b0 con 0x7f77440040e0 2024-04-25T09:11:28.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.962+0000 7f7765c00640 1 -- 172.21.15.173:0/750926688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77440040e0 msgr2=0x7f7744004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:28.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.962+0000 7f7765c00640 1 --2- 172.21.15.173:0/750926688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77440040e0 0x7f7744004810 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f774c009ae0 tx=0x7f774c01ca50 comp rx=0 tx=0).stop 2024-04-25T09:11:28.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.962+0000 7f775f400640 1 -- 172.21.15.173:0/750926688 reap_dead start 2024-04-25T09:11:28.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.962+0000 7f7765c00640 1 -- 172.21.15.173:0/750926688 shutdown_connections 2024-04-25T09:11:28.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.962+0000 7f7765c00640 1 -- 172.21.15.173:0/750926688 >> 172.21.15.173:0/750926688 conn(0x7f776006ac90 msgr2=0x7f776006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:28.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.962+0000 7f7765c00640 1 -- 172.21.15.173:0/750926688 shutdown_connections 2024-04-25T09:11:28.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.962+0000 7f7765c00640 1 -- 172.21.15.173:0/750926688 wait complete. 2024-04-25T09:11:28.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f7765c00640 1 Processor -- start 2024-04-25T09:11:28.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f7765c00640 1 -- start start 2024-04-25T09:11:28.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f7765c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77440040e0 0x7f77600b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:28.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f7765c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77600ceff0 0x7f77600ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:28.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f7765c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77601fa1d0 0x7f77601fa660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:28.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f7765c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776006f0f0 con 0x7f77601fa1d0 2024-04-25T09:11:28.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f7765c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776006ef70 con 0x7f77600ceff0 2024-04-25T09:11:28.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f7765c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77600ae170 con 0x7f77440040e0 2024-04-25T09:11:28.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f775f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77601fa1d0 0x7f77601fa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:28.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f775f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77601fa1d0 0x7f77601fa660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36728/0 (socket says 172.21.15.173:36728) 2024-04-25T09:11:28.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f775f400640 1 -- 172.21.15.173:0/3263914328 learned_addr learned my addr 172.21.15.173:0/3263914328 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:28.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f775e000640 1 --2- 172.21.15.173:0/3263914328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77600ceff0 0x7f77600ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:28.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f775ea00640 1 --2- 172.21.15.173:0/3263914328 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77440040e0 0x7f77600b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:28.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f775f400640 1 -- 172.21.15.173:0/3263914328 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77440040e0 msgr2=0x7f77600b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:28.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f775f400640 1 --2- 172.21.15.173:0/3263914328 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77440040e0 0x7f77600b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f775f400640 1 -- 172.21.15.173:0/3263914328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77600ceff0 msgr2=0x7f77600ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:28.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f775f400640 1 --2- 172.21.15.173:0/3263914328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77600ceff0 0x7f77600ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f775f400640 1 -- 172.21.15.173:0/3263914328 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77600ace00 con 0x7f77601fa1d0 2024-04-25T09:11:28.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f775f400640 1 --2- 172.21.15.173:0/3263914328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77601fa1d0 0x7f77601fa660 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f77600727c0 tx=0x7f7758007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:28.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f7756a00640 1 -- 172.21.15.173:0/3263914328 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7758017020 con 0x7f77601fa1d0 2024-04-25T09:11:28.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f7756a00640 1 -- 172.21.15.173:0/3263914328 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775800aad0 con 0x7f77601fa1d0 2024-04-25T09:11:28.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f7756a00640 1 -- 172.21.15.173:0/3263914328 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77580133f0 con 0x7f77601fa1d0 2024-04-25T09:11:28.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f7765c00640 1 -- 172.21.15.173:0/3263914328 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77600ad0d0 con 0x7f77601fa1d0 2024-04-25T09:11:28.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.966+0000 7f7765c00640 1 -- 172.21.15.173:0/3263914328 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77600ad690 con 0x7f77601fa1d0 2024-04-25T09:11:28.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.970+0000 7f7765c00640 1 -- 172.21.15.173:0/3263914328 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7760073ab0 con 0x7f77601fa1d0 2024-04-25T09:11:28.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.970+0000 7f7756a00640 1 -- 172.21.15.173:0/3263914328 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f775801a020 con 0x7f77601fa1d0 2024-04-25T09:11:28.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.970+0000 7f7756a00640 1 --2- 172.21.15.173:0/3263914328 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7740066f60 0x7f7740069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:28.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.970+0000 7f7756a00640 1 -- 172.21.15.173:0/3263914328 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f77580856b0 con 0x7f77601fa1d0 2024-04-25T09:11:28.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.970+0000 7f775ea00640 1 --2- 172.21.15.173:0/3263914328 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7740066f60 0x7f7740069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:28.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.970+0000 7f775ea00640 1 --2- 172.21.15.173:0/3263914328 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7740066f60 0x7f7740069420 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f77600cdda0 tx=0x7f7750009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:28.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:28.974+0000 7f7756a00640 1 -- 172.21.15.173:0/3263914328 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7758021020 con 0x7f77601fa1d0 2024-04-25T09:11:29.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.162+0000 7f7765c00640 1 -- 172.21.15.173:0/3263914328 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7760143720 con 0x7f77601fa1d0 2024-04-25T09:11:29.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.794+0000 7f7756a00640 1 -- 172.21.15.173:0/3263914328 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v81) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7758055ed0 con 0x7f77601fa1d0 2024-04-25T09:11:29.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.794+0000 7f7765c00640 1 -- 172.21.15.173:0/3263914328 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7740066f60 msgr2=0x7f7740069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.794+0000 7f7765c00640 1 --2- 172.21.15.173:0/3263914328 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7740066f60 0x7f7740069420 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f77600cdda0 tx=0x7f7750009040 comp rx=0 tx=0).stop 2024-04-25T09:11:29.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.794+0000 7f7765c00640 1 -- 172.21.15.173:0/3263914328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77601fa1d0 msgr2=0x7f77601fa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.794+0000 7f7765c00640 1 --2- 172.21.15.173:0/3263914328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77601fa1d0 0x7f77601fa660 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f77600727c0 tx=0x7f7758007b00 comp rx=0 tx=0).stop 2024-04-25T09:11:29.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.794+0000 7f7765c00640 1 -- 172.21.15.173:0/3263914328 shutdown_connections 2024-04-25T09:11:29.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.794+0000 7f7765c00640 1 --2- 172.21.15.173:0/3263914328 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7740066f60 0x7f7740069420 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.794+0000 7f7765c00640 1 --2- 172.21.15.173:0/3263914328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77601fa1d0 0x7f77601fa660 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.794+0000 7f7765c00640 1 --2- 172.21.15.173:0/3263914328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77600ceff0 0x7f77600ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.794+0000 7f7765c00640 1 --2- 172.21.15.173:0/3263914328 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77440040e0 0x7f77600b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.794+0000 7f7765c00640 1 -- 172.21.15.173:0/3263914328 >> 172.21.15.173:0/3263914328 conn(0x7f776006ac90 msgr2=0x7f7760143f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:29.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.794+0000 7f7765c00640 1 -- 172.21.15.173:0/3263914328 shutdown_connections 2024-04-25T09:11:29.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.794+0000 7f7765c00640 1 -- 172.21.15.173:0/3263914328 wait complete. 2024-04-25T09:11:29.802 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:11:29.802 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:29.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.954+0000 7f761fc00640 1 Processor -- start 2024-04-25T09:11:29.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.954+0000 7f761fc00640 1 -- start start 2024-04-25T09:11:29.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.954+0000 7f761fc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f761815edd0 0x7f76180cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.954+0000 7f761fc00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761815f320 con 0x7f76180aefa0 2024-04-25T09:11:29.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.954+0000 7f761fc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761806d420 con 0x7f76180b3e70 2024-04-25T09:11:29.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.954+0000 7f761fc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f761806dd50 con 0x7f761815edd0 2024-04-25T09:11:29.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.958+0000 7f7617e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f76180aefa0 0x7f76180cd7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46452/0 (socket says 172.21.15.173:46452) 2024-04-25T09:11:29.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.958+0000 7f7617e00640 1 -- 172.21.15.173:0/4226854455 learned_addr learned my addr 172.21.15.173:0/4226854455 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:29.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.958+0000 7f761dc00640 1 --2- 172.21.15.173:0/4226854455 >> v2:172.21.15.194:3300/0 conn(0x7f761815edd0 0x7f76180cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.958+0000 7f7617400640 1 -- 172.21.15.173:0/4226854455 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322707280 0 0) 0x7f761815f320 con 0x7f76180aefa0 2024-04-25T09:11:29.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.958+0000 7f7617400640 1 -- 172.21.15.173:0/4226854455 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75fc003530 con 0x7f76180aefa0 2024-04-25T09:11:29.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.958+0000 7f7617400640 1 -- 172.21.15.173:0/4226854455 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763698398 0 0) 0x7f761806d420 con 0x7f76180b3e70 2024-04-25T09:11:29.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.958+0000 7f7617400640 1 -- 172.21.15.173:0/4226854455 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f761815f320 con 0x7f76180b3e70 2024-04-25T09:11:29.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.958+0000 7f7617400640 1 -- 172.21.15.173:0/4226854455 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3210960978 0 0) 0x7f75fc003530 con 0x7f76180aefa0 2024-04-25T09:11:29.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.958+0000 7f761dc00640 1 -- 172.21.15.173:0/4226854455 >> v1:172.21.15.194:6789/0 conn(0x7f76180b3e70 legacy=0x7f76180b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.958+0000 7f761dc00640 1 -- 172.21.15.173:0/4226854455 >> v1:172.21.15.173:6789/0 conn(0x7f76180aefa0 legacy=0x7f76180cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.958+0000 7f761dc00640 1 -- 172.21.15.173:0/4226854455 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f761806d700 con 0x7f761815edd0 2024-04-25T09:11:29.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.958+0000 7f761dc00640 1 --2- 172.21.15.173:0/4226854455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f761815edd0 0x7f76180cdeb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f76100097c0 tx=0x7f761001c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aaf9b4ab33bb8b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:29.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f7617400640 1 -- 172.21.15.173:0/4226854455 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76100b0070 con 0x7f761815edd0 2024-04-25T09:11:29.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f7617400640 1 -- 172.21.15.173:0/4226854455 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76100ab400 con 0x7f761815edd0 2024-04-25T09:11:29.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f7617400640 1 -- 172.21.15.173:0/4226854455 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604001680 con 0x7f761815edd0 2024-04-25T09:11:29.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761fc00640 1 -- 172.21.15.173:0/4226854455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f761815edd0 msgr2=0x7f76180cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761fc00640 1 --2- 172.21.15.173:0/4226854455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f761815edd0 0x7f76180cdeb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f76100097c0 tx=0x7f761001c390 comp rx=0 tx=0).stop 2024-04-25T09:11:29.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761fc00640 1 -- 172.21.15.173:0/4226854455 shutdown_connections 2024-04-25T09:11:29.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761fc00640 1 --2- 172.21.15.173:0/4226854455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f761815edd0 0x7f76180cdeb0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761fc00640 1 -- 172.21.15.173:0/4226854455 >> 172.21.15.173:0/4226854455 conn(0x7f761806ac90 msgr2=0x7f761806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:29.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761fc00640 1 -- 172.21.15.173:0/4226854455 shutdown_connections 2024-04-25T09:11:29.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761fc00640 1 -- 172.21.15.173:0/4226854455 wait complete. 2024-04-25T09:11:29.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761fc00640 1 Processor -- start 2024-04-25T09:11:29.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761fc00640 1 -- start start 2024-04-25T09:11:29.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761fc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76180aefa0 0x7f761814cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761fc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76180b3e70 0x7f7618158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761fc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f761815edd0 0x7f7618158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761fc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761806e340 con 0x7f76180aefa0 2024-04-25T09:11:29.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761fc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761806e1c0 con 0x7f76180b3e70 2024-04-25T09:11:29.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761fc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7618168fd0 con 0x7f761815edd0 2024-04-25T09:11:29.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76180aefa0 0x7f761814cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76180aefa0 0x7f761814cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36736/0 (socket says 172.21.15.173:36736) 2024-04-25T09:11:29.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761d200640 1 -- 172.21.15.173:0/2212183103 learned_addr learned my addr 172.21.15.173:0/2212183103 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:29.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f7617e00640 1 --2- 172.21.15.173:0/2212183103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76180b3e70 0x7f7618158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761d200640 1 -- 172.21.15.173:0/2212183103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f761815edd0 msgr2=0x7f7618158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761d200640 1 --2- 172.21.15.173:0/2212183103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f761815edd0 0x7f7618158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.962+0000 7f761d200640 1 -- 172.21.15.173:0/2212183103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76180b3e70 msgr2=0x7f7618158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.966+0000 7f761d200640 1 --2- 172.21.15.173:0/2212183103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76180b3e70 0x7f7618158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.966+0000 7f761d200640 1 -- 172.21.15.173:0/2212183103 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76180b14f0 con 0x7f76180aefa0 2024-04-25T09:11:29.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.966+0000 7f7617e00640 1 --2- 172.21.15.173:0/2212183103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76180b3e70 0x7f7618158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:29.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.966+0000 7f761d200640 1 --2- 172.21.15.173:0/2212183103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76180aefa0 0x7f761814cd80 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f760800c7a0 tx=0x7f760800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:29.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.966+0000 7f7614c00640 1 -- 172.21.15.173:0/2212183103 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608003b80 con 0x7f76180aefa0 2024-04-25T09:11:29.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.966+0000 7f7614c00640 1 -- 172.21.15.173:0/2212183103 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7608003d40 con 0x7f76180aefa0 2024-04-25T09:11:29.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.966+0000 7f7614c00640 1 -- 172.21.15.173:0/2212183103 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760800aa90 con 0x7f76180aefa0 2024-04-25T09:11:29.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.966+0000 7f761fc00640 1 -- 172.21.15.173:0/2212183103 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76180b17d0 con 0x7f76180aefa0 2024-04-25T09:11:29.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.966+0000 7f761fc00640 1 -- 172.21.15.173:0/2212183103 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76180b1d90 con 0x7f76180aefa0 2024-04-25T09:11:29.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.966+0000 7f761fc00640 1 -- 172.21.15.173:0/2212183103 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7618073a40 con 0x7f76180aefa0 2024-04-25T09:11:29.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.966+0000 7f7614c00640 1 -- 172.21.15.173:0/2212183103 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f760800ac30 con 0x7f76180aefa0 2024-04-25T09:11:29.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.966+0000 7f7614c00640 1 --2- 172.21.15.173:0/2212183103 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f75f8066f60 0x7f75f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.966+0000 7f7614c00640 1 -- 172.21.15.173:0/2212183103 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7608085170 con 0x7f76180aefa0 2024-04-25T09:11:29.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.966+0000 7f7617e00640 1 --2- 172.21.15.173:0/2212183103 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f75f8066f60 0x7f75f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.970+0000 7f7617e00640 1 --2- 172.21.15.173:0/2212183103 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f75f8066f60 0x7f75f8069420 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f76040011f0 tx=0x7f7604009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:29.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:29.970+0000 7f7614c00640 1 -- 172.21.15.173:0/2212183103 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7608055f60 con 0x7f76180aefa0 2024-04-25T09:11:30.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.162+0000 7f761fc00640 1 -- 172.21.15.173:0/2212183103 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f761806e540 con 0x7f76180aefa0 2024-04-25T09:11:30.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.162+0000 7f7614c00640 1 -- 172.21.15.173:0/2212183103 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f7608055860 con 0x7f76180aefa0 2024-04-25T09:11:30.147 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:30.147 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1021410995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1021410995},{"type":"v1","addr":"172.21.15.194:6834","nonce":1021410995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2198134208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2198134208},{"type":"v1","addr":"172.21.15.194:6835","nonce":2198134208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8772,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/684989574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":684989574},{"type":"v1","addr":"172.21.15.173:6836","nonce":684989574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:26.148874+0000","modified":"2024-04-25T09:11:29.164422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8775":{"gid":8775,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/671971539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":671971539},{"type":"v1","addr":"172.21.15.173:6837","nonce":671971539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:11:30.147 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 81 2024-04-25T09:11:30.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.162+0000 7f761fc00640 1 -- 172.21.15.173:0/2212183103 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f75f8066f60 msgr2=0x7f75f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.162+0000 7f761fc00640 1 --2- 172.21.15.173:0/2212183103 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f75f8066f60 0x7f75f8069420 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f76040011f0 tx=0x7f7604009040 comp rx=0 tx=0).stop 2024-04-25T09:11:30.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.162+0000 7f761fc00640 1 -- 172.21.15.173:0/2212183103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76180aefa0 msgr2=0x7f761814cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.162+0000 7f761fc00640 1 --2- 172.21.15.173:0/2212183103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76180aefa0 0x7f761814cd80 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f760800c7a0 tx=0x7f760800cc60 comp rx=0 tx=0).stop 2024-04-25T09:11:30.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.162+0000 7f761fc00640 1 -- 172.21.15.173:0/2212183103 shutdown_connections 2024-04-25T09:11:30.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.162+0000 7f761fc00640 1 --2- 172.21.15.173:0/2212183103 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f75f8066f60 0x7f75f8069420 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.162+0000 7f761fc00640 1 --2- 172.21.15.173:0/2212183103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f761815edd0 0x7f7618158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.162+0000 7f761fc00640 1 --2- 172.21.15.173:0/2212183103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76180b3e70 0x7f7618158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.162+0000 7f761fc00640 1 --2- 172.21.15.173:0/2212183103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76180aefa0 0x7f761814cd80 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.162+0000 7f761fc00640 1 -- 172.21.15.173:0/2212183103 >> 172.21.15.173:0/2212183103 conn(0x7f761806ac90 msgr2=0x7f76180b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:30.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.162+0000 7f761fc00640 1 -- 172.21.15.173:0/2212183103 shutdown_connections 2024-04-25T09:11:30.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.162+0000 7f761fc00640 1 -- 172.21.15.173:0/2212183103 wait complete. 2024-04-25T09:11:30.169 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:30.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.318+0000 7fc542600640 1 Processor -- start 2024-04-25T09:11:30.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.318+0000 7fc542600640 1 -- start start 2024-04-25T09:11:30.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.318+0000 7fc542600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc53c159380 0x7fc53c15bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.318+0000 7fc542600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc53c0ccc20 0x7fc53c0cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.318+0000 7fc542600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53c159760 con 0x7fc53c15c260 2024-04-25T09:11:30.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.322+0000 7fc542600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53c15ccc0 con 0x7fc53c159380 2024-04-25T09:11:30.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.322+0000 7fc542600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c15c700 con 0x7fc53c0ccc20 2024-04-25T09:11:30.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.322+0000 7fc541200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc53c159380 0x7fc53c15bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.322+0000 7fc541200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc53c159380 0x7fc53c15bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36752/0 (socket says 172.21.15.173:36752) 2024-04-25T09:11:30.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.322+0000 7fc541200640 1 -- 172.21.15.173:0/1894456201 learned_addr learned my addr 172.21.15.173:0/1894456201 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:30.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.322+0000 7fc533e00640 1 --2- 172.21.15.173:0/1894456201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc53c0ccc20 0x7fc53c0cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.322+0000 7fc541200640 1 -- 172.21.15.173:0/1894456201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc53c0ccc20 msgr2=0x7fc53c0cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:30.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.322+0000 7fc541200640 1 --2- 172.21.15.173:0/1894456201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc53c0ccc20 0x7fc53c0cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.322+0000 7fc541200640 1 -- 172.21.15.173:0/1894456201 >> v1:172.21.15.194:6789/0 conn(0x7fc53c15c260 legacy=0x7fc53c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:30.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.322+0000 7fc541200640 1 -- 172.21.15.173:0/1894456201 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c15c9e0 con 0x7fc53c159380 2024-04-25T09:11:30.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.322+0000 7fc541200640 1 --2- 172.21.15.173:0/1894456201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc53c159380 0x7fc53c15bd20 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fc52c009870 tx=0x7fc52c01c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f436703cf32f7545 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:30.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.322+0000 7fc53be00640 1 -- 172.21.15.173:0/1894456201 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c0b0070 con 0x7fc53c159380 2024-04-25T09:11:30.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.322+0000 7fc53be00640 1 -- 172.21.15.173:0/1894456201 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c0ab600 con 0x7fc53c159380 2024-04-25T09:11:30.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.322+0000 7fc53be00640 1 -- 172.21.15.173:0/1894456201 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c0ab9d0 con 0x7fc53c159380 2024-04-25T09:11:30.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc542600640 1 -- 172.21.15.173:0/1894456201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc53c159380 msgr2=0x7fc53c15bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc542600640 1 --2- 172.21.15.173:0/1894456201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc53c159380 0x7fc53c15bd20 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fc52c009870 tx=0x7fc52c01c2b0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc542600640 1 -- 172.21.15.173:0/1894456201 shutdown_connections 2024-04-25T09:11:30.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc542600640 1 --2- 172.21.15.173:0/1894456201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc53c0ccc20 0x7fc53c0cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc542600640 1 --2- 172.21.15.173:0/1894456201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc53c159380 0x7fc53c15bd20 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc542600640 1 -- 172.21.15.173:0/1894456201 >> 172.21.15.173:0/1894456201 conn(0x7fc53c0726a0 msgr2=0x7fc53c099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:30.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc542600640 1 -- 172.21.15.173:0/1894456201 shutdown_connections 2024-04-25T09:11:30.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc542600640 1 -- 172.21.15.173:0/1894456201 wait complete. 2024-04-25T09:11:30.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc542600640 1 Processor -- start 2024-04-25T09:11:30.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc542600640 1 -- start start 2024-04-25T09:11:30.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc542600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc53c159380 0x7fc53c151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc542600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc53c15c260 0x7fc53c158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc542600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc53c0c75e0 0x7fc53c0c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc542600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c168a40 con 0x7fc53c15c260 2024-04-25T09:11:30.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc542600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c1688c0 con 0x7fc53c159380 2024-04-25T09:11:30.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc542600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c168bc0 con 0x7fc53c0c75e0 2024-04-25T09:11:30.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc533e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc53c15c260 0x7fc53c158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc533e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc53c15c260 0x7fc53c158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36766/0 (socket says 172.21.15.173:36766) 2024-04-25T09:11:30.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc533e00640 1 -- 172.21.15.173:0/731294923 learned_addr learned my addr 172.21.15.173:0/731294923 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:30.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc541200640 1 --2- 172.21.15.173:0/731294923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc53c159380 0x7fc53c151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc541c00640 1 --2- 172.21.15.173:0/731294923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc53c0c75e0 0x7fc53c0c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc533e00640 1 -- 172.21.15.173:0/731294923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc53c0c75e0 msgr2=0x7fc53c0c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc533e00640 1 --2- 172.21.15.173:0/731294923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc53c0c75e0 0x7fc53c0c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc533e00640 1 -- 172.21.15.173:0/731294923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc53c159380 msgr2=0x7fc53c151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc533e00640 1 --2- 172.21.15.173:0/731294923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc53c159380 0x7fc53c151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.326+0000 7fc533e00640 1 -- 172.21.15.173:0/731294923 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c0c7a70 con 0x7fc53c15c260 2024-04-25T09:11:30.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.330+0000 7fc533e00640 1 --2- 172.21.15.173:0/731294923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc53c15c260 0x7fc53c158d10 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fc52400d5f0 tx=0x7fc52400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:30.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.330+0000 7fc539600640 1 -- 172.21.15.173:0/731294923 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5240125f0 con 0x7fc53c15c260 2024-04-25T09:11:30.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.330+0000 7fc539600640 1 -- 172.21.15.173:0/731294923 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc524019070 con 0x7fc53c15c260 2024-04-25T09:11:30.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.330+0000 7fc539600640 1 -- 172.21.15.173:0/731294923 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5240129b0 con 0x7fc53c15c260 2024-04-25T09:11:30.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.330+0000 7fc542600640 1 -- 172.21.15.173:0/731294923 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53c0c7d10 con 0x7fc53c15c260 2024-04-25T09:11:30.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.330+0000 7fc542600640 1 -- 172.21.15.173:0/731294923 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53c0c82d0 con 0x7fc53c15c260 2024-04-25T09:11:30.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.330+0000 7fc542600640 1 -- 172.21.15.173:0/731294923 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53c073a40 con 0x7fc53c15c260 2024-04-25T09:11:30.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.330+0000 7fc539600640 1 -- 172.21.15.173:0/731294923 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc524012b50 con 0x7fc53c15c260 2024-04-25T09:11:30.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.330+0000 7fc539600640 1 --2- 172.21.15.173:0/731294923 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc518066f90 0x7fc518069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.330+0000 7fc539600640 1 -- 172.21.15.173:0/731294923 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc524085410 con 0x7fc53c15c260 2024-04-25T09:11:30.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.334+0000 7fc541200640 1 --2- 172.21.15.173:0/731294923 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc518066f90 0x7fc518069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.334+0000 7fc541200640 1 --2- 172.21.15.173:0/731294923 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc518066f90 0x7fc518069450 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0ad000 tx=0x7fc52c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:30.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.334+0000 7fc539600640 1 -- 172.21.15.173:0/731294923 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc524055c30 con 0x7fc53c15c260 2024-04-25T09:11:30.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.490+0000 7fc542600640 1 -- 172.21.15.173:0/731294923 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc53c0cd060 con 0x7fc53c15c260 2024-04-25T09:11:30.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.490+0000 7fc539600640 1 -- 172.21.15.173:0/731294923 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+17012 (secure 0 0 0) 0x7fc524059cd0 con 0x7fc53c15c260 2024-04-25T09:11:30.477 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:30.478 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":122,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:11:27.763236+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:11:24.499900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T09:11:25.140140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:30.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.494+0000 7fc542600640 1 -- 172.21.15.173:0/731294923 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc518066f90 msgr2=0x7fc518069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.494+0000 7fc542600640 1 --2- 172.21.15.173:0/731294923 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc518066f90 0x7fc518069450 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0ad000 tx=0x7fc52c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:11:30.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.494+0000 7fc542600640 1 -- 172.21.15.173:0/731294923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc53c15c260 msgr2=0x7fc53c158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.494+0000 7fc542600640 1 --2- 172.21.15.173:0/731294923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc53c15c260 0x7fc53c158d10 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fc52400d5f0 tx=0x7fc52400dab0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.494+0000 7fc542600640 1 -- 172.21.15.173:0/731294923 shutdown_connections 2024-04-25T09:11:30.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.494+0000 7fc542600640 1 --2- 172.21.15.173:0/731294923 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc518066f90 0x7fc518069450 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.494+0000 7fc542600640 1 --2- 172.21.15.173:0/731294923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc53c0c75e0 0x7fc53c0c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.494+0000 7fc542600640 1 --2- 172.21.15.173:0/731294923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc53c15c260 0x7fc53c158d10 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.494+0000 7fc542600640 1 --2- 172.21.15.173:0/731294923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc53c159380 0x7fc53c151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.494+0000 7fc542600640 1 -- 172.21.15.173:0/731294923 >> 172.21.15.173:0/731294923 conn(0x7fc53c0726a0 msgr2=0x7fc53c15cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:30.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.494+0000 7fc542600640 1 -- 172.21.15.173:0/731294923 shutdown_connections 2024-04-25T09:11:30.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.494+0000 7fc542600640 1 -- 172.21.15.173:0/731294923 wait complete. 2024-04-25T09:11:30.499 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:11:30.499 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:11:30.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.650+0000 7fe46be00640 1 Processor -- start 2024-04-25T09:11:30.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.650+0000 7fe46be00640 1 -- start start 2024-04-25T09:11:30.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.650+0000 7fe46be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe46c0b4930 0x7fe46c161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.650+0000 7fe46be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe46c06df90 0x7fe46c06e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.650+0000 7fe46be00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe46c0b2ee0 con 0x7fe46c15dc90 2024-04-25T09:11:30.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.650+0000 7fe46be00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe46c06db00 con 0x7fe46c0b4930 2024-04-25T09:11:30.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.650+0000 7fe46be00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe46c0b50c0 con 0x7fe46c06df90 2024-04-25T09:11:30.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.650+0000 7fe462000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe46c0b4930 0x7fe46c161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.650+0000 7fe462000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe46c0b4930 0x7fe46c161d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36768/0 (socket says 172.21.15.173:36768) 2024-04-25T09:11:30.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.650+0000 7fe462000640 1 -- 172.21.15.173:0/1535819532 learned_addr learned my addr 172.21.15.173:0/1535819532 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:30.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.654+0000 7fe462000640 1 -- 172.21.15.173:0/1535819532 >> v2:172.21.15.194:3300/0 conn(0x7fe46c06df90 msgr2=0x7fe46c06e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:30.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.654+0000 7fe46b400640 1 --2- 172.21.15.173:0/1535819532 >> v2:172.21.15.194:3300/0 conn(0x7fe46c06df90 0x7fe46c06e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.654+0000 7fe462000640 1 --2- 172.21.15.173:0/1535819532 >> v2:172.21.15.194:3300/0 conn(0x7fe46c06df90 0x7fe46c06e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.654+0000 7fe462000640 1 -- 172.21.15.173:0/1535819532 >> v1:172.21.15.194:6789/0 conn(0x7fe46c15dc90 legacy=0x7fe46c161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:30.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.654+0000 7fe462000640 1 -- 172.21.15.173:0/1535819532 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c0b31c0 con 0x7fe46c0b4930 2024-04-25T09:11:30.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.654+0000 7fe46b400640 1 --2- 172.21.15.173:0/1535819532 >> v2:172.21.15.194:3300/0 conn(0x7fe46c06df90 0x7fe46c06e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:30.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.654+0000 7fe462000640 1 --2- 172.21.15.173:0/1535819532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe46c0b4930 0x7fe46c161d70 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fe46c06c870 tx=0x7fe45401ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde3da2c1c84f866 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:30.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.654+0000 7fe46a000640 1 -- 172.21.15.173:0/1535819532 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4540b2070 con 0x7fe46c0b4930 2024-04-25T09:11:30.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.654+0000 7fe46a000640 1 -- 172.21.15.173:0/1535819532 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4540a9070 con 0x7fe46c0b4930 2024-04-25T09:11:30.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.654+0000 7fe46a000640 1 -- 172.21.15.173:0/1535819532 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4540ad880 con 0x7fe46c0b4930 2024-04-25T09:11:30.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.654+0000 7fe46be00640 1 -- 172.21.15.173:0/1535819532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe46c0b4930 msgr2=0x7fe46c161d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.654+0000 7fe46be00640 1 --2- 172.21.15.173:0/1535819532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe46c0b4930 0x7fe46c161d70 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fe46c06c870 tx=0x7fe45401ceb0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46be00640 1 -- 172.21.15.173:0/1535819532 shutdown_connections 2024-04-25T09:11:30.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46be00640 1 --2- 172.21.15.173:0/1535819532 >> v2:172.21.15.194:3300/0 conn(0x7fe46c06df90 0x7fe46c06e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46be00640 1 --2- 172.21.15.173:0/1535819532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe46c0b4930 0x7fe46c161d70 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46be00640 1 -- 172.21.15.173:0/1535819532 >> 172.21.15.173:0/1535819532 conn(0x7fe46c0cc800 msgr2=0x7fe46c0ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:30.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46be00640 1 -- 172.21.15.173:0/1535819532 shutdown_connections 2024-04-25T09:11:30.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46be00640 1 -- 172.21.15.173:0/1535819532 wait complete. 2024-04-25T09:11:30.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46be00640 1 Processor -- start 2024-04-25T09:11:30.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46be00640 1 -- start start 2024-04-25T09:11:30.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe46c06df90 0x7fe46c160a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe46c0b4930 0x7fe46c15cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe46c15dc90 0x7fe46c15e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46be00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c16a9a0 con 0x7fe46c15dc90 2024-04-25T09:11:30.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c1624c0 con 0x7fe46c06df90 2024-04-25T09:11:30.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c16ab20 con 0x7fe46c0b4930 2024-04-25T09:11:30.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe46c15dc90 0x7fe46c15e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe46c15dc90 0x7fe46c15e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36784/0 (socket says 172.21.15.173:36784) 2024-04-25T09:11:30.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46b400640 1 -- 172.21.15.173:0/2096384944 learned_addr learned my addr 172.21.15.173:0/2096384944 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:30.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46aa00640 1 --2- 172.21.15.173:0/2096384944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe46c06df90 0x7fe46c160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe462000640 1 --2- 172.21.15.173:0/2096384944 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe46c0b4930 0x7fe46c15cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46b400640 1 -- 172.21.15.173:0/2096384944 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe46c0b4930 msgr2=0x7fe46c15cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46b400640 1 --2- 172.21.15.173:0/2096384944 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe46c0b4930 0x7fe46c15cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46b400640 1 -- 172.21.15.173:0/2096384944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe46c06df90 msgr2=0x7fe46c160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46b400640 1 --2- 172.21.15.173:0/2096384944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe46c06df90 0x7fe46c160a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46b400640 1 -- 172.21.15.173:0/2096384944 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c160f70 con 0x7fe46c15dc90 2024-04-25T09:11:30.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46aa00640 1 --2- 172.21.15.173:0/2096384944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe46c06df90 0x7fe46c160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:30.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe462000640 1 --2- 172.21.15.173:0/2096384944 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe46c0b4930 0x7fe46c15cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:30.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46b400640 1 --2- 172.21.15.173:0/2096384944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe46c15dc90 0x7fe46c15e960 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fe46400cd80 tx=0x7fe46400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:30.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe463400640 1 -- 172.21.15.173:0/2096384944 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46400f680 con 0x7fe46c15dc90 2024-04-25T09:11:30.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe463400640 1 -- 172.21.15.173:0/2096384944 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46400f840 con 0x7fe46c15dc90 2024-04-25T09:11:30.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe46be00640 1 -- 172.21.15.173:0/2096384944 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe46c151930 con 0x7fe46c15dc90 2024-04-25T09:11:30.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.658+0000 7fe463400640 1 -- 172.21.15.173:0/2096384944 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46400fc30 con 0x7fe46c15dc90 2024-04-25T09:11:30.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.662+0000 7fe46be00640 1 -- 172.21.15.173:0/2096384944 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe46c151ef0 con 0x7fe46c15dc90 2024-04-25T09:11:30.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.662+0000 7fe46be00640 1 -- 172.21.15.173:0/2096384944 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46c1525b0 con 0x7fe46c15dc90 2024-04-25T09:11:30.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.662+0000 7fe463400640 1 -- 172.21.15.173:0/2096384944 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe4640213f0 con 0x7fe46c15dc90 2024-04-25T09:11:30.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.662+0000 7fe463400640 1 --2- 172.21.15.173:0/2096384944 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe448066f60 0x7fe448069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.662+0000 7fe463400640 1 -- 172.21.15.173:0/2096384944 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe464085fd0 con 0x7fe46c15dc90 2024-04-25T09:11:30.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.662+0000 7fe46aa00640 1 --2- 172.21.15.173:0/2096384944 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe448066f60 0x7fe448069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.662+0000 7fe46aa00640 1 --2- 172.21.15.173:0/2096384944 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe448066f60 0x7fe448069420 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe45c003ec0 tx=0x7fe45c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:30.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.666+0000 7fe463400640 1 -- 172.21.15.173:0/2096384944 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe46c1525b0 con 0x7fe46c15dc90 2024-04-25T09:11:30.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.822+0000 7fe46be00640 1 -- 172.21.15.173:0/2096384944 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe46c073a40 con 0x7fe448066f60 2024-04-25T09:11:30.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.826+0000 7fe463400640 1 -- 172.21.15.173:0/2096384944 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+240531 (secure 0 0 0) 0x7fe45c053bb0 con 0x7fe448066f60 2024-04-25T09:11:30.815 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:30.816 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:11:30.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.830+0000 7fe46be00640 1 -- 172.21.15.173:0/2096384944 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe448066f60 msgr2=0x7fe448069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.830+0000 7fe46be00640 1 --2- 172.21.15.173:0/2096384944 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe448066f60 0x7fe448069420 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe45c003ec0 tx=0x7fe45c009040 comp rx=0 tx=0).stop 2024-04-25T09:11:30.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.830+0000 7fe46be00640 1 -- 172.21.15.173:0/2096384944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe46c15dc90 msgr2=0x7fe46c15e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.830+0000 7fe46be00640 1 --2- 172.21.15.173:0/2096384944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe46c15dc90 0x7fe46c15e960 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fe46400cd80 tx=0x7fe46400a650 comp rx=0 tx=0).stop 2024-04-25T09:11:30.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.830+0000 7fe46be00640 1 -- 172.21.15.173:0/2096384944 shutdown_connections 2024-04-25T09:11:30.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.830+0000 7fe46be00640 1 --2- 172.21.15.173:0/2096384944 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe448066f60 0x7fe448069420 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.830+0000 7fe46be00640 1 --2- 172.21.15.173:0/2096384944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe46c15dc90 0x7fe46c15e960 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.830+0000 7fe46be00640 1 --2- 172.21.15.173:0/2096384944 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe46c0b4930 0x7fe46c15cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.830+0000 7fe46be00640 1 --2- 172.21.15.173:0/2096384944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe46c06df90 0x7fe46c160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.830+0000 7fe46be00640 1 -- 172.21.15.173:0/2096384944 >> 172.21.15.173:0/2096384944 conn(0x7fe46c0cc800 msgr2=0x7fe46c06fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:30.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.830+0000 7fe46be00640 1 -- 172.21.15.173:0/2096384944 shutdown_connections 2024-04-25T09:11:30.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:30.830+0000 7fe46be00640 1 -- 172.21.15.173:0/2096384944 wait complete. 2024-04-25T09:11:30.838 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":381,"stamp":"2024-04-25T09:11:28.841351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":42,"acting":42,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":423128,"kb_used_data":12620,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754551592,"statfs":{"total":773094113280,"available":772660830208,"internally_reserved":0,"allocated":12922880,"data_stored":6614829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.088418"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.788996+0000","last_change":"2024-04-25T09:11:26.784135+0000","last_active":"2024-04-25T09:11:26.788996+0000","last_peered":"2024-04-25T09:11:26.788996+0000","last_clean":"2024-04-25T09:11:26.788996+0000","last_became_active":"2024-04-25T09:11:26.783850+0000","last_became_peered":"2024-04-25T09:11:26.783850+0000","last_unstale":"2024-04-25T09:11:26.788996+0000","last_undegraded":"2024-04-25T09:11:26.788996+0000","last_fullsized":"2024-04-25T09:11:26.788996+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:30.057861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":3,"reported_epoch":121,"state":"creating+activating","last_fresh":"2024-04-25T09:11:26.777365+0000","last_change":"2024-04-25T09:11:26.777365+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:26.777365+0000","last_undegraded":"2024-04-25T09:11:26.777365+0000","last_fullsized":"2024-04-25T09:11:26.777365+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.795822+0000","last_change":"2024-04-25T09:11:26.791381+0000","last_active":"2024-04-25T09:11:26.795822+0000","last_peered":"2024-04-25T09:11:26.795822+0000","last_clean":"2024-04-25T09:11:26.795822+0000","last_became_active":"2024-04-25T09:11:26.789379+0000","last_became_peered":"2024-04-25T09:11:26.789379+0000","last_unstale":"2024-04-25T09:11:26.795822+0000","last_undegraded":"2024-04-25T09:11:26.795822+0000","last_fullsized":"2024-04-25T09:11:26.795822+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:27.017599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.795392+0000","last_change":"2024-04-25T09:11:26.793939+0000","last_active":"2024-04-25T09:11:26.795392+0000","last_peered":"2024-04-25T09:11:26.795392+0000","last_clean":"2024-04-25T09:11:26.795392+0000","last_became_active":"2024-04-25T09:11:26.792032+0000","last_became_peered":"2024-04-25T09:11:26.792032+0000","last_unstale":"2024-04-25T09:11:26.795392+0000","last_undegraded":"2024-04-25T09:11:26.795392+0000","last_fullsized":"2024-04-25T09:11:26.795392+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:07.110094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.801768+0000","last_change":"2024-04-25T09:11:26.801768+0000","last_active":"2024-04-25T09:11:26.801768+0000","last_peered":"2024-04-25T09:11:26.801768+0000","last_clean":"2024-04-25T09:11:26.801768+0000","last_became_active":"2024-04-25T09:11:26.801480+0000","last_became_peered":"2024-04-25T09:11:26.801480+0000","last_unstale":"2024-04-25T09:11:26.801768+0000","last_undegraded":"2024-04-25T09:11:26.801768+0000","last_fullsized":"2024-04-25T09:11:26.801768+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:10.217192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.797781+0000","last_change":"2024-04-25T09:11:26.792420+0000","last_active":"2024-04-25T09:11:26.797781+0000","last_peered":"2024-04-25T09:11:26.797781+0000","last_clean":"2024-04-25T09:11:26.797781+0000","last_became_active":"2024-04-25T09:11:26.792149+0000","last_became_peered":"2024-04-25T09:11:26.792149+0000","last_unstale":"2024-04-25T09:11:26.797781+0000","last_undegraded":"2024-04-25T09:11:26.797781+0000","last_fullsized":"2024-04-25T09:11:26.797781+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:35.433281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.806525+0000","last_change":"2024-04-25T09:11:26.805666+0000","last_active":"2024-04-25T09:11:26.806525+0000","last_peered":"2024-04-25T09:11:26.806525+0000","last_clean":"2024-04-25T09:11:26.806525+0000","last_became_active":"2024-04-25T09:11:26.805395+0000","last_became_peered":"2024-04-25T09:11:26.805395+0000","last_unstale":"2024-04-25T09:11:26.806525+0000","last_undegraded":"2024-04-25T09:11:26.806525+0000","last_fullsized":"2024-04-25T09:11:26.806525+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:50.859865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"121'2","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.798594+0000","last_change":"2024-04-25T09:11:25.788687+0000","last_active":"2024-04-25T09:11:26.798594+0000","last_peered":"2024-04-25T09:11:26.798594+0000","last_clean":"2024-04-25T09:11:26.798594+0000","last_became_active":"2024-04-25T09:11:25.788408+0000","last_became_peered":"2024-04-25T09:11:25.788408+0000","last_unstale":"2024-04-25T09:11:26.798594+0000","last_undegraded":"2024-04-25T09:11:26.798594+0000","last_fullsized":"2024-04-25T09:11:26.798594+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:29.964854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.798002+0000","last_change":"2024-04-25T09:11:26.797141+0000","last_active":"2024-04-25T09:11:26.798002+0000","last_peered":"2024-04-25T09:11:26.798002+0000","last_clean":"2024-04-25T09:11:26.798002+0000","last_became_active":"2024-04-25T09:11:26.796854+0000","last_became_peered":"2024-04-25T09:11:26.796854+0000","last_unstale":"2024-04-25T09:11:26.798002+0000","last_undegraded":"2024-04-25T09:11:26.798002+0000","last_fullsized":"2024-04-25T09:11:26.798002+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:56.161415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.791967+0000","last_change":"2024-04-25T09:11:26.789683+0000","last_active":"2024-04-25T09:11:26.791967+0000","last_peered":"2024-04-25T09:11:26.791967+0000","last_clean":"2024-04-25T09:11:26.791967+0000","last_became_active":"2024-04-25T09:11:26.788459+0000","last_became_peered":"2024-04-25T09:11:26.788459+0000","last_unstale":"2024-04-25T09:11:26.791967+0000","last_undegraded":"2024-04-25T09:11:26.791967+0000","last_fullsized":"2024-04-25T09:11:26.791967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:19.898515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"121'2","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.793939+0000","last_change":"2024-04-25T09:11:25.792534+0000","last_active":"2024-04-25T09:11:26.793939+0000","last_peered":"2024-04-25T09:11:26.793939+0000","last_clean":"2024-04-25T09:11:26.793939+0000","last_became_active":"2024-04-25T09:11:25.792008+0000","last_became_peered":"2024-04-25T09:11:25.792008+0000","last_unstale":"2024-04-25T09:11:26.793939+0000","last_undegraded":"2024-04-25T09:11:26.793939+0000","last_fullsized":"2024-04-25T09:11:26.793939+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:22.627378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"121'1","reported_seq":13,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.796640+0000","last_change":"2024-04-25T09:11:25.789177+0000","last_active":"2024-04-25T09:11:26.796640+0000","last_peered":"2024-04-25T09:11:26.796640+0000","last_clean":"2024-04-25T09:11:26.796640+0000","last_became_active":"2024-04-25T09:11:25.788356+0000","last_became_peered":"2024-04-25T09:11:25.788356+0000","last_unstale":"2024-04-25T09:11:26.796640+0000","last_undegraded":"2024-04-25T09:11:26.796640+0000","last_fullsized":"2024-04-25T09:11:26.796640+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:06.193412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.776625+0000","last_change":"2024-04-25T09:11:25.791795+0000","last_active":"2024-04-25T09:11:26.776625+0000","last_peered":"2024-04-25T09:11:26.776625+0000","last_clean":"2024-04-25T09:11:26.776625+0000","last_became_active":"2024-04-25T09:11:25.791461+0000","last_became_peered":"2024-04-25T09:11:25.791461+0000","last_unstale":"2024-04-25T09:11:26.776625+0000","last_undegraded":"2024-04-25T09:11:26.776625+0000","last_fullsized":"2024-04-25T09:11:26.776625+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:09.144966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.774149+0000","last_change":"2024-04-25T09:11:25.783997+0000","last_active":"2024-04-25T09:11:26.774149+0000","last_peered":"2024-04-25T09:11:26.774149+0000","last_clean":"2024-04-25T09:11:26.774149+0000","last_became_active":"2024-04-25T09:11:25.783674+0000","last_became_peered":"2024-04-25T09:11:25.783674+0000","last_unstale":"2024-04-25T09:11:26.774149+0000","last_undegraded":"2024-04-25T09:11:26.774149+0000","last_fullsized":"2024-04-25T09:11:26.774149+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:53.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.773587+0000","last_change":"2024-04-25T09:11:25.786145+0000","last_active":"2024-04-25T09:11:26.773587+0000","last_peered":"2024-04-25T09:11:26.773587+0000","last_clean":"2024-04-25T09:11:26.773587+0000","last_became_active":"2024-04-25T09:11:25.785877+0000","last_became_peered":"2024-04-25T09:11:25.785877+0000","last_unstale":"2024-04-25T09:11:26.773587+0000","last_undegraded":"2024-04-25T09:11:26.773587+0000","last_fullsized":"2024-04-25T09:11:26.773587+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:46.425507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.791979+0000","last_change":"2024-04-25T09:11:26.786960+0000","last_active":"2024-04-25T09:11:26.791979+0000","last_peered":"2024-04-25T09:11:26.791979+0000","last_clean":"2024-04-25T09:11:26.791979+0000","last_became_active":"2024-04-25T09:11:26.785791+0000","last_became_peered":"2024-04-25T09:11:26.785791+0000","last_unstale":"2024-04-25T09:11:26.791979+0000","last_undegraded":"2024-04-25T09:11:26.791979+0000","last_fullsized":"2024-04-25T09:11:26.791979+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:04.305239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.793418+0000","last_change":"2024-04-25T09:11:26.790380+0000","last_active":"2024-04-25T09:11:26.793418+0000","last_peered":"2024-04-25T09:11:26.793418+0000","last_clean":"2024-04-25T09:11:26.793418+0000","last_became_active":"2024-04-25T09:11:26.790013+0000","last_became_peered":"2024-04-25T09:11:26.790013+0000","last_unstale":"2024-04-25T09:11:26.793418+0000","last_undegraded":"2024-04-25T09:11:26.793418+0000","last_fullsized":"2024-04-25T09:11:26.793418+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:49.531791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.788832+0000","last_change":"2024-04-25T09:11:26.781923+0000","last_active":"2024-04-25T09:11:26.788832+0000","last_peered":"2024-04-25T09:11:26.788832+0000","last_clean":"2024-04-25T09:11:26.788832+0000","last_became_active":"2024-04-25T09:11:26.780479+0000","last_became_peered":"2024-04-25T09:11:26.780479+0000","last_unstale":"2024-04-25T09:11:26.788832+0000","last_undegraded":"2024-04-25T09:11:26.788832+0000","last_fullsized":"2024-04-25T09:11:26.788832+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:55.473718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:25.752627+0000","last_change":"2024-04-25T09:11:25.752627+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:25.752627+0000","last_undegraded":"2024-04-25T09:11:25.752627+0000","last_fullsized":"2024-04-25T09:11:25.752627+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.773757+0000","last_change":"2024-04-25T09:11:25.780949+0000","last_active":"2024-04-25T09:11:26.773757+0000","last_peered":"2024-04-25T09:11:26.773757+0000","last_clean":"2024-04-25T09:11:26.773757+0000","last_became_active":"2024-04-25T09:11:25.780664+0000","last_became_peered":"2024-04-25T09:11:25.780664+0000","last_unstale":"2024-04-25T09:11:26.773757+0000","last_undegraded":"2024-04-25T09:11:26.773757+0000","last_fullsized":"2024-04-25T09:11:26.773757+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:52.742093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.795608+0000","last_change":"2024-04-25T09:11:26.793502+0000","last_active":"2024-04-25T09:11:26.795608+0000","last_peered":"2024-04-25T09:11:26.795608+0000","last_clean":"2024-04-25T09:11:26.795608+0000","last_became_active":"2024-04-25T09:11:26.792794+0000","last_became_peered":"2024-04-25T09:11:26.792794+0000","last_unstale":"2024-04-25T09:11:26.795608+0000","last_undegraded":"2024-04-25T09:11:26.795608+0000","last_fullsized":"2024-04-25T09:11:26.795608+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:40.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:11:24.750156+0000","last_change":"2024-04-25T09:11:24.750156+0000","last_active":"2024-04-25T09:11:24.750156+0000","last_peered":"2024-04-25T09:11:24.750156+0000","last_clean":"2024-04-25T09:11:24.750156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:24.750156+0000","last_undegraded":"2024-04-25T09:11:24.750156+0000","last_fullsized":"2024-04-25T09:11:24.750156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":354,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.773820+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:11:26.773820+0000","last_peered":"2024-04-25T09:11:26.773820+0000","last_clean":"2024-04-25T09:11:26.773820+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:11:26.773820+0000","last_undegraded":"2024-04-25T09:11:26.773820+0000","last_fullsized":"2024-04-25T09:11:26.773820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":2},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":14,"acting":14,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50664,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321176,"statfs":{"total":96636764160,"available":96584884224,"internally_reserved":0,"allocated":1462272,"data_stored":676509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46504,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325336,"statfs":{"total":96636764160,"available":96589144064,"internally_reserved":0,"allocated":1462272,"data_stored":676509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509549,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":58980,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312860,"statfs":{"total":96636764160,"available":96576368640,"internally_reserved":0,"allocated":1462272,"data_stored":676509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54812,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317028,"statfs":{"total":96636764160,"available":96580636672,"internally_reserved":0,"allocated":1449984,"data_stored":671060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509549,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54856,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316984,"statfs":{"total":96636764160,"available":96580591616,"internally_reserved":0,"allocated":1499136,"data_stored":696552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509549,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50660,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321180,"statfs":{"total":96636764160,"available":96584888320,"internally_reserved":0,"allocated":1462272,"data_stored":676509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509549,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55384,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316456,"statfs":{"total":96636764160,"available":96580050944,"internally_reserved":0,"allocated":2043904,"data_stored":1261428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574957,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51268,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320572,"statfs":{"total":96636764160,"available":96584265728,"internally_reserved":0,"allocated":2080768,"data_stored":1279753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:11:30.842 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:11:31.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.030+0000 7f2352400640 1 Processor -- start 2024-04-25T09:11:31.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.030+0000 7f2352400640 1 -- start start 2024-04-25T09:11:31.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.030+0000 7f2352400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f234c145250 0x7f234c15c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.030+0000 7f2352400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f234c0cc8b0 0x7f234c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.030+0000 7f2352400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f234c071320 0x7f234c071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.030+0000 7f2352400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234c15cec0 con 0x7f234c145250 2024-04-25T09:11:31.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.030+0000 7f2352400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234c06e7c0 con 0x7f234c071320 2024-04-25T09:11:31.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.030+0000 7f2352400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234c06d720 con 0x7f234c0cc8b0 2024-04-25T09:11:31.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.030+0000 7f234b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f234c145250 0x7f234c15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.030+0000 7f234b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f234c145250 0x7f234c15c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36800/0 (socket says 172.21.15.173:36800) 2024-04-25T09:11:31.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.030+0000 7f234b400640 1 -- 172.21.15.173:0/606904565 learned_addr learned my addr 172.21.15.173:0/606904565 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:31.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.030+0000 7f2342a00640 1 --2- 172.21.15.173:0/606904565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f234c0cc8b0 0x7f234c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.030+0000 7f234be00640 1 --2- 172.21.15.173:0/606904565 >> v2:172.21.15.194:3300/0 conn(0x7f234c071320 0x7f234c071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.034+0000 7f234b400640 1 -- 172.21.15.173:0/606904565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f234c0cc8b0 msgr2=0x7f234c0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:31.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.034+0000 7f234b400640 1 --2- 172.21.15.173:0/606904565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f234c0cc8b0 0x7f234c0ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.034+0000 7f234b400640 1 -- 172.21.15.173:0/606904565 >> v2:172.21.15.194:3300/0 conn(0x7f234c071320 msgr2=0x7f234c071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:31.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.034+0000 7f234b400640 1 --2- 172.21.15.173:0/606904565 >> v2:172.21.15.194:3300/0 conn(0x7f234c071320 0x7f234c071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.034+0000 7f234b400640 1 -- 172.21.15.173:0/606904565 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c06da00 con 0x7f234c145250 2024-04-25T09:11:31.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.034+0000 7f234b400640 1 --2- 172.21.15.173:0/606904565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f234c145250 0x7f234c15c980 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f234c0710e0 tx=0x7f233c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec649b55d0b1a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:31.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.034+0000 7f234aa00640 1 -- 172.21.15.173:0/606904565 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c0a5760 con 0x7f234c145250 2024-04-25T09:11:31.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.034+0000 7f234aa00640 1 -- 172.21.15.173:0/606904565 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c0a5900 con 0x7f234c145250 2024-04-25T09:11:31.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.034+0000 7f234aa00640 1 -- 172.21.15.173:0/606904565 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c0a5cd0 con 0x7f234c145250 2024-04-25T09:11:31.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.034+0000 7f2352400640 1 -- 172.21.15.173:0/606904565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f234c145250 msgr2=0x7f234c15c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.034+0000 7f2352400640 1 --2- 172.21.15.173:0/606904565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f234c145250 0x7f234c15c980 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f234c0710e0 tx=0x7f233c01c9f0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.034+0000 7f2352400640 1 -- 172.21.15.173:0/606904565 shutdown_connections 2024-04-25T09:11:31.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.034+0000 7f2352400640 1 --2- 172.21.15.173:0/606904565 >> v2:172.21.15.194:3300/0 conn(0x7f234c071320 0x7f234c071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.034+0000 7f2352400640 1 --2- 172.21.15.173:0/606904565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f234c0cc8b0 0x7f234c0ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.034+0000 7f2352400640 1 --2- 172.21.15.173:0/606904565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f234c145250 0x7f234c15c980 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.034+0000 7f2352400640 1 -- 172.21.15.173:0/606904565 >> 172.21.15.173:0/606904565 conn(0x7f234c06ac90 msgr2=0x7f234c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:31.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.034+0000 7f2352400640 1 -- 172.21.15.173:0/606904565 shutdown_connections 2024-04-25T09:11:31.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.034+0000 7f2352400640 1 -- 172.21.15.173:0/606904565 wait complete. 2024-04-25T09:11:31.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2352400640 1 Processor -- start 2024-04-25T09:11:31.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2352400640 1 -- start start 2024-04-25T09:11:31.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2352400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f234c071320 0x7f234c143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2352400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f234c0cc8b0 0x7f234c161700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2352400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f234c145250 0x7f234c140030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2352400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c0720e0 con 0x7f234c0cc8b0 2024-04-25T09:11:31.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2352400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c145630 con 0x7f234c071320 2024-04-25T09:11:31.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2352400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234c06ef80 con 0x7f234c145250 2024-04-25T09:11:31.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2342a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f234c0cc8b0 0x7f234c161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2342a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f234c0cc8b0 0x7f234c161700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36816/0 (socket says 172.21.15.173:36816) 2024-04-25T09:11:31.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2342a00640 1 -- 172.21.15.173:0/239756937 learned_addr learned my addr 172.21.15.173:0/239756937 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:31.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f234b400640 1 --2- 172.21.15.173:0/239756937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f234c071320 0x7f234c143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f234be00640 1 --2- 172.21.15.173:0/239756937 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f234c145250 0x7f234c140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2342a00640 1 -- 172.21.15.173:0/239756937 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f234c145250 msgr2=0x7f234c140030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2342a00640 1 --2- 172.21.15.173:0/239756937 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f234c145250 0x7f234c140030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2342a00640 1 -- 172.21.15.173:0/239756937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f234c071320 msgr2=0x7f234c143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2342a00640 1 --2- 172.21.15.173:0/239756937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f234c071320 0x7f234c143fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2342a00640 1 -- 172.21.15.173:0/239756937 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c15f6b0 con 0x7f234c0cc8b0 2024-04-25T09:11:31.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2342a00640 1 --2- 172.21.15.173:0/239756937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f234c0cc8b0 0x7f234c161700 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f233400d5f0 tx=0x7f233400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:31.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2343e00640 1 -- 172.21.15.173:0/239756937 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23340125f0 con 0x7f234c0cc8b0 2024-04-25T09:11:31.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2343e00640 1 -- 172.21.15.173:0/239756937 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2334019070 con 0x7f234c0cc8b0 2024-04-25T09:11:31.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2343e00640 1 -- 172.21.15.173:0/239756937 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23340129b0 con 0x7f234c0cc8b0 2024-04-25T09:11:31.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2352400640 1 -- 172.21.15.173:0/239756937 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234c15f9f0 con 0x7f234c0cc8b0 2024-04-25T09:11:31.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.038+0000 7f2352400640 1 -- 172.21.15.173:0/239756937 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234c160230 con 0x7f234c0cc8b0 2024-04-25T09:11:31.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.042+0000 7f2352400640 1 -- 172.21.15.173:0/239756937 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f234c073a40 con 0x7f234c0cc8b0 2024-04-25T09:11:31.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.042+0000 7f2343e00640 1 -- 172.21.15.173:0/239756937 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2334012b50 con 0x7f234c0cc8b0 2024-04-25T09:11:31.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.042+0000 7f2343e00640 1 --2- 172.21.15.173:0/239756937 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2328066f60 0x7f2328069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.042+0000 7f2343e00640 1 -- 172.21.15.173:0/239756937 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2334085490 con 0x7f234c0cc8b0 2024-04-25T09:11:31.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.042+0000 7f234b400640 1 --2- 172.21.15.173:0/239756937 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2328066f60 0x7f2328069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.042+0000 7f234b400640 1 --2- 172.21.15.173:0/239756937 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2328066f60 0x7f2328069420 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f233c0ae000 tx=0x7f233c0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:31.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.046+0000 7f2343e00640 1 -- 172.21.15.173:0/239756937 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f234c15f9f0 con 0x7f234c0cc8b0 2024-04-25T09:11:31.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.194+0000 7f2352400640 1 -- 172.21.15.173:0/239756937 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f234c0cc570 con 0x7f2328066f60 2024-04-25T09:11:31.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.202+0000 7f2343e00640 1 -- 172.21.15.173:0/239756937 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252382 (secure 0 0 0) 0x7f234c0cc570 con 0x7f2328066f60 2024-04-25T09:11:31.190 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:31.191 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:11:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.206+0000 7f2352400640 1 -- 172.21.15.173:0/239756937 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2328066f60 msgr2=0x7f2328069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.206+0000 7f2352400640 1 --2- 172.21.15.173:0/239756937 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2328066f60 0x7f2328069420 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f233c0ae000 tx=0x7f233c0a7070 comp rx=0 tx=0).stop 2024-04-25T09:11:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.206+0000 7f2352400640 1 -- 172.21.15.173:0/239756937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f234c0cc8b0 msgr2=0x7f234c161700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.206+0000 7f2352400640 1 --2- 172.21.15.173:0/239756937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f234c0cc8b0 0x7f234c161700 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f233400d5f0 tx=0x7f233400dab0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.206+0000 7f2352400640 1 -- 172.21.15.173:0/239756937 shutdown_connections 2024-04-25T09:11:31.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.206+0000 7f2352400640 1 --2- 172.21.15.173:0/239756937 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2328066f60 0x7f2328069420 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.206+0000 7f2352400640 1 --2- 172.21.15.173:0/239756937 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f234c145250 0x7f234c140030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.206+0000 7f2352400640 1 --2- 172.21.15.173:0/239756937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f234c0cc8b0 0x7f234c161700 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.206+0000 7f2352400640 1 --2- 172.21.15.173:0/239756937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f234c071320 0x7f234c143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.206+0000 7f2352400640 1 -- 172.21.15.173:0/239756937 >> 172.21.15.173:0/239756937 conn(0x7f234c06ac90 msgr2=0x7f234c0cfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.206+0000 7f2352400640 1 -- 172.21.15.173:0/239756937 shutdown_connections 2024-04-25T09:11:31.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.206+0000 7f2352400640 1 -- 172.21.15.173:0/239756937 wait complete. 2024-04-25T09:11:31.210 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":382,"stamp":"2024-04-25T09:11:30.841729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":427604,"kb_used_data":12956,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754547116,"statfs":{"total":773094113280,"available":772656246784,"internally_reserved":0,"allocated":13266944,"data_stored":6776797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":424463920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001199"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768987+0000","last_change":"2024-04-25T09:11:26.787243+0000","last_active":"2024-04-25T09:11:27.768987+0000","last_peered":"2024-04-25T09:11:27.768987+0000","last_clean":"2024-04-25T09:11:27.768987+0000","last_became_active":"2024-04-25T09:11:26.786975+0000","last_became_peered":"2024-04-25T09:11:26.786975+0000","last_unstale":"2024-04-25T09:11:27.768987+0000","last_undegraded":"2024-04-25T09:11:27.768987+0000","last_fullsized":"2024-04-25T09:11:27.768987+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:30.819327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.808070+0000","last_change":"2024-04-25T09:11:26.806403+0000","last_active":"2024-04-25T09:11:26.808070+0000","last_peered":"2024-04-25T09:11:26.808070+0000","last_clean":"2024-04-25T09:11:26.808070+0000","last_became_active":"2024-04-25T09:11:26.804718+0000","last_became_peered":"2024-04-25T09:11:26.804718+0000","last_unstale":"2024-04-25T09:11:26.808070+0000","last_undegraded":"2024-04-25T09:11:26.808070+0000","last_fullsized":"2024-04-25T09:11:26.808070+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:09.911379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.804401+0000","last_change":"2024-04-25T09:11:26.794706+0000","last_active":"2024-04-25T09:11:26.804401+0000","last_peered":"2024-04-25T09:11:26.804401+0000","last_clean":"2024-04-25T09:11:26.804401+0000","last_became_active":"2024-04-25T09:11:26.794366+0000","last_became_peered":"2024-04-25T09:11:26.794366+0000","last_unstale":"2024-04-25T09:11:26.804401+0000","last_undegraded":"2024-04-25T09:11:26.804401+0000","last_fullsized":"2024-04-25T09:11:26.804401+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:56.161415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.788996+0000","last_change":"2024-04-25T09:11:26.784135+0000","last_active":"2024-04-25T09:11:26.788996+0000","last_peered":"2024-04-25T09:11:26.788996+0000","last_clean":"2024-04-25T09:11:26.788996+0000","last_became_active":"2024-04-25T09:11:26.783850+0000","last_became_peered":"2024-04-25T09:11:26.783850+0000","last_unstale":"2024-04-25T09:11:26.788996+0000","last_undegraded":"2024-04-25T09:11:26.788996+0000","last_fullsized":"2024-04-25T09:11:26.788996+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:30.057861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768372+0000","last_change":"2024-04-25T09:11:26.771408+0000","last_active":"2024-04-25T09:11:27.768372+0000","last_peered":"2024-04-25T09:11:27.768372+0000","last_clean":"2024-04-25T09:11:27.768372+0000","last_became_active":"2024-04-25T09:11:26.771106+0000","last_became_peered":"2024-04-25T09:11:26.771106+0000","last_unstale":"2024-04-25T09:11:27.768372+0000","last_undegraded":"2024-04-25T09:11:27.768372+0000","last_fullsized":"2024-04-25T09:11:27.768372+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:20.917299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767559+0000","last_change":"2024-04-25T09:11:26.797018+0000","last_active":"2024-04-25T09:11:27.767559+0000","last_peered":"2024-04-25T09:11:27.767559+0000","last_clean":"2024-04-25T09:11:27.767559+0000","last_became_active":"2024-04-25T09:11:26.796767+0000","last_became_peered":"2024-04-25T09:11:26.796767+0000","last_unstale":"2024-04-25T09:11:27.767559+0000","last_undegraded":"2024-04-25T09:11:27.767559+0000","last_fullsized":"2024-04-25T09:11:27.767559+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:03.914384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767133+0000","last_change":"2024-04-25T09:11:26.778696+0000","last_active":"2024-04-25T09:11:27.767133+0000","last_peered":"2024-04-25T09:11:27.767133+0000","last_clean":"2024-04-25T09:11:27.767133+0000","last_became_active":"2024-04-25T09:11:26.778367+0000","last_became_peered":"2024-04-25T09:11:26.778367+0000","last_unstale":"2024-04-25T09:11:27.767133+0000","last_undegraded":"2024-04-25T09:11:27.767133+0000","last_fullsized":"2024-04-25T09:11:27.767133+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:36.182448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.805017+0000","last_change":"2024-04-25T09:11:26.794235+0000","last_active":"2024-04-25T09:11:26.805017+0000","last_peered":"2024-04-25T09:11:26.805017+0000","last_clean":"2024-04-25T09:11:26.805017+0000","last_became_active":"2024-04-25T09:11:26.793919+0000","last_became_peered":"2024-04-25T09:11:26.793919+0000","last_unstale":"2024-04-25T09:11:26.805017+0000","last_undegraded":"2024-04-25T09:11:26.805017+0000","last_fullsized":"2024-04-25T09:11:26.805017+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:40.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":3,"reported_epoch":121,"state":"creating+activating","last_fresh":"2024-04-25T09:11:26.777365+0000","last_change":"2024-04-25T09:11:26.777365+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:26.777365+0000","last_undegraded":"2024-04-25T09:11:26.777365+0000","last_fullsized":"2024-04-25T09:11:26.777365+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.788460+0000","last_change":"2024-04-25T09:11:26.786628+0000","last_active":"2024-04-25T09:11:26.788460+0000","last_peered":"2024-04-25T09:11:26.788460+0000","last_clean":"2024-04-25T09:11:26.788460+0000","last_became_active":"2024-04-25T09:11:26.786348+0000","last_became_peered":"2024-04-25T09:11:26.786348+0000","last_unstale":"2024-04-25T09:11:26.788460+0000","last_undegraded":"2024-04-25T09:11:26.788460+0000","last_fullsized":"2024-04-25T09:11:26.788460+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:43.578822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.769033+0000","last_change":"2024-04-25T09:11:26.783292+0000","last_active":"2024-04-25T09:11:27.769033+0000","last_peered":"2024-04-25T09:11:27.769033+0000","last_clean":"2024-04-25T09:11:27.769033+0000","last_became_active":"2024-04-25T09:11:26.783017+0000","last_became_peered":"2024-04-25T09:11:26.783017+0000","last_unstale":"2024-04-25T09:11:27.769033+0000","last_undegraded":"2024-04-25T09:11:27.769033+0000","last_fullsized":"2024-04-25T09:11:27.769033+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:44.158295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767635+0000","last_change":"2024-04-25T09:11:26.772025+0000","last_active":"2024-04-25T09:11:27.767635+0000","last_peered":"2024-04-25T09:11:27.767635+0000","last_clean":"2024-04-25T09:11:27.767635+0000","last_became_active":"2024-04-25T09:11:26.771747+0000","last_became_peered":"2024-04-25T09:11:26.771747+0000","last_unstale":"2024-04-25T09:11:27.767635+0000","last_undegraded":"2024-04-25T09:11:27.767635+0000","last_fullsized":"2024-04-25T09:11:27.767635+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:01.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.792314+0000","last_change":"2024-04-25T09:11:26.787942+0000","last_active":"2024-04-25T09:11:26.792314+0000","last_peered":"2024-04-25T09:11:26.792314+0000","last_clean":"2024-04-25T09:11:26.792314+0000","last_became_active":"2024-04-25T09:11:26.787585+0000","last_became_peered":"2024-04-25T09:11:26.787585+0000","last_unstale":"2024-04-25T09:11:26.792314+0000","last_undegraded":"2024-04-25T09:11:26.792314+0000","last_fullsized":"2024-04-25T09:11:26.792314+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:06.710197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.807110+0000","last_change":"2024-04-25T09:11:26.801981+0000","last_active":"2024-04-25T09:11:26.807110+0000","last_peered":"2024-04-25T09:11:26.807110+0000","last_clean":"2024-04-25T09:11:26.807110+0000","last_became_active":"2024-04-25T09:11:26.794868+0000","last_became_peered":"2024-04-25T09:11:26.794868+0000","last_unstale":"2024-04-25T09:11:26.807110+0000","last_undegraded":"2024-04-25T09:11:26.807110+0000","last_fullsized":"2024-04-25T09:11:26.807110+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:53.484584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767548+0000","last_change":"2024-04-25T09:11:26.782835+0000","last_active":"2024-04-25T09:11:27.767548+0000","last_peered":"2024-04-25T09:11:27.767548+0000","last_clean":"2024-04-25T09:11:27.767548+0000","last_became_active":"2024-04-25T09:11:26.782340+0000","last_became_peered":"2024-04-25T09:11:26.782340+0000","last_unstale":"2024-04-25T09:11:27.767548+0000","last_undegraded":"2024-04-25T09:11:27.767548+0000","last_fullsized":"2024-04-25T09:11:27.767548+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:18.339218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767110+0000","last_change":"2024-04-25T09:11:26.795334+0000","last_active":"2024-04-25T09:11:27.767110+0000","last_peered":"2024-04-25T09:11:27.767110+0000","last_clean":"2024-04-25T09:11:27.767110+0000","last_became_active":"2024-04-25T09:11:26.794720+0000","last_became_peered":"2024-04-25T09:11:26.794720+0000","last_unstale":"2024-04-25T09:11:27.767110+0000","last_undegraded":"2024-04-25T09:11:27.767110+0000","last_fullsized":"2024-04-25T09:11:27.767110+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:17.010143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.790261+0000","last_change":"2024-04-25T09:11:26.788198+0000","last_active":"2024-04-25T09:11:26.790261+0000","last_peered":"2024-04-25T09:11:26.790261+0000","last_clean":"2024-04-25T09:11:26.790261+0000","last_became_active":"2024-04-25T09:11:26.787463+0000","last_became_peered":"2024-04-25T09:11:26.787463+0000","last_unstale":"2024-04-25T09:11:26.790261+0000","last_undegraded":"2024-04-25T09:11:26.790261+0000","last_fullsized":"2024-04-25T09:11:26.790261+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:09.020019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.808049+0000","last_change":"2024-04-25T09:11:26.804889+0000","last_active":"2024-04-25T09:11:26.808049+0000","last_peered":"2024-04-25T09:11:26.808049+0000","last_clean":"2024-04-25T09:11:26.808049+0000","last_became_active":"2024-04-25T09:11:26.804397+0000","last_became_peered":"2024-04-25T09:11:26.804397+0000","last_unstale":"2024-04-25T09:11:26.808049+0000","last_undegraded":"2024-04-25T09:11:26.808049+0000","last_fullsized":"2024-04-25T09:11:26.808049+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:08.462078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768173+0000","last_change":"2024-04-25T09:11:26.782877+0000","last_active":"2024-04-25T09:11:27.768173+0000","last_peered":"2024-04-25T09:11:27.768173+0000","last_clean":"2024-04-25T09:11:27.768173+0000","last_became_active":"2024-04-25T09:11:26.782538+0000","last_became_peered":"2024-04-25T09:11:26.782538+0000","last_unstale":"2024-04-25T09:11:27.768173+0000","last_undegraded":"2024-04-25T09:11:27.768173+0000","last_fullsized":"2024-04-25T09:11:27.768173+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:02.178137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.795822+0000","last_change":"2024-04-25T09:11:26.791381+0000","last_active":"2024-04-25T09:11:26.795822+0000","last_peered":"2024-04-25T09:11:26.795822+0000","last_clean":"2024-04-25T09:11:26.795822+0000","last_became_active":"2024-04-25T09:11:26.789379+0000","last_became_peered":"2024-04-25T09:11:26.789379+0000","last_unstale":"2024-04-25T09:11:26.795822+0000","last_undegraded":"2024-04-25T09:11:26.795822+0000","last_fullsized":"2024-04-25T09:11:26.795822+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:27.017599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.795392+0000","last_change":"2024-04-25T09:11:26.793939+0000","last_active":"2024-04-25T09:11:26.795392+0000","last_peered":"2024-04-25T09:11:26.795392+0000","last_clean":"2024-04-25T09:11:26.795392+0000","last_became_active":"2024-04-25T09:11:26.792032+0000","last_became_peered":"2024-04-25T09:11:26.792032+0000","last_unstale":"2024-04-25T09:11:26.795392+0000","last_undegraded":"2024-04-25T09:11:26.795392+0000","last_fullsized":"2024-04-25T09:11:26.795392+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:07.110094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.769149+0000","last_change":"2024-04-25T09:11:26.798320+0000","last_active":"2024-04-25T09:11:27.769149+0000","last_peered":"2024-04-25T09:11:27.769149+0000","last_clean":"2024-04-25T09:11:27.769149+0000","last_became_active":"2024-04-25T09:11:26.797870+0000","last_became_peered":"2024-04-25T09:11:26.797870+0000","last_unstale":"2024-04-25T09:11:27.769149+0000","last_undegraded":"2024-04-25T09:11:27.769149+0000","last_fullsized":"2024-04-25T09:11:27.769149+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:48.355880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.801768+0000","last_change":"2024-04-25T09:11:26.801768+0000","last_active":"2024-04-25T09:11:26.801768+0000","last_peered":"2024-04-25T09:11:26.801768+0000","last_clean":"2024-04-25T09:11:26.801768+0000","last_became_active":"2024-04-25T09:11:26.801480+0000","last_became_peered":"2024-04-25T09:11:26.801480+0000","last_unstale":"2024-04-25T09:11:26.801768+0000","last_undegraded":"2024-04-25T09:11:26.801768+0000","last_fullsized":"2024-04-25T09:11:26.801768+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:10.217192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070205+0000","last_change":"2024-04-25T09:11:26.790623+0000","last_active":"2024-04-25T09:11:28.070205+0000","last_peered":"2024-04-25T09:11:28.070205+0000","last_clean":"2024-04-25T09:11:28.070205+0000","last_became_active":"2024-04-25T09:11:26.790108+0000","last_became_peered":"2024-04-25T09:11:26.790108+0000","last_unstale":"2024-04-25T09:11:28.070205+0000","last_undegraded":"2024-04-25T09:11:28.070205+0000","last_fullsized":"2024-04-25T09:11:28.070205+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:30.819327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070601+0000","last_change":"2024-04-25T09:11:26.783160+0000","last_active":"2024-04-25T09:11:28.070601+0000","last_peered":"2024-04-25T09:11:28.070601+0000","last_clean":"2024-04-25T09:11:28.070601+0000","last_became_active":"2024-04-25T09:11:26.782852+0000","last_became_peered":"2024-04-25T09:11:26.782852+0000","last_unstale":"2024-04-25T09:11:28.070601+0000","last_undegraded":"2024-04-25T09:11:28.070601+0000","last_fullsized":"2024-04-25T09:11:28.070601+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:08.011751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.797781+0000","last_change":"2024-04-25T09:11:26.792420+0000","last_active":"2024-04-25T09:11:26.797781+0000","last_peered":"2024-04-25T09:11:26.797781+0000","last_clean":"2024-04-25T09:11:26.797781+0000","last_became_active":"2024-04-25T09:11:26.792149+0000","last_became_peered":"2024-04-25T09:11:26.792149+0000","last_unstale":"2024-04-25T09:11:26.797781+0000","last_undegraded":"2024-04-25T09:11:26.797781+0000","last_fullsized":"2024-04-25T09:11:26.797781+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:35.433281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768495+0000","last_change":"2024-04-25T09:11:26.780285+0000","last_active":"2024-04-25T09:11:27.768495+0000","last_peered":"2024-04-25T09:11:27.768495+0000","last_clean":"2024-04-25T09:11:27.768495+0000","last_became_active":"2024-04-25T09:11:26.780022+0000","last_became_peered":"2024-04-25T09:11:26.780022+0000","last_unstale":"2024-04-25T09:11:27.768495+0000","last_undegraded":"2024-04-25T09:11:27.768495+0000","last_fullsized":"2024-04-25T09:11:27.768495+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:41.102958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767748+0000","last_change":"2024-04-25T09:11:26.781347+0000","last_active":"2024-04-25T09:11:27.767748+0000","last_peered":"2024-04-25T09:11:27.767748+0000","last_clean":"2024-04-25T09:11:27.767748+0000","last_became_active":"2024-04-25T09:11:26.781120+0000","last_became_peered":"2024-04-25T09:11:26.781120+0000","last_unstale":"2024-04-25T09:11:27.767748+0000","last_undegraded":"2024-04-25T09:11:27.767748+0000","last_fullsized":"2024-04-25T09:11:27.767748+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:01.534619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.806525+0000","last_change":"2024-04-25T09:11:26.805666+0000","last_active":"2024-04-25T09:11:26.806525+0000","last_peered":"2024-04-25T09:11:26.806525+0000","last_clean":"2024-04-25T09:11:26.806525+0000","last_became_active":"2024-04-25T09:11:26.805395+0000","last_became_peered":"2024-04-25T09:11:26.805395+0000","last_unstale":"2024-04-25T09:11:26.806525+0000","last_undegraded":"2024-04-25T09:11:26.806525+0000","last_fullsized":"2024-04-25T09:11:26.806525+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:50.859865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.806206+0000","last_change":"2024-04-25T09:11:26.793946+0000","last_active":"2024-04-25T09:11:26.806206+0000","last_peered":"2024-04-25T09:11:26.806206+0000","last_clean":"2024-04-25T09:11:26.806206+0000","last_became_active":"2024-04-25T09:11:26.784942+0000","last_became_peered":"2024-04-25T09:11:26.784942+0000","last_unstale":"2024-04-25T09:11:26.806206+0000","last_undegraded":"2024-04-25T09:11:26.806206+0000","last_fullsized":"2024-04-25T09:11:26.806206+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:30.057861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070246+0000","last_change":"2024-04-25T09:11:26.795695+0000","last_active":"2024-04-25T09:11:28.070246+0000","last_peered":"2024-04-25T09:11:28.070246+0000","last_clean":"2024-04-25T09:11:28.070246+0000","last_became_active":"2024-04-25T09:11:26.795419+0000","last_became_peered":"2024-04-25T09:11:26.795419+0000","last_unstale":"2024-04-25T09:11:28.070246+0000","last_undegraded":"2024-04-25T09:11:28.070246+0000","last_fullsized":"2024-04-25T09:11:28.070246+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:03.214507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070156+0000","last_change":"2024-04-25T09:11:26.790369+0000","last_active":"2024-04-25T09:11:28.070156+0000","last_peered":"2024-04-25T09:11:28.070156+0000","last_clean":"2024-04-25T09:11:28.070156+0000","last_became_active":"2024-04-25T09:11:26.789737+0000","last_became_peered":"2024-04-25T09:11:26.789737+0000","last_unstale":"2024-04-25T09:11:28.070156+0000","last_undegraded":"2024-04-25T09:11:28.070156+0000","last_fullsized":"2024-04-25T09:11:28.070156+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:44.158295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.791717+0000","last_change":"2024-04-25T09:11:26.787994+0000","last_active":"2024-04-25T09:11:26.791717+0000","last_peered":"2024-04-25T09:11:26.791717+0000","last_clean":"2024-04-25T09:11:26.791717+0000","last_became_active":"2024-04-25T09:11:26.787717+0000","last_became_peered":"2024-04-25T09:11:26.787717+0000","last_unstale":"2024-04-25T09:11:26.791717+0000","last_undegraded":"2024-04-25T09:11:26.791717+0000","last_fullsized":"2024-04-25T09:11:26.791717+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:12.274747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"121'4","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768329+0000","last_change":"2024-04-25T09:11:25.782496+0000","last_active":"2024-04-25T09:11:27.768329+0000","last_peered":"2024-04-25T09:11:27.768329+0000","last_clean":"2024-04-25T09:11:27.768329+0000","last_became_active":"2024-04-25T09:11:25.782211+0000","last_became_peered":"2024-04-25T09:11:25.782211+0000","last_unstale":"2024-04-25T09:11:27.768329+0000","last_undegraded":"2024-04-25T09:11:27.768329+0000","last_fullsized":"2024-04-25T09:11:27.768329+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:43.030827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767536+0000","last_change":"2024-04-25T09:11:26.803328+0000","last_active":"2024-04-25T09:11:27.767536+0000","last_peered":"2024-04-25T09:11:27.767536+0000","last_clean":"2024-04-25T09:11:27.767536+0000","last_became_active":"2024-04-25T09:11:26.802977+0000","last_became_peered":"2024-04-25T09:11:26.802977+0000","last_unstale":"2024-04-25T09:11:27.767536+0000","last_undegraded":"2024-04-25T09:11:27.767536+0000","last_fullsized":"2024-04-25T09:11:27.767536+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:18.825168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"121'1","reported_seq":13,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.803602+0000","last_change":"2024-04-25T09:11:25.789063+0000","last_active":"2024-04-25T09:11:26.803602+0000","last_peered":"2024-04-25T09:11:26.803602+0000","last_clean":"2024-04-25T09:11:26.803602+0000","last_became_active":"2024-04-25T09:11:25.788745+0000","last_became_peered":"2024-04-25T09:11:25.788745+0000","last_unstale":"2024-04-25T09:11:26.803602+0000","last_undegraded":"2024-04-25T09:11:26.803602+0000","last_fullsized":"2024-04-25T09:11:26.803602+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:26:16.606333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070386+0000","last_change":"2024-04-25T09:11:26.780782+0000","last_active":"2024-04-25T09:11:28.070386+0000","last_peered":"2024-04-25T09:11:28.070386+0000","last_clean":"2024-04-25T09:11:28.070386+0000","last_became_active":"2024-04-25T09:11:26.780519+0000","last_became_peered":"2024-04-25T09:11:26.780519+0000","last_unstale":"2024-04-25T09:11:28.070386+0000","last_undegraded":"2024-04-25T09:11:28.070386+0000","last_fullsized":"2024-04-25T09:11:28.070386+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:44.033298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"121'2","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.798594+0000","last_change":"2024-04-25T09:11:25.788687+0000","last_active":"2024-04-25T09:11:26.798594+0000","last_peered":"2024-04-25T09:11:26.798594+0000","last_clean":"2024-04-25T09:11:26.798594+0000","last_became_active":"2024-04-25T09:11:25.788408+0000","last_became_peered":"2024-04-25T09:11:25.788408+0000","last_unstale":"2024-04-25T09:11:26.798594+0000","last_undegraded":"2024-04-25T09:11:26.798594+0000","last_fullsized":"2024-04-25T09:11:26.798594+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:29.964854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.798002+0000","last_change":"2024-04-25T09:11:26.797141+0000","last_active":"2024-04-25T09:11:26.798002+0000","last_peered":"2024-04-25T09:11:26.798002+0000","last_clean":"2024-04-25T09:11:26.798002+0000","last_became_active":"2024-04-25T09:11:26.796854+0000","last_became_peered":"2024-04-25T09:11:26.796854+0000","last_unstale":"2024-04-25T09:11:26.798002+0000","last_undegraded":"2024-04-25T09:11:26.798002+0000","last_fullsized":"2024-04-25T09:11:26.798002+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:56.161415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"121'2","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.809316+0000","last_change":"2024-04-25T09:11:25.778670+0000","last_active":"2024-04-25T09:11:26.809316+0000","last_peered":"2024-04-25T09:11:26.809316+0000","last_clean":"2024-04-25T09:11:26.809316+0000","last_became_active":"2024-04-25T09:11:25.778177+0000","last_became_peered":"2024-04-25T09:11:25.778177+0000","last_unstale":"2024-04-25T09:11:26.809316+0000","last_undegraded":"2024-04-25T09:11:26.809316+0000","last_fullsized":"2024-04-25T09:11:26.809316+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:01.802409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.791752+0000","last_change":"2024-04-25T09:11:26.789429+0000","last_active":"2024-04-25T09:11:26.791752+0000","last_peered":"2024-04-25T09:11:26.791752+0000","last_clean":"2024-04-25T09:11:26.791752+0000","last_became_active":"2024-04-25T09:11:26.788594+0000","last_became_peered":"2024-04-25T09:11:26.788594+0000","last_unstale":"2024-04-25T09:11:26.791752+0000","last_undegraded":"2024-04-25T09:11:26.791752+0000","last_fullsized":"2024-04-25T09:11:26.791752+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:57.095719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768484+0000","last_change":"2024-04-25T09:11:25.778748+0000","last_active":"2024-04-25T09:11:27.768484+0000","last_peered":"2024-04-25T09:11:27.768484+0000","last_clean":"2024-04-25T09:11:27.768484+0000","last_became_active":"2024-04-25T09:11:25.778369+0000","last_became_peered":"2024-04-25T09:11:25.778369+0000","last_unstale":"2024-04-25T09:11:27.768484+0000","last_undegraded":"2024-04-25T09:11:27.768484+0000","last_fullsized":"2024-04-25T09:11:27.768484+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:40.038318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767759+0000","last_change":"2024-04-25T09:11:26.782603+0000","last_active":"2024-04-25T09:11:27.767759+0000","last_peered":"2024-04-25T09:11:27.767759+0000","last_clean":"2024-04-25T09:11:27.767759+0000","last_became_active":"2024-04-25T09:11:26.781970+0000","last_became_peered":"2024-04-25T09:11:26.781970+0000","last_unstale":"2024-04-25T09:11:27.767759+0000","last_undegraded":"2024-04-25T09:11:27.767759+0000","last_fullsized":"2024-04-25T09:11:27.767759+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:50.866716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767584+0000","last_change":"2024-04-25T09:11:25.784323+0000","last_active":"2024-04-25T09:11:27.767584+0000","last_peered":"2024-04-25T09:11:27.767584+0000","last_clean":"2024-04-25T09:11:27.767584+0000","last_became_active":"2024-04-25T09:11:25.783886+0000","last_became_peered":"2024-04-25T09:11:25.783886+0000","last_unstale":"2024-04-25T09:11:27.767584+0000","last_undegraded":"2024-04-25T09:11:27.767584+0000","last_fullsized":"2024-04-25T09:11:27.767584+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:47.142671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.806230+0000","last_change":"2024-04-25T09:11:26.796820+0000","last_active":"2024-04-25T09:11:26.806230+0000","last_peered":"2024-04-25T09:11:26.806230+0000","last_clean":"2024-04-25T09:11:26.806230+0000","last_became_active":"2024-04-25T09:11:26.796373+0000","last_became_peered":"2024-04-25T09:11:26.796373+0000","last_unstale":"2024-04-25T09:11:26.806230+0000","last_undegraded":"2024-04-25T09:11:26.806230+0000","last_fullsized":"2024-04-25T09:11:26.806230+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:24.936289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070315+0000","last_change":"2024-04-25T09:11:25.786111+0000","last_active":"2024-04-25T09:11:28.070315+0000","last_peered":"2024-04-25T09:11:28.070315+0000","last_clean":"2024-04-25T09:11:28.070315+0000","last_became_active":"2024-04-25T09:11:25.785762+0000","last_became_peered":"2024-04-25T09:11:25.785762+0000","last_unstale":"2024-04-25T09:11:28.070315+0000","last_undegraded":"2024-04-25T09:11:28.070315+0000","last_fullsized":"2024-04-25T09:11:28.070315+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:24.290504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.808512+0000","last_change":"2024-04-25T09:11:26.807560+0000","last_active":"2024-04-25T09:11:26.808512+0000","last_peered":"2024-04-25T09:11:26.808512+0000","last_clean":"2024-04-25T09:11:26.808512+0000","last_became_active":"2024-04-25T09:11:26.807297+0000","last_became_peered":"2024-04-25T09:11:26.807297+0000","last_unstale":"2024-04-25T09:11:26.808512+0000","last_undegraded":"2024-04-25T09:11:26.808512+0000","last_fullsized":"2024-04-25T09:11:26.808512+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:05.958586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767243+0000","last_change":"2024-04-25T09:11:25.782062+0000","last_active":"2024-04-25T09:11:27.767243+0000","last_peered":"2024-04-25T09:11:27.767243+0000","last_clean":"2024-04-25T09:11:27.767243+0000","last_became_active":"2024-04-25T09:11:25.781812+0000","last_became_peered":"2024-04-25T09:11:25.781812+0000","last_unstale":"2024-04-25T09:11:27.767243+0000","last_undegraded":"2024-04-25T09:11:27.767243+0000","last_fullsized":"2024-04-25T09:11:27.767243+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:17.958244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767943+0000","last_change":"2024-04-25T09:11:26.783348+0000","last_active":"2024-04-25T09:11:27.767943+0000","last_peered":"2024-04-25T09:11:27.767943+0000","last_clean":"2024-04-25T09:11:27.767943+0000","last_became_active":"2024-04-25T09:11:26.783086+0000","last_became_peered":"2024-04-25T09:11:26.783086+0000","last_unstale":"2024-04-25T09:11:27.767943+0000","last_undegraded":"2024-04-25T09:11:27.767943+0000","last_fullsized":"2024-04-25T09:11:27.767943+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:25.760586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768379+0000","last_change":"2024-04-25T09:11:25.786883+0000","last_active":"2024-04-25T09:11:27.768379+0000","last_peered":"2024-04-25T09:11:27.768379+0000","last_clean":"2024-04-25T09:11:27.768379+0000","last_became_active":"2024-04-25T09:11:25.786471+0000","last_became_peered":"2024-04-25T09:11:25.786471+0000","last_unstale":"2024-04-25T09:11:27.768379+0000","last_undegraded":"2024-04-25T09:11:27.768379+0000","last_fullsized":"2024-04-25T09:11:27.768379+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:33.024623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070506+0000","last_change":"2024-04-25T09:11:26.802053+0000","last_active":"2024-04-25T09:11:28.070506+0000","last_peered":"2024-04-25T09:11:28.070506+0000","last_clean":"2024-04-25T09:11:28.070506+0000","last_became_active":"2024-04-25T09:11:26.801745+0000","last_became_peered":"2024-04-25T09:11:26.801745+0000","last_unstale":"2024-04-25T09:11:28.070506+0000","last_undegraded":"2024-04-25T09:11:28.070506+0000","last_fullsized":"2024-04-25T09:11:28.070506+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:34.027095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070327+0000","last_change":"2024-04-25T09:11:25.790188+0000","last_active":"2024-04-25T09:11:28.070327+0000","last_peered":"2024-04-25T09:11:28.070327+0000","last_clean":"2024-04-25T09:11:28.070327+0000","last_became_active":"2024-04-25T09:11:25.789477+0000","last_became_peered":"2024-04-25T09:11:25.789477+0000","last_unstale":"2024-04-25T09:11:28.070327+0000","last_undegraded":"2024-04-25T09:11:28.070327+0000","last_fullsized":"2024-04-25T09:11:28.070327+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:40.038318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.807631+0000","last_change":"2024-04-25T09:11:26.804558+0000","last_active":"2024-04-25T09:11:26.807631+0000","last_peered":"2024-04-25T09:11:26.807631+0000","last_clean":"2024-04-25T09:11:26.807631+0000","last_became_active":"2024-04-25T09:11:26.801426+0000","last_became_peered":"2024-04-25T09:11:26.801426+0000","last_unstale":"2024-04-25T09:11:26.807631+0000","last_undegraded":"2024-04-25T09:11:26.807631+0000","last_fullsized":"2024-04-25T09:11:26.807631+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:11.458429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"121'3","reported_seq":17,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070498+0000","last_change":"2024-04-25T09:11:25.785530+0000","last_active":"2024-04-25T09:11:28.070498+0000","last_peered":"2024-04-25T09:11:28.070498+0000","last_clean":"2024-04-25T09:11:28.070498+0000","last_became_active":"2024-04-25T09:11:25.785236+0000","last_became_peered":"2024-04-25T09:11:25.785236+0000","last_unstale":"2024-04-25T09:11:28.070498+0000","last_undegraded":"2024-04-25T09:11:28.070498+0000","last_fullsized":"2024-04-25T09:11:28.070498+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:36.050959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070656+0000","last_change":"2024-04-25T09:11:26.793693+0000","last_active":"2024-04-25T09:11:28.070656+0000","last_peered":"2024-04-25T09:11:28.070656+0000","last_clean":"2024-04-25T09:11:28.070656+0000","last_became_active":"2024-04-25T09:11:26.793379+0000","last_became_peered":"2024-04-25T09:11:26.793379+0000","last_unstale":"2024-04-25T09:11:28.070656+0000","last_undegraded":"2024-04-25T09:11:28.070656+0000","last_fullsized":"2024-04-25T09:11:28.070656+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:58.722752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"121'6","reported_seq":18,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.809992+0000","last_change":"2024-04-25T09:11:25.788323+0000","last_active":"2024-04-25T09:11:26.809992+0000","last_peered":"2024-04-25T09:11:26.809992+0000","last_clean":"2024-04-25T09:11:26.809992+0000","last_became_active":"2024-04-25T09:11:25.787675+0000","last_became_peered":"2024-04-25T09:11:25.787675+0000","last_unstale":"2024-04-25T09:11:26.809992+0000","last_undegraded":"2024-04-25T09:11:26.809992+0000","last_fullsized":"2024-04-25T09:11:26.809992+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:29.964854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768233+0000","last_change":"2024-04-25T09:11:26.776056+0000","last_active":"2024-04-25T09:11:27.768233+0000","last_peered":"2024-04-25T09:11:27.768233+0000","last_clean":"2024-04-25T09:11:27.768233+0000","last_became_active":"2024-04-25T09:11:26.775732+0000","last_became_peered":"2024-04-25T09:11:26.775732+0000","last_unstale":"2024-04-25T09:11:27.768233+0000","last_undegraded":"2024-04-25T09:11:27.768233+0000","last_fullsized":"2024-04-25T09:11:27.768233+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:20.515945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"121'2","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.807771+0000","last_change":"2024-04-25T09:11:25.786240+0000","last_active":"2024-04-25T09:11:26.807771+0000","last_peered":"2024-04-25T09:11:26.807771+0000","last_clean":"2024-04-25T09:11:26.807771+0000","last_became_active":"2024-04-25T09:11:25.785904+0000","last_became_peered":"2024-04-25T09:11:25.785904+0000","last_unstale":"2024-04-25T09:11:26.807771+0000","last_undegraded":"2024-04-25T09:11:26.807771+0000","last_fullsized":"2024-04-25T09:11:26.807771+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:03.302767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.800822+0000","last_change":"2024-04-25T09:11:26.799364+0000","last_active":"2024-04-25T09:11:26.800822+0000","last_peered":"2024-04-25T09:11:26.800822+0000","last_clean":"2024-04-25T09:11:26.800822+0000","last_became_active":"2024-04-25T09:11:26.798845+0000","last_became_peered":"2024-04-25T09:11:26.798845+0000","last_unstale":"2024-04-25T09:11:26.800822+0000","last_undegraded":"2024-04-25T09:11:26.800822+0000","last_fullsized":"2024-04-25T09:11:26.800822+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:51.241627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.794340+0000","last_change":"2024-04-25T09:11:25.789385+0000","last_active":"2024-04-25T09:11:26.794340+0000","last_peered":"2024-04-25T09:11:26.794340+0000","last_clean":"2024-04-25T09:11:26.794340+0000","last_became_active":"2024-04-25T09:11:25.789127+0000","last_became_peered":"2024-04-25T09:11:25.789127+0000","last_unstale":"2024-04-25T09:11:26.794340+0000","last_undegraded":"2024-04-25T09:11:26.794340+0000","last_fullsized":"2024-04-25T09:11:26.794340+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:06.107623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.791967+0000","last_change":"2024-04-25T09:11:26.789683+0000","last_active":"2024-04-25T09:11:26.791967+0000","last_peered":"2024-04-25T09:11:26.791967+0000","last_clean":"2024-04-25T09:11:26.791967+0000","last_became_active":"2024-04-25T09:11:26.788459+0000","last_became_peered":"2024-04-25T09:11:26.788459+0000","last_unstale":"2024-04-25T09:11:26.791967+0000","last_undegraded":"2024-04-25T09:11:26.791967+0000","last_fullsized":"2024-04-25T09:11:26.791967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:19.898515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.786092+0000","last_change":"2024-04-25T09:11:25.787217+0000","last_active":"2024-04-25T09:11:26.786092+0000","last_peered":"2024-04-25T09:11:26.786092+0000","last_clean":"2024-04-25T09:11:26.786092+0000","last_became_active":"2024-04-25T09:11:25.786763+0000","last_became_peered":"2024-04-25T09:11:25.786763+0000","last_unstale":"2024-04-25T09:11:26.786092+0000","last_undegraded":"2024-04-25T09:11:26.786092+0000","last_fullsized":"2024-04-25T09:11:26.786092+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:09.144966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070405+0000","last_change":"2024-04-25T09:11:26.781598+0000","last_active":"2024-04-25T09:11:28.070405+0000","last_peered":"2024-04-25T09:11:28.070405+0000","last_clean":"2024-04-25T09:11:28.070405+0000","last_became_active":"2024-04-25T09:11:26.781290+0000","last_became_peered":"2024-04-25T09:11:26.781290+0000","last_unstale":"2024-04-25T09:11:28.070405+0000","last_undegraded":"2024-04-25T09:11:28.070405+0000","last_fullsized":"2024-04-25T09:11:28.070405+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:11.569136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"121'1","reported_seq":13,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.800436+0000","last_change":"2024-04-25T09:11:25.781852+0000","last_active":"2024-04-25T09:11:26.800436+0000","last_peered":"2024-04-25T09:11:26.800436+0000","last_clean":"2024-04-25T09:11:26.800436+0000","last_became_active":"2024-04-25T09:11:25.780781+0000","last_became_peered":"2024-04-25T09:11:25.780781+0000","last_unstale":"2024-04-25T09:11:26.800436+0000","last_undegraded":"2024-04-25T09:11:26.800436+0000","last_fullsized":"2024-04-25T09:11:26.800436+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:54.103134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.769052+0000","last_change":"2024-04-25T09:11:26.797827+0000","last_active":"2024-04-25T09:11:27.769052+0000","last_peered":"2024-04-25T09:11:27.769052+0000","last_clean":"2024-04-25T09:11:27.769052+0000","last_became_active":"2024-04-25T09:11:26.797548+0000","last_became_peered":"2024-04-25T09:11:26.797548+0000","last_unstale":"2024-04-25T09:11:27.769052+0000","last_undegraded":"2024-04-25T09:11:27.769052+0000","last_fullsized":"2024-04-25T09:11:27.769052+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:03.214507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"121'2","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.793939+0000","last_change":"2024-04-25T09:11:25.792534+0000","last_active":"2024-04-25T09:11:26.793939+0000","last_peered":"2024-04-25T09:11:26.793939+0000","last_clean":"2024-04-25T09:11:26.793939+0000","last_became_active":"2024-04-25T09:11:25.792008+0000","last_became_peered":"2024-04-25T09:11:25.792008+0000","last_unstale":"2024-04-25T09:11:26.793939+0000","last_undegraded":"2024-04-25T09:11:26.793939+0000","last_fullsized":"2024-04-25T09:11:26.793939+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:22.627378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767889+0000","last_change":"2024-04-25T09:11:26.772587+0000","last_active":"2024-04-25T09:11:27.767889+0000","last_peered":"2024-04-25T09:11:27.767889+0000","last_clean":"2024-04-25T09:11:27.767889+0000","last_became_active":"2024-04-25T09:11:26.772276+0000","last_became_peered":"2024-04-25T09:11:26.772276+0000","last_unstale":"2024-04-25T09:11:27.767889+0000","last_undegraded":"2024-04-25T09:11:27.767889+0000","last_fullsized":"2024-04-25T09:11:27.767889+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:32.004711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"121'1","reported_seq":13,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.796640+0000","last_change":"2024-04-25T09:11:25.789177+0000","last_active":"2024-04-25T09:11:26.796640+0000","last_peered":"2024-04-25T09:11:26.796640+0000","last_clean":"2024-04-25T09:11:26.796640+0000","last_became_active":"2024-04-25T09:11:25.788356+0000","last_became_peered":"2024-04-25T09:11:25.788356+0000","last_unstale":"2024-04-25T09:11:26.796640+0000","last_undegraded":"2024-04-25T09:11:26.796640+0000","last_fullsized":"2024-04-25T09:11:26.796640+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:06.193412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070694+0000","last_change":"2024-04-25T09:11:26.789879+0000","last_active":"2024-04-25T09:11:28.070694+0000","last_peered":"2024-04-25T09:11:28.070694+0000","last_clean":"2024-04-25T09:11:28.070694+0000","last_became_active":"2024-04-25T09:11:26.789518+0000","last_became_peered":"2024-04-25T09:11:26.789518+0000","last_unstale":"2024-04-25T09:11:28.070694+0000","last_undegraded":"2024-04-25T09:11:28.070694+0000","last_fullsized":"2024-04-25T09:11:28.070694+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:26.026358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.776625+0000","last_change":"2024-04-25T09:11:25.791795+0000","last_active":"2024-04-25T09:11:26.776625+0000","last_peered":"2024-04-25T09:11:26.776625+0000","last_clean":"2024-04-25T09:11:26.776625+0000","last_became_active":"2024-04-25T09:11:25.791461+0000","last_became_peered":"2024-04-25T09:11:25.791461+0000","last_unstale":"2024-04-25T09:11:26.776625+0000","last_undegraded":"2024-04-25T09:11:26.776625+0000","last_fullsized":"2024-04-25T09:11:26.776625+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:09.144966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767110+0000","last_change":"2024-04-25T09:11:26.772157+0000","last_active":"2024-04-25T09:11:27.767110+0000","last_peered":"2024-04-25T09:11:27.767110+0000","last_clean":"2024-04-25T09:11:27.767110+0000","last_became_active":"2024-04-25T09:11:26.771882+0000","last_became_peered":"2024-04-25T09:11:26.771882+0000","last_unstale":"2024-04-25T09:11:27.767110+0000","last_undegraded":"2024-04-25T09:11:27.767110+0000","last_fullsized":"2024-04-25T09:11:27.767110+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:07.458809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767135+0000","last_change":"2024-04-25T09:11:25.784911+0000","last_active":"2024-04-25T09:11:27.767135+0000","last_peered":"2024-04-25T09:11:27.767135+0000","last_clean":"2024-04-25T09:11:27.767135+0000","last_became_active":"2024-04-25T09:11:25.784461+0000","last_became_peered":"2024-04-25T09:11:25.784461+0000","last_unstale":"2024-04-25T09:11:27.767135+0000","last_undegraded":"2024-04-25T09:11:27.767135+0000","last_fullsized":"2024-04-25T09:11:27.767135+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:09.127425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.804573+0000","last_change":"2024-04-25T09:11:26.797782+0000","last_active":"2024-04-25T09:11:26.804573+0000","last_peered":"2024-04-25T09:11:26.804573+0000","last_clean":"2024-04-25T09:11:26.804573+0000","last_became_active":"2024-04-25T09:11:26.797497+0000","last_became_peered":"2024-04-25T09:11:26.797497+0000","last_unstale":"2024-04-25T09:11:26.804573+0000","last_undegraded":"2024-04-25T09:11:26.804573+0000","last_fullsized":"2024-04-25T09:11:26.804573+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:37.118986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.774149+0000","last_change":"2024-04-25T09:11:25.783997+0000","last_active":"2024-04-25T09:11:26.774149+0000","last_peered":"2024-04-25T09:11:26.774149+0000","last_clean":"2024-04-25T09:11:26.774149+0000","last_became_active":"2024-04-25T09:11:25.783674+0000","last_became_peered":"2024-04-25T09:11:25.783674+0000","last_unstale":"2024-04-25T09:11:26.774149+0000","last_undegraded":"2024-04-25T09:11:26.774149+0000","last_fullsized":"2024-04-25T09:11:26.774149+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:53.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.806219+0000","last_change":"2024-04-25T09:11:26.796627+0000","last_active":"2024-04-25T09:11:26.806219+0000","last_peered":"2024-04-25T09:11:26.806219+0000","last_clean":"2024-04-25T09:11:26.806219+0000","last_became_active":"2024-04-25T09:11:26.794570+0000","last_became_peered":"2024-04-25T09:11:26.794570+0000","last_unstale":"2024-04-25T09:11:26.806219+0000","last_undegraded":"2024-04-25T09:11:26.806219+0000","last_fullsized":"2024-04-25T09:11:26.806219+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:10.217192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.786231+0000","last_change":"2024-04-25T09:11:25.786373+0000","last_active":"2024-04-25T09:11:26.786231+0000","last_peered":"2024-04-25T09:11:26.786231+0000","last_clean":"2024-04-25T09:11:26.786231+0000","last_became_active":"2024-04-25T09:11:25.785938+0000","last_became_peered":"2024-04-25T09:11:25.785938+0000","last_unstale":"2024-04-25T09:11:26.786231+0000","last_undegraded":"2024-04-25T09:11:26.786231+0000","last_fullsized":"2024-04-25T09:11:26.786231+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:06.193412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070321+0000","last_change":"2024-04-25T09:11:26.794889+0000","last_active":"2024-04-25T09:11:28.070321+0000","last_peered":"2024-04-25T09:11:28.070321+0000","last_clean":"2024-04-25T09:11:28.070321+0000","last_became_active":"2024-04-25T09:11:26.794248+0000","last_became_peered":"2024-04-25T09:11:26.794248+0000","last_unstale":"2024-04-25T09:11:28.070321+0000","last_undegraded":"2024-04-25T09:11:28.070321+0000","last_fullsized":"2024-04-25T09:11:28.070321+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:48.355880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.773587+0000","last_change":"2024-04-25T09:11:25.786145+0000","last_active":"2024-04-25T09:11:26.773587+0000","last_peered":"2024-04-25T09:11:26.773587+0000","last_clean":"2024-04-25T09:11:26.773587+0000","last_became_active":"2024-04-25T09:11:25.785877+0000","last_became_peered":"2024-04-25T09:11:25.785877+0000","last_unstale":"2024-04-25T09:11:26.773587+0000","last_undegraded":"2024-04-25T09:11:26.773587+0000","last_fullsized":"2024-04-25T09:11:26.773587+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:46.425507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767784+0000","last_change":"2024-04-25T09:11:26.790428+0000","last_active":"2024-04-25T09:11:27.767784+0000","last_peered":"2024-04-25T09:11:27.767784+0000","last_clean":"2024-04-25T09:11:27.767784+0000","last_became_active":"2024-04-25T09:11:26.789545+0000","last_became_peered":"2024-04-25T09:11:26.789545+0000","last_unstale":"2024-04-25T09:11:27.767784+0000","last_undegraded":"2024-04-25T09:11:27.767784+0000","last_fullsized":"2024-04-25T09:11:27.767784+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:48.073136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767867+0000","last_change":"2024-04-25T09:11:25.784967+0000","last_active":"2024-04-25T09:11:27.767867+0000","last_peered":"2024-04-25T09:11:27.767867+0000","last_clean":"2024-04-25T09:11:27.767867+0000","last_became_active":"2024-04-25T09:11:25.784702+0000","last_became_peered":"2024-04-25T09:11:25.784702+0000","last_unstale":"2024-04-25T09:11:27.767867+0000","last_undegraded":"2024-04-25T09:11:27.767867+0000","last_fullsized":"2024-04-25T09:11:27.767867+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:47.656385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.795819+0000","last_change":"2024-04-25T09:11:26.792914+0000","last_active":"2024-04-25T09:11:26.795819+0000","last_peered":"2024-04-25T09:11:26.795819+0000","last_clean":"2024-04-25T09:11:26.795819+0000","last_became_active":"2024-04-25T09:11:26.792600+0000","last_became_peered":"2024-04-25T09:11:26.792600+0000","last_unstale":"2024-04-25T09:11:26.795819+0000","last_undegraded":"2024-04-25T09:11:26.795819+0000","last_fullsized":"2024-04-25T09:11:26.795819+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:42.179442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"122'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.772977+0000","last_change":"2024-04-25T09:11:25.785623+0000","last_active":"2024-04-25T09:11:28.772977+0000","last_peered":"2024-04-25T09:11:28.772977+0000","last_clean":"2024-04-25T09:11:28.772977+0000","last_became_active":"2024-04-25T09:11:25.785338+0000","last_became_peered":"2024-04-25T09:11:25.785338+0000","last_unstale":"2024-04-25T09:11:28.772977+0000","last_undegraded":"2024-04-25T09:11:28.772977+0000","last_fullsized":"2024-04-25T09:11:28.772977+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:10.566665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.791979+0000","last_change":"2024-04-25T09:11:26.786960+0000","last_active":"2024-04-25T09:11:26.791979+0000","last_peered":"2024-04-25T09:11:26.791979+0000","last_clean":"2024-04-25T09:11:26.791979+0000","last_became_active":"2024-04-25T09:11:26.785791+0000","last_became_peered":"2024-04-25T09:11:26.785791+0000","last_unstale":"2024-04-25T09:11:26.791979+0000","last_undegraded":"2024-04-25T09:11:26.791979+0000","last_fullsized":"2024-04-25T09:11:26.791979+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:04.305239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768313+0000","last_change":"2024-04-25T09:11:25.786163+0000","last_active":"2024-04-25T09:11:27.768313+0000","last_peered":"2024-04-25T09:11:27.768313+0000","last_clean":"2024-04-25T09:11:27.768313+0000","last_became_active":"2024-04-25T09:11:25.785903+0000","last_became_peered":"2024-04-25T09:11:25.785903+0000","last_unstale":"2024-04-25T09:11:27.768313+0000","last_undegraded":"2024-04-25T09:11:27.768313+0000","last_fullsized":"2024-04-25T09:11:27.768313+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:07.009279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.793418+0000","last_change":"2024-04-25T09:11:26.790380+0000","last_active":"2024-04-25T09:11:26.793418+0000","last_peered":"2024-04-25T09:11:26.793418+0000","last_clean":"2024-04-25T09:11:26.793418+0000","last_became_active":"2024-04-25T09:11:26.790013+0000","last_became_peered":"2024-04-25T09:11:26.790013+0000","last_unstale":"2024-04-25T09:11:26.793418+0000","last_undegraded":"2024-04-25T09:11:26.793418+0000","last_fullsized":"2024-04-25T09:11:26.793418+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:49.531791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767898+0000","last_change":"2024-04-25T09:11:25.785188+0000","last_active":"2024-04-25T09:11:27.767898+0000","last_peered":"2024-04-25T09:11:27.767898+0000","last_clean":"2024-04-25T09:11:27.767898+0000","last_became_active":"2024-04-25T09:11:25.779978+0000","last_became_peered":"2024-04-25T09:11:25.779978+0000","last_unstale":"2024-04-25T09:11:27.767898+0000","last_undegraded":"2024-04-25T09:11:27.767898+0000","last_fullsized":"2024-04-25T09:11:27.767898+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:38.992725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767281+0000","last_change":"2024-04-25T09:11:26.771533+0000","last_active":"2024-04-25T09:11:27.767281+0000","last_peered":"2024-04-25T09:11:27.767281+0000","last_clean":"2024-04-25T09:11:27.767281+0000","last_became_active":"2024-04-25T09:11:26.771206+0000","last_became_peered":"2024-04-25T09:11:26.771206+0000","last_unstale":"2024-04-25T09:11:27.767281+0000","last_undegraded":"2024-04-25T09:11:27.767281+0000","last_fullsized":"2024-04-25T09:11:27.767281+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:16.193785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768858+0000","last_change":"2024-04-25T09:11:25.786217+0000","last_active":"2024-04-25T09:11:27.768858+0000","last_peered":"2024-04-25T09:11:27.768858+0000","last_clean":"2024-04-25T09:11:27.768858+0000","last_became_active":"2024-04-25T09:11:25.785945+0000","last_became_peered":"2024-04-25T09:11:25.785945+0000","last_unstale":"2024-04-25T09:11:27.768858+0000","last_undegraded":"2024-04-25T09:11:27.768858+0000","last_fullsized":"2024-04-25T09:11:27.768858+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:36.050959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.804552+0000","last_change":"2024-04-25T09:11:26.786763+0000","last_active":"2024-04-25T09:11:26.804552+0000","last_peered":"2024-04-25T09:11:26.804552+0000","last_clean":"2024-04-25T09:11:26.804552+0000","last_became_active":"2024-04-25T09:11:26.786447+0000","last_became_peered":"2024-04-25T09:11:26.786447+0000","last_unstale":"2024-04-25T09:11:26.804552+0000","last_undegraded":"2024-04-25T09:11:26.804552+0000","last_fullsized":"2024-04-25T09:11:26.804552+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:55.473718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768686+0000","last_change":"2024-04-25T09:11:25.789039+0000","last_active":"2024-04-25T09:11:27.768686+0000","last_peered":"2024-04-25T09:11:27.768686+0000","last_clean":"2024-04-25T09:11:27.768686+0000","last_became_active":"2024-04-25T09:11:25.788749+0000","last_became_peered":"2024-04-25T09:11:25.788749+0000","last_unstale":"2024-04-25T09:11:27.768686+0000","last_undegraded":"2024-04-25T09:11:27.768686+0000","last_fullsized":"2024-04-25T09:11:27.768686+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:24.290504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.788832+0000","last_change":"2024-04-25T09:11:26.781923+0000","last_active":"2024-04-25T09:11:26.788832+0000","last_peered":"2024-04-25T09:11:26.788832+0000","last_clean":"2024-04-25T09:11:26.788832+0000","last_became_active":"2024-04-25T09:11:26.780479+0000","last_became_peered":"2024-04-25T09:11:26.780479+0000","last_unstale":"2024-04-25T09:11:26.788832+0000","last_undegraded":"2024-04-25T09:11:26.788832+0000","last_fullsized":"2024-04-25T09:11:26.788832+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:55.473718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767233+0000","last_change":"2024-04-25T09:11:25.781405+0000","last_active":"2024-04-25T09:11:27.767233+0000","last_peered":"2024-04-25T09:11:27.767233+0000","last_clean":"2024-04-25T09:11:27.767233+0000","last_became_active":"2024-04-25T09:11:25.781100+0000","last_became_peered":"2024-04-25T09:11:25.781100+0000","last_unstale":"2024-04-25T09:11:27.767233+0000","last_undegraded":"2024-04-25T09:11:27.767233+0000","last_fullsized":"2024-04-25T09:11:27.767233+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:10.988280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.800732+0000","last_change":"2024-04-25T09:11:26.798742+0000","last_active":"2024-04-25T09:11:26.800732+0000","last_peered":"2024-04-25T09:11:26.800732+0000","last_clean":"2024-04-25T09:11:26.800732+0000","last_became_active":"2024-04-25T09:11:26.798468+0000","last_became_peered":"2024-04-25T09:11:26.798468+0000","last_unstale":"2024-04-25T09:11:26.800732+0000","last_undegraded":"2024-04-25T09:11:26.800732+0000","last_fullsized":"2024-04-25T09:11:26.800732+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:10.151989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.773757+0000","last_change":"2024-04-25T09:11:25.780949+0000","last_active":"2024-04-25T09:11:26.773757+0000","last_peered":"2024-04-25T09:11:26.773757+0000","last_clean":"2024-04-25T09:11:26.773757+0000","last_became_active":"2024-04-25T09:11:25.780664+0000","last_became_peered":"2024-04-25T09:11:25.780664+0000","last_unstale":"2024-04-25T09:11:26.773757+0000","last_undegraded":"2024-04-25T09:11:26.773757+0000","last_fullsized":"2024-04-25T09:11:26.773757+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:52.742093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.795608+0000","last_change":"2024-04-25T09:11:26.793502+0000","last_active":"2024-04-25T09:11:26.795608+0000","last_peered":"2024-04-25T09:11:26.795608+0000","last_clean":"2024-04-25T09:11:26.795608+0000","last_became_active":"2024-04-25T09:11:26.792794+0000","last_became_peered":"2024-04-25T09:11:26.792794+0000","last_unstale":"2024-04-25T09:11:26.795608+0000","last_undegraded":"2024-04-25T09:11:26.795608+0000","last_fullsized":"2024-04-25T09:11:26.795608+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:40.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"121'8","reported_seq":20,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.809444+0000","last_change":"2024-04-25T09:11:25.787740+0000","last_active":"2024-04-25T09:11:26.809444+0000","last_peered":"2024-04-25T09:11:26.809444+0000","last_clean":"2024-04-25T09:11:26.809444+0000","last_became_active":"2024-04-25T09:11:25.786106+0000","last_became_peered":"2024-04-25T09:11:25.786106+0000","last_unstale":"2024-04-25T09:11:26.809444+0000","last_undegraded":"2024-04-25T09:11:26.809444+0000","last_fullsized":"2024-04-25T09:11:26.809444+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:53.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":354,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.773820+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:11:26.773820+0000","last_peered":"2024-04-25T09:11:26.773820+0000","last_clean":"2024-04-25T09:11:26.773820+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:11:26.773820+0000","last_undegraded":"2024-04-25T09:11:26.773820+0000","last_fullsized":"2024-04-25T09:11:26.773820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509549,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50708,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321132,"statfs":{"total":96636764160,"available":96584839168,"internally_reserved":0,"allocated":1515520,"data_stored":703826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509549,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50712,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321128,"statfs":{"total":96636764160,"available":96584835072,"internally_reserved":0,"allocated":1519616,"data_stored":703404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509550,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59040,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312800,"statfs":{"total":96636764160,"available":96576307200,"internally_reserved":0,"allocated":1523712,"data_stored":704856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509549,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54868,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316972,"statfs":{"total":96636764160,"available":96580579328,"internally_reserved":0,"allocated":1515520,"data_stored":698198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509549,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54856,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316984,"statfs":{"total":96636764160,"available":96580591616,"internally_reserved":0,"allocated":1499136,"data_stored":696552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509550,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50704,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321136,"statfs":{"total":96636764160,"available":96584843264,"internally_reserved":0,"allocated":1503232,"data_stored":696574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509550,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55448,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316392,"statfs":{"total":96636764160,"available":96579985408,"internally_reserved":0,"allocated":2109440,"data_stored":1293634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574957,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51268,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320572,"statfs":{"total":96636764160,"available":96584265728,"internally_reserved":0,"allocated":2080768,"data_stored":1279753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:11:31.214 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:11:31.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.402+0000 7fde02e00640 1 Processor -- start 2024-04-25T09:11:31.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.402+0000 7fde02e00640 1 -- start start 2024-04-25T09:11:31.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.402+0000 7fde02e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fddfc160fe0 0x7fddfc161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.402+0000 7fde02e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fddfc06bca0 0x7fddfc06c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.402+0000 7fde02e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddfc061d60 con 0x7fddfc06dac0 2024-04-25T09:11:31.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.402+0000 7fde02e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddfc0ad510 con 0x7fddfc160fe0 2024-04-25T09:11:31.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.402+0000 7fde02e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddfc1613c0 con 0x7fddfc06bca0 2024-04-25T09:11:31.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.406+0000 7fddfbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fddfc160fe0 0x7fddfc161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.406+0000 7fddfbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fddfc160fe0 0x7fddfc161fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36824/0 (socket says 172.21.15.173:36824) 2024-04-25T09:11:31.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.406+0000 7fddfbe00640 1 -- 172.21.15.173:0/3904147268 learned_addr learned my addr 172.21.15.173:0/3904147268 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:31.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.406+0000 7fddfb400640 1 --1- 172.21.15.173:0/3904147268 >> v1:172.21.15.173:6789/0 conn(0x7fddfc06dac0 0x7fddfc0ace00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46456/0 (socket says 172.21.15.173:46456) 2024-04-25T09:11:31.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.406+0000 7fde00e00640 1 --2- 172.21.15.173:0/3904147268 >> v2:172.21.15.194:3300/0 conn(0x7fddfc06bca0 0x7fddfc06c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.406+0000 7fddfbe00640 1 -- 172.21.15.173:0/3904147268 >> v2:172.21.15.194:3300/0 conn(0x7fddfc06bca0 msgr2=0x7fddfc06c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:31.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.406+0000 7fddfbe00640 1 --2- 172.21.15.173:0/3904147268 >> v2:172.21.15.194:3300/0 conn(0x7fddfc06bca0 0x7fddfc06c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.406+0000 7fddfbe00640 1 -- 172.21.15.173:0/3904147268 >> v1:172.21.15.173:6789/0 conn(0x7fddfc06dac0 legacy=0x7fddfc0ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.406+0000 7fddfbe00640 1 -- 172.21.15.173:0/3904147268 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc06dfa0 con 0x7fddfc160fe0 2024-04-25T09:11:31.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.406+0000 7fddfaa00640 1 -- 172.21.15.173:0/3904147268 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482150454 0 0) 0x7fdde8001120 con 0x7fddfc06dac0 2024-04-25T09:11:31.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.406+0000 7fde00e00640 1 --2- 172.21.15.173:0/3904147268 >> v2:172.21.15.194:3300/0 conn(0x7fddfc06bca0 0x7fddfc06c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:31.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.406+0000 7fddfbe00640 1 --2- 172.21.15.173:0/3904147268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddfc160fe0 0x7fddfc161fb0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fddfc062040 tx=0x7fddec01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73210d623168c2aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:31.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.406+0000 7fddfaa00640 1 -- 172.21.15.173:0/3904147268 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0b2070 con 0x7fddfc160fe0 2024-04-25T09:11:31.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.406+0000 7fddfaa00640 1 -- 172.21.15.173:0/3904147268 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec0ad680 con 0x7fddfc160fe0 2024-04-25T09:11:31.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.406+0000 7fddfaa00640 1 -- 172.21.15.173:0/3904147268 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0ada50 con 0x7fddfc160fe0 2024-04-25T09:11:31.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fde02e00640 1 -- 172.21.15.173:0/3904147268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddfc160fe0 msgr2=0x7fddfc161fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fde02e00640 1 --2- 172.21.15.173:0/3904147268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddfc160fe0 0x7fddfc161fb0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fddfc062040 tx=0x7fddec01c490 comp rx=0 tx=0).stop 2024-04-25T09:11:31.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fde02e00640 1 -- 172.21.15.173:0/3904147268 shutdown_connections 2024-04-25T09:11:31.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fde02e00640 1 --2- 172.21.15.173:0/3904147268 >> v2:172.21.15.194:3300/0 conn(0x7fddfc06bca0 0x7fddfc06c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fde02e00640 1 --2- 172.21.15.173:0/3904147268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddfc160fe0 0x7fddfc161fb0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fde02e00640 1 -- 172.21.15.173:0/3904147268 >> 172.21.15.173:0/3904147268 conn(0x7fddfc071c20 msgr2=0x7fddfc072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:31.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fde02e00640 1 -- 172.21.15.173:0/3904147268 shutdown_connections 2024-04-25T09:11:31.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fde02e00640 1 -- 172.21.15.173:0/3904147268 wait complete. 2024-04-25T09:11:31.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fde02e00640 1 Processor -- start 2024-04-25T09:11:31.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fde02e00640 1 -- start start 2024-04-25T09:11:31.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fde02e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddfc06bca0 0x7fddfc136810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fde02e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddfc06dac0 0x7fddfc14f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fde02e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddfc160fe0 0x7fddfc0ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fde02e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc1624f0 con 0x7fddfc06bca0 2024-04-25T09:11:31.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fde02e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc06eb20 con 0x7fddfc160fe0 2024-04-25T09:11:31.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fde02e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc06f850 con 0x7fddfc06dac0 2024-04-25T09:11:31.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fddfbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddfc06bca0 0x7fddfc136810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fddfbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddfc06bca0 0x7fddfc136810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36830/0 (socket says 172.21.15.173:36830) 2024-04-25T09:11:31.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fddfbe00640 1 -- 172.21.15.173:0/2899969939 learned_addr learned my addr 172.21.15.173:0/2899969939 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:31.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fddfb400640 1 --2- 172.21.15.173:0/2899969939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddfc06dac0 0x7fddfc14f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fde00e00640 1 --2- 172.21.15.173:0/2899969939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddfc160fe0 0x7fddfc0ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fddfbe00640 1 -- 172.21.15.173:0/2899969939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddfc06dac0 msgr2=0x7fddfc14f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fddfbe00640 1 --2- 172.21.15.173:0/2899969939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddfc06dac0 0x7fddfc14f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fddfbe00640 1 -- 172.21.15.173:0/2899969939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddfc160fe0 msgr2=0x7fddfc0ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fddfbe00640 1 --2- 172.21.15.173:0/2899969939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddfc160fe0 0x7fddfc0ae810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fddfbe00640 1 -- 172.21.15.173:0/2899969939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc148a70 con 0x7fddfc06bca0 2024-04-25T09:11:31.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fddfb400640 1 --2- 172.21.15.173:0/2899969939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddfc06dac0 0x7fddfc14f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:31.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.410+0000 7fde00e00640 1 --2- 172.21.15.173:0/2899969939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddfc160fe0 0x7fddfc0ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:31.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.414+0000 7fddfbe00640 1 --2- 172.21.15.173:0/2899969939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddfc06bca0 0x7fddfc136810 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fddec01a0c0 tx=0x7fddec01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:31.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.414+0000 7fddf3e00640 1 -- 172.21.15.173:0/2899969939 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0bc020 con 0x7fddfc06bca0 2024-04-25T09:11:31.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.414+0000 7fddf3e00640 1 -- 172.21.15.173:0/2899969939 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec0adcf0 con 0x7fddfc06bca0 2024-04-25T09:11:31.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.414+0000 7fddf3e00640 1 -- 172.21.15.173:0/2899969939 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0b2040 con 0x7fddfc06bca0 2024-04-25T09:11:31.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.414+0000 7fde02e00640 1 -- 172.21.15.173:0/2899969939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddfc148d50 con 0x7fddfc06bca0 2024-04-25T09:11:31.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.414+0000 7fde02e00640 1 -- 172.21.15.173:0/2899969939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddfc1557e0 con 0x7fddfc06bca0 2024-04-25T09:11:31.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.414+0000 7fde02e00640 1 -- 172.21.15.173:0/2899969939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddfc073a40 con 0x7fddfc06bca0 2024-04-25T09:11:31.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.414+0000 7fddf3e00640 1 -- 172.21.15.173:0/2899969939 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fddec0bf020 con 0x7fddfc06bca0 2024-04-25T09:11:31.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.414+0000 7fddf3e00640 1 --2- 172.21.15.173:0/2899969939 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdddc066f60 0x7fdddc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.414+0000 7fddf3e00640 1 -- 172.21.15.173:0/2899969939 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fddec11f2a0 con 0x7fddfc06bca0 2024-04-25T09:11:31.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.414+0000 7fddfb400640 1 --2- 172.21.15.173:0/2899969939 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdddc066f60 0x7fdddc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.418+0000 7fddfb400640 1 --2- 172.21.15.173:0/2899969939 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdddc066f60 0x7fdddc069420 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fdde8007fd0 tx=0x7fdde8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:31.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.418+0000 7fddf3e00640 1 -- 172.21.15.173:0/2899969939 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fddec0c6030 con 0x7fddfc06bca0 2024-04-25T09:11:31.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.570+0000 7fde02e00640 1 -- 172.21.15.173:0/2899969939 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fddfc15d220 con 0x7fdddc066f60 2024-04-25T09:11:31.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.574+0000 7fddf3e00640 1 -- 172.21.15.173:0/2899969939 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252382 (secure 0 0 0) 0x7fddfc15d220 con 0x7fdddc066f60 2024-04-25T09:11:31.563 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:31.565 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:11:31.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.578+0000 7fde02e00640 1 -- 172.21.15.173:0/2899969939 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdddc066f60 msgr2=0x7fdddc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.578+0000 7fde02e00640 1 --2- 172.21.15.173:0/2899969939 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdddc066f60 0x7fdddc069420 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fdde8007fd0 tx=0x7fdde8009040 comp rx=0 tx=0).stop 2024-04-25T09:11:31.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.578+0000 7fde02e00640 1 -- 172.21.15.173:0/2899969939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddfc06bca0 msgr2=0x7fddfc136810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.578+0000 7fde02e00640 1 --2- 172.21.15.173:0/2899969939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddfc06bca0 0x7fddfc136810 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fddec01a0c0 tx=0x7fddec01acd0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.578+0000 7fde02e00640 1 -- 172.21.15.173:0/2899969939 shutdown_connections 2024-04-25T09:11:31.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.578+0000 7fde02e00640 1 --2- 172.21.15.173:0/2899969939 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdddc066f60 0x7fdddc069420 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.578+0000 7fde02e00640 1 --2- 172.21.15.173:0/2899969939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddfc160fe0 0x7fddfc0ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.578+0000 7fde02e00640 1 --2- 172.21.15.173:0/2899969939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddfc06dac0 0x7fddfc14f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.578+0000 7fde02e00640 1 --2- 172.21.15.173:0/2899969939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddfc06bca0 0x7fddfc136810 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.578+0000 7fde02e00640 1 -- 172.21.15.173:0/2899969939 >> 172.21.15.173:0/2899969939 conn(0x7fddfc071c20 msgr2=0x7fddfc1510e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:31.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.578+0000 7fde02e00640 1 -- 172.21.15.173:0/2899969939 shutdown_connections 2024-04-25T09:11:31.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.578+0000 7fde02e00640 1 -- 172.21.15.173:0/2899969939 wait complete. 2024-04-25T09:11:31.583 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":382,"stamp":"2024-04-25T09:11:30.841729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":427604,"kb_used_data":12956,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754547116,"statfs":{"total":773094113280,"available":772656246784,"internally_reserved":0,"allocated":13266944,"data_stored":6776797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":424463920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001199"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768987+0000","last_change":"2024-04-25T09:11:26.787243+0000","last_active":"2024-04-25T09:11:27.768987+0000","last_peered":"2024-04-25T09:11:27.768987+0000","last_clean":"2024-04-25T09:11:27.768987+0000","last_became_active":"2024-04-25T09:11:26.786975+0000","last_became_peered":"2024-04-25T09:11:26.786975+0000","last_unstale":"2024-04-25T09:11:27.768987+0000","last_undegraded":"2024-04-25T09:11:27.768987+0000","last_fullsized":"2024-04-25T09:11:27.768987+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:30.819327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.808070+0000","last_change":"2024-04-25T09:11:26.806403+0000","last_active":"2024-04-25T09:11:26.808070+0000","last_peered":"2024-04-25T09:11:26.808070+0000","last_clean":"2024-04-25T09:11:26.808070+0000","last_became_active":"2024-04-25T09:11:26.804718+0000","last_became_peered":"2024-04-25T09:11:26.804718+0000","last_unstale":"2024-04-25T09:11:26.808070+0000","last_undegraded":"2024-04-25T09:11:26.808070+0000","last_fullsized":"2024-04-25T09:11:26.808070+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:09.911379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.804401+0000","last_change":"2024-04-25T09:11:26.794706+0000","last_active":"2024-04-25T09:11:26.804401+0000","last_peered":"2024-04-25T09:11:26.804401+0000","last_clean":"2024-04-25T09:11:26.804401+0000","last_became_active":"2024-04-25T09:11:26.794366+0000","last_became_peered":"2024-04-25T09:11:26.794366+0000","last_unstale":"2024-04-25T09:11:26.804401+0000","last_undegraded":"2024-04-25T09:11:26.804401+0000","last_fullsized":"2024-04-25T09:11:26.804401+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:56.161415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.788996+0000","last_change":"2024-04-25T09:11:26.784135+0000","last_active":"2024-04-25T09:11:26.788996+0000","last_peered":"2024-04-25T09:11:26.788996+0000","last_clean":"2024-04-25T09:11:26.788996+0000","last_became_active":"2024-04-25T09:11:26.783850+0000","last_became_peered":"2024-04-25T09:11:26.783850+0000","last_unstale":"2024-04-25T09:11:26.788996+0000","last_undegraded":"2024-04-25T09:11:26.788996+0000","last_fullsized":"2024-04-25T09:11:26.788996+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:30.057861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768372+0000","last_change":"2024-04-25T09:11:26.771408+0000","last_active":"2024-04-25T09:11:27.768372+0000","last_peered":"2024-04-25T09:11:27.768372+0000","last_clean":"2024-04-25T09:11:27.768372+0000","last_became_active":"2024-04-25T09:11:26.771106+0000","last_became_peered":"2024-04-25T09:11:26.771106+0000","last_unstale":"2024-04-25T09:11:27.768372+0000","last_undegraded":"2024-04-25T09:11:27.768372+0000","last_fullsized":"2024-04-25T09:11:27.768372+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:20.917299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767559+0000","last_change":"2024-04-25T09:11:26.797018+0000","last_active":"2024-04-25T09:11:27.767559+0000","last_peered":"2024-04-25T09:11:27.767559+0000","last_clean":"2024-04-25T09:11:27.767559+0000","last_became_active":"2024-04-25T09:11:26.796767+0000","last_became_peered":"2024-04-25T09:11:26.796767+0000","last_unstale":"2024-04-25T09:11:27.767559+0000","last_undegraded":"2024-04-25T09:11:27.767559+0000","last_fullsized":"2024-04-25T09:11:27.767559+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:03.914384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767133+0000","last_change":"2024-04-25T09:11:26.778696+0000","last_active":"2024-04-25T09:11:27.767133+0000","last_peered":"2024-04-25T09:11:27.767133+0000","last_clean":"2024-04-25T09:11:27.767133+0000","last_became_active":"2024-04-25T09:11:26.778367+0000","last_became_peered":"2024-04-25T09:11:26.778367+0000","last_unstale":"2024-04-25T09:11:27.767133+0000","last_undegraded":"2024-04-25T09:11:27.767133+0000","last_fullsized":"2024-04-25T09:11:27.767133+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:36.182448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.805017+0000","last_change":"2024-04-25T09:11:26.794235+0000","last_active":"2024-04-25T09:11:26.805017+0000","last_peered":"2024-04-25T09:11:26.805017+0000","last_clean":"2024-04-25T09:11:26.805017+0000","last_became_active":"2024-04-25T09:11:26.793919+0000","last_became_peered":"2024-04-25T09:11:26.793919+0000","last_unstale":"2024-04-25T09:11:26.805017+0000","last_undegraded":"2024-04-25T09:11:26.805017+0000","last_fullsized":"2024-04-25T09:11:26.805017+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:40.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":3,"reported_epoch":121,"state":"creating+activating","last_fresh":"2024-04-25T09:11:26.777365+0000","last_change":"2024-04-25T09:11:26.777365+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:26.777365+0000","last_undegraded":"2024-04-25T09:11:26.777365+0000","last_fullsized":"2024-04-25T09:11:26.777365+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.788460+0000","last_change":"2024-04-25T09:11:26.786628+0000","last_active":"2024-04-25T09:11:26.788460+0000","last_peered":"2024-04-25T09:11:26.788460+0000","last_clean":"2024-04-25T09:11:26.788460+0000","last_became_active":"2024-04-25T09:11:26.786348+0000","last_became_peered":"2024-04-25T09:11:26.786348+0000","last_unstale":"2024-04-25T09:11:26.788460+0000","last_undegraded":"2024-04-25T09:11:26.788460+0000","last_fullsized":"2024-04-25T09:11:26.788460+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:43.578822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.769033+0000","last_change":"2024-04-25T09:11:26.783292+0000","last_active":"2024-04-25T09:11:27.769033+0000","last_peered":"2024-04-25T09:11:27.769033+0000","last_clean":"2024-04-25T09:11:27.769033+0000","last_became_active":"2024-04-25T09:11:26.783017+0000","last_became_peered":"2024-04-25T09:11:26.783017+0000","last_unstale":"2024-04-25T09:11:27.769033+0000","last_undegraded":"2024-04-25T09:11:27.769033+0000","last_fullsized":"2024-04-25T09:11:27.769033+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:44.158295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767635+0000","last_change":"2024-04-25T09:11:26.772025+0000","last_active":"2024-04-25T09:11:27.767635+0000","last_peered":"2024-04-25T09:11:27.767635+0000","last_clean":"2024-04-25T09:11:27.767635+0000","last_became_active":"2024-04-25T09:11:26.771747+0000","last_became_peered":"2024-04-25T09:11:26.771747+0000","last_unstale":"2024-04-25T09:11:27.767635+0000","last_undegraded":"2024-04-25T09:11:27.767635+0000","last_fullsized":"2024-04-25T09:11:27.767635+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:01.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.792314+0000","last_change":"2024-04-25T09:11:26.787942+0000","last_active":"2024-04-25T09:11:26.792314+0000","last_peered":"2024-04-25T09:11:26.792314+0000","last_clean":"2024-04-25T09:11:26.792314+0000","last_became_active":"2024-04-25T09:11:26.787585+0000","last_became_peered":"2024-04-25T09:11:26.787585+0000","last_unstale":"2024-04-25T09:11:26.792314+0000","last_undegraded":"2024-04-25T09:11:26.792314+0000","last_fullsized":"2024-04-25T09:11:26.792314+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:06.710197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.807110+0000","last_change":"2024-04-25T09:11:26.801981+0000","last_active":"2024-04-25T09:11:26.807110+0000","last_peered":"2024-04-25T09:11:26.807110+0000","last_clean":"2024-04-25T09:11:26.807110+0000","last_became_active":"2024-04-25T09:11:26.794868+0000","last_became_peered":"2024-04-25T09:11:26.794868+0000","last_unstale":"2024-04-25T09:11:26.807110+0000","last_undegraded":"2024-04-25T09:11:26.807110+0000","last_fullsized":"2024-04-25T09:11:26.807110+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:53.484584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767548+0000","last_change":"2024-04-25T09:11:26.782835+0000","last_active":"2024-04-25T09:11:27.767548+0000","last_peered":"2024-04-25T09:11:27.767548+0000","last_clean":"2024-04-25T09:11:27.767548+0000","last_became_active":"2024-04-25T09:11:26.782340+0000","last_became_peered":"2024-04-25T09:11:26.782340+0000","last_unstale":"2024-04-25T09:11:27.767548+0000","last_undegraded":"2024-04-25T09:11:27.767548+0000","last_fullsized":"2024-04-25T09:11:27.767548+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:18.339218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767110+0000","last_change":"2024-04-25T09:11:26.795334+0000","last_active":"2024-04-25T09:11:27.767110+0000","last_peered":"2024-04-25T09:11:27.767110+0000","last_clean":"2024-04-25T09:11:27.767110+0000","last_became_active":"2024-04-25T09:11:26.794720+0000","last_became_peered":"2024-04-25T09:11:26.794720+0000","last_unstale":"2024-04-25T09:11:27.767110+0000","last_undegraded":"2024-04-25T09:11:27.767110+0000","last_fullsized":"2024-04-25T09:11:27.767110+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:17.010143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.790261+0000","last_change":"2024-04-25T09:11:26.788198+0000","last_active":"2024-04-25T09:11:26.790261+0000","last_peered":"2024-04-25T09:11:26.790261+0000","last_clean":"2024-04-25T09:11:26.790261+0000","last_became_active":"2024-04-25T09:11:26.787463+0000","last_became_peered":"2024-04-25T09:11:26.787463+0000","last_unstale":"2024-04-25T09:11:26.790261+0000","last_undegraded":"2024-04-25T09:11:26.790261+0000","last_fullsized":"2024-04-25T09:11:26.790261+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:09.020019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.808049+0000","last_change":"2024-04-25T09:11:26.804889+0000","last_active":"2024-04-25T09:11:26.808049+0000","last_peered":"2024-04-25T09:11:26.808049+0000","last_clean":"2024-04-25T09:11:26.808049+0000","last_became_active":"2024-04-25T09:11:26.804397+0000","last_became_peered":"2024-04-25T09:11:26.804397+0000","last_unstale":"2024-04-25T09:11:26.808049+0000","last_undegraded":"2024-04-25T09:11:26.808049+0000","last_fullsized":"2024-04-25T09:11:26.808049+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:08.462078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768173+0000","last_change":"2024-04-25T09:11:26.782877+0000","last_active":"2024-04-25T09:11:27.768173+0000","last_peered":"2024-04-25T09:11:27.768173+0000","last_clean":"2024-04-25T09:11:27.768173+0000","last_became_active":"2024-04-25T09:11:26.782538+0000","last_became_peered":"2024-04-25T09:11:26.782538+0000","last_unstale":"2024-04-25T09:11:27.768173+0000","last_undegraded":"2024-04-25T09:11:27.768173+0000","last_fullsized":"2024-04-25T09:11:27.768173+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:02.178137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.795822+0000","last_change":"2024-04-25T09:11:26.791381+0000","last_active":"2024-04-25T09:11:26.795822+0000","last_peered":"2024-04-25T09:11:26.795822+0000","last_clean":"2024-04-25T09:11:26.795822+0000","last_became_active":"2024-04-25T09:11:26.789379+0000","last_became_peered":"2024-04-25T09:11:26.789379+0000","last_unstale":"2024-04-25T09:11:26.795822+0000","last_undegraded":"2024-04-25T09:11:26.795822+0000","last_fullsized":"2024-04-25T09:11:26.795822+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:27.017599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.795392+0000","last_change":"2024-04-25T09:11:26.793939+0000","last_active":"2024-04-25T09:11:26.795392+0000","last_peered":"2024-04-25T09:11:26.795392+0000","last_clean":"2024-04-25T09:11:26.795392+0000","last_became_active":"2024-04-25T09:11:26.792032+0000","last_became_peered":"2024-04-25T09:11:26.792032+0000","last_unstale":"2024-04-25T09:11:26.795392+0000","last_undegraded":"2024-04-25T09:11:26.795392+0000","last_fullsized":"2024-04-25T09:11:26.795392+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:07.110094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.769149+0000","last_change":"2024-04-25T09:11:26.798320+0000","last_active":"2024-04-25T09:11:27.769149+0000","last_peered":"2024-04-25T09:11:27.769149+0000","last_clean":"2024-04-25T09:11:27.769149+0000","last_became_active":"2024-04-25T09:11:26.797870+0000","last_became_peered":"2024-04-25T09:11:26.797870+0000","last_unstale":"2024-04-25T09:11:27.769149+0000","last_undegraded":"2024-04-25T09:11:27.769149+0000","last_fullsized":"2024-04-25T09:11:27.769149+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:48.355880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.801768+0000","last_change":"2024-04-25T09:11:26.801768+0000","last_active":"2024-04-25T09:11:26.801768+0000","last_peered":"2024-04-25T09:11:26.801768+0000","last_clean":"2024-04-25T09:11:26.801768+0000","last_became_active":"2024-04-25T09:11:26.801480+0000","last_became_peered":"2024-04-25T09:11:26.801480+0000","last_unstale":"2024-04-25T09:11:26.801768+0000","last_undegraded":"2024-04-25T09:11:26.801768+0000","last_fullsized":"2024-04-25T09:11:26.801768+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:10.217192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070205+0000","last_change":"2024-04-25T09:11:26.790623+0000","last_active":"2024-04-25T09:11:28.070205+0000","last_peered":"2024-04-25T09:11:28.070205+0000","last_clean":"2024-04-25T09:11:28.070205+0000","last_became_active":"2024-04-25T09:11:26.790108+0000","last_became_peered":"2024-04-25T09:11:26.790108+0000","last_unstale":"2024-04-25T09:11:28.070205+0000","last_undegraded":"2024-04-25T09:11:28.070205+0000","last_fullsized":"2024-04-25T09:11:28.070205+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:30.819327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070601+0000","last_change":"2024-04-25T09:11:26.783160+0000","last_active":"2024-04-25T09:11:28.070601+0000","last_peered":"2024-04-25T09:11:28.070601+0000","last_clean":"2024-04-25T09:11:28.070601+0000","last_became_active":"2024-04-25T09:11:26.782852+0000","last_became_peered":"2024-04-25T09:11:26.782852+0000","last_unstale":"2024-04-25T09:11:28.070601+0000","last_undegraded":"2024-04-25T09:11:28.070601+0000","last_fullsized":"2024-04-25T09:11:28.070601+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:08.011751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.797781+0000","last_change":"2024-04-25T09:11:26.792420+0000","last_active":"2024-04-25T09:11:26.797781+0000","last_peered":"2024-04-25T09:11:26.797781+0000","last_clean":"2024-04-25T09:11:26.797781+0000","last_became_active":"2024-04-25T09:11:26.792149+0000","last_became_peered":"2024-04-25T09:11:26.792149+0000","last_unstale":"2024-04-25T09:11:26.797781+0000","last_undegraded":"2024-04-25T09:11:26.797781+0000","last_fullsized":"2024-04-25T09:11:26.797781+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:35.433281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768495+0000","last_change":"2024-04-25T09:11:26.780285+0000","last_active":"2024-04-25T09:11:27.768495+0000","last_peered":"2024-04-25T09:11:27.768495+0000","last_clean":"2024-04-25T09:11:27.768495+0000","last_became_active":"2024-04-25T09:11:26.780022+0000","last_became_peered":"2024-04-25T09:11:26.780022+0000","last_unstale":"2024-04-25T09:11:27.768495+0000","last_undegraded":"2024-04-25T09:11:27.768495+0000","last_fullsized":"2024-04-25T09:11:27.768495+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:41.102958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767748+0000","last_change":"2024-04-25T09:11:26.781347+0000","last_active":"2024-04-25T09:11:27.767748+0000","last_peered":"2024-04-25T09:11:27.767748+0000","last_clean":"2024-04-25T09:11:27.767748+0000","last_became_active":"2024-04-25T09:11:26.781120+0000","last_became_peered":"2024-04-25T09:11:26.781120+0000","last_unstale":"2024-04-25T09:11:27.767748+0000","last_undegraded":"2024-04-25T09:11:27.767748+0000","last_fullsized":"2024-04-25T09:11:27.767748+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:01.534619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.806525+0000","last_change":"2024-04-25T09:11:26.805666+0000","last_active":"2024-04-25T09:11:26.806525+0000","last_peered":"2024-04-25T09:11:26.806525+0000","last_clean":"2024-04-25T09:11:26.806525+0000","last_became_active":"2024-04-25T09:11:26.805395+0000","last_became_peered":"2024-04-25T09:11:26.805395+0000","last_unstale":"2024-04-25T09:11:26.806525+0000","last_undegraded":"2024-04-25T09:11:26.806525+0000","last_fullsized":"2024-04-25T09:11:26.806525+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:50.859865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.806206+0000","last_change":"2024-04-25T09:11:26.793946+0000","last_active":"2024-04-25T09:11:26.806206+0000","last_peered":"2024-04-25T09:11:26.806206+0000","last_clean":"2024-04-25T09:11:26.806206+0000","last_became_active":"2024-04-25T09:11:26.784942+0000","last_became_peered":"2024-04-25T09:11:26.784942+0000","last_unstale":"2024-04-25T09:11:26.806206+0000","last_undegraded":"2024-04-25T09:11:26.806206+0000","last_fullsized":"2024-04-25T09:11:26.806206+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:30.057861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070246+0000","last_change":"2024-04-25T09:11:26.795695+0000","last_active":"2024-04-25T09:11:28.070246+0000","last_peered":"2024-04-25T09:11:28.070246+0000","last_clean":"2024-04-25T09:11:28.070246+0000","last_became_active":"2024-04-25T09:11:26.795419+0000","last_became_peered":"2024-04-25T09:11:26.795419+0000","last_unstale":"2024-04-25T09:11:28.070246+0000","last_undegraded":"2024-04-25T09:11:28.070246+0000","last_fullsized":"2024-04-25T09:11:28.070246+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:03.214507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070156+0000","last_change":"2024-04-25T09:11:26.790369+0000","last_active":"2024-04-25T09:11:28.070156+0000","last_peered":"2024-04-25T09:11:28.070156+0000","last_clean":"2024-04-25T09:11:28.070156+0000","last_became_active":"2024-04-25T09:11:26.789737+0000","last_became_peered":"2024-04-25T09:11:26.789737+0000","last_unstale":"2024-04-25T09:11:28.070156+0000","last_undegraded":"2024-04-25T09:11:28.070156+0000","last_fullsized":"2024-04-25T09:11:28.070156+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:44.158295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.791717+0000","last_change":"2024-04-25T09:11:26.787994+0000","last_active":"2024-04-25T09:11:26.791717+0000","last_peered":"2024-04-25T09:11:26.791717+0000","last_clean":"2024-04-25T09:11:26.791717+0000","last_became_active":"2024-04-25T09:11:26.787717+0000","last_became_peered":"2024-04-25T09:11:26.787717+0000","last_unstale":"2024-04-25T09:11:26.791717+0000","last_undegraded":"2024-04-25T09:11:26.791717+0000","last_fullsized":"2024-04-25T09:11:26.791717+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:12.274747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"121'4","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768329+0000","last_change":"2024-04-25T09:11:25.782496+0000","last_active":"2024-04-25T09:11:27.768329+0000","last_peered":"2024-04-25T09:11:27.768329+0000","last_clean":"2024-04-25T09:11:27.768329+0000","last_became_active":"2024-04-25T09:11:25.782211+0000","last_became_peered":"2024-04-25T09:11:25.782211+0000","last_unstale":"2024-04-25T09:11:27.768329+0000","last_undegraded":"2024-04-25T09:11:27.768329+0000","last_fullsized":"2024-04-25T09:11:27.768329+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:43.030827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767536+0000","last_change":"2024-04-25T09:11:26.803328+0000","last_active":"2024-04-25T09:11:27.767536+0000","last_peered":"2024-04-25T09:11:27.767536+0000","last_clean":"2024-04-25T09:11:27.767536+0000","last_became_active":"2024-04-25T09:11:26.802977+0000","last_became_peered":"2024-04-25T09:11:26.802977+0000","last_unstale":"2024-04-25T09:11:27.767536+0000","last_undegraded":"2024-04-25T09:11:27.767536+0000","last_fullsized":"2024-04-25T09:11:27.767536+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:18.825168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"121'1","reported_seq":13,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.803602+0000","last_change":"2024-04-25T09:11:25.789063+0000","last_active":"2024-04-25T09:11:26.803602+0000","last_peered":"2024-04-25T09:11:26.803602+0000","last_clean":"2024-04-25T09:11:26.803602+0000","last_became_active":"2024-04-25T09:11:25.788745+0000","last_became_peered":"2024-04-25T09:11:25.788745+0000","last_unstale":"2024-04-25T09:11:26.803602+0000","last_undegraded":"2024-04-25T09:11:26.803602+0000","last_fullsized":"2024-04-25T09:11:26.803602+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:26:16.606333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070386+0000","last_change":"2024-04-25T09:11:26.780782+0000","last_active":"2024-04-25T09:11:28.070386+0000","last_peered":"2024-04-25T09:11:28.070386+0000","last_clean":"2024-04-25T09:11:28.070386+0000","last_became_active":"2024-04-25T09:11:26.780519+0000","last_became_peered":"2024-04-25T09:11:26.780519+0000","last_unstale":"2024-04-25T09:11:28.070386+0000","last_undegraded":"2024-04-25T09:11:28.070386+0000","last_fullsized":"2024-04-25T09:11:28.070386+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:44.033298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"121'2","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.798594+0000","last_change":"2024-04-25T09:11:25.788687+0000","last_active":"2024-04-25T09:11:26.798594+0000","last_peered":"2024-04-25T09:11:26.798594+0000","last_clean":"2024-04-25T09:11:26.798594+0000","last_became_active":"2024-04-25T09:11:25.788408+0000","last_became_peered":"2024-04-25T09:11:25.788408+0000","last_unstale":"2024-04-25T09:11:26.798594+0000","last_undegraded":"2024-04-25T09:11:26.798594+0000","last_fullsized":"2024-04-25T09:11:26.798594+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:29.964854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.798002+0000","last_change":"2024-04-25T09:11:26.797141+0000","last_active":"2024-04-25T09:11:26.798002+0000","last_peered":"2024-04-25T09:11:26.798002+0000","last_clean":"2024-04-25T09:11:26.798002+0000","last_became_active":"2024-04-25T09:11:26.796854+0000","last_became_peered":"2024-04-25T09:11:26.796854+0000","last_unstale":"2024-04-25T09:11:26.798002+0000","last_undegraded":"2024-04-25T09:11:26.798002+0000","last_fullsized":"2024-04-25T09:11:26.798002+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:56.161415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"121'2","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.809316+0000","last_change":"2024-04-25T09:11:25.778670+0000","last_active":"2024-04-25T09:11:26.809316+0000","last_peered":"2024-04-25T09:11:26.809316+0000","last_clean":"2024-04-25T09:11:26.809316+0000","last_became_active":"2024-04-25T09:11:25.778177+0000","last_became_peered":"2024-04-25T09:11:25.778177+0000","last_unstale":"2024-04-25T09:11:26.809316+0000","last_undegraded":"2024-04-25T09:11:26.809316+0000","last_fullsized":"2024-04-25T09:11:26.809316+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:01.802409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.791752+0000","last_change":"2024-04-25T09:11:26.789429+0000","last_active":"2024-04-25T09:11:26.791752+0000","last_peered":"2024-04-25T09:11:26.791752+0000","last_clean":"2024-04-25T09:11:26.791752+0000","last_became_active":"2024-04-25T09:11:26.788594+0000","last_became_peered":"2024-04-25T09:11:26.788594+0000","last_unstale":"2024-04-25T09:11:26.791752+0000","last_undegraded":"2024-04-25T09:11:26.791752+0000","last_fullsized":"2024-04-25T09:11:26.791752+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:57.095719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768484+0000","last_change":"2024-04-25T09:11:25.778748+0000","last_active":"2024-04-25T09:11:27.768484+0000","last_peered":"2024-04-25T09:11:27.768484+0000","last_clean":"2024-04-25T09:11:27.768484+0000","last_became_active":"2024-04-25T09:11:25.778369+0000","last_became_peered":"2024-04-25T09:11:25.778369+0000","last_unstale":"2024-04-25T09:11:27.768484+0000","last_undegraded":"2024-04-25T09:11:27.768484+0000","last_fullsized":"2024-04-25T09:11:27.768484+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:40.038318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767759+0000","last_change":"2024-04-25T09:11:26.782603+0000","last_active":"2024-04-25T09:11:27.767759+0000","last_peered":"2024-04-25T09:11:27.767759+0000","last_clean":"2024-04-25T09:11:27.767759+0000","last_became_active":"2024-04-25T09:11:26.781970+0000","last_became_peered":"2024-04-25T09:11:26.781970+0000","last_unstale":"2024-04-25T09:11:27.767759+0000","last_undegraded":"2024-04-25T09:11:27.767759+0000","last_fullsized":"2024-04-25T09:11:27.767759+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:50.866716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767584+0000","last_change":"2024-04-25T09:11:25.784323+0000","last_active":"2024-04-25T09:11:27.767584+0000","last_peered":"2024-04-25T09:11:27.767584+0000","last_clean":"2024-04-25T09:11:27.767584+0000","last_became_active":"2024-04-25T09:11:25.783886+0000","last_became_peered":"2024-04-25T09:11:25.783886+0000","last_unstale":"2024-04-25T09:11:27.767584+0000","last_undegraded":"2024-04-25T09:11:27.767584+0000","last_fullsized":"2024-04-25T09:11:27.767584+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:47.142671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.806230+0000","last_change":"2024-04-25T09:11:26.796820+0000","last_active":"2024-04-25T09:11:26.806230+0000","last_peered":"2024-04-25T09:11:26.806230+0000","last_clean":"2024-04-25T09:11:26.806230+0000","last_became_active":"2024-04-25T09:11:26.796373+0000","last_became_peered":"2024-04-25T09:11:26.796373+0000","last_unstale":"2024-04-25T09:11:26.806230+0000","last_undegraded":"2024-04-25T09:11:26.806230+0000","last_fullsized":"2024-04-25T09:11:26.806230+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:24.936289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070315+0000","last_change":"2024-04-25T09:11:25.786111+0000","last_active":"2024-04-25T09:11:28.070315+0000","last_peered":"2024-04-25T09:11:28.070315+0000","last_clean":"2024-04-25T09:11:28.070315+0000","last_became_active":"2024-04-25T09:11:25.785762+0000","last_became_peered":"2024-04-25T09:11:25.785762+0000","last_unstale":"2024-04-25T09:11:28.070315+0000","last_undegraded":"2024-04-25T09:11:28.070315+0000","last_fullsized":"2024-04-25T09:11:28.070315+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:24.290504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.808512+0000","last_change":"2024-04-25T09:11:26.807560+0000","last_active":"2024-04-25T09:11:26.808512+0000","last_peered":"2024-04-25T09:11:26.808512+0000","last_clean":"2024-04-25T09:11:26.808512+0000","last_became_active":"2024-04-25T09:11:26.807297+0000","last_became_peered":"2024-04-25T09:11:26.807297+0000","last_unstale":"2024-04-25T09:11:26.808512+0000","last_undegraded":"2024-04-25T09:11:26.808512+0000","last_fullsized":"2024-04-25T09:11:26.808512+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:05.958586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767243+0000","last_change":"2024-04-25T09:11:25.782062+0000","last_active":"2024-04-25T09:11:27.767243+0000","last_peered":"2024-04-25T09:11:27.767243+0000","last_clean":"2024-04-25T09:11:27.767243+0000","last_became_active":"2024-04-25T09:11:25.781812+0000","last_became_peered":"2024-04-25T09:11:25.781812+0000","last_unstale":"2024-04-25T09:11:27.767243+0000","last_undegraded":"2024-04-25T09:11:27.767243+0000","last_fullsized":"2024-04-25T09:11:27.767243+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:17.958244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767943+0000","last_change":"2024-04-25T09:11:26.783348+0000","last_active":"2024-04-25T09:11:27.767943+0000","last_peered":"2024-04-25T09:11:27.767943+0000","last_clean":"2024-04-25T09:11:27.767943+0000","last_became_active":"2024-04-25T09:11:26.783086+0000","last_became_peered":"2024-04-25T09:11:26.783086+0000","last_unstale":"2024-04-25T09:11:27.767943+0000","last_undegraded":"2024-04-25T09:11:27.767943+0000","last_fullsized":"2024-04-25T09:11:27.767943+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:25.760586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768379+0000","last_change":"2024-04-25T09:11:25.786883+0000","last_active":"2024-04-25T09:11:27.768379+0000","last_peered":"2024-04-25T09:11:27.768379+0000","last_clean":"2024-04-25T09:11:27.768379+0000","last_became_active":"2024-04-25T09:11:25.786471+0000","last_became_peered":"2024-04-25T09:11:25.786471+0000","last_unstale":"2024-04-25T09:11:27.768379+0000","last_undegraded":"2024-04-25T09:11:27.768379+0000","last_fullsized":"2024-04-25T09:11:27.768379+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:33.024623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070506+0000","last_change":"2024-04-25T09:11:26.802053+0000","last_active":"2024-04-25T09:11:28.070506+0000","last_peered":"2024-04-25T09:11:28.070506+0000","last_clean":"2024-04-25T09:11:28.070506+0000","last_became_active":"2024-04-25T09:11:26.801745+0000","last_became_peered":"2024-04-25T09:11:26.801745+0000","last_unstale":"2024-04-25T09:11:28.070506+0000","last_undegraded":"2024-04-25T09:11:28.070506+0000","last_fullsized":"2024-04-25T09:11:28.070506+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:34.027095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070327+0000","last_change":"2024-04-25T09:11:25.790188+0000","last_active":"2024-04-25T09:11:28.070327+0000","last_peered":"2024-04-25T09:11:28.070327+0000","last_clean":"2024-04-25T09:11:28.070327+0000","last_became_active":"2024-04-25T09:11:25.789477+0000","last_became_peered":"2024-04-25T09:11:25.789477+0000","last_unstale":"2024-04-25T09:11:28.070327+0000","last_undegraded":"2024-04-25T09:11:28.070327+0000","last_fullsized":"2024-04-25T09:11:28.070327+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:40.038318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.807631+0000","last_change":"2024-04-25T09:11:26.804558+0000","last_active":"2024-04-25T09:11:26.807631+0000","last_peered":"2024-04-25T09:11:26.807631+0000","last_clean":"2024-04-25T09:11:26.807631+0000","last_became_active":"2024-04-25T09:11:26.801426+0000","last_became_peered":"2024-04-25T09:11:26.801426+0000","last_unstale":"2024-04-25T09:11:26.807631+0000","last_undegraded":"2024-04-25T09:11:26.807631+0000","last_fullsized":"2024-04-25T09:11:26.807631+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:11.458429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"121'3","reported_seq":17,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070498+0000","last_change":"2024-04-25T09:11:25.785530+0000","last_active":"2024-04-25T09:11:28.070498+0000","last_peered":"2024-04-25T09:11:28.070498+0000","last_clean":"2024-04-25T09:11:28.070498+0000","last_became_active":"2024-04-25T09:11:25.785236+0000","last_became_peered":"2024-04-25T09:11:25.785236+0000","last_unstale":"2024-04-25T09:11:28.070498+0000","last_undegraded":"2024-04-25T09:11:28.070498+0000","last_fullsized":"2024-04-25T09:11:28.070498+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:36.050959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070656+0000","last_change":"2024-04-25T09:11:26.793693+0000","last_active":"2024-04-25T09:11:28.070656+0000","last_peered":"2024-04-25T09:11:28.070656+0000","last_clean":"2024-04-25T09:11:28.070656+0000","last_became_active":"2024-04-25T09:11:26.793379+0000","last_became_peered":"2024-04-25T09:11:26.793379+0000","last_unstale":"2024-04-25T09:11:28.070656+0000","last_undegraded":"2024-04-25T09:11:28.070656+0000","last_fullsized":"2024-04-25T09:11:28.070656+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:58.722752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"121'6","reported_seq":18,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.809992+0000","last_change":"2024-04-25T09:11:25.788323+0000","last_active":"2024-04-25T09:11:26.809992+0000","last_peered":"2024-04-25T09:11:26.809992+0000","last_clean":"2024-04-25T09:11:26.809992+0000","last_became_active":"2024-04-25T09:11:25.787675+0000","last_became_peered":"2024-04-25T09:11:25.787675+0000","last_unstale":"2024-04-25T09:11:26.809992+0000","last_undegraded":"2024-04-25T09:11:26.809992+0000","last_fullsized":"2024-04-25T09:11:26.809992+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:29.964854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768233+0000","last_change":"2024-04-25T09:11:26.776056+0000","last_active":"2024-04-25T09:11:27.768233+0000","last_peered":"2024-04-25T09:11:27.768233+0000","last_clean":"2024-04-25T09:11:27.768233+0000","last_became_active":"2024-04-25T09:11:26.775732+0000","last_became_peered":"2024-04-25T09:11:26.775732+0000","last_unstale":"2024-04-25T09:11:27.768233+0000","last_undegraded":"2024-04-25T09:11:27.768233+0000","last_fullsized":"2024-04-25T09:11:27.768233+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:20.515945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"121'2","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.807771+0000","last_change":"2024-04-25T09:11:25.786240+0000","last_active":"2024-04-25T09:11:26.807771+0000","last_peered":"2024-04-25T09:11:26.807771+0000","last_clean":"2024-04-25T09:11:26.807771+0000","last_became_active":"2024-04-25T09:11:25.785904+0000","last_became_peered":"2024-04-25T09:11:25.785904+0000","last_unstale":"2024-04-25T09:11:26.807771+0000","last_undegraded":"2024-04-25T09:11:26.807771+0000","last_fullsized":"2024-04-25T09:11:26.807771+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:03.302767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.800822+0000","last_change":"2024-04-25T09:11:26.799364+0000","last_active":"2024-04-25T09:11:26.800822+0000","last_peered":"2024-04-25T09:11:26.800822+0000","last_clean":"2024-04-25T09:11:26.800822+0000","last_became_active":"2024-04-25T09:11:26.798845+0000","last_became_peered":"2024-04-25T09:11:26.798845+0000","last_unstale":"2024-04-25T09:11:26.800822+0000","last_undegraded":"2024-04-25T09:11:26.800822+0000","last_fullsized":"2024-04-25T09:11:26.800822+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:51.241627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.794340+0000","last_change":"2024-04-25T09:11:25.789385+0000","last_active":"2024-04-25T09:11:26.794340+0000","last_peered":"2024-04-25T09:11:26.794340+0000","last_clean":"2024-04-25T09:11:26.794340+0000","last_became_active":"2024-04-25T09:11:25.789127+0000","last_became_peered":"2024-04-25T09:11:25.789127+0000","last_unstale":"2024-04-25T09:11:26.794340+0000","last_undegraded":"2024-04-25T09:11:26.794340+0000","last_fullsized":"2024-04-25T09:11:26.794340+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:06.107623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.791967+0000","last_change":"2024-04-25T09:11:26.789683+0000","last_active":"2024-04-25T09:11:26.791967+0000","last_peered":"2024-04-25T09:11:26.791967+0000","last_clean":"2024-04-25T09:11:26.791967+0000","last_became_active":"2024-04-25T09:11:26.788459+0000","last_became_peered":"2024-04-25T09:11:26.788459+0000","last_unstale":"2024-04-25T09:11:26.791967+0000","last_undegraded":"2024-04-25T09:11:26.791967+0000","last_fullsized":"2024-04-25T09:11:26.791967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:19.898515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.786092+0000","last_change":"2024-04-25T09:11:25.787217+0000","last_active":"2024-04-25T09:11:26.786092+0000","last_peered":"2024-04-25T09:11:26.786092+0000","last_clean":"2024-04-25T09:11:26.786092+0000","last_became_active":"2024-04-25T09:11:25.786763+0000","last_became_peered":"2024-04-25T09:11:25.786763+0000","last_unstale":"2024-04-25T09:11:26.786092+0000","last_undegraded":"2024-04-25T09:11:26.786092+0000","last_fullsized":"2024-04-25T09:11:26.786092+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:09.144966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070405+0000","last_change":"2024-04-25T09:11:26.781598+0000","last_active":"2024-04-25T09:11:28.070405+0000","last_peered":"2024-04-25T09:11:28.070405+0000","last_clean":"2024-04-25T09:11:28.070405+0000","last_became_active":"2024-04-25T09:11:26.781290+0000","last_became_peered":"2024-04-25T09:11:26.781290+0000","last_unstale":"2024-04-25T09:11:28.070405+0000","last_undegraded":"2024-04-25T09:11:28.070405+0000","last_fullsized":"2024-04-25T09:11:28.070405+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:11.569136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"121'1","reported_seq":13,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.800436+0000","last_change":"2024-04-25T09:11:25.781852+0000","last_active":"2024-04-25T09:11:26.800436+0000","last_peered":"2024-04-25T09:11:26.800436+0000","last_clean":"2024-04-25T09:11:26.800436+0000","last_became_active":"2024-04-25T09:11:25.780781+0000","last_became_peered":"2024-04-25T09:11:25.780781+0000","last_unstale":"2024-04-25T09:11:26.800436+0000","last_undegraded":"2024-04-25T09:11:26.800436+0000","last_fullsized":"2024-04-25T09:11:26.800436+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:54.103134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.769052+0000","last_change":"2024-04-25T09:11:26.797827+0000","last_active":"2024-04-25T09:11:27.769052+0000","last_peered":"2024-04-25T09:11:27.769052+0000","last_clean":"2024-04-25T09:11:27.769052+0000","last_became_active":"2024-04-25T09:11:26.797548+0000","last_became_peered":"2024-04-25T09:11:26.797548+0000","last_unstale":"2024-04-25T09:11:27.769052+0000","last_undegraded":"2024-04-25T09:11:27.769052+0000","last_fullsized":"2024-04-25T09:11:27.769052+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:03.214507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"121'2","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.793939+0000","last_change":"2024-04-25T09:11:25.792534+0000","last_active":"2024-04-25T09:11:26.793939+0000","last_peered":"2024-04-25T09:11:26.793939+0000","last_clean":"2024-04-25T09:11:26.793939+0000","last_became_active":"2024-04-25T09:11:25.792008+0000","last_became_peered":"2024-04-25T09:11:25.792008+0000","last_unstale":"2024-04-25T09:11:26.793939+0000","last_undegraded":"2024-04-25T09:11:26.793939+0000","last_fullsized":"2024-04-25T09:11:26.793939+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:22.627378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767889+0000","last_change":"2024-04-25T09:11:26.772587+0000","last_active":"2024-04-25T09:11:27.767889+0000","last_peered":"2024-04-25T09:11:27.767889+0000","last_clean":"2024-04-25T09:11:27.767889+0000","last_became_active":"2024-04-25T09:11:26.772276+0000","last_became_peered":"2024-04-25T09:11:26.772276+0000","last_unstale":"2024-04-25T09:11:27.767889+0000","last_undegraded":"2024-04-25T09:11:27.767889+0000","last_fullsized":"2024-04-25T09:11:27.767889+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:32.004711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"121'1","reported_seq":13,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.796640+0000","last_change":"2024-04-25T09:11:25.789177+0000","last_active":"2024-04-25T09:11:26.796640+0000","last_peered":"2024-04-25T09:11:26.796640+0000","last_clean":"2024-04-25T09:11:26.796640+0000","last_became_active":"2024-04-25T09:11:25.788356+0000","last_became_peered":"2024-04-25T09:11:25.788356+0000","last_unstale":"2024-04-25T09:11:26.796640+0000","last_undegraded":"2024-04-25T09:11:26.796640+0000","last_fullsized":"2024-04-25T09:11:26.796640+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:06.193412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070694+0000","last_change":"2024-04-25T09:11:26.789879+0000","last_active":"2024-04-25T09:11:28.070694+0000","last_peered":"2024-04-25T09:11:28.070694+0000","last_clean":"2024-04-25T09:11:28.070694+0000","last_became_active":"2024-04-25T09:11:26.789518+0000","last_became_peered":"2024-04-25T09:11:26.789518+0000","last_unstale":"2024-04-25T09:11:28.070694+0000","last_undegraded":"2024-04-25T09:11:28.070694+0000","last_fullsized":"2024-04-25T09:11:28.070694+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:26.026358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.776625+0000","last_change":"2024-04-25T09:11:25.791795+0000","last_active":"2024-04-25T09:11:26.776625+0000","last_peered":"2024-04-25T09:11:26.776625+0000","last_clean":"2024-04-25T09:11:26.776625+0000","last_became_active":"2024-04-25T09:11:25.791461+0000","last_became_peered":"2024-04-25T09:11:25.791461+0000","last_unstale":"2024-04-25T09:11:26.776625+0000","last_undegraded":"2024-04-25T09:11:26.776625+0000","last_fullsized":"2024-04-25T09:11:26.776625+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:09.144966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767110+0000","last_change":"2024-04-25T09:11:26.772157+0000","last_active":"2024-04-25T09:11:27.767110+0000","last_peered":"2024-04-25T09:11:27.767110+0000","last_clean":"2024-04-25T09:11:27.767110+0000","last_became_active":"2024-04-25T09:11:26.771882+0000","last_became_peered":"2024-04-25T09:11:26.771882+0000","last_unstale":"2024-04-25T09:11:27.767110+0000","last_undegraded":"2024-04-25T09:11:27.767110+0000","last_fullsized":"2024-04-25T09:11:27.767110+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:07.458809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767135+0000","last_change":"2024-04-25T09:11:25.784911+0000","last_active":"2024-04-25T09:11:27.767135+0000","last_peered":"2024-04-25T09:11:27.767135+0000","last_clean":"2024-04-25T09:11:27.767135+0000","last_became_active":"2024-04-25T09:11:25.784461+0000","last_became_peered":"2024-04-25T09:11:25.784461+0000","last_unstale":"2024-04-25T09:11:27.767135+0000","last_undegraded":"2024-04-25T09:11:27.767135+0000","last_fullsized":"2024-04-25T09:11:27.767135+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:09.127425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.804573+0000","last_change":"2024-04-25T09:11:26.797782+0000","last_active":"2024-04-25T09:11:26.804573+0000","last_peered":"2024-04-25T09:11:26.804573+0000","last_clean":"2024-04-25T09:11:26.804573+0000","last_became_active":"2024-04-25T09:11:26.797497+0000","last_became_peered":"2024-04-25T09:11:26.797497+0000","last_unstale":"2024-04-25T09:11:26.804573+0000","last_undegraded":"2024-04-25T09:11:26.804573+0000","last_fullsized":"2024-04-25T09:11:26.804573+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:37.118986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.774149+0000","last_change":"2024-04-25T09:11:25.783997+0000","last_active":"2024-04-25T09:11:26.774149+0000","last_peered":"2024-04-25T09:11:26.774149+0000","last_clean":"2024-04-25T09:11:26.774149+0000","last_became_active":"2024-04-25T09:11:25.783674+0000","last_became_peered":"2024-04-25T09:11:25.783674+0000","last_unstale":"2024-04-25T09:11:26.774149+0000","last_undegraded":"2024-04-25T09:11:26.774149+0000","last_fullsized":"2024-04-25T09:11:26.774149+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:53.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.806219+0000","last_change":"2024-04-25T09:11:26.796627+0000","last_active":"2024-04-25T09:11:26.806219+0000","last_peered":"2024-04-25T09:11:26.806219+0000","last_clean":"2024-04-25T09:11:26.806219+0000","last_became_active":"2024-04-25T09:11:26.794570+0000","last_became_peered":"2024-04-25T09:11:26.794570+0000","last_unstale":"2024-04-25T09:11:26.806219+0000","last_undegraded":"2024-04-25T09:11:26.806219+0000","last_fullsized":"2024-04-25T09:11:26.806219+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:10.217192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.786231+0000","last_change":"2024-04-25T09:11:25.786373+0000","last_active":"2024-04-25T09:11:26.786231+0000","last_peered":"2024-04-25T09:11:26.786231+0000","last_clean":"2024-04-25T09:11:26.786231+0000","last_became_active":"2024-04-25T09:11:25.785938+0000","last_became_peered":"2024-04-25T09:11:25.785938+0000","last_unstale":"2024-04-25T09:11:26.786231+0000","last_undegraded":"2024-04-25T09:11:26.786231+0000","last_fullsized":"2024-04-25T09:11:26.786231+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:06.193412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070321+0000","last_change":"2024-04-25T09:11:26.794889+0000","last_active":"2024-04-25T09:11:28.070321+0000","last_peered":"2024-04-25T09:11:28.070321+0000","last_clean":"2024-04-25T09:11:28.070321+0000","last_became_active":"2024-04-25T09:11:26.794248+0000","last_became_peered":"2024-04-25T09:11:26.794248+0000","last_unstale":"2024-04-25T09:11:28.070321+0000","last_undegraded":"2024-04-25T09:11:28.070321+0000","last_fullsized":"2024-04-25T09:11:28.070321+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:48.355880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.773587+0000","last_change":"2024-04-25T09:11:25.786145+0000","last_active":"2024-04-25T09:11:26.773587+0000","last_peered":"2024-04-25T09:11:26.773587+0000","last_clean":"2024-04-25T09:11:26.773587+0000","last_became_active":"2024-04-25T09:11:25.785877+0000","last_became_peered":"2024-04-25T09:11:25.785877+0000","last_unstale":"2024-04-25T09:11:26.773587+0000","last_undegraded":"2024-04-25T09:11:26.773587+0000","last_fullsized":"2024-04-25T09:11:26.773587+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:46.425507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767784+0000","last_change":"2024-04-25T09:11:26.790428+0000","last_active":"2024-04-25T09:11:27.767784+0000","last_peered":"2024-04-25T09:11:27.767784+0000","last_clean":"2024-04-25T09:11:27.767784+0000","last_became_active":"2024-04-25T09:11:26.789545+0000","last_became_peered":"2024-04-25T09:11:26.789545+0000","last_unstale":"2024-04-25T09:11:27.767784+0000","last_undegraded":"2024-04-25T09:11:27.767784+0000","last_fullsized":"2024-04-25T09:11:27.767784+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:48.073136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767867+0000","last_change":"2024-04-25T09:11:25.784967+0000","last_active":"2024-04-25T09:11:27.767867+0000","last_peered":"2024-04-25T09:11:27.767867+0000","last_clean":"2024-04-25T09:11:27.767867+0000","last_became_active":"2024-04-25T09:11:25.784702+0000","last_became_peered":"2024-04-25T09:11:25.784702+0000","last_unstale":"2024-04-25T09:11:27.767867+0000","last_undegraded":"2024-04-25T09:11:27.767867+0000","last_fullsized":"2024-04-25T09:11:27.767867+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:47.656385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.795819+0000","last_change":"2024-04-25T09:11:26.792914+0000","last_active":"2024-04-25T09:11:26.795819+0000","last_peered":"2024-04-25T09:11:26.795819+0000","last_clean":"2024-04-25T09:11:26.795819+0000","last_became_active":"2024-04-25T09:11:26.792600+0000","last_became_peered":"2024-04-25T09:11:26.792600+0000","last_unstale":"2024-04-25T09:11:26.795819+0000","last_undegraded":"2024-04-25T09:11:26.795819+0000","last_fullsized":"2024-04-25T09:11:26.795819+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:42.179442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"122'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.772977+0000","last_change":"2024-04-25T09:11:25.785623+0000","last_active":"2024-04-25T09:11:28.772977+0000","last_peered":"2024-04-25T09:11:28.772977+0000","last_clean":"2024-04-25T09:11:28.772977+0000","last_became_active":"2024-04-25T09:11:25.785338+0000","last_became_peered":"2024-04-25T09:11:25.785338+0000","last_unstale":"2024-04-25T09:11:28.772977+0000","last_undegraded":"2024-04-25T09:11:28.772977+0000","last_fullsized":"2024-04-25T09:11:28.772977+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:10.566665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.791979+0000","last_change":"2024-04-25T09:11:26.786960+0000","last_active":"2024-04-25T09:11:26.791979+0000","last_peered":"2024-04-25T09:11:26.791979+0000","last_clean":"2024-04-25T09:11:26.791979+0000","last_became_active":"2024-04-25T09:11:26.785791+0000","last_became_peered":"2024-04-25T09:11:26.785791+0000","last_unstale":"2024-04-25T09:11:26.791979+0000","last_undegraded":"2024-04-25T09:11:26.791979+0000","last_fullsized":"2024-04-25T09:11:26.791979+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:04.305239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768313+0000","last_change":"2024-04-25T09:11:25.786163+0000","last_active":"2024-04-25T09:11:27.768313+0000","last_peered":"2024-04-25T09:11:27.768313+0000","last_clean":"2024-04-25T09:11:27.768313+0000","last_became_active":"2024-04-25T09:11:25.785903+0000","last_became_peered":"2024-04-25T09:11:25.785903+0000","last_unstale":"2024-04-25T09:11:27.768313+0000","last_undegraded":"2024-04-25T09:11:27.768313+0000","last_fullsized":"2024-04-25T09:11:27.768313+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:07.009279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.793418+0000","last_change":"2024-04-25T09:11:26.790380+0000","last_active":"2024-04-25T09:11:26.793418+0000","last_peered":"2024-04-25T09:11:26.793418+0000","last_clean":"2024-04-25T09:11:26.793418+0000","last_became_active":"2024-04-25T09:11:26.790013+0000","last_became_peered":"2024-04-25T09:11:26.790013+0000","last_unstale":"2024-04-25T09:11:26.793418+0000","last_undegraded":"2024-04-25T09:11:26.793418+0000","last_fullsized":"2024-04-25T09:11:26.793418+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:49.531791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767898+0000","last_change":"2024-04-25T09:11:25.785188+0000","last_active":"2024-04-25T09:11:27.767898+0000","last_peered":"2024-04-25T09:11:27.767898+0000","last_clean":"2024-04-25T09:11:27.767898+0000","last_became_active":"2024-04-25T09:11:25.779978+0000","last_became_peered":"2024-04-25T09:11:25.779978+0000","last_unstale":"2024-04-25T09:11:27.767898+0000","last_undegraded":"2024-04-25T09:11:27.767898+0000","last_fullsized":"2024-04-25T09:11:27.767898+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:38.992725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767281+0000","last_change":"2024-04-25T09:11:26.771533+0000","last_active":"2024-04-25T09:11:27.767281+0000","last_peered":"2024-04-25T09:11:27.767281+0000","last_clean":"2024-04-25T09:11:27.767281+0000","last_became_active":"2024-04-25T09:11:26.771206+0000","last_became_peered":"2024-04-25T09:11:26.771206+0000","last_unstale":"2024-04-25T09:11:27.767281+0000","last_undegraded":"2024-04-25T09:11:27.767281+0000","last_fullsized":"2024-04-25T09:11:27.767281+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:16.193785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768858+0000","last_change":"2024-04-25T09:11:25.786217+0000","last_active":"2024-04-25T09:11:27.768858+0000","last_peered":"2024-04-25T09:11:27.768858+0000","last_clean":"2024-04-25T09:11:27.768858+0000","last_became_active":"2024-04-25T09:11:25.785945+0000","last_became_peered":"2024-04-25T09:11:25.785945+0000","last_unstale":"2024-04-25T09:11:27.768858+0000","last_undegraded":"2024-04-25T09:11:27.768858+0000","last_fullsized":"2024-04-25T09:11:27.768858+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:36.050959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.804552+0000","last_change":"2024-04-25T09:11:26.786763+0000","last_active":"2024-04-25T09:11:26.804552+0000","last_peered":"2024-04-25T09:11:26.804552+0000","last_clean":"2024-04-25T09:11:26.804552+0000","last_became_active":"2024-04-25T09:11:26.786447+0000","last_became_peered":"2024-04-25T09:11:26.786447+0000","last_unstale":"2024-04-25T09:11:26.804552+0000","last_undegraded":"2024-04-25T09:11:26.804552+0000","last_fullsized":"2024-04-25T09:11:26.804552+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:55.473718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768686+0000","last_change":"2024-04-25T09:11:25.789039+0000","last_active":"2024-04-25T09:11:27.768686+0000","last_peered":"2024-04-25T09:11:27.768686+0000","last_clean":"2024-04-25T09:11:27.768686+0000","last_became_active":"2024-04-25T09:11:25.788749+0000","last_became_peered":"2024-04-25T09:11:25.788749+0000","last_unstale":"2024-04-25T09:11:27.768686+0000","last_undegraded":"2024-04-25T09:11:27.768686+0000","last_fullsized":"2024-04-25T09:11:27.768686+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:24.290504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.788832+0000","last_change":"2024-04-25T09:11:26.781923+0000","last_active":"2024-04-25T09:11:26.788832+0000","last_peered":"2024-04-25T09:11:26.788832+0000","last_clean":"2024-04-25T09:11:26.788832+0000","last_became_active":"2024-04-25T09:11:26.780479+0000","last_became_peered":"2024-04-25T09:11:26.780479+0000","last_unstale":"2024-04-25T09:11:26.788832+0000","last_undegraded":"2024-04-25T09:11:26.788832+0000","last_fullsized":"2024-04-25T09:11:26.788832+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:55.473718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767233+0000","last_change":"2024-04-25T09:11:25.781405+0000","last_active":"2024-04-25T09:11:27.767233+0000","last_peered":"2024-04-25T09:11:27.767233+0000","last_clean":"2024-04-25T09:11:27.767233+0000","last_became_active":"2024-04-25T09:11:25.781100+0000","last_became_peered":"2024-04-25T09:11:25.781100+0000","last_unstale":"2024-04-25T09:11:27.767233+0000","last_undegraded":"2024-04-25T09:11:27.767233+0000","last_fullsized":"2024-04-25T09:11:27.767233+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:10.988280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.800732+0000","last_change":"2024-04-25T09:11:26.798742+0000","last_active":"2024-04-25T09:11:26.800732+0000","last_peered":"2024-04-25T09:11:26.800732+0000","last_clean":"2024-04-25T09:11:26.800732+0000","last_became_active":"2024-04-25T09:11:26.798468+0000","last_became_peered":"2024-04-25T09:11:26.798468+0000","last_unstale":"2024-04-25T09:11:26.800732+0000","last_undegraded":"2024-04-25T09:11:26.800732+0000","last_fullsized":"2024-04-25T09:11:26.800732+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:10.151989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.773757+0000","last_change":"2024-04-25T09:11:25.780949+0000","last_active":"2024-04-25T09:11:26.773757+0000","last_peered":"2024-04-25T09:11:26.773757+0000","last_clean":"2024-04-25T09:11:26.773757+0000","last_became_active":"2024-04-25T09:11:25.780664+0000","last_became_peered":"2024-04-25T09:11:25.780664+0000","last_unstale":"2024-04-25T09:11:26.773757+0000","last_undegraded":"2024-04-25T09:11:26.773757+0000","last_fullsized":"2024-04-25T09:11:26.773757+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:52.742093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.795608+0000","last_change":"2024-04-25T09:11:26.793502+0000","last_active":"2024-04-25T09:11:26.795608+0000","last_peered":"2024-04-25T09:11:26.795608+0000","last_clean":"2024-04-25T09:11:26.795608+0000","last_became_active":"2024-04-25T09:11:26.792794+0000","last_became_peered":"2024-04-25T09:11:26.792794+0000","last_unstale":"2024-04-25T09:11:26.795608+0000","last_undegraded":"2024-04-25T09:11:26.795608+0000","last_fullsized":"2024-04-25T09:11:26.795608+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:40.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"121'8","reported_seq":20,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.809444+0000","last_change":"2024-04-25T09:11:25.787740+0000","last_active":"2024-04-25T09:11:26.809444+0000","last_peered":"2024-04-25T09:11:26.809444+0000","last_clean":"2024-04-25T09:11:26.809444+0000","last_became_active":"2024-04-25T09:11:25.786106+0000","last_became_peered":"2024-04-25T09:11:25.786106+0000","last_unstale":"2024-04-25T09:11:26.809444+0000","last_undegraded":"2024-04-25T09:11:26.809444+0000","last_fullsized":"2024-04-25T09:11:26.809444+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:53.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":354,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.773820+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:11:26.773820+0000","last_peered":"2024-04-25T09:11:26.773820+0000","last_clean":"2024-04-25T09:11:26.773820+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:11:26.773820+0000","last_undegraded":"2024-04-25T09:11:26.773820+0000","last_fullsized":"2024-04-25T09:11:26.773820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509549,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50708,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321132,"statfs":{"total":96636764160,"available":96584839168,"internally_reserved":0,"allocated":1515520,"data_stored":703826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509549,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50712,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321128,"statfs":{"total":96636764160,"available":96584835072,"internally_reserved":0,"allocated":1519616,"data_stored":703404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509550,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59040,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312800,"statfs":{"total":96636764160,"available":96576307200,"internally_reserved":0,"allocated":1523712,"data_stored":704856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509549,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54868,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316972,"statfs":{"total":96636764160,"available":96580579328,"internally_reserved":0,"allocated":1515520,"data_stored":698198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509549,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54856,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316984,"statfs":{"total":96636764160,"available":96580591616,"internally_reserved":0,"allocated":1499136,"data_stored":696552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509550,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50704,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321136,"statfs":{"total":96636764160,"available":96584843264,"internally_reserved":0,"allocated":1503232,"data_stored":696574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509550,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55448,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316392,"statfs":{"total":96636764160,"available":96579985408,"internally_reserved":0,"allocated":2109440,"data_stored":1293634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574957,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51268,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320572,"statfs":{"total":96636764160,"available":96584265728,"internally_reserved":0,"allocated":2080768,"data_stored":1279753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:11:31.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.37 is not active+clean 2024-04-25T09:11:31.587 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.37', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 121, 'state': 'creating+activating', 'last_fresh': '2024-04-25T09:11:26.777365+0000', 'last_change': '2024-04-25T09:11:26.777365+0000', 'last_active': '2024-04-25T09:11:25.752627+0000', 'last_peered': '2024-04-25T09:11:25.752627+0000', 'last_clean': '2024-04-25T09:11:25.752627+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:11:26.777365+0000', 'last_undegraded': '2024-04-25T09:11:26.777365+0000', 'last_fullsized': '2024-04-25T09:11:26.777365+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:11:25.752627+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:11:25.752627+0000', 'last_clean_scrub_stamp': '2024-04-25T09:11:25.752627+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': ['7', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:11:31.587 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:11:31.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.778+0000 7f0e65e00640 1 Processor -- start 2024-04-25T09:11:31.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.778+0000 7f0e65e00640 1 -- start start 2024-04-25T09:11:31.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.778+0000 7f0e65e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e60161010 0x7f0e6006f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.778+0000 7f0e65e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0e60162130 0x7f0e601614b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.778+0000 7f0e65e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e600cf990 con 0x7f0e600d0750 2024-04-25T09:11:31.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.778+0000 7f0e65e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e600cfc70 con 0x7f0e60162130 2024-04-25T09:11:31.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.778+0000 7f0e65e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600cff50 con 0x7f0e60161010 2024-04-25T09:11:31.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.778+0000 7f0e65400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f0e600d0750 0x7f0e6006bda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46466/0 (socket says 172.21.15.173:46466) 2024-04-25T09:11:31.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.778+0000 7f0e65400640 1 -- 172.21.15.173:0/1476764615 learned_addr learned my addr 172.21.15.173:0/1476764615 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:31.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e5fe00640 1 -- 172.21.15.173:0/1476764615 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116733025 0 0) 0x7f0e600cf990 con 0x7f0e600d0750 2024-04-25T09:11:31.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e5fe00640 1 -- 172.21.15.173:0/1476764615 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e44003530 con 0x7f0e600d0750 2024-04-25T09:11:31.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e64a00640 1 --2- 172.21.15.173:0/1476764615 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e60161010 0x7f0e6006f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e57e00640 1 --2- 172.21.15.173:0/1476764615 >> v2:172.21.15.194:3300/0 conn(0x7f0e60162130 0x7f0e601614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e5fe00640 1 -- 172.21.15.173:0/1476764615 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3836021884 0 0) 0x7f0e44003530 con 0x7f0e600d0750 2024-04-25T09:11:31.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e5fe00640 1 -- 172.21.15.173:0/1476764615 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e60161010 msgr2=0x7f0e6006f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:31.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e5fe00640 1 --2- 172.21.15.173:0/1476764615 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e60161010 0x7f0e6006f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e5fe00640 1 -- 172.21.15.173:0/1476764615 >> v2:172.21.15.194:3300/0 conn(0x7f0e60162130 msgr2=0x7f0e601614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:31.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e5fe00640 1 --2- 172.21.15.173:0/1476764615 >> v2:172.21.15.194:3300/0 conn(0x7f0e60162130 0x7f0e601614b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e5fe00640 1 -- 172.21.15.173:0/1476764615 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e600d0230 con 0x7f0e600d0750 2024-04-25T09:11:31.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e5fe00640 1 -- 172.21.15.173:0/1476764615 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f0e58001a00 con 0x7f0e600d0750 2024-04-25T09:11:31.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e5fe00640 1 -- 172.21.15.173:0/1476764615 >> v1:172.21.15.173:6789/0 conn(0x7f0e600d0750 legacy=0x7f0e6006bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e5fe00640 1 --2- 172.21.15.173:0/1476764615 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e60161010 0x7f0e440039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e5fe00640 1 --2- 172.21.15.173:0/1476764615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e44003f40 0x7f0e44004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e5fe00640 1 --2- 172.21.15.173:0/1476764615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e44004d50 0x7f0e440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e5fe00640 1 -- 172.21.15.173:0/1476764615 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600cfc70 con 0x7f0e44004d50 2024-04-25T09:11:31.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e5fe00640 1 -- 172.21.15.173:0/1476764615 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600cff50 con 0x7f0e44003f40 2024-04-25T09:11:31.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e5fe00640 1 -- 172.21.15.173:0/1476764615 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4400b9d0 con 0x7f0e60161010 2024-04-25T09:11:31.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e65400640 1 --2- 172.21.15.173:0/1476764615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e44004d50 0x7f0e440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e64a00640 1 --2- 172.21.15.173:0/1476764615 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e60161010 0x7f0e440039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e57e00640 1 --2- 172.21.15.173:0/1476764615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e44003f40 0x7f0e44004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e65400640 1 -- 172.21.15.173:0/1476764615 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e60161010 msgr2=0x7f0e440039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:31.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e65400640 1 --2- 172.21.15.173:0/1476764615 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e60161010 0x7f0e440039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e65400640 1 -- 172.21.15.173:0/1476764615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e44003f40 msgr2=0x7f0e44004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:31.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e65400640 1 --2- 172.21.15.173:0/1476764615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e44003f40 0x7f0e44004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e65400640 1 -- 172.21.15.173:0/1476764615 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e44003530 con 0x7f0e44004d50 2024-04-25T09:11:31.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.782+0000 7f0e64a00640 1 --2- 172.21.15.173:0/1476764615 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e60161010 0x7f0e440039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:31.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e65400640 1 --2- 172.21.15.173:0/1476764615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e44004d50 0x7f0e440051d0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800a8c0 tx=0x7f0e5801d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d577930be83552 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:31.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e5fe00640 1 -- 172.21.15.173:0/1476764615 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5800a4e0 con 0x7f0e44004d50 2024-04-25T09:11:31.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e5fe00640 1 -- 172.21.15.173:0/1476764615 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e580ad650 con 0x7f0e44004d50 2024-04-25T09:11:31.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e5fe00640 1 -- 172.21.15.173:0/1476764615 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e580ada40 con 0x7f0e44004d50 2024-04-25T09:11:31.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e65e00640 1 -- 172.21.15.173:0/1476764615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e44004d50 msgr2=0x7f0e440051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e65e00640 1 --2- 172.21.15.173:0/1476764615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e44004d50 0x7f0e440051d0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800a8c0 tx=0x7f0e5801d380 comp rx=0 tx=0).stop 2024-04-25T09:11:31.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e65400640 1 -- 172.21.15.173:0/1476764615 reap_dead start 2024-04-25T09:11:31.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e65e00640 1 -- 172.21.15.173:0/1476764615 shutdown_connections 2024-04-25T09:11:31.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e65e00640 1 -- 172.21.15.173:0/1476764615 >> 172.21.15.173:0/1476764615 conn(0x7f0e600b30a0 msgr2=0x7f0e600b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:31.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e65e00640 1 -- 172.21.15.173:0/1476764615 shutdown_connections 2024-04-25T09:11:31.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e65e00640 1 -- 172.21.15.173:0/1476764615 wait complete. 2024-04-25T09:11:31.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e65e00640 1 Processor -- start 2024-04-25T09:11:31.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e65e00640 1 -- start start 2024-04-25T09:11:31.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e65e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e44004d50 0x7f0e6015a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e65e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e600b7030 0x7f0e600b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e65e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e601f4ac0 0x7f0e600b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e65e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e60161b70 con 0x7f0e600b7030 2024-04-25T09:11:31.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e65e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e601619f0 con 0x7f0e601f4ac0 2024-04-25T09:11:31.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.786+0000 7f0e65e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e60161cf0 con 0x7f0e44004d50 2024-04-25T09:11:31.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e57e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e600b7030 0x7f0e600b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e57e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e600b7030 0x7f0e600b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36846/0 (socket says 172.21.15.173:36846) 2024-04-25T09:11:31.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e57e00640 1 -- 172.21.15.173:0/2554791008 learned_addr learned my addr 172.21.15.173:0/2554791008 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:31.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e65400640 1 --2- 172.21.15.173:0/2554791008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e601f4ac0 0x7f0e600b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e64a00640 1 --2- 172.21.15.173:0/2554791008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e44004d50 0x7f0e6015a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e57e00640 1 -- 172.21.15.173:0/2554791008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e44004d50 msgr2=0x7f0e6015a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e57e00640 1 --2- 172.21.15.173:0/2554791008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e44004d50 0x7f0e6015a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e57e00640 1 -- 172.21.15.173:0/2554791008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e601f4ac0 msgr2=0x7f0e600b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e57e00640 1 --2- 172.21.15.173:0/2554791008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e601f4ac0 0x7f0e600b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e57e00640 1 -- 172.21.15.173:0/2554791008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e600b5ba0 con 0x7f0e600b7030 2024-04-25T09:11:31.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e64a00640 1 --2- 172.21.15.173:0/2554791008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e44004d50 0x7f0e6015a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:31.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e65400640 1 --2- 172.21.15.173:0/2554791008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e601f4ac0 0x7f0e600b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:31.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e57e00640 1 --2- 172.21.15.173:0/2554791008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e600b7030 0x7f0e600b2500 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f0e48011970 tx=0x7f0e48011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:31.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e5d600640 1 -- 172.21.15.173:0/2554791008 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48019070 con 0x7f0e600b7030 2024-04-25T09:11:31.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e5d600640 1 -- 172.21.15.173:0/2554791008 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e48004240 con 0x7f0e600b7030 2024-04-25T09:11:31.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e5d600640 1 -- 172.21.15.173:0/2554791008 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4800f8e0 con 0x7f0e600b7030 2024-04-25T09:11:31.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e65e00640 1 -- 172.21.15.173:0/2554791008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e601f3d70 con 0x7f0e600b7030 2024-04-25T09:11:31.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e65e00640 1 -- 172.21.15.173:0/2554791008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e601f4330 con 0x7f0e600b7030 2024-04-25T09:11:31.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e65e00640 1 -- 172.21.15.173:0/2554791008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e60073a40 con 0x7f0e600b7030 2024-04-25T09:11:31.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e5d600640 1 -- 172.21.15.173:0/2554791008 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0e4801c070 con 0x7f0e600b7030 2024-04-25T09:11:31.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.790+0000 7f0e5d600640 1 --2- 172.21.15.173:0/2554791008 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e3c066f90 0x7f0e3c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.794+0000 7f0e5d600640 1 -- 172.21.15.173:0/2554791008 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0e48085630 con 0x7f0e600b7030 2024-04-25T09:11:31.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.794+0000 7f0e64a00640 1 --2- 172.21.15.173:0/2554791008 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e3c066f90 0x7f0e3c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.794+0000 7f0e64a00640 1 --2- 172.21.15.173:0/2554791008 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e3c066f90 0x7f0e3c069450 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0e600b4830 tx=0x7f0e50008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:31.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:31.794+0000 7f0e5d600640 1 -- 172.21.15.173:0/2554791008 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0e480564a0 con 0x7f0e600b7030 2024-04-25T09:11:31.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.002+0000 7f0e65e00640 1 -- 172.21.15.173:0/2554791008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0e600ca110 con 0x7f0e600b7030 2024-04-25T09:11:31.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.002+0000 7f0e5d600640 1 -- 172.21.15.173:0/2554791008 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1265 (secure 0 0 0) 0x7f0e48055da0 con 0x7f0e600b7030 2024-04-25T09:11:31.988 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:31.988 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":546,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":122,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":96},{"state_name":"creating+activating","count":1}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":437866496,"bytes_avail":772656246784,"bytes_total":773094113280,"inactive_pgs_ratio":0.010309278033673763,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":81,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8775}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-04-25T09:11:20.839953+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:11:31.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.006+0000 7f0e65e00640 1 -- 172.21.15.173:0/2554791008 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e3c066f90 msgr2=0x7f0e3c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.006+0000 7f0e65e00640 1 --2- 172.21.15.173:0/2554791008 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e3c066f90 0x7f0e3c069450 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0e600b4830 tx=0x7f0e50008040 comp rx=0 tx=0).stop 2024-04-25T09:11:31.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.006+0000 7f0e65e00640 1 -- 172.21.15.173:0/2554791008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e600b7030 msgr2=0x7f0e600b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.006+0000 7f0e65e00640 1 --2- 172.21.15.173:0/2554791008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e600b7030 0x7f0e600b2500 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f0e48011970 tx=0x7f0e48011e30 comp rx=0 tx=0).stop 2024-04-25T09:11:31.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.006+0000 7f0e65e00640 1 -- 172.21.15.173:0/2554791008 shutdown_connections 2024-04-25T09:11:31.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.006+0000 7f0e65e00640 1 --2- 172.21.15.173:0/2554791008 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e3c066f90 0x7f0e3c069450 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.006+0000 7f0e65e00640 1 --2- 172.21.15.173:0/2554791008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e601f4ac0 0x7f0e600b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.006+0000 7f0e65e00640 1 --2- 172.21.15.173:0/2554791008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e600b7030 0x7f0e600b2500 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.006+0000 7f0e65e00640 1 --2- 172.21.15.173:0/2554791008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e44004d50 0x7f0e6015a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.006+0000 7f0e65e00640 1 -- 172.21.15.173:0/2554791008 >> 172.21.15.173:0/2554791008 conn(0x7f0e600b30a0 msgr2=0x7f0e6006bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:31.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.006+0000 7f0e65e00640 1 -- 172.21.15.173:0/2554791008 shutdown_connections 2024-04-25T09:11:31.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.006+0000 7f0e65e00640 1 -- 172.21.15.173:0/2554791008 wait complete. 2024-04-25T09:11:32.010 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:11:32.010 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:11:32.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.158+0000 7fd758a00640 1 Processor -- start 2024-04-25T09:11:32.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.158+0000 7fd758a00640 1 -- start start 2024-04-25T09:11:32.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd758a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7540b3e70 0x7fd7540b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd758a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd7540aefa0 0x7fd7540b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd758a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7540b4790 con 0x7fd75415edd0 2024-04-25T09:11:32.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd758a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd75406dd50 con 0x7fd7540aefa0 2024-04-25T09:11:32.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd758a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75415f320 con 0x7fd7540b3e70 2024-04-25T09:11:32.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd752800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd75415edd0 0x7fd7540b2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:46472/0 (socket says 172.21.15.173:46472) 2024-04-25T09:11:32.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd752800640 1 -- 172.21.15.173:0/1387262049 learned_addr learned my addr 172.21.15.173:0/1387262049 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:32.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd749400640 1 --2- 172.21.15.173:0/1387262049 >> v2:172.21.15.194:3300/0 conn(0x7fd7540aefa0 0x7fd7540b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd751e00640 1 --2- 172.21.15.173:0/1387262049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7540b3e70 0x7fd7540b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd751400640 1 -- 172.21.15.173:0/1387262049 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730389626 0 0) 0x7fd7540b4790 con 0x7fd75415edd0 2024-04-25T09:11:32.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd751400640 1 -- 172.21.15.173:0/1387262049 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd738005740 con 0x7fd75415edd0 2024-04-25T09:11:32.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd751400640 1 -- 172.21.15.173:0/1387262049 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2503226945 0 0) 0x7fd738005740 con 0x7fd75415edd0 2024-04-25T09:11:32.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd751400640 1 -- 172.21.15.173:0/1387262049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7540b3e70 msgr2=0x7fd7540b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:32.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd751400640 1 --2- 172.21.15.173:0/1387262049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7540b3e70 0x7fd7540b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd751400640 1 -- 172.21.15.173:0/1387262049 >> v2:172.21.15.194:3300/0 conn(0x7fd7540aefa0 msgr2=0x7fd7540b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:32.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd751400640 1 --2- 172.21.15.173:0/1387262049 >> v2:172.21.15.194:3300/0 conn(0x7fd7540aefa0 0x7fd7540b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd751400640 1 -- 172.21.15.173:0/1387262049 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75406d420 con 0x7fd75415edd0 2024-04-25T09:11:32.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd751400640 1 -- 172.21.15.173:0/1387262049 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fd74c001680 con 0x7fd75415edd0 2024-04-25T09:11:32.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd751400640 1 -- 172.21.15.173:0/1387262049 >> v1:172.21.15.173:6789/0 conn(0x7fd75415edd0 legacy=0x7fd7540b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd751400640 1 --2- 172.21.15.173:0/1387262049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7540b3e70 0x7fd738005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd751400640 1 --2- 172.21.15.173:0/1387262049 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd738006150 0x7fd738006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd751400640 1 --2- 172.21.15.173:0/1387262049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd738006f60 0x7fd7380073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd751400640 1 -- 172.21.15.173:0/1387262049 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75406dd50 con 0x7fd738006150 2024-04-25T09:11:32.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd751400640 1 -- 172.21.15.173:0/1387262049 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75415f320 con 0x7fd738006f60 2024-04-25T09:11:32.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd751400640 1 -- 172.21.15.173:0/1387262049 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73800dbe0 con 0x7fd7540b3e70 2024-04-25T09:11:32.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd749400640 1 --2- 172.21.15.173:0/1387262049 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd738006150 0x7fd738006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd751e00640 1 --2- 172.21.15.173:0/1387262049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7540b3e70 0x7fd738005bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd752800640 1 --2- 172.21.15.173:0/1387262049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd738006f60 0x7fd7380073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd749400640 1 -- 172.21.15.173:0/1387262049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7540b3e70 msgr2=0x7fd738005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:32.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd749400640 1 --2- 172.21.15.173:0/1387262049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7540b3e70 0x7fd738005bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd749400640 1 -- 172.21.15.173:0/1387262049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd738006f60 msgr2=0x7fd7380073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:32.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd749400640 1 --2- 172.21.15.173:0/1387262049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd738006f60 0x7fd7380073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.162+0000 7fd749400640 1 -- 172.21.15.173:0/1387262049 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd738005740 con 0x7fd738006150 2024-04-25T09:11:32.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.166+0000 7fd749400640 1 --2- 172.21.15.173:0/1387262049 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd738006150 0x7fd738006a20 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009ae0 tx=0x7fd73c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbeace82798f472b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.166+0000 7fd751400640 1 -- 172.21.15.173:0/1387262049 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c0b2070 con 0x7fd738006150 2024-04-25T09:11:32.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.166+0000 7fd751400640 1 -- 172.21.15.173:0/1387262049 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73c0a5590 con 0x7fd738006150 2024-04-25T09:11:32.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.166+0000 7fd751400640 1 -- 172.21.15.173:0/1387262049 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c0096b0 con 0x7fd738006150 2024-04-25T09:11:32.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.166+0000 7fd758a00640 1 -- 172.21.15.173:0/1387262049 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd738006150 msgr2=0x7fd738006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.166+0000 7fd758a00640 1 --2- 172.21.15.173:0/1387262049 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd738006150 0x7fd738006a20 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009ae0 tx=0x7fd73c01ca50 comp rx=0 tx=0).stop 2024-04-25T09:11:32.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.166+0000 7fd752800640 1 -- 172.21.15.173:0/1387262049 reap_dead start 2024-04-25T09:11:32.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.166+0000 7fd758a00640 1 -- 172.21.15.173:0/1387262049 shutdown_connections 2024-04-25T09:11:32.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.166+0000 7fd758a00640 1 -- 172.21.15.173:0/1387262049 >> 172.21.15.173:0/1387262049 conn(0x7fd75406ac90 msgr2=0x7fd75406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:32.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.166+0000 7fd758a00640 1 -- 172.21.15.173:0/1387262049 shutdown_connections 2024-04-25T09:11:32.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.166+0000 7fd758a00640 1 -- 172.21.15.173:0/1387262049 wait complete. 2024-04-25T09:11:32.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd758a00640 1 Processor -- start 2024-04-25T09:11:32.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd758a00640 1 -- start start 2024-04-25T09:11:32.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd758a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd738006150 0x7fd75415d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd758a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd754157d70 0x7fd754157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd758a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd754157570 0x7fd754148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd758a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7540ce7b0 con 0x7fd754157570 2024-04-25T09:11:32.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd758a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75406d9e0 con 0x7fd754157d70 2024-04-25T09:11:32.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd758a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75415aba0 con 0x7fd738006150 2024-04-25T09:11:32.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd752800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd754157570 0x7fd754148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd752800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd754157570 0x7fd754148c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36854/0 (socket says 172.21.15.173:36854) 2024-04-25T09:11:32.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd752800640 1 -- 172.21.15.173:0/3192237115 learned_addr learned my addr 172.21.15.173:0/3192237115 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:32.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd751e00640 1 --2- 172.21.15.173:0/3192237115 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd738006150 0x7fd75415d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd749400640 1 --2- 172.21.15.173:0/3192237115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd754157d70 0x7fd754157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd752800640 1 -- 172.21.15.173:0/3192237115 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd738006150 msgr2=0x7fd75415d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd752800640 1 --2- 172.21.15.173:0/3192237115 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd738006150 0x7fd75415d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd752800640 1 -- 172.21.15.173:0/3192237115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd754157d70 msgr2=0x7fd754157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd752800640 1 --2- 172.21.15.173:0/3192237115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd754157d70 0x7fd754157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd752800640 1 -- 172.21.15.173:0/3192237115 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75415c510 con 0x7fd754157570 2024-04-25T09:11:32.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd749400640 1 --2- 172.21.15.173:0/3192237115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd754157d70 0x7fd754157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:32.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd752800640 1 --2- 172.21.15.173:0/3192237115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd754157570 0x7fd754148c70 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fd74c000c10 tx=0x7fd74c011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd74aa00640 1 -- 172.21.15.173:0/3192237115 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c010040 con 0x7fd754157570 2024-04-25T09:11:32.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd74aa00640 1 -- 172.21.15.173:0/3192237115 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74c01a070 con 0x7fd754157570 2024-04-25T09:11:32.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd74aa00640 1 -- 172.21.15.173:0/3192237115 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c00fb00 con 0x7fd754157570 2024-04-25T09:11:32.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd758a00640 1 -- 172.21.15.173:0/3192237115 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75415c7f0 con 0x7fd754157570 2024-04-25T09:11:32.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd758a00640 1 -- 172.21.15.173:0/3192237115 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75415cdb0 con 0x7fd754157570 2024-04-25T09:11:32.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.170+0000 7fd758a00640 1 -- 172.21.15.173:0/3192237115 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd754073a40 con 0x7fd754157570 2024-04-25T09:11:32.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.174+0000 7fd74aa00640 1 -- 172.21.15.173:0/3192237115 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd74c00fca0 con 0x7fd754157570 2024-04-25T09:11:32.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.174+0000 7fd74aa00640 1 --2- 172.21.15.173:0/3192237115 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd730066f60 0x7fd730069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.174+0000 7fd74aa00640 1 -- 172.21.15.173:0/3192237115 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd74c0881d0 con 0x7fd754157570 2024-04-25T09:11:32.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.174+0000 7fd751e00640 1 --2- 172.21.15.173:0/3192237115 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd730066f60 0x7fd730069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.174+0000 7fd751e00640 1 --2- 172.21.15.173:0/3192237115 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd730066f60 0x7fd730069420 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd7440133c0 tx=0x7fd74400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.178+0000 7fd74aa00640 1 -- 172.21.15.173:0/3192237115 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd74c058fb0 con 0x7fd754157570 2024-04-25T09:11:32.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.326+0000 7fd758a00640 1 -- 172.21.15.173:0/3192237115 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd75406e540 con 0x7fd730066f60 2024-04-25T09:11:32.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.334+0000 7fd74aa00640 1 -- 172.21.15.173:0/3192237115 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252382 (secure 0 0 0) 0x7fd75406e540 con 0x7fd730066f60 2024-04-25T09:11:32.322 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:32.323 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:11:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.338+0000 7fd758a00640 1 -- 172.21.15.173:0/3192237115 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd730066f60 msgr2=0x7fd730069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.338+0000 7fd758a00640 1 --2- 172.21.15.173:0/3192237115 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd730066f60 0x7fd730069420 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd7440133c0 tx=0x7fd74400b040 comp rx=0 tx=0).stop 2024-04-25T09:11:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.338+0000 7fd758a00640 1 -- 172.21.15.173:0/3192237115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd754157570 msgr2=0x7fd754148c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.338+0000 7fd758a00640 1 --2- 172.21.15.173:0/3192237115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd754157570 0x7fd754148c70 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fd74c000c10 tx=0x7fd74c011c20 comp rx=0 tx=0).stop 2024-04-25T09:11:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.338+0000 7fd758a00640 1 -- 172.21.15.173:0/3192237115 shutdown_connections 2024-04-25T09:11:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.338+0000 7fd758a00640 1 --2- 172.21.15.173:0/3192237115 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd730066f60 0x7fd730069420 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.338+0000 7fd758a00640 1 --2- 172.21.15.173:0/3192237115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd754157570 0x7fd754148c70 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.338+0000 7fd758a00640 1 --2- 172.21.15.173:0/3192237115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd754157d70 0x7fd754157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.338+0000 7fd758a00640 1 --2- 172.21.15.173:0/3192237115 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd738006150 0x7fd75415d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.338+0000 7fd758a00640 1 -- 172.21.15.173:0/3192237115 >> 172.21.15.173:0/3192237115 conn(0x7fd75406ac90 msgr2=0x7fd7540ceae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:32.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.338+0000 7fd758a00640 1 -- 172.21.15.173:0/3192237115 shutdown_connections 2024-04-25T09:11:32.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:32.338+0000 7fd758a00640 1 -- 172.21.15.173:0/3192237115 wait complete. 2024-04-25T09:11:32.342 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":382,"stamp":"2024-04-25T09:11:30.841729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":427604,"kb_used_data":12956,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754547116,"statfs":{"total":773094113280,"available":772656246784,"internally_reserved":0,"allocated":13266944,"data_stored":6776797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":424463920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001199"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768987+0000","last_change":"2024-04-25T09:11:26.787243+0000","last_active":"2024-04-25T09:11:27.768987+0000","last_peered":"2024-04-25T09:11:27.768987+0000","last_clean":"2024-04-25T09:11:27.768987+0000","last_became_active":"2024-04-25T09:11:26.786975+0000","last_became_peered":"2024-04-25T09:11:26.786975+0000","last_unstale":"2024-04-25T09:11:27.768987+0000","last_undegraded":"2024-04-25T09:11:27.768987+0000","last_fullsized":"2024-04-25T09:11:27.768987+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:30.819327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.808070+0000","last_change":"2024-04-25T09:11:26.806403+0000","last_active":"2024-04-25T09:11:26.808070+0000","last_peered":"2024-04-25T09:11:26.808070+0000","last_clean":"2024-04-25T09:11:26.808070+0000","last_became_active":"2024-04-25T09:11:26.804718+0000","last_became_peered":"2024-04-25T09:11:26.804718+0000","last_unstale":"2024-04-25T09:11:26.808070+0000","last_undegraded":"2024-04-25T09:11:26.808070+0000","last_fullsized":"2024-04-25T09:11:26.808070+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:09.911379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.804401+0000","last_change":"2024-04-25T09:11:26.794706+0000","last_active":"2024-04-25T09:11:26.804401+0000","last_peered":"2024-04-25T09:11:26.804401+0000","last_clean":"2024-04-25T09:11:26.804401+0000","last_became_active":"2024-04-25T09:11:26.794366+0000","last_became_peered":"2024-04-25T09:11:26.794366+0000","last_unstale":"2024-04-25T09:11:26.804401+0000","last_undegraded":"2024-04-25T09:11:26.804401+0000","last_fullsized":"2024-04-25T09:11:26.804401+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:56.161415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.788996+0000","last_change":"2024-04-25T09:11:26.784135+0000","last_active":"2024-04-25T09:11:26.788996+0000","last_peered":"2024-04-25T09:11:26.788996+0000","last_clean":"2024-04-25T09:11:26.788996+0000","last_became_active":"2024-04-25T09:11:26.783850+0000","last_became_peered":"2024-04-25T09:11:26.783850+0000","last_unstale":"2024-04-25T09:11:26.788996+0000","last_undegraded":"2024-04-25T09:11:26.788996+0000","last_fullsized":"2024-04-25T09:11:26.788996+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:30.057861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768372+0000","last_change":"2024-04-25T09:11:26.771408+0000","last_active":"2024-04-25T09:11:27.768372+0000","last_peered":"2024-04-25T09:11:27.768372+0000","last_clean":"2024-04-25T09:11:27.768372+0000","last_became_active":"2024-04-25T09:11:26.771106+0000","last_became_peered":"2024-04-25T09:11:26.771106+0000","last_unstale":"2024-04-25T09:11:27.768372+0000","last_undegraded":"2024-04-25T09:11:27.768372+0000","last_fullsized":"2024-04-25T09:11:27.768372+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:20.917299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767559+0000","last_change":"2024-04-25T09:11:26.797018+0000","last_active":"2024-04-25T09:11:27.767559+0000","last_peered":"2024-04-25T09:11:27.767559+0000","last_clean":"2024-04-25T09:11:27.767559+0000","last_became_active":"2024-04-25T09:11:26.796767+0000","last_became_peered":"2024-04-25T09:11:26.796767+0000","last_unstale":"2024-04-25T09:11:27.767559+0000","last_undegraded":"2024-04-25T09:11:27.767559+0000","last_fullsized":"2024-04-25T09:11:27.767559+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:03.914384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767133+0000","last_change":"2024-04-25T09:11:26.778696+0000","last_active":"2024-04-25T09:11:27.767133+0000","last_peered":"2024-04-25T09:11:27.767133+0000","last_clean":"2024-04-25T09:11:27.767133+0000","last_became_active":"2024-04-25T09:11:26.778367+0000","last_became_peered":"2024-04-25T09:11:26.778367+0000","last_unstale":"2024-04-25T09:11:27.767133+0000","last_undegraded":"2024-04-25T09:11:27.767133+0000","last_fullsized":"2024-04-25T09:11:27.767133+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:36.182448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.805017+0000","last_change":"2024-04-25T09:11:26.794235+0000","last_active":"2024-04-25T09:11:26.805017+0000","last_peered":"2024-04-25T09:11:26.805017+0000","last_clean":"2024-04-25T09:11:26.805017+0000","last_became_active":"2024-04-25T09:11:26.793919+0000","last_became_peered":"2024-04-25T09:11:26.793919+0000","last_unstale":"2024-04-25T09:11:26.805017+0000","last_undegraded":"2024-04-25T09:11:26.805017+0000","last_fullsized":"2024-04-25T09:11:26.805017+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:40.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":3,"reported_epoch":121,"state":"creating+activating","last_fresh":"2024-04-25T09:11:26.777365+0000","last_change":"2024-04-25T09:11:26.777365+0000","last_active":"2024-04-25T09:11:25.752627+0000","last_peered":"2024-04-25T09:11:25.752627+0000","last_clean":"2024-04-25T09:11:25.752627+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:11:26.777365+0000","last_undegraded":"2024-04-25T09:11:26.777365+0000","last_fullsized":"2024-04-25T09:11:26.777365+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.788460+0000","last_change":"2024-04-25T09:11:26.786628+0000","last_active":"2024-04-25T09:11:26.788460+0000","last_peered":"2024-04-25T09:11:26.788460+0000","last_clean":"2024-04-25T09:11:26.788460+0000","last_became_active":"2024-04-25T09:11:26.786348+0000","last_became_peered":"2024-04-25T09:11:26.786348+0000","last_unstale":"2024-04-25T09:11:26.788460+0000","last_undegraded":"2024-04-25T09:11:26.788460+0000","last_fullsized":"2024-04-25T09:11:26.788460+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:43.578822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.769033+0000","last_change":"2024-04-25T09:11:26.783292+0000","last_active":"2024-04-25T09:11:27.769033+0000","last_peered":"2024-04-25T09:11:27.769033+0000","last_clean":"2024-04-25T09:11:27.769033+0000","last_became_active":"2024-04-25T09:11:26.783017+0000","last_became_peered":"2024-04-25T09:11:26.783017+0000","last_unstale":"2024-04-25T09:11:27.769033+0000","last_undegraded":"2024-04-25T09:11:27.769033+0000","last_fullsized":"2024-04-25T09:11:27.769033+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:44.158295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767635+0000","last_change":"2024-04-25T09:11:26.772025+0000","last_active":"2024-04-25T09:11:27.767635+0000","last_peered":"2024-04-25T09:11:27.767635+0000","last_clean":"2024-04-25T09:11:27.767635+0000","last_became_active":"2024-04-25T09:11:26.771747+0000","last_became_peered":"2024-04-25T09:11:26.771747+0000","last_unstale":"2024-04-25T09:11:27.767635+0000","last_undegraded":"2024-04-25T09:11:27.767635+0000","last_fullsized":"2024-04-25T09:11:27.767635+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:01.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.792314+0000","last_change":"2024-04-25T09:11:26.787942+0000","last_active":"2024-04-25T09:11:26.792314+0000","last_peered":"2024-04-25T09:11:26.792314+0000","last_clean":"2024-04-25T09:11:26.792314+0000","last_became_active":"2024-04-25T09:11:26.787585+0000","last_became_peered":"2024-04-25T09:11:26.787585+0000","last_unstale":"2024-04-25T09:11:26.792314+0000","last_undegraded":"2024-04-25T09:11:26.792314+0000","last_fullsized":"2024-04-25T09:11:26.792314+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:06.710197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.807110+0000","last_change":"2024-04-25T09:11:26.801981+0000","last_active":"2024-04-25T09:11:26.807110+0000","last_peered":"2024-04-25T09:11:26.807110+0000","last_clean":"2024-04-25T09:11:26.807110+0000","last_became_active":"2024-04-25T09:11:26.794868+0000","last_became_peered":"2024-04-25T09:11:26.794868+0000","last_unstale":"2024-04-25T09:11:26.807110+0000","last_undegraded":"2024-04-25T09:11:26.807110+0000","last_fullsized":"2024-04-25T09:11:26.807110+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:53.484584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767548+0000","last_change":"2024-04-25T09:11:26.782835+0000","last_active":"2024-04-25T09:11:27.767548+0000","last_peered":"2024-04-25T09:11:27.767548+0000","last_clean":"2024-04-25T09:11:27.767548+0000","last_became_active":"2024-04-25T09:11:26.782340+0000","last_became_peered":"2024-04-25T09:11:26.782340+0000","last_unstale":"2024-04-25T09:11:27.767548+0000","last_undegraded":"2024-04-25T09:11:27.767548+0000","last_fullsized":"2024-04-25T09:11:27.767548+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:18.339218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767110+0000","last_change":"2024-04-25T09:11:26.795334+0000","last_active":"2024-04-25T09:11:27.767110+0000","last_peered":"2024-04-25T09:11:27.767110+0000","last_clean":"2024-04-25T09:11:27.767110+0000","last_became_active":"2024-04-25T09:11:26.794720+0000","last_became_peered":"2024-04-25T09:11:26.794720+0000","last_unstale":"2024-04-25T09:11:27.767110+0000","last_undegraded":"2024-04-25T09:11:27.767110+0000","last_fullsized":"2024-04-25T09:11:27.767110+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:17.010143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.790261+0000","last_change":"2024-04-25T09:11:26.788198+0000","last_active":"2024-04-25T09:11:26.790261+0000","last_peered":"2024-04-25T09:11:26.790261+0000","last_clean":"2024-04-25T09:11:26.790261+0000","last_became_active":"2024-04-25T09:11:26.787463+0000","last_became_peered":"2024-04-25T09:11:26.787463+0000","last_unstale":"2024-04-25T09:11:26.790261+0000","last_undegraded":"2024-04-25T09:11:26.790261+0000","last_fullsized":"2024-04-25T09:11:26.790261+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:09.020019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.808049+0000","last_change":"2024-04-25T09:11:26.804889+0000","last_active":"2024-04-25T09:11:26.808049+0000","last_peered":"2024-04-25T09:11:26.808049+0000","last_clean":"2024-04-25T09:11:26.808049+0000","last_became_active":"2024-04-25T09:11:26.804397+0000","last_became_peered":"2024-04-25T09:11:26.804397+0000","last_unstale":"2024-04-25T09:11:26.808049+0000","last_undegraded":"2024-04-25T09:11:26.808049+0000","last_fullsized":"2024-04-25T09:11:26.808049+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:08.462078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768173+0000","last_change":"2024-04-25T09:11:26.782877+0000","last_active":"2024-04-25T09:11:27.768173+0000","last_peered":"2024-04-25T09:11:27.768173+0000","last_clean":"2024-04-25T09:11:27.768173+0000","last_became_active":"2024-04-25T09:11:26.782538+0000","last_became_peered":"2024-04-25T09:11:26.782538+0000","last_unstale":"2024-04-25T09:11:27.768173+0000","last_undegraded":"2024-04-25T09:11:27.768173+0000","last_fullsized":"2024-04-25T09:11:27.768173+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:02.178137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.795822+0000","last_change":"2024-04-25T09:11:26.791381+0000","last_active":"2024-04-25T09:11:26.795822+0000","last_peered":"2024-04-25T09:11:26.795822+0000","last_clean":"2024-04-25T09:11:26.795822+0000","last_became_active":"2024-04-25T09:11:26.789379+0000","last_became_peered":"2024-04-25T09:11:26.789379+0000","last_unstale":"2024-04-25T09:11:26.795822+0000","last_undegraded":"2024-04-25T09:11:26.795822+0000","last_fullsized":"2024-04-25T09:11:26.795822+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:27.017599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.795392+0000","last_change":"2024-04-25T09:11:26.793939+0000","last_active":"2024-04-25T09:11:26.795392+0000","last_peered":"2024-04-25T09:11:26.795392+0000","last_clean":"2024-04-25T09:11:26.795392+0000","last_became_active":"2024-04-25T09:11:26.792032+0000","last_became_peered":"2024-04-25T09:11:26.792032+0000","last_unstale":"2024-04-25T09:11:26.795392+0000","last_undegraded":"2024-04-25T09:11:26.795392+0000","last_fullsized":"2024-04-25T09:11:26.795392+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:07.110094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.769149+0000","last_change":"2024-04-25T09:11:26.798320+0000","last_active":"2024-04-25T09:11:27.769149+0000","last_peered":"2024-04-25T09:11:27.769149+0000","last_clean":"2024-04-25T09:11:27.769149+0000","last_became_active":"2024-04-25T09:11:26.797870+0000","last_became_peered":"2024-04-25T09:11:26.797870+0000","last_unstale":"2024-04-25T09:11:27.769149+0000","last_undegraded":"2024-04-25T09:11:27.769149+0000","last_fullsized":"2024-04-25T09:11:27.769149+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:48.355880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.801768+0000","last_change":"2024-04-25T09:11:26.801768+0000","last_active":"2024-04-25T09:11:26.801768+0000","last_peered":"2024-04-25T09:11:26.801768+0000","last_clean":"2024-04-25T09:11:26.801768+0000","last_became_active":"2024-04-25T09:11:26.801480+0000","last_became_peered":"2024-04-25T09:11:26.801480+0000","last_unstale":"2024-04-25T09:11:26.801768+0000","last_undegraded":"2024-04-25T09:11:26.801768+0000","last_fullsized":"2024-04-25T09:11:26.801768+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:10.217192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070205+0000","last_change":"2024-04-25T09:11:26.790623+0000","last_active":"2024-04-25T09:11:28.070205+0000","last_peered":"2024-04-25T09:11:28.070205+0000","last_clean":"2024-04-25T09:11:28.070205+0000","last_became_active":"2024-04-25T09:11:26.790108+0000","last_became_peered":"2024-04-25T09:11:26.790108+0000","last_unstale":"2024-04-25T09:11:28.070205+0000","last_undegraded":"2024-04-25T09:11:28.070205+0000","last_fullsized":"2024-04-25T09:11:28.070205+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:30.819327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070601+0000","last_change":"2024-04-25T09:11:26.783160+0000","last_active":"2024-04-25T09:11:28.070601+0000","last_peered":"2024-04-25T09:11:28.070601+0000","last_clean":"2024-04-25T09:11:28.070601+0000","last_became_active":"2024-04-25T09:11:26.782852+0000","last_became_peered":"2024-04-25T09:11:26.782852+0000","last_unstale":"2024-04-25T09:11:28.070601+0000","last_undegraded":"2024-04-25T09:11:28.070601+0000","last_fullsized":"2024-04-25T09:11:28.070601+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:08.011751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.797781+0000","last_change":"2024-04-25T09:11:26.792420+0000","last_active":"2024-04-25T09:11:26.797781+0000","last_peered":"2024-04-25T09:11:26.797781+0000","last_clean":"2024-04-25T09:11:26.797781+0000","last_became_active":"2024-04-25T09:11:26.792149+0000","last_became_peered":"2024-04-25T09:11:26.792149+0000","last_unstale":"2024-04-25T09:11:26.797781+0000","last_undegraded":"2024-04-25T09:11:26.797781+0000","last_fullsized":"2024-04-25T09:11:26.797781+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:35.433281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768495+0000","last_change":"2024-04-25T09:11:26.780285+0000","last_active":"2024-04-25T09:11:27.768495+0000","last_peered":"2024-04-25T09:11:27.768495+0000","last_clean":"2024-04-25T09:11:27.768495+0000","last_became_active":"2024-04-25T09:11:26.780022+0000","last_became_peered":"2024-04-25T09:11:26.780022+0000","last_unstale":"2024-04-25T09:11:27.768495+0000","last_undegraded":"2024-04-25T09:11:27.768495+0000","last_fullsized":"2024-04-25T09:11:27.768495+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:41.102958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767748+0000","last_change":"2024-04-25T09:11:26.781347+0000","last_active":"2024-04-25T09:11:27.767748+0000","last_peered":"2024-04-25T09:11:27.767748+0000","last_clean":"2024-04-25T09:11:27.767748+0000","last_became_active":"2024-04-25T09:11:26.781120+0000","last_became_peered":"2024-04-25T09:11:26.781120+0000","last_unstale":"2024-04-25T09:11:27.767748+0000","last_undegraded":"2024-04-25T09:11:27.767748+0000","last_fullsized":"2024-04-25T09:11:27.767748+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:01.534619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.806525+0000","last_change":"2024-04-25T09:11:26.805666+0000","last_active":"2024-04-25T09:11:26.806525+0000","last_peered":"2024-04-25T09:11:26.806525+0000","last_clean":"2024-04-25T09:11:26.806525+0000","last_became_active":"2024-04-25T09:11:26.805395+0000","last_became_peered":"2024-04-25T09:11:26.805395+0000","last_unstale":"2024-04-25T09:11:26.806525+0000","last_undegraded":"2024-04-25T09:11:26.806525+0000","last_fullsized":"2024-04-25T09:11:26.806525+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:50.859865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.806206+0000","last_change":"2024-04-25T09:11:26.793946+0000","last_active":"2024-04-25T09:11:26.806206+0000","last_peered":"2024-04-25T09:11:26.806206+0000","last_clean":"2024-04-25T09:11:26.806206+0000","last_became_active":"2024-04-25T09:11:26.784942+0000","last_became_peered":"2024-04-25T09:11:26.784942+0000","last_unstale":"2024-04-25T09:11:26.806206+0000","last_undegraded":"2024-04-25T09:11:26.806206+0000","last_fullsized":"2024-04-25T09:11:26.806206+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:30.057861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070246+0000","last_change":"2024-04-25T09:11:26.795695+0000","last_active":"2024-04-25T09:11:28.070246+0000","last_peered":"2024-04-25T09:11:28.070246+0000","last_clean":"2024-04-25T09:11:28.070246+0000","last_became_active":"2024-04-25T09:11:26.795419+0000","last_became_peered":"2024-04-25T09:11:26.795419+0000","last_unstale":"2024-04-25T09:11:28.070246+0000","last_undegraded":"2024-04-25T09:11:28.070246+0000","last_fullsized":"2024-04-25T09:11:28.070246+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:03.214507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070156+0000","last_change":"2024-04-25T09:11:26.790369+0000","last_active":"2024-04-25T09:11:28.070156+0000","last_peered":"2024-04-25T09:11:28.070156+0000","last_clean":"2024-04-25T09:11:28.070156+0000","last_became_active":"2024-04-25T09:11:26.789737+0000","last_became_peered":"2024-04-25T09:11:26.789737+0000","last_unstale":"2024-04-25T09:11:28.070156+0000","last_undegraded":"2024-04-25T09:11:28.070156+0000","last_fullsized":"2024-04-25T09:11:28.070156+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:44.158295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.791717+0000","last_change":"2024-04-25T09:11:26.787994+0000","last_active":"2024-04-25T09:11:26.791717+0000","last_peered":"2024-04-25T09:11:26.791717+0000","last_clean":"2024-04-25T09:11:26.791717+0000","last_became_active":"2024-04-25T09:11:26.787717+0000","last_became_peered":"2024-04-25T09:11:26.787717+0000","last_unstale":"2024-04-25T09:11:26.791717+0000","last_undegraded":"2024-04-25T09:11:26.791717+0000","last_fullsized":"2024-04-25T09:11:26.791717+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:12.274747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"121'4","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768329+0000","last_change":"2024-04-25T09:11:25.782496+0000","last_active":"2024-04-25T09:11:27.768329+0000","last_peered":"2024-04-25T09:11:27.768329+0000","last_clean":"2024-04-25T09:11:27.768329+0000","last_became_active":"2024-04-25T09:11:25.782211+0000","last_became_peered":"2024-04-25T09:11:25.782211+0000","last_unstale":"2024-04-25T09:11:27.768329+0000","last_undegraded":"2024-04-25T09:11:27.768329+0000","last_fullsized":"2024-04-25T09:11:27.768329+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:43.030827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767536+0000","last_change":"2024-04-25T09:11:26.803328+0000","last_active":"2024-04-25T09:11:27.767536+0000","last_peered":"2024-04-25T09:11:27.767536+0000","last_clean":"2024-04-25T09:11:27.767536+0000","last_became_active":"2024-04-25T09:11:26.802977+0000","last_became_peered":"2024-04-25T09:11:26.802977+0000","last_unstale":"2024-04-25T09:11:27.767536+0000","last_undegraded":"2024-04-25T09:11:27.767536+0000","last_fullsized":"2024-04-25T09:11:27.767536+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:18.825168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"121'1","reported_seq":13,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.803602+0000","last_change":"2024-04-25T09:11:25.789063+0000","last_active":"2024-04-25T09:11:26.803602+0000","last_peered":"2024-04-25T09:11:26.803602+0000","last_clean":"2024-04-25T09:11:26.803602+0000","last_became_active":"2024-04-25T09:11:25.788745+0000","last_became_peered":"2024-04-25T09:11:25.788745+0000","last_unstale":"2024-04-25T09:11:26.803602+0000","last_undegraded":"2024-04-25T09:11:26.803602+0000","last_fullsized":"2024-04-25T09:11:26.803602+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:26:16.606333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070386+0000","last_change":"2024-04-25T09:11:26.780782+0000","last_active":"2024-04-25T09:11:28.070386+0000","last_peered":"2024-04-25T09:11:28.070386+0000","last_clean":"2024-04-25T09:11:28.070386+0000","last_became_active":"2024-04-25T09:11:26.780519+0000","last_became_peered":"2024-04-25T09:11:26.780519+0000","last_unstale":"2024-04-25T09:11:28.070386+0000","last_undegraded":"2024-04-25T09:11:28.070386+0000","last_fullsized":"2024-04-25T09:11:28.070386+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:44.033298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"121'2","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.798594+0000","last_change":"2024-04-25T09:11:25.788687+0000","last_active":"2024-04-25T09:11:26.798594+0000","last_peered":"2024-04-25T09:11:26.798594+0000","last_clean":"2024-04-25T09:11:26.798594+0000","last_became_active":"2024-04-25T09:11:25.788408+0000","last_became_peered":"2024-04-25T09:11:25.788408+0000","last_unstale":"2024-04-25T09:11:26.798594+0000","last_undegraded":"2024-04-25T09:11:26.798594+0000","last_fullsized":"2024-04-25T09:11:26.798594+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:29.964854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.798002+0000","last_change":"2024-04-25T09:11:26.797141+0000","last_active":"2024-04-25T09:11:26.798002+0000","last_peered":"2024-04-25T09:11:26.798002+0000","last_clean":"2024-04-25T09:11:26.798002+0000","last_became_active":"2024-04-25T09:11:26.796854+0000","last_became_peered":"2024-04-25T09:11:26.796854+0000","last_unstale":"2024-04-25T09:11:26.798002+0000","last_undegraded":"2024-04-25T09:11:26.798002+0000","last_fullsized":"2024-04-25T09:11:26.798002+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:56.161415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"121'2","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.809316+0000","last_change":"2024-04-25T09:11:25.778670+0000","last_active":"2024-04-25T09:11:26.809316+0000","last_peered":"2024-04-25T09:11:26.809316+0000","last_clean":"2024-04-25T09:11:26.809316+0000","last_became_active":"2024-04-25T09:11:25.778177+0000","last_became_peered":"2024-04-25T09:11:25.778177+0000","last_unstale":"2024-04-25T09:11:26.809316+0000","last_undegraded":"2024-04-25T09:11:26.809316+0000","last_fullsized":"2024-04-25T09:11:26.809316+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:01.802409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.791752+0000","last_change":"2024-04-25T09:11:26.789429+0000","last_active":"2024-04-25T09:11:26.791752+0000","last_peered":"2024-04-25T09:11:26.791752+0000","last_clean":"2024-04-25T09:11:26.791752+0000","last_became_active":"2024-04-25T09:11:26.788594+0000","last_became_peered":"2024-04-25T09:11:26.788594+0000","last_unstale":"2024-04-25T09:11:26.791752+0000","last_undegraded":"2024-04-25T09:11:26.791752+0000","last_fullsized":"2024-04-25T09:11:26.791752+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:57.095719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768484+0000","last_change":"2024-04-25T09:11:25.778748+0000","last_active":"2024-04-25T09:11:27.768484+0000","last_peered":"2024-04-25T09:11:27.768484+0000","last_clean":"2024-04-25T09:11:27.768484+0000","last_became_active":"2024-04-25T09:11:25.778369+0000","last_became_peered":"2024-04-25T09:11:25.778369+0000","last_unstale":"2024-04-25T09:11:27.768484+0000","last_undegraded":"2024-04-25T09:11:27.768484+0000","last_fullsized":"2024-04-25T09:11:27.768484+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:40.038318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767759+0000","last_change":"2024-04-25T09:11:26.782603+0000","last_active":"2024-04-25T09:11:27.767759+0000","last_peered":"2024-04-25T09:11:27.767759+0000","last_clean":"2024-04-25T09:11:27.767759+0000","last_became_active":"2024-04-25T09:11:26.781970+0000","last_became_peered":"2024-04-25T09:11:26.781970+0000","last_unstale":"2024-04-25T09:11:27.767759+0000","last_undegraded":"2024-04-25T09:11:27.767759+0000","last_fullsized":"2024-04-25T09:11:27.767759+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:50.866716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767584+0000","last_change":"2024-04-25T09:11:25.784323+0000","last_active":"2024-04-25T09:11:27.767584+0000","last_peered":"2024-04-25T09:11:27.767584+0000","last_clean":"2024-04-25T09:11:27.767584+0000","last_became_active":"2024-04-25T09:11:25.783886+0000","last_became_peered":"2024-04-25T09:11:25.783886+0000","last_unstale":"2024-04-25T09:11:27.767584+0000","last_undegraded":"2024-04-25T09:11:27.767584+0000","last_fullsized":"2024-04-25T09:11:27.767584+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:47.142671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.806230+0000","last_change":"2024-04-25T09:11:26.796820+0000","last_active":"2024-04-25T09:11:26.806230+0000","last_peered":"2024-04-25T09:11:26.806230+0000","last_clean":"2024-04-25T09:11:26.806230+0000","last_became_active":"2024-04-25T09:11:26.796373+0000","last_became_peered":"2024-04-25T09:11:26.796373+0000","last_unstale":"2024-04-25T09:11:26.806230+0000","last_undegraded":"2024-04-25T09:11:26.806230+0000","last_fullsized":"2024-04-25T09:11:26.806230+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:24.936289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070315+0000","last_change":"2024-04-25T09:11:25.786111+0000","last_active":"2024-04-25T09:11:28.070315+0000","last_peered":"2024-04-25T09:11:28.070315+0000","last_clean":"2024-04-25T09:11:28.070315+0000","last_became_active":"2024-04-25T09:11:25.785762+0000","last_became_peered":"2024-04-25T09:11:25.785762+0000","last_unstale":"2024-04-25T09:11:28.070315+0000","last_undegraded":"2024-04-25T09:11:28.070315+0000","last_fullsized":"2024-04-25T09:11:28.070315+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:24.290504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.808512+0000","last_change":"2024-04-25T09:11:26.807560+0000","last_active":"2024-04-25T09:11:26.808512+0000","last_peered":"2024-04-25T09:11:26.808512+0000","last_clean":"2024-04-25T09:11:26.808512+0000","last_became_active":"2024-04-25T09:11:26.807297+0000","last_became_peered":"2024-04-25T09:11:26.807297+0000","last_unstale":"2024-04-25T09:11:26.808512+0000","last_undegraded":"2024-04-25T09:11:26.808512+0000","last_fullsized":"2024-04-25T09:11:26.808512+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:05.958586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767243+0000","last_change":"2024-04-25T09:11:25.782062+0000","last_active":"2024-04-25T09:11:27.767243+0000","last_peered":"2024-04-25T09:11:27.767243+0000","last_clean":"2024-04-25T09:11:27.767243+0000","last_became_active":"2024-04-25T09:11:25.781812+0000","last_became_peered":"2024-04-25T09:11:25.781812+0000","last_unstale":"2024-04-25T09:11:27.767243+0000","last_undegraded":"2024-04-25T09:11:27.767243+0000","last_fullsized":"2024-04-25T09:11:27.767243+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:17.958244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767943+0000","last_change":"2024-04-25T09:11:26.783348+0000","last_active":"2024-04-25T09:11:27.767943+0000","last_peered":"2024-04-25T09:11:27.767943+0000","last_clean":"2024-04-25T09:11:27.767943+0000","last_became_active":"2024-04-25T09:11:26.783086+0000","last_became_peered":"2024-04-25T09:11:26.783086+0000","last_unstale":"2024-04-25T09:11:27.767943+0000","last_undegraded":"2024-04-25T09:11:27.767943+0000","last_fullsized":"2024-04-25T09:11:27.767943+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:25.760586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768379+0000","last_change":"2024-04-25T09:11:25.786883+0000","last_active":"2024-04-25T09:11:27.768379+0000","last_peered":"2024-04-25T09:11:27.768379+0000","last_clean":"2024-04-25T09:11:27.768379+0000","last_became_active":"2024-04-25T09:11:25.786471+0000","last_became_peered":"2024-04-25T09:11:25.786471+0000","last_unstale":"2024-04-25T09:11:27.768379+0000","last_undegraded":"2024-04-25T09:11:27.768379+0000","last_fullsized":"2024-04-25T09:11:27.768379+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:33.024623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070506+0000","last_change":"2024-04-25T09:11:26.802053+0000","last_active":"2024-04-25T09:11:28.070506+0000","last_peered":"2024-04-25T09:11:28.070506+0000","last_clean":"2024-04-25T09:11:28.070506+0000","last_became_active":"2024-04-25T09:11:26.801745+0000","last_became_peered":"2024-04-25T09:11:26.801745+0000","last_unstale":"2024-04-25T09:11:28.070506+0000","last_undegraded":"2024-04-25T09:11:28.070506+0000","last_fullsized":"2024-04-25T09:11:28.070506+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:34.027095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070327+0000","last_change":"2024-04-25T09:11:25.790188+0000","last_active":"2024-04-25T09:11:28.070327+0000","last_peered":"2024-04-25T09:11:28.070327+0000","last_clean":"2024-04-25T09:11:28.070327+0000","last_became_active":"2024-04-25T09:11:25.789477+0000","last_became_peered":"2024-04-25T09:11:25.789477+0000","last_unstale":"2024-04-25T09:11:28.070327+0000","last_undegraded":"2024-04-25T09:11:28.070327+0000","last_fullsized":"2024-04-25T09:11:28.070327+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:40.038318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.807631+0000","last_change":"2024-04-25T09:11:26.804558+0000","last_active":"2024-04-25T09:11:26.807631+0000","last_peered":"2024-04-25T09:11:26.807631+0000","last_clean":"2024-04-25T09:11:26.807631+0000","last_became_active":"2024-04-25T09:11:26.801426+0000","last_became_peered":"2024-04-25T09:11:26.801426+0000","last_unstale":"2024-04-25T09:11:26.807631+0000","last_undegraded":"2024-04-25T09:11:26.807631+0000","last_fullsized":"2024-04-25T09:11:26.807631+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:11.458429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"121'3","reported_seq":17,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070498+0000","last_change":"2024-04-25T09:11:25.785530+0000","last_active":"2024-04-25T09:11:28.070498+0000","last_peered":"2024-04-25T09:11:28.070498+0000","last_clean":"2024-04-25T09:11:28.070498+0000","last_became_active":"2024-04-25T09:11:25.785236+0000","last_became_peered":"2024-04-25T09:11:25.785236+0000","last_unstale":"2024-04-25T09:11:28.070498+0000","last_undegraded":"2024-04-25T09:11:28.070498+0000","last_fullsized":"2024-04-25T09:11:28.070498+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:36.050959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070656+0000","last_change":"2024-04-25T09:11:26.793693+0000","last_active":"2024-04-25T09:11:28.070656+0000","last_peered":"2024-04-25T09:11:28.070656+0000","last_clean":"2024-04-25T09:11:28.070656+0000","last_became_active":"2024-04-25T09:11:26.793379+0000","last_became_peered":"2024-04-25T09:11:26.793379+0000","last_unstale":"2024-04-25T09:11:28.070656+0000","last_undegraded":"2024-04-25T09:11:28.070656+0000","last_fullsized":"2024-04-25T09:11:28.070656+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:58.722752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"121'6","reported_seq":18,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.809992+0000","last_change":"2024-04-25T09:11:25.788323+0000","last_active":"2024-04-25T09:11:26.809992+0000","last_peered":"2024-04-25T09:11:26.809992+0000","last_clean":"2024-04-25T09:11:26.809992+0000","last_became_active":"2024-04-25T09:11:25.787675+0000","last_became_peered":"2024-04-25T09:11:25.787675+0000","last_unstale":"2024-04-25T09:11:26.809992+0000","last_undegraded":"2024-04-25T09:11:26.809992+0000","last_fullsized":"2024-04-25T09:11:26.809992+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:29.964854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768233+0000","last_change":"2024-04-25T09:11:26.776056+0000","last_active":"2024-04-25T09:11:27.768233+0000","last_peered":"2024-04-25T09:11:27.768233+0000","last_clean":"2024-04-25T09:11:27.768233+0000","last_became_active":"2024-04-25T09:11:26.775732+0000","last_became_peered":"2024-04-25T09:11:26.775732+0000","last_unstale":"2024-04-25T09:11:27.768233+0000","last_undegraded":"2024-04-25T09:11:27.768233+0000","last_fullsized":"2024-04-25T09:11:27.768233+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:20.515945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"121'2","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.807771+0000","last_change":"2024-04-25T09:11:25.786240+0000","last_active":"2024-04-25T09:11:26.807771+0000","last_peered":"2024-04-25T09:11:26.807771+0000","last_clean":"2024-04-25T09:11:26.807771+0000","last_became_active":"2024-04-25T09:11:25.785904+0000","last_became_peered":"2024-04-25T09:11:25.785904+0000","last_unstale":"2024-04-25T09:11:26.807771+0000","last_undegraded":"2024-04-25T09:11:26.807771+0000","last_fullsized":"2024-04-25T09:11:26.807771+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:03.302767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.800822+0000","last_change":"2024-04-25T09:11:26.799364+0000","last_active":"2024-04-25T09:11:26.800822+0000","last_peered":"2024-04-25T09:11:26.800822+0000","last_clean":"2024-04-25T09:11:26.800822+0000","last_became_active":"2024-04-25T09:11:26.798845+0000","last_became_peered":"2024-04-25T09:11:26.798845+0000","last_unstale":"2024-04-25T09:11:26.800822+0000","last_undegraded":"2024-04-25T09:11:26.800822+0000","last_fullsized":"2024-04-25T09:11:26.800822+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:51.241627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.794340+0000","last_change":"2024-04-25T09:11:25.789385+0000","last_active":"2024-04-25T09:11:26.794340+0000","last_peered":"2024-04-25T09:11:26.794340+0000","last_clean":"2024-04-25T09:11:26.794340+0000","last_became_active":"2024-04-25T09:11:25.789127+0000","last_became_peered":"2024-04-25T09:11:25.789127+0000","last_unstale":"2024-04-25T09:11:26.794340+0000","last_undegraded":"2024-04-25T09:11:26.794340+0000","last_fullsized":"2024-04-25T09:11:26.794340+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:06.107623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.791967+0000","last_change":"2024-04-25T09:11:26.789683+0000","last_active":"2024-04-25T09:11:26.791967+0000","last_peered":"2024-04-25T09:11:26.791967+0000","last_clean":"2024-04-25T09:11:26.791967+0000","last_became_active":"2024-04-25T09:11:26.788459+0000","last_became_peered":"2024-04-25T09:11:26.788459+0000","last_unstale":"2024-04-25T09:11:26.791967+0000","last_undegraded":"2024-04-25T09:11:26.791967+0000","last_fullsized":"2024-04-25T09:11:26.791967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:19.898515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.786092+0000","last_change":"2024-04-25T09:11:25.787217+0000","last_active":"2024-04-25T09:11:26.786092+0000","last_peered":"2024-04-25T09:11:26.786092+0000","last_clean":"2024-04-25T09:11:26.786092+0000","last_became_active":"2024-04-25T09:11:25.786763+0000","last_became_peered":"2024-04-25T09:11:25.786763+0000","last_unstale":"2024-04-25T09:11:26.786092+0000","last_undegraded":"2024-04-25T09:11:26.786092+0000","last_fullsized":"2024-04-25T09:11:26.786092+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:09.144966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070405+0000","last_change":"2024-04-25T09:11:26.781598+0000","last_active":"2024-04-25T09:11:28.070405+0000","last_peered":"2024-04-25T09:11:28.070405+0000","last_clean":"2024-04-25T09:11:28.070405+0000","last_became_active":"2024-04-25T09:11:26.781290+0000","last_became_peered":"2024-04-25T09:11:26.781290+0000","last_unstale":"2024-04-25T09:11:28.070405+0000","last_undegraded":"2024-04-25T09:11:28.070405+0000","last_fullsized":"2024-04-25T09:11:28.070405+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:11.569136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"121'1","reported_seq":13,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.800436+0000","last_change":"2024-04-25T09:11:25.781852+0000","last_active":"2024-04-25T09:11:26.800436+0000","last_peered":"2024-04-25T09:11:26.800436+0000","last_clean":"2024-04-25T09:11:26.800436+0000","last_became_active":"2024-04-25T09:11:25.780781+0000","last_became_peered":"2024-04-25T09:11:25.780781+0000","last_unstale":"2024-04-25T09:11:26.800436+0000","last_undegraded":"2024-04-25T09:11:26.800436+0000","last_fullsized":"2024-04-25T09:11:26.800436+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:54.103134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.769052+0000","last_change":"2024-04-25T09:11:26.797827+0000","last_active":"2024-04-25T09:11:27.769052+0000","last_peered":"2024-04-25T09:11:27.769052+0000","last_clean":"2024-04-25T09:11:27.769052+0000","last_became_active":"2024-04-25T09:11:26.797548+0000","last_became_peered":"2024-04-25T09:11:26.797548+0000","last_unstale":"2024-04-25T09:11:27.769052+0000","last_undegraded":"2024-04-25T09:11:27.769052+0000","last_fullsized":"2024-04-25T09:11:27.769052+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:03.214507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"121'2","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.793939+0000","last_change":"2024-04-25T09:11:25.792534+0000","last_active":"2024-04-25T09:11:26.793939+0000","last_peered":"2024-04-25T09:11:26.793939+0000","last_clean":"2024-04-25T09:11:26.793939+0000","last_became_active":"2024-04-25T09:11:25.792008+0000","last_became_peered":"2024-04-25T09:11:25.792008+0000","last_unstale":"2024-04-25T09:11:26.793939+0000","last_undegraded":"2024-04-25T09:11:26.793939+0000","last_fullsized":"2024-04-25T09:11:26.793939+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:22.627378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767889+0000","last_change":"2024-04-25T09:11:26.772587+0000","last_active":"2024-04-25T09:11:27.767889+0000","last_peered":"2024-04-25T09:11:27.767889+0000","last_clean":"2024-04-25T09:11:27.767889+0000","last_became_active":"2024-04-25T09:11:26.772276+0000","last_became_peered":"2024-04-25T09:11:26.772276+0000","last_unstale":"2024-04-25T09:11:27.767889+0000","last_undegraded":"2024-04-25T09:11:27.767889+0000","last_fullsized":"2024-04-25T09:11:27.767889+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:32.004711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"121'1","reported_seq":13,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.796640+0000","last_change":"2024-04-25T09:11:25.789177+0000","last_active":"2024-04-25T09:11:26.796640+0000","last_peered":"2024-04-25T09:11:26.796640+0000","last_clean":"2024-04-25T09:11:26.796640+0000","last_became_active":"2024-04-25T09:11:25.788356+0000","last_became_peered":"2024-04-25T09:11:25.788356+0000","last_unstale":"2024-04-25T09:11:26.796640+0000","last_undegraded":"2024-04-25T09:11:26.796640+0000","last_fullsized":"2024-04-25T09:11:26.796640+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:06.193412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070694+0000","last_change":"2024-04-25T09:11:26.789879+0000","last_active":"2024-04-25T09:11:28.070694+0000","last_peered":"2024-04-25T09:11:28.070694+0000","last_clean":"2024-04-25T09:11:28.070694+0000","last_became_active":"2024-04-25T09:11:26.789518+0000","last_became_peered":"2024-04-25T09:11:26.789518+0000","last_unstale":"2024-04-25T09:11:28.070694+0000","last_undegraded":"2024-04-25T09:11:28.070694+0000","last_fullsized":"2024-04-25T09:11:28.070694+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:26.026358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.776625+0000","last_change":"2024-04-25T09:11:25.791795+0000","last_active":"2024-04-25T09:11:26.776625+0000","last_peered":"2024-04-25T09:11:26.776625+0000","last_clean":"2024-04-25T09:11:26.776625+0000","last_became_active":"2024-04-25T09:11:25.791461+0000","last_became_peered":"2024-04-25T09:11:25.791461+0000","last_unstale":"2024-04-25T09:11:26.776625+0000","last_undegraded":"2024-04-25T09:11:26.776625+0000","last_fullsized":"2024-04-25T09:11:26.776625+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:09.144966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767110+0000","last_change":"2024-04-25T09:11:26.772157+0000","last_active":"2024-04-25T09:11:27.767110+0000","last_peered":"2024-04-25T09:11:27.767110+0000","last_clean":"2024-04-25T09:11:27.767110+0000","last_became_active":"2024-04-25T09:11:26.771882+0000","last_became_peered":"2024-04-25T09:11:26.771882+0000","last_unstale":"2024-04-25T09:11:27.767110+0000","last_undegraded":"2024-04-25T09:11:27.767110+0000","last_fullsized":"2024-04-25T09:11:27.767110+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:07.458809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767135+0000","last_change":"2024-04-25T09:11:25.784911+0000","last_active":"2024-04-25T09:11:27.767135+0000","last_peered":"2024-04-25T09:11:27.767135+0000","last_clean":"2024-04-25T09:11:27.767135+0000","last_became_active":"2024-04-25T09:11:25.784461+0000","last_became_peered":"2024-04-25T09:11:25.784461+0000","last_unstale":"2024-04-25T09:11:27.767135+0000","last_undegraded":"2024-04-25T09:11:27.767135+0000","last_fullsized":"2024-04-25T09:11:27.767135+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:09.127425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.804573+0000","last_change":"2024-04-25T09:11:26.797782+0000","last_active":"2024-04-25T09:11:26.804573+0000","last_peered":"2024-04-25T09:11:26.804573+0000","last_clean":"2024-04-25T09:11:26.804573+0000","last_became_active":"2024-04-25T09:11:26.797497+0000","last_became_peered":"2024-04-25T09:11:26.797497+0000","last_unstale":"2024-04-25T09:11:26.804573+0000","last_undegraded":"2024-04-25T09:11:26.804573+0000","last_fullsized":"2024-04-25T09:11:26.804573+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:37.118986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.774149+0000","last_change":"2024-04-25T09:11:25.783997+0000","last_active":"2024-04-25T09:11:26.774149+0000","last_peered":"2024-04-25T09:11:26.774149+0000","last_clean":"2024-04-25T09:11:26.774149+0000","last_became_active":"2024-04-25T09:11:25.783674+0000","last_became_peered":"2024-04-25T09:11:25.783674+0000","last_unstale":"2024-04-25T09:11:26.774149+0000","last_undegraded":"2024-04-25T09:11:26.774149+0000","last_fullsized":"2024-04-25T09:11:26.774149+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:53.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.806219+0000","last_change":"2024-04-25T09:11:26.796627+0000","last_active":"2024-04-25T09:11:26.806219+0000","last_peered":"2024-04-25T09:11:26.806219+0000","last_clean":"2024-04-25T09:11:26.806219+0000","last_became_active":"2024-04-25T09:11:26.794570+0000","last_became_peered":"2024-04-25T09:11:26.794570+0000","last_unstale":"2024-04-25T09:11:26.806219+0000","last_undegraded":"2024-04-25T09:11:26.806219+0000","last_fullsized":"2024-04-25T09:11:26.806219+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:10.217192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.786231+0000","last_change":"2024-04-25T09:11:25.786373+0000","last_active":"2024-04-25T09:11:26.786231+0000","last_peered":"2024-04-25T09:11:26.786231+0000","last_clean":"2024-04-25T09:11:26.786231+0000","last_became_active":"2024-04-25T09:11:25.785938+0000","last_became_peered":"2024-04-25T09:11:25.785938+0000","last_unstale":"2024-04-25T09:11:26.786231+0000","last_undegraded":"2024-04-25T09:11:26.786231+0000","last_fullsized":"2024-04-25T09:11:26.786231+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:06.193412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070321+0000","last_change":"2024-04-25T09:11:26.794889+0000","last_active":"2024-04-25T09:11:28.070321+0000","last_peered":"2024-04-25T09:11:28.070321+0000","last_clean":"2024-04-25T09:11:28.070321+0000","last_became_active":"2024-04-25T09:11:26.794248+0000","last_became_peered":"2024-04-25T09:11:26.794248+0000","last_unstale":"2024-04-25T09:11:28.070321+0000","last_undegraded":"2024-04-25T09:11:28.070321+0000","last_fullsized":"2024-04-25T09:11:28.070321+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:48.355880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.773587+0000","last_change":"2024-04-25T09:11:25.786145+0000","last_active":"2024-04-25T09:11:26.773587+0000","last_peered":"2024-04-25T09:11:26.773587+0000","last_clean":"2024-04-25T09:11:26.773587+0000","last_became_active":"2024-04-25T09:11:25.785877+0000","last_became_peered":"2024-04-25T09:11:25.785877+0000","last_unstale":"2024-04-25T09:11:26.773587+0000","last_undegraded":"2024-04-25T09:11:26.773587+0000","last_fullsized":"2024-04-25T09:11:26.773587+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:46.425507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767784+0000","last_change":"2024-04-25T09:11:26.790428+0000","last_active":"2024-04-25T09:11:27.767784+0000","last_peered":"2024-04-25T09:11:27.767784+0000","last_clean":"2024-04-25T09:11:27.767784+0000","last_became_active":"2024-04-25T09:11:26.789545+0000","last_became_peered":"2024-04-25T09:11:26.789545+0000","last_unstale":"2024-04-25T09:11:27.767784+0000","last_undegraded":"2024-04-25T09:11:27.767784+0000","last_fullsized":"2024-04-25T09:11:27.767784+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:48.073136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767867+0000","last_change":"2024-04-25T09:11:25.784967+0000","last_active":"2024-04-25T09:11:27.767867+0000","last_peered":"2024-04-25T09:11:27.767867+0000","last_clean":"2024-04-25T09:11:27.767867+0000","last_became_active":"2024-04-25T09:11:25.784702+0000","last_became_peered":"2024-04-25T09:11:25.784702+0000","last_unstale":"2024-04-25T09:11:27.767867+0000","last_undegraded":"2024-04-25T09:11:27.767867+0000","last_fullsized":"2024-04-25T09:11:27.767867+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:47.656385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.795819+0000","last_change":"2024-04-25T09:11:26.792914+0000","last_active":"2024-04-25T09:11:26.795819+0000","last_peered":"2024-04-25T09:11:26.795819+0000","last_clean":"2024-04-25T09:11:26.795819+0000","last_became_active":"2024-04-25T09:11:26.792600+0000","last_became_peered":"2024-04-25T09:11:26.792600+0000","last_unstale":"2024-04-25T09:11:26.795819+0000","last_undegraded":"2024-04-25T09:11:26.795819+0000","last_fullsized":"2024-04-25T09:11:26.795819+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:42.179442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"122'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.772977+0000","last_change":"2024-04-25T09:11:25.785623+0000","last_active":"2024-04-25T09:11:28.772977+0000","last_peered":"2024-04-25T09:11:28.772977+0000","last_clean":"2024-04-25T09:11:28.772977+0000","last_became_active":"2024-04-25T09:11:25.785338+0000","last_became_peered":"2024-04-25T09:11:25.785338+0000","last_unstale":"2024-04-25T09:11:28.772977+0000","last_undegraded":"2024-04-25T09:11:28.772977+0000","last_fullsized":"2024-04-25T09:11:28.772977+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:10.566665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.791979+0000","last_change":"2024-04-25T09:11:26.786960+0000","last_active":"2024-04-25T09:11:26.791979+0000","last_peered":"2024-04-25T09:11:26.791979+0000","last_clean":"2024-04-25T09:11:26.791979+0000","last_became_active":"2024-04-25T09:11:26.785791+0000","last_became_peered":"2024-04-25T09:11:26.785791+0000","last_unstale":"2024-04-25T09:11:26.791979+0000","last_undegraded":"2024-04-25T09:11:26.791979+0000","last_fullsized":"2024-04-25T09:11:26.791979+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:04.305239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768313+0000","last_change":"2024-04-25T09:11:25.786163+0000","last_active":"2024-04-25T09:11:27.768313+0000","last_peered":"2024-04-25T09:11:27.768313+0000","last_clean":"2024-04-25T09:11:27.768313+0000","last_became_active":"2024-04-25T09:11:25.785903+0000","last_became_peered":"2024-04-25T09:11:25.785903+0000","last_unstale":"2024-04-25T09:11:27.768313+0000","last_undegraded":"2024-04-25T09:11:27.768313+0000","last_fullsized":"2024-04-25T09:11:27.768313+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:07.009279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.793418+0000","last_change":"2024-04-25T09:11:26.790380+0000","last_active":"2024-04-25T09:11:26.793418+0000","last_peered":"2024-04-25T09:11:26.793418+0000","last_clean":"2024-04-25T09:11:26.793418+0000","last_became_active":"2024-04-25T09:11:26.790013+0000","last_became_peered":"2024-04-25T09:11:26.790013+0000","last_unstale":"2024-04-25T09:11:26.793418+0000","last_undegraded":"2024-04-25T09:11:26.793418+0000","last_fullsized":"2024-04-25T09:11:26.793418+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:49.531791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767898+0000","last_change":"2024-04-25T09:11:25.785188+0000","last_active":"2024-04-25T09:11:27.767898+0000","last_peered":"2024-04-25T09:11:27.767898+0000","last_clean":"2024-04-25T09:11:27.767898+0000","last_became_active":"2024-04-25T09:11:25.779978+0000","last_became_peered":"2024-04-25T09:11:25.779978+0000","last_unstale":"2024-04-25T09:11:27.767898+0000","last_undegraded":"2024-04-25T09:11:27.767898+0000","last_fullsized":"2024-04-25T09:11:27.767898+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:38.992725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767281+0000","last_change":"2024-04-25T09:11:26.771533+0000","last_active":"2024-04-25T09:11:27.767281+0000","last_peered":"2024-04-25T09:11:27.767281+0000","last_clean":"2024-04-25T09:11:27.767281+0000","last_became_active":"2024-04-25T09:11:26.771206+0000","last_became_peered":"2024-04-25T09:11:26.771206+0000","last_unstale":"2024-04-25T09:11:27.767281+0000","last_undegraded":"2024-04-25T09:11:27.767281+0000","last_fullsized":"2024-04-25T09:11:27.767281+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:16.193785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768858+0000","last_change":"2024-04-25T09:11:25.786217+0000","last_active":"2024-04-25T09:11:27.768858+0000","last_peered":"2024-04-25T09:11:27.768858+0000","last_clean":"2024-04-25T09:11:27.768858+0000","last_became_active":"2024-04-25T09:11:25.785945+0000","last_became_peered":"2024-04-25T09:11:25.785945+0000","last_unstale":"2024-04-25T09:11:27.768858+0000","last_undegraded":"2024-04-25T09:11:27.768858+0000","last_fullsized":"2024-04-25T09:11:27.768858+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:36.050959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.804552+0000","last_change":"2024-04-25T09:11:26.786763+0000","last_active":"2024-04-25T09:11:26.804552+0000","last_peered":"2024-04-25T09:11:26.804552+0000","last_clean":"2024-04-25T09:11:26.804552+0000","last_became_active":"2024-04-25T09:11:26.786447+0000","last_became_peered":"2024-04-25T09:11:26.786447+0000","last_unstale":"2024-04-25T09:11:26.804552+0000","last_undegraded":"2024-04-25T09:11:26.804552+0000","last_fullsized":"2024-04-25T09:11:26.804552+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:55.473718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768686+0000","last_change":"2024-04-25T09:11:25.789039+0000","last_active":"2024-04-25T09:11:27.768686+0000","last_peered":"2024-04-25T09:11:27.768686+0000","last_clean":"2024-04-25T09:11:27.768686+0000","last_became_active":"2024-04-25T09:11:25.788749+0000","last_became_peered":"2024-04-25T09:11:25.788749+0000","last_unstale":"2024-04-25T09:11:27.768686+0000","last_undegraded":"2024-04-25T09:11:27.768686+0000","last_fullsized":"2024-04-25T09:11:27.768686+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:24.290504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.788832+0000","last_change":"2024-04-25T09:11:26.781923+0000","last_active":"2024-04-25T09:11:26.788832+0000","last_peered":"2024-04-25T09:11:26.788832+0000","last_clean":"2024-04-25T09:11:26.788832+0000","last_became_active":"2024-04-25T09:11:26.780479+0000","last_became_peered":"2024-04-25T09:11:26.780479+0000","last_unstale":"2024-04-25T09:11:26.788832+0000","last_undegraded":"2024-04-25T09:11:26.788832+0000","last_fullsized":"2024-04-25T09:11:26.788832+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:55.473718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767233+0000","last_change":"2024-04-25T09:11:25.781405+0000","last_active":"2024-04-25T09:11:27.767233+0000","last_peered":"2024-04-25T09:11:27.767233+0000","last_clean":"2024-04-25T09:11:27.767233+0000","last_became_active":"2024-04-25T09:11:25.781100+0000","last_became_peered":"2024-04-25T09:11:25.781100+0000","last_unstale":"2024-04-25T09:11:27.767233+0000","last_undegraded":"2024-04-25T09:11:27.767233+0000","last_fullsized":"2024-04-25T09:11:27.767233+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:10.988280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.800732+0000","last_change":"2024-04-25T09:11:26.798742+0000","last_active":"2024-04-25T09:11:26.800732+0000","last_peered":"2024-04-25T09:11:26.800732+0000","last_clean":"2024-04-25T09:11:26.800732+0000","last_became_active":"2024-04-25T09:11:26.798468+0000","last_became_peered":"2024-04-25T09:11:26.798468+0000","last_unstale":"2024-04-25T09:11:26.800732+0000","last_undegraded":"2024-04-25T09:11:26.800732+0000","last_fullsized":"2024-04-25T09:11:26.800732+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:10.151989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.773757+0000","last_change":"2024-04-25T09:11:25.780949+0000","last_active":"2024-04-25T09:11:26.773757+0000","last_peered":"2024-04-25T09:11:26.773757+0000","last_clean":"2024-04-25T09:11:26.773757+0000","last_became_active":"2024-04-25T09:11:25.780664+0000","last_became_peered":"2024-04-25T09:11:25.780664+0000","last_unstale":"2024-04-25T09:11:26.773757+0000","last_undegraded":"2024-04-25T09:11:26.773757+0000","last_fullsized":"2024-04-25T09:11:26.773757+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:52.742093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.795608+0000","last_change":"2024-04-25T09:11:26.793502+0000","last_active":"2024-04-25T09:11:26.795608+0000","last_peered":"2024-04-25T09:11:26.795608+0000","last_clean":"2024-04-25T09:11:26.795608+0000","last_became_active":"2024-04-25T09:11:26.792794+0000","last_became_peered":"2024-04-25T09:11:26.792794+0000","last_unstale":"2024-04-25T09:11:26.795608+0000","last_undegraded":"2024-04-25T09:11:26.795608+0000","last_fullsized":"2024-04-25T09:11:26.795608+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:40.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"121'8","reported_seq":20,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.809444+0000","last_change":"2024-04-25T09:11:25.787740+0000","last_active":"2024-04-25T09:11:26.809444+0000","last_peered":"2024-04-25T09:11:26.809444+0000","last_clean":"2024-04-25T09:11:26.809444+0000","last_became_active":"2024-04-25T09:11:25.786106+0000","last_became_peered":"2024-04-25T09:11:25.786106+0000","last_unstale":"2024-04-25T09:11:26.809444+0000","last_undegraded":"2024-04-25T09:11:26.809444+0000","last_fullsized":"2024-04-25T09:11:26.809444+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:53.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":354,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:26.773820+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:11:26.773820+0000","last_peered":"2024-04-25T09:11:26.773820+0000","last_clean":"2024-04-25T09:11:26.773820+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:11:26.773820+0000","last_undegraded":"2024-04-25T09:11:26.773820+0000","last_fullsized":"2024-04-25T09:11:26.773820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509549,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50708,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321132,"statfs":{"total":96636764160,"available":96584839168,"internally_reserved":0,"allocated":1515520,"data_stored":703826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509549,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50712,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321128,"statfs":{"total":96636764160,"available":96584835072,"internally_reserved":0,"allocated":1519616,"data_stored":703404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509550,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59040,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312800,"statfs":{"total":96636764160,"available":96576307200,"internally_reserved":0,"allocated":1523712,"data_stored":704856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509549,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54868,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316972,"statfs":{"total":96636764160,"available":96580579328,"internally_reserved":0,"allocated":1515520,"data_stored":698198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509549,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54856,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316984,"statfs":{"total":96636764160,"available":96580591616,"internally_reserved":0,"allocated":1499136,"data_stored":696552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509550,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50704,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321136,"statfs":{"total":96636764160,"available":96584843264,"internally_reserved":0,"allocated":1503232,"data_stored":696574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509550,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55448,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316392,"statfs":{"total":96636764160,"available":96579985408,"internally_reserved":0,"allocated":2109440,"data_stored":1293634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574957,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51268,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320572,"statfs":{"total":96636764160,"available":96584265728,"internally_reserved":0,"allocated":2080768,"data_stored":1279753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:11:35.346 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:11:35.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.506+0000 7f27e5400640 1 Processor -- start 2024-04-25T09:11:35.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.506+0000 7f27e5400640 1 -- start start 2024-04-25T09:11:35.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.506+0000 7f27e5400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27e015a180 0x7f27e00b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:35.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.506+0000 7f27e5400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e006e860 con 0x7f27e00b2ca0 2024-04-25T09:11:35.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.506+0000 7f27e5400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e006eb20 con 0x7f27e0071a30 2024-04-25T09:11:35.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.506+0000 7f27e5400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00af230 con 0x7f27e015a180 2024-04-25T09:11:35.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.506+0000 7f27d5e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f27e00b2ca0 0x7f27e0071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54558/0 (socket says 172.21.15.173:54558) 2024-04-25T09:11:35.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.506+0000 7f27d5e00640 1 -- 172.21.15.173:0/2095394472 learned_addr learned my addr 172.21.15.173:0/2095394472 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:35.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.506+0000 7f27de800640 1 --2- 172.21.15.173:0/2095394472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27e015a180 0x7f27e00b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:35.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.510+0000 7f27dde00640 1 -- 172.21.15.173:0/2095394472 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043939186 0 0) 0x7f27e006e860 con 0x7f27e00b2ca0 2024-04-25T09:11:35.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.510+0000 7f27dde00640 1 -- 172.21.15.173:0/2095394472 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27c4003530 con 0x7f27e00b2ca0 2024-04-25T09:11:35.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.510+0000 7f27de800640 1 -- 172.21.15.173:0/2095394472 >> v1:172.21.15.194:6789/0 conn(0x7f27e0071a30 legacy=0x7f27e006d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:35.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.510+0000 7f27dde00640 1 -- 172.21.15.173:0/2095394472 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2646980145 0 0) 0x7f27c4003530 con 0x7f27e00b2ca0 2024-04-25T09:11:35.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.510+0000 7f27de800640 1 -- 172.21.15.173:0/2095394472 >> v1:172.21.15.173:6789/0 conn(0x7f27e00b2ca0 legacy=0x7f27e0071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:35.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.510+0000 7f27de800640 1 -- 172.21.15.173:0/2095394472 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e00aebe0 con 0x7f27e015a180 2024-04-25T09:11:35.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.510+0000 7f27de800640 1 --2- 172.21.15.173:0/2095394472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27e015a180 0x7f27e00b40e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f27c80097f0 tx=0x7f27c801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ecf74415076e9c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:35.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.510+0000 7f27dde00640 1 -- 172.21.15.173:0/2095394472 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80b0070 con 0x7f27e015a180 2024-04-25T09:11:35.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.510+0000 7f27dde00640 1 -- 172.21.15.173:0/2095394472 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c80ab400 con 0x7f27e015a180 2024-04-25T09:11:35.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.510+0000 7f27dde00640 1 -- 172.21.15.173:0/2095394472 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0001680 con 0x7f27e015a180 2024-04-25T09:11:35.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27e5400640 1 -- 172.21.15.173:0/2095394472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27e015a180 msgr2=0x7f27e00b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:35.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27e5400640 1 --2- 172.21.15.173:0/2095394472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27e015a180 0x7f27e00b40e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f27c80097f0 tx=0x7f27c801c400 comp rx=0 tx=0).stop 2024-04-25T09:11:35.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27e5400640 1 -- 172.21.15.173:0/2095394472 shutdown_connections 2024-04-25T09:11:35.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27e5400640 1 --2- 172.21.15.173:0/2095394472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27e015a180 0x7f27e00b40e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:35.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27e5400640 1 -- 172.21.15.173:0/2095394472 >> 172.21.15.173:0/2095394472 conn(0x7f27e006ac90 msgr2=0x7f27e006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:35.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27e5400640 1 -- 172.21.15.173:0/2095394472 shutdown_connections 2024-04-25T09:11:35.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27e5400640 1 -- 172.21.15.173:0/2095394472 wait complete. 2024-04-25T09:11:35.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27e5400640 1 Processor -- start 2024-04-25T09:11:35.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27e5400640 1 -- start start 2024-04-25T09:11:35.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27e5400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27e0071a30 0x7f27e00ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:35.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27e5400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27e00b2ca0 0x7f27e01655e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:35.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27e5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27e015a180 0x7f27e015b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:35.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27e5400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00cfaf0 con 0x7f27e00b2ca0 2024-04-25T09:11:35.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27e5400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00cf970 con 0x7f27e015a180 2024-04-25T09:11:35.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27e5400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00cfc70 con 0x7f27e0071a30 2024-04-25T09:11:35.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27d5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27e00b2ca0 0x7f27e01655e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:35.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27d5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27e00b2ca0 0x7f27e01655e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60290/0 (socket says 172.21.15.173:60290) 2024-04-25T09:11:35.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27d5e00640 1 -- 172.21.15.173:0/3404187451 learned_addr learned my addr 172.21.15.173:0/3404187451 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:35.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27de800640 1 --2- 172.21.15.173:0/3404187451 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27e0071a30 0x7f27e00ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:35.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27df200640 1 --2- 172.21.15.173:0/3404187451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27e015a180 0x7f27e015b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:35.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27d5e00640 1 -- 172.21.15.173:0/3404187451 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27e0071a30 msgr2=0x7f27e00ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:35.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27d5e00640 1 --2- 172.21.15.173:0/3404187451 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27e0071a30 0x7f27e00ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:35.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27d5e00640 1 -- 172.21.15.173:0/3404187451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27e015a180 msgr2=0x7f27e015b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:35.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27d5e00640 1 --2- 172.21.15.173:0/3404187451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27e015a180 0x7f27e015b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:35.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27d5e00640 1 -- 172.21.15.173:0/3404187451 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e013fc80 con 0x7f27e00b2ca0 2024-04-25T09:11:35.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.514+0000 7f27df200640 1 --2- 172.21.15.173:0/3404187451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27e015a180 0x7f27e015b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:35.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.518+0000 7f27d5e00640 1 --2- 172.21.15.173:0/3404187451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27e00b2ca0 0x7f27e01655e0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f27d000c520 tx=0x7f27d000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:35.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.518+0000 7f27d7400640 1 -- 172.21.15.173:0/3404187451 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0017070 con 0x7f27e00b2ca0 2024-04-25T09:11:35.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.518+0000 7f27d7400640 1 -- 172.21.15.173:0/3404187451 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d0005d10 con 0x7f27e00b2ca0 2024-04-25T09:11:35.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.518+0000 7f27d7400640 1 -- 172.21.15.173:0/3404187451 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d00072b0 con 0x7f27e00b2ca0 2024-04-25T09:11:35.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.518+0000 7f27e5400640 1 -- 172.21.15.173:0/3404187451 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e00ad8b0 con 0x7f27e00b2ca0 2024-04-25T09:11:35.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.518+0000 7f27e5400640 1 -- 172.21.15.173:0/3404187451 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e00ade70 con 0x7f27e00b2ca0 2024-04-25T09:11:35.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.518+0000 7f27e5400640 1 -- 172.21.15.173:0/3404187451 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e0073a40 con 0x7f27e00b2ca0 2024-04-25T09:11:35.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.518+0000 7f27d7400640 1 -- 172.21.15.173:0/3404187451 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f27d001a070 con 0x7f27e00b2ca0 2024-04-25T09:11:35.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.518+0000 7f27d7400640 1 --2- 172.21.15.173:0/3404187451 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f27bc066f60 0x7f27bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:35.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.518+0000 7f27d7400640 1 -- 172.21.15.173:0/3404187451 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f27d00845a0 con 0x7f27e00b2ca0 2024-04-25T09:11:35.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.518+0000 7f27de800640 1 --2- 172.21.15.173:0/3404187451 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f27bc066f60 0x7f27bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:35.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.522+0000 7f27de800640 1 --2- 172.21.15.173:0/3404187451 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f27bc066f60 0x7f27bc069420 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f27c80ad000 tx=0x7f27c80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:35.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.522+0000 7f27d7400640 1 -- 172.21.15.173:0/3404187451 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f27d0054dc0 con 0x7f27e00b2ca0 2024-04-25T09:11:35.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.674+0000 7f27e5400640 1 -- 172.21.15.173:0/3404187451 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27e006e640 con 0x7f27bc066f60 2024-04-25T09:11:35.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.678+0000 7f27d7400640 1 -- 172.21.15.173:0/3404187451 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252400 (secure 0 0 0) 0x7f27e006e640 con 0x7f27bc066f60 2024-04-25T09:11:35.668 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:35.669 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:11:35.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.682+0000 7f27e5400640 1 -- 172.21.15.173:0/3404187451 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f27bc066f60 msgr2=0x7f27bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:35.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.682+0000 7f27e5400640 1 --2- 172.21.15.173:0/3404187451 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f27bc066f60 0x7f27bc069420 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f27c80ad000 tx=0x7f27c80a6000 comp rx=0 tx=0).stop 2024-04-25T09:11:35.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.682+0000 7f27e5400640 1 -- 172.21.15.173:0/3404187451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27e00b2ca0 msgr2=0x7f27e01655e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:35.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.682+0000 7f27e5400640 1 --2- 172.21.15.173:0/3404187451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27e00b2ca0 0x7f27e01655e0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f27d000c520 tx=0x7f27d000c9e0 comp rx=0 tx=0).stop 2024-04-25T09:11:35.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.682+0000 7f27e5400640 1 -- 172.21.15.173:0/3404187451 shutdown_connections 2024-04-25T09:11:35.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.682+0000 7f27e5400640 1 --2- 172.21.15.173:0/3404187451 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f27bc066f60 0x7f27bc069420 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:35.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.682+0000 7f27e5400640 1 --2- 172.21.15.173:0/3404187451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27e015a180 0x7f27e015b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:35.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.682+0000 7f27e5400640 1 --2- 172.21.15.173:0/3404187451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27e00b2ca0 0x7f27e01655e0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:35.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.682+0000 7f27e5400640 1 --2- 172.21.15.173:0/3404187451 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27e0071a30 0x7f27e00ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:35.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.682+0000 7f27e5400640 1 -- 172.21.15.173:0/3404187451 >> 172.21.15.173:0/3404187451 conn(0x7f27e006ac90 msgr2=0x7f27e0071320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:35.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.682+0000 7f27e5400640 1 -- 172.21.15.173:0/3404187451 shutdown_connections 2024-04-25T09:11:35.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.682+0000 7f27e5400640 1 -- 172.21.15.173:0/3404187451 wait complete. 2024-04-25T09:11:35.688 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2024-04-25T09:11:34.842849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":427664,"kb_used_data":13032,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754547056,"statfs":{"total":773094113280,"available":772656185344,"internally_reserved":0,"allocated":13344768,"data_stored":6811508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":424463920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.078344"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768987+0000","last_change":"2024-04-25T09:11:26.787243+0000","last_active":"2024-04-25T09:11:27.768987+0000","last_peered":"2024-04-25T09:11:27.768987+0000","last_clean":"2024-04-25T09:11:27.768987+0000","last_became_active":"2024-04-25T09:11:26.786975+0000","last_became_peered":"2024-04-25T09:11:26.786975+0000","last_unstale":"2024-04-25T09:11:27.768987+0000","last_undegraded":"2024-04-25T09:11:27.768987+0000","last_fullsized":"2024-04-25T09:11:27.768987+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:30.819327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172138+0000","last_change":"2024-04-25T09:11:26.806403+0000","last_active":"2024-04-25T09:11:29.172138+0000","last_peered":"2024-04-25T09:11:29.172138+0000","last_clean":"2024-04-25T09:11:29.172138+0000","last_became_active":"2024-04-25T09:11:26.804718+0000","last_became_peered":"2024-04-25T09:11:26.804718+0000","last_unstale":"2024-04-25T09:11:29.172138+0000","last_undegraded":"2024-04-25T09:11:29.172138+0000","last_fullsized":"2024-04-25T09:11:29.172138+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:41.522086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172343+0000","last_change":"2024-04-25T09:11:26.794706+0000","last_active":"2024-04-25T09:11:29.172343+0000","last_peered":"2024-04-25T09:11:29.172343+0000","last_clean":"2024-04-25T09:11:29.172343+0000","last_became_active":"2024-04-25T09:11:26.794366+0000","last_became_peered":"2024-04-25T09:11:26.794366+0000","last_unstale":"2024-04-25T09:11:29.172343+0000","last_undegraded":"2024-04-25T09:11:29.172343+0000","last_fullsized":"2024-04-25T09:11:29.172343+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:48.145142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.038853+0000","last_change":"2024-04-25T09:11:26.784135+0000","last_active":"2024-04-25T09:11:28.038853+0000","last_peered":"2024-04-25T09:11:28.038853+0000","last_clean":"2024-04-25T09:11:28.038853+0000","last_became_active":"2024-04-25T09:11:26.783850+0000","last_became_peered":"2024-04-25T09:11:26.783850+0000","last_unstale":"2024-04-25T09:11:28.038853+0000","last_undegraded":"2024-04-25T09:11:28.038853+0000","last_fullsized":"2024-04-25T09:11:28.038853+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:09.911379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768372+0000","last_change":"2024-04-25T09:11:26.771408+0000","last_active":"2024-04-25T09:11:27.768372+0000","last_peered":"2024-04-25T09:11:27.768372+0000","last_clean":"2024-04-25T09:11:27.768372+0000","last_became_active":"2024-04-25T09:11:26.771106+0000","last_became_peered":"2024-04-25T09:11:26.771106+0000","last_unstale":"2024-04-25T09:11:27.768372+0000","last_undegraded":"2024-04-25T09:11:27.768372+0000","last_fullsized":"2024-04-25T09:11:27.768372+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:20.917299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767559+0000","last_change":"2024-04-25T09:11:26.797018+0000","last_active":"2024-04-25T09:11:27.767559+0000","last_peered":"2024-04-25T09:11:27.767559+0000","last_clean":"2024-04-25T09:11:27.767559+0000","last_became_active":"2024-04-25T09:11:26.796767+0000","last_became_peered":"2024-04-25T09:11:26.796767+0000","last_unstale":"2024-04-25T09:11:27.767559+0000","last_undegraded":"2024-04-25T09:11:27.767559+0000","last_fullsized":"2024-04-25T09:11:27.767559+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:03.914384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767133+0000","last_change":"2024-04-25T09:11:26.778696+0000","last_active":"2024-04-25T09:11:27.767133+0000","last_peered":"2024-04-25T09:11:27.767133+0000","last_clean":"2024-04-25T09:11:27.767133+0000","last_became_active":"2024-04-25T09:11:26.778367+0000","last_became_peered":"2024-04-25T09:11:26.778367+0000","last_unstale":"2024-04-25T09:11:27.767133+0000","last_undegraded":"2024-04-25T09:11:27.767133+0000","last_fullsized":"2024-04-25T09:11:27.767133+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:36.182448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.171648+0000","last_change":"2024-04-25T09:11:26.794235+0000","last_active":"2024-04-25T09:11:29.171648+0000","last_peered":"2024-04-25T09:11:29.171648+0000","last_clean":"2024-04-25T09:11:29.171648+0000","last_became_active":"2024-04-25T09:11:26.793919+0000","last_became_peered":"2024-04-25T09:11:26.793919+0000","last_unstale":"2024-04-25T09:11:29.171648+0000","last_undegraded":"2024-04-25T09:11:29.171648+0000","last_fullsized":"2024-04-25T09:11:29.171648+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:55.857772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.039013+0000","last_change":"2024-04-25T09:11:26.805079+0000","last_active":"2024-04-25T09:11:28.039013+0000","last_peered":"2024-04-25T09:11:28.039013+0000","last_clean":"2024-04-25T09:11:28.039013+0000","last_became_active":"2024-04-25T09:11:26.804718+0000","last_became_peered":"2024-04-25T09:11:26.804718+0000","last_unstale":"2024-04-25T09:11:28.039013+0000","last_undegraded":"2024-04-25T09:11:28.039013+0000","last_fullsized":"2024-04-25T09:11:28.039013+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:41.522086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.171813+0000","last_change":"2024-04-25T09:11:26.786628+0000","last_active":"2024-04-25T09:11:29.171813+0000","last_peered":"2024-04-25T09:11:29.171813+0000","last_clean":"2024-04-25T09:11:29.171813+0000","last_became_active":"2024-04-25T09:11:26.786348+0000","last_became_peered":"2024-04-25T09:11:26.786348+0000","last_unstale":"2024-04-25T09:11:29.171813+0000","last_undegraded":"2024-04-25T09:11:29.171813+0000","last_fullsized":"2024-04-25T09:11:29.171813+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:34.583446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.769033+0000","last_change":"2024-04-25T09:11:26.783292+0000","last_active":"2024-04-25T09:11:27.769033+0000","last_peered":"2024-04-25T09:11:27.769033+0000","last_clean":"2024-04-25T09:11:27.769033+0000","last_became_active":"2024-04-25T09:11:26.783017+0000","last_became_peered":"2024-04-25T09:11:26.783017+0000","last_unstale":"2024-04-25T09:11:27.769033+0000","last_undegraded":"2024-04-25T09:11:27.769033+0000","last_fullsized":"2024-04-25T09:11:27.769033+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:44.158295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767635+0000","last_change":"2024-04-25T09:11:26.772025+0000","last_active":"2024-04-25T09:11:27.767635+0000","last_peered":"2024-04-25T09:11:27.767635+0000","last_clean":"2024-04-25T09:11:27.767635+0000","last_became_active":"2024-04-25T09:11:26.771747+0000","last_became_peered":"2024-04-25T09:11:26.771747+0000","last_unstale":"2024-04-25T09:11:27.767635+0000","last_undegraded":"2024-04-25T09:11:27.767635+0000","last_fullsized":"2024-04-25T09:11:27.767635+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:01.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.171534+0000","last_change":"2024-04-25T09:11:26.787942+0000","last_active":"2024-04-25T09:11:29.171534+0000","last_peered":"2024-04-25T09:11:29.171534+0000","last_clean":"2024-04-25T09:11:29.171534+0000","last_became_active":"2024-04-25T09:11:26.787585+0000","last_became_peered":"2024-04-25T09:11:26.787585+0000","last_unstale":"2024-04-25T09:11:29.171534+0000","last_undegraded":"2024-04-25T09:11:29.171534+0000","last_fullsized":"2024-04-25T09:11:29.171534+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:31.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172103+0000","last_change":"2024-04-25T09:11:26.801981+0000","last_active":"2024-04-25T09:11:29.172103+0000","last_peered":"2024-04-25T09:11:29.172103+0000","last_clean":"2024-04-25T09:11:29.172103+0000","last_became_active":"2024-04-25T09:11:26.794868+0000","last_became_peered":"2024-04-25T09:11:26.794868+0000","last_unstale":"2024-04-25T09:11:29.172103+0000","last_undegraded":"2024-04-25T09:11:29.172103+0000","last_fullsized":"2024-04-25T09:11:29.172103+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:33.951077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767548+0000","last_change":"2024-04-25T09:11:26.782835+0000","last_active":"2024-04-25T09:11:27.767548+0000","last_peered":"2024-04-25T09:11:27.767548+0000","last_clean":"2024-04-25T09:11:27.767548+0000","last_became_active":"2024-04-25T09:11:26.782340+0000","last_became_peered":"2024-04-25T09:11:26.782340+0000","last_unstale":"2024-04-25T09:11:27.767548+0000","last_undegraded":"2024-04-25T09:11:27.767548+0000","last_fullsized":"2024-04-25T09:11:27.767548+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:18.339218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767110+0000","last_change":"2024-04-25T09:11:26.795334+0000","last_active":"2024-04-25T09:11:27.767110+0000","last_peered":"2024-04-25T09:11:27.767110+0000","last_clean":"2024-04-25T09:11:27.767110+0000","last_became_active":"2024-04-25T09:11:26.794720+0000","last_became_peered":"2024-04-25T09:11:26.794720+0000","last_unstale":"2024-04-25T09:11:27.767110+0000","last_undegraded":"2024-04-25T09:11:27.767110+0000","last_fullsized":"2024-04-25T09:11:27.767110+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:17.010143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172675+0000","last_change":"2024-04-25T09:11:26.788198+0000","last_active":"2024-04-25T09:11:29.172675+0000","last_peered":"2024-04-25T09:11:29.172675+0000","last_clean":"2024-04-25T09:11:29.172675+0000","last_became_active":"2024-04-25T09:11:26.787463+0000","last_became_peered":"2024-04-25T09:11:26.787463+0000","last_unstale":"2024-04-25T09:11:29.172675+0000","last_undegraded":"2024-04-25T09:11:29.172675+0000","last_fullsized":"2024-04-25T09:11:29.172675+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:47.427978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172343+0000","last_change":"2024-04-25T09:11:26.804889+0000","last_active":"2024-04-25T09:11:29.172343+0000","last_peered":"2024-04-25T09:11:29.172343+0000","last_clean":"2024-04-25T09:11:29.172343+0000","last_became_active":"2024-04-25T09:11:26.804397+0000","last_became_peered":"2024-04-25T09:11:26.804397+0000","last_unstale":"2024-04-25T09:11:29.172343+0000","last_undegraded":"2024-04-25T09:11:29.172343+0000","last_fullsized":"2024-04-25T09:11:29.172343+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:10.129896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768173+0000","last_change":"2024-04-25T09:11:26.782877+0000","last_active":"2024-04-25T09:11:27.768173+0000","last_peered":"2024-04-25T09:11:27.768173+0000","last_clean":"2024-04-25T09:11:27.768173+0000","last_became_active":"2024-04-25T09:11:26.782538+0000","last_became_peered":"2024-04-25T09:11:26.782538+0000","last_unstale":"2024-04-25T09:11:27.768173+0000","last_undegraded":"2024-04-25T09:11:27.768173+0000","last_fullsized":"2024-04-25T09:11:27.768173+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:02.178137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172809+0000","last_change":"2024-04-25T09:11:26.791381+0000","last_active":"2024-04-25T09:11:29.172809+0000","last_peered":"2024-04-25T09:11:29.172809+0000","last_clean":"2024-04-25T09:11:29.172809+0000","last_became_active":"2024-04-25T09:11:26.789379+0000","last_became_peered":"2024-04-25T09:11:26.789379+0000","last_unstale":"2024-04-25T09:11:29.172809+0000","last_undegraded":"2024-04-25T09:11:29.172809+0000","last_fullsized":"2024-04-25T09:11:29.172809+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:51.592200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.039022+0000","last_change":"2024-04-25T09:11:26.793939+0000","last_active":"2024-04-25T09:11:28.039022+0000","last_peered":"2024-04-25T09:11:28.039022+0000","last_clean":"2024-04-25T09:11:28.039022+0000","last_became_active":"2024-04-25T09:11:26.792032+0000","last_became_peered":"2024-04-25T09:11:26.792032+0000","last_unstale":"2024-04-25T09:11:28.039022+0000","last_undegraded":"2024-04-25T09:11:28.039022+0000","last_fullsized":"2024-04-25T09:11:28.039022+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:50.117338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.769149+0000","last_change":"2024-04-25T09:11:26.798320+0000","last_active":"2024-04-25T09:11:27.769149+0000","last_peered":"2024-04-25T09:11:27.769149+0000","last_clean":"2024-04-25T09:11:27.769149+0000","last_became_active":"2024-04-25T09:11:26.797870+0000","last_became_peered":"2024-04-25T09:11:26.797870+0000","last_unstale":"2024-04-25T09:11:27.769149+0000","last_undegraded":"2024-04-25T09:11:27.769149+0000","last_fullsized":"2024-04-25T09:11:27.769149+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:48.355880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.038584+0000","last_change":"2024-04-25T09:11:26.801768+0000","last_active":"2024-04-25T09:11:28.038584+0000","last_peered":"2024-04-25T09:11:28.038584+0000","last_clean":"2024-04-25T09:11:28.038584+0000","last_became_active":"2024-04-25T09:11:26.801480+0000","last_became_peered":"2024-04-25T09:11:26.801480+0000","last_unstale":"2024-04-25T09:11:28.038584+0000","last_undegraded":"2024-04-25T09:11:28.038584+0000","last_fullsized":"2024-04-25T09:11:28.038584+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:11.458429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070205+0000","last_change":"2024-04-25T09:11:26.790623+0000","last_active":"2024-04-25T09:11:28.070205+0000","last_peered":"2024-04-25T09:11:28.070205+0000","last_clean":"2024-04-25T09:11:28.070205+0000","last_became_active":"2024-04-25T09:11:26.790108+0000","last_became_peered":"2024-04-25T09:11:26.790108+0000","last_unstale":"2024-04-25T09:11:28.070205+0000","last_undegraded":"2024-04-25T09:11:28.070205+0000","last_fullsized":"2024-04-25T09:11:28.070205+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:30.819327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070601+0000","last_change":"2024-04-25T09:11:26.783160+0000","last_active":"2024-04-25T09:11:28.070601+0000","last_peered":"2024-04-25T09:11:28.070601+0000","last_clean":"2024-04-25T09:11:28.070601+0000","last_became_active":"2024-04-25T09:11:26.782852+0000","last_became_peered":"2024-04-25T09:11:26.782852+0000","last_unstale":"2024-04-25T09:11:28.070601+0000","last_undegraded":"2024-04-25T09:11:28.070601+0000","last_fullsized":"2024-04-25T09:11:28.070601+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:08.011751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172907+0000","last_change":"2024-04-25T09:11:26.792420+0000","last_active":"2024-04-25T09:11:29.172907+0000","last_peered":"2024-04-25T09:11:29.172907+0000","last_clean":"2024-04-25T09:11:29.172907+0000","last_became_active":"2024-04-25T09:11:26.792149+0000","last_became_peered":"2024-04-25T09:11:26.792149+0000","last_unstale":"2024-04-25T09:11:29.172907+0000","last_undegraded":"2024-04-25T09:11:29.172907+0000","last_fullsized":"2024-04-25T09:11:29.172907+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:36.999687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768495+0000","last_change":"2024-04-25T09:11:26.780285+0000","last_active":"2024-04-25T09:11:27.768495+0000","last_peered":"2024-04-25T09:11:27.768495+0000","last_clean":"2024-04-25T09:11:27.768495+0000","last_became_active":"2024-04-25T09:11:26.780022+0000","last_became_peered":"2024-04-25T09:11:26.780022+0000","last_unstale":"2024-04-25T09:11:27.768495+0000","last_undegraded":"2024-04-25T09:11:27.768495+0000","last_fullsized":"2024-04-25T09:11:27.768495+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:41.102958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767748+0000","last_change":"2024-04-25T09:11:26.781347+0000","last_active":"2024-04-25T09:11:27.767748+0000","last_peered":"2024-04-25T09:11:27.767748+0000","last_clean":"2024-04-25T09:11:27.767748+0000","last_became_active":"2024-04-25T09:11:26.781120+0000","last_became_peered":"2024-04-25T09:11:26.781120+0000","last_unstale":"2024-04-25T09:11:27.767748+0000","last_undegraded":"2024-04-25T09:11:27.767748+0000","last_fullsized":"2024-04-25T09:11:27.767748+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:01.534619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.173016+0000","last_change":"2024-04-25T09:11:26.805666+0000","last_active":"2024-04-25T09:11:29.173016+0000","last_peered":"2024-04-25T09:11:29.173016+0000","last_clean":"2024-04-25T09:11:29.173016+0000","last_became_active":"2024-04-25T09:11:26.805395+0000","last_became_peered":"2024-04-25T09:11:26.805395+0000","last_unstale":"2024-04-25T09:11:29.173016+0000","last_undegraded":"2024-04-25T09:11:29.173016+0000","last_fullsized":"2024-04-25T09:11:29.173016+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:33.574260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172133+0000","last_change":"2024-04-25T09:11:26.793946+0000","last_active":"2024-04-25T09:11:29.172133+0000","last_peered":"2024-04-25T09:11:29.172133+0000","last_clean":"2024-04-25T09:11:29.172133+0000","last_became_active":"2024-04-25T09:11:26.784942+0000","last_became_peered":"2024-04-25T09:11:26.784942+0000","last_unstale":"2024-04-25T09:11:29.172133+0000","last_undegraded":"2024-04-25T09:11:29.172133+0000","last_fullsized":"2024-04-25T09:11:29.172133+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:50.117338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070246+0000","last_change":"2024-04-25T09:11:26.795695+0000","last_active":"2024-04-25T09:11:28.070246+0000","last_peered":"2024-04-25T09:11:28.070246+0000","last_clean":"2024-04-25T09:11:28.070246+0000","last_became_active":"2024-04-25T09:11:26.795419+0000","last_became_peered":"2024-04-25T09:11:26.795419+0000","last_unstale":"2024-04-25T09:11:28.070246+0000","last_undegraded":"2024-04-25T09:11:28.070246+0000","last_fullsized":"2024-04-25T09:11:28.070246+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:03.214507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070156+0000","last_change":"2024-04-25T09:11:26.790369+0000","last_active":"2024-04-25T09:11:28.070156+0000","last_peered":"2024-04-25T09:11:28.070156+0000","last_clean":"2024-04-25T09:11:28.070156+0000","last_became_active":"2024-04-25T09:11:26.789737+0000","last_became_peered":"2024-04-25T09:11:26.789737+0000","last_unstale":"2024-04-25T09:11:28.070156+0000","last_undegraded":"2024-04-25T09:11:28.070156+0000","last_fullsized":"2024-04-25T09:11:28.070156+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:44.158295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.171757+0000","last_change":"2024-04-25T09:11:26.787994+0000","last_active":"2024-04-25T09:11:29.171757+0000","last_peered":"2024-04-25T09:11:29.171757+0000","last_clean":"2024-04-25T09:11:29.171757+0000","last_became_active":"2024-04-25T09:11:26.787717+0000","last_became_peered":"2024-04-25T09:11:26.787717+0000","last_unstale":"2024-04-25T09:11:29.171757+0000","last_undegraded":"2024-04-25T09:11:29.171757+0000","last_fullsized":"2024-04-25T09:11:29.171757+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:17.602681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"121'4","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768329+0000","last_change":"2024-04-25T09:11:25.782496+0000","last_active":"2024-04-25T09:11:27.768329+0000","last_peered":"2024-04-25T09:11:27.768329+0000","last_clean":"2024-04-25T09:11:27.768329+0000","last_became_active":"2024-04-25T09:11:25.782211+0000","last_became_peered":"2024-04-25T09:11:25.782211+0000","last_unstale":"2024-04-25T09:11:27.768329+0000","last_undegraded":"2024-04-25T09:11:27.768329+0000","last_fullsized":"2024-04-25T09:11:27.768329+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:43.030827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767536+0000","last_change":"2024-04-25T09:11:26.803328+0000","last_active":"2024-04-25T09:11:27.767536+0000","last_peered":"2024-04-25T09:11:27.767536+0000","last_clean":"2024-04-25T09:11:27.767536+0000","last_became_active":"2024-04-25T09:11:26.802977+0000","last_became_peered":"2024-04-25T09:11:26.802977+0000","last_unstale":"2024-04-25T09:11:27.767536+0000","last_undegraded":"2024-04-25T09:11:27.767536+0000","last_fullsized":"2024-04-25T09:11:27.767536+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:18.825168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.171847+0000","last_change":"2024-04-25T09:11:25.789063+0000","last_active":"2024-04-25T09:11:29.171847+0000","last_peered":"2024-04-25T09:11:29.171847+0000","last_clean":"2024-04-25T09:11:29.171847+0000","last_became_active":"2024-04-25T09:11:25.788745+0000","last_became_peered":"2024-04-25T09:11:25.788745+0000","last_unstale":"2024-04-25T09:11:29.171847+0000","last_undegraded":"2024-04-25T09:11:29.171847+0000","last_fullsized":"2024-04-25T09:11:29.171847+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:26:16.606333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070386+0000","last_change":"2024-04-25T09:11:26.780782+0000","last_active":"2024-04-25T09:11:28.070386+0000","last_peered":"2024-04-25T09:11:28.070386+0000","last_clean":"2024-04-25T09:11:28.070386+0000","last_became_active":"2024-04-25T09:11:26.780519+0000","last_became_peered":"2024-04-25T09:11:26.780519+0000","last_unstale":"2024-04-25T09:11:28.070386+0000","last_undegraded":"2024-04-25T09:11:28.070386+0000","last_fullsized":"2024-04-25T09:11:28.070386+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:44.033298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.038966+0000","last_change":"2024-04-25T09:11:25.788687+0000","last_active":"2024-04-25T09:11:28.038966+0000","last_peered":"2024-04-25T09:11:28.038966+0000","last_clean":"2024-04-25T09:11:28.038966+0000","last_became_active":"2024-04-25T09:11:25.788408+0000","last_became_peered":"2024-04-25T09:11:25.788408+0000","last_unstale":"2024-04-25T09:11:28.038966+0000","last_undegraded":"2024-04-25T09:11:28.038966+0000","last_fullsized":"2024-04-25T09:11:28.038966+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:29.964854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.039160+0000","last_change":"2024-04-25T09:11:26.797141+0000","last_active":"2024-04-25T09:11:28.039160+0000","last_peered":"2024-04-25T09:11:28.039160+0000","last_clean":"2024-04-25T09:11:28.039160+0000","last_became_active":"2024-04-25T09:11:26.796854+0000","last_became_peered":"2024-04-25T09:11:26.796854+0000","last_unstale":"2024-04-25T09:11:28.039160+0000","last_undegraded":"2024-04-25T09:11:28.039160+0000","last_fullsized":"2024-04-25T09:11:28.039160+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:09.120691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.171838+0000","last_change":"2024-04-25T09:11:25.778670+0000","last_active":"2024-04-25T09:11:29.171838+0000","last_peered":"2024-04-25T09:11:29.171838+0000","last_clean":"2024-04-25T09:11:29.171838+0000","last_became_active":"2024-04-25T09:11:25.778177+0000","last_became_peered":"2024-04-25T09:11:25.778177+0000","last_unstale":"2024-04-25T09:11:29.171838+0000","last_undegraded":"2024-04-25T09:11:29.171838+0000","last_fullsized":"2024-04-25T09:11:29.171838+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:01.802409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.171334+0000","last_change":"2024-04-25T09:11:26.789429+0000","last_active":"2024-04-25T09:11:29.171334+0000","last_peered":"2024-04-25T09:11:29.171334+0000","last_clean":"2024-04-25T09:11:29.171334+0000","last_became_active":"2024-04-25T09:11:26.788594+0000","last_became_peered":"2024-04-25T09:11:26.788594+0000","last_unstale":"2024-04-25T09:11:29.171334+0000","last_undegraded":"2024-04-25T09:11:29.171334+0000","last_fullsized":"2024-04-25T09:11:29.171334+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:00.922260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768484+0000","last_change":"2024-04-25T09:11:25.778748+0000","last_active":"2024-04-25T09:11:27.768484+0000","last_peered":"2024-04-25T09:11:27.768484+0000","last_clean":"2024-04-25T09:11:27.768484+0000","last_became_active":"2024-04-25T09:11:25.778369+0000","last_became_peered":"2024-04-25T09:11:25.778369+0000","last_unstale":"2024-04-25T09:11:27.768484+0000","last_undegraded":"2024-04-25T09:11:27.768484+0000","last_fullsized":"2024-04-25T09:11:27.768484+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:40.038318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767759+0000","last_change":"2024-04-25T09:11:26.782603+0000","last_active":"2024-04-25T09:11:27.767759+0000","last_peered":"2024-04-25T09:11:27.767759+0000","last_clean":"2024-04-25T09:11:27.767759+0000","last_became_active":"2024-04-25T09:11:26.781970+0000","last_became_peered":"2024-04-25T09:11:26.781970+0000","last_unstale":"2024-04-25T09:11:27.767759+0000","last_undegraded":"2024-04-25T09:11:27.767759+0000","last_fullsized":"2024-04-25T09:11:27.767759+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:50.866716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767584+0000","last_change":"2024-04-25T09:11:25.784323+0000","last_active":"2024-04-25T09:11:27.767584+0000","last_peered":"2024-04-25T09:11:27.767584+0000","last_clean":"2024-04-25T09:11:27.767584+0000","last_became_active":"2024-04-25T09:11:25.783886+0000","last_became_peered":"2024-04-25T09:11:25.783886+0000","last_unstale":"2024-04-25T09:11:27.767584+0000","last_undegraded":"2024-04-25T09:11:27.767584+0000","last_fullsized":"2024-04-25T09:11:27.767584+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:47.142671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172293+0000","last_change":"2024-04-25T09:11:26.796820+0000","last_active":"2024-04-25T09:11:29.172293+0000","last_peered":"2024-04-25T09:11:29.172293+0000","last_clean":"2024-04-25T09:11:29.172293+0000","last_became_active":"2024-04-25T09:11:26.796373+0000","last_became_peered":"2024-04-25T09:11:26.796373+0000","last_unstale":"2024-04-25T09:11:29.172293+0000","last_undegraded":"2024-04-25T09:11:29.172293+0000","last_fullsized":"2024-04-25T09:11:29.172293+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:09.120691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070315+0000","last_change":"2024-04-25T09:11:25.786111+0000","last_active":"2024-04-25T09:11:28.070315+0000","last_peered":"2024-04-25T09:11:28.070315+0000","last_clean":"2024-04-25T09:11:28.070315+0000","last_became_active":"2024-04-25T09:11:25.785762+0000","last_became_peered":"2024-04-25T09:11:25.785762+0000","last_unstale":"2024-04-25T09:11:28.070315+0000","last_undegraded":"2024-04-25T09:11:28.070315+0000","last_fullsized":"2024-04-25T09:11:28.070315+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:24.290504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.171889+0000","last_change":"2024-04-25T09:11:26.807560+0000","last_active":"2024-04-25T09:11:29.171889+0000","last_peered":"2024-04-25T09:11:29.171889+0000","last_clean":"2024-04-25T09:11:29.171889+0000","last_became_active":"2024-04-25T09:11:26.807297+0000","last_became_peered":"2024-04-25T09:11:26.807297+0000","last_unstale":"2024-04-25T09:11:29.171889+0000","last_undegraded":"2024-04-25T09:11:29.171889+0000","last_fullsized":"2024-04-25T09:11:29.171889+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:02.420732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767243+0000","last_change":"2024-04-25T09:11:25.782062+0000","last_active":"2024-04-25T09:11:27.767243+0000","last_peered":"2024-04-25T09:11:27.767243+0000","last_clean":"2024-04-25T09:11:27.767243+0000","last_became_active":"2024-04-25T09:11:25.781812+0000","last_became_peered":"2024-04-25T09:11:25.781812+0000","last_unstale":"2024-04-25T09:11:27.767243+0000","last_undegraded":"2024-04-25T09:11:27.767243+0000","last_fullsized":"2024-04-25T09:11:27.767243+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:17.958244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767943+0000","last_change":"2024-04-25T09:11:26.783348+0000","last_active":"2024-04-25T09:11:27.767943+0000","last_peered":"2024-04-25T09:11:27.767943+0000","last_clean":"2024-04-25T09:11:27.767943+0000","last_became_active":"2024-04-25T09:11:26.783086+0000","last_became_peered":"2024-04-25T09:11:26.783086+0000","last_unstale":"2024-04-25T09:11:27.767943+0000","last_undegraded":"2024-04-25T09:11:27.767943+0000","last_fullsized":"2024-04-25T09:11:27.767943+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:25.760586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768379+0000","last_change":"2024-04-25T09:11:25.786883+0000","last_active":"2024-04-25T09:11:27.768379+0000","last_peered":"2024-04-25T09:11:27.768379+0000","last_clean":"2024-04-25T09:11:27.768379+0000","last_became_active":"2024-04-25T09:11:25.786471+0000","last_became_peered":"2024-04-25T09:11:25.786471+0000","last_unstale":"2024-04-25T09:11:27.768379+0000","last_undegraded":"2024-04-25T09:11:27.768379+0000","last_fullsized":"2024-04-25T09:11:27.768379+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:33.024623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070506+0000","last_change":"2024-04-25T09:11:26.802053+0000","last_active":"2024-04-25T09:11:28.070506+0000","last_peered":"2024-04-25T09:11:28.070506+0000","last_clean":"2024-04-25T09:11:28.070506+0000","last_became_active":"2024-04-25T09:11:26.801745+0000","last_became_peered":"2024-04-25T09:11:26.801745+0000","last_unstale":"2024-04-25T09:11:28.070506+0000","last_undegraded":"2024-04-25T09:11:28.070506+0000","last_fullsized":"2024-04-25T09:11:28.070506+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:34.027095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070327+0000","last_change":"2024-04-25T09:11:25.790188+0000","last_active":"2024-04-25T09:11:28.070327+0000","last_peered":"2024-04-25T09:11:28.070327+0000","last_clean":"2024-04-25T09:11:28.070327+0000","last_became_active":"2024-04-25T09:11:25.789477+0000","last_became_peered":"2024-04-25T09:11:25.789477+0000","last_unstale":"2024-04-25T09:11:28.070327+0000","last_undegraded":"2024-04-25T09:11:28.070327+0000","last_fullsized":"2024-04-25T09:11:28.070327+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:40.038318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172331+0000","last_change":"2024-04-25T09:11:26.804558+0000","last_active":"2024-04-25T09:11:29.172331+0000","last_peered":"2024-04-25T09:11:29.172331+0000","last_clean":"2024-04-25T09:11:29.172331+0000","last_became_active":"2024-04-25T09:11:26.801426+0000","last_became_peered":"2024-04-25T09:11:26.801426+0000","last_unstale":"2024-04-25T09:11:29.172331+0000","last_undegraded":"2024-04-25T09:11:29.172331+0000","last_fullsized":"2024-04-25T09:11:29.172331+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:55.430515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"121'3","reported_seq":17,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070498+0000","last_change":"2024-04-25T09:11:25.785530+0000","last_active":"2024-04-25T09:11:28.070498+0000","last_peered":"2024-04-25T09:11:28.070498+0000","last_clean":"2024-04-25T09:11:28.070498+0000","last_became_active":"2024-04-25T09:11:25.785236+0000","last_became_peered":"2024-04-25T09:11:25.785236+0000","last_unstale":"2024-04-25T09:11:28.070498+0000","last_undegraded":"2024-04-25T09:11:28.070498+0000","last_fullsized":"2024-04-25T09:11:28.070498+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:36.050959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070656+0000","last_change":"2024-04-25T09:11:26.793693+0000","last_active":"2024-04-25T09:11:28.070656+0000","last_peered":"2024-04-25T09:11:28.070656+0000","last_clean":"2024-04-25T09:11:28.070656+0000","last_became_active":"2024-04-25T09:11:26.793379+0000","last_became_peered":"2024-04-25T09:11:26.793379+0000","last_unstale":"2024-04-25T09:11:28.070656+0000","last_undegraded":"2024-04-25T09:11:28.070656+0000","last_fullsized":"2024-04-25T09:11:28.070656+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:58.722752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"121'6","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172061+0000","last_change":"2024-04-25T09:11:25.788323+0000","last_active":"2024-04-25T09:11:29.172061+0000","last_peered":"2024-04-25T09:11:29.172061+0000","last_clean":"2024-04-25T09:11:29.172061+0000","last_became_active":"2024-04-25T09:11:25.787675+0000","last_became_peered":"2024-04-25T09:11:25.787675+0000","last_unstale":"2024-04-25T09:11:29.172061+0000","last_undegraded":"2024-04-25T09:11:29.172061+0000","last_fullsized":"2024-04-25T09:11:29.172061+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:29.964854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768233+0000","last_change":"2024-04-25T09:11:26.776056+0000","last_active":"2024-04-25T09:11:27.768233+0000","last_peered":"2024-04-25T09:11:27.768233+0000","last_clean":"2024-04-25T09:11:27.768233+0000","last_became_active":"2024-04-25T09:11:26.775732+0000","last_became_peered":"2024-04-25T09:11:26.775732+0000","last_unstale":"2024-04-25T09:11:27.768233+0000","last_undegraded":"2024-04-25T09:11:27.768233+0000","last_fullsized":"2024-04-25T09:11:27.768233+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:20.515945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172508+0000","last_change":"2024-04-25T09:11:25.786240+0000","last_active":"2024-04-25T09:11:29.172508+0000","last_peered":"2024-04-25T09:11:29.172508+0000","last_clean":"2024-04-25T09:11:29.172508+0000","last_became_active":"2024-04-25T09:11:25.785904+0000","last_became_peered":"2024-04-25T09:11:25.785904+0000","last_unstale":"2024-04-25T09:11:29.172508+0000","last_undegraded":"2024-04-25T09:11:29.172508+0000","last_fullsized":"2024-04-25T09:11:29.172508+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:03.302767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.171632+0000","last_change":"2024-04-25T09:11:26.799364+0000","last_active":"2024-04-25T09:11:29.171632+0000","last_peered":"2024-04-25T09:11:29.171632+0000","last_clean":"2024-04-25T09:11:29.171632+0000","last_became_active":"2024-04-25T09:11:26.798845+0000","last_became_peered":"2024-04-25T09:11:26.798845+0000","last_unstale":"2024-04-25T09:11:29.171632+0000","last_undegraded":"2024-04-25T09:11:29.171632+0000","last_fullsized":"2024-04-25T09:11:29.171632+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:26.761813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172528+0000","last_change":"2024-04-25T09:11:25.789385+0000","last_active":"2024-04-25T09:11:29.172528+0000","last_peered":"2024-04-25T09:11:29.172528+0000","last_clean":"2024-04-25T09:11:29.172528+0000","last_became_active":"2024-04-25T09:11:25.789127+0000","last_became_peered":"2024-04-25T09:11:25.789127+0000","last_unstale":"2024-04-25T09:11:29.172528+0000","last_undegraded":"2024-04-25T09:11:29.172528+0000","last_fullsized":"2024-04-25T09:11:29.172528+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:06.107623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.171845+0000","last_change":"2024-04-25T09:11:26.789683+0000","last_active":"2024-04-25T09:11:29.171845+0000","last_peered":"2024-04-25T09:11:29.171845+0000","last_clean":"2024-04-25T09:11:29.171845+0000","last_became_active":"2024-04-25T09:11:26.788459+0000","last_became_peered":"2024-04-25T09:11:26.788459+0000","last_unstale":"2024-04-25T09:11:29.171845+0000","last_undegraded":"2024-04-25T09:11:29.171845+0000","last_fullsized":"2024-04-25T09:11:29.171845+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:46.711389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172590+0000","last_change":"2024-04-25T09:11:25.787217+0000","last_active":"2024-04-25T09:11:29.172590+0000","last_peered":"2024-04-25T09:11:29.172590+0000","last_clean":"2024-04-25T09:11:29.172590+0000","last_became_active":"2024-04-25T09:11:25.786763+0000","last_became_peered":"2024-04-25T09:11:25.786763+0000","last_unstale":"2024-04-25T09:11:29.172590+0000","last_undegraded":"2024-04-25T09:11:29.172590+0000","last_fullsized":"2024-04-25T09:11:29.172590+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:09.144966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070405+0000","last_change":"2024-04-25T09:11:26.781598+0000","last_active":"2024-04-25T09:11:28.070405+0000","last_peered":"2024-04-25T09:11:28.070405+0000","last_clean":"2024-04-25T09:11:28.070405+0000","last_became_active":"2024-04-25T09:11:26.781290+0000","last_became_peered":"2024-04-25T09:11:26.781290+0000","last_unstale":"2024-04-25T09:11:28.070405+0000","last_undegraded":"2024-04-25T09:11:28.070405+0000","last_fullsized":"2024-04-25T09:11:28.070405+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:11.569136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172669+0000","last_change":"2024-04-25T09:11:25.781852+0000","last_active":"2024-04-25T09:11:29.172669+0000","last_peered":"2024-04-25T09:11:29.172669+0000","last_clean":"2024-04-25T09:11:29.172669+0000","last_became_active":"2024-04-25T09:11:25.780781+0000","last_became_peered":"2024-04-25T09:11:25.780781+0000","last_unstale":"2024-04-25T09:11:29.172669+0000","last_undegraded":"2024-04-25T09:11:29.172669+0000","last_fullsized":"2024-04-25T09:11:29.172669+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:54.103134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.769052+0000","last_change":"2024-04-25T09:11:26.797827+0000","last_active":"2024-04-25T09:11:27.769052+0000","last_peered":"2024-04-25T09:11:27.769052+0000","last_clean":"2024-04-25T09:11:27.769052+0000","last_became_active":"2024-04-25T09:11:26.797548+0000","last_became_peered":"2024-04-25T09:11:26.797548+0000","last_unstale":"2024-04-25T09:11:27.769052+0000","last_undegraded":"2024-04-25T09:11:27.769052+0000","last_fullsized":"2024-04-25T09:11:27.769052+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:03.214507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172999+0000","last_change":"2024-04-25T09:11:25.792534+0000","last_active":"2024-04-25T09:11:29.172999+0000","last_peered":"2024-04-25T09:11:29.172999+0000","last_clean":"2024-04-25T09:11:29.172999+0000","last_became_active":"2024-04-25T09:11:25.792008+0000","last_became_peered":"2024-04-25T09:11:25.792008+0000","last_unstale":"2024-04-25T09:11:29.172999+0000","last_undegraded":"2024-04-25T09:11:29.172999+0000","last_fullsized":"2024-04-25T09:11:29.172999+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:22.627378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767889+0000","last_change":"2024-04-25T09:11:26.772587+0000","last_active":"2024-04-25T09:11:27.767889+0000","last_peered":"2024-04-25T09:11:27.767889+0000","last_clean":"2024-04-25T09:11:27.767889+0000","last_became_active":"2024-04-25T09:11:26.772276+0000","last_became_peered":"2024-04-25T09:11:26.772276+0000","last_unstale":"2024-04-25T09:11:27.767889+0000","last_undegraded":"2024-04-25T09:11:27.767889+0000","last_fullsized":"2024-04-25T09:11:27.767889+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:32.004711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"121'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.039046+0000","last_change":"2024-04-25T09:11:25.789177+0000","last_active":"2024-04-25T09:11:28.039046+0000","last_peered":"2024-04-25T09:11:28.039046+0000","last_clean":"2024-04-25T09:11:28.039046+0000","last_became_active":"2024-04-25T09:11:25.788356+0000","last_became_peered":"2024-04-25T09:11:25.788356+0000","last_unstale":"2024-04-25T09:11:28.039046+0000","last_undegraded":"2024-04-25T09:11:28.039046+0000","last_fullsized":"2024-04-25T09:11:28.039046+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:06.193412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070694+0000","last_change":"2024-04-25T09:11:26.789879+0000","last_active":"2024-04-25T09:11:28.070694+0000","last_peered":"2024-04-25T09:11:28.070694+0000","last_clean":"2024-04-25T09:11:28.070694+0000","last_became_active":"2024-04-25T09:11:26.789518+0000","last_became_peered":"2024-04-25T09:11:26.789518+0000","last_unstale":"2024-04-25T09:11:28.070694+0000","last_undegraded":"2024-04-25T09:11:28.070694+0000","last_fullsized":"2024-04-25T09:11:28.070694+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:26.026358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.038547+0000","last_change":"2024-04-25T09:11:25.791795+0000","last_active":"2024-04-25T09:11:28.038547+0000","last_peered":"2024-04-25T09:11:28.038547+0000","last_clean":"2024-04-25T09:11:28.038547+0000","last_became_active":"2024-04-25T09:11:25.791461+0000","last_became_peered":"2024-04-25T09:11:25.791461+0000","last_unstale":"2024-04-25T09:11:28.038547+0000","last_undegraded":"2024-04-25T09:11:28.038547+0000","last_fullsized":"2024-04-25T09:11:28.038547+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:09.144966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767110+0000","last_change":"2024-04-25T09:11:26.772157+0000","last_active":"2024-04-25T09:11:27.767110+0000","last_peered":"2024-04-25T09:11:27.767110+0000","last_clean":"2024-04-25T09:11:27.767110+0000","last_became_active":"2024-04-25T09:11:26.771882+0000","last_became_peered":"2024-04-25T09:11:26.771882+0000","last_unstale":"2024-04-25T09:11:27.767110+0000","last_undegraded":"2024-04-25T09:11:27.767110+0000","last_fullsized":"2024-04-25T09:11:27.767110+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:07.458809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767135+0000","last_change":"2024-04-25T09:11:25.784911+0000","last_active":"2024-04-25T09:11:27.767135+0000","last_peered":"2024-04-25T09:11:27.767135+0000","last_clean":"2024-04-25T09:11:27.767135+0000","last_became_active":"2024-04-25T09:11:25.784461+0000","last_became_peered":"2024-04-25T09:11:25.784461+0000","last_unstale":"2024-04-25T09:11:27.767135+0000","last_undegraded":"2024-04-25T09:11:27.767135+0000","last_fullsized":"2024-04-25T09:11:27.767135+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:09.127425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172418+0000","last_change":"2024-04-25T09:11:26.797782+0000","last_active":"2024-04-25T09:11:29.172418+0000","last_peered":"2024-04-25T09:11:29.172418+0000","last_clean":"2024-04-25T09:11:29.172418+0000","last_became_active":"2024-04-25T09:11:26.797497+0000","last_became_peered":"2024-04-25T09:11:26.797497+0000","last_unstale":"2024-04-25T09:11:29.172418+0000","last_undegraded":"2024-04-25T09:11:29.172418+0000","last_fullsized":"2024-04-25T09:11:29.172418+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:11.990751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.038345+0000","last_change":"2024-04-25T09:11:25.783997+0000","last_active":"2024-04-25T09:11:28.038345+0000","last_peered":"2024-04-25T09:11:28.038345+0000","last_clean":"2024-04-25T09:11:28.038345+0000","last_became_active":"2024-04-25T09:11:25.783674+0000","last_became_peered":"2024-04-25T09:11:25.783674+0000","last_unstale":"2024-04-25T09:11:28.038345+0000","last_undegraded":"2024-04-25T09:11:28.038345+0000","last_fullsized":"2024-04-25T09:11:28.038345+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:53.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172486+0000","last_change":"2024-04-25T09:11:26.796627+0000","last_active":"2024-04-25T09:11:29.172486+0000","last_peered":"2024-04-25T09:11:29.172486+0000","last_clean":"2024-04-25T09:11:29.172486+0000","last_became_active":"2024-04-25T09:11:26.794570+0000","last_became_peered":"2024-04-25T09:11:26.794570+0000","last_unstale":"2024-04-25T09:11:29.172486+0000","last_undegraded":"2024-04-25T09:11:29.172486+0000","last_fullsized":"2024-04-25T09:11:29.172486+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:39.995196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172634+0000","last_change":"2024-04-25T09:11:25.786373+0000","last_active":"2024-04-25T09:11:29.172634+0000","last_peered":"2024-04-25T09:11:29.172634+0000","last_clean":"2024-04-25T09:11:29.172634+0000","last_became_active":"2024-04-25T09:11:25.785938+0000","last_became_peered":"2024-04-25T09:11:25.785938+0000","last_unstale":"2024-04-25T09:11:29.172634+0000","last_undegraded":"2024-04-25T09:11:29.172634+0000","last_fullsized":"2024-04-25T09:11:29.172634+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:06.193412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.070321+0000","last_change":"2024-04-25T09:11:26.794889+0000","last_active":"2024-04-25T09:11:28.070321+0000","last_peered":"2024-04-25T09:11:28.070321+0000","last_clean":"2024-04-25T09:11:28.070321+0000","last_became_active":"2024-04-25T09:11:26.794248+0000","last_became_peered":"2024-04-25T09:11:26.794248+0000","last_unstale":"2024-04-25T09:11:28.070321+0000","last_undegraded":"2024-04-25T09:11:28.070321+0000","last_fullsized":"2024-04-25T09:11:28.070321+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:48.355880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.038320+0000","last_change":"2024-04-25T09:11:25.786145+0000","last_active":"2024-04-25T09:11:28.038320+0000","last_peered":"2024-04-25T09:11:28.038320+0000","last_clean":"2024-04-25T09:11:28.038320+0000","last_became_active":"2024-04-25T09:11:25.785877+0000","last_became_peered":"2024-04-25T09:11:25.785877+0000","last_unstale":"2024-04-25T09:11:28.038320+0000","last_undegraded":"2024-04-25T09:11:28.038320+0000","last_fullsized":"2024-04-25T09:11:28.038320+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:46.425507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767784+0000","last_change":"2024-04-25T09:11:26.790428+0000","last_active":"2024-04-25T09:11:27.767784+0000","last_peered":"2024-04-25T09:11:27.767784+0000","last_clean":"2024-04-25T09:11:27.767784+0000","last_became_active":"2024-04-25T09:11:26.789545+0000","last_became_peered":"2024-04-25T09:11:26.789545+0000","last_unstale":"2024-04-25T09:11:27.767784+0000","last_undegraded":"2024-04-25T09:11:27.767784+0000","last_fullsized":"2024-04-25T09:11:27.767784+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:48.073136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"121'2","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767867+0000","last_change":"2024-04-25T09:11:25.784967+0000","last_active":"2024-04-25T09:11:27.767867+0000","last_peered":"2024-04-25T09:11:27.767867+0000","last_clean":"2024-04-25T09:11:27.767867+0000","last_became_active":"2024-04-25T09:11:25.784702+0000","last_became_peered":"2024-04-25T09:11:25.784702+0000","last_unstale":"2024-04-25T09:11:27.767867+0000","last_undegraded":"2024-04-25T09:11:27.767867+0000","last_fullsized":"2024-04-25T09:11:27.767867+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:47.656385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.171552+0000","last_change":"2024-04-25T09:11:26.792914+0000","last_active":"2024-04-25T09:11:29.171552+0000","last_peered":"2024-04-25T09:11:29.171552+0000","last_clean":"2024-04-25T09:11:29.171552+0000","last_became_active":"2024-04-25T09:11:26.792600+0000","last_became_peered":"2024-04-25T09:11:26.792600+0000","last_unstale":"2024-04-25T09:11:29.171552+0000","last_undegraded":"2024-04-25T09:11:29.171552+0000","last_fullsized":"2024-04-25T09:11:29.171552+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:32.375704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"122'1","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.772977+0000","last_change":"2024-04-25T09:11:25.785623+0000","last_active":"2024-04-25T09:11:28.772977+0000","last_peered":"2024-04-25T09:11:28.772977+0000","last_clean":"2024-04-25T09:11:28.772977+0000","last_became_active":"2024-04-25T09:11:25.785338+0000","last_became_peered":"2024-04-25T09:11:25.785338+0000","last_unstale":"2024-04-25T09:11:28.772977+0000","last_undegraded":"2024-04-25T09:11:28.772977+0000","last_fullsized":"2024-04-25T09:11:28.772977+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:10.566665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.038916+0000","last_change":"2024-04-25T09:11:26.786960+0000","last_active":"2024-04-25T09:11:28.038916+0000","last_peered":"2024-04-25T09:11:28.038916+0000","last_clean":"2024-04-25T09:11:28.038916+0000","last_became_active":"2024-04-25T09:11:26.785791+0000","last_became_peered":"2024-04-25T09:11:26.785791+0000","last_unstale":"2024-04-25T09:11:28.038916+0000","last_undegraded":"2024-04-25T09:11:28.038916+0000","last_fullsized":"2024-04-25T09:11:28.038916+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:55.857772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768313+0000","last_change":"2024-04-25T09:11:25.786163+0000","last_active":"2024-04-25T09:11:27.768313+0000","last_peered":"2024-04-25T09:11:27.768313+0000","last_clean":"2024-04-25T09:11:27.768313+0000","last_became_active":"2024-04-25T09:11:25.785903+0000","last_became_peered":"2024-04-25T09:11:25.785903+0000","last_unstale":"2024-04-25T09:11:27.768313+0000","last_undegraded":"2024-04-25T09:11:27.768313+0000","last_fullsized":"2024-04-25T09:11:27.768313+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:07.009279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172924+0000","last_change":"2024-04-25T09:11:26.790380+0000","last_active":"2024-04-25T09:11:29.172924+0000","last_peered":"2024-04-25T09:11:29.172924+0000","last_clean":"2024-04-25T09:11:29.172924+0000","last_became_active":"2024-04-25T09:11:26.790013+0000","last_became_peered":"2024-04-25T09:11:26.790013+0000","last_unstale":"2024-04-25T09:11:29.172924+0000","last_undegraded":"2024-04-25T09:11:29.172924+0000","last_fullsized":"2024-04-25T09:11:29.172924+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:10.979605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767898+0000","last_change":"2024-04-25T09:11:25.785188+0000","last_active":"2024-04-25T09:11:27.767898+0000","last_peered":"2024-04-25T09:11:27.767898+0000","last_clean":"2024-04-25T09:11:27.767898+0000","last_became_active":"2024-04-25T09:11:25.779978+0000","last_became_peered":"2024-04-25T09:11:25.779978+0000","last_unstale":"2024-04-25T09:11:27.767898+0000","last_undegraded":"2024-04-25T09:11:27.767898+0000","last_fullsized":"2024-04-25T09:11:27.767898+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:38.992725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767281+0000","last_change":"2024-04-25T09:11:26.771533+0000","last_active":"2024-04-25T09:11:27.767281+0000","last_peered":"2024-04-25T09:11:27.767281+0000","last_clean":"2024-04-25T09:11:27.767281+0000","last_became_active":"2024-04-25T09:11:26.771206+0000","last_became_peered":"2024-04-25T09:11:26.771206+0000","last_unstale":"2024-04-25T09:11:27.767281+0000","last_undegraded":"2024-04-25T09:11:27.767281+0000","last_fullsized":"2024-04-25T09:11:27.767281+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:16.193785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768858+0000","last_change":"2024-04-25T09:11:25.786217+0000","last_active":"2024-04-25T09:11:27.768858+0000","last_peered":"2024-04-25T09:11:27.768858+0000","last_clean":"2024-04-25T09:11:27.768858+0000","last_became_active":"2024-04-25T09:11:25.785945+0000","last_became_peered":"2024-04-25T09:11:25.785945+0000","last_unstale":"2024-04-25T09:11:27.768858+0000","last_undegraded":"2024-04-25T09:11:27.768858+0000","last_fullsized":"2024-04-25T09:11:27.768858+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:36.050959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172554+0000","last_change":"2024-04-25T09:11:26.786763+0000","last_active":"2024-04-25T09:11:29.172554+0000","last_peered":"2024-04-25T09:11:29.172554+0000","last_clean":"2024-04-25T09:11:29.172554+0000","last_became_active":"2024-04-25T09:11:26.786447+0000","last_became_peered":"2024-04-25T09:11:26.786447+0000","last_unstale":"2024-04-25T09:11:29.172554+0000","last_undegraded":"2024-04-25T09:11:29.172554+0000","last_fullsized":"2024-04-25T09:11:29.172554+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:18.960715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.768686+0000","last_change":"2024-04-25T09:11:25.789039+0000","last_active":"2024-04-25T09:11:27.768686+0000","last_peered":"2024-04-25T09:11:27.768686+0000","last_clean":"2024-04-25T09:11:27.768686+0000","last_became_active":"2024-04-25T09:11:25.788749+0000","last_became_peered":"2024-04-25T09:11:25.788749+0000","last_unstale":"2024-04-25T09:11:27.768686+0000","last_undegraded":"2024-04-25T09:11:27.768686+0000","last_fullsized":"2024-04-25T09:11:27.768686+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:24.290504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.038548+0000","last_change":"2024-04-25T09:11:26.781923+0000","last_active":"2024-04-25T09:11:28.038548+0000","last_peered":"2024-04-25T09:11:28.038548+0000","last_clean":"2024-04-25T09:11:28.038548+0000","last_became_active":"2024-04-25T09:11:26.780479+0000","last_became_peered":"2024-04-25T09:11:26.780479+0000","last_unstale":"2024-04-25T09:11:28.038548+0000","last_undegraded":"2024-04-25T09:11:28.038548+0000","last_fullsized":"2024-04-25T09:11:28.038548+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:08.462078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:27.767233+0000","last_change":"2024-04-25T09:11:25.781405+0000","last_active":"2024-04-25T09:11:27.767233+0000","last_peered":"2024-04-25T09:11:27.767233+0000","last_clean":"2024-04-25T09:11:27.767233+0000","last_became_active":"2024-04-25T09:11:25.781100+0000","last_became_peered":"2024-04-25T09:11:25.781100+0000","last_unstale":"2024-04-25T09:11:27.767233+0000","last_undegraded":"2024-04-25T09:11:27.767233+0000","last_fullsized":"2024-04-25T09:11:27.767233+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:10.988280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.171748+0000","last_change":"2024-04-25T09:11:26.798742+0000","last_active":"2024-04-25T09:11:29.171748+0000","last_peered":"2024-04-25T09:11:29.171748+0000","last_clean":"2024-04-25T09:11:29.171748+0000","last_became_active":"2024-04-25T09:11:26.798468+0000","last_became_peered":"2024-04-25T09:11:26.798468+0000","last_unstale":"2024-04-25T09:11:29.171748+0000","last_undegraded":"2024-04-25T09:11:29.171748+0000","last_fullsized":"2024-04-25T09:11:29.171748+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:42.312884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.038329+0000","last_change":"2024-04-25T09:11:25.780949+0000","last_active":"2024-04-25T09:11:28.038329+0000","last_peered":"2024-04-25T09:11:28.038329+0000","last_clean":"2024-04-25T09:11:28.038329+0000","last_became_active":"2024-04-25T09:11:25.780664+0000","last_became_peered":"2024-04-25T09:11:25.780664+0000","last_unstale":"2024-04-25T09:11:28.038329+0000","last_undegraded":"2024-04-25T09:11:28.038329+0000","last_fullsized":"2024-04-25T09:11:28.038329+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:52.742093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.038914+0000","last_change":"2024-04-25T09:11:26.793502+0000","last_active":"2024-04-25T09:11:28.038914+0000","last_peered":"2024-04-25T09:11:28.038914+0000","last_clean":"2024-04-25T09:11:28.038914+0000","last_became_active":"2024-04-25T09:11:26.792794+0000","last_became_peered":"2024-04-25T09:11:26.792794+0000","last_unstale":"2024-04-25T09:11:28.038914+0000","last_undegraded":"2024-04-25T09:11:28.038914+0000","last_fullsized":"2024-04-25T09:11:28.038914+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:25.752627+0000","last_clean_scrub_stamp":"2024-04-25T09:11:25.752627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:33.951077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"121'8","reported_seq":22,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:29.172054+0000","last_change":"2024-04-25T09:11:25.787740+0000","last_active":"2024-04-25T09:11:29.172054+0000","last_peered":"2024-04-25T09:11:29.172054+0000","last_clean":"2024-04-25T09:11:29.172054+0000","last_became_active":"2024-04-25T09:11:25.786106+0000","last_became_peered":"2024-04-25T09:11:25.786106+0000","last_unstale":"2024-04-25T09:11:29.172054+0000","last_undegraded":"2024-04-25T09:11:29.172054+0000","last_fullsized":"2024-04-25T09:11:29.172054+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:24.750156+0000","last_clean_scrub_stamp":"2024-04-25T09:11:24.750156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:53.145452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":356,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T09:11:28.038664+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:11:28.038664+0000","last_peered":"2024-04-25T09:11:28.038664+0000","last_clean":"2024-04-25T09:11:28.038664+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:11:28.038664+0000","last_undegraded":"2024-04-25T09:11:28.038664+0000","last_fullsized":"2024-04-25T09:11:28.038664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509550,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50708,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321132,"statfs":{"total":96636764160,"available":96584839168,"internally_reserved":0,"allocated":1515520,"data_stored":703826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509550,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50712,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321128,"statfs":{"total":96636764160,"available":96584835072,"internally_reserved":0,"allocated":1519616,"data_stored":703404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509551,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59040,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312800,"statfs":{"total":96636764160,"available":96576307200,"internally_reserved":0,"allocated":1523712,"data_stored":704856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509550,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54880,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316960,"statfs":{"total":96636764160,"available":96580567040,"internally_reserved":0,"allocated":1527808,"data_stored":704890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509550,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54864,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316976,"statfs":{"total":96636764160,"available":96580583424,"internally_reserved":0,"allocated":1511424,"data_stored":703244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509551,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50708,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321132,"statfs":{"total":96636764160,"available":96584839168,"internally_reserved":0,"allocated":1515520,"data_stored":703266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509551,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55448,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316392,"statfs":{"total":96636764160,"available":96579985408,"internally_reserved":0,"allocated":2109440,"data_stored":1293634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574958,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51304,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320536,"statfs":{"total":96636764160,"available":96584228864,"internally_reserved":0,"allocated":2121728,"data_stored":1294388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:11:35.692 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:11:35.692 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:11:35.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.886+0000 7f0b3a800640 1 Processor -- start 2024-04-25T09:11:35.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.886+0000 7f0b3a800640 1 -- start start 2024-04-25T09:11:35.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.890+0000 7f0b3a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0b34150d20 0x7f0b340ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:35.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.890+0000 7f0b3a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b34151100 0x7f0b3415a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:35.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.890+0000 7f0b3a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0b3415e1a0 0x7f0b3415e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:35.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.890+0000 7f0b3a800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3415ac80 con 0x7f0b3415e1a0 2024-04-25T09:11:35.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.890+0000 7f0b3a800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3415af60 con 0x7f0b34150d20 2024-04-25T09:11:35.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.890+0000 7f0b3a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3415b240 con 0x7f0b34151100 2024-04-25T09:11:35.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.890+0000 7f0b39e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0b3415e1a0 0x7f0b3415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:35.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.890+0000 7f0b39e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0b3415e1a0 0x7f0b3415e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60296/0 (socket says 172.21.15.173:60296) 2024-04-25T09:11:35.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.890+0000 7f0b39e00640 1 -- 172.21.15.173:0/1808956675 learned_addr learned my addr 172.21.15.173:0/1808956675 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:35.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.890+0000 7f0b38a00640 1 --2- 172.21.15.173:0/1808956675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b34151100 0x7f0b3415a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:35.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.890+0000 7f0b39400640 1 --2- 172.21.15.173:0/1808956675 >> v2:172.21.15.194:3300/0 conn(0x7f0b34150d20 0x7f0b340ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:35.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.890+0000 7f0b39e00640 1 -- 172.21.15.173:0/1808956675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b34151100 msgr2=0x7f0b3415a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:35.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.890+0000 7f0b39e00640 1 --2- 172.21.15.173:0/1808956675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b34151100 0x7f0b3415a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:35.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.890+0000 7f0b39e00640 1 -- 172.21.15.173:0/1808956675 >> v2:172.21.15.194:3300/0 conn(0x7f0b34150d20 msgr2=0x7f0b340ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:35.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.890+0000 7f0b39e00640 1 --2- 172.21.15.173:0/1808956675 >> v2:172.21.15.194:3300/0 conn(0x7f0b34150d20 0x7f0b340ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:35.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.890+0000 7f0b39e00640 1 -- 172.21.15.173:0/1808956675 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3415dca0 con 0x7f0b3415e1a0 2024-04-25T09:11:35.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.890+0000 7f0b39e00640 1 --2- 172.21.15.173:0/1808956675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b3415e1a0 0x7f0b3415e610 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f0b3406f6e0 tx=0x7f0b2c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b44718d4822144 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:35.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b33e00640 1 -- 172.21.15.173:0/1808956675 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c0a5700 con 0x7f0b3415e1a0 2024-04-25T09:11:35.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b33e00640 1 -- 172.21.15.173:0/1808956675 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2c0a58a0 con 0x7f0b3415e1a0 2024-04-25T09:11:35.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b33e00640 1 -- 172.21.15.173:0/1808956675 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c0a5c70 con 0x7f0b3415e1a0 2024-04-25T09:11:35.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b3a800640 1 -- 172.21.15.173:0/1808956675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b3415e1a0 msgr2=0x7f0b3415e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:35.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b3a800640 1 --2- 172.21.15.173:0/1808956675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b3415e1a0 0x7f0b3415e610 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f0b3406f6e0 tx=0x7f0b2c01c9f0 comp rx=0 tx=0).stop 2024-04-25T09:11:35.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b3a800640 1 -- 172.21.15.173:0/1808956675 shutdown_connections 2024-04-25T09:11:35.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b3a800640 1 --2- 172.21.15.173:0/1808956675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b3415e1a0 0x7f0b3415e610 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:35.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b3a800640 1 --2- 172.21.15.173:0/1808956675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b34151100 0x7f0b3415a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:35.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b3a800640 1 --2- 172.21.15.173:0/1808956675 >> v2:172.21.15.194:3300/0 conn(0x7f0b34150d20 0x7f0b340ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:35.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b3a800640 1 -- 172.21.15.173:0/1808956675 >> 172.21.15.173:0/1808956675 conn(0x7f0b34061d40 msgr2=0x7f0b3406ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:35.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b3a800640 1 -- 172.21.15.173:0/1808956675 shutdown_connections 2024-04-25T09:11:35.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b3a800640 1 -- 172.21.15.173:0/1808956675 wait complete. 2024-04-25T09:11:35.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b3a800640 1 Processor -- start 2024-04-25T09:11:35.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b3a800640 1 -- start start 2024-04-25T09:11:35.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b3a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b34150d20 0x7f0b340c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:35.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b3a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b34151100 0x7f0b34144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:35.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b3a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b3415e1a0 0x7f0b3414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:35.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b3a800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3406d420 con 0x7f0b3415e1a0 2024-04-25T09:11:35.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b3a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3406d2a0 con 0x7f0b34150d20 2024-04-25T09:11:35.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b3a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3406d5a0 con 0x7f0b34151100 2024-04-25T09:11:35.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b39e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b3415e1a0 0x7f0b3414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:35.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b39e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b3415e1a0 0x7f0b3414b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60306/0 (socket says 172.21.15.173:60306) 2024-04-25T09:11:35.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.894+0000 7f0b39e00640 1 -- 172.21.15.173:0/3173151106 learned_addr learned my addr 172.21.15.173:0/3173151106 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:35.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.898+0000 7f0b39400640 1 --2- 172.21.15.173:0/3173151106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b34150d20 0x7f0b340c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:35.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.898+0000 7f0b38a00640 1 --2- 172.21.15.173:0/3173151106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b34151100 0x7f0b34144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:35.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.898+0000 7f0b39e00640 1 -- 172.21.15.173:0/3173151106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b34151100 msgr2=0x7f0b34144cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:35.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.898+0000 7f0b39e00640 1 --2- 172.21.15.173:0/3173151106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b34151100 0x7f0b34144cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:35.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.898+0000 7f0b39e00640 1 -- 172.21.15.173:0/3173151106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b34150d20 msgr2=0x7f0b340c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:35.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.898+0000 7f0b39e00640 1 --2- 172.21.15.173:0/3173151106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b34150d20 0x7f0b340c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:35.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.898+0000 7f0b39e00640 1 -- 172.21.15.173:0/3173151106 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b340c55d0 con 0x7f0b3415e1a0 2024-04-25T09:11:35.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.898+0000 7f0b39e00640 1 --2- 172.21.15.173:0/3173151106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b3415e1a0 0x7f0b3414b2e0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c01d290 tx=0x7f0b2c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:35.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.898+0000 7f0b31600640 1 -- 172.21.15.173:0/3173151106 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c0bc020 con 0x7f0b3415e1a0 2024-04-25T09:11:35.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.898+0000 7f0b31600640 1 -- 172.21.15.173:0/3173151106 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2c007ab0 con 0x7f0b3415e1a0 2024-04-25T09:11:35.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.898+0000 7f0b31600640 1 -- 172.21.15.173:0/3173151106 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c0a5700 con 0x7f0b3415e1a0 2024-04-25T09:11:35.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.898+0000 7f0b3a800640 1 -- 172.21.15.173:0/3173151106 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3414cb30 con 0x7f0b3415e1a0 2024-04-25T09:11:35.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.898+0000 7f0b3a800640 1 -- 172.21.15.173:0/3173151106 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3414cdd0 con 0x7f0b3415e1a0 2024-04-25T09:11:35.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.898+0000 7f0b3a800640 1 -- 172.21.15.173:0/3173151106 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b34073a40 con 0x7f0b3415e1a0 2024-04-25T09:11:35.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.898+0000 7f0b31600640 1 -- 172.21.15.173:0/3173151106 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0b2c0bf020 con 0x7f0b3415e1a0 2024-04-25T09:11:35.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.898+0000 7f0b31600640 1 --2- 172.21.15.173:0/3173151106 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b14066f60 0x7f0b14069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:35.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.898+0000 7f0b31600640 1 -- 172.21.15.173:0/3173151106 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0b2c120420 con 0x7f0b3415e1a0 2024-04-25T09:11:35.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.902+0000 7f0b39400640 1 --2- 172.21.15.173:0/3173151106 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b14066f60 0x7f0b14069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:35.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.902+0000 7f0b39400640 1 --2- 172.21.15.173:0/3173151106 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b14066f60 0x7f0b14069420 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800ba30 tx=0x7f0b28008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:35.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:35.902+0000 7f0b31600640 1 -- 172.21.15.173:0/3173151106 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0b2c0c6030 con 0x7f0b3415e1a0 2024-04-25T09:11:36.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.114+0000 7f0b3a800640 1 -- 172.21.15.173:0/3173151106 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0b3406e7b0 con 0x7f0b3415e1a0 2024-04-25T09:11:36.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.118+0000 7f0b31600640 1 -- 172.21.15.173:0/3173151106 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0b2c0165e0 con 0x7f0b3415e1a0 2024-04-25T09:11:36.102 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2024-04-25T09:11:36.102 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w== 2024-04-25T09:11:36.102 INFO:teuthology.orchestra.run.smithi173.stdout: caps mds = "allow" 2024-04-25T09:11:36.102 INFO:teuthology.orchestra.run.smithi173.stdout: caps mon = "allow r" 2024-04-25T09:11:36.102 INFO:teuthology.orchestra.run.smithi173.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:11:36.102 INFO:teuthology.orchestra.run.smithi173.stderr:updated caps for client.0 2024-04-25T09:11:36.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.118+0000 7f0b3a800640 1 -- 172.21.15.173:0/3173151106 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b14066f60 msgr2=0x7f0b14069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:36.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.118+0000 7f0b3a800640 1 --2- 172.21.15.173:0/3173151106 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b14066f60 0x7f0b14069420 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800ba30 tx=0x7f0b28008040 comp rx=0 tx=0).stop 2024-04-25T09:11:36.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.118+0000 7f0b3a800640 1 -- 172.21.15.173:0/3173151106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b3415e1a0 msgr2=0x7f0b3414b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:36.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.118+0000 7f0b3a800640 1 --2- 172.21.15.173:0/3173151106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b3415e1a0 0x7f0b3414b2e0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c01d290 tx=0x7f0b2c019790 comp rx=0 tx=0).stop 2024-04-25T09:11:36.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.118+0000 7f0b3a800640 1 -- 172.21.15.173:0/3173151106 shutdown_connections 2024-04-25T09:11:36.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.118+0000 7f0b3a800640 1 --2- 172.21.15.173:0/3173151106 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b14066f60 0x7f0b14069420 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.118+0000 7f0b3a800640 1 --2- 172.21.15.173:0/3173151106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b3415e1a0 0x7f0b3414b2e0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.118+0000 7f0b3a800640 1 --2- 172.21.15.173:0/3173151106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b34151100 0x7f0b34144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.118+0000 7f0b3a800640 1 --2- 172.21.15.173:0/3173151106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b34150d20 0x7f0b340c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.118+0000 7f0b3a800640 1 -- 172.21.15.173:0/3173151106 >> 172.21.15.173:0/3173151106 conn(0x7f0b34061d40 msgr2=0x7f0b3415b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:36.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.118+0000 7f0b3a800640 1 -- 172.21.15.173:0/3173151106 shutdown_connections 2024-04-25T09:11:36.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.118+0000 7f0b3a800640 1 -- 172.21.15.173:0/3173151106 wait complete. 2024-04-25T09:11:36.123 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:36.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.274+0000 7f9f69600640 1 Processor -- start 2024-04-25T09:11:36.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.274+0000 7f9f69600640 1 -- start start 2024-04-25T09:11:36.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.274+0000 7f9f69600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9f640b3e70 0x7f9f640b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:36.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.274+0000 7f9f69600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f6415edd0 0x7f9f640b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:36.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.274+0000 7f9f69600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f640b4790 con 0x7f9f640aefa0 2024-04-25T09:11:36.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.274+0000 7f9f69600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f6406dd50 con 0x7f9f640b3e70 2024-04-25T09:11:36.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.274+0000 7f9f69600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6415f320 con 0x7f9f6415edd0 2024-04-25T09:11:36.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.274+0000 7f9f5a000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f9f640aefa0 0x7f9f640b2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54570/0 (socket says 172.21.15.173:54570) 2024-04-25T09:11:36.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.274+0000 7f9f5a000640 1 -- 172.21.15.173:0/2129952821 learned_addr learned my addr 172.21.15.173:0/2129952821 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:36.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f62a00640 1 --2- 172.21.15.173:0/2129952821 >> v2:172.21.15.194:3300/0 conn(0x7f9f640b3e70 0x7f9f640b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:36.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f63400640 1 --2- 172.21.15.173:0/2129952821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f6415edd0 0x7f9f640b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:36.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f62000640 1 -- 172.21.15.173:0/2129952821 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1457461797 0 0) 0x7f9f640b4790 con 0x7f9f640aefa0 2024-04-25T09:11:36.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f62000640 1 -- 172.21.15.173:0/2129952821 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f48005740 con 0x7f9f640aefa0 2024-04-25T09:11:36.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f62000640 1 -- 172.21.15.173:0/2129952821 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2935326892 0 0) 0x7f9f48005740 con 0x7f9f640aefa0 2024-04-25T09:11:36.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f62000640 1 -- 172.21.15.173:0/2129952821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f6415edd0 msgr2=0x7f9f640b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:36.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f62000640 1 --2- 172.21.15.173:0/2129952821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f6415edd0 0x7f9f640b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f62000640 1 -- 172.21.15.173:0/2129952821 >> v2:172.21.15.194:3300/0 conn(0x7f9f640b3e70 msgr2=0x7f9f640b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f62000640 1 --2- 172.21.15.173:0/2129952821 >> v2:172.21.15.194:3300/0 conn(0x7f9f640b3e70 0x7f9f640b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f62000640 1 -- 172.21.15.173:0/2129952821 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6406d420 con 0x7f9f640aefa0 2024-04-25T09:11:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f62000640 1 -- 172.21.15.173:0/2129952821 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f9f4c001680 con 0x7f9f640aefa0 2024-04-25T09:11:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f62000640 1 -- 172.21.15.173:0/2129952821 >> v1:172.21.15.173:6789/0 conn(0x7f9f640aefa0 legacy=0x7f9f640b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f62000640 1 --2- 172.21.15.173:0/2129952821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f48005bd0 0x7f9f48005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f62000640 1 --2- 172.21.15.173:0/2129952821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f48006a20 0x7f9f48006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f62000640 1 --2- 172.21.15.173:0/2129952821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f6415edd0 0x7f9f480073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f62000640 1 -- 172.21.15.173:0/2129952821 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6406dd50 con 0x7f9f48006a20 2024-04-25T09:11:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f62000640 1 -- 172.21.15.173:0/2129952821 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6415f320 con 0x7f9f48005bd0 2024-04-25T09:11:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f62000640 1 -- 172.21.15.173:0/2129952821 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4800dbe0 con 0x7f9f6415edd0 2024-04-25T09:11:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f5a000640 1 --2- 172.21.15.173:0/2129952821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f48006a20 0x7f9f48006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f62a00640 1 --2- 172.21.15.173:0/2129952821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f48005bd0 0x7f9f48005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f63400640 1 --2- 172.21.15.173:0/2129952821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f6415edd0 0x7f9f480073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f5a000640 1 -- 172.21.15.173:0/2129952821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f6415edd0 msgr2=0x7f9f480073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f5a000640 1 --2- 172.21.15.173:0/2129952821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f6415edd0 0x7f9f480073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f5a000640 1 -- 172.21.15.173:0/2129952821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f48005bd0 msgr2=0x7f9f48005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:36.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f5a000640 1 --2- 172.21.15.173:0/2129952821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f48005bd0 0x7f9f48005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f5a000640 1 -- 172.21.15.173:0/2129952821 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f48005740 con 0x7f9f48006a20 2024-04-25T09:11:36.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.278+0000 7f9f63400640 1 --2- 172.21.15.173:0/2129952821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f6415edd0 0x7f9f480073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:36.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f5a000640 1 --2- 172.21.15.173:0/2129952821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f48006a20 0x7f9f48006ea0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00c210 tx=0x7f9f4c01f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5b123deaaacacd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:36.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f62000640 1 -- 172.21.15.173:0/2129952821 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c007d60 con 0x7f9f48006a20 2024-04-25T09:11:36.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f62000640 1 -- 172.21.15.173:0/2129952821 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c005ae0 con 0x7f9f48006a20 2024-04-25T09:11:36.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f62000640 1 -- 172.21.15.173:0/2129952821 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c007070 con 0x7f9f48006a20 2024-04-25T09:11:36.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f69600640 1 -- 172.21.15.173:0/2129952821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f48006a20 msgr2=0x7f9f48006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:36.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f69600640 1 --2- 172.21.15.173:0/2129952821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f48006a20 0x7f9f48006ea0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00c210 tx=0x7f9f4c01f3f0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f63400640 1 -- 172.21.15.173:0/2129952821 reap_dead start 2024-04-25T09:11:36.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f69600640 1 -- 172.21.15.173:0/2129952821 shutdown_connections 2024-04-25T09:11:36.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f69600640 1 -- 172.21.15.173:0/2129952821 >> 172.21.15.173:0/2129952821 conn(0x7f9f6406ac90 msgr2=0x7f9f6406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:36.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f69600640 1 -- 172.21.15.173:0/2129952821 shutdown_connections 2024-04-25T09:11:36.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f69600640 1 -- 172.21.15.173:0/2129952821 wait complete. 2024-04-25T09:11:36.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f69600640 1 Processor -- start 2024-04-25T09:11:36.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f69600640 1 -- start start 2024-04-25T09:11:36.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f69600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f48006a20 0x7f9f64144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:36.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f69600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f64145350 0x7f9f64156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:36.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f69600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f641457d0 0x7f9f64156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:36.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f69600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f640ce7b0 con 0x7f9f64145350 2024-04-25T09:11:36.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f69600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6406d9e0 con 0x7f9f641457d0 2024-04-25T09:11:36.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f69600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6415aba0 con 0x7f9f48006a20 2024-04-25T09:11:36.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f5a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f64145350 0x7f9f64156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:36.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f5a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f64145350 0x7f9f64156900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60328/0 (socket says 172.21.15.173:60328) 2024-04-25T09:11:36.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.282+0000 7f9f5a000640 1 -- 172.21.15.173:0/34084248 learned_addr learned my addr 172.21.15.173:0/34084248 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:36.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.286+0000 7f9f62a00640 1 --2- 172.21.15.173:0/34084248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f48006a20 0x7f9f64144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:36.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.286+0000 7f9f63400640 1 --2- 172.21.15.173:0/34084248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f641457d0 0x7f9f64156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:36.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.286+0000 7f9f5a000640 1 -- 172.21.15.173:0/34084248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f48006a20 msgr2=0x7f9f64144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:36.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.286+0000 7f9f5a000640 1 --2- 172.21.15.173:0/34084248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f48006a20 0x7f9f64144a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.286+0000 7f9f5a000640 1 -- 172.21.15.173:0/34084248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f641457d0 msgr2=0x7f9f64156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:36.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.286+0000 7f9f5a000640 1 --2- 172.21.15.173:0/34084248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f641457d0 0x7f9f64156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.286+0000 7f9f5a000640 1 -- 172.21.15.173:0/34084248 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f640aca60 con 0x7f9f64145350 2024-04-25T09:11:36.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.286+0000 7f9f5a000640 1 --2- 172.21.15.173:0/34084248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f64145350 0x7f9f64156900 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c000fc0 tx=0x7f9f48007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:36.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.286+0000 7f9f5b400640 1 -- 172.21.15.173:0/34084248 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c005c90 con 0x7f9f64145350 2024-04-25T09:11:36.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.286+0000 7f9f5b400640 1 -- 172.21.15.173:0/34084248 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c005e30 con 0x7f9f64145350 2024-04-25T09:11:36.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.286+0000 7f9f5b400640 1 -- 172.21.15.173:0/34084248 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c0049f0 con 0x7f9f64145350 2024-04-25T09:11:36.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.286+0000 7f9f69600640 1 -- 172.21.15.173:0/34084248 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f640acd40 con 0x7f9f64145350 2024-04-25T09:11:36.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.286+0000 7f9f69600640 1 -- 172.21.15.173:0/34084248 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f64144f80 con 0x7f9f64145350 2024-04-25T09:11:36.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.286+0000 7f9f69600640 1 -- 172.21.15.173:0/34084248 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f64073a40 con 0x7f9f64145350 2024-04-25T09:11:36.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.286+0000 7f9f5b400640 1 -- 172.21.15.173:0/34084248 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9f4c004b90 con 0x7f9f64145350 2024-04-25T09:11:36.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.286+0000 7f9f5b400640 1 --2- 172.21.15.173:0/34084248 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9f40066f90 0x7f9f40069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:36.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.286+0000 7f9f5b400640 1 -- 172.21.15.173:0/34084248 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9f4c121c20 con 0x7f9f64145350 2024-04-25T09:11:36.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.290+0000 7f9f62a00640 1 --2- 172.21.15.173:0/34084248 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9f40066f90 0x7f9f40069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:36.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.290+0000 7f9f62a00640 1 --2- 172.21.15.173:0/34084248 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9f40066f90 0x7f9f40069450 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009b60 tx=0x7f9f54009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:36.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.294+0000 7f9f5b400640 1 -- 172.21.15.173:0/34084248 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9f4c0c1070 con 0x7f9f64145350 2024-04-25T09:11:36.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.478+0000 7f9f69600640 1 -- 172.21.15.173:0/34084248 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f6406e540 con 0x7f9f64145350 2024-04-25T09:11:36.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.482+0000 7f9f5b400640 1 -- 172.21.15.173:0/34084248 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f9f4c019100 con 0x7f9f64145350 2024-04-25T09:11:36.466 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:36.466 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1021410995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1021410995},{"type":"v1","addr":"172.21.15.194:6834","nonce":1021410995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2198134208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2198134208},{"type":"v1","addr":"172.21.15.194:6835","nonce":2198134208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8772,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/684989574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":684989574},{"type":"v1","addr":"172.21.15.173:6836","nonce":684989574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:26.148874+0000","modified":"2024-04-25T09:11:29.164422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8775":{"gid":8775,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/671971539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":671971539},{"type":"v1","addr":"172.21.15.173:6837","nonce":671971539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:11:36.466 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 81 2024-04-25T09:11:36.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.482+0000 7f9f69600640 1 -- 172.21.15.173:0/34084248 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9f40066f90 msgr2=0x7f9f40069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:36.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.482+0000 7f9f69600640 1 --2- 172.21.15.173:0/34084248 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9f40066f90 0x7f9f40069450 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009b60 tx=0x7f9f54009190 comp rx=0 tx=0).stop 2024-04-25T09:11:36.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.482+0000 7f9f69600640 1 -- 172.21.15.173:0/34084248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f64145350 msgr2=0x7f9f64156900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:36.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.482+0000 7f9f69600640 1 --2- 172.21.15.173:0/34084248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f64145350 0x7f9f64156900 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c000fc0 tx=0x7f9f48007a50 comp rx=0 tx=0).stop 2024-04-25T09:11:36.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.482+0000 7f9f69600640 1 -- 172.21.15.173:0/34084248 shutdown_connections 2024-04-25T09:11:36.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.482+0000 7f9f69600640 1 --2- 172.21.15.173:0/34084248 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9f40066f90 0x7f9f40069450 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.482+0000 7f9f69600640 1 --2- 172.21.15.173:0/34084248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f641457d0 0x7f9f64156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.482+0000 7f9f69600640 1 --2- 172.21.15.173:0/34084248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f64145350 0x7f9f64156900 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.482+0000 7f9f69600640 1 --2- 172.21.15.173:0/34084248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f48006a20 0x7f9f64144a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.482+0000 7f9f69600640 1 -- 172.21.15.173:0/34084248 >> 172.21.15.173:0/34084248 conn(0x7f9f6406ac90 msgr2=0x7f9f640cf270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:36.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.482+0000 7f9f69600640 1 -- 172.21.15.173:0/34084248 shutdown_connections 2024-04-25T09:11:36.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:36.482+0000 7f9f69600640 1 -- 172.21.15.173:0/34084248 wait complete. 2024-04-25T09:11:36.889 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 81, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:11:26.148874+0000', 'modified': '2024-04-25T09:11:29.164422+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8775}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8775': {'gid': 8775, 'name': 'c', 'rank': 0, 'incarnation': 77, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.173:6837/671971539', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6835', 'nonce': 671971539}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 671971539}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:11:36.890 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:11:36.890 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:11:37.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.042+0000 7f757b400640 1 Processor -- start 2024-04-25T09:11:37.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.042+0000 7f757b400640 1 -- start start 2024-04-25T09:11:37.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.042+0000 7f757b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7574145290 0x7f757415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.042+0000 7f757b400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757415c5f0 con 0x7f75740cc260 2024-04-25T09:11:37.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.042+0000 7f757b400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757406d4b0 con 0x7f75740b3fe0 2024-04-25T09:11:37.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.042+0000 7f757b400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75740ccd80 con 0x7f7574145290 2024-04-25T09:11:37.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.046+0000 7f7578a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7574145290 0x7f757415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.046+0000 7f7578a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7574145290 0x7f757415c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60338/0 (socket says 172.21.15.173:60338) 2024-04-25T09:11:37.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.046+0000 7f7579400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f75740cc260 0x7f75740cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:54586/0 (socket says 172.21.15.173:54586) 2024-04-25T09:11:37.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.046+0000 7f7578a00640 1 -- 172.21.15.173:0/4291089311 learned_addr learned my addr 172.21.15.173:0/4291089311 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:37.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.046+0000 7f7578a00640 1 -- 172.21.15.173:0/4291089311 >> v1:172.21.15.194:6789/0 conn(0x7f75740b3fe0 legacy=0x7f75740b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.046+0000 7f7578a00640 1 -- 172.21.15.173:0/4291089311 >> v1:172.21.15.173:6789/0 conn(0x7f75740cc260 legacy=0x7f75740cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.046+0000 7f7578a00640 1 -- 172.21.15.173:0/4291089311 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757406d790 con 0x7f7574145290 2024-04-25T09:11:37.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.046+0000 7f7578a00640 1 --2- 172.21.15.173:0/4291089311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7574145290 0x7f757415c0b0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f7564009870 tx=0x7f756401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6919d01b96f5ee80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.046+0000 7f7573e00640 1 -- 172.21.15.173:0/4291089311 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75640b0070 con 0x7f7574145290 2024-04-25T09:11:37.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.046+0000 7f7573e00640 1 -- 172.21.15.173:0/4291089311 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7564004230 con 0x7f7574145290 2024-04-25T09:11:37.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.046+0000 7f7573e00640 1 -- 172.21.15.173:0/4291089311 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7564003620 con 0x7f7574145290 2024-04-25T09:11:37.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f757b400640 1 -- 172.21.15.173:0/4291089311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7574145290 msgr2=0x7f757415c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f757b400640 1 --2- 172.21.15.173:0/4291089311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7574145290 0x7f757415c0b0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f7564009870 tx=0x7f756401c440 comp rx=0 tx=0).stop 2024-04-25T09:11:37.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f757b400640 1 -- 172.21.15.173:0/4291089311 shutdown_connections 2024-04-25T09:11:37.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f757b400640 1 --2- 172.21.15.173:0/4291089311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7574145290 0x7f757415c0b0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f757b400640 1 -- 172.21.15.173:0/4291089311 >> 172.21.15.173:0/4291089311 conn(0x7f757406ac90 msgr2=0x7f757406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:37.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f757b400640 1 -- 172.21.15.173:0/4291089311 shutdown_connections 2024-04-25T09:11:37.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f757b400640 1 -- 172.21.15.173:0/4291089311 wait complete. 2024-04-25T09:11:37.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f757b400640 1 Processor -- start 2024-04-25T09:11:37.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f757b400640 1 -- start start 2024-04-25T09:11:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f757b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75740b3fe0 0x7f7574142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f757b400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75740cc260 0x7f757413c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f757b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7574145290 0x7f757415c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f757b400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757406eee0 con 0x7f75740b3fe0 2024-04-25T09:11:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f757b400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757406ed60 con 0x7f7574145290 2024-04-25T09:11:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f757b400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757406f060 con 0x7f75740cc260 2024-04-25T09:11:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f7578a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75740b3fe0 0x7f7574142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f7578a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75740b3fe0 0x7f7574142c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60340/0 (socket says 172.21.15.173:60340) 2024-04-25T09:11:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f7578a00640 1 -- 172.21.15.173:0/2970822119 learned_addr learned my addr 172.21.15.173:0/2970822119 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f7578a00640 1 -- 172.21.15.173:0/2970822119 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75740cc260 msgr2=0x7f757413c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f7578a00640 1 --2- 172.21.15.173:0/2970822119 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75740cc260 0x7f757413c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f7578a00640 1 -- 172.21.15.173:0/2970822119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7574145290 msgr2=0x7f757415c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f7578a00640 1 --2- 172.21.15.173:0/2970822119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7574145290 0x7f757415c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f7578a00640 1 -- 172.21.15.173:0/2970822119 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7574141b60 con 0x7f75740b3fe0 2024-04-25T09:11:37.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f7578a00640 1 --2- 172.21.15.173:0/2970822119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75740b3fe0 0x7f7574142c00 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f756401a070 tx=0x7f75640191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.050+0000 7f7571600640 1 -- 172.21.15.173:0/2970822119 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75640bb070 con 0x7f75740b3fe0 2024-04-25T09:11:37.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.054+0000 7f7571600640 1 -- 172.21.15.173:0/2970822119 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75640043e0 con 0x7f75740b3fe0 2024-04-25T09:11:37.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.054+0000 7f757b400640 1 -- 172.21.15.173:0/2970822119 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7574141e40 con 0x7f75740b3fe0 2024-04-25T09:11:37.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.054+0000 7f7571600640 1 -- 172.21.15.173:0/2970822119 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75640b0040 con 0x7f75740b3fe0 2024-04-25T09:11:37.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.054+0000 7f757b400640 1 -- 172.21.15.173:0/2970822119 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7574142400 con 0x7f75740b3fe0 2024-04-25T09:11:37.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.054+0000 7f7571600640 1 -- 172.21.15.173:0/2970822119 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f75640ab440 con 0x7f75740b3fe0 2024-04-25T09:11:37.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.054+0000 7f7571600640 1 --2- 172.21.15.173:0/2970822119 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7550066f60 0x7f7550069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.054+0000 7f7571600640 1 -- 172.21.15.173:0/2970822119 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f756411eab0 con 0x7f75740b3fe0 2024-04-25T09:11:37.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.054+0000 7f756be00640 1 --2- 172.21.15.173:0/2970822119 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7550066f60 0x7f7550069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.054+0000 7f757e98e000 1 Processor -- start 2024-04-25T09:11:37.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.054+0000 7f757e98e000 1 -- start start 2024-04-25T09:11:37.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.054+0000 7f756be00640 1 --2- 172.21.15.173:0/2970822119 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7550066f60 0x7f7550069420 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f755c000f70 tx=0x7f755c0079e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f757e98e000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 0x559906608d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f757e98e000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906609240 0x5599065be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f757e98e000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599065bef30 0x5599065bf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f757e98e000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599064a65f0 con 0x559906608920 2024-04-25T09:11:37.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f757e98e000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990640dda0 con 0x5599065bef30 2024-04-25T09:11:37.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f757e98e000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x559906396150 con 0x559906609240 2024-04-25T09:11:37.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f7578a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 0x559906608d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f7578a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 0x559906608d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60354/0 (socket says 172.21.15.173:60354) 2024-04-25T09:11:37.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f7578a00640 1 -- 172.21.15.173:0/1248358367 learned_addr learned my addr 172.21.15.173:0/1248358367 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:37.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f7579400640 1 --2- 172.21.15.173:0/1248358367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599065bef30 0x5599065bf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f756be00640 1 --2- 172.21.15.173:0/1248358367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906609240 0x5599065be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f7578a00640 1 -- 172.21.15.173:0/1248358367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906609240 msgr2=0x5599065be9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f7578a00640 1 --2- 172.21.15.173:0/1248358367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906609240 0x5599065be9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f7578a00640 1 -- 172.21.15.173:0/1248358367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599065bef30 msgr2=0x5599065bf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f7578a00640 1 --2- 172.21.15.173:0/1248358367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599065bef30 0x5599065bf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f7578a00640 1 -- 172.21.15.173:0/1248358367 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599063afca0 con 0x559906608920 2024-04-25T09:11:37.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f756be00640 1 --2- 172.21.15.173:0/1248358367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906609240 0x5599065be9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:37.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f7578a00640 1 --2- 172.21.15.173:0/1248358367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 0x559906608d00 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f75640eee90 tx=0x7f75640eee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c7d130d7d1a2d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f7569600640 1 -- 172.21.15.173:0/1248358367 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756411b070 con 0x559906608920 2024-04-25T09:11:37.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f7569600640 1 -- 172.21.15.173:0/1248358367 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75640f32e0 con 0x559906608920 2024-04-25T09:11:37.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f7569600640 1 -- 172.21.15.173:0/1248358367 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75640f78a0 con 0x559906608920 2024-04-25T09:11:37.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f757e98e000 1 -- 172.21.15.173:0/1248358367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 msgr2=0x559906608d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f757e98e000 1 --2- 172.21.15.173:0/1248358367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 0x559906608d00 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f75640eee90 tx=0x7f75640eee00 comp rx=0 tx=0).stop 2024-04-25T09:11:37.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f757e98e000 1 -- 172.21.15.173:0/1248358367 shutdown_connections 2024-04-25T09:11:37.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f757e98e000 1 --2- 172.21.15.173:0/1248358367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599065bef30 0x5599065bf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f757e98e000 1 --2- 172.21.15.173:0/1248358367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906609240 0x5599065be9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f757e98e000 1 --2- 172.21.15.173:0/1248358367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 0x559906608d00 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f757e98e000 1 -- 172.21.15.173:0/1248358367 >> 172.21.15.173:0/1248358367 conn(0x5599065c52a0 msgr2=0x5599065bd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:37.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f757e98e000 1 -- 172.21.15.173:0/1248358367 shutdown_connections 2024-04-25T09:11:37.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f757e98e000 1 -- 172.21.15.173:0/1248358367 wait complete. 2024-04-25T09:11:37.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f757e98e000 1 -- start start 2024-04-25T09:11:37.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.058+0000 7f757e98e000 1 Processor -- start 2024-04-25T09:11:37.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599065bef30 0x55990660fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906608920 0x5599066101c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559906609240 0x5599065c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599063c8990 con 0x5599065bef30 2024-04-25T09:11:37.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559906409e40 con 0x559906609240 2024-04-25T09:11:37.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x559906399900 con 0x559906608920 2024-04-25T09:11:37.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 10 client.0 _ll_register_callbacks cb 0x5599064c11c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:37.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7578a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599065bef30 0x55990660fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7578a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599065bef30 0x55990660fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60370/0 (socket says 172.21.15.173:60370) 2024-04-25T09:11:37.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7578a00640 1 -- 172.21.15.173:0/3962288949 learned_addr learned my addr 172.21.15.173:0/3962288949 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:37.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f756be00640 1 --2- 172.21.15.173:0/3962288949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906608920 0x5599066101c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7579400640 1 --2- 172.21.15.173:0/3962288949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559906609240 0x5599065c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7578a00640 1 -- 172.21.15.173:0/3962288949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906608920 msgr2=0x5599066101c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7578a00640 1 --2- 172.21.15.173:0/3962288949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906608920 0x5599066101c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7578a00640 1 -- 172.21.15.173:0/3962288949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559906609240 msgr2=0x5599065c2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7578a00640 1 --2- 172.21.15.173:0/3962288949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559906609240 0x5599065c2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7578a00640 1 -- 172.21.15.173:0/3962288949 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599063c6630 con 0x5599065bef30 2024-04-25T09:11:37.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f756be00640 1 --2- 172.21.15.173:0/3962288949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906608920 0x5599066101c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:37.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7579400640 1 --2- 172.21.15.173:0/3962288949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559906609240 0x5599065c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:37.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7578a00640 1 --2- 172.21.15.173:0/3962288949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599065bef30 0x55990660fc80 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f75640eee90 tx=0x7f7564009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8623289ac425647 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7562000640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:11:37.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7562000640 1 -- 172.21.15.173:0/3962288949 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756411b040 con 0x5599065bef30 2024-04-25T09:11:37.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7562000640 1 -- 172.21.15.173:0/3962288949 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f75640ef3f0 con 0x5599065bef30 2024-04-25T09:11:37.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 -- 172.21.15.173:0/3962288949 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f75640f32e0 con 0x5599065bef30 2024-04-25T09:11:37.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7562000640 1 -- 172.21.15.173:0/3962288949 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75640f78a0 con 0x5599065bef30 2024-04-25T09:11:37.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 10 client.8940 fetch_fsmap learned FSMap version 81 2024-04-25T09:11:37.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 -- 172.21.15.173:0/3962288949 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x5599063963a0 con 0x5599065bef30 2024-04-25T09:11:37.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7562000640 1 -- 172.21.15.173:0/3962288949 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75640f32e0 con 0x5599065bef30 2024-04-25T09:11:37.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7562000640 1 -- 172.21.15.173:0/3962288949 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 81) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f75640b3070 con 0x5599065bef30 2024-04-25T09:11:37.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 10 client.8940 fetch_fsmap finished waiting for FSMap version 81 2024-04-25T09:11:37.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 10 client.8940 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:11:37.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 20 client.8940 populate_metadata read hostname 'smithi173' 2024-04-25T09:11:37.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 --2- 172.21.15.173:0/3962288949 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x5599065c34b0 0x5599065c3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 4 client.8940 mds_command: new command op to 8775 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:11:37.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 -- 172.21.15.173:0/3962288949 --> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5599063a9a50 con 0x5599065c34b0 2024-04-25T09:11:37.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f756be00640 1 --2- 172.21.15.173:0/3962288949 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x5599065c34b0 0x5599065c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7562000640 10 client.8940 ms_handle_connect on v2:172.21.15.173:6835/671971539 2024-04-25T09:11:37.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f756be00640 1 --2- 172.21.15.173:0/3962288949 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x5599065c34b0 0x5599065c3890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7443bec4463571ce server_cookie=b2e302945ff3811c in_seq=0 out_seq=0 2024-04-25T09:11:37.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7562000640 1 -- 172.21.15.173:0/3962288949 <== mds.0 v2:172.21.15.173:6835/671971539 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5599063a9a50 con 0x5599065c34b0 2024-04-25T09:11:37.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7562000640 10 client.8940 handle_command_reply: tid=0 2024-04-25T09:11:37.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 client.8940 shutdown 2024-04-25T09:11:37.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 -- 172.21.15.173:0/3962288949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599065bef30 msgr2=0x55990660fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 --2- 172.21.15.173:0/3962288949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599065bef30 0x55990660fc80 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f75640eee90 tx=0x7f7564009220 comp rx=0 tx=0).stop 2024-04-25T09:11:37.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 -- 172.21.15.173:0/3962288949 shutdown_connections 2024-04-25T09:11:37.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 --2- 172.21.15.173:0/3962288949 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x5599065c34b0 0x5599065c3890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 --2- 172.21.15.173:0/3962288949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559906609240 0x5599065c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 --2- 172.21.15.173:0/3962288949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906608920 0x5599066101c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 --2- 172.21.15.173:0/3962288949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599065bef30 0x55990660fc80 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f7562000640 0 client.8940 ms_handle_reset on v2:172.21.15.173:6835/671971539 2024-04-25T09:11:37.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 -- 172.21.15.173:0/3962288949 >> 172.21.15.173:0/3962288949 conn(0x5599065c52a0 msgr2=0x5599065bd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:37.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.062+0000 7f757e98e000 1 -- 172.21.15.173:0/3962288949 shutdown_connections 2024-04-25T09:11:37.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.066+0000 7f757e98e000 1 -- 172.21.15.173:0/3962288949 wait complete. 2024-04-25T09:11:37.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.066+0000 7f757e98e000 20 client.8940 trim_cache size 0 max 16384 2024-04-25T09:11:37.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.078+0000 7f757e98e000 1 Processor -- start 2024-04-25T09:11:37.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.078+0000 7f757e98e000 1 -- start start 2024-04-25T09:11:37.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599065bef30 0x5599065c22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 0x5599065c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906609240 0x5599066128b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7574202820 con 0x559906608920 2024-04-25T09:11:37.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75741416f0 con 0x5599065bef30 2024-04-25T09:11:37.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7574202220 con 0x559906609240 2024-04-25T09:11:37.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f756be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 0x5599065c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f756be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 0x5599065c2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60382/0 (socket says 172.21.15.173:60382) 2024-04-25T09:11:37.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f756be00640 1 -- 172.21.15.173:0/1347129462 learned_addr learned my addr 172.21.15.173:0/1347129462 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:37.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f756be00640 1 -- 172.21.15.173:0/1347129462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906609240 msgr2=0x5599066128b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f756be00640 1 --2- 172.21.15.173:0/1347129462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906609240 0x5599066128b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f756be00640 1 -- 172.21.15.173:0/1347129462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599065bef30 msgr2=0x5599065c22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f756be00640 1 --2- 172.21.15.173:0/1347129462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599065bef30 0x5599065c22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f756be00640 1 -- 172.21.15.173:0/1347129462 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559906609070 con 0x559906608920 2024-04-25T09:11:37.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f756be00640 1 --2- 172.21.15.173:0/1347129462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 0x5599065c2800 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x5599063ae380 tx=0x7f755c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b818d16bea6f21c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f7568c00640 1 -- 172.21.15.173:0/1347129462 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c023460 con 0x559906608920 2024-04-25T09:11:37.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f7568c00640 1 -- 172.21.15.173:0/1347129462 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c023600 con 0x559906608920 2024-04-25T09:11:37.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f7568c00640 1 -- 172.21.15.173:0/1347129462 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c0148f0 con 0x559906608920 2024-04-25T09:11:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 -- 172.21.15.173:0/1347129462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 msgr2=0x5599065c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 --2- 172.21.15.173:0/1347129462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 0x5599065c2800 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x5599063ae380 tx=0x7f755c012000 comp rx=0 tx=0).stop 2024-04-25T09:11:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 -- 172.21.15.173:0/1347129462 shutdown_connections 2024-04-25T09:11:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 --2- 172.21.15.173:0/1347129462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906609240 0x5599066128b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 --2- 172.21.15.173:0/1347129462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 0x5599065c2800 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 --2- 172.21.15.173:0/1347129462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599065bef30 0x5599065c22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 -- 172.21.15.173:0/1347129462 >> 172.21.15.173:0/1347129462 conn(0x5599065c52a0 msgr2=0x5599065c1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 -- 172.21.15.173:0/1347129462 shutdown_connections 2024-04-25T09:11:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 -- 172.21.15.173:0/1347129462 wait complete. 2024-04-25T09:11:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 -- start start 2024-04-25T09:11:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 Processor -- start 2024-04-25T09:11:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599065bef30 0x559906668860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 0x5599066154e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906609240 0x559906615a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599064123d0 con 0x559906608920 2024-04-25T09:11:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599064c9d50 con 0x5599065bef30 2024-04-25T09:11:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599063a8980 con 0x559906609240 2024-04-25T09:11:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f757e98e000 10 client.0 _ll_register_callbacks cb 0x7f75640069b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f756be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 0x5599066154e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f756be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 0x5599066154e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60386/0 (socket says 172.21.15.173:60386) 2024-04-25T09:11:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f756be00640 1 -- 172.21.15.173:0/1849570175 learned_addr learned my addr 172.21.15.173:0/1849570175 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f7578a00640 1 --2- 172.21.15.173:0/1849570175 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599065bef30 0x559906668860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.082+0000 7f7579400640 1 --2- 172.21.15.173:0/1849570175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906609240 0x559906615a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f756be00640 1 -- 172.21.15.173:0/1849570175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906609240 msgr2=0x559906615a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f756be00640 1 --2- 172.21.15.173:0/1849570175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906609240 0x559906615a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f756be00640 1 -- 172.21.15.173:0/1849570175 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599065bef30 msgr2=0x559906668860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f756be00640 1 --2- 172.21.15.173:0/1849570175 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599065bef30 0x559906668860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f756be00640 1 -- 172.21.15.173:0/1849570175 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55990648f600 con 0x559906608920 2024-04-25T09:11:37.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f7579400640 1 --2- 172.21.15.173:0/1849570175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906609240 0x559906615a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:37.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f756be00640 1 --2- 172.21.15.173:0/1849570175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 0x5599066154e0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f757415baa0 tx=0x7f755c001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfcc2d8a2c8e255 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f7562000640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:11:37.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f7562000640 1 -- 172.21.15.173:0/1849570175 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c036030 con 0x559906608920 2024-04-25T09:11:37.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f7562000640 1 -- 172.21.15.173:0/1849570175 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f755c034950 con 0x559906608920 2024-04-25T09:11:37.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 1 -- 172.21.15.173:0/1849570175 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f755c023600 con 0x559906608920 2024-04-25T09:11:37.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f7562000640 1 -- 172.21.15.173:0/1849570175 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f755c034b50 con 0x559906608920 2024-04-25T09:11:37.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 10 client.8946 fetch_fsmap learned FSMap version 81 2024-04-25T09:11:37.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 1 -- 172.21.15.173:0/1849570175 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x5599063a29b0 con 0x559906608920 2024-04-25T09:11:37.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f7562000640 1 -- 172.21.15.173:0/1849570175 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c023600 con 0x559906608920 2024-04-25T09:11:37.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f7562000640 1 -- 172.21.15.173:0/1849570175 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 81) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f755c014870 con 0x559906608920 2024-04-25T09:11:37.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 10 client.8946 fetch_fsmap finished waiting for FSMap version 81 2024-04-25T09:11:37.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 10 client.8946 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:11:37.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 20 client.8946 populate_metadata read hostname 'smithi173' 2024-04-25T09:11:37.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 1 --2- 172.21.15.173:0/1849570175 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x559906624330 0x559906624710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 4 client.8946 mds_command: new command op to 8775 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:11:37.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 1 -- 172.21.15.173:0/1849570175 --> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55990641b2e0 con 0x559906624330 2024-04-25T09:11:37.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f7578a00640 1 --2- 172.21.15.173:0/1849570175 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x559906624330 0x559906624710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f7562000640 10 client.8946 ms_handle_connect on v2:172.21.15.173:6835/671971539 2024-04-25T09:11:37.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f7578a00640 1 --2- 172.21.15.173:0/1849570175 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x559906624330 0x559906624710 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cfc0e795c46c831 server_cookie=ba5a1d507b0f771c in_seq=0 out_seq=0 2024-04-25T09:11:37.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f7562000640 1 -- 172.21.15.173:0/1849570175 <== mds.0 v2:172.21.15.173:6835/671971539 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55990641b2e0 con 0x559906624330 2024-04-25T09:11:37.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f7562000640 10 client.8946 handle_command_reply: tid=0 2024-04-25T09:11:37.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 1 client.8946 shutdown 2024-04-25T09:11:37.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 1 -- 172.21.15.173:0/1849570175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 msgr2=0x5599066154e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 1 --2- 172.21.15.173:0/1849570175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 0x5599066154e0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f757415baa0 tx=0x7f755c001090 comp rx=0 tx=0).stop 2024-04-25T09:11:37.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 1 -- 172.21.15.173:0/1849570175 shutdown_connections 2024-04-25T09:11:37.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 1 --2- 172.21.15.173:0/1849570175 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x559906624330 0x559906624710 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 1 --2- 172.21.15.173:0/1849570175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559906609240 0x559906615a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 1 --2- 172.21.15.173:0/1849570175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559906608920 0x5599066154e0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 1 --2- 172.21.15.173:0/1849570175 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599065bef30 0x559906668860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f7562000640 0 client.8946 ms_handle_reset on v2:172.21.15.173:6835/671971539 2024-04-25T09:11:37.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 1 -- 172.21.15.173:0/1849570175 >> 172.21.15.173:0/1849570175 conn(0x5599065c52a0 msgr2=0x5599065f4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:37.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 1 -- 172.21.15.173:0/1849570175 shutdown_connections 2024-04-25T09:11:37.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 1 -- 172.21.15.173:0/1849570175 wait complete. 2024-04-25T09:11:37.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757e98e000 20 client.8946 trim_cache size 0 max 16384 2024-04-25T09:11:37.076 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:11:37.076 INFO:teuthology.orchestra.run.smithi173.stdout: "cluster_fsid": "ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6", 2024-04-25T09:11:37.077 INFO:teuthology.orchestra.run.smithi173.stdout: "whoami": 0, 2024-04-25T09:11:37.077 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 8775, 2024-04-25T09:11:37.077 INFO:teuthology.orchestra.run.smithi173.stdout: "want_state": "up:active", 2024-04-25T09:11:37.077 INFO:teuthology.orchestra.run.smithi173.stdout: "state": "up:active", 2024-04-25T09:11:37.077 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs", 2024-04-25T09:11:37.077 INFO:teuthology.orchestra.run.smithi173.stdout: "rank_uptime": 10.324622938999999, 2024-04-25T09:11:37.077 INFO:teuthology.orchestra.run.smithi173.stdout: "mdsmap_epoch": 81, 2024-04-25T09:11:37.077 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch": 122, 2024-04-25T09:11:37.077 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch_barrier": 122, 2024-04-25T09:11:37.077 INFO:teuthology.orchestra.run.smithi173.stdout: "uptime": 15.211738928000001 2024-04-25T09:11:37.077 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:11:37.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757b400640 1 -- 172.21.15.173:0/2970822119 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7550066f60 msgr2=0x7f7550069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757b400640 1 --2- 172.21.15.173:0/2970822119 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7550066f60 0x7f7550069420 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f755c000f70 tx=0x7f755c0079e0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757b400640 1 -- 172.21.15.173:0/2970822119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75740b3fe0 msgr2=0x7f7574142c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757b400640 1 --2- 172.21.15.173:0/2970822119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75740b3fe0 0x7f7574142c00 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f756401a070 tx=0x7f75640191e0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757b400640 1 -- 172.21.15.173:0/2970822119 shutdown_connections 2024-04-25T09:11:37.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757b400640 1 --2- 172.21.15.173:0/2970822119 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7550066f60 0x7f7550069420 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757b400640 1 --2- 172.21.15.173:0/2970822119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7574145290 0x7f757415c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757b400640 1 --2- 172.21.15.173:0/2970822119 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75740cc260 0x7f757413c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757b400640 1 --2- 172.21.15.173:0/2970822119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75740b3fe0 0x7f7574142c00 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757b400640 1 -- 172.21.15.173:0/2970822119 >> 172.21.15.173:0/2970822119 conn(0x7f757406ac90 msgr2=0x7f75740cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:37.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757b400640 1 -- 172.21.15.173:0/2970822119 shutdown_connections 2024-04-25T09:11:37.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.086+0000 7f757b400640 1 -- 172.21.15.173:0/2970822119 wait complete. 2024-04-25T09:11:37.091 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:11:37.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.242+0000 7f249ac00640 1 Processor -- start 2024-04-25T09:11:37.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.242+0000 7f249ac00640 1 -- start start 2024-04-25T09:11:37.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.242+0000 7f249ac00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24940b3e70 0x7f24940b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.246+0000 7f249ac00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f249415edd0 0x7f24940b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.246+0000 7f249ac00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24940b4790 con 0x7f24940aefa0 2024-04-25T09:11:37.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.246+0000 7f249ac00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f249406dd50 con 0x7f249415edd0 2024-04-25T09:11:37.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.246+0000 7f249ac00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249415f320 con 0x7f24940b3e70 2024-04-25T09:11:37.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.246+0000 7f2498c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f249415edd0 0x7f24940b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.246+0000 7f2493e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24940b3e70 0x7f24940b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.246+0000 7f2498c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f249415edd0 0x7f24940b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:57642/0 (socket says 172.21.15.173:57642) 2024-04-25T09:11:37.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.246+0000 7f2493e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24940b3e70 0x7f24940b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:34428/0 (socket says 172.21.15.173:34428) 2024-04-25T09:11:37.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.246+0000 7f2498c00640 1 -- 172.21.15.173:0/2965405172 learned_addr learned my addr 172.21.15.173:0/2965405172 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:37.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.246+0000 7f2493400640 1 --1- 172.21.15.173:0/2965405172 >> v1:172.21.15.194:6789/0 conn(0x7f24940aefa0 0x7f24940b2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:60188/0 (socket says 172.21.15.173:60188) 2024-04-25T09:11:37.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.246+0000 7f2498c00640 1 -- 172.21.15.173:0/2965405172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24940b3e70 msgr2=0x7f24940b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.246+0000 7f2498c00640 1 --2- 172.21.15.173:0/2965405172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24940b3e70 0x7f24940b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.246+0000 7f2498c00640 1 -- 172.21.15.173:0/2965405172 >> v1:172.21.15.194:6789/0 conn(0x7f24940aefa0 legacy=0x7f24940b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.246+0000 7f2498c00640 1 -- 172.21.15.173:0/2965405172 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249406d420 con 0x7f249415edd0 2024-04-25T09:11:37.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.246+0000 7f2493e00640 1 --2- 172.21.15.173:0/2965405172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24940b3e70 0x7f24940b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:37.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.246+0000 7f2498c00640 1 --2- 172.21.15.173:0/2965405172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f249415edd0 0x7f24940b2e80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f248c009e50 tx=0x7f248c01ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0ca7f9c39d879a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f2492a00640 1 -- 172.21.15.173:0/2965405172 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c0a58f0 con 0x7f249415edd0 2024-04-25T09:11:37.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f2492a00640 1 -- 172.21.15.173:0/2965405172 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248c0a5a90 con 0x7f249415edd0 2024-04-25T09:11:37.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f2492a00640 1 -- 172.21.15.173:0/2965405172 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c0a5e60 con 0x7f249415edd0 2024-04-25T09:11:37.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f249ac00640 1 -- 172.21.15.173:0/2965405172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f249415edd0 msgr2=0x7f24940b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f249ac00640 1 --2- 172.21.15.173:0/2965405172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f249415edd0 0x7f24940b2e80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f248c009e50 tx=0x7f248c01ca00 comp rx=0 tx=0).stop 2024-04-25T09:11:37.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f249ac00640 1 -- 172.21.15.173:0/2965405172 shutdown_connections 2024-04-25T09:11:37.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f249ac00640 1 --2- 172.21.15.173:0/2965405172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f249415edd0 0x7f24940b2e80 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f249ac00640 1 --2- 172.21.15.173:0/2965405172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24940b3e70 0x7f24940b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f249ac00640 1 -- 172.21.15.173:0/2965405172 >> 172.21.15.173:0/2965405172 conn(0x7f249406ac90 msgr2=0x7f249406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:37.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f249ac00640 1 -- 172.21.15.173:0/2965405172 shutdown_connections 2024-04-25T09:11:37.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f249ac00640 1 -- 172.21.15.173:0/2965405172 wait complete. 2024-04-25T09:11:37.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f249ac00640 1 Processor -- start 2024-04-25T09:11:37.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f249ac00640 1 -- start start 2024-04-25T09:11:37.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f249ac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24940aefa0 0x7f249415be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f249ac00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24940b3e70 0x7f24941f7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f249ac00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f249415edd0 0x7f2494150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f249ac00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249406e1c0 con 0x7f249415edd0 2024-04-25T09:11:37.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f249ac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249415aba0 con 0x7f24940aefa0 2024-04-25T09:11:37.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.250+0000 7f249ac00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249406e340 con 0x7f24940b3e70 2024-04-25T09:11:37.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f2498c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f249415edd0 0x7f2494150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f2498c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f249415edd0 0x7f2494150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60392/0 (socket says 172.21.15.173:60392) 2024-04-25T09:11:37.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f2498c00640 1 -- 172.21.15.173:0/4067862294 learned_addr learned my addr 172.21.15.173:0/4067862294 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:37.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f2493400640 1 --2- 172.21.15.173:0/4067862294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24940b3e70 0x7f24941f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f2493e00640 1 --2- 172.21.15.173:0/4067862294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24940aefa0 0x7f249415be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f2498c00640 1 -- 172.21.15.173:0/4067862294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24940b3e70 msgr2=0x7f24941f7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f2498c00640 1 --2- 172.21.15.173:0/4067862294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24940b3e70 0x7f24941f7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f2498c00640 1 -- 172.21.15.173:0/4067862294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24940aefa0 msgr2=0x7f249415be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f2498c00640 1 --2- 172.21.15.173:0/4067862294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24940aefa0 0x7f249415be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f2498c00640 1 -- 172.21.15.173:0/4067862294 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249415c470 con 0x7f249415edd0 2024-04-25T09:11:37.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f2493400640 1 --2- 172.21.15.173:0/4067862294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24940b3e70 0x7f24941f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:37.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f2498c00640 1 --2- 172.21.15.173:0/4067862294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f249415edd0 0x7f2494150190 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f248c01a630 tx=0x7f248c0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f248be00640 1 -- 172.21.15.173:0/4067862294 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c0bc070 con 0x7f249415edd0 2024-04-25T09:11:37.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f248be00640 1 -- 172.21.15.173:0/4067862294 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248c0addf0 con 0x7f249415edd0 2024-04-25T09:11:37.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f248be00640 1 -- 172.21.15.173:0/4067862294 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c0a58f0 con 0x7f249415edd0 2024-04-25T09:11:37.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f249ac00640 1 -- 172.21.15.173:0/4067862294 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249415c750 con 0x7f249415edd0 2024-04-25T09:11:37.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f249ac00640 1 -- 172.21.15.173:0/4067862294 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24941f8290 con 0x7f249415edd0 2024-04-25T09:11:37.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f249ac00640 1 -- 172.21.15.173:0/4067862294 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2494073a40 con 0x7f249415edd0 2024-04-25T09:11:37.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f248be00640 1 -- 172.21.15.173:0/4067862294 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f248c0b8680 con 0x7f249415edd0 2024-04-25T09:11:37.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.254+0000 7f248be00640 1 --2- 172.21.15.173:0/4067862294 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2474066f90 0x7f2474069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.258+0000 7f248be00640 1 -- 172.21.15.173:0/4067862294 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f248c11fe90 con 0x7f249415edd0 2024-04-25T09:11:37.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.258+0000 7f2493e00640 1 --2- 172.21.15.173:0/4067862294 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2474066f90 0x7f2474069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.258+0000 7f2493e00640 1 --2- 172.21.15.173:0/4067862294 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2474066f90 0x7f2474069450 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2484009580 tx=0x7f2484009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.258+0000 7f248be00640 1 -- 172.21.15.173:0/4067862294 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f248c016620 con 0x7f249415edd0 2024-04-25T09:11:37.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.446+0000 7f249ac00640 1 -- 172.21.15.173:0/4067862294 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f249406f1c0 con 0x7f249415edd0 2024-04-25T09:11:37.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.446+0000 7f248be00640 1 -- 172.21.15.173:0/4067862294 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v81) v1 ==== 53+0+73 (secure 0 0 0) 0x7f248c0f06b0 con 0x7f249415edd0 2024-04-25T09:11:37.432 INFO:teuthology.orchestra.run.smithi173.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:11:37.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.450+0000 7f249ac00640 1 -- 172.21.15.173:0/4067862294 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2474066f90 msgr2=0x7f2474069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.450+0000 7f249ac00640 1 --2- 172.21.15.173:0/4067862294 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2474066f90 0x7f2474069450 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2484009580 tx=0x7f2484009190 comp rx=0 tx=0).stop 2024-04-25T09:11:37.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.450+0000 7f249ac00640 1 -- 172.21.15.173:0/4067862294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f249415edd0 msgr2=0x7f2494150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.450+0000 7f249ac00640 1 --2- 172.21.15.173:0/4067862294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f249415edd0 0x7f2494150190 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f248c01a630 tx=0x7f248c0197a0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.450+0000 7f249ac00640 1 -- 172.21.15.173:0/4067862294 shutdown_connections 2024-04-25T09:11:37.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.450+0000 7f249ac00640 1 --2- 172.21.15.173:0/4067862294 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2474066f90 0x7f2474069450 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.450+0000 7f249ac00640 1 --2- 172.21.15.173:0/4067862294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f249415edd0 0x7f2494150190 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.450+0000 7f249ac00640 1 --2- 172.21.15.173:0/4067862294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24940b3e70 0x7f24941f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.450+0000 7f249ac00640 1 --2- 172.21.15.173:0/4067862294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24940aefa0 0x7f249415be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.450+0000 7f249ac00640 1 -- 172.21.15.173:0/4067862294 >> 172.21.15.173:0/4067862294 conn(0x7f249406ac90 msgr2=0x7f2494159e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:37.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.450+0000 7f249ac00640 1 -- 172.21.15.173:0/4067862294 shutdown_connections 2024-04-25T09:11:37.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:37.450+0000 7f249ac00640 1 -- 172.21.15.173:0/4067862294 wait complete. 2024-04-25T09:11:37.453 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:11:37.454 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:11:37.454 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2024-04-25T09:11:37.454 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:11:37.454 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:37.454 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:11:37.454 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:11:37.454 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:11:37.454 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:11:37.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:37.454 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2024-04-25T09:11:37.463 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:11:37.463 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:11:37.463 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:11:37.463 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:37.463 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-25T09:11:37.463 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:37.463 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:11:37.463 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:37.463 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2024-04-25T09:11:37.463 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:11:37.463 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:37.463 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2024-04-25T09:11:37.464 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:11:37.464 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:37.464 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:11:37.464 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:37.464 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:11:37.464 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 41921sec preferred_lft 41921sec 2024-04-25T09:11:37.464 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2024-04-25T09:11:37.464 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:37.464 INFO:teuthology.orchestra.run.smithi173.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:11:37.464 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 02:42:00:0e:60:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:37.464 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:11:37.464 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:37.464 INFO:teuthology.orchestra.run.smithi173.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:11:37.464 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:37.464 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:11:37.464 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:37.465 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:11:37.465 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:37.465 INFO:teuthology.orchestra.run.smithi173.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:11:37.465 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:11:37.465 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:11:37.465 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:37.465 INFO:teuthology.orchestra.run.smithi173.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:11:37.465 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:11:37.465 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:11:37.465 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:37.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:37.466 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:11:37.526 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-04-25T09:11:37.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:37.528 DEBUG:teuthology.orchestra.run.smithi173:> route 2024-04-25T09:11:37.580 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2024-04-25T09:11:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:11:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:11:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:11:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:11:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:11:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:11:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:11:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:11:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:11:37.581 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:11:37.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:37.582 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:11:37.582 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:37.582 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:11:37.582 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:11:37.582 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:11:37.582 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:37.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:37.673 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-25T09:11:37.729 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:11:37.729 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:11:37.730 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:11:37.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:37.730 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2024-04-25T09:11:37.792 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:11:37.792 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:37.845 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:11:37.845 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:11:37.845 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:37.892 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:11:37.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:37.892 DEBUG:teuthology.orchestra.run.smithi173:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:37.982 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:37.982 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:11:37.982 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:11:37.995 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:37.995 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:11:37.995 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:11:37.995 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:11:37.995 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:11:38.004 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:38.004 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:11:38.004 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:11:38.004 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:11:38.005 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:11:38.005 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-04-25T09:11:38.005 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-04-25T09:11:38.005 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6" will pass to kernel 2024-04-25T09:11:38.009 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:11:38.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:38.009 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:38.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:38.076 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:11:38.132 INFO:teuthology.orchestra.run.smithi173.stdout:client8173 2024-04-25T09:11:38.132 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:11:38.132 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:38.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:38.181 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:38.181 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:38.181 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.0 2024-04-25T09:11:38.181 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:38.181 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:38.181 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:38.181 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:38.268 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.268 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.268 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227227 s, 46.1 MB/s 2024-04-25T09:11:38.297 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.297 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.297 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273982 s, 38.3 MB/s 2024-04-25T09:11:38.318 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.318 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.318 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194511 s, 53.9 MB/s 2024-04-25T09:11:38.337 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.337 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.337 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171285 s, 61.2 MB/s 2024-04-25T09:11:38.358 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.358 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.358 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187106 s, 56.0 MB/s 2024-04-25T09:11:38.378 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.379 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.379 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190377 s, 55.1 MB/s 2024-04-25T09:11:38.399 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.399 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.399 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183996 s, 57.0 MB/s 2024-04-25T09:11:38.425 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.425 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.425 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247976 s, 42.3 MB/s 2024-04-25T09:11:38.446 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.446 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.446 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018492 s, 56.7 MB/s 2024-04-25T09:11:38.467 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.467 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.467 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199246 s, 52.6 MB/s 2024-04-25T09:11:38.488 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.488 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.488 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184772 s, 56.7 MB/s 2024-04-25T09:11:38.513 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.513 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.514 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237812 s, 44.1 MB/s 2024-04-25T09:11:38.532 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.532 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.532 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166417 s, 63.0 MB/s 2024-04-25T09:11:38.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.560 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257871 s, 40.7 MB/s 2024-04-25T09:11:38.580 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.580 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.580 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187633 s, 55.9 MB/s 2024-04-25T09:11:38.602 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.602 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.603 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205185 s, 51.1 MB/s 2024-04-25T09:11:38.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.622 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179323 s, 58.5 MB/s 2024-04-25T09:11:38.639 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.639 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.639 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146573 s, 71.5 MB/s 2024-04-25T09:11:38.659 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.659 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.659 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183741 s, 57.1 MB/s 2024-04-25T09:11:38.679 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.679 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.679 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186737 s, 56.2 MB/s 2024-04-25T09:11:38.699 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.699 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.699 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181812 s, 57.7 MB/s 2024-04-25T09:11:38.718 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.718 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.719 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172368 s, 60.8 MB/s 2024-04-25T09:11:38.734 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.734 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.735 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141517 s, 74.1 MB/s 2024-04-25T09:11:38.749 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.749 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.749 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126202 s, 83.1 MB/s 2024-04-25T09:11:38.767 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.767 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.768 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166023 s, 63.2 MB/s 2024-04-25T09:11:38.790 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.790 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.790 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209394 s, 50.1 MB/s 2024-04-25T09:11:38.808 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.808 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.808 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163216 s, 64.2 MB/s 2024-04-25T09:11:38.830 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.830 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.830 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193598 s, 54.2 MB/s 2024-04-25T09:11:38.846 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.846 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.846 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014498 s, 72.3 MB/s 2024-04-25T09:11:38.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.865 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177225 s, 59.2 MB/s 2024-04-25T09:11:38.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.882 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144054 s, 72.8 MB/s 2024-04-25T09:11:38.905 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.905 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.905 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213189 s, 49.2 MB/s 2024-04-25T09:11:38.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:38.906 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:38.906 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:38.906 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.1 2024-04-25T09:11:38.906 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:38.907 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:38.907 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:38.907 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:38.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:38.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:38.982 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163345 s, 64.2 MB/s 2024-04-25T09:11:39.001 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.001 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.001 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167526 s, 62.6 MB/s 2024-04-25T09:11:39.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.022 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198056 s, 52.9 MB/s 2024-04-25T09:11:39.047 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.047 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.047 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235666 s, 44.5 MB/s 2024-04-25T09:11:39.071 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.071 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.071 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214712 s, 48.8 MB/s 2024-04-25T09:11:39.087 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.088 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.088 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151283 s, 69.3 MB/s 2024-04-25T09:11:39.106 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.106 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.107 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170742 s, 61.4 MB/s 2024-04-25T09:11:39.123 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.123 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.123 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147419 s, 71.1 MB/s 2024-04-25T09:11:39.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.140 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151237 s, 69.3 MB/s 2024-04-25T09:11:39.158 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.159 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.159 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016695 s, 62.8 MB/s 2024-04-25T09:11:39.178 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.178 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.178 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178787 s, 58.6 MB/s 2024-04-25T09:11:39.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.200 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197183 s, 53.2 MB/s 2024-04-25T09:11:39.219 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.219 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.219 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177921 s, 58.9 MB/s 2024-04-25T09:11:39.236 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.236 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.236 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147878 s, 70.9 MB/s 2024-04-25T09:11:39.253 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.253 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.253 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149546 s, 70.1 MB/s 2024-04-25T09:11:39.269 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.269 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.269 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146284 s, 71.7 MB/s 2024-04-25T09:11:39.285 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.285 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.286 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143672 s, 73.0 MB/s 2024-04-25T09:11:39.305 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.305 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.305 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179016 s, 58.6 MB/s 2024-04-25T09:11:39.324 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.324 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.325 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176652 s, 59.4 MB/s 2024-04-25T09:11:39.340 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.340 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.341 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141486 s, 74.1 MB/s 2024-04-25T09:11:39.357 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.357 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.357 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146331 s, 71.7 MB/s 2024-04-25T09:11:39.378 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.378 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.378 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192687 s, 54.4 MB/s 2024-04-25T09:11:39.398 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.398 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.398 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185607 s, 56.5 MB/s 2024-04-25T09:11:39.414 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.414 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.414 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141784 s, 74.0 MB/s 2024-04-25T09:11:39.435 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.435 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.435 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188009 s, 55.8 MB/s 2024-04-25T09:11:39.449 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.449 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.449 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121269 s, 86.5 MB/s 2024-04-25T09:11:39.467 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.467 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.467 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163185 s, 64.3 MB/s 2024-04-25T09:11:39.483 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.483 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.484 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149889 s, 70.0 MB/s 2024-04-25T09:11:39.506 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.506 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.506 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205797 s, 51.0 MB/s 2024-04-25T09:11:39.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.522 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140476 s, 74.6 MB/s 2024-04-25T09:11:39.538 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.539 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.539 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150206 s, 69.8 MB/s 2024-04-25T09:11:39.555 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.555 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.555 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144896 s, 72.4 MB/s 2024-04-25T09:11:39.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:39.556 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:39.556 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:39.557 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.2 2024-04-25T09:11:39.557 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:39.557 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:39.557 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:39.557 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:39.633 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.633 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.633 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227959 s, 46.0 MB/s 2024-04-25T09:11:39.654 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.655 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.655 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198369 s, 52.9 MB/s 2024-04-25T09:11:39.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.672 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016031 s, 65.4 MB/s 2024-04-25T09:11:39.692 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.692 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.692 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182652 s, 57.4 MB/s 2024-04-25T09:11:39.708 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.708 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.708 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014333 s, 73.2 MB/s 2024-04-25T09:11:39.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.731 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205391 s, 51.1 MB/s 2024-04-25T09:11:39.747 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.747 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.747 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145249 s, 72.2 MB/s 2024-04-25T09:11:39.765 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.765 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.765 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015781 s, 66.4 MB/s 2024-04-25T09:11:39.781 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.782 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.782 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149849 s, 70.0 MB/s 2024-04-25T09:11:39.802 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.802 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.803 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191631 s, 54.7 MB/s 2024-04-25T09:11:39.819 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.819 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.819 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148628 s, 70.6 MB/s 2024-04-25T09:11:39.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.838 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016566 s, 63.3 MB/s 2024-04-25T09:11:39.852 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.852 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.852 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131484 s, 79.7 MB/s 2024-04-25T09:11:39.869 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.869 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.869 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145162 s, 72.2 MB/s 2024-04-25T09:11:39.888 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.888 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.888 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174352 s, 60.1 MB/s 2024-04-25T09:11:39.902 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.902 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.902 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123777 s, 84.7 MB/s 2024-04-25T09:11:39.918 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.918 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.919 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146197 s, 71.7 MB/s 2024-04-25T09:11:39.939 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.940 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.940 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190511 s, 55.0 MB/s 2024-04-25T09:11:39.953 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.953 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.953 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122451 s, 85.6 MB/s 2024-04-25T09:11:39.974 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.974 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.974 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185782 s, 56.4 MB/s 2024-04-25T09:11:39.994 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:39.994 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:39.994 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185804 s, 56.4 MB/s 2024-04-25T09:11:40.010 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.010 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.011 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145555 s, 72.0 MB/s 2024-04-25T09:11:40.028 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.028 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.028 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160985 s, 65.1 MB/s 2024-04-25T09:11:40.045 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.045 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.045 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151162 s, 69.4 MB/s 2024-04-25T09:11:40.058 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.059 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.059 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116411 s, 90.1 MB/s 2024-04-25T09:11:40.077 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.077 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.077 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164945 s, 63.6 MB/s 2024-04-25T09:11:40.092 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.092 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.092 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141594 s, 74.1 MB/s 2024-04-25T09:11:40.109 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.109 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.109 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148371 s, 70.7 MB/s 2024-04-25T09:11:40.126 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.126 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.126 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144657 s, 72.5 MB/s 2024-04-25T09:11:40.144 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.144 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.144 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164626 s, 63.7 MB/s 2024-04-25T09:11:40.165 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.166 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.166 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020096 s, 52.2 MB/s 2024-04-25T09:11:40.184 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.184 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.185 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170526 s, 61.5 MB/s 2024-04-25T09:11:40.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:40.186 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:40.186 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:40.186 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.3 2024-04-25T09:11:40.186 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:40.186 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:40.186 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:40.186 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:40.258 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.259 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.259 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166786 s, 62.9 MB/s 2024-04-25T09:11:40.275 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.275 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.275 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146263 s, 71.7 MB/s 2024-04-25T09:11:40.291 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.291 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.291 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149561 s, 70.1 MB/s 2024-04-25T09:11:40.308 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.308 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.308 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146281 s, 71.7 MB/s 2024-04-25T09:11:40.324 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.324 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.324 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140014 s, 74.9 MB/s 2024-04-25T09:11:40.342 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.342 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.342 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016173 s, 64.8 MB/s 2024-04-25T09:11:40.363 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.363 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.363 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192423 s, 54.5 MB/s 2024-04-25T09:11:40.379 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.379 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.379 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150119 s, 69.8 MB/s 2024-04-25T09:11:40.404 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.404 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.405 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232318 s, 45.1 MB/s 2024-04-25T09:11:40.420 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.421 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.421 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142757 s, 73.5 MB/s 2024-04-25T09:11:40.437 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.437 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.437 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014797 s, 70.9 MB/s 2024-04-25T09:11:40.456 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.456 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.456 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173614 s, 60.4 MB/s 2024-04-25T09:11:40.473 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.473 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.473 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149635 s, 70.1 MB/s 2024-04-25T09:11:40.493 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.493 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.493 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017837 s, 58.8 MB/s 2024-04-25T09:11:40.507 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.507 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.507 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123484 s, 84.9 MB/s 2024-04-25T09:11:40.523 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.523 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.523 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145384 s, 72.1 MB/s 2024-04-25T09:11:40.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.541 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.541 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154226 s, 68.0 MB/s 2024-04-25T09:11:40.557 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.557 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.557 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145967 s, 71.8 MB/s 2024-04-25T09:11:40.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.576 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172968 s, 60.6 MB/s 2024-04-25T09:11:40.593 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.593 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.593 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150151 s, 69.8 MB/s 2024-04-25T09:11:40.612 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.612 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.612 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174961 s, 59.9 MB/s 2024-04-25T09:11:40.629 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.629 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.629 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151296 s, 69.3 MB/s 2024-04-25T09:11:40.645 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.645 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.645 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142464 s, 73.6 MB/s 2024-04-25T09:11:40.664 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.664 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.664 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168541 s, 62.2 MB/s 2024-04-25T09:11:40.680 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.681 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.681 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148235 s, 70.7 MB/s 2024-04-25T09:11:40.697 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.697 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.697 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141839 s, 73.9 MB/s 2024-04-25T09:11:40.716 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.716 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.716 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173596 s, 60.4 MB/s 2024-04-25T09:11:40.734 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.734 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.734 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167923 s, 62.4 MB/s 2024-04-25T09:11:40.751 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.751 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.751 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147305 s, 71.2 MB/s 2024-04-25T09:11:40.769 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.770 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.770 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170817 s, 61.4 MB/s 2024-04-25T09:11:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016947 s, 61.9 MB/s 2024-04-25T09:11:40.804 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.804 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.805 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143885 s, 72.9 MB/s 2024-04-25T09:11:40.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:40.806 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:40.806 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:40.806 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.4 2024-04-25T09:11:40.806 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:40.806 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:40.806 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:40.807 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:40.881 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.881 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.881 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186774 s, 56.1 MB/s 2024-04-25T09:11:40.897 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.897 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.897 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143641 s, 73.0 MB/s 2024-04-25T09:11:40.913 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.913 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.913 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141153 s, 74.3 MB/s 2024-04-25T09:11:40.930 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.930 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.930 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156578 s, 67.0 MB/s 2024-04-25T09:11:40.950 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.950 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.950 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179394 s, 58.5 MB/s 2024-04-25T09:11:40.973 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.973 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.973 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212357 s, 49.4 MB/s 2024-04-25T09:11:40.992 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:40.992 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:40.992 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174804 s, 60.0 MB/s 2024-04-25T09:11:41.018 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.018 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.018 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235269 s, 44.6 MB/s 2024-04-25T09:11:41.034 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.034 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.034 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148152 s, 70.8 MB/s 2024-04-25T09:11:41.051 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.051 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.051 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146232 s, 71.7 MB/s 2024-04-25T09:11:41.068 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.068 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.068 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015343 s, 68.3 MB/s 2024-04-25T09:11:41.088 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.088 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.088 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181542 s, 57.8 MB/s 2024-04-25T09:11:41.106 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.106 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.106 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165124 s, 63.5 MB/s 2024-04-25T09:11:41.123 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.123 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.123 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150438 s, 69.7 MB/s 2024-04-25T09:11:41.141 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.141 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.141 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166122 s, 63.1 MB/s 2024-04-25T09:11:41.157 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.157 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.157 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140559 s, 74.6 MB/s 2024-04-25T09:11:41.174 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.174 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.174 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147807 s, 70.9 MB/s 2024-04-25T09:11:41.187 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.187 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.187 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113369 s, 92.5 MB/s 2024-04-25T09:11:41.204 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.204 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.204 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153158 s, 68.5 MB/s 2024-04-25T09:11:41.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.222 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158425 s, 66.2 MB/s 2024-04-25T09:11:41.241 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.241 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.241 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017729 s, 59.1 MB/s 2024-04-25T09:11:41.262 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.262 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.262 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189055 s, 55.5 MB/s 2024-04-25T09:11:41.281 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.281 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.281 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017246 s, 60.8 MB/s 2024-04-25T09:11:41.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.298 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151352 s, 69.3 MB/s 2024-04-25T09:11:41.314 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.314 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.314 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147286 s, 71.2 MB/s 2024-04-25T09:11:41.334 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.334 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.334 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177058 s, 59.2 MB/s 2024-04-25T09:11:41.352 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.352 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.352 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160959 s, 65.1 MB/s 2024-04-25T09:11:41.368 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.368 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.368 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014451 s, 72.6 MB/s 2024-04-25T09:11:41.385 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.385 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.385 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156204 s, 67.1 MB/s 2024-04-25T09:11:41.405 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.405 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.405 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175527 s, 59.7 MB/s 2024-04-25T09:11:41.421 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.421 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.421 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142468 s, 73.6 MB/s 2024-04-25T09:11:41.437 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.437 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.437 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143283 s, 73.2 MB/s 2024-04-25T09:11:41.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:41.439 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:41.439 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:41.439 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.5 2024-04-25T09:11:41.439 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:41.439 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:41.439 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:41.439 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:41.517 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.517 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.518 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196066 s, 53.5 MB/s 2024-04-25T09:11:41.534 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.534 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.534 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152659 s, 68.7 MB/s 2024-04-25T09:11:41.551 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.552 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.552 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154136 s, 68.0 MB/s 2024-04-25T09:11:41.573 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.573 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.573 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199263 s, 52.6 MB/s 2024-04-25T09:11:41.589 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.589 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.589 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141146 s, 74.3 MB/s 2024-04-25T09:11:41.609 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.609 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.609 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175054 s, 59.9 MB/s 2024-04-25T09:11:41.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.628 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173525 s, 60.4 MB/s 2024-04-25T09:11:41.645 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.645 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.645 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150882 s, 69.5 MB/s 2024-04-25T09:11:41.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.661 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140608 s, 74.6 MB/s 2024-04-25T09:11:41.678 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.679 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.679 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157775 s, 66.5 MB/s 2024-04-25T09:11:41.700 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.700 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.700 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192753 s, 54.4 MB/s 2024-04-25T09:11:41.716 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.717 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.717 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151132 s, 69.4 MB/s 2024-04-25T09:11:41.733 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.734 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.734 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152181 s, 68.9 MB/s 2024-04-25T09:11:41.752 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.752 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.752 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163917 s, 64.0 MB/s 2024-04-25T09:11:41.774 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.774 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.774 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204595 s, 51.3 MB/s 2024-04-25T09:11:41.791 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.791 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.791 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148475 s, 70.6 MB/s 2024-04-25T09:11:41.808 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.808 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.809 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156898 s, 66.8 MB/s 2024-04-25T09:11:41.828 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.828 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.828 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175341 s, 59.8 MB/s 2024-04-25T09:11:41.844 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.844 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.844 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147762 s, 71.0 MB/s 2024-04-25T09:11:41.863 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.863 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.863 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165309 s, 63.4 MB/s 2024-04-25T09:11:41.886 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.886 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.886 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212124 s, 49.4 MB/s 2024-04-25T09:11:41.905 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.905 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.905 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017072 s, 61.4 MB/s 2024-04-25T09:11:41.922 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.922 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.922 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152856 s, 68.6 MB/s 2024-04-25T09:11:41.941 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.941 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.941 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165988 s, 63.2 MB/s 2024-04-25T09:11:41.959 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.959 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.960 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167905 s, 62.5 MB/s 2024-04-25T09:11:41.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.978 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167268 s, 62.7 MB/s 2024-04-25T09:11:41.997 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:41.997 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:41.997 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016855 s, 62.2 MB/s 2024-04-25T09:11:42.017 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.017 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.017 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189559 s, 55.3 MB/s 2024-04-25T09:11:42.036 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.036 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.036 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169358 s, 61.9 MB/s 2024-04-25T09:11:42.050 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.050 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.050 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118737 s, 88.3 MB/s 2024-04-25T09:11:42.066 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.066 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.066 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014902 s, 70.4 MB/s 2024-04-25T09:11:42.087 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.087 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.087 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185434 s, 56.5 MB/s 2024-04-25T09:11:42.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:42.088 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:42.088 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:42.089 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.6 2024-04-25T09:11:42.089 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:42.089 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:42.089 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:42.089 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:42.157 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.157 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.158 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147531 s, 71.1 MB/s 2024-04-25T09:11:42.179 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.179 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.179 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202057 s, 51.9 MB/s 2024-04-25T09:11:42.196 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.196 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.196 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015068 s, 69.6 MB/s 2024-04-25T09:11:42.213 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.213 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.213 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151361 s, 69.3 MB/s 2024-04-25T09:11:42.231 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.231 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.231 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166542 s, 63.0 MB/s 2024-04-25T09:11:42.248 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.248 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.248 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147874 s, 70.9 MB/s 2024-04-25T09:11:42.266 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.266 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.266 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138432 s, 75.7 MB/s 2024-04-25T09:11:42.287 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.287 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.287 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210419 s, 49.8 MB/s 2024-04-25T09:11:42.303 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.303 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.303 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142977 s, 73.3 MB/s 2024-04-25T09:11:42.325 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.325 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.325 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205463 s, 51.0 MB/s 2024-04-25T09:11:42.344 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.344 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.344 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169168 s, 62.0 MB/s 2024-04-25T09:11:42.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.360 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141934 s, 73.9 MB/s 2024-04-25T09:11:42.373 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.373 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.373 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115399 s, 90.9 MB/s 2024-04-25T09:11:42.389 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.390 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.390 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014726 s, 71.2 MB/s 2024-04-25T09:11:42.411 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.411 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.411 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198317 s, 52.9 MB/s 2024-04-25T09:11:42.427 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.428 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.428 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146771 s, 71.4 MB/s 2024-04-25T09:11:42.448 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.448 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.448 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189562 s, 55.3 MB/s 2024-04-25T09:11:42.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.469 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019236 s, 54.5 MB/s 2024-04-25T09:11:42.486 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.486 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.486 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150366 s, 69.7 MB/s 2024-04-25T09:11:42.510 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.510 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.510 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222951 s, 47.0 MB/s 2024-04-25T09:11:42.526 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.526 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.526 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141843 s, 73.9 MB/s 2024-04-25T09:11:42.547 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.547 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.547 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188133 s, 55.7 MB/s 2024-04-25T09:11:42.563 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.563 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.563 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142961 s, 73.3 MB/s 2024-04-25T09:11:42.582 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.582 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.582 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017322 s, 60.5 MB/s 2024-04-25T09:11:42.604 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.604 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.604 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201184 s, 52.1 MB/s 2024-04-25T09:11:42.618 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.618 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.618 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120413 s, 87.1 MB/s 2024-04-25T09:11:42.634 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.634 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.634 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143847 s, 72.9 MB/s 2024-04-25T09:11:42.650 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.650 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.650 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144816 s, 72.4 MB/s 2024-04-25T09:11:42.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.672 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199148 s, 52.7 MB/s 2024-04-25T09:11:42.686 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.686 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.686 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122773 s, 85.4 MB/s 2024-04-25T09:11:42.705 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.705 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.705 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168851 s, 62.1 MB/s 2024-04-25T09:11:42.724 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.724 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.724 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174439 s, 60.1 MB/s 2024-04-25T09:11:42.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:42.725 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:42.725 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:42.726 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.7 2024-04-25T09:11:42.726 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:42.726 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:42.726 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:42.726 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:42.802 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.802 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.803 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019094 s, 54.9 MB/s 2024-04-25T09:11:42.816 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.816 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.816 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121713 s, 86.2 MB/s 2024-04-25T09:11:42.834 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.834 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.834 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157144 s, 66.7 MB/s 2024-04-25T09:11:42.855 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.855 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.855 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191991 s, 54.6 MB/s 2024-04-25T09:11:42.871 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.872 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.872 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148464 s, 70.6 MB/s 2024-04-25T09:11:42.888 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.888 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.888 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145665 s, 72.0 MB/s 2024-04-25T09:11:42.906 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.907 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.907 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167767 s, 62.5 MB/s 2024-04-25T09:11:42.923 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.923 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.923 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147802 s, 70.9 MB/s 2024-04-25T09:11:42.942 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.942 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.942 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173953 s, 60.3 MB/s 2024-04-25T09:11:42.959 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.960 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.960 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154937 s, 67.7 MB/s 2024-04-25T09:11:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144924 s, 72.4 MB/s 2024-04-25T09:11:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143052 s, 73.3 MB/s 2024-04-25T09:11:43.008 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.009 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.009 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145836 s, 71.9 MB/s 2024-04-25T09:11:43.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.025 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145132 s, 72.2 MB/s 2024-04-25T09:11:43.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.042 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143794 s, 72.9 MB/s 2024-04-25T09:11:43.066 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.066 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.066 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231597 s, 45.3 MB/s 2024-04-25T09:11:43.082 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.082 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.082 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014593 s, 71.9 MB/s 2024-04-25T09:11:43.098 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.098 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.098 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138887 s, 75.5 MB/s 2024-04-25T09:11:43.114 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.114 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.114 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144081 s, 72.8 MB/s 2024-04-25T09:11:43.131 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.131 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.131 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145435 s, 72.1 MB/s 2024-04-25T09:11:43.149 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.149 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.149 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166899 s, 62.8 MB/s 2024-04-25T09:11:43.172 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.172 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.172 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211663 s, 49.5 MB/s 2024-04-25T09:11:43.191 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.191 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.191 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169682 s, 61.8 MB/s 2024-04-25T09:11:43.208 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.208 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.208 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148403 s, 70.7 MB/s 2024-04-25T09:11:43.226 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.226 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.226 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166366 s, 63.0 MB/s 2024-04-25T09:11:43.248 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.248 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.248 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200275 s, 52.4 MB/s 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157325 s, 66.7 MB/s 2024-04-25T09:11:43.286 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.286 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.286 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184016 s, 57.0 MB/s 2024-04-25T09:11:43.303 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.303 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.303 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015364 s, 68.2 MB/s 2024-04-25T09:11:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170594 s, 61.5 MB/s 2024-04-25T09:11:43.343 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.343 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.343 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186385 s, 56.3 MB/s 2024-04-25T09:11:43.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.360 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156806 s, 66.9 MB/s 2024-04-25T09:11:43.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:43.362 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:43.362 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:43.362 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.8 2024-04-25T09:11:43.362 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:43.362 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:43.362 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:43.362 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:43.439 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.439 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.439 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168424 s, 62.3 MB/s 2024-04-25T09:11:43.456 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.456 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.456 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148185 s, 70.8 MB/s 2024-04-25T09:11:43.473 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.473 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.473 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151387 s, 69.3 MB/s 2024-04-25T09:11:43.498 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.498 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.498 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231221 s, 45.3 MB/s 2024-04-25T09:11:43.515 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.515 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.515 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154127 s, 68.0 MB/s 2024-04-25T09:11:43.534 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.534 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.534 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169964 s, 61.7 MB/s 2024-04-25T09:11:43.550 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.550 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.550 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146754 s, 71.5 MB/s 2024-04-25T09:11:43.567 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.567 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.567 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152374 s, 68.8 MB/s 2024-04-25T09:11:43.586 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.586 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.586 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168555 s, 62.2 MB/s 2024-04-25T09:11:43.611 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.611 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.612 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237921 s, 44.1 MB/s 2024-04-25T09:11:43.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.628 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151465 s, 69.2 MB/s 2024-04-25T09:11:43.642 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.643 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.643 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012388 s, 84.6 MB/s 2024-04-25T09:11:43.656 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.656 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.656 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114567 s, 91.5 MB/s 2024-04-25T09:11:43.674 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.674 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.674 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164608 s, 63.7 MB/s 2024-04-25T09:11:43.694 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.695 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.695 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187307 s, 56.0 MB/s 2024-04-25T09:11:43.713 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.714 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.714 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017154 s, 61.1 MB/s 2024-04-25T09:11:43.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.731 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159581 s, 65.7 MB/s 2024-04-25T09:11:43.753 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.753 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.753 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194804 s, 53.8 MB/s 2024-04-25T09:11:43.769 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.769 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.769 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144596 s, 72.5 MB/s 2024-04-25T09:11:43.786 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.786 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.786 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150815 s, 69.5 MB/s 2024-04-25T09:11:43.804 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.804 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.805 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171626 s, 61.1 MB/s 2024-04-25T09:11:43.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.821 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144115 s, 72.8 MB/s 2024-04-25T09:11:43.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.837 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143906 s, 72.9 MB/s 2024-04-25T09:11:43.854 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.855 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.855 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156871 s, 66.8 MB/s 2024-04-25T09:11:43.871 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.871 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.871 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146594 s, 71.5 MB/s 2024-04-25T09:11:43.888 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.888 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.888 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154301 s, 68.0 MB/s 2024-04-25T09:11:43.905 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.905 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.905 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145688 s, 72.0 MB/s 2024-04-25T09:11:43.924 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.924 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.924 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175694 s, 59.7 MB/s 2024-04-25T09:11:43.943 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.943 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.943 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176411 s, 59.4 MB/s 2024-04-25T09:11:43.963 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.964 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.964 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181847 s, 57.7 MB/s 2024-04-25T09:11:43.985 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:43.985 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:43.985 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192159 s, 54.6 MB/s 2024-04-25T09:11:44.002 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.002 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.002 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015615 s, 67.2 MB/s 2024-04-25T09:11:44.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:44.004 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:44.004 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:44.004 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.9 2024-04-25T09:11:44.004 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:44.004 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:44.004 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:44.004 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:44.072 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.072 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.072 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144141 s, 72.7 MB/s 2024-04-25T09:11:44.091 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.091 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.091 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167049 s, 62.8 MB/s 2024-04-25T09:11:44.111 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.111 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.112 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189524 s, 55.3 MB/s 2024-04-25T09:11:44.134 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.134 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.134 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205446 s, 51.0 MB/s 2024-04-25T09:11:44.151 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.151 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.151 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148047 s, 70.8 MB/s 2024-04-25T09:11:44.165 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.165 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.165 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122986 s, 85.3 MB/s 2024-04-25T09:11:44.185 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.185 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.185 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182894 s, 57.3 MB/s 2024-04-25T09:11:44.204 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.204 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.204 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174391 s, 60.1 MB/s 2024-04-25T09:11:44.225 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.225 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.225 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190632 s, 55.0 MB/s 2024-04-25T09:11:44.244 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.244 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.244 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175042 s, 59.9 MB/s 2024-04-25T09:11:44.261 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.261 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.261 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148112 s, 70.8 MB/s 2024-04-25T09:11:44.281 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.281 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.282 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188879 s, 55.5 MB/s 2024-04-25T09:11:44.299 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.299 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.299 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158282 s, 66.2 MB/s 2024-04-25T09:11:44.315 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.315 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.315 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145042 s, 72.3 MB/s 2024-04-25T09:11:44.331 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.332 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.332 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144981 s, 72.3 MB/s 2024-04-25T09:11:44.350 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.350 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.350 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166013 s, 63.2 MB/s 2024-04-25T09:11:44.367 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.367 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.367 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155971 s, 67.2 MB/s 2024-04-25T09:11:44.384 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.384 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.384 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148724 s, 70.5 MB/s 2024-04-25T09:11:44.401 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.401 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.401 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148802 s, 70.5 MB/s 2024-04-25T09:11:44.422 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.422 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.422 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190641 s, 55.0 MB/s 2024-04-25T09:11:44.440 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.440 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.440 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166132 s, 63.1 MB/s 2024-04-25T09:11:44.460 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.461 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.461 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187087 s, 56.0 MB/s 2024-04-25T09:11:44.480 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.480 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.480 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179814 s, 58.3 MB/s 2024-04-25T09:11:44.499 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.499 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.499 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166722 s, 62.9 MB/s 2024-04-25T09:11:44.523 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.523 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.523 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224435 s, 46.7 MB/s 2024-04-25T09:11:44.541 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.541 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.541 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164605 s, 63.7 MB/s 2024-04-25T09:11:44.557 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.557 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.557 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143032 s, 73.3 MB/s 2024-04-25T09:11:44.575 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.576 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166233 s, 63.1 MB/s 2024-04-25T09:11:44.597 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.597 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.597 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019296 s, 54.3 MB/s 2024-04-25T09:11:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02113 s, 49.6 MB/s 2024-04-25T09:11:44.638 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.639 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.639 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170386 s, 61.5 MB/s 2024-04-25T09:11:44.659 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.659 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.660 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190435 s, 55.1 MB/s 2024-04-25T09:11:44.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:44.661 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:44.661 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:44.661 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.10 2024-04-25T09:11:44.661 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:44.661 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:44.661 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:44.661 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:44.736 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.736 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.736 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171083 s, 61.3 MB/s 2024-04-25T09:11:44.753 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.753 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.753 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015435 s, 67.9 MB/s 2024-04-25T09:11:44.769 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.770 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.770 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149584 s, 70.1 MB/s 2024-04-25T09:11:44.786 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.786 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.786 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147679 s, 71.0 MB/s 2024-04-25T09:11:44.803 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.803 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.803 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014604 s, 71.8 MB/s 2024-04-25T09:11:44.820 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.820 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.820 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151561 s, 69.2 MB/s 2024-04-25T09:11:44.841 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.841 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.841 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197706 s, 53.0 MB/s 2024-04-25T09:11:44.860 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.860 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.860 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170965 s, 61.3 MB/s 2024-04-25T09:11:44.876 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.876 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.876 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145429 s, 72.1 MB/s 2024-04-25T09:11:44.898 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.898 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.898 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198273 s, 52.9 MB/s 2024-04-25T09:11:44.917 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.918 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.918 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179363 s, 58.5 MB/s 2024-04-25T09:11:44.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.934 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146297 s, 71.7 MB/s 2024-04-25T09:11:44.954 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.954 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.954 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187428 s, 55.9 MB/s 2024-04-25T09:11:44.970 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.970 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.970 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141121 s, 74.3 MB/s 2024-04-25T09:11:44.992 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:44.992 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:44.992 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198128 s, 52.9 MB/s 2024-04-25T09:11:45.009 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.009 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.009 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152088 s, 68.9 MB/s 2024-04-25T09:11:45.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.025 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145191 s, 72.2 MB/s 2024-04-25T09:11:45.041 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.042 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143828 s, 72.9 MB/s 2024-04-25T09:11:45.061 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.061 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.061 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179342 s, 58.5 MB/s 2024-04-25T09:11:45.080 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.080 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.080 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170782 s, 61.4 MB/s 2024-04-25T09:11:45.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.102 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.102 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196854 s, 53.3 MB/s 2024-04-25T09:11:45.119 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.119 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.119 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015721 s, 66.7 MB/s 2024-04-25T09:11:45.138 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.138 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.138 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168805 s, 62.1 MB/s 2024-04-25T09:11:45.162 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.162 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.162 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222658 s, 47.1 MB/s 2024-04-25T09:11:45.180 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.180 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.180 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161992 s, 64.7 MB/s 2024-04-25T09:11:45.198 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.198 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.198 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163594 s, 64.1 MB/s 2024-04-25T09:11:45.217 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.217 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.218 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176399 s, 59.4 MB/s 2024-04-25T09:11:45.234 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.234 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.234 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150486 s, 69.7 MB/s 2024-04-25T09:11:45.252 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:11:45.253 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.253 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.253 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162127 s, 64.7 MB/s 2024-04-25T09:11:45.255 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:11:45.275 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.275 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.275 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211303 s, 49.6 MB/s 2024-04-25T09:11:45.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.294 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167729 s, 62.5 MB/s 2024-04-25T09:11:45.315 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.315 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.315 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195613 s, 53.6 MB/s 2024-04-25T09:11:45.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:45.316 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:45.317 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:45.317 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.11 2024-04-25T09:11:45.317 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:45.317 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:45.317 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:45.317 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156279 s, 67.1 MB/s 2024-04-25T09:11:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160645 s, 65.3 MB/s 2024-04-25T09:11:45.420 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.420 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.420 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151506 s, 69.2 MB/s 2024-04-25T09:11:45.440 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.440 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.440 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178538 s, 58.7 MB/s 2024-04-25T09:11:45.461 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.461 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.461 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192156 s, 54.6 MB/s 2024-04-25T09:11:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193467 s, 54.2 MB/s 2024-04-25T09:11:45.502 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.502 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.502 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188209 s, 55.7 MB/s 2024-04-25T09:11:45.519 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.519 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.519 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152868 s, 68.6 MB/s 2024-04-25T09:11:45.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.540 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185492 s, 56.5 MB/s 2024-04-25T09:11:45.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.556 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142755 s, 73.5 MB/s 2024-04-25T09:11:45.572 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.572 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.572 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014491 s, 72.4 MB/s 2024-04-25T09:11:45.589 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.589 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.589 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151328 s, 69.3 MB/s 2024-04-25T09:11:45.605 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.605 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.605 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141844 s, 73.9 MB/s 2024-04-25T09:11:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147224 s, 71.2 MB/s 2024-04-25T09:11:45.638 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.638 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.638 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151538 s, 69.2 MB/s 2024-04-25T09:11:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015271 s, 68.7 MB/s 2024-04-25T09:11:45.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.672 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149802 s, 70.0 MB/s 2024-04-25T09:11:45.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.690 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158402 s, 66.2 MB/s 2024-04-25T09:11:45.706 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.706 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.706 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148055 s, 70.8 MB/s 2024-04-25T09:11:45.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.731 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224661 s, 46.7 MB/s 2024-04-25T09:11:45.748 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.748 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.748 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155003 s, 67.6 MB/s 2024-04-25T09:11:45.767 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.767 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.767 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174776 s, 60.0 MB/s 2024-04-25T09:11:45.783 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.783 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.783 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144382 s, 72.6 MB/s 2024-04-25T09:11:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153586 s, 68.3 MB/s 2024-04-25T09:11:45.822 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.822 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.822 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194962 s, 53.8 MB/s 2024-04-25T09:11:45.844 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.844 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.844 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205354 s, 51.1 MB/s 2024-04-25T09:11:45.860 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.860 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.860 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141688 s, 74.0 MB/s 2024-04-25T09:11:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.877 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144739 s, 72.4 MB/s 2024-04-25T09:11:45.893 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.893 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.893 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014595 s, 71.8 MB/s 2024-04-25T09:11:45.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.914 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196579 s, 53.3 MB/s 2024-04-25T09:11:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142888 s, 73.4 MB/s 2024-04-25T09:11:45.953 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:45.953 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:45.953 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205024 s, 51.1 MB/s 2024-04-25T09:11:45.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:45.954 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:45.954 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:45.954 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.12 2024-04-25T09:11:45.955 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:45.955 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:45.955 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:45.955 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:46.030 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.030 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.030 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194505 s, 53.9 MB/s 2024-04-25T09:11:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173014 s, 60.6 MB/s 2024-04-25T09:11:46.066 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.066 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.066 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149974 s, 69.9 MB/s 2024-04-25T09:11:46.086 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.086 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.087 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01837 s, 57.1 MB/s 2024-04-25T09:11:46.102 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.102 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.102 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143815 s, 72.9 MB/s 2024-04-25T09:11:46.119 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.119 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.119 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014898 s, 70.4 MB/s 2024-04-25T09:11:46.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.141 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195023 s, 53.8 MB/s 2024-04-25T09:11:46.163 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.163 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.163 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209045 s, 50.2 MB/s 2024-04-25T09:11:46.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.183 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179108 s, 58.5 MB/s 2024-04-25T09:11:46.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.200 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153432 s, 68.3 MB/s 2024-04-25T09:11:46.223 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.223 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.223 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215935 s, 48.6 MB/s 2024-04-25T09:11:46.246 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.246 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.246 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020824 s, 50.4 MB/s 2024-04-25T09:11:46.266 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.266 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.266 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182385 s, 57.5 MB/s 2024-04-25T09:11:46.285 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.285 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.285 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179155 s, 58.5 MB/s 2024-04-25T09:11:46.304 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.304 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.304 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168419 s, 62.3 MB/s 2024-04-25T09:11:46.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.323 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172537 s, 60.8 MB/s 2024-04-25T09:11:46.339 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.339 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.339 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145828 s, 71.9 MB/s 2024-04-25T09:11:46.357 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.357 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.357 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155399 s, 67.5 MB/s 2024-04-25T09:11:46.373 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.373 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.373 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146195 s, 71.7 MB/s 2024-04-25T09:11:46.390 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.390 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.390 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147472 s, 71.1 MB/s 2024-04-25T09:11:46.403 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.403 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.403 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118377 s, 88.6 MB/s 2024-04-25T09:11:46.420 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.421 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.421 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157487 s, 66.6 MB/s 2024-04-25T09:11:46.441 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.441 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.441 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184878 s, 56.7 MB/s 2024-04-25T09:11:46.461 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.461 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.461 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181417 s, 57.8 MB/s 2024-04-25T09:11:46.482 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.482 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.482 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019369 s, 54.1 MB/s 2024-04-25T09:11:46.502 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.502 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.502 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188645 s, 55.6 MB/s 2024-04-25T09:11:46.523 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.523 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.524 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194709 s, 53.9 MB/s 2024-04-25T09:11:46.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.540 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148019 s, 70.8 MB/s 2024-04-25T09:11:46.557 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.557 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.557 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150643 s, 69.6 MB/s 2024-04-25T09:11:46.573 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.573 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.574 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147801 s, 70.9 MB/s 2024-04-25T09:11:46.590 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.590 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.590 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147673 s, 71.0 MB/s 2024-04-25T09:11:46.606 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.607 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.607 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147651 s, 71.0 MB/s 2024-04-25T09:11:46.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:46.608 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:46.608 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:46.608 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.13 2024-04-25T09:11:46.608 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:46.608 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:46.608 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:46.609 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:46.686 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.686 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.686 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198895 s, 52.7 MB/s 2024-04-25T09:11:46.704 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.705 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.705 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016918 s, 62.0 MB/s 2024-04-25T09:11:46.725 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.725 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.725 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185929 s, 56.4 MB/s 2024-04-25T09:11:46.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.742 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.742 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149764 s, 70.0 MB/s 2024-04-25T09:11:46.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.759 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155421 s, 67.5 MB/s 2024-04-25T09:11:46.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.777 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162225 s, 64.6 MB/s 2024-04-25T09:11:46.796 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.796 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.796 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174925 s, 59.9 MB/s 2024-04-25T09:11:46.813 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.813 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.813 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148121 s, 70.8 MB/s 2024-04-25T09:11:46.830 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.830 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.830 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149596 s, 70.1 MB/s 2024-04-25T09:11:46.850 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.850 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.850 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187396 s, 56.0 MB/s 2024-04-25T09:11:46.871 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.871 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.871 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188329 s, 55.7 MB/s 2024-04-25T09:11:46.896 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.896 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.896 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023402 s, 44.8 MB/s 2024-04-25T09:11:46.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.914 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158349 s, 66.2 MB/s 2024-04-25T09:11:46.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.934 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183368 s, 57.2 MB/s 2024-04-25T09:11:46.957 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.957 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.957 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202764 s, 51.7 MB/s 2024-04-25T09:11:46.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:46.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:46.978 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197982 s, 53.0 MB/s 2024-04-25T09:11:47.001 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.001 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.001 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206233 s, 50.8 MB/s 2024-04-25T09:11:47.017 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.017 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.017 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014855 s, 70.6 MB/s 2024-04-25T09:11:47.039 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.039 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.039 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198129 s, 52.9 MB/s 2024-04-25T09:11:47.058 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.058 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.058 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177799 s, 59.0 MB/s 2024-04-25T09:11:47.075 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.075 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.075 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151206 s, 69.3 MB/s 2024-04-25T09:11:47.095 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.095 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.095 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181219 s, 57.9 MB/s 2024-04-25T09:11:47.112 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.112 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.112 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01482 s, 70.8 MB/s 2024-04-25T09:11:47.129 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.129 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.129 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153247 s, 68.4 MB/s 2024-04-25T09:11:47.147 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.147 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.147 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160237 s, 65.4 MB/s 2024-04-25T09:11:47.166 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.166 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.166 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176837 s, 59.3 MB/s 2024-04-25T09:11:47.186 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.186 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.186 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180387 s, 58.1 MB/s 2024-04-25T09:11:47.202 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.202 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.202 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147655 s, 71.0 MB/s 2024-04-25T09:11:47.220 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.220 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.220 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155791 s, 67.3 MB/s 2024-04-25T09:11:47.236 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.236 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.236 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147629 s, 71.0 MB/s 2024-04-25T09:11:47.255 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.255 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.255 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170731 s, 61.4 MB/s 2024-04-25T09:11:47.271 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.271 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.271 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142989 s, 73.3 MB/s 2024-04-25T09:11:47.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:47.273 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:47.273 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:47.273 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.14 2024-04-25T09:11:47.273 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:47.273 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:47.273 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:47.273 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:47.344 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.344 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.344 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146255 s, 71.7 MB/s 2024-04-25T09:11:47.364 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.364 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.364 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179178 s, 58.5 MB/s 2024-04-25T09:11:47.380 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.381 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.381 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149413 s, 70.2 MB/s 2024-04-25T09:11:47.398 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.398 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.398 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153386 s, 68.4 MB/s 2024-04-25T09:11:47.416 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.416 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.416 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170228 s, 61.6 MB/s 2024-04-25T09:11:47.430 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.430 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.430 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118497 s, 88.5 MB/s 2024-04-25T09:11:47.447 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.447 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.447 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152235 s, 68.9 MB/s 2024-04-25T09:11:47.463 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.463 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.463 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144716 s, 72.5 MB/s 2024-04-25T09:11:47.481 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.481 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.481 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162199 s, 64.6 MB/s 2024-04-25T09:11:47.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.497 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144478 s, 72.6 MB/s 2024-04-25T09:11:47.521 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.522 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223676 s, 46.9 MB/s 2024-04-25T09:11:47.539 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.539 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.539 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161826 s, 64.8 MB/s 2024-04-25T09:11:47.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.556 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153403 s, 68.4 MB/s 2024-04-25T09:11:47.572 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.572 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.573 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145092 s, 72.3 MB/s 2024-04-25T09:11:47.588 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.588 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.588 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140054 s, 74.9 MB/s 2024-04-25T09:11:47.608 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.608 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.608 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175571 s, 59.7 MB/s 2024-04-25T09:11:47.625 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.625 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.625 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152043 s, 69.0 MB/s 2024-04-25T09:11:47.645 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.645 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.645 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018185 s, 57.7 MB/s 2024-04-25T09:11:47.662 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.662 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.662 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152436 s, 68.8 MB/s 2024-04-25T09:11:47.679 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.679 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.679 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152319 s, 68.8 MB/s 2024-04-25T09:11:47.695 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.695 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.695 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014166 s, 74.0 MB/s 2024-04-25T09:11:47.711 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.711 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.711 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147133 s, 71.3 MB/s 2024-04-25T09:11:47.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.732 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.732 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184094 s, 57.0 MB/s 2024-04-25T09:11:47.748 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.748 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.748 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014541 s, 72.1 MB/s 2024-04-25T09:11:47.765 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.765 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.765 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151934 s, 69.0 MB/s 2024-04-25T09:11:47.786 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.786 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.786 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196904 s, 53.3 MB/s 2024-04-25T09:11:47.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.805 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170149 s, 61.6 MB/s 2024-04-25T09:11:47.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.822 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.822 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146546 s, 71.6 MB/s 2024-04-25T09:11:47.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.838 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142864 s, 73.4 MB/s 2024-04-25T09:11:47.854 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.854 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.854 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143183 s, 73.2 MB/s 2024-04-25T09:11:47.870 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.870 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.870 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141684 s, 74.0 MB/s 2024-04-25T09:11:47.887 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.887 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.887 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152255 s, 68.9 MB/s 2024-04-25T09:11:47.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:47.889 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:47.889 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:47.889 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.15 2024-04-25T09:11:47.889 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:47.889 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:47.889 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:47.890 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:47.959 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.960 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.960 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178065 s, 58.9 MB/s 2024-04-25T09:11:47.976 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.976 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.976 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146033 s, 71.8 MB/s 2024-04-25T09:11:47.994 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:47.994 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:47.994 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160339 s, 65.4 MB/s 2024-04-25T09:11:48.010 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.010 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.010 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144137 s, 72.7 MB/s 2024-04-25T09:11:48.026 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.026 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.026 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144956 s, 72.3 MB/s 2024-04-25T09:11:48.043 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.043 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.043 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149721 s, 70.0 MB/s 2024-04-25T09:11:48.062 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.062 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.062 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171105 s, 61.3 MB/s 2024-04-25T09:11:48.081 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.081 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.081 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167874 s, 62.5 MB/s 2024-04-25T09:11:48.098 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.098 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.098 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155297 s, 67.5 MB/s 2024-04-25T09:11:48.114 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.114 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.114 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141947 s, 73.9 MB/s 2024-04-25T09:11:48.132 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.132 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.132 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165717 s, 63.3 MB/s 2024-04-25T09:11:48.150 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.150 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.150 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157564 s, 66.5 MB/s 2024-04-25T09:11:48.166 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.166 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.166 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014598 s, 71.8 MB/s 2024-04-25T09:11:48.182 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.183 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147343 s, 71.2 MB/s 2024-04-25T09:11:48.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.200 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155319 s, 67.5 MB/s 2024-04-25T09:11:48.218 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.218 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.218 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159894 s, 65.6 MB/s 2024-04-25T09:11:48.235 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.235 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.235 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015382 s, 68.2 MB/s 2024-04-25T09:11:48.253 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.254 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.254 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169163 s, 62.0 MB/s 2024-04-25T09:11:48.269 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.269 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.270 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141323 s, 74.2 MB/s 2024-04-25T09:11:48.288 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.288 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.288 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166041 s, 63.2 MB/s 2024-04-25T09:11:48.304 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.304 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.304 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144862 s, 72.4 MB/s 2024-04-25T09:11:48.324 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.324 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.324 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018349 s, 57.1 MB/s 2024-04-25T09:11:48.340 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.340 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.341 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144166 s, 72.7 MB/s 2024-04-25T09:11:48.357 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.357 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.357 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148159 s, 70.8 MB/s 2024-04-25T09:11:48.381 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.381 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.381 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217074 s, 48.3 MB/s 2024-04-25T09:11:48.397 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.397 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.397 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143226 s, 73.2 MB/s 2024-04-25T09:11:48.418 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.418 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.418 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193647 s, 54.1 MB/s 2024-04-25T09:11:48.437 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.438 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.438 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180623 s, 58.1 MB/s 2024-04-25T09:11:48.454 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.454 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.454 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014217 s, 73.8 MB/s 2024-04-25T09:11:48.476 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.476 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.476 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204056 s, 51.4 MB/s 2024-04-25T09:11:48.493 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.493 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.494 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159006 s, 65.9 MB/s 2024-04-25T09:11:48.515 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.515 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.515 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199576 s, 52.5 MB/s 2024-04-25T09:11:48.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:48.517 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:48.517 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:48.517 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.16 2024-04-25T09:11:48.517 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:48.517 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:48.517 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:48.517 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:48.590 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.591 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.591 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164517 s, 63.7 MB/s 2024-04-25T09:11:48.608 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.608 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.609 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162121 s, 64.7 MB/s 2024-04-25T09:11:48.629 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.630 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.630 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194514 s, 53.9 MB/s 2024-04-25T09:11:48.653 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.653 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.653 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022052 s, 47.6 MB/s 2024-04-25T09:11:48.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.672 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167506 s, 62.6 MB/s 2024-04-25T09:11:48.689 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.689 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.689 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154901 s, 67.7 MB/s 2024-04-25T09:11:48.710 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.710 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.711 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195883 s, 53.5 MB/s 2024-04-25T09:11:48.727 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.727 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.727 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145116 s, 72.3 MB/s 2024-04-25T09:11:48.745 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.745 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.745 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016862 s, 62.2 MB/s 2024-04-25T09:11:48.762 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.763 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.763 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153234 s, 68.4 MB/s 2024-04-25T09:11:48.781 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.781 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.781 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170061 s, 61.7 MB/s 2024-04-25T09:11:48.801 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.801 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.801 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175027 s, 59.9 MB/s 2024-04-25T09:11:48.818 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.818 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.818 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158785 s, 66.0 MB/s 2024-04-25T09:11:48.840 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.840 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.840 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020211 s, 51.9 MB/s 2024-04-25T09:11:48.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.859 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161592 s, 64.9 MB/s 2024-04-25T09:11:48.879 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.879 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.879 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189526 s, 55.3 MB/s 2024-04-25T09:11:48.898 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.898 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.898 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017405 s, 60.2 MB/s 2024-04-25T09:11:48.919 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.920 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.920 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198656 s, 52.8 MB/s 2024-04-25T09:11:48.942 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.942 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.942 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202923 s, 51.7 MB/s 2024-04-25T09:11:48.960 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.960 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.961 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167228 s, 62.7 MB/s 2024-04-25T09:11:48.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.978 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159858 s, 65.6 MB/s 2024-04-25T09:11:48.996 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:48.996 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:48.996 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166605 s, 62.9 MB/s 2024-04-25T09:11:49.014 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.014 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.014 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155597 s, 67.4 MB/s 2024-04-25T09:11:49.031 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.031 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.031 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155326 s, 67.5 MB/s 2024-04-25T09:11:49.048 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.048 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.048 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157011 s, 66.8 MB/s 2024-04-25T09:11:49.068 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.068 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.069 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183532 s, 57.1 MB/s 2024-04-25T09:11:49.085 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.085 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.085 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145078 s, 72.3 MB/s 2024-04-25T09:11:49.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.101 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148155 s, 70.8 MB/s 2024-04-25T09:11:49.118 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.118 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.118 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150258 s, 69.8 MB/s 2024-04-25T09:11:49.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.136 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158456 s, 66.2 MB/s 2024-04-25T09:11:49.152 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.152 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.152 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145129 s, 72.3 MB/s 2024-04-25T09:11:49.170 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.170 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.170 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015861 s, 66.1 MB/s 2024-04-25T09:11:49.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:49.171 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:49.171 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:49.171 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.17 2024-04-25T09:11:49.171 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:49.172 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:49.172 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:49.172 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:49.244 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.245 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.245 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014474 s, 72.4 MB/s 2024-04-25T09:11:49.260 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.260 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.260 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014495 s, 72.3 MB/s 2024-04-25T09:11:49.277 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.277 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.277 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014704 s, 71.3 MB/s 2024-04-25T09:11:49.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.294 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151288 s, 69.3 MB/s 2024-04-25T09:11:49.311 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.312 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.312 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159933 s, 65.6 MB/s 2024-04-25T09:11:49.327 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.327 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.328 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139988 s, 74.9 MB/s 2024-04-25T09:11:49.347 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.348 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.348 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181612 s, 57.7 MB/s 2024-04-25T09:11:49.366 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.366 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.366 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163322 s, 64.2 MB/s 2024-04-25T09:11:49.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.386 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018602 s, 56.4 MB/s 2024-04-25T09:11:49.400 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.400 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.401 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125318 s, 83.7 MB/s 2024-04-25T09:11:49.420 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.421 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.421 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184125 s, 56.9 MB/s 2024-04-25T09:11:49.438 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.438 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.438 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153846 s, 68.2 MB/s 2024-04-25T09:11:49.457 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.457 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.457 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172086 s, 60.9 MB/s 2024-04-25T09:11:49.477 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.477 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.478 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189284 s, 55.4 MB/s 2024-04-25T09:11:49.498 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.498 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.498 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188555 s, 55.6 MB/s 2024-04-25T09:11:49.515 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.515 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.515 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152072 s, 69.0 MB/s 2024-04-25T09:11:49.532 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.532 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.532 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152955 s, 68.6 MB/s 2024-04-25T09:11:49.549 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.549 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.549 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154253 s, 68.0 MB/s 2024-04-25T09:11:49.568 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.568 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.568 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166646 s, 62.9 MB/s 2024-04-25T09:11:49.584 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.585 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.585 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150794 s, 69.5 MB/s 2024-04-25T09:11:49.601 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.601 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.601 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148611 s, 70.6 MB/s 2024-04-25T09:11:49.621 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.621 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.621 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161018 s, 65.1 MB/s 2024-04-25T09:11:49.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.632 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111463 s, 94.1 MB/s 2024-04-25T09:11:49.654 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.654 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.654 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199897 s, 52.5 MB/s 2024-04-25T09:11:49.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.673 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167545 s, 62.6 MB/s 2024-04-25T09:11:49.692 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.692 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.692 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178222 s, 58.8 MB/s 2024-04-25T09:11:49.708 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.708 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.708 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142291 s, 73.7 MB/s 2024-04-25T09:11:49.727 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.727 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.727 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172079 s, 60.9 MB/s 2024-04-25T09:11:49.743 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.743 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.743 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144154 s, 72.7 MB/s 2024-04-25T09:11:49.761 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.761 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.761 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158521 s, 66.1 MB/s 2024-04-25T09:11:49.779 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.779 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.779 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158479 s, 66.2 MB/s 2024-04-25T09:11:49.796 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.796 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.796 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151681 s, 69.1 MB/s 2024-04-25T09:11:49.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:49.797 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:49.797 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:49.798 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.18 2024-04-25T09:11:49.798 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:49.798 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:49.798 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:49.798 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:49.873 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.873 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.873 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189897 s, 55.2 MB/s 2024-04-25T09:11:49.894 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.894 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.894 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019362 s, 54.2 MB/s 2024-04-25T09:11:49.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.914 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018181 s, 57.7 MB/s 2024-04-25T09:11:49.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.935 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185587 s, 56.5 MB/s 2024-04-25T09:11:49.956 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.957 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.957 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205839 s, 50.9 MB/s 2024-04-25T09:11:49.974 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.974 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.974 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158182 s, 66.3 MB/s 2024-04-25T09:11:49.994 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:49.994 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:49.994 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176747 s, 59.3 MB/s 2024-04-25T09:11:50.013 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.013 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.013 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171384 s, 61.2 MB/s 2024-04-25T09:11:50.030 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.030 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.030 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158035 s, 66.4 MB/s 2024-04-25T09:11:50.048 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.048 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.048 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015688 s, 66.8 MB/s 2024-04-25T09:11:50.069 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.069 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.069 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019088 s, 54.9 MB/s 2024-04-25T09:11:50.089 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.089 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.089 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183138 s, 57.3 MB/s 2024-04-25T09:11:50.109 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.109 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.109 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018286 s, 57.3 MB/s 2024-04-25T09:11:50.125 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.126 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.126 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149274 s, 70.2 MB/s 2024-04-25T09:11:50.145 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.145 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.145 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017502 s, 59.9 MB/s 2024-04-25T09:11:50.165 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.165 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.165 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182704 s, 57.4 MB/s 2024-04-25T09:11:50.181 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.181 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.181 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149177 s, 70.3 MB/s 2024-04-25T09:11:50.202 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.202 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.202 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188948 s, 55.5 MB/s 2024-04-25T09:11:50.218 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.218 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.218 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144564 s, 72.5 MB/s 2024-04-25T09:11:50.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.240 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195109 s, 53.7 MB/s 2024-04-25T09:11:50.256 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.256 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.256 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143663 s, 73.0 MB/s 2024-04-25T09:11:50.276 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.276 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.277 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189301 s, 55.4 MB/s 2024-04-25T09:11:50.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.298 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195006 s, 53.8 MB/s 2024-04-25T09:11:50.317 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.317 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.317 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017619 s, 59.5 MB/s 2024-04-25T09:11:50.337 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.337 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.337 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183043 s, 57.3 MB/s 2024-04-25T09:11:50.356 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.356 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.356 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171743 s, 61.1 MB/s 2024-04-25T09:11:50.375 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.375 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.375 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167837 s, 62.5 MB/s 2024-04-25T09:11:50.392 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.392 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.393 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156681 s, 66.9 MB/s 2024-04-25T09:11:50.409 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.409 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.409 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148248 s, 70.7 MB/s 2024-04-25T09:11:50.426 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.427 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.427 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157433 s, 66.6 MB/s 2024-04-25T09:11:50.442 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.442 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.443 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142986 s, 73.3 MB/s 2024-04-25T09:11:50.462 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.462 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.462 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175803 s, 59.6 MB/s 2024-04-25T09:11:50.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:50.463 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:50.464 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:50.464 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.19 2024-04-25T09:11:50.464 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:50.464 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:50.464 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:50.464 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:50.537 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.537 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.537 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154505 s, 67.9 MB/s 2024-04-25T09:11:50.557 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.557 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.557 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178179 s, 58.8 MB/s 2024-04-25T09:11:50.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.630 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.631 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175288 s, 59.8 MB/s 2024-04-25T09:11:50.631 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.631 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.631 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159001 s, 65.9 MB/s 2024-04-25T09:11:50.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.632 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168236 s, 62.3 MB/s 2024-04-25T09:11:50.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.632 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148587 s, 70.6 MB/s 2024-04-25T09:11:50.645 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.646 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.646 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148916 s, 70.4 MB/s 2024-04-25T09:11:50.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.661 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140161 s, 74.8 MB/s 2024-04-25T09:11:50.678 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.678 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.679 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153859 s, 68.2 MB/s 2024-04-25T09:11:50.696 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.696 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.696 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161501 s, 64.9 MB/s 2024-04-25T09:11:50.712 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.712 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.712 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141752 s, 74.0 MB/s 2024-04-25T09:11:50.728 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.728 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.728 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140825 s, 74.5 MB/s 2024-04-25T09:11:50.745 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.745 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.745 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148722 s, 70.5 MB/s 2024-04-25T09:11:50.761 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.761 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.762 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146854 s, 71.4 MB/s 2024-04-25T09:11:50.782 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.782 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.782 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191296 s, 54.8 MB/s 2024-04-25T09:11:50.802 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.803 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.803 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184397 s, 56.9 MB/s 2024-04-25T09:11:50.822 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.822 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.822 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179565 s, 58.4 MB/s 2024-04-25T09:11:50.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.838 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140928 s, 74.4 MB/s 2024-04-25T09:11:50.856 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.856 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.856 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015788 s, 66.4 MB/s 2024-04-25T09:11:50.872 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.872 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.872 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139967 s, 74.9 MB/s 2024-04-25T09:11:50.889 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.889 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.889 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153518 s, 68.3 MB/s 2024-04-25T09:11:50.907 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.907 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.907 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161024 s, 65.1 MB/s 2024-04-25T09:11:50.923 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.923 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.923 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014595 s, 71.8 MB/s 2024-04-25T09:11:50.941 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.941 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.942 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164019 s, 63.9 MB/s 2024-04-25T09:11:50.962 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.962 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.962 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187039 s, 56.1 MB/s 2024-04-25T09:11:50.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.978 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142607 s, 73.5 MB/s 2024-04-25T09:11:50.994 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:50.994 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:50.994 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145413 s, 72.1 MB/s 2024-04-25T09:11:51.010 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.010 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.010 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143518 s, 73.1 MB/s 2024-04-25T09:11:51.027 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.028 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.028 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154149 s, 68.0 MB/s 2024-04-25T09:11:51.045 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.046 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.046 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159814 s, 65.6 MB/s 2024-04-25T09:11:51.070 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.070 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.070 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230415 s, 45.5 MB/s 2024-04-25T09:11:51.090 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.090 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.090 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183026 s, 57.3 MB/s 2024-04-25T09:11:51.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:51.092 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:51.092 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:51.092 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.20 2024-04-25T09:11:51.092 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:51.092 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:51.092 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:51.092 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:51.168 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.168 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.168 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018097 s, 57.9 MB/s 2024-04-25T09:11:51.185 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.185 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.185 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154465 s, 67.9 MB/s 2024-04-25T09:11:51.209 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.210 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.210 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229044 s, 45.8 MB/s 2024-04-25T09:11:51.227 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.227 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.227 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157702 s, 66.5 MB/s 2024-04-25T09:11:51.248 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.248 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.248 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193096 s, 54.3 MB/s 2024-04-25T09:11:51.265 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.266 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.266 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157649 s, 66.5 MB/s 2024-04-25T09:11:51.283 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.283 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.283 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156482 s, 67.0 MB/s 2024-04-25T09:11:51.300 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.300 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.300 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015482 s, 67.7 MB/s 2024-04-25T09:11:51.316 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.316 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.316 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142016 s, 73.8 MB/s 2024-04-25T09:11:51.334 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.334 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.335 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161288 s, 65.0 MB/s 2024-04-25T09:11:51.352 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.352 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.352 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160876 s, 65.2 MB/s 2024-04-25T09:11:51.369 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.370 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.370 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158797 s, 66.0 MB/s 2024-04-25T09:11:51.389 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.390 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.390 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180145 s, 58.2 MB/s 2024-04-25T09:11:51.406 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.406 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.406 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149784 s, 70.0 MB/s 2024-04-25T09:11:51.423 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.423 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.423 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148226 s, 70.7 MB/s 2024-04-25T09:11:51.442 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.442 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.442 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174089 s, 60.2 MB/s 2024-04-25T09:11:51.459 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.459 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.459 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150216 s, 69.8 MB/s 2024-04-25T09:11:51.475 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.475 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.475 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142472 s, 73.6 MB/s 2024-04-25T09:11:51.493 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.493 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.493 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162384 s, 64.6 MB/s 2024-04-25T09:11:51.512 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.512 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.512 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170612 s, 61.5 MB/s 2024-04-25T09:11:51.528 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.528 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.528 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146588 s, 71.5 MB/s 2024-04-25T09:11:51.549 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.549 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.550 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193186 s, 54.3 MB/s 2024-04-25T09:11:51.565 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.565 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.565 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141766 s, 74.0 MB/s 2024-04-25T09:11:51.581 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.581 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.581 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142432 s, 73.6 MB/s 2024-04-25T09:11:51.600 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.600 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.600 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171788 s, 61.0 MB/s 2024-04-25T09:11:51.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.624 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213155 s, 49.2 MB/s 2024-04-25T09:11:51.642 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.643 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.643 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170565 s, 61.5 MB/s 2024-04-25T09:11:51.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.661 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163892 s, 64.0 MB/s 2024-04-25T09:11:51.678 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.678 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.678 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154397 s, 67.9 MB/s 2024-04-25T09:11:51.694 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.694 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.694 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145618 s, 72.0 MB/s 2024-04-25T09:11:51.715 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.715 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.715 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188038 s, 55.8 MB/s 2024-04-25T09:11:51.737 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.737 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.737 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200704 s, 52.2 MB/s 2024-04-25T09:11:51.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:51.738 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:51.738 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:51.739 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.21 2024-04-25T09:11:51.739 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:51.739 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:51.739 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:51.739 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:51.812 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.812 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.812 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178606 s, 58.7 MB/s 2024-04-25T09:11:51.828 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.828 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.828 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143643 s, 73.0 MB/s 2024-04-25T09:11:51.847 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.847 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.847 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173612 s, 60.4 MB/s 2024-04-25T09:11:51.866 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.866 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.866 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01709 s, 61.4 MB/s 2024-04-25T09:11:51.885 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.885 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.885 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170266 s, 61.6 MB/s 2024-04-25T09:11:51.901 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.901 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.902 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014947 s, 70.2 MB/s 2024-04-25T09:11:51.920 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.920 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.920 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016145 s, 64.9 MB/s 2024-04-25T09:11:51.942 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.942 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.942 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195481 s, 53.6 MB/s 2024-04-25T09:11:51.961 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.961 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.961 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174008 s, 60.3 MB/s 2024-04-25T09:11:51.977 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:51.977 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:51.978 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144434 s, 72.6 MB/s 2024-04-25T09:11:52.001 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.001 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.001 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219351 s, 47.8 MB/s 2024-04-25T09:11:52.018 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.019 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.019 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156441 s, 67.0 MB/s 2024-04-25T09:11:52.035 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.035 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.035 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151293 s, 69.3 MB/s 2024-04-25T09:11:52.051 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.051 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.051 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139348 s, 75.2 MB/s 2024-04-25T09:11:52.067 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.068 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.068 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144507 s, 72.6 MB/s 2024-04-25T09:11:52.085 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.085 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.085 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151707 s, 69.1 MB/s 2024-04-25T09:11:52.102 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.102 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.102 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016049 s, 65.3 MB/s 2024-04-25T09:11:52.118 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.119 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.119 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145419 s, 72.1 MB/s 2024-04-25T09:11:52.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.137 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161232 s, 65.0 MB/s 2024-04-25T09:11:52.152 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.153 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.153 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142906 s, 73.4 MB/s 2024-04-25T09:11:52.172 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.172 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.172 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173164 s, 60.6 MB/s 2024-04-25T09:11:52.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.192 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018261 s, 57.4 MB/s 2024-04-25T09:11:52.211 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.211 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.212 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177909 s, 58.9 MB/s 2024-04-25T09:11:52.233 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.234 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.234 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202343 s, 51.8 MB/s 2024-04-25T09:11:52.252 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.252 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.252 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163435 s, 64.2 MB/s 2024-04-25T09:11:52.270 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.270 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.270 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164927 s, 63.6 MB/s 2024-04-25T09:11:52.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.294 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218666 s, 48.0 MB/s 2024-04-25T09:11:52.310 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.310 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.310 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146631 s, 71.5 MB/s 2024-04-25T09:11:52.334 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.334 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.334 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218979 s, 47.9 MB/s 2024-04-25T09:11:52.351 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.352 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.352 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147923 s, 70.9 MB/s 2024-04-25T09:11:52.367 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.367 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.367 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146823 s, 71.4 MB/s 2024-04-25T09:11:52.385 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.386 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169916 s, 61.7 MB/s 2024-04-25T09:11:52.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:52.387 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:52.387 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:52.387 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.22 2024-04-25T09:11:52.387 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:52.387 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:52.387 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:52.387 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:52.457 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.457 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.457 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143778 s, 72.9 MB/s 2024-04-25T09:11:52.473 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.473 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.473 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146933 s, 71.4 MB/s 2024-04-25T09:11:52.491 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.491 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.491 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157636 s, 66.5 MB/s 2024-04-25T09:11:52.510 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.511 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.511 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178855 s, 58.6 MB/s 2024-04-25T09:11:52.528 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.528 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.528 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154639 s, 67.8 MB/s 2024-04-25T09:11:52.545 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.546 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.546 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159863 s, 65.6 MB/s 2024-04-25T09:11:52.562 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.562 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.562 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145932 s, 71.9 MB/s 2024-04-25T09:11:52.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.578 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145221 s, 72.2 MB/s 2024-04-25T09:11:52.597 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.597 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.598 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175852 s, 59.6 MB/s 2024-04-25T09:11:52.616 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.616 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.616 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167823 s, 62.5 MB/s 2024-04-25T09:11:52.636 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.636 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.636 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178979 s, 58.6 MB/s 2024-04-25T09:11:52.656 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.656 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.656 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017992 s, 58.3 MB/s 2024-04-25T09:11:52.674 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.674 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.674 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168136 s, 62.4 MB/s 2024-04-25T09:11:52.691 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.691 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.691 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150103 s, 69.9 MB/s 2024-04-25T09:11:52.707 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.707 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.707 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141146 s, 74.3 MB/s 2024-04-25T09:11:52.724 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.724 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.724 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151503 s, 69.2 MB/s 2024-04-25T09:11:52.740 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.740 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.740 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144476 s, 72.6 MB/s 2024-04-25T09:11:52.757 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.757 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.757 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147188 s, 71.2 MB/s 2024-04-25T09:11:52.776 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.776 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.776 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170554 s, 61.5 MB/s 2024-04-25T09:11:52.792 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.792 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.792 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144557 s, 72.5 MB/s 2024-04-25T09:11:52.809 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.810 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.810 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158174 s, 66.3 MB/s 2024-04-25T09:11:52.830 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.830 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.830 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189724 s, 55.3 MB/s 2024-04-25T09:11:52.851 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.851 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.851 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194359 s, 54.0 MB/s 2024-04-25T09:11:52.868 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.868 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.868 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146047 s, 71.8 MB/s 2024-04-25T09:11:52.884 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.884 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.884 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014504 s, 72.3 MB/s 2024-04-25T09:11:52.903 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.903 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.903 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169209 s, 62.0 MB/s 2024-04-25T09:11:52.919 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.919 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.919 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143416 s, 73.1 MB/s 2024-04-25T09:11:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150196 s, 69.8 MB/s 2024-04-25T09:11:52.952 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.952 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.952 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146224 s, 71.7 MB/s 2024-04-25T09:11:52.971 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.972 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.972 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176152 s, 59.5 MB/s 2024-04-25T09:11:52.988 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:52.988 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:52.988 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144714 s, 72.5 MB/s 2024-04-25T09:11:53.009 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.009 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.009 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188789 s, 55.5 MB/s 2024-04-25T09:11:53.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:53.010 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:53.010 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:53.010 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.23 2024-04-25T09:11:53.011 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:53.011 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:53.011 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:53.011 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:53.082 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.082 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.082 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158508 s, 66.2 MB/s 2024-04-25T09:11:53.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.101 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180128 s, 58.2 MB/s 2024-04-25T09:11:53.118 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.118 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.119 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153714 s, 68.2 MB/s 2024-04-25T09:11:53.137 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.137 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.137 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172559 s, 60.8 MB/s 2024-04-25T09:11:53.153 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.153 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.153 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141139 s, 74.3 MB/s 2024-04-25T09:11:53.169 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.170 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.170 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145447 s, 72.1 MB/s 2024-04-25T09:11:53.186 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.186 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.186 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144182 s, 72.7 MB/s 2024-04-25T09:11:53.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.205 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174261 s, 60.2 MB/s 2024-04-25T09:11:53.221 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.221 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.222 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146269 s, 71.7 MB/s 2024-04-25T09:11:53.238 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.239 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.239 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153349 s, 68.4 MB/s 2024-04-25T09:11:53.254 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.254 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.254 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140291 s, 74.7 MB/s 2024-04-25T09:11:53.272 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.272 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.272 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160926 s, 65.2 MB/s 2024-04-25T09:11:53.289 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.289 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.289 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153904 s, 68.1 MB/s 2024-04-25T09:11:53.306 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.306 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.306 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146278 s, 71.7 MB/s 2024-04-25T09:11:53.322 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.322 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.322 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148967 s, 70.4 MB/s 2024-04-25T09:11:53.344 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.344 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.344 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01948 s, 53.8 MB/s 2024-04-25T09:11:53.362 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.362 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.362 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016625 s, 63.1 MB/s 2024-04-25T09:11:53.376 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.376 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.376 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121331 s, 86.4 MB/s 2024-04-25T09:11:53.392 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.392 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.392 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146108 s, 71.8 MB/s 2024-04-25T09:11:53.408 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.409 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.409 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014217 s, 73.8 MB/s 2024-04-25T09:11:53.425 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.425 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.426 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154157 s, 68.0 MB/s 2024-04-25T09:11:53.443 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.443 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.443 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154016 s, 68.1 MB/s 2024-04-25T09:11:53.459 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.459 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.459 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144686 s, 72.5 MB/s 2024-04-25T09:11:53.477 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.478 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.478 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168436 s, 62.3 MB/s 2024-04-25T09:11:53.500 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.500 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.500 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204739 s, 51.2 MB/s 2024-04-25T09:11:53.520 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.521 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.521 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191295 s, 54.8 MB/s 2024-04-25T09:11:53.538 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.538 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.538 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157968 s, 66.4 MB/s 2024-04-25T09:11:53.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.559 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191692 s, 54.7 MB/s 2024-04-25T09:11:53.577 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.577 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.577 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158322 s, 66.2 MB/s 2024-04-25T09:11:53.595 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.595 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.595 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165373 s, 63.4 MB/s 2024-04-25T09:11:53.611 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.611 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.611 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145418 s, 72.1 MB/s 2024-04-25T09:11:53.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.628 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152242 s, 68.9 MB/s 2024-04-25T09:11:53.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:53.630 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:53.630 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:53.630 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.24 2024-04-25T09:11:53.630 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:53.630 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:53.630 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:53.630 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:53.700 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.700 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.700 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143265 s, 73.2 MB/s 2024-04-25T09:11:53.720 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.720 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.720 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176381 s, 59.4 MB/s 2024-04-25T09:11:53.740 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.740 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.740 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182563 s, 57.4 MB/s 2024-04-25T09:11:53.758 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.758 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.758 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162751 s, 64.4 MB/s 2024-04-25T09:11:53.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.777 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172725 s, 60.7 MB/s 2024-04-25T09:11:53.793 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.793 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.794 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145389 s, 72.1 MB/s 2024-04-25T09:11:53.812 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.812 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.812 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016896 s, 62.1 MB/s 2024-04-25T09:11:53.830 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.830 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.830 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158786 s, 66.0 MB/s 2024-04-25T09:11:53.846 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.846 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.847 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150435 s, 69.7 MB/s 2024-04-25T09:11:53.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.865 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162867 s, 64.4 MB/s 2024-04-25T09:11:53.885 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.885 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.885 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180557 s, 58.1 MB/s 2024-04-25T09:11:53.902 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.902 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.902 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153687 s, 68.2 MB/s 2024-04-25T09:11:53.919 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.919 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.919 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160348 s, 65.4 MB/s 2024-04-25T09:11:53.941 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.941 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.941 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200497 s, 52.3 MB/s 2024-04-25T09:11:53.958 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.958 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.958 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156597 s, 67.0 MB/s 2024-04-25T09:11:53.977 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.977 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.977 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167821 s, 62.5 MB/s 2024-04-25T09:11:53.994 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:53.994 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:53.994 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153296 s, 68.4 MB/s 2024-04-25T09:11:54.010 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.011 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.011 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146487 s, 71.6 MB/s 2024-04-25T09:11:54.028 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.028 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.028 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152329 s, 68.8 MB/s 2024-04-25T09:11:54.046 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.046 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.046 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167944 s, 62.4 MB/s 2024-04-25T09:11:54.069 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.069 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.069 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206343 s, 50.8 MB/s 2024-04-25T09:11:54.090 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.091 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.091 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200905 s, 52.2 MB/s 2024-04-25T09:11:54.108 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.108 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.108 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156031 s, 67.2 MB/s 2024-04-25T09:11:54.126 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.126 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.126 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159669 s, 65.7 MB/s 2024-04-25T09:11:54.143 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.144 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.144 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159338 s, 65.8 MB/s 2024-04-25T09:11:54.160 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.161 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.161 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148026 s, 70.8 MB/s 2024-04-25T09:11:54.182 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.182 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.182 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199071 s, 52.7 MB/s 2024-04-25T09:11:54.199 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.199 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.199 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154825 s, 67.7 MB/s 2024-04-25T09:11:54.219 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.219 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.219 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177457 s, 59.1 MB/s 2024-04-25T09:11:54.235 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.235 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.235 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142614 s, 73.5 MB/s 2024-04-25T09:11:54.249 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.249 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.249 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116393 s, 90.1 MB/s 2024-04-25T09:11:54.270 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.270 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.271 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200236 s, 52.4 MB/s 2024-04-25T09:11:54.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:54.272 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:54.272 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:54.272 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.25 2024-04-25T09:11:54.272 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:54.272 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:54.272 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:54.272 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:54.342 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.342 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.342 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016907 s, 62.0 MB/s 2024-04-25T09:11:54.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.360 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155835 s, 67.3 MB/s 2024-04-25T09:11:54.378 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.378 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.379 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169956 s, 61.7 MB/s 2024-04-25T09:11:54.396 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.396 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.396 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155478 s, 67.4 MB/s 2024-04-25T09:11:54.412 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.412 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.412 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014561 s, 72.0 MB/s 2024-04-25T09:11:54.431 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.431 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.431 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172778 s, 60.7 MB/s 2024-04-25T09:11:54.455 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.455 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.455 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222167 s, 47.2 MB/s 2024-04-25T09:11:54.474 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.474 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.474 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168067 s, 62.4 MB/s 2024-04-25T09:11:54.495 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.496 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.496 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197084 s, 53.2 MB/s 2024-04-25T09:11:54.513 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.513 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.513 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156169 s, 67.1 MB/s 2024-04-25T09:11:54.530 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.530 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.530 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151335 s, 69.3 MB/s 2024-04-25T09:11:54.547 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.547 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.547 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158502 s, 66.2 MB/s 2024-04-25T09:11:54.568 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.568 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.568 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189402 s, 55.4 MB/s 2024-04-25T09:11:54.585 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.585 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.585 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150766 s, 69.5 MB/s 2024-04-25T09:11:54.601 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.601 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.601 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145396 s, 72.1 MB/s 2024-04-25T09:11:54.618 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.618 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.618 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147982 s, 70.9 MB/s 2024-04-25T09:11:54.634 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.634 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.634 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144581 s, 72.5 MB/s 2024-04-25T09:11:54.652 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.653 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.653 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168868 s, 62.1 MB/s 2024-04-25T09:11:54.669 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.669 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.669 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149953 s, 69.9 MB/s 2024-04-25T09:11:54.685 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.686 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.686 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145099 s, 72.3 MB/s 2024-04-25T09:11:54.703 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.703 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.703 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157906 s, 66.4 MB/s 2024-04-25T09:11:54.720 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.721 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.721 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155525 s, 67.4 MB/s 2024-04-25T09:11:54.737 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.738 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.738 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151348 s, 69.3 MB/s 2024-04-25T09:11:54.758 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.759 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019187 s, 54.7 MB/s 2024-04-25T09:11:54.774 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.774 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.775 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142773 s, 73.4 MB/s 2024-04-25T09:11:54.791 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.791 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.791 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144825 s, 72.4 MB/s 2024-04-25T09:11:54.808 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.808 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.808 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154225 s, 68.0 MB/s 2024-04-25T09:11:54.825 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.825 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.825 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147675 s, 71.0 MB/s 2024-04-25T09:11:54.841 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.841 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.841 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141221 s, 74.3 MB/s 2024-04-25T09:11:54.860 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.860 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.860 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174523 s, 60.1 MB/s 2024-04-25T09:11:54.874 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.874 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.874 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012316 s, 85.1 MB/s 2024-04-25T09:11:54.891 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.891 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.891 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154218 s, 68.0 MB/s 2024-04-25T09:11:54.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:54.893 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:54.893 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:54.893 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.26 2024-04-25T09:11:54.893 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:54.893 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:54.893 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:54.893 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:54.965 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.966 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.966 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011404 s, 91.9 MB/s 2024-04-25T09:11:54.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.982 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147433 s, 71.1 MB/s 2024-04-25T09:11:54.998 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:54.998 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:54.998 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143803 s, 72.9 MB/s 2024-04-25T09:11:55.015 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.015 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.015 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148171 s, 70.8 MB/s 2024-04-25T09:11:55.032 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.032 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.032 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150179 s, 69.8 MB/s 2024-04-25T09:11:55.051 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.052 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.052 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180744 s, 58.0 MB/s 2024-04-25T09:11:55.071 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.071 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.071 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175136 s, 59.9 MB/s 2024-04-25T09:11:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243938 s, 43.0 MB/s 2024-04-25T09:11:55.113 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.114 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.114 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146058 s, 71.8 MB/s 2024-04-25T09:11:55.132 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.132 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.133 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171237 s, 61.2 MB/s 2024-04-25T09:11:55.154 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.154 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.154 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197673 s, 53.0 MB/s 2024-04-25T09:11:55.175 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.175 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.175 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190243 s, 55.1 MB/s 2024-04-25T09:11:55.191 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.191 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.191 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147625 s, 71.0 MB/s 2024-04-25T09:11:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205417 s, 51.0 MB/s 2024-04-25T09:11:55.233 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.233 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.233 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173956 s, 60.3 MB/s 2024-04-25T09:11:55.250 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.250 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.250 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151218 s, 69.3 MB/s 2024-04-25T09:11:55.271 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.271 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.271 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190642 s, 55.0 MB/s 2024-04-25T09:11:55.287 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.287 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.287 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143929 s, 72.9 MB/s 2024-04-25T09:11:55.305 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.305 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.305 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161609 s, 64.9 MB/s 2024-04-25T09:11:55.321 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.321 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.321 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145895 s, 71.9 MB/s 2024-04-25T09:11:55.338 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.338 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.338 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153164 s, 68.5 MB/s 2024-04-25T09:11:55.357 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.357 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.357 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171399 s, 61.2 MB/s 2024-04-25T09:11:55.378 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.379 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.379 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196367 s, 53.4 MB/s 2024-04-25T09:11:55.399 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.399 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.399 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018398 s, 57.0 MB/s 2024-04-25T09:11:55.415 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.416 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.416 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150431 s, 69.7 MB/s 2024-04-25T09:11:55.434 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.434 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.434 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167607 s, 62.6 MB/s 2024-04-25T09:11:55.450 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.450 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.450 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144511 s, 72.6 MB/s 2024-04-25T09:11:55.467 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.467 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.467 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152031 s, 69.0 MB/s 2024-04-25T09:11:55.486 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.486 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.486 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016679 s, 62.9 MB/s 2024-04-25T09:11:55.502 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.502 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.502 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147529 s, 71.1 MB/s 2024-04-25T09:11:55.519 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.519 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.519 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151221 s, 69.3 MB/s 2024-04-25T09:11:55.537 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.537 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.537 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016534 s, 63.4 MB/s 2024-04-25T09:11:55.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:55.539 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:55.539 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:55.539 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.27 2024-04-25T09:11:55.539 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:55.539 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:55.539 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:55.539 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:55.613 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.613 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.614 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019545 s, 53.6 MB/s 2024-04-25T09:11:55.630 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.630 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.631 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014844 s, 70.6 MB/s 2024-04-25T09:11:55.651 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.651 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.651 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193139 s, 54.3 MB/s 2024-04-25T09:11:55.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.672 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190026 s, 55.2 MB/s 2024-04-25T09:11:55.689 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.689 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.690 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156243 s, 67.1 MB/s 2024-04-25T09:11:55.711 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.711 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.711 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197325 s, 53.1 MB/s 2024-04-25T09:11:55.727 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.727 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.728 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145381 s, 72.1 MB/s 2024-04-25T09:11:55.745 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.746 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.746 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161296 s, 65.0 MB/s 2024-04-25T09:11:55.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.766 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181947 s, 57.6 MB/s 2024-04-25T09:11:55.782 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.782 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.782 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148335 s, 70.7 MB/s 2024-04-25T09:11:55.801 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.801 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.801 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166586 s, 62.9 MB/s 2024-04-25T09:11:55.818 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.818 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.818 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156081 s, 67.2 MB/s 2024-04-25T09:11:55.835 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.835 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.835 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148862 s, 70.4 MB/s 2024-04-25T09:11:55.853 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.853 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.853 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169943 s, 61.7 MB/s 2024-04-25T09:11:55.870 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.870 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.870 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150979 s, 69.5 MB/s 2024-04-25T09:11:55.890 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.891 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.891 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01848 s, 56.7 MB/s 2024-04-25T09:11:55.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.912 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196645 s, 53.3 MB/s 2024-04-25T09:11:55.929 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.929 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.929 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151803 s, 69.1 MB/s 2024-04-25T09:11:55.945 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.946 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.946 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014818 s, 70.8 MB/s 2024-04-25T09:11:55.963 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.963 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.963 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158394 s, 66.2 MB/s 2024-04-25T09:11:55.979 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:55.979 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:55.979 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143527 s, 73.1 MB/s 2024-04-25T09:11:56.001 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.001 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.001 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201858 s, 51.9 MB/s 2024-04-25T09:11:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171922 s, 61.0 MB/s 2024-04-25T09:11:56.037 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.037 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.037 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148596 s, 70.6 MB/s 2024-04-25T09:11:56.051 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.051 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.051 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125684 s, 83.4 MB/s 2024-04-25T09:11:56.075 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.075 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.075 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216955 s, 48.3 MB/s 2024-04-25T09:11:56.091 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.092 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.092 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149825 s, 70.0 MB/s 2024-04-25T09:11:56.108 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.108 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.108 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144137 s, 72.7 MB/s 2024-04-25T09:11:56.124 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.124 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.125 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146573 s, 71.5 MB/s 2024-04-25T09:11:56.148 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.148 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.148 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021686 s, 48.4 MB/s 2024-04-25T09:11:56.164 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.164 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.165 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146648 s, 71.5 MB/s 2024-04-25T09:11:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014828 s, 70.7 MB/s 2024-04-25T09:11:56.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:56.182 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:56.183 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:56.183 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.28 2024-04-25T09:11:56.183 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:56.183 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:56.183 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:56.183 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:56.252 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.253 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.253 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150187 s, 69.8 MB/s 2024-04-25T09:11:56.269 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.269 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.269 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01424 s, 73.6 MB/s 2024-04-25T09:11:56.285 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.285 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.285 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150198 s, 69.8 MB/s 2024-04-25T09:11:56.302 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.302 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.302 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148129 s, 70.8 MB/s 2024-04-25T09:11:56.319 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.319 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.319 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153471 s, 68.3 MB/s 2024-04-25T09:11:56.335 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.336 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.336 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144025 s, 72.8 MB/s 2024-04-25T09:11:56.351 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.351 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.351 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134166 s, 78.2 MB/s 2024-04-25T09:11:56.369 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.369 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.369 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166168 s, 63.1 MB/s 2024-04-25T09:11:56.389 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.389 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.389 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182697 s, 57.4 MB/s 2024-04-25T09:11:56.410 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.411 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.411 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019124 s, 54.8 MB/s 2024-04-25T09:11:56.428 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.428 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.429 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163754 s, 64.0 MB/s 2024-04-25T09:11:56.446 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.446 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.446 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154865 s, 67.7 MB/s 2024-04-25T09:11:56.465 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.466 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.466 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181003 s, 57.9 MB/s 2024-04-25T09:11:56.488 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.488 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.488 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207415 s, 50.6 MB/s 2024-04-25T09:11:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150487 s, 69.7 MB/s 2024-04-25T09:11:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219283 s, 47.8 MB/s 2024-04-25T09:11:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192497 s, 54.5 MB/s 2024-04-25T09:11:56.567 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.567 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.567 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151662 s, 69.1 MB/s 2024-04-25T09:11:56.584 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.584 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.584 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153751 s, 68.2 MB/s 2024-04-25T09:11:56.602 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.602 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.602 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162328 s, 64.6 MB/s 2024-04-25T09:11:56.620 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.620 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.620 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155198 s, 67.6 MB/s 2024-04-25T09:11:56.636 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.636 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.636 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145906 s, 71.9 MB/s 2024-04-25T09:11:56.653 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.653 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.653 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148584 s, 70.6 MB/s 2024-04-25T09:11:56.673 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.673 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.673 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186321 s, 56.3 MB/s 2024-04-25T09:11:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.690 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146665 s, 71.5 MB/s 2024-04-25T09:11:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189365 s, 55.4 MB/s 2024-04-25T09:11:56.727 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.727 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.727 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148833 s, 70.5 MB/s 2024-04-25T09:11:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150576 s, 69.6 MB/s 2024-04-25T09:11:56.761 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.761 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.761 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150809 s, 69.5 MB/s 2024-04-25T09:11:56.780 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.781 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.781 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177588 s, 59.0 MB/s 2024-04-25T09:11:56.797 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.797 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.797 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015125 s, 69.3 MB/s 2024-04-25T09:11:56.820 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.820 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.820 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210641 s, 49.8 MB/s 2024-04-25T09:11:56.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:56.822 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:56.822 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:56.822 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.29 2024-04-25T09:11:56.822 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:56.822 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:56.823 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:56.823 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:56.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186226 s, 56.3 MB/s 2024-04-25T09:11:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180827 s, 58.0 MB/s 2024-04-25T09:11:57.010 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.010 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.010 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199447 s, 52.6 MB/s 2024-04-25T09:11:57.033 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.033 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.033 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214098 s, 49.0 MB/s 2024-04-25T09:11:57.047 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.047 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.047 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117823 s, 89.0 MB/s 2024-04-25T09:11:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116433 s, 90.1 MB/s 2024-04-25T09:11:57.077 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.077 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.077 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150518 s, 69.7 MB/s 2024-04-25T09:11:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158359 s, 66.2 MB/s 2024-04-25T09:11:57.111 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.111 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.112 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151008 s, 69.4 MB/s 2024-04-25T09:11:57.129 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.130 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.130 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163696 s, 64.1 MB/s 2024-04-25T09:11:57.149 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.149 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.149 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178857 s, 58.6 MB/s 2024-04-25T09:11:57.166 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.166 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.166 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153237 s, 68.4 MB/s 2024-04-25T09:11:57.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.184 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153597 s, 68.3 MB/s 2024-04-25T09:11:57.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.200 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149529 s, 70.1 MB/s 2024-04-25T09:11:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149569 s, 70.1 MB/s 2024-04-25T09:11:57.233 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.234 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.234 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148735 s, 70.5 MB/s 2024-04-25T09:11:57.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.257 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218082 s, 48.1 MB/s 2024-04-25T09:11:57.273 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.273 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.273 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014466 s, 72.5 MB/s 2024-04-25T09:11:57.291 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.291 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.291 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155285 s, 67.5 MB/s 2024-04-25T09:11:57.309 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.309 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.309 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169032 s, 62.0 MB/s 2024-04-25T09:11:57.326 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.326 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.326 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151222 s, 69.3 MB/s 2024-04-25T09:11:57.349 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.349 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.349 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212902 s, 49.3 MB/s 2024-04-25T09:11:57.369 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.369 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.370 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185113 s, 56.6 MB/s 2024-04-25T09:11:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147987 s, 70.9 MB/s 2024-04-25T09:11:57.402 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.402 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.402 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141967 s, 73.9 MB/s 2024-04-25T09:11:57.417 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.417 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.417 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131431 s, 79.8 MB/s 2024-04-25T09:11:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120829 s, 86.8 MB/s 2024-04-25T09:11:57.446 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.447 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.447 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138073 s, 75.9 MB/s 2024-04-25T09:11:57.463 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.463 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.463 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147924 s, 70.9 MB/s 2024-04-25T09:11:57.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.484 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191201 s, 54.8 MB/s 2024-04-25T09:11:57.500 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.500 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.500 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141705 s, 74.0 MB/s 2024-04-25T09:11:57.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.522 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203585 s, 51.5 MB/s 2024-04-25T09:11:57.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:57.524 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:57.524 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:57.524 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.30 2024-04-25T09:11:57.524 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:57.524 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:57.524 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:57.524 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:57.557 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.557 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.557 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193018 s, 54.3 MB/s 2024-04-25T09:11:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154688 s, 67.8 MB/s 2024-04-25T09:11:57.591 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.591 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.591 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149016 s, 70.4 MB/s 2024-04-25T09:11:57.607 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.607 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.607 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144923 s, 72.4 MB/s 2024-04-25T09:11:57.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.632 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227969 s, 46.0 MB/s 2024-04-25T09:11:57.653 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.653 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.653 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193704 s, 54.1 MB/s 2024-04-25T09:11:57.673 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.673 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.673 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183272 s, 57.2 MB/s 2024-04-25T09:11:57.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.690 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151477 s, 69.2 MB/s 2024-04-25T09:11:57.706 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.706 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.706 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014556 s, 72.0 MB/s 2024-04-25T09:11:57.727 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.727 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.727 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187465 s, 55.9 MB/s 2024-04-25T09:11:57.740 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.741 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120984 s, 86.7 MB/s 2024-04-25T09:11:57.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.759 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167505 s, 62.6 MB/s 2024-04-25T09:11:57.780 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.780 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.780 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187279 s, 56.0 MB/s 2024-04-25T09:11:57.797 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.798 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.798 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158743 s, 66.1 MB/s 2024-04-25T09:11:57.815 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.815 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.815 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156463 s, 67.0 MB/s 2024-04-25T09:11:57.832 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.832 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.832 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151798 s, 69.1 MB/s 2024-04-25T09:11:57.848 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.848 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.848 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145816 s, 71.9 MB/s 2024-04-25T09:11:57.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.865 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150691 s, 69.6 MB/s 2024-04-25T09:11:57.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.882 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146206 s, 71.7 MB/s 2024-04-25T09:11:57.900 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.900 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.900 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167432 s, 62.6 MB/s 2024-04-25T09:11:57.921 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.922 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.922 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198236 s, 52.9 MB/s 2024-04-25T09:11:57.938 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.938 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.938 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148183 s, 70.8 MB/s 2024-04-25T09:11:57.957 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.957 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.957 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168878 s, 62.1 MB/s 2024-04-25T09:11:57.974 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.974 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.974 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015113 s, 69.4 MB/s 2024-04-25T09:11:57.996 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:57.997 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:57.997 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210756 s, 49.8 MB/s 2024-04-25T09:11:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150221 s, 69.8 MB/s 2024-04-25T09:11:58.031 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.031 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.031 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161909 s, 64.8 MB/s 2024-04-25T09:11:58.045 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.045 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.045 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118038 s, 88.8 MB/s 2024-04-25T09:11:58.061 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.061 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.061 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145929 s, 71.9 MB/s 2024-04-25T09:11:58.077 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.077 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.078 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141836 s, 73.9 MB/s 2024-04-25T09:11:58.096 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.096 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.096 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168151 s, 62.4 MB/s 2024-04-25T09:11:58.112 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.112 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.112 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141832 s, 73.9 MB/s 2024-04-25T09:11:58.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:58.114 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:11:58.114 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:11:58.114 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.31 2024-04-25T09:11:58.114 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:11:58.114 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:11:58.114 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:11:58.114 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:11:58.190 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.190 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.190 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200748 s, 52.2 MB/s 2024-04-25T09:11:58.207 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.207 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.207 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155908 s, 67.3 MB/s 2024-04-25T09:11:58.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.224 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149905 s, 69.9 MB/s 2024-04-25T09:11:58.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.240 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147378 s, 71.1 MB/s 2024-04-25T09:11:58.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.257 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146082 s, 71.8 MB/s 2024-04-25T09:11:58.275 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.276 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.276 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171277 s, 61.2 MB/s 2024-04-25T09:11:58.293 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.293 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.293 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015403 s, 68.1 MB/s 2024-04-25T09:11:58.312 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.312 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.312 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171231 s, 61.2 MB/s 2024-04-25T09:11:58.330 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.330 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.330 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017056 s, 61.5 MB/s 2024-04-25T09:11:58.351 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.351 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.351 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185803 s, 56.4 MB/s 2024-04-25T09:11:58.368 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.368 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.368 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159018 s, 65.9 MB/s 2024-04-25T09:11:58.389 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.389 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.389 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188151 s, 55.7 MB/s 2024-04-25T09:11:58.408 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.408 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.408 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173831 s, 60.3 MB/s 2024-04-25T09:11:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015096 s, 69.5 MB/s 2024-04-25T09:11:58.441 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.441 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.441 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147537 s, 71.1 MB/s 2024-04-25T09:11:58.463 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.463 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.463 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196337 s, 53.4 MB/s 2024-04-25T09:11:58.487 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.487 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.487 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225586 s, 46.5 MB/s 2024-04-25T09:11:58.508 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.508 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.508 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194129 s, 54.0 MB/s 2024-04-25T09:11:58.525 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.525 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.525 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149762 s, 70.0 MB/s 2024-04-25T09:11:58.542 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.542 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.542 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153124 s, 68.5 MB/s 2024-04-25T09:11:58.561 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.561 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.561 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173021 s, 60.6 MB/s 2024-04-25T09:11:58.583 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.583 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.583 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197136 s, 53.2 MB/s 2024-04-25T09:11:58.599 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.599 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.599 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147761 s, 71.0 MB/s 2024-04-25T09:11:58.616 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.616 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.616 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154134 s, 68.0 MB/s 2024-04-25T09:11:58.633 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.633 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.633 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151172 s, 69.4 MB/s 2024-04-25T09:11:58.649 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.650 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.650 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146174 s, 71.7 MB/s 2024-04-25T09:11:58.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.667 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151199 s, 69.4 MB/s 2024-04-25T09:11:58.685 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.686 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.686 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170857 s, 61.4 MB/s 2024-04-25T09:11:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169673 s, 61.8 MB/s 2024-04-25T09:11:58.725 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.725 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.725 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188752 s, 55.6 MB/s 2024-04-25T09:11:58.743 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.743 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.743 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162339 s, 64.6 MB/s 2024-04-25T09:11:58.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:11:58.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:11:58.759 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148308 s, 70.7 MB/s 2024-04-25T09:11:58.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:58.761 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub start /scrub_control_test_path recursive 2024-04-25T09:11:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.958+0000 7fa2b3000640 1 Processor -- start 2024-04-25T09:11:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.958+0000 7fa2b3000640 1 -- start start 2024-04-25T09:11:58.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.962+0000 7fa2b3000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa2ac145290 0x7fa2ac15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.962+0000 7fa2b3000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2ac0b3fe0 0x7fa2ac0b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.962+0000 7fa2b3000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa2ac0cc260 0x7fa2ac0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.962+0000 7fa2b3000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ac15c5f0 con 0x7fa2ac0cc260 2024-04-25T09:11:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.962+0000 7fa2b3000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ac06d4b0 con 0x7fa2ac145290 2024-04-25T09:11:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.962+0000 7fa2b3000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac06d790 con 0x7fa2ac0b3fe0 2024-04-25T09:11:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.962+0000 7fa2b1000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa2ac0cc260 0x7fa2ac0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.962+0000 7fa2b1000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa2ac0cc260 0x7fa2ac0cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39928/0 (socket says 172.21.15.173:39928) 2024-04-25T09:11:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.962+0000 7fa2b1000640 1 -- 172.21.15.173:0/729091480 learned_addr learned my addr 172.21.15.173:0/729091480 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.962+0000 7fa2ab400640 1 --2- 172.21.15.173:0/729091480 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2ac0b3fe0 0x7fa2ac0b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.962+0000 7fa2abe00640 1 --2- 172.21.15.173:0/729091480 >> v2:172.21.15.194:3300/0 conn(0x7fa2ac145290 0x7fa2ac15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.962+0000 7fa2b1000640 1 -- 172.21.15.173:0/729091480 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2ac0b3fe0 msgr2=0x7fa2ac0b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:58.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.962+0000 7fa2b1000640 1 --2- 172.21.15.173:0/729091480 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2ac0b3fe0 0x7fa2ac0b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.962+0000 7fa2b1000640 1 -- 172.21.15.173:0/729091480 >> v2:172.21.15.194:3300/0 conn(0x7fa2ac145290 msgr2=0x7fa2ac15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:58.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.962+0000 7fa2b1000640 1 --2- 172.21.15.173:0/729091480 >> v2:172.21.15.194:3300/0 conn(0x7fa2ac145290 0x7fa2ac15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.962+0000 7fa2b1000640 1 -- 172.21.15.173:0/729091480 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac06da70 con 0x7fa2ac0cc260 2024-04-25T09:11:58.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.962+0000 7fa2b1000640 1 --2- 172.21.15.173:0/729091480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2ac0cc260 0x7fa2ac0cc6b0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0d0800 tx=0x7fa2a401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad0c9b117928c28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:58.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2aaa00640 1 -- 172.21.15.173:0/729091480 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a40a5660 con 0x7fa2ac0cc260 2024-04-25T09:11:58.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2aaa00640 1 -- 172.21.15.173:0/729091480 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a40a5800 con 0x7fa2ac0cc260 2024-04-25T09:11:58.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2aaa00640 1 -- 172.21.15.173:0/729091480 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a40a5bd0 con 0x7fa2ac0cc260 2024-04-25T09:11:58.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2b3000640 1 -- 172.21.15.173:0/729091480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2ac0cc260 msgr2=0x7fa2ac0cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:58.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2b3000640 1 --2- 172.21.15.173:0/729091480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2ac0cc260 0x7fa2ac0cc6b0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0d0800 tx=0x7fa2a401c8d0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2b3000640 1 -- 172.21.15.173:0/729091480 shutdown_connections 2024-04-25T09:11:58.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2b3000640 1 --2- 172.21.15.173:0/729091480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2ac0cc260 0x7fa2ac0cc6b0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2b3000640 1 --2- 172.21.15.173:0/729091480 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2ac0b3fe0 0x7fa2ac0b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2b3000640 1 --2- 172.21.15.173:0/729091480 >> v2:172.21.15.194:3300/0 conn(0x7fa2ac145290 0x7fa2ac15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2b3000640 1 -- 172.21.15.173:0/729091480 >> 172.21.15.173:0/729091480 conn(0x7fa2ac06ac90 msgr2=0x7fa2ac06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:58.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2b3000640 1 -- 172.21.15.173:0/729091480 shutdown_connections 2024-04-25T09:11:58.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2b3000640 1 -- 172.21.15.173:0/729091480 wait complete. 2024-04-25T09:11:58.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2b3000640 1 Processor -- start 2024-04-25T09:11:58.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2b3000640 1 -- start start 2024-04-25T09:11:58.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2b3000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2ac0b3fe0 0x7fa2ac0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2b3000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2ac0cc260 0x7fa2ac0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2b3000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2ac145290 0x7fa2ac0ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2b3000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac1457f0 con 0x7fa2ac0cc260 2024-04-25T09:11:58.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2b3000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac145670 con 0x7fa2ac145290 2024-04-25T09:11:58.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2b3000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac06ed60 con 0x7fa2ac0b3fe0 2024-04-25T09:11:58.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2ab400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2ac0cc260 0x7fa2ac0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2ab400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2ac0cc260 0x7fa2ac0ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39940/0 (socket says 172.21.15.173:39940) 2024-04-25T09:11:58.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2ab400640 1 -- 172.21.15.173:0/4030884819 learned_addr learned my addr 172.21.15.173:0/4030884819 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:58.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2b1000640 1 --2- 172.21.15.173:0/4030884819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2ac145290 0x7fa2ac0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2abe00640 1 --2- 172.21.15.173:0/4030884819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2ac0b3fe0 0x7fa2ac0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2ab400640 1 -- 172.21.15.173:0/4030884819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2ac0b3fe0 msgr2=0x7fa2ac0ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:58.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2ab400640 1 --2- 172.21.15.173:0/4030884819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2ac0b3fe0 0x7fa2ac0ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2ab400640 1 -- 172.21.15.173:0/4030884819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2ac145290 msgr2=0x7fa2ac0ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:58.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.966+0000 7fa2ab400640 1 --2- 172.21.15.173:0/4030884819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2ac145290 0x7fa2ac0ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.970+0000 7fa2ab400640 1 -- 172.21.15.173:0/4030884819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac0cf200 con 0x7fa2ac0cc260 2024-04-25T09:11:58.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.970+0000 7fa2ab400640 1 --2- 172.21.15.173:0/4030884819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2ac0cc260 0x7fa2ac0ac8c0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fa29800e8b0 tx=0x7fa29800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:58.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.970+0000 7fa2a3e00640 1 -- 172.21.15.173:0/4030884819 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa298017070 con 0x7fa2ac0cc260 2024-04-25T09:11:58.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.970+0000 7fa2a3e00640 1 -- 172.21.15.173:0/4030884819 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29800c940 con 0x7fa2ac0cc260 2024-04-25T09:11:58.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.970+0000 7fa2b3000640 1 -- 172.21.15.173:0/4030884819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ac0ad430 con 0x7fa2ac0cc260 2024-04-25T09:11:58.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.970+0000 7fa2a3e00640 1 -- 172.21.15.173:0/4030884819 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29800cd10 con 0x7fa2ac0cc260 2024-04-25T09:11:58.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.970+0000 7fa2b3000640 1 -- 172.21.15.173:0/4030884819 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac0adcd0 con 0x7fa2ac0cc260 2024-04-25T09:11:58.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.970+0000 7fa2a3e00640 1 -- 172.21.15.173:0/4030884819 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa29801a070 con 0x7fa2ac0cc260 2024-04-25T09:11:58.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.970+0000 7fa2a3e00640 1 --2- 172.21.15.173:0/4030884819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa28c066f60 0x7fa28c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.970+0000 7fa2a3e00640 1 -- 172.21.15.173:0/4030884819 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa298085190 con 0x7fa2ac0cc260 2024-04-25T09:11:58.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.970+0000 7fa2abe00640 1 --2- 172.21.15.173:0/4030884819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa28c066f60 0x7fa28c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 Processor -- start 2024-04-25T09:11:58.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 -- start start 2024-04-25T09:11:58.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2abe00640 1 --2- 172.21.15.173:0/4030884819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa28c066f60 0x7fa28c069420 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0cc030 tx=0x7fa29c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:58.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec50863f0 0x557ec50867d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec5086d10 0x557ec503cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec503d520 0x557ec503d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec4e8ad50 con 0x557ec5086d10 2024-04-25T09:11:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec4e12e40 con 0x557ec50863f0 2024-04-25T09:11:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ec4e86df0 con 0x557ec503d520 2024-04-25T09:11:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2ab400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec5086d10 0x557ec503cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2ab400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec5086d10 0x557ec503cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39952/0 (socket says 172.21.15.173:39952) 2024-04-25T09:11:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2ab400640 1 -- 172.21.15.173:0/2383356312 learned_addr learned my addr 172.21.15.173:0/2383356312 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2abe00640 1 --2- 172.21.15.173:0/2383356312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec50863f0 0x557ec50867d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b1000640 1 --2- 172.21.15.173:0/2383356312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec503d520 0x557ec503d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2ab400640 1 -- 172.21.15.173:0/2383356312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec503d520 msgr2=0x557ec503d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2ab400640 1 --2- 172.21.15.173:0/2383356312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec503d520 0x557ec503d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2ab400640 1 -- 172.21.15.173:0/2383356312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec50863f0 msgr2=0x557ec50867d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2ab400640 1 --2- 172.21.15.173:0/2383356312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec50863f0 0x557ec50867d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2ab400640 1 -- 172.21.15.173:0/2383356312 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ec4e27d90 con 0x557ec5086d10 2024-04-25T09:11:58.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2ab400640 1 --2- 172.21.15.173:0/2383356312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec5086d10 0x557ec503cfe0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fa29805da50 tx=0x7fa298055340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad38147bc4f0a3c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:58.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2a0c00640 1 -- 172.21.15.173:0/2383356312 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa298021040 con 0x557ec5086d10 2024-04-25T09:11:58.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2a0c00640 1 -- 172.21.15.173:0/2383356312 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa298053c20 con 0x557ec5086d10 2024-04-25T09:11:58.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2a0c00640 1 -- 172.21.15.173:0/2383356312 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29806d1c0 con 0x557ec5086d10 2024-04-25T09:11:58.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 -- 172.21.15.173:0/2383356312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec5086d10 msgr2=0x557ec503cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:58.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 --2- 172.21.15.173:0/2383356312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec5086d10 0x557ec503cfe0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fa29805da50 tx=0x7fa298055340 comp rx=0 tx=0).stop 2024-04-25T09:11:58.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 -- 172.21.15.173:0/2383356312 shutdown_connections 2024-04-25T09:11:58.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 --2- 172.21.15.173:0/2383356312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec503d520 0x557ec503d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 --2- 172.21.15.173:0/2383356312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec5086d10 0x557ec503cfe0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 --2- 172.21.15.173:0/2383356312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec50863f0 0x557ec50867d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 -- 172.21.15.173:0/2383356312 >> 172.21.15.173:0/2383356312 conn(0x557ec50394d0 msgr2=0x557ec503b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:58.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 -- 172.21.15.173:0/2383356312 shutdown_connections 2024-04-25T09:11:58.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 -- 172.21.15.173:0/2383356312 wait complete. 2024-04-25T09:11:58.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 -- start start 2024-04-25T09:11:58.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.974+0000 7fa2b6587000 1 Processor -- start 2024-04-25T09:11:58.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b6587000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec503d520 0x557ec5043080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b6587000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec50863f0 0x557ec50740c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b6587000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec5086d10 0x557ec5074600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b6587000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec4e30610 con 0x557ec503d520 2024-04-25T09:11:58.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b6587000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec4e459a0 con 0x557ec50863f0 2024-04-25T09:11:58.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b6587000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ec4e8f380 con 0x557ec5086d10 2024-04-25T09:11:58.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b6587000 10 client.0 _ll_register_callbacks cb 0x557ec4f3f0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:58.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2abe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec503d520 0x557ec5043080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2abe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec503d520 0x557ec5043080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39968/0 (socket says 172.21.15.173:39968) 2024-04-25T09:11:58.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2abe00640 1 -- 172.21.15.173:0/1123381973 learned_addr learned my addr 172.21.15.173:0/1123381973 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2ab400640 1 --2- 172.21.15.173:0/1123381973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec50863f0 0x557ec50740c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b1000640 1 --2- 172.21.15.173:0/1123381973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec5086d10 0x557ec5074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2abe00640 1 -- 172.21.15.173:0/1123381973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec5086d10 msgr2=0x557ec5074600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2abe00640 1 --2- 172.21.15.173:0/1123381973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec5086d10 0x557ec5074600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2abe00640 1 -- 172.21.15.173:0/1123381973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec50863f0 msgr2=0x557ec50740c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2abe00640 1 --2- 172.21.15.173:0/1123381973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec50863f0 0x557ec50740c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2abe00640 1 -- 172.21.15.173:0/1123381973 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ec4e85d40 con 0x557ec503d520 2024-04-25T09:11:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b1000640 1 --2- 172.21.15.173:0/1123381973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec5086d10 0x557ec5074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2abe00640 1 --2- 172.21.15.173:0/1123381973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec503d520 0x557ec5043080 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0149f0 tx=0x7fa29c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97deff87033a5959 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa295600640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:11:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa295600640 1 -- 172.21.15.173:0/1123381973 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c027030 con 0x557ec503d520 2024-04-25T09:11:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa295600640 1 -- 172.21.15.173:0/1123381973 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa29c00f040 con 0x557ec503d520 2024-04-25T09:11:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b6587000 1 -- 172.21.15.173:0/1123381973 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa298053c20 con 0x557ec503d520 2024-04-25T09:11:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa295600640 1 -- 172.21.15.173:0/1123381973 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa29c004020 con 0x557ec503d520 2024-04-25T09:11:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b6587000 10 client.8961 fetch_fsmap learned FSMap version 81 2024-04-25T09:11:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b6587000 1 -- 172.21.15.173:0/1123381973 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x557ec4f0df00 con 0x557ec503d520 2024-04-25T09:11:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa295600640 1 -- 172.21.15.173:0/1123381973 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa298053c20 con 0x557ec503d520 2024-04-25T09:11:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa295600640 1 -- 172.21.15.173:0/1123381973 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 81) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa29c035080 con 0x557ec503d520 2024-04-25T09:11:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b6587000 10 client.8961 fetch_fsmap finished waiting for FSMap version 81 2024-04-25T09:11:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b6587000 10 client.8961 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:11:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b6587000 20 client.8961 populate_metadata read hostname 'smithi173' 2024-04-25T09:11:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b6587000 1 --2- 172.21.15.173:0/1123381973 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x557ec508d830 0x557ec508dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b6587000 4 client.8961 mds_command: new command op to 8775 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:11:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b6587000 1 -- 172.21.15.173:0/1123381973 --> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557ec4e26a20 con 0x557ec508d830 2024-04-25T09:11:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2ab400640 1 --2- 172.21.15.173:0/1123381973 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x557ec508d830 0x557ec508dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2ab400640 1 --2- 172.21.15.173:0/1123381973 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x557ec508d830 0x557ec508dc10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca15b67106a5ef71 server_cookie=3bc59367e18b94ac in_seq=0 out_seq=0 2024-04-25T09:11:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa295600640 10 client.8961 ms_handle_connect on v2:172.21.15.173:6835/671971539 2024-04-25T09:11:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa295600640 1 -- 172.21.15.173:0/1123381973 <== mds.0 v2:172.21.15.173:6835/671971539 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557ec4e26a20 con 0x557ec508d830 2024-04-25T09:11:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa295600640 10 client.8961 handle_command_reply: tid=0 2024-04-25T09:11:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.978+0000 7fa2b6587000 1 client.8961 shutdown 2024-04-25T09:11:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.982+0000 7fa2b6587000 1 -- 172.21.15.173:0/1123381973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec503d520 msgr2=0x557ec5043080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.982+0000 7fa2b6587000 1 --2- 172.21.15.173:0/1123381973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec503d520 0x557ec5043080 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0149f0 tx=0x7fa29c0046d0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.982+0000 7fa2b6587000 1 -- 172.21.15.173:0/1123381973 shutdown_connections 2024-04-25T09:11:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.982+0000 7fa2b6587000 1 --2- 172.21.15.173:0/1123381973 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x557ec508d830 0x557ec508dc10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.982+0000 7fa2b6587000 1 --2- 172.21.15.173:0/1123381973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec5086d10 0x557ec5074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.982+0000 7fa2b6587000 1 --2- 172.21.15.173:0/1123381973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec50863f0 0x557ec50740c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.982+0000 7fa2b6587000 1 --2- 172.21.15.173:0/1123381973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec503d520 0x557ec5043080 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.982+0000 7fa295600640 0 client.8961 ms_handle_reset on v2:172.21.15.173:6835/671971539 2024-04-25T09:11:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.982+0000 7fa2b6587000 1 -- 172.21.15.173:0/1123381973 >> 172.21.15.173:0/1123381973 conn(0x557ec50394d0 msgr2=0x557ec503c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.982+0000 7fa2b6587000 1 -- 172.21.15.173:0/1123381973 shutdown_connections 2024-04-25T09:11:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.982+0000 7fa2b6587000 1 -- 172.21.15.173:0/1123381973 wait complete. 2024-04-25T09:11:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.982+0000 7fa2b6587000 20 client.8961 trim_cache size 0 max 16384 2024-04-25T09:11:58.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.994+0000 7fa2b6587000 1 Processor -- start 2024-04-25T09:11:58.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.994+0000 7fa2b6587000 1 -- start start 2024-04-25T09:11:58.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec503d520 0x557ec50e2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec50863f0 0x557ec50e3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec5086d10 0x557ec50e36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac203340 con 0x557ec5086d10 2024-04-25T09:11:58.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac2024c0 con 0x557ec503d520 2024-04-25T09:11:58.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac143c50 con 0x557ec50863f0 2024-04-25T09:11:58.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b1000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec5086d10 0x557ec50e36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b1000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec5086d10 0x557ec50e36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39974/0 (socket says 172.21.15.173:39974) 2024-04-25T09:11:58.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b1000640 1 -- 172.21.15.173:0/789242905 learned_addr learned my addr 172.21.15.173:0/789242905 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:58.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2ab400640 1 --2- 172.21.15.173:0/789242905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec50863f0 0x557ec50e3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2abe00640 1 --2- 172.21.15.173:0/789242905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec503d520 0x557ec50e2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b1000640 1 -- 172.21.15.173:0/789242905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec50863f0 msgr2=0x557ec50e3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:58.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b1000640 1 --2- 172.21.15.173:0/789242905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec50863f0 0x557ec50e3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b1000640 1 -- 172.21.15.173:0/789242905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec503d520 msgr2=0x557ec50e2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:58.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b1000640 1 --2- 172.21.15.173:0/789242905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec503d520 0x557ec50e2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b1000640 1 -- 172.21.15.173:0/789242905 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ec5074590 con 0x557ec5086d10 2024-04-25T09:11:58.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2abe00640 1 --2- 172.21.15.173:0/789242905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec503d520 0x557ec50e2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:58.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2ab400640 1 --2- 172.21.15.173:0/789242905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec50863f0 0x557ec50e3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:58.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b1000640 1 --2- 172.21.15.173:0/789242905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec5086d10 0x557ec50e36c0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40af040 tx=0x7fa2a40a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84af505290c9c2fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:58.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa297e00640 1 -- 172.21.15.173:0/789242905 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4009210 con 0x557ec5086d10 2024-04-25T09:11:58.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa297e00640 1 -- 172.21.15.173:0/789242905 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a40a5660 con 0x557ec5086d10 2024-04-25T09:11:58.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa297e00640 1 -- 172.21.15.173:0/789242905 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a40a5a10 con 0x557ec5086d10 2024-04-25T09:11:58.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 -- 172.21.15.173:0/789242905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec5086d10 msgr2=0x557ec50e36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:58.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 --2- 172.21.15.173:0/789242905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec5086d10 0x557ec50e36c0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40af040 tx=0x7fa2a40a7070 comp rx=0 tx=0).stop 2024-04-25T09:11:58.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 -- 172.21.15.173:0/789242905 shutdown_connections 2024-04-25T09:11:58.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 --2- 172.21.15.173:0/789242905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec5086d10 0x557ec50e36c0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 --2- 172.21.15.173:0/789242905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec50863f0 0x557ec50e3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 --2- 172.21.15.173:0/789242905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec503d520 0x557ec50e2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 -- 172.21.15.173:0/789242905 >> 172.21.15.173:0/789242905 conn(0x557ec50394d0 msgr2=0x557ec50424d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:58.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 -- 172.21.15.173:0/789242905 shutdown_connections 2024-04-25T09:11:58.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 -- 172.21.15.173:0/789242905 wait complete. 2024-04-25T09:11:58.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 -- start start 2024-04-25T09:11:58.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 Processor -- start 2024-04-25T09:11:58.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec503d520 0x557ec50e64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec50863f0 0x557ec508b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec5086d10 0x557ec508b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec4e41dc0 con 0x557ec503d520 2024-04-25T09:11:58.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac144250 con 0x557ec5086d10 2024-04-25T09:11:58.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ec4e8a060 con 0x557ec50863f0 2024-04-25T09:11:58.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:58.998+0000 7fa2b6587000 10 client.0 _ll_register_callbacks cb 0x7fa29c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:58.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2abe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec503d520 0x557ec50e64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2abe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec503d520 0x557ec50e64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39982/0 (socket says 172.21.15.173:39982) 2024-04-25T09:11:58.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2abe00640 1 -- 172.21.15.173:0/453141507 learned_addr learned my addr 172.21.15.173:0/453141507 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:58.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2ab400640 1 --2- 172.21.15.173:0/453141507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec50863f0 0x557ec508b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2b1000640 1 --2- 172.21.15.173:0/453141507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec5086d10 0x557ec508b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2abe00640 1 -- 172.21.15.173:0/453141507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec50863f0 msgr2=0x557ec508b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:58.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2abe00640 1 --2- 172.21.15.173:0/453141507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec50863f0 0x557ec508b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2abe00640 1 -- 172.21.15.173:0/453141507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec5086d10 msgr2=0x557ec508b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:58.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2abe00640 1 --2- 172.21.15.173:0/453141507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec5086d10 0x557ec508b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2abe00640 1 -- 172.21.15.173:0/453141507 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ec4ee4330 con 0x557ec503d520 2024-04-25T09:11:58.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2abe00640 1 --2- 172.21.15.173:0/453141507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec503d520 0x557ec50e64e0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0098a0 tx=0x7fa29c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10537f22f231fb84 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:58.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa295600640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:11:58.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa295600640 1 -- 172.21.15.173:0/453141507 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c027040 con 0x557ec503d520 2024-04-25T09:11:58.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa295600640 1 -- 172.21.15.173:0/453141507 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa29c03dc50 con 0x557ec503d520 2024-04-25T09:11:58.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2b6587000 1 -- 172.21.15.173:0/453141507 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2a40a5660 con 0x557ec503d520 2024-04-25T09:11:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa295600640 1 -- 172.21.15.173:0/453141507 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa29c03de50 con 0x557ec503d520 2024-04-25T09:11:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2b6587000 10 client.8967 fetch_fsmap learned FSMap version 81 2024-04-25T09:11:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2b6587000 1 -- 172.21.15.173:0/453141507 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x557ec4e575f0 con 0x557ec503d520 2024-04-25T09:11:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa295600640 1 -- 172.21.15.173:0/453141507 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a40a5660 con 0x557ec503d520 2024-04-25T09:11:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa295600640 1 -- 172.21.15.173:0/453141507 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 81) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa29c044050 con 0x557ec503d520 2024-04-25T09:11:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2b6587000 10 client.8967 fetch_fsmap finished waiting for FSMap version 81 2024-04-25T09:11:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2b6587000 10 client.8967 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:11:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2b6587000 20 client.8967 populate_metadata read hostname 'smithi173' 2024-04-25T09:11:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2b6587000 1 --2- 172.21.15.173:0/453141507 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x557ec508bea0 0x557ec508c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2b6587000 4 client.8967 mds_command: new command op to 8775 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-04-25T09:11:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2b6587000 1 -- 172.21.15.173:0/453141507 --> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x557ec4e98290 con 0x557ec508bea0 2024-04-25T09:11:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2ab400640 1 --2- 172.21.15.173:0/453141507 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x557ec508bea0 0x557ec508c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa2ab400640 1 --2- 172.21.15.173:0/453141507 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x557ec508bea0 0x557ec508c2b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=795a9a83f143fae1 server_cookie=96bd73bb04fe8b38 in_seq=0 out_seq=0 2024-04-25T09:11:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.002+0000 7fa295600640 10 client.8967 ms_handle_connect on v2:172.21.15.173:6835/671971539 2024-04-25T09:11:58.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa295600640 1 -- 172.21.15.173:0/453141507 <== mds.0 v2:172.21.15.173:6835/671971539 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x557ec4e98290 con 0x557ec508bea0 2024-04-25T09:11:58.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa295600640 10 client.8967 handle_command_reply: tid=0 2024-04-25T09:11:58.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b6587000 1 client.8967 shutdown 2024-04-25T09:11:58.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b6587000 1 -- 172.21.15.173:0/453141507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec503d520 msgr2=0x557ec50e64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:58.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b6587000 1 --2- 172.21.15.173:0/453141507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec503d520 0x557ec50e64e0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0098a0 tx=0x7fa29c019000 comp rx=0 tx=0).stop 2024-04-25T09:11:58.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b6587000 1 -- 172.21.15.173:0/453141507 shutdown_connections 2024-04-25T09:11:58.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b6587000 1 --2- 172.21.15.173:0/453141507 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x557ec508bea0 0x557ec508c2b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b6587000 1 --2- 172.21.15.173:0/453141507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ec5086d10 0x557ec508b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b6587000 1 --2- 172.21.15.173:0/453141507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x557ec50863f0 0x557ec508b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b6587000 1 --2- 172.21.15.173:0/453141507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ec503d520 0x557ec50e64e0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b6587000 1 -- 172.21.15.173:0/453141507 >> 172.21.15.173:0/453141507 conn(0x557ec50394d0 msgr2=0x557ec5084f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:58.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa295600640 0 client.8967 ms_handle_reset on v2:172.21.15.173:6835/671971539 2024-04-25T09:11:58.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b6587000 1 -- 172.21.15.173:0/453141507 shutdown_connections 2024-04-25T09:11:58.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b6587000 1 -- 172.21.15.173:0/453141507 wait complete. 2024-04-25T09:11:58.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b6587000 20 client.8967 trim_cache size 0 max 16384 2024-04-25T09:11:58.992 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:11:58.992 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0, 2024-04-25T09:11:58.992 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_tag": "1915a84e-397a-4a41-95ea-651f8327cb8d", 2024-04-25T09:11:58.992 INFO:teuthology.orchestra.run.smithi173.stdout: "mode": "asynchronous" 2024-04-25T09:11:58.992 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:11:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b3000640 1 -- 172.21.15.173:0/4030884819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa28c066f60 msgr2=0x7fa28c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b3000640 1 --2- 172.21.15.173:0/4030884819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa28c066f60 0x7fa28c069420 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0cc030 tx=0x7fa29c009190 comp rx=0 tx=0).stop 2024-04-25T09:11:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b3000640 1 -- 172.21.15.173:0/4030884819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2ac0cc260 msgr2=0x7fa2ac0ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b3000640 1 --2- 172.21.15.173:0/4030884819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2ac0cc260 0x7fa2ac0ac8c0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fa29800e8b0 tx=0x7fa29800ed70 comp rx=0 tx=0).stop 2024-04-25T09:11:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b3000640 1 -- 172.21.15.173:0/4030884819 shutdown_connections 2024-04-25T09:11:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b3000640 1 --2- 172.21.15.173:0/4030884819 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa28c066f60 0x7fa28c069420 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b3000640 1 --2- 172.21.15.173:0/4030884819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2ac145290 0x7fa2ac0ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b3000640 1 --2- 172.21.15.173:0/4030884819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2ac0cc260 0x7fa2ac0ac8c0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b3000640 1 --2- 172.21.15.173:0/4030884819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2ac0b3fe0 0x7fa2ac0ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b3000640 1 -- 172.21.15.173:0/4030884819 >> 172.21.15.173:0/4030884819 conn(0x7fa2ac06ac90 msgr2=0x7fa2ac15cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b3000640 1 -- 172.21.15.173:0/4030884819 shutdown_connections 2024-04-25T09:11:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.006+0000 7fa2b3000640 1 -- 172.21.15.173:0/4030884819 wait complete. 2024-04-25T09:11:59.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:59.016 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub pause 2024-04-25T09:11:59.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.206+0000 7f2a9ca00640 1 Processor -- start 2024-04-25T09:11:59.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.206+0000 7f2a9ca00640 1 -- start start 2024-04-25T09:11:59.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.206+0000 7f2a9ca00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2a98099a50 0x7f2a98099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.206+0000 7f2a9ca00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a9806bda0 0x7f2a9815dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.206+0000 7f2a9ca00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a9809a370 con 0x7f2a9806c220 2024-04-25T09:11:59.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.206+0000 7f2a9ca00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a98161570 con 0x7f2a98099a50 2024-04-25T09:11:59.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.206+0000 7f2a9ca00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a98161850 con 0x7f2a9806bda0 2024-04-25T09:11:59.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.206+0000 7f2a96800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2a98099a50 0x7f2a98099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.206+0000 7f2a97200640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f2a9806c220 0x7f2a9815e270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:58424/0 (socket says 172.21.15.173:58424) 2024-04-25T09:11:59.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.206+0000 7f2a8de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a9806bda0 0x7f2a9815dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.206+0000 7f2a97200640 1 -- 172.21.15.173:0/2123491162 learned_addr learned my addr 172.21.15.173:0/2123491162 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:11:59.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.206+0000 7f2a96800640 1 -- 172.21.15.173:0/2123491162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a9806bda0 msgr2=0x7f2a9815dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.206+0000 7f2a96800640 1 --2- 172.21.15.173:0/2123491162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a9806bda0 0x7f2a9815dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.206+0000 7f2a96800640 1 -- 172.21.15.173:0/2123491162 >> v1:172.21.15.194:6789/0 conn(0x7f2a9806c220 legacy=0x7f2a9815e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.206+0000 7f2a96800640 1 -- 172.21.15.173:0/2123491162 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a98161b30 con 0x7f2a98099a50 2024-04-25T09:11:59.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.206+0000 7f2a95e00640 1 -- 172.21.15.173:0/2123491162 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658938704 0 0) 0x7f2a9809a370 con 0x7f2a9806c220 2024-04-25T09:11:59.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.206+0000 7f2a8de00640 1 --2- 172.21.15.173:0/2123491162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a9806bda0 0x7f2a9815dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:59.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.210+0000 7f2a96800640 1 --2- 172.21.15.173:0/2123491162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a98099a50 0x7f2a98099e30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2a880097c0 tx=0x7f2a8801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38a59b2c9e479f6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.210+0000 7f2a95e00640 1 -- 172.21.15.173:0/2123491162 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a880b2070 con 0x7f2a98099a50 2024-04-25T09:11:59.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.210+0000 7f2a95e00640 1 -- 172.21.15.173:0/2123491162 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a880ad680 con 0x7f2a98099a50 2024-04-25T09:11:59.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.210+0000 7f2a95e00640 1 -- 172.21.15.173:0/2123491162 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a880ada50 con 0x7f2a98099a50 2024-04-25T09:11:59.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.210+0000 7f2a9ca00640 1 -- 172.21.15.173:0/2123491162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a98099a50 msgr2=0x7f2a98099e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.210+0000 7f2a9ca00640 1 --2- 172.21.15.173:0/2123491162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a98099a50 0x7f2a98099e30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2a880097c0 tx=0x7f2a8801c470 comp rx=0 tx=0).stop 2024-04-25T09:11:59.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.210+0000 7f2a9ca00640 1 -- 172.21.15.173:0/2123491162 shutdown_connections 2024-04-25T09:11:59.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.210+0000 7f2a9ca00640 1 --2- 172.21.15.173:0/2123491162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a9806bda0 0x7f2a9815dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.210+0000 7f2a9ca00640 1 --2- 172.21.15.173:0/2123491162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a98099a50 0x7f2a98099e30 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.210+0000 7f2a9ca00640 1 -- 172.21.15.173:0/2123491162 >> 172.21.15.173:0/2123491162 conn(0x7f2a980b31d0 msgr2=0x7f2a980b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:59.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.210+0000 7f2a9ca00640 1 -- 172.21.15.173:0/2123491162 shutdown_connections 2024-04-25T09:11:59.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.210+0000 7f2a9ca00640 1 -- 172.21.15.173:0/2123491162 wait complete. 2024-04-25T09:11:59.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a9ca00640 1 Processor -- start 2024-04-25T09:11:59.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a9ca00640 1 -- start start 2024-04-25T09:11:59.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a9ca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a9806bda0 0x7f2a981501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a9ca00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a9806c220 0x7f2a98153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a9ca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a98099a50 0x7f2a98153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a9ca00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9809ae40 con 0x7f2a9806bda0 2024-04-25T09:11:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a9ca00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9809acc0 con 0x7f2a98099a50 2024-04-25T09:11:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a9ca00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9816b120 con 0x7f2a9806c220 2024-04-25T09:11:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a96800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a9806bda0 0x7f2a981501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a96800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a9806bda0 0x7f2a981501c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39990/0 (socket says 172.21.15.173:39990) 2024-04-25T09:11:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a96800640 1 -- 172.21.15.173:0/2951715270 learned_addr learned my addr 172.21.15.173:0/2951715270 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a8de00640 1 --2- 172.21.15.173:0/2951715270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a9806c220 0x7f2a98153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a97200640 1 --2- 172.21.15.173:0/2951715270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a98099a50 0x7f2a98153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a96800640 1 -- 172.21.15.173:0/2951715270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a9806c220 msgr2=0x7f2a98153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a96800640 1 --2- 172.21.15.173:0/2951715270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a9806c220 0x7f2a98153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a96800640 1 -- 172.21.15.173:0/2951715270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a98099a50 msgr2=0x7f2a98153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a96800640 1 --2- 172.21.15.173:0/2951715270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a98099a50 0x7f2a98153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a96800640 1 -- 172.21.15.173:0/2951715270 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a98150700 con 0x7f2a9806bda0 2024-04-25T09:11:59.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a96800640 1 --2- 172.21.15.173:0/2951715270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a9806bda0 0x7f2a981501c0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f2a8801a0a0 tx=0x7f2a8801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a8f400640 1 -- 172.21.15.173:0/2951715270 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a880bc020 con 0x7f2a9806bda0 2024-04-25T09:11:59.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a8f400640 1 -- 172.21.15.173:0/2951715270 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a880adb70 con 0x7f2a9806bda0 2024-04-25T09:11:59.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a9ca00640 1 -- 172.21.15.173:0/2951715270 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a981515f0 con 0x7f2a9806bda0 2024-04-25T09:11:59.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a8f400640 1 -- 172.21.15.173:0/2951715270 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a880b2040 con 0x7f2a9806bda0 2024-04-25T09:11:59.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.214+0000 7f2a9ca00640 1 -- 172.21.15.173:0/2951715270 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a98151bb0 con 0x7f2a9806bda0 2024-04-25T09:11:59.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.218+0000 7f2a8f400640 1 -- 172.21.15.173:0/2951715270 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2a880bf020 con 0x7f2a9806bda0 2024-04-25T09:11:59.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.218+0000 7f2a8f400640 1 --2- 172.21.15.173:0/2951715270 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2a74066f60 0x7f2a74069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.218+0000 7f2a8f400640 1 -- 172.21.15.173:0/2951715270 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2a8811f120 con 0x7f2a9806bda0 2024-04-25T09:11:59.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.218+0000 7f2a8de00640 1 --2- 172.21.15.173:0/2951715270 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2a74066f60 0x7f2a74069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.218+0000 7f2aa091c000 1 Processor -- start 2024-04-25T09:11:59.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.218+0000 7f2aa091c000 1 -- start start 2024-04-25T09:11:59.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.218+0000 7f2a8de00640 1 --2- 172.21.15.173:0/2951715270 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2a74066f60 0x7f2a74069420 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009bd0 tx=0x7f2a8000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.218+0000 7f2aa091c000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a67000ba40 0x55a67000be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.218+0000 7f2aa091c000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a67000c360 0x55a66ffc6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.218+0000 7f2aa091c000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a66ffc6d90 0x55a66ffc7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.218+0000 7f2aa091c000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a66fea91f0 con 0x55a67000ba40 2024-04-25T09:11:59.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.218+0000 7f2aa091c000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a66fe0fe90 con 0x55a67000c360 2024-04-25T09:11:59.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.218+0000 7f2aa091c000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a66fd97f50 con 0x55a66ffc6d90 2024-04-25T09:11:59.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.218+0000 7f2a96800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a67000ba40 0x55a67000be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2a96800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a67000ba40 0x55a67000be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40002/0 (socket says 172.21.15.173:40002) 2024-04-25T09:11:59.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2a96800640 1 -- 172.21.15.173:0/369049367 learned_addr learned my addr 172.21.15.173:0/369049367 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:59.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2a8de00640 1 --2- 172.21.15.173:0/369049367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a67000c360 0x55a66ffc6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2a96800640 1 -- 172.21.15.173:0/369049367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a66ffc6d90 msgr2=0x55a66ffc7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2a96800640 1 --2- 172.21.15.173:0/369049367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a66ffc6d90 0x55a66ffc7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2a96800640 1 -- 172.21.15.173:0/369049367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a67000c360 msgr2=0x55a66ffc6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2a96800640 1 --2- 172.21.15.173:0/369049367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a67000c360 0x55a66ffc6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2a96800640 1 -- 172.21.15.173:0/369049367 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a66fde78b0 con 0x55a67000ba40 2024-04-25T09:11:59.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2a8de00640 1 --2- 172.21.15.173:0/369049367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a67000c360 0x55a66ffc6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:59.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2a96800640 1 --2- 172.21.15.173:0/369049367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a67000ba40 0x55a67000be20 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f2a880ef8d0 tx=0x7f2a8801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b024d8b0c58bf809 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2a87400640 1 -- 172.21.15.173:0/369049367 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a880f7fa0 con 0x55a67000ba40 2024-04-25T09:11:59.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2a87400640 1 -- 172.21.15.173:0/369049367 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a880edc40 con 0x55a67000ba40 2024-04-25T09:11:59.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2a87400640 1 -- 172.21.15.173:0/369049367 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a880f0bc0 con 0x55a67000ba40 2024-04-25T09:11:59.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2aa091c000 1 -- 172.21.15.173:0/369049367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a67000ba40 msgr2=0x55a67000be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2aa091c000 1 --2- 172.21.15.173:0/369049367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a67000ba40 0x55a67000be20 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f2a880ef8d0 tx=0x7f2a8801c470 comp rx=0 tx=0).stop 2024-04-25T09:11:59.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2aa091c000 1 -- 172.21.15.173:0/369049367 shutdown_connections 2024-04-25T09:11:59.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2aa091c000 1 --2- 172.21.15.173:0/369049367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a66ffc6d90 0x55a66ffc7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2aa091c000 1 --2- 172.21.15.173:0/369049367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a67000c360 0x55a66ffc6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2aa091c000 1 --2- 172.21.15.173:0/369049367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a67000ba40 0x55a67000be20 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2aa091c000 1 -- 172.21.15.173:0/369049367 >> 172.21.15.173:0/369049367 conn(0x55a66ffc2d40 msgr2=0x55a66ffc5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:59.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2aa091c000 1 -- 172.21.15.173:0/369049367 shutdown_connections 2024-04-25T09:11:59.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2aa091c000 1 -- 172.21.15.173:0/369049367 wait complete. 2024-04-25T09:11:59.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2aa091c000 1 -- start start 2024-04-25T09:11:59.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2aa091c000 1 Processor -- start 2024-04-25T09:11:59.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2aa091c000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a66ffc6d90 0x55a66ffcc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2aa091c000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a67000ba40 0x55a66ffcc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2aa091c000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a67000c360 0x55a66ffcced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2aa091c000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a66fdca540 con 0x55a66ffc6d90 2024-04-25T09:11:59.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2aa091c000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a66fe0bf30 con 0x55a67000c360 2024-04-25T09:11:59.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2aa091c000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a66ffad5b0 con 0x55a67000ba40 2024-04-25T09:11:59.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2aa091c000 10 client.0 _ll_register_callbacks cb 0x55a66fec4180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:59.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2a96800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a66ffc6d90 0x55a66ffcc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2a96800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a66ffc6d90 0x55a66ffcc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40008/0 (socket says 172.21.15.173:40008) 2024-04-25T09:11:59.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2a96800640 1 -- 172.21.15.173:0/2222729059 learned_addr learned my addr 172.21.15.173:0/2222729059 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:59.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2a8de00640 1 --2- 172.21.15.173:0/2222729059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a67000ba40 0x55a66ffcc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.222+0000 7f2a97200640 1 --2- 172.21.15.173:0/2222729059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a67000c360 0x55a66ffcced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2a96800640 1 -- 172.21.15.173:0/2222729059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a67000ba40 msgr2=0x55a66ffcc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2a96800640 1 --2- 172.21.15.173:0/2222729059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a67000ba40 0x55a66ffcc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2a96800640 1 -- 172.21.15.173:0/2222729059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a67000c360 msgr2=0x55a66ffcced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2a96800640 1 --2- 172.21.15.173:0/2222729059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a67000c360 0x55a66ffcced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2a96800640 1 -- 172.21.15.173:0/2222729059 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a66fd981a0 con 0x55a66ffc6d90 2024-04-25T09:11:59.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2a96800640 1 --2- 172.21.15.173:0/2222729059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a66ffc6d90 0x55a66ffcc450 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f2a88006f90 tx=0x7f2a88000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6faa51d8ef1f6e83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2a7be00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:11:59.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2a7be00640 1 -- 172.21.15.173:0/2222729059 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a880ebfb0 con 0x55a66ffc6d90 2024-04-25T09:11:59.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2a7be00640 1 -- 172.21.15.173:0/2222729059 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2a880f0bc0 con 0x55a66ffc6d90 2024-04-25T09:11:59.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 1 -- 172.21.15.173:0/2222729059 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2a880edc40 con 0x55a66ffc6d90 2024-04-25T09:11:59.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2a7be00640 1 -- 172.21.15.173:0/2222729059 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a880ec150 con 0x55a66ffc6d90 2024-04-25T09:11:59.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 10 client.8976 fetch_fsmap learned FSMap version 81 2024-04-25T09:11:59.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 1 -- 172.21.15.173:0/2222729059 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x55a66fe92840 con 0x55a66ffc6d90 2024-04-25T09:11:59.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2a7be00640 1 -- 172.21.15.173:0/2222729059 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a880edc40 con 0x55a66ffc6d90 2024-04-25T09:11:59.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2a7be00640 1 -- 172.21.15.173:0/2222729059 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 81) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2a880b5030 con 0x55a66ffc6d90 2024-04-25T09:11:59.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 10 client.8976 fetch_fsmap finished waiting for FSMap version 81 2024-04-25T09:11:59.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 10 client.8976 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:11:59.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 20 client.8976 populate_metadata read hostname 'smithi173' 2024-04-25T09:11:59.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 1 --2- 172.21.15.173:0/2222729059 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55a67001ace0 0x55a67001d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 4 client.8976 mds_command: new command op to 8775 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:11:59.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 1 -- 172.21.15.173:0/2222729059 --> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a66fdabbe0 con 0x55a67001ace0 2024-04-25T09:11:59.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2a8de00640 1 --2- 172.21.15.173:0/2222729059 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55a67001ace0 0x55a67001d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2a8de00640 1 --2- 172.21.15.173:0/2222729059 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55a67001ace0 0x55a67001d0d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdaf49500732f77a server_cookie=6f6effb082eef511 in_seq=0 out_seq=0 2024-04-25T09:11:59.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2a7be00640 10 client.8976 ms_handle_connect on v2:172.21.15.173:6835/671971539 2024-04-25T09:11:59.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2a7be00640 1 -- 172.21.15.173:0/2222729059 <== mds.0 v2:172.21.15.173:6835/671971539 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a66fdabbe0 con 0x55a67001ace0 2024-04-25T09:11:59.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2a7be00640 10 client.8976 handle_command_reply: tid=0 2024-04-25T09:11:59.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 1 client.8976 shutdown 2024-04-25T09:11:59.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 1 -- 172.21.15.173:0/2222729059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a66ffc6d90 msgr2=0x55a66ffcc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 1 --2- 172.21.15.173:0/2222729059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a66ffc6d90 0x55a66ffcc450 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f2a88006f90 tx=0x7f2a88000bd0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 1 -- 172.21.15.173:0/2222729059 shutdown_connections 2024-04-25T09:11:59.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 1 --2- 172.21.15.173:0/2222729059 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55a67001ace0 0x55a67001d0d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 1 --2- 172.21.15.173:0/2222729059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a67000c360 0x55a66ffcced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 1 --2- 172.21.15.173:0/2222729059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a67000ba40 0x55a66ffcc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2a7be00640 0 client.8976 ms_handle_reset on v2:172.21.15.173:6835/671971539 2024-04-25T09:11:59.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 1 --2- 172.21.15.173:0/2222729059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a66ffc6d90 0x55a66ffcc450 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 1 -- 172.21.15.173:0/2222729059 >> 172.21.15.173:0/2222729059 conn(0x55a66ffc2d40 msgr2=0x55a66ffc59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:59.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 1 -- 172.21.15.173:0/2222729059 shutdown_connections 2024-04-25T09:11:59.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 1 -- 172.21.15.173:0/2222729059 wait complete. 2024-04-25T09:11:59.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.226+0000 7f2aa091c000 20 client.8976 trim_cache size 0 max 16384 2024-04-25T09:11:59.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.242+0000 7f2aa091c000 1 Processor -- start 2024-04-25T09:11:59.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.242+0000 7f2aa091c000 1 -- start start 2024-04-25T09:11:59.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.242+0000 7f2aa091c000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a66ffc6d90 0x55a670067370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.242+0000 7f2aa091c000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a67000ba40 0x55a6700678b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.242+0000 7f2aa091c000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a67000c360 0x55a670067df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.242+0000 7f2aa091c000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a982037f0 con 0x55a67000ba40 2024-04-25T09:11:59.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.242+0000 7f2aa091c000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a982029f0 con 0x55a66ffc6d90 2024-04-25T09:11:59.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.242+0000 7f2aa091c000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a98155ab0 con 0x55a67000c360 2024-04-25T09:11:59.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a8de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a67000ba40 0x55a6700678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a8de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a67000ba40 0x55a6700678b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40018/0 (socket says 172.21.15.173:40018) 2024-04-25T09:11:59.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a8de00640 1 -- 172.21.15.173:0/2720319280 learned_addr learned my addr 172.21.15.173:0/2720319280 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:59.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a96800640 1 --2- 172.21.15.173:0/2720319280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a66ffc6d90 0x55a670067370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a97200640 1 --2- 172.21.15.173:0/2720319280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a67000c360 0x55a670067df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a8de00640 1 -- 172.21.15.173:0/2720319280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a67000c360 msgr2=0x55a670067df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a8de00640 1 --2- 172.21.15.173:0/2720319280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a67000c360 0x55a670067df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a8de00640 1 -- 172.21.15.173:0/2720319280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a66ffc6d90 msgr2=0x55a670067370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a8de00640 1 --2- 172.21.15.173:0/2720319280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a66ffc6d90 0x55a670067370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a8de00640 1 -- 172.21.15.173:0/2720319280 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a66fe69a10 con 0x55a67000ba40 2024-04-25T09:11:59.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a8de00640 1 --2- 172.21.15.173:0/2720319280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a67000ba40 0x55a6700678b0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f2a98154500 tx=0x7f2a80014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef107a18897f279 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a86a00640 1 -- 172.21.15.173:0/2720319280 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8001e040 con 0x55a67000ba40 2024-04-25T09:11:59.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a86a00640 1 -- 172.21.15.173:0/2720319280 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a80030070 con 0x55a67000ba40 2024-04-25T09:11:59.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a86a00640 1 -- 172.21.15.173:0/2720319280 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a80017840 con 0x55a67000ba40 2024-04-25T09:11:59.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2aa091c000 1 -- 172.21.15.173:0/2720319280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a67000ba40 msgr2=0x55a6700678b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2aa091c000 1 --2- 172.21.15.173:0/2720319280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a67000ba40 0x55a6700678b0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f2a98154500 tx=0x7f2a80014000 comp rx=0 tx=0).stop 2024-04-25T09:11:59.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2aa091c000 1 -- 172.21.15.173:0/2720319280 shutdown_connections 2024-04-25T09:11:59.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2aa091c000 1 --2- 172.21.15.173:0/2720319280 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a67000c360 0x55a670067df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2aa091c000 1 --2- 172.21.15.173:0/2720319280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a67000ba40 0x55a6700678b0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2aa091c000 1 --2- 172.21.15.173:0/2720319280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a66ffc6d90 0x55a670067370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2aa091c000 1 -- 172.21.15.173:0/2720319280 >> 172.21.15.173:0/2720319280 conn(0x55a66ffc2d40 msgr2=0x55a670009e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:59.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2aa091c000 1 -- 172.21.15.173:0/2720319280 shutdown_connections 2024-04-25T09:11:59.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2aa091c000 1 -- 172.21.15.173:0/2720319280 wait complete. 2024-04-25T09:11:59.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2aa091c000 1 -- start start 2024-04-25T09:11:59.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2aa091c000 1 Processor -- start 2024-04-25T09:11:59.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2aa091c000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a66ffc6d90 0x55a67006b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2aa091c000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a67000ba40 0x55a67006b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2aa091c000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a67000c360 0x55a670026b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2aa091c000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a66fdb29a0 con 0x55a66ffc6d90 2024-04-25T09:11:59.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2aa091c000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a981560b0 con 0x55a67000c360 2024-04-25T09:11:59.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2aa091c000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a66ffc2bc0 con 0x55a67000ba40 2024-04-25T09:11:59.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2aa091c000 10 client.0 _ll_register_callbacks cb 0x55a66fdd2a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:59.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a96800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a66ffc6d90 0x55a67006b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a96800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a66ffc6d90 0x55a67006b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40026/0 (socket says 172.21.15.173:40026) 2024-04-25T09:11:59.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a96800640 1 -- 172.21.15.173:0/3754925746 learned_addr learned my addr 172.21.15.173:0/3754925746 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:59.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a97200640 1 --2- 172.21.15.173:0/3754925746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a67000c360 0x55a670026b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.246+0000 7f2a8de00640 1 --2- 172.21.15.173:0/3754925746 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a67000ba40 0x55a67006b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a96800640 1 -- 172.21.15.173:0/3754925746 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a67000ba40 msgr2=0x55a67006b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a96800640 1 --2- 172.21.15.173:0/3754925746 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a67000ba40 0x55a67006b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a96800640 1 -- 172.21.15.173:0/3754925746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a67000c360 msgr2=0x55a670026b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a96800640 1 --2- 172.21.15.173:0/3754925746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a67000c360 0x55a670026b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a96800640 1 -- 172.21.15.173:0/3754925746 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a66fda4b00 con 0x55a66ffc6d90 2024-04-25T09:11:59.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a96800640 1 --2- 172.21.15.173:0/3754925746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a66ffc6d90 0x55a67006b2c0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f2a8801c950 tx=0x7f2a88019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acfce8356bfbc23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a7be00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:11:59.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a7be00640 1 -- 172.21.15.173:0/3754925746 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a880ebfb0 con 0x55a66ffc6d90 2024-04-25T09:11:59.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a7be00640 1 -- 172.21.15.173:0/3754925746 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2a880eed90 con 0x55a66ffc6d90 2024-04-25T09:11:59.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 1 -- 172.21.15.173:0/3754925746 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2a80030070 con 0x55a66ffc6d90 2024-04-25T09:11:59.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a7be00640 1 -- 172.21.15.173:0/3754925746 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a880eefd0 con 0x55a66ffc6d90 2024-04-25T09:11:59.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 10 client.8982 fetch_fsmap learned FSMap version 81 2024-04-25T09:11:59.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 1 -- 172.21.15.173:0/3754925746 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x55a66fdb6f80 con 0x55a66ffc6d90 2024-04-25T09:11:59.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a7be00640 1 -- 172.21.15.173:0/3754925746 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a80030070 con 0x55a66ffc6d90 2024-04-25T09:11:59.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a7be00640 1 -- 172.21.15.173:0/3754925746 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 81) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2a880eb690 con 0x55a66ffc6d90 2024-04-25T09:11:59.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 10 client.8982 fetch_fsmap finished waiting for FSMap version 81 2024-04-25T09:11:59.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 10 client.8982 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:11:59.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 20 client.8982 populate_metadata read hostname 'smithi173' 2024-04-25T09:11:59.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 1 --2- 172.21.15.173:0/3754925746 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55a670027540 0x55a670027950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 4 client.8982 mds_command: new command op to 8775 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-04-25T09:11:59.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 1 -- 172.21.15.173:0/3754925746 --> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x55a66fe1d3d0 con 0x55a670027540 2024-04-25T09:11:59.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a8de00640 1 --2- 172.21.15.173:0/3754925746 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55a670027540 0x55a670027950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a8de00640 1 --2- 172.21.15.173:0/3754925746 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55a670027540 0x55a670027950 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7521bee020aac9f server_cookie=60b29acf58ddadc in_seq=0 out_seq=0 2024-04-25T09:11:59.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a7be00640 10 client.8982 ms_handle_connect on v2:172.21.15.173:6835/671971539 2024-04-25T09:11:59.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a7be00640 1 -- 172.21.15.173:0/3754925746 <== mds.0 v2:172.21.15.173:6835/671971539 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x55a66fe1d3d0 con 0x55a670027540 2024-04-25T09:11:59.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a7be00640 10 client.8982 handle_command_reply: tid=0 2024-04-25T09:11:59.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 1 client.8982 shutdown 2024-04-25T09:11:59.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 1 -- 172.21.15.173:0/3754925746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a66ffc6d90 msgr2=0x55a67006b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 1 --2- 172.21.15.173:0/3754925746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a66ffc6d90 0x55a67006b2c0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f2a8801c950 tx=0x7f2a88019210 comp rx=0 tx=0).stop 2024-04-25T09:11:59.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 1 -- 172.21.15.173:0/3754925746 shutdown_connections 2024-04-25T09:11:59.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 1 --2- 172.21.15.173:0/3754925746 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55a670027540 0x55a670027950 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 1 --2- 172.21.15.173:0/3754925746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a67000c360 0x55a670026b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 1 --2- 172.21.15.173:0/3754925746 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55a67000ba40 0x55a67006b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 1 --2- 172.21.15.173:0/3754925746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a66ffc6d90 0x55a67006b2c0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a7be00640 0 client.8982 ms_handle_reset on v2:172.21.15.173:6835/671971539 2024-04-25T09:11:59.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 1 -- 172.21.15.173:0/3754925746 >> 172.21.15.173:0/3754925746 conn(0x55a66ffc2d40 msgr2=0x55a66ffcceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:59.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 1 -- 172.21.15.173:0/3754925746 shutdown_connections 2024-04-25T09:11:59.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 1 -- 172.21.15.173:0/3754925746 wait complete. 2024-04-25T09:11:59.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2aa091c000 20 client.8982 trim_cache size 0 max 16384 2024-04-25T09:11:59.239 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:11:59.239 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0 2024-04-25T09:11:59.240 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:11:59.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a9ca00640 1 -- 172.21.15.173:0/2951715270 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2a74066f60 msgr2=0x7f2a74069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a9ca00640 1 --2- 172.21.15.173:0/2951715270 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2a74066f60 0x7f2a74069420 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009bd0 tx=0x7f2a8000b040 comp rx=0 tx=0).stop 2024-04-25T09:11:59.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a9ca00640 1 -- 172.21.15.173:0/2951715270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a9806bda0 msgr2=0x7f2a981501c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a9ca00640 1 --2- 172.21.15.173:0/2951715270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a9806bda0 0x7f2a981501c0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f2a8801a0a0 tx=0x7f2a8801acb0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a9ca00640 1 -- 172.21.15.173:0/2951715270 shutdown_connections 2024-04-25T09:11:59.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a9ca00640 1 --2- 172.21.15.173:0/2951715270 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2a74066f60 0x7f2a74069420 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a9ca00640 1 --2- 172.21.15.173:0/2951715270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a98099a50 0x7f2a98153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a9ca00640 1 --2- 172.21.15.173:0/2951715270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a9806c220 0x7f2a98153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a9ca00640 1 --2- 172.21.15.173:0/2951715270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a9806bda0 0x7f2a981501c0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a9ca00640 1 -- 172.21.15.173:0/2951715270 >> 172.21.15.173:0/2951715270 conn(0x7f2a980b31d0 msgr2=0x7f2a98070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:59.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a9ca00640 1 -- 172.21.15.173:0/2951715270 shutdown_connections 2024-04-25T09:11:59.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.250+0000 7f2a9ca00640 1 -- 172.21.15.173:0/2951715270 wait complete. 2024-04-25T09:11:59.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:59.255 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub status 2024-04-25T09:11:59.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.406+0000 7f5862400640 1 Processor -- start 2024-04-25T09:11:59.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.406+0000 7f5862400640 1 -- start start 2024-04-25T09:11:59.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.410+0000 7f5862400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f585c0aeb90 0x7f585c0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.410+0000 7f5862400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f585c0aef70 0x7f585c0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.410+0000 7f5862400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f585c0cdba0 0x7f585c0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.410+0000 7f5862400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585c071320 con 0x7f585c0aef70 2024-04-25T09:11:59.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.410+0000 7f5862400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585c072330 con 0x7f585c0aeb90 2024-04-25T09:11:59.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.410+0000 7f5862400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0ce570 con 0x7f585c0cdba0 2024-04-25T09:11:59.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.410+0000 7f585aa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f585c0aef70 0x7f585c0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.410+0000 7f585aa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f585c0aef70 0x7f585c0cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40030/0 (socket says 172.21.15.173:40030) 2024-04-25T09:11:59.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.410+0000 7f585aa00640 1 -- 172.21.15.173:0/4243864763 learned_addr learned my addr 172.21.15.173:0/4243864763 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:59.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.410+0000 7f585b400640 1 --2- 172.21.15.173:0/4243864763 >> v2:172.21.15.194:3300/0 conn(0x7f585c0aeb90 0x7f585c0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.410+0000 7f585be00640 1 --2- 172.21.15.173:0/4243864763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f585c0cdba0 0x7f585c0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.410+0000 7f585aa00640 1 -- 172.21.15.173:0/4243864763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f585c0cdba0 msgr2=0x7f585c0ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.410+0000 7f585aa00640 1 --2- 172.21.15.173:0/4243864763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f585c0cdba0 0x7f585c0ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.410+0000 7f585aa00640 1 -- 172.21.15.173:0/4243864763 >> v2:172.21.15.194:3300/0 conn(0x7f585c0aeb90 msgr2=0x7f585c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.410+0000 7f585aa00640 1 --2- 172.21.15.173:0/4243864763 >> v2:172.21.15.194:3300/0 conn(0x7f585c0aeb90 0x7f585c0cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.410+0000 7f585aa00640 1 -- 172.21.15.173:0/4243864763 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c071570 con 0x7f585c0aef70 2024-04-25T09:11:59.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.410+0000 7f585b400640 1 --2- 172.21.15.173:0/4243864763 >> v2:172.21.15.194:3300/0 conn(0x7f585c0aeb90 0x7f585c0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:59.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.410+0000 7f585be00640 1 --2- 172.21.15.173:0/4243864763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f585c0cdba0 0x7f585c0ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:59.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.414+0000 7f585aa00640 1 --2- 172.21.15.173:0/4243864763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f585c0aef70 0x7f585c0cc610 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f585c0cd220 tx=0x7f584801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f7180c78bdc9c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.414+0000 7f585a000640 1 -- 172.21.15.173:0/4243864763 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58480ab620 con 0x7f585c0aef70 2024-04-25T09:11:59.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.414+0000 7f585a000640 1 -- 172.21.15.173:0/4243864763 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58480b0070 con 0x7f585c0aef70 2024-04-25T09:11:59.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.414+0000 7f585a000640 1 -- 172.21.15.173:0/4243864763 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58480ab9e0 con 0x7f585c0aef70 2024-04-25T09:11:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.414+0000 7f5862400640 1 -- 172.21.15.173:0/4243864763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f585c0aef70 msgr2=0x7f585c0cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.414+0000 7f5862400640 1 --2- 172.21.15.173:0/4243864763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f585c0aef70 0x7f585c0cc610 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f585c0cd220 tx=0x7f584801c460 comp rx=0 tx=0).stop 2024-04-25T09:11:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.414+0000 7f5862400640 1 -- 172.21.15.173:0/4243864763 shutdown_connections 2024-04-25T09:11:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.414+0000 7f5862400640 1 --2- 172.21.15.173:0/4243864763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f585c0cdba0 0x7f585c0ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.414+0000 7f5862400640 1 --2- 172.21.15.173:0/4243864763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f585c0aef70 0x7f585c0cc610 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.414+0000 7f5862400640 1 --2- 172.21.15.173:0/4243864763 >> v2:172.21.15.194:3300/0 conn(0x7f585c0aeb90 0x7f585c0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.414+0000 7f5862400640 1 -- 172.21.15.173:0/4243864763 >> 172.21.15.173:0/4243864763 conn(0x7f585c06ac90 msgr2=0x7f585c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.414+0000 7f5862400640 1 -- 172.21.15.173:0/4243864763 shutdown_connections 2024-04-25T09:11:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.414+0000 7f5862400640 1 -- 172.21.15.173:0/4243864763 wait complete. 2024-04-25T09:11:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.414+0000 7f5862400640 1 Processor -- start 2024-04-25T09:11:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.414+0000 7f5862400640 1 -- start start 2024-04-25T09:11:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f5862400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f585c0aeb90 0x7f585c144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f5862400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f585c0aef70 0x7f585c0afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f5862400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f585c0cdba0 0x7f585c14a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f5862400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c15ef40 con 0x7f585c0aeb90 2024-04-25T09:11:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f5862400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c15edc0 con 0x7f585c0aef70 2024-04-25T09:11:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f5862400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c15f0c0 con 0x7f585c0cdba0 2024-04-25T09:11:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f585b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f585c0aeb90 0x7f585c144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f585b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f585c0aeb90 0x7f585c144b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40034/0 (socket says 172.21.15.173:40034) 2024-04-25T09:11:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f585b400640 1 -- 172.21.15.173:0/43569901 learned_addr learned my addr 172.21.15.173:0/43569901 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f585aa00640 1 --2- 172.21.15.173:0/43569901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f585c0aef70 0x7f585c0afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f585be00640 1 --2- 172.21.15.173:0/43569901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f585c0cdba0 0x7f585c14a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f585b400640 1 -- 172.21.15.173:0/43569901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f585c0cdba0 msgr2=0x7f585c14a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f585b400640 1 --2- 172.21.15.173:0/43569901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f585c0cdba0 0x7f585c14a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f585b400640 1 -- 172.21.15.173:0/43569901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f585c0aef70 msgr2=0x7f585c0afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f585b400640 1 --2- 172.21.15.173:0/43569901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f585c0aef70 0x7f585c0afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f585b400640 1 -- 172.21.15.173:0/43569901 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c145050 con 0x7f585c0aeb90 2024-04-25T09:11:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f585aa00640 1 --2- 172.21.15.173:0/43569901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f585c0aef70 0x7f585c0afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f585b400640 1 --2- 172.21.15.173:0/43569901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f585c0aeb90 0x7f585c144b10 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f584c00ce30 tx=0x7f584c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f5853400640 1 -- 172.21.15.173:0/43569901 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c00f680 con 0x7f585c0aeb90 2024-04-25T09:11:59.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f5853400640 1 -- 172.21.15.173:0/43569901 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584c00f820 con 0x7f585c0aeb90 2024-04-25T09:11:59.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f5853400640 1 -- 172.21.15.173:0/43569901 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c00fc10 con 0x7f585c0aeb90 2024-04-25T09:11:59.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f5862400640 1 -- 172.21.15.173:0/43569901 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c146bb0 con 0x7f585c0aeb90 2024-04-25T09:11:59.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.418+0000 7f5862400640 1 -- 172.21.15.173:0/43569901 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585c147170 con 0x7f585c0aeb90 2024-04-25T09:11:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f5853400640 1 -- 172.21.15.173:0/43569901 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f584c018400 con 0x7f585c0aeb90 2024-04-25T09:11:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f5853400640 1 --2- 172.21.15.173:0/43569901 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f583c066f60 0x7f583c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f5853400640 1 -- 172.21.15.173:0/43569901 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f584c085ec0 con 0x7f585c0aeb90 2024-04-25T09:11:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f58657df000 1 Processor -- start 2024-04-25T09:11:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f585aa00640 1 --2- 172.21.15.173:0/43569901 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f583c066f60 0x7f583c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f58657df000 1 -- start start 2024-04-25T09:11:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f585aa00640 1 --2- 172.21.15.173:0/43569901 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f583c066f60 0x7f583c069420 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f58480af000 tx=0x7f58480a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f58657df000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df103d79d0 0x55df103d7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f58657df000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df1038db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f58657df000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df1038e0a0 0x55df1038e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f58657df000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df101daff0 con 0x55df103d82f0 2024-04-25T09:11:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f58657df000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df10163150 con 0x55df103d79d0 2024-04-25T09:11:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f58657df000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df101d7090 con 0x55df1038e0a0 2024-04-25T09:11:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f585aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df1038db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f585aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df1038db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40046/0 (socket says 172.21.15.173:40046) 2024-04-25T09:11:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f585aa00640 1 -- 172.21.15.173:0/2502673189 learned_addr learned my addr 172.21.15.173:0/2502673189 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f585b400640 1 --2- 172.21.15.173:0/2502673189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df103d79d0 0x55df103d7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f585be00640 1 --2- 172.21.15.173:0/2502673189 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df1038e0a0 0x55df1038e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f585aa00640 1 -- 172.21.15.173:0/2502673189 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df1038e0a0 msgr2=0x55df1038e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f585aa00640 1 --2- 172.21.15.173:0/2502673189 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df1038e0a0 0x55df1038e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f585aa00640 1 -- 172.21.15.173:0/2502673189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df103d79d0 msgr2=0x55df103d7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f585aa00640 1 --2- 172.21.15.173:0/2502673189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df103d79d0 0x55df103d7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f585aa00640 1 -- 172.21.15.173:0/2502673189 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df103710d0 con 0x55df103d82f0 2024-04-25T09:11:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f585aa00640 1 --2- 172.21.15.173:0/2502673189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df1038db60 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f584801c9d0 tx=0x7f5848004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7667729f29bb974 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f5847e00640 1 -- 172.21.15.173:0/2502673189 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58480ba070 con 0x55df103d82f0 2024-04-25T09:11:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.422+0000 7f5847e00640 1 -- 172.21.15.173:0/2502673189 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58480b0040 con 0x55df103d82f0 2024-04-25T09:11:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f5847e00640 1 -- 172.21.15.173:0/2502673189 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58480ca880 con 0x55df103d82f0 2024-04-25T09:11:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 -- 172.21.15.173:0/2502673189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 msgr2=0x55df1038db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 --2- 172.21.15.173:0/2502673189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df1038db60 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f584801c9d0 tx=0x7f5848004740 comp rx=0 tx=0).stop 2024-04-25T09:11:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 -- 172.21.15.173:0/2502673189 shutdown_connections 2024-04-25T09:11:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 --2- 172.21.15.173:0/2502673189 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df1038e0a0 0x55df1038e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 --2- 172.21.15.173:0/2502673189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df1038db60 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 --2- 172.21.15.173:0/2502673189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df103d79d0 0x55df103d7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 -- 172.21.15.173:0/2502673189 >> 172.21.15.173:0/2502673189 conn(0x55df1038a020 msgr2=0x55df1038c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 -- 172.21.15.173:0/2502673189 shutdown_connections 2024-04-25T09:11:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 -- 172.21.15.173:0/2502673189 wait complete. 2024-04-25T09:11:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 -- start start 2024-04-25T09:11:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 Processor -- start 2024-04-25T09:11:59.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df1038e0a0 0x55df103bc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df103d79d0 0x55df103bcd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df103bd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df1019f250 con 0x55df103d82f0 2024-04-25T09:11:59.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df10195690 con 0x55df1038e0a0 2024-04-25T09:11:59.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df10163a40 con 0x55df103d79d0 2024-04-25T09:11:59.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 10 client.0 _ll_register_callbacks cb 0x55df10378e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:59.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f585be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df103bd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f585be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df103bd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40048/0 (socket says 172.21.15.173:40048) 2024-04-25T09:11:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f585be00640 1 -- 172.21.15.173:0/3696595204 learned_addr learned my addr 172.21.15.173:0/3696595204 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f585b400640 1 --2- 172.21.15.173:0/3696595204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df1038e0a0 0x55df103bc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f585aa00640 1 --2- 172.21.15.173:0/3696595204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df103d79d0 0x55df103bcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f585be00640 1 -- 172.21.15.173:0/3696595204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df103d79d0 msgr2=0x55df103bcd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f585be00640 1 --2- 172.21.15.173:0/3696595204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df103d79d0 0x55df103bcd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f585be00640 1 -- 172.21.15.173:0/3696595204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df1038e0a0 msgr2=0x55df103bc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f585be00640 1 --2- 172.21.15.173:0/3696595204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df1038e0a0 0x55df103bc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f585be00640 1 -- 172.21.15.173:0/3696595204 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df102881c0 con 0x55df103d82f0 2024-04-25T09:11:59.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f585be00640 1 --2- 172.21.15.173:0/3696595204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df103bd270 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f5854003d30 tx=0x7f585400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2524ade681ce80b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f5844c00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:11:59.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f5844c00640 1 -- 172.21.15.173:0/3696595204 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5854018070 con 0x55df103d82f0 2024-04-25T09:11:59.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f5844c00640 1 -- 172.21.15.173:0/3696595204 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5854014650 con 0x55df103d82f0 2024-04-25T09:11:59.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 -- 172.21.15.173:0/3696595204 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58480b0040 con 0x55df103d82f0 2024-04-25T09:11:59.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f5844c00640 1 -- 172.21.15.173:0/3696595204 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5854023050 con 0x55df103d82f0 2024-04-25T09:11:59.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 10 client.8994 fetch_fsmap learned FSMap version 81 2024-04-25T09:11:59.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.426+0000 7f58657df000 1 -- 172.21.15.173:0/3696595204 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x55df10284170 con 0x55df103d82f0 2024-04-25T09:11:59.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f5844c00640 1 -- 172.21.15.173:0/3696595204 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58480b0040 con 0x55df103d82f0 2024-04-25T09:11:59.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f5844c00640 1 -- 172.21.15.173:0/3696595204 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 81) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5854026020 con 0x55df103d82f0 2024-04-25T09:11:59.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f58657df000 10 client.8994 fetch_fsmap finished waiting for FSMap version 81 2024-04-25T09:11:59.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f58657df000 10 client.8994 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:11:59.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f58657df000 20 client.8994 populate_metadata read hostname 'smithi173' 2024-04-25T09:11:59.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f58657df000 1 --2- 172.21.15.173:0/3696595204 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55df103e7c80 0x55df103ea070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f58657df000 4 client.8994 mds_command: new command op to 8775 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:11:59.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f58657df000 1 -- 172.21.15.173:0/3696595204 --> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df10176c60 con 0x55df103e7c80 2024-04-25T09:11:59.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f585b400640 1 --2- 172.21.15.173:0/3696595204 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55df103e7c80 0x55df103ea070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f585b400640 1 --2- 172.21.15.173:0/3696595204 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55df103e7c80 0x55df103ea070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65433842ab39fad6 server_cookie=ff0e716a9e3a61b1 in_seq=0 out_seq=0 2024-04-25T09:11:59.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f5844c00640 10 client.8994 ms_handle_connect on v2:172.21.15.173:6835/671971539 2024-04-25T09:11:59.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f5844c00640 1 -- 172.21.15.173:0/3696595204 <== mds.0 v2:172.21.15.173:6835/671971539 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55df10176c60 con 0x55df103e7c80 2024-04-25T09:11:59.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f5844c00640 10 client.8994 handle_command_reply: tid=0 2024-04-25T09:11:59.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f58657df000 1 client.8994 shutdown 2024-04-25T09:11:59.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f58657df000 1 -- 172.21.15.173:0/3696595204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 msgr2=0x55df103bd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f58657df000 1 --2- 172.21.15.173:0/3696595204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df103bd270 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f5854003d30 tx=0x7f585400c910 comp rx=0 tx=0).stop 2024-04-25T09:11:59.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f58657df000 1 -- 172.21.15.173:0/3696595204 shutdown_connections 2024-04-25T09:11:59.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f58657df000 1 --2- 172.21.15.173:0/3696595204 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55df103e7c80 0x55df103ea070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f58657df000 1 --2- 172.21.15.173:0/3696595204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df103bd270 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f58657df000 1 --2- 172.21.15.173:0/3696595204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df103d79d0 0x55df103bcd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f58657df000 1 --2- 172.21.15.173:0/3696595204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df1038e0a0 0x55df103bc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f5844c00640 0 client.8994 ms_handle_reset on v2:172.21.15.173:6835/671971539 2024-04-25T09:11:59.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f58657df000 1 -- 172.21.15.173:0/3696595204 >> 172.21.15.173:0/3696595204 conn(0x55df1038a020 msgr2=0x55df1038cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:59.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f58657df000 1 -- 172.21.15.173:0/3696595204 shutdown_connections 2024-04-25T09:11:59.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f58657df000 1 -- 172.21.15.173:0/3696595204 wait complete. 2024-04-25T09:11:59.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.430+0000 7f58657df000 20 client.8994 trim_cache size 0 max 16384 2024-04-25T09:11:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f58657df000 1 Processor -- start 2024-04-25T09:11:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f58657df000 1 -- start start 2024-04-25T09:11:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f58657df000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df1038e0a0 0x55df104340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f58657df000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df103d79d0 0x55df10434630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f58657df000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df10434b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f58657df000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c202ff0 con 0x55df103d82f0 2024-04-25T09:11:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f58657df000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c2021b0 con 0x55df103d79d0 2024-04-25T09:11:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f58657df000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0ad630 con 0x55df1038e0a0 2024-04-25T09:11:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f585be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df10434b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f585be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df10434b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40054/0 (socket says 172.21.15.173:40054) 2024-04-25T09:11:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f585be00640 1 -- 172.21.15.173:0/586149786 learned_addr learned my addr 172.21.15.173:0/586149786 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f585b400640 1 --2- 172.21.15.173:0/586149786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df1038e0a0 0x55df104340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f585aa00640 1 --2- 172.21.15.173:0/586149786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df103d79d0 0x55df10434630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f585be00640 1 -- 172.21.15.173:0/586149786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df1038e0a0 msgr2=0x55df104340f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f585be00640 1 --2- 172.21.15.173:0/586149786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df1038e0a0 0x55df104340f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f585be00640 1 -- 172.21.15.173:0/586149786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df103d79d0 msgr2=0x55df10434630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f585be00640 1 --2- 172.21.15.173:0/586149786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df103d79d0 0x55df10434630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f585be00640 1 -- 172.21.15.173:0/586149786 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df10221de0 con 0x55df103d82f0 2024-04-25T09:11:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f585be00640 1 --2- 172.21.15.173:0/586149786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df10434b70 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f5854006b20 tx=0x7f585400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757280730ad5baf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f5847400640 1 -- 172.21.15.173:0/586149786 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5854018070 con 0x55df103d82f0 2024-04-25T09:11:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f5847400640 1 -- 172.21.15.173:0/586149786 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5854000e50 con 0x55df103d82f0 2024-04-25T09:11:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f5847400640 1 -- 172.21.15.173:0/586149786 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5854014ba0 con 0x55df103d82f0 2024-04-25T09:11:59.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f58657df000 1 -- 172.21.15.173:0/586149786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 msgr2=0x55df10434b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f58657df000 1 --2- 172.21.15.173:0/586149786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df10434b70 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f5854006b20 tx=0x7f585400e000 comp rx=0 tx=0).stop 2024-04-25T09:11:59.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f58657df000 1 -- 172.21.15.173:0/586149786 shutdown_connections 2024-04-25T09:11:59.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f58657df000 1 --2- 172.21.15.173:0/586149786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df10434b70 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f58657df000 1 --2- 172.21.15.173:0/586149786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df103d79d0 0x55df10434630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f58657df000 1 --2- 172.21.15.173:0/586149786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df1038e0a0 0x55df104340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f58657df000 1 -- 172.21.15.173:0/586149786 >> 172.21.15.173:0/586149786 conn(0x55df1038a020 msgr2=0x55df103d60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:59.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f58657df000 1 -- 172.21.15.173:0/586149786 shutdown_connections 2024-04-25T09:11:59.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.446+0000 7f58657df000 1 -- 172.21.15.173:0/586149786 wait complete. 2024-04-25T09:11:59.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 1 -- start start 2024-04-25T09:11:59.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 1 Processor -- start 2024-04-25T09:11:59.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df1038e0a0 0x55df103ea770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df103d79d0 0x55df103eacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df103eb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df10175e00 con 0x55df103d82f0 2024-04-25T09:11:59.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c149be0 con 0x55df1038e0a0 2024-04-25T09:11:59.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df101da300 con 0x55df103d79d0 2024-04-25T09:11:59.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 10 client.0 _ll_register_callbacks cb 0x55df10359040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:59.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f585b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df1038e0a0 0x55df103ea770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f585be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df103eb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f585aa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df103d79d0 0x55df103eacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f585be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df103eb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40058/0 (socket says 172.21.15.173:40058) 2024-04-25T09:11:59.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f585b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df1038e0a0 0x55df103ea770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:57474/0 (socket says 172.21.15.173:57474) 2024-04-25T09:11:59.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f585be00640 1 -- 172.21.15.173:0/2429705326 learned_addr learned my addr 172.21.15.173:0/2429705326 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:59.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f585be00640 1 -- 172.21.15.173:0/2429705326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df103d79d0 msgr2=0x55df103eacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f585be00640 1 --2- 172.21.15.173:0/2429705326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df103d79d0 0x55df103eacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f585be00640 1 -- 172.21.15.173:0/2429705326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df1038e0a0 msgr2=0x55df103ea770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f585be00640 1 --2- 172.21.15.173:0/2429705326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df1038e0a0 0x55df103ea770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f585be00640 1 -- 172.21.15.173:0/2429705326 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df1017c8e0 con 0x55df103d82f0 2024-04-25T09:11:59.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f585be00640 1 --2- 172.21.15.173:0/2429705326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df103eb1f0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f585400c910 tx=0x7f58540046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3950c100e41c0b61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f5844c00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:11:59.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f5844c00640 1 -- 172.21.15.173:0/2429705326 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5854018050 con 0x55df103d82f0 2024-04-25T09:11:59.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f5844c00640 1 -- 172.21.15.173:0/2429705326 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f585403a480 con 0x55df103d82f0 2024-04-25T09:11:59.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 1 -- 172.21.15.173:0/2429705326 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5854000e50 con 0x55df103d82f0 2024-04-25T09:11:59.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f5844c00640 1 -- 172.21.15.173:0/2429705326 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5854042050 con 0x55df103d82f0 2024-04-25T09:11:59.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 10 client.9000 fetch_fsmap learned FSMap version 81 2024-04-25T09:11:59.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 1 -- 172.21.15.173:0/2429705326 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x55df102348f0 con 0x55df103d82f0 2024-04-25T09:11:59.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f5844c00640 1 -- 172.21.15.173:0/2429705326 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5854000e50 con 0x55df103d82f0 2024-04-25T09:11:59.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f5844c00640 1 -- 172.21.15.173:0/2429705326 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 81) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5854045020 con 0x55df103d82f0 2024-04-25T09:11:59.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 10 client.9000 fetch_fsmap finished waiting for FSMap version 81 2024-04-25T09:11:59.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 10 client.9000 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:11:59.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 20 client.9000 populate_metadata read hostname 'smithi173' 2024-04-25T09:11:59.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 1 --2- 172.21.15.173:0/2429705326 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55df1043df50 0x55df10440340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 4 client.9000 mds_command: new command op to 8775 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:11:59.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 1 -- 172.21.15.173:0/2429705326 --> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55df101e8530 con 0x55df1043df50 2024-04-25T09:11:59.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f585b400640 1 --2- 172.21.15.173:0/2429705326 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55df1043df50 0x55df10440340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f585b400640 1 --2- 172.21.15.173:0/2429705326 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55df1043df50 0x55df10440340 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc0fc58beea88c90 server_cookie=af9a127f1a031706 in_seq=0 out_seq=0 2024-04-25T09:11:59.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f5844c00640 10 client.9000 ms_handle_connect on v2:172.21.15.173:6835/671971539 2024-04-25T09:11:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f5844c00640 1 -- 172.21.15.173:0/2429705326 <== mds.0 v2:172.21.15.173:6835/671971539 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x55df101e8530 con 0x55df1043df50 2024-04-25T09:11:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f5844c00640 10 client.9000 handle_command_reply: tid=0 2024-04-25T09:11:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.450+0000 7f58657df000 1 client.9000 shutdown 2024-04-25T09:11:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f58657df000 1 -- 172.21.15.173:0/2429705326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 msgr2=0x55df103eb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f58657df000 1 --2- 172.21.15.173:0/2429705326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df103eb1f0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f585400c910 tx=0x7f58540046d0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f58657df000 1 -- 172.21.15.173:0/2429705326 shutdown_connections 2024-04-25T09:11:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f58657df000 1 --2- 172.21.15.173:0/2429705326 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55df1043df50 0x55df10440340 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f58657df000 1 --2- 172.21.15.173:0/2429705326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df103d82f0 0x55df103eb1f0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f58657df000 1 --2- 172.21.15.173:0/2429705326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55df103d79d0 0x55df103eacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f5844c00640 0 client.9000 ms_handle_reset on v2:172.21.15.173:6835/671971539 2024-04-25T09:11:59.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f58657df000 1 --2- 172.21.15.173:0/2429705326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55df1038e0a0 0x55df103ea770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f58657df000 1 -- 172.21.15.173:0/2429705326 >> 172.21.15.173:0/2429705326 conn(0x55df1038a020 msgr2=0x55df103d6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:59.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f58657df000 1 -- 172.21.15.173:0/2429705326 shutdown_connections 2024-04-25T09:11:59.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f58657df000 1 -- 172.21.15.173:0/2429705326 wait complete. 2024-04-25T09:11:59.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f58657df000 20 client.9000 trim_cache size 0 max 16384 2024-04-25T09:11:59.448 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:11:59.448 INFO:teuthology.orchestra.run.smithi173.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-04-25T09:11:59.448 INFO:teuthology.orchestra.run.smithi173.stdout: "scrubs": { 2024-04-25T09:11:59.448 INFO:teuthology.orchestra.run.smithi173.stdout: "1915a84e-397a-4a41-95ea-651f8327cb8d": { 2024-04-25T09:11:59.448 INFO:teuthology.orchestra.run.smithi173.stdout: "path": "/scrub_control_test_path", 2024-04-25T09:11:59.448 INFO:teuthology.orchestra.run.smithi173.stdout: "tag": "1915a84e-397a-4a41-95ea-651f8327cb8d", 2024-04-25T09:11:59.448 INFO:teuthology.orchestra.run.smithi173.stdout: "options": "recursive" 2024-04-25T09:11:59.449 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:59.449 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:11:59.449 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:11:59.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f5862400640 1 -- 172.21.15.173:0/43569901 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f583c066f60 msgr2=0x7f583c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f5862400640 1 --2- 172.21.15.173:0/43569901 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f583c066f60 0x7f583c069420 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f58480af000 tx=0x7f58480a7000 comp rx=0 tx=0).stop 2024-04-25T09:11:59.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f5862400640 1 -- 172.21.15.173:0/43569901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f585c0aeb90 msgr2=0x7f585c144b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f5862400640 1 --2- 172.21.15.173:0/43569901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f585c0aeb90 0x7f585c144b10 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f584c00ce30 tx=0x7f584c00a650 comp rx=0 tx=0).stop 2024-04-25T09:11:59.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f5862400640 1 -- 172.21.15.173:0/43569901 shutdown_connections 2024-04-25T09:11:59.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f5862400640 1 --2- 172.21.15.173:0/43569901 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f583c066f60 0x7f583c069420 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f5862400640 1 --2- 172.21.15.173:0/43569901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f585c0cdba0 0x7f585c14a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f5862400640 1 --2- 172.21.15.173:0/43569901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f585c0aef70 0x7f585c0afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f5862400640 1 --2- 172.21.15.173:0/43569901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f585c0aeb90 0x7f585c144b10 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f5862400640 1 -- 172.21.15.173:0/43569901 >> 172.21.15.173:0/43569901 conn(0x7f585c06ac90 msgr2=0x7f585c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:59.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f5862400640 1 -- 172.21.15.173:0/43569901 shutdown_connections 2024-04-25T09:11:59.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.454+0000 7f5862400640 1 -- 172.21.15.173:0/43569901 wait complete. 2024-04-25T09:11:59.457 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:59.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.606+0000 7fc15a600640 1 Processor -- start 2024-04-25T09:11:59.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.606+0000 7fc15a600640 1 -- start start 2024-04-25T09:11:59.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.610+0000 7fc15a600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc1540b3e70 0x7fc1540b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.610+0000 7fc15a600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc1540aefa0 0x7fc1540b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.610+0000 7fc15a600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc15415edd0 0x7fc1540b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.610+0000 7fc15a600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc15406dd50 con 0x7fc1540b3e70 2024-04-25T09:11:59.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.610+0000 7fc15a600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1540b4790 con 0x7fc1540aefa0 2024-04-25T09:11:59.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.610+0000 7fc15a600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15415f320 con 0x7fc15415edd0 2024-04-25T09:11:59.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.610+0000 7fc153400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc1540b3e70 0x7fc1540b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.610+0000 7fc153400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc1540b3e70 0x7fc1540b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40066/0 (socket says 172.21.15.173:40066) 2024-04-25T09:11:59.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.610+0000 7fc153400640 1 -- 172.21.15.173:0/2240801917 learned_addr learned my addr 172.21.15.173:0/2240801917 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:59.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.610+0000 7fc153e00640 1 --2- 172.21.15.173:0/2240801917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc15415edd0 0x7fc1540b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.610+0000 7fc152a00640 1 --2- 172.21.15.173:0/2240801917 >> v2:172.21.15.194:3300/0 conn(0x7fc1540aefa0 0x7fc1540b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.610+0000 7fc153400640 1 -- 172.21.15.173:0/2240801917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc15415edd0 msgr2=0x7fc1540b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.610+0000 7fc153400640 1 --2- 172.21.15.173:0/2240801917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc15415edd0 0x7fc1540b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.610+0000 7fc153400640 1 -- 172.21.15.173:0/2240801917 >> v2:172.21.15.194:3300/0 conn(0x7fc1540aefa0 msgr2=0x7fc1540b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.610+0000 7fc153400640 1 --2- 172.21.15.173:0/2240801917 >> v2:172.21.15.194:3300/0 conn(0x7fc1540aefa0 0x7fc1540b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.610+0000 7fc153400640 1 -- 172.21.15.173:0/2240801917 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15406d420 con 0x7fc1540b3e70 2024-04-25T09:11:59.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.610+0000 7fc152a00640 1 --2- 172.21.15.173:0/2240801917 >> v2:172.21.15.194:3300/0 conn(0x7fc1540aefa0 0x7fc1540b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:59.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.614+0000 7fc153400640 1 --2- 172.21.15.173:0/2240801917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1540b3e70 0x7fc1540b4250 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fc1540d0650 tx=0x7fc14401ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a93e2267bb6c9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.614+0000 7fc152000640 1 -- 172.21.15.173:0/2240801917 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14400b2d0 con 0x7fc1540b3e70 2024-04-25T09:11:59.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.614+0000 7fc152000640 1 -- 172.21.15.173:0/2240801917 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14400b470 con 0x7fc1540b3e70 2024-04-25T09:11:59.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.614+0000 7fc152000640 1 -- 172.21.15.173:0/2240801917 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1440a7b90 con 0x7fc1540b3e70 2024-04-25T09:11:59.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.614+0000 7fc15a600640 1 -- 172.21.15.173:0/2240801917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1540b3e70 msgr2=0x7fc1540b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.614+0000 7fc15a600640 1 --2- 172.21.15.173:0/2240801917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1540b3e70 0x7fc1540b4250 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fc1540d0650 tx=0x7fc14401ebc0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.614+0000 7fc15a600640 1 -- 172.21.15.173:0/2240801917 shutdown_connections 2024-04-25T09:11:59.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.614+0000 7fc15a600640 1 --2- 172.21.15.173:0/2240801917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc15415edd0 0x7fc1540b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.614+0000 7fc15a600640 1 --2- 172.21.15.173:0/2240801917 >> v2:172.21.15.194:3300/0 conn(0x7fc1540aefa0 0x7fc1540b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.614+0000 7fc15a600640 1 --2- 172.21.15.173:0/2240801917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1540b3e70 0x7fc1540b4250 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.614+0000 7fc15a600640 1 -- 172.21.15.173:0/2240801917 >> 172.21.15.173:0/2240801917 conn(0x7fc15406ac90 msgr2=0x7fc15406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:59.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.614+0000 7fc15a600640 1 -- 172.21.15.173:0/2240801917 shutdown_connections 2024-04-25T09:11:59.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.614+0000 7fc15a600640 1 -- 172.21.15.173:0/2240801917 wait complete. 2024-04-25T09:11:59.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.614+0000 7fc15a600640 1 Processor -- start 2024-04-25T09:11:59.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.614+0000 7fc15a600640 1 -- start start 2024-04-25T09:11:59.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc15a600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1540aefa0 0x7fc15415bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc15a600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1540b3e70 0x7fc154159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc15a600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc15415edd0 0x7fc15414ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc15a600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15406e1e0 con 0x7fc1540b3e70 2024-04-25T09:11:59.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc15a600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1540b3600 con 0x7fc1540aefa0 2024-04-25T09:11:59.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc15a600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15406e360 con 0x7fc15415edd0 2024-04-25T09:11:59.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc152a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1540b3e70 0x7fc154159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc152a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1540b3e70 0x7fc154159c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40070/0 (socket says 172.21.15.173:40070) 2024-04-25T09:11:59.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc152a00640 1 -- 172.21.15.173:0/1914607512 learned_addr learned my addr 172.21.15.173:0/1914607512 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:59.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc153400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1540aefa0 0x7fc15415bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc153e00640 1 --2- 172.21.15.173:0/1914607512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc15415edd0 0x7fc15414ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc152a00640 1 -- 172.21.15.173:0/1914607512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc15415edd0 msgr2=0x7fc15414ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc152a00640 1 --2- 172.21.15.173:0/1914607512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc15415edd0 0x7fc15414ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc152a00640 1 -- 172.21.15.173:0/1914607512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1540aefa0 msgr2=0x7fc15415bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc152a00640 1 --2- 172.21.15.173:0/1914607512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1540aefa0 0x7fc15415bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc152a00640 1 -- 172.21.15.173:0/1914607512 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15415af50 con 0x7fc1540b3e70 2024-04-25T09:11:59.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc153400640 1 --2- 172.21.15.173:0/1914607512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1540aefa0 0x7fc15415bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:59.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc152a00640 1 --2- 172.21.15.173:0/1914607512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1540b3e70 0x7fc154159c40 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fc14000c820 tx=0x7fc14000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc14b400640 1 -- 172.21.15.173:0/1914607512 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140015070 con 0x7fc1540b3e70 2024-04-25T09:11:59.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc14b400640 1 -- 172.21.15.173:0/1914607512 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc140007820 con 0x7fc1540b3e70 2024-04-25T09:11:59.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc15a600640 1 -- 172.21.15.173:0/1914607512 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc15415b230 con 0x7fc1540b3e70 2024-04-25T09:11:59.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc14b400640 1 -- 172.21.15.173:0/1914607512 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140007c10 con 0x7fc1540b3e70 2024-04-25T09:11:59.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc15a600640 1 -- 172.21.15.173:0/1914607512 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc15415a180 con 0x7fc1540b3e70 2024-04-25T09:11:59.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc15a600640 1 -- 172.21.15.173:0/1914607512 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc154073a40 con 0x7fc1540b3e70 2024-04-25T09:11:59.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.618+0000 7fc14b400640 1 -- 172.21.15.173:0/1914607512 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc140018070 con 0x7fc1540b3e70 2024-04-25T09:11:59.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.622+0000 7fc14b400640 1 --2- 172.21.15.173:0/1914607512 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc134066f60 0x7fc134069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.622+0000 7fc14b400640 1 -- 172.21.15.173:0/1914607512 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc140085070 con 0x7fc1540b3e70 2024-04-25T09:11:59.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.622+0000 7fc153400640 1 --2- 172.21.15.173:0/1914607512 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc134066f60 0x7fc134069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.622+0000 7fc153400640 1 --2- 172.21.15.173:0/1914607512 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc134066f60 0x7fc134069420 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc1440b0000 tx=0x7fc1440a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.626+0000 7fc14b400640 1 -- 172.21.15.173:0/1914607512 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc140055770 con 0x7fc1540b3e70 2024-04-25T09:11:59.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.814+0000 7fc15a600640 1 -- 172.21.15.173:0/1914607512 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc15406e540 con 0x7fc1540b3e70 2024-04-25T09:11:59.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.814+0000 7fc14b400640 1 -- 172.21.15.173:0/1914607512 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fc140059810 con 0x7fc1540b3e70 2024-04-25T09:11:59.799 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:11:59.800 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1021410995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1021410995},{"type":"v1","addr":"172.21.15.194:6834","nonce":1021410995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2198134208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2198134208},{"type":"v1","addr":"172.21.15.194:6835","nonce":2198134208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8772,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/684989574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":684989574},{"type":"v1","addr":"172.21.15.173:6836","nonce":684989574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:26.148874+0000","modified":"2024-04-25T09:11:29.164422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8775":{"gid":8775,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/671971539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":671971539},{"type":"v1","addr":"172.21.15.173:6837","nonce":671971539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:11:59.800 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 81 2024-04-25T09:11:59.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.818+0000 7fc15a600640 1 -- 172.21.15.173:0/1914607512 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc134066f60 msgr2=0x7fc134069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.818+0000 7fc15a600640 1 --2- 172.21.15.173:0/1914607512 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc134066f60 0x7fc134069420 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc1440b0000 tx=0x7fc1440a9070 comp rx=0 tx=0).stop 2024-04-25T09:11:59.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.818+0000 7fc15a600640 1 -- 172.21.15.173:0/1914607512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1540b3e70 msgr2=0x7fc154159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.818+0000 7fc15a600640 1 --2- 172.21.15.173:0/1914607512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1540b3e70 0x7fc154159c40 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fc14000c820 tx=0x7fc14000cc20 comp rx=0 tx=0).stop 2024-04-25T09:11:59.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.818+0000 7fc15a600640 1 -- 172.21.15.173:0/1914607512 shutdown_connections 2024-04-25T09:11:59.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.818+0000 7fc15a600640 1 --2- 172.21.15.173:0/1914607512 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc134066f60 0x7fc134069420 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.818+0000 7fc15a600640 1 --2- 172.21.15.173:0/1914607512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc15415edd0 0x7fc15414ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.818+0000 7fc15a600640 1 --2- 172.21.15.173:0/1914607512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1540b3e70 0x7fc154159c40 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.818+0000 7fc15a600640 1 --2- 172.21.15.173:0/1914607512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1540aefa0 0x7fc15415bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.818+0000 7fc15a600640 1 -- 172.21.15.173:0/1914607512 >> 172.21.15.173:0/1914607512 conn(0x7fc15406ac90 msgr2=0x7fc154153510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:59.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.818+0000 7fc15a600640 1 -- 172.21.15.173:0/1914607512 shutdown_connections 2024-04-25T09:11:59.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.818+0000 7fc15a600640 1 -- 172.21.15.173:0/1914607512 wait complete. 2024-04-25T09:11:59.820 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:11:59.820 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:11:59.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.970+0000 7f201f800640 1 Processor -- start 2024-04-25T09:11:59.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.970+0000 7f201f800640 1 -- start start 2024-04-25T09:11:59.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.970+0000 7f201f800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f201815bbb0 0x7f20180cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.970+0000 7f201f800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20180cf9c0 0x7f20180cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.970+0000 7f201f800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f20180cc900 0x7f2018099b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.970+0000 7f201f800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20180d0180 con 0x7f201815bbb0 2024-04-25T09:11:59.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.970+0000 7f201f800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20180d0460 con 0x7f20180cc900 2024-04-25T09:11:59.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.970+0000 7f201f800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20180c5530 con 0x7f20180cf9c0 2024-04-25T09:11:59.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.970+0000 7f201ce00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f201815bbb0 0x7f20180cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.970+0000 7f201ce00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f201815bbb0 0x7f20180cf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40078/0 (socket says 172.21.15.173:40078) 2024-04-25T09:11:59.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.970+0000 7f201ce00640 1 -- 172.21.15.173:0/595028011 learned_addr learned my addr 172.21.15.173:0/595028011 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:59.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.970+0000 7f201d800640 1 --2- 172.21.15.173:0/595028011 >> v2:172.21.15.194:3300/0 conn(0x7f20180cc900 0x7f2018099b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.970+0000 7f200fe00640 1 --2- 172.21.15.173:0/595028011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20180cf9c0 0x7f20180cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.970+0000 7f201ce00640 1 -- 172.21.15.173:0/595028011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20180cf9c0 msgr2=0x7f20180cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.970+0000 7f201ce00640 1 --2- 172.21.15.173:0/595028011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20180cf9c0 0x7f20180cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.970+0000 7f201ce00640 1 -- 172.21.15.173:0/595028011 >> v2:172.21.15.194:3300/0 conn(0x7f20180cc900 msgr2=0x7f2018099b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:59.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.970+0000 7f201ce00640 1 --2- 172.21.15.173:0/595028011 >> v2:172.21.15.194:3300/0 conn(0x7f20180cc900 0x7f2018099b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.970+0000 7f201ce00640 1 -- 172.21.15.173:0/595028011 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20180c5810 con 0x7f201815bbb0 2024-04-25T09:11:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.974+0000 7f201ce00640 1 --2- 172.21.15.173:0/595028011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f201815bbb0 0x7f20180cf480 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f20180b7930 tx=0x7f200801c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e48e2a5cd131f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.974+0000 7f2017e00640 1 -- 172.21.15.173:0/595028011 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20080b0070 con 0x7f201815bbb0 2024-04-25T09:11:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.974+0000 7f2017e00640 1 -- 172.21.15.173:0/595028011 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20080ab600 con 0x7f201815bbb0 2024-04-25T09:11:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.974+0000 7f2017e00640 1 -- 172.21.15.173:0/595028011 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20080ab9d0 con 0x7f201815bbb0 2024-04-25T09:11:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.974+0000 7f201f800640 1 -- 172.21.15.173:0/595028011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f201815bbb0 msgr2=0x7f20180cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.974+0000 7f201f800640 1 --2- 172.21.15.173:0/595028011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f201815bbb0 0x7f20180cf480 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f20180b7930 tx=0x7f200801c1a0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.974+0000 7f201f800640 1 -- 172.21.15.173:0/595028011 shutdown_connections 2024-04-25T09:11:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.974+0000 7f201f800640 1 --2- 172.21.15.173:0/595028011 >> v2:172.21.15.194:3300/0 conn(0x7f20180cc900 0x7f2018099b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.974+0000 7f201f800640 1 --2- 172.21.15.173:0/595028011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20180cf9c0 0x7f20180cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.974+0000 7f201f800640 1 --2- 172.21.15.173:0/595028011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f201815bbb0 0x7f20180cf480 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.974+0000 7f201f800640 1 -- 172.21.15.173:0/595028011 >> 172.21.15.173:0/595028011 conn(0x7f20180b33a0 msgr2=0x7f20180b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.974+0000 7f201f800640 1 -- 172.21.15.173:0/595028011 shutdown_connections 2024-04-25T09:11:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.974+0000 7f201f800640 1 -- 172.21.15.173:0/595028011 wait complete. 2024-04-25T09:11:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201f800640 1 Processor -- start 2024-04-25T09:11:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201f800640 1 -- start start 2024-04-25T09:11:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201f800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20180cc900 0x7f201806d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201f800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20180cf9c0 0x7f201815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201f800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f201815bbb0 0x7f20181533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201f800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20180c5d30 con 0x7f20180cc900 2024-04-25T09:11:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201f800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20180d0740 con 0x7f20180cf9c0 2024-04-25T09:11:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201f800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20180c5eb0 con 0x7f201815bbb0 2024-04-25T09:11:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201ce00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20180cc900 0x7f201806d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201ce00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20180cc900 0x7f201806d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40088/0 (socket says 172.21.15.173:40088) 2024-04-25T09:11:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201ce00640 1 -- 172.21.15.173:0/2457980826 learned_addr learned my addr 172.21.15.173:0/2457980826 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:11:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f200fe00640 1 --2- 172.21.15.173:0/2457980826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20180cf9c0 0x7f201815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201d800640 1 --2- 172.21.15.173:0/2457980826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f201815bbb0 0x7f20181533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201ce00640 1 -- 172.21.15.173:0/2457980826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f201815bbb0 msgr2=0x7f20181533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201ce00640 1 --2- 172.21.15.173:0/2457980826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f201815bbb0 0x7f20181533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201ce00640 1 -- 172.21.15.173:0/2457980826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20180cf9c0 msgr2=0x7f201815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201ce00640 1 --2- 172.21.15.173:0/2457980826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20180cf9c0 0x7f201815a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201ce00640 1 -- 172.21.15.173:0/2457980826 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2018153900 con 0x7f20180cc900 2024-04-25T09:11:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201ce00640 1 --2- 172.21.15.173:0/2457980826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20180cc900 0x7f201806d8d0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f200801ca40 tx=0x7f200801a9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f2015600640 1 -- 172.21.15.173:0/2457980826 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20080ba020 con 0x7f20180cc900 2024-04-25T09:11:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f2015600640 1 -- 172.21.15.173:0/2457980826 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20080b6420 con 0x7f20180cc900 2024-04-25T09:11:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f2015600640 1 -- 172.21.15.173:0/2457980826 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20080b0040 con 0x7f20180cc900 2024-04-25T09:11:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201f800640 1 -- 172.21.15.173:0/2457980826 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2018158e00 con 0x7f20180cc900 2024-04-25T09:11:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.978+0000 7f201f800640 1 -- 172.21.15.173:0/2457980826 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2018153d10 con 0x7f20180cc900 2024-04-25T09:11:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.982+0000 7f201f800640 1 -- 172.21.15.173:0/2457980826 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2018073a40 con 0x7f20180cc900 2024-04-25T09:11:59.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.982+0000 7f2015600640 1 -- 172.21.15.173:0/2457980826 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f20080bd020 con 0x7f20180cc900 2024-04-25T09:11:59.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.982+0000 7f2015600640 1 --2- 172.21.15.173:0/2457980826 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1ff4066f90 0x7f1ff4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:59.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.982+0000 7f2015600640 1 -- 172.21.15.173:0/2457980826 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f200811f300 con 0x7f20180cc900 2024-04-25T09:11:59.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.982+0000 7f200fe00640 1 --2- 172.21.15.173:0/2457980826 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1ff4066f90 0x7f1ff4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:59.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.982+0000 7f200fe00640 1 --2- 172.21.15.173:0/2457980826 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1ff4066f90 0x7f1ff4069450 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f201806d670 tx=0x7f2000008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:59.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:11:59.986+0000 7f2015600640 1 -- 172.21.15.173:0/2457980826 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f20080c4030 con 0x7f20180cc900 2024-04-25T09:12:00.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:00.198+0000 7f201f800640 1 -- 172.21.15.173:0/2457980826 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f201815e2c0 con 0x7f20180cc900 2024-04-25T09:12:00.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:00.198+0000 7f2015600640 1 -- 172.21.15.173:0/2457980826 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1186 (secure 0 0 0) 0x7f2008016110 con 0x7f20180cc900 2024-04-25T09:12:00.183 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:00.183 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":574,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":122,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":841,"data_bytes":858834763,"bytes_used":2107244544,"bytes_avail":770986868736,"bytes_total":773094113280,"write_bytes_sec":45092564,"read_op_per_sec":0,"write_op_per_sec":45},"fsmap":{"epoch":81,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8775}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-04-25T09:11:20.839953+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:12:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:00.198+0000 7f201f800640 1 -- 172.21.15.173:0/2457980826 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1ff4066f90 msgr2=0x7f1ff4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:00.198+0000 7f201f800640 1 --2- 172.21.15.173:0/2457980826 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1ff4066f90 0x7f1ff4069450 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f201806d670 tx=0x7f2000008040 comp rx=0 tx=0).stop 2024-04-25T09:12:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:00.198+0000 7f201f800640 1 -- 172.21.15.173:0/2457980826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20180cc900 msgr2=0x7f201806d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:00.198+0000 7f201f800640 1 --2- 172.21.15.173:0/2457980826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20180cc900 0x7f201806d8d0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f200801ca40 tx=0x7f200801a9e0 comp rx=0 tx=0).stop 2024-04-25T09:12:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:00.198+0000 7f201f800640 1 -- 172.21.15.173:0/2457980826 shutdown_connections 2024-04-25T09:12:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:00.198+0000 7f201f800640 1 --2- 172.21.15.173:0/2457980826 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1ff4066f90 0x7f1ff4069450 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:00.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:00.198+0000 7f201f800640 1 --2- 172.21.15.173:0/2457980826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f201815bbb0 0x7f20181533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:00.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:00.198+0000 7f201f800640 1 --2- 172.21.15.173:0/2457980826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20180cf9c0 0x7f201815a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:00.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:00.198+0000 7f201f800640 1 --2- 172.21.15.173:0/2457980826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20180cc900 0x7f201806d8d0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:00.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:00.198+0000 7f201f800640 1 -- 172.21.15.173:0/2457980826 >> 172.21.15.173:0/2457980826 conn(0x7f20180b33a0 msgr2=0x7f20180ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:00.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:00.202+0000 7f201f800640 1 -- 172.21.15.173:0/2457980826 shutdown_connections 2024-04-25T09:12:00.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:00.202+0000 7f201f800640 1 -- 172.21.15.173:0/2457980826 wait complete. 2024-04-25T09:12:00.204 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:12:01.205 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:01.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.362+0000 7fc2a1600640 1 Processor -- start 2024-04-25T09:12:01.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.366+0000 7fc2a1600640 1 -- start start 2024-04-25T09:12:01.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.366+0000 7fc2a1600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29c15dbb0 0x7fc29c15df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.366+0000 7fc2a1600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc29c06f830 0x7fc29c06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.366+0000 7fc2a1600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29c06d870 con 0x7fc29c0d2130 2024-04-25T09:12:01.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.366+0000 7fc2a1600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c0d2590 con 0x7fc29c06f830 2024-04-25T09:12:01.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.366+0000 7fc2a1600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c15e5c0 con 0x7fc29c15dbb0 2024-04-25T09:12:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.366+0000 7fc29b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc29c06f830 0x7fc29c06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.366+0000 7fc29aa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29c15dbb0 0x7fc29c15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.366+0000 7fc29b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc29c06f830 0x7fc29c06fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:57510/0 (socket says 172.21.15.173:57510) 2024-04-25T09:12:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.366+0000 7fc29a000640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fc29c0d2130 0x7fc29c06c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:58430/0 (socket says 172.21.15.173:58430) 2024-04-25T09:12:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.366+0000 7fc29b400640 1 -- 172.21.15.173:0/1900644338 learned_addr learned my addr 172.21.15.173:0/1900644338 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.366+0000 7fc29b400640 1 -- 172.21.15.173:0/1900644338 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29c15dbb0 msgr2=0x7fc29c15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.366+0000 7fc29b400640 1 --2- 172.21.15.173:0/1900644338 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29c15dbb0 0x7fc29c15df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.366+0000 7fc29b400640 1 -- 172.21.15.173:0/1900644338 >> v1:172.21.15.194:6789/0 conn(0x7fc29c0d2130 legacy=0x7fc29c06c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.366+0000 7fc29b400640 1 -- 172.21.15.173:0/1900644338 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c161690 con 0x7fc29c06f830 2024-04-25T09:12:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.366+0000 7fc299600640 1 -- 172.21.15.173:0/1900644338 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291456615 0 0) 0x7fc29c06d870 con 0x7fc29c0d2130 2024-04-25T09:12:01.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.370+0000 7fc29b400640 1 --2- 172.21.15.173:0/1900644338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29c06f830 0x7fc29c06fcc0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc294009870 tx=0x7fc29401c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9abc6dc4a6a5f436 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:01.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.370+0000 7fc299600640 1 -- 172.21.15.173:0/1900644338 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2940ab650 con 0x7fc29c06f830 2024-04-25T09:12:01.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.370+0000 7fc299600640 1 -- 172.21.15.173:0/1900644338 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2940b0070 con 0x7fc29c06f830 2024-04-25T09:12:01.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.370+0000 7fc299600640 1 -- 172.21.15.173:0/1900644338 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2940aba10 con 0x7fc29c06f830 2024-04-25T09:12:01.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.370+0000 7fc2a1600640 1 -- 172.21.15.173:0/1900644338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29c06f830 msgr2=0x7fc29c06fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.370+0000 7fc2a1600640 1 --2- 172.21.15.173:0/1900644338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29c06f830 0x7fc29c06fcc0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc294009870 tx=0x7fc29401c560 comp rx=0 tx=0).stop 2024-04-25T09:12:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.370+0000 7fc2a1600640 1 -- 172.21.15.173:0/1900644338 shutdown_connections 2024-04-25T09:12:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.370+0000 7fc2a1600640 1 --2- 172.21.15.173:0/1900644338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29c06f830 0x7fc29c06fcc0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.370+0000 7fc2a1600640 1 --2- 172.21.15.173:0/1900644338 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29c15dbb0 0x7fc29c15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.370+0000 7fc2a1600640 1 -- 172.21.15.173:0/1900644338 >> 172.21.15.173:0/1900644338 conn(0x7fc29c061880 msgr2=0x7fc29c061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.370+0000 7fc2a1600640 1 -- 172.21.15.173:0/1900644338 shutdown_connections 2024-04-25T09:12:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.370+0000 7fc2a1600640 1 -- 172.21.15.173:0/1900644338 wait complete. 2024-04-25T09:12:01.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc2a1600640 1 Processor -- start 2024-04-25T09:12:01.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc2a1600640 1 -- start start 2024-04-25T09:12:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc2a1600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc29c06f830 0x7fc29c0b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc2a1600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29c0d2130 0x7fc29c0c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc2a1600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29c15dbb0 0x7fc29c0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc2a1600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c16a990 con 0x7fc29c06f830 2024-04-25T09:12:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc2a1600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c15ee60 con 0x7fc29c0d2130 2024-04-25T09:12:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc2a1600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c16ab10 con 0x7fc29c15dbb0 2024-04-25T09:12:01.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc29aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc29c06f830 0x7fc29c0b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc29aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc29c06f830 0x7fc29c0b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40100/0 (socket says 172.21.15.173:40100) 2024-04-25T09:12:01.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc29aa00640 1 -- 172.21.15.173:0/3895924301 learned_addr learned my addr 172.21.15.173:0/3895924301 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:01.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc29a000640 1 --2- 172.21.15.173:0/3895924301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29c0d2130 0x7fc29c0c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc29b400640 1 --2- 172.21.15.173:0/3895924301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29c15dbb0 0x7fc29c0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc29aa00640 1 -- 172.21.15.173:0/3895924301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29c15dbb0 msgr2=0x7fc29c0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc29aa00640 1 --2- 172.21.15.173:0/3895924301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29c15dbb0 0x7fc29c0cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc29aa00640 1 -- 172.21.15.173:0/3895924301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29c0d2130 msgr2=0x7fc29c0c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc29aa00640 1 --2- 172.21.15.173:0/3895924301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29c0d2130 0x7fc29c0c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc29aa00640 1 -- 172.21.15.173:0/3895924301 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c0cb640 con 0x7fc29c06f830 2024-04-25T09:12:01.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc29aa00640 1 --2- 172.21.15.173:0/3895924301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc29c06f830 0x7fc29c0b28f0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fc28c00efc0 tx=0x7fc28c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:01.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc292a00640 1 -- 172.21.15.173:0/3895924301 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c018020 con 0x7fc29c06f830 2024-04-25T09:12:01.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc292a00640 1 -- 172.21.15.173:0/3895924301 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c014480 con 0x7fc29c06f830 2024-04-25T09:12:01.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc292a00640 1 -- 172.21.15.173:0/3895924301 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c014850 con 0x7fc29c06f830 2024-04-25T09:12:01.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc2a1600640 1 -- 172.21.15.173:0/3895924301 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29c0cada0 con 0x7fc29c06f830 2024-04-25T09:12:01.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc2a1600640 1 -- 172.21.15.173:0/3895924301 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c0cb360 con 0x7fc29c06f830 2024-04-25T09:12:01.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.374+0000 7fc2a1600640 1 -- 172.21.15.173:0/3895924301 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29c073a40 con 0x7fc29c06f830 2024-04-25T09:12:01.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.378+0000 7fc292a00640 1 -- 172.21.15.173:0/3895924301 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc28c01b020 con 0x7fc29c06f830 2024-04-25T09:12:01.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.378+0000 7fc292a00640 1 --2- 172.21.15.173:0/3895924301 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc27c066f90 0x7fc27c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.378+0000 7fc292a00640 1 -- 172.21.15.173:0/3895924301 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc28c085d60 con 0x7fc29c06f830 2024-04-25T09:12:01.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.378+0000 7fc29a000640 1 --2- 172.21.15.173:0/3895924301 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc27c066f90 0x7fc27c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.378+0000 7fc29a000640 1 --2- 172.21.15.173:0/3895924301 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc27c066f90 0x7fc27c069450 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0b1110 tx=0x7fc288007c10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:01.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.382+0000 7fc292a00640 1 -- 172.21.15.173:0/3895924301 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc28c022070 con 0x7fc29c06f830 2024-04-25T09:12:01.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.566+0000 7fc2a1600640 1 -- 172.21.15.173:0/3895924301 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc29c06c5d0 con 0x7fc29c06f830 2024-04-25T09:12:01.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.566+0000 7fc292a00640 1 -- 172.21.15.173:0/3895924301 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fc28c010040 con 0x7fc29c06f830 2024-04-25T09:12:01.550 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:01.551 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1021410995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1021410995},{"type":"v1","addr":"172.21.15.194:6834","nonce":1021410995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2198134208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2198134208},{"type":"v1","addr":"172.21.15.194:6835","nonce":2198134208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8772,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/684989574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":684989574},{"type":"v1","addr":"172.21.15.173:6836","nonce":684989574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:26.148874+0000","modified":"2024-04-25T09:11:29.164422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8775":{"gid":8775,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/671971539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":671971539},{"type":"v1","addr":"172.21.15.173:6837","nonce":671971539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:12:01.551 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 81 2024-04-25T09:12:01.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.566+0000 7fc2a1600640 1 -- 172.21.15.173:0/3895924301 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc27c066f90 msgr2=0x7fc27c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.566+0000 7fc2a1600640 1 --2- 172.21.15.173:0/3895924301 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc27c066f90 0x7fc27c069450 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0b1110 tx=0x7fc288007c10 comp rx=0 tx=0).stop 2024-04-25T09:12:01.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.566+0000 7fc2a1600640 1 -- 172.21.15.173:0/3895924301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc29c06f830 msgr2=0x7fc29c0b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.566+0000 7fc2a1600640 1 --2- 172.21.15.173:0/3895924301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc29c06f830 0x7fc29c0b28f0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fc28c00efc0 tx=0x7fc28c00c490 comp rx=0 tx=0).stop 2024-04-25T09:12:01.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.566+0000 7fc2a1600640 1 -- 172.21.15.173:0/3895924301 shutdown_connections 2024-04-25T09:12:01.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.566+0000 7fc2a1600640 1 --2- 172.21.15.173:0/3895924301 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc27c066f90 0x7fc27c069450 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.566+0000 7fc2a1600640 1 --2- 172.21.15.173:0/3895924301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29c15dbb0 0x7fc29c0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.566+0000 7fc2a1600640 1 --2- 172.21.15.173:0/3895924301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29c0d2130 0x7fc29c0c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.566+0000 7fc2a1600640 1 --2- 172.21.15.173:0/3895924301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc29c06f830 0x7fc29c0b28f0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.566+0000 7fc2a1600640 1 -- 172.21.15.173:0/3895924301 >> 172.21.15.173:0/3895924301 conn(0x7fc29c061880 msgr2=0x7fc29c06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:01.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.566+0000 7fc2a1600640 1 -- 172.21.15.173:0/3895924301 shutdown_connections 2024-04-25T09:12:01.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.566+0000 7fc2a1600640 1 -- 172.21.15.173:0/3895924301 wait complete. 2024-04-25T09:12:01.571 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:12:01.571 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:12:01.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.722+0000 7ff81e200640 1 Processor -- start 2024-04-25T09:12:01.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.722+0000 7ff81e200640 1 -- start start 2024-04-25T09:12:01.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.722+0000 7ff81e200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff8180b3e70 0x7ff8180b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.722+0000 7ff81e200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff8180aefa0 0x7ff8180b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.722+0000 7ff81e200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8180b4790 con 0x7ff81815edd0 2024-04-25T09:12:01.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.722+0000 7ff81e200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81806dd50 con 0x7ff8180b3e70 2024-04-25T09:12:01.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.722+0000 7ff81e200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81815f320 con 0x7ff8180aefa0 2024-04-25T09:12:01.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.722+0000 7ff817400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff8180b3e70 0x7ff8180b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.722+0000 7ff817400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff8180b3e70 0x7ff8180b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40106/0 (socket says 172.21.15.173:40106) 2024-04-25T09:12:01.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.722+0000 7ff817400640 1 -- 172.21.15.173:0/2743715131 learned_addr learned my addr 172.21.15.173:0/2743715131 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:01.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.722+0000 7ff816a00640 1 --2- 172.21.15.173:0/2743715131 >> v2:172.21.15.194:3300/0 conn(0x7ff8180aefa0 0x7ff8180b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.722+0000 7ff817400640 1 -- 172.21.15.173:0/2743715131 >> v2:172.21.15.194:3300/0 conn(0x7ff8180aefa0 msgr2=0x7ff8180b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:01.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.722+0000 7ff817400640 1 --2- 172.21.15.173:0/2743715131 >> v2:172.21.15.194:3300/0 conn(0x7ff8180aefa0 0x7ff8180b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.722+0000 7ff817400640 1 -- 172.21.15.173:0/2743715131 >> v1:172.21.15.194:6789/0 conn(0x7ff81815edd0 legacy=0x7ff8180b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.722+0000 7ff817400640 1 -- 172.21.15.173:0/2743715131 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81806d420 con 0x7ff8180b3e70 2024-04-25T09:12:01.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.726+0000 7ff817400640 1 --2- 172.21.15.173:0/2743715131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8180b3e70 0x7ff8180b4250 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7ff8180d0650 tx=0x7ff80801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8875702f0a5cd21a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:01.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.726+0000 7ff816000640 1 -- 172.21.15.173:0/2743715131 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8080aa670 con 0x7ff8180b3e70 2024-04-25T09:12:01.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.726+0000 7ff816000640 1 -- 172.21.15.173:0/2743715131 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8080af070 con 0x7ff8180b3e70 2024-04-25T09:12:01.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.726+0000 7ff816000640 1 -- 172.21.15.173:0/2743715131 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8080aaa30 con 0x7ff8180b3e70 2024-04-25T09:12:01.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.726+0000 7ff81e200640 1 -- 172.21.15.173:0/2743715131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8180b3e70 msgr2=0x7ff8180b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.726+0000 7ff81e200640 1 --2- 172.21.15.173:0/2743715131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8180b3e70 0x7ff8180b4250 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7ff8180d0650 tx=0x7ff80801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.726+0000 7ff81e200640 1 -- 172.21.15.173:0/2743715131 shutdown_connections 2024-04-25T09:12:01.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.726+0000 7ff81e200640 1 --2- 172.21.15.173:0/2743715131 >> v2:172.21.15.194:3300/0 conn(0x7ff8180aefa0 0x7ff8180b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.726+0000 7ff81e200640 1 --2- 172.21.15.173:0/2743715131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8180b3e70 0x7ff8180b4250 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.726+0000 7ff81e200640 1 -- 172.21.15.173:0/2743715131 >> 172.21.15.173:0/2743715131 conn(0x7ff81806ac90 msgr2=0x7ff81806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:01.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.726+0000 7ff81e200640 1 -- 172.21.15.173:0/2743715131 shutdown_connections 2024-04-25T09:12:01.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.726+0000 7ff81e200640 1 -- 172.21.15.173:0/2743715131 wait complete. 2024-04-25T09:12:01.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.726+0000 7ff81e200640 1 Processor -- start 2024-04-25T09:12:01.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff81e200640 1 -- start start 2024-04-25T09:12:01.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff81e200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8180aefa0 0x7ff81815f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff81e200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8180b3e70 0x7ff818153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff81e200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff81815edd0 0x7ff818155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff81e200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81806e1e0 con 0x7ff8180b3e70 2024-04-25T09:12:01.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff81e200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81815aba0 con 0x7ff81815edd0 2024-04-25T09:12:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff81e200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81806e360 con 0x7ff8180aefa0 2024-04-25T09:12:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff816a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8180b3e70 0x7ff818153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff816a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8180b3e70 0x7ff818153e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40116/0 (socket says 172.21.15.173:40116) 2024-04-25T09:12:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff816a00640 1 -- 172.21.15.173:0/701583069 learned_addr learned my addr 172.21.15.173:0/701583069 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff817400640 1 --2- 172.21.15.173:0/701583069 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8180aefa0 0x7ff81815f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff817e00640 1 --2- 172.21.15.173:0/701583069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff81815edd0 0x7ff818155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff816a00640 1 -- 172.21.15.173:0/701583069 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8180aefa0 msgr2=0x7ff81815f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff816a00640 1 --2- 172.21.15.173:0/701583069 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8180aefa0 0x7ff81815f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff816a00640 1 -- 172.21.15.173:0/701583069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff81815edd0 msgr2=0x7ff818155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff816a00640 1 --2- 172.21.15.173:0/701583069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff81815edd0 0x7ff818155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff816a00640 1 -- 172.21.15.173:0/701583069 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8181566b0 con 0x7ff8180b3e70 2024-04-25T09:12:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff816a00640 1 --2- 172.21.15.173:0/701583069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8180b3e70 0x7ff818153e60 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7ff80400e8a0 tx=0x7ff80400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff80f400640 1 -- 172.21.15.173:0/701583069 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804017070 con 0x7ff8180b3e70 2024-04-25T09:12:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff80f400640 1 -- 172.21.15.173:0/701583069 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80400c940 con 0x7ff8180b3e70 2024-04-25T09:12:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff81e200640 1 -- 172.21.15.173:0/701583069 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff818155d90 con 0x7ff8180b3e70 2024-04-25T09:12:01.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff80f400640 1 -- 172.21.15.173:0/701583069 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80400ccf0 con 0x7ff8180b3e70 2024-04-25T09:12:01.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff81e200640 1 -- 172.21.15.173:0/701583069 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff818156c30 con 0x7ff8180b3e70 2024-04-25T09:12:01.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.730+0000 7ff81e200640 1 -- 172.21.15.173:0/701583069 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff818073a40 con 0x7ff8180b3e70 2024-04-25T09:12:01.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.734+0000 7ff80f400640 1 -- 172.21.15.173:0/701583069 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff80401a070 con 0x7ff8180b3e70 2024-04-25T09:12:01.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.734+0000 7ff80f400640 1 --2- 172.21.15.173:0/701583069 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff7f8066f60 0x7ff7f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.734+0000 7ff80f400640 1 -- 172.21.15.173:0/701583069 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff804085160 con 0x7ff8180b3e70 2024-04-25T09:12:01.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.734+0000 7ff817400640 1 --2- 172.21.15.173:0/701583069 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff7f8066f60 0x7ff7f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.734+0000 7ff817400640 1 --2- 172.21.15.173:0/701583069 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff7f8066f60 0x7ff7f8069420 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff8080ae000 tx=0x7ff8080a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:01.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.738+0000 7ff80f400640 1 -- 172.21.15.173:0/701583069 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff804055f40 con 0x7ff8180b3e70 2024-04-25T09:12:01.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.950+0000 7ff81e200640 1 -- 172.21.15.173:0/701583069 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff81806e540 con 0x7ff8180b3e70 2024-04-25T09:12:01.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.950+0000 7ff80f400640 1 -- 172.21.15.173:0/701583069 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1188 (secure 0 0 0) 0x7ff804055840 con 0x7ff8180b3e70 2024-04-25T09:12:01.935 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:01.936 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":576,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":122,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1028,"data_bytes":1055489538,"bytes_used":2524741632,"bytes_avail":770569371648,"bytes_total":773094113280,"write_bytes_sec":59295303,"read_op_per_sec":0,"write_op_per_sec":59},"fsmap":{"epoch":81,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8775}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-04-25T09:11:20.839953+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:12:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.954+0000 7ff81e200640 1 -- 172.21.15.173:0/701583069 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff7f8066f60 msgr2=0x7ff7f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.954+0000 7ff81e200640 1 --2- 172.21.15.173:0/701583069 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff7f8066f60 0x7ff7f8069420 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff8080ae000 tx=0x7ff8080a7000 comp rx=0 tx=0).stop 2024-04-25T09:12:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.954+0000 7ff81e200640 1 -- 172.21.15.173:0/701583069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8180b3e70 msgr2=0x7ff818153e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.954+0000 7ff81e200640 1 --2- 172.21.15.173:0/701583069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8180b3e70 0x7ff818153e60 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7ff80400e8a0 tx=0x7ff80400eca0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.954+0000 7ff81e200640 1 -- 172.21.15.173:0/701583069 shutdown_connections 2024-04-25T09:12:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.954+0000 7ff81e200640 1 --2- 172.21.15.173:0/701583069 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff7f8066f60 0x7ff7f8069420 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.954+0000 7ff81e200640 1 --2- 172.21.15.173:0/701583069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff81815edd0 0x7ff818155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.954+0000 7ff81e200640 1 --2- 172.21.15.173:0/701583069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8180b3e70 0x7ff818153e60 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.954+0000 7ff81e200640 1 --2- 172.21.15.173:0/701583069 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8180aefa0 0x7ff81815f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.954+0000 7ff81e200640 1 -- 172.21.15.173:0/701583069 >> 172.21.15.173:0/701583069 conn(0x7ff81806ac90 msgr2=0x7ff8180acfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.954+0000 7ff81e200640 1 -- 172.21.15.173:0/701583069 shutdown_connections 2024-04-25T09:12:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:01.954+0000 7ff81e200640 1 -- 172.21.15.173:0/701583069 wait complete. 2024-04-25T09:12:01.956 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:12:02.957 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:03.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.110+0000 7f3997e00640 1 Processor -- start 2024-04-25T09:12:03.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.110+0000 7f3997e00640 1 -- start start 2024-04-25T09:12:03.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.114+0000 7f3997e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39980cef40 0x7f39980cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.114+0000 7f3997e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399815ac90 con 0x7f39980b2c80 2024-04-25T09:12:03.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.114+0000 7f3997e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399815af70 con 0x7f399806e920 2024-04-25T09:12:03.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.114+0000 7f3997e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399815b8a0 con 0x7f39980cef40 2024-04-25T09:12:03.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.114+0000 7f398e000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f39980b2c80 0x7f399806e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36610/0 (socket says 172.21.15.173:36610) 2024-04-25T09:12:03.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.114+0000 7f398e000640 1 -- 172.21.15.173:0/3224654247 learned_addr learned my addr 172.21.15.173:0/3224654247 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:03.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.114+0000 7f3996a00640 1 --2- 172.21.15.173:0/3224654247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39980cef40 0x7f39980cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.114+0000 7f3996000640 1 -- 172.21.15.173:0/3224654247 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641008240 0 0) 0x7f399815ac90 con 0x7f39980b2c80 2024-04-25T09:12:03.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.114+0000 7f3996000640 1 -- 172.21.15.173:0/3224654247 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f397c003530 con 0x7f39980b2c80 2024-04-25T09:12:03.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.114+0000 7f3996000640 1 -- 172.21.15.173:0/3224654247 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053904828 0 0) 0x7f399815af70 con 0x7f399806e920 2024-04-25T09:12:03.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.114+0000 7f3996000640 1 -- 172.21.15.173:0/3224654247 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f399815ac90 con 0x7f399806e920 2024-04-25T09:12:03.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.114+0000 7f3996a00640 1 -- 172.21.15.173:0/3224654247 >> v1:172.21.15.194:6789/0 conn(0x7f399806e920 legacy=0x7f39980711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.114+0000 7f3996a00640 1 -- 172.21.15.173:0/3224654247 >> v1:172.21.15.173:6789/0 conn(0x7f39980b2c80 legacy=0x7f399806e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.114+0000 7f3996a00640 1 -- 172.21.15.173:0/3224654247 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399815b250 con 0x7f39980cef40 2024-04-25T09:12:03.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.118+0000 7f3996a00640 1 --2- 172.21.15.173:0/3224654247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39980cef40 0x7f39980cc6d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f39880097f0 tx=0x7f398801cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66396820ece2ada4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.118+0000 7f3996000640 1 -- 172.21.15.173:0/3224654247 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39880aa430 con 0x7f39980cef40 2024-04-25T09:12:03.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.118+0000 7f3996000640 1 -- 172.21.15.173:0/3224654247 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39880af070 con 0x7f39980cef40 2024-04-25T09:12:03.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.118+0000 7f3996000640 1 -- 172.21.15.173:0/3224654247 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39880aa7f0 con 0x7f39980cef40 2024-04-25T09:12:03.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.118+0000 7f3997e00640 1 -- 172.21.15.173:0/3224654247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39980cef40 msgr2=0x7f39980cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.118+0000 7f3997e00640 1 --2- 172.21.15.173:0/3224654247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39980cef40 0x7f39980cc6d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f39880097f0 tx=0x7f398801cf10 comp rx=0 tx=0).stop 2024-04-25T09:12:03.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.118+0000 7f3997e00640 1 -- 172.21.15.173:0/3224654247 shutdown_connections 2024-04-25T09:12:03.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.118+0000 7f3997e00640 1 --2- 172.21.15.173:0/3224654247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39980cef40 0x7f39980cc6d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.118+0000 7f3997e00640 1 -- 172.21.15.173:0/3224654247 >> 172.21.15.173:0/3224654247 conn(0x7f399806ac90 msgr2=0x7f399806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:03.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.118+0000 7f3997e00640 1 -- 172.21.15.173:0/3224654247 shutdown_connections 2024-04-25T09:12:03.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.118+0000 7f3997e00640 1 -- 172.21.15.173:0/3224654247 wait complete. 2024-04-25T09:12:03.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.118+0000 7f3997e00640 1 Processor -- start 2024-04-25T09:12:03.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.118+0000 7f3997e00640 1 -- start start 2024-04-25T09:12:03.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3997e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f399806e920 0x7f3998150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3997e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39980b2c80 0x7f3998154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3997e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39980cef40 0x7f399814eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3997e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399806d490 con 0x7f399806e920 2024-04-25T09:12:03.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3997e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399806d310 con 0x7f39980cef40 2024-04-25T09:12:03.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3997e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399806d610 con 0x7f39980b2c80 2024-04-25T09:12:03.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3996a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f399806e920 0x7f3998150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3996a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f399806e920 0x7f3998150500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40122/0 (socket says 172.21.15.173:40122) 2024-04-25T09:12:03.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3996a00640 1 -- 172.21.15.173:0/1633819771 learned_addr learned my addr 172.21.15.173:0/1633819771 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:03.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3997400640 1 --2- 172.21.15.173:0/1633819771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39980cef40 0x7f399814eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f398e000640 1 --2- 172.21.15.173:0/1633819771 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39980b2c80 0x7f3998154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3996a00640 1 -- 172.21.15.173:0/1633819771 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39980b2c80 msgr2=0x7f3998154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3996a00640 1 --2- 172.21.15.173:0/1633819771 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39980b2c80 0x7f3998154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3996a00640 1 -- 172.21.15.173:0/1633819771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39980cef40 msgr2=0x7f399814eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3996a00640 1 --2- 172.21.15.173:0/1633819771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39980cef40 0x7f399814eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3996a00640 1 -- 172.21.15.173:0/1633819771 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399814f460 con 0x7f399806e920 2024-04-25T09:12:03.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3996a00640 1 --2- 172.21.15.173:0/1633819771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f399806e920 0x7f3998150500 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f39880190c0 tx=0x7f398801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f398f400640 1 -- 172.21.15.173:0/1633819771 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39880be610 con 0x7f399806e920 2024-04-25T09:12:03.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f398f400640 1 -- 172.21.15.173:0/1633819771 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39880be7d0 con 0x7f399806e920 2024-04-25T09:12:03.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f398f400640 1 -- 172.21.15.173:0/1633819771 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39880bebc0 con 0x7f399806e920 2024-04-25T09:12:03.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3997e00640 1 -- 172.21.15.173:0/1633819771 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399814f740 con 0x7f399806e920 2024-04-25T09:12:03.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3997e00640 1 -- 172.21.15.173:0/1633819771 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399814fd00 con 0x7f399806e920 2024-04-25T09:12:03.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f3997e00640 1 -- 172.21.15.173:0/1633819771 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3998073a40 con 0x7f399806e920 2024-04-25T09:12:03.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.122+0000 7f398f400640 1 -- 172.21.15.173:0/1633819771 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f39880bc020 con 0x7f399806e920 2024-04-25T09:12:03.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.126+0000 7f398f400640 1 --2- 172.21.15.173:0/1633819771 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3974066f60 0x7f3974069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.126+0000 7f398f400640 1 -- 172.21.15.173:0/1633819771 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f398811f600 con 0x7f399806e920 2024-04-25T09:12:03.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.126+0000 7f398e000640 1 --2- 172.21.15.173:0/1633819771 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3974066f60 0x7f3974069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.126+0000 7f398e000640 1 --2- 172.21.15.173:0/1633819771 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3974066f60 0x7f3974069420 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3998149620 tx=0x7f3980007d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.130+0000 7f398f400640 1 -- 172.21.15.173:0/1633819771 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f39880160d0 con 0x7f399806e920 2024-04-25T09:12:03.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.318+0000 7f3997e00640 1 -- 172.21.15.173:0/1633819771 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39980b27a0 con 0x7f399806e920 2024-04-25T09:12:03.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.318+0000 7f398f400640 1 -- 172.21.15.173:0/1633819771 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f39880efe20 con 0x7f399806e920 2024-04-25T09:12:03.305 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:03.305 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1021410995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1021410995},{"type":"v1","addr":"172.21.15.194:6834","nonce":1021410995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2198134208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2198134208},{"type":"v1","addr":"172.21.15.194:6835","nonce":2198134208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8772,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/684989574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":684989574},{"type":"v1","addr":"172.21.15.173:6836","nonce":684989574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:26.148874+0000","modified":"2024-04-25T09:11:29.164422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8775":{"gid":8775,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/671971539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":671971539},{"type":"v1","addr":"172.21.15.173:6837","nonce":671971539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:12:03.305 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 81 2024-04-25T09:12:03.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.322+0000 7f3997e00640 1 -- 172.21.15.173:0/1633819771 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3974066f60 msgr2=0x7f3974069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.322+0000 7f3997e00640 1 --2- 172.21.15.173:0/1633819771 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3974066f60 0x7f3974069420 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3998149620 tx=0x7f3980007d80 comp rx=0 tx=0).stop 2024-04-25T09:12:03.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.322+0000 7f3997e00640 1 -- 172.21.15.173:0/1633819771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f399806e920 msgr2=0x7f3998150500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.322+0000 7f3997e00640 1 --2- 172.21.15.173:0/1633819771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f399806e920 0x7f3998150500 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f39880190c0 tx=0x7f398801acf0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.322+0000 7f3997e00640 1 -- 172.21.15.173:0/1633819771 shutdown_connections 2024-04-25T09:12:03.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.322+0000 7f3997e00640 1 --2- 172.21.15.173:0/1633819771 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3974066f60 0x7f3974069420 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.322+0000 7f3997e00640 1 --2- 172.21.15.173:0/1633819771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39980cef40 0x7f399814eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.322+0000 7f3997e00640 1 --2- 172.21.15.173:0/1633819771 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39980b2c80 0x7f3998154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.322+0000 7f3997e00640 1 --2- 172.21.15.173:0/1633819771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f399806e920 0x7f3998150500 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.322+0000 7f3997e00640 1 -- 172.21.15.173:0/1633819771 >> 172.21.15.173:0/1633819771 conn(0x7f399806ac90 msgr2=0x7f3998159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:03.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.322+0000 7f3997e00640 1 -- 172.21.15.173:0/1633819771 shutdown_connections 2024-04-25T09:12:03.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.322+0000 7f3997e00640 1 -- 172.21.15.173:0/1633819771 wait complete. 2024-04-25T09:12:03.325 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:12:03.325 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:12:03.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.474+0000 7fd770000640 1 Processor -- start 2024-04-25T09:12:03.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.474+0000 7fd770000640 1 -- start start 2024-04-25T09:12:03.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.474+0000 7fd770000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd7680b3e70 0x7fd7680b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.474+0000 7fd770000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7680aefa0 0x7fd7680b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.474+0000 7fd770000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7680b4790 con 0x7fd76815edd0 2024-04-25T09:12:03.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.474+0000 7fd770000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76806dd50 con 0x7fd7680b3e70 2024-04-25T09:12:03.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.474+0000 7fd770000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76815f320 con 0x7fd7680aefa0 2024-04-25T09:12:03.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.474+0000 7fd76d600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd7680b3e70 0x7fd7680b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.474+0000 7fd76e000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd76815edd0 0x7fd7680b2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38274/0 (socket says 172.21.15.173:38274) 2024-04-25T09:12:03.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.474+0000 7fd76e000640 1 -- 172.21.15.173:0/565074540 learned_addr learned my addr 172.21.15.173:0/565074540 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:03.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.478+0000 7fd76cc00640 1 --2- 172.21.15.173:0/565074540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7680aefa0 0x7fd7680b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.478+0000 7fd76d600640 1 -- 172.21.15.173:0/565074540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7680aefa0 msgr2=0x7fd7680b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:03.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.478+0000 7fd76d600640 1 --2- 172.21.15.173:0/565074540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7680aefa0 0x7fd7680b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.478+0000 7fd76d600640 1 -- 172.21.15.173:0/565074540 >> v1:172.21.15.173:6789/0 conn(0x7fd76815edd0 legacy=0x7fd7680b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.478+0000 7fd76d600640 1 -- 172.21.15.173:0/565074540 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76806d420 con 0x7fd7680b3e70 2024-04-25T09:12:03.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.478+0000 7fd76cc00640 1 --2- 172.21.15.173:0/565074540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7680aefa0 0x7fd7680b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:03.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.478+0000 7fd76d600640 1 --2- 172.21.15.173:0/565074540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7680b3e70 0x7fd7680b4250 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009d90 tx=0x7fd75c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf88d448626b7e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.478+0000 7fd767e00640 1 -- 172.21.15.173:0/565074540 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c0b2070 con 0x7fd7680b3e70 2024-04-25T09:12:03.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.478+0000 7fd767e00640 1 -- 172.21.15.173:0/565074540 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c0a5a20 con 0x7fd7680b3e70 2024-04-25T09:12:03.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.478+0000 7fd767e00640 1 -- 172.21.15.173:0/565074540 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c0a5df0 con 0x7fd7680b3e70 2024-04-25T09:12:03.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.478+0000 7fd770000640 1 -- 172.21.15.173:0/565074540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7680b3e70 msgr2=0x7fd7680b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.478+0000 7fd770000640 1 --2- 172.21.15.173:0/565074540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7680b3e70 0x7fd7680b4250 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009d90 tx=0x7fd75c01c940 comp rx=0 tx=0).stop 2024-04-25T09:12:03.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd770000640 1 -- 172.21.15.173:0/565074540 shutdown_connections 2024-04-25T09:12:03.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd770000640 1 --2- 172.21.15.173:0/565074540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7680aefa0 0x7fd7680b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd770000640 1 --2- 172.21.15.173:0/565074540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7680b3e70 0x7fd7680b4250 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd770000640 1 -- 172.21.15.173:0/565074540 >> 172.21.15.173:0/565074540 conn(0x7fd76806ac90 msgr2=0x7fd76806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:03.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd770000640 1 -- 172.21.15.173:0/565074540 shutdown_connections 2024-04-25T09:12:03.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd770000640 1 -- 172.21.15.173:0/565074540 wait complete. 2024-04-25T09:12:03.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd770000640 1 Processor -- start 2024-04-25T09:12:03.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd770000640 1 -- start start 2024-04-25T09:12:03.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd770000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7680aefa0 0x7fd76815c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd770000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7680b3e70 0x7fd76815af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd770000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd76815edd0 0x7fd768153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd770000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76806e1e0 con 0x7fd7680b3e70 2024-04-25T09:12:03.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd770000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76815aba0 con 0x7fd76815edd0 2024-04-25T09:12:03.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd770000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76806e360 con 0x7fd7680aefa0 2024-04-25T09:12:03.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd76cc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7680b3e70 0x7fd76815af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd76cc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7680b3e70 0x7fd76815af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53134/0 (socket says 172.21.15.173:53134) 2024-04-25T09:12:03.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd76cc00640 1 -- 172.21.15.173:0/2373624133 learned_addr learned my addr 172.21.15.173:0/2373624133 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:03.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd76d600640 1 --2- 172.21.15.173:0/2373624133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7680aefa0 0x7fd76815c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd76e000640 1 --2- 172.21.15.173:0/2373624133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd76815edd0 0x7fd768153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd76cc00640 1 -- 172.21.15.173:0/2373624133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7680aefa0 msgr2=0x7fd76815c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd76cc00640 1 --2- 172.21.15.173:0/2373624133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7680aefa0 0x7fd76815c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd76cc00640 1 -- 172.21.15.173:0/2373624133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd76815edd0 msgr2=0x7fd768153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd76cc00640 1 --2- 172.21.15.173:0/2373624133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd76815edd0 0x7fd768153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd76cc00640 1 -- 172.21.15.173:0/2373624133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7681fa4f0 con 0x7fd7680b3e70 2024-04-25T09:12:03.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd76e000640 1 --2- 172.21.15.173:0/2373624133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd76815edd0 0x7fd768153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:03.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd76cc00640 1 --2- 172.21.15.173:0/2373624133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7680b3e70 0x7fd76815af80 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fd75400c7f0 tx=0x7fd75400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd765600640 1 -- 172.21.15.173:0/2373624133 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754015070 con 0x7fd7680b3e70 2024-04-25T09:12:03.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd765600640 1 -- 172.21.15.173:0/2373624133 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7540077c0 con 0x7fd7680b3e70 2024-04-25T09:12:03.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd765600640 1 -- 172.21.15.173:0/2373624133 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754007bd0 con 0x7fd7680b3e70 2024-04-25T09:12:03.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.482+0000 7fd770000640 1 -- 172.21.15.173:0/2373624133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7681fa7d0 con 0x7fd7680b3e70 2024-04-25T09:12:03.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.486+0000 7fd770000640 1 -- 172.21.15.173:0/2373624133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7681fad90 con 0x7fd7680b3e70 2024-04-25T09:12:03.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.486+0000 7fd770000640 1 -- 172.21.15.173:0/2373624133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd768073a40 con 0x7fd7680b3e70 2024-04-25T09:12:03.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.486+0000 7fd765600640 1 -- 172.21.15.173:0/2373624133 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd754018070 con 0x7fd7680b3e70 2024-04-25T09:12:03.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.486+0000 7fd765600640 1 --2- 172.21.15.173:0/2373624133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd748066f60 0x7fd748069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.486+0000 7fd765600640 1 -- 172.21.15.173:0/2373624133 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd7540852e0 con 0x7fd7680b3e70 2024-04-25T09:12:03.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.486+0000 7fd76d600640 1 --2- 172.21.15.173:0/2373624133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd748066f60 0x7fd748069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.486+0000 7fd76d600640 1 --2- 172.21.15.173:0/2373624133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd748066f60 0x7fd748069420 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0af000 tx=0x7fd75c0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.490+0000 7fd765600640 1 -- 172.21.15.173:0/2373624133 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd7540560c0 con 0x7fd7680b3e70 2024-04-25T09:12:03.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.698+0000 7fd770000640 1 -- 172.21.15.173:0/2373624133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd76806f1c0 con 0x7fd7680b3e70 2024-04-25T09:12:03.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.698+0000 7fd765600640 1 -- 172.21.15.173:0/2373624133 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1188 (secure 0 0 0) 0x7fd7540559c0 con 0x7fd7680b3e70 2024-04-25T09:12:03.683 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:03.683 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":578,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":122,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076461058,"bytes_used":2570878976,"bytes_avail":770523234304,"bytes_total":773094113280,"write_bytes_sec":44741403,"read_op_per_sec":0,"write_op_per_sec":44},"fsmap":{"epoch":81,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8775}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-04-25T09:11:20.839953+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:12:03.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.698+0000 7fd770000640 1 -- 172.21.15.173:0/2373624133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd748066f60 msgr2=0x7fd748069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.698+0000 7fd770000640 1 --2- 172.21.15.173:0/2373624133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd748066f60 0x7fd748069420 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0af000 tx=0x7fd75c0a7070 comp rx=0 tx=0).stop 2024-04-25T09:12:03.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.698+0000 7fd770000640 1 -- 172.21.15.173:0/2373624133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7680b3e70 msgr2=0x7fd76815af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.698+0000 7fd770000640 1 --2- 172.21.15.173:0/2373624133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7680b3e70 0x7fd76815af80 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fd75400c7f0 tx=0x7fd75400ccb0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.698+0000 7fd770000640 1 -- 172.21.15.173:0/2373624133 shutdown_connections 2024-04-25T09:12:03.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.698+0000 7fd770000640 1 --2- 172.21.15.173:0/2373624133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd748066f60 0x7fd748069420 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.698+0000 7fd770000640 1 --2- 172.21.15.173:0/2373624133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd76815edd0 0x7fd768153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.698+0000 7fd770000640 1 --2- 172.21.15.173:0/2373624133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7680b3e70 0x7fd76815af80 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.698+0000 7fd770000640 1 --2- 172.21.15.173:0/2373624133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7680aefa0 0x7fd76815c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.698+0000 7fd770000640 1 -- 172.21.15.173:0/2373624133 >> 172.21.15.173:0/2373624133 conn(0x7fd76806ac90 msgr2=0x7fd768159ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:03.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.698+0000 7fd770000640 1 -- 172.21.15.173:0/2373624133 shutdown_connections 2024-04-25T09:12:03.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:03.698+0000 7fd770000640 1 -- 172.21.15.173:0/2373624133 wait complete. 2024-04-25T09:12:03.704 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:12:04.704 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:04.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.866+0000 7fd15be00640 1 Processor -- start 2024-04-25T09:12:04.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.866+0000 7fd15be00640 1 -- start start 2024-04-25T09:12:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.866+0000 7fd15be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd15c0b2bf0 0x7fd15c099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.866+0000 7fd15be00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15c09a3f0 con 0x7fd15c15ed40 2024-04-25T09:12:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.866+0000 7fd15be00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15c09a6d0 con 0x7fd15c15f370 2024-04-25T09:12:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.866+0000 7fd15be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c09a9b0 con 0x7fd15c0b2bf0 2024-04-25T09:12:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.866+0000 7fd15a000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd15c15ed40 0x7fd15c06c7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38276/0 (socket says 172.21.15.173:38276) 2024-04-25T09:12:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.866+0000 7fd15a000640 1 -- 172.21.15.173:0/2456201030 learned_addr learned my addr 172.21.15.173:0/2456201030 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.866+0000 7fd15aa00640 1 --2- 172.21.15.173:0/2456201030 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd15c0b2bf0 0x7fd15c099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.866+0000 7fd159600640 1 -- 172.21.15.173:0/2456201030 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325710018 0 0) 0x7fd15c09a3f0 con 0x7fd15c15ed40 2024-04-25T09:12:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.866+0000 7fd159600640 1 -- 172.21.15.173:0/2456201030 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd140003530 con 0x7fd15c15ed40 2024-04-25T09:12:04.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.866+0000 7fd159600640 1 -- 172.21.15.173:0/2456201030 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511391852 0 0) 0x7fd15c09a6d0 con 0x7fd15c15f370 2024-04-25T09:12:04.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.866+0000 7fd159600640 1 -- 172.21.15.173:0/2456201030 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd15c09a3f0 con 0x7fd15c15f370 2024-04-25T09:12:04.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.866+0000 7fd15aa00640 1 -- 172.21.15.173:0/2456201030 >> v1:172.21.15.194:6789/0 conn(0x7fd15c15f370 legacy=0x7fd15c15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.866+0000 7fd15aa00640 1 -- 172.21.15.173:0/2456201030 >> v1:172.21.15.173:6789/0 conn(0x7fd15c15ed40 legacy=0x7fd15c06c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.866+0000 7fd159600640 1 -- 172.21.15.173:0/2456201030 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2620876253 0 0) 0x7fd140003530 con 0x7fd15c15ed40 2024-04-25T09:12:04.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.866+0000 7fd15aa00640 1 -- 172.21.15.173:0/2456201030 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c09ac90 con 0x7fd15c0b2bf0 2024-04-25T09:12:04.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.870+0000 7fd15aa00640 1 --2- 172.21.15.173:0/2456201030 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd15c0b2bf0 0x7fd15c099a50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0097f0 tx=0x7fd14c01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=309dec9d5dbbb332 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.870+0000 7fd159600640 1 -- 172.21.15.173:0/2456201030 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0b0070 con 0x7fd15c0b2bf0 2024-04-25T09:12:04.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.870+0000 7fd159600640 1 -- 172.21.15.173:0/2456201030 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c0ab400 con 0x7fd15c0b2bf0 2024-04-25T09:12:04.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.870+0000 7fd159600640 1 -- 172.21.15.173:0/2456201030 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148001680 con 0x7fd15c0b2bf0 2024-04-25T09:12:04.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.870+0000 7fd15be00640 1 -- 172.21.15.173:0/2456201030 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd15c0b2bf0 msgr2=0x7fd15c099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.870+0000 7fd15be00640 1 --2- 172.21.15.173:0/2456201030 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd15c0b2bf0 0x7fd15c099a50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0097f0 tx=0x7fd14c01c370 comp rx=0 tx=0).stop 2024-04-25T09:12:04.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.870+0000 7fd15be00640 1 -- 172.21.15.173:0/2456201030 shutdown_connections 2024-04-25T09:12:04.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.870+0000 7fd15be00640 1 --2- 172.21.15.173:0/2456201030 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd15c0b2bf0 0x7fd15c099a50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.870+0000 7fd15be00640 1 -- 172.21.15.173:0/2456201030 >> 172.21.15.173:0/2456201030 conn(0x7fd15c0b3080 msgr2=0x7fd15c0b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.870+0000 7fd15be00640 1 -- 172.21.15.173:0/2456201030 shutdown_connections 2024-04-25T09:12:04.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.870+0000 7fd15be00640 1 -- 172.21.15.173:0/2456201030 wait complete. 2024-04-25T09:12:04.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15be00640 1 Processor -- start 2024-04-25T09:12:04.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15be00640 1 -- start start 2024-04-25T09:12:04.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd15c0b2bf0 0x7fd15c151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd15c15ed40 0x7fd15c157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd15c15f370 0x7fd15c158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15be00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c16c2e0 con 0x7fd15c15f370 2024-04-25T09:12:04.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c09a1a0 con 0x7fd15c0b2bf0 2024-04-25T09:12:04.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c16c460 con 0x7fd15c15ed40 2024-04-25T09:12:04.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd15c0b2bf0 0x7fd15c151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd15c15f370 0x7fd15c158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd15c0b2bf0 0x7fd15c151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:32976/0 (socket says 172.21.15.173:32976) 2024-04-25T09:12:04.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15aa00640 1 -- 172.21.15.173:0/3396585997 learned_addr learned my addr 172.21.15.173:0/3396585997 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:04.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15a000640 1 --2- 172.21.15.173:0/3396585997 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd15c15ed40 0x7fd15c157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15aa00640 1 -- 172.21.15.173:0/3396585997 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd15c15ed40 msgr2=0x7fd15c157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15aa00640 1 --2- 172.21.15.173:0/3396585997 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd15c15ed40 0x7fd15c157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15aa00640 1 -- 172.21.15.173:0/3396585997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd15c15f370 msgr2=0x7fd15c158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15aa00640 1 --2- 172.21.15.173:0/3396585997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd15c15f370 0x7fd15c158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15aa00640 1 -- 172.21.15.173:0/3396585997 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c0cc900 con 0x7fd15c0b2bf0 2024-04-25T09:12:04.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.874+0000 7fd15aa00640 1 --2- 172.21.15.173:0/3396585997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd15c0b2bf0 0x7fd15c151120 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd14c009740 tx=0x7fd14c019110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.878+0000 7fd152a00640 1 -- 172.21.15.173:0/3396585997 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0b8070 con 0x7fd15c0b2bf0 2024-04-25T09:12:04.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.878+0000 7fd152a00640 1 -- 172.21.15.173:0/3396585997 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c004220 con 0x7fd15c0b2bf0 2024-04-25T09:12:04.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.878+0000 7fd152a00640 1 -- 172.21.15.173:0/3396585997 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0b0040 con 0x7fd15c0b2bf0 2024-04-25T09:12:04.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.878+0000 7fd15be00640 1 -- 172.21.15.173:0/3396585997 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd15c0ccbe0 con 0x7fd15c0b2bf0 2024-04-25T09:12:04.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.878+0000 7fd15be00640 1 -- 172.21.15.173:0/3396585997 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd15c0cd1a0 con 0x7fd15c0b2bf0 2024-04-25T09:12:04.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.878+0000 7fd15be00640 1 -- 172.21.15.173:0/3396585997 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd15c073a40 con 0x7fd15c0b2bf0 2024-04-25T09:12:04.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.878+0000 7fd152a00640 1 -- 172.21.15.173:0/3396585997 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd14c003620 con 0x7fd15c0b2bf0 2024-04-25T09:12:04.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.878+0000 7fd152a00640 1 --2- 172.21.15.173:0/3396585997 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd13c066f90 0x7fd13c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.878+0000 7fd152a00640 1 -- 172.21.15.173:0/3396585997 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd14c11f360 con 0x7fd15c0b2bf0 2024-04-25T09:12:04.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.878+0000 7fd15a000640 1 --2- 172.21.15.173:0/3396585997 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd13c066f90 0x7fd13c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.882+0000 7fd15a000640 1 --2- 172.21.15.173:0/3396585997 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd13c066f90 0x7fd13c069450 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd15c1599a0 tx=0x7fd148001160 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:04.882+0000 7fd152a00640 1 -- 172.21.15.173:0/3396585997 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd14c015ff0 con 0x7fd15c0b2bf0 2024-04-25T09:12:05.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.070+0000 7fd15be00640 1 -- 172.21.15.173:0/3396585997 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd15c158a30 con 0x7fd15c0b2bf0 2024-04-25T09:12:05.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.070+0000 7fd152a00640 1 -- 172.21.15.173:0/3396585997 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fd14c0efc90 con 0x7fd15c0b2bf0 2024-04-25T09:12:05.055 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:05.055 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1021410995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1021410995},{"type":"v1","addr":"172.21.15.194:6834","nonce":1021410995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2198134208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2198134208},{"type":"v1","addr":"172.21.15.194:6835","nonce":2198134208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8772,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/684989574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":684989574},{"type":"v1","addr":"172.21.15.173:6836","nonce":684989574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:26.148874+0000","modified":"2024-04-25T09:11:29.164422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8775":{"gid":8775,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/671971539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":671971539},{"type":"v1","addr":"172.21.15.173:6837","nonce":671971539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:12:05.055 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 81 2024-04-25T09:12:05.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.070+0000 7fd15be00640 1 -- 172.21.15.173:0/3396585997 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd13c066f90 msgr2=0x7fd13c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.070+0000 7fd15be00640 1 --2- 172.21.15.173:0/3396585997 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd13c066f90 0x7fd13c069450 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd15c1599a0 tx=0x7fd148001160 comp rx=0 tx=0).stop 2024-04-25T09:12:05.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.070+0000 7fd15be00640 1 -- 172.21.15.173:0/3396585997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd15c0b2bf0 msgr2=0x7fd15c151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.070+0000 7fd15be00640 1 --2- 172.21.15.173:0/3396585997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd15c0b2bf0 0x7fd15c151120 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd14c009740 tx=0x7fd14c019110 comp rx=0 tx=0).stop 2024-04-25T09:12:05.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.070+0000 7fd15be00640 1 -- 172.21.15.173:0/3396585997 shutdown_connections 2024-04-25T09:12:05.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.070+0000 7fd15be00640 1 --2- 172.21.15.173:0/3396585997 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd13c066f90 0x7fd13c069450 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.070+0000 7fd15be00640 1 --2- 172.21.15.173:0/3396585997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd15c15f370 0x7fd15c158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.070+0000 7fd15be00640 1 --2- 172.21.15.173:0/3396585997 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd15c15ed40 0x7fd15c157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.070+0000 7fd15be00640 1 --2- 172.21.15.173:0/3396585997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd15c0b2bf0 0x7fd15c151120 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.070+0000 7fd15be00640 1 -- 172.21.15.173:0/3396585997 >> 172.21.15.173:0/3396585997 conn(0x7fd15c0b3080 msgr2=0x7fd15c15e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.070+0000 7fd15be00640 1 -- 172.21.15.173:0/3396585997 shutdown_connections 2024-04-25T09:12:05.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.070+0000 7fd15be00640 1 -- 172.21.15.173:0/3396585997 wait complete. 2024-04-25T09:12:05.077 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:12:05.077 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:12:05.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.226+0000 7fdd23200640 1 Processor -- start 2024-04-25T09:12:05.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.226+0000 7fdd23200640 1 -- start start 2024-04-25T09:12:05.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.226+0000 7fdd23200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd1c15a180 0x7fdd1c0b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.226+0000 7fdd23200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdd1c0b2ca0 0x7fdd1c0ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.226+0000 7fdd23200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1c06e860 con 0x7fdd1c071320 2024-04-25T09:12:05.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.226+0000 7fdd23200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1c0af230 con 0x7fdd1c0b2ca0 2024-04-25T09:12:05.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.226+0000 7fdd23200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c06eb20 con 0x7fdd1c15a180 2024-04-25T09:12:05.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.230+0000 7fdd1b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdd1c0b2ca0 0x7fdd1c0ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.230+0000 7fdd1be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd1c15a180 0x7fdd1c0b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.230+0000 7fdd1b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdd1c0b2ca0 0x7fdd1c0ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:32978/0 (socket says 172.21.15.173:32978) 2024-04-25T09:12:05.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.230+0000 7fdd1be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd1c15a180 0x7fdd1c0b40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:53484/0 (socket says 172.21.15.173:53484) 2024-04-25T09:12:05.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.230+0000 7fdd1b400640 1 -- 172.21.15.173:0/3445415466 learned_addr learned my addr 172.21.15.173:0/3445415466 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:05.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.230+0000 7fdd21200640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fdd1c071320 0x7fdd1c06d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:33392/0 (socket says 172.21.15.173:33392) 2024-04-25T09:12:05.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.230+0000 7fdd1b400640 1 -- 172.21.15.173:0/3445415466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd1c15a180 msgr2=0x7fdd1c0b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.230+0000 7fdd1b400640 1 --2- 172.21.15.173:0/3445415466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd1c15a180 0x7fdd1c0b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.230+0000 7fdd1b400640 1 -- 172.21.15.173:0/3445415466 >> v1:172.21.15.194:6789/0 conn(0x7fdd1c071320 legacy=0x7fdd1c06d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.230+0000 7fdd1b400640 1 -- 172.21.15.173:0/3445415466 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c0aebe0 con 0x7fdd1c0b2ca0 2024-04-25T09:12:05.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.230+0000 7fdd1aa00640 1 -- 172.21.15.173:0/3445415466 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161812375 0 0) 0x7fdd1c06e860 con 0x7fdd1c071320 2024-04-25T09:12:05.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.230+0000 7fdd1b400640 1 --2- 172.21.15.173:0/3445415466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd1c0b2ca0 0x7fdd1c0ccf20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800aa10 tx=0x7fdd0801d930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d6caa97fcb7748c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.234+0000 7fdd1aa00640 1 -- 172.21.15.173:0/3445415466 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd080b3070 con 0x7fdd1c0b2ca0 2024-04-25T09:12:05.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.234+0000 7fdd1aa00640 1 -- 172.21.15.173:0/3445415466 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd080a68f0 con 0x7fdd1c0b2ca0 2024-04-25T09:12:05.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.234+0000 7fdd1aa00640 1 -- 172.21.15.173:0/3445415466 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0800b040 con 0x7fdd1c0b2ca0 2024-04-25T09:12:05.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.234+0000 7fdd23200640 1 -- 172.21.15.173:0/3445415466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd1c0b2ca0 msgr2=0x7fdd1c0ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.234+0000 7fdd23200640 1 --2- 172.21.15.173:0/3445415466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd1c0b2ca0 0x7fdd1c0ccf20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800aa10 tx=0x7fdd0801d930 comp rx=0 tx=0).stop 2024-04-25T09:12:05.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.234+0000 7fdd23200640 1 -- 172.21.15.173:0/3445415466 shutdown_connections 2024-04-25T09:12:05.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.234+0000 7fdd23200640 1 --2- 172.21.15.173:0/3445415466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd1c0b2ca0 0x7fdd1c0ccf20 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.234+0000 7fdd23200640 1 --2- 172.21.15.173:0/3445415466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd1c15a180 0x7fdd1c0b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.234+0000 7fdd23200640 1 -- 172.21.15.173:0/3445415466 >> 172.21.15.173:0/3445415466 conn(0x7fdd1c06ac90 msgr2=0x7fdd1c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.234+0000 7fdd23200640 1 -- 172.21.15.173:0/3445415466 shutdown_connections 2024-04-25T09:12:05.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.234+0000 7fdd23200640 1 -- 172.21.15.173:0/3445415466 wait complete. 2024-04-25T09:12:05.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.234+0000 7fdd23200640 1 Processor -- start 2024-04-25T09:12:05.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.234+0000 7fdd23200640 1 -- start start 2024-04-25T09:12:05.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.234+0000 7fdd23200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd1c071320 0x7fdd1c155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd23200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd1c0b2ca0 0x7fdd1c15cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd23200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd1c15a180 0x7fdd1c154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd23200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0cfaf0 con 0x7fdd1c15a180 2024-04-25T09:12:05.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd23200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0cf970 con 0x7fdd1c0b2ca0 2024-04-25T09:12:05.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd23200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0cfc70 con 0x7fdd1c071320 2024-04-25T09:12:05.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd21200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd1c15a180 0x7fdd1c154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd21200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd1c15a180 0x7fdd1c154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53160/0 (socket says 172.21.15.173:53160) 2024-04-25T09:12:05.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd21200640 1 -- 172.21.15.173:0/3756053308 learned_addr learned my addr 172.21.15.173:0/3756053308 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:05.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd1be00640 1 --2- 172.21.15.173:0/3756053308 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd1c071320 0x7fdd1c155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd1b400640 1 --2- 172.21.15.173:0/3756053308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd1c0b2ca0 0x7fdd1c15cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd21200640 1 -- 172.21.15.173:0/3756053308 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd1c071320 msgr2=0x7fdd1c155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd21200640 1 --2- 172.21.15.173:0/3756053308 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd1c071320 0x7fdd1c155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd21200640 1 -- 172.21.15.173:0/3756053308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd1c0b2ca0 msgr2=0x7fdd1c15cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd21200640 1 --2- 172.21.15.173:0/3756053308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd1c0b2ca0 0x7fdd1c15cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd21200640 1 -- 172.21.15.173:0/3756053308 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c1565f0 con 0x7fdd1c15a180 2024-04-25T09:12:05.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd21200640 1 --2- 172.21.15.173:0/3756053308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd1c15a180 0x7fdd1c154ec0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400c3e0 tx=0x7fdd1400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd13e00640 1 -- 172.21.15.173:0/3756053308 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd140074e0 con 0x7fdd1c15a180 2024-04-25T09:12:05.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd13e00640 1 -- 172.21.15.173:0/3756053308 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd140047f0 con 0x7fdd1c15a180 2024-04-25T09:12:05.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd13e00640 1 -- 172.21.15.173:0/3756053308 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd14004be0 con 0x7fdd1c15a180 2024-04-25T09:12:05.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd23200640 1 -- 172.21.15.173:0/3756053308 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1c1568d0 con 0x7fdd1c15a180 2024-04-25T09:12:05.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd23200640 1 -- 172.21.15.173:0/3756053308 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1c1561c0 con 0x7fdd1c15a180 2024-04-25T09:12:05.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd23200640 1 -- 172.21.15.173:0/3756053308 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1c073a40 con 0x7fdd1c15a180 2024-04-25T09:12:05.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.238+0000 7fdd13e00640 1 -- 172.21.15.173:0/3756053308 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdd14011070 con 0x7fdd1c15a180 2024-04-25T09:12:05.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.242+0000 7fdd13e00640 1 --2- 172.21.15.173:0/3756053308 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdcfc066f60 0x7fdcfc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.242+0000 7fdd13e00640 1 -- 172.21.15.173:0/3756053308 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdd14084c60 con 0x7fdd1c15a180 2024-04-25T09:12:05.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.242+0000 7fdd1be00640 1 --2- 172.21.15.173:0/3756053308 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdcfc066f60 0x7fdcfc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.242+0000 7fdd1be00640 1 --2- 172.21.15.173:0/3756053308 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdcfc066f60 0x7fdcfc069420 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c0113e0 tx=0x7fdd0c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.246+0000 7fdd13e00640 1 -- 172.21.15.173:0/3756053308 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdd14055480 con 0x7fdd1c15a180 2024-04-25T09:12:05.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.450+0000 7fdd23200640 1 -- 172.21.15.173:0/3756053308 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fdd1c06e640 con 0x7fdd1c15a180 2024-04-25T09:12:05.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.450+0000 7fdd13e00640 1 -- 172.21.15.173:0/3756053308 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1598 (secure 0 0 0) 0x7fdd14059520 con 0x7fdd1c15a180 2024-04-25T09:12:05.436 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:05.436 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":579,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":122,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076684781,"bytes_used":2598592512,"bytes_avail":770495520768,"bytes_total":773094113280,"write_bytes_sec":41965257,"read_op_per_sec":0,"write_op_per_sec":42},"fsmap":{"epoch":81,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8775}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-04-25T09:12:04.850163+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:12:05.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.454+0000 7fdd23200640 1 -- 172.21.15.173:0/3756053308 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdcfc066f60 msgr2=0x7fdcfc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.454+0000 7fdd23200640 1 --2- 172.21.15.173:0/3756053308 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdcfc066f60 0x7fdcfc069420 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c0113e0 tx=0x7fdd0c00b040 comp rx=0 tx=0).stop 2024-04-25T09:12:05.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.454+0000 7fdd23200640 1 -- 172.21.15.173:0/3756053308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd1c15a180 msgr2=0x7fdd1c154ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.454+0000 7fdd23200640 1 --2- 172.21.15.173:0/3756053308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd1c15a180 0x7fdd1c154ec0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400c3e0 tx=0x7fdd1400c8a0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.454+0000 7fdd23200640 1 -- 172.21.15.173:0/3756053308 shutdown_connections 2024-04-25T09:12:05.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.454+0000 7fdd23200640 1 --2- 172.21.15.173:0/3756053308 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdcfc066f60 0x7fdcfc069420 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.454+0000 7fdd23200640 1 --2- 172.21.15.173:0/3756053308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd1c15a180 0x7fdd1c154ec0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.454+0000 7fdd23200640 1 --2- 172.21.15.173:0/3756053308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd1c0b2ca0 0x7fdd1c15cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.454+0000 7fdd23200640 1 --2- 172.21.15.173:0/3756053308 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd1c071320 0x7fdd1c155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.454+0000 7fdd23200640 1 -- 172.21.15.173:0/3756053308 >> 172.21.15.173:0/3756053308 conn(0x7fdd1c06ac90 msgr2=0x7fdd1c15db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.454+0000 7fdd23200640 1 -- 172.21.15.173:0/3756053308 shutdown_connections 2024-04-25T09:12:05.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.454+0000 7fdd23200640 1 -- 172.21.15.173:0/3756053308 wait complete. 2024-04-25T09:12:05.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2024-04-25T09:12:05.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:05.457 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub abort 2024-04-25T09:12:05.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d1f800640 1 Processor -- start 2024-04-25T09:12:05.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d1f800640 1 -- start start 2024-04-25T09:12:05.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d1f800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2d180aef70 0x7f2d1806d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d1f800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d18071570 con 0x7f2d180cc7e0 2024-04-25T09:12:05.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d1f800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d18071850 con 0x7f2d180aeb90 2024-04-25T09:12:05.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d1f800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d18071320 con 0x7f2d180aef70 2024-04-25T09:12:05.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d0fe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f2d180cc7e0 0x7f2d180cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38286/0 (socket says 172.21.15.173:38286) 2024-04-25T09:12:05.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d0fe00640 1 -- 172.21.15.173:0/278635157 learned_addr learned my addr 172.21.15.173:0/278635157 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:05.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d1d800640 1 --2- 172.21.15.173:0/278635157 >> v2:172.21.15.194:3300/0 conn(0x7f2d180aef70 0x7f2d1806d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d17e00640 1 -- 172.21.15.173:0/278635157 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444666769 0 0) 0x7f2d18071570 con 0x7f2d180cc7e0 2024-04-25T09:12:05.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d17e00640 1 -- 172.21.15.173:0/278635157 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cfc003530 con 0x7f2d180cc7e0 2024-04-25T09:12:05.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d17e00640 1 -- 172.21.15.173:0/278635157 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2786204092 0 0) 0x7f2cfc003530 con 0x7f2d180cc7e0 2024-04-25T09:12:05.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d17e00640 1 -- 172.21.15.173:0/278635157 >> v2:172.21.15.194:3300/0 conn(0x7f2d180aef70 msgr2=0x7f2d1806d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d17e00640 1 --2- 172.21.15.173:0/278635157 >> v2:172.21.15.194:3300/0 conn(0x7f2d180aef70 0x7f2d1806d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d17e00640 1 -- 172.21.15.173:0/278635157 >> v1:172.21.15.194:6789/0 conn(0x7f2d180aeb90 legacy=0x7f2d180cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d17e00640 1 -- 172.21.15.173:0/278635157 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d18071b30 con 0x7f2d180cc7e0 2024-04-25T09:12:05.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d17e00640 1 -- 172.21.15.173:0/278635157 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f2d000016a0 con 0x7f2d180cc7e0 2024-04-25T09:12:05.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d17e00640 1 -- 172.21.15.173:0/278635157 >> v1:172.21.15.173:6789/0 conn(0x7f2d180cc7e0 legacy=0x7f2d180cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d17e00640 1 --2- 172.21.15.173:0/278635157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cfc0039c0 0x7f2cfc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d17e00640 1 --2- 172.21.15.173:0/278635157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cfc004810 0x7f2cfc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d17e00640 1 --2- 172.21.15.173:0/278635157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cfc0051d0 0x7f2cfc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d17e00640 1 -- 172.21.15.173:0/278635157 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18071320 con 0x7f2cfc0039c0 2024-04-25T09:12:05.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d17e00640 1 -- 172.21.15.173:0/278635157 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc00c170 con 0x7f2cfc0051d0 2024-04-25T09:12:05.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d17e00640 1 -- 172.21.15.173:0/278635157 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc00e580 con 0x7f2cfc004810 2024-04-25T09:12:05.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d1ce00640 1 --2- 172.21.15.173:0/278635157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cfc0039c0 0x7f2cfc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d1d800640 1 --2- 172.21.15.173:0/278635157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cfc0051d0 0x7f2cfc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d0fe00640 1 --2- 172.21.15.173:0/278635157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cfc004810 0x7f2cfc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d1ce00640 1 -- 172.21.15.173:0/278635157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cfc004810 msgr2=0x7f2cfc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d1ce00640 1 --2- 172.21.15.173:0/278635157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cfc004810 0x7f2cfc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d1ce00640 1 -- 172.21.15.173:0/278635157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cfc0051d0 msgr2=0x7f2cfc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d1ce00640 1 --2- 172.21.15.173:0/278635157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cfc0051d0 0x7f2cfc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d1ce00640 1 -- 172.21.15.173:0/278635157 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc003530 con 0x7f2cfc0039c0 2024-04-25T09:12:05.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.610+0000 7f2d1d800640 1 -- 172.21.15.173:0/278635157 reap_dead start 2024-04-25T09:12:05.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.614+0000 7f2d1ce00640 1 --2- 172.21.15.173:0/278635157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cfc0039c0 0x7f2cfc003de0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f2d08001780 tx=0x7f2d0801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13608a2600c6970 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.614+0000 7f2d17e00640 1 -- 172.21.15.173:0/278635157 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d080013a0 con 0x7f2cfc0039c0 2024-04-25T09:12:05.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.614+0000 7f2d17e00640 1 -- 172.21.15.173:0/278635157 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d080052f0 con 0x7f2cfc0039c0 2024-04-25T09:12:05.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.614+0000 7f2d17e00640 1 -- 172.21.15.173:0/278635157 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08003840 con 0x7f2cfc0039c0 2024-04-25T09:12:05.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.614+0000 7f2d1f800640 1 -- 172.21.15.173:0/278635157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cfc0039c0 msgr2=0x7f2cfc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.614+0000 7f2d1f800640 1 --2- 172.21.15.173:0/278635157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cfc0039c0 0x7f2cfc003de0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f2d08001780 tx=0x7f2d0801c400 comp rx=0 tx=0).stop 2024-04-25T09:12:05.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.614+0000 7f2d1f800640 1 -- 172.21.15.173:0/278635157 shutdown_connections 2024-04-25T09:12:05.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.614+0000 7f2d1f800640 1 --2- 172.21.15.173:0/278635157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cfc0039c0 0x7f2cfc003de0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.614+0000 7f2d1f800640 1 -- 172.21.15.173:0/278635157 >> 172.21.15.173:0/278635157 conn(0x7f2d1806ac90 msgr2=0x7f2d1806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.614+0000 7f2d1f800640 1 -- 172.21.15.173:0/278635157 shutdown_connections 2024-04-25T09:12:05.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.614+0000 7f2d1f800640 1 -- 172.21.15.173:0/278635157 wait complete. 2024-04-25T09:12:05.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1f800640 1 Processor -- start 2024-04-25T09:12:05.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1f800640 1 -- start start 2024-04-25T09:12:05.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1f800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cfc0039c0 0x7f2d1814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1f800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d180b1b30 0x7f2d1815c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1f800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d180b1fb0 0x7f2d1815c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1f800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1815e940 con 0x7f2cfc0039c0 2024-04-25T09:12:05.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1f800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1815e7c0 con 0x7f2d180b1fb0 2024-04-25T09:12:05.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1f800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1815eac0 con 0x7f2d180b1b30 2024-04-25T09:12:05.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1ce00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cfc0039c0 0x7f2d1814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1ce00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cfc0039c0 0x7f2d1814e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53176/0 (socket says 172.21.15.173:53176) 2024-04-25T09:12:05.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1ce00640 1 -- 172.21.15.173:0/3812345194 learned_addr learned my addr 172.21.15.173:0/3812345194 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:05.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d0fe00640 1 --2- 172.21.15.173:0/3812345194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d180b1b30 0x7f2d1815c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1d800640 1 --2- 172.21.15.173:0/3812345194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d180b1fb0 0x7f2d1815c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1ce00640 1 -- 172.21.15.173:0/3812345194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d180b1b30 msgr2=0x7f2d1815c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1ce00640 1 --2- 172.21.15.173:0/3812345194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d180b1b30 0x7f2d1815c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1ce00640 1 -- 172.21.15.173:0/3812345194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d180b1fb0 msgr2=0x7f2d1815c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1ce00640 1 --2- 172.21.15.173:0/3812345194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d180b1fb0 0x7f2d1815c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1ce00640 1 -- 172.21.15.173:0/3812345194 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d180b0a70 con 0x7f2cfc0039c0 2024-04-25T09:12:05.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1ce00640 1 --2- 172.21.15.173:0/3812345194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cfc0039c0 0x7f2d1814e4b0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f2d0801c230 tx=0x7f2cfc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d15600640 1 -- 172.21.15.173:0/3812345194 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08007a40 con 0x7f2cfc0039c0 2024-04-25T09:12:05.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d15600640 1 -- 172.21.15.173:0/3812345194 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d080ba070 con 0x7f2cfc0039c0 2024-04-25T09:12:05.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d15600640 1 -- 172.21.15.173:0/3812345194 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d080054a0 con 0x7f2cfc0039c0 2024-04-25T09:12:05.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1f800640 1 -- 172.21.15.173:0/3812345194 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d180b01d0 con 0x7f2cfc0039c0 2024-04-25T09:12:05.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.618+0000 7f2d1f800640 1 -- 172.21.15.173:0/3812345194 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d180b0790 con 0x7f2cfc0039c0 2024-04-25T09:12:05.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.622+0000 7f2d15600640 1 -- 172.21.15.173:0/3812345194 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2d08007030 con 0x7f2cfc0039c0 2024-04-25T09:12:05.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.622+0000 7f2d15600640 1 --2- 172.21.15.173:0/3812345194 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2cf4066f60 0x7f2cf4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.622+0000 7f2d15600640 1 -- 172.21.15.173:0/3812345194 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2d0811f0b0 con 0x7f2cfc0039c0 2024-04-25T09:12:05.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.622+0000 7f2d22cbb000 1 Processor -- start 2024-04-25T09:12:05.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.622+0000 7f2d0fe00640 1 --2- 172.21.15.173:0/3812345194 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2cf4066f60 0x7f2cf4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.622+0000 7f2d22cbb000 1 -- start start 2024-04-25T09:12:05.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.622+0000 7f2d0fe00640 1 --2- 172.21.15.173:0/3812345194 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2cf4066f60 0x7f2cf4069420 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2d00001ec0 tx=0x7f2d00009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d22cbb000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608feca40 0x556608fece20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d22cbb000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608fed360 0x556608fa7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d22cbb000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x556608fa8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d22cbb000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556608e8a1f0 con 0x556608fa7d90 2024-04-25T09:12:05.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d22cbb000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556608df0e90 con 0x556608fed360 2024-04-25T09:12:05.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d22cbb000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x556608d78f50 con 0x556608feca40 2024-04-25T09:12:05.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d1d800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x556608fa8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d1d800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x556608fa8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53188/0 (socket says 172.21.15.173:53188) 2024-04-25T09:12:05.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d1d800640 1 -- 172.21.15.173:0/4086394846 learned_addr learned my addr 172.21.15.173:0/4086394846 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:05.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d1ce00640 1 --2- 172.21.15.173:0/4086394846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608feca40 0x556608fece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d0fe00640 1 --2- 172.21.15.173:0/4086394846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608fed360 0x556608fa7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d1d800640 1 -- 172.21.15.173:0/4086394846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608feca40 msgr2=0x556608fece20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d1d800640 1 --2- 172.21.15.173:0/4086394846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608feca40 0x556608fece20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d1d800640 1 -- 172.21.15.173:0/4086394846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608fed360 msgr2=0x556608fa7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d1d800640 1 --2- 172.21.15.173:0/4086394846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608fed360 0x556608fa7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d1d800640 1 -- 172.21.15.173:0/4086394846 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556608dc88b0 con 0x556608fa7d90 2024-04-25T09:12:05.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d1d800640 1 --2- 172.21.15.173:0/4086394846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x556608fa8170 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f2d1815e4f0 tx=0x7f2d10009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453470bdd6dadcdc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d0d600640 1 -- 172.21.15.173:0/4086394846 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d10003ba0 con 0x556608fa7d90 2024-04-25T09:12:05.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d0d600640 1 -- 172.21.15.173:0/4086394846 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1001e070 con 0x556608fa7d90 2024-04-25T09:12:05.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d0d600640 1 -- 172.21.15.173:0/4086394846 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d10004030 con 0x556608fa7d90 2024-04-25T09:12:05.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d22cbb000 1 -- 172.21.15.173:0/4086394846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 msgr2=0x556608fa8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/4086394846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x556608fa8170 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f2d1815e4f0 tx=0x7f2d10009750 comp rx=0 tx=0).stop 2024-04-25T09:12:05.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d22cbb000 1 -- 172.21.15.173:0/4086394846 shutdown_connections 2024-04-25T09:12:05.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/4086394846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x556608fa8170 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/4086394846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608fed360 0x556608fa7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/4086394846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608feca40 0x556608fece20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d22cbb000 1 -- 172.21.15.173:0/4086394846 >> 172.21.15.173:0/4086394846 conn(0x556608fa3d40 msgr2=0x556608fa6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d22cbb000 1 -- 172.21.15.173:0/4086394846 shutdown_connections 2024-04-25T09:12:05.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d22cbb000 1 -- 172.21.15.173:0/4086394846 wait complete. 2024-04-25T09:12:05.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d22cbb000 1 -- start start 2024-04-25T09:12:05.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.626+0000 7f2d22cbb000 1 Processor -- start 2024-04-25T09:12:05.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x556608ff41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608feca40 0x556608ff4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608fed360 0x556608fade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556608dab540 con 0x556608fa7d90 2024-04-25T09:12:05.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556608decf30 con 0x556608fed360 2024-04-25T09:12:05.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x556608db2e50 con 0x556608feca40 2024-04-25T09:12:05.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 10 client.0 _ll_register_callbacks cb 0x556608ea5180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:05.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d1ce00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x556608ff41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d1ce00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x556608ff41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53202/0 (socket says 172.21.15.173:53202) 2024-04-25T09:12:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d1ce00640 1 -- 172.21.15.173:0/296928350 learned_addr learned my addr 172.21.15.173:0/296928350 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d0fe00640 1 --2- 172.21.15.173:0/296928350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608feca40 0x556608ff4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d1d800640 1 --2- 172.21.15.173:0/296928350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608fed360 0x556608fade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d1ce00640 1 -- 172.21.15.173:0/296928350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608feca40 msgr2=0x556608ff4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d1ce00640 1 --2- 172.21.15.173:0/296928350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608feca40 0x556608ff4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d1ce00640 1 -- 172.21.15.173:0/296928350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608fed360 msgr2=0x556608fade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d1ce00640 1 --2- 172.21.15.173:0/296928350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608fed360 0x556608fade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d1ce00640 1 -- 172.21.15.173:0/296928350 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556608d791a0 con 0x556608fa7d90 2024-04-25T09:12:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d1d800640 1 --2- 172.21.15.173:0/296928350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608fed360 0x556608fade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d0fe00640 1 --2- 172.21.15.173:0/296928350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608feca40 0x556608ff4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d1ce00640 1 --2- 172.21.15.173:0/296928350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x556608ff41c0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f2d0801c8e0 tx=0x7f2d08001520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa9c196d3260de7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d06000640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:12:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d06000640 1 -- 172.21.15.173:0/296928350 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d080f3980 con 0x556608fa7d90 2024-04-25T09:12:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d06000640 1 -- 172.21.15.173:0/296928350 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2d080c0ca0 con 0x556608fa7d90 2024-04-25T09:12:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 -- 172.21.15.173:0/296928350 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d1001e070 con 0x556608fa7d90 2024-04-25T09:12:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d06000640 1 -- 172.21.15.173:0/296928350 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d080f7f40 con 0x556608fa7d90 2024-04-25T09:12:05.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 10 client.9057 fetch_fsmap learned FSMap version 81 2024-04-25T09:12:05.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 -- 172.21.15.173:0/296928350 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x556608e73840 con 0x556608fa7d90 2024-04-25T09:12:05.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d06000640 1 -- 172.21.15.173:0/296928350 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1001e070 con 0x556608fa7d90 2024-04-25T09:12:05.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d06000640 1 -- 172.21.15.173:0/296928350 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 81) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2d080f7ab0 con 0x556608fa7d90 2024-04-25T09:12:05.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 10 client.9057 fetch_fsmap finished waiting for FSMap version 81 2024-04-25T09:12:05.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 10 client.9057 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:12:05.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 20 client.9057 populate_metadata read hostname 'smithi173' 2024-04-25T09:12:05.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/296928350 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x556608faeb80 0x556608faef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 4 client.9057 mds_command: new command op to 8775 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:12:05.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 -- 172.21.15.173:0/296928350 --> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556608d8cbe0 con 0x556608faeb80 2024-04-25T09:12:05.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d0fe00640 1 --2- 172.21.15.173:0/296928350 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x556608faeb80 0x556608faef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d0fe00640 1 --2- 172.21.15.173:0/296928350 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x556608faeb80 0x556608faef60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d0749b71ed59b91 server_cookie=841a1a138ae5d72f in_seq=0 out_seq=0 2024-04-25T09:12:05.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d06000640 10 client.9057 ms_handle_connect on v2:172.21.15.173:6835/671971539 2024-04-25T09:12:05.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d06000640 1 -- 172.21.15.173:0/296928350 <== mds.0 v2:172.21.15.173:6835/671971539 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556608d8cbe0 con 0x556608faeb80 2024-04-25T09:12:05.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d06000640 10 client.9057 handle_command_reply: tid=0 2024-04-25T09:12:05.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 client.9057 shutdown 2024-04-25T09:12:05.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 -- 172.21.15.173:0/296928350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 msgr2=0x556608ff41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/296928350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x556608ff41c0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f2d0801c8e0 tx=0x7f2d08001520 comp rx=0 tx=0).stop 2024-04-25T09:12:05.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 -- 172.21.15.173:0/296928350 shutdown_connections 2024-04-25T09:12:05.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/296928350 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x556608faeb80 0x556608faef60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/296928350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608fed360 0x556608fade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/296928350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608feca40 0x556608ff4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d06000640 0 client.9057 ms_handle_reset on v2:172.21.15.173:6835/671971539 2024-04-25T09:12:05.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/296928350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x556608ff41c0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 -- 172.21.15.173:0/296928350 >> 172.21.15.173:0/296928350 conn(0x556608fa3d40 msgr2=0x556608fa69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 -- 172.21.15.173:0/296928350 shutdown_connections 2024-04-25T09:12:05.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 1 -- 172.21.15.173:0/296928350 wait complete. 2024-04-25T09:12:05.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.630+0000 7f2d22cbb000 20 client.9057 trim_cache size 0 max 16384 2024-04-25T09:12:05.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d22cbb000 1 Processor -- start 2024-04-25T09:12:05.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d22cbb000 1 -- start start 2024-04-25T09:12:05.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d22cbb000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x556609049290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d22cbb000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608feca40 0x5566090497d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d22cbb000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608fed360 0x556609049d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d22cbb000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d182041e0 con 0x556608fa7d90 2024-04-25T09:12:05.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d22cbb000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18203360 con 0x556608fed360 2024-04-25T09:12:05.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d22cbb000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d181f8a90 con 0x556608feca40 2024-04-25T09:12:05.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d1ce00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x556609049290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d1ce00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x556609049290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53216/0 (socket says 172.21.15.173:53216) 2024-04-25T09:12:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d1ce00640 1 -- 172.21.15.173:0/4278034569 learned_addr learned my addr 172.21.15.173:0/4278034569 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d0fe00640 1 --2- 172.21.15.173:0/4278034569 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608feca40 0x5566090497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d1ce00640 1 -- 172.21.15.173:0/4278034569 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608feca40 msgr2=0x5566090497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d1ce00640 1 --2- 172.21.15.173:0/4278034569 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608feca40 0x5566090497d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d1ce00640 1 -- 172.21.15.173:0/4278034569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608fed360 msgr2=0x556609049d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d1d800640 1 --2- 172.21.15.173:0/4278034569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608fed360 0x556609049d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d1ce00640 1 --2- 172.21.15.173:0/4278034569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608fed360 0x556609049d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d1ce00640 1 -- 172.21.15.173:0/4278034569 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556608fadd80 con 0x556608fa7d90 2024-04-25T09:12:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d0fe00640 1 --2- 172.21.15.173:0/4278034569 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608feca40 0x5566090497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d1d800640 1 --2- 172.21.15.173:0/4278034569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608fed360 0x556609049d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.646+0000 7f2d1ce00640 1 --2- 172.21.15.173:0/4278034569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x556609049290 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f2d080aafd0 tx=0x7f2d080f2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c160446c2ace8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d0cc00640 1 -- 172.21.15.173:0/4278034569 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d080ef190 con 0x556608fa7d90 2024-04-25T09:12:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d0cc00640 1 -- 172.21.15.173:0/4278034569 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d080f3980 con 0x556608fa7d90 2024-04-25T09:12:05.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d0cc00640 1 -- 172.21.15.173:0/4278034569 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d080ef600 con 0x556608fa7d90 2024-04-25T09:12:05.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 -- 172.21.15.173:0/4278034569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 msgr2=0x556609049290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/4278034569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x556609049290 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f2d080aafd0 tx=0x7f2d080f2000 comp rx=0 tx=0).stop 2024-04-25T09:12:05.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 -- 172.21.15.173:0/4278034569 shutdown_connections 2024-04-25T09:12:05.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/4278034569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608fed360 0x556609049d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/4278034569 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608feca40 0x5566090497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/4278034569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x556609049290 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 -- 172.21.15.173:0/4278034569 >> 172.21.15.173:0/4278034569 conn(0x556608fa3d40 msgr2=0x556608feb140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 -- 172.21.15.173:0/4278034569 shutdown_connections 2024-04-25T09:12:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 -- 172.21.15.173:0/4278034569 wait complete. 2024-04-25T09:12:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 -- start start 2024-04-25T09:12:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 Processor -- start 2024-04-25T09:12:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x55660904d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608feca40 0x55660904d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608fed360 0x556608ff1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556608decf30 con 0x556608fa7d90 2024-04-25T09:12:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18202d60 con 0x556608feca40 2024-04-25T09:12:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x556608da9df0 con 0x556608fed360 2024-04-25T09:12:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 10 client.0 _ll_register_callbacks cb 0x556608db3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d1ce00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x55660904d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d1ce00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x55660904d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53224/0 (socket says 172.21.15.173:53224) 2024-04-25T09:12:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d1ce00640 1 -- 172.21.15.173:0/1608081024 learned_addr learned my addr 172.21.15.173:0/1608081024 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d1d800640 1 --2- 172.21.15.173:0/1608081024 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608fed360 0x556608ff1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d0fe00640 1 --2- 172.21.15.173:0/1608081024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608feca40 0x55660904d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d1ce00640 1 -- 172.21.15.173:0/1608081024 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608fed360 msgr2=0x556608ff1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d1ce00640 1 --2- 172.21.15.173:0/1608081024 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608fed360 0x556608ff1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d1ce00640 1 -- 172.21.15.173:0/1608081024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608feca40 msgr2=0x55660904d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d1ce00640 1 --2- 172.21.15.173:0/1608081024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608feca40 0x55660904d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d1ce00640 1 -- 172.21.15.173:0/1608081024 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556608e4aa10 con 0x556608fa7d90 2024-04-25T09:12:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d1ce00640 1 --2- 172.21.15.173:0/1608081024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x55660904d2a0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f2d080ef530 tx=0x7f2d0811d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bec962d4354f9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d06000640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:12:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d06000640 1 -- 172.21.15.173:0/1608081024 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08107320 con 0x556608fa7d90 2024-04-25T09:12:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d06000640 1 -- 172.21.15.173:0/1608081024 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2d080f0b60 con 0x556608fa7d90 2024-04-25T09:12:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 -- 172.21.15.173:0/1608081024 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d080f3980 con 0x556608fa7d90 2024-04-25T09:12:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d06000640 1 -- 172.21.15.173:0/1608081024 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d080f0da0 con 0x556608fa7d90 2024-04-25T09:12:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 10 client.9063 fetch_fsmap learned FSMap version 81 2024-04-25T09:12:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.650+0000 7f2d22cbb000 1 -- 172.21.15.173:0/1608081024 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x556608d85b00 con 0x556608fa7d90 2024-04-25T09:12:05.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d06000640 1 -- 172.21.15.173:0/1608081024 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d080f3980 con 0x556608fa7d90 2024-04-25T09:12:05.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d06000640 1 -- 172.21.15.173:0/1608081024 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 81) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2d080eec80 con 0x556608fa7d90 2024-04-25T09:12:05.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d22cbb000 10 client.9063 fetch_fsmap finished waiting for FSMap version 81 2024-04-25T09:12:05.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d22cbb000 10 client.9063 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:12:05.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d22cbb000 20 client.9063 populate_metadata read hostname 'smithi173' 2024-04-25T09:12:05.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/1608081024 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x556608ff28c0 0x556608ff2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d22cbb000 4 client.9063 mds_command: new command op to 8775 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-04-25T09:12:05.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d22cbb000 1 -- 172.21.15.173:0/1608081024 --> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x556608dfe3d0 con 0x556608ff28c0 2024-04-25T09:12:05.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d0fe00640 1 --2- 172.21.15.173:0/1608081024 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x556608ff28c0 0x556608ff2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d0fe00640 1 --2- 172.21.15.173:0/1608081024 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x556608ff28c0 0x556608ff2cd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51e98760adc8de03 server_cookie=6de9b4c1dd0f3f11 in_seq=0 out_seq=0 2024-04-25T09:12:05.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d06000640 10 client.9063 ms_handle_connect on v2:172.21.15.173:6835/671971539 2024-04-25T09:12:05.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d06000640 1 -- 172.21.15.173:0/1608081024 <== mds.0 v2:172.21.15.173:6835/671971539 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x556608dfe3d0 con 0x556608ff28c0 2024-04-25T09:12:05.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d06000640 10 client.9063 handle_command_reply: tid=0 2024-04-25T09:12:05.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d22cbb000 1 client.9063 shutdown 2024-04-25T09:12:05.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d22cbb000 1 -- 172.21.15.173:0/1608081024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 msgr2=0x55660904d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/1608081024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x55660904d2a0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f2d080ef530 tx=0x7f2d0811d320 comp rx=0 tx=0).stop 2024-04-25T09:12:05.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d22cbb000 1 -- 172.21.15.173:0/1608081024 shutdown_connections 2024-04-25T09:12:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/1608081024 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x556608ff28c0 0x556608ff2cd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/1608081024 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556608fed360 0x556608ff1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/1608081024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556608feca40 0x55660904d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d22cbb000 1 --2- 172.21.15.173:0/1608081024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556608fa7d90 0x55660904d2a0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d06000640 0 client.9063 ms_handle_reset on v2:172.21.15.173:6835/671971539 2024-04-25T09:12:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d22cbb000 1 -- 172.21.15.173:0/1608081024 >> 172.21.15.173:0/1608081024 conn(0x556608fa3d40 msgr2=0x556608feb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d22cbb000 1 -- 172.21.15.173:0/1608081024 shutdown_connections 2024-04-25T09:12:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d22cbb000 1 -- 172.21.15.173:0/1608081024 wait complete. 2024-04-25T09:12:05.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d22cbb000 20 client.9063 trim_cache size 0 max 16384 2024-04-25T09:12:05.642 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:12:05.642 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0 2024-04-25T09:12:05.643 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:12:05.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d1f800640 1 -- 172.21.15.173:0/3812345194 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2cf4066f60 msgr2=0x7f2cf4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d1f800640 1 --2- 172.21.15.173:0/3812345194 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2cf4066f60 0x7f2cf4069420 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2d00001ec0 tx=0x7f2d00009040 comp rx=0 tx=0).stop 2024-04-25T09:12:05.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d1f800640 1 -- 172.21.15.173:0/3812345194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cfc0039c0 msgr2=0x7f2d1814e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d1f800640 1 --2- 172.21.15.173:0/3812345194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cfc0039c0 0x7f2d1814e4b0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f2d0801c230 tx=0x7f2cfc005840 comp rx=0 tx=0).stop 2024-04-25T09:12:05.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d1f800640 1 -- 172.21.15.173:0/3812345194 shutdown_connections 2024-04-25T09:12:05.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d1f800640 1 --2- 172.21.15.173:0/3812345194 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2cf4066f60 0x7f2cf4069420 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d1f800640 1 --2- 172.21.15.173:0/3812345194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d180b1fb0 0x7f2d1815c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d1f800640 1 --2- 172.21.15.173:0/3812345194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d180b1b30 0x7f2d1815c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d1f800640 1 --2- 172.21.15.173:0/3812345194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cfc0039c0 0x7f2d1814e4b0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d1f800640 1 -- 172.21.15.173:0/3812345194 >> 172.21.15.173:0/3812345194 conn(0x7f2d1806ac90 msgr2=0x7f2d1814f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d1f800640 1 -- 172.21.15.173:0/3812345194 shutdown_connections 2024-04-25T09:12:05.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.654+0000 7f2d1f800640 1 -- 172.21.15.173:0/3812345194 wait complete. 2024-04-25T09:12:05.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:05.658 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub status 2024-04-25T09:12:05.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.814+0000 7f7853e00640 1 Processor -- start 2024-04-25T09:12:05.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.814+0000 7f7853e00640 1 -- start start 2024-04-25T09:12:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.814+0000 7f7853e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785406bda0 0x7f78540cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.814+0000 7f7853e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f785406c220 0x7f78540cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.814+0000 7f7853e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7854161570 con 0x7f7854099a50 2024-04-25T09:12:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.814+0000 7f7853e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7854161850 con 0x7f785406c220 2024-04-25T09:12:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.814+0000 7f7853e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7854161b30 con 0x7f785406bda0 2024-04-25T09:12:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.814+0000 7f7853400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f785406c220 0x7f78540cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.814+0000 7f7852a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f7854099a50 0x7f7854099e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38290/0 (socket says 172.21.15.173:38290) 2024-04-25T09:12:05.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.814+0000 7f7852a00640 1 -- 172.21.15.173:0/3620064281 learned_addr learned my addr 172.21.15.173:0/3620064281 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:05.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.814+0000 7f7852000640 1 --2- 172.21.15.173:0/3620064281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785406bda0 0x7f78540cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.814+0000 7f7853400640 1 -- 172.21.15.173:0/3620064281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785406bda0 msgr2=0x7f78540cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.814+0000 7f7853400640 1 --2- 172.21.15.173:0/3620064281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785406bda0 0x7f78540cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.814+0000 7f7853400640 1 -- 172.21.15.173:0/3620064281 >> v1:172.21.15.173:6789/0 conn(0x7f7854099a50 legacy=0x7f7854099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.814+0000 7f7853400640 1 -- 172.21.15.173:0/3620064281 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7854161e10 con 0x7f785406c220 2024-04-25T09:12:05.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.818+0000 7f7853400640 1 --2- 172.21.15.173:0/3620064281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f785406c220 0x7f78540cfce0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f784c009d90 tx=0x7f784c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d146b94eaf482358 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.818+0000 7f7851600640 1 -- 172.21.15.173:0/3620064281 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c0b2070 con 0x7f785406c220 2024-04-25T09:12:05.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.818+0000 7f7851600640 1 -- 172.21.15.173:0/3620064281 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c0a5a20 con 0x7f785406c220 2024-04-25T09:12:05.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.818+0000 7f7851600640 1 -- 172.21.15.173:0/3620064281 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c0a5df0 con 0x7f785406c220 2024-04-25T09:12:05.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.818+0000 7f7853e00640 1 -- 172.21.15.173:0/3620064281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f785406c220 msgr2=0x7f78540cfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.818+0000 7f7853e00640 1 --2- 172.21.15.173:0/3620064281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f785406c220 0x7f78540cfce0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f784c009d90 tx=0x7f784c01c940 comp rx=0 tx=0).stop 2024-04-25T09:12:05.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.818+0000 7f7853e00640 1 -- 172.21.15.173:0/3620064281 shutdown_connections 2024-04-25T09:12:05.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.818+0000 7f7853e00640 1 --2- 172.21.15.173:0/3620064281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f785406c220 0x7f78540cfce0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.818+0000 7f7853e00640 1 --2- 172.21.15.173:0/3620064281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785406bda0 0x7f78540cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.818+0000 7f7853e00640 1 -- 172.21.15.173:0/3620064281 >> 172.21.15.173:0/3620064281 conn(0x7f78540b31d0 msgr2=0x7f78540b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.818+0000 7f7853e00640 1 -- 172.21.15.173:0/3620064281 shutdown_connections 2024-04-25T09:12:05.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.818+0000 7f7853e00640 1 -- 172.21.15.173:0/3620064281 wait complete. 2024-04-25T09:12:05.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853e00640 1 Processor -- start 2024-04-25T09:12:05.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853e00640 1 -- start start 2024-04-25T09:12:05.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f785406bda0 0x7f78540b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785406c220 0x7f785415b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7854099a50 0x7f7854151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785416a910 con 0x7f7854099a50 2024-04-25T09:12:05.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785409aed0 con 0x7f785406bda0 2024-04-25T09:12:05.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785416aa90 con 0x7f785406c220 2024-04-25T09:12:05.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7854099a50 0x7f7854151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7854099a50 0x7f7854151140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53234/0 (socket says 172.21.15.173:53234) 2024-04-25T09:12:05.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853400640 1 -- 172.21.15.173:0/311214062 learned_addr learned my addr 172.21.15.173:0/311214062 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:05.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7852a00640 1 --2- 172.21.15.173:0/311214062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f785406bda0 0x7f78540b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7852000640 1 --2- 172.21.15.173:0/311214062 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785406c220 0x7f785415b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853400640 1 -- 172.21.15.173:0/311214062 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785406c220 msgr2=0x7f785415b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853400640 1 --2- 172.21.15.173:0/311214062 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785406c220 0x7f785415b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853400640 1 -- 172.21.15.173:0/311214062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f785406bda0 msgr2=0x7f78540b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853400640 1 --2- 172.21.15.173:0/311214062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f785406bda0 0x7f78540b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853400640 1 -- 172.21.15.173:0/311214062 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78540b6b30 con 0x7f7854099a50 2024-04-25T09:12:05.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853400640 1 --2- 172.21.15.173:0/311214062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7854099a50 0x7f7854151140 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f784c0b0040 tx=0x7f784c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f784aa00640 1 -- 172.21.15.173:0/311214062 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c0b2050 con 0x7f7854099a50 2024-04-25T09:12:05.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f784aa00640 1 -- 172.21.15.173:0/311214062 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c0be070 con 0x7f7854099a50 2024-04-25T09:12:05.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853e00640 1 -- 172.21.15.173:0/311214062 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78540b6e10 con 0x7f7854099a50 2024-04-25T09:12:05.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f784aa00640 1 -- 172.21.15.173:0/311214062 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c0adad0 con 0x7f7854099a50 2024-04-25T09:12:05.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.822+0000 7f7853e00640 1 -- 172.21.15.173:0/311214062 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785415cfa0 con 0x7f7854099a50 2024-04-25T09:12:05.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.826+0000 7f784aa00640 1 -- 172.21.15.173:0/311214062 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f784c0adc70 con 0x7f7854099a50 2024-04-25T09:12:05.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.826+0000 7f784aa00640 1 --2- 172.21.15.173:0/311214062 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7834066f90 0x7f7834069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.826+0000 7f784aa00640 1 -- 172.21.15.173:0/311214062 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f784c11fdd0 con 0x7f7854099a50 2024-04-25T09:12:05.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.826+0000 7f7852a00640 1 --2- 172.21.15.173:0/311214062 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7834066f90 0x7f7834069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.826+0000 7f7852a00640 1 --2- 172.21.15.173:0/311214062 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7834066f90 0x7f7834069450 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7844000f70 tx=0x7f7844007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.826+0000 7f785ca09000 1 Processor -- start 2024-04-25T09:12:05.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.826+0000 7f785ca09000 1 -- start start 2024-04-25T09:12:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.826+0000 7f785ca09000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 0x55e572beedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.826+0000 7f785ca09000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572bef2f0 0x55e572ba4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.826+0000 7f785ca09000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572ba50a0 0x55e572ba5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.826+0000 7f785ca09000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5729f1ff0 con 0x55e572bee9d0 2024-04-25T09:12:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.826+0000 7f785ca09000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e57297a150 con 0x55e572bef2f0 2024-04-25T09:12:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.826+0000 7f785ca09000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5729ee090 con 0x55e572ba50a0 2024-04-25T09:12:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.826+0000 7f7852a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 0x55e572beedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.826+0000 7f7852a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 0x55e572beedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53240/0 (socket says 172.21.15.173:53240) 2024-04-25T09:12:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.826+0000 7f7852a00640 1 -- 172.21.15.173:0/2010259139 learned_addr learned my addr 172.21.15.173:0/2010259139 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f7852a00640 1 -- 172.21.15.173:0/2010259139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572ba50a0 msgr2=0x55e572ba5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f7852a00640 1 --2- 172.21.15.173:0/2010259139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572ba50a0 0x55e572ba5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.826+0000 7f7852000640 1 --2- 172.21.15.173:0/2010259139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572bef2f0 0x55e572ba4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f7852a00640 1 -- 172.21.15.173:0/2010259139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572bef2f0 msgr2=0x55e572ba4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f7852a00640 1 --2- 172.21.15.173:0/2010259139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572bef2f0 0x55e572ba4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f7852a00640 1 -- 172.21.15.173:0/2010259139 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e572b880d0 con 0x55e572bee9d0 2024-04-25T09:12:05.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f7852a00640 1 --2- 172.21.15.173:0/2010259139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 0x55e572beedb0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f7844001820 tx=0x7f7844013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bd9c7ef1e92c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f783f400640 1 -- 172.21.15.173:0/2010259139 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7844026070 con 0x55e572bee9d0 2024-04-25T09:12:05.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f783f400640 1 -- 172.21.15.173:0/2010259139 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7844013970 con 0x55e572bee9d0 2024-04-25T09:12:05.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f783f400640 1 -- 172.21.15.173:0/2010259139 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7844013d20 con 0x55e572bee9d0 2024-04-25T09:12:05.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f785ca09000 1 -- 172.21.15.173:0/2010259139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 msgr2=0x55e572beedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f785ca09000 1 --2- 172.21.15.173:0/2010259139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 0x55e572beedb0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f7844001820 tx=0x7f7844013000 comp rx=0 tx=0).stop 2024-04-25T09:12:05.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f785ca09000 1 -- 172.21.15.173:0/2010259139 shutdown_connections 2024-04-25T09:12:05.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f785ca09000 1 --2- 172.21.15.173:0/2010259139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572ba50a0 0x55e572ba5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f785ca09000 1 --2- 172.21.15.173:0/2010259139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572bef2f0 0x55e572ba4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f785ca09000 1 --2- 172.21.15.173:0/2010259139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 0x55e572beedb0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f785ca09000 1 -- 172.21.15.173:0/2010259139 >> 172.21.15.173:0/2010259139 conn(0x55e572ba1020 msgr2=0x55e572ba3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f785ca09000 1 -- 172.21.15.173:0/2010259139 shutdown_connections 2024-04-25T09:12:05.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f785ca09000 1 -- 172.21.15.173:0/2010259139 wait complete. 2024-04-25T09:12:05.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f785ca09000 1 -- start start 2024-04-25T09:12:05.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f785ca09000 1 Processor -- start 2024-04-25T09:12:05.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f785ca09000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572ba50a0 0x55e572bd37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f785ca09000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572bee9d0 0x55e572bd3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f785ca09000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572bef2f0 0x55e572bd4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f785ca09000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5729b6250 con 0x55e572ba50a0 2024-04-25T09:12:05.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f785ca09000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5729ac690 con 0x55e572bee9d0 2024-04-25T09:12:05.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f785ca09000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e57297aa40 con 0x55e572bef2f0 2024-04-25T09:12:05.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f785ca09000 10 client.0 _ll_register_callbacks cb 0x55e572b8fe90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:05.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f7852a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572ba50a0 0x55e572bd37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f7852a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572ba50a0 0x55e572bd37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53244/0 (socket says 172.21.15.173:53244) 2024-04-25T09:12:05.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f7852a00640 1 -- 172.21.15.173:0/1950762217 learned_addr learned my addr 172.21.15.173:0/1950762217 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:05.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f7852000640 1 --2- 172.21.15.173:0/1950762217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572bee9d0 0x55e572bd3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f7853400640 1 --2- 172.21.15.173:0/1950762217 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572bef2f0 0x55e572bd4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f7852a00640 1 -- 172.21.15.173:0/1950762217 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572bef2f0 msgr2=0x55e572bd4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f7852a00640 1 --2- 172.21.15.173:0/1950762217 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572bef2f0 0x55e572bd4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f7852a00640 1 -- 172.21.15.173:0/1950762217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572bee9d0 msgr2=0x55e572bd3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f7852a00640 1 --2- 172.21.15.173:0/1950762217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572bee9d0 0x55e572bd3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f7852a00640 1 -- 172.21.15.173:0/1950762217 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e572a9f1c0 con 0x55e572ba50a0 2024-04-25T09:12:05.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f7852a00640 1 --2- 172.21.15.173:0/1950762217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572ba50a0 0x55e572bd37f0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f78440014b0 tx=0x7f7844000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8bc02599bc7f16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.830+0000 7f7833e00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:12:05.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f7833e00640 1 -- 172.21.15.173:0/1950762217 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784402f020 con 0x55e572ba50a0 2024-04-25T09:12:05.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f7833e00640 1 -- 172.21.15.173:0/1950762217 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7844020850 con 0x55e572ba50a0 2024-04-25T09:12:05.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 1 -- 172.21.15.173:0/1950762217 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7844013970 con 0x55e572ba50a0 2024-04-25T09:12:05.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f7833e00640 1 -- 172.21.15.173:0/1950762217 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7844026040 con 0x55e572ba50a0 2024-04-25T09:12:05.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 10 client.9078 fetch_fsmap learned FSMap version 81 2024-04-25T09:12:05.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 1 -- 172.21.15.173:0/1950762217 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x55e572a9b170 con 0x55e572ba50a0 2024-04-25T09:12:05.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f7833e00640 1 -- 172.21.15.173:0/1950762217 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7844013970 con 0x55e572ba50a0 2024-04-25T09:12:05.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f7833e00640 1 -- 172.21.15.173:0/1950762217 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 81) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7844020a50 con 0x55e572ba50a0 2024-04-25T09:12:05.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 10 client.9078 fetch_fsmap finished waiting for FSMap version 81 2024-04-25T09:12:05.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 10 client.9078 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:12:05.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 20 client.9078 populate_metadata read hostname 'smithi173' 2024-04-25T09:12:05.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 1 --2- 172.21.15.173:0/1950762217 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55e572bfec80 0x55e572c01070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 4 client.9078 mds_command: new command op to 8775 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:12:05.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 1 -- 172.21.15.173:0/1950762217 --> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e57298dc60 con 0x55e572bfec80 2024-04-25T09:12:05.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f7852000640 1 --2- 172.21.15.173:0/1950762217 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55e572bfec80 0x55e572c01070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f7852000640 1 --2- 172.21.15.173:0/1950762217 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55e572bfec80 0x55e572c01070 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb4d403b2c35d104 server_cookie=ac12c0abd606736a in_seq=0 out_seq=0 2024-04-25T09:12:05.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f7833e00640 10 client.9078 ms_handle_connect on v2:172.21.15.173:6835/671971539 2024-04-25T09:12:05.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f7833e00640 1 -- 172.21.15.173:0/1950762217 <== mds.0 v2:172.21.15.173:6835/671971539 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e57298dc60 con 0x55e572bfec80 2024-04-25T09:12:05.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f7833e00640 10 client.9078 handle_command_reply: tid=0 2024-04-25T09:12:05.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 1 client.9078 shutdown 2024-04-25T09:12:05.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 1 -- 172.21.15.173:0/1950762217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572ba50a0 msgr2=0x55e572bd37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 1 --2- 172.21.15.173:0/1950762217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572ba50a0 0x55e572bd37f0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f78440014b0 tx=0x7f7844000bd0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 1 -- 172.21.15.173:0/1950762217 shutdown_connections 2024-04-25T09:12:05.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 1 --2- 172.21.15.173:0/1950762217 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55e572bfec80 0x55e572c01070 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 1 --2- 172.21.15.173:0/1950762217 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572bef2f0 0x55e572bd4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 1 --2- 172.21.15.173:0/1950762217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572bee9d0 0x55e572bd3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f7833e00640 0 client.9078 ms_handle_reset on v2:172.21.15.173:6835/671971539 2024-04-25T09:12:05.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 1 --2- 172.21.15.173:0/1950762217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572ba50a0 0x55e572bd37f0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 1 -- 172.21.15.173:0/1950762217 >> 172.21.15.173:0/1950762217 conn(0x55e572ba1020 msgr2=0x55e572ba3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 1 -- 172.21.15.173:0/1950762217 shutdown_connections 2024-04-25T09:12:05.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 1 -- 172.21.15.173:0/1950762217 wait complete. 2024-04-25T09:12:05.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.834+0000 7f785ca09000 20 client.9078 trim_cache size 0 max 16384 2024-04-25T09:12:05.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f785ca09000 1 Processor -- start 2024-04-25T09:12:05.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f785ca09000 1 -- start start 2024-04-25T09:12:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f785ca09000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572ba50a0 0x55e572c4b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f785ca09000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 0x55e572c4b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f785ca09000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572bef2f0 0x55e572c4bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f785ca09000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7854203290 con 0x55e572bee9d0 2024-04-25T09:12:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f785ca09000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78542024c0 con 0x55e572ba50a0 2024-04-25T09:12:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f785ca09000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785414e900 con 0x55e572bef2f0 2024-04-25T09:12:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f7852000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 0x55e572c4b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f7852000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 0x55e572c4b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53256/0 (socket says 172.21.15.173:53256) 2024-04-25T09:12:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f7852000640 1 -- 172.21.15.173:0/2031796790 learned_addr learned my addr 172.21.15.173:0/2031796790 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f7853400640 1 --2- 172.21.15.173:0/2031796790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572bef2f0 0x55e572c4bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f7852a00640 1 --2- 172.21.15.173:0/2031796790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572ba50a0 0x55e572c4b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f7852000640 1 -- 172.21.15.173:0/2031796790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572bef2f0 msgr2=0x55e572c4bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f7852000640 1 --2- 172.21.15.173:0/2031796790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572bef2f0 0x55e572c4bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f7852000640 1 -- 172.21.15.173:0/2031796790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572ba50a0 msgr2=0x55e572c4b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f7852000640 1 --2- 172.21.15.173:0/2031796790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572ba50a0 0x55e572c4b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f7852000640 1 -- 172.21.15.173:0/2031796790 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e572a38de0 con 0x55e572bee9d0 2024-04-25T09:12:05.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f7852000640 1 --2- 172.21.15.173:0/2031796790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 0x55e572c4b630 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f7840009f60 tx=0x7f7840008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9903267ed7c9598 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f783ea00640 1 -- 172.21.15.173:0/2031796790 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840018990 con 0x55e572bee9d0 2024-04-25T09:12:05.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f783ea00640 1 -- 172.21.15.173:0/2031796790 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7840021030 con 0x55e572bee9d0 2024-04-25T09:12:05.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.850+0000 7f783ea00640 1 -- 172.21.15.173:0/2031796790 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840018d90 con 0x55e572bee9d0 2024-04-25T09:12:05.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 -- 172.21.15.173:0/2031796790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 msgr2=0x55e572c4b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 --2- 172.21.15.173:0/2031796790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 0x55e572c4b630 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f7840009f60 tx=0x7f7840008040 comp rx=0 tx=0).stop 2024-04-25T09:12:05.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 -- 172.21.15.173:0/2031796790 shutdown_connections 2024-04-25T09:12:05.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 --2- 172.21.15.173:0/2031796790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572bef2f0 0x55e572c4bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 --2- 172.21.15.173:0/2031796790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 0x55e572c4b630 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 --2- 172.21.15.173:0/2031796790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572ba50a0 0x55e572c4b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 -- 172.21.15.173:0/2031796790 >> 172.21.15.173:0/2031796790 conn(0x55e572ba1020 msgr2=0x55e572bfbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 -- 172.21.15.173:0/2031796790 shutdown_connections 2024-04-25T09:12:05.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 -- 172.21.15.173:0/2031796790 wait complete. 2024-04-25T09:12:05.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 -- start start 2024-04-25T09:12:05.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 Processor -- start 2024-04-25T09:12:05.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572ba50a0 0x55e572c4ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 0x55e572c4f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572bef2f0 0x55e572c00fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e57298ce00 con 0x55e572bee9d0 2024-04-25T09:12:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785414fee0 con 0x55e572bef2f0 2024-04-25T09:12:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5729f1300 con 0x55e572ba50a0 2024-04-25T09:12:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 10 client.0 _ll_register_callbacks cb 0x55e572b70040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7852000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 0x55e572c4f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7852000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 0x55e572c4f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53260/0 (socket says 172.21.15.173:53260) 2024-04-25T09:12:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7852000640 1 -- 172.21.15.173:0/1211845979 learned_addr learned my addr 172.21.15.173:0/1211845979 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7853400640 1 --2- 172.21.15.173:0/1211845979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572bef2f0 0x55e572c00fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7852a00640 1 --2- 172.21.15.173:0/1211845979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572ba50a0 0x55e572c4ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7852000640 1 -- 172.21.15.173:0/1211845979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572ba50a0 msgr2=0x55e572c4ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7852000640 1 --2- 172.21.15.173:0/1211845979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572ba50a0 0x55e572c4ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7852000640 1 -- 172.21.15.173:0/1211845979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572bef2f0 msgr2=0x55e572c00fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7852000640 1 --2- 172.21.15.173:0/1211845979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572bef2f0 0x55e572c00fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7852000640 1 -- 172.21.15.173:0/1211845979 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5729938e0 con 0x55e572bee9d0 2024-04-25T09:12:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7853400640 1 --2- 172.21.15.173:0/1211845979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572bef2f0 0x55e572c00fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:05.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7852a00640 1 --2- 172.21.15.173:0/1211845979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572ba50a0 0x55e572c4ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:05.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7852000640 1 --2- 172.21.15.173:0/1211845979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 0x55e572c4f4a0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f7840004710 tx=0x7f784001da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac0d75489ef2b14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7833e00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:12:05.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7833e00640 1 -- 172.21.15.173:0/1211845979 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840018da0 con 0x55e572bee9d0 2024-04-25T09:12:05.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7833e00640 1 -- 172.21.15.173:0/1211845979 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f784001d1d0 con 0x55e572bee9d0 2024-04-25T09:12:05.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 -- 172.21.15.173:0/1211845979 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7840021030 con 0x55e572bee9d0 2024-04-25T09:12:05.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7833e00640 1 -- 172.21.15.173:0/1211845979 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7840036050 con 0x55e572bee9d0 2024-04-25T09:12:05.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 10 client.9084 fetch_fsmap learned FSMap version 81 2024-04-25T09:12:05.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 -- 172.21.15.173:0/1211845979 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x55e572a4b8f0 con 0x55e572bee9d0 2024-04-25T09:12:05.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7833e00640 1 -- 172.21.15.173:0/1211845979 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7840021030 con 0x55e572bee9d0 2024-04-25T09:12:05.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7833e00640 1 -- 172.21.15.173:0/1211845979 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 81) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7840039020 con 0x55e572bee9d0 2024-04-25T09:12:05.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 10 client.9084 fetch_fsmap finished waiting for FSMap version 81 2024-04-25T09:12:05.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 10 client.9084 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:12:05.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 20 client.9084 populate_metadata read hostname 'smithi173' 2024-04-25T09:12:05.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 --2- 172.21.15.173:0/1211845979 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55e572c01b70 0x55e572c01f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 4 client.9084 mds_command: new command op to 8775 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:12:05.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f785ca09000 1 -- 172.21.15.173:0/1211845979 --> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e5729ff530 con 0x55e572c01b70 2024-04-25T09:12:05.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.854+0000 7f7852a00640 1 --2- 172.21.15.173:0/1211845979 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55e572c01b70 0x55e572c01f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f7852a00640 1 --2- 172.21.15.173:0/1211845979 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55e572c01b70 0x55e572c01f80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf4a986ef793ae7e server_cookie=f53090d9ba2d3aa8 in_seq=0 out_seq=0 2024-04-25T09:12:05.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f7833e00640 10 client.9084 ms_handle_connect on v2:172.21.15.173:6835/671971539 2024-04-25T09:12:05.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f7833e00640 1 -- 172.21.15.173:0/1211845979 <== mds.0 v2:172.21.15.173:6835/671971539 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+69 (crc 0 0 0) 0x55e5729ff530 con 0x55e572c01b70 2024-04-25T09:12:05.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f7833e00640 10 client.9084 handle_command_reply: tid=0 2024-04-25T09:12:05.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f785ca09000 1 client.9084 shutdown 2024-04-25T09:12:05.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f785ca09000 1 -- 172.21.15.173:0/1211845979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 msgr2=0x55e572c4f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f785ca09000 1 --2- 172.21.15.173:0/1211845979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 0x55e572c4f4a0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f7840004710 tx=0x7f784001da90 comp rx=0 tx=0).stop 2024-04-25T09:12:05.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f785ca09000 1 -- 172.21.15.173:0/1211845979 shutdown_connections 2024-04-25T09:12:05.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f785ca09000 1 --2- 172.21.15.173:0/1211845979 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x55e572c01b70 0x55e572c01f80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f785ca09000 1 --2- 172.21.15.173:0/1211845979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e572bef2f0 0x55e572c00fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f785ca09000 1 --2- 172.21.15.173:0/1211845979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e572bee9d0 0x55e572c4f4a0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f7833e00640 0 client.9084 ms_handle_reset on v2:172.21.15.173:6835/671971539 2024-04-25T09:12:05.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f785ca09000 1 --2- 172.21.15.173:0/1211845979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e572ba50a0 0x55e572c4ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f785ca09000 1 -- 172.21.15.173:0/1211845979 >> 172.21.15.173:0/1211845979 conn(0x55e572ba1020 msgr2=0x55e572bed0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f785ca09000 1 -- 172.21.15.173:0/1211845979 shutdown_connections 2024-04-25T09:12:05.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f785ca09000 1 -- 172.21.15.173:0/1211845979 wait complete. 2024-04-25T09:12:05.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f785ca09000 20 client.9084 trim_cache size 0 max 16384 2024-04-25T09:12:05.846 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:12:05.846 INFO:teuthology.orchestra.run.smithi173.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-04-25T09:12:05.846 INFO:teuthology.orchestra.run.smithi173.stdout: "scrubs": {} 2024-04-25T09:12:05.846 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:12:05.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f7853e00640 1 -- 172.21.15.173:0/311214062 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7834066f90 msgr2=0x7f7834069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f7853e00640 1 --2- 172.21.15.173:0/311214062 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7834066f90 0x7f7834069450 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7844000f70 tx=0x7f7844007e90 comp rx=0 tx=0).stop 2024-04-25T09:12:05.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f7853e00640 1 -- 172.21.15.173:0/311214062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7854099a50 msgr2=0x7f7854151140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f7853e00640 1 --2- 172.21.15.173:0/311214062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7854099a50 0x7f7854151140 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f784c0b0040 tx=0x7f784c0196e0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f7853e00640 1 -- 172.21.15.173:0/311214062 shutdown_connections 2024-04-25T09:12:05.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f7853e00640 1 --2- 172.21.15.173:0/311214062 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7834066f90 0x7f7834069450 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f7853e00640 1 --2- 172.21.15.173:0/311214062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7854099a50 0x7f7854151140 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f7853e00640 1 --2- 172.21.15.173:0/311214062 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785406c220 0x7f785415b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f7853e00640 1 --2- 172.21.15.173:0/311214062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f785406bda0 0x7f78540b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f7853e00640 1 -- 172.21.15.173:0/311214062 >> 172.21.15.173:0/311214062 conn(0x7f78540b31d0 msgr2=0x7f7854155e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f7853e00640 1 -- 172.21.15.173:0/311214062 shutdown_connections 2024-04-25T09:12:05.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:05.858+0000 7f7853e00640 1 -- 172.21.15.173:0/311214062 wait complete. 2024-04-25T09:12:05.861 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:05.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.014+0000 7f510ba00640 1 Processor -- start 2024-04-25T09:12:05.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.014+0000 7f510ba00640 1 -- start start 2024-04-25T09:12:05.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.014+0000 7f510ba00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f510415df90 0x7f51040d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.014+0000 7f510ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f510406f830 0x7f510406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.014+0000 7f510ba00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f510406d870 con 0x7f510415dbb0 2024-04-25T09:12:05.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.014+0000 7f510ba00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510415e5c0 con 0x7f510415df90 2024-04-25T09:12:05.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.014+0000 7f510ba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510415e8a0 con 0x7f510406f830 2024-04-25T09:12:05.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.014+0000 7f5103e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f510415df90 0x7f51040d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.014+0000 7f5109000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f510415dbb0 0x7f510406c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38300/0 (socket says 172.21.15.173:38300) 2024-04-25T09:12:05.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.014+0000 7f5109000640 1 -- 172.21.15.173:0/3734543417 learned_addr learned my addr 172.21.15.173:0/3734543417 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:05.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.014+0000 7f5109a00640 1 --2- 172.21.15.173:0/3734543417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f510406f830 0x7f510406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.014+0000 7f5103e00640 1 -- 172.21.15.173:0/3734543417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f510406f830 msgr2=0x7f510406fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.014+0000 7f5103e00640 1 --2- 172.21.15.173:0/3734543417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f510406f830 0x7f510406fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.014+0000 7f5103e00640 1 -- 172.21.15.173:0/3734543417 >> v1:172.21.15.173:6789/0 conn(0x7f510415dbb0 legacy=0x7f510406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.014+0000 7f5103e00640 1 -- 172.21.15.173:0/3734543417 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5104161690 con 0x7f510415df90 2024-04-25T09:12:06.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.014+0000 7f5103400640 1 -- 172.21.15.173:0/3734543417 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952893695 0 0) 0x7f510406d870 con 0x7f510415dbb0 2024-04-25T09:12:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.018+0000 7f5103e00640 1 --2- 172.21.15.173:0/3734543417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f510415df90 0x7f51040d2130 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f50f00097c0 tx=0x7f50f001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7daa927b9c4594fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.018+0000 7f5103400640 1 -- 172.21.15.173:0/3734543417 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00b0070 con 0x7f510415df90 2024-04-25T09:12:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.018+0000 7f5103400640 1 -- 172.21.15.173:0/3734543417 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f00ab600 con 0x7f510415df90 2024-04-25T09:12:06.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.018+0000 7f5103400640 1 -- 172.21.15.173:0/3734543417 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00ab9d0 con 0x7f510415df90 2024-04-25T09:12:06.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.018+0000 7f510ba00640 1 -- 172.21.15.173:0/3734543417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f510415df90 msgr2=0x7f51040d2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.018+0000 7f510ba00640 1 --2- 172.21.15.173:0/3734543417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f510415df90 0x7f51040d2130 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f50f00097c0 tx=0x7f50f001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.018+0000 7f510ba00640 1 -- 172.21.15.173:0/3734543417 shutdown_connections 2024-04-25T09:12:06.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.018+0000 7f510ba00640 1 --2- 172.21.15.173:0/3734543417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f510406f830 0x7f510406fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.018+0000 7f510ba00640 1 --2- 172.21.15.173:0/3734543417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f510415df90 0x7f51040d2130 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.018+0000 7f510ba00640 1 -- 172.21.15.173:0/3734543417 >> 172.21.15.173:0/3734543417 conn(0x7f5104061880 msgr2=0x7f5104061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.018+0000 7f510ba00640 1 -- 172.21.15.173:0/3734543417 shutdown_connections 2024-04-25T09:12:06.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.018+0000 7f510ba00640 1 -- 172.21.15.173:0/3734543417 wait complete. 2024-04-25T09:12:06.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.018+0000 7f510ba00640 1 Processor -- start 2024-04-25T09:12:06.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f510ba00640 1 -- start start 2024-04-25T09:12:06.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f510ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f510406f830 0x7f5104154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f510ba00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f510415dbb0 0x7f51041545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f510ba00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f510415df90 0x7f51040ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f510ba00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510416ab10 con 0x7f510415dbb0 2024-04-25T09:12:06.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f510ba00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510416a990 con 0x7f510415df90 2024-04-25T09:12:06.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f510ba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510416ac90 con 0x7f510406f830 2024-04-25T09:12:06.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f5103e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f510415dbb0 0x7f51041545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f5103e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f510415dbb0 0x7f51041545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53282/0 (socket says 172.21.15.173:53282) 2024-04-25T09:12:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f5103e00640 1 -- 172.21.15.173:0/3932480733 learned_addr learned my addr 172.21.15.173:0/3932480733 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f5109a00640 1 --2- 172.21.15.173:0/3932480733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f510415df90 0x7f51040ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f5109000640 1 --2- 172.21.15.173:0/3932480733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f510406f830 0x7f5104154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f5103e00640 1 -- 172.21.15.173:0/3932480733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f510406f830 msgr2=0x7f5104154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f5103e00640 1 --2- 172.21.15.173:0/3932480733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f510406f830 0x7f5104154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f5103e00640 1 -- 172.21.15.173:0/3932480733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f510415df90 msgr2=0x7f51040ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f5103e00640 1 --2- 172.21.15.173:0/3932480733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f510415df90 0x7f51040ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f5103e00640 1 -- 172.21.15.173:0/3932480733 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5104154ae0 con 0x7f510415dbb0 2024-04-25T09:12:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f5109000640 1 --2- 172.21.15.173:0/3932480733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f510406f830 0x7f5104154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f5109a00640 1 --2- 172.21.15.173:0/3932480733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f510415df90 0x7f51040ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f5103e00640 1 --2- 172.21.15.173:0/3932480733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f510415dbb0 0x7f51041545a0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f50f001ab50 tx=0x7f50f0019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f5100c00640 1 -- 172.21.15.173:0/3932480733 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00b0040 con 0x7f510415dbb0 2024-04-25T09:12:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f5100c00640 1 -- 172.21.15.173:0/3932480733 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f00bb070 con 0x7f510415dbb0 2024-04-25T09:12:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f5100c00640 1 -- 172.21.15.173:0/3932480733 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00b6670 con 0x7f510415dbb0 2024-04-25T09:12:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f510ba00640 1 -- 172.21.15.173:0/3932480733 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51040cb3a0 con 0x7f510415dbb0 2024-04-25T09:12:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f510ba00640 1 -- 172.21.15.173:0/3932480733 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5104158da0 con 0x7f510415dbb0 2024-04-25T09:12:06.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.022+0000 7f510ba00640 1 -- 172.21.15.173:0/3932480733 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5104073a40 con 0x7f510415dbb0 2024-04-25T09:12:06.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.026+0000 7f5100c00640 1 -- 172.21.15.173:0/3932480733 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f50f00b3070 con 0x7f510415dbb0 2024-04-25T09:12:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.026+0000 7f5100c00640 1 --2- 172.21.15.173:0/3932480733 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f50e4066f60 0x7f50e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.026+0000 7f5100c00640 1 -- 172.21.15.173:0/3932480733 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f50f011ef90 con 0x7f510415dbb0 2024-04-25T09:12:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.026+0000 7f5109000640 1 --2- 172.21.15.173:0/3932480733 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f50e4066f60 0x7f50e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.026+0000 7f5109000640 1 --2- 172.21.15.173:0/3932480733 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f50e4066f60 0x7f50e4069420 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f50f4000f70 tx=0x7f50f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.030+0000 7f5100c00640 1 -- 172.21.15.173:0/3932480733 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f50f0016090 con 0x7f510415dbb0 2024-04-25T09:12:06.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.214+0000 7f510ba00640 1 -- 172.21.15.173:0/3932480733 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51040cf020 con 0x7f510415dbb0 2024-04-25T09:12:06.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.218+0000 7f5100c00640 1 -- 172.21.15.173:0/3932480733 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f50f00efd70 con 0x7f510415dbb0 2024-04-25T09:12:06.202 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:06.203 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1021410995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1021410995},{"type":"v1","addr":"172.21.15.194:6834","nonce":1021410995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2198134208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2198134208},{"type":"v1","addr":"172.21.15.194:6835","nonce":2198134208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8772,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/684989574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":684989574},{"type":"v1","addr":"172.21.15.173:6836","nonce":684989574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:26.148874+0000","modified":"2024-04-25T09:11:29.164422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8775":{"gid":8775,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/671971539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":671971539},{"type":"v1","addr":"172.21.15.173:6837","nonce":671971539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:12:06.204 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 81 2024-04-25T09:12:06.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.218+0000 7f510ba00640 1 -- 172.21.15.173:0/3932480733 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f50e4066f60 msgr2=0x7f50e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.218+0000 7f510ba00640 1 --2- 172.21.15.173:0/3932480733 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f50e4066f60 0x7f50e4069420 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f50f4000f70 tx=0x7f50f4009040 comp rx=0 tx=0).stop 2024-04-25T09:12:06.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.218+0000 7f510ba00640 1 -- 172.21.15.173:0/3932480733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f510415dbb0 msgr2=0x7f51041545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.218+0000 7f510ba00640 1 --2- 172.21.15.173:0/3932480733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f510415dbb0 0x7f51041545a0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f50f001ab50 tx=0x7f50f0019240 comp rx=0 tx=0).stop 2024-04-25T09:12:06.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.218+0000 7f510ba00640 1 -- 172.21.15.173:0/3932480733 shutdown_connections 2024-04-25T09:12:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.218+0000 7f510ba00640 1 --2- 172.21.15.173:0/3932480733 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f50e4066f60 0x7f50e4069420 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.218+0000 7f510ba00640 1 --2- 172.21.15.173:0/3932480733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f510415df90 0x7f51040ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.218+0000 7f510ba00640 1 --2- 172.21.15.173:0/3932480733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f510415dbb0 0x7f51041545a0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.218+0000 7f510ba00640 1 --2- 172.21.15.173:0/3932480733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f510406f830 0x7f5104154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.218+0000 7f510ba00640 1 -- 172.21.15.173:0/3932480733 >> 172.21.15.173:0/3932480733 conn(0x7f5104061880 msgr2=0x7f510406c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.218+0000 7f510ba00640 1 -- 172.21.15.173:0/3932480733 shutdown_connections 2024-04-25T09:12:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.218+0000 7f510ba00640 1 -- 172.21.15.173:0/3932480733 wait complete. 2024-04-25T09:12:06.222 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:12:06.222 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:12:06.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.370+0000 7fead6600640 1 Processor -- start 2024-04-25T09:12:06.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.370+0000 7fead6600640 1 -- start start 2024-04-25T09:12:06.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.374+0000 7fead6600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fead0147200 0x7fead00cf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.374+0000 7fead6600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fead0071460 0x7fead00718e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.374+0000 7fead6600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead015f080 con 0x7fead01475e0 2024-04-25T09:12:06.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.374+0000 7fead6600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead00cd080 con 0x7fead0071460 2024-04-25T09:12:06.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.374+0000 7fead6600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead00cd360 con 0x7fead0147200 2024-04-25T09:12:06.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.374+0000 7feacea00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fead01475e0 0x7fead015e970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38312/0 (socket says 172.21.15.173:38312) 2024-04-25T09:12:06.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.374+0000 7feacea00640 1 -- 172.21.15.173:0/3191939157 learned_addr learned my addr 172.21.15.173:0/3191939157 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:06.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.374+0000 7feacfe00640 1 --2- 172.21.15.173:0/3191939157 >> v2:172.21.15.194:3300/0 conn(0x7fead0071460 0x7fead00718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.374+0000 7feacf400640 1 --2- 172.21.15.173:0/3191939157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fead0147200 0x7fead00cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.374+0000 7feace000640 1 -- 172.21.15.173:0/3191939157 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5328035 0 0) 0x7fead015f080 con 0x7fead01475e0 2024-04-25T09:12:06.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.374+0000 7feace000640 1 -- 172.21.15.173:0/3191939157 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feab4003530 con 0x7fead01475e0 2024-04-25T09:12:06.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.374+0000 7feace000640 1 -- 172.21.15.173:0/3191939157 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 19018612 0 0) 0x7feab4003530 con 0x7fead01475e0 2024-04-25T09:12:06.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.374+0000 7feacfe00640 1 -- 172.21.15.173:0/3191939157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fead0147200 msgr2=0x7fead00cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.374+0000 7feacfe00640 1 --2- 172.21.15.173:0/3191939157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fead0147200 0x7fead00cf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.374+0000 7feacfe00640 1 -- 172.21.15.173:0/3191939157 >> v1:172.21.15.173:6789/0 conn(0x7fead01475e0 legacy=0x7fead015e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.374+0000 7feacfe00640 1 -- 172.21.15.173:0/3191939157 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead00cd640 con 0x7fead0071460 2024-04-25T09:12:06.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.378+0000 7feacfe00640 1 --2- 172.21.15.173:0/3191939157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fead0071460 0x7fead00718e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7feac80097c0 tx=0x7feac801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca99a7c031451dce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.378+0000 7feace000640 1 -- 172.21.15.173:0/3191939157 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac80b0070 con 0x7fead0071460 2024-04-25T09:12:06.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.378+0000 7feace000640 1 -- 172.21.15.173:0/3191939157 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac80ab400 con 0x7fead0071460 2024-04-25T09:12:06.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.378+0000 7feace000640 1 -- 172.21.15.173:0/3191939157 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc001680 con 0x7fead0071460 2024-04-25T09:12:06.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.378+0000 7fead6600640 1 -- 172.21.15.173:0/3191939157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fead0071460 msgr2=0x7fead00718e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.378+0000 7fead6600640 1 --2- 172.21.15.173:0/3191939157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fead0071460 0x7fead00718e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7feac80097c0 tx=0x7feac801c3c0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.378+0000 7fead6600640 1 -- 172.21.15.173:0/3191939157 shutdown_connections 2024-04-25T09:12:06.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.378+0000 7fead6600640 1 --2- 172.21.15.173:0/3191939157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fead0071460 0x7fead00718e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.378+0000 7fead6600640 1 --2- 172.21.15.173:0/3191939157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fead0147200 0x7fead00cf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.378+0000 7fead6600640 1 -- 172.21.15.173:0/3191939157 >> 172.21.15.173:0/3191939157 conn(0x7fead00b3460 msgr2=0x7fead00b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.378+0000 7fead6600640 1 -- 172.21.15.173:0/3191939157 shutdown_connections 2024-04-25T09:12:06.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.378+0000 7fead6600640 1 -- 172.21.15.173:0/3191939157 wait complete. 2024-04-25T09:12:06.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.378+0000 7fead6600640 1 Processor -- start 2024-04-25T09:12:06.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.378+0000 7fead6600640 1 -- start start 2024-04-25T09:12:06.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7fead6600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fead0071460 0x7fead00b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7fead6600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fead0147200 0x7fead015cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7fead6600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fead01475e0 0x7fead00cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7fead6600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead015e4c0 con 0x7fead01475e0 2024-04-25T09:12:06.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7fead6600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead015e340 con 0x7fead0147200 2024-04-25T09:12:06.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7fead6600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead00ce930 con 0x7fead0071460 2024-04-25T09:12:06.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7feacfe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fead01475e0 0x7fead00cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7feacfe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fead01475e0 0x7fead00cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53292/0 (socket says 172.21.15.173:53292) 2024-04-25T09:12:06.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7feacfe00640 1 -- 172.21.15.173:0/1852613737 learned_addr learned my addr 172.21.15.173:0/1852613737 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:06.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7feacf400640 1 --2- 172.21.15.173:0/1852613737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fead0071460 0x7fead00b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7feacea00640 1 --2- 172.21.15.173:0/1852613737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fead0147200 0x7fead015cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7feacfe00640 1 -- 172.21.15.173:0/1852613737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fead0071460 msgr2=0x7fead00b7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7feacfe00640 1 --2- 172.21.15.173:0/1852613737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fead0071460 0x7fead00b7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7feacfe00640 1 -- 172.21.15.173:0/1852613737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fead0147200 msgr2=0x7fead015cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7feacfe00640 1 --2- 172.21.15.173:0/1852613737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fead0147200 0x7fead015cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7feacfe00640 1 -- 172.21.15.173:0/1852613737 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead00d0d40 con 0x7fead01475e0 2024-04-25T09:12:06.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7feacfe00640 1 --2- 172.21.15.173:0/1852613737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fead01475e0 0x7fead00cfb00 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7feac80ae040 tx=0x7feac8019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7feac7400640 1 -- 172.21.15.173:0/1852613737 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac80b8020 con 0x7fead01475e0 2024-04-25T09:12:06.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7feac7400640 1 -- 172.21.15.173:0/1852613737 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac80b4410 con 0x7fead01475e0 2024-04-25T09:12:06.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7fead6600640 1 -- 172.21.15.173:0/1852613737 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead00b7590 con 0x7fead01475e0 2024-04-25T09:12:06.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7feac7400640 1 -- 172.21.15.173:0/1852613737 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac80b0040 con 0x7fead01475e0 2024-04-25T09:12:06.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7fead6600640 1 -- 172.21.15.173:0/1852613737 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead00d12c0 con 0x7fead01475e0 2024-04-25T09:12:06.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.382+0000 7fead6600640 1 -- 172.21.15.173:0/1852613737 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead0073a40 con 0x7fead01475e0 2024-04-25T09:12:06.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.386+0000 7feac7400640 1 -- 172.21.15.173:0/1852613737 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feac80bb020 con 0x7fead01475e0 2024-04-25T09:12:06.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.386+0000 7feac7400640 1 --2- 172.21.15.173:0/1852613737 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feab0066f60 0x7feab0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.386+0000 7feac7400640 1 -- 172.21.15.173:0/1852613737 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7feac811ece0 con 0x7fead01475e0 2024-04-25T09:12:06.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.386+0000 7feacf400640 1 --2- 172.21.15.173:0/1852613737 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feab0066f60 0x7feab0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.386+0000 7feacf400640 1 --2- 172.21.15.173:0/1852613737 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feab0066f60 0x7feab0069420 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7feac00074a0 tx=0x7feac000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.390+0000 7feac7400640 1 -- 172.21.15.173:0/1852613737 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feac80c2030 con 0x7fead01475e0 2024-04-25T09:12:06.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.598+0000 7fead6600640 1 -- 172.21.15.173:0/1852613737 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fead00b09d0 con 0x7fead01475e0 2024-04-25T09:12:06.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.598+0000 7feac7400640 1 -- 172.21.15.173:0/1852613737 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1598 (secure 0 0 0) 0x7feac8015fb0 con 0x7fead01475e0 2024-04-25T09:12:06.582 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:06.582 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":580,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":122,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076684781,"bytes_used":2598592512,"bytes_avail":770495520768,"bytes_total":773094113280,"write_bytes_sec":41965257,"read_op_per_sec":0,"write_op_per_sec":42},"fsmap":{"epoch":81,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8775}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-04-25T09:12:04.850163+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:12:06.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.598+0000 7fead6600640 1 -- 172.21.15.173:0/1852613737 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feab0066f60 msgr2=0x7feab0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.598+0000 7fead6600640 1 --2- 172.21.15.173:0/1852613737 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feab0066f60 0x7feab0069420 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7feac00074a0 tx=0x7feac000b040 comp rx=0 tx=0).stop 2024-04-25T09:12:06.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.598+0000 7fead6600640 1 -- 172.21.15.173:0/1852613737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fead01475e0 msgr2=0x7fead00cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.598+0000 7fead6600640 1 --2- 172.21.15.173:0/1852613737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fead01475e0 0x7fead00cfb00 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7feac80ae040 tx=0x7feac8019160 comp rx=0 tx=0).stop 2024-04-25T09:12:06.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.598+0000 7fead6600640 1 -- 172.21.15.173:0/1852613737 shutdown_connections 2024-04-25T09:12:06.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.598+0000 7fead6600640 1 --2- 172.21.15.173:0/1852613737 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feab0066f60 0x7feab0069420 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.598+0000 7fead6600640 1 --2- 172.21.15.173:0/1852613737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fead01475e0 0x7fead00cfb00 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.598+0000 7fead6600640 1 --2- 172.21.15.173:0/1852613737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fead0147200 0x7fead015cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.598+0000 7fead6600640 1 --2- 172.21.15.173:0/1852613737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fead0071460 0x7fead00b7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.598+0000 7fead6600640 1 -- 172.21.15.173:0/1852613737 >> 172.21.15.173:0/1852613737 conn(0x7fead00b3460 msgr2=0x7fead006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.598+0000 7fead6600640 1 -- 172.21.15.173:0/1852613737 shutdown_connections 2024-04-25T09:12:06.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.598+0000 7fead6600640 1 -- 172.21.15.173:0/1852613737 wait complete. 2024-04-25T09:12:06.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2024-04-25T09:12:06.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:06.603 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub resume 2024-04-25T09:12:06.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.754+0000 7f26bd600640 1 Processor -- start 2024-04-25T09:12:06.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.754+0000 7f26bd600640 1 -- start start 2024-04-25T09:12:06.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.758+0000 7f26bd600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f26b80aeb90 0x7f26b80cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.758+0000 7f26bd600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26b80ce2b0 0x7f26b80cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.758+0000 7f26bd600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b8071570 con 0x7f26b80aef70 2024-04-25T09:12:06.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.758+0000 7f26bd600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b8071320 con 0x7f26b80aeb90 2024-04-25T09:12:06.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.758+0000 7f26bd600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b8072330 con 0x7f26b80ce2b0 2024-04-25T09:12:06.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.758+0000 7f26b6000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f26b80aef70 0x7f26b80cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38320/0 (socket says 172.21.15.173:38320) 2024-04-25T09:12:06.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.758+0000 7f26b6000640 1 -- 172.21.15.173:0/170557344 learned_addr learned my addr 172.21.15.173:0/170557344 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:06.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.758+0000 7f26b7400640 1 --2- 172.21.15.173:0/170557344 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26b80ce2b0 0x7f26b80cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.758+0000 7f26b6a00640 1 --2- 172.21.15.173:0/170557344 >> v2:172.21.15.194:3300/0 conn(0x7f26b80aeb90 0x7f26b80cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.758+0000 7f26b5600640 1 -- 172.21.15.173:0/170557344 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265552847 0 0) 0x7f26b8071570 con 0x7f26b80aef70 2024-04-25T09:12:06.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.758+0000 7f26b5600640 1 -- 172.21.15.173:0/170557344 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f269c003530 con 0x7f26b80aef70 2024-04-25T09:12:06.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.758+0000 7f26b7400640 1 -- 172.21.15.173:0/170557344 >> v2:172.21.15.194:3300/0 conn(0x7f26b80aeb90 msgr2=0x7f26b80cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.758+0000 7f26b5600640 1 -- 172.21.15.173:0/170557344 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2933080264 0 0) 0x7f269c003530 con 0x7f26b80aef70 2024-04-25T09:12:06.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.758+0000 7f26b7400640 1 --2- 172.21.15.173:0/170557344 >> v2:172.21.15.194:3300/0 conn(0x7f26b80aeb90 0x7f26b80cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.758+0000 7f26b7400640 1 -- 172.21.15.173:0/170557344 >> v1:172.21.15.173:6789/0 conn(0x7f26b80aef70 legacy=0x7f26b80cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.758+0000 7f26b7400640 1 -- 172.21.15.173:0/170557344 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b8071850 con 0x7f26b80ce2b0 2024-04-25T09:12:06.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.758+0000 7f26b6a00640 1 --2- 172.21.15.173:0/170557344 >> v2:172.21.15.194:3300/0 conn(0x7f26b80aeb90 0x7f26b80cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:06.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.762+0000 7f26b7400640 1 --2- 172.21.15.173:0/170557344 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26b80ce2b0 0x7f26b80cc610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009d90 tx=0x7f26b001c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3ad356cb26b5011 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.762+0000 7f26b5600640 1 -- 172.21.15.173:0/170557344 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4001680 con 0x7f26b80ce2b0 2024-04-25T09:12:06.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.762+0000 7f26b5600640 1 -- 172.21.15.173:0/170557344 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b00a64e0 con 0x7f26b80ce2b0 2024-04-25T09:12:06.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.762+0000 7f26b5600640 1 -- 172.21.15.173:0/170557344 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b00a68b0 con 0x7f26b80ce2b0 2024-04-25T09:12:06.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.762+0000 7f26bd600640 1 -- 172.21.15.173:0/170557344 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26b80ce2b0 msgr2=0x7f26b80cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.762+0000 7f26bd600640 1 --2- 172.21.15.173:0/170557344 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26b80ce2b0 0x7f26b80cc610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009d90 tx=0x7f26b001c7d0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.762+0000 7f26bd600640 1 -- 172.21.15.173:0/170557344 shutdown_connections 2024-04-25T09:12:06.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.762+0000 7f26bd600640 1 --2- 172.21.15.173:0/170557344 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26b80ce2b0 0x7f26b80cc610 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.762+0000 7f26bd600640 1 --2- 172.21.15.173:0/170557344 >> v2:172.21.15.194:3300/0 conn(0x7f26b80aeb90 0x7f26b80cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.762+0000 7f26bd600640 1 -- 172.21.15.173:0/170557344 >> 172.21.15.173:0/170557344 conn(0x7f26b806ac90 msgr2=0x7f26b806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.762+0000 7f26bd600640 1 -- 172.21.15.173:0/170557344 shutdown_connections 2024-04-25T09:12:06.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.762+0000 7f26bd600640 1 -- 172.21.15.173:0/170557344 wait complete. 2024-04-25T09:12:06.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.762+0000 7f26bd600640 1 Processor -- start 2024-04-25T09:12:06.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.762+0000 7f26bd600640 1 -- start start 2024-04-25T09:12:06.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26bd600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26b80aeb90 0x7f26b8142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26bd600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b80aef70 0x7f26b80b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26bd600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26b80ce2b0 0x7f26b8157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26bd600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b80d02c0 con 0x7f26b80aef70 2024-04-25T09:12:06.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26bd600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b80d0140 con 0x7f26b80aeb90 2024-04-25T09:12:06.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26bd600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b80d0440 con 0x7f26b80ce2b0 2024-04-25T09:12:06.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26b6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b80aef70 0x7f26b80b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26b6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b80aef70 0x7f26b80b05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53296/0 (socket says 172.21.15.173:53296) 2024-04-25T09:12:06.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26b6000640 1 -- 172.21.15.173:0/2384230409 learned_addr learned my addr 172.21.15.173:0/2384230409 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:06.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26b6a00640 1 --2- 172.21.15.173:0/2384230409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26b80aeb90 0x7f26b8142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26b7400640 1 --2- 172.21.15.173:0/2384230409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26b80ce2b0 0x7f26b8157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26b6000640 1 -- 172.21.15.173:0/2384230409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26b80ce2b0 msgr2=0x7f26b8157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26b6000640 1 --2- 172.21.15.173:0/2384230409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26b80ce2b0 0x7f26b8157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26b6000640 1 -- 172.21.15.173:0/2384230409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26b80aeb90 msgr2=0x7f26b8142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26b6000640 1 --2- 172.21.15.173:0/2384230409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26b80aeb90 0x7f26b8142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26b6000640 1 -- 172.21.15.173:0/2384230409 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b8142d80 con 0x7f26b80aef70 2024-04-25T09:12:06.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26b6000640 1 --2- 172.21.15.173:0/2384230409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b80aef70 0x7f26b80b05a0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f26a400c780 tx=0x7f26a400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26aea00640 1 -- 172.21.15.173:0/2384230409 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4005ae0 con 0x7f26b80aef70 2024-04-25T09:12:06.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26aea00640 1 -- 172.21.15.173:0/2384230409 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a4005ca0 con 0x7f26b80aef70 2024-04-25T09:12:06.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26bd600640 1 -- 172.21.15.173:0/2384230409 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b8156c20 con 0x7f26b80aef70 2024-04-25T09:12:06.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26aea00640 1 -- 172.21.15.173:0/2384230409 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a40072b0 con 0x7f26b80aef70 2024-04-25T09:12:06.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.766+0000 7f26bd600640 1 -- 172.21.15.173:0/2384230409 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b81571e0 con 0x7f26b80aef70 2024-04-25T09:12:06.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.770+0000 7f26aea00640 1 -- 172.21.15.173:0/2384230409 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f26a4007450 con 0x7f26b80aef70 2024-04-25T09:12:06.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.770+0000 7f26aea00640 1 --2- 172.21.15.173:0/2384230409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2698066f60 0x7f2698069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.770+0000 7f26aea00640 1 -- 172.21.15.173:0/2384230409 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f26a4084fe0 con 0x7f26b80aef70 2024-04-25T09:12:06.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.770+0000 7f26b6a00640 1 --2- 172.21.15.173:0/2384230409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2698066f60 0x7f2698069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.770+0000 7f26c0abc000 1 Processor -- start 2024-04-25T09:12:06.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.770+0000 7f26c0abc000 1 -- start start 2024-04-25T09:12:06.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.770+0000 7f26b6a00640 1 --2- 172.21.15.173:0/2384230409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2698066f60 0x7f2698069420 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f26b8143ba0 tx=0x7f26a800d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.770+0000 7f26c0abc000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 0x5639149cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.770+0000 7f26c0abc000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149ce2f0 0x563914983b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.770+0000 7f26c0abc000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149840a0 0x563914984480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.770+0000 7f26c0abc000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639147d0ff0 con 0x5639149cd9d0 2024-04-25T09:12:06.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.770+0000 7f26c0abc000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x563914759150 con 0x5639149ce2f0 2024-04-25T09:12:06.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.770+0000 7f26c0abc000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639147cd090 con 0x5639149840a0 2024-04-25T09:12:06.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.770+0000 7f26b6a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 0x5639149cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.770+0000 7f26b6a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 0x5639149cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53302/0 (socket says 172.21.15.173:53302) 2024-04-25T09:12:06.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.770+0000 7f26b6a00640 1 -- 172.21.15.173:0/1262296723 learned_addr learned my addr 172.21.15.173:0/1262296723 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:06.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26b6000640 1 --2- 172.21.15.173:0/1262296723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149ce2f0 0x563914983b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26b7400640 1 --2- 172.21.15.173:0/1262296723 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149840a0 0x563914984480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26b6a00640 1 -- 172.21.15.173:0/1262296723 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149840a0 msgr2=0x563914984480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26b6a00640 1 --2- 172.21.15.173:0/1262296723 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149840a0 0x563914984480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26b6a00640 1 -- 172.21.15.173:0/1262296723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149ce2f0 msgr2=0x563914983b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26b6a00640 1 --2- 172.21.15.173:0/1262296723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149ce2f0 0x563914983b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26b6a00640 1 -- 172.21.15.173:0/1262296723 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639149670d0 con 0x5639149cd9d0 2024-04-25T09:12:06.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26b6a00640 1 --2- 172.21.15.173:0/1262296723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 0x5639149cddb0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f26a8004390 tx=0x7f26a8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558b93fc27141930 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26a3400640 1 -- 172.21.15.173:0/1262296723 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a8029070 con 0x5639149cd9d0 2024-04-25T09:12:06.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26a3400640 1 -- 172.21.15.173:0/1262296723 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a8019850 con 0x5639149cd9d0 2024-04-25T09:12:06.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26a3400640 1 -- 172.21.15.173:0/1262296723 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a8019c40 con 0x5639149cd9d0 2024-04-25T09:12:06.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26c0abc000 1 -- 172.21.15.173:0/1262296723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 msgr2=0x5639149cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26c0abc000 1 --2- 172.21.15.173:0/1262296723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 0x5639149cddb0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f26a8004390 tx=0x7f26a8016000 comp rx=0 tx=0).stop 2024-04-25T09:12:06.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26c0abc000 1 -- 172.21.15.173:0/1262296723 shutdown_connections 2024-04-25T09:12:06.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26c0abc000 1 --2- 172.21.15.173:0/1262296723 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149840a0 0x563914984480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26c0abc000 1 --2- 172.21.15.173:0/1262296723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149ce2f0 0x563914983b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26c0abc000 1 --2- 172.21.15.173:0/1262296723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 0x5639149cddb0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26c0abc000 1 -- 172.21.15.173:0/1262296723 >> 172.21.15.173:0/1262296723 conn(0x563914980020 msgr2=0x563914982440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26c0abc000 1 -- 172.21.15.173:0/1262296723 shutdown_connections 2024-04-25T09:12:06.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26c0abc000 1 -- 172.21.15.173:0/1262296723 wait complete. 2024-04-25T09:12:06.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26c0abc000 1 -- start start 2024-04-25T09:12:06.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26c0abc000 1 Processor -- start 2024-04-25T09:12:06.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26c0abc000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149840a0 0x5639149d9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26c0abc000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 0x5639149d96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26c0abc000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149ce2f0 0x5639149b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26c0abc000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x563914795250 con 0x5639149cd9d0 2024-04-25T09:12:06.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26c0abc000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56391478b690 con 0x5639149ce2f0 2024-04-25T09:12:06.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26c0abc000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x563914759a40 con 0x5639149840a0 2024-04-25T09:12:06.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26c0abc000 10 client.0 _ll_register_callbacks cb 0x56391496ee90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:06.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26b6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 0x5639149d96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26b6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 0x5639149d96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53308/0 (socket says 172.21.15.173:53308) 2024-04-25T09:12:06.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26b6000640 1 -- 172.21.15.173:0/3911284221 learned_addr learned my addr 172.21.15.173:0/3911284221 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:06.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26b6000640 1 -- 172.21.15.173:0/3911284221 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149840a0 msgr2=0x5639149d9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26b6000640 1 --2- 172.21.15.173:0/3911284221 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149840a0 0x5639149d9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26b6000640 1 -- 172.21.15.173:0/3911284221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149ce2f0 msgr2=0x5639149b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26b6000640 1 --2- 172.21.15.173:0/3911284221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149ce2f0 0x5639149b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.774+0000 7f26b6000640 1 -- 172.21.15.173:0/3911284221 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56391487e1c0 con 0x5639149cd9d0 2024-04-25T09:12:06.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26b6000640 1 --2- 172.21.15.173:0/3911284221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 0x5639149d96d0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f26a4055420 tx=0x7f26a4059920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5777e839247fed71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f2697e00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:12:06.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f2697e00640 1 -- 172.21.15.173:0/3911284221 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4053b30 con 0x5639149cd9d0 2024-04-25T09:12:06.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f2697e00640 1 -- 172.21.15.173:0/3911284221 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f26a405db50 con 0x5639149cd9d0 2024-04-25T09:12:06.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 1 -- 172.21.15.173:0/3911284221 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f26a8019850 con 0x5639149cd9d0 2024-04-25T09:12:06.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f2697e00640 1 -- 172.21.15.173:0/3911284221 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26a4054bc0 con 0x5639149cd9d0 2024-04-25T09:12:06.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 10 client.9111 fetch_fsmap learned FSMap version 81 2024-04-25T09:12:06.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 1 -- 172.21.15.173:0/3911284221 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x56391487a170 con 0x5639149cd9d0 2024-04-25T09:12:06.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f2697e00640 1 -- 172.21.15.173:0/3911284221 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a8019850 con 0x5639149cd9d0 2024-04-25T09:12:06.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f2697e00640 1 -- 172.21.15.173:0/3911284221 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 81) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f26a4054d60 con 0x5639149cd9d0 2024-04-25T09:12:06.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 10 client.9111 fetch_fsmap finished waiting for FSMap version 81 2024-04-25T09:12:06.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 10 client.9111 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:12:06.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 20 client.9111 populate_metadata read hostname 'smithi173' 2024-04-25T09:12:06.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 1 --2- 172.21.15.173:0/3911284221 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x5639149b6d90 0x5639149b7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 4 client.9111 mds_command: new command op to 8775 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:12:06.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 1 -- 172.21.15.173:0/3911284221 --> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56391476cc60 con 0x5639149b6d90 2024-04-25T09:12:06.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26b6a00640 1 --2- 172.21.15.173:0/3911284221 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x5639149b6d90 0x5639149b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26b6a00640 1 --2- 172.21.15.173:0/3911284221 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x5639149b6d90 0x5639149b7170 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15f48a5e7b7eb2fd server_cookie=1089baa3c2523206 in_seq=0 out_seq=0 2024-04-25T09:12:06.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f2697e00640 10 client.9111 ms_handle_connect on v2:172.21.15.173:6835/671971539 2024-04-25T09:12:06.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f2697e00640 1 -- 172.21.15.173:0/3911284221 <== mds.0 v2:172.21.15.173:6835/671971539 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56391476cc60 con 0x5639149b6d90 2024-04-25T09:12:06.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f2697e00640 10 client.9111 handle_command_reply: tid=0 2024-04-25T09:12:06.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 1 client.9111 shutdown 2024-04-25T09:12:06.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 1 -- 172.21.15.173:0/3911284221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 msgr2=0x5639149d96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 1 --2- 172.21.15.173:0/3911284221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 0x5639149d96d0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f26a4055420 tx=0x7f26a4059920 comp rx=0 tx=0).stop 2024-04-25T09:12:06.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 1 -- 172.21.15.173:0/3911284221 shutdown_connections 2024-04-25T09:12:06.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 1 --2- 172.21.15.173:0/3911284221 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x5639149b6d90 0x5639149b7170 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 1 --2- 172.21.15.173:0/3911284221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149ce2f0 0x5639149b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 1 --2- 172.21.15.173:0/3911284221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 0x5639149d96d0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f2697e00640 0 client.9111 ms_handle_reset on v2:172.21.15.173:6835/671971539 2024-04-25T09:12:06.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 1 --2- 172.21.15.173:0/3911284221 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149840a0 0x5639149d9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 1 -- 172.21.15.173:0/3911284221 >> 172.21.15.173:0/3911284221 conn(0x563914980020 msgr2=0x563914982ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 1 -- 172.21.15.173:0/3911284221 shutdown_connections 2024-04-25T09:12:06.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 1 -- 172.21.15.173:0/3911284221 wait complete. 2024-04-25T09:12:06.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.778+0000 7f26c0abc000 20 client.9111 trim_cache size 0 max 16384 2024-04-25T09:12:06.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.794+0000 7f26c0abc000 1 Processor -- start 2024-04-25T09:12:06.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.794+0000 7f26c0abc000 1 -- start start 2024-04-25T09:12:06.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26c0abc000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149840a0 0x5639149b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26c0abc000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 0x5639149e8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26c0abc000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149ce2f0 0x5639149b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26c0abc000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b81fecb0 con 0x5639149cd9d0 2024-04-25T09:12:06.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26c0abc000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b81fdec0 con 0x5639149ce2f0 2024-04-25T09:12:06.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26c0abc000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b8155f50 con 0x5639149840a0 2024-04-25T09:12:06.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26b6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 0x5639149e8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26b7400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149ce2f0 0x5639149b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26b6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 0x5639149e8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53316/0 (socket says 172.21.15.173:53316) 2024-04-25T09:12:06.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26b6a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149840a0 0x5639149b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26b6000640 1 -- 172.21.15.173:0/3684689584 learned_addr learned my addr 172.21.15.173:0/3684689584 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:06.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26b6000640 1 -- 172.21.15.173:0/3684689584 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149840a0 msgr2=0x5639149b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26b6000640 1 --2- 172.21.15.173:0/3684689584 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149840a0 0x5639149b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26b6000640 1 -- 172.21.15.173:0/3684689584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149ce2f0 msgr2=0x5639149b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26b6000640 1 --2- 172.21.15.173:0/3684689584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149ce2f0 0x5639149b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26b6000640 1 -- 172.21.15.173:0/3684689584 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563914817de0 con 0x5639149cd9d0 2024-04-25T09:12:06.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26b6000640 1 --2- 172.21.15.173:0/3684689584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 0x5639149e8340 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f26a4055470 tx=0x7f26a406a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fc03652497af29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26a2a00640 1 -- 172.21.15.173:0/3684689584 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4053b30 con 0x5639149cd9d0 2024-04-25T09:12:06.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26a2a00640 1 -- 172.21.15.173:0/3684689584 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a4081070 con 0x5639149cd9d0 2024-04-25T09:12:06.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26a2a00640 1 -- 172.21.15.173:0/3684689584 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4054d60 con 0x5639149cd9d0 2024-04-25T09:12:06.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26c0abc000 1 -- 172.21.15.173:0/3684689584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 msgr2=0x5639149e8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26c0abc000 1 --2- 172.21.15.173:0/3684689584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 0x5639149e8340 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f26a4055470 tx=0x7f26a406a000 comp rx=0 tx=0).stop 2024-04-25T09:12:06.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26c0abc000 1 -- 172.21.15.173:0/3684689584 shutdown_connections 2024-04-25T09:12:06.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26c0abc000 1 --2- 172.21.15.173:0/3684689584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149ce2f0 0x5639149b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26c0abc000 1 --2- 172.21.15.173:0/3684689584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149cd9d0 0x5639149e8340 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26c0abc000 1 --2- 172.21.15.173:0/3684689584 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149840a0 0x5639149b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26c0abc000 1 -- 172.21.15.173:0/3684689584 >> 172.21.15.173:0/3684689584 conn(0x563914980020 msgr2=0x5639149b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26c0abc000 1 -- 172.21.15.173:0/3684689584 shutdown_connections 2024-04-25T09:12:06.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26c0abc000 1 -- 172.21.15.173:0/3684689584 wait complete. 2024-04-25T09:12:06.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26c0abc000 1 -- start start 2024-04-25T09:12:06.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.798+0000 7f26c0abc000 1 Processor -- start 2024-04-25T09:12:06.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26c0abc000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149840a0 0x5639149b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26c0abc000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149cd9d0 0x5639149e5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26c0abc000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149ce2f0 0x5639149e5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26c0abc000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56391476be00 con 0x5639149ce2f0 2024-04-25T09:12:06.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26c0abc000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b81fd990 con 0x5639149840a0 2024-04-25T09:12:06.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26c0abc000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639147d0300 con 0x5639149cd9d0 2024-04-25T09:12:06.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26c0abc000 10 client.0 _ll_register_callbacks cb 0x56391494f040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:06.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26b7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149ce2f0 0x5639149e5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26b6a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149840a0 0x5639149b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26b6000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149cd9d0 0x5639149e5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26b7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149ce2f0 0x5639149e5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53332/0 (socket says 172.21.15.173:53332) 2024-04-25T09:12:06.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26b6a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149840a0 0x5639149b5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:33158/0 (socket says 172.21.15.173:33158) 2024-04-25T09:12:06.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26b7400640 1 -- 172.21.15.173:0/2137485835 learned_addr learned my addr 172.21.15.173:0/2137485835 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:06.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26b7400640 1 -- 172.21.15.173:0/2137485835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149cd9d0 msgr2=0x5639149e5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26b7400640 1 --2- 172.21.15.173:0/2137485835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149cd9d0 0x5639149e5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26b7400640 1 -- 172.21.15.173:0/2137485835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149840a0 msgr2=0x5639149b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26b7400640 1 --2- 172.21.15.173:0/2137485835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149840a0 0x5639149b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26b7400640 1 -- 172.21.15.173:0/2137485835 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5639147728e0 con 0x5639149ce2f0 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26b7400640 1 --2- 172.21.15.173:0/2137485835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149ce2f0 0x5639149e5890 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009d90 tx=0x7f26b001b010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638f16da000fd762 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f2697e00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f2697e00640 1 -- 172.21.15.173:0/2137485835 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b0009450 con 0x5639149ce2f0 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f2697e00640 1 -- 172.21.15.173:0/2137485835 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f26b00a6d00 con 0x5639149ce2f0 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26c0abc000 1 -- 172.21.15.173:0/2137485835 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f26a4081070 con 0x5639149ce2f0 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f2697e00640 1 -- 172.21.15.173:0/2137485835 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26b00ae420 con 0x5639149ce2f0 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26c0abc000 10 client.9117 fetch_fsmap learned FSMap version 81 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26c0abc000 1 -- 172.21.15.173:0/2137485835 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x56391482a8f0 con 0x5639149ce2f0 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f2697e00640 1 -- 172.21.15.173:0/2137485835 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a4081070 con 0x5639149ce2f0 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f2697e00640 1 -- 172.21.15.173:0/2137485835 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 81) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f26b00d4080 con 0x5639149ce2f0 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26c0abc000 10 client.9117 fetch_fsmap finished waiting for FSMap version 81 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26c0abc000 10 client.9117 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:12:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26c0abc000 20 client.9117 populate_metadata read hostname 'smithi173' 2024-04-25T09:12:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26c0abc000 1 --2- 172.21.15.173:0/2137485835 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x563914a31c60 0x563914a32040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26c0abc000 4 client.9117 mds_command: new command op to 8775 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-04-25T09:12:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26c0abc000 1 -- 172.21.15.173:0/2137485835 --> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x5639147de530 con 0x563914a31c60 2024-04-25T09:12:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26b6a00640 1 --2- 172.21.15.173:0/2137485835 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x563914a31c60 0x563914a32040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f26b6a00640 1 --2- 172.21.15.173:0/2137485835 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x563914a31c60 0x563914a32040 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56f00d91f85701fa server_cookie=763c42a683883927 in_seq=0 out_seq=0 2024-04-25T09:12:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.802+0000 7f2697e00640 10 client.9117 ms_handle_connect on v2:172.21.15.173:6835/671971539 2024-04-25T09:12:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f2697e00640 1 -- 172.21.15.173:0/2137485835 <== mds.0 v2:172.21.15.173:6835/671971539 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x5639147de530 con 0x563914a31c60 2024-04-25T09:12:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f2697e00640 10 client.9117 handle_command_reply: tid=0 2024-04-25T09:12:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26c0abc000 1 client.9117 shutdown 2024-04-25T09:12:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26c0abc000 1 -- 172.21.15.173:0/2137485835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149ce2f0 msgr2=0x5639149e5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26c0abc000 1 --2- 172.21.15.173:0/2137485835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149ce2f0 0x5639149e5890 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009d90 tx=0x7f26b001b010 comp rx=0 tx=0).stop 2024-04-25T09:12:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26c0abc000 1 -- 172.21.15.173:0/2137485835 shutdown_connections 2024-04-25T09:12:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26c0abc000 1 --2- 172.21.15.173:0/2137485835 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x563914a31c60 0x563914a32040 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26c0abc000 1 --2- 172.21.15.173:0/2137485835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5639149ce2f0 0x5639149e5890 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26c0abc000 1 --2- 172.21.15.173:0/2137485835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5639149cd9d0 0x5639149e5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26c0abc000 1 --2- 172.21.15.173:0/2137485835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639149840a0 0x5639149b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f2697e00640 0 client.9117 ms_handle_reset on v2:172.21.15.173:6835/671971539 2024-04-25T09:12:06.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26c0abc000 1 -- 172.21.15.173:0/2137485835 >> 172.21.15.173:0/2137485835 conn(0x563914980020 msgr2=0x5639149b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26c0abc000 1 -- 172.21.15.173:0/2137485835 shutdown_connections 2024-04-25T09:12:06.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26c0abc000 1 -- 172.21.15.173:0/2137485835 wait complete. 2024-04-25T09:12:06.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26c0abc000 20 client.9117 trim_cache size 0 max 16384 2024-04-25T09:12:06.794 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:12:06.794 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0 2024-04-25T09:12:06.794 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:12:06.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26bd600640 1 -- 172.21.15.173:0/2384230409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2698066f60 msgr2=0x7f2698069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26bd600640 1 --2- 172.21.15.173:0/2384230409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2698066f60 0x7f2698069420 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f26b8143ba0 tx=0x7f26a800d040 comp rx=0 tx=0).stop 2024-04-25T09:12:06.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26bd600640 1 -- 172.21.15.173:0/2384230409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b80aef70 msgr2=0x7f26b80b05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26bd600640 1 --2- 172.21.15.173:0/2384230409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b80aef70 0x7f26b80b05a0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f26a400c780 tx=0x7f26a400cc40 comp rx=0 tx=0).stop 2024-04-25T09:12:06.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26bd600640 1 -- 172.21.15.173:0/2384230409 shutdown_connections 2024-04-25T09:12:06.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26bd600640 1 --2- 172.21.15.173:0/2384230409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2698066f60 0x7f2698069420 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26bd600640 1 --2- 172.21.15.173:0/2384230409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26b80ce2b0 0x7f26b8157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26bd600640 1 --2- 172.21.15.173:0/2384230409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b80aef70 0x7f26b80b05a0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26bd600640 1 --2- 172.21.15.173:0/2384230409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26b80aeb90 0x7f26b8142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26bd600640 1 -- 172.21.15.173:0/2384230409 >> 172.21.15.173:0/2384230409 conn(0x7f26b806ac90 msgr2=0x7f26b806b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26bd600640 1 -- 172.21.15.173:0/2384230409 shutdown_connections 2024-04-25T09:12:06.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.806+0000 7f26bd600640 1 -- 172.21.15.173:0/2384230409 wait complete. 2024-04-25T09:12:06.809 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T09:12:06.809 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-04-25T09:12:06.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.962+0000 7f977a400640 1 Processor -- start 2024-04-25T09:12:06.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.962+0000 7f977a400640 1 -- start start 2024-04-25T09:12:06.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.966+0000 7f977a400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97740aeb90 0x7f97740cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.966+0000 7f977a400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9774071570 con 0x7f97740ce2b0 2024-04-25T09:12:06.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.966+0000 7f977a400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9774071850 con 0x7f97740aef70 2024-04-25T09:12:06.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.966+0000 7f977a400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9774071320 con 0x7f97740aeb90 2024-04-25T09:12:06.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.966+0000 7f9773e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f97740ce2b0 0x7f977415af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38324/0 (socket says 172.21.15.173:38324) 2024-04-25T09:12:06.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.966+0000 7f9773e00640 1 -- 172.21.15.173:0/1472465459 learned_addr learned my addr 172.21.15.173:0/1472465459 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:06.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.966+0000 7f9773400640 1 --2- 172.21.15.173:0/1472465459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97740aeb90 0x7f97740cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.966+0000 7f9772a00640 1 -- 172.21.15.173:0/1472465459 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350775960 0 0) 0x7f9774071570 con 0x7f97740ce2b0 2024-04-25T09:12:06.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.966+0000 7f9772a00640 1 -- 172.21.15.173:0/1472465459 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9758003530 con 0x7f97740ce2b0 2024-04-25T09:12:06.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.966+0000 7f9772a00640 1 -- 172.21.15.173:0/1472465459 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3468794719 0 0) 0x7f9774071850 con 0x7f97740aef70 2024-04-25T09:12:06.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.966+0000 7f9772a00640 1 -- 172.21.15.173:0/1472465459 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9774071570 con 0x7f97740aef70 2024-04-25T09:12:06.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.966+0000 7f9773400640 1 -- 172.21.15.173:0/1472465459 >> v1:172.21.15.194:6789/0 conn(0x7f97740aef70 legacy=0x7f97740cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.966+0000 7f9773400640 1 -- 172.21.15.173:0/1472465459 >> v1:172.21.15.173:6789/0 conn(0x7f97740ce2b0 legacy=0x7f977415af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.966+0000 7f9773400640 1 -- 172.21.15.173:0/1472465459 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9774071b30 con 0x7f97740aeb90 2024-04-25T09:12:06.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.970+0000 7f9773400640 1 --2- 172.21.15.173:0/1472465459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97740aeb90 0x7f97740cc0d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9764009dc0 tx=0x7f976401c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de5be9bdcf313f7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.970+0000 7f9772a00640 1 -- 172.21.15.173:0/1472465459 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640b2070 con 0x7f97740aeb90 2024-04-25T09:12:06.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.970+0000 7f9772a00640 1 -- 172.21.15.173:0/1472465459 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97640a57c0 con 0x7f97740aeb90 2024-04-25T09:12:06.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.970+0000 7f9772a00640 1 -- 172.21.15.173:0/1472465459 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640a5b90 con 0x7f97740aeb90 2024-04-25T09:12:06.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.970+0000 7f977a400640 1 -- 172.21.15.173:0/1472465459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97740aeb90 msgr2=0x7f97740cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.970+0000 7f977a400640 1 --2- 172.21.15.173:0/1472465459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97740aeb90 0x7f97740cc0d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9764009dc0 tx=0x7f976401c900 comp rx=0 tx=0).stop 2024-04-25T09:12:06.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.970+0000 7f977a400640 1 -- 172.21.15.173:0/1472465459 shutdown_connections 2024-04-25T09:12:06.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.970+0000 7f977a400640 1 --2- 172.21.15.173:0/1472465459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97740aeb90 0x7f97740cc0d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.970+0000 7f977a400640 1 -- 172.21.15.173:0/1472465459 >> 172.21.15.173:0/1472465459 conn(0x7f977406ac90 msgr2=0x7f977406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.970+0000 7f977a400640 1 -- 172.21.15.173:0/1472465459 shutdown_connections 2024-04-25T09:12:06.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.970+0000 7f977a400640 1 -- 172.21.15.173:0/1472465459 wait complete. 2024-04-25T09:12:06.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.970+0000 7f977a400640 1 Processor -- start 2024-04-25T09:12:06.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.970+0000 7f977a400640 1 -- start start 2024-04-25T09:12:06.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f977a400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97740aeb90 0x7f97740b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f977a400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97740aef70 0x7f9774140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f977a400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97740ce2b0 0x7f9774140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f977a400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9774168ac0 con 0x7f97740aeb90 2024-04-25T09:12:06.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f977a400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9774168940 con 0x7f97740aef70 2024-04-25T09:12:06.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f977a400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9774168c40 con 0x7f97740ce2b0 2024-04-25T09:12:06.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f9773400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97740aeb90 0x7f97740b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f9773400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97740aeb90 0x7f97740b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53342/0 (socket says 172.21.15.173:53342) 2024-04-25T09:12:06.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f9773400640 1 -- 172.21.15.173:0/3392311848 learned_addr learned my addr 172.21.15.173:0/3392311848 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:06.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f976aa00640 1 --2- 172.21.15.173:0/3392311848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97740aef70 0x7f9774140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f9773e00640 1 --2- 172.21.15.173:0/3392311848 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97740ce2b0 0x7f9774140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f9773400640 1 -- 172.21.15.173:0/3392311848 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97740ce2b0 msgr2=0x7f9774140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f9773400640 1 --2- 172.21.15.173:0/3392311848 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97740ce2b0 0x7f9774140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f9773400640 1 -- 172.21.15.173:0/3392311848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97740aef70 msgr2=0x7f9774140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f9773400640 1 --2- 172.21.15.173:0/3392311848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97740aef70 0x7f9774140870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f9773400640 1 -- 172.21.15.173:0/3392311848 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97740adb30 con 0x7f97740aeb90 2024-04-25T09:12:06.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f9773400640 1 --2- 172.21.15.173:0/3392311848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97740aeb90 0x7f97740b02f0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f97640b0040 tx=0x7f97640196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f976be00640 1 -- 172.21.15.173:0/3392311848 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640bd020 con 0x7f97740aeb90 2024-04-25T09:12:06.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f976be00640 1 -- 172.21.15.173:0/3392311848 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97640b8470 con 0x7f97740aeb90 2024-04-25T09:12:06.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f977a400640 1 -- 172.21.15.173:0/3392311848 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97740ade10 con 0x7f97740aeb90 2024-04-25T09:12:06.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f976be00640 1 -- 172.21.15.173:0/3392311848 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640b2040 con 0x7f97740aeb90 2024-04-25T09:12:06.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f977a400640 1 -- 172.21.15.173:0/3392311848 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97741591b0 con 0x7f97740aeb90 2024-04-25T09:12:06.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.974+0000 7f976be00640 1 -- 172.21.15.173:0/3392311848 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f97640c0020 con 0x7f97740aeb90 2024-04-25T09:12:06.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f976be00640 1 --2- 172.21.15.173:0/3392311848 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9750066f60 0x7f9750069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f976be00640 1 -- 172.21.15.173:0/3392311848 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f976411fea0 con 0x7f97740aeb90 2024-04-25T09:12:06.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f976aa00640 1 --2- 172.21.15.173:0/3392311848 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9750066f60 0x7f9750069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f977d8bd000 1 Processor -- start 2024-04-25T09:12:06.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f977d8bd000 1 -- start start 2024-04-25T09:12:06.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f976aa00640 1 --2- 172.21.15.173:0/3392311848 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9750066f60 0x7f9750069420 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9774144bd0 tx=0x7f975c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f977d8bd000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3c9d0 0x556202b3cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f977d8bd000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202b3d2f0 0x556202af2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f977d8bd000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202af30a0 0x556202af3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f977d8bd000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55620293fff0 con 0x556202b3c9d0 2024-04-25T09:12:06.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f977d8bd000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562028c8150 con 0x556202b3d2f0 2024-04-25T09:12:06.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f977d8bd000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55620293c090 con 0x556202af30a0 2024-04-25T09:12:06.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f9773400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3c9d0 0x556202b3cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f9773400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3c9d0 0x556202b3cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53344/0 (socket says 172.21.15.173:53344) 2024-04-25T09:12:06.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f9773400640 1 -- 172.21.15.173:0/2399478858 learned_addr learned my addr 172.21.15.173:0/2399478858 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:06.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f9773400640 1 -- 172.21.15.173:0/2399478858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202af30a0 msgr2=0x556202af3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f9773400640 1 --2- 172.21.15.173:0/2399478858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202af30a0 0x556202af3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f976aa00640 1 --2- 172.21.15.173:0/2399478858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202b3d2f0 0x556202af2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f9773400640 1 -- 172.21.15.173:0/2399478858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202b3d2f0 msgr2=0x556202af2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f9773400640 1 --2- 172.21.15.173:0/2399478858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202b3d2f0 0x556202af2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f9773400640 1 -- 172.21.15.173:0/2399478858 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556202ad60d0 con 0x556202b3c9d0 2024-04-25T09:12:06.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f976aa00640 1 --2- 172.21.15.173:0/2399478858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202b3d2f0 0x556202af2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:06.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f9773400640 1 --2- 172.21.15.173:0/2399478858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3c9d0 0x556202b3cdb0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f97640f0340 tx=0x7f9764009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1e30ae51a4b5b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f9763e00640 1 -- 172.21.15.173:0/2399478858 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640f8ca0 con 0x556202b3c9d0 2024-04-25T09:12:06.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f9763e00640 1 -- 172.21.15.173:0/2399478858 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97640ee940 con 0x556202b3c9d0 2024-04-25T09:12:06.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f9763e00640 1 -- 172.21.15.173:0/2399478858 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640f08a0 con 0x556202b3c9d0 2024-04-25T09:12:06.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f977d8bd000 1 -- 172.21.15.173:0/2399478858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3c9d0 msgr2=0x556202b3cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f977d8bd000 1 --2- 172.21.15.173:0/2399478858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3c9d0 0x556202b3cdb0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f97640f0340 tx=0x7f9764009450 comp rx=0 tx=0).stop 2024-04-25T09:12:06.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f977d8bd000 1 -- 172.21.15.173:0/2399478858 shutdown_connections 2024-04-25T09:12:06.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f977d8bd000 1 --2- 172.21.15.173:0/2399478858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202af30a0 0x556202af3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f977d8bd000 1 --2- 172.21.15.173:0/2399478858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202b3d2f0 0x556202af2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f977d8bd000 1 --2- 172.21.15.173:0/2399478858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3c9d0 0x556202b3cdb0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f977d8bd000 1 -- 172.21.15.173:0/2399478858 >> 172.21.15.173:0/2399478858 conn(0x556202aef020 msgr2=0x556202af1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f977d8bd000 1 -- 172.21.15.173:0/2399478858 shutdown_connections 2024-04-25T09:12:06.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.978+0000 7f977d8bd000 1 -- 172.21.15.173:0/2399478858 wait complete. 2024-04-25T09:12:06.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f977d8bd000 1 -- start start 2024-04-25T09:12:06.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f977d8bd000 1 Processor -- start 2024-04-25T09:12:06.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f977d8bd000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202af30a0 0x556202b217f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f977d8bd000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3c9d0 0x556202b21d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f977d8bd000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202b3d2f0 0x556202b22270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f977d8bd000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x556202904250 con 0x556202b3c9d0 2024-04-25T09:12:06.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f977d8bd000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562028fa690 con 0x556202af30a0 2024-04-25T09:12:06.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f977d8bd000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562028c8a40 con 0x556202b3d2f0 2024-04-25T09:12:06.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f977d8bd000 10 client.0 _ll_register_callbacks cb 0x556202adde90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:06.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f976aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3c9d0 0x556202b21d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f976aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3c9d0 0x556202b21d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53352/0 (socket says 172.21.15.173:53352) 2024-04-25T09:12:06.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f976aa00640 1 -- 172.21.15.173:0/730213606 learned_addr learned my addr 172.21.15.173:0/730213606 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:06.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f9773400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202af30a0 0x556202b217f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f9773e00640 1 --2- 172.21.15.173:0/730213606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202b3d2f0 0x556202b22270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f976aa00640 1 -- 172.21.15.173:0/730213606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202b3d2f0 msgr2=0x556202b22270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f976aa00640 1 --2- 172.21.15.173:0/730213606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202b3d2f0 0x556202b22270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f976aa00640 1 -- 172.21.15.173:0/730213606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202af30a0 msgr2=0x556202b217f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f976aa00640 1 --2- 172.21.15.173:0/730213606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202af30a0 0x556202b217f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f976aa00640 1 -- 172.21.15.173:0/730213606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562029ed1c0 con 0x556202b3c9d0 2024-04-25T09:12:06.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f9773400640 1 --2- 172.21.15.173:0/730213606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202af30a0 0x556202b217f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:06.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f976aa00640 1 --2- 172.21.15.173:0/730213606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3c9d0 0x556202b21d30 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f975c0146d0 tx=0x7f975c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d991cb1d7f183eb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f9760c00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:12:06.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f9760c00640 1 -- 172.21.15.173:0/730213606 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c013680 con 0x556202b3c9d0 2024-04-25T09:12:06.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f977d8bd000 1 -- 172.21.15.173:0/730213606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f97640ee940 con 0x556202b3c9d0 2024-04-25T09:12:06.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f9760c00640 1 -- 172.21.15.173:0/730213606 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f975c013820 con 0x556202b3c9d0 2024-04-25T09:12:06.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f9760c00640 1 -- 172.21.15.173:0/730213606 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f975c02d050 con 0x556202b3c9d0 2024-04-25T09:12:06.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f977d8bd000 10 client.9129 fetch_fsmap learned FSMap version 81 2024-04-25T09:12:06.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f977d8bd000 1 -- 172.21.15.173:0/730213606 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x5562029e9170 con 0x556202b3c9d0 2024-04-25T09:12:06.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f9760c00640 1 -- 172.21.15.173:0/730213606 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97640ee940 con 0x556202b3c9d0 2024-04-25T09:12:06.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f9760c00640 1 -- 172.21.15.173:0/730213606 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 81) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f975c030020 con 0x556202b3c9d0 2024-04-25T09:12:06.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f977d8bd000 10 client.9129 fetch_fsmap finished waiting for FSMap version 81 2024-04-25T09:12:06.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f977d8bd000 10 client.9129 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:12:06.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f977d8bd000 20 client.9129 populate_metadata read hostname 'smithi173' 2024-04-25T09:12:06.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f977d8bd000 1 --2- 172.21.15.173:0/730213606 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x556202b4cc80 0x556202b4f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f977d8bd000 4 client.9129 mds_command: new command op to 8775 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:12:06.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f977d8bd000 1 -- 172.21.15.173:0/730213606 --> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562028dbc60 con 0x556202b4cc80 2024-04-25T09:12:06.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f9773400640 1 --2- 172.21.15.173:0/730213606 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x556202b4cc80 0x556202b4f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f9760c00640 10 client.9129 ms_handle_connect on v2:172.21.15.173:6835/671971539 2024-04-25T09:12:06.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.982+0000 7f9773400640 1 --2- 172.21.15.173:0/730213606 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x556202b4cc80 0x556202b4f070 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88822e2b9343f2a4 server_cookie=5603e90e5d652885 in_seq=0 out_seq=0 2024-04-25T09:12:06.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.986+0000 7f9760c00640 1 -- 172.21.15.173:0/730213606 <== mds.0 v2:172.21.15.173:6835/671971539 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5562028dbc60 con 0x556202b4cc80 2024-04-25T09:12:06.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.986+0000 7f9760c00640 10 client.9129 handle_command_reply: tid=0 2024-04-25T09:12:06.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.986+0000 7f977d8bd000 1 client.9129 shutdown 2024-04-25T09:12:06.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.986+0000 7f977d8bd000 1 -- 172.21.15.173:0/730213606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3c9d0 msgr2=0x556202b21d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.986+0000 7f977d8bd000 1 --2- 172.21.15.173:0/730213606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3c9d0 0x556202b21d30 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f975c0146d0 tx=0x7f975c000ee0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.986+0000 7f977d8bd000 1 -- 172.21.15.173:0/730213606 shutdown_connections 2024-04-25T09:12:06.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.986+0000 7f977d8bd000 1 --2- 172.21.15.173:0/730213606 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x556202b4cc80 0x556202b4f070 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.986+0000 7f977d8bd000 1 --2- 172.21.15.173:0/730213606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202b3d2f0 0x556202b22270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.986+0000 7f977d8bd000 1 --2- 172.21.15.173:0/730213606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3c9d0 0x556202b21d30 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.986+0000 7f9760c00640 0 client.9129 ms_handle_reset on v2:172.21.15.173:6835/671971539 2024-04-25T09:12:06.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.986+0000 7f977d8bd000 1 --2- 172.21.15.173:0/730213606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202af30a0 0x556202b217f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.986+0000 7f977d8bd000 1 -- 172.21.15.173:0/730213606 >> 172.21.15.173:0/730213606 conn(0x556202aef020 msgr2=0x556202af1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.986+0000 7f977d8bd000 1 -- 172.21.15.173:0/730213606 shutdown_connections 2024-04-25T09:12:06.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.986+0000 7f977d8bd000 1 -- 172.21.15.173:0/730213606 wait complete. 2024-04-25T09:12:06.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.986+0000 7f977d8bd000 20 client.9129 trim_cache size 0 max 16384 2024-04-25T09:12:06.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.998+0000 7f977d8bd000 1 Processor -- start 2024-04-25T09:12:06.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:06.998+0000 7f977d8bd000 1 -- start start 2024-04-25T09:12:06.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f977d8bd000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202af30a0 0x556202af2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f977d8bd000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202b3c9d0 0x556202b49e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f977d8bd000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3d2f0 0x556202b4a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f977d8bd000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9774203960 con 0x556202b3d2f0 2024-04-25T09:12:06.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f977d8bd000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9774202b90 con 0x556202b3c9d0 2024-04-25T09:12:06.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f977d8bd000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97741511f0 con 0x556202af30a0 2024-04-25T09:12:06.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f9773e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3d2f0 0x556202b4a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f9773e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3d2f0 0x556202b4a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53364/0 (socket says 172.21.15.173:53364) 2024-04-25T09:12:06.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f9773e00640 1 -- 172.21.15.173:0/2598364719 learned_addr learned my addr 172.21.15.173:0/2598364719 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:06.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f9773400640 1 --2- 172.21.15.173:0/2598364719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202af30a0 0x556202af2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f976aa00640 1 --2- 172.21.15.173:0/2598364719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202b3c9d0 0x556202b49e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f9773e00640 1 -- 172.21.15.173:0/2598364719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202af30a0 msgr2=0x556202af2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f9773e00640 1 --2- 172.21.15.173:0/2598364719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202af30a0 0x556202af2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f9773e00640 1 -- 172.21.15.173:0/2598364719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202b3c9d0 msgr2=0x556202b49e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f9773e00640 1 --2- 172.21.15.173:0/2598364719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202b3c9d0 0x556202b49e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f9773e00640 1 -- 172.21.15.173:0/2598364719 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556202986de0 con 0x556202b3d2f0 2024-04-25T09:12:06.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f9773e00640 1 --2- 172.21.15.173:0/2598364719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3d2f0 0x556202b4a380 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f976c0011f0 tx=0x7f976c007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba043314eb5d4f11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f9763400640 1 -- 172.21.15.173:0/2598364719 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c019020 con 0x556202b3d2f0 2024-04-25T09:12:06.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f9763400640 1 -- 172.21.15.173:0/2598364719 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c001810 con 0x556202b3d2f0 2024-04-25T09:12:06.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f9763400640 1 -- 172.21.15.173:0/2598364719 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c001bc0 con 0x556202b3d2f0 2024-04-25T09:12:06.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f977d8bd000 1 -- 172.21.15.173:0/2598364719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3d2f0 msgr2=0x556202b4a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f977d8bd000 1 --2- 172.21.15.173:0/2598364719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3d2f0 0x556202b4a380 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f976c0011f0 tx=0x7f976c007410 comp rx=0 tx=0).stop 2024-04-25T09:12:06.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f977d8bd000 1 -- 172.21.15.173:0/2598364719 shutdown_connections 2024-04-25T09:12:06.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f977d8bd000 1 --2- 172.21.15.173:0/2598364719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202b3d2f0 0x556202b4a380 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f977d8bd000 1 --2- 172.21.15.173:0/2598364719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202b3c9d0 0x556202b49e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f977d8bd000 1 --2- 172.21.15.173:0/2598364719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202af30a0 0x556202af2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f977d8bd000 1 -- 172.21.15.173:0/2598364719 >> 172.21.15.173:0/2598364719 conn(0x556202aef020 msgr2=0x556202b49730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f977d8bd000 1 -- 172.21.15.173:0/2598364719 shutdown_connections 2024-04-25T09:12:06.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f977d8bd000 1 -- 172.21.15.173:0/2598364719 wait complete. 2024-04-25T09:12:06.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f977d8bd000 1 -- start start 2024-04-25T09:12:06.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.002+0000 7f977d8bd000 1 Processor -- start 2024-04-25T09:12:06.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202af30a0 0x556202b9c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202b3c9d0 0x556202b9ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202b3d2f0 0x556202b4ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562028dae00 con 0x556202af30a0 2024-04-25T09:12:06.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97741517f0 con 0x556202b3d2f0 2024-04-25T09:12:06.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55620293f300 con 0x556202b3c9d0 2024-04-25T09:12:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 10 client.0 _ll_register_callbacks cb 0x556202abe040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9773400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202af30a0 0x556202b9c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9773400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202af30a0 0x556202b9c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53370/0 (socket says 172.21.15.173:53370) 2024-04-25T09:12:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9773400640 1 -- 172.21.15.173:0/362906123 learned_addr learned my addr 172.21.15.173:0/362906123 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f976aa00640 1 --2- 172.21.15.173:0/362906123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202b3c9d0 0x556202b9ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9773e00640 1 --2- 172.21.15.173:0/362906123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202b3d2f0 0x556202b4ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9773400640 1 -- 172.21.15.173:0/362906123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202b3c9d0 msgr2=0x556202b9ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9773400640 1 --2- 172.21.15.173:0/362906123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202b3c9d0 0x556202b9ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9773400640 1 -- 172.21.15.173:0/362906123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202b3d2f0 msgr2=0x556202b4ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9773400640 1 --2- 172.21.15.173:0/362906123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202b3d2f0 0x556202b4ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9773400640 1 -- 172.21.15.173:0/362906123 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562028e18e0 con 0x556202af30a0 2024-04-25T09:12:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9773400640 1 --2- 172.21.15.173:0/362906123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202af30a0 0x556202b9c510 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f97640f0340 tx=0x7f976401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b42b2a302e4f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9760c00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:12:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9760c00640 1 -- 172.21.15.173:0/362906123 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640f8ca0 con 0x556202af30a0 2024-04-25T09:12:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9760c00640 1 -- 172.21.15.173:0/362906123 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f97640ee940 con 0x556202af30a0 2024-04-25T09:12:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 -- 172.21.15.173:0/362906123 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f976c001810 con 0x556202af30a0 2024-04-25T09:12:06.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9760c00640 1 -- 172.21.15.173:0/362906123 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97640f08a0 con 0x556202af30a0 2024-04-25T09:12:06.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 10 client.9135 fetch_fsmap learned FSMap version 81 2024-04-25T09:12:06.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 -- 172.21.15.173:0/362906123 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x5562029998f0 con 0x556202af30a0 2024-04-25T09:12:06.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9760c00640 1 -- 172.21.15.173:0/362906123 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c001810 con 0x556202af30a0 2024-04-25T09:12:06.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9760c00640 1 -- 172.21.15.173:0/362906123 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 81) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f97640f8810 con 0x556202af30a0 2024-04-25T09:12:06.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 10 client.9135 fetch_fsmap finished waiting for FSMap version 81 2024-04-25T09:12:06.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 10 client.9135 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:12:06.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 20 client.9135 populate_metadata read hostname 'smithi173' 2024-04-25T09:12:06.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 --2- 172.21.15.173:0/362906123 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x556202b4f380 0x556202b4f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 4 client.9135 mds_command: new command op to 8775 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:12:06.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 -- 172.21.15.173:0/362906123 --> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55620294d530 con 0x556202b4f380 2024-04-25T09:12:06.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f976aa00640 1 --2- 172.21.15.173:0/362906123 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x556202b4f380 0x556202b4f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9760c00640 10 client.9135 ms_handle_connect on v2:172.21.15.173:6835/671971539 2024-04-25T09:12:06.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f976aa00640 1 --2- 172.21.15.173:0/362906123 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x556202b4f380 0x556202b4f790 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f5b8707e68e8221 server_cookie=15b181871a97dded in_seq=0 out_seq=0 2024-04-25T09:12:06.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9760c00640 1 -- 172.21.15.173:0/362906123 <== mds.0 v2:172.21.15.173:6835/671971539 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55620294d530 con 0x556202b4f380 2024-04-25T09:12:06.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9760c00640 10 client.9135 handle_command_reply: tid=0 2024-04-25T09:12:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 client.9135 shutdown 2024-04-25T09:12:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 -- 172.21.15.173:0/362906123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202af30a0 msgr2=0x556202b9c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 --2- 172.21.15.173:0/362906123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202af30a0 0x556202b9c510 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f97640f0340 tx=0x7f976401c900 comp rx=0 tx=0).stop 2024-04-25T09:12:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 -- 172.21.15.173:0/362906123 shutdown_connections 2024-04-25T09:12:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 --2- 172.21.15.173:0/362906123 >> [v2:172.21.15.173:6835/671971539,v1:172.21.15.173:6837/671971539] conn(0x556202b4f380 0x556202b4f790 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 --2- 172.21.15.173:0/362906123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556202b3d2f0 0x556202b4ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 --2- 172.21.15.173:0/362906123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556202b3c9d0 0x556202b9ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 --2- 172.21.15.173:0/362906123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556202af30a0 0x556202b9c510 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 -- 172.21.15.173:0/362906123 >> 172.21.15.173:0/362906123 conn(0x556202aef020 msgr2=0x556202b49fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f9760c00640 0 client.9135 ms_handle_reset on v2:172.21.15.173:6835/671971539 2024-04-25T09:12:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 -- 172.21.15.173:0/362906123 shutdown_connections 2024-04-25T09:12:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 1 -- 172.21.15.173:0/362906123 wait complete. 2024-04-25T09:12:06.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977d8bd000 20 client.9135 trim_cache size 0 max 16384 2024-04-25T09:12:06.999 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:12:07.000 INFO:teuthology.orchestra.run.smithi173.stdout: "status": "no active scrubs running", 2024-04-25T09:12:07.000 INFO:teuthology.orchestra.run.smithi173.stdout: "scrubs": {} 2024-04-25T09:12:07.000 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:12:07.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977a400640 1 -- 172.21.15.173:0/3392311848 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9750066f60 msgr2=0x7f9750069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977a400640 1 --2- 172.21.15.173:0/3392311848 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9750066f60 0x7f9750069420 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9774144bd0 tx=0x7f975c009040 comp rx=0 tx=0).stop 2024-04-25T09:12:07.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977a400640 1 -- 172.21.15.173:0/3392311848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97740aeb90 msgr2=0x7f97740b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977a400640 1 --2- 172.21.15.173:0/3392311848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97740aeb90 0x7f97740b02f0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f97640b0040 tx=0x7f97640196a0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977a400640 1 -- 172.21.15.173:0/3392311848 shutdown_connections 2024-04-25T09:12:07.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977a400640 1 --2- 172.21.15.173:0/3392311848 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9750066f60 0x7f9750069420 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977a400640 1 --2- 172.21.15.173:0/3392311848 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97740ce2b0 0x7f9774140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977a400640 1 --2- 172.21.15.173:0/3392311848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97740aef70 0x7f9774140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977a400640 1 --2- 172.21.15.173:0/3392311848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97740aeb90 0x7f97740b02f0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977a400640 1 -- 172.21.15.173:0/3392311848 >> 172.21.15.173:0/3392311848 conn(0x7f977406ac90 msgr2=0x7f977414e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:07.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977a400640 1 -- 172.21.15.173:0/3392311848 shutdown_connections 2024-04-25T09:12:07.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.006+0000 7f977a400640 1 -- 172.21.15.173:0/3392311848 wait complete. 2024-04-25T09:12:07.011 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:12:07.012 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:07.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.162+0000 7f0415400640 1 Processor -- start 2024-04-25T09:12:07.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.162+0000 7f0415400640 1 -- start start 2024-04-25T09:12:07.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.162+0000 7f0415400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f041015d9a0 0x7f04100b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.162+0000 7f0415400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f04100b4910 0x7f041006ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.162+0000 7f0415400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041006b710 con 0x7f041015ecd0 2024-04-25T09:12:07.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.162+0000 7f0415400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041006b1d0 con 0x7f04100b4910 2024-04-25T09:12:07.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.162+0000 7f0415400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041006b430 con 0x7f041015d9a0 2024-04-25T09:12:07.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.162+0000 7f040f200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f04100b4910 0x7f041006ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.162+0000 7f040e800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f041015d9a0 0x7f04100b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.162+0000 7f040f200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f04100b4910 0x7f041006ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:33206/0 (socket says 172.21.15.173:33206) 2024-04-25T09:12:07.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.162+0000 7f040f200640 1 -- 172.21.15.173:0/3957916088 learned_addr learned my addr 172.21.15.173:0/3957916088 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:07.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.162+0000 7f040f200640 1 -- 172.21.15.173:0/3957916088 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f041015d9a0 msgr2=0x7f04100b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:07.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.162+0000 7f040de00640 1 -- 172.21.15.173:0/3957916088 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026616882 0 0) 0x7f041006b710 con 0x7f041015ecd0 2024-04-25T09:12:07.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.162+0000 7f040f200640 1 --2- 172.21.15.173:0/3957916088 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f041015d9a0 0x7f04100b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.162+0000 7f040f200640 1 -- 172.21.15.173:0/3957916088 >> v1:172.21.15.194:6789/0 conn(0x7f041015ecd0 legacy=0x7f04100b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.162+0000 7f040f200640 1 -- 172.21.15.173:0/3957916088 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041015e1f0 con 0x7f04100b4910 2024-04-25T09:12:07.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.166+0000 7f040f200640 1 --2- 172.21.15.173:0/3957916088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04100b4910 0x7f041006ac90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0408009e50 tx=0x7f040801ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10cdd6a3b05608a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.166+0000 7f040de00640 1 -- 172.21.15.173:0/3957916088 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04080a58d0 con 0x7f04100b4910 2024-04-25T09:12:07.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.166+0000 7f040de00640 1 -- 172.21.15.173:0/3957916088 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04080a5a70 con 0x7f04100b4910 2024-04-25T09:12:07.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.166+0000 7f040de00640 1 -- 172.21.15.173:0/3957916088 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04080a5e40 con 0x7f04100b4910 2024-04-25T09:12:07.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.166+0000 7f0415400640 1 -- 172.21.15.173:0/3957916088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04100b4910 msgr2=0x7f041006ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.166+0000 7f0415400640 1 --2- 172.21.15.173:0/3957916088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04100b4910 0x7f041006ac90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0408009e50 tx=0x7f040801ca00 comp rx=0 tx=0).stop 2024-04-25T09:12:07.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.166+0000 7f0415400640 1 -- 172.21.15.173:0/3957916088 shutdown_connections 2024-04-25T09:12:07.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.166+0000 7f0415400640 1 --2- 172.21.15.173:0/3957916088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04100b4910 0x7f041006ac90 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.166+0000 7f0415400640 1 --2- 172.21.15.173:0/3957916088 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f041015d9a0 0x7f04100b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.166+0000 7f0415400640 1 -- 172.21.15.173:0/3957916088 >> 172.21.15.173:0/3957916088 conn(0x7f04100b23f0 msgr2=0x7f04100b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.166+0000 7f0415400640 1 -- 172.21.15.173:0/3957916088 shutdown_connections 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.166+0000 7f0415400640 1 -- 172.21.15.173:0/3957916088 wait complete. 2024-04-25T09:12:07.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f0415400640 1 Processor -- start 2024-04-25T09:12:07.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f0415400640 1 -- start start 2024-04-25T09:12:07.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f0415400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04100b4910 0x7f0410157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f0415400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f041015d9a0 0x7f041014f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f0415400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f041015ecd0 0x7f04101564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f0415400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04100703b0 con 0x7f041015ecd0 2024-04-25T09:12:07.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f0415400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041015df90 con 0x7f041015d9a0 2024-04-25T09:12:07.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f0415400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0410070530 con 0x7f04100b4910 2024-04-25T09:12:07.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f040f200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f041015ecd0 0x7f04101564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f040f200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f041015ecd0 0x7f04101564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53384/0 (socket says 172.21.15.173:53384) 2024-04-25T09:12:07.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f040f200640 1 -- 172.21.15.173:0/260772140 learned_addr learned my addr 172.21.15.173:0/260772140 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:07.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f040e800640 1 --2- 172.21.15.173:0/260772140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04100b4910 0x7f0410157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f0405e00640 1 --2- 172.21.15.173:0/260772140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f041015d9a0 0x7f041014f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f040f200640 1 -- 172.21.15.173:0/260772140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04100b4910 msgr2=0x7f0410157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f040f200640 1 --2- 172.21.15.173:0/260772140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04100b4910 0x7f0410157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f040f200640 1 -- 172.21.15.173:0/260772140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f041015d9a0 msgr2=0x7f041014f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f040f200640 1 --2- 172.21.15.173:0/260772140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f041015d9a0 0x7f041014f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f040f200640 1 -- 172.21.15.173:0/260772140 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04101501c0 con 0x7f041015ecd0 2024-04-25T09:12:07.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f040f200640 1 --2- 172.21.15.173:0/260772140 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f041015ecd0 0x7f04101564a0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f04080af040 tx=0x7f04080197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f0407400640 1 -- 172.21.15.173:0/260772140 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04080a58d0 con 0x7f041015ecd0 2024-04-25T09:12:07.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f0407400640 1 -- 172.21.15.173:0/260772140 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04080be070 con 0x7f041015ecd0 2024-04-25T09:12:07.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f0407400640 1 -- 172.21.15.173:0/260772140 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0408009510 con 0x7f041015ecd0 2024-04-25T09:12:07.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f0415400640 1 -- 172.21.15.173:0/260772140 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04101504a0 con 0x7f041015ecd0 2024-04-25T09:12:07.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.170+0000 7f0415400640 1 -- 172.21.15.173:0/260772140 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0410150a60 con 0x7f041015ecd0 2024-04-25T09:12:07.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.174+0000 7f0415400640 1 -- 172.21.15.173:0/260772140 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0410073a40 con 0x7f041015ecd0 2024-04-25T09:12:07.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.174+0000 7f0407400640 1 -- 172.21.15.173:0/260772140 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f04080b8470 con 0x7f041015ecd0 2024-04-25T09:12:07.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.174+0000 7f0407400640 1 --2- 172.21.15.173:0/260772140 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f03ec066f60 0x7f03ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.174+0000 7f0407400640 1 -- 172.21.15.173:0/260772140 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0408120850 con 0x7f041015ecd0 2024-04-25T09:12:07.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.174+0000 7f040e800640 1 --2- 172.21.15.173:0/260772140 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f03ec066f60 0x7f03ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.174+0000 7f040e800640 1 --2- 172.21.15.173:0/260772140 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f03ec066f60 0x7f03ec069420 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0400009af0 tx=0x7f0400008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.178+0000 7f0407400640 1 -- 172.21.15.173:0/260772140 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0408016620 con 0x7f041015ecd0 2024-04-25T09:12:07.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.366+0000 7f0415400640 1 -- 172.21.15.173:0/260772140 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0410072810 con 0x7f041015ecd0 2024-04-25T09:12:07.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.366+0000 7f0407400640 1 -- 172.21.15.173:0/260772140 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f04080f1630 con 0x7f041015ecd0 2024-04-25T09:12:07.350 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:07.351 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1021410995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1021410995},{"type":"v1","addr":"172.21.15.194:6834","nonce":1021410995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2198134208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2198134208},{"type":"v1","addr":"172.21.15.194:6835","nonce":2198134208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8772,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/684989574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":684989574},{"type":"v1","addr":"172.21.15.173:6836","nonce":684989574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:26.148874+0000","modified":"2024-04-25T09:11:29.164422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8775":{"gid":8775,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/671971539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":671971539},{"type":"v1","addr":"172.21.15.173:6837","nonce":671971539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:12:07.353 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 81 2024-04-25T09:12:07.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.366+0000 7f0415400640 1 -- 172.21.15.173:0/260772140 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f03ec066f60 msgr2=0x7f03ec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.366+0000 7f0415400640 1 --2- 172.21.15.173:0/260772140 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f03ec066f60 0x7f03ec069420 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0400009af0 tx=0x7f0400008040 comp rx=0 tx=0).stop 2024-04-25T09:12:07.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.366+0000 7f0415400640 1 -- 172.21.15.173:0/260772140 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f041015ecd0 msgr2=0x7f04101564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.366+0000 7f0415400640 1 --2- 172.21.15.173:0/260772140 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f041015ecd0 0x7f04101564a0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f04080af040 tx=0x7f04080197a0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.366+0000 7f0415400640 1 -- 172.21.15.173:0/260772140 shutdown_connections 2024-04-25T09:12:07.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.366+0000 7f0415400640 1 --2- 172.21.15.173:0/260772140 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f03ec066f60 0x7f03ec069420 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.366+0000 7f0415400640 1 --2- 172.21.15.173:0/260772140 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f041015ecd0 0x7f04101564a0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.366+0000 7f0415400640 1 --2- 172.21.15.173:0/260772140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f041015d9a0 0x7f041014f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.366+0000 7f0415400640 1 --2- 172.21.15.173:0/260772140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04100b4910 0x7f0410157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.366+0000 7f0415400640 1 -- 172.21.15.173:0/260772140 >> 172.21.15.173:0/260772140 conn(0x7f04100b23f0 msgr2=0x7f04100b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:07.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.366+0000 7f0415400640 1 -- 172.21.15.173:0/260772140 shutdown_connections 2024-04-25T09:12:07.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.366+0000 7f0415400640 1 -- 172.21.15.173:0/260772140 wait complete. 2024-04-25T09:12:07.371 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:12:07.371 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:12:07.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.522+0000 7f1be4800640 1 Processor -- start 2024-04-25T09:12:07.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.522+0000 7f1be4800640 1 -- start start 2024-04-25T09:12:07.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.522+0000 7f1be4800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1bdc15dbb0 0x7f1bdc15df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.522+0000 7f1be4800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bdc0d2130 0x7f1bdc06c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.522+0000 7f1be4800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bdc06d870 con 0x7f1bdc06c7b0 2024-04-25T09:12:07.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.522+0000 7f1be4800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bdc0d2590 con 0x7f1bdc15dbb0 2024-04-25T09:12:07.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.522+0000 7f1be4800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc15e5c0 con 0x7f1bdc0d2130 2024-04-25T09:12:07.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.522+0000 7f1be1400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bdc0d2130 0x7f1bdc06c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.522+0000 7f1be1e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1bdc15dbb0 0x7f1bdc15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.522+0000 7f1be2800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f1bdc06c7b0 0x7f1bdc06f830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:33436/0 (socket says 172.21.15.173:33436) 2024-04-25T09:12:07.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.522+0000 7f1be2800640 1 -- 172.21.15.173:0/211360191 learned_addr learned my addr 172.21.15.173:0/211360191 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:07.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.522+0000 7f1be0a00640 1 -- 172.21.15.173:0/211360191 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186336948 0 0) 0x7f1bdc06d870 con 0x7f1bdc06c7b0 2024-04-25T09:12:07.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.522+0000 7f1be0a00640 1 -- 172.21.15.173:0/211360191 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bc4003530 con 0x7f1bdc06c7b0 2024-04-25T09:12:07.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.522+0000 7f1be1400640 1 -- 172.21.15.173:0/211360191 >> v2:172.21.15.194:3300/0 conn(0x7f1bdc15dbb0 msgr2=0x7f1bdc15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:07.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.522+0000 7f1be1400640 1 --2- 172.21.15.173:0/211360191 >> v2:172.21.15.194:3300/0 conn(0x7f1bdc15dbb0 0x7f1bdc15df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.522+0000 7f1be1400640 1 -- 172.21.15.173:0/211360191 >> v1:172.21.15.194:6789/0 conn(0x7f1bdc06c7b0 legacy=0x7f1bdc06f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.522+0000 7f1be1400640 1 -- 172.21.15.173:0/211360191 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc161690 con 0x7f1bdc0d2130 2024-04-25T09:12:07.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.522+0000 7f1be1e00640 1 --2- 172.21.15.173:0/211360191 >> v2:172.21.15.194:3300/0 conn(0x7f1bdc15dbb0 0x7f1bdc15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:07.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.526+0000 7f1be1400640 1 --2- 172.21.15.173:0/211360191 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bdc0d2130 0x7f1bdc06c270 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0097c0 tx=0x7f1bcc01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2b9d58401fdaccc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.526+0000 7f1be0a00640 1 -- 172.21.15.173:0/211360191 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0a7070 con 0x7f1bdc0d2130 2024-04-25T09:12:07.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.526+0000 7f1be0a00640 1 -- 172.21.15.173:0/211360191 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc0b0070 con 0x7f1bdc0d2130 2024-04-25T09:12:07.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.526+0000 7f1be0a00640 1 -- 172.21.15.173:0/211360191 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0ab890 con 0x7f1bdc0d2130 2024-04-25T09:12:07.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.526+0000 7f1be4800640 1 -- 172.21.15.173:0/211360191 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bdc0d2130 msgr2=0x7f1bdc06c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.526+0000 7f1be4800640 1 --2- 172.21.15.173:0/211360191 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bdc0d2130 0x7f1bdc06c270 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0097c0 tx=0x7f1bcc01c470 comp rx=0 tx=0).stop 2024-04-25T09:12:07.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.526+0000 7f1be4800640 1 -- 172.21.15.173:0/211360191 shutdown_connections 2024-04-25T09:12:07.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.526+0000 7f1be4800640 1 --2- 172.21.15.173:0/211360191 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bdc0d2130 0x7f1bdc06c270 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.526+0000 7f1be4800640 1 --2- 172.21.15.173:0/211360191 >> v2:172.21.15.194:3300/0 conn(0x7f1bdc15dbb0 0x7f1bdc15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.526+0000 7f1be4800640 1 -- 172.21.15.173:0/211360191 >> 172.21.15.173:0/211360191 conn(0x7f1bdc061880 msgr2=0x7f1bdc061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:07.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.526+0000 7f1be4800640 1 -- 172.21.15.173:0/211360191 shutdown_connections 2024-04-25T09:12:07.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.526+0000 7f1be4800640 1 -- 172.21.15.173:0/211360191 wait complete. 2024-04-25T09:12:07.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.526+0000 7f1be4800640 1 Processor -- start 2024-04-25T09:12:07.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.526+0000 7f1be4800640 1 -- start start 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be4800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bdc06c7b0 0x7f1bdc149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be4800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bdc0d2130 0x7f1bdc15c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be4800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bdc15dbb0 0x7f1bdc1487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be4800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc1624d0 con 0x7f1bdc06c7b0 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be4800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc162350 con 0x7f1bdc0d2130 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be4800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc06ff40 con 0x7f1bdc15dbb0 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be1e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bdc06c7b0 0x7f1bdc149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be1400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bdc0d2130 0x7f1bdc15c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be1e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bdc06c7b0 0x7f1bdc149c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53390/0 (socket says 172.21.15.173:53390) 2024-04-25T09:12:07.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be1e00640 1 -- 172.21.15.173:0/846414040 learned_addr learned my addr 172.21.15.173:0/846414040 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:07.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be2800640 1 --2- 172.21.15.173:0/846414040 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bdc15dbb0 0x7f1bdc1487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be1400640 1 -- 172.21.15.173:0/846414040 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bdc15dbb0 msgr2=0x7f1bdc1487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be1400640 1 --2- 172.21.15.173:0/846414040 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bdc15dbb0 0x7f1bdc1487c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be1400640 1 -- 172.21.15.173:0/846414040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bdc06c7b0 msgr2=0x7f1bdc149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be1400640 1 --2- 172.21.15.173:0/846414040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bdc06c7b0 0x7f1bdc149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be1400640 1 -- 172.21.15.173:0/846414040 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc14a150 con 0x7f1bdc0d2130 2024-04-25T09:12:07.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be2800640 1 --2- 172.21.15.173:0/846414040 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bdc15dbb0 0x7f1bdc1487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:07.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be1e00640 1 --2- 172.21.15.173:0/846414040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bdc06c7b0 0x7f1bdc149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:07.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be1400640 1 --2- 172.21.15.173:0/846414040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bdc0d2130 0x7f1bdc15c060 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0ac000 tx=0x7f1bcc01acb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1bd6000640 1 -- 172.21.15.173:0/846414040 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0b5600 con 0x7f1bdc0d2130 2024-04-25T09:12:07.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1bd6000640 1 -- 172.21.15.173:0/846414040 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc0b57a0 con 0x7f1bdc0d2130 2024-04-25T09:12:07.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1bd6000640 1 -- 172.21.15.173:0/846414040 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0b5b90 con 0x7f1bdc0d2130 2024-04-25T09:12:07.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be4800640 1 -- 172.21.15.173:0/846414040 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bdc147720 con 0x7f1bdc0d2130 2024-04-25T09:12:07.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be4800640 1 -- 172.21.15.173:0/846414040 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bdc147ce0 con 0x7f1bdc0d2130 2024-04-25T09:12:07.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.530+0000 7f1be4800640 1 -- 172.21.15.173:0/846414040 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bdc073a40 con 0x7f1bdc0d2130 2024-04-25T09:12:07.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.534+0000 7f1bd6000640 1 -- 172.21.15.173:0/846414040 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1bcc0bd070 con 0x7f1bdc0d2130 2024-04-25T09:12:07.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.534+0000 7f1bd6000640 1 --2- 172.21.15.173:0/846414040 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1bc0066f60 0x7f1bc0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.534+0000 7f1bd6000640 1 -- 172.21.15.173:0/846414040 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1bcc11f1f0 con 0x7f1bdc0d2130 2024-04-25T09:12:07.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.534+0000 7f1be1e00640 1 --2- 172.21.15.173:0/846414040 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1bc0066f60 0x7f1bc0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.534+0000 7f1be1e00640 1 --2- 172.21.15.173:0/846414040 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1bc0066f60 0x7f1bc0069420 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009600 tx=0x7f1bd0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.538+0000 7f1bd6000640 1 -- 172.21.15.173:0/846414040 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1bcc016090 con 0x7f1bdc0d2130 2024-04-25T09:12:07.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.746+0000 7f1be4800640 1 -- 172.21.15.173:0/846414040 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1bdc0ced20 con 0x7f1bdc0d2130 2024-04-25T09:12:07.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.746+0000 7f1bd6000640 1 -- 172.21.15.173:0/846414040 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1598 (secure 0 0 0) 0x7f1bcc0ef980 con 0x7f1bdc0d2130 2024-04-25T09:12:07.730 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:07.730 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":582,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":122,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076684781,"bytes_used":2598592512,"bytes_avail":770495520768,"bytes_total":773094113280,"write_bytes_sec":22258918,"read_op_per_sec":0,"write_op_per_sec":22},"fsmap":{"epoch":81,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8775}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-04-25T09:12:04.850163+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:12:07.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.746+0000 7f1be4800640 1 -- 172.21.15.173:0/846414040 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1bc0066f60 msgr2=0x7f1bc0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.746+0000 7f1be4800640 1 --2- 172.21.15.173:0/846414040 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1bc0066f60 0x7f1bc0069420 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009600 tx=0x7f1bd0009190 comp rx=0 tx=0).stop 2024-04-25T09:12:07.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.746+0000 7f1be4800640 1 -- 172.21.15.173:0/846414040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bdc0d2130 msgr2=0x7f1bdc15c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.746+0000 7f1be4800640 1 --2- 172.21.15.173:0/846414040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bdc0d2130 0x7f1bdc15c060 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0ac000 tx=0x7f1bcc01acb0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.746+0000 7f1be4800640 1 -- 172.21.15.173:0/846414040 shutdown_connections 2024-04-25T09:12:07.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.746+0000 7f1be4800640 1 --2- 172.21.15.173:0/846414040 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1bc0066f60 0x7f1bc0069420 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.746+0000 7f1be4800640 1 --2- 172.21.15.173:0/846414040 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bdc15dbb0 0x7f1bdc1487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.746+0000 7f1be4800640 1 --2- 172.21.15.173:0/846414040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bdc0d2130 0x7f1bdc15c060 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.746+0000 7f1be4800640 1 --2- 172.21.15.173:0/846414040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bdc06c7b0 0x7f1bdc149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.746+0000 7f1be4800640 1 -- 172.21.15.173:0/846414040 >> 172.21.15.173:0/846414040 conn(0x7f1bdc061880 msgr2=0x7f1bdc061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:07.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.746+0000 7f1be4800640 1 -- 172.21.15.173:0/846414040 shutdown_connections 2024-04-25T09:12:07.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:07.746+0000 7f1be4800640 1 -- 172.21.15.173:0/846414040 wait complete. 2024-04-25T09:12:07.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2024-04-25T09:12:08.753 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:08.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.914+0000 7fd97c800640 1 Processor -- start 2024-04-25T09:12:08.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.914+0000 7fd97c800640 1 -- start start 2024-04-25T09:12:08.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.918+0000 7fd97c800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd974145250 0x7fd97415c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.918+0000 7fd97c800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd9740ccd30 0x7fd974071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.918+0000 7fd97c800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd97415cec0 con 0x7fd9740cc8b0 2024-04-25T09:12:08.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.918+0000 7fd97c800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97406e7c0 con 0x7fd9740ccd30 2024-04-25T09:12:08.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.918+0000 7fd97c800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97406d720 con 0x7fd974145250 2024-04-25T09:12:08.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.918+0000 7fd979400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd9740cc8b0 0x7fd974071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38336/0 (socket says 172.21.15.173:38336) 2024-04-25T09:12:08.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.918+0000 7fd979400640 1 -- 172.21.15.173:0/4169331348 learned_addr learned my addr 172.21.15.173:0/4169331348 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:08.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.918+0000 7fd979e00640 1 --2- 172.21.15.173:0/4169331348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd974145250 0x7fd97415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.918+0000 7fd97a800640 1 --2- 172.21.15.173:0/4169331348 >> v2:172.21.15.194:3300/0 conn(0x7fd9740ccd30 0x7fd974071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.918+0000 7fd978a00640 1 -- 172.21.15.173:0/4169331348 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999160724 0 0) 0x7fd964001120 con 0x7fd9740cc8b0 2024-04-25T09:12:08.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.918+0000 7fd978a00640 1 -- 172.21.15.173:0/4169331348 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd95c003530 con 0x7fd9740cc8b0 2024-04-25T09:12:08.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.918+0000 7fd978a00640 1 -- 172.21.15.173:0/4169331348 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2331414576 0 0) 0x7fd95c003530 con 0x7fd9740cc8b0 2024-04-25T09:12:08.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.918+0000 7fd97a800640 1 -- 172.21.15.173:0/4169331348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd974145250 msgr2=0x7fd97415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:08.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.918+0000 7fd97a800640 1 --2- 172.21.15.173:0/4169331348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd974145250 0x7fd97415c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.918+0000 7fd97a800640 1 -- 172.21.15.173:0/4169331348 >> v1:172.21.15.173:6789/0 conn(0x7fd9740cc8b0 legacy=0x7fd974071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.918+0000 7fd97a800640 1 -- 172.21.15.173:0/4169331348 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97406da00 con 0x7fd9740ccd30 2024-04-25T09:12:08.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.922+0000 7fd97a800640 1 --2- 172.21.15.173:0/4169331348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9740ccd30 0x7fd974071a30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd970009d90 tx=0x7fd97001c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b7d32dc0338ac09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.922+0000 7fd978a00640 1 -- 172.21.15.173:0/4169331348 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9700b2070 con 0x7fd9740ccd30 2024-04-25T09:12:08.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.922+0000 7fd978a00640 1 -- 172.21.15.173:0/4169331348 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9700a5660 con 0x7fd9740ccd30 2024-04-25T09:12:08.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.922+0000 7fd978a00640 1 -- 172.21.15.173:0/4169331348 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964001850 con 0x7fd9740ccd30 2024-04-25T09:12:08.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.922+0000 7fd97c800640 1 -- 172.21.15.173:0/4169331348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9740ccd30 msgr2=0x7fd974071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.922+0000 7fd97c800640 1 --2- 172.21.15.173:0/4169331348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9740ccd30 0x7fd974071a30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd970009d90 tx=0x7fd97001c860 comp rx=0 tx=0).stop 2024-04-25T09:12:08.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.922+0000 7fd97c800640 1 -- 172.21.15.173:0/4169331348 shutdown_connections 2024-04-25T09:12:08.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.922+0000 7fd97c800640 1 --2- 172.21.15.173:0/4169331348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9740ccd30 0x7fd974071a30 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.922+0000 7fd97c800640 1 --2- 172.21.15.173:0/4169331348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd974145250 0x7fd97415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.922+0000 7fd97c800640 1 -- 172.21.15.173:0/4169331348 >> 172.21.15.173:0/4169331348 conn(0x7fd97406ac90 msgr2=0x7fd97406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:08.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.922+0000 7fd97c800640 1 -- 172.21.15.173:0/4169331348 shutdown_connections 2024-04-25T09:12:08.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.922+0000 7fd97c800640 1 -- 172.21.15.173:0/4169331348 wait complete. 2024-04-25T09:12:08.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.922+0000 7fd97c800640 1 Processor -- start 2024-04-25T09:12:08.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.922+0000 7fd97c800640 1 -- start start 2024-04-25T09:12:08.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd97c800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9740cc8b0 0x7fd97415b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd97c800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9740ccd30 0x7fd97413ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd97c800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd974145250 0x7fd9740ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd97c800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd974145630 con 0x7fd9740ccd30 2024-04-25T09:12:08.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd97c800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9740cd1a0 con 0x7fd974145250 2024-04-25T09:12:08.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd97c800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97406ef80 con 0x7fd9740cc8b0 2024-04-25T09:12:08.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd979400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9740ccd30 0x7fd97413ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd979400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9740ccd30 0x7fd97413ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53402/0 (socket says 172.21.15.173:53402) 2024-04-25T09:12:08.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd979400640 1 -- 172.21.15.173:0/2693277249 learned_addr learned my addr 172.21.15.173:0/2693277249 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:08.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd979e00640 1 --2- 172.21.15.173:0/2693277249 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9740cc8b0 0x7fd97415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd97a800640 1 --2- 172.21.15.173:0/2693277249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd974145250 0x7fd9740ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd979400640 1 -- 172.21.15.173:0/2693277249 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9740cc8b0 msgr2=0x7fd97415b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd979400640 1 --2- 172.21.15.173:0/2693277249 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9740cc8b0 0x7fd97415b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd979400640 1 -- 172.21.15.173:0/2693277249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd974145250 msgr2=0x7fd9740ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd979400640 1 --2- 172.21.15.173:0/2693277249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd974145250 0x7fd9740ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd979400640 1 -- 172.21.15.173:0/2693277249 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9741f4340 con 0x7fd9740ccd30 2024-04-25T09:12:08.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd979400640 1 --2- 172.21.15.173:0/2693277249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9740ccd30 0x7fd97413ec40 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fd96400c750 tx=0x7fd96400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd96e000640 1 -- 172.21.15.173:0/2693277249 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964005ae0 con 0x7fd9740ccd30 2024-04-25T09:12:08.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd96e000640 1 -- 172.21.15.173:0/2693277249 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd964005c80 con 0x7fd9740ccd30 2024-04-25T09:12:08.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd97c800640 1 -- 172.21.15.173:0/2693277249 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97413f5b0 con 0x7fd9740ccd30 2024-04-25T09:12:08.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd96e000640 1 -- 172.21.15.173:0/2693277249 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9640072b0 con 0x7fd9740ccd30 2024-04-25T09:12:08.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd97c800640 1 -- 172.21.15.173:0/2693277249 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97413fb70 con 0x7fd9740ccd30 2024-04-25T09:12:08.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd97c800640 1 -- 172.21.15.173:0/2693277249 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd974073a40 con 0x7fd9740ccd30 2024-04-25T09:12:08.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.926+0000 7fd96e000640 1 -- 172.21.15.173:0/2693277249 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd964007450 con 0x7fd9740ccd30 2024-04-25T09:12:08.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.930+0000 7fd96e000640 1 --2- 172.21.15.173:0/2693277249 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd958066f60 0x7fd958069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.930+0000 7fd96e000640 1 -- 172.21.15.173:0/2693277249 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd964085210 con 0x7fd9740ccd30 2024-04-25T09:12:08.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.930+0000 7fd979e00640 1 --2- 172.21.15.173:0/2693277249 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd958066f60 0x7fd958069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.930+0000 7fd979e00640 1 --2- 172.21.15.173:0/2693277249 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd958066f60 0x7fd958069420 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd968009a50 tx=0x7fd968008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:08.934+0000 7fd96e000640 1 -- 172.21.15.173:0/2693277249 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd97415cec0 con 0x7fd9740ccd30 2024-04-25T09:12:09.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.118+0000 7fd97c800640 1 -- 172.21.15.173:0/2693277249 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd97415b8b0 con 0x7fd9740ccd30 2024-04-25T09:12:09.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.122+0000 7fd96e000640 1 -- 172.21.15.173:0/2693277249 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fd964055f60 con 0x7fd9740ccd30 2024-04-25T09:12:09.106 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:09.106 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1021410995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1021410995},{"type":"v1","addr":"172.21.15.194:6834","nonce":1021410995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2198134208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2198134208},{"type":"v1","addr":"172.21.15.194:6835","nonce":2198134208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8772,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/684989574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":684989574},{"type":"v1","addr":"172.21.15.173:6836","nonce":684989574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:26.148874+0000","modified":"2024-04-25T09:11:29.164422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8775":{"gid":8775,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/671971539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":671971539},{"type":"v1","addr":"172.21.15.173:6837","nonce":671971539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:12:09.106 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 81 2024-04-25T09:12:09.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.122+0000 7fd97c800640 1 -- 172.21.15.173:0/2693277249 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd958066f60 msgr2=0x7fd958069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.122+0000 7fd97c800640 1 --2- 172.21.15.173:0/2693277249 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd958066f60 0x7fd958069420 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd968009a50 tx=0x7fd968008040 comp rx=0 tx=0).stop 2024-04-25T09:12:09.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.122+0000 7fd97c800640 1 -- 172.21.15.173:0/2693277249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9740ccd30 msgr2=0x7fd97413ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.122+0000 7fd97c800640 1 --2- 172.21.15.173:0/2693277249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9740ccd30 0x7fd97413ec40 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fd96400c750 tx=0x7fd96400cc10 comp rx=0 tx=0).stop 2024-04-25T09:12:09.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.122+0000 7fd97c800640 1 -- 172.21.15.173:0/2693277249 shutdown_connections 2024-04-25T09:12:09.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.122+0000 7fd97c800640 1 --2- 172.21.15.173:0/2693277249 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd958066f60 0x7fd958069420 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.122+0000 7fd97c800640 1 --2- 172.21.15.173:0/2693277249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd974145250 0x7fd9740ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.122+0000 7fd97c800640 1 --2- 172.21.15.173:0/2693277249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9740ccd30 0x7fd97413ec40 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.122+0000 7fd97c800640 1 --2- 172.21.15.173:0/2693277249 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9740cc8b0 0x7fd97415b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.122+0000 7fd97c800640 1 -- 172.21.15.173:0/2693277249 >> 172.21.15.173:0/2693277249 conn(0x7fd97406ac90 msgr2=0x7fd97415d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:09.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.122+0000 7fd97c800640 1 -- 172.21.15.173:0/2693277249 shutdown_connections 2024-04-25T09:12:09.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.122+0000 7fd97c800640 1 -- 172.21.15.173:0/2693277249 wait complete. 2024-04-25T09:12:09.127 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:12:09.127 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:12:09.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.278+0000 7f55c3200640 1 Processor -- start 2024-04-25T09:12:09.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.278+0000 7f55c3200640 1 -- start start 2024-04-25T09:12:09.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.278+0000 7f55c3200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f55bc0b3e70 0x7f55bc0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.278+0000 7f55c3200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55bc0b3590 con 0x7f55bc15edd0 2024-04-25T09:12:09.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.278+0000 7f55c3200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55bc0b4790 con 0x7f55bc0aefa0 2024-04-25T09:12:09.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.278+0000 7f55c3200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55bc06dd50 con 0x7f55bc0b3e70 2024-04-25T09:12:09.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.278+0000 7f55c1200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f55bc15edd0 0x7f55bc0b2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38352/0 (socket says 172.21.15.173:38352) 2024-04-25T09:12:09.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.278+0000 7f55c1200640 1 -- 172.21.15.173:0/2667140264 learned_addr learned my addr 172.21.15.173:0/2667140264 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:09.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.278+0000 7f55bbe00640 1 --2- 172.21.15.173:0/2667140264 >> v2:172.21.15.194:3300/0 conn(0x7f55bc0b3e70 0x7f55bc0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.278+0000 7f55bb400640 1 -- 172.21.15.173:0/2667140264 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262802368 0 0) 0x7f55bc0b3590 con 0x7f55bc15edd0 2024-04-25T09:12:09.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.278+0000 7f55bb400640 1 -- 172.21.15.173:0/2667140264 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55a0003530 con 0x7f55bc15edd0 2024-04-25T09:12:09.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.278+0000 7f55bbe00640 1 -- 172.21.15.173:0/2667140264 >> v1:172.21.15.194:6789/0 conn(0x7f55bc0aefa0 legacy=0x7f55bc0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.278+0000 7f55bb400640 1 -- 172.21.15.173:0/2667140264 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4236890185 0 0) 0x7f55a0003530 con 0x7f55bc15edd0 2024-04-25T09:12:09.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.278+0000 7f55bbe00640 1 -- 172.21.15.173:0/2667140264 >> v1:172.21.15.173:6789/0 conn(0x7f55bc15edd0 legacy=0x7f55bc0b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.278+0000 7f55bbe00640 1 -- 172.21.15.173:0/2667140264 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc15f320 con 0x7f55bc0b3e70 2024-04-25T09:12:09.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.282+0000 7f55bbe00640 1 --2- 172.21.15.173:0/2667140264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55bc0b3e70 0x7f55bc0b4250 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0097c0 tx=0x7f55ac01c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=665f257ec7b24351 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.282+0000 7f55bb400640 1 -- 172.21.15.173:0/2667140264 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0b0070 con 0x7f55bc0b3e70 2024-04-25T09:12:09.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.282+0000 7f55bb400640 1 -- 172.21.15.173:0/2667140264 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac0ab400 con 0x7f55bc0b3e70 2024-04-25T09:12:09.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.282+0000 7f55bb400640 1 -- 172.21.15.173:0/2667140264 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b4001a00 con 0x7f55bc0b3e70 2024-04-25T09:12:09.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.282+0000 7f55c3200640 1 -- 172.21.15.173:0/2667140264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55bc0b3e70 msgr2=0x7f55bc0b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.282+0000 7f55c3200640 1 --2- 172.21.15.173:0/2667140264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55bc0b3e70 0x7f55bc0b4250 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0097c0 tx=0x7f55ac01c270 comp rx=0 tx=0).stop 2024-04-25T09:12:09.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.282+0000 7f55c3200640 1 -- 172.21.15.173:0/2667140264 shutdown_connections 2024-04-25T09:12:09.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.282+0000 7f55c3200640 1 --2- 172.21.15.173:0/2667140264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55bc0b3e70 0x7f55bc0b4250 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.282+0000 7f55c3200640 1 -- 172.21.15.173:0/2667140264 >> 172.21.15.173:0/2667140264 conn(0x7f55bc06ac90 msgr2=0x7f55bc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:09.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.282+0000 7f55c3200640 1 -- 172.21.15.173:0/2667140264 shutdown_connections 2024-04-25T09:12:09.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.282+0000 7f55c3200640 1 -- 172.21.15.173:0/2667140264 wait complete. 2024-04-25T09:12:09.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55c3200640 1 Processor -- start 2024-04-25T09:12:09.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55c3200640 1 -- start start 2024-04-25T09:12:09.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55c3200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55bc0aefa0 0x7f55bc14e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55c3200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55bc0b3e70 0x7f55bc0af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55c3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55bc15edd0 0x7f55bc0afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55c3200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc06d9e0 con 0x7f55bc0b3e70 2024-04-25T09:12:09.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55c3200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc06d700 con 0x7f55bc0aefa0 2024-04-25T09:12:09.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55c3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc0ce7b0 con 0x7f55bc15edd0 2024-04-25T09:12:09.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55b3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55bc0b3e70 0x7f55bc0af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55b3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55bc0b3e70 0x7f55bc0af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53408/0 (socket says 172.21.15.173:53408) 2024-04-25T09:12:09.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55b3400640 1 -- 172.21.15.173:0/4215537811 learned_addr learned my addr 172.21.15.173:0/4215537811 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:09.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55c1200640 1 --2- 172.21.15.173:0/4215537811 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55bc15edd0 0x7f55bc0afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55bbe00640 1 --2- 172.21.15.173:0/4215537811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55bc0aefa0 0x7f55bc14e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55b3400640 1 -- 172.21.15.173:0/4215537811 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55bc15edd0 msgr2=0x7f55bc0afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55b3400640 1 --2- 172.21.15.173:0/4215537811 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55bc15edd0 0x7f55bc0afc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55b3400640 1 -- 172.21.15.173:0/4215537811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55bc0aefa0 msgr2=0x7f55bc14e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55b3400640 1 --2- 172.21.15.173:0/4215537811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55bc0aefa0 0x7f55bc14e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55b3400640 1 -- 172.21.15.173:0/4215537811 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc15c7c0 con 0x7f55bc0b3e70 2024-04-25T09:12:09.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55b3400640 1 --2- 172.21.15.173:0/4215537811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55bc0b3e70 0x7f55bc0af710 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009e50 tx=0x7f55a400c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55b8c00640 1 -- 172.21.15.173:0/4215537811 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a400cd50 con 0x7f55bc0b3e70 2024-04-25T09:12:09.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55b8c00640 1 -- 172.21.15.173:0/4215537811 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a4004020 con 0x7f55bc0b3e70 2024-04-25T09:12:09.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55b8c00640 1 -- 172.21.15.173:0/4215537811 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a4004410 con 0x7f55bc0b3e70 2024-04-25T09:12:09.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55c3200640 1 -- 172.21.15.173:0/4215537811 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55bc15caa0 con 0x7f55bc0b3e70 2024-04-25T09:12:09.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.286+0000 7f55c3200640 1 -- 172.21.15.173:0/4215537811 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55bc15d060 con 0x7f55bc0b3e70 2024-04-25T09:12:09.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.290+0000 7f55c3200640 1 -- 172.21.15.173:0/4215537811 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55bc073a40 con 0x7f55bc0b3e70 2024-04-25T09:12:09.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.290+0000 7f55b8c00640 1 -- 172.21.15.173:0/4215537811 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f55a401b020 con 0x7f55bc0b3e70 2024-04-25T09:12:09.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.290+0000 7f55b8c00640 1 --2- 172.21.15.173:0/4215537811 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5598066f60 0x7f5598069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.290+0000 7f55b8c00640 1 -- 172.21.15.173:0/4215537811 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f55a4087210 con 0x7f55bc0b3e70 2024-04-25T09:12:09.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.290+0000 7f55bbe00640 1 --2- 172.21.15.173:0/4215537811 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5598066f60 0x7f5598069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.290+0000 7f55bbe00640 1 --2- 172.21.15.173:0/4215537811 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5598066f60 0x7f5598069420 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0ad000 tx=0x7f55ac0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.294+0000 7f55b8c00640 1 -- 172.21.15.173:0/4215537811 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f55a40579a0 con 0x7f55bc0b3e70 2024-04-25T09:12:09.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.502+0000 7f55c3200640 1 -- 172.21.15.173:0/4215537811 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f55bc06f1c0 con 0x7f55bc0b3e70 2024-04-25T09:12:09.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.506+0000 7f55b8c00640 1 -- 172.21.15.173:0/4215537811 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1598 (secure 0 0 0) 0x7f55a405ba40 con 0x7f55bc0b3e70 2024-04-25T09:12:09.489 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:09.490 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":583,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":122,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076684781,"bytes_used":2598592512,"bytes_avail":770495520768,"bytes_total":773094113280,"write_bytes_sec":19813184,"read_op_per_sec":0,"write_op_per_sec":20},"fsmap":{"epoch":81,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8775}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-04-25T09:12:04.850163+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:12:09.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.506+0000 7f55c3200640 1 -- 172.21.15.173:0/4215537811 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5598066f60 msgr2=0x7f5598069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.506+0000 7f55c3200640 1 --2- 172.21.15.173:0/4215537811 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5598066f60 0x7f5598069420 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0ad000 tx=0x7f55ac0a6000 comp rx=0 tx=0).stop 2024-04-25T09:12:09.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.506+0000 7f55c3200640 1 -- 172.21.15.173:0/4215537811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55bc0b3e70 msgr2=0x7f55bc0af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.506+0000 7f55c3200640 1 --2- 172.21.15.173:0/4215537811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55bc0b3e70 0x7f55bc0af710 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009e50 tx=0x7f55a400c430 comp rx=0 tx=0).stop 2024-04-25T09:12:09.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.506+0000 7f55c3200640 1 -- 172.21.15.173:0/4215537811 shutdown_connections 2024-04-25T09:12:09.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.506+0000 7f55c3200640 1 --2- 172.21.15.173:0/4215537811 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5598066f60 0x7f5598069420 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.506+0000 7f55c3200640 1 --2- 172.21.15.173:0/4215537811 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55bc15edd0 0x7f55bc0afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.506+0000 7f55c3200640 1 --2- 172.21.15.173:0/4215537811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55bc0b3e70 0x7f55bc0af710 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.506+0000 7f55c3200640 1 --2- 172.21.15.173:0/4215537811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55bc0aefa0 0x7f55bc14e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.506+0000 7f55c3200640 1 -- 172.21.15.173:0/4215537811 >> 172.21.15.173:0/4215537811 conn(0x7f55bc06ac90 msgr2=0x7f55bc0ada40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:09.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.506+0000 7f55c3200640 1 -- 172.21.15.173:0/4215537811 shutdown_connections 2024-04-25T09:12:09.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:09.506+0000 7f55c3200640 1 -- 172.21.15.173:0/4215537811 wait complete. 2024-04-25T09:12:09.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2024-04-25T09:12:10.512 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:10.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee80e00640 1 Processor -- start 2024-04-25T09:12:10.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee80e00640 1 -- start start 2024-04-25T09:12:10.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee80e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee7c06ac90 0x7fee7c06fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee80e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7c070230 con 0x7fee7c15ea80 2024-04-25T09:12:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee80e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7c070510 con 0x7fee7c0b3920 2024-04-25T09:12:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee80e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0b01a0 con 0x7fee7c06ac90 2024-04-25T09:12:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee7a800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fee7c15ea80 0x7fee7c15f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38364/0 (socket says 172.21.15.173:38364) 2024-04-25T09:12:10.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee7a800640 1 -- 172.21.15.173:0/1833922158 learned_addr learned my addr 172.21.15.173:0/1833922158 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee79e00640 1 --2- 172.21.15.173:0/1833922158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee7c06ac90 0x7fee7c06fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee78a00640 1 -- 172.21.15.173:0/1833922158 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231055380 0 0) 0x7fee7c070230 con 0x7fee7c15ea80 2024-04-25T09:12:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee78a00640 1 -- 172.21.15.173:0/1833922158 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee60003530 con 0x7fee7c15ea80 2024-04-25T09:12:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee78a00640 1 -- 172.21.15.173:0/1833922158 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701406366 0 0) 0x7fee7c070510 con 0x7fee7c0b3920 2024-04-25T09:12:10.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee78a00640 1 -- 172.21.15.173:0/1833922158 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee7c070230 con 0x7fee7c0b3920 2024-04-25T09:12:10.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee78a00640 1 -- 172.21.15.173:0/1833922158 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 895439835 0 0) 0x7fee60003530 con 0x7fee7c15ea80 2024-04-25T09:12:10.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee78a00640 1 -- 172.21.15.173:0/1833922158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee7c06ac90 msgr2=0x7fee7c06fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:10.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee78a00640 1 --2- 172.21.15.173:0/1833922158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee7c06ac90 0x7fee7c06fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee78a00640 1 -- 172.21.15.173:0/1833922158 >> v1:172.21.15.194:6789/0 conn(0x7fee7c0b3920 legacy=0x7fee7c06b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee78a00640 1 -- 172.21.15.173:0/1833922158 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c15e280 con 0x7fee7c15ea80 2024-04-25T09:12:10.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee78a00640 1 -- 172.21.15.173:0/1833922158 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fee74001a00 con 0x7fee7c15ea80 2024-04-25T09:12:10.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee78a00640 1 -- 172.21.15.173:0/1833922158 >> v1:172.21.15.173:6789/0 conn(0x7fee7c15ea80 legacy=0x7fee7c15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee78a00640 1 --2- 172.21.15.173:0/1833922158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee60003b80 0x7fee60003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee78a00640 1 --2- 172.21.15.173:0/1833922158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee7c06ac90 0x7fee60004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee78a00640 1 --2- 172.21.15.173:0/1833922158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee60004d50 0x7fee600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee78a00640 1 -- 172.21.15.173:0/1833922158 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0b01a0 con 0x7fee60003b80 2024-04-25T09:12:10.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee78a00640 1 -- 172.21.15.173:0/1833922158 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6000ba80 con 0x7fee60004d50 2024-04-25T09:12:10.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.670+0000 7fee78a00640 1 -- 172.21.15.173:0/1833922158 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6000bc80 con 0x7fee7c06ac90 2024-04-25T09:12:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.674+0000 7fee79e00640 1 --2- 172.21.15.173:0/1833922158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee60003b80 0x7fee60003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.674+0000 7fee79400640 1 --2- 172.21.15.173:0/1833922158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee7c06ac90 0x7fee60004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.674+0000 7fee7a800640 1 --2- 172.21.15.173:0/1833922158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee60004d50 0x7fee600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.674+0000 7fee79e00640 1 -- 172.21.15.173:0/1833922158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee7c06ac90 msgr2=0x7fee60004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.674+0000 7fee79e00640 1 --2- 172.21.15.173:0/1833922158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee7c06ac90 0x7fee60004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.674+0000 7fee79e00640 1 -- 172.21.15.173:0/1833922158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee60004d50 msgr2=0x7fee600051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.674+0000 7fee79e00640 1 --2- 172.21.15.173:0/1833922158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee60004d50 0x7fee600051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.674+0000 7fee79e00640 1 -- 172.21.15.173:0/1833922158 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee60003530 con 0x7fee60003b80 2024-04-25T09:12:10.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.674+0000 7fee7a800640 1 --2- 172.21.15.173:0/1833922158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee60004d50 0x7fee600051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:10.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.674+0000 7fee79e00640 1 --2- 172.21.15.173:0/1833922158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee60003b80 0x7fee60003f80 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009ae0 tx=0x7fee6c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2305035bb069c2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:10.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.674+0000 7fee78a00640 1 -- 172.21.15.173:0/1833922158 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c0096b0 con 0x7fee60003b80 2024-04-25T09:12:10.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.674+0000 7fee78a00640 1 -- 172.21.15.173:0/1833922158 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c0a6450 con 0x7fee60003b80 2024-04-25T09:12:10.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.674+0000 7fee78a00640 1 -- 172.21.15.173:0/1833922158 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c0a6840 con 0x7fee60003b80 2024-04-25T09:12:10.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee80e00640 1 -- 172.21.15.173:0/1833922158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee60003b80 msgr2=0x7fee60003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee80e00640 1 --2- 172.21.15.173:0/1833922158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee60003b80 0x7fee60003f80 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009ae0 tx=0x7fee6c01ca70 comp rx=0 tx=0).stop 2024-04-25T09:12:10.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee7a800640 1 -- 172.21.15.173:0/1833922158 reap_dead start 2024-04-25T09:12:10.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee80e00640 1 -- 172.21.15.173:0/1833922158 shutdown_connections 2024-04-25T09:12:10.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee80e00640 1 -- 172.21.15.173:0/1833922158 >> 172.21.15.173:0/1833922158 conn(0x7fee7c0b23f0 msgr2=0x7fee7c0b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:10.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee80e00640 1 -- 172.21.15.173:0/1833922158 shutdown_connections 2024-04-25T09:12:10.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee80e00640 1 -- 172.21.15.173:0/1833922158 wait complete. 2024-04-25T09:12:10.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee80e00640 1 Processor -- start 2024-04-25T09:12:10.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee80e00640 1 -- start start 2024-04-25T09:12:10.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee80e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee60003b80 0x7fee7c14d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee80e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee7c167b50 0x7fee7c167fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee80e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee7c06b070 0x7fee7c06b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee80e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c15f010 con 0x7fee7c06b070 2024-04-25T09:12:10.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee80e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c15ee90 con 0x7fee7c167b50 2024-04-25T09:12:10.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee80e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c169ec0 con 0x7fee60003b80 2024-04-25T09:12:10.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee7a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee7c06b070 0x7fee7c06b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee7a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee7c06b070 0x7fee7c06b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53426/0 (socket says 172.21.15.173:53426) 2024-04-25T09:12:10.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee7a800640 1 -- 172.21.15.173:0/1213306767 learned_addr learned my addr 172.21.15.173:0/1213306767 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:10.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee79e00640 1 --2- 172.21.15.173:0/1213306767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee60003b80 0x7fee7c14d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee79400640 1 --2- 172.21.15.173:0/1213306767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee7c167b50 0x7fee7c167fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee7a800640 1 -- 172.21.15.173:0/1213306767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee60003b80 msgr2=0x7fee7c14d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee7a800640 1 --2- 172.21.15.173:0/1213306767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee60003b80 0x7fee7c14d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee7a800640 1 -- 172.21.15.173:0/1213306767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee7c167b50 msgr2=0x7fee7c167fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee7a800640 1 --2- 172.21.15.173:0/1213306767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee7c167b50 0x7fee7c167fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee7a800640 1 -- 172.21.15.173:0/1213306767 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c14d700 con 0x7fee7c06b070 2024-04-25T09:12:10.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.678+0000 7fee79e00640 1 --2- 172.21.15.173:0/1213306767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee60003b80 0x7fee7c14d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:10.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.682+0000 7fee7a800640 1 --2- 172.21.15.173:0/1213306767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee7c06b070 0x7fee7c06b4f0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fee7c15ee60 tx=0x7fee74007ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:10.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.682+0000 7fee72000640 1 -- 172.21.15.173:0/1213306767 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7400ea20 con 0x7fee7c06b070 2024-04-25T09:12:10.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.682+0000 7fee72000640 1 -- 172.21.15.173:0/1213306767 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7400ebe0 con 0x7fee7c06b070 2024-04-25T09:12:10.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.682+0000 7fee72000640 1 -- 172.21.15.173:0/1213306767 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7400edd0 con 0x7fee7c06b070 2024-04-25T09:12:10.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.682+0000 7fee80e00640 1 -- 172.21.15.173:0/1213306767 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c1686a0 con 0x7fee7c06b070 2024-04-25T09:12:10.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.682+0000 7fee80e00640 1 -- 172.21.15.173:0/1213306767 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c164720 con 0x7fee7c06b070 2024-04-25T09:12:10.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.682+0000 7fee80e00640 1 -- 172.21.15.173:0/1213306767 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c06ba30 con 0x7fee7c06b070 2024-04-25T09:12:10.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.682+0000 7fee72000640 1 -- 172.21.15.173:0/1213306767 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fee7401a020 con 0x7fee7c06b070 2024-04-25T09:12:10.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.682+0000 7fee72000640 1 --2- 172.21.15.173:0/1213306767 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fee5c066f90 0x7fee5c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.682+0000 7fee72000640 1 -- 172.21.15.173:0/1213306767 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fee74084be0 con 0x7fee7c06b070 2024-04-25T09:12:10.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.682+0000 7fee79e00640 1 --2- 172.21.15.173:0/1213306767 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fee5c066f90 0x7fee5c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.686+0000 7fee79e00640 1 --2- 172.21.15.173:0/1213306767 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fee5c066f90 0x7fee5c069450 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0ad000 tx=0x7fee6c0b2040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:10.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.686+0000 7fee72000640 1 -- 172.21.15.173:0/1213306767 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fee74021020 con 0x7fee7c06b070 2024-04-25T09:12:10.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.878+0000 7fee80e00640 1 -- 172.21.15.173:0/1213306767 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee7c0b57b0 con 0x7fee7c06b070 2024-04-25T09:12:10.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.878+0000 7fee72000640 1 -- 172.21.15.173:0/1213306767 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fee74055930 con 0x7fee7c06b070 2024-04-25T09:12:10.862 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:10.862 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1021410995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1021410995},{"type":"v1","addr":"172.21.15.194:6834","nonce":1021410995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2198134208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2198134208},{"type":"v1","addr":"172.21.15.194:6835","nonce":2198134208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8772,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/684989574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":684989574},{"type":"v1","addr":"172.21.15.173:6836","nonce":684989574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:26.148874+0000","modified":"2024-04-25T09:11:29.164422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8775":{"gid":8775,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/671971539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":671971539},{"type":"v1","addr":"172.21.15.173:6837","nonce":671971539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:12:10.862 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 81 2024-04-25T09:12:10.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.878+0000 7fee80e00640 1 -- 172.21.15.173:0/1213306767 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fee5c066f90 msgr2=0x7fee5c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.878+0000 7fee80e00640 1 --2- 172.21.15.173:0/1213306767 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fee5c066f90 0x7fee5c069450 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0ad000 tx=0x7fee6c0b2040 comp rx=0 tx=0).stop 2024-04-25T09:12:10.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.878+0000 7fee80e00640 1 -- 172.21.15.173:0/1213306767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee7c06b070 msgr2=0x7fee7c06b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.878+0000 7fee80e00640 1 --2- 172.21.15.173:0/1213306767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee7c06b070 0x7fee7c06b4f0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fee7c15ee60 tx=0x7fee74007ba0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.878+0000 7fee80e00640 1 -- 172.21.15.173:0/1213306767 shutdown_connections 2024-04-25T09:12:10.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.878+0000 7fee80e00640 1 --2- 172.21.15.173:0/1213306767 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fee5c066f90 0x7fee5c069450 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.878+0000 7fee80e00640 1 --2- 172.21.15.173:0/1213306767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee7c06b070 0x7fee7c06b4f0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.878+0000 7fee80e00640 1 --2- 172.21.15.173:0/1213306767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee7c167b50 0x7fee7c167fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.878+0000 7fee80e00640 1 --2- 172.21.15.173:0/1213306767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee60003b80 0x7fee7c14d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.878+0000 7fee80e00640 1 -- 172.21.15.173:0/1213306767 >> 172.21.15.173:0/1213306767 conn(0x7fee7c0b23f0 msgr2=0x7fee7c0b0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:10.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.878+0000 7fee80e00640 1 -- 172.21.15.173:0/1213306767 shutdown_connections 2024-04-25T09:12:10.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:10.878+0000 7fee80e00640 1 -- 172.21.15.173:0/1213306767 wait complete. 2024-04-25T09:12:10.883 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:12:10.883 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:12:11.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.034+0000 7fc210e00640 1 Processor -- start 2024-04-25T09:12:11.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.034+0000 7fc210e00640 1 -- start start 2024-04-25T09:12:11.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.034+0000 7fc210e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc20c145250 0x7fc20c15c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:11.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.034+0000 7fc210e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc20c0ccd30 0x7fc20c071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:11.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.034+0000 7fc210e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c15cec0 con 0x7fc20c0cc8b0 2024-04-25T09:12:11.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.034+0000 7fc210e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c06e7c0 con 0x7fc20c0ccd30 2024-04-25T09:12:11.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.034+0000 7fc210e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c06d720 con 0x7fc20c145250 2024-04-25T09:12:11.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.034+0000 7fc20a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc20c0ccd30 0x7fc20c071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:11.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.034+0000 7fc20a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc20c0ccd30 0x7fc20c071a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53438/0 (socket says 172.21.15.173:53438) 2024-04-25T09:12:11.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.034+0000 7fc20a800640 1 -- 172.21.15.173:0/2534243136 learned_addr learned my addr 172.21.15.173:0/2534243136 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:11.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.034+0000 7fc209e00640 1 --2- 172.21.15.173:0/2534243136 >> v2:172.21.15.194:3300/0 conn(0x7fc20c145250 0x7fc20c15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:11.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.034+0000 7fc20a800640 1 -- 172.21.15.173:0/2534243136 >> v2:172.21.15.194:3300/0 conn(0x7fc20c145250 msgr2=0x7fc20c15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:11.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.034+0000 7fc20a800640 1 --2- 172.21.15.173:0/2534243136 >> v2:172.21.15.194:3300/0 conn(0x7fc20c145250 0x7fc20c15c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.034+0000 7fc20a800640 1 -- 172.21.15.173:0/2534243136 >> v1:172.21.15.194:6789/0 conn(0x7fc20c0cc8b0 legacy=0x7fc20c071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:11.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.034+0000 7fc20a800640 1 -- 172.21.15.173:0/2534243136 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c06da00 con 0x7fc20c0ccd30 2024-04-25T09:12:11.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.038+0000 7fc20a800640 1 --2- 172.21.15.173:0/2534243136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc20c0ccd30 0x7fc20c071a30 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fc20c0d0420 tx=0x7fc20401c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1bc52be3ecb30aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:11.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.038+0000 7fc208a00640 1 -- 172.21.15.173:0/2534243136 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2040a5660 con 0x7fc20c0ccd30 2024-04-25T09:12:11.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.038+0000 7fc208a00640 1 -- 172.21.15.173:0/2534243136 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2040a5800 con 0x7fc20c0ccd30 2024-04-25T09:12:11.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.038+0000 7fc208a00640 1 -- 172.21.15.173:0/2534243136 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2040a5bd0 con 0x7fc20c0ccd30 2024-04-25T09:12:11.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.038+0000 7fc210e00640 1 -- 172.21.15.173:0/2534243136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc20c0ccd30 msgr2=0x7fc20c071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:11.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.038+0000 7fc210e00640 1 --2- 172.21.15.173:0/2534243136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc20c0ccd30 0x7fc20c071a30 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fc20c0d0420 tx=0x7fc20401c7a0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.038+0000 7fc210e00640 1 -- 172.21.15.173:0/2534243136 shutdown_connections 2024-04-25T09:12:11.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.038+0000 7fc210e00640 1 --2- 172.21.15.173:0/2534243136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc20c0ccd30 0x7fc20c071a30 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.038+0000 7fc210e00640 1 --2- 172.21.15.173:0/2534243136 >> v2:172.21.15.194:3300/0 conn(0x7fc20c145250 0x7fc20c15c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.038+0000 7fc210e00640 1 -- 172.21.15.173:0/2534243136 >> 172.21.15.173:0/2534243136 conn(0x7fc20c06ac90 msgr2=0x7fc20c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:11.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.038+0000 7fc210e00640 1 -- 172.21.15.173:0/2534243136 shutdown_connections 2024-04-25T09:12:11.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.038+0000 7fc210e00640 1 -- 172.21.15.173:0/2534243136 wait complete. 2024-04-25T09:12:11.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc210e00640 1 Processor -- start 2024-04-25T09:12:11.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc210e00640 1 -- start start 2024-04-25T09:12:11.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc210e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc20c0cc8b0 0x7fc20c0b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:11.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc210e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc20c0ccd30 0x7fc20c0c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:11.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc210e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc20c145250 0x7fc20c133120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:11.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc210e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c06ef80 con 0x7fc20c145250 2024-04-25T09:12:11.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc210e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c145630 con 0x7fc20c0cc8b0 2024-04-25T09:12:11.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc210e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c0cd140 con 0x7fc20c0ccd30 2024-04-25T09:12:11.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc20a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc20c145250 0x7fc20c133120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:11.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc20a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc20c145250 0x7fc20c133120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53452/0 (socket says 172.21.15.173:53452) 2024-04-25T09:12:11.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc20a800640 1 -- 172.21.15.173:0/66605170 learned_addr learned my addr 172.21.15.173:0/66605170 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:11.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc20a800640 1 -- 172.21.15.173:0/66605170 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc20c0ccd30 msgr2=0x7fc20c0c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:11.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc209e00640 1 --2- 172.21.15.173:0/66605170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc20c0cc8b0 0x7fc20c0b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:11.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc20a800640 1 --2- 172.21.15.173:0/66605170 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc20c0ccd30 0x7fc20c0c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc20a800640 1 -- 172.21.15.173:0/66605170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc20c0cc8b0 msgr2=0x7fc20c0b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:11.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc20a800640 1 --2- 172.21.15.173:0/66605170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc20c0cc8b0 0x7fc20c0b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc20a800640 1 -- 172.21.15.173:0/66605170 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c0c5840 con 0x7fc20c145250 2024-04-25T09:12:11.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc209e00640 1 --2- 172.21.15.173:0/66605170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc20c0cc8b0 0x7fc20c0b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:11.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc20a800640 1 --2- 172.21.15.173:0/66605170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc20c145250 0x7fc20c133120 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fc20401a3d0 tx=0x7fc204019540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:11.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc202000640 1 -- 172.21.15.173:0/66605170 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2040b8670 con 0x7fc20c145250 2024-04-25T09:12:11.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc202000640 1 -- 172.21.15.173:0/66605170 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2040be070 con 0x7fc20c145250 2024-04-25T09:12:11.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc202000640 1 -- 172.21.15.173:0/66605170 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2040b8a50 con 0x7fc20c145250 2024-04-25T09:12:11.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc210e00640 1 -- 172.21.15.173:0/66605170 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc20c0c5b20 con 0x7fc20c145250 2024-04-25T09:12:11.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc210e00640 1 -- 172.21.15.173:0/66605170 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20c0c60e0 con 0x7fc20c145250 2024-04-25T09:12:11.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.042+0000 7fc210e00640 1 -- 172.21.15.173:0/66605170 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc20c073a40 con 0x7fc20c145250 2024-04-25T09:12:11.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.046+0000 7fc202000640 1 -- 172.21.15.173:0/66605170 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc2040b8bf0 con 0x7fc20c145250 2024-04-25T09:12:11.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.046+0000 7fc202000640 1 --2- 172.21.15.173:0/66605170 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc1e8066f90 0x7fc1e8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:11.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.046+0000 7fc202000640 1 -- 172.21.15.173:0/66605170 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc2041202c0 con 0x7fc20c145250 2024-04-25T09:12:11.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.046+0000 7fc209e00640 1 --2- 172.21.15.173:0/66605170 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc1e8066f90 0x7fc1e8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:11.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.046+0000 7fc209e00640 1 --2- 172.21.15.173:0/66605170 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc1e8066f90 0x7fc1e8069450 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0097a0 tx=0x7fc1fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:11.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.050+0000 7fc202000640 1 -- 172.21.15.173:0/66605170 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc20c15cec0 con 0x7fc20c145250 2024-04-25T09:12:11.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.258+0000 7fc210e00640 1 -- 172.21.15.173:0/66605170 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc20c071fb0 con 0x7fc20c145250 2024-04-25T09:12:11.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.258+0000 7fc202000640 1 -- 172.21.15.173:0/66605170 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1598 (secure 0 0 0) 0x7fc2040ac3a0 con 0x7fc20c145250 2024-04-25T09:12:11.243 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:11.243 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":585,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":122,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076684781,"bytes_used":2598592512,"bytes_avail":770495520768,"bytes_total":773094113280,"write_bytes_sec":19813184,"read_op_per_sec":0,"write_op_per_sec":20},"fsmap":{"epoch":81,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8775}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-04-25T09:12:04.850163+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:12:11.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.262+0000 7fc210e00640 1 -- 172.21.15.173:0/66605170 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc1e8066f90 msgr2=0x7fc1e8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:11.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.262+0000 7fc210e00640 1 --2- 172.21.15.173:0/66605170 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc1e8066f90 0x7fc1e8069450 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0097a0 tx=0x7fc1fc008040 comp rx=0 tx=0).stop 2024-04-25T09:12:11.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.262+0000 7fc210e00640 1 -- 172.21.15.173:0/66605170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc20c145250 msgr2=0x7fc20c133120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:11.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.262+0000 7fc210e00640 1 --2- 172.21.15.173:0/66605170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc20c145250 0x7fc20c133120 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fc20401a3d0 tx=0x7fc204019540 comp rx=0 tx=0).stop 2024-04-25T09:12:11.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.262+0000 7fc210e00640 1 -- 172.21.15.173:0/66605170 shutdown_connections 2024-04-25T09:12:11.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.262+0000 7fc210e00640 1 --2- 172.21.15.173:0/66605170 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc1e8066f90 0x7fc1e8069450 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.262+0000 7fc210e00640 1 --2- 172.21.15.173:0/66605170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc20c145250 0x7fc20c133120 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.262+0000 7fc210e00640 1 --2- 172.21.15.173:0/66605170 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc20c0ccd30 0x7fc20c0c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.262+0000 7fc210e00640 1 --2- 172.21.15.173:0/66605170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc20c0cc8b0 0x7fc20c0b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.262+0000 7fc210e00640 1 -- 172.21.15.173:0/66605170 >> 172.21.15.173:0/66605170 conn(0x7fc20c06ac90 msgr2=0x7fc20c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:11.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.262+0000 7fc210e00640 1 -- 172.21.15.173:0/66605170 shutdown_connections 2024-04-25T09:12:11.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:11.262+0000 7fc210e00640 1 -- 172.21.15.173:0/66605170 wait complete. 2024-04-25T09:12:11.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2024-04-25T09:12:12.265 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:12.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.426+0000 7f5499200640 1 Processor -- start 2024-04-25T09:12:12.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.426+0000 7f5499200640 1 -- start start 2024-04-25T09:12:12.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.430+0000 7f5499200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f54940b3e70 0x7f54940b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.430+0000 7f5499200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54940aefa0 0x7f54940b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.430+0000 7f5499200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54940b4790 con 0x7f549415edd0 2024-04-25T09:12:12.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.430+0000 7f5499200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549406dd50 con 0x7f54940b3e70 2024-04-25T09:12:12.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.430+0000 7f5499200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549415f320 con 0x7f54940aefa0 2024-04-25T09:12:12.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.430+0000 7f5489400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54940aefa0 0x7f54940b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.430+0000 7f5491e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f54940b3e70 0x7f54940b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.430+0000 7f5489400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54940aefa0 0x7f54940b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:53854/0 (socket says 172.21.15.173:53854) 2024-04-25T09:12:12.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.430+0000 7f5489400640 1 -- 172.21.15.173:0/1796019980 learned_addr learned my addr 172.21.15.173:0/1796019980 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:12.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.430+0000 7f5489400640 1 -- 172.21.15.173:0/1796019980 >> v2:172.21.15.194:3300/0 conn(0x7f54940b3e70 msgr2=0x7f54940b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:12.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.430+0000 7f5489400640 1 --2- 172.21.15.173:0/1796019980 >> v2:172.21.15.194:3300/0 conn(0x7f54940b3e70 0x7f54940b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.430+0000 7f5489400640 1 -- 172.21.15.173:0/1796019980 >> v1:172.21.15.194:6789/0 conn(0x7f549415edd0 legacy=0x7f54940b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.430+0000 7f5489400640 1 -- 172.21.15.173:0/1796019980 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549406d420 con 0x7f54940aefa0 2024-04-25T09:12:12.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.430+0000 7f5491e00640 1 --2- 172.21.15.173:0/1796019980 >> v2:172.21.15.194:3300/0 conn(0x7f54940b3e70 0x7f54940b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:12.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.434+0000 7f5489400640 1 --2- 172.21.15.173:0/1796019980 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54940aefa0 0x7f54940b2770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f547c009870 tx=0x7f547c01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d259ea68d0f5ec4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:12.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.434+0000 7f5491400640 1 -- 172.21.15.173:0/1796019980 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0a9610 con 0x7f54940aefa0 2024-04-25T09:12:12.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.434+0000 7f5491400640 1 -- 172.21.15.173:0/1796019980 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c0a97b0 con 0x7f54940aefa0 2024-04-25T09:12:12.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.434+0000 7f5491400640 1 -- 172.21.15.173:0/1796019980 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0a9b80 con 0x7f54940aefa0 2024-04-25T09:12:12.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.434+0000 7f5499200640 1 -- 172.21.15.173:0/1796019980 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54940aefa0 msgr2=0x7f54940b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.434+0000 7f5499200640 1 --2- 172.21.15.173:0/1796019980 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54940aefa0 0x7f54940b2770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f547c009870 tx=0x7f547c01c530 comp rx=0 tx=0).stop 2024-04-25T09:12:12.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.434+0000 7f5499200640 1 -- 172.21.15.173:0/1796019980 shutdown_connections 2024-04-25T09:12:12.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.434+0000 7f5499200640 1 --2- 172.21.15.173:0/1796019980 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54940aefa0 0x7f54940b2770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.434+0000 7f5499200640 1 --2- 172.21.15.173:0/1796019980 >> v2:172.21.15.194:3300/0 conn(0x7f54940b3e70 0x7f54940b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.434+0000 7f5499200640 1 -- 172.21.15.173:0/1796019980 >> 172.21.15.173:0/1796019980 conn(0x7f549406ac90 msgr2=0x7f549406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:12.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.434+0000 7f5499200640 1 -- 172.21.15.173:0/1796019980 shutdown_connections 2024-04-25T09:12:12.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.434+0000 7f5499200640 1 -- 172.21.15.173:0/1796019980 wait complete. 2024-04-25T09:12:12.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.434+0000 7f5499200640 1 Processor -- start 2024-04-25T09:12:12.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.434+0000 7f5499200640 1 -- start start 2024-04-25T09:12:12.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.434+0000 7f5499200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54940aefa0 0x7f54941f7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.434+0000 7f5499200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54940b3e70 0x7f549414b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f5499200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f549415edd0 0x7f549414d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f5499200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549406e1c0 con 0x7f549415edd0 2024-04-25T09:12:12.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f5499200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549415aba0 con 0x7f54940b3e70 2024-04-25T09:12:12.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f5499200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549406e340 con 0x7f54940aefa0 2024-04-25T09:12:12.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f5492800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f549415edd0 0x7f549414d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f5492800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f549415edd0 0x7f549414d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53462/0 (socket says 172.21.15.173:53462) 2024-04-25T09:12:12.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f5492800640 1 -- 172.21.15.173:0/215959360 learned_addr learned my addr 172.21.15.173:0/215959360 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:12.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f5489400640 1 --2- 172.21.15.173:0/215959360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54940b3e70 0x7f549414b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f5491e00640 1 --2- 172.21.15.173:0/215959360 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54940aefa0 0x7f54941f7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f5492800640 1 -- 172.21.15.173:0/215959360 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54940aefa0 msgr2=0x7f54941f7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f5492800640 1 --2- 172.21.15.173:0/215959360 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54940aefa0 0x7f54941f7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f5492800640 1 -- 172.21.15.173:0/215959360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54940b3e70 msgr2=0x7f549414b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f5492800640 1 --2- 172.21.15.173:0/215959360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54940b3e70 0x7f549414b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f5492800640 1 -- 172.21.15.173:0/215959360 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54941f7a80 con 0x7f549415edd0 2024-04-25T09:12:12.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f5492800640 1 --2- 172.21.15.173:0/215959360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f549415edd0 0x7f549414d290 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f548c00c7a0 tx=0x7f548c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:12.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f548aa00640 1 -- 172.21.15.173:0/215959360 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c003b80 con 0x7f549415edd0 2024-04-25T09:12:12.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f548aa00640 1 -- 172.21.15.173:0/215959360 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c003d20 con 0x7f549415edd0 2024-04-25T09:12:12.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f5499200640 1 -- 172.21.15.173:0/215959360 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5494152450 con 0x7f549415edd0 2024-04-25T09:12:12.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f548aa00640 1 -- 172.21.15.173:0/215959360 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c00aa90 con 0x7f549415edd0 2024-04-25T09:12:12.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f5499200640 1 -- 172.21.15.173:0/215959360 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5494152a10 con 0x7f549415edd0 2024-04-25T09:12:12.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f5499200640 1 -- 172.21.15.173:0/215959360 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5494073a40 con 0x7f549415edd0 2024-04-25T09:12:12.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.438+0000 7f548aa00640 1 -- 172.21.15.173:0/215959360 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f548c00ac30 con 0x7f549415edd0 2024-04-25T09:12:12.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.442+0000 7f548aa00640 1 --2- 172.21.15.173:0/215959360 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5470066f60 0x7f5470069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.442+0000 7f548aa00640 1 -- 172.21.15.173:0/215959360 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f548c084fe0 con 0x7f549415edd0 2024-04-25T09:12:12.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.442+0000 7f5491e00640 1 --2- 172.21.15.173:0/215959360 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5470066f60 0x7f5470069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.442+0000 7f5491e00640 1 --2- 172.21.15.173:0/215959360 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5470066f60 0x7f5470069420 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5484009580 tx=0x7f5484009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:12.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.446+0000 7f548aa00640 1 -- 172.21.15.173:0/215959360 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f54941f7a80 con 0x7f549415edd0 2024-04-25T09:12:12.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.630+0000 7f5499200640 1 -- 172.21.15.173:0/215959360 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f549406e540 con 0x7f549415edd0 2024-04-25T09:12:12.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.634+0000 7f548aa00640 1 -- 172.21.15.173:0/215959360 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f548c0557d0 con 0x7f549415edd0 2024-04-25T09:12:12.617 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:12.618 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1021410995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1021410995},{"type":"v1","addr":"172.21.15.194:6834","nonce":1021410995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2198134208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2198134208},{"type":"v1","addr":"172.21.15.194:6835","nonce":2198134208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8772,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/684989574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":684989574},{"type":"v1","addr":"172.21.15.173:6836","nonce":684989574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:26.148874+0000","modified":"2024-04-25T09:11:29.164422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8775":{"gid":8775,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/671971539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":671971539},{"type":"v1","addr":"172.21.15.173:6837","nonce":671971539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:12:12.618 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 81 2024-04-25T09:12:12.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.634+0000 7f5499200640 1 -- 172.21.15.173:0/215959360 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5470066f60 msgr2=0x7f5470069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.634+0000 7f5499200640 1 --2- 172.21.15.173:0/215959360 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5470066f60 0x7f5470069420 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5484009580 tx=0x7f5484009190 comp rx=0 tx=0).stop 2024-04-25T09:12:12.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.634+0000 7f5499200640 1 -- 172.21.15.173:0/215959360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f549415edd0 msgr2=0x7f549414d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.634+0000 7f5499200640 1 --2- 172.21.15.173:0/215959360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f549415edd0 0x7f549414d290 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f548c00c7a0 tx=0x7f548c00cc60 comp rx=0 tx=0).stop 2024-04-25T09:12:12.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.634+0000 7f5499200640 1 -- 172.21.15.173:0/215959360 shutdown_connections 2024-04-25T09:12:12.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.634+0000 7f5499200640 1 --2- 172.21.15.173:0/215959360 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5470066f60 0x7f5470069420 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.634+0000 7f5499200640 1 --2- 172.21.15.173:0/215959360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f549415edd0 0x7f549414d290 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.634+0000 7f5499200640 1 --2- 172.21.15.173:0/215959360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54940b3e70 0x7f549414b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.634+0000 7f5499200640 1 --2- 172.21.15.173:0/215959360 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54940aefa0 0x7f54941f7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.634+0000 7f5499200640 1 -- 172.21.15.173:0/215959360 >> 172.21.15.173:0/215959360 conn(0x7f549406ac90 msgr2=0x7f54940b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:12.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.634+0000 7f5499200640 1 -- 172.21.15.173:0/215959360 shutdown_connections 2024-04-25T09:12:12.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.634+0000 7f5499200640 1 -- 172.21.15.173:0/215959360 wait complete. 2024-04-25T09:12:12.639 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:12:12.639 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:12:12.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.790+0000 7f0468a00640 1 Processor -- start 2024-04-25T09:12:12.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.790+0000 7f0468a00640 1 -- start start 2024-04-25T09:12:12.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.790+0000 7f0468a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f046415dc60 0x7f04640b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.790+0000 7f0468a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0464071910 0x7f0464071da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.790+0000 7f0468a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046415e040 con 0x7f04640b42f0 2024-04-25T09:12:12.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.790+0000 7f0468a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04640b2d50 con 0x7f046415dc60 2024-04-25T09:12:12.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.790+0000 7f0468a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04640b2ff0 con 0x7f0464071910 2024-04-25T09:12:12.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.790+0000 7f0463400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f046415dc60 0x7f04640b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.790+0000 7f0463400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f046415dc60 0x7f04640b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53478/0 (socket says 172.21.15.173:53478) 2024-04-25T09:12:12.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.790+0000 7f0463400640 1 -- 172.21.15.173:0/2739134684 learned_addr learned my addr 172.21.15.173:0/2739134684 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:12.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.790+0000 7f0462a00640 1 --1- 172.21.15.173:0/2739134684 >> v1:172.21.15.173:6789/0 conn(0x7f04640b42f0 0x7f04640b4750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:38368/0 (socket says 172.21.15.173:38368) 2024-04-25T09:12:12.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.790+0000 7f0463e00640 1 --2- 172.21.15.173:0/2739134684 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0464071910 0x7f0464071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.790+0000 7f0463400640 1 -- 172.21.15.173:0/2739134684 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0464071910 msgr2=0x7f0464071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:12.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.790+0000 7f0463400640 1 --2- 172.21.15.173:0/2739134684 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0464071910 0x7f0464071da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.790+0000 7f0463400640 1 -- 172.21.15.173:0/2739134684 >> v1:172.21.15.173:6789/0 conn(0x7f04640b42f0 legacy=0x7f04640b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.790+0000 7f0462000640 1 -- 172.21.15.173:0/2739134684 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226862733 0 0) 0x7f046415e040 con 0x7f04640b42f0 2024-04-25T09:12:12.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.790+0000 7f0463400640 1 -- 172.21.15.173:0/2739134684 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04640b32d0 con 0x7f046415dc60 2024-04-25T09:12:12.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.790+0000 7f0463e00640 1 --2- 172.21.15.173:0/2739134684 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0464071910 0x7f0464071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:12.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.794+0000 7f0463400640 1 --2- 172.21.15.173:0/2739134684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f046415dc60 0x7f04640b3db0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f0454009870 tx=0x7f045401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65fe12877eee6288 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:12.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.794+0000 7f0462000640 1 -- 172.21.15.173:0/2739134684 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04540ab650 con 0x7f046415dc60 2024-04-25T09:12:12.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.794+0000 7f0462000640 1 -- 172.21.15.173:0/2739134684 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04540b0070 con 0x7f046415dc60 2024-04-25T09:12:12.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.794+0000 7f0462000640 1 -- 172.21.15.173:0/2739134684 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04540aba10 con 0x7f046415dc60 2024-04-25T09:12:12.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.794+0000 7f0468a00640 1 -- 172.21.15.173:0/2739134684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f046415dc60 msgr2=0x7f04640b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.794+0000 7f0468a00640 1 --2- 172.21.15.173:0/2739134684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f046415dc60 0x7f04640b3db0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f0454009870 tx=0x7f045401c560 comp rx=0 tx=0).stop 2024-04-25T09:12:12.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.794+0000 7f0468a00640 1 -- 172.21.15.173:0/2739134684 shutdown_connections 2024-04-25T09:12:12.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.794+0000 7f0468a00640 1 --2- 172.21.15.173:0/2739134684 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0464071910 0x7f0464071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.794+0000 7f0468a00640 1 --2- 172.21.15.173:0/2739134684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f046415dc60 0x7f04640b3db0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.794+0000 7f0468a00640 1 -- 172.21.15.173:0/2739134684 >> 172.21.15.173:0/2739134684 conn(0x7f04640cc700 msgr2=0x7f04640ccb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:12.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.794+0000 7f0468a00640 1 -- 172.21.15.173:0/2739134684 shutdown_connections 2024-04-25T09:12:12.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.794+0000 7f0468a00640 1 -- 172.21.15.173:0/2739134684 wait complete. 2024-04-25T09:12:12.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0468a00640 1 Processor -- start 2024-04-25T09:12:12.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0468a00640 1 -- start start 2024-04-25T09:12:12.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0468a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0464071910 0x7f0464154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0468a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04640b42f0 0x7f0464154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0468a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f046415dc60 0x7f0464154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0468a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04640b4fe0 con 0x7f046415dc60 2024-04-25T09:12:12.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0468a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04640b4e60 con 0x7f0464071910 2024-04-25T09:12:12.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0468a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046416a780 con 0x7f04640b42f0 2024-04-25T09:12:12.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0463e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f046415dc60 0x7f0464154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0463e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f046415dc60 0x7f0464154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53490/0 (socket says 172.21.15.173:53490) 2024-04-25T09:12:12.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0463e00640 1 -- 172.21.15.173:0/322494654 learned_addr learned my addr 172.21.15.173:0/322494654 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:12.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0462a00640 1 --2- 172.21.15.173:0/322494654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04640b42f0 0x7f0464154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0463400640 1 --2- 172.21.15.173:0/322494654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0464071910 0x7f0464154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0463e00640 1 -- 172.21.15.173:0/322494654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04640b42f0 msgr2=0x7f0464154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0463e00640 1 --2- 172.21.15.173:0/322494654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04640b42f0 0x7f0464154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0463e00640 1 -- 172.21.15.173:0/322494654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0464071910 msgr2=0x7f0464154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0463e00640 1 --2- 172.21.15.173:0/322494654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0464071910 0x7f0464154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0463e00640 1 -- 172.21.15.173:0/322494654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0464156590 con 0x7f046415dc60 2024-04-25T09:12:12.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0463400640 1 --2- 172.21.15.173:0/322494654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0464071910 0x7f0464154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:12.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0462a00640 1 --2- 172.21.15.173:0/322494654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04640b42f0 0x7f0464154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:12.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0463e00640 1 --2- 172.21.15.173:0/322494654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f046415dc60 0x7f0464154da0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f045c00cca0 tx=0x7f045c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:12.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f045b400640 1 -- 172.21.15.173:0/322494654 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c00f680 con 0x7f046415dc60 2024-04-25T09:12:12.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f045b400640 1 -- 172.21.15.173:0/322494654 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045c00f840 con 0x7f046415dc60 2024-04-25T09:12:12.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0468a00640 1 -- 172.21.15.173:0/322494654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0464156870 con 0x7f046415dc60 2024-04-25T09:12:12.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f045b400640 1 -- 172.21.15.173:0/322494654 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c00fc30 con 0x7f046415dc60 2024-04-25T09:12:12.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0468a00640 1 -- 172.21.15.173:0/322494654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0464156e30 con 0x7f046415dc60 2024-04-25T09:12:12.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.798+0000 7f0468a00640 1 -- 172.21.15.173:0/322494654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0464073a40 con 0x7f046415dc60 2024-04-25T09:12:12.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.802+0000 7f045b400640 1 -- 172.21.15.173:0/322494654 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f045c0213f0 con 0x7f046415dc60 2024-04-25T09:12:12.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.802+0000 7f045b400640 1 --2- 172.21.15.173:0/322494654 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0444066f60 0x7f0444069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.802+0000 7f045b400640 1 -- 172.21.15.173:0/322494654 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f045c085fa0 con 0x7f046415dc60 2024-04-25T09:12:12.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.802+0000 7f0463400640 1 --2- 172.21.15.173:0/322494654 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0444066f60 0x7f0444069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.802+0000 7f0463400640 1 --2- 172.21.15.173:0/322494654 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0444066f60 0x7f0444069420 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f04540af000 tx=0x7f0454008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:12.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:12.806+0000 7f045b400640 1 -- 172.21.15.173:0/322494654 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f045c014030 con 0x7f046415dc60 2024-04-25T09:12:13.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:13.018+0000 7f0468a00640 1 -- 172.21.15.173:0/322494654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0464157000 con 0x7f046415dc60 2024-04-25T09:12:13.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:13.018+0000 7f045b400640 1 -- 172.21.15.173:0/322494654 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1598 (secure 0 0 0) 0x7f045c056d80 con 0x7f046415dc60 2024-04-25T09:12:13.001 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:13.002 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":587,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":122,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076689006,"bytes_used":2598600704,"bytes_avail":770495512576,"bytes_total":773094113280,"write_bytes_sec":18154129,"read_op_per_sec":0,"write_op_per_sec":18},"fsmap":{"epoch":81,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8775}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-04-25T09:12:04.850163+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:12:13.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:13.018+0000 7f0468a00640 1 -- 172.21.15.173:0/322494654 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0444066f60 msgr2=0x7f0444069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:13.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:13.018+0000 7f0468a00640 1 --2- 172.21.15.173:0/322494654 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0444066f60 0x7f0444069420 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f04540af000 tx=0x7f0454008040 comp rx=0 tx=0).stop 2024-04-25T09:12:13.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:13.018+0000 7f0468a00640 1 -- 172.21.15.173:0/322494654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f046415dc60 msgr2=0x7f0464154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:13.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:13.018+0000 7f0468a00640 1 --2- 172.21.15.173:0/322494654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f046415dc60 0x7f0464154da0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f045c00cca0 tx=0x7f045c00a650 comp rx=0 tx=0).stop 2024-04-25T09:12:13.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:13.018+0000 7f0468a00640 1 -- 172.21.15.173:0/322494654 shutdown_connections 2024-04-25T09:12:13.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:13.018+0000 7f0468a00640 1 --2- 172.21.15.173:0/322494654 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0444066f60 0x7f0444069420 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:13.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:13.018+0000 7f0468a00640 1 --2- 172.21.15.173:0/322494654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f046415dc60 0x7f0464154da0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:13.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:13.018+0000 7f0468a00640 1 --2- 172.21.15.173:0/322494654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04640b42f0 0x7f0464154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:13.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:13.018+0000 7f0468a00640 1 --2- 172.21.15.173:0/322494654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0464071910 0x7f0464154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:13.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:13.018+0000 7f0468a00640 1 -- 172.21.15.173:0/322494654 >> 172.21.15.173:0/322494654 conn(0x7f04640cc700 msgr2=0x7f04640b09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:13.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:13.018+0000 7f0468a00640 1 -- 172.21.15.173:0/322494654 shutdown_connections 2024-04-25T09:12:13.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:13.018+0000 7f0468a00640 1 -- 172.21.15.173:0/322494654 wait complete. 2024-04-25T09:12:13.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2024-04-25T09:12:14.023 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:14.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.182+0000 7f8500600640 1 Processor -- start 2024-04-25T09:12:14.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.182+0000 7f8500600640 1 -- start start 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.182+0000 7f8500600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84f80b3e70 0x7f84f80b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.182+0000 7f8500600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f84f80aefa0 0x7f84f80b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.182+0000 7f8500600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f80b4790 con 0x7f84f815edd0 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.182+0000 7f8500600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f806dd50 con 0x7f84f80aefa0 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.182+0000 7f8500600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f815f320 con 0x7f84f80b3e70 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.182+0000 7f84fd200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f84f80aefa0 0x7f84f80b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.182+0000 7f84fd200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f84f80aefa0 0x7f84f80b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53840/0 (socket says 172.21.15.173:53840) 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.182+0000 7f84fd200640 1 -- 172.21.15.173:0/985301119 learned_addr learned my addr 172.21.15.173:0/985301119 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.182+0000 7f84fdc00640 1 --2- 172.21.15.173:0/985301119 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84f80b3e70 0x7f84f80b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.186+0000 7f84fd200640 1 -- 172.21.15.173:0/985301119 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84f80b3e70 msgr2=0x7f84f80b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:14.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.186+0000 7f84fd200640 1 --2- 172.21.15.173:0/985301119 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84f80b3e70 0x7f84f80b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.186+0000 7f84fd200640 1 -- 172.21.15.173:0/985301119 >> v1:172.21.15.194:6789/0 conn(0x7f84f815edd0 legacy=0x7f84f80b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.186+0000 7f84fd200640 1 -- 172.21.15.173:0/985301119 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f806d420 con 0x7f84f80aefa0 2024-04-25T09:12:14.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.186+0000 7f84fd200640 1 --2- 172.21.15.173:0/985301119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84f80aefa0 0x7f84f80b2770 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009870 tx=0x7f84e401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d86e4ac702a6e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:14.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.186+0000 7f84f7e00640 1 -- 172.21.15.173:0/985301119 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e40a9610 con 0x7f84f80aefa0 2024-04-25T09:12:14.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.186+0000 7f84f7e00640 1 -- 172.21.15.173:0/985301119 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e40a97b0 con 0x7f84f80aefa0 2024-04-25T09:12:14.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.186+0000 7f84f7e00640 1 -- 172.21.15.173:0/985301119 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e40a9b80 con 0x7f84f80aefa0 2024-04-25T09:12:14.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.186+0000 7f8500600640 1 -- 172.21.15.173:0/985301119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84f80aefa0 msgr2=0x7f84f80b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.186+0000 7f8500600640 1 --2- 172.21.15.173:0/985301119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84f80aefa0 0x7f84f80b2770 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009870 tx=0x7f84e401c530 comp rx=0 tx=0).stop 2024-04-25T09:12:14.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.186+0000 7f8500600640 1 -- 172.21.15.173:0/985301119 shutdown_connections 2024-04-25T09:12:14.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.186+0000 7f8500600640 1 --2- 172.21.15.173:0/985301119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84f80aefa0 0x7f84f80b2770 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.186+0000 7f8500600640 1 --2- 172.21.15.173:0/985301119 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84f80b3e70 0x7f84f80b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.186+0000 7f8500600640 1 -- 172.21.15.173:0/985301119 >> 172.21.15.173:0/985301119 conn(0x7f84f806ac90 msgr2=0x7f84f806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:14.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.186+0000 7f8500600640 1 -- 172.21.15.173:0/985301119 shutdown_connections 2024-04-25T09:12:14.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.186+0000 7f8500600640 1 -- 172.21.15.173:0/985301119 wait complete. 2024-04-25T09:12:14.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f8500600640 1 Processor -- start 2024-04-25T09:12:14.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f8500600640 1 -- start start 2024-04-25T09:12:14.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f8500600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84f80aefa0 0x7f84f80b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f8500600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84f80b3e70 0x7f84f80b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f8500600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84f815edd0 0x7f84f81f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f8500600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f806e1c0 con 0x7f84f80aefa0 2024-04-25T09:12:14.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f8500600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f815aba0 con 0x7f84f815edd0 2024-04-25T09:12:14.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f8500600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f806e340 con 0x7f84f80b3e70 2024-04-25T09:12:14.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f84fdc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84f80aefa0 0x7f84f80b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f84fdc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84f80aefa0 0x7f84f80b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53856/0 (socket says 172.21.15.173:53856) 2024-04-25T09:12:14.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f84fdc00640 1 -- 172.21.15.173:0/2082868306 learned_addr learned my addr 172.21.15.173:0/2082868306 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:14.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f84fd200640 1 --2- 172.21.15.173:0/2082868306 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84f80b3e70 0x7f84f80b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f84fe600640 1 --2- 172.21.15.173:0/2082868306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84f815edd0 0x7f84f81f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f84fdc00640 1 -- 172.21.15.173:0/2082868306 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84f80b3e70 msgr2=0x7f84f80b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f84fdc00640 1 --2- 172.21.15.173:0/2082868306 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84f80b3e70 0x7f84f80b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f84fdc00640 1 -- 172.21.15.173:0/2082868306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84f815edd0 msgr2=0x7f84f81f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f84fdc00640 1 --2- 172.21.15.173:0/2082868306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84f815edd0 0x7f84f81f5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f84fdc00640 1 -- 172.21.15.173:0/2082868306 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f80aa570 con 0x7f84f80aefa0 2024-04-25T09:12:14.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f84fdc00640 1 --2- 172.21.15.173:0/2082868306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84f80aefa0 0x7f84f80b29e0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00e870 tx=0x7f84ec00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:14.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f84f5600640 1 -- 172.21.15.173:0/2082868306 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec017070 con 0x7f84f80aefa0 2024-04-25T09:12:14.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f84f5600640 1 -- 172.21.15.173:0/2082868306 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ec00c940 con 0x7f84f80aefa0 2024-04-25T09:12:14.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f84f5600640 1 -- 172.21.15.173:0/2082868306 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec00ccf0 con 0x7f84f80aefa0 2024-04-25T09:12:14.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.190+0000 7f8500600640 1 -- 172.21.15.173:0/2082868306 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f80a9cd0 con 0x7f84f80aefa0 2024-04-25T09:12:14.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.194+0000 7f8500600640 1 -- 172.21.15.173:0/2082868306 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f80aa290 con 0x7f84f80aefa0 2024-04-25T09:12:14.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.194+0000 7f8500600640 1 -- 172.21.15.173:0/2082868306 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f8073a40 con 0x7f84f80aefa0 2024-04-25T09:12:14.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.194+0000 7f84f5600640 1 -- 172.21.15.173:0/2082868306 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f84ec01a070 con 0x7f84f80aefa0 2024-04-25T09:12:14.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.194+0000 7f84f5600640 1 --2- 172.21.15.173:0/2082868306 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84d8066f60 0x7f84d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.194+0000 7f84f5600640 1 -- 172.21.15.173:0/2082868306 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f84ec084fe0 con 0x7f84f80aefa0 2024-04-25T09:12:14.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.194+0000 7f84fd200640 1 --2- 172.21.15.173:0/2082868306 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84d8066f60 0x7f84d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.194+0000 7f84fd200640 1 --2- 172.21.15.173:0/2082868306 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84d8066f60 0x7f84d8069420 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f84e40ae000 tx=0x7f84e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:14.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.198+0000 7f84f5600640 1 -- 172.21.15.173:0/2082868306 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f84ec055820 con 0x7f84f80aefa0 2024-04-25T09:12:14.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.382+0000 7f8500600640 1 -- 172.21.15.173:0/2082868306 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84f806f1c0 con 0x7f84f80aefa0 2024-04-25T09:12:14.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.386+0000 7f84f5600640 1 -- 172.21.15.173:0/2082868306 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f84ec0598c0 con 0x7f84f80aefa0 2024-04-25T09:12:14.369 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:14.369 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1021410995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1021410995},{"type":"v1","addr":"172.21.15.194:6834","nonce":1021410995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2198134208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2198134208},{"type":"v1","addr":"172.21.15.194:6835","nonce":2198134208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8772,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/684989574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":684989574},{"type":"v1","addr":"172.21.15.173:6836","nonce":684989574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:26.148874+0000","modified":"2024-04-25T09:11:29.164422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8775":{"gid":8775,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/671971539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":671971539},{"type":"v1","addr":"172.21.15.173:6837","nonce":671971539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:12:14.370 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 81 2024-04-25T09:12:14.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.386+0000 7f8500600640 1 -- 172.21.15.173:0/2082868306 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84d8066f60 msgr2=0x7f84d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.386+0000 7f8500600640 1 --2- 172.21.15.173:0/2082868306 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84d8066f60 0x7f84d8069420 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f84e40ae000 tx=0x7f84e4009040 comp rx=0 tx=0).stop 2024-04-25T09:12:14.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.386+0000 7f8500600640 1 -- 172.21.15.173:0/2082868306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84f80aefa0 msgr2=0x7f84f80b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.386+0000 7f8500600640 1 --2- 172.21.15.173:0/2082868306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84f80aefa0 0x7f84f80b29e0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00e870 tx=0x7f84ec00ec70 comp rx=0 tx=0).stop 2024-04-25T09:12:14.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.386+0000 7f8500600640 1 -- 172.21.15.173:0/2082868306 shutdown_connections 2024-04-25T09:12:14.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.386+0000 7f8500600640 1 --2- 172.21.15.173:0/2082868306 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84d8066f60 0x7f84d8069420 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.386+0000 7f8500600640 1 --2- 172.21.15.173:0/2082868306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84f815edd0 0x7f84f81f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.386+0000 7f8500600640 1 --2- 172.21.15.173:0/2082868306 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84f80b3e70 0x7f84f80b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.386+0000 7f8500600640 1 --2- 172.21.15.173:0/2082868306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84f80aefa0 0x7f84f80b29e0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.386+0000 7f8500600640 1 -- 172.21.15.173:0/2082868306 >> 172.21.15.173:0/2082868306 conn(0x7f84f806ac90 msgr2=0x7f84f80cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:14.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.386+0000 7f8500600640 1 -- 172.21.15.173:0/2082868306 shutdown_connections 2024-04-25T09:12:14.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.386+0000 7f8500600640 1 -- 172.21.15.173:0/2082868306 wait complete. 2024-04-25T09:12:14.390 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:12:14.390 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:12:14.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.542+0000 7f3405800640 1 Processor -- start 2024-04-25T09:12:14.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.542+0000 7f3405800640 1 -- start start 2024-04-25T09:12:14.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.542+0000 7f3405800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f340015b980 0x7f34000707c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.542+0000 7f3405800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34000ccfb0 con 0x7f340006ac90 2024-04-25T09:12:14.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.542+0000 7f3405800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34000cd290 con 0x7f34000d0780 2024-04-25T09:12:14.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.542+0000 7f3405800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34000cd570 con 0x7f340015b980 2024-04-25T09:12:14.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.542+0000 7f33fe000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f340006ac90 0x7f340015bd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49192/0 (socket says 172.21.15.173:49192) 2024-04-25T09:12:14.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.542+0000 7f33fe000640 1 -- 172.21.15.173:0/2090105454 learned_addr learned my addr 172.21.15.173:0/2090105454 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:14.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.542+0000 7f33fea00640 1 --2- 172.21.15.173:0/2090105454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f340015b980 0x7f34000707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.542+0000 7f33fd600640 1 -- 172.21.15.173:0/2090105454 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043728861 0 0) 0x7f34000ccfb0 con 0x7f340006ac90 2024-04-25T09:12:14.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.542+0000 7f33fd600640 1 -- 172.21.15.173:0/2090105454 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33e4003530 con 0x7f340006ac90 2024-04-25T09:12:14.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.542+0000 7f33fd600640 1 -- 172.21.15.173:0/2090105454 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107397952 0 0) 0x7f34000cd290 con 0x7f34000d0780 2024-04-25T09:12:14.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.542+0000 7f33fd600640 1 -- 172.21.15.173:0/2090105454 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34000ccfb0 con 0x7f34000d0780 2024-04-25T09:12:14.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.542+0000 7f33fea00640 1 -- 172.21.15.173:0/2090105454 >> v1:172.21.15.194:6789/0 conn(0x7f34000d0780 legacy=0x7f340015c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.542+0000 7f33fea00640 1 -- 172.21.15.173:0/2090105454 >> v1:172.21.15.173:6789/0 conn(0x7f340006ac90 legacy=0x7f340015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.542+0000 7f33fea00640 1 -- 172.21.15.173:0/2090105454 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34000cd850 con 0x7f340015b980 2024-04-25T09:12:14.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.546+0000 7f33fea00640 1 --2- 172.21.15.173:0/2090105454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f340015b980 0x7f34000707c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f33e80097f0 tx=0x7f33e801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=938e3c0aefd95f14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:14.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.546+0000 7f33fd600640 1 -- 172.21.15.173:0/2090105454 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80aa610 con 0x7f340015b980 2024-04-25T09:12:14.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.546+0000 7f33fd600640 1 -- 172.21.15.173:0/2090105454 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e80af070 con 0x7f340015b980 2024-04-25T09:12:14.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.546+0000 7f33fd600640 1 -- 172.21.15.173:0/2090105454 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80aa9d0 con 0x7f340015b980 2024-04-25T09:12:14.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.546+0000 7f3405800640 1 -- 172.21.15.173:0/2090105454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f340015b980 msgr2=0x7f34000707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.546+0000 7f3405800640 1 --2- 172.21.15.173:0/2090105454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f340015b980 0x7f34000707c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f33e80097f0 tx=0x7f33e801c4b0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.546+0000 7f3405800640 1 -- 172.21.15.173:0/2090105454 shutdown_connections 2024-04-25T09:12:14.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.546+0000 7f3405800640 1 --2- 172.21.15.173:0/2090105454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f340015b980 0x7f34000707c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.546+0000 7f3405800640 1 -- 172.21.15.173:0/2090105454 >> 172.21.15.173:0/2090105454 conn(0x7f34000b23f0 msgr2=0x7f34000b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:14.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.546+0000 7f3405800640 1 -- 172.21.15.173:0/2090105454 shutdown_connections 2024-04-25T09:12:14.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.546+0000 7f3405800640 1 -- 172.21.15.173:0/2090105454 wait complete. 2024-04-25T09:12:14.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f3405800640 1 Processor -- start 2024-04-25T09:12:14.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f3405800640 1 -- start start 2024-04-25T09:12:14.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f3405800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f340006ac90 0x7f34000b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f3405800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34000d0780 0x7f3400153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f3405800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f340015b980 0x7f34001536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f3405800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3400072780 con 0x7f340006ac90 2024-04-25T09:12:14.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f3405800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3400072600 con 0x7f34000d0780 2024-04-25T09:12:14.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f3405800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340006b480 con 0x7f340015b980 2024-04-25T09:12:14.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f33fea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f340006ac90 0x7f34000b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f33fea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f340006ac90 0x7f34000b0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53862/0 (socket says 172.21.15.173:53862) 2024-04-25T09:12:14.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f33fea00640 1 -- 172.21.15.173:0/3130245754 learned_addr learned my addr 172.21.15.173:0/3130245754 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:14.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f33fe000640 1 --2- 172.21.15.173:0/3130245754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34000d0780 0x7f3400153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f33ff400640 1 --2- 172.21.15.173:0/3130245754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f340015b980 0x7f34001536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f33fea00640 1 -- 172.21.15.173:0/3130245754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f340015b980 msgr2=0x7f34001536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f33fea00640 1 --2- 172.21.15.173:0/3130245754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f340015b980 0x7f34001536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f33fea00640 1 -- 172.21.15.173:0/3130245754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34000d0780 msgr2=0x7f3400153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f33fea00640 1 --2- 172.21.15.173:0/3130245754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34000d0780 0x7f3400153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f33fea00640 1 -- 172.21.15.173:0/3130245754 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340014fa20 con 0x7f340006ac90 2024-04-25T09:12:14.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f33fea00640 1 --2- 172.21.15.173:0/3130245754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f340006ac90 0x7f34000b0f70 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f33e801a0e0 tx=0x7f33e8019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:14.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f33f6a00640 1 -- 172.21.15.173:0/3130245754 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80aabd0 con 0x7f340006ac90 2024-04-25T09:12:14.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f33f6a00640 1 -- 172.21.15.173:0/3130245754 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e80aadb0 con 0x7f340006ac90 2024-04-25T09:12:14.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f3405800640 1 -- 172.21.15.173:0/3130245754 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340014fd00 con 0x7f340006ac90 2024-04-25T09:12:14.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f33f6a00640 1 -- 172.21.15.173:0/3130245754 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80be690 con 0x7f340006ac90 2024-04-25T09:12:14.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.550+0000 7f3405800640 1 -- 172.21.15.173:0/3130245754 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34001502c0 con 0x7f340006ac90 2024-04-25T09:12:14.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.554+0000 7f3405800640 1 -- 172.21.15.173:0/3130245754 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3400073a40 con 0x7f340006ac90 2024-04-25T09:12:14.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.554+0000 7f33f6a00640 1 -- 172.21.15.173:0/3130245754 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f33e80be830 con 0x7f340006ac90 2024-04-25T09:12:14.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.554+0000 7f33f6a00640 1 --2- 172.21.15.173:0/3130245754 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f33dc066f60 0x7f33dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.554+0000 7f33f6a00640 1 -- 172.21.15.173:0/3130245754 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f33e811f630 con 0x7f340006ac90 2024-04-25T09:12:14.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.554+0000 7f33fe000640 1 --2- 172.21.15.173:0/3130245754 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f33dc066f60 0x7f33dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.554+0000 7f33fe000640 1 --2- 172.21.15.173:0/3130245754 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f33dc066f60 0x7f33dc069420 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f340015dd70 tx=0x7f33f0007d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:14.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.558+0000 7f33f6a00640 1 -- 172.21.15.173:0/3130245754 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f33e80a7070 con 0x7f340006ac90 2024-04-25T09:12:14.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.766+0000 7f3405800640 1 -- 172.21.15.173:0/3130245754 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f340015e880 con 0x7f340006ac90 2024-04-25T09:12:14.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.766+0000 7f33f6a00640 1 -- 172.21.15.173:0/3130245754 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1596 (secure 0 0 0) 0x7f33e80160d0 con 0x7f340006ac90 2024-04-25T09:12:14.752 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:14.752 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":589,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":122,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076689006,"bytes_used":2598600704,"bytes_avail":770495512576,"bytes_total":773094113280,"write_bytes_sec":1767024,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":81,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8775}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-04-25T09:12:04.850163+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:12:14.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.770+0000 7f3405800640 1 -- 172.21.15.173:0/3130245754 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f33dc066f60 msgr2=0x7f33dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.770+0000 7f3405800640 1 --2- 172.21.15.173:0/3130245754 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f33dc066f60 0x7f33dc069420 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f340015dd70 tx=0x7f33f0007d80 comp rx=0 tx=0).stop 2024-04-25T09:12:14.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.770+0000 7f3405800640 1 -- 172.21.15.173:0/3130245754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f340006ac90 msgr2=0x7f34000b0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.770+0000 7f3405800640 1 --2- 172.21.15.173:0/3130245754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f340006ac90 0x7f34000b0f70 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f33e801a0e0 tx=0x7f33e8019250 comp rx=0 tx=0).stop 2024-04-25T09:12:14.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.770+0000 7f3405800640 1 -- 172.21.15.173:0/3130245754 shutdown_connections 2024-04-25T09:12:14.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.770+0000 7f3405800640 1 --2- 172.21.15.173:0/3130245754 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f33dc066f60 0x7f33dc069420 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.770+0000 7f3405800640 1 --2- 172.21.15.173:0/3130245754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f340015b980 0x7f34001536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.770+0000 7f3405800640 1 --2- 172.21.15.173:0/3130245754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34000d0780 0x7f3400153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.770+0000 7f3405800640 1 --2- 172.21.15.173:0/3130245754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f340006ac90 0x7f34000b0f70 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.770+0000 7f3405800640 1 -- 172.21.15.173:0/3130245754 >> 172.21.15.173:0/3130245754 conn(0x7f34000b23f0 msgr2=0x7f3400070310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:14.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.770+0000 7f3405800640 1 -- 172.21.15.173:0/3130245754 shutdown_connections 2024-04-25T09:12:14.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:14.770+0000 7f3405800640 1 -- 172.21.15.173:0/3130245754 wait complete. 2024-04-25T09:12:14.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2024-04-25T09:12:15.325 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:12:15.328 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:12:15.775 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:15.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc890200640 1 Processor -- start 2024-04-25T09:12:15.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc890200640 1 -- start start 2024-04-25T09:12:15.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc890200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc88806ac90 0x7fc8880aee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc890200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc88815c850 0x7fc88806b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc890200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc88815f400 0x7fc88815f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc890200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc88806b5b0 con 0x7fc88806ac90 2024-04-25T09:12:15.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc890200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8880af550 con 0x7fc88815f400 2024-04-25T09:12:15.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc890200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880af830 con 0x7fc88815c850 2024-04-25T09:12:15.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc88d800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc88806ac90 0x7fc8880aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc88d800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc88806ac90 0x7fc8880aee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53878/0 (socket says 172.21.15.173:53878) 2024-04-25T09:12:15.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc88d800640 1 -- 172.21.15.173:0/510382650 learned_addr learned my addr 172.21.15.173:0/510382650 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:15.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc88ce00640 1 --2- 172.21.15.173:0/510382650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc88815c850 0x7fc88806b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc88d800640 1 -- 172.21.15.173:0/510382650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc88815c850 msgr2=0x7fc88806b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:15.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc88e200640 1 --2- 172.21.15.173:0/510382650 >> v2:172.21.15.194:3300/0 conn(0x7fc88815f400 0x7fc88815f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc88d800640 1 --2- 172.21.15.173:0/510382650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc88815c850 0x7fc88806b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc88d800640 1 -- 172.21.15.173:0/510382650 >> v2:172.21.15.194:3300/0 conn(0x7fc88815f400 msgr2=0x7fc88815f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:15.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc88d800640 1 --2- 172.21.15.173:0/510382650 >> v2:172.21.15.194:3300/0 conn(0x7fc88815f400 0x7fc88815f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc88d800640 1 -- 172.21.15.173:0/510382650 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8880afb10 con 0x7fc88806ac90 2024-04-25T09:12:15.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc88ce00640 1 --2- 172.21.15.173:0/510382650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc88815c850 0x7fc88806b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:15.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.934+0000 7fc88e200640 1 --2- 172.21.15.173:0/510382650 >> v2:172.21.15.194:3300/0 conn(0x7fc88815f400 0x7fc88815f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:15.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.938+0000 7fc88d800640 1 --2- 172.21.15.173:0/510382650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88806ac90 0x7fc8880aee70 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fc8880cc9b0 tx=0x7fc87c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40897c6e826bcc3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:15.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.938+0000 7fc887e00640 1 -- 172.21.15.173:0/510382650 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0b0070 con 0x7fc88806ac90 2024-04-25T09:12:15.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.938+0000 7fc887e00640 1 -- 172.21.15.173:0/510382650 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87c0ab600 con 0x7fc88806ac90 2024-04-25T09:12:15.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.938+0000 7fc887e00640 1 -- 172.21.15.173:0/510382650 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0ab9d0 con 0x7fc88806ac90 2024-04-25T09:12:15.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.938+0000 7fc890200640 1 -- 172.21.15.173:0/510382650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88806ac90 msgr2=0x7fc8880aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.938+0000 7fc890200640 1 --2- 172.21.15.173:0/510382650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88806ac90 0x7fc8880aee70 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fc8880cc9b0 tx=0x7fc87c01c520 comp rx=0 tx=0).stop 2024-04-25T09:12:15.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.938+0000 7fc890200640 1 -- 172.21.15.173:0/510382650 shutdown_connections 2024-04-25T09:12:15.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.938+0000 7fc890200640 1 --2- 172.21.15.173:0/510382650 >> v2:172.21.15.194:3300/0 conn(0x7fc88815f400 0x7fc88815f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.938+0000 7fc890200640 1 --2- 172.21.15.173:0/510382650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc88815c850 0x7fc88806b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.938+0000 7fc890200640 1 --2- 172.21.15.173:0/510382650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88806ac90 0x7fc8880aee70 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.938+0000 7fc890200640 1 -- 172.21.15.173:0/510382650 >> 172.21.15.173:0/510382650 conn(0x7fc888099a50 msgr2=0x7fc8880b5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:15.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.938+0000 7fc890200640 1 -- 172.21.15.173:0/510382650 shutdown_connections 2024-04-25T09:12:15.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.938+0000 7fc890200640 1 -- 172.21.15.173:0/510382650 wait complete. 2024-04-25T09:12:15.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc890200640 1 Processor -- start 2024-04-25T09:12:15.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc890200640 1 -- start start 2024-04-25T09:12:15.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc890200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc88806ac90 0x7fc88815a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc890200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc88815c850 0x7fc8881f85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc890200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88815f400 0x7fc888159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc890200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc888145630 con 0x7fc88815f400 2024-04-25T09:12:15.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc890200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8881454b0 con 0x7fc88806ac90 2024-04-25T09:12:15.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc890200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88815ddd0 con 0x7fc88815c850 2024-04-25T09:12:15.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc88e200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88815f400 0x7fc888159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc88e200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88815f400 0x7fc888159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53884/0 (socket says 172.21.15.173:53884) 2024-04-25T09:12:15.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc88e200640 1 -- 172.21.15.173:0/1923193974 learned_addr learned my addr 172.21.15.173:0/1923193974 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:15.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc88ce00640 1 --2- 172.21.15.173:0/1923193974 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc88815c850 0x7fc8881f85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc88d800640 1 --2- 172.21.15.173:0/1923193974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc88806ac90 0x7fc88815a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc88e200640 1 -- 172.21.15.173:0/1923193974 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc88815c850 msgr2=0x7fc8881f85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc88e200640 1 --2- 172.21.15.173:0/1923193974 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc88815c850 0x7fc8881f85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc88e200640 1 -- 172.21.15.173:0/1923193974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc88806ac90 msgr2=0x7fc88815a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc88e200640 1 --2- 172.21.15.173:0/1923193974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc88806ac90 0x7fc88815a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc88e200640 1 -- 172.21.15.173:0/1923193974 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88815aa10 con 0x7fc88815f400 2024-04-25T09:12:15.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc88e200640 1 --2- 172.21.15.173:0/1923193974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88815f400 0x7fc888159b40 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fc88000cd80 tx=0x7fc88000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:15.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc885600640 1 -- 172.21.15.173:0/1923193974 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88000f680 con 0x7fc88815f400 2024-04-25T09:12:15.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc885600640 1 -- 172.21.15.173:0/1923193974 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88000f840 con 0x7fc88815f400 2024-04-25T09:12:15.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc890200640 1 -- 172.21.15.173:0/1923193974 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88815acf0 con 0x7fc88815f400 2024-04-25T09:12:15.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc885600640 1 -- 172.21.15.173:0/1923193974 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88000fc30 con 0x7fc88815f400 2024-04-25T09:12:15.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc890200640 1 -- 172.21.15.173:0/1923193974 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88815b2b0 con 0x7fc88815f400 2024-04-25T09:12:15.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.942+0000 7fc890200640 1 -- 172.21.15.173:0/1923193974 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc888073a40 con 0x7fc88815f400 2024-04-25T09:12:15.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.946+0000 7fc885600640 1 -- 172.21.15.173:0/1923193974 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc8800213f0 con 0x7fc88815f400 2024-04-25T09:12:15.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.946+0000 7fc885600640 1 --2- 172.21.15.173:0/1923193974 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc868066f60 0x7fc868069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.946+0000 7fc885600640 1 -- 172.21.15.173:0/1923193974 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc880085f00 con 0x7fc88815f400 2024-04-25T09:12:15.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.946+0000 7fc88d800640 1 --2- 172.21.15.173:0/1923193974 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc868066f60 0x7fc868069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.946+0000 7fc88d800640 1 --2- 172.21.15.173:0/1923193974 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc868066f60 0x7fc868069420 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0ad000 tx=0x7fc87c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:15.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:15.950+0000 7fc885600640 1 -- 172.21.15.173:0/1923193974 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc880014030 con 0x7fc88815f400 2024-04-25T09:12:16.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.134+0000 7fc890200640 1 -- 172.21.15.173:0/1923193974 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc88815f170 con 0x7fc88815f400 2024-04-25T09:12:16.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.134+0000 7fc885600640 1 -- 172.21.15.173:0/1923193974 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fc880056690 con 0x7fc88815f400 2024-04-25T09:12:16.121 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:16.121 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1021410995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1021410995},{"type":"v1","addr":"172.21.15.194:6834","nonce":1021410995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2198134208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2198134208},{"type":"v1","addr":"172.21.15.194:6835","nonce":2198134208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8772,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/684989574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":684989574},{"type":"v1","addr":"172.21.15.173:6836","nonce":684989574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:26.148874+0000","modified":"2024-04-25T09:11:29.164422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8775":{"gid":8775,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/671971539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":671971539},{"type":"v1","addr":"172.21.15.173:6837","nonce":671971539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:12:16.121 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 81 2024-04-25T09:12:16.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.138+0000 7fc890200640 1 -- 172.21.15.173:0/1923193974 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc868066f60 msgr2=0x7fc868069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.138+0000 7fc890200640 1 --2- 172.21.15.173:0/1923193974 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc868066f60 0x7fc868069420 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0ad000 tx=0x7fc87c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:12:16.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.138+0000 7fc890200640 1 -- 172.21.15.173:0/1923193974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88815f400 msgr2=0x7fc888159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.138+0000 7fc890200640 1 --2- 172.21.15.173:0/1923193974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88815f400 0x7fc888159b40 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fc88000cd80 tx=0x7fc88000a650 comp rx=0 tx=0).stop 2024-04-25T09:12:16.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.138+0000 7fc890200640 1 -- 172.21.15.173:0/1923193974 shutdown_connections 2024-04-25T09:12:16.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.138+0000 7fc890200640 1 --2- 172.21.15.173:0/1923193974 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc868066f60 0x7fc868069420 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.138+0000 7fc890200640 1 --2- 172.21.15.173:0/1923193974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc88815f400 0x7fc888159b40 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.138+0000 7fc890200640 1 --2- 172.21.15.173:0/1923193974 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc88815c850 0x7fc8881f85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.138+0000 7fc890200640 1 --2- 172.21.15.173:0/1923193974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc88806ac90 0x7fc88815a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.138+0000 7fc890200640 1 -- 172.21.15.173:0/1923193974 >> 172.21.15.173:0/1923193974 conn(0x7fc888099a50 msgr2=0x7fc8880b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.138+0000 7fc890200640 1 -- 172.21.15.173:0/1923193974 shutdown_connections 2024-04-25T09:12:16.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.138+0000 7fc890200640 1 -- 172.21.15.173:0/1923193974 wait complete. 2024-04-25T09:12:16.142 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:12:16.142 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:12:16.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a6b000640 1 Processor -- start 2024-04-25T09:12:16.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a6b000640 1 -- start start 2024-04-25T09:12:16.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a6b000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a6415edd0 0x7f4a640cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a6b000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6415f320 con 0x7f4a640aefa0 2024-04-25T09:12:16.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a6b000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6406d420 con 0x7f4a640b3e70 2024-04-25T09:12:16.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a6b000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6406dd50 con 0x7f4a6415edd0 2024-04-25T09:12:16.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a63400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4a640aefa0 0x7f4a640cd7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49202/0 (socket says 172.21.15.173:49202) 2024-04-25T09:12:16.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a63400640 1 -- 172.21.15.173:0/3743699478 learned_addr learned my addr 172.21.15.173:0/3743699478 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:16.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a69000640 1 --2- 172.21.15.173:0/3743699478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a6415edd0 0x7f4a640cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a62a00640 1 -- 172.21.15.173:0/3743699478 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495159080 0 0) 0x7f4a6415f320 con 0x7f4a640aefa0 2024-04-25T09:12:16.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a62a00640 1 -- 172.21.15.173:0/3743699478 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a48003530 con 0x7f4a640aefa0 2024-04-25T09:12:16.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a62a00640 1 -- 172.21.15.173:0/3743699478 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2061885159 0 0) 0x7f4a48003530 con 0x7f4a640aefa0 2024-04-25T09:12:16.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a62a00640 1 -- 172.21.15.173:0/3743699478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a6415edd0 msgr2=0x7f4a640cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:16.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a62a00640 1 --2- 172.21.15.173:0/3743699478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a6415edd0 0x7f4a640cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a62a00640 1 -- 172.21.15.173:0/3743699478 >> v1:172.21.15.194:6789/0 conn(0x7f4a640b3e70 legacy=0x7f4a640b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a62a00640 1 -- 172.21.15.173:0/3743699478 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6406d700 con 0x7f4a640aefa0 2024-04-25T09:12:16.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a62a00640 1 -- 172.21.15.173:0/3743699478 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f4a50001680 con 0x7f4a640aefa0 2024-04-25T09:12:16.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a62a00640 1 -- 172.21.15.173:0/3743699478 >> v1:172.21.15.173:6789/0 conn(0x7f4a640aefa0 legacy=0x7f4a640cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a62a00640 1 --2- 172.21.15.173:0/3743699478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a480039f0 0x7f4a48003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a62a00640 1 --2- 172.21.15.173:0/3743699478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a6415edd0 0x7f4a48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a62a00640 1 --2- 172.21.15.173:0/3743699478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a48004d50 0x7f4a480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a62a00640 1 -- 172.21.15.173:0/3743699478 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6406dd50 con 0x7f4a48004d50 2024-04-25T09:12:16.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a62a00640 1 -- 172.21.15.173:0/3743699478 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4800bb10 con 0x7f4a480039f0 2024-04-25T09:12:16.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a62a00640 1 -- 172.21.15.173:0/3743699478 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4800bd10 con 0x7f4a6415edd0 2024-04-25T09:12:16.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a69000640 1 --2- 172.21.15.173:0/3743699478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a48004d50 0x7f4a480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a63400640 1 --2- 172.21.15.173:0/3743699478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a6415edd0 0x7f4a48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a63e00640 1 --2- 172.21.15.173:0/3743699478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a480039f0 0x7f4a48003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a69000640 1 -- 172.21.15.173:0/3743699478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a6415edd0 msgr2=0x7f4a48004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:16.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a69000640 1 --2- 172.21.15.173:0/3743699478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a6415edd0 0x7f4a48004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a69000640 1 -- 172.21.15.173:0/3743699478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a480039f0 msgr2=0x7f4a48003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:16.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a69000640 1 --2- 172.21.15.173:0/3743699478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a480039f0 0x7f4a48003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.294+0000 7f4a69000640 1 -- 172.21.15.173:0/3743699478 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a48003530 con 0x7f4a48004d50 2024-04-25T09:12:16.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.298+0000 7f4a69000640 1 --2- 172.21.15.173:0/3743699478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a48004d50 0x7f4a480051d0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c009f90 tx=0x7f4a5c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=259a7a6a6b4c8c28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.298+0000 7f4a62a00640 1 -- 172.21.15.173:0/3743699478 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c0b2070 con 0x7f4a48004d50 2024-04-25T09:12:16.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.298+0000 7f4a62a00640 1 -- 172.21.15.173:0/3743699478 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5c0a5c50 con 0x7f4a48004d50 2024-04-25T09:12:16.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.298+0000 7f4a62a00640 1 -- 172.21.15.173:0/3743699478 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c009c10 con 0x7f4a48004d50 2024-04-25T09:12:16.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.298+0000 7f4a6b000640 1 -- 172.21.15.173:0/3743699478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a48004d50 msgr2=0x7f4a480051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.298+0000 7f4a6b000640 1 --2- 172.21.15.173:0/3743699478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a48004d50 0x7f4a480051d0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c009f90 tx=0x7f4a5c01cc40 comp rx=0 tx=0).stop 2024-04-25T09:12:16.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.298+0000 7f4a69000640 1 -- 172.21.15.173:0/3743699478 reap_dead start 2024-04-25T09:12:16.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.298+0000 7f4a6b000640 1 -- 172.21.15.173:0/3743699478 shutdown_connections 2024-04-25T09:12:16.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.298+0000 7f4a6b000640 1 -- 172.21.15.173:0/3743699478 >> 172.21.15.173:0/3743699478 conn(0x7f4a6406ac90 msgr2=0x7f4a6406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.298+0000 7f4a6b000640 1 -- 172.21.15.173:0/3743699478 shutdown_connections 2024-04-25T09:12:16.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.298+0000 7f4a6b000640 1 -- 172.21.15.173:0/3743699478 wait complete. 2024-04-25T09:12:16.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a6b000640 1 Processor -- start 2024-04-25T09:12:16.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a6b000640 1 -- start start 2024-04-25T09:12:16.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a6b000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a48004d50 0x7f4a64153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a6b000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a641f00e0 0x7f4a6415d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a6b000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a641f0560 0x7f4a6415d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a6b000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6406e1e0 con 0x7f4a641f0560 2024-04-25T09:12:16.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a6b000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6415aba0 con 0x7f4a48004d50 2024-04-25T09:12:16.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a6b000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6406e360 con 0x7f4a641f00e0 2024-04-25T09:12:16.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a69000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a641f0560 0x7f4a6415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a69000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a641f0560 0x7f4a6415d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53898/0 (socket says 172.21.15.173:53898) 2024-04-25T09:12:16.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a69000640 1 -- 172.21.15.173:0/2118128526 learned_addr learned my addr 172.21.15.173:0/2118128526 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:16.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a69000640 1 -- 172.21.15.173:0/2118128526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a641f00e0 msgr2=0x7f4a6415d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a69000640 1 --2- 172.21.15.173:0/2118128526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a641f00e0 0x7f4a6415d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a69000640 1 -- 172.21.15.173:0/2118128526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a48004d50 msgr2=0x7f4a64153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a69000640 1 --2- 172.21.15.173:0/2118128526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a48004d50 0x7f4a64153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a69000640 1 -- 172.21.15.173:0/2118128526 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a640d02e0 con 0x7f4a641f0560 2024-04-25T09:12:16.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a69000640 1 --2- 172.21.15.173:0/2118128526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a641f0560 0x7f4a6415d660 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c0b0040 tx=0x7f4a5c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a5be00640 1 -- 172.21.15.173:0/2118128526 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c0bd070 con 0x7f4a641f0560 2024-04-25T09:12:16.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a5be00640 1 -- 172.21.15.173:0/2118128526 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5c0a5a50 con 0x7f4a641f0560 2024-04-25T09:12:16.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a5be00640 1 -- 172.21.15.173:0/2118128526 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c0b2040 con 0x7f4a641f0560 2024-04-25T09:12:16.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a6b000640 1 -- 172.21.15.173:0/2118128526 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a64158200 con 0x7f4a641f0560 2024-04-25T09:12:16.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.302+0000 7f4a6b000640 1 -- 172.21.15.173:0/2118128526 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a641587c0 con 0x7f4a641f0560 2024-04-25T09:12:16.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.306+0000 7f4a6b000640 1 -- 172.21.15.173:0/2118128526 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a64073a40 con 0x7f4a641f0560 2024-04-25T09:12:16.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.306+0000 7f4a5be00640 1 -- 172.21.15.173:0/2118128526 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4a5c0c0070 con 0x7f4a641f0560 2024-04-25T09:12:16.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.306+0000 7f4a5be00640 1 --2- 172.21.15.173:0/2118128526 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4a44066f60 0x7f4a44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.306+0000 7f4a5be00640 1 -- 172.21.15.173:0/2118128526 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4a5c11ed20 con 0x7f4a641f0560 2024-04-25T09:12:16.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.306+0000 7f4a63e00640 1 --2- 172.21.15.173:0/2118128526 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4a44066f60 0x7f4a44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.306+0000 7f4a63e00640 1 --2- 172.21.15.173:0/2118128526 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4a44066f60 0x7f4a44069420 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4a54007fd0 tx=0x7f4a54009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.310+0000 7f4a5be00640 1 -- 172.21.15.173:0/2118128526 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4a5c016950 con 0x7f4a641f0560 2024-04-25T09:12:16.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.518+0000 7f4a6b000640 1 -- 172.21.15.173:0/2118128526 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4a6406f1c0 con 0x7f4a641f0560 2024-04-25T09:12:16.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.522+0000 7f4a5be00640 1 -- 172.21.15.173:0/2118128526 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1571 (secure 0 0 0) 0x7f4a5c0a5c20 con 0x7f4a641f0560 2024-04-25T09:12:16.505 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:16.505 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":590,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":122,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076689006,"bytes_used":2598600704,"bytes_avail":770495512576,"bytes_total":773094113280,"write_bytes_sec":19793,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":81,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8775}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2024-04-25T09:12:14.852371+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:12:16.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.522+0000 7f4a6b000640 1 -- 172.21.15.173:0/2118128526 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4a44066f60 msgr2=0x7f4a44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.522+0000 7f4a6b000640 1 --2- 172.21.15.173:0/2118128526 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4a44066f60 0x7f4a44069420 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4a54007fd0 tx=0x7f4a54009040 comp rx=0 tx=0).stop 2024-04-25T09:12:16.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.522+0000 7f4a6b000640 1 -- 172.21.15.173:0/2118128526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a641f0560 msgr2=0x7f4a6415d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.522+0000 7f4a6b000640 1 --2- 172.21.15.173:0/2118128526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a641f0560 0x7f4a6415d660 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c0b0040 tx=0x7f4a5c009750 comp rx=0 tx=0).stop 2024-04-25T09:12:16.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.522+0000 7f4a6b000640 1 -- 172.21.15.173:0/2118128526 shutdown_connections 2024-04-25T09:12:16.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.522+0000 7f4a6b000640 1 --2- 172.21.15.173:0/2118128526 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4a44066f60 0x7f4a44069420 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.522+0000 7f4a6b000640 1 --2- 172.21.15.173:0/2118128526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a641f0560 0x7f4a6415d660 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.522+0000 7f4a6b000640 1 --2- 172.21.15.173:0/2118128526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a641f00e0 0x7f4a6415d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.522+0000 7f4a6b000640 1 --2- 172.21.15.173:0/2118128526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a48004d50 0x7f4a64153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.522+0000 7f4a6b000640 1 -- 172.21.15.173:0/2118128526 >> 172.21.15.173:0/2118128526 conn(0x7f4a6406ac90 msgr2=0x7f4a640b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.522+0000 7f4a6b000640 1 -- 172.21.15.173:0/2118128526 shutdown_connections 2024-04-25T09:12:16.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.522+0000 7f4a6b000640 1 -- 172.21.15.173:0/2118128526 wait complete. 2024-04-25T09:12:16.527 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:12:16.528 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:12:16.528 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:12:16.615 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:12:16.717 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:12:16.718 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:12:16.718 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:16.727 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:12:16.727 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:16.776 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:16.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.966+0000 7f1f62800640 1 Processor -- start 2024-04-25T09:12:16.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.966+0000 7f1f62800640 1 -- start start 2024-04-25T09:12:16.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.970+0000 7f1f62800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1f5c0b3e70 0x7f1f5c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.970+0000 7f1f62800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f5c0aefa0 0x7f1f5c0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.970+0000 7f1f62800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5c0b4790 con 0x7f1f5c15edd0 2024-04-25T09:12:16.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.970+0000 7f1f62800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5c06dd50 con 0x7f1f5c0b3e70 2024-04-25T09:12:16.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.970+0000 7f1f62800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c15f320 con 0x7f1f5c0aefa0 2024-04-25T09:12:16.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.970+0000 7f1f5b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1f5c0b3e70 0x7f1f5c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.970+0000 7f1f5b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1f5c0b3e70 0x7f1f5c0b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53914/0 (socket says 172.21.15.173:53914) 2024-04-25T09:12:16.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.970+0000 7f1f5b400640 1 -- 172.21.15.173:0/3279271606 learned_addr learned my addr 172.21.15.173:0/3279271606 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:16.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.970+0000 7f1f52a00640 1 --2- 172.21.15.173:0/3279271606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f5c0aefa0 0x7f1f5c0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.970+0000 7f1f5b400640 1 -- 172.21.15.173:0/3279271606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f5c0aefa0 msgr2=0x7f1f5c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:16.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.970+0000 7f1f5b400640 1 --2- 172.21.15.173:0/3279271606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f5c0aefa0 0x7f1f5c0b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.970+0000 7f1f5b400640 1 -- 172.21.15.173:0/3279271606 >> v1:172.21.15.194:6789/0 conn(0x7f1f5c15edd0 legacy=0x7f1f5c0b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.970+0000 7f1f5b400640 1 -- 172.21.15.173:0/3279271606 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c06d420 con 0x7f1f5c0b3e70 2024-04-25T09:12:16.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.974+0000 7f1f5b400640 1 --2- 172.21.15.173:0/3279271606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f5c0b3e70 0x7f1f5c0b4250 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009870 tx=0x7f1f4c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed608250009860c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.974+0000 7f1f5aa00640 1 -- 172.21.15.173:0/3279271606 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0a9610 con 0x7f1f5c0b3e70 2024-04-25T09:12:16.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.974+0000 7f1f5aa00640 1 -- 172.21.15.173:0/3279271606 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c0a97b0 con 0x7f1f5c0b3e70 2024-04-25T09:12:16.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.974+0000 7f1f5aa00640 1 -- 172.21.15.173:0/3279271606 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0a9b80 con 0x7f1f5c0b3e70 2024-04-25T09:12:16.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.974+0000 7f1f62800640 1 -- 172.21.15.173:0/3279271606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f5c0b3e70 msgr2=0x7f1f5c0b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.974+0000 7f1f62800640 1 --2- 172.21.15.173:0/3279271606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f5c0b3e70 0x7f1f5c0b4250 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009870 tx=0x7f1f4c01c530 comp rx=0 tx=0).stop 2024-04-25T09:12:16.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.974+0000 7f1f62800640 1 -- 172.21.15.173:0/3279271606 shutdown_connections 2024-04-25T09:12:16.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.974+0000 7f1f62800640 1 --2- 172.21.15.173:0/3279271606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f5c0aefa0 0x7f1f5c0b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.974+0000 7f1f62800640 1 --2- 172.21.15.173:0/3279271606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f5c0b3e70 0x7f1f5c0b4250 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.974+0000 7f1f62800640 1 -- 172.21.15.173:0/3279271606 >> 172.21.15.173:0/3279271606 conn(0x7f1f5c06ac90 msgr2=0x7f1f5c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.974+0000 7f1f62800640 1 -- 172.21.15.173:0/3279271606 shutdown_connections 2024-04-25T09:12:16.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.974+0000 7f1f62800640 1 -- 172.21.15.173:0/3279271606 wait complete. 2024-04-25T09:12:16.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.974+0000 7f1f62800640 1 Processor -- start 2024-04-25T09:12:16.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.974+0000 7f1f62800640 1 -- start start 2024-04-25T09:12:16.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f62800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f5c0aefa0 0x7f1f5c14dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f62800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f5c0b3e70 0x7f1f5c0b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f62800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f5c15edd0 0x7f1f5c15ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f62800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c06e1e0 con 0x7f1f5c0aefa0 2024-04-25T09:12:16.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f62800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c15aba0 con 0x7f1f5c0b3e70 2024-04-25T09:12:16.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f62800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c06e360 con 0x7f1f5c15edd0 2024-04-25T09:12:16.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f5b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f5c0aefa0 0x7f1f5c14dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f5b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f5c0aefa0 0x7f1f5c14dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53920/0 (socket says 172.21.15.173:53920) 2024-04-25T09:12:16.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f5b400640 1 -- 172.21.15.173:0/798459072 learned_addr learned my addr 172.21.15.173:0/798459072 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:16.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f52a00640 1 --2- 172.21.15.173:0/798459072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f5c0b3e70 0x7f1f5c0b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f5be00640 1 --2- 172.21.15.173:0/798459072 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f5c15edd0 0x7f1f5c15ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f5b400640 1 -- 172.21.15.173:0/798459072 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f5c15edd0 msgr2=0x7f1f5c15ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f5b400640 1 --2- 172.21.15.173:0/798459072 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f5c15edd0 0x7f1f5c15ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f5b400640 1 -- 172.21.15.173:0/798459072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f5c0b3e70 msgr2=0x7f1f5c0b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f5b400640 1 --2- 172.21.15.173:0/798459072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f5c0b3e70 0x7f1f5c0b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f5b400640 1 -- 172.21.15.173:0/798459072 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c0b1ea0 con 0x7f1f5c0aefa0 2024-04-25T09:12:16.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f5b400640 1 --2- 172.21.15.173:0/798459072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f5c0aefa0 0x7f1f5c14dab0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c01abe0 tx=0x7f1f4c0192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f53e00640 1 -- 172.21.15.173:0/798459072 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0a9610 con 0x7f1f5c0aefa0 2024-04-25T09:12:16.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f53e00640 1 -- 172.21.15.173:0/798459072 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c0b9630 con 0x7f1f5c0aefa0 2024-04-25T09:12:16.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f53e00640 1 -- 172.21.15.173:0/798459072 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0b9a20 con 0x7f1f5c0aefa0 2024-04-25T09:12:16.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f62800640 1 -- 172.21.15.173:0/798459072 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5c0b2180 con 0x7f1f5c0aefa0 2024-04-25T09:12:16.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f62800640 1 -- 172.21.15.173:0/798459072 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5c0b2740 con 0x7f1f5c0aefa0 2024-04-25T09:12:16.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f62800640 1 -- 172.21.15.173:0/798459072 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5c073a40 con 0x7f1f5c0aefa0 2024-04-25T09:12:16.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.978+0000 7f1f53e00640 1 -- 172.21.15.173:0/798459072 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1f4c0b9bc0 con 0x7f1f5c0aefa0 2024-04-25T09:12:16.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.982+0000 7f1f53e00640 1 --2- 172.21.15.173:0/798459072 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1f38066f60 0x7f1f38069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.982+0000 7f1f53e00640 1 -- 172.21.15.173:0/798459072 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1f4c11ede0 con 0x7f1f5c0aefa0 2024-04-25T09:12:16.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.982+0000 7f1f52a00640 1 --2- 172.21.15.173:0/798459072 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1f38066f60 0x7f1f38069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.982+0000 7f1f52a00640 1 --2- 172.21.15.173:0/798459072 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1f38066f60 0x7f1f38069420 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c153cf0 tx=0x7f1f44009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:16.986+0000 7f1f53e00640 1 -- 172.21.15.173:0/798459072 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1f4c0c0030 con 0x7f1f5c0aefa0 2024-04-25T09:12:17.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.138+0000 7f1f62800640 1 -- 172.21.15.173:0/798459072 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f5c06e540 con 0x7f1f5c0aefa0 2024-04-25T09:12:17.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.142+0000 7f1f53e00640 1 -- 172.21.15.173:0/798459072 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+17012 (secure 0 0 0) 0x7f1f4c0ad020 con 0x7f1f5c0aefa0 2024-04-25T09:12:17.125 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:17.125 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":122,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:11:27.763236+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:11:24.499900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T09:11:25.140140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:17.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.142+0000 7f1f62800640 1 -- 172.21.15.173:0/798459072 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1f38066f60 msgr2=0x7f1f38069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.142+0000 7f1f62800640 1 --2- 172.21.15.173:0/798459072 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1f38066f60 0x7f1f38069420 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c153cf0 tx=0x7f1f44009190 comp rx=0 tx=0).stop 2024-04-25T09:12:17.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.142+0000 7f1f62800640 1 -- 172.21.15.173:0/798459072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f5c0aefa0 msgr2=0x7f1f5c14dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.142+0000 7f1f62800640 1 --2- 172.21.15.173:0/798459072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f5c0aefa0 0x7f1f5c14dab0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c01abe0 tx=0x7f1f4c0192d0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.142+0000 7f1f62800640 1 -- 172.21.15.173:0/798459072 shutdown_connections 2024-04-25T09:12:17.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.142+0000 7f1f62800640 1 --2- 172.21.15.173:0/798459072 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1f38066f60 0x7f1f38069420 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.142+0000 7f1f62800640 1 --2- 172.21.15.173:0/798459072 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f5c15edd0 0x7f1f5c15ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.142+0000 7f1f62800640 1 --2- 172.21.15.173:0/798459072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f5c0b3e70 0x7f1f5c0b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.142+0000 7f1f62800640 1 --2- 172.21.15.173:0/798459072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f5c0aefa0 0x7f1f5c14dab0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.142+0000 7f1f62800640 1 -- 172.21.15.173:0/798459072 >> 172.21.15.173:0/798459072 conn(0x7f1f5c06ac90 msgr2=0x7f1f5c150f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:17.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.142+0000 7f1f62800640 1 -- 172.21.15.173:0/798459072 shutdown_connections 2024-04-25T09:12:17.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.142+0000 7f1f62800640 1 -- 172.21.15.173:0/798459072 wait complete. 2024-04-25T09:12:17.146 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:11:24.499900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:11:25.140140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:12:17.146 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:12:17.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.298+0000 7fcffa400640 1 Processor -- start 2024-04-25T09:12:17.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.298+0000 7fcffa400640 1 -- start start 2024-04-25T09:12:17.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.302+0000 7fcffa400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcff4145290 0x7fcff415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.302+0000 7fcffa400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcff40b3fe0 0x7fcff40b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.302+0000 7fcffa400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff415c5f0 con 0x7fcff40cc260 2024-04-25T09:12:17.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.302+0000 7fcffa400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff406d4b0 con 0x7fcff40b3fe0 2024-04-25T09:12:17.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.302+0000 7fcffa400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff406d790 con 0x7fcff4145290 2024-04-25T09:12:17.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.302+0000 7fcff2a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcff40b3fe0 0x7fcff40b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.302+0000 7fcff2a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcff40b3fe0 0x7fcff40b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53936/0 (socket says 172.21.15.173:53936) 2024-04-25T09:12:17.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.302+0000 7fcff2a00640 1 -- 172.21.15.173:0/3132150429 learned_addr learned my addr 172.21.15.173:0/3132150429 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:17.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.302+0000 7fcff3400640 1 --2- 172.21.15.173:0/3132150429 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcff4145290 0x7fcff415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.302+0000 7fcff2a00640 1 -- 172.21.15.173:0/3132150429 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcff4145290 msgr2=0x7fcff415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:17.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.302+0000 7fcff2a00640 1 --2- 172.21.15.173:0/3132150429 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcff4145290 0x7fcff415c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.302+0000 7fcff2a00640 1 -- 172.21.15.173:0/3132150429 >> v1:172.21.15.194:6789/0 conn(0x7fcff40cc260 legacy=0x7fcff40cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.302+0000 7fcff2a00640 1 -- 172.21.15.173:0/3132150429 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff406da70 con 0x7fcff40b3fe0 2024-04-25T09:12:17.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.306+0000 7fcff2a00640 1 --2- 172.21.15.173:0/3132150429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff40b3fe0 0x7fcff40b4420 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009870 tx=0x7fcfe001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd51713ce680c89c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.306+0000 7fcff2000640 1 -- 172.21.15.173:0/3132150429 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00b0070 con 0x7fcff40b3fe0 2024-04-25T09:12:17.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.306+0000 7fcff2000640 1 -- 172.21.15.173:0/3132150429 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe0004230 con 0x7fcff40b3fe0 2024-04-25T09:12:17.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.306+0000 7fcff2000640 1 -- 172.21.15.173:0/3132150429 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0003620 con 0x7fcff40b3fe0 2024-04-25T09:12:17.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.306+0000 7fcffa400640 1 -- 172.21.15.173:0/3132150429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff40b3fe0 msgr2=0x7fcff40b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.306+0000 7fcffa400640 1 --2- 172.21.15.173:0/3132150429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff40b3fe0 0x7fcff40b4420 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009870 tx=0x7fcfe001c440 comp rx=0 tx=0).stop 2024-04-25T09:12:17.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.306+0000 7fcffa400640 1 -- 172.21.15.173:0/3132150429 shutdown_connections 2024-04-25T09:12:17.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.306+0000 7fcffa400640 1 --2- 172.21.15.173:0/3132150429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff40b3fe0 0x7fcff40b4420 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.306+0000 7fcffa400640 1 --2- 172.21.15.173:0/3132150429 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcff4145290 0x7fcff415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.306+0000 7fcffa400640 1 -- 172.21.15.173:0/3132150429 >> 172.21.15.173:0/3132150429 conn(0x7fcff406ac90 msgr2=0x7fcff406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:17.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.306+0000 7fcffa400640 1 -- 172.21.15.173:0/3132150429 shutdown_connections 2024-04-25T09:12:17.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.306+0000 7fcffa400640 1 -- 172.21.15.173:0/3132150429 wait complete. 2024-04-25T09:12:17.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.306+0000 7fcffa400640 1 Processor -- start 2024-04-25T09:12:17.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.306+0000 7fcffa400640 1 -- start start 2024-04-25T09:12:17.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcffa400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcff40b3fe0 0x7fcff40af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcffa400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcff40cc260 0x7fcff40b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcffa400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff4145290 0x7fcff413e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcffa400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff406eee0 con 0x7fcff4145290 2024-04-25T09:12:17.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcffa400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff406ed60 con 0x7fcff40b3fe0 2024-04-25T09:12:17.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcffa400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff406f060 con 0x7fcff40cc260 2024-04-25T09:12:17.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcff3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff4145290 0x7fcff413e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcff3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff4145290 0x7fcff413e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53940/0 (socket says 172.21.15.173:53940) 2024-04-25T09:12:17.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcff3e00640 1 -- 172.21.15.173:0/2192725235 learned_addr learned my addr 172.21.15.173:0/2192725235 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:17.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcff3400640 1 --2- 172.21.15.173:0/2192725235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcff40b3fe0 0x7fcff40af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcff2a00640 1 --2- 172.21.15.173:0/2192725235 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcff40cc260 0x7fcff40b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcff3e00640 1 -- 172.21.15.173:0/2192725235 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcff40cc260 msgr2=0x7fcff40b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcff3e00640 1 --2- 172.21.15.173:0/2192725235 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcff40cc260 0x7fcff40b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcff3e00640 1 -- 172.21.15.173:0/2192725235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcff40b3fe0 msgr2=0x7fcff40af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcff3e00640 1 --2- 172.21.15.173:0/2192725235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcff40b3fe0 0x7fcff40af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcff3e00640 1 -- 172.21.15.173:0/2192725235 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff40b11f0 con 0x7fcff4145290 2024-04-25T09:12:17.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcff3e00640 1 --2- 172.21.15.173:0/2192725235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff4145290 0x7fcff413e6e0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00c370 tx=0x7fcfec00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcfeb400640 1 -- 172.21.15.173:0/2192725235 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec005220 con 0x7fcff4145290 2024-04-25T09:12:17.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcfeb400640 1 -- 172.21.15.173:0/2192725235 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfec0053c0 con 0x7fcff4145290 2024-04-25T09:12:17.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcffa400640 1 -- 172.21.15.173:0/2192725235 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff40afc10 con 0x7fcff4145290 2024-04-25T09:12:17.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcfeb400640 1 -- 172.21.15.173:0/2192725235 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec007270 con 0x7fcff4145290 2024-04-25T09:12:17.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcffa400640 1 -- 172.21.15.173:0/2192725235 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff40b04b0 con 0x7fcff4145290 2024-04-25T09:12:17.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcffa400640 1 -- 172.21.15.173:0/2192725235 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff4073ab0 con 0x7fcff4145290 2024-04-25T09:12:17.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.310+0000 7fcfeb400640 1 -- 172.21.15.173:0/2192725235 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcfec019020 con 0x7fcff4145290 2024-04-25T09:12:17.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.314+0000 7fcfeb400640 1 --2- 172.21.15.173:0/2192725235 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcfd4066f60 0x7fcfd4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.314+0000 7fcfeb400640 1 -- 172.21.15.173:0/2192725235 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcfec0843b0 con 0x7fcff4145290 2024-04-25T09:12:17.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.314+0000 7fcff3400640 1 --2- 172.21.15.173:0/2192725235 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcfd4066f60 0x7fcfd4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.314+0000 7fcff3400640 1 --2- 172.21.15.173:0/2192725235 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcfd4066f60 0x7fcfd4069420 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4003b90 tx=0x7fcfe40098d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.318+0000 7fcfeb400640 1 -- 172.21.15.173:0/2192725235 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcff415c5f0 con 0x7fcff4145290 2024-04-25T09:12:17.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.470+0000 7fcffa400640 1 -- 172.21.15.173:0/2192725235 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcff4144080 con 0x7fcff4145290 2024-04-25T09:12:17.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.470+0000 7fcfeb400640 1 -- 172.21.15.173:0/2192725235 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v122) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcfec054be0 con 0x7fcff4145290 2024-04-25T09:12:17.456 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:12:17.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.474+0000 7fcffa400640 1 -- 172.21.15.173:0/2192725235 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcfd4066f60 msgr2=0x7fcfd4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.474+0000 7fcffa400640 1 --2- 172.21.15.173:0/2192725235 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcfd4066f60 0x7fcfd4069420 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4003b90 tx=0x7fcfe40098d0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.474+0000 7fcffa400640 1 -- 172.21.15.173:0/2192725235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff4145290 msgr2=0x7fcff413e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.474+0000 7fcffa400640 1 --2- 172.21.15.173:0/2192725235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff4145290 0x7fcff413e6e0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00c370 tx=0x7fcfec00c830 comp rx=0 tx=0).stop 2024-04-25T09:12:17.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.474+0000 7fcffa400640 1 -- 172.21.15.173:0/2192725235 shutdown_connections 2024-04-25T09:12:17.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.474+0000 7fcffa400640 1 --2- 172.21.15.173:0/2192725235 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcfd4066f60 0x7fcfd4069420 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.474+0000 7fcffa400640 1 --2- 172.21.15.173:0/2192725235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff4145290 0x7fcff413e6e0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.474+0000 7fcffa400640 1 --2- 172.21.15.173:0/2192725235 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcff40cc260 0x7fcff40b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.474+0000 7fcffa400640 1 --2- 172.21.15.173:0/2192725235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcff40b3fe0 0x7fcff40af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.474+0000 7fcffa400640 1 -- 172.21.15.173:0/2192725235 >> 172.21.15.173:0/2192725235 conn(0x7fcff406ac90 msgr2=0x7fcff40cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:17.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.474+0000 7fcffa400640 1 -- 172.21.15.173:0/2192725235 shutdown_connections 2024-04-25T09:12:17.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.474+0000 7fcffa400640 1 -- 172.21.15.173:0/2192725235 wait complete. 2024-04-25T09:12:17.478 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:12:17.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0dbe00640 1 Processor -- start 2024-04-25T09:12:17.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0dbe00640 1 -- start start 2024-04-25T09:12:17.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0dbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe0dc144f10 0x7fe0dc15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0dbe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe0dc1452f0 0x7fe0dc06ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0dbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0dc0ce420 0x7fe0dc0ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0dbe00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0dc15fa40 con 0x7fe0dc144f10 2024-04-25T09:12:17.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0dbe00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0dc0720a0 con 0x7fe0dc1452f0 2024-04-25T09:12:17.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0dbe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc071490 con 0x7fe0dc0ce420 2024-04-25T09:12:17.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0daa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe0dc144f10 0x7fe0dc15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0daa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe0dc144f10 0x7fe0dc15f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53952/0 (socket says 172.21.15.173:53952) 2024-04-25T09:12:17.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0daa00640 1 -- 172.21.15.173:0/4065503359 learned_addr learned my addr 172.21.15.173:0/4065503359 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:17.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0da000640 1 --2- 172.21.15.173:0/4065503359 >> v2:172.21.15.194:3300/0 conn(0x7fe0dc1452f0 0x7fe0dc06ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0db400640 1 --2- 172.21.15.173:0/4065503359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0dc0ce420 0x7fe0dc0ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0daa00640 1 -- 172.21.15.173:0/4065503359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0dc0ce420 msgr2=0x7fe0dc0ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:17.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0daa00640 1 --2- 172.21.15.173:0/4065503359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0dc0ce420 0x7fe0dc0ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0daa00640 1 -- 172.21.15.173:0/4065503359 >> v2:172.21.15.194:3300/0 conn(0x7fe0dc1452f0 msgr2=0x7fe0dc06ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:17.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0daa00640 1 --2- 172.21.15.173:0/4065503359 >> v2:172.21.15.194:3300/0 conn(0x7fe0dc1452f0 0x7fe0dc06ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0daa00640 1 -- 172.21.15.173:0/4065503359 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc071770 con 0x7fe0dc144f10 2024-04-25T09:12:17.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.634+0000 7fe0da000640 1 --2- 172.21.15.173:0/4065503359 >> v2:172.21.15.194:3300/0 conn(0x7fe0dc1452f0 0x7fe0dc06ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:17.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.638+0000 7fe0daa00640 1 --2- 172.21.15.173:0/4065503359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0dc144f10 0x7fe0dc15f500 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc06f6e0 tx=0x7fe0cc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d795a743e5e3379 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.638+0000 7fe0d9600640 1 -- 172.21.15.173:0/4065503359 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0b0070 con 0x7fe0dc144f10 2024-04-25T09:12:17.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.638+0000 7fe0d9600640 1 -- 172.21.15.173:0/4065503359 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0cc0ab600 con 0x7fe0dc144f10 2024-04-25T09:12:17.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.638+0000 7fe0d9600640 1 -- 172.21.15.173:0/4065503359 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0ab9d0 con 0x7fe0dc144f10 2024-04-25T09:12:17.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.638+0000 7fe0dbe00640 1 -- 172.21.15.173:0/4065503359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0dc144f10 msgr2=0x7fe0dc15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.638+0000 7fe0dbe00640 1 --2- 172.21.15.173:0/4065503359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0dc144f10 0x7fe0dc15f500 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc06f6e0 tx=0x7fe0cc01c520 comp rx=0 tx=0).stop 2024-04-25T09:12:17.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.638+0000 7fe0dbe00640 1 -- 172.21.15.173:0/4065503359 shutdown_connections 2024-04-25T09:12:17.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.638+0000 7fe0dbe00640 1 --2- 172.21.15.173:0/4065503359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0dc0ce420 0x7fe0dc0ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.638+0000 7fe0dbe00640 1 --2- 172.21.15.173:0/4065503359 >> v2:172.21.15.194:3300/0 conn(0x7fe0dc1452f0 0x7fe0dc06ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.638+0000 7fe0dbe00640 1 --2- 172.21.15.173:0/4065503359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0dc144f10 0x7fe0dc15f500 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.638+0000 7fe0dbe00640 1 -- 172.21.15.173:0/4065503359 >> 172.21.15.173:0/4065503359 conn(0x7fe0dc061d40 msgr2=0x7fe0dc06ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:17.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.638+0000 7fe0dbe00640 1 -- 172.21.15.173:0/4065503359 shutdown_connections 2024-04-25T09:12:17.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.638+0000 7fe0dbe00640 1 -- 172.21.15.173:0/4065503359 wait complete. 2024-04-25T09:12:17.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.638+0000 7fe0dbe00640 1 Processor -- start 2024-04-25T09:12:17.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0dbe00640 1 -- start start 2024-04-25T09:12:17.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0dbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0dc0ce420 0x7fe0dc138bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0dbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0dc144f10 0x7fe0dc13b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0dbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0dc1452f0 0x7fe0dc13bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0dbe00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc06f140 con 0x7fe0dc0ce420 2024-04-25T09:12:17.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0dbe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc06efc0 con 0x7fe0dc1452f0 2024-04-25T09:12:17.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0dbe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc15ca30 con 0x7fe0dc144f10 2024-04-25T09:12:17.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0daa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0dc0ce420 0x7fe0dc138bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0daa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0dc0ce420 0x7fe0dc138bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53954/0 (socket says 172.21.15.173:53954) 2024-04-25T09:12:17.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0daa00640 1 -- 172.21.15.173:0/3014819705 learned_addr learned my addr 172.21.15.173:0/3014819705 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:17.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0da000640 1 --2- 172.21.15.173:0/3014819705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0dc144f10 0x7fe0dc13b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0db400640 1 --2- 172.21.15.173:0/3014819705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0dc1452f0 0x7fe0dc13bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0daa00640 1 -- 172.21.15.173:0/3014819705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0dc144f10 msgr2=0x7fe0dc13b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0daa00640 1 --2- 172.21.15.173:0/3014819705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0dc144f10 0x7fe0dc13b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0daa00640 1 -- 172.21.15.173:0/3014819705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0dc1452f0 msgr2=0x7fe0dc13bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0daa00640 1 --2- 172.21.15.173:0/3014819705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0dc1452f0 0x7fe0dc13bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0daa00640 1 -- 172.21.15.173:0/3014819705 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc13aa80 con 0x7fe0dc0ce420 2024-04-25T09:12:17.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0db400640 1 --2- 172.21.15.173:0/3014819705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0dc1452f0 0x7fe0dc13bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:17.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0da000640 1 --2- 172.21.15.173:0/3014819705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0dc144f10 0x7fe0dc13b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:17.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0daa00640 1 --2- 172.21.15.173:0/3014819705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0dc0ce420 0x7fe0dc138bc0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0ae040 tx=0x7fe0cc01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0d2a00640 1 -- 172.21.15.173:0/3014819705 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0b0040 con 0x7fe0dc0ce420 2024-04-25T09:12:17.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0d2a00640 1 -- 172.21.15.173:0/3014819705 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0cc0bc070 con 0x7fe0dc0ce420 2024-04-25T09:12:17.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0d2a00640 1 -- 172.21.15.173:0/3014819705 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0b6660 con 0x7fe0dc0ce420 2024-04-25T09:12:17.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0dbe00640 1 -- 172.21.15.173:0/3014819705 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0dc13ba10 con 0x7fe0dc0ce420 2024-04-25T09:12:17.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0dbe00640 1 -- 172.21.15.173:0/3014819705 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0dc13acf0 con 0x7fe0dc0ce420 2024-04-25T09:12:17.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.642+0000 7fe0dbe00640 1 -- 172.21.15.173:0/3014819705 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0dc073a40 con 0x7fe0dc0ce420 2024-04-25T09:12:17.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.646+0000 7fe0d2a00640 1 -- 172.21.15.173:0/3014819705 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe0cc0b6800 con 0x7fe0dc0ce420 2024-04-25T09:12:17.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.646+0000 7fe0d2a00640 1 --2- 172.21.15.173:0/3014819705 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0bc066f60 0x7fe0bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.646+0000 7fe0d2a00640 1 -- 172.21.15.173:0/3014819705 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe0cc11f5f0 con 0x7fe0dc0ce420 2024-04-25T09:12:17.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.646+0000 7fe0da000640 1 --2- 172.21.15.173:0/3014819705 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0bc066f60 0x7fe0bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.646+0000 7fe0da000640 1 --2- 172.21.15.173:0/3014819705 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0bc066f60 0x7fe0bc069420 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc13db90 tx=0x7fe0c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.650+0000 7fe0d2a00640 1 -- 172.21.15.173:0/3014819705 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe0cc016110 con 0x7fe0dc0ce420 2024-04-25T09:12:17.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.802+0000 7fe0dbe00640 1 -- 172.21.15.173:0/3014819705 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0dc06b640 con 0x7fe0dc0ce420 2024-04-25T09:12:17.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.806+0000 7fe0d2a00640 1 -- 172.21.15.173:0/3014819705 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v122) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe0cc0f03e0 con 0x7fe0dc0ce420 2024-04-25T09:12:17.789 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:12:17.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.806+0000 7fe0dbe00640 1 -- 172.21.15.173:0/3014819705 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0bc066f60 msgr2=0x7fe0bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.806+0000 7fe0dbe00640 1 --2- 172.21.15.173:0/3014819705 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0bc066f60 0x7fe0bc069420 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc13db90 tx=0x7fe0c8008040 comp rx=0 tx=0).stop 2024-04-25T09:12:17.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.806+0000 7fe0dbe00640 1 -- 172.21.15.173:0/3014819705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0dc0ce420 msgr2=0x7fe0dc138bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.806+0000 7fe0dbe00640 1 --2- 172.21.15.173:0/3014819705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0dc0ce420 0x7fe0dc138bc0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0ae040 tx=0x7fe0cc01ad60 comp rx=0 tx=0).stop 2024-04-25T09:12:17.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.806+0000 7fe0dbe00640 1 -- 172.21.15.173:0/3014819705 shutdown_connections 2024-04-25T09:12:17.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.806+0000 7fe0dbe00640 1 --2- 172.21.15.173:0/3014819705 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0bc066f60 0x7fe0bc069420 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.806+0000 7fe0dbe00640 1 --2- 172.21.15.173:0/3014819705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0dc1452f0 0x7fe0dc13bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.806+0000 7fe0dbe00640 1 --2- 172.21.15.173:0/3014819705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0dc144f10 0x7fe0dc13b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.806+0000 7fe0dbe00640 1 --2- 172.21.15.173:0/3014819705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0dc0ce420 0x7fe0dc138bc0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.806+0000 7fe0dbe00640 1 -- 172.21.15.173:0/3014819705 >> 172.21.15.173:0/3014819705 conn(0x7fe0dc061d40 msgr2=0x7fe0dc0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:17.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.806+0000 7fe0dbe00640 1 -- 172.21.15.173:0/3014819705 shutdown_connections 2024-04-25T09:12:17.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.806+0000 7fe0dbe00640 1 -- 172.21.15.173:0/3014819705 wait complete. 2024-04-25T09:12:17.811 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:12:17.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.962+0000 7f481ae00640 1 Processor -- start 2024-04-25T09:12:17.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f481ae00640 1 -- start start 2024-04-25T09:12:17.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f481ae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48140cc260 0x7f48140cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f481ae00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f481406d4b0 con 0x7f4814145290 2024-04-25T09:12:17.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f481ae00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f481406d790 con 0x7f48140b3fe0 2024-04-25T09:12:17.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f481ae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481406da70 con 0x7f48140cc260 2024-04-25T09:12:17.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4813e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4814145290 0x7f481415c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49210/0 (socket says 172.21.15.173:49210) 2024-04-25T09:12:17.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4813e00640 1 -- 172.21.15.173:0/423510045 learned_addr learned my addr 172.21.15.173:0/423510045 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:17.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4818e00640 1 --2- 172.21.15.173:0/423510045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48140cc260 0x7f48140cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4812a00640 1 -- 172.21.15.173:0/423510045 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175040369 0 0) 0x7f481406d4b0 con 0x7f4814145290 2024-04-25T09:12:17.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4812a00640 1 -- 172.21.15.173:0/423510045 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47f8003530 con 0x7f4814145290 2024-04-25T09:12:17.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4812a00640 1 -- 172.21.15.173:0/423510045 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1865221680 0 0) 0x7f47f8003530 con 0x7f4814145290 2024-04-25T09:12:17.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4812a00640 1 -- 172.21.15.173:0/423510045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48140cc260 msgr2=0x7f48140cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:17.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4812a00640 1 --2- 172.21.15.173:0/423510045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48140cc260 0x7f48140cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4812a00640 1 -- 172.21.15.173:0/423510045 >> v1:172.21.15.194:6789/0 conn(0x7f48140b3fe0 legacy=0x7f48140b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4812a00640 1 -- 172.21.15.173:0/423510045 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481406dd50 con 0x7f4814145290 2024-04-25T09:12:17.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4812a00640 1 -- 172.21.15.173:0/423510045 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f4804001a00 con 0x7f4814145290 2024-04-25T09:12:17.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4812a00640 1 -- 172.21.15.173:0/423510045 >> v1:172.21.15.173:6789/0 conn(0x7f4814145290 legacy=0x7f481415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4812a00640 1 --2- 172.21.15.173:0/423510045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f80039f0 0x7f47f8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4812a00640 1 --2- 172.21.15.173:0/423510045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47f8004810 0x7f47f8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4812a00640 1 --2- 172.21.15.173:0/423510045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48140cc260 0x7f47f80052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4812a00640 1 -- 172.21.15.173:0/423510045 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481406da70 con 0x7f47f80039f0 2024-04-25T09:12:17.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4812a00640 1 -- 172.21.15.173:0/423510045 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f800bb90 con 0x7f47f8004810 2024-04-25T09:12:17.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4812a00640 1 -- 172.21.15.173:0/423510045 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f800bd90 con 0x7f48140cc260 2024-04-25T09:12:17.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4813e00640 1 --2- 172.21.15.173:0/423510045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f80039f0 0x7f47f8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4813400640 1 --2- 172.21.15.173:0/423510045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47f8004810 0x7f47f8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4818e00640 1 --2- 172.21.15.173:0/423510045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48140cc260 0x7f47f80052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4813e00640 1 -- 172.21.15.173:0/423510045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48140cc260 msgr2=0x7f47f80052a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:17.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4813e00640 1 --2- 172.21.15.173:0/423510045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48140cc260 0x7f47f80052a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4813e00640 1 -- 172.21.15.173:0/423510045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47f8004810 msgr2=0x7f47f8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:17.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4813e00640 1 --2- 172.21.15.173:0/423510045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47f8004810 0x7f47f8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.966+0000 7f4813e00640 1 -- 172.21.15.173:0/423510045 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f8003530 con 0x7f47f80039f0 2024-04-25T09:12:17.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.970+0000 7f4813e00640 1 --2- 172.21.15.173:0/423510045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f80039f0 0x7f47f8003e10 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f480400a840 tx=0x7f480401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223b87665b7efbe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.970+0000 7f4812a00640 1 -- 172.21.15.173:0/423510045 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480400a460 con 0x7f47f80039f0 2024-04-25T09:12:17.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.970+0000 7f4812a00640 1 -- 172.21.15.173:0/423510045 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48040ad650 con 0x7f47f80039f0 2024-04-25T09:12:17.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.970+0000 7f4812a00640 1 -- 172.21.15.173:0/423510045 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48040ada40 con 0x7f47f80039f0 2024-04-25T09:12:17.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.970+0000 7f481ae00640 1 -- 172.21.15.173:0/423510045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f80039f0 msgr2=0x7f47f8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.970+0000 7f481ae00640 1 --2- 172.21.15.173:0/423510045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f80039f0 0x7f47f8003e10 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f480400a840 tx=0x7f480401d360 comp rx=0 tx=0).stop 2024-04-25T09:12:17.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.970+0000 7f4818e00640 1 -- 172.21.15.173:0/423510045 reap_dead start 2024-04-25T09:12:17.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.970+0000 7f481ae00640 1 -- 172.21.15.173:0/423510045 shutdown_connections 2024-04-25T09:12:17.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.970+0000 7f481ae00640 1 -- 172.21.15.173:0/423510045 >> 172.21.15.173:0/423510045 conn(0x7f481406ac90 msgr2=0x7f481406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:17.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.970+0000 7f481ae00640 1 -- 172.21.15.173:0/423510045 shutdown_connections 2024-04-25T09:12:17.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.970+0000 7f481ae00640 1 -- 172.21.15.173:0/423510045 wait complete. 2024-04-25T09:12:17.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f481ae00640 1 Processor -- start 2024-04-25T09:12:17.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f481ae00640 1 -- start start 2024-04-25T09:12:17.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f481ae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47f80039f0 0x7f481415ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f481ae00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4814164a60 0x7f4814164ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f481ae00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48140b1230 0x7f48140b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f481ae00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481406f1b0 con 0x7f48140b1230 2024-04-25T09:12:17.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f481ae00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481406f030 con 0x7f4814164a60 2024-04-25T09:12:17.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f481ae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481415b2c0 con 0x7f47f80039f0 2024-04-25T09:12:17.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f4818e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48140b1230 0x7f48140b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f4818e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48140b1230 0x7f48140b16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53982/0 (socket says 172.21.15.173:53982) 2024-04-25T09:12:17.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f4818e00640 1 -- 172.21.15.173:0/2538731192 learned_addr learned my addr 172.21.15.173:0/2538731192 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:17.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f4813e00640 1 --2- 172.21.15.173:0/2538731192 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47f80039f0 0x7f481415ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f4813400640 1 --2- 172.21.15.173:0/2538731192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4814164a60 0x7f4814164ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f4818e00640 1 -- 172.21.15.173:0/2538731192 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47f80039f0 msgr2=0x7f481415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f4818e00640 1 --2- 172.21.15.173:0/2538731192 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47f80039f0 0x7f481415ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f4818e00640 1 -- 172.21.15.173:0/2538731192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4814164a60 msgr2=0x7f4814164ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f4818e00640 1 --2- 172.21.15.173:0/2538731192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4814164a60 0x7f4814164ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f4818e00640 1 -- 172.21.15.173:0/2538731192 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48140af460 con 0x7f48140b1230 2024-04-25T09:12:17.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f4818e00640 1 --2- 172.21.15.173:0/2538731192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48140b1230 0x7f48140b16c0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f48140727c0 tx=0x7f480c011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f480be00640 1 -- 172.21.15.173:0/2538731192 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c019020 con 0x7f48140b1230 2024-04-25T09:12:17.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f480be00640 1 -- 172.21.15.173:0/2538731192 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c003620 con 0x7f48140b1230 2024-04-25T09:12:17.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f481ae00640 1 -- 172.21.15.173:0/2538731192 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48140af740 con 0x7f48140b1230 2024-04-25T09:12:17.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f480be00640 1 -- 172.21.15.173:0/2538731192 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c003a50 con 0x7f48140b1230 2024-04-25T09:12:17.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f481ae00640 1 -- 172.21.15.173:0/2538731192 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48140afd00 con 0x7f48140b1230 2024-04-25T09:12:17.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.974+0000 7f481ae00640 1 -- 172.21.15.173:0/2538731192 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4814073ab0 con 0x7f48140b1230 2024-04-25T09:12:17.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.978+0000 7f480be00640 1 -- 172.21.15.173:0/2538731192 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f480c01c020 con 0x7f48140b1230 2024-04-25T09:12:17.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.978+0000 7f480be00640 1 --2- 172.21.15.173:0/2538731192 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f47f4066f60 0x7f47f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.978+0000 7f480be00640 1 -- 172.21.15.173:0/2538731192 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f480c085330 con 0x7f48140b1230 2024-04-25T09:12:17.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.978+0000 7f4813e00640 1 --2- 172.21.15.173:0/2538731192 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f47f4066f60 0x7f47f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.978+0000 7f4813e00640 1 --2- 172.21.15.173:0/2538731192 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f47f4066f60 0x7f47f4069420 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f48040ad000 tx=0x7f481406d680 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:17.982+0000 7f480be00640 1 -- 172.21.15.173:0/2538731192 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f480c023030 con 0x7f48140b1230 2024-04-25T09:12:18.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.134+0000 7f481ae00640 1 -- 172.21.15.173:0/2538731192 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f481406c300 con 0x7f48140b1230 2024-04-25T09:12:18.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.134+0000 7f480be00640 1 -- 172.21.15.173:0/2538731192 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v122) v1 ==== 100+0+11 (secure 0 0 0) 0x7f480c055b50 con 0x7f48140b1230 2024-04-25T09:12:18.120 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:12:18.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.138+0000 7f481ae00640 1 -- 172.21.15.173:0/2538731192 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f47f4066f60 msgr2=0x7f47f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:18.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.138+0000 7f481ae00640 1 --2- 172.21.15.173:0/2538731192 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f47f4066f60 0x7f47f4069420 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f48040ad000 tx=0x7f481406d680 comp rx=0 tx=0).stop 2024-04-25T09:12:18.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.138+0000 7f481ae00640 1 -- 172.21.15.173:0/2538731192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48140b1230 msgr2=0x7f48140b16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:18.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.138+0000 7f481ae00640 1 --2- 172.21.15.173:0/2538731192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48140b1230 0x7f48140b16c0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f48140727c0 tx=0x7f480c011920 comp rx=0 tx=0).stop 2024-04-25T09:12:18.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.138+0000 7f481ae00640 1 -- 172.21.15.173:0/2538731192 shutdown_connections 2024-04-25T09:12:18.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.138+0000 7f481ae00640 1 --2- 172.21.15.173:0/2538731192 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f47f4066f60 0x7f47f4069420 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.138+0000 7f481ae00640 1 --2- 172.21.15.173:0/2538731192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48140b1230 0x7f48140b16c0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.138+0000 7f481ae00640 1 --2- 172.21.15.173:0/2538731192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4814164a60 0x7f4814164ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.138+0000 7f481ae00640 1 --2- 172.21.15.173:0/2538731192 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47f80039f0 0x7f481415ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.138+0000 7f481ae00640 1 -- 172.21.15.173:0/2538731192 >> 172.21.15.173:0/2538731192 conn(0x7f481406ac90 msgr2=0x7f481415e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:18.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.138+0000 7f481ae00640 1 -- 172.21.15.173:0/2538731192 shutdown_connections 2024-04-25T09:12:18.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.138+0000 7f481ae00640 1 -- 172.21.15.173:0/2538731192 wait complete. 2024-04-25T09:12:18.141 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:12:18.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.294+0000 7fe00ee00640 1 Processor -- start 2024-04-25T09:12:18.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.298+0000 7fe00ee00640 1 -- start start 2024-04-25T09:12:18.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.298+0000 7fe00ee00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe00815b980 0x7fe0080ad880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:18.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.298+0000 7fe00ee00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe00806f650 0x7fe00806bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:18.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.298+0000 7fe00ee00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe00806c1e0 0x7fe00815bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:18.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.298+0000 7fe00ee00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0080728b0 con 0x7fe00815b980 2024-04-25T09:12:18.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.298+0000 7fe00ee00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe008072b90 con 0x7fe00806f650 2024-04-25T09:12:18.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.298+0000 7fe00ee00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0080af4c0 con 0x7fe00806c1e0 2024-04-25T09:12:18.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.298+0000 7fe00da00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe00815b980 0x7fe0080ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:18.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.298+0000 7fe00da00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe00815b980 0x7fe0080ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53984/0 (socket says 172.21.15.173:53984) 2024-04-25T09:12:18.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.298+0000 7fe00da00640 1 -- 172.21.15.173:0/3001921790 learned_addr learned my addr 172.21.15.173:0/3001921790 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:18.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.298+0000 7fe00d000640 1 --2- 172.21.15.173:0/3001921790 >> v2:172.21.15.194:3300/0 conn(0x7fe00806f650 0x7fe00806bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:18.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.298+0000 7fe00e400640 1 --2- 172.21.15.173:0/3001921790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe00806c1e0 0x7fe00815bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:18.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.298+0000 7fe00da00640 1 -- 172.21.15.173:0/3001921790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe00806c1e0 msgr2=0x7fe00815bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:18.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.298+0000 7fe00da00640 1 --2- 172.21.15.173:0/3001921790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe00806c1e0 0x7fe00815bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.298+0000 7fe00da00640 1 -- 172.21.15.173:0/3001921790 >> v2:172.21.15.194:3300/0 conn(0x7fe00806f650 msgr2=0x7fe00806bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:18.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.298+0000 7fe00da00640 1 --2- 172.21.15.173:0/3001921790 >> v2:172.21.15.194:3300/0 conn(0x7fe00806f650 0x7fe00806bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.298+0000 7fe00da00640 1 -- 172.21.15.173:0/3001921790 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0080af120 con 0x7fe00815b980 2024-04-25T09:12:18.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.298+0000 7fe00d000640 1 --2- 172.21.15.173:0/3001921790 >> v2:172.21.15.194:3300/0 conn(0x7fe00806f650 0x7fe00806bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:18.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.302+0000 7fe00da00640 1 --2- 172.21.15.173:0/3001921790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe00815b980 0x7fe0080ad880 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fe008073020 tx=0x7fdffc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c87fa80d494141 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:18.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.302+0000 7fe007e00640 1 -- 172.21.15.173:0/3001921790 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0b0070 con 0x7fe00815b980 2024-04-25T09:12:18.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.302+0000 7fe007e00640 1 -- 172.21.15.173:0/3001921790 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc0ab600 con 0x7fe00815b980 2024-04-25T09:12:18.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.302+0000 7fe007e00640 1 -- 172.21.15.173:0/3001921790 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0ab9d0 con 0x7fe00815b980 2024-04-25T09:12:18.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.302+0000 7fe00ee00640 1 -- 172.21.15.173:0/3001921790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe00815b980 msgr2=0x7fe0080ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:18.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.302+0000 7fe00ee00640 1 --2- 172.21.15.173:0/3001921790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe00815b980 0x7fe0080ad880 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fe008073020 tx=0x7fdffc01c520 comp rx=0 tx=0).stop 2024-04-25T09:12:18.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.302+0000 7fe00ee00640 1 -- 172.21.15.173:0/3001921790 shutdown_connections 2024-04-25T09:12:18.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.302+0000 7fe00ee00640 1 --2- 172.21.15.173:0/3001921790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe00806c1e0 0x7fe00815bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.302+0000 7fe00ee00640 1 --2- 172.21.15.173:0/3001921790 >> v2:172.21.15.194:3300/0 conn(0x7fe00806f650 0x7fe00806bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.302+0000 7fe00ee00640 1 --2- 172.21.15.173:0/3001921790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe00815b980 0x7fe0080ad880 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.302+0000 7fe00ee00640 1 -- 172.21.15.173:0/3001921790 >> 172.21.15.173:0/3001921790 conn(0x7fe008071b80 msgr2=0x7fe008071f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:18.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.302+0000 7fe00ee00640 1 -- 172.21.15.173:0/3001921790 shutdown_connections 2024-04-25T09:12:18.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.302+0000 7fe00ee00640 1 -- 172.21.15.173:0/3001921790 wait complete. 2024-04-25T09:12:18.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.302+0000 7fe00ee00640 1 Processor -- start 2024-04-25T09:12:18.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00ee00640 1 -- start start 2024-04-25T09:12:18.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00ee00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe00806c1e0 0x7fe0081594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:18.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00ee00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe00806f650 0x7fe00813a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:18.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00ee00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0080b4700 0x7fe0080b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:18.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00ee00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00806e7b0 con 0x7fe0080b4700 2024-04-25T09:12:18.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00ee00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00806e630 con 0x7fe00806c1e0 2024-04-25T09:12:18.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00ee00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00806e930 con 0x7fe00806f650 2024-04-25T09:12:18.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00e400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0080b4700 0x7fe0080b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:18.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00e400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0080b4700 0x7fe0080b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53998/0 (socket says 172.21.15.173:53998) 2024-04-25T09:12:18.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00e400640 1 -- 172.21.15.173:0/3873220713 learned_addr learned my addr 172.21.15.173:0/3873220713 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:18.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00da00640 1 --2- 172.21.15.173:0/3873220713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe00806c1e0 0x7fe0081594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:18.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00d000640 1 --2- 172.21.15.173:0/3873220713 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe00806f650 0x7fe00813a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00e400640 1 -- 172.21.15.173:0/3873220713 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe00806f650 msgr2=0x7fe00813a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00e400640 1 --2- 172.21.15.173:0/3873220713 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe00806f650 0x7fe00813a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00e400640 1 -- 172.21.15.173:0/3873220713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe00806c1e0 msgr2=0x7fe0081594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00e400640 1 --2- 172.21.15.173:0/3873220713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe00806c1e0 0x7fe0081594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00e400640 1 -- 172.21.15.173:0/3873220713 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe008159a20 con 0x7fe0080b4700 2024-04-25T09:12:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00e400640 1 --2- 172.21.15.173:0/3873220713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0080b4700 0x7fe0080b4b90 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fe000007e90 tx=0x7fe00000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe005600640 1 -- 172.21.15.173:0/3873220713 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000014420 con 0x7fe0080b4700 2024-04-25T09:12:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe005600640 1 -- 172.21.15.173:0/3873220713 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe000019070 con 0x7fe0080b4700 2024-04-25T09:12:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe005600640 1 -- 172.21.15.173:0/3873220713 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000014820 con 0x7fe0080b4700 2024-04-25T09:12:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00ee00640 1 -- 172.21.15.173:0/3873220713 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0081f6e70 con 0x7fe0080b4700 2024-04-25T09:12:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00ee00640 1 -- 172.21.15.173:0/3873220713 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0081f7430 con 0x7fe0080b4700 2024-04-25T09:12:18.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.306+0000 7fe00ee00640 1 -- 172.21.15.173:0/3873220713 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe008073a40 con 0x7fe0080b4700 2024-04-25T09:12:18.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.310+0000 7fe005600640 1 -- 172.21.15.173:0/3873220713 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe0000149c0 con 0x7fe0080b4700 2024-04-25T09:12:18.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.310+0000 7fe005600640 1 --2- 172.21.15.173:0/3873220713 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdfe8066f90 0x7fdfe8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:18.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.310+0000 7fe005600640 1 -- 172.21.15.173:0/3873220713 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe000085840 con 0x7fe0080b4700 2024-04-25T09:12:18.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.310+0000 7fe00da00640 1 --2- 172.21.15.173:0/3873220713 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdfe8066f90 0x7fdfe8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:18.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.310+0000 7fe00da00640 1 --2- 172.21.15.173:0/3873220713 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdfe8066f90 0x7fdfe8069450 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0ad000 tx=0x7fdffc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:18.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.314+0000 7fe005600640 1 -- 172.21.15.173:0/3873220713 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe000056070 con 0x7fe0080b4700 2024-04-25T09:12:18.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.482+0000 7fe00ee00640 1 -- 172.21.15.173:0/3873220713 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe0081fa0f0 con 0x7fe0080b4700 2024-04-25T09:12:18.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.482+0000 7fe005600640 1 -- 172.21.15.173:0/3873220713 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v122) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe00005a110 con 0x7fe0080b4700 2024-04-25T09:12:18.467 INFO:teuthology.orchestra.run.smithi173.stderr:listed 0 entries 2024-04-25T09:12:18.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.482+0000 7fe00ee00640 1 -- 172.21.15.173:0/3873220713 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdfe8066f90 msgr2=0x7fdfe8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:18.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.482+0000 7fe00ee00640 1 --2- 172.21.15.173:0/3873220713 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdfe8066f90 0x7fdfe8069450 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0ad000 tx=0x7fdffc0a6000 comp rx=0 tx=0).stop 2024-04-25T09:12:18.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.482+0000 7fe00ee00640 1 -- 172.21.15.173:0/3873220713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0080b4700 msgr2=0x7fe0080b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:18.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.482+0000 7fe00ee00640 1 --2- 172.21.15.173:0/3873220713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0080b4700 0x7fe0080b4b90 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fe000007e90 tx=0x7fe00000e4b0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.482+0000 7fe00ee00640 1 -- 172.21.15.173:0/3873220713 shutdown_connections 2024-04-25T09:12:18.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.482+0000 7fe00ee00640 1 --2- 172.21.15.173:0/3873220713 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdfe8066f90 0x7fdfe8069450 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.482+0000 7fe00ee00640 1 --2- 172.21.15.173:0/3873220713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0080b4700 0x7fe0080b4b90 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.482+0000 7fe00ee00640 1 --2- 172.21.15.173:0/3873220713 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe00806f650 0x7fe00813a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.482+0000 7fe00ee00640 1 --2- 172.21.15.173:0/3873220713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe00806c1e0 0x7fe0081594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.482+0000 7fe00ee00640 1 -- 172.21.15.173:0/3873220713 >> 172.21.15.173:0/3873220713 conn(0x7fe008071b80 msgr2=0x7fe0080b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:18.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.482+0000 7fe00ee00640 1 -- 172.21.15.173:0/3873220713 shutdown_connections 2024-04-25T09:12:18.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:18.482+0000 7fe00ee00640 1 -- 172.21.15.173:0/3873220713 wait complete. 2024-04-25T09:12:18.487 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:12:18.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:18.487 DEBUG:teuthology.orchestra.run.smithi173:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:19.130 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:12:19.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:19.131 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:12:19.139 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:12:19.140 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:19.149 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:12:19.149 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:12:19.149 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:19.189 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:12:19.189 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:12:19.189 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:19.202 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:12:19.202 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:19.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.386+0000 7fd103400640 1 Processor -- start 2024-04-25T09:12:19.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.386+0000 7fd103400640 1 -- start start 2024-04-25T09:12:19.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.386+0000 7fd103400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0fc0cc8b0 0x7fd0fc0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.386+0000 7fd103400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd0fc0ce8f0 0x7fd0fc0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.386+0000 7fd103400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc06e7c0 con 0x7fd0fc145250 2024-04-25T09:12:19.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.386+0000 7fd103400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0fc06d720 con 0x7fd0fc0ce8f0 2024-04-25T09:12:19.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.386+0000 7fd103400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc06da00 con 0x7fd0fc0cc8b0 2024-04-25T09:12:19.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.386+0000 7fd101400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd0fc0ce8f0 0x7fd0fc0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.386+0000 7fd101400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd0fc0ce8f0 0x7fd0fc0ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54002/0 (socket says 172.21.15.173:54002) 2024-04-25T09:12:19.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.386+0000 7fd101400640 1 -- 172.21.15.173:0/2546917368 learned_addr learned my addr 172.21.15.173:0/2546917368 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:19.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.386+0000 7fd0fbe00640 1 --2- 172.21.15.173:0/2546917368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0fc0cc8b0 0x7fd0fc0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.386+0000 7fd101400640 1 -- 172.21.15.173:0/2546917368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0fc0cc8b0 msgr2=0x7fd0fc0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:19.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.386+0000 7fd101400640 1 --2- 172.21.15.173:0/2546917368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0fc0cc8b0 0x7fd0fc0ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.386+0000 7fd101400640 1 -- 172.21.15.173:0/2546917368 >> v1:172.21.15.194:6789/0 conn(0x7fd0fc145250 legacy=0x7fd0fc15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:19.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.386+0000 7fd101400640 1 -- 172.21.15.173:0/2546917368 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc06dce0 con 0x7fd0fc0ce8f0 2024-04-25T09:12:19.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.390+0000 7fd101400640 1 --2- 172.21.15.173:0/2546917368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0fc0ce8f0 0x7fd0fc0ced60 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009e50 tx=0x7fd0f401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5251490463ddc3d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:19.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.390+0000 7fd0fb400640 1 -- 172.21.15.173:0/2546917368 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40a5760 con 0x7fd0fc0ce8f0 2024-04-25T09:12:19.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.390+0000 7fd0fb400640 1 -- 172.21.15.173:0/2546917368 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f40a5900 con 0x7fd0fc0ce8f0 2024-04-25T09:12:19.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.390+0000 7fd0fb400640 1 -- 172.21.15.173:0/2546917368 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40a5cd0 con 0x7fd0fc0ce8f0 2024-04-25T09:12:19.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.390+0000 7fd103400640 1 -- 172.21.15.173:0/2546917368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0fc0ce8f0 msgr2=0x7fd0fc0ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.390+0000 7fd103400640 1 --2- 172.21.15.173:0/2546917368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0fc0ce8f0 0x7fd0fc0ced60 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009e50 tx=0x7fd0f401c9f0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.390+0000 7fd103400640 1 -- 172.21.15.173:0/2546917368 shutdown_connections 2024-04-25T09:12:19.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.390+0000 7fd103400640 1 --2- 172.21.15.173:0/2546917368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0fc0cc8b0 0x7fd0fc0ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.390+0000 7fd103400640 1 --2- 172.21.15.173:0/2546917368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0fc0ce8f0 0x7fd0fc0ced60 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.390+0000 7fd103400640 1 -- 172.21.15.173:0/2546917368 >> 172.21.15.173:0/2546917368 conn(0x7fd0fc06ac90 msgr2=0x7fd0fc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:19.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.390+0000 7fd103400640 1 -- 172.21.15.173:0/2546917368 shutdown_connections 2024-04-25T09:12:19.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.390+0000 7fd103400640 1 -- 172.21.15.173:0/2546917368 wait complete. 2024-04-25T09:12:19.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd103400640 1 Processor -- start 2024-04-25T09:12:19.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd103400640 1 -- start start 2024-04-25T09:12:19.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd103400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0fc0cc8b0 0x7fd0fc0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd103400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0fc0ce8f0 0x7fd0fc15ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd103400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0fc145250 0x7fd0fc155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd103400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc06d380 con 0x7fd0fc0cc8b0 2024-04-25T09:12:19.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd103400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc06ef80 con 0x7fd0fc145250 2024-04-25T09:12:19.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd103400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc06d500 con 0x7fd0fc0ce8f0 2024-04-25T09:12:19.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd100a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0fc0cc8b0 0x7fd0fc0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd100a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0fc0cc8b0 0x7fd0fc0b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54016/0 (socket says 172.21.15.173:54016) 2024-04-25T09:12:19.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd100a00640 1 -- 172.21.15.173:0/1971677926 learned_addr learned my addr 172.21.15.173:0/1971677926 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:19.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd101400640 1 --2- 172.21.15.173:0/1971677926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0fc145250 0x7fd0fc155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd0fbe00640 1 --2- 172.21.15.173:0/1971677926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0fc0ce8f0 0x7fd0fc15ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd100a00640 1 -- 172.21.15.173:0/1971677926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0fc0ce8f0 msgr2=0x7fd0fc15ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd100a00640 1 --2- 172.21.15.173:0/1971677926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0fc0ce8f0 0x7fd0fc15ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd100a00640 1 -- 172.21.15.173:0/1971677926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0fc145250 msgr2=0x7fd0fc155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd100a00640 1 --2- 172.21.15.173:0/1971677926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0fc145250 0x7fd0fc155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd100a00640 1 -- 172.21.15.173:0/1971677926 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc0b3e90 con 0x7fd0fc0cc8b0 2024-04-25T09:12:19.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd101400640 1 --2- 172.21.15.173:0/1971677926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0fc145250 0x7fd0fc155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:19.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd100a00640 1 --2- 172.21.15.173:0/1971677926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0fc0cc8b0 0x7fd0fc0b0180 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000c480 tx=0x7fd0f000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:19.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd0f8c00640 1 -- 172.21.15.173:0/1971677926 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0012830 con 0x7fd0fc0cc8b0 2024-04-25T09:12:19.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd0f8c00640 1 -- 172.21.15.173:0/1971677926 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f0017070 con 0x7fd0fc0cc8b0 2024-04-25T09:12:19.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd0f8c00640 1 -- 172.21.15.173:0/1971677926 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0012c30 con 0x7fd0fc0cc8b0 2024-04-25T09:12:19.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd103400640 1 -- 172.21.15.173:0/1971677926 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0fc0b35f0 con 0x7fd0fc0cc8b0 2024-04-25T09:12:19.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd103400640 1 -- 172.21.15.173:0/1971677926 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0fc0b3bb0 con 0x7fd0fc0cc8b0 2024-04-25T09:12:19.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.394+0000 7fd103400640 1 -- 172.21.15.173:0/1971677926 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0fc073a40 con 0x7fd0fc0cc8b0 2024-04-25T09:12:19.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.398+0000 7fd0f8c00640 1 -- 172.21.15.173:0/1971677926 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd0f001c460 con 0x7fd0fc0cc8b0 2024-04-25T09:12:19.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.398+0000 7fd0f8c00640 1 --2- 172.21.15.173:0/1971677926 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd0dc066f90 0x7fd0dc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.398+0000 7fd0f8c00640 1 -- 172.21.15.173:0/1971677926 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd0f0084ee0 con 0x7fd0fc0cc8b0 2024-04-25T09:12:19.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.398+0000 7fd0fbe00640 1 --2- 172.21.15.173:0/1971677926 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd0dc066f90 0x7fd0dc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.398+0000 7fd0fbe00640 1 --2- 172.21.15.173:0/1971677926 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd0dc066f90 0x7fd0dc069450 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0aecf0 tx=0x7fd0e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:19.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.402+0000 7fd0f8c00640 1 -- 172.21.15.173:0/1971677926 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd0f0055df0 con 0x7fd0fc0cc8b0 2024-04-25T09:12:19.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.586+0000 7fd103400640 1 -- 172.21.15.173:0/1971677926 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0fc071e30 con 0x7fd0fc0cc8b0 2024-04-25T09:12:19.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.586+0000 7fd0f8c00640 1 -- 172.21.15.173:0/1971677926 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fd0f00556f0 con 0x7fd0fc0cc8b0 2024-04-25T09:12:19.572 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:19.572 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1021410995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1021410995},{"type":"v1","addr":"172.21.15.194:6834","nonce":1021410995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2198134208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2198134208},{"type":"v1","addr":"172.21.15.194:6835","nonce":2198134208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8772,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/684989574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":684989574},{"type":"v1","addr":"172.21.15.173:6836","nonce":684989574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:26.148874+0000","modified":"2024-04-25T09:11:29.164422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8775":{"gid":8775,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/671971539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":671971539},{"type":"v1","addr":"172.21.15.173:6837","nonce":671971539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:12:19.572 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 81 2024-04-25T09:12:19.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.590+0000 7fd103400640 1 -- 172.21.15.173:0/1971677926 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd0dc066f90 msgr2=0x7fd0dc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.590+0000 7fd103400640 1 --2- 172.21.15.173:0/1971677926 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd0dc066f90 0x7fd0dc069450 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0aecf0 tx=0x7fd0e8008040 comp rx=0 tx=0).stop 2024-04-25T09:12:19.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.590+0000 7fd103400640 1 -- 172.21.15.173:0/1971677926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0fc0cc8b0 msgr2=0x7fd0fc0b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.590+0000 7fd103400640 1 --2- 172.21.15.173:0/1971677926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0fc0cc8b0 0x7fd0fc0b0180 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000c480 tx=0x7fd0f000c940 comp rx=0 tx=0).stop 2024-04-25T09:12:19.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.590+0000 7fd103400640 1 -- 172.21.15.173:0/1971677926 shutdown_connections 2024-04-25T09:12:19.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.590+0000 7fd103400640 1 --2- 172.21.15.173:0/1971677926 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd0dc066f90 0x7fd0dc069450 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.590+0000 7fd103400640 1 --2- 172.21.15.173:0/1971677926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0fc145250 0x7fd0fc155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.590+0000 7fd103400640 1 --2- 172.21.15.173:0/1971677926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0fc0ce8f0 0x7fd0fc15ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.590+0000 7fd103400640 1 --2- 172.21.15.173:0/1971677926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0fc0cc8b0 0x7fd0fc0b0180 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.590+0000 7fd103400640 1 -- 172.21.15.173:0/1971677926 >> 172.21.15.173:0/1971677926 conn(0x7fd0fc06ac90 msgr2=0x7fd0fc0cfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:19.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.590+0000 7fd103400640 1 -- 172.21.15.173:0/1971677926 shutdown_connections 2024-04-25T09:12:19.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.590+0000 7fd103400640 1 -- 172.21.15.173:0/1971677926 wait complete. 2024-04-25T09:12:19.593 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:19.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.742+0000 7f3bba000640 1 Processor -- start 2024-04-25T09:12:19.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.742+0000 7f3bba000640 1 -- start start 2024-04-25T09:12:19.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.746+0000 7f3bba000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bb40b3e70 0x7f3bb40b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.746+0000 7f3bba000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3bb40aefa0 0x7f3bb40b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.746+0000 7f3bba000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3bb415edd0 0x7f3bb40b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.746+0000 7f3bba000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb406dd50 con 0x7f3bb40aefa0 2024-04-25T09:12:19.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.746+0000 7f3bba000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb40b4790 con 0x7f3bb415edd0 2024-04-25T09:12:19.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.746+0000 7f3bba000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb415f320 con 0x7f3bb40b3e70 2024-04-25T09:12:19.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.746+0000 7f3baaa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3bb40aefa0 0x7f3bb40b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.746+0000 7f3baaa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3bb40aefa0 0x7f3bb40b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54018/0 (socket says 172.21.15.173:54018) 2024-04-25T09:12:19.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.746+0000 7f3baaa00640 1 -- 172.21.15.173:0/988830269 learned_addr learned my addr 172.21.15.173:0/988830269 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:19.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.746+0000 7f3bb3e00640 1 --2- 172.21.15.173:0/988830269 >> v2:172.21.15.194:3300/0 conn(0x7f3bb415edd0 0x7f3bb40b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.746+0000 7f3bb3400640 1 --2- 172.21.15.173:0/988830269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bb40b3e70 0x7f3bb40b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.746+0000 7f3baaa00640 1 -- 172.21.15.173:0/988830269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bb40b3e70 msgr2=0x7f3bb40b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:19.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.746+0000 7f3baaa00640 1 --2- 172.21.15.173:0/988830269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bb40b3e70 0x7f3bb40b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.746+0000 7f3baaa00640 1 -- 172.21.15.173:0/988830269 >> v2:172.21.15.194:3300/0 conn(0x7f3bb415edd0 msgr2=0x7f3bb40b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:19.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.746+0000 7f3baaa00640 1 --2- 172.21.15.173:0/988830269 >> v2:172.21.15.194:3300/0 conn(0x7f3bb415edd0 0x7f3bb40b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.746+0000 7f3baaa00640 1 -- 172.21.15.173:0/988830269 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb406d420 con 0x7f3bb40aefa0 2024-04-25T09:12:19.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.746+0000 7f3bb3400640 1 --2- 172.21.15.173:0/988830269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bb40b3e70 0x7f3bb40b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:19.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.746+0000 7f3bb3e00640 1 --2- 172.21.15.173:0/988830269 >> v2:172.21.15.194:3300/0 conn(0x7f3bb415edd0 0x7f3bb40b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:19.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3baaa00640 1 --2- 172.21.15.173:0/988830269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bb40aefa0 0x7f3bb40b2770 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f3bb406bbf0 tx=0x7f3b9c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57de0fac88372e17 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:19.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bb2a00640 1 -- 172.21.15.173:0/988830269 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c0aa430 con 0x7f3bb40aefa0 2024-04-25T09:12:19.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bb2a00640 1 -- 172.21.15.173:0/988830269 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9c0af070 con 0x7f3bb40aefa0 2024-04-25T09:12:19.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bb2a00640 1 -- 172.21.15.173:0/988830269 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c0aa7f0 con 0x7f3bb40aefa0 2024-04-25T09:12:19.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bba000640 1 -- 172.21.15.173:0/988830269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bb40aefa0 msgr2=0x7f3bb40b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bba000640 1 --2- 172.21.15.173:0/988830269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bb40aefa0 0x7f3bb40b2770 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f3bb406bbf0 tx=0x7f3b9c01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bba000640 1 -- 172.21.15.173:0/988830269 shutdown_connections 2024-04-25T09:12:19.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bba000640 1 --2- 172.21.15.173:0/988830269 >> v2:172.21.15.194:3300/0 conn(0x7f3bb415edd0 0x7f3bb40b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bba000640 1 --2- 172.21.15.173:0/988830269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bb40aefa0 0x7f3bb40b2770 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bba000640 1 --2- 172.21.15.173:0/988830269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bb40b3e70 0x7f3bb40b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bba000640 1 -- 172.21.15.173:0/988830269 >> 172.21.15.173:0/988830269 conn(0x7f3bb406ac90 msgr2=0x7f3bb406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:19.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bba000640 1 -- 172.21.15.173:0/988830269 shutdown_connections 2024-04-25T09:12:19.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bba000640 1 -- 172.21.15.173:0/988830269 wait complete. 2024-04-25T09:12:19.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bba000640 1 Processor -- start 2024-04-25T09:12:19.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bba000640 1 -- start start 2024-04-25T09:12:19.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bba000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bb40aefa0 0x7f3bb4135460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bba000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bb40b3e70 0x7f3bb414dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bba000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bb415edd0 0x7f3bb41fa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bba000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb406e1c0 con 0x7f3bb415edd0 2024-04-25T09:12:19.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bba000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40b3600 con 0x7f3bb40aefa0 2024-04-25T09:12:19.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bba000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb406e340 con 0x7f3bb40b3e70 2024-04-25T09:12:19.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bb3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bb415edd0 0x7f3bb41fa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bb3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bb415edd0 0x7f3bb41fa6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54026/0 (socket says 172.21.15.173:54026) 2024-04-25T09:12:19.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.750+0000 7f3bb3e00640 1 -- 172.21.15.173:0/3157476237 learned_addr learned my addr 172.21.15.173:0/3157476237 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:19.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3bb3400640 1 --2- 172.21.15.173:0/3157476237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bb40aefa0 0x7f3bb4135460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3baaa00640 1 --2- 172.21.15.173:0/3157476237 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bb40b3e70 0x7f3bb414dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3bb3e00640 1 -- 172.21.15.173:0/3157476237 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bb40b3e70 msgr2=0x7f3bb414dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3bb3e00640 1 --2- 172.21.15.173:0/3157476237 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bb40b3e70 0x7f3bb414dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3bb3e00640 1 -- 172.21.15.173:0/3157476237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bb40aefa0 msgr2=0x7f3bb4135460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3bb3e00640 1 --2- 172.21.15.173:0/3157476237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bb40aefa0 0x7f3bb4135460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3bb3e00640 1 -- 172.21.15.173:0/3157476237 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb41fb510 con 0x7f3bb415edd0 2024-04-25T09:12:19.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3baaa00640 1 --2- 172.21.15.173:0/3157476237 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bb40b3e70 0x7f3bb414dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:19.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3bb3e00640 1 --2- 172.21.15.173:0/3157476237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bb415edd0 0x7f3bb41fa6c0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00cef0 tx=0x7f3bac00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:19.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3babe00640 1 -- 172.21.15.173:0/3157476237 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac01a070 con 0x7f3bb415edd0 2024-04-25T09:12:19.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3babe00640 1 -- 172.21.15.173:0/3157476237 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac00d860 con 0x7f3bb415edd0 2024-04-25T09:12:19.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3bba000640 1 -- 172.21.15.173:0/3157476237 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb41fb230 con 0x7f3bb415edd0 2024-04-25T09:12:19.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3babe00640 1 -- 172.21.15.173:0/3157476237 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00dc50 con 0x7f3bb415edd0 2024-04-25T09:12:19.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3bba000640 1 -- 172.21.15.173:0/3157476237 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb4134c60 con 0x7f3bb415edd0 2024-04-25T09:12:19.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3bba000640 1 -- 172.21.15.173:0/3157476237 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb4073a40 con 0x7f3bb415edd0 2024-04-25T09:12:19.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3babe00640 1 -- 172.21.15.173:0/3157476237 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3bac01d070 con 0x7f3bb415edd0 2024-04-25T09:12:19.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3babe00640 1 --2- 172.21.15.173:0/3157476237 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b90066f60 0x7f3b90069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3babe00640 1 -- 172.21.15.173:0/3157476237 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3bac0859d0 con 0x7f3bb415edd0 2024-04-25T09:12:19.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.754+0000 7f3bb3400640 1 --2- 172.21.15.173:0/3157476237 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b90066f60 0x7f3b90069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.758+0000 7f3bb3400640 1 --2- 172.21.15.173:0/3157476237 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b90066f60 0x7f3b90069420 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3bb415daf0 tx=0x7f3ba4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:19.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.758+0000 7f3babe00640 1 -- 172.21.15.173:0/3157476237 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3bac0562b0 con 0x7f3bb415edd0 2024-04-25T09:12:19.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.914+0000 7f3bba000640 1 -- 172.21.15.173:0/3157476237 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bb406e540 con 0x7f3bb415edd0 2024-04-25T09:12:19.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.918+0000 7f3babe00640 1 -- 172.21.15.173:0/3157476237 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+17012 (secure 0 0 0) 0x7f3bac05a350 con 0x7f3bb415edd0 2024-04-25T09:12:19.902 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:19.902 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":122,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:11:27.763236+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:11:24.499900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T09:11:25.140140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:19.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.918+0000 7f3bba000640 1 -- 172.21.15.173:0/3157476237 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b90066f60 msgr2=0x7f3b90069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.918+0000 7f3bba000640 1 --2- 172.21.15.173:0/3157476237 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b90066f60 0x7f3b90069420 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3bb415daf0 tx=0x7f3ba4008040 comp rx=0 tx=0).stop 2024-04-25T09:12:19.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.918+0000 7f3bba000640 1 -- 172.21.15.173:0/3157476237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bb415edd0 msgr2=0x7f3bb41fa6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.918+0000 7f3bba000640 1 --2- 172.21.15.173:0/3157476237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bb415edd0 0x7f3bb41fa6c0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00cef0 tx=0x7f3bac00a710 comp rx=0 tx=0).stop 2024-04-25T09:12:19.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.918+0000 7f3bba000640 1 -- 172.21.15.173:0/3157476237 shutdown_connections 2024-04-25T09:12:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.918+0000 7f3bba000640 1 --2- 172.21.15.173:0/3157476237 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b90066f60 0x7f3b90069420 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.918+0000 7f3bba000640 1 --2- 172.21.15.173:0/3157476237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bb415edd0 0x7f3bb41fa6c0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.918+0000 7f3bba000640 1 --2- 172.21.15.173:0/3157476237 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bb40b3e70 0x7f3bb414dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.918+0000 7f3bba000640 1 --2- 172.21.15.173:0/3157476237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bb40aefa0 0x7f3bb4135460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.918+0000 7f3bba000640 1 -- 172.21.15.173:0/3157476237 >> 172.21.15.173:0/3157476237 conn(0x7f3bb406ac90 msgr2=0x7f3bb406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.918+0000 7f3bba000640 1 -- 172.21.15.173:0/3157476237 shutdown_connections 2024-04-25T09:12:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:19.918+0000 7f3bba000640 1 -- 172.21.15.173:0/3157476237 wait complete. 2024-04-25T09:12:19.923 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:11:24.499900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:11:25.140140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:12:19.923 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:12:20.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.078+0000 7f0dbe000640 1 Processor -- start 2024-04-25T09:12:20.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.078+0000 7f0dbe000640 1 -- start start 2024-04-25T09:12:20.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.078+0000 7f0dbe000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0db80aeb90 0x7f0db80cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.078+0000 7f0dbe000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db8071570 con 0x7f0db80ce2b0 2024-04-25T09:12:20.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.078+0000 7f0dbe000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db8071850 con 0x7f0db80aef70 2024-04-25T09:12:20.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.078+0000 7f0dbe000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db8071320 con 0x7f0db80aeb90 2024-04-25T09:12:20.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.078+0000 7f0db7400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0db80aeb90 0x7f0db80cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.078+0000 7f0db7e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f0db80ce2b0 0x7f0db815af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49218/0 (socket says 172.21.15.173:49218) 2024-04-25T09:12:20.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.078+0000 7f0db7e00640 1 -- 172.21.15.173:0/1852089432 learned_addr learned my addr 172.21.15.173:0/1852089432 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:20.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.078+0000 7f0db7400640 1 -- 172.21.15.173:0/1852089432 >> v1:172.21.15.194:6789/0 conn(0x7f0db80aef70 legacy=0x7f0db80cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:20.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.078+0000 7f0db7400640 1 -- 172.21.15.173:0/1852089432 >> v1:172.21.15.173:6789/0 conn(0x7f0db80ce2b0 legacy=0x7f0db815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.078+0000 7f0db7400640 1 -- 172.21.15.173:0/1852089432 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db8071b30 con 0x7f0db80aeb90 2024-04-25T09:12:20.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.078+0000 7f0db6a00640 1 -- 172.21.15.173:0/1852089432 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914942008 0 0) 0x7f0db8071570 con 0x7f0db80ce2b0 2024-04-25T09:12:20.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.082+0000 7f0db7400640 1 --2- 172.21.15.173:0/1852089432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db80aeb90 0x7f0db80cc0d0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f0da80097c0 tx=0x7f0da801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fafbd90b6ce717b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:20.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.082+0000 7f0db6a00640 1 -- 172.21.15.173:0/1852089432 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da80b0070 con 0x7f0db80aeb90 2024-04-25T09:12:20.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.082+0000 7f0db6a00640 1 -- 172.21.15.173:0/1852089432 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da80ab600 con 0x7f0db80aeb90 2024-04-25T09:12:20.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.082+0000 7f0db6a00640 1 -- 172.21.15.173:0/1852089432 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da80ab9d0 con 0x7f0db80aeb90 2024-04-25T09:12:20.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.082+0000 7f0dbe000640 1 -- 172.21.15.173:0/1852089432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db80aeb90 msgr2=0x7f0db80cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.082+0000 7f0dbe000640 1 --2- 172.21.15.173:0/1852089432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db80aeb90 0x7f0db80cc0d0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f0da80097c0 tx=0x7f0da801c410 comp rx=0 tx=0).stop 2024-04-25T09:12:20.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.082+0000 7f0dbe000640 1 -- 172.21.15.173:0/1852089432 shutdown_connections 2024-04-25T09:12:20.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.082+0000 7f0dbe000640 1 --2- 172.21.15.173:0/1852089432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db80aeb90 0x7f0db80cc0d0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.082+0000 7f0dbe000640 1 -- 172.21.15.173:0/1852089432 >> 172.21.15.173:0/1852089432 conn(0x7f0db806ac90 msgr2=0x7f0db806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:20.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.082+0000 7f0dbe000640 1 -- 172.21.15.173:0/1852089432 shutdown_connections 2024-04-25T09:12:20.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.082+0000 7f0dbe000640 1 -- 172.21.15.173:0/1852089432 wait complete. 2024-04-25T09:12:20.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0dbe000640 1 Processor -- start 2024-04-25T09:12:20.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0dbe000640 1 -- start start 2024-04-25T09:12:20.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0dbe000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db80aeb90 0x7f0db814fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0dbe000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db80aef70 0x7f0db814a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0dbe000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db80ce2b0 0x7f0db814b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0dbe000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db8168ac0 con 0x7f0db80ce2b0 2024-04-25T09:12:20.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0dbe000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db8168940 con 0x7f0db80aef70 2024-04-25T09:12:20.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0dbe000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db8168c40 con 0x7f0db80aeb90 2024-04-25T09:12:20.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0db7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db80ce2b0 0x7f0db814b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0db7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db80ce2b0 0x7f0db814b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54050/0 (socket says 172.21.15.173:54050) 2024-04-25T09:12:20.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0db7e00640 1 -- 172.21.15.173:0/572248623 learned_addr learned my addr 172.21.15.173:0/572248623 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:20.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0db7400640 1 --2- 172.21.15.173:0/572248623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db80aeb90 0x7f0db814fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0daea00640 1 --2- 172.21.15.173:0/572248623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db80aef70 0x7f0db814a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0db7e00640 1 -- 172.21.15.173:0/572248623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db80aeb90 msgr2=0x7f0db814fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0db7e00640 1 --2- 172.21.15.173:0/572248623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db80aeb90 0x7f0db814fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0db7e00640 1 -- 172.21.15.173:0/572248623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db80aef70 msgr2=0x7f0db814a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0db7e00640 1 --2- 172.21.15.173:0/572248623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db80aef70 0x7f0db814a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0db7e00640 1 -- 172.21.15.173:0/572248623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db80ac960 con 0x7f0db80ce2b0 2024-04-25T09:12:20.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0db7e00640 1 --2- 172.21.15.173:0/572248623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db80ce2b0 0x7f0db814b900 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f0db000c7d0 tx=0x7f0db000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:20.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0dafe00640 1 -- 172.21.15.173:0/572248623 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0018070 con 0x7f0db80ce2b0 2024-04-25T09:12:20.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0dafe00640 1 -- 172.21.15.173:0/572248623 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db000a640 con 0x7f0db80ce2b0 2024-04-25T09:12:20.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0dafe00640 1 -- 172.21.15.173:0/572248623 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db000aa70 con 0x7f0db80ce2b0 2024-04-25T09:12:20.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0dbe000640 1 -- 172.21.15.173:0/572248623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db80acc00 con 0x7f0db80ce2b0 2024-04-25T09:12:20.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0dbe000640 1 -- 172.21.15.173:0/572248623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db81503a0 con 0x7f0db80ce2b0 2024-04-25T09:12:20.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.086+0000 7f0dbe000640 1 -- 172.21.15.173:0/572248623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db8073ab0 con 0x7f0db80ce2b0 2024-04-25T09:12:20.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.090+0000 7f0dafe00640 1 -- 172.21.15.173:0/572248623 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0db000ac10 con 0x7f0db80ce2b0 2024-04-25T09:12:20.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.090+0000 7f0dafe00640 1 --2- 172.21.15.173:0/572248623 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d94066f60 0x7f0d94069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.090+0000 7f0dafe00640 1 -- 172.21.15.173:0/572248623 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0db00847e0 con 0x7f0db80ce2b0 2024-04-25T09:12:20.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.090+0000 7f0db7400640 1 --2- 172.21.15.173:0/572248623 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d94066f60 0x7f0d94069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.090+0000 7f0db7400640 1 --2- 172.21.15.173:0/572248623 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d94066f60 0x7f0d94069420 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0da80ad000 tx=0x7f0da80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:20.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.094+0000 7f0dafe00640 1 -- 172.21.15.173:0/572248623 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0db0054f70 con 0x7f0db80ce2b0 2024-04-25T09:12:20.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.246+0000 7f0dbe000640 1 -- 172.21.15.173:0/572248623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0db80b2480 con 0x7f0db80ce2b0 2024-04-25T09:12:20.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.246+0000 7f0dafe00640 1 -- 172.21.15.173:0/572248623 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v122) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0db0059010 con 0x7f0db80ce2b0 2024-04-25T09:12:20.232 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:12:20.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.250+0000 7f0dbe000640 1 -- 172.21.15.173:0/572248623 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d94066f60 msgr2=0x7f0d94069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.250+0000 7f0dbe000640 1 --2- 172.21.15.173:0/572248623 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d94066f60 0x7f0d94069420 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0da80ad000 tx=0x7f0da80a6000 comp rx=0 tx=0).stop 2024-04-25T09:12:20.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.250+0000 7f0dbe000640 1 -- 172.21.15.173:0/572248623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db80ce2b0 msgr2=0x7f0db814b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.250+0000 7f0dbe000640 1 --2- 172.21.15.173:0/572248623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db80ce2b0 0x7f0db814b900 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f0db000c7d0 tx=0x7f0db000cc90 comp rx=0 tx=0).stop 2024-04-25T09:12:20.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.250+0000 7f0dbe000640 1 -- 172.21.15.173:0/572248623 shutdown_connections 2024-04-25T09:12:20.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.250+0000 7f0dbe000640 1 --2- 172.21.15.173:0/572248623 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d94066f60 0x7f0d94069420 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.250+0000 7f0dbe000640 1 --2- 172.21.15.173:0/572248623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db80ce2b0 0x7f0db814b900 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.250+0000 7f0dbe000640 1 --2- 172.21.15.173:0/572248623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db80aef70 0x7f0db814a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.250+0000 7f0dbe000640 1 --2- 172.21.15.173:0/572248623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db80aeb90 0x7f0db814fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.250+0000 7f0dbe000640 1 -- 172.21.15.173:0/572248623 >> 172.21.15.173:0/572248623 conn(0x7f0db806ac90 msgr2=0x7f0db814e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:20.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.250+0000 7f0dbe000640 1 -- 172.21.15.173:0/572248623 shutdown_connections 2024-04-25T09:12:20.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.250+0000 7f0dbe000640 1 -- 172.21.15.173:0/572248623 wait complete. 2024-04-25T09:12:20.253 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:12:20.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.406+0000 7f6b3b600640 1 Processor -- start 2024-04-25T09:12:20.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.406+0000 7f6b3b600640 1 -- start start 2024-04-25T09:12:20.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.410+0000 7f6b3b600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b340b3fe0 0x7f6b340b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.410+0000 7f6b3b600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6b340cc260 0x7f6b340cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.410+0000 7f6b3b600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3406d4b0 con 0x7f6b34145290 2024-04-25T09:12:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.410+0000 7f6b3b600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3406d790 con 0x7f6b340cc260 2024-04-25T09:12:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.410+0000 7f6b3b600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3406da70 con 0x7f6b340b3fe0 2024-04-25T09:12:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.410+0000 7f6b39600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6b340cc260 0x7f6b340cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.410+0000 7f6b38c00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f6b34145290 0x7f6b3415c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49234/0 (socket says 172.21.15.173:49234) 2024-04-25T09:12:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.410+0000 7f6b39600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6b340cc260 0x7f6b340cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54060/0 (socket says 172.21.15.173:54060) 2024-04-25T09:12:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.410+0000 7f6b38c00640 1 -- 172.21.15.173:0/3889803502 learned_addr learned my addr 172.21.15.173:0/3889803502 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.410+0000 7f6b2be00640 1 --2- 172.21.15.173:0/3889803502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b340b3fe0 0x7f6b340b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.410+0000 7f6b39600640 1 -- 172.21.15.173:0/3889803502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b340b3fe0 msgr2=0x7f6b340b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.410+0000 7f6b39600640 1 --2- 172.21.15.173:0/3889803502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b340b3fe0 0x7f6b340b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.410+0000 7f6b39600640 1 -- 172.21.15.173:0/3889803502 >> v1:172.21.15.173:6789/0 conn(0x7f6b34145290 legacy=0x7f6b3415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.410+0000 7f6b39600640 1 -- 172.21.15.173:0/3889803502 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3406dd50 con 0x7f6b340cc260 2024-04-25T09:12:20.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.410+0000 7f6b33e00640 1 -- 172.21.15.173:0/3889803502 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222400420 0 0) 0x7f6b3406d4b0 con 0x7f6b34145290 2024-04-25T09:12:20.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.414+0000 7f6b39600640 1 --2- 172.21.15.173:0/3889803502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b340cc260 0x7f6b340cc6b0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009d90 tx=0x7f6b2c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0cd13526c2e446d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:20.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.414+0000 7f6b33e00640 1 -- 172.21.15.173:0/3889803502 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c0b2070 con 0x7f6b340cc260 2024-04-25T09:12:20.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.414+0000 7f6b33e00640 1 -- 172.21.15.173:0/3889803502 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c0a5820 con 0x7f6b340cc260 2024-04-25T09:12:20.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.414+0000 7f6b33e00640 1 -- 172.21.15.173:0/3889803502 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c0a5bf0 con 0x7f6b340cc260 2024-04-25T09:12:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.414+0000 7f6b3b600640 1 -- 172.21.15.173:0/3889803502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b340cc260 msgr2=0x7f6b340cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.414+0000 7f6b3b600640 1 --2- 172.21.15.173:0/3889803502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b340cc260 0x7f6b340cc6b0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009d90 tx=0x7f6b2c01c850 comp rx=0 tx=0).stop 2024-04-25T09:12:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.414+0000 7f6b3b600640 1 -- 172.21.15.173:0/3889803502 shutdown_connections 2024-04-25T09:12:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.414+0000 7f6b3b600640 1 --2- 172.21.15.173:0/3889803502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b340cc260 0x7f6b340cc6b0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.414+0000 7f6b3b600640 1 --2- 172.21.15.173:0/3889803502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b340b3fe0 0x7f6b340b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.414+0000 7f6b3b600640 1 -- 172.21.15.173:0/3889803502 >> 172.21.15.173:0/3889803502 conn(0x7f6b3406ac90 msgr2=0x7f6b3406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.414+0000 7f6b3b600640 1 -- 172.21.15.173:0/3889803502 shutdown_connections 2024-04-25T09:12:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.414+0000 7f6b3b600640 1 -- 172.21.15.173:0/3889803502 wait complete. 2024-04-25T09:12:20.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.414+0000 7f6b3b600640 1 Processor -- start 2024-04-25T09:12:20.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.414+0000 7f6b3b600640 1 -- start start 2024-04-25T09:12:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b3b600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b340b3fe0 0x7f6b340cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b3b600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b340cc260 0x7f6b34160650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b3b600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b34145290 0x7f6b34160b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b3b600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3406eee0 con 0x7f6b340b3fe0 2024-04-25T09:12:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b3b600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3406ed60 con 0x7f6b340cc260 2024-04-25T09:12:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b3b600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3406f060 con 0x7f6b34145290 2024-04-25T09:12:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b38c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b340b3fe0 0x7f6b340cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b38c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b340b3fe0 0x7f6b340cd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54062/0 (socket says 172.21.15.173:54062) 2024-04-25T09:12:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b38c00640 1 -- 172.21.15.173:0/294769208 learned_addr learned my addr 172.21.15.173:0/294769208 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b2be00640 1 --2- 172.21.15.173:0/294769208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b340cc260 0x7f6b34160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b39600640 1 --2- 172.21.15.173:0/294769208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b34145290 0x7f6b34160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b38c00640 1 -- 172.21.15.173:0/294769208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b34145290 msgr2=0x7f6b34160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b38c00640 1 --2- 172.21.15.173:0/294769208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b34145290 0x7f6b34160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b38c00640 1 -- 172.21.15.173:0/294769208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b340cc260 msgr2=0x7f6b34160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b38c00640 1 --2- 172.21.15.173:0/294769208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b340cc260 0x7f6b34160650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b38c00640 1 -- 172.21.15.173:0/294769208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b341611a0 con 0x7f6b340b3fe0 2024-04-25T09:12:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b2be00640 1 --2- 172.21.15.173:0/294769208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b340cc260 0x7f6b34160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b38c00640 1 --2- 172.21.15.173:0/294769208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b340b3fe0 0x7f6b340cd550 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f6b2400c4b0 tx=0x7f6b2400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b31600640 1 -- 172.21.15.173:0/294769208 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b24018070 con 0x7f6b340b3fe0 2024-04-25T09:12:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b31600640 1 -- 172.21.15.173:0/294769208 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b24007500 con 0x7f6b340b3fe0 2024-04-25T09:12:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b31600640 1 -- 172.21.15.173:0/294769208 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b24004a30 con 0x7f6b340b3fe0 2024-04-25T09:12:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b3b600640 1 -- 172.21.15.173:0/294769208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b34161480 con 0x7f6b340b3fe0 2024-04-25T09:12:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b3b600640 1 -- 172.21.15.173:0/294769208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b34130f20 con 0x7f6b340b3fe0 2024-04-25T09:12:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b3b600640 1 -- 172.21.15.173:0/294769208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b34073ab0 con 0x7f6b340b3fe0 2024-04-25T09:12:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.418+0000 7f6b31600640 1 -- 172.21.15.173:0/294769208 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6b2401b070 con 0x7f6b340b3fe0 2024-04-25T09:12:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.422+0000 7f6b31600640 1 --2- 172.21.15.173:0/294769208 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6b10066f60 0x7f6b10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.422+0000 7f6b31600640 1 -- 172.21.15.173:0/294769208 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6b24084540 con 0x7f6b340b3fe0 2024-04-25T09:12:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.422+0000 7f6b2be00640 1 --2- 172.21.15.173:0/294769208 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6b10066f60 0x7f6b10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.422+0000 7f6b2be00640 1 --2- 172.21.15.173:0/294769208 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6b10066f60 0x7f6b10069420 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6b340cf350 tx=0x7f6b1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:20.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.426+0000 7f6b31600640 1 -- 172.21.15.173:0/294769208 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6b24055330 con 0x7f6b340b3fe0 2024-04-25T09:12:20.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.582+0000 7f6b3b600640 1 -- 172.21.15.173:0/294769208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b341310f0 con 0x7f6b340b3fe0 2024-04-25T09:12:20.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.582+0000 7f6b31600640 1 -- 172.21.15.173:0/294769208 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v122) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6b24054c30 con 0x7f6b340b3fe0 2024-04-25T09:12:20.568 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:12:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.586+0000 7f6b3b600640 1 -- 172.21.15.173:0/294769208 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6b10066f60 msgr2=0x7f6b10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.586+0000 7f6b3b600640 1 --2- 172.21.15.173:0/294769208 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6b10066f60 0x7f6b10069420 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6b340cf350 tx=0x7f6b1c008040 comp rx=0 tx=0).stop 2024-04-25T09:12:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.586+0000 7f6b3b600640 1 -- 172.21.15.173:0/294769208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b340b3fe0 msgr2=0x7f6b340cd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.586+0000 7f6b3b600640 1 --2- 172.21.15.173:0/294769208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b340b3fe0 0x7f6b340cd550 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f6b2400c4b0 tx=0x7f6b2400c970 comp rx=0 tx=0).stop 2024-04-25T09:12:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.586+0000 7f6b3b600640 1 -- 172.21.15.173:0/294769208 shutdown_connections 2024-04-25T09:12:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.586+0000 7f6b3b600640 1 --2- 172.21.15.173:0/294769208 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6b10066f60 0x7f6b10069420 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.586+0000 7f6b3b600640 1 --2- 172.21.15.173:0/294769208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b34145290 0x7f6b34160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.586+0000 7f6b3b600640 1 --2- 172.21.15.173:0/294769208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b340cc260 0x7f6b34160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.586+0000 7f6b3b600640 1 --2- 172.21.15.173:0/294769208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b340b3fe0 0x7f6b340cd550 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.586+0000 7f6b3b600640 1 -- 172.21.15.173:0/294769208 >> 172.21.15.173:0/294769208 conn(0x7f6b3406ac90 msgr2=0x7f6b340b0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.586+0000 7f6b3b600640 1 -- 172.21.15.173:0/294769208 shutdown_connections 2024-04-25T09:12:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.586+0000 7f6b3b600640 1 -- 172.21.15.173:0/294769208 wait complete. 2024-04-25T09:12:20.588 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:12:20.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.742+0000 7f4e4e200640 1 Processor -- start 2024-04-25T09:12:20.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.742+0000 7f4e4e200640 1 -- start start 2024-04-25T09:12:20.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.742+0000 7f4e4e200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4e48145290 0x7f4e4815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.742+0000 7f4e4e200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4815c5f0 con 0x7f4e480b3fe0 2024-04-25T09:12:20.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.742+0000 7f4e4e200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4806d4b0 con 0x7f4e480cc260 2024-04-25T09:12:20.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.742+0000 7f4e4e200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e480ccd80 con 0x7f4e48145290 2024-04-25T09:12:20.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.742+0000 7f4e47400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4e48145290 0x7f4e4815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.742+0000 7f4e47400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4e48145290 0x7f4e4815c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54068/0 (socket says 172.21.15.173:54068) 2024-04-25T09:12:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.742+0000 7f4e46a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4e480b3fe0 0x7f4e480b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49242/0 (socket says 172.21.15.173:49242) 2024-04-25T09:12:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.742+0000 7f4e47400640 1 -- 172.21.15.173:0/4083356683 learned_addr learned my addr 172.21.15.173:0/4083356683 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.746+0000 7f4e47400640 1 -- 172.21.15.173:0/4083356683 >> v1:172.21.15.194:6789/0 conn(0x7f4e480cc260 legacy=0x7f4e480cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.746+0000 7f4e47400640 1 -- 172.21.15.173:0/4083356683 >> v1:172.21.15.173:6789/0 conn(0x7f4e480b3fe0 legacy=0x7f4e480b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.746+0000 7f4e47400640 1 -- 172.21.15.173:0/4083356683 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4806d790 con 0x7f4e48145290 2024-04-25T09:12:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.746+0000 7f4e46000640 1 -- 172.21.15.173:0/4083356683 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481103548 0 0) 0x7f4e34001120 con 0x7f4e480b3fe0 2024-04-25T09:12:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.746+0000 7f4e47400640 1 --2- 172.21.15.173:0/4083356683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e48145290 0x7f4e4815c0b0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f4e38009870 tx=0x7f4e3801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9404a7f72e1e29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.746+0000 7f4e46000640 1 -- 172.21.15.173:0/4083356683 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e380b0070 con 0x7f4e48145290 2024-04-25T09:12:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.746+0000 7f4e46000640 1 -- 172.21.15.173:0/4083356683 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e38004230 con 0x7f4e48145290 2024-04-25T09:12:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.746+0000 7f4e46000640 1 -- 172.21.15.173:0/4083356683 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e38003620 con 0x7f4e48145290 2024-04-25T09:12:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.746+0000 7f4e4e200640 1 -- 172.21.15.173:0/4083356683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e48145290 msgr2=0x7f4e4815c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.746+0000 7f4e4e200640 1 --2- 172.21.15.173:0/4083356683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e48145290 0x7f4e4815c0b0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f4e38009870 tx=0x7f4e3801c440 comp rx=0 tx=0).stop 2024-04-25T09:12:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.746+0000 7f4e4e200640 1 -- 172.21.15.173:0/4083356683 shutdown_connections 2024-04-25T09:12:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.746+0000 7f4e4e200640 1 --2- 172.21.15.173:0/4083356683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e48145290 0x7f4e4815c0b0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.746+0000 7f4e4e200640 1 -- 172.21.15.173:0/4083356683 >> 172.21.15.173:0/4083356683 conn(0x7f4e4806ac90 msgr2=0x7f4e4806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.746+0000 7f4e4e200640 1 -- 172.21.15.173:0/4083356683 shutdown_connections 2024-04-25T09:12:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.746+0000 7f4e4e200640 1 -- 172.21.15.173:0/4083356683 wait complete. 2024-04-25T09:12:20.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e4e200640 1 Processor -- start 2024-04-25T09:12:20.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e4e200640 1 -- start start 2024-04-25T09:12:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e4e200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e480b3fe0 0x7f4e4815bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e4e200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e480cc260 0x7f4e4813e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e4e200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e48145290 0x7f4e480ce630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e4e200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4806eee0 con 0x7f4e480b3fe0 2024-04-25T09:12:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e4e200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4806ed60 con 0x7f4e480cc260 2024-04-25T09:12:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e4e200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4806f060 con 0x7f4e48145290 2024-04-25T09:12:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e47400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e480b3fe0 0x7f4e4815bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e47400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e480b3fe0 0x7f4e4815bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54080/0 (socket says 172.21.15.173:54080) 2024-04-25T09:12:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e47400640 1 -- 172.21.15.173:0/108693992 learned_addr learned my addr 172.21.15.173:0/108693992 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e46a00640 1 --2- 172.21.15.173:0/108693992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e480cc260 0x7f4e4813e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e47e00640 1 --2- 172.21.15.173:0/108693992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e48145290 0x7f4e480ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e47400640 1 -- 172.21.15.173:0/108693992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e48145290 msgr2=0x7f4e480ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e47400640 1 --2- 172.21.15.173:0/108693992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e48145290 0x7f4e480ce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e47400640 1 -- 172.21.15.173:0/108693992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e480cc260 msgr2=0x7f4e4813e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e47400640 1 --2- 172.21.15.173:0/108693992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e480cc260 0x7f4e4813e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e47400640 1 -- 172.21.15.173:0/108693992 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e480cf010 con 0x7f4e480b3fe0 2024-04-25T09:12:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e47e00640 1 --2- 172.21.15.173:0/108693992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e48145290 0x7f4e480ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e47400640 1 --2- 172.21.15.173:0/108693992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e480b3fe0 0x7f4e4815bab0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f4e380ae040 tx=0x7f4e380191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e3f400640 1 -- 172.21.15.173:0/108693992 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e380b0040 con 0x7f4e480b3fe0 2024-04-25T09:12:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e3f400640 1 -- 172.21.15.173:0/108693992 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e380bb070 con 0x7f4e480b3fe0 2024-04-25T09:12:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e4e200640 1 -- 172.21.15.173:0/108693992 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e48142c90 con 0x7f4e480b3fe0 2024-04-25T09:12:20.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e3f400640 1 -- 172.21.15.173:0/108693992 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e380b6440 con 0x7f4e480b3fe0 2024-04-25T09:12:20.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.750+0000 7f4e4e200640 1 -- 172.21.15.173:0/108693992 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e48143250 con 0x7f4e480b3fe0 2024-04-25T09:12:20.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.754+0000 7f4e4e200640 1 -- 172.21.15.173:0/108693992 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e48073ab0 con 0x7f4e480b3fe0 2024-04-25T09:12:20.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.754+0000 7f4e3f400640 1 -- 172.21.15.173:0/108693992 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4e380b65e0 con 0x7f4e480b3fe0 2024-04-25T09:12:20.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.754+0000 7f4e3f400640 1 --2- 172.21.15.173:0/108693992 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4e28066f60 0x7f4e28069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.754+0000 7f4e3f400640 1 -- 172.21.15.173:0/108693992 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4e3811f530 con 0x7f4e480b3fe0 2024-04-25T09:12:20.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.754+0000 7f4e46a00640 1 --2- 172.21.15.173:0/108693992 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4e28066f60 0x7f4e28069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.754+0000 7f4e46a00640 1 --2- 172.21.15.173:0/108693992 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4e28066f60 0x7f4e28069420 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4e4813db00 tx=0x7f4e34007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:20.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.758+0000 7f4e3f400640 1 -- 172.21.15.173:0/108693992 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4e38016150 con 0x7f4e480b3fe0 2024-04-25T09:12:20.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.914+0000 7f4e4e200640 1 -- 172.21.15.173:0/108693992 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4e4813c920 con 0x7f4e480b3fe0 2024-04-25T09:12:20.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.914+0000 7f4e3f400640 1 -- 172.21.15.173:0/108693992 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v122) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4e380f0440 con 0x7f4e480b3fe0 2024-04-25T09:12:20.899 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:12:20.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.914+0000 7f4e4e200640 1 -- 172.21.15.173:0/108693992 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4e28066f60 msgr2=0x7f4e28069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.918+0000 7f4e4e200640 1 --2- 172.21.15.173:0/108693992 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4e28066f60 0x7f4e28069420 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4e4813db00 tx=0x7f4e34007d30 comp rx=0 tx=0).stop 2024-04-25T09:12:20.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.918+0000 7f4e4e200640 1 -- 172.21.15.173:0/108693992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e480b3fe0 msgr2=0x7f4e4815bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.918+0000 7f4e4e200640 1 --2- 172.21.15.173:0/108693992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e480b3fe0 0x7f4e4815bab0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f4e380ae040 tx=0x7f4e380191e0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.918+0000 7f4e4e200640 1 -- 172.21.15.173:0/108693992 shutdown_connections 2024-04-25T09:12:20.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.918+0000 7f4e4e200640 1 --2- 172.21.15.173:0/108693992 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4e28066f60 0x7f4e28069420 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.918+0000 7f4e4e200640 1 --2- 172.21.15.173:0/108693992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e48145290 0x7f4e480ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.918+0000 7f4e4e200640 1 --2- 172.21.15.173:0/108693992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e480cc260 0x7f4e4813e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.918+0000 7f4e4e200640 1 --2- 172.21.15.173:0/108693992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e480b3fe0 0x7f4e4815bab0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.918+0000 7f4e4e200640 1 -- 172.21.15.173:0/108693992 >> 172.21.15.173:0/108693992 conn(0x7f4e4806ac90 msgr2=0x7f4e480cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:20.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.918+0000 7f4e4e200640 1 -- 172.21.15.173:0/108693992 shutdown_connections 2024-04-25T09:12:20.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:20.918+0000 7f4e4e200640 1 -- 172.21.15.173:0/108693992 wait complete. 2024-04-25T09:12:20.920 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:21.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.070+0000 7fa45ca00640 1 Processor -- start 2024-04-25T09:12:21.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.070+0000 7fa45ca00640 1 -- start start 2024-04-25T09:12:21.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.070+0000 7fa45ca00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa4580cc8b0 0x7fa4580ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:21.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.070+0000 7fa45ca00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa4580ce8f0 0x7fa4580ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:21.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.070+0000 7fa45ca00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45806e7c0 con 0x7fa458145250 2024-04-25T09:12:21.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.070+0000 7fa45ca00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45806d720 con 0x7fa4580cc8b0 2024-04-25T09:12:21.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.070+0000 7fa45ca00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45806da00 con 0x7fa4580ce8f0 2024-04-25T09:12:21.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.070+0000 7fa455e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa458145250 0x7fa45815c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49252/0 (socket says 172.21.15.173:49252) 2024-04-25T09:12:21.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.070+0000 7fa455e00640 1 -- 172.21.15.173:0/563774554 learned_addr learned my addr 172.21.15.173:0/563774554 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:21.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.074+0000 7fa455400640 1 --2- 172.21.15.173:0/563774554 >> v2:172.21.15.173:3300/0 conn(0x7fa4580cc8b0 0x7fa4580ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:21.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.074+0000 7fa456800640 1 --2- 172.21.15.173:0/563774554 >> v2:172.21.15.194:3300/0 conn(0x7fa4580ce8f0 0x7fa4580ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:21.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.074+0000 7fa454a00640 1 -- 172.21.15.173:0/563774554 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834972208 0 0) 0x7fa45806e7c0 con 0x7fa458145250 2024-04-25T09:12:21.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.074+0000 7fa454a00640 1 -- 172.21.15.173:0/563774554 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa43c003530 con 0x7fa458145250 2024-04-25T09:12:21.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.074+0000 7fa455400640 1 -- 172.21.15.173:0/563774554 >> v2:172.21.15.194:3300/0 conn(0x7fa4580ce8f0 msgr2=0x7fa4580ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:21.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.074+0000 7fa455400640 1 --2- 172.21.15.173:0/563774554 >> v2:172.21.15.194:3300/0 conn(0x7fa4580ce8f0 0x7fa4580ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.074+0000 7fa455400640 1 -- 172.21.15.173:0/563774554 >> v1:172.21.15.173:6789/0 conn(0x7fa458145250 legacy=0x7fa45815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:21.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.074+0000 7fa455400640 1 -- 172.21.15.173:0/563774554 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45806dce0 con 0x7fa4580cc8b0 2024-04-25T09:12:21.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.074+0000 7fa455400640 1 --2- 172.21.15.173:0/563774554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4580cc8b0 0x7fa4580ccd30 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fa45806f4a0 tx=0x7fa44401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4ce74846985996 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:21.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.074+0000 7fa454a00640 1 -- 172.21.15.173:0/563774554 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4440b0070 con 0x7fa4580cc8b0 2024-04-25T09:12:21.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.074+0000 7fa454a00640 1 -- 172.21.15.173:0/563774554 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4440ab600 con 0x7fa4580cc8b0 2024-04-25T09:12:21.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.074+0000 7fa454a00640 1 -- 172.21.15.173:0/563774554 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4440ab9d0 con 0x7fa4580cc8b0 2024-04-25T09:12:21.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa45ca00640 1 -- 172.21.15.173:0/563774554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4580cc8b0 msgr2=0x7fa4580ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:21.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa45ca00640 1 --2- 172.21.15.173:0/563774554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4580cc8b0 0x7fa4580ccd30 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fa45806f4a0 tx=0x7fa44401c480 comp rx=0 tx=0).stop 2024-04-25T09:12:21.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa45ca00640 1 -- 172.21.15.173:0/563774554 shutdown_connections 2024-04-25T09:12:21.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa45ca00640 1 --2- 172.21.15.173:0/563774554 >> v2:172.21.15.194:3300/0 conn(0x7fa4580ce8f0 0x7fa4580ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa45ca00640 1 --2- 172.21.15.173:0/563774554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4580cc8b0 0x7fa4580ccd30 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa45ca00640 1 -- 172.21.15.173:0/563774554 >> 172.21.15.173:0/563774554 conn(0x7fa45806ac90 msgr2=0x7fa45806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:21.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa45ca00640 1 -- 172.21.15.173:0/563774554 shutdown_connections 2024-04-25T09:12:21.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa45ca00640 1 -- 172.21.15.173:0/563774554 wait complete. 2024-04-25T09:12:21.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa45ca00640 1 Processor -- start 2024-04-25T09:12:21.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa45ca00640 1 -- start start 2024-04-25T09:12:21.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa45ca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4580cc8b0 0x7fa4581418f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:21.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa45ca00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4580ce8f0 0x7fa45813d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:21.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa45ca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa458145250 0x7fa45815dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:21.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa45ca00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45806d380 con 0x7fa458145250 2024-04-25T09:12:21.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa45ca00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45806ef80 con 0x7fa4580cc8b0 2024-04-25T09:12:21.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa45ca00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45806d500 con 0x7fa4580ce8f0 2024-04-25T09:12:21.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa456800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa458145250 0x7fa45815dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:21.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa456800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa458145250 0x7fa45815dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54086/0 (socket says 172.21.15.173:54086) 2024-04-25T09:12:21.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa456800640 1 -- 172.21.15.173:0/3693850682 learned_addr learned my addr 172.21.15.173:0/3693850682 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:21.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa456800640 1 -- 172.21.15.173:0/3693850682 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4580ce8f0 msgr2=0x7fa45813d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:21.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa456800640 1 --2- 172.21.15.173:0/3693850682 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4580ce8f0 0x7fa45813d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa456800640 1 -- 172.21.15.173:0/3693850682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4580cc8b0 msgr2=0x7fa4581418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:21.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa455e00640 1 --2- 172.21.15.173:0/3693850682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4580cc8b0 0x7fa4581418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:21.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa456800640 1 --2- 172.21.15.173:0/3693850682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4580cc8b0 0x7fa4581418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa456800640 1 -- 172.21.15.173:0/3693850682 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4581439b0 con 0x7fa458145250 2024-04-25T09:12:21.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa455e00640 1 --2- 172.21.15.173:0/3693850682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4580cc8b0 0x7fa4581418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:21.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.078+0000 7fa456800640 1 --2- 172.21.15.173:0/3693850682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa458145250 0x7fa45815dab0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fa45000efc0 tx=0x7fa45000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:21.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.082+0000 7fa44e000640 1 -- 172.21.15.173:0/3693850682 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450018020 con 0x7fa458145250 2024-04-25T09:12:21.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.082+0000 7fa44e000640 1 -- 172.21.15.173:0/3693850682 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa450014480 con 0x7fa458145250 2024-04-25T09:12:21.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.082+0000 7fa45ca00640 1 -- 172.21.15.173:0/3693850682 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa458142910 con 0x7fa458145250 2024-04-25T09:12:21.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.082+0000 7fa44e000640 1 -- 172.21.15.173:0/3693850682 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450014870 con 0x7fa458145250 2024-04-25T09:12:21.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.082+0000 7fa45ca00640 1 -- 172.21.15.173:0/3693850682 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa458142ed0 con 0x7fa458145250 2024-04-25T09:12:21.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.082+0000 7fa45ca00640 1 -- 172.21.15.173:0/3693850682 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa458073a40 con 0x7fa458145250 2024-04-25T09:12:21.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.082+0000 7fa44e000640 1 -- 172.21.15.173:0/3693850682 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa45001b020 con 0x7fa458145250 2024-04-25T09:12:21.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.082+0000 7fa44e000640 1 --2- 172.21.15.173:0/3693850682 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa438066f60 0x7fa438069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:21.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.082+0000 7fa44e000640 1 -- 172.21.15.173:0/3693850682 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa450085c00 con 0x7fa458145250 2024-04-25T09:12:21.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.082+0000 7fa455e00640 1 --2- 172.21.15.173:0/3693850682 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa438066f60 0x7fa438069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:21.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.082+0000 7fa455e00640 1 --2- 172.21.15.173:0/3693850682 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa438066f60 0x7fa438069420 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa448005890 tx=0x7fa448009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:21.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.086+0000 7fa44e000640 1 -- 172.21.15.173:0/3693850682 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa45008c080 con 0x7fa458145250 2024-04-25T09:12:21.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.270+0000 7fa45ca00640 1 -- 172.21.15.173:0/3693850682 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4580b2790 con 0x7fa458145250 2024-04-25T09:12:21.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.270+0000 7fa44e000640 1 -- 172.21.15.173:0/3693850682 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fa450022070 con 0x7fa458145250 2024-04-25T09:12:21.257 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:21.257 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1021410995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1021410995},{"type":"v1","addr":"172.21.15.194:6834","nonce":1021410995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2198134208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2198134208},{"type":"v1","addr":"172.21.15.194:6835","nonce":2198134208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8772,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/684989574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":684989574},{"type":"v1","addr":"172.21.15.173:6836","nonce":684989574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:26.148874+0000","modified":"2024-04-25T09:11:29.164422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8775":{"gid":8775,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/671971539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":671971539},{"type":"v1","addr":"172.21.15.173:6837","nonce":671971539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:12:21.257 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 81 2024-04-25T09:12:21.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.274+0000 7fa45ca00640 1 -- 172.21.15.173:0/3693850682 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa438066f60 msgr2=0x7fa438069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:21.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.274+0000 7fa45ca00640 1 --2- 172.21.15.173:0/3693850682 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa438066f60 0x7fa438069420 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa448005890 tx=0x7fa448009040 comp rx=0 tx=0).stop 2024-04-25T09:12:21.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.274+0000 7fa45ca00640 1 -- 172.21.15.173:0/3693850682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa458145250 msgr2=0x7fa45815dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:21.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.274+0000 7fa45ca00640 1 --2- 172.21.15.173:0/3693850682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa458145250 0x7fa45815dab0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fa45000efc0 tx=0x7fa45000c490 comp rx=0 tx=0).stop 2024-04-25T09:12:21.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.274+0000 7fa45ca00640 1 -- 172.21.15.173:0/3693850682 shutdown_connections 2024-04-25T09:12:21.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.274+0000 7fa45ca00640 1 --2- 172.21.15.173:0/3693850682 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa438066f60 0x7fa438069420 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.274+0000 7fa45ca00640 1 --2- 172.21.15.173:0/3693850682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa458145250 0x7fa45815dab0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.274+0000 7fa45ca00640 1 --2- 172.21.15.173:0/3693850682 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4580ce8f0 0x7fa45813d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.274+0000 7fa45ca00640 1 --2- 172.21.15.173:0/3693850682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4580cc8b0 0x7fa4581418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.274+0000 7fa45ca00640 1 -- 172.21.15.173:0/3693850682 >> 172.21.15.173:0/3693850682 conn(0x7fa45806ac90 msgr2=0x7fa4581444b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:21.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.274+0000 7fa45ca00640 1 -- 172.21.15.173:0/3693850682 shutdown_connections 2024-04-25T09:12:21.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.274+0000 7fa45ca00640 1 -- 172.21.15.173:0/3693850682 wait complete. 2024-04-25T09:12:21.279 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:21.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.430+0000 7f799d200640 1 Processor -- start 2024-04-25T09:12:21.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.430+0000 7f799d200640 1 -- start start 2024-04-25T09:12:21.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.430+0000 7f799d200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f79980d04a0 0x7f79980d0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:21.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.430+0000 7f799d200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79980cc370 con 0x7f799815a7a0 2024-04-25T09:12:21.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.430+0000 7f799d200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79980cb2d0 con 0x7f799806e200 2024-04-25T09:12:21.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.430+0000 7f799d200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79980cb5b0 con 0x7f79980d04a0 2024-04-25T09:12:21.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.430+0000 7f7996a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f79980d04a0 0x7f79980d0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:21.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.430+0000 7f7997400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f799815a7a0 0x7f79980ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49260/0 (socket says 172.21.15.173:49260) 2024-04-25T09:12:21.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.430+0000 7f7997400640 1 -- 172.21.15.173:0/310592930 learned_addr learned my addr 172.21.15.173:0/310592930 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:21.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.430+0000 7f7996a00640 1 -- 172.21.15.173:0/310592930 >> v1:172.21.15.194:6789/0 conn(0x7f799806e200 legacy=0x7f799806e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:21.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.430+0000 7f7996a00640 1 -- 172.21.15.173:0/310592930 >> v1:172.21.15.173:6789/0 conn(0x7f799815a7a0 legacy=0x7f79980ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:21.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.430+0000 7f7996a00640 1 -- 172.21.15.173:0/310592930 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79980cb890 con 0x7f79980d04a0 2024-04-25T09:12:21.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.430+0000 7f7996000640 1 -- 172.21.15.173:0/310592930 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735087381 0 0) 0x7f79880014a0 con 0x7f799815a7a0 2024-04-25T09:12:21.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.434+0000 7f7996a00640 1 --2- 172.21.15.173:0/310592930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79980d04a0 0x7f79980d0930 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f79840097c0 tx=0x7f798401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e698aa28c737a7e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:21.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.434+0000 7f7996000640 1 -- 172.21.15.173:0/310592930 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79840b0070 con 0x7f79980d04a0 2024-04-25T09:12:21.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.434+0000 7f7996000640 1 -- 172.21.15.173:0/310592930 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79840ab600 con 0x7f79980d04a0 2024-04-25T09:12:21.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.434+0000 7f7996000640 1 -- 172.21.15.173:0/310592930 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79840ab9d0 con 0x7f79980d04a0 2024-04-25T09:12:21.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.434+0000 7f799d200640 1 -- 172.21.15.173:0/310592930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79980d04a0 msgr2=0x7f79980d0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:21.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.434+0000 7f799d200640 1 --2- 172.21.15.173:0/310592930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79980d04a0 0x7f79980d0930 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f79840097c0 tx=0x7f798401c430 comp rx=0 tx=0).stop 2024-04-25T09:12:21.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.434+0000 7f799d200640 1 -- 172.21.15.173:0/310592930 shutdown_connections 2024-04-25T09:12:21.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.434+0000 7f799d200640 1 --2- 172.21.15.173:0/310592930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79980d04a0 0x7f79980d0930 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.434+0000 7f799d200640 1 -- 172.21.15.173:0/310592930 >> 172.21.15.173:0/310592930 conn(0x7f79980726a0 msgr2=0x7f7998099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:21.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.434+0000 7f799d200640 1 -- 172.21.15.173:0/310592930 shutdown_connections 2024-04-25T09:12:21.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.434+0000 7f799d200640 1 -- 172.21.15.173:0/310592930 wait complete. 2024-04-25T09:12:21.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f799d200640 1 Processor -- start 2024-04-25T09:12:21.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f799d200640 1 -- start start 2024-04-25T09:12:21.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f799d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f799806e200 0x7f79980b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:21.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f799d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79980d04a0 0x7f799809b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:21.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f799d200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f799815a7a0 0x7f799809b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:21.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f799d200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79980caef0 con 0x7f799806e200 2024-04-25T09:12:21.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f799d200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799815ab80 con 0x7f79980d04a0 2024-04-25T09:12:21.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f799d200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79980cb070 con 0x7f799815a7a0 2024-04-25T09:12:21.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f7997400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f799806e200 0x7f79980b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:21.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f7997400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f799806e200 0x7f79980b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54108/0 (socket says 172.21.15.173:54108) 2024-04-25T09:12:21.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f7997400640 1 -- 172.21.15.173:0/3077212562 learned_addr learned my addr 172.21.15.173:0/3077212562 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:21.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f7997400640 1 -- 172.21.15.173:0/3077212562 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f799815a7a0 msgr2=0x7f799809b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:21.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f7997400640 1 --2- 172.21.15.173:0/3077212562 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f799815a7a0 0x7f799809b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f7996a00640 1 --2- 172.21.15.173:0/3077212562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79980d04a0 0x7f799809b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:21.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f7997400640 1 -- 172.21.15.173:0/3077212562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79980d04a0 msgr2=0x7f799809b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:21.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f7997400640 1 --2- 172.21.15.173:0/3077212562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79980d04a0 0x7f799809b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f7997400640 1 -- 172.21.15.173:0/3077212562 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79980b02d0 con 0x7f799806e200 2024-04-25T09:12:21.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f7996a00640 1 --2- 172.21.15.173:0/3077212562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79980d04a0 0x7f799809b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:21.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f7997400640 1 --2- 172.21.15.173:0/3077212562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f799806e200 0x7f79980b2450 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f798800c7c0 tx=0x7f798800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:21.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f798f400640 1 -- 172.21.15.173:0/3077212562 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7988018070 con 0x7f799806e200 2024-04-25T09:12:21.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f798f400640 1 -- 172.21.15.173:0/3077212562 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798800a640 con 0x7f799806e200 2024-04-25T09:12:21.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f798f400640 1 -- 172.21.15.173:0/3077212562 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798800aa30 con 0x7f799806e200 2024-04-25T09:12:21.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f799d200640 1 -- 172.21.15.173:0/3077212562 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79980b0860 con 0x7f799806e200 2024-04-25T09:12:21.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.438+0000 7f799d200640 1 -- 172.21.15.173:0/3077212562 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79980b0e20 con 0x7f799806e200 2024-04-25T09:12:21.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.442+0000 7f799d200640 1 -- 172.21.15.173:0/3077212562 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7998073a40 con 0x7f799806e200 2024-04-25T09:12:21.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.442+0000 7f798f400640 1 -- 172.21.15.173:0/3077212562 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f798800abd0 con 0x7f799806e200 2024-04-25T09:12:21.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.442+0000 7f798f400640 1 --2- 172.21.15.173:0/3077212562 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7978066f60 0x7f7978069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:21.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.442+0000 7f798f400640 1 -- 172.21.15.173:0/3077212562 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7988084910 con 0x7f799806e200 2024-04-25T09:12:21.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.442+0000 7f7996a00640 1 --2- 172.21.15.173:0/3077212562 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7978066f60 0x7f7978069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:21.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.442+0000 7f7996a00640 1 --2- 172.21.15.173:0/3077212562 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7978066f60 0x7f7978069420 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f79840ad000 tx=0x7f79840a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:21.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.446+0000 7f798f400640 1 -- 172.21.15.173:0/3077212562 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f79980cc370 con 0x7f799806e200 2024-04-25T09:12:21.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.602+0000 7f799d200640 1 -- 172.21.15.173:0/3077212562 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7998099e60 con 0x7f799806e200 2024-04-25T09:12:21.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.606+0000 7f798f400640 1 -- 172.21.15.173:0/3077212562 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+17012 (secure 0 0 0) 0x7f79880556f0 con 0x7f799806e200 2024-04-25T09:12:21.589 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:21.589 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":122,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:11:27.763236+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:11:24.499900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T09:11:25.140140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:21.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.606+0000 7f799d200640 1 -- 172.21.15.173:0/3077212562 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7978066f60 msgr2=0x7f7978069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:21.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.606+0000 7f799d200640 1 --2- 172.21.15.173:0/3077212562 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7978066f60 0x7f7978069420 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f79840ad000 tx=0x7f79840a6000 comp rx=0 tx=0).stop 2024-04-25T09:12:21.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.606+0000 7f799d200640 1 -- 172.21.15.173:0/3077212562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f799806e200 msgr2=0x7f79980b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:21.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.606+0000 7f799d200640 1 --2- 172.21.15.173:0/3077212562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f799806e200 0x7f79980b2450 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f798800c7c0 tx=0x7f798800cc80 comp rx=0 tx=0).stop 2024-04-25T09:12:21.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.606+0000 7f799d200640 1 -- 172.21.15.173:0/3077212562 shutdown_connections 2024-04-25T09:12:21.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.606+0000 7f799d200640 1 --2- 172.21.15.173:0/3077212562 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7978066f60 0x7f7978069420 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.606+0000 7f799d200640 1 --2- 172.21.15.173:0/3077212562 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f799815a7a0 0x7f799809b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.606+0000 7f799d200640 1 --2- 172.21.15.173:0/3077212562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79980d04a0 0x7f799809b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.606+0000 7f799d200640 1 --2- 172.21.15.173:0/3077212562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f799806e200 0x7f79980b2450 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.606+0000 7f799d200640 1 -- 172.21.15.173:0/3077212562 >> 172.21.15.173:0/3077212562 conn(0x7f79980726a0 msgr2=0x7f79980ad320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:21.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.606+0000 7f799d200640 1 -- 172.21.15.173:0/3077212562 shutdown_connections 2024-04-25T09:12:21.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.606+0000 7f799d200640 1 -- 172.21.15.173:0/3077212562 wait complete. 2024-04-25T09:12:21.611 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:12:21.611 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:21.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.762+0000 7f89d0600640 1 Processor -- start 2024-04-25T09:12:21.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.762+0000 7f89d0600640 1 -- start start 2024-04-25T09:12:21.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.762+0000 7f89d0600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f89c80d1270 0x7f89c80cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:21.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.762+0000 7f89d0600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89c8099b30 0x7f89c8099fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:21.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.762+0000 7f89d0600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c80d01d0 con 0x7f89c80cd7e0 2024-04-25T09:12:21.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.762+0000 7f89d0600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c80cffa0 con 0x7f89c80d1270 2024-04-25T09:12:21.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.762+0000 7f89d0600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c80d04b0 con 0x7f89c8099b30 2024-04-25T09:12:21.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.762+0000 7f89cdc00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f89c80cd7e0 0x7f89c806cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49274/0 (socket says 172.21.15.173:49274) 2024-04-25T09:12:21.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.762+0000 7f89cdc00640 1 -- 172.21.15.173:0/516448401 learned_addr learned my addr 172.21.15.173:0/516448401 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:21.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.762+0000 7f89cd200640 1 --2- 172.21.15.173:0/516448401 >> v2:172.21.15.194:3300/0 conn(0x7f89c80d1270 0x7f89c80cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:21.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.762+0000 7f89ce600640 1 --2- 172.21.15.173:0/516448401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89c8099b30 0x7f89c8099fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:21.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.762+0000 7f89c7e00640 1 -- 172.21.15.173:0/516448401 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069683264 0 0) 0x7f89c80d01d0 con 0x7f89c80cd7e0 2024-04-25T09:12:21.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.762+0000 7f89c7e00640 1 -- 172.21.15.173:0/516448401 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89b0003530 con 0x7f89c80cd7e0 2024-04-25T09:12:21.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.762+0000 7f89ce600640 1 -- 172.21.15.173:0/516448401 >> v2:172.21.15.194:3300/0 conn(0x7f89c80d1270 msgr2=0x7f89c80cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:21.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.762+0000 7f89ce600640 1 --2- 172.21.15.173:0/516448401 >> v2:172.21.15.194:3300/0 conn(0x7f89c80d1270 0x7f89c80cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.762+0000 7f89ce600640 1 -- 172.21.15.173:0/516448401 >> v1:172.21.15.173:6789/0 conn(0x7f89c80cd7e0 legacy=0x7f89c806cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:21.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.762+0000 7f89ce600640 1 -- 172.21.15.173:0/516448401 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c80d0790 con 0x7f89c8099b30 2024-04-25T09:12:21.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.762+0000 7f89cd200640 1 --2- 172.21.15.173:0/516448401 >> v2:172.21.15.194:3300/0 conn(0x7f89c80d1270 0x7f89c80cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:21.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.766+0000 7f89ce600640 1 --2- 172.21.15.173:0/516448401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89c8099b30 0x7f89c8099fc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f89c0009d90 tx=0x7f89c001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57285bfa58bd25e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:21.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.766+0000 7f89c7e00640 1 -- 172.21.15.173:0/516448401 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c00b2070 con 0x7f89c8099b30 2024-04-25T09:12:21.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.766+0000 7f89c7e00640 1 -- 172.21.15.173:0/516448401 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c00a5920 con 0x7f89c8099b30 2024-04-25T09:12:21.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.766+0000 7f89c7e00640 1 -- 172.21.15.173:0/516448401 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c00a5cd0 con 0x7f89c8099b30 2024-04-25T09:12:21.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.766+0000 7f89d0600640 1 -- 172.21.15.173:0/516448401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89c8099b30 msgr2=0x7f89c8099fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:21.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.766+0000 7f89d0600640 1 --2- 172.21.15.173:0/516448401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89c8099b30 0x7f89c8099fc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f89c0009d90 tx=0x7f89c001c970 comp rx=0 tx=0).stop 2024-04-25T09:12:21.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.766+0000 7f89d0600640 1 -- 172.21.15.173:0/516448401 shutdown_connections 2024-04-25T09:12:21.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.766+0000 7f89d0600640 1 --2- 172.21.15.173:0/516448401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89c8099b30 0x7f89c8099fc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.766+0000 7f89d0600640 1 --2- 172.21.15.173:0/516448401 >> v2:172.21.15.194:3300/0 conn(0x7f89c80d1270 0x7f89c80cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.766+0000 7f89d0600640 1 -- 172.21.15.173:0/516448401 >> 172.21.15.173:0/516448401 conn(0x7f89c80b33a0 msgr2=0x7f89c80b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:21.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.766+0000 7f89d0600640 1 -- 172.21.15.173:0/516448401 shutdown_connections 2024-04-25T09:12:21.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.766+0000 7f89d0600640 1 -- 172.21.15.173:0/516448401 wait complete. 2024-04-25T09:12:21.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89d0600640 1 Processor -- start 2024-04-25T09:12:21.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89d0600640 1 -- start start 2024-04-25T09:12:21.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89d0600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c8099b30 0x7f89c80b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:21.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89d0600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89c80cd7e0 0x7f89c815fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:21.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89d0600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c80d1270 0x7f89c815e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:21.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89d0600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c815deb0 con 0x7f89c80d1270 2024-04-25T09:12:21.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89d0600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c815dd30 con 0x7f89c8099b30 2024-04-25T09:12:21.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89d0600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c815e030 con 0x7f89c80cd7e0 2024-04-25T09:12:21.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89ce600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c80d1270 0x7f89c815e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:21.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89ce600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c80d1270 0x7f89c815e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54112/0 (socket says 172.21.15.173:54112) 2024-04-25T09:12:21.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89ce600640 1 -- 172.21.15.173:0/1935060564 learned_addr learned my addr 172.21.15.173:0/1935060564 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:21.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89cdc00640 1 --2- 172.21.15.173:0/1935060564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c8099b30 0x7f89c80b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:21.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89ce600640 1 -- 172.21.15.173:0/1935060564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89c80cd7e0 msgr2=0x7f89c815fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:21.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89cd200640 1 --2- 172.21.15.173:0/1935060564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89c80cd7e0 0x7f89c815fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:21.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89ce600640 1 --2- 172.21.15.173:0/1935060564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89c80cd7e0 0x7f89c815fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89ce600640 1 -- 172.21.15.173:0/1935060564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c8099b30 msgr2=0x7f89c80b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:21.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89ce600640 1 --2- 172.21.15.173:0/1935060564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c8099b30 0x7f89c80b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89ce600640 1 -- 172.21.15.173:0/1935060564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c815b1e0 con 0x7f89c80d1270 2024-04-25T09:12:21.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89cdc00640 1 --2- 172.21.15.173:0/1935060564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c8099b30 0x7f89c80b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:21.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89cd200640 1 --2- 172.21.15.173:0/1935060564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89c80cd7e0 0x7f89c815fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:21.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89ce600640 1 --2- 172.21.15.173:0/1935060564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c80d1270 0x7f89c815e390 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f89c00b0040 tx=0x7f89c0019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:21.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89c5600640 1 -- 172.21.15.173:0/1935060564 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c00b2050 con 0x7f89c80d1270 2024-04-25T09:12:21.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89c5600640 1 -- 172.21.15.173:0/1935060564 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c00be070 con 0x7f89c80d1270 2024-04-25T09:12:21.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89c5600640 1 -- 172.21.15.173:0/1935060564 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c00ad850 con 0x7f89c80d1270 2024-04-25T09:12:21.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.770+0000 7f89d0600640 1 -- 172.21.15.173:0/1935060564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c815b480 con 0x7f89c80d1270 2024-04-25T09:12:21.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.774+0000 7f89d0600640 1 -- 172.21.15.173:0/1935060564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c8155f60 con 0x7f89c80d1270 2024-04-25T09:12:21.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.774+0000 7f89d0600640 1 -- 172.21.15.173:0/1935060564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c8073a40 con 0x7f89c80d1270 2024-04-25T09:12:21.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.774+0000 7f89c5600640 1 -- 172.21.15.173:0/1935060564 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f89c00ad9f0 con 0x7f89c80d1270 2024-04-25T09:12:21.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.774+0000 7f89c5600640 1 --2- 172.21.15.173:0/1935060564 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f89a8066f60 0x7f89a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:21.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.774+0000 7f89c5600640 1 -- 172.21.15.173:0/1935060564 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f89c0120300 con 0x7f89c80d1270 2024-04-25T09:12:21.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.774+0000 7f89cdc00640 1 --2- 172.21.15.173:0/1935060564 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f89a8066f60 0x7f89a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:21.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.774+0000 7f89cdc00640 1 --2- 172.21.15.173:0/1935060564 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f89a8066f60 0x7f89a8069420 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f89bc005890 tx=0x7f89bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:21.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.778+0000 7f89c5600640 1 -- 172.21.15.173:0/1935060564 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f89c0016560 con 0x7f89c80d1270 2024-04-25T09:12:21.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.966+0000 7f89d0600640 1 -- 172.21.15.173:0/1935060564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89c80c84d0 con 0x7f89c80d1270 2024-04-25T09:12:21.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.970+0000 7f89c5600640 1 -- 172.21.15.173:0/1935060564 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f89c00f10e0 con 0x7f89c80d1270 2024-04-25T09:12:21.953 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:21.953 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1021410995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1021410995},{"type":"v1","addr":"172.21.15.194:6834","nonce":1021410995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2198134208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2198134208},{"type":"v1","addr":"172.21.15.194:6835","nonce":2198134208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8772,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/684989574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":684989574},{"type":"v1","addr":"172.21.15.173:6836","nonce":684989574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:26.148874+0000","modified":"2024-04-25T09:11:29.164422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8775":{"gid":8775,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/671971539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":671971539},{"type":"v1","addr":"172.21.15.173:6837","nonce":671971539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:12:21.953 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 81 2024-04-25T09:12:21.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.970+0000 7f89d0600640 1 -- 172.21.15.173:0/1935060564 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f89a8066f60 msgr2=0x7f89a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:21.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.970+0000 7f89d0600640 1 --2- 172.21.15.173:0/1935060564 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f89a8066f60 0x7f89a8069420 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f89bc005890 tx=0x7f89bc009040 comp rx=0 tx=0).stop 2024-04-25T09:12:21.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.970+0000 7f89d0600640 1 -- 172.21.15.173:0/1935060564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c80d1270 msgr2=0x7f89c815e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:21.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.970+0000 7f89d0600640 1 --2- 172.21.15.173:0/1935060564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c80d1270 0x7f89c815e390 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f89c00b0040 tx=0x7f89c0019710 comp rx=0 tx=0).stop 2024-04-25T09:12:21.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.970+0000 7f89d0600640 1 -- 172.21.15.173:0/1935060564 shutdown_connections 2024-04-25T09:12:21.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.970+0000 7f89d0600640 1 --2- 172.21.15.173:0/1935060564 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f89a8066f60 0x7f89a8069420 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.970+0000 7f89d0600640 1 --2- 172.21.15.173:0/1935060564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c80d1270 0x7f89c815e390 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.970+0000 7f89d0600640 1 --2- 172.21.15.173:0/1935060564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89c80cd7e0 0x7f89c815fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.970+0000 7f89d0600640 1 --2- 172.21.15.173:0/1935060564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89c8099b30 0x7f89c80b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:21.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.970+0000 7f89d0600640 1 -- 172.21.15.173:0/1935060564 >> 172.21.15.173:0/1935060564 conn(0x7f89c80b33a0 msgr2=0x7f89c806cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:21.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.970+0000 7f89d0600640 1 -- 172.21.15.173:0/1935060564 shutdown_connections 2024-04-25T09:12:21.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:21.970+0000 7f89d0600640 1 -- 172.21.15.173:0/1935060564 wait complete. 2024-04-25T09:12:21.974 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:22.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.126+0000 7f8212400640 1 Processor -- start 2024-04-25T09:12:22.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.126+0000 7f8212400640 1 -- start start 2024-04-25T09:12:22.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.126+0000 7f8212400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f820c06fba0 0x7f820c0b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.126+0000 7f8212400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f820c15ea80 0x7f820c15f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.126+0000 7f8212400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820c070230 con 0x7f820c06ac90 2024-04-25T09:12:22.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.126+0000 7f8212400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f820c070000 con 0x7f820c15ea80 2024-04-25T09:12:22.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.126+0000 7f8212400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f820c0b01a0 con 0x7f820c06fba0 2024-04-25T09:12:22.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.126+0000 7f820be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f820c15ea80 0x7f820c15f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.126+0000 7f820be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f820c15ea80 0x7f820c15f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54122/0 (socket says 172.21.15.173:54122) 2024-04-25T09:12:22.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.126+0000 7f820be00640 1 -- 172.21.15.173:0/595433715 learned_addr learned my addr 172.21.15.173:0/595433715 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:22.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.126+0000 7f820aa00640 1 --2- 172.21.15.173:0/595433715 >> v2:172.21.15.194:3300/0 conn(0x7f820c06fba0 0x7f820c0b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.126+0000 7f820be00640 1 -- 172.21.15.173:0/595433715 >> v2:172.21.15.194:3300/0 conn(0x7f820c06fba0 msgr2=0x7f820c0b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:22.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.126+0000 7f820be00640 1 --2- 172.21.15.173:0/595433715 >> v2:172.21.15.194:3300/0 conn(0x7f820c06fba0 0x7f820c0b3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.126+0000 7f820be00640 1 -- 172.21.15.173:0/595433715 >> v1:172.21.15.194:6789/0 conn(0x7f820c06ac90 legacy=0x7f820c06b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.126+0000 7f820be00640 1 -- 172.21.15.173:0/595433715 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c070510 con 0x7f820c15ea80 2024-04-25T09:12:22.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.130+0000 7f820be00640 1 --2- 172.21.15.173:0/595433715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f820c15ea80 0x7f820c15f230 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f820c0d1720 tx=0x7f820401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4364264aba8c7cc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:22.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.130+0000 7f820a000640 1 -- 172.21.15.173:0/595433715 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82040a56c0 con 0x7f820c15ea80 2024-04-25T09:12:22.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.130+0000 7f820a000640 1 -- 172.21.15.173:0/595433715 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82040a5860 con 0x7f820c15ea80 2024-04-25T09:12:22.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.130+0000 7f820a000640 1 -- 172.21.15.173:0/595433715 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82040a5c30 con 0x7f820c15ea80 2024-04-25T09:12:22.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.130+0000 7f8212400640 1 -- 172.21.15.173:0/595433715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f820c15ea80 msgr2=0x7f820c15f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.130+0000 7f8212400640 1 --2- 172.21.15.173:0/595433715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f820c15ea80 0x7f820c15f230 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f820c0d1720 tx=0x7f820401c9f0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.130+0000 7f8212400640 1 -- 172.21.15.173:0/595433715 shutdown_connections 2024-04-25T09:12:22.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.130+0000 7f8212400640 1 --2- 172.21.15.173:0/595433715 >> v2:172.21.15.194:3300/0 conn(0x7f820c06fba0 0x7f820c0b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.130+0000 7f8212400640 1 --2- 172.21.15.173:0/595433715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f820c15ea80 0x7f820c15f230 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.130+0000 7f8212400640 1 -- 172.21.15.173:0/595433715 >> 172.21.15.173:0/595433715 conn(0x7f820c0b23f0 msgr2=0x7f820c0b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:22.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.130+0000 7f8212400640 1 -- 172.21.15.173:0/595433715 shutdown_connections 2024-04-25T09:12:22.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.130+0000 7f8212400640 1 -- 172.21.15.173:0/595433715 wait complete. 2024-04-25T09:12:22.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f8212400640 1 Processor -- start 2024-04-25T09:12:22.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f8212400640 1 -- start start 2024-04-25T09:12:22.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f8212400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f820c06ac90 0x7f820c152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f8212400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f820c06fba0 0x7f820c15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f8212400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f820c15ea80 0x7f820c15d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f8212400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c16a830 con 0x7f820c06fba0 2024-04-25T09:12:22.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f8212400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c16a6b0 con 0x7f820c15ea80 2024-04-25T09:12:22.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f8212400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c16a9b0 con 0x7f820c06ac90 2024-04-25T09:12:22.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f820aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f820c06fba0 0x7f820c15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f820aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f820c06fba0 0x7f820c15ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54136/0 (socket says 172.21.15.173:54136) 2024-04-25T09:12:22.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f820aa00640 1 -- 172.21.15.173:0/3295804699 learned_addr learned my addr 172.21.15.173:0/3295804699 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:22.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f820b400640 1 --2- 172.21.15.173:0/3295804699 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f820c06ac90 0x7f820c152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f820be00640 1 --2- 172.21.15.173:0/3295804699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f820c15ea80 0x7f820c15d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f820aa00640 1 -- 172.21.15.173:0/3295804699 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f820c06ac90 msgr2=0x7f820c152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f820aa00640 1 --2- 172.21.15.173:0/3295804699 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f820c06ac90 0x7f820c152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f820aa00640 1 -- 172.21.15.173:0/3295804699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f820c15ea80 msgr2=0x7f820c15d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f820aa00640 1 --2- 172.21.15.173:0/3295804699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f820c15ea80 0x7f820c15d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f820aa00640 1 -- 172.21.15.173:0/3295804699 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c159d00 con 0x7f820c06fba0 2024-04-25T09:12:22.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f820aa00640 1 --2- 172.21.15.173:0/3295804699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f820c06fba0 0x7f820c15ce10 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f81f400e960 tx=0x7f81f400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:22.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f8203400640 1 -- 172.21.15.173:0/3295804699 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4017070 con 0x7f820c06fba0 2024-04-25T09:12:22.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f8203400640 1 -- 172.21.15.173:0/3295804699 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f400ca00 con 0x7f820c06fba0 2024-04-25T09:12:22.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f8212400640 1 -- 172.21.15.173:0/3295804699 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820c159fe0 con 0x7f820c06fba0 2024-04-25T09:12:22.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f8203400640 1 -- 172.21.15.173:0/3295804699 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f400cdb0 con 0x7f820c06fba0 2024-04-25T09:12:22.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f8212400640 1 -- 172.21.15.173:0/3295804699 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820c15b470 con 0x7f820c06fba0 2024-04-25T09:12:22.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.134+0000 7f8212400640 1 -- 172.21.15.173:0/3295804699 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820c073a40 con 0x7f820c06fba0 2024-04-25T09:12:22.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.138+0000 7f8203400640 1 -- 172.21.15.173:0/3295804699 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f81f401a070 con 0x7f820c06fba0 2024-04-25T09:12:22.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.138+0000 7f8203400640 1 --2- 172.21.15.173:0/3295804699 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f81e8066f60 0x7f81e8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.138+0000 7f8203400640 1 -- 172.21.15.173:0/3295804699 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f81f4085540 con 0x7f820c06fba0 2024-04-25T09:12:22.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.138+0000 7f820b400640 1 --2- 172.21.15.173:0/3295804699 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f81e8066f60 0x7f81e8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.138+0000 7f820b400640 1 --2- 172.21.15.173:0/3295804699 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f81e8066f60 0x7f81e8069420 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f820c072de0 tx=0x7f81fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:22.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.142+0000 7f8203400640 1 -- 172.21.15.173:0/3295804699 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f81f4055d60 con 0x7f820c06fba0 2024-04-25T09:12:22.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.326+0000 7f8212400640 1 -- 172.21.15.173:0/3295804699 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f820c0732d0 con 0x7f820c06fba0 2024-04-25T09:12:22.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.326+0000 7f8203400640 1 -- 172.21.15.173:0/3295804699 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f81f4059e00 con 0x7f820c06fba0 2024-04-25T09:12:22.313 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:22.313 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1021410995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1021410995},{"type":"v1","addr":"172.21.15.194:6834","nonce":1021410995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2198134208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2198134208},{"type":"v1","addr":"172.21.15.194:6835","nonce":2198134208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8772,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/684989574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":684989574},{"type":"v1","addr":"172.21.15.173:6836","nonce":684989574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:26.148874+0000","modified":"2024-04-25T09:11:29.164422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8775},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8775":{"gid":8775,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/671971539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":671971539},{"type":"v1","addr":"172.21.15.173:6837","nonce":671971539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:12:22.313 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 81 2024-04-25T09:12:22.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.330+0000 7f8212400640 1 -- 172.21.15.173:0/3295804699 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f81e8066f60 msgr2=0x7f81e8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.330+0000 7f8212400640 1 --2- 172.21.15.173:0/3295804699 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f81e8066f60 0x7f81e8069420 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f820c072de0 tx=0x7f81fc009040 comp rx=0 tx=0).stop 2024-04-25T09:12:22.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.330+0000 7f8212400640 1 -- 172.21.15.173:0/3295804699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f820c06fba0 msgr2=0x7f820c15ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.330+0000 7f8212400640 1 --2- 172.21.15.173:0/3295804699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f820c06fba0 0x7f820c15ce10 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f81f400e960 tx=0x7f81f400ee20 comp rx=0 tx=0).stop 2024-04-25T09:12:22.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.330+0000 7f8212400640 1 -- 172.21.15.173:0/3295804699 shutdown_connections 2024-04-25T09:12:22.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.330+0000 7f8212400640 1 --2- 172.21.15.173:0/3295804699 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f81e8066f60 0x7f81e8069420 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.330+0000 7f8212400640 1 --2- 172.21.15.173:0/3295804699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f820c15ea80 0x7f820c15d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.330+0000 7f8212400640 1 --2- 172.21.15.173:0/3295804699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f820c06fba0 0x7f820c15ce10 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.330+0000 7f8212400640 1 --2- 172.21.15.173:0/3295804699 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f820c06ac90 0x7f820c152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.330+0000 7f8212400640 1 -- 172.21.15.173:0/3295804699 >> 172.21.15.173:0/3295804699 conn(0x7f820c0b23f0 msgr2=0x7f820c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:22.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.330+0000 7f8212400640 1 -- 172.21.15.173:0/3295804699 shutdown_connections 2024-04-25T09:12:22.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.330+0000 7f8212400640 1 -- 172.21.15.173:0/3295804699 wait complete. 2024-04-25T09:12:22.334 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:22.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.486+0000 7fc931000640 1 Processor -- start 2024-04-25T09:12:22.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.486+0000 7fc931000640 1 -- start start 2024-04-25T09:12:22.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.486+0000 7fc931000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc92c15df90 0x7fc92c0d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.486+0000 7fc931000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc92c06f830 0x7fc92c06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.486+0000 7fc931000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92c06d870 con 0x7fc92c15dbb0 2024-04-25T09:12:22.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.486+0000 7fc931000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92c15e5c0 con 0x7fc92c15df90 2024-04-25T09:12:22.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.486+0000 7fc931000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c15e8a0 con 0x7fc92c06f830 2024-04-25T09:12:22.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.486+0000 7fc929e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc92c15dbb0 0x7fc92c06c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49282/0 (socket says 172.21.15.173:49282) 2024-04-25T09:12:22.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.486+0000 7fc929e00640 1 -- 172.21.15.173:0/3028621607 learned_addr learned my addr 172.21.15.173:0/3028621607 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:22.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.486+0000 7fc929400640 1 --2- 172.21.15.173:0/3028621607 >> v2:172.21.15.194:3300/0 conn(0x7fc92c15df90 0x7fc92c0d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.486+0000 7fc92a800640 1 --2- 172.21.15.173:0/3028621607 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc92c06f830 0x7fc92c06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.486+0000 7fc928a00640 1 -- 172.21.15.173:0/3028621607 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292744386 0 0) 0x7fc92c06d870 con 0x7fc92c15dbb0 2024-04-25T09:12:22.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.486+0000 7fc928a00640 1 -- 172.21.15.173:0/3028621607 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc910003530 con 0x7fc92c15dbb0 2024-04-25T09:12:22.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.486+0000 7fc92a800640 1 -- 172.21.15.173:0/3028621607 >> v2:172.21.15.194:3300/0 conn(0x7fc92c15df90 msgr2=0x7fc92c0d2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:22.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.486+0000 7fc92a800640 1 --2- 172.21.15.173:0/3028621607 >> v2:172.21.15.194:3300/0 conn(0x7fc92c15df90 0x7fc92c0d2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.486+0000 7fc92a800640 1 -- 172.21.15.173:0/3028621607 >> v1:172.21.15.173:6789/0 conn(0x7fc92c15dbb0 legacy=0x7fc92c06c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.486+0000 7fc92a800640 1 -- 172.21.15.173:0/3028621607 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c161690 con 0x7fc92c06f830 2024-04-25T09:12:22.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.490+0000 7fc92a800640 1 --2- 172.21.15.173:0/3028621607 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc92c06f830 0x7fc92c06fcc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc924009d90 tx=0x7fc92401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b41825166a1cadb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:22.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.490+0000 7fc928a00640 1 -- 172.21.15.173:0/3028621607 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9240b2070 con 0x7fc92c06f830 2024-04-25T09:12:22.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.490+0000 7fc928a00640 1 -- 172.21.15.173:0/3028621607 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9240a5830 con 0x7fc92c06f830 2024-04-25T09:12:22.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.490+0000 7fc928a00640 1 -- 172.21.15.173:0/3028621607 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9240a5be0 con 0x7fc92c06f830 2024-04-25T09:12:22.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.490+0000 7fc931000640 1 -- 172.21.15.173:0/3028621607 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc92c06f830 msgr2=0x7fc92c06fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.490+0000 7fc931000640 1 --2- 172.21.15.173:0/3028621607 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc92c06f830 0x7fc92c06fcc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc924009d90 tx=0x7fc92401c970 comp rx=0 tx=0).stop 2024-04-25T09:12:22.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.490+0000 7fc931000640 1 -- 172.21.15.173:0/3028621607 shutdown_connections 2024-04-25T09:12:22.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.490+0000 7fc931000640 1 --2- 172.21.15.173:0/3028621607 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc92c06f830 0x7fc92c06fcc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.490+0000 7fc931000640 1 --2- 172.21.15.173:0/3028621607 >> v2:172.21.15.194:3300/0 conn(0x7fc92c15df90 0x7fc92c0d2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.490+0000 7fc931000640 1 -- 172.21.15.173:0/3028621607 >> 172.21.15.173:0/3028621607 conn(0x7fc92c061880 msgr2=0x7fc92c061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:22.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.490+0000 7fc931000640 1 -- 172.21.15.173:0/3028621607 shutdown_connections 2024-04-25T09:12:22.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.490+0000 7fc931000640 1 -- 172.21.15.173:0/3028621607 wait complete. 2024-04-25T09:12:22.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc931000640 1 Processor -- start 2024-04-25T09:12:22.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc931000640 1 -- start start 2024-04-25T09:12:22.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc931000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc92c06f830 0x7fc92c0c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc931000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc92c15dbb0 0x7fc92c154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc931000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc92c15df90 0x7fc92c15c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc931000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c16ab10 con 0x7fc92c15df90 2024-04-25T09:12:22.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc931000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c16a990 con 0x7fc92c06f830 2024-04-25T09:12:22.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc931000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c16ac90 con 0x7fc92c15dbb0 2024-04-25T09:12:22.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc92a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc92c15df90 0x7fc92c15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc92a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc92c15df90 0x7fc92c15c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54142/0 (socket says 172.21.15.173:54142) 2024-04-25T09:12:22.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc92a800640 1 -- 172.21.15.173:0/207898824 learned_addr learned my addr 172.21.15.173:0/207898824 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:22.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc929e00640 1 --2- 172.21.15.173:0/207898824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc92c06f830 0x7fc92c0c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc929400640 1 --2- 172.21.15.173:0/207898824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc92c15dbb0 0x7fc92c154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc92a800640 1 -- 172.21.15.173:0/207898824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc92c15dbb0 msgr2=0x7fc92c154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc92a800640 1 --2- 172.21.15.173:0/207898824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc92c15dbb0 0x7fc92c154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc92a800640 1 -- 172.21.15.173:0/207898824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc92c06f830 msgr2=0x7fc92c0c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc92a800640 1 --2- 172.21.15.173:0/207898824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc92c06f830 0x7fc92c0c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc92a800640 1 -- 172.21.15.173:0/207898824 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c155990 con 0x7fc92c15df90 2024-04-25T09:12:22.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc929400640 1 --2- 172.21.15.173:0/207898824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc92c15dbb0 0x7fc92c154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:22.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc929e00640 1 --2- 172.21.15.173:0/207898824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc92c06f830 0x7fc92c0c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:22.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc92a800640 1 --2- 172.21.15.173:0/207898824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc92c15df90 0x7fc92c15c010 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fc924009d90 tx=0x7fc924019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:22.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc922000640 1 -- 172.21.15.173:0/207898824 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9240b2050 con 0x7fc92c15df90 2024-04-25T09:12:22.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc922000640 1 -- 172.21.15.173:0/207898824 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9240be070 con 0x7fc92c15df90 2024-04-25T09:12:22.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc931000640 1 -- 172.21.15.173:0/207898824 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92c0c7a50 con 0x7fc92c15df90 2024-04-25T09:12:22.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc922000640 1 -- 172.21.15.173:0/207898824 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9240ad890 con 0x7fc92c15df90 2024-04-25T09:12:22.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.494+0000 7fc931000640 1 -- 172.21.15.173:0/207898824 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92c155290 con 0x7fc92c15df90 2024-04-25T09:12:22.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.498+0000 7fc931000640 1 -- 172.21.15.173:0/207898824 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92c073a40 con 0x7fc92c15df90 2024-04-25T09:12:22.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.498+0000 7fc922000640 1 -- 172.21.15.173:0/207898824 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc9240ada30 con 0x7fc92c15df90 2024-04-25T09:12:22.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.498+0000 7fc922000640 1 --2- 172.21.15.173:0/207898824 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc908066f90 0x7fc908069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.498+0000 7fc922000640 1 -- 172.21.15.173:0/207898824 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc9241200f0 con 0x7fc92c15df90 2024-04-25T09:12:22.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.498+0000 7fc929e00640 1 --2- 172.21.15.173:0/207898824 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc908066f90 0x7fc908069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.498+0000 7fc929e00640 1 --2- 172.21.15.173:0/207898824 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc908066f90 0x7fc908069450 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc914005890 tx=0x7fc914009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:22.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.502+0000 7fc922000640 1 -- 172.21.15.173:0/207898824 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc924016560 con 0x7fc92c15df90 2024-04-25T09:12:22.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.658+0000 7fc931000640 1 -- 172.21.15.173:0/207898824 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc92c0cf020 con 0x7fc92c15df90 2024-04-25T09:12:22.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.658+0000 7fc922000640 1 -- 172.21.15.173:0/207898824 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+17012 (secure 0 0 0) 0x7fc9240f1090 con 0x7fc92c15df90 2024-04-25T09:12:22.644 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:22.644 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":122,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:11:27.763236+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:11:24.499900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T09:11:25.140140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:22.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.662+0000 7fc931000640 1 -- 172.21.15.173:0/207898824 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc908066f90 msgr2=0x7fc908069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.662+0000 7fc931000640 1 --2- 172.21.15.173:0/207898824 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc908066f90 0x7fc908069450 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc914005890 tx=0x7fc914009040 comp rx=0 tx=0).stop 2024-04-25T09:12:22.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.662+0000 7fc931000640 1 -- 172.21.15.173:0/207898824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc92c15df90 msgr2=0x7fc92c15c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.662+0000 7fc931000640 1 --2- 172.21.15.173:0/207898824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc92c15df90 0x7fc92c15c010 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fc924009d90 tx=0x7fc924019710 comp rx=0 tx=0).stop 2024-04-25T09:12:22.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.662+0000 7fc931000640 1 -- 172.21.15.173:0/207898824 shutdown_connections 2024-04-25T09:12:22.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.662+0000 7fc931000640 1 --2- 172.21.15.173:0/207898824 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc908066f90 0x7fc908069450 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.662+0000 7fc931000640 1 --2- 172.21.15.173:0/207898824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc92c15df90 0x7fc92c15c010 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.662+0000 7fc931000640 1 --2- 172.21.15.173:0/207898824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc92c15dbb0 0x7fc92c154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.662+0000 7fc931000640 1 --2- 172.21.15.173:0/207898824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc92c06f830 0x7fc92c0c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.662+0000 7fc931000640 1 -- 172.21.15.173:0/207898824 >> 172.21.15.173:0/207898824 conn(0x7fc92c061880 msgr2=0x7fc92c0cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:22.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.662+0000 7fc931000640 1 -- 172.21.15.173:0/207898824 shutdown_connections 2024-04-25T09:12:22.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.662+0000 7fc931000640 1 -- 172.21.15.173:0/207898824 wait complete. 2024-04-25T09:12:22.667 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:12:22.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.822+0000 7fe0c5000640 1 Processor -- start 2024-04-25T09:12:22.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.822+0000 7fe0c5000640 1 -- start start 2024-04-25T09:12:22.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.822+0000 7fe0c5000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe0c00aef70 0x7fe0c006d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.822+0000 7fe0c5000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c0071570 con 0x7fe0c00aeb90 2024-04-25T09:12:22.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.822+0000 7fe0c5000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c0071850 con 0x7fe0c00cc7e0 2024-04-25T09:12:22.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.822+0000 7fe0c5000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c0071320 con 0x7fe0c00aef70 2024-04-25T09:12:22.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.822+0000 7fe0bde00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe0c00aeb90 0x7fe0c00cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49296/0 (socket says 172.21.15.173:49296) 2024-04-25T09:12:22.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.822+0000 7fe0bde00640 1 -- 172.21.15.173:0/455349303 learned_addr learned my addr 172.21.15.173:0/455349303 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:22.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.822+0000 7fe0be800640 1 --2- 172.21.15.173:0/455349303 >> v2:172.21.15.194:3300/0 conn(0x7fe0c00aef70 0x7fe0c006d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.822+0000 7fe0bca00640 1 -- 172.21.15.173:0/455349303 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550639755 0 0) 0x7fe0c0071570 con 0x7fe0c00aeb90 2024-04-25T09:12:22.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.826+0000 7fe0bca00640 1 -- 172.21.15.173:0/455349303 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0a4003530 con 0x7fe0c00aeb90 2024-04-25T09:12:22.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.826+0000 7fe0bca00640 1 -- 172.21.15.173:0/455349303 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279656319 0 0) 0x7fe0c0071850 con 0x7fe0c00cc7e0 2024-04-25T09:12:22.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.826+0000 7fe0bca00640 1 -- 172.21.15.173:0/455349303 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0c0071570 con 0x7fe0c00cc7e0 2024-04-25T09:12:22.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.826+0000 7fe0be800640 1 -- 172.21.15.173:0/455349303 >> v1:172.21.15.194:6789/0 conn(0x7fe0c00cc7e0 legacy=0x7fe0c00cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.826+0000 7fe0be800640 1 -- 172.21.15.173:0/455349303 >> v1:172.21.15.173:6789/0 conn(0x7fe0c00aeb90 legacy=0x7fe0c00cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.826+0000 7fe0bca00640 1 -- 172.21.15.173:0/455349303 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1542560117 0 0) 0x7fe0a4003530 con 0x7fe0c00aeb90 2024-04-25T09:12:22.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.826+0000 7fe0be800640 1 -- 172.21.15.173:0/455349303 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c0071b30 con 0x7fe0c00aef70 2024-04-25T09:12:22.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.826+0000 7fe0be800640 1 --2- 172.21.15.173:0/455349303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c00aef70 0x7fe0c006d940 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe0b80097c0 tx=0x7fe0b801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8834ddce6d05985 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:22.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.826+0000 7fe0bca00640 1 -- 172.21.15.173:0/455349303 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b80b0070 con 0x7fe0c00aef70 2024-04-25T09:12:22.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.826+0000 7fe0bca00640 1 -- 172.21.15.173:0/455349303 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b80a4e50 con 0x7fe0c00aef70 2024-04-25T09:12:22.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.826+0000 7fe0bca00640 1 -- 172.21.15.173:0/455349303 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0001a20 con 0x7fe0c00aef70 2024-04-25T09:12:22.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.826+0000 7fe0c5000640 1 -- 172.21.15.173:0/455349303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c00aef70 msgr2=0x7fe0c006d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.826+0000 7fe0c5000640 1 --2- 172.21.15.173:0/455349303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c00aef70 0x7fe0c006d940 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe0b80097c0 tx=0x7fe0b801c330 comp rx=0 tx=0).stop 2024-04-25T09:12:22.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0c5000640 1 -- 172.21.15.173:0/455349303 shutdown_connections 2024-04-25T09:12:22.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0c5000640 1 --2- 172.21.15.173:0/455349303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c00aef70 0x7fe0c006d940 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0c5000640 1 -- 172.21.15.173:0/455349303 >> 172.21.15.173:0/455349303 conn(0x7fe0c006ac90 msgr2=0x7fe0c006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:22.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0c5000640 1 -- 172.21.15.173:0/455349303 shutdown_connections 2024-04-25T09:12:22.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0c5000640 1 -- 172.21.15.173:0/455349303 wait complete. 2024-04-25T09:12:22.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0c5000640 1 Processor -- start 2024-04-25T09:12:22.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0c5000640 1 -- start start 2024-04-25T09:12:22.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0c5000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c00aeb90 0x7fe0c01f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0c5000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c00aef70 0x7fe0c0148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0c5000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0c00cc7e0 0x7fe0c01436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0c5000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c006ea20 con 0x7fe0c00cc7e0 2024-04-25T09:12:22.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0c5000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c006e8a0 con 0x7fe0c00aef70 2024-04-25T09:12:22.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0c5000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00cf720 con 0x7fe0c00aeb90 2024-04-25T09:12:22.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0be800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0c00cc7e0 0x7fe0c01436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0be800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0c00cc7e0 0x7fe0c01436f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54156/0 (socket says 172.21.15.173:54156) 2024-04-25T09:12:22.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0be800640 1 -- 172.21.15.173:0/2204547020 learned_addr learned my addr 172.21.15.173:0/2204547020 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:22.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0bde00640 1 --2- 172.21.15.173:0/2204547020 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c00aeb90 0x7fe0c01f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0bd400640 1 --2- 172.21.15.173:0/2204547020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c00aef70 0x7fe0c0148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0be800640 1 -- 172.21.15.173:0/2204547020 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c00aeb90 msgr2=0x7fe0c01f2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0be800640 1 --2- 172.21.15.173:0/2204547020 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c00aeb90 0x7fe0c01f2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0be800640 1 -- 172.21.15.173:0/2204547020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c00aef70 msgr2=0x7fe0c0148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0be800640 1 --2- 172.21.15.173:0/2204547020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c00aef70 0x7fe0c0148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0be800640 1 -- 172.21.15.173:0/2204547020 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00b0640 con 0x7fe0c00cc7e0 2024-04-25T09:12:22.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0be800640 1 --2- 172.21.15.173:0/2204547020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0c00cc7e0 0x7fe0c01436f0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fe0b80ae040 tx=0x7fe0b801ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:22.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.830+0000 7fe0b6000640 1 -- 172.21.15.173:0/2204547020 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b80b0050 con 0x7fe0c00cc7e0 2024-04-25T09:12:22.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.834+0000 7fe0b6000640 1 -- 172.21.15.173:0/2204547020 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b80b1040 con 0x7fe0c00cc7e0 2024-04-25T09:12:22.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.834+0000 7fe0b6000640 1 -- 172.21.15.173:0/2204547020 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8004220 con 0x7fe0c00cc7e0 2024-04-25T09:12:22.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.834+0000 7fe0c5000640 1 -- 172.21.15.173:0/2204547020 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c00b0920 con 0x7fe0c00cc7e0 2024-04-25T09:12:22.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.834+0000 7fe0c5000640 1 -- 172.21.15.173:0/2204547020 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c00b0ee0 con 0x7fe0c00cc7e0 2024-04-25T09:12:22.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.834+0000 7fe0c5000640 1 -- 172.21.15.173:0/2204547020 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c0073ab0 con 0x7fe0c00cc7e0 2024-04-25T09:12:22.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.834+0000 7fe0b6000640 1 -- 172.21.15.173:0/2204547020 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe0b80be020 con 0x7fe0c00cc7e0 2024-04-25T09:12:22.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.834+0000 7fe0b6000640 1 --2- 172.21.15.173:0/2204547020 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0a0066f60 0x7fe0a0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.834+0000 7fe0b6000640 1 -- 172.21.15.173:0/2204547020 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe0b811ef70 con 0x7fe0c00cc7e0 2024-04-25T09:12:22.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.834+0000 7fe0bde00640 1 --2- 172.21.15.173:0/2204547020 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0a0066f60 0x7fe0a0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.834+0000 7fe0bde00640 1 --2- 172.21.15.173:0/2204547020 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0a0066f60 0x7fe0a0069420 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0001730 tx=0x7fe0b0004b90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:22.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:22.838+0000 7fe0b6000640 1 -- 172.21.15.173:0/2204547020 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe0b8015fb0 con 0x7fe0c00cc7e0 2024-04-25T09:12:23.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.030+0000 7fe0c5000640 1 -- 172.21.15.173:0/2204547020 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe0c00b10b0 con 0x7fe0c00cc7e0 2024-04-25T09:12:23.014 INFO:tasks.ceph.mon.a.smithi173.stderr:2024-04-25T09:12:23.030+0000 7f537be00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:12:23.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.030+0000 7fe0b6000640 1 -- 172.21.15.173:0/2204547020 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v82) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe0b80ef830 con 0x7fe0c00cc7e0 2024-04-25T09:12:23.016 INFO:teuthology.orchestra.run.smithi173.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:12:23.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.034+0000 7fe0c5000640 1 -- 172.21.15.173:0/2204547020 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0a0066f60 msgr2=0x7fe0a0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:23.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.034+0000 7fe0c5000640 1 --2- 172.21.15.173:0/2204547020 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0a0066f60 0x7fe0a0069420 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0001730 tx=0x7fe0b0004b90 comp rx=0 tx=0).stop 2024-04-25T09:12:23.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.034+0000 7fe0c5000640 1 -- 172.21.15.173:0/2204547020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0c00cc7e0 msgr2=0x7fe0c01436f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:23.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.034+0000 7fe0c5000640 1 --2- 172.21.15.173:0/2204547020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0c00cc7e0 0x7fe0c01436f0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fe0b80ae040 tx=0x7fe0b801ab70 comp rx=0 tx=0).stop 2024-04-25T09:12:23.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.034+0000 7fe0c5000640 1 -- 172.21.15.173:0/2204547020 shutdown_connections 2024-04-25T09:12:23.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.034+0000 7fe0c5000640 1 --2- 172.21.15.173:0/2204547020 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0a0066f60 0x7fe0a0069420 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:23.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.034+0000 7fe0c5000640 1 --2- 172.21.15.173:0/2204547020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0c00cc7e0 0x7fe0c01436f0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:23.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.034+0000 7fe0c5000640 1 --2- 172.21.15.173:0/2204547020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c00aef70 0x7fe0c0148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:23.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.034+0000 7fe0c5000640 1 --2- 172.21.15.173:0/2204547020 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c00aeb90 0x7fe0c01f2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:23.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.034+0000 7fe0c5000640 1 -- 172.21.15.173:0/2204547020 >> 172.21.15.173:0/2204547020 conn(0x7fe0c006ac90 msgr2=0x7fe0c015a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:23.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.034+0000 7fe0c5000640 1 -- 172.21.15.173:0/2204547020 shutdown_connections 2024-04-25T09:12:23.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.034+0000 7fe0c5000640 1 -- 172.21.15.173:0/2204547020 wait complete. 2024-04-25T09:12:23.041 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:12:23.086 INFO:tasks.ceph.mds.c.smithi173.stdout:starting mds.c at 2024-04-25T09:12:23.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.198+0000 7f3b7b600640 1 Processor -- start 2024-04-25T09:12:23.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.198+0000 7f3b7b600640 1 -- start start 2024-04-25T09:12:23.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.198+0000 7f3b7b600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3b740aeb90 0x7f3b740cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:23.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.198+0000 7f3b7b600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b74071570 con 0x7f3b740ce2b0 2024-04-25T09:12:23.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.198+0000 7f3b7b600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b74071850 con 0x7f3b740aef70 2024-04-25T09:12:23.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.198+0000 7f3b7b600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b74071320 con 0x7f3b740aeb90 2024-04-25T09:12:23.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.198+0000 7f3b79600640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f3b740ce2b0 0x7f3b7415af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:49310/0 (socket says 172.21.15.173:49310) 2024-04-25T09:12:23.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.198+0000 7f3b79600640 1 -- 172.21.15.173:0/3944149664 learned_addr learned my addr 172.21.15.173:0/3944149664 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:23.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.198+0000 7f3b78c00640 1 --2- 172.21.15.173:0/3944149664 >> v2:172.21.15.194:3300/0 conn(0x7f3b740aeb90 0x7f3b740cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:23.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.198+0000 7f3b73400640 1 -- 172.21.15.173:0/3944149664 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964276702 0 0) 0x7f3b74071570 con 0x7f3b740ce2b0 2024-04-25T09:12:23.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.202+0000 7f3b73400640 1 -- 172.21.15.173:0/3944149664 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b58003530 con 0x7f3b740ce2b0 2024-04-25T09:12:23.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.202+0000 7f3b73400640 1 -- 172.21.15.173:0/3944149664 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598564702 0 0) 0x7f3b74071850 con 0x7f3b740aef70 2024-04-25T09:12:23.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.202+0000 7f3b73400640 1 -- 172.21.15.173:0/3944149664 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b74071570 con 0x7f3b740aef70 2024-04-25T09:12:23.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.202+0000 7f3b78c00640 1 -- 172.21.15.173:0/3944149664 >> v1:172.21.15.194:6789/0 conn(0x7f3b740aef70 legacy=0x7f3b740cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:23.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.202+0000 7f3b73400640 1 -- 172.21.15.173:0/3944149664 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 261882729 0 0) 0x7f3b58003530 con 0x7f3b740ce2b0 2024-04-25T09:12:23.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.202+0000 7f3b78c00640 1 -- 172.21.15.173:0/3944149664 >> v1:172.21.15.173:6789/0 conn(0x7f3b740ce2b0 legacy=0x7f3b7415af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:23.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.202+0000 7f3b78c00640 1 -- 172.21.15.173:0/3944149664 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b74071b30 con 0x7f3b740aeb90 2024-04-25T09:12:23.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.202+0000 7f3b78c00640 1 --2- 172.21.15.173:0/3944149664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b740aeb90 0x7f3b740cc0d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3b640097c0 tx=0x7f3b6401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83b3f70fa974ab9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:23.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.202+0000 7f3b73400640 1 -- 172.21.15.173:0/3944149664 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b640b0070 con 0x7f3b740aeb90 2024-04-25T09:12:23.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.202+0000 7f3b73400640 1 -- 172.21.15.173:0/3944149664 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b640ab400 con 0x7f3b740aeb90 2024-04-25T09:12:23.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.202+0000 7f3b73400640 1 -- 172.21.15.173:0/3944149664 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c001a00 con 0x7f3b740aeb90 2024-04-25T09:12:23.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b7b600640 1 -- 172.21.15.173:0/3944149664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b740aeb90 msgr2=0x7f3b740cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:23.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b7b600640 1 --2- 172.21.15.173:0/3944149664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b740aeb90 0x7f3b740cc0d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3b640097c0 tx=0x7f3b6401c330 comp rx=0 tx=0).stop 2024-04-25T09:12:23.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b7b600640 1 -- 172.21.15.173:0/3944149664 shutdown_connections 2024-04-25T09:12:23.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b7b600640 1 --2- 172.21.15.173:0/3944149664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b740aeb90 0x7f3b740cc0d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:23.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b7b600640 1 -- 172.21.15.173:0/3944149664 >> 172.21.15.173:0/3944149664 conn(0x7f3b7406ac90 msgr2=0x7f3b7406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:23.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b7b600640 1 -- 172.21.15.173:0/3944149664 shutdown_connections 2024-04-25T09:12:23.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b7b600640 1 -- 172.21.15.173:0/3944149664 wait complete. 2024-04-25T09:12:23.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b7b600640 1 Processor -- start 2024-04-25T09:12:23.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b7b600640 1 -- start start 2024-04-25T09:12:23.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b7b600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b740aeb90 0x7f3b74142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:23.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b7b600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b740aef70 0x7f3b74156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:23.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b7b600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b740ce2b0 0x7f3b7406d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:23.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b7b600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b740cfab0 con 0x7f3b740aeb90 2024-04-25T09:12:23.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b7b600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b740cf930 con 0x7f3b740ce2b0 2024-04-25T09:12:23.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b7b600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b740cfc30 con 0x7f3b740aef70 2024-04-25T09:12:23.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b78c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b740aeb90 0x7f3b74142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:23.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b78c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b740aeb90 0x7f3b74142f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:54182/0 (socket says 172.21.15.173:54182) 2024-04-25T09:12:23.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b78c00640 1 -- 172.21.15.173:0/77757411 learned_addr learned my addr 172.21.15.173:0/77757411 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:23.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b73e00640 1 --2- 172.21.15.173:0/77757411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b740aef70 0x7f3b74156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:23.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b78c00640 1 -- 172.21.15.173:0/77757411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b740aef70 msgr2=0x7f3b74156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:23.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b79600640 1 --2- 172.21.15.173:0/77757411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b740ce2b0 0x7f3b7406d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:23.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b78c00640 1 --2- 172.21.15.173:0/77757411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b740aef70 0x7f3b74156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:23.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b78c00640 1 -- 172.21.15.173:0/77757411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b740ce2b0 msgr2=0x7f3b7406d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:23.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b78c00640 1 --2- 172.21.15.173:0/77757411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b740ce2b0 0x7f3b7406d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:23.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b78c00640 1 -- 172.21.15.173:0/77757411 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b741586a0 con 0x7f3b740aeb90 2024-04-25T09:12:23.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b73e00640 1 --2- 172.21.15.173:0/77757411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b740aef70 0x7f3b74156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:23.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b79600640 1 --2- 172.21.15.173:0/77757411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b740ce2b0 0x7f3b7406d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:23.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.206+0000 7f3b78c00640 1 --2- 172.21.15.173:0/77757411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b740aeb90 0x7f3b74142f40 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f3b64018f40 tx=0x7f3b6401ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:23.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.210+0000 7f3b70c00640 1 -- 172.21.15.173:0/77757411 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b640b0050 con 0x7f3b740aeb90 2024-04-25T09:12:23.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.210+0000 7f3b70c00640 1 -- 172.21.15.173:0/77757411 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b640bc070 con 0x7f3b740aeb90 2024-04-25T09:12:23.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.210+0000 7f3b70c00640 1 -- 172.21.15.173:0/77757411 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64006e20 con 0x7f3b740aeb90 2024-04-25T09:12:23.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.210+0000 7f3b7b600640 1 -- 172.21.15.173:0/77757411 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b74157600 con 0x7f3b740aeb90 2024-04-25T09:12:23.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.210+0000 7f3b7b600640 1 -- 172.21.15.173:0/77757411 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b74157bc0 con 0x7f3b740aeb90 2024-04-25T09:12:23.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.210+0000 7f3b7b600640 1 -- 172.21.15.173:0/77757411 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b74073ab0 con 0x7f3b740aeb90 2024-04-25T09:12:23.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.210+0000 7f3b70c00640 1 -- 172.21.15.173:0/77757411 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3b640b7850 con 0x7f3b740aeb90 2024-04-25T09:12:23.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.210+0000 7f3b70c00640 1 --2- 172.21.15.173:0/77757411 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b54066f60 0x7f3b54069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:23.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.210+0000 7f3b70c00640 1 -- 172.21.15.173:0/77757411 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f3b6411f9c0 con 0x7f3b740aeb90 2024-04-25T09:12:23.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.210+0000 7f3b73e00640 1 --2- 172.21.15.173:0/77757411 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b54066f60 0x7f3b54069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:23.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.210+0000 7f3b73e00640 1 --2- 172.21.15.173:0/77757411 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b54066f60 0x7f3b54069420 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3b7415dcb0 tx=0x7f3b60009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:23.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.214+0000 7f3b70c00640 1 -- 172.21.15.173:0/77757411 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3b64015fb0 con 0x7f3b740aeb90 2024-04-25T09:12:23.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:23.402+0000 7f3b7b600640 1 -- 172.21.15.173:0/77757411 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3b7406c300 con 0x7f3b740aeb90 2024-04-25T09:12:24.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.034+0000 7f3b70c00640 1 -- 172.21.15.173:0/77757411 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v83) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3b640f0870 con 0x7f3b740aeb90 2024-04-25T09:12:24.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.034+0000 7f3b7b600640 1 -- 172.21.15.173:0/77757411 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b54066f60 msgr2=0x7f3b54069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.034+0000 7f3b7b600640 1 --2- 172.21.15.173:0/77757411 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b54066f60 0x7f3b54069420 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3b7415dcb0 tx=0x7f3b60009040 comp rx=0 tx=0).stop 2024-04-25T09:12:24.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.034+0000 7f3b7b600640 1 -- 172.21.15.173:0/77757411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b740aeb90 msgr2=0x7f3b74142f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.034+0000 7f3b7b600640 1 --2- 172.21.15.173:0/77757411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b740aeb90 0x7f3b74142f40 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f3b64018f40 tx=0x7f3b6401ab70 comp rx=0 tx=0).stop 2024-04-25T09:12:24.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.034+0000 7f3b7b600640 1 -- 172.21.15.173:0/77757411 shutdown_connections 2024-04-25T09:12:24.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.034+0000 7f3b7b600640 1 --2- 172.21.15.173:0/77757411 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3b54066f60 0x7f3b54069420 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.034+0000 7f3b7b600640 1 --2- 172.21.15.173:0/77757411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b740ce2b0 0x7f3b7406d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.034+0000 7f3b7b600640 1 --2- 172.21.15.173:0/77757411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b740aef70 0x7f3b74156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.034+0000 7f3b7b600640 1 --2- 172.21.15.173:0/77757411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b740aeb90 0x7f3b74142f40 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.034+0000 7f3b7b600640 1 -- 172.21.15.173:0/77757411 >> 172.21.15.173:0/77757411 conn(0x7f3b7406ac90 msgr2=0x7f3b74150d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:24.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.034+0000 7f3b7b600640 1 -- 172.21.15.173:0/77757411 shutdown_connections 2024-04-25T09:12:24.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.034+0000 7f3b7b600640 1 -- 172.21.15.173:0/77757411 wait complete. 2024-04-25T09:12:24.043 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:12:24.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f41a2000640 1 Processor -- start 2024-04-25T09:12:24.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f41a2000640 1 -- start start 2024-04-25T09:12:24.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f41a2000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f419c145290 0x7f419c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f41a2000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f419c0b3fe0 0x7f419c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f41a2000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f419c0cc260 0x7f419c0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f41a2000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419c15c5f0 con 0x7f419c145290 2024-04-25T09:12:24.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f41a2000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419c06d4b0 con 0x7f419c0b3fe0 2024-04-25T09:12:24.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f41a2000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c06d790 con 0x7f419c0cc260 2024-04-25T09:12:24.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f419b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f419c145290 0x7f419c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f419b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f419c145290 0x7f419c15c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51894/0 (socket says 172.21.15.173:51894) 2024-04-25T09:12:24.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f419b400640 1 -- 172.21.15.173:0/1463416508 learned_addr learned my addr 172.21.15.173:0/1463416508 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:24.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f419aa00640 1 --2- 172.21.15.173:0/1463416508 >> v2:172.21.15.194:3300/0 conn(0x7f419c0b3fe0 0x7f419c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f419be00640 1 --2- 172.21.15.173:0/1463416508 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f419c0cc260 0x7f419c0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f419b400640 1 -- 172.21.15.173:0/1463416508 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f419c0cc260 msgr2=0x7f419c0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:24.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f419b400640 1 --2- 172.21.15.173:0/1463416508 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f419c0cc260 0x7f419c0cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f419b400640 1 -- 172.21.15.173:0/1463416508 >> v2:172.21.15.194:3300/0 conn(0x7f419c0b3fe0 msgr2=0x7f419c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:24.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f419b400640 1 --2- 172.21.15.173:0/1463416508 >> v2:172.21.15.194:3300/0 conn(0x7f419c0b3fe0 0x7f419c0b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f419b400640 1 -- 172.21.15.173:0/1463416508 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c06da70 con 0x7f419c145290 2024-04-25T09:12:24.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.246+0000 7f419be00640 1 --2- 172.21.15.173:0/1463416508 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f419c0cc260 0x7f419c0cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:24.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.250+0000 7f419b400640 1 --2- 172.21.15.173:0/1463416508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f419c145290 0x7f419c15c0b0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f419c071100 tx=0x7f418c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1807183293a2fd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:24.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.250+0000 7f419a000640 1 -- 172.21.15.173:0/1463416508 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c0b0070 con 0x7f419c145290 2024-04-25T09:12:24.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.250+0000 7f419a000640 1 -- 172.21.15.173:0/1463416508 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c0ab600 con 0x7f419c145290 2024-04-25T09:12:24.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.250+0000 7f419a000640 1 -- 172.21.15.173:0/1463416508 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c0ab9d0 con 0x7f419c145290 2024-04-25T09:12:24.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.250+0000 7f41a2000640 1 -- 172.21.15.173:0/1463416508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f419c145290 msgr2=0x7f419c15c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.250+0000 7f41a2000640 1 --2- 172.21.15.173:0/1463416508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f419c145290 0x7f419c15c0b0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f419c071100 tx=0x7f418c01c400 comp rx=0 tx=0).stop 2024-04-25T09:12:24.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.250+0000 7f41a2000640 1 -- 172.21.15.173:0/1463416508 shutdown_connections 2024-04-25T09:12:24.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.250+0000 7f41a2000640 1 --2- 172.21.15.173:0/1463416508 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f419c0cc260 0x7f419c0cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.250+0000 7f41a2000640 1 --2- 172.21.15.173:0/1463416508 >> v2:172.21.15.194:3300/0 conn(0x7f419c0b3fe0 0x7f419c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.250+0000 7f41a2000640 1 --2- 172.21.15.173:0/1463416508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f419c145290 0x7f419c15c0b0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.250+0000 7f41a2000640 1 -- 172.21.15.173:0/1463416508 >> 172.21.15.173:0/1463416508 conn(0x7f419c06ac90 msgr2=0x7f419c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:24.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.250+0000 7f41a2000640 1 -- 172.21.15.173:0/1463416508 shutdown_connections 2024-04-25T09:12:24.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.250+0000 7f41a2000640 1 -- 172.21.15.173:0/1463416508 wait complete. 2024-04-25T09:12:24.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.250+0000 7f41a2000640 1 Processor -- start 2024-04-25T09:12:24.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.250+0000 7f41a2000640 1 -- start start 2024-04-25T09:12:24.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f41a2000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f419c0b3fe0 0x7f419c134ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f41a2000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f419c0cc260 0x7f419c140a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f41a2000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f419c145290 0x7f419c141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f41a2000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c1457f0 con 0x7f419c145290 2024-04-25T09:12:24.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f41a2000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c145670 con 0x7f419c0b3fe0 2024-04-25T09:12:24.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f41a2000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c06ed60 con 0x7f419c0cc260 2024-04-25T09:12:24.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f419be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f419c145290 0x7f419c141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f419be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f419c145290 0x7f419c141060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51908/0 (socket says 172.21.15.173:51908) 2024-04-25T09:12:24.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f419be00640 1 -- 172.21.15.173:0/341482289 learned_addr learned my addr 172.21.15.173:0/341482289 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:24.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f419b400640 1 --2- 172.21.15.173:0/341482289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f419c0b3fe0 0x7f419c134ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f419aa00640 1 --2- 172.21.15.173:0/341482289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f419c0cc260 0x7f419c140a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f419be00640 1 -- 172.21.15.173:0/341482289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f419c0cc260 msgr2=0x7f419c140a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f419be00640 1 --2- 172.21.15.173:0/341482289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f419c0cc260 0x7f419c140a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f419be00640 1 -- 172.21.15.173:0/341482289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f419c0b3fe0 msgr2=0x7f419c134ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f419be00640 1 --2- 172.21.15.173:0/341482289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f419c0b3fe0 0x7f419c134ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f419be00640 1 -- 172.21.15.173:0/341482289 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c1443b0 con 0x7f419c145290 2024-04-25T09:12:24.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f419aa00640 1 --2- 172.21.15.173:0/341482289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f419c0cc260 0x7f419c140a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:24.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f419be00640 1 --2- 172.21.15.173:0/341482289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f419c145290 0x7f419c141060 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f419400cef0 tx=0x7f419400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:24.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f4193400640 1 -- 172.21.15.173:0/341482289 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419401a070 con 0x7f419c145290 2024-04-25T09:12:24.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f4193400640 1 -- 172.21.15.173:0/341482289 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419400d860 con 0x7f419c145290 2024-04-25T09:12:24.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f4193400640 1 -- 172.21.15.173:0/341482289 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419400dc50 con 0x7f419c145290 2024-04-25T09:12:24.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f41a2000640 1 -- 172.21.15.173:0/341482289 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419c1430e0 con 0x7f419c145290 2024-04-25T09:12:24.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f41a2000640 1 -- 172.21.15.173:0/341482289 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419c144650 con 0x7f419c145290 2024-04-25T09:12:24.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.254+0000 7f41a2000640 1 -- 172.21.15.173:0/341482289 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419c1364b0 con 0x7f419c145290 2024-04-25T09:12:24.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.258+0000 7f4193400640 1 -- 172.21.15.173:0/341482289 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f419401d070 con 0x7f419c145290 2024-04-25T09:12:24.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.258+0000 7f4193400640 1 --2- 172.21.15.173:0/341482289 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f417c066f60 0x7f417c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.258+0000 7f4193400640 1 -- 172.21.15.173:0/341482289 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f4194085ab0 con 0x7f419c145290 2024-04-25T09:12:24.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.258+0000 7f419b400640 1 --2- 172.21.15.173:0/341482289 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f417c066f60 0x7f417c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.258+0000 7f419b400640 1 --2- 172.21.15.173:0/341482289 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f417c066f60 0x7f417c069420 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f418c0ad000 tx=0x7f418c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:24.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.262+0000 7f4193400640 1 -- 172.21.15.173:0/341482289 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f419c1364b0 con 0x7f419c145290 2024-04-25T09:12:24.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:24.418+0000 7f41a2000640 1 -- 172.21.15.173:0/341482289 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f419c1424b0 con 0x7f419c145290 2024-04-25T09:12:25.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.038+0000 7f4193400640 1 -- 172.21.15.173:0/341482289 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v124) v1 ==== 181+0+0 (secure 0 0 0) 0x7f41940562b0 con 0x7f419c145290 2024-04-25T09:12:25.022 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:12:25.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.042+0000 7f41a2000640 1 -- 172.21.15.173:0/341482289 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f417c066f60 msgr2=0x7f417c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:25.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.042+0000 7f41a2000640 1 --2- 172.21.15.173:0/341482289 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f417c066f60 0x7f417c069420 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f418c0ad000 tx=0x7f418c008040 comp rx=0 tx=0).stop 2024-04-25T09:12:25.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.042+0000 7f41a2000640 1 -- 172.21.15.173:0/341482289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f419c145290 msgr2=0x7f419c141060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.042+0000 7f41a2000640 1 --2- 172.21.15.173:0/341482289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f419c145290 0x7f419c141060 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f419400cef0 tx=0x7f419400a710 comp rx=0 tx=0).stop 2024-04-25T09:12:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.042+0000 7f41a2000640 1 -- 172.21.15.173:0/341482289 shutdown_connections 2024-04-25T09:12:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.042+0000 7f41a2000640 1 --2- 172.21.15.173:0/341482289 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f417c066f60 0x7f417c069420 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.042+0000 7f41a2000640 1 --2- 172.21.15.173:0/341482289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f419c145290 0x7f419c141060 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.042+0000 7f41a2000640 1 --2- 172.21.15.173:0/341482289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f419c0cc260 0x7f419c140a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.042+0000 7f41a2000640 1 --2- 172.21.15.173:0/341482289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f419c0b3fe0 0x7f419c134ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.042+0000 7f41a2000640 1 -- 172.21.15.173:0/341482289 >> 172.21.15.173:0/341482289 conn(0x7f419c06ac90 msgr2=0x7f419c0cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.042+0000 7f41a2000640 1 -- 172.21.15.173:0/341482289 shutdown_connections 2024-04-25T09:12:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.042+0000 7f41a2000640 1 -- 172.21.15.173:0/341482289 wait complete. 2024-04-25T09:12:25.050 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:12:25.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.210+0000 7fbfb3a00640 1 Processor -- start 2024-04-25T09:12:25.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.210+0000 7fbfb3a00640 1 -- start start 2024-04-25T09:12:25.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.214+0000 7fbfb3a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbfac0cc7e0 0x7fbfac0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:25.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.214+0000 7fbfb3a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbfac0aef70 0x7fbfac0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:25.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.214+0000 7fbfb3a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfac071570 con 0x7fbfac0aeb90 2024-04-25T09:12:25.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.214+0000 7fbfb3a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac071320 con 0x7fbfac0aef70 2024-04-25T09:12:25.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.214+0000 7fbfb3a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac072330 con 0x7fbfac0cc7e0 2024-04-25T09:12:25.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.214+0000 7fbfb1000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fbfac0aeb90 0x7fbfac0cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:59212/0 (socket says 172.21.15.173:59212) 2024-04-25T09:12:25.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.214+0000 7fbfb1000640 1 -- 172.21.15.173:0/3912698972 learned_addr learned my addr 172.21.15.173:0/3912698972 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:25.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.214+0000 7fbfb1a00640 1 --2- 172.21.15.173:0/3912698972 >> v2:172.21.15.173:3300/0 conn(0x7fbfac0aef70 0x7fbfac0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:25.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.214+0000 7fbfa3e00640 1 --2- 172.21.15.173:0/3912698972 >> v2:172.21.15.194:3300/0 conn(0x7fbfac0cc7e0 0x7fbfac0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:25.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.214+0000 7fbfb1a00640 1 -- 172.21.15.173:0/3912698972 >> v2:172.21.15.194:3300/0 conn(0x7fbfac0cc7e0 msgr2=0x7fbfac0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:25.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.214+0000 7fbfb1a00640 1 --2- 172.21.15.173:0/3912698972 >> v2:172.21.15.194:3300/0 conn(0x7fbfac0cc7e0 0x7fbfac0cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:25.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.214+0000 7fbfb1a00640 1 -- 172.21.15.173:0/3912698972 >> v1:172.21.15.173:6789/0 conn(0x7fbfac0aeb90 legacy=0x7fbfac0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:25.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.214+0000 7fbfb1a00640 1 -- 172.21.15.173:0/3912698972 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac071850 con 0x7fbfac0aef70 2024-04-25T09:12:25.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.214+0000 7fbfb1a00640 1 --2- 172.21.15.173:0/3912698972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfac0aef70 0x7fbfac0ce0e0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0cd960 tx=0x7fbfa401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c174e076bacbfe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:25.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.214+0000 7fbfabe00640 1 -- 172.21.15.173:0/3912698972 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40b2070 con 0x7fbfac0aef70 2024-04-25T09:12:25.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.214+0000 7fbfabe00640 1 -- 172.21.15.173:0/3912698972 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa40a5750 con 0x7fbfac0aef70 2024-04-25T09:12:25.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.214+0000 7fbfabe00640 1 -- 172.21.15.173:0/3912698972 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40a5b20 con 0x7fbfac0aef70 2024-04-25T09:12:25.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb3a00640 1 -- 172.21.15.173:0/3912698972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfac0aef70 msgr2=0x7fbfac0ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:25.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb3a00640 1 --2- 172.21.15.173:0/3912698972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfac0aef70 0x7fbfac0ce0e0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0cd960 tx=0x7fbfa401c8a0 comp rx=0 tx=0).stop 2024-04-25T09:12:25.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb3a00640 1 -- 172.21.15.173:0/3912698972 shutdown_connections 2024-04-25T09:12:25.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb3a00640 1 --2- 172.21.15.173:0/3912698972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfac0aef70 0x7fbfac0ce0e0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:25.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb3a00640 1 --2- 172.21.15.173:0/3912698972 >> v2:172.21.15.194:3300/0 conn(0x7fbfac0cc7e0 0x7fbfac0cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:25.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb3a00640 1 -- 172.21.15.173:0/3912698972 >> 172.21.15.173:0/3912698972 conn(0x7fbfac06ac90 msgr2=0x7fbfac06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:25.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb3a00640 1 -- 172.21.15.173:0/3912698972 shutdown_connections 2024-04-25T09:12:25.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb3a00640 1 -- 172.21.15.173:0/3912698972 wait complete. 2024-04-25T09:12:25.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb3a00640 1 Processor -- start 2024-04-25T09:12:25.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb3a00640 1 -- start start 2024-04-25T09:12:25.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb3a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfac0aeb90 0x7fbfac1f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:25.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb3a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfac0aef70 0x7fbfac0cf980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:25.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb3a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfac0cc7e0 0x7fbfac1577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:25.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb3a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac15bb30 con 0x7fbfac0aef70 2024-04-25T09:12:25.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb3a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac15b9b0 con 0x7fbfac0cc7e0 2024-04-25T09:12:25.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb3a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac15bcb0 con 0x7fbfac0aeb90 2024-04-25T09:12:25.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfa3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfac0aef70 0x7fbfac0cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:25.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfa3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfac0aef70 0x7fbfac0cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51920/0 (socket says 172.21.15.173:51920) 2024-04-25T09:12:25.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfa3e00640 1 -- 172.21.15.173:0/2316225929 learned_addr learned my addr 172.21.15.173:0/2316225929 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:25.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb1000640 1 --2- 172.21.15.173:0/2316225929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfac0aeb90 0x7fbfac1f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:25.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb1a00640 1 --2- 172.21.15.173:0/2316225929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfac0cc7e0 0x7fbfac1577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:25.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfa3e00640 1 -- 172.21.15.173:0/2316225929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfac0aeb90 msgr2=0x7fbfac1f67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:25.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfa3e00640 1 --2- 172.21.15.173:0/2316225929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfac0aeb90 0x7fbfac1f67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:25.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfa3e00640 1 -- 172.21.15.173:0/2316225929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfac0cc7e0 msgr2=0x7fbfac1577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:25.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfa3e00640 1 --2- 172.21.15.173:0/2316225929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfac0cc7e0 0x7fbfac1577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:25.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfa3e00640 1 -- 172.21.15.173:0/2316225929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac1516b0 con 0x7fbfac0aef70 2024-04-25T09:12:25.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb1a00640 1 --2- 172.21.15.173:0/2316225929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfac0cc7e0 0x7fbfac1577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:25.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.218+0000 7fbfb1000640 1 --2- 172.21.15.173:0/2316225929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfac0aeb90 0x7fbfac1f67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:25.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.222+0000 7fbfa3e00640 1 --2- 172.21.15.173:0/2316225929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfac0aef70 0x7fbfac0cf980 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400d800 tx=0x7fbf9400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:25.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.222+0000 7fbfa9600640 1 -- 172.21.15.173:0/2316225929 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9400b6c0 con 0x7fbfac0aef70 2024-04-25T09:12:25.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.222+0000 7fbfa9600640 1 -- 172.21.15.173:0/2316225929 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf94019070 con 0x7fbfac0aef70 2024-04-25T09:12:25.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.222+0000 7fbfb3a00640 1 -- 172.21.15.173:0/2316225929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfac158430 con 0x7fbfac0aef70 2024-04-25T09:12:25.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.222+0000 7fbfa9600640 1 -- 172.21.15.173:0/2316225929 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9400ba60 con 0x7fbfac0aef70 2024-04-25T09:12:25.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.222+0000 7fbfb3a00640 1 -- 172.21.15.173:0/2316225929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac153810 con 0x7fbfac0aef70 2024-04-25T09:12:25.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.222+0000 7fbfb3a00640 1 -- 172.21.15.173:0/2316225929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfac073ab0 con 0x7fbfac0aef70 2024-04-25T09:12:25.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.222+0000 7fbfa9600640 1 -- 172.21.15.173:0/2316225929 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbf9400bc00 con 0x7fbfac0aef70 2024-04-25T09:12:25.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.222+0000 7fbfa9600640 1 --2- 172.21.15.173:0/2316225929 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbf88066f60 0x7fbf88069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:25.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.222+0000 7fbfa9600640 1 -- 172.21.15.173:0/2316225929 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5749+0+0 (secure 0 0 0) 0x7fbf94085430 con 0x7fbfac0aef70 2024-04-25T09:12:25.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.222+0000 7fbfb1000640 1 --2- 172.21.15.173:0/2316225929 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbf88066f60 0x7fbf88069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:25.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.226+0000 7fbfb1000640 1 --2- 172.21.15.173:0/2316225929 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbf88066f60 0x7fbf88069420 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c000f70 tx=0x7fbf9c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:25.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.226+0000 7fbfa9600640 1 -- 172.21.15.173:0/2316225929 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbf940564a0 con 0x7fbfac0aef70 2024-04-25T09:12:25.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:25.386+0000 7fbfb3a00640 1 -- 172.21.15.173:0/2316225929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbfac0b4690 con 0x7fbfac0aef70 2024-04-25T09:12:26.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.038+0000 7fbfa9600640 1 -- 172.21.15.173:0/2316225929 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v125) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbf94055da0 con 0x7fbfac0aef70 2024-04-25T09:12:26.023 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' removed 2024-04-25T09:12:26.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.042+0000 7fbfb3a00640 1 -- 172.21.15.173:0/2316225929 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbf88066f60 msgr2=0x7fbf88069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:26.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.042+0000 7fbfb3a00640 1 --2- 172.21.15.173:0/2316225929 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbf88066f60 0x7fbf88069420 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c000f70 tx=0x7fbf9c009040 comp rx=0 tx=0).stop 2024-04-25T09:12:26.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.042+0000 7fbfb3a00640 1 -- 172.21.15.173:0/2316225929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfac0aef70 msgr2=0x7fbfac0cf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:26.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.042+0000 7fbfb3a00640 1 --2- 172.21.15.173:0/2316225929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfac0aef70 0x7fbfac0cf980 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400d800 tx=0x7fbf9400dcc0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.046+0000 7fbfb3a00640 1 -- 172.21.15.173:0/2316225929 shutdown_connections 2024-04-25T09:12:26.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.046+0000 7fbfb3a00640 1 --2- 172.21.15.173:0/2316225929 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbf88066f60 0x7fbf88069420 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.046+0000 7fbfb3a00640 1 --2- 172.21.15.173:0/2316225929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfac0cc7e0 0x7fbfac1577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.046+0000 7fbfb3a00640 1 --2- 172.21.15.173:0/2316225929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfac0aef70 0x7fbfac0cf980 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.046+0000 7fbfb3a00640 1 --2- 172.21.15.173:0/2316225929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfac0aeb90 0x7fbfac1f67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.046+0000 7fbfb3a00640 1 -- 172.21.15.173:0/2316225929 >> 172.21.15.173:0/2316225929 conn(0x7fbfac06ac90 msgr2=0x7fbfac06d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:26.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.046+0000 7fbfb3a00640 1 -- 172.21.15.173:0/2316225929 shutdown_connections 2024-04-25T09:12:26.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.046+0000 7fbfb3a00640 1 -- 172.21.15.173:0/2316225929 wait complete. 2024-04-25T09:12:26.065 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:12:26.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.226+0000 7f4bdd000640 1 Processor -- start 2024-04-25T09:12:26.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.230+0000 7f4bdd000640 1 -- start start 2024-04-25T09:12:26.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.230+0000 7f4bdd000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4bd8161f80 0x7f4bd80cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:26.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.230+0000 7f4bdd000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4bd80aea40 0x7f4bd80cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:26.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.230+0000 7f4bdd000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd80b2770 con 0x7f4bd80cc630 2024-04-25T09:12:26.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.230+0000 7f4bdd000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd80ccaa0 con 0x7f4bd80aea40 2024-04-25T09:12:26.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.230+0000 7f4bdd000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd8071e80 con 0x7f4bd8161f80 2024-04-25T09:12:26.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.230+0000 7f4bcfe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4bd80aea40 0x7f4bd80cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:26.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.230+0000 7f4bcfe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4bd80aea40 0x7f4bd80cc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51928/0 (socket says 172.21.15.173:51928) 2024-04-25T09:12:26.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.230+0000 7f4bd6800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4bd80cc630 0x7f4bd806d380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:59220/0 (socket says 172.21.15.173:59220) 2024-04-25T09:12:26.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.230+0000 7f4bcfe00640 1 -- 172.21.15.173:0/3363000624 learned_addr learned my addr 172.21.15.173:0/3363000624 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:26.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.230+0000 7f4bd5e00640 1 --2- 172.21.15.173:0/3363000624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4bd8161f80 0x7f4bd80cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:26.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.230+0000 7f4bcfe00640 1 -- 172.21.15.173:0/3363000624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4bd8161f80 msgr2=0x7f4bd80cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:26.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.230+0000 7f4bcfe00640 1 --2- 172.21.15.173:0/3363000624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4bd8161f80 0x7f4bd80cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.230+0000 7f4bcfe00640 1 -- 172.21.15.173:0/3363000624 >> v1:172.21.15.173:6789/0 conn(0x7f4bd80cc630 legacy=0x7f4bd806d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:26.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.230+0000 7f4bcfe00640 1 -- 172.21.15.173:0/3363000624 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd8072160 con 0x7f4bd80aea40 2024-04-25T09:12:26.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.230+0000 7f4bd5e00640 1 --2- 172.21.15.173:0/3363000624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4bd8161f80 0x7f4bd80cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:26.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.230+0000 7f4bd5400640 1 -- 172.21.15.173:0/3363000624 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629450900 0 0) 0x7f4bd00014a0 con 0x7f4bd80cc630 2024-04-25T09:12:26.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.234+0000 7f4bcfe00640 1 --2- 172.21.15.173:0/3363000624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bd80aea40 0x7f4bd80cc0f0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009870 tx=0x7f4bc001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5404801c96dcfa84 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:26.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.234+0000 7f4bd5400640 1 -- 172.21.15.173:0/3363000624 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00b1070 con 0x7f4bd80aea40 2024-04-25T09:12:26.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.234+0000 7f4bd5400640 1 -- 172.21.15.173:0/3363000624 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc00ac620 con 0x7f4bd80aea40 2024-04-25T09:12:26.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.234+0000 7f4bd5400640 1 -- 172.21.15.173:0/3363000624 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00ac9f0 con 0x7f4bd80aea40 2024-04-25T09:12:26.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.234+0000 7f4bdd000640 1 -- 172.21.15.173:0/3363000624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bd80aea40 msgr2=0x7f4bd80cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:26.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.234+0000 7f4bdd000640 1 --2- 172.21.15.173:0/3363000624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bd80aea40 0x7f4bd80cc0f0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009870 tx=0x7f4bc001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.234+0000 7f4bdd000640 1 -- 172.21.15.173:0/3363000624 shutdown_connections 2024-04-25T09:12:26.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.234+0000 7f4bdd000640 1 --2- 172.21.15.173:0/3363000624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bd80aea40 0x7f4bd80cc0f0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.234+0000 7f4bdd000640 1 --2- 172.21.15.173:0/3363000624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4bd8161f80 0x7f4bd80cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.234+0000 7f4bdd000640 1 -- 172.21.15.173:0/3363000624 >> 172.21.15.173:0/3363000624 conn(0x7f4bd806ac90 msgr2=0x7f4bd806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:26.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.234+0000 7f4bdd000640 1 -- 172.21.15.173:0/3363000624 shutdown_connections 2024-04-25T09:12:26.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.234+0000 7f4bdd000640 1 -- 172.21.15.173:0/3363000624 wait complete. 2024-04-25T09:12:26.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.234+0000 7f4bdd000640 1 Processor -- start 2024-04-25T09:12:26.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.234+0000 7f4bdd000640 1 -- start start 2024-04-25T09:12:26.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bdd000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bd80aea40 0x7f4bd815af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:26.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bdd000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4bd80cc630 0x7f4bd815c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:26.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bdd000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4bd8161f80 0x7f4bd80b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:26.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bdd000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80ceb40 con 0x7f4bd80aea40 2024-04-25T09:12:26.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bdd000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80d0450 con 0x7f4bd8161f80 2024-04-25T09:12:26.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bdd000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80cecc0 con 0x7f4bd80cc630 2024-04-25T09:12:26.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bd5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bd80aea40 0x7f4bd815af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:26.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bd5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bd80aea40 0x7f4bd815af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51930/0 (socket says 172.21.15.173:51930) 2024-04-25T09:12:26.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bd5e00640 1 -- 172.21.15.173:0/3662614892 learned_addr learned my addr 172.21.15.173:0/3662614892 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:26.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bcfe00640 1 --2- 172.21.15.173:0/3662614892 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4bd80cc630 0x7f4bd815c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:26.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bd6800640 1 --2- 172.21.15.173:0/3662614892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4bd8161f80 0x7f4bd80b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:26.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bd5e00640 1 -- 172.21.15.173:0/3662614892 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4bd80cc630 msgr2=0x7f4bd815c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:26.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bd5e00640 1 --2- 172.21.15.173:0/3662614892 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4bd80cc630 0x7f4bd815c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bd5e00640 1 -- 172.21.15.173:0/3662614892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4bd8161f80 msgr2=0x7f4bd80b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:26.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bd5e00640 1 --2- 172.21.15.173:0/3662614892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4bd8161f80 0x7f4bd80b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bd5e00640 1 -- 172.21.15.173:0/3662614892 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd8155b00 con 0x7f4bd80aea40 2024-04-25T09:12:26.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bd5e00640 1 --2- 172.21.15.173:0/3662614892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bd80aea40 0x7f4bd815af40 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800c820 tx=0x7f4bc800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:26.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bce000640 1 -- 172.21.15.173:0/3662614892 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8015070 con 0x7f4bd80aea40 2024-04-25T09:12:26.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bce000640 1 -- 172.21.15.173:0/3662614892 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc8007a30 con 0x7f4bd80aea40 2024-04-25T09:12:26.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bdd000640 1 -- 172.21.15.173:0/3662614892 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd8155de0 con 0x7f4bd80aea40 2024-04-25T09:12:26.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bce000640 1 -- 172.21.15.173:0/3662614892 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8007e40 con 0x7f4bd80aea40 2024-04-25T09:12:26.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bdd000640 1 -- 172.21.15.173:0/3662614892 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd81563a0 con 0x7f4bd80aea40 2024-04-25T09:12:26.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bdd000640 1 -- 172.21.15.173:0/3662614892 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd8073ab0 con 0x7f4bd80aea40 2024-04-25T09:12:26.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.238+0000 7f4bce000640 1 -- 172.21.15.173:0/3662614892 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4bc8018070 con 0x7f4bd80aea40 2024-04-25T09:12:26.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.242+0000 7f4bce000640 1 --2- 172.21.15.173:0/3662614892 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4bb4066f60 0x7f4bb4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:26.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.242+0000 7f4bce000640 1 -- 172.21.15.173:0/3662614892 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f4bc8084d50 con 0x7f4bd80aea40 2024-04-25T09:12:26.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.242+0000 7f4bcfe00640 1 --2- 172.21.15.173:0/3662614892 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4bb4066f60 0x7f4bb4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:26.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.242+0000 7f4bcfe00640 1 --2- 172.21.15.173:0/3662614892 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4bb4066f60 0x7f4bb4069420 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00ae000 tx=0x7f4bc0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:26.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.246+0000 7f4bce000640 1 -- 172.21.15.173:0/3662614892 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4bc8055870 con 0x7f4bd80aea40 2024-04-25T09:12:26.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.438+0000 7f4bdd000640 1 -- 172.21.15.173:0/3662614892 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4bd80cff70 con 0x7f4bd80aea40 2024-04-25T09:12:26.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.442+0000 7f4bce000640 1 -- 172.21.15.173:0/3662614892 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4bc8059910 con 0x7f4bd80aea40 2024-04-25T09:12:26.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.446+0000 7f4bdd000640 1 -- 172.21.15.173:0/3662614892 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4bb4066f60 msgr2=0x7f4bb4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:26.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.446+0000 7f4bdd000640 1 --2- 172.21.15.173:0/3662614892 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4bb4066f60 0x7f4bb4069420 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00ae000 tx=0x7f4bc0008040 comp rx=0 tx=0).stop 2024-04-25T09:12:26.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.446+0000 7f4bdd000640 1 -- 172.21.15.173:0/3662614892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bd80aea40 msgr2=0x7f4bd815af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:26.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.446+0000 7f4bdd000640 1 --2- 172.21.15.173:0/3662614892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bd80aea40 0x7f4bd815af40 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800c820 tx=0x7f4bc800cce0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.446+0000 7f4bdd000640 1 -- 172.21.15.173:0/3662614892 shutdown_connections 2024-04-25T09:12:26.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.446+0000 7f4bdd000640 1 --2- 172.21.15.173:0/3662614892 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4bb4066f60 0x7f4bb4069420 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.446+0000 7f4bdd000640 1 --2- 172.21.15.173:0/3662614892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4bd8161f80 0x7f4bd80b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.446+0000 7f4bdd000640 1 --2- 172.21.15.173:0/3662614892 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4bd80cc630 0x7f4bd815c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.446+0000 7f4bdd000640 1 --2- 172.21.15.173:0/3662614892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bd80aea40 0x7f4bd815af40 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.446+0000 7f4bdd000640 1 -- 172.21.15.173:0/3662614892 >> 172.21.15.173:0/3662614892 conn(0x7f4bd806ac90 msgr2=0x7f4bd80af710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:26.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.446+0000 7f4bdd000640 1 -- 172.21.15.173:0/3662614892 shutdown_connections 2024-04-25T09:12:26.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.446+0000 7f4bdd000640 1 -- 172.21.15.173:0/3662614892 wait complete. 2024-04-25T09:12:26.496 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-04-25T09:12:26.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.645+0000 7f6db5c00640 1 Processor -- start 2024-04-25T09:12:26.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.645+0000 7f6db5c00640 1 -- start start 2024-04-25T09:12:26.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.645+0000 7f6db5c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6db00b3e70 0x7f6db00b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:26.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.645+0000 7f6db5c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6db00aefa0 0x7f6db00b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:26.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.645+0000 7f6db5c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6db015edd0 0x7f6db00b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:26.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.645+0000 7f6db5c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db006dd50 con 0x7f6db015edd0 2024-04-25T09:12:26.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.645+0000 7f6db5c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db00b4790 con 0x7f6db00aefa0 2024-04-25T09:12:26.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.645+0000 7f6db5c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db015f320 con 0x7f6db00b3e70 2024-04-25T09:12:26.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.645+0000 7f6daf400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6db015edd0 0x7f6db00b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:26.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.645+0000 7f6daf400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6db015edd0 0x7f6db00b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51932/0 (socket says 172.21.15.173:51932) 2024-04-25T09:12:26.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.645+0000 7f6daf400640 1 -- 172.21.15.173:0/916951061 learned_addr learned my addr 172.21.15.173:0/916951061 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:26.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.645+0000 7f6daea00640 1 --2- 172.21.15.173:0/916951061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6db00b3e70 0x7f6db00b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:26.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.649+0000 7f6da6000640 1 --2- 172.21.15.173:0/916951061 >> v2:172.21.15.194:3300/0 conn(0x7f6db00aefa0 0x7f6db00b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:26.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.649+0000 7f6daf400640 1 -- 172.21.15.173:0/916951061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6db00b3e70 msgr2=0x7f6db00b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:26.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.649+0000 7f6daf400640 1 --2- 172.21.15.173:0/916951061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6db00b3e70 0x7f6db00b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.649+0000 7f6daf400640 1 -- 172.21.15.173:0/916951061 >> v2:172.21.15.194:3300/0 conn(0x7f6db00aefa0 msgr2=0x7f6db00b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:26.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.649+0000 7f6daf400640 1 --2- 172.21.15.173:0/916951061 >> v2:172.21.15.194:3300/0 conn(0x7f6db00aefa0 0x7f6db00b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.649+0000 7f6daf400640 1 -- 172.21.15.173:0/916951061 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db006d420 con 0x7f6db015edd0 2024-04-25T09:12:26.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.649+0000 7f6daf400640 1 --2- 172.21.15.173:0/916951061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6db015edd0 0x7f6db00b2cb0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f6db0062550 tx=0x7f6da801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad83712c6aeb3b89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:26.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.649+0000 7f6dae000640 1 -- 172.21.15.173:0/916951061 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da80aa430 con 0x7f6db015edd0 2024-04-25T09:12:26.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.649+0000 7f6dae000640 1 -- 172.21.15.173:0/916951061 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da80af070 con 0x7f6db015edd0 2024-04-25T09:12:26.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.649+0000 7f6dae000640 1 -- 172.21.15.173:0/916951061 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da80aa7f0 con 0x7f6db015edd0 2024-04-25T09:12:26.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6db5c00640 1 -- 172.21.15.173:0/916951061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6db015edd0 msgr2=0x7f6db00b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:26.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6db5c00640 1 --2- 172.21.15.173:0/916951061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6db015edd0 0x7f6db00b2cb0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f6db0062550 tx=0x7f6da801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6db5c00640 1 -- 172.21.15.173:0/916951061 shutdown_connections 2024-04-25T09:12:26.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6db5c00640 1 --2- 172.21.15.173:0/916951061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6db015edd0 0x7f6db00b2cb0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6db5c00640 1 --2- 172.21.15.173:0/916951061 >> v2:172.21.15.194:3300/0 conn(0x7f6db00aefa0 0x7f6db00b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6db5c00640 1 --2- 172.21.15.173:0/916951061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6db00b3e70 0x7f6db00b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6db5c00640 1 -- 172.21.15.173:0/916951061 >> 172.21.15.173:0/916951061 conn(0x7f6db006ac90 msgr2=0x7f6db006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:26.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6db5c00640 1 -- 172.21.15.173:0/916951061 shutdown_connections 2024-04-25T09:12:26.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6db5c00640 1 -- 172.21.15.173:0/916951061 wait complete. 2024-04-25T09:12:26.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6db5c00640 1 Processor -- start 2024-04-25T09:12:26.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6db5c00640 1 -- start start 2024-04-25T09:12:26.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6db5c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6db00aefa0 0x7f6db01f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:26.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6db5c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6db00b3e70 0x7f6db014cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:26.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6db5c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6db015edd0 0x7f6db0154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:26.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6db5c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db006e1c0 con 0x7f6db00aefa0 2024-04-25T09:12:26.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6db5c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db00b3600 con 0x7f6db00b3e70 2024-04-25T09:12:26.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6db5c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db006e340 con 0x7f6db015edd0 2024-04-25T09:12:26.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6daea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6db00aefa0 0x7f6db01f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:26.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6daea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6db00aefa0 0x7f6db01f55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51944/0 (socket says 172.21.15.173:51944) 2024-04-25T09:12:26.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6daea00640 1 -- 172.21.15.173:0/227538692 learned_addr learned my addr 172.21.15.173:0/227538692 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:26.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6da6000640 1 --2- 172.21.15.173:0/227538692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6db00b3e70 0x7f6db014cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:26.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6daf400640 1 --2- 172.21.15.173:0/227538692 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6db015edd0 0x7f6db0154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:26.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6daea00640 1 -- 172.21.15.173:0/227538692 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6db015edd0 msgr2=0x7f6db0154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:26.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6daea00640 1 --2- 172.21.15.173:0/227538692 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6db015edd0 0x7f6db0154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6daea00640 1 -- 172.21.15.173:0/227538692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6db00b3e70 msgr2=0x7f6db014cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:26.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6daea00640 1 --2- 172.21.15.173:0/227538692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6db00b3e70 0x7f6db014cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6daea00640 1 -- 172.21.15.173:0/227538692 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db01563c0 con 0x7f6db00aefa0 2024-04-25T09:12:26.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6daea00640 1 --2- 172.21.15.173:0/227538692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6db00aefa0 0x7f6db01f55c0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f6da000efc0 tx=0x7f6da000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:26.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6da7400640 1 -- 172.21.15.173:0/227538692 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0018020 con 0x7f6db00aefa0 2024-04-25T09:12:26.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6da7400640 1 -- 172.21.15.173:0/227538692 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da0014480 con 0x7f6db00aefa0 2024-04-25T09:12:26.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.653+0000 7f6da7400640 1 -- 172.21.15.173:0/227538692 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0014850 con 0x7f6db00aefa0 2024-04-25T09:12:26.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.657+0000 7f6db5c00640 1 -- 172.21.15.173:0/227538692 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db01566a0 con 0x7f6db00aefa0 2024-04-25T09:12:26.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.657+0000 7f6db5c00640 1 -- 172.21.15.173:0/227538692 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db0156c60 con 0x7f6db00aefa0 2024-04-25T09:12:26.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.657+0000 7f6db5c00640 1 -- 172.21.15.173:0/227538692 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db0073a40 con 0x7f6db00aefa0 2024-04-25T09:12:26.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.657+0000 7f6da7400640 1 -- 172.21.15.173:0/227538692 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6da001b020 con 0x7f6db00aefa0 2024-04-25T09:12:26.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.657+0000 7f6da7400640 1 --2- 172.21.15.173:0/227538692 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d8c066f60 0x7f6d8c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:26.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.657+0000 7f6da7400640 1 -- 172.21.15.173:0/227538692 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f6da00858e0 con 0x7f6db00aefa0 2024-04-25T09:12:26.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.657+0000 7f6da6000640 1 --2- 172.21.15.173:0/227538692 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d8c066f60 0x7f6d8c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:26.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.657+0000 7f6da6000640 1 --2- 172.21.15.173:0/227538692 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d8c066f60 0x7f6d8c069420 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6db00d0530 tx=0x7f6d98008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:26.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.661+0000 7f6da7400640 1 -- 172.21.15.173:0/227538692 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6da0022070 con 0x7f6db00aefa0 2024-04-25T09:12:26.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:26.873+0000 7f6db5c00640 1 -- 172.21.15.173:0/227538692 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) v1 -- 0x7f6db006f1c0 con 0x7f6db00aefa0 2024-04-25T09:12:27.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.045+0000 7f6da7400640 1 -- 172.21.15.173:0/227538692 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v464) v1 ==== 166+0+0 (secure 0 0 0) 0x7f6da0010040 con 0x7f6db00aefa0 2024-04-25T09:12:27.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.049+0000 7f6db5c00640 1 -- 172.21.15.173:0/227538692 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d8c066f60 msgr2=0x7f6d8c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.049+0000 7f6db5c00640 1 --2- 172.21.15.173:0/227538692 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d8c066f60 0x7f6d8c069420 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6db00d0530 tx=0x7f6d98008040 comp rx=0 tx=0).stop 2024-04-25T09:12:27.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.049+0000 7f6db5c00640 1 -- 172.21.15.173:0/227538692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6db00aefa0 msgr2=0x7f6db01f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.049+0000 7f6db5c00640 1 --2- 172.21.15.173:0/227538692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6db00aefa0 0x7f6db01f55c0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f6da000efc0 tx=0x7f6da000c490 comp rx=0 tx=0).stop 2024-04-25T09:12:27.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.049+0000 7f6db5c00640 1 -- 172.21.15.173:0/227538692 shutdown_connections 2024-04-25T09:12:27.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.049+0000 7f6db5c00640 1 --2- 172.21.15.173:0/227538692 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d8c066f60 0x7f6d8c069420 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.049+0000 7f6db5c00640 1 --2- 172.21.15.173:0/227538692 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6db015edd0 0x7f6db0154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.049+0000 7f6db5c00640 1 --2- 172.21.15.173:0/227538692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6db00b3e70 0x7f6db014cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.049+0000 7f6db5c00640 1 --2- 172.21.15.173:0/227538692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6db00aefa0 0x7f6db01f55c0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.049+0000 7f6db5c00640 1 -- 172.21.15.173:0/227538692 >> 172.21.15.173:0/227538692 conn(0x7f6db006ac90 msgr2=0x7f6db01513d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:27.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.049+0000 7f6db5c00640 1 -- 172.21.15.173:0/227538692 shutdown_connections 2024-04-25T09:12:27.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.049+0000 7f6db5c00640 1 -- 172.21.15.173:0/227538692 wait complete. 2024-04-25T09:12:27.054 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-04-25T09:12:27.055 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T09:12:27.055 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:27.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.205+0000 7fe76ec00640 1 Processor -- start 2024-04-25T09:12:27.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.205+0000 7fe76ec00640 1 -- start start 2024-04-25T09:12:27.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.205+0000 7fe76ec00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe76806dac0 0x7fe7680ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.205+0000 7fe76ec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe76806bca0 0x7fe76806c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.205+0000 7fe76ec00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe768061d60 con 0x7fe768160fe0 2024-04-25T09:12:27.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.205+0000 7fe76ec00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7681613c0 con 0x7fe76806dac0 2024-04-25T09:12:27.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.205+0000 7fe76ec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76806dfa0 con 0x7fe76806bca0 2024-04-25T09:12:27.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.209+0000 7fe75f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe76806dac0 0x7fe7680ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.209+0000 7fe75f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe76806dac0 0x7fe7680ace00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51948/0 (socket says 172.21.15.173:51948) 2024-04-25T09:12:27.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.209+0000 7fe75f400640 1 -- 172.21.15.173:0/1176529298 learned_addr learned my addr 172.21.15.173:0/1176529298 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:27.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.209+0000 7fe76cc00640 1 --2- 172.21.15.173:0/1176529298 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe76806bca0 0x7fe76806c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.209+0000 7fe75f400640 1 -- 172.21.15.173:0/1176529298 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe76806bca0 msgr2=0x7fe76806c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:27.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.209+0000 7fe75f400640 1 --2- 172.21.15.173:0/1176529298 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe76806bca0 0x7fe76806c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.209+0000 7fe75f400640 1 -- 172.21.15.173:0/1176529298 >> v1:172.21.15.194:6789/0 conn(0x7fe768160fe0 legacy=0x7fe768161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.209+0000 7fe75f400640 1 -- 172.21.15.173:0/1176529298 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76806e280 con 0x7fe76806dac0 2024-04-25T09:12:27.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.209+0000 7fe75f400640 1 --2- 172.21.15.173:0/1176529298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe76806dac0 0x7fe7680ace00 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fe750009870 tx=0x7fe75001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97754708cb428a81 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:27.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.209+0000 7fe767400640 1 -- 172.21.15.173:0/1176529298 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7500b1070 con 0x7fe76806dac0 2024-04-25T09:12:27.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.209+0000 7fe767400640 1 -- 172.21.15.173:0/1176529298 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7500ac620 con 0x7fe76806dac0 2024-04-25T09:12:27.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.209+0000 7fe767400640 1 -- 172.21.15.173:0/1176529298 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7500ac9f0 con 0x7fe76806dac0 2024-04-25T09:12:27.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76ec00640 1 -- 172.21.15.173:0/1176529298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe76806dac0 msgr2=0x7fe7680ace00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76ec00640 1 --2- 172.21.15.173:0/1176529298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe76806dac0 0x7fe7680ace00 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fe750009870 tx=0x7fe75001c4d0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76ec00640 1 -- 172.21.15.173:0/1176529298 shutdown_connections 2024-04-25T09:12:27.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76ec00640 1 --2- 172.21.15.173:0/1176529298 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe76806bca0 0x7fe76806c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76ec00640 1 --2- 172.21.15.173:0/1176529298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe76806dac0 0x7fe7680ace00 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76ec00640 1 -- 172.21.15.173:0/1176529298 >> 172.21.15.173:0/1176529298 conn(0x7fe768071c20 msgr2=0x7fe768072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:27.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76ec00640 1 -- 172.21.15.173:0/1176529298 shutdown_connections 2024-04-25T09:12:27.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76ec00640 1 -- 172.21.15.173:0/1176529298 wait complete. 2024-04-25T09:12:27.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76ec00640 1 Processor -- start 2024-04-25T09:12:27.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76ec00640 1 -- start start 2024-04-25T09:12:27.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76ec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe76806bca0 0x7fe768152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76ec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe76806dac0 0x7fe7680adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76ec00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe768160fe0 0x7fe76814a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76ec00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7680ad4c0 con 0x7fe768160fe0 2024-04-25T09:12:27.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76ec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7680ad340 con 0x7fe76806dac0 2024-04-25T09:12:27.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76ec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76806f850 con 0x7fe76806bca0 2024-04-25T09:12:27.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76cc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe768160fe0 0x7fe76814a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76cc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe768160fe0 0x7fe76814a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51962/0 (socket says 172.21.15.173:51962) 2024-04-25T09:12:27.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76cc00640 1 -- 172.21.15.173:0/1666394959 learned_addr learned my addr 172.21.15.173:0/1666394959 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:27.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe767e00640 1 --2- 172.21.15.173:0/1666394959 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe76806bca0 0x7fe768152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe75f400640 1 --2- 172.21.15.173:0/1666394959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe76806dac0 0x7fe7680adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76cc00640 1 -- 172.21.15.173:0/1666394959 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe76806bca0 msgr2=0x7fe768152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76cc00640 1 --2- 172.21.15.173:0/1666394959 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe76806bca0 0x7fe768152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76cc00640 1 -- 172.21.15.173:0/1666394959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe76806dac0 msgr2=0x7fe7680adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76cc00640 1 --2- 172.21.15.173:0/1666394959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe76806dac0 0x7fe7680adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.213+0000 7fe76cc00640 1 -- 172.21.15.173:0/1666394959 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe768152f50 con 0x7fe768160fe0 2024-04-25T09:12:27.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.217+0000 7fe76cc00640 1 --2- 172.21.15.173:0/1666394959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe768160fe0 0x7fe76814a3c0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fe760007e40 tx=0x7fe76000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:27.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.217+0000 7fe764c00640 1 -- 172.21.15.173:0/1666394959 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760014620 con 0x7fe768160fe0 2024-04-25T09:12:27.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.217+0000 7fe764c00640 1 -- 172.21.15.173:0/1666394959 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe760019070 con 0x7fe768160fe0 2024-04-25T09:12:27.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.217+0000 7fe764c00640 1 -- 172.21.15.173:0/1666394959 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760014a20 con 0x7fe768160fe0 2024-04-25T09:12:27.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.217+0000 7fe76ec00640 1 -- 172.21.15.173:0/1666394959 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe768153230 con 0x7fe768160fe0 2024-04-25T09:12:27.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.217+0000 7fe76ec00640 1 -- 172.21.15.173:0/1666394959 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe768135650 con 0x7fe768160fe0 2024-04-25T09:12:27.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.217+0000 7fe76ec00640 1 -- 172.21.15.173:0/1666394959 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe768073a40 con 0x7fe768160fe0 2024-04-25T09:12:27.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.217+0000 7fe764c00640 1 -- 172.21.15.173:0/1666394959 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe760014bc0 con 0x7fe768160fe0 2024-04-25T09:12:27.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.217+0000 7fe764c00640 1 --2- 172.21.15.173:0/1666394959 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe744066f60 0x7fe744069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.217+0000 7fe764c00640 1 -- 172.21.15.173:0/1666394959 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe7600855f0 con 0x7fe768160fe0 2024-04-25T09:12:27.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.217+0000 7fe767e00640 1 --2- 172.21.15.173:0/1666394959 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe744066f60 0x7fe744069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.217+0000 7fe767e00640 1 --2- 172.21.15.173:0/1666394959 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe744066f60 0x7fe744069420 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe758001770 tx=0x7fe758009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:27.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.221+0000 7fe764c00640 1 -- 172.21.15.173:0/1666394959 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe760056110 con 0x7fe768160fe0 2024-04-25T09:12:27.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.377+0000 7fe76ec00640 1 -- 172.21.15.173:0/1666394959 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7680cf6c0 con 0x7fe768160fe0 2024-04-25T09:12:27.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.381+0000 7fe764c00640 1 -- 172.21.15.173:0/1666394959 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+13363 (secure 0 0 0) 0x7fe76005a1b0 con 0x7fe768160fe0 2024-04-25T09:12:27.365 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:27.365 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":125,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:12:26.039303+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:6837/671971539":"2024-04-26T09:12:23.031934+0000","172.21.15.173:6835/671971539":"2024-04-26T09:12:23.031934+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:27.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.381+0000 7fe76ec00640 1 -- 172.21.15.173:0/1666394959 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe744066f60 msgr2=0x7fe744069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.381+0000 7fe76ec00640 1 --2- 172.21.15.173:0/1666394959 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe744066f60 0x7fe744069420 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe758001770 tx=0x7fe758009040 comp rx=0 tx=0).stop 2024-04-25T09:12:27.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.381+0000 7fe76ec00640 1 -- 172.21.15.173:0/1666394959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe768160fe0 msgr2=0x7fe76814a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.381+0000 7fe76ec00640 1 --2- 172.21.15.173:0/1666394959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe768160fe0 0x7fe76814a3c0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fe760007e40 tx=0x7fe76000e4b0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.381+0000 7fe76ec00640 1 -- 172.21.15.173:0/1666394959 shutdown_connections 2024-04-25T09:12:27.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.381+0000 7fe76ec00640 1 --2- 172.21.15.173:0/1666394959 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe744066f60 0x7fe744069420 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.381+0000 7fe76ec00640 1 --2- 172.21.15.173:0/1666394959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe768160fe0 0x7fe76814a3c0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.381+0000 7fe76ec00640 1 --2- 172.21.15.173:0/1666394959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe76806dac0 0x7fe7680adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.381+0000 7fe76ec00640 1 --2- 172.21.15.173:0/1666394959 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe76806bca0 0x7fe768152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.381+0000 7fe76ec00640 1 -- 172.21.15.173:0/1666394959 >> 172.21.15.173:0/1666394959 conn(0x7fe768071c20 msgr2=0x7fe7680ae690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:27.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.381+0000 7fe76ec00640 1 -- 172.21.15.173:0/1666394959 shutdown_connections 2024-04-25T09:12:27.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.381+0000 7fe76ec00640 1 -- 172.21.15.173:0/1666394959 wait complete. 2024-04-25T09:12:27.387 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:12:27.387 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:12:27.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.541+0000 7fa894800640 1 Processor -- start 2024-04-25T09:12:27.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.541+0000 7fa894800640 1 -- start start 2024-04-25T09:12:27.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.541+0000 7fa894800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa88c145290 0x7fa88c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.541+0000 7fa894800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa88c0b3fe0 0x7fa88c0b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.541+0000 7fa894800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88c15c5f0 con 0x7fa88c0cc260 2024-04-25T09:12:27.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.541+0000 7fa894800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88c06d4b0 con 0x7fa88c145290 2024-04-25T09:12:27.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.541+0000 7fa894800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c06d790 con 0x7fa88c0b3fe0 2024-04-25T09:12:27.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.541+0000 7fa891e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa88c145290 0x7fa88c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.541+0000 7fa892800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa88c0cc260 0x7fa88c0cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:59226/0 (socket says 172.21.15.173:59226) 2024-04-25T09:12:27.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.541+0000 7fa891e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa88c145290 0x7fa88c15c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51968/0 (socket says 172.21.15.173:51968) 2024-04-25T09:12:27.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.541+0000 7fa892800640 1 -- 172.21.15.173:0/3389713471 learned_addr learned my addr 172.21.15.173:0/3389713471 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:27.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.541+0000 7fa891400640 1 --2- 172.21.15.173:0/3389713471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa88c0b3fe0 0x7fa88c0b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.541+0000 7fa891e00640 1 -- 172.21.15.173:0/3389713471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa88c0b3fe0 msgr2=0x7fa88c0b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:27.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.541+0000 7fa891e00640 1 --2- 172.21.15.173:0/3389713471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa88c0b3fe0 0x7fa88c0b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.541+0000 7fa891e00640 1 -- 172.21.15.173:0/3389713471 >> v1:172.21.15.173:6789/0 conn(0x7fa88c0cc260 legacy=0x7fa88c0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.541+0000 7fa891e00640 1 -- 172.21.15.173:0/3389713471 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c06da70 con 0x7fa88c145290 2024-04-25T09:12:27.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.541+0000 7fa891400640 1 --2- 172.21.15.173:0/3389713471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa88c0b3fe0 0x7fa88c0b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:27.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.541+0000 7fa890a00640 1 -- 172.21.15.173:0/3389713471 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265984867 0 0) 0x7fa8880014a0 con 0x7fa88c0cc260 2024-04-25T09:12:27.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.545+0000 7fa891e00640 1 --2- 172.21.15.173:0/3389713471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa88c145290 0x7fa88c15c0b0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fa8800097c0 tx=0x7fa88001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f917f51d435ec4ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:27.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.545+0000 7fa890a00640 1 -- 172.21.15.173:0/3389713471 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8800b0070 con 0x7fa88c145290 2024-04-25T09:12:27.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.545+0000 7fa890a00640 1 -- 172.21.15.173:0/3389713471 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8800ab600 con 0x7fa88c145290 2024-04-25T09:12:27.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.545+0000 7fa890a00640 1 -- 172.21.15.173:0/3389713471 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8800ab9d0 con 0x7fa88c145290 2024-04-25T09:12:27.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.545+0000 7fa894800640 1 -- 172.21.15.173:0/3389713471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa88c145290 msgr2=0x7fa88c15c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.545+0000 7fa894800640 1 --2- 172.21.15.173:0/3389713471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa88c145290 0x7fa88c15c0b0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fa8800097c0 tx=0x7fa88001c380 comp rx=0 tx=0).stop 2024-04-25T09:12:27.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.545+0000 7fa894800640 1 -- 172.21.15.173:0/3389713471 shutdown_connections 2024-04-25T09:12:27.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.545+0000 7fa894800640 1 --2- 172.21.15.173:0/3389713471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa88c0b3fe0 0x7fa88c0b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.545+0000 7fa894800640 1 --2- 172.21.15.173:0/3389713471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa88c145290 0x7fa88c15c0b0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.545+0000 7fa894800640 1 -- 172.21.15.173:0/3389713471 >> 172.21.15.173:0/3389713471 conn(0x7fa88c06ac90 msgr2=0x7fa88c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:27.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.545+0000 7fa894800640 1 -- 172.21.15.173:0/3389713471 shutdown_connections 2024-04-25T09:12:27.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.545+0000 7fa894800640 1 -- 172.21.15.173:0/3389713471 wait complete. 2024-04-25T09:12:27.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa894800640 1 Processor -- start 2024-04-25T09:12:27.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa894800640 1 -- start start 2024-04-25T09:12:27.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa894800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa88c0b3fe0 0x7fa88c15a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa894800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa88c0cc260 0x7fa88c13f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa894800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa88c145290 0x7fa88c0ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa894800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c06eee0 con 0x7fa88c0cc260 2024-04-25T09:12:27.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa894800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c06ed60 con 0x7fa88c0b3fe0 2024-04-25T09:12:27.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa894800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c06f060 con 0x7fa88c145290 2024-04-25T09:12:27.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa891400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa88c0cc260 0x7fa88c13f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa891400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa88c0cc260 0x7fa88c13f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51982/0 (socket says 172.21.15.173:51982) 2024-04-25T09:12:27.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa891400640 1 -- 172.21.15.173:0/246020388 learned_addr learned my addr 172.21.15.173:0/246020388 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:27.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa892800640 1 --2- 172.21.15.173:0/246020388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa88c145290 0x7fa88c0ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa891e00640 1 --2- 172.21.15.173:0/246020388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa88c0b3fe0 0x7fa88c15a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa891400640 1 -- 172.21.15.173:0/246020388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa88c145290 msgr2=0x7fa88c0ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa891400640 1 --2- 172.21.15.173:0/246020388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa88c145290 0x7fa88c0ad020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa891400640 1 -- 172.21.15.173:0/246020388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa88c0b3fe0 msgr2=0x7fa88c15a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa891400640 1 --2- 172.21.15.173:0/246020388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa88c0b3fe0 0x7fa88c15a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa891400640 1 -- 172.21.15.173:0/246020388 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c13e160 con 0x7fa88c0cc260 2024-04-25T09:12:27.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa892800640 1 --2- 172.21.15.173:0/246020388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa88c145290 0x7fa88c0ad020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:27.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa891e00640 1 --2- 172.21.15.173:0/246020388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa88c0b3fe0 0x7fa88c15a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:27.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa891400640 1 --2- 172.21.15.173:0/246020388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa88c0cc260 0x7fa88c13f200 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00c7f0 tx=0x7fa87c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:27.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa886000640 1 -- 172.21.15.173:0/246020388 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c015070 con 0x7fa88c0cc260 2024-04-25T09:12:27.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa886000640 1 -- 172.21.15.173:0/246020388 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c007820 con 0x7fa88c0cc260 2024-04-25T09:12:27.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa894800640 1 -- 172.21.15.173:0/246020388 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88c13e440 con 0x7fa88c0cc260 2024-04-25T09:12:27.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa886000640 1 -- 172.21.15.173:0/246020388 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c007c10 con 0x7fa88c0cc260 2024-04-25T09:12:27.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa894800640 1 -- 172.21.15.173:0/246020388 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88c13ea00 con 0x7fa88c0cc260 2024-04-25T09:12:27.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.549+0000 7fa894800640 1 -- 172.21.15.173:0/246020388 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88c073ab0 con 0x7fa88c0cc260 2024-04-25T09:12:27.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.553+0000 7fa886000640 1 -- 172.21.15.173:0/246020388 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa87c018070 con 0x7fa88c0cc260 2024-04-25T09:12:27.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.553+0000 7fa886000640 1 --2- 172.21.15.173:0/246020388 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa870066f90 0x7fa870069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.553+0000 7fa886000640 1 -- 172.21.15.173:0/246020388 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fa87c085090 con 0x7fa88c0cc260 2024-04-25T09:12:27.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.553+0000 7fa891e00640 1 --2- 172.21.15.173:0/246020388 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa870066f90 0x7fa870069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.553+0000 7fa891e00640 1 --2- 172.21.15.173:0/246020388 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa870066f90 0x7fa870069450 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa8800ad000 tx=0x7fa880008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:27.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.557+0000 7fa886000640 1 -- 172.21.15.173:0/246020388 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa87c056170 con 0x7fa88c0cc260 2024-04-25T09:12:27.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.709+0000 7fa894800640 1 -- 172.21.15.173:0/246020388 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa88c0ccbb0 con 0x7fa88c0cc260 2024-04-25T09:12:27.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.709+0000 7fa886000640 1 -- 172.21.15.173:0/246020388 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa87c055a70 con 0x7fa88c0cc260 2024-04-25T09:12:27.696 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:12:27.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.713+0000 7fa894800640 1 -- 172.21.15.173:0/246020388 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa870066f90 msgr2=0x7fa870069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.713+0000 7fa894800640 1 --2- 172.21.15.173:0/246020388 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa870066f90 0x7fa870069450 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa8800ad000 tx=0x7fa880008040 comp rx=0 tx=0).stop 2024-04-25T09:12:27.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.713+0000 7fa894800640 1 -- 172.21.15.173:0/246020388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa88c0cc260 msgr2=0x7fa88c13f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.713+0000 7fa894800640 1 --2- 172.21.15.173:0/246020388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa88c0cc260 0x7fa88c13f200 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00c7f0 tx=0x7fa87c00ccb0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.713+0000 7fa894800640 1 -- 172.21.15.173:0/246020388 shutdown_connections 2024-04-25T09:12:27.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.713+0000 7fa894800640 1 --2- 172.21.15.173:0/246020388 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa870066f90 0x7fa870069450 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.713+0000 7fa894800640 1 --2- 172.21.15.173:0/246020388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa88c145290 0x7fa88c0ad020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.713+0000 7fa894800640 1 --2- 172.21.15.173:0/246020388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa88c0cc260 0x7fa88c13f200 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.713+0000 7fa894800640 1 --2- 172.21.15.173:0/246020388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa88c0b3fe0 0x7fa88c15a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.713+0000 7fa894800640 1 -- 172.21.15.173:0/246020388 >> 172.21.15.173:0/246020388 conn(0x7fa88c06ac90 msgr2=0x7fa88c0cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:27.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.713+0000 7fa894800640 1 -- 172.21.15.173:0/246020388 shutdown_connections 2024-04-25T09:12:27.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.713+0000 7fa894800640 1 -- 172.21.15.173:0/246020388 wait complete. 2024-04-25T09:12:27.717 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-04-25T09:12:27.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.869+0000 7f702cc00640 1 Processor -- start 2024-04-25T09:12:27.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.869+0000 7f702cc00640 1 -- start start 2024-04-25T09:12:27.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.869+0000 7f702cc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f70280cc8b0 0x7f70280ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.869+0000 7f702cc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f70280ce8f0 0x7f70280ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.869+0000 7f702cc00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702806e7c0 con 0x7f7028145250 2024-04-25T09:12:27.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.869+0000 7f702cc00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702806d720 con 0x7f70280cc8b0 2024-04-25T09:12:27.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.869+0000 7f702cc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702806da00 con 0x7f70280ce8f0 2024-04-25T09:12:27.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.869+0000 7f701d400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f70280cc8b0 0x7f70280ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.869+0000 7f7025e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f7028145250 0x7f702815c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:59232/0 (socket says 172.21.15.173:59232) 2024-04-25T09:12:27.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.869+0000 7f7025e00640 1 -- 172.21.15.173:0/1853765015 learned_addr learned my addr 172.21.15.173:0/1853765015 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:27.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.869+0000 7f701d400640 1 -- 172.21.15.173:0/1853765015 >> v2:172.21.15.194:3300/0 conn(0x7f70280ce8f0 msgr2=0x7f70280ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:27.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.869+0000 7f7026800640 1 --2- 172.21.15.173:0/1853765015 >> v2:172.21.15.194:3300/0 conn(0x7f70280ce8f0 0x7f70280ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.869+0000 7f701d400640 1 --2- 172.21.15.173:0/1853765015 >> v2:172.21.15.194:3300/0 conn(0x7f70280ce8f0 0x7f70280ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.869+0000 7f701d400640 1 -- 172.21.15.173:0/1853765015 >> v1:172.21.15.173:6789/0 conn(0x7f7028145250 legacy=0x7f702815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.869+0000 7f701d400640 1 -- 172.21.15.173:0/1853765015 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702806dce0 con 0x7f70280cc8b0 2024-04-25T09:12:27.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.869+0000 7f7026800640 1 --2- 172.21.15.173:0/1853765015 >> v2:172.21.15.194:3300/0 conn(0x7f70280ce8f0 0x7f70280ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:27.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.869+0000 7f7025400640 1 -- 172.21.15.173:0/1853765015 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44289474 0 0) 0x7f702806e7c0 con 0x7f7028145250 2024-04-25T09:12:27.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.873+0000 7f701d400640 1 --2- 172.21.15.173:0/1853765015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70280cc8b0 0x7f70280ccd30 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f702806f4a0 tx=0x7f701001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9830794b4c1719fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:27.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.873+0000 7f7025400640 1 -- 172.21.15.173:0/1853765015 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70100b2070 con 0x7f70280cc8b0 2024-04-25T09:12:27.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.873+0000 7f7025400640 1 -- 172.21.15.173:0/1853765015 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70100a58e0 con 0x7f70280cc8b0 2024-04-25T09:12:27.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.873+0000 7f7025400640 1 -- 172.21.15.173:0/1853765015 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70100a5cb0 con 0x7f70280cc8b0 2024-04-25T09:12:27.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.873+0000 7f702cc00640 1 -- 172.21.15.173:0/1853765015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70280cc8b0 msgr2=0x7f70280ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.873+0000 7f702cc00640 1 --2- 172.21.15.173:0/1853765015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70280cc8b0 0x7f70280ccd30 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f702806f4a0 tx=0x7f701001c930 comp rx=0 tx=0).stop 2024-04-25T09:12:27.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.873+0000 7f702cc00640 1 -- 172.21.15.173:0/1853765015 shutdown_connections 2024-04-25T09:12:27.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.873+0000 7f702cc00640 1 --2- 172.21.15.173:0/1853765015 >> v2:172.21.15.194:3300/0 conn(0x7f70280ce8f0 0x7f70280ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.873+0000 7f702cc00640 1 --2- 172.21.15.173:0/1853765015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70280cc8b0 0x7f70280ccd30 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.873+0000 7f702cc00640 1 -- 172.21.15.173:0/1853765015 >> 172.21.15.173:0/1853765015 conn(0x7f702806ac90 msgr2=0x7f702806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:27.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.873+0000 7f702cc00640 1 -- 172.21.15.173:0/1853765015 shutdown_connections 2024-04-25T09:12:27.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.873+0000 7f702cc00640 1 -- 172.21.15.173:0/1853765015 wait complete. 2024-04-25T09:12:27.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f702cc00640 1 Processor -- start 2024-04-25T09:12:27.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f702cc00640 1 -- start start 2024-04-25T09:12:27.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f702cc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70280cc8b0 0x7f70280b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f702cc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70280ce8f0 0x7f7028142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f702cc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7028145250 0x7f702813e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f702cc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702806d380 con 0x7f70280ce8f0 2024-04-25T09:12:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f702cc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702806ef80 con 0x7f7028145250 2024-04-25T09:12:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f702cc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702806d500 con 0x7f70280cc8b0 2024-04-25T09:12:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f701d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70280ce8f0 0x7f7028142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f701d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70280ce8f0 0x7f7028142580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51996/0 (socket says 172.21.15.173:51996) 2024-04-25T09:12:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f701d400640 1 -- 172.21.15.173:0/546699366 learned_addr learned my addr 172.21.15.173:0/546699366 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f7025e00640 1 --2- 172.21.15.173:0/546699366 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70280cc8b0 0x7f70280b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f7026800640 1 --2- 172.21.15.173:0/546699366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7028145250 0x7f702813e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f701d400640 1 -- 172.21.15.173:0/546699366 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70280cc8b0 msgr2=0x7f70280b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f701d400640 1 --2- 172.21.15.173:0/546699366 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70280cc8b0 0x7f70280b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f701d400640 1 -- 172.21.15.173:0/546699366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7028145250 msgr2=0x7f702813e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f701d400640 1 --2- 172.21.15.173:0/546699366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7028145250 0x7f702813e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f701d400640 1 -- 172.21.15.173:0/546699366 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702813f9d0 con 0x7f70280ce8f0 2024-04-25T09:12:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f701d400640 1 --2- 172.21.15.173:0/546699366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70280ce8f0 0x7f7028142580 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f70100b0040 tx=0x7f70100196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f701ea00640 1 -- 172.21.15.173:0/546699366 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70100b2050 con 0x7f70280ce8f0 2024-04-25T09:12:27.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f701ea00640 1 -- 172.21.15.173:0/546699366 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70100b3040 con 0x7f70280ce8f0 2024-04-25T09:12:27.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f701ea00640 1 -- 172.21.15.173:0/546699366 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70100ad910 con 0x7f70280ce8f0 2024-04-25T09:12:27.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f702cc00640 1 -- 172.21.15.173:0/546699366 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70280c5820 con 0x7f70280ce8f0 2024-04-25T09:12:27.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.877+0000 7f702cc00640 1 -- 172.21.15.173:0/546699366 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702813f6f0 con 0x7f70280ce8f0 2024-04-25T09:12:27.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.881+0000 7f702cc00640 1 -- 172.21.15.173:0/546699366 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7028073a40 con 0x7f70280ce8f0 2024-04-25T09:12:27.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.881+0000 7f701ea00640 1 -- 172.21.15.173:0/546699366 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f70100c0020 con 0x7f70280ce8f0 2024-04-25T09:12:27.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.881+0000 7f701ea00640 1 --2- 172.21.15.173:0/546699366 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7004066f60 0x7f7004069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.881+0000 7f701ea00640 1 -- 172.21.15.173:0/546699366 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f701011f9e0 con 0x7f70280ce8f0 2024-04-25T09:12:27.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.881+0000 7f7025e00640 1 --2- 172.21.15.173:0/546699366 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7004066f60 0x7f7004069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.881+0000 7f7025e00640 1 --2- 172.21.15.173:0/546699366 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7004066f60 0x7f7004069420 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7018000f70 tx=0x7f7018007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:27.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:27.885+0000 7f701ea00640 1 -- 172.21.15.173:0/546699366 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7010016520 con 0x7f70280ce8f0 2024-04-25T09:12:28.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:28.097+0000 7f702cc00640 1 -- 172.21.15.173:0/546699366 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) v1 -- 0x7f7028144150 con 0x7f70280ce8f0 2024-04-25T09:12:29.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.053+0000 7f701ea00640 1 -- 172.21.15.173:0/546699366 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v466) v1 ==== 169+0+0 (secure 0 0 0) 0x7f70100f0be0 con 0x7f70280ce8f0 2024-04-25T09:12:29.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.057+0000 7f702cc00640 1 -- 172.21.15.173:0/546699366 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7004066f60 msgr2=0x7f7004069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.057+0000 7f702cc00640 1 --2- 172.21.15.173:0/546699366 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7004066f60 0x7f7004069420 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7018000f70 tx=0x7f7018007b60 comp rx=0 tx=0).stop 2024-04-25T09:12:29.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.057+0000 7f702cc00640 1 -- 172.21.15.173:0/546699366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70280ce8f0 msgr2=0x7f7028142580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.057+0000 7f702cc00640 1 --2- 172.21.15.173:0/546699366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70280ce8f0 0x7f7028142580 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f70100b0040 tx=0x7f70100196d0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.057+0000 7f702cc00640 1 -- 172.21.15.173:0/546699366 shutdown_connections 2024-04-25T09:12:29.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.057+0000 7f702cc00640 1 --2- 172.21.15.173:0/546699366 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7004066f60 0x7f7004069420 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.057+0000 7f702cc00640 1 --2- 172.21.15.173:0/546699366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7028145250 0x7f702813e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.057+0000 7f702cc00640 1 --2- 172.21.15.173:0/546699366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70280ce8f0 0x7f7028142580 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.057+0000 7f702cc00640 1 --2- 172.21.15.173:0/546699366 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70280cc8b0 0x7f70280b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.057+0000 7f702cc00640 1 -- 172.21.15.173:0/546699366 >> 172.21.15.173:0/546699366 conn(0x7f702806ac90 msgr2=0x7f702815e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:29.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.057+0000 7f702cc00640 1 -- 172.21.15.173:0/546699366 shutdown_connections 2024-04-25T09:12:29.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.057+0000 7f702cc00640 1 -- 172.21.15.173:0/546699366 wait complete. 2024-04-25T09:12:29.066 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:12:29.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.225+0000 7f15f5000640 1 Processor -- start 2024-04-25T09:12:29.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.225+0000 7f15f5000640 1 -- start start 2024-04-25T09:12:29.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.225+0000 7f15f5000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f15f00d02a0 0x7f15f0099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.225+0000 7f15f5000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f00cc7a0 con 0x7f15f0099f90 2024-04-25T09:12:29.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.225+0000 7f15f5000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f00cca80 con 0x7f15f015bab0 2024-04-25T09:12:29.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.225+0000 7f15f5000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f00ccd60 con 0x7f15f00d02a0 2024-04-25T09:12:29.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.225+0000 7f15ed400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f15f00d02a0 0x7f15f0099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.225+0000 7f15ed400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f15f00d02a0 0x7f15f0099a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51998/0 (socket says 172.21.15.173:51998) 2024-04-25T09:12:29.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.225+0000 7f15ed400640 1 -- 172.21.15.173:0/186843149 learned_addr learned my addr 172.21.15.173:0/186843149 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:29.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.225+0000 7f15ee800640 1 --1- 172.21.15.173:0/186843149 >> v1:172.21.15.173:6789/0 conn(0x7f15f0099f90 0x7f15f00c5300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:59248/0 (socket says 172.21.15.173:59248) 2024-04-25T09:12:29.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.225+0000 7f15ed400640 1 -- 172.21.15.173:0/186843149 >> v1:172.21.15.194:6789/0 conn(0x7f15f015bab0 legacy=0x7f15f00cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.225+0000 7f15ed400640 1 -- 172.21.15.173:0/186843149 >> v1:172.21.15.173:6789/0 conn(0x7f15f0099f90 legacy=0x7f15f00c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.225+0000 7f15ed400640 1 -- 172.21.15.173:0/186843149 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f00cd040 con 0x7f15f00d02a0 2024-04-25T09:12:29.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.229+0000 7f15ed400640 1 --2- 172.21.15.173:0/186843149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15f00d02a0 0x7f15f0099a50 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009870 tx=0x7f15dc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbdc50400ae5a0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:29.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.229+0000 7f15eca00640 1 -- 172.21.15.173:0/186843149 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc0a7070 con 0x7f15f00d02a0 2024-04-25T09:12:29.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.229+0000 7f15eca00640 1 -- 172.21.15.173:0/186843149 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc0b0070 con 0x7f15f00d02a0 2024-04-25T09:12:29.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.229+0000 7f15eca00640 1 -- 172.21.15.173:0/186843149 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc0ab890 con 0x7f15f00d02a0 2024-04-25T09:12:29.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.229+0000 7f15f5000640 1 -- 172.21.15.173:0/186843149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15f00d02a0 msgr2=0x7f15f0099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.229+0000 7f15f5000640 1 --2- 172.21.15.173:0/186843149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15f00d02a0 0x7f15f0099a50 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009870 tx=0x7f15dc01c560 comp rx=0 tx=0).stop 2024-04-25T09:12:29.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.229+0000 7f15f5000640 1 -- 172.21.15.173:0/186843149 shutdown_connections 2024-04-25T09:12:29.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.229+0000 7f15f5000640 1 --2- 172.21.15.173:0/186843149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15f00d02a0 0x7f15f0099a50 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.229+0000 7f15f5000640 1 -- 172.21.15.173:0/186843149 >> 172.21.15.173:0/186843149 conn(0x7f15f00b32a0 msgr2=0x7f15f00b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:29.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.229+0000 7f15f5000640 1 -- 172.21.15.173:0/186843149 shutdown_connections 2024-04-25T09:12:29.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.229+0000 7f15f5000640 1 -- 172.21.15.173:0/186843149 wait complete. 2024-04-25T09:12:29.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15f5000640 1 Processor -- start 2024-04-25T09:12:29.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15f5000640 1 -- start start 2024-04-25T09:12:29.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15f5000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15f0099f90 0x7f15f01541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15f5000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f00d02a0 0x7f15f01fac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15f5000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f015bab0 0x7f15f01fb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15f5000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f015c010 con 0x7f15f0099f90 2024-04-25T09:12:29.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15f5000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f015be90 con 0x7f15f015bab0 2024-04-25T09:12:29.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15f5000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00cc3c0 con 0x7f15f00d02a0 2024-04-25T09:12:29.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15ede00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15f0099f90 0x7f15f01541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15ede00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15f0099f90 0x7f15f01541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52004/0 (socket says 172.21.15.173:52004) 2024-04-25T09:12:29.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15ede00640 1 -- 172.21.15.173:0/2767825009 learned_addr learned my addr 172.21.15.173:0/2767825009 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:29.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15ee800640 1 --2- 172.21.15.173:0/2767825009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f015bab0 0x7f15f01fb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15ed400640 1 --2- 172.21.15.173:0/2767825009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f00d02a0 0x7f15f01fac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15ede00640 1 -- 172.21.15.173:0/2767825009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f00d02a0 msgr2=0x7f15f01fac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15ede00640 1 --2- 172.21.15.173:0/2767825009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f00d02a0 0x7f15f01fac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15ede00640 1 -- 172.21.15.173:0/2767825009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f015bab0 msgr2=0x7f15f01fb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15ede00640 1 --2- 172.21.15.173:0/2767825009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f015bab0 0x7f15f01fb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15ede00640 1 -- 172.21.15.173:0/2767825009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f01fbab0 con 0x7f15f0099f90 2024-04-25T09:12:29.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15ed400640 1 --2- 172.21.15.173:0/2767825009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f00d02a0 0x7f15f01fac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:29.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15ede00640 1 --2- 172.21.15.173:0/2767825009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15f0099f90 0x7f15f01541e0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f15e000c450 tx=0x7f15e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:29.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15e6000640 1 -- 172.21.15.173:0/2767825009 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e0016020 con 0x7f15f0099f90 2024-04-25T09:12:29.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15e6000640 1 -- 172.21.15.173:0/2767825009 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e00052d0 con 0x7f15f0099f90 2024-04-25T09:12:29.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15f5000640 1 -- 172.21.15.173:0/2767825009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f0158bb0 con 0x7f15f0099f90 2024-04-25T09:12:29.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15e6000640 1 -- 172.21.15.173:0/2767825009 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e0007260 con 0x7f15f0099f90 2024-04-25T09:12:29.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15f5000640 1 -- 172.21.15.173:0/2767825009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f0159170 con 0x7f15f0099f90 2024-04-25T09:12:29.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.233+0000 7f15f5000640 1 -- 172.21.15.173:0/2767825009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f0073ab0 con 0x7f15f0099f90 2024-04-25T09:12:29.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.237+0000 7f15e6000640 1 -- 172.21.15.173:0/2767825009 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f15e0007400 con 0x7f15f0099f90 2024-04-25T09:12:29.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.237+0000 7f15e6000640 1 --2- 172.21.15.173:0/2767825009 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f15d0066f90 0x7f15d0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.237+0000 7f15e6000640 1 -- 172.21.15.173:0/2767825009 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f15e0084720 con 0x7f15f0099f90 2024-04-25T09:12:29.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.237+0000 7f15ed400640 1 --2- 172.21.15.173:0/2767825009 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f15d0066f90 0x7f15d0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.237+0000 7f15ed400640 1 --2- 172.21.15.173:0/2767825009 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f15d0066f90 0x7f15d0069450 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0af000 tx=0x7f15dc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:29.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.241+0000 7f15e6000640 1 -- 172.21.15.173:0/2767825009 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f15e0020020 con 0x7f15f0099f90 2024-04-25T09:12:29.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.397+0000 7f15f5000640 1 -- 172.21.15.173:0/2767825009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f15f015f400 con 0x7f15f0099f90 2024-04-25T09:12:29.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.401+0000 7f15e6000640 1 -- 172.21.15.173:0/2767825009 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f15e0005480 con 0x7f15f0099f90 2024-04-25T09:12:29.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.401+0000 7f15f5000640 1 -- 172.21.15.173:0/2767825009 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f15d0066f90 msgr2=0x7f15d0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.401+0000 7f15f5000640 1 --2- 172.21.15.173:0/2767825009 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f15d0066f90 0x7f15d0069450 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0af000 tx=0x7f15dc0a7000 comp rx=0 tx=0).stop 2024-04-25T09:12:29.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.401+0000 7f15f5000640 1 -- 172.21.15.173:0/2767825009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15f0099f90 msgr2=0x7f15f01541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.401+0000 7f15f5000640 1 --2- 172.21.15.173:0/2767825009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15f0099f90 0x7f15f01541e0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f15e000c450 tx=0x7f15e000c910 comp rx=0 tx=0).stop 2024-04-25T09:12:29.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.401+0000 7f15f5000640 1 -- 172.21.15.173:0/2767825009 shutdown_connections 2024-04-25T09:12:29.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.401+0000 7f15f5000640 1 --2- 172.21.15.173:0/2767825009 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f15d0066f90 0x7f15d0069450 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.401+0000 7f15f5000640 1 --2- 172.21.15.173:0/2767825009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f015bab0 0x7f15f01fb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.401+0000 7f15f5000640 1 --2- 172.21.15.173:0/2767825009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f00d02a0 0x7f15f01fac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.401+0000 7f15f5000640 1 --2- 172.21.15.173:0/2767825009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15f0099f90 0x7f15f01541e0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.401+0000 7f15f5000640 1 -- 172.21.15.173:0/2767825009 >> 172.21.15.173:0/2767825009 conn(0x7f15f00b32a0 msgr2=0x7f15f0166fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:29.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.401+0000 7f15f5000640 1 -- 172.21.15.173:0/2767825009 shutdown_connections 2024-04-25T09:12:29.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.401+0000 7f15f5000640 1 -- 172.21.15.173:0/2767825009 wait complete. 2024-04-25T09:12:29.406 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:12:29.406 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:12:29.507 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:12:29.601 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:12:29.601 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:12:29.601 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:29.610 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:12:29.610 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:12:29.610 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:29.619 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:12:29.620 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:12:29.620 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:29.664 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:12:29.664 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:12:29.664 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:29.673 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:12:29.673 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:12:29.674 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:29.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.861+0000 7f2d9d200640 1 Processor -- start 2024-04-25T09:12:29.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.861+0000 7f2d9d200640 1 -- start start 2024-04-25T09:12:29.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d9d200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2d980ccd30 0x7f2d980cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d9d200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9806e7c0 con 0x7f2d98145250 2024-04-25T09:12:29.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d9d200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9806d720 con 0x7f2d980cc8b0 2024-04-25T09:12:29.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d9d200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9806da00 con 0x7f2d980ccd30 2024-04-25T09:12:29.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f2d98145250 0x7f2d9815c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:59260/0 (socket says 172.21.15.173:59260) 2024-04-25T09:12:29.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95e00640 1 -- 172.21.15.173:0/1769406610 learned_addr learned my addr 172.21.15.173:0/1769406610 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:29.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d96800640 1 --2- 172.21.15.173:0/1769406610 >> v2:172.21.15.194:3300/0 conn(0x7f2d980ccd30 0x7f2d980cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95400640 1 -- 172.21.15.173:0/1769406610 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914414645 0 0) 0x7f2d9806e7c0 con 0x7f2d98145250 2024-04-25T09:12:29.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95400640 1 -- 172.21.15.173:0/1769406610 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d7c003530 con 0x7f2d98145250 2024-04-25T09:12:29.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95400640 1 -- 172.21.15.173:0/1769406610 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1384050440 0 0) 0x7f2d7c003530 con 0x7f2d98145250 2024-04-25T09:12:29.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95400640 1 -- 172.21.15.173:0/1769406610 >> v2:172.21.15.194:3300/0 conn(0x7f2d980ccd30 msgr2=0x7f2d980cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:29.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95400640 1 --2- 172.21.15.173:0/1769406610 >> v2:172.21.15.194:3300/0 conn(0x7f2d980ccd30 0x7f2d980cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95400640 1 -- 172.21.15.173:0/1769406610 >> v1:172.21.15.194:6789/0 conn(0x7f2d980cc8b0 legacy=0x7f2d980ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95400640 1 -- 172.21.15.173:0/1769406610 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9806dce0 con 0x7f2d98145250 2024-04-25T09:12:29.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95400640 1 -- 172.21.15.173:0/1769406610 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f2d88001680 con 0x7f2d98145250 2024-04-25T09:12:29.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95400640 1 -- 172.21.15.173:0/1769406610 >> v1:172.21.15.173:6789/0 conn(0x7f2d98145250 legacy=0x7f2d9815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95400640 1 --2- 172.21.15.173:0/1769406610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d7c003a10 0x7f2d7c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95400640 1 --2- 172.21.15.173:0/1769406610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7c004810 0x7f2d7c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95400640 1 --2- 172.21.15.173:0/1769406610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d7c0051d0 0x7f2d7c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95400640 1 -- 172.21.15.173:0/1769406610 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9806da00 con 0x7f2d7c003a10 2024-04-25T09:12:29.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95400640 1 -- 172.21.15.173:0/1769406610 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c00c0d0 con 0x7f2d7c004810 2024-04-25T09:12:29.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95400640 1 -- 172.21.15.173:0/1769406610 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c00c2d0 con 0x7f2d7c0051d0 2024-04-25T09:12:29.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95e00640 1 --2- 172.21.15.173:0/1769406610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d7c003a10 0x7f2d7c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d8d400640 1 --2- 172.21.15.173:0/1769406610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7c004810 0x7f2d7c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d96800640 1 --2- 172.21.15.173:0/1769406610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d7c0051d0 0x7f2d7c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95e00640 1 -- 172.21.15.173:0/1769406610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d7c0051d0 msgr2=0x7f2d7c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:29.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95e00640 1 --2- 172.21.15.173:0/1769406610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d7c0051d0 0x7f2d7c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95e00640 1 -- 172.21.15.173:0/1769406610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7c004810 msgr2=0x7f2d7c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:29.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95e00640 1 --2- 172.21.15.173:0/1769406610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7c004810 0x7f2d7c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d95e00640 1 -- 172.21.15.173:0/1769406610 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c003530 con 0x7f2d7c003a10 2024-04-25T09:12:29.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.865+0000 7f2d96800640 1 -- 172.21.15.173:0/1769406610 reap_dead start 2024-04-25T09:12:29.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.869+0000 7f2d95e00640 1 --2- 172.21.15.173:0/1769406610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d7c003a10 0x7f2d7c003e30 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800c110 tx=0x7f2d8801caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258895f83e39eb7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:29.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.869+0000 7f2d95400640 1 -- 172.21.15.173:0/1769406610 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d88007c30 con 0x7f2d7c003a10 2024-04-25T09:12:29.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.869+0000 7f2d95400640 1 -- 172.21.15.173:0/1769406610 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d880a9020 con 0x7f2d7c003a10 2024-04-25T09:12:29.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.869+0000 7f2d95400640 1 -- 172.21.15.173:0/1769406610 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d88005ae0 con 0x7f2d7c003a10 2024-04-25T09:12:29.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.869+0000 7f2d9d200640 1 -- 172.21.15.173:0/1769406610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d7c003a10 msgr2=0x7f2d7c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.869+0000 7f2d9d200640 1 --2- 172.21.15.173:0/1769406610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d7c003a10 0x7f2d7c003e30 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800c110 tx=0x7f2d8801caf0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.869+0000 7f2d9d200640 1 -- 172.21.15.173:0/1769406610 shutdown_connections 2024-04-25T09:12:29.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.869+0000 7f2d9d200640 1 --2- 172.21.15.173:0/1769406610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d7c003a10 0x7f2d7c003e30 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.869+0000 7f2d9d200640 1 -- 172.21.15.173:0/1769406610 >> 172.21.15.173:0/1769406610 conn(0x7f2d9806ac90 msgr2=0x7f2d9806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:29.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.869+0000 7f2d9d200640 1 -- 172.21.15.173:0/1769406610 shutdown_connections 2024-04-25T09:12:29.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.869+0000 7f2d9d200640 1 -- 172.21.15.173:0/1769406610 wait complete. 2024-04-25T09:12:29.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.869+0000 7f2d9d200640 1 Processor -- start 2024-04-25T09:12:29.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d9d200640 1 -- start start 2024-04-25T09:12:29.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d9d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7c003a10 0x7f2d981431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d9d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d980b2870 0x7f2d980b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d9d200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d980c7760 0x7f2d980c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d9d200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9806ef80 con 0x7f2d980b2870 2024-04-25T09:12:29.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d9d200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d98145630 con 0x7f2d7c003a10 2024-04-25T09:12:29.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d9d200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980cd140 con 0x7f2d980c7760 2024-04-25T09:12:29.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d8d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d980b2870 0x7f2d980b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d8d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d980b2870 0x7f2d980b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52022/0 (socket says 172.21.15.173:52022) 2024-04-25T09:12:29.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d8d400640 1 -- 172.21.15.173:0/2430652684 learned_addr learned my addr 172.21.15.173:0/2430652684 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:29.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d95e00640 1 --2- 172.21.15.173:0/2430652684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7c003a10 0x7f2d981431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d96800640 1 --2- 172.21.15.173:0/2430652684 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d980c7760 0x7f2d980c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d8d400640 1 -- 172.21.15.173:0/2430652684 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d980c7760 msgr2=0x7f2d980c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d8d400640 1 --2- 172.21.15.173:0/2430652684 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d980c7760 0x7f2d980c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d8d400640 1 -- 172.21.15.173:0/2430652684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7c003a10 msgr2=0x7f2d981431a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d8d400640 1 --2- 172.21.15.173:0/2430652684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7c003a10 0x7f2d981431a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d8d400640 1 -- 172.21.15.173:0/2430652684 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d981f66b0 con 0x7f2d980b2870 2024-04-25T09:12:29.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d8d400640 1 --2- 172.21.15.173:0/2430652684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d980b2870 0x7f2d980b2cf0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000e410 tx=0x7f2d8000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:29.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d8ea00640 1 -- 172.21.15.173:0/2430652684 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80019070 con 0x7f2d980b2870 2024-04-25T09:12:29.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d8ea00640 1 -- 172.21.15.173:0/2430652684 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d800052e0 con 0x7f2d980b2870 2024-04-25T09:12:29.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d8ea00640 1 -- 172.21.15.173:0/2430652684 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80003820 con 0x7f2d980b2870 2024-04-25T09:12:29.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d9d200640 1 -- 172.21.15.173:0/2430652684 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d980c8120 con 0x7f2d980b2870 2024-04-25T09:12:29.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d9d200640 1 -- 172.21.15.173:0/2430652684 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d980b3730 con 0x7f2d980b2870 2024-04-25T09:12:29.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.873+0000 7f2d9d200640 1 -- 172.21.15.173:0/2430652684 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d98073a40 con 0x7f2d980b2870 2024-04-25T09:12:29.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.877+0000 7f2d8ea00640 1 -- 172.21.15.173:0/2430652684 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2d8001c070 con 0x7f2d980b2870 2024-04-25T09:12:29.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.877+0000 7f2d8ea00640 1 --2- 172.21.15.173:0/2430652684 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2d74066f60 0x7f2d74069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.877+0000 7f2d8ea00640 1 -- 172.21.15.173:0/2430652684 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f2d80084420 con 0x7f2d980b2870 2024-04-25T09:12:29.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.877+0000 7f2d95e00640 1 --2- 172.21.15.173:0/2430652684 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2d74066f60 0x7f2d74069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.877+0000 7f2d95e00640 1 --2- 172.21.15.173:0/2430652684 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2d74066f60 0x7f2d74069420 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2d880aa000 tx=0x7f2d9815bf00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:29.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:29.881+0000 7f2d8ea00640 1 -- 172.21.15.173:0/2430652684 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2d980c8120 con 0x7f2d980b2870 2024-04-25T09:12:30.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.065+0000 7f2d9d200640 1 -- 172.21.15.173:0/2430652684 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d980cbf10 con 0x7f2d980b2870 2024-04-25T09:12:30.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.065+0000 7f2d8ea00640 1 -- 172.21.15.173:0/2430652684 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f2d981f66b0 con 0x7f2d980b2870 2024-04-25T09:12:30.053 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:30.053 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":83,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1021410995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1021410995},{"type":"v1","addr":"172.21.15.194:6834","nonce":1021410995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2198134208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2198134208},{"type":"v1","addr":"172.21.15.194:6835","nonce":2198134208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76},{"gid":8772,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/684989574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":684989574},{"type":"v1","addr":"172.21.15.173:6836","nonce":684989574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":75},{"gid":9318,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/493184142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":493184142},{"type":"v1","addr":"172.21.15.173:6837","nonce":493184142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[]} 2024-04-25T09:12:30.053 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 83 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.069+0000 7f2d9d200640 1 -- 172.21.15.173:0/2430652684 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2d74066f60 msgr2=0x7f2d74069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.069+0000 7f2d9d200640 1 --2- 172.21.15.173:0/2430652684 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2d74066f60 0x7f2d74069420 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2d880aa000 tx=0x7f2d9815bf00 comp rx=0 tx=0).stop 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.069+0000 7f2d9d200640 1 -- 172.21.15.173:0/2430652684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d980b2870 msgr2=0x7f2d980b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.069+0000 7f2d9d200640 1 --2- 172.21.15.173:0/2430652684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d980b2870 0x7f2d980b2cf0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000e410 tx=0x7f2d8000e8d0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.069+0000 7f2d9d200640 1 -- 172.21.15.173:0/2430652684 shutdown_connections 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.069+0000 7f2d9d200640 1 --2- 172.21.15.173:0/2430652684 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2d74066f60 0x7f2d74069420 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.069+0000 7f2d9d200640 1 --2- 172.21.15.173:0/2430652684 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d980c7760 0x7f2d980c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.069+0000 7f2d9d200640 1 --2- 172.21.15.173:0/2430652684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d980b2870 0x7f2d980b2cf0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.069+0000 7f2d9d200640 1 --2- 172.21.15.173:0/2430652684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7c003a10 0x7f2d981431a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.069+0000 7f2d9d200640 1 -- 172.21.15.173:0/2430652684 >> 172.21.15.173:0/2430652684 conn(0x7f2d9806ac90 msgr2=0x7f2d980b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.069+0000 7f2d9d200640 1 -- 172.21.15.173:0/2430652684 shutdown_connections 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.069+0000 7f2d9d200640 1 -- 172.21.15.173:0/2430652684 wait complete. 2024-04-25T09:12:30.074 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:12:30.074 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:12:30.074 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:12:30.075 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:30.075 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:12:30.075 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:12:30.075 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:12:30.075 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:30.075 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:12:30.075 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:12:30.075 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:12:30.075 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:30.076 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:12:30.076 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:12:30.076 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:12:30.076 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:30.086 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:12:30.087 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:12:30.088 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:12:30.088 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:12:30.089 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:12:30.089 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:12:30.090 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:12:30.090 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:12:30.136 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:12:30.136 DEBUG:teuthology.parallel:result is None 2024-04-25T09:12:30.138 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:12:30.138 DEBUG:teuthology.parallel:result is None 2024-04-25T09:12:30.138 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:12:30.139 DEBUG:teuthology.parallel:result is None 2024-04-25T09:12:30.139 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:12:30.139 DEBUG:teuthology.parallel:result is None 2024-04-25T09:12:30.140 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:12:30.221 INFO:tasks.ceph.mds.c.smithi173.stdout:starting mds.c at 2024-04-25T09:12:30.223 INFO:tasks.ceph.mds.a.smithi173.stdout:starting mds.a at 2024-04-25T09:12:30.228 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-04-25T09:12:30.230 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-04-25T09:12:30.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.297+0000 7fbc1d600640 1 Processor -- start 2024-04-25T09:12:30.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.297+0000 7fbc1d600640 1 -- start start 2024-04-25T09:12:30.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.297+0000 7fbc1d600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbc18145290 0x7fbc1815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.297+0000 7fbc1d600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbc180cc260 0x7fbc180cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.297+0000 7fbc1d600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc1815c5f0 con 0x7fbc180b3fe0 2024-04-25T09:12:30.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.297+0000 7fbc1d600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc1806d4b0 con 0x7fbc18145290 2024-04-25T09:12:30.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.297+0000 7fbc1d600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc1806d790 con 0x7fbc180cc260 2024-04-25T09:12:30.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.297+0000 7fbc16a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbc18145290 0x7fbc1815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.297+0000 7fbc16a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbc18145290 0x7fbc1815c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52048/0 (socket says 172.21.15.173:52048) 2024-04-25T09:12:30.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.297+0000 7fbc16a00640 1 -- 172.21.15.173:0/4083124305 learned_addr learned my addr 172.21.15.173:0/4083124305 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:30.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.297+0000 7fbc17400640 1 --2- 172.21.15.173:0/4083124305 >> v2:172.21.15.194:3300/0 conn(0x7fbc180cc260 0x7fbc180cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.301+0000 7fbc16a00640 1 -- 172.21.15.173:0/4083124305 >> v2:172.21.15.194:3300/0 conn(0x7fbc180cc260 msgr2=0x7fbc180cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:30.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.301+0000 7fbc16a00640 1 --2- 172.21.15.173:0/4083124305 >> v2:172.21.15.194:3300/0 conn(0x7fbc180cc260 0x7fbc180cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.301+0000 7fbc16a00640 1 -- 172.21.15.173:0/4083124305 >> v1:172.21.15.194:6789/0 conn(0x7fbc180b3fe0 legacy=0x7fbc180b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.301+0000 7fbc16a00640 1 -- 172.21.15.173:0/4083124305 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1806da70 con 0x7fbc18145290 2024-04-25T09:12:30.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.301+0000 7fbc16a00640 1 --2- 172.21.15.173:0/4083124305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc18145290 0x7fbc1815c0b0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fbc1815f5b0 tx=0x7fbc0801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170c5385f84e1007 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:30.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.301+0000 7fbc16000640 1 -- 172.21.15.173:0/4083124305 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc080b1070 con 0x7fbc18145290 2024-04-25T09:12:30.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.301+0000 7fbc16000640 1 -- 172.21.15.173:0/4083124305 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc080ac640 con 0x7fbc18145290 2024-04-25T09:12:30.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.301+0000 7fbc16000640 1 -- 172.21.15.173:0/4083124305 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc080aca10 con 0x7fbc18145290 2024-04-25T09:12:30.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc1d600640 1 -- 172.21.15.173:0/4083124305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc18145290 msgr2=0x7fbc1815c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc1d600640 1 --2- 172.21.15.173:0/4083124305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc18145290 0x7fbc1815c0b0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fbc1815f5b0 tx=0x7fbc0801c400 comp rx=0 tx=0).stop 2024-04-25T09:12:30.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc1d600640 1 -- 172.21.15.173:0/4083124305 shutdown_connections 2024-04-25T09:12:30.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc1d600640 1 --2- 172.21.15.173:0/4083124305 >> v2:172.21.15.194:3300/0 conn(0x7fbc180cc260 0x7fbc180cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc1d600640 1 --2- 172.21.15.173:0/4083124305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc18145290 0x7fbc1815c0b0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc1d600640 1 -- 172.21.15.173:0/4083124305 >> 172.21.15.173:0/4083124305 conn(0x7fbc1806ac90 msgr2=0x7fbc1806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:30.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc1d600640 1 -- 172.21.15.173:0/4083124305 shutdown_connections 2024-04-25T09:12:30.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc1d600640 1 -- 172.21.15.173:0/4083124305 wait complete. 2024-04-25T09:12:30.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc1d600640 1 Processor -- start 2024-04-25T09:12:30.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc1d600640 1 -- start start 2024-04-25T09:12:30.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc1d600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc180b3fe0 0x7fbc18141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc1d600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc180cc260 0x7fbc180b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc1d600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc18145290 0x7fbc18142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc1d600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1806eee0 con 0x7fbc18145290 2024-04-25T09:12:30.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc1d600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1806ed60 con 0x7fbc180b3fe0 2024-04-25T09:12:30.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc1d600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1806f060 con 0x7fbc180cc260 2024-04-25T09:12:30.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc17400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc18145290 0x7fbc18142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc17400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc18145290 0x7fbc18142d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52062/0 (socket says 172.21.15.173:52062) 2024-04-25T09:12:30.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc17400640 1 -- 172.21.15.173:0/4192341127 learned_addr learned my addr 172.21.15.173:0/4192341127 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:30.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc0fe00640 1 --2- 172.21.15.173:0/4192341127 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc180cc260 0x7fbc180b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc16a00640 1 --2- 172.21.15.173:0/4192341127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc180b3fe0 0x7fbc18141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc17400640 1 -- 172.21.15.173:0/4192341127 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc180cc260 msgr2=0x7fbc180b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc17400640 1 --2- 172.21.15.173:0/4192341127 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc180cc260 0x7fbc180b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc17400640 1 -- 172.21.15.173:0/4192341127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc180b3fe0 msgr2=0x7fbc18141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc17400640 1 --2- 172.21.15.173:0/4192341127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc180b3fe0 0x7fbc18141e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.305+0000 7fbc17400640 1 -- 172.21.15.173:0/4192341127 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc18141080 con 0x7fbc18145290 2024-04-25T09:12:30.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.309+0000 7fbc17400640 1 --2- 172.21.15.173:0/4192341127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc18145290 0x7fbc18142d50 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000efc0 tx=0x7fbc1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:30.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.309+0000 7fbc0ea00640 1 -- 172.21.15.173:0/4192341127 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10018020 con 0x7fbc18145290 2024-04-25T09:12:30.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.309+0000 7fbc0ea00640 1 -- 172.21.15.173:0/4192341127 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc10014480 con 0x7fbc18145290 2024-04-25T09:12:30.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.309+0000 7fbc1d600640 1 -- 172.21.15.173:0/4192341127 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc181439a0 con 0x7fbc18145290 2024-04-25T09:12:30.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.309+0000 7fbc0ea00640 1 -- 172.21.15.173:0/4192341127 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10014870 con 0x7fbc18145290 2024-04-25T09:12:30.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.309+0000 7fbc1d600640 1 -- 172.21.15.173:0/4192341127 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc18141600 con 0x7fbc18145290 2024-04-25T09:12:30.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.309+0000 7fbc1d600640 1 -- 172.21.15.173:0/4192341127 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc18073ab0 con 0x7fbc18145290 2024-04-25T09:12:30.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.309+0000 7fbc0ea00640 1 -- 172.21.15.173:0/4192341127 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbc1001b020 con 0x7fbc18145290 2024-04-25T09:12:30.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.309+0000 7fbc0ea00640 1 --2- 172.21.15.173:0/4192341127 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbbf4066f60 0x7fbbf4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.309+0000 7fbc0ea00640 1 -- 172.21.15.173:0/4192341127 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fbc10085850 con 0x7fbc18145290 2024-04-25T09:12:30.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.309+0000 7fbc16a00640 1 --2- 172.21.15.173:0/4192341127 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbbf4066f60 0x7fbbf4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.313+0000 7fbc16a00640 1 --2- 172.21.15.173:0/4192341127 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbbf4066f60 0x7fbbf4069420 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbc080ae000 tx=0x7fbc08008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:30.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.313+0000 7fbc0ea00640 1 -- 172.21.15.173:0/4192341127 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbc10022070 con 0x7fbc18145290 2024-04-25T09:12:30.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:30.481+0000 7fbc1d600640 1 -- 172.21.15.173:0/4192341127 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbc1815e2b0 con 0x7fbc18145290 2024-04-25T09:12:31.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.077+0000 7fbc0ea00640 1 -- 172.21.15.173:0/4192341127 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v127) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbc10010040 con 0x7fbc18145290 2024-04-25T09:12:31.062 INFO:teuthology.orchestra.run.smithi173.stderr: removed all blocklist entries 2024-04-25T09:12:31.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.077+0000 7fbc1d600640 1 -- 172.21.15.173:0/4192341127 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbbf4066f60 msgr2=0x7fbbf4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.077+0000 7fbc1d600640 1 --2- 172.21.15.173:0/4192341127 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbbf4066f60 0x7fbbf4069420 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbc080ae000 tx=0x7fbc08008040 comp rx=0 tx=0).stop 2024-04-25T09:12:31.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.077+0000 7fbc1d600640 1 -- 172.21.15.173:0/4192341127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc18145290 msgr2=0x7fbc18142d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.077+0000 7fbc1d600640 1 --2- 172.21.15.173:0/4192341127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc18145290 0x7fbc18142d50 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000efc0 tx=0x7fbc1000c490 comp rx=0 tx=0).stop 2024-04-25T09:12:31.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.077+0000 7fbc1d600640 1 -- 172.21.15.173:0/4192341127 shutdown_connections 2024-04-25T09:12:31.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.077+0000 7fbc1d600640 1 --2- 172.21.15.173:0/4192341127 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbbf4066f60 0x7fbbf4069420 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.077+0000 7fbc1d600640 1 --2- 172.21.15.173:0/4192341127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc18145290 0x7fbc18142d50 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.077+0000 7fbc1d600640 1 --2- 172.21.15.173:0/4192341127 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc180cc260 0x7fbc180b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.077+0000 7fbc1d600640 1 --2- 172.21.15.173:0/4192341127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc180b3fe0 0x7fbc18141e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.077+0000 7fbc1d600640 1 -- 172.21.15.173:0/4192341127 >> 172.21.15.173:0/4192341127 conn(0x7fbc1806ac90 msgr2=0x7fbc1815d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:31.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.081+0000 7fbc1d600640 1 -- 172.21.15.173:0/4192341127 shutdown_connections 2024-04-25T09:12:31.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.081+0000 7fbc1d600640 1 -- 172.21.15.173:0/4192341127 wait complete. 2024-04-25T09:12:31.088 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:12:31.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.237+0000 7fcb31c00640 1 Processor -- start 2024-04-25T09:12:31.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.237+0000 7fcb31c00640 1 -- start start 2024-04-25T09:12:31.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.241+0000 7fcb31c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcb2c0b3e70 0x7fcb2c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.241+0000 7fcb31c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb2c15edd0 0x7fcb2c0b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.241+0000 7fcb31c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2c0b4790 con 0x7fcb2c0aefa0 2024-04-25T09:12:31.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.241+0000 7fcb31c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb2c06dd50 con 0x7fcb2c0b3e70 2024-04-25T09:12:31.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.241+0000 7fcb31c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c15f320 con 0x7fcb2c15edd0 2024-04-25T09:12:31.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.241+0000 7fcb2aa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcb2c0b3e70 0x7fcb2c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.241+0000 7fcb2a000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fcb2c0aefa0 0x7fcb2c0b2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:59286/0 (socket says 172.21.15.173:59286) 2024-04-25T09:12:31.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.241+0000 7fcb2a000640 1 -- 172.21.15.173:0/1171998356 learned_addr learned my addr 172.21.15.173:0/1171998356 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:31.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.241+0000 7fcb2b400640 1 --2- 172.21.15.173:0/1171998356 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb2c15edd0 0x7fcb2c0b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.241+0000 7fcb29600640 1 -- 172.21.15.173:0/1171998356 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904761251 0 0) 0x7fcb2c0b4790 con 0x7fcb2c0aefa0 2024-04-25T09:12:31.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.241+0000 7fcb29600640 1 -- 172.21.15.173:0/1171998356 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb10003530 con 0x7fcb2c0aefa0 2024-04-25T09:12:31.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.241+0000 7fcb2aa00640 1 -- 172.21.15.173:0/1171998356 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb2c15edd0 msgr2=0x7fcb2c0b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:31.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.241+0000 7fcb2aa00640 1 --2- 172.21.15.173:0/1171998356 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb2c15edd0 0x7fcb2c0b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.241+0000 7fcb2aa00640 1 -- 172.21.15.173:0/1171998356 >> v1:172.21.15.173:6789/0 conn(0x7fcb2c0aefa0 legacy=0x7fcb2c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.241+0000 7fcb2aa00640 1 -- 172.21.15.173:0/1171998356 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2c06d420 con 0x7fcb2c0b3e70 2024-04-25T09:12:31.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.245+0000 7fcb2aa00640 1 --2- 172.21.15.173:0/1171998356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c0b3e70 0x7fcb2c0b4250 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0097c0 tx=0x7fcb1c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d631d2f76a080d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:31.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.245+0000 7fcb29600640 1 -- 172.21.15.173:0/1171998356 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0aa5f0 con 0x7fcb2c0b3e70 2024-04-25T09:12:31.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.245+0000 7fcb29600640 1 -- 172.21.15.173:0/1171998356 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c0af070 con 0x7fcb2c0b3e70 2024-04-25T09:12:31.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.245+0000 7fcb29600640 1 -- 172.21.15.173:0/1171998356 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0aa9b0 con 0x7fcb2c0b3e70 2024-04-25T09:12:31.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.245+0000 7fcb31c00640 1 -- 172.21.15.173:0/1171998356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c0b3e70 msgr2=0x7fcb2c0b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.245+0000 7fcb31c00640 1 --2- 172.21.15.173:0/1171998356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c0b3e70 0x7fcb2c0b4250 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0097c0 tx=0x7fcb1c01c470 comp rx=0 tx=0).stop 2024-04-25T09:12:31.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.245+0000 7fcb31c00640 1 -- 172.21.15.173:0/1171998356 shutdown_connections 2024-04-25T09:12:31.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.245+0000 7fcb31c00640 1 --2- 172.21.15.173:0/1171998356 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb2c15edd0 0x7fcb2c0b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.245+0000 7fcb31c00640 1 --2- 172.21.15.173:0/1171998356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c0b3e70 0x7fcb2c0b4250 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.245+0000 7fcb31c00640 1 -- 172.21.15.173:0/1171998356 >> 172.21.15.173:0/1171998356 conn(0x7fcb2c06ac90 msgr2=0x7fcb2c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:31.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.245+0000 7fcb31c00640 1 -- 172.21.15.173:0/1171998356 shutdown_connections 2024-04-25T09:12:31.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.245+0000 7fcb31c00640 1 -- 172.21.15.173:0/1171998356 wait complete. 2024-04-25T09:12:31.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.245+0000 7fcb31c00640 1 Processor -- start 2024-04-25T09:12:31.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.245+0000 7fcb31c00640 1 -- start start 2024-04-25T09:12:31.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb31c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c0aefa0 0x7fcb2c152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb31c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb2c0b3e70 0x7fcb2c153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb31c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb2c15edd0 0x7fcb2c146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb31c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c06e1e0 con 0x7fcb2c0aefa0 2024-04-25T09:12:31.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb31c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c15aba0 con 0x7fcb2c0b3e70 2024-04-25T09:12:31.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb31c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c06e360 con 0x7fcb2c15edd0 2024-04-25T09:12:31.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb2aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c0aefa0 0x7fcb2c152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb2aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c0aefa0 0x7fcb2c152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52084/0 (socket says 172.21.15.173:52084) 2024-04-25T09:12:31.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb2aa00640 1 -- 172.21.15.173:0/3906175581 learned_addr learned my addr 172.21.15.173:0/3906175581 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:31.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb2b400640 1 --2- 172.21.15.173:0/3906175581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb2c15edd0 0x7fcb2c146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb2a000640 1 --2- 172.21.15.173:0/3906175581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb2c0b3e70 0x7fcb2c153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb2aa00640 1 -- 172.21.15.173:0/3906175581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb2c15edd0 msgr2=0x7fcb2c146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb2aa00640 1 --2- 172.21.15.173:0/3906175581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb2c15edd0 0x7fcb2c146fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb2aa00640 1 -- 172.21.15.173:0/3906175581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb2c0b3e70 msgr2=0x7fcb2c153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb2aa00640 1 --2- 172.21.15.173:0/3906175581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb2c0b3e70 0x7fcb2c153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb2aa00640 1 -- 172.21.15.173:0/3906175581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2c0adb50 con 0x7fcb2c0aefa0 2024-04-25T09:12:31.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb2b400640 1 --2- 172.21.15.173:0/3906175581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb2c15edd0 0x7fcb2c146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:31.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb2a000640 1 --2- 172.21.15.173:0/3906175581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb2c0b3e70 0x7fcb2c153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:31.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb2aa00640 1 --2- 172.21.15.173:0/3906175581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c0aefa0 0x7fcb2c152ec0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c01a0a0 tx=0x7fcb1c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:31.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb22a00640 1 -- 172.21.15.173:0/3906175581 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0be610 con 0x7fcb2c0aefa0 2024-04-25T09:12:31.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb22a00640 1 -- 172.21.15.173:0/3906175581 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c0be7d0 con 0x7fcb2c0aefa0 2024-04-25T09:12:31.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb22a00640 1 -- 172.21.15.173:0/3906175581 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0bebc0 con 0x7fcb2c0aefa0 2024-04-25T09:12:31.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb31c00640 1 -- 172.21.15.173:0/3906175581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2c0ad2d0 con 0x7fcb2c0aefa0 2024-04-25T09:12:31.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb31c00640 1 -- 172.21.15.173:0/3906175581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2c0ad590 con 0x7fcb2c0aefa0 2024-04-25T09:12:31.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb31c00640 1 -- 172.21.15.173:0/3906175581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2c073a40 con 0x7fcb2c0aefa0 2024-04-25T09:12:31.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.249+0000 7fcb22a00640 1 -- 172.21.15.173:0/3906175581 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcb1c0bc020 con 0x7fcb2c0aefa0 2024-04-25T09:12:31.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.253+0000 7fcb22a00640 1 --2- 172.21.15.173:0/3906175581 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcb08066f60 0x7fcb08069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.253+0000 7fcb22a00640 1 -- 172.21.15.173:0/3906175581 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fcb1c11efe0 con 0x7fcb2c0aefa0 2024-04-25T09:12:31.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.253+0000 7fcb2a000640 1 --2- 172.21.15.173:0/3906175581 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcb08066f60 0x7fcb08069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.253+0000 7fcb2a000640 1 --2- 172.21.15.173:0/3906175581 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcb08066f60 0x7fcb08069420 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c151660 tx=0x7fcb14009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:31.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.257+0000 7fcb22a00640 1 -- 172.21.15.173:0/3906175581 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcb1c0c5030 con 0x7fcb2c0aefa0 2024-04-25T09:12:31.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.465+0000 7fcb31c00640 1 -- 172.21.15.173:0/3906175581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcb2c06f1c0 con 0x7fcb2c0aefa0 2024-04-25T09:12:31.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.465+0000 7fcb22a00640 1 -- 172.21.15.173:0/3906175581 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fcb1c016090 con 0x7fcb2c0aefa0 2024-04-25T09:12:31.451 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:31.451 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:12:31.451 INFO:teuthology.orchestra.run.smithi173.stdout: "auth_dump": [ 2024-04-25T09:12:31.451 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.451 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.a", 2024-04-25T09:12:31.451 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmnVr3EhAAn+C0Mb/MrYSZuQyr5QTXig==", 2024-04-25T09:12:31.451 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.451 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:12:31.452 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:12:31.452 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:12:31.452 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:12:31.452 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.452 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:12:31.452 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.452 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.b", 2024-04-25T09:12:31.452 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6Gypm0QfFHhAAuP8xE/8pvSZMcP8N33OB9Q==", 2024-04-25T09:12:31.452 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.452 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:12:31.452 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:12:31.452 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:12:31.452 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:12:31.453 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.453 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:12:31.453 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.453 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.c", 2024-04-25T09:12:31.453 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmQsv4GRAATNiD7udOvl8xRDIx64O5jg==", 2024-04-25T09:12:31.453 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.453 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:12:31.453 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:12:31.453 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:12:31.453 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:12:31.453 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.453 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:12:31.453 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.453 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.d", 2024-04-25T09:12:31.454 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmtGMSJhAAonqLeuSsNrgyZks1eoJ1Gg==", 2024-04-25T09:12:31.454 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.454 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:12:31.454 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:12:31.454 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:12:31.454 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:12:31.454 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.454 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:12:31.454 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.454 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.0", 2024-04-25T09:12:31.454 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD9Gypm+Yw7LBAAnOFUKU3w1ltre7aHMWZ/SQ==", 2024-04-25T09:12:31.454 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.454 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:12:31.454 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:12:31.455 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:12:31.455 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.455 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:12:31.455 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.455 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.1", 2024-04-25T09:12:31.455 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAAHCpm4BUIOBAAmbfWUWCun/una5WoemhL6Q==", 2024-04-25T09:12:31.455 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.455 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:12:31.455 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:12:31.455 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:12:31.455 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.455 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:12:31.455 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.455 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.2", 2024-04-25T09:12:31.456 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAEHCpmFXIaBRAA0cN2GdLSS3jJC+x4RVUUlw==", 2024-04-25T09:12:31.456 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.456 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:12:31.456 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:12:31.456 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:12:31.456 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.456 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:12:31.456 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.456 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.3", 2024-04-25T09:12:31.456 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAHHCpmUD+YDxAALPvf1wLzhuQmFPo3/vJkdQ==", 2024-04-25T09:12:31.456 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.456 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:12:31.456 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:12:31.456 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:12:31.456 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.457 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:12:31.457 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.457 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.4", 2024-04-25T09:12:31.457 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQANHCpmLQ0fCBAA1Shz0Pfns+rj5r601hzOnQ==", 2024-04-25T09:12:31.457 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.457 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:12:31.457 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:12:31.457 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:12:31.457 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.457 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:12:31.457 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.457 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.5", 2024-04-25T09:12:31.458 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAQHCpmyMj1ERAAMRvZ3PFQa9oe6oGemLvfxw==", 2024-04-25T09:12:31.458 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.458 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:12:31.458 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:12:31.458 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:12:31.458 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.458 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:12:31.458 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.458 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.6", 2024-04-25T09:12:31.458 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQATHCpmKha6GxAAF4zfdFDlylGHHhGI5tVpGA==", 2024-04-25T09:12:31.458 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.458 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:12:31.458 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:12:31.459 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:12:31.459 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.459 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:12:31.459 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.459 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.7", 2024-04-25T09:12:31.459 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAWHCpmB2lFJhAA3sYYsjS5DIC5fCDz6ur0tA==", 2024-04-25T09:12:31.459 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.459 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:12:31.459 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:12:31.459 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:12:31.459 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.459 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:12:31.459 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.459 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.0", 2024-04-25T09:12:31.460 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w==", 2024-04-25T09:12:31.460 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.460 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:12:31.460 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow r", 2024-04-25T09:12:31.460 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:12:31.460 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.460 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:12:31.460 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.460 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.1", 2024-04-25T09:12:31.460 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6Gypm1PbHMxAAXMrgpR/xgzfQuuNrculQxA==", 2024-04-25T09:12:31.460 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.460 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:12:31.460 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:12:31.460 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:12:31.460 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:12:31.460 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.461 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:12:31.461 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.461 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.2", 2024-04-25T09:12:31.461 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmrTxjMBAAaqwDl5uiLxhaDIk7m6oDIw==", 2024-04-25T09:12:31.461 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.461 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:12:31.461 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:12:31.461 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:12:31.461 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:12:31.461 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.461 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:12:31.461 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.461 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.3", 2024-04-25T09:12:31.461 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmlAS9ORAAvYbwLnUaDHXOqvEBwJJJcQ==", 2024-04-25T09:12:31.461 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.461 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:12:31.461 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:12:31.462 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:12:31.462 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:12:31.462 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.462 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:12:31.462 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.462 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.admin", 2024-04-25T09:12:31.462 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD5GypmYFhkMhAACwSsE+B9l263vnlJ0LjFkQ==", 2024-04-25T09:12:31.462 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.462 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:12:31.462 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:12:31.462 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:12:31.462 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:12:31.462 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.462 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:12:31.462 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.462 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mgr.x", 2024-04-25T09:12:31.463 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmMSqHDhAAe0nkrXbT7dBbAbI89ExUmw==", 2024-04-25T09:12:31.463 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.463 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:12:31.463 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile mgr", 2024-04-25T09:12:31.463 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:12:31.463 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.463 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:12:31.463 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:31.463 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mgr.y", 2024-04-25T09:12:31.463 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmjCuzChAAomjH5vLVICqSFpyDVQeB4w==", 2024-04-25T09:12:31.463 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:12:31.463 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:12:31.463 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile mgr", 2024-04-25T09:12:31.463 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:12:31.463 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.463 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:31.463 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-04-25T09:12:31.464 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:12:31.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.469+0000 7fcb31c00640 1 -- 172.21.15.173:0/3906175581 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcb08066f60 msgr2=0x7fcb08069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.469+0000 7fcb31c00640 1 --2- 172.21.15.173:0/3906175581 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcb08066f60 0x7fcb08069420 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c151660 tx=0x7fcb14009040 comp rx=0 tx=0).stop 2024-04-25T09:12:31.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.469+0000 7fcb31c00640 1 -- 172.21.15.173:0/3906175581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c0aefa0 msgr2=0x7fcb2c152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.469+0000 7fcb31c00640 1 --2- 172.21.15.173:0/3906175581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c0aefa0 0x7fcb2c152ec0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c01a0a0 tx=0x7fcb1c01acb0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.469+0000 7fcb31c00640 1 -- 172.21.15.173:0/3906175581 shutdown_connections 2024-04-25T09:12:31.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.469+0000 7fcb31c00640 1 --2- 172.21.15.173:0/3906175581 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcb08066f60 0x7fcb08069420 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.469+0000 7fcb31c00640 1 --2- 172.21.15.173:0/3906175581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb2c15edd0 0x7fcb2c146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.469+0000 7fcb31c00640 1 --2- 172.21.15.173:0/3906175581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb2c0b3e70 0x7fcb2c153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.469+0000 7fcb31c00640 1 --2- 172.21.15.173:0/3906175581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c0aefa0 0x7fcb2c152ec0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.469+0000 7fcb31c00640 1 -- 172.21.15.173:0/3906175581 >> 172.21.15.173:0/3906175581 conn(0x7fcb2c06ac90 msgr2=0x7fcb2c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:31.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.469+0000 7fcb31c00640 1 -- 172.21.15.173:0/3906175581 shutdown_connections 2024-04-25T09:12:31.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.469+0000 7fcb31c00640 1 -- 172.21.15.173:0/3906175581 wait complete. 2024-04-25T09:12:31.473 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:31.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.621+0000 7f8186400640 1 Processor -- start 2024-04-25T09:12:31.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.621+0000 7f8186400640 1 -- start start 2024-04-25T09:12:31.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.625+0000 7f8186400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f818015a180 0x7f81800b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.625+0000 7f8186400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81800b2ca0 0x7f81800ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.625+0000 7f8186400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818006e860 con 0x7f8180071320 2024-04-25T09:12:31.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.625+0000 7f8186400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81800af230 con 0x7f818015a180 2024-04-25T09:12:31.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.625+0000 7f8186400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818006eb20 con 0x7f81800b2ca0 2024-04-25T09:12:31.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.625+0000 7f817f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f818015a180 0x7f81800b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.625+0000 7f817f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f818015a180 0x7f81800b40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52086/0 (socket says 172.21.15.173:52086) 2024-04-25T09:12:31.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.625+0000 7f817f400640 1 -- 172.21.15.173:0/2102004372 learned_addr learned my addr 172.21.15.173:0/2102004372 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:31.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.625+0000 7f817ea00640 1 --2- 172.21.15.173:0/2102004372 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81800b2ca0 0x7f81800ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.625+0000 7f817f400640 1 -- 172.21.15.173:0/2102004372 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81800b2ca0 msgr2=0x7f81800ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:31.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.625+0000 7f817f400640 1 --2- 172.21.15.173:0/2102004372 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81800b2ca0 0x7f81800ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.625+0000 7f817f400640 1 -- 172.21.15.173:0/2102004372 >> v1:172.21.15.194:6789/0 conn(0x7f8180071320 legacy=0x7f818006d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:31.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.625+0000 7f817f400640 1 -- 172.21.15.173:0/2102004372 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81800aebe0 con 0x7f818015a180 2024-04-25T09:12:31.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.625+0000 7f817ea00640 1 --2- 172.21.15.173:0/2102004372 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81800b2ca0 0x7f81800ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:31.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.629+0000 7f817f400640 1 --2- 172.21.15.173:0/2102004372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818015a180 0x7f81800b40e0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f8170009e50 tx=0x7f817001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a144e1dcdfa145 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:31.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.629+0000 7f817e000640 1 -- 172.21.15.173:0/2102004372 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81700a5750 con 0x7f818015a180 2024-04-25T09:12:31.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.629+0000 7f817e000640 1 -- 172.21.15.173:0/2102004372 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81700a58f0 con 0x7f818015a180 2024-04-25T09:12:31.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.629+0000 7f817e000640 1 -- 172.21.15.173:0/2102004372 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81700a5cc0 con 0x7f818015a180 2024-04-25T09:12:31.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.629+0000 7f8186400640 1 -- 172.21.15.173:0/2102004372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818015a180 msgr2=0x7f81800b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.629+0000 7f8186400640 1 --2- 172.21.15.173:0/2102004372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818015a180 0x7f81800b40e0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f8170009e50 tx=0x7f817001c9f0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.629+0000 7f8186400640 1 -- 172.21.15.173:0/2102004372 shutdown_connections 2024-04-25T09:12:31.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.629+0000 7f8186400640 1 --2- 172.21.15.173:0/2102004372 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81800b2ca0 0x7f81800ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.629+0000 7f8186400640 1 --2- 172.21.15.173:0/2102004372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f818015a180 0x7f81800b40e0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.629+0000 7f8186400640 1 -- 172.21.15.173:0/2102004372 >> 172.21.15.173:0/2102004372 conn(0x7f818006ac90 msgr2=0x7f818006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:31.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.629+0000 7f8186400640 1 -- 172.21.15.173:0/2102004372 shutdown_connections 2024-04-25T09:12:31.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.629+0000 7f8186400640 1 -- 172.21.15.173:0/2102004372 wait complete. 2024-04-25T09:12:31.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.629+0000 7f8186400640 1 Processor -- start 2024-04-25T09:12:31.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.629+0000 7f8186400640 1 -- start start 2024-04-25T09:12:31.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f8186400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8180071320 0x7f81800c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f8186400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81800b2ca0 0x7f81801fa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f8186400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f818015a180 0x7f81801470e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f8186400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81800cfaf0 con 0x7f81800b2ca0 2024-04-25T09:12:31.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f8186400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81800cf970 con 0x7f818015a180 2024-04-25T09:12:31.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f8186400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81800cfc70 con 0x7f8180071320 2024-04-25T09:12:31.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f817ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81800b2ca0 0x7f81801fa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f817ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81800b2ca0 0x7f81801fa910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52096/0 (socket says 172.21.15.173:52096) 2024-04-25T09:12:31.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f817ea00640 1 -- 172.21.15.173:0/3063060406 learned_addr learned my addr 172.21.15.173:0/3063060406 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:31.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f817fe00640 1 --2- 172.21.15.173:0/3063060406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f818015a180 0x7f81801470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f817f400640 1 --2- 172.21.15.173:0/3063060406 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8180071320 0x7f81800c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f817ea00640 1 -- 172.21.15.173:0/3063060406 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8180071320 msgr2=0x7f81800c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f817ea00640 1 --2- 172.21.15.173:0/3063060406 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8180071320 0x7f81800c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f817ea00640 1 -- 172.21.15.173:0/3063060406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f818015a180 msgr2=0x7f81801470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f817ea00640 1 --2- 172.21.15.173:0/3063060406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f818015a180 0x7f81801470e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f817ea00640 1 -- 172.21.15.173:0/3063060406 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8180156ec0 con 0x7f81800b2ca0 2024-04-25T09:12:31.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f817fe00640 1 --2- 172.21.15.173:0/3063060406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f818015a180 0x7f81801470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:31.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f817ea00640 1 --2- 172.21.15.173:0/3063060406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81800b2ca0 0x7f81801fa910 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f816c00c820 tx=0x7f816c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:31.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f8177400640 1 -- 172.21.15.173:0/3063060406 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c015070 con 0x7f81800b2ca0 2024-04-25T09:12:31.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f8177400640 1 -- 172.21.15.173:0/3063060406 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c007a30 con 0x7f81800b2ca0 2024-04-25T09:12:31.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f8177400640 1 -- 172.21.15.173:0/3063060406 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c007e40 con 0x7f81800b2ca0 2024-04-25T09:12:31.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f8186400640 1 -- 172.21.15.173:0/3063060406 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81801fb140 con 0x7f81800b2ca0 2024-04-25T09:12:31.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f8186400640 1 -- 172.21.15.173:0/3063060406 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81801fb700 con 0x7f81800b2ca0 2024-04-25T09:12:31.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f8186400640 1 -- 172.21.15.173:0/3063060406 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8180073a40 con 0x7f81800b2ca0 2024-04-25T09:12:31.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.633+0000 7f8177400640 1 -- 172.21.15.173:0/3063060406 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f816c018070 con 0x7f81800b2ca0 2024-04-25T09:12:31.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.637+0000 7f8177400640 1 --2- 172.21.15.173:0/3063060406 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8160066f90 0x7f8160069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.637+0000 7f8177400640 1 -- 172.21.15.173:0/3063060406 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f816c084c80 con 0x7f81800b2ca0 2024-04-25T09:12:31.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.637+0000 7f817f400640 1 --2- 172.21.15.173:0/3063060406 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8160066f90 0x7f8160069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.637+0000 7f817f400640 1 --2- 172.21.15.173:0/3063060406 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8160066f90 0x7f8160069450 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f81700ae000 tx=0x7f81700a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:31.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.641+0000 7f8177400640 1 -- 172.21.15.173:0/3063060406 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f816c0557f0 con 0x7f81800b2ca0 2024-04-25T09:12:31.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.793+0000 7f8186400640 1 -- 172.21.15.173:0/3063060406 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81800720f0 con 0x7f81800b2ca0 2024-04-25T09:12:31.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.797+0000 7f8177400640 1 -- 172.21.15.173:0/3063060406 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+13234 (secure 0 0 0) 0x7f816c059890 con 0x7f81800b2ca0 2024-04-25T09:12:31.781 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:31.781 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":129,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:12:31.092160+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:31.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.797+0000 7f8186400640 1 -- 172.21.15.173:0/3063060406 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8160066f90 msgr2=0x7f8160069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.797+0000 7f8186400640 1 --2- 172.21.15.173:0/3063060406 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8160066f90 0x7f8160069450 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f81700ae000 tx=0x7f81700a7070 comp rx=0 tx=0).stop 2024-04-25T09:12:31.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.797+0000 7f8186400640 1 -- 172.21.15.173:0/3063060406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81800b2ca0 msgr2=0x7f81801fa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.797+0000 7f8186400640 1 --2- 172.21.15.173:0/3063060406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81800b2ca0 0x7f81801fa910 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f816c00c820 tx=0x7f816c00cce0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.797+0000 7f8186400640 1 -- 172.21.15.173:0/3063060406 shutdown_connections 2024-04-25T09:12:31.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.797+0000 7f8186400640 1 --2- 172.21.15.173:0/3063060406 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8160066f90 0x7f8160069450 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.797+0000 7f8186400640 1 --2- 172.21.15.173:0/3063060406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f818015a180 0x7f81801470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.797+0000 7f8186400640 1 --2- 172.21.15.173:0/3063060406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81800b2ca0 0x7f81801fa910 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.797+0000 7f8186400640 1 --2- 172.21.15.173:0/3063060406 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8180071320 0x7f81800c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.797+0000 7f8186400640 1 -- 172.21.15.173:0/3063060406 >> 172.21.15.173:0/3063060406 conn(0x7f818006ac90 msgr2=0x7f81800af550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:31.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.797+0000 7f8186400640 1 -- 172.21.15.173:0/3063060406 shutdown_connections 2024-04-25T09:12:31.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.797+0000 7f8186400640 1 -- 172.21.15.173:0/3063060406 wait complete. 2024-04-25T09:12:31.802 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:12:31.802 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:12:31.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.957+0000 7fa015e00640 1 Processor -- start 2024-04-25T09:12:31.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.957+0000 7fa015e00640 1 -- start start 2024-04-25T09:12:31.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.957+0000 7fa015e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa010145290 0x7fa01015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.957+0000 7fa015e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0100cc260 0x7fa0100cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.957+0000 7fa015e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01015c5f0 con 0x7fa0100b3fe0 2024-04-25T09:12:31.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.957+0000 7fa015e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01006d4b0 con 0x7fa010145290 2024-04-25T09:12:31.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.957+0000 7fa015e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01006d790 con 0x7fa0100cc260 2024-04-25T09:12:31.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.957+0000 7fa00ea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa010145290 0x7fa01015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.957+0000 7fa00e000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa0100b3fe0 0x7fa0100b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:59298/0 (socket says 172.21.15.173:59298) 2024-04-25T09:12:31.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.957+0000 7fa00e000640 1 -- 172.21.15.173:0/327936057 learned_addr learned my addr 172.21.15.173:0/327936057 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:31.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.957+0000 7fa00f400640 1 --2- 172.21.15.173:0/327936057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0100cc260 0x7fa0100cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.957+0000 7fa00ea00640 1 -- 172.21.15.173:0/327936057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0100cc260 msgr2=0x7fa0100cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:31.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.957+0000 7fa00ea00640 1 --2- 172.21.15.173:0/327936057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0100cc260 0x7fa0100cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.957+0000 7fa00ea00640 1 -- 172.21.15.173:0/327936057 >> v1:172.21.15.173:6789/0 conn(0x7fa0100b3fe0 legacy=0x7fa0100b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.957+0000 7fa00ea00640 1 -- 172.21.15.173:0/327936057 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01006da70 con 0x7fa010145290 2024-04-25T09:12:31.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.961+0000 7fa00ea00640 1 --2- 172.21.15.173:0/327936057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa010145290 0x7fa01015c0b0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fa000009d90 tx=0x7fa00001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f305f38e4b76bc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:31.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.961+0000 7fa00d600640 1 -- 172.21.15.173:0/327936057 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0000b2070 con 0x7fa010145290 2024-04-25T09:12:31.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.961+0000 7fa00d600640 1 -- 172.21.15.173:0/327936057 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0000a5820 con 0x7fa010145290 2024-04-25T09:12:31.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.961+0000 7fa00d600640 1 -- 172.21.15.173:0/327936057 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0000a5bf0 con 0x7fa010145290 2024-04-25T09:12:31.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.961+0000 7fa015e00640 1 -- 172.21.15.173:0/327936057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa010145290 msgr2=0x7fa01015c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.961+0000 7fa015e00640 1 --2- 172.21.15.173:0/327936057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa010145290 0x7fa01015c0b0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fa000009d90 tx=0x7fa00001c850 comp rx=0 tx=0).stop 2024-04-25T09:12:31.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.961+0000 7fa015e00640 1 -- 172.21.15.173:0/327936057 shutdown_connections 2024-04-25T09:12:31.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.961+0000 7fa015e00640 1 --2- 172.21.15.173:0/327936057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0100cc260 0x7fa0100cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.961+0000 7fa015e00640 1 --2- 172.21.15.173:0/327936057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa010145290 0x7fa01015c0b0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.961+0000 7fa015e00640 1 -- 172.21.15.173:0/327936057 >> 172.21.15.173:0/327936057 conn(0x7fa01006ac90 msgr2=0x7fa01006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:31.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.961+0000 7fa015e00640 1 -- 172.21.15.173:0/327936057 shutdown_connections 2024-04-25T09:12:31.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.961+0000 7fa015e00640 1 -- 172.21.15.173:0/327936057 wait complete. 2024-04-25T09:12:31.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa015e00640 1 Processor -- start 2024-04-25T09:12:31.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa015e00640 1 -- start start 2024-04-25T09:12:31.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa015e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0100b3fe0 0x7fa01015adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa015e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0100cc260 0x7fa0101408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa015e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa010145290 0x7fa0101439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa015e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01006ed60 con 0x7fa0100b3fe0 2024-04-25T09:12:31.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa015e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01006eee0 con 0x7fa0100cc260 2024-04-25T09:12:31.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa015e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01006f060 con 0x7fa010145290 2024-04-25T09:12:31.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa00ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0100b3fe0 0x7fa01015adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa00ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0100b3fe0 0x7fa01015adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52116/0 (socket says 172.21.15.173:52116) 2024-04-25T09:12:31.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa00ea00640 1 -- 172.21.15.173:0/495697575 learned_addr learned my addr 172.21.15.173:0/495697575 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:31.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa00ea00640 1 -- 172.21.15.173:0/495697575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa010145290 msgr2=0x7fa0101439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa00ea00640 1 --2- 172.21.15.173:0/495697575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa010145290 0x7fa0101439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa00ea00640 1 -- 172.21.15.173:0/495697575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0100cc260 msgr2=0x7fa0101408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa00e000640 1 --2- 172.21.15.173:0/495697575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0100cc260 0x7fa0101408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa00ea00640 1 --2- 172.21.15.173:0/495697575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0100cc260 0x7fa0101408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa00ea00640 1 -- 172.21.15.173:0/495697575 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0100ac960 con 0x7fa0100b3fe0 2024-04-25T09:12:31.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa00e000640 1 --2- 172.21.15.173:0/495697575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0100cc260 0x7fa0101408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:31.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa00ea00640 1 --2- 172.21.15.173:0/495697575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0100b3fe0 0x7fa01015adc0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fa0000b0040 tx=0x7fa0000195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:31.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa007400640 1 -- 172.21.15.173:0/495697575 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0000bd020 con 0x7fa0100b3fe0 2024-04-25T09:12:31.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa007400640 1 -- 172.21.15.173:0/495697575 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0000b8670 con 0x7fa0100b3fe0 2024-04-25T09:12:31.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa015e00640 1 -- 172.21.15.173:0/495697575 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa010143260 con 0x7fa0100b3fe0 2024-04-25T09:12:31.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa007400640 1 -- 172.21.15.173:0/495697575 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0000b2040 con 0x7fa0100b3fe0 2024-04-25T09:12:31.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa015e00640 1 -- 172.21.15.173:0/495697575 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa010143540 con 0x7fa0100b3fe0 2024-04-25T09:12:31.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.965+0000 7fa015e00640 1 -- 172.21.15.173:0/495697575 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa010073ab0 con 0x7fa0100b3fe0 2024-04-25T09:12:31.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.969+0000 7fa007400640 1 -- 172.21.15.173:0/495697575 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa0000c0020 con 0x7fa0100b3fe0 2024-04-25T09:12:31.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.969+0000 7fa007400640 1 --2- 172.21.15.173:0/495697575 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9fec066f60 0x7f9fec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.969+0000 7fa007400640 1 -- 172.21.15.173:0/495697575 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fa00011fc60 con 0x7fa0100b3fe0 2024-04-25T09:12:31.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.969+0000 7fa00e000640 1 --2- 172.21.15.173:0/495697575 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9fec066f60 0x7f9fec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.969+0000 7fa00e000640 1 --2- 172.21.15.173:0/495697575 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9fec066f60 0x7f9fec069420 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8007fd0 tx=0x7f9ff8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:31.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:31.973+0000 7fa007400640 1 -- 172.21.15.173:0/495697575 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa0000c7030 con 0x7fa0100b3fe0 2024-04-25T09:12:32.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.133+0000 7fa015e00640 1 -- 172.21.15.173:0/495697575 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa01013e3a0 con 0x7fa0100b3fe0 2024-04-25T09:12:32.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.133+0000 7fa007400640 1 -- 172.21.15.173:0/495697575 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v129) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa000016560 con 0x7fa0100b3fe0 2024-04-25T09:12:32.118 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:12:32.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.133+0000 7fa015e00640 1 -- 172.21.15.173:0/495697575 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9fec066f60 msgr2=0x7f9fec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.133+0000 7fa015e00640 1 --2- 172.21.15.173:0/495697575 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9fec066f60 0x7f9fec069420 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8007fd0 tx=0x7f9ff8009040 comp rx=0 tx=0).stop 2024-04-25T09:12:32.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.133+0000 7fa015e00640 1 -- 172.21.15.173:0/495697575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0100b3fe0 msgr2=0x7fa01015adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.133+0000 7fa015e00640 1 --2- 172.21.15.173:0/495697575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0100b3fe0 0x7fa01015adc0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fa0000b0040 tx=0x7fa0000195f0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.133+0000 7fa015e00640 1 -- 172.21.15.173:0/495697575 shutdown_connections 2024-04-25T09:12:32.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.133+0000 7fa015e00640 1 --2- 172.21.15.173:0/495697575 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9fec066f60 0x7f9fec069420 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.133+0000 7fa015e00640 1 --2- 172.21.15.173:0/495697575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa010145290 0x7fa0101439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.133+0000 7fa015e00640 1 --2- 172.21.15.173:0/495697575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0100cc260 0x7fa0101408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.133+0000 7fa015e00640 1 --2- 172.21.15.173:0/495697575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0100b3fe0 0x7fa01015adc0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.133+0000 7fa015e00640 1 -- 172.21.15.173:0/495697575 >> 172.21.15.173:0/495697575 conn(0x7fa01006ac90 msgr2=0x7fa01015c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:32.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.133+0000 7fa015e00640 1 -- 172.21.15.173:0/495697575 shutdown_connections 2024-04-25T09:12:32.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.133+0000 7fa015e00640 1 -- 172.21.15.173:0/495697575 wait complete. 2024-04-25T09:12:32.139 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:12:32.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.293+0000 7fa599200640 1 Processor -- start 2024-04-25T09:12:32.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.293+0000 7fa599200640 1 -- start start 2024-04-25T09:12:32.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.293+0000 7fa599200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa5940d1270 0x7fa5940cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.293+0000 7fa599200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5940d01d0 con 0x7fa594099b30 2024-04-25T09:12:32.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.293+0000 7fa599200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5940d04b0 con 0x7fa5940cd7e0 2024-04-25T09:12:32.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.293+0000 7fa599200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5940cffa0 con 0x7fa5940d1270 2024-04-25T09:12:32.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.293+0000 7fa592800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa594099b30 0x7fa59415d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:59304/0 (socket says 172.21.15.173:59304) 2024-04-25T09:12:32.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.293+0000 7fa592800640 1 -- 172.21.15.173:0/1952729306 learned_addr learned my addr 172.21.15.173:0/1952729306 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:32.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.293+0000 7fa591400640 1 --2- 172.21.15.173:0/1952729306 >> v2:172.21.15.194:3300/0 conn(0x7fa5940d1270 0x7fa5940cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.293+0000 7fa590a00640 1 -- 172.21.15.173:0/1952729306 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323439089 0 0) 0x7fa5940d01d0 con 0x7fa594099b30 2024-04-25T09:12:32.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.293+0000 7fa590a00640 1 -- 172.21.15.173:0/1952729306 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa578003530 con 0x7fa594099b30 2024-04-25T09:12:32.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.293+0000 7fa591400640 1 -- 172.21.15.173:0/1952729306 >> v1:172.21.15.194:6789/0 conn(0x7fa5940cd7e0 legacy=0x7fa59406cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.293+0000 7fa591400640 1 -- 172.21.15.173:0/1952729306 >> v1:172.21.15.173:6789/0 conn(0x7fa594099b30 legacy=0x7fa59415d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.293+0000 7fa591400640 1 -- 172.21.15.173:0/1952729306 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5940d0790 con 0x7fa5940d1270 2024-04-25T09:12:32.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.297+0000 7fa591400640 1 --2- 172.21.15.173:0/1952729306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5940d1270 0x7fa5940cfa60 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa5800097c0 tx=0x7fa58001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56b12087b2da5ed6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:32.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.297+0000 7fa590a00640 1 -- 172.21.15.173:0/1952729306 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5800a7070 con 0x7fa5940d1270 2024-04-25T09:12:32.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.297+0000 7fa590a00640 1 -- 172.21.15.173:0/1952729306 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5800b0070 con 0x7fa5940d1270 2024-04-25T09:12:32.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.297+0000 7fa590a00640 1 -- 172.21.15.173:0/1952729306 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5800ab890 con 0x7fa5940d1270 2024-04-25T09:12:32.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.297+0000 7fa599200640 1 -- 172.21.15.173:0/1952729306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5940d1270 msgr2=0x7fa5940cfa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.297+0000 7fa599200640 1 --2- 172.21.15.173:0/1952729306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5940d1270 0x7fa5940cfa60 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa5800097c0 tx=0x7fa58001c470 comp rx=0 tx=0).stop 2024-04-25T09:12:32.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.297+0000 7fa599200640 1 -- 172.21.15.173:0/1952729306 shutdown_connections 2024-04-25T09:12:32.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.297+0000 7fa599200640 1 --2- 172.21.15.173:0/1952729306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5940d1270 0x7fa5940cfa60 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.297+0000 7fa599200640 1 -- 172.21.15.173:0/1952729306 >> 172.21.15.173:0/1952729306 conn(0x7fa5940b33a0 msgr2=0x7fa5940b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:32.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.297+0000 7fa599200640 1 -- 172.21.15.173:0/1952729306 shutdown_connections 2024-04-25T09:12:32.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.297+0000 7fa599200640 1 -- 172.21.15.173:0/1952729306 wait complete. 2024-04-25T09:12:32.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa599200640 1 Processor -- start 2024-04-25T09:12:32.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa599200640 1 -- start start 2024-04-25T09:12:32.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa599200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa594099b30 0x7fa59415e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa599200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5940cd7e0 0x7fa5940b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa599200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5940d1270 0x7fa5940b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa599200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59415e1c0 con 0x7fa5940d1270 2024-04-25T09:12:32.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa599200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59415e040 con 0x7fa5940cd7e0 2024-04-25T09:12:32.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa599200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5940cdbc0 con 0x7fa594099b30 2024-04-25T09:12:32.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa592800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5940d1270 0x7fa5940b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa592800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5940d1270 0x7fa5940b6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52122/0 (socket says 172.21.15.173:52122) 2024-04-25T09:12:32.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa592800640 1 -- 172.21.15.173:0/184111933 learned_addr learned my addr 172.21.15.173:0/184111933 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:32.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa591e00640 1 --2- 172.21.15.173:0/184111933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa594099b30 0x7fa59415e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa591400640 1 --2- 172.21.15.173:0/184111933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5940cd7e0 0x7fa5940b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa592800640 1 -- 172.21.15.173:0/184111933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa594099b30 msgr2=0x7fa59415e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa592800640 1 --2- 172.21.15.173:0/184111933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa594099b30 0x7fa59415e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa592800640 1 -- 172.21.15.173:0/184111933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5940cd7e0 msgr2=0x7fa5940b69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa592800640 1 --2- 172.21.15.173:0/184111933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5940cd7e0 0x7fa5940b69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa592800640 1 -- 172.21.15.173:0/184111933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5940b00d0 con 0x7fa5940d1270 2024-04-25T09:12:32.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa592800640 1 --2- 172.21.15.173:0/184111933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5940d1270 0x7fa5940b6f30 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00caa0 tx=0x7fa58c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:32.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa58a000640 1 -- 172.21.15.173:0/184111933 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c017070 con 0x7fa5940d1270 2024-04-25T09:12:32.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa58a000640 1 -- 172.21.15.173:0/184111933 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58c00ac00 con 0x7fa5940d1270 2024-04-25T09:12:32.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa599200640 1 -- 172.21.15.173:0/184111933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5940af030 con 0x7fa5940d1270 2024-04-25T09:12:32.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa58a000640 1 -- 172.21.15.173:0/184111933 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c012400 con 0x7fa5940d1270 2024-04-25T09:12:32.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa599200640 1 -- 172.21.15.173:0/184111933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5940af5f0 con 0x7fa5940d1270 2024-04-25T09:12:32.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.301+0000 7fa599200640 1 -- 172.21.15.173:0/184111933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa594073a40 con 0x7fa5940d1270 2024-04-25T09:12:32.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.305+0000 7fa58a000640 1 -- 172.21.15.173:0/184111933 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa58c01a070 con 0x7fa5940d1270 2024-04-25T09:12:32.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.305+0000 7fa58a000640 1 --2- 172.21.15.173:0/184111933 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa574066f60 0x7fa574069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.305+0000 7fa58a000640 1 -- 172.21.15.173:0/184111933 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fa58c084ae0 con 0x7fa5940d1270 2024-04-25T09:12:32.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.305+0000 7fa591e00640 1 --2- 172.21.15.173:0/184111933 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa574066f60 0x7fa574069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.305+0000 7fa591e00640 1 --2- 172.21.15.173:0/184111933 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa574066f60 0x7fa574069420 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fa584001810 tx=0x7fa584009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:32.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.309+0000 7fa58a000640 1 -- 172.21.15.173:0/184111933 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa58c0556f0 con 0x7fa5940d1270 2024-04-25T09:12:32.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.465+0000 7fa599200640 1 -- 172.21.15.173:0/184111933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa59406d7a0 con 0x7fa5940d1270 2024-04-25T09:12:32.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.465+0000 7fa58a000640 1 -- 172.21.15.173:0/184111933 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v129) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa58c059790 con 0x7fa5940d1270 2024-04-25T09:12:32.451 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:32.451 INFO:teuthology.orchestra.run.smithi173.stdout:[ 2024-04-25T09:12:32.451 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:12:32.451 INFO:teuthology.orchestra.run.smithi173.stdout: "poolnum": 1, 2024-04-25T09:12:32.451 INFO:teuthology.orchestra.run.smithi173.stdout: "poolname": ".mgr" 2024-04-25T09:12:32.451 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:12:32.451 INFO:teuthology.orchestra.run.smithi173.stdout:] 2024-04-25T09:12:32.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.465+0000 7fa599200640 1 -- 172.21.15.173:0/184111933 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa574066f60 msgr2=0x7fa574069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.465+0000 7fa599200640 1 --2- 172.21.15.173:0/184111933 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa574066f60 0x7fa574069420 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fa584001810 tx=0x7fa584009040 comp rx=0 tx=0).stop 2024-04-25T09:12:32.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.465+0000 7fa599200640 1 -- 172.21.15.173:0/184111933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5940d1270 msgr2=0x7fa5940b6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.465+0000 7fa599200640 1 --2- 172.21.15.173:0/184111933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5940d1270 0x7fa5940b6f30 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00caa0 tx=0x7fa58c00cf60 comp rx=0 tx=0).stop 2024-04-25T09:12:32.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.465+0000 7fa599200640 1 -- 172.21.15.173:0/184111933 shutdown_connections 2024-04-25T09:12:32.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.465+0000 7fa599200640 1 --2- 172.21.15.173:0/184111933 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa574066f60 0x7fa574069420 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.465+0000 7fa599200640 1 --2- 172.21.15.173:0/184111933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5940d1270 0x7fa5940b6f30 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.465+0000 7fa599200640 1 --2- 172.21.15.173:0/184111933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5940cd7e0 0x7fa5940b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.465+0000 7fa599200640 1 --2- 172.21.15.173:0/184111933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa594099b30 0x7fa59415e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.465+0000 7fa599200640 1 -- 172.21.15.173:0/184111933 >> 172.21.15.173:0/184111933 conn(0x7fa5940b33a0 msgr2=0x7fa5940b11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:32.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.469+0000 7fa599200640 1 -- 172.21.15.173:0/184111933 shutdown_connections 2024-04-25T09:12:32.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.469+0000 7fa599200640 1 -- 172.21.15.173:0/184111933 wait complete. 2024-04-25T09:12:32.472 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:12:32.472 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:12:32.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.629+0000 7f62ee800640 1 Processor -- start 2024-04-25T09:12:32.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.629+0000 7f62ee800640 1 -- start start 2024-04-25T09:12:32.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.629+0000 7f62ee800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f62e80b0d70 0x7f62e815ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.629+0000 7f62ee800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f62e80ccff0 0x7f62e80cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.629+0000 7f62ee800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e80cdaa0 con 0x7f62e80ce680 2024-04-25T09:12:32.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.629+0000 7f62ee800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e806d3d0 con 0x7f62e80ccff0 2024-04-25T09:12:32.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.629+0000 7f62ee800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e806d670 con 0x7f62e80b0d70 2024-04-25T09:12:32.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.629+0000 7f62eca00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f62e80ccff0 0x7f62e80cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.629+0000 7f62eca00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f62e80ccff0 0x7f62e80cd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52130/0 (socket says 172.21.15.173:52130) 2024-04-25T09:12:32.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.629+0000 7f62eca00640 1 -- 172.21.15.173:0/224586021 learned_addr learned my addr 172.21.15.173:0/224586021 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:32.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.629+0000 7f62ed400640 1 --2- 172.21.15.173:0/224586021 >> v2:172.21.15.194:3300/0 conn(0x7f62e80b0d70 0x7f62e815ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.629+0000 7f62eca00640 1 -- 172.21.15.173:0/224586021 >> v2:172.21.15.194:3300/0 conn(0x7f62e80b0d70 msgr2=0x7f62e815ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:32.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.629+0000 7f62eca00640 1 --2- 172.21.15.173:0/224586021 >> v2:172.21.15.194:3300/0 conn(0x7f62e80b0d70 0x7f62e815ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.629+0000 7f62eca00640 1 -- 172.21.15.173:0/224586021 >> v1:172.21.15.194:6789/0 conn(0x7f62e80ce680 legacy=0x7f62e806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.629+0000 7f62eca00640 1 -- 172.21.15.173:0/224586021 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e806d950 con 0x7f62e80ccff0 2024-04-25T09:12:32.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.633+0000 7f62eca00640 1 --2- 172.21.15.173:0/224586021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e80ccff0 0x7f62e80cd450 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f62e80b4e90 tx=0x7f62d401eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7b4cfb6a0b4dd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:32.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.633+0000 7f62e7e00640 1 -- 172.21.15.173:0/224586021 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d40b4070 con 0x7f62e80ccff0 2024-04-25T09:12:32.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.633+0000 7f62e7e00640 1 -- 172.21.15.173:0/224586021 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d40a7a10 con 0x7f62e80ccff0 2024-04-25T09:12:32.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.633+0000 7f62e7e00640 1 -- 172.21.15.173:0/224586021 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d40a7de0 con 0x7f62e80ccff0 2024-04-25T09:12:32.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.633+0000 7f62ee800640 1 -- 172.21.15.173:0/224586021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e80ccff0 msgr2=0x7f62e80cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.633+0000 7f62ee800640 1 --2- 172.21.15.173:0/224586021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e80ccff0 0x7f62e80cd450 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f62e80b4e90 tx=0x7f62d401eb30 comp rx=0 tx=0).stop 2024-04-25T09:12:32.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.633+0000 7f62ee800640 1 -- 172.21.15.173:0/224586021 shutdown_connections 2024-04-25T09:12:32.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.633+0000 7f62ee800640 1 --2- 172.21.15.173:0/224586021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e80ccff0 0x7f62e80cd450 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.633+0000 7f62ee800640 1 --2- 172.21.15.173:0/224586021 >> v2:172.21.15.194:3300/0 conn(0x7f62e80b0d70 0x7f62e815ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.633+0000 7f62ee800640 1 -- 172.21.15.173:0/224586021 >> 172.21.15.173:0/224586021 conn(0x7f62e8061d40 msgr2=0x7f62e806ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:32.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.633+0000 7f62ee800640 1 -- 172.21.15.173:0/224586021 shutdown_connections 2024-04-25T09:12:32.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.633+0000 7f62ee800640 1 -- 172.21.15.173:0/224586021 wait complete. 2024-04-25T09:12:32.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.633+0000 7f62ee800640 1 Processor -- start 2024-04-25T09:12:32.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.633+0000 7f62ee800640 1 -- start start 2024-04-25T09:12:32.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ee800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e80b0d70 0x7f62e813b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ee800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62e80ccff0 0x7f62e8142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ee800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62e80ce680 0x7f62e81430b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ee800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e80ceea0 con 0x7f62e80b0d70 2024-04-25T09:12:32.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ee800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e815b1d0 con 0x7f62e80ce680 2024-04-25T09:12:32.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ee800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e813c980 con 0x7f62e80ccff0 2024-04-25T09:12:32.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ed400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e80b0d70 0x7f62e813b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ed400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e80b0d70 0x7f62e813b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52144/0 (socket says 172.21.15.173:52144) 2024-04-25T09:12:32.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ed400640 1 -- 172.21.15.173:0/2581602357 learned_addr learned my addr 172.21.15.173:0/2581602357 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:32.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ede00640 1 --2- 172.21.15.173:0/2581602357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62e80ce680 0x7f62e81430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62eca00640 1 --2- 172.21.15.173:0/2581602357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62e80ccff0 0x7f62e8142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ed400640 1 -- 172.21.15.173:0/2581602357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62e80ccff0 msgr2=0x7f62e8142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ed400640 1 --2- 172.21.15.173:0/2581602357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62e80ccff0 0x7f62e8142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ed400640 1 -- 172.21.15.173:0/2581602357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62e80ce680 msgr2=0x7f62e81430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ed400640 1 --2- 172.21.15.173:0/2581602357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62e80ce680 0x7f62e81430b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ed400640 1 -- 172.21.15.173:0/2581602357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e815bd20 con 0x7f62e80b0d70 2024-04-25T09:12:32.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ede00640 1 --2- 172.21.15.173:0/2581602357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62e80ce680 0x7f62e81430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:32.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ed400640 1 --2- 172.21.15.173:0/2581602357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e80b0d70 0x7f62e813b4f0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00d800 tx=0x7f62dc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:32.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62e5600640 1 -- 172.21.15.173:0/2581602357 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc00b6c0 con 0x7f62e80b0d70 2024-04-25T09:12:32.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62e5600640 1 -- 172.21.15.173:0/2581602357 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc019070 con 0x7f62e80b0d70 2024-04-25T09:12:32.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62e5600640 1 -- 172.21.15.173:0/2581602357 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc00bae0 con 0x7f62e80b0d70 2024-04-25T09:12:32.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ee800640 1 -- 172.21.15.173:0/2581602357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e813bd70 con 0x7f62e80b0d70 2024-04-25T09:12:32.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ee800640 1 -- 172.21.15.173:0/2581602357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e813c330 con 0x7f62e80b0d70 2024-04-25T09:12:32.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62ee800640 1 -- 172.21.15.173:0/2581602357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e8073a40 con 0x7f62e80b0d70 2024-04-25T09:12:32.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.637+0000 7f62e5600640 1 -- 172.21.15.173:0/2581602357 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f62dc00bc80 con 0x7f62e80b0d70 2024-04-25T09:12:32.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.641+0000 7f62e5600640 1 --2- 172.21.15.173:0/2581602357 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f62c8066f60 0x7f62c8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.641+0000 7f62e5600640 1 -- 172.21.15.173:0/2581602357 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f62dc085330 con 0x7f62e80b0d70 2024-04-25T09:12:32.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.641+0000 7f62eca00640 1 --2- 172.21.15.173:0/2581602357 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f62c8066f60 0x7f62c8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.641+0000 7f62eca00640 1 --2- 172.21.15.173:0/2581602357 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f62c8066f60 0x7f62c8069420 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f62d40b1000 tx=0x7f62d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:32.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.645+0000 7f62e5600640 1 -- 172.21.15.173:0/2581602357 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f62dc056460 con 0x7f62e80b0d70 2024-04-25T09:12:32.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:32.797+0000 7f62ee800640 1 -- 172.21.15.173:0/2581602357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f62e806ba50 con 0x7f62e80b0d70 2024-04-25T09:12:33.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.081+0000 7f62e5600640 1 -- 172.21.15.173:0/2581602357 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v130) v1 ==== 138+0+0 (secure 0 0 0) 0x7f62dc055d60 con 0x7f62e80b0d70 2024-04-25T09:12:33.065 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' created 2024-04-25T09:12:33.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.081+0000 7f62ee800640 1 -- 172.21.15.173:0/2581602357 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f62c8066f60 msgr2=0x7f62c8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.081+0000 7f62ee800640 1 --2- 172.21.15.173:0/2581602357 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f62c8066f60 0x7f62c8069420 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f62d40b1000 tx=0x7f62d4008040 comp rx=0 tx=0).stop 2024-04-25T09:12:33.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.081+0000 7f62ee800640 1 -- 172.21.15.173:0/2581602357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e80b0d70 msgr2=0x7f62e813b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.081+0000 7f62ee800640 1 --2- 172.21.15.173:0/2581602357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e80b0d70 0x7f62e813b4f0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00d800 tx=0x7f62dc00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.081+0000 7f62ee800640 1 -- 172.21.15.173:0/2581602357 shutdown_connections 2024-04-25T09:12:33.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.081+0000 7f62ee800640 1 --2- 172.21.15.173:0/2581602357 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f62c8066f60 0x7f62c8069420 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.081+0000 7f62ee800640 1 --2- 172.21.15.173:0/2581602357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62e80ce680 0x7f62e81430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.081+0000 7f62ee800640 1 --2- 172.21.15.173:0/2581602357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62e80ccff0 0x7f62e8142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.081+0000 7f62ee800640 1 --2- 172.21.15.173:0/2581602357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e80b0d70 0x7f62e813b4f0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.081+0000 7f62ee800640 1 -- 172.21.15.173:0/2581602357 >> 172.21.15.173:0/2581602357 conn(0x7f62e8061d40 msgr2=0x7f62e815c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:33.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.081+0000 7f62ee800640 1 -- 172.21.15.173:0/2581602357 shutdown_connections 2024-04-25T09:12:33.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.081+0000 7f62ee800640 1 -- 172.21.15.173:0/2581602357 wait complete. 2024-04-25T09:12:33.090 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:12:33.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.249+0000 7fbff9200640 1 Processor -- start 2024-04-25T09:12:33.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.249+0000 7fbff9200640 1 -- start start 2024-04-25T09:12:33.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.249+0000 7fbff9200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbff40cf3f0 0x7fbff40cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.249+0000 7fbff9200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbff41467c0 0x7fbff4146c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.249+0000 7fbff9200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff41633a0 con 0x7fbff4144e20 2024-04-25T09:12:33.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.249+0000 7fbff9200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff4145620 con 0x7fbff40cf3f0 2024-04-25T09:12:33.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.249+0000 7fbff9200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff40cfd90 con 0x7fbff41467c0 2024-04-25T09:12:33.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.249+0000 7fbfe9400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbff40cf3f0 0x7fbff40cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.249+0000 7fbff1e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fbff4144e20 0x7fbff40ce230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:59316/0 (socket says 172.21.15.173:59316) 2024-04-25T09:12:33.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.249+0000 7fbfe9400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbff40cf3f0 0x7fbff40cf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52156/0 (socket says 172.21.15.173:52156) 2024-04-25T09:12:33.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.249+0000 7fbff1e00640 1 -- 172.21.15.173:0/4222851035 learned_addr learned my addr 172.21.15.173:0/4222851035 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:33.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.249+0000 7fbff2800640 1 --2- 172.21.15.173:0/4222851035 >> v2:172.21.15.194:3300/0 conn(0x7fbff41467c0 0x7fbff4146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.249+0000 7fbfe9400640 1 -- 172.21.15.173:0/4222851035 >> v2:172.21.15.194:3300/0 conn(0x7fbff41467c0 msgr2=0x7fbff4146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:33.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.249+0000 7fbfe9400640 1 --2- 172.21.15.173:0/4222851035 >> v2:172.21.15.194:3300/0 conn(0x7fbff41467c0 0x7fbff4146c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.249+0000 7fbfe9400640 1 -- 172.21.15.173:0/4222851035 >> v1:172.21.15.173:6789/0 conn(0x7fbff4144e20 legacy=0x7fbff40ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.249+0000 7fbfe9400640 1 -- 172.21.15.173:0/4222851035 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff40cecf0 con 0x7fbff40cf3f0 2024-04-25T09:12:33.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.249+0000 7fbff2800640 1 --2- 172.21.15.173:0/4222851035 >> v2:172.21.15.194:3300/0 conn(0x7fbff41467c0 0x7fbff4146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:33.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.253+0000 7fbfe9400640 1 --2- 172.21.15.173:0/4222851035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbff40cf3f0 0x7fbff40cf850 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fbff40b3460 tx=0x7fbfdc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460ee5ae5fd7bcc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:33.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.253+0000 7fbff1400640 1 -- 172.21.15.173:0/4222851035 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc0b0070 con 0x7fbff40cf3f0 2024-04-25T09:12:33.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.253+0000 7fbff1400640 1 -- 172.21.15.173:0/4222851035 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc0ab600 con 0x7fbff40cf3f0 2024-04-25T09:12:33.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.253+0000 7fbff1400640 1 -- 172.21.15.173:0/4222851035 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc0ab9d0 con 0x7fbff40cf3f0 2024-04-25T09:12:33.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.253+0000 7fbff9200640 1 -- 172.21.15.173:0/4222851035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbff40cf3f0 msgr2=0x7fbff40cf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.253+0000 7fbff9200640 1 --2- 172.21.15.173:0/4222851035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbff40cf3f0 0x7fbff40cf850 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fbff40b3460 tx=0x7fbfdc01c480 comp rx=0 tx=0).stop 2024-04-25T09:12:33.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.253+0000 7fbff9200640 1 -- 172.21.15.173:0/4222851035 shutdown_connections 2024-04-25T09:12:33.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.253+0000 7fbff9200640 1 --2- 172.21.15.173:0/4222851035 >> v2:172.21.15.194:3300/0 conn(0x7fbff41467c0 0x7fbff4146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.253+0000 7fbff9200640 1 --2- 172.21.15.173:0/4222851035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbff40cf3f0 0x7fbff40cf850 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.253+0000 7fbff9200640 1 -- 172.21.15.173:0/4222851035 >> 172.21.15.173:0/4222851035 conn(0x7fbff406f5d0 msgr2=0x7fbff406f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:33.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.253+0000 7fbff9200640 1 -- 172.21.15.173:0/4222851035 shutdown_connections 2024-04-25T09:12:33.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.253+0000 7fbff9200640 1 -- 172.21.15.173:0/4222851035 wait complete. 2024-04-25T09:12:33.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbff9200640 1 Processor -- start 2024-04-25T09:12:33.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbff9200640 1 -- start start 2024-04-25T09:12:33.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbff9200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbff40cf3f0 0x7fbff40b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbff9200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbff4144e20 0x7fbff4139e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbff9200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbff41467c0 0x7fbff413de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbff9200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff40ce940 con 0x7fbff4144e20 2024-04-25T09:12:33.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbff9200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff4145200 con 0x7fbff40cf3f0 2024-04-25T09:12:33.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbff9200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff413e3b0 con 0x7fbff41467c0 2024-04-25T09:12:33.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbfe9400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbff4144e20 0x7fbff4139e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbfe9400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbff4144e20 0x7fbff4139e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52166/0 (socket says 172.21.15.173:52166) 2024-04-25T09:12:33.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbfe9400640 1 -- 172.21.15.173:0/1322825393 learned_addr learned my addr 172.21.15.173:0/1322825393 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:33.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbff1e00640 1 --2- 172.21.15.173:0/1322825393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbff40cf3f0 0x7fbff40b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbff2800640 1 --2- 172.21.15.173:0/1322825393 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbff41467c0 0x7fbff413de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbfe9400640 1 -- 172.21.15.173:0/1322825393 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbff41467c0 msgr2=0x7fbff413de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbfe9400640 1 --2- 172.21.15.173:0/1322825393 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbff41467c0 0x7fbff413de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbfe9400640 1 -- 172.21.15.173:0/1322825393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbff40cf3f0 msgr2=0x7fbff40b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbfe9400640 1 --2- 172.21.15.173:0/1322825393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbff40cf3f0 0x7fbff40b4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbfe9400640 1 -- 172.21.15.173:0/1322825393 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff413e5e0 con 0x7fbff4144e20 2024-04-25T09:12:33.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbff2800640 1 --2- 172.21.15.173:0/1322825393 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbff41467c0 0x7fbff413de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:33.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbfe9400640 1 --2- 172.21.15.173:0/1322825393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbff4144e20 0x7fbff4139e90 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc01a0b0 tx=0x7fbfdc019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:33.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbfeaa00640 1 -- 172.21.15.173:0/1322825393 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc0b8020 con 0x7fbff4144e20 2024-04-25T09:12:33.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbfeaa00640 1 -- 172.21.15.173:0/1322825393 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc0b4630 con 0x7fbff4144e20 2024-04-25T09:12:33.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbfeaa00640 1 -- 172.21.15.173:0/1322825393 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc0b0040 con 0x7fbff4144e20 2024-04-25T09:12:33.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbff9200640 1 -- 172.21.15.173:0/1322825393 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff413e8c0 con 0x7fbff4144e20 2024-04-25T09:12:33.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.257+0000 7fbff9200640 1 -- 172.21.15.173:0/1322825393 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff413ee80 con 0x7fbff4144e20 2024-04-25T09:12:33.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.261+0000 7fbff9200640 1 -- 172.21.15.173:0/1322825393 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff4073ab0 con 0x7fbff4144e20 2024-04-25T09:12:33.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.261+0000 7fbfeaa00640 1 -- 172.21.15.173:0/1322825393 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbfdc0bb020 con 0x7fbff4144e20 2024-04-25T09:12:33.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.261+0000 7fbfeaa00640 1 --2- 172.21.15.173:0/1322825393 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbfd0066f60 0x7fbfd0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.261+0000 7fbfeaa00640 1 -- 172.21.15.173:0/1322825393 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5619+0+0 (secure 0 0 0) 0x7fbfdc11eff0 con 0x7fbff4144e20 2024-04-25T09:12:33.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.261+0000 7fbff1e00640 1 --2- 172.21.15.173:0/1322825393 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbfd0066f60 0x7fbfd0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.265+0000 7fbff1e00640 1 --2- 172.21.15.173:0/1322825393 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbfd0066f60 0x7fbfd0069420 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbff40714f0 tx=0x7fbfe4007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:33.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.265+0000 7fbfeaa00640 1 -- 172.21.15.173:0/1322825393 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbfdc0c2030 con 0x7fbff4144e20 2024-04-25T09:12:33.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:33.421+0000 7fbff9200640 1 -- 172.21.15.173:0/1322825393 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbff414ba50 con 0x7fbff4144e20 2024-04-25T09:12:34.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.085+0000 7fbfeaa00640 1 -- 172.21.15.173:0/1322825393 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v131) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbfdc016070 con 0x7fbff4144e20 2024-04-25T09:12:34.072 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' created 2024-04-25T09:12:34.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.089+0000 7fbff9200640 1 -- 172.21.15.173:0/1322825393 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbfd0066f60 msgr2=0x7fbfd0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:34.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.089+0000 7fbff9200640 1 --2- 172.21.15.173:0/1322825393 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbfd0066f60 0x7fbfd0069420 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbff40714f0 tx=0x7fbfe4007e90 comp rx=0 tx=0).stop 2024-04-25T09:12:34.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.089+0000 7fbff9200640 1 -- 172.21.15.173:0/1322825393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbff4144e20 msgr2=0x7fbff4139e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:34.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.089+0000 7fbff9200640 1 --2- 172.21.15.173:0/1322825393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbff4144e20 0x7fbff4139e90 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc01a0b0 tx=0x7fbfdc019220 comp rx=0 tx=0).stop 2024-04-25T09:12:34.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.089+0000 7fbff9200640 1 -- 172.21.15.173:0/1322825393 shutdown_connections 2024-04-25T09:12:34.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.089+0000 7fbff9200640 1 --2- 172.21.15.173:0/1322825393 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbfd0066f60 0x7fbfd0069420 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.089+0000 7fbff9200640 1 --2- 172.21.15.173:0/1322825393 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbff41467c0 0x7fbff413de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.089+0000 7fbff9200640 1 --2- 172.21.15.173:0/1322825393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbff4144e20 0x7fbff4139e90 secure :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc01a0b0 tx=0x7fbfdc019220 comp rx=0 tx=0).stop 2024-04-25T09:12:34.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.089+0000 7fbff9200640 1 --2- 172.21.15.173:0/1322825393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbff40cf3f0 0x7fbff40b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.089+0000 7fbff9200640 1 -- 172.21.15.173:0/1322825393 >> 172.21.15.173:0/1322825393 conn(0x7fbff406f5d0 msgr2=0x7fbff4071760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:34.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.089+0000 7fbff9200640 1 -- 172.21.15.173:0/1322825393 shutdown_connections 2024-04-25T09:12:34.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.089+0000 7fbff9200640 1 -- 172.21.15.173:0/1322825393 wait complete. 2024-04-25T09:12:34.111 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:12:34.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa66000640 1 Processor -- start 2024-04-25T09:12:34.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa66000640 1 -- start start 2024-04-25T09:12:34.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa66000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7faa60145290 0x7faa6015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:34.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa66000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6015c5f0 con 0x7faa600b3fe0 2024-04-25T09:12:34.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa66000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6006d4b0 con 0x7faa600cc260 2024-04-25T09:12:34.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa66000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa600ccd80 con 0x7faa60145290 2024-04-25T09:12:34.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa57e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7faa600b3fe0 0x7faa600b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41862/0 (socket says 172.21.15.173:41862) 2024-04-25T09:12:34.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa57e00640 1 -- 172.21.15.173:0/1063925815 learned_addr learned my addr 172.21.15.173:0/1063925815 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:34.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa5f400640 1 --2- 172.21.15.173:0/1063925815 >> v2:172.21.15.194:3300/0 conn(0x7faa60145290 0x7faa6015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:34.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa5ea00640 1 -- 172.21.15.173:0/1063925815 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768505458 0 0) 0x7faa48001120 con 0x7faa600b3fe0 2024-04-25T09:12:34.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa5ea00640 1 -- 172.21.15.173:0/1063925815 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa44003530 con 0x7faa600b3fe0 2024-04-25T09:12:34.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa5ea00640 1 -- 172.21.15.173:0/1063925815 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1179152547 0 0) 0x7faa44003530 con 0x7faa600b3fe0 2024-04-25T09:12:34.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa5ea00640 1 -- 172.21.15.173:0/1063925815 >> v2:172.21.15.194:3300/0 conn(0x7faa60145290 msgr2=0x7faa6015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:34.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa5ea00640 1 --2- 172.21.15.173:0/1063925815 >> v2:172.21.15.194:3300/0 conn(0x7faa60145290 0x7faa6015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa5ea00640 1 -- 172.21.15.173:0/1063925815 >> v1:172.21.15.194:6789/0 conn(0x7faa600cc260 legacy=0x7faa600cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:34.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa5ea00640 1 -- 172.21.15.173:0/1063925815 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6006d790 con 0x7faa600b3fe0 2024-04-25T09:12:34.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa5ea00640 1 -- 172.21.15.173:0/1063925815 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7faa48001870 con 0x7faa600b3fe0 2024-04-25T09:12:34.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa5ea00640 1 -- 172.21.15.173:0/1063925815 >> v1:172.21.15.173:6789/0 conn(0x7faa600b3fe0 legacy=0x7faa600b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:34.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa5ea00640 1 --2- 172.21.15.173:0/1063925815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa440039c0 0x7faa44003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:34.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa5ea00640 1 --2- 172.21.15.173:0/1063925815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa44004810 0x7faa44004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:34.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa5ea00640 1 --2- 172.21.15.173:0/1063925815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa44005220 0x7faa4400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:34.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa5ea00640 1 -- 172.21.15.173:0/1063925815 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa600ccd80 con 0x7faa44005220 2024-04-25T09:12:34.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa5ea00640 1 -- 172.21.15.173:0/1063925815 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4400c170 con 0x7faa440039c0 2024-04-25T09:12:34.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa5ea00640 1 -- 172.21.15.173:0/1063925815 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4400c370 con 0x7faa44004810 2024-04-25T09:12:34.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa5fe00640 1 --2- 172.21.15.173:0/1063925815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa44005220 0x7faa4400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:34.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa57e00640 1 --2- 172.21.15.173:0/1063925815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa44004810 0x7faa44004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:34.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.265+0000 7faa5f400640 1 --2- 172.21.15.173:0/1063925815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa440039c0 0x7faa44003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:34.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.269+0000 7faa5fe00640 1 -- 172.21.15.173:0/1063925815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa44004810 msgr2=0x7faa44004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:34.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.269+0000 7faa5fe00640 1 --2- 172.21.15.173:0/1063925815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa44004810 0x7faa44004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.269+0000 7faa5fe00640 1 -- 172.21.15.173:0/1063925815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa440039c0 msgr2=0x7faa44003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:34.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.269+0000 7faa5fe00640 1 --2- 172.21.15.173:0/1063925815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa440039c0 0x7faa44003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.269+0000 7faa5fe00640 1 -- 172.21.15.173:0/1063925815 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa44003530 con 0x7faa44005220 2024-04-25T09:12:34.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.269+0000 7faa5fe00640 1 -- 172.21.15.173:0/1063925815 reap_dead start 2024-04-25T09:12:34.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.269+0000 7faa5fe00640 1 --2- 172.21.15.173:0/1063925815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa44005220 0x7faa4400b9d0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7faa58001f60 tx=0x7faa5801eff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa33a997a2e4981 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:34.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.269+0000 7faa5ea00640 1 -- 172.21.15.173:0/1063925815 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58001b60 con 0x7faa44005220 2024-04-25T09:12:34.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.269+0000 7faa5ea00640 1 -- 172.21.15.173:0/1063925815 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa580a8c10 con 0x7faa44005220 2024-04-25T09:12:34.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.269+0000 7faa5ea00640 1 -- 172.21.15.173:0/1063925815 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58003980 con 0x7faa44005220 2024-04-25T09:12:34.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.269+0000 7faa66000640 1 -- 172.21.15.173:0/1063925815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa44005220 msgr2=0x7faa4400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:34.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.269+0000 7faa66000640 1 --2- 172.21.15.173:0/1063925815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa44005220 0x7faa4400b9d0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7faa58001f60 tx=0x7faa5801eff0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.269+0000 7faa66000640 1 -- 172.21.15.173:0/1063925815 shutdown_connections 2024-04-25T09:12:34.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.269+0000 7faa66000640 1 --2- 172.21.15.173:0/1063925815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa44005220 0x7faa4400b9d0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.269+0000 7faa66000640 1 -- 172.21.15.173:0/1063925815 >> 172.21.15.173:0/1063925815 conn(0x7faa6006ac90 msgr2=0x7faa6006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:34.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.269+0000 7faa66000640 1 -- 172.21.15.173:0/1063925815 shutdown_connections 2024-04-25T09:12:34.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.269+0000 7faa66000640 1 -- 172.21.15.173:0/1063925815 wait complete. 2024-04-25T09:12:34.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa66000640 1 Processor -- start 2024-04-25T09:12:34.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa66000640 1 -- start start 2024-04-25T09:12:34.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa66000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa44005220 0x7faa60130d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:34.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa66000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa601419d0 0x7faa600ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:34.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa66000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa600ac8f0 0x7faa60130170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:34.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa66000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa60145670 con 0x7faa601419d0 2024-04-25T09:12:34.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa66000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6006dd50 con 0x7faa600ac8f0 2024-04-25T09:12:34.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa66000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa601457f0 con 0x7faa44005220 2024-04-25T09:12:34.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa57e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa601419d0 0x7faa600ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:34.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa57e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa601419d0 0x7faa600ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59770/0 (socket says 172.21.15.173:59770) 2024-04-25T09:12:34.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa57e00640 1 -- 172.21.15.173:0/4225973700 learned_addr learned my addr 172.21.15.173:0/4225973700 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:34.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa5fe00640 1 --2- 172.21.15.173:0/4225973700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa600ac8f0 0x7faa60130170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:34.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa5f400640 1 --2- 172.21.15.173:0/4225973700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa44005220 0x7faa60130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:34.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa57e00640 1 -- 172.21.15.173:0/4225973700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa44005220 msgr2=0x7faa60130d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:34.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa57e00640 1 --2- 172.21.15.173:0/4225973700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa44005220 0x7faa60130d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa57e00640 1 -- 172.21.15.173:0/4225973700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa600ac8f0 msgr2=0x7faa60130170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:34.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa57e00640 1 --2- 172.21.15.173:0/4225973700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa600ac8f0 0x7faa60130170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa57e00640 1 -- 172.21.15.173:0/4225973700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6012e330 con 0x7faa601419d0 2024-04-25T09:12:34.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa57e00640 1 --2- 172.21.15.173:0/4225973700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa601419d0 0x7faa600ae8b0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7faa48004f30 tx=0x7faa48007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:34.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa57400640 1 -- 172.21.15.173:0/4225973700 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4801a070 con 0x7faa601419d0 2024-04-25T09:12:34.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa57400640 1 -- 172.21.15.173:0/4225973700 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4800f6d0 con 0x7faa601419d0 2024-04-25T09:12:34.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa66000640 1 -- 172.21.15.173:0/4225973700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6012e610 con 0x7faa601419d0 2024-04-25T09:12:34.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa57400640 1 -- 172.21.15.173:0/4225973700 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4800fac0 con 0x7faa601419d0 2024-04-25T09:12:34.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.273+0000 7faa66000640 1 -- 172.21.15.173:0/4225973700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6012ebd0 con 0x7faa601419d0 2024-04-25T09:12:34.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.277+0000 7faa66000640 1 -- 172.21.15.173:0/4225973700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa60073ab0 con 0x7faa601419d0 2024-04-25T09:12:34.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.277+0000 7faa57400640 1 -- 172.21.15.173:0/4225973700 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faa4801d070 con 0x7faa601419d0 2024-04-25T09:12:34.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.277+0000 7faa57400640 1 --2- 172.21.15.173:0/4225973700 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faa3c066f60 0x7faa3c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:34.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.277+0000 7faa57400640 1 -- 172.21.15.173:0/4225973700 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6001+0+0 (secure 0 0 0) 0x7faa48084ec0 con 0x7faa601419d0 2024-04-25T09:12:34.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.277+0000 7faa5f400640 1 --2- 172.21.15.173:0/4225973700 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faa3c066f60 0x7faa3c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:34.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.281+0000 7faa5f400640 1 --2- 172.21.15.173:0/4225973700 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faa3c066f60 0x7faa3c069420 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7faa50009b60 tx=0x7faa50009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:34.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.281+0000 7faa57400640 1 -- 172.21.15.173:0/4225973700 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faa48024020 con 0x7faa601419d0 2024-04-25T09:12:34.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:34.469+0000 7faa66000640 1 -- 172.21.15.173:0/4225973700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7faa60144720 con 0x7faa601419d0 2024-04-25T09:12:35.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.109+0000 7faa57400640 1 -- 172.21.15.173:0/4225973700 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v86) v1 ==== 174+0+0 (secure 0 0 0) 0x7faa6015c5f0 con 0x7faa601419d0 2024-04-25T09:12:35.094 INFO:teuthology.orchestra.run.smithi173.stderr:new fs with metadata pool 19 and data pool 20 2024-04-25T09:12:35.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.113+0000 7faa66000640 1 -- 172.21.15.173:0/4225973700 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faa3c066f60 msgr2=0x7faa3c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:35.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.113+0000 7faa66000640 1 --2- 172.21.15.173:0/4225973700 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faa3c066f60 0x7faa3c069420 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7faa50009b60 tx=0x7faa50009190 comp rx=0 tx=0).stop 2024-04-25T09:12:35.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.113+0000 7faa66000640 1 -- 172.21.15.173:0/4225973700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa601419d0 msgr2=0x7faa600ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:35.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.113+0000 7faa66000640 1 --2- 172.21.15.173:0/4225973700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa601419d0 0x7faa600ae8b0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7faa48004f30 tx=0x7faa48007430 comp rx=0 tx=0).stop 2024-04-25T09:12:35.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.113+0000 7faa66000640 1 -- 172.21.15.173:0/4225973700 shutdown_connections 2024-04-25T09:12:35.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.113+0000 7faa66000640 1 --2- 172.21.15.173:0/4225973700 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faa3c066f60 0x7faa3c069420 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.113+0000 7faa66000640 1 --2- 172.21.15.173:0/4225973700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa600ac8f0 0x7faa60130170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.113+0000 7faa66000640 1 --2- 172.21.15.173:0/4225973700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa601419d0 0x7faa600ae8b0 secure :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7faa48004f30 tx=0x7faa48007430 comp rx=0 tx=0).stop 2024-04-25T09:12:35.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.113+0000 7faa66000640 1 --2- 172.21.15.173:0/4225973700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa44005220 0x7faa60130d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.113+0000 7faa66000640 1 -- 172.21.15.173:0/4225973700 >> 172.21.15.173:0/4225973700 conn(0x7faa6006ac90 msgr2=0x7faa60071af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:35.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.113+0000 7faa66000640 1 -- 172.21.15.173:0/4225973700 shutdown_connections 2024-04-25T09:12:35.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.117+0000 7faa66000640 1 -- 172.21.15.173:0/4225973700 wait complete. 2024-04-25T09:12:35.134 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:35.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.285+0000 7ff1c3200640 1 Processor -- start 2024-04-25T09:12:35.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.285+0000 7ff1c3200640 1 -- start start 2024-04-25T09:12:35.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.285+0000 7ff1c3200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff1bc160fe0 0x7ff1bc161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.285+0000 7ff1c3200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff1bc06dac0 0x7ff1bc0ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.285+0000 7ff1c3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1bc06bca0 0x7ff1bc06c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.285+0000 7ff1c3200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1bc1613c0 con 0x7ff1bc06dac0 2024-04-25T09:12:35.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.285+0000 7ff1c3200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1bc061d60 con 0x7ff1bc160fe0 2024-04-25T09:12:35.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.285+0000 7ff1c3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc06dfa0 con 0x7ff1bc06bca0 2024-04-25T09:12:35.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.285+0000 7ff1b3400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff1bc06dac0 0x7ff1bc0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.285+0000 7ff1b3400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff1bc06dac0 0x7ff1bc0ace00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59774/0 (socket says 172.21.15.173:59774) 2024-04-25T09:12:35.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.285+0000 7ff1b3400640 1 -- 172.21.15.173:0/1040136763 learned_addr learned my addr 172.21.15.173:0/1040136763 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:35.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.289+0000 7ff1c1200640 1 --2- 172.21.15.173:0/1040136763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1bc06bca0 0x7ff1bc06c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.289+0000 7ff1bbe00640 1 --2- 172.21.15.173:0/1040136763 >> v2:172.21.15.194:3300/0 conn(0x7ff1bc160fe0 0x7ff1bc161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.289+0000 7ff1b3400640 1 -- 172.21.15.173:0/1040136763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1bc06bca0 msgr2=0x7ff1bc06c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:35.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.289+0000 7ff1b3400640 1 --2- 172.21.15.173:0/1040136763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1bc06bca0 0x7ff1bc06c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.289+0000 7ff1b3400640 1 -- 172.21.15.173:0/1040136763 >> v2:172.21.15.194:3300/0 conn(0x7ff1bc160fe0 msgr2=0x7ff1bc161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:35.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.289+0000 7ff1b3400640 1 --2- 172.21.15.173:0/1040136763 >> v2:172.21.15.194:3300/0 conn(0x7ff1bc160fe0 0x7ff1bc161fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.289+0000 7ff1b3400640 1 -- 172.21.15.173:0/1040136763 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc06e280 con 0x7ff1bc06dac0 2024-04-25T09:12:35.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.289+0000 7ff1bbe00640 1 --2- 172.21.15.173:0/1040136763 >> v2:172.21.15.194:3300/0 conn(0x7ff1bc160fe0 0x7ff1bc161fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:35.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.289+0000 7ff1c1200640 1 --2- 172.21.15.173:0/1040136763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1bc06bca0 0x7ff1bc06c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:35.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.289+0000 7ff1b3400640 1 --2- 172.21.15.173:0/1040136763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1bc06dac0 0x7ff1bc0ace00 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc071070 tx=0x7ff1a401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0d9370a260d8bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:35.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.289+0000 7ff1bb400640 1 -- 172.21.15.173:0/1040136763 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a40b0070 con 0x7ff1bc06dac0 2024-04-25T09:12:35.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.289+0000 7ff1bb400640 1 -- 172.21.15.173:0/1040136763 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a40ab600 con 0x7ff1bc06dac0 2024-04-25T09:12:35.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.289+0000 7ff1bb400640 1 -- 172.21.15.173:0/1040136763 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a40ab9d0 con 0x7ff1bc06dac0 2024-04-25T09:12:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c3200640 1 -- 172.21.15.173:0/1040136763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1bc06dac0 msgr2=0x7ff1bc0ace00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c3200640 1 --2- 172.21.15.173:0/1040136763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1bc06dac0 0x7ff1bc0ace00 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc071070 tx=0x7ff1a401c490 comp rx=0 tx=0).stop 2024-04-25T09:12:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c3200640 1 -- 172.21.15.173:0/1040136763 shutdown_connections 2024-04-25T09:12:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c3200640 1 --2- 172.21.15.173:0/1040136763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1bc06bca0 0x7ff1bc06c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c3200640 1 --2- 172.21.15.173:0/1040136763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1bc06dac0 0x7ff1bc0ace00 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c3200640 1 --2- 172.21.15.173:0/1040136763 >> v2:172.21.15.194:3300/0 conn(0x7ff1bc160fe0 0x7ff1bc161fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c3200640 1 -- 172.21.15.173:0/1040136763 >> 172.21.15.173:0/1040136763 conn(0x7ff1bc071c20 msgr2=0x7ff1bc072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c3200640 1 -- 172.21.15.173:0/1040136763 shutdown_connections 2024-04-25T09:12:35.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c3200640 1 -- 172.21.15.173:0/1040136763 wait complete. 2024-04-25T09:12:35.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c3200640 1 Processor -- start 2024-04-25T09:12:35.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c3200640 1 -- start start 2024-04-25T09:12:35.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1bc06bca0 0x7ff1bc13ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c3200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1bc06dac0 0x7ff1bc15f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c3200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1bc160fe0 0x7ff1bc15b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c3200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc0ad340 con 0x7ff1bc160fe0 2024-04-25T09:12:35.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c3200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc1624f0 con 0x7ff1bc06dac0 2024-04-25T09:12:35.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc0ad4c0 con 0x7ff1bc06bca0 2024-04-25T09:12:35.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c1200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1bc160fe0 0x7ff1bc15b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c1200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1bc160fe0 0x7ff1bc15b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59778/0 (socket says 172.21.15.173:59778) 2024-04-25T09:12:35.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c1200640 1 -- 172.21.15.173:0/810590678 learned_addr learned my addr 172.21.15.173:0/810590678 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:35.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1b3400640 1 --2- 172.21.15.173:0/810590678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1bc06dac0 0x7ff1bc15f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1bbe00640 1 --2- 172.21.15.173:0/810590678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1bc06bca0 0x7ff1bc13ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c1200640 1 -- 172.21.15.173:0/810590678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1bc06bca0 msgr2=0x7ff1bc13ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:35.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c1200640 1 --2- 172.21.15.173:0/810590678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1bc06bca0 0x7ff1bc13ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c1200640 1 -- 172.21.15.173:0/810590678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1bc06dac0 msgr2=0x7ff1bc15f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c1200640 1 --2- 172.21.15.173:0/810590678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1bc06dac0 0x7ff1bc15f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c1200640 1 -- 172.21.15.173:0/810590678 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc158630 con 0x7ff1bc160fe0 2024-04-25T09:12:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.293+0000 7ff1c1200640 1 --2- 172.21.15.173:0/810590678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1bc160fe0 0x7ff1bc15b060 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400cef0 tx=0x7ff1b400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.297+0000 7ff1b8c00640 1 -- 172.21.15.173:0/810590678 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b401a070 con 0x7ff1bc160fe0 2024-04-25T09:12:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.297+0000 7ff1b8c00640 1 -- 172.21.15.173:0/810590678 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b400d860 con 0x7ff1bc160fe0 2024-04-25T09:12:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.297+0000 7ff1b8c00640 1 -- 172.21.15.173:0/810590678 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b400dc50 con 0x7ff1bc160fe0 2024-04-25T09:12:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.297+0000 7ff1c3200640 1 -- 172.21.15.173:0/810590678 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1bc158910 con 0x7ff1bc160fe0 2024-04-25T09:12:35.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.297+0000 7ff1c3200640 1 -- 172.21.15.173:0/810590678 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1bc158ed0 con 0x7ff1bc160fe0 2024-04-25T09:12:35.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.297+0000 7ff1c3200640 1 -- 172.21.15.173:0/810590678 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1bc073a40 con 0x7ff1bc160fe0 2024-04-25T09:12:35.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.297+0000 7ff1b8c00640 1 -- 172.21.15.173:0/810590678 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff1b401d070 con 0x7ff1bc160fe0 2024-04-25T09:12:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.297+0000 7ff1b8c00640 1 --2- 172.21.15.173:0/810590678 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff198066f60 0x7ff198069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.297+0000 7ff1b8c00640 1 -- 172.21.15.173:0/810590678 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff1b4085930 con 0x7ff1bc160fe0 2024-04-25T09:12:35.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.297+0000 7ff1bbe00640 1 --2- 172.21.15.173:0/810590678 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff198066f60 0x7ff198069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.301+0000 7ff1bbe00640 1 --2- 172.21.15.173:0/810590678 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff198066f60 0x7ff198069420 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc157390 tx=0x7ff1ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:35.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.301+0000 7ff1b8c00640 1 -- 172.21.15.173:0/810590678 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff1b40562b0 con 0x7ff1bc160fe0 2024-04-25T09:12:35.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.457+0000 7ff1c3200640 1 -- 172.21.15.173:0/810590678 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1bc0cf6c0 con 0x7ff1bc160fe0 2024-04-25T09:12:35.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.461+0000 7ff1b8c00640 1 -- 172.21.15.173:0/810590678 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+16973 (secure 0 0 0) 0x7ff1b405a350 con 0x7ff1bc160fe0 2024-04-25T09:12:35.445 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:35.445 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":132,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:12:34.472158+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:12:32.846423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-04-25T09:12:33.466675+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:35.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.461+0000 7ff1c3200640 1 -- 172.21.15.173:0/810590678 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff198066f60 msgr2=0x7ff198069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:35.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.461+0000 7ff1c3200640 1 --2- 172.21.15.173:0/810590678 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff198066f60 0x7ff198069420 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc157390 tx=0x7ff1ac008040 comp rx=0 tx=0).stop 2024-04-25T09:12:35.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.461+0000 7ff1c3200640 1 -- 172.21.15.173:0/810590678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1bc160fe0 msgr2=0x7ff1bc15b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:35.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.461+0000 7ff1c3200640 1 --2- 172.21.15.173:0/810590678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1bc160fe0 0x7ff1bc15b060 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400cef0 tx=0x7ff1b400a710 comp rx=0 tx=0).stop 2024-04-25T09:12:35.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.461+0000 7ff1c3200640 1 -- 172.21.15.173:0/810590678 shutdown_connections 2024-04-25T09:12:35.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.461+0000 7ff1c3200640 1 --2- 172.21.15.173:0/810590678 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff198066f60 0x7ff198069420 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.461+0000 7ff1c3200640 1 --2- 172.21.15.173:0/810590678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1bc160fe0 0x7ff1bc15b060 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.461+0000 7ff1c3200640 1 --2- 172.21.15.173:0/810590678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1bc06dac0 0x7ff1bc15f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.461+0000 7ff1c3200640 1 --2- 172.21.15.173:0/810590678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1bc06bca0 0x7ff1bc13ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.461+0000 7ff1c3200640 1 -- 172.21.15.173:0/810590678 >> 172.21.15.173:0/810590678 conn(0x7ff1bc071c20 msgr2=0x7ff1bc0adf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:35.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.461+0000 7ff1c3200640 1 -- 172.21.15.173:0/810590678 shutdown_connections 2024-04-25T09:12:35.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.461+0000 7ff1c3200640 1 -- 172.21.15.173:0/810590678 wait complete. 2024-04-25T09:12:35.467 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:35.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.617+0000 7fab4ce00640 1 Processor -- start 2024-04-25T09:12:35.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.617+0000 7fab4ce00640 1 -- start start 2024-04-25T09:12:35.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.617+0000 7fab4ce00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fab480b3e70 0x7fab480b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.617+0000 7fab4ce00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fab480aefa0 0x7fab480b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.617+0000 7fab4ce00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab480b4790 con 0x7fab4815edd0 2024-04-25T09:12:35.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.617+0000 7fab4ce00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4806dd50 con 0x7fab480aefa0 2024-04-25T09:12:35.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.617+0000 7fab4ce00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4815f320 con 0x7fab480b3e70 2024-04-25T09:12:35.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.617+0000 7fab45400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fab480aefa0 0x7fab480b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.617+0000 7fab45400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fab480aefa0 0x7fab480b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59784/0 (socket says 172.21.15.173:59784) 2024-04-25T09:12:35.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.617+0000 7fab45400640 1 -- 172.21.15.173:0/3432914689 learned_addr learned my addr 172.21.15.173:0/3432914689 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:35.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.617+0000 7fab45e00640 1 --2- 172.21.15.173:0/3432914689 >> v2:172.21.15.194:3300/0 conn(0x7fab480b3e70 0x7fab480b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.617+0000 7fab45400640 1 -- 172.21.15.173:0/3432914689 >> v2:172.21.15.194:3300/0 conn(0x7fab480b3e70 msgr2=0x7fab480b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:35.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.617+0000 7fab45400640 1 --2- 172.21.15.173:0/3432914689 >> v2:172.21.15.194:3300/0 conn(0x7fab480b3e70 0x7fab480b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.617+0000 7fab45400640 1 -- 172.21.15.173:0/3432914689 >> v1:172.21.15.194:6789/0 conn(0x7fab4815edd0 legacy=0x7fab480b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:35.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.617+0000 7fab45400640 1 -- 172.21.15.173:0/3432914689 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4806d420 con 0x7fab480aefa0 2024-04-25T09:12:35.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.621+0000 7fab45400640 1 --2- 172.21.15.173:0/3432914689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 0x7fab480b2770 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fab4806bca0 tx=0x7fab3401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bf1ebc13fcd738 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:35.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.621+0000 7fab44a00640 1 -- 172.21.15.173:0/3432914689 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340aa670 con 0x7fab480aefa0 2024-04-25T09:12:35.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.621+0000 7fab44a00640 1 -- 172.21.15.173:0/3432914689 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab340af070 con 0x7fab480aefa0 2024-04-25T09:12:35.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.621+0000 7fab44a00640 1 -- 172.21.15.173:0/3432914689 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340aaa30 con 0x7fab480aefa0 2024-04-25T09:12:35.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.621+0000 7fab4ce00640 1 -- 172.21.15.173:0/3432914689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 msgr2=0x7fab480b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:35.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.621+0000 7fab4ce00640 1 --2- 172.21.15.173:0/3432914689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 0x7fab480b2770 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fab4806bca0 tx=0x7fab3401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.621+0000 7fab4ce00640 1 -- 172.21.15.173:0/3432914689 shutdown_connections 2024-04-25T09:12:35.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.621+0000 7fab4ce00640 1 --2- 172.21.15.173:0/3432914689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 0x7fab480b2770 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.621+0000 7fab4ce00640 1 --2- 172.21.15.173:0/3432914689 >> v2:172.21.15.194:3300/0 conn(0x7fab480b3e70 0x7fab480b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.621+0000 7fab4ce00640 1 -- 172.21.15.173:0/3432914689 >> 172.21.15.173:0/3432914689 conn(0x7fab4806ac90 msgr2=0x7fab4806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:35.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.621+0000 7fab4ce00640 1 -- 172.21.15.173:0/3432914689 shutdown_connections 2024-04-25T09:12:35.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.621+0000 7fab4ce00640 1 -- 172.21.15.173:0/3432914689 wait complete. 2024-04-25T09:12:35.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab4ce00640 1 Processor -- start 2024-04-25T09:12:35.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab4ce00640 1 -- start start 2024-04-25T09:12:35.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab4ce00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 0x7fab481481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab4ce00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab480b3e70 0x7fab48166860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab4ce00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab4815edd0 0x7fab480b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab4ce00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4806e1c0 con 0x7fab480aefa0 2024-04-25T09:12:35.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab4ce00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4815aba0 con 0x7fab4815edd0 2024-04-25T09:12:35.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab4ce00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4806e340 con 0x7fab480b3e70 2024-04-25T09:12:35.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab45e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 0x7fab481481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab45e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 0x7fab481481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59794/0 (socket says 172.21.15.173:59794) 2024-04-25T09:12:35.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab45e00640 1 -- 172.21.15.173:0/1528503027 learned_addr learned my addr 172.21.15.173:0/1528503027 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:35.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab45400640 1 --2- 172.21.15.173:0/1528503027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab480b3e70 0x7fab48166860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab46800640 1 --2- 172.21.15.173:0/1528503027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab4815edd0 0x7fab480b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab45e00640 1 -- 172.21.15.173:0/1528503027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab480b3e70 msgr2=0x7fab48166860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:35.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab45e00640 1 --2- 172.21.15.173:0/1528503027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab480b3e70 0x7fab48166860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab45e00640 1 -- 172.21.15.173:0/1528503027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab4815edd0 msgr2=0x7fab480b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:35.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab45e00640 1 --2- 172.21.15.173:0/1528503027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab4815edd0 0x7fab480b2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab45e00640 1 -- 172.21.15.173:0/1528503027 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab48167320 con 0x7fab480aefa0 2024-04-25T09:12:35.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab45400640 1 --2- 172.21.15.173:0/1528503027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab480b3e70 0x7fab48166860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:35.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab45e00640 1 --2- 172.21.15.173:0/1528503027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 0x7fab481481f0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fab3800efc0 tx=0x7fab3800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:35.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab3e000640 1 -- 172.21.15.173:0/1528503027 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38018020 con 0x7fab480aefa0 2024-04-25T09:12:35.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab3e000640 1 -- 172.21.15.173:0/1528503027 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab38014480 con 0x7fab480aefa0 2024-04-25T09:12:35.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab4ce00640 1 -- 172.21.15.173:0/1528503027 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab48167600 con 0x7fab480aefa0 2024-04-25T09:12:35.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab3e000640 1 -- 172.21.15.173:0/1528503027 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38014870 con 0x7fab480aefa0 2024-04-25T09:12:35.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.625+0000 7fab4ce00640 1 -- 172.21.15.173:0/1528503027 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab48167bc0 con 0x7fab480aefa0 2024-04-25T09:12:35.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.629+0000 7fab4ce00640 1 -- 172.21.15.173:0/1528503027 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab48073a40 con 0x7fab480aefa0 2024-04-25T09:12:35.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.629+0000 7fab3e000640 1 -- 172.21.15.173:0/1528503027 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fab3801b020 con 0x7fab480aefa0 2024-04-25T09:12:35.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.629+0000 7fab3e000640 1 --2- 172.21.15.173:0/1528503027 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fab28066f90 0x7fab28069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.629+0000 7fab3e000640 1 -- 172.21.15.173:0/1528503027 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fab38085d40 con 0x7fab480aefa0 2024-04-25T09:12:35.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.629+0000 7fab45400640 1 --2- 172.21.15.173:0/1528503027 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fab28066f90 0x7fab28069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.629+0000 7fab45400640 1 --2- 172.21.15.173:0/1528503027 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fab28066f90 0x7fab28069450 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fab340ae000 tx=0x7fab340a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:35.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.633+0000 7fab3e000640 1 -- 172.21.15.173:0/1528503027 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fab38022070 con 0x7fab480aefa0 2024-04-25T09:12:35.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.789+0000 7fab4ce00640 1 -- 172.21.15.173:0/1528503027 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab4806e540 con 0x7fab480aefa0 2024-04-25T09:12:35.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.789+0000 7fab3e000640 1 -- 172.21.15.173:0/1528503027 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+16973 (secure 0 0 0) 0x7fab38010040 con 0x7fab480aefa0 2024-04-25T09:12:35.777 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:35.777 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":132,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:12:34.472158+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:12:32.846423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-04-25T09:12:33.466675+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:35.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.793+0000 7fab4ce00640 1 -- 172.21.15.173:0/1528503027 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fab28066f90 msgr2=0x7fab28069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:35.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.793+0000 7fab4ce00640 1 --2- 172.21.15.173:0/1528503027 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fab28066f90 0x7fab28069450 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fab340ae000 tx=0x7fab340a7000 comp rx=0 tx=0).stop 2024-04-25T09:12:35.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.793+0000 7fab4ce00640 1 -- 172.21.15.173:0/1528503027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 msgr2=0x7fab481481f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:35.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.793+0000 7fab4ce00640 1 --2- 172.21.15.173:0/1528503027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 0x7fab481481f0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fab3800efc0 tx=0x7fab3800c490 comp rx=0 tx=0).stop 2024-04-25T09:12:35.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.793+0000 7fab4ce00640 1 -- 172.21.15.173:0/1528503027 shutdown_connections 2024-04-25T09:12:35.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.793+0000 7fab4ce00640 1 --2- 172.21.15.173:0/1528503027 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fab28066f90 0x7fab28069450 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.793+0000 7fab4ce00640 1 --2- 172.21.15.173:0/1528503027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab4815edd0 0x7fab480b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.793+0000 7fab4ce00640 1 --2- 172.21.15.173:0/1528503027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab480b3e70 0x7fab48166860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.793+0000 7fab4ce00640 1 --2- 172.21.15.173:0/1528503027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab480aefa0 0x7fab481481f0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.793+0000 7fab4ce00640 1 -- 172.21.15.173:0/1528503027 >> 172.21.15.173:0/1528503027 conn(0x7fab4806ac90 msgr2=0x7fab480b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:35.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.793+0000 7fab4ce00640 1 -- 172.21.15.173:0/1528503027 shutdown_connections 2024-04-25T09:12:35.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.793+0000 7fab4ce00640 1 -- 172.21.15.173:0/1528503027 wait complete. 2024-04-25T09:12:35.799 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:12:35.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.953+0000 7ff680600640 1 Processor -- start 2024-04-25T09:12:35.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.953+0000 7ff680600640 1 -- start start 2024-04-25T09:12:35.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.953+0000 7ff680600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff678155ea0 0x7ff67815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.953+0000 7ff680600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff6780cdfc0 0x7ff6780ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.953+0000 7ff680600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6780cc730 con 0x7ff678160100 2024-04-25T09:12:35.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.953+0000 7ff680600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6780cc4f0 con 0x7ff6780cdfc0 2024-04-25T09:12:35.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.953+0000 7ff680600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67815bfe0 con 0x7ff678155ea0 2024-04-25T09:12:35.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.953+0000 7ff67dc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff678155ea0 0x7ff67815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.953+0000 7ff67e600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff6780cdfc0 0x7ff6780ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.953+0000 7ff67dc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff678155ea0 0x7ff67815cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:51656/0 (socket says 172.21.15.173:51656) 2024-04-25T09:12:35.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.953+0000 7ff67d200640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7ff678160100 0x7ff6780cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:55306/0 (socket says 172.21.15.173:55306) 2024-04-25T09:12:35.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.953+0000 7ff67dc00640 1 -- 172.21.15.173:0/1914254865 learned_addr learned my addr 172.21.15.173:0/1914254865 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:35.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.957+0000 7ff67dc00640 1 -- 172.21.15.173:0/1914254865 >> v2:172.21.15.194:3300/0 conn(0x7ff6780cdfc0 msgr2=0x7ff6780ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:35.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.957+0000 7ff67dc00640 1 --2- 172.21.15.173:0/1914254865 >> v2:172.21.15.194:3300/0 conn(0x7ff6780cdfc0 0x7ff6780ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.957+0000 7ff67dc00640 1 -- 172.21.15.173:0/1914254865 >> v1:172.21.15.194:6789/0 conn(0x7ff678160100 legacy=0x7ff6780cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:35.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.957+0000 7ff67dc00640 1 -- 172.21.15.173:0/1914254865 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67815c2c0 con 0x7ff678155ea0 2024-04-25T09:12:35.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.957+0000 7ff677e00640 1 -- 172.21.15.173:0/1914254865 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396975816 0 0) 0x7ff6780cc730 con 0x7ff678160100 2024-04-25T09:12:35.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.957+0000 7ff67e600640 1 --2- 172.21.15.173:0/1914254865 >> v2:172.21.15.194:3300/0 conn(0x7ff6780cdfc0 0x7ff6780ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:35.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.957+0000 7ff67dc00640 1 --2- 172.21.15.173:0/1914254865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff678155ea0 0x7ff67815cac0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009870 tx=0x7ff66c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed267ac0bdf3c289 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:35.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.957+0000 7ff677e00640 1 -- 172.21.15.173:0/1914254865 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c0b2070 con 0x7ff678155ea0 2024-04-25T09:12:35.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.957+0000 7ff677e00640 1 -- 172.21.15.173:0/1914254865 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66c0a9070 con 0x7ff678155ea0 2024-04-25T09:12:35.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.957+0000 7ff677e00640 1 -- 172.21.15.173:0/1914254865 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c0ad880 con 0x7ff678155ea0 2024-04-25T09:12:35.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.957+0000 7ff680600640 1 -- 172.21.15.173:0/1914254865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff678155ea0 msgr2=0x7ff67815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:35.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.957+0000 7ff680600640 1 --2- 172.21.15.173:0/1914254865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff678155ea0 0x7ff67815cac0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009870 tx=0x7ff66c01c560 comp rx=0 tx=0).stop 2024-04-25T09:12:35.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.957+0000 7ff680600640 1 -- 172.21.15.173:0/1914254865 shutdown_connections 2024-04-25T09:12:35.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.957+0000 7ff680600640 1 --2- 172.21.15.173:0/1914254865 >> v2:172.21.15.194:3300/0 conn(0x7ff6780cdfc0 0x7ff6780ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.957+0000 7ff680600640 1 --2- 172.21.15.173:0/1914254865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff678155ea0 0x7ff67815cac0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.957+0000 7ff680600640 1 -- 172.21.15.173:0/1914254865 >> 172.21.15.173:0/1914254865 conn(0x7ff6780b3460 msgr2=0x7ff6780b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:35.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff680600640 1 -- 172.21.15.173:0/1914254865 shutdown_connections 2024-04-25T09:12:35.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff680600640 1 -- 172.21.15.173:0/1914254865 wait complete. 2024-04-25T09:12:35.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff680600640 1 Processor -- start 2024-04-25T09:12:35.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff680600640 1 -- start start 2024-04-25T09:12:35.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff680600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6780cdfc0 0x7ff678154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff680600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff678155ea0 0x7ff678142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff680600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff678160100 0x7ff6781f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff680600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6780ccb90 con 0x7ff678155ea0 2024-04-25T09:12:35.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff680600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6780cca10 con 0x7ff6780cdfc0 2024-04-25T09:12:35.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff680600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6780cfb70 con 0x7ff678160100 2024-04-25T09:12:35.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff67d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff678155ea0 0x7ff678142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff67d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff678155ea0 0x7ff678142120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59810/0 (socket says 172.21.15.173:59810) 2024-04-25T09:12:35.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff67d200640 1 -- 172.21.15.173:0/857885970 learned_addr learned my addr 172.21.15.173:0/857885970 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:35.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff67dc00640 1 --2- 172.21.15.173:0/857885970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6780cdfc0 0x7ff678154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff67e600640 1 --2- 172.21.15.173:0/857885970 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff678160100 0x7ff6781f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff67d200640 1 -- 172.21.15.173:0/857885970 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff678160100 msgr2=0x7ff6781f6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:35.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff67d200640 1 --2- 172.21.15.173:0/857885970 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff678160100 0x7ff6781f6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff67d200640 1 -- 172.21.15.173:0/857885970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6780cdfc0 msgr2=0x7ff678154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:35.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff67d200640 1 --2- 172.21.15.173:0/857885970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6780cdfc0 0x7ff678154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:35.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff67d200640 1 -- 172.21.15.173:0/857885970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6781552e0 con 0x7ff678155ea0 2024-04-25T09:12:35.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff67d200640 1 --2- 172.21.15.173:0/857885970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff678155ea0 0x7ff678142120 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7ff66400c480 tx=0x7ff66400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:35.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.961+0000 7ff675600640 1 -- 172.21.15.173:0/857885970 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664018070 con 0x7ff678155ea0 2024-04-25T09:12:35.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.965+0000 7ff675600640 1 -- 172.21.15.173:0/857885970 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff664007500 con 0x7ff678155ea0 2024-04-25T09:12:35.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.965+0000 7ff680600640 1 -- 172.21.15.173:0/857885970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67814fd90 con 0x7ff678155ea0 2024-04-25T09:12:35.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.965+0000 7ff675600640 1 -- 172.21.15.173:0/857885970 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664004a30 con 0x7ff678155ea0 2024-04-25T09:12:35.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.965+0000 7ff680600640 1 -- 172.21.15.173:0/857885970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6781530c0 con 0x7ff678155ea0 2024-04-25T09:12:35.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.965+0000 7ff680600640 1 -- 172.21.15.173:0/857885970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff678073ab0 con 0x7ff678155ea0 2024-04-25T09:12:35.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.965+0000 7ff675600640 1 -- 172.21.15.173:0/857885970 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff66401b070 con 0x7ff678155ea0 2024-04-25T09:12:35.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.965+0000 7ff675600640 1 --2- 172.21.15.173:0/857885970 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff658066f90 0x7ff658069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:35.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.965+0000 7ff675600640 1 -- 172.21.15.173:0/857885970 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff664084480 con 0x7ff678155ea0 2024-04-25T09:12:35.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.965+0000 7ff67dc00640 1 --2- 172.21.15.173:0/857885970 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff658066f90 0x7ff658069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:35.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.969+0000 7ff67dc00640 1 --2- 172.21.15.173:0/857885970 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff658066f90 0x7ff658069450 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0af000 tx=0x7ff66c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:35.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:35.969+0000 7ff675600640 1 -- 172.21.15.173:0/857885970 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff6781552e0 con 0x7ff678155ea0 2024-04-25T09:12:36.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:36.165+0000 7ff680600640 1 -- 172.21.15.173:0/857885970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff6780cf030 con 0x7ff678155ea0 2024-04-25T09:12:37.064 INFO:tasks.ceph.mds.a.smithi173.stderr:2024-04-25T09:12:37.077+0000 7f6cb4a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:12:37.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.113+0000 7ff675600640 1 -- 172.21.15.173:0/857885970 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v88) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff6640552f0 con 0x7ff678155ea0 2024-04-25T09:12:37.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.117+0000 7ff680600640 1 -- 172.21.15.173:0/857885970 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff658066f90 msgr2=0x7ff658069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.117+0000 7ff680600640 1 --2- 172.21.15.173:0/857885970 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff658066f90 0x7ff658069450 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0af000 tx=0x7ff66c008040 comp rx=0 tx=0).stop 2024-04-25T09:12:37.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.117+0000 7ff680600640 1 -- 172.21.15.173:0/857885970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff678155ea0 msgr2=0x7ff678142120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.117+0000 7ff680600640 1 --2- 172.21.15.173:0/857885970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff678155ea0 0x7ff678142120 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7ff66400c480 tx=0x7ff66400c940 comp rx=0 tx=0).stop 2024-04-25T09:12:37.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.117+0000 7ff680600640 1 -- 172.21.15.173:0/857885970 shutdown_connections 2024-04-25T09:12:37.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.117+0000 7ff680600640 1 --2- 172.21.15.173:0/857885970 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff658066f90 0x7ff658069450 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.117+0000 7ff680600640 1 --2- 172.21.15.173:0/857885970 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff678160100 0x7ff6781f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.117+0000 7ff680600640 1 --2- 172.21.15.173:0/857885970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff678155ea0 0x7ff678142120 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.117+0000 7ff680600640 1 --2- 172.21.15.173:0/857885970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6780cdfc0 0x7ff678154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.117+0000 7ff680600640 1 -- 172.21.15.173:0/857885970 >> 172.21.15.173:0/857885970 conn(0x7ff6780b3460 msgr2=0x7ff6780b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:37.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.117+0000 7ff680600640 1 -- 172.21.15.173:0/857885970 shutdown_connections 2024-04-25T09:12:37.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.117+0000 7ff680600640 1 -- 172.21.15.173:0/857885970 wait complete. 2024-04-25T09:12:37.126 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:12:37.126 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:12:37.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.285+0000 7f4825800640 1 Processor -- start 2024-04-25T09:12:37.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.285+0000 7f4825800640 1 -- start start 2024-04-25T09:12:37.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.285+0000 7f4825800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f482015e120 0x7f48200b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.285+0000 7f4825800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f482006d200 0x7f4820099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.285+0000 7f4825800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48200d1490 con 0x7f48200d0630 2024-04-25T09:12:37.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.285+0000 7f4825800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48200d0bf0 con 0x7f482006d200 2024-04-25T09:12:37.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.285+0000 7f4825800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48200d0ed0 con 0x7f482015e120 2024-04-25T09:12:37.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.285+0000 7f4817e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f482006d200 0x7f4820099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.285+0000 7f4817e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f482006d200 0x7f4820099a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59824/0 (socket says 172.21.15.173:59824) 2024-04-25T09:12:37.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.285+0000 7f4817e00640 1 -- 172.21.15.173:0/979030264 learned_addr learned my addr 172.21.15.173:0/979030264 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:37.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.285+0000 7f4817e00640 1 -- 172.21.15.173:0/979030264 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f482015e120 msgr2=0x7f48200b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:37.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.285+0000 7f481ea00640 1 --2- 172.21.15.173:0/979030264 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f482015e120 0x7f48200b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.285+0000 7f4817e00640 1 --2- 172.21.15.173:0/979030264 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f482015e120 0x7f48200b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.285+0000 7f4817e00640 1 -- 172.21.15.173:0/979030264 >> v1:172.21.15.194:6789/0 conn(0x7f48200d0630 legacy=0x7f482006c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:37.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.285+0000 7f4817e00640 1 -- 172.21.15.173:0/979030264 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48200d11b0 con 0x7f482006d200 2024-04-25T09:12:37.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.285+0000 7f481ea00640 1 --2- 172.21.15.173:0/979030264 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f482015e120 0x7f48200b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:37.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.289+0000 7f4817e00640 1 --2- 172.21.15.173:0/979030264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f482006d200 0x7f4820099a50 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f4808009870 tx=0x7f480801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e19e9609604708 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:37.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.289+0000 7f481e000640 1 -- 172.21.15.173:0/979030264 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48080b2070 con 0x7f482006d200 2024-04-25T09:12:37.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.289+0000 7f481e000640 1 -- 172.21.15.173:0/979030264 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48080a9070 con 0x7f482006d200 2024-04-25T09:12:37.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.289+0000 7f481e000640 1 -- 172.21.15.173:0/979030264 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48080ad880 con 0x7f482006d200 2024-04-25T09:12:37.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.289+0000 7f4825800640 1 -- 172.21.15.173:0/979030264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f482006d200 msgr2=0x7f4820099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.289+0000 7f4825800640 1 --2- 172.21.15.173:0/979030264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f482006d200 0x7f4820099a50 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f4808009870 tx=0x7f480801c490 comp rx=0 tx=0).stop 2024-04-25T09:12:37.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.289+0000 7f4825800640 1 -- 172.21.15.173:0/979030264 shutdown_connections 2024-04-25T09:12:37.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.289+0000 7f4825800640 1 --2- 172.21.15.173:0/979030264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f482006d200 0x7f4820099a50 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.289+0000 7f4825800640 1 --2- 172.21.15.173:0/979030264 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f482015e120 0x7f48200b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.289+0000 7f4825800640 1 -- 172.21.15.173:0/979030264 >> 172.21.15.173:0/979030264 conn(0x7f48200b32a0 msgr2=0x7f48200b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:37.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.289+0000 7f4825800640 1 -- 172.21.15.173:0/979030264 shutdown_connections 2024-04-25T09:12:37.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.289+0000 7f4825800640 1 -- 172.21.15.173:0/979030264 wait complete. 2024-04-25T09:12:37.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.289+0000 7f4825800640 1 Processor -- start 2024-04-25T09:12:37.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.289+0000 7f4825800640 1 -- start start 2024-04-25T09:12:37.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f4825800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f482006d200 0x7f48201fb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f4825800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48200d0630 0x7f4820150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f4825800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f482015e120 0x7f48201570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f4825800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482016aef0 con 0x7f482006d200 2024-04-25T09:12:37.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f4825800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482016ad70 con 0x7f482015e120 2024-04-25T09:12:37.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f4825800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482016b070 con 0x7f48200d0630 2024-04-25T09:12:37.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f481ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f482006d200 0x7f48201fb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f481ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f482006d200 0x7f48201fb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59836/0 (socket says 172.21.15.173:59836) 2024-04-25T09:12:37.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f481ea00640 1 -- 172.21.15.173:0/3344056804 learned_addr learned my addr 172.21.15.173:0/3344056804 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:37.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f4817e00640 1 --2- 172.21.15.173:0/3344056804 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48200d0630 0x7f4820150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f481f400640 1 --2- 172.21.15.173:0/3344056804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f482015e120 0x7f48201570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f481ea00640 1 -- 172.21.15.173:0/3344056804 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48200d0630 msgr2=0x7f4820150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f481ea00640 1 --2- 172.21.15.173:0/3344056804 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48200d0630 0x7f4820150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f481ea00640 1 -- 172.21.15.173:0/3344056804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f482015e120 msgr2=0x7f48201570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f481ea00640 1 --2- 172.21.15.173:0/3344056804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f482015e120 0x7f48201570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f481ea00640 1 -- 172.21.15.173:0/3344056804 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48200c70c0 con 0x7f482006d200 2024-04-25T09:12:37.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f481ea00640 1 --2- 172.21.15.173:0/3344056804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f482006d200 0x7f48201fb300 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f481000c7f0 tx=0x7f481000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f4816a00640 1 -- 172.21.15.173:0/3344056804 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4810015070 con 0x7f482006d200 2024-04-25T09:12:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f4816a00640 1 -- 172.21.15.173:0/3344056804 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4810007820 con 0x7f482006d200 2024-04-25T09:12:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f4816a00640 1 -- 172.21.15.173:0/3344056804 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4810007c10 con 0x7f482006d200 2024-04-25T09:12:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f4825800640 1 -- 172.21.15.173:0/3344056804 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48200c73a0 con 0x7f482006d200 2024-04-25T09:12:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f4825800640 1 -- 172.21.15.173:0/3344056804 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48200c7960 con 0x7f482006d200 2024-04-25T09:12:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.293+0000 7f4825800640 1 -- 172.21.15.173:0/3344056804 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4820073ab0 con 0x7f482006d200 2024-04-25T09:12:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.297+0000 7f4816a00640 1 -- 172.21.15.173:0/3344056804 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4810018070 con 0x7f482006d200 2024-04-25T09:12:37.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.297+0000 7f4816a00640 1 --2- 172.21.15.173:0/3344056804 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f47fc066f90 0x7f47fc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.297+0000 7f4816a00640 1 -- 172.21.15.173:0/3344056804 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4810085240 con 0x7f482006d200 2024-04-25T09:12:37.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.297+0000 7f4817e00640 1 --2- 172.21.15.173:0/3344056804 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f47fc066f90 0x7f47fc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.297+0000 7f4817e00640 1 --2- 172.21.15.173:0/3344056804 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f47fc066f90 0x7f47fc069450 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f48080af000 tx=0x7f4808008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:37.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.301+0000 7f4816a00640 1 -- 172.21.15.173:0/3344056804 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4810055a70 con 0x7f482006d200 2024-04-25T09:12:37.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:37.489+0000 7f4825800640 1 -- 172.21.15.173:0/3344056804 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f48200b2b50 con 0x7f482006d200 2024-04-25T09:12:38.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.117+0000 7f4816a00640 1 -- 172.21.15.173:0/3344056804 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v89) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4810059b10 con 0x7f482006d200 2024-04-25T09:12:38.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.121+0000 7f4825800640 1 -- 172.21.15.173:0/3344056804 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f47fc066f90 msgr2=0x7f47fc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.121+0000 7f4825800640 1 --2- 172.21.15.173:0/3344056804 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f47fc066f90 0x7f47fc069450 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f48080af000 tx=0x7f4808008040 comp rx=0 tx=0).stop 2024-04-25T09:12:38.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.121+0000 7f4825800640 1 -- 172.21.15.173:0/3344056804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f482006d200 msgr2=0x7f48201fb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.121+0000 7f4825800640 1 --2- 172.21.15.173:0/3344056804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f482006d200 0x7f48201fb300 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f481000c7f0 tx=0x7f481000ccb0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.121+0000 7f4825800640 1 -- 172.21.15.173:0/3344056804 shutdown_connections 2024-04-25T09:12:38.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.121+0000 7f4825800640 1 --2- 172.21.15.173:0/3344056804 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f47fc066f90 0x7f47fc069450 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.121+0000 7f4825800640 1 --2- 172.21.15.173:0/3344056804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f482015e120 0x7f48201570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.121+0000 7f4825800640 1 --2- 172.21.15.173:0/3344056804 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48200d0630 0x7f4820150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.121+0000 7f4825800640 1 --2- 172.21.15.173:0/3344056804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f482006d200 0x7f48201fb300 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.121+0000 7f4825800640 1 -- 172.21.15.173:0/3344056804 >> 172.21.15.173:0/3344056804 conn(0x7f48200b32a0 msgr2=0x7f48200c52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.121+0000 7f4825800640 1 -- 172.21.15.173:0/3344056804 shutdown_connections 2024-04-25T09:12:38.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.121+0000 7f4825800640 1 -- 172.21.15.173:0/3344056804 wait complete. 2024-04-25T09:12:38.127 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:12:38.127 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:38.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.277+0000 7fe23a800640 1 Processor -- start 2024-04-25T09:12:38.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.277+0000 7fe23a800640 1 -- start start 2024-04-25T09:12:38.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.281+0000 7fe23a800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe2340b3e70 0x7fe2340b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.281+0000 7fe23a800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2340b3590 con 0x7fe2340aefa0 2024-04-25T09:12:38.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.281+0000 7fe23a800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2340b4790 con 0x7fe23415edd0 2024-04-25T09:12:38.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.281+0000 7fe23a800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23406dd50 con 0x7fe2340b3e70 2024-04-25T09:12:38.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.281+0000 7fe233400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe2340b3e70 0x7fe2340b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.281+0000 7fe233400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe2340b3e70 0x7fe2340b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59844/0 (socket says 172.21.15.173:59844) 2024-04-25T09:12:38.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.281+0000 7fe233400640 1 -- 172.21.15.173:0/1075572448 learned_addr learned my addr 172.21.15.173:0/1075572448 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:38.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.281+0000 7fe233400640 1 -- 172.21.15.173:0/1075572448 >> v1:172.21.15.194:6789/0 conn(0x7fe23415edd0 legacy=0x7fe2340b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.281+0000 7fe233400640 1 -- 172.21.15.173:0/1075572448 >> v1:172.21.15.173:6789/0 conn(0x7fe2340aefa0 legacy=0x7fe2340b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.281+0000 7fe233400640 1 -- 172.21.15.173:0/1075572448 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23415f320 con 0x7fe2340b3e70 2024-04-25T09:12:38.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.281+0000 7fe232000640 1 -- 172.21.15.173:0/1075572448 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058438762 0 0) 0x7fe2340b3590 con 0x7fe2340aefa0 2024-04-25T09:12:38.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.285+0000 7fe233400640 1 --2- 172.21.15.173:0/1075572448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2340b3e70 0x7fe2340b4250 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fe22400bb10 tx=0x7fe22401ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1338e8f42da887e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.285+0000 7fe232000640 1 -- 172.21.15.173:0/1075572448 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2240b4070 con 0x7fe2340b3e70 2024-04-25T09:12:38.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.285+0000 7fe232000640 1 -- 172.21.15.173:0/1075572448 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2240a7bf0 con 0x7fe2340b3e70 2024-04-25T09:12:38.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.285+0000 7fe232000640 1 -- 172.21.15.173:0/1075572448 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2240af440 con 0x7fe2340b3e70 2024-04-25T09:12:38.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.285+0000 7fe23a800640 1 -- 172.21.15.173:0/1075572448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2340b3e70 msgr2=0x7fe2340b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.285+0000 7fe23a800640 1 --2- 172.21.15.173:0/1075572448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2340b3e70 0x7fe2340b4250 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fe22400bb10 tx=0x7fe22401ec00 comp rx=0 tx=0).stop 2024-04-25T09:12:38.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.285+0000 7fe23a800640 1 -- 172.21.15.173:0/1075572448 shutdown_connections 2024-04-25T09:12:38.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.285+0000 7fe23a800640 1 --2- 172.21.15.173:0/1075572448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2340b3e70 0x7fe2340b4250 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.285+0000 7fe23a800640 1 -- 172.21.15.173:0/1075572448 >> 172.21.15.173:0/1075572448 conn(0x7fe23406ac90 msgr2=0x7fe23406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.285+0000 7fe23a800640 1 -- 172.21.15.173:0/1075572448 shutdown_connections 2024-04-25T09:12:38.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.285+0000 7fe23a800640 1 -- 172.21.15.173:0/1075572448 wait complete. 2024-04-25T09:12:38.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.285+0000 7fe23a800640 1 Processor -- start 2024-04-25T09:12:38.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.285+0000 7fe23a800640 1 -- start start 2024-04-25T09:12:38.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe23a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2340aefa0 0x7fe23413e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe23a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2340b3e70 0x7fe234140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe23a800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe23415edd0 0x7fe234151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe23a800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23415aba0 con 0x7fe23415edd0 2024-04-25T09:12:38.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe23a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2340ce7b0 con 0x7fe2340b3e70 2024-04-25T09:12:38.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe23a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23406e1e0 con 0x7fe2340aefa0 2024-04-25T09:12:38.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe233e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe23415edd0 0x7fe234151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe233e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe23415edd0 0x7fe234151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59858/0 (socket says 172.21.15.173:59858) 2024-04-25T09:12:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe233e00640 1 -- 172.21.15.173:0/3444413401 learned_addr learned my addr 172.21.15.173:0/3444413401 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe232a00640 1 --2- 172.21.15.173:0/3444413401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2340b3e70 0x7fe234140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe233400640 1 --2- 172.21.15.173:0/3444413401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2340aefa0 0x7fe23413e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe233e00640 1 -- 172.21.15.173:0/3444413401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2340aefa0 msgr2=0x7fe23413e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe233e00640 1 --2- 172.21.15.173:0/3444413401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2340aefa0 0x7fe23413e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe233e00640 1 -- 172.21.15.173:0/3444413401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2340b3e70 msgr2=0x7fe234140640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe233e00640 1 --2- 172.21.15.173:0/3444413401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2340b3e70 0x7fe234140640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe233e00640 1 -- 172.21.15.173:0/3444413401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe234140fb0 con 0x7fe23415edd0 2024-04-25T09:12:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe233e00640 1 --2- 172.21.15.173:0/3444413401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe23415edd0 0x7fe234151d50 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00c760 tx=0x7fe22c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe22b400640 1 -- 172.21.15.173:0/3444413401 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c003b80 con 0x7fe23415edd0 2024-04-25T09:12:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe22b400640 1 -- 172.21.15.173:0/3444413401 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22c003d20 con 0x7fe23415edd0 2024-04-25T09:12:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe22b400640 1 -- 172.21.15.173:0/3444413401 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c00aa30 con 0x7fe23415edd0 2024-04-25T09:12:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe23a800640 1 -- 172.21.15.173:0/3444413401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe234141290 con 0x7fe23415edd0 2024-04-25T09:12:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe23a800640 1 -- 172.21.15.173:0/3444413401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe234158d80 con 0x7fe23415edd0 2024-04-25T09:12:38.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe23a800640 1 -- 172.21.15.173:0/3444413401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe234073a40 con 0x7fe23415edd0 2024-04-25T09:12:38.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.289+0000 7fe22b400640 1 -- 172.21.15.173:0/3444413401 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe22c00abd0 con 0x7fe23415edd0 2024-04-25T09:12:38.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.293+0000 7fe22b400640 1 --2- 172.21.15.173:0/3444413401 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe214066f60 0x7fe214069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.293+0000 7fe22b400640 1 -- 172.21.15.173:0/3444413401 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe22c085070 con 0x7fe23415edd0 2024-04-25T09:12:38.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.293+0000 7fe233400640 1 --2- 172.21.15.173:0/3444413401 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe214066f60 0x7fe214069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.293+0000 7fe233400640 1 --2- 172.21.15.173:0/3444413401 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe214066f60 0x7fe214069420 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe2240b1000 tx=0x7fe224008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.297+0000 7fe22b400640 1 -- 172.21.15.173:0/3444413401 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe22c055ee0 con 0x7fe23415edd0 2024-04-25T09:12:38.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.481+0000 7fe23a800640 1 -- 172.21.15.173:0/3444413401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe23406f1c0 con 0x7fe23415edd0 2024-04-25T09:12:38.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.481+0000 7fe22b400640 1 -- 172.21.15.173:0/3444413401 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4952 (secure 0 0 0) 0x7fe22c0557e0 con 0x7fe23415edd0 2024-04-25T09:12:38.467 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:38.467 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":89,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":9408,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1841246276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1841246276},{"type":"v1","addr":"172.21.15.173:6835","nonce":1841246276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:34.472510+0000","modified":"2024-04-25T09:12:37.491581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9411":{"gid":9411,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3627798672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3627798672},{"type":"v1","addr":"172.21.15.173:6837","nonce":3627798672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:12:38.467 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 89 2024-04-25T09:12:38.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.481+0000 7fe23a800640 1 -- 172.21.15.173:0/3444413401 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe214066f60 msgr2=0x7fe214069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.481+0000 7fe23a800640 1 --2- 172.21.15.173:0/3444413401 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe214066f60 0x7fe214069420 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe2240b1000 tx=0x7fe224008040 comp rx=0 tx=0).stop 2024-04-25T09:12:38.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.481+0000 7fe23a800640 1 -- 172.21.15.173:0/3444413401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe23415edd0 msgr2=0x7fe234151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.481+0000 7fe23a800640 1 --2- 172.21.15.173:0/3444413401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe23415edd0 0x7fe234151d50 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00c760 tx=0x7fe22c00cc20 comp rx=0 tx=0).stop 2024-04-25T09:12:38.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.485+0000 7fe23a800640 1 -- 172.21.15.173:0/3444413401 shutdown_connections 2024-04-25T09:12:38.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.485+0000 7fe23a800640 1 --2- 172.21.15.173:0/3444413401 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe214066f60 0x7fe214069420 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.485+0000 7fe23a800640 1 --2- 172.21.15.173:0/3444413401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe23415edd0 0x7fe234151d50 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.485+0000 7fe23a800640 1 --2- 172.21.15.173:0/3444413401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2340b3e70 0x7fe234140640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.485+0000 7fe23a800640 1 --2- 172.21.15.173:0/3444413401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2340aefa0 0x7fe23413e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.485+0000 7fe23a800640 1 -- 172.21.15.173:0/3444413401 >> 172.21.15.173:0/3444413401 conn(0x7fe23406ac90 msgr2=0x7fe2340b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.485+0000 7fe23a800640 1 -- 172.21.15.173:0/3444413401 shutdown_connections 2024-04-25T09:12:38.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.485+0000 7fe23a800640 1 -- 172.21.15.173:0/3444413401 wait complete. 2024-04-25T09:12:38.488 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:38.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.637+0000 7effe2200640 1 Processor -- start 2024-04-25T09:12:38.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.637+0000 7effe2200640 1 -- start start 2024-04-25T09:12:38.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.641+0000 7effe2200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effdc0b3e70 0x7effdc0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.641+0000 7effe2200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7effdc15edd0 0x7effdc0b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.641+0000 7effe2200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effdc0b4790 con 0x7effdc0aefa0 2024-04-25T09:12:38.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.641+0000 7effe2200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effdc06dd50 con 0x7effdc15edd0 2024-04-25T09:12:38.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.641+0000 7effe2200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effdc15f320 con 0x7effdc0b3e70 2024-04-25T09:12:38.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.641+0000 7effdbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7effdc15edd0 0x7effdc0b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.641+0000 7effdbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7effdc15edd0 0x7effdc0b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59872/0 (socket says 172.21.15.173:59872) 2024-04-25T09:12:38.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.641+0000 7effdbe00640 1 -- 172.21.15.173:0/3820183014 learned_addr learned my addr 172.21.15.173:0/3820183014 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:38.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.641+0000 7effdb400640 1 --2- 172.21.15.173:0/3820183014 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effdc0b3e70 0x7effdc0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.641+0000 7effdbe00640 1 -- 172.21.15.173:0/3820183014 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effdc0b3e70 msgr2=0x7effdc0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.641+0000 7effdbe00640 1 --2- 172.21.15.173:0/3820183014 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effdc0b3e70 0x7effdc0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.641+0000 7effdbe00640 1 -- 172.21.15.173:0/3820183014 >> v1:172.21.15.194:6789/0 conn(0x7effdc0aefa0 legacy=0x7effdc0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.641+0000 7effdbe00640 1 -- 172.21.15.173:0/3820183014 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effdc06d420 con 0x7effdc15edd0 2024-04-25T09:12:38.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effdbe00640 1 --2- 172.21.15.173:0/3820183014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effdc15edd0 0x7effdc0b2e80 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7effd4009e50 tx=0x7effd401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917a36b997571ee3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effdaa00640 1 -- 172.21.15.173:0/3820183014 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd40a58f0 con 0x7effdc15edd0 2024-04-25T09:12:38.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effdaa00640 1 -- 172.21.15.173:0/3820183014 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd40a5a90 con 0x7effdc15edd0 2024-04-25T09:12:38.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effdaa00640 1 -- 172.21.15.173:0/3820183014 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd40a5e60 con 0x7effdc15edd0 2024-04-25T09:12:38.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effe2200640 1 -- 172.21.15.173:0/3820183014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effdc15edd0 msgr2=0x7effdc0b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effe2200640 1 --2- 172.21.15.173:0/3820183014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effdc15edd0 0x7effdc0b2e80 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7effd4009e50 tx=0x7effd401ca00 comp rx=0 tx=0).stop 2024-04-25T09:12:38.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effe2200640 1 -- 172.21.15.173:0/3820183014 shutdown_connections 2024-04-25T09:12:38.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effe2200640 1 --2- 172.21.15.173:0/3820183014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effdc15edd0 0x7effdc0b2e80 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effe2200640 1 --2- 172.21.15.173:0/3820183014 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effdc0b3e70 0x7effdc0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effe2200640 1 -- 172.21.15.173:0/3820183014 >> 172.21.15.173:0/3820183014 conn(0x7effdc06ac90 msgr2=0x7effdc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effe2200640 1 -- 172.21.15.173:0/3820183014 shutdown_connections 2024-04-25T09:12:38.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effe2200640 1 -- 172.21.15.173:0/3820183014 wait complete. 2024-04-25T09:12:38.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effe2200640 1 Processor -- start 2024-04-25T09:12:38.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effe2200640 1 -- start start 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effe2200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effdc0aefa0 0x7effdc14ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effe2200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effdc0b3e70 0x7effdc14a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effe2200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effdc15edd0 0x7effdc1476e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effe2200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effdc06e1c0 con 0x7effdc15edd0 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effe2200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effdc15aba0 con 0x7effdc0b3e70 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.645+0000 7effe2200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effdc06e340 con 0x7effdc0aefa0 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.649+0000 7effdbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effdc15edd0 0x7effdc1476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.649+0000 7effdbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effdc15edd0 0x7effdc1476e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59878/0 (socket says 172.21.15.173:59878) 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.649+0000 7effdbe00640 1 -- 172.21.15.173:0/3396051920 learned_addr learned my addr 172.21.15.173:0/3396051920 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.649+0000 7effdb400640 1 --2- 172.21.15.173:0/3396051920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effdc0aefa0 0x7effdc14ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.649+0000 7effd2a00640 1 --2- 172.21.15.173:0/3396051920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effdc0b3e70 0x7effdc14a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.649+0000 7effdbe00640 1 -- 172.21.15.173:0/3396051920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effdc0aefa0 msgr2=0x7effdc14ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.649+0000 7effdbe00640 1 --2- 172.21.15.173:0/3396051920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effdc0aefa0 0x7effdc14ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.649+0000 7effdbe00640 1 -- 172.21.15.173:0/3396051920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effdc0b3e70 msgr2=0x7effdc14a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.649+0000 7effdbe00640 1 --2- 172.21.15.173:0/3396051920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effdc0b3e70 0x7effdc14a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.649+0000 7effdbe00640 1 -- 172.21.15.173:0/3396051920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effdc14dc00 con 0x7effdc15edd0 2024-04-25T09:12:38.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.649+0000 7effdbe00640 1 --2- 172.21.15.173:0/3396051920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effdc15edd0 0x7effdc1476e0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7effd40af040 tx=0x7effd40197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.649+0000 7effd3e00640 1 -- 172.21.15.173:0/3396051920 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd40a58f0 con 0x7effdc15edd0 2024-04-25T09:12:38.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.649+0000 7effd3e00640 1 -- 172.21.15.173:0/3396051920 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd40adbf0 con 0x7effdc15edd0 2024-04-25T09:12:38.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.649+0000 7effd3e00640 1 -- 172.21.15.173:0/3396051920 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd4009510 con 0x7effdc15edd0 2024-04-25T09:12:38.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.649+0000 7effe2200640 1 -- 172.21.15.173:0/3396051920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effdc14dee0 con 0x7effdc15edd0 2024-04-25T09:12:38.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.649+0000 7effe2200640 1 -- 172.21.15.173:0/3396051920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effdc14e4a0 con 0x7effdc15edd0 2024-04-25T09:12:38.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.649+0000 7effe2200640 1 -- 172.21.15.173:0/3396051920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effdc1f6a00 con 0x7effdc15edd0 2024-04-25T09:12:38.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.649+0000 7effd3e00640 1 -- 172.21.15.173:0/3396051920 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7effd40c1020 con 0x7effdc15edd0 2024-04-25T09:12:38.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.653+0000 7effd3e00640 1 --2- 172.21.15.173:0/3396051920 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7effb8066f60 0x7effb8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.653+0000 7effd3e00640 1 -- 172.21.15.173:0/3396051920 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7effd411fac0 con 0x7effdc15edd0 2024-04-25T09:12:38.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.653+0000 7effdb400640 1 --2- 172.21.15.173:0/3396051920 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7effb8066f60 0x7effb8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.653+0000 7effdb400640 1 --2- 172.21.15.173:0/3396051920 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7effb8066f60 0x7effb8069420 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7effcc009a50 tx=0x7effcc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.653+0000 7effd3e00640 1 -- 172.21.15.173:0/3396051920 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7effd40c8020 con 0x7effdc15edd0 2024-04-25T09:12:38.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.809+0000 7effe2200640 1 -- 172.21.15.173:0/3396051920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effdc06f1c0 con 0x7effdc15edd0 2024-04-25T09:12:38.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.813+0000 7effd3e00640 1 -- 172.21.15.173:0/3396051920 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+16960 (secure 0 0 0) 0x7effd4016620 con 0x7effdc15edd0 2024-04-25T09:12:38.797 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:38.797 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":133,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:12:36.092214+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:12:32.846423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-04-25T09:12:33.466675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:38.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.813+0000 7effe2200640 1 -- 172.21.15.173:0/3396051920 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7effb8066f60 msgr2=0x7effb8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.813+0000 7effe2200640 1 --2- 172.21.15.173:0/3396051920 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7effb8066f60 0x7effb8069420 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7effcc009a50 tx=0x7effcc008040 comp rx=0 tx=0).stop 2024-04-25T09:12:38.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.813+0000 7effe2200640 1 -- 172.21.15.173:0/3396051920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effdc15edd0 msgr2=0x7effdc1476e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.813+0000 7effe2200640 1 --2- 172.21.15.173:0/3396051920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effdc15edd0 0x7effdc1476e0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7effd40af040 tx=0x7effd40197a0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.813+0000 7effe2200640 1 -- 172.21.15.173:0/3396051920 shutdown_connections 2024-04-25T09:12:38.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.813+0000 7effe2200640 1 --2- 172.21.15.173:0/3396051920 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7effb8066f60 0x7effb8069420 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.813+0000 7effe2200640 1 --2- 172.21.15.173:0/3396051920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effdc15edd0 0x7effdc1476e0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.813+0000 7effe2200640 1 --2- 172.21.15.173:0/3396051920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effdc0b3e70 0x7effdc14a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.813+0000 7effe2200640 1 --2- 172.21.15.173:0/3396051920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effdc0aefa0 0x7effdc14ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.813+0000 7effe2200640 1 -- 172.21.15.173:0/3396051920 >> 172.21.15.173:0/3396051920 conn(0x7effdc06ac90 msgr2=0x7effdc0cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.813+0000 7effe2200640 1 -- 172.21.15.173:0/3396051920 shutdown_connections 2024-04-25T09:12:38.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.813+0000 7effe2200640 1 -- 172.21.15.173:0/3396051920 wait complete. 2024-04-25T09:12:38.819 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:12:38.819 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:12:38.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.969+0000 7f6a8be00640 1 Processor -- start 2024-04-25T09:12:38.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.969+0000 7f6a8be00640 1 -- start start 2024-04-25T09:12:38.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.973+0000 7f6a8be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6a8c0adca0 0x7f6a8c15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.973+0000 7f6a8be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a8c15e390 0x7f6a8c06bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.973+0000 7f6a8be00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8c15e810 con 0x7f6a8c06c1e0 2024-04-25T09:12:38.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.973+0000 7f6a8be00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c15edd0 con 0x7f6a8c0adca0 2024-04-25T09:12:38.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.973+0000 7f6a8be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c06c610 con 0x7f6a8c15e390 2024-04-25T09:12:38.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.973+0000 7f6a8aa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6a8c0adca0 0x7f6a8c15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.973+0000 7f6a8b400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f6a8c06c1e0 0x7f6a8c1613d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41880/0 (socket says 172.21.15.173:41880) 2024-04-25T09:12:38.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.973+0000 7f6a8b400640 1 -- 172.21.15.173:0/3234452623 learned_addr learned my addr 172.21.15.173:0/3234452623 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:38.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.973+0000 7f6a8aa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6a8c0adca0 0x7f6a8c15de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59886/0 (socket says 172.21.15.173:59886) 2024-04-25T09:12:38.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.973+0000 7f6a83e00640 1 --2- 172.21.15.173:0/3234452623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a8c15e390 0x7f6a8c06bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.973+0000 7f6a8aa00640 1 -- 172.21.15.173:0/3234452623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a8c15e390 msgr2=0x7f6a8c06bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.973+0000 7f6a8aa00640 1 --2- 172.21.15.173:0/3234452623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a8c15e390 0x7f6a8c06bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.973+0000 7f6a8aa00640 1 -- 172.21.15.173:0/3234452623 >> v1:172.21.15.173:6789/0 conn(0x7f6a8c06c1e0 legacy=0x7f6a8c1613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.973+0000 7f6a8aa00640 1 -- 172.21.15.173:0/3234452623 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c15eaf0 con 0x7f6a8c0adca0 2024-04-25T09:12:38.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.973+0000 7f6a83e00640 1 --2- 172.21.15.173:0/3234452623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a8c15e390 0x7f6a8c06bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:38.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.973+0000 7f6a8a000640 1 -- 172.21.15.173:0/3234452623 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584191491 0 0) 0x7f6a8c15e810 con 0x7f6a8c06c1e0 2024-04-25T09:12:38.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.977+0000 7f6a8aa00640 1 --2- 172.21.15.173:0/3234452623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a8c0adca0 0x7f6a8c15de50 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c0097c0 tx=0x7f6a7c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fab59dfd687037b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.977+0000 7f6a8a000640 1 -- 172.21.15.173:0/3234452623 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c0b1070 con 0x7f6a8c0adca0 2024-04-25T09:12:38.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.977+0000 7f6a8a000640 1 -- 172.21.15.173:0/3234452623 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7c0a8050 con 0x7f6a8c0adca0 2024-04-25T09:12:38.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.977+0000 7f6a8a000640 1 -- 172.21.15.173:0/3234452623 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c0ac860 con 0x7f6a8c0adca0 2024-04-25T09:12:38.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.977+0000 7f6a8be00640 1 -- 172.21.15.173:0/3234452623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a8c0adca0 msgr2=0x7f6a8c15de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.977+0000 7f6a8be00640 1 --2- 172.21.15.173:0/3234452623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a8c0adca0 0x7f6a8c15de50 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c0097c0 tx=0x7f6a7c01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.977+0000 7f6a8be00640 1 -- 172.21.15.173:0/3234452623 shutdown_connections 2024-04-25T09:12:38.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.977+0000 7f6a8be00640 1 --2- 172.21.15.173:0/3234452623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a8c15e390 0x7f6a8c06bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.977+0000 7f6a8be00640 1 --2- 172.21.15.173:0/3234452623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a8c0adca0 0x7f6a8c15de50 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.977+0000 7f6a8be00640 1 -- 172.21.15.173:0/3234452623 >> 172.21.15.173:0/3234452623 conn(0x7f6a8c071980 msgr2=0x7f6a8c071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.977+0000 7f6a8be00640 1 -- 172.21.15.173:0/3234452623 shutdown_connections 2024-04-25T09:12:38.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.977+0000 7f6a8be00640 1 -- 172.21.15.173:0/3234452623 wait complete. 2024-04-25T09:12:38.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.977+0000 7f6a8be00640 1 Processor -- start 2024-04-25T09:12:38.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.977+0000 7f6a8be00640 1 -- start start 2024-04-25T09:12:38.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.977+0000 7f6a8be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a8c06c1e0 0x7f6a8c1416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.977+0000 7f6a8be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a8c0adca0 0x7f6a8c158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.977+0000 7f6a8be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a8c15e390 0x7f6a8c1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a8be00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0ae080 con 0x7f6a8c0adca0 2024-04-25T09:12:38.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a8be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c061d50 con 0x7f6a8c15e390 2024-04-25T09:12:38.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a8be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0ae200 con 0x7f6a8c06c1e0 2024-04-25T09:12:38.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a83e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a8c0adca0 0x7f6a8c158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a83e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a8c0adca0 0x7f6a8c158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59890/0 (socket says 172.21.15.173:59890) 2024-04-25T09:12:38.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a83e00640 1 -- 172.21.15.173:0/128139016 learned_addr learned my addr 172.21.15.173:0/128139016 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:38.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a8aa00640 1 --2- 172.21.15.173:0/128139016 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a8c06c1e0 0x7f6a8c1416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a8b400640 1 --2- 172.21.15.173:0/128139016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a8c15e390 0x7f6a8c1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a83e00640 1 -- 172.21.15.173:0/128139016 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a8c06c1e0 msgr2=0x7f6a8c1416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a83e00640 1 --2- 172.21.15.173:0/128139016 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a8c06c1e0 0x7f6a8c1416e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a83e00640 1 -- 172.21.15.173:0/128139016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a8c15e390 msgr2=0x7f6a8c1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a83e00640 1 --2- 172.21.15.173:0/128139016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a8c15e390 0x7f6a8c1594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a83e00640 1 -- 172.21.15.173:0/128139016 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c06e950 con 0x7f6a8c0adca0 2024-04-25T09:12:38.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a83e00640 1 --2- 172.21.15.173:0/128139016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a8c0adca0 0x7f6a8c158f60 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400e840 tx=0x7f6a7400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a82a00640 1 -- 172.21.15.173:0/128139016 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a74017070 con 0x7f6a8c0adca0 2024-04-25T09:12:38.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a82a00640 1 -- 172.21.15.173:0/128139016 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7400c8d0 con 0x7f6a8c0adca0 2024-04-25T09:12:38.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a8be00640 1 -- 172.21.15.173:0/128139016 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8c06ec30 con 0x7f6a8c0adca0 2024-04-25T09:12:38.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a82a00640 1 -- 172.21.15.173:0/128139016 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7400f040 con 0x7f6a8c0adca0 2024-04-25T09:12:38.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a8be00640 1 -- 172.21.15.173:0/128139016 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c06f1f0 con 0x7f6a8c0adca0 2024-04-25T09:12:38.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a8be00640 1 -- 172.21.15.173:0/128139016 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8c073a40 con 0x7f6a8c0adca0 2024-04-25T09:12:38.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.981+0000 7f6a82a00640 1 -- 172.21.15.173:0/128139016 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6a7401a070 con 0x7f6a8c0adca0 2024-04-25T09:12:38.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.985+0000 7f6a82a00640 1 --2- 172.21.15.173:0/128139016 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6a68066f60 0x7f6a68069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.985+0000 7f6a82a00640 1 -- 172.21.15.173:0/128139016 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6a74084e40 con 0x7f6a8c0adca0 2024-04-25T09:12:38.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.985+0000 7f6a8aa00640 1 --2- 172.21.15.173:0/128139016 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6a68066f60 0x7f6a68069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.985+0000 7f6a8aa00640 1 --2- 172.21.15.173:0/128139016 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6a68066f60 0x7f6a68069420 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c0ae000 tx=0x7f6a7c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:38.985+0000 7f6a82a00640 1 -- 172.21.15.173:0/128139016 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6a74055c20 con 0x7f6a8c0adca0 2024-04-25T09:12:39.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.137+0000 7f6a8be00640 1 -- 172.21.15.173:0/128139016 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6a8c06bf90 con 0x7f6a68066f60 2024-04-25T09:12:39.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.145+0000 7f6a82a00640 1 -- 172.21.15.173:0/128139016 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243590 (secure 0 0 0) 0x7f6a8c06bf90 con 0x7f6a68066f60 2024-04-25T09:12:39.132 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:39.133 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:12:39.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.145+0000 7f6a8be00640 1 -- 172.21.15.173:0/128139016 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6a68066f60 msgr2=0x7f6a68069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:39.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.145+0000 7f6a8be00640 1 --2- 172.21.15.173:0/128139016 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6a68066f60 0x7f6a68069420 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c0ae000 tx=0x7f6a7c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:12:39.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.149+0000 7f6a8be00640 1 -- 172.21.15.173:0/128139016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a8c0adca0 msgr2=0x7f6a8c158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:39.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.149+0000 7f6a8be00640 1 --2- 172.21.15.173:0/128139016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a8c0adca0 0x7f6a8c158f60 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400e840 tx=0x7f6a7400ed00 comp rx=0 tx=0).stop 2024-04-25T09:12:39.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.149+0000 7f6a8be00640 1 -- 172.21.15.173:0/128139016 shutdown_connections 2024-04-25T09:12:39.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.149+0000 7f6a8be00640 1 --2- 172.21.15.173:0/128139016 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6a68066f60 0x7f6a68069420 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.149+0000 7f6a8be00640 1 --2- 172.21.15.173:0/128139016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a8c15e390 0x7f6a8c1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.149+0000 7f6a8be00640 1 --2- 172.21.15.173:0/128139016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a8c0adca0 0x7f6a8c158f60 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.149+0000 7f6a8be00640 1 --2- 172.21.15.173:0/128139016 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a8c06c1e0 0x7f6a8c1416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.149+0000 7f6a8be00640 1 -- 172.21.15.173:0/128139016 >> 172.21.15.173:0/128139016 conn(0x7f6a8c071980 msgr2=0x7f6a8c154460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:39.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.149+0000 7f6a8be00640 1 -- 172.21.15.173:0/128139016 shutdown_connections 2024-04-25T09:12:39.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.149+0000 7f6a8be00640 1 -- 172.21.15.173:0/128139016 wait complete. 2024-04-25T09:12:39.152 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":427,"stamp":"2024-04-25T09:12:38.857384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592104,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":436856,"kb_used_data":13872,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754537864,"statfs":{"total":773094113280,"available":772646772736,"internally_reserved":0,"allocated":14204928,"data_stored":7213512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":432983600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.773893"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097934+0000","last_change":"2024-04-25T09:12:35.114369+0000","last_active":"2024-04-25T09:12:36.097934+0000","last_peered":"2024-04-25T09:12:36.097934+0000","last_clean":"2024-04-25T09:12:36.097934+0000","last_became_active":"2024-04-25T09:12:35.113316+0000","last_became_peered":"2024-04-25T09:12:35.113316+0000","last_unstale":"2024-04-25T09:12:36.097934+0000","last_undegraded":"2024-04-25T09:12:36.097934+0000","last_fullsized":"2024-04-25T09:12:36.097934+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:45.449663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372005+0000","last_change":"2024-04-25T09:12:35.128837+0000","last_active":"2024-04-25T09:12:36.372005+0000","last_peered":"2024-04-25T09:12:36.372005+0000","last_clean":"2024-04-25T09:12:36.372005+0000","last_became_active":"2024-04-25T09:12:35.128494+0000","last_became_peered":"2024-04-25T09:12:35.128494+0000","last_unstale":"2024-04-25T09:12:36.372005+0000","last_undegraded":"2024-04-25T09:12:36.372005+0000","last_fullsized":"2024-04-25T09:12:36.372005+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:15.711993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097917+0000","last_change":"2024-04-25T09:12:35.109962+0000","last_active":"2024-04-25T09:12:36.097917+0000","last_peered":"2024-04-25T09:12:36.097917+0000","last_clean":"2024-04-25T09:12:36.097917+0000","last_became_active":"2024-04-25T09:12:35.109686+0000","last_became_peered":"2024-04-25T09:12:35.109686+0000","last_unstale":"2024-04-25T09:12:36.097917+0000","last_undegraded":"2024-04-25T09:12:36.097917+0000","last_fullsized":"2024-04-25T09:12:36.097917+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:33.266966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097549+0000","last_change":"2024-04-25T09:12:35.125641+0000","last_active":"2024-04-25T09:12:36.097549+0000","last_peered":"2024-04-25T09:12:36.097549+0000","last_clean":"2024-04-25T09:12:36.097549+0000","last_became_active":"2024-04-25T09:12:35.125341+0000","last_became_peered":"2024-04-25T09:12:35.125341+0000","last_unstale":"2024-04-25T09:12:36.097549+0000","last_undegraded":"2024-04-25T09:12:36.097549+0000","last_fullsized":"2024-04-25T09:12:36.097549+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:49.194891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096964+0000","last_change":"2024-04-25T09:12:35.116739+0000","last_active":"2024-04-25T09:12:36.096964+0000","last_peered":"2024-04-25T09:12:36.096964+0000","last_clean":"2024-04-25T09:12:36.096964+0000","last_became_active":"2024-04-25T09:12:35.116447+0000","last_became_peered":"2024-04-25T09:12:35.116447+0000","last_unstale":"2024-04-25T09:12:36.096964+0000","last_undegraded":"2024-04-25T09:12:36.096964+0000","last_fullsized":"2024-04-25T09:12:36.096964+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:38.388538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371875+0000","last_change":"2024-04-25T09:12:35.127360+0000","last_active":"2024-04-25T09:12:36.371875+0000","last_peered":"2024-04-25T09:12:36.371875+0000","last_clean":"2024-04-25T09:12:36.371875+0000","last_became_active":"2024-04-25T09:12:35.127080+0000","last_became_peered":"2024-04-25T09:12:35.127080+0000","last_unstale":"2024-04-25T09:12:36.371875+0000","last_undegraded":"2024-04-25T09:12:36.371875+0000","last_fullsized":"2024-04-25T09:12:36.371875+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:34.934426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097559+0000","last_change":"2024-04-25T09:12:35.109705+0000","last_active":"2024-04-25T09:12:36.097559+0000","last_peered":"2024-04-25T09:12:36.097559+0000","last_clean":"2024-04-25T09:12:36.097559+0000","last_became_active":"2024-04-25T09:12:35.109437+0000","last_became_peered":"2024-04-25T09:12:35.109437+0000","last_unstale":"2024-04-25T09:12:36.097559+0000","last_undegraded":"2024-04-25T09:12:36.097559+0000","last_fullsized":"2024-04-25T09:12:36.097559+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:15.440771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371926+0000","last_change":"2024-04-25T09:12:35.128555+0000","last_active":"2024-04-25T09:12:36.371926+0000","last_peered":"2024-04-25T09:12:36.371926+0000","last_clean":"2024-04-25T09:12:36.371926+0000","last_became_active":"2024-04-25T09:12:35.127720+0000","last_became_peered":"2024-04-25T09:12:35.127720+0000","last_unstale":"2024-04-25T09:12:36.371926+0000","last_undegraded":"2024-04-25T09:12:36.371926+0000","last_fullsized":"2024-04-25T09:12:36.371926+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:06.969509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085382+0000","last_change":"2024-04-25T09:12:33.085382+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085382+0000","last_undegraded":"2024-04-25T09:12:33.085382+0000","last_fullsized":"2024-04-25T09:12:33.085382+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097381+0000","last_change":"2024-04-25T09:12:35.111869+0000","last_active":"2024-04-25T09:12:36.097381+0000","last_peered":"2024-04-25T09:12:36.097381+0000","last_clean":"2024-04-25T09:12:36.097381+0000","last_became_active":"2024-04-25T09:12:35.111471+0000","last_became_peered":"2024-04-25T09:12:35.111471+0000","last_unstale":"2024-04-25T09:12:36.097381+0000","last_undegraded":"2024-04-25T09:12:36.097381+0000","last_fullsized":"2024-04-25T09:12:36.097381+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:12.635916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090084+0000","last_change":"2024-04-25T09:12:33.090084+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090084+0000","last_undegraded":"2024-04-25T09:12:33.090084+0000","last_fullsized":"2024-04-25T09:12:33.090084+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372261+0000","last_change":"2024-04-25T09:12:34.113365+0000","last_active":"2024-04-25T09:12:36.372261+0000","last_peered":"2024-04-25T09:12:36.372261+0000","last_clean":"2024-04-25T09:12:36.372261+0000","last_became_active":"2024-04-25T09:12:34.113074+0000","last_became_peered":"2024-04-25T09:12:34.113074+0000","last_unstale":"2024-04-25T09:12:36.372261+0000","last_undegraded":"2024-04-25T09:12:36.372261+0000","last_fullsized":"2024-04-25T09:12:36.372261+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:17.490405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097632+0000","last_change":"2024-04-25T09:12:35.116889+0000","last_active":"2024-04-25T09:12:36.097632+0000","last_peered":"2024-04-25T09:12:36.097632+0000","last_clean":"2024-04-25T09:12:36.097632+0000","last_became_active":"2024-04-25T09:12:35.116633+0000","last_became_peered":"2024-04-25T09:12:35.116633+0000","last_unstale":"2024-04-25T09:12:36.097632+0000","last_undegraded":"2024-04-25T09:12:36.097632+0000","last_fullsized":"2024-04-25T09:12:36.097632+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:04.492092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371747+0000","last_change":"2024-04-25T09:12:34.112627+0000","last_active":"2024-04-25T09:12:36.371747+0000","last_peered":"2024-04-25T09:12:36.371747+0000","last_clean":"2024-04-25T09:12:36.371747+0000","last_became_active":"2024-04-25T09:12:34.112324+0000","last_became_peered":"2024-04-25T09:12:34.112324+0000","last_unstale":"2024-04-25T09:12:36.371747+0000","last_undegraded":"2024-04-25T09:12:36.371747+0000","last_fullsized":"2024-04-25T09:12:36.371747+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:39.328452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090857+0000","last_change":"2024-04-25T09:12:33.090857+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090857+0000","last_undegraded":"2024-04-25T09:12:33.090857+0000","last_fullsized":"2024-04-25T09:12:33.090857+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.089714+0000","last_change":"2024-04-25T09:12:33.089714+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.089714+0000","last_undegraded":"2024-04-25T09:12:33.089714+0000","last_fullsized":"2024-04-25T09:12:33.089714+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.165483+0000","last_change":"2024-04-25T09:12:33.165483+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.165483+0000","last_undegraded":"2024-04-25T09:12:33.165483+0000","last_fullsized":"2024-04-25T09:12:33.165483+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371889+0000","last_change":"2024-04-25T09:12:35.128824+0000","last_active":"2024-04-25T09:12:36.371889+0000","last_peered":"2024-04-25T09:12:36.371889+0000","last_clean":"2024-04-25T09:12:36.371889+0000","last_became_active":"2024-04-25T09:12:35.128530+0000","last_became_peered":"2024-04-25T09:12:35.128530+0000","last_unstale":"2024-04-25T09:12:36.371889+0000","last_undegraded":"2024-04-25T09:12:36.371889+0000","last_fullsized":"2024-04-25T09:12:36.371889+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:26.609412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085149+0000","last_change":"2024-04-25T09:12:33.085149+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085149+0000","last_undegraded":"2024-04-25T09:12:33.085149+0000","last_fullsized":"2024-04-25T09:12:33.085149+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096961+0000","last_change":"2024-04-25T09:12:35.115352+0000","last_active":"2024-04-25T09:12:36.096961+0000","last_peered":"2024-04-25T09:12:36.096961+0000","last_clean":"2024-04-25T09:12:36.096961+0000","last_became_active":"2024-04-25T09:12:35.115090+0000","last_became_peered":"2024-04-25T09:12:35.115090+0000","last_unstale":"2024-04-25T09:12:36.096961+0000","last_undegraded":"2024-04-25T09:12:36.096961+0000","last_fullsized":"2024-04-25T09:12:36.096961+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:03.804395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085671+0000","last_change":"2024-04-25T09:12:33.085671+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085671+0000","last_undegraded":"2024-04-25T09:12:33.085671+0000","last_fullsized":"2024-04-25T09:12:33.085671+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097883+0000","last_change":"2024-04-25T09:12:34.116925+0000","last_active":"2024-04-25T09:12:36.097883+0000","last_peered":"2024-04-25T09:12:36.097883+0000","last_clean":"2024-04-25T09:12:36.097883+0000","last_became_active":"2024-04-25T09:12:34.116013+0000","last_became_peered":"2024-04-25T09:12:34.116013+0000","last_unstale":"2024-04-25T09:12:36.097883+0000","last_undegraded":"2024-04-25T09:12:36.097883+0000","last_fullsized":"2024-04-25T09:12:36.097883+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:49.636624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"132'3","reported_seq":17,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372141+0000","last_change":"2024-04-25T09:12:34.111922+0000","last_active":"2024-04-25T09:12:36.372141+0000","last_peered":"2024-04-25T09:12:36.372141+0000","last_clean":"2024-04-25T09:12:36.372141+0000","last_became_active":"2024-04-25T09:12:34.111591+0000","last_became_peered":"2024-04-25T09:12:34.111591+0000","last_unstale":"2024-04-25T09:12:36.372141+0000","last_undegraded":"2024-04-25T09:12:36.372141+0000","last_fullsized":"2024-04-25T09:12:36.372141+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:49.439435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"132'6","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372376+0000","last_change":"2024-04-25T09:12:34.114195+0000","last_active":"2024-04-25T09:12:36.372376+0000","last_peered":"2024-04-25T09:12:36.372376+0000","last_clean":"2024-04-25T09:12:36.372376+0000","last_became_active":"2024-04-25T09:12:34.113862+0000","last_became_peered":"2024-04-25T09:12:34.113862+0000","last_unstale":"2024-04-25T09:12:36.372376+0000","last_undegraded":"2024-04-25T09:12:36.372376+0000","last_fullsized":"2024-04-25T09:12:36.372376+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:00.424853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097525+0000","last_change":"2024-04-25T09:12:34.115786+0000","last_active":"2024-04-25T09:12:36.097525+0000","last_peered":"2024-04-25T09:12:36.097525+0000","last_clean":"2024-04-25T09:12:36.097525+0000","last_became_active":"2024-04-25T09:12:34.115524+0000","last_became_peered":"2024-04-25T09:12:34.115524+0000","last_unstale":"2024-04-25T09:12:36.097525+0000","last_undegraded":"2024-04-25T09:12:36.097525+0000","last_fullsized":"2024-04-25T09:12:36.097525+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:39.699444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372510+0000","last_change":"2024-04-25T09:12:35.131021+0000","last_active":"2024-04-25T09:12:36.372510+0000","last_peered":"2024-04-25T09:12:36.372510+0000","last_clean":"2024-04-25T09:12:36.372510+0000","last_became_active":"2024-04-25T09:12:35.130750+0000","last_became_peered":"2024-04-25T09:12:35.130750+0000","last_unstale":"2024-04-25T09:12:36.372510+0000","last_undegraded":"2024-04-25T09:12:36.372510+0000","last_fullsized":"2024-04-25T09:12:36.372510+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:37.039253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085160+0000","last_change":"2024-04-25T09:12:33.085160+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085160+0000","last_undegraded":"2024-04-25T09:12:33.085160+0000","last_fullsized":"2024-04-25T09:12:33.085160+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.165346+0000","last_change":"2024-04-25T09:12:33.165346+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.165346+0000","last_undegraded":"2024-04-25T09:12:33.165346+0000","last_fullsized":"2024-04-25T09:12:33.165346+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085076+0000","last_change":"2024-04-25T09:12:33.085076+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085076+0000","last_undegraded":"2024-04-25T09:12:33.085076+0000","last_fullsized":"2024-04-25T09:12:33.085076+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371368+0000","last_change":"2024-04-25T09:12:35.125572+0000","last_active":"2024-04-25T09:12:36.371368+0000","last_peered":"2024-04-25T09:12:36.371368+0000","last_clean":"2024-04-25T09:12:36.371368+0000","last_became_active":"2024-04-25T09:12:35.125300+0000","last_became_peered":"2024-04-25T09:12:35.125300+0000","last_unstale":"2024-04-25T09:12:36.371368+0000","last_undegraded":"2024-04-25T09:12:36.371368+0000","last_fullsized":"2024-04-25T09:12:36.371368+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:05.811985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085168+0000","last_change":"2024-04-25T09:12:33.085168+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085168+0000","last_undegraded":"2024-04-25T09:12:33.085168+0000","last_fullsized":"2024-04-25T09:12:33.085168+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371601+0000","last_change":"2024-04-25T09:12:35.125851+0000","last_active":"2024-04-25T09:12:36.371601+0000","last_peered":"2024-04-25T09:12:36.371601+0000","last_clean":"2024-04-25T09:12:36.371601+0000","last_became_active":"2024-04-25T09:12:35.125343+0000","last_became_peered":"2024-04-25T09:12:35.125343+0000","last_unstale":"2024-04-25T09:12:36.371601+0000","last_undegraded":"2024-04-25T09:12:36.371601+0000","last_fullsized":"2024-04-25T09:12:36.371601+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:00.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.164941+0000","last_change":"2024-04-25T09:12:33.164941+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.164941+0000","last_undegraded":"2024-04-25T09:12:33.164941+0000","last_fullsized":"2024-04-25T09:12:33.164941+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.088951+0000","last_change":"2024-04-25T09:12:33.088951+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.088951+0000","last_undegraded":"2024-04-25T09:12:33.088951+0000","last_fullsized":"2024-04-25T09:12:33.088951+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090361+0000","last_change":"2024-04-25T09:12:33.090361+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090361+0000","last_undegraded":"2024-04-25T09:12:33.090361+0000","last_fullsized":"2024-04-25T09:12:33.090361+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097836+0000","last_change":"2024-04-25T09:12:35.125513+0000","last_active":"2024-04-25T09:12:36.097836+0000","last_peered":"2024-04-25T09:12:36.097836+0000","last_clean":"2024-04-25T09:12:36.097836+0000","last_became_active":"2024-04-25T09:12:35.125238+0000","last_became_peered":"2024-04-25T09:12:35.125238+0000","last_unstale":"2024-04-25T09:12:36.097836+0000","last_undegraded":"2024-04-25T09:12:36.097836+0000","last_fullsized":"2024-04-25T09:12:36.097836+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:18.547869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097596+0000","last_change":"2024-04-25T09:12:34.105311+0000","last_active":"2024-04-25T09:12:36.097596+0000","last_peered":"2024-04-25T09:12:36.097596+0000","last_clean":"2024-04-25T09:12:36.097596+0000","last_became_active":"2024-04-25T09:12:34.105070+0000","last_became_peered":"2024-04-25T09:12:34.105070+0000","last_unstale":"2024-04-25T09:12:36.097596+0000","last_undegraded":"2024-04-25T09:12:36.097596+0000","last_fullsized":"2024-04-25T09:12:36.097596+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:38.389565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371839+0000","last_change":"2024-04-25T09:12:34.114130+0000","last_active":"2024-04-25T09:12:36.371839+0000","last_peered":"2024-04-25T09:12:36.371839+0000","last_clean":"2024-04-25T09:12:36.371839+0000","last_became_active":"2024-04-25T09:12:34.113813+0000","last_became_peered":"2024-04-25T09:12:34.113813+0000","last_unstale":"2024-04-25T09:12:36.371839+0000","last_undegraded":"2024-04-25T09:12:36.371839+0000","last_fullsized":"2024-04-25T09:12:36.371839+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:19.761568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.164934+0000","last_change":"2024-04-25T09:12:33.164934+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.164934+0000","last_undegraded":"2024-04-25T09:12:33.164934+0000","last_fullsized":"2024-04-25T09:12:33.164934+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097979+0000","last_change":"2024-04-25T09:12:34.110412+0000","last_active":"2024-04-25T09:12:36.097979+0000","last_peered":"2024-04-25T09:12:36.097979+0000","last_clean":"2024-04-25T09:12:36.097979+0000","last_became_active":"2024-04-25T09:12:34.110163+0000","last_became_peered":"2024-04-25T09:12:34.110163+0000","last_unstale":"2024-04-25T09:12:36.097979+0000","last_undegraded":"2024-04-25T09:12:36.097979+0000","last_fullsized":"2024-04-25T09:12:36.097979+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:34.085553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090423+0000","last_change":"2024-04-25T09:12:33.090423+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090423+0000","last_undegraded":"2024-04-25T09:12:33.090423+0000","last_fullsized":"2024-04-25T09:12:33.090423+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371411+0000","last_change":"2024-04-25T09:12:35.130641+0000","last_active":"2024-04-25T09:12:36.371411+0000","last_peered":"2024-04-25T09:12:36.371411+0000","last_clean":"2024-04-25T09:12:36.371411+0000","last_became_active":"2024-04-25T09:12:35.130358+0000","last_became_peered":"2024-04-25T09:12:35.130358+0000","last_unstale":"2024-04-25T09:12:36.371411+0000","last_undegraded":"2024-04-25T09:12:36.371411+0000","last_fullsized":"2024-04-25T09:12:36.371411+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:23.637033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090373+0000","last_change":"2024-04-25T09:12:33.090373+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090373+0000","last_undegraded":"2024-04-25T09:12:33.090373+0000","last_fullsized":"2024-04-25T09:12:33.090373+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.164927+0000","last_change":"2024-04-25T09:12:33.164927+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.164927+0000","last_undegraded":"2024-04-25T09:12:33.164927+0000","last_fullsized":"2024-04-25T09:12:33.164927+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085076+0000","last_change":"2024-04-25T09:12:33.085076+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085076+0000","last_undegraded":"2024-04-25T09:12:33.085076+0000","last_fullsized":"2024-04-25T09:12:33.085076+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371652+0000","last_change":"2024-04-25T09:12:34.111472+0000","last_active":"2024-04-25T09:12:36.371652+0000","last_peered":"2024-04-25T09:12:36.371652+0000","last_clean":"2024-04-25T09:12:36.371652+0000","last_became_active":"2024-04-25T09:12:34.111180+0000","last_became_peered":"2024-04-25T09:12:34.111180+0000","last_unstale":"2024-04-25T09:12:36.371652+0000","last_undegraded":"2024-04-25T09:12:36.371652+0000","last_fullsized":"2024-04-25T09:12:36.371652+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:55.097890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.164849+0000","last_change":"2024-04-25T09:12:33.164849+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.164849+0000","last_undegraded":"2024-04-25T09:12:33.164849+0000","last_fullsized":"2024-04-25T09:12:33.164849+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372398+0000","last_change":"2024-04-25T09:12:35.132520+0000","last_active":"2024-04-25T09:12:36.372398+0000","last_peered":"2024-04-25T09:12:36.372398+0000","last_clean":"2024-04-25T09:12:36.372398+0000","last_became_active":"2024-04-25T09:12:35.132241+0000","last_became_peered":"2024-04-25T09:12:35.132241+0000","last_unstale":"2024-04-25T09:12:36.372398+0000","last_undegraded":"2024-04-25T09:12:36.372398+0000","last_fullsized":"2024-04-25T09:12:36.372398+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:16.640588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.089039+0000","last_change":"2024-04-25T09:12:33.089039+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.089039+0000","last_undegraded":"2024-04-25T09:12:33.089039+0000","last_fullsized":"2024-04-25T09:12:33.089039+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371515+0000","last_change":"2024-04-25T09:12:34.114900+0000","last_active":"2024-04-25T09:12:36.371515+0000","last_peered":"2024-04-25T09:12:36.371515+0000","last_clean":"2024-04-25T09:12:36.371515+0000","last_became_active":"2024-04-25T09:12:34.114551+0000","last_became_peered":"2024-04-25T09:12:34.114551+0000","last_unstale":"2024-04-25T09:12:36.371515+0000","last_undegraded":"2024-04-25T09:12:36.371515+0000","last_fullsized":"2024-04-25T09:12:36.371515+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:17.056789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":376,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371118+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:12:36.371118+0000","last_peered":"2024-04-25T09:12:36.371118+0000","last_clean":"2024-04-25T09:12:36.371118+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:12:36.371118+0000","last_undegraded":"2024-04-25T09:12:36.371118+0000","last_fullsized":"2024-04-25T09:12:36.371118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":1736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509562,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54976,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316864,"statfs":{"total":96636764160,"available":96580468736,"internally_reserved":0,"allocated":1617920,"data_stored":750230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509562,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50816,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321024,"statfs":{"total":96636764160,"available":96584728576,"internally_reserved":0,"allocated":1617920,"data_stored":750230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509563,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59124,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312716,"statfs":{"total":96636764160,"available":96576221184,"internally_reserved":0,"allocated":1605632,"data_stored":744021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59128,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312712,"statfs":{"total":96636764160,"available":96576217088,"internally_reserved":0,"allocated":1617920,"data_stored":750230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509563,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55016,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316824,"statfs":{"total":96636764160,"available":96580427776,"internally_reserved":0,"allocated":1662976,"data_stored":771364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509563,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50804,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321036,"statfs":{"total":96636764160,"available":96584740864,"internally_reserved":0,"allocated":1605632,"data_stored":744021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509563,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55552,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316288,"statfs":{"total":96636764160,"available":96579878912,"internally_reserved":0,"allocated":2211840,"data_stored":1340598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574971,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51440,"kb_used_data":2212,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320400,"statfs":{"total":96636764160,"available":96584089600,"internally_reserved":0,"allocated":2265088,"data_stored":1362818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:12:39.157 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:12:39.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.349+0000 7f9274600640 1 Processor -- start 2024-04-25T09:12:39.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.349+0000 7f9274600640 1 -- start start 2024-04-25T09:12:39.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.353+0000 7f9274600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f926c0b3e70 0x7f926c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:39.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.353+0000 7f9274600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926c0b3590 con 0x7f926c0aefa0 2024-04-25T09:12:39.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.353+0000 7f9274600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926c0b4790 con 0x7f926c15edd0 2024-04-25T09:12:39.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.353+0000 7f9274600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926c06dd50 con 0x7f926c0b3e70 2024-04-25T09:12:39.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.353+0000 7f9271200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f926c0aefa0 0x7f926c0b2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41894/0 (socket says 172.21.15.173:41894) 2024-04-25T09:12:39.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.353+0000 7f9271200640 1 -- 172.21.15.173:0/2957009365 learned_addr learned my addr 172.21.15.173:0/2957009365 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:39.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.353+0000 7f9271c00640 1 --2- 172.21.15.173:0/2957009365 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f926c0b3e70 0x7f926c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:39.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.353+0000 7f926be00640 1 -- 172.21.15.173:0/2957009365 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364831679 0 0) 0x7f926c0b3590 con 0x7f926c0aefa0 2024-04-25T09:12:39.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.353+0000 7f926be00640 1 -- 172.21.15.173:0/2957009365 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9254003530 con 0x7f926c0aefa0 2024-04-25T09:12:39.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.353+0000 7f926be00640 1 -- 172.21.15.173:0/2957009365 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855637127 0 0) 0x7f926c0b4790 con 0x7f926c15edd0 2024-04-25T09:12:39.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.353+0000 7f926be00640 1 -- 172.21.15.173:0/2957009365 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f926c0b3590 con 0x7f926c15edd0 2024-04-25T09:12:39.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.353+0000 7f9271c00640 1 -- 172.21.15.173:0/2957009365 >> v1:172.21.15.194:6789/0 conn(0x7f926c15edd0 legacy=0x7f926c0b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:39.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.353+0000 7f9271c00640 1 -- 172.21.15.173:0/2957009365 >> v1:172.21.15.173:6789/0 conn(0x7f926c0aefa0 legacy=0x7f926c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:39.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.353+0000 7f9271c00640 1 -- 172.21.15.173:0/2957009365 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c15f320 con 0x7f926c0b3e70 2024-04-25T09:12:39.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f9271c00640 1 --2- 172.21.15.173:0/2957009365 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f926c0b3e70 0x7f926c0b4250 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f92600097f0 tx=0x7f926001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aa944e1d32dec54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:39.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f926be00640 1 -- 172.21.15.173:0/2957009365 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92600aa430 con 0x7f926c0b3e70 2024-04-25T09:12:39.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f926be00640 1 -- 172.21.15.173:0/2957009365 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92600af070 con 0x7f926c0b3e70 2024-04-25T09:12:39.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f926be00640 1 -- 172.21.15.173:0/2957009365 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92600aa7f0 con 0x7f926c0b3e70 2024-04-25T09:12:39.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f9274600640 1 -- 172.21.15.173:0/2957009365 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f926c0b3e70 msgr2=0x7f926c0b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:39.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f9274600640 1 --2- 172.21.15.173:0/2957009365 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f926c0b3e70 0x7f926c0b4250 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f92600097f0 tx=0x7f926001c4b0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f9274600640 1 -- 172.21.15.173:0/2957009365 shutdown_connections 2024-04-25T09:12:39.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f9274600640 1 --2- 172.21.15.173:0/2957009365 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f926c0b3e70 0x7f926c0b4250 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f9274600640 1 -- 172.21.15.173:0/2957009365 >> 172.21.15.173:0/2957009365 conn(0x7f926c06ac90 msgr2=0x7f926c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:39.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f9274600640 1 -- 172.21.15.173:0/2957009365 shutdown_connections 2024-04-25T09:12:39.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f9274600640 1 -- 172.21.15.173:0/2957009365 wait complete. 2024-04-25T09:12:39.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f9274600640 1 Processor -- start 2024-04-25T09:12:39.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f9274600640 1 -- start start 2024-04-25T09:12:39.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f9274600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f926c0aefa0 0x7f926c1f7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:39.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f9274600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f926c0b3e70 0x7f926c159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:39.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f9274600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f926c15edd0 0x7f926c15ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:39.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f9274600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c15aba0 con 0x7f926c15edd0 2024-04-25T09:12:39.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f9274600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c0ce7b0 con 0x7f926c0b3e70 2024-04-25T09:12:39.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.357+0000 7f9274600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926c06e1e0 con 0x7f926c0aefa0 2024-04-25T09:12:39.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9272600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f926c15edd0 0x7f926c15ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:39.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9271200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f926c0b3e70 0x7f926c159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:39.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9271c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f926c0aefa0 0x7f926c1f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:39.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9272600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f926c15edd0 0x7f926c15ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59894/0 (socket says 172.21.15.173:59894) 2024-04-25T09:12:39.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9272600640 1 -- 172.21.15.173:0/3522894909 learned_addr learned my addr 172.21.15.173:0/3522894909 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:39.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9271c00640 1 --2- 172.21.15.173:0/3522894909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f926c0aefa0 0x7f926c1f7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:51738/0 (socket says 172.21.15.173:51738) 2024-04-25T09:12:39.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9272600640 1 -- 172.21.15.173:0/3522894909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f926c0aefa0 msgr2=0x7f926c1f7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:39.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9272600640 1 --2- 172.21.15.173:0/3522894909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f926c0aefa0 0x7f926c1f7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9272600640 1 -- 172.21.15.173:0/3522894909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f926c0b3e70 msgr2=0x7f926c159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:39.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9272600640 1 --2- 172.21.15.173:0/3522894909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f926c0b3e70 0x7f926c159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9272600640 1 -- 172.21.15.173:0/3522894909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c15b770 con 0x7f926c15edd0 2024-04-25T09:12:39.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9272600640 1 --2- 172.21.15.173:0/3522894909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f926c15edd0 0x7f926c15ad20 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f926400c760 tx=0x7f926400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:39.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9269600640 1 -- 172.21.15.173:0/3522894909 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264003b80 con 0x7f926c15edd0 2024-04-25T09:12:39.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9269600640 1 -- 172.21.15.173:0/3522894909 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9264003d20 con 0x7f926c15edd0 2024-04-25T09:12:39.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9269600640 1 -- 172.21.15.173:0/3522894909 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926400aa90 con 0x7f926c15edd0 2024-04-25T09:12:39.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9274600640 1 -- 172.21.15.173:0/3522894909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926c1f6c80 con 0x7f926c15edd0 2024-04-25T09:12:39.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9274600640 1 -- 172.21.15.173:0/3522894909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926c1f7240 con 0x7f926c15edd0 2024-04-25T09:12:39.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9274600640 1 -- 172.21.15.173:0/3522894909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926c1f7440 con 0x7f926c15edd0 2024-04-25T09:12:39.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9269600640 1 -- 172.21.15.173:0/3522894909 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f926400ac30 con 0x7f926c15edd0 2024-04-25T09:12:39.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.361+0000 7f9269600640 1 --2- 172.21.15.173:0/3522894909 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f924c066f60 0x7f924c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:39.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.365+0000 7f9269600640 1 -- 172.21.15.173:0/3522894909 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9264084fa0 con 0x7f926c15edd0 2024-04-25T09:12:39.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.365+0000 7f9271c00640 1 --2- 172.21.15.173:0/3522894909 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f924c066f60 0x7f924c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:39.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.365+0000 7f9271c00640 1 --2- 172.21.15.173:0/3522894909 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f924c066f60 0x7f924c069420 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f92600ae000 tx=0x7f92600a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:39.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.365+0000 7f9269600640 1 -- 172.21.15.173:0/3522894909 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f926c1f7440 con 0x7f926c15edd0 2024-04-25T09:12:39.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.517+0000 7f9274600640 1 -- 172.21.15.173:0/3522894909 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f926c073a40 con 0x7f924c066f60 2024-04-25T09:12:39.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.525+0000 7f9269600640 1 -- 172.21.15.173:0/3522894909 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243590 (secure 0 0 0) 0x7f926c073a40 con 0x7f924c066f60 2024-04-25T09:12:39.511 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:39.513 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:12:39.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.529+0000 7f9274600640 1 -- 172.21.15.173:0/3522894909 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f924c066f60 msgr2=0x7f924c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:39.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.529+0000 7f9274600640 1 --2- 172.21.15.173:0/3522894909 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f924c066f60 0x7f924c069420 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f92600ae000 tx=0x7f92600a7000 comp rx=0 tx=0).stop 2024-04-25T09:12:39.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.529+0000 7f9274600640 1 -- 172.21.15.173:0/3522894909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f926c15edd0 msgr2=0x7f926c15ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:39.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.529+0000 7f9274600640 1 --2- 172.21.15.173:0/3522894909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f926c15edd0 0x7f926c15ad20 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f926400c760 tx=0x7f926400cc20 comp rx=0 tx=0).stop 2024-04-25T09:12:39.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.529+0000 7f9274600640 1 -- 172.21.15.173:0/3522894909 shutdown_connections 2024-04-25T09:12:39.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.529+0000 7f9274600640 1 --2- 172.21.15.173:0/3522894909 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f924c066f60 0x7f924c069420 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.529+0000 7f9274600640 1 --2- 172.21.15.173:0/3522894909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f926c15edd0 0x7f926c15ad20 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.529+0000 7f9274600640 1 --2- 172.21.15.173:0/3522894909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f926c0b3e70 0x7f926c159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.529+0000 7f9274600640 1 --2- 172.21.15.173:0/3522894909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f926c0aefa0 0x7f926c1f7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.529+0000 7f9274600640 1 -- 172.21.15.173:0/3522894909 >> 172.21.15.173:0/3522894909 conn(0x7f926c06ac90 msgr2=0x7f926c159e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:39.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.529+0000 7f9274600640 1 -- 172.21.15.173:0/3522894909 shutdown_connections 2024-04-25T09:12:39.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.529+0000 7f9274600640 1 -- 172.21.15.173:0/3522894909 wait complete. 2024-04-25T09:12:39.532 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":427,"stamp":"2024-04-25T09:12:38.857384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592104,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":436856,"kb_used_data":13872,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754537864,"statfs":{"total":773094113280,"available":772646772736,"internally_reserved":0,"allocated":14204928,"data_stored":7213512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":432983600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.773893"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097934+0000","last_change":"2024-04-25T09:12:35.114369+0000","last_active":"2024-04-25T09:12:36.097934+0000","last_peered":"2024-04-25T09:12:36.097934+0000","last_clean":"2024-04-25T09:12:36.097934+0000","last_became_active":"2024-04-25T09:12:35.113316+0000","last_became_peered":"2024-04-25T09:12:35.113316+0000","last_unstale":"2024-04-25T09:12:36.097934+0000","last_undegraded":"2024-04-25T09:12:36.097934+0000","last_fullsized":"2024-04-25T09:12:36.097934+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:45.449663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372005+0000","last_change":"2024-04-25T09:12:35.128837+0000","last_active":"2024-04-25T09:12:36.372005+0000","last_peered":"2024-04-25T09:12:36.372005+0000","last_clean":"2024-04-25T09:12:36.372005+0000","last_became_active":"2024-04-25T09:12:35.128494+0000","last_became_peered":"2024-04-25T09:12:35.128494+0000","last_unstale":"2024-04-25T09:12:36.372005+0000","last_undegraded":"2024-04-25T09:12:36.372005+0000","last_fullsized":"2024-04-25T09:12:36.372005+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:15.711993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097917+0000","last_change":"2024-04-25T09:12:35.109962+0000","last_active":"2024-04-25T09:12:36.097917+0000","last_peered":"2024-04-25T09:12:36.097917+0000","last_clean":"2024-04-25T09:12:36.097917+0000","last_became_active":"2024-04-25T09:12:35.109686+0000","last_became_peered":"2024-04-25T09:12:35.109686+0000","last_unstale":"2024-04-25T09:12:36.097917+0000","last_undegraded":"2024-04-25T09:12:36.097917+0000","last_fullsized":"2024-04-25T09:12:36.097917+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:33.266966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097549+0000","last_change":"2024-04-25T09:12:35.125641+0000","last_active":"2024-04-25T09:12:36.097549+0000","last_peered":"2024-04-25T09:12:36.097549+0000","last_clean":"2024-04-25T09:12:36.097549+0000","last_became_active":"2024-04-25T09:12:35.125341+0000","last_became_peered":"2024-04-25T09:12:35.125341+0000","last_unstale":"2024-04-25T09:12:36.097549+0000","last_undegraded":"2024-04-25T09:12:36.097549+0000","last_fullsized":"2024-04-25T09:12:36.097549+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:49.194891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096964+0000","last_change":"2024-04-25T09:12:35.116739+0000","last_active":"2024-04-25T09:12:36.096964+0000","last_peered":"2024-04-25T09:12:36.096964+0000","last_clean":"2024-04-25T09:12:36.096964+0000","last_became_active":"2024-04-25T09:12:35.116447+0000","last_became_peered":"2024-04-25T09:12:35.116447+0000","last_unstale":"2024-04-25T09:12:36.096964+0000","last_undegraded":"2024-04-25T09:12:36.096964+0000","last_fullsized":"2024-04-25T09:12:36.096964+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:38.388538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371875+0000","last_change":"2024-04-25T09:12:35.127360+0000","last_active":"2024-04-25T09:12:36.371875+0000","last_peered":"2024-04-25T09:12:36.371875+0000","last_clean":"2024-04-25T09:12:36.371875+0000","last_became_active":"2024-04-25T09:12:35.127080+0000","last_became_peered":"2024-04-25T09:12:35.127080+0000","last_unstale":"2024-04-25T09:12:36.371875+0000","last_undegraded":"2024-04-25T09:12:36.371875+0000","last_fullsized":"2024-04-25T09:12:36.371875+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:34.934426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097559+0000","last_change":"2024-04-25T09:12:35.109705+0000","last_active":"2024-04-25T09:12:36.097559+0000","last_peered":"2024-04-25T09:12:36.097559+0000","last_clean":"2024-04-25T09:12:36.097559+0000","last_became_active":"2024-04-25T09:12:35.109437+0000","last_became_peered":"2024-04-25T09:12:35.109437+0000","last_unstale":"2024-04-25T09:12:36.097559+0000","last_undegraded":"2024-04-25T09:12:36.097559+0000","last_fullsized":"2024-04-25T09:12:36.097559+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:15.440771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371926+0000","last_change":"2024-04-25T09:12:35.128555+0000","last_active":"2024-04-25T09:12:36.371926+0000","last_peered":"2024-04-25T09:12:36.371926+0000","last_clean":"2024-04-25T09:12:36.371926+0000","last_became_active":"2024-04-25T09:12:35.127720+0000","last_became_peered":"2024-04-25T09:12:35.127720+0000","last_unstale":"2024-04-25T09:12:36.371926+0000","last_undegraded":"2024-04-25T09:12:36.371926+0000","last_fullsized":"2024-04-25T09:12:36.371926+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:06.969509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085382+0000","last_change":"2024-04-25T09:12:33.085382+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085382+0000","last_undegraded":"2024-04-25T09:12:33.085382+0000","last_fullsized":"2024-04-25T09:12:33.085382+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097381+0000","last_change":"2024-04-25T09:12:35.111869+0000","last_active":"2024-04-25T09:12:36.097381+0000","last_peered":"2024-04-25T09:12:36.097381+0000","last_clean":"2024-04-25T09:12:36.097381+0000","last_became_active":"2024-04-25T09:12:35.111471+0000","last_became_peered":"2024-04-25T09:12:35.111471+0000","last_unstale":"2024-04-25T09:12:36.097381+0000","last_undegraded":"2024-04-25T09:12:36.097381+0000","last_fullsized":"2024-04-25T09:12:36.097381+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:12.635916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090084+0000","last_change":"2024-04-25T09:12:33.090084+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090084+0000","last_undegraded":"2024-04-25T09:12:33.090084+0000","last_fullsized":"2024-04-25T09:12:33.090084+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372261+0000","last_change":"2024-04-25T09:12:34.113365+0000","last_active":"2024-04-25T09:12:36.372261+0000","last_peered":"2024-04-25T09:12:36.372261+0000","last_clean":"2024-04-25T09:12:36.372261+0000","last_became_active":"2024-04-25T09:12:34.113074+0000","last_became_peered":"2024-04-25T09:12:34.113074+0000","last_unstale":"2024-04-25T09:12:36.372261+0000","last_undegraded":"2024-04-25T09:12:36.372261+0000","last_fullsized":"2024-04-25T09:12:36.372261+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:17.490405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097632+0000","last_change":"2024-04-25T09:12:35.116889+0000","last_active":"2024-04-25T09:12:36.097632+0000","last_peered":"2024-04-25T09:12:36.097632+0000","last_clean":"2024-04-25T09:12:36.097632+0000","last_became_active":"2024-04-25T09:12:35.116633+0000","last_became_peered":"2024-04-25T09:12:35.116633+0000","last_unstale":"2024-04-25T09:12:36.097632+0000","last_undegraded":"2024-04-25T09:12:36.097632+0000","last_fullsized":"2024-04-25T09:12:36.097632+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:04.492092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371747+0000","last_change":"2024-04-25T09:12:34.112627+0000","last_active":"2024-04-25T09:12:36.371747+0000","last_peered":"2024-04-25T09:12:36.371747+0000","last_clean":"2024-04-25T09:12:36.371747+0000","last_became_active":"2024-04-25T09:12:34.112324+0000","last_became_peered":"2024-04-25T09:12:34.112324+0000","last_unstale":"2024-04-25T09:12:36.371747+0000","last_undegraded":"2024-04-25T09:12:36.371747+0000","last_fullsized":"2024-04-25T09:12:36.371747+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:39.328452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090857+0000","last_change":"2024-04-25T09:12:33.090857+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090857+0000","last_undegraded":"2024-04-25T09:12:33.090857+0000","last_fullsized":"2024-04-25T09:12:33.090857+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.089714+0000","last_change":"2024-04-25T09:12:33.089714+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.089714+0000","last_undegraded":"2024-04-25T09:12:33.089714+0000","last_fullsized":"2024-04-25T09:12:33.089714+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.165483+0000","last_change":"2024-04-25T09:12:33.165483+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.165483+0000","last_undegraded":"2024-04-25T09:12:33.165483+0000","last_fullsized":"2024-04-25T09:12:33.165483+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371889+0000","last_change":"2024-04-25T09:12:35.128824+0000","last_active":"2024-04-25T09:12:36.371889+0000","last_peered":"2024-04-25T09:12:36.371889+0000","last_clean":"2024-04-25T09:12:36.371889+0000","last_became_active":"2024-04-25T09:12:35.128530+0000","last_became_peered":"2024-04-25T09:12:35.128530+0000","last_unstale":"2024-04-25T09:12:36.371889+0000","last_undegraded":"2024-04-25T09:12:36.371889+0000","last_fullsized":"2024-04-25T09:12:36.371889+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:26.609412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085149+0000","last_change":"2024-04-25T09:12:33.085149+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085149+0000","last_undegraded":"2024-04-25T09:12:33.085149+0000","last_fullsized":"2024-04-25T09:12:33.085149+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096961+0000","last_change":"2024-04-25T09:12:35.115352+0000","last_active":"2024-04-25T09:12:36.096961+0000","last_peered":"2024-04-25T09:12:36.096961+0000","last_clean":"2024-04-25T09:12:36.096961+0000","last_became_active":"2024-04-25T09:12:35.115090+0000","last_became_peered":"2024-04-25T09:12:35.115090+0000","last_unstale":"2024-04-25T09:12:36.096961+0000","last_undegraded":"2024-04-25T09:12:36.096961+0000","last_fullsized":"2024-04-25T09:12:36.096961+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:03.804395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085671+0000","last_change":"2024-04-25T09:12:33.085671+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085671+0000","last_undegraded":"2024-04-25T09:12:33.085671+0000","last_fullsized":"2024-04-25T09:12:33.085671+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097883+0000","last_change":"2024-04-25T09:12:34.116925+0000","last_active":"2024-04-25T09:12:36.097883+0000","last_peered":"2024-04-25T09:12:36.097883+0000","last_clean":"2024-04-25T09:12:36.097883+0000","last_became_active":"2024-04-25T09:12:34.116013+0000","last_became_peered":"2024-04-25T09:12:34.116013+0000","last_unstale":"2024-04-25T09:12:36.097883+0000","last_undegraded":"2024-04-25T09:12:36.097883+0000","last_fullsized":"2024-04-25T09:12:36.097883+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:49.636624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"132'3","reported_seq":17,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372141+0000","last_change":"2024-04-25T09:12:34.111922+0000","last_active":"2024-04-25T09:12:36.372141+0000","last_peered":"2024-04-25T09:12:36.372141+0000","last_clean":"2024-04-25T09:12:36.372141+0000","last_became_active":"2024-04-25T09:12:34.111591+0000","last_became_peered":"2024-04-25T09:12:34.111591+0000","last_unstale":"2024-04-25T09:12:36.372141+0000","last_undegraded":"2024-04-25T09:12:36.372141+0000","last_fullsized":"2024-04-25T09:12:36.372141+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:49.439435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"132'6","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372376+0000","last_change":"2024-04-25T09:12:34.114195+0000","last_active":"2024-04-25T09:12:36.372376+0000","last_peered":"2024-04-25T09:12:36.372376+0000","last_clean":"2024-04-25T09:12:36.372376+0000","last_became_active":"2024-04-25T09:12:34.113862+0000","last_became_peered":"2024-04-25T09:12:34.113862+0000","last_unstale":"2024-04-25T09:12:36.372376+0000","last_undegraded":"2024-04-25T09:12:36.372376+0000","last_fullsized":"2024-04-25T09:12:36.372376+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:00.424853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097525+0000","last_change":"2024-04-25T09:12:34.115786+0000","last_active":"2024-04-25T09:12:36.097525+0000","last_peered":"2024-04-25T09:12:36.097525+0000","last_clean":"2024-04-25T09:12:36.097525+0000","last_became_active":"2024-04-25T09:12:34.115524+0000","last_became_peered":"2024-04-25T09:12:34.115524+0000","last_unstale":"2024-04-25T09:12:36.097525+0000","last_undegraded":"2024-04-25T09:12:36.097525+0000","last_fullsized":"2024-04-25T09:12:36.097525+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:39.699444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372510+0000","last_change":"2024-04-25T09:12:35.131021+0000","last_active":"2024-04-25T09:12:36.372510+0000","last_peered":"2024-04-25T09:12:36.372510+0000","last_clean":"2024-04-25T09:12:36.372510+0000","last_became_active":"2024-04-25T09:12:35.130750+0000","last_became_peered":"2024-04-25T09:12:35.130750+0000","last_unstale":"2024-04-25T09:12:36.372510+0000","last_undegraded":"2024-04-25T09:12:36.372510+0000","last_fullsized":"2024-04-25T09:12:36.372510+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:37.039253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085160+0000","last_change":"2024-04-25T09:12:33.085160+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085160+0000","last_undegraded":"2024-04-25T09:12:33.085160+0000","last_fullsized":"2024-04-25T09:12:33.085160+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.165346+0000","last_change":"2024-04-25T09:12:33.165346+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.165346+0000","last_undegraded":"2024-04-25T09:12:33.165346+0000","last_fullsized":"2024-04-25T09:12:33.165346+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085076+0000","last_change":"2024-04-25T09:12:33.085076+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085076+0000","last_undegraded":"2024-04-25T09:12:33.085076+0000","last_fullsized":"2024-04-25T09:12:33.085076+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371368+0000","last_change":"2024-04-25T09:12:35.125572+0000","last_active":"2024-04-25T09:12:36.371368+0000","last_peered":"2024-04-25T09:12:36.371368+0000","last_clean":"2024-04-25T09:12:36.371368+0000","last_became_active":"2024-04-25T09:12:35.125300+0000","last_became_peered":"2024-04-25T09:12:35.125300+0000","last_unstale":"2024-04-25T09:12:36.371368+0000","last_undegraded":"2024-04-25T09:12:36.371368+0000","last_fullsized":"2024-04-25T09:12:36.371368+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:05.811985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085168+0000","last_change":"2024-04-25T09:12:33.085168+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085168+0000","last_undegraded":"2024-04-25T09:12:33.085168+0000","last_fullsized":"2024-04-25T09:12:33.085168+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371601+0000","last_change":"2024-04-25T09:12:35.125851+0000","last_active":"2024-04-25T09:12:36.371601+0000","last_peered":"2024-04-25T09:12:36.371601+0000","last_clean":"2024-04-25T09:12:36.371601+0000","last_became_active":"2024-04-25T09:12:35.125343+0000","last_became_peered":"2024-04-25T09:12:35.125343+0000","last_unstale":"2024-04-25T09:12:36.371601+0000","last_undegraded":"2024-04-25T09:12:36.371601+0000","last_fullsized":"2024-04-25T09:12:36.371601+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:00.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.164941+0000","last_change":"2024-04-25T09:12:33.164941+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.164941+0000","last_undegraded":"2024-04-25T09:12:33.164941+0000","last_fullsized":"2024-04-25T09:12:33.164941+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.088951+0000","last_change":"2024-04-25T09:12:33.088951+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.088951+0000","last_undegraded":"2024-04-25T09:12:33.088951+0000","last_fullsized":"2024-04-25T09:12:33.088951+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090361+0000","last_change":"2024-04-25T09:12:33.090361+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090361+0000","last_undegraded":"2024-04-25T09:12:33.090361+0000","last_fullsized":"2024-04-25T09:12:33.090361+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097836+0000","last_change":"2024-04-25T09:12:35.125513+0000","last_active":"2024-04-25T09:12:36.097836+0000","last_peered":"2024-04-25T09:12:36.097836+0000","last_clean":"2024-04-25T09:12:36.097836+0000","last_became_active":"2024-04-25T09:12:35.125238+0000","last_became_peered":"2024-04-25T09:12:35.125238+0000","last_unstale":"2024-04-25T09:12:36.097836+0000","last_undegraded":"2024-04-25T09:12:36.097836+0000","last_fullsized":"2024-04-25T09:12:36.097836+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:18.547869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097596+0000","last_change":"2024-04-25T09:12:34.105311+0000","last_active":"2024-04-25T09:12:36.097596+0000","last_peered":"2024-04-25T09:12:36.097596+0000","last_clean":"2024-04-25T09:12:36.097596+0000","last_became_active":"2024-04-25T09:12:34.105070+0000","last_became_peered":"2024-04-25T09:12:34.105070+0000","last_unstale":"2024-04-25T09:12:36.097596+0000","last_undegraded":"2024-04-25T09:12:36.097596+0000","last_fullsized":"2024-04-25T09:12:36.097596+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:38.389565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371839+0000","last_change":"2024-04-25T09:12:34.114130+0000","last_active":"2024-04-25T09:12:36.371839+0000","last_peered":"2024-04-25T09:12:36.371839+0000","last_clean":"2024-04-25T09:12:36.371839+0000","last_became_active":"2024-04-25T09:12:34.113813+0000","last_became_peered":"2024-04-25T09:12:34.113813+0000","last_unstale":"2024-04-25T09:12:36.371839+0000","last_undegraded":"2024-04-25T09:12:36.371839+0000","last_fullsized":"2024-04-25T09:12:36.371839+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:19.761568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.164934+0000","last_change":"2024-04-25T09:12:33.164934+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.164934+0000","last_undegraded":"2024-04-25T09:12:33.164934+0000","last_fullsized":"2024-04-25T09:12:33.164934+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097979+0000","last_change":"2024-04-25T09:12:34.110412+0000","last_active":"2024-04-25T09:12:36.097979+0000","last_peered":"2024-04-25T09:12:36.097979+0000","last_clean":"2024-04-25T09:12:36.097979+0000","last_became_active":"2024-04-25T09:12:34.110163+0000","last_became_peered":"2024-04-25T09:12:34.110163+0000","last_unstale":"2024-04-25T09:12:36.097979+0000","last_undegraded":"2024-04-25T09:12:36.097979+0000","last_fullsized":"2024-04-25T09:12:36.097979+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:34.085553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090423+0000","last_change":"2024-04-25T09:12:33.090423+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090423+0000","last_undegraded":"2024-04-25T09:12:33.090423+0000","last_fullsized":"2024-04-25T09:12:33.090423+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371411+0000","last_change":"2024-04-25T09:12:35.130641+0000","last_active":"2024-04-25T09:12:36.371411+0000","last_peered":"2024-04-25T09:12:36.371411+0000","last_clean":"2024-04-25T09:12:36.371411+0000","last_became_active":"2024-04-25T09:12:35.130358+0000","last_became_peered":"2024-04-25T09:12:35.130358+0000","last_unstale":"2024-04-25T09:12:36.371411+0000","last_undegraded":"2024-04-25T09:12:36.371411+0000","last_fullsized":"2024-04-25T09:12:36.371411+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:23.637033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090373+0000","last_change":"2024-04-25T09:12:33.090373+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090373+0000","last_undegraded":"2024-04-25T09:12:33.090373+0000","last_fullsized":"2024-04-25T09:12:33.090373+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.164927+0000","last_change":"2024-04-25T09:12:33.164927+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.164927+0000","last_undegraded":"2024-04-25T09:12:33.164927+0000","last_fullsized":"2024-04-25T09:12:33.164927+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085076+0000","last_change":"2024-04-25T09:12:33.085076+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085076+0000","last_undegraded":"2024-04-25T09:12:33.085076+0000","last_fullsized":"2024-04-25T09:12:33.085076+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371652+0000","last_change":"2024-04-25T09:12:34.111472+0000","last_active":"2024-04-25T09:12:36.371652+0000","last_peered":"2024-04-25T09:12:36.371652+0000","last_clean":"2024-04-25T09:12:36.371652+0000","last_became_active":"2024-04-25T09:12:34.111180+0000","last_became_peered":"2024-04-25T09:12:34.111180+0000","last_unstale":"2024-04-25T09:12:36.371652+0000","last_undegraded":"2024-04-25T09:12:36.371652+0000","last_fullsized":"2024-04-25T09:12:36.371652+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:55.097890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.164849+0000","last_change":"2024-04-25T09:12:33.164849+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.164849+0000","last_undegraded":"2024-04-25T09:12:33.164849+0000","last_fullsized":"2024-04-25T09:12:33.164849+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372398+0000","last_change":"2024-04-25T09:12:35.132520+0000","last_active":"2024-04-25T09:12:36.372398+0000","last_peered":"2024-04-25T09:12:36.372398+0000","last_clean":"2024-04-25T09:12:36.372398+0000","last_became_active":"2024-04-25T09:12:35.132241+0000","last_became_peered":"2024-04-25T09:12:35.132241+0000","last_unstale":"2024-04-25T09:12:36.372398+0000","last_undegraded":"2024-04-25T09:12:36.372398+0000","last_fullsized":"2024-04-25T09:12:36.372398+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:16.640588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.089039+0000","last_change":"2024-04-25T09:12:33.089039+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.089039+0000","last_undegraded":"2024-04-25T09:12:33.089039+0000","last_fullsized":"2024-04-25T09:12:33.089039+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371515+0000","last_change":"2024-04-25T09:12:34.114900+0000","last_active":"2024-04-25T09:12:36.371515+0000","last_peered":"2024-04-25T09:12:36.371515+0000","last_clean":"2024-04-25T09:12:36.371515+0000","last_became_active":"2024-04-25T09:12:34.114551+0000","last_became_peered":"2024-04-25T09:12:34.114551+0000","last_unstale":"2024-04-25T09:12:36.371515+0000","last_undegraded":"2024-04-25T09:12:36.371515+0000","last_fullsized":"2024-04-25T09:12:36.371515+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:17.056789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":376,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371118+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:12:36.371118+0000","last_peered":"2024-04-25T09:12:36.371118+0000","last_clean":"2024-04-25T09:12:36.371118+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:12:36.371118+0000","last_undegraded":"2024-04-25T09:12:36.371118+0000","last_fullsized":"2024-04-25T09:12:36.371118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":1736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509562,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54976,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316864,"statfs":{"total":96636764160,"available":96580468736,"internally_reserved":0,"allocated":1617920,"data_stored":750230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509562,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50816,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321024,"statfs":{"total":96636764160,"available":96584728576,"internally_reserved":0,"allocated":1617920,"data_stored":750230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509563,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59124,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312716,"statfs":{"total":96636764160,"available":96576221184,"internally_reserved":0,"allocated":1605632,"data_stored":744021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59128,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312712,"statfs":{"total":96636764160,"available":96576217088,"internally_reserved":0,"allocated":1617920,"data_stored":750230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509563,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55016,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316824,"statfs":{"total":96636764160,"available":96580427776,"internally_reserved":0,"allocated":1662976,"data_stored":771364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509563,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50804,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321036,"statfs":{"total":96636764160,"available":96584740864,"internally_reserved":0,"allocated":1605632,"data_stored":744021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509563,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55552,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316288,"statfs":{"total":96636764160,"available":96579878912,"internally_reserved":0,"allocated":2211840,"data_stored":1340598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574971,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51440,"kb_used_data":2212,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320400,"statfs":{"total":96636764160,"available":96584089600,"internally_reserved":0,"allocated":2265088,"data_stored":1362818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:12:39.535 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:12:39.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.725+0000 7f8d4ac00640 1 Processor -- start 2024-04-25T09:12:39.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.725+0000 7f8d4ac00640 1 -- start start 2024-04-25T09:12:39.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.725+0000 7f8d4ac00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8d440d1270 0x7f8d440cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:39.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.725+0000 7f8d4ac00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8d44099b30 0x7f8d44099f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:39.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.725+0000 7f8d4ac00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d440d01d0 con 0x7f8d440cd7e0 2024-04-25T09:12:39.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.725+0000 7f8d4ac00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d440cffa0 con 0x7f8d44099b30 2024-04-25T09:12:39.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.725+0000 7f8d4ac00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4409a4c0 con 0x7f8d440d1270 2024-04-25T09:12:39.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.729+0000 7f8d48c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8d44099b30 0x7f8d44099f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:39.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.729+0000 7f8d48c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8d44099b30 0x7f8d44099f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59906/0 (socket says 172.21.15.173:59906) 2024-04-25T09:12:39.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.729+0000 7f8d48c00640 1 -- 172.21.15.173:0/387094003 learned_addr learned my addr 172.21.15.173:0/387094003 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:39.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.729+0000 7f8d43e00640 1 --1- 172.21.15.173:0/387094003 >> v1:172.21.15.173:6789/0 conn(0x7f8d440cd7e0 0x7f8d4406cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41896/0 (socket says 172.21.15.173:41896) 2024-04-25T09:12:39.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.729+0000 7f8d3b400640 1 --2- 172.21.15.173:0/387094003 >> v2:172.21.15.194:3300/0 conn(0x7f8d440d1270 0x7f8d440cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:39.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.729+0000 7f8d48c00640 1 -- 172.21.15.173:0/387094003 >> v2:172.21.15.194:3300/0 conn(0x7f8d440d1270 msgr2=0x7f8d440cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:39.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.729+0000 7f8d48c00640 1 --2- 172.21.15.173:0/387094003 >> v2:172.21.15.194:3300/0 conn(0x7f8d440d1270 0x7f8d440cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.729+0000 7f8d48c00640 1 -- 172.21.15.173:0/387094003 >> v1:172.21.15.173:6789/0 conn(0x7f8d440cd7e0 legacy=0x7f8d4406cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:39.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.729+0000 7f8d48c00640 1 -- 172.21.15.173:0/387094003 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d440d04b0 con 0x7f8d44099b30 2024-04-25T09:12:39.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.729+0000 7f8d43400640 1 -- 172.21.15.173:0/387094003 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676467936 0 0) 0x7f8d440d01d0 con 0x7f8d440cd7e0 2024-04-25T09:12:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.729+0000 7f8d48c00640 1 --2- 172.21.15.173:0/387094003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d44099b30 0x7f8d44099f80 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f8d44072b40 tx=0x7f8d3c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e9cb154483cc84 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.729+0000 7f8d43400640 1 -- 172.21.15.173:0/387094003 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c0a5880 con 0x7f8d44099b30 2024-04-25T09:12:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.729+0000 7f8d43400640 1 -- 172.21.15.173:0/387094003 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c0a5a20 con 0x7f8d44099b30 2024-04-25T09:12:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.729+0000 7f8d43400640 1 -- 172.21.15.173:0/387094003 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c0a5df0 con 0x7f8d44099b30 2024-04-25T09:12:39.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d4ac00640 1 -- 172.21.15.173:0/387094003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d44099b30 msgr2=0x7f8d44099f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:39.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d4ac00640 1 --2- 172.21.15.173:0/387094003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d44099b30 0x7f8d44099f80 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f8d44072b40 tx=0x7f8d3c01c9c0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d4ac00640 1 -- 172.21.15.173:0/387094003 shutdown_connections 2024-04-25T09:12:39.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d4ac00640 1 --2- 172.21.15.173:0/387094003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d44099b30 0x7f8d44099f80 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d4ac00640 1 --2- 172.21.15.173:0/387094003 >> v2:172.21.15.194:3300/0 conn(0x7f8d440d1270 0x7f8d440cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d4ac00640 1 -- 172.21.15.173:0/387094003 >> 172.21.15.173:0/387094003 conn(0x7f8d440b33a0 msgr2=0x7f8d440b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:39.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d4ac00640 1 -- 172.21.15.173:0/387094003 shutdown_connections 2024-04-25T09:12:39.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d4ac00640 1 -- 172.21.15.173:0/387094003 wait complete. 2024-04-25T09:12:39.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d4ac00640 1 Processor -- start 2024-04-25T09:12:39.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d4ac00640 1 -- start start 2024-04-25T09:12:39.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d4ac00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d44099b30 0x7f8d44155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:39.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d4ac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d440cd7e0 0x7f8d44152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:39.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d4ac00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d440d1270 0x7f8d4415c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:39.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d4ac00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d440cdd40 con 0x7f8d440d1270 2024-04-25T09:12:39.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d4ac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d440cdbc0 con 0x7f8d440cd7e0 2024-04-25T09:12:39.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d4ac00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4415dd30 con 0x7f8d44099b30 2024-04-25T09:12:39.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d48c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d440d1270 0x7f8d4415c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:39.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d48c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d440d1270 0x7f8d4415c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59916/0 (socket says 172.21.15.173:59916) 2024-04-25T09:12:39.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d48c00640 1 -- 172.21.15.173:0/2316176108 learned_addr learned my addr 172.21.15.173:0/2316176108 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:39.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d3b400640 1 --2- 172.21.15.173:0/2316176108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d440cd7e0 0x7f8d44152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:39.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d43e00640 1 --2- 172.21.15.173:0/2316176108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d44099b30 0x7f8d44155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:39.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d48c00640 1 -- 172.21.15.173:0/2316176108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d44099b30 msgr2=0x7f8d44155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:39.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d48c00640 1 --2- 172.21.15.173:0/2316176108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d44099b30 0x7f8d44155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d48c00640 1 -- 172.21.15.173:0/2316176108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d440cd7e0 msgr2=0x7f8d44152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:39.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d48c00640 1 --2- 172.21.15.173:0/2316176108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d440cd7e0 0x7f8d44152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d48c00640 1 -- 172.21.15.173:0/2316176108 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4415b7a0 con 0x7f8d440d1270 2024-04-25T09:12:39.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.733+0000 7f8d3b400640 1 --2- 172.21.15.173:0/2316176108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d440cd7e0 0x7f8d44152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:39.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.737+0000 7f8d48c00640 1 --2- 172.21.15.173:0/2316176108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d440d1270 0x7f8d4415c210 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0195d0 tx=0x7f8d3c019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:39.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.737+0000 7f8d40c00640 1 -- 172.21.15.173:0/2316176108 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c0bc030 con 0x7f8d440d1270 2024-04-25T09:12:39.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.737+0000 7f8d40c00640 1 -- 172.21.15.173:0/2316176108 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c0b8470 con 0x7f8d440d1270 2024-04-25T09:12:39.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.737+0000 7f8d40c00640 1 -- 172.21.15.173:0/2316176108 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c0b8820 con 0x7f8d440d1270 2024-04-25T09:12:39.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.737+0000 7f8d4ac00640 1 -- 172.21.15.173:0/2316176108 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d440b0110 con 0x7f8d440d1270 2024-04-25T09:12:39.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.737+0000 7f8d4ac00640 1 -- 172.21.15.173:0/2316176108 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4415bcf0 con 0x7f8d440d1270 2024-04-25T09:12:39.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.737+0000 7f8d4ac00640 1 -- 172.21.15.173:0/2316176108 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d44073a40 con 0x7f8d440d1270 2024-04-25T09:12:39.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.737+0000 7f8d40c00640 1 -- 172.21.15.173:0/2316176108 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8d3c0bf070 con 0x7f8d440d1270 2024-04-25T09:12:39.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.737+0000 7f8d40c00640 1 --2- 172.21.15.173:0/2316176108 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8d20066f60 0x7f8d20069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:39.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.737+0000 7f8d40c00640 1 -- 172.21.15.173:0/2316176108 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8d3c11fe60 con 0x7f8d440d1270 2024-04-25T09:12:39.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.737+0000 7f8d43e00640 1 --2- 172.21.15.173:0/2316176108 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8d20066f60 0x7f8d20069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:39.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.737+0000 7f8d43e00640 1 --2- 172.21.15.173:0/2316176108 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8d20066f60 0x7f8d20069420 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8d34007fd0 tx=0x7f8d34007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:39.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.741+0000 7f8d40c00640 1 -- 172.21.15.173:0/2316176108 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8d3c0165e0 con 0x7f8d440d1270 2024-04-25T09:12:39.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.893+0000 7f8d4ac00640 1 -- 172.21.15.173:0/2316176108 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d4406d5f0 con 0x7f8d20066f60 2024-04-25T09:12:39.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.901+0000 7f8d40c00640 1 -- 172.21.15.173:0/2316176108 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243590 (secure 0 0 0) 0x7f8d4406d5f0 con 0x7f8d20066f60 2024-04-25T09:12:39.888 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:39.889 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:12:39.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.905+0000 7f8d4ac00640 1 -- 172.21.15.173:0/2316176108 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8d20066f60 msgr2=0x7f8d20069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:39.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.905+0000 7f8d4ac00640 1 --2- 172.21.15.173:0/2316176108 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8d20066f60 0x7f8d20069420 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8d34007fd0 tx=0x7f8d34007d60 comp rx=0 tx=0).stop 2024-04-25T09:12:39.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.905+0000 7f8d4ac00640 1 -- 172.21.15.173:0/2316176108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d440d1270 msgr2=0x7f8d4415c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:39.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.905+0000 7f8d4ac00640 1 --2- 172.21.15.173:0/2316176108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d440d1270 0x7f8d4415c210 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0195d0 tx=0x7f8d3c019760 comp rx=0 tx=0).stop 2024-04-25T09:12:39.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.905+0000 7f8d4ac00640 1 -- 172.21.15.173:0/2316176108 shutdown_connections 2024-04-25T09:12:39.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.905+0000 7f8d4ac00640 1 --2- 172.21.15.173:0/2316176108 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8d20066f60 0x7f8d20069420 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.905+0000 7f8d4ac00640 1 --2- 172.21.15.173:0/2316176108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d440d1270 0x7f8d4415c210 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.905+0000 7f8d4ac00640 1 --2- 172.21.15.173:0/2316176108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d440cd7e0 0x7f8d44152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.905+0000 7f8d4ac00640 1 --2- 172.21.15.173:0/2316176108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d44099b30 0x7f8d44155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:39.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.905+0000 7f8d4ac00640 1 -- 172.21.15.173:0/2316176108 >> 172.21.15.173:0/2316176108 conn(0x7f8d440b33a0 msgr2=0x7f8d440b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:39.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.905+0000 7f8d4ac00640 1 -- 172.21.15.173:0/2316176108 shutdown_connections 2024-04-25T09:12:39.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:39.905+0000 7f8d4ac00640 1 -- 172.21.15.173:0/2316176108 wait complete. 2024-04-25T09:12:39.908 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":427,"stamp":"2024-04-25T09:12:38.857384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592104,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":436856,"kb_used_data":13872,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754537864,"statfs":{"total":773094113280,"available":772646772736,"internally_reserved":0,"allocated":14204928,"data_stored":7213512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":432983600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.773893"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097934+0000","last_change":"2024-04-25T09:12:35.114369+0000","last_active":"2024-04-25T09:12:36.097934+0000","last_peered":"2024-04-25T09:12:36.097934+0000","last_clean":"2024-04-25T09:12:36.097934+0000","last_became_active":"2024-04-25T09:12:35.113316+0000","last_became_peered":"2024-04-25T09:12:35.113316+0000","last_unstale":"2024-04-25T09:12:36.097934+0000","last_undegraded":"2024-04-25T09:12:36.097934+0000","last_fullsized":"2024-04-25T09:12:36.097934+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:45.449663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372005+0000","last_change":"2024-04-25T09:12:35.128837+0000","last_active":"2024-04-25T09:12:36.372005+0000","last_peered":"2024-04-25T09:12:36.372005+0000","last_clean":"2024-04-25T09:12:36.372005+0000","last_became_active":"2024-04-25T09:12:35.128494+0000","last_became_peered":"2024-04-25T09:12:35.128494+0000","last_unstale":"2024-04-25T09:12:36.372005+0000","last_undegraded":"2024-04-25T09:12:36.372005+0000","last_fullsized":"2024-04-25T09:12:36.372005+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:15.711993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097917+0000","last_change":"2024-04-25T09:12:35.109962+0000","last_active":"2024-04-25T09:12:36.097917+0000","last_peered":"2024-04-25T09:12:36.097917+0000","last_clean":"2024-04-25T09:12:36.097917+0000","last_became_active":"2024-04-25T09:12:35.109686+0000","last_became_peered":"2024-04-25T09:12:35.109686+0000","last_unstale":"2024-04-25T09:12:36.097917+0000","last_undegraded":"2024-04-25T09:12:36.097917+0000","last_fullsized":"2024-04-25T09:12:36.097917+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:33.266966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097549+0000","last_change":"2024-04-25T09:12:35.125641+0000","last_active":"2024-04-25T09:12:36.097549+0000","last_peered":"2024-04-25T09:12:36.097549+0000","last_clean":"2024-04-25T09:12:36.097549+0000","last_became_active":"2024-04-25T09:12:35.125341+0000","last_became_peered":"2024-04-25T09:12:35.125341+0000","last_unstale":"2024-04-25T09:12:36.097549+0000","last_undegraded":"2024-04-25T09:12:36.097549+0000","last_fullsized":"2024-04-25T09:12:36.097549+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:49.194891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096964+0000","last_change":"2024-04-25T09:12:35.116739+0000","last_active":"2024-04-25T09:12:36.096964+0000","last_peered":"2024-04-25T09:12:36.096964+0000","last_clean":"2024-04-25T09:12:36.096964+0000","last_became_active":"2024-04-25T09:12:35.116447+0000","last_became_peered":"2024-04-25T09:12:35.116447+0000","last_unstale":"2024-04-25T09:12:36.096964+0000","last_undegraded":"2024-04-25T09:12:36.096964+0000","last_fullsized":"2024-04-25T09:12:36.096964+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:38.388538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371875+0000","last_change":"2024-04-25T09:12:35.127360+0000","last_active":"2024-04-25T09:12:36.371875+0000","last_peered":"2024-04-25T09:12:36.371875+0000","last_clean":"2024-04-25T09:12:36.371875+0000","last_became_active":"2024-04-25T09:12:35.127080+0000","last_became_peered":"2024-04-25T09:12:35.127080+0000","last_unstale":"2024-04-25T09:12:36.371875+0000","last_undegraded":"2024-04-25T09:12:36.371875+0000","last_fullsized":"2024-04-25T09:12:36.371875+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:34.934426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097559+0000","last_change":"2024-04-25T09:12:35.109705+0000","last_active":"2024-04-25T09:12:36.097559+0000","last_peered":"2024-04-25T09:12:36.097559+0000","last_clean":"2024-04-25T09:12:36.097559+0000","last_became_active":"2024-04-25T09:12:35.109437+0000","last_became_peered":"2024-04-25T09:12:35.109437+0000","last_unstale":"2024-04-25T09:12:36.097559+0000","last_undegraded":"2024-04-25T09:12:36.097559+0000","last_fullsized":"2024-04-25T09:12:36.097559+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:15.440771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371926+0000","last_change":"2024-04-25T09:12:35.128555+0000","last_active":"2024-04-25T09:12:36.371926+0000","last_peered":"2024-04-25T09:12:36.371926+0000","last_clean":"2024-04-25T09:12:36.371926+0000","last_became_active":"2024-04-25T09:12:35.127720+0000","last_became_peered":"2024-04-25T09:12:35.127720+0000","last_unstale":"2024-04-25T09:12:36.371926+0000","last_undegraded":"2024-04-25T09:12:36.371926+0000","last_fullsized":"2024-04-25T09:12:36.371926+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:06.969509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085382+0000","last_change":"2024-04-25T09:12:33.085382+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085382+0000","last_undegraded":"2024-04-25T09:12:33.085382+0000","last_fullsized":"2024-04-25T09:12:33.085382+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097381+0000","last_change":"2024-04-25T09:12:35.111869+0000","last_active":"2024-04-25T09:12:36.097381+0000","last_peered":"2024-04-25T09:12:36.097381+0000","last_clean":"2024-04-25T09:12:36.097381+0000","last_became_active":"2024-04-25T09:12:35.111471+0000","last_became_peered":"2024-04-25T09:12:35.111471+0000","last_unstale":"2024-04-25T09:12:36.097381+0000","last_undegraded":"2024-04-25T09:12:36.097381+0000","last_fullsized":"2024-04-25T09:12:36.097381+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:12.635916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090084+0000","last_change":"2024-04-25T09:12:33.090084+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090084+0000","last_undegraded":"2024-04-25T09:12:33.090084+0000","last_fullsized":"2024-04-25T09:12:33.090084+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372261+0000","last_change":"2024-04-25T09:12:34.113365+0000","last_active":"2024-04-25T09:12:36.372261+0000","last_peered":"2024-04-25T09:12:36.372261+0000","last_clean":"2024-04-25T09:12:36.372261+0000","last_became_active":"2024-04-25T09:12:34.113074+0000","last_became_peered":"2024-04-25T09:12:34.113074+0000","last_unstale":"2024-04-25T09:12:36.372261+0000","last_undegraded":"2024-04-25T09:12:36.372261+0000","last_fullsized":"2024-04-25T09:12:36.372261+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:17.490405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097632+0000","last_change":"2024-04-25T09:12:35.116889+0000","last_active":"2024-04-25T09:12:36.097632+0000","last_peered":"2024-04-25T09:12:36.097632+0000","last_clean":"2024-04-25T09:12:36.097632+0000","last_became_active":"2024-04-25T09:12:35.116633+0000","last_became_peered":"2024-04-25T09:12:35.116633+0000","last_unstale":"2024-04-25T09:12:36.097632+0000","last_undegraded":"2024-04-25T09:12:36.097632+0000","last_fullsized":"2024-04-25T09:12:36.097632+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:04.492092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371747+0000","last_change":"2024-04-25T09:12:34.112627+0000","last_active":"2024-04-25T09:12:36.371747+0000","last_peered":"2024-04-25T09:12:36.371747+0000","last_clean":"2024-04-25T09:12:36.371747+0000","last_became_active":"2024-04-25T09:12:34.112324+0000","last_became_peered":"2024-04-25T09:12:34.112324+0000","last_unstale":"2024-04-25T09:12:36.371747+0000","last_undegraded":"2024-04-25T09:12:36.371747+0000","last_fullsized":"2024-04-25T09:12:36.371747+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:39.328452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090857+0000","last_change":"2024-04-25T09:12:33.090857+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090857+0000","last_undegraded":"2024-04-25T09:12:33.090857+0000","last_fullsized":"2024-04-25T09:12:33.090857+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.089714+0000","last_change":"2024-04-25T09:12:33.089714+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.089714+0000","last_undegraded":"2024-04-25T09:12:33.089714+0000","last_fullsized":"2024-04-25T09:12:33.089714+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.165483+0000","last_change":"2024-04-25T09:12:33.165483+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.165483+0000","last_undegraded":"2024-04-25T09:12:33.165483+0000","last_fullsized":"2024-04-25T09:12:33.165483+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371889+0000","last_change":"2024-04-25T09:12:35.128824+0000","last_active":"2024-04-25T09:12:36.371889+0000","last_peered":"2024-04-25T09:12:36.371889+0000","last_clean":"2024-04-25T09:12:36.371889+0000","last_became_active":"2024-04-25T09:12:35.128530+0000","last_became_peered":"2024-04-25T09:12:35.128530+0000","last_unstale":"2024-04-25T09:12:36.371889+0000","last_undegraded":"2024-04-25T09:12:36.371889+0000","last_fullsized":"2024-04-25T09:12:36.371889+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:26.609412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085149+0000","last_change":"2024-04-25T09:12:33.085149+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085149+0000","last_undegraded":"2024-04-25T09:12:33.085149+0000","last_fullsized":"2024-04-25T09:12:33.085149+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096961+0000","last_change":"2024-04-25T09:12:35.115352+0000","last_active":"2024-04-25T09:12:36.096961+0000","last_peered":"2024-04-25T09:12:36.096961+0000","last_clean":"2024-04-25T09:12:36.096961+0000","last_became_active":"2024-04-25T09:12:35.115090+0000","last_became_peered":"2024-04-25T09:12:35.115090+0000","last_unstale":"2024-04-25T09:12:36.096961+0000","last_undegraded":"2024-04-25T09:12:36.096961+0000","last_fullsized":"2024-04-25T09:12:36.096961+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:03.804395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085671+0000","last_change":"2024-04-25T09:12:33.085671+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085671+0000","last_undegraded":"2024-04-25T09:12:33.085671+0000","last_fullsized":"2024-04-25T09:12:33.085671+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097883+0000","last_change":"2024-04-25T09:12:34.116925+0000","last_active":"2024-04-25T09:12:36.097883+0000","last_peered":"2024-04-25T09:12:36.097883+0000","last_clean":"2024-04-25T09:12:36.097883+0000","last_became_active":"2024-04-25T09:12:34.116013+0000","last_became_peered":"2024-04-25T09:12:34.116013+0000","last_unstale":"2024-04-25T09:12:36.097883+0000","last_undegraded":"2024-04-25T09:12:36.097883+0000","last_fullsized":"2024-04-25T09:12:36.097883+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:49.636624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"132'3","reported_seq":17,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372141+0000","last_change":"2024-04-25T09:12:34.111922+0000","last_active":"2024-04-25T09:12:36.372141+0000","last_peered":"2024-04-25T09:12:36.372141+0000","last_clean":"2024-04-25T09:12:36.372141+0000","last_became_active":"2024-04-25T09:12:34.111591+0000","last_became_peered":"2024-04-25T09:12:34.111591+0000","last_unstale":"2024-04-25T09:12:36.372141+0000","last_undegraded":"2024-04-25T09:12:36.372141+0000","last_fullsized":"2024-04-25T09:12:36.372141+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:49.439435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"132'6","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372376+0000","last_change":"2024-04-25T09:12:34.114195+0000","last_active":"2024-04-25T09:12:36.372376+0000","last_peered":"2024-04-25T09:12:36.372376+0000","last_clean":"2024-04-25T09:12:36.372376+0000","last_became_active":"2024-04-25T09:12:34.113862+0000","last_became_peered":"2024-04-25T09:12:34.113862+0000","last_unstale":"2024-04-25T09:12:36.372376+0000","last_undegraded":"2024-04-25T09:12:36.372376+0000","last_fullsized":"2024-04-25T09:12:36.372376+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:00.424853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097525+0000","last_change":"2024-04-25T09:12:34.115786+0000","last_active":"2024-04-25T09:12:36.097525+0000","last_peered":"2024-04-25T09:12:36.097525+0000","last_clean":"2024-04-25T09:12:36.097525+0000","last_became_active":"2024-04-25T09:12:34.115524+0000","last_became_peered":"2024-04-25T09:12:34.115524+0000","last_unstale":"2024-04-25T09:12:36.097525+0000","last_undegraded":"2024-04-25T09:12:36.097525+0000","last_fullsized":"2024-04-25T09:12:36.097525+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:39.699444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372510+0000","last_change":"2024-04-25T09:12:35.131021+0000","last_active":"2024-04-25T09:12:36.372510+0000","last_peered":"2024-04-25T09:12:36.372510+0000","last_clean":"2024-04-25T09:12:36.372510+0000","last_became_active":"2024-04-25T09:12:35.130750+0000","last_became_peered":"2024-04-25T09:12:35.130750+0000","last_unstale":"2024-04-25T09:12:36.372510+0000","last_undegraded":"2024-04-25T09:12:36.372510+0000","last_fullsized":"2024-04-25T09:12:36.372510+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:37.039253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085160+0000","last_change":"2024-04-25T09:12:33.085160+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085160+0000","last_undegraded":"2024-04-25T09:12:33.085160+0000","last_fullsized":"2024-04-25T09:12:33.085160+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.165346+0000","last_change":"2024-04-25T09:12:33.165346+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.165346+0000","last_undegraded":"2024-04-25T09:12:33.165346+0000","last_fullsized":"2024-04-25T09:12:33.165346+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085076+0000","last_change":"2024-04-25T09:12:33.085076+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085076+0000","last_undegraded":"2024-04-25T09:12:33.085076+0000","last_fullsized":"2024-04-25T09:12:33.085076+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371368+0000","last_change":"2024-04-25T09:12:35.125572+0000","last_active":"2024-04-25T09:12:36.371368+0000","last_peered":"2024-04-25T09:12:36.371368+0000","last_clean":"2024-04-25T09:12:36.371368+0000","last_became_active":"2024-04-25T09:12:35.125300+0000","last_became_peered":"2024-04-25T09:12:35.125300+0000","last_unstale":"2024-04-25T09:12:36.371368+0000","last_undegraded":"2024-04-25T09:12:36.371368+0000","last_fullsized":"2024-04-25T09:12:36.371368+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:05.811985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085168+0000","last_change":"2024-04-25T09:12:33.085168+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085168+0000","last_undegraded":"2024-04-25T09:12:33.085168+0000","last_fullsized":"2024-04-25T09:12:33.085168+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371601+0000","last_change":"2024-04-25T09:12:35.125851+0000","last_active":"2024-04-25T09:12:36.371601+0000","last_peered":"2024-04-25T09:12:36.371601+0000","last_clean":"2024-04-25T09:12:36.371601+0000","last_became_active":"2024-04-25T09:12:35.125343+0000","last_became_peered":"2024-04-25T09:12:35.125343+0000","last_unstale":"2024-04-25T09:12:36.371601+0000","last_undegraded":"2024-04-25T09:12:36.371601+0000","last_fullsized":"2024-04-25T09:12:36.371601+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:00.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.164941+0000","last_change":"2024-04-25T09:12:33.164941+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.164941+0000","last_undegraded":"2024-04-25T09:12:33.164941+0000","last_fullsized":"2024-04-25T09:12:33.164941+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.088951+0000","last_change":"2024-04-25T09:12:33.088951+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.088951+0000","last_undegraded":"2024-04-25T09:12:33.088951+0000","last_fullsized":"2024-04-25T09:12:33.088951+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090361+0000","last_change":"2024-04-25T09:12:33.090361+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090361+0000","last_undegraded":"2024-04-25T09:12:33.090361+0000","last_fullsized":"2024-04-25T09:12:33.090361+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097836+0000","last_change":"2024-04-25T09:12:35.125513+0000","last_active":"2024-04-25T09:12:36.097836+0000","last_peered":"2024-04-25T09:12:36.097836+0000","last_clean":"2024-04-25T09:12:36.097836+0000","last_became_active":"2024-04-25T09:12:35.125238+0000","last_became_peered":"2024-04-25T09:12:35.125238+0000","last_unstale":"2024-04-25T09:12:36.097836+0000","last_undegraded":"2024-04-25T09:12:36.097836+0000","last_fullsized":"2024-04-25T09:12:36.097836+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:18.547869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097596+0000","last_change":"2024-04-25T09:12:34.105311+0000","last_active":"2024-04-25T09:12:36.097596+0000","last_peered":"2024-04-25T09:12:36.097596+0000","last_clean":"2024-04-25T09:12:36.097596+0000","last_became_active":"2024-04-25T09:12:34.105070+0000","last_became_peered":"2024-04-25T09:12:34.105070+0000","last_unstale":"2024-04-25T09:12:36.097596+0000","last_undegraded":"2024-04-25T09:12:36.097596+0000","last_fullsized":"2024-04-25T09:12:36.097596+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:38.389565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371839+0000","last_change":"2024-04-25T09:12:34.114130+0000","last_active":"2024-04-25T09:12:36.371839+0000","last_peered":"2024-04-25T09:12:36.371839+0000","last_clean":"2024-04-25T09:12:36.371839+0000","last_became_active":"2024-04-25T09:12:34.113813+0000","last_became_peered":"2024-04-25T09:12:34.113813+0000","last_unstale":"2024-04-25T09:12:36.371839+0000","last_undegraded":"2024-04-25T09:12:36.371839+0000","last_fullsized":"2024-04-25T09:12:36.371839+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:19.761568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.164934+0000","last_change":"2024-04-25T09:12:33.164934+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.164934+0000","last_undegraded":"2024-04-25T09:12:33.164934+0000","last_fullsized":"2024-04-25T09:12:33.164934+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097979+0000","last_change":"2024-04-25T09:12:34.110412+0000","last_active":"2024-04-25T09:12:36.097979+0000","last_peered":"2024-04-25T09:12:36.097979+0000","last_clean":"2024-04-25T09:12:36.097979+0000","last_became_active":"2024-04-25T09:12:34.110163+0000","last_became_peered":"2024-04-25T09:12:34.110163+0000","last_unstale":"2024-04-25T09:12:36.097979+0000","last_undegraded":"2024-04-25T09:12:36.097979+0000","last_fullsized":"2024-04-25T09:12:36.097979+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:34.085553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090423+0000","last_change":"2024-04-25T09:12:33.090423+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090423+0000","last_undegraded":"2024-04-25T09:12:33.090423+0000","last_fullsized":"2024-04-25T09:12:33.090423+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371411+0000","last_change":"2024-04-25T09:12:35.130641+0000","last_active":"2024-04-25T09:12:36.371411+0000","last_peered":"2024-04-25T09:12:36.371411+0000","last_clean":"2024-04-25T09:12:36.371411+0000","last_became_active":"2024-04-25T09:12:35.130358+0000","last_became_peered":"2024-04-25T09:12:35.130358+0000","last_unstale":"2024-04-25T09:12:36.371411+0000","last_undegraded":"2024-04-25T09:12:36.371411+0000","last_fullsized":"2024-04-25T09:12:36.371411+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:23.637033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090373+0000","last_change":"2024-04-25T09:12:33.090373+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090373+0000","last_undegraded":"2024-04-25T09:12:33.090373+0000","last_fullsized":"2024-04-25T09:12:33.090373+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.164927+0000","last_change":"2024-04-25T09:12:33.164927+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.164927+0000","last_undegraded":"2024-04-25T09:12:33.164927+0000","last_fullsized":"2024-04-25T09:12:33.164927+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085076+0000","last_change":"2024-04-25T09:12:33.085076+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085076+0000","last_undegraded":"2024-04-25T09:12:33.085076+0000","last_fullsized":"2024-04-25T09:12:33.085076+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371652+0000","last_change":"2024-04-25T09:12:34.111472+0000","last_active":"2024-04-25T09:12:36.371652+0000","last_peered":"2024-04-25T09:12:36.371652+0000","last_clean":"2024-04-25T09:12:36.371652+0000","last_became_active":"2024-04-25T09:12:34.111180+0000","last_became_peered":"2024-04-25T09:12:34.111180+0000","last_unstale":"2024-04-25T09:12:36.371652+0000","last_undegraded":"2024-04-25T09:12:36.371652+0000","last_fullsized":"2024-04-25T09:12:36.371652+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:55.097890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.164849+0000","last_change":"2024-04-25T09:12:33.164849+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.164849+0000","last_undegraded":"2024-04-25T09:12:33.164849+0000","last_fullsized":"2024-04-25T09:12:33.164849+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372398+0000","last_change":"2024-04-25T09:12:35.132520+0000","last_active":"2024-04-25T09:12:36.372398+0000","last_peered":"2024-04-25T09:12:36.372398+0000","last_clean":"2024-04-25T09:12:36.372398+0000","last_became_active":"2024-04-25T09:12:35.132241+0000","last_became_peered":"2024-04-25T09:12:35.132241+0000","last_unstale":"2024-04-25T09:12:36.372398+0000","last_undegraded":"2024-04-25T09:12:36.372398+0000","last_fullsized":"2024-04-25T09:12:36.372398+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:16.640588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.089039+0000","last_change":"2024-04-25T09:12:33.089039+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.089039+0000","last_undegraded":"2024-04-25T09:12:33.089039+0000","last_fullsized":"2024-04-25T09:12:33.089039+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371515+0000","last_change":"2024-04-25T09:12:34.114900+0000","last_active":"2024-04-25T09:12:36.371515+0000","last_peered":"2024-04-25T09:12:36.371515+0000","last_clean":"2024-04-25T09:12:36.371515+0000","last_became_active":"2024-04-25T09:12:34.114551+0000","last_became_peered":"2024-04-25T09:12:34.114551+0000","last_unstale":"2024-04-25T09:12:36.371515+0000","last_undegraded":"2024-04-25T09:12:36.371515+0000","last_fullsized":"2024-04-25T09:12:36.371515+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:17.056789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":376,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371118+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:12:36.371118+0000","last_peered":"2024-04-25T09:12:36.371118+0000","last_clean":"2024-04-25T09:12:36.371118+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:12:36.371118+0000","last_undegraded":"2024-04-25T09:12:36.371118+0000","last_fullsized":"2024-04-25T09:12:36.371118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":1736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509562,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54976,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316864,"statfs":{"total":96636764160,"available":96580468736,"internally_reserved":0,"allocated":1617920,"data_stored":750230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509562,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50816,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321024,"statfs":{"total":96636764160,"available":96584728576,"internally_reserved":0,"allocated":1617920,"data_stored":750230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509563,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59124,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312716,"statfs":{"total":96636764160,"available":96576221184,"internally_reserved":0,"allocated":1605632,"data_stored":744021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59128,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312712,"statfs":{"total":96636764160,"available":96576217088,"internally_reserved":0,"allocated":1617920,"data_stored":750230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509563,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55016,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316824,"statfs":{"total":96636764160,"available":96580427776,"internally_reserved":0,"allocated":1662976,"data_stored":771364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509563,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50804,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321036,"statfs":{"total":96636764160,"available":96584740864,"internally_reserved":0,"allocated":1605632,"data_stored":744021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509563,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55552,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316288,"statfs":{"total":96636764160,"available":96579878912,"internally_reserved":0,"allocated":2211840,"data_stored":1340598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574971,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51440,"kb_used_data":2212,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320400,"statfs":{"total":96636764160,"available":96584089600,"internally_reserved":0,"allocated":2265088,"data_stored":1362818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:12:39.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3e is not active+clean 2024-04-25T09:12:39.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3d is not active+clean 2024-04-25T09:12:39.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3c is not active+clean 2024-04-25T09:12:39.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3b is not active+clean 2024-04-25T09:12:39.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3a is not active+clean 2024-04-25T09:12:39.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.38 is not active+clean 2024-04-25T09:12:39.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.37 is not active+clean 2024-04-25T09:12:39.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.36 is not active+clean 2024-04-25T09:12:39.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.35 is not active+clean 2024-04-25T09:12:39.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.33 is not active+clean 2024-04-25T09:12:39.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.30 is not active+clean 2024-04-25T09:12:39.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2f is not active+clean 2024-04-25T09:12:39.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2e is not active+clean 2024-04-25T09:12:39.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2c is not active+clean 2024-04-25T09:12:39.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2b is not active+clean 2024-04-25T09:12:39.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.29 is not active+clean 2024-04-25T09:12:39.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.28 is not active+clean 2024-04-25T09:12:39.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.27 is not active+clean 2024-04-25T09:12:39.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.26 is not active+clean 2024-04-25T09:12:39.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.24 is not active+clean 2024-04-25T09:12:39.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.23 is not active+clean 2024-04-25T09:12:39.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.22 is not active+clean 2024-04-25T09:12:39.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.21 is not active+clean 2024-04-25T09:12:39.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.20 is not active+clean 2024-04-25T09:12:39.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.18 is not active+clean 2024-04-25T09:12:39.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1f is not active+clean 2024-04-25T09:12:39.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.085382+0000', 'last_change': '2024-04-25T09:12:33.085382+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.085382+0000', 'last_undegraded': '2024-04-25T09:12:33.085382+0000', 'last_fullsized': '2024-04-25T09:12:33.085382+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:12:39.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1e is not active+clean 2024-04-25T09:12:39.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.090084+0000', 'last_change': '2024-04-25T09:12:33.090084+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.090084+0000', 'last_undegraded': '2024-04-25T09:12:33.090084+0000', 'last_fullsized': '2024-04-25T09:12:33.090084+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:12:39.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1a is not active+clean 2024-04-25T09:12:39.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1c is not active+clean 2024-04-25T09:12:39.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1b is not active+clean 2024-04-25T09:12:39.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.090857+0000', 'last_change': '2024-04-25T09:12:33.090857+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.090857+0000', 'last_undegraded': '2024-04-25T09:12:33.090857+0000', 'last_fullsized': '2024-04-25T09:12:33.090857+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:12:39.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1d is not active+clean 2024-04-25T09:12:39.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1a is not active+clean 2024-04-25T09:12:39.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.089714+0000', 'last_change': '2024-04-25T09:12:33.089714+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.089714+0000', 'last_undegraded': '2024-04-25T09:12:33.089714+0000', 'last_fullsized': '2024-04-25T09:12:33.089714+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:12:39.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1e is not active+clean 2024-04-25T09:12:39.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.19 is not active+clean 2024-04-25T09:12:39.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.165483+0000', 'last_change': '2024-04-25T09:12:33.165483+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.165483+0000', 'last_undegraded': '2024-04-25T09:12:33.165483+0000', 'last_fullsized': '2024-04-25T09:12:33.165483+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:12:39.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.18 is not active+clean 2024-04-25T09:12:39.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.085149+0000', 'last_change': '2024-04-25T09:12:33.085149+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.085149+0000', 'last_undegraded': '2024-04-25T09:12:33.085149+0000', 'last_fullsized': '2024-04-25T09:12:33.085149+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:12:39.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.17 is not active+clean 2024-04-25T09:12:39.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.085671+0000', 'last_change': '2024-04-25T09:12:33.085671+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.085671+0000', 'last_undegraded': '2024-04-25T09:12:33.085671+0000', 'last_fullsized': '2024-04-25T09:12:33.085671+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:12:39.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.11 is not active+clean 2024-04-25T09:12:39.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.12 is not active+clean 2024-04-25T09:12:39.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.13 is not active+clean 2024-04-25T09:12:39.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.14 is not active+clean 2024-04-25T09:12:39.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.11 is not active+clean 2024-04-25T09:12:39.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.085160+0000', 'last_change': '2024-04-25T09:12:33.085160+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.085160+0000', 'last_undegraded': '2024-04-25T09:12:33.085160+0000', 'last_fullsized': '2024-04-25T09:12:33.085160+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:12:39.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.17 is not active+clean 2024-04-25T09:12:39.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.10 is not active+clean 2024-04-25T09:12:39.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.165346+0000', 'last_change': '2024-04-25T09:12:33.165346+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.165346+0000', 'last_undegraded': '2024-04-25T09:12:33.165346+0000', 'last_fullsized': '2024-04-25T09:12:33.165346+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:12:39.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.8 is not active+clean 2024-04-25T09:12:39.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.f is not active+clean 2024-04-25T09:12:39.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.085076+0000', 'last_change': '2024-04-25T09:12:33.085076+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.085076+0000', 'last_undegraded': '2024-04-25T09:12:33.085076+0000', 'last_fullsized': '2024-04-25T09:12:33.085076+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:12:39.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.e is not active+clean 2024-04-25T09:12:39.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.085168+0000', 'last_change': '2024-04-25T09:12:33.085168+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.085168+0000', 'last_undegraded': '2024-04-25T09:12:33.085168+0000', 'last_fullsized': '2024-04-25T09:12:33.085168+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:12:39.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.d is not active+clean 2024-04-25T09:12:39.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.164941+0000', 'last_change': '2024-04-25T09:12:33.164941+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.164941+0000', 'last_undegraded': '2024-04-25T09:12:33.164941+0000', 'last_fullsized': '2024-04-25T09:12:33.164941+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:12:39.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.b is not active+clean 2024-04-25T09:12:39.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.c is not active+clean 2024-04-25T09:12:39.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.088951+0000', 'last_change': '2024-04-25T09:12:33.088951+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.088951+0000', 'last_undegraded': '2024-04-25T09:12:33.088951+0000', 'last_fullsized': '2024-04-25T09:12:33.088951+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:12:39.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.c is not active+clean 2024-04-25T09:12:39.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.b is not active+clean 2024-04-25T09:12:39.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.090361+0000', 'last_change': '2024-04-25T09:12:33.090361+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.090361+0000', 'last_undegraded': '2024-04-25T09:12:33.090361+0000', 'last_fullsized': '2024-04-25T09:12:33.090361+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:12:39.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.e is not active+clean 2024-04-25T09:12:39.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.f is not active+clean 2024-04-25T09:12:39.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.8 is not active+clean 2024-04-25T09:12:39.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.164934+0000', 'last_change': '2024-04-25T09:12:33.164934+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.164934+0000', 'last_undegraded': '2024-04-25T09:12:33.164934+0000', 'last_fullsized': '2024-04-25T09:12:33.164934+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:12:39.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.0 is not active+clean 2024-04-25T09:12:39.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1 is not active+clean 2024-04-25T09:12:39.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.6 is not active+clean 2024-04-25T09:12:39.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.090423+0000', 'last_change': '2024-04-25T09:12:33.090423+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.090423+0000', 'last_undegraded': '2024-04-25T09:12:33.090423+0000', 'last_fullsized': '2024-04-25T09:12:33.090423+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:12:39.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.5 is not active+clean 2024-04-25T09:12:39.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.090373+0000', 'last_change': '2024-04-25T09:12:33.090373+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.090373+0000', 'last_undegraded': '2024-04-25T09:12:33.090373+0000', 'last_fullsized': '2024-04-25T09:12:33.090373+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:12:39.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3 is not active+clean 2024-04-25T09:12:39.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.4 is not active+clean 2024-04-25T09:12:39.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.164927+0000', 'last_change': '2024-04-25T09:12:33.164927+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.164927+0000', 'last_undegraded': '2024-04-25T09:12:33.164927+0000', 'last_fullsized': '2024-04-25T09:12:33.164927+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:12:39.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.4 is not active+clean 2024-04-25T09:12:39.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3 is not active+clean 2024-04-25T09:12:39.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.085076+0000', 'last_change': '2024-04-25T09:12:33.085076+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.085076+0000', 'last_undegraded': '2024-04-25T09:12:33.085076+0000', 'last_fullsized': '2024-04-25T09:12:33.085076+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:12:39.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.5 is not active+clean 2024-04-25T09:12:39.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.6 is not active+clean 2024-04-25T09:12:39.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1 is not active+clean 2024-04-25T09:12:39.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.164849+0000', 'last_change': '2024-04-25T09:12:33.164849+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.164849+0000', 'last_undegraded': '2024-04-25T09:12:33.164849+0000', 'last_fullsized': '2024-04-25T09:12:33.164849+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:12:39.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.0 is not active+clean 2024-04-25T09:12:39.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 130, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:12:33.089039+0000', 'last_change': '2024-04-25T09:12:33.089039+0000', 'last_active': '2024-04-25T09:12:33.076368+0000', 'last_peered': '2024-04-25T09:12:33.076368+0000', 'last_clean': '2024-04-25T09:12:33.076368+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:33.089039+0000', 'last_undegraded': '2024-04-25T09:12:33.089039+0000', 'last_fullsized': '2024-04-25T09:12:33.089039+0000', 'mapping_epoch': 130, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 130, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:33.076368+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:12:39.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.15 is not active+clean 2024-04-25T09:12:39.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:12:34.083304+0000', 'last_change': '2024-04-25T09:12:34.083304+0000', 'last_active': '2024-04-25T09:12:34.083304+0000', 'last_peered': '2024-04-25T09:12:34.083304+0000', 'last_clean': '2024-04-25T09:12:34.083304+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:12:34.083304+0000', 'last_undegraded': '2024-04-25T09:12:34.083304+0000', 'last_fullsized': '2024-04-25T09:12:34.083304+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'last_clean_scrub_stamp': '2024-04-25T09:12:34.083304+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:12:39.923 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:12:40.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.105+0000 7f84d9c00640 1 Processor -- start 2024-04-25T09:12:40.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.105+0000 7f84d9c00640 1 -- start start 2024-04-25T09:12:40.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.105+0000 7f84d9c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f84d40b3e70 0x7f84d40b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:40.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.105+0000 7f84d9c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d40b3590 con 0x7f84d415edd0 2024-04-25T09:12:40.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.105+0000 7f84d9c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d40b4790 con 0x7f84d40aefa0 2024-04-25T09:12:40.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.105+0000 7f84d9c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d406dd50 con 0x7f84d40b3e70 2024-04-25T09:12:40.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.105+0000 7f84d2a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f84d40b3e70 0x7f84d40b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:40.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.105+0000 7f84d2a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f84d40b3e70 0x7f84d40b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59928/0 (socket says 172.21.15.173:59928) 2024-04-25T09:12:40.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.105+0000 7f84d3400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f84d415edd0 0x7f84d40b2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41900/0 (socket says 172.21.15.173:41900) 2024-04-25T09:12:40.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.105+0000 7f84d2a00640 1 -- 172.21.15.173:0/1899319476 learned_addr learned my addr 172.21.15.173:0/1899319476 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:40.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.105+0000 7f84d2a00640 1 -- 172.21.15.173:0/1899319476 >> v1:172.21.15.194:6789/0 conn(0x7f84d40aefa0 legacy=0x7f84d40b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:40.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.105+0000 7f84d2a00640 1 -- 172.21.15.173:0/1899319476 >> v1:172.21.15.173:6789/0 conn(0x7f84d415edd0 legacy=0x7f84d40b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:40.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.105+0000 7f84d2a00640 1 -- 172.21.15.173:0/1899319476 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d415f320 con 0x7f84d40b3e70 2024-04-25T09:12:40.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.109+0000 7f84d2a00640 1 --2- 172.21.15.173:0/1899319476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d40b3e70 0x7f84d40b4250 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f84c400d150 tx=0x7f84c401ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60940ffbaf34673 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:40.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.109+0000 7f84d1600640 1 -- 172.21.15.173:0/1899319476 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c400b2d0 con 0x7f84d40b3e70 2024-04-25T09:12:40.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.109+0000 7f84d1600640 1 -- 172.21.15.173:0/1899319476 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c400b470 con 0x7f84d40b3e70 2024-04-25T09:12:40.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.109+0000 7f84d1600640 1 -- 172.21.15.173:0/1899319476 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c40a7bd0 con 0x7f84d40b3e70 2024-04-25T09:12:40.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.109+0000 7f84d9c00640 1 -- 172.21.15.173:0/1899319476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d40b3e70 msgr2=0x7f84d40b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:40.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.109+0000 7f84d9c00640 1 --2- 172.21.15.173:0/1899319476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d40b3e70 0x7f84d40b4250 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f84c400d150 tx=0x7f84c401ebc0 comp rx=0 tx=0).stop 2024-04-25T09:12:40.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.109+0000 7f84d9c00640 1 -- 172.21.15.173:0/1899319476 shutdown_connections 2024-04-25T09:12:40.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.109+0000 7f84d9c00640 1 --2- 172.21.15.173:0/1899319476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d40b3e70 0x7f84d40b4250 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:40.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.109+0000 7f84d9c00640 1 -- 172.21.15.173:0/1899319476 >> 172.21.15.173:0/1899319476 conn(0x7f84d406ac90 msgr2=0x7f84d406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:40.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.109+0000 7f84d9c00640 1 -- 172.21.15.173:0/1899319476 shutdown_connections 2024-04-25T09:12:40.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.109+0000 7f84d9c00640 1 -- 172.21.15.173:0/1899319476 wait complete. 2024-04-25T09:12:40.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d9c00640 1 Processor -- start 2024-04-25T09:12:40.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d9c00640 1 -- start start 2024-04-25T09:12:40.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d9c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d40aefa0 0x7f84d4144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:40.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d9c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d40b3e70 0x7f84d40b2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:40.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d9c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d415edd0 0x7f84d40b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:40.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d9c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d415aba0 con 0x7f84d415edd0 2024-04-25T09:12:40.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d9c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d40ce7b0 con 0x7f84d40b3e70 2024-04-25T09:12:40.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d9c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d406e1e0 con 0x7f84d40aefa0 2024-04-25T09:12:40.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d415edd0 0x7f84d40b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:40.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d415edd0 0x7f84d40b2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59934/0 (socket says 172.21.15.173:59934) 2024-04-25T09:12:40.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d3400640 1 -- 172.21.15.173:0/239336312 learned_addr learned my addr 172.21.15.173:0/239336312 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:40.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d2a00640 1 --2- 172.21.15.173:0/239336312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d40aefa0 0x7f84d4144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:40.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d2000640 1 --2- 172.21.15.173:0/239336312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d40b3e70 0x7f84d40b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:40.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d3400640 1 -- 172.21.15.173:0/239336312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d40aefa0 msgr2=0x7f84d4144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:40.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d3400640 1 --2- 172.21.15.173:0/239336312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d40aefa0 0x7f84d4144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:40.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d3400640 1 -- 172.21.15.173:0/239336312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d40b3e70 msgr2=0x7f84d40b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:40.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d3400640 1 --2- 172.21.15.173:0/239336312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d40b3e70 0x7f84d40b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:40.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d3400640 1 -- 172.21.15.173:0/239336312 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d414ae90 con 0x7f84d415edd0 2024-04-25T09:12:40.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d3400640 1 --2- 172.21.15.173:0/239336312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d415edd0 0x7f84d40b2ad0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00c3f0 tx=0x7f84cc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:40.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84caa00640 1 -- 172.21.15.173:0/239336312 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc0074e0 con 0x7f84d415edd0 2024-04-25T09:12:40.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84caa00640 1 -- 172.21.15.173:0/239336312 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84cc007680 con 0x7f84d415edd0 2024-04-25T09:12:40.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d9c00640 1 -- 172.21.15.173:0/239336312 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d414b170 con 0x7f84d415edd0 2024-04-25T09:12:40.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84caa00640 1 -- 172.21.15.173:0/239336312 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc004a10 con 0x7f84d415edd0 2024-04-25T09:12:40.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.113+0000 7f84d9c00640 1 -- 172.21.15.173:0/239336312 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d414b730 con 0x7f84d415edd0 2024-04-25T09:12:40.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.117+0000 7f84d9c00640 1 -- 172.21.15.173:0/239336312 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d4073a40 con 0x7f84d415edd0 2024-04-25T09:12:40.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.117+0000 7f84caa00640 1 -- 172.21.15.173:0/239336312 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f84cc01a020 con 0x7f84d415edd0 2024-04-25T09:12:40.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.117+0000 7f84caa00640 1 --2- 172.21.15.173:0/239336312 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84b4066f60 0x7f84b4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:40.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.117+0000 7f84caa00640 1 -- 172.21.15.173:0/239336312 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f84cc0847a0 con 0x7f84d415edd0 2024-04-25T09:12:40.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.117+0000 7f84d2a00640 1 --2- 172.21.15.173:0/239336312 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84b4066f60 0x7f84b4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:40.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.117+0000 7f84d2a00640 1 --2- 172.21.15.173:0/239336312 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84b4066f60 0x7f84b4069420 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f84c40b0000 tx=0x7f84c40a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:40.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.121+0000 7f84caa00640 1 -- 172.21.15.173:0/239336312 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f84cc054fd0 con 0x7f84d415edd0 2024-04-25T09:12:40.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.333+0000 7f84d9c00640 1 -- 172.21.15.173:0/239336312 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f84d406e540 con 0x7f84d415edd0 2024-04-25T09:12:40.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.333+0000 7f84caa00640 1 -- 172.21.15.173:0/239336312 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1337 (secure 0 0 0) 0x7f84cc059070 con 0x7f84d415edd0 2024-04-25T09:12:40.319 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:40.319 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":614,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":133,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":46},{"state_name":"active+clean","count":30},{"state_name":"creating+peering","count":21}],"num_pgs":97,"num_pools":3,"num_objects":13,"data_bytes":592104,"bytes_used":447340544,"bytes_avail":772646772736,"bytes_total":773094113280,"unknown_pgs_ratio":0.47422680258750916,"inactive_pgs_ratio":0.2164948433637619,"write_bytes_sec":1950,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":89,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":9411}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2024-04-25T09:12:24.854436+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:12:40.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.337+0000 7f84d9c00640 1 -- 172.21.15.173:0/239336312 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84b4066f60 msgr2=0x7f84b4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:40.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.337+0000 7f84d9c00640 1 --2- 172.21.15.173:0/239336312 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84b4066f60 0x7f84b4069420 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f84c40b0000 tx=0x7f84c40a9070 comp rx=0 tx=0).stop 2024-04-25T09:12:40.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.337+0000 7f84d9c00640 1 -- 172.21.15.173:0/239336312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d415edd0 msgr2=0x7f84d40b2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:40.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.337+0000 7f84d9c00640 1 --2- 172.21.15.173:0/239336312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d415edd0 0x7f84d40b2ad0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00c3f0 tx=0x7f84cc00c8b0 comp rx=0 tx=0).stop 2024-04-25T09:12:40.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.337+0000 7f84d9c00640 1 -- 172.21.15.173:0/239336312 shutdown_connections 2024-04-25T09:12:40.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.337+0000 7f84d9c00640 1 --2- 172.21.15.173:0/239336312 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f84b4066f60 0x7f84b4069420 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:40.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.337+0000 7f84d9c00640 1 --2- 172.21.15.173:0/239336312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d415edd0 0x7f84d40b2ad0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:40.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.337+0000 7f84d9c00640 1 --2- 172.21.15.173:0/239336312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d40b3e70 0x7f84d40b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:40.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.337+0000 7f84d9c00640 1 --2- 172.21.15.173:0/239336312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d40aefa0 0x7f84d4144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:40.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.337+0000 7f84d9c00640 1 -- 172.21.15.173:0/239336312 >> 172.21.15.173:0/239336312 conn(0x7f84d406ac90 msgr2=0x7f84d414e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:40.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.337+0000 7f84d9c00640 1 -- 172.21.15.173:0/239336312 shutdown_connections 2024-04-25T09:12:40.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.337+0000 7f84d9c00640 1 -- 172.21.15.173:0/239336312 wait complete. 2024-04-25T09:12:40.340 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:12:40.340 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:12:40.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.489+0000 7f5a03e00640 1 Processor -- start 2024-04-25T09:12:40.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.489+0000 7f5a03e00640 1 -- start start 2024-04-25T09:12:40.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.493+0000 7f5a03e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f59fc0cc8b0 0x7f59fc0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:40.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.493+0000 7f5a03e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59fc06e7c0 con 0x7f59fc0ce8f0 2024-04-25T09:12:40.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.493+0000 7f5a03e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59fc06d720 con 0x7f59fc145250 2024-04-25T09:12:40.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.493+0000 7f5a03e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59fc06da00 con 0x7f59fc0cc8b0 2024-04-25T09:12:40.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.493+0000 7f5a00a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f59fc0cc8b0 0x7f59fc0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:40.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.493+0000 7f5a01e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f59fc0ce8f0 0x7f59fc0ced00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:41906/0 (socket says 172.21.15.173:41906) 2024-04-25T09:12:40.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.493+0000 7f5a01e00640 1 -- 172.21.15.173:0/3432603699 learned_addr learned my addr 172.21.15.173:0/3432603699 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:40.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.493+0000 7f5a00a00640 1 -- 172.21.15.173:0/3432603699 >> v1:172.21.15.194:6789/0 conn(0x7f59fc145250 legacy=0x7f59fc15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:40.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.493+0000 7f5a00a00640 1 -- 172.21.15.173:0/3432603699 >> v1:172.21.15.173:6789/0 conn(0x7f59fc0ce8f0 legacy=0x7f59fc0ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:40.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.493+0000 7f5a00a00640 1 -- 172.21.15.173:0/3432603699 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59fc06dce0 con 0x7f59fc0cc8b0 2024-04-25T09:12:40.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.493+0000 7f59fbe00640 1 -- 172.21.15.173:0/3432603699 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505103876 0 0) 0x7f59fc06e7c0 con 0x7f59fc0ce8f0 2024-04-25T09:12:40.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.497+0000 7f5a00a00640 1 --2- 172.21.15.173:0/3432603699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59fc0cc8b0 0x7f59fc0ccd30 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f59e80097c0 tx=0x7f59e801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da088e45e74a625f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:40.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.497+0000 7f59fbe00640 1 -- 172.21.15.173:0/3432603699 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e80b0070 con 0x7f59fc0cc8b0 2024-04-25T09:12:40.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.497+0000 7f59fbe00640 1 -- 172.21.15.173:0/3432603699 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e8004230 con 0x7f59fc0cc8b0 2024-04-25T09:12:40.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.497+0000 7f59fbe00640 1 -- 172.21.15.173:0/3432603699 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8003620 con 0x7f59fc0cc8b0 2024-04-25T09:12:40.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.497+0000 7f5a03e00640 1 -- 172.21.15.173:0/3432603699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59fc0cc8b0 msgr2=0x7f59fc0ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:40.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.497+0000 7f5a03e00640 1 --2- 172.21.15.173:0/3432603699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59fc0cc8b0 0x7f59fc0ccd30 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f59e80097c0 tx=0x7f59e801c460 comp rx=0 tx=0).stop 2024-04-25T09:12:40.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.497+0000 7f5a03e00640 1 -- 172.21.15.173:0/3432603699 shutdown_connections 2024-04-25T09:12:40.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.497+0000 7f5a03e00640 1 --2- 172.21.15.173:0/3432603699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59fc0cc8b0 0x7f59fc0ccd30 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:40.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.497+0000 7f5a03e00640 1 -- 172.21.15.173:0/3432603699 >> 172.21.15.173:0/3432603699 conn(0x7f59fc06ac90 msgr2=0x7f59fc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:40.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.497+0000 7f5a03e00640 1 -- 172.21.15.173:0/3432603699 shutdown_connections 2024-04-25T09:12:40.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.497+0000 7f5a03e00640 1 -- 172.21.15.173:0/3432603699 wait complete. 2024-04-25T09:12:40.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.497+0000 7f5a03e00640 1 Processor -- start 2024-04-25T09:12:40.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.497+0000 7f5a03e00640 1 -- start start 2024-04-25T09:12:40.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a03e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59fc0cc8b0 0x7f59fc140be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:40.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a03e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59fc0ce8f0 0x7f59fc13d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:40.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a03e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59fc145250 0x7f59fc13d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:40.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a03e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc06d380 con 0x7f59fc0cc8b0 2024-04-25T09:12:40.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a03e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc06ef80 con 0x7f59fc145250 2024-04-25T09:12:40.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a03e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc06d500 con 0x7f59fc0ce8f0 2024-04-25T09:12:40.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a01400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59fc0cc8b0 0x7f59fc140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:40.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a01400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59fc0cc8b0 0x7f59fc140be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:59946/0 (socket says 172.21.15.173:59946) 2024-04-25T09:12:40.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a01400640 1 -- 172.21.15.173:0/4092921899 learned_addr learned my addr 172.21.15.173:0/4092921899 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:40.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a01400640 1 -- 172.21.15.173:0/4092921899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59fc0ce8f0 msgr2=0x7f59fc13d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:40.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a01400640 1 --2- 172.21.15.173:0/4092921899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59fc0ce8f0 0x7f59fc13d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:40.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a01400640 1 -- 172.21.15.173:0/4092921899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59fc145250 msgr2=0x7f59fc13d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:40.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a01e00640 1 --2- 172.21.15.173:0/4092921899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59fc145250 0x7f59fc13d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:40.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a01400640 1 --2- 172.21.15.173:0/4092921899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59fc145250 0x7f59fc13d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:40.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a01400640 1 -- 172.21.15.173:0/4092921899 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59fc13dbf0 con 0x7f59fc0cc8b0 2024-04-25T09:12:40.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a01e00640 1 --2- 172.21.15.173:0/4092921899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59fc145250 0x7f59fc13d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:40.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a01400640 1 --2- 172.21.15.173:0/4092921899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59fc0cc8b0 0x7f59fc140be0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f59f000ba50 tx=0x7f59f000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:40.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f59f9600640 1 -- 172.21.15.173:0/4092921899 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f0019070 con 0x7f59fc0cc8b0 2024-04-25T09:12:40.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f59f9600640 1 -- 172.21.15.173:0/4092921899 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f000cc20 con 0x7f59fc0cc8b0 2024-04-25T09:12:40.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f59f9600640 1 -- 172.21.15.173:0/4092921899 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f0014680 con 0x7f59fc0cc8b0 2024-04-25T09:12:40.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a03e00640 1 -- 172.21.15.173:0/4092921899 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59fc13de60 con 0x7f59fc0cc8b0 2024-04-25T09:12:40.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a03e00640 1 -- 172.21.15.173:0/4092921899 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59fc13e420 con 0x7f59fc0cc8b0 2024-04-25T09:12:40.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f5a03e00640 1 -- 172.21.15.173:0/4092921899 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59fc073a40 con 0x7f59fc0cc8b0 2024-04-25T09:12:40.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.501+0000 7f59f9600640 1 -- 172.21.15.173:0/4092921899 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f59f001c070 con 0x7f59fc0cc8b0 2024-04-25T09:12:40.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.505+0000 7f59f9600640 1 --2- 172.21.15.173:0/4092921899 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59dc066f60 0x7f59dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:40.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.505+0000 7f59f9600640 1 -- 172.21.15.173:0/4092921899 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f59f0084f20 con 0x7f59fc0cc8b0 2024-04-25T09:12:40.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.505+0000 7f5a00a00640 1 --2- 172.21.15.173:0/4092921899 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59dc066f60 0x7f59dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:40.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.505+0000 7f5a00a00640 1 --2- 172.21.15.173:0/4092921899 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59dc066f60 0x7f59dc069420 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f59e80ad000 tx=0x7f59e8004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:40.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.509+0000 7f59f9600640 1 -- 172.21.15.173:0/4092921899 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f59f00556b0 con 0x7f59fc0cc8b0 2024-04-25T09:12:40.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.657+0000 7f5a03e00640 1 -- 172.21.15.173:0/4092921899 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f59fc0cfd80 con 0x7f59dc066f60 2024-04-25T09:12:40.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.665+0000 7f59f9600640 1 -- 172.21.15.173:0/4092921899 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243590 (secure 0 0 0) 0x7f59fc0cfd80 con 0x7f59dc066f60 2024-04-25T09:12:40.654 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:40.655 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:12:40.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.669+0000 7f5a03e00640 1 -- 172.21.15.173:0/4092921899 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59dc066f60 msgr2=0x7f59dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:40.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.669+0000 7f5a03e00640 1 --2- 172.21.15.173:0/4092921899 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59dc066f60 0x7f59dc069420 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f59e80ad000 tx=0x7f59e8004740 comp rx=0 tx=0).stop 2024-04-25T09:12:40.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.669+0000 7f5a03e00640 1 -- 172.21.15.173:0/4092921899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59fc0cc8b0 msgr2=0x7f59fc140be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:40.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.669+0000 7f5a03e00640 1 --2- 172.21.15.173:0/4092921899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59fc0cc8b0 0x7f59fc140be0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f59f000ba50 tx=0x7f59f000bf10 comp rx=0 tx=0).stop 2024-04-25T09:12:40.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.669+0000 7f5a03e00640 1 -- 172.21.15.173:0/4092921899 shutdown_connections 2024-04-25T09:12:40.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.669+0000 7f5a03e00640 1 --2- 172.21.15.173:0/4092921899 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f59dc066f60 0x7f59dc069420 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:40.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.669+0000 7f5a03e00640 1 --2- 172.21.15.173:0/4092921899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59fc145250 0x7f59fc13d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:40.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.669+0000 7f5a03e00640 1 --2- 172.21.15.173:0/4092921899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59fc0ce8f0 0x7f59fc13d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:40.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.669+0000 7f5a03e00640 1 --2- 172.21.15.173:0/4092921899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59fc0cc8b0 0x7f59fc140be0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:40.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.669+0000 7f5a03e00640 1 -- 172.21.15.173:0/4092921899 >> 172.21.15.173:0/4092921899 conn(0x7f59fc06ac90 msgr2=0x7f59fc0cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:40.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.669+0000 7f5a03e00640 1 -- 172.21.15.173:0/4092921899 shutdown_connections 2024-04-25T09:12:40.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:40.669+0000 7f5a03e00640 1 -- 172.21.15.173:0/4092921899 wait complete. 2024-04-25T09:12:40.674 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":427,"stamp":"2024-04-25T09:12:38.857384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592104,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":436856,"kb_used_data":13872,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754537864,"statfs":{"total":773094113280,"available":772646772736,"internally_reserved":0,"allocated":14204928,"data_stored":7213512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":432983600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.773893"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097934+0000","last_change":"2024-04-25T09:12:35.114369+0000","last_active":"2024-04-25T09:12:36.097934+0000","last_peered":"2024-04-25T09:12:36.097934+0000","last_clean":"2024-04-25T09:12:36.097934+0000","last_became_active":"2024-04-25T09:12:35.113316+0000","last_became_peered":"2024-04-25T09:12:35.113316+0000","last_unstale":"2024-04-25T09:12:36.097934+0000","last_undegraded":"2024-04-25T09:12:36.097934+0000","last_fullsized":"2024-04-25T09:12:36.097934+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:45.449663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372005+0000","last_change":"2024-04-25T09:12:35.128837+0000","last_active":"2024-04-25T09:12:36.372005+0000","last_peered":"2024-04-25T09:12:36.372005+0000","last_clean":"2024-04-25T09:12:36.372005+0000","last_became_active":"2024-04-25T09:12:35.128494+0000","last_became_peered":"2024-04-25T09:12:35.128494+0000","last_unstale":"2024-04-25T09:12:36.372005+0000","last_undegraded":"2024-04-25T09:12:36.372005+0000","last_fullsized":"2024-04-25T09:12:36.372005+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:15.711993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097917+0000","last_change":"2024-04-25T09:12:35.109962+0000","last_active":"2024-04-25T09:12:36.097917+0000","last_peered":"2024-04-25T09:12:36.097917+0000","last_clean":"2024-04-25T09:12:36.097917+0000","last_became_active":"2024-04-25T09:12:35.109686+0000","last_became_peered":"2024-04-25T09:12:35.109686+0000","last_unstale":"2024-04-25T09:12:36.097917+0000","last_undegraded":"2024-04-25T09:12:36.097917+0000","last_fullsized":"2024-04-25T09:12:36.097917+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:33.266966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097549+0000","last_change":"2024-04-25T09:12:35.125641+0000","last_active":"2024-04-25T09:12:36.097549+0000","last_peered":"2024-04-25T09:12:36.097549+0000","last_clean":"2024-04-25T09:12:36.097549+0000","last_became_active":"2024-04-25T09:12:35.125341+0000","last_became_peered":"2024-04-25T09:12:35.125341+0000","last_unstale":"2024-04-25T09:12:36.097549+0000","last_undegraded":"2024-04-25T09:12:36.097549+0000","last_fullsized":"2024-04-25T09:12:36.097549+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:49.194891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096964+0000","last_change":"2024-04-25T09:12:35.116739+0000","last_active":"2024-04-25T09:12:36.096964+0000","last_peered":"2024-04-25T09:12:36.096964+0000","last_clean":"2024-04-25T09:12:36.096964+0000","last_became_active":"2024-04-25T09:12:35.116447+0000","last_became_peered":"2024-04-25T09:12:35.116447+0000","last_unstale":"2024-04-25T09:12:36.096964+0000","last_undegraded":"2024-04-25T09:12:36.096964+0000","last_fullsized":"2024-04-25T09:12:36.096964+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:38.388538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371875+0000","last_change":"2024-04-25T09:12:35.127360+0000","last_active":"2024-04-25T09:12:36.371875+0000","last_peered":"2024-04-25T09:12:36.371875+0000","last_clean":"2024-04-25T09:12:36.371875+0000","last_became_active":"2024-04-25T09:12:35.127080+0000","last_became_peered":"2024-04-25T09:12:35.127080+0000","last_unstale":"2024-04-25T09:12:36.371875+0000","last_undegraded":"2024-04-25T09:12:36.371875+0000","last_fullsized":"2024-04-25T09:12:36.371875+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:34.934426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097559+0000","last_change":"2024-04-25T09:12:35.109705+0000","last_active":"2024-04-25T09:12:36.097559+0000","last_peered":"2024-04-25T09:12:36.097559+0000","last_clean":"2024-04-25T09:12:36.097559+0000","last_became_active":"2024-04-25T09:12:35.109437+0000","last_became_peered":"2024-04-25T09:12:35.109437+0000","last_unstale":"2024-04-25T09:12:36.097559+0000","last_undegraded":"2024-04-25T09:12:36.097559+0000","last_fullsized":"2024-04-25T09:12:36.097559+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:15.440771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371926+0000","last_change":"2024-04-25T09:12:35.128555+0000","last_active":"2024-04-25T09:12:36.371926+0000","last_peered":"2024-04-25T09:12:36.371926+0000","last_clean":"2024-04-25T09:12:36.371926+0000","last_became_active":"2024-04-25T09:12:35.127720+0000","last_became_peered":"2024-04-25T09:12:35.127720+0000","last_unstale":"2024-04-25T09:12:36.371926+0000","last_undegraded":"2024-04-25T09:12:36.371926+0000","last_fullsized":"2024-04-25T09:12:36.371926+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:06.969509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085382+0000","last_change":"2024-04-25T09:12:33.085382+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085382+0000","last_undegraded":"2024-04-25T09:12:33.085382+0000","last_fullsized":"2024-04-25T09:12:33.085382+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097381+0000","last_change":"2024-04-25T09:12:35.111869+0000","last_active":"2024-04-25T09:12:36.097381+0000","last_peered":"2024-04-25T09:12:36.097381+0000","last_clean":"2024-04-25T09:12:36.097381+0000","last_became_active":"2024-04-25T09:12:35.111471+0000","last_became_peered":"2024-04-25T09:12:35.111471+0000","last_unstale":"2024-04-25T09:12:36.097381+0000","last_undegraded":"2024-04-25T09:12:36.097381+0000","last_fullsized":"2024-04-25T09:12:36.097381+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:12.635916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090084+0000","last_change":"2024-04-25T09:12:33.090084+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090084+0000","last_undegraded":"2024-04-25T09:12:33.090084+0000","last_fullsized":"2024-04-25T09:12:33.090084+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372261+0000","last_change":"2024-04-25T09:12:34.113365+0000","last_active":"2024-04-25T09:12:36.372261+0000","last_peered":"2024-04-25T09:12:36.372261+0000","last_clean":"2024-04-25T09:12:36.372261+0000","last_became_active":"2024-04-25T09:12:34.113074+0000","last_became_peered":"2024-04-25T09:12:34.113074+0000","last_unstale":"2024-04-25T09:12:36.372261+0000","last_undegraded":"2024-04-25T09:12:36.372261+0000","last_fullsized":"2024-04-25T09:12:36.372261+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:17.490405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097632+0000","last_change":"2024-04-25T09:12:35.116889+0000","last_active":"2024-04-25T09:12:36.097632+0000","last_peered":"2024-04-25T09:12:36.097632+0000","last_clean":"2024-04-25T09:12:36.097632+0000","last_became_active":"2024-04-25T09:12:35.116633+0000","last_became_peered":"2024-04-25T09:12:35.116633+0000","last_unstale":"2024-04-25T09:12:36.097632+0000","last_undegraded":"2024-04-25T09:12:36.097632+0000","last_fullsized":"2024-04-25T09:12:36.097632+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:04.492092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371747+0000","last_change":"2024-04-25T09:12:34.112627+0000","last_active":"2024-04-25T09:12:36.371747+0000","last_peered":"2024-04-25T09:12:36.371747+0000","last_clean":"2024-04-25T09:12:36.371747+0000","last_became_active":"2024-04-25T09:12:34.112324+0000","last_became_peered":"2024-04-25T09:12:34.112324+0000","last_unstale":"2024-04-25T09:12:36.371747+0000","last_undegraded":"2024-04-25T09:12:36.371747+0000","last_fullsized":"2024-04-25T09:12:36.371747+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:39.328452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090857+0000","last_change":"2024-04-25T09:12:33.090857+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090857+0000","last_undegraded":"2024-04-25T09:12:33.090857+0000","last_fullsized":"2024-04-25T09:12:33.090857+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.089714+0000","last_change":"2024-04-25T09:12:33.089714+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.089714+0000","last_undegraded":"2024-04-25T09:12:33.089714+0000","last_fullsized":"2024-04-25T09:12:33.089714+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.165483+0000","last_change":"2024-04-25T09:12:33.165483+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.165483+0000","last_undegraded":"2024-04-25T09:12:33.165483+0000","last_fullsized":"2024-04-25T09:12:33.165483+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371889+0000","last_change":"2024-04-25T09:12:35.128824+0000","last_active":"2024-04-25T09:12:36.371889+0000","last_peered":"2024-04-25T09:12:36.371889+0000","last_clean":"2024-04-25T09:12:36.371889+0000","last_became_active":"2024-04-25T09:12:35.128530+0000","last_became_peered":"2024-04-25T09:12:35.128530+0000","last_unstale":"2024-04-25T09:12:36.371889+0000","last_undegraded":"2024-04-25T09:12:36.371889+0000","last_fullsized":"2024-04-25T09:12:36.371889+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:26.609412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085149+0000","last_change":"2024-04-25T09:12:33.085149+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085149+0000","last_undegraded":"2024-04-25T09:12:33.085149+0000","last_fullsized":"2024-04-25T09:12:33.085149+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096961+0000","last_change":"2024-04-25T09:12:35.115352+0000","last_active":"2024-04-25T09:12:36.096961+0000","last_peered":"2024-04-25T09:12:36.096961+0000","last_clean":"2024-04-25T09:12:36.096961+0000","last_became_active":"2024-04-25T09:12:35.115090+0000","last_became_peered":"2024-04-25T09:12:35.115090+0000","last_unstale":"2024-04-25T09:12:36.096961+0000","last_undegraded":"2024-04-25T09:12:36.096961+0000","last_fullsized":"2024-04-25T09:12:36.096961+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:03.804395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085671+0000","last_change":"2024-04-25T09:12:33.085671+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085671+0000","last_undegraded":"2024-04-25T09:12:33.085671+0000","last_fullsized":"2024-04-25T09:12:33.085671+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097883+0000","last_change":"2024-04-25T09:12:34.116925+0000","last_active":"2024-04-25T09:12:36.097883+0000","last_peered":"2024-04-25T09:12:36.097883+0000","last_clean":"2024-04-25T09:12:36.097883+0000","last_became_active":"2024-04-25T09:12:34.116013+0000","last_became_peered":"2024-04-25T09:12:34.116013+0000","last_unstale":"2024-04-25T09:12:36.097883+0000","last_undegraded":"2024-04-25T09:12:36.097883+0000","last_fullsized":"2024-04-25T09:12:36.097883+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:49.636624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"132'3","reported_seq":17,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372141+0000","last_change":"2024-04-25T09:12:34.111922+0000","last_active":"2024-04-25T09:12:36.372141+0000","last_peered":"2024-04-25T09:12:36.372141+0000","last_clean":"2024-04-25T09:12:36.372141+0000","last_became_active":"2024-04-25T09:12:34.111591+0000","last_became_peered":"2024-04-25T09:12:34.111591+0000","last_unstale":"2024-04-25T09:12:36.372141+0000","last_undegraded":"2024-04-25T09:12:36.372141+0000","last_fullsized":"2024-04-25T09:12:36.372141+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:49.439435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"132'6","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372376+0000","last_change":"2024-04-25T09:12:34.114195+0000","last_active":"2024-04-25T09:12:36.372376+0000","last_peered":"2024-04-25T09:12:36.372376+0000","last_clean":"2024-04-25T09:12:36.372376+0000","last_became_active":"2024-04-25T09:12:34.113862+0000","last_became_peered":"2024-04-25T09:12:34.113862+0000","last_unstale":"2024-04-25T09:12:36.372376+0000","last_undegraded":"2024-04-25T09:12:36.372376+0000","last_fullsized":"2024-04-25T09:12:36.372376+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:00.424853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097525+0000","last_change":"2024-04-25T09:12:34.115786+0000","last_active":"2024-04-25T09:12:36.097525+0000","last_peered":"2024-04-25T09:12:36.097525+0000","last_clean":"2024-04-25T09:12:36.097525+0000","last_became_active":"2024-04-25T09:12:34.115524+0000","last_became_peered":"2024-04-25T09:12:34.115524+0000","last_unstale":"2024-04-25T09:12:36.097525+0000","last_undegraded":"2024-04-25T09:12:36.097525+0000","last_fullsized":"2024-04-25T09:12:36.097525+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:39.699444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372510+0000","last_change":"2024-04-25T09:12:35.131021+0000","last_active":"2024-04-25T09:12:36.372510+0000","last_peered":"2024-04-25T09:12:36.372510+0000","last_clean":"2024-04-25T09:12:36.372510+0000","last_became_active":"2024-04-25T09:12:35.130750+0000","last_became_peered":"2024-04-25T09:12:35.130750+0000","last_unstale":"2024-04-25T09:12:36.372510+0000","last_undegraded":"2024-04-25T09:12:36.372510+0000","last_fullsized":"2024-04-25T09:12:36.372510+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:37.039253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085160+0000","last_change":"2024-04-25T09:12:33.085160+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085160+0000","last_undegraded":"2024-04-25T09:12:33.085160+0000","last_fullsized":"2024-04-25T09:12:33.085160+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.165346+0000","last_change":"2024-04-25T09:12:33.165346+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.165346+0000","last_undegraded":"2024-04-25T09:12:33.165346+0000","last_fullsized":"2024-04-25T09:12:33.165346+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085076+0000","last_change":"2024-04-25T09:12:33.085076+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085076+0000","last_undegraded":"2024-04-25T09:12:33.085076+0000","last_fullsized":"2024-04-25T09:12:33.085076+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371368+0000","last_change":"2024-04-25T09:12:35.125572+0000","last_active":"2024-04-25T09:12:36.371368+0000","last_peered":"2024-04-25T09:12:36.371368+0000","last_clean":"2024-04-25T09:12:36.371368+0000","last_became_active":"2024-04-25T09:12:35.125300+0000","last_became_peered":"2024-04-25T09:12:35.125300+0000","last_unstale":"2024-04-25T09:12:36.371368+0000","last_undegraded":"2024-04-25T09:12:36.371368+0000","last_fullsized":"2024-04-25T09:12:36.371368+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:05.811985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085168+0000","last_change":"2024-04-25T09:12:33.085168+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085168+0000","last_undegraded":"2024-04-25T09:12:33.085168+0000","last_fullsized":"2024-04-25T09:12:33.085168+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371601+0000","last_change":"2024-04-25T09:12:35.125851+0000","last_active":"2024-04-25T09:12:36.371601+0000","last_peered":"2024-04-25T09:12:36.371601+0000","last_clean":"2024-04-25T09:12:36.371601+0000","last_became_active":"2024-04-25T09:12:35.125343+0000","last_became_peered":"2024-04-25T09:12:35.125343+0000","last_unstale":"2024-04-25T09:12:36.371601+0000","last_undegraded":"2024-04-25T09:12:36.371601+0000","last_fullsized":"2024-04-25T09:12:36.371601+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:00.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.164941+0000","last_change":"2024-04-25T09:12:33.164941+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.164941+0000","last_undegraded":"2024-04-25T09:12:33.164941+0000","last_fullsized":"2024-04-25T09:12:33.164941+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.088951+0000","last_change":"2024-04-25T09:12:33.088951+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.088951+0000","last_undegraded":"2024-04-25T09:12:33.088951+0000","last_fullsized":"2024-04-25T09:12:33.088951+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090361+0000","last_change":"2024-04-25T09:12:33.090361+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090361+0000","last_undegraded":"2024-04-25T09:12:33.090361+0000","last_fullsized":"2024-04-25T09:12:33.090361+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097836+0000","last_change":"2024-04-25T09:12:35.125513+0000","last_active":"2024-04-25T09:12:36.097836+0000","last_peered":"2024-04-25T09:12:36.097836+0000","last_clean":"2024-04-25T09:12:36.097836+0000","last_became_active":"2024-04-25T09:12:35.125238+0000","last_became_peered":"2024-04-25T09:12:35.125238+0000","last_unstale":"2024-04-25T09:12:36.097836+0000","last_undegraded":"2024-04-25T09:12:36.097836+0000","last_fullsized":"2024-04-25T09:12:36.097836+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:18.547869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097596+0000","last_change":"2024-04-25T09:12:34.105311+0000","last_active":"2024-04-25T09:12:36.097596+0000","last_peered":"2024-04-25T09:12:36.097596+0000","last_clean":"2024-04-25T09:12:36.097596+0000","last_became_active":"2024-04-25T09:12:34.105070+0000","last_became_peered":"2024-04-25T09:12:34.105070+0000","last_unstale":"2024-04-25T09:12:36.097596+0000","last_undegraded":"2024-04-25T09:12:36.097596+0000","last_fullsized":"2024-04-25T09:12:36.097596+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:38.389565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371839+0000","last_change":"2024-04-25T09:12:34.114130+0000","last_active":"2024-04-25T09:12:36.371839+0000","last_peered":"2024-04-25T09:12:36.371839+0000","last_clean":"2024-04-25T09:12:36.371839+0000","last_became_active":"2024-04-25T09:12:34.113813+0000","last_became_peered":"2024-04-25T09:12:34.113813+0000","last_unstale":"2024-04-25T09:12:36.371839+0000","last_undegraded":"2024-04-25T09:12:36.371839+0000","last_fullsized":"2024-04-25T09:12:36.371839+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:19.761568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.164934+0000","last_change":"2024-04-25T09:12:33.164934+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.164934+0000","last_undegraded":"2024-04-25T09:12:33.164934+0000","last_fullsized":"2024-04-25T09:12:33.164934+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097979+0000","last_change":"2024-04-25T09:12:34.110412+0000","last_active":"2024-04-25T09:12:36.097979+0000","last_peered":"2024-04-25T09:12:36.097979+0000","last_clean":"2024-04-25T09:12:36.097979+0000","last_became_active":"2024-04-25T09:12:34.110163+0000","last_became_peered":"2024-04-25T09:12:34.110163+0000","last_unstale":"2024-04-25T09:12:36.097979+0000","last_undegraded":"2024-04-25T09:12:36.097979+0000","last_fullsized":"2024-04-25T09:12:36.097979+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:34.085553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090423+0000","last_change":"2024-04-25T09:12:33.090423+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090423+0000","last_undegraded":"2024-04-25T09:12:33.090423+0000","last_fullsized":"2024-04-25T09:12:33.090423+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371411+0000","last_change":"2024-04-25T09:12:35.130641+0000","last_active":"2024-04-25T09:12:36.371411+0000","last_peered":"2024-04-25T09:12:36.371411+0000","last_clean":"2024-04-25T09:12:36.371411+0000","last_became_active":"2024-04-25T09:12:35.130358+0000","last_became_peered":"2024-04-25T09:12:35.130358+0000","last_unstale":"2024-04-25T09:12:36.371411+0000","last_undegraded":"2024-04-25T09:12:36.371411+0000","last_fullsized":"2024-04-25T09:12:36.371411+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:23.637033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.090373+0000","last_change":"2024-04-25T09:12:33.090373+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.090373+0000","last_undegraded":"2024-04-25T09:12:33.090373+0000","last_fullsized":"2024-04-25T09:12:33.090373+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.164927+0000","last_change":"2024-04-25T09:12:33.164927+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.164927+0000","last_undegraded":"2024-04-25T09:12:33.164927+0000","last_fullsized":"2024-04-25T09:12:33.164927+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.085076+0000","last_change":"2024-04-25T09:12:33.085076+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.085076+0000","last_undegraded":"2024-04-25T09:12:33.085076+0000","last_fullsized":"2024-04-25T09:12:33.085076+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371652+0000","last_change":"2024-04-25T09:12:34.111472+0000","last_active":"2024-04-25T09:12:36.371652+0000","last_peered":"2024-04-25T09:12:36.371652+0000","last_clean":"2024-04-25T09:12:36.371652+0000","last_became_active":"2024-04-25T09:12:34.111180+0000","last_became_peered":"2024-04-25T09:12:34.111180+0000","last_unstale":"2024-04-25T09:12:36.371652+0000","last_undegraded":"2024-04-25T09:12:36.371652+0000","last_fullsized":"2024-04-25T09:12:36.371652+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:55.097890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.164849+0000","last_change":"2024-04-25T09:12:33.164849+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.164849+0000","last_undegraded":"2024-04-25T09:12:33.164849+0000","last_fullsized":"2024-04-25T09:12:33.164849+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372398+0000","last_change":"2024-04-25T09:12:35.132520+0000","last_active":"2024-04-25T09:12:36.372398+0000","last_peered":"2024-04-25T09:12:36.372398+0000","last_clean":"2024-04-25T09:12:36.372398+0000","last_became_active":"2024-04-25T09:12:35.132241+0000","last_became_peered":"2024-04-25T09:12:35.132241+0000","last_unstale":"2024-04-25T09:12:36.372398+0000","last_undegraded":"2024-04-25T09:12:36.372398+0000","last_fullsized":"2024-04-25T09:12:36.372398+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:16.640588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":130,"state":"creating+peering","last_fresh":"2024-04-25T09:12:33.089039+0000","last_change":"2024-04-25T09:12:33.089039+0000","last_active":"2024-04-25T09:12:33.076368+0000","last_peered":"2024-04-25T09:12:33.076368+0000","last_clean":"2024-04-25T09:12:33.076368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:33.089039+0000","last_undegraded":"2024-04-25T09:12:33.089039+0000","last_fullsized":"2024-04-25T09:12:33.089039+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:12:34.083304+0000","last_change":"2024-04-25T09:12:34.083304+0000","last_active":"2024-04-25T09:12:34.083304+0000","last_peered":"2024-04-25T09:12:34.083304+0000","last_clean":"2024-04-25T09:12:34.083304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:12:34.083304+0000","last_undegraded":"2024-04-25T09:12:34.083304+0000","last_fullsized":"2024-04-25T09:12:34.083304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371515+0000","last_change":"2024-04-25T09:12:34.114900+0000","last_active":"2024-04-25T09:12:36.371515+0000","last_peered":"2024-04-25T09:12:36.371515+0000","last_clean":"2024-04-25T09:12:36.371515+0000","last_became_active":"2024-04-25T09:12:34.114551+0000","last_became_peered":"2024-04-25T09:12:34.114551+0000","last_unstale":"2024-04-25T09:12:36.371515+0000","last_undegraded":"2024-04-25T09:12:36.371515+0000","last_fullsized":"2024-04-25T09:12:36.371515+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:17.056789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":376,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371118+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:12:36.371118+0000","last_peered":"2024-04-25T09:12:36.371118+0000","last_clean":"2024-04-25T09:12:36.371118+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:12:36.371118+0000","last_undegraded":"2024-04-25T09:12:36.371118+0000","last_fullsized":"2024-04-25T09:12:36.371118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":1736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509562,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54976,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316864,"statfs":{"total":96636764160,"available":96580468736,"internally_reserved":0,"allocated":1617920,"data_stored":750230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509562,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50816,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321024,"statfs":{"total":96636764160,"available":96584728576,"internally_reserved":0,"allocated":1617920,"data_stored":750230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509563,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59124,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312716,"statfs":{"total":96636764160,"available":96576221184,"internally_reserved":0,"allocated":1605632,"data_stored":744021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59128,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312712,"statfs":{"total":96636764160,"available":96576217088,"internally_reserved":0,"allocated":1617920,"data_stored":750230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509563,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55016,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316824,"statfs":{"total":96636764160,"available":96580427776,"internally_reserved":0,"allocated":1662976,"data_stored":771364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509563,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50804,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321036,"statfs":{"total":96636764160,"available":96584740864,"internally_reserved":0,"allocated":1605632,"data_stored":744021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509563,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55552,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316288,"statfs":{"total":96636764160,"available":96579878912,"internally_reserved":0,"allocated":2211840,"data_stored":1340598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574971,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51440,"kb_used_data":2212,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320400,"statfs":{"total":96636764160,"available":96584089600,"internally_reserved":0,"allocated":2265088,"data_stored":1362818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:12:43.679 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:12:43.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.841+0000 7fd344200640 1 Processor -- start 2024-04-25T09:12:43.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.841+0000 7fd344200640 1 -- start start 2024-04-25T09:12:43.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.841+0000 7fd344200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd33c0b3e70 0x7fd33c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:43.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.841+0000 7fd344200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd33c0aefa0 0x7fd33c0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:43.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.841+0000 7fd344200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c0b4790 con 0x7fd33c15edd0 2024-04-25T09:12:43.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.841+0000 7fd344200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33c06dd50 con 0x7fd33c0b3e70 2024-04-25T09:12:43.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.841+0000 7fd344200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c15f320 con 0x7fd33c0aefa0 2024-04-25T09:12:43.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.841+0000 7fd342200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd33c15edd0 0x7fd33c0b2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34250/0 (socket says 172.21.15.173:34250) 2024-04-25T09:12:43.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.841+0000 7fd342200640 1 -- 172.21.15.173:0/3533629178 learned_addr learned my addr 172.21.15.173:0/3533629178 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:43.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd340e00640 1 --2- 172.21.15.173:0/3533629178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd33c0aefa0 0x7fd33c0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:43.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd341800640 1 --2- 172.21.15.173:0/3533629178 >> v2:172.21.15.194:3300/0 conn(0x7fd33c0b3e70 0x7fd33c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:43.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd33be00640 1 -- 172.21.15.173:0/3533629178 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052209028 0 0) 0x7fd33c0b4790 con 0x7fd33c15edd0 2024-04-25T09:12:43.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd33be00640 1 -- 172.21.15.173:0/3533629178 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd324003530 con 0x7fd33c15edd0 2024-04-25T09:12:43.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd33be00640 1 -- 172.21.15.173:0/3533629178 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 76901272 0 0) 0x7fd324003530 con 0x7fd33c15edd0 2024-04-25T09:12:43.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd33be00640 1 -- 172.21.15.173:0/3533629178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd33c0aefa0 msgr2=0x7fd33c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:43.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd33be00640 1 --2- 172.21.15.173:0/3533629178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd33c0aefa0 0x7fd33c0b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:43.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd33be00640 1 -- 172.21.15.173:0/3533629178 >> v2:172.21.15.194:3300/0 conn(0x7fd33c0b3e70 msgr2=0x7fd33c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:43.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd33be00640 1 --2- 172.21.15.173:0/3533629178 >> v2:172.21.15.194:3300/0 conn(0x7fd33c0b3e70 0x7fd33c0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:43.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd33be00640 1 -- 172.21.15.173:0/3533629178 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c06d420 con 0x7fd33c15edd0 2024-04-25T09:12:43.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd33be00640 1 -- 172.21.15.173:0/3533629178 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fd334001a00 con 0x7fd33c15edd0 2024-04-25T09:12:43.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd33be00640 1 -- 172.21.15.173:0/3533629178 >> v1:172.21.15.173:6789/0 conn(0x7fd33c15edd0 legacy=0x7fd33c0b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:43.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd33be00640 1 --2- 172.21.15.173:0/3533629178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3240039c0 0x7fd324003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:43.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd33be00640 1 --2- 172.21.15.173:0/3533629178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd33c0aefa0 0x7fd324004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:43.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd33be00640 1 --2- 172.21.15.173:0/3533629178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd324004d50 0x7fd3240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:43.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd33be00640 1 -- 172.21.15.173:0/3533629178 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c06dd50 con 0x7fd3240039c0 2024-04-25T09:12:43.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd33be00640 1 -- 172.21.15.173:0/3533629178 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c15f320 con 0x7fd324004d50 2024-04-25T09:12:43.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd33be00640 1 -- 172.21.15.173:0/3533629178 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32400b9d0 con 0x7fd33c0aefa0 2024-04-25T09:12:43.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd341800640 1 --2- 172.21.15.173:0/3533629178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3240039c0 0x7fd324003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:43.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd342200640 1 --2- 172.21.15.173:0/3533629178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd324004d50 0x7fd3240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:43.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd340e00640 1 --2- 172.21.15.173:0/3533629178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd33c0aefa0 0x7fd324004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:43.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd341800640 1 -- 172.21.15.173:0/3533629178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd33c0aefa0 msgr2=0x7fd324004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:43.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd341800640 1 --2- 172.21.15.173:0/3533629178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd33c0aefa0 0x7fd324004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:43.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd341800640 1 -- 172.21.15.173:0/3533629178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd324004d50 msgr2=0x7fd3240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:43.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd341800640 1 --2- 172.21.15.173:0/3533629178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd324004d50 0x7fd3240051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:43.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd341800640 1 -- 172.21.15.173:0/3533629178 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd324003530 con 0x7fd3240039c0 2024-04-25T09:12:43.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.845+0000 7fd342200640 1 --2- 172.21.15.173:0/3533629178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd324004d50 0x7fd3240051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:43.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd341800640 1 --2- 172.21.15.173:0/3533629178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3240039c0 0x7fd324003de0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fd330009ae0 tx=0x7fd33001ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4580b08371879e67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:43.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd33be00640 1 -- 172.21.15.173:0/3533629178 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3300b2070 con 0x7fd3240039c0 2024-04-25T09:12:43.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd33be00640 1 -- 172.21.15.173:0/3533629178 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3300a5670 con 0x7fd3240039c0 2024-04-25T09:12:43.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd33be00640 1 -- 172.21.15.173:0/3533629178 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3300096b0 con 0x7fd3240039c0 2024-04-25T09:12:43.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd344200640 1 -- 172.21.15.173:0/3533629178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3240039c0 msgr2=0x7fd324003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:43.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd344200640 1 --2- 172.21.15.173:0/3533629178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3240039c0 0x7fd324003de0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fd330009ae0 tx=0x7fd33001ca80 comp rx=0 tx=0).stop 2024-04-25T09:12:43.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd342200640 1 -- 172.21.15.173:0/3533629178 reap_dead start 2024-04-25T09:12:43.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd344200640 1 -- 172.21.15.173:0/3533629178 shutdown_connections 2024-04-25T09:12:43.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd344200640 1 -- 172.21.15.173:0/3533629178 >> 172.21.15.173:0/3533629178 conn(0x7fd33c06ac90 msgr2=0x7fd33c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:43.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd344200640 1 -- 172.21.15.173:0/3533629178 shutdown_connections 2024-04-25T09:12:43.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd344200640 1 -- 172.21.15.173:0/3533629178 wait complete. 2024-04-25T09:12:43.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd344200640 1 Processor -- start 2024-04-25T09:12:43.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd344200640 1 -- start start 2024-04-25T09:12:43.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd344200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3240039c0 0x7fd33c147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:43.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd344200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd33c1533d0 0x7fd33c153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:43.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd344200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd33c151f30 0x7fd33c1523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:43.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd344200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c06e1c0 con 0x7fd3240039c0 2024-04-25T09:12:43.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd344200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c15aba0 con 0x7fd33c151f30 2024-04-25T09:12:43.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.849+0000 7fd344200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c06e340 con 0x7fd33c1533d0 2024-04-25T09:12:43.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd341800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3240039c0 0x7fd33c147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:43.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd341800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3240039c0 0x7fd33c147570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51058/0 (socket says 172.21.15.173:51058) 2024-04-25T09:12:43.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd341800640 1 -- 172.21.15.173:0/2633632255 learned_addr learned my addr 172.21.15.173:0/2633632255 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:43.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd340e00640 1 --2- 172.21.15.173:0/2633632255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd33c1533d0 0x7fd33c153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:43.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd342200640 1 --2- 172.21.15.173:0/2633632255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd33c151f30 0x7fd33c1523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:43.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd341800640 1 -- 172.21.15.173:0/2633632255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd33c1533d0 msgr2=0x7fd33c153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:43.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd341800640 1 --2- 172.21.15.173:0/2633632255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd33c1533d0 0x7fd33c153850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:43.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd341800640 1 -- 172.21.15.173:0/2633632255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd33c151f30 msgr2=0x7fd33c1523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:43.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd341800640 1 --2- 172.21.15.173:0/2633632255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd33c151f30 0x7fd33c1523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:43.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd341800640 1 -- 172.21.15.173:0/2633632255 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c147ab0 con 0x7fd3240039c0 2024-04-25T09:12:43.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd340e00640 1 --2- 172.21.15.173:0/2633632255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd33c1533d0 0x7fd33c153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:43.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd341800640 1 --2- 172.21.15.173:0/2633632255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3240039c0 0x7fd33c147570 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fd33001c8b0 tx=0x7fd324005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:43.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd339600640 1 -- 172.21.15.173:0/2633632255 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3300bc020 con 0x7fd3240039c0 2024-04-25T09:12:43.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd339600640 1 -- 172.21.15.173:0/2633632255 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3300a5e20 con 0x7fd3240039c0 2024-04-25T09:12:43.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd339600640 1 -- 172.21.15.173:0/2633632255 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3300b2040 con 0x7fd3240039c0 2024-04-25T09:12:43.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd344200640 1 -- 172.21.15.173:0/2633632255 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33c152ca0 con 0x7fd3240039c0 2024-04-25T09:12:43.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd344200640 1 -- 172.21.15.173:0/2633632255 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33c15f6b0 con 0x7fd3240039c0 2024-04-25T09:12:43.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd344200640 1 -- 172.21.15.173:0/2633632255 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33c073a40 con 0x7fd3240039c0 2024-04-25T09:12:43.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd339600640 1 -- 172.21.15.173:0/2633632255 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd330004260 con 0x7fd3240039c0 2024-04-25T09:12:43.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd339600640 1 --2- 172.21.15.173:0/2633632255 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd31c066f30 0x7fd31c0693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:43.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.853+0000 7fd339600640 1 -- 172.21.15.173:0/2633632255 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd33011f3d0 con 0x7fd3240039c0 2024-04-25T09:12:43.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.857+0000 7fd340e00640 1 --2- 172.21.15.173:0/2633632255 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd31c066f30 0x7fd31c0693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:43.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.857+0000 7fd340e00640 1 --2- 172.21.15.173:0/2633632255 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd31c066f30 0x7fd31c0693f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd33c159900 tx=0x7fd328008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:43.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:43.861+0000 7fd339600640 1 -- 172.21.15.173:0/2633632255 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd3300c6020 con 0x7fd3240039c0 2024-04-25T09:12:43.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.013+0000 7fd344200640 1 -- 172.21.15.173:0/2633632255 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd33c06e540 con 0x7fd31c066f30 2024-04-25T09:12:44.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.017+0000 7fd339600640 1 -- 172.21.15.173:0/2633632255 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252473 (secure 0 0 0) 0x7fd33c06e540 con 0x7fd31c066f30 2024-04-25T09:12:44.006 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:44.007 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:12:44.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.021+0000 7fd344200640 1 -- 172.21.15.173:0/2633632255 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd31c066f30 msgr2=0x7fd31c0693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:44.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.021+0000 7fd344200640 1 --2- 172.21.15.173:0/2633632255 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd31c066f30 0x7fd31c0693f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd33c159900 tx=0x7fd328008040 comp rx=0 tx=0).stop 2024-04-25T09:12:44.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.021+0000 7fd344200640 1 -- 172.21.15.173:0/2633632255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3240039c0 msgr2=0x7fd33c147570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:44.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.021+0000 7fd344200640 1 --2- 172.21.15.173:0/2633632255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3240039c0 0x7fd33c147570 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fd33001c8b0 tx=0x7fd324005840 comp rx=0 tx=0).stop 2024-04-25T09:12:44.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.021+0000 7fd344200640 1 -- 172.21.15.173:0/2633632255 shutdown_connections 2024-04-25T09:12:44.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.021+0000 7fd344200640 1 --2- 172.21.15.173:0/2633632255 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd31c066f30 0x7fd31c0693f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.021+0000 7fd344200640 1 --2- 172.21.15.173:0/2633632255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd33c151f30 0x7fd33c1523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.021+0000 7fd344200640 1 --2- 172.21.15.173:0/2633632255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd33c1533d0 0x7fd33c153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.021+0000 7fd344200640 1 --2- 172.21.15.173:0/2633632255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3240039c0 0x7fd33c147570 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.021+0000 7fd344200640 1 -- 172.21.15.173:0/2633632255 >> 172.21.15.173:0/2633632255 conn(0x7fd33c06ac90 msgr2=0x7fd33c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:44.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.021+0000 7fd344200640 1 -- 172.21.15.173:0/2633632255 shutdown_connections 2024-04-25T09:12:44.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.021+0000 7fd344200640 1 -- 172.21.15.173:0/2633632255 wait complete. 2024-04-25T09:12:44.026 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2024-04-25T09:12:42.858186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":437128,"kb_used_data":14152,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754537592,"statfs":{"total":773094113280,"available":772646494208,"internally_reserved":0,"allocated":14491648,"data_stored":7351540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":432983600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001894"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097934+0000","last_change":"2024-04-25T09:12:35.114369+0000","last_active":"2024-04-25T09:12:36.097934+0000","last_peered":"2024-04-25T09:12:36.097934+0000","last_clean":"2024-04-25T09:12:36.097934+0000","last_became_active":"2024-04-25T09:12:35.113316+0000","last_became_peered":"2024-04-25T09:12:35.113316+0000","last_unstale":"2024-04-25T09:12:36.097934+0000","last_undegraded":"2024-04-25T09:12:36.097934+0000","last_fullsized":"2024-04-25T09:12:36.097934+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:45.449663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.123390+0000","last_change":"2024-04-25T09:12:35.115608+0000","last_active":"2024-04-25T09:12:36.123390+0000","last_peered":"2024-04-25T09:12:36.123390+0000","last_clean":"2024-04-25T09:12:36.123390+0000","last_became_active":"2024-04-25T09:12:35.114509+0000","last_became_peered":"2024-04-25T09:12:35.114509+0000","last_unstale":"2024-04-25T09:12:36.123390+0000","last_undegraded":"2024-04-25T09:12:36.123390+0000","last_fullsized":"2024-04-25T09:12:36.123390+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:34.474444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372056+0000","last_change":"2024-04-25T09:12:35.115889+0000","last_active":"2024-04-25T09:12:36.372056+0000","last_peered":"2024-04-25T09:12:36.372056+0000","last_clean":"2024-04-25T09:12:36.372056+0000","last_became_active":"2024-04-25T09:12:35.115557+0000","last_became_peered":"2024-04-25T09:12:35.115557+0000","last_unstale":"2024-04-25T09:12:36.372056+0000","last_undegraded":"2024-04-25T09:12:36.372056+0000","last_fullsized":"2024-04-25T09:12:36.372056+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:28.182317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.123442+0000","last_change":"2024-04-25T09:12:35.107365+0000","last_active":"2024-04-25T09:12:36.123442+0000","last_peered":"2024-04-25T09:12:36.123442+0000","last_clean":"2024-04-25T09:12:36.123442+0000","last_became_active":"2024-04-25T09:12:35.107103+0000","last_became_peered":"2024-04-25T09:12:35.107103+0000","last_unstale":"2024-04-25T09:12:36.123442+0000","last_undegraded":"2024-04-25T09:12:36.123442+0000","last_fullsized":"2024-04-25T09:12:36.123442+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:15.342033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371562+0000","last_change":"2024-04-25T09:12:35.104602+0000","last_active":"2024-04-25T09:12:36.371562+0000","last_peered":"2024-04-25T09:12:36.371562+0000","last_clean":"2024-04-25T09:12:36.371562+0000","last_became_active":"2024-04-25T09:12:35.104347+0000","last_became_peered":"2024-04-25T09:12:35.104347+0000","last_unstale":"2024-04-25T09:12:36.371562+0000","last_undegraded":"2024-04-25T09:12:36.371562+0000","last_fullsized":"2024-04-25T09:12:36.371562+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:00.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096608+0000","last_change":"2024-04-25T09:12:35.123984+0000","last_active":"2024-04-25T09:12:36.096608+0000","last_peered":"2024-04-25T09:12:36.096608+0000","last_clean":"2024-04-25T09:12:36.096608+0000","last_became_active":"2024-04-25T09:12:35.121878+0000","last_became_peered":"2024-04-25T09:12:35.121878+0000","last_unstale":"2024-04-25T09:12:36.096608+0000","last_undegraded":"2024-04-25T09:12:36.096608+0000","last_fullsized":"2024-04-25T09:12:36.096608+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:27.155845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372005+0000","last_change":"2024-04-25T09:12:35.128837+0000","last_active":"2024-04-25T09:12:36.372005+0000","last_peered":"2024-04-25T09:12:36.372005+0000","last_clean":"2024-04-25T09:12:36.372005+0000","last_became_active":"2024-04-25T09:12:35.128494+0000","last_became_peered":"2024-04-25T09:12:35.128494+0000","last_unstale":"2024-04-25T09:12:36.372005+0000","last_undegraded":"2024-04-25T09:12:36.372005+0000","last_fullsized":"2024-04-25T09:12:36.372005+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:15.711993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.095977+0000","last_change":"2024-04-25T09:12:35.108448+0000","last_active":"2024-04-25T09:12:36.095977+0000","last_peered":"2024-04-25T09:12:36.095977+0000","last_clean":"2024-04-25T09:12:36.095977+0000","last_became_active":"2024-04-25T09:12:35.103394+0000","last_became_peered":"2024-04-25T09:12:35.103394+0000","last_unstale":"2024-04-25T09:12:36.095977+0000","last_undegraded":"2024-04-25T09:12:36.095977+0000","last_fullsized":"2024-04-25T09:12:36.095977+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:14.691356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097070+0000","last_change":"2024-04-25T09:12:35.110499+0000","last_active":"2024-04-25T09:12:36.097070+0000","last_peered":"2024-04-25T09:12:36.097070+0000","last_clean":"2024-04-25T09:12:36.097070+0000","last_became_active":"2024-04-25T09:12:35.110187+0000","last_became_peered":"2024-04-25T09:12:35.110187+0000","last_unstale":"2024-04-25T09:12:36.097070+0000","last_undegraded":"2024-04-25T09:12:36.097070+0000","last_fullsized":"2024-04-25T09:12:36.097070+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:56.403813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371917+0000","last_change":"2024-04-25T09:12:35.102259+0000","last_active":"2024-04-25T09:12:36.371917+0000","last_peered":"2024-04-25T09:12:36.371917+0000","last_clean":"2024-04-25T09:12:36.371917+0000","last_became_active":"2024-04-25T09:12:35.101974+0000","last_became_peered":"2024-04-25T09:12:35.101974+0000","last_unstale":"2024-04-25T09:12:36.371917+0000","last_undegraded":"2024-04-25T09:12:36.371917+0000","last_fullsized":"2024-04-25T09:12:36.371917+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:45.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.123501+0000","last_change":"2024-04-25T09:12:35.116424+0000","last_active":"2024-04-25T09:12:36.123501+0000","last_peered":"2024-04-25T09:12:36.123501+0000","last_clean":"2024-04-25T09:12:36.123501+0000","last_became_active":"2024-04-25T09:12:35.116118+0000","last_became_peered":"2024-04-25T09:12:35.116118+0000","last_unstale":"2024-04-25T09:12:36.123501+0000","last_undegraded":"2024-04-25T09:12:36.123501+0000","last_fullsized":"2024-04-25T09:12:36.123501+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:09.755019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097917+0000","last_change":"2024-04-25T09:12:35.109962+0000","last_active":"2024-04-25T09:12:36.097917+0000","last_peered":"2024-04-25T09:12:36.097917+0000","last_clean":"2024-04-25T09:12:36.097917+0000","last_became_active":"2024-04-25T09:12:35.109686+0000","last_became_peered":"2024-04-25T09:12:35.109686+0000","last_unstale":"2024-04-25T09:12:36.097917+0000","last_undegraded":"2024-04-25T09:12:36.097917+0000","last_fullsized":"2024-04-25T09:12:36.097917+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:33.266966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096709+0000","last_change":"2024-04-25T09:12:35.127661+0000","last_active":"2024-04-25T09:12:36.096709+0000","last_peered":"2024-04-25T09:12:36.096709+0000","last_clean":"2024-04-25T09:12:36.096709+0000","last_became_active":"2024-04-25T09:12:35.127316+0000","last_became_peered":"2024-04-25T09:12:35.127316+0000","last_unstale":"2024-04-25T09:12:36.096709+0000","last_undegraded":"2024-04-25T09:12:36.096709+0000","last_fullsized":"2024-04-25T09:12:36.096709+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:12.245061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097549+0000","last_change":"2024-04-25T09:12:35.125641+0000","last_active":"2024-04-25T09:12:36.097549+0000","last_peered":"2024-04-25T09:12:36.097549+0000","last_clean":"2024-04-25T09:12:36.097549+0000","last_became_active":"2024-04-25T09:12:35.125341+0000","last_became_peered":"2024-04-25T09:12:35.125341+0000","last_unstale":"2024-04-25T09:12:36.097549+0000","last_undegraded":"2024-04-25T09:12:36.097549+0000","last_fullsized":"2024-04-25T09:12:36.097549+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:49.194891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096964+0000","last_change":"2024-04-25T09:12:35.116739+0000","last_active":"2024-04-25T09:12:36.096964+0000","last_peered":"2024-04-25T09:12:36.096964+0000","last_clean":"2024-04-25T09:12:36.096964+0000","last_became_active":"2024-04-25T09:12:35.116447+0000","last_became_peered":"2024-04-25T09:12:35.116447+0000","last_unstale":"2024-04-25T09:12:36.096964+0000","last_undegraded":"2024-04-25T09:12:36.096964+0000","last_fullsized":"2024-04-25T09:12:36.096964+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:38.388538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096221+0000","last_change":"2024-04-25T09:12:35.102753+0000","last_active":"2024-04-25T09:12:36.096221+0000","last_peered":"2024-04-25T09:12:36.096221+0000","last_clean":"2024-04-25T09:12:36.096221+0000","last_became_active":"2024-04-25T09:12:35.102452+0000","last_became_peered":"2024-04-25T09:12:35.102452+0000","last_unstale":"2024-04-25T09:12:36.096221+0000","last_undegraded":"2024-04-25T09:12:36.096221+0000","last_fullsized":"2024-04-25T09:12:36.096221+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:15.789486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097207+0000","last_change":"2024-04-25T09:12:35.110201+0000","last_active":"2024-04-25T09:12:36.097207+0000","last_peered":"2024-04-25T09:12:36.097207+0000","last_clean":"2024-04-25T09:12:36.097207+0000","last_became_active":"2024-04-25T09:12:35.108974+0000","last_became_peered":"2024-04-25T09:12:35.108974+0000","last_unstale":"2024-04-25T09:12:36.097207+0000","last_undegraded":"2024-04-25T09:12:36.097207+0000","last_fullsized":"2024-04-25T09:12:36.097207+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:18.063726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371676+0000","last_change":"2024-04-25T09:12:35.105920+0000","last_active":"2024-04-25T09:12:36.371676+0000","last_peered":"2024-04-25T09:12:36.371676+0000","last_clean":"2024-04-25T09:12:36.371676+0000","last_became_active":"2024-04-25T09:12:35.105188+0000","last_became_peered":"2024-04-25T09:12:35.105188+0000","last_unstale":"2024-04-25T09:12:36.371676+0000","last_undegraded":"2024-04-25T09:12:36.371676+0000","last_fullsized":"2024-04-25T09:12:36.371676+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:15.711993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371875+0000","last_change":"2024-04-25T09:12:35.127360+0000","last_active":"2024-04-25T09:12:36.371875+0000","last_peered":"2024-04-25T09:12:36.371875+0000","last_clean":"2024-04-25T09:12:36.371875+0000","last_became_active":"2024-04-25T09:12:35.127080+0000","last_became_peered":"2024-04-25T09:12:35.127080+0000","last_unstale":"2024-04-25T09:12:36.371875+0000","last_undegraded":"2024-04-25T09:12:36.371875+0000","last_fullsized":"2024-04-25T09:12:36.371875+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:34.934426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371736+0000","last_change":"2024-04-25T09:12:35.121817+0000","last_active":"2024-04-25T09:12:36.371736+0000","last_peered":"2024-04-25T09:12:36.371736+0000","last_clean":"2024-04-25T09:12:36.371736+0000","last_became_active":"2024-04-25T09:12:35.121571+0000","last_became_peered":"2024-04-25T09:12:35.121571+0000","last_unstale":"2024-04-25T09:12:36.371736+0000","last_undegraded":"2024-04-25T09:12:36.371736+0000","last_fullsized":"2024-04-25T09:12:36.371736+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:26.609412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.123251+0000","last_change":"2024-04-25T09:12:35.106993+0000","last_active":"2024-04-25T09:12:36.123251+0000","last_peered":"2024-04-25T09:12:36.123251+0000","last_clean":"2024-04-25T09:12:36.123251+0000","last_became_active":"2024-04-25T09:12:35.106506+0000","last_became_peered":"2024-04-25T09:12:35.106506+0000","last_unstale":"2024-04-25T09:12:36.123251+0000","last_undegraded":"2024-04-25T09:12:36.123251+0000","last_fullsized":"2024-04-25T09:12:36.123251+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:39.376176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097559+0000","last_change":"2024-04-25T09:12:35.109705+0000","last_active":"2024-04-25T09:12:36.097559+0000","last_peered":"2024-04-25T09:12:36.097559+0000","last_clean":"2024-04-25T09:12:36.097559+0000","last_became_active":"2024-04-25T09:12:35.109437+0000","last_became_peered":"2024-04-25T09:12:35.109437+0000","last_unstale":"2024-04-25T09:12:36.097559+0000","last_undegraded":"2024-04-25T09:12:36.097559+0000","last_fullsized":"2024-04-25T09:12:36.097559+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:15.440771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.123152+0000","last_change":"2024-04-25T09:12:35.121733+0000","last_active":"2024-04-25T09:12:36.123152+0000","last_peered":"2024-04-25T09:12:36.123152+0000","last_clean":"2024-04-25T09:12:36.123152+0000","last_became_active":"2024-04-25T09:12:35.121275+0000","last_became_peered":"2024-04-25T09:12:35.121275+0000","last_unstale":"2024-04-25T09:12:36.123152+0000","last_undegraded":"2024-04-25T09:12:36.123152+0000","last_fullsized":"2024-04-25T09:12:36.123152+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:19.124133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096309+0000","last_change":"2024-04-25T09:12:35.106547+0000","last_active":"2024-04-25T09:12:36.096309+0000","last_peered":"2024-04-25T09:12:36.096309+0000","last_clean":"2024-04-25T09:12:36.096309+0000","last_became_active":"2024-04-25T09:12:35.106262+0000","last_became_peered":"2024-04-25T09:12:35.106262+0000","last_unstale":"2024-04-25T09:12:36.096309+0000","last_undegraded":"2024-04-25T09:12:36.096309+0000","last_fullsized":"2024-04-25T09:12:36.096309+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:27:44.513125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372446+0000","last_change":"2024-04-25T09:12:35.119654+0000","last_active":"2024-04-25T09:12:36.372446+0000","last_peered":"2024-04-25T09:12:36.372446+0000","last_clean":"2024-04-25T09:12:36.372446+0000","last_became_active":"2024-04-25T09:12:35.119400+0000","last_became_peered":"2024-04-25T09:12:35.119400+0000","last_unstale":"2024-04-25T09:12:36.372446+0000","last_undegraded":"2024-04-25T09:12:36.372446+0000","last_fullsized":"2024-04-25T09:12:36.372446+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:02.070317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372223+0000","last_change":"2024-04-25T09:12:35.125037+0000","last_active":"2024-04-25T09:12:36.372223+0000","last_peered":"2024-04-25T09:12:36.372223+0000","last_clean":"2024-04-25T09:12:36.372223+0000","last_became_active":"2024-04-25T09:12:35.124676+0000","last_became_peered":"2024-04-25T09:12:35.124676+0000","last_unstale":"2024-04-25T09:12:36.372223+0000","last_undegraded":"2024-04-25T09:12:36.372223+0000","last_fullsized":"2024-04-25T09:12:36.372223+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:11.931848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371926+0000","last_change":"2024-04-25T09:12:35.128555+0000","last_active":"2024-04-25T09:12:36.371926+0000","last_peered":"2024-04-25T09:12:36.371926+0000","last_clean":"2024-04-25T09:12:36.371926+0000","last_became_active":"2024-04-25T09:12:35.127720+0000","last_became_peered":"2024-04-25T09:12:35.127720+0000","last_unstale":"2024-04-25T09:12:36.371926+0000","last_undegraded":"2024-04-25T09:12:36.371926+0000","last_fullsized":"2024-04-25T09:12:36.371926+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:06.969509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371975+0000","last_change":"2024-04-25T09:12:35.101656+0000","last_active":"2024-04-25T09:12:36.371975+0000","last_peered":"2024-04-25T09:12:36.371975+0000","last_clean":"2024-04-25T09:12:36.371975+0000","last_became_active":"2024-04-25T09:12:35.101231+0000","last_became_peered":"2024-04-25T09:12:35.101231+0000","last_unstale":"2024-04-25T09:12:36.371975+0000","last_undegraded":"2024-04-25T09:12:36.371975+0000","last_fullsized":"2024-04-25T09:12:36.371975+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:39.809710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371027+0000","last_change":"2024-04-25T09:12:35.122723+0000","last_active":"2024-04-25T09:12:36.371027+0000","last_peered":"2024-04-25T09:12:36.371027+0000","last_clean":"2024-04-25T09:12:36.371027+0000","last_became_active":"2024-04-25T09:12:35.120678+0000","last_became_peered":"2024-04-25T09:12:35.120678+0000","last_unstale":"2024-04-25T09:12:36.371027+0000","last_undegraded":"2024-04-25T09:12:36.371027+0000","last_fullsized":"2024-04-25T09:12:36.371027+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:05.750891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371005+0000","last_change":"2024-04-25T09:12:35.118579+0000","last_active":"2024-04-25T09:12:36.371005+0000","last_peered":"2024-04-25T09:12:36.371005+0000","last_clean":"2024-04-25T09:12:36.371005+0000","last_became_active":"2024-04-25T09:12:35.118284+0000","last_became_peered":"2024-04-25T09:12:35.118284+0000","last_unstale":"2024-04-25T09:12:36.371005+0000","last_undegraded":"2024-04-25T09:12:36.371005+0000","last_fullsized":"2024-04-25T09:12:36.371005+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:43.102414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.095981+0000","last_change":"2024-04-25T09:12:35.104334+0000","last_active":"2024-04-25T09:12:36.095981+0000","last_peered":"2024-04-25T09:12:36.095981+0000","last_clean":"2024-04-25T09:12:36.095981+0000","last_became_active":"2024-04-25T09:12:35.104058+0000","last_became_peered":"2024-04-25T09:12:35.104058+0000","last_unstale":"2024-04-25T09:12:36.095981+0000","last_undegraded":"2024-04-25T09:12:36.095981+0000","last_fullsized":"2024-04-25T09:12:36.095981+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:19.116175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371355+0000","last_change":"2024-04-25T09:12:35.103379+0000","last_active":"2024-04-25T09:12:36.371355+0000","last_peered":"2024-04-25T09:12:36.371355+0000","last_clean":"2024-04-25T09:12:36.371355+0000","last_became_active":"2024-04-25T09:12:35.102499+0000","last_became_peered":"2024-04-25T09:12:35.102499+0000","last_unstale":"2024-04-25T09:12:36.371355+0000","last_undegraded":"2024-04-25T09:12:36.371355+0000","last_fullsized":"2024-04-25T09:12:36.371355+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:33.557626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.095976+0000","last_change":"2024-04-25T09:12:35.113389+0000","last_active":"2024-04-25T09:12:36.095976+0000","last_peered":"2024-04-25T09:12:36.095976+0000","last_clean":"2024-04-25T09:12:36.095976+0000","last_became_active":"2024-04-25T09:12:35.113100+0000","last_became_peered":"2024-04-25T09:12:35.113100+0000","last_unstale":"2024-04-25T09:12:36.095976+0000","last_undegraded":"2024-04-25T09:12:36.095976+0000","last_fullsized":"2024-04-25T09:12:36.095976+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:16.519503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"132'4","reported_seq":18,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372194+0000","last_change":"2024-04-25T09:12:34.109770+0000","last_active":"2024-04-25T09:12:36.372194+0000","last_peered":"2024-04-25T09:12:36.372194+0000","last_clean":"2024-04-25T09:12:36.372194+0000","last_became_active":"2024-04-25T09:12:34.108816+0000","last_became_peered":"2024-04-25T09:12:34.108816+0000","last_unstale":"2024-04-25T09:12:36.372194+0000","last_undegraded":"2024-04-25T09:12:36.372194+0000","last_fullsized":"2024-04-25T09:12:36.372194+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:38.369239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097381+0000","last_change":"2024-04-25T09:12:35.111869+0000","last_active":"2024-04-25T09:12:36.097381+0000","last_peered":"2024-04-25T09:12:36.097381+0000","last_clean":"2024-04-25T09:12:36.097381+0000","last_became_active":"2024-04-25T09:12:35.111471+0000","last_became_peered":"2024-04-25T09:12:35.111471+0000","last_unstale":"2024-04-25T09:12:36.097381+0000","last_undegraded":"2024-04-25T09:12:36.097381+0000","last_fullsized":"2024-04-25T09:12:36.097381+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:12.635916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"132'1","reported_seq":15,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371757+0000","last_change":"2024-04-25T09:12:34.112255+0000","last_active":"2024-04-25T09:12:36.371757+0000","last_peered":"2024-04-25T09:12:36.371757+0000","last_clean":"2024-04-25T09:12:36.371757+0000","last_became_active":"2024-04-25T09:12:34.111565+0000","last_became_peered":"2024-04-25T09:12:34.111565+0000","last_unstale":"2024-04-25T09:12:36.371757+0000","last_undegraded":"2024-04-25T09:12:36.371757+0000","last_fullsized":"2024-04-25T09:12:36.371757+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:35.677579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.123345+0000","last_change":"2024-04-25T09:12:35.115841+0000","last_active":"2024-04-25T09:12:36.123345+0000","last_peered":"2024-04-25T09:12:36.123345+0000","last_clean":"2024-04-25T09:12:36.123345+0000","last_became_active":"2024-04-25T09:12:35.114663+0000","last_became_peered":"2024-04-25T09:12:35.114663+0000","last_unstale":"2024-04-25T09:12:36.123345+0000","last_undegraded":"2024-04-25T09:12:36.123345+0000","last_fullsized":"2024-04-25T09:12:36.123345+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:59.703539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372261+0000","last_change":"2024-04-25T09:12:34.113365+0000","last_active":"2024-04-25T09:12:36.372261+0000","last_peered":"2024-04-25T09:12:36.372261+0000","last_clean":"2024-04-25T09:12:36.372261+0000","last_became_active":"2024-04-25T09:12:34.113074+0000","last_became_peered":"2024-04-25T09:12:34.113074+0000","last_unstale":"2024-04-25T09:12:36.372261+0000","last_undegraded":"2024-04-25T09:12:36.372261+0000","last_fullsized":"2024-04-25T09:12:36.372261+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:17.490405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097632+0000","last_change":"2024-04-25T09:12:35.116889+0000","last_active":"2024-04-25T09:12:36.097632+0000","last_peered":"2024-04-25T09:12:36.097632+0000","last_clean":"2024-04-25T09:12:36.097632+0000","last_became_active":"2024-04-25T09:12:35.116633+0000","last_became_peered":"2024-04-25T09:12:35.116633+0000","last_unstale":"2024-04-25T09:12:36.097632+0000","last_undegraded":"2024-04-25T09:12:36.097632+0000","last_fullsized":"2024-04-25T09:12:36.097632+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:04.492092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371747+0000","last_change":"2024-04-25T09:12:34.112627+0000","last_active":"2024-04-25T09:12:36.371747+0000","last_peered":"2024-04-25T09:12:36.371747+0000","last_clean":"2024-04-25T09:12:36.371747+0000","last_became_active":"2024-04-25T09:12:34.112324+0000","last_became_peered":"2024-04-25T09:12:34.112324+0000","last_unstale":"2024-04-25T09:12:36.371747+0000","last_undegraded":"2024-04-25T09:12:36.371747+0000","last_fullsized":"2024-04-25T09:12:36.371747+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:39.328452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096281+0000","last_change":"2024-04-25T09:12:35.100931+0000","last_active":"2024-04-25T09:12:36.096281+0000","last_peered":"2024-04-25T09:12:36.096281+0000","last_clean":"2024-04-25T09:12:36.096281+0000","last_became_active":"2024-04-25T09:12:35.100567+0000","last_became_peered":"2024-04-25T09:12:35.100567+0000","last_unstale":"2024-04-25T09:12:36.096281+0000","last_undegraded":"2024-04-25T09:12:36.096281+0000","last_fullsized":"2024-04-25T09:12:36.096281+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:02.950686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"132'1","reported_seq":15,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096567+0000","last_change":"2024-04-25T09:12:34.107115+0000","last_active":"2024-04-25T09:12:36.096567+0000","last_peered":"2024-04-25T09:12:36.096567+0000","last_clean":"2024-04-25T09:12:36.096567+0000","last_became_active":"2024-04-25T09:12:34.106819+0000","last_became_peered":"2024-04-25T09:12:34.106819+0000","last_unstale":"2024-04-25T09:12:36.096567+0000","last_undegraded":"2024-04-25T09:12:36.096567+0000","last_fullsized":"2024-04-25T09:12:36.096567+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:01.789272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096592+0000","last_change":"2024-04-25T09:12:35.103410+0000","last_active":"2024-04-25T09:12:36.096592+0000","last_peered":"2024-04-25T09:12:36.096592+0000","last_clean":"2024-04-25T09:12:36.096592+0000","last_became_active":"2024-04-25T09:12:35.103065+0000","last_became_peered":"2024-04-25T09:12:35.103065+0000","last_unstale":"2024-04-25T09:12:36.096592+0000","last_undegraded":"2024-04-25T09:12:36.096592+0000","last_fullsized":"2024-04-25T09:12:36.096592+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:04.940220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"132'1","reported_seq":15,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371395+0000","last_change":"2024-04-25T09:12:34.102901+0000","last_active":"2024-04-25T09:12:36.371395+0000","last_peered":"2024-04-25T09:12:36.371395+0000","last_clean":"2024-04-25T09:12:36.371395+0000","last_became_active":"2024-04-25T09:12:34.102628+0000","last_became_peered":"2024-04-25T09:12:34.102628+0000","last_unstale":"2024-04-25T09:12:36.371395+0000","last_undegraded":"2024-04-25T09:12:36.371395+0000","last_fullsized":"2024-04-25T09:12:36.371395+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:49.439435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371693+0000","last_change":"2024-04-25T09:12:35.123341+0000","last_active":"2024-04-25T09:12:36.371693+0000","last_peered":"2024-04-25T09:12:36.371693+0000","last_clean":"2024-04-25T09:12:36.371693+0000","last_became_active":"2024-04-25T09:12:35.121875+0000","last_became_peered":"2024-04-25T09:12:35.121875+0000","last_unstale":"2024-04-25T09:12:36.371693+0000","last_undegraded":"2024-04-25T09:12:36.371693+0000","last_fullsized":"2024-04-25T09:12:36.371693+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:34.934426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096237+0000","last_change":"2024-04-25T09:12:34.109089+0000","last_active":"2024-04-25T09:12:36.096237+0000","last_peered":"2024-04-25T09:12:36.096237+0000","last_clean":"2024-04-25T09:12:36.096237+0000","last_became_active":"2024-04-25T09:12:34.107357+0000","last_became_peered":"2024-04-25T09:12:34.107357+0000","last_unstale":"2024-04-25T09:12:36.096237+0000","last_undegraded":"2024-04-25T09:12:36.096237+0000","last_fullsized":"2024-04-25T09:12:36.096237+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:55.468883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371889+0000","last_change":"2024-04-25T09:12:35.128824+0000","last_active":"2024-04-25T09:12:36.371889+0000","last_peered":"2024-04-25T09:12:36.371889+0000","last_clean":"2024-04-25T09:12:36.371889+0000","last_became_active":"2024-04-25T09:12:35.128530+0000","last_became_peered":"2024-04-25T09:12:35.128530+0000","last_unstale":"2024-04-25T09:12:36.371889+0000","last_undegraded":"2024-04-25T09:12:36.371889+0000","last_fullsized":"2024-04-25T09:12:36.371889+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:26.609412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.370988+0000","last_change":"2024-04-25T09:12:34.103226+0000","last_active":"2024-04-25T09:12:36.370988+0000","last_peered":"2024-04-25T09:12:36.370988+0000","last_clean":"2024-04-25T09:12:36.370988+0000","last_became_active":"2024-04-25T09:12:34.102871+0000","last_became_peered":"2024-04-25T09:12:34.102871+0000","last_unstale":"2024-04-25T09:12:36.370988+0000","last_undegraded":"2024-04-25T09:12:36.370988+0000","last_fullsized":"2024-04-25T09:12:36.370988+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:18.117197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096961+0000","last_change":"2024-04-25T09:12:35.115352+0000","last_active":"2024-04-25T09:12:36.096961+0000","last_peered":"2024-04-25T09:12:36.096961+0000","last_clean":"2024-04-25T09:12:36.096961+0000","last_became_active":"2024-04-25T09:12:35.115090+0000","last_became_peered":"2024-04-25T09:12:35.115090+0000","last_unstale":"2024-04-25T09:12:36.096961+0000","last_undegraded":"2024-04-25T09:12:36.096961+0000","last_fullsized":"2024-04-25T09:12:36.096961+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:03.804395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.123396+0000","last_change":"2024-04-25T09:12:34.113734+0000","last_active":"2024-04-25T09:12:36.123396+0000","last_peered":"2024-04-25T09:12:36.123396+0000","last_clean":"2024-04-25T09:12:36.123396+0000","last_became_active":"2024-04-25T09:12:34.113188+0000","last_became_peered":"2024-04-25T09:12:34.113188+0000","last_unstale":"2024-04-25T09:12:36.123396+0000","last_undegraded":"2024-04-25T09:12:36.123396+0000","last_fullsized":"2024-04-25T09:12:36.123396+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:20.069943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096355+0000","last_change":"2024-04-25T09:12:35.101326+0000","last_active":"2024-04-25T09:12:36.096355+0000","last_peered":"2024-04-25T09:12:36.096355+0000","last_clean":"2024-04-25T09:12:36.096355+0000","last_became_active":"2024-04-25T09:12:35.101037+0000","last_became_peered":"2024-04-25T09:12:35.101037+0000","last_unstale":"2024-04-25T09:12:36.096355+0000","last_undegraded":"2024-04-25T09:12:36.096355+0000","last_fullsized":"2024-04-25T09:12:36.096355+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:24.524462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097883+0000","last_change":"2024-04-25T09:12:34.116925+0000","last_active":"2024-04-25T09:12:36.097883+0000","last_peered":"2024-04-25T09:12:36.097883+0000","last_clean":"2024-04-25T09:12:36.097883+0000","last_became_active":"2024-04-25T09:12:34.116013+0000","last_became_peered":"2024-04-25T09:12:34.116013+0000","last_unstale":"2024-04-25T09:12:36.097883+0000","last_undegraded":"2024-04-25T09:12:36.097883+0000","last_fullsized":"2024-04-25T09:12:36.097883+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:49.636624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371019+0000","last_change":"2024-04-25T09:12:35.117633+0000","last_active":"2024-04-25T09:12:36.371019+0000","last_peered":"2024-04-25T09:12:36.371019+0000","last_clean":"2024-04-25T09:12:36.371019+0000","last_became_active":"2024-04-25T09:12:35.117252+0000","last_became_peered":"2024-04-25T09:12:35.117252+0000","last_unstale":"2024-04-25T09:12:36.371019+0000","last_undegraded":"2024-04-25T09:12:36.371019+0000","last_fullsized":"2024-04-25T09:12:36.371019+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:16.897550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"132'3","reported_seq":17,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372141+0000","last_change":"2024-04-25T09:12:34.111922+0000","last_active":"2024-04-25T09:12:36.372141+0000","last_peered":"2024-04-25T09:12:36.372141+0000","last_clean":"2024-04-25T09:12:36.372141+0000","last_became_active":"2024-04-25T09:12:34.111591+0000","last_became_peered":"2024-04-25T09:12:34.111591+0000","last_unstale":"2024-04-25T09:12:36.372141+0000","last_undegraded":"2024-04-25T09:12:36.372141+0000","last_fullsized":"2024-04-25T09:12:36.372141+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:49.439435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371217+0000","last_change":"2024-04-25T09:12:35.122223+0000","last_active":"2024-04-25T09:12:36.371217+0000","last_peered":"2024-04-25T09:12:36.371217+0000","last_clean":"2024-04-25T09:12:36.371217+0000","last_became_active":"2024-04-25T09:12:35.121072+0000","last_became_peered":"2024-04-25T09:12:35.121072+0000","last_unstale":"2024-04-25T09:12:36.371217+0000","last_undegraded":"2024-04-25T09:12:36.371217+0000","last_fullsized":"2024-04-25T09:12:36.371217+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:53.409630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"132'6","reported_seq":20,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372376+0000","last_change":"2024-04-25T09:12:34.114195+0000","last_active":"2024-04-25T09:12:36.372376+0000","last_peered":"2024-04-25T09:12:36.372376+0000","last_clean":"2024-04-25T09:12:36.372376+0000","last_became_active":"2024-04-25T09:12:34.113862+0000","last_became_peered":"2024-04-25T09:12:34.113862+0000","last_unstale":"2024-04-25T09:12:36.372376+0000","last_undegraded":"2024-04-25T09:12:36.372376+0000","last_fullsized":"2024-04-25T09:12:36.372376+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:00.424853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371934+0000","last_change":"2024-04-25T09:12:35.116732+0000","last_active":"2024-04-25T09:12:36.371934+0000","last_peered":"2024-04-25T09:12:36.371934+0000","last_clean":"2024-04-25T09:12:36.371934+0000","last_became_active":"2024-04-25T09:12:35.116308+0000","last_became_peered":"2024-04-25T09:12:35.116308+0000","last_unstale":"2024-04-25T09:12:36.371934+0000","last_undegraded":"2024-04-25T09:12:36.371934+0000","last_fullsized":"2024-04-25T09:12:36.371934+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:37:37.521499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097525+0000","last_change":"2024-04-25T09:12:34.115786+0000","last_active":"2024-04-25T09:12:36.097525+0000","last_peered":"2024-04-25T09:12:36.097525+0000","last_clean":"2024-04-25T09:12:36.097525+0000","last_became_active":"2024-04-25T09:12:34.115524+0000","last_became_peered":"2024-04-25T09:12:34.115524+0000","last_unstale":"2024-04-25T09:12:36.097525+0000","last_undegraded":"2024-04-25T09:12:36.097525+0000","last_fullsized":"2024-04-25T09:12:36.097525+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:39.699444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372510+0000","last_change":"2024-04-25T09:12:35.131021+0000","last_active":"2024-04-25T09:12:36.372510+0000","last_peered":"2024-04-25T09:12:36.372510+0000","last_clean":"2024-04-25T09:12:36.372510+0000","last_became_active":"2024-04-25T09:12:35.130750+0000","last_became_peered":"2024-04-25T09:12:35.130750+0000","last_unstale":"2024-04-25T09:12:36.372510+0000","last_undegraded":"2024-04-25T09:12:36.372510+0000","last_fullsized":"2024-04-25T09:12:36.372510+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:37.039253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.370769+0000","last_change":"2024-04-25T09:12:34.109891+0000","last_active":"2024-04-25T09:12:36.370769+0000","last_peered":"2024-04-25T09:12:36.370769+0000","last_clean":"2024-04-25T09:12:36.370769+0000","last_became_active":"2024-04-25T09:12:34.109424+0000","last_became_peered":"2024-04-25T09:12:34.109424+0000","last_unstale":"2024-04-25T09:12:36.370769+0000","last_undegraded":"2024-04-25T09:12:36.370769+0000","last_fullsized":"2024-04-25T09:12:36.370769+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:03.933284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371946+0000","last_change":"2024-04-25T09:12:35.106605+0000","last_active":"2024-04-25T09:12:36.371946+0000","last_peered":"2024-04-25T09:12:36.371946+0000","last_clean":"2024-04-25T09:12:36.371946+0000","last_became_active":"2024-04-25T09:12:35.106338+0000","last_became_peered":"2024-04-25T09:12:35.106338+0000","last_unstale":"2024-04-25T09:12:36.371946+0000","last_undegraded":"2024-04-25T09:12:36.371946+0000","last_fullsized":"2024-04-25T09:12:36.371946+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:37.039253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"132'8","reported_seq":22,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096277+0000","last_change":"2024-04-25T09:12:34.104901+0000","last_active":"2024-04-25T09:12:36.096277+0000","last_peered":"2024-04-25T09:12:36.096277+0000","last_clean":"2024-04-25T09:12:36.096277+0000","last_became_active":"2024-04-25T09:12:34.104197+0000","last_became_peered":"2024-04-25T09:12:34.104197+0000","last_unstale":"2024-04-25T09:12:36.096277+0000","last_undegraded":"2024-04-25T09:12:36.096277+0000","last_fullsized":"2024-04-25T09:12:36.096277+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:02.754255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371218+0000","last_change":"2024-04-25T09:12:35.121024+0000","last_active":"2024-04-25T09:12:36.371218+0000","last_peered":"2024-04-25T09:12:36.371218+0000","last_clean":"2024-04-25T09:12:36.371218+0000","last_became_active":"2024-04-25T09:12:35.112896+0000","last_became_peered":"2024-04-25T09:12:35.112896+0000","last_unstale":"2024-04-25T09:12:36.371218+0000","last_undegraded":"2024-04-25T09:12:36.371218+0000","last_fullsized":"2024-04-25T09:12:36.371218+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:50.110450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"132'1","reported_seq":15,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.123464+0000","last_change":"2024-04-25T09:12:34.108148+0000","last_active":"2024-04-25T09:12:36.123464+0000","last_peered":"2024-04-25T09:12:36.123464+0000","last_clean":"2024-04-25T09:12:36.123464+0000","last_became_active":"2024-04-25T09:12:34.107865+0000","last_became_peered":"2024-04-25T09:12:34.107865+0000","last_unstale":"2024-04-25T09:12:36.123464+0000","last_undegraded":"2024-04-25T09:12:36.123464+0000","last_fullsized":"2024-04-25T09:12:36.123464+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:40.714295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371368+0000","last_change":"2024-04-25T09:12:35.125572+0000","last_active":"2024-04-25T09:12:36.371368+0000","last_peered":"2024-04-25T09:12:36.371368+0000","last_clean":"2024-04-25T09:12:36.371368+0000","last_became_active":"2024-04-25T09:12:35.125300+0000","last_became_peered":"2024-04-25T09:12:35.125300+0000","last_unstale":"2024-04-25T09:12:36.371368+0000","last_undegraded":"2024-04-25T09:12:36.371368+0000","last_fullsized":"2024-04-25T09:12:36.371368+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:05.811985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372055+0000","last_change":"2024-04-25T09:12:34.106150+0000","last_active":"2024-04-25T09:12:36.372055+0000","last_peered":"2024-04-25T09:12:36.372055+0000","last_clean":"2024-04-25T09:12:36.372055+0000","last_became_active":"2024-04-25T09:12:34.105890+0000","last_became_peered":"2024-04-25T09:12:34.105890+0000","last_unstale":"2024-04-25T09:12:36.372055+0000","last_undegraded":"2024-04-25T09:12:36.372055+0000","last_fullsized":"2024-04-25T09:12:36.372055+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:01.943750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371601+0000","last_change":"2024-04-25T09:12:35.125851+0000","last_active":"2024-04-25T09:12:36.371601+0000","last_peered":"2024-04-25T09:12:36.371601+0000","last_clean":"2024-04-25T09:12:36.371601+0000","last_became_active":"2024-04-25T09:12:35.125343+0000","last_became_peered":"2024-04-25T09:12:35.125343+0000","last_unstale":"2024-04-25T09:12:36.371601+0000","last_undegraded":"2024-04-25T09:12:36.371601+0000","last_fullsized":"2024-04-25T09:12:36.371601+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:00.644137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"132'1","reported_seq":15,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097318+0000","last_change":"2024-04-25T09:12:34.109271+0000","last_active":"2024-04-25T09:12:36.097318+0000","last_peered":"2024-04-25T09:12:36.097318+0000","last_clean":"2024-04-25T09:12:36.097318+0000","last_became_active":"2024-04-25T09:12:34.109005+0000","last_became_peered":"2024-04-25T09:12:34.109005+0000","last_unstale":"2024-04-25T09:12:36.097318+0000","last_undegraded":"2024-04-25T09:12:36.097318+0000","last_fullsized":"2024-04-25T09:12:36.097318+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:26.284455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372035+0000","last_change":"2024-04-25T09:12:35.122796+0000","last_active":"2024-04-25T09:12:36.372035+0000","last_peered":"2024-04-25T09:12:36.372035+0000","last_clean":"2024-04-25T09:12:36.372035+0000","last_became_active":"2024-04-25T09:12:35.122518+0000","last_became_peered":"2024-04-25T09:12:35.122518+0000","last_unstale":"2024-04-25T09:12:36.372035+0000","last_undegraded":"2024-04-25T09:12:36.372035+0000","last_fullsized":"2024-04-25T09:12:36.372035+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:29.475522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371808+0000","last_change":"2024-04-25T09:12:34.113255+0000","last_active":"2024-04-25T09:12:36.371808+0000","last_peered":"2024-04-25T09:12:36.371808+0000","last_clean":"2024-04-25T09:12:36.371808+0000","last_became_active":"2024-04-25T09:12:34.112658+0000","last_became_peered":"2024-04-25T09:12:34.112658+0000","last_unstale":"2024-04-25T09:12:36.371808+0000","last_undegraded":"2024-04-25T09:12:36.371808+0000","last_fullsized":"2024-04-25T09:12:36.371808+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:44.802122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371776+0000","last_change":"2024-04-25T09:12:35.118168+0000","last_active":"2024-04-25T09:12:36.371776+0000","last_peered":"2024-04-25T09:12:36.371776+0000","last_clean":"2024-04-25T09:12:36.371776+0000","last_became_active":"2024-04-25T09:12:35.117803+0000","last_became_peered":"2024-04-25T09:12:35.117803+0000","last_unstale":"2024-04-25T09:12:36.371776+0000","last_undegraded":"2024-04-25T09:12:36.371776+0000","last_fullsized":"2024-04-25T09:12:36.371776+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:06.969509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096700+0000","last_change":"2024-04-25T09:12:34.106394+0000","last_active":"2024-04-25T09:12:36.096700+0000","last_peered":"2024-04-25T09:12:36.096700+0000","last_clean":"2024-04-25T09:12:36.096700+0000","last_became_active":"2024-04-25T09:12:34.104183+0000","last_became_peered":"2024-04-25T09:12:34.104183+0000","last_unstale":"2024-04-25T09:12:36.096700+0000","last_undegraded":"2024-04-25T09:12:36.096700+0000","last_fullsized":"2024-04-25T09:12:36.096700+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:54.897766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097836+0000","last_change":"2024-04-25T09:12:35.125513+0000","last_active":"2024-04-25T09:12:36.097836+0000","last_peered":"2024-04-25T09:12:36.097836+0000","last_clean":"2024-04-25T09:12:36.097836+0000","last_became_active":"2024-04-25T09:12:35.125238+0000","last_became_peered":"2024-04-25T09:12:35.125238+0000","last_unstale":"2024-04-25T09:12:36.097836+0000","last_undegraded":"2024-04-25T09:12:36.097836+0000","last_fullsized":"2024-04-25T09:12:36.097836+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:18.547869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097596+0000","last_change":"2024-04-25T09:12:34.105311+0000","last_active":"2024-04-25T09:12:36.097596+0000","last_peered":"2024-04-25T09:12:36.097596+0000","last_clean":"2024-04-25T09:12:36.097596+0000","last_became_active":"2024-04-25T09:12:34.105070+0000","last_became_peered":"2024-04-25T09:12:34.105070+0000","last_unstale":"2024-04-25T09:12:36.097596+0000","last_undegraded":"2024-04-25T09:12:36.097596+0000","last_fullsized":"2024-04-25T09:12:36.097596+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:38.389565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371838+0000","last_change":"2024-04-25T09:12:35.124346+0000","last_active":"2024-04-25T09:12:36.371838+0000","last_peered":"2024-04-25T09:12:36.371838+0000","last_clean":"2024-04-25T09:12:36.371838+0000","last_became_active":"2024-04-25T09:12:35.123969+0000","last_became_peered":"2024-04-25T09:12:35.123969+0000","last_unstale":"2024-04-25T09:12:36.371838+0000","last_undegraded":"2024-04-25T09:12:36.371838+0000","last_fullsized":"2024-04-25T09:12:36.371838+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:16.640588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371839+0000","last_change":"2024-04-25T09:12:34.114130+0000","last_active":"2024-04-25T09:12:36.371839+0000","last_peered":"2024-04-25T09:12:36.371839+0000","last_clean":"2024-04-25T09:12:36.371839+0000","last_became_active":"2024-04-25T09:12:34.113813+0000","last_became_peered":"2024-04-25T09:12:34.113813+0000","last_unstale":"2024-04-25T09:12:36.371839+0000","last_undegraded":"2024-04-25T09:12:36.371839+0000","last_fullsized":"2024-04-25T09:12:36.371839+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:19.761568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.123534+0000","last_change":"2024-04-25T09:12:35.112741+0000","last_active":"2024-04-25T09:12:36.123534+0000","last_peered":"2024-04-25T09:12:36.123534+0000","last_clean":"2024-04-25T09:12:36.123534+0000","last_became_active":"2024-04-25T09:12:35.112414+0000","last_became_peered":"2024-04-25T09:12:35.112414+0000","last_unstale":"2024-04-25T09:12:36.123534+0000","last_undegraded":"2024-04-25T09:12:36.123534+0000","last_fullsized":"2024-04-25T09:12:36.123534+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:01.125558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096371+0000","last_change":"2024-04-25T09:12:34.105503+0000","last_active":"2024-04-25T09:12:36.096371+0000","last_peered":"2024-04-25T09:12:36.096371+0000","last_clean":"2024-04-25T09:12:36.096371+0000","last_became_active":"2024-04-25T09:12:34.104653+0000","last_became_peered":"2024-04-25T09:12:34.104653+0000","last_unstale":"2024-04-25T09:12:36.096371+0000","last_undegraded":"2024-04-25T09:12:36.096371+0000","last_fullsized":"2024-04-25T09:12:36.096371+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:17.453637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371406+0000","last_change":"2024-04-25T09:12:35.114290+0000","last_active":"2024-04-25T09:12:36.371406+0000","last_peered":"2024-04-25T09:12:36.371406+0000","last_clean":"2024-04-25T09:12:36.371406+0000","last_became_active":"2024-04-25T09:12:35.113989+0000","last_became_peered":"2024-04-25T09:12:35.113989+0000","last_unstale":"2024-04-25T09:12:36.371406+0000","last_undegraded":"2024-04-25T09:12:36.371406+0000","last_fullsized":"2024-04-25T09:12:36.371406+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:23.637033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"132'2","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097979+0000","last_change":"2024-04-25T09:12:34.110412+0000","last_active":"2024-04-25T09:12:36.097979+0000","last_peered":"2024-04-25T09:12:36.097979+0000","last_clean":"2024-04-25T09:12:36.097979+0000","last_became_active":"2024-04-25T09:12:34.110163+0000","last_became_peered":"2024-04-25T09:12:34.110163+0000","last_unstale":"2024-04-25T09:12:36.097979+0000","last_undegraded":"2024-04-25T09:12:36.097979+0000","last_fullsized":"2024-04-25T09:12:36.097979+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:34.085553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.370855+0000","last_change":"2024-04-25T09:12:35.123570+0000","last_active":"2024-04-25T09:12:36.370855+0000","last_peered":"2024-04-25T09:12:36.370855+0000","last_clean":"2024-04-25T09:12:36.370855+0000","last_became_active":"2024-04-25T09:12:35.123004+0000","last_became_peered":"2024-04-25T09:12:35.123004+0000","last_unstale":"2024-04-25T09:12:36.370855+0000","last_undegraded":"2024-04-25T09:12:36.370855+0000","last_fullsized":"2024-04-25T09:12:36.370855+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:10.679503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"133'1","reported_seq":15,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096466+0000","last_change":"2024-04-25T09:12:34.110785+0000","last_active":"2024-04-25T09:12:36.096466+0000","last_peered":"2024-04-25T09:12:36.096466+0000","last_clean":"2024-04-25T09:12:36.096466+0000","last_became_active":"2024-04-25T09:12:34.110492+0000","last_became_peered":"2024-04-25T09:12:34.110492+0000","last_unstale":"2024-04-25T09:12:36.096466+0000","last_undegraded":"2024-04-25T09:12:36.096466+0000","last_fullsized":"2024-04-25T09:12:36.096466+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:44.361135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371411+0000","last_change":"2024-04-25T09:12:35.130641+0000","last_active":"2024-04-25T09:12:36.371411+0000","last_peered":"2024-04-25T09:12:36.371411+0000","last_clean":"2024-04-25T09:12:36.371411+0000","last_became_active":"2024-04-25T09:12:35.130358+0000","last_became_peered":"2024-04-25T09:12:35.130358+0000","last_unstale":"2024-04-25T09:12:36.371411+0000","last_undegraded":"2024-04-25T09:12:36.371411+0000","last_fullsized":"2024-04-25T09:12:36.371411+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:23.637033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096155+0000","last_change":"2024-04-25T09:12:34.108071+0000","last_active":"2024-04-25T09:12:36.096155+0000","last_peered":"2024-04-25T09:12:36.096155+0000","last_clean":"2024-04-25T09:12:36.096155+0000","last_became_active":"2024-04-25T09:12:34.103672+0000","last_became_peered":"2024-04-25T09:12:34.103672+0000","last_unstale":"2024-04-25T09:12:36.096155+0000","last_undegraded":"2024-04-25T09:12:36.096155+0000","last_fullsized":"2024-04-25T09:12:36.096155+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:17.435906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372072+0000","last_change":"2024-04-25T09:12:35.102816+0000","last_active":"2024-04-25T09:12:36.372072+0000","last_peered":"2024-04-25T09:12:36.372072+0000","last_clean":"2024-04-25T09:12:36.372072+0000","last_became_active":"2024-04-25T09:12:35.102511+0000","last_became_peered":"2024-04-25T09:12:35.102511+0000","last_unstale":"2024-04-25T09:12:36.372072+0000","last_undegraded":"2024-04-25T09:12:36.372072+0000","last_fullsized":"2024-04-25T09:12:36.372072+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:24.206699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097049+0000","last_change":"2024-04-25T09:12:34.110221+0000","last_active":"2024-04-25T09:12:36.097049+0000","last_peered":"2024-04-25T09:12:36.097049+0000","last_clean":"2024-04-25T09:12:36.097049+0000","last_became_active":"2024-04-25T09:12:34.109891+0000","last_became_peered":"2024-04-25T09:12:34.109891+0000","last_unstale":"2024-04-25T09:12:36.097049+0000","last_undegraded":"2024-04-25T09:12:36.097049+0000","last_fullsized":"2024-04-25T09:12:36.097049+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:47.318937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096756+0000","last_change":"2024-04-25T09:12:35.117004+0000","last_active":"2024-04-25T09:12:36.096756+0000","last_peered":"2024-04-25T09:12:36.096756+0000","last_clean":"2024-04-25T09:12:36.096756+0000","last_became_active":"2024-04-25T09:12:35.116730+0000","last_became_peered":"2024-04-25T09:12:35.116730+0000","last_unstale":"2024-04-25T09:12:36.096756+0000","last_undegraded":"2024-04-25T09:12:36.096756+0000","last_fullsized":"2024-04-25T09:12:36.096756+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:10.230264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.123135+0000","last_change":"2024-04-25T09:12:34.115299+0000","last_active":"2024-04-25T09:12:36.123135+0000","last_peered":"2024-04-25T09:12:36.123135+0000","last_clean":"2024-04-25T09:12:36.123135+0000","last_became_active":"2024-04-25T09:12:34.114888+0000","last_became_peered":"2024-04-25T09:12:34.114888+0000","last_unstale":"2024-04-25T09:12:36.123135+0000","last_undegraded":"2024-04-25T09:12:36.123135+0000","last_fullsized":"2024-04-25T09:12:36.123135+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:06.964368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.097132+0000","last_change":"2024-04-25T09:12:35.114606+0000","last_active":"2024-04-25T09:12:36.097132+0000","last_peered":"2024-04-25T09:12:36.097132+0000","last_clean":"2024-04-25T09:12:36.097132+0000","last_became_active":"2024-04-25T09:12:35.113811+0000","last_became_peered":"2024-04-25T09:12:35.113811+0000","last_unstale":"2024-04-25T09:12:36.097132+0000","last_undegraded":"2024-04-25T09:12:36.097132+0000","last_fullsized":"2024-04-25T09:12:36.097132+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:40.335388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371652+0000","last_change":"2024-04-25T09:12:34.111472+0000","last_active":"2024-04-25T09:12:36.371652+0000","last_peered":"2024-04-25T09:12:36.371652+0000","last_clean":"2024-04-25T09:12:36.371652+0000","last_became_active":"2024-04-25T09:12:34.111180+0000","last_became_peered":"2024-04-25T09:12:34.111180+0000","last_unstale":"2024-04-25T09:12:36.371652+0000","last_undegraded":"2024-04-25T09:12:36.371652+0000","last_fullsized":"2024-04-25T09:12:36.371652+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:55.097890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096842+0000","last_change":"2024-04-25T09:12:35.123622+0000","last_active":"2024-04-25T09:12:36.096842+0000","last_peered":"2024-04-25T09:12:36.096842+0000","last_clean":"2024-04-25T09:12:36.096842+0000","last_became_active":"2024-04-25T09:12:35.122902+0000","last_became_peered":"2024-04-25T09:12:35.122902+0000","last_unstale":"2024-04-25T09:12:36.096842+0000","last_undegraded":"2024-04-25T09:12:36.096842+0000","last_fullsized":"2024-04-25T09:12:36.096842+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:09.865296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.096353+0000","last_change":"2024-04-25T09:12:34.111476+0000","last_active":"2024-04-25T09:12:36.096353+0000","last_peered":"2024-04-25T09:12:36.096353+0000","last_clean":"2024-04-25T09:12:36.096353+0000","last_became_active":"2024-04-25T09:12:34.111009+0000","last_became_peered":"2024-04-25T09:12:34.111009+0000","last_unstale":"2024-04-25T09:12:36.096353+0000","last_undegraded":"2024-04-25T09:12:36.096353+0000","last_fullsized":"2024-04-25T09:12:36.096353+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:19.314492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372398+0000","last_change":"2024-04-25T09:12:35.132520+0000","last_active":"2024-04-25T09:12:36.372398+0000","last_peered":"2024-04-25T09:12:36.372398+0000","last_clean":"2024-04-25T09:12:36.372398+0000","last_became_active":"2024-04-25T09:12:35.132241+0000","last_became_peered":"2024-04-25T09:12:35.132241+0000","last_unstale":"2024-04-25T09:12:36.372398+0000","last_undegraded":"2024-04-25T09:12:36.372398+0000","last_fullsized":"2024-04-25T09:12:36.372398+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:16.640588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371350+0000","last_change":"2024-04-25T09:12:34.102692+0000","last_active":"2024-04-25T09:12:36.371350+0000","last_peered":"2024-04-25T09:12:36.371350+0000","last_clean":"2024-04-25T09:12:36.371350+0000","last_became_active":"2024-04-25T09:12:34.102409+0000","last_became_peered":"2024-04-25T09:12:34.102409+0000","last_unstale":"2024-04-25T09:12:36.371350+0000","last_undegraded":"2024-04-25T09:12:36.371350+0000","last_fullsized":"2024-04-25T09:12:36.371350+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:17.490405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":12,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.372167+0000","last_change":"2024-04-25T09:12:35.115629+0000","last_active":"2024-04-25T09:12:36.372167+0000","last_peered":"2024-04-25T09:12:36.372167+0000","last_clean":"2024-04-25T09:12:36.372167+0000","last_became_active":"2024-04-25T09:12:35.115138+0000","last_became_peered":"2024-04-25T09:12:35.115138+0000","last_unstale":"2024-04-25T09:12:36.372167+0000","last_undegraded":"2024-04-25T09:12:36.372167+0000","last_fullsized":"2024-04-25T09:12:36.372167+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:34.083304+0000","last_clean_scrub_stamp":"2024-04-25T09:12:34.083304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:22.122514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":14,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371515+0000","last_change":"2024-04-25T09:12:34.114900+0000","last_active":"2024-04-25T09:12:36.371515+0000","last_peered":"2024-04-25T09:12:36.371515+0000","last_clean":"2024-04-25T09:12:36.371515+0000","last_became_active":"2024-04-25T09:12:34.114551+0000","last_became_peered":"2024-04-25T09:12:34.114551+0000","last_unstale":"2024-04-25T09:12:36.371515+0000","last_undegraded":"2024-04-25T09:12:36.371515+0000","last_fullsized":"2024-04-25T09:12:36.371515+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:33.076368+0000","last_clean_scrub_stamp":"2024-04-25T09:12:33.076368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:17.056789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":377,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-25T09:12:36.371175+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:12:36.371175+0000","last_peered":"2024-04-25T09:12:36.371175+0000","last_clean":"2024-04-25T09:12:36.371175+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:12:36.371175+0000","last_undegraded":"2024-04-25T09:12:36.371175+0000","last_fullsized":"2024-04-25T09:12:36.371175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509563,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55020,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316820,"statfs":{"total":96636764160,"available":96580423680,"internally_reserved":0,"allocated":1662976,"data_stored":771420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509563,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50856,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320984,"statfs":{"total":96636764160,"available":96584687616,"internally_reserved":0,"allocated":1658880,"data_stored":770770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509564,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59164,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312676,"statfs":{"total":96636764160,"available":96576180224,"internally_reserved":0,"allocated":1654784,"data_stored":770748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509563,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59180,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312660,"statfs":{"total":96636764160,"available":96576163840,"internally_reserved":0,"allocated":1671168,"data_stored":772430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509563,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55016,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316824,"statfs":{"total":96636764160,"available":96580427776,"internally_reserved":0,"allocated":1662976,"data_stored":771364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509564,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50860,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320980,"statfs":{"total":96636764160,"available":96584683520,"internally_reserved":0,"allocated":1658880,"data_stored":770818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509564,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55592,"kb_used_data":2204,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316248,"statfs":{"total":96636764160,"available":96579837952,"internally_reserved":0,"allocated":2256896,"data_stored":1361172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574972,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51440,"kb_used_data":2212,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320400,"statfs":{"total":96636764160,"available":96584089600,"internally_reserved":0,"allocated":2265088,"data_stored":1362818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:12:44.029 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:12:44.029 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:12:44.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.225+0000 7fe339800640 1 Processor -- start 2024-04-25T09:12:44.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.225+0000 7fe339800640 1 -- start start 2024-04-25T09:12:44.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe339800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe3340ccff0 0x7fe3340cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:44.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe339800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3340ce680 0x7fe3340ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:44.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe339800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3340cdaa0 con 0x7fe3340b0d70 2024-04-25T09:12:44.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe339800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33415b3a0 con 0x7fe3340ccff0 2024-04-25T09:12:44.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe339800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33406d3d0 con 0x7fe3340ce680 2024-04-25T09:12:44.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe3340b0d70 0x7fe33415ac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34258/0 (socket says 172.21.15.173:34258) 2024-04-25T09:12:44.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333e00640 1 -- 172.21.15.173:0/388182890 learned_addr learned my addr 172.21.15.173:0/388182890 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:44.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333400640 1 -- 172.21.15.173:0/388182890 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074251191 0 0) 0x7fe3340cdaa0 con 0x7fe3340b0d70 2024-04-25T09:12:44.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333400640 1 -- 172.21.15.173:0/388182890 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe318003530 con 0x7fe3340b0d70 2024-04-25T09:12:44.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe32b400640 1 --2- 172.21.15.173:0/388182890 >> v2:172.21.15.194:3300/0 conn(0x7fe3340ccff0 0x7fe3340cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:44.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe338e00640 1 --2- 172.21.15.173:0/388182890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3340ce680 0x7fe3340ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:44.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333400640 1 -- 172.21.15.173:0/388182890 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3361952753 0 0) 0x7fe318003530 con 0x7fe3340b0d70 2024-04-25T09:12:44.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333400640 1 -- 172.21.15.173:0/388182890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3340ce680 msgr2=0x7fe3340ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:44.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333400640 1 --2- 172.21.15.173:0/388182890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3340ce680 0x7fe3340ceb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333400640 1 -- 172.21.15.173:0/388182890 >> v2:172.21.15.194:3300/0 conn(0x7fe3340ccff0 msgr2=0x7fe3340cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:44.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333400640 1 --2- 172.21.15.173:0/388182890 >> v2:172.21.15.194:3300/0 conn(0x7fe3340ccff0 0x7fe3340cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333400640 1 -- 172.21.15.173:0/388182890 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33406d670 con 0x7fe3340b0d70 2024-04-25T09:12:44.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333400640 1 -- 172.21.15.173:0/388182890 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fe324001680 con 0x7fe3340b0d70 2024-04-25T09:12:44.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333400640 1 -- 172.21.15.173:0/388182890 >> v1:172.21.15.173:6789/0 conn(0x7fe3340b0d70 legacy=0x7fe33415ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:44.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333400640 1 --2- 172.21.15.173:0/388182890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3340ce680 0x7fe3180039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:44.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333400640 1 --2- 172.21.15.173:0/388182890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe318003f40 0x7fe318004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:44.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333400640 1 --2- 172.21.15.173:0/388182890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe318004d50 0x7fe3180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:44.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333400640 1 -- 172.21.15.173:0/388182890 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33415b3a0 con 0x7fe318004d50 2024-04-25T09:12:44.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333400640 1 -- 172.21.15.173:0/388182890 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33406d3d0 con 0x7fe318003f40 2024-04-25T09:12:44.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333400640 1 -- 172.21.15.173:0/388182890 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31800ba20 con 0x7fe3340ce680 2024-04-25T09:12:44.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe338e00640 1 --2- 172.21.15.173:0/388182890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe318004d50 0x7fe3180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:44.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe333e00640 1 --2- 172.21.15.173:0/388182890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3340ce680 0x7fe3180039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:44.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe32b400640 1 --2- 172.21.15.173:0/388182890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe318003f40 0x7fe318004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:44.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe338e00640 1 -- 172.21.15.173:0/388182890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3340ce680 msgr2=0x7fe3180039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:44.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe338e00640 1 --2- 172.21.15.173:0/388182890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3340ce680 0x7fe3180039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe338e00640 1 -- 172.21.15.173:0/388182890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe318003f40 msgr2=0x7fe318004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:44.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe338e00640 1 --2- 172.21.15.173:0/388182890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe318003f40 0x7fe318004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.229+0000 7fe338e00640 1 -- 172.21.15.173:0/388182890 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe318003530 con 0x7fe318004d50 2024-04-25T09:12:44.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.233+0000 7fe338e00640 1 --2- 172.21.15.173:0/388182890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe318004d50 0x7fe3180051d0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fe32c00e170 tx=0x7fe32c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be141c2d3c3e3dd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:44.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.233+0000 7fe333400640 1 -- 172.21.15.173:0/388182890 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c0b0070 con 0x7fe318004d50 2024-04-25T09:12:44.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.233+0000 7fe333400640 1 -- 172.21.15.173:0/388182890 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32c0ab600 con 0x7fe318004d50 2024-04-25T09:12:44.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.233+0000 7fe333400640 1 -- 172.21.15.173:0/388182890 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c009c10 con 0x7fe318004d50 2024-04-25T09:12:44.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.233+0000 7fe339800640 1 -- 172.21.15.173:0/388182890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe318004d50 msgr2=0x7fe3180051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:44.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.233+0000 7fe339800640 1 --2- 172.21.15.173:0/388182890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe318004d50 0x7fe3180051d0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fe32c00e170 tx=0x7fe32c01c910 comp rx=0 tx=0).stop 2024-04-25T09:12:44.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.233+0000 7fe338e00640 1 -- 172.21.15.173:0/388182890 reap_dead start 2024-04-25T09:12:44.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.233+0000 7fe339800640 1 -- 172.21.15.173:0/388182890 shutdown_connections 2024-04-25T09:12:44.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.233+0000 7fe339800640 1 -- 172.21.15.173:0/388182890 >> 172.21.15.173:0/388182890 conn(0x7fe334061d40 msgr2=0x7fe33406ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:44.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.233+0000 7fe339800640 1 -- 172.21.15.173:0/388182890 shutdown_connections 2024-04-25T09:12:44.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.233+0000 7fe339800640 1 -- 172.21.15.173:0/388182890 wait complete. 2024-04-25T09:12:44.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.233+0000 7fe339800640 1 Processor -- start 2024-04-25T09:12:44.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.233+0000 7fe339800640 1 -- start start 2024-04-25T09:12:44.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe339800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe318004d50 0x7fe3340ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:44.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe339800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe334157c80 0x7fe3340b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:44.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe339800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe334158100 0x7fe3340b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:44.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe339800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3340cee70 con 0x7fe334157c80 2024-04-25T09:12:44.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe339800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe334143d90 con 0x7fe334158100 2024-04-25T09:12:44.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe339800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3340ceff0 con 0x7fe318004d50 2024-04-25T09:12:44.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe32b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe334157c80 0x7fe3340b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:44.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe32b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe334157c80 0x7fe3340b2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51066/0 (socket says 172.21.15.173:51066) 2024-04-25T09:12:44.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe32b400640 1 -- 172.21.15.173:0/1311326365 learned_addr learned my addr 172.21.15.173:0/1311326365 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:44.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe338e00640 1 --2- 172.21.15.173:0/1311326365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe334158100 0x7fe3340b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:44.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe333e00640 1 --2- 172.21.15.173:0/1311326365 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe318004d50 0x7fe3340ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:44.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe32b400640 1 -- 172.21.15.173:0/1311326365 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe318004d50 msgr2=0x7fe3340ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:44.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe32b400640 1 --2- 172.21.15.173:0/1311326365 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe318004d50 0x7fe3340ca810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe32b400640 1 -- 172.21.15.173:0/1311326365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe334158100 msgr2=0x7fe3340b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:44.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe32b400640 1 --2- 172.21.15.173:0/1311326365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe334158100 0x7fe3340b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe32b400640 1 -- 172.21.15.173:0/1311326365 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3340cc070 con 0x7fe334157c80 2024-04-25T09:12:44.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe338e00640 1 --2- 172.21.15.173:0/1311326365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe334158100 0x7fe3340b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:44.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe32b400640 1 --2- 172.21.15.173:0/1311326365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe334157c80 0x7fe3340b2510 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0119d0 tx=0x7fe31c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:44.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe330c00640 1 -- 172.21.15.173:0/1311326365 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00fb50 con 0x7fe334157c80 2024-04-25T09:12:44.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe330c00640 1 -- 172.21.15.173:0/1311326365 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c00fcf0 con 0x7fe334157c80 2024-04-25T09:12:44.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe330c00640 1 -- 172.21.15.173:0/1311326365 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00fea0 con 0x7fe334157c80 2024-04-25T09:12:44.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe339800640 1 -- 172.21.15.173:0/1311326365 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3340cb4f0 con 0x7fe334157c80 2024-04-25T09:12:44.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe339800640 1 -- 172.21.15.173:0/1311326365 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3340cbab0 con 0x7fe334157c80 2024-04-25T09:12:44.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.237+0000 7fe339800640 1 -- 172.21.15.173:0/1311326365 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe334073a40 con 0x7fe334157c80 2024-04-25T09:12:44.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.241+0000 7fe330c00640 1 -- 172.21.15.173:0/1311326365 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe31c012040 con 0x7fe334157c80 2024-04-25T09:12:44.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.241+0000 7fe330c00640 1 --2- 172.21.15.173:0/1311326365 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe310066fb0 0x7fe310069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:44.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.241+0000 7fe330c00640 1 -- 172.21.15.173:0/1311326365 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe31c0858a0 con 0x7fe334157c80 2024-04-25T09:12:44.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.241+0000 7fe333e00640 1 --2- 172.21.15.173:0/1311326365 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe310066fb0 0x7fe310069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:44.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.241+0000 7fe333e00640 1 --2- 172.21.15.173:0/1311326365 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe310066fb0 0x7fe310069470 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fe3341431b0 tx=0x7fe324009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:44.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.245+0000 7fe330c00640 1 -- 172.21.15.173:0/1311326365 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe31c019030 con 0x7fe334157c80 2024-04-25T09:12:44.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.453+0000 7fe339800640 1 -- 172.21.15.173:0/1311326365 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe33406ba50 con 0x7fe334157c80 2024-04-25T09:12:44.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.457+0000 7fe330c00640 1 -- 172.21.15.173:0/1311326365 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7fe31c056170 con 0x7fe334157c80 2024-04-25T09:12:44.441 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2024-04-25T09:12:44.441 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w== 2024-04-25T09:12:44.441 INFO:teuthology.orchestra.run.smithi173.stdout: caps mds = "allow" 2024-04-25T09:12:44.441 INFO:teuthology.orchestra.run.smithi173.stdout: caps mon = "allow r" 2024-04-25T09:12:44.441 INFO:teuthology.orchestra.run.smithi173.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:12:44.441 INFO:teuthology.orchestra.run.smithi173.stderr:updated caps for client.0 2024-04-25T09:12:44.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.457+0000 7fe339800640 1 -- 172.21.15.173:0/1311326365 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe310066fb0 msgr2=0x7fe310069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:44.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.457+0000 7fe339800640 1 --2- 172.21.15.173:0/1311326365 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe310066fb0 0x7fe310069470 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fe3341431b0 tx=0x7fe324009040 comp rx=0 tx=0).stop 2024-04-25T09:12:44.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.457+0000 7fe339800640 1 -- 172.21.15.173:0/1311326365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe334157c80 msgr2=0x7fe3340b2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:44.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.457+0000 7fe339800640 1 --2- 172.21.15.173:0/1311326365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe334157c80 0x7fe3340b2510 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0119d0 tx=0x7fe31c011e90 comp rx=0 tx=0).stop 2024-04-25T09:12:44.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.457+0000 7fe339800640 1 -- 172.21.15.173:0/1311326365 shutdown_connections 2024-04-25T09:12:44.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.457+0000 7fe339800640 1 --2- 172.21.15.173:0/1311326365 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe310066fb0 0x7fe310069470 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.457+0000 7fe339800640 1 --2- 172.21.15.173:0/1311326365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe334158100 0x7fe3340b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.457+0000 7fe339800640 1 --2- 172.21.15.173:0/1311326365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe334157c80 0x7fe3340b2510 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.457+0000 7fe339800640 1 --2- 172.21.15.173:0/1311326365 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe318004d50 0x7fe3340ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.457+0000 7fe339800640 1 -- 172.21.15.173:0/1311326365 >> 172.21.15.173:0/1311326365 conn(0x7fe334061d40 msgr2=0x7fe334159bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:44.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.457+0000 7fe339800640 1 -- 172.21.15.173:0/1311326365 shutdown_connections 2024-04-25T09:12:44.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.457+0000 7fe339800640 1 -- 172.21.15.173:0/1311326365 wait complete. 2024-04-25T09:12:44.462 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:44.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.613+0000 7f7b07a00640 1 Processor -- start 2024-04-25T09:12:44.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.613+0000 7f7b07a00640 1 -- start start 2024-04-25T09:12:44.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.613+0000 7f7b07a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7b000d06d0 0x7f7b000d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:44.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.613+0000 7f7b07a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b00161b40 0x7f7b00161ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:44.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.613+0000 7f7b07a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b000b5740 con 0x7f7b0015df60 2024-04-25T09:12:44.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.613+0000 7f7b07a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b000d1070 con 0x7f7b000d06d0 2024-04-25T09:12:44.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.613+0000 7f7b07a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b00162a00 con 0x7f7b00161b40 2024-04-25T09:12:44.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.613+0000 7f7affe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7b000d06d0 0x7f7b000d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:44.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.613+0000 7f7b05a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b00161b40 0x7f7b00161ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:44.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.613+0000 7f7b05000640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f7b0015df60 0x7f7b000d29d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:44612/0 (socket says 172.21.15.173:44612) 2024-04-25T09:12:44.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.613+0000 7f7b05a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b00161b40 0x7f7b00161ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:53634/0 (socket says 172.21.15.173:53634) 2024-04-25T09:12:44.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.613+0000 7f7b05000640 1 -- 172.21.15.173:0/1418265464 learned_addr learned my addr 172.21.15.173:0/1418265464 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:44.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.613+0000 7f7affe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7b000d06d0 0x7f7b000d0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:52646/0 (socket says 172.21.15.173:52646) 2024-04-25T09:12:44.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.613+0000 7f7b05a00640 1 -- 172.21.15.173:0/1418265464 >> v2:172.21.15.194:3300/0 conn(0x7f7b000d06d0 msgr2=0x7f7b000d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:44.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.613+0000 7f7b05a00640 1 --2- 172.21.15.173:0/1418265464 >> v2:172.21.15.194:3300/0 conn(0x7f7b000d06d0 0x7f7b000d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.613+0000 7f7b05a00640 1 -- 172.21.15.173:0/1418265464 >> v1:172.21.15.194:6789/0 conn(0x7f7b0015df60 legacy=0x7f7b000d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:44.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.613+0000 7f7b05a00640 1 -- 172.21.15.173:0/1418265464 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b00162720 con 0x7f7b00161b40 2024-04-25T09:12:44.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.617+0000 7f7b05a00640 1 --2- 172.21.15.173:0/1418265464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b00161b40 0x7f7b00161ff0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009d90 tx=0x7f7af801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d102e45465b0a4cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:44.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.617+0000 7f7aff400640 1 -- 172.21.15.173:0/1418265464 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af80b2070 con 0x7f7b00161b40 2024-04-25T09:12:44.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.617+0000 7f7aff400640 1 -- 172.21.15.173:0/1418265464 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af80a5920 con 0x7f7b00161b40 2024-04-25T09:12:44.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.617+0000 7f7aff400640 1 -- 172.21.15.173:0/1418265464 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af80a5cf0 con 0x7f7b00161b40 2024-04-25T09:12:44.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.617+0000 7f7b07a00640 1 -- 172.21.15.173:0/1418265464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b00161b40 msgr2=0x7f7b00161ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:44.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.617+0000 7f7b07a00640 1 --2- 172.21.15.173:0/1418265464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b00161b40 0x7f7b00161ff0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009d90 tx=0x7f7af801c970 comp rx=0 tx=0).stop 2024-04-25T09:12:44.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.617+0000 7f7b07a00640 1 -- 172.21.15.173:0/1418265464 shutdown_connections 2024-04-25T09:12:44.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.617+0000 7f7b07a00640 1 --2- 172.21.15.173:0/1418265464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b00161b40 0x7f7b00161ff0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.617+0000 7f7b07a00640 1 --2- 172.21.15.173:0/1418265464 >> v2:172.21.15.194:3300/0 conn(0x7f7b000d06d0 0x7f7b000d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.617+0000 7f7b07a00640 1 -- 172.21.15.173:0/1418265464 >> 172.21.15.173:0/1418265464 conn(0x7f7b0006c570 msgr2=0x7f7b0006c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:44.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.617+0000 7f7b07a00640 1 -- 172.21.15.173:0/1418265464 shutdown_connections 2024-04-25T09:12:44.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.617+0000 7f7b07a00640 1 -- 172.21.15.173:0/1418265464 wait complete. 2024-04-25T09:12:44.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7b07a00640 1 Processor -- start 2024-04-25T09:12:44.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7b07a00640 1 -- start start 2024-04-25T09:12:44.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7b07a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b000d06d0 0x7f7b001595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:44.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7b07a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b0015df60 0x7f7b0015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7b07a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b00161b40 0x7f7b000b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7b07a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0015e4c0 con 0x7f7b0015df60 2024-04-25T09:12:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7b07a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0015e340 con 0x7f7b000d06d0 2024-04-25T09:12:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7b07a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b000d30e0 con 0x7f7b00161b40 2024-04-25T09:12:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7affe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b0015df60 0x7f7b0015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7affe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b0015df60 0x7f7b0015d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51078/0 (socket says 172.21.15.173:51078) 2024-04-25T09:12:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7affe00640 1 -- 172.21.15.173:0/4238475447 learned_addr learned my addr 172.21.15.173:0/4238475447 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7b05000640 1 --2- 172.21.15.173:0/4238475447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b000d06d0 0x7f7b001595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7b05a00640 1 --2- 172.21.15.173:0/4238475447 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b00161b40 0x7f7b000b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7affe00640 1 -- 172.21.15.173:0/4238475447 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b00161b40 msgr2=0x7f7b000b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7affe00640 1 --2- 172.21.15.173:0/4238475447 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b00161b40 0x7f7b000b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7affe00640 1 -- 172.21.15.173:0/4238475447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b000d06d0 msgr2=0x7f7b001595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7affe00640 1 --2- 172.21.15.173:0/4238475447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b000d06d0 0x7f7b001595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7affe00640 1 -- 172.21.15.173:0/4238475447 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b00159ea0 con 0x7f7b0015df60 2024-04-25T09:12:44.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7affe00640 1 --2- 172.21.15.173:0/4238475447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b0015df60 0x7f7b0015d1a0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00e840 tx=0x7f7aec00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:44.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7afcc00640 1 -- 172.21.15.173:0/4238475447 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec017070 con 0x7f7b0015df60 2024-04-25T09:12:44.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7afcc00640 1 -- 172.21.15.173:0/4238475447 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aec00ee90 con 0x7f7b0015df60 2024-04-25T09:12:44.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7afcc00640 1 -- 172.21.15.173:0/4238475447 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec00cb60 con 0x7f7b0015df60 2024-04-25T09:12:44.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7b07a00640 1 -- 172.21.15.173:0/4238475447 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b0015a180 con 0x7f7b0015df60 2024-04-25T09:12:44.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.621+0000 7f7b07a00640 1 -- 172.21.15.173:0/4238475447 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b0015a740 con 0x7f7b0015df60 2024-04-25T09:12:44.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.625+0000 7f7b07a00640 1 -- 172.21.15.173:0/4238475447 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b00073a40 con 0x7f7b0015df60 2024-04-25T09:12:44.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.625+0000 7f7afcc00640 1 -- 172.21.15.173:0/4238475447 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7aec01a070 con 0x7f7b0015df60 2024-04-25T09:12:44.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.625+0000 7f7afcc00640 1 --2- 172.21.15.173:0/4238475447 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7ae0066f60 0x7f7ae0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:44.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.625+0000 7f7afcc00640 1 -- 172.21.15.173:0/4238475447 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7aec085020 con 0x7f7b0015df60 2024-04-25T09:12:44.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.625+0000 7f7b05000640 1 --2- 172.21.15.173:0/4238475447 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7ae0066f60 0x7f7ae0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:44.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.625+0000 7f7b05000640 1 --2- 172.21.15.173:0/4238475447 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7ae0066f60 0x7f7ae0069420 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7af0000f70 tx=0x7f7af0007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:44.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.629+0000 7f7afcc00640 1 -- 172.21.15.173:0/4238475447 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7aec0557b0 con 0x7f7b0015df60 2024-04-25T09:12:44.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.813+0000 7f7b07a00640 1 -- 172.21.15.173:0/4238475447 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b000d1960 con 0x7f7b0015df60 2024-04-25T09:12:44.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.813+0000 7f7afcc00640 1 -- 172.21.15.173:0/4238475447 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f7aec059850 con 0x7f7b0015df60 2024-04-25T09:12:44.799 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:44.799 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":89,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":9408,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1841246276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1841246276},{"type":"v1","addr":"172.21.15.173:6835","nonce":1841246276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:34.472510+0000","modified":"2024-04-25T09:12:37.491581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9411":{"gid":9411,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3627798672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3627798672},{"type":"v1","addr":"172.21.15.173:6837","nonce":3627798672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:12:44.799 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 89 2024-04-25T09:12:44.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.817+0000 7f7b07a00640 1 -- 172.21.15.173:0/4238475447 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7ae0066f60 msgr2=0x7f7ae0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:44.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.817+0000 7f7b07a00640 1 --2- 172.21.15.173:0/4238475447 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7ae0066f60 0x7f7ae0069420 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7af0000f70 tx=0x7f7af0007e90 comp rx=0 tx=0).stop 2024-04-25T09:12:44.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.817+0000 7f7b07a00640 1 -- 172.21.15.173:0/4238475447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b0015df60 msgr2=0x7f7b0015d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:44.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.817+0000 7f7b07a00640 1 --2- 172.21.15.173:0/4238475447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b0015df60 0x7f7b0015d1a0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00e840 tx=0x7f7aec00ec40 comp rx=0 tx=0).stop 2024-04-25T09:12:44.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.817+0000 7f7b07a00640 1 -- 172.21.15.173:0/4238475447 shutdown_connections 2024-04-25T09:12:44.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.817+0000 7f7b07a00640 1 --2- 172.21.15.173:0/4238475447 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7ae0066f60 0x7f7ae0069420 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.817+0000 7f7b07a00640 1 --2- 172.21.15.173:0/4238475447 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b00161b40 0x7f7b000b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.817+0000 7f7b07a00640 1 --2- 172.21.15.173:0/4238475447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b0015df60 0x7f7b0015d1a0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.817+0000 7f7b07a00640 1 --2- 172.21.15.173:0/4238475447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b000d06d0 0x7f7b001595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:44.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.817+0000 7f7b07a00640 1 -- 172.21.15.173:0/4238475447 >> 172.21.15.173:0/4238475447 conn(0x7f7b0006c570 msgr2=0x7f7b000b8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:44.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.817+0000 7f7b07a00640 1 -- 172.21.15.173:0/4238475447 shutdown_connections 2024-04-25T09:12:44.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:44.817+0000 7f7b07a00640 1 -- 172.21.15.173:0/4238475447 wait complete. 2024-04-25T09:12:45.223 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 89, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:12:34.472510+0000', 'modified': '2024-04-25T09:12:37.491581+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9411}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9411': {'gid': 9411, 'name': 'a', 'rank': 0, 'incarnation': 86, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.173:6837/3627798672', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6836', 'nonce': 3627798672}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 3627798672}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:12:45.223 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:12:45.224 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:12:45.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.377+0000 7f4a13200640 1 Processor -- start 2024-04-25T09:12:45.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.377+0000 7f4a13200640 1 -- start start 2024-04-25T09:12:45.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.377+0000 7f4a13200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4a1415b980 0x7f4a140ad880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.377+0000 7f4a13200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4a1406f650 0x7f4a1406bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.377+0000 7f4a13200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a140728b0 con 0x7f4a1406c1e0 2024-04-25T09:12:45.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.377+0000 7f4a13200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a14072b90 con 0x7f4a1415b980 2024-04-25T09:12:45.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.377+0000 7f4a13200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a140af4c0 con 0x7f4a1406f650 2024-04-25T09:12:45.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.377+0000 7f4a11e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4a1415b980 0x7f4a140ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.377+0000 7f4a11e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4a1415b980 0x7f4a140ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51090/0 (socket says 172.21.15.173:51090) 2024-04-25T09:12:45.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.377+0000 7f4a11e00640 1 -- 172.21.15.173:0/624495745 learned_addr learned my addr 172.21.15.173:0/624495745 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:45.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.377+0000 7f4a0be00640 1 --2- 172.21.15.173:0/624495745 >> v2:172.21.15.194:3300/0 conn(0x7f4a1406f650 0x7f4a1406bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.377+0000 7f4a11e00640 1 -- 172.21.15.173:0/624495745 >> v2:172.21.15.194:3300/0 conn(0x7f4a1406f650 msgr2=0x7f4a1406bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:45.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.377+0000 7f4a11e00640 1 --2- 172.21.15.173:0/624495745 >> v2:172.21.15.194:3300/0 conn(0x7f4a1406f650 0x7f4a1406bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.377+0000 7f4a11e00640 1 -- 172.21.15.173:0/624495745 >> v1:172.21.15.194:6789/0 conn(0x7f4a1406c1e0 legacy=0x7f4a1415bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:45.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.377+0000 7f4a11e00640 1 -- 172.21.15.173:0/624495745 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a140af120 con 0x7f4a1415b980 2024-04-25T09:12:45.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.381+0000 7f4a11e00640 1 --2- 172.21.15.173:0/624495745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a1415b980 0x7f4a140ad880 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f4a14073020 tx=0x7f4a0401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fee0d0d2b7f27d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:45.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.381+0000 7f4a11400640 1 -- 172.21.15.173:0/624495745 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a040b0070 con 0x7f4a1415b980 2024-04-25T09:12:45.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.381+0000 7f4a11400640 1 -- 172.21.15.173:0/624495745 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a040ab600 con 0x7f4a1415b980 2024-04-25T09:12:45.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.381+0000 7f4a11400640 1 -- 172.21.15.173:0/624495745 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a040ab9d0 con 0x7f4a1415b980 2024-04-25T09:12:45.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.381+0000 7f4a13200640 1 -- 172.21.15.173:0/624495745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a1415b980 msgr2=0x7f4a140ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:45.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.381+0000 7f4a13200640 1 --2- 172.21.15.173:0/624495745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a1415b980 0x7f4a140ad880 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f4a14073020 tx=0x7f4a0401c520 comp rx=0 tx=0).stop 2024-04-25T09:12:45.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.381+0000 7f4a13200640 1 -- 172.21.15.173:0/624495745 shutdown_connections 2024-04-25T09:12:45.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.381+0000 7f4a13200640 1 --2- 172.21.15.173:0/624495745 >> v2:172.21.15.194:3300/0 conn(0x7f4a1406f650 0x7f4a1406bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.381+0000 7f4a13200640 1 --2- 172.21.15.173:0/624495745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a1415b980 0x7f4a140ad880 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.381+0000 7f4a13200640 1 -- 172.21.15.173:0/624495745 >> 172.21.15.173:0/624495745 conn(0x7f4a14071b80 msgr2=0x7f4a14071f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:45.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.381+0000 7f4a13200640 1 -- 172.21.15.173:0/624495745 shutdown_connections 2024-04-25T09:12:45.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.381+0000 7f4a13200640 1 -- 172.21.15.173:0/624495745 wait complete. 2024-04-25T09:12:45.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a13200640 1 Processor -- start 2024-04-25T09:12:45.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a13200640 1 -- start start 2024-04-25T09:12:45.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a13200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a1406c1e0 0x7f4a14158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a13200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a1406f650 0x7f4a1414ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a13200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a1415a520 0x7f4a1415da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a13200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1406fa30 con 0x7f4a1406f650 2024-04-25T09:12:45.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a13200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1406c5f0 con 0x7f4a1406c1e0 2024-04-25T09:12:45.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a13200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14168580 con 0x7f4a1415a520 2024-04-25T09:12:45.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a0be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a1406f650 0x7f4a1414ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a0be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a1406f650 0x7f4a1414ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51092/0 (socket says 172.21.15.173:51092) 2024-04-25T09:12:45.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a0be00640 1 -- 172.21.15.173:0/1738826987 learned_addr learned my addr 172.21.15.173:0/1738826987 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:45.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a11e00640 1 --2- 172.21.15.173:0/1738826987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a1406c1e0 0x7f4a14158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a12800640 1 --2- 172.21.15.173:0/1738826987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a1415a520 0x7f4a1415da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a0be00640 1 -- 172.21.15.173:0/1738826987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a1415a520 msgr2=0x7f4a1415da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:45.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a0be00640 1 --2- 172.21.15.173:0/1738826987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a1415a520 0x7f4a1415da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a0be00640 1 -- 172.21.15.173:0/1738826987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a1406c1e0 msgr2=0x7f4a14158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:45.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a0be00640 1 --2- 172.21.15.173:0/1738826987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a1406c1e0 0x7f4a14158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a0be00640 1 -- 172.21.15.173:0/1738826987 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a14159480 con 0x7f4a1406f650 2024-04-25T09:12:45.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a0be00640 1 --2- 172.21.15.173:0/1738826987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a1406f650 0x7f4a1414ec70 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00d5f0 tx=0x7f49fc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:45.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a0a000640 1 -- 172.21.15.173:0/1738826987 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc0125f0 con 0x7f4a1406f650 2024-04-25T09:12:45.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a0a000640 1 -- 172.21.15.173:0/1738826987 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc019070 con 0x7f4a1406f650 2024-04-25T09:12:45.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a0a000640 1 -- 172.21.15.173:0/1738826987 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc0129b0 con 0x7f4a1406f650 2024-04-25T09:12:45.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a13200640 1 -- 172.21.15.173:0/1738826987 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a14159760 con 0x7f4a1406f650 2024-04-25T09:12:45.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.385+0000 7f4a13200640 1 -- 172.21.15.173:0/1738826987 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a14159d20 con 0x7f4a1406f650 2024-04-25T09:12:45.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a0a000640 1 -- 172.21.15.173:0/1738826987 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f49fc012b50 con 0x7f4a1406f650 2024-04-25T09:12:45.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a0a000640 1 --2- 172.21.15.173:0/1738826987 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f49f0066f90 0x7f49f0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a0a000640 1 -- 172.21.15.173:0/1738826987 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f49fc085540 con 0x7f4a1406f650 2024-04-25T09:12:45.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a11e00640 1 --2- 172.21.15.173:0/1738826987 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f49f0066f90 0x7f49f0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a1c50c000 1 Processor -- start 2024-04-25T09:12:45.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a1c50c000 1 -- start start 2024-04-25T09:12:45.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a11e00640 1 --2- 172.21.15.173:0/1738826987 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f49f0066f90 0x7f49f0069450 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4a040ad000 tx=0x7f4a04008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:45.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a1c50c000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc54920 0x5582fdc54d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a1c50c000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc55240 0x5582fdc0a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a1c50c000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc0af30 0x5582fdc0b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a1c50c000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fdaf25f0 con 0x5582fdc55240 2024-04-25T09:12:45.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a1c50c000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fda59da0 con 0x5582fdc54920 2024-04-25T09:12:45.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a1c50c000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582fd9e2150 con 0x5582fdc0af30 2024-04-25T09:12:45.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a0be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc55240 0x5582fdc0a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a0be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc55240 0x5582fdc0a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51102/0 (socket says 172.21.15.173:51102) 2024-04-25T09:12:45.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a0be00640 1 -- 172.21.15.173:0/2886263134 learned_addr learned my addr 172.21.15.173:0/2886263134 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:45.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a11e00640 1 --2- 172.21.15.173:0/2886263134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc54920 0x5582fdc54d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a12800640 1 --2- 172.21.15.173:0/2886263134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc0af30 0x5582fdc0b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a0be00640 1 -- 172.21.15.173:0/2886263134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc0af30 msgr2=0x5582fdc0b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:45.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a0be00640 1 --2- 172.21.15.173:0/2886263134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc0af30 0x5582fdc0b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a0be00640 1 -- 172.21.15.173:0/2886263134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc54920 msgr2=0x5582fdc54d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:45.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.389+0000 7f4a0be00640 1 --2- 172.21.15.173:0/2886263134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc54920 0x5582fdc54d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a0be00640 1 -- 172.21.15.173:0/2886263134 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582fd9fbca0 con 0x5582fdc55240 2024-04-25T09:12:45.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a0be00640 1 --2- 172.21.15.173:0/2886263134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc55240 0x5582fdc0a9f0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f49fc052090 tx=0x7f49fc0563f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf211e0fd200fda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:45.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a02a00640 1 -- 172.21.15.173:0/2886263134 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc06d020 con 0x5582fdc55240 2024-04-25T09:12:45.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a02a00640 1 -- 172.21.15.173:0/2886263134 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc05e3d0 con 0x5582fdc55240 2024-04-25T09:12:45.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a02a00640 1 -- 172.21.15.173:0/2886263134 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc053f30 con 0x5582fdc55240 2024-04-25T09:12:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a1c50c000 1 -- 172.21.15.173:0/2886263134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc55240 msgr2=0x5582fdc0a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/2886263134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc55240 0x5582fdc0a9f0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f49fc052090 tx=0x7f49fc0563f0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a1c50c000 1 -- 172.21.15.173:0/2886263134 shutdown_connections 2024-04-25T09:12:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/2886263134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc0af30 0x5582fdc0b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/2886263134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc55240 0x5582fdc0a9f0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/2886263134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc54920 0x5582fdc54d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a1c50c000 1 -- 172.21.15.173:0/2886263134 >> 172.21.15.173:0/2886263134 conn(0x5582fdc112a0 msgr2=0x5582fdc092d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a1c50c000 1 -- 172.21.15.173:0/2886263134 shutdown_connections 2024-04-25T09:12:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a1c50c000 1 -- 172.21.15.173:0/2886263134 wait complete. 2024-04-25T09:12:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a1c50c000 1 -- start start 2024-04-25T09:12:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a1c50c000 1 Processor -- start 2024-04-25T09:12:45.380 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:12:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a1c50c000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc0af30 0x5582fdc5be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a1c50c000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc54920 0x5582fdc5c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a1c50c000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc55240 0x5582fdc0eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a1c50c000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fda14990 con 0x5582fdc0af30 2024-04-25T09:12:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a1c50c000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fda55e40 con 0x5582fdc55240 2024-04-25T09:12:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a1c50c000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582fd9e5900 con 0x5582fdc54920 2024-04-25T09:12:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a1c50c000 10 client.0 _ll_register_callbacks cb 0x5582fdb0d1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a11e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc0af30 0x5582fdc5be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a11e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc0af30 0x5582fdc5be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51116/0 (socket says 172.21.15.173:51116) 2024-04-25T09:12:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a11e00640 1 -- 172.21.15.173:0/3853671690 learned_addr learned my addr 172.21.15.173:0/3853671690 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a12800640 1 --2- 172.21.15.173:0/3853671690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc55240 0x5582fdc0eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a0be00640 1 --2- 172.21.15.173:0/3853671690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc54920 0x5582fdc5c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a11e00640 1 -- 172.21.15.173:0/3853671690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc54920 msgr2=0x5582fdc5c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a11e00640 1 --2- 172.21.15.173:0/3853671690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc54920 0x5582fdc5c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a11e00640 1 -- 172.21.15.173:0/3853671690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc55240 msgr2=0x5582fdc0eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a11e00640 1 --2- 172.21.15.173:0/3853671690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc55240 0x5582fdc0eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a11e00640 1 -- 172.21.15.173:0/3853671690 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5582fda12630 con 0x5582fdc0af30 2024-04-25T09:12:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a12800640 1 --2- 172.21.15.173:0/3853671690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc55240 0x5582fdc0eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f4a11e00640 1 --2- 172.21.15.173:0/3853671690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc0af30 0x5582fdc5be40 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f4a0401ca00 tx=0x7f4a0401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f078238efcf8304 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.393+0000 7f49f7400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:12:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f49f7400640 1 -- 172.21.15.173:0/3853671690 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a040b0040 con 0x5582fdc0af30 2024-04-25T09:12:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 1 -- 172.21.15.173:0/3853671690 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f49fc05e3d0 con 0x5582fdc0af30 2024-04-25T09:12:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f49f7400640 1 -- 172.21.15.173:0/3853671690 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4a040b6bd0 con 0x5582fdc0af30 2024-04-25T09:12:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f49f7400640 1 -- 172.21.15.173:0/3853671690 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a040cf050 con 0x5582fdc0af30 2024-04-25T09:12:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 10 client.9579 fetch_fsmap learned FSMap version 89 2024-04-25T09:12:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 1 -- 172.21.15.173:0/3853671690 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x5582fd9e23a0 con 0x5582fdc0af30 2024-04-25T09:12:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f49f7400640 1 -- 172.21.15.173:0/3853671690 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc05e3d0 con 0x5582fdc0af30 2024-04-25T09:12:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f49f7400640 1 -- 172.21.15.173:0/3853671690 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 89) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4a040d2020 con 0x5582fdc0af30 2024-04-25T09:12:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 10 client.9579 fetch_fsmap finished waiting for FSMap version 89 2024-04-25T09:12:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 10 client.9579 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:12:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 20 client.9579 populate_metadata read hostname 'smithi173' 2024-04-25T09:12:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/3853671690 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x5582fdc10160 0x5582fdc65ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 4 client.9579 mds_command: new command op to 9411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:12:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 1 -- 172.21.15.173:0/3853671690 --> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5582fd9f5a50 con 0x5582fdc10160 2024-04-25T09:12:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a0be00640 1 --2- 172.21.15.173:0/3853671690 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x5582fdc10160 0x5582fdc65ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a0be00640 1 --2- 172.21.15.173:0/3853671690 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x5582fdc10160 0x5582fdc65ea0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70fca3fa70f2520d server_cookie=58f34dda372cb280 in_seq=0 out_seq=0 2024-04-25T09:12:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f49f7400640 10 client.9579 ms_handle_connect on v2:172.21.15.173:6836/3627798672 2024-04-25T09:12:45.386 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:12:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f49f7400640 1 -- 172.21.15.173:0/3853671690 <== mds.0 v2:172.21.15.173:6836/3627798672 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5582fd9f5a50 con 0x5582fdc10160 2024-04-25T09:12:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f49f7400640 10 client.9579 handle_command_reply: tid=0 2024-04-25T09:12:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 1 client.9579 shutdown 2024-04-25T09:12:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 1 -- 172.21.15.173:0/3853671690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc0af30 msgr2=0x5582fdc5be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/3853671690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc0af30 0x5582fdc5be40 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f4a0401ca00 tx=0x7f4a0401ad60 comp rx=0 tx=0).stop 2024-04-25T09:12:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 1 -- 172.21.15.173:0/3853671690 shutdown_connections 2024-04-25T09:12:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/3853671690 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x5582fdc10160 0x5582fdc65ea0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/3853671690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc55240 0x5582fdc0eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/3853671690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc54920 0x5582fdc5c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/3853671690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc0af30 0x5582fdc5be40 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f49f7400640 0 client.9579 ms_handle_reset on v2:172.21.15.173:6836/3627798672 2024-04-25T09:12:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 1 -- 172.21.15.173:0/3853671690 >> 172.21.15.173:0/3853671690 conn(0x5582fdc112a0 msgr2=0x5582fdc099e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 1 -- 172.21.15.173:0/3853671690 shutdown_connections 2024-04-25T09:12:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 1 -- 172.21.15.173:0/3853671690 wait complete. 2024-04-25T09:12:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.397+0000 7f4a1c50c000 20 client.9579 trim_cache size 0 max 16384 2024-04-25T09:12:45.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.413+0000 7f4a1c50c000 1 Processor -- start 2024-04-25T09:12:45.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.413+0000 7f4a1c50c000 1 -- start start 2024-04-25T09:12:45.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.413+0000 7f4a1c50c000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc0af30 0x5582fdcafd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.413+0000 7f4a1c50c000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc54920 0x5582fdcb0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.413+0000 7f4a1c50c000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc55240 0x5582fdcb07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.413+0000 7f4a1c50c000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14202660 con 0x5582fdc54920 2024-04-25T09:12:45.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.413+0000 7f4a1c50c000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14152310 con 0x5582fdc55240 2024-04-25T09:12:45.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.413+0000 7f4a1c50c000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14202230 con 0x5582fdc0af30 2024-04-25T09:12:45.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.413+0000 7f4a0be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc54920 0x5582fdcb0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.413+0000 7f4a0be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc54920 0x5582fdcb0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51122/0 (socket says 172.21.15.173:51122) 2024-04-25T09:12:45.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.413+0000 7f4a0be00640 1 -- 172.21.15.173:0/1957400485 learned_addr learned my addr 172.21.15.173:0/1957400485 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:45.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.413+0000 7f4a11e00640 1 --2- 172.21.15.173:0/1957400485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc0af30 0x5582fdcafd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.413+0000 7f4a12800640 1 --2- 172.21.15.173:0/1957400485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc55240 0x5582fdcb07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.413+0000 7f4a0be00640 1 -- 172.21.15.173:0/1957400485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc0af30 msgr2=0x5582fdcafd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:45.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.413+0000 7f4a0be00640 1 --2- 172.21.15.173:0/1957400485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc0af30 0x5582fdcafd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.413+0000 7f4a0be00640 1 -- 172.21.15.173:0/1957400485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc55240 msgr2=0x5582fdcb07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:45.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.413+0000 7f4a0be00640 1 --2- 172.21.15.173:0/1957400485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc55240 0x5582fdcb07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a0be00640 1 -- 172.21.15.173:0/1957400485 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582fdc55070 con 0x5582fdc54920 2024-04-25T09:12:45.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a0be00640 1 --2- 172.21.15.173:0/1957400485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc54920 0x5582fdcb0260 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0564e0 tx=0x7f49fc020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b0e07ba8016448 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:45.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a02000640 1 -- 172.21.15.173:0/1957400485 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc06d040 con 0x5582fdc54920 2024-04-25T09:12:45.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a02000640 1 -- 172.21.15.173:0/1957400485 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc05e3d0 con 0x5582fdc54920 2024-04-25T09:12:45.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a02000640 1 -- 172.21.15.173:0/1957400485 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc053f30 con 0x5582fdc54920 2024-04-25T09:12:45.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a1c50c000 1 -- 172.21.15.173:0/1957400485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc54920 msgr2=0x5582fdcb0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:45.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/1957400485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc54920 0x5582fdcb0260 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0564e0 tx=0x7f49fc020000 comp rx=0 tx=0).stop 2024-04-25T09:12:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a1c50c000 1 -- 172.21.15.173:0/1957400485 shutdown_connections 2024-04-25T09:12:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/1957400485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc55240 0x5582fdcb07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/1957400485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc54920 0x5582fdcb0260 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/1957400485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc0af30 0x5582fdcafd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a1c50c000 1 -- 172.21.15.173:0/1957400485 >> 172.21.15.173:0/1957400485 conn(0x5582fdc112a0 msgr2=0x5582fdc0e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a1c50c000 1 -- 172.21.15.173:0/1957400485 shutdown_connections 2024-04-25T09:12:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a1c50c000 1 -- 172.21.15.173:0/1957400485 wait complete. 2024-04-25T09:12:45.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a1c50c000 1 -- start start 2024-04-25T09:12:45.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a1c50c000 1 Processor -- start 2024-04-25T09:12:45.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a1c50c000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc0af30 0x5582fdc9bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a1c50c000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc55240 0x5582fdc9c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a1c50c000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc9ce60 0x5582fdc9d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a1c50c000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fda5e3d0 con 0x5582fdc9ce60 2024-04-25T09:12:45.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a1c50c000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fdb15d50 con 0x5582fdc55240 2024-04-25T09:12:45.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a1c50c000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582fd9f4980 con 0x5582fdc0af30 2024-04-25T09:12:45.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a1c50c000 10 client.0 _ll_register_callbacks cb 0x7f49fc055a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:45.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a12800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc9ce60 0x5582fdc9d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a12800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc9ce60 0x5582fdc9d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51130/0 (socket says 172.21.15.173:51130) 2024-04-25T09:12:45.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a12800640 1 -- 172.21.15.173:0/4007898861 learned_addr learned my addr 172.21.15.173:0/4007898861 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:45.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a0be00640 1 --2- 172.21.15.173:0/4007898861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc55240 0x5582fdc9c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a11e00640 1 --2- 172.21.15.173:0/4007898861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc0af30 0x5582fdc9bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a12800640 1 -- 172.21.15.173:0/4007898861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc0af30 msgr2=0x5582fdc9bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:45.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a12800640 1 --2- 172.21.15.173:0/4007898861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc0af30 0x5582fdc9bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a12800640 1 -- 172.21.15.173:0/4007898861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc55240 msgr2=0x5582fdc9c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:45.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a12800640 1 --2- 172.21.15.173:0/4007898861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc55240 0x5582fdc9c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a12800640 1 -- 172.21.15.173:0/4007898861 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5582fdadb600 con 0x5582fdc9ce60 2024-04-25T09:12:45.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.417+0000 7f4a11e00640 1 --2- 172.21.15.173:0/4007898861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc0af30 0x5582fdc9bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:45.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a12800640 1 --2- 172.21.15.173:0/4007898861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc9ce60 0x5582fdc9d240 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c005740 tx=0x7f4a0c001c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb4fe0e485651a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:45.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f49f7400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:12:45.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f49f7400640 1 -- 172.21.15.173:0/4007898861 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c017640 con 0x5582fdc9ce60 2024-04-25T09:12:45.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 1 -- 172.21.15.173:0/4007898861 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f49fc05e3d0 con 0x5582fdc9ce60 2024-04-25T09:12:45.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f49f7400640 1 -- 172.21.15.173:0/4007898861 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4a0c0177e0 con 0x5582fdc9ce60 2024-04-25T09:12:45.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f49f7400640 1 -- 172.21.15.173:0/4007898861 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a0c026050 con 0x5582fdc9ce60 2024-04-25T09:12:45.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 10 client.9585 fetch_fsmap learned FSMap version 89 2024-04-25T09:12:45.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 1 -- 172.21.15.173:0/4007898861 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x5582fd9ee9b0 con 0x5582fdc9ce60 2024-04-25T09:12:45.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f49f7400640 1 -- 172.21.15.173:0/4007898861 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc05e3d0 con 0x5582fdc9ce60 2024-04-25T09:12:45.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f49f7400640 1 -- 172.21.15.173:0/4007898861 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 89) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4a0c029020 con 0x5582fdc9ce60 2024-04-25T09:12:45.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 10 client.9585 fetch_fsmap finished waiting for FSMap version 89 2024-04-25T09:12:45.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 10 client.9585 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:12:45.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 20 client.9585 populate_metadata read hostname 'smithi173' 2024-04-25T09:12:45.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/4007898861 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x5582fdc9d780 0x5582fdc9db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 4 client.9585 mds_command: new command op to 9411 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:12:45.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 1 -- 172.21.15.173:0/4007898861 --> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5582fda672e0 con 0x5582fdc9d780 2024-04-25T09:12:45.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a11e00640 1 --2- 172.21.15.173:0/4007898861 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x5582fdc9d780 0x5582fdc9db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a11e00640 1 --2- 172.21.15.173:0/4007898861 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x5582fdc9d780 0x5582fdc9db60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d67225b6667801 server_cookie=3a62c443eafc46d8 in_seq=0 out_seq=0 2024-04-25T09:12:45.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f49f7400640 10 client.9585 ms_handle_connect on v2:172.21.15.173:6836/3627798672 2024-04-25T09:12:45.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f49f7400640 1 -- 172.21.15.173:0/4007898861 <== mds.0 v2:172.21.15.173:6836/3627798672 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5582fda672e0 con 0x5582fdc9d780 2024-04-25T09:12:45.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f49f7400640 10 client.9585 handle_command_reply: tid=0 2024-04-25T09:12:45.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 1 client.9585 shutdown 2024-04-25T09:12:45.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 1 -- 172.21.15.173:0/4007898861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc9ce60 msgr2=0x5582fdc9d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:45.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/4007898861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc9ce60 0x5582fdc9d240 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c005740 tx=0x7f4a0c001c20 comp rx=0 tx=0).stop 2024-04-25T09:12:45.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 1 -- 172.21.15.173:0/4007898861 shutdown_connections 2024-04-25T09:12:45.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/4007898861 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x5582fdc9d780 0x5582fdc9db60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/4007898861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5582fdc9ce60 0x5582fdc9d240 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/4007898861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5582fdc55240 0x5582fdc9c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f49f7400640 0 client.9585 ms_handle_reset on v2:172.21.15.173:6836/3627798672 2024-04-25T09:12:45.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 1 --2- 172.21.15.173:0/4007898861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5582fdc0af30 0x5582fdc9bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 1 -- 172.21.15.173:0/4007898861 >> 172.21.15.173:0/4007898861 conn(0x5582fdc112a0 msgr2=0x5582fdc5c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:45.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 1 -- 172.21.15.173:0/4007898861 shutdown_connections 2024-04-25T09:12:45.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 1 -- 172.21.15.173:0/4007898861 wait complete. 2024-04-25T09:12:45.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a1c50c000 20 client.9585 trim_cache size 0 max 16384 2024-04-25T09:12:45.418 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:12:45.418 INFO:teuthology.orchestra.run.smithi173.stdout: "cluster_fsid": "ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6", 2024-04-25T09:12:45.418 INFO:teuthology.orchestra.run.smithi173.stdout: "whoami": 0, 2024-04-25T09:12:45.418 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 9411, 2024-04-25T09:12:45.418 INFO:teuthology.orchestra.run.smithi173.stdout: "want_state": "up:active", 2024-04-25T09:12:45.418 INFO:teuthology.orchestra.run.smithi173.stdout: "state": "up:active", 2024-04-25T09:12:45.419 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs", 2024-04-25T09:12:45.419 INFO:teuthology.orchestra.run.smithi173.stdout: "rank_uptime": 10.312183426000001, 2024-04-25T09:12:45.419 INFO:teuthology.orchestra.run.smithi173.stdout: "mdsmap_epoch": 89, 2024-04-25T09:12:45.419 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch": 133, 2024-04-25T09:12:45.419 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch_barrier": 133, 2024-04-25T09:12:45.419 INFO:teuthology.orchestra.run.smithi173.stdout: "uptime": 15.178787604 2024-04-25T09:12:45.420 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:12:45.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a13200640 1 -- 172.21.15.173:0/1738826987 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f49f0066f90 msgr2=0x7f49f0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:45.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a13200640 1 --2- 172.21.15.173:0/1738826987 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f49f0066f90 0x7f49f0069450 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4a040ad000 tx=0x7f4a04008040 comp rx=0 tx=0).stop 2024-04-25T09:12:45.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a13200640 1 -- 172.21.15.173:0/1738826987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a1406f650 msgr2=0x7f4a1414ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:45.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a13200640 1 --2- 172.21.15.173:0/1738826987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a1406f650 0x7f4a1414ec70 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00d5f0 tx=0x7f49fc00dab0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a13200640 1 -- 172.21.15.173:0/1738826987 shutdown_connections 2024-04-25T09:12:45.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a13200640 1 --2- 172.21.15.173:0/1738826987 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f49f0066f90 0x7f49f0069450 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a13200640 1 --2- 172.21.15.173:0/1738826987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a1415a520 0x7f4a1415da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a13200640 1 --2- 172.21.15.173:0/1738826987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a1406f650 0x7f4a1414ec70 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a13200640 1 --2- 172.21.15.173:0/1738826987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a1406c1e0 0x7f4a14158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a13200640 1 -- 172.21.15.173:0/1738826987 >> 172.21.15.173:0/1738826987 conn(0x7f4a14071b80 msgr2=0x7f4a1415bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:45.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a13200640 1 -- 172.21.15.173:0/1738826987 shutdown_connections 2024-04-25T09:12:45.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.421+0000 7f4a13200640 1 -- 172.21.15.173:0/1738826987 wait complete. 2024-04-25T09:12:45.426 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:12:45.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.625+0000 7fd5b0e00640 1 Processor -- start 2024-04-25T09:12:45.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.625+0000 7fd5b0e00640 1 -- start start 2024-04-25T09:12:45.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.625+0000 7fd5b0e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5ac0b3e70 0x7fd5ac0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.625+0000 7fd5b0e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd5ac0aefa0 0x7fd5ac0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.625+0000 7fd5b0e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5ac0b4790 con 0x7fd5ac15edd0 2024-04-25T09:12:45.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.625+0000 7fd5b0e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ac06dd50 con 0x7fd5ac0aefa0 2024-04-25T09:12:45.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.625+0000 7fd5b0e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac15f320 con 0x7fd5ac0b3e70 2024-04-25T09:12:45.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.625+0000 7fd5a1400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd5ac0aefa0 0x7fd5ac0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.625+0000 7fd5aa800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd5ac15edd0 0x7fd5ac0b2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34262/0 (socket says 172.21.15.173:34262) 2024-04-25T09:12:45.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.625+0000 7fd5aa800640 1 -- 172.21.15.173:0/2382756610 learned_addr learned my addr 172.21.15.173:0/2382756610 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:45.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.629+0000 7fd5a1400640 1 -- 172.21.15.173:0/2382756610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5ac0b3e70 msgr2=0x7fd5ac0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:45.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.629+0000 7fd5a1400640 1 --2- 172.21.15.173:0/2382756610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5ac0b3e70 0x7fd5ac0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.629+0000 7fd5a1400640 1 -- 172.21.15.173:0/2382756610 >> v1:172.21.15.173:6789/0 conn(0x7fd5ac15edd0 legacy=0x7fd5ac0b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:45.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.629+0000 7fd5a1400640 1 -- 172.21.15.173:0/2382756610 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac06d420 con 0x7fd5ac0aefa0 2024-04-25T09:12:45.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.629+0000 7fd5a1400640 1 --2- 172.21.15.173:0/2382756610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5ac0aefa0 0x7fd5ac0b2770 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fd5940097c0 tx=0x7fd59401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74181001df2765e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:45.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.629+0000 7fd5a9400640 1 -- 172.21.15.173:0/2382756610 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5940aa5f0 con 0x7fd5ac0aefa0 2024-04-25T09:12:45.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.629+0000 7fd5a9400640 1 -- 172.21.15.173:0/2382756610 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5940af070 con 0x7fd5ac0aefa0 2024-04-25T09:12:45.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.629+0000 7fd5a9400640 1 -- 172.21.15.173:0/2382756610 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5940aa9b0 con 0x7fd5ac0aefa0 2024-04-25T09:12:45.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.629+0000 7fd5b0e00640 1 -- 172.21.15.173:0/2382756610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5ac0aefa0 msgr2=0x7fd5ac0b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:45.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.629+0000 7fd5b0e00640 1 --2- 172.21.15.173:0/2382756610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5ac0aefa0 0x7fd5ac0b2770 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fd5940097c0 tx=0x7fd59401c470 comp rx=0 tx=0).stop 2024-04-25T09:12:45.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5b0e00640 1 -- 172.21.15.173:0/2382756610 shutdown_connections 2024-04-25T09:12:45.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5b0e00640 1 --2- 172.21.15.173:0/2382756610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5ac0aefa0 0x7fd5ac0b2770 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5b0e00640 1 --2- 172.21.15.173:0/2382756610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5ac0b3e70 0x7fd5ac0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5b0e00640 1 -- 172.21.15.173:0/2382756610 >> 172.21.15.173:0/2382756610 conn(0x7fd5ac06ac90 msgr2=0x7fd5ac06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:45.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5b0e00640 1 -- 172.21.15.173:0/2382756610 shutdown_connections 2024-04-25T09:12:45.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5b0e00640 1 -- 172.21.15.173:0/2382756610 wait complete. 2024-04-25T09:12:45.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5b0e00640 1 Processor -- start 2024-04-25T09:12:45.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5b0e00640 1 -- start start 2024-04-25T09:12:45.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5b0e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5ac0aefa0 0x7fd5ac0b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5b0e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5ac0b3e70 0x7fd5ac143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5b0e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5ac15edd0 0x7fd5ac155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5b0e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac06e1e0 con 0x7fd5ac15edd0 2024-04-25T09:12:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5b0e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac15aba0 con 0x7fd5ac0b3e70 2024-04-25T09:12:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5b0e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac06e360 con 0x7fd5ac0aefa0 2024-04-25T09:12:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5aa800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5ac15edd0 0x7fd5ac155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5aa800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5ac15edd0 0x7fd5ac155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51150/0 (socket says 172.21.15.173:51150) 2024-04-25T09:12:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5aa800640 1 -- 172.21.15.173:0/3602007184 learned_addr learned my addr 172.21.15.173:0/3602007184 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5a9e00640 1 --2- 172.21.15.173:0/3602007184 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5ac0aefa0 0x7fd5ac0b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5a1400640 1 --2- 172.21.15.173:0/3602007184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5ac0b3e70 0x7fd5ac143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5aa800640 1 -- 172.21.15.173:0/3602007184 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5ac0aefa0 msgr2=0x7fd5ac0b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5aa800640 1 --2- 172.21.15.173:0/3602007184 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5ac0aefa0 0x7fd5ac0b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5aa800640 1 -- 172.21.15.173:0/3602007184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5ac0b3e70 msgr2=0x7fd5ac143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5aa800640 1 --2- 172.21.15.173:0/3602007184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5ac0b3e70 0x7fd5ac143fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5aa800640 1 -- 172.21.15.173:0/3602007184 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac15ccb0 con 0x7fd5ac15edd0 2024-04-25T09:12:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5aa800640 1 --2- 172.21.15.173:0/3602007184 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5ac15edd0 0x7fd5ac155350 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fd5a400cbc0 tx=0x7fd5a400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.633+0000 7fd5a2a00640 1 -- 172.21.15.173:0/3602007184 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4017070 con 0x7fd5ac15edd0 2024-04-25T09:12:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.637+0000 7fd5a2a00640 1 -- 172.21.15.173:0/3602007184 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a400ad40 con 0x7fd5ac15edd0 2024-04-25T09:12:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.637+0000 7fd5b0e00640 1 -- 172.21.15.173:0/3602007184 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ac0b2b20 con 0x7fd5ac15edd0 2024-04-25T09:12:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.637+0000 7fd5a2a00640 1 -- 172.21.15.173:0/3602007184 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4012600 con 0x7fd5ac15edd0 2024-04-25T09:12:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.637+0000 7fd5b0e00640 1 -- 172.21.15.173:0/3602007184 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ac15c1d0 con 0x7fd5ac15edd0 2024-04-25T09:12:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.637+0000 7fd5b0e00640 1 -- 172.21.15.173:0/3602007184 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ac073a40 con 0x7fd5ac15edd0 2024-04-25T09:12:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.637+0000 7fd5a2a00640 1 -- 172.21.15.173:0/3602007184 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd5a401a070 con 0x7fd5ac15edd0 2024-04-25T09:12:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.637+0000 7fd5a2a00640 1 --2- 172.21.15.173:0/3602007184 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd588066f60 0x7fd588069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:45.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.637+0000 7fd5a2a00640 1 -- 172.21.15.173:0/3602007184 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd5a4084f30 con 0x7fd5ac15edd0 2024-04-25T09:12:45.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.637+0000 7fd5a9e00640 1 --2- 172.21.15.173:0/3602007184 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd588066f60 0x7fd588069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:45.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.637+0000 7fd5a9e00640 1 --2- 172.21.15.173:0/3602007184 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd588066f60 0x7fd588069420 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd59c006fd0 tx=0x7fd59c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:45.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.641+0000 7fd5a2a00640 1 -- 172.21.15.173:0/3602007184 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd5a4055630 con 0x7fd5ac15edd0 2024-04-25T09:12:45.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.833+0000 7fd5b0e00640 1 -- 172.21.15.173:0/3602007184 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd5ac06f1c0 con 0x7fd5ac15edd0 2024-04-25T09:12:45.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.833+0000 7fd5a2a00640 1 -- 172.21.15.173:0/3602007184 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v89) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd5a40596d0 con 0x7fd5ac15edd0 2024-04-25T09:12:45.817 INFO:teuthology.orchestra.run.smithi173.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:12:45.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.833+0000 7fd5b0e00640 1 -- 172.21.15.173:0/3602007184 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd588066f60 msgr2=0x7fd588069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:45.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.833+0000 7fd5b0e00640 1 --2- 172.21.15.173:0/3602007184 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd588066f60 0x7fd588069420 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd59c006fd0 tx=0x7fd59c008040 comp rx=0 tx=0).stop 2024-04-25T09:12:45.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.833+0000 7fd5b0e00640 1 -- 172.21.15.173:0/3602007184 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5ac15edd0 msgr2=0x7fd5ac155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:45.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.833+0000 7fd5b0e00640 1 --2- 172.21.15.173:0/3602007184 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5ac15edd0 0x7fd5ac155350 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fd5a400cbc0 tx=0x7fd5a400a430 comp rx=0 tx=0).stop 2024-04-25T09:12:45.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.833+0000 7fd5b0e00640 1 -- 172.21.15.173:0/3602007184 shutdown_connections 2024-04-25T09:12:45.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.833+0000 7fd5b0e00640 1 --2- 172.21.15.173:0/3602007184 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd588066f60 0x7fd588069420 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.833+0000 7fd5b0e00640 1 --2- 172.21.15.173:0/3602007184 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5ac15edd0 0x7fd5ac155350 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.833+0000 7fd5b0e00640 1 --2- 172.21.15.173:0/3602007184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5ac0b3e70 0x7fd5ac143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.833+0000 7fd5b0e00640 1 --2- 172.21.15.173:0/3602007184 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5ac0aefa0 0x7fd5ac0b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:45.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.833+0000 7fd5b0e00640 1 -- 172.21.15.173:0/3602007184 >> 172.21.15.173:0/3602007184 conn(0x7fd5ac06ac90 msgr2=0x7fd5ac0af490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:45.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.833+0000 7fd5b0e00640 1 -- 172.21.15.173:0/3602007184 shutdown_connections 2024-04-25T09:12:45.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:45.833+0000 7fd5b0e00640 1 -- 172.21.15.173:0/3602007184 wait complete. 2024-04-25T09:12:45.839 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:12:45.839 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:12:45.839 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2024-04-25T09:12:45.839 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:12:45.839 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:45.839 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:12:45.839 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:12:45.839 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:12:45.839 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:12:45.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:45.840 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2024-04-25T09:12:45.848 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:12:45.848 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:12:45.848 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:12:45.848 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:45.849 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-25T09:12:45.849 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:45.849 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:12:45.849 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:12:45.849 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2024-04-25T09:12:45.849 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:12:45.849 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:12:45.849 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2024-04-25T09:12:45.849 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:12:45.849 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:12:45.849 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:12:45.849 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:12:45.849 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:12:45.849 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 41852sec preferred_lft 41852sec 2024-04-25T09:12:45.849 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2024-04-25T09:12:45.850 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:45.850 INFO:teuthology.orchestra.run.smithi173.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:12:45.850 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 02:42:00:0e:60:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:12:45.850 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:12:45.850 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:45.850 INFO:teuthology.orchestra.run.smithi173.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:12:45.850 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:12:45.850 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:12:45.850 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:45.850 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:12:45.850 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:45.850 INFO:teuthology.orchestra.run.smithi173.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:12:45.850 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:12:45.850 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:12:45.851 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:45.851 INFO:teuthology.orchestra.run.smithi173.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:12:45.851 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:12:45.851 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:12:45.851 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:45.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:45.852 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:12:45.909 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-04-25T09:12:45.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:45.912 DEBUG:teuthology.orchestra.run.smithi173:> route 2024-04-25T09:12:45.964 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2024-04-25T09:12:45.964 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:12:45.965 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:12:45.965 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:12:45.965 INFO:teuthology.orchestra.run.smithi173.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:12:45.965 INFO:teuthology.orchestra.run.smithi173.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:12:45.965 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:12:45.965 INFO:teuthology.orchestra.run.smithi173.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:12:45.965 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:12:45.965 INFO:teuthology.orchestra.run.smithi173.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:12:45.965 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:12:45.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:45.965 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:12:45.965 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:45.965 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:12:45.966 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:12:45.966 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:12:45.966 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:46.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:46.060 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-25T09:12:46.069 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:12:46.070 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:12:46.070 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:12:46.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:46.070 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2024-04-25T09:12:46.131 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:12:46.131 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:46.180 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:12:46.180 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:12:46.180 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:46.231 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:12:46.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:46.232 DEBUG:teuthology.orchestra.run.smithi173:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:12:46.320 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:12:46.320 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:12:46.320 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:12:46.335 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:12:46.335 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:12:46.335 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:12:46.335 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:12:46.336 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:12:46.344 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:12:46.344 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:12:46.344 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:12:46.344 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:12:46.344 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:12:46.344 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-04-25T09:12:46.344 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-04-25T09:12:46.344 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6" will pass to kernel 2024-04-25T09:12:46.348 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:12:46.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:46.348 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:46.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:46.368 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:12:46.423 INFO:teuthology.orchestra.run.smithi173.stdout:client9597 2024-04-25T09:12:46.423 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:12:46.424 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:46.473 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:46.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f4716c00640 1 Processor -- start 2024-04-25T09:12:46.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f4716c00640 1 -- start start 2024-04-25T09:12:46.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f4716c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f47100b2ca0 0x7f47100b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:46.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f4716c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f471015a180 0x7f47100ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:46.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f4716c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47100cf6a0 0x7f4710071320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:46.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f4716c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47100af230 con 0x7f47100b2ca0 2024-04-25T09:12:46.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f4716c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f471006e860 con 0x7f471015a180 2024-04-25T09:12:46.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f4716c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471006eb20 con 0x7f47100cf6a0 2024-04-25T09:12:46.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f470fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f47100b2ca0 0x7f47100b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:46.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f470fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f47100b2ca0 0x7f47100b40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51162/0 (socket says 172.21.15.173:51162) 2024-04-25T09:12:46.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f470fe00640 1 -- 172.21.15.173:0/1669304115 learned_addr learned my addr 172.21.15.173:0/1669304115 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:46.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f4714c00640 1 --2- 172.21.15.173:0/1669304115 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47100cf6a0 0x7f4710071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:46.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f470fe00640 1 -- 172.21.15.173:0/1669304115 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47100cf6a0 msgr2=0x7f4710071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:46.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f470fe00640 1 --2- 172.21.15.173:0/1669304115 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47100cf6a0 0x7f4710071320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:46.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f470fe00640 1 -- 172.21.15.173:0/1669304115 >> v2:172.21.15.194:3300/0 conn(0x7f471015a180 msgr2=0x7f47100ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:46.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f4707400640 1 --2- 172.21.15.173:0/1669304115 >> v2:172.21.15.194:3300/0 conn(0x7f471015a180 0x7f47100ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:46.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f470fe00640 1 --2- 172.21.15.173:0/1669304115 >> v2:172.21.15.194:3300/0 conn(0x7f471015a180 0x7f47100ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:46.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f470fe00640 1 -- 172.21.15.173:0/1669304115 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47100aebe0 con 0x7f47100b2ca0 2024-04-25T09:12:46.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f4714c00640 1 --2- 172.21.15.173:0/1669304115 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47100cf6a0 0x7f4710071320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:46.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.665+0000 7f4707400640 1 --2- 172.21.15.173:0/1669304115 >> v2:172.21.15.194:3300/0 conn(0x7f471015a180 0x7f47100ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:46.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.669+0000 7f470fe00640 1 --2- 172.21.15.173:0/1669304115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47100b2ca0 0x7f47100b40e0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f47100d0090 tx=0x7f46f801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd1d833144c4246 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:46.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.669+0000 7f470f400640 1 -- 172.21.15.173:0/1669304115 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f80ab5f0 con 0x7f47100b2ca0 2024-04-25T09:12:46.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.669+0000 7f470f400640 1 -- 172.21.15.173:0/1669304115 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f80b0070 con 0x7f47100b2ca0 2024-04-25T09:12:46.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.669+0000 7f470f400640 1 -- 172.21.15.173:0/1669304115 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f80ab9b0 con 0x7f47100b2ca0 2024-04-25T09:12:46.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.669+0000 7f4716c00640 1 -- 172.21.15.173:0/1669304115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47100b2ca0 msgr2=0x7f47100b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:46.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.669+0000 7f4716c00640 1 --2- 172.21.15.173:0/1669304115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47100b2ca0 0x7f47100b40e0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f47100d0090 tx=0x7f46f801c520 comp rx=0 tx=0).stop 2024-04-25T09:12:46.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.669+0000 7f4716c00640 1 -- 172.21.15.173:0/1669304115 shutdown_connections 2024-04-25T09:12:46.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.669+0000 7f4716c00640 1 --2- 172.21.15.173:0/1669304115 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47100cf6a0 0x7f4710071320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:46.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.669+0000 7f4716c00640 1 --2- 172.21.15.173:0/1669304115 >> v2:172.21.15.194:3300/0 conn(0x7f471015a180 0x7f47100ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:46.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.669+0000 7f4716c00640 1 --2- 172.21.15.173:0/1669304115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47100b2ca0 0x7f47100b40e0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:46.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.669+0000 7f4716c00640 1 -- 172.21.15.173:0/1669304115 >> 172.21.15.173:0/1669304115 conn(0x7f471006ac90 msgr2=0x7f471006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:46.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.669+0000 7f4716c00640 1 -- 172.21.15.173:0/1669304115 shutdown_connections 2024-04-25T09:12:46.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.669+0000 7f4716c00640 1 -- 172.21.15.173:0/1669304115 wait complete. 2024-04-25T09:12:46.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4716c00640 1 Processor -- start 2024-04-25T09:12:46.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4716c00640 1 -- start start 2024-04-25T09:12:46.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4716c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47100b2ca0 0x7f471014deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:46.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4716c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47100cf6a0 0x7f4710146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:46.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4716c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f471015a180 0x7f47100b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:46.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4716c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471006e240 con 0x7f471015a180 2024-04-25T09:12:46.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4716c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471006e0c0 con 0x7f47100cf6a0 2024-04-25T09:12:46.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4716c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471006e3c0 con 0x7f47100b2ca0 2024-04-25T09:12:46.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4714c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f471015a180 0x7f47100b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:46.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4714c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f471015a180 0x7f47100b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51178/0 (socket says 172.21.15.173:51178) 2024-04-25T09:12:46.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4714c00640 1 -- 172.21.15.173:0/262933315 learned_addr learned my addr 172.21.15.173:0/262933315 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:46.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4707400640 1 --2- 172.21.15.173:0/262933315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47100cf6a0 0x7f4710146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:46.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f470fe00640 1 --2- 172.21.15.173:0/262933315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47100b2ca0 0x7f471014deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:46.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4714c00640 1 -- 172.21.15.173:0/262933315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47100b2ca0 msgr2=0x7f471014deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:46.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4714c00640 1 --2- 172.21.15.173:0/262933315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47100b2ca0 0x7f471014deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:46.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4714c00640 1 -- 172.21.15.173:0/262933315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47100cf6a0 msgr2=0x7f4710146640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:46.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4714c00640 1 --2- 172.21.15.173:0/262933315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47100cf6a0 0x7f4710146640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:46.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4714c00640 1 -- 172.21.15.173:0/262933315 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471014e5b0 con 0x7f471015a180 2024-04-25T09:12:46.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4714c00640 1 --2- 172.21.15.173:0/262933315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f471015a180 0x7f47100b0400 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f470800cd40 tx=0x7f470800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:46.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f470cc00640 1 -- 172.21.15.173:0/262933315 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470800f680 con 0x7f471015a180 2024-04-25T09:12:46.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f470cc00640 1 -- 172.21.15.173:0/262933315 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470800f840 con 0x7f471015a180 2024-04-25T09:12:46.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f470cc00640 1 -- 172.21.15.173:0/262933315 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470800fc30 con 0x7f471015a180 2024-04-25T09:12:46.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4716c00640 1 -- 172.21.15.173:0/262933315 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47100cdcb0 con 0x7f471015a180 2024-04-25T09:12:46.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.673+0000 7f4716c00640 1 -- 172.21.15.173:0/262933315 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47100ce270 con 0x7f471015a180 2024-04-25T09:12:46.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.677+0000 7f4716c00640 1 -- 172.21.15.173:0/262933315 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471014e780 con 0x7f471015a180 2024-04-25T09:12:46.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.677+0000 7f470cc00640 1 -- 172.21.15.173:0/262933315 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f470800e3e0 con 0x7f471015a180 2024-04-25T09:12:46.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.677+0000 7f470cc00640 1 --2- 172.21.15.173:0/262933315 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f46ec066f60 0x7f46ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:46.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.677+0000 7f470cc00640 1 -- 172.21.15.173:0/262933315 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4708085d50 con 0x7f471015a180 2024-04-25T09:12:46.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.677+0000 7f470fe00640 1 --2- 172.21.15.173:0/262933315 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f46ec066f60 0x7f46ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:46.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.677+0000 7f470fe00640 1 --2- 172.21.15.173:0/262933315 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f46ec066f60 0x7f46ec069420 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f46f80af000 tx=0x7f46f80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:46.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.681+0000 7f470cc00640 1 -- 172.21.15.173:0/262933315 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4708014030 con 0x7f471015a180 2024-04-25T09:12:46.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.865+0000 7f4716c00640 1 -- 172.21.15.173:0/262933315 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47100ce470 con 0x7f471015a180 2024-04-25T09:12:46.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.869+0000 7f470cc00640 1 -- 172.21.15.173:0/262933315 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f4708056570 con 0x7f471015a180 2024-04-25T09:12:46.853 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:46.853 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":89,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":9408,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1841246276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1841246276},{"type":"v1","addr":"172.21.15.173:6835","nonce":1841246276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:34.472510+0000","modified":"2024-04-25T09:12:37.491581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9411":{"gid":9411,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3627798672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3627798672},{"type":"v1","addr":"172.21.15.173:6837","nonce":3627798672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:12:46.853 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 89 2024-04-25T09:12:46.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.869+0000 7f4716c00640 1 -- 172.21.15.173:0/262933315 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f46ec066f60 msgr2=0x7f46ec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:46.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.869+0000 7f4716c00640 1 --2- 172.21.15.173:0/262933315 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f46ec066f60 0x7f46ec069420 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f46f80af000 tx=0x7f46f80a7000 comp rx=0 tx=0).stop 2024-04-25T09:12:46.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.869+0000 7f4716c00640 1 -- 172.21.15.173:0/262933315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f471015a180 msgr2=0x7f47100b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:46.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.869+0000 7f4716c00640 1 --2- 172.21.15.173:0/262933315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f471015a180 0x7f47100b0400 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f470800cd40 tx=0x7f470800a650 comp rx=0 tx=0).stop 2024-04-25T09:12:46.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.869+0000 7f4716c00640 1 -- 172.21.15.173:0/262933315 shutdown_connections 2024-04-25T09:12:46.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.869+0000 7f4716c00640 1 --2- 172.21.15.173:0/262933315 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f46ec066f60 0x7f46ec069420 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:46.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.869+0000 7f4716c00640 1 --2- 172.21.15.173:0/262933315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f471015a180 0x7f47100b0400 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:46.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.869+0000 7f4716c00640 1 --2- 172.21.15.173:0/262933315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47100cf6a0 0x7f4710146640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:46.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.869+0000 7f4716c00640 1 --2- 172.21.15.173:0/262933315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47100b2ca0 0x7f471014deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:46.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.869+0000 7f4716c00640 1 -- 172.21.15.173:0/262933315 >> 172.21.15.173:0/262933315 conn(0x7f471006ac90 msgr2=0x7f4710153c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:46.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.869+0000 7f4716c00640 1 -- 172.21.15.173:0/262933315 shutdown_connections 2024-04-25T09:12:46.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:46.869+0000 7f4716c00640 1 -- 172.21.15.173:0/262933315 wait complete. 2024-04-25T09:12:46.875 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:47.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.025+0000 7fa51a200640 1 Processor -- start 2024-04-25T09:12:47.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.025+0000 7fa51a200640 1 -- start start 2024-04-25T09:12:47.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.025+0000 7fa51a200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa514145250 0x7fa51415c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:47.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.025+0000 7fa51a200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51415cec0 con 0x7fa5140cc8b0 2024-04-25T09:12:47.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.025+0000 7fa51a200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51406e7c0 con 0x7fa5140ccd30 2024-04-25T09:12:47.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.025+0000 7fa51a200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa514072140 con 0x7fa514145250 2024-04-25T09:12:47.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.025+0000 7fa50aa00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa5140cc8b0 0x7fa514071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:34274/0 (socket says 172.21.15.173:34274) 2024-04-25T09:12:47.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.025+0000 7fa513400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa514145250 0x7fa51415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:47.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.025+0000 7fa50aa00640 1 -- 172.21.15.173:0/1427743776 learned_addr learned my addr 172.21.15.173:0/1427743776 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:12:47.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.025+0000 7fa513400640 1 -- 172.21.15.173:0/1427743776 >> v1:172.21.15.194:6789/0 conn(0x7fa5140ccd30 legacy=0x7fa514071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:47.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.025+0000 7fa513400640 1 -- 172.21.15.173:0/1427743776 >> v1:172.21.15.173:6789/0 conn(0x7fa5140cc8b0 legacy=0x7fa514071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:47.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.025+0000 7fa513400640 1 -- 172.21.15.173:0/1427743776 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51406d720 con 0x7fa514145250 2024-04-25T09:12:47.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.029+0000 7fa513400640 1 --2- 172.21.15.173:0/1427743776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa514145250 0x7fa51415c980 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fa5040097c0 tx=0x7fa50401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb230f63093bc99 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:47.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.029+0000 7fa512a00640 1 -- 172.21.15.173:0/1427743776 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5040a7070 con 0x7fa514145250 2024-04-25T09:12:47.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.029+0000 7fa512a00640 1 -- 172.21.15.173:0/1427743776 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5040b0070 con 0x7fa514145250 2024-04-25T09:12:47.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.029+0000 7fa512a00640 1 -- 172.21.15.173:0/1427743776 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5040ab890 con 0x7fa514145250 2024-04-25T09:12:47.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.029+0000 7fa51a200640 1 -- 172.21.15.173:0/1427743776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa514145250 msgr2=0x7fa51415c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:47.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.029+0000 7fa51a200640 1 --2- 172.21.15.173:0/1427743776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa514145250 0x7fa51415c980 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fa5040097c0 tx=0x7fa50401c470 comp rx=0 tx=0).stop 2024-04-25T09:12:47.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.029+0000 7fa51a200640 1 -- 172.21.15.173:0/1427743776 shutdown_connections 2024-04-25T09:12:47.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.029+0000 7fa51a200640 1 --2- 172.21.15.173:0/1427743776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa514145250 0x7fa51415c980 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:47.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.029+0000 7fa51a200640 1 -- 172.21.15.173:0/1427743776 >> 172.21.15.173:0/1427743776 conn(0x7fa51406ac90 msgr2=0x7fa51406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:47.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.029+0000 7fa51a200640 1 -- 172.21.15.173:0/1427743776 shutdown_connections 2024-04-25T09:12:47.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.029+0000 7fa51a200640 1 -- 172.21.15.173:0/1427743776 wait complete. 2024-04-25T09:12:47.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa51a200640 1 Processor -- start 2024-04-25T09:12:47.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa51a200640 1 -- start start 2024-04-25T09:12:47.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa51a200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5140cc8b0 0x7fa51415b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:47.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa51a200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5140ccd30 0x7fa514135f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:47.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa51a200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa514145250 0x7fa51413ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:47.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa51a200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa514145630 con 0x7fa514145250 2024-04-25T09:12:47.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa51a200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51406e2a0 con 0x7fa5140cc8b0 2024-04-25T09:12:47.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa51a200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51406ef80 con 0x7fa5140ccd30 2024-04-25T09:12:47.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa513e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa514145250 0x7fa51413ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:47.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa513e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa514145250 0x7fa51413ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51198/0 (socket says 172.21.15.173:51198) 2024-04-25T09:12:47.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa513e00640 1 -- 172.21.15.173:0/1260994009 learned_addr learned my addr 172.21.15.173:0/1260994009 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:12:47.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa50aa00640 1 --2- 172.21.15.173:0/1260994009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5140ccd30 0x7fa514135f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:47.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa513400640 1 --2- 172.21.15.173:0/1260994009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5140cc8b0 0x7fa51415b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:47.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa513e00640 1 -- 172.21.15.173:0/1260994009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5140ccd30 msgr2=0x7fa514135f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:47.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa513e00640 1 --2- 172.21.15.173:0/1260994009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5140ccd30 0x7fa514135f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:47.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa513e00640 1 -- 172.21.15.173:0/1260994009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5140cc8b0 msgr2=0x7fa51415b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:47.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa513e00640 1 --2- 172.21.15.173:0/1260994009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5140cc8b0 0x7fa51415b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:47.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa513e00640 1 -- 172.21.15.173:0/1260994009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51415b7b0 con 0x7fa514145250 2024-04-25T09:12:47.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa513e00640 1 --2- 172.21.15.173:0/1260994009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa514145250 0x7fa51413ca80 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00c770 tx=0x7fa50c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:47.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa50be00640 1 -- 172.21.15.173:0/1260994009 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c003b80 con 0x7fa514145250 2024-04-25T09:12:47.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa50be00640 1 -- 172.21.15.173:0/1260994009 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50c003d20 con 0x7fa514145250 2024-04-25T09:12:47.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa50be00640 1 -- 172.21.15.173:0/1260994009 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c00aa90 con 0x7fa514145250 2024-04-25T09:12:47.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa51a200640 1 -- 172.21.15.173:0/1260994009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5140addf0 con 0x7fa514145250 2024-04-25T09:12:47.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.033+0000 7fa51a200640 1 -- 172.21.15.173:0/1260994009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5140b37b0 con 0x7fa514145250 2024-04-25T09:12:47.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.037+0000 7fa51a200640 1 -- 172.21.15.173:0/1260994009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa514073a40 con 0x7fa514145250 2024-04-25T09:12:47.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.037+0000 7fa50be00640 1 -- 172.21.15.173:0/1260994009 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa50c00ac30 con 0x7fa514145250 2024-04-25T09:12:47.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.037+0000 7fa50be00640 1 --2- 172.21.15.173:0/1260994009 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa4f0066f60 0x7fa4f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:47.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.037+0000 7fa50be00640 1 -- 172.21.15.173:0/1260994009 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa50c084ef0 con 0x7fa514145250 2024-04-25T09:12:47.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.037+0000 7fa513400640 1 --2- 172.21.15.173:0/1260994009 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa4f0066f60 0x7fa4f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:47.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.037+0000 7fa513400640 1 --2- 172.21.15.173:0/1260994009 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa4f0066f60 0x7fa4f0069420 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa5040af000 tx=0x7fa5040a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:47.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.041+0000 7fa50be00640 1 -- 172.21.15.173:0/1260994009 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa50c0557b0 con 0x7fa514145250 2024-04-25T09:12:47.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.229+0000 7fa51a200640 1 -- 172.21.15.173:0/1260994009 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5140b3260 con 0x7fa514145250 2024-04-25T09:12:47.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.229+0000 7fa50be00640 1 -- 172.21.15.173:0/1260994009 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4952 (secure 0 0 0) 0x7fa50c059850 con 0x7fa514145250 2024-04-25T09:12:47.214 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:12:47.215 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":89,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":9408,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1841246276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1841246276},{"type":"v1","addr":"172.21.15.173:6835","nonce":1841246276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:34.472510+0000","modified":"2024-04-25T09:12:37.491581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9411":{"gid":9411,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3627798672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3627798672},{"type":"v1","addr":"172.21.15.173:6837","nonce":3627798672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:12:47.215 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 89 2024-04-25T09:12:47.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.229+0000 7fa51a200640 1 -- 172.21.15.173:0/1260994009 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa4f0066f60 msgr2=0x7fa4f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:47.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.229+0000 7fa51a200640 1 --2- 172.21.15.173:0/1260994009 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa4f0066f60 0x7fa4f0069420 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa5040af000 tx=0x7fa5040a7000 comp rx=0 tx=0).stop 2024-04-25T09:12:47.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.229+0000 7fa51a200640 1 -- 172.21.15.173:0/1260994009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa514145250 msgr2=0x7fa51413ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:47.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.229+0000 7fa51a200640 1 --2- 172.21.15.173:0/1260994009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa514145250 0x7fa51413ca80 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00c770 tx=0x7fa50c00cc30 comp rx=0 tx=0).stop 2024-04-25T09:12:47.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.229+0000 7fa51a200640 1 -- 172.21.15.173:0/1260994009 shutdown_connections 2024-04-25T09:12:47.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.229+0000 7fa51a200640 1 --2- 172.21.15.173:0/1260994009 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa4f0066f60 0x7fa4f0069420 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:47.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.229+0000 7fa51a200640 1 --2- 172.21.15.173:0/1260994009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa514145250 0x7fa51413ca80 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:47.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.229+0000 7fa51a200640 1 --2- 172.21.15.173:0/1260994009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5140ccd30 0x7fa514135f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:47.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.229+0000 7fa51a200640 1 --2- 172.21.15.173:0/1260994009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5140cc8b0 0x7fa51415b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:47.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.229+0000 7fa51a200640 1 -- 172.21.15.173:0/1260994009 >> 172.21.15.173:0/1260994009 conn(0x7fa51406ac90 msgr2=0x7fa5140ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:47.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.229+0000 7fa51a200640 1 -- 172.21.15.173:0/1260994009 shutdown_connections 2024-04-25T09:12:47.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:12:47.229+0000 7fa51a200640 1 -- 172.21.15.173:0/1260994009 wait complete. 2024-04-25T09:12:47.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:47.237 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:47.237 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:47.237 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.0 2024-04-25T09:12:47.237 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:47.237 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:47.237 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:47.237 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:47.275 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.275 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.275 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161505 s, 64.9 MB/s 2024-04-25T09:12:47.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.298 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212388 s, 49.4 MB/s 2024-04-25T09:12:47.319 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.319 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.319 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195217 s, 53.7 MB/s 2024-04-25T09:12:47.341 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.341 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.341 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197803 s, 53.0 MB/s 2024-04-25T09:12:47.355 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.356 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.356 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126647 s, 82.8 MB/s 2024-04-25T09:12:47.375 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.375 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.375 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174001 s, 60.3 MB/s 2024-04-25T09:12:47.394 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.394 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.394 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173687 s, 60.4 MB/s 2024-04-25T09:12:47.414 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.414 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.414 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184531 s, 56.8 MB/s 2024-04-25T09:12:47.436 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.436 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.436 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199067 s, 52.7 MB/s 2024-04-25T09:12:47.454 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.454 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.454 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015867 s, 66.1 MB/s 2024-04-25T09:12:47.476 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.476 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.476 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200875 s, 52.2 MB/s 2024-04-25T09:12:47.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.497 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193946 s, 54.1 MB/s 2024-04-25T09:12:47.518 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.518 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.518 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019143 s, 54.8 MB/s 2024-04-25T09:12:47.537 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.537 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.537 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167266 s, 62.7 MB/s 2024-04-25T09:12:47.555 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.555 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.555 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163398 s, 64.2 MB/s 2024-04-25T09:12:47.574 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.574 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.574 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171998 s, 61.0 MB/s 2024-04-25T09:12:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.596 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204772 s, 51.2 MB/s 2024-04-25T09:12:47.618 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.618 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.618 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200815 s, 52.2 MB/s 2024-04-25T09:12:47.641 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.642 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.642 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021986 s, 47.7 MB/s 2024-04-25T09:12:47.662 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.662 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.662 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183117 s, 57.3 MB/s 2024-04-25T09:12:47.686 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.686 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.687 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229085 s, 45.8 MB/s 2024-04-25T09:12:47.708 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.708 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.708 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194852 s, 53.8 MB/s 2024-04-25T09:12:47.732 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.733 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.733 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023072 s, 45.4 MB/s 2024-04-25T09:12:47.756 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.756 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.756 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216023 s, 48.5 MB/s 2024-04-25T09:12:47.776 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.776 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.776 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186792 s, 56.1 MB/s 2024-04-25T09:12:47.797 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.797 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.797 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188933 s, 55.5 MB/s 2024-04-25T09:12:47.811 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.811 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.811 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011771 s, 89.1 MB/s 2024-04-25T09:12:47.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.837 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244838 s, 42.8 MB/s 2024-04-25T09:12:47.854 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.854 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.854 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01499 s, 70.0 MB/s 2024-04-25T09:12:47.874 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.874 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.874 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185436 s, 56.5 MB/s 2024-04-25T09:12:47.890 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.890 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.891 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146163 s, 71.7 MB/s 2024-04-25T09:12:47.907 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.907 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.907 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151497 s, 69.2 MB/s 2024-04-25T09:12:47.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:47.909 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:47.909 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:47.909 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.1 2024-04-25T09:12:47.909 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:47.909 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:47.909 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:47.909 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:47.988 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:47.988 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:47.989 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187907 s, 55.8 MB/s 2024-04-25T09:12:48.005 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.005 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.006 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151896 s, 69.0 MB/s 2024-04-25T09:12:48.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.025 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178295 s, 58.8 MB/s 2024-04-25T09:12:48.046 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.046 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.046 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188196 s, 55.7 MB/s 2024-04-25T09:12:48.062 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.063 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.063 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015001 s, 69.9 MB/s 2024-04-25T09:12:48.084 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.084 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.084 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200571 s, 52.3 MB/s 2024-04-25T09:12:48.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.101 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147077 s, 71.3 MB/s 2024-04-25T09:12:48.121 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.122 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.122 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187176 s, 56.0 MB/s 2024-04-25T09:12:48.139 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.140 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161289 s, 65.0 MB/s 2024-04-25T09:12:48.159 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.159 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.159 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017895 s, 58.6 MB/s 2024-04-25T09:12:48.177 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.177 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.177 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161806 s, 64.8 MB/s 2024-04-25T09:12:48.197 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.197 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.197 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178997 s, 58.6 MB/s 2024-04-25T09:12:48.214 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.214 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.214 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157821 s, 66.4 MB/s 2024-04-25T09:12:48.228 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.228 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.228 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119866 s, 87.5 MB/s 2024-04-25T09:12:48.246 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.246 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.246 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166517 s, 63.0 MB/s 2024-04-25T09:12:48.263 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.263 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.263 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149012 s, 70.4 MB/s 2024-04-25T09:12:48.279 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.279 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.279 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146545 s, 71.6 MB/s 2024-04-25T09:12:48.296 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.296 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.296 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147894 s, 70.9 MB/s 2024-04-25T09:12:48.312 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.312 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.313 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147372 s, 71.2 MB/s 2024-04-25T09:12:48.332 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.332 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.332 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173993 s, 60.3 MB/s 2024-04-25T09:12:48.351 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.351 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.351 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172997 s, 60.6 MB/s 2024-04-25T09:12:48.369 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.370 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.370 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171057 s, 61.3 MB/s 2024-04-25T09:12:48.387 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.387 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.387 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160485 s, 65.3 MB/s 2024-04-25T09:12:48.405 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.405 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.405 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157788 s, 66.5 MB/s 2024-04-25T09:12:48.423 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.423 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.423 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161314 s, 65.0 MB/s 2024-04-25T09:12:48.440 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.440 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.440 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151724 s, 69.1 MB/s 2024-04-25T09:12:48.462 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.462 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.462 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207449 s, 50.5 MB/s 2024-04-25T09:12:48.481 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.481 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.481 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017326 s, 60.5 MB/s 2024-04-25T09:12:48.502 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.502 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.502 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189498 s, 55.3 MB/s 2024-04-25T09:12:48.520 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.520 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.520 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163485 s, 64.1 MB/s 2024-04-25T09:12:48.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.541 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184723 s, 56.8 MB/s 2024-04-25T09:12:48.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.559 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163024 s, 64.3 MB/s 2024-04-25T09:12:48.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:48.560 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:48.560 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:48.561 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.2 2024-04-25T09:12:48.561 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:48.561 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:48.561 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:48.561 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:48.635 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.635 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.635 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177434 s, 59.1 MB/s 2024-04-25T09:12:48.652 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.652 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.652 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147035 s, 71.3 MB/s 2024-04-25T09:12:48.668 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.668 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.668 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147825 s, 70.9 MB/s 2024-04-25T09:12:48.687 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.688 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.688 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173758 s, 60.3 MB/s 2024-04-25T09:12:48.706 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.706 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.706 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166356 s, 63.0 MB/s 2024-04-25T09:12:48.724 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.724 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.724 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165194 s, 63.5 MB/s 2024-04-25T09:12:48.745 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.745 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.745 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195016 s, 53.8 MB/s 2024-04-25T09:12:48.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.766 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194469 s, 53.9 MB/s 2024-04-25T09:12:48.784 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.784 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.784 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163636 s, 64.1 MB/s 2024-04-25T09:12:48.802 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.802 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.802 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164067 s, 63.9 MB/s 2024-04-25T09:12:48.819 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.819 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.819 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147297 s, 71.2 MB/s 2024-04-25T09:12:48.836 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.836 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.836 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154491 s, 67.9 MB/s 2024-04-25T09:12:48.856 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.856 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.856 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183038 s, 57.3 MB/s 2024-04-25T09:12:48.877 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.877 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.877 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184856 s, 56.7 MB/s 2024-04-25T09:12:48.898 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.898 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.899 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200979 s, 52.2 MB/s 2024-04-25T09:12:48.920 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.920 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.920 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196702 s, 53.3 MB/s 2024-04-25T09:12:48.938 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.939 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.939 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170083 s, 61.7 MB/s 2024-04-25T09:12:48.957 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.957 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.957 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160504 s, 65.3 MB/s 2024-04-25T09:12:48.977 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.978 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192887 s, 54.4 MB/s 2024-04-25T09:12:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161165 s, 65.1 MB/s 2024-04-25T09:12:49.013 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.013 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.013 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156863 s, 66.8 MB/s 2024-04-25T09:12:49.030 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.030 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.030 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150531 s, 69.7 MB/s 2024-04-25T09:12:49.046 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.047 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.047 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151784 s, 69.1 MB/s 2024-04-25T09:12:49.063 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.063 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.063 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146051 s, 71.8 MB/s 2024-04-25T09:12:49.079 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.080 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.080 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146385 s, 71.6 MB/s 2024-04-25T09:12:49.096 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.097 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152064 s, 69.0 MB/s 2024-04-25T09:12:49.117 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.117 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.117 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185856 s, 56.4 MB/s 2024-04-25T09:12:49.135 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.135 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.135 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164678 s, 63.7 MB/s 2024-04-25T09:12:49.151 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.151 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.151 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141539 s, 74.1 MB/s 2024-04-25T09:12:49.169 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.169 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.169 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162622 s, 64.5 MB/s 2024-04-25T09:12:49.191 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.191 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.191 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199573 s, 52.5 MB/s 2024-04-25T09:12:49.207 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.207 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.207 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146435 s, 71.6 MB/s 2024-04-25T09:12:49.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:49.209 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:49.209 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:49.209 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.3 2024-04-25T09:12:49.209 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:49.209 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:49.209 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:49.209 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:49.284 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.284 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.284 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142655 s, 73.5 MB/s 2024-04-25T09:12:49.300 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.300 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.300 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148349 s, 70.7 MB/s 2024-04-25T09:12:49.321 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.321 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.321 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187663 s, 55.9 MB/s 2024-04-25T09:12:49.337 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.337 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.337 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137362 s, 76.3 MB/s 2024-04-25T09:12:49.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.360 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217981 s, 48.1 MB/s 2024-04-25T09:12:49.376 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.376 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.376 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142292 s, 73.7 MB/s 2024-04-25T09:12:49.399 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.399 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.399 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213709 s, 49.1 MB/s 2024-04-25T09:12:49.416 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.416 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.416 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015383 s, 68.2 MB/s 2024-04-25T09:12:49.433 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.433 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.433 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149565 s, 70.1 MB/s 2024-04-25T09:12:49.452 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.452 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.452 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168895 s, 62.1 MB/s 2024-04-25T09:12:49.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.470 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156703 s, 66.9 MB/s 2024-04-25T09:12:49.486 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.486 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.486 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146892 s, 71.4 MB/s 2024-04-25T09:12:49.507 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.507 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.507 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194234 s, 54.0 MB/s 2024-04-25T09:12:49.528 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.528 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.528 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190264 s, 55.1 MB/s 2024-04-25T09:12:49.545 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.545 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.545 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151302 s, 69.3 MB/s 2024-04-25T09:12:49.561 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.561 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.561 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141919 s, 73.9 MB/s 2024-04-25T09:12:49.575 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.575 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.575 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118561 s, 88.4 MB/s 2024-04-25T09:12:49.593 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.594 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.594 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168431 s, 62.3 MB/s 2024-04-25T09:12:49.611 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.611 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.611 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160401 s, 65.4 MB/s 2024-04-25T09:12:49.627 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.627 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.627 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142714 s, 73.5 MB/s 2024-04-25T09:12:49.644 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.644 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.644 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149077 s, 70.3 MB/s 2024-04-25T09:12:49.662 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.662 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.663 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164656 s, 63.7 MB/s 2024-04-25T09:12:49.682 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.682 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.682 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183082 s, 57.3 MB/s 2024-04-25T09:12:49.697 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.697 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.697 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126199 s, 83.1 MB/s 2024-04-25T09:12:49.718 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.718 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.718 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190838 s, 54.9 MB/s 2024-04-25T09:12:49.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.739 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192703 s, 54.4 MB/s 2024-04-25T09:12:49.760 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.760 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.760 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189832 s, 55.2 MB/s 2024-04-25T09:12:49.780 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.780 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.780 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182268 s, 57.5 MB/s 2024-04-25T09:12:49.798 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.798 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.798 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169192 s, 62.0 MB/s 2024-04-25T09:12:49.817 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.817 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.818 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172227 s, 60.9 MB/s 2024-04-25T09:12:49.834 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.834 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.834 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149784 s, 70.0 MB/s 2024-04-25T09:12:49.853 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.854 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.854 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173873 s, 60.3 MB/s 2024-04-25T09:12:49.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:49.855 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:49.855 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:49.855 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.4 2024-04-25T09:12:49.855 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:49.855 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:49.855 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:49.855 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144311 s, 72.7 MB/s 2024-04-25T09:12:49.944 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.944 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.944 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018205 s, 57.6 MB/s 2024-04-25T09:12:49.961 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.961 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.961 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145521 s, 72.1 MB/s 2024-04-25T09:12:49.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.978 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015457 s, 67.8 MB/s 2024-04-25T09:12:49.997 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:49.997 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:49.997 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172084 s, 60.9 MB/s 2024-04-25T09:12:50.015 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.015 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.016 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167942 s, 62.4 MB/s 2024-04-25T09:12:50.032 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.032 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.032 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144546 s, 72.5 MB/s 2024-04-25T09:12:50.049 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.049 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.049 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158864 s, 66.0 MB/s 2024-04-25T09:12:50.070 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.070 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.070 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190163 s, 55.1 MB/s 2024-04-25T09:12:50.087 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.087 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.087 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155873 s, 67.3 MB/s 2024-04-25T09:12:50.108 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.108 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.108 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185012 s, 56.7 MB/s 2024-04-25T09:12:50.124 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.124 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.124 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142307 s, 73.7 MB/s 2024-04-25T09:12:50.147 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.147 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.147 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214316 s, 48.9 MB/s 2024-04-25T09:12:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191262 s, 54.8 MB/s 2024-04-25T09:12:50.186 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.186 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.186 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162854 s, 64.4 MB/s 2024-04-25T09:12:50.208 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.208 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.208 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200934 s, 52.2 MB/s 2024-04-25T09:12:50.225 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.225 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.225 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145352 s, 72.1 MB/s 2024-04-25T09:12:50.246 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.246 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.246 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197167 s, 53.2 MB/s 2024-04-25T09:12:50.269 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.269 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.269 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212127 s, 49.4 MB/s 2024-04-25T09:12:50.286 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.286 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.286 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146045 s, 71.8 MB/s 2024-04-25T09:12:50.302 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.302 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.302 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144616 s, 72.5 MB/s 2024-04-25T09:12:50.319 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.319 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.319 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151732 s, 69.1 MB/s 2024-04-25T09:12:50.338 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.338 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.338 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168728 s, 62.1 MB/s 2024-04-25T09:12:50.359 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.359 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.359 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195197 s, 53.7 MB/s 2024-04-25T09:12:50.380 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.380 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.380 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188681 s, 55.6 MB/s 2024-04-25T09:12:50.398 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.398 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.398 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166062 s, 63.1 MB/s 2024-04-25T09:12:50.415 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.415 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.415 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147622 s, 71.0 MB/s 2024-04-25T09:12:50.432 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.432 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.432 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150906 s, 69.5 MB/s 2024-04-25T09:12:50.448 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.448 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.448 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147737 s, 71.0 MB/s 2024-04-25T09:12:50.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.469 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190571 s, 55.0 MB/s 2024-04-25T09:12:50.486 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.486 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.486 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148014 s, 70.8 MB/s 2024-04-25T09:12:50.503 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.503 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.503 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150527 s, 69.7 MB/s 2024-04-25T09:12:50.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:50.505 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:50.505 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:50.505 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.5 2024-04-25T09:12:50.505 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:50.505 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:50.505 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:50.505 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:50.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.576 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151717 s, 69.1 MB/s 2024-04-25T09:12:50.593 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.593 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.593 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151184 s, 69.4 MB/s 2024-04-25T09:12:50.610 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.610 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.610 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155777 s, 67.3 MB/s 2024-04-25T09:12:50.630 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.630 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.630 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177949 s, 58.9 MB/s 2024-04-25T09:12:50.647 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.647 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.647 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151249 s, 69.3 MB/s 2024-04-25T09:12:50.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.665 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158841 s, 66.0 MB/s 2024-04-25T09:12:50.681 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.681 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.681 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145427 s, 72.1 MB/s 2024-04-25T09:12:50.697 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.698 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.698 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144559 s, 72.5 MB/s 2024-04-25T09:12:50.711 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.712 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.712 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123634 s, 84.8 MB/s 2024-04-25T09:12:50.736 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.736 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.736 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223492 s, 46.9 MB/s 2024-04-25T09:12:50.755 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.755 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.755 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178589 s, 58.7 MB/s 2024-04-25T09:12:50.772 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.772 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.772 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149282 s, 70.2 MB/s 2024-04-25T09:12:50.791 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.791 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.791 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169824 s, 61.7 MB/s 2024-04-25T09:12:50.807 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.807 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.807 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147578 s, 71.1 MB/s 2024-04-25T09:12:50.824 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.824 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.824 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154255 s, 68.0 MB/s 2024-04-25T09:12:50.845 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.845 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.845 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191434 s, 54.8 MB/s 2024-04-25T09:12:50.859 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.859 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.860 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123082 s, 85.2 MB/s 2024-04-25T09:12:50.881 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.881 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.881 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196324 s, 53.4 MB/s 2024-04-25T09:12:50.899 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.899 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.899 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166001 s, 63.2 MB/s 2024-04-25T09:12:50.917 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.917 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.917 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015543 s, 67.5 MB/s 2024-04-25T09:12:50.930 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.930 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.930 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116793 s, 89.8 MB/s 2024-04-25T09:12:50.946 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.946 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.946 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145873 s, 71.9 MB/s 2024-04-25T09:12:50.965 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.965 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.965 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017088 s, 61.4 MB/s 2024-04-25T09:12:50.981 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:50.981 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:50.981 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143152 s, 73.2 MB/s 2024-04-25T09:12:51.002 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.002 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.003 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191531 s, 54.7 MB/s 2024-04-25T09:12:51.021 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.021 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.021 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169947 s, 61.7 MB/s 2024-04-25T09:12:51.039 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.039 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.039 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164654 s, 63.7 MB/s 2024-04-25T09:12:51.056 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.056 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.056 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151463 s, 69.2 MB/s 2024-04-25T09:12:51.073 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.073 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.073 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146849 s, 71.4 MB/s 2024-04-25T09:12:51.091 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.091 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.091 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159915 s, 65.6 MB/s 2024-04-25T09:12:51.109 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.109 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.109 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164698 s, 63.7 MB/s 2024-04-25T09:12:51.128 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.128 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.128 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170908 s, 61.4 MB/s 2024-04-25T09:12:51.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:51.129 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:51.129 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:51.130 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.6 2024-04-25T09:12:51.130 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:51.130 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:51.130 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:51.130 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:51.207 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.207 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.208 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183664 s, 57.1 MB/s 2024-04-25T09:12:51.232 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.232 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.232 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229368 s, 45.7 MB/s 2024-04-25T09:12:51.251 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.251 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.251 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169635 s, 61.8 MB/s 2024-04-25T09:12:51.267 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.267 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.267 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142318 s, 73.7 MB/s 2024-04-25T09:12:51.287 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.287 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.287 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188078 s, 55.8 MB/s 2024-04-25T09:12:51.305 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.305 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.305 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159491 s, 65.7 MB/s 2024-04-25T09:12:51.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.323 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159415 s, 65.8 MB/s 2024-04-25T09:12:51.342 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.342 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.342 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173957 s, 60.3 MB/s 2024-04-25T09:12:51.363 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.363 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.363 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192636 s, 54.4 MB/s 2024-04-25T09:12:51.380 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.380 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.380 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155301 s, 67.5 MB/s 2024-04-25T09:12:51.397 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.397 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.397 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153474 s, 68.3 MB/s 2024-04-25T09:12:51.413 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.413 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.414 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142514 s, 73.6 MB/s 2024-04-25T09:12:51.437 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.437 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.437 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219118 s, 47.9 MB/s 2024-04-25T09:12:51.453 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.453 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.453 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143692 s, 73.0 MB/s 2024-04-25T09:12:51.472 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.472 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.472 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172809 s, 60.7 MB/s 2024-04-25T09:12:51.489 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.489 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.489 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148697 s, 70.5 MB/s 2024-04-25T09:12:51.509 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.509 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.509 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185328 s, 56.6 MB/s 2024-04-25T09:12:51.529 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.529 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.529 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179593 s, 58.4 MB/s 2024-04-25T09:12:51.545 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.545 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.545 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145631 s, 72.0 MB/s 2024-04-25T09:12:51.563 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.563 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.563 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158723 s, 66.1 MB/s 2024-04-25T09:12:51.580 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.580 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.581 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01575 s, 66.6 MB/s 2024-04-25T09:12:51.596 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.597 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.597 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143553 s, 73.0 MB/s 2024-04-25T09:12:51.612 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.612 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.613 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139031 s, 75.4 MB/s 2024-04-25T09:12:51.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.628 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139816 s, 75.0 MB/s 2024-04-25T09:12:51.646 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.646 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.646 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155696 s, 67.3 MB/s 2024-04-25T09:12:51.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.667 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192494 s, 54.5 MB/s 2024-04-25T09:12:51.685 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.685 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.685 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016584 s, 63.2 MB/s 2024-04-25T09:12:51.703 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.703 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.704 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164025 s, 63.9 MB/s 2024-04-25T09:12:51.720 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.720 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.720 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152344 s, 68.8 MB/s 2024-04-25T09:12:51.738 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.738 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.738 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158893 s, 66.0 MB/s 2024-04-25T09:12:51.760 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.760 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.760 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204097 s, 51.4 MB/s 2024-04-25T09:12:51.780 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.780 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.780 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179074 s, 58.6 MB/s 2024-04-25T09:12:51.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:51.782 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:51.782 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:51.782 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.7 2024-04-25T09:12:51.782 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:51.782 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:51.782 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:51.782 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:51.859 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.859 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.859 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222098 s, 47.2 MB/s 2024-04-25T09:12:51.873 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.873 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.873 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117703 s, 89.1 MB/s 2024-04-25T09:12:51.891 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.891 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.891 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166801 s, 62.9 MB/s 2024-04-25T09:12:51.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.912 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191508 s, 54.8 MB/s 2024-04-25T09:12:51.929 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.929 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.929 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143063 s, 73.3 MB/s 2024-04-25T09:12:51.952 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.952 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.952 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021656 s, 48.4 MB/s 2024-04-25T09:12:51.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.968 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142674 s, 73.5 MB/s 2024-04-25T09:12:51.986 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:51.986 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:51.986 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159979 s, 65.5 MB/s 2024-04-25T09:12:52.005 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.005 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.005 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175375 s, 59.8 MB/s 2024-04-25T09:12:52.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.025 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188214 s, 55.7 MB/s 2024-04-25T09:12:52.045 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.045 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.045 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177968 s, 58.9 MB/s 2024-04-25T09:12:52.063 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.063 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.063 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016121 s, 65.0 MB/s 2024-04-25T09:12:52.079 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.079 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.079 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145278 s, 72.2 MB/s 2024-04-25T09:12:52.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.097 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162052 s, 64.7 MB/s 2024-04-25T09:12:52.114 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.114 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.114 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149799 s, 70.0 MB/s 2024-04-25T09:12:52.131 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.131 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.133 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149959 s, 69.9 MB/s 2024-04-25T09:12:52.147 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.147 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.147 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140219 s, 74.8 MB/s 2024-04-25T09:12:52.163 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.163 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.163 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139979 s, 74.9 MB/s 2024-04-25T09:12:52.184 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.185 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.185 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200821 s, 52.2 MB/s 2024-04-25T09:12:52.201 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.201 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.201 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140779 s, 74.5 MB/s 2024-04-25T09:12:52.219 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.219 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.219 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165439 s, 63.4 MB/s 2024-04-25T09:12:52.236 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.236 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.236 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152528 s, 68.7 MB/s 2024-04-25T09:12:52.253 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.253 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.253 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152509 s, 68.8 MB/s 2024-04-25T09:12:52.270 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.270 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.270 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148576 s, 70.6 MB/s 2024-04-25T09:12:52.286 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.286 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.286 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148495 s, 70.6 MB/s 2024-04-25T09:12:52.308 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.308 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.308 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202308 s, 51.8 MB/s 2024-04-25T09:12:52.327 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.327 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.327 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168778 s, 62.1 MB/s 2024-04-25T09:12:52.345 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.345 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.345 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159018 s, 65.9 MB/s 2024-04-25T09:12:52.362 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.362 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.362 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154935 s, 67.7 MB/s 2024-04-25T09:12:52.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.386 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225462 s, 46.5 MB/s 2024-04-25T09:12:52.404 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.404 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.405 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164394 s, 63.8 MB/s 2024-04-25T09:12:52.422 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.422 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.422 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156087 s, 67.2 MB/s 2024-04-25T09:12:52.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:52.423 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:52.423 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:52.423 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.8 2024-04-25T09:12:52.424 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:52.424 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:52.424 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:52.424 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:52.501 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.501 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.501 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194242 s, 54.0 MB/s 2024-04-25T09:12:52.518 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.518 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.518 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015189 s, 69.0 MB/s 2024-04-25T09:12:52.539 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.539 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.539 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192361 s, 54.5 MB/s 2024-04-25T09:12:52.557 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.557 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.558 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163449 s, 64.2 MB/s 2024-04-25T09:12:52.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.576 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167633 s, 62.6 MB/s 2024-04-25T09:12:52.597 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.597 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.597 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190604 s, 55.0 MB/s 2024-04-25T09:12:52.615 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.615 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.615 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163859 s, 64.0 MB/s 2024-04-25T09:12:52.636 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.636 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.636 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190628 s, 55.0 MB/s 2024-04-25T09:12:52.657 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.657 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.657 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196117 s, 53.5 MB/s 2024-04-25T09:12:52.674 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.675 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.675 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154335 s, 67.9 MB/s 2024-04-25T09:12:52.691 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.691 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.691 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014619 s, 71.7 MB/s 2024-04-25T09:12:52.707 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.707 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.707 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149272 s, 70.2 MB/s 2024-04-25T09:12:52.723 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.723 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.723 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141327 s, 74.2 MB/s 2024-04-25T09:12:52.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.740 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141574 s, 74.1 MB/s 2024-04-25T09:12:52.756 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.756 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.756 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150546 s, 69.7 MB/s 2024-04-25T09:12:52.774 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.774 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.774 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015852 s, 66.1 MB/s 2024-04-25T09:12:52.790 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.790 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.790 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140768 s, 74.5 MB/s 2024-04-25T09:12:52.806 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.807 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.807 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147285 s, 71.2 MB/s 2024-04-25T09:12:52.823 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.824 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.824 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151468 s, 69.2 MB/s 2024-04-25T09:12:52.842 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.842 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.842 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166825 s, 62.9 MB/s 2024-04-25T09:12:52.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.859 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.859 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149234 s, 70.3 MB/s 2024-04-25T09:12:52.875 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.875 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.875 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147525 s, 71.1 MB/s 2024-04-25T09:12:52.896 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.896 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.896 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192284 s, 54.5 MB/s 2024-04-25T09:12:52.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.914 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161978 s, 64.7 MB/s 2024-04-25T09:12:52.932 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.932 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.932 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164911 s, 63.6 MB/s 2024-04-25T09:12:52.952 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.952 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.952 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175286 s, 59.8 MB/s 2024-04-25T09:12:52.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.969 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151634 s, 69.2 MB/s 2024-04-25T09:12:52.986 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:52.986 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:52.986 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150023 s, 69.9 MB/s 2024-04-25T09:12:53.001 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.002 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.002 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140761 s, 74.5 MB/s 2024-04-25T09:12:53.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.023 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189196 s, 55.4 MB/s 2024-04-25T09:12:53.040 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.041 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.041 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165879 s, 63.2 MB/s 2024-04-25T09:12:53.057 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.058 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.058 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151652 s, 69.1 MB/s 2024-04-25T09:12:53.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:53.059 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:53.059 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:53.059 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.9 2024-04-25T09:12:53.059 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:53.059 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:53.059 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:53.060 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:53.134 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.134 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.134 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162782 s, 64.4 MB/s 2024-04-25T09:12:53.151 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.151 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.151 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147703 s, 71.0 MB/s 2024-04-25T09:12:53.171 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.171 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.171 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184448 s, 56.8 MB/s 2024-04-25T09:12:53.188 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.188 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.188 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148206 s, 70.8 MB/s 2024-04-25T09:12:53.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.205 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159351 s, 65.8 MB/s 2024-04-25T09:12:53.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.222 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146885 s, 71.4 MB/s 2024-04-25T09:12:53.241 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.241 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.241 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175001 s, 59.9 MB/s 2024-04-25T09:12:53.259 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.259 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.260 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165804 s, 63.2 MB/s 2024-04-25T09:12:53.277 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.277 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.277 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155016 s, 67.6 MB/s 2024-04-25T09:12:53.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.295 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.295 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161755 s, 64.8 MB/s 2024-04-25T09:12:53.311 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.311 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.311 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146248 s, 71.7 MB/s 2024-04-25T09:12:53.329 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.329 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.329 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161273 s, 65.0 MB/s 2024-04-25T09:12:53.349 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.349 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.349 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184286 s, 56.9 MB/s 2024-04-25T09:12:53.366 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.366 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.366 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146316 s, 71.7 MB/s 2024-04-25T09:12:53.382 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.382 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.382 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146947 s, 71.4 MB/s 2024-04-25T09:12:53.400 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.401 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.401 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163467 s, 64.1 MB/s 2024-04-25T09:12:53.422 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.422 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.422 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203077 s, 51.6 MB/s 2024-04-25T09:12:53.437 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.437 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.437 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122694 s, 85.5 MB/s 2024-04-25T09:12:53.458 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.458 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.458 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193183 s, 54.3 MB/s 2024-04-25T09:12:53.478 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.478 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.478 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181006 s, 57.9 MB/s 2024-04-25T09:12:53.495 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.495 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.496 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157349 s, 66.6 MB/s 2024-04-25T09:12:53.514 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.514 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.514 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167998 s, 62.4 MB/s 2024-04-25T09:12:53.530 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.530 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.530 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014685 s, 71.4 MB/s 2024-04-25T09:12:53.551 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.551 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.551 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188011 s, 55.8 MB/s 2024-04-25T09:12:53.569 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.569 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.570 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164794 s, 63.6 MB/s 2024-04-25T09:12:53.586 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.586 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.587 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014866 s, 70.5 MB/s 2024-04-25T09:12:53.607 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.607 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.607 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192172 s, 54.6 MB/s 2024-04-25T09:12:53.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.625 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154879 s, 67.7 MB/s 2024-04-25T09:12:53.642 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.642 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.642 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015783 s, 66.4 MB/s 2024-04-25T09:12:53.660 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.661 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168785 s, 62.1 MB/s 2024-04-25T09:12:53.683 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.683 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.683 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210759 s, 49.8 MB/s 2024-04-25T09:12:53.701 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.701 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.701 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154895 s, 67.7 MB/s 2024-04-25T09:12:53.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:53.702 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:53.702 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:53.703 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.10 2024-04-25T09:12:53.703 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:53.703 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:53.703 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:53.703 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:53.778 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.778 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.778 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208726 s, 50.2 MB/s 2024-04-25T09:12:53.800 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.800 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.800 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198721 s, 52.8 MB/s 2024-04-25T09:12:53.818 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.818 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.818 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166261 s, 63.1 MB/s 2024-04-25T09:12:53.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.837 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169873 s, 61.7 MB/s 2024-04-25T09:12:53.853 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.853 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.853 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145237 s, 72.2 MB/s 2024-04-25T09:12:53.870 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.870 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.870 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015385 s, 68.2 MB/s 2024-04-25T09:12:53.888 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.888 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.888 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162598 s, 64.5 MB/s 2024-04-25T09:12:53.907 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.907 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.907 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016862 s, 62.2 MB/s 2024-04-25T09:12:53.923 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.923 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.924 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149637 s, 70.1 MB/s 2024-04-25T09:12:53.941 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.941 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.941 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159601 s, 65.7 MB/s 2024-04-25T09:12:53.958 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.958 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.958 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148543 s, 70.6 MB/s 2024-04-25T09:12:53.974 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.974 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.974 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142994 s, 73.3 MB/s 2024-04-25T09:12:53.995 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:53.995 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:53.995 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189149 s, 55.4 MB/s 2024-04-25T09:12:54.015 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.015 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.016 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018865 s, 55.6 MB/s 2024-04-25T09:12:54.031 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.031 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.031 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140346 s, 74.7 MB/s 2024-04-25T09:12:54.048 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.048 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.048 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150196 s, 69.8 MB/s 2024-04-25T09:12:54.065 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.065 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.065 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146094 s, 71.8 MB/s 2024-04-25T09:12:54.081 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.081 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.081 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144402 s, 72.6 MB/s 2024-04-25T09:12:54.096 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.096 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.096 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139283 s, 75.3 MB/s 2024-04-25T09:12:54.115 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.115 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.115 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163935 s, 64.0 MB/s 2024-04-25T09:12:54.132 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.132 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.132 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155399 s, 67.5 MB/s 2024-04-25T09:12:54.148 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.148 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.148 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142013 s, 73.8 MB/s 2024-04-25T09:12:54.167 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.167 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.167 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174832 s, 60.0 MB/s 2024-04-25T09:12:54.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.192 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222405 s, 47.1 MB/s 2024-04-25T09:12:54.207 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.207 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.208 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139652 s, 75.1 MB/s 2024-04-25T09:12:54.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.224 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150024 s, 69.9 MB/s 2024-04-25T09:12:54.241 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.241 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.241 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147925 s, 70.9 MB/s 2024-04-25T09:12:54.262 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.262 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.262 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197607 s, 53.1 MB/s 2024-04-25T09:12:54.278 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.278 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.278 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140778 s, 74.5 MB/s 2024-04-25T09:12:54.295 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.295 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.295 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150491 s, 69.7 MB/s 2024-04-25T09:12:54.319 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.319 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.319 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219727 s, 47.7 MB/s 2024-04-25T09:12:54.336 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.336 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.336 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154757 s, 67.8 MB/s 2024-04-25T09:12:54.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:54.338 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:54.338 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:54.338 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.11 2024-04-25T09:12:54.338 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:54.338 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:54.338 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:54.338 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:54.409 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.409 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.409 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154947 s, 67.7 MB/s 2024-04-25T09:12:54.426 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.426 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.426 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153144 s, 68.5 MB/s 2024-04-25T09:12:54.447 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.447 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.447 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192713 s, 54.4 MB/s 2024-04-25T09:12:54.465 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.465 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.465 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016139 s, 65.0 MB/s 2024-04-25T09:12:54.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.484 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173823 s, 60.3 MB/s 2024-04-25T09:12:54.501 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.501 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.501 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150321 s, 69.8 MB/s 2024-04-25T09:12:54.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.522 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195987 s, 53.5 MB/s 2024-04-25T09:12:54.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.540 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163022 s, 64.3 MB/s 2024-04-25T09:12:54.561 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.561 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.561 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01966 s, 53.3 MB/s 2024-04-25T09:12:54.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.578 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148301 s, 70.7 MB/s 2024-04-25T09:12:54.595 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.595 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.595 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015384 s, 68.2 MB/s 2024-04-25T09:12:54.613 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.613 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.613 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164056 s, 63.9 MB/s 2024-04-25T09:12:54.631 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.631 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.631 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164672 s, 63.7 MB/s 2024-04-25T09:12:54.649 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.649 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.649 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162777 s, 64.4 MB/s 2024-04-25T09:12:54.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.665 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140207 s, 74.8 MB/s 2024-04-25T09:12:54.681 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.681 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.681 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141258 s, 74.2 MB/s 2024-04-25T09:12:54.704 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.704 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.704 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210225 s, 49.9 MB/s 2024-04-25T09:12:54.724 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.724 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.725 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188937 s, 55.5 MB/s 2024-04-25T09:12:54.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.742 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153634 s, 68.3 MB/s 2024-04-25T09:12:54.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.759 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155558 s, 67.4 MB/s 2024-04-25T09:12:54.776 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.776 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.776 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155508 s, 67.4 MB/s 2024-04-25T09:12:54.798 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.798 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.798 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197283 s, 53.2 MB/s 2024-04-25T09:12:54.815 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.815 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.815 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152263 s, 68.9 MB/s 2024-04-25T09:12:54.831 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.831 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.831 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145591 s, 72.0 MB/s 2024-04-25T09:12:54.848 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.848 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.849 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156455 s, 67.0 MB/s 2024-04-25T09:12:54.862 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.862 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.862 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119771 s, 87.5 MB/s 2024-04-25T09:12:54.879 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.879 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.880 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155592 s, 67.4 MB/s 2024-04-25T09:12:54.896 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.896 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.896 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145218 s, 72.2 MB/s 2024-04-25T09:12:54.911 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.911 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.911 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137942 s, 76.0 MB/s 2024-04-25T09:12:54.928 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.928 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.928 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143717 s, 73.0 MB/s 2024-04-25T09:12:54.944 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.945 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.945 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152702 s, 68.7 MB/s 2024-04-25T09:12:54.966 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:54.966 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:54.966 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01937 s, 54.1 MB/s 2024-04-25T09:12:54.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:54.968 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:54.968 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:54.968 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.12 2024-04-25T09:12:54.968 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:54.968 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:54.968 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:54.968 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:55.039 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.039 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.039 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142966 s, 73.3 MB/s 2024-04-25T09:12:55.061 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.061 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.061 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200582 s, 52.3 MB/s 2024-04-25T09:12:55.079 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.079 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.079 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155414 s, 67.5 MB/s 2024-04-25T09:12:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164489 s, 63.7 MB/s 2024-04-25T09:12:55.118 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.118 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.118 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196343 s, 53.4 MB/s 2024-04-25T09:12:55.131 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.131 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.132 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112437 s, 93.3 MB/s 2024-04-25T09:12:55.156 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.156 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.156 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230628 s, 45.5 MB/s 2024-04-25T09:12:55.179 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.179 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.179 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020828 s, 50.3 MB/s 2024-04-25T09:12:55.199 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.199 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.199 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177479 s, 59.1 MB/s 2024-04-25T09:12:55.220 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.220 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.220 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192532 s, 54.5 MB/s 2024-04-25T09:12:55.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.240 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182099 s, 57.6 MB/s 2024-04-25T09:12:55.260 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.260 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.260 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183421 s, 57.2 MB/s 2024-04-25T09:12:55.280 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.280 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.280 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180174 s, 58.2 MB/s 2024-04-25T09:12:55.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.298 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153646 s, 68.2 MB/s 2024-04-25T09:12:55.315 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.315 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.315 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156969 s, 66.8 MB/s 2024-04-25T09:12:55.336 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.336 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.336 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190586 s, 55.0 MB/s 2024-04-25T09:12:55.354 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.354 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.354 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156237 s, 67.1 MB/s 2024-04-25T09:12:55.374 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.374 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.374 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188696 s, 55.6 MB/s 2024-04-25T09:12:55.390 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.391 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.391 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145374 s, 72.1 MB/s 2024-04-25T09:12:55.409 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.409 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.409 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016156 s, 64.9 MB/s 2024-04-25T09:12:55.428 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.428 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.428 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178171 s, 58.9 MB/s 2024-04-25T09:12:55.445 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.445 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.445 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152045 s, 69.0 MB/s 2024-04-25T09:12:55.462 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.462 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.462 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146066 s, 71.8 MB/s 2024-04-25T09:12:55.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.484 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201614 s, 52.0 MB/s 2024-04-25T09:12:55.504 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.504 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.504 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017914 s, 58.5 MB/s 2024-04-25T09:12:55.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.523 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167961 s, 62.4 MB/s 2024-04-25T09:12:55.539 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.540 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155263 s, 67.5 MB/s 2024-04-25T09:12:55.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.556 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149362 s, 70.2 MB/s 2024-04-25T09:12:55.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.578 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196441 s, 53.4 MB/s 2024-04-25T09:12:55.597 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.597 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.597 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171328 s, 61.2 MB/s 2024-04-25T09:12:55.615 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.615 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.615 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166738 s, 62.9 MB/s 2024-04-25T09:12:55.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.632 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150784 s, 69.5 MB/s 2024-04-25T09:12:55.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:55.634 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:55.634 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:55.634 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.13 2024-04-25T09:12:55.634 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:55.634 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:55.634 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:55.634 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:55.706 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.706 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.706 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016944 s, 61.9 MB/s 2024-04-25T09:12:55.723 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.723 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.723 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015179 s, 69.1 MB/s 2024-04-25T09:12:55.742 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.742 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.742 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176745 s, 59.3 MB/s 2024-04-25T09:12:55.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.759 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150673 s, 69.6 MB/s 2024-04-25T09:12:55.780 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.780 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.780 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190037 s, 55.2 MB/s 2024-04-25T09:12:55.796 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.796 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.796 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144818 s, 72.4 MB/s 2024-04-25T09:12:55.817 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.817 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.818 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195863 s, 53.5 MB/s 2024-04-25T09:12:55.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.837 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174217 s, 60.2 MB/s 2024-04-25T09:12:55.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.858 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197308 s, 53.1 MB/s 2024-04-25T09:12:55.878 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.878 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.878 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180467 s, 58.1 MB/s 2024-04-25T09:12:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150287 s, 69.8 MB/s 2024-04-25T09:12:55.916 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.916 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.916 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190832 s, 54.9 MB/s 2024-04-25T09:12:55.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.934 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170393 s, 61.5 MB/s 2024-04-25T09:12:55.951 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.951 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.951 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149327 s, 70.2 MB/s 2024-04-25T09:12:55.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.968 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014898 s, 70.4 MB/s 2024-04-25T09:12:55.984 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:55.985 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:55.985 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147434 s, 71.1 MB/s 2024-04-25T09:12:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176526 s, 59.4 MB/s 2024-04-25T09:12:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190245 s, 55.1 MB/s 2024-04-25T09:12:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164573 s, 63.7 MB/s 2024-04-25T09:12:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187787 s, 55.8 MB/s 2024-04-25T09:12:56.080 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.080 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.080 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148125 s, 70.8 MB/s 2024-04-25T09:12:56.104 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.104 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.104 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216991 s, 48.3 MB/s 2024-04-25T09:12:56.120 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.120 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.121 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148391 s, 70.7 MB/s 2024-04-25T09:12:56.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.140 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175597 s, 59.7 MB/s 2024-04-25T09:12:56.158 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.158 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.158 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169029 s, 62.0 MB/s 2024-04-25T09:12:56.179 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.179 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.179 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193076 s, 54.3 MB/s 2024-04-25T09:12:56.203 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.203 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.203 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215392 s, 48.7 MB/s 2024-04-25T09:12:56.225 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.226 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.226 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180393 s, 58.1 MB/s 2024-04-25T09:12:56.247 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.247 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.247 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227745 s, 46.0 MB/s 2024-04-25T09:12:56.264 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.264 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.264 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014665 s, 71.5 MB/s 2024-04-25T09:12:56.280 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.280 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.280 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146533 s, 71.6 MB/s 2024-04-25T09:12:56.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.298 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166388 s, 63.0 MB/s 2024-04-25T09:12:56.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:56.301 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:56.301 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:56.301 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.14 2024-04-25T09:12:56.301 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:56.301 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:56.301 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:56.301 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152647 s, 68.7 MB/s 2024-04-25T09:12:56.399 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.399 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.399 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208025 s, 50.4 MB/s 2024-04-25T09:12:56.416 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.416 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.416 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148378 s, 70.7 MB/s 2024-04-25T09:12:56.434 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.434 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.435 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014919 s, 70.3 MB/s 2024-04-25T09:12:56.449 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.449 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.449 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152239 s, 68.9 MB/s 2024-04-25T09:12:56.470 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.470 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.471 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193311 s, 54.2 MB/s 2024-04-25T09:12:56.488 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.488 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.488 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154104 s, 68.0 MB/s 2024-04-25T09:12:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152868 s, 68.6 MB/s 2024-04-25T09:12:56.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.522 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151684 s, 69.1 MB/s 2024-04-25T09:12:56.543 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.543 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.543 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019664 s, 53.3 MB/s 2024-04-25T09:12:56.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.559 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140284 s, 74.7 MB/s 2024-04-25T09:12:56.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.576 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149541 s, 70.1 MB/s 2024-04-25T09:12:56.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.592 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144482 s, 72.6 MB/s 2024-04-25T09:12:56.616 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.616 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.616 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218845 s, 47.9 MB/s 2024-04-25T09:12:56.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.632 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147393 s, 71.1 MB/s 2024-04-25T09:12:56.651 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.651 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.651 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167681 s, 62.5 MB/s 2024-04-25T09:12:56.671 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.671 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.671 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178667 s, 58.7 MB/s 2024-04-25T09:12:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168521 s, 62.2 MB/s 2024-04-25T09:12:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194785 s, 53.8 MB/s 2024-04-25T09:12:56.727 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.727 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.727 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144976 s, 72.3 MB/s 2024-04-25T09:12:56.751 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.751 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.751 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222396 s, 47.1 MB/s 2024-04-25T09:12:56.769 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.769 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165935 s, 63.2 MB/s 2024-04-25T09:12:56.787 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.787 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.787 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016097 s, 65.1 MB/s 2024-04-25T09:12:56.809 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.809 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.809 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201331 s, 52.1 MB/s 2024-04-25T09:12:56.826 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.826 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.827 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153358 s, 68.4 MB/s 2024-04-25T09:12:56.847 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019388 s, 54.1 MB/s 2024-04-25T09:12:56.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.865 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155206 s, 67.6 MB/s 2024-04-25T09:12:56.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.882 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155014 s, 67.6 MB/s 2024-04-25T09:12:56.901 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.901 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.901 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169426 s, 61.9 MB/s 2024-04-25T09:12:56.920 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.920 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.920 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169812 s, 61.7 MB/s 2024-04-25T09:12:56.937 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161066 s, 65.1 MB/s 2024-04-25T09:12:56.956 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:56.956 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:56.956 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017105 s, 61.3 MB/s 2024-04-25T09:12:56.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:56.958 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:56.958 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:56.958 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.15 2024-04-25T09:12:56.958 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:56.958 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:56.958 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:56.958 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:57.033 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.033 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.033 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162131 s, 64.7 MB/s 2024-04-25T09:12:57.049 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.049 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.049 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142303 s, 73.7 MB/s 2024-04-25T09:12:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219036 s, 47.9 MB/s 2024-04-25T09:12:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161369 s, 65.0 MB/s 2024-04-25T09:12:57.108 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.109 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.109 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162191 s, 64.7 MB/s 2024-04-25T09:12:57.129 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.129 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.129 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183419 s, 57.2 MB/s 2024-04-25T09:12:57.149 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.149 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.149 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184663 s, 56.8 MB/s 2024-04-25T09:12:57.166 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.166 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.166 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153002 s, 68.5 MB/s 2024-04-25T09:12:57.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.183 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151608 s, 69.2 MB/s 2024-04-25T09:12:57.201 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.201 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.201 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165243 s, 63.5 MB/s 2024-04-25T09:12:57.218 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.218 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.219 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154277 s, 68.0 MB/s 2024-04-25T09:12:57.235 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.235 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.235 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014491 s, 72.4 MB/s 2024-04-25T09:12:57.251 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.251 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.251 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138857 s, 75.5 MB/s 2024-04-25T09:12:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147028 s, 71.3 MB/s 2024-04-25T09:12:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148217 s, 70.7 MB/s 2024-04-25T09:12:57.303 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.303 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.303 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173646 s, 60.4 MB/s 2024-04-25T09:12:57.319 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.319 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.319 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145242 s, 72.2 MB/s 2024-04-25T09:12:57.339 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.339 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.339 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175866 s, 59.6 MB/s 2024-04-25T09:12:57.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.360 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197289 s, 53.1 MB/s 2024-04-25T09:12:57.378 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.379 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.379 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164678 s, 63.7 MB/s 2024-04-25T09:12:57.395 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.395 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.395 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146807 s, 71.4 MB/s 2024-04-25T09:12:57.414 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.414 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.414 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171443 s, 61.2 MB/s 2024-04-25T09:12:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148463 s, 70.6 MB/s 2024-04-25T09:12:57.451 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.451 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.452 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186891 s, 56.1 MB/s 2024-04-25T09:12:57.464 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.465 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.465 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113594 s, 92.3 MB/s 2024-04-25T09:12:57.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.484 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176964 s, 59.3 MB/s 2024-04-25T09:12:57.500 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.500 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.500 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143717 s, 73.0 MB/s 2024-04-25T09:12:57.517 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.517 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.517 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148768 s, 70.5 MB/s 2024-04-25T09:12:57.536 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.536 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.536 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177084 s, 59.2 MB/s 2024-04-25T09:12:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204253 s, 51.3 MB/s 2024-04-25T09:12:57.575 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.575 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.575 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146907 s, 71.4 MB/s 2024-04-25T09:12:57.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.592 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01487 s, 70.5 MB/s 2024-04-25T09:12:57.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:57.594 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:57.594 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:57.594 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.16 2024-04-25T09:12:57.594 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:57.594 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:57.594 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:57.594 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:57.669 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.670 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.670 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165951 s, 63.2 MB/s 2024-04-25T09:12:57.688 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.688 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.688 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169093 s, 62.0 MB/s 2024-04-25T09:12:57.708 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.708 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.709 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018619 s, 56.3 MB/s 2024-04-25T09:12:57.726 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.726 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.726 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156909 s, 66.8 MB/s 2024-04-25T09:12:57.743 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.743 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.743 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153479 s, 68.3 MB/s 2024-04-25T09:12:57.762 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.762 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.762 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170951 s, 61.3 MB/s 2024-04-25T09:12:57.781 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.781 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.781 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174318 s, 60.2 MB/s 2024-04-25T09:12:57.799 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.799 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.799 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164741 s, 63.7 MB/s 2024-04-25T09:12:57.816 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.816 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.816 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014882 s, 70.5 MB/s 2024-04-25T09:12:57.832 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146061 s, 71.8 MB/s 2024-04-25T09:12:57.849 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.849 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.849 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148811 s, 70.5 MB/s 2024-04-25T09:12:57.868 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.868 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.868 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166305 s, 63.1 MB/s 2024-04-25T09:12:57.883 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.884 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.884 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140659 s, 74.5 MB/s 2024-04-25T09:12:57.901 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.901 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.901 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151436 s, 69.2 MB/s 2024-04-25T09:12:57.921 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.921 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.921 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182543 s, 57.4 MB/s 2024-04-25T09:12:57.937 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.937 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.937 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148191 s, 70.8 MB/s 2024-04-25T09:12:57.958 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.959 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.959 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01945 s, 53.9 MB/s 2024-04-25T09:12:57.975 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.975 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.975 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148863 s, 70.4 MB/s 2024-04-25T09:12:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017169 s, 61.1 MB/s 2024-04-25T09:12:58.010 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.010 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.010 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139205 s, 75.3 MB/s 2024-04-25T09:12:58.027 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.027 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.027 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147621 s, 71.0 MB/s 2024-04-25T09:12:58.047 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.047 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.047 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184336 s, 56.9 MB/s 2024-04-25T09:12:58.067 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.067 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.068 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01862 s, 56.3 MB/s 2024-04-25T09:12:58.085 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.085 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.086 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163562 s, 64.1 MB/s 2024-04-25T09:12:58.104 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.104 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.104 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167257 s, 62.7 MB/s 2024-04-25T09:12:58.125 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.125 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.125 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189286 s, 55.4 MB/s 2024-04-25T09:12:58.141 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.141 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.142 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014865 s, 70.5 MB/s 2024-04-25T09:12:58.158 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.158 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.158 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149174 s, 70.3 MB/s 2024-04-25T09:12:58.178 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.178 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.178 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183965 s, 57.0 MB/s 2024-04-25T09:12:58.197 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.197 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.197 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016773 s, 62.5 MB/s 2024-04-25T09:12:58.214 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.214 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.215 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016065 s, 65.3 MB/s 2024-04-25T09:12:58.231 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.231 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.231 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014544 s, 72.1 MB/s 2024-04-25T09:12:58.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:58.233 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:58.233 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:58.233 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.17 2024-04-25T09:12:58.233 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:58.233 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:58.233 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:58.233 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:58.305 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.305 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.305 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160797 s, 65.2 MB/s 2024-04-25T09:12:58.321 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.322 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.322 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148168 s, 70.8 MB/s 2024-04-25T09:12:58.339 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.339 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.339 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153991 s, 68.1 MB/s 2024-04-25T09:12:58.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.361 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198499 s, 52.8 MB/s 2024-04-25T09:12:58.377 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.377 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.377 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151797 s, 69.1 MB/s 2024-04-25T09:12:58.397 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.397 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.397 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176124 s, 59.5 MB/s 2024-04-25T09:12:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154184 s, 68.0 MB/s 2024-04-25T09:12:58.431 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.431 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.431 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152623 s, 68.7 MB/s 2024-04-25T09:12:58.452 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.452 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.452 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189038 s, 55.5 MB/s 2024-04-25T09:12:58.470 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.470 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.470 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165846 s, 63.2 MB/s 2024-04-25T09:12:58.487 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.487 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.487 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015128 s, 69.3 MB/s 2024-04-25T09:12:58.503 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.503 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.503 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145512 s, 72.1 MB/s 2024-04-25T09:12:58.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.522 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171247 s, 61.2 MB/s 2024-04-25T09:12:58.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.540 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162392 s, 64.6 MB/s 2024-04-25T09:12:58.558 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.558 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.558 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158783 s, 66.0 MB/s 2024-04-25T09:12:58.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.576 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165261 s, 63.4 MB/s 2024-04-25T09:12:58.593 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.593 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.593 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149671 s, 70.1 MB/s 2024-04-25T09:12:58.609 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.609 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.609 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143326 s, 73.2 MB/s 2024-04-25T09:12:58.626 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.626 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.626 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153998 s, 68.1 MB/s 2024-04-25T09:12:58.643 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.643 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.643 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153152 s, 68.5 MB/s 2024-04-25T09:12:58.662 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.662 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.662 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170961 s, 61.3 MB/s 2024-04-25T09:12:58.679 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.679 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.679 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152448 s, 68.8 MB/s 2024-04-25T09:12:58.696 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.696 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.696 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152122 s, 68.9 MB/s 2024-04-25T09:12:58.715 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.715 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.715 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167294 s, 62.7 MB/s 2024-04-25T09:12:58.734 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.734 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.734 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172554 s, 60.8 MB/s 2024-04-25T09:12:58.753 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.753 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.753 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172612 s, 60.7 MB/s 2024-04-25T09:12:58.774 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.774 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.774 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191872 s, 54.6 MB/s 2024-04-25T09:12:58.792 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.792 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.792 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167963 s, 62.4 MB/s 2024-04-25T09:12:58.813 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.813 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.813 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193524 s, 54.2 MB/s 2024-04-25T09:12:58.830 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.830 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.830 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152021 s, 69.0 MB/s 2024-04-25T09:12:58.849 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.849 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.849 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170245 s, 61.6 MB/s 2024-04-25T09:12:58.867 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.867 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.868 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166702 s, 62.9 MB/s 2024-04-25T09:12:58.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:58.869 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:58.869 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:58.869 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.18 2024-04-25T09:12:58.870 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:58.870 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:58.870 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:58.870 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:58.950 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.950 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.950 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210349 s, 49.8 MB/s 2024-04-25T09:12:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173498 s, 60.4 MB/s 2024-04-25T09:12:58.986 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:58.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:58.987 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015578 s, 67.3 MB/s 2024-04-25T09:12:59.007 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.008 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.008 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189979 s, 55.2 MB/s 2024-04-25T09:12:59.024 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.024 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.025 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015121 s, 69.3 MB/s 2024-04-25T09:12:59.041 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.041 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.042 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015056 s, 69.6 MB/s 2024-04-25T09:12:59.056 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.056 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.056 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127443 s, 82.3 MB/s 2024-04-25T09:12:59.075 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.075 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.075 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175067 s, 59.9 MB/s 2024-04-25T09:12:59.093 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.093 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.093 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158967 s, 66.0 MB/s 2024-04-25T09:12:59.111 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.111 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.111 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01648 s, 63.6 MB/s 2024-04-25T09:12:59.125 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.126 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.126 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124161 s, 84.5 MB/s 2024-04-25T09:12:59.146 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.146 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.146 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187986 s, 55.8 MB/s 2024-04-25T09:12:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.167 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.167 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187635 s, 55.9 MB/s 2024-04-25T09:12:59.185 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.185 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.185 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164498 s, 63.7 MB/s 2024-04-25T09:12:59.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.205 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186185 s, 56.3 MB/s 2024-04-25T09:12:59.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.224 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164438 s, 63.8 MB/s 2024-04-25T09:12:59.243 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.243 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.243 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180357 s, 58.1 MB/s 2024-04-25T09:12:59.260 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.261 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.261 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152554 s, 68.7 MB/s 2024-04-25T09:12:59.277 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.277 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.277 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149231 s, 70.3 MB/s 2024-04-25T09:12:59.293 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.293 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.293 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143426 s, 73.1 MB/s 2024-04-25T09:12:59.309 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.310 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.310 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145699 s, 72.0 MB/s 2024-04-25T09:12:59.326 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.327 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.327 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151562 s, 69.2 MB/s 2024-04-25T09:12:59.345 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.345 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.345 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168034 s, 62.4 MB/s 2024-04-25T09:12:59.362 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.362 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.362 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152162 s, 68.9 MB/s 2024-04-25T09:12:59.381 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.381 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.381 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167122 s, 62.7 MB/s 2024-04-25T09:12:59.397 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.397 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.397 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146498 s, 71.6 MB/s 2024-04-25T09:12:59.416 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.416 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.416 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017214 s, 60.9 MB/s 2024-04-25T09:12:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149266 s, 70.2 MB/s 2024-04-25T09:12:59.453 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.453 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.453 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018139 s, 57.8 MB/s 2024-04-25T09:12:59.470 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.470 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.470 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155456 s, 67.5 MB/s 2024-04-25T09:12:59.488 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.489 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.489 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165495 s, 63.4 MB/s 2024-04-25T09:12:59.506 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.506 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.506 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152891 s, 68.6 MB/s 2024-04-25T09:12:59.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:59.507 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:12:59.507 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:12:59.507 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.19 2024-04-25T09:12:59.507 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:12:59.507 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:12:59.507 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:12:59.507 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:12:59.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.577 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.577 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157369 s, 66.6 MB/s 2024-04-25T09:12:59.593 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.593 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.593 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143517 s, 73.1 MB/s 2024-04-25T09:12:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194824 s, 53.8 MB/s 2024-04-25T09:12:59.631 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.631 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.631 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154125 s, 68.0 MB/s 2024-04-25T09:12:59.652 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.652 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.652 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182353 s, 57.5 MB/s 2024-04-25T09:12:59.668 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.668 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.668 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148459 s, 70.6 MB/s 2024-04-25T09:12:59.685 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.685 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.685 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153205 s, 68.4 MB/s 2024-04-25T09:12:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160965 s, 65.1 MB/s 2024-04-25T09:12:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197174 s, 53.2 MB/s 2024-04-25T09:12:59.749 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.749 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.749 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226213 s, 46.4 MB/s 2024-04-25T09:12:59.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.766 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148725 s, 70.5 MB/s 2024-04-25T09:12:59.787 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.787 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.787 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190238 s, 55.1 MB/s 2024-04-25T09:12:59.803 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.803 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.804 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149045 s, 70.4 MB/s 2024-04-25T09:12:59.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.822 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161479 s, 64.9 MB/s 2024-04-25T09:12:59.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.838 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147917 s, 70.9 MB/s 2024-04-25T09:12:59.861 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.861 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.862 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216499 s, 48.4 MB/s 2024-04-25T09:12:59.878 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.878 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.878 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151645 s, 69.1 MB/s 2024-04-25T09:12:59.894 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.894 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.895 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141693 s, 74.0 MB/s 2024-04-25T09:12:59.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.915 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181437 s, 57.8 MB/s 2024-04-25T09:12:59.932 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.933 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.933 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162459 s, 64.5 MB/s 2024-04-25T09:12:59.951 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.951 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.951 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166945 s, 62.8 MB/s 2024-04-25T09:12:59.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.968 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148074 s, 70.8 MB/s 2024-04-25T09:12:59.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:12:59.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:12:59.987 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017554 s, 59.7 MB/s 2024-04-25T09:13:00.004 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.004 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.004 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151094 s, 69.4 MB/s 2024-04-25T09:13:00.020 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146824 s, 71.4 MB/s 2024-04-25T09:13:00.037 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.037 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.037 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143789 s, 72.9 MB/s 2024-04-25T09:13:00.053 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.054 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.054 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150067 s, 69.9 MB/s 2024-04-25T09:13:00.072 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.072 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.072 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168229 s, 62.3 MB/s 2024-04-25T09:13:00.088 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.089 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.089 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014387 s, 72.9 MB/s 2024-04-25T09:13:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.102 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011325 s, 92.6 MB/s 2024-04-25T09:13:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159037 s, 65.9 MB/s 2024-04-25T09:13:00.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.136 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014867 s, 70.5 MB/s 2024-04-25T09:13:00.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:00.137 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:13:00.138 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:13:00.138 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.20 2024-04-25T09:13:00.138 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:13:00.138 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:13:00.138 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:13:00.138 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:13:00.210 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.210 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.210 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167652 s, 62.5 MB/s 2024-04-25T09:13:00.226 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.226 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.226 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146868 s, 71.4 MB/s 2024-04-25T09:13:00.247 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.247 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.247 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185571 s, 56.5 MB/s 2024-04-25T09:13:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162641 s, 64.5 MB/s 2024-04-25T09:13:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168868 s, 62.1 MB/s 2024-04-25T09:13:00.304 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.304 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.304 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180758 s, 58.0 MB/s 2024-04-25T09:13:00.319 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.319 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.319 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133878 s, 78.3 MB/s 2024-04-25T09:13:00.338 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.338 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.338 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168119 s, 62.4 MB/s 2024-04-25T09:13:00.356 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.356 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.356 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161902 s, 64.8 MB/s 2024-04-25T09:13:00.373 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.373 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.373 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015054 s, 69.7 MB/s 2024-04-25T09:13:00.391 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.391 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.391 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162093 s, 64.7 MB/s 2024-04-25T09:13:00.407 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.407 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.407 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144765 s, 72.4 MB/s 2024-04-25T09:13:00.426 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.426 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.426 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163488 s, 64.1 MB/s 2024-04-25T09:13:00.442 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.442 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.442 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151608 s, 69.2 MB/s 2024-04-25T09:13:00.461 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.461 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.461 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016979 s, 61.8 MB/s 2024-04-25T09:13:00.478 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.478 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.478 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152765 s, 68.6 MB/s 2024-04-25T09:13:00.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.497 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167225 s, 62.7 MB/s 2024-04-25T09:13:00.516 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.516 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.516 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173677 s, 60.4 MB/s 2024-04-25T09:13:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154495 s, 67.9 MB/s 2024-04-25T09:13:00.554 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.554 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.554 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195366 s, 53.7 MB/s 2024-04-25T09:13:00.574 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.575 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.575 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185089 s, 56.7 MB/s 2024-04-25T09:13:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142296 s, 73.7 MB/s 2024-04-25T09:13:00.615 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.615 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.615 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226441 s, 46.3 MB/s 2024-04-25T09:13:00.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.632 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148004 s, 70.8 MB/s 2024-04-25T09:13:00.653 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.653 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.653 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191214 s, 54.8 MB/s 2024-04-25T09:13:00.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.672 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169303 s, 61.9 MB/s 2024-04-25T09:13:00.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.690 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017052 s, 61.5 MB/s 2024-04-25T09:13:00.709 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.709 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.709 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167877 s, 62.5 MB/s 2024-04-25T09:13:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121064 s, 86.6 MB/s 2024-04-25T09:13:00.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.741 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169156 s, 62.0 MB/s 2024-04-25T09:13:00.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.759 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161412 s, 65.0 MB/s 2024-04-25T09:13:00.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.777 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162178 s, 64.7 MB/s 2024-04-25T09:13:00.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:00.779 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:13:00.779 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:13:00.779 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.21 2024-04-25T09:13:00.779 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:13:00.779 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:13:00.779 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:13:00.779 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:13:00.847 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.847 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.847 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014194 s, 73.9 MB/s 2024-04-25T09:13:00.866 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.867 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.867 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173301 s, 60.5 MB/s 2024-04-25T09:13:00.884 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.884 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.884 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154476 s, 67.9 MB/s 2024-04-25T09:13:00.902 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.902 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.902 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159909 s, 65.6 MB/s 2024-04-25T09:13:00.917 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.917 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.917 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140681 s, 74.5 MB/s 2024-04-25T09:13:00.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.934 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145601 s, 72.0 MB/s 2024-04-25T09:13:00.958 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.958 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.958 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225547 s, 46.5 MB/s 2024-04-25T09:13:00.975 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.975 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.976 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156357 s, 67.1 MB/s 2024-04-25T09:13:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177261 s, 59.2 MB/s 2024-04-25T09:13:01.009 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.009 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.009 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012159 s, 86.2 MB/s 2024-04-25T09:13:01.029 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.029 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.029 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182031 s, 57.6 MB/s 2024-04-25T09:13:01.045 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.045 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.045 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141578 s, 74.1 MB/s 2024-04-25T09:13:01.061 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.061 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.061 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014624 s, 71.7 MB/s 2024-04-25T09:13:01.078 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.078 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.078 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150914 s, 69.5 MB/s 2024-04-25T09:13:01.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.097 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169788 s, 61.8 MB/s 2024-04-25T09:13:01.120 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.120 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.120 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214013 s, 49.0 MB/s 2024-04-25T09:13:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142176 s, 73.8 MB/s 2024-04-25T09:13:01.155 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.155 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.155 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168342 s, 62.3 MB/s 2024-04-25T09:13:01.171 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.171 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.171 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144057 s, 72.8 MB/s 2024-04-25T09:13:01.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.192 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189503 s, 55.3 MB/s 2024-04-25T09:13:01.213 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.214 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.214 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201394 s, 52.1 MB/s 2024-04-25T09:13:01.232 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.233 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.233 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171576 s, 61.1 MB/s 2024-04-25T09:13:01.252 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.252 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.252 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172848 s, 60.7 MB/s 2024-04-25T09:13:01.267 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.267 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.268 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135925 s, 77.1 MB/s 2024-04-25T09:13:01.283 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.283 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.283 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140959 s, 74.4 MB/s 2024-04-25T09:13:01.300 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.300 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.300 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151692 s, 69.1 MB/s 2024-04-25T09:13:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145496 s, 72.1 MB/s 2024-04-25T09:13:01.332 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.333 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.333 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145006 s, 72.3 MB/s 2024-04-25T09:13:01.350 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.350 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.350 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152968 s, 68.5 MB/s 2024-04-25T09:13:01.366 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.366 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.366 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144263 s, 72.7 MB/s 2024-04-25T09:13:01.384 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.384 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.384 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164296 s, 63.8 MB/s 2024-04-25T09:13:01.401 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.401 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.401 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150748 s, 69.6 MB/s 2024-04-25T09:13:01.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:01.403 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:13:01.403 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:13:01.403 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.22 2024-04-25T09:13:01.403 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:13:01.403 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:13:01.403 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:13:01.403 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:13:01.479 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.479 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.479 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180861 s, 58.0 MB/s 2024-04-25T09:13:01.495 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.495 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.495 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142739 s, 73.5 MB/s 2024-04-25T09:13:01.511 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146829 s, 71.4 MB/s 2024-04-25T09:13:01.530 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.530 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.530 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169419 s, 61.9 MB/s 2024-04-25T09:13:01.547 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.547 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.547 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146684 s, 71.5 MB/s 2024-04-25T09:13:01.564 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.564 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.564 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015289 s, 68.6 MB/s 2024-04-25T09:13:01.583 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.583 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.583 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173282 s, 60.5 MB/s 2024-04-25T09:13:01.600 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.600 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.600 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157925 s, 66.4 MB/s 2024-04-25T09:13:01.616 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.616 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.616 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143306 s, 73.2 MB/s 2024-04-25T09:13:01.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.632 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142394 s, 73.6 MB/s 2024-04-25T09:13:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155857 s, 67.3 MB/s 2024-04-25T09:13:01.666 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.667 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145494 s, 72.1 MB/s 2024-04-25T09:13:01.684 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.684 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.684 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158608 s, 66.1 MB/s 2024-04-25T09:13:01.705 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.705 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.705 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194747 s, 53.8 MB/s 2024-04-25T09:13:01.721 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.721 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.721 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145372 s, 72.1 MB/s 2024-04-25T09:13:01.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.739 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160946 s, 65.2 MB/s 2024-04-25T09:13:01.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.760 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185281 s, 56.6 MB/s 2024-04-25T09:13:01.776 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.776 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.776 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145651 s, 72.0 MB/s 2024-04-25T09:13:01.793 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.793 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.793 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151851 s, 69.1 MB/s 2024-04-25T09:13:01.811 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.811 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.812 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166822 s, 62.9 MB/s 2024-04-25T09:13:01.827 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.828 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.828 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144463 s, 72.6 MB/s 2024-04-25T09:13:01.850 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.850 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.850 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020673 s, 50.7 MB/s 2024-04-25T09:13:01.866 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.866 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.866 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142767 s, 73.4 MB/s 2024-04-25T09:13:01.883 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.883 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.883 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153377 s, 68.4 MB/s 2024-04-25T09:13:01.899 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.899 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.899 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013859 s, 75.7 MB/s 2024-04-25T09:13:01.920 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.920 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197174 s, 53.2 MB/s 2024-04-25T09:13:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.939 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.939 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162268 s, 64.6 MB/s 2024-04-25T09:13:01.955 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.955 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.955 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149883 s, 70.0 MB/s 2024-04-25T09:13:01.971 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.971 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.972 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145562 s, 72.0 MB/s 2024-04-25T09:13:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199655 s, 52.5 MB/s 2024-04-25T09:13:02.012 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.012 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.012 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170589 s, 61.5 MB/s 2024-04-25T09:13:02.031 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.031 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.031 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173407 s, 60.5 MB/s 2024-04-25T09:13:02.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:02.033 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:13:02.033 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:13:02.033 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.23 2024-04-25T09:13:02.033 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:13:02.033 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:13:02.033 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:13:02.033 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:13:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182539 s, 57.4 MB/s 2024-04-25T09:13:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142695 s, 73.5 MB/s 2024-04-25T09:13:02.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.140 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148863 s, 70.4 MB/s 2024-04-25T09:13:02.162 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.162 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.162 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200675 s, 52.3 MB/s 2024-04-25T09:13:02.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.183 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191978 s, 54.6 MB/s 2024-04-25T09:13:02.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.200 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015398 s, 68.1 MB/s 2024-04-25T09:13:02.220 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.220 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.220 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184649 s, 56.8 MB/s 2024-04-25T09:13:02.238 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.238 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.238 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156794 s, 66.9 MB/s 2024-04-25T09:13:02.254 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.254 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.254 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150508 s, 69.7 MB/s 2024-04-25T09:13:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023266 s, 45.1 MB/s 2024-04-25T09:13:02.303 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.303 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.303 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217208 s, 48.3 MB/s 2024-04-25T09:13:02.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.324 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.324 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187525 s, 55.9 MB/s 2024-04-25T09:13:02.339 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.340 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.340 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144205 s, 72.7 MB/s 2024-04-25T09:13:02.355 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.356 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.356 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141361 s, 74.2 MB/s 2024-04-25T09:13:02.372 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.372 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151437 s, 69.2 MB/s 2024-04-25T09:13:02.389 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150106 s, 69.9 MB/s 2024-04-25T09:13:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190709 s, 55.0 MB/s 2024-04-25T09:13:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149314 s, 70.2 MB/s 2024-04-25T09:13:02.446 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.446 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.446 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175944 s, 59.6 MB/s 2024-04-25T09:13:02.462 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.463 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.463 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014581 s, 71.9 MB/s 2024-04-25T09:13:02.481 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.482 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.482 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017311 s, 60.6 MB/s 2024-04-25T09:13:02.499 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.499 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.499 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157437 s, 66.6 MB/s 2024-04-25T09:13:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148733 s, 70.5 MB/s 2024-04-25T09:13:02.532 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.532 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.532 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014572 s, 72.0 MB/s 2024-04-25T09:13:02.551 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.551 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.551 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165586 s, 63.3 MB/s 2024-04-25T09:13:02.574 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.574 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.574 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021458 s, 48.9 MB/s 2024-04-25T09:13:02.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.593 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168077 s, 62.4 MB/s 2024-04-25T09:13:02.609 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.609 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.609 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149137 s, 70.3 MB/s 2024-04-25T09:13:02.627 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.627 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.627 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158922 s, 66.0 MB/s 2024-04-25T09:13:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019245 s, 54.5 MB/s 2024-04-25T09:13:02.669 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.669 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.669 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192076 s, 54.6 MB/s 2024-04-25T09:13:02.689 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.689 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.689 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179664 s, 58.4 MB/s 2024-04-25T09:13:02.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:02.690 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:13:02.690 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:13:02.690 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.24 2024-04-25T09:13:02.691 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:13:02.691 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:13:02.691 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:13:02.691 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:13:02.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.766 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152179 s, 68.9 MB/s 2024-04-25T09:13:02.783 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.783 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.783 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162756 s, 64.4 MB/s 2024-04-25T09:13:02.801 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.801 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.801 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161632 s, 64.9 MB/s 2024-04-25T09:13:02.819 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.819 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.819 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154317 s, 67.9 MB/s 2024-04-25T09:13:02.832 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.833 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.833 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124358 s, 84.3 MB/s 2024-04-25T09:13:02.851 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.851 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.852 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017031 s, 61.6 MB/s 2024-04-25T09:13:02.869 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.869 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.869 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016113 s, 65.1 MB/s 2024-04-25T09:13:02.883 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.883 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.883 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011887 s, 88.2 MB/s 2024-04-25T09:13:02.900 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.900 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.900 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151743 s, 69.1 MB/s 2024-04-25T09:13:02.921 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.921 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.921 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194 s, 54.1 MB/s 2024-04-25T09:13:02.938 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.938 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.938 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146638 s, 71.5 MB/s 2024-04-25T09:13:02.954 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.954 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.955 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149089 s, 70.3 MB/s 2024-04-25T09:13:02.970 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.970 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.970 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014154 s, 74.1 MB/s 2024-04-25T09:13:02.989 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:02.989 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:02.989 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164747 s, 63.6 MB/s 2024-04-25T09:13:03.010 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.010 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.010 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194403 s, 53.9 MB/s 2024-04-25T09:13:03.028 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.028 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.028 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162327 s, 64.6 MB/s 2024-04-25T09:13:03.043 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.043 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.044 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013985 s, 75.0 MB/s 2024-04-25T09:13:03.062 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.062 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.062 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164777 s, 63.6 MB/s 2024-04-25T09:13:03.083 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.083 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.083 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019428 s, 54.0 MB/s 2024-04-25T09:13:03.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.100 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150076 s, 69.9 MB/s 2024-04-25T09:13:03.116 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.116 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.116 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145847 s, 71.9 MB/s 2024-04-25T09:13:03.137 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.137 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.138 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192042 s, 54.6 MB/s 2024-04-25T09:13:03.154 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.154 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.154 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149212 s, 70.3 MB/s 2024-04-25T09:13:03.170 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.171 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.171 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014524 s, 72.2 MB/s 2024-04-25T09:13:03.187 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.187 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.187 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144875 s, 72.4 MB/s 2024-04-25T09:13:03.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.205 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162782 s, 64.4 MB/s 2024-04-25T09:13:03.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.222 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150888 s, 69.5 MB/s 2024-04-25T09:13:03.241 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.241 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.241 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173151 s, 60.6 MB/s 2024-04-25T09:13:03.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.257 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148056 s, 70.8 MB/s 2024-04-25T09:13:03.274 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.274 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.274 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150011 s, 69.9 MB/s 2024-04-25T09:13:03.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.295 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186615 s, 56.2 MB/s 2024-04-25T09:13:03.314 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.314 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.314 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177258 s, 59.2 MB/s 2024-04-25T09:13:03.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:03.315 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:13:03.315 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:13:03.316 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.25 2024-04-25T09:13:03.316 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:13:03.316 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:13:03.316 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:13:03.316 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:13:03.385 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.385 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.386 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167536 s, 62.6 MB/s 2024-04-25T09:13:03.405 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.405 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.405 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179512 s, 58.4 MB/s 2024-04-25T09:13:03.423 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.423 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.423 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163732 s, 64.0 MB/s 2024-04-25T09:13:03.441 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.441 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.441 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157751 s, 66.5 MB/s 2024-04-25T09:13:03.458 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.458 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.458 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149671 s, 70.1 MB/s 2024-04-25T09:13:03.480 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.480 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.480 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201628 s, 52.0 MB/s 2024-04-25T09:13:03.500 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.500 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.500 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186703 s, 56.2 MB/s 2024-04-25T09:13:03.517 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.517 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.517 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151328 s, 69.3 MB/s 2024-04-25T09:13:03.533 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.533 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.533 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146077 s, 71.8 MB/s 2024-04-25T09:13:03.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.556 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205788 s, 51.0 MB/s 2024-04-25T09:13:03.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.576 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184655 s, 56.8 MB/s 2024-04-25T09:13:03.594 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.594 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.594 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167528 s, 62.6 MB/s 2024-04-25T09:13:03.616 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.616 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.616 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020144 s, 52.1 MB/s 2024-04-25T09:13:03.637 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.637 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.637 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190596 s, 55.0 MB/s 2024-04-25T09:13:03.657 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.657 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.657 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185336 s, 56.6 MB/s 2024-04-25T09:13:03.675 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.675 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.675 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157436 s, 66.6 MB/s 2024-04-25T09:13:03.693 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.693 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.693 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159988 s, 65.5 MB/s 2024-04-25T09:13:03.715 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.716 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.716 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207581 s, 50.5 MB/s 2024-04-25T09:13:03.733 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.733 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.733 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158369 s, 66.2 MB/s 2024-04-25T09:13:03.750 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.750 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.750 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153926 s, 68.1 MB/s 2024-04-25T09:13:03.768 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.768 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.768 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158985 s, 66.0 MB/s 2024-04-25T09:13:03.789 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.789 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.789 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019082 s, 55.0 MB/s 2024-04-25T09:13:03.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.806 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.806 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150224 s, 69.8 MB/s 2024-04-25T09:13:03.822 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.823 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.823 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151998 s, 69.0 MB/s 2024-04-25T09:13:03.844 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.844 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.844 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193537 s, 54.2 MB/s 2024-04-25T09:13:03.861 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.861 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.861 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153867 s, 68.1 MB/s 2024-04-25T09:13:03.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.883 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196705 s, 53.3 MB/s 2024-04-25T09:13:03.902 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.903 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.903 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184534 s, 56.8 MB/s 2024-04-25T09:13:03.919 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.919 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.919 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147754 s, 71.0 MB/s 2024-04-25T09:13:03.938 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.938 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.939 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176226 s, 59.5 MB/s 2024-04-25T09:13:03.955 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.955 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.955 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148776 s, 70.5 MB/s 2024-04-25T09:13:03.971 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:03.971 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:03.971 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144327 s, 72.7 MB/s 2024-04-25T09:13:03.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:03.973 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:13:03.973 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:13:03.973 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.26 2024-04-25T09:13:03.973 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:13:03.973 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:13:03.973 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:13:03.973 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:13:04.050 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.050 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.050 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170355 s, 61.6 MB/s 2024-04-25T09:13:04.067 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.067 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.067 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150021 s, 69.9 MB/s 2024-04-25T09:13:04.087 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.087 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.087 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186346 s, 56.3 MB/s 2024-04-25T09:13:04.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.101 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115444 s, 90.8 MB/s 2024-04-25T09:13:04.118 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.118 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.118 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156842 s, 66.9 MB/s 2024-04-25T09:13:04.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.137 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.137 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170181 s, 61.6 MB/s 2024-04-25T09:13:04.157 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.157 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.157 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188382 s, 55.7 MB/s 2024-04-25T09:13:04.173 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.173 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.173 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139864 s, 75.0 MB/s 2024-04-25T09:13:04.193 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.193 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.193 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178505 s, 58.7 MB/s 2024-04-25T09:13:04.209 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.209 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.209 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149768 s, 70.0 MB/s 2024-04-25T09:13:04.226 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.226 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.226 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146945 s, 71.4 MB/s 2024-04-25T09:13:04.249 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.249 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.249 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021262 s, 49.3 MB/s 2024-04-25T09:13:04.265 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.265 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.265 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014476 s, 72.4 MB/s 2024-04-25T09:13:04.283 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.283 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.283 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160039 s, 65.5 MB/s 2024-04-25T09:13:04.300 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.300 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.300 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151465 s, 69.2 MB/s 2024-04-25T09:13:04.317 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.318 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.318 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161307 s, 65.0 MB/s 2024-04-25T09:13:04.338 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.338 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.338 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191155 s, 54.9 MB/s 2024-04-25T09:13:04.357 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.357 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.357 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166108 s, 63.1 MB/s 2024-04-25T09:13:04.373 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.373 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.373 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014875 s, 70.5 MB/s 2024-04-25T09:13:04.392 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.392 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.392 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017073 s, 61.4 MB/s 2024-04-25T09:13:04.405 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.405 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.405 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109924 s, 95.4 MB/s 2024-04-25T09:13:04.423 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.423 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.423 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162194 s, 64.6 MB/s 2024-04-25T09:13:04.444 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.444 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.445 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198814 s, 52.7 MB/s 2024-04-25T09:13:04.462 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.462 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.463 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160561 s, 65.3 MB/s 2024-04-25T09:13:04.482 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.482 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.482 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174058 s, 60.2 MB/s 2024-04-25T09:13:04.499 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.499 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.500 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161262 s, 65.0 MB/s 2024-04-25T09:13:04.518 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.518 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.518 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168948 s, 62.1 MB/s 2024-04-25T09:13:04.535 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.535 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.535 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147999 s, 70.9 MB/s 2024-04-25T09:13:04.551 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.551 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.551 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146637 s, 71.5 MB/s 2024-04-25T09:13:04.568 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.569 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.569 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149705 s, 70.0 MB/s 2024-04-25T09:13:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146113 s, 71.8 MB/s 2024-04-25T09:13:04.601 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.601 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.601 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146661 s, 71.5 MB/s 2024-04-25T09:13:04.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:04.606 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:13:04.606 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:13:04.606 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.27 2024-04-25T09:13:04.606 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:13:04.606 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:13:04.606 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:13:04.606 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:13:04.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.673 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014946 s, 70.2 MB/s 2024-04-25T09:13:04.689 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.690 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151537 s, 69.2 MB/s 2024-04-25T09:13:04.706 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.706 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.706 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143674 s, 73.0 MB/s 2024-04-25T09:13:04.724 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.725 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.725 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169739 s, 61.8 MB/s 2024-04-25T09:13:04.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.742 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148387 s, 70.7 MB/s 2024-04-25T09:13:04.761 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.761 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.761 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177635 s, 59.0 MB/s 2024-04-25T09:13:04.780 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.780 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.780 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173023 s, 60.6 MB/s 2024-04-25T09:13:04.801 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.801 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.801 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197607 s, 53.1 MB/s 2024-04-25T09:13:04.818 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.818 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.818 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149095 s, 70.3 MB/s 2024-04-25T09:13:04.834 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.834 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.834 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142602 s, 73.5 MB/s 2024-04-25T09:13:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.854 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179432 s, 58.4 MB/s 2024-04-25T09:13:04.873 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.873 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.873 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179118 s, 58.5 MB/s 2024-04-25T09:13:04.890 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.890 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.890 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153685 s, 68.2 MB/s 2024-04-25T09:13:04.909 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.909 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.909 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169018 s, 62.0 MB/s 2024-04-25T09:13:04.928 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.928 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.928 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170631 s, 61.5 MB/s 2024-04-25T09:13:04.949 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.950 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.950 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194055 s, 54.0 MB/s 2024-04-25T09:13:04.966 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.966 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.966 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148405 s, 70.7 MB/s 2024-04-25T09:13:04.983 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:04.984 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:04.984 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156112 s, 67.2 MB/s 2024-04-25T09:13:05.002 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.002 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.002 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169481 s, 61.9 MB/s 2024-04-25T09:13:05.024 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.025 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.025 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203304 s, 51.6 MB/s 2024-04-25T09:13:05.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.042 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152925 s, 68.6 MB/s 2024-04-25T09:13:05.061 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.061 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.061 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172843 s, 60.7 MB/s 2024-04-25T09:13:05.078 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.078 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.078 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152794 s, 68.6 MB/s 2024-04-25T09:13:05.095 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.095 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.095 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148156 s, 70.8 MB/s 2024-04-25T09:13:05.112 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.112 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.112 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153647 s, 68.2 MB/s 2024-04-25T09:13:05.129 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.129 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.129 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150281 s, 69.8 MB/s 2024-04-25T09:13:05.143 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.143 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.143 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125231 s, 83.7 MB/s 2024-04-25T09:13:05.164 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.165 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.165 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192439 s, 54.5 MB/s 2024-04-25T09:13:05.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.183 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169753 s, 61.8 MB/s 2024-04-25T09:13:05.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.200 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150395 s, 69.7 MB/s 2024-04-25T09:13:05.216 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.217 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.218 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146294 s, 71.7 MB/s 2024-04-25T09:13:05.235 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.235 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.235 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173014 s, 60.6 MB/s 2024-04-25T09:13:05.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:05.237 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:13:05.237 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:13:05.237 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.28 2024-04-25T09:13:05.237 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:13:05.237 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:13:05.237 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:13:05.237 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:13:05.317 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.318 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.318 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190255 s, 55.1 MB/s 2024-04-25T09:13:05.334 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.334 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.334 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150762 s, 69.6 MB/s 2024-04-25T09:13:05.353 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.353 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.353 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164518 s, 63.7 MB/s 2024-04-25T09:13:05.378 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.378 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.378 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232943 s, 45.0 MB/s 2024-04-25T09:13:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164182 s, 63.9 MB/s 2024-04-25T09:13:05.413 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.413 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.414 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151699 s, 69.1 MB/s 2024-04-25T09:13:05.434 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.434 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.434 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018913 s, 55.4 MB/s 2024-04-25T09:13:05.451 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.451 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.452 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157634 s, 66.5 MB/s 2024-04-25T09:13:05.468 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.468 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.468 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145571 s, 72.0 MB/s 2024-04-25T09:13:05.487 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.487 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.488 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177988 s, 58.9 MB/s 2024-04-25T09:13:05.507 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.507 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.507 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181419 s, 57.8 MB/s 2024-04-25T09:13:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161827 s, 64.8 MB/s 2024-04-25T09:13:05.548 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.548 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.548 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208349 s, 50.3 MB/s 2024-04-25T09:13:05.566 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.566 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.566 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161975 s, 64.7 MB/s 2024-04-25T09:13:05.586 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.586 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.586 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189268 s, 55.4 MB/s 2024-04-25T09:13:05.603 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.603 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.603 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147172 s, 71.2 MB/s 2024-04-25T09:13:05.621 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.621 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.621 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166567 s, 63.0 MB/s 2024-04-25T09:13:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.639 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.640 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163904 s, 64.0 MB/s 2024-04-25T09:13:05.658 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.658 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.658 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165243 s, 63.5 MB/s 2024-04-25T09:13:05.675 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.675 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.675 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158296 s, 66.2 MB/s 2024-04-25T09:13:05.696 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.696 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.696 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191119 s, 54.9 MB/s 2024-04-25T09:13:05.712 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.713 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.713 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145922 s, 71.9 MB/s 2024-04-25T09:13:05.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.731 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164766 s, 63.6 MB/s 2024-04-25T09:13:05.748 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.748 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.748 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154772 s, 67.7 MB/s 2024-04-25T09:13:05.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.767 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.767 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166775 s, 62.9 MB/s 2024-04-25T09:13:05.786 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.786 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.786 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177119 s, 59.2 MB/s 2024-04-25T09:13:05.803 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.804 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.804 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155794 s, 67.3 MB/s 2024-04-25T09:13:05.825 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.825 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.825 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195308 s, 53.7 MB/s 2024-04-25T09:13:05.841 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.841 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.841 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147434 s, 71.1 MB/s 2024-04-25T09:13:05.867 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.867 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.867 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243544 s, 43.1 MB/s 2024-04-25T09:13:05.887 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.887 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.887 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017642 s, 59.4 MB/s 2024-04-25T09:13:05.904 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.904 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.904 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149227 s, 70.3 MB/s 2024-04-25T09:13:05.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:05.905 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:13:05.906 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:13:05.906 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.29 2024-04-25T09:13:05.906 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:13:05.906 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:13:05.906 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:13:05.906 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:13:05.976 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.976 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.977 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142872 s, 73.4 MB/s 2024-04-25T09:13:05.994 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:05.994 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:05.994 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157799 s, 66.4 MB/s 2024-04-25T09:13:06.018 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.018 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.018 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219902 s, 47.7 MB/s 2024-04-25T09:13:06.035 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.035 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.035 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152378 s, 68.8 MB/s 2024-04-25T09:13:06.052 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.052 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.052 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154883 s, 67.7 MB/s 2024-04-25T09:13:06.072 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.072 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.072 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175965 s, 59.6 MB/s 2024-04-25T09:13:06.091 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.091 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.091 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173357 s, 60.5 MB/s 2024-04-25T09:13:06.111 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.111 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.111 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178664 s, 58.7 MB/s 2024-04-25T09:13:06.128 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.128 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.128 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151243 s, 69.3 MB/s 2024-04-25T09:13:06.145 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.145 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.145 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152761 s, 68.6 MB/s 2024-04-25T09:13:06.167 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.167 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.167 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204695 s, 51.2 MB/s 2024-04-25T09:13:06.185 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.185 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.185 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157796 s, 66.5 MB/s 2024-04-25T09:13:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140106 s, 74.8 MB/s 2024-04-25T09:13:06.221 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.221 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.222 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190301 s, 55.1 MB/s 2024-04-25T09:13:06.238 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.238 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.238 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149976 s, 69.9 MB/s 2024-04-25T09:13:06.260 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.260 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.260 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200622 s, 52.3 MB/s 2024-04-25T09:13:06.277 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.277 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.278 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015764 s, 66.5 MB/s 2024-04-25T09:13:06.296 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.296 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.296 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162193 s, 64.6 MB/s 2024-04-25T09:13:06.312 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.312 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.312 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148159 s, 70.8 MB/s 2024-04-25T09:13:06.331 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.331 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.331 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017147 s, 61.2 MB/s 2024-04-25T09:13:06.347 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.348 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.348 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143601 s, 73.0 MB/s 2024-04-25T09:13:06.366 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.366 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.366 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016469 s, 63.7 MB/s 2024-04-25T09:13:06.384 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.384 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.384 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164455 s, 63.8 MB/s 2024-04-25T09:13:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146211 s, 71.7 MB/s 2024-04-25T09:13:06.422 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.422 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.422 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195646 s, 53.6 MB/s 2024-04-25T09:13:06.438 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.438 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.438 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145531 s, 72.1 MB/s 2024-04-25T09:13:06.459 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.459 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.459 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191379 s, 54.8 MB/s 2024-04-25T09:13:06.476 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.476 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.476 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150944 s, 69.5 MB/s 2024-04-25T09:13:06.496 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.496 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.496 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178909 s, 58.6 MB/s 2024-04-25T09:13:06.513 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.513 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.513 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151243 s, 69.3 MB/s 2024-04-25T09:13:06.534 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.534 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.534 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197163 s, 53.2 MB/s 2024-04-25T09:13:06.552 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.552 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.552 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154799 s, 67.7 MB/s 2024-04-25T09:13:06.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:06.553 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:13:06.553 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:13:06.553 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.30 2024-04-25T09:13:06.553 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:13:06.553 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:13:06.553 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:13:06.553 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:13:06.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.624 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.624 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148877 s, 70.4 MB/s 2024-04-25T09:13:06.641 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.641 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.641 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153056 s, 68.5 MB/s 2024-04-25T09:13:06.657 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.657 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.657 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147302 s, 71.2 MB/s 2024-04-25T09:13:06.674 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.674 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.674 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145826 s, 71.9 MB/s 2024-04-25T09:13:06.695 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.696 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.696 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02007 s, 52.2 MB/s 2024-04-25T09:13:06.714 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.714 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.714 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166884 s, 62.8 MB/s 2024-04-25T09:13:06.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.731 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154938 s, 67.7 MB/s 2024-04-25T09:13:06.748 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.748 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.748 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148874 s, 70.4 MB/s 2024-04-25T09:13:06.765 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.765 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.766 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158076 s, 66.3 MB/s 2024-04-25T09:13:06.780 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.780 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.780 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123055 s, 85.2 MB/s 2024-04-25T09:13:06.798 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.798 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.798 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167672 s, 62.5 MB/s 2024-04-25T09:13:06.818 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.818 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.818 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176548 s, 59.4 MB/s 2024-04-25T09:13:06.839 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.839 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.839 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194859 s, 53.8 MB/s 2024-04-25T09:13:06.855 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.856 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.856 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147765 s, 71.0 MB/s 2024-04-25T09:13:06.875 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.875 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.875 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017499 s, 59.9 MB/s 2024-04-25T09:13:06.892 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.893 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.893 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158969 s, 66.0 MB/s 2024-04-25T09:13:06.909 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.909 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.909 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149471 s, 70.2 MB/s 2024-04-25T09:13:06.927 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.927 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.927 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153982 s, 68.1 MB/s 2024-04-25T09:13:06.946 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.946 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.946 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175736 s, 59.7 MB/s 2024-04-25T09:13:06.962 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.962 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.963 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146645 s, 71.5 MB/s 2024-04-25T09:13:06.981 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:06.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:06.982 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170383 s, 61.5 MB/s 2024-04-25T09:13:07.002 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.002 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.002 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185584 s, 56.5 MB/s 2024-04-25T09:13:07.019 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.019 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.019 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158447 s, 66.2 MB/s 2024-04-25T09:13:07.040 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.040 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.040 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018793 s, 55.8 MB/s 2024-04-25T09:13:07.057 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.057 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.057 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151103 s, 69.4 MB/s 2024-04-25T09:13:07.076 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.076 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.076 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174365 s, 60.1 MB/s 2024-04-25T09:13:07.093 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.093 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.093 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015592 s, 67.3 MB/s 2024-04-25T09:13:07.112 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.112 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.112 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167791 s, 62.5 MB/s 2024-04-25T09:13:07.128 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.128 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.128 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014649 s, 71.6 MB/s 2024-04-25T09:13:07.149 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.149 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.149 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190298 s, 55.1 MB/s 2024-04-25T09:13:07.168 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.168 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.168 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168167 s, 62.4 MB/s 2024-04-25T09:13:07.185 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.185 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.185 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015545 s, 67.5 MB/s 2024-04-25T09:13:07.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:07.187 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:13:07.187 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:13:07.187 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.31 2024-04-25T09:13:07.187 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:13:07.187 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:13:07.187 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:13:07.187 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:13:07.256 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.257 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151581 s, 69.2 MB/s 2024-04-25T09:13:07.273 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.273 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.273 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145572 s, 72.0 MB/s 2024-04-25T09:13:07.290 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.290 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.291 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160315 s, 65.4 MB/s 2024-04-25T09:13:07.307 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.307 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.307 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142684 s, 73.5 MB/s 2024-04-25T09:13:07.326 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.326 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.326 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179321 s, 58.5 MB/s 2024-04-25T09:13:07.345 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.345 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.345 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166298 s, 63.1 MB/s 2024-04-25T09:13:07.364 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.467 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.468 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172623 s, 60.7 MB/s 2024-04-25T09:13:07.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.469 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188137 s, 55.7 MB/s 2024-04-25T09:13:07.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.469 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160852 s, 65.2 MB/s 2024-04-25T09:13:07.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.469 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140156 s, 74.8 MB/s 2024-04-25T09:13:07.470 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.470 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.470 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150238 s, 69.8 MB/s 2024-04-25T09:13:07.470 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.470 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.470 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014657 s, 71.5 MB/s 2024-04-25T09:13:07.470 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.470 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.470 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144427 s, 72.6 MB/s 2024-04-25T09:13:07.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.484 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143629 s, 73.0 MB/s 2024-04-25T09:13:07.501 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.501 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.501 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144548 s, 72.5 MB/s 2024-04-25T09:13:07.521 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.521 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.521 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181875 s, 57.7 MB/s 2024-04-25T09:13:07.538 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.538 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.538 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155555 s, 67.4 MB/s 2024-04-25T09:13:07.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.560 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.560 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197198 s, 53.2 MB/s 2024-04-25T09:13:07.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.576 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.576 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146415 s, 71.6 MB/s 2024-04-25T09:13:07.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.592 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140898 s, 74.4 MB/s 2024-04-25T09:13:07.608 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.608 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.609 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147513 s, 71.1 MB/s 2024-04-25T09:13:07.625 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.625 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.626 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152737 s, 68.7 MB/s 2024-04-25T09:13:07.641 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.641 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.641 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141329 s, 74.2 MB/s 2024-04-25T09:13:07.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.661 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.661 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178007 s, 58.9 MB/s 2024-04-25T09:13:07.677 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.677 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.678 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147071 s, 71.3 MB/s 2024-04-25T09:13:07.696 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.696 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.697 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171881 s, 61.0 MB/s 2024-04-25T09:13:07.714 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.714 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.714 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161222 s, 65.0 MB/s 2024-04-25T09:13:07.732 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.732 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.732 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156692 s, 66.9 MB/s 2024-04-25T09:13:07.750 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.750 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.750 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159122 s, 65.9 MB/s 2024-04-25T09:13:07.767 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.767 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.767 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152532 s, 68.7 MB/s 2024-04-25T09:13:07.788 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.788 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.788 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190525 s, 55.0 MB/s 2024-04-25T09:13:07.804 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:13:07.804 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:13:07.804 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143616 s, 73.0 MB/s 2024-04-25T09:13:07.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:07.805 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub start /scrub_control_test_path recursive 2024-04-25T09:13:07.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.001+0000 7f2ee4200640 1 Processor -- start 2024-04-25T09:13:07.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.001+0000 7f2ee4200640 1 -- start start 2024-04-25T09:13:07.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.005+0000 7f2ee4200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2edc0b3fe0 0x7f2edc0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:07.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.005+0000 7f2ee4200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2edc06d4b0 con 0x7f2edc0cc260 2024-04-25T09:13:07.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.005+0000 7f2ee4200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2edc06d790 con 0x7f2edc145290 2024-04-25T09:13:07.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.005+0000 7f2ee4200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2edc0ccd80 con 0x7f2edc0b3fe0 2024-04-25T09:13:07.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.005+0000 7f2ee2200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f2edc0cc260 0x7f2edc0cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45774/0 (socket says 172.21.15.173:45774) 2024-04-25T09:13:07.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.005+0000 7f2ee2200640 1 -- 172.21.15.173:0/2070458330 learned_addr learned my addr 172.21.15.173:0/2070458330 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:07.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.005+0000 7f2ee0e00640 1 --2- 172.21.15.173:0/2070458330 >> v2:172.21.15.173:3300/0 conn(0x7f2edc0b3fe0 0x7f2edc0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:07.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.005+0000 7f2edbe00640 1 -- 172.21.15.173:0/2070458330 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951290571 0 0) 0x7f2edc06d4b0 con 0x7f2edc0cc260 2024-04-25T09:13:07.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.005+0000 7f2edbe00640 1 -- 172.21.15.173:0/2070458330 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ec4003530 con 0x7f2edc0cc260 2024-04-25T09:13:07.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.005+0000 7f2edbe00640 1 -- 172.21.15.173:0/2070458330 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 57161452 0 0) 0x7f2edc06d790 con 0x7f2edc145290 2024-04-25T09:13:07.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.005+0000 7f2edbe00640 1 -- 172.21.15.173:0/2070458330 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2edc06d4b0 con 0x7f2edc145290 2024-04-25T09:13:07.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.005+0000 7f2ee0e00640 1 -- 172.21.15.173:0/2070458330 >> v1:172.21.15.194:6789/0 conn(0x7f2edc145290 legacy=0x7f2edc15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:07.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.005+0000 7f2ee0e00640 1 -- 172.21.15.173:0/2070458330 >> v1:172.21.15.173:6789/0 conn(0x7f2edc0cc260 legacy=0x7f2edc0cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:07.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.005+0000 7f2ee0e00640 1 -- 172.21.15.173:0/2070458330 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc06da70 con 0x7f2edc0b3fe0 2024-04-25T09:13:07.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2ee0e00640 1 --2- 172.21.15.173:0/2070458330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2edc0b3fe0 0x7f2edc0b4450 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80097c0 tx=0x7f2ec801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ea3d850b323211 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:07.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2edbe00640 1 -- 172.21.15.173:0/2070458330 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec80b0070 con 0x7f2edc0b3fe0 2024-04-25T09:13:07.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2edbe00640 1 -- 172.21.15.173:0/2070458330 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec80ab600 con 0x7f2edc0b3fe0 2024-04-25T09:13:07.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2edbe00640 1 -- 172.21.15.173:0/2070458330 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec80ab9d0 con 0x7f2edc0b3fe0 2024-04-25T09:13:07.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2ee4200640 1 -- 172.21.15.173:0/2070458330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2edc0b3fe0 msgr2=0x7f2edc0b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:07.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2ee4200640 1 --2- 172.21.15.173:0/2070458330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2edc0b3fe0 0x7f2edc0b4450 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80097c0 tx=0x7f2ec801c380 comp rx=0 tx=0).stop 2024-04-25T09:13:07.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2ee4200640 1 -- 172.21.15.173:0/2070458330 shutdown_connections 2024-04-25T09:13:07.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2ee4200640 1 --2- 172.21.15.173:0/2070458330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2edc0b3fe0 0x7f2edc0b4450 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:07.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2ee4200640 1 -- 172.21.15.173:0/2070458330 >> 172.21.15.173:0/2070458330 conn(0x7f2edc06ac90 msgr2=0x7f2edc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:07.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2ee4200640 1 -- 172.21.15.173:0/2070458330 shutdown_connections 2024-04-25T09:13:07.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2ee4200640 1 -- 172.21.15.173:0/2070458330 wait complete. 2024-04-25T09:13:07.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2ee4200640 1 Processor -- start 2024-04-25T09:13:07.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2ee4200640 1 -- start start 2024-04-25T09:13:07.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2ee4200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2edc0b3fe0 0x7f2edc0caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:07.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2ee4200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc0cc260 0x7f2edc0ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:07.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2ee4200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2edc145290 0x7f2edc0ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:07.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2ee4200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc06eee0 con 0x7f2edc145290 2024-04-25T09:13:07.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2ee4200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc06ed60 con 0x7f2edc0cc260 2024-04-25T09:13:07.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2ee4200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc06f060 con 0x7f2edc0b3fe0 2024-04-25T09:13:07.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2ee2200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2edc145290 0x7f2edc0ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:07.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.009+0000 7f2ee2200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2edc145290 0x7f2edc0ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34974/0 (socket says 172.21.15.173:34974) 2024-04-25T09:13:07.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.013+0000 7f2ee2200640 1 -- 172.21.15.173:0/422969663 learned_addr learned my addr 172.21.15.173:0/422969663 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:07.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.013+0000 7f2ee1800640 1 --2- 172.21.15.173:0/422969663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2edc0b3fe0 0x7f2edc0caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:07.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.013+0000 7f2ee0e00640 1 --2- 172.21.15.173:0/422969663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc0cc260 0x7f2edc0ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:07.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.013+0000 7f2ee2200640 1 -- 172.21.15.173:0/422969663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2edc0b3fe0 msgr2=0x7f2edc0caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:07.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.013+0000 7f2ee2200640 1 --2- 172.21.15.173:0/422969663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2edc0b3fe0 0x7f2edc0caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:07.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.013+0000 7f2ee2200640 1 -- 172.21.15.173:0/422969663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc0cc260 msgr2=0x7f2edc0ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:07.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.013+0000 7f2ee2200640 1 --2- 172.21.15.173:0/422969663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc0cc260 0x7f2edc0ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:07.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.013+0000 7f2ee2200640 1 -- 172.21.15.173:0/422969663 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc1fa310 con 0x7f2edc145290 2024-04-25T09:13:07.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.013+0000 7f2ee2200640 1 --2- 172.21.15.173:0/422969663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2edc145290 0x7f2edc0ade50 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400c3c0 tx=0x7f2ed400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:07.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.013+0000 7f2ed9600640 1 -- 172.21.15.173:0/422969663 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4017070 con 0x7f2edc145290 2024-04-25T09:13:07.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.013+0000 7f2ed9600640 1 -- 172.21.15.173:0/422969663 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed4005cf0 con 0x7f2edc145290 2024-04-25T09:13:07.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.013+0000 7f2ee4200640 1 -- 172.21.15.173:0/422969663 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2edc13ee70 con 0x7f2edc145290 2024-04-25T09:13:07.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.013+0000 7f2ed9600640 1 -- 172.21.15.173:0/422969663 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed40072f0 con 0x7f2edc145290 2024-04-25T09:13:07.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.013+0000 7f2ee4200640 1 -- 172.21.15.173:0/422969663 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2edc13f430 con 0x7f2edc145290 2024-04-25T09:13:07.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.013+0000 7f2ed9600640 1 -- 172.21.15.173:0/422969663 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2ed401a070 con 0x7f2edc145290 2024-04-25T09:13:08.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ed9600640 1 --2- 172.21.15.173:0/422969663 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2ebc066f60 0x7f2ebc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ed9600640 1 -- 172.21.15.173:0/422969663 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2ed4084520 con 0x7f2edc145290 2024-04-25T09:13:08.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee1800640 1 --2- 172.21.15.173:0/422969663 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2ebc066f60 0x7f2ebc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee7659000 1 Processor -- start 2024-04-25T09:13:08.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee7659000 1 -- start start 2024-04-25T09:13:08.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee1800640 1 --2- 172.21.15.173:0/422969663 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2ebc066f60 0x7f2ebc069420 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0001570 tx=0x7f2ed0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee7659000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc153f0 0x559efcc157d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee7659000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcc15d10 0x559efcbcbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee7659000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcbcc520 0x559efcbcc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee7659000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efca19d50 con 0x559efcc153f0 2024-04-25T09:13:08.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee7659000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efc9a1e40 con 0x559efcbcc520 2024-04-25T09:13:08.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee7659000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x559efca15df0 con 0x559efcc15d10 2024-04-25T09:13:08.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee1800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc153f0 0x559efcc157d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee1800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc153f0 0x559efcc157d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34990/0 (socket says 172.21.15.173:34990) 2024-04-25T09:13:08.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee1800640 1 -- 172.21.15.173:0/2166270663 learned_addr learned my addr 172.21.15.173:0/2166270663 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:08.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee2200640 1 --2- 172.21.15.173:0/2166270663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcbcc520 0x559efcbcc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee0e00640 1 --2- 172.21.15.173:0/2166270663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcc15d10 0x559efcbcbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee1800640 1 -- 172.21.15.173:0/2166270663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcc15d10 msgr2=0x559efcbcbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee1800640 1 --2- 172.21.15.173:0/2166270663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcc15d10 0x559efcbcbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee1800640 1 -- 172.21.15.173:0/2166270663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcbcc520 msgr2=0x559efcbcc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee1800640 1 --2- 172.21.15.173:0/2166270663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcbcc520 0x559efcbcc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee1800640 1 -- 172.21.15.173:0/2166270663 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559efc9b6d90 con 0x559efcc153f0 2024-04-25T09:13:08.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee1800640 1 --2- 172.21.15.173:0/2166270663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc153f0 0x559efcc157d0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000fe40 tx=0x7f2ed0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a29188cf7994b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ece000640 1 -- 172.21.15.173:0/2166270663 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0025070 con 0x559efcc153f0 2024-04-25T09:13:08.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ece000640 1 -- 172.21.15.173:0/2166270663 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed001b050 con 0x559efcc153f0 2024-04-25T09:13:08.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ece000640 1 -- 172.21.15.173:0/2166270663 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed00137c0 con 0x559efcc153f0 2024-04-25T09:13:08.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee7659000 1 -- 172.21.15.173:0/2166270663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc153f0 msgr2=0x559efcc157d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee7659000 1 --2- 172.21.15.173:0/2166270663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc153f0 0x559efcc157d0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000fe40 tx=0x7f2ed0012000 comp rx=0 tx=0).stop 2024-04-25T09:13:08.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee7659000 1 -- 172.21.15.173:0/2166270663 shutdown_connections 2024-04-25T09:13:08.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee7659000 1 --2- 172.21.15.173:0/2166270663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcbcc520 0x559efcbcc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee7659000 1 --2- 172.21.15.173:0/2166270663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcc15d10 0x559efcbcbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee7659000 1 --2- 172.21.15.173:0/2166270663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc153f0 0x559efcc157d0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee7659000 1 -- 172.21.15.173:0/2166270663 >> 172.21.15.173:0/2166270663 conn(0x559efcbc84d0 msgr2=0x559efcbca8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee7659000 1 -- 172.21.15.173:0/2166270663 shutdown_connections 2024-04-25T09:13:08.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.017+0000 7f2ee7659000 1 -- 172.21.15.173:0/2166270663 wait complete. 2024-04-25T09:13:08.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee7659000 1 -- start start 2024-04-25T09:13:08.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee7659000 1 Processor -- start 2024-04-25T09:13:08.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee7659000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcbcc520 0x559efcbd1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee7659000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcc153f0 0x559efcbd6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee7659000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc15d10 0x559efcbd7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee7659000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efc9bf610 con 0x559efcc15d10 2024-04-25T09:13:08.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee7659000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efc9d49a0 con 0x559efcbcc520 2024-04-25T09:13:08.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee7659000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x559efca1e380 con 0x559efcc153f0 2024-04-25T09:13:08.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee7659000 10 client.0 _ll_register_callbacks cb 0x559efcace0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:13:08.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee2200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc15d10 0x559efcbd7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee1800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcbcc520 0x559efcbd1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee2200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc15d10 0x559efcbd7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34994/0 (socket says 172.21.15.173:34994) 2024-04-25T09:13:08.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee2200640 1 -- 172.21.15.173:0/4046219034 learned_addr learned my addr 172.21.15.173:0/4046219034 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:08.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee0e00640 1 --2- 172.21.15.173:0/4046219034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcc153f0 0x559efcbd6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee2200640 1 -- 172.21.15.173:0/4046219034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcc153f0 msgr2=0x559efcbd6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee2200640 1 --2- 172.21.15.173:0/4046219034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcc153f0 0x559efcbd6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee2200640 1 -- 172.21.15.173:0/4046219034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcbcc520 msgr2=0x559efcbd1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee2200640 1 --2- 172.21.15.173:0/4046219034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcbcc520 0x559efcbd1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee2200640 1 -- 172.21.15.173:0/4046219034 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559efca14d40 con 0x559efcc15d10 2024-04-25T09:13:08.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee2200640 1 --2- 172.21.15.173:0/4046219034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc15d10 0x559efcbd7130 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4054cd0 tx=0x7f2ed4058de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=accf324efaa5b649 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ec2a00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:13:08.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ec2a00640 1 -- 172.21.15.173:0/4046219034 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed406c070 con 0x559efcc15d10 2024-04-25T09:13:08.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ec2a00640 1 -- 172.21.15.173:0/4046219034 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2ed4084070 con 0x559efcc15d10 2024-04-25T09:13:08.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee7659000 1 -- 172.21.15.173:0/4046219034 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ed001b050 con 0x559efcc15d10 2024-04-25T09:13:08.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ec2a00640 1 -- 172.21.15.173:0/4046219034 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ed4084270 con 0x559efcc15d10 2024-04-25T09:13:08.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee7659000 10 client.9627 fetch_fsmap learned FSMap version 89 2024-04-25T09:13:08.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee7659000 1 -- 172.21.15.173:0/4046219034 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x559efca9cf00 con 0x559efcc15d10 2024-04-25T09:13:08.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ec2a00640 1 -- 172.21.15.173:0/4046219034 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed001b050 con 0x559efcc15d10 2024-04-25T09:13:08.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ec2a00640 1 -- 172.21.15.173:0/4046219034 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 89) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2ed4007490 con 0x559efcc15d10 2024-04-25T09:13:08.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee7659000 10 client.9627 fetch_fsmap finished waiting for FSMap version 89 2024-04-25T09:13:08.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee7659000 10 client.9627 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-04-25T09:13:08.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee7659000 20 client.9627 populate_metadata read hostname 'smithi173' 2024-04-25T09:13:08.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee7659000 1 --2- 172.21.15.173:0/4046219034 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x559efcc1c830 0x559efcc1cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee7659000 4 client.9627 mds_command: new command op to 9411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:13:08.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee7659000 1 -- 172.21.15.173:0/4046219034 --> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559efc9b5a20 con 0x559efcc1c830 2024-04-25T09:13:08.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.021+0000 7f2ee1800640 1 --2- 172.21.15.173:0/4046219034 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x559efcc1c830 0x559efcc1cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.025+0000 7f2ee1800640 1 --2- 172.21.15.173:0/4046219034 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x559efcc1c830 0x559efcc1cc10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5b7326f45c66a51 server_cookie=166bd8e62b2afec8 in_seq=0 out_seq=0 2024-04-25T09:13:08.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.025+0000 7f2ec2a00640 10 client.9627 ms_handle_connect on v2:172.21.15.173:6836/3627798672 2024-04-25T09:13:08.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.025+0000 7f2ec2a00640 1 -- 172.21.15.173:0/4046219034 <== mds.0 v2:172.21.15.173:6836/3627798672 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559efc9b5a20 con 0x559efcc1c830 2024-04-25T09:13:08.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.025+0000 7f2ec2a00640 10 client.9627 handle_command_reply: tid=0 2024-04-25T09:13:08.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.025+0000 7f2ee7659000 1 client.9627 shutdown 2024-04-25T09:13:08.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.025+0000 7f2ee7659000 1 -- 172.21.15.173:0/4046219034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc15d10 msgr2=0x559efcbd7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.025+0000 7f2ee7659000 1 --2- 172.21.15.173:0/4046219034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc15d10 0x559efcbd7130 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4054cd0 tx=0x7f2ed4058de0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.025+0000 7f2ee7659000 1 -- 172.21.15.173:0/4046219034 shutdown_connections 2024-04-25T09:13:08.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.025+0000 7f2ee7659000 1 --2- 172.21.15.173:0/4046219034 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x559efcc1c830 0x559efcc1cc10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.025+0000 7f2ee7659000 1 --2- 172.21.15.173:0/4046219034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc15d10 0x559efcbd7130 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.025+0000 7f2ee7659000 1 --2- 172.21.15.173:0/4046219034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcc153f0 0x559efcbd6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.025+0000 7f2ee7659000 1 --2- 172.21.15.173:0/4046219034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcbcc520 0x559efcbd1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.025+0000 7f2ec2a00640 0 client.9627 ms_handle_reset on v2:172.21.15.173:6836/3627798672 2024-04-25T09:13:08.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.025+0000 7f2ee7659000 1 -- 172.21.15.173:0/4046219034 >> 172.21.15.173:0/4046219034 conn(0x559efcbc84d0 msgr2=0x559efcbcb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.025+0000 7f2ee7659000 1 -- 172.21.15.173:0/4046219034 shutdown_connections 2024-04-25T09:13:08.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.025+0000 7f2ee7659000 1 -- 172.21.15.173:0/4046219034 wait complete. 2024-04-25T09:13:08.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.025+0000 7f2ee7659000 20 client.9627 trim_cache size 0 max 16384 2024-04-25T09:13:08.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 Processor -- start 2024-04-25T09:13:08.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 -- start start 2024-04-25T09:13:08.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcbcc520 0x559efcbcb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcc153f0 0x559efcbcbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc15d10 0x559efcc18100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc2030e0 con 0x559efcc15d10 2024-04-25T09:13:08.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc202280 con 0x559efcc153f0 2024-04-25T09:13:08.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc1f6da0 con 0x559efcbcc520 2024-04-25T09:13:08.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee2200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc15d10 0x559efcc18100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee2200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc15d10 0x559efcc18100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35000/0 (socket says 172.21.15.173:35000) 2024-04-25T09:13:08.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee2200640 1 -- 172.21.15.173:0/1171640376 learned_addr learned my addr 172.21.15.173:0/1171640376 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:08.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee1800640 1 --2- 172.21.15.173:0/1171640376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcbcc520 0x559efcbcb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee0e00640 1 --2- 172.21.15.173:0/1171640376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcc153f0 0x559efcbcbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee2200640 1 -- 172.21.15.173:0/1171640376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcbcc520 msgr2=0x559efcbcb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee2200640 1 --2- 172.21.15.173:0/1171640376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcbcc520 0x559efcbcb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee2200640 1 -- 172.21.15.173:0/1171640376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcc153f0 msgr2=0x559efcbcbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee2200640 1 --2- 172.21.15.173:0/1171640376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcc153f0 0x559efcbcbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee2200640 1 -- 172.21.15.173:0/1171640376 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559efcc15b40 con 0x559efcc15d10 2024-04-25T09:13:08.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee2200640 1 --2- 172.21.15.173:0/1171640376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc15d10 0x559efcc18100 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4052ff0 tx=0x7f2ed4058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e8475159a6c211 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ecd600640 1 -- 172.21.15.173:0/1171640376 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed406c070 con 0x559efcc15d10 2024-04-25T09:13:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ecd600640 1 -- 172.21.15.173:0/1171640376 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed4007490 con 0x559efcc15d10 2024-04-25T09:13:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ecd600640 1 -- 172.21.15.173:0/1171640376 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4075020 con 0x559efcc15d10 2024-04-25T09:13:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 -- 172.21.15.173:0/1171640376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc15d10 msgr2=0x559efcc18100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 --2- 172.21.15.173:0/1171640376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc15d10 0x559efcc18100 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4052ff0 tx=0x7f2ed4058000 comp rx=0 tx=0).stop 2024-04-25T09:13:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 -- 172.21.15.173:0/1171640376 shutdown_connections 2024-04-25T09:13:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 --2- 172.21.15.173:0/1171640376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc15d10 0x559efcc18100 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 --2- 172.21.15.173:0/1171640376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcc153f0 0x559efcbcbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 --2- 172.21.15.173:0/1171640376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcbcc520 0x559efcbcb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 -- 172.21.15.173:0/1171640376 >> 172.21.15.173:0/1171640376 conn(0x559efcbc84d0 msgr2=0x559efcc13be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 -- 172.21.15.173:0/1171640376 shutdown_connections 2024-04-25T09:13:08.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 -- 172.21.15.173:0/1171640376 wait complete. 2024-04-25T09:13:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 -- start start 2024-04-25T09:13:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.041+0000 7f2ee7659000 1 Processor -- start 2024-04-25T09:13:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee7659000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcbcc520 0x559efcc1ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee7659000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc153f0 0x559efcc32e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee7659000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcc15d10 0x559efcc33350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee7659000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efc9d0dc0 con 0x559efcc153f0 2024-04-25T09:13:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee7659000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc201c80 con 0x559efcc15d10 2024-04-25T09:13:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee7659000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x559efca19060 con 0x559efcbcc520 2024-04-25T09:13:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee7659000 10 client.0 _ll_register_callbacks cb 0x7f2ed0017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:13:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee0e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc153f0 0x559efcc32e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee0e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc153f0 0x559efcc32e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35016/0 (socket says 172.21.15.173:35016) 2024-04-25T09:13:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee0e00640 1 -- 172.21.15.173:0/2107370139 learned_addr learned my addr 172.21.15.173:0/2107370139 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee1800640 1 --2- 172.21.15.173:0/2107370139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcbcc520 0x559efcc1ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee2200640 1 --2- 172.21.15.173:0/2107370139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcc15d10 0x559efcc33350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee0e00640 1 -- 172.21.15.173:0/2107370139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcbcc520 msgr2=0x559efcc1ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee0e00640 1 --2- 172.21.15.173:0/2107370139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcbcc520 0x559efcc1ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee0e00640 1 -- 172.21.15.173:0/2107370139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcc15d10 msgr2=0x559efcc33350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee0e00640 1 --2- 172.21.15.173:0/2107370139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcc15d10 0x559efcc33350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee0e00640 1 -- 172.21.15.173:0/2107370139 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559efca73330 con 0x559efcc153f0 2024-04-25T09:13:08.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee0e00640 1 --2- 172.21.15.173:0/2107370139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc153f0 0x559efcc32e10 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8018f90 tx=0x7f2ec801abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac361eb979723dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ec2a00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:13:08.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ec2a00640 1 -- 172.21.15.173:0/2107370139 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec80b0040 con 0x559efcc153f0 2024-04-25T09:13:08.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ec2a00640 1 -- 172.21.15.173:0/2107370139 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2ec80b78e0 con 0x559efcc153f0 2024-04-25T09:13:08.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee7659000 1 -- 172.21.15.173:0/2107370139 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ed4007490 con 0x559efcc153f0 2024-04-25T09:13:08.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ec2a00640 1 -- 172.21.15.173:0/2107370139 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ec80ca050 con 0x559efcc153f0 2024-04-25T09:13:08.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee7659000 10 client.9633 fetch_fsmap learned FSMap version 89 2024-04-25T09:13:08.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee7659000 1 -- 172.21.15.173:0/2107370139 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x559efc9e65f0 con 0x559efcc153f0 2024-04-25T09:13:08.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ec2a00640 1 -- 172.21.15.173:0/2107370139 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed4007490 con 0x559efcc153f0 2024-04-25T09:13:08.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ec2a00640 1 -- 172.21.15.173:0/2107370139 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 89) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2ec80cd020 con 0x559efcc153f0 2024-04-25T09:13:08.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee7659000 10 client.9633 fetch_fsmap finished waiting for FSMap version 89 2024-04-25T09:13:08.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee7659000 10 client.9633 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-04-25T09:13:08.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee7659000 20 client.9633 populate_metadata read hostname 'smithi173' 2024-04-25T09:13:08.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee7659000 1 --2- 172.21.15.173:0/2107370139 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x559efcc76240 0x559efcc76620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee7659000 4 client.9633 mds_command: new command op to 9411 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-04-25T09:13:08.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee7659000 1 -- 172.21.15.173:0/2107370139 --> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x559efca27290 con 0x559efcc76240 2024-04-25T09:13:08.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee1800640 1 --2- 172.21.15.173:0/2107370139 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x559efcc76240 0x559efcc76620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ee1800640 1 --2- 172.21.15.173:0/2107370139 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x559efcc76240 0x559efcc76620 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d483b7e6d555af1 server_cookie=75381ef01a0f81db in_seq=0 out_seq=0 2024-04-25T09:13:08.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.045+0000 7f2ec2a00640 10 client.9633 ms_handle_connect on v2:172.21.15.173:6836/3627798672 2024-04-25T09:13:08.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ec2a00640 1 -- 172.21.15.173:0/2107370139 <== mds.0 v2:172.21.15.173:6836/3627798672 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x559efca27290 con 0x559efcc76240 2024-04-25T09:13:08.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ec2a00640 10 client.9633 handle_command_reply: tid=0 2024-04-25T09:13:08.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee7659000 1 client.9633 shutdown 2024-04-25T09:13:08.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee7659000 1 -- 172.21.15.173:0/2107370139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc153f0 msgr2=0x559efcc32e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee7659000 1 --2- 172.21.15.173:0/2107370139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc153f0 0x559efcc32e10 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8018f90 tx=0x7f2ec801abc0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee7659000 1 -- 172.21.15.173:0/2107370139 shutdown_connections 2024-04-25T09:13:08.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee7659000 1 --2- 172.21.15.173:0/2107370139 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x559efcc76240 0x559efcc76620 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee7659000 1 --2- 172.21.15.173:0/2107370139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559efcc15d10 0x559efcc33350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee7659000 1 --2- 172.21.15.173:0/2107370139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559efcc153f0 0x559efcc32e10 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee7659000 1 --2- 172.21.15.173:0/2107370139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x559efcbcc520 0x559efcc1ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee7659000 1 -- 172.21.15.173:0/2107370139 >> 172.21.15.173:0/2107370139 conn(0x559efcbc84d0 msgr2=0x559efcc14470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ec2a00640 0 client.9633 ms_handle_reset on v2:172.21.15.173:6836/3627798672 2024-04-25T09:13:08.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee7659000 1 -- 172.21.15.173:0/2107370139 shutdown_connections 2024-04-25T09:13:08.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee7659000 1 -- 172.21.15.173:0/2107370139 wait complete. 2024-04-25T09:13:08.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee7659000 20 client.9633 trim_cache size 0 max 16384 2024-04-25T09:13:08.037 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:13:08.037 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0, 2024-04-25T09:13:08.037 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_tag": "d8034378-2d2a-44f7-9815-538131c5e84f", 2024-04-25T09:13:08.037 INFO:teuthology.orchestra.run.smithi173.stdout: "mode": "asynchronous" 2024-04-25T09:13:08.037 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:13:08.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee4200640 1 -- 172.21.15.173:0/422969663 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2ebc066f60 msgr2=0x7f2ebc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee4200640 1 --2- 172.21.15.173:0/422969663 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2ebc066f60 0x7f2ebc069420 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0001570 tx=0x7f2ed0009040 comp rx=0 tx=0).stop 2024-04-25T09:13:08.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee4200640 1 -- 172.21.15.173:0/422969663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2edc145290 msgr2=0x7f2edc0ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee4200640 1 --2- 172.21.15.173:0/422969663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2edc145290 0x7f2edc0ade50 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400c3c0 tx=0x7f2ed400c880 comp rx=0 tx=0).stop 2024-04-25T09:13:08.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee4200640 1 -- 172.21.15.173:0/422969663 shutdown_connections 2024-04-25T09:13:08.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee4200640 1 --2- 172.21.15.173:0/422969663 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2ebc066f60 0x7f2ebc069420 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee4200640 1 --2- 172.21.15.173:0/422969663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2edc145290 0x7f2edc0ade50 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee4200640 1 --2- 172.21.15.173:0/422969663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2edc0cc260 0x7f2edc0ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee4200640 1 --2- 172.21.15.173:0/422969663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2edc0b3fe0 0x7f2edc0caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee4200640 1 -- 172.21.15.173:0/422969663 >> 172.21.15.173:0/422969663 conn(0x7f2edc06ac90 msgr2=0x7f2edc0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee4200640 1 -- 172.21.15.173:0/422969663 shutdown_connections 2024-04-25T09:13:08.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.049+0000 7f2ee4200640 1 -- 172.21.15.173:0/422969663 wait complete. 2024-04-25T09:13:08.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:08.061 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub pause 2024-04-25T09:13:08.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.245+0000 7fcf07e00640 1 Processor -- start 2024-04-25T09:13:08.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.245+0000 7fcf07e00640 1 -- start start 2024-04-25T09:13:08.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.245+0000 7fcf07e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf08099a50 0x7fcf08099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.245+0000 7fcf07e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcf0806c220 0x7fcf0815e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.245+0000 7fcf07e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0809a370 con 0x7fcf0806bda0 2024-04-25T09:13:08.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.245+0000 7fcf07e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf08161570 con 0x7fcf0806c220 2024-04-25T09:13:08.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.245+0000 7fcf07e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf08161850 con 0x7fcf08099a50 2024-04-25T09:13:08.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.245+0000 7fcf06a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf08099a50 0x7fcf08099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.245+0000 7fcf07400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcf0806c220 0x7fcf0815e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.245+0000 7fcf06a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf08099a50 0x7fcf08099e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:39774/0 (socket says 172.21.15.173:39774) 2024-04-25T09:13:08.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.245+0000 7fcf06a00640 1 -- 172.21.15.173:0/1378333496 learned_addr learned my addr 172.21.15.173:0/1378333496 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:08.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.249+0000 7fcf06a00640 1 -- 172.21.15.173:0/1378333496 >> v2:172.21.15.194:3300/0 conn(0x7fcf0806c220 msgr2=0x7fcf0815e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.249+0000 7fcf06a00640 1 --2- 172.21.15.173:0/1378333496 >> v2:172.21.15.194:3300/0 conn(0x7fcf0806c220 0x7fcf0815e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.249+0000 7fcf06a00640 1 -- 172.21.15.173:0/1378333496 >> v1:172.21.15.194:6789/0 conn(0x7fcf0806bda0 legacy=0x7fcf0815dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.249+0000 7fcf06a00640 1 -- 172.21.15.173:0/1378333496 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf08161b30 con 0x7fcf08099a50 2024-04-25T09:13:08.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.249+0000 7fcf07400640 1 --2- 172.21.15.173:0/1378333496 >> v2:172.21.15.194:3300/0 conn(0x7fcf0806c220 0x7fcf0815e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:08.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.249+0000 7fcf06a00640 1 --2- 172.21.15.173:0/1378333496 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf08099a50 0x7fcf08099e30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009870 tx=0x7fcef801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e2c9d732d79157f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.249+0000 7fcf06000640 1 -- 172.21.15.173:0/1378333496 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef80ab640 con 0x7fcf08099a50 2024-04-25T09:13:08.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.249+0000 7fcf06000640 1 -- 172.21.15.173:0/1378333496 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef80b0070 con 0x7fcf08099a50 2024-04-25T09:13:08.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.249+0000 7fcf06000640 1 -- 172.21.15.173:0/1378333496 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef80aba00 con 0x7fcf08099a50 2024-04-25T09:13:08.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.249+0000 7fcf07e00640 1 -- 172.21.15.173:0/1378333496 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf08099a50 msgr2=0x7fcf08099e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.249+0000 7fcf07e00640 1 --2- 172.21.15.173:0/1378333496 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf08099a50 0x7fcf08099e30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009870 tx=0x7fcef801c530 comp rx=0 tx=0).stop 2024-04-25T09:13:08.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.249+0000 7fcf07e00640 1 -- 172.21.15.173:0/1378333496 shutdown_connections 2024-04-25T09:13:08.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.249+0000 7fcf07e00640 1 --2- 172.21.15.173:0/1378333496 >> v2:172.21.15.194:3300/0 conn(0x7fcf0806c220 0x7fcf0815e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.249+0000 7fcf07e00640 1 --2- 172.21.15.173:0/1378333496 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf08099a50 0x7fcf08099e30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.249+0000 7fcf07e00640 1 -- 172.21.15.173:0/1378333496 >> 172.21.15.173:0/1378333496 conn(0x7fcf080b31d0 msgr2=0x7fcf080b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.249+0000 7fcf07e00640 1 -- 172.21.15.173:0/1378333496 shutdown_connections 2024-04-25T09:13:08.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fcf07e00640 1 -- 172.21.15.173:0/1378333496 wait complete. 2024-04-25T09:13:08.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fcf07e00640 1 Processor -- start 2024-04-25T09:13:08.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fcf07e00640 1 -- start start 2024-04-25T09:13:08.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fcf07e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf0806bda0 0x7fcf08142760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fcf07e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf0806c220 0x7fcf0806f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fcf07e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf08099a50 0x7fcf0806fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fcf07e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0809ae40 con 0x7fcf0806c220 2024-04-25T09:13:08.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fcf07e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0809acc0 con 0x7fcf0806bda0 2024-04-25T09:13:08.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fcf07e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0816b120 con 0x7fcf08099a50 2024-04-25T09:13:08.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fceffe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf0806c220 0x7fcf0806f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fceffe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf0806c220 0x7fcf0806f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35022/0 (socket says 172.21.15.173:35022) 2024-04-25T09:13:08.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fceffe00640 1 -- 172.21.15.173:0/1773984491 learned_addr learned my addr 172.21.15.173:0/1773984491 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:08.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fcf06a00640 1 --2- 172.21.15.173:0/1773984491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf0806bda0 0x7fcf08142760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fcf07400640 1 --2- 172.21.15.173:0/1773984491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf08099a50 0x7fcf0806fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fceffe00640 1 -- 172.21.15.173:0/1773984491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf08099a50 msgr2=0x7fcf0806fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fceffe00640 1 --2- 172.21.15.173:0/1773984491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf08099a50 0x7fcf0806fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fceffe00640 1 -- 172.21.15.173:0/1773984491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf0806bda0 msgr2=0x7fcf08142760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fceffe00640 1 --2- 172.21.15.173:0/1773984491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf0806bda0 0x7fcf08142760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fceffe00640 1 -- 172.21.15.173:0/1773984491 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf08157b90 con 0x7fcf0806c220 2024-04-25T09:13:08.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fcf07400640 1 --2- 172.21.15.173:0/1773984491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf08099a50 0x7fcf0806fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:08.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fceffe00640 1 --2- 172.21.15.173:0/1773984491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf0806c220 0x7fcf0806f500 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fcef000c3a0 tx=0x7fcef000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fcefea00640 1 -- 172.21.15.173:0/1773984491 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef00052d0 con 0x7fcf0806c220 2024-04-25T09:13:08.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fcefea00640 1 -- 172.21.15.173:0/1773984491 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef0005470 con 0x7fcf0806c220 2024-04-25T09:13:08.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fcefea00640 1 -- 172.21.15.173:0/1773984491 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0007260 con 0x7fcf0806c220 2024-04-25T09:13:08.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.253+0000 7fcf07e00640 1 -- 172.21.15.173:0/1773984491 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0815c7b0 con 0x7fcf0806c220 2024-04-25T09:13:08.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.257+0000 7fcf07e00640 1 -- 172.21.15.173:0/1773984491 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0815ca90 con 0x7fcf0806c220 2024-04-25T09:13:08.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.257+0000 7fcefea00640 1 -- 172.21.15.173:0/1773984491 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcef0007400 con 0x7fcf0806c220 2024-04-25T09:13:08.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.257+0000 7fcefea00640 1 --2- 172.21.15.173:0/1773984491 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcee4066f60 0x7fcee4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.257+0000 7fcefea00640 1 -- 172.21.15.173:0/1773984491 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcef0084640 con 0x7fcf0806c220 2024-04-25T09:13:08.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.257+0000 7fcf06a00640 1 --2- 172.21.15.173:0/1773984491 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcee4066f60 0x7fcee4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.257+0000 7fcf1114e000 1 Processor -- start 2024-04-25T09:13:08.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.257+0000 7fcf1114e000 1 -- start start 2024-04-25T09:13:08.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.257+0000 7fcf06a00640 1 --2- 172.21.15.173:0/1773984491 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcee4066f60 0x7fcee4069420 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcef80af000 tx=0x7fcef80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf1114e000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a52a40 0x564523a52e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf1114e000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a53360 0x564523a0d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf1114e000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a0dd90 0x564523a0e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf1114e000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645238f01f0 con 0x564523a53360 2024-04-25T09:13:08.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf1114e000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523856e90 con 0x564523a0dd90 2024-04-25T09:13:08.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf1114e000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645237def50 con 0x564523a52a40 2024-04-25T09:13:08.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fceffe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a53360 0x564523a0d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fceffe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a53360 0x564523a0d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35032/0 (socket says 172.21.15.173:35032) 2024-04-25T09:13:08.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fceffe00640 1 -- 172.21.15.173:0/2369322524 learned_addr learned my addr 172.21.15.173:0/2369322524 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf06a00640 1 --2- 172.21.15.173:0/2369322524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a52a40 0x564523a52e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf07400640 1 --2- 172.21.15.173:0/2369322524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a0dd90 0x564523a0e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fceffe00640 1 -- 172.21.15.173:0/2369322524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a52a40 msgr2=0x564523a52e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fceffe00640 1 --2- 172.21.15.173:0/2369322524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a52a40 0x564523a52e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fceffe00640 1 -- 172.21.15.173:0/2369322524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a0dd90 msgr2=0x564523a0e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fceffe00640 1 --2- 172.21.15.173:0/2369322524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a0dd90 0x564523a0e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fceffe00640 1 -- 172.21.15.173:0/2369322524 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56452382e8b0 con 0x564523a53360 2024-04-25T09:13:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fceffe00640 1 --2- 172.21.15.173:0/2369322524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a53360 0x564523a0d850 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fcef005cf00 tx=0x7fcef000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a01534071fdd789 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcef7400640 1 -- 172.21.15.173:0/2369322524 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef00530d0 con 0x564523a53360 2024-04-25T09:13:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcef7400640 1 -- 172.21.15.173:0/2369322524 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef005b070 con 0x564523a53360 2024-04-25T09:13:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcef7400640 1 -- 172.21.15.173:0/2369322524 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0054220 con 0x564523a53360 2024-04-25T09:13:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf1114e000 1 -- 172.21.15.173:0/2369322524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a53360 msgr2=0x564523a0d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf1114e000 1 --2- 172.21.15.173:0/2369322524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a53360 0x564523a0d850 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fcef005cf00 tx=0x7fcef000f000 comp rx=0 tx=0).stop 2024-04-25T09:13:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf1114e000 1 -- 172.21.15.173:0/2369322524 shutdown_connections 2024-04-25T09:13:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf1114e000 1 --2- 172.21.15.173:0/2369322524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a0dd90 0x564523a0e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf1114e000 1 --2- 172.21.15.173:0/2369322524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a53360 0x564523a0d850 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf1114e000 1 --2- 172.21.15.173:0/2369322524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a52a40 0x564523a52e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf1114e000 1 -- 172.21.15.173:0/2369322524 >> 172.21.15.173:0/2369322524 conn(0x564523a09d40 msgr2=0x564523a0c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf1114e000 1 -- 172.21.15.173:0/2369322524 shutdown_connections 2024-04-25T09:13:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf1114e000 1 -- 172.21.15.173:0/2369322524 wait complete. 2024-04-25T09:13:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf1114e000 1 -- start start 2024-04-25T09:13:08.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.261+0000 7fcf1114e000 1 Processor -- start 2024-04-25T09:13:08.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a0dd90 0x564523a5a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a52a40 0x564523a5a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a53360 0x564523a13ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523811540 con 0x564523a0dd90 2024-04-25T09:13:08.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523852f30 con 0x564523a52a40 2024-04-25T09:13:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645239f45b0 con 0x564523a53360 2024-04-25T09:13:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 10 client.0 _ll_register_callbacks cb 0x56452390b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:13:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf06a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a0dd90 0x564523a5a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf06a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a0dd90 0x564523a5a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35034/0 (socket says 172.21.15.173:35034) 2024-04-25T09:13:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf06a00640 1 -- 172.21.15.173:0/1976838907 learned_addr learned my addr 172.21.15.173:0/1976838907 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fceffe00640 1 --2- 172.21.15.173:0/1976838907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a52a40 0x564523a5a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf07400640 1 --2- 172.21.15.173:0/1976838907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a53360 0x564523a13ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf06a00640 1 -- 172.21.15.173:0/1976838907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a53360 msgr2=0x564523a13ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf06a00640 1 --2- 172.21.15.173:0/1976838907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a53360 0x564523a13ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf06a00640 1 -- 172.21.15.173:0/1976838907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a52a40 msgr2=0x564523a5a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf06a00640 1 --2- 172.21.15.173:0/1976838907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a52a40 0x564523a5a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf06a00640 1 -- 172.21.15.173:0/1976838907 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645237df1a0 con 0x564523a0dd90 2024-04-25T09:13:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf06a00640 1 --2- 172.21.15.173:0/1976838907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a0dd90 0x564523a5a1c0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009630 tx=0x7fcef801ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3627678951600518 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fceebe00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:13:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fceebe00640 1 -- 172.21.15.173:0/1976838907 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef80cf060 con 0x564523a0dd90 2024-04-25T09:13:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fceebe00640 1 -- 172.21.15.173:0/1976838907 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcef80c1410 con 0x564523a0dd90 2024-04-25T09:13:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 -- 172.21.15.173:0/1976838907 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcef005b070 con 0x564523a0dd90 2024-04-25T09:13:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fceebe00640 1 -- 172.21.15.173:0/1976838907 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcef80d5050 con 0x564523a0dd90 2024-04-25T09:13:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 10 client.9642 fetch_fsmap learned FSMap version 89 2024-04-25T09:13:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 -- 172.21.15.173:0/1976838907 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x5645238d9840 con 0x564523a0dd90 2024-04-25T09:13:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fceebe00640 1 -- 172.21.15.173:0/1976838907 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef005b070 con 0x564523a0dd90 2024-04-25T09:13:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fceebe00640 1 -- 172.21.15.173:0/1976838907 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 89) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcef80d8020 con 0x564523a0dd90 2024-04-25T09:13:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 10 client.9642 fetch_fsmap finished waiting for FSMap version 89 2024-04-25T09:13:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 10 client.9642 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-04-25T09:13:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 20 client.9642 populate_metadata read hostname 'smithi173' 2024-04-25T09:13:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 --2- 172.21.15.173:0/1976838907 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x564523a14c30 0x564523a15010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 4 client.9642 mds_command: new command op to 9411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:13:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 -- 172.21.15.173:0/1976838907 --> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5645237f2be0 con 0x564523a14c30 2024-04-25T09:13:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fceffe00640 1 --2- 172.21.15.173:0/1976838907 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x564523a14c30 0x564523a15010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fceffe00640 1 --2- 172.21.15.173:0/1976838907 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x564523a14c30 0x564523a15010 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9438ed22f9cfd8b3 server_cookie=e83d3ea578c68cb2 in_seq=0 out_seq=0 2024-04-25T09:13:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fceebe00640 10 client.9642 ms_handle_connect on v2:172.21.15.173:6836/3627798672 2024-04-25T09:13:08.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fceebe00640 1 -- 172.21.15.173:0/1976838907 <== mds.0 v2:172.21.15.173:6836/3627798672 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5645237f2be0 con 0x564523a14c30 2024-04-25T09:13:08.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fceebe00640 10 client.9642 handle_command_reply: tid=0 2024-04-25T09:13:08.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 client.9642 shutdown 2024-04-25T09:13:08.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 -- 172.21.15.173:0/1976838907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a0dd90 msgr2=0x564523a5a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 --2- 172.21.15.173:0/1976838907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a0dd90 0x564523a5a1c0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009630 tx=0x7fcef801ad70 comp rx=0 tx=0).stop 2024-04-25T09:13:08.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 -- 172.21.15.173:0/1976838907 shutdown_connections 2024-04-25T09:13:08.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 --2- 172.21.15.173:0/1976838907 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x564523a14c30 0x564523a15010 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 --2- 172.21.15.173:0/1976838907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a53360 0x564523a13ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 --2- 172.21.15.173:0/1976838907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a52a40 0x564523a5a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 --2- 172.21.15.173:0/1976838907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a0dd90 0x564523a5a1c0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fceebe00640 0 client.9642 ms_handle_reset on v2:172.21.15.173:6836/3627798672 2024-04-25T09:13:08.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 -- 172.21.15.173:0/1976838907 >> 172.21.15.173:0/1976838907 conn(0x564523a09d40 msgr2=0x564523a0c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 -- 172.21.15.173:0/1976838907 shutdown_connections 2024-04-25T09:13:08.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 1 -- 172.21.15.173:0/1976838907 wait complete. 2024-04-25T09:13:08.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.265+0000 7fcf1114e000 20 client.9642 trim_cache size 0 max 16384 2024-04-25T09:13:08.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.281+0000 7fcf1114e000 1 Processor -- start 2024-04-25T09:13:08.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.281+0000 7fcf1114e000 1 -- start start 2024-04-25T09:13:08.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.281+0000 7fcf1114e000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a0dd90 0x564523ab7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.281+0000 7fcf1114e000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a52a40 0x564523ab7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.281+0000 7fcf1114e000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a53360 0x564523ab8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.281+0000 7fcf1114e000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf082039b0 con 0x564523a53360 2024-04-25T09:13:08.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.281+0000 7fcf1114e000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf08202b60 con 0x564523a0dd90 2024-04-25T09:13:08.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.281+0000 7fcf1114e000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf08158f20 con 0x564523a52a40 2024-04-25T09:13:08.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.281+0000 7fcf07400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a53360 0x564523ab8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.281+0000 7fcf07400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a53360 0x564523ab8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35048/0 (socket says 172.21.15.173:35048) 2024-04-25T09:13:08.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.281+0000 7fcf07400640 1 -- 172.21.15.173:0/1787867739 learned_addr learned my addr 172.21.15.173:0/1787867739 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:08.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.281+0000 7fcf07400640 1 -- 172.21.15.173:0/1787867739 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a52a40 msgr2=0x564523ab7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.281+0000 7fcf07400640 1 --2- 172.21.15.173:0/1787867739 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a52a40 0x564523ab7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.281+0000 7fcf07400640 1 -- 172.21.15.173:0/1787867739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a0dd90 msgr2=0x564523ab7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.281+0000 7fcf07400640 1 --2- 172.21.15.173:0/1787867739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a0dd90 0x564523ab7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.281+0000 7fcf07400640 1 -- 172.21.15.173:0/1787867739 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645238b0a10 con 0x564523a53360 2024-04-25T09:13:08.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.281+0000 7fcf07400640 1 --2- 172.21.15.173:0/1787867739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a53360 0x564523ab8520 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fcf000167d0 tx=0x7fcf00009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14eef2b2537ed16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcef6a00640 1 -- 172.21.15.173:0/1787867739 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00003ba0 con 0x564523a53360 2024-04-25T09:13:08.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcef6a00640 1 -- 172.21.15.173:0/1787867739 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf00003d60 con 0x564523a53360 2024-04-25T09:13:08.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcef6a00640 1 -- 172.21.15.173:0/1787867739 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00004260 con 0x564523a53360 2024-04-25T09:13:08.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 -- 172.21.15.173:0/1787867739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a53360 msgr2=0x564523ab8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 --2- 172.21.15.173:0/1787867739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a53360 0x564523ab8520 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fcf000167d0 tx=0x7fcf00009750 comp rx=0 tx=0).stop 2024-04-25T09:13:08.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 -- 172.21.15.173:0/1787867739 shutdown_connections 2024-04-25T09:13:08.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 --2- 172.21.15.173:0/1787867739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a53360 0x564523ab8520 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 --2- 172.21.15.173:0/1787867739 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a52a40 0x564523ab7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 --2- 172.21.15.173:0/1787867739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a0dd90 0x564523ab7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 -- 172.21.15.173:0/1787867739 >> 172.21.15.173:0/1787867739 conn(0x564523a09d40 msgr2=0x564523a511f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 -- 172.21.15.173:0/1787867739 shutdown_connections 2024-04-25T09:13:08.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 -- 172.21.15.173:0/1787867739 wait complete. 2024-04-25T09:13:08.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 -- start start 2024-04-25T09:13:08.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 Processor -- start 2024-04-25T09:13:08.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a0dd90 0x564523abb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a52a40 0x564523abbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a53360 0x564523a57ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523855e60 con 0x564523a0dd90 2024-04-25T09:13:08.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf08159520 con 0x564523a53360 2024-04-25T09:13:08.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x564523852f30 con 0x564523a52a40 2024-04-25T09:13:08.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 10 client.0 _ll_register_callbacks cb 0x564523819a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:13:08.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf06a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a0dd90 0x564523abb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf06a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a0dd90 0x564523abb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35062/0 (socket says 172.21.15.173:35062) 2024-04-25T09:13:08.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf06a00640 1 -- 172.21.15.173:0/2986561490 learned_addr learned my addr 172.21.15.173:0/2986561490 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:08.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf07400640 1 --2- 172.21.15.173:0/2986561490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a53360 0x564523a57ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fceffe00640 1 --2- 172.21.15.173:0/2986561490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a52a40 0x564523abbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf06a00640 1 -- 172.21.15.173:0/2986561490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a52a40 msgr2=0x564523abbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf06a00640 1 --2- 172.21.15.173:0/2986561490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a52a40 0x564523abbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf06a00640 1 -- 172.21.15.173:0/2986561490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a53360 msgr2=0x564523a57ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf06a00640 1 --2- 172.21.15.173:0/2986561490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a53360 0x564523a57ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf06a00640 1 -- 172.21.15.173:0/2986561490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645237ebb00 con 0x564523a0dd90 2024-04-25T09:13:08.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf07400640 1 --2- 172.21.15.173:0/2986561490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a53360 0x564523a57ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:08.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf06a00640 1 --2- 172.21.15.173:0/2986561490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a0dd90 0x564523abb8a0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fcef801c570 tx=0x7fcef80192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0f5a3d37a05c5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fceebe00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:13:08.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fceebe00640 1 -- 172.21.15.173:0/2986561490 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef80dd020 con 0x564523a0dd90 2024-04-25T09:13:08.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fceebe00640 1 -- 172.21.15.173:0/2986561490 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcef80c1410 con 0x564523a0dd90 2024-04-25T09:13:08.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 -- 172.21.15.173:0/2986561490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcf00003d60 con 0x564523a0dd90 2024-04-25T09:13:08.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fceebe00640 1 -- 172.21.15.173:0/2986561490 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcef80bc070 con 0x564523a0dd90 2024-04-25T09:13:08.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 10 client.9648 fetch_fsmap learned FSMap version 89 2024-04-25T09:13:08.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.285+0000 7fcf1114e000 1 -- 172.21.15.173:0/2986561490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x5645237fdf80 con 0x564523a0dd90 2024-04-25T09:13:08.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fceebe00640 1 -- 172.21.15.173:0/2986561490 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf00003d60 con 0x564523a0dd90 2024-04-25T09:13:08.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fceebe00640 1 -- 172.21.15.173:0/2986561490 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 89) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcef80d2070 con 0x564523a0dd90 2024-04-25T09:13:08.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf1114e000 10 client.9648 fetch_fsmap finished waiting for FSMap version 89 2024-04-25T09:13:08.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf1114e000 10 client.9648 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-04-25T09:13:08.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf1114e000 20 client.9648 populate_metadata read hostname 'smithi173' 2024-04-25T09:13:08.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf1114e000 1 --2- 172.21.15.173:0/2986561490 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x564523a58ba0 0x564523a58fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf1114e000 4 client.9648 mds_command: new command op to 9411 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-04-25T09:13:08.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf1114e000 1 -- 172.21.15.173:0/2986561490 --> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x5645238643d0 con 0x564523a58ba0 2024-04-25T09:13:08.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fceffe00640 1 --2- 172.21.15.173:0/2986561490 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x564523a58ba0 0x564523a58fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fceffe00640 1 --2- 172.21.15.173:0/2986561490 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x564523a58ba0 0x564523a58fb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca1bc704a2e2349a server_cookie=dd5bcd8076b59c31 in_seq=0 out_seq=0 2024-04-25T09:13:08.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fceebe00640 10 client.9648 ms_handle_connect on v2:172.21.15.173:6836/3627798672 2024-04-25T09:13:08.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fceebe00640 1 -- 172.21.15.173:0/2986561490 <== mds.0 v2:172.21.15.173:6836/3627798672 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x5645238643d0 con 0x564523a58ba0 2024-04-25T09:13:08.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fceebe00640 10 client.9648 handle_command_reply: tid=0 2024-04-25T09:13:08.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf1114e000 1 client.9648 shutdown 2024-04-25T09:13:08.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf1114e000 1 -- 172.21.15.173:0/2986561490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a0dd90 msgr2=0x564523abb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf1114e000 1 --2- 172.21.15.173:0/2986561490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a0dd90 0x564523abb8a0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fcef801c570 tx=0x7fcef80192d0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf1114e000 1 -- 172.21.15.173:0/2986561490 shutdown_connections 2024-04-25T09:13:08.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf1114e000 1 --2- 172.21.15.173:0/2986561490 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x564523a58ba0 0x564523a58fb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf1114e000 1 --2- 172.21.15.173:0/2986561490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564523a53360 0x564523a57ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf1114e000 1 --2- 172.21.15.173:0/2986561490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x564523a52a40 0x564523abbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fceebe00640 0 client.9648 ms_handle_reset on v2:172.21.15.173:6836/3627798672 2024-04-25T09:13:08.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf1114e000 1 --2- 172.21.15.173:0/2986561490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564523a0dd90 0x564523abb8a0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf1114e000 1 -- 172.21.15.173:0/2986561490 >> 172.21.15.173:0/2986561490 conn(0x564523a09d40 msgr2=0x564523a51a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf1114e000 1 -- 172.21.15.173:0/2986561490 shutdown_connections 2024-04-25T09:13:08.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf1114e000 1 -- 172.21.15.173:0/2986561490 wait complete. 2024-04-25T09:13:08.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf1114e000 20 client.9648 trim_cache size 0 max 16384 2024-04-25T09:13:08.279 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:13:08.279 INFO:teuthology.orchestra.run.smithi173.stdout: "return_code": 0 2024-04-25T09:13:08.279 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:13:08.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf07e00640 1 -- 172.21.15.173:0/1773984491 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcee4066f60 msgr2=0x7fcee4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf07e00640 1 --2- 172.21.15.173:0/1773984491 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcee4066f60 0x7fcee4069420 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcef80af000 tx=0x7fcef80a7000 comp rx=0 tx=0).stop 2024-04-25T09:13:08.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf07e00640 1 -- 172.21.15.173:0/1773984491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf0806c220 msgr2=0x7fcf0806f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf07e00640 1 --2- 172.21.15.173:0/1773984491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf0806c220 0x7fcf0806f500 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fcef000c3a0 tx=0x7fcef000c860 comp rx=0 tx=0).stop 2024-04-25T09:13:08.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf07e00640 1 -- 172.21.15.173:0/1773984491 shutdown_connections 2024-04-25T09:13:08.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf07e00640 1 --2- 172.21.15.173:0/1773984491 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcee4066f60 0x7fcee4069420 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf07e00640 1 --2- 172.21.15.173:0/1773984491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf08099a50 0x7fcf0806fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf07e00640 1 --2- 172.21.15.173:0/1773984491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf0806c220 0x7fcf0806f500 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf07e00640 1 --2- 172.21.15.173:0/1773984491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf0806bda0 0x7fcf08142760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf07e00640 1 -- 172.21.15.173:0/1773984491 >> 172.21.15.173:0/1773984491 conn(0x7fcf080b31d0 msgr2=0x7fcf08070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf07e00640 1 -- 172.21.15.173:0/1773984491 shutdown_connections 2024-04-25T09:13:08.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.289+0000 7fcf07e00640 1 -- 172.21.15.173:0/1773984491 wait complete. 2024-04-25T09:13:08.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:08.293 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-04-25T09:13:08.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.445+0000 7fded0600640 1 Processor -- start 2024-04-25T09:13:08.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.445+0000 7fded0600640 1 -- start start 2024-04-25T09:13:08.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.445+0000 7fded0600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdec8145290 0x7fdec815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.445+0000 7fded0600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec815c5f0 con 0x7fdec80cc260 2024-04-25T09:13:08.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.445+0000 7fded0600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec806d4b0 con 0x7fdec80b3fe0 2024-04-25T09:13:08.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.445+0000 7fded0600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec80ccd80 con 0x7fdec8145290 2024-04-25T09:13:08.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.449+0000 7fdece600640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fdec80cc260 0x7fdec80cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45784/0 (socket says 172.21.15.173:45784) 2024-04-25T09:13:08.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.449+0000 7fdece600640 1 -- 172.21.15.173:0/1814272855 learned_addr learned my addr 172.21.15.173:0/1814272855 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:08.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.449+0000 7fdecdc00640 1 --2- 172.21.15.173:0/1814272855 >> v2:172.21.15.194:3300/0 conn(0x7fdec8145290 0x7fdec815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.449+0000 7fdecdc00640 1 -- 172.21.15.173:0/1814272855 >> v1:172.21.15.194:6789/0 conn(0x7fdec80b3fe0 legacy=0x7fdec80b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.449+0000 7fdec7e00640 1 -- 172.21.15.173:0/1814272855 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676524042 0 0) 0x7fdec00014a0 con 0x7fdec80cc260 2024-04-25T09:13:08.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.449+0000 7fdecdc00640 1 -- 172.21.15.173:0/1814272855 >> v1:172.21.15.173:6789/0 conn(0x7fdec80cc260 legacy=0x7fdec80cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.449+0000 7fdecdc00640 1 -- 172.21.15.173:0/1814272855 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec806d790 con 0x7fdec8145290 2024-04-25T09:13:08.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.449+0000 7fdecdc00640 1 --2- 172.21.15.173:0/1814272855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdec8145290 0x7fdec815c0b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0097c0 tx=0x7fdebc01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3afd3c09a2ed38b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.449+0000 7fdec7e00640 1 -- 172.21.15.173:0/1814272855 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0b0070 con 0x7fdec8145290 2024-04-25T09:13:08.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.449+0000 7fdec7e00640 1 -- 172.21.15.173:0/1814272855 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc0ab600 con 0x7fdec8145290 2024-04-25T09:13:08.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.449+0000 7fdec7e00640 1 -- 172.21.15.173:0/1814272855 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0ab9d0 con 0x7fdec8145290 2024-04-25T09:13:08.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fded0600640 1 -- 172.21.15.173:0/1814272855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdec8145290 msgr2=0x7fdec815c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fded0600640 1 --2- 172.21.15.173:0/1814272855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdec8145290 0x7fdec815c0b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0097c0 tx=0x7fdebc01c380 comp rx=0 tx=0).stop 2024-04-25T09:13:08.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fded0600640 1 -- 172.21.15.173:0/1814272855 shutdown_connections 2024-04-25T09:13:08.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fded0600640 1 --2- 172.21.15.173:0/1814272855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdec8145290 0x7fdec815c0b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fded0600640 1 -- 172.21.15.173:0/1814272855 >> 172.21.15.173:0/1814272855 conn(0x7fdec806ac90 msgr2=0x7fdec806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fded0600640 1 -- 172.21.15.173:0/1814272855 shutdown_connections 2024-04-25T09:13:08.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fded0600640 1 -- 172.21.15.173:0/1814272855 wait complete. 2024-04-25T09:13:08.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fded0600640 1 Processor -- start 2024-04-25T09:13:08.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fded0600640 1 -- start start 2024-04-25T09:13:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fded0600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdec80b3fe0 0x7fdec81f8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fded0600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdec80cc260 0x7fdec8136a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fded0600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdec8145290 0x7fdec813bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fded0600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec806eee0 con 0x7fdec80cc260 2024-04-25T09:13:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fded0600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec806ed60 con 0x7fdec8145290 2024-04-25T09:13:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fded0600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec806f060 con 0x7fdec80b3fe0 2024-04-25T09:13:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fdecd200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdec80cc260 0x7fdec8136a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fdecd200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdec80cc260 0x7fdec8136a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35064/0 (socket says 172.21.15.173:35064) 2024-04-25T09:13:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fdecd200640 1 -- 172.21.15.173:0/2449996243 learned_addr learned my addr 172.21.15.173:0/2449996243 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fdecdc00640 1 --2- 172.21.15.173:0/2449996243 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdec80b3fe0 0x7fdec81f8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.453+0000 7fdece600640 1 --2- 172.21.15.173:0/2449996243 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdec8145290 0x7fdec813bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.457+0000 7fdecd200640 1 -- 172.21.15.173:0/2449996243 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdec80b3fe0 msgr2=0x7fdec81f8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.457+0000 7fdecd200640 1 --2- 172.21.15.173:0/2449996243 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdec80b3fe0 0x7fdec81f8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.457+0000 7fdecd200640 1 -- 172.21.15.173:0/2449996243 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdec8145290 msgr2=0x7fdec813bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.457+0000 7fdecd200640 1 --2- 172.21.15.173:0/2449996243 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdec8145290 0x7fdec813bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.457+0000 7fdecd200640 1 -- 172.21.15.173:0/2449996243 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec8136fc0 con 0x7fdec80cc260 2024-04-25T09:13:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.457+0000 7fdecd200640 1 --2- 172.21.15.173:0/2449996243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdec80cc260 0x7fdec8136a80 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400c3c0 tx=0x7fdeb400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.457+0000 7fdec5600640 1 -- 172.21.15.173:0/2449996243 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4017070 con 0x7fdec80cc260 2024-04-25T09:13:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.457+0000 7fdec5600640 1 -- 172.21.15.173:0/2449996243 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb40052d0 con 0x7fdec80cc260 2024-04-25T09:13:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.457+0000 7fded0600640 1 -- 172.21.15.173:0/2449996243 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec8143760 con 0x7fdec80cc260 2024-04-25T09:13:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.457+0000 7fdec5600640 1 -- 172.21.15.173:0/2449996243 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4003840 con 0x7fdec80cc260 2024-04-25T09:13:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.457+0000 7fded0600640 1 -- 172.21.15.173:0/2449996243 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec8143d20 con 0x7fdec80cc260 2024-04-25T09:13:08.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.457+0000 7fdec5600640 1 -- 172.21.15.173:0/2449996243 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdeb401a070 con 0x7fdec80cc260 2024-04-25T09:13:08.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdec5600640 1 --2- 172.21.15.173:0/2449996243 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdea8066f60 0x7fdea8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdec5600640 1 -- 172.21.15.173:0/2449996243 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdeb4084430 con 0x7fdec80cc260 2024-04-25T09:13:08.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdecdc00640 1 --2- 172.21.15.173:0/2449996243 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdea8066f60 0x7fdea8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fded3ae9000 1 Processor -- start 2024-04-25T09:13:08.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fded3ae9000 1 -- start start 2024-04-25T09:13:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdecdc00640 1 --2- 172.21.15.173:0/2449996243 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdea8066f60 0x7fdea8069420 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0ad000 tx=0x7fdebc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fded3ae9000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38e9d0 0x55ddcb38edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fded3ae9000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38f2f0 0x55ddcb344b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fded3ae9000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb3450a0 0x55ddcb345480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fded3ae9000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddcb191ff0 con 0x55ddcb38e9d0 2024-04-25T09:13:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fded3ae9000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddcb11a150 con 0x55ddcb38f2f0 2024-04-25T09:13:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fded3ae9000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ddcb18e090 con 0x55ddcb3450a0 2024-04-25T09:13:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdecdc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38e9d0 0x55ddcb38edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdecdc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38e9d0 0x55ddcb38edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35066/0 (socket says 172.21.15.173:35066) 2024-04-25T09:13:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdecdc00640 1 -- 172.21.15.173:0/3460580521 learned_addr learned my addr 172.21.15.173:0/3460580521 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdecd200640 1 --2- 172.21.15.173:0/3460580521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38f2f0 0x55ddcb344b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdece600640 1 --2- 172.21.15.173:0/3460580521 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb3450a0 0x55ddcb345480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdecdc00640 1 -- 172.21.15.173:0/3460580521 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb3450a0 msgr2=0x55ddcb345480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdecdc00640 1 --2- 172.21.15.173:0/3460580521 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb3450a0 0x55ddcb345480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdecdc00640 1 -- 172.21.15.173:0/3460580521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38f2f0 msgr2=0x55ddcb344b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdecdc00640 1 --2- 172.21.15.173:0/3460580521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38f2f0 0x55ddcb344b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdecdc00640 1 -- 172.21.15.173:0/3460580521 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddcb3280d0 con 0x55ddcb38e9d0 2024-04-25T09:13:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdecd200640 1 --2- 172.21.15.173:0/3460580521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38f2f0 0x55ddcb344b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:08.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdecdc00640 1 --2- 172.21.15.173:0/3460580521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38e9d0 0x55ddcb38edb0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fdebc019fb0 tx=0x7fdebc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ae072585f7f3ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdeba000640 1 -- 172.21.15.173:0/3460580521 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0b0040 con 0x55ddcb38e9d0 2024-04-25T09:13:08.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdeba000640 1 -- 172.21.15.173:0/3460580521 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc0c5070 con 0x55ddcb38e9d0 2024-04-25T09:13:08.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fdeba000640 1 -- 172.21.15.173:0/3460580521 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0b6640 con 0x55ddcb38e9d0 2024-04-25T09:13:08.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fded3ae9000 1 -- 172.21.15.173:0/3460580521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38e9d0 msgr2=0x55ddcb38edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fded3ae9000 1 --2- 172.21.15.173:0/3460580521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38e9d0 0x55ddcb38edb0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fdebc019fb0 tx=0x7fdebc004740 comp rx=0 tx=0).stop 2024-04-25T09:13:08.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fded3ae9000 1 -- 172.21.15.173:0/3460580521 shutdown_connections 2024-04-25T09:13:08.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fded3ae9000 1 --2- 172.21.15.173:0/3460580521 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb3450a0 0x55ddcb345480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fded3ae9000 1 --2- 172.21.15.173:0/3460580521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38f2f0 0x55ddcb344b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fded3ae9000 1 --2- 172.21.15.173:0/3460580521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38e9d0 0x55ddcb38edb0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fded3ae9000 1 -- 172.21.15.173:0/3460580521 >> 172.21.15.173:0/3460580521 conn(0x55ddcb341020 msgr2=0x55ddcb343440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fded3ae9000 1 -- 172.21.15.173:0/3460580521 shutdown_connections 2024-04-25T09:13:08.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.461+0000 7fded3ae9000 1 -- 172.21.15.173:0/3460580521 wait complete. 2024-04-25T09:13:08.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fded3ae9000 1 -- start start 2024-04-25T09:13:08.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fded3ae9000 1 Processor -- start 2024-04-25T09:13:08.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fded3ae9000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb3450a0 0x55ddcb39a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fded3ae9000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38e9d0 0x55ddcb39a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fded3ae9000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38f2f0 0x55ddcb376f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fded3ae9000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddcb156250 con 0x55ddcb38f2f0 2024-04-25T09:13:08.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fded3ae9000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddcb14c690 con 0x55ddcb38e9d0 2024-04-25T09:13:08.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fded3ae9000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ddcb11aa40 con 0x55ddcb3450a0 2024-04-25T09:13:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fded3ae9000 10 client.0 _ll_register_callbacks cb 0x55ddcb32fe90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:13:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdece600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38f2f0 0x55ddcb376f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdece600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38f2f0 0x55ddcb376f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35068/0 (socket says 172.21.15.173:35068) 2024-04-25T09:13:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdece600640 1 -- 172.21.15.173:0/87725370 learned_addr learned my addr 172.21.15.173:0/87725370 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdecdc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb3450a0 0x55ddcb39a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdecd200640 1 --2- 172.21.15.173:0/87725370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38e9d0 0x55ddcb39a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdece600640 1 -- 172.21.15.173:0/87725370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb3450a0 msgr2=0x55ddcb39a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdece600640 1 --2- 172.21.15.173:0/87725370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb3450a0 0x55ddcb39a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdece600640 1 -- 172.21.15.173:0/87725370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38e9d0 msgr2=0x55ddcb39a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdece600640 1 --2- 172.21.15.173:0/87725370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38e9d0 0x55ddcb39a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdece600640 1 -- 172.21.15.173:0/87725370 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ddcb23f1c0 con 0x55ddcb38f2f0 2024-04-25T09:13:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdecdc00640 1 --2- 172.21.15.173:0/87725370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb3450a0 0x55ddcb39a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdece600640 1 --2- 172.21.15.173:0/87725370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38f2f0 0x55ddcb376f70 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fdec0007b80 tx=0x7fdec0012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7442d5afceaf669 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdeaea00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:13:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdeaea00640 1 -- 172.21.15.173:0/87725370 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0019070 con 0x55ddcb38f2f0 2024-04-25T09:13:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdeaea00640 1 -- 172.21.15.173:0/87725370 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdec0015440 con 0x55ddcb38f2f0 2024-04-25T09:13:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fded3ae9000 1 -- 172.21.15.173:0/87725370 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdebc0c5070 con 0x55ddcb38f2f0 2024-04-25T09:13:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdeaea00640 1 -- 172.21.15.173:0/87725370 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdec0024050 con 0x55ddcb38f2f0 2024-04-25T09:13:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fded3ae9000 10 client.9660 fetch_fsmap learned FSMap version 89 2024-04-25T09:13:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fded3ae9000 1 -- 172.21.15.173:0/87725370 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x55ddcb23b170 con 0x55ddcb38f2f0 2024-04-25T09:13:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdeaea00640 1 -- 172.21.15.173:0/87725370 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc0c5070 con 0x55ddcb38f2f0 2024-04-25T09:13:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdeaea00640 1 -- 172.21.15.173:0/87725370 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 89) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdec0027020 con 0x55ddcb38f2f0 2024-04-25T09:13:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fded3ae9000 10 client.9660 fetch_fsmap finished waiting for FSMap version 89 2024-04-25T09:13:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fded3ae9000 10 client.9660 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-04-25T09:13:08.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fded3ae9000 20 client.9660 populate_metadata read hostname 'smithi173' 2024-04-25T09:13:08.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fded3ae9000 1 --2- 172.21.15.173:0/87725370 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x55ddcb377ce0 0x55ddcb3780c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fded3ae9000 4 client.9660 mds_command: new command op to 9411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:13:08.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fded3ae9000 1 -- 172.21.15.173:0/87725370 --> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ddcb12dc60 con 0x55ddcb377ce0 2024-04-25T09:13:08.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.465+0000 7fdecdc00640 1 --2- 172.21.15.173:0/87725370 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x55ddcb377ce0 0x55ddcb3780c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.469+0000 7fdecdc00640 1 --2- 172.21.15.173:0/87725370 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x55ddcb377ce0 0x55ddcb3780c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13b1462ee828ac70 server_cookie=f297e671dad8bdee in_seq=0 out_seq=0 2024-04-25T09:13:08.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.469+0000 7fdeaea00640 10 client.9660 ms_handle_connect on v2:172.21.15.173:6836/3627798672 2024-04-25T09:13:08.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.469+0000 7fdeaea00640 1 -- 172.21.15.173:0/87725370 <== mds.0 v2:172.21.15.173:6836/3627798672 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ddcb12dc60 con 0x55ddcb377ce0 2024-04-25T09:13:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.469+0000 7fdeaea00640 10 client.9660 handle_command_reply: tid=0 2024-04-25T09:13:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.469+0000 7fded3ae9000 1 client.9660 shutdown 2024-04-25T09:13:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.469+0000 7fded3ae9000 1 -- 172.21.15.173:0/87725370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38f2f0 msgr2=0x55ddcb376f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.469+0000 7fded3ae9000 1 --2- 172.21.15.173:0/87725370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38f2f0 0x55ddcb376f70 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fdec0007b80 tx=0x7fdec0012690 comp rx=0 tx=0).stop 2024-04-25T09:13:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.469+0000 7fded3ae9000 1 -- 172.21.15.173:0/87725370 shutdown_connections 2024-04-25T09:13:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.469+0000 7fded3ae9000 1 --2- 172.21.15.173:0/87725370 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x55ddcb377ce0 0x55ddcb3780c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.469+0000 7fded3ae9000 1 --2- 172.21.15.173:0/87725370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38f2f0 0x55ddcb376f70 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.469+0000 7fded3ae9000 1 --2- 172.21.15.173:0/87725370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38e9d0 0x55ddcb39a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.469+0000 7fdeaea00640 0 client.9660 ms_handle_reset on v2:172.21.15.173:6836/3627798672 2024-04-25T09:13:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.469+0000 7fded3ae9000 1 --2- 172.21.15.173:0/87725370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb3450a0 0x55ddcb39a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.469+0000 7fded3ae9000 1 -- 172.21.15.173:0/87725370 >> 172.21.15.173:0/87725370 conn(0x55ddcb341020 msgr2=0x55ddcb343ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.469+0000 7fded3ae9000 1 -- 172.21.15.173:0/87725370 shutdown_connections 2024-04-25T09:13:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.469+0000 7fded3ae9000 1 -- 172.21.15.173:0/87725370 wait complete. 2024-04-25T09:13:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.469+0000 7fded3ae9000 20 client.9660 trim_cache size 0 max 16384 2024-04-25T09:13:08.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 Processor -- start 2024-04-25T09:13:08.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 -- start start 2024-04-25T09:13:08.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb3450a0 0x55ddcb3a9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38e9d0 0x55ddcb375ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38f2f0 0x55ddcb376020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec80cf2c0 con 0x55ddcb38f2f0 2024-04-25T09:13:08.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec80ce500 con 0x55ddcb38e9d0 2024-04-25T09:13:08.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec815ace0 con 0x55ddcb3450a0 2024-04-25T09:13:08.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fdece600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38f2f0 0x55ddcb376020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fdecdc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb3450a0 0x55ddcb3a9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fdece600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38f2f0 0x55ddcb376020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35074/0 (socket says 172.21.15.173:35074) 2024-04-25T09:13:08.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fdece600640 1 -- 172.21.15.173:0/495972626 learned_addr learned my addr 172.21.15.173:0/495972626 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:08.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fdecd200640 1 --2- 172.21.15.173:0/495972626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38e9d0 0x55ddcb375ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fdece600640 1 -- 172.21.15.173:0/495972626 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb3450a0 msgr2=0x55ddcb3a9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fdece600640 1 --2- 172.21.15.173:0/495972626 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb3450a0 0x55ddcb3a9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fdece600640 1 -- 172.21.15.173:0/495972626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38e9d0 msgr2=0x55ddcb375ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fdece600640 1 --2- 172.21.15.173:0/495972626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38e9d0 0x55ddcb375ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fdece600640 1 -- 172.21.15.173:0/495972626 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddcb1d8de0 con 0x55ddcb38f2f0 2024-04-25T09:13:08.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fdece600640 1 --2- 172.21.15.173:0/495972626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38f2f0 0x55ddcb376020 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fdec0001230 tx=0x7fdec0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9fa7ff3721722b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fdeb9600640 1 -- 172.21.15.173:0/495972626 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0019050 con 0x55ddcb38f2f0 2024-04-25T09:13:08.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fdeb9600640 1 -- 172.21.15.173:0/495972626 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec0015800 con 0x55ddcb38f2f0 2024-04-25T09:13:08.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fdeb9600640 1 -- 172.21.15.173:0/495972626 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0015bf0 con 0x55ddcb38f2f0 2024-04-25T09:13:08.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 -- 172.21.15.173:0/495972626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38f2f0 msgr2=0x55ddcb376020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 --2- 172.21.15.173:0/495972626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38f2f0 0x55ddcb376020 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fdec0001230 tx=0x7fdec0016000 comp rx=0 tx=0).stop 2024-04-25T09:13:08.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 -- 172.21.15.173:0/495972626 shutdown_connections 2024-04-25T09:13:08.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 --2- 172.21.15.173:0/495972626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb38f2f0 0x55ddcb376020 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 --2- 172.21.15.173:0/495972626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38e9d0 0x55ddcb375ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 --2- 172.21.15.173:0/495972626 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb3450a0 0x55ddcb3a9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 -- 172.21.15.173:0/495972626 >> 172.21.15.173:0/495972626 conn(0x55ddcb341020 msgr2=0x55ddcb371470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 -- 172.21.15.173:0/495972626 shutdown_connections 2024-04-25T09:13:08.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 -- 172.21.15.173:0/495972626 wait complete. 2024-04-25T09:13:08.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 -- start start 2024-04-25T09:13:08.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.485+0000 7fded3ae9000 1 Processor -- start 2024-04-25T09:13:08.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb3450a0 0x55ddcb376e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38e9d0 0x55ddcb3a6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb38f2f0 0x55ddcb3a6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddcb191300 con 0x55ddcb3450a0 2024-04-25T09:13:08.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddcb12ce00 con 0x55ddcb38e9d0 2024-04-25T09:13:08.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ddcb196620 con 0x55ddcb38f2f0 2024-04-25T09:13:08.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 10 client.0 _ll_register_callbacks cb 0x55ddcb310040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:13:08.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdecdc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb3450a0 0x55ddcb376e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdecdc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb3450a0 0x55ddcb376e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35088/0 (socket says 172.21.15.173:35088) 2024-04-25T09:13:08.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdecdc00640 1 -- 172.21.15.173:0/3694841262 learned_addr learned my addr 172.21.15.173:0/3694841262 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:08.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdecd200640 1 --2- 172.21.15.173:0/3694841262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38e9d0 0x55ddcb3a6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdece600640 1 --2- 172.21.15.173:0/3694841262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb38f2f0 0x55ddcb3a6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdecdc00640 1 -- 172.21.15.173:0/3694841262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb38f2f0 msgr2=0x55ddcb3a6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdecdc00640 1 --2- 172.21.15.173:0/3694841262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb38f2f0 0x55ddcb3a6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdecdc00640 1 -- 172.21.15.173:0/3694841262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38e9d0 msgr2=0x55ddcb3a6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdecdc00640 1 --2- 172.21.15.173:0/3694841262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38e9d0 0x55ddcb3a6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdecdc00640 1 -- 172.21.15.173:0/3694841262 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ddcb1338e0 con 0x55ddcb3450a0 2024-04-25T09:13:08.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdecdc00640 1 --2- 172.21.15.173:0/3694841262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb3450a0 0x55ddcb376e80 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0096c0 tx=0x7fdebc01abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54bf1be44a855b14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdeaea00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:13:08.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdeaea00640 1 -- 172.21.15.173:0/3694841262 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0b0040 con 0x55ddcb3450a0 2024-04-25T09:13:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdeaea00640 1 -- 172.21.15.173:0/3694841262 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdebc0d12e0 con 0x55ddcb3450a0 2024-04-25T09:13:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 -- 172.21.15.173:0/3694841262 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdec0015800 con 0x55ddcb3450a0 2024-04-25T09:13:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdeaea00640 1 -- 172.21.15.173:0/3694841262 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdebc0d1e60 con 0x55ddcb3450a0 2024-04-25T09:13:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 10 client.9666 fetch_fsmap learned FSMap version 89 2024-04-25T09:13:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 -- 172.21.15.173:0/3694841262 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x55ddcb1eb8f0 con 0x55ddcb3450a0 2024-04-25T09:13:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdeaea00640 1 -- 172.21.15.173:0/3694841262 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec0015800 con 0x55ddcb3450a0 2024-04-25T09:13:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdeaea00640 1 -- 172.21.15.173:0/3694841262 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 89) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdebc0d14e0 con 0x55ddcb3450a0 2024-04-25T09:13:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 10 client.9666 fetch_fsmap finished waiting for FSMap version 89 2024-04-25T09:13:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 10 client.9666 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-04-25T09:13:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 20 client.9666 populate_metadata read hostname 'smithi173' 2024-04-25T09:13:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 --2- 172.21.15.173:0/3694841262 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x55ddcb3f2e70 0x55ddcb3f3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 4 client.9666 mds_command: new command op to 9411 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:13:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 -- 172.21.15.173:0/3694841262 --> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ddcb19f530 con 0x55ddcb3f2e70 2024-04-25T09:13:08.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdecd200640 1 --2- 172.21.15.173:0/3694841262 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x55ddcb3f2e70 0x55ddcb3f3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdeaea00640 10 client.9666 ms_handle_connect on v2:172.21.15.173:6836/3627798672 2024-04-25T09:13:08.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdecd200640 1 --2- 172.21.15.173:0/3694841262 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x55ddcb3f2e70 0x55ddcb3f3280 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eda459ce4b7a6717 server_cookie=38552ee7dfa10425 in_seq=0 out_seq=0 2024-04-25T09:13:08.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdeaea00640 1 -- 172.21.15.173:0/3694841262 <== mds.0 v2:172.21.15.173:6836/3627798672 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x55ddcb19f530 con 0x55ddcb3f2e70 2024-04-25T09:13:08.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdeaea00640 10 client.9666 handle_command_reply: tid=0 2024-04-25T09:13:08.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 client.9666 shutdown 2024-04-25T09:13:08.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 -- 172.21.15.173:0/3694841262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb3450a0 msgr2=0x55ddcb376e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 --2- 172.21.15.173:0/3694841262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb3450a0 0x55ddcb376e80 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0096c0 tx=0x7fdebc01abc0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 -- 172.21.15.173:0/3694841262 shutdown_connections 2024-04-25T09:13:08.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 --2- 172.21.15.173:0/3694841262 >> [v2:172.21.15.173:6836/3627798672,v1:172.21.15.173:6837/3627798672] conn(0x55ddcb3f2e70 0x55ddcb3f3280 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 --2- 172.21.15.173:0/3694841262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ddcb38f2f0 0x55ddcb3a6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 --2- 172.21.15.173:0/3694841262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ddcb38e9d0 0x55ddcb3a6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fdeaea00640 0 client.9666 ms_handle_reset on v2:172.21.15.173:6836/3627798672 2024-04-25T09:13:08.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 --2- 172.21.15.173:0/3694841262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ddcb3450a0 0x55ddcb376e80 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 -- 172.21.15.173:0/3694841262 >> 172.21.15.173:0/3694841262 conn(0x55ddcb341020 msgr2=0x55ddcb371d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 -- 172.21.15.173:0/3694841262 shutdown_connections 2024-04-25T09:13:08.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 1 -- 172.21.15.173:0/3694841262 wait complete. 2024-04-25T09:13:08.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.489+0000 7fded3ae9000 20 client.9666 trim_cache size 0 max 16384 2024-04-25T09:13:08.482 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:13:08.483 INFO:teuthology.orchestra.run.smithi173.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-04-25T09:13:08.483 INFO:teuthology.orchestra.run.smithi173.stdout: "scrubs": { 2024-04-25T09:13:08.483 INFO:teuthology.orchestra.run.smithi173.stdout: "d8034378-2d2a-44f7-9815-538131c5e84f": { 2024-04-25T09:13:08.483 INFO:teuthology.orchestra.run.smithi173.stdout: "path": "/scrub_control_test_path", 2024-04-25T09:13:08.483 INFO:teuthology.orchestra.run.smithi173.stdout: "tag": "d8034378-2d2a-44f7-9815-538131c5e84f", 2024-04-25T09:13:08.483 INFO:teuthology.orchestra.run.smithi173.stdout: "options": "recursive" 2024-04-25T09:13:08.483 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:08.483 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:08.483 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:13:08.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.493+0000 7fded0600640 1 -- 172.21.15.173:0/2449996243 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdea8066f60 msgr2=0x7fdea8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.493+0000 7fded0600640 1 --2- 172.21.15.173:0/2449996243 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdea8066f60 0x7fdea8069420 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0ad000 tx=0x7fdebc008040 comp rx=0 tx=0).stop 2024-04-25T09:13:08.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.493+0000 7fded0600640 1 -- 172.21.15.173:0/2449996243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdec80cc260 msgr2=0x7fdec8136a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.493+0000 7fded0600640 1 --2- 172.21.15.173:0/2449996243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdec80cc260 0x7fdec8136a80 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400c3c0 tx=0x7fdeb400c880 comp rx=0 tx=0).stop 2024-04-25T09:13:08.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.493+0000 7fded0600640 1 -- 172.21.15.173:0/2449996243 shutdown_connections 2024-04-25T09:13:08.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.493+0000 7fded0600640 1 --2- 172.21.15.173:0/2449996243 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdea8066f60 0x7fdea8069420 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.493+0000 7fded0600640 1 --2- 172.21.15.173:0/2449996243 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdec8145290 0x7fdec813bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.493+0000 7fded0600640 1 --2- 172.21.15.173:0/2449996243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdec80cc260 0x7fdec8136a80 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.493+0000 7fded0600640 1 --2- 172.21.15.173:0/2449996243 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdec80b3fe0 0x7fdec81f8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.493+0000 7fded0600640 1 -- 172.21.15.173:0/2449996243 >> 172.21.15.173:0/2449996243 conn(0x7fdec806ac90 msgr2=0x7fdec815d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.493+0000 7fded0600640 1 -- 172.21.15.173:0/2449996243 shutdown_connections 2024-04-25T09:13:08.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.493+0000 7fded0600640 1 -- 172.21.15.173:0/2449996243 wait complete. 2024-04-25T09:13:08.495 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.645+0000 7f0c5d800640 1 Processor -- start 2024-04-25T09:13:08.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.645+0000 7f0c5d800640 1 -- start start 2024-04-25T09:13:08.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.645+0000 7f0c5d800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0c58160fe0 0x7f0c58161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.645+0000 7f0c5d800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0c5806bca0 0x7f0c5806c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.645+0000 7f0c5d800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c58061d60 con 0x7f0c5806dac0 2024-04-25T09:13:08.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.645+0000 7f0c5d800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c580ad510 con 0x7f0c58160fe0 2024-04-25T09:13:08.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.645+0000 7f0c5d800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c581613c0 con 0x7f0c5806bca0 2024-04-25T09:13:08.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.645+0000 7f0c56a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0c58160fe0 0x7f0c58161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.645+0000 7f0c56a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0c58160fe0 0x7f0c58161fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35096/0 (socket says 172.21.15.173:35096) 2024-04-25T09:13:08.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.645+0000 7f0c56a00640 1 -- 172.21.15.173:0/1885884331 learned_addr learned my addr 172.21.15.173:0/1885884331 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:08.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.645+0000 7f0c56a00640 1 -- 172.21.15.173:0/1885884331 >> v2:172.21.15.194:3300/0 conn(0x7f0c5806bca0 msgr2=0x7f0c5806c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.645+0000 7f0c57400640 1 --2- 172.21.15.173:0/1885884331 >> v2:172.21.15.194:3300/0 conn(0x7f0c5806bca0 0x7f0c5806c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.645+0000 7f0c56a00640 1 --2- 172.21.15.173:0/1885884331 >> v2:172.21.15.194:3300/0 conn(0x7f0c5806bca0 0x7f0c5806c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.645+0000 7f0c56a00640 1 -- 172.21.15.173:0/1885884331 >> v1:172.21.15.194:6789/0 conn(0x7f0c5806dac0 legacy=0x7f0c580ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.645+0000 7f0c56a00640 1 -- 172.21.15.173:0/1885884331 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5806dfa0 con 0x7f0c58160fe0 2024-04-25T09:13:08.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.645+0000 7f0c57400640 1 --2- 172.21.15.173:0/1885884331 >> v2:172.21.15.194:3300/0 conn(0x7f0c5806bca0 0x7f0c5806c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:08.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.649+0000 7f0c56a00640 1 --2- 172.21.15.173:0/1885884331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c58160fe0 0x7f0c58161fb0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f0c58062040 tx=0x7f0c4801c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8e60bd92aab65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.649+0000 7f0c55600640 1 -- 172.21.15.173:0/1885884331 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c480b0070 con 0x7f0c58160fe0 2024-04-25T09:13:08.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.649+0000 7f0c55600640 1 -- 172.21.15.173:0/1885884331 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c480ab600 con 0x7f0c58160fe0 2024-04-25T09:13:08.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.649+0000 7f0c55600640 1 -- 172.21.15.173:0/1885884331 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c480ab9d0 con 0x7f0c58160fe0 2024-04-25T09:13:08.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.649+0000 7f0c5d800640 1 -- 172.21.15.173:0/1885884331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c58160fe0 msgr2=0x7f0c58161fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.649+0000 7f0c5d800640 1 --2- 172.21.15.173:0/1885884331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c58160fe0 0x7f0c58161fb0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f0c58062040 tx=0x7f0c4801c270 comp rx=0 tx=0).stop 2024-04-25T09:13:08.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.649+0000 7f0c5d800640 1 -- 172.21.15.173:0/1885884331 shutdown_connections 2024-04-25T09:13:08.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.649+0000 7f0c5d800640 1 --2- 172.21.15.173:0/1885884331 >> v2:172.21.15.194:3300/0 conn(0x7f0c5806bca0 0x7f0c5806c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.649+0000 7f0c5d800640 1 --2- 172.21.15.173:0/1885884331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c58160fe0 0x7f0c58161fb0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.649+0000 7f0c5d800640 1 -- 172.21.15.173:0/1885884331 >> 172.21.15.173:0/1885884331 conn(0x7f0c58071c20 msgr2=0x7f0c58072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.649+0000 7f0c5d800640 1 -- 172.21.15.173:0/1885884331 shutdown_connections 2024-04-25T09:13:08.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.649+0000 7f0c5d800640 1 -- 172.21.15.173:0/1885884331 wait complete. 2024-04-25T09:13:08.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c5d800640 1 Processor -- start 2024-04-25T09:13:08.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c5d800640 1 -- start start 2024-04-25T09:13:08.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c5d800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c5806bca0 0x7f0c5814a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c5d800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c5806dac0 0x7f0c58156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c5d800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c58160fe0 0x7f0c5814e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c5d800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c581624f0 con 0x7f0c5806dac0 2024-04-25T09:13:08.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c5d800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5806eb20 con 0x7f0c58160fe0 2024-04-25T09:13:08.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c5d800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5806f850 con 0x7f0c5806bca0 2024-04-25T09:13:08.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c56000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c5806dac0 0x7f0c58156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c56000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c5806dac0 0x7f0c58156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35104/0 (socket says 172.21.15.173:35104) 2024-04-25T09:13:08.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c56000640 1 -- 172.21.15.173:0/3848751057 learned_addr learned my addr 172.21.15.173:0/3848751057 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:08.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c56a00640 1 --2- 172.21.15.173:0/3848751057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c5806bca0 0x7f0c5814a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c57400640 1 --2- 172.21.15.173:0/3848751057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c58160fe0 0x7f0c5814e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c56000640 1 -- 172.21.15.173:0/3848751057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c5806bca0 msgr2=0x7f0c5814a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c56000640 1 --2- 172.21.15.173:0/3848751057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c5806bca0 0x7f0c5814a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c56000640 1 -- 172.21.15.173:0/3848751057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c58160fe0 msgr2=0x7f0c5814e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c56000640 1 --2- 172.21.15.173:0/3848751057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c58160fe0 0x7f0c5814e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c56000640 1 -- 172.21.15.173:0/3848751057 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c581555e0 con 0x7f0c5806dac0 2024-04-25T09:13:08.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c56000640 1 --2- 172.21.15.173:0/3848751057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c5806dac0 0x7f0c58156960 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400c450 tx=0x7f0c4400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c4ea00640 1 -- 172.21.15.173:0/3848751057 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44012830 con 0x7f0c5806dac0 2024-04-25T09:13:08.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c4ea00640 1 -- 172.21.15.173:0/3848751057 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c44017070 con 0x7f0c5806dac0 2024-04-25T09:13:08.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c5d800640 1 -- 172.21.15.173:0/3848751057 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c581558c0 con 0x7f0c5806dac0 2024-04-25T09:13:08.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c4ea00640 1 -- 172.21.15.173:0/3848751057 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44012c30 con 0x7f0c5806dac0 2024-04-25T09:13:08.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c5d800640 1 -- 172.21.15.173:0/3848751057 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c58155e80 con 0x7f0c5806dac0 2024-04-25T09:13:08.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.653+0000 7f0c5d800640 1 -- 172.21.15.173:0/3848751057 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c58073a40 con 0x7f0c5806dac0 2024-04-25T09:13:08.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.657+0000 7f0c4ea00640 1 -- 172.21.15.173:0/3848751057 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0c4401c460 con 0x7f0c5806dac0 2024-04-25T09:13:08.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.657+0000 7f0c4ea00640 1 --2- 172.21.15.173:0/3848751057 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0c38066f90 0x7f0c38069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.657+0000 7f0c4ea00640 1 -- 172.21.15.173:0/3848751057 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0c44084dc0 con 0x7f0c5806dac0 2024-04-25T09:13:08.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.657+0000 7f0c56a00640 1 --2- 172.21.15.173:0/3848751057 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0c38066f90 0x7f0c38069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.657+0000 7f0c56a00640 1 --2- 172.21.15.173:0/3848751057 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0c38066f90 0x7f0c38069450 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0c480ad000 tx=0x7f0c48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.661+0000 7f0c4ea00640 1 -- 172.21.15.173:0/3848751057 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0c440555e0 con 0x7f0c5806dac0 2024-04-25T09:13:08.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.849+0000 7f0c5d800640 1 -- 172.21.15.173:0/3848751057 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c580cf6c0 con 0x7f0c5806dac0 2024-04-25T09:13:08.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.853+0000 7f0c4ea00640 1 -- 172.21.15.173:0/3848751057 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f0c44059680 con 0x7f0c5806dac0 2024-04-25T09:13:08.837 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:08.837 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":89,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":9408,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1841246276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1841246276},{"type":"v1","addr":"172.21.15.173:6835","nonce":1841246276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:34.472510+0000","modified":"2024-04-25T09:12:37.491581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9411":{"gid":9411,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3627798672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3627798672},{"type":"v1","addr":"172.21.15.173:6837","nonce":3627798672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:13:08.837 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 89 2024-04-25T09:13:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.853+0000 7f0c5d800640 1 -- 172.21.15.173:0/3848751057 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0c38066f90 msgr2=0x7f0c38069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.853+0000 7f0c5d800640 1 --2- 172.21.15.173:0/3848751057 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0c38066f90 0x7f0c38069450 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0c480ad000 tx=0x7f0c48008040 comp rx=0 tx=0).stop 2024-04-25T09:13:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.853+0000 7f0c5d800640 1 -- 172.21.15.173:0/3848751057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c5806dac0 msgr2=0x7f0c58156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.853+0000 7f0c5d800640 1 --2- 172.21.15.173:0/3848751057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c5806dac0 0x7f0c58156960 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400c450 tx=0x7f0c4400c910 comp rx=0 tx=0).stop 2024-04-25T09:13:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.853+0000 7f0c5d800640 1 -- 172.21.15.173:0/3848751057 shutdown_connections 2024-04-25T09:13:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.853+0000 7f0c5d800640 1 --2- 172.21.15.173:0/3848751057 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0c38066f90 0x7f0c38069450 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.853+0000 7f0c5d800640 1 --2- 172.21.15.173:0/3848751057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c58160fe0 0x7f0c5814e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.853+0000 7f0c5d800640 1 --2- 172.21.15.173:0/3848751057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c5806dac0 0x7f0c58156960 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.853+0000 7f0c5d800640 1 --2- 172.21.15.173:0/3848751057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c5806bca0 0x7f0c5814a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.853+0000 7f0c5d800640 1 -- 172.21.15.173:0/3848751057 >> 172.21.15.173:0/3848751057 conn(0x7f0c58071c20 msgr2=0x7f0c580aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.853+0000 7f0c5d800640 1 -- 172.21.15.173:0/3848751057 shutdown_connections 2024-04-25T09:13:08.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:08.853+0000 7f0c5d800640 1 -- 172.21.15.173:0/3848751057 wait complete. 2024-04-25T09:13:08.856 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-04-25T09:13:08.857 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:13:08.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.009+0000 7fa6c5e00640 1 Processor -- start 2024-04-25T09:13:08.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.009+0000 7fa6c5e00640 1 -- start start 2024-04-25T09:13:08.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.009+0000 7fa6c5e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6c015bbb0 0x7fa6c00cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.009+0000 7fa6c5e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa6c00cf9c0 0x7fa6c00cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.009+0000 7fa6c5e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa6c00cc900 0x7fa6c0099b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:08.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.009+0000 7fa6c5e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c00d0180 con 0x7fa6c00cf9c0 2024-04-25T09:13:08.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.009+0000 7fa6c5e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c00d0460 con 0x7fa6c00cc900 2024-04-25T09:13:08.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.009+0000 7fa6c5e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c00c5530 con 0x7fa6c015bbb0 2024-04-25T09:13:08.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.009+0000 7fa6b6000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa6c00cf9c0 0x7fa6c00cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.009+0000 7fa6b6000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa6c00cf9c0 0x7fa6c00cc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35116/0 (socket says 172.21.15.173:35116) 2024-04-25T09:13:08.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.009+0000 7fa6b6000640 1 -- 172.21.15.173:0/1067646910 learned_addr learned my addr 172.21.15.173:0/1067646910 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:08.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.009+0000 7fa6bea00640 1 --2- 172.21.15.173:0/1067646910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6c015bbb0 0x7fa6c00cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.009+0000 7fa6bf400640 1 --2- 172.21.15.173:0/1067646910 >> v2:172.21.15.194:3300/0 conn(0x7fa6c00cc900 0x7fa6c0099b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:08.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.009+0000 7fa6b6000640 1 -- 172.21.15.173:0/1067646910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6c015bbb0 msgr2=0x7fa6c00cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.009+0000 7fa6b6000640 1 --2- 172.21.15.173:0/1067646910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6c015bbb0 0x7fa6c00cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.009+0000 7fa6b6000640 1 -- 172.21.15.173:0/1067646910 >> v2:172.21.15.194:3300/0 conn(0x7fa6c00cc900 msgr2=0x7fa6c0099b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:08.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.009+0000 7fa6b6000640 1 --2- 172.21.15.173:0/1067646910 >> v2:172.21.15.194:3300/0 conn(0x7fa6c00cc900 0x7fa6c0099b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.009+0000 7fa6b6000640 1 -- 172.21.15.173:0/1067646910 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c00c5810 con 0x7fa6c00cf9c0 2024-04-25T09:13:08.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.013+0000 7fa6b6000640 1 --2- 172.21.15.173:0/1067646910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6c00cf9c0 0x7fa6c00cc3c0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00b7930 tx=0x7fa6a801c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426f9625ce17e215 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:08.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.013+0000 7fa6be000640 1 -- 172.21.15.173:0/1067646910 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80b0070 con 0x7fa6c00cf9c0 2024-04-25T09:13:08.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.013+0000 7fa6be000640 1 -- 172.21.15.173:0/1067646910 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a80ab600 con 0x7fa6c00cf9c0 2024-04-25T09:13:08.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.013+0000 7fa6be000640 1 -- 172.21.15.173:0/1067646910 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80ab9d0 con 0x7fa6c00cf9c0 2024-04-25T09:13:08.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.013+0000 7fa6c5e00640 1 -- 172.21.15.173:0/1067646910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6c00cf9c0 msgr2=0x7fa6c00cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:08.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.013+0000 7fa6c5e00640 1 --2- 172.21.15.173:0/1067646910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6c00cf9c0 0x7fa6c00cc3c0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00b7930 tx=0x7fa6a801c1a0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.013+0000 7fa6c5e00640 1 -- 172.21.15.173:0/1067646910 shutdown_connections 2024-04-25T09:13:08.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.013+0000 7fa6c5e00640 1 --2- 172.21.15.173:0/1067646910 >> v2:172.21.15.194:3300/0 conn(0x7fa6c00cc900 0x7fa6c0099b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.013+0000 7fa6c5e00640 1 --2- 172.21.15.173:0/1067646910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6c00cf9c0 0x7fa6c00cc3c0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.013+0000 7fa6c5e00640 1 --2- 172.21.15.173:0/1067646910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6c015bbb0 0x7fa6c00cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:08.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.013+0000 7fa6c5e00640 1 -- 172.21.15.173:0/1067646910 >> 172.21.15.173:0/1067646910 conn(0x7fa6c00b33a0 msgr2=0x7fa6c00b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:08.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.013+0000 7fa6c5e00640 1 -- 172.21.15.173:0/1067646910 shutdown_connections 2024-04-25T09:13:08.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.013+0000 7fa6c5e00640 1 -- 172.21.15.173:0/1067646910 wait complete. 2024-04-25T09:13:09.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6c5e00640 1 Processor -- start 2024-04-25T09:13:09.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6c5e00640 1 -- start start 2024-04-25T09:13:09.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6c5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6c00cc900 0x7fa6c01516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6c5e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6c00cf9c0 0x7fa6c006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6c5e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6c015bbb0 0x7fa6c0155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6c5e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c00c5d30 con 0x7fa6c00cc900 2024-04-25T09:13:09.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6c5e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c00d0740 con 0x7fa6c00cf9c0 2024-04-25T09:13:09.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6c5e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c00c5eb0 con 0x7fa6c015bbb0 2024-04-25T09:13:09.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6bea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6c00cc900 0x7fa6c01516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6bea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6c00cc900 0x7fa6c01516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35130/0 (socket says 172.21.15.173:35130) 2024-04-25T09:13:09.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6bea00640 1 -- 172.21.15.173:0/1905783740 learned_addr learned my addr 172.21.15.173:0/1905783740 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:09.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6b6000640 1 --2- 172.21.15.173:0/1905783740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6c00cf9c0 0x7fa6c006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6bf400640 1 --2- 172.21.15.173:0/1905783740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6c015bbb0 0x7fa6c0155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6b6000640 1 -- 172.21.15.173:0/1905783740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6c015bbb0 msgr2=0x7fa6c0155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6b6000640 1 --2- 172.21.15.173:0/1905783740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6c015bbb0 0x7fa6c0155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6b6000640 1 -- 172.21.15.173:0/1905783740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6c00cc900 msgr2=0x7fa6c01516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6b6000640 1 --2- 172.21.15.173:0/1905783740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6c00cc900 0x7fa6c01516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6b6000640 1 -- 172.21.15.173:0/1905783740 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c0156ee0 con 0x7fa6c00cf9c0 2024-04-25T09:13:09.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6bea00640 1 --2- 172.21.15.173:0/1905783740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6c00cc900 0x7fa6c01516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:09.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6b6000640 1 --2- 172.21.15.173:0/1905783740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6c00cf9c0 0x7fa6c006c4a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80ab000 tx=0x7fa6a801a9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6b7e00640 1 -- 172.21.15.173:0/1905783740 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80ba020 con 0x7fa6c00cf9c0 2024-04-25T09:13:09.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6b7e00640 1 -- 172.21.15.173:0/1905783740 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a80b6420 con 0x7fa6c00cf9c0 2024-04-25T09:13:09.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6c5e00640 1 -- 172.21.15.173:0/1905783740 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c01571c0 con 0x7fa6c00cf9c0 2024-04-25T09:13:09.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6b7e00640 1 -- 172.21.15.173:0/1905783740 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80b0040 con 0x7fa6c00cf9c0 2024-04-25T09:13:09.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6c5e00640 1 -- 172.21.15.173:0/1905783740 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c0151c00 con 0x7fa6c00cf9c0 2024-04-25T09:13:09.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.017+0000 7fa6c5e00640 1 -- 172.21.15.173:0/1905783740 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c006bda0 con 0x7fa6c00cf9c0 2024-04-25T09:13:09.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.021+0000 7fa6b7e00640 1 -- 172.21.15.173:0/1905783740 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa6a80bd020 con 0x7fa6c00cf9c0 2024-04-25T09:13:09.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.021+0000 7fa6b7e00640 1 --2- 172.21.15.173:0/1905783740 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa69c066f90 0x7fa69c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.021+0000 7fa6b7e00640 1 -- 172.21.15.173:0/1905783740 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa6a811f210 con 0x7fa6c00cf9c0 2024-04-25T09:13:09.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.021+0000 7fa6bea00640 1 --2- 172.21.15.173:0/1905783740 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa69c066f90 0x7fa69c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.021+0000 7fa6bea00640 1 --2- 172.21.15.173:0/1905783740 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa69c066f90 0x7fa69c069450 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0009ef0 tx=0x7fa6b0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.025+0000 7fa6b7e00640 1 -- 172.21.15.173:0/1905783740 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa6c006bda0 con 0x7fa6c00cf9c0 2024-04-25T09:13:09.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.229+0000 7fa6c5e00640 1 -- 172.21.15.173:0/1905783740 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa6c0073a40 con 0x7fa6c00cf9c0 2024-04-25T09:13:09.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.229+0000 7fa6b7e00640 1 -- 172.21.15.173:0/1905783740 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1186 (secure 0 0 0) 0x7fa6a80c4030 con 0x7fa6c00cf9c0 2024-04-25T09:13:09.216 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:09.216 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":643,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":133,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":874,"data_bytes":893931744,"bytes_used":2186592256,"bytes_avail":770907521024,"bytes_total":773094113280,"write_bytes_sec":46886770,"read_op_per_sec":0,"write_op_per_sec":47},"fsmap":{"epoch":89,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":9411}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2024-04-25T09:12:24.854436+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:13:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.233+0000 7fa6c5e00640 1 -- 172.21.15.173:0/1905783740 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa69c066f90 msgr2=0x7fa69c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.233+0000 7fa6c5e00640 1 --2- 172.21.15.173:0/1905783740 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa69c066f90 0x7fa69c069450 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0009ef0 tx=0x7fa6b0009190 comp rx=0 tx=0).stop 2024-04-25T09:13:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.233+0000 7fa6c5e00640 1 -- 172.21.15.173:0/1905783740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6c00cf9c0 msgr2=0x7fa6c006c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.233+0000 7fa6c5e00640 1 --2- 172.21.15.173:0/1905783740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6c00cf9c0 0x7fa6c006c4a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80ab000 tx=0x7fa6a801a9e0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.233+0000 7fa6c5e00640 1 -- 172.21.15.173:0/1905783740 shutdown_connections 2024-04-25T09:13:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.233+0000 7fa6c5e00640 1 --2- 172.21.15.173:0/1905783740 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa69c066f90 0x7fa69c069450 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.233+0000 7fa6c5e00640 1 --2- 172.21.15.173:0/1905783740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6c015bbb0 0x7fa6c0155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.233+0000 7fa6c5e00640 1 --2- 172.21.15.173:0/1905783740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6c00cf9c0 0x7fa6c006c4a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.233+0000 7fa6c5e00640 1 --2- 172.21.15.173:0/1905783740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6c00cc900 0x7fa6c01516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.233+0000 7fa6c5e00640 1 -- 172.21.15.173:0/1905783740 >> 172.21.15.173:0/1905783740 conn(0x7fa6c00b33a0 msgr2=0x7fa6c00ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.233+0000 7fa6c5e00640 1 -- 172.21.15.173:0/1905783740 shutdown_connections 2024-04-25T09:13:09.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:09.233+0000 7fa6c5e00640 1 -- 172.21.15.173:0/1905783740 wait complete. 2024-04-25T09:13:09.237 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:13:10.238 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:10.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.393+0000 7fec37200640 1 Processor -- start 2024-04-25T09:13:10.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.393+0000 7fec37200640 1 -- start start 2024-04-25T09:13:10.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.397+0000 7fec37200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fec30145250 0x7fec3015c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.397+0000 7fec37200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec300cc8b0 0x7fec300ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.397+0000 7fec37200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fec30071320 0x7fec30071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.397+0000 7fec37200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec3015cec0 con 0x7fec30145250 2024-04-25T09:13:10.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.397+0000 7fec37200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec3006e7c0 con 0x7fec30071320 2024-04-25T09:13:10.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.397+0000 7fec37200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3006d720 con 0x7fec300cc8b0 2024-04-25T09:13:10.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.397+0000 7fec2fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fec30145250 0x7fec3015c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.397+0000 7fec2fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fec30145250 0x7fec3015c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35136/0 (socket says 172.21.15.173:35136) 2024-04-25T09:13:10.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.397+0000 7fec2fe00640 1 -- 172.21.15.173:0/3590661111 learned_addr learned my addr 172.21.15.173:0/3590661111 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:10.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.397+0000 7fec35200640 1 --2- 172.21.15.173:0/3590661111 >> v2:172.21.15.194:3300/0 conn(0x7fec30071320 0x7fec30071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.397+0000 7fec2f400640 1 --2- 172.21.15.173:0/3590661111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec300cc8b0 0x7fec300ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.397+0000 7fec2fe00640 1 -- 172.21.15.173:0/3590661111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec300cc8b0 msgr2=0x7fec300ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:10.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.397+0000 7fec2fe00640 1 --2- 172.21.15.173:0/3590661111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec300cc8b0 0x7fec300ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.397+0000 7fec2fe00640 1 -- 172.21.15.173:0/3590661111 >> v2:172.21.15.194:3300/0 conn(0x7fec30071320 msgr2=0x7fec30071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:10.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.397+0000 7fec2fe00640 1 --2- 172.21.15.173:0/3590661111 >> v2:172.21.15.194:3300/0 conn(0x7fec30071320 0x7fec30071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.397+0000 7fec2fe00640 1 -- 172.21.15.173:0/3590661111 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3006da00 con 0x7fec30145250 2024-04-25T09:13:10.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.397+0000 7fec35200640 1 --2- 172.21.15.173:0/3590661111 >> v2:172.21.15.194:3300/0 conn(0x7fec30071320 0x7fec30071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:10.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.397+0000 7fec2fe00640 1 --2- 172.21.15.173:0/3590661111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec30145250 0x7fec3015c980 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fec300710e0 tx=0x7fec2001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e854c9d68da4a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:10.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec2ea00640 1 -- 172.21.15.173:0/3590661111 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec200a5760 con 0x7fec30145250 2024-04-25T09:13:10.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec2ea00640 1 -- 172.21.15.173:0/3590661111 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec200a5900 con 0x7fec30145250 2024-04-25T09:13:10.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec2ea00640 1 -- 172.21.15.173:0/3590661111 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec200a5cd0 con 0x7fec30145250 2024-04-25T09:13:10.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec37200640 1 -- 172.21.15.173:0/3590661111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec30145250 msgr2=0x7fec3015c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec37200640 1 --2- 172.21.15.173:0/3590661111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec30145250 0x7fec3015c980 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fec300710e0 tx=0x7fec2001c9f0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec37200640 1 -- 172.21.15.173:0/3590661111 shutdown_connections 2024-04-25T09:13:10.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec37200640 1 --2- 172.21.15.173:0/3590661111 >> v2:172.21.15.194:3300/0 conn(0x7fec30071320 0x7fec30071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec37200640 1 --2- 172.21.15.173:0/3590661111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec300cc8b0 0x7fec300ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec37200640 1 --2- 172.21.15.173:0/3590661111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec30145250 0x7fec3015c980 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec37200640 1 -- 172.21.15.173:0/3590661111 >> 172.21.15.173:0/3590661111 conn(0x7fec3006ac90 msgr2=0x7fec3006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:10.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec37200640 1 -- 172.21.15.173:0/3590661111 shutdown_connections 2024-04-25T09:13:10.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec37200640 1 -- 172.21.15.173:0/3590661111 wait complete. 2024-04-25T09:13:10.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec37200640 1 Processor -- start 2024-04-25T09:13:10.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec37200640 1 -- start start 2024-04-25T09:13:10.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec37200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec30071320 0x7fec301f6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec37200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec300cc8b0 0x7fec300ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec37200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec30145250 0x7fec3015e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec37200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec300720e0 con 0x7fec30145250 2024-04-25T09:13:10.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec37200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec30145630 con 0x7fec300cc8b0 2024-04-25T09:13:10.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec37200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3006ef80 con 0x7fec30071320 2024-04-25T09:13:10.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.401+0000 7fec35200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec30145250 0x7fec3015e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.405+0000 7fec35200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec30145250 0x7fec3015e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35146/0 (socket says 172.21.15.173:35146) 2024-04-25T09:13:10.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.405+0000 7fec35200640 1 -- 172.21.15.173:0/2489191946 learned_addr learned my addr 172.21.15.173:0/2489191946 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:10.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.405+0000 7fec2fe00640 1 --2- 172.21.15.173:0/2489191946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec30071320 0x7fec301f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.405+0000 7fec2f400640 1 --2- 172.21.15.173:0/2489191946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec300cc8b0 0x7fec300ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.405+0000 7fec35200640 1 -- 172.21.15.173:0/2489191946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec30071320 msgr2=0x7fec301f6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.405+0000 7fec35200640 1 --2- 172.21.15.173:0/2489191946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec30071320 0x7fec301f6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.405+0000 7fec35200640 1 -- 172.21.15.173:0/2489191946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec300cc8b0 msgr2=0x7fec300ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.405+0000 7fec35200640 1 --2- 172.21.15.173:0/2489191946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec300cc8b0 0x7fec300ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.405+0000 7fec35200640 1 -- 172.21.15.173:0/2489191946 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec300b3de0 con 0x7fec30145250 2024-04-25T09:13:10.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.405+0000 7fec35200640 1 --2- 172.21.15.173:0/2489191946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec30145250 0x7fec3015e4b0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fec2800d5d0 tx=0x7fec2800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:10.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.405+0000 7fec27e00640 1 -- 172.21.15.173:0/2489191946 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28004030 con 0x7fec30145250 2024-04-25T09:13:10.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.405+0000 7fec27e00640 1 -- 172.21.15.173:0/2489191946 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec280041d0 con 0x7fec30145250 2024-04-25T09:13:10.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.405+0000 7fec27e00640 1 -- 172.21.15.173:0/2489191946 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28003620 con 0x7fec30145250 2024-04-25T09:13:10.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.405+0000 7fec37200640 1 -- 172.21.15.173:0/2489191946 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec300b40c0 con 0x7fec30145250 2024-04-25T09:13:10.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.405+0000 7fec37200640 1 -- 172.21.15.173:0/2489191946 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec300b4680 con 0x7fec30145250 2024-04-25T09:13:10.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.405+0000 7fec37200640 1 -- 172.21.15.173:0/2489191946 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec30073a40 con 0x7fec30145250 2024-04-25T09:13:10.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.405+0000 7fec27e00640 1 -- 172.21.15.173:0/2489191946 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fec280037c0 con 0x7fec30145250 2024-04-25T09:13:10.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.409+0000 7fec27e00640 1 --2- 172.21.15.173:0/2489191946 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fec10066f60 0x7fec10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.409+0000 7fec27e00640 1 -- 172.21.15.173:0/2489191946 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fec28085780 con 0x7fec30145250 2024-04-25T09:13:10.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.409+0000 7fec2fe00640 1 --2- 172.21.15.173:0/2489191946 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fec10066f60 0x7fec10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.409+0000 7fec2fe00640 1 --2- 172.21.15.173:0/2489191946 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fec10066f60 0x7fec10069420 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fec200ae000 tx=0x7fec200a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:10.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.413+0000 7fec27e00640 1 -- 172.21.15.173:0/2489191946 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fec28055fa0 con 0x7fec30145250 2024-04-25T09:13:10.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.601+0000 7fec37200640 1 -- 172.21.15.173:0/2489191946 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec300d0160 con 0x7fec30145250 2024-04-25T09:13:10.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.601+0000 7fec27e00640 1 -- 172.21.15.173:0/2489191946 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4952 (secure 0 0 0) 0x7fec2805a040 con 0x7fec30145250 2024-04-25T09:13:10.585 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:10.585 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":89,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":9408,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1841246276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1841246276},{"type":"v1","addr":"172.21.15.173:6835","nonce":1841246276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:34.472510+0000","modified":"2024-04-25T09:12:37.491581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9411":{"gid":9411,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3627798672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3627798672},{"type":"v1","addr":"172.21.15.173:6837","nonce":3627798672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:13:10.586 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 89 2024-04-25T09:13:10.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.601+0000 7fec37200640 1 -- 172.21.15.173:0/2489191946 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fec10066f60 msgr2=0x7fec10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.601+0000 7fec37200640 1 --2- 172.21.15.173:0/2489191946 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fec10066f60 0x7fec10069420 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fec200ae000 tx=0x7fec200a7070 comp rx=0 tx=0).stop 2024-04-25T09:13:10.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.601+0000 7fec37200640 1 -- 172.21.15.173:0/2489191946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec30145250 msgr2=0x7fec3015e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.601+0000 7fec37200640 1 --2- 172.21.15.173:0/2489191946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec30145250 0x7fec3015e4b0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fec2800d5d0 tx=0x7fec2800da90 comp rx=0 tx=0).stop 2024-04-25T09:13:10.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.601+0000 7fec37200640 1 -- 172.21.15.173:0/2489191946 shutdown_connections 2024-04-25T09:13:10.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.601+0000 7fec37200640 1 --2- 172.21.15.173:0/2489191946 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fec10066f60 0x7fec10069420 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.601+0000 7fec37200640 1 --2- 172.21.15.173:0/2489191946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec30145250 0x7fec3015e4b0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.601+0000 7fec37200640 1 --2- 172.21.15.173:0/2489191946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec300cc8b0 0x7fec300ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.601+0000 7fec37200640 1 --2- 172.21.15.173:0/2489191946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec30071320 0x7fec301f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.601+0000 7fec37200640 1 -- 172.21.15.173:0/2489191946 >> 172.21.15.173:0/2489191946 conn(0x7fec3006ac90 msgr2=0x7fec3006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:10.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.601+0000 7fec37200640 1 -- 172.21.15.173:0/2489191946 shutdown_connections 2024-04-25T09:13:10.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.601+0000 7fec37200640 1 -- 172.21.15.173:0/2489191946 wait complete. 2024-04-25T09:13:10.606 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-04-25T09:13:10.606 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:13:10.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.753+0000 7fe019a00640 1 Processor -- start 2024-04-25T09:13:10.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.753+0000 7fe019a00640 1 -- start start 2024-04-25T09:13:10.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.757+0000 7fe019a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe01415cc70 0x7fe014160060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.757+0000 7fe019a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe0140cbde0 0x7fe0140cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.757+0000 7fe019a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0140cc730 con 0x7fe0140ce050 2024-04-25T09:13:10.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.757+0000 7fe019a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01415fbd0 con 0x7fe0140cbde0 2024-04-25T09:13:10.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.757+0000 7fe019a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01415f580 con 0x7fe01415cc70 2024-04-25T09:13:10.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.757+0000 7fe013400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe0140cbde0 0x7fe0140cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.757+0000 7fe012a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe0140ce050 0x7fe0140ce430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45786/0 (socket says 172.21.15.173:45786) 2024-04-25T09:13:10.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.757+0000 7fe012a00640 1 -- 172.21.15.173:0/3668570251 learned_addr learned my addr 172.21.15.173:0/3668570251 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:10.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.757+0000 7fe011600640 1 -- 172.21.15.173:0/3668570251 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120781722 0 0) 0x7fe0140cc730 con 0x7fe0140ce050 2024-04-25T09:13:10.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.757+0000 7fe013400640 1 -- 172.21.15.173:0/3668570251 >> v2:172.21.15.194:3300/0 conn(0x7fe01415cc70 msgr2=0x7fe014160060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:10.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.757+0000 7fe013400640 1 --2- 172.21.15.173:0/3668570251 >> v2:172.21.15.194:3300/0 conn(0x7fe01415cc70 0x7fe014160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.757+0000 7fe013400640 1 -- 172.21.15.173:0/3668570251 >> v1:172.21.15.173:6789/0 conn(0x7fe0140ce050 legacy=0x7fe0140ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.757+0000 7fe013400640 1 -- 172.21.15.173:0/3668570251 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01415f860 con 0x7fe0140cbde0 2024-04-25T09:13:10.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.761+0000 7fe013400640 1 --2- 172.21.15.173:0/3668570251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0140cbde0 0x7fe0140cf360 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fe0140d2890 tx=0x7fe00c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2449e7f6cf10d946 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:10.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.761+0000 7fe011600640 1 -- 172.21.15.173:0/3668570251 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0b2070 con 0x7fe0140cbde0 2024-04-25T09:13:10.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.761+0000 7fe011600640 1 -- 172.21.15.173:0/3668570251 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0140d00b0 con 0x7fe0140cbde0 2024-04-25T09:13:10.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.761+0000 7fe011600640 1 -- 172.21.15.173:0/3668570251 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0a5ba0 con 0x7fe0140cbde0 2024-04-25T09:13:10.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.761+0000 7fe019a00640 1 -- 172.21.15.173:0/3668570251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0140cbde0 msgr2=0x7fe0140cf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.761+0000 7fe019a00640 1 --2- 172.21.15.173:0/3668570251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0140cbde0 0x7fe0140cf360 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fe0140d2890 tx=0x7fe00c01c8a0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.761+0000 7fe019a00640 1 -- 172.21.15.173:0/3668570251 shutdown_connections 2024-04-25T09:13:10.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.761+0000 7fe019a00640 1 --2- 172.21.15.173:0/3668570251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0140cbde0 0x7fe0140cf360 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.761+0000 7fe019a00640 1 --2- 172.21.15.173:0/3668570251 >> v2:172.21.15.194:3300/0 conn(0x7fe01415cc70 0x7fe014160060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.761+0000 7fe019a00640 1 -- 172.21.15.173:0/3668570251 >> 172.21.15.173:0/3668570251 conn(0x7fe0140b3460 msgr2=0x7fe0140b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:10.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.761+0000 7fe019a00640 1 -- 172.21.15.173:0/3668570251 shutdown_connections 2024-04-25T09:13:10.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.761+0000 7fe019a00640 1 -- 172.21.15.173:0/3668570251 wait complete. 2024-04-25T09:13:10.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.761+0000 7fe019a00640 1 Processor -- start 2024-04-25T09:13:10.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.761+0000 7fe019a00640 1 -- start start 2024-04-25T09:13:10.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe019a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0140cbde0 0x7fe0140b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe019a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0140ce050 0x7fe01414d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe019a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01415cc70 0x7fe01413afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe019a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe014168c10 con 0x7fe01415cc70 2024-04-25T09:13:10.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe019a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe014168a90 con 0x7fe0140ce050 2024-04-25T09:13:10.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe019a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe014168d90 con 0x7fe0140cbde0 2024-04-25T09:13:10.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe013400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01415cc70 0x7fe01413afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe013400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01415cc70 0x7fe01413afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35156/0 (socket says 172.21.15.173:35156) 2024-04-25T09:13:10.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe013400640 1 -- 172.21.15.173:0/1983189142 learned_addr learned my addr 172.21.15.173:0/1983189142 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:10.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe012a00640 1 --2- 172.21.15.173:0/1983189142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0140cbde0 0x7fe0140b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe012000640 1 --2- 172.21.15.173:0/1983189142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0140ce050 0x7fe01414d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe013400640 1 -- 172.21.15.173:0/1983189142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0140cbde0 msgr2=0x7fe0140b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe013400640 1 --2- 172.21.15.173:0/1983189142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0140cbde0 0x7fe0140b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe013400640 1 -- 172.21.15.173:0/1983189142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0140ce050 msgr2=0x7fe01414d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe013400640 1 --2- 172.21.15.173:0/1983189142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0140ce050 0x7fe01414d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe013400640 1 -- 172.21.15.173:0/1983189142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe014144df0 con 0x7fe01415cc70 2024-04-25T09:13:10.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe012000640 1 --2- 172.21.15.173:0/1983189142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0140ce050 0x7fe01414d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:10.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe013400640 1 --2- 172.21.15.173:0/1983189142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01415cc70 0x7fe01413afe0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0b0040 tx=0x7fe00c019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:10.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe00aa00640 1 -- 172.21.15.173:0/1983189142 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0b2050 con 0x7fe01415cc70 2024-04-25T09:13:10.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe00aa00640 1 -- 172.21.15.173:0/1983189142 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c0be070 con 0x7fe01415cc70 2024-04-25T09:13:10.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe019a00640 1 -- 172.21.15.173:0/1983189142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01414e430 con 0x7fe01415cc70 2024-04-25T09:13:10.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe00aa00640 1 -- 172.21.15.173:0/1983189142 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0adad0 con 0x7fe01415cc70 2024-04-25T09:13:10.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe019a00640 1 -- 172.21.15.173:0/1983189142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01413f550 con 0x7fe01415cc70 2024-04-25T09:13:10.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe019a00640 1 -- 172.21.15.173:0/1983189142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe014073a40 con 0x7fe01415cc70 2024-04-25T09:13:10.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.765+0000 7fe00aa00640 1 -- 172.21.15.173:0/1983189142 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe00c0adc70 con 0x7fe01415cc70 2024-04-25T09:13:10.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.769+0000 7fe00aa00640 1 --2- 172.21.15.173:0/1983189142 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdff4066f90 0x7fdff4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.769+0000 7fe00aa00640 1 -- 172.21.15.173:0/1983189142 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe00c11fd70 con 0x7fe01415cc70 2024-04-25T09:13:10.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.769+0000 7fe012a00640 1 --2- 172.21.15.173:0/1983189142 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdff4066f90 0x7fdff4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.769+0000 7fe012a00640 1 --2- 172.21.15.173:0/1983189142 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdff4066f90 0x7fdff4069450 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe004007fd0 tx=0x7fe004007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:10.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.773+0000 7fe00aa00640 1 -- 172.21.15.173:0/1983189142 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe00c0c7020 con 0x7fe01415cc70 2024-04-25T09:13:10.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.981+0000 7fe019a00640 1 -- 172.21.15.173:0/1983189142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe0140cefc0 con 0x7fe01415cc70 2024-04-25T09:13:10.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.981+0000 7fe00aa00640 1 -- 172.21.15.173:0/1983189142 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1186 (secure 0 0 0) 0x7fe00c016520 con 0x7fe01415cc70 2024-04-25T09:13:10.966 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:10.966 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":645,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":133,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":907,"data_bytes":928534752,"bytes_used":2230632448,"bytes_avail":770863480832,"bytes_total":773094113280,"write_bytes_sec":47276196,"read_op_per_sec":0,"write_op_per_sec":47},"fsmap":{"epoch":89,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":9411}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2024-04-25T09:12:24.854436+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:13:10.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.981+0000 7fe019a00640 1 -- 172.21.15.173:0/1983189142 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdff4066f90 msgr2=0x7fdff4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.981+0000 7fe019a00640 1 --2- 172.21.15.173:0/1983189142 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdff4066f90 0x7fdff4069450 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe004007fd0 tx=0x7fe004007d60 comp rx=0 tx=0).stop 2024-04-25T09:13:10.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.981+0000 7fe019a00640 1 -- 172.21.15.173:0/1983189142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01415cc70 msgr2=0x7fe01413afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.981+0000 7fe019a00640 1 --2- 172.21.15.173:0/1983189142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01415cc70 0x7fe01413afe0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0b0040 tx=0x7fe00c019640 comp rx=0 tx=0).stop 2024-04-25T09:13:10.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.981+0000 7fe019a00640 1 -- 172.21.15.173:0/1983189142 shutdown_connections 2024-04-25T09:13:10.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.981+0000 7fe019a00640 1 --2- 172.21.15.173:0/1983189142 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdff4066f90 0x7fdff4069450 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.981+0000 7fe019a00640 1 --2- 172.21.15.173:0/1983189142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe01415cc70 0x7fe01413afe0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.981+0000 7fe019a00640 1 --2- 172.21.15.173:0/1983189142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0140ce050 0x7fe01414d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.985+0000 7fe019a00640 1 --2- 172.21.15.173:0/1983189142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0140cbde0 0x7fe0140b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.985+0000 7fe019a00640 1 -- 172.21.15.173:0/1983189142 >> 172.21.15.173:0/1983189142 conn(0x7fe0140b3460 msgr2=0x7fe0140b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:10.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.985+0000 7fe019a00640 1 -- 172.21.15.173:0/1983189142 shutdown_connections 2024-04-25T09:13:10.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:10.985+0000 7fe019a00640 1 -- 172.21.15.173:0/1983189142 wait complete. 2024-04-25T09:13:10.987 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:13:11.988 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:12.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.145+0000 7f32a5400640 1 Processor -- start 2024-04-25T09:13:12.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.145+0000 7f32a5400640 1 -- start start 2024-04-25T09:13:12.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.149+0000 7f32a5400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f32a015ba20 0x7f32a015be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:12.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.149+0000 7f32a5400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32a0070070 0x7f32a00d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:12.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.149+0000 7f32a5400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a015c460 con 0x7f32a00b70f0 2024-04-25T09:13:12.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.149+0000 7f32a5400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a015c740 con 0x7f32a015ba20 2024-04-25T09:13:12.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.149+0000 7f32a5400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a015ca20 con 0x7f32a0070070 2024-04-25T09:13:12.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.149+0000 7f329e800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f32a015ba20 0x7f32a015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:12.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.149+0000 7f3295e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f32a00b70f0 0x7f32a006f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45798/0 (socket says 172.21.15.173:45798) 2024-04-25T09:13:12.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.149+0000 7f3295e00640 1 -- 172.21.15.173:0/20669394 learned_addr learned my addr 172.21.15.173:0/20669394 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:12.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.149+0000 7f329f200640 1 --2- 172.21.15.173:0/20669394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32a0070070 0x7f32a00d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:12.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.149+0000 7f329e800640 1 -- 172.21.15.173:0/20669394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32a0070070 msgr2=0x7f32a00d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:12.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.149+0000 7f329e800640 1 --2- 172.21.15.173:0/20669394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32a0070070 0x7f32a00d1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.149+0000 7f329e800640 1 -- 172.21.15.173:0/20669394 >> v1:172.21.15.173:6789/0 conn(0x7f32a00b70f0 legacy=0x7f32a006f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:12.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.149+0000 7f329de00640 1 -- 172.21.15.173:0/20669394 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546165883 0 0) 0x7f32a015c460 con 0x7f32a00b70f0 2024-04-25T09:13:12.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.149+0000 7f329e800640 1 -- 172.21.15.173:0/20669394 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a015cd00 con 0x7f32a015ba20 2024-04-25T09:13:12.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f329e800640 1 --2- 172.21.15.173:0/20669394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a015ba20 0x7f32a015be00 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f32900097f0 tx=0x7f329001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678828d79a43c73c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:12.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f329de00640 1 -- 172.21.15.173:0/20669394 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32900aa5f0 con 0x7f32a015ba20 2024-04-25T09:13:12.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f329de00640 1 -- 172.21.15.173:0/20669394 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32900af070 con 0x7f32a015ba20 2024-04-25T09:13:12.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f329de00640 1 -- 172.21.15.173:0/20669394 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32900aa9b0 con 0x7f32a015ba20 2024-04-25T09:13:12.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f32a5400640 1 -- 172.21.15.173:0/20669394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a015ba20 msgr2=0x7f32a015be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:12.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f32a5400640 1 --2- 172.21.15.173:0/20669394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a015ba20 0x7f32a015be00 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f32900097f0 tx=0x7f329001c470 comp rx=0 tx=0).stop 2024-04-25T09:13:12.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f32a5400640 1 -- 172.21.15.173:0/20669394 shutdown_connections 2024-04-25T09:13:12.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f32a5400640 1 --2- 172.21.15.173:0/20669394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32a0070070 0x7f32a00d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f32a5400640 1 --2- 172.21.15.173:0/20669394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a015ba20 0x7f32a015be00 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f32a5400640 1 -- 172.21.15.173:0/20669394 >> 172.21.15.173:0/20669394 conn(0x7f32a0061880 msgr2=0x7f32a0061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:12.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f32a5400640 1 -- 172.21.15.173:0/20669394 shutdown_connections 2024-04-25T09:13:12.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f32a5400640 1 -- 172.21.15.173:0/20669394 wait complete. 2024-04-25T09:13:12.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f32a5400640 1 Processor -- start 2024-04-25T09:13:12.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f32a5400640 1 -- start start 2024-04-25T09:13:12.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f32a5400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a0070070 0x7f32a006bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:12.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f32a5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32a00b70f0 0x7f32a00cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:12.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f32a5400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32a015ba20 0x7f32a0166a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:12.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f32a5400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a015df20 con 0x7f32a0070070 2024-04-25T09:13:12.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f32a5400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a00b7750 con 0x7f32a00b70f0 2024-04-25T09:13:12.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f32a5400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a015e0a0 con 0x7f32a015ba20 2024-04-25T09:13:12.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.153+0000 7f329e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a0070070 0x7f32a006bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:12.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.157+0000 7f329e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a0070070 0x7f32a006bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35174/0 (socket says 172.21.15.173:35174) 2024-04-25T09:13:12.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.157+0000 7f329e800640 1 -- 172.21.15.173:0/1878681392 learned_addr learned my addr 172.21.15.173:0/1878681392 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:12.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.157+0000 7f329f200640 1 --2- 172.21.15.173:0/1878681392 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32a015ba20 0x7f32a0166a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:12.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.157+0000 7f3295e00640 1 --2- 172.21.15.173:0/1878681392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32a00b70f0 0x7f32a00cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:12.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.157+0000 7f329e800640 1 -- 172.21.15.173:0/1878681392 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32a015ba20 msgr2=0x7f32a0166a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:12.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.157+0000 7f329e800640 1 --2- 172.21.15.173:0/1878681392 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32a015ba20 0x7f32a0166a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.157+0000 7f329e800640 1 -- 172.21.15.173:0/1878681392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32a00b70f0 msgr2=0x7f32a00cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:12.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.157+0000 7f329e800640 1 --2- 172.21.15.173:0/1878681392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32a00b70f0 0x7f32a00cfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.157+0000 7f329e800640 1 -- 172.21.15.173:0/1878681392 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a00d0a90 con 0x7f32a0070070 2024-04-25T09:13:12.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.157+0000 7f329e800640 1 --2- 172.21.15.173:0/1878681392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a0070070 0x7f32a006bec0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f329001a0a0 tx=0x7f329001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:12.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.157+0000 7f3297400640 1 -- 172.21.15.173:0/1878681392 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32900be610 con 0x7f32a0070070 2024-04-25T09:13:12.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.157+0000 7f3297400640 1 -- 172.21.15.173:0/1878681392 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32900be7d0 con 0x7f32a0070070 2024-04-25T09:13:12.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.157+0000 7f3297400640 1 -- 172.21.15.173:0/1878681392 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32900bebc0 con 0x7f32a0070070 2024-04-25T09:13:12.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.157+0000 7f32a5400640 1 -- 172.21.15.173:0/1878681392 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a006c400 con 0x7f32a0070070 2024-04-25T09:13:12.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.157+0000 7f32a5400640 1 -- 172.21.15.173:0/1878681392 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a00b4cf0 con 0x7f32a0070070 2024-04-25T09:13:12.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.157+0000 7f32a5400640 1 -- 172.21.15.173:0/1878681392 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a0073a40 con 0x7f32a0070070 2024-04-25T09:13:12.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.157+0000 7f3297400640 1 -- 172.21.15.173:0/1878681392 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f32900bc020 con 0x7f32a0070070 2024-04-25T09:13:12.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.157+0000 7f3297400640 1 --2- 172.21.15.173:0/1878681392 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f327c066f60 0x7f327c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:12.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.161+0000 7f3297400640 1 -- 172.21.15.173:0/1878681392 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f329011ef30 con 0x7f32a0070070 2024-04-25T09:13:12.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.161+0000 7f3295e00640 1 --2- 172.21.15.173:0/1878681392 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f327c066f60 0x7f327c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:12.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.161+0000 7f3295e00640 1 --2- 172.21.15.173:0/1878681392 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f327c066f60 0x7f327c069420 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f32a0154ee0 tx=0x7f3288009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:12.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.161+0000 7f3297400640 1 -- 172.21.15.173:0/1878681392 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f32a00d25e0 con 0x7f32a0070070 2024-04-25T09:13:12.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.349+0000 7f32a5400640 1 -- 172.21.15.173:0/1878681392 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32a006e620 con 0x7f32a0070070 2024-04-25T09:13:12.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.349+0000 7f3297400640 1 -- 172.21.15.173:0/1878681392 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f3290016090 con 0x7f32a0070070 2024-04-25T09:13:12.335 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:12.335 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":89,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":9408,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1841246276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1841246276},{"type":"v1","addr":"172.21.15.173:6835","nonce":1841246276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:34.472510+0000","modified":"2024-04-25T09:12:37.491581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9411":{"gid":9411,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3627798672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3627798672},{"type":"v1","addr":"172.21.15.173:6837","nonce":3627798672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:13:12.335 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 89 2024-04-25T09:13:12.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.353+0000 7f32a5400640 1 -- 172.21.15.173:0/1878681392 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f327c066f60 msgr2=0x7f327c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:12.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.353+0000 7f32a5400640 1 --2- 172.21.15.173:0/1878681392 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f327c066f60 0x7f327c069420 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f32a0154ee0 tx=0x7f3288009040 comp rx=0 tx=0).stop 2024-04-25T09:13:12.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.353+0000 7f32a5400640 1 -- 172.21.15.173:0/1878681392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a0070070 msgr2=0x7f32a006bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:12.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.353+0000 7f32a5400640 1 --2- 172.21.15.173:0/1878681392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a0070070 0x7f32a006bec0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f329001a0a0 tx=0x7f329001acb0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.353+0000 7f32a5400640 1 -- 172.21.15.173:0/1878681392 shutdown_connections 2024-04-25T09:13:12.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.353+0000 7f32a5400640 1 --2- 172.21.15.173:0/1878681392 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f327c066f60 0x7f327c069420 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.353+0000 7f32a5400640 1 --2- 172.21.15.173:0/1878681392 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32a015ba20 0x7f32a0166a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.353+0000 7f32a5400640 1 --2- 172.21.15.173:0/1878681392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32a00b70f0 0x7f32a00cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.353+0000 7f32a5400640 1 --2- 172.21.15.173:0/1878681392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a0070070 0x7f32a006bec0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.353+0000 7f32a5400640 1 -- 172.21.15.173:0/1878681392 >> 172.21.15.173:0/1878681392 conn(0x7f32a0061880 msgr2=0x7f32a0154090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:12.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.353+0000 7f32a5400640 1 -- 172.21.15.173:0/1878681392 shutdown_connections 2024-04-25T09:13:12.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.353+0000 7f32a5400640 1 -- 172.21.15.173:0/1878681392 wait complete. 2024-04-25T09:13:12.356 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-04-25T09:13:12.356 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:13:12.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.505+0000 7f72da400640 1 Processor -- start 2024-04-25T09:13:12.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.505+0000 7f72da400640 1 -- start start 2024-04-25T09:13:12.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.505+0000 7f72da400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f72d406c270 0x7f72d406c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:12.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.505+0000 7f72da400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f72d406ccf0 0x7f72d40b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:12.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.505+0000 7f72da400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d409ad60 con 0x7f72d415da60 2024-04-25T09:13:12.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.505+0000 7f72da400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d409ab40 con 0x7f72d406ccf0 2024-04-25T09:13:12.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.505+0000 7f72da400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d406d140 con 0x7f72d406c270 2024-04-25T09:13:12.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.509+0000 7f72d9a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f72d406ccf0 0x7f72d40b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:12.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.509+0000 7f72d9a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f72d406ccf0 0x7f72d40b22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35188/0 (socket says 172.21.15.173:35188) 2024-04-25T09:13:12.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.509+0000 7f72d9a00640 1 -- 172.21.15.173:0/296135093 learned_addr learned my addr 172.21.15.173:0/296135093 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:12.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.509+0000 7f72cbe00640 1 --2- 172.21.15.173:0/296135093 >> v2:172.21.15.194:3300/0 conn(0x7f72d406c270 0x7f72d406c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:12.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.509+0000 7f72d9a00640 1 -- 172.21.15.173:0/296135093 >> v2:172.21.15.194:3300/0 conn(0x7f72d406c270 msgr2=0x7f72d406c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:12.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.509+0000 7f72d9a00640 1 --2- 172.21.15.173:0/296135093 >> v2:172.21.15.194:3300/0 conn(0x7f72d406c270 0x7f72d406c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.509+0000 7f72d9a00640 1 -- 172.21.15.173:0/296135093 >> v1:172.21.15.194:6789/0 conn(0x7f72d415da60 legacy=0x7f72d409a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:12.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.509+0000 7f72d9a00640 1 -- 172.21.15.173:0/296135093 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d40cbd30 con 0x7f72d406ccf0 2024-04-25T09:13:12.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.509+0000 7f72d9a00640 1 --2- 172.21.15.173:0/296135093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72d406ccf0 0x7f72d40b22c0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f72d40c8680 tx=0x7f72cc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6fe9cd80fde96ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:12.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.509+0000 7f72d3e00640 1 -- 172.21.15.173:0/296135093 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0a57a0 con 0x7f72d406ccf0 2024-04-25T09:13:12.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.509+0000 7f72d3e00640 1 -- 172.21.15.173:0/296135093 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc0a5940 con 0x7f72d406ccf0 2024-04-25T09:13:12.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.509+0000 7f72d3e00640 1 -- 172.21.15.173:0/296135093 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0a5d10 con 0x7f72d406ccf0 2024-04-25T09:13:12.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72da400640 1 -- 172.21.15.173:0/296135093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72d406ccf0 msgr2=0x7f72d40b22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:12.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72da400640 1 --2- 172.21.15.173:0/296135093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72d406ccf0 0x7f72d40b22c0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f72d40c8680 tx=0x7f72cc01c9f0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72da400640 1 -- 172.21.15.173:0/296135093 shutdown_connections 2024-04-25T09:13:12.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72da400640 1 --2- 172.21.15.173:0/296135093 >> v2:172.21.15.194:3300/0 conn(0x7f72d406c270 0x7f72d406c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72da400640 1 --2- 172.21.15.173:0/296135093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72d406ccf0 0x7f72d40b22c0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72da400640 1 -- 172.21.15.173:0/296135093 >> 172.21.15.173:0/296135093 conn(0x7f72d40b3130 msgr2=0x7f72d40b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:12.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72da400640 1 -- 172.21.15.173:0/296135093 shutdown_connections 2024-04-25T09:13:12.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72da400640 1 -- 172.21.15.173:0/296135093 wait complete. 2024-04-25T09:13:12.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72da400640 1 Processor -- start 2024-04-25T09:13:12.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72da400640 1 -- start start 2024-04-25T09:13:12.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72da400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72d406c270 0x7f72d4152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:12.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72da400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72d406ccf0 0x7f72d40b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:12.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72da400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72d415da60 0x7f72d40b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:12.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72da400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d415dfc0 con 0x7f72d415da60 2024-04-25T09:13:12.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72da400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d415de40 con 0x7f72d406c270 2024-04-25T09:13:12.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72da400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d40ccad0 con 0x7f72d406ccf0 2024-04-25T09:13:12.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72d9a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72d415da60 0x7f72d40b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:12.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72d9a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72d415da60 0x7f72d40b6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35202/0 (socket says 172.21.15.173:35202) 2024-04-25T09:13:12.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72d9a00640 1 -- 172.21.15.173:0/1821732899 learned_addr learned my addr 172.21.15.173:0/1821732899 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:12.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72cbe00640 1 --2- 172.21.15.173:0/1821732899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72d406ccf0 0x7f72d40b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:12.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.513+0000 7f72d9000640 1 --2- 172.21.15.173:0/1821732899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72d406c270 0x7f72d4152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:12.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.517+0000 7f72d9a00640 1 -- 172.21.15.173:0/1821732899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72d406ccf0 msgr2=0x7f72d40b6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:12.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.517+0000 7f72d9a00640 1 --2- 172.21.15.173:0/1821732899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72d406ccf0 0x7f72d40b6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.517+0000 7f72d9a00640 1 -- 172.21.15.173:0/1821732899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72d406c270 msgr2=0x7f72d4152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:12.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.517+0000 7f72d9a00640 1 --2- 172.21.15.173:0/1821732899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72d406c270 0x7f72d4152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.517+0000 7f72d9a00640 1 -- 172.21.15.173:0/1821732899 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d40b5990 con 0x7f72d415da60 2024-04-25T09:13:12.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.517+0000 7f72d9a00640 1 --2- 172.21.15.173:0/1821732899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72d415da60 0x7f72d40b6f70 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0af040 tx=0x7f72cc019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:12.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.517+0000 7f72d1600640 1 -- 172.21.15.173:0/1821732899 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0bc020 con 0x7f72d415da60 2024-04-25T09:13:12.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.517+0000 7f72d1600640 1 -- 172.21.15.173:0/1821732899 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc0b8670 con 0x7f72d415da60 2024-04-25T09:13:12.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.517+0000 7f72d1600640 1 -- 172.21.15.173:0/1821732899 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0b8a60 con 0x7f72d415da60 2024-04-25T09:13:12.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.517+0000 7f72da400640 1 -- 172.21.15.173:0/1821732899 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d40b5c70 con 0x7f72d415da60 2024-04-25T09:13:12.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.517+0000 7f72da400640 1 -- 172.21.15.173:0/1821732899 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d40b6230 con 0x7f72d415da60 2024-04-25T09:13:12.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.517+0000 7f72da400640 1 -- 172.21.15.173:0/1821732899 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d4073a40 con 0x7f72d415da60 2024-04-25T09:13:12.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.517+0000 7f72d1600640 1 -- 172.21.15.173:0/1821732899 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f72cc0bf020 con 0x7f72d415da60 2024-04-25T09:13:12.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.517+0000 7f72d1600640 1 --2- 172.21.15.173:0/1821732899 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f72b0066f90 0x7f72b0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:12.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.517+0000 7f72d1600640 1 -- 172.21.15.173:0/1821732899 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f72cc11fef0 con 0x7f72d415da60 2024-04-25T09:13:12.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.517+0000 7f72d9000640 1 --2- 172.21.15.173:0/1821732899 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f72b0066f90 0x7f72b0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:12.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.521+0000 7f72d9000640 1 --2- 172.21.15.173:0/1821732899 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f72b0066f90 0x7f72b0069450 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f72c4001770 tx=0x7f72c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:12.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.525+0000 7f72d1600640 1 -- 172.21.15.173:0/1821732899 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f72cc0c6030 con 0x7f72d415da60 2024-04-25T09:13:12.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.729+0000 7f72da400640 1 -- 172.21.15.173:0/1821732899 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f72d406f4a0 con 0x7f72d415da60 2024-04-25T09:13:12.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.733+0000 7f72d1600640 1 -- 172.21.15.173:0/1821732899 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1188 (secure 0 0 0) 0x7f72cc0165e0 con 0x7f72d415da60 2024-04-25T09:13:12.717 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:12.717 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":647,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":133,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1042,"data_bytes":1070092512,"bytes_used":2580455424,"bytes_avail":770513657856,"bytes_total":773094113280,"write_bytes_sec":55927525,"read_op_per_sec":0,"write_op_per_sec":56},"fsmap":{"epoch":89,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":9411}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2024-04-25T09:12:24.854436+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:13:12.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.733+0000 7f72da400640 1 -- 172.21.15.173:0/1821732899 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f72b0066f90 msgr2=0x7f72b0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:12.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.733+0000 7f72da400640 1 --2- 172.21.15.173:0/1821732899 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f72b0066f90 0x7f72b0069450 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f72c4001770 tx=0x7f72c4009040 comp rx=0 tx=0).stop 2024-04-25T09:13:12.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.733+0000 7f72da400640 1 -- 172.21.15.173:0/1821732899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72d415da60 msgr2=0x7f72d40b6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:12.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.733+0000 7f72da400640 1 --2- 172.21.15.173:0/1821732899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72d415da60 0x7f72d40b6f70 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0af040 tx=0x7f72cc019790 comp rx=0 tx=0).stop 2024-04-25T09:13:12.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.733+0000 7f72da400640 1 -- 172.21.15.173:0/1821732899 shutdown_connections 2024-04-25T09:13:12.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.733+0000 7f72da400640 1 --2- 172.21.15.173:0/1821732899 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f72b0066f90 0x7f72b0069450 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.733+0000 7f72da400640 1 --2- 172.21.15.173:0/1821732899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72d415da60 0x7f72d40b6f70 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.733+0000 7f72da400640 1 --2- 172.21.15.173:0/1821732899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72d406ccf0 0x7f72d40b6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.733+0000 7f72da400640 1 --2- 172.21.15.173:0/1821732899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72d406c270 0x7f72d4152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.733+0000 7f72da400640 1 -- 172.21.15.173:0/1821732899 >> 172.21.15.173:0/1821732899 conn(0x7f72d40b3130 msgr2=0x7f72d40cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:12.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.733+0000 7f72da400640 1 -- 172.21.15.173:0/1821732899 shutdown_connections 2024-04-25T09:13:12.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:12.733+0000 7f72da400640 1 -- 172.21.15.173:0/1821732899 wait complete. 2024-04-25T09:13:12.738 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T09:13:13.738 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:13.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.901+0000 7fa1a1e00640 1 Processor -- start 2024-04-25T09:13:13.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.901+0000 7fa1a1e00640 1 -- start start 2024-04-25T09:13:13.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.901+0000 7fa1a1e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa19c15be00 0x7fa19c06f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:13.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.901+0000 7fa1a1e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c06fea0 0x7fa19c0d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:13.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.901+0000 7fa1a1e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19c15c460 con 0x7fa19c15ba20 2024-04-25T09:13:13.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.901+0000 7fa1a1e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa19c15c740 con 0x7fa19c15be00 2024-04-25T09:13:13.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.901+0000 7fa1a1e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c15ca20 con 0x7fa19c06fea0 2024-04-25T09:13:13.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.901+0000 7fa19a000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa19c15be00 0x7fa19c06f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:13.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.901+0000 7fa19b400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c06fea0 0x7fa19c0d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:13.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.901+0000 7fa19a000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa19c15be00 0x7fa19c06f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:56624/0 (socket says 172.21.15.173:56624) 2024-04-25T09:13:13.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.901+0000 7fa19b400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c06fea0 0x7fa19c0d1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:35542/0 (socket says 172.21.15.173:35542) 2024-04-25T09:13:13.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.901+0000 7fa19a000640 1 -- 172.21.15.173:0/973368015 learned_addr learned my addr 172.21.15.173:0/973368015 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:13.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.901+0000 7fa19a000640 1 -- 172.21.15.173:0/973368015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c06fea0 msgr2=0x7fa19c0d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:13.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.901+0000 7fa19a000640 1 --2- 172.21.15.173:0/973368015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c06fea0 0x7fa19c0d1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:13.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.901+0000 7fa19a000640 1 -- 172.21.15.173:0/973368015 >> v1:172.21.15.194:6789/0 conn(0x7fa19c15ba20 legacy=0x7fa19c0b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:13.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.901+0000 7fa19a000640 1 -- 172.21.15.173:0/973368015 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c15cd00 con 0x7fa19c15be00 2024-04-25T09:13:13.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.901+0000 7fa19b400640 1 --2- 172.21.15.173:0/973368015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c06fea0 0x7fa19c0d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:13.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.905+0000 7fa19a000640 1 --2- 172.21.15.173:0/973368015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa19c15be00 0x7fa19c06f960 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa1880098a0 tx=0x7fa18801c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcc7411fc7efa634 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:13.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.905+0000 7fa199600640 1 -- 172.21.15.173:0/973368015 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1880b0070 con 0x7fa19c15be00 2024-04-25T09:13:13.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.905+0000 7fa199600640 1 -- 172.21.15.173:0/973368015 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1880ab600 con 0x7fa19c15be00 2024-04-25T09:13:13.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.905+0000 7fa199600640 1 -- 172.21.15.173:0/973368015 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1880ab9d0 con 0x7fa19c15be00 2024-04-25T09:13:13.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.905+0000 7fa1a1e00640 1 -- 172.21.15.173:0/973368015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa19c15be00 msgr2=0x7fa19c06f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:13.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.905+0000 7fa1a1e00640 1 --2- 172.21.15.173:0/973368015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa19c15be00 0x7fa19c06f960 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa1880098a0 tx=0x7fa18801c540 comp rx=0 tx=0).stop 2024-04-25T09:13:13.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.905+0000 7fa1a1e00640 1 -- 172.21.15.173:0/973368015 shutdown_connections 2024-04-25T09:13:13.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.905+0000 7fa1a1e00640 1 --2- 172.21.15.173:0/973368015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c06fea0 0x7fa19c0d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:13.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.905+0000 7fa1a1e00640 1 --2- 172.21.15.173:0/973368015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa19c15be00 0x7fa19c06f960 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:13.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.905+0000 7fa1a1e00640 1 -- 172.21.15.173:0/973368015 >> 172.21.15.173:0/973368015 conn(0x7fa19c061880 msgr2=0x7fa19c061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:13.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.905+0000 7fa1a1e00640 1 -- 172.21.15.173:0/973368015 shutdown_connections 2024-04-25T09:13:13.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.905+0000 7fa1a1e00640 1 -- 172.21.15.173:0/973368015 wait complete. 2024-04-25T09:13:13.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa1a1e00640 1 Processor -- start 2024-04-25T09:13:13.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa1a1e00640 1 -- start start 2024-04-25T09:13:13.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa1a1e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa19c06fea0 0x7fa19c06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:13.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa1a1e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa19c15ba20 0x7fa19c0b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:13.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa1a1e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c15be00 0x7fa19c1f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:13.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa1a1e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c15e2b0 con 0x7fa19c15ba20 2024-04-25T09:13:13.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa1a1e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c15e130 con 0x7fa19c06fea0 2024-04-25T09:13:13.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa1a1e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c15e430 con 0x7fa19c15be00 2024-04-25T09:13:13.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa19a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa19c15ba20 0x7fa19c0b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:13.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa19a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa19c15ba20 0x7fa19c0b2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35266/0 (socket says 172.21.15.173:35266) 2024-04-25T09:13:13.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa19a000640 1 -- 172.21.15.173:0/1740295688 learned_addr learned my addr 172.21.15.173:0/1740295688 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:13.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa19b400640 1 --2- 172.21.15.173:0/1740295688 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c15be00 0x7fa19c1f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:13.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa19aa00640 1 --2- 172.21.15.173:0/1740295688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa19c06fea0 0x7fa19c06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:13.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa19a000640 1 -- 172.21.15.173:0/1740295688 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c15be00 msgr2=0x7fa19c1f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:13.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa19a000640 1 --2- 172.21.15.173:0/1740295688 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c15be00 0x7fa19c1f64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:13.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa19a000640 1 -- 172.21.15.173:0/1740295688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa19c06fea0 msgr2=0x7fa19c06c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:13.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa19a000640 1 --2- 172.21.15.173:0/1740295688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa19c06fea0 0x7fa19c06c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:13.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa19a000640 1 -- 172.21.15.173:0/1740295688 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c15af70 con 0x7fa19c15ba20 2024-04-25T09:13:13.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa19a000640 1 --2- 172.21.15.173:0/1740295688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa19c15ba20 0x7fa19c0b2800 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fa18801a170 tx=0x7fa1880192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:13.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa193400640 1 -- 172.21.15.173:0/1740295688 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1880b0040 con 0x7fa19c15ba20 2024-04-25T09:13:13.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa193400640 1 -- 172.21.15.173:0/1740295688 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1880b9070 con 0x7fa19c15ba20 2024-04-25T09:13:13.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa1a1e00640 1 -- 172.21.15.173:0/1740295688 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19c06bed0 con 0x7fa19c15ba20 2024-04-25T09:13:13.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa193400640 1 -- 172.21.15.173:0/1740295688 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1880b4670 con 0x7fa19c15ba20 2024-04-25T09:13:13.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.909+0000 7fa1a1e00640 1 -- 172.21.15.173:0/1740295688 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19c0b2d40 con 0x7fa19c15ba20 2024-04-25T09:13:13.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.913+0000 7fa1a1e00640 1 -- 172.21.15.173:0/1740295688 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19c073a40 con 0x7fa19c15ba20 2024-04-25T09:13:13.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.913+0000 7fa193400640 1 -- 172.21.15.173:0/1740295688 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa1880b4810 con 0x7fa19c15ba20 2024-04-25T09:13:13.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.913+0000 7fa193400640 1 --2- 172.21.15.173:0/1740295688 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa17c066f60 0x7fa17c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:13.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.913+0000 7fa193400640 1 -- 172.21.15.173:0/1740295688 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa18811e9a0 con 0x7fa19c15ba20 2024-04-25T09:13:13.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.913+0000 7fa19aa00640 1 --2- 172.21.15.173:0/1740295688 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa17c066f60 0x7fa17c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:13.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.913+0000 7fa19aa00640 1 --2- 172.21.15.173:0/1740295688 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa17c066f60 0x7fa17c069420 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0d11c0 tx=0x7fa18c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:13.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:13.917+0000 7fa193400640 1 -- 172.21.15.173:0/1740295688 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa188016130 con 0x7fa19c15ba20 2024-04-25T09:13:14.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.105+0000 7fa1a1e00640 1 -- 172.21.15.173:0/1740295688 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa19c0cefc0 con 0x7fa19c15ba20 2024-04-25T09:13:14.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.105+0000 7fa193400640 1 -- 172.21.15.173:0/1740295688 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4952 (secure 0 0 0) 0x7fa1880ef810 con 0x7fa19c15ba20 2024-04-25T09:13:14.091 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:14.091 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":89,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":9408,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1841246276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1841246276},{"type":"v1","addr":"172.21.15.173:6835","nonce":1841246276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:34.472510+0000","modified":"2024-04-25T09:12:37.491581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9411":{"gid":9411,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3627798672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3627798672},{"type":"v1","addr":"172.21.15.173:6837","nonce":3627798672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:13:14.092 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 89 2024-04-25T09:13:14.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.109+0000 7fa1a1e00640 1 -- 172.21.15.173:0/1740295688 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa17c066f60 msgr2=0x7fa17c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.109+0000 7fa1a1e00640 1 --2- 172.21.15.173:0/1740295688 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa17c066f60 0x7fa17c069420 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0d11c0 tx=0x7fa18c009040 comp rx=0 tx=0).stop 2024-04-25T09:13:14.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.109+0000 7fa1a1e00640 1 -- 172.21.15.173:0/1740295688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa19c15ba20 msgr2=0x7fa19c0b2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.109+0000 7fa1a1e00640 1 --2- 172.21.15.173:0/1740295688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa19c15ba20 0x7fa19c0b2800 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fa18801a170 tx=0x7fa1880192e0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.109+0000 7fa1a1e00640 1 -- 172.21.15.173:0/1740295688 shutdown_connections 2024-04-25T09:13:14.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.109+0000 7fa1a1e00640 1 --2- 172.21.15.173:0/1740295688 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa17c066f60 0x7fa17c069420 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.109+0000 7fa1a1e00640 1 --2- 172.21.15.173:0/1740295688 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c15be00 0x7fa19c1f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.109+0000 7fa1a1e00640 1 --2- 172.21.15.173:0/1740295688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa19c15ba20 0x7fa19c0b2800 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.109+0000 7fa1a1e00640 1 --2- 172.21.15.173:0/1740295688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa19c06fea0 0x7fa19c06c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.109+0000 7fa1a1e00640 1 -- 172.21.15.173:0/1740295688 >> 172.21.15.173:0/1740295688 conn(0x7fa19c061880 msgr2=0x7fa19c0d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:14.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.109+0000 7fa1a1e00640 1 -- 172.21.15.173:0/1740295688 shutdown_connections 2024-04-25T09:13:14.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.109+0000 7fa1a1e00640 1 -- 172.21.15.173:0/1740295688 wait complete. 2024-04-25T09:13:14.112 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-04-25T09:13:14.113 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:13:14.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.261+0000 7f27bc000640 1 Processor -- start 2024-04-25T09:13:14.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.261+0000 7f27bc000640 1 -- start start 2024-04-25T09:13:14.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27bc000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f27b4145250 0x7f27b415c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27bc000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27b40cc8b0 0x7f27b40ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27bc000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b415cec0 con 0x7f27b4071320 2024-04-25T09:13:14.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27bc000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b406e7c0 con 0x7f27b4145250 2024-04-25T09:13:14.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27bc000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b406d720 con 0x7f27b40cc8b0 2024-04-25T09:13:14.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27ba000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f27b4071320 0x7f27b4071790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45484/0 (socket says 172.21.15.173:45484) 2024-04-25T09:13:14.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27ba000640 1 -- 172.21.15.173:0/3351648437 learned_addr learned my addr 172.21.15.173:0/3351648437 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:14.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b3e00640 1 -- 172.21.15.173:0/3351648437 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637420291 0 0) 0x7f27ac0014a0 con 0x7f27b4071320 2024-04-25T09:13:14.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b3e00640 1 -- 172.21.15.173:0/3351648437 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f279c003530 con 0x7f27b4071320 2024-04-25T09:13:14.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b9600640 1 --2- 172.21.15.173:0/3351648437 >> v2:172.21.15.194:3300/0 conn(0x7f27b4145250 0x7f27b415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b8c00640 1 --2- 172.21.15.173:0/3351648437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27b40cc8b0 0x7f27b40ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b3e00640 1 -- 172.21.15.173:0/3351648437 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1887588083 0 0) 0x7f279c003530 con 0x7f27b4071320 2024-04-25T09:13:14.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b3e00640 1 -- 172.21.15.173:0/3351648437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27b40cc8b0 msgr2=0x7f27b40ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:14.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b3e00640 1 --2- 172.21.15.173:0/3351648437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27b40cc8b0 0x7f27b40ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b3e00640 1 -- 172.21.15.173:0/3351648437 >> v2:172.21.15.194:3300/0 conn(0x7f27b4145250 msgr2=0x7f27b415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:14.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b3e00640 1 --2- 172.21.15.173:0/3351648437 >> v2:172.21.15.194:3300/0 conn(0x7f27b4145250 0x7f27b415c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b3e00640 1 -- 172.21.15.173:0/3351648437 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b406da00 con 0x7f27b4071320 2024-04-25T09:13:14.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b3e00640 1 -- 172.21.15.173:0/3351648437 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f27ac001bd0 con 0x7f27b4071320 2024-04-25T09:13:14.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b8c00640 1 --2- 172.21.15.173:0/3351648437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27b40cc8b0 0x7f27b40ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:14.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b3e00640 1 -- 172.21.15.173:0/3351648437 >> v1:172.21.15.173:6789/0 conn(0x7f27b4071320 legacy=0x7f27b4071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b3e00640 1 --2- 172.21.15.173:0/3351648437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27b40cc8b0 0x7f279c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b3e00640 1 --2- 172.21.15.173:0/3351648437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f279c003f00 0x7f279c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b3e00640 1 --2- 172.21.15.173:0/3351648437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f279c004d50 0x7f279c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b3e00640 1 -- 172.21.15.173:0/3351648437 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b406e7c0 con 0x7f279c004d50 2024-04-25T09:13:14.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b3e00640 1 -- 172.21.15.173:0/3351648437 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b406d720 con 0x7f279c003f00 2024-04-25T09:13:14.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b3e00640 1 -- 172.21.15.173:0/3351648437 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c00ba00 con 0x7f27b40cc8b0 2024-04-25T09:13:14.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27ba000640 1 --2- 172.21.15.173:0/3351648437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f279c004d50 0x7f279c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b9600640 1 --2- 172.21.15.173:0/3351648437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27b40cc8b0 0x7f279c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27b8c00640 1 --2- 172.21.15.173:0/3351648437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f279c003f00 0x7f279c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27ba000640 1 -- 172.21.15.173:0/3351648437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27b40cc8b0 msgr2=0x7f279c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:14.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27ba000640 1 --2- 172.21.15.173:0/3351648437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27b40cc8b0 0x7f279c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27ba000640 1 -- 172.21.15.173:0/3351648437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f279c003f00 msgr2=0x7f279c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:14.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27ba000640 1 --2- 172.21.15.173:0/3351648437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f279c003f00 0x7f279c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.265+0000 7f27ba000640 1 -- 172.21.15.173:0/3351648437 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c003530 con 0x7f279c004d50 2024-04-25T09:13:14.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.269+0000 7f27ba000640 1 --2- 172.21.15.173:0/3351648437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f279c004d50 0x7f279c0051d0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00aa50 tx=0x7f27ac01d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4793f7bb68c9ac0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:14.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.269+0000 7f27b3e00640 1 -- 172.21.15.173:0/3351648437 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac00a670 con 0x7f279c004d50 2024-04-25T09:13:14.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.269+0000 7f27b3e00640 1 -- 172.21.15.173:0/3351648437 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac0ad650 con 0x7f279c004d50 2024-04-25T09:13:14.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.269+0000 7f27b3e00640 1 -- 172.21.15.173:0/3351648437 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac0ada80 con 0x7f279c004d50 2024-04-25T09:13:14.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.269+0000 7f27bc000640 1 -- 172.21.15.173:0/3351648437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f279c004d50 msgr2=0x7f279c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.269+0000 7f27bc000640 1 --2- 172.21.15.173:0/3351648437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f279c004d50 0x7f279c0051d0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00aa50 tx=0x7f27ac01d3a0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.269+0000 7f27ba000640 1 -- 172.21.15.173:0/3351648437 reap_dead start 2024-04-25T09:13:14.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.269+0000 7f27bc000640 1 -- 172.21.15.173:0/3351648437 shutdown_connections 2024-04-25T09:13:14.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.269+0000 7f27bc000640 1 -- 172.21.15.173:0/3351648437 >> 172.21.15.173:0/3351648437 conn(0x7f27b406ac90 msgr2=0x7f27b406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:14.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.269+0000 7f27bc000640 1 -- 172.21.15.173:0/3351648437 shutdown_connections 2024-04-25T09:13:14.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.269+0000 7f27bc000640 1 -- 172.21.15.173:0/3351648437 wait complete. 2024-04-25T09:13:14.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27bc000640 1 Processor -- start 2024-04-25T09:13:14.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27bc000640 1 -- start start 2024-04-25T09:13:14.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27bc000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f279c004d50 0x7f27b415b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27bc000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27b40ad770 0x7f27b415dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27bc000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27b40cb2f0 0x7f27b415e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27bc000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b406e2a0 con 0x7f279c004d50 2024-04-25T09:13:14.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27bc000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b406dfc0 con 0x7f27b40ad770 2024-04-25T09:13:14.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27bc000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b4145630 con 0x7f27b40cb2f0 2024-04-25T09:13:14.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27b9600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f279c004d50 0x7f27b415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27b9600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f279c004d50 0x7f27b415b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35284/0 (socket says 172.21.15.173:35284) 2024-04-25T09:13:14.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27b9600640 1 -- 172.21.15.173:0/2220883299 learned_addr learned my addr 172.21.15.173:0/2220883299 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:14.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27b8c00640 1 --2- 172.21.15.173:0/2220883299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27b40ad770 0x7f27b415dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27ba000640 1 --2- 172.21.15.173:0/2220883299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27b40cb2f0 0x7f27b415e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27b9600640 1 -- 172.21.15.173:0/2220883299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27b40cb2f0 msgr2=0x7f27b415e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27b9600640 1 --2- 172.21.15.173:0/2220883299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27b40cb2f0 0x7f27b415e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27b9600640 1 -- 172.21.15.173:0/2220883299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27b40ad770 msgr2=0x7f27b415dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27b9600640 1 --2- 172.21.15.173:0/2220883299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27b40ad770 0x7f27b415dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27b9600640 1 -- 172.21.15.173:0/2220883299 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b40cffe0 con 0x7f279c004d50 2024-04-25T09:13:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27b8c00640 1 --2- 172.21.15.173:0/2220883299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27b40ad770 0x7f27b415dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27b9600640 1 --2- 172.21.15.173:0/2220883299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f279c004d50 0x7f27b415b300 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f27a8011aa0 tx=0x7f27a8011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27b1600640 1 -- 172.21.15.173:0/2220883299 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a800fb80 con 0x7f279c004d50 2024-04-25T09:13:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27b1600640 1 -- 172.21.15.173:0/2220883299 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a800fd20 con 0x7f279c004d50 2024-04-25T09:13:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27bc000640 1 -- 172.21.15.173:0/2220883299 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b415b840 con 0x7f279c004d50 2024-04-25T09:13:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27b1600640 1 -- 172.21.15.173:0/2220883299 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a8014680 con 0x7f279c004d50 2024-04-25T09:13:14.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27bc000640 1 -- 172.21.15.173:0/2220883299 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b40adce0 con 0x7f279c004d50 2024-04-25T09:13:14.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.273+0000 7f27bc000640 1 -- 172.21.15.173:0/2220883299 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b4073a40 con 0x7f279c004d50 2024-04-25T09:13:14.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.277+0000 7f27b1600640 1 -- 172.21.15.173:0/2220883299 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f27a8012040 con 0x7f279c004d50 2024-04-25T09:13:14.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.277+0000 7f27b1600640 1 --2- 172.21.15.173:0/2220883299 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2794066f60 0x7f2794069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.277+0000 7f27b1600640 1 -- 172.21.15.173:0/2220883299 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f27a80859b0 con 0x7f279c004d50 2024-04-25T09:13:14.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.277+0000 7f27b8c00640 1 --2- 172.21.15.173:0/2220883299 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2794066f60 0x7f2794069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.277+0000 7f27b8c00640 1 --2- 172.21.15.173:0/2220883299 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2794066f60 0x7f2794069420 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f27b413cae0 tx=0x7f27a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:14.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.281+0000 7f27b1600640 1 -- 172.21.15.173:0/2220883299 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f27a8019030 con 0x7f279c004d50 2024-04-25T09:13:14.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.489+0000 7f27bc000640 1 -- 172.21.15.173:0/2220883299 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f27b40cc360 con 0x7f279c004d50 2024-04-25T09:13:14.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.489+0000 7f27b1600640 1 -- 172.21.15.173:0/2220883299 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1598 (secure 0 0 0) 0x7f27a8056820 con 0x7f279c004d50 2024-04-25T09:13:14.473 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:14.473 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":648,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":133,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076677378,"bytes_used":2612207616,"bytes_avail":770481905664,"bytes_total":773094113280,"write_bytes_sec":40747807,"read_op_per_sec":0,"write_op_per_sec":40},"fsmap":{"epoch":89,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":9411}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":31,"modified":"2024-04-25T09:13:12.865070+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:13:14.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.489+0000 7f27bc000640 1 -- 172.21.15.173:0/2220883299 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2794066f60 msgr2=0x7f2794069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.489+0000 7f27bc000640 1 --2- 172.21.15.173:0/2220883299 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2794066f60 0x7f2794069420 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f27b413cae0 tx=0x7f27a0008040 comp rx=0 tx=0).stop 2024-04-25T09:13:14.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.489+0000 7f27bc000640 1 -- 172.21.15.173:0/2220883299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f279c004d50 msgr2=0x7f27b415b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.489+0000 7f27bc000640 1 --2- 172.21.15.173:0/2220883299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f279c004d50 0x7f27b415b300 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f27a8011aa0 tx=0x7f27a8011f60 comp rx=0 tx=0).stop 2024-04-25T09:13:14.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.489+0000 7f27bc000640 1 -- 172.21.15.173:0/2220883299 shutdown_connections 2024-04-25T09:13:14.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.489+0000 7f27bc000640 1 --2- 172.21.15.173:0/2220883299 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2794066f60 0x7f2794069420 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.489+0000 7f27bc000640 1 --2- 172.21.15.173:0/2220883299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27b40cb2f0 0x7f27b415e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.489+0000 7f27bc000640 1 --2- 172.21.15.173:0/2220883299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27b40ad770 0x7f27b415dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.489+0000 7f27bc000640 1 --2- 172.21.15.173:0/2220883299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f279c004d50 0x7f27b415b300 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.489+0000 7f27bc000640 1 -- 172.21.15.173:0/2220883299 >> 172.21.15.173:0/2220883299 conn(0x7f27b406ac90 msgr2=0x7f27b40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:14.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.489+0000 7f27bc000640 1 -- 172.21.15.173:0/2220883299 shutdown_connections 2024-04-25T09:13:14.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.489+0000 7f27bc000640 1 -- 172.21.15.173:0/2220883299 wait complete. 2024-04-25T09:13:14.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused'} 2024-04-25T09:13:14.494 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:13:14.494 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:13:14.509 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:13:14.509 INFO:tasks.cephfs.test_scrub_checks:Waiting for promotion of one of the original standbys {'c', 'd', 'b'} 2024-04-25T09:13:14.509 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2024-04-25T09:13:14.698 INFO:teuthology.orchestra.run.smithi173.stdout:{"mds_beacon_grace":"15.000000"} 2024-04-25T09:13:14.698 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2024-04-25T09:13:14.699 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:14.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92e7800640 1 Processor -- start 2024-04-25T09:13:14.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92e7800640 1 -- start start 2024-04-25T09:13:14.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92e7800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f92e0145250 0x7f92e015c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92e7800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e015cec0 con 0x7f92e00cc8b0 2024-04-25T09:13:14.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92e7800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e006e7c0 con 0x7f92e00ccd30 2024-04-25T09:13:14.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92e7800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e0072140 con 0x7f92e0145250 2024-04-25T09:13:14.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92dfe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f92e00cc8b0 0x7f92e0071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45500/0 (socket says 172.21.15.173:45500) 2024-04-25T09:13:14.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92dfe00640 1 -- 172.21.15.173:0/3851341017 learned_addr learned my addr 172.21.15.173:0/3851341017 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:14.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92e4e00640 1 --2- 172.21.15.173:0/3851341017 >> v2:172.21.15.194:3300/0 conn(0x7f92e0145250 0x7f92e015c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92df400640 1 -- 172.21.15.173:0/3851341017 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119686490 0 0) 0x7f92cc001120 con 0x7f92e00cc8b0 2024-04-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92df400640 1 -- 172.21.15.173:0/3851341017 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92c4003530 con 0x7f92e00cc8b0 2024-04-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92df400640 1 -- 172.21.15.173:0/3851341017 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1419943037 0 0) 0x7f92c4003530 con 0x7f92e00cc8b0 2024-04-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92df400640 1 -- 172.21.15.173:0/3851341017 >> v2:172.21.15.194:3300/0 conn(0x7f92e0145250 msgr2=0x7f92e015c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92df400640 1 --2- 172.21.15.173:0/3851341017 >> v2:172.21.15.194:3300/0 conn(0x7f92e0145250 0x7f92e015c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92df400640 1 -- 172.21.15.173:0/3851341017 >> v1:172.21.15.194:6789/0 conn(0x7f92e00ccd30 legacy=0x7f92e0071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92df400640 1 -- 172.21.15.173:0/3851341017 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e006d720 con 0x7f92e00cc8b0 2024-04-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92df400640 1 -- 172.21.15.173:0/3851341017 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f92cc001850 con 0x7f92e00cc8b0 2024-04-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92df400640 1 -- 172.21.15.173:0/3851341017 >> v1:172.21.15.173:6789/0 conn(0x7f92e00cc8b0 legacy=0x7f92e0071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92df400640 1 --2- 172.21.15.173:0/3851341017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c40039c0 0x7f92c4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92df400640 1 --2- 172.21.15.173:0/3851341017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c4004810 0x7f92c4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92df400640 1 --2- 172.21.15.173:0/3851341017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92c40051d0 0x7f92c400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92df400640 1 -- 172.21.15.173:0/3851341017 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e0072140 con 0x7f92c40051d0 2024-04-25T09:13:14.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92df400640 1 -- 172.21.15.173:0/3851341017 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c400c070 con 0x7f92c4004810 2024-04-25T09:13:14.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.849+0000 7f92df400640 1 -- 172.21.15.173:0/3851341017 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c400c270 con 0x7f92c40039c0 2024-04-25T09:13:14.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.853+0000 7f92dfe00640 1 --2- 172.21.15.173:0/3851341017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c4004810 0x7f92c4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.853+0000 7f92e5800640 1 --2- 172.21.15.173:0/3851341017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92c40051d0 0x7f92c400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.853+0000 7f92e4e00640 1 --2- 172.21.15.173:0/3851341017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c40039c0 0x7f92c4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.853+0000 7f92e5800640 1 -- 172.21.15.173:0/3851341017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c40039c0 msgr2=0x7f92c4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:14.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.853+0000 7f92e5800640 1 --2- 172.21.15.173:0/3851341017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c40039c0 0x7f92c4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.853+0000 7f92e5800640 1 -- 172.21.15.173:0/3851341017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c4004810 msgr2=0x7f92c4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:14.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.853+0000 7f92e5800640 1 --2- 172.21.15.173:0/3851341017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c4004810 0x7f92c4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.853+0000 7f92e5800640 1 -- 172.21.15.173:0/3851341017 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c4003530 con 0x7f92c40051d0 2024-04-25T09:13:14.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.853+0000 7f92e5800640 1 -- 172.21.15.173:0/3851341017 reap_dead start 2024-04-25T09:13:14.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.853+0000 7f92e5800640 1 --2- 172.21.15.173:0/3851341017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92c40051d0 0x7f92c400b9d0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f92d8001e70 tx=0x7f92d801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963c6908d7385d40 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:14.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.853+0000 7f92df400640 1 -- 172.21.15.173:0/3851341017 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d8001a90 con 0x7f92c40051d0 2024-04-25T09:13:14.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.853+0000 7f92df400640 1 -- 172.21.15.173:0/3851341017 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d8003bc0 con 0x7f92c40051d0 2024-04-25T09:13:14.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.853+0000 7f92df400640 1 -- 172.21.15.173:0/3851341017 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d8005020 con 0x7f92c40051d0 2024-04-25T09:13:14.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e7800640 1 -- 172.21.15.173:0/3851341017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92c40051d0 msgr2=0x7f92c400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e7800640 1 --2- 172.21.15.173:0/3851341017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92c40051d0 0x7f92c400b9d0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f92d8001e70 tx=0x7f92d801c780 comp rx=0 tx=0).stop 2024-04-25T09:13:14.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e7800640 1 -- 172.21.15.173:0/3851341017 shutdown_connections 2024-04-25T09:13:14.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e7800640 1 --2- 172.21.15.173:0/3851341017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92c40051d0 0x7f92c400b9d0 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e7800640 1 -- 172.21.15.173:0/3851341017 >> 172.21.15.173:0/3851341017 conn(0x7f92e006ac90 msgr2=0x7f92e006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:14.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e7800640 1 -- 172.21.15.173:0/3851341017 shutdown_connections 2024-04-25T09:13:14.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e7800640 1 -- 172.21.15.173:0/3851341017 wait complete. 2024-04-25T09:13:14.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e7800640 1 Processor -- start 2024-04-25T09:13:14.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e7800640 1 -- start start 2024-04-25T09:13:14.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e7800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c40051d0 0x7f92e00aad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e7800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92e01ef0d0 0x7f92e013fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e7800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92e01ef550 0x7f92e0140370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e7800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e006dfc0 con 0x7f92e01ef550 2024-04-25T09:13:14.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e7800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e006dce0 con 0x7f92c40051d0 2024-04-25T09:13:14.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e7800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e006e2a0 con 0x7f92e01ef0d0 2024-04-25T09:13:14.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e5800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92e01ef550 0x7f92e0140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e5800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92e01ef550 0x7f92e0140370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35304/0 (socket says 172.21.15.173:35304) 2024-04-25T09:13:14.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e5800640 1 -- 172.21.15.173:0/2026251304 learned_addr learned my addr 172.21.15.173:0/2026251304 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:14.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92dfe00640 1 --2- 172.21.15.173:0/2026251304 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92e01ef0d0 0x7f92e013fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e4e00640 1 --2- 172.21.15.173:0/2026251304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c40051d0 0x7f92e00aad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e5800640 1 -- 172.21.15.173:0/2026251304 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92e01ef0d0 msgr2=0x7f92e013fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e5800640 1 --2- 172.21.15.173:0/2026251304 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92e01ef0d0 0x7f92e013fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e5800640 1 -- 172.21.15.173:0/2026251304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c40051d0 msgr2=0x7f92e00aad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e5800640 1 --2- 172.21.15.173:0/2026251304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c40051d0 0x7f92e00aad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e5800640 1 -- 172.21.15.173:0/2026251304 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e00a97a0 con 0x7f92e01ef550 2024-04-25T09:13:14.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92e5800640 1 --2- 172.21.15.173:0/2026251304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92e01ef550 0x7f92e0140370 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f92d801cc60 tx=0x7f92c4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:14.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.857+0000 7f92dcc00640 1 -- 172.21.15.173:0/2026251304 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d8007dc0 con 0x7f92e01ef550 2024-04-25T09:13:14.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.861+0000 7f92dcc00640 1 -- 172.21.15.173:0/2026251304 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d80012e0 con 0x7f92e01ef550 2024-04-25T09:13:14.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.861+0000 7f92e7800640 1 -- 172.21.15.173:0/2026251304 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e00a8700 con 0x7f92e01ef550 2024-04-25T09:13:14.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.861+0000 7f92dcc00640 1 -- 172.21.15.173:0/2026251304 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d8006b60 con 0x7f92e01ef550 2024-04-25T09:13:14.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.861+0000 7f92e7800640 1 -- 172.21.15.173:0/2026251304 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e00a8cc0 con 0x7f92e01ef550 2024-04-25T09:13:14.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.861+0000 7f92e7800640 1 -- 172.21.15.173:0/2026251304 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e0073a40 con 0x7f92e01ef550 2024-04-25T09:13:14.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.861+0000 7f92dcc00640 1 -- 172.21.15.173:0/2026251304 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f92d8006d00 con 0x7f92e01ef550 2024-04-25T09:13:14.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.861+0000 7f92dcc00640 1 --2- 172.21.15.173:0/2026251304 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92c0066f60 0x7f92c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.861+0000 7f92dcc00640 1 -- 172.21.15.173:0/2026251304 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f92d811eac0 con 0x7f92e01ef550 2024-04-25T09:13:14.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.861+0000 7f92e4e00640 1 --2- 172.21.15.173:0/2026251304 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92c0066f60 0x7f92c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.861+0000 7f92e4e00640 1 --2- 172.21.15.173:0/2026251304 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92c0066f60 0x7f92c0069420 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009b60 tx=0x7f92d0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:14.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:14.865+0000 7f92dcc00640 1 -- 172.21.15.173:0/2026251304 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f92d80b8060 con 0x7f92e01ef550 2024-04-25T09:13:15.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:15.053+0000 7f92e7800640 1 -- 172.21.15.173:0/2026251304 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92e006c300 con 0x7f92e01ef550 2024-04-25T09:13:15.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:15.053+0000 7f92dcc00640 1 -- 172.21.15.173:0/2026251304 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f92d8016490 con 0x7f92e01ef550 2024-04-25T09:13:15.038 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:15.038 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":89,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":9408,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1841246276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1841246276},{"type":"v1","addr":"172.21.15.173:6835","nonce":1841246276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:34.472510+0000","modified":"2024-04-25T09:12:37.491581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9411":{"gid":9411,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3627798672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3627798672},{"type":"v1","addr":"172.21.15.173:6837","nonce":3627798672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:13:15.038 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 89 2024-04-25T09:13:15.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:15.053+0000 7f92e7800640 1 -- 172.21.15.173:0/2026251304 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92c0066f60 msgr2=0x7f92c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:15.053+0000 7f92e7800640 1 --2- 172.21.15.173:0/2026251304 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92c0066f60 0x7f92c0069420 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009b60 tx=0x7f92d0009190 comp rx=0 tx=0).stop 2024-04-25T09:13:15.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:15.053+0000 7f92e7800640 1 -- 172.21.15.173:0/2026251304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92e01ef550 msgr2=0x7f92e0140370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:15.053+0000 7f92e7800640 1 --2- 172.21.15.173:0/2026251304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92e01ef550 0x7f92e0140370 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f92d801cc60 tx=0x7f92c4005840 comp rx=0 tx=0).stop 2024-04-25T09:13:15.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:15.053+0000 7f92e7800640 1 -- 172.21.15.173:0/2026251304 shutdown_connections 2024-04-25T09:13:15.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:15.053+0000 7f92e7800640 1 --2- 172.21.15.173:0/2026251304 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f92c0066f60 0x7f92c0069420 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:15.053+0000 7f92e7800640 1 --2- 172.21.15.173:0/2026251304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92e01ef550 0x7f92e0140370 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:15.053+0000 7f92e7800640 1 --2- 172.21.15.173:0/2026251304 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92e01ef0d0 0x7f92e013fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:15.053+0000 7f92e7800640 1 --2- 172.21.15.173:0/2026251304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c40051d0 0x7f92e00aad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:15.053+0000 7f92e7800640 1 -- 172.21.15.173:0/2026251304 >> 172.21.15.173:0/2026251304 conn(0x7f92e006ac90 msgr2=0x7f92e0071320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:15.053+0000 7f92e7800640 1 -- 172.21.15.173:0/2026251304 shutdown_connections 2024-04-25T09:13:15.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:15.053+0000 7f92e7800640 1 -- 172.21.15.173:0/2026251304 wait complete. 2024-04-25T09:13:15.059 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-04-25T09:13:15.435 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:13:15.439 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:13:20.060 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:20.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.221+0000 7f3f80c00640 1 Processor -- start 2024-04-25T09:13:20.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.221+0000 7f3f80c00640 1 -- start start 2024-04-25T09:13:20.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.221+0000 7f3f80c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3f7c0b3e70 0x7f3f7c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:20.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.221+0000 7f3f80c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f7c0aefa0 0x7f3f7c0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:20.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.221+0000 7f3f80c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f7c0b4790 con 0x7f3f7c15edd0 2024-04-25T09:13:20.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.221+0000 7f3f80c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f7c06dd50 con 0x7f3f7c0b3e70 2024-04-25T09:13:20.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.221+0000 7f3f80c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c15f320 con 0x7f3f7c0aefa0 2024-04-25T09:13:20.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.225+0000 7f3f7a800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f3f7c15edd0 0x7f3f7c0b2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45510/0 (socket says 172.21.15.173:45510) 2024-04-25T09:13:20.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.225+0000 7f3f7a800640 1 -- 172.21.15.173:0/3514320294 learned_addr learned my addr 172.21.15.173:0/3514320294 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:20.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.225+0000 7f3f79e00640 1 --2- 172.21.15.173:0/3514320294 >> v2:172.21.15.194:3300/0 conn(0x7f3f7c0b3e70 0x7f3f7c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:20.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.225+0000 7f3f79400640 1 --2- 172.21.15.173:0/3514320294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f7c0aefa0 0x7f3f7c0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:20.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.225+0000 7f3f78a00640 1 -- 172.21.15.173:0/3514320294 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18749819 0 0) 0x7f3f7c0b4790 con 0x7f3f7c15edd0 2024-04-25T09:13:20.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.225+0000 7f3f78a00640 1 -- 172.21.15.173:0/3514320294 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f60003530 con 0x7f3f7c15edd0 2024-04-25T09:13:20.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.225+0000 7f3f79400640 1 -- 172.21.15.173:0/3514320294 >> v2:172.21.15.194:3300/0 conn(0x7f3f7c0b3e70 msgr2=0x7f3f7c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:20.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.225+0000 7f3f79400640 1 --2- 172.21.15.173:0/3514320294 >> v2:172.21.15.194:3300/0 conn(0x7f3f7c0b3e70 0x7f3f7c0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:20.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.225+0000 7f3f79400640 1 -- 172.21.15.173:0/3514320294 >> v1:172.21.15.173:6789/0 conn(0x7f3f7c15edd0 legacy=0x7f3f7c0b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:20.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.225+0000 7f3f79400640 1 -- 172.21.15.173:0/3514320294 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c06d420 con 0x7f3f7c0aefa0 2024-04-25T09:13:20.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.225+0000 7f3f79e00640 1 --2- 172.21.15.173:0/3514320294 >> v2:172.21.15.194:3300/0 conn(0x7f3f7c0b3e70 0x7f3f7c0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:20.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.225+0000 7f3f79400640 1 --2- 172.21.15.173:0/3514320294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f7c0aefa0 0x7f3f7c0b2770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3f680097c0 tx=0x7f3f6801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a799b7661b4aee97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:20.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f78a00640 1 -- 172.21.15.173:0/3514320294 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f680aa5f0 con 0x7f3f7c0aefa0 2024-04-25T09:13:20.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f78a00640 1 -- 172.21.15.173:0/3514320294 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f680af070 con 0x7f3f7c0aefa0 2024-04-25T09:13:20.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f78a00640 1 -- 172.21.15.173:0/3514320294 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f680aa990 con 0x7f3f7c0aefa0 2024-04-25T09:13:20.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f80c00640 1 -- 172.21.15.173:0/3514320294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f7c0aefa0 msgr2=0x7f3f7c0b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:20.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f80c00640 1 --2- 172.21.15.173:0/3514320294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f7c0aefa0 0x7f3f7c0b2770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3f680097c0 tx=0x7f3f6801c470 comp rx=0 tx=0).stop 2024-04-25T09:13:20.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f80c00640 1 -- 172.21.15.173:0/3514320294 shutdown_connections 2024-04-25T09:13:20.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f80c00640 1 --2- 172.21.15.173:0/3514320294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f7c0aefa0 0x7f3f7c0b2770 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:20.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f80c00640 1 --2- 172.21.15.173:0/3514320294 >> v2:172.21.15.194:3300/0 conn(0x7f3f7c0b3e70 0x7f3f7c0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:20.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f80c00640 1 -- 172.21.15.173:0/3514320294 >> 172.21.15.173:0/3514320294 conn(0x7f3f7c06ac90 msgr2=0x7f3f7c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:20.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f80c00640 1 -- 172.21.15.173:0/3514320294 shutdown_connections 2024-04-25T09:13:20.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f80c00640 1 -- 172.21.15.173:0/3514320294 wait complete. 2024-04-25T09:13:20.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f80c00640 1 Processor -- start 2024-04-25T09:13:20.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f80c00640 1 -- start start 2024-04-25T09:13:20.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f80c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f7c0aefa0 0x7f3f7c14f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:20.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f80c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f7c0b3e70 0x7f3f7c14b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:20.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f80c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f7c15edd0 0x7f3f7c149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:20.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f80c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c06e1c0 con 0x7f3f7c0b3e70 2024-04-25T09:13:20.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f80c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c15aba0 con 0x7f3f7c0aefa0 2024-04-25T09:13:20.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f80c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c06e340 con 0x7f3f7c15edd0 2024-04-25T09:13:20.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f79400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f7c0b3e70 0x7f3f7c14b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:20.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f79400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f7c0b3e70 0x7f3f7c14b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35320/0 (socket says 172.21.15.173:35320) 2024-04-25T09:13:20.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f79400640 1 -- 172.21.15.173:0/2146563071 learned_addr learned my addr 172.21.15.173:0/2146563071 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:20.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.229+0000 7f3f79e00640 1 --2- 172.21.15.173:0/2146563071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f7c0aefa0 0x7f3f7c14f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:20.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.233+0000 7f3f7a800640 1 --2- 172.21.15.173:0/2146563071 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f7c15edd0 0x7f3f7c149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:20.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.233+0000 7f3f79400640 1 -- 172.21.15.173:0/2146563071 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f7c15edd0 msgr2=0x7f3f7c149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:20.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.233+0000 7f3f79400640 1 --2- 172.21.15.173:0/2146563071 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f7c15edd0 0x7f3f7c149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:20.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.233+0000 7f3f79400640 1 -- 172.21.15.173:0/2146563071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f7c0aefa0 msgr2=0x7f3f7c14f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:20.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.233+0000 7f3f79400640 1 --2- 172.21.15.173:0/2146563071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f7c0aefa0 0x7f3f7c14f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:20.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.233+0000 7f3f79400640 1 -- 172.21.15.173:0/2146563071 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c14f920 con 0x7f3f7c0b3e70 2024-04-25T09:13:20.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.233+0000 7f3f79400640 1 --2- 172.21.15.173:0/2146563071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f7c0b3e70 0x7f3f7c14b060 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f3f680ac040 tx=0x7f3f6801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:20.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.233+0000 7f3f72000640 1 -- 172.21.15.173:0/2146563071 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68006e20 con 0x7f3f7c0b3e70 2024-04-25T09:13:20.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.233+0000 7f3f72000640 1 -- 172.21.15.173:0/2146563071 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f680be410 con 0x7f3f7c0b3e70 2024-04-25T09:13:20.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.233+0000 7f3f72000640 1 -- 172.21.15.173:0/2146563071 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f680be7c0 con 0x7f3f7c0b3e70 2024-04-25T09:13:20.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.233+0000 7f3f80c00640 1 -- 172.21.15.173:0/2146563071 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f7c14baf0 con 0x7f3f7c0b3e70 2024-04-25T09:13:20.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.233+0000 7f3f80c00640 1 -- 172.21.15.173:0/2146563071 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7c152030 con 0x7f3f7c0b3e70 2024-04-25T09:13:20.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.233+0000 7f3f80c00640 1 -- 172.21.15.173:0/2146563071 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7c073a40 con 0x7f3f7c0b3e70 2024-04-25T09:13:20.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.233+0000 7f3f72000640 1 -- 172.21.15.173:0/2146563071 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3f680bc020 con 0x7f3f7c0b3e70 2024-04-25T09:13:20.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.233+0000 7f3f72000640 1 --2- 172.21.15.173:0/2146563071 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f5c066f90 0x7f3f5c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:20.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.237+0000 7f3f72000640 1 -- 172.21.15.173:0/2146563071 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3f6811ee30 con 0x7f3f7c0b3e70 2024-04-25T09:13:20.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.237+0000 7f3f79e00640 1 --2- 172.21.15.173:0/2146563071 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f5c066f90 0x7f3f5c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:20.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.237+0000 7f3f79e00640 1 --2- 172.21.15.173:0/2146563071 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f5c066f90 0x7f3f5c069450 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009580 tx=0x7f3f6c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:20.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.241+0000 7f3f72000640 1 -- 172.21.15.173:0/2146563071 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3f680c5070 con 0x7f3f7c0b3e70 2024-04-25T09:13:20.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.425+0000 7f3f80c00640 1 -- 172.21.15.173:0/2146563071 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f7c06e540 con 0x7f3f7c0b3e70 2024-04-25T09:13:20.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.425+0000 7f3f72000640 1 -- 172.21.15.173:0/2146563071 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f3f68016090 con 0x7f3f7c0b3e70 2024-04-25T09:13:20.410 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:20.410 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":89,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":9408,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1841246276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1841246276},{"type":"v1","addr":"172.21.15.173:6835","nonce":1841246276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:34.472510+0000","modified":"2024-04-25T09:12:37.491581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9411":{"gid":9411,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3627798672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3627798672},{"type":"v1","addr":"172.21.15.173:6837","nonce":3627798672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:13:20.410 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 89 2024-04-25T09:13:20.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.425+0000 7f3f80c00640 1 -- 172.21.15.173:0/2146563071 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f5c066f90 msgr2=0x7f3f5c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:20.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.425+0000 7f3f80c00640 1 --2- 172.21.15.173:0/2146563071 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f5c066f90 0x7f3f5c069450 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009580 tx=0x7f3f6c009190 comp rx=0 tx=0).stop 2024-04-25T09:13:20.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.425+0000 7f3f80c00640 1 -- 172.21.15.173:0/2146563071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f7c0b3e70 msgr2=0x7f3f7c14b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:20.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.425+0000 7f3f80c00640 1 --2- 172.21.15.173:0/2146563071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f7c0b3e70 0x7f3f7c14b060 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f3f680ac040 tx=0x7f3f6801acb0 comp rx=0 tx=0).stop 2024-04-25T09:13:20.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.425+0000 7f3f80c00640 1 -- 172.21.15.173:0/2146563071 shutdown_connections 2024-04-25T09:13:20.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.425+0000 7f3f80c00640 1 --2- 172.21.15.173:0/2146563071 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3f5c066f90 0x7f3f5c069450 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:20.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.425+0000 7f3f80c00640 1 --2- 172.21.15.173:0/2146563071 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f7c15edd0 0x7f3f7c149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:20.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.425+0000 7f3f80c00640 1 --2- 172.21.15.173:0/2146563071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f7c0b3e70 0x7f3f7c14b060 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:20.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.425+0000 7f3f80c00640 1 --2- 172.21.15.173:0/2146563071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f7c0aefa0 0x7f3f7c14f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:20.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.425+0000 7f3f80c00640 1 -- 172.21.15.173:0/2146563071 >> 172.21.15.173:0/2146563071 conn(0x7f3f7c06ac90 msgr2=0x7f3f7c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:20.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.425+0000 7f3f80c00640 1 -- 172.21.15.173:0/2146563071 shutdown_connections 2024-04-25T09:13:20.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:20.425+0000 7f3f80c00640 1 -- 172.21.15.173:0/2146563071 wait complete. 2024-04-25T09:13:20.432 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-04-25T09:13:25.433 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:25.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.597+0000 7f9e68000640 1 Processor -- start 2024-04-25T09:13:25.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.597+0000 7f9e68000640 1 -- start start 2024-04-25T09:13:25.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.597+0000 7f9e68000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e600b3e70 0x7f9e600b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:25.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.597+0000 7f9e68000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9e600aefa0 0x7f9e600b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:25.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.597+0000 7f9e68000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9e6015edd0 0x7f9e600b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:25.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.597+0000 7f9e68000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6006dd50 con 0x7f9e6015edd0 2024-04-25T09:13:25.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.597+0000 7f9e68000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e600b4790 con 0x7f9e600aefa0 2024-04-25T09:13:25.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.597+0000 7f9e68000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6015f320 con 0x7f9e600b3e70 2024-04-25T09:13:25.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.597+0000 7f9e66000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9e6015edd0 0x7f9e600b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:25.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.597+0000 7f9e66000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9e6015edd0 0x7f9e600b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35804/0 (socket says 172.21.15.173:35804) 2024-04-25T09:13:25.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.597+0000 7f9e66000640 1 -- 172.21.15.173:0/2106784822 learned_addr learned my addr 172.21.15.173:0/2106784822 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:25.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e65600640 1 --2- 172.21.15.173:0/2106784822 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e600b3e70 0x7f9e600b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:25.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e64c00640 1 --2- 172.21.15.173:0/2106784822 >> v2:172.21.15.194:3300/0 conn(0x7f9e600aefa0 0x7f9e600b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:25.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e66000640 1 -- 172.21.15.173:0/2106784822 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e600b3e70 msgr2=0x7f9e600b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:25.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e66000640 1 --2- 172.21.15.173:0/2106784822 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e600b3e70 0x7f9e600b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:25.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e66000640 1 -- 172.21.15.173:0/2106784822 >> v2:172.21.15.194:3300/0 conn(0x7f9e600aefa0 msgr2=0x7f9e600b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:25.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e66000640 1 --2- 172.21.15.173:0/2106784822 >> v2:172.21.15.194:3300/0 conn(0x7f9e600aefa0 0x7f9e600b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:25.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e66000640 1 -- 172.21.15.173:0/2106784822 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6006d420 con 0x7f9e6015edd0 2024-04-25T09:13:25.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e64c00640 1 --2- 172.21.15.173:0/2106784822 >> v2:172.21.15.194:3300/0 conn(0x7f9e600aefa0 0x7f9e600b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:25.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e66000640 1 --2- 172.21.15.173:0/2106784822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e6015edd0 0x7f9e600b2cb0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f9e60062550 tx=0x7f9e5801ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c919b7164cd87a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:25.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e5fe00640 1 -- 172.21.15.173:0/2106784822 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5800b2d0 con 0x7f9e6015edd0 2024-04-25T09:13:25.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e5fe00640 1 -- 172.21.15.173:0/2106784822 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5800b470 con 0x7f9e6015edd0 2024-04-25T09:13:25.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e5fe00640 1 -- 172.21.15.173:0/2106784822 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e580a7b90 con 0x7f9e6015edd0 2024-04-25T09:13:25.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e68000640 1 -- 172.21.15.173:0/2106784822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e6015edd0 msgr2=0x7f9e600b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:25.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e68000640 1 --2- 172.21.15.173:0/2106784822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e6015edd0 0x7f9e600b2cb0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f9e60062550 tx=0x7f9e5801ebc0 comp rx=0 tx=0).stop 2024-04-25T09:13:25.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e68000640 1 -- 172.21.15.173:0/2106784822 shutdown_connections 2024-04-25T09:13:25.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e68000640 1 --2- 172.21.15.173:0/2106784822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e6015edd0 0x7f9e600b2cb0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:25.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e68000640 1 --2- 172.21.15.173:0/2106784822 >> v2:172.21.15.194:3300/0 conn(0x7f9e600aefa0 0x7f9e600b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e68000640 1 --2- 172.21.15.173:0/2106784822 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e600b3e70 0x7f9e600b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.601+0000 7f9e68000640 1 -- 172.21.15.173:0/2106784822 >> 172.21.15.173:0/2106784822 conn(0x7f9e6006ac90 msgr2=0x7f9e6006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e68000640 1 -- 172.21.15.173:0/2106784822 shutdown_connections 2024-04-25T09:13:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e68000640 1 -- 172.21.15.173:0/2106784822 wait complete. 2024-04-25T09:13:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e68000640 1 Processor -- start 2024-04-25T09:13:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e68000640 1 -- start start 2024-04-25T09:13:25.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e68000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e600aefa0 0x7f9e600ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e68000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e600b3e70 0x7f9e60142770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e68000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e6015edd0 0x7f9e6014e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e68000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6006e1c0 con 0x7f9e600b3e70 2024-04-25T09:13:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e68000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e600b3600 con 0x7f9e6015edd0 2024-04-25T09:13:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e68000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6006e340 con 0x7f9e600aefa0 2024-04-25T09:13:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e64c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e600b3e70 0x7f9e60142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e64c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e600b3e70 0x7f9e60142770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35810/0 (socket says 172.21.15.173:35810) 2024-04-25T09:13:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e64c00640 1 -- 172.21.15.173:0/4056244201 learned_addr learned my addr 172.21.15.173:0/4056244201 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e65600640 1 --2- 172.21.15.173:0/4056244201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e600aefa0 0x7f9e600ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e66000640 1 --2- 172.21.15.173:0/4056244201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e6015edd0 0x7f9e6014e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e65600640 1 -- 172.21.15.173:0/4056244201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e6015edd0 msgr2=0x7f9e6014e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e65600640 1 --2- 172.21.15.173:0/4056244201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e6015edd0 0x7f9e6014e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e65600640 1 -- 172.21.15.173:0/4056244201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e600b3e70 msgr2=0x7f9e60142770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:25.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e65600640 1 --2- 172.21.15.173:0/4056244201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e600b3e70 0x7f9e60142770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:25.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e65600640 1 -- 172.21.15.173:0/4056244201 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e600afa60 con 0x7f9e600aefa0 2024-04-25T09:13:25.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.605+0000 7f9e65600640 1 --2- 172.21.15.173:0/4056244201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e600aefa0 0x7f9e600ac8c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400d600 tx=0x7f9e5400dac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:25.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.609+0000 7f9e5d600640 1 -- 172.21.15.173:0/4056244201 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e540125f0 con 0x7f9e600aefa0 2024-04-25T09:13:25.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.609+0000 7f9e5d600640 1 -- 172.21.15.173:0/4056244201 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e54019070 con 0x7f9e600aefa0 2024-04-25T09:13:25.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.609+0000 7f9e5d600640 1 -- 172.21.15.173:0/4056244201 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e540129b0 con 0x7f9e600aefa0 2024-04-25T09:13:25.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.609+0000 7f9e68000640 1 -- 172.21.15.173:0/4056244201 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6015c8f0 con 0x7f9e600aefa0 2024-04-25T09:13:25.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.609+0000 7f9e68000640 1 -- 172.21.15.173:0/4056244201 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e6015ceb0 con 0x7f9e600aefa0 2024-04-25T09:13:25.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.609+0000 7f9e68000640 1 -- 172.21.15.173:0/4056244201 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e60073a40 con 0x7f9e600aefa0 2024-04-25T09:13:25.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.609+0000 7f9e5d600640 1 -- 172.21.15.173:0/4056244201 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9e54012b50 con 0x7f9e600aefa0 2024-04-25T09:13:25.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.609+0000 7f9e5d600640 1 --2- 172.21.15.173:0/4056244201 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9e40066f60 0x7f9e40069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:25.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.609+0000 7f9e5d600640 1 -- 172.21.15.173:0/4056244201 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9e54085430 con 0x7f9e600aefa0 2024-04-25T09:13:25.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.609+0000 7f9e64c00640 1 --2- 172.21.15.173:0/4056244201 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9e40066f60 0x7f9e40069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:25.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.609+0000 7f9e64c00640 1 --2- 172.21.15.173:0/4056244201 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9e40066f60 0x7f9e40069420 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9e60143a80 tx=0x7f9e4c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:25.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.613+0000 7f9e5d600640 1 -- 172.21.15.173:0/4056244201 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9e54055bd0 con 0x7f9e600aefa0 2024-04-25T09:13:25.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.805+0000 7f9e68000640 1 -- 172.21.15.173:0/4056244201 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e6015e120 con 0x7f9e600aefa0 2024-04-25T09:13:25.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.805+0000 7f9e5d600640 1 -- 172.21.15.173:0/4056244201 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f9e54059c70 con 0x7f9e600aefa0 2024-04-25T09:13:25.789 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:25.790 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":89,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":9408,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1841246276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1841246276},{"type":"v1","addr":"172.21.15.173:6835","nonce":1841246276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:34.472510+0000","modified":"2024-04-25T09:12:37.491581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9411":{"gid":9411,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.173:6837/3627798672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3627798672},{"type":"v1","addr":"172.21.15.173:6837","nonce":3627798672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:13:25.790 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 89 2024-04-25T09:13:25.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.805+0000 7f9e68000640 1 -- 172.21.15.173:0/4056244201 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9e40066f60 msgr2=0x7f9e40069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:25.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.805+0000 7f9e68000640 1 --2- 172.21.15.173:0/4056244201 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9e40066f60 0x7f9e40069420 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9e60143a80 tx=0x7f9e4c008040 comp rx=0 tx=0).stop 2024-04-25T09:13:25.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.805+0000 7f9e68000640 1 -- 172.21.15.173:0/4056244201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e600aefa0 msgr2=0x7f9e600ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:25.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.805+0000 7f9e68000640 1 --2- 172.21.15.173:0/4056244201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e600aefa0 0x7f9e600ac8c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400d600 tx=0x7f9e5400dac0 comp rx=0 tx=0).stop 2024-04-25T09:13:25.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.805+0000 7f9e68000640 1 -- 172.21.15.173:0/4056244201 shutdown_connections 2024-04-25T09:13:25.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.805+0000 7f9e68000640 1 --2- 172.21.15.173:0/4056244201 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9e40066f60 0x7f9e40069420 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:25.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.805+0000 7f9e68000640 1 --2- 172.21.15.173:0/4056244201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e6015edd0 0x7f9e6014e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:25.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.805+0000 7f9e68000640 1 --2- 172.21.15.173:0/4056244201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e600b3e70 0x7f9e60142770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:25.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.805+0000 7f9e68000640 1 --2- 172.21.15.173:0/4056244201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e600aefa0 0x7f9e600ac8c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:25.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.805+0000 7f9e68000640 1 -- 172.21.15.173:0/4056244201 >> 172.21.15.173:0/4056244201 conn(0x7f9e6006ac90 msgr2=0x7f9e600cff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:25.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.805+0000 7f9e68000640 1 -- 172.21.15.173:0/4056244201 shutdown_connections 2024-04-25T09:13:25.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:25.805+0000 7f9e68000640 1 -- 172.21.15.173:0/4056244201 wait complete. 2024-04-25T09:13:25.811 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-04-25T09:13:30.812 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:30.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.965+0000 7f6d8cc00640 1 Processor -- start 2024-04-25T09:13:30.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.969+0000 7f6d8cc00640 1 -- start start 2024-04-25T09:13:30.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.969+0000 7f6d8cc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6d880cd7e0 0x7f6d880cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:30.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.969+0000 7f6d8cc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6d880d1270 0x7f6d8806cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:30.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.969+0000 7f6d8cc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d88099b30 0x7f6d88099fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:30.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.969+0000 7f6d8cc00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d880cffa0 con 0x7f6d880d1270 2024-04-25T09:13:30.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.969+0000 7f6d8cc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d880d01d0 con 0x7f6d880cd7e0 2024-04-25T09:13:30.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.969+0000 7f6d8cc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d880d04b0 con 0x7f6d88099b30 2024-04-25T09:13:30.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.969+0000 7f6d85400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6d880d1270 0x7f6d8806cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:30.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.969+0000 7f6d85400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6d880d1270 0x7f6d8806cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35816/0 (socket says 172.21.15.173:35816) 2024-04-25T09:13:30.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.969+0000 7f6d85400640 1 -- 172.21.15.173:0/749739825 learned_addr learned my addr 172.21.15.173:0/749739825 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:30.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.969+0000 7f6d86800640 1 --2- 172.21.15.173:0/749739825 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d88099b30 0x7f6d88099fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:30.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.969+0000 7f6d85e00640 1 --2- 172.21.15.173:0/749739825 >> v2:172.21.15.194:3300/0 conn(0x7f6d880cd7e0 0x7f6d880cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:30.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.969+0000 7f6d85400640 1 -- 172.21.15.173:0/749739825 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d88099b30 msgr2=0x7f6d88099fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:30.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.969+0000 7f6d85400640 1 --2- 172.21.15.173:0/749739825 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d88099b30 0x7f6d88099fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:30.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.969+0000 7f6d85400640 1 -- 172.21.15.173:0/749739825 >> v2:172.21.15.194:3300/0 conn(0x7f6d880cd7e0 msgr2=0x7f6d880cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:30.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.969+0000 7f6d85400640 1 --2- 172.21.15.173:0/749739825 >> v2:172.21.15.194:3300/0 conn(0x7f6d880cd7e0 0x7f6d880cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:30.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.969+0000 7f6d85400640 1 -- 172.21.15.173:0/749739825 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d880d0790 con 0x7f6d880d1270 2024-04-25T09:13:30.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.973+0000 7f6d85400640 1 --2- 172.21.15.173:0/749739825 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d880d1270 0x7f6d8806cb50 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f6d88072860 tx=0x7f6d7001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893e3fb8869c2d27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:30.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.973+0000 7f6d84a00640 1 -- 172.21.15.173:0/749739825 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d700b1070 con 0x7f6d880d1270 2024-04-25T09:13:30.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.973+0000 7f6d84a00640 1 -- 172.21.15.173:0/749739825 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d700ac630 con 0x7f6d880d1270 2024-04-25T09:13:30.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.973+0000 7f6d84a00640 1 -- 172.21.15.173:0/749739825 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d700a8050 con 0x7f6d880d1270 2024-04-25T09:13:30.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.973+0000 7f6d8cc00640 1 -- 172.21.15.173:0/749739825 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d880d1270 msgr2=0x7f6d8806cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:30.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.973+0000 7f6d8cc00640 1 --2- 172.21.15.173:0/749739825 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d880d1270 0x7f6d8806cb50 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f6d88072860 tx=0x7f6d7001c520 comp rx=0 tx=0).stop 2024-04-25T09:13:30.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.973+0000 7f6d8cc00640 1 -- 172.21.15.173:0/749739825 shutdown_connections 2024-04-25T09:13:30.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.973+0000 7f6d8cc00640 1 --2- 172.21.15.173:0/749739825 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d88099b30 0x7f6d88099fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:30.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.973+0000 7f6d8cc00640 1 --2- 172.21.15.173:0/749739825 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d880d1270 0x7f6d8806cb50 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:30.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.973+0000 7f6d8cc00640 1 --2- 172.21.15.173:0/749739825 >> v2:172.21.15.194:3300/0 conn(0x7f6d880cd7e0 0x7f6d880cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:30.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.973+0000 7f6d8cc00640 1 -- 172.21.15.173:0/749739825 >> 172.21.15.173:0/749739825 conn(0x7f6d880b33a0 msgr2=0x7f6d880b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:30.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.973+0000 7f6d8cc00640 1 -- 172.21.15.173:0/749739825 shutdown_connections 2024-04-25T09:13:30.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.973+0000 7f6d8cc00640 1 -- 172.21.15.173:0/749739825 wait complete. 2024-04-25T09:13:30.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.973+0000 7f6d8cc00640 1 Processor -- start 2024-04-25T09:13:30.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.973+0000 7f6d8cc00640 1 -- start start 2024-04-25T09:13:30.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d8cc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d88099b30 0x7f6d88159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:30.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d8cc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d880cd7e0 0x7f6d880af960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:30.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d8cc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d880d1270 0x7f6d88152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:30.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d8cc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d880cdd40 con 0x7f6d880d1270 2024-04-25T09:13:30.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d8cc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d880cdbc0 con 0x7f6d880cd7e0 2024-04-25T09:13:30.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d8cc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8815dd30 con 0x7f6d88099b30 2024-04-25T09:13:30.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d86800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d880d1270 0x7f6d88152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:30.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d85e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d88099b30 0x7f6d88159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:30.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d85e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d88099b30 0x7f6d88159680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:48110/0 (socket says 172.21.15.173:48110) 2024-04-25T09:13:30.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d85400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d880cd7e0 0x7f6d880af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:30.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d86800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d880d1270 0x7f6d88152fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35822/0 (socket says 172.21.15.173:35822) 2024-04-25T09:13:30.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d85e00640 1 -- 172.21.15.173:0/2595671310 learned_addr learned my addr 172.21.15.173:0/2595671310 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:30.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d86800640 1 -- 172.21.15.173:0/2595671310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d88099b30 msgr2=0x7f6d88159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:30.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d86800640 1 --2- 172.21.15.173:0/2595671310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d88099b30 0x7f6d88159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:30.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d86800640 1 -- 172.21.15.173:0/2595671310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d880cd7e0 msgr2=0x7f6d880af960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:30.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d86800640 1 --2- 172.21.15.173:0/2595671310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d880cd7e0 0x7f6d880af960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:30.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d86800640 1 -- 172.21.15.173:0/2595671310 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d88158cf0 con 0x7f6d880d1270 2024-04-25T09:13:30.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d86800640 1 --2- 172.21.15.173:0/2595671310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d880d1270 0x7f6d88152fd0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f6d80007d40 tx=0x7f6d8000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:30.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d7e000640 1 -- 172.21.15.173:0/2595671310 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80019070 con 0x7f6d880d1270 2024-04-25T09:13:30.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d7e000640 1 -- 172.21.15.173:0/2595671310 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d800039a0 con 0x7f6d880d1270 2024-04-25T09:13:30.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d7e000640 1 -- 172.21.15.173:0/2595671310 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80003db0 con 0x7f6d880d1270 2024-04-25T09:13:30.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d8cc00640 1 -- 172.21.15.173:0/2595671310 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d88158fd0 con 0x7f6d880d1270 2024-04-25T09:13:30.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d8cc00640 1 -- 172.21.15.173:0/2595671310 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d88159bc0 con 0x7f6d880d1270 2024-04-25T09:13:30.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d8cc00640 1 -- 172.21.15.173:0/2595671310 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d88073a40 con 0x7f6d880d1270 2024-04-25T09:13:30.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.977+0000 7f6d7e000640 1 -- 172.21.15.173:0/2595671310 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6d8001c070 con 0x7f6d880d1270 2024-04-25T09:13:30.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.981+0000 7f6d7e000640 1 --2- 172.21.15.173:0/2595671310 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d64066f60 0x7f6d64069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:30.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.981+0000 7f6d7e000640 1 -- 172.21.15.173:0/2595671310 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f6d80084f10 con 0x7f6d880d1270 2024-04-25T09:13:30.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.981+0000 7f6d85e00640 1 --2- 172.21.15.173:0/2595671310 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d64066f60 0x7f6d64069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:30.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.981+0000 7f6d85e00640 1 --2- 172.21.15.173:0/2595671310 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d64066f60 0x7f6d64069420 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6d880b3860 tx=0x7f6d78008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:30.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:30.985+0000 7f6d7e000640 1 -- 172.21.15.173:0/2595671310 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6d800556e0 con 0x7f6d880d1270 2024-04-25T09:13:31.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:31.173+0000 7f6d8cc00640 1 -- 172.21.15.173:0/2595671310 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d880b0320 con 0x7f6d880d1270 2024-04-25T09:13:31.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:31.177+0000 7f6d7e000640 1 -- 172.21.15.173:0/2595671310 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4160 (secure 0 0 0) 0x7f6d80059780 con 0x7f6d880d1270 2024-04-25T09:13:31.160 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:31.161 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":90,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:34.472510+0000","modified":"2024-04-25T09:13:30.512627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9408":{"gid":9408,"name":"c","rank":0,"incarnation":90,"state":"up:replay","state_seq":1,"addr":"172.21.15.173:6835/1841246276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1841246276},{"type":"v1","addr":"172.21.15.173:6835","nonce":1841246276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:13:31.161 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 90 2024-04-25T09:13:31.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:31.177+0000 7f6d8cc00640 1 -- 172.21.15.173:0/2595671310 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d64066f60 msgr2=0x7f6d64069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:31.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:31.177+0000 7f6d8cc00640 1 --2- 172.21.15.173:0/2595671310 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d64066f60 0x7f6d64069420 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6d880b3860 tx=0x7f6d78008040 comp rx=0 tx=0).stop 2024-04-25T09:13:31.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:31.177+0000 7f6d8cc00640 1 -- 172.21.15.173:0/2595671310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d880d1270 msgr2=0x7f6d88152fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:31.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:31.177+0000 7f6d8cc00640 1 --2- 172.21.15.173:0/2595671310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d880d1270 0x7f6d88152fd0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f6d80007d40 tx=0x7f6d8000e4b0 comp rx=0 tx=0).stop 2024-04-25T09:13:31.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:31.177+0000 7f6d8cc00640 1 -- 172.21.15.173:0/2595671310 shutdown_connections 2024-04-25T09:13:31.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:31.177+0000 7f6d8cc00640 1 --2- 172.21.15.173:0/2595671310 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d64066f60 0x7f6d64069420 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:31.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:31.177+0000 7f6d8cc00640 1 --2- 172.21.15.173:0/2595671310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d880d1270 0x7f6d88152fd0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:31.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:31.177+0000 7f6d8cc00640 1 --2- 172.21.15.173:0/2595671310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d880cd7e0 0x7f6d880af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:31.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:31.177+0000 7f6d8cc00640 1 --2- 172.21.15.173:0/2595671310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d88099b30 0x7f6d88159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:31.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:31.177+0000 7f6d8cc00640 1 -- 172.21.15.173:0/2595671310 >> 172.21.15.173:0/2595671310 conn(0x7f6d880b33a0 msgr2=0x7f6d88161db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:31.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:31.177+0000 7f6d8cc00640 1 -- 172.21.15.173:0/2595671310 shutdown_connections 2024-04-25T09:13:31.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:31.177+0000 7f6d8cc00640 1 -- 172.21.15.173:0/2595671310 wait complete. 2024-04-25T09:13:31.182 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-04-25T09:13:36.060 INFO:tasks.ceph.mds.c.smithi173.stderr:2024-04-25T09:13:36.077+0000 7f3edec00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:13:36.183 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:36.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.345+0000 7f5649200640 1 Processor -- start 2024-04-25T09:13:36.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.345+0000 7f5649200640 1 -- start start 2024-04-25T09:13:36.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.345+0000 7f5649200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f56441583f0 0x7f56440d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:36.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.345+0000 7f5649200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5644162210 0x7f56440d1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:36.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.345+0000 7f5649200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56440cc080 con 0x7f56440cce20 2024-04-25T09:13:36.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.345+0000 7f5649200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5644162650 con 0x7f5644162210 2024-04-25T09:13:36.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.345+0000 7f5649200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5644162870 con 0x7f56441583f0 2024-04-25T09:13:36.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.349+0000 7f5641400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f56440cce20 0x7f5644161b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36064/0 (socket says 172.21.15.173:36064) 2024-04-25T09:13:36.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.349+0000 7f5641400640 1 -- 172.21.15.173:0/1429228698 learned_addr learned my addr 172.21.15.173:0/1429228698 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:36.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.349+0000 7f5642800640 1 --2- 172.21.15.173:0/1429228698 >> v2:172.21.15.173:3300/0 conn(0x7f5644162210 0x7f56440d1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:36.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.349+0000 7f5641e00640 1 --2- 172.21.15.173:0/1429228698 >> v2:172.21.15.194:3300/0 conn(0x7f56441583f0 0x7f56440d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:36.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.349+0000 7f5640a00640 1 -- 172.21.15.173:0/1429228698 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601267269 0 0) 0x7f56440cc080 con 0x7f56440cce20 2024-04-25T09:13:36.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.349+0000 7f5640a00640 1 -- 172.21.15.173:0/1429228698 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5628003530 con 0x7f56440cce20 2024-04-25T09:13:36.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.349+0000 7f5642800640 1 -- 172.21.15.173:0/1429228698 >> v2:172.21.15.194:3300/0 conn(0x7f56441583f0 msgr2=0x7f56440d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:36.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.349+0000 7f5642800640 1 --2- 172.21.15.173:0/1429228698 >> v2:172.21.15.194:3300/0 conn(0x7f56441583f0 0x7f56440d17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.349+0000 7f5642800640 1 -- 172.21.15.173:0/1429228698 >> v1:172.21.15.173:6789/0 conn(0x7f56440cce20 legacy=0x7f5644161b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:36.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.349+0000 7f5642800640 1 -- 172.21.15.173:0/1429228698 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56440cc340 con 0x7f5644162210 2024-04-25T09:13:36.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.349+0000 7f5641e00640 1 --2- 172.21.15.173:0/1429228698 >> v2:172.21.15.194:3300/0 conn(0x7f56441583f0 0x7f56440d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:36.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.349+0000 7f5642800640 1 --2- 172.21.15.173:0/1429228698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5644162210 0x7f56440d1cf0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f5644071fb0 tx=0x7f563c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd6ffbb6504a806 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:36.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.349+0000 7f5640a00640 1 -- 172.21.15.173:0/1429228698 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c0b2070 con 0x7f5644162210 2024-04-25T09:13:36.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.349+0000 7f5640a00640 1 -- 172.21.15.173:0/1429228698 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563c0a59c0 con 0x7f5644162210 2024-04-25T09:13:36.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.349+0000 7f5640a00640 1 -- 172.21.15.173:0/1429228698 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c0a5d90 con 0x7f5644162210 2024-04-25T09:13:36.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5649200640 1 -- 172.21.15.173:0/1429228698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5644162210 msgr2=0x7f56440d1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:36.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5649200640 1 --2- 172.21.15.173:0/1429228698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5644162210 0x7f56440d1cf0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f5644071fb0 tx=0x7f563c01c900 comp rx=0 tx=0).stop 2024-04-25T09:13:36.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5649200640 1 -- 172.21.15.173:0/1429228698 shutdown_connections 2024-04-25T09:13:36.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5649200640 1 --2- 172.21.15.173:0/1429228698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5644162210 0x7f56440d1cf0 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5649200640 1 --2- 172.21.15.173:0/1429228698 >> v2:172.21.15.194:3300/0 conn(0x7f56441583f0 0x7f56440d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5649200640 1 -- 172.21.15.173:0/1429228698 >> 172.21.15.173:0/1429228698 conn(0x7f564406f600 msgr2=0x7f564406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:36.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5649200640 1 -- 172.21.15.173:0/1429228698 shutdown_connections 2024-04-25T09:13:36.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5649200640 1 -- 172.21.15.173:0/1429228698 wait complete. 2024-04-25T09:13:36.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5649200640 1 Processor -- start 2024-04-25T09:13:36.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5649200640 1 -- start start 2024-04-25T09:13:36.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5649200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56440cce20 0x7f5644151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:36.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5649200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56441583f0 0x7f56441610d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:36.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5649200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5644162210 0x7f5644161610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:36.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5649200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56440cea70 con 0x7f56440cce20 2024-04-25T09:13:36.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5649200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56440ce8f0 con 0x7f5644162210 2024-04-25T09:13:36.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5649200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56440cebf0 con 0x7f56441583f0 2024-04-25T09:13:36.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5641e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56440cce20 0x7f5644151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:36.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5641e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56440cce20 0x7f5644151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60662/0 (socket says 172.21.15.173:60662) 2024-04-25T09:13:36.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5641e00640 1 -- 172.21.15.173:0/186986816 learned_addr learned my addr 172.21.15.173:0/186986816 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:36.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5641e00640 1 -- 172.21.15.173:0/186986816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56441583f0 msgr2=0x7f56441610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:36.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5641e00640 1 --2- 172.21.15.173:0/186986816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56441583f0 0x7f56441610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5641e00640 1 -- 172.21.15.173:0/186986816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5644162210 msgr2=0x7f5644161610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:36.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5641e00640 1 --2- 172.21.15.173:0/186986816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5644162210 0x7f5644161610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.353+0000 7f5641e00640 1 -- 172.21.15.173:0/186986816 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56440b6cf0 con 0x7f56440cce20 2024-04-25T09:13:36.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.357+0000 7f5641e00640 1 --2- 172.21.15.173:0/186986816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56440cce20 0x7f5644151a00 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f563400e840 tx=0x7f563400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:36.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.357+0000 7f563a000640 1 -- 172.21.15.173:0/186986816 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634017070 con 0x7f56440cce20 2024-04-25T09:13:36.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.357+0000 7f563a000640 1 -- 172.21.15.173:0/186986816 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563400c8d0 con 0x7f56440cce20 2024-04-25T09:13:36.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.357+0000 7f563a000640 1 -- 172.21.15.173:0/186986816 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563400f040 con 0x7f56440cce20 2024-04-25T09:13:36.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.357+0000 7f5649200640 1 -- 172.21.15.173:0/186986816 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56441605f0 con 0x7f56440cce20 2024-04-25T09:13:36.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.357+0000 7f5649200640 1 -- 172.21.15.173:0/186986816 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56441602a0 con 0x7f56440cce20 2024-04-25T09:13:36.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.357+0000 7f5649200640 1 -- 172.21.15.173:0/186986816 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5644073a40 con 0x7f56440cce20 2024-04-25T09:13:36.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.357+0000 7f563a000640 1 -- 172.21.15.173:0/186986816 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f563401a070 con 0x7f56440cce20 2024-04-25T09:13:36.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.357+0000 7f563a000640 1 --2- 172.21.15.173:0/186986816 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5620066f60 0x7f5620069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:36.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.357+0000 7f563a000640 1 -- 172.21.15.173:0/186986816 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f5634084e70 con 0x7f56440cce20 2024-04-25T09:13:36.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.357+0000 7f5641400640 1 --2- 172.21.15.173:0/186986816 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5620066f60 0x7f5620069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:36.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.361+0000 7f5641400640 1 --2- 172.21.15.173:0/186986816 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5620066f60 0x7f5620069420 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f562c007fd0 tx=0x7f562c007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:36.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.361+0000 7f563a000640 1 -- 172.21.15.173:0/186986816 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5634055c90 con 0x7f56440cce20 2024-04-25T09:13:36.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.549+0000 7f5649200640 1 -- 172.21.15.173:0/186986816 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56440cf650 con 0x7f56440cce20 2024-04-25T09:13:36.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.549+0000 7f563a000640 1 -- 172.21.15.173:0/186986816 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4161 (secure 0 0 0) 0x7f56340510c0 con 0x7f56440cce20 2024-04-25T09:13:36.534 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:36.534 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":93,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:34.472510+0000","modified":"2024-04-25T09:13:32.594395+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9408":{"gid":9408,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":19,"addr":"172.21.15.173:6835/1841246276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1841246276},{"type":"v1","addr":"172.21.15.173:6835","nonce":1841246276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:13:36.535 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 93 2024-04-25T09:13:36.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.553+0000 7f5649200640 1 -- 172.21.15.173:0/186986816 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5620066f60 msgr2=0x7f5620069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:36.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.553+0000 7f5649200640 1 --2- 172.21.15.173:0/186986816 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5620066f60 0x7f5620069420 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f562c007fd0 tx=0x7f562c007900 comp rx=0 tx=0).stop 2024-04-25T09:13:36.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.553+0000 7f5649200640 1 -- 172.21.15.173:0/186986816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56440cce20 msgr2=0x7f5644151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:36.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.553+0000 7f5649200640 1 --2- 172.21.15.173:0/186986816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56440cce20 0x7f5644151a00 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f563400e840 tx=0x7f563400ed00 comp rx=0 tx=0).stop 2024-04-25T09:13:36.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.553+0000 7f5649200640 1 -- 172.21.15.173:0/186986816 shutdown_connections 2024-04-25T09:13:36.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.553+0000 7f5649200640 1 --2- 172.21.15.173:0/186986816 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5620066f60 0x7f5620069420 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.553+0000 7f5649200640 1 --2- 172.21.15.173:0/186986816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5644162210 0x7f5644161610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.553+0000 7f5649200640 1 --2- 172.21.15.173:0/186986816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56441583f0 0x7f56441610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.553+0000 7f5649200640 1 --2- 172.21.15.173:0/186986816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56440cce20 0x7f5644151a00 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.553+0000 7f5649200640 1 -- 172.21.15.173:0/186986816 >> 172.21.15.173:0/186986816 conn(0x7f564406f600 msgr2=0x7f56440b2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:36.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.553+0000 7f5649200640 1 -- 172.21.15.173:0/186986816 shutdown_connections 2024-04-25T09:13:36.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.553+0000 7f5649200640 1 -- 172.21.15.173:0/186986816 wait complete. 2024-04-25T09:13:36.555 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2024-04-25T09:13:36.555 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:36.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.705+0000 7f679b800640 1 Processor -- start 2024-04-25T09:13:36.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.705+0000 7f679b800640 1 -- start start 2024-04-25T09:13:36.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.709+0000 7f679b800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6794145250 0x7f679415c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:36.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.709+0000 7f679b800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f67940cc8b0 0x7f67940ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:36.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.709+0000 7f679b800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f679415cec0 con 0x7f6794071320 2024-04-25T09:13:36.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.709+0000 7f679b800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f679406e7c0 con 0x7f67940cc8b0 2024-04-25T09:13:36.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.709+0000 7f679b800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679406d720 con 0x7f6794145250 2024-04-25T09:13:36.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.709+0000 7f6793e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f67940cc8b0 0x7f67940ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:36.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.709+0000 7f6799800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f6794071320 0x7f6794071790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36076/0 (socket says 172.21.15.173:36076) 2024-04-25T09:13:36.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.709+0000 7f6799800640 1 -- 172.21.15.173:0/1071059614 learned_addr learned my addr 172.21.15.173:0/1071059614 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:36.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.709+0000 7f6793e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f67940cc8b0 0x7f67940ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60666/0 (socket says 172.21.15.173:60666) 2024-04-25T09:13:36.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.709+0000 7f6798e00640 1 --2- 172.21.15.173:0/1071059614 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6794145250 0x7f679415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:36.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.709+0000 7f6793e00640 1 -- 172.21.15.173:0/1071059614 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6794145250 msgr2=0x7f679415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:36.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.709+0000 7f6793e00640 1 --2- 172.21.15.173:0/1071059614 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6794145250 0x7f679415c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.709+0000 7f6793e00640 1 -- 172.21.15.173:0/1071059614 >> v1:172.21.15.173:6789/0 conn(0x7f6794071320 legacy=0x7f6794071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:36.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.709+0000 7f6793e00640 1 -- 172.21.15.173:0/1071059614 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679406da00 con 0x7f67940cc8b0 2024-04-25T09:13:36.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.709+0000 7f6793e00640 1 --2- 172.21.15.173:0/1071059614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67940cc8b0 0x7f67940ccd30 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f67800097c0 tx=0x7f678001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2704ba1ab29a067b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:36.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f6793400640 1 -- 172.21.15.173:0/1071059614 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67800b2070 con 0x7f67940cc8b0 2024-04-25T09:13:36.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f6793400640 1 -- 172.21.15.173:0/1071059614 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67800ad640 con 0x7f67940cc8b0 2024-04-25T09:13:36.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f6793400640 1 -- 172.21.15.173:0/1071059614 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67800ada10 con 0x7f67940cc8b0 2024-04-25T09:13:36.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f679b800640 1 -- 172.21.15.173:0/1071059614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67940cc8b0 msgr2=0x7f67940ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:36.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f679b800640 1 --2- 172.21.15.173:0/1071059614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67940cc8b0 0x7f67940ccd30 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f67800097c0 tx=0x7f678001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f679b800640 1 -- 172.21.15.173:0/1071059614 shutdown_connections 2024-04-25T09:13:36.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f679b800640 1 --2- 172.21.15.173:0/1071059614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67940cc8b0 0x7f67940ccd30 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f679b800640 1 --2- 172.21.15.173:0/1071059614 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6794145250 0x7f679415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f679b800640 1 -- 172.21.15.173:0/1071059614 >> 172.21.15.173:0/1071059614 conn(0x7f679406ac90 msgr2=0x7f679406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:36.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f679b800640 1 -- 172.21.15.173:0/1071059614 shutdown_connections 2024-04-25T09:13:36.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f679b800640 1 -- 172.21.15.173:0/1071059614 wait complete. 2024-04-25T09:13:36.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f679b800640 1 Processor -- start 2024-04-25T09:13:36.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f679b800640 1 -- start start 2024-04-25T09:13:36.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f679b800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6794071320 0x7f679415a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:36.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f679b800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67940cc8b0 0x7f67940ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:36.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f679b800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6794145250 0x7f67940ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:36.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f679b800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679406ef80 con 0x7f6794145250 2024-04-25T09:13:36.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f679b800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6794145630 con 0x7f6794071320 2024-04-25T09:13:36.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f679b800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679406d380 con 0x7f67940cc8b0 2024-04-25T09:13:36.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f6799800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6794145250 0x7f67940ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:36.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f6799800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6794145250 0x7f67940ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60682/0 (socket says 172.21.15.173:60682) 2024-04-25T09:13:36.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.713+0000 7f6799800640 1 -- 172.21.15.173:0/2036955488 learned_addr learned my addr 172.21.15.173:0/2036955488 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:36.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.717+0000 7f6793e00640 1 --2- 172.21.15.173:0/2036955488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67940cc8b0 0x7f67940ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:36.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.717+0000 7f6799800640 1 -- 172.21.15.173:0/2036955488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67940cc8b0 msgr2=0x7f67940ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:36.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.717+0000 7f6799800640 1 --2- 172.21.15.173:0/2036955488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67940cc8b0 0x7f67940ad910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.717+0000 7f6799800640 1 -- 172.21.15.173:0/2036955488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6794071320 msgr2=0x7f679415a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:36.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.717+0000 7f6799800640 1 --2- 172.21.15.173:0/2036955488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6794071320 0x7f679415a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.717+0000 7f6799800640 1 -- 172.21.15.173:0/2036955488 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67941f6b60 con 0x7f6794145250 2024-04-25T09:13:36.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.717+0000 7f6799800640 1 --2- 172.21.15.173:0/2036955488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6794145250 0x7f67940ade50 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f678c00ca80 tx=0x7f678c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:36.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.717+0000 7f6790c00640 1 -- 172.21.15.173:0/2036955488 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c017070 con 0x7f6794145250 2024-04-25T09:13:36.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.717+0000 7f6790c00640 1 -- 172.21.15.173:0/2036955488 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c00ac30 con 0x7f6794145250 2024-04-25T09:13:36.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.717+0000 7f6790c00640 1 -- 172.21.15.173:0/2036955488 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c012600 con 0x7f6794145250 2024-04-25T09:13:36.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.717+0000 7f679b800640 1 -- 172.21.15.173:0/2036955488 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67941f6e20 con 0x7f6794145250 2024-04-25T09:13:36.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.717+0000 7f679b800640 1 -- 172.21.15.173:0/2036955488 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67941f73e0 con 0x7f6794145250 2024-04-25T09:13:36.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.717+0000 7f679b800640 1 -- 172.21.15.173:0/2036955488 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6794073a40 con 0x7f6794145250 2024-04-25T09:13:36.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.717+0000 7f6790c00640 1 -- 172.21.15.173:0/2036955488 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f678c01a070 con 0x7f6794145250 2024-04-25T09:13:36.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.717+0000 7f6790c00640 1 --2- 172.21.15.173:0/2036955488 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6774066f90 0x7f6774069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:36.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.717+0000 7f6790c00640 1 -- 172.21.15.173:0/2036955488 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f678c084e90 con 0x7f6794145250 2024-04-25T09:13:36.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.717+0000 7f6798e00640 1 --2- 172.21.15.173:0/2036955488 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6774066f90 0x7f6774069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:36.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.721+0000 7f6798e00640 1 --2- 172.21.15.173:0/2036955488 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6774066f90 0x7f6774069450 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6784006aa0 tx=0x7f6784006a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:36.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.721+0000 7f6790c00640 1 -- 172.21.15.173:0/2036955488 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f679415cec0 con 0x7f6794145250 2024-04-25T09:13:36.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.913+0000 7f679b800640 1 -- 172.21.15.173:0/2036955488 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6794141cf0 con 0x7f6794145250 2024-04-25T09:13:36.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.913+0000 7f6790c00640 1 -- 172.21.15.173:0/2036955488 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4161 (secure 0 0 0) 0x7f678c086090 con 0x7f6794145250 2024-04-25T09:13:36.898 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:36.898 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":93,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:34.472510+0000","modified":"2024-04-25T09:13:32.594395+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9408":{"gid":9408,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":19,"addr":"172.21.15.173:6835/1841246276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1841246276},{"type":"v1","addr":"172.21.15.173:6835","nonce":1841246276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:13:36.898 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 93 2024-04-25T09:13:36.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.913+0000 7f679b800640 1 -- 172.21.15.173:0/2036955488 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6774066f90 msgr2=0x7f6774069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:36.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.913+0000 7f679b800640 1 --2- 172.21.15.173:0/2036955488 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6774066f90 0x7f6774069450 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6784006aa0 tx=0x7f6784006a30 comp rx=0 tx=0).stop 2024-04-25T09:13:36.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.913+0000 7f679b800640 1 -- 172.21.15.173:0/2036955488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6794145250 msgr2=0x7f67940ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:36.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.913+0000 7f679b800640 1 --2- 172.21.15.173:0/2036955488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6794145250 0x7f67940ade50 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f678c00ca80 tx=0x7f678c00cf40 comp rx=0 tx=0).stop 2024-04-25T09:13:36.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.913+0000 7f679b800640 1 -- 172.21.15.173:0/2036955488 shutdown_connections 2024-04-25T09:13:36.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.913+0000 7f679b800640 1 --2- 172.21.15.173:0/2036955488 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6774066f90 0x7f6774069450 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.913+0000 7f679b800640 1 --2- 172.21.15.173:0/2036955488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6794145250 0x7f67940ade50 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.913+0000 7f679b800640 1 --2- 172.21.15.173:0/2036955488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67940cc8b0 0x7f67940ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.913+0000 7f679b800640 1 --2- 172.21.15.173:0/2036955488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6794071320 0x7f679415a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:36.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.913+0000 7f679b800640 1 -- 172.21.15.173:0/2036955488 >> 172.21.15.173:0/2036955488 conn(0x7f679406ac90 msgr2=0x7f67940b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:36.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.913+0000 7f679b800640 1 -- 172.21.15.173:0/2036955488 shutdown_connections 2024-04-25T09:13:36.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:36.913+0000 7f679b800640 1 -- 172.21.15.173:0/2036955488 wait complete. 2024-04-25T09:13:36.919 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T09:13:36.919 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:13:37.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.069+0000 7f47ed600640 1 Processor -- start 2024-04-25T09:13:37.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.069+0000 7f47ed600640 1 -- start start 2024-04-25T09:13:37.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.069+0000 7f47ed600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f47e8160fe0 0x7f47e8161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:37.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.069+0000 7f47ed600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f47e806dac0 0x7f47e80ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:37.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.069+0000 7f47ed600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47e806bca0 0x7f47e806c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:37.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.069+0000 7f47ed600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e81613c0 con 0x7f47e806dac0 2024-04-25T09:13:37.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.069+0000 7f47ed600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e8061d60 con 0x7f47e8160fe0 2024-04-25T09:13:37.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.069+0000 7f47ed600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e806dfa0 con 0x7f47e806bca0 2024-04-25T09:13:37.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.073+0000 7f47e6000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f47e806dac0 0x7f47e80ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:37.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.073+0000 7f47e6000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f47e806dac0 0x7f47e80ace00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60694/0 (socket says 172.21.15.173:60694) 2024-04-25T09:13:37.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.073+0000 7f47e6000640 1 -- 172.21.15.173:0/1163055625 learned_addr learned my addr 172.21.15.173:0/1163055625 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:37.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.073+0000 7f47e7400640 1 --2- 172.21.15.173:0/1163055625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47e806bca0 0x7f47e806c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:37.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.073+0000 7f47e6a00640 1 --2- 172.21.15.173:0/1163055625 >> v2:172.21.15.194:3300/0 conn(0x7f47e8160fe0 0x7f47e8161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:37.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.073+0000 7f47e6000640 1 -- 172.21.15.173:0/1163055625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47e806bca0 msgr2=0x7f47e806c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:37.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.073+0000 7f47e6000640 1 --2- 172.21.15.173:0/1163055625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47e806bca0 0x7f47e806c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.073+0000 7f47e6000640 1 -- 172.21.15.173:0/1163055625 >> v2:172.21.15.194:3300/0 conn(0x7f47e8160fe0 msgr2=0x7f47e8161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:37.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.073+0000 7f47e6000640 1 --2- 172.21.15.173:0/1163055625 >> v2:172.21.15.194:3300/0 conn(0x7f47e8160fe0 0x7f47e8161fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.073+0000 7f47e6000640 1 -- 172.21.15.173:0/1163055625 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e806e280 con 0x7f47e806dac0 2024-04-25T09:13:37.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.073+0000 7f47e6a00640 1 --2- 172.21.15.173:0/1163055625 >> v2:172.21.15.194:3300/0 conn(0x7f47e8160fe0 0x7f47e8161fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:37.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.073+0000 7f47e6000640 1 --2- 172.21.15.173:0/1163055625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47e806dac0 0x7f47e80ace00 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f47e8071070 tx=0x7f47d401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48dd2013b7569179 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:37.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47e5600640 1 -- 172.21.15.173:0/1163055625 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d40b0070 con 0x7f47e806dac0 2024-04-25T09:13:37.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47e5600640 1 -- 172.21.15.173:0/1163055625 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d40ab600 con 0x7f47e806dac0 2024-04-25T09:13:37.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47e5600640 1 -- 172.21.15.173:0/1163055625 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d40ab9d0 con 0x7f47e806dac0 2024-04-25T09:13:37.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47ed600640 1 -- 172.21.15.173:0/1163055625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47e806dac0 msgr2=0x7f47e80ace00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:37.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47ed600640 1 --2- 172.21.15.173:0/1163055625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47e806dac0 0x7f47e80ace00 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f47e8071070 tx=0x7f47d401c490 comp rx=0 tx=0).stop 2024-04-25T09:13:37.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47ed600640 1 -- 172.21.15.173:0/1163055625 shutdown_connections 2024-04-25T09:13:37.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47ed600640 1 --2- 172.21.15.173:0/1163055625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47e806bca0 0x7f47e806c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47ed600640 1 --2- 172.21.15.173:0/1163055625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47e806dac0 0x7f47e80ace00 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47ed600640 1 --2- 172.21.15.173:0/1163055625 >> v2:172.21.15.194:3300/0 conn(0x7f47e8160fe0 0x7f47e8161fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47ed600640 1 -- 172.21.15.173:0/1163055625 >> 172.21.15.173:0/1163055625 conn(0x7f47e8071c20 msgr2=0x7f47e8072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:37.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47ed600640 1 -- 172.21.15.173:0/1163055625 shutdown_connections 2024-04-25T09:13:37.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47ed600640 1 -- 172.21.15.173:0/1163055625 wait complete. 2024-04-25T09:13:37.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47ed600640 1 Processor -- start 2024-04-25T09:13:37.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47ed600640 1 -- start start 2024-04-25T09:13:37.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47ed600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47e806bca0 0x7f47e8158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:37.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47ed600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47e806dac0 0x7f47e8155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:37.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47ed600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47e8160fe0 0x7f47e8156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:37.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47ed600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80ad340 con 0x7f47e806dac0 2024-04-25T09:13:37.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47ed600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e81624f0 con 0x7f47e806bca0 2024-04-25T09:13:37.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47ed600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80ad4c0 con 0x7f47e8160fe0 2024-04-25T09:13:37.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47e6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47e806dac0 0x7f47e8155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:37.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47e6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47e806dac0 0x7f47e8155db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60704/0 (socket says 172.21.15.173:60704) 2024-04-25T09:13:37.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.077+0000 7f47e6000640 1 -- 172.21.15.173:0/984455564 learned_addr learned my addr 172.21.15.173:0/984455564 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:37.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.081+0000 7f47e7400640 1 --2- 172.21.15.173:0/984455564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47e8160fe0 0x7f47e8156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:37.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.081+0000 7f47e6a00640 1 --2- 172.21.15.173:0/984455564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47e806bca0 0x7f47e8158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:37.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.081+0000 7f47e6000640 1 -- 172.21.15.173:0/984455564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47e8160fe0 msgr2=0x7f47e8156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:37.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.081+0000 7f47e6000640 1 --2- 172.21.15.173:0/984455564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47e8160fe0 0x7f47e8156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.081+0000 7f47e6000640 1 -- 172.21.15.173:0/984455564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47e806bca0 msgr2=0x7f47e8158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:37.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.081+0000 7f47e6000640 1 --2- 172.21.15.173:0/984455564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47e806bca0 0x7f47e8158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.081+0000 7f47e6000640 1 -- 172.21.15.173:0/984455564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e8148bc0 con 0x7f47e806dac0 2024-04-25T09:13:37.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.081+0000 7f47e7400640 1 --2- 172.21.15.173:0/984455564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47e8160fe0 0x7f47e8156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:37.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.081+0000 7f47e6000640 1 --2- 172.21.15.173:0/984455564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47e806dac0 0x7f47e8155db0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f47d401cd30 tx=0x7f47d4019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:37.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.081+0000 7f47dea00640 1 -- 172.21.15.173:0/984455564 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d40b9070 con 0x7f47e806dac0 2024-04-25T09:13:37.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.081+0000 7f47dea00640 1 -- 172.21.15.173:0/984455564 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d40b4420 con 0x7f47e806dac0 2024-04-25T09:13:37.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.081+0000 7f47dea00640 1 -- 172.21.15.173:0/984455564 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d40b0040 con 0x7f47e806dac0 2024-04-25T09:13:37.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.081+0000 7f47ed600640 1 -- 172.21.15.173:0/984455564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e8148ea0 con 0x7f47e806dac0 2024-04-25T09:13:37.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.081+0000 7f47ed600640 1 -- 172.21.15.173:0/984455564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e8149460 con 0x7f47e806dac0 2024-04-25T09:13:37.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.081+0000 7f47ed600640 1 -- 172.21.15.173:0/984455564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e8073a40 con 0x7f47e806dac0 2024-04-25T09:13:37.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.081+0000 7f47dea00640 1 -- 172.21.15.173:0/984455564 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f47d40b4810 con 0x7f47e806dac0 2024-04-25T09:13:37.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.081+0000 7f47dea00640 1 --2- 172.21.15.173:0/984455564 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f47c8066f90 0x7f47c8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:37.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.085+0000 7f47dea00640 1 -- 172.21.15.173:0/984455564 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f47d411e480 con 0x7f47e806dac0 2024-04-25T09:13:37.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.085+0000 7f47e6a00640 1 --2- 172.21.15.173:0/984455564 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f47c8066f90 0x7f47c8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:37.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.085+0000 7f47e6a00640 1 --2- 172.21.15.173:0/984455564 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f47c8066f90 0x7f47c8069450 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f47d800d8d0 tx=0x7f47d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:37.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.085+0000 7f47dea00640 1 -- 172.21.15.173:0/984455564 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f47d4016110 con 0x7f47e806dac0 2024-04-25T09:13:37.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.293+0000 7f47ed600640 1 -- 172.21.15.173:0/984455564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f47e80cf6c0 con 0x7f47e806dac0 2024-04-25T09:13:37.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.293+0000 7f47dea00640 1 -- 172.21.15.173:0/984455564 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1024 (secure 0 0 0) 0x7f47d40ef290 con 0x7f47e806dac0 2024-04-25T09:13:37.278 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:37.278 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":671,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":134,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076677378,"bytes_used":2612629504,"bytes_avail":770481483776,"bytes_total":773094113280,"read_bytes_sec":245803,"read_op_per_sec":12,"write_op_per_sec":0},"fsmap":{"epoch":93,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":9408}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":33,"modified":"2024-04-25T09:13:32.870221+0000","services":{}},"progress_events":{}} 2024-04-25T09:13:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.293+0000 7f47ed600640 1 -- 172.21.15.173:0/984455564 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f47c8066f90 msgr2=0x7f47c8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.293+0000 7f47ed600640 1 --2- 172.21.15.173:0/984455564 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f47c8066f90 0x7f47c8069450 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f47d800d8d0 tx=0x7f47d8008040 comp rx=0 tx=0).stop 2024-04-25T09:13:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.293+0000 7f47ed600640 1 -- 172.21.15.173:0/984455564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47e806dac0 msgr2=0x7f47e8155db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.293+0000 7f47ed600640 1 --2- 172.21.15.173:0/984455564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47e806dac0 0x7f47e8155db0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f47d401cd30 tx=0x7f47d4019230 comp rx=0 tx=0).stop 2024-04-25T09:13:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.293+0000 7f47ed600640 1 -- 172.21.15.173:0/984455564 shutdown_connections 2024-04-25T09:13:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.293+0000 7f47ed600640 1 --2- 172.21.15.173:0/984455564 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f47c8066f90 0x7f47c8069450 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.293+0000 7f47ed600640 1 --2- 172.21.15.173:0/984455564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47e8160fe0 0x7f47e8156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.293+0000 7f47ed600640 1 --2- 172.21.15.173:0/984455564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47e806dac0 0x7f47e8155db0 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.293+0000 7f47ed600640 1 --2- 172.21.15.173:0/984455564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47e806bca0 0x7f47e8158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.293+0000 7f47ed600640 1 -- 172.21.15.173:0/984455564 >> 172.21.15.173:0/984455564 conn(0x7f47e8071c20 msgr2=0x7f47e80b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:37.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.297+0000 7f47ed600640 1 -- 172.21.15.173:0/984455564 shutdown_connections 2024-04-25T09:13:37.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.297+0000 7f47ed600640 1 -- 172.21.15.173:0/984455564 wait complete. 2024-04-25T09:13:37.299 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:13:37.299 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:13:37.430 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:13:37.489 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:13:37.490 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:13:37.490 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:13:37.499 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:13:37.499 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:13:37.547 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:13:37.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c3200640 1 Processor -- start 2024-04-25T09:13:37.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c3200640 1 -- start start 2024-04-25T09:13:37.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4c40d00f0 0x7fa4c4166440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:37.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c3200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c40cc440 con 0x7fa4c415b900 2024-04-25T09:13:37.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c3200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c415bce0 con 0x7fa4c40cc000 2024-04-25T09:13:37.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c40cd2d0 con 0x7fa4c40d00f0 2024-04-25T09:13:37.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c1e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa4c415b900 0x7fa4c40b2930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36084/0 (socket says 172.21.15.173:36084) 2024-04-25T09:13:37.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c1e00640 1 -- 172.21.15.173:0/4172530805 learned_addr learned my addr 172.21.15.173:0/4172530805 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:37.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c2800640 1 --2- 172.21.15.173:0/4172530805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4c40d00f0 0x7fa4c4166440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:37.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c0a00640 1 -- 172.21.15.173:0/4172530805 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797027269 0 0) 0x7fa4b4001120 con 0x7fa4c415b900 2024-04-25T09:13:37.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c0a00640 1 -- 172.21.15.173:0/4172530805 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a8003530 con 0x7fa4c415b900 2024-04-25T09:13:37.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c0a00640 1 -- 172.21.15.173:0/4172530805 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1471766032 0 0) 0x7fa4a8003530 con 0x7fa4c415b900 2024-04-25T09:13:37.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c0a00640 1 -- 172.21.15.173:0/4172530805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4c40d00f0 msgr2=0x7fa4c4166440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:37.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c0a00640 1 --2- 172.21.15.173:0/4172530805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4c40d00f0 0x7fa4c4166440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c0a00640 1 -- 172.21.15.173:0/4172530805 >> v1:172.21.15.194:6789/0 conn(0x7fa4c40cc000 legacy=0x7fa4c40cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:37.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c0a00640 1 -- 172.21.15.173:0/4172530805 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c40cc6c0 con 0x7fa4c415b900 2024-04-25T09:13:37.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c0a00640 1 -- 172.21.15.173:0/4172530805 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fa4b4001850 con 0x7fa4c415b900 2024-04-25T09:13:37.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c0a00640 1 -- 172.21.15.173:0/4172530805 >> v1:172.21.15.173:6789/0 conn(0x7fa4c415b900 legacy=0x7fa4c40b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:37.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c0a00640 1 --2- 172.21.15.173:0/4172530805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4a80039f0 0x7fa4a8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:37.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c0a00640 1 --2- 172.21.15.173:0/4172530805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4a8004810 0x7fa4a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:37.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c0a00640 1 --2- 172.21.15.173:0/4172530805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4c40d00f0 0x7fa4a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:37.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c0a00640 1 -- 172.21.15.173:0/4172530805 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c40cd2d0 con 0x7fa4a80039f0 2024-04-25T09:13:37.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c0a00640 1 -- 172.21.15.173:0/4172530805 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a800bab0 con 0x7fa4a8004810 2024-04-25T09:13:37.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c0a00640 1 -- 172.21.15.173:0/4172530805 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a800bcb0 con 0x7fa4c40d00f0 2024-04-25T09:13:37.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c1e00640 1 --2- 172.21.15.173:0/4172530805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4a80039f0 0x7fa4a8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:37.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c1400640 1 --2- 172.21.15.173:0/4172530805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4a8004810 0x7fa4a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:37.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c2800640 1 --2- 172.21.15.173:0/4172530805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4c40d00f0 0x7fa4a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:37.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c1e00640 1 -- 172.21.15.173:0/4172530805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4c40d00f0 msgr2=0x7fa4a80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:37.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c1e00640 1 --2- 172.21.15.173:0/4172530805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4c40d00f0 0x7fa4a80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c1e00640 1 -- 172.21.15.173:0/4172530805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4a8004810 msgr2=0x7fa4a8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:37.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c1e00640 1 --2- 172.21.15.173:0/4172530805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4a8004810 0x7fa4a8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.749+0000 7fa4c1e00640 1 -- 172.21.15.173:0/4172530805 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a8003530 con 0x7fa4a80039f0 2024-04-25T09:13:37.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.753+0000 7fa4c1e00640 1 --2- 172.21.15.173:0/4172530805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4a80039f0 0x7fa4a8003e10 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400c4c0 tx=0x7fa4b401cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9cd1380a64678a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:37.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.753+0000 7fa4c0a00640 1 -- 172.21.15.173:0/4172530805 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b400c0e0 con 0x7fa4a80039f0 2024-04-25T09:13:37.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.753+0000 7fa4c0a00640 1 -- 172.21.15.173:0/4172530805 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b40a9070 con 0x7fa4a80039f0 2024-04-25T09:13:37.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.753+0000 7fa4c0a00640 1 -- 172.21.15.173:0/4172530805 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b40a5db0 con 0x7fa4a80039f0 2024-04-25T09:13:37.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.753+0000 7fa4c3200640 1 -- 172.21.15.173:0/4172530805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4a80039f0 msgr2=0x7fa4a8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:37.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.753+0000 7fa4c3200640 1 --2- 172.21.15.173:0/4172530805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4a80039f0 0x7fa4a8003e10 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400c4c0 tx=0x7fa4b401cc70 comp rx=0 tx=0).stop 2024-04-25T09:13:37.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.753+0000 7fa4c2800640 1 -- 172.21.15.173:0/4172530805 reap_dead start 2024-04-25T09:13:37.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.753+0000 7fa4c3200640 1 -- 172.21.15.173:0/4172530805 shutdown_connections 2024-04-25T09:13:37.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.753+0000 7fa4c3200640 1 -- 172.21.15.173:0/4172530805 >> 172.21.15.173:0/4172530805 conn(0x7fa4c40d1620 msgr2=0x7fa4c40d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:37.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.753+0000 7fa4c3200640 1 -- 172.21.15.173:0/4172530805 shutdown_connections 2024-04-25T09:13:37.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.753+0000 7fa4c3200640 1 -- 172.21.15.173:0/4172530805 wait complete. 2024-04-25T09:13:37.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c3200640 1 Processor -- start 2024-04-25T09:13:37.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c3200640 1 -- start start 2024-04-25T09:13:37.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c3200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4a80039f0 0x7fa4c414e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:37.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4c40af040 0x7fa4c415d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:37.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c3200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4c406f840 0x7fa4c406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:37.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c3200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4166dd0 con 0x7fa4a80039f0 2024-04-25T09:13:37.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c3200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4166c50 con 0x7fa4c406f840 2024-04-25T09:13:37.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4166f50 con 0x7fa4c40af040 2024-04-25T09:13:37.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c1e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4a80039f0 0x7fa4c414e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:37.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c1e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4a80039f0 0x7fa4c414e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60718/0 (socket says 172.21.15.173:60718) 2024-04-25T09:13:37.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c1e00640 1 -- 172.21.15.173:0/1296688660 learned_addr learned my addr 172.21.15.173:0/1296688660 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:37.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c1400640 1 --2- 172.21.15.173:0/1296688660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4c40af040 0x7fa4c415d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:37.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c2800640 1 --2- 172.21.15.173:0/1296688660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4c406f840 0x7fa4c406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:37.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c1e00640 1 -- 172.21.15.173:0/1296688660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4c40af040 msgr2=0x7fa4c415d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:37.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c1e00640 1 --2- 172.21.15.173:0/1296688660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4c40af040 0x7fa4c415d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c1e00640 1 -- 172.21.15.173:0/1296688660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4c406f840 msgr2=0x7fa4c406fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:37.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c1e00640 1 --2- 172.21.15.173:0/1296688660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4c406f840 0x7fa4c406fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c1e00640 1 -- 172.21.15.173:0/1296688660 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c40c5b30 con 0x7fa4a80039f0 2024-04-25T09:13:37.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c1e00640 1 --2- 172.21.15.173:0/1296688660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4a80039f0 0x7fa4c414e400 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400c4c0 tx=0x7fa4a8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:37.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4ba000640 1 -- 172.21.15.173:0/1296688660 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b40011e0 con 0x7fa4a80039f0 2024-04-25T09:13:37.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4ba000640 1 -- 172.21.15.173:0/1296688660 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b40a5950 con 0x7fa4a80039f0 2024-04-25T09:13:37.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c3200640 1 -- 172.21.15.173:0/1296688660 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c415da00 con 0x7fa4a80039f0 2024-04-25T09:13:37.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4ba000640 1 -- 172.21.15.173:0/1296688660 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b40047f0 con 0x7fa4a80039f0 2024-04-25T09:13:37.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c3200640 1 -- 172.21.15.173:0/1296688660 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c415dfc0 con 0x7fa4a80039f0 2024-04-25T09:13:37.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.757+0000 7fa4c3200640 1 -- 172.21.15.173:0/1296688660 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c4073a40 con 0x7fa4a80039f0 2024-04-25T09:13:37.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.761+0000 7fa4ba000640 1 -- 172.21.15.173:0/1296688660 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa4b4004990 con 0x7fa4a80039f0 2024-04-25T09:13:37.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.761+0000 7fa4ba000640 1 --2- 172.21.15.173:0/1296688660 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa4a4066f90 0x7fa4a4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:37.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.761+0000 7fa4ba000640 1 -- 172.21.15.173:0/1296688660 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fa4b411ed60 con 0x7fa4a80039f0 2024-04-25T09:13:37.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.761+0000 7fa4c1400640 1 --2- 172.21.15.173:0/1296688660 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa4a4066f90 0x7fa4a4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:37.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.761+0000 7fa4c1400640 1 --2- 172.21.15.173:0/1296688660 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa4a4066f90 0x7fa4a4069450 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0000c10 tx=0x7fa4b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:37.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.765+0000 7fa4ba000640 1 -- 172.21.15.173:0/1296688660 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa4c40c5b30 con 0x7fa4a80039f0 2024-04-25T09:13:37.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.917+0000 7fa4c3200640 1 -- 172.21.15.173:0/1296688660 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4c414eb20 con 0x7fa4a80039f0 2024-04-25T09:13:37.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.921+0000 7fa4ba000640 1 -- 172.21.15.173:0/1296688660 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+17091 (secure 0 0 0) 0x7fa4c40cc440 con 0x7fa4a80039f0 2024-04-25T09:13:37.906 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:37.906 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":134,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:13:30.512676+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:12:32.846423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-04-25T09:12:33.466675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:6837/3627798672":"2024-04-26T09:13:30.512572+0000","172.21.15.173:6836/3627798672":"2024-04-26T09:13:30.512572+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:13:37.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.921+0000 7fa4c3200640 1 -- 172.21.15.173:0/1296688660 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa4a4066f90 msgr2=0x7fa4a4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:37.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.921+0000 7fa4c3200640 1 --2- 172.21.15.173:0/1296688660 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa4a4066f90 0x7fa4a4069450 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0000c10 tx=0x7fa4b0009040 comp rx=0 tx=0).stop 2024-04-25T09:13:37.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.921+0000 7fa4c3200640 1 -- 172.21.15.173:0/1296688660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4a80039f0 msgr2=0x7fa4c414e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:37.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.921+0000 7fa4c3200640 1 --2- 172.21.15.173:0/1296688660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4a80039f0 0x7fa4c414e400 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400c4c0 tx=0x7fa4a8005840 comp rx=0 tx=0).stop 2024-04-25T09:13:37.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.921+0000 7fa4c3200640 1 -- 172.21.15.173:0/1296688660 shutdown_connections 2024-04-25T09:13:37.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.921+0000 7fa4c3200640 1 --2- 172.21.15.173:0/1296688660 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa4a4066f90 0x7fa4a4069450 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.921+0000 7fa4c3200640 1 --2- 172.21.15.173:0/1296688660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4c406f840 0x7fa4c406fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.921+0000 7fa4c3200640 1 --2- 172.21.15.173:0/1296688660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4c40af040 0x7fa4c415d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.921+0000 7fa4c3200640 1 --2- 172.21.15.173:0/1296688660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4a80039f0 0x7fa4c414e400 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:37.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.921+0000 7fa4c3200640 1 -- 172.21.15.173:0/1296688660 >> 172.21.15.173:0/1296688660 conn(0x7fa4c40d1620 msgr2=0x7fa4c415a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:37.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.921+0000 7fa4c3200640 1 -- 172.21.15.173:0/1296688660 shutdown_connections 2024-04-25T09:13:37.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:37.921+0000 7fa4c3200640 1 -- 172.21.15.173:0/1296688660 wait complete. 2024-04-25T09:13:37.925 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:12:32.846423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:12:33.466675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '133', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:13:37.926 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:13:38.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.081+0000 7f9c7bc00640 1 Processor -- start 2024-04-25T09:13:38.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.081+0000 7f9c7bc00640 1 -- start start 2024-04-25T09:13:38.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.081+0000 7f9c7bc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9c74145290 0x7f9c7415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:38.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.081+0000 7f9c7bc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9c740b3fe0 0x7f9c740b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:38.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.081+0000 7f9c7bc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7415c5f0 con 0x7f9c740cc260 2024-04-25T09:13:38.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.081+0000 7f9c7bc00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c740ccd80 con 0x7f9c74145290 2024-04-25T09:13:38.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.081+0000 7f9c7bc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7406d4b0 con 0x7f9c740b3fe0 2024-04-25T09:13:38.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.081+0000 7f9c79200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9c74145290 0x7f9c7415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:38.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.081+0000 7f9c79200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9c74145290 0x7f9c7415c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60732/0 (socket says 172.21.15.173:60732) 2024-04-25T09:13:38.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.081+0000 7f9c79200640 1 -- 172.21.15.173:0/2026151661 learned_addr learned my addr 172.21.15.173:0/2026151661 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:38.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.081+0000 7f9c73e00640 1 --2- 172.21.15.173:0/2026151661 >> v2:172.21.15.194:3300/0 conn(0x7f9c740b3fe0 0x7f9c740b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:38.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.081+0000 7f9c79200640 1 -- 172.21.15.173:0/2026151661 >> v2:172.21.15.194:3300/0 conn(0x7f9c740b3fe0 msgr2=0x7f9c740b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:38.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.081+0000 7f9c79200640 1 --2- 172.21.15.173:0/2026151661 >> v2:172.21.15.194:3300/0 conn(0x7f9c740b3fe0 0x7f9c740b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.081+0000 7f9c79200640 1 -- 172.21.15.173:0/2026151661 >> v1:172.21.15.194:6789/0 conn(0x7f9c740cc260 legacy=0x7f9c740cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:38.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.081+0000 7f9c79200640 1 -- 172.21.15.173:0/2026151661 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7406d790 con 0x7f9c74145290 2024-04-25T09:13:38.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.085+0000 7f9c79200640 1 --2- 172.21.15.173:0/2026151661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c74145290 0x7f9c7415c0b0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f9c74071100 tx=0x7f9c6801c1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc580fda8194330b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:38.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.085+0000 7f9c73400640 1 -- 172.21.15.173:0/2026151661 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c680b0070 con 0x7f9c74145290 2024-04-25T09:13:38.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.085+0000 7f9c73400640 1 -- 172.21.15.173:0/2026151661 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c680ab600 con 0x7f9c74145290 2024-04-25T09:13:38.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.085+0000 7f9c73400640 1 -- 172.21.15.173:0/2026151661 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c680ab9d0 con 0x7f9c74145290 2024-04-25T09:13:38.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.085+0000 7f9c7bc00640 1 -- 172.21.15.173:0/2026151661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c74145290 msgr2=0x7f9c7415c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:38.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.085+0000 7f9c7bc00640 1 --2- 172.21.15.173:0/2026151661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c74145290 0x7f9c7415c0b0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f9c74071100 tx=0x7f9c6801c1e0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.085+0000 7f9c7bc00640 1 -- 172.21.15.173:0/2026151661 shutdown_connections 2024-04-25T09:13:38.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.085+0000 7f9c7bc00640 1 --2- 172.21.15.173:0/2026151661 >> v2:172.21.15.194:3300/0 conn(0x7f9c740b3fe0 0x7f9c740b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.085+0000 7f9c7bc00640 1 --2- 172.21.15.173:0/2026151661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c74145290 0x7f9c7415c0b0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.085+0000 7f9c7bc00640 1 -- 172.21.15.173:0/2026151661 >> 172.21.15.173:0/2026151661 conn(0x7f9c7406ac90 msgr2=0x7f9c7406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:38.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.085+0000 7f9c7bc00640 1 -- 172.21.15.173:0/2026151661 shutdown_connections 2024-04-25T09:13:38.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.085+0000 7f9c7bc00640 1 -- 172.21.15.173:0/2026151661 wait complete. 2024-04-25T09:13:38.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.085+0000 7f9c7bc00640 1 Processor -- start 2024-04-25T09:13:38.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c7bc00640 1 -- start start 2024-04-25T09:13:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c7bc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c740b3fe0 0x7f9c740b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c7bc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c740cc260 0x7f9c741594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c7bc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c74145290 0x7f9c7415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c7bc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c741457f0 con 0x7f9c74145290 2024-04-25T09:13:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c7bc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c74145670 con 0x7f9c740cc260 2024-04-25T09:13:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c7bc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7406ed60 con 0x7f9c740b3fe0 2024-04-25T09:13:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c79c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c74145290 0x7f9c7415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:38.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c79200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c740b3fe0 0x7f9c740b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:38.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c79c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c74145290 0x7f9c7415a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60746/0 (socket says 172.21.15.173:60746) 2024-04-25T09:13:38.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c79c00640 1 -- 172.21.15.173:0/626693519 learned_addr learned my addr 172.21.15.173:0/626693519 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:38.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c73e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c740cc260 0x7f9c741594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:38.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c79c00640 1 -- 172.21.15.173:0/626693519 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c740b3fe0 msgr2=0x7f9c740b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:38.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c79c00640 1 --2- 172.21.15.173:0/626693519 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c740b3fe0 0x7f9c740b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c79c00640 1 -- 172.21.15.173:0/626693519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c740cc260 msgr2=0x7f9c741594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:38.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c79c00640 1 --2- 172.21.15.173:0/626693519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c740cc260 0x7f9c741594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c79c00640 1 -- 172.21.15.173:0/626693519 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c740a8ca0 con 0x7f9c74145290 2024-04-25T09:13:38.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c79c00640 1 --2- 172.21.15.173:0/626693519 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c74145290 0x7f9c7415a4f0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c00c780 tx=0x7f9c6c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:38.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c70c00640 1 -- 172.21.15.173:0/626693519 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c004b70 con 0x7f9c74145290 2024-04-25T09:13:38.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c70c00640 1 -- 172.21.15.173:0/626693519 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c004d10 con 0x7f9c74145290 2024-04-25T09:13:38.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c7bc00640 1 -- 172.21.15.173:0/626693519 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c740a8f40 con 0x7f9c74145290 2024-04-25T09:13:38.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c70c00640 1 -- 172.21.15.173:0/626693519 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c00aa90 con 0x7f9c74145290 2024-04-25T09:13:38.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c7bc00640 1 -- 172.21.15.173:0/626693519 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7413e8b0 con 0x7f9c74145290 2024-04-25T09:13:38.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.089+0000 7f9c7bc00640 1 -- 172.21.15.173:0/626693519 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c74073ab0 con 0x7f9c74145290 2024-04-25T09:13:38.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.093+0000 7f9c70c00640 1 -- 172.21.15.173:0/626693519 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9c6c00ac30 con 0x7f9c74145290 2024-04-25T09:13:38.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.093+0000 7f9c70c00640 1 --2- 172.21.15.173:0/626693519 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9c54066f60 0x7f9c54069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:38.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.093+0000 7f9c70c00640 1 -- 172.21.15.173:0/626693519 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f9c6c085580 con 0x7f9c74145290 2024-04-25T09:13:38.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.093+0000 7f9c79200640 1 --2- 172.21.15.173:0/626693519 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9c54066f60 0x7f9c54069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:38.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.093+0000 7f9c79200640 1 --2- 172.21.15.173:0/626693519 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9c54066f60 0x7f9c54069420 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9c680ad000 tx=0x7f9c680a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:38.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.097+0000 7f9c70c00640 1 -- 172.21.15.173:0/626693519 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9c6c055df0 con 0x7f9c74145290 2024-04-25T09:13:38.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.257+0000 7f9c7bc00640 1 -- 172.21.15.173:0/626693519 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c74141f20 con 0x7f9c74145290 2024-04-25T09:13:38.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.257+0000 7f9c70c00640 1 -- 172.21.15.173:0/626693519 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v134) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c6c059e90 con 0x7f9c74145290 2024-04-25T09:13:38.241 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:13:38.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.257+0000 7f9c7bc00640 1 -- 172.21.15.173:0/626693519 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9c54066f60 msgr2=0x7f9c54069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:38.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.257+0000 7f9c7bc00640 1 --2- 172.21.15.173:0/626693519 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9c54066f60 0x7f9c54069420 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9c680ad000 tx=0x7f9c680a6000 comp rx=0 tx=0).stop 2024-04-25T09:13:38.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.257+0000 7f9c7bc00640 1 -- 172.21.15.173:0/626693519 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c74145290 msgr2=0x7f9c7415a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:38.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.257+0000 7f9c7bc00640 1 --2- 172.21.15.173:0/626693519 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c74145290 0x7f9c7415a4f0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c00c780 tx=0x7f9c6c00cc40 comp rx=0 tx=0).stop 2024-04-25T09:13:38.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.257+0000 7f9c7bc00640 1 -- 172.21.15.173:0/626693519 shutdown_connections 2024-04-25T09:13:38.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.257+0000 7f9c7bc00640 1 --2- 172.21.15.173:0/626693519 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9c54066f60 0x7f9c54069420 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.257+0000 7f9c7bc00640 1 --2- 172.21.15.173:0/626693519 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c74145290 0x7f9c7415a4f0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.257+0000 7f9c7bc00640 1 --2- 172.21.15.173:0/626693519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c740cc260 0x7f9c741594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.257+0000 7f9c7bc00640 1 --2- 172.21.15.173:0/626693519 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c740b3fe0 0x7f9c740b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.257+0000 7f9c7bc00640 1 -- 172.21.15.173:0/626693519 >> 172.21.15.173:0/626693519 conn(0x7f9c7406ac90 msgr2=0x7f9c74140e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:38.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.257+0000 7f9c7bc00640 1 -- 172.21.15.173:0/626693519 shutdown_connections 2024-04-25T09:13:38.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.257+0000 7f9c7bc00640 1 -- 172.21.15.173:0/626693519 wait complete. 2024-04-25T09:13:38.261 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:13:38.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.413+0000 7faf34800640 1 Processor -- start 2024-04-25T09:13:38.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.413+0000 7faf34800640 1 -- start start 2024-04-25T09:13:38.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.413+0000 7faf34800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf2c0b3fe0 0x7faf2c0b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:38.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.413+0000 7faf34800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2c06d4b0 con 0x7faf2c145290 2024-04-25T09:13:38.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.413+0000 7faf34800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2c06d790 con 0x7faf2c0cc260 2024-04-25T09:13:38.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.413+0000 7faf34800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c06da70 con 0x7faf2c0b3fe0 2024-04-25T09:13:38.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.417+0000 7faf31e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7faf2c145290 0x7faf2c15c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36096/0 (socket says 172.21.15.173:36096) 2024-04-25T09:13:38.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.417+0000 7faf31e00640 1 -- 172.21.15.173:0/635939263 learned_addr learned my addr 172.21.15.173:0/635939263 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:38.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.417+0000 7faf31400640 1 --2- 172.21.15.173:0/635939263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf2c0b3fe0 0x7faf2c0b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:38.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.417+0000 7faf30a00640 1 -- 172.21.15.173:0/635939263 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17154683 0 0) 0x7faf2c06d4b0 con 0x7faf2c145290 2024-04-25T09:13:38.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.417+0000 7faf30a00640 1 -- 172.21.15.173:0/635939263 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf14003530 con 0x7faf2c145290 2024-04-25T09:13:38.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.417+0000 7faf30a00640 1 -- 172.21.15.173:0/635939263 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456657378 0 0) 0x7faf2c06d790 con 0x7faf2c0cc260 2024-04-25T09:13:38.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.417+0000 7faf30a00640 1 -- 172.21.15.173:0/635939263 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf2c06d4b0 con 0x7faf2c0cc260 2024-04-25T09:13:38.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.417+0000 7faf30a00640 1 -- 172.21.15.173:0/635939263 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 876864358 0 0) 0x7faf14003530 con 0x7faf2c145290 2024-04-25T09:13:38.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.417+0000 7faf31400640 1 -- 172.21.15.173:0/635939263 >> v1:172.21.15.194:6789/0 conn(0x7faf2c0cc260 legacy=0x7faf2c0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:38.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.417+0000 7faf31400640 1 -- 172.21.15.173:0/635939263 >> v1:172.21.15.173:6789/0 conn(0x7faf2c145290 legacy=0x7faf2c15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:38.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.417+0000 7faf31400640 1 -- 172.21.15.173:0/635939263 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c06dd50 con 0x7faf2c0b3fe0 2024-04-25T09:13:38.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.417+0000 7faf31400640 1 --2- 172.21.15.173:0/635939263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf2c0b3fe0 0x7faf2c0b4420 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0097f0 tx=0x7faf1c01c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6138ed383c03b2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:38.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf30a00640 1 -- 172.21.15.173:0/635939263 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0b0070 con 0x7faf2c0b3fe0 2024-04-25T09:13:38.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf30a00640 1 -- 172.21.15.173:0/635939263 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c0ab400 con 0x7faf2c0b3fe0 2024-04-25T09:13:38.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf30a00640 1 -- 172.21.15.173:0/635939263 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf20001680 con 0x7faf2c0b3fe0 2024-04-25T09:13:38.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf34800640 1 -- 172.21.15.173:0/635939263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf2c0b3fe0 msgr2=0x7faf2c0b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:38.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf34800640 1 --2- 172.21.15.173:0/635939263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf2c0b3fe0 0x7faf2c0b4420 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0097f0 tx=0x7faf1c01c2e0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf34800640 1 -- 172.21.15.173:0/635939263 shutdown_connections 2024-04-25T09:13:38.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf34800640 1 --2- 172.21.15.173:0/635939263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf2c0b3fe0 0x7faf2c0b4420 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf34800640 1 -- 172.21.15.173:0/635939263 >> 172.21.15.173:0/635939263 conn(0x7faf2c06ac90 msgr2=0x7faf2c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:38.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf34800640 1 -- 172.21.15.173:0/635939263 shutdown_connections 2024-04-25T09:13:38.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf34800640 1 -- 172.21.15.173:0/635939263 wait complete. 2024-04-25T09:13:38.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf34800640 1 Processor -- start 2024-04-25T09:13:38.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf34800640 1 -- start start 2024-04-25T09:13:38.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf34800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf2c0b3fe0 0x7faf2c15d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:38.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf34800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf2c0cc260 0x7faf2c0c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:38.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf34800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf2c145290 0x7faf2c0c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:38.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf34800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c06f130 con 0x7faf2c145290 2024-04-25T09:13:38.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf34800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c06efb0 con 0x7faf2c0b3fe0 2024-04-25T09:13:38.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf34800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0c58d0 con 0x7faf2c0cc260 2024-04-25T09:13:38.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf32800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf2c145290 0x7faf2c0c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:38.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf32800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf2c145290 0x7faf2c0c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60750/0 (socket says 172.21.15.173:60750) 2024-04-25T09:13:38.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf32800640 1 -- 172.21.15.173:0/2490079770 learned_addr learned my addr 172.21.15.173:0/2490079770 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:38.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf32800640 1 -- 172.21.15.173:0/2490079770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf2c0cc260 msgr2=0x7faf2c0c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:38.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf31400640 1 --2- 172.21.15.173:0/2490079770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf2c0cc260 0x7faf2c0c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:38.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.421+0000 7faf31e00640 1 --2- 172.21.15.173:0/2490079770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf2c0b3fe0 0x7faf2c15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:38.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.425+0000 7faf32800640 1 --2- 172.21.15.173:0/2490079770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf2c0cc260 0x7faf2c0c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.425+0000 7faf32800640 1 -- 172.21.15.173:0/2490079770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf2c0b3fe0 msgr2=0x7faf2c15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:38.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.425+0000 7faf32800640 1 --2- 172.21.15.173:0/2490079770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf2c0b3fe0 0x7faf2c15d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.425+0000 7faf32800640 1 -- 172.21.15.173:0/2490079770 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c0c5bb0 con 0x7faf2c145290 2024-04-25T09:13:38.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.425+0000 7faf31400640 1 --2- 172.21.15.173:0/2490079770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf2c0cc260 0x7faf2c0c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:38.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.425+0000 7faf31e00640 1 --2- 172.21.15.173:0/2490079770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf2c0b3fe0 0x7faf2c15d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:38.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.425+0000 7faf32800640 1 --2- 172.21.15.173:0/2490079770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf2c145290 0x7faf2c0c9b30 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7faf2800c730 tx=0x7faf2800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:38.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.425+0000 7faf26000640 1 -- 172.21.15.173:0/2490079770 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28003b80 con 0x7faf2c145290 2024-04-25T09:13:38.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.425+0000 7faf26000640 1 -- 172.21.15.173:0/2490079770 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf28003d20 con 0x7faf2c145290 2024-04-25T09:13:38.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.425+0000 7faf26000640 1 -- 172.21.15.173:0/2490079770 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2800aa90 con 0x7faf2c145290 2024-04-25T09:13:38.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.425+0000 7faf34800640 1 -- 172.21.15.173:0/2490079770 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2c0c5e90 con 0x7faf2c145290 2024-04-25T09:13:38.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.425+0000 7faf34800640 1 -- 172.21.15.173:0/2490079770 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2c15d8d0 con 0x7faf2c145290 2024-04-25T09:13:38.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.425+0000 7faf34800640 1 -- 172.21.15.173:0/2490079770 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2c073ab0 con 0x7faf2c145290 2024-04-25T09:13:38.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.425+0000 7faf26000640 1 -- 172.21.15.173:0/2490079770 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faf2800ac30 con 0x7faf2c145290 2024-04-25T09:13:38.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.425+0000 7faf26000640 1 --2- 172.21.15.173:0/2490079770 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf10066f60 0x7faf10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:38.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.425+0000 7faf26000640 1 -- 172.21.15.173:0/2490079770 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7faf280851a0 con 0x7faf2c145290 2024-04-25T09:13:38.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.429+0000 7faf31e00640 1 --2- 172.21.15.173:0/2490079770 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf10066f60 0x7faf10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:38.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.429+0000 7faf31e00640 1 --2- 172.21.15.173:0/2490079770 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf10066f60 0x7faf10069420 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7faf200017f0 tx=0x7faf20009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:38.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.429+0000 7faf26000640 1 -- 172.21.15.173:0/2490079770 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faf28055fc0 con 0x7faf2c145290 2024-04-25T09:13:38.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.585+0000 7faf34800640 1 -- 172.21.15.173:0/2490079770 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf2c15e1e0 con 0x7faf2c145290 2024-04-25T09:13:38.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.585+0000 7faf26000640 1 -- 172.21.15.173:0/2490079770 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v134) v1 ==== 104+0+11 (secure 0 0 0) 0x7faf280558c0 con 0x7faf2c145290 2024-04-25T09:13:38.569 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:13:38.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.585+0000 7faf34800640 1 -- 172.21.15.173:0/2490079770 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf10066f60 msgr2=0x7faf10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:38.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.585+0000 7faf34800640 1 --2- 172.21.15.173:0/2490079770 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf10066f60 0x7faf10069420 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7faf200017f0 tx=0x7faf20009040 comp rx=0 tx=0).stop 2024-04-25T09:13:38.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.585+0000 7faf34800640 1 -- 172.21.15.173:0/2490079770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf2c145290 msgr2=0x7faf2c0c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:38.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.585+0000 7faf34800640 1 --2- 172.21.15.173:0/2490079770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf2c145290 0x7faf2c0c9b30 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7faf2800c730 tx=0x7faf2800cbf0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.585+0000 7faf34800640 1 -- 172.21.15.173:0/2490079770 shutdown_connections 2024-04-25T09:13:38.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.585+0000 7faf34800640 1 --2- 172.21.15.173:0/2490079770 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf10066f60 0x7faf10069420 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.585+0000 7faf34800640 1 --2- 172.21.15.173:0/2490079770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf2c145290 0x7faf2c0c9b30 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.585+0000 7faf34800640 1 --2- 172.21.15.173:0/2490079770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf2c0cc260 0x7faf2c0c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.585+0000 7faf34800640 1 --2- 172.21.15.173:0/2490079770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf2c0b3fe0 0x7faf2c15d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.585+0000 7faf34800640 1 -- 172.21.15.173:0/2490079770 >> 172.21.15.173:0/2490079770 conn(0x7faf2c06ac90 msgr2=0x7faf2c0b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:38.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.585+0000 7faf34800640 1 -- 172.21.15.173:0/2490079770 shutdown_connections 2024-04-25T09:13:38.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.585+0000 7faf34800640 1 -- 172.21.15.173:0/2490079770 wait complete. 2024-04-25T09:13:38.590 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:13:38.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.745+0000 7f0d67600640 1 Processor -- start 2024-04-25T09:13:38.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.745+0000 7f0d67600640 1 -- start start 2024-04-25T09:13:38.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.745+0000 7f0d67600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d60161300 0x7f0d6015f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:38.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.745+0000 7f0d67600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0d6015ec70 0x7f0d600b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:38.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.745+0000 7f0d67600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6006ba70 con 0x7f0d600b44d0 2024-04-25T09:13:38.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.745+0000 7f0d67600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d600b2ef0 con 0x7f0d6015ec70 2024-04-25T09:13:38.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.745+0000 7f0d67600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600b31d0 con 0x7f0d60161300 2024-04-25T09:13:38.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.745+0000 7f0d5fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0d6015ec70 0x7f0d600b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:38.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.745+0000 7f0d5fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0d6015ec70 0x7f0d600b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60762/0 (socket says 172.21.15.173:60762) 2024-04-25T09:13:38.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.745+0000 7f0d5fe00640 1 -- 172.21.15.173:0/105366567 learned_addr learned my addr 172.21.15.173:0/105366567 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:38.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.745+0000 7f0d64c00640 1 --2- 172.21.15.173:0/105366567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d60161300 0x7f0d6015f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:38.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.745+0000 7f0d5fe00640 1 -- 172.21.15.173:0/105366567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d60161300 msgr2=0x7f0d6015f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:38.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.745+0000 7f0d5fe00640 1 --2- 172.21.15.173:0/105366567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d60161300 0x7f0d6015f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.745+0000 7f0d5fe00640 1 -- 172.21.15.173:0/105366567 >> v1:172.21.15.194:6789/0 conn(0x7f0d600b44d0 legacy=0x7f0d6006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:38.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.745+0000 7f0d5fe00640 1 -- 172.21.15.173:0/105366567 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d600b34b0 con 0x7f0d6015ec70 2024-04-25T09:13:38.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.749+0000 7f0d5fe00640 1 --2- 172.21.15.173:0/105366567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d6015ec70 0x7f0d600b3f90 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009870 tx=0x7f0d4c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bceb571f099edaef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:38.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.749+0000 7f0d5f400640 1 -- 172.21.15.173:0/105366567 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0aa430 con 0x7f0d6015ec70 2024-04-25T09:13:38.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.749+0000 7f0d5f400640 1 -- 172.21.15.173:0/105366567 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c0af070 con 0x7f0d6015ec70 2024-04-25T09:13:38.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.749+0000 7f0d5f400640 1 -- 172.21.15.173:0/105366567 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0aa7f0 con 0x7f0d6015ec70 2024-04-25T09:13:38.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.749+0000 7f0d67600640 1 -- 172.21.15.173:0/105366567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d6015ec70 msgr2=0x7f0d600b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:38.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.749+0000 7f0d67600640 1 --2- 172.21.15.173:0/105366567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d6015ec70 0x7f0d600b3f90 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009870 tx=0x7f0d4c01c4d0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.749+0000 7f0d67600640 1 -- 172.21.15.173:0/105366567 shutdown_connections 2024-04-25T09:13:38.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.749+0000 7f0d67600640 1 --2- 172.21.15.173:0/105366567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d6015ec70 0x7f0d600b3f90 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.749+0000 7f0d67600640 1 --2- 172.21.15.173:0/105366567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d60161300 0x7f0d6015f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.749+0000 7f0d67600640 1 -- 172.21.15.173:0/105366567 >> 172.21.15.173:0/105366567 conn(0x7f0d6006ac90 msgr2=0x7f0d6006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:38.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.749+0000 7f0d67600640 1 -- 172.21.15.173:0/105366567 shutdown_connections 2024-04-25T09:13:38.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.749+0000 7f0d67600640 1 -- 172.21.15.173:0/105366567 wait complete. 2024-04-25T09:13:38.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d67600640 1 Processor -- start 2024-04-25T09:13:38.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d67600640 1 -- start start 2024-04-25T09:13:38.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d67600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d600b44d0 0x7f0d600ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:38.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d67600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d6015ec70 0x7f0d600afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:38.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d67600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d60161300 0x7f0d600b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:38.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d67600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600b2c20 con 0x7f0d60161300 2024-04-25T09:13:38.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d67600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600b2aa0 con 0x7f0d6015ec70 2024-04-25T09:13:38.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d67600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6016b040 con 0x7f0d600b44d0 2024-04-25T09:13:38.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d65600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d60161300 0x7f0d600b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:38.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d64c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d600b44d0 0x7f0d600ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:38.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d65600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d60161300 0x7f0d600b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60774/0 (socket says 172.21.15.173:60774) 2024-04-25T09:13:38.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d65600640 1 -- 172.21.15.173:0/4260071489 learned_addr learned my addr 172.21.15.173:0/4260071489 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d5fe00640 1 --2- 172.21.15.173:0/4260071489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d6015ec70 0x7f0d600afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d65600640 1 -- 172.21.15.173:0/4260071489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d600b44d0 msgr2=0x7f0d600ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d65600640 1 --2- 172.21.15.173:0/4260071489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d600b44d0 0x7f0d600ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d65600640 1 -- 172.21.15.173:0/4260071489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d6015ec70 msgr2=0x7f0d600afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d65600640 1 --2- 172.21.15.173:0/4260071489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d6015ec70 0x7f0d600afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d65600640 1 -- 172.21.15.173:0/4260071489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d60151da0 con 0x7f0d60161300 2024-04-25T09:13:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d65600640 1 --2- 172.21.15.173:0/4260071489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d60161300 0x7f0d600b0030 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800c730 tx=0x7f0d5800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d5cc00640 1 -- 172.21.15.173:0/4260071489 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58016020 con 0x7f0d60161300 2024-04-25T09:13:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d5cc00640 1 -- 172.21.15.173:0/4260071489 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d58006d60 con 0x7f0d60161300 2024-04-25T09:13:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d67600640 1 -- 172.21.15.173:0/4260071489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d60152080 con 0x7f0d60161300 2024-04-25T09:13:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d5cc00640 1 -- 172.21.15.173:0/4260071489 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58003bc0 con 0x7f0d60161300 2024-04-25T09:13:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.753+0000 7f0d67600640 1 -- 172.21.15.173:0/4260071489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d60152640 con 0x7f0d60161300 2024-04-25T09:13:38.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.757+0000 7f0d67600640 1 -- 172.21.15.173:0/4260071489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d60073ab0 con 0x7f0d60161300 2024-04-25T09:13:38.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.757+0000 7f0d5cc00640 1 -- 172.21.15.173:0/4260071489 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0d580050d0 con 0x7f0d60161300 2024-04-25T09:13:38.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.757+0000 7f0d5cc00640 1 --2- 172.21.15.173:0/4260071489 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d40066f90 0x7f0d40069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:38.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.757+0000 7f0d5cc00640 1 -- 172.21.15.173:0/4260071489 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f0d58084cd0 con 0x7f0d60161300 2024-04-25T09:13:38.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.757+0000 7f0d64c00640 1 --2- 172.21.15.173:0/4260071489 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d40066f90 0x7f0d40069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:38.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.757+0000 7f0d64c00640 1 --2- 172.21.15.173:0/4260071489 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d40066f90 0x7f0d40069450 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0d60150f40 tx=0x7f0d50008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:38.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.761+0000 7f0d5cc00640 1 -- 172.21.15.173:0/4260071489 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0d58020020 con 0x7f0d60161300 2024-04-25T09:13:38.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.917+0000 7f0d67600640 1 -- 172.21.15.173:0/4260071489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d6006eb20 con 0x7f0d60161300 2024-04-25T09:13:38.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.917+0000 7f0d5cc00640 1 -- 172.21.15.173:0/4260071489 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v134) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0d580554a0 con 0x7f0d60161300 2024-04-25T09:13:38.902 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:13:38.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.917+0000 7f0d67600640 1 -- 172.21.15.173:0/4260071489 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d40066f90 msgr2=0x7f0d40069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:38.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.917+0000 7f0d67600640 1 --2- 172.21.15.173:0/4260071489 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d40066f90 0x7f0d40069450 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0d60150f40 tx=0x7f0d50008040 comp rx=0 tx=0).stop 2024-04-25T09:13:38.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.917+0000 7f0d67600640 1 -- 172.21.15.173:0/4260071489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d60161300 msgr2=0x7f0d600b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:38.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.917+0000 7f0d67600640 1 --2- 172.21.15.173:0/4260071489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d60161300 0x7f0d600b0030 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800c730 tx=0x7f0d5800cb30 comp rx=0 tx=0).stop 2024-04-25T09:13:38.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.917+0000 7f0d67600640 1 -- 172.21.15.173:0/4260071489 shutdown_connections 2024-04-25T09:13:38.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.917+0000 7f0d67600640 1 --2- 172.21.15.173:0/4260071489 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d40066f90 0x7f0d40069450 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.917+0000 7f0d67600640 1 --2- 172.21.15.173:0/4260071489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d60161300 0x7f0d600b0030 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.917+0000 7f0d67600640 1 --2- 172.21.15.173:0/4260071489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d6015ec70 0x7f0d600afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.917+0000 7f0d67600640 1 --2- 172.21.15.173:0/4260071489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d600b44d0 0x7f0d600ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:38.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.917+0000 7f0d67600640 1 -- 172.21.15.173:0/4260071489 >> 172.21.15.173:0/4260071489 conn(0x7f0d6006ac90 msgr2=0x7f0d600cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:38.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.917+0000 7f0d67600640 1 -- 172.21.15.173:0/4260071489 shutdown_connections 2024-04-25T09:13:38.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:38.921+0000 7f0d67600640 1 -- 172.21.15.173:0/4260071489 wait complete. 2024-04-25T09:13:38.923 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:13:39.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.073+0000 7feafd400640 1 Processor -- start 2024-04-25T09:13:39.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.073+0000 7feafd400640 1 -- start start 2024-04-25T09:13:39.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feafd400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf80cff40 0x7feaf80cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feafd400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf815ddd0 con 0x7feaf8159f00 2024-04-25T09:13:39.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feafd400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf815e0b0 con 0x7feaf815a2e0 2024-04-25T09:13:39.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feafd400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf815e390 con 0x7feaf80cff40 2024-04-25T09:13:39.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf6800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7feaf8159f00 0x7feaf80cb960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36102/0 (socket says 172.21.15.173:36102) 2024-04-25T09:13:39.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf6800640 1 -- 172.21.15.173:0/124126330 learned_addr learned my addr 172.21.15.173:0/124126330 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:39.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf5e00640 1 --2- 172.21.15.173:0/124126330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf80cff40 0x7feaf80cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf5400640 1 -- 172.21.15.173:0/124126330 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784854131 0 0) 0x7feaf815ddd0 con 0x7feaf8159f00 2024-04-25T09:13:39.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf5400640 1 -- 172.21.15.173:0/124126330 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feadc003530 con 0x7feaf8159f00 2024-04-25T09:13:39.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf5400640 1 -- 172.21.15.173:0/124126330 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2399897404 0 0) 0x7feadc003530 con 0x7feaf8159f00 2024-04-25T09:13:39.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf5400640 1 -- 172.21.15.173:0/124126330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf80cff40 msgr2=0x7feaf80cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:39.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf5400640 1 --2- 172.21.15.173:0/124126330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf80cff40 0x7feaf80cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf5400640 1 -- 172.21.15.173:0/124126330 >> v1:172.21.15.194:6789/0 conn(0x7feaf815a2e0 legacy=0x7feaf8071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:39.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf5400640 1 -- 172.21.15.173:0/124126330 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf815e670 con 0x7feaf8159f00 2024-04-25T09:13:39.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf5400640 1 -- 172.21.15.173:0/124126330 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7feae8001a00 con 0x7feaf8159f00 2024-04-25T09:13:39.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf5400640 1 -- 172.21.15.173:0/124126330 >> v1:172.21.15.173:6789/0 conn(0x7feaf8159f00 legacy=0x7feaf80cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:39.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf5400640 1 --2- 172.21.15.173:0/124126330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feadc0039f0 0x7feadc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf5400640 1 --2- 172.21.15.173:0/124126330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf80cff40 0x7feadc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf5400640 1 --2- 172.21.15.173:0/124126330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feadc004d50 0x7feadc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf5400640 1 -- 172.21.15.173:0/124126330 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf815e390 con 0x7feadc0039f0 2024-04-25T09:13:39.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf5400640 1 -- 172.21.15.173:0/124126330 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc00dc90 con 0x7feadc004d50 2024-04-25T09:13:39.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf5400640 1 -- 172.21.15.173:0/124126330 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc00de60 con 0x7feaf80cff40 2024-04-25T09:13:39.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf6800640 1 --2- 172.21.15.173:0/124126330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feadc0039f0 0x7feadc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf5e00640 1 --2- 172.21.15.173:0/124126330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf80cff40 0x7feadc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf7200640 1 --2- 172.21.15.173:0/124126330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feadc004d50 0x7feadc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf6800640 1 -- 172.21.15.173:0/124126330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf80cff40 msgr2=0x7feadc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:39.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf6800640 1 --2- 172.21.15.173:0/124126330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf80cff40 0x7feadc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf6800640 1 -- 172.21.15.173:0/124126330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feadc004d50 msgr2=0x7feadc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:39.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf6800640 1 --2- 172.21.15.173:0/124126330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feadc004d50 0x7feadc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf6800640 1 -- 172.21.15.173:0/124126330 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc003530 con 0x7feadc0039f0 2024-04-25T09:13:39.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.077+0000 7feaf5e00640 1 --2- 172.21.15.173:0/124126330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf80cff40 0x7feadc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:39.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.081+0000 7feaf6800640 1 --2- 172.21.15.173:0/124126330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feadc0039f0 0x7feadc003dd0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7feae800a7d0 tx=0x7feae801d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63945fd7b61bbe2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:39.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.081+0000 7feaf5400640 1 -- 172.21.15.173:0/124126330 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800a3f0 con 0x7feadc0039f0 2024-04-25T09:13:39.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.081+0000 7feaf5400640 1 -- 172.21.15.173:0/124126330 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae80ad650 con 0x7feadc0039f0 2024-04-25T09:13:39.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.081+0000 7feaf5400640 1 -- 172.21.15.173:0/124126330 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae80ada40 con 0x7feadc0039f0 2024-04-25T09:13:39.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.081+0000 7feafd400640 1 -- 172.21.15.173:0/124126330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feadc0039f0 msgr2=0x7feadc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:39.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.081+0000 7feafd400640 1 --2- 172.21.15.173:0/124126330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feadc0039f0 0x7feadc003dd0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7feae800a7d0 tx=0x7feae801d2e0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.081+0000 7feaf7200640 1 -- 172.21.15.173:0/124126330 reap_dead start 2024-04-25T09:13:39.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.081+0000 7feafd400640 1 -- 172.21.15.173:0/124126330 shutdown_connections 2024-04-25T09:13:39.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.081+0000 7feafd400640 1 -- 172.21.15.173:0/124126330 >> 172.21.15.173:0/124126330 conn(0x7feaf806ac90 msgr2=0x7feaf806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:39.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.081+0000 7feafd400640 1 -- 172.21.15.173:0/124126330 shutdown_connections 2024-04-25T09:13:39.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.081+0000 7feafd400640 1 -- 172.21.15.173:0/124126330 wait complete. 2024-04-25T09:13:39.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feafd400640 1 Processor -- start 2024-04-25T09:13:39.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feafd400640 1 -- start start 2024-04-25T09:13:39.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feafd400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feadc0039f0 0x7feaf8147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feafd400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf815b3d0 0x7feaf81f6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feafd400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaf81f6e90 0x7feaf814f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feafd400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80cd470 con 0x7feadc0039f0 2024-04-25T09:13:39.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feafd400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80cd2f0 con 0x7feaf81f6e90 2024-04-25T09:13:39.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feafd400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80cd5f0 con 0x7feaf815b3d0 2024-04-25T09:13:39.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feaf6800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feadc0039f0 0x7feaf8147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feaf6800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feadc0039f0 0x7feaf8147080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60792/0 (socket says 172.21.15.173:60792) 2024-04-25T09:13:39.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feaf6800640 1 -- 172.21.15.173:0/1609899408 learned_addr learned my addr 172.21.15.173:0/1609899408 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:39.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feaf5e00640 1 --2- 172.21.15.173:0/1609899408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf815b3d0 0x7feaf81f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feaf7200640 1 --2- 172.21.15.173:0/1609899408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaf81f6e90 0x7feaf814f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feaf6800640 1 -- 172.21.15.173:0/1609899408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf815b3d0 msgr2=0x7feaf81f6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:39.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feaf6800640 1 --2- 172.21.15.173:0/1609899408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf815b3d0 0x7feaf81f6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feaf6800640 1 -- 172.21.15.173:0/1609899408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaf81f6e90 msgr2=0x7feaf814f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:39.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feaf6800640 1 --2- 172.21.15.173:0/1609899408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaf81f6e90 0x7feaf814f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feaf6800640 1 -- 172.21.15.173:0/1609899408 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf80afd90 con 0x7feadc0039f0 2024-04-25T09:13:39.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feaf7200640 1 --2- 172.21.15.173:0/1609899408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaf81f6e90 0x7feaf814f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:39.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feaf6800640 1 --2- 172.21.15.173:0/1609899408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feadc0039f0 0x7feaf8147080 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7feae801d110 tx=0x7feadc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:39.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feaeea00640 1 -- 172.21.15.173:0/1609899408 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae80b2040 con 0x7feadc0039f0 2024-04-25T09:13:39.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feaeea00640 1 -- 172.21.15.173:0/1609899408 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae80bc070 con 0x7feadc0039f0 2024-04-25T09:13:39.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feafd400640 1 -- 172.21.15.173:0/1609899408 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf80b0070 con 0x7feadc0039f0 2024-04-25T09:13:39.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feaeea00640 1 -- 172.21.15.173:0/1609899408 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8001940 con 0x7feadc0039f0 2024-04-25T09:13:39.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feafd400640 1 -- 172.21.15.173:0/1609899408 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf81f6450 con 0x7feadc0039f0 2024-04-25T09:13:39.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.085+0000 7feafd400640 1 -- 172.21.15.173:0/1609899408 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf8073ab0 con 0x7feadc0039f0 2024-04-25T09:13:39.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.089+0000 7feaeea00640 1 -- 172.21.15.173:0/1609899408 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feae8004b70 con 0x7feadc0039f0 2024-04-25T09:13:39.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.089+0000 7feaeea00640 1 --2- 172.21.15.173:0/1609899408 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fead8066f60 0x7fead8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.089+0000 7feaeea00640 1 -- 172.21.15.173:0/1609899408 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7feae811fff0 con 0x7feadc0039f0 2024-04-25T09:13:39.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.089+0000 7feaf5e00640 1 --2- 172.21.15.173:0/1609899408 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fead8066f60 0x7fead8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.089+0000 7feaf5e00640 1 --2- 172.21.15.173:0/1609899408 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fead8066f60 0x7fead8069420 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7feaf80b2fb0 tx=0x7feae4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:39.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.093+0000 7feaeea00640 1 -- 172.21.15.173:0/1609899408 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feae8016ff0 con 0x7feadc0039f0 2024-04-25T09:13:39.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.261+0000 7feafd400640 1 -- 172.21.15.173:0/1609899408 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7feaf80cecc0 con 0x7feadc0039f0 2024-04-25T09:13:39.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.261+0000 7feaeea00640 1 -- 172.21.15.173:0/1609899408 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v134) v1 ==== 80+0+124 (secure 0 0 0) 0x7feae80f0de0 con 0x7feadc0039f0 2024-04-25T09:13:39.248 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173:6837/3627798672 2024-04-26T09:13:30.512572+0000 2024-04-25T09:13:39.248 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173:6836/3627798672 2024-04-26T09:13:30.512572+0000 2024-04-25T09:13:39.248 INFO:teuthology.orchestra.run.smithi173.stderr:listed 2 entries 2024-04-25T09:13:39.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.265+0000 7feafd400640 1 -- 172.21.15.173:0/1609899408 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fead8066f60 msgr2=0x7fead8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:39.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.265+0000 7feafd400640 1 --2- 172.21.15.173:0/1609899408 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fead8066f60 0x7fead8069420 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7feaf80b2fb0 tx=0x7feae4008040 comp rx=0 tx=0).stop 2024-04-25T09:13:39.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.265+0000 7feafd400640 1 -- 172.21.15.173:0/1609899408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feadc0039f0 msgr2=0x7feaf8147080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:39.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.265+0000 7feafd400640 1 --2- 172.21.15.173:0/1609899408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feadc0039f0 0x7feaf8147080 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7feae801d110 tx=0x7feadc005840 comp rx=0 tx=0).stop 2024-04-25T09:13:39.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.265+0000 7feafd400640 1 -- 172.21.15.173:0/1609899408 shutdown_connections 2024-04-25T09:13:39.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.265+0000 7feafd400640 1 --2- 172.21.15.173:0/1609899408 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fead8066f60 0x7fead8069420 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.265+0000 7feafd400640 1 --2- 172.21.15.173:0/1609899408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaf81f6e90 0x7feaf814f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.265+0000 7feafd400640 1 --2- 172.21.15.173:0/1609899408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf815b3d0 0x7feaf81f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.265+0000 7feafd400640 1 --2- 172.21.15.173:0/1609899408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feadc0039f0 0x7feaf8147080 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.265+0000 7feafd400640 1 -- 172.21.15.173:0/1609899408 >> 172.21.15.173:0/1609899408 conn(0x7feaf806ac90 msgr2=0x7feaf80b3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:39.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.265+0000 7feafd400640 1 -- 172.21.15.173:0/1609899408 shutdown_connections 2024-04-25T09:13:39.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.265+0000 7feafd400640 1 -- 172.21.15.173:0/1609899408 wait complete. 2024-04-25T09:13:39.270 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:13:39.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:39.270 DEBUG:teuthology.orchestra.run.smithi173:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:13:39.295 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:13:39.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:39.295 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:13:39.344 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:13:39.344 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:13:39.353 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:13:39.353 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:13:39.354 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:13:39.395 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:13:39.395 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:13:39.395 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:13:39.404 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:13:39.404 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:39.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.585+0000 7fcd55200640 1 Processor -- start 2024-04-25T09:13:39.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.585+0000 7fcd55200640 1 -- start start 2024-04-25T09:13:39.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.585+0000 7fcd55200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd500cc8b0 0x7fcd500ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.585+0000 7fcd55200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5006e7c0 con 0x7fcd50145250 2024-04-25T09:13:39.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.585+0000 7fcd55200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5006d720 con 0x7fcd500ce8f0 2024-04-25T09:13:39.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.585+0000 7fcd55200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5006da00 con 0x7fcd500cc8b0 2024-04-25T09:13:39.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.585+0000 7fcd4de00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fcd50145250 0x7fcd5015c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36116/0 (socket says 172.21.15.173:36116) 2024-04-25T09:13:39.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.585+0000 7fcd4de00640 1 -- 172.21.15.173:0/3693697474 learned_addr learned my addr 172.21.15.173:0/3693697474 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:39.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4d400640 1 --2- 172.21.15.173:0/3693697474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd500cc8b0 0x7fcd500ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4ca00640 1 -- 172.21.15.173:0/3693697474 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758573372 0 0) 0x7fcd5006e7c0 con 0x7fcd50145250 2024-04-25T09:13:39.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4ca00640 1 -- 172.21.15.173:0/3693697474 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd34003530 con 0x7fcd50145250 2024-04-25T09:13:39.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4ca00640 1 -- 172.21.15.173:0/3693697474 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 537701052 0 0) 0x7fcd34003530 con 0x7fcd50145250 2024-04-25T09:13:39.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4ca00640 1 -- 172.21.15.173:0/3693697474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd500cc8b0 msgr2=0x7fcd500ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:39.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4ca00640 1 --2- 172.21.15.173:0/3693697474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd500cc8b0 0x7fcd500ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4ca00640 1 -- 172.21.15.173:0/3693697474 >> v1:172.21.15.194:6789/0 conn(0x7fcd500ce8f0 legacy=0x7fcd500ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:39.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4ca00640 1 -- 172.21.15.173:0/3693697474 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5006dce0 con 0x7fcd50145250 2024-04-25T09:13:39.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4ca00640 1 -- 172.21.15.173:0/3693697474 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fcd40001680 con 0x7fcd50145250 2024-04-25T09:13:39.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4ca00640 1 -- 172.21.15.173:0/3693697474 >> v1:172.21.15.173:6789/0 conn(0x7fcd50145250 legacy=0x7fcd5015c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:39.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4ca00640 1 --2- 172.21.15.173:0/3693697474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd340039f0 0x7fcd34003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4ca00640 1 --2- 172.21.15.173:0/3693697474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd500cc8b0 0x7fcd34004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4ca00640 1 --2- 172.21.15.173:0/3693697474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd34004d50 0x7fcd340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4ca00640 1 -- 172.21.15.173:0/3693697474 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5006da00 con 0x7fcd34004d50 2024-04-25T09:13:39.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4ca00640 1 -- 172.21.15.173:0/3693697474 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3400bab0 con 0x7fcd340039f0 2024-04-25T09:13:39.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4ca00640 1 -- 172.21.15.173:0/3693697474 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3400bcb0 con 0x7fcd500cc8b0 2024-04-25T09:13:39.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4e800640 1 --2- 172.21.15.173:0/3693697474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd34004d50 0x7fcd340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4de00640 1 --2- 172.21.15.173:0/3693697474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd340039f0 0x7fcd34003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4d400640 1 --2- 172.21.15.173:0/3693697474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd500cc8b0 0x7fcd34004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4e800640 1 -- 172.21.15.173:0/3693697474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd500cc8b0 msgr2=0x7fcd34004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:39.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4e800640 1 --2- 172.21.15.173:0/3693697474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd500cc8b0 0x7fcd34004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4e800640 1 -- 172.21.15.173:0/3693697474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd340039f0 msgr2=0x7fcd34003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:39.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4e800640 1 --2- 172.21.15.173:0/3693697474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd340039f0 0x7fcd34003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.589+0000 7fcd4e800640 1 -- 172.21.15.173:0/3693697474 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd34003530 con 0x7fcd34004d50 2024-04-25T09:13:39.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd4e800640 1 --2- 172.21.15.173:0/3693697474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd34004d50 0x7fcd340051d0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fcd48001e40 tx=0x7fcd4801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9a391e05d0934a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:39.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd4ca00640 1 -- 172.21.15.173:0/3693697474 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48001a90 con 0x7fcd34004d50 2024-04-25T09:13:39.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd4ca00640 1 -- 172.21.15.173:0/3693697474 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd48003b80 con 0x7fcd34004d50 2024-04-25T09:13:39.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd4ca00640 1 -- 172.21.15.173:0/3693697474 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48005080 con 0x7fcd34004d50 2024-04-25T09:13:39.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd55200640 1 -- 172.21.15.173:0/3693697474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd34004d50 msgr2=0x7fcd340051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:39.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd55200640 1 --2- 172.21.15.173:0/3693697474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd34004d50 0x7fcd340051d0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fcd48001e40 tx=0x7fcd4801c760 comp rx=0 tx=0).stop 2024-04-25T09:13:39.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd4e800640 1 -- 172.21.15.173:0/3693697474 reap_dead start 2024-04-25T09:13:39.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd55200640 1 -- 172.21.15.173:0/3693697474 shutdown_connections 2024-04-25T09:13:39.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd55200640 1 -- 172.21.15.173:0/3693697474 >> 172.21.15.173:0/3693697474 conn(0x7fcd5006ac90 msgr2=0x7fcd5006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:39.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd55200640 1 -- 172.21.15.173:0/3693697474 shutdown_connections 2024-04-25T09:13:39.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd55200640 1 -- 172.21.15.173:0/3693697474 wait complete. 2024-04-25T09:13:39.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd55200640 1 Processor -- start 2024-04-25T09:13:39.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd55200640 1 -- start start 2024-04-25T09:13:39.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd55200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd34004d50 0x7fcd500c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd55200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd500c4e40 0x7fcd501f31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd55200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd501f3710 0x7fcd501f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd55200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd50145630 con 0x7fcd500c4e40 2024-04-25T09:13:39.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd55200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5006e2a0 con 0x7fcd34004d50 2024-04-25T09:13:39.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd55200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5006ef80 con 0x7fcd501f3710 2024-04-25T09:13:39.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.593+0000 7fcd4d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd500c4e40 0x7fcd501f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.597+0000 7fcd4d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd500c4e40 0x7fcd501f31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60818/0 (socket says 172.21.15.173:60818) 2024-04-25T09:13:39.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.597+0000 7fcd4d400640 1 -- 172.21.15.173:0/1858618111 learned_addr learned my addr 172.21.15.173:0/1858618111 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:39.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.597+0000 7fcd4e800640 1 --2- 172.21.15.173:0/1858618111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd501f3710 0x7fcd501f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.597+0000 7fcd4de00640 1 --2- 172.21.15.173:0/1858618111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd34004d50 0x7fcd500c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.597+0000 7fcd4d400640 1 -- 172.21.15.173:0/1858618111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd501f3710 msgr2=0x7fcd501f3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:39.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.597+0000 7fcd4d400640 1 --2- 172.21.15.173:0/1858618111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd501f3710 0x7fcd501f3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.597+0000 7fcd4d400640 1 -- 172.21.15.173:0/1858618111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd34004d50 msgr2=0x7fcd500c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:39.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.597+0000 7fcd4d400640 1 --2- 172.21.15.173:0/1858618111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd34004d50 0x7fcd500c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.597+0000 7fcd4d400640 1 -- 172.21.15.173:0/1858618111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd500c5630 con 0x7fcd500c4e40 2024-04-25T09:13:39.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.597+0000 7fcd4d400640 1 --2- 172.21.15.173:0/1858618111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd500c4e40 0x7fcd501f31d0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0119d0 tx=0x7fcd3c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:39.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.597+0000 7fcd46000640 1 -- 172.21.15.173:0/1858618111 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c00fb50 con 0x7fcd500c4e40 2024-04-25T09:13:39.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.597+0000 7fcd46000640 1 -- 172.21.15.173:0/1858618111 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c00fcf0 con 0x7fcd500c4e40 2024-04-25T09:13:39.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.597+0000 7fcd46000640 1 -- 172.21.15.173:0/1858618111 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c00fea0 con 0x7fcd500c4e40 2024-04-25T09:13:39.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.597+0000 7fcd55200640 1 -- 172.21.15.173:0/1858618111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd500c5910 con 0x7fcd500c4e40 2024-04-25T09:13:39.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.597+0000 7fcd55200640 1 -- 172.21.15.173:0/1858618111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd500c5ed0 con 0x7fcd500c4e40 2024-04-25T09:13:39.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.597+0000 7fcd55200640 1 -- 172.21.15.173:0/1858618111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd50073a40 con 0x7fcd500c4e40 2024-04-25T09:13:39.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.597+0000 7fcd46000640 1 -- 172.21.15.173:0/1858618111 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcd3c012040 con 0x7fcd500c4e40 2024-04-25T09:13:39.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.601+0000 7fcd46000640 1 --2- 172.21.15.173:0/1858618111 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd30066f90 0x7fcd30069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.601+0000 7fcd46000640 1 -- 172.21.15.173:0/1858618111 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fcd3c0857d0 con 0x7fcd500c4e40 2024-04-25T09:13:39.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.601+0000 7fcd4de00640 1 --2- 172.21.15.173:0/1858618111 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd30066f90 0x7fcd30069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.601+0000 7fcd4de00640 1 --2- 172.21.15.173:0/1858618111 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd30066f90 0x7fcd30069450 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fcd40007c70 tx=0x7fcd40001dc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:39.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.605+0000 7fcd46000640 1 -- 172.21.15.173:0/1858618111 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcd3c019030 con 0x7fcd500c4e40 2024-04-25T09:13:39.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.793+0000 7fcd55200640 1 -- 172.21.15.173:0/1858618111 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd500aef70 con 0x7fcd500c4e40 2024-04-25T09:13:39.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.793+0000 7fcd46000640 1 -- 172.21.15.173:0/1858618111 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4161 (secure 0 0 0) 0x7fcd3c056060 con 0x7fcd500c4e40 2024-04-25T09:13:39.778 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:39.778 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":93,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:34.472510+0000","modified":"2024-04-25T09:13:32.594395+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9408":{"gid":9408,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":19,"addr":"172.21.15.173:6835/1841246276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1841246276},{"type":"v1","addr":"172.21.15.173:6835","nonce":1841246276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:13:39.779 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 93 2024-04-25T09:13:39.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.793+0000 7fcd55200640 1 -- 172.21.15.173:0/1858618111 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd30066f90 msgr2=0x7fcd30069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:39.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.793+0000 7fcd55200640 1 --2- 172.21.15.173:0/1858618111 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd30066f90 0x7fcd30069450 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fcd40007c70 tx=0x7fcd40001dc0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.793+0000 7fcd55200640 1 -- 172.21.15.173:0/1858618111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd500c4e40 msgr2=0x7fcd501f31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:39.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.793+0000 7fcd55200640 1 --2- 172.21.15.173:0/1858618111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd500c4e40 0x7fcd501f31d0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0119d0 tx=0x7fcd3c011e90 comp rx=0 tx=0).stop 2024-04-25T09:13:39.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.793+0000 7fcd55200640 1 -- 172.21.15.173:0/1858618111 shutdown_connections 2024-04-25T09:13:39.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.793+0000 7fcd55200640 1 --2- 172.21.15.173:0/1858618111 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd30066f90 0x7fcd30069450 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.793+0000 7fcd55200640 1 --2- 172.21.15.173:0/1858618111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd501f3710 0x7fcd501f3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.793+0000 7fcd55200640 1 --2- 172.21.15.173:0/1858618111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd500c4e40 0x7fcd501f31d0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.793+0000 7fcd55200640 1 --2- 172.21.15.173:0/1858618111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd34004d50 0x7fcd500c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.793+0000 7fcd55200640 1 -- 172.21.15.173:0/1858618111 >> 172.21.15.173:0/1858618111 conn(0x7fcd5006ac90 msgr2=0x7fcd500b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:39.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.797+0000 7fcd55200640 1 -- 172.21.15.173:0/1858618111 shutdown_connections 2024-04-25T09:13:39.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.797+0000 7fcd55200640 1 -- 172.21.15.173:0/1858618111 wait complete. 2024-04-25T09:13:39.800 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:13:39.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.949+0000 7f5213600640 1 Processor -- start 2024-04-25T09:13:39.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.949+0000 7f5213600640 1 -- start start 2024-04-25T09:13:39.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.953+0000 7f5213600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f520c15a180 0x7f520c0b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.953+0000 7f5213600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f520c0b2ca0 0x7f520c0ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.953+0000 7f5213600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c06e860 con 0x7f520c071320 2024-04-25T09:13:39.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.953+0000 7f5213600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c0af230 con 0x7f520c0b2ca0 2024-04-25T09:13:39.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.953+0000 7f5213600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c06eb20 con 0x7f520c15a180 2024-04-25T09:13:39.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.953+0000 7f520be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f520c0b2ca0 0x7f520c0ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.953+0000 7f520be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f520c0b2ca0 0x7f520c0ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60828/0 (socket says 172.21.15.173:60828) 2024-04-25T09:13:39.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.953+0000 7f520be00640 1 -- 172.21.15.173:0/2160602385 learned_addr learned my addr 172.21.15.173:0/2160602385 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:39.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.953+0000 7f520be00640 1 -- 172.21.15.173:0/2160602385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f520c15a180 msgr2=0x7f520c0b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:39.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.953+0000 7f5210c00640 1 --2- 172.21.15.173:0/2160602385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f520c15a180 0x7f520c0b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.953+0000 7f520be00640 1 --2- 172.21.15.173:0/2160602385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f520c15a180 0x7f520c0b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.953+0000 7f520be00640 1 -- 172.21.15.173:0/2160602385 >> v1:172.21.15.194:6789/0 conn(0x7f520c071320 legacy=0x7f520c06d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:39.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.953+0000 7f520be00640 1 -- 172.21.15.173:0/2160602385 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c0aebe0 con 0x7f520c0b2ca0 2024-04-25T09:13:39.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.953+0000 7f5210c00640 1 --2- 172.21.15.173:0/2160602385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f520c15a180 0x7f520c0b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:39.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f520be00640 1 --2- 172.21.15.173:0/2160602385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f520c0b2ca0 0x7f520c0ccf20 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009870 tx=0x7f51f801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86fd0d5582faf139 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:39.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f520b400640 1 -- 172.21.15.173:0/2160602385 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80b0070 con 0x7f520c0b2ca0 2024-04-25T09:13:39.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f520b400640 1 -- 172.21.15.173:0/2160602385 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f80ab600 con 0x7f520c0b2ca0 2024-04-25T09:13:39.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f520b400640 1 -- 172.21.15.173:0/2160602385 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80ab9d0 con 0x7f520c0b2ca0 2024-04-25T09:13:39.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f5213600640 1 -- 172.21.15.173:0/2160602385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f520c0b2ca0 msgr2=0x7f520c0ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:39.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f5213600640 1 --2- 172.21.15.173:0/2160602385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f520c0b2ca0 0x7f520c0ccf20 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009870 tx=0x7f51f801c520 comp rx=0 tx=0).stop 2024-04-25T09:13:39.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f5213600640 1 -- 172.21.15.173:0/2160602385 shutdown_connections 2024-04-25T09:13:39.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f5213600640 1 --2- 172.21.15.173:0/2160602385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f520c0b2ca0 0x7f520c0ccf20 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f5213600640 1 --2- 172.21.15.173:0/2160602385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f520c15a180 0x7f520c0b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f5213600640 1 -- 172.21.15.173:0/2160602385 >> 172.21.15.173:0/2160602385 conn(0x7f520c06ac90 msgr2=0x7f520c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:39.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f5213600640 1 -- 172.21.15.173:0/2160602385 shutdown_connections 2024-04-25T09:13:39.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f5213600640 1 -- 172.21.15.173:0/2160602385 wait complete. 2024-04-25T09:13:39.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f5213600640 1 Processor -- start 2024-04-25T09:13:39.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f5213600640 1 -- start start 2024-04-25T09:13:39.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f5213600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f520c071320 0x7f520c14b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f5213600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f520c0b2ca0 0x7f520c14c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f5213600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f520c15a180 0x7f520c14c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f5213600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0cfaf0 con 0x7f520c15a180 2024-04-25T09:13:39.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f5213600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0cf970 con 0x7f520c071320 2024-04-25T09:13:39.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f5213600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0cfc70 con 0x7f520c0b2ca0 2024-04-25T09:13:39.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.957+0000 7f5211600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f520c15a180 0x7f520c14c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f520be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f520c0b2ca0 0x7f520c14c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f5211600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f520c15a180 0x7f520c14c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60832/0 (socket says 172.21.15.173:60832) 2024-04-25T09:13:39.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f5211600640 1 -- 172.21.15.173:0/3644771535 learned_addr learned my addr 172.21.15.173:0/3644771535 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:39.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f5210c00640 1 --2- 172.21.15.173:0/3644771535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f520c071320 0x7f520c14b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f5211600640 1 -- 172.21.15.173:0/3644771535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f520c0b2ca0 msgr2=0x7f520c14c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:39.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f5211600640 1 --2- 172.21.15.173:0/3644771535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f520c0b2ca0 0x7f520c14c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f5211600640 1 -- 172.21.15.173:0/3644771535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f520c071320 msgr2=0x7f520c14b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:39.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f5211600640 1 --2- 172.21.15.173:0/3644771535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f520c071320 0x7f520c14b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:39.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f5211600640 1 -- 172.21.15.173:0/3644771535 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c0acba0 con 0x7f520c15a180 2024-04-25T09:13:39.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f5211600640 1 --2- 172.21.15.173:0/3644771535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f520c15a180 0x7f520c14c710 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f520400b410 tx=0x7f520400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:39.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f5208c00640 1 -- 172.21.15.173:0/3644771535 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204015020 con 0x7f520c15a180 2024-04-25T09:13:39.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f5208c00640 1 -- 172.21.15.173:0/3644771535 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5204011870 con 0x7f520c15a180 2024-04-25T09:13:39.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f5213600640 1 -- 172.21.15.173:0/3644771535 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c0ace80 con 0x7f520c15a180 2024-04-25T09:13:39.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f5208c00640 1 -- 172.21.15.173:0/3644771535 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204011c60 con 0x7f520c15a180 2024-04-25T09:13:39.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f5213600640 1 -- 172.21.15.173:0/3644771535 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c14cc50 con 0x7f520c15a180 2024-04-25T09:13:39.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f5213600640 1 -- 172.21.15.173:0/3644771535 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c0ad050 con 0x7f520c15a180 2024-04-25T09:13:39.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f5208c00640 1 -- 172.21.15.173:0/3644771535 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5204018020 con 0x7f520c15a180 2024-04-25T09:13:39.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f5208c00640 1 --2- 172.21.15.173:0/3644771535 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f51ec066f60 0x7f51ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:39.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.961+0000 7f5208c00640 1 -- 172.21.15.173:0/3644771535 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f5204084d20 con 0x7f520c15a180 2024-04-25T09:13:39.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.965+0000 7f5210c00640 1 --2- 172.21.15.173:0/3644771535 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f51ec066f60 0x7f51ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:39.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.965+0000 7f5210c00640 1 --2- 172.21.15.173:0/3644771535 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f51ec066f60 0x7f51ec069420 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00d620 tx=0x7f51fc007810 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:39.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:39.965+0000 7f5208c00640 1 -- 172.21.15.173:0/3644771535 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f520401f030 con 0x7f520c15a180 2024-04-25T09:13:40.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.125+0000 7f5213600640 1 -- 172.21.15.173:0/3644771535 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f520c073a40 con 0x7f520c15a180 2024-04-25T09:13:40.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.125+0000 7f5208c00640 1 -- 172.21.15.173:0/3644771535 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+17091 (secure 0 0 0) 0x7f5204055460 con 0x7f520c15a180 2024-04-25T09:13:40.111 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:40.111 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":134,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:13:30.512676+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:12:32.846423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-04-25T09:12:33.466675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:6837/3627798672":"2024-04-26T09:13:30.512572+0000","172.21.15.173:6836/3627798672":"2024-04-26T09:13:30.512572+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:13:40.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.129+0000 7f5213600640 1 -- 172.21.15.173:0/3644771535 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f51ec066f60 msgr2=0x7f51ec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:40.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.129+0000 7f5213600640 1 --2- 172.21.15.173:0/3644771535 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f51ec066f60 0x7f51ec069420 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00d620 tx=0x7f51fc007810 comp rx=0 tx=0).stop 2024-04-25T09:13:40.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.129+0000 7f5213600640 1 -- 172.21.15.173:0/3644771535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f520c15a180 msgr2=0x7f520c14c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:40.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.129+0000 7f5213600640 1 --2- 172.21.15.173:0/3644771535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f520c15a180 0x7f520c14c710 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f520400b410 tx=0x7f520400b8d0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.129+0000 7f5213600640 1 -- 172.21.15.173:0/3644771535 shutdown_connections 2024-04-25T09:13:40.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.129+0000 7f5213600640 1 --2- 172.21.15.173:0/3644771535 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f51ec066f60 0x7f51ec069420 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.129+0000 7f5213600640 1 --2- 172.21.15.173:0/3644771535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f520c15a180 0x7f520c14c710 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.129+0000 7f5213600640 1 --2- 172.21.15.173:0/3644771535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f520c0b2ca0 0x7f520c14c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.129+0000 7f5213600640 1 --2- 172.21.15.173:0/3644771535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f520c071320 0x7f520c14b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.129+0000 7f5213600640 1 -- 172.21.15.173:0/3644771535 >> 172.21.15.173:0/3644771535 conn(0x7f520c06ac90 msgr2=0x7f520c0ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:40.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.129+0000 7f5213600640 1 -- 172.21.15.173:0/3644771535 shutdown_connections 2024-04-25T09:13:40.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.129+0000 7f5213600640 1 -- 172.21.15.173:0/3644771535 wait complete. 2024-04-25T09:13:40.132 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:12:32.846423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:12:33.466675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '133', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:13:40.132 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:13:40.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.301+0000 7fa7b3400640 1 Processor -- start 2024-04-25T09:13:40.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7b3400640 1 -- start start 2024-04-25T09:13:40.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7b3400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa7ac0aff70 0x7fa7ac15d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7b3400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7ac072a30 0x7fa7ac072e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7b3400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa7ac06ac90 0x7fa7ac06b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7b3400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ac06b640 con 0x7fa7ac0aff70 2024-04-25T09:13:40.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7b3400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ac0cbc10 con 0x7fa7ac06ac90 2024-04-25T09:13:40.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7b3400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac0cd380 con 0x7fa7ac072a30 2024-04-25T09:13:40.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7b0a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa7ac0aff70 0x7fa7ac15d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7b0a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa7ac0aff70 0x7fa7ac15d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60842/0 (socket says 172.21.15.173:60842) 2024-04-25T09:13:40.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7b0a00640 1 -- 172.21.15.173:0/247875204 learned_addr learned my addr 172.21.15.173:0/247875204 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:40.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7abe00640 1 --2- 172.21.15.173:0/247875204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7ac072a30 0x7fa7ac072e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7b1400640 1 --2- 172.21.15.173:0/247875204 >> v2:172.21.15.194:3300/0 conn(0x7fa7ac06ac90 0x7fa7ac06b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7b0a00640 1 -- 172.21.15.173:0/247875204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7ac072a30 msgr2=0x7fa7ac072e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:40.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7b0a00640 1 --2- 172.21.15.173:0/247875204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7ac072a30 0x7fa7ac072e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7b0a00640 1 -- 172.21.15.173:0/247875204 >> v2:172.21.15.194:3300/0 conn(0x7fa7ac06ac90 msgr2=0x7fa7ac06b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:40.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7b0a00640 1 --2- 172.21.15.173:0/247875204 >> v2:172.21.15.194:3300/0 conn(0x7fa7ac06ac90 0x7fa7ac06b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7b0a00640 1 -- 172.21.15.173:0/247875204 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac0cd660 con 0x7fa7ac0aff70 2024-04-25T09:13:40.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7b1400640 1 --2- 172.21.15.173:0/247875204 >> v2:172.21.15.194:3300/0 conn(0x7fa7ac06ac90 0x7fa7ac06b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:40.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.305+0000 7fa7abe00640 1 --2- 172.21.15.173:0/247875204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7ac072a30 0x7fa7ac072e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:40.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.309+0000 7fa7b0a00640 1 --2- 172.21.15.173:0/247875204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7ac0aff70 0x7fa7ac15d030 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac06d670 tx=0x7fa7a001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b577086addb9f742 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:40.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.309+0000 7fa7ab400640 1 -- 172.21.15.173:0/247875204 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a00a6040 con 0x7fa7ac0aff70 2024-04-25T09:13:40.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.309+0000 7fa7ab400640 1 -- 172.21.15.173:0/247875204 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a00af070 con 0x7fa7ac0aff70 2024-04-25T09:13:40.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.309+0000 7fa7ab400640 1 -- 172.21.15.173:0/247875204 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a00aa860 con 0x7fa7ac0aff70 2024-04-25T09:13:40.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.309+0000 7fa7b3400640 1 -- 172.21.15.173:0/247875204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7ac0aff70 msgr2=0x7fa7ac15d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:40.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.309+0000 7fa7b3400640 1 --2- 172.21.15.173:0/247875204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7ac0aff70 0x7fa7ac15d030 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac06d670 tx=0x7fa7a001c520 comp rx=0 tx=0).stop 2024-04-25T09:13:40.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.309+0000 7fa7b3400640 1 -- 172.21.15.173:0/247875204 shutdown_connections 2024-04-25T09:13:40.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.309+0000 7fa7b3400640 1 --2- 172.21.15.173:0/247875204 >> v2:172.21.15.194:3300/0 conn(0x7fa7ac06ac90 0x7fa7ac06b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.309+0000 7fa7b3400640 1 --2- 172.21.15.173:0/247875204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7ac072a30 0x7fa7ac072e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.309+0000 7fa7b3400640 1 --2- 172.21.15.173:0/247875204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7ac0aff70 0x7fa7ac15d030 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.309+0000 7fa7b3400640 1 -- 172.21.15.173:0/247875204 >> 172.21.15.173:0/247875204 conn(0x7fa7ac0b23f0 msgr2=0x7fa7ac0b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:40.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.309+0000 7fa7b3400640 1 -- 172.21.15.173:0/247875204 shutdown_connections 2024-04-25T09:13:40.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.309+0000 7fa7b3400640 1 -- 172.21.15.173:0/247875204 wait complete. 2024-04-25T09:13:40.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b3400640 1 Processor -- start 2024-04-25T09:13:40.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b3400640 1 -- start start 2024-04-25T09:13:40.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7ac06ac90 0x7fa7ac14cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b3400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7ac072a30 0x7fa7ac0b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7ac15af30 0x7fa7ac15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b3400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac15c9a0 con 0x7fa7ac06ac90 2024-04-25T09:13:40.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b3400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac0cd030 con 0x7fa7ac15af30 2024-04-25T09:13:40.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b3400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac15cb20 con 0x7fa7ac072a30 2024-04-25T09:13:40.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b0a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7ac06ac90 0x7fa7ac14cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b0a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7ac06ac90 0x7fa7ac14cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60844/0 (socket says 172.21.15.173:60844) 2024-04-25T09:13:40.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b0a00640 1 -- 172.21.15.173:0/248600488 learned_addr learned my addr 172.21.15.173:0/248600488 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:40.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7abe00640 1 --2- 172.21.15.173:0/248600488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7ac072a30 0x7fa7ac0b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b1400640 1 --2- 172.21.15.173:0/248600488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7ac15af30 0x7fa7ac15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b0a00640 1 -- 172.21.15.173:0/248600488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7ac072a30 msgr2=0x7fa7ac0b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:40.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b0a00640 1 --2- 172.21.15.173:0/248600488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7ac072a30 0x7fa7ac0b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b0a00640 1 -- 172.21.15.173:0/248600488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7ac15af30 msgr2=0x7fa7ac15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:40.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b0a00640 1 --2- 172.21.15.173:0/248600488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7ac15af30 0x7fa7ac15b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b0a00640 1 -- 172.21.15.173:0/248600488 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac14e090 con 0x7fa7ac06ac90 2024-04-25T09:13:40.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b0a00640 1 --2- 172.21.15.173:0/248600488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7ac06ac90 0x7fa7ac14cb40 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fa7a001abd0 tx=0x7fa7a001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:40.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7a8c00640 1 -- 172.21.15.173:0/248600488 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a00bd5f0 con 0x7fa7ac06ac90 2024-04-25T09:13:40.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7a8c00640 1 -- 172.21.15.173:0/248600488 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a00bd790 con 0x7fa7ac06ac90 2024-04-25T09:13:40.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b3400640 1 -- 172.21.15.173:0/248600488 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ac14e370 con 0x7fa7ac06ac90 2024-04-25T09:13:40.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7a8c00640 1 -- 172.21.15.173:0/248600488 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a00bdb40 con 0x7fa7ac06ac90 2024-04-25T09:13:40.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.313+0000 7fa7b3400640 1 -- 172.21.15.173:0/248600488 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ac14e930 con 0x7fa7ac06ac90 2024-04-25T09:13:40.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.317+0000 7fa7b3400640 1 -- 172.21.15.173:0/248600488 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ac073ab0 con 0x7fa7ac06ac90 2024-04-25T09:13:40.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.317+0000 7fa7a8c00640 1 -- 172.21.15.173:0/248600488 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa7a00b33f0 con 0x7fa7ac06ac90 2024-04-25T09:13:40.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.317+0000 7fa7a8c00640 1 --2- 172.21.15.173:0/248600488 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa78c066f60 0x7fa78c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.317+0000 7fa7a8c00640 1 -- 172.21.15.173:0/248600488 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fa7a011f2e0 con 0x7fa7ac06ac90 2024-04-25T09:13:40.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.317+0000 7fa7abe00640 1 --2- 172.21.15.173:0/248600488 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa78c066f60 0x7fa78c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.317+0000 7fa7abe00640 1 --2- 172.21.15.173:0/248600488 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa78c066f60 0x7fa78c069420 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0b1b30 tx=0x7fa798008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:40.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.321+0000 7fa7a8c00640 1 -- 172.21.15.173:0/248600488 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa7a00c3060 con 0x7fa7ac06ac90 2024-04-25T09:13:40.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.477+0000 7fa7b3400640 1 -- 172.21.15.173:0/248600488 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa7ac0b5220 con 0x7fa7ac06ac90 2024-04-25T09:13:40.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.477+0000 7fa7a8c00640 1 -- 172.21.15.173:0/248600488 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v134) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7a0016110 con 0x7fa7ac06ac90 2024-04-25T09:13:40.461 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:13:40.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.477+0000 7fa7b3400640 1 -- 172.21.15.173:0/248600488 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa78c066f60 msgr2=0x7fa78c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:40.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.477+0000 7fa7b3400640 1 --2- 172.21.15.173:0/248600488 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa78c066f60 0x7fa78c069420 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0b1b30 tx=0x7fa798008040 comp rx=0 tx=0).stop 2024-04-25T09:13:40.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.477+0000 7fa7b3400640 1 -- 172.21.15.173:0/248600488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7ac06ac90 msgr2=0x7fa7ac14cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:40.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.477+0000 7fa7b3400640 1 --2- 172.21.15.173:0/248600488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7ac06ac90 0x7fa7ac14cb40 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fa7a001abd0 tx=0x7fa7a001ad60 comp rx=0 tx=0).stop 2024-04-25T09:13:40.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.477+0000 7fa7b3400640 1 -- 172.21.15.173:0/248600488 shutdown_connections 2024-04-25T09:13:40.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.477+0000 7fa7b3400640 1 --2- 172.21.15.173:0/248600488 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa78c066f60 0x7fa78c069420 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.477+0000 7fa7b3400640 1 --2- 172.21.15.173:0/248600488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7ac15af30 0x7fa7ac15b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.477+0000 7fa7b3400640 1 --2- 172.21.15.173:0/248600488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7ac072a30 0x7fa7ac0b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.477+0000 7fa7b3400640 1 --2- 172.21.15.173:0/248600488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7ac06ac90 0x7fa7ac14cb40 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.477+0000 7fa7b3400640 1 -- 172.21.15.173:0/248600488 >> 172.21.15.173:0/248600488 conn(0x7fa7ac0b23f0 msgr2=0x7fa7ac158770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:40.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.477+0000 7fa7b3400640 1 -- 172.21.15.173:0/248600488 shutdown_connections 2024-04-25T09:13:40.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.477+0000 7fa7b3400640 1 -- 172.21.15.173:0/248600488 wait complete. 2024-04-25T09:13:40.482 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:13:40.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.637+0000 7f2bbda00640 1 Processor -- start 2024-04-25T09:13:40.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.637+0000 7f2bbda00640 1 -- start start 2024-04-25T09:13:40.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.637+0000 7f2bbda00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2bb80b3fe0 0x7f2bb80b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.637+0000 7f2bbda00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2bb80cc260 0x7f2bb80cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.637+0000 7f2bbda00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb806d4b0 con 0x7f2bb8145290 2024-04-25T09:13:40.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.637+0000 7f2bbda00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb806d790 con 0x7f2bb80b3fe0 2024-04-25T09:13:40.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.637+0000 7f2bbda00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb806da70 con 0x7f2bb80cc260 2024-04-25T09:13:40.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.637+0000 7f2bb6000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2bb80b3fe0 0x7f2bb80b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.637+0000 7f2bb6000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2bb80b3fe0 0x7f2bb80b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60860/0 (socket says 172.21.15.173:60860) 2024-04-25T09:13:40.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.637+0000 7f2bb6000640 1 -- 172.21.15.173:0/3958891370 learned_addr learned my addr 172.21.15.173:0/3958891370 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:40.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.641+0000 7f2bb7400640 1 --2- 172.21.15.173:0/3958891370 >> v2:172.21.15.194:3300/0 conn(0x7f2bb80cc260 0x7f2bb80cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.641+0000 7f2bb6000640 1 -- 172.21.15.173:0/3958891370 >> v2:172.21.15.194:3300/0 conn(0x7f2bb80cc260 msgr2=0x7f2bb80cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:40.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.641+0000 7f2bb6000640 1 --2- 172.21.15.173:0/3958891370 >> v2:172.21.15.194:3300/0 conn(0x7f2bb80cc260 0x7f2bb80cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.641+0000 7f2bb6000640 1 -- 172.21.15.173:0/3958891370 >> v1:172.21.15.194:6789/0 conn(0x7f2bb8145290 legacy=0x7f2bb815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:40.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.641+0000 7f2bb6000640 1 -- 172.21.15.173:0/3958891370 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb806dd50 con 0x7f2bb80b3fe0 2024-04-25T09:13:40.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.641+0000 7f2bb6000640 1 --2- 172.21.15.173:0/3958891370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bb80b3fe0 0x7f2bb80b4450 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f2bb815f5b0 tx=0x7f2ba401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d5ae887c1716b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:40.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.641+0000 7f2bb5600640 1 -- 172.21.15.173:0/3958891370 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba40b0070 con 0x7f2bb80b3fe0 2024-04-25T09:13:40.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.641+0000 7f2bb5600640 1 -- 172.21.15.173:0/3958891370 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba40ab600 con 0x7f2bb80b3fe0 2024-04-25T09:13:40.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.641+0000 7f2bb5600640 1 -- 172.21.15.173:0/3958891370 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba40ab9d0 con 0x7f2bb80b3fe0 2024-04-25T09:13:40.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.641+0000 7f2bbda00640 1 -- 172.21.15.173:0/3958891370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bb80b3fe0 msgr2=0x7f2bb80b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:40.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.641+0000 7f2bbda00640 1 --2- 172.21.15.173:0/3958891370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bb80b3fe0 0x7f2bb80b4450 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f2bb815f5b0 tx=0x7f2ba401c3c0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.641+0000 7f2bbda00640 1 -- 172.21.15.173:0/3958891370 shutdown_connections 2024-04-25T09:13:40.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.641+0000 7f2bbda00640 1 --2- 172.21.15.173:0/3958891370 >> v2:172.21.15.194:3300/0 conn(0x7f2bb80cc260 0x7f2bb80cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.641+0000 7f2bbda00640 1 --2- 172.21.15.173:0/3958891370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bb80b3fe0 0x7f2bb80b4450 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.641+0000 7f2bbda00640 1 -- 172.21.15.173:0/3958891370 >> 172.21.15.173:0/3958891370 conn(0x7f2bb806ac90 msgr2=0x7f2bb806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:40.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.641+0000 7f2bbda00640 1 -- 172.21.15.173:0/3958891370 shutdown_connections 2024-04-25T09:13:40.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bbda00640 1 -- 172.21.15.173:0/3958891370 wait complete. 2024-04-25T09:13:40.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bbda00640 1 Processor -- start 2024-04-25T09:13:40.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bbda00640 1 -- start start 2024-04-25T09:13:40.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bbda00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bb80b3fe0 0x7f2bb80cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bbda00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2bb80cc260 0x7f2bb81f7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bbda00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bb8145290 0x7f2bb80ce690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bbda00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb806eee0 con 0x7f2bb8145290 2024-04-25T09:13:40.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bbda00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb806ed60 con 0x7f2bb80b3fe0 2024-04-25T09:13:40.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bbda00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb806f060 con 0x7f2bb80cc260 2024-04-25T09:13:40.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bb7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bb8145290 0x7f2bb80ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bb7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bb8145290 0x7f2bb80ce690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60864/0 (socket says 172.21.15.173:60864) 2024-04-25T09:13:40.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bb7400640 1 -- 172.21.15.173:0/159560936 learned_addr learned my addr 172.21.15.173:0/159560936 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:40.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bb6a00640 1 --2- 172.21.15.173:0/159560936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bb80b3fe0 0x7f2bb80cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bb6000640 1 --2- 172.21.15.173:0/159560936 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2bb80cc260 0x7f2bb81f7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bb7400640 1 -- 172.21.15.173:0/159560936 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2bb80cc260 msgr2=0x7f2bb81f7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:40.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bb7400640 1 --2- 172.21.15.173:0/159560936 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2bb80cc260 0x7f2bb81f7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bb7400640 1 -- 172.21.15.173:0/159560936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bb80b3fe0 msgr2=0x7f2bb80cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:40.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bb7400640 1 --2- 172.21.15.173:0/159560936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bb80b3fe0 0x7f2bb80cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bb7400640 1 -- 172.21.15.173:0/159560936 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb80cebd0 con 0x7f2bb8145290 2024-04-25T09:13:40.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bb7400640 1 --2- 172.21.15.173:0/159560936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bb8145290 0x7f2bb80ce690 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000d560 tx=0x7f2bb000da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:40.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2baea00640 1 -- 172.21.15.173:0/159560936 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00125f0 con 0x7f2bb8145290 2024-04-25T09:13:40.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2baea00640 1 -- 172.21.15.173:0/159560936 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb0019070 con 0x7f2bb8145290 2024-04-25T09:13:40.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2baea00640 1 -- 172.21.15.173:0/159560936 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00129f0 con 0x7f2bb8145290 2024-04-25T09:13:40.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.645+0000 7f2bbda00640 1 -- 172.21.15.173:0/159560936 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb815b6e0 con 0x7f2bb8145290 2024-04-25T09:13:40.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.649+0000 7f2bbda00640 1 -- 172.21.15.173:0/159560936 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb80ad0c0 con 0x7f2bb8145290 2024-04-25T09:13:40.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.649+0000 7f2bbda00640 1 -- 172.21.15.173:0/159560936 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb8073ab0 con 0x7f2bb8145290 2024-04-25T09:13:40.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.649+0000 7f2baea00640 1 -- 172.21.15.173:0/159560936 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2bb0012b90 con 0x7f2bb8145290 2024-04-25T09:13:40.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.649+0000 7f2baea00640 1 --2- 172.21.15.173:0/159560936 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2b98066f60 0x7f2b98069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.649+0000 7f2baea00640 1 -- 172.21.15.173:0/159560936 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f2bb0085440 con 0x7f2bb8145290 2024-04-25T09:13:40.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.649+0000 7f2bb6a00640 1 --2- 172.21.15.173:0/159560936 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2b98066f60 0x7f2b98069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.649+0000 7f2bb6a00640 1 --2- 172.21.15.173:0/159560936 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2b98066f60 0x7f2b98069420 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800b450 tx=0x7f2ba800d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:40.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.653+0000 7f2baea00640 1 -- 172.21.15.173:0/159560936 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2bb0055c20 con 0x7f2bb8145290 2024-04-25T09:13:40.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.809+0000 7f2bbda00640 1 -- 172.21.15.173:0/159560936 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2bb813e010 con 0x7f2bb8145290 2024-04-25T09:13:40.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.809+0000 7f2baea00640 1 -- 172.21.15.173:0/159560936 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v134) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2bb0059cc0 con 0x7f2bb8145290 2024-04-25T09:13:40.796 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:13:40.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.813+0000 7f2bbda00640 1 -- 172.21.15.173:0/159560936 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2b98066f60 msgr2=0x7f2b98069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:40.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.813+0000 7f2bbda00640 1 --2- 172.21.15.173:0/159560936 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2b98066f60 0x7f2b98069420 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800b450 tx=0x7f2ba800d040 comp rx=0 tx=0).stop 2024-04-25T09:13:40.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.813+0000 7f2bbda00640 1 -- 172.21.15.173:0/159560936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bb8145290 msgr2=0x7f2bb80ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:40.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.813+0000 7f2bbda00640 1 --2- 172.21.15.173:0/159560936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bb8145290 0x7f2bb80ce690 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000d560 tx=0x7f2bb000da20 comp rx=0 tx=0).stop 2024-04-25T09:13:40.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.813+0000 7f2bbda00640 1 -- 172.21.15.173:0/159560936 shutdown_connections 2024-04-25T09:13:40.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.813+0000 7f2bbda00640 1 --2- 172.21.15.173:0/159560936 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2b98066f60 0x7f2b98069420 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.813+0000 7f2bbda00640 1 --2- 172.21.15.173:0/159560936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bb8145290 0x7f2bb80ce690 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.813+0000 7f2bbda00640 1 --2- 172.21.15.173:0/159560936 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2bb80cc260 0x7f2bb81f7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.813+0000 7f2bbda00640 1 --2- 172.21.15.173:0/159560936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bb80b3fe0 0x7f2bb80cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.813+0000 7f2bbda00640 1 -- 172.21.15.173:0/159560936 >> 172.21.15.173:0/159560936 conn(0x7f2bb806ac90 msgr2=0x7f2bb813e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:40.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.813+0000 7f2bbda00640 1 -- 172.21.15.173:0/159560936 shutdown_connections 2024-04-25T09:13:40.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.813+0000 7f2bbda00640 1 -- 172.21.15.173:0/159560936 wait complete. 2024-04-25T09:13:40.817 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:13:40.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.969+0000 7f4344200640 1 Processor -- start 2024-04-25T09:13:40.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.973+0000 7f4344200640 1 -- start start 2024-04-25T09:13:40.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.973+0000 7f4344200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f433c145290 0x7f433c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.973+0000 7f4344200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f433c0b3fe0 0x7f433c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.973+0000 7f4344200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433c15c5f0 con 0x7f433c0cc260 2024-04-25T09:13:40.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.973+0000 7f4344200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433c0ccd80 con 0x7f433c0b3fe0 2024-04-25T09:13:40.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.973+0000 7f4344200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433c06d4b0 con 0x7f433c145290 2024-04-25T09:13:40.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.973+0000 7f4340e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f433c0b3fe0 0x7f433c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.973+0000 7f4340e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f433c0b3fe0 0x7f433c0b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60870/0 (socket says 172.21.15.173:60870) 2024-04-25T09:13:40.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.973+0000 7f4340e00640 1 -- 172.21.15.173:0/2845810713 learned_addr learned my addr 172.21.15.173:0/2845810713 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:40.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.973+0000 7f4341800640 1 --2- 172.21.15.173:0/2845810713 >> v2:172.21.15.194:3300/0 conn(0x7f433c145290 0x7f433c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.973+0000 7f4340e00640 1 -- 172.21.15.173:0/2845810713 >> v2:172.21.15.194:3300/0 conn(0x7f433c145290 msgr2=0x7f433c15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:40.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.973+0000 7f4340e00640 1 --2- 172.21.15.173:0/2845810713 >> v2:172.21.15.194:3300/0 conn(0x7f433c145290 0x7f433c15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.973+0000 7f4340e00640 1 -- 172.21.15.173:0/2845810713 >> v1:172.21.15.194:6789/0 conn(0x7f433c0cc260 legacy=0x7f433c0cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:40.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.973+0000 7f4340e00640 1 -- 172.21.15.173:0/2845810713 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c06d790 con 0x7f433c0b3fe0 2024-04-25T09:13:40.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.977+0000 7f4340e00640 1 --2- 172.21.15.173:0/2845810713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f433c0b3fe0 0x7f433c0b4450 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f433c0d0800 tx=0x7f432801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb4a7c3f21591a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:40.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.977+0000 7f433be00640 1 -- 172.21.15.173:0/2845810713 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43280b1070 con 0x7f433c0b3fe0 2024-04-25T09:13:40.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.977+0000 7f433be00640 1 -- 172.21.15.173:0/2845810713 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43280ac640 con 0x7f433c0b3fe0 2024-04-25T09:13:40.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.977+0000 7f433be00640 1 -- 172.21.15.173:0/2845810713 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43280aca10 con 0x7f433c0b3fe0 2024-04-25T09:13:40.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.977+0000 7f4344200640 1 -- 172.21.15.173:0/2845810713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f433c0b3fe0 msgr2=0x7f433c0b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:40.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.977+0000 7f4344200640 1 --2- 172.21.15.173:0/2845810713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f433c0b3fe0 0x7f433c0b4450 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f433c0d0800 tx=0x7f432801c400 comp rx=0 tx=0).stop 2024-04-25T09:13:40.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.977+0000 7f4344200640 1 -- 172.21.15.173:0/2845810713 shutdown_connections 2024-04-25T09:13:40.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.977+0000 7f4344200640 1 --2- 172.21.15.173:0/2845810713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f433c0b3fe0 0x7f433c0b4450 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.977+0000 7f4344200640 1 --2- 172.21.15.173:0/2845810713 >> v2:172.21.15.194:3300/0 conn(0x7f433c145290 0x7f433c15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.977+0000 7f4344200640 1 -- 172.21.15.173:0/2845810713 >> 172.21.15.173:0/2845810713 conn(0x7f433c06ac90 msgr2=0x7f433c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:40.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.977+0000 7f4344200640 1 -- 172.21.15.173:0/2845810713 shutdown_connections 2024-04-25T09:13:40.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.977+0000 7f4344200640 1 -- 172.21.15.173:0/2845810713 wait complete. 2024-04-25T09:13:40.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.977+0000 7f4344200640 1 Processor -- start 2024-04-25T09:13:40.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.977+0000 7f4344200640 1 -- start start 2024-04-25T09:13:40.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4344200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f433c0b3fe0 0x7f433c13c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4344200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f433c0cc260 0x7f433c15c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4344200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f433c145290 0x7f433c15cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4344200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c1457f0 con 0x7f433c145290 2024-04-25T09:13:40.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4344200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c145670 con 0x7f433c0cc260 2024-04-25T09:13:40.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4344200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433c06ed60 con 0x7f433c0b3fe0 2024-04-25T09:13:40.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4342200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f433c145290 0x7f433c15cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4342200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f433c145290 0x7f433c15cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60876/0 (socket says 172.21.15.173:60876) 2024-04-25T09:13:40.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4342200640 1 -- 172.21.15.173:0/3588497319 learned_addr learned my addr 172.21.15.173:0/3588497319 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:40.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4341800640 1 --2- 172.21.15.173:0/3588497319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f433c0b3fe0 0x7f433c13c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4340e00640 1 --2- 172.21.15.173:0/3588497319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f433c0cc260 0x7f433c15c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4342200640 1 -- 172.21.15.173:0/3588497319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f433c0b3fe0 msgr2=0x7f433c13c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:40.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4342200640 1 --2- 172.21.15.173:0/3588497319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f433c0b3fe0 0x7f433c13c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4342200640 1 -- 172.21.15.173:0/3588497319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f433c0cc260 msgr2=0x7f433c15c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:40.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4342200640 1 --2- 172.21.15.173:0/3588497319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f433c0cc260 0x7f433c15c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:40.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4342200640 1 -- 172.21.15.173:0/3588497319 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c15b260 con 0x7f433c145290 2024-04-25T09:13:40.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4342200640 1 --2- 172.21.15.173:0/3588497319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f433c145290 0x7f433c15cd10 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f433400c770 tx=0x7f433400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:40.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4339600640 1 -- 172.21.15.173:0/3588497319 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4334003b80 con 0x7f433c145290 2024-04-25T09:13:40.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4339600640 1 -- 172.21.15.173:0/3588497319 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4334003d20 con 0x7f433c145290 2024-04-25T09:13:40.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4344200640 1 -- 172.21.15.173:0/3588497319 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433c13e480 con 0x7f433c145290 2024-04-25T09:13:40.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4339600640 1 -- 172.21.15.173:0/3588497319 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433400aa90 con 0x7f433c145290 2024-04-25T09:13:40.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4344200640 1 -- 172.21.15.173:0/3588497319 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433c13ea40 con 0x7f433c145290 2024-04-25T09:13:40.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4344200640 1 -- 172.21.15.173:0/3588497319 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433c073ab0 con 0x7f433c145290 2024-04-25T09:13:40.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.981+0000 7f4339600640 1 -- 172.21.15.173:0/3588497319 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f433400ac30 con 0x7f433c145290 2024-04-25T09:13:40.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.985+0000 7f4339600640 1 --2- 172.21.15.173:0/3588497319 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f431c066f60 0x7f431c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:40.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.985+0000 7f4339600640 1 -- 172.21.15.173:0/3588497319 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f4334084ff0 con 0x7f433c145290 2024-04-25T09:13:40.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.985+0000 7f4341800640 1 --2- 172.21.15.173:0/3588497319 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f431c066f60 0x7f431c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:40.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.985+0000 7f4341800640 1 --2- 172.21.15.173:0/3588497319 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f431c066f60 0x7f431c069420 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f43300079c0 tx=0x7f4330008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:40.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:40.989+0000 7f4339600640 1 -- 172.21.15.173:0/3588497319 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f433c15c5f0 con 0x7f433c145290 2024-04-25T09:13:41.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.141+0000 7f4344200640 1 -- 172.21.15.173:0/3588497319 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f433c1410b0 con 0x7f433c145290 2024-04-25T09:13:41.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.141+0000 7f4339600640 1 -- 172.21.15.173:0/3588497319 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v134) v1 ==== 100+0+11 (secure 0 0 0) 0x7f43340557c0 con 0x7f433c145290 2024-04-25T09:13:41.125 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:13:41.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.141+0000 7f4344200640 1 -- 172.21.15.173:0/3588497319 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f431c066f60 msgr2=0x7f431c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:41.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.141+0000 7f4344200640 1 --2- 172.21.15.173:0/3588497319 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f431c066f60 0x7f431c069420 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f43300079c0 tx=0x7f4330008040 comp rx=0 tx=0).stop 2024-04-25T09:13:41.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.141+0000 7f4344200640 1 -- 172.21.15.173:0/3588497319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f433c145290 msgr2=0x7f433c15cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:41.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.141+0000 7f4344200640 1 --2- 172.21.15.173:0/3588497319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f433c145290 0x7f433c15cd10 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f433400c770 tx=0x7f433400cc30 comp rx=0 tx=0).stop 2024-04-25T09:13:41.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.141+0000 7f4344200640 1 -- 172.21.15.173:0/3588497319 shutdown_connections 2024-04-25T09:13:41.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.141+0000 7f4344200640 1 --2- 172.21.15.173:0/3588497319 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f431c066f60 0x7f431c069420 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.141+0000 7f4344200640 1 --2- 172.21.15.173:0/3588497319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f433c145290 0x7f433c15cd10 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.141+0000 7f4344200640 1 --2- 172.21.15.173:0/3588497319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f433c0cc260 0x7f433c15c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.141+0000 7f4344200640 1 --2- 172.21.15.173:0/3588497319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f433c0b3fe0 0x7f433c13c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.141+0000 7f4344200640 1 -- 172.21.15.173:0/3588497319 >> 172.21.15.173:0/3588497319 conn(0x7f433c06ac90 msgr2=0x7f433c0ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:41.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.141+0000 7f4344200640 1 -- 172.21.15.173:0/3588497319 shutdown_connections 2024-04-25T09:13:41.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.141+0000 7f4344200640 1 -- 172.21.15.173:0/3588497319 wait complete. 2024-04-25T09:13:41.147 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:41.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.297+0000 7fd66e400640 1 Processor -- start 2024-04-25T09:13:41.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.297+0000 7fd66e400640 1 -- start start 2024-04-25T09:13:41.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.297+0000 7fd66e400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd6680b3e70 0x7fd6680b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.297+0000 7fd66e400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd6680aefa0 0x7fd6680b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.297+0000 7fd66e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd66815edd0 0x7fd6680b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.297+0000 7fd66e400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd66806dd50 con 0x7fd6680b3e70 2024-04-25T09:13:41.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.297+0000 7fd66e400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6680b4790 con 0x7fd6680aefa0 2024-04-25T09:13:41.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.297+0000 7fd66e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66815f320 con 0x7fd66815edd0 2024-04-25T09:13:41.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.297+0000 7fd667400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd6680b3e70 0x7fd6680b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.297+0000 7fd667400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd6680b3e70 0x7fd6680b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60890/0 (socket says 172.21.15.173:60890) 2024-04-25T09:13:41.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.297+0000 7fd667400640 1 -- 172.21.15.173:0/1501041732 learned_addr learned my addr 172.21.15.173:0/1501041732 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:41.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.297+0000 7fd667e00640 1 --2- 172.21.15.173:0/1501041732 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd66815edd0 0x7fd6680b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.297+0000 7fd666a00640 1 --2- 172.21.15.173:0/1501041732 >> v2:172.21.15.194:3300/0 conn(0x7fd6680aefa0 0x7fd6680b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.301+0000 7fd667400640 1 -- 172.21.15.173:0/1501041732 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd66815edd0 msgr2=0x7fd6680b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:41.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.301+0000 7fd667400640 1 --2- 172.21.15.173:0/1501041732 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd66815edd0 0x7fd6680b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.301+0000 7fd667400640 1 -- 172.21.15.173:0/1501041732 >> v2:172.21.15.194:3300/0 conn(0x7fd6680aefa0 msgr2=0x7fd6680b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:41.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.301+0000 7fd667400640 1 --2- 172.21.15.173:0/1501041732 >> v2:172.21.15.194:3300/0 conn(0x7fd6680aefa0 0x7fd6680b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.301+0000 7fd667400640 1 -- 172.21.15.173:0/1501041732 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66806d420 con 0x7fd6680b3e70 2024-04-25T09:13:41.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.301+0000 7fd667400640 1 --2- 172.21.15.173:0/1501041732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6680b3e70 0x7fd6680b4250 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fd6680d0650 tx=0x7fd65801ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff8bb4745bd84ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:41.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.301+0000 7fd666000640 1 -- 172.21.15.173:0/1501041732 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65800b2d0 con 0x7fd6680b3e70 2024-04-25T09:13:41.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.301+0000 7fd666000640 1 -- 172.21.15.173:0/1501041732 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65800b470 con 0x7fd6680b3e70 2024-04-25T09:13:41.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.301+0000 7fd666000640 1 -- 172.21.15.173:0/1501041732 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6580a7b90 con 0x7fd6680b3e70 2024-04-25T09:13:41.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.301+0000 7fd66e400640 1 -- 172.21.15.173:0/1501041732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6680b3e70 msgr2=0x7fd6680b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:41.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.301+0000 7fd66e400640 1 --2- 172.21.15.173:0/1501041732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6680b3e70 0x7fd6680b4250 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fd6680d0650 tx=0x7fd65801ebc0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.301+0000 7fd66e400640 1 -- 172.21.15.173:0/1501041732 shutdown_connections 2024-04-25T09:13:41.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.301+0000 7fd66e400640 1 --2- 172.21.15.173:0/1501041732 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd66815edd0 0x7fd6680b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.301+0000 7fd66e400640 1 --2- 172.21.15.173:0/1501041732 >> v2:172.21.15.194:3300/0 conn(0x7fd6680aefa0 0x7fd6680b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.301+0000 7fd66e400640 1 --2- 172.21.15.173:0/1501041732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6680b3e70 0x7fd6680b4250 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.301+0000 7fd66e400640 1 -- 172.21.15.173:0/1501041732 >> 172.21.15.173:0/1501041732 conn(0x7fd66806ac90 msgr2=0x7fd66806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:41.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.301+0000 7fd66e400640 1 -- 172.21.15.173:0/1501041732 shutdown_connections 2024-04-25T09:13:41.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.301+0000 7fd66e400640 1 -- 172.21.15.173:0/1501041732 wait complete. 2024-04-25T09:13:41.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd66e400640 1 Processor -- start 2024-04-25T09:13:41.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd66e400640 1 -- start start 2024-04-25T09:13:41.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd66e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6680aefa0 0x7fd668146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd66e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6680b3e70 0x7fd668151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd66e400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd66815edd0 0x7fd668149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd66e400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66806e1e0 con 0x7fd66815edd0 2024-04-25T09:13:41.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd66e400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6680b3600 con 0x7fd6680b3e70 2024-04-25T09:13:41.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd66e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66806e360 con 0x7fd6680aefa0 2024-04-25T09:13:41.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd667e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd66815edd0 0x7fd668149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd667e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd66815edd0 0x7fd668149f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60896/0 (socket says 172.21.15.173:60896) 2024-04-25T09:13:41.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd667e00640 1 -- 172.21.15.173:0/1731965164 learned_addr learned my addr 172.21.15.173:0/1731965164 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:41.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd667400640 1 --2- 172.21.15.173:0/1731965164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6680aefa0 0x7fd668146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd666a00640 1 --2- 172.21.15.173:0/1731965164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6680b3e70 0x7fd668151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd667e00640 1 -- 172.21.15.173:0/1731965164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6680aefa0 msgr2=0x7fd668146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:41.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd667e00640 1 --2- 172.21.15.173:0/1731965164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6680aefa0 0x7fd668146420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd667e00640 1 -- 172.21.15.173:0/1731965164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6680b3e70 msgr2=0x7fd668151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:41.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd667e00640 1 --2- 172.21.15.173:0/1731965164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6680b3e70 0x7fd668151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd667e00640 1 -- 172.21.15.173:0/1731965164 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66814cea0 con 0x7fd66815edd0 2024-04-25T09:13:41.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd667e00640 1 --2- 172.21.15.173:0/1731965164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd66815edd0 0x7fd668149f30 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fd66000e7f0 tx=0x7fd66000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:41.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd65f400640 1 -- 172.21.15.173:0/1731965164 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd660017070 con 0x7fd66815edd0 2024-04-25T09:13:41.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd65f400640 1 -- 172.21.15.173:0/1731965164 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66000c940 con 0x7fd66815edd0 2024-04-25T09:13:41.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd65f400640 1 -- 172.21.15.173:0/1731965164 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66000eea0 con 0x7fd66815edd0 2024-04-25T09:13:41.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd66e400640 1 -- 172.21.15.173:0/1731965164 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66814d180 con 0x7fd66815edd0 2024-04-25T09:13:41.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.305+0000 7fd66e400640 1 -- 172.21.15.173:0/1731965164 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd668150600 con 0x7fd66815edd0 2024-04-25T09:13:41.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.309+0000 7fd66e400640 1 -- 172.21.15.173:0/1731965164 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd668150800 con 0x7fd66815edd0 2024-04-25T09:13:41.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.309+0000 7fd65f400640 1 -- 172.21.15.173:0/1731965164 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd66001a070 con 0x7fd66815edd0 2024-04-25T09:13:41.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.309+0000 7fd65f400640 1 --2- 172.21.15.173:0/1731965164 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd648066f60 0x7fd648069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.309+0000 7fd65f400640 1 -- 172.21.15.173:0/1731965164 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd6600853c0 con 0x7fd66815edd0 2024-04-25T09:13:41.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.309+0000 7fd667400640 1 --2- 172.21.15.173:0/1731965164 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd648066f60 0x7fd648069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.309+0000 7fd667400640 1 --2- 172.21.15.173:0/1731965164 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd648066f60 0x7fd648069420 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd6580b0000 tx=0x7fd6580a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:41.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.313+0000 7fd65f400640 1 -- 172.21.15.173:0/1731965164 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd668150800 con 0x7fd66815edd0 2024-04-25T09:13:41.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.501+0000 7fd66e400640 1 -- 172.21.15.173:0/1731965164 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd668073a40 con 0x7fd66815edd0 2024-04-25T09:13:41.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.501+0000 7fd65f400640 1 -- 172.21.15.173:0/1731965164 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4161 (secure 0 0 0) 0x7fd660055b90 con 0x7fd66815edd0 2024-04-25T09:13:41.485 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:41.485 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":93,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:34.472510+0000","modified":"2024-04-25T09:13:32.594395+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9408":{"gid":9408,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":19,"addr":"172.21.15.173:6835/1841246276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1841246276},{"type":"v1","addr":"172.21.15.173:6835","nonce":1841246276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:13:41.485 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 93 2024-04-25T09:13:41.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.501+0000 7fd66e400640 1 -- 172.21.15.173:0/1731965164 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd648066f60 msgr2=0x7fd648069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:41.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.501+0000 7fd66e400640 1 --2- 172.21.15.173:0/1731965164 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd648066f60 0x7fd648069420 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd6580b0000 tx=0x7fd6580a9070 comp rx=0 tx=0).stop 2024-04-25T09:13:41.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.501+0000 7fd66e400640 1 -- 172.21.15.173:0/1731965164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd66815edd0 msgr2=0x7fd668149f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:41.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.501+0000 7fd66e400640 1 --2- 172.21.15.173:0/1731965164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd66815edd0 0x7fd668149f30 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fd66000e7f0 tx=0x7fd66000ecb0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.501+0000 7fd66e400640 1 -- 172.21.15.173:0/1731965164 shutdown_connections 2024-04-25T09:13:41.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.501+0000 7fd66e400640 1 --2- 172.21.15.173:0/1731965164 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd648066f60 0x7fd648069420 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.501+0000 7fd66e400640 1 --2- 172.21.15.173:0/1731965164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd66815edd0 0x7fd668149f30 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.501+0000 7fd66e400640 1 --2- 172.21.15.173:0/1731965164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6680b3e70 0x7fd668151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.501+0000 7fd66e400640 1 --2- 172.21.15.173:0/1731965164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6680aefa0 0x7fd668146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.501+0000 7fd66e400640 1 -- 172.21.15.173:0/1731965164 >> 172.21.15.173:0/1731965164 conn(0x7fd66806ac90 msgr2=0x7fd66815e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:41.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.501+0000 7fd66e400640 1 -- 172.21.15.173:0/1731965164 shutdown_connections 2024-04-25T09:13:41.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.501+0000 7fd66e400640 1 -- 172.21.15.173:0/1731965164 wait complete. 2024-04-25T09:13:41.506 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:13:41.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.657+0000 7ff3e6c00640 1 Processor -- start 2024-04-25T09:13:41.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.657+0000 7ff3e6c00640 1 -- start start 2024-04-25T09:13:41.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3e6c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3e0071a30 0x7ff3e00b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3e6c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff3e00b2ca0 0x7ff3e00ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3e6c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e006e860 con 0x7ff3e015a180 2024-04-25T09:13:41.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3e6c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e00af230 con 0x7ff3e00b2ca0 2024-04-25T09:13:41.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3e6c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e006eb20 con 0x7ff3e0071a30 2024-04-25T09:13:41.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dfe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ff3e015a180 0x7ff3e0071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36124/0 (socket says 172.21.15.173:36124) 2024-04-25T09:13:41.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dfe00640 1 -- 172.21.15.173:0/1776447411 learned_addr learned my addr 172.21.15.173:0/1776447411 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:41.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3e4c00640 1 --2- 172.21.15.173:0/1776447411 >> v2:172.21.15.194:3300/0 conn(0x7ff3e00b2ca0 0x7ff3e00ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3df400640 1 --2- 172.21.15.173:0/1776447411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3e0071a30 0x7ff3e00b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dea00640 1 -- 172.21.15.173:0/1776447411 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257404257 0 0) 0x7ff3e006e860 con 0x7ff3e015a180 2024-04-25T09:13:41.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dea00640 1 -- 172.21.15.173:0/1776447411 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3c4003530 con 0x7ff3e015a180 2024-04-25T09:13:41.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dea00640 1 -- 172.21.15.173:0/1776447411 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3127411709 0 0) 0x7ff3c4003530 con 0x7ff3e015a180 2024-04-25T09:13:41.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dea00640 1 -- 172.21.15.173:0/1776447411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3e0071a30 msgr2=0x7ff3e00b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:41.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dea00640 1 --2- 172.21.15.173:0/1776447411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3e0071a30 0x7ff3e00b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dea00640 1 -- 172.21.15.173:0/1776447411 >> v2:172.21.15.194:3300/0 conn(0x7ff3e00b2ca0 msgr2=0x7ff3e00ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:41.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dea00640 1 --2- 172.21.15.173:0/1776447411 >> v2:172.21.15.194:3300/0 conn(0x7ff3e00b2ca0 0x7ff3e00ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dea00640 1 -- 172.21.15.173:0/1776447411 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e00aebe0 con 0x7ff3e015a180 2024-04-25T09:13:41.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dea00640 1 -- 172.21.15.173:0/1776447411 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7ff3d0001a00 con 0x7ff3e015a180 2024-04-25T09:13:41.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dea00640 1 -- 172.21.15.173:0/1776447411 >> v1:172.21.15.173:6789/0 conn(0x7ff3e015a180 legacy=0x7ff3e0071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dea00640 1 --2- 172.21.15.173:0/1776447411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3c40039c0 0x7ff3c4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dea00640 1 --2- 172.21.15.173:0/1776447411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3c4004810 0x7ff3c4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dea00640 1 --2- 172.21.15.173:0/1776447411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3e0071a30 0x7ff3c40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dea00640 1 -- 172.21.15.173:0/1776447411 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e00af230 con 0x7ff3c4004810 2024-04-25T09:13:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dea00640 1 -- 172.21.15.173:0/1776447411 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e006eb20 con 0x7ff3c40039c0 2024-04-25T09:13:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dea00640 1 -- 172.21.15.173:0/1776447411 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c400b9d0 con 0x7ff3e0071a30 2024-04-25T09:13:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3df400640 1 --2- 172.21.15.173:0/1776447411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3c4004810 0x7ff3c4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3e4c00640 1 --2- 172.21.15.173:0/1776447411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3e0071a30 0x7ff3c40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dfe00640 1 --2- 172.21.15.173:0/1776447411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3c40039c0 0x7ff3c4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3df400640 1 -- 172.21.15.173:0/1776447411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3e0071a30 msgr2=0x7ff3c40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3df400640 1 --2- 172.21.15.173:0/1776447411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3e0071a30 0x7ff3c40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3df400640 1 -- 172.21.15.173:0/1776447411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3c40039c0 msgr2=0x7ff3c4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3df400640 1 --2- 172.21.15.173:0/1776447411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3c40039c0 0x7ff3c4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3df400640 1 -- 172.21.15.173:0/1776447411 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c4003530 con 0x7ff3c4004810 2024-04-25T09:13:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.661+0000 7ff3dfe00640 1 --2- 172.21.15.173:0/1776447411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3c40039c0 0x7ff3c4003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:41.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.665+0000 7ff3df400640 1 --2- 172.21.15.173:0/1776447411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3c4004810 0x7ff3c4004c90 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc009ae0 tx=0x7ff3cc01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c735d0ed9f7b49fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:41.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.665+0000 7ff3dea00640 1 -- 172.21.15.173:0/1776447411 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0b2070 con 0x7ff3c4004810 2024-04-25T09:13:41.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.665+0000 7ff3dea00640 1 -- 172.21.15.173:0/1776447411 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc0a5580 con 0x7ff3c4004810 2024-04-25T09:13:41.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.665+0000 7ff3dea00640 1 -- 172.21.15.173:0/1776447411 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0096b0 con 0x7ff3c4004810 2024-04-25T09:13:41.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.665+0000 7ff3e6c00640 1 -- 172.21.15.173:0/1776447411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3c4004810 msgr2=0x7ff3c4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:41.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.665+0000 7ff3e6c00640 1 --2- 172.21.15.173:0/1776447411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3c4004810 0x7ff3c4004c90 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc009ae0 tx=0x7ff3cc01ca70 comp rx=0 tx=0).stop 2024-04-25T09:13:41.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.665+0000 7ff3e4c00640 1 -- 172.21.15.173:0/1776447411 reap_dead start 2024-04-25T09:13:41.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.665+0000 7ff3e6c00640 1 -- 172.21.15.173:0/1776447411 shutdown_connections 2024-04-25T09:13:41.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.665+0000 7ff3e6c00640 1 -- 172.21.15.173:0/1776447411 >> 172.21.15.173:0/1776447411 conn(0x7ff3e006ac90 msgr2=0x7ff3e006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:41.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.665+0000 7ff3e6c00640 1 -- 172.21.15.173:0/1776447411 shutdown_connections 2024-04-25T09:13:41.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.665+0000 7ff3e6c00640 1 -- 172.21.15.173:0/1776447411 wait complete. 2024-04-25T09:13:41.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.665+0000 7ff3e6c00640 1 Processor -- start 2024-04-25T09:13:41.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.665+0000 7ff3e6c00640 1 -- start start 2024-04-25T09:13:41.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3e6c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3c4004810 0x7ff3e01527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3e6c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3e0152d20 0x7ff3e01531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3e6c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e015a560 0x7ff3e015a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3e6c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e00b4260 con 0x7ff3e0152d20 2024-04-25T09:13:41.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3e6c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e00b40e0 con 0x7ff3e015a560 2024-04-25T09:13:41.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3e6c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e00b43e0 con 0x7ff3c4004810 2024-04-25T09:13:41.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3df400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3e0152d20 0x7ff3e01531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3df400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3e0152d20 0x7ff3e01531a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60906/0 (socket says 172.21.15.173:60906) 2024-04-25T09:13:41.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3df400640 1 -- 172.21.15.173:0/3951320467 learned_addr learned my addr 172.21.15.173:0/3951320467 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:41.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3dfe00640 1 --2- 172.21.15.173:0/3951320467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3c4004810 0x7ff3e01527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3e4c00640 1 --2- 172.21.15.173:0/3951320467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e015a560 0x7ff3e015a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3df400640 1 -- 172.21.15.173:0/3951320467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3c4004810 msgr2=0x7ff3e01527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:41.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3df400640 1 --2- 172.21.15.173:0/3951320467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3c4004810 0x7ff3e01527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3df400640 1 -- 172.21.15.173:0/3951320467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e015a560 msgr2=0x7ff3e015a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:41.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3df400640 1 --2- 172.21.15.173:0/3951320467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e015a560 0x7ff3e015a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3df400640 1 -- 172.21.15.173:0/3951320467 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e0153a90 con 0x7ff3e0152d20 2024-04-25T09:13:41.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3dfe00640 1 --2- 172.21.15.173:0/3951320467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3c4004810 0x7ff3e01527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:41.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3df400640 1 --2- 172.21.15.173:0/3951320467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3e0152d20 0x7ff3e01531a0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc01c8a0 tx=0x7ff3c4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:41.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3d7e00640 1 -- 172.21.15.173:0/3951320467 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0bc020 con 0x7ff3e0152d20 2024-04-25T09:13:41.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3d7e00640 1 -- 172.21.15.173:0/3951320467 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc004020 con 0x7ff3e0152d20 2024-04-25T09:13:41.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3e6c00640 1 -- 172.21.15.173:0/3951320467 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e0148ac0 con 0x7ff3e0152d20 2024-04-25T09:13:41.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3d7e00640 1 -- 172.21.15.173:0/3951320467 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0b2040 con 0x7ff3e0152d20 2024-04-25T09:13:41.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3e6c00640 1 -- 172.21.15.173:0/3951320467 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e01537b0 con 0x7ff3e0152d20 2024-04-25T09:13:41.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3e6c00640 1 -- 172.21.15.173:0/3951320467 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e0073a40 con 0x7ff3e0152d20 2024-04-25T09:13:41.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.669+0000 7ff3d7e00640 1 -- 172.21.15.173:0/3951320467 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff3cc003620 con 0x7ff3e0152d20 2024-04-25T09:13:41.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.673+0000 7ff3d7e00640 1 --2- 172.21.15.173:0/3951320467 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff3c0066f60 0x7ff3c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.673+0000 7ff3d7e00640 1 -- 172.21.15.173:0/3951320467 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ff3cc11f460 con 0x7ff3e0152d20 2024-04-25T09:13:41.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.673+0000 7ff3dfe00640 1 --2- 172.21.15.173:0/3951320467 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff3c0066f60 0x7ff3c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.673+0000 7ff3dfe00640 1 --2- 172.21.15.173:0/3951320467 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff3c0066f60 0x7ff3c0069420 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0001930 tx=0x7ff3d00018c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:41.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.677+0000 7ff3d7e00640 1 -- 172.21.15.173:0/3951320467 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff3cc0c6020 con 0x7ff3e0152d20 2024-04-25T09:13:41.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.833+0000 7ff3e6c00640 1 -- 172.21.15.173:0/3951320467 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3e006e640 con 0x7ff3e0152d20 2024-04-25T09:13:41.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.833+0000 7ff3d7e00640 1 -- 172.21.15.173:0/3951320467 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+17091 (secure 0 0 0) 0x7ff3cc016780 con 0x7ff3e0152d20 2024-04-25T09:13:41.818 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:41.818 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":134,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:13:30.512676+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:12:32.846423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-04-25T09:12:33.466675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:6837/3627798672":"2024-04-26T09:13:30.512572+0000","172.21.15.173:6836/3627798672":"2024-04-26T09:13:30.512572+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:13:41.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.837+0000 7ff3e6c00640 1 -- 172.21.15.173:0/3951320467 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff3c0066f60 msgr2=0x7ff3c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:41.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.837+0000 7ff3e6c00640 1 --2- 172.21.15.173:0/3951320467 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff3c0066f60 0x7ff3c0069420 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0001930 tx=0x7ff3d00018c0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.837+0000 7ff3e6c00640 1 -- 172.21.15.173:0/3951320467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3e0152d20 msgr2=0x7ff3e01531a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:41.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.837+0000 7ff3e6c00640 1 --2- 172.21.15.173:0/3951320467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3e0152d20 0x7ff3e01531a0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc01c8a0 tx=0x7ff3c4005840 comp rx=0 tx=0).stop 2024-04-25T09:13:41.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.837+0000 7ff3e6c00640 1 -- 172.21.15.173:0/3951320467 shutdown_connections 2024-04-25T09:13:41.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.837+0000 7ff3e6c00640 1 --2- 172.21.15.173:0/3951320467 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff3c0066f60 0x7ff3c0069420 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.837+0000 7ff3e6c00640 1 --2- 172.21.15.173:0/3951320467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e015a560 0x7ff3e015a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.837+0000 7ff3e6c00640 1 --2- 172.21.15.173:0/3951320467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3e0152d20 0x7ff3e01531a0 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.837+0000 7ff3e6c00640 1 --2- 172.21.15.173:0/3951320467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3c4004810 0x7ff3e01527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.837+0000 7ff3e6c00640 1 -- 172.21.15.173:0/3951320467 >> 172.21.15.173:0/3951320467 conn(0x7ff3e006ac90 msgr2=0x7ff3e014d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:41.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.837+0000 7ff3e6c00640 1 -- 172.21.15.173:0/3951320467 shutdown_connections 2024-04-25T09:13:41.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.837+0000 7ff3e6c00640 1 -- 172.21.15.173:0/3951320467 wait complete. 2024-04-25T09:13:41.840 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:13:41.840 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:41.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.989+0000 7fc038200640 1 Processor -- start 2024-04-25T09:13:41.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.989+0000 7fc038200640 1 -- start start 2024-04-25T09:13:41.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.993+0000 7fc038200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc0300b3e70 0x7fc0300b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.993+0000 7fc038200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0300b3590 con 0x7fc03015edd0 2024-04-25T09:13:41.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.993+0000 7fc038200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0300b4790 con 0x7fc0300aefa0 2024-04-25T09:13:41.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.993+0000 7fc038200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc03006dd50 con 0x7fc0300b3e70 2024-04-25T09:13:41.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.993+0000 7fc036200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc03015edd0 0x7fc0300b2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36138/0 (socket says 172.21.15.173:36138) 2024-04-25T09:13:41.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.993+0000 7fc036200640 1 -- 172.21.15.173:0/3457058648 learned_addr learned my addr 172.21.15.173:0/3457058648 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:41.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.993+0000 7fc035800640 1 --2- 172.21.15.173:0/3457058648 >> v2:172.21.15.194:3300/0 conn(0x7fc0300b3e70 0x7fc0300b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.993+0000 7fc02fe00640 1 -- 172.21.15.173:0/3457058648 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826063417 0 0) 0x7fc0300b3590 con 0x7fc03015edd0 2024-04-25T09:13:41.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.993+0000 7fc02fe00640 1 -- 172.21.15.173:0/3457058648 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc018005740 con 0x7fc03015edd0 2024-04-25T09:13:41.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.993+0000 7fc02fe00640 1 -- 172.21.15.173:0/3457058648 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335962519 0 0) 0x7fc0300b4790 con 0x7fc0300aefa0 2024-04-25T09:13:41.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.993+0000 7fc02fe00640 1 -- 172.21.15.173:0/3457058648 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0300b3590 con 0x7fc0300aefa0 2024-04-25T09:13:41.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.993+0000 7fc035800640 1 -- 172.21.15.173:0/3457058648 >> v1:172.21.15.194:6789/0 conn(0x7fc0300aefa0 legacy=0x7fc0300b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:41.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.993+0000 7fc035800640 1 -- 172.21.15.173:0/3457058648 >> v1:172.21.15.173:6789/0 conn(0x7fc03015edd0 legacy=0x7fc0300b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:41.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.993+0000 7fc02fe00640 1 -- 172.21.15.173:0/3457058648 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1437028708 0 0) 0x7fc018005740 con 0x7fc03015edd0 2024-04-25T09:13:41.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.993+0000 7fc035800640 1 -- 172.21.15.173:0/3457058648 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03015f320 con 0x7fc0300b3e70 2024-04-25T09:13:41.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.997+0000 7fc035800640 1 --2- 172.21.15.173:0/3457058648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0300b3e70 0x7fc0300b4250 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc024009d90 tx=0x7fc02401c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86a926d5fbc71188 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:41.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.997+0000 7fc02fe00640 1 -- 172.21.15.173:0/3457058648 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0240b2070 con 0x7fc0300b3e70 2024-04-25T09:13:41.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.997+0000 7fc02fe00640 1 -- 172.21.15.173:0/3457058648 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0240a55c0 con 0x7fc0300b3e70 2024-04-25T09:13:41.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.997+0000 7fc02fe00640 1 -- 172.21.15.173:0/3457058648 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028001680 con 0x7fc0300b3e70 2024-04-25T09:13:41.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.997+0000 7fc038200640 1 -- 172.21.15.173:0/3457058648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0300b3e70 msgr2=0x7fc0300b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:41.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.997+0000 7fc038200640 1 --2- 172.21.15.173:0/3457058648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0300b3e70 0x7fc0300b4250 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc024009d90 tx=0x7fc02401c860 comp rx=0 tx=0).stop 2024-04-25T09:13:41.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.997+0000 7fc038200640 1 -- 172.21.15.173:0/3457058648 shutdown_connections 2024-04-25T09:13:41.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.997+0000 7fc038200640 1 --2- 172.21.15.173:0/3457058648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0300b3e70 0x7fc0300b4250 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.997+0000 7fc038200640 1 -- 172.21.15.173:0/3457058648 >> 172.21.15.173:0/3457058648 conn(0x7fc03006ac90 msgr2=0x7fc03006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:41.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.997+0000 7fc038200640 1 -- 172.21.15.173:0/3457058648 shutdown_connections 2024-04-25T09:13:41.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.997+0000 7fc038200640 1 -- 172.21.15.173:0/3457058648 wait complete. 2024-04-25T09:13:41.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.997+0000 7fc038200640 1 Processor -- start 2024-04-25T09:13:41.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:41.997+0000 7fc038200640 1 -- start start 2024-04-25T09:13:41.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc038200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0300aefa0 0x7fc03014f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc038200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0300b3e70 0x7fc0301514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc038200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc03015edd0 0x7fc030151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc038200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03015aba0 con 0x7fc0300aefa0 2024-04-25T09:13:41.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc038200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0300ce7b0 con 0x7fc03015edd0 2024-04-25T09:13:41.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc038200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03006e1e0 con 0x7fc0300b3e70 2024-04-25T09:13:41.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc035800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0300aefa0 0x7fc03014f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc035800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0300aefa0 0x7fc03014f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60912/0 (socket says 172.21.15.173:60912) 2024-04-25T09:13:41.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc035800640 1 -- 172.21.15.173:0/1865104655 learned_addr learned my addr 172.21.15.173:0/1865104655 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:41.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc034e00640 1 --2- 172.21.15.173:0/1865104655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0300b3e70 0x7fc0301514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc036200640 1 --2- 172.21.15.173:0/1865104655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc03015edd0 0x7fc030151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc035800640 1 -- 172.21.15.173:0/1865104655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0300b3e70 msgr2=0x7fc0301514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:41.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc035800640 1 --2- 172.21.15.173:0/1865104655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0300b3e70 0x7fc0301514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc035800640 1 -- 172.21.15.173:0/1865104655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc03015edd0 msgr2=0x7fc030151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:41.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc035800640 1 --2- 172.21.15.173:0/1865104655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc03015edd0 0x7fc030151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:41.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc035800640 1 -- 172.21.15.173:0/1865104655 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0301523e0 con 0x7fc0300aefa0 2024-04-25T09:13:41.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc034e00640 1 --2- 172.21.15.173:0/1865104655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0300b3e70 0x7fc0301514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:41.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc036200640 1 --2- 172.21.15.173:0/1865104655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc03015edd0 0x7fc030151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:41.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc035800640 1 --2- 172.21.15.173:0/1865104655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0300aefa0 0x7fc03014f930 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fc024009d90 tx=0x7fc024019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:41.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc02d600640 1 -- 172.21.15.173:0/1865104655 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0240bf070 con 0x7fc0300aefa0 2024-04-25T09:13:41.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc02d600640 1 -- 172.21.15.173:0/1865104655 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0240b3040 con 0x7fc0300aefa0 2024-04-25T09:13:41.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc038200640 1 -- 172.21.15.173:0/1865104655 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc03015af50 con 0x7fc0300aefa0 2024-04-25T09:13:41.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc02d600640 1 -- 172.21.15.173:0/1865104655 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0240b2050 con 0x7fc0300aefa0 2024-04-25T09:13:41.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc038200640 1 -- 172.21.15.173:0/1865104655 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc03015b510 con 0x7fc0300aefa0 2024-04-25T09:13:41.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc038200640 1 -- 172.21.15.173:0/1865104655 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc030073a40 con 0x7fc0300aefa0 2024-04-25T09:13:41.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.001+0000 7fc02d600640 1 -- 172.21.15.173:0/1865104655 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc0240c2070 con 0x7fc0300aefa0 2024-04-25T09:13:41.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.005+0000 7fc02d600640 1 --2- 172.21.15.173:0/1865104655 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc010066f60 0x7fc010069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:41.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.005+0000 7fc02d600640 1 -- 172.21.15.173:0/1865104655 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fc02411f230 con 0x7fc0300aefa0 2024-04-25T09:13:41.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.005+0000 7fc034e00640 1 --2- 172.21.15.173:0/1865104655 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc010066f60 0x7fc010069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:41.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.005+0000 7fc034e00640 1 --2- 172.21.15.173:0/1865104655 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc010066f60 0x7fc010069420 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc0301f5e50 tx=0x7fc01c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:41.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.005+0000 7fc02d600640 1 -- 172.21.15.173:0/1865104655 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc024016480 con 0x7fc0300aefa0 2024-04-25T09:13:42.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.189+0000 7fc038200640 1 -- 172.21.15.173:0/1865104655 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc03006f1c0 con 0x7fc0300aefa0 2024-04-25T09:13:42.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.193+0000 7fc02d600640 1 -- 172.21.15.173:0/1865104655 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4161 (secure 0 0 0) 0x7fc0240effc0 con 0x7fc0300aefa0 2024-04-25T09:13:42.176 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:42.177 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":93,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:34.472510+0000","modified":"2024-04-25T09:13:32.594395+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9408":{"gid":9408,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":19,"addr":"172.21.15.173:6835/1841246276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1841246276},{"type":"v1","addr":"172.21.15.173:6835","nonce":1841246276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:13:42.177 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 93 2024-04-25T09:13:42.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.193+0000 7fc038200640 1 -- 172.21.15.173:0/1865104655 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc010066f60 msgr2=0x7fc010069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:42.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.193+0000 7fc038200640 1 --2- 172.21.15.173:0/1865104655 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc010066f60 0x7fc010069420 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc0301f5e50 tx=0x7fc01c009040 comp rx=0 tx=0).stop 2024-04-25T09:13:42.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.193+0000 7fc038200640 1 -- 172.21.15.173:0/1865104655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0300aefa0 msgr2=0x7fc03014f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:42.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.193+0000 7fc038200640 1 --2- 172.21.15.173:0/1865104655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0300aefa0 0x7fc03014f930 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fc024009d90 tx=0x7fc024019600 comp rx=0 tx=0).stop 2024-04-25T09:13:42.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.193+0000 7fc038200640 1 -- 172.21.15.173:0/1865104655 shutdown_connections 2024-04-25T09:13:42.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.193+0000 7fc038200640 1 --2- 172.21.15.173:0/1865104655 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc010066f60 0x7fc010069420 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.193+0000 7fc038200640 1 --2- 172.21.15.173:0/1865104655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc03015edd0 0x7fc030151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.193+0000 7fc038200640 1 --2- 172.21.15.173:0/1865104655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0300b3e70 0x7fc0301514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.193+0000 7fc038200640 1 --2- 172.21.15.173:0/1865104655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0300aefa0 0x7fc03014f930 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.193+0000 7fc038200640 1 -- 172.21.15.173:0/1865104655 >> 172.21.15.173:0/1865104655 conn(0x7fc03006ac90 msgr2=0x7fc0300b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:42.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.193+0000 7fc038200640 1 -- 172.21.15.173:0/1865104655 shutdown_connections 2024-04-25T09:13:42.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.193+0000 7fc038200640 1 -- 172.21.15.173:0/1865104655 wait complete. 2024-04-25T09:13:42.199 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:42.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.349+0000 7f6929a00640 1 Processor -- start 2024-04-25T09:13:42.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.349+0000 7f6929a00640 1 -- start start 2024-04-25T09:13:42.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.353+0000 7f6929a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f692415a180 0x7f69240b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:42.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.353+0000 7f6929a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f69240b2ca0 0x7f69240ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:42.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.353+0000 7f6929a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6924071320 0x7f69240717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:42.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.353+0000 7f6929a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69240af230 con 0x7f692415a180 2024-04-25T09:13:42.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.353+0000 7f6929a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692406e860 con 0x7f6924071320 2024-04-25T09:13:42.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.353+0000 7f6929a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692406eb20 con 0x7f69240b2ca0 2024-04-25T09:13:42.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.353+0000 7f6922a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f692415a180 0x7f69240b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:42.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.353+0000 7f6922a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f692415a180 0x7f69240b40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60918/0 (socket says 172.21.15.173:60918) 2024-04-25T09:13:42.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.353+0000 7f6922a00640 1 -- 172.21.15.173:0/1972579188 learned_addr learned my addr 172.21.15.173:0/1972579188 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:42.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.353+0000 7f6923400640 1 --2- 172.21.15.173:0/1972579188 >> v2:172.21.15.194:3300/0 conn(0x7f6924071320 0x7f69240717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:42.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.353+0000 7f6922000640 1 --2- 172.21.15.173:0/1972579188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f69240b2ca0 0x7f69240ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:42.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.353+0000 7f6922a00640 1 -- 172.21.15.173:0/1972579188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f69240b2ca0 msgr2=0x7f69240ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:42.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.353+0000 7f6922a00640 1 --2- 172.21.15.173:0/1972579188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f69240b2ca0 0x7f69240ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.353+0000 7f6922a00640 1 -- 172.21.15.173:0/1972579188 >> v2:172.21.15.194:3300/0 conn(0x7f6924071320 msgr2=0x7f69240717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:42.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.353+0000 7f6922a00640 1 --2- 172.21.15.173:0/1972579188 >> v2:172.21.15.194:3300/0 conn(0x7f6924071320 0x7f69240717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.353+0000 7f6922a00640 1 -- 172.21.15.173:0/1972579188 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69240aebe0 con 0x7f692415a180 2024-04-25T09:13:42.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.353+0000 7f6922000640 1 --2- 172.21.15.173:0/1972579188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f69240b2ca0 0x7f69240ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:42.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6922a00640 1 --2- 172.21.15.173:0/1972579188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692415a180 0x7f69240b40e0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f692415db60 tx=0x7f691401e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3a5700ad64c40d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:42.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6921600640 1 -- 172.21.15.173:0/1972579188 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69140ad070 con 0x7f692415a180 2024-04-25T09:13:42.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6921600640 1 -- 172.21.15.173:0/1972579188 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6914004230 con 0x7f692415a180 2024-04-25T09:13:42.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6921600640 1 -- 172.21.15.173:0/1972579188 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69140a7770 con 0x7f692415a180 2024-04-25T09:13:42.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6929a00640 1 -- 172.21.15.173:0/1972579188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692415a180 msgr2=0x7f69240b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:42.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6929a00640 1 --2- 172.21.15.173:0/1972579188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692415a180 0x7f69240b40e0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f692415db60 tx=0x7f691401e9d0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6929a00640 1 -- 172.21.15.173:0/1972579188 shutdown_connections 2024-04-25T09:13:42.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6929a00640 1 --2- 172.21.15.173:0/1972579188 >> v2:172.21.15.194:3300/0 conn(0x7f6924071320 0x7f69240717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6929a00640 1 --2- 172.21.15.173:0/1972579188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f69240b2ca0 0x7f69240ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6929a00640 1 --2- 172.21.15.173:0/1972579188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692415a180 0x7f69240b40e0 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6929a00640 1 -- 172.21.15.173:0/1972579188 >> 172.21.15.173:0/1972579188 conn(0x7f692406ac90 msgr2=0x7f692406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:42.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6929a00640 1 -- 172.21.15.173:0/1972579188 shutdown_connections 2024-04-25T09:13:42.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6929a00640 1 -- 172.21.15.173:0/1972579188 wait complete. 2024-04-25T09:13:42.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6929a00640 1 Processor -- start 2024-04-25T09:13:42.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6929a00640 1 -- start start 2024-04-25T09:13:42.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6929a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6924071320 0x7f6924150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:42.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6929a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f69240b2ca0 0x7f6924155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:42.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6929a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692415a180 0x7f692415c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:42.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6929a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692406e240 con 0x7f692415a180 2024-04-25T09:13:42.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6929a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692406e0c0 con 0x7f6924071320 2024-04-25T09:13:42.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6929a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692406e3c0 con 0x7f69240b2ca0 2024-04-25T09:13:42.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6923400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692415a180 0x7f692415c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:42.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6923400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692415a180 0x7f692415c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60922/0 (socket says 172.21.15.173:60922) 2024-04-25T09:13:42.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.357+0000 7f6923400640 1 -- 172.21.15.173:0/1368250001 learned_addr learned my addr 172.21.15.173:0/1368250001 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:42.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.361+0000 7f6922a00640 1 --2- 172.21.15.173:0/1368250001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6924071320 0x7f6924150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:42.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.361+0000 7f6922000640 1 --2- 172.21.15.173:0/1368250001 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f69240b2ca0 0x7f6924155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:42.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.361+0000 7f6923400640 1 -- 172.21.15.173:0/1368250001 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f69240b2ca0 msgr2=0x7f6924155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:42.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.361+0000 7f6923400640 1 --2- 172.21.15.173:0/1368250001 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f69240b2ca0 0x7f6924155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.361+0000 7f6923400640 1 -- 172.21.15.173:0/1368250001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6924071320 msgr2=0x7f6924150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:42.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.361+0000 7f6923400640 1 --2- 172.21.15.173:0/1368250001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6924071320 0x7f6924150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.361+0000 7f6923400640 1 -- 172.21.15.173:0/1368250001 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692406f040 con 0x7f692415a180 2024-04-25T09:13:42.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.361+0000 7f6923400640 1 --2- 172.21.15.173:0/1368250001 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692415a180 0x7f692415c350 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f691c007d20 tx=0x7f691c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:42.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.361+0000 7f691aa00640 1 -- 172.21.15.173:0/1368250001 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c014420 con 0x7f692415a180 2024-04-25T09:13:42.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.361+0000 7f691aa00640 1 -- 172.21.15.173:0/1368250001 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c019070 con 0x7f692415a180 2024-04-25T09:13:42.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.361+0000 7f6929a00640 1 -- 172.21.15.173:0/1368250001 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69241579b0 con 0x7f692415a180 2024-04-25T09:13:42.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.361+0000 7f691aa00640 1 -- 172.21.15.173:0/1368250001 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c014820 con 0x7f692415a180 2024-04-25T09:13:42.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.361+0000 7f6929a00640 1 -- 172.21.15.173:0/1368250001 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6924156ed0 con 0x7f692415a180 2024-04-25T09:13:42.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.361+0000 7f6929a00640 1 -- 172.21.15.173:0/1368250001 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6924073a40 con 0x7f692415a180 2024-04-25T09:13:42.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.361+0000 7f691aa00640 1 -- 172.21.15.173:0/1368250001 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f691c0149c0 con 0x7f692415a180 2024-04-25T09:13:42.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.361+0000 7f691aa00640 1 --2- 172.21.15.173:0/1368250001 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6900066f60 0x7f6900069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:42.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.361+0000 7f691aa00640 1 -- 172.21.15.173:0/1368250001 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f691c085890 con 0x7f692415a180 2024-04-25T09:13:42.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.361+0000 7f6922a00640 1 --2- 172.21.15.173:0/1368250001 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6900066f60 0x7f6900069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:42.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.365+0000 7f6922a00640 1 --2- 172.21.15.173:0/1368250001 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6900066f60 0x7f6900069420 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f69140b1000 tx=0x7f69140a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:42.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.365+0000 7f691aa00640 1 -- 172.21.15.173:0/1368250001 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f69241579b0 con 0x7f692415a180 2024-04-25T09:13:42.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.553+0000 7f6929a00640 1 -- 172.21.15.173:0/1368250001 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f692406e640 con 0x7f692415a180 2024-04-25T09:13:42.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.553+0000 7f691aa00640 1 -- 172.21.15.173:0/1368250001 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4161 (secure 0 0 0) 0x7f691c056060 con 0x7f692415a180 2024-04-25T09:13:42.539 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:42.539 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":93,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:34.472510+0000","modified":"2024-04-25T09:13:32.594395+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":134,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9408":{"gid":9408,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":19,"addr":"172.21.15.173:6835/1841246276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1841246276},{"type":"v1","addr":"172.21.15.173:6835","nonce":1841246276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T09:13:42.539 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 93 2024-04-25T09:13:42.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.557+0000 7f6929a00640 1 -- 172.21.15.173:0/1368250001 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6900066f60 msgr2=0x7f6900069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:42.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.557+0000 7f6929a00640 1 --2- 172.21.15.173:0/1368250001 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6900066f60 0x7f6900069420 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f69140b1000 tx=0x7f69140a9070 comp rx=0 tx=0).stop 2024-04-25T09:13:42.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.557+0000 7f6929a00640 1 -- 172.21.15.173:0/1368250001 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692415a180 msgr2=0x7f692415c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:42.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.557+0000 7f6929a00640 1 --2- 172.21.15.173:0/1368250001 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692415a180 0x7f692415c350 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f691c007d20 tx=0x7f691c00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.557+0000 7f6929a00640 1 -- 172.21.15.173:0/1368250001 shutdown_connections 2024-04-25T09:13:42.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.557+0000 7f6929a00640 1 --2- 172.21.15.173:0/1368250001 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6900066f60 0x7f6900069420 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.557+0000 7f6929a00640 1 --2- 172.21.15.173:0/1368250001 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692415a180 0x7f692415c350 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.557+0000 7f6929a00640 1 --2- 172.21.15.173:0/1368250001 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f69240b2ca0 0x7f6924155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.557+0000 7f6929a00640 1 --2- 172.21.15.173:0/1368250001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6924071320 0x7f6924150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.557+0000 7f6929a00640 1 -- 172.21.15.173:0/1368250001 >> 172.21.15.173:0/1368250001 conn(0x7f692406ac90 msgr2=0x7f69240cd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:42.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.557+0000 7f6929a00640 1 -- 172.21.15.173:0/1368250001 shutdown_connections 2024-04-25T09:13:42.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.557+0000 7f6929a00640 1 -- 172.21.15.173:0/1368250001 wait complete. 2024-04-25T09:13:42.559 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:13:42.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.713+0000 7f0ba7200640 1 Processor -- start 2024-04-25T09:13:42.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.713+0000 7f0ba7200640 1 -- start start 2024-04-25T09:13:42.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.713+0000 7f0ba7200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0ba815ba60 0x7f0ba80cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:42.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.713+0000 7f0ba7200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ba80d00a0 0x7f0ba80b6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:42.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.713+0000 7f0ba7200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba80cd460 con 0x7f0ba815b680 2024-04-25T09:13:42.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.713+0000 7f0ba7200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba80cc3c0 con 0x7f0ba815ba60 2024-04-25T09:13:42.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.713+0000 7f0ba7200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba80cc6a0 con 0x7f0ba80d00a0 2024-04-25T09:13:42.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.713+0000 7f0ba5400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0ba815ba60 0x7f0ba80cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:42.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.713+0000 7f0ba5400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0ba815ba60 0x7f0ba80cfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60934/0 (socket says 172.21.15.173:60934) 2024-04-25T09:13:42.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.713+0000 7f0ba5400640 1 -- 172.21.15.173:0/2921535113 learned_addr learned my addr 172.21.15.173:0/2921535113 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:42.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.713+0000 7f0ba6800640 1 --2- 172.21.15.173:0/2921535113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ba80d00a0 0x7f0ba80b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:42.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.713+0000 7f0ba5400640 1 -- 172.21.15.173:0/2921535113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ba80d00a0 msgr2=0x7f0ba80b6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:42.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.713+0000 7f0ba5400640 1 --2- 172.21.15.173:0/2921535113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ba80d00a0 0x7f0ba80b6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.713+0000 7f0ba5400640 1 -- 172.21.15.173:0/2921535113 >> v1:172.21.15.194:6789/0 conn(0x7f0ba815b680 legacy=0x7f0ba809a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:42.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.713+0000 7f0ba5400640 1 -- 172.21.15.173:0/2921535113 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba80cc980 con 0x7f0ba815ba60 2024-04-25T09:13:42.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.713+0000 7f0ba6800640 1 --2- 172.21.15.173:0/2921535113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ba80d00a0 0x7f0ba80b6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:42.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.717+0000 7f0ba5400640 1 --2- 172.21.15.173:0/2921535113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba815ba60 0x7f0ba80cfb60 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f0b94009870 tx=0x7f0b9401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1619a4a002a7ce92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:42.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.717+0000 7f0ba4a00640 1 -- 172.21.15.173:0/2921535113 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b940b0070 con 0x7f0ba815ba60 2024-04-25T09:13:42.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.717+0000 7f0ba4a00640 1 -- 172.21.15.173:0/2921535113 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b940ab600 con 0x7f0ba815ba60 2024-04-25T09:13:42.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.717+0000 7f0ba4a00640 1 -- 172.21.15.173:0/2921535113 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b940ab9d0 con 0x7f0ba815ba60 2024-04-25T09:13:42.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.717+0000 7f0ba7200640 1 -- 172.21.15.173:0/2921535113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba815ba60 msgr2=0x7f0ba80cfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:42.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.717+0000 7f0ba7200640 1 --2- 172.21.15.173:0/2921535113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba815ba60 0x7f0ba80cfb60 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f0b94009870 tx=0x7f0b9401c380 comp rx=0 tx=0).stop 2024-04-25T09:13:42.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.717+0000 7f0ba7200640 1 -- 172.21.15.173:0/2921535113 shutdown_connections 2024-04-25T09:13:42.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.717+0000 7f0ba7200640 1 --2- 172.21.15.173:0/2921535113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ba80d00a0 0x7f0ba80b6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.717+0000 7f0ba7200640 1 --2- 172.21.15.173:0/2921535113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba815ba60 0x7f0ba80cfb60 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.717+0000 7f0ba7200640 1 -- 172.21.15.173:0/2921535113 >> 172.21.15.173:0/2921535113 conn(0x7f0ba80b3090 msgr2=0x7f0ba80b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:42.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.717+0000 7f0ba7200640 1 -- 172.21.15.173:0/2921535113 shutdown_connections 2024-04-25T09:13:42.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.717+0000 7f0ba7200640 1 -- 172.21.15.173:0/2921535113 wait complete. 2024-04-25T09:13:42.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.717+0000 7f0ba7200640 1 Processor -- start 2024-04-25T09:13:42.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.717+0000 7f0ba7200640 1 -- start start 2024-04-25T09:13:42.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba7200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba80d00a0 0x7f0ba80705b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:42.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba7200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ba815b680 0x7f0ba8156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:42.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba7200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ba815ba60 0x7f0ba81567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:42.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba7200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba809acf0 con 0x7f0ba80d00a0 2024-04-25T09:13:42.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba7200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba809ab70 con 0x7f0ba815ba60 2024-04-25T09:13:42.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba7200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba80b43f0 con 0x7f0ba815b680 2024-04-25T09:13:42.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba80d00a0 0x7f0ba80705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:42.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba5e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba80d00a0 0x7f0ba80705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60948/0 (socket says 172.21.15.173:60948) 2024-04-25T09:13:42.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba5e00640 1 -- 172.21.15.173:0/2781429295 learned_addr learned my addr 172.21.15.173:0/2781429295 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:42.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba5400640 1 --2- 172.21.15.173:0/2781429295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ba815b680 0x7f0ba8156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:42.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba6800640 1 --2- 172.21.15.173:0/2781429295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ba815ba60 0x7f0ba81567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:42.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba5e00640 1 -- 172.21.15.173:0/2781429295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ba815b680 msgr2=0x7f0ba8156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:42.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba5e00640 1 --2- 172.21.15.173:0/2781429295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ba815b680 0x7f0ba8156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba5e00640 1 -- 172.21.15.173:0/2781429295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ba815ba60 msgr2=0x7f0ba81567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:42.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba5e00640 1 --2- 172.21.15.173:0/2781429295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ba815ba60 0x7f0ba81567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba5e00640 1 -- 172.21.15.173:0/2781429295 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba80c88c0 con 0x7f0ba80d00a0 2024-04-25T09:13:42.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba5400640 1 --2- 172.21.15.173:0/2781429295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ba815b680 0x7f0ba8156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:42.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba5e00640 1 --2- 172.21.15.173:0/2781429295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba80d00a0 0x7f0ba80705b0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800c450 tx=0x7f0b9800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:42.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0b9e000640 1 -- 172.21.15.173:0/2781429295 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98016020 con 0x7f0ba80d00a0 2024-04-25T09:13:42.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0b9e000640 1 -- 172.21.15.173:0/2781429295 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b980052d0 con 0x7f0ba80d00a0 2024-04-25T09:13:42.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0b9e000640 1 -- 172.21.15.173:0/2781429295 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98007260 con 0x7f0ba80d00a0 2024-04-25T09:13:42.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba7200640 1 -- 172.21.15.173:0/2781429295 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba80c8ba0 con 0x7f0ba80d00a0 2024-04-25T09:13:42.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba7200640 1 -- 172.21.15.173:0/2781429295 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba80c9160 con 0x7f0ba80d00a0 2024-04-25T09:13:42.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.721+0000 7f0ba7200640 1 -- 172.21.15.173:0/2781429295 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba8073a40 con 0x7f0ba80d00a0 2024-04-25T09:13:42.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.725+0000 7f0b9e000640 1 -- 172.21.15.173:0/2781429295 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0b98007400 con 0x7f0ba80d00a0 2024-04-25T09:13:42.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.725+0000 7f0b9e000640 1 --2- 172.21.15.173:0/2781429295 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b88066f60 0x7f0b88069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:42.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.725+0000 7f0b9e000640 1 -- 172.21.15.173:0/2781429295 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f0b98084b00 con 0x7f0ba80d00a0 2024-04-25T09:13:42.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.725+0000 7f0ba5400640 1 --2- 172.21.15.173:0/2781429295 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b88066f60 0x7f0b88069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:42.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.725+0000 7f0ba5400640 1 --2- 172.21.15.173:0/2781429295 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b88066f60 0x7f0b88069420 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f0b940ad000 tx=0x7f0b940a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:42.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.729+0000 7f0b9e000640 1 -- 172.21.15.173:0/2781429295 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0b98020020 con 0x7f0ba80d00a0 2024-04-25T09:13:42.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.881+0000 7f0ba7200640 1 -- 172.21.15.173:0/2781429295 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ba80b3cc0 con 0x7f0ba80d00a0 2024-04-25T09:13:42.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.885+0000 7f0b9e000640 1 -- 172.21.15.173:0/2781429295 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+17091 (secure 0 0 0) 0x7f0ba80cd460 con 0x7f0ba80d00a0 2024-04-25T09:13:42.869 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:42.869 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":134,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:13:30.512676+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:12:32.846423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-04-25T09:12:33.466675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:6837/3627798672":"2024-04-26T09:13:30.512572+0000","172.21.15.173:6836/3627798672":"2024-04-26T09:13:30.512572+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:13:42.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.885+0000 7f0ba7200640 1 -- 172.21.15.173:0/2781429295 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b88066f60 msgr2=0x7f0b88069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:42.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.885+0000 7f0ba7200640 1 --2- 172.21.15.173:0/2781429295 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b88066f60 0x7f0b88069420 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f0b940ad000 tx=0x7f0b940a6000 comp rx=0 tx=0).stop 2024-04-25T09:13:42.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.885+0000 7f0ba7200640 1 -- 172.21.15.173:0/2781429295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba80d00a0 msgr2=0x7f0ba80705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:42.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.885+0000 7f0ba7200640 1 --2- 172.21.15.173:0/2781429295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba80d00a0 0x7f0ba80705b0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800c450 tx=0x7f0b9800c910 comp rx=0 tx=0).stop 2024-04-25T09:13:42.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.885+0000 7f0ba7200640 1 -- 172.21.15.173:0/2781429295 shutdown_connections 2024-04-25T09:13:42.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.885+0000 7f0ba7200640 1 --2- 172.21.15.173:0/2781429295 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0b88066f60 0x7f0b88069420 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.885+0000 7f0ba7200640 1 --2- 172.21.15.173:0/2781429295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ba815ba60 0x7f0ba81567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.885+0000 7f0ba7200640 1 --2- 172.21.15.173:0/2781429295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ba815b680 0x7f0ba8156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.885+0000 7f0ba7200640 1 --2- 172.21.15.173:0/2781429295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba80d00a0 0x7f0ba80705b0 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:42.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.885+0000 7f0ba7200640 1 -- 172.21.15.173:0/2781429295 >> 172.21.15.173:0/2781429295 conn(0x7f0ba80b3090 msgr2=0x7f0ba809a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:42.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.885+0000 7f0ba7200640 1 -- 172.21.15.173:0/2781429295 shutdown_connections 2024-04-25T09:13:42.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:42.885+0000 7f0ba7200640 1 -- 172.21.15.173:0/2781429295 wait complete. 2024-04-25T09:13:42.890 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:13:43.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.041+0000 7ff64be00640 1 Processor -- start 2024-04-25T09:13:43.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.041+0000 7ff64be00640 1 -- start start 2024-04-25T09:13:43.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.041+0000 7ff64be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff6440cc7e0 0x7ff6440cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:43.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.041+0000 7ff64be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff6440aef70 0x7ff6440ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:43.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.041+0000 7ff64be00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff644071570 con 0x7ff6440aeb90 2024-04-25T09:13:43.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.041+0000 7ff64be00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff644071320 con 0x7ff6440aef70 2024-04-25T09:13:43.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.041+0000 7ff64be00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff644072330 con 0x7ff6440cc7e0 2024-04-25T09:13:43.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.041+0000 7ff649e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff6440aef70 0x7ff6440ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:43.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.041+0000 7ff649400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ff6440aeb90 0x7ff6440cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:36144/0 (socket says 172.21.15.173:36144) 2024-04-25T09:13:43.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.041+0000 7ff649400640 1 -- 172.21.15.173:0/3784987749 learned_addr learned my addr 172.21.15.173:0/3784987749 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:43.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.041+0000 7ff648a00640 1 --2- 172.21.15.173:0/3784987749 >> v2:172.21.15.194:3300/0 conn(0x7ff6440cc7e0 0x7ff6440cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:43.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.041+0000 7ff649e00640 1 -- 172.21.15.173:0/3784987749 >> v2:172.21.15.194:3300/0 conn(0x7ff6440cc7e0 msgr2=0x7ff6440cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:43.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.041+0000 7ff649e00640 1 --2- 172.21.15.173:0/3784987749 >> v2:172.21.15.194:3300/0 conn(0x7ff6440cc7e0 0x7ff6440cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:43.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.041+0000 7ff649e00640 1 -- 172.21.15.173:0/3784987749 >> v1:172.21.15.173:6789/0 conn(0x7ff6440aeb90 legacy=0x7ff6440cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:43.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.041+0000 7ff649e00640 1 -- 172.21.15.173:0/3784987749 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff644071850 con 0x7ff6440aef70 2024-04-25T09:13:43.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.045+0000 7ff649e00640 1 --2- 172.21.15.173:0/3784987749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6440aef70 0x7ff6440ce0e0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7ff6440cd960 tx=0x7ff63c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d483b822da330 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:43.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.045+0000 7ff643e00640 1 -- 172.21.15.173:0/3784987749 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0b2070 con 0x7ff6440aef70 2024-04-25T09:13:43.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.045+0000 7ff643e00640 1 -- 172.21.15.173:0/3784987749 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c0a5750 con 0x7ff6440aef70 2024-04-25T09:13:43.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.045+0000 7ff643e00640 1 -- 172.21.15.173:0/3784987749 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0a5b20 con 0x7ff6440aef70 2024-04-25T09:13:43.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.045+0000 7ff64be00640 1 -- 172.21.15.173:0/3784987749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6440aef70 msgr2=0x7ff6440ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:43.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.045+0000 7ff64be00640 1 --2- 172.21.15.173:0/3784987749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6440aef70 0x7ff6440ce0e0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7ff6440cd960 tx=0x7ff63c01c8a0 comp rx=0 tx=0).stop 2024-04-25T09:13:43.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.045+0000 7ff64be00640 1 -- 172.21.15.173:0/3784987749 shutdown_connections 2024-04-25T09:13:43.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.045+0000 7ff64be00640 1 --2- 172.21.15.173:0/3784987749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6440aef70 0x7ff6440ce0e0 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:43.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.045+0000 7ff64be00640 1 --2- 172.21.15.173:0/3784987749 >> v2:172.21.15.194:3300/0 conn(0x7ff6440cc7e0 0x7ff6440cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:43.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.045+0000 7ff64be00640 1 -- 172.21.15.173:0/3784987749 >> 172.21.15.173:0/3784987749 conn(0x7ff64406ac90 msgr2=0x7ff64406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:43.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.045+0000 7ff64be00640 1 -- 172.21.15.173:0/3784987749 shutdown_connections 2024-04-25T09:13:43.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.045+0000 7ff64be00640 1 -- 172.21.15.173:0/3784987749 wait complete. 2024-04-25T09:13:43.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff64be00640 1 Processor -- start 2024-04-25T09:13:43.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff64be00640 1 -- start start 2024-04-25T09:13:43.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff64be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6440aeb90 0x7ff6441f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:43.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff64be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6440aef70 0x7ff6440cf980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:43.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff64be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6440cc7e0 0x7ff6441577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:43.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff64be00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64415bb30 con 0x7ff6440aef70 2024-04-25T09:13:43.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff64be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64415b9b0 con 0x7ff6440aeb90 2024-04-25T09:13:43.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff64be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64415bcb0 con 0x7ff6440cc7e0 2024-04-25T09:13:43.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff648a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6440aef70 0x7ff6440cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:43.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff648a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6440aef70 0x7ff6440cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60956/0 (socket says 172.21.15.173:60956) 2024-04-25T09:13:43.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff648a00640 1 -- 172.21.15.173:0/1213279451 learned_addr learned my addr 172.21.15.173:0/1213279451 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:43.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff649400640 1 --2- 172.21.15.173:0/1213279451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6440aeb90 0x7ff6441f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:43.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff649e00640 1 --2- 172.21.15.173:0/1213279451 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6440cc7e0 0x7ff6441577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:43.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff648a00640 1 -- 172.21.15.173:0/1213279451 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6440cc7e0 msgr2=0x7ff6441577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:43.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff648a00640 1 --2- 172.21.15.173:0/1213279451 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6440cc7e0 0x7ff6441577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:43.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff648a00640 1 -- 172.21.15.173:0/1213279451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6440aeb90 msgr2=0x7ff6441f67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:43.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff648a00640 1 --2- 172.21.15.173:0/1213279451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6440aeb90 0x7ff6441f67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:43.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff648a00640 1 -- 172.21.15.173:0/1213279451 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6441516b0 con 0x7ff6440aef70 2024-04-25T09:13:43.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff648a00640 1 --2- 172.21.15.173:0/1213279451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6440aef70 0x7ff6440cf980 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7ff63000d800 tx=0x7ff63000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:43.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff641600640 1 -- 172.21.15.173:0/1213279451 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63000b6c0 con 0x7ff6440aef70 2024-04-25T09:13:43.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff641600640 1 -- 172.21.15.173:0/1213279451 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff630019070 con 0x7ff6440aef70 2024-04-25T09:13:43.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff641600640 1 -- 172.21.15.173:0/1213279451 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63000ba60 con 0x7ff6440aef70 2024-04-25T09:13:43.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff64be00640 1 -- 172.21.15.173:0/1213279451 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff644158430 con 0x7ff6440aef70 2024-04-25T09:13:43.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.049+0000 7ff64be00640 1 -- 172.21.15.173:0/1213279451 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff644153530 con 0x7ff6440aef70 2024-04-25T09:13:43.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.053+0000 7ff64be00640 1 -- 172.21.15.173:0/1213279451 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff644073ab0 con 0x7ff6440aef70 2024-04-25T09:13:43.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.053+0000 7ff641600640 1 -- 172.21.15.173:0/1213279451 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff63000bc00 con 0x7ff6440aef70 2024-04-25T09:13:43.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.053+0000 7ff641600640 1 --2- 172.21.15.173:0/1213279451 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff624066f60 0x7ff624069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:43.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.053+0000 7ff641600640 1 -- 172.21.15.173:0/1213279451 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ff630085490 con 0x7ff6440aef70 2024-04-25T09:13:43.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.053+0000 7ff649400640 1 --2- 172.21.15.173:0/1213279451 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff624066f60 0x7ff624069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:43.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.057+0000 7ff649400640 1 --2- 172.21.15.173:0/1213279451 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff624066f60 0x7ff624069420 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff638000f70 tx=0x7ff638007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:43.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.057+0000 7ff641600640 1 -- 172.21.15.173:0/1213279451 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff630055d00 con 0x7ff6440aef70 2024-04-25T09:13:43.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.245+0000 7ff64be00640 1 -- 172.21.15.173:0/1213279451 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff6440b4690 con 0x7ff6440aef70 2024-04-25T09:13:43.231 INFO:tasks.ceph.mon.a.smithi173.stderr:2024-04-25T09:13:43.245+0000 7f537be00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:13:43.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.249+0000 7ff641600640 1 -- 172.21.15.173:0/1213279451 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v94) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff630059da0 con 0x7ff6440aef70 2024-04-25T09:13:43.233 INFO:teuthology.orchestra.run.smithi173.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:13:43.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.249+0000 7ff64be00640 1 -- 172.21.15.173:0/1213279451 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff624066f60 msgr2=0x7ff624069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:43.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.249+0000 7ff64be00640 1 --2- 172.21.15.173:0/1213279451 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff624066f60 0x7ff624069420 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff638000f70 tx=0x7ff638007e90 comp rx=0 tx=0).stop 2024-04-25T09:13:43.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.249+0000 7ff64be00640 1 -- 172.21.15.173:0/1213279451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6440aef70 msgr2=0x7ff6440cf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:43.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.249+0000 7ff64be00640 1 --2- 172.21.15.173:0/1213279451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6440aef70 0x7ff6440cf980 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7ff63000d800 tx=0x7ff63000dcc0 comp rx=0 tx=0).stop 2024-04-25T09:13:43.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.249+0000 7ff64be00640 1 -- 172.21.15.173:0/1213279451 shutdown_connections 2024-04-25T09:13:43.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.249+0000 7ff64be00640 1 --2- 172.21.15.173:0/1213279451 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff624066f60 0x7ff624069420 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:43.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.249+0000 7ff64be00640 1 --2- 172.21.15.173:0/1213279451 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6440cc7e0 0x7ff6441577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:43.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.249+0000 7ff64be00640 1 --2- 172.21.15.173:0/1213279451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6440aef70 0x7ff6440cf980 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:43.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.249+0000 7ff64be00640 1 --2- 172.21.15.173:0/1213279451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6440aeb90 0x7ff6441f67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:43.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.249+0000 7ff64be00640 1 -- 172.21.15.173:0/1213279451 >> 172.21.15.173:0/1213279451 conn(0x7ff64406ac90 msgr2=0x7ff64406d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:43.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.253+0000 7ff64be00640 1 -- 172.21.15.173:0/1213279451 shutdown_connections 2024-04-25T09:13:43.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.253+0000 7ff64be00640 1 -- 172.21.15.173:0/1213279451 wait complete. 2024-04-25T09:13:43.266 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:13:43.314 INFO:tasks.ceph.mds.c.smithi173.stdout:starting mds.c at 2024-04-25T09:13:43.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.425+0000 7f82a6000640 1 Processor -- start 2024-04-25T09:13:43.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.425+0000 7f82a6000640 1 -- start start 2024-04-25T09:13:43.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.425+0000 7f82a6000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f82a00cc7e0 0x7f82a00cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:43.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.425+0000 7f82a6000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f82a00aef70 0x7f82a00ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:43.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.425+0000 7f82a6000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a0071570 con 0x7f82a00aeb90 2024-04-25T09:13:43.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.425+0000 7f82a6000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a0071320 con 0x7f82a00aef70 2024-04-25T09:13:43.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.425+0000 7f82a6000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a0072330 con 0x7f82a00cc7e0 2024-04-25T09:13:43.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.425+0000 7f829fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f82a00aef70 0x7f82a00ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:43.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.425+0000 7f829fe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f82a00aef70 0x7f82a00ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47798/0 (socket says 172.21.15.173:47798) 2024-04-25T09:13:43.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.425+0000 7f829fe00640 1 -- 172.21.15.173:0/2450409924 learned_addr learned my addr 172.21.15.173:0/2450409924 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:43.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.425+0000 7f829ea00640 1 --2- 172.21.15.173:0/2450409924 >> v2:172.21.15.194:3300/0 conn(0x7f82a00cc7e0 0x7f82a00cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:43.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.425+0000 7f829fe00640 1 -- 172.21.15.173:0/2450409924 >> v2:172.21.15.194:3300/0 conn(0x7f82a00cc7e0 msgr2=0x7f82a00cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:43.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.425+0000 7f829fe00640 1 --2- 172.21.15.173:0/2450409924 >> v2:172.21.15.194:3300/0 conn(0x7f82a00cc7e0 0x7f82a00cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:43.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.425+0000 7f829fe00640 1 -- 172.21.15.173:0/2450409924 >> v1:172.21.15.194:6789/0 conn(0x7f82a00aeb90 legacy=0x7f82a00cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:43.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.425+0000 7f829fe00640 1 -- 172.21.15.173:0/2450409924 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a0071850 con 0x7f82a00aef70 2024-04-25T09:13:43.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.429+0000 7f829fe00640 1 --2- 172.21.15.173:0/2450409924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82a00aef70 0x7f82a00ce0e0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f82a01555a0 tx=0x7f829801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463f2990a08843ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:43.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.429+0000 7f829e000640 1 -- 172.21.15.173:0/2450409924 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82980a55b0 con 0x7f82a00aef70 2024-04-25T09:13:43.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.429+0000 7f829e000640 1 -- 172.21.15.173:0/2450409924 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82980a5750 con 0x7f82a00aef70 2024-04-25T09:13:43.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.429+0000 7f829e000640 1 -- 172.21.15.173:0/2450409924 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82980a5b20 con 0x7f82a00aef70 2024-04-25T09:13:43.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.429+0000 7f82a6000640 1 -- 172.21.15.173:0/2450409924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82a00aef70 msgr2=0x7f82a00ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:43.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.429+0000 7f82a6000640 1 --2- 172.21.15.173:0/2450409924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82a00aef70 0x7f82a00ce0e0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f82a01555a0 tx=0x7f829801c900 comp rx=0 tx=0).stop 2024-04-25T09:13:43.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.429+0000 7f82a6000640 1 -- 172.21.15.173:0/2450409924 shutdown_connections 2024-04-25T09:13:43.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.429+0000 7f82a6000640 1 --2- 172.21.15.173:0/2450409924 >> v2:172.21.15.194:3300/0 conn(0x7f82a00cc7e0 0x7f82a00cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:43.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.429+0000 7f82a6000640 1 --2- 172.21.15.173:0/2450409924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82a00aef70 0x7f82a00ce0e0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:43.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.429+0000 7f82a6000640 1 -- 172.21.15.173:0/2450409924 >> 172.21.15.173:0/2450409924 conn(0x7f82a006ac90 msgr2=0x7f82a006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:43.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.429+0000 7f82a6000640 1 -- 172.21.15.173:0/2450409924 shutdown_connections 2024-04-25T09:13:43.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.429+0000 7f82a6000640 1 -- 172.21.15.173:0/2450409924 wait complete. 2024-04-25T09:13:43.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f82a6000640 1 Processor -- start 2024-04-25T09:13:43.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f82a6000640 1 -- start start 2024-04-25T09:13:43.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f82a6000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82a00aeb90 0x7f82a00af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:43.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f82a6000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82a00aef70 0x7f82a014c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:43.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f82a6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82a00cc7e0 0x7f82a01496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:43.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f82a6000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a015bb30 con 0x7f82a00cc7e0 2024-04-25T09:13:43.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f82a6000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a015b9b0 con 0x7f82a00aef70 2024-04-25T09:13:43.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f82a6000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a015bcb0 con 0x7f82a00aeb90 2024-04-25T09:13:43.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f829fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82a00cc7e0 0x7f82a01496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:43.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f829fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82a00cc7e0 0x7f82a01496e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47810/0 (socket says 172.21.15.173:47810) 2024-04-25T09:13:43.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f829fe00640 1 -- 172.21.15.173:0/737954177 learned_addr learned my addr 172.21.15.173:0/737954177 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:43.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f829f400640 1 --2- 172.21.15.173:0/737954177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82a00aeb90 0x7f82a00af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:43.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f829ea00640 1 --2- 172.21.15.173:0/737954177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82a00aef70 0x7f82a014c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:43.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f829fe00640 1 -- 172.21.15.173:0/737954177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82a00aeb90 msgr2=0x7f82a00af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:43.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f829fe00640 1 --2- 172.21.15.173:0/737954177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82a00aeb90 0x7f82a00af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:43.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f829fe00640 1 -- 172.21.15.173:0/737954177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82a00aef70 msgr2=0x7f82a014c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:43.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f829fe00640 1 --2- 172.21.15.173:0/737954177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82a00aef70 0x7f82a014c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:43.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f829fe00640 1 -- 172.21.15.173:0/737954177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a00b0360 con 0x7f82a00cc7e0 2024-04-25T09:13:43.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f829fe00640 1 --2- 172.21.15.173:0/737954177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82a00cc7e0 0x7f82a01496e0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f829801a530 tx=0x7f82980196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:43.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f8297400640 1 -- 172.21.15.173:0/737954177 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82980bc020 con 0x7f82a00cc7e0 2024-04-25T09:13:43.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f8297400640 1 -- 172.21.15.173:0/737954177 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82980b8690 con 0x7f82a00cc7e0 2024-04-25T09:13:43.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f8297400640 1 -- 172.21.15.173:0/737954177 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298009510 con 0x7f82a00cc7e0 2024-04-25T09:13:43.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f82a6000640 1 -- 172.21.15.173:0/737954177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a00b0640 con 0x7f82a00cc7e0 2024-04-25T09:13:43.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f82a6000640 1 -- 172.21.15.173:0/737954177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a00b0c00 con 0x7f82a00cc7e0 2024-04-25T09:13:43.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.433+0000 7f82a6000640 1 -- 172.21.15.173:0/737954177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a0073ab0 con 0x7f82a00cc7e0 2024-04-25T09:13:43.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.437+0000 7f8297400640 1 -- 172.21.15.173:0/737954177 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f82980bf020 con 0x7f82a00cc7e0 2024-04-25T09:13:43.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.437+0000 7f8297400640 1 --2- 172.21.15.173:0/737954177 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8280066f60 0x7f8280069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:43.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.437+0000 7f8297400640 1 -- 172.21.15.173:0/737954177 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f8298120080 con 0x7f82a00cc7e0 2024-04-25T09:13:43.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.437+0000 7f829f400640 1 --2- 172.21.15.173:0/737954177 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8280066f60 0x7f8280069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:43.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.437+0000 7f829f400640 1 --2- 172.21.15.173:0/737954177 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8280066f60 0x7f8280069420 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f82a014be00 tx=0x7f8290009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:43.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.441+0000 7f8297400640 1 -- 172.21.15.173:0/737954177 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f82980c6030 con 0x7f82a00cc7e0 2024-04-25T09:13:43.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:43.633+0000 7f82a6000640 1 -- 172.21.15.173:0/737954177 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f82a006db70 con 0x7f82a00cc7e0 2024-04-25T09:13:44.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.249+0000 7f8297400640 1 -- 172.21.15.173:0/737954177 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v95) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8298016580 con 0x7f82a00cc7e0 2024-04-25T09:13:44.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.253+0000 7f82a6000640 1 -- 172.21.15.173:0/737954177 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8280066f60 msgr2=0x7f8280069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:44.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.253+0000 7f82a6000640 1 --2- 172.21.15.173:0/737954177 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8280066f60 0x7f8280069420 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f82a014be00 tx=0x7f8290009060 comp rx=0 tx=0).stop 2024-04-25T09:13:44.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.253+0000 7f82a6000640 1 -- 172.21.15.173:0/737954177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82a00cc7e0 msgr2=0x7f82a01496e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:44.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.253+0000 7f82a6000640 1 --2- 172.21.15.173:0/737954177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82a00cc7e0 0x7f82a01496e0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f829801a530 tx=0x7f82980196a0 comp rx=0 tx=0).stop 2024-04-25T09:13:44.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.253+0000 7f82a6000640 1 -- 172.21.15.173:0/737954177 shutdown_connections 2024-04-25T09:13:44.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.253+0000 7f82a6000640 1 --2- 172.21.15.173:0/737954177 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8280066f60 0x7f8280069420 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:44.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.253+0000 7f82a6000640 1 --2- 172.21.15.173:0/737954177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82a00cc7e0 0x7f82a01496e0 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:44.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.253+0000 7f82a6000640 1 --2- 172.21.15.173:0/737954177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82a00aef70 0x7f82a014c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:44.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.253+0000 7f82a6000640 1 --2- 172.21.15.173:0/737954177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82a00aeb90 0x7f82a00af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:44.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.253+0000 7f82a6000640 1 -- 172.21.15.173:0/737954177 >> 172.21.15.173:0/737954177 conn(0x7f82a006ac90 msgr2=0x7f82a006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:44.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.253+0000 7f82a6000640 1 -- 172.21.15.173:0/737954177 shutdown_connections 2024-04-25T09:13:44.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.253+0000 7f82a6000640 1 -- 172.21.15.173:0/737954177 wait complete. 2024-04-25T09:13:44.261 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:13:44.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.461+0000 7f01fea00640 1 Processor -- start 2024-04-25T09:13:44.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.461+0000 7f01fea00640 1 -- start start 2024-04-25T09:13:44.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.461+0000 7f01fea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f01f80cc7e0 0x7f01f80cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:44.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.465+0000 7f01fea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f01f80aef70 0x7f01f80ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:44.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.465+0000 7f01fea00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f8071570 con 0x7f01f80aeb90 2024-04-25T09:13:44.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.465+0000 7f01fea00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f8071320 con 0x7f01f80cc7e0 2024-04-25T09:13:44.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.465+0000 7f01fea00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f8072330 con 0x7f01f80aef70 2024-04-25T09:13:44.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.465+0000 7f01ef400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f01f80cc7e0 0x7f01f80cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:44.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.465+0000 7f01f7e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f01f80aeb90 0x7f01f80cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:42668/0 (socket says 172.21.15.173:42668) 2024-04-25T09:13:44.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.465+0000 7f01f7e00640 1 -- 172.21.15.173:0/179497176 learned_addr learned my addr 172.21.15.173:0/179497176 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:44.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.465+0000 7f01ef400640 1 -- 172.21.15.173:0/179497176 >> v2:172.21.15.194:3300/0 conn(0x7f01f80aef70 msgr2=0x7f01f80ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:44.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.465+0000 7f01ef400640 1 --2- 172.21.15.173:0/179497176 >> v2:172.21.15.194:3300/0 conn(0x7f01f80aef70 0x7f01f80ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:44.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.465+0000 7f01ef400640 1 -- 172.21.15.173:0/179497176 >> v1:172.21.15.173:6789/0 conn(0x7f01f80aeb90 legacy=0x7f01f80cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:44.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.465+0000 7f01ef400640 1 -- 172.21.15.173:0/179497176 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f8071850 con 0x7f01f80cc7e0 2024-04-25T09:13:44.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.465+0000 7f01f7400640 1 -- 172.21.15.173:0/179497176 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705430423 0 0) 0x7f01f8071570 con 0x7f01f80aeb90 2024-04-25T09:13:44.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.465+0000 7f01ef400640 1 --2- 172.21.15.173:0/179497176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f80cc7e0 0x7f01f80cdba0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f01f81555a0 tx=0x7f01e001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de513a51d462121 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:44.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.465+0000 7f01f7400640 1 -- 172.21.15.173:0/179497176 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e00b0070 con 0x7f01f80cc7e0 2024-04-25T09:13:44.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.465+0000 7f01f7400640 1 -- 172.21.15.173:0/179497176 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e00ab600 con 0x7f01f80cc7e0 2024-04-25T09:13:44.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.465+0000 7f01f7400640 1 -- 172.21.15.173:0/179497176 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e00ab9d0 con 0x7f01f80cc7e0 2024-04-25T09:13:44.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01fea00640 1 -- 172.21.15.173:0/179497176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f80cc7e0 msgr2=0x7f01f80cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:44.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01fea00640 1 --2- 172.21.15.173:0/179497176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f80cc7e0 0x7f01f80cdba0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f01f81555a0 tx=0x7f01e001c3f0 comp rx=0 tx=0).stop 2024-04-25T09:13:44.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01fea00640 1 -- 172.21.15.173:0/179497176 shutdown_connections 2024-04-25T09:13:44.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01fea00640 1 --2- 172.21.15.173:0/179497176 >> v2:172.21.15.194:3300/0 conn(0x7f01f80aef70 0x7f01f80ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:44.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01fea00640 1 --2- 172.21.15.173:0/179497176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f80cc7e0 0x7f01f80cdba0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:44.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01fea00640 1 -- 172.21.15.173:0/179497176 >> 172.21.15.173:0/179497176 conn(0x7f01f806ac90 msgr2=0x7f01f806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:44.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01fea00640 1 -- 172.21.15.173:0/179497176 shutdown_connections 2024-04-25T09:13:44.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01fea00640 1 -- 172.21.15.173:0/179497176 wait complete. 2024-04-25T09:13:44.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01fea00640 1 Processor -- start 2024-04-25T09:13:44.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01fea00640 1 -- start start 2024-04-25T09:13:44.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01fea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f80aeb90 0x7f01f815a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:44.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01fea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f80aef70 0x7f01f8157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:44.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01fea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01f80cc7e0 0x7f01f81581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:44.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01fea00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f815bb30 con 0x7f01f80aef70 2024-04-25T09:13:44.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01fea00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f815b9b0 con 0x7f01f80cc7e0 2024-04-25T09:13:44.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01fea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f815bcb0 con 0x7f01f80aeb90 2024-04-25T09:13:44.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01ef400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f80aef70 0x7f01f8157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:44.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01ef400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f80aef70 0x7f01f8157c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47838/0 (socket says 172.21.15.173:47838) 2024-04-25T09:13:44.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01ef400640 1 -- 172.21.15.173:0/3254020667 learned_addr learned my addr 172.21.15.173:0/3254020667 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:44.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01fca00640 1 --2- 172.21.15.173:0/3254020667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01f80cc7e0 0x7f01f81581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:44.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01ef400640 1 -- 172.21.15.173:0/3254020667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f80aeb90 msgr2=0x7f01f815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:44.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01f7e00640 1 --2- 172.21.15.173:0/3254020667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f80aeb90 0x7f01f815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:44.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01ef400640 1 --2- 172.21.15.173:0/3254020667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f80aeb90 0x7f01f815a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:44.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01ef400640 1 -- 172.21.15.173:0/3254020667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01f80cc7e0 msgr2=0x7f01f81581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:44.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01ef400640 1 --2- 172.21.15.173:0/3254020667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01f80cc7e0 0x7f01f81581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:44.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01ef400640 1 -- 172.21.15.173:0/3254020667 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f815d4b0 con 0x7f01f80aef70 2024-04-25T09:13:44.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01fca00640 1 --2- 172.21.15.173:0/3254020667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01f80cc7e0 0x7f01f81581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:44.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01f7e00640 1 --2- 172.21.15.173:0/3254020667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f80aeb90 0x7f01f815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:44.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.469+0000 7f01ef400640 1 --2- 172.21.15.173:0/3254020667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f80aef70 0x7f01f8157c70 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f01e0019000 tx=0x7f01e001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:44.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.473+0000 7f01f4c00640 1 -- 172.21.15.173:0/3254020667 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e00b0050 con 0x7f01f80aef70 2024-04-25T09:13:44.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.473+0000 7f01f4c00640 1 -- 172.21.15.173:0/3254020667 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e00bc070 con 0x7f01f80aef70 2024-04-25T09:13:44.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.473+0000 7f01fea00640 1 -- 172.21.15.173:0/3254020667 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f81560a0 con 0x7f01f80aef70 2024-04-25T09:13:44.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.473+0000 7f01f4c00640 1 -- 172.21.15.173:0/3254020667 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e00b5a10 con 0x7f01f80aef70 2024-04-25T09:13:44.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.473+0000 7f01fea00640 1 -- 172.21.15.173:0/3254020667 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f815d790 con 0x7f01f80aef70 2024-04-25T09:13:44.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.473+0000 7f01fea00640 1 -- 172.21.15.173:0/3254020667 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f8073ab0 con 0x7f01f80aef70 2024-04-25T09:13:44.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.473+0000 7f01f4c00640 1 -- 172.21.15.173:0/3254020667 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f01e00ab4a0 con 0x7f01f80aef70 2024-04-25T09:13:44.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.473+0000 7f01f4c00640 1 --2- 172.21.15.173:0/3254020667 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01d4066f90 0x7f01d4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:44.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.473+0000 7f01f4c00640 1 -- 172.21.15.173:0/3254020667 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f01e011fca0 con 0x7f01f80aef70 2024-04-25T09:13:44.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.473+0000 7f01f7e00640 1 --2- 172.21.15.173:0/3254020667 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01d4066f90 0x7f01d4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:44.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.473+0000 7f01f7e00640 1 --2- 172.21.15.173:0/3254020667 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01d4066f90 0x7f01d4069450 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f01e80012f0 tx=0x7f01e8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:44.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.477+0000 7f01f4c00640 1 -- 172.21.15.173:0/3254020667 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f01e0016070 con 0x7f01f80aef70 2024-04-25T09:13:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:44.637+0000 7f01fea00640 1 -- 172.21.15.173:0/3254020667 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f01f814ea40 con 0x7f01f80aef70 2024-04-25T09:13:45.491 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:13:45.494 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:13:45.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.633+0000 7f01f4c00640 1 -- 172.21.15.173:0/3254020667 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v136) v1 ==== 181+0+0 (secure 0 0 0) 0x7f01e00f0af0 con 0x7f01f80aef70 2024-04-25T09:13:45.617 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:13:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.637+0000 7f01fea00640 1 -- 172.21.15.173:0/3254020667 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01d4066f90 msgr2=0x7f01d4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.637+0000 7f01fea00640 1 --2- 172.21.15.173:0/3254020667 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01d4066f90 0x7f01d4069450 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f01e80012f0 tx=0x7f01e8009040 comp rx=0 tx=0).stop 2024-04-25T09:13:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.637+0000 7f01fea00640 1 -- 172.21.15.173:0/3254020667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f80aef70 msgr2=0x7f01f8157c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.637+0000 7f01fea00640 1 --2- 172.21.15.173:0/3254020667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f80aef70 0x7f01f8157c70 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f01e0019000 tx=0x7f01e001ac30 comp rx=0 tx=0).stop 2024-04-25T09:13:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.637+0000 7f01fea00640 1 -- 172.21.15.173:0/3254020667 shutdown_connections 2024-04-25T09:13:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.637+0000 7f01fea00640 1 --2- 172.21.15.173:0/3254020667 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f01d4066f90 0x7f01d4069450 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.637+0000 7f01fea00640 1 --2- 172.21.15.173:0/3254020667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01f80cc7e0 0x7f01f81581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.637+0000 7f01fea00640 1 --2- 172.21.15.173:0/3254020667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01f80aef70 0x7f01f8157c70 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.637+0000 7f01fea00640 1 --2- 172.21.15.173:0/3254020667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f80aeb90 0x7f01f815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.637+0000 7f01fea00640 1 -- 172.21.15.173:0/3254020667 >> 172.21.15.173:0/3254020667 conn(0x7f01f806ac90 msgr2=0x7f01f80b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:45.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.641+0000 7f01fea00640 1 -- 172.21.15.173:0/3254020667 shutdown_connections 2024-04-25T09:13:45.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.641+0000 7f01fea00640 1 -- 172.21.15.173:0/3254020667 wait complete. 2024-04-25T09:13:45.650 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:13:45.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.809+0000 7fb59fa00640 1 Processor -- start 2024-04-25T09:13:45.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.809+0000 7fb59fa00640 1 -- start start 2024-04-25T09:13:45.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.809+0000 7fb59fa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb5980cc7e0 0x7fb5980cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.809+0000 7fb59fa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb5980aef70 0x7fb5980ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.809+0000 7fb59fa00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb598071570 con 0x7fb5980aeb90 2024-04-25T09:13:45.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.809+0000 7fb59fa00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb598071320 con 0x7fb5980cc7e0 2024-04-25T09:13:45.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.809+0000 7fb59fa00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb598072330 con 0x7fb5980aef70 2024-04-25T09:13:45.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.809+0000 7fb597e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb5980cc7e0 0x7fb5980cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.809+0000 7fb597e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb5980cc7e0 0x7fb5980cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47846/0 (socket says 172.21.15.173:47846) 2024-04-25T09:13:45.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.809+0000 7fb597e00640 1 -- 172.21.15.173:0/2401169145 learned_addr learned my addr 172.21.15.173:0/2401169145 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:45.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.809+0000 7fb59d000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fb5980aeb90 0x7fb5980cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:42678/0 (socket says 172.21.15.173:42678) 2024-04-25T09:13:45.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.813+0000 7fb59da00640 1 --2- 172.21.15.173:0/2401169145 >> v2:172.21.15.194:3300/0 conn(0x7fb5980aef70 0x7fb5980ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.813+0000 7fb597e00640 1 -- 172.21.15.173:0/2401169145 >> v2:172.21.15.194:3300/0 conn(0x7fb5980aef70 msgr2=0x7fb5980ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:45.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.813+0000 7fb597e00640 1 --2- 172.21.15.173:0/2401169145 >> v2:172.21.15.194:3300/0 conn(0x7fb5980aef70 0x7fb5980ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.813+0000 7fb597e00640 1 -- 172.21.15.173:0/2401169145 >> v1:172.21.15.173:6789/0 conn(0x7fb5980aeb90 legacy=0x7fb5980cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:45.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.813+0000 7fb597e00640 1 -- 172.21.15.173:0/2401169145 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb598071850 con 0x7fb5980cc7e0 2024-04-25T09:13:45.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.813+0000 7fb59da00640 1 --2- 172.21.15.173:0/2401169145 >> v2:172.21.15.194:3300/0 conn(0x7fb5980aef70 0x7fb5980ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:45.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.813+0000 7fb597e00640 1 --2- 172.21.15.173:0/2401169145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5980cc7e0 0x7fb5980cdba0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7fb5981555a0 tx=0x7fb58401eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9446ba4111b9b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:45.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.813+0000 7fb597400640 1 -- 172.21.15.173:0/2401169145 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5840b4070 con 0x7fb5980cc7e0 2024-04-25T09:13:45.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.813+0000 7fb597400640 1 -- 172.21.15.173:0/2401169145 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5840a7a20 con 0x7fb5980cc7e0 2024-04-25T09:13:45.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.813+0000 7fb597400640 1 -- 172.21.15.173:0/2401169145 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5840a7df0 con 0x7fb5980cc7e0 2024-04-25T09:13:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.813+0000 7fb59fa00640 1 -- 172.21.15.173:0/2401169145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5980cc7e0 msgr2=0x7fb5980cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.813+0000 7fb59fa00640 1 --2- 172.21.15.173:0/2401169145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5980cc7e0 0x7fb5980cdba0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7fb5981555a0 tx=0x7fb58401eb60 comp rx=0 tx=0).stop 2024-04-25T09:13:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb59fa00640 1 -- 172.21.15.173:0/2401169145 shutdown_connections 2024-04-25T09:13:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb59fa00640 1 --2- 172.21.15.173:0/2401169145 >> v2:172.21.15.194:3300/0 conn(0x7fb5980aef70 0x7fb5980ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb59fa00640 1 --2- 172.21.15.173:0/2401169145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5980cc7e0 0x7fb5980cdba0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb59fa00640 1 -- 172.21.15.173:0/2401169145 >> 172.21.15.173:0/2401169145 conn(0x7fb59806ac90 msgr2=0x7fb59806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb59fa00640 1 -- 172.21.15.173:0/2401169145 shutdown_connections 2024-04-25T09:13:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb59fa00640 1 -- 172.21.15.173:0/2401169145 wait complete. 2024-04-25T09:13:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb59fa00640 1 Processor -- start 2024-04-25T09:13:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb59fa00640 1 -- start start 2024-04-25T09:13:45.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb59fa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5980aeb90 0x7fb59813d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb59fa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5980aef70 0x7fb59814af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb59fa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5980cc7e0 0x7fb598148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb59fa00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59815bb30 con 0x7fb5980aef70 2024-04-25T09:13:45.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb59fa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59815b9b0 con 0x7fb5980aeb90 2024-04-25T09:13:45.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb59fa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59815bcb0 con 0x7fb5980cc7e0 2024-04-25T09:13:45.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb597e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5980aef70 0x7fb59814af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb597e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5980aef70 0x7fb59814af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47852/0 (socket says 172.21.15.173:47852) 2024-04-25T09:13:45.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb597e00640 1 -- 172.21.15.173:0/2546231624 learned_addr learned my addr 172.21.15.173:0/2546231624 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:45.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb59d000640 1 --2- 172.21.15.173:0/2546231624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5980aeb90 0x7fb59813d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb59da00640 1 --2- 172.21.15.173:0/2546231624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5980cc7e0 0x7fb598148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb597e00640 1 -- 172.21.15.173:0/2546231624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5980cc7e0 msgr2=0x7fb598148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:45.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb597e00640 1 --2- 172.21.15.173:0/2546231624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5980cc7e0 0x7fb598148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb597e00640 1 -- 172.21.15.173:0/2546231624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5980aeb90 msgr2=0x7fb59813d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:45.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb597e00640 1 --2- 172.21.15.173:0/2546231624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5980aeb90 0x7fb59813d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb597e00640 1 -- 172.21.15.173:0/2546231624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5980b1220 con 0x7fb5980aef70 2024-04-25T09:13:45.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb59da00640 1 --2- 172.21.15.173:0/2546231624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5980cc7e0 0x7fb598148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:45.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb597e00640 1 --2- 172.21.15.173:0/2546231624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5980aef70 0x7fb59814af90 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fb58401b770 tx=0x7fb58401b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:45.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb594c00640 1 -- 172.21.15.173:0/2546231624 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5840b4070 con 0x7fb5980aef70 2024-04-25T09:13:45.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb594c00640 1 -- 172.21.15.173:0/2546231624 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5840b6070 con 0x7fb5980aef70 2024-04-25T09:13:45.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb594c00640 1 -- 172.21.15.173:0/2546231624 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5840afe10 con 0x7fb5980aef70 2024-04-25T09:13:45.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.817+0000 7fb59fa00640 1 -- 172.21.15.173:0/2546231624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5980b1500 con 0x7fb5980aef70 2024-04-25T09:13:45.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.821+0000 7fb59fa00640 1 -- 172.21.15.173:0/2546231624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5980b1ac0 con 0x7fb5980aef70 2024-04-25T09:13:45.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.821+0000 7fb59fa00640 1 -- 172.21.15.173:0/2546231624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb598073ab0 con 0x7fb5980aef70 2024-04-25T09:13:45.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.821+0000 7fb594c00640 1 -- 172.21.15.173:0/2546231624 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb5840bb470 con 0x7fb5980aef70 2024-04-25T09:13:45.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.821+0000 7fb594c00640 1 --2- 172.21.15.173:0/2546231624 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb578066f60 0x7fb578069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.821+0000 7fb594c00640 1 -- 172.21.15.173:0/2546231624 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5835+0+0 (secure 0 0 0) 0x7fb58411f630 con 0x7fb5980aef70 2024-04-25T09:13:45.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.821+0000 7fb59d000640 1 --2- 172.21.15.173:0/2546231624 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb578066f60 0x7fb578069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.821+0000 7fb59d000640 1 --2- 172.21.15.173:0/2546231624 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb578066f60 0x7fb578069420 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb58c000f70 tx=0x7fb58c007c50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:45.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.825+0000 7fb594c00640 1 -- 172.21.15.173:0/2546231624 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb5840187e0 con 0x7fb5980aef70 2024-04-25T09:13:45.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:45.981+0000 7fb59fa00640 1 -- 172.21.15.173:0/2546231624 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb598149870 con 0x7fb5980aef70 2024-04-25T09:13:46.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.633+0000 7fb594c00640 1 -- 172.21.15.173:0/2546231624 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v137) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb5840f0520 con 0x7fb5980aef70 2024-04-25T09:13:46.619 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' removed 2024-04-25T09:13:46.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.637+0000 7fb59fa00640 1 -- 172.21.15.173:0/2546231624 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb578066f60 msgr2=0x7fb578069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.637+0000 7fb59fa00640 1 --2- 172.21.15.173:0/2546231624 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb578066f60 0x7fb578069420 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb58c000f70 tx=0x7fb58c007c50 comp rx=0 tx=0).stop 2024-04-25T09:13:46.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.637+0000 7fb59fa00640 1 -- 172.21.15.173:0/2546231624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5980aef70 msgr2=0x7fb59814af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.637+0000 7fb59fa00640 1 --2- 172.21.15.173:0/2546231624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5980aef70 0x7fb59814af90 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fb58401b770 tx=0x7fb58401b900 comp rx=0 tx=0).stop 2024-04-25T09:13:46.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.637+0000 7fb59fa00640 1 -- 172.21.15.173:0/2546231624 shutdown_connections 2024-04-25T09:13:46.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.637+0000 7fb59fa00640 1 --2- 172.21.15.173:0/2546231624 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb578066f60 0x7fb578069420 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.637+0000 7fb59fa00640 1 --2- 172.21.15.173:0/2546231624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5980cc7e0 0x7fb598148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.637+0000 7fb59fa00640 1 --2- 172.21.15.173:0/2546231624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5980aef70 0x7fb59814af90 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.637+0000 7fb59fa00640 1 --2- 172.21.15.173:0/2546231624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5980aeb90 0x7fb59813d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.637+0000 7fb59fa00640 1 -- 172.21.15.173:0/2546231624 >> 172.21.15.173:0/2546231624 conn(0x7fb59806ac90 msgr2=0x7fb5980d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:46.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.637+0000 7fb59fa00640 1 -- 172.21.15.173:0/2546231624 shutdown_connections 2024-04-25T09:13:46.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.637+0000 7fb59fa00640 1 -- 172.21.15.173:0/2546231624 wait complete. 2024-04-25T09:13:46.654 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:13:46.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.833+0000 7faf47800640 1 Processor -- start 2024-04-25T09:13:46.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.833+0000 7faf47800640 1 -- start start 2024-04-25T09:13:46.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.833+0000 7faf47800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7faf4006d200 0x7faf400b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.833+0000 7faf47800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf400d1490 con 0x7faf4009a160 2024-04-25T09:13:46.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.833+0000 7faf47800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf400d0bf0 con 0x7faf4015e120 2024-04-25T09:13:46.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.833+0000 7faf47800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf400d0ed0 con 0x7faf4006d200 2024-04-25T09:13:46.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.833+0000 7faf37e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7faf4006d200 0x7faf400b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.833+0000 7faf37e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7faf4006d200 0x7faf400b2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47866/0 (socket says 172.21.15.173:47866) 2024-04-25T09:13:46.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.833+0000 7faf37e00640 1 -- 172.21.15.173:0/3020799265 learned_addr learned my addr 172.21.15.173:0/3020799265 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:46.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.833+0000 7faf45800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7faf4009a160 0x7faf400cc430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:42682/0 (socket says 172.21.15.173:42682) 2024-04-25T09:13:46.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.833+0000 7faf37e00640 1 -- 172.21.15.173:0/3020799265 >> v1:172.21.15.194:6789/0 conn(0x7faf4015e120 legacy=0x7faf40099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.833+0000 7faf37e00640 1 -- 172.21.15.173:0/3020799265 >> v1:172.21.15.173:6789/0 conn(0x7faf4009a160 legacy=0x7faf400cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.833+0000 7faf37e00640 1 -- 172.21.15.173:0/3020799265 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf400d11b0 con 0x7faf4006d200 2024-04-25T09:13:46.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.833+0000 7faf3fe00640 1 -- 172.21.15.173:0/3020799265 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430264917 0 0) 0x7faf400d1490 con 0x7faf4009a160 2024-04-25T09:13:46.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.837+0000 7faf37e00640 1 --2- 172.21.15.173:0/3020799265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf4006d200 0x7faf400b2a00 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7faf28009870 tx=0x7faf2801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa43e5a076243dbc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:46.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.837+0000 7faf3fe00640 1 -- 172.21.15.173:0/3020799265 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf280b0070 con 0x7faf4006d200 2024-04-25T09:13:46.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.837+0000 7faf3fe00640 1 -- 172.21.15.173:0/3020799265 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf280ab600 con 0x7faf4006d200 2024-04-25T09:13:46.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.837+0000 7faf3fe00640 1 -- 172.21.15.173:0/3020799265 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf280ab9d0 con 0x7faf4006d200 2024-04-25T09:13:46.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.837+0000 7faf47800640 1 -- 172.21.15.173:0/3020799265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf4006d200 msgr2=0x7faf400b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.837+0000 7faf47800640 1 --2- 172.21.15.173:0/3020799265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf4006d200 0x7faf400b2a00 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7faf28009870 tx=0x7faf2801c4d0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.837+0000 7faf47800640 1 -- 172.21.15.173:0/3020799265 shutdown_connections 2024-04-25T09:13:46.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.837+0000 7faf47800640 1 --2- 172.21.15.173:0/3020799265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf4006d200 0x7faf400b2a00 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.837+0000 7faf47800640 1 -- 172.21.15.173:0/3020799265 >> 172.21.15.173:0/3020799265 conn(0x7faf400b32a0 msgr2=0x7faf400b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:46.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.837+0000 7faf47800640 1 -- 172.21.15.173:0/3020799265 shutdown_connections 2024-04-25T09:13:46.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.837+0000 7faf47800640 1 -- 172.21.15.173:0/3020799265 wait complete. 2024-04-25T09:13:46.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf47800640 1 Processor -- start 2024-04-25T09:13:46.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf47800640 1 -- start start 2024-04-25T09:13:46.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf47800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf4006d200 0x7faf401526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf47800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf4009a160 0x7faf400c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf47800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf4015e120 0x7faf40156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf47800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4016bb70 con 0x7faf4015e120 2024-04-25T09:13:46.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf47800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf400cd620 con 0x7faf4006d200 2024-04-25T09:13:46.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf47800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4016bcf0 con 0x7faf4009a160 2024-04-25T09:13:46.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf45800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf4015e120 0x7faf40156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf45800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf4015e120 0x7faf40156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47868/0 (socket says 172.21.15.173:47868) 2024-04-25T09:13:46.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf45800640 1 -- 172.21.15.173:0/871092208 learned_addr learned my addr 172.21.15.173:0/871092208 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:46.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf37e00640 1 --2- 172.21.15.173:0/871092208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf4009a160 0x7faf400c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf44e00640 1 --2- 172.21.15.173:0/871092208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf4006d200 0x7faf401526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf45800640 1 -- 172.21.15.173:0/871092208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf4009a160 msgr2=0x7faf400c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf45800640 1 --2- 172.21.15.173:0/871092208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf4009a160 0x7faf400c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf45800640 1 -- 172.21.15.173:0/871092208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf4006d200 msgr2=0x7faf401526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf45800640 1 --2- 172.21.15.173:0/871092208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf4006d200 0x7faf401526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf45800640 1 -- 172.21.15.173:0/871092208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf400c6df0 con 0x7faf4015e120 2024-04-25T09:13:46.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf45800640 1 --2- 172.21.15.173:0/871092208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf4015e120 0x7faf40156770 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7faf3800c700 tx=0x7faf3800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:46.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf3d600640 1 -- 172.21.15.173:0/871092208 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38018070 con 0x7faf4015e120 2024-04-25T09:13:46.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf3d600640 1 -- 172.21.15.173:0/871092208 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3800ce10 con 0x7faf4015e120 2024-04-25T09:13:46.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf47800640 1 -- 172.21.15.173:0/871092208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf400c70d0 con 0x7faf4015e120 2024-04-25T09:13:46.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf3d600640 1 -- 172.21.15.173:0/871092208 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3800a880 con 0x7faf4015e120 2024-04-25T09:13:46.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf47800640 1 -- 172.21.15.173:0/871092208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf400c7690 con 0x7faf4015e120 2024-04-25T09:13:46.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.841+0000 7faf47800640 1 -- 172.21.15.173:0/871092208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf40073ab0 con 0x7faf4015e120 2024-04-25T09:13:46.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.845+0000 7faf3d600640 1 -- 172.21.15.173:0/871092208 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faf3801b070 con 0x7faf4015e120 2024-04-25T09:13:46.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.845+0000 7faf3d600640 1 --2- 172.21.15.173:0/871092208 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf1c066f60 0x7faf1c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.845+0000 7faf3d600640 1 -- 172.21.15.173:0/871092208 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5421+0+0 (secure 0 0 0) 0x7faf38084410 con 0x7faf4015e120 2024-04-25T09:13:46.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.845+0000 7faf44e00640 1 --2- 172.21.15.173:0/871092208 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf1c066f60 0x7faf1c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.845+0000 7faf44e00640 1 --2- 172.21.15.173:0/871092208 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf1c066f60 0x7faf1c069420 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7faf400ce8e0 tx=0x7faf30009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:46.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:46.849+0000 7faf3d600640 1 -- 172.21.15.173:0/871092208 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faf38054ed0 con 0x7faf4015e120 2024-04-25T09:13:46.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.005+0000 7faf47800640 1 -- 172.21.15.173:0/871092208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7faf400b7670 con 0x7faf4015e120 2024-04-25T09:13:46.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.009+0000 7faf3d600640 1 -- 172.21.15.173:0/871092208 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7faf38058f70 con 0x7faf4015e120 2024-04-25T09:13:46.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.009+0000 7faf47800640 1 -- 172.21.15.173:0/871092208 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf1c066f60 msgr2=0x7faf1c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.009+0000 7faf47800640 1 --2- 172.21.15.173:0/871092208 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf1c066f60 0x7faf1c069420 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7faf400ce8e0 tx=0x7faf30009040 comp rx=0 tx=0).stop 2024-04-25T09:13:46.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.009+0000 7faf47800640 1 -- 172.21.15.173:0/871092208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf4015e120 msgr2=0x7faf40156770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.009+0000 7faf47800640 1 --2- 172.21.15.173:0/871092208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf4015e120 0x7faf40156770 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7faf3800c700 tx=0x7faf3800cbc0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.009+0000 7faf47800640 1 -- 172.21.15.173:0/871092208 shutdown_connections 2024-04-25T09:13:46.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.009+0000 7faf47800640 1 --2- 172.21.15.173:0/871092208 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faf1c066f60 0x7faf1c069420 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.009+0000 7faf47800640 1 --2- 172.21.15.173:0/871092208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf4015e120 0x7faf40156770 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.009+0000 7faf47800640 1 --2- 172.21.15.173:0/871092208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf4009a160 0x7faf400c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.009+0000 7faf47800640 1 --2- 172.21.15.173:0/871092208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf4006d200 0x7faf401526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.009+0000 7faf47800640 1 -- 172.21.15.173:0/871092208 >> 172.21.15.173:0/871092208 conn(0x7faf400b32a0 msgr2=0x7faf4015cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:46.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.009+0000 7faf47800640 1 -- 172.21.15.173:0/871092208 shutdown_connections 2024-04-25T09:13:46.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.009+0000 7faf47800640 1 -- 172.21.15.173:0/871092208 wait complete. 2024-04-25T09:13:47.014 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-04-25T09:13:47.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3449800640 1 Processor -- start 2024-04-25T09:13:47.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3449800640 1 -- start start 2024-04-25T09:13:47.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3449800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3444145250 0x7f344415c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3449800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34440cc8b0 0x7f34440ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3449800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3444071320 0x7f3444071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3449800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f344415cec0 con 0x7f3444071320 2024-04-25T09:13:47.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3449800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f344406e7c0 con 0x7f3444145250 2024-04-25T09:13:47.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3449800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344406d720 con 0x7f34440cc8b0 2024-04-25T09:13:47.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3443400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3444071320 0x7f3444071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3443400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3444071320 0x7f3444071790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47880/0 (socket says 172.21.15.173:47880) 2024-04-25T09:13:47.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3443400640 1 -- 172.21.15.173:0/2698574495 learned_addr learned my addr 172.21.15.173:0/2698574495 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:47.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3442a00640 1 --2- 172.21.15.173:0/2698574495 >> v2:172.21.15.194:3300/0 conn(0x7f3444145250 0x7f344415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3442000640 1 --2- 172.21.15.173:0/2698574495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34440cc8b0 0x7f34440ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3443400640 1 -- 172.21.15.173:0/2698574495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34440cc8b0 msgr2=0x7f34440ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:47.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3443400640 1 --2- 172.21.15.173:0/2698574495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34440cc8b0 0x7f34440ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3443400640 1 -- 172.21.15.173:0/2698574495 >> v2:172.21.15.194:3300/0 conn(0x7f3444145250 msgr2=0x7f344415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:47.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3443400640 1 --2- 172.21.15.173:0/2698574495 >> v2:172.21.15.194:3300/0 conn(0x7f3444145250 0x7f344415c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3443400640 1 -- 172.21.15.173:0/2698574495 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344406da00 con 0x7f3444071320 2024-04-25T09:13:47.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.169+0000 7f3442000640 1 --2- 172.21.15.173:0/2698574495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34440cc8b0 0x7f34440ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:47.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.173+0000 7f3443400640 1 --2- 172.21.15.173:0/2698574495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3444071320 0x7f3444071790 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f34440d0420 tx=0x7f343c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9ed739221017f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:47.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.173+0000 7f3441600640 1 -- 172.21.15.173:0/2698574495 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c0b1070 con 0x7f3444071320 2024-04-25T09:13:47.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.173+0000 7f3441600640 1 -- 172.21.15.173:0/2698574495 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343c0ac630 con 0x7f3444071320 2024-04-25T09:13:47.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.173+0000 7f3441600640 1 -- 172.21.15.173:0/2698574495 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c0a8050 con 0x7f3444071320 2024-04-25T09:13:47.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.173+0000 7f3449800640 1 -- 172.21.15.173:0/2698574495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3444071320 msgr2=0x7f3444071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.173+0000 7f3449800640 1 --2- 172.21.15.173:0/2698574495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3444071320 0x7f3444071790 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f34440d0420 tx=0x7f343c01c520 comp rx=0 tx=0).stop 2024-04-25T09:13:47.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.173+0000 7f3449800640 1 -- 172.21.15.173:0/2698574495 shutdown_connections 2024-04-25T09:13:47.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.173+0000 7f3449800640 1 --2- 172.21.15.173:0/2698574495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3444071320 0x7f3444071790 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.173+0000 7f3449800640 1 --2- 172.21.15.173:0/2698574495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34440cc8b0 0x7f34440ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.173+0000 7f3449800640 1 --2- 172.21.15.173:0/2698574495 >> v2:172.21.15.194:3300/0 conn(0x7f3444145250 0x7f344415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.173+0000 7f3449800640 1 -- 172.21.15.173:0/2698574495 >> 172.21.15.173:0/2698574495 conn(0x7f344406ac90 msgr2=0x7f344406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:47.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.173+0000 7f3449800640 1 -- 172.21.15.173:0/2698574495 shutdown_connections 2024-04-25T09:13:47.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.173+0000 7f3449800640 1 -- 172.21.15.173:0/2698574495 wait complete. 2024-04-25T09:13:47.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.173+0000 7f3449800640 1 Processor -- start 2024-04-25T09:13:47.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.173+0000 7f3449800640 1 -- start start 2024-04-25T09:13:47.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3449800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3444071320 0x7f3444137ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3449800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34440cc8b0 0x7f344413e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3449800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3444145250 0x7f344413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3449800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34440720e0 con 0x7f34440cc8b0 2024-04-25T09:13:47.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3449800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3444145630 con 0x7f3444145250 2024-04-25T09:13:47.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3449800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344406ef80 con 0x7f3444071320 2024-04-25T09:13:47.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3442000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34440cc8b0 0x7f344413e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3442000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34440cc8b0 0x7f344413e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47894/0 (socket says 172.21.15.173:47894) 2024-04-25T09:13:47.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3442000640 1 -- 172.21.15.173:0/918466409 learned_addr learned my addr 172.21.15.173:0/918466409 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:47.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3442a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3444071320 0x7f3444137ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3443400640 1 --2- 172.21.15.173:0/918466409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3444145250 0x7f344413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3442a00640 1 -- 172.21.15.173:0/918466409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3444145250 msgr2=0x7f344413e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3442a00640 1 --2- 172.21.15.173:0/918466409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3444145250 0x7f344413e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3442a00640 1 -- 172.21.15.173:0/918466409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34440cc8b0 msgr2=0x7f344413e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3442a00640 1 --2- 172.21.15.173:0/918466409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34440cc8b0 0x7f344413e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3442a00640 1 -- 172.21.15.173:0/918466409 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3444140160 con 0x7f3444071320 2024-04-25T09:13:47.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3442000640 1 --2- 172.21.15.173:0/918466409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34440cc8b0 0x7f344413e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:47.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3442a00640 1 --2- 172.21.15.173:0/918466409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3444071320 0x7f3444137ff0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3434007e60 tx=0x7f343400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:47.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f343aa00640 1 -- 172.21.15.173:0/918466409 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434014620 con 0x7f3444071320 2024-04-25T09:13:47.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f343aa00640 1 -- 172.21.15.173:0/918466409 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3434019070 con 0x7f3444071320 2024-04-25T09:13:47.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3449800640 1 -- 172.21.15.173:0/918466409 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3444140440 con 0x7f3444071320 2024-04-25T09:13:47.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f343aa00640 1 -- 172.21.15.173:0/918466409 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34340149e0 con 0x7f3444071320 2024-04-25T09:13:47.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3449800640 1 -- 172.21.15.173:0/918466409 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3444140a00 con 0x7f3444071320 2024-04-25T09:13:47.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.177+0000 7f3449800640 1 -- 172.21.15.173:0/918466409 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3444073a40 con 0x7f3444071320 2024-04-25T09:13:47.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.181+0000 7f343aa00640 1 -- 172.21.15.173:0/918466409 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3434014b80 con 0x7f3444071320 2024-04-25T09:13:47.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.181+0000 7f343aa00640 1 --2- 172.21.15.173:0/918466409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3424066f90 0x7f3424069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.181+0000 7f343aa00640 1 -- 172.21.15.173:0/918466409 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f34340856d0 con 0x7f3444071320 2024-04-25T09:13:47.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.181+0000 7f3442000640 1 --2- 172.21.15.173:0/918466409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3424066f90 0x7f3424069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.181+0000 7f3442000640 1 --2- 172.21.15.173:0/918466409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3424066f90 0x7f3424069450 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f344415eb00 tx=0x7f3430008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:47.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.185+0000 7f343aa00640 1 -- 172.21.15.173:0/918466409 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3434056110 con 0x7f3444071320 2024-04-25T09:13:47.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.393+0000 7f3449800640 1 -- 172.21.15.173:0/918466409 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) v1 -- 0x7f344413f100 con 0x7f3444071320 2024-04-25T09:13:47.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.657+0000 7f343aa00640 1 -- 172.21.15.173:0/918466409 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v525) v1 ==== 166+0+0 (secure 0 0 0) 0x7f343405a1b0 con 0x7f3444071320 2024-04-25T09:13:47.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.657+0000 7f3449800640 1 -- 172.21.15.173:0/918466409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3424066f90 msgr2=0x7f3424069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.657+0000 7f3449800640 1 --2- 172.21.15.173:0/918466409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3424066f90 0x7f3424069450 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f344415eb00 tx=0x7f3430008040 comp rx=0 tx=0).stop 2024-04-25T09:13:47.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.657+0000 7f3449800640 1 -- 172.21.15.173:0/918466409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3444071320 msgr2=0x7f3444137ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.657+0000 7f3449800640 1 --2- 172.21.15.173:0/918466409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3444071320 0x7f3444137ff0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3434007e60 tx=0x7f343400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.657+0000 7f3449800640 1 -- 172.21.15.173:0/918466409 shutdown_connections 2024-04-25T09:13:47.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.657+0000 7f3449800640 1 --2- 172.21.15.173:0/918466409 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3424066f90 0x7f3424069450 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.657+0000 7f3449800640 1 --2- 172.21.15.173:0/918466409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3444145250 0x7f344413e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.657+0000 7f3449800640 1 --2- 172.21.15.173:0/918466409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34440cc8b0 0x7f344413e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.657+0000 7f3449800640 1 --2- 172.21.15.173:0/918466409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3444071320 0x7f3444137ff0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.657+0000 7f3449800640 1 -- 172.21.15.173:0/918466409 >> 172.21.15.173:0/918466409 conn(0x7f344406ac90 msgr2=0x7f34440ae5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:47.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.657+0000 7f3449800640 1 -- 172.21.15.173:0/918466409 shutdown_connections 2024-04-25T09:13:47.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.657+0000 7f3449800640 1 -- 172.21.15.173:0/918466409 wait complete. 2024-04-25T09:13:47.661 INFO:tasks.cephfs_test_runner:test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-04-25T09:13:47.662 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T09:13:47.662 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:13:47.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c9a00640 1 Processor -- start 2024-04-25T09:13:47.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c9a00640 1 -- start start 2024-04-25T09:13:47.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21c415ba20 0x7f21c415be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c9a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f21c40b7550 0x7f21c40d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c9a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c415c460 con 0x7f21c40b70f0 2024-04-25T09:13:47.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c9a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c415c740 con 0x7f21c40b7550 2024-04-25T09:13:47.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c415ca20 con 0x7f21c415ba20 2024-04-25T09:13:47.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21ba000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f21c40b70f0 0x7f21c406f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:42692/0 (socket says 172.21.15.173:42692) 2024-04-25T09:13:47.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21ba000640 1 -- 172.21.15.173:0/627069075 learned_addr learned my addr 172.21.15.173:0/627069075 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:47.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2000640 1 -- 172.21.15.173:0/627069075 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361297978 0 0) 0x7f21c415c460 con 0x7f21c40b70f0 2024-04-25T09:13:47.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2000640 1 -- 172.21.15.173:0/627069075 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21a8003530 con 0x7f21c40b70f0 2024-04-25T09:13:47.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c3400640 1 --2- 172.21.15.173:0/627069075 >> v2:172.21.15.194:3300/0 conn(0x7f21c40b7550 0x7f21c40d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2a00640 1 --2- 172.21.15.173:0/627069075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21c415ba20 0x7f21c415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2000640 1 -- 172.21.15.173:0/627069075 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 303745282 0 0) 0x7f21a8003530 con 0x7f21c40b70f0 2024-04-25T09:13:47.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2000640 1 -- 172.21.15.173:0/627069075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21c415ba20 msgr2=0x7f21c415be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:47.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2000640 1 --2- 172.21.15.173:0/627069075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21c415ba20 0x7f21c415be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2000640 1 -- 172.21.15.173:0/627069075 >> v2:172.21.15.194:3300/0 conn(0x7f21c40b7550 msgr2=0x7f21c40d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:47.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2000640 1 --2- 172.21.15.173:0/627069075 >> v2:172.21.15.194:3300/0 conn(0x7f21c40b7550 0x7f21c40d1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2000640 1 -- 172.21.15.173:0/627069075 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c415cd00 con 0x7f21c40b70f0 2024-04-25T09:13:47.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2000640 1 -- 172.21.15.173:0/627069075 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f21ac001a00 con 0x7f21c40b70f0 2024-04-25T09:13:47.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2000640 1 -- 172.21.15.173:0/627069075 >> v1:172.21.15.173:6789/0 conn(0x7f21c40b70f0 legacy=0x7f21c406f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2000640 1 --2- 172.21.15.173:0/627069075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21a80039c0 0x7f21a8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2000640 1 --2- 172.21.15.173:0/627069075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21a8004810 0x7f21a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2000640 1 --2- 172.21.15.173:0/627069075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21c415ba20 0x7f21a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2000640 1 -- 172.21.15.173:0/627069075 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c415c740 con 0x7f21a80039c0 2024-04-25T09:13:47.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2000640 1 -- 172.21.15.173:0/627069075 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c415ca20 con 0x7f21a8004810 2024-04-25T09:13:47.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2000640 1 -- 172.21.15.173:0/627069075 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a800b9d0 con 0x7f21c415ba20 2024-04-25T09:13:47.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2a00640 1 --2- 172.21.15.173:0/627069075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21a80039c0 0x7f21a8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21ba000640 1 --2- 172.21.15.173:0/627069075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21a8004810 0x7f21a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c3400640 1 --2- 172.21.15.173:0/627069075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21c415ba20 0x7f21a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2a00640 1 -- 172.21.15.173:0/627069075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21c415ba20 msgr2=0x7f21a80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:47.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2a00640 1 --2- 172.21.15.173:0/627069075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21c415ba20 0x7f21a80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2a00640 1 -- 172.21.15.173:0/627069075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21a8004810 msgr2=0x7f21a8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:47.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2a00640 1 --2- 172.21.15.173:0/627069075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21a8004810 0x7f21a8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c2a00640 1 -- 172.21.15.173:0/627069075 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a8003530 con 0x7f21a80039c0 2024-04-25T09:13:47.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21c3400640 1 --2- 172.21.15.173:0/627069075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21c415ba20 0x7f21a80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:47.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.825+0000 7f21ba000640 1 --2- 172.21.15.173:0/627069075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21a8004810 0x7f21a8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:47.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.829+0000 7f21c2a00640 1 --2- 172.21.15.173:0/627069075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21a80039c0 0x7f21a8003de0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009ae0 tx=0x7f21b401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e68b1cddd4136fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:47.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.829+0000 7f21c2000640 1 -- 172.21.15.173:0/627069075 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b40b2070 con 0x7f21a80039c0 2024-04-25T09:13:47.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.829+0000 7f21c2000640 1 -- 172.21.15.173:0/627069075 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b40a5550 con 0x7f21a80039c0 2024-04-25T09:13:47.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.829+0000 7f21c2000640 1 -- 172.21.15.173:0/627069075 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b40096b0 con 0x7f21a80039c0 2024-04-25T09:13:47.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.829+0000 7f21c9a00640 1 -- 172.21.15.173:0/627069075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21a80039c0 msgr2=0x7f21a8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.829+0000 7f21c9a00640 1 --2- 172.21.15.173:0/627069075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21a80039c0 0x7f21a8003de0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009ae0 tx=0x7f21b401c9e0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.829+0000 7f21c3400640 1 -- 172.21.15.173:0/627069075 reap_dead start 2024-04-25T09:13:47.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.829+0000 7f21c9a00640 1 -- 172.21.15.173:0/627069075 shutdown_connections 2024-04-25T09:13:47.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.829+0000 7f21c9a00640 1 -- 172.21.15.173:0/627069075 >> 172.21.15.173:0/627069075 conn(0x7f21c4061880 msgr2=0x7f21c4061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:47.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.829+0000 7f21c9a00640 1 -- 172.21.15.173:0/627069075 shutdown_connections 2024-04-25T09:13:47.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.829+0000 7f21c9a00640 1 -- 172.21.15.173:0/627069075 wait complete. 2024-04-25T09:13:47.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21c9a00640 1 Processor -- start 2024-04-25T09:13:47.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21c9a00640 1 -- start start 2024-04-25T09:13:47.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21c9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21a80039c0 0x7f21c4151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21c9a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21c40ac8d0 0x7f21c40afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21c9a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21c40b0050 0x7f21c406cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21c9a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c40d2350 con 0x7f21c40ac8d0 2024-04-25T09:13:47.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21c9a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c40d21d0 con 0x7f21c40b0050 2024-04-25T09:13:47.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21c9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c40d24d0 con 0x7f21a80039c0 2024-04-25T09:13:47.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21ba000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21c40ac8d0 0x7f21c40afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21ba000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21c40ac8d0 0x7f21c40afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47912/0 (socket says 172.21.15.173:47912) 2024-04-25T09:13:47.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21ba000640 1 -- 172.21.15.173:0/53652060 learned_addr learned my addr 172.21.15.173:0/53652060 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:47.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21c3400640 1 --2- 172.21.15.173:0/53652060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21c40b0050 0x7f21c406cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21c2a00640 1 --2- 172.21.15.173:0/53652060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21a80039c0 0x7f21c4151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21ba000640 1 -- 172.21.15.173:0/53652060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21a80039c0 msgr2=0x7f21c4151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21ba000640 1 --2- 172.21.15.173:0/53652060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21a80039c0 0x7f21c4151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21ba000640 1 -- 172.21.15.173:0/53652060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21c40b0050 msgr2=0x7f21c406cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21ba000640 1 --2- 172.21.15.173:0/53652060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21c40b0050 0x7f21c406cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21ba000640 1 -- 172.21.15.173:0/53652060 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c4159670 con 0x7f21c40ac8d0 2024-04-25T09:13:47.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21ba000640 1 --2- 172.21.15.173:0/53652060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21c40ac8d0 0x7f21c40afb10 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f21ac0079e0 tx=0x7f21ac00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:47.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21bb400640 1 -- 172.21.15.173:0/53652060 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac00edf0 con 0x7f21c40ac8d0 2024-04-25T09:13:47.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21bb400640 1 -- 172.21.15.173:0/53652060 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ac018070 con 0x7f21c40ac8d0 2024-04-25T09:13:47.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21c9a00640 1 -- 172.21.15.173:0/53652060 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c41598e0 con 0x7f21c40ac8d0 2024-04-25T09:13:47.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21bb400640 1 -- 172.21.15.173:0/53652060 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac013620 con 0x7f21c40ac8d0 2024-04-25T09:13:47.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.833+0000 7f21c9a00640 1 -- 172.21.15.173:0/53652060 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c4159ea0 con 0x7f21c40ac8d0 2024-04-25T09:13:47.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.837+0000 7f21c9a00640 1 -- 172.21.15.173:0/53652060 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c4073a40 con 0x7f21c40ac8d0 2024-04-25T09:13:47.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.837+0000 7f21bb400640 1 -- 172.21.15.173:0/53652060 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f21ac0137c0 con 0x7f21c40ac8d0 2024-04-25T09:13:47.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.837+0000 7f21bb400640 1 --2- 172.21.15.173:0/53652060 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f21a0066f90 0x7f21a0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.837+0000 7f21bb400640 1 -- 172.21.15.173:0/53652060 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f21ac085470 con 0x7f21c40ac8d0 2024-04-25T09:13:47.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.837+0000 7f21c2a00640 1 --2- 172.21.15.173:0/53652060 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f21a0066f90 0x7f21a0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.837+0000 7f21c2a00640 1 --2- 172.21.15.173:0/53652060 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f21a0066f90 0x7f21a0069450 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f21b40af000 tx=0x7f21b40046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:47.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:47.841+0000 7f21bb400640 1 -- 172.21.15.173:0/53652060 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f21ac055eb0 con 0x7f21c40ac8d0 2024-04-25T09:13:47.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.009+0000 7f21c9a00640 1 -- 172.21.15.173:0/53652060 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21c40b0430 con 0x7f21c40ac8d0 2024-04-25T09:13:47.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.013+0000 7f21bb400640 1 -- 172.21.15.173:0/53652060 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+13497 (secure 0 0 0) 0x7f21ac059f50 con 0x7f21c40ac8d0 2024-04-25T09:13:47.996 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:47.997 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":137,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:13:46.636163+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.173:6835/1841246276":"2024-04-26T09:13:43.250336+0000","172.21.15.173:6834/1841246276":"2024-04-26T09:13:43.250336+0000","172.21.15.173:6837/3627798672":"2024-04-26T09:13:30.512572+0000","172.21.15.173:6836/3627798672":"2024-04-26T09:13:30.512572+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:13:47.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.013+0000 7f21c9a00640 1 -- 172.21.15.173:0/53652060 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f21a0066f90 msgr2=0x7f21a0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.013+0000 7f21c9a00640 1 --2- 172.21.15.173:0/53652060 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f21a0066f90 0x7f21a0069450 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f21b40af000 tx=0x7f21b40046d0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.013+0000 7f21c9a00640 1 -- 172.21.15.173:0/53652060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21c40ac8d0 msgr2=0x7f21c40afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.013+0000 7f21c9a00640 1 --2- 172.21.15.173:0/53652060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21c40ac8d0 0x7f21c40afb10 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f21ac0079e0 tx=0x7f21ac00e530 comp rx=0 tx=0).stop 2024-04-25T09:13:47.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.013+0000 7f21c9a00640 1 -- 172.21.15.173:0/53652060 shutdown_connections 2024-04-25T09:13:47.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.013+0000 7f21c9a00640 1 --2- 172.21.15.173:0/53652060 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f21a0066f90 0x7f21a0069450 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.013+0000 7f21c9a00640 1 --2- 172.21.15.173:0/53652060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21c40b0050 0x7f21c406cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.013+0000 7f21c9a00640 1 --2- 172.21.15.173:0/53652060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21c40ac8d0 0x7f21c40afb10 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.013+0000 7f21c9a00640 1 --2- 172.21.15.173:0/53652060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21a80039c0 0x7f21c4151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.013+0000 7f21c9a00640 1 -- 172.21.15.173:0/53652060 >> 172.21.15.173:0/53652060 conn(0x7f21c4061880 msgr2=0x7f21c40d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:47.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.013+0000 7f21c9a00640 1 -- 172.21.15.173:0/53652060 shutdown_connections 2024-04-25T09:13:47.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.013+0000 7f21c9a00640 1 -- 172.21.15.173:0/53652060 wait complete. 2024-04-25T09:13:48.017 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:13:48.017 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:13:48.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.169+0000 7fb6daa00640 1 Processor -- start 2024-04-25T09:13:48.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.169+0000 7fb6daa00640 1 -- start start 2024-04-25T09:13:48.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.173+0000 7fb6daa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb6d40cff40 0x7fb6d4159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.173+0000 7fb6daa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb6d40cd2f0 0x7fb6d40cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.173+0000 7fb6daa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6d406d380 0x7fb6d406d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.173+0000 7fb6daa00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d415ddd0 con 0x7fb6d40cd2f0 2024-04-25T09:13:48.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.173+0000 7fb6daa00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d415e0b0 con 0x7fb6d40cff40 2024-04-25T09:13:48.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.173+0000 7fb6daa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d415e390 con 0x7fb6d406d380 2024-04-25T09:13:48.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.173+0000 7fb6d3400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb6d40cd2f0 0x7fb6d40cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.173+0000 7fb6d3400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb6d40cd2f0 0x7fb6d40cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47922/0 (socket says 172.21.15.173:47922) 2024-04-25T09:13:48.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.173+0000 7fb6d3400640 1 -- 172.21.15.173:0/3565237544 learned_addr learned my addr 172.21.15.173:0/3565237544 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:48.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.173+0000 7fb6d8a00640 1 --2- 172.21.15.173:0/3565237544 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6d406d380 0x7fb6d406d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.173+0000 7fb6d3e00640 1 --2- 172.21.15.173:0/3565237544 >> v2:172.21.15.194:3300/0 conn(0x7fb6d40cff40 0x7fb6d4159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.173+0000 7fb6d3400640 1 -- 172.21.15.173:0/3565237544 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6d406d380 msgr2=0x7fb6d406d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:48.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.173+0000 7fb6d3400640 1 --2- 172.21.15.173:0/3565237544 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6d406d380 0x7fb6d406d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.173+0000 7fb6d3400640 1 -- 172.21.15.173:0/3565237544 >> v2:172.21.15.194:3300/0 conn(0x7fb6d40cff40 msgr2=0x7fb6d4159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:48.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.173+0000 7fb6d3400640 1 --2- 172.21.15.173:0/3565237544 >> v2:172.21.15.194:3300/0 conn(0x7fb6d40cff40 0x7fb6d4159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.173+0000 7fb6d3400640 1 -- 172.21.15.173:0/3565237544 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d415e670 con 0x7fb6d40cd2f0 2024-04-25T09:13:48.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.177+0000 7fb6d3400640 1 --2- 172.21.15.173:0/3565237544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d40cd2f0 0x7fb6d40cd780 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40d07a0 tx=0x7fb6bc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80cc2ff3b7cecee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:48.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.177+0000 7fb6d2a00640 1 -- 172.21.15.173:0/3565237544 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc0b0070 con 0x7fb6d40cd2f0 2024-04-25T09:13:48.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.177+0000 7fb6d2a00640 1 -- 172.21.15.173:0/3565237544 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc0ab600 con 0x7fb6d40cd2f0 2024-04-25T09:13:48.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.177+0000 7fb6d2a00640 1 -- 172.21.15.173:0/3565237544 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc0ab9d0 con 0x7fb6d40cd2f0 2024-04-25T09:13:48.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.177+0000 7fb6daa00640 1 -- 172.21.15.173:0/3565237544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d40cd2f0 msgr2=0x7fb6d40cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.177+0000 7fb6daa00640 1 --2- 172.21.15.173:0/3565237544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d40cd2f0 0x7fb6d40cd780 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40d07a0 tx=0x7fb6bc01c400 comp rx=0 tx=0).stop 2024-04-25T09:13:48.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.177+0000 7fb6daa00640 1 -- 172.21.15.173:0/3565237544 shutdown_connections 2024-04-25T09:13:48.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.177+0000 7fb6daa00640 1 --2- 172.21.15.173:0/3565237544 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6d406d380 0x7fb6d406d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.177+0000 7fb6daa00640 1 --2- 172.21.15.173:0/3565237544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d40cd2f0 0x7fb6d40cd780 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.177+0000 7fb6daa00640 1 --2- 172.21.15.173:0/3565237544 >> v2:172.21.15.194:3300/0 conn(0x7fb6d40cff40 0x7fb6d4159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.177+0000 7fb6daa00640 1 -- 172.21.15.173:0/3565237544 >> 172.21.15.173:0/3565237544 conn(0x7fb6d406ac90 msgr2=0x7fb6d406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:48.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.177+0000 7fb6daa00640 1 -- 172.21.15.173:0/3565237544 shutdown_connections 2024-04-25T09:13:48.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.177+0000 7fb6daa00640 1 -- 172.21.15.173:0/3565237544 wait complete. 2024-04-25T09:13:48.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.177+0000 7fb6daa00640 1 Processor -- start 2024-04-25T09:13:48.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.177+0000 7fb6daa00640 1 -- start start 2024-04-25T09:13:48.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6daa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6d406d380 0x7fb6d4147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6daa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6d40cd2f0 0x7fb6d4159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6daa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d40cff40 0x7fb6d4143270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6daa00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40cc2f0 con 0x7fb6d40cff40 2024-04-25T09:13:48.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6daa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40cc170 con 0x7fb6d40cd2f0 2024-04-25T09:13:48.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6daa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40cc470 con 0x7fb6d406d380 2024-04-25T09:13:48.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6d8a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d40cff40 0x7fb6d4143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6d3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6d406d380 0x7fb6d4147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6d3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6d406d380 0x7fb6d4147950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:43926/0 (socket says 172.21.15.173:43926) 2024-04-25T09:13:48.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6d3e00640 1 -- 172.21.15.173:0/3965783173 learned_addr learned my addr 172.21.15.173:0/3965783173 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:48.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6d3400640 1 --2- 172.21.15.173:0/3965783173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6d40cd2f0 0x7fb6d4159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6d8a00640 1 -- 172.21.15.173:0/3965783173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6d406d380 msgr2=0x7fb6d4147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6d8a00640 1 --2- 172.21.15.173:0/3965783173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6d406d380 0x7fb6d4147950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6d8a00640 1 -- 172.21.15.173:0/3965783173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6d40cd2f0 msgr2=0x7fb6d4159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6d8a00640 1 --2- 172.21.15.173:0/3965783173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6d40cd2f0 0x7fb6d4159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6d8a00640 1 -- 172.21.15.173:0/3965783173 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d4158170 con 0x7fb6d40cff40 2024-04-25T09:13:48.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6d3e00640 1 --2- 172.21.15.173:0/3965783173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6d406d380 0x7fb6d4147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:48.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6d8a00640 1 --2- 172.21.15.173:0/3965783173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d40cff40 0x7fb6d4143270 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc009bd0 tx=0x7fb6cc0085d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:48.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6cbe00640 1 -- 172.21.15.173:0/3965783173 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc008ce0 con 0x7fb6d40cff40 2024-04-25T09:13:48.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6cbe00640 1 -- 172.21.15.173:0/3965783173 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6cc009cc0 con 0x7fb6d40cff40 2024-04-25T09:13:48.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6cbe00640 1 -- 172.21.15.173:0/3965783173 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc003be0 con 0x7fb6d40cff40 2024-04-25T09:13:48.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6daa00640 1 -- 172.21.15.173:0/3965783173 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d4158450 con 0x7fb6d40cff40 2024-04-25T09:13:48.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6daa00640 1 -- 172.21.15.173:0/3965783173 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d4158a10 con 0x7fb6d40cff40 2024-04-25T09:13:48.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6daa00640 1 -- 172.21.15.173:0/3965783173 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d4073ab0 con 0x7fb6d40cff40 2024-04-25T09:13:48.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.181+0000 7fb6cbe00640 1 -- 172.21.15.173:0/3965783173 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb6cc016420 con 0x7fb6d40cff40 2024-04-25T09:13:48.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.185+0000 7fb6cbe00640 1 --2- 172.21.15.173:0/3965783173 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb6b0066f60 0x7fb6b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.185+0000 7fb6cbe00640 1 -- 172.21.15.173:0/3965783173 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fb6cc084b20 con 0x7fb6d40cff40 2024-04-25T09:13:48.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.185+0000 7fb6d3e00640 1 --2- 172.21.15.173:0/3965783173 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb6b0066f60 0x7fb6b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.185+0000 7fb6d3e00640 1 --2- 172.21.15.173:0/3965783173 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb6b0066f60 0x7fb6b0069420 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4149e50 tx=0x7fb6c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:48.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.189+0000 7fb6cbe00640 1 -- 172.21.15.173:0/3965783173 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb6cc055690 con 0x7fb6d40cff40 2024-04-25T09:13:48.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.341+0000 7fb6daa00640 1 -- 172.21.15.173:0/3965783173 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb6d40ccb20 con 0x7fb6d40cff40 2024-04-25T09:13:48.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.341+0000 7fb6cbe00640 1 -- 172.21.15.173:0/3965783173 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v137) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb6cc059730 con 0x7fb6d40cff40 2024-04-25T09:13:48.327 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:13:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.345+0000 7fb6daa00640 1 -- 172.21.15.173:0/3965783173 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb6b0066f60 msgr2=0x7fb6b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.345+0000 7fb6daa00640 1 --2- 172.21.15.173:0/3965783173 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb6b0066f60 0x7fb6b0069420 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4149e50 tx=0x7fb6c4008040 comp rx=0 tx=0).stop 2024-04-25T09:13:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.345+0000 7fb6daa00640 1 -- 172.21.15.173:0/3965783173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d40cff40 msgr2=0x7fb6d4143270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.345+0000 7fb6daa00640 1 --2- 172.21.15.173:0/3965783173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d40cff40 0x7fb6d4143270 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc009bd0 tx=0x7fb6cc0085d0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.345+0000 7fb6daa00640 1 -- 172.21.15.173:0/3965783173 shutdown_connections 2024-04-25T09:13:48.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.345+0000 7fb6daa00640 1 --2- 172.21.15.173:0/3965783173 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb6b0066f60 0x7fb6b0069420 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.345+0000 7fb6daa00640 1 --2- 172.21.15.173:0/3965783173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6d40cff40 0x7fb6d4143270 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.345+0000 7fb6daa00640 1 --2- 172.21.15.173:0/3965783173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6d40cd2f0 0x7fb6d4159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.345+0000 7fb6daa00640 1 --2- 172.21.15.173:0/3965783173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6d406d380 0x7fb6d4147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.345+0000 7fb6daa00640 1 -- 172.21.15.173:0/3965783173 >> 172.21.15.173:0/3965783173 conn(0x7fb6d406ac90 msgr2=0x7fb6d414d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:48.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.345+0000 7fb6daa00640 1 -- 172.21.15.173:0/3965783173 shutdown_connections 2024-04-25T09:13:48.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.345+0000 7fb6daa00640 1 -- 172.21.15.173:0/3965783173 wait complete. 2024-04-25T09:13:48.349 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-04-25T09:13:48.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.497+0000 7f525e600640 1 Processor -- start 2024-04-25T09:13:48.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.497+0000 7f525e600640 1 -- start start 2024-04-25T09:13:48.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.501+0000 7f525e600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f525815ba20 0x7f525815be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.501+0000 7f525e600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5258070070 0x7f52580d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.501+0000 7f525e600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f525815c460 con 0x7f52580b70f0 2024-04-25T09:13:48.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.501+0000 7f525e600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f525815c740 con 0x7f525815ba20 2024-04-25T09:13:48.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.501+0000 7f525e600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f525815ca20 con 0x7f5258070070 2024-04-25T09:13:48.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.501+0000 7f5256a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f52580b70f0 0x7f525806f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:42696/0 (socket says 172.21.15.173:42696) 2024-04-25T09:13:48.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.501+0000 7f5257400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f525815ba20 0x7f525815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.501+0000 7f5256a00640 1 -- 172.21.15.173:0/2188346219 learned_addr learned my addr 172.21.15.173:0/2188346219 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:48.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.501+0000 7f5257e00640 1 --2- 172.21.15.173:0/2188346219 >> v2:172.21.15.194:3300/0 conn(0x7f5258070070 0x7f52580d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.501+0000 7f5256000640 1 -- 172.21.15.173:0/2188346219 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938208842 0 0) 0x7f525815c460 con 0x7f52580b70f0 2024-04-25T09:13:48.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.501+0000 7f5257400640 1 -- 172.21.15.173:0/2188346219 >> v2:172.21.15.194:3300/0 conn(0x7f5258070070 msgr2=0x7f52580d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:48.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.501+0000 7f5257400640 1 --2- 172.21.15.173:0/2188346219 >> v2:172.21.15.194:3300/0 conn(0x7f5258070070 0x7f52580d1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.501+0000 7f5257400640 1 -- 172.21.15.173:0/2188346219 >> v1:172.21.15.173:6789/0 conn(0x7f52580b70f0 legacy=0x7f525806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.501+0000 7f5257400640 1 -- 172.21.15.173:0/2188346219 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525815cd00 con 0x7f525815ba20 2024-04-25T09:13:48.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.501+0000 7f5257e00640 1 --2- 172.21.15.173:0/2188346219 >> v2:172.21.15.194:3300/0 conn(0x7f5258070070 0x7f52580d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:48.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.505+0000 7f5257400640 1 --2- 172.21.15.173:0/2188346219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f525815ba20 0x7f525815be00 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f5248009d90 tx=0x7f524801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dddf4973654a7c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:48.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.505+0000 7f5256000640 1 -- 172.21.15.173:0/2188346219 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52480b2070 con 0x7f525815ba20 2024-04-25T09:13:48.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.505+0000 7f5256000640 1 -- 172.21.15.173:0/2188346219 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52480a59e0 con 0x7f525815ba20 2024-04-25T09:13:48.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.505+0000 7f5256000640 1 -- 172.21.15.173:0/2188346219 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52480a5db0 con 0x7f525815ba20 2024-04-25T09:13:48.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.505+0000 7f525e600640 1 -- 172.21.15.173:0/2188346219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f525815ba20 msgr2=0x7f525815be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.505+0000 7f525e600640 1 --2- 172.21.15.173:0/2188346219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f525815ba20 0x7f525815be00 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f5248009d90 tx=0x7f524801c900 comp rx=0 tx=0).stop 2024-04-25T09:13:48.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.505+0000 7f525e600640 1 -- 172.21.15.173:0/2188346219 shutdown_connections 2024-04-25T09:13:48.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.505+0000 7f525e600640 1 --2- 172.21.15.173:0/2188346219 >> v2:172.21.15.194:3300/0 conn(0x7f5258070070 0x7f52580d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.505+0000 7f525e600640 1 --2- 172.21.15.173:0/2188346219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f525815ba20 0x7f525815be00 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.505+0000 7f525e600640 1 -- 172.21.15.173:0/2188346219 >> 172.21.15.173:0/2188346219 conn(0x7f5258061880 msgr2=0x7f5258061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:48.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.505+0000 7f525e600640 1 -- 172.21.15.173:0/2188346219 shutdown_connections 2024-04-25T09:13:48.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.505+0000 7f525e600640 1 -- 172.21.15.173:0/2188346219 wait complete. 2024-04-25T09:13:48.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.505+0000 7f525e600640 1 Processor -- start 2024-04-25T09:13:48.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.505+0000 7f525e600640 1 -- start start 2024-04-25T09:13:48.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f525e600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5258070070 0x7f52581599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f525e600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52580b70f0 0x7f5258163790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f525e600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525815ba20 0x7f5258165010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f525e600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525815df20 con 0x7f52580b70f0 2024-04-25T09:13:48.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f525e600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52580b7750 con 0x7f5258070070 2024-04-25T09:13:48.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f525e600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525815e0a0 con 0x7f525815ba20 2024-04-25T09:13:48.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f5256a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52580b70f0 0x7f5258163790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f5256a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52580b70f0 0x7f5258163790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47948/0 (socket says 172.21.15.173:47948) 2024-04-25T09:13:48.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f5256a00640 1 -- 172.21.15.173:0/1224321663 learned_addr learned my addr 172.21.15.173:0/1224321663 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:48.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f5257400640 1 --2- 172.21.15.173:0/1224321663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5258070070 0x7f52581599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f5257e00640 1 --2- 172.21.15.173:0/1224321663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525815ba20 0x7f5258165010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f5256a00640 1 -- 172.21.15.173:0/1224321663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525815ba20 msgr2=0x7f5258165010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f5256a00640 1 --2- 172.21.15.173:0/1224321663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525815ba20 0x7f5258165010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f5256a00640 1 -- 172.21.15.173:0/1224321663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5258070070 msgr2=0x7f52581599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f5256a00640 1 --2- 172.21.15.173:0/1224321663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5258070070 0x7f52581599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f5256a00640 1 -- 172.21.15.173:0/1224321663 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5258163cd0 con 0x7f52580b70f0 2024-04-25T09:13:48.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f5257e00640 1 --2- 172.21.15.173:0/1224321663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525815ba20 0x7f5258165010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:48.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f5256a00640 1 --2- 172.21.15.173:0/1224321663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52580b70f0 0x7f5258163790 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f524400c520 tx=0x7f524400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:48.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f524f400640 1 -- 172.21.15.173:0/1224321663 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5244018070 con 0x7f52580b70f0 2024-04-25T09:13:48.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f524f400640 1 -- 172.21.15.173:0/1224321663 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52440074e0 con 0x7f52580b70f0 2024-04-25T09:13:48.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f524f400640 1 -- 172.21.15.173:0/1224321663 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52440049f0 con 0x7f52580b70f0 2024-04-25T09:13:48.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f525e600640 1 -- 172.21.15.173:0/1224321663 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5258163f70 con 0x7f52580b70f0 2024-04-25T09:13:48.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f525e600640 1 -- 172.21.15.173:0/1224321663 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5258164530 con 0x7f52580b70f0 2024-04-25T09:13:48.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f525e600640 1 -- 172.21.15.173:0/1224321663 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5258073a40 con 0x7f52580b70f0 2024-04-25T09:13:48.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.509+0000 7f524f400640 1 -- 172.21.15.173:0/1224321663 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f524401b070 con 0x7f52580b70f0 2024-04-25T09:13:48.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.513+0000 7f524f400640 1 --2- 172.21.15.173:0/1224321663 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5238066f60 0x7f5238069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.513+0000 7f524f400640 1 -- 172.21.15.173:0/1224321663 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f52440843a0 con 0x7f52580b70f0 2024-04-25T09:13:48.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.513+0000 7f5257400640 1 --2- 172.21.15.173:0/1224321663 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5238066f60 0x7f5238069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.513+0000 7f5257400640 1 --2- 172.21.15.173:0/1224321663 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5238066f60 0x7f5238069420 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f52480af000 tx=0x7f52480a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:48.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.517+0000 7f524f400640 1 -- 172.21.15.173:0/1224321663 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5244054de0 con 0x7f52580b70f0 2024-04-25T09:13:48.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:48.721+0000 7f525e600640 1 -- 172.21.15.173:0/1224321663 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) v1 -- 0x7f52580b2550 con 0x7f52580b70f0 2024-04-25T09:13:49.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.660+0000 7f524f400640 1 -- 172.21.15.173:0/1224321663 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v527) v1 ==== 162+0+0 (secure 0 0 0) 0x7f5244058e80 con 0x7f52580b70f0 2024-04-25T09:13:49.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.660+0000 7f525e600640 1 -- 172.21.15.173:0/1224321663 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5238066f60 msgr2=0x7f5238069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.660+0000 7f525e600640 1 --2- 172.21.15.173:0/1224321663 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5238066f60 0x7f5238069420 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f52480af000 tx=0x7f52480a7070 comp rx=0 tx=0).stop 2024-04-25T09:13:49.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.660+0000 7f525e600640 1 -- 172.21.15.173:0/1224321663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52580b70f0 msgr2=0x7f5258163790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.660+0000 7f525e600640 1 --2- 172.21.15.173:0/1224321663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52580b70f0 0x7f5258163790 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f524400c520 tx=0x7f524400c9e0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.660+0000 7f525e600640 1 -- 172.21.15.173:0/1224321663 shutdown_connections 2024-04-25T09:13:49.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.660+0000 7f525e600640 1 --2- 172.21.15.173:0/1224321663 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5238066f60 0x7f5238069420 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.660+0000 7f525e600640 1 --2- 172.21.15.173:0/1224321663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525815ba20 0x7f5258165010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.660+0000 7f525e600640 1 --2- 172.21.15.173:0/1224321663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52580b70f0 0x7f5258163790 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.660+0000 7f525e600640 1 --2- 172.21.15.173:0/1224321663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5258070070 0x7f52581599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.660+0000 7f525e600640 1 -- 172.21.15.173:0/1224321663 >> 172.21.15.173:0/1224321663 conn(0x7f5258061880 msgr2=0x7f52580b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:49.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.660+0000 7f525e600640 1 -- 172.21.15.173:0/1224321663 shutdown_connections 2024-04-25T09:13:49.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.660+0000 7f525e600640 1 -- 172.21.15.173:0/1224321663 wait complete. 2024-04-25T09:13:49.670 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:13:49.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.828+0000 7ff8e5400640 1 Processor -- start 2024-04-25T09:13:49.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.828+0000 7ff8e5400640 1 -- start start 2024-04-25T09:13:49.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.828+0000 7ff8e5400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff8e015b710 0x7ff8e0071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.828+0000 7ff8e5400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff8e00cd3d0 0x7ff8e00cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.828+0000 7ff8e5400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e015e2d0 con 0x7ff8e00cc670 2024-04-25T09:13:49.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.828+0000 7ff8e5400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e00ccae0 con 0x7ff8e00cd3d0 2024-04-25T09:13:49.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.828+0000 7ff8e5400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e015eea0 con 0x7ff8e015b710 2024-04-25T09:13:49.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.828+0000 7ff8dde00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff8e00cd3d0 0x7ff8e00cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.828+0000 7ff8dde00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff8e00cd3d0 0x7ff8e00cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47950/0 (socket says 172.21.15.173:47950) 2024-04-25T09:13:49.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.828+0000 7ff8dde00640 1 -- 172.21.15.173:0/823199373 learned_addr learned my addr 172.21.15.173:0/823199373 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:49.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.828+0000 7ff8de800640 1 --2- 172.21.15.173:0/823199373 >> v2:172.21.15.194:3300/0 conn(0x7ff8e015b710 0x7ff8e0071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.828+0000 7ff8dde00640 1 -- 172.21.15.173:0/823199373 >> v2:172.21.15.194:3300/0 conn(0x7ff8e015b710 msgr2=0x7ff8e0071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:49.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.828+0000 7ff8dde00640 1 --2- 172.21.15.173:0/823199373 >> v2:172.21.15.194:3300/0 conn(0x7ff8e015b710 0x7ff8e0071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.828+0000 7ff8dde00640 1 -- 172.21.15.173:0/823199373 >> v1:172.21.15.194:6789/0 conn(0x7ff8e00cc670 legacy=0x7ff8e006d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:49.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.828+0000 7ff8dde00640 1 -- 172.21.15.173:0/823199373 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e015e570 con 0x7ff8e00cd3d0 2024-04-25T09:13:49.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.832+0000 7ff8dde00640 1 --2- 172.21.15.173:0/823199373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e00cd3d0 0x7ff8e00cc130 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00ccfa0 tx=0x7ff8cc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fab0ff8d0a0c3c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:49.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.832+0000 7ff8dd400640 1 -- 172.21.15.173:0/823199373 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc0b0070 con 0x7ff8e00cd3d0 2024-04-25T09:13:49.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.832+0000 7ff8dd400640 1 -- 172.21.15.173:0/823199373 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8cc0ab600 con 0x7ff8e00cd3d0 2024-04-25T09:13:49.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.832+0000 7ff8dd400640 1 -- 172.21.15.173:0/823199373 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc0ab9d0 con 0x7ff8e00cd3d0 2024-04-25T09:13:49.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.832+0000 7ff8e5400640 1 -- 172.21.15.173:0/823199373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e00cd3d0 msgr2=0x7ff8e00cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.832+0000 7ff8e5400640 1 --2- 172.21.15.173:0/823199373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e00cd3d0 0x7ff8e00cc130 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00ccfa0 tx=0x7ff8cc01c420 comp rx=0 tx=0).stop 2024-04-25T09:13:49.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.832+0000 7ff8e5400640 1 -- 172.21.15.173:0/823199373 shutdown_connections 2024-04-25T09:13:49.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.832+0000 7ff8e5400640 1 --2- 172.21.15.173:0/823199373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e00cd3d0 0x7ff8e00cc130 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.832+0000 7ff8e5400640 1 --2- 172.21.15.173:0/823199373 >> v2:172.21.15.194:3300/0 conn(0x7ff8e015b710 0x7ff8e0071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.832+0000 7ff8e5400640 1 -- 172.21.15.173:0/823199373 >> 172.21.15.173:0/823199373 conn(0x7ff8e006ac90 msgr2=0x7ff8e006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:49.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.832+0000 7ff8e5400640 1 -- 172.21.15.173:0/823199373 shutdown_connections 2024-04-25T09:13:49.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.832+0000 7ff8e5400640 1 -- 172.21.15.173:0/823199373 wait complete. 2024-04-25T09:13:49.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8e5400640 1 Processor -- start 2024-04-25T09:13:49.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8e5400640 1 -- start start 2024-04-25T09:13:49.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8e5400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8e00cc670 0x7ff8e0138d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8e5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8e00cd3d0 0x7ff8e0159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8e5400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e015b710 0x7ff8e0148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8e5400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e0072540 con 0x7ff8e015b710 2024-04-25T09:13:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8e5400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e00723c0 con 0x7ff8e00cd3d0 2024-04-25T09:13:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8e5400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e016a800 con 0x7ff8e00cc670 2024-04-25T09:13:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8df200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e015b710 0x7ff8e0148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8df200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e015b710 0x7ff8e0148dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47966/0 (socket says 172.21.15.173:47966) 2024-04-25T09:13:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8df200640 1 -- 172.21.15.173:0/2479819183 learned_addr learned my addr 172.21.15.173:0/2479819183 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8de800640 1 --2- 172.21.15.173:0/2479819183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8e00cc670 0x7ff8e0138d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8dde00640 1 --2- 172.21.15.173:0/2479819183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8e00cd3d0 0x7ff8e0159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8df200640 1 -- 172.21.15.173:0/2479819183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8e00cc670 msgr2=0x7ff8e0138d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8df200640 1 --2- 172.21.15.173:0/2479819183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8e00cc670 0x7ff8e0138d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8df200640 1 -- 172.21.15.173:0/2479819183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8e00cd3d0 msgr2=0x7ff8e0159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8df200640 1 --2- 172.21.15.173:0/2479819183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8e00cd3d0 0x7ff8e0159f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8df200640 1 -- 172.21.15.173:0/2479819183 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e0158e70 con 0x7ff8e015b710 2024-04-25T09:13:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8df200640 1 --2- 172.21.15.173:0/2479819183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e015b710 0x7ff8e0148dd0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800c3c0 tx=0x7ff8d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8d6a00640 1 -- 172.21.15.173:0/2479819183 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8011790 con 0x7ff8e015b710 2024-04-25T09:13:49.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8d6a00640 1 -- 172.21.15.173:0/2479819183 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d8017070 con 0x7ff8e015b710 2024-04-25T09:13:49.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8d6a00640 1 -- 172.21.15.173:0/2479819183 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8011b70 con 0x7ff8e015b710 2024-04-25T09:13:49.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8e5400640 1 -- 172.21.15.173:0/2479819183 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e0159150 con 0x7ff8e015b710 2024-04-25T09:13:49.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8e5400640 1 -- 172.21.15.173:0/2479819183 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e0159710 con 0x7ff8e015b710 2024-04-25T09:13:49.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.836+0000 7ff8e5400640 1 -- 172.21.15.173:0/2479819183 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e0073ab0 con 0x7ff8e015b710 2024-04-25T09:13:49.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.840+0000 7ff8d6a00640 1 -- 172.21.15.173:0/2479819183 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff8d8011d10 con 0x7ff8e015b710 2024-04-25T09:13:49.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.840+0000 7ff8d6a00640 1 --2- 172.21.15.173:0/2479819183 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff8c0066f60 0x7ff8c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.840+0000 7ff8d6a00640 1 -- 172.21.15.173:0/2479819183 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5421+0+0 (secure 0 0 0) 0x7ff8d8084c00 con 0x7ff8e015b710 2024-04-25T09:13:49.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.840+0000 7ff8de800640 1 --2- 172.21.15.173:0/2479819183 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff8c0066f60 0x7ff8c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.840+0000 7ff8de800640 1 --2- 172.21.15.173:0/2479819183 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff8c0066f60 0x7ff8c0069420 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0003ab0 tx=0x7ff8d0009830 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:49.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.844+0000 7ff8d6a00640 1 -- 172.21.15.173:0/2479819183 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff8d80556d0 con 0x7ff8e015b710 2024-04-25T09:13:49.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:49.996+0000 7ff8e5400640 1 -- 172.21.15.173:0/2479819183 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff8e00d00d0 con 0x7ff8e015b710 2024-04-25T09:13:49.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.004+0000 7ff8d6a00640 1 -- 172.21.15.173:0/2479819183 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff8d8059770 con 0x7ff8e015b710 2024-04-25T09:13:49.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.004+0000 7ff8e5400640 1 -- 172.21.15.173:0/2479819183 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff8c0066f60 msgr2=0x7ff8c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.004+0000 7ff8e5400640 1 --2- 172.21.15.173:0/2479819183 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff8c0066f60 0x7ff8c0069420 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0003ab0 tx=0x7ff8d0009830 comp rx=0 tx=0).stop 2024-04-25T09:13:49.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.004+0000 7ff8e5400640 1 -- 172.21.15.173:0/2479819183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e015b710 msgr2=0x7ff8e0148dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.004+0000 7ff8e5400640 1 --2- 172.21.15.173:0/2479819183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e015b710 0x7ff8e0148dd0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800c3c0 tx=0x7ff8d800c880 comp rx=0 tx=0).stop 2024-04-25T09:13:49.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.004+0000 7ff8e5400640 1 -- 172.21.15.173:0/2479819183 shutdown_connections 2024-04-25T09:13:49.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.004+0000 7ff8e5400640 1 --2- 172.21.15.173:0/2479819183 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff8c0066f60 0x7ff8c0069420 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.004+0000 7ff8e5400640 1 --2- 172.21.15.173:0/2479819183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e015b710 0x7ff8e0148dd0 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.004+0000 7ff8e5400640 1 --2- 172.21.15.173:0/2479819183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8e00cd3d0 0x7ff8e0159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.004+0000 7ff8e5400640 1 --2- 172.21.15.173:0/2479819183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8e00cc670 0x7ff8e0138d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.004+0000 7ff8e5400640 1 -- 172.21.15.173:0/2479819183 >> 172.21.15.173:0/2479819183 conn(0x7ff8e006ac90 msgr2=0x7ff8e0152000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:49.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.004+0000 7ff8e5400640 1 -- 172.21.15.173:0/2479819183 shutdown_connections 2024-04-25T09:13:49.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.004+0000 7ff8e5400640 1 -- 172.21.15.173:0/2479819183 wait complete. 2024-04-25T09:13:50.010 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:13:50.010 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:13:50.126 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:13:50.177 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:13:50.177 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:13:50.177 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:13:50.185 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:13:50.186 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:13:50.186 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:13:50.230 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:13:50.230 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:13:50.230 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:13:50.238 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:13:50.238 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:13:50.238 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:13:50.282 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:13:50.282 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:13:50.282 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:50.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.432+0000 7fcd20400640 1 Processor -- start 2024-04-25T09:13:50.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.432+0000 7fcd20400640 1 -- start start 2024-04-25T09:13:50.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.432+0000 7fcd20400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcd180cc8b0 0x7fcd180ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.432+0000 7fcd20400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1806e7c0 con 0x7fcd180ce8f0 2024-04-25T09:13:50.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.432+0000 7fcd20400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1806d720 con 0x7fcd18145250 2024-04-25T09:13:50.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.432+0000 7fcd20400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1806da00 con 0x7fcd180cc8b0 2024-04-25T09:13:50.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.432+0000 7fcd1e400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fcd180ce8f0 0x7fcd180ced00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:42700/0 (socket says 172.21.15.173:42700) 2024-04-25T09:13:50.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.432+0000 7fcd1e400640 1 -- 172.21.15.173:0/2890437131 learned_addr learned my addr 172.21.15.173:0/2890437131 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:50.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.432+0000 7fcd1d000640 1 --2- 172.21.15.173:0/2890437131 >> v2:172.21.15.194:3300/0 conn(0x7fcd180cc8b0 0x7fcd180ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.432+0000 7fcd17e00640 1 -- 172.21.15.173:0/2890437131 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050593032 0 0) 0x7fcd1806e7c0 con 0x7fcd180ce8f0 2024-04-25T09:13:50.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.432+0000 7fcd17e00640 1 -- 172.21.15.173:0/2890437131 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd00003530 con 0x7fcd180ce8f0 2024-04-25T09:13:50.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.432+0000 7fcd17e00640 1 -- 172.21.15.173:0/2890437131 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253014365 0 0) 0x7fcd1806d720 con 0x7fcd18145250 2024-04-25T09:13:50.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.432+0000 7fcd17e00640 1 -- 172.21.15.173:0/2890437131 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd1806e7c0 con 0x7fcd18145250 2024-04-25T09:13:50.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.432+0000 7fcd1d000640 1 -- 172.21.15.173:0/2890437131 >> v1:172.21.15.194:6789/0 conn(0x7fcd18145250 legacy=0x7fcd1815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:50.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.436+0000 7fcd1d000640 1 -- 172.21.15.173:0/2890437131 >> v1:172.21.15.173:6789/0 conn(0x7fcd180ce8f0 legacy=0x7fcd180ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:50.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.436+0000 7fcd1d000640 1 -- 172.21.15.173:0/2890437131 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1806dce0 con 0x7fcd180cc8b0 2024-04-25T09:13:50.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.436+0000 7fcd1d000640 1 --2- 172.21.15.173:0/2890437131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd180cc8b0 0x7fcd180ccd30 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcd040097c0 tx=0x7fcd0401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e090f5a2979ce0f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:50.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.436+0000 7fcd17e00640 1 -- 172.21.15.173:0/2890437131 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd040b1070 con 0x7fcd180cc8b0 2024-04-25T09:13:50.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.436+0000 7fcd17e00640 1 -- 172.21.15.173:0/2890437131 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd040ac5f0 con 0x7fcd180cc8b0 2024-04-25T09:13:50.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.436+0000 7fcd17e00640 1 -- 172.21.15.173:0/2890437131 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd040ac9c0 con 0x7fcd180cc8b0 2024-04-25T09:13:50.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.436+0000 7fcd20400640 1 -- 172.21.15.173:0/2890437131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd180cc8b0 msgr2=0x7fcd180ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:50.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.436+0000 7fcd20400640 1 --2- 172.21.15.173:0/2890437131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd180cc8b0 0x7fcd180ccd30 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcd040097c0 tx=0x7fcd0401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:13:50.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.436+0000 7fcd20400640 1 -- 172.21.15.173:0/2890437131 shutdown_connections 2024-04-25T09:13:50.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.436+0000 7fcd20400640 1 --2- 172.21.15.173:0/2890437131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd180cc8b0 0x7fcd180ccd30 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:50.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.436+0000 7fcd20400640 1 -- 172.21.15.173:0/2890437131 >> 172.21.15.173:0/2890437131 conn(0x7fcd1806ac90 msgr2=0x7fcd1806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:50.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.436+0000 7fcd20400640 1 -- 172.21.15.173:0/2890437131 shutdown_connections 2024-04-25T09:13:50.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.436+0000 7fcd20400640 1 -- 172.21.15.173:0/2890437131 wait complete. 2024-04-25T09:13:50.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd20400640 1 Processor -- start 2024-04-25T09:13:50.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd20400640 1 -- start start 2024-04-25T09:13:50.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd20400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd180cc8b0 0x7fcd180afd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd20400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd180ce8f0 0x7fcd180b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd20400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd18145250 0x7fcd18155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd20400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1806d380 con 0x7fcd180ce8f0 2024-04-25T09:13:50.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd20400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1806ef80 con 0x7fcd18145250 2024-04-25T09:13:50.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd20400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1806d500 con 0x7fcd180cc8b0 2024-04-25T09:13:50.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd1d000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd180ce8f0 0x7fcd180b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd1d000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd180ce8f0 0x7fcd180b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:47980/0 (socket says 172.21.15.173:47980) 2024-04-25T09:13:50.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd1d000640 1 -- 172.21.15.173:0/2453568401 learned_addr learned my addr 172.21.15.173:0/2453568401 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:50.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd1e400640 1 --2- 172.21.15.173:0/2453568401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd18145250 0x7fcd18155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd1da00640 1 --2- 172.21.15.173:0/2453568401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd180cc8b0 0x7fcd180afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd1d000640 1 -- 172.21.15.173:0/2453568401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd180cc8b0 msgr2=0x7fcd180afd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd1d000640 1 --2- 172.21.15.173:0/2453568401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd180cc8b0 0x7fcd180afd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd1d000640 1 -- 172.21.15.173:0/2453568401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd18145250 msgr2=0x7fcd18155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd1d000640 1 --2- 172.21.15.173:0/2453568401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd18145250 0x7fcd18155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd1d000640 1 -- 172.21.15.173:0/2453568401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd181562b0 con 0x7fcd180ce8f0 2024-04-25T09:13:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd1e400640 1 --2- 172.21.15.173:0/2453568401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd18145250 0x7fcd18155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd1da00640 1 --2- 172.21.15.173:0/2453568401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd180cc8b0 0x7fcd180afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd1d000640 1 --2- 172.21.15.173:0/2453568401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd180ce8f0 0x7fcd180b02d0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fcd04000c10 tx=0x7fcd04019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd15600640 1 -- 172.21.15.173:0/2453568401 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd040b1040 con 0x7fcd180ce8f0 2024-04-25T09:13:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd15600640 1 -- 172.21.15.173:0/2453568401 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd040bb070 con 0x7fcd180ce8f0 2024-04-25T09:13:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd20400640 1 -- 172.21.15.173:0/2453568401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd18156590 con 0x7fcd180ce8f0 2024-04-25T09:13:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd15600640 1 -- 172.21.15.173:0/2453568401 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04006e20 con 0x7fcd180ce8f0 2024-04-25T09:13:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.440+0000 7fcd20400640 1 -- 172.21.15.173:0/2453568401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd18156b50 con 0x7fcd180ce8f0 2024-04-25T09:13:50.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.444+0000 7fcd20400640 1 -- 172.21.15.173:0/2453568401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd18073a40 con 0x7fcd180ce8f0 2024-04-25T09:13:50.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.444+0000 7fcd15600640 1 -- 172.21.15.173:0/2453568401 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcd040b5610 con 0x7fcd180ce8f0 2024-04-25T09:13:50.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.444+0000 7fcd15600640 1 --2- 172.21.15.173:0/2453568401 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fccf8066f60 0x7fccf8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.444+0000 7fcd15600640 1 -- 172.21.15.173:0/2453568401 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fcd0411eb00 con 0x7fcd180ce8f0 2024-04-25T09:13:50.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.444+0000 7fcd1da00640 1 --2- 172.21.15.173:0/2453568401 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fccf8066f60 0x7fccf8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.444+0000 7fcd1da00640 1 --2- 172.21.15.173:0/2453568401 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fccf8066f60 0x7fccf8069420 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fcd180b0aa0 tx=0x7fcd0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:50.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.448+0000 7fcd15600640 1 -- 172.21.15.173:0/2453568401 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcd040a9070 con 0x7fcd180ce8f0 2024-04-25T09:13:50.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.640+0000 7fcd20400640 1 -- 172.21.15.173:0/2453568401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd180cc690 con 0x7fcd180ce8f0 2024-04-25T09:13:50.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.640+0000 7fcd15600640 1 -- 172.21.15.173:0/2453568401 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+2917 (secure 0 0 0) 0x7fcd0411ee20 con 0x7fcd180ce8f0 2024-04-25T09:13:50.626 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:50.626 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":95,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3141905119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3141905119},{"type":"v1","addr":"172.21.15.194:6833","nonce":3141905119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":8566,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2523867416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2523867416},{"type":"v1","addr":"172.21.15.194:6835","nonce":2523867416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":9870,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3367902720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3367902720},{"type":"v1","addr":"172.21.15.173:6835","nonce":3367902720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95}],"filesystems":[]} 2024-04-25T09:13:50.626 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 95 2024-04-25T09:13:50.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.644+0000 7fcd20400640 1 -- 172.21.15.173:0/2453568401 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fccf8066f60 msgr2=0x7fccf8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:50.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.644+0000 7fcd20400640 1 --2- 172.21.15.173:0/2453568401 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fccf8066f60 0x7fccf8069420 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fcd180b0aa0 tx=0x7fcd0c009040 comp rx=0 tx=0).stop 2024-04-25T09:13:50.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.644+0000 7fcd20400640 1 -- 172.21.15.173:0/2453568401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd180ce8f0 msgr2=0x7fcd180b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:50.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.644+0000 7fcd20400640 1 --2- 172.21.15.173:0/2453568401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd180ce8f0 0x7fcd180b02d0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fcd04000c10 tx=0x7fcd04019240 comp rx=0 tx=0).stop 2024-04-25T09:13:50.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.644+0000 7fcd20400640 1 -- 172.21.15.173:0/2453568401 shutdown_connections 2024-04-25T09:13:50.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.644+0000 7fcd20400640 1 --2- 172.21.15.173:0/2453568401 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fccf8066f60 0x7fccf8069420 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:50.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.644+0000 7fcd20400640 1 --2- 172.21.15.173:0/2453568401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd18145250 0x7fcd18155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:50.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.644+0000 7fcd20400640 1 --2- 172.21.15.173:0/2453568401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd180ce8f0 0x7fcd180b02d0 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:50.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.644+0000 7fcd20400640 1 --2- 172.21.15.173:0/2453568401 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd180cc8b0 0x7fcd180afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:50.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.644+0000 7fcd20400640 1 -- 172.21.15.173:0/2453568401 >> 172.21.15.173:0/2453568401 conn(0x7fcd1806ac90 msgr2=0x7fcd18140930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:50.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.644+0000 7fcd20400640 1 -- 172.21.15.173:0/2453568401 shutdown_connections 2024-04-25T09:13:50.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.644+0000 7fcd20400640 1 -- 172.21.15.173:0/2453568401 wait complete. 2024-04-25T09:13:50.647 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:13:50.647 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:13:50.647 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:13:50.648 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:13:50.648 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:13:50.648 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:13:50.648 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:13:50.648 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:13:50.648 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:13:50.648 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:13:50.649 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:13:50.649 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:13:50.649 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:13:50.649 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:13:50.659 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:13:50.659 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:13:50.661 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:13:50.661 DEBUG:teuthology.parallel:result is None 2024-04-25T09:13:50.663 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:13:50.663 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:13:50.664 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:13:50.664 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:13:50.665 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:13:50.665 DEBUG:teuthology.parallel:result is None 2024-04-25T09:13:50.712 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:13:50.713 DEBUG:teuthology.parallel:result is None 2024-04-25T09:13:50.714 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:13:50.714 DEBUG:teuthology.parallel:result is None 2024-04-25T09:13:50.714 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:13:50.746 INFO:tasks.ceph.mds.a.smithi173.stdout:starting mds.a at 2024-04-25T09:13:50.747 INFO:tasks.ceph.mds.c.smithi173.stdout:starting mds.c at 2024-04-25T09:13:50.802 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-04-25T09:13:50.802 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-04-25T09:13:50.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.872+0000 7fe122800640 1 Processor -- start 2024-04-25T09:13:50.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.872+0000 7fe122800640 1 -- start start 2024-04-25T09:13:50.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.876+0000 7fe122800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe11c15f070 0x7fe11c0b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.876+0000 7fe122800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe11c0b4600 0x7fe11c06f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.876+0000 7fe122800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c06e710 con 0x7fe11c15a830 2024-04-25T09:13:50.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.876+0000 7fe122800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c0b3cb0 con 0x7fe11c0b4600 2024-04-25T09:13:50.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.876+0000 7fe122800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c06e4c0 con 0x7fe11c15f070 2024-04-25T09:13:50.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.876+0000 7fe11be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe11c0b4600 0x7fe11c06f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.876+0000 7fe11be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe11c0b4600 0x7fe11c06f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48026/0 (socket says 172.21.15.173:48026) 2024-04-25T09:13:50.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.876+0000 7fe11be00640 1 -- 172.21.15.173:0/3985852375 learned_addr learned my addr 172.21.15.173:0/3985852375 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:50.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.876+0000 7fe112a00640 1 --2- 172.21.15.173:0/3985852375 >> v2:172.21.15.194:3300/0 conn(0x7fe11c15f070 0x7fe11c0b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.876+0000 7fe11be00640 1 -- 172.21.15.173:0/3985852375 >> v2:172.21.15.194:3300/0 conn(0x7fe11c15f070 msgr2=0x7fe11c0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:50.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.876+0000 7fe11be00640 1 --2- 172.21.15.173:0/3985852375 >> v2:172.21.15.194:3300/0 conn(0x7fe11c15f070 0x7fe11c0b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:50.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.876+0000 7fe11be00640 1 -- 172.21.15.173:0/3985852375 >> v1:172.21.15.194:6789/0 conn(0x7fe11c15a830 legacy=0x7fe11c0b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:50.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.876+0000 7fe11be00640 1 -- 172.21.15.173:0/3985852375 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c06e9f0 con 0x7fe11c0b4600 2024-04-25T09:13:50.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.876+0000 7fe112a00640 1 --2- 172.21.15.173:0/3985852375 >> v2:172.21.15.194:3300/0 conn(0x7fe11c15f070 0x7fe11c0b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:50.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.880+0000 7fe11be00640 1 --2- 172.21.15.173:0/3985852375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe11c0b4600 0x7fe11c06f4d0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fe11c071800 tx=0x7fe11401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab7ce2c07a3e2d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:50.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.880+0000 7fe11aa00640 1 -- 172.21.15.173:0/3985852375 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140a56d0 con 0x7fe11c0b4600 2024-04-25T09:13:50.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.880+0000 7fe11aa00640 1 -- 172.21.15.173:0/3985852375 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1140a5870 con 0x7fe11c0b4600 2024-04-25T09:13:50.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.880+0000 7fe11aa00640 1 -- 172.21.15.173:0/3985852375 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140a5c40 con 0x7fe11c0b4600 2024-04-25T09:13:50.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.880+0000 7fe122800640 1 -- 172.21.15.173:0/3985852375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe11c0b4600 msgr2=0x7fe11c06f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:50.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.880+0000 7fe122800640 1 --2- 172.21.15.173:0/3985852375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe11c0b4600 0x7fe11c06f4d0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fe11c071800 tx=0x7fe11401c920 comp rx=0 tx=0).stop 2024-04-25T09:13:50.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.880+0000 7fe122800640 1 -- 172.21.15.173:0/3985852375 shutdown_connections 2024-04-25T09:13:50.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.880+0000 7fe122800640 1 --2- 172.21.15.173:0/3985852375 >> v2:172.21.15.194:3300/0 conn(0x7fe11c15f070 0x7fe11c0b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:50.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.880+0000 7fe122800640 1 --2- 172.21.15.173:0/3985852375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe11c0b4600 0x7fe11c06f4d0 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:50.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.880+0000 7fe122800640 1 -- 172.21.15.173:0/3985852375 >> 172.21.15.173:0/3985852375 conn(0x7fe11c0b5b00 msgr2=0x7fe11c0b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:50.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.880+0000 7fe122800640 1 -- 172.21.15.173:0/3985852375 shutdown_connections 2024-04-25T09:13:50.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.880+0000 7fe122800640 1 -- 172.21.15.173:0/3985852375 wait complete. 2024-04-25T09:13:50.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.880+0000 7fe122800640 1 Processor -- start 2024-04-25T09:13:50.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.880+0000 7fe122800640 1 -- start start 2024-04-25T09:13:50.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe122800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe11c0b4600 0x7fe11c152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe122800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe11c15a830 0x7fe11c142de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe122800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe11c15f070 0x7fe11c1500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe122800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0adea0 con 0x7fe11c0b4600 2024-04-25T09:13:50.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe122800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0add20 con 0x7fe11c15a830 2024-04-25T09:13:50.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe122800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c070220 con 0x7fe11c15f070 2024-04-25T09:13:50.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe11b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe11c0b4600 0x7fe11c152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe11b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe11c0b4600 0x7fe11c152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48042/0 (socket says 172.21.15.173:48042) 2024-04-25T09:13:50.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe11b400640 1 -- 172.21.15.173:0/2171733281 learned_addr learned my addr 172.21.15.173:0/2171733281 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:50.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe11be00640 1 --2- 172.21.15.173:0/2171733281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe11c15f070 0x7fe11c1500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe112a00640 1 --2- 172.21.15.173:0/2171733281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe11c15a830 0x7fe11c142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe11b400640 1 -- 172.21.15.173:0/2171733281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe11c15f070 msgr2=0x7fe11c1500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:50.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe11b400640 1 --2- 172.21.15.173:0/2171733281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe11c15f070 0x7fe11c1500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:50.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe11b400640 1 -- 172.21.15.173:0/2171733281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe11c15a830 msgr2=0x7fe11c142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:50.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe11b400640 1 --2- 172.21.15.173:0/2171733281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe11c15a830 0x7fe11c142de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:50.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe11b400640 1 -- 172.21.15.173:0/2171733281 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c150aa0 con 0x7fe11c0b4600 2024-04-25T09:13:50.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe11b400640 1 --2- 172.21.15.173:0/2171733281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe11c0b4600 0x7fe11c152190 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00c450 tx=0x7fe10c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:50.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe113e00640 1 -- 172.21.15.173:0/2171733281 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c012830 con 0x7fe11c0b4600 2024-04-25T09:13:50.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe113e00640 1 -- 172.21.15.173:0/2171733281 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c017070 con 0x7fe11c0b4600 2024-04-25T09:13:50.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe113e00640 1 -- 172.21.15.173:0/2171733281 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c012c30 con 0x7fe11c0b4600 2024-04-25T09:13:50.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe122800640 1 -- 172.21.15.173:0/2171733281 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c14df30 con 0x7fe11c0b4600 2024-04-25T09:13:50.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe122800640 1 -- 172.21.15.173:0/2171733281 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c14e4f0 con 0x7fe11c0b4600 2024-04-25T09:13:50.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe122800640 1 -- 172.21.15.173:0/2171733281 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11c073ab0 con 0x7fe11c0b4600 2024-04-25T09:13:50.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.884+0000 7fe113e00640 1 -- 172.21.15.173:0/2171733281 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe10c01c460 con 0x7fe11c0b4600 2024-04-25T09:13:50.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.888+0000 7fe113e00640 1 --2- 172.21.15.173:0/2171733281 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0f8066f60 0x7fe0f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.888+0000 7fe113e00640 1 -- 172.21.15.173:0/2171733281 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fe10c084bb0 con 0x7fe11c0b4600 2024-04-25T09:13:50.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.888+0000 7fe112a00640 1 --2- 172.21.15.173:0/2171733281 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0f8066f60 0x7fe0f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.888+0000 7fe112a00640 1 --2- 172.21.15.173:0/2171733281 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0f8066f60 0x7fe0f8069420 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe11c14fbe0 tx=0x7fe104008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:50.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:50.892+0000 7fe113e00640 1 -- 172.21.15.173:0/2171733281 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe10c055690 con 0x7fe11c0b4600 2024-04-25T09:13:51.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.060+0000 7fe122800640 1 -- 172.21.15.173:0/2171733281 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe11c0ccc40 con 0x7fe11c0b4600 2024-04-25T09:13:51.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.676+0000 7fe113e00640 1 -- 172.21.15.173:0/2171733281 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v139) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe10c059730 con 0x7fe11c0b4600 2024-04-25T09:13:51.661 INFO:teuthology.orchestra.run.smithi173.stderr: removed all blocklist entries 2024-04-25T09:13:51.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.680+0000 7fe122800640 1 -- 172.21.15.173:0/2171733281 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0f8066f60 msgr2=0x7fe0f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:51.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.680+0000 7fe122800640 1 --2- 172.21.15.173:0/2171733281 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0f8066f60 0x7fe0f8069420 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe11c14fbe0 tx=0x7fe104008040 comp rx=0 tx=0).stop 2024-04-25T09:13:51.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.680+0000 7fe122800640 1 -- 172.21.15.173:0/2171733281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe11c0b4600 msgr2=0x7fe11c152190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:51.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.680+0000 7fe122800640 1 --2- 172.21.15.173:0/2171733281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe11c0b4600 0x7fe11c152190 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00c450 tx=0x7fe10c00c910 comp rx=0 tx=0).stop 2024-04-25T09:13:51.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.680+0000 7fe122800640 1 -- 172.21.15.173:0/2171733281 shutdown_connections 2024-04-25T09:13:51.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.680+0000 7fe122800640 1 --2- 172.21.15.173:0/2171733281 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe0f8066f60 0x7fe0f8069420 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.680+0000 7fe122800640 1 --2- 172.21.15.173:0/2171733281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe11c15f070 0x7fe11c1500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.680+0000 7fe122800640 1 --2- 172.21.15.173:0/2171733281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe11c15a830 0x7fe11c142de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.680+0000 7fe122800640 1 --2- 172.21.15.173:0/2171733281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe11c0b4600 0x7fe11c152190 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.680+0000 7fe122800640 1 -- 172.21.15.173:0/2171733281 >> 172.21.15.173:0/2171733281 conn(0x7fe11c0b5b00 msgr2=0x7fe11c155570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:51.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.680+0000 7fe122800640 1 -- 172.21.15.173:0/2171733281 shutdown_connections 2024-04-25T09:13:51.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.680+0000 7fe122800640 1 -- 172.21.15.173:0/2171733281 wait complete. 2024-04-25T09:13:51.687 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:13:51.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.884+0000 7fd6e2c00640 1 Processor -- start 2024-04-25T09:13:51.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.884+0000 7fd6e2c00640 1 -- start start 2024-04-25T09:13:51.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.884+0000 7fd6e2c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd6dc145250 0x7fd6dc15c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:51.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.884+0000 7fd6e2c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd6dc0ccd30 0x7fd6dc071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:51.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.884+0000 7fd6e2c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6dc15cec0 con 0x7fd6dc0cc8b0 2024-04-25T09:13:51.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.884+0000 7fd6e2c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc06e7c0 con 0x7fd6dc145250 2024-04-25T09:13:51.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.884+0000 7fd6e2c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc06d720 con 0x7fd6dc0ccd30 2024-04-25T09:13:51.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.884+0000 7fd6dbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd6dc145250 0x7fd6dc15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:51.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.884+0000 7fd6dbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd6dc145250 0x7fd6dc15c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48056/0 (socket says 172.21.15.173:48056) 2024-04-25T09:13:51.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.884+0000 7fd6d3e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd6dc0cc8b0 0x7fd6dc071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:42714/0 (socket says 172.21.15.173:42714) 2024-04-25T09:13:51.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.884+0000 7fd6dbe00640 1 -- 172.21.15.173:0/984622991 learned_addr learned my addr 172.21.15.173:0/984622991 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:51.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.884+0000 7fd6dbe00640 1 -- 172.21.15.173:0/984622991 >> v2:172.21.15.194:3300/0 conn(0x7fd6dc0ccd30 msgr2=0x7fd6dc071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:51.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.884+0000 7fd6e0c00640 1 --2- 172.21.15.173:0/984622991 >> v2:172.21.15.194:3300/0 conn(0x7fd6dc0ccd30 0x7fd6dc071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:51.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.884+0000 7fd6db400640 1 -- 172.21.15.173:0/984622991 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731713016 0 0) 0x7fd6c4001120 con 0x7fd6dc0cc8b0 2024-04-25T09:13:51.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.884+0000 7fd6dbe00640 1 --2- 172.21.15.173:0/984622991 >> v2:172.21.15.194:3300/0 conn(0x7fd6dc0ccd30 0x7fd6dc071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.884+0000 7fd6dbe00640 1 -- 172.21.15.173:0/984622991 >> v1:172.21.15.173:6789/0 conn(0x7fd6dc0cc8b0 legacy=0x7fd6dc071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:51.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.884+0000 7fd6dbe00640 1 -- 172.21.15.173:0/984622991 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc06da00 con 0x7fd6dc145250 2024-04-25T09:13:51.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.884+0000 7fd6e0c00640 1 --2- 172.21.15.173:0/984622991 >> v2:172.21.15.194:3300/0 conn(0x7fd6dc0ccd30 0x7fd6dc071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:51.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.888+0000 7fd6dbe00640 1 --2- 172.21.15.173:0/984622991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6dc145250 0x7fd6dc15c980 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc06f4a0 tx=0x7fd6cc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447c6582f3e8adb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:51.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.888+0000 7fd6db400640 1 -- 172.21.15.173:0/984622991 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0aa650 con 0x7fd6dc145250 2024-04-25T09:13:51.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.888+0000 7fd6db400640 1 -- 172.21.15.173:0/984622991 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc0af070 con 0x7fd6dc145250 2024-04-25T09:13:51.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.888+0000 7fd6db400640 1 -- 172.21.15.173:0/984622991 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0aaa10 con 0x7fd6dc145250 2024-04-25T09:13:51.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.888+0000 7fd6e2c00640 1 -- 172.21.15.173:0/984622991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6dc145250 msgr2=0x7fd6dc15c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:51.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.888+0000 7fd6e2c00640 1 --2- 172.21.15.173:0/984622991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6dc145250 0x7fd6dc15c980 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc06f4a0 tx=0x7fd6cc01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.888+0000 7fd6e2c00640 1 -- 172.21.15.173:0/984622991 shutdown_connections 2024-04-25T09:13:51.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.888+0000 7fd6e2c00640 1 --2- 172.21.15.173:0/984622991 >> v2:172.21.15.194:3300/0 conn(0x7fd6dc0ccd30 0x7fd6dc071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.888+0000 7fd6e2c00640 1 --2- 172.21.15.173:0/984622991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6dc145250 0x7fd6dc15c980 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.888+0000 7fd6e2c00640 1 -- 172.21.15.173:0/984622991 >> 172.21.15.173:0/984622991 conn(0x7fd6dc06ac90 msgr2=0x7fd6dc06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:51.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.888+0000 7fd6e2c00640 1 -- 172.21.15.173:0/984622991 shutdown_connections 2024-04-25T09:13:51.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.888+0000 7fd6e2c00640 1 -- 172.21.15.173:0/984622991 wait complete. 2024-04-25T09:13:51.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.888+0000 7fd6e2c00640 1 Processor -- start 2024-04-25T09:13:51.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6e2c00640 1 -- start start 2024-04-25T09:13:51.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6e2c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6dc0cc8b0 0x7fd6dc143b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:51.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6e2c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6dc0ccd30 0x7fd6dc0ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:51.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6e2c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6dc145250 0x7fd6dc142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:51.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6e2c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc06ef80 con 0x7fd6dc0cc8b0 2024-04-25T09:13:51.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6e2c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc145630 con 0x7fd6dc145250 2024-04-25T09:13:51.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6e2c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0cd140 con 0x7fd6dc0ccd30 2024-04-25T09:13:51.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6dbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6dc0cc8b0 0x7fd6dc143b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:51.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6dbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6dc0cc8b0 0x7fd6dc143b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48060/0 (socket says 172.21.15.173:48060) 2024-04-25T09:13:51.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6dbe00640 1 -- 172.21.15.173:0/1143155181 learned_addr learned my addr 172.21.15.173:0/1143155181 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:51.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6d3e00640 1 --2- 172.21.15.173:0/1143155181 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6dc0ccd30 0x7fd6dc0ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:51.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6dbe00640 1 -- 172.21.15.173:0/1143155181 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6dc0ccd30 msgr2=0x7fd6dc0ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:51.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6e0c00640 1 --2- 172.21.15.173:0/1143155181 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6dc145250 0x7fd6dc142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:51.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6dbe00640 1 --2- 172.21.15.173:0/1143155181 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6dc0ccd30 0x7fd6dc0ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6dbe00640 1 -- 172.21.15.173:0/1143155181 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6dc145250 msgr2=0x7fd6dc142eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:51.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6dbe00640 1 --2- 172.21.15.173:0/1143155181 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6dc145250 0x7fd6dc142eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6dbe00640 1 -- 172.21.15.173:0/1143155181 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc0ada40 con 0x7fd6dc0cc8b0 2024-04-25T09:13:51.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6d3e00640 1 --2- 172.21.15.173:0/1143155181 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6dc0ccd30 0x7fd6dc0ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:51.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6e0c00640 1 --2- 172.21.15.173:0/1143155181 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6dc145250 0x7fd6dc142eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:51.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6dbe00640 1 --2- 172.21.15.173:0/1143155181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6dc0cc8b0 0x7fd6dc143b00 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc019100 tx=0x7fd6cc01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:51.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6d8c00640 1 -- 172.21.15.173:0/1143155181 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0b9070 con 0x7fd6dc0cc8b0 2024-04-25T09:13:51.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6d8c00640 1 -- 172.21.15.173:0/1143155181 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc0a6040 con 0x7fd6dc0cc8b0 2024-04-25T09:13:51.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6d8c00640 1 -- 172.21.15.173:0/1143155181 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc004020 con 0x7fd6dc0cc8b0 2024-04-25T09:13:51.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6e2c00640 1 -- 172.21.15.173:0/1143155181 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6dc0add20 con 0x7fd6dc0cc8b0 2024-04-25T09:13:51.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6e2c00640 1 -- 172.21.15.173:0/1143155181 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6dc0b2a10 con 0x7fd6dc0cc8b0 2024-04-25T09:13:51.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.892+0000 7fd6e2c00640 1 -- 172.21.15.173:0/1143155181 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6dc0ae220 con 0x7fd6dc0cc8b0 2024-04-25T09:13:51.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.896+0000 7fd6d8c00640 1 -- 172.21.15.173:0/1143155181 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd6cc0041c0 con 0x7fd6dc0cc8b0 2024-04-25T09:13:51.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.896+0000 7fd6d8c00640 1 --2- 172.21.15.173:0/1143155181 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd6b8066f60 0x7fd6b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:51.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.896+0000 7fd6d8c00640 1 -- 172.21.15.173:0/1143155181 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fd6cc11ed70 con 0x7fd6dc0cc8b0 2024-04-25T09:13:51.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.896+0000 7fd6d3e00640 1 --2- 172.21.15.173:0/1143155181 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd6b8066f60 0x7fd6b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:51.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.896+0000 7fd6d3e00640 1 --2- 172.21.15.173:0/1143155181 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd6b8066f60 0x7fd6b8069420 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4007fd0 tx=0x7fd6c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:51.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:51.900+0000 7fd6d8c00640 1 -- 172.21.15.173:0/1143155181 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd6cc016110 con 0x7fd6dc0cc8b0 2024-04-25T09:13:52.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.108+0000 7fd6e2c00640 1 -- 172.21.15.173:0/1143155181 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd6dc073a40 con 0x7fd6dc0cc8b0 2024-04-25T09:13:52.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.108+0000 7fd6d8c00640 1 -- 172.21.15.173:0/1143155181 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd6cc0044b0 con 0x7fd6dc0cc8b0 2024-04-25T09:13:52.095 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:52.096 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:13:52.096 INFO:teuthology.orchestra.run.smithi173.stdout: "auth_dump": [ 2024-04-25T09:13:52.096 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.096 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.a", 2024-04-25T09:13:52.096 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmnVr3EhAAn+C0Mb/MrYSZuQyr5QTXig==", 2024-04-25T09:13:52.097 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.097 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:13:52.097 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:13:52.097 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:13:52.097 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:13:52.097 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.097 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:13:52.097 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.097 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.b", 2024-04-25T09:13:52.097 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6Gypm0QfFHhAAuP8xE/8pvSZMcP8N33OB9Q==", 2024-04-25T09:13:52.097 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.098 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:13:52.098 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:13:52.098 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:13:52.098 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:13:52.098 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.098 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:13:52.098 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.098 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.c", 2024-04-25T09:13:52.098 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmQsv4GRAATNiD7udOvl8xRDIx64O5jg==", 2024-04-25T09:13:52.098 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.098 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:13:52.098 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:13:52.099 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:13:52.099 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:13:52.099 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.099 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:13:52.099 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.099 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mds.d", 2024-04-25T09:13:52.099 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmtGMSJhAAonqLeuSsNrgyZks1eoJ1Gg==", 2024-04-25T09:13:52.099 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.099 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:13:52.099 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:13:52.099 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:13:52.099 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:13:52.099 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.099 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:13:52.099 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.100 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.0", 2024-04-25T09:13:52.100 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD9Gypm+Yw7LBAAnOFUKU3w1ltre7aHMWZ/SQ==", 2024-04-25T09:13:52.100 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.100 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:13:52.100 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:13:52.100 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:13:52.100 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.100 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:13:52.100 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.100 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.1", 2024-04-25T09:13:52.100 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAAHCpm4BUIOBAAmbfWUWCun/una5WoemhL6Q==", 2024-04-25T09:13:52.100 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.100 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:13:52.100 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:13:52.100 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:13:52.100 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.101 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:13:52.101 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.101 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.2", 2024-04-25T09:13:52.101 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAEHCpmFXIaBRAA0cN2GdLSS3jJC+x4RVUUlw==", 2024-04-25T09:13:52.101 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.101 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:13:52.101 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:13:52.101 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:13:52.101 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.101 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:13:52.101 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.101 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.3", 2024-04-25T09:13:52.101 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAHHCpmUD+YDxAALPvf1wLzhuQmFPo3/vJkdQ==", 2024-04-25T09:13:52.101 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.102 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:13:52.102 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:13:52.102 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:13:52.102 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.102 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:13:52.102 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.102 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.4", 2024-04-25T09:13:52.102 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQANHCpmLQ0fCBAA1Shz0Pfns+rj5r601hzOnQ==", 2024-04-25T09:13:52.102 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.102 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:13:52.102 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:13:52.102 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:13:52.102 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.102 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:13:52.103 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.103 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.5", 2024-04-25T09:13:52.103 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAQHCpmyMj1ERAAMRvZ3PFQa9oe6oGemLvfxw==", 2024-04-25T09:13:52.103 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.103 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:13:52.103 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:13:52.103 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:13:52.103 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.103 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:13:52.103 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.103 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.6", 2024-04-25T09:13:52.103 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQATHCpmKha6GxAAF4zfdFDlylGHHhGI5tVpGA==", 2024-04-25T09:13:52.103 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.103 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:13:52.103 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:13:52.103 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:13:52.104 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.104 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:13:52.104 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.104 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "osd.7", 2024-04-25T09:13:52.104 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQAWHCpmB2lFJhAA3sYYsjS5DIC5fCDz6ur0tA==", 2024-04-25T09:13:52.104 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.104 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow profile osd", 2024-04-25T09:13:52.104 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile osd", 2024-04-25T09:13:52.104 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:13:52.104 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.104 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:13:52.104 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.104 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.0", 2024-04-25T09:13:52.104 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w==", 2024-04-25T09:13:52.105 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.105 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:13:52.105 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow r", 2024-04-25T09:13:52.105 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:13:52.105 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.105 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:13:52.105 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.105 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.1", 2024-04-25T09:13:52.105 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6Gypm1PbHMxAAXMrgpR/xgzfQuuNrculQxA==", 2024-04-25T09:13:52.105 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.105 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:13:52.105 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:13:52.105 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:13:52.105 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:13:52.105 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.106 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:13:52.106 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.106 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.2", 2024-04-25T09:13:52.106 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmrTxjMBAAaqwDl5uiLxhaDIk7m6oDIw==", 2024-04-25T09:13:52.106 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.106 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:13:52.106 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:13:52.106 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:13:52.106 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:13:52.106 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.106 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:13:52.106 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.106 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.3", 2024-04-25T09:13:52.106 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmlAS9ORAAvYbwLnUaDHXOqvEBwJJJcQ==", 2024-04-25T09:13:52.106 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.107 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow", 2024-04-25T09:13:52.107 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow r", 2024-04-25T09:13:52.107 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow rw", 2024-04-25T09:13:52.107 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow rwx" 2024-04-25T09:13:52.107 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.107 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:13:52.107 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.107 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "client.admin", 2024-04-25T09:13:52.107 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD5GypmYFhkMhAACwSsE+B9l263vnlJ0LjFkQ==", 2024-04-25T09:13:52.107 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.107 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:13:52.107 INFO:teuthology.orchestra.run.smithi173.stdout: "mgr": "allow *", 2024-04-25T09:13:52.107 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow *", 2024-04-25T09:13:52.107 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:13:52.108 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.108 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:13:52.108 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.108 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mgr.x", 2024-04-25T09:13:52.108 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmMSqHDhAAe0nkrXbT7dBbAbI89ExUmw==", 2024-04-25T09:13:52.108 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.108 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:13:52.108 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile mgr", 2024-04-25T09:13:52.108 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:13:52.108 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.108 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-25T09:13:52.108 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:52.108 INFO:teuthology.orchestra.run.smithi173.stdout: "entity": "mgr.y", 2024-04-25T09:13:52.108 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "AQD6GypmjCuzChAAomjH5vLVICqSFpyDVQeB4w==", 2024-04-25T09:13:52.108 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": { 2024-04-25T09:13:52.108 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": "allow *", 2024-04-25T09:13:52.109 INFO:teuthology.orchestra.run.smithi173.stdout: "mon": "allow profile mgr", 2024-04-25T09:13:52.109 INFO:teuthology.orchestra.run.smithi173.stdout: "osd": "allow *" 2024-04-25T09:13:52.109 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.109 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:52.109 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-04-25T09:13:52.109 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:13:52.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.112+0000 7fd6e2c00640 1 -- 172.21.15.173:0/1143155181 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd6b8066f60 msgr2=0x7fd6b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.112+0000 7fd6e2c00640 1 --2- 172.21.15.173:0/1143155181 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd6b8066f60 0x7fd6b8069420 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4007fd0 tx=0x7fd6c4009040 comp rx=0 tx=0).stop 2024-04-25T09:13:52.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.112+0000 7fd6e2c00640 1 -- 172.21.15.173:0/1143155181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6dc0cc8b0 msgr2=0x7fd6dc143b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.112+0000 7fd6e2c00640 1 --2- 172.21.15.173:0/1143155181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6dc0cc8b0 0x7fd6dc143b00 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc019100 tx=0x7fd6cc01ad30 comp rx=0 tx=0).stop 2024-04-25T09:13:52.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.112+0000 7fd6e2c00640 1 -- 172.21.15.173:0/1143155181 shutdown_connections 2024-04-25T09:13:52.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.112+0000 7fd6e2c00640 1 --2- 172.21.15.173:0/1143155181 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd6b8066f60 0x7fd6b8069420 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.112+0000 7fd6e2c00640 1 --2- 172.21.15.173:0/1143155181 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6dc145250 0x7fd6dc142eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.112+0000 7fd6e2c00640 1 --2- 172.21.15.173:0/1143155181 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6dc0ccd30 0x7fd6dc0ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.112+0000 7fd6e2c00640 1 --2- 172.21.15.173:0/1143155181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6dc0cc8b0 0x7fd6dc143b00 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.112+0000 7fd6e2c00640 1 -- 172.21.15.173:0/1143155181 >> 172.21.15.173:0/1143155181 conn(0x7fd6dc06ac90 msgr2=0x7fd6dc071320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:52.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.112+0000 7fd6e2c00640 1 -- 172.21.15.173:0/1143155181 shutdown_connections 2024-04-25T09:13:52.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.112+0000 7fd6e2c00640 1 -- 172.21.15.173:0/1143155181 wait complete. 2024-04-25T09:13:52.118 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:13:52.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f6513000640 1 Processor -- start 2024-04-25T09:13:52.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f6513000640 1 -- start start 2024-04-25T09:13:52.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f6513000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f650c0b3e70 0x7f650c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f6513000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f650c15edd0 0x7f650c0b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f6513000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f650c0b4790 con 0x7f650c0aefa0 2024-04-25T09:13:52.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f6513000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650c06dd50 con 0x7f650c0b3e70 2024-04-25T09:13:52.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f6513000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650c15f320 con 0x7f650c15edd0 2024-04-25T09:13:52.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f650b400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f650c0aefa0 0x7f650c0b2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:42730/0 (socket says 172.21.15.173:42730) 2024-04-25T09:13:52.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f650b400640 1 -- 172.21.15.173:0/715488212 learned_addr learned my addr 172.21.15.173:0/715488212 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:52.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f6511000640 1 --2- 172.21.15.173:0/715488212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f650c15edd0 0x7f650c0b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f650be00640 1 --2- 172.21.15.173:0/715488212 >> v2:172.21.15.194:3300/0 conn(0x7f650c0b3e70 0x7f650c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f650aa00640 1 -- 172.21.15.173:0/715488212 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146606293 0 0) 0x7f650c0b4790 con 0x7f650c0aefa0 2024-04-25T09:13:52.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f650aa00640 1 -- 172.21.15.173:0/715488212 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64f0003530 con 0x7f650c0aefa0 2024-04-25T09:13:52.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f650aa00640 1 -- 172.21.15.173:0/715488212 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2909687655 0 0) 0x7f64f0003530 con 0x7f650c0aefa0 2024-04-25T09:13:52.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f650aa00640 1 -- 172.21.15.173:0/715488212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f650c15edd0 msgr2=0x7f650c0b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:52.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f650aa00640 1 --2- 172.21.15.173:0/715488212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f650c15edd0 0x7f650c0b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f650aa00640 1 -- 172.21.15.173:0/715488212 >> v2:172.21.15.194:3300/0 conn(0x7f650c0b3e70 msgr2=0x7f650c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:52.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f650aa00640 1 --2- 172.21.15.173:0/715488212 >> v2:172.21.15.194:3300/0 conn(0x7f650c0b3e70 0x7f650c0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f650aa00640 1 -- 172.21.15.173:0/715488212 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650c06d420 con 0x7f650c0aefa0 2024-04-25T09:13:52.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.268+0000 7f650aa00640 1 -- 172.21.15.173:0/715488212 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f64f8001680 con 0x7f650c0aefa0 2024-04-25T09:13:52.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650aa00640 1 -- 172.21.15.173:0/715488212 >> v1:172.21.15.173:6789/0 conn(0x7f650c0aefa0 legacy=0x7f650c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650aa00640 1 --2- 172.21.15.173:0/715488212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64f00039c0 0x7f64f0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650aa00640 1 --2- 172.21.15.173:0/715488212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64f0004810 0x7f64f0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650aa00640 1 --2- 172.21.15.173:0/715488212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f650c15edd0 0x7f64f00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650aa00640 1 -- 172.21.15.173:0/715488212 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c06dd50 con 0x7f64f0004810 2024-04-25T09:13:52.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650aa00640 1 -- 172.21.15.173:0/715488212 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c15f320 con 0x7f64f00039c0 2024-04-25T09:13:52.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650aa00640 1 -- 172.21.15.173:0/715488212 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f000b9d0 con 0x7f650c15edd0 2024-04-25T09:13:52.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650b400640 1 --2- 172.21.15.173:0/715488212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64f0004810 0x7f64f0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650be00640 1 --2- 172.21.15.173:0/715488212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64f00039c0 0x7f64f0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f6511000640 1 --2- 172.21.15.173:0/715488212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f650c15edd0 0x7f64f00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650b400640 1 -- 172.21.15.173:0/715488212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f650c15edd0 msgr2=0x7f64f00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:52.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650b400640 1 --2- 172.21.15.173:0/715488212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f650c15edd0 0x7f64f00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650b400640 1 -- 172.21.15.173:0/715488212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64f00039c0 msgr2=0x7f64f0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:52.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650b400640 1 --2- 172.21.15.173:0/715488212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64f00039c0 0x7f64f0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650b400640 1 -- 172.21.15.173:0/715488212 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f0003530 con 0x7f64f0004810 2024-04-25T09:13:52.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650be00640 1 --2- 172.21.15.173:0/715488212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64f00039c0 0x7f64f0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:52.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f6511000640 1 --2- 172.21.15.173:0/715488212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f650c15edd0 0x7f64f00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:52.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650b400640 1 --2- 172.21.15.173:0/715488212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64f0004810 0x7f64f0004c90 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f64f800c160 tx=0x7f64f801f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f8b7ca87f27ecc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:52.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650aa00640 1 -- 172.21.15.173:0/715488212 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f8007c90 con 0x7f64f0004810 2024-04-25T09:13:52.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650aa00640 1 -- 172.21.15.173:0/715488212 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f80ac020 con 0x7f64f0004810 2024-04-25T09:13:52.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.272+0000 7f650aa00640 1 -- 172.21.15.173:0/715488212 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f80058e0 con 0x7f64f0004810 2024-04-25T09:13:52.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f6513000640 1 -- 172.21.15.173:0/715488212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64f0004810 msgr2=0x7f64f0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f6513000640 1 --2- 172.21.15.173:0/715488212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64f0004810 0x7f64f0004c90 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f64f800c160 tx=0x7f64f801f330 comp rx=0 tx=0).stop 2024-04-25T09:13:52.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f6511000640 1 -- 172.21.15.173:0/715488212 reap_dead start 2024-04-25T09:13:52.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f6513000640 1 -- 172.21.15.173:0/715488212 shutdown_connections 2024-04-25T09:13:52.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f6513000640 1 -- 172.21.15.173:0/715488212 >> 172.21.15.173:0/715488212 conn(0x7f650c06ac90 msgr2=0x7f650c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:52.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f6513000640 1 -- 172.21.15.173:0/715488212 shutdown_connections 2024-04-25T09:13:52.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f6513000640 1 -- 172.21.15.173:0/715488212 wait complete. 2024-04-25T09:13:52.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f6513000640 1 Processor -- start 2024-04-25T09:13:52.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f6513000640 1 -- start start 2024-04-25T09:13:52.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f6513000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f650c0b10e0 0x7f650c14f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f6513000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f650c14e630 0x7f650c0adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f6513000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f650c0b14c0 0x7f650c0b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f6513000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c0ce7b0 con 0x7f650c0b10e0 2024-04-25T09:13:52.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f6513000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c06d9e0 con 0x7f650c14e630 2024-04-25T09:13:52.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f6513000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650c15aba0 con 0x7f650c0b14c0 2024-04-25T09:13:52.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f650be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f650c0b10e0 0x7f650c14f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f650be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f650c0b10e0 0x7f650c14f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48064/0 (socket says 172.21.15.173:48064) 2024-04-25T09:13:52.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f650be00640 1 -- 172.21.15.173:0/283766452 learned_addr learned my addr 172.21.15.173:0/283766452 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:52.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f650b400640 1 --2- 172.21.15.173:0/283766452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f650c14e630 0x7f650c0adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f6511000640 1 --2- 172.21.15.173:0/283766452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f650c0b14c0 0x7f650c0b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f650be00640 1 -- 172.21.15.173:0/283766452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f650c0b14c0 msgr2=0x7f650c0b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f650be00640 1 --2- 172.21.15.173:0/283766452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f650c0b14c0 0x7f650c0b1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f650be00640 1 -- 172.21.15.173:0/283766452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f650c14e630 msgr2=0x7f650c0adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f650be00640 1 --2- 172.21.15.173:0/283766452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f650c14e630 0x7f650c0adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f650be00640 1 -- 172.21.15.173:0/283766452 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650c0ae1d0 con 0x7f650c0b10e0 2024-04-25T09:13:52.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.276+0000 7f650b400640 1 --2- 172.21.15.173:0/283766452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f650c14e630 0x7f650c0adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:52.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.280+0000 7f650be00640 1 --2- 172.21.15.173:0/283766452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f650c0b10e0 0x7f650c14f4e0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009fd0 tx=0x7f64fc011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:52.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.280+0000 7f6503e00640 1 -- 172.21.15.173:0/283766452 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc004220 con 0x7f650c0b10e0 2024-04-25T09:13:52.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.280+0000 7f6503e00640 1 -- 172.21.15.173:0/283766452 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc0043c0 con 0x7f650c0b10e0 2024-04-25T09:13:52.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.280+0000 7f6503e00640 1 -- 172.21.15.173:0/283766452 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc015890 con 0x7f650c0b10e0 2024-04-25T09:13:52.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.280+0000 7f6513000640 1 -- 172.21.15.173:0/283766452 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f650c0acbf0 con 0x7f650c0b10e0 2024-04-25T09:13:52.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.280+0000 7f6513000640 1 -- 172.21.15.173:0/283766452 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f650c0ad1b0 con 0x7f650c0b10e0 2024-04-25T09:13:52.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.280+0000 7f6513000640 1 -- 172.21.15.173:0/283766452 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f650c073a40 con 0x7f650c0b10e0 2024-04-25T09:13:52.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.280+0000 7f6503e00640 1 -- 172.21.15.173:0/283766452 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f64fc015a30 con 0x7f650c0b10e0 2024-04-25T09:13:52.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.280+0000 7f6503e00640 1 --2- 172.21.15.173:0/283766452 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f64ec066fe0 0x7f64ec0694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.280+0000 7f6503e00640 1 -- 172.21.15.173:0/283766452 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f64fc085420 con 0x7f650c0b10e0 2024-04-25T09:13:52.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.280+0000 7f650b400640 1 --2- 172.21.15.173:0/283766452 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f64ec066fe0 0x7f64ec0694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.284+0000 7f650b400640 1 --2- 172.21.15.173:0/283766452 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f64ec066fe0 0x7f64ec0694a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f64f80ad000 tx=0x7f64f8000ff0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:52.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.284+0000 7f6503e00640 1 -- 172.21.15.173:0/283766452 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f64fc019030 con 0x7f650c0b10e0 2024-04-25T09:13:52.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.440+0000 7f6513000640 1 -- 172.21.15.173:0/283766452 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f650c06e540 con 0x7f650c0b10e0 2024-04-25T09:13:52.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.440+0000 7f6503e00640 1 -- 172.21.15.173:0/283766452 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+13234 (secure 0 0 0) 0x7f64fc0565d0 con 0x7f650c0b10e0 2024-04-25T09:13:52.425 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:52.425 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":140,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:13:51.683072+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:13:52.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.440+0000 7f6513000640 1 -- 172.21.15.173:0/283766452 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f64ec066fe0 msgr2=0x7f64ec0694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.440+0000 7f6513000640 1 --2- 172.21.15.173:0/283766452 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f64ec066fe0 0x7f64ec0694a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f64f80ad000 tx=0x7f64f8000ff0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.440+0000 7f6513000640 1 -- 172.21.15.173:0/283766452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f650c0b10e0 msgr2=0x7f650c14f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.440+0000 7f6513000640 1 --2- 172.21.15.173:0/283766452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f650c0b10e0 0x7f650c14f4e0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009fd0 tx=0x7f64fc011a60 comp rx=0 tx=0).stop 2024-04-25T09:13:52.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.440+0000 7f6513000640 1 -- 172.21.15.173:0/283766452 shutdown_connections 2024-04-25T09:13:52.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.440+0000 7f6513000640 1 --2- 172.21.15.173:0/283766452 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f64ec066fe0 0x7f64ec0694a0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.440+0000 7f6513000640 1 --2- 172.21.15.173:0/283766452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f650c0b14c0 0x7f650c0b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.440+0000 7f6513000640 1 --2- 172.21.15.173:0/283766452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f650c14e630 0x7f650c0adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.440+0000 7f6513000640 1 --2- 172.21.15.173:0/283766452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f650c0b10e0 0x7f650c14f4e0 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.440+0000 7f6513000640 1 -- 172.21.15.173:0/283766452 >> 172.21.15.173:0/283766452 conn(0x7f650c06ac90 msgr2=0x7f650c0cf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:52.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.440+0000 7f6513000640 1 -- 172.21.15.173:0/283766452 shutdown_connections 2024-04-25T09:13:52.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.440+0000 7f6513000640 1 -- 172.21.15.173:0/283766452 wait complete. 2024-04-25T09:13:52.447 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:13:52.447 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:13:52.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.600+0000 7f770f400640 1 Processor -- start 2024-04-25T09:13:52.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.600+0000 7f770f400640 1 -- start start 2024-04-25T09:13:52.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.600+0000 7f770f400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77080aeb90 0x7f77080cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.600+0000 7f770f400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f77080ce2b0 0x7f77080cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.600+0000 7f770f400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7708071570 con 0x7f77080aef70 2024-04-25T09:13:52.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.600+0000 7f770f400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7708071320 con 0x7f77080ce2b0 2024-04-25T09:13:52.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.600+0000 7f770f400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7708072330 con 0x7f77080aeb90 2024-04-25T09:13:52.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.604+0000 7f7707e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f77080aef70 0x7f77080cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:42738/0 (socket says 172.21.15.173:42738) 2024-04-25T09:13:52.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.604+0000 7f7707e00640 1 -- 172.21.15.173:0/850762425 learned_addr learned my addr 172.21.15.173:0/850762425 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:52.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.604+0000 7f770ca00640 1 --2- 172.21.15.173:0/850762425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77080aeb90 0x7f77080cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.604+0000 7f770d400640 1 --2- 172.21.15.173:0/850762425 >> v2:172.21.15.194:3300/0 conn(0x7f77080ce2b0 0x7f77080cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.604+0000 7f7707400640 1 -- 172.21.15.173:0/850762425 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932086651 0 0) 0x7f7708071570 con 0x7f77080aef70 2024-04-25T09:13:52.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.604+0000 7f7707400640 1 -- 172.21.15.173:0/850762425 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76ec003530 con 0x7f77080aef70 2024-04-25T09:13:52.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.604+0000 7f770ca00640 1 -- 172.21.15.173:0/850762425 >> v2:172.21.15.194:3300/0 conn(0x7f77080ce2b0 msgr2=0x7f77080cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:52.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.604+0000 7f770ca00640 1 --2- 172.21.15.173:0/850762425 >> v2:172.21.15.194:3300/0 conn(0x7f77080ce2b0 0x7f77080cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.604+0000 7f770ca00640 1 -- 172.21.15.173:0/850762425 >> v1:172.21.15.173:6789/0 conn(0x7f77080aef70 legacy=0x7f77080cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.604+0000 7f770ca00640 1 -- 172.21.15.173:0/850762425 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7708071850 con 0x7f77080aeb90 2024-04-25T09:13:52.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.604+0000 7f770d400640 1 --2- 172.21.15.173:0/850762425 >> v2:172.21.15.194:3300/0 conn(0x7f77080ce2b0 0x7f77080cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:52.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.604+0000 7f770ca00640 1 --2- 172.21.15.173:0/850762425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77080aeb90 0x7f77080cc0d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f76f00097c0 tx=0x7f76f001e5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1de8b4f1b9dc8449 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:52.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f7707400640 1 -- 172.21.15.173:0/850762425 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f00ac660 con 0x7f77080aeb90 2024-04-25T09:13:52.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f7707400640 1 -- 172.21.15.173:0/850762425 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f00b1070 con 0x7f77080aeb90 2024-04-25T09:13:52.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f7707400640 1 -- 172.21.15.173:0/850762425 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f00aca20 con 0x7f77080aeb90 2024-04-25T09:13:52.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770f400640 1 -- 172.21.15.173:0/850762425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77080aeb90 msgr2=0x7f77080cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770f400640 1 --2- 172.21.15.173:0/850762425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77080aeb90 0x7f77080cc0d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f76f00097c0 tx=0x7f76f001e5f0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770f400640 1 -- 172.21.15.173:0/850762425 shutdown_connections 2024-04-25T09:13:52.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770f400640 1 --2- 172.21.15.173:0/850762425 >> v2:172.21.15.194:3300/0 conn(0x7f77080ce2b0 0x7f77080cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770f400640 1 --2- 172.21.15.173:0/850762425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77080aeb90 0x7f77080cc0d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770f400640 1 -- 172.21.15.173:0/850762425 >> 172.21.15.173:0/850762425 conn(0x7f770806ac90 msgr2=0x7f770806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:52.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770f400640 1 -- 172.21.15.173:0/850762425 shutdown_connections 2024-04-25T09:13:52.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770f400640 1 -- 172.21.15.173:0/850762425 wait complete. 2024-04-25T09:13:52.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770f400640 1 Processor -- start 2024-04-25T09:13:52.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770f400640 1 -- start start 2024-04-25T09:13:52.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77080aeb90 0x7f7708152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77080aef70 0x7f7708159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770f400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77080ce2b0 0x7f7708159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770f400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77080d02c0 con 0x7f77080aeb90 2024-04-25T09:13:52.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770f400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77080d0140 con 0x7f77080aef70 2024-04-25T09:13:52.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770f400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77080d0440 con 0x7f77080ce2b0 2024-04-25T09:13:52.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770ca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77080aeb90 0x7f7708152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770ca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77080aeb90 0x7f7708152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48074/0 (socket says 172.21.15.173:48074) 2024-04-25T09:13:52.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770ca00640 1 -- 172.21.15.173:0/1497868929 learned_addr learned my addr 172.21.15.173:0/1497868929 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:52.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f7707e00640 1 --2- 172.21.15.173:0/1497868929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77080aef70 0x7f7708159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.608+0000 7f770d400640 1 --2- 172.21.15.173:0/1497868929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77080ce2b0 0x7f7708159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.612+0000 7f770ca00640 1 -- 172.21.15.173:0/1497868929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77080ce2b0 msgr2=0x7f7708159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.612+0000 7f770ca00640 1 --2- 172.21.15.173:0/1497868929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77080ce2b0 0x7f7708159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.612+0000 7f770ca00640 1 -- 172.21.15.173:0/1497868929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77080aef70 msgr2=0x7f7708159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.612+0000 7f770ca00640 1 --2- 172.21.15.173:0/1497868929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77080aef70 0x7f7708159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.612+0000 7f770ca00640 1 -- 172.21.15.173:0/1497868929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77081476a0 con 0x7f77080aeb90 2024-04-25T09:13:52.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.612+0000 7f770ca00640 1 --2- 172.21.15.173:0/1497868929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77080aeb90 0x7f7708152a60 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f76f00ae040 tx=0x7f76f001ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:52.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.612+0000 7f7704c00640 1 -- 172.21.15.173:0/1497868929 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f00bb070 con 0x7f77080aeb90 2024-04-25T09:13:52.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.612+0000 7f7704c00640 1 -- 172.21.15.173:0/1497868929 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f00b5420 con 0x7f77080aeb90 2024-04-25T09:13:52.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.612+0000 7f770f400640 1 -- 172.21.15.173:0/1497868929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7708147980 con 0x7f77080aeb90 2024-04-25T09:13:52.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.612+0000 7f7704c00640 1 -- 172.21.15.173:0/1497868929 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f0006e20 con 0x7f77080aeb90 2024-04-25T09:13:52.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.612+0000 7f770f400640 1 -- 172.21.15.173:0/1497868929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7708147f40 con 0x7f77080aeb90 2024-04-25T09:13:52.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.612+0000 7f770f400640 1 -- 172.21.15.173:0/1497868929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7708073ab0 con 0x7f77080aeb90 2024-04-25T09:13:52.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.612+0000 7f7704c00640 1 -- 172.21.15.173:0/1497868929 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f76f00be070 con 0x7f77080aeb90 2024-04-25T09:13:52.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.612+0000 7f7704c00640 1 --2- 172.21.15.173:0/1497868929 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f76e4066f60 0x7f76e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.612+0000 7f7704c00640 1 -- 172.21.15.173:0/1497868929 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f76f011f3c0 con 0x7f77080aeb90 2024-04-25T09:13:52.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.616+0000 7f7707e00640 1 --2- 172.21.15.173:0/1497868929 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f76e4066f60 0x7f76e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.616+0000 7f7707e00640 1 --2- 172.21.15.173:0/1497868929 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f76e4066f60 0x7f76e4069420 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f76f8007fd0 tx=0x7f76f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:52.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.616+0000 7f7704c00640 1 -- 172.21.15.173:0/1497868929 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f76f00182a0 con 0x7f77080aeb90 2024-04-25T09:13:52.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.780+0000 7f770f400640 1 -- 172.21.15.173:0/1497868929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f770806e740 con 0x7f77080aeb90 2024-04-25T09:13:52.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.780+0000 7f7704c00640 1 -- 172.21.15.173:0/1497868929 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v140) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76f00eff40 con 0x7f77080aeb90 2024-04-25T09:13:52.767 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:13:52.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.784+0000 7f770f400640 1 -- 172.21.15.173:0/1497868929 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f76e4066f60 msgr2=0x7f76e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.784+0000 7f770f400640 1 --2- 172.21.15.173:0/1497868929 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f76e4066f60 0x7f76e4069420 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f76f8007fd0 tx=0x7f76f8009040 comp rx=0 tx=0).stop 2024-04-25T09:13:52.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.784+0000 7f770f400640 1 -- 172.21.15.173:0/1497868929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77080aeb90 msgr2=0x7f7708152a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.784+0000 7f770f400640 1 --2- 172.21.15.173:0/1497868929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77080aeb90 0x7f7708152a60 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f76f00ae040 tx=0x7f76f001ce30 comp rx=0 tx=0).stop 2024-04-25T09:13:52.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.784+0000 7f770f400640 1 -- 172.21.15.173:0/1497868929 shutdown_connections 2024-04-25T09:13:52.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.784+0000 7f770f400640 1 --2- 172.21.15.173:0/1497868929 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f76e4066f60 0x7f76e4069420 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.784+0000 7f770f400640 1 --2- 172.21.15.173:0/1497868929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77080ce2b0 0x7f7708159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.784+0000 7f770f400640 1 --2- 172.21.15.173:0/1497868929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77080aef70 0x7f7708159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.784+0000 7f770f400640 1 --2- 172.21.15.173:0/1497868929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77080aeb90 0x7f7708152a60 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.784+0000 7f770f400640 1 -- 172.21.15.173:0/1497868929 >> 172.21.15.173:0/1497868929 conn(0x7f770806ac90 msgr2=0x7f770806d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:52.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.784+0000 7f770f400640 1 -- 172.21.15.173:0/1497868929 shutdown_connections 2024-04-25T09:13:52.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.784+0000 7f770f400640 1 -- 172.21.15.173:0/1497868929 wait complete. 2024-04-25T09:13:52.789 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:13:52.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5ea200640 1 Processor -- start 2024-04-25T09:13:52.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5ea200640 1 -- start start 2024-04-25T09:13:52.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5ea200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb5e40b3e70 0x7fb5e40b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5ea200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5e40aefa0 0x7fb5e40b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5ea200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb5e415edd0 0x7fb5e40b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5ea200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e406dd50 con 0x7fb5e415edd0 2024-04-25T09:13:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5ea200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e40b4790 con 0x7fb5e40b3e70 2024-04-25T09:13:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5ea200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e415f320 con 0x7fb5e40aefa0 2024-04-25T09:13:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5e3e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb5e415edd0 0x7fb5e40b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5e3e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb5e415edd0 0x7fb5e40b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48090/0 (socket says 172.21.15.173:48090) 2024-04-25T09:13:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5e3e00640 1 -- 172.21.15.173:0/3305177736 learned_addr learned my addr 172.21.15.173:0/3305177736 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5e3400640 1 --2- 172.21.15.173:0/3305177736 >> v2:172.21.15.194:3300/0 conn(0x7fb5e40b3e70 0x7fb5e40b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5e2a00640 1 --2- 172.21.15.173:0/3305177736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5e40aefa0 0x7fb5e40b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5e3e00640 1 -- 172.21.15.173:0/3305177736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5e40aefa0 msgr2=0x7fb5e40b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5e3e00640 1 --2- 172.21.15.173:0/3305177736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5e40aefa0 0x7fb5e40b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5e3e00640 1 -- 172.21.15.173:0/3305177736 >> v2:172.21.15.194:3300/0 conn(0x7fb5e40b3e70 msgr2=0x7fb5e40b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5e3e00640 1 --2- 172.21.15.173:0/3305177736 >> v2:172.21.15.194:3300/0 conn(0x7fb5e40b3e70 0x7fb5e40b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5e3e00640 1 -- 172.21.15.173:0/3305177736 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e406d420 con 0x7fb5e415edd0 2024-04-25T09:13:52.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.940+0000 7fb5e3400640 1 --2- 172.21.15.173:0/3305177736 >> v2:172.21.15.194:3300/0 conn(0x7fb5e40b3e70 0x7fb5e40b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:52.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.944+0000 7fb5e3e00640 1 --2- 172.21.15.173:0/3305177736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5e415edd0 0x7fb5e40b2cb0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7fb5e406bca0 tx=0x7fb5dc01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1c2b27563ac0e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:52.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.944+0000 7fb5e2000640 1 -- 172.21.15.173:0/3305177736 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc0a5860 con 0x7fb5e415edd0 2024-04-25T09:13:52.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.944+0000 7fb5e2000640 1 -- 172.21.15.173:0/3305177736 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5dc0a5a00 con 0x7fb5e415edd0 2024-04-25T09:13:52.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.944+0000 7fb5e2000640 1 -- 172.21.15.173:0/3305177736 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc0a5dd0 con 0x7fb5e415edd0 2024-04-25T09:13:52.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.944+0000 7fb5ea200640 1 -- 172.21.15.173:0/3305177736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5e415edd0 msgr2=0x7fb5e40b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.944+0000 7fb5ea200640 1 --2- 172.21.15.173:0/3305177736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5e415edd0 0x7fb5e40b2cb0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7fb5e406bca0 tx=0x7fb5dc01c9c0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.944+0000 7fb5ea200640 1 -- 172.21.15.173:0/3305177736 shutdown_connections 2024-04-25T09:13:52.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.944+0000 7fb5ea200640 1 --2- 172.21.15.173:0/3305177736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5e415edd0 0x7fb5e40b2cb0 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.944+0000 7fb5ea200640 1 --2- 172.21.15.173:0/3305177736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5e40aefa0 0x7fb5e40b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.944+0000 7fb5ea200640 1 --2- 172.21.15.173:0/3305177736 >> v2:172.21.15.194:3300/0 conn(0x7fb5e40b3e70 0x7fb5e40b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.944+0000 7fb5ea200640 1 -- 172.21.15.173:0/3305177736 >> 172.21.15.173:0/3305177736 conn(0x7fb5e406ac90 msgr2=0x7fb5e406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:52.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.944+0000 7fb5ea200640 1 -- 172.21.15.173:0/3305177736 shutdown_connections 2024-04-25T09:13:52.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.944+0000 7fb5ea200640 1 -- 172.21.15.173:0/3305177736 wait complete. 2024-04-25T09:13:52.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5ea200640 1 Processor -- start 2024-04-25T09:13:52.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5ea200640 1 -- start start 2024-04-25T09:13:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5ea200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5e40aefa0 0x7fb5e414bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5ea200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5e40b3e70 0x7fb5e4151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5ea200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5e415edd0 0x7fb5e4157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5ea200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e406e1c0 con 0x7fb5e415edd0 2024-04-25T09:13:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5ea200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e40b3600 con 0x7fb5e40aefa0 2024-04-25T09:13:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5ea200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e406e340 con 0x7fb5e40b3e70 2024-04-25T09:13:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5e3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5e415edd0 0x7fb5e4157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5e3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5e415edd0 0x7fb5e4157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48106/0 (socket says 172.21.15.173:48106) 2024-04-25T09:13:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5e3e00640 1 -- 172.21.15.173:0/3936108213 learned_addr learned my addr 172.21.15.173:0/3936108213 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5e3400640 1 --2- 172.21.15.173:0/3936108213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5e40aefa0 0x7fb5e414bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5e2a00640 1 --2- 172.21.15.173:0/3936108213 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5e40b3e70 0x7fb5e4151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5e3e00640 1 -- 172.21.15.173:0/3936108213 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5e40b3e70 msgr2=0x7fb5e4151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5e3e00640 1 --2- 172.21.15.173:0/3936108213 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5e40b3e70 0x7fb5e4151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5e3e00640 1 -- 172.21.15.173:0/3936108213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5e40aefa0 msgr2=0x7fb5e414bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5e3e00640 1 --2- 172.21.15.173:0/3936108213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5e40aefa0 0x7fb5e414bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5e3e00640 1 -- 172.21.15.173:0/3936108213 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e414d500 con 0x7fb5e415edd0 2024-04-25T09:13:52.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5e2a00640 1 --2- 172.21.15.173:0/3936108213 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5e40b3e70 0x7fb5e4151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:52.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5e3e00640 1 --2- 172.21.15.173:0/3936108213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5e415edd0 0x7fb5e4157a90 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0af040 tx=0x7fb5dc019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5db400640 1 -- 172.21.15.173:0/3936108213 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc0b8640 con 0x7fb5e415edd0 2024-04-25T09:13:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5db400640 1 -- 172.21.15.173:0/3936108213 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5dc0bf070 con 0x7fb5e415edd0 2024-04-25T09:13:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5ea200640 1 -- 172.21.15.173:0/3936108213 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e414d7e0 con 0x7fb5e415edd0 2024-04-25T09:13:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5db400640 1 -- 172.21.15.173:0/3936108213 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc0b8a00 con 0x7fb5e415edd0 2024-04-25T09:13:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5ea200640 1 -- 172.21.15.173:0/3936108213 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e414dda0 con 0x7fb5e415edd0 2024-04-25T09:13:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.948+0000 7fb5ea200640 1 -- 172.21.15.173:0/3936108213 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e4073a40 con 0x7fb5e415edd0 2024-04-25T09:13:52.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.952+0000 7fb5db400640 1 -- 172.21.15.173:0/3936108213 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb5dc0b8ba0 con 0x7fb5e415edd0 2024-04-25T09:13:52.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.952+0000 7fb5db400640 1 --2- 172.21.15.173:0/3936108213 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb5c4066f90 0x7fb5c4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.952+0000 7fb5db400640 1 -- 172.21.15.173:0/3936108213 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fb5dc11f650 con 0x7fb5e415edd0 2024-04-25T09:13:52.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.952+0000 7fb5e3400640 1 --2- 172.21.15.173:0/3936108213 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb5c4066f90 0x7fb5c4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.952+0000 7fb5e3400640 1 --2- 172.21.15.173:0/3936108213 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb5c4066f90 0x7fb5c4069450 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb5e41519e0 tx=0x7fb5d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:52.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:52.956+0000 7fb5db400640 1 -- 172.21.15.173:0/3936108213 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb5dc0c8020 con 0x7fb5e415edd0 2024-04-25T09:13:53.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.112+0000 7fb5ea200640 1 -- 172.21.15.173:0/3936108213 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb5e406f1c0 con 0x7fb5e415edd0 2024-04-25T09:13:53.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.112+0000 7fb5db400640 1 -- 172.21.15.173:0/3936108213 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v140) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb5dc0165e0 con 0x7fb5e415edd0 2024-04-25T09:13:53.098 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:53.098 INFO:teuthology.orchestra.run.smithi173.stdout:[ 2024-04-25T09:13:53.098 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-04-25T09:13:53.098 INFO:teuthology.orchestra.run.smithi173.stdout: "poolnum": 1, 2024-04-25T09:13:53.098 INFO:teuthology.orchestra.run.smithi173.stdout: "poolname": ".mgr" 2024-04-25T09:13:53.098 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-25T09:13:53.098 INFO:teuthology.orchestra.run.smithi173.stdout:] 2024-04-25T09:13:53.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.112+0000 7fb5ea200640 1 -- 172.21.15.173:0/3936108213 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb5c4066f90 msgr2=0x7fb5c4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:53.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.112+0000 7fb5ea200640 1 --2- 172.21.15.173:0/3936108213 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb5c4066f90 0x7fb5c4069450 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb5e41519e0 tx=0x7fb5d4008040 comp rx=0 tx=0).stop 2024-04-25T09:13:53.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.112+0000 7fb5ea200640 1 -- 172.21.15.173:0/3936108213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5e415edd0 msgr2=0x7fb5e4157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:53.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.112+0000 7fb5ea200640 1 --2- 172.21.15.173:0/3936108213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5e415edd0 0x7fb5e4157a90 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0af040 tx=0x7fb5dc019760 comp rx=0 tx=0).stop 2024-04-25T09:13:53.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.112+0000 7fb5ea200640 1 -- 172.21.15.173:0/3936108213 shutdown_connections 2024-04-25T09:13:53.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.112+0000 7fb5ea200640 1 --2- 172.21.15.173:0/3936108213 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb5c4066f90 0x7fb5c4069450 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.112+0000 7fb5ea200640 1 --2- 172.21.15.173:0/3936108213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5e415edd0 0x7fb5e4157a90 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.112+0000 7fb5ea200640 1 --2- 172.21.15.173:0/3936108213 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5e40b3e70 0x7fb5e4151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.112+0000 7fb5ea200640 1 --2- 172.21.15.173:0/3936108213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5e40aefa0 0x7fb5e414bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.112+0000 7fb5ea200640 1 -- 172.21.15.173:0/3936108213 >> 172.21.15.173:0/3936108213 conn(0x7fb5e406ac90 msgr2=0x7fb5e41525c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:53.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.112+0000 7fb5ea200640 1 -- 172.21.15.173:0/3936108213 shutdown_connections 2024-04-25T09:13:53.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.112+0000 7fb5ea200640 1 -- 172.21.15.173:0/3936108213 wait complete. 2024-04-25T09:13:53.119 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:13:53.119 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:13:53.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.272+0000 7f67cb200640 1 Processor -- start 2024-04-25T09:13:53.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.272+0000 7f67cb200640 1 -- start start 2024-04-25T09:13:53.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.272+0000 7f67cb200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67c41594e0 0x7f67c40cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:53.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.272+0000 7f67cb200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f67c4071580 0x7f67c415bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:53.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.272+0000 7f67cb200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c415cbd0 con 0x7f67c40cf360 2024-04-25T09:13:53.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.272+0000 7f67cb200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c40ce990 con 0x7f67c4071580 2024-04-25T09:13:53.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.272+0000 7f67cb200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c415ceb0 con 0x7f67c41594e0 2024-04-25T09:13:53.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.272+0000 7f67c9200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f67c4071580 0x7f67c415bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:53.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.272+0000 7f67c9200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f67c4071580 0x7f67c415bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48114/0 (socket says 172.21.15.173:48114) 2024-04-25T09:13:53.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.272+0000 7f67c9200640 1 -- 172.21.15.173:0/3646657788 learned_addr learned my addr 172.21.15.173:0/3646657788 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:53.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.272+0000 7f67bb400640 1 --1- 172.21.15.173:0/3646657788 >> v1:172.21.15.173:6789/0 conn(0x7f67c40cf360 0x7f67c4070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:42740/0 (socket says 172.21.15.173:42740) 2024-04-25T09:13:53.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.272+0000 7f67c9200640 1 -- 172.21.15.173:0/3646657788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67c41594e0 msgr2=0x7f67c40cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:53.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.272+0000 7f67c3e00640 1 --2- 172.21.15.173:0/3646657788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67c41594e0 0x7f67c40cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:53.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.276+0000 7f67c9200640 1 --2- 172.21.15.173:0/3646657788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67c41594e0 0x7f67c40cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.276+0000 7f67c9200640 1 -- 172.21.15.173:0/3646657788 >> v1:172.21.15.173:6789/0 conn(0x7f67c40cf360 legacy=0x7f67c4070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:53.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.276+0000 7f67c9200640 1 -- 172.21.15.173:0/3646657788 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c40ce340 con 0x7f67c4071580 2024-04-25T09:13:53.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.276+0000 7f67c3e00640 1 --2- 172.21.15.173:0/3646657788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67c41594e0 0x7f67c40cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:53.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.276+0000 7f67c9200640 1 --2- 172.21.15.173:0/3646657788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67c4071580 0x7f67c415bff0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f67bc009870 tx=0x7f67bc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7756e55c767e64e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:53.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.276+0000 7f67c3400640 1 -- 172.21.15.173:0/3646657788 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0b1070 con 0x7f67c4071580 2024-04-25T09:13:53.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.276+0000 7f67c3400640 1 -- 172.21.15.173:0/3646657788 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67bc0ac410 con 0x7f67c4071580 2024-04-25T09:13:53.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.276+0000 7f67c3400640 1 -- 172.21.15.173:0/3646657788 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0ac7e0 con 0x7f67c4071580 2024-04-25T09:13:53.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.276+0000 7f67cb200640 1 -- 172.21.15.173:0/3646657788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67c4071580 msgr2=0x7f67c415bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:53.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.276+0000 7f67cb200640 1 --2- 172.21.15.173:0/3646657788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67c4071580 0x7f67c415bff0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f67bc009870 tx=0x7f67bc01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.276+0000 7f67cb200640 1 -- 172.21.15.173:0/3646657788 shutdown_connections 2024-04-25T09:13:53.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.276+0000 7f67cb200640 1 --2- 172.21.15.173:0/3646657788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67c4071580 0x7f67c415bff0 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.276+0000 7f67cb200640 1 --2- 172.21.15.173:0/3646657788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67c41594e0 0x7f67c40cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.276+0000 7f67cb200640 1 -- 172.21.15.173:0/3646657788 >> 172.21.15.173:0/3646657788 conn(0x7f67c40b3540 msgr2=0x7f67c40b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:53.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.276+0000 7f67cb200640 1 -- 172.21.15.173:0/3646657788 shutdown_connections 2024-04-25T09:13:53.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.276+0000 7f67cb200640 1 -- 172.21.15.173:0/3646657788 wait complete. 2024-04-25T09:13:53.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67cb200640 1 Processor -- start 2024-04-25T09:13:53.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67cb200640 1 -- start start 2024-04-25T09:13:53.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67cb200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67c4071580 0x7f67c4150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:53.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67cb200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67c41594e0 0x7f67c40cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:53.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67cb200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67c414f210 0x7f67c4155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:53.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67cb200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c41688f0 con 0x7f67c414f210 2024-04-25T09:13:53.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67cb200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4168770 con 0x7f67c41594e0 2024-04-25T09:13:53.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67cb200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4168a70 con 0x7f67c4071580 2024-04-25T09:13:53.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67c9200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67c414f210 0x7f67c4155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:53.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67c9200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67c414f210 0x7f67c4155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34754/0 (socket says 172.21.15.173:34754) 2024-04-25T09:13:53.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67c9200640 1 -- 172.21.15.173:0/4084578641 learned_addr learned my addr 172.21.15.173:0/4084578641 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:53.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67c9200640 1 -- 172.21.15.173:0/4084578641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67c4071580 msgr2=0x7f67c4150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:53.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67c9200640 1 --2- 172.21.15.173:0/4084578641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67c4071580 0x7f67c4150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67c9200640 1 -- 172.21.15.173:0/4084578641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67c41594e0 msgr2=0x7f67c40cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:53.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67c9200640 1 --2- 172.21.15.173:0/4084578641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67c41594e0 0x7f67c40cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67c9200640 1 -- 172.21.15.173:0/4084578641 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c4154b60 con 0x7f67c414f210 2024-04-25T09:13:53.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67c9200640 1 --2- 172.21.15.173:0/4084578641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67c414f210 0x7f67c4155390 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f67bc01a0d0 tx=0x7f67bc019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:53.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67c0c00640 1 -- 172.21.15.173:0/4084578641 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0bc070 con 0x7f67c414f210 2024-04-25T09:13:53.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67c0c00640 1 -- 172.21.15.173:0/4084578641 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67bc0b7440 con 0x7f67c414f210 2024-04-25T09:13:53.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67c0c00640 1 -- 172.21.15.173:0/4084578641 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0b1070 con 0x7f67c414f210 2024-04-25T09:13:53.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67cb200640 1 -- 172.21.15.173:0/4084578641 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c4150740 con 0x7f67c414f210 2024-04-25T09:13:53.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.280+0000 7f67cb200640 1 -- 172.21.15.173:0/4084578641 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c4150d00 con 0x7f67c414f210 2024-04-25T09:13:53.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.284+0000 7f67cb200640 1 -- 172.21.15.173:0/4084578641 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c4073ab0 con 0x7f67c414f210 2024-04-25T09:13:53.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.284+0000 7f67c0c00640 1 -- 172.21.15.173:0/4084578641 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f67bc0b63e0 con 0x7f67c414f210 2024-04-25T09:13:53.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.284+0000 7f67c0c00640 1 --2- 172.21.15.173:0/4084578641 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f67a0066f60 0x7f67a0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:53.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.284+0000 7f67c0c00640 1 -- 172.21.15.173:0/4084578641 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f67bc11e900 con 0x7f67c414f210 2024-04-25T09:13:53.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.284+0000 7f67c3e00640 1 --2- 172.21.15.173:0/4084578641 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f67a0066f60 0x7f67a0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:53.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.284+0000 7f67c3e00640 1 --2- 172.21.15.173:0/4084578641 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f67a0066f60 0x7f67a0069420 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f67c40b0d10 tx=0x7f67b4008330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:53.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.288+0000 7f67c0c00640 1 -- 172.21.15.173:0/4084578641 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f67bc016150 con 0x7f67c414f210 2024-04-25T09:13:53.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.444+0000 7f67cb200640 1 -- 172.21.15.173:0/4084578641 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f67c406e620 con 0x7f67c414f210 2024-04-25T09:13:53.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.688+0000 7f67c0c00640 1 -- 172.21.15.173:0/4084578641 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v141) v1 ==== 138+0+0 (secure 0 0 0) 0x7f67bc0efb60 con 0x7f67c414f210 2024-04-25T09:13:53.673 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' created 2024-04-25T09:13:53.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.688+0000 7f67cb200640 1 -- 172.21.15.173:0/4084578641 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f67a0066f60 msgr2=0x7f67a0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:53.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.688+0000 7f67cb200640 1 --2- 172.21.15.173:0/4084578641 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f67a0066f60 0x7f67a0069420 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f67c40b0d10 tx=0x7f67b4008330 comp rx=0 tx=0).stop 2024-04-25T09:13:53.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.688+0000 7f67cb200640 1 -- 172.21.15.173:0/4084578641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67c414f210 msgr2=0x7f67c4155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:53.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.688+0000 7f67cb200640 1 --2- 172.21.15.173:0/4084578641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67c414f210 0x7f67c4155390 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f67bc01a0d0 tx=0x7f67bc019240 comp rx=0 tx=0).stop 2024-04-25T09:13:53.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.688+0000 7f67cb200640 1 -- 172.21.15.173:0/4084578641 shutdown_connections 2024-04-25T09:13:53.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.688+0000 7f67cb200640 1 --2- 172.21.15.173:0/4084578641 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f67a0066f60 0x7f67a0069420 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.688+0000 7f67cb200640 1 --2- 172.21.15.173:0/4084578641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67c414f210 0x7f67c4155390 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.688+0000 7f67cb200640 1 --2- 172.21.15.173:0/4084578641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67c41594e0 0x7f67c40cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.688+0000 7f67cb200640 1 --2- 172.21.15.173:0/4084578641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67c4071580 0x7f67c4150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.688+0000 7f67cb200640 1 -- 172.21.15.173:0/4084578641 >> 172.21.15.173:0/4084578641 conn(0x7f67c40b3540 msgr2=0x7f67c415ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:53.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.688+0000 7f67cb200640 1 -- 172.21.15.173:0/4084578641 shutdown_connections 2024-04-25T09:13:53.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.688+0000 7f67cb200640 1 -- 172.21.15.173:0/4084578641 wait complete. 2024-04-25T09:13:53.700 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:13:53.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.856+0000 7fbbb0800640 1 Processor -- start 2024-04-25T09:13:53.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.856+0000 7fbbb0800640 1 -- start start 2024-04-25T09:13:53.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.860+0000 7fbbb0800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbba80aeb90 0x7fbba80cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:53.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.860+0000 7fbbb0800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbba80ce2b0 0x7fbba80cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:53.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.860+0000 7fbbb0800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba8071570 con 0x7fbba80aef70 2024-04-25T09:13:53.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.860+0000 7fbbb0800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba8071320 con 0x7fbba80aeb90 2024-04-25T09:13:53.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.860+0000 7fbbb0800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba8072330 con 0x7fbba80ce2b0 2024-04-25T09:13:53.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.860+0000 7fbbade00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbba80aeb90 0x7fbba80cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:53.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.860+0000 7fbbad400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fbba80aef70 0x7fbba80cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:55680/0 (socket says 172.21.15.173:55680) 2024-04-25T09:13:53.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.860+0000 7fbbad400640 1 -- 172.21.15.173:0/2596036988 learned_addr learned my addr 172.21.15.173:0/2596036988 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:53.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.860+0000 7fbbae800640 1 --2- 172.21.15.173:0/2596036988 >> v2:172.21.15.194:3300/0 conn(0x7fbba80ce2b0 0x7fbba80cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:53.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.860+0000 7fbbade00640 1 -- 172.21.15.173:0/2596036988 >> v2:172.21.15.194:3300/0 conn(0x7fbba80ce2b0 msgr2=0x7fbba80cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:53.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.860+0000 7fbbade00640 1 --2- 172.21.15.173:0/2596036988 >> v2:172.21.15.194:3300/0 conn(0x7fbba80ce2b0 0x7fbba80cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.860+0000 7fbbade00640 1 -- 172.21.15.173:0/2596036988 >> v1:172.21.15.173:6789/0 conn(0x7fbba80aef70 legacy=0x7fbba80cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:53.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.860+0000 7fbbade00640 1 -- 172.21.15.173:0/2596036988 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba8071850 con 0x7fbba80aeb90 2024-04-25T09:13:53.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.864+0000 7fbbade00640 1 --2- 172.21.15.173:0/2596036988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbba80aeb90 0x7fbba80cc0d0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fbba815e4f0 tx=0x7fbb9c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe1323f73d06dcd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:53.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.864+0000 7fbbaca00640 1 -- 172.21.15.173:0/2596036988 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c0b0070 con 0x7fbba80aeb90 2024-04-25T09:13:53.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.864+0000 7fbbaca00640 1 -- 172.21.15.173:0/2596036988 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c0ab600 con 0x7fbba80aeb90 2024-04-25T09:13:53.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.864+0000 7fbbaca00640 1 -- 172.21.15.173:0/2596036988 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c0ab9d0 con 0x7fbba80aeb90 2024-04-25T09:13:53.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.864+0000 7fbbb0800640 1 -- 172.21.15.173:0/2596036988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbba80aeb90 msgr2=0x7fbba80cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:53.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.864+0000 7fbbb0800640 1 --2- 172.21.15.173:0/2596036988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbba80aeb90 0x7fbba80cc0d0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fbba815e4f0 tx=0x7fbb9c01c3c0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.864+0000 7fbbb0800640 1 -- 172.21.15.173:0/2596036988 shutdown_connections 2024-04-25T09:13:53.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.864+0000 7fbbb0800640 1 --2- 172.21.15.173:0/2596036988 >> v2:172.21.15.194:3300/0 conn(0x7fbba80ce2b0 0x7fbba80cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.864+0000 7fbbb0800640 1 --2- 172.21.15.173:0/2596036988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbba80aeb90 0x7fbba80cc0d0 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.864+0000 7fbbb0800640 1 -- 172.21.15.173:0/2596036988 >> 172.21.15.173:0/2596036988 conn(0x7fbba806ac90 msgr2=0x7fbba806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:53.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.864+0000 7fbbb0800640 1 -- 172.21.15.173:0/2596036988 shutdown_connections 2024-04-25T09:13:53.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.864+0000 7fbbb0800640 1 -- 172.21.15.173:0/2596036988 wait complete. 2024-04-25T09:13:53.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.864+0000 7fbbb0800640 1 Processor -- start 2024-04-25T09:13:53.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.864+0000 7fbbb0800640 1 -- start start 2024-04-25T09:13:53.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbb0800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbba80aeb90 0x7fbba8149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:53.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbb0800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbba80aef70 0x7fbba8147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:53.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbb0800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbba80ce2b0 0x7fbba8159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:53.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbb0800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba815bb30 con 0x7fbba80aef70 2024-04-25T09:13:53.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbb0800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba815b9b0 con 0x7fbba80ce2b0 2024-04-25T09:13:53.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbb0800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba815bcb0 con 0x7fbba80aeb90 2024-04-25T09:13:53.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbad400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbba80aef70 0x7fbba8147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:53.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbad400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbba80aef70 0x7fbba8147040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34762/0 (socket says 172.21.15.173:34762) 2024-04-25T09:13:53.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbad400640 1 -- 172.21.15.173:0/662765776 learned_addr learned my addr 172.21.15.173:0/662765776 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:53.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbae800640 1 --2- 172.21.15.173:0/662765776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbba80ce2b0 0x7fbba8159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:53.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbade00640 1 --2- 172.21.15.173:0/662765776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbba80aeb90 0x7fbba8149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:53.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbad400640 1 -- 172.21.15.173:0/662765776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbba80aeb90 msgr2=0x7fbba8149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:53.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbad400640 1 --2- 172.21.15.173:0/662765776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbba80aeb90 0x7fbba8149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbad400640 1 -- 172.21.15.173:0/662765776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbba80ce2b0 msgr2=0x7fbba8159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:53.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbad400640 1 --2- 172.21.15.173:0/662765776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbba80ce2b0 0x7fbba8159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbad400640 1 -- 172.21.15.173:0/662765776 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba8148aa0 con 0x7fbba80aef70 2024-04-25T09:13:53.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbad400640 1 --2- 172.21.15.173:0/662765776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbba80aef70 0x7fbba8147040 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800c420 tx=0x7fbb9800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:53.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbba2000640 1 -- 172.21.15.173:0/662765776 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98017070 con 0x7fbba80aef70 2024-04-25T09:13:53.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbba2000640 1 -- 172.21.15.173:0/662765776 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb98005cf0 con 0x7fbba80aef70 2024-04-25T09:13:53.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbba2000640 1 -- 172.21.15.173:0/662765776 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb980072f0 con 0x7fbba80aef70 2024-04-25T09:13:53.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbb0800640 1 -- 172.21.15.173:0/662765776 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba8148d80 con 0x7fbba80aef70 2024-04-25T09:13:53.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbb0800640 1 -- 172.21.15.173:0/662765776 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba8149340 con 0x7fbba80aef70 2024-04-25T09:13:53.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbbb0800640 1 -- 172.21.15.173:0/662765776 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba8073ab0 con 0x7fbba80aef70 2024-04-25T09:13:53.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.868+0000 7fbba2000640 1 -- 172.21.15.173:0/662765776 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbb9801a070 con 0x7fbba80aef70 2024-04-25T09:13:53.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.872+0000 7fbba2000640 1 --2- 172.21.15.173:0/662765776 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbb8c066f60 0x7fbb8c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:53.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.872+0000 7fbba2000640 1 -- 172.21.15.173:0/662765776 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5619+0+0 (secure 0 0 0) 0x7fbb980846f0 con 0x7fbba80aef70 2024-04-25T09:13:53.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.872+0000 7fbbade00640 1 --2- 172.21.15.173:0/662765776 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbb8c066f60 0x7fbb8c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:53.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.872+0000 7fbbade00640 1 --2- 172.21.15.173:0/662765776 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbb8c066f60 0x7fbb8c069420 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0ad000 tx=0x7fbb9c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:53.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:53.876+0000 7fbba2000640 1 -- 172.21.15.173:0/662765776 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbb98021020 con 0x7fbba80aef70 2024-04-25T09:13:54.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.028+0000 7fbbb0800640 1 -- 172.21.15.173:0/662765776 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbba806b2c0 con 0x7fbba80aef70 2024-04-25T09:13:54.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.692+0000 7fbba2000640 1 -- 172.21.15.173:0/662765776 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v142) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbb980551e0 con 0x7fbba80aef70 2024-04-25T09:13:54.676 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' created 2024-04-25T09:13:54.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.692+0000 7fbbb0800640 1 -- 172.21.15.173:0/662765776 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbb8c066f60 msgr2=0x7fbb8c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:54.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.692+0000 7fbbb0800640 1 --2- 172.21.15.173:0/662765776 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbb8c066f60 0x7fbb8c069420 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0ad000 tx=0x7fbb9c008040 comp rx=0 tx=0).stop 2024-04-25T09:13:54.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.692+0000 7fbbb0800640 1 -- 172.21.15.173:0/662765776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbba80aef70 msgr2=0x7fbba8147040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:54.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.692+0000 7fbbb0800640 1 --2- 172.21.15.173:0/662765776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbba80aef70 0x7fbba8147040 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800c420 tx=0x7fbb9800c8e0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.692+0000 7fbbb0800640 1 -- 172.21.15.173:0/662765776 shutdown_connections 2024-04-25T09:13:54.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.692+0000 7fbbb0800640 1 --2- 172.21.15.173:0/662765776 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbb8c066f60 0x7fbb8c069420 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.692+0000 7fbbb0800640 1 --2- 172.21.15.173:0/662765776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbba80ce2b0 0x7fbba8159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.692+0000 7fbbb0800640 1 --2- 172.21.15.173:0/662765776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbba80aef70 0x7fbba8147040 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.692+0000 7fbbb0800640 1 --2- 172.21.15.173:0/662765776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbba80aeb90 0x7fbba8149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.692+0000 7fbbb0800640 1 -- 172.21.15.173:0/662765776 >> 172.21.15.173:0/662765776 conn(0x7fbba806ac90 msgr2=0x7fbba814dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:54.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.692+0000 7fbbb0800640 1 -- 172.21.15.173:0/662765776 shutdown_connections 2024-04-25T09:13:54.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.692+0000 7fbbb0800640 1 -- 172.21.15.173:0/662765776 wait complete. 2024-04-25T09:13:54.716 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:13:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.872+0000 7feda2400640 1 Processor -- start 2024-04-25T09:13:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.872+0000 7feda2400640 1 -- start start 2024-04-25T09:13:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.872+0000 7feda2400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed9c15e120 0x7fed9c0b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.872+0000 7feda2400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fed9c09a160 0x7fed9c0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.872+0000 7feda2400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9c0d1490 con 0x7fed9c06d200 2024-04-25T09:13:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.872+0000 7feda2400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c0d0bf0 con 0x7fed9c09a160 2024-04-25T09:13:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.872+0000 7feda2400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0d0ed0 con 0x7fed9c15e120 2024-04-25T09:13:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.872+0000 7fed9be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fed9c09a160 0x7fed9c0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.872+0000 7fed9be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fed9c09a160 0x7fed9c0cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34764/0 (socket says 172.21.15.173:34764) 2024-04-25T09:13:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.872+0000 7fed9be00640 1 -- 172.21.15.173:0/3573198558 learned_addr learned my addr 172.21.15.173:0/3573198558 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.872+0000 7fed9b400640 1 --2- 172.21.15.173:0/3573198558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed9c15e120 0x7fed9c0b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.872+0000 7fed9be00640 1 -- 172.21.15.173:0/3573198558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed9c15e120 msgr2=0x7fed9c0b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.872+0000 7fed9be00640 1 --2- 172.21.15.173:0/3573198558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed9c15e120 0x7fed9c0b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.872+0000 7fed9be00640 1 -- 172.21.15.173:0/3573198558 >> v1:172.21.15.194:6789/0 conn(0x7fed9c06d200 legacy=0x7fed9c099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:54.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.872+0000 7fed9be00640 1 -- 172.21.15.173:0/3573198558 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c0d11b0 con 0x7fed9c09a160 2024-04-25T09:13:54.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.872+0000 7fed9b400640 1 --2- 172.21.15.173:0/3573198558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed9c15e120 0x7fed9c0b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:54.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.876+0000 7fed9be00640 1 --2- 172.21.15.173:0/3573198558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed9c09a160 0x7fed9c0cc430 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7fed94009e50 tx=0x7fed9401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5223c57a0c9a2e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:54.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.876+0000 7fed9a000640 1 -- 172.21.15.173:0/3573198558 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed940a5660 con 0x7fed9c09a160 2024-04-25T09:13:54.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.876+0000 7fed9a000640 1 -- 172.21.15.173:0/3573198558 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed940a5800 con 0x7fed9c09a160 2024-04-25T09:13:54.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.876+0000 7fed9a000640 1 -- 172.21.15.173:0/3573198558 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed940a5bd0 con 0x7fed9c09a160 2024-04-25T09:13:54.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.876+0000 7feda2400640 1 -- 172.21.15.173:0/3573198558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed9c09a160 msgr2=0x7fed9c0cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:54.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.876+0000 7feda2400640 1 --2- 172.21.15.173:0/3573198558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed9c09a160 0x7fed9c0cc430 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7fed94009e50 tx=0x7fed9401c9a0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.876+0000 7feda2400640 1 -- 172.21.15.173:0/3573198558 shutdown_connections 2024-04-25T09:13:54.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.876+0000 7feda2400640 1 --2- 172.21.15.173:0/3573198558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed9c09a160 0x7fed9c0cc430 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.876+0000 7feda2400640 1 --2- 172.21.15.173:0/3573198558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed9c15e120 0x7fed9c0b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.876+0000 7feda2400640 1 -- 172.21.15.173:0/3573198558 >> 172.21.15.173:0/3573198558 conn(0x7fed9c0b32a0 msgr2=0x7fed9c0b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:54.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.876+0000 7feda2400640 1 -- 172.21.15.173:0/3573198558 shutdown_connections 2024-04-25T09:13:54.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.876+0000 7feda2400640 1 -- 172.21.15.173:0/3573198558 wait complete. 2024-04-25T09:13:54.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7feda2400640 1 Processor -- start 2024-04-25T09:13:54.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7feda2400640 1 -- start start 2024-04-25T09:13:54.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7feda2400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed9c06d200 0x7fed9c151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:54.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7feda2400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed9c09a160 0x7fed9c154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:54.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7feda2400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed9c15e120 0x7fed9c1549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:54.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7feda2400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0cd550 con 0x7fed9c06d200 2024-04-25T09:13:54.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7feda2400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0cd3d0 con 0x7fed9c09a160 2024-04-25T09:13:54.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7feda2400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0cd6d0 con 0x7fed9c15e120 2024-04-25T09:13:54.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7fed9b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed9c06d200 0x7fed9c151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:54.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7fed9b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed9c06d200 0x7fed9c151410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34772/0 (socket says 172.21.15.173:34772) 2024-04-25T09:13:54.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7fed9b400640 1 -- 172.21.15.173:0/752345753 learned_addr learned my addr 172.21.15.173:0/752345753 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:54.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7fed9aa00640 1 --2- 172.21.15.173:0/752345753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed9c09a160 0x7fed9c154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:54.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7fed9be00640 1 --2- 172.21.15.173:0/752345753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed9c15e120 0x7fed9c1549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:54.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7fed9b400640 1 -- 172.21.15.173:0/752345753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed9c15e120 msgr2=0x7fed9c1549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:54.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7fed9b400640 1 --2- 172.21.15.173:0/752345753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed9c15e120 0x7fed9c1549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7fed9b400640 1 -- 172.21.15.173:0/752345753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed9c09a160 msgr2=0x7fed9c154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:54.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7fed9b400640 1 --2- 172.21.15.173:0/752345753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed9c09a160 0x7fed9c154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7fed9b400640 1 -- 172.21.15.173:0/752345753 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c1528b0 con 0x7fed9c06d200 2024-04-25T09:13:54.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7fed9b400640 1 --2- 172.21.15.173:0/752345753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed9c06d200 0x7fed9c151410 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00d800 tx=0x7fed8c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:54.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7fed93400640 1 -- 172.21.15.173:0/752345753 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c00b6c0 con 0x7fed9c06d200 2024-04-25T09:13:54.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7fed93400640 1 -- 172.21.15.173:0/752345753 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8c019070 con 0x7fed9c06d200 2024-04-25T09:13:54.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7fed93400640 1 -- 172.21.15.173:0/752345753 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c00baa0 con 0x7fed9c06d200 2024-04-25T09:13:54.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7feda2400640 1 -- 172.21.15.173:0/752345753 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9c152b90 con 0x7fed9c06d200 2024-04-25T09:13:54.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.880+0000 7feda2400640 1 -- 172.21.15.173:0/752345753 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c0b4720 con 0x7fed9c06d200 2024-04-25T09:13:54.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.884+0000 7feda2400640 1 -- 172.21.15.173:0/752345753 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9c073ab0 con 0x7fed9c06d200 2024-04-25T09:13:54.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.884+0000 7fed93400640 1 -- 172.21.15.173:0/752345753 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fed8c00bc40 con 0x7fed9c06d200 2024-04-25T09:13:54.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.884+0000 7fed93400640 1 --2- 172.21.15.173:0/752345753 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fed7c066f60 0x7fed7c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:54.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.884+0000 7fed93400640 1 -- 172.21.15.173:0/752345753 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fed8c085dc0 con 0x7fed9c06d200 2024-04-25T09:13:54.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.884+0000 7fed9aa00640 1 --2- 172.21.15.173:0/752345753 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fed7c066f60 0x7fed7c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:54.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.884+0000 7fed9aa00640 1 --2- 172.21.15.173:0/752345753 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fed7c066f60 0x7fed7c069420 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fed9c1536f0 tx=0x7fed88009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:54.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:54.888+0000 7fed93400640 1 -- 172.21.15.173:0/752345753 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fed8c0567c0 con 0x7fed9c06d200 2024-04-25T09:13:55.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.076+0000 7feda2400640 1 -- 172.21.15.173:0/752345753 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fed9c152d60 con 0x7fed9c06d200 2024-04-25T09:13:55.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.720+0000 7fed93400640 1 -- 172.21.15.173:0/752345753 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v98) v1 ==== 174+0+0 (secure 0 0 0) 0x7fed8c05a860 con 0x7fed9c06d200 2024-04-25T09:13:55.707 INFO:teuthology.orchestra.run.smithi173.stderr:new fs with metadata pool 21 and data pool 22 2024-04-25T09:13:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.728+0000 7feda2400640 1 -- 172.21.15.173:0/752345753 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fed7c066f60 msgr2=0x7fed7c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.728+0000 7feda2400640 1 --2- 172.21.15.173:0/752345753 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fed7c066f60 0x7fed7c069420 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fed9c1536f0 tx=0x7fed88009040 comp rx=0 tx=0).stop 2024-04-25T09:13:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.728+0000 7feda2400640 1 -- 172.21.15.173:0/752345753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed9c06d200 msgr2=0x7fed9c151410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.728+0000 7feda2400640 1 --2- 172.21.15.173:0/752345753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed9c06d200 0x7fed9c151410 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00d800 tx=0x7fed8c00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.728+0000 7feda2400640 1 -- 172.21.15.173:0/752345753 shutdown_connections 2024-04-25T09:13:55.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.728+0000 7feda2400640 1 --2- 172.21.15.173:0/752345753 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fed7c066f60 0x7fed7c069420 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.728+0000 7feda2400640 1 --2- 172.21.15.173:0/752345753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed9c15e120 0x7fed9c1549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.728+0000 7feda2400640 1 --2- 172.21.15.173:0/752345753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed9c09a160 0x7fed9c154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.728+0000 7feda2400640 1 --2- 172.21.15.173:0/752345753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed9c06d200 0x7fed9c151410 secure :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00d800 tx=0x7fed8c00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.728+0000 7feda2400640 1 -- 172.21.15.173:0/752345753 >> 172.21.15.173:0/752345753 conn(0x7fed9c0b32a0 msgr2=0x7fed9c06fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:55.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.732+0000 7feda2400640 1 -- 172.21.15.173:0/752345753 shutdown_connections 2024-04-25T09:13:55.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.732+0000 7feda2400640 1 -- 172.21.15.173:0/752345753 wait complete. 2024-04-25T09:13:55.750 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:13:55.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.900+0000 7f4537e00640 1 Processor -- start 2024-04-25T09:13:55.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f4537e00640 1 -- start start 2024-04-25T09:13:55.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f4537e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45300c6d40 0x7f4530166760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f4537e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45300d0180 con 0x7f45300cc3c0 2024-04-25T09:13:55.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f4537e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45300d0460 con 0x7f453015bbb0 2024-04-25T09:13:55.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f4537e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45300c5530 con 0x7f45300c6d40 2024-04-25T09:13:55.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f4534a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f45300cc3c0 0x7f45300cc810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:55688/0 (socket says 172.21.15.173:55688) 2024-04-25T09:13:55.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f4534a00640 1 -- 172.21.15.173:0/2432965646 learned_addr learned my addr 172.21.15.173:0/2432965646 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:55.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f4535e00640 1 --2- 172.21.15.173:0/2432965646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45300c6d40 0x7f4530166760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f452fe00640 1 -- 172.21.15.173:0/2432965646 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377875508 0 0) 0x7f45300d0180 con 0x7f45300cc3c0 2024-04-25T09:13:55.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f452fe00640 1 -- 172.21.15.173:0/2432965646 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4518003530 con 0x7f45300cc3c0 2024-04-25T09:13:55.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f452fe00640 1 -- 172.21.15.173:0/2432965646 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1283079538 0 0) 0x7f4518003530 con 0x7f45300cc3c0 2024-04-25T09:13:55.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f452fe00640 1 -- 172.21.15.173:0/2432965646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45300c6d40 msgr2=0x7f4530166760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:55.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f452fe00640 1 --2- 172.21.15.173:0/2432965646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45300c6d40 0x7f4530166760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f452fe00640 1 -- 172.21.15.173:0/2432965646 >> v1:172.21.15.194:6789/0 conn(0x7f453015bbb0 legacy=0x7f45300cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f452fe00640 1 -- 172.21.15.173:0/2432965646 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45300c5810 con 0x7f45300cc3c0 2024-04-25T09:13:55.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f452fe00640 1 -- 172.21.15.173:0/2432965646 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f451c001680 con 0x7f45300cc3c0 2024-04-25T09:13:55.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f4535e00640 1 --2- 172.21.15.173:0/2432965646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45300c6d40 0x7f4530166760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:55.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f452fe00640 1 -- 172.21.15.173:0/2432965646 >> v1:172.21.15.173:6789/0 conn(0x7f45300cc3c0 legacy=0x7f45300cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f452fe00640 1 --2- 172.21.15.173:0/2432965646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45180039f0 0x7f4518003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f452fe00640 1 --2- 172.21.15.173:0/2432965646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45300c6d40 0x7f4518004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f452fe00640 1 --2- 172.21.15.173:0/2432965646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4518004d50 0x7f45180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f452fe00640 1 -- 172.21.15.173:0/2432965646 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45300c5530 con 0x7f4518004d50 2024-04-25T09:13:55.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f452fe00640 1 -- 172.21.15.173:0/2432965646 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451800ba20 con 0x7f45180039f0 2024-04-25T09:13:55.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f452fe00640 1 -- 172.21.15.173:0/2432965646 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451800bc20 con 0x7f45300c6d40 2024-04-25T09:13:55.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f4534a00640 1 --2- 172.21.15.173:0/2432965646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45300c6d40 0x7f4518004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f4535e00640 1 --2- 172.21.15.173:0/2432965646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4518004d50 0x7f45180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f4535400640 1 --2- 172.21.15.173:0/2432965646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45180039f0 0x7f4518003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f4535e00640 1 -- 172.21.15.173:0/2432965646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45300c6d40 msgr2=0x7f4518004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:55.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f4535e00640 1 --2- 172.21.15.173:0/2432965646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45300c6d40 0x7f4518004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f4535e00640 1 -- 172.21.15.173:0/2432965646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45180039f0 msgr2=0x7f4518003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:55.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f4535e00640 1 --2- 172.21.15.173:0/2432965646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45180039f0 0x7f4518003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f4535e00640 1 -- 172.21.15.173:0/2432965646 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4518003530 con 0x7f4518004d50 2024-04-25T09:13:55.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.904+0000 7f4534a00640 1 --2- 172.21.15.173:0/2432965646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f45300c6d40 0x7f4518004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:55.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.908+0000 7f4535e00640 1 --2- 172.21.15.173:0/2432965646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4518004d50 0x7f45180051d0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f4528009c80 tx=0x7f452801cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f836774d9ee2f64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:55.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.908+0000 7f452fe00640 1 -- 172.21.15.173:0/2432965646 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4528009880 con 0x7f4518004d50 2024-04-25T09:13:55.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.908+0000 7f452fe00640 1 -- 172.21.15.173:0/2432965646 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4528004020 con 0x7f4518004d50 2024-04-25T09:13:55.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.908+0000 7f452fe00640 1 -- 172.21.15.173:0/2432965646 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45280043f0 con 0x7f4518004d50 2024-04-25T09:13:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.908+0000 7f4537e00640 1 -- 172.21.15.173:0/2432965646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4518004d50 msgr2=0x7f45180051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.908+0000 7f4537e00640 1 --2- 172.21.15.173:0/2432965646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4518004d50 0x7f45180051d0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f4528009c80 tx=0x7f452801cbd0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.908+0000 7f4535e00640 1 -- 172.21.15.173:0/2432965646 reap_dead start 2024-04-25T09:13:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.908+0000 7f4537e00640 1 -- 172.21.15.173:0/2432965646 shutdown_connections 2024-04-25T09:13:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.908+0000 7f4537e00640 1 -- 172.21.15.173:0/2432965646 >> 172.21.15.173:0/2432965646 conn(0x7f45300b33a0 msgr2=0x7f45300b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.908+0000 7f4537e00640 1 -- 172.21.15.173:0/2432965646 shutdown_connections 2024-04-25T09:13:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.908+0000 7f4537e00640 1 -- 172.21.15.173:0/2432965646 wait complete. 2024-04-25T09:13:55.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4537e00640 1 Processor -- start 2024-04-25T09:13:55.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4537e00640 1 -- start start 2024-04-25T09:13:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4537e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4518004d50 0x7f453014b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4537e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f453015d400 0x7f45300b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4537e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f453015d880 0x7f45300b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4537e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453015bf90 con 0x7f453015d880 2024-04-25T09:13:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4537e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45300cfe70 con 0x7f453015d400 2024-04-25T09:13:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4537e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45300d0740 con 0x7f4518004d50 2024-04-25T09:13:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4535e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f453015d880 0x7f45300b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4535e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f453015d880 0x7f45300b6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34800/0 (socket says 172.21.15.173:34800) 2024-04-25T09:13:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4535e00640 1 -- 172.21.15.173:0/2595798773 learned_addr learned my addr 172.21.15.173:0/2595798773 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4534a00640 1 --2- 172.21.15.173:0/2595798773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f453015d400 0x7f45300b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4535400640 1 --2- 172.21.15.173:0/2595798773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4518004d50 0x7f453014b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4535e00640 1 -- 172.21.15.173:0/2595798773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4518004d50 msgr2=0x7f453014b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4535e00640 1 --2- 172.21.15.173:0/2595798773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4518004d50 0x7f453014b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4535e00640 1 -- 172.21.15.173:0/2595798773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f453015d400 msgr2=0x7f45300b6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4535e00640 1 --2- 172.21.15.173:0/2595798773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f453015d400 0x7f45300b6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4535e00640 1 -- 172.21.15.173:0/2595798773 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453014bdd0 con 0x7f453015d880 2024-04-25T09:13:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4535e00640 1 --2- 172.21.15.173:0/2595798773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f453015d880 0x7f45300b6f70 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f4528009c80 tx=0x7f4518005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f452d600640 1 -- 172.21.15.173:0/2595798773 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c007d60 con 0x7f453015d880 2024-04-25T09:13:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f452d600640 1 -- 172.21.15.173:0/2595798773 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45280bc070 con 0x7f453015d880 2024-04-25T09:13:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4537e00640 1 -- 172.21.15.173:0/2595798773 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453015c360 con 0x7f453015d880 2024-04-25T09:13:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f452d600640 1 -- 172.21.15.173:0/2595798773 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4528009880 con 0x7f453015d880 2024-04-25T09:13:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.912+0000 7f4537e00640 1 -- 172.21.15.173:0/2595798773 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453015c920 con 0x7f453015d880 2024-04-25T09:13:55.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.916+0000 7f4537e00640 1 -- 172.21.15.173:0/2595798773 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4530073a40 con 0x7f453015d880 2024-04-25T09:13:55.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.916+0000 7f452d600640 1 -- 172.21.15.173:0/2595798773 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f45280a5890 con 0x7f453015d880 2024-04-25T09:13:55.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.916+0000 7f452d600640 1 --2- 172.21.15.173:0/2595798773 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4510066f90 0x7f4510069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.916+0000 7f452d600640 1 -- 172.21.15.173:0/2595798773 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f452811f7c0 con 0x7f453015d880 2024-04-25T09:13:55.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.916+0000 7f4535400640 1 --2- 172.21.15.173:0/2595798773 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4510066f90 0x7f4510069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.916+0000 7f4535400640 1 --2- 172.21.15.173:0/2595798773 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4510066f90 0x7f4510069450 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4524000f90 tx=0x7f4524001af0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:55.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:55.920+0000 7f452d600640 1 -- 172.21.15.173:0/2595798773 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f45280168e0 con 0x7f453015d880 2024-04-25T09:13:56.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.076+0000 7f4537e00640 1 -- 172.21.15.173:0/2595798773 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45300c4d30 con 0x7f453015d880 2024-04-25T09:13:56.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.080+0000 7f452d600640 1 -- 172.21.15.173:0/2595798773 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+16965 (secure 0 0 0) 0x7f45280effe0 con 0x7f453015d880 2024-04-25T09:13:56.065 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:56.065 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":143,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:13:55.080985+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:13:53.493356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-04-25T09:13:54.078507+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:13:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.080+0000 7f4537e00640 1 -- 172.21.15.173:0/2595798773 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4510066f90 msgr2=0x7f4510069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.080+0000 7f4537e00640 1 --2- 172.21.15.173:0/2595798773 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4510066f90 0x7f4510069450 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4524000f90 tx=0x7f4524001af0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.080+0000 7f4537e00640 1 -- 172.21.15.173:0/2595798773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f453015d880 msgr2=0x7f45300b6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.080+0000 7f4537e00640 1 --2- 172.21.15.173:0/2595798773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f453015d880 0x7f45300b6f70 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f4528009c80 tx=0x7f4518005840 comp rx=0 tx=0).stop 2024-04-25T09:13:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.080+0000 7f4537e00640 1 -- 172.21.15.173:0/2595798773 shutdown_connections 2024-04-25T09:13:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.080+0000 7f4537e00640 1 --2- 172.21.15.173:0/2595798773 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4510066f90 0x7f4510069450 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.080+0000 7f4537e00640 1 --2- 172.21.15.173:0/2595798773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f453015d880 0x7f45300b6f70 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.080+0000 7f4537e00640 1 --2- 172.21.15.173:0/2595798773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f453015d400 0x7f45300b6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.080+0000 7f4537e00640 1 --2- 172.21.15.173:0/2595798773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4518004d50 0x7f453014b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.080+0000 7f4537e00640 1 -- 172.21.15.173:0/2595798773 >> 172.21.15.173:0/2595798773 conn(0x7f45300b33a0 msgr2=0x7f45300c62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.080+0000 7f4537e00640 1 -- 172.21.15.173:0/2595798773 shutdown_connections 2024-04-25T09:13:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.080+0000 7f4537e00640 1 -- 172.21.15.173:0/2595798773 wait complete. 2024-04-25T09:13:56.086 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:13:56.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.236+0000 7ff44d200640 1 Processor -- start 2024-04-25T09:13:56.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.236+0000 7ff44d200640 1 -- start start 2024-04-25T09:13:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.236+0000 7ff44d200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff4480aefa0 0x7ff4480cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.236+0000 7ff44d200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44815f320 con 0x7ff44815edd0 2024-04-25T09:13:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.236+0000 7ff44d200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44806d420 con 0x7ff4480b3e70 2024-04-25T09:13:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.236+0000 7ff44d200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44806dd50 con 0x7ff4480aefa0 2024-04-25T09:13:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.236+0000 7ff445400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff4480aefa0 0x7ff4480cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.236+0000 7ff446800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ff44815edd0 0x7ff4480cdce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:55696/0 (socket says 172.21.15.173:55696) 2024-04-25T09:13:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.236+0000 7ff445400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff4480aefa0 0x7ff4480cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34816/0 (socket says 172.21.15.173:34816) 2024-04-25T09:13:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.236+0000 7ff446800640 1 -- 172.21.15.173:0/2309785656 learned_addr learned my addr 172.21.15.173:0/2309785656 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.236+0000 7ff445400640 1 -- 172.21.15.173:0/2309785656 >> v1:172.21.15.194:6789/0 conn(0x7ff4480b3e70 legacy=0x7ff4480b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.236+0000 7ff445400640 1 -- 172.21.15.173:0/2309785656 >> v1:172.21.15.173:6789/0 conn(0x7ff44815edd0 legacy=0x7ff4480cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.236+0000 7ff444a00640 1 -- 172.21.15.173:0/2309785656 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499387452 0 0) 0x7ff44815f320 con 0x7ff44815edd0 2024-04-25T09:13:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.236+0000 7ff445400640 1 -- 172.21.15.173:0/2309785656 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44806d700 con 0x7ff4480aefa0 2024-04-25T09:13:56.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.240+0000 7ff445400640 1 --2- 172.21.15.173:0/2309785656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480aefa0 0x7ff4480cd7a0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7ff43400ba60 tx=0x7ff43401eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee52b4c53696a34 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:56.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.240+0000 7ff444a00640 1 -- 172.21.15.173:0/2309785656 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340b4070 con 0x7ff4480aefa0 2024-04-25T09:13:56.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.240+0000 7ff444a00640 1 -- 172.21.15.173:0/2309785656 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4340a7af0 con 0x7ff4480aefa0 2024-04-25T09:13:56.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.240+0000 7ff444a00640 1 -- 172.21.15.173:0/2309785656 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340af440 con 0x7ff4480aefa0 2024-04-25T09:13:56.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.240+0000 7ff44d200640 1 -- 172.21.15.173:0/2309785656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480aefa0 msgr2=0x7ff4480cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:56.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.240+0000 7ff44d200640 1 --2- 172.21.15.173:0/2309785656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480aefa0 0x7ff4480cd7a0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7ff43400ba60 tx=0x7ff43401eb00 comp rx=0 tx=0).stop 2024-04-25T09:13:56.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.240+0000 7ff44d200640 1 -- 172.21.15.173:0/2309785656 shutdown_connections 2024-04-25T09:13:56.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.240+0000 7ff44d200640 1 --2- 172.21.15.173:0/2309785656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480aefa0 0x7ff4480cd7a0 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.240+0000 7ff44d200640 1 -- 172.21.15.173:0/2309785656 >> 172.21.15.173:0/2309785656 conn(0x7ff44806ac90 msgr2=0x7ff44806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:56.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.240+0000 7ff44d200640 1 -- 172.21.15.173:0/2309785656 shutdown_connections 2024-04-25T09:13:56.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.240+0000 7ff44d200640 1 -- 172.21.15.173:0/2309785656 wait complete. 2024-04-25T09:13:56.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff44d200640 1 Processor -- start 2024-04-25T09:13:56.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff44d200640 1 -- start start 2024-04-25T09:13:56.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff44d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4480aefa0 0x7ff448153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:56.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff44d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480b3e70 0x7ff4480ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:56.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff44d200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff44815edd0 0x7ff4481f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:56.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff44d200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44806e360 con 0x7ff4480b3e70 2024-04-25T09:13:56.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff44d200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44806e1e0 con 0x7ff4480aefa0 2024-04-25T09:13:56.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff44d200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff448071b30 con 0x7ff44815edd0 2024-04-25T09:13:56.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff445400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480b3e70 0x7ff4480ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:56.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff445400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480b3e70 0x7ff4480ad2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34822/0 (socket says 172.21.15.173:34822) 2024-04-25T09:13:56.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff445400640 1 -- 172.21.15.173:0/1007741826 learned_addr learned my addr 172.21.15.173:0/1007741826 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:56.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff445e00640 1 --2- 172.21.15.173:0/1007741826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4480aefa0 0x7ff448153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:56.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff446800640 1 --2- 172.21.15.173:0/1007741826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff44815edd0 0x7ff4481f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:56.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff445400640 1 -- 172.21.15.173:0/1007741826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff44815edd0 msgr2=0x7ff4481f7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:56.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff445400640 1 --2- 172.21.15.173:0/1007741826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff44815edd0 0x7ff4481f7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff445400640 1 -- 172.21.15.173:0/1007741826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4480aefa0 msgr2=0x7ff448153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:56.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff445400640 1 --2- 172.21.15.173:0/1007741826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4480aefa0 0x7ff448153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff445400640 1 -- 172.21.15.173:0/1007741826 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff448150ac0 con 0x7ff4480b3e70 2024-04-25T09:13:56.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff445400640 1 --2- 172.21.15.173:0/1007741826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480b3e70 0x7ff4480ad2d0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7ff4340b2040 tx=0x7ff43401d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:56.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff43e000640 1 -- 172.21.15.173:0/1007741826 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340b4040 con 0x7ff4480b3e70 2024-04-25T09:13:56.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff43e000640 1 -- 172.21.15.173:0/1007741826 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4340afca0 con 0x7ff4480b3e70 2024-04-25T09:13:56.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff44d200640 1 -- 172.21.15.173:0/1007741826 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44814dd90 con 0x7ff4480b3e70 2024-04-25T09:13:56.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff43e000640 1 -- 172.21.15.173:0/1007741826 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff434004240 con 0x7ff4480b3e70 2024-04-25T09:13:56.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff44d200640 1 -- 172.21.15.173:0/1007741826 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4480add20 con 0x7ff4480b3e70 2024-04-25T09:13:56.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.244+0000 7ff44d200640 1 -- 172.21.15.173:0/1007741826 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff448073a40 con 0x7ff4480b3e70 2024-04-25T09:13:56.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.248+0000 7ff43e000640 1 -- 172.21.15.173:0/1007741826 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff4340c1060 con 0x7ff4480b3e70 2024-04-25T09:13:56.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.248+0000 7ff43e000640 1 --2- 172.21.15.173:0/1007741826 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff428066f60 0x7ff428069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:56.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.248+0000 7ff43e000640 1 -- 172.21.15.173:0/1007741826 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff43411f6e0 con 0x7ff4480b3e70 2024-04-25T09:13:56.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.248+0000 7ff445e00640 1 --2- 172.21.15.173:0/1007741826 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff428066f60 0x7ff428069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:56.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.248+0000 7ff445e00640 1 --2- 172.21.15.173:0/1007741826 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff428066f60 0x7ff428069420 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff4480b33e0 tx=0x7ff438009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:56.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.252+0000 7ff43e000640 1 -- 172.21.15.173:0/1007741826 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff434018720 con 0x7ff4480b3e70 2024-04-25T09:13:56.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.404+0000 7ff44d200640 1 -- 172.21.15.173:0/1007741826 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff44806f1c0 con 0x7ff4480b3e70 2024-04-25T09:13:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.408+0000 7ff43e000640 1 -- 172.21.15.173:0/1007741826 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+16965 (secure 0 0 0) 0x7ff4340f05f0 con 0x7ff4480b3e70 2024-04-25T09:13:56.393 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:56.393 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":143,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:13:55.080985+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:13:53.493356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-04-25T09:13:54.078507+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:13:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.408+0000 7ff44d200640 1 -- 172.21.15.173:0/1007741826 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff428066f60 msgr2=0x7ff428069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.408+0000 7ff44d200640 1 --2- 172.21.15.173:0/1007741826 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff428066f60 0x7ff428069420 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff4480b33e0 tx=0x7ff438009040 comp rx=0 tx=0).stop 2024-04-25T09:13:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.408+0000 7ff44d200640 1 -- 172.21.15.173:0/1007741826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480b3e70 msgr2=0x7ff4480ad2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.408+0000 7ff44d200640 1 --2- 172.21.15.173:0/1007741826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480b3e70 0x7ff4480ad2d0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7ff4340b2040 tx=0x7ff43401d340 comp rx=0 tx=0).stop 2024-04-25T09:13:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.408+0000 7ff44d200640 1 -- 172.21.15.173:0/1007741826 shutdown_connections 2024-04-25T09:13:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.408+0000 7ff44d200640 1 --2- 172.21.15.173:0/1007741826 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff428066f60 0x7ff428069420 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.408+0000 7ff44d200640 1 --2- 172.21.15.173:0/1007741826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff44815edd0 0x7ff4481f7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.408+0000 7ff44d200640 1 --2- 172.21.15.173:0/1007741826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4480b3e70 0x7ff4480ad2d0 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.408+0000 7ff44d200640 1 --2- 172.21.15.173:0/1007741826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4480aefa0 0x7ff448153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.408+0000 7ff44d200640 1 -- 172.21.15.173:0/1007741826 >> 172.21.15.173:0/1007741826 conn(0x7ff44806ac90 msgr2=0x7ff4480af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:56.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.408+0000 7ff44d200640 1 -- 172.21.15.173:0/1007741826 shutdown_connections 2024-04-25T09:13:56.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.408+0000 7ff44d200640 1 -- 172.21.15.173:0/1007741826 wait complete. 2024-04-25T09:13:56.415 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:13:56.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.568+0000 7fed35600640 1 Processor -- start 2024-04-25T09:13:56.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.568+0000 7fed35600640 1 -- start start 2024-04-25T09:13:56.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.568+0000 7fed35600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fed30145290 0x7fed3015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:56.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.572+0000 7fed35600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3015c5f0 con 0x7fed300b3fe0 2024-04-25T09:13:56.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.572+0000 7fed35600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3006d4b0 con 0x7fed300cc260 2024-04-25T09:13:56.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.572+0000 7fed35600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed300ccd80 con 0x7fed30145290 2024-04-25T09:13:56.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.572+0000 7fed2ea00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fed30145290 0x7fed3015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:56.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.572+0000 7fed2e000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fed300b3fe0 0x7fed300b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:55706/0 (socket says 172.21.15.173:55706) 2024-04-25T09:13:56.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.572+0000 7fed2e000640 1 -- 172.21.15.173:0/2612539680 learned_addr learned my addr 172.21.15.173:0/2612539680 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:56.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.572+0000 7fed2ea00640 1 -- 172.21.15.173:0/2612539680 >> v1:172.21.15.194:6789/0 conn(0x7fed300cc260 legacy=0x7fed300cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:56.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.572+0000 7fed2ea00640 1 -- 172.21.15.173:0/2612539680 >> v1:172.21.15.173:6789/0 conn(0x7fed300b3fe0 legacy=0x7fed300b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:56.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.572+0000 7fed2ea00640 1 -- 172.21.15.173:0/2612539680 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3006d790 con 0x7fed30145290 2024-04-25T09:13:56.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.572+0000 7fed2ea00640 1 --2- 172.21.15.173:0/2612539680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed30145290 0x7fed3015c0b0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7fed20009d90 tx=0x7fed2001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfd7a4156d7aa7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:56.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.572+0000 7fed2d600640 1 -- 172.21.15.173:0/2612539680 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed200b2070 con 0x7fed30145290 2024-04-25T09:13:56.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.572+0000 7fed2d600640 1 -- 172.21.15.173:0/2612539680 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed200a5820 con 0x7fed30145290 2024-04-25T09:13:56.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.572+0000 7fed2d600640 1 -- 172.21.15.173:0/2612539680 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed200a5bf0 con 0x7fed30145290 2024-04-25T09:13:56.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed35600640 1 -- 172.21.15.173:0/2612539680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed30145290 msgr2=0x7fed3015c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:56.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed35600640 1 --2- 172.21.15.173:0/2612539680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed30145290 0x7fed3015c0b0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7fed20009d90 tx=0x7fed2001c850 comp rx=0 tx=0).stop 2024-04-25T09:13:56.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed35600640 1 -- 172.21.15.173:0/2612539680 shutdown_connections 2024-04-25T09:13:56.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed35600640 1 --2- 172.21.15.173:0/2612539680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed30145290 0x7fed3015c0b0 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed35600640 1 -- 172.21.15.173:0/2612539680 >> 172.21.15.173:0/2612539680 conn(0x7fed3006ac90 msgr2=0x7fed3006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:56.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed35600640 1 -- 172.21.15.173:0/2612539680 shutdown_connections 2024-04-25T09:13:56.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed35600640 1 -- 172.21.15.173:0/2612539680 wait complete. 2024-04-25T09:13:56.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed35600640 1 Processor -- start 2024-04-25T09:13:56.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed35600640 1 -- start start 2024-04-25T09:13:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed35600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed300b3fe0 0x7fed3013f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed35600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed300cc260 0x7fed3015ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed35600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed30145290 0x7fed3015e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed35600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3006eee0 con 0x7fed300b3fe0 2024-04-25T09:13:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed35600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3006ed60 con 0x7fed300cc260 2024-04-25T09:13:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed35600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3006f060 con 0x7fed30145290 2024-04-25T09:13:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed2ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed300b3fe0 0x7fed3013f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed2ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed300b3fe0 0x7fed3013f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34842/0 (socket says 172.21.15.173:34842) 2024-04-25T09:13:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed2ea00640 1 -- 172.21.15.173:0/2882031426 learned_addr learned my addr 172.21.15.173:0/2882031426 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed2f400640 1 --2- 172.21.15.173:0/2882031426 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed30145290 0x7fed3015e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed2e000640 1 --2- 172.21.15.173:0/2882031426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed300cc260 0x7fed3015ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed2ea00640 1 -- 172.21.15.173:0/2882031426 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed30145290 msgr2=0x7fed3015e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed2ea00640 1 --2- 172.21.15.173:0/2882031426 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed30145290 0x7fed3015e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed2ea00640 1 -- 172.21.15.173:0/2882031426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed300cc260 msgr2=0x7fed3015ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed2ea00640 1 --2- 172.21.15.173:0/2882031426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed300cc260 0x7fed3015ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed2ea00640 1 -- 172.21.15.173:0/2882031426 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3013f580 con 0x7fed300b3fe0 2024-04-25T09:13:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.576+0000 7fed2f400640 1 --2- 172.21.15.173:0/2882031426 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed30145290 0x7fed3015e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.580+0000 7fed2ea00640 1 --2- 172.21.15.173:0/2882031426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed300b3fe0 0x7fed3013f040 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fed20019460 tx=0x7fed200195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.580+0000 7fed26a00640 1 -- 172.21.15.173:0/2882031426 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed200b2050 con 0x7fed300b3fe0 2024-04-25T09:13:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.580+0000 7fed26a00640 1 -- 172.21.15.173:0/2882031426 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed200be070 con 0x7fed300b3fe0 2024-04-25T09:13:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.580+0000 7fed26a00640 1 -- 172.21.15.173:0/2882031426 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed200ada70 con 0x7fed300b3fe0 2024-04-25T09:13:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.580+0000 7fed35600640 1 -- 172.21.15.173:0/2882031426 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3015b0b0 con 0x7fed300b3fe0 2024-04-25T09:13:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.580+0000 7fed35600640 1 -- 172.21.15.173:0/2882031426 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3013d230 con 0x7fed300b3fe0 2024-04-25T09:13:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.580+0000 7fed35600640 1 -- 172.21.15.173:0/2882031426 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed30073ab0 con 0x7fed300b3fe0 2024-04-25T09:13:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.580+0000 7fed26a00640 1 -- 172.21.15.173:0/2882031426 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fed200adc10 con 0x7fed300b3fe0 2024-04-25T09:13:56.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.580+0000 7fed26a00640 1 --2- 172.21.15.173:0/2882031426 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fed10066f60 0x7fed10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:56.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.580+0000 7fed26a00640 1 -- 172.21.15.173:0/2882031426 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fed201202a0 con 0x7fed300b3fe0 2024-04-25T09:13:56.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.580+0000 7fed2e000640 1 --2- 172.21.15.173:0/2882031426 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fed10066f60 0x7fed10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:56.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.584+0000 7fed2e000640 1 --2- 172.21.15.173:0/2882031426 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fed10066f60 0x7fed10069420 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fed300af970 tx=0x7fed1c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.584+0000 7fed26a00640 1 -- 172.21.15.173:0/2882031426 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fed20016560 con 0x7fed300b3fe0 2024-04-25T09:13:56.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:56.780+0000 7fed35600640 1 -- 172.21.15.173:0/2882031426 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fed300af3e0 con 0x7fed300b3fe0 2024-04-25T09:13:57.667 INFO:tasks.ceph.mds.b.smithi194.stderr:2024-04-25T09:13:57.682+0000 7fb458600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:13:57.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.732+0000 7fed26a00640 1 -- 172.21.15.173:0/2882031426 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v101) v1 ==== 118+0+0 (secure 0 0 0) 0x7fed200ab340 con 0x7fed300b3fe0 2024-04-25T09:13:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.732+0000 7fed35600640 1 -- 172.21.15.173:0/2882031426 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fed10066f60 msgr2=0x7fed10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.732+0000 7fed35600640 1 --2- 172.21.15.173:0/2882031426 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fed10066f60 0x7fed10069420 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fed300af970 tx=0x7fed1c009040 comp rx=0 tx=0).stop 2024-04-25T09:13:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.732+0000 7fed35600640 1 -- 172.21.15.173:0/2882031426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed300b3fe0 msgr2=0x7fed3013f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.732+0000 7fed35600640 1 --2- 172.21.15.173:0/2882031426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed300b3fe0 0x7fed3013f040 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fed20019460 tx=0x7fed200195f0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.732+0000 7fed35600640 1 -- 172.21.15.173:0/2882031426 shutdown_connections 2024-04-25T09:13:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.732+0000 7fed35600640 1 --2- 172.21.15.173:0/2882031426 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fed10066f60 0x7fed10069420 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.732+0000 7fed35600640 1 --2- 172.21.15.173:0/2882031426 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed30145290 0x7fed3015e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.732+0000 7fed35600640 1 --2- 172.21.15.173:0/2882031426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed300cc260 0x7fed3015ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.732+0000 7fed35600640 1 --2- 172.21.15.173:0/2882031426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed300b3fe0 0x7fed3013f040 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.732+0000 7fed35600640 1 -- 172.21.15.173:0/2882031426 >> 172.21.15.173:0/2882031426 conn(0x7fed3006ac90 msgr2=0x7fed300afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.736+0000 7fed35600640 1 -- 172.21.15.173:0/2882031426 shutdown_connections 2024-04-25T09:13:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.736+0000 7fed35600640 1 -- 172.21.15.173:0/2882031426 wait complete. 2024-04-25T09:13:57.742 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:13:57.742 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:13:57.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.900+0000 7fb553a00640 1 Processor -- start 2024-04-25T09:13:57.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.900+0000 7fb553a00640 1 -- start start 2024-04-25T09:13:57.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.900+0000 7fb553a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb54c0cc7e0 0x7fb54c0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:57.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.900+0000 7fb553a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb54c0aef70 0x7fb54c0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:57.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.900+0000 7fb553a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54c071570 con 0x7fb54c0aeb90 2024-04-25T09:13:57.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.900+0000 7fb553a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c071320 con 0x7fb54c0cc7e0 2024-04-25T09:13:57.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.900+0000 7fb553a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c072330 con 0x7fb54c0aef70 2024-04-25T09:13:57.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.900+0000 7fb54be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb54c0cc7e0 0x7fb54c0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:57.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.900+0000 7fb551000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fb54c0aeb90 0x7fb54c0cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:55712/0 (socket says 172.21.15.173:55712) 2024-04-25T09:13:57.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.900+0000 7fb551000640 1 -- 172.21.15.173:0/3449667062 learned_addr learned my addr 172.21.15.173:0/3449667062 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:57.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.900+0000 7fb54be00640 1 -- 172.21.15.173:0/3449667062 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb54c0aef70 msgr2=0x7fb54c0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:57.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.900+0000 7fb54be00640 1 --2- 172.21.15.173:0/3449667062 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb54c0aef70 0x7fb54c0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.900+0000 7fb54be00640 1 -- 172.21.15.173:0/3449667062 >> v1:172.21.15.173:6789/0 conn(0x7fb54c0aeb90 legacy=0x7fb54c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:57.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.900+0000 7fb54be00640 1 -- 172.21.15.173:0/3449667062 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c071850 con 0x7fb54c0cc7e0 2024-04-25T09:13:57.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.900+0000 7fb54b400640 1 -- 172.21.15.173:0/3449667062 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987436286 0 0) 0x7fb54c071570 con 0x7fb54c0aeb90 2024-04-25T09:13:57.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.904+0000 7fb54be00640 1 --2- 172.21.15.173:0/3449667062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb54c0cc7e0 0x7fb54c0cdba0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fb5380097c0 tx=0x7fb53801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619a09d3898fbdff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:57.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.904+0000 7fb54b400640 1 -- 172.21.15.173:0/3449667062 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5380b0070 con 0x7fb54c0cc7e0 2024-04-25T09:13:57.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.904+0000 7fb54b400640 1 -- 172.21.15.173:0/3449667062 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5380ab600 con 0x7fb54c0cc7e0 2024-04-25T09:13:57.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.904+0000 7fb54b400640 1 -- 172.21.15.173:0/3449667062 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5380ab9d0 con 0x7fb54c0cc7e0 2024-04-25T09:13:57.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.904+0000 7fb553a00640 1 -- 172.21.15.173:0/3449667062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb54c0cc7e0 msgr2=0x7fb54c0cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:57.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.904+0000 7fb553a00640 1 --2- 172.21.15.173:0/3449667062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb54c0cc7e0 0x7fb54c0cdba0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fb5380097c0 tx=0x7fb53801c410 comp rx=0 tx=0).stop 2024-04-25T09:13:57.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.904+0000 7fb553a00640 1 -- 172.21.15.173:0/3449667062 shutdown_connections 2024-04-25T09:13:57.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.904+0000 7fb553a00640 1 --2- 172.21.15.173:0/3449667062 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb54c0aef70 0x7fb54c0ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.904+0000 7fb553a00640 1 --2- 172.21.15.173:0/3449667062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb54c0cc7e0 0x7fb54c0cdba0 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.904+0000 7fb553a00640 1 -- 172.21.15.173:0/3449667062 >> 172.21.15.173:0/3449667062 conn(0x7fb54c06ac90 msgr2=0x7fb54c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:57.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.904+0000 7fb553a00640 1 -- 172.21.15.173:0/3449667062 shutdown_connections 2024-04-25T09:13:57.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.904+0000 7fb553a00640 1 -- 172.21.15.173:0/3449667062 wait complete. 2024-04-25T09:13:57.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb553a00640 1 Processor -- start 2024-04-25T09:13:57.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb553a00640 1 -- start start 2024-04-25T09:13:57.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb553a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb54c0aeb90 0x7fb54c14ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:57.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb553a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb54c0aef70 0x7fb54c152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:57.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb553a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb54c0cc7e0 0x7fb54c0b1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:57.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb553a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c15bb30 con 0x7fb54c0cc7e0 2024-04-25T09:13:57.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb553a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c15b9b0 con 0x7fb54c0aeb90 2024-04-25T09:13:57.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb553a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c15bcb0 con 0x7fb54c0aef70 2024-04-25T09:13:57.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb551a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb54c0cc7e0 0x7fb54c0b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:57.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb551a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb54c0cc7e0 0x7fb54c0b1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34854/0 (socket says 172.21.15.173:34854) 2024-04-25T09:13:57.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb551a00640 1 -- 172.21.15.173:0/1152007133 learned_addr learned my addr 172.21.15.173:0/1152007133 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:57.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb551a00640 1 -- 172.21.15.173:0/1152007133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb54c0aef70 msgr2=0x7fb54c152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:57.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb54be00640 1 --2- 172.21.15.173:0/1152007133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb54c0aef70 0x7fb54c152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:57.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb551000640 1 --2- 172.21.15.173:0/1152007133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb54c0aeb90 0x7fb54c14ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:57.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb551a00640 1 --2- 172.21.15.173:0/1152007133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb54c0aef70 0x7fb54c152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb551a00640 1 -- 172.21.15.173:0/1152007133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb54c0aeb90 msgr2=0x7fb54c14ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:57.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb551a00640 1 --2- 172.21.15.173:0/1152007133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb54c0aeb90 0x7fb54c14ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb551a00640 1 -- 172.21.15.173:0/1152007133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c152880 con 0x7fb54c0cc7e0 2024-04-25T09:13:57.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb54be00640 1 --2- 172.21.15.173:0/1152007133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb54c0aef70 0x7fb54c152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:57.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb551000640 1 --2- 172.21.15.173:0/1152007133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb54c0aeb90 0x7fb54c14ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:57.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb551a00640 1 --2- 172.21.15.173:0/1152007133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb54c0cc7e0 0x7fb54c0b1150 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fb54400b970 tx=0x7fb54400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:57.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb548c00640 1 -- 172.21.15.173:0/1152007133 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544019070 con 0x7fb54c0cc7e0 2024-04-25T09:13:57.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb548c00640 1 -- 172.21.15.173:0/1152007133 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54400cb60 con 0x7fb54c0cc7e0 2024-04-25T09:13:57.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb553a00640 1 -- 172.21.15.173:0/1152007133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c152b60 con 0x7fb54c0cc7e0 2024-04-25T09:13:57.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb548c00640 1 -- 172.21.15.173:0/1152007133 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544014440 con 0x7fb54c0cc7e0 2024-04-25T09:13:57.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb553a00640 1 -- 172.21.15.173:0/1152007133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c0b0950 con 0x7fb54c0cc7e0 2024-04-25T09:13:57.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.908+0000 7fb553a00640 1 -- 172.21.15.173:0/1152007133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54c073ab0 con 0x7fb54c0cc7e0 2024-04-25T09:13:57.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.912+0000 7fb548c00640 1 -- 172.21.15.173:0/1152007133 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb54401c070 con 0x7fb54c0cc7e0 2024-04-25T09:13:57.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.912+0000 7fb548c00640 1 --2- 172.21.15.173:0/1152007133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb52c066f60 0x7fb52c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:57.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.912+0000 7fb548c00640 1 -- 172.21.15.173:0/1152007133 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb544084f30 con 0x7fb54c0cc7e0 2024-04-25T09:13:57.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.912+0000 7fb551000640 1 --2- 172.21.15.173:0/1152007133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb52c066f60 0x7fb52c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:57.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.912+0000 7fb551000640 1 --2- 172.21.15.173:0/1152007133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb52c066f60 0x7fb52c069420 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb53c000f70 tx=0x7fb53c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:57.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:57.916+0000 7fb548c00640 1 -- 172.21.15.173:0/1152007133 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb544055da0 con 0x7fb54c0cc7e0 2024-04-25T09:13:58.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.104+0000 7fb553a00640 1 -- 172.21.15.173:0/1152007133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb54c0ce340 con 0x7fb54c0cc7e0 2024-04-25T09:13:58.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.736+0000 7fb548c00640 1 -- 172.21.15.173:0/1152007133 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v102) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb5440556a0 con 0x7fb54c0cc7e0 2024-04-25T09:13:58.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.740+0000 7fb553a00640 1 -- 172.21.15.173:0/1152007133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb52c066f60 msgr2=0x7fb52c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:58.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.740+0000 7fb553a00640 1 --2- 172.21.15.173:0/1152007133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb52c066f60 0x7fb52c069420 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb53c000f70 tx=0x7fb53c009040 comp rx=0 tx=0).stop 2024-04-25T09:13:58.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.740+0000 7fb553a00640 1 -- 172.21.15.173:0/1152007133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb54c0cc7e0 msgr2=0x7fb54c0b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:58.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.740+0000 7fb553a00640 1 --2- 172.21.15.173:0/1152007133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb54c0cc7e0 0x7fb54c0b1150 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fb54400b970 tx=0x7fb54400be30 comp rx=0 tx=0).stop 2024-04-25T09:13:58.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.740+0000 7fb553a00640 1 -- 172.21.15.173:0/1152007133 shutdown_connections 2024-04-25T09:13:58.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.740+0000 7fb553a00640 1 --2- 172.21.15.173:0/1152007133 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb52c066f60 0x7fb52c069420 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.740+0000 7fb553a00640 1 --2- 172.21.15.173:0/1152007133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb54c0cc7e0 0x7fb54c0b1150 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.740+0000 7fb553a00640 1 --2- 172.21.15.173:0/1152007133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb54c0aef70 0x7fb54c152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.740+0000 7fb553a00640 1 --2- 172.21.15.173:0/1152007133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb54c0aeb90 0x7fb54c14ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.740+0000 7fb553a00640 1 -- 172.21.15.173:0/1152007133 >> 172.21.15.173:0/1152007133 conn(0x7fb54c06ac90 msgr2=0x7fb54c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:58.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.740+0000 7fb553a00640 1 -- 172.21.15.173:0/1152007133 shutdown_connections 2024-04-25T09:13:58.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.740+0000 7fb553a00640 1 -- 172.21.15.173:0/1152007133 wait complete. 2024-04-25T09:13:58.747 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:13:58.748 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:58.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.900+0000 7f4aff800640 1 Processor -- start 2024-04-25T09:13:58.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.900+0000 7f4aff800640 1 -- start start 2024-04-25T09:13:58.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.900+0000 7f4aff800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af815be00 0x7f4af806f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.900+0000 7f4aff800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af815c460 con 0x7f4af815ba20 2024-04-25T09:13:58.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.900+0000 7f4aff800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af815c740 con 0x7f4af806fea0 2024-04-25T09:13:58.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.900+0000 7f4aff800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af815ca20 con 0x7f4af815be00 2024-04-25T09:13:58.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.900+0000 7f4afce00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4af815ba20 0x7f4af80b70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:55716/0 (socket says 172.21.15.173:55716) 2024-04-25T09:13:58.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.900+0000 7f4afce00640 1 -- 172.21.15.173:0/893923049 learned_addr learned my addr 172.21.15.173:0/893923049 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:58.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.900+0000 7f4aefe00640 1 --2- 172.21.15.173:0/893923049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af815be00 0x7f4af806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.900+0000 7f4af7e00640 1 -- 172.21.15.173:0/893923049 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938004293 0 0) 0x7f4af815c460 con 0x7f4af815ba20 2024-04-25T09:13:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.900+0000 7f4af7e00640 1 -- 172.21.15.173:0/893923049 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4adc003530 con 0x7f4af815ba20 2024-04-25T09:13:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.900+0000 7f4af7e00640 1 -- 172.21.15.173:0/893923049 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668957351 0 0) 0x7f4af815c740 con 0x7f4af806fea0 2024-04-25T09:13:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.900+0000 7f4af7e00640 1 -- 172.21.15.173:0/893923049 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4af815c460 con 0x7f4af806fea0 2024-04-25T09:13:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.900+0000 7f4aefe00640 1 -- 172.21.15.173:0/893923049 >> v1:172.21.15.194:6789/0 conn(0x7f4af806fea0 legacy=0x7f4af80d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.900+0000 7f4aefe00640 1 -- 172.21.15.173:0/893923049 >> v1:172.21.15.173:6789/0 conn(0x7f4af815ba20 legacy=0x7f4af80b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.900+0000 7f4aefe00640 1 -- 172.21.15.173:0/893923049 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af815cd00 con 0x7f4af815be00 2024-04-25T09:13:58.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.904+0000 7f4aefe00640 1 --2- 172.21.15.173:0/893923049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af815be00 0x7f4af806f960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00097f0 tx=0x7f4ae001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27c3f47ec4c21427 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:58.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.904+0000 7f4af7e00640 1 -- 172.21.15.173:0/893923049 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00b0070 con 0x7f4af815be00 2024-04-25T09:13:58.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.904+0000 7f4af7e00640 1 -- 172.21.15.173:0/893923049 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae00ab600 con 0x7f4af815be00 2024-04-25T09:13:58.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.904+0000 7f4af7e00640 1 -- 172.21.15.173:0/893923049 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00ab9d0 con 0x7f4af815be00 2024-04-25T09:13:58.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.904+0000 7f4aff800640 1 -- 172.21.15.173:0/893923049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af815be00 msgr2=0x7f4af806f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:58.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.904+0000 7f4aff800640 1 --2- 172.21.15.173:0/893923049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af815be00 0x7f4af806f960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00097f0 tx=0x7f4ae001c4e0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.904+0000 7f4aff800640 1 -- 172.21.15.173:0/893923049 shutdown_connections 2024-04-25T09:13:58.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.904+0000 7f4aff800640 1 --2- 172.21.15.173:0/893923049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af815be00 0x7f4af806f960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.904+0000 7f4aff800640 1 -- 172.21.15.173:0/893923049 >> 172.21.15.173:0/893923049 conn(0x7f4af8061880 msgr2=0x7f4af8061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:58.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.904+0000 7f4aff800640 1 -- 172.21.15.173:0/893923049 shutdown_connections 2024-04-25T09:13:58.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.904+0000 7f4aff800640 1 -- 172.21.15.173:0/893923049 wait complete. 2024-04-25T09:13:58.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aff800640 1 Processor -- start 2024-04-25T09:13:58.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aff800640 1 -- start start 2024-04-25T09:13:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aff800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4af806fea0 0x7f4af81671d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aff800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af815ba20 0x7f4af80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aff800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af815be00 0x7f4af80c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aff800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af816a160 con 0x7f4af815ba20 2024-04-25T09:13:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aff800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af80702b0 con 0x7f4af806fea0 2024-04-25T09:13:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aff800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af816a2e0 con 0x7f4af815be00 2024-04-25T09:13:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aefe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af815ba20 0x7f4af80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aefe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af815ba20 0x7f4af80b6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34856/0 (socket says 172.21.15.173:34856) 2024-04-25T09:13:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aefe00640 1 -- 172.21.15.173:0/1887073267 learned_addr learned my addr 172.21.15.173:0/1887073267 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4afce00640 1 --2- 172.21.15.173:0/1887073267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4af806fea0 0x7f4af81671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4afd800640 1 --2- 172.21.15.173:0/1887073267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af815be00 0x7f4af80c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aefe00640 1 -- 172.21.15.173:0/1887073267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af815be00 msgr2=0x7f4af80c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aefe00640 1 --2- 172.21.15.173:0/1887073267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af815be00 0x7f4af80c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aefe00640 1 -- 172.21.15.173:0/1887073267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4af806fea0 msgr2=0x7f4af81671d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aefe00640 1 --2- 172.21.15.173:0/1887073267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4af806fea0 0x7f4af81671d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aefe00640 1 -- 172.21.15.173:0/1887073267 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af8152870 con 0x7f4af815ba20 2024-04-25T09:13:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aefe00640 1 --2- 172.21.15.173:0/1887073267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af815ba20 0x7f4af80b6110 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00097f0 tx=0x7f4ae0019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4af5600640 1 -- 172.21.15.173:0/1887073267 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00b0040 con 0x7f4af815ba20 2024-04-25T09:13:58.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4af5600640 1 -- 172.21.15.173:0/1887073267 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae00be070 con 0x7f4af815ba20 2024-04-25T09:13:58.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aff800640 1 -- 172.21.15.173:0/1887073267 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af8152b30 con 0x7f4af815ba20 2024-04-25T09:13:58.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4af5600640 1 -- 172.21.15.173:0/1887073267 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00b78b0 con 0x7f4af815ba20 2024-04-25T09:13:58.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.908+0000 7f4aff800640 1 -- 172.21.15.173:0/1887073267 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af80b6650 con 0x7f4af815ba20 2024-04-25T09:13:58.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.912+0000 7f4aff800640 1 -- 172.21.15.173:0/1887073267 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af8073a40 con 0x7f4af815ba20 2024-04-25T09:13:58.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.912+0000 7f4af5600640 1 -- 172.21.15.173:0/1887073267 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4ae00b3040 con 0x7f4af815ba20 2024-04-25T09:13:58.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.912+0000 7f4af5600640 1 --2- 172.21.15.173:0/1887073267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4ad4066f60 0x7f4ad4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.912+0000 7f4af5600640 1 -- 172.21.15.173:0/1887073267 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4ae011f320 con 0x7f4af815ba20 2024-04-25T09:13:58.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.912+0000 7f4afce00640 1 --2- 172.21.15.173:0/1887073267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4ad4066f60 0x7f4ad4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.912+0000 7f4afce00640 1 --2- 172.21.15.173:0/1887073267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4ad4066f60 0x7f4ad4069420 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8007fd0 tx=0x7f4ae8007d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:58.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:58.916+0000 7f4af5600640 1 -- 172.21.15.173:0/1887073267 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4ae00160d0 con 0x7f4af815ba20 2024-04-25T09:13:59.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.104+0000 7f4aff800640 1 -- 172.21.15.173:0/1887073267 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4af806d0b0 con 0x7f4af815ba20 2024-04-25T09:13:59.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.104+0000 7f4af5600640 1 -- 172.21.15.173:0/1887073267 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4950 (secure 0 0 0) 0x7f4ae00efab0 con 0x7f4af815ba20 2024-04-25T09:13:59.091 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:59.091 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":102,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/751187793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":751187793},{"type":"v1","addr":"172.21.15.173:6836","nonce":751187793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":9013,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1331227782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1331227782},{"type":"v1","addr":"172.21.15.194:6834","nonce":1331227782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":97},{"gid":9957,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/401620872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":401620872},{"type":"v1","addr":"172.21.15.173:6837","nonce":401620872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:13:55.081334+0000","modified":"2024-04-25T09:13:58.107523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9969":{"gid":9969,"name":"b","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/3308916795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":3308916795},{"type":"v1","addr":"172.21.15.194:6835","nonce":3308916795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T09:13:59.091 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 102 2024-04-25T09:13:59.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.108+0000 7f4aff800640 1 -- 172.21.15.173:0/1887073267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4ad4066f60 msgr2=0x7f4ad4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.108+0000 7f4aff800640 1 --2- 172.21.15.173:0/1887073267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4ad4066f60 0x7f4ad4069420 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8007fd0 tx=0x7f4ae8007d80 comp rx=0 tx=0).stop 2024-04-25T09:13:59.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.108+0000 7f4aff800640 1 -- 172.21.15.173:0/1887073267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af815ba20 msgr2=0x7f4af80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.108+0000 7f4aff800640 1 --2- 172.21.15.173:0/1887073267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af815ba20 0x7f4af80b6110 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00097f0 tx=0x7f4ae0019280 comp rx=0 tx=0).stop 2024-04-25T09:13:59.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.108+0000 7f4aff800640 1 -- 172.21.15.173:0/1887073267 shutdown_connections 2024-04-25T09:13:59.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.108+0000 7f4aff800640 1 --2- 172.21.15.173:0/1887073267 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4ad4066f60 0x7f4ad4069420 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.108+0000 7f4aff800640 1 --2- 172.21.15.173:0/1887073267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af815be00 0x7f4af80c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.108+0000 7f4aff800640 1 --2- 172.21.15.173:0/1887073267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4af815ba20 0x7f4af80b6110 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.108+0000 7f4aff800640 1 --2- 172.21.15.173:0/1887073267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4af806fea0 0x7f4af81671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.108+0000 7f4aff800640 1 -- 172.21.15.173:0/1887073267 >> 172.21.15.173:0/1887073267 conn(0x7f4af8061880 msgr2=0x7f4af80b6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:59.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.108+0000 7f4aff800640 1 -- 172.21.15.173:0/1887073267 shutdown_connections 2024-04-25T09:13:59.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.108+0000 7f4aff800640 1 -- 172.21.15.173:0/1887073267 wait complete. 2024-04-25T09:13:59.111 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:13:59.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.260+0000 7f0751c00640 1 Processor -- start 2024-04-25T09:13:59.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f0751c00640 1 -- start start 2024-04-25T09:13:59.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f0751c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f074c0ccd30 0x7f074c0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f0751c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074c06e7c0 con 0x7f074c0cc8b0 2024-04-25T09:13:59.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f0751c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074c06d720 con 0x7f074c145250 2024-04-25T09:13:59.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f0751c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c06da00 con 0x7f074c0ccd30 2024-04-25T09:13:59.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f0743e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f074c0cc8b0 0x7f074c0ce8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:55730/0 (socket says 172.21.15.173:55730) 2024-04-25T09:13:59.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f0743e00640 1 -- 172.21.15.173:0/1499795084 learned_addr learned my addr 172.21.15.173:0/1499795084 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:59.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f074b400640 1 --2- 172.21.15.173:0/1499795084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f074c0ccd30 0x7f074c0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f074a000640 1 -- 172.21.15.173:0/1499795084 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352260078 0 0) 0x7f074c06e7c0 con 0x7f074c0cc8b0 2024-04-25T09:13:59.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f074a000640 1 -- 172.21.15.173:0/1499795084 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0730003530 con 0x7f074c0cc8b0 2024-04-25T09:13:59.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f074a000640 1 -- 172.21.15.173:0/1499795084 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3399662574 0 0) 0x7f0730003530 con 0x7f074c0cc8b0 2024-04-25T09:13:59.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f074a000640 1 -- 172.21.15.173:0/1499795084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f074c0ccd30 msgr2=0x7f074c0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:59.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f074a000640 1 --2- 172.21.15.173:0/1499795084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f074c0ccd30 0x7f074c0cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f074a000640 1 -- 172.21.15.173:0/1499795084 >> v1:172.21.15.194:6789/0 conn(0x7f074c145250 legacy=0x7f074c15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f074a000640 1 -- 172.21.15.173:0/1499795084 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c06dce0 con 0x7f074c0cc8b0 2024-04-25T09:13:59.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f074a000640 1 -- 172.21.15.173:0/1499795084 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f0734001680 con 0x7f074c0cc8b0 2024-04-25T09:13:59.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f074a000640 1 -- 172.21.15.173:0/1499795084 >> v1:172.21.15.173:6789/0 conn(0x7f074c0cc8b0 legacy=0x7f074c0ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f074a000640 1 --2- 172.21.15.173:0/1499795084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f074c0ccd30 0x7f07300039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f074a000640 1 --2- 172.21.15.173:0/1499795084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0730003f30 0x7f0730004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f074a000640 1 --2- 172.21.15.173:0/1499795084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0730004d50 0x7f07300051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f074a000640 1 -- 172.21.15.173:0/1499795084 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c06da00 con 0x7f0730003f30 2024-04-25T09:13:59.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f074a000640 1 -- 172.21.15.173:0/1499795084 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073000ba30 con 0x7f0730004d50 2024-04-25T09:13:59.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f074a000640 1 -- 172.21.15.173:0/1499795084 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073000bc30 con 0x7f074c0ccd30 2024-04-25T09:13:59.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f0743e00640 1 --2- 172.21.15.173:0/1499795084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0730003f30 0x7f0730004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f074aa00640 1 --2- 172.21.15.173:0/1499795084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f074c0ccd30 0x7f07300039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f074b400640 1 --2- 172.21.15.173:0/1499795084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0730004d50 0x7f07300051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f0743e00640 1 -- 172.21.15.173:0/1499795084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f074c0ccd30 msgr2=0x7f07300039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:59.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f0743e00640 1 --2- 172.21.15.173:0/1499795084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f074c0ccd30 0x7f07300039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f0743e00640 1 -- 172.21.15.173:0/1499795084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0730004d50 msgr2=0x7f07300051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:59.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f0743e00640 1 --2- 172.21.15.173:0/1499795084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0730004d50 0x7f07300051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.264+0000 7f0743e00640 1 -- 172.21.15.173:0/1499795084 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0730003530 con 0x7f0730003f30 2024-04-25T09:13:59.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.268+0000 7f0743e00640 1 --2- 172.21.15.173:0/1499795084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0730003f30 0x7f0730004810 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f073400c240 tx=0x7f073401cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1e8d213911474 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:59.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.268+0000 7f074a000640 1 -- 172.21.15.173:0/1499795084 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734007d20 con 0x7f0730003f30 2024-04-25T09:13:59.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.268+0000 7f074a000640 1 -- 172.21.15.173:0/1499795084 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07340a9020 con 0x7f0730003f30 2024-04-25T09:13:59.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.268+0000 7f074a000640 1 -- 172.21.15.173:0/1499795084 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734005b00 con 0x7f0730003f30 2024-04-25T09:13:59.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.268+0000 7f0751c00640 1 -- 172.21.15.173:0/1499795084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0730003f30 msgr2=0x7f0730004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.268+0000 7f0751c00640 1 --2- 172.21.15.173:0/1499795084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0730003f30 0x7f0730004810 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f073400c240 tx=0x7f073401cba0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.268+0000 7f074b400640 1 -- 172.21.15.173:0/1499795084 reap_dead start 2024-04-25T09:13:59.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.268+0000 7f0751c00640 1 -- 172.21.15.173:0/1499795084 shutdown_connections 2024-04-25T09:13:59.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.268+0000 7f0751c00640 1 -- 172.21.15.173:0/1499795084 >> 172.21.15.173:0/1499795084 conn(0x7f074c06ac90 msgr2=0x7f074c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:59.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.268+0000 7f0751c00640 1 -- 172.21.15.173:0/1499795084 shutdown_connections 2024-04-25T09:13:59.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.268+0000 7f0751c00640 1 -- 172.21.15.173:0/1499795084 wait complete. 2024-04-25T09:13:59.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0751c00640 1 Processor -- start 2024-04-25T09:13:59.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0751c00640 1 -- start start 2024-04-25T09:13:59.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0751c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0730003f30 0x7f074c1416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0751c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f074c13d4e0 0x7f074c1425c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0751c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f074c142b00 0x7f074c13b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0751c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c145630 con 0x7f074c13d4e0 2024-04-25T09:13:59.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0751c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c06e2a0 con 0x7f074c142b00 2024-04-25T09:13:59.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0751c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0cd180 con 0x7f0730003f30 2024-04-25T09:13:59.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0743e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f074c13d4e0 0x7f074c1425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0743e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f074c13d4e0 0x7f074c1425c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34878/0 (socket says 172.21.15.173:34878) 2024-04-25T09:13:59.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0743e00640 1 -- 172.21.15.173:0/297888187 learned_addr learned my addr 172.21.15.173:0/297888187 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:59.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0743e00640 1 -- 172.21.15.173:0/297888187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0730003f30 msgr2=0x7f074c1416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0743e00640 1 --2- 172.21.15.173:0/297888187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0730003f30 0x7f074c1416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0743e00640 1 -- 172.21.15.173:0/297888187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f074c142b00 msgr2=0x7f074c13b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0743e00640 1 --2- 172.21.15.173:0/297888187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f074c142b00 0x7f074c13b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0743e00640 1 -- 172.21.15.173:0/297888187 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c13fc90 con 0x7f074c13d4e0 2024-04-25T09:13:59.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0743e00640 1 --2- 172.21.15.173:0/297888187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f074c13d4e0 0x7f074c1425c0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f073400c240 tx=0x7f0730005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:59.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0742a00640 1 -- 172.21.15.173:0/297888187 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734001c60 con 0x7f074c13d4e0 2024-04-25T09:13:59.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0742a00640 1 -- 172.21.15.173:0/297888187 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07340047f0 con 0x7f074c13d4e0 2024-04-25T09:13:59.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0742a00640 1 -- 172.21.15.173:0/297888187 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734004ba0 con 0x7f074c13d4e0 2024-04-25T09:13:59.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0751c00640 1 -- 172.21.15.173:0/297888187 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074c13ff70 con 0x7f074c13d4e0 2024-04-25T09:13:59.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0751c00640 1 -- 172.21.15.173:0/297888187 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074c140530 con 0x7f074c13d4e0 2024-04-25T09:13:59.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.272+0000 7f0751c00640 1 -- 172.21.15.173:0/297888187 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074c073a40 con 0x7f074c13d4e0 2024-04-25T09:13:59.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.276+0000 7f0742a00640 1 -- 172.21.15.173:0/297888187 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0734007070 con 0x7f074c13d4e0 2024-04-25T09:13:59.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.276+0000 7f0742a00640 1 --2- 172.21.15.173:0/297888187 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0728066f90 0x7f0728069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.276+0000 7f0742a00640 1 -- 172.21.15.173:0/297888187 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f073411f610 con 0x7f074c13d4e0 2024-04-25T09:13:59.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.276+0000 7f074aa00640 1 --2- 172.21.15.173:0/297888187 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0728066f90 0x7f0728069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.276+0000 7f074aa00640 1 --2- 172.21.15.173:0/297888187 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0728066f90 0x7f0728069450 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f073c007990 tx=0x7f073c007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:59.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.280+0000 7f0742a00640 1 -- 172.21.15.173:0/297888187 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f07340168b0 con 0x7f074c13d4e0 2024-04-25T09:13:59.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.432+0000 7f0751c00640 1 -- 172.21.15.173:0/297888187 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f074c142f20 con 0x7f074c13d4e0 2024-04-25T09:13:59.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.436+0000 7f0742a00640 1 -- 172.21.15.173:0/297888187 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+16952 (secure 0 0 0) 0x7f07340f4e20 con 0x7f074c13d4e0 2024-04-25T09:13:59.420 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:59.420 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":144,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:13:56.711320+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:13:53.493356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-04-25T09:13:54.078507+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:13:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.436+0000 7f0751c00640 1 -- 172.21.15.173:0/297888187 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0728066f90 msgr2=0x7f0728069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.436+0000 7f0751c00640 1 --2- 172.21.15.173:0/297888187 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0728066f90 0x7f0728069450 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f073c007990 tx=0x7f073c007920 comp rx=0 tx=0).stop 2024-04-25T09:13:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.436+0000 7f0751c00640 1 -- 172.21.15.173:0/297888187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f074c13d4e0 msgr2=0x7f074c1425c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.436+0000 7f0751c00640 1 --2- 172.21.15.173:0/297888187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f074c13d4e0 0x7f074c1425c0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f073400c240 tx=0x7f0730005840 comp rx=0 tx=0).stop 2024-04-25T09:13:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.436+0000 7f0751c00640 1 -- 172.21.15.173:0/297888187 shutdown_connections 2024-04-25T09:13:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.436+0000 7f0751c00640 1 --2- 172.21.15.173:0/297888187 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0728066f90 0x7f0728069450 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.436+0000 7f0751c00640 1 --2- 172.21.15.173:0/297888187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f074c142b00 0x7f074c13b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.436+0000 7f0751c00640 1 --2- 172.21.15.173:0/297888187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f074c13d4e0 0x7f074c1425c0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.436+0000 7f0751c00640 1 --2- 172.21.15.173:0/297888187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0730003f30 0x7f074c1416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.436+0000 7f0751c00640 1 -- 172.21.15.173:0/297888187 >> 172.21.15.173:0/297888187 conn(0x7f074c06ac90 msgr2=0x7f074c0afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.436+0000 7f0751c00640 1 -- 172.21.15.173:0/297888187 shutdown_connections 2024-04-25T09:13:59.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.436+0000 7f0751c00640 1 -- 172.21.15.173:0/297888187 wait complete. 2024-04-25T09:13:59.441 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:13:59.442 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:13:59.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.592+0000 7fac7be00640 1 Processor -- start 2024-04-25T09:13:59.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.592+0000 7fac7be00640 1 -- start start 2024-04-25T09:13:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.592+0000 7fac7be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fac74160fe0 0x7fac74161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.592+0000 7fac7be00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac74061d60 con 0x7fac7406dac0 2024-04-25T09:13:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.592+0000 7fac7be00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7406dfa0 con 0x7fac7406bca0 2024-04-25T09:13:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.592+0000 7fac7be00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac740ad510 con 0x7fac74160fe0 2024-04-25T09:13:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.592+0000 7fac79400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fac74160fe0 0x7fac74161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.592+0000 7fac78a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fac7406dac0 0x7fac740ace00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:55742/0 (socket says 172.21.15.173:55742) 2024-04-25T09:13:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.592+0000 7fac78a00640 1 -- 172.21.15.173:0/2164525920 learned_addr learned my addr 172.21.15.173:0/2164525920 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.592+0000 7fac79400640 1 --2- 172.21.15.173:0/2164525920 >> v2:172.21.15.173:3300/0 conn(0x7fac74160fe0 0x7fac74161fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34890/0 (socket says 172.21.15.173:34890) 2024-04-25T09:13:59.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.592+0000 7fac79400640 1 -- 172.21.15.173:0/2164525920 >> v1:172.21.15.194:6789/0 conn(0x7fac7406bca0 legacy=0x7fac7406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:59.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.592+0000 7fac79400640 1 -- 172.21.15.173:0/2164525920 >> v1:172.21.15.173:6789/0 conn(0x7fac7406dac0 legacy=0x7fac740ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.592+0000 7fac79400640 1 -- 172.21.15.173:0/2164525920 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7406e280 con 0x7fac74160fe0 2024-04-25T09:13:59.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.592+0000 7fac73e00640 1 -- 172.21.15.173:0/2164525920 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215633855 0 0) 0x7fac60001120 con 0x7fac7406dac0 2024-04-25T09:13:59.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.596+0000 7fac79400640 1 --2- 172.21.15.173:0/2164525920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac74160fe0 0x7fac74161fb0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7fac68009d90 tx=0x7fac6801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8911aea1ab7b7753 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:59.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.596+0000 7fac73e00640 1 -- 172.21.15.173:0/2164525920 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac680b2070 con 0x7fac74160fe0 2024-04-25T09:13:59.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.596+0000 7fac73e00640 1 -- 172.21.15.173:0/2164525920 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac680a5760 con 0x7fac74160fe0 2024-04-25T09:13:59.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.596+0000 7fac73e00640 1 -- 172.21.15.173:0/2164525920 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac680a5b30 con 0x7fac74160fe0 2024-04-25T09:13:59.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.596+0000 7fac7be00640 1 -- 172.21.15.173:0/2164525920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac74160fe0 msgr2=0x7fac74161fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.596+0000 7fac7be00640 1 --2- 172.21.15.173:0/2164525920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac74160fe0 0x7fac74161fb0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7fac68009d90 tx=0x7fac6801c8a0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.596+0000 7fac7be00640 1 -- 172.21.15.173:0/2164525920 shutdown_connections 2024-04-25T09:13:59.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.596+0000 7fac7be00640 1 --2- 172.21.15.173:0/2164525920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac74160fe0 0x7fac74161fb0 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.596+0000 7fac7be00640 1 -- 172.21.15.173:0/2164525920 >> 172.21.15.173:0/2164525920 conn(0x7fac74071c20 msgr2=0x7fac74072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:59.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.596+0000 7fac7be00640 1 -- 172.21.15.173:0/2164525920 shutdown_connections 2024-04-25T09:13:59.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.596+0000 7fac7be00640 1 -- 172.21.15.173:0/2164525920 wait complete. 2024-04-25T09:13:59.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac7be00640 1 Processor -- start 2024-04-25T09:13:59.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac7be00640 1 -- start start 2024-04-25T09:13:59.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac7be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac7406bca0 0x7fac7415e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac7be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac7406dac0 0x7fac74146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac7be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac74160fe0 0x7fac74144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac7be00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7406c540 con 0x7fac7406bca0 2024-04-25T09:13:59.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac7be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac741624f0 con 0x7fac74160fe0 2024-04-25T09:13:59.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac7be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7416c1b0 con 0x7fac7406dac0 2024-04-25T09:13:59.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac79400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac7406bca0 0x7fac7415e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac79400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac7406bca0 0x7fac7415e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34906/0 (socket says 172.21.15.173:34906) 2024-04-25T09:13:59.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac79400640 1 -- 172.21.15.173:0/3489762925 learned_addr learned my addr 172.21.15.173:0/3489762925 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:59.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac79e00640 1 --2- 172.21.15.173:0/3489762925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac74160fe0 0x7fac74144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac78a00640 1 --2- 172.21.15.173:0/3489762925 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac7406dac0 0x7fac74146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac79400640 1 -- 172.21.15.173:0/3489762925 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac7406dac0 msgr2=0x7fac74146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac79400640 1 --2- 172.21.15.173:0/3489762925 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac7406dac0 0x7fac74146110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac79400640 1 -- 172.21.15.173:0/3489762925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac74160fe0 msgr2=0x7fac74144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac79400640 1 --2- 172.21.15.173:0/3489762925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac74160fe0 0x7fac74144910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac79400640 1 -- 172.21.15.173:0/3489762925 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7415ebe0 con 0x7fac7406bca0 2024-04-25T09:13:59.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac79e00640 1 --2- 172.21.15.173:0/3489762925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac74160fe0 0x7fac74144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:59.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac79400640 1 --2- 172.21.15.173:0/3489762925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac7406bca0 0x7fac7415e600 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7fac680194b0 tx=0x7fac68019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:59.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac71600640 1 -- 172.21.15.173:0/3489762925 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac680bd020 con 0x7fac7406bca0 2024-04-25T09:13:59.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac71600640 1 -- 172.21.15.173:0/3489762925 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac680b8670 con 0x7fac7406bca0 2024-04-25T09:13:59.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac71600640 1 -- 172.21.15.173:0/3489762925 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac680b2040 con 0x7fac7406bca0 2024-04-25T09:13:59.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac7be00640 1 -- 172.21.15.173:0/3489762925 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac74145350 con 0x7fac7406bca0 2024-04-25T09:13:59.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.600+0000 7fac7be00640 1 -- 172.21.15.173:0/3489762925 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac74145910 con 0x7fac7406bca0 2024-04-25T09:13:59.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.604+0000 7fac7be00640 1 -- 172.21.15.173:0/3489762925 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac74073a40 con 0x7fac7406bca0 2024-04-25T09:13:59.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.604+0000 7fac71600640 1 -- 172.21.15.173:0/3489762925 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fac680c0020 con 0x7fac7406bca0 2024-04-25T09:13:59.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.604+0000 7fac71600640 1 --2- 172.21.15.173:0/3489762925 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fac54066f90 0x7fac54069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.604+0000 7fac71600640 1 -- 172.21.15.173:0/3489762925 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fac6811ff60 con 0x7fac7406bca0 2024-04-25T09:13:59.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.604+0000 7fac78a00640 1 --2- 172.21.15.173:0/3489762925 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fac54066f90 0x7fac54069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.604+0000 7fac78a00640 1 --2- 172.21.15.173:0/3489762925 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fac54066f90 0x7fac54069450 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fac60007fd0 tx=0x7fac60007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:59.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.608+0000 7fac71600640 1 -- 172.21.15.173:0/3489762925 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fac680c7070 con 0x7fac7406bca0 2024-04-25T09:13:59.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.760+0000 7fac7be00640 1 -- 172.21.15.173:0/3489762925 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac740cf6c0 con 0x7fac54066f90 2024-04-25T09:13:59.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.768+0000 7fac71600640 1 -- 172.21.15.173:0/3489762925 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+242993 (secure 0 0 0) 0x7fac740cf6c0 con 0x7fac54066f90 2024-04-25T09:13:59.756 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:13:59.757 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:13:59.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.772+0000 7fac7be00640 1 -- 172.21.15.173:0/3489762925 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fac54066f90 msgr2=0x7fac54069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.772+0000 7fac7be00640 1 --2- 172.21.15.173:0/3489762925 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fac54066f90 0x7fac54069450 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fac60007fd0 tx=0x7fac60007980 comp rx=0 tx=0).stop 2024-04-25T09:13:59.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.772+0000 7fac7be00640 1 -- 172.21.15.173:0/3489762925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac7406bca0 msgr2=0x7fac7415e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.772+0000 7fac7be00640 1 --2- 172.21.15.173:0/3489762925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac7406bca0 0x7fac7415e600 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7fac680194b0 tx=0x7fac68019640 comp rx=0 tx=0).stop 2024-04-25T09:13:59.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.772+0000 7fac7be00640 1 -- 172.21.15.173:0/3489762925 shutdown_connections 2024-04-25T09:13:59.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.772+0000 7fac7be00640 1 --2- 172.21.15.173:0/3489762925 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fac54066f90 0x7fac54069450 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.772+0000 7fac7be00640 1 --2- 172.21.15.173:0/3489762925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac74160fe0 0x7fac74144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.772+0000 7fac7be00640 1 --2- 172.21.15.173:0/3489762925 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac7406dac0 0x7fac74146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.772+0000 7fac7be00640 1 --2- 172.21.15.173:0/3489762925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac7406bca0 0x7fac7415e600 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.772+0000 7fac7be00640 1 -- 172.21.15.173:0/3489762925 >> 172.21.15.173:0/3489762925 conn(0x7fac74071c20 msgr2=0x7fac740b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:59.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.772+0000 7fac7be00640 1 -- 172.21.15.173:0/3489762925 shutdown_connections 2024-04-25T09:13:59.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.772+0000 7fac7be00640 1 -- 172.21.15.173:0/3489762925 wait complete. 2024-04-25T09:13:59.776 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":478,"stamp":"2024-04-25T09:13:58.875509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":170,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":92,"acting":92,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":472512,"kb_used_data":14932,"kb_used_omap":12,"kb_used_meta":457459,"kb_avail":754502208,"statfs":{"total":773094113280,"available":772610260992,"internally_reserved":0,"allocated":15290368,"data_stored":7737561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":468438576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.180967"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717953+0000","last_change":"2024-04-25T09:13:55.742900+0000","last_active":"2024-04-25T09:13:56.717953+0000","last_peered":"2024-04-25T09:13:56.717953+0000","last_clean":"2024-04-25T09:13:56.717953+0000","last_became_active":"2024-04-25T09:13:55.742544+0000","last_became_peered":"2024-04-25T09:13:55.742544+0000","last_unstale":"2024-04-25T09:13:56.717953+0000","last_undegraded":"2024-04-25T09:13:56.717953+0000","last_fullsized":"2024-04-25T09:13:56.717953+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:41.376893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718028+0000","last_change":"2024-04-25T09:13:55.722825+0000","last_active":"2024-04-25T09:13:56.718028+0000","last_peered":"2024-04-25T09:13:56.718028+0000","last_clean":"2024-04-25T09:13:56.718028+0000","last_became_active":"2024-04-25T09:13:55.722426+0000","last_became_peered":"2024-04-25T09:13:55.722426+0000","last_unstale":"2024-04-25T09:13:56.718028+0000","last_undegraded":"2024-04-25T09:13:56.718028+0000","last_fullsized":"2024-04-25T09:13:56.718028+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:22.040179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747436+0000","last_change":"2024-04-25T09:13:55.746333+0000","last_active":"2024-04-25T09:13:56.747436+0000","last_peered":"2024-04-25T09:13:56.747436+0000","last_clean":"2024-04-25T09:13:56.747436+0000","last_became_active":"2024-04-25T09:13:55.742104+0000","last_became_peered":"2024-04-25T09:13:55.742104+0000","last_unstale":"2024-04-25T09:13:56.747436+0000","last_undegraded":"2024-04-25T09:13:56.747436+0000","last_fullsized":"2024-04-25T09:13:56.747436+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:42.683250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717775+0000","last_change":"2024-04-25T09:13:55.730791+0000","last_active":"2024-04-25T09:13:56.717775+0000","last_peered":"2024-04-25T09:13:56.717775+0000","last_clean":"2024-04-25T09:13:56.717775+0000","last_became_active":"2024-04-25T09:13:55.730465+0000","last_became_peered":"2024-04-25T09:13:55.730465+0000","last_unstale":"2024-04-25T09:13:56.717775+0000","last_undegraded":"2024-04-25T09:13:56.717775+0000","last_fullsized":"2024-04-25T09:13:56.717775+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:17.012203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717921+0000","last_change":"2024-04-25T09:13:55.719281+0000","last_active":"2024-04-25T09:13:56.717921+0000","last_peered":"2024-04-25T09:13:56.717921+0000","last_clean":"2024-04-25T09:13:56.717921+0000","last_became_active":"2024-04-25T09:13:55.718404+0000","last_became_peered":"2024-04-25T09:13:55.718404+0000","last_unstale":"2024-04-25T09:13:56.717921+0000","last_undegraded":"2024-04-25T09:13:56.717921+0000","last_fullsized":"2024-04-25T09:13:56.717921+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:38.672115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717841+0000","last_change":"2024-04-25T09:13:55.728441+0000","last_active":"2024-04-25T09:13:56.717841+0000","last_peered":"2024-04-25T09:13:56.717841+0000","last_clean":"2024-04-25T09:13:56.717841+0000","last_became_active":"2024-04-25T09:13:55.727618+0000","last_became_peered":"2024-04-25T09:13:55.727618+0000","last_unstale":"2024-04-25T09:13:56.717841+0000","last_undegraded":"2024-04-25T09:13:56.717841+0000","last_fullsized":"2024-04-25T09:13:56.717841+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:00.943778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702653+0000","last_change":"2024-04-25T09:13:53.702653+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702653+0000","last_undegraded":"2024-04-25T09:13:53.702653+0000","last_fullsized":"2024-04-25T09:13:53.702653+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747249+0000","last_change":"2024-04-25T09:13:54.714659+0000","last_active":"2024-04-25T09:13:56.747249+0000","last_peered":"2024-04-25T09:13:56.747249+0000","last_clean":"2024-04-25T09:13:56.747249+0000","last_became_active":"2024-04-25T09:13:54.713833+0000","last_became_peered":"2024-04-25T09:13:54.713833+0000","last_unstale":"2024-04-25T09:13:56.747249+0000","last_undegraded":"2024-04-25T09:13:56.747249+0000","last_fullsized":"2024-04-25T09:13:56.747249+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:08.263244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747551+0000","last_change":"2024-04-25T09:13:54.715020+0000","last_active":"2024-04-25T09:13:56.747551+0000","last_peered":"2024-04-25T09:13:56.747551+0000","last_clean":"2024-04-25T09:13:56.747551+0000","last_became_active":"2024-04-25T09:13:54.714699+0000","last_became_peered":"2024-04-25T09:13:54.714699+0000","last_unstale":"2024-04-25T09:13:56.747551+0000","last_undegraded":"2024-04-25T09:13:56.747551+0000","last_fullsized":"2024-04-25T09:13:56.747551+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:05.091617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747414+0000","last_change":"2024-04-25T09:13:55.742805+0000","last_active":"2024-04-25T09:13:56.747414+0000","last_peered":"2024-04-25T09:13:56.747414+0000","last_clean":"2024-04-25T09:13:56.747414+0000","last_became_active":"2024-04-25T09:13:55.742529+0000","last_became_peered":"2024-04-25T09:13:55.742529+0000","last_unstale":"2024-04-25T09:13:56.747414+0000","last_undegraded":"2024-04-25T09:13:56.747414+0000","last_fullsized":"2024-04-25T09:13:56.747414+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:38.099089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.704056+0000","last_change":"2024-04-25T09:13:53.704056+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.704056+0000","last_undegraded":"2024-04-25T09:13:53.704056+0000","last_fullsized":"2024-04-25T09:13:53.704056+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.693480+0000","last_change":"2024-04-25T09:13:53.693480+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.693480+0000","last_undegraded":"2024-04-25T09:13:53.693480+0000","last_fullsized":"2024-04-25T09:13:53.693480+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.703668+0000","last_change":"2024-04-25T09:13:53.703668+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.703668+0000","last_undegraded":"2024-04-25T09:13:53.703668+0000","last_fullsized":"2024-04-25T09:13:53.703668+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.699625+0000","last_change":"2024-04-25T09:13:53.699625+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.699625+0000","last_undegraded":"2024-04-25T09:13:53.699625+0000","last_fullsized":"2024-04-25T09:13:53.699625+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702794+0000","last_change":"2024-04-25T09:13:53.702794+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702794+0000","last_undegraded":"2024-04-25T09:13:53.702794+0000","last_fullsized":"2024-04-25T09:13:53.702794+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747374+0000","last_change":"2024-04-25T09:13:54.706537+0000","last_active":"2024-04-25T09:13:56.747374+0000","last_peered":"2024-04-25T09:13:56.747374+0000","last_clean":"2024-04-25T09:13:56.747374+0000","last_became_active":"2024-04-25T09:13:54.706228+0000","last_became_peered":"2024-04-25T09:13:54.706228+0000","last_unstale":"2024-04-25T09:13:56.747374+0000","last_undegraded":"2024-04-25T09:13:56.747374+0000","last_fullsized":"2024-04-25T09:13:56.747374+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:01.382832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717999+0000","last_change":"2024-04-25T09:13:55.742803+0000","last_active":"2024-04-25T09:13:56.717999+0000","last_peered":"2024-04-25T09:13:56.717999+0000","last_clean":"2024-04-25T09:13:56.717999+0000","last_became_active":"2024-04-25T09:13:55.742513+0000","last_became_peered":"2024-04-25T09:13:55.742513+0000","last_unstale":"2024-04-25T09:13:56.717999+0000","last_undegraded":"2024-04-25T09:13:56.717999+0000","last_fullsized":"2024-04-25T09:13:56.717999+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:16.713216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.699705+0000","last_change":"2024-04-25T09:13:53.699705+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.699705+0000","last_undegraded":"2024-04-25T09:13:53.699705+0000","last_fullsized":"2024-04-25T09:13:53.699705+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718134+0000","last_change":"2024-04-25T09:13:55.720321+0000","last_active":"2024-04-25T09:13:56.718134+0000","last_peered":"2024-04-25T09:13:56.718134+0000","last_clean":"2024-04-25T09:13:56.718134+0000","last_became_active":"2024-04-25T09:13:55.719998+0000","last_became_peered":"2024-04-25T09:13:55.719998+0000","last_unstale":"2024-04-25T09:13:56.718134+0000","last_undegraded":"2024-04-25T09:13:56.718134+0000","last_fullsized":"2024-04-25T09:13:56.718134+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:11.054761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"143'3","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718015+0000","last_change":"2024-04-25T09:13:54.716928+0000","last_active":"2024-04-25T09:13:56.718015+0000","last_peered":"2024-04-25T09:13:56.718015+0000","last_clean":"2024-04-25T09:13:56.718015+0000","last_became_active":"2024-04-25T09:13:54.716645+0000","last_became_peered":"2024-04-25T09:13:54.716645+0000","last_unstale":"2024-04-25T09:13:56.718015+0000","last_undegraded":"2024-04-25T09:13:56.718015+0000","last_fullsized":"2024-04-25T09:13:56.718015+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:04.981253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.703370+0000","last_change":"2024-04-25T09:13:53.703370+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.703370+0000","last_undegraded":"2024-04-25T09:13:53.703370+0000","last_fullsized":"2024-04-25T09:13:53.703370+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.698028+0000","last_change":"2024-04-25T09:13:53.698028+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.698028+0000","last_undegraded":"2024-04-25T09:13:53.698028+0000","last_fullsized":"2024-04-25T09:13:53.698028+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.696707+0000","last_change":"2024-04-25T09:13:53.696707+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.696707+0000","last_undegraded":"2024-04-25T09:13:53.696707+0000","last_fullsized":"2024-04-25T09:13:53.696707+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.698682+0000","last_change":"2024-04-25T09:13:53.698682+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.698682+0000","last_undegraded":"2024-04-25T09:13:53.698682+0000","last_fullsized":"2024-04-25T09:13:53.698682+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747260+0000","last_change":"2024-04-25T09:13:55.738271+0000","last_active":"2024-04-25T09:13:56.747260+0000","last_peered":"2024-04-25T09:13:56.747260+0000","last_clean":"2024-04-25T09:13:56.747260+0000","last_became_active":"2024-04-25T09:13:55.737962+0000","last_became_peered":"2024-04-25T09:13:55.737962+0000","last_unstale":"2024-04-25T09:13:56.747260+0000","last_undegraded":"2024-04-25T09:13:56.747260+0000","last_fullsized":"2024-04-25T09:13:56.747260+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:05.725971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718057+0000","last_change":"2024-04-25T09:13:54.715032+0000","last_active":"2024-04-25T09:13:56.718057+0000","last_peered":"2024-04-25T09:13:56.718057+0000","last_clean":"2024-04-25T09:13:56.718057+0000","last_became_active":"2024-04-25T09:13:54.714755+0000","last_became_peered":"2024-04-25T09:13:54.714755+0000","last_unstale":"2024-04-25T09:13:56.718057+0000","last_undegraded":"2024-04-25T09:13:56.718057+0000","last_fullsized":"2024-04-25T09:13:56.718057+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:19.649135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747476+0000","last_change":"2024-04-25T09:13:55.746491+0000","last_active":"2024-04-25T09:13:56.747476+0000","last_peered":"2024-04-25T09:13:56.747476+0000","last_clean":"2024-04-25T09:13:56.747476+0000","last_became_active":"2024-04-25T09:13:55.743362+0000","last_became_peered":"2024-04-25T09:13:55.743362+0000","last_unstale":"2024-04-25T09:13:56.747476+0000","last_undegraded":"2024-04-25T09:13:56.747476+0000","last_fullsized":"2024-04-25T09:13:56.747476+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:51.119070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747297+0000","last_change":"2024-04-25T09:13:54.714838+0000","last_active":"2024-04-25T09:13:56.747297+0000","last_peered":"2024-04-25T09:13:56.747297+0000","last_clean":"2024-04-25T09:13:56.747297+0000","last_became_active":"2024-04-25T09:13:54.714346+0000","last_became_peered":"2024-04-25T09:13:54.714346+0000","last_unstale":"2024-04-25T09:13:56.747297+0000","last_undegraded":"2024-04-25T09:13:56.747297+0000","last_fullsized":"2024-04-25T09:13:56.747297+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:13.989630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.704335+0000","last_change":"2024-04-25T09:13:53.704335+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.704335+0000","last_undegraded":"2024-04-25T09:13:53.704335+0000","last_fullsized":"2024-04-25T09:13:53.704335+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.696538+0000","last_change":"2024-04-25T09:13:53.696538+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.696538+0000","last_undegraded":"2024-04-25T09:13:53.696538+0000","last_fullsized":"2024-04-25T09:13:53.696538+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747044+0000","last_change":"2024-04-25T09:13:55.741720+0000","last_active":"2024-04-25T09:13:56.747044+0000","last_peered":"2024-04-25T09:13:56.747044+0000","last_clean":"2024-04-25T09:13:56.747044+0000","last_became_active":"2024-04-25T09:13:55.739951+0000","last_became_peered":"2024-04-25T09:13:55.739951+0000","last_unstale":"2024-04-25T09:13:56.747044+0000","last_undegraded":"2024-04-25T09:13:56.747044+0000","last_fullsized":"2024-04-25T09:13:56.747044+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:58.698810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702706+0000","last_change":"2024-04-25T09:13:53.702706+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702706+0000","last_undegraded":"2024-04-25T09:13:53.702706+0000","last_fullsized":"2024-04-25T09:13:53.702706+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.693528+0000","last_change":"2024-04-25T09:13:53.693528+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.693528+0000","last_undegraded":"2024-04-25T09:13:53.693528+0000","last_fullsized":"2024-04-25T09:13:53.693528+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747176+0000","last_change":"2024-04-25T09:13:55.734783+0000","last_active":"2024-04-25T09:13:56.747176+0000","last_peered":"2024-04-25T09:13:56.747176+0000","last_clean":"2024-04-25T09:13:56.747176+0000","last_became_active":"2024-04-25T09:13:55.734488+0000","last_became_peered":"2024-04-25T09:13:55.734488+0000","last_unstale":"2024-04-25T09:13:56.747176+0000","last_undegraded":"2024-04-25T09:13:56.747176+0000","last_fullsized":"2024-04-25T09:13:56.747176+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:08.088176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702870+0000","last_change":"2024-04-25T09:13:53.702870+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702870+0000","last_undegraded":"2024-04-25T09:13:53.702870+0000","last_fullsized":"2024-04-25T09:13:53.702870+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.693458+0000","last_change":"2024-04-25T09:13:53.693458+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.693458+0000","last_undegraded":"2024-04-25T09:13:53.693458+0000","last_fullsized":"2024-04-25T09:13:53.693458+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.696748+0000","last_change":"2024-04-25T09:13:53.696748+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.696748+0000","last_undegraded":"2024-04-25T09:13:53.696748+0000","last_fullsized":"2024-04-25T09:13:53.696748+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.698900+0000","last_change":"2024-04-25T09:13:53.698900+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.698900+0000","last_undegraded":"2024-04-25T09:13:53.698900+0000","last_fullsized":"2024-04-25T09:13:53.698900+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702401+0000","last_change":"2024-04-25T09:13:53.702401+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702401+0000","last_undegraded":"2024-04-25T09:13:53.702401+0000","last_fullsized":"2024-04-25T09:13:53.702401+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702622+0000","last_change":"2024-04-25T09:13:53.702622+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702622+0000","last_undegraded":"2024-04-25T09:13:53.702622+0000","last_fullsized":"2024-04-25T09:13:53.702622+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.698646+0000","last_change":"2024-04-25T09:13:53.698646+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.698646+0000","last_undegraded":"2024-04-25T09:13:53.698646+0000","last_fullsized":"2024-04-25T09:13:53.698646+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717763+0000","last_change":"2024-04-25T09:13:54.714803+0000","last_active":"2024-04-25T09:13:56.717763+0000","last_peered":"2024-04-25T09:13:56.717763+0000","last_clean":"2024-04-25T09:13:56.717763+0000","last_became_active":"2024-04-25T09:13:54.714545+0000","last_became_peered":"2024-04-25T09:13:54.714545+0000","last_unstale":"2024-04-25T09:13:56.717763+0000","last_undegraded":"2024-04-25T09:13:56.717763+0000","last_fullsized":"2024-04-25T09:13:56.717763+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:03.583888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.698666+0000","last_change":"2024-04-25T09:13:53.698666+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.698666+0000","last_undegraded":"2024-04-25T09:13:53.698666+0000","last_fullsized":"2024-04-25T09:13:53.698666+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.746962+0000","last_change":"2024-04-25T09:13:54.717287+0000","last_active":"2024-04-25T09:13:56.746962+0000","last_peered":"2024-04-25T09:13:56.746962+0000","last_clean":"2024-04-25T09:13:56.746962+0000","last_became_active":"2024-04-25T09:13:54.716916+0000","last_became_peered":"2024-04-25T09:13:54.716916+0000","last_unstale":"2024-04-25T09:13:56.746962+0000","last_undegraded":"2024-04-25T09:13:56.746962+0000","last_fullsized":"2024-04-25T09:13:56.746962+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:57.944637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702782+0000","last_change":"2024-04-25T09:13:53.702782+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702782+0000","last_undegraded":"2024-04-25T09:13:53.702782+0000","last_fullsized":"2024-04-25T09:13:53.702782+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":397,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747058+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:13:56.747058+0000","last_peered":"2024-04-25T09:13:56.747058+0000","last_clean":"2024-04-25T09:13:56.747058+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:13:56.747058+0000","last_undegraded":"2024-04-25T09:13:56.747058+0000","last_fullsized":"2024-04-25T09:13:56.747058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":2},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55100,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316740,"statfs":{"total":96636764160,"available":96580341760,"internally_reserved":0,"allocated":1748992,"data_stored":812963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50936,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320904,"statfs":{"total":96636764160,"available":96584605696,"internally_reserved":0,"allocated":1748992,"data_stored":812963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63420,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308420,"statfs":{"total":96636764160,"available":96571822080,"internally_reserved":0,"allocated":1748992,"data_stored":812963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77252,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294588,"statfs":{"total":96636764160,"available":96557658112,"internally_reserved":0,"allocated":1761280,"data_stored":819172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77330887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509579,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55156,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316684,"statfs":{"total":96636764160,"available":96580284416,"internally_reserved":0,"allocated":1806336,"data_stored":839810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55100,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316740,"statfs":{"total":96636764160,"available":96580341760,"internally_reserved":0,"allocated":1748992,"data_stored":812963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59836,"kb_used_data":2288,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312004,"statfs":{"total":96636764160,"available":96575492096,"internally_reserved":0,"allocated":2342912,"data_stored":1403331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574987,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55712,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316128,"statfs":{"total":96636764160,"available":96579715072,"internally_reserved":0,"allocated":2383872,"data_stored":1423396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:13:59.780 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:13:59.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.968+0000 7f1b40400640 1 Processor -- start 2024-04-25T09:13:59.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.968+0000 7f1b40400640 1 -- start start 2024-04-25T09:13:59.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b40400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1b380b3e70 0x7f1b380b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b40400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b380b3590 con 0x7f1b3815edd0 2024-04-25T09:13:59.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b40400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b380b4790 con 0x7f1b380aefa0 2024-04-25T09:13:59.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b40400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3806dd50 con 0x7f1b380b3e70 2024-04-25T09:13:59.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b3e400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f1b3815edd0 0x7f1b380b2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:55756/0 (socket says 172.21.15.173:55756) 2024-04-25T09:13:59.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b3e400640 1 -- 172.21.15.173:0/88242505 learned_addr learned my addr 172.21.15.173:0/88242505 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:13:59.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b3da00640 1 --2- 172.21.15.173:0/88242505 >> v2:172.21.15.194:3300/0 conn(0x7f1b380b3e70 0x7f1b380b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b37e00640 1 -- 172.21.15.173:0/88242505 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292886660 0 0) 0x7f1b380b3590 con 0x7f1b3815edd0 2024-04-25T09:13:59.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b37e00640 1 -- 172.21.15.173:0/88242505 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b20003530 con 0x7f1b3815edd0 2024-04-25T09:13:59.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b37e00640 1 -- 172.21.15.173:0/88242505 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 704782950 0 0) 0x7f1b20003530 con 0x7f1b3815edd0 2024-04-25T09:13:59.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b37e00640 1 -- 172.21.15.173:0/88242505 >> v2:172.21.15.194:3300/0 conn(0x7f1b380b3e70 msgr2=0x7f1b380b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:59.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b37e00640 1 --2- 172.21.15.173:0/88242505 >> v2:172.21.15.194:3300/0 conn(0x7f1b380b3e70 0x7f1b380b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b37e00640 1 -- 172.21.15.173:0/88242505 >> v1:172.21.15.194:6789/0 conn(0x7f1b380aefa0 legacy=0x7f1b380b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b37e00640 1 -- 172.21.15.173:0/88242505 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3815f320 con 0x7f1b3815edd0 2024-04-25T09:13:59.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b37e00640 1 -- 172.21.15.173:0/88242505 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f1b30001a00 con 0x7f1b3815edd0 2024-04-25T09:13:59.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b37e00640 1 -- 172.21.15.173:0/88242505 >> v1:172.21.15.173:6789/0 conn(0x7f1b3815edd0 legacy=0x7f1b380b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b37e00640 1 --2- 172.21.15.173:0/88242505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b200039c0 0x7f1b20003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b37e00640 1 --2- 172.21.15.173:0/88242505 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b20004810 0x7f1b20004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b37e00640 1 --2- 172.21.15.173:0/88242505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b200051d0 0x7f1b2000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b37e00640 1 -- 172.21.15.173:0/88242505 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3806dd50 con 0x7f1b200051d0 2024-04-25T09:13:59.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b37e00640 1 -- 172.21.15.173:0/88242505 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2000c070 con 0x7f1b200039c0 2024-04-25T09:13:59.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b37e00640 1 -- 172.21.15.173:0/88242505 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2000c270 con 0x7f1b20004810 2024-04-25T09:13:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b3da00640 1 --2- 172.21.15.173:0/88242505 >> v2:172.21.15.194:3300/0 conn(0x7f1b380b3e70 0x7f1b380b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b3e400640 1 --2- 172.21.15.173:0/88242505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b200051d0 0x7f1b2000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b3d000640 1 --2- 172.21.15.173:0/88242505 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b20004810 0x7f1b20004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b3da00640 1 --2- 172.21.15.173:0/88242505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b200039c0 0x7f1b20003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b3e400640 1 -- 172.21.15.173:0/88242505 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b20004810 msgr2=0x7f1b20004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b3e400640 1 --2- 172.21.15.173:0/88242505 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b20004810 0x7f1b20004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b3e400640 1 -- 172.21.15.173:0/88242505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b200039c0 msgr2=0x7f1b20003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b3e400640 1 --2- 172.21.15.173:0/88242505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b200039c0 0x7f1b20003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b3e400640 1 -- 172.21.15.173:0/88242505 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b20003530 con 0x7f1b200051d0 2024-04-25T09:13:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.972+0000 7f1b3da00640 1 --2- 172.21.15.173:0/88242505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b200039c0 0x7f1b20003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.976+0000 7f1b3e400640 1 -- 172.21.15.173:0/88242505 reap_dead start 2024-04-25T09:13:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.976+0000 7f1b3e400640 1 --2- 172.21.15.173:0/88242505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b200051d0 0x7f1b2000b9d0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000a840 tx=0x7f1b3001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef1e28618d9717f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.976+0000 7f1b37e00640 1 -- 172.21.15.173:0/88242505 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3000a460 con 0x7f1b200051d0 2024-04-25T09:13:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.976+0000 7f1b37e00640 1 -- 172.21.15.173:0/88242505 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b300ac640 con 0x7f1b200051d0 2024-04-25T09:13:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.976+0000 7f1b37e00640 1 -- 172.21.15.173:0/88242505 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b300aca30 con 0x7f1b200051d0 2024-04-25T09:13:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.976+0000 7f1b40400640 1 -- 172.21.15.173:0/88242505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b200051d0 msgr2=0x7f1b2000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.976+0000 7f1b40400640 1 --2- 172.21.15.173:0/88242505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b200051d0 0x7f1b2000b9d0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000a840 tx=0x7f1b3001d360 comp rx=0 tx=0).stop 2024-04-25T09:13:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.976+0000 7f1b40400640 1 -- 172.21.15.173:0/88242505 shutdown_connections 2024-04-25T09:13:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.976+0000 7f1b40400640 1 --2- 172.21.15.173:0/88242505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b200051d0 0x7f1b2000b9d0 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.976+0000 7f1b40400640 1 -- 172.21.15.173:0/88242505 >> 172.21.15.173:0/88242505 conn(0x7f1b3806ac90 msgr2=0x7f1b3806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.976+0000 7f1b40400640 1 -- 172.21.15.173:0/88242505 shutdown_connections 2024-04-25T09:13:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.976+0000 7f1b40400640 1 -- 172.21.15.173:0/88242505 wait complete. 2024-04-25T09:13:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.976+0000 7f1b40400640 1 Processor -- start 2024-04-25T09:13:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.976+0000 7f1b40400640 1 -- start start 2024-04-25T09:13:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b40400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b200051d0 0x7f1b38158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b40400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b3815d370 0x7f1b38157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b40400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b3814b1b0 0x7f1b38155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b40400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3806d9e0 con 0x7f1b200051d0 2024-04-25T09:13:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b40400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3806d700 con 0x7f1b3814b1b0 2024-04-25T09:13:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b40400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3815aba0 con 0x7f1b3815d370 2024-04-25T09:13:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b3da00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b200051d0 0x7f1b38158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b3da00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b200051d0 0x7f1b38158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34922/0 (socket says 172.21.15.173:34922) 2024-04-25T09:13:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b3da00640 1 -- 172.21.15.173:0/3958558228 learned_addr learned my addr 172.21.15.173:0/3958558228 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:13:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b3e400640 1 --2- 172.21.15.173:0/3958558228 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b3814b1b0 0x7f1b38155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b3d000640 1 --2- 172.21.15.173:0/3958558228 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b3815d370 0x7f1b38157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b3da00640 1 -- 172.21.15.173:0/3958558228 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b3815d370 msgr2=0x7f1b38157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b3da00640 1 --2- 172.21.15.173:0/3958558228 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b3815d370 0x7f1b38157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b3da00640 1 -- 172.21.15.173:0/3958558228 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b3814b1b0 msgr2=0x7f1b38155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b3da00640 1 --2- 172.21.15.173:0/3958558228 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b3814b1b0 0x7f1b38155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b3da00640 1 -- 172.21.15.173:0/3958558228 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b381578e0 con 0x7f1b200051d0 2024-04-25T09:13:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b3d000640 1 --2- 172.21.15.173:0/3958558228 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b3815d370 0x7f1b38157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:59.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b3da00640 1 --2- 172.21.15.173:0/3958558228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b200051d0 0x7f1b38158980 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c010920 tx=0x7f1b2c010de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:59.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b35600640 1 -- 172.21.15.173:0/3958558228 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c00f040 con 0x7f1b200051d0 2024-04-25T09:13:59.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b35600640 1 -- 172.21.15.173:0/3958558228 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c00ec40 con 0x7f1b200051d0 2024-04-25T09:13:59.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b35600640 1 -- 172.21.15.173:0/3958558228 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c01c400 con 0x7f1b200051d0 2024-04-25T09:13:59.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b40400640 1 -- 172.21.15.173:0/3958558228 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b38157bc0 con 0x7f1b200051d0 2024-04-25T09:13:59.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b40400640 1 -- 172.21.15.173:0/3958558228 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b38158180 con 0x7f1b200051d0 2024-04-25T09:13:59.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.980+0000 7f1b40400640 1 -- 172.21.15.173:0/3958558228 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b38073a40 con 0x7f1b200051d0 2024-04-25T09:13:59.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.984+0000 7f1b35600640 1 -- 172.21.15.173:0/3958558228 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1b2c01c5c0 con 0x7f1b200051d0 2024-04-25T09:13:59.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.984+0000 7f1b35600640 1 --2- 172.21.15.173:0/3958558228 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1b18066f90 0x7f1b18069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.984+0000 7f1b35600640 1 -- 172.21.15.173:0/3958558228 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1b2c085830 con 0x7f1b200051d0 2024-04-25T09:13:59.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.984+0000 7f1b3d000640 1 --2- 172.21.15.173:0/3958558228 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1b18066f90 0x7f1b18069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.984+0000 7f1b3d000640 1 --2- 172.21.15.173:0/3958558228 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1b18066f90 0x7f1b18069450 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1b3815a5c0 tx=0x7f1b24009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:59.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:13:59.988+0000 7f1b35600640 1 -- 172.21.15.173:0/3958558228 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1b2c018030 con 0x7f1b200051d0 2024-04-25T09:14:00.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.156+0000 7f1b40400640 1 -- 172.21.15.173:0/3958558228 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b3806e540 con 0x7f1b18066f90 2024-04-25T09:14:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.160+0000 7f1b35600640 1 -- 172.21.15.173:0/3958558228 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+242993 (secure 0 0 0) 0x7f1b3806e540 con 0x7f1b18066f90 2024-04-25T09:14:00.149 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:00.151 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:14:00.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.164+0000 7f1b40400640 1 -- 172.21.15.173:0/3958558228 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1b18066f90 msgr2=0x7f1b18069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.164+0000 7f1b40400640 1 --2- 172.21.15.173:0/3958558228 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1b18066f90 0x7f1b18069450 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1b3815a5c0 tx=0x7f1b24009040 comp rx=0 tx=0).stop 2024-04-25T09:14:00.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.164+0000 7f1b40400640 1 -- 172.21.15.173:0/3958558228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b200051d0 msgr2=0x7f1b38158980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.164+0000 7f1b40400640 1 --2- 172.21.15.173:0/3958558228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b200051d0 0x7f1b38158980 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c010920 tx=0x7f1b2c010de0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.164+0000 7f1b40400640 1 -- 172.21.15.173:0/3958558228 shutdown_connections 2024-04-25T09:14:00.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.164+0000 7f1b40400640 1 --2- 172.21.15.173:0/3958558228 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1b18066f90 0x7f1b18069450 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.164+0000 7f1b40400640 1 --2- 172.21.15.173:0/3958558228 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b3814b1b0 0x7f1b38155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.164+0000 7f1b40400640 1 --2- 172.21.15.173:0/3958558228 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b3815d370 0x7f1b38157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.164+0000 7f1b40400640 1 --2- 172.21.15.173:0/3958558228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b200051d0 0x7f1b38158980 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.164+0000 7f1b40400640 1 -- 172.21.15.173:0/3958558228 >> 172.21.15.173:0/3958558228 conn(0x7f1b3806ac90 msgr2=0x7f1b38071320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:00.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.164+0000 7f1b40400640 1 -- 172.21.15.173:0/3958558228 shutdown_connections 2024-04-25T09:14:00.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.164+0000 7f1b40400640 1 -- 172.21.15.173:0/3958558228 wait complete. 2024-04-25T09:14:00.170 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":478,"stamp":"2024-04-25T09:13:58.875509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":170,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":92,"acting":92,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":472512,"kb_used_data":14932,"kb_used_omap":12,"kb_used_meta":457459,"kb_avail":754502208,"statfs":{"total":773094113280,"available":772610260992,"internally_reserved":0,"allocated":15290368,"data_stored":7737561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":468438576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.180967"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717953+0000","last_change":"2024-04-25T09:13:55.742900+0000","last_active":"2024-04-25T09:13:56.717953+0000","last_peered":"2024-04-25T09:13:56.717953+0000","last_clean":"2024-04-25T09:13:56.717953+0000","last_became_active":"2024-04-25T09:13:55.742544+0000","last_became_peered":"2024-04-25T09:13:55.742544+0000","last_unstale":"2024-04-25T09:13:56.717953+0000","last_undegraded":"2024-04-25T09:13:56.717953+0000","last_fullsized":"2024-04-25T09:13:56.717953+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:41.376893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718028+0000","last_change":"2024-04-25T09:13:55.722825+0000","last_active":"2024-04-25T09:13:56.718028+0000","last_peered":"2024-04-25T09:13:56.718028+0000","last_clean":"2024-04-25T09:13:56.718028+0000","last_became_active":"2024-04-25T09:13:55.722426+0000","last_became_peered":"2024-04-25T09:13:55.722426+0000","last_unstale":"2024-04-25T09:13:56.718028+0000","last_undegraded":"2024-04-25T09:13:56.718028+0000","last_fullsized":"2024-04-25T09:13:56.718028+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:22.040179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747436+0000","last_change":"2024-04-25T09:13:55.746333+0000","last_active":"2024-04-25T09:13:56.747436+0000","last_peered":"2024-04-25T09:13:56.747436+0000","last_clean":"2024-04-25T09:13:56.747436+0000","last_became_active":"2024-04-25T09:13:55.742104+0000","last_became_peered":"2024-04-25T09:13:55.742104+0000","last_unstale":"2024-04-25T09:13:56.747436+0000","last_undegraded":"2024-04-25T09:13:56.747436+0000","last_fullsized":"2024-04-25T09:13:56.747436+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:42.683250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717775+0000","last_change":"2024-04-25T09:13:55.730791+0000","last_active":"2024-04-25T09:13:56.717775+0000","last_peered":"2024-04-25T09:13:56.717775+0000","last_clean":"2024-04-25T09:13:56.717775+0000","last_became_active":"2024-04-25T09:13:55.730465+0000","last_became_peered":"2024-04-25T09:13:55.730465+0000","last_unstale":"2024-04-25T09:13:56.717775+0000","last_undegraded":"2024-04-25T09:13:56.717775+0000","last_fullsized":"2024-04-25T09:13:56.717775+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:17.012203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717921+0000","last_change":"2024-04-25T09:13:55.719281+0000","last_active":"2024-04-25T09:13:56.717921+0000","last_peered":"2024-04-25T09:13:56.717921+0000","last_clean":"2024-04-25T09:13:56.717921+0000","last_became_active":"2024-04-25T09:13:55.718404+0000","last_became_peered":"2024-04-25T09:13:55.718404+0000","last_unstale":"2024-04-25T09:13:56.717921+0000","last_undegraded":"2024-04-25T09:13:56.717921+0000","last_fullsized":"2024-04-25T09:13:56.717921+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:38.672115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717841+0000","last_change":"2024-04-25T09:13:55.728441+0000","last_active":"2024-04-25T09:13:56.717841+0000","last_peered":"2024-04-25T09:13:56.717841+0000","last_clean":"2024-04-25T09:13:56.717841+0000","last_became_active":"2024-04-25T09:13:55.727618+0000","last_became_peered":"2024-04-25T09:13:55.727618+0000","last_unstale":"2024-04-25T09:13:56.717841+0000","last_undegraded":"2024-04-25T09:13:56.717841+0000","last_fullsized":"2024-04-25T09:13:56.717841+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:00.943778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702653+0000","last_change":"2024-04-25T09:13:53.702653+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702653+0000","last_undegraded":"2024-04-25T09:13:53.702653+0000","last_fullsized":"2024-04-25T09:13:53.702653+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747249+0000","last_change":"2024-04-25T09:13:54.714659+0000","last_active":"2024-04-25T09:13:56.747249+0000","last_peered":"2024-04-25T09:13:56.747249+0000","last_clean":"2024-04-25T09:13:56.747249+0000","last_became_active":"2024-04-25T09:13:54.713833+0000","last_became_peered":"2024-04-25T09:13:54.713833+0000","last_unstale":"2024-04-25T09:13:56.747249+0000","last_undegraded":"2024-04-25T09:13:56.747249+0000","last_fullsized":"2024-04-25T09:13:56.747249+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:08.263244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747551+0000","last_change":"2024-04-25T09:13:54.715020+0000","last_active":"2024-04-25T09:13:56.747551+0000","last_peered":"2024-04-25T09:13:56.747551+0000","last_clean":"2024-04-25T09:13:56.747551+0000","last_became_active":"2024-04-25T09:13:54.714699+0000","last_became_peered":"2024-04-25T09:13:54.714699+0000","last_unstale":"2024-04-25T09:13:56.747551+0000","last_undegraded":"2024-04-25T09:13:56.747551+0000","last_fullsized":"2024-04-25T09:13:56.747551+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:05.091617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747414+0000","last_change":"2024-04-25T09:13:55.742805+0000","last_active":"2024-04-25T09:13:56.747414+0000","last_peered":"2024-04-25T09:13:56.747414+0000","last_clean":"2024-04-25T09:13:56.747414+0000","last_became_active":"2024-04-25T09:13:55.742529+0000","last_became_peered":"2024-04-25T09:13:55.742529+0000","last_unstale":"2024-04-25T09:13:56.747414+0000","last_undegraded":"2024-04-25T09:13:56.747414+0000","last_fullsized":"2024-04-25T09:13:56.747414+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:38.099089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.704056+0000","last_change":"2024-04-25T09:13:53.704056+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.704056+0000","last_undegraded":"2024-04-25T09:13:53.704056+0000","last_fullsized":"2024-04-25T09:13:53.704056+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.693480+0000","last_change":"2024-04-25T09:13:53.693480+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.693480+0000","last_undegraded":"2024-04-25T09:13:53.693480+0000","last_fullsized":"2024-04-25T09:13:53.693480+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.703668+0000","last_change":"2024-04-25T09:13:53.703668+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.703668+0000","last_undegraded":"2024-04-25T09:13:53.703668+0000","last_fullsized":"2024-04-25T09:13:53.703668+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.699625+0000","last_change":"2024-04-25T09:13:53.699625+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.699625+0000","last_undegraded":"2024-04-25T09:13:53.699625+0000","last_fullsized":"2024-04-25T09:13:53.699625+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702794+0000","last_change":"2024-04-25T09:13:53.702794+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702794+0000","last_undegraded":"2024-04-25T09:13:53.702794+0000","last_fullsized":"2024-04-25T09:13:53.702794+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747374+0000","last_change":"2024-04-25T09:13:54.706537+0000","last_active":"2024-04-25T09:13:56.747374+0000","last_peered":"2024-04-25T09:13:56.747374+0000","last_clean":"2024-04-25T09:13:56.747374+0000","last_became_active":"2024-04-25T09:13:54.706228+0000","last_became_peered":"2024-04-25T09:13:54.706228+0000","last_unstale":"2024-04-25T09:13:56.747374+0000","last_undegraded":"2024-04-25T09:13:56.747374+0000","last_fullsized":"2024-04-25T09:13:56.747374+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:01.382832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717999+0000","last_change":"2024-04-25T09:13:55.742803+0000","last_active":"2024-04-25T09:13:56.717999+0000","last_peered":"2024-04-25T09:13:56.717999+0000","last_clean":"2024-04-25T09:13:56.717999+0000","last_became_active":"2024-04-25T09:13:55.742513+0000","last_became_peered":"2024-04-25T09:13:55.742513+0000","last_unstale":"2024-04-25T09:13:56.717999+0000","last_undegraded":"2024-04-25T09:13:56.717999+0000","last_fullsized":"2024-04-25T09:13:56.717999+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:16.713216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.699705+0000","last_change":"2024-04-25T09:13:53.699705+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.699705+0000","last_undegraded":"2024-04-25T09:13:53.699705+0000","last_fullsized":"2024-04-25T09:13:53.699705+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718134+0000","last_change":"2024-04-25T09:13:55.720321+0000","last_active":"2024-04-25T09:13:56.718134+0000","last_peered":"2024-04-25T09:13:56.718134+0000","last_clean":"2024-04-25T09:13:56.718134+0000","last_became_active":"2024-04-25T09:13:55.719998+0000","last_became_peered":"2024-04-25T09:13:55.719998+0000","last_unstale":"2024-04-25T09:13:56.718134+0000","last_undegraded":"2024-04-25T09:13:56.718134+0000","last_fullsized":"2024-04-25T09:13:56.718134+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:11.054761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"143'3","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718015+0000","last_change":"2024-04-25T09:13:54.716928+0000","last_active":"2024-04-25T09:13:56.718015+0000","last_peered":"2024-04-25T09:13:56.718015+0000","last_clean":"2024-04-25T09:13:56.718015+0000","last_became_active":"2024-04-25T09:13:54.716645+0000","last_became_peered":"2024-04-25T09:13:54.716645+0000","last_unstale":"2024-04-25T09:13:56.718015+0000","last_undegraded":"2024-04-25T09:13:56.718015+0000","last_fullsized":"2024-04-25T09:13:56.718015+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:04.981253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.703370+0000","last_change":"2024-04-25T09:13:53.703370+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.703370+0000","last_undegraded":"2024-04-25T09:13:53.703370+0000","last_fullsized":"2024-04-25T09:13:53.703370+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.698028+0000","last_change":"2024-04-25T09:13:53.698028+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.698028+0000","last_undegraded":"2024-04-25T09:13:53.698028+0000","last_fullsized":"2024-04-25T09:13:53.698028+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.696707+0000","last_change":"2024-04-25T09:13:53.696707+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.696707+0000","last_undegraded":"2024-04-25T09:13:53.696707+0000","last_fullsized":"2024-04-25T09:13:53.696707+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.698682+0000","last_change":"2024-04-25T09:13:53.698682+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.698682+0000","last_undegraded":"2024-04-25T09:13:53.698682+0000","last_fullsized":"2024-04-25T09:13:53.698682+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747260+0000","last_change":"2024-04-25T09:13:55.738271+0000","last_active":"2024-04-25T09:13:56.747260+0000","last_peered":"2024-04-25T09:13:56.747260+0000","last_clean":"2024-04-25T09:13:56.747260+0000","last_became_active":"2024-04-25T09:13:55.737962+0000","last_became_peered":"2024-04-25T09:13:55.737962+0000","last_unstale":"2024-04-25T09:13:56.747260+0000","last_undegraded":"2024-04-25T09:13:56.747260+0000","last_fullsized":"2024-04-25T09:13:56.747260+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:05.725971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718057+0000","last_change":"2024-04-25T09:13:54.715032+0000","last_active":"2024-04-25T09:13:56.718057+0000","last_peered":"2024-04-25T09:13:56.718057+0000","last_clean":"2024-04-25T09:13:56.718057+0000","last_became_active":"2024-04-25T09:13:54.714755+0000","last_became_peered":"2024-04-25T09:13:54.714755+0000","last_unstale":"2024-04-25T09:13:56.718057+0000","last_undegraded":"2024-04-25T09:13:56.718057+0000","last_fullsized":"2024-04-25T09:13:56.718057+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:19.649135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747476+0000","last_change":"2024-04-25T09:13:55.746491+0000","last_active":"2024-04-25T09:13:56.747476+0000","last_peered":"2024-04-25T09:13:56.747476+0000","last_clean":"2024-04-25T09:13:56.747476+0000","last_became_active":"2024-04-25T09:13:55.743362+0000","last_became_peered":"2024-04-25T09:13:55.743362+0000","last_unstale":"2024-04-25T09:13:56.747476+0000","last_undegraded":"2024-04-25T09:13:56.747476+0000","last_fullsized":"2024-04-25T09:13:56.747476+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:51.119070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747297+0000","last_change":"2024-04-25T09:13:54.714838+0000","last_active":"2024-04-25T09:13:56.747297+0000","last_peered":"2024-04-25T09:13:56.747297+0000","last_clean":"2024-04-25T09:13:56.747297+0000","last_became_active":"2024-04-25T09:13:54.714346+0000","last_became_peered":"2024-04-25T09:13:54.714346+0000","last_unstale":"2024-04-25T09:13:56.747297+0000","last_undegraded":"2024-04-25T09:13:56.747297+0000","last_fullsized":"2024-04-25T09:13:56.747297+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:13.989630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.704335+0000","last_change":"2024-04-25T09:13:53.704335+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.704335+0000","last_undegraded":"2024-04-25T09:13:53.704335+0000","last_fullsized":"2024-04-25T09:13:53.704335+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.696538+0000","last_change":"2024-04-25T09:13:53.696538+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.696538+0000","last_undegraded":"2024-04-25T09:13:53.696538+0000","last_fullsized":"2024-04-25T09:13:53.696538+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747044+0000","last_change":"2024-04-25T09:13:55.741720+0000","last_active":"2024-04-25T09:13:56.747044+0000","last_peered":"2024-04-25T09:13:56.747044+0000","last_clean":"2024-04-25T09:13:56.747044+0000","last_became_active":"2024-04-25T09:13:55.739951+0000","last_became_peered":"2024-04-25T09:13:55.739951+0000","last_unstale":"2024-04-25T09:13:56.747044+0000","last_undegraded":"2024-04-25T09:13:56.747044+0000","last_fullsized":"2024-04-25T09:13:56.747044+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:58.698810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702706+0000","last_change":"2024-04-25T09:13:53.702706+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702706+0000","last_undegraded":"2024-04-25T09:13:53.702706+0000","last_fullsized":"2024-04-25T09:13:53.702706+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.693528+0000","last_change":"2024-04-25T09:13:53.693528+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.693528+0000","last_undegraded":"2024-04-25T09:13:53.693528+0000","last_fullsized":"2024-04-25T09:13:53.693528+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747176+0000","last_change":"2024-04-25T09:13:55.734783+0000","last_active":"2024-04-25T09:13:56.747176+0000","last_peered":"2024-04-25T09:13:56.747176+0000","last_clean":"2024-04-25T09:13:56.747176+0000","last_became_active":"2024-04-25T09:13:55.734488+0000","last_became_peered":"2024-04-25T09:13:55.734488+0000","last_unstale":"2024-04-25T09:13:56.747176+0000","last_undegraded":"2024-04-25T09:13:56.747176+0000","last_fullsized":"2024-04-25T09:13:56.747176+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:08.088176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702870+0000","last_change":"2024-04-25T09:13:53.702870+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702870+0000","last_undegraded":"2024-04-25T09:13:53.702870+0000","last_fullsized":"2024-04-25T09:13:53.702870+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.693458+0000","last_change":"2024-04-25T09:13:53.693458+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.693458+0000","last_undegraded":"2024-04-25T09:13:53.693458+0000","last_fullsized":"2024-04-25T09:13:53.693458+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.696748+0000","last_change":"2024-04-25T09:13:53.696748+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.696748+0000","last_undegraded":"2024-04-25T09:13:53.696748+0000","last_fullsized":"2024-04-25T09:13:53.696748+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.698900+0000","last_change":"2024-04-25T09:13:53.698900+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.698900+0000","last_undegraded":"2024-04-25T09:13:53.698900+0000","last_fullsized":"2024-04-25T09:13:53.698900+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702401+0000","last_change":"2024-04-25T09:13:53.702401+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702401+0000","last_undegraded":"2024-04-25T09:13:53.702401+0000","last_fullsized":"2024-04-25T09:13:53.702401+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702622+0000","last_change":"2024-04-25T09:13:53.702622+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702622+0000","last_undegraded":"2024-04-25T09:13:53.702622+0000","last_fullsized":"2024-04-25T09:13:53.702622+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.698646+0000","last_change":"2024-04-25T09:13:53.698646+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.698646+0000","last_undegraded":"2024-04-25T09:13:53.698646+0000","last_fullsized":"2024-04-25T09:13:53.698646+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717763+0000","last_change":"2024-04-25T09:13:54.714803+0000","last_active":"2024-04-25T09:13:56.717763+0000","last_peered":"2024-04-25T09:13:56.717763+0000","last_clean":"2024-04-25T09:13:56.717763+0000","last_became_active":"2024-04-25T09:13:54.714545+0000","last_became_peered":"2024-04-25T09:13:54.714545+0000","last_unstale":"2024-04-25T09:13:56.717763+0000","last_undegraded":"2024-04-25T09:13:56.717763+0000","last_fullsized":"2024-04-25T09:13:56.717763+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:03.583888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.698666+0000","last_change":"2024-04-25T09:13:53.698666+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.698666+0000","last_undegraded":"2024-04-25T09:13:53.698666+0000","last_fullsized":"2024-04-25T09:13:53.698666+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.746962+0000","last_change":"2024-04-25T09:13:54.717287+0000","last_active":"2024-04-25T09:13:56.746962+0000","last_peered":"2024-04-25T09:13:56.746962+0000","last_clean":"2024-04-25T09:13:56.746962+0000","last_became_active":"2024-04-25T09:13:54.716916+0000","last_became_peered":"2024-04-25T09:13:54.716916+0000","last_unstale":"2024-04-25T09:13:56.746962+0000","last_undegraded":"2024-04-25T09:13:56.746962+0000","last_fullsized":"2024-04-25T09:13:56.746962+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:57.944637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702782+0000","last_change":"2024-04-25T09:13:53.702782+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702782+0000","last_undegraded":"2024-04-25T09:13:53.702782+0000","last_fullsized":"2024-04-25T09:13:53.702782+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":397,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747058+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:13:56.747058+0000","last_peered":"2024-04-25T09:13:56.747058+0000","last_clean":"2024-04-25T09:13:56.747058+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:13:56.747058+0000","last_undegraded":"2024-04-25T09:13:56.747058+0000","last_fullsized":"2024-04-25T09:13:56.747058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":2},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55100,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316740,"statfs":{"total":96636764160,"available":96580341760,"internally_reserved":0,"allocated":1748992,"data_stored":812963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50936,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320904,"statfs":{"total":96636764160,"available":96584605696,"internally_reserved":0,"allocated":1748992,"data_stored":812963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63420,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308420,"statfs":{"total":96636764160,"available":96571822080,"internally_reserved":0,"allocated":1748992,"data_stored":812963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77252,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294588,"statfs":{"total":96636764160,"available":96557658112,"internally_reserved":0,"allocated":1761280,"data_stored":819172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77330887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509579,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55156,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316684,"statfs":{"total":96636764160,"available":96580284416,"internally_reserved":0,"allocated":1806336,"data_stored":839810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55100,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316740,"statfs":{"total":96636764160,"available":96580341760,"internally_reserved":0,"allocated":1748992,"data_stored":812963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59836,"kb_used_data":2288,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312004,"statfs":{"total":96636764160,"available":96575492096,"internally_reserved":0,"allocated":2342912,"data_stored":1403331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574987,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55712,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316128,"statfs":{"total":96636764160,"available":96579715072,"internally_reserved":0,"allocated":2383872,"data_stored":1423396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:14:00.174 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:14:00.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.360+0000 7efde6800640 1 Processor -- start 2024-04-25T09:14:00.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.360+0000 7efde6800640 1 -- start start 2024-04-25T09:14:00.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.364+0000 7efde6800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efde00aefa0 0x7efde00cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.364+0000 7efde6800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efde015edd0 0x7efde00cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.364+0000 7efde6800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde015f320 con 0x7efde00b3e70 2024-04-25T09:14:00.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.364+0000 7efde6800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde006dd50 con 0x7efde00aefa0 2024-04-25T09:14:00.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.364+0000 7efde6800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde006d420 con 0x7efde015edd0 2024-04-25T09:14:00.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.364+0000 7efddf400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7efde00b3e70 0x7efde00b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:55770/0 (socket says 172.21.15.173:55770) 2024-04-25T09:14:00.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.364+0000 7efddf400640 1 -- 172.21.15.173:0/2793025151 learned_addr learned my addr 172.21.15.173:0/2793025151 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:00.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.364+0000 7efdd6a00640 1 --2- 172.21.15.173:0/2793025151 >> v2:172.21.15.173:3300/0 conn(0x7efde00aefa0 0x7efde00cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.364+0000 7efddfe00640 1 --2- 172.21.15.173:0/2793025151 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efde015edd0 0x7efde00cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.364+0000 7efdd6a00640 1 -- 172.21.15.173:0/2793025151 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efde015edd0 msgr2=0x7efde00cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:00.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.364+0000 7efdd6a00640 1 --2- 172.21.15.173:0/2793025151 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efde015edd0 0x7efde00cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.364+0000 7efdd6a00640 1 -- 172.21.15.173:0/2793025151 >> v1:172.21.15.173:6789/0 conn(0x7efde00b3e70 legacy=0x7efde00b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.364+0000 7efdd6a00640 1 -- 172.21.15.173:0/2793025151 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde006d700 con 0x7efde00aefa0 2024-04-25T09:14:00.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efdd6a00640 1 --2- 172.21.15.173:0/2793025151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde00aefa0 0x7efde00cd7a0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7efdc80097c0 tx=0x7efdc801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3b9950beb0dd21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:00.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efddea00640 1 -- 172.21.15.173:0/2793025151 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc80ab660 con 0x7efde00aefa0 2024-04-25T09:14:00.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efddea00640 1 -- 172.21.15.173:0/2793025151 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc80b0070 con 0x7efde00aefa0 2024-04-25T09:14:00.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efddea00640 1 -- 172.21.15.173:0/2793025151 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc80aba20 con 0x7efde00aefa0 2024-04-25T09:14:00.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efde6800640 1 -- 172.21.15.173:0/2793025151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde00aefa0 msgr2=0x7efde00cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efde6800640 1 --2- 172.21.15.173:0/2793025151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde00aefa0 0x7efde00cd7a0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7efdc80097c0 tx=0x7efdc801c470 comp rx=0 tx=0).stop 2024-04-25T09:14:00.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efde6800640 1 -- 172.21.15.173:0/2793025151 shutdown_connections 2024-04-25T09:14:00.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efde6800640 1 --2- 172.21.15.173:0/2793025151 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efde015edd0 0x7efde00cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efde6800640 1 --2- 172.21.15.173:0/2793025151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde00aefa0 0x7efde00cd7a0 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efde6800640 1 -- 172.21.15.173:0/2793025151 >> 172.21.15.173:0/2793025151 conn(0x7efde006ac90 msgr2=0x7efde006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:00.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efde6800640 1 -- 172.21.15.173:0/2793025151 shutdown_connections 2024-04-25T09:14:00.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efde6800640 1 -- 172.21.15.173:0/2793025151 wait complete. 2024-04-25T09:14:00.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efde6800640 1 Processor -- start 2024-04-25T09:14:00.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efde6800640 1 -- start start 2024-04-25T09:14:00.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efde6800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efde00aefa0 0x7efde0159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efde6800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efde00b3e70 0x7efde01598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efde6800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde015edd0 0x7efde01f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efde6800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde0167930 con 0x7efde015edd0 2024-04-25T09:14:00.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efde6800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde01677b0 con 0x7efde00aefa0 2024-04-25T09:14:00.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efde6800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde0167ab0 con 0x7efde00b3e70 2024-04-25T09:14:00.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.368+0000 7efddfe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde015edd0 0x7efde01f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.372+0000 7efddfe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde015edd0 0x7efde01f6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34936/0 (socket says 172.21.15.173:34936) 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.372+0000 7efddfe00640 1 -- 172.21.15.173:0/985349016 learned_addr learned my addr 172.21.15.173:0/985349016 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.372+0000 7efdd6a00640 1 --2- 172.21.15.173:0/985349016 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efde00b3e70 0x7efde01598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.372+0000 7efddf400640 1 --2- 172.21.15.173:0/985349016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efde00aefa0 0x7efde0159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.372+0000 7efddfe00640 1 -- 172.21.15.173:0/985349016 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efde00b3e70 msgr2=0x7efde01598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.372+0000 7efddfe00640 1 --2- 172.21.15.173:0/985349016 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efde00b3e70 0x7efde01598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.372+0000 7efddfe00640 1 -- 172.21.15.173:0/985349016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efde00aefa0 msgr2=0x7efde0159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.372+0000 7efddfe00640 1 --2- 172.21.15.173:0/985349016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efde00aefa0 0x7efde0159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.372+0000 7efddfe00640 1 -- 172.21.15.173:0/985349016 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde015a0d0 con 0x7efde015edd0 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.372+0000 7efddf400640 1 --2- 172.21.15.173:0/985349016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efde00aefa0 0x7efde0159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.372+0000 7efddfe00640 1 --2- 172.21.15.173:0/985349016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde015edd0 0x7efde01f6da0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7efdd800d800 tx=0x7efdd800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:00.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.372+0000 7efdd7e00640 1 -- 172.21.15.173:0/985349016 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd800b6c0 con 0x7efde015edd0 2024-04-25T09:14:00.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.372+0000 7efdd7e00640 1 -- 172.21.15.173:0/985349016 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd8019070 con 0x7efde015edd0 2024-04-25T09:14:00.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.372+0000 7efdd7e00640 1 -- 172.21.15.173:0/985349016 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd800baa0 con 0x7efde015edd0 2024-04-25T09:14:00.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.372+0000 7efde6800640 1 -- 172.21.15.173:0/985349016 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde014af30 con 0x7efde015edd0 2024-04-25T09:14:00.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.372+0000 7efde6800640 1 -- 172.21.15.173:0/985349016 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde0159df0 con 0x7efde015edd0 2024-04-25T09:14:00.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.372+0000 7efde6800640 1 -- 172.21.15.173:0/985349016 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde014ad30 con 0x7efde015edd0 2024-04-25T09:14:00.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.372+0000 7efdd7e00640 1 -- 172.21.15.173:0/985349016 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efdd800bc40 con 0x7efde015edd0 2024-04-25T09:14:00.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.376+0000 7efdd7e00640 1 --2- 172.21.15.173:0/985349016 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efdbc066f60 0x7efdbc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.376+0000 7efdd7e00640 1 -- 172.21.15.173:0/985349016 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efdd8085620 con 0x7efde015edd0 2024-04-25T09:14:00.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.376+0000 7efddf400640 1 --2- 172.21.15.173:0/985349016 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efdbc066f60 0x7efdbc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.376+0000 7efddf400640 1 --2- 172.21.15.173:0/985349016 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efdbc066f60 0x7efdbc069420 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efde015d140 tx=0x7efdd0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:00.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.380+0000 7efdd7e00640 1 -- 172.21.15.173:0/985349016 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efdd8056400 con 0x7efde015edd0 2024-04-25T09:14:00.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.528+0000 7efde6800640 1 -- 172.21.15.173:0/985349016 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efde006e540 con 0x7efdbc066f60 2024-04-25T09:14:00.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.536+0000 7efdd7e00640 1 -- 172.21.15.173:0/985349016 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+242993 (secure 0 0 0) 0x7efde006e540 con 0x7efdbc066f60 2024-04-25T09:14:00.522 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:00.524 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.536+0000 7efde6800640 1 -- 172.21.15.173:0/985349016 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efdbc066f60 msgr2=0x7efdbc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.536+0000 7efde6800640 1 --2- 172.21.15.173:0/985349016 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efdbc066f60 0x7efdbc069420 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efde015d140 tx=0x7efdd0009040 comp rx=0 tx=0).stop 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.536+0000 7efde6800640 1 -- 172.21.15.173:0/985349016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde015edd0 msgr2=0x7efde01f6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.536+0000 7efde6800640 1 --2- 172.21.15.173:0/985349016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde015edd0 0x7efde01f6da0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7efdd800d800 tx=0x7efdd800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.536+0000 7efde6800640 1 -- 172.21.15.173:0/985349016 shutdown_connections 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.540+0000 7efde6800640 1 --2- 172.21.15.173:0/985349016 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7efdbc066f60 0x7efdbc069420 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.540+0000 7efde6800640 1 --2- 172.21.15.173:0/985349016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde015edd0 0x7efde01f6da0 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.540+0000 7efde6800640 1 --2- 172.21.15.173:0/985349016 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efde00b3e70 0x7efde01598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.540+0000 7efde6800640 1 --2- 172.21.15.173:0/985349016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efde00aefa0 0x7efde0159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.540+0000 7efde6800640 1 -- 172.21.15.173:0/985349016 >> 172.21.15.173:0/985349016 conn(0x7efde006ac90 msgr2=0x7efde015c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.540+0000 7efde6800640 1 -- 172.21.15.173:0/985349016 shutdown_connections 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.540+0000 7efde6800640 1 -- 172.21.15.173:0/985349016 wait complete. 2024-04-25T09:14:00.544 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":478,"stamp":"2024-04-25T09:13:58.875509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":170,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":92,"acting":92,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":472512,"kb_used_data":14932,"kb_used_omap":12,"kb_used_meta":457459,"kb_avail":754502208,"statfs":{"total":773094113280,"available":772610260992,"internally_reserved":0,"allocated":15290368,"data_stored":7737561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":468438576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.180967"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717953+0000","last_change":"2024-04-25T09:13:55.742900+0000","last_active":"2024-04-25T09:13:56.717953+0000","last_peered":"2024-04-25T09:13:56.717953+0000","last_clean":"2024-04-25T09:13:56.717953+0000","last_became_active":"2024-04-25T09:13:55.742544+0000","last_became_peered":"2024-04-25T09:13:55.742544+0000","last_unstale":"2024-04-25T09:13:56.717953+0000","last_undegraded":"2024-04-25T09:13:56.717953+0000","last_fullsized":"2024-04-25T09:13:56.717953+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:41.376893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718028+0000","last_change":"2024-04-25T09:13:55.722825+0000","last_active":"2024-04-25T09:13:56.718028+0000","last_peered":"2024-04-25T09:13:56.718028+0000","last_clean":"2024-04-25T09:13:56.718028+0000","last_became_active":"2024-04-25T09:13:55.722426+0000","last_became_peered":"2024-04-25T09:13:55.722426+0000","last_unstale":"2024-04-25T09:13:56.718028+0000","last_undegraded":"2024-04-25T09:13:56.718028+0000","last_fullsized":"2024-04-25T09:13:56.718028+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:22.040179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747436+0000","last_change":"2024-04-25T09:13:55.746333+0000","last_active":"2024-04-25T09:13:56.747436+0000","last_peered":"2024-04-25T09:13:56.747436+0000","last_clean":"2024-04-25T09:13:56.747436+0000","last_became_active":"2024-04-25T09:13:55.742104+0000","last_became_peered":"2024-04-25T09:13:55.742104+0000","last_unstale":"2024-04-25T09:13:56.747436+0000","last_undegraded":"2024-04-25T09:13:56.747436+0000","last_fullsized":"2024-04-25T09:13:56.747436+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:42.683250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717775+0000","last_change":"2024-04-25T09:13:55.730791+0000","last_active":"2024-04-25T09:13:56.717775+0000","last_peered":"2024-04-25T09:13:56.717775+0000","last_clean":"2024-04-25T09:13:56.717775+0000","last_became_active":"2024-04-25T09:13:55.730465+0000","last_became_peered":"2024-04-25T09:13:55.730465+0000","last_unstale":"2024-04-25T09:13:56.717775+0000","last_undegraded":"2024-04-25T09:13:56.717775+0000","last_fullsized":"2024-04-25T09:13:56.717775+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:17.012203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717921+0000","last_change":"2024-04-25T09:13:55.719281+0000","last_active":"2024-04-25T09:13:56.717921+0000","last_peered":"2024-04-25T09:13:56.717921+0000","last_clean":"2024-04-25T09:13:56.717921+0000","last_became_active":"2024-04-25T09:13:55.718404+0000","last_became_peered":"2024-04-25T09:13:55.718404+0000","last_unstale":"2024-04-25T09:13:56.717921+0000","last_undegraded":"2024-04-25T09:13:56.717921+0000","last_fullsized":"2024-04-25T09:13:56.717921+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:38.672115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717841+0000","last_change":"2024-04-25T09:13:55.728441+0000","last_active":"2024-04-25T09:13:56.717841+0000","last_peered":"2024-04-25T09:13:56.717841+0000","last_clean":"2024-04-25T09:13:56.717841+0000","last_became_active":"2024-04-25T09:13:55.727618+0000","last_became_peered":"2024-04-25T09:13:55.727618+0000","last_unstale":"2024-04-25T09:13:56.717841+0000","last_undegraded":"2024-04-25T09:13:56.717841+0000","last_fullsized":"2024-04-25T09:13:56.717841+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:00.943778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702653+0000","last_change":"2024-04-25T09:13:53.702653+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702653+0000","last_undegraded":"2024-04-25T09:13:53.702653+0000","last_fullsized":"2024-04-25T09:13:53.702653+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747249+0000","last_change":"2024-04-25T09:13:54.714659+0000","last_active":"2024-04-25T09:13:56.747249+0000","last_peered":"2024-04-25T09:13:56.747249+0000","last_clean":"2024-04-25T09:13:56.747249+0000","last_became_active":"2024-04-25T09:13:54.713833+0000","last_became_peered":"2024-04-25T09:13:54.713833+0000","last_unstale":"2024-04-25T09:13:56.747249+0000","last_undegraded":"2024-04-25T09:13:56.747249+0000","last_fullsized":"2024-04-25T09:13:56.747249+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:08.263244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747551+0000","last_change":"2024-04-25T09:13:54.715020+0000","last_active":"2024-04-25T09:13:56.747551+0000","last_peered":"2024-04-25T09:13:56.747551+0000","last_clean":"2024-04-25T09:13:56.747551+0000","last_became_active":"2024-04-25T09:13:54.714699+0000","last_became_peered":"2024-04-25T09:13:54.714699+0000","last_unstale":"2024-04-25T09:13:56.747551+0000","last_undegraded":"2024-04-25T09:13:56.747551+0000","last_fullsized":"2024-04-25T09:13:56.747551+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:05.091617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747414+0000","last_change":"2024-04-25T09:13:55.742805+0000","last_active":"2024-04-25T09:13:56.747414+0000","last_peered":"2024-04-25T09:13:56.747414+0000","last_clean":"2024-04-25T09:13:56.747414+0000","last_became_active":"2024-04-25T09:13:55.742529+0000","last_became_peered":"2024-04-25T09:13:55.742529+0000","last_unstale":"2024-04-25T09:13:56.747414+0000","last_undegraded":"2024-04-25T09:13:56.747414+0000","last_fullsized":"2024-04-25T09:13:56.747414+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:38.099089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.704056+0000","last_change":"2024-04-25T09:13:53.704056+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.704056+0000","last_undegraded":"2024-04-25T09:13:53.704056+0000","last_fullsized":"2024-04-25T09:13:53.704056+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.693480+0000","last_change":"2024-04-25T09:13:53.693480+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.693480+0000","last_undegraded":"2024-04-25T09:13:53.693480+0000","last_fullsized":"2024-04-25T09:13:53.693480+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.703668+0000","last_change":"2024-04-25T09:13:53.703668+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.703668+0000","last_undegraded":"2024-04-25T09:13:53.703668+0000","last_fullsized":"2024-04-25T09:13:53.703668+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.699625+0000","last_change":"2024-04-25T09:13:53.699625+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.699625+0000","last_undegraded":"2024-04-25T09:13:53.699625+0000","last_fullsized":"2024-04-25T09:13:53.699625+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702794+0000","last_change":"2024-04-25T09:13:53.702794+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702794+0000","last_undegraded":"2024-04-25T09:13:53.702794+0000","last_fullsized":"2024-04-25T09:13:53.702794+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747374+0000","last_change":"2024-04-25T09:13:54.706537+0000","last_active":"2024-04-25T09:13:56.747374+0000","last_peered":"2024-04-25T09:13:56.747374+0000","last_clean":"2024-04-25T09:13:56.747374+0000","last_became_active":"2024-04-25T09:13:54.706228+0000","last_became_peered":"2024-04-25T09:13:54.706228+0000","last_unstale":"2024-04-25T09:13:56.747374+0000","last_undegraded":"2024-04-25T09:13:56.747374+0000","last_fullsized":"2024-04-25T09:13:56.747374+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:01.382832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717999+0000","last_change":"2024-04-25T09:13:55.742803+0000","last_active":"2024-04-25T09:13:56.717999+0000","last_peered":"2024-04-25T09:13:56.717999+0000","last_clean":"2024-04-25T09:13:56.717999+0000","last_became_active":"2024-04-25T09:13:55.742513+0000","last_became_peered":"2024-04-25T09:13:55.742513+0000","last_unstale":"2024-04-25T09:13:56.717999+0000","last_undegraded":"2024-04-25T09:13:56.717999+0000","last_fullsized":"2024-04-25T09:13:56.717999+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:16.713216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.699705+0000","last_change":"2024-04-25T09:13:53.699705+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.699705+0000","last_undegraded":"2024-04-25T09:13:53.699705+0000","last_fullsized":"2024-04-25T09:13:53.699705+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718134+0000","last_change":"2024-04-25T09:13:55.720321+0000","last_active":"2024-04-25T09:13:56.718134+0000","last_peered":"2024-04-25T09:13:56.718134+0000","last_clean":"2024-04-25T09:13:56.718134+0000","last_became_active":"2024-04-25T09:13:55.719998+0000","last_became_peered":"2024-04-25T09:13:55.719998+0000","last_unstale":"2024-04-25T09:13:56.718134+0000","last_undegraded":"2024-04-25T09:13:56.718134+0000","last_fullsized":"2024-04-25T09:13:56.718134+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:11.054761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"143'3","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718015+0000","last_change":"2024-04-25T09:13:54.716928+0000","last_active":"2024-04-25T09:13:56.718015+0000","last_peered":"2024-04-25T09:13:56.718015+0000","last_clean":"2024-04-25T09:13:56.718015+0000","last_became_active":"2024-04-25T09:13:54.716645+0000","last_became_peered":"2024-04-25T09:13:54.716645+0000","last_unstale":"2024-04-25T09:13:56.718015+0000","last_undegraded":"2024-04-25T09:13:56.718015+0000","last_fullsized":"2024-04-25T09:13:56.718015+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:04.981253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.703370+0000","last_change":"2024-04-25T09:13:53.703370+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.703370+0000","last_undegraded":"2024-04-25T09:13:53.703370+0000","last_fullsized":"2024-04-25T09:13:53.703370+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.698028+0000","last_change":"2024-04-25T09:13:53.698028+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.698028+0000","last_undegraded":"2024-04-25T09:13:53.698028+0000","last_fullsized":"2024-04-25T09:13:53.698028+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.696707+0000","last_change":"2024-04-25T09:13:53.696707+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.696707+0000","last_undegraded":"2024-04-25T09:13:53.696707+0000","last_fullsized":"2024-04-25T09:13:53.696707+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.698682+0000","last_change":"2024-04-25T09:13:53.698682+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.698682+0000","last_undegraded":"2024-04-25T09:13:53.698682+0000","last_fullsized":"2024-04-25T09:13:53.698682+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747260+0000","last_change":"2024-04-25T09:13:55.738271+0000","last_active":"2024-04-25T09:13:56.747260+0000","last_peered":"2024-04-25T09:13:56.747260+0000","last_clean":"2024-04-25T09:13:56.747260+0000","last_became_active":"2024-04-25T09:13:55.737962+0000","last_became_peered":"2024-04-25T09:13:55.737962+0000","last_unstale":"2024-04-25T09:13:56.747260+0000","last_undegraded":"2024-04-25T09:13:56.747260+0000","last_fullsized":"2024-04-25T09:13:56.747260+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:05.725971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718057+0000","last_change":"2024-04-25T09:13:54.715032+0000","last_active":"2024-04-25T09:13:56.718057+0000","last_peered":"2024-04-25T09:13:56.718057+0000","last_clean":"2024-04-25T09:13:56.718057+0000","last_became_active":"2024-04-25T09:13:54.714755+0000","last_became_peered":"2024-04-25T09:13:54.714755+0000","last_unstale":"2024-04-25T09:13:56.718057+0000","last_undegraded":"2024-04-25T09:13:56.718057+0000","last_fullsized":"2024-04-25T09:13:56.718057+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:19.649135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747476+0000","last_change":"2024-04-25T09:13:55.746491+0000","last_active":"2024-04-25T09:13:56.747476+0000","last_peered":"2024-04-25T09:13:56.747476+0000","last_clean":"2024-04-25T09:13:56.747476+0000","last_became_active":"2024-04-25T09:13:55.743362+0000","last_became_peered":"2024-04-25T09:13:55.743362+0000","last_unstale":"2024-04-25T09:13:56.747476+0000","last_undegraded":"2024-04-25T09:13:56.747476+0000","last_fullsized":"2024-04-25T09:13:56.747476+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:51.119070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747297+0000","last_change":"2024-04-25T09:13:54.714838+0000","last_active":"2024-04-25T09:13:56.747297+0000","last_peered":"2024-04-25T09:13:56.747297+0000","last_clean":"2024-04-25T09:13:56.747297+0000","last_became_active":"2024-04-25T09:13:54.714346+0000","last_became_peered":"2024-04-25T09:13:54.714346+0000","last_unstale":"2024-04-25T09:13:56.747297+0000","last_undegraded":"2024-04-25T09:13:56.747297+0000","last_fullsized":"2024-04-25T09:13:56.747297+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:13.989630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.704335+0000","last_change":"2024-04-25T09:13:53.704335+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.704335+0000","last_undegraded":"2024-04-25T09:13:53.704335+0000","last_fullsized":"2024-04-25T09:13:53.704335+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.696538+0000","last_change":"2024-04-25T09:13:53.696538+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.696538+0000","last_undegraded":"2024-04-25T09:13:53.696538+0000","last_fullsized":"2024-04-25T09:13:53.696538+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747044+0000","last_change":"2024-04-25T09:13:55.741720+0000","last_active":"2024-04-25T09:13:56.747044+0000","last_peered":"2024-04-25T09:13:56.747044+0000","last_clean":"2024-04-25T09:13:56.747044+0000","last_became_active":"2024-04-25T09:13:55.739951+0000","last_became_peered":"2024-04-25T09:13:55.739951+0000","last_unstale":"2024-04-25T09:13:56.747044+0000","last_undegraded":"2024-04-25T09:13:56.747044+0000","last_fullsized":"2024-04-25T09:13:56.747044+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:58.698810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702706+0000","last_change":"2024-04-25T09:13:53.702706+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702706+0000","last_undegraded":"2024-04-25T09:13:53.702706+0000","last_fullsized":"2024-04-25T09:13:53.702706+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.693528+0000","last_change":"2024-04-25T09:13:53.693528+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.693528+0000","last_undegraded":"2024-04-25T09:13:53.693528+0000","last_fullsized":"2024-04-25T09:13:53.693528+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747176+0000","last_change":"2024-04-25T09:13:55.734783+0000","last_active":"2024-04-25T09:13:56.747176+0000","last_peered":"2024-04-25T09:13:56.747176+0000","last_clean":"2024-04-25T09:13:56.747176+0000","last_became_active":"2024-04-25T09:13:55.734488+0000","last_became_peered":"2024-04-25T09:13:55.734488+0000","last_unstale":"2024-04-25T09:13:56.747176+0000","last_undegraded":"2024-04-25T09:13:56.747176+0000","last_fullsized":"2024-04-25T09:13:56.747176+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:08.088176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702870+0000","last_change":"2024-04-25T09:13:53.702870+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702870+0000","last_undegraded":"2024-04-25T09:13:53.702870+0000","last_fullsized":"2024-04-25T09:13:53.702870+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.693458+0000","last_change":"2024-04-25T09:13:53.693458+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.693458+0000","last_undegraded":"2024-04-25T09:13:53.693458+0000","last_fullsized":"2024-04-25T09:13:53.693458+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.696748+0000","last_change":"2024-04-25T09:13:53.696748+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.696748+0000","last_undegraded":"2024-04-25T09:13:53.696748+0000","last_fullsized":"2024-04-25T09:13:53.696748+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.698900+0000","last_change":"2024-04-25T09:13:53.698900+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.698900+0000","last_undegraded":"2024-04-25T09:13:53.698900+0000","last_fullsized":"2024-04-25T09:13:53.698900+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702401+0000","last_change":"2024-04-25T09:13:53.702401+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702401+0000","last_undegraded":"2024-04-25T09:13:53.702401+0000","last_fullsized":"2024-04-25T09:13:53.702401+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702622+0000","last_change":"2024-04-25T09:13:53.702622+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702622+0000","last_undegraded":"2024-04-25T09:13:53.702622+0000","last_fullsized":"2024-04-25T09:13:53.702622+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.698646+0000","last_change":"2024-04-25T09:13:53.698646+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.698646+0000","last_undegraded":"2024-04-25T09:13:53.698646+0000","last_fullsized":"2024-04-25T09:13:53.698646+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717763+0000","last_change":"2024-04-25T09:13:54.714803+0000","last_active":"2024-04-25T09:13:56.717763+0000","last_peered":"2024-04-25T09:13:56.717763+0000","last_clean":"2024-04-25T09:13:56.717763+0000","last_became_active":"2024-04-25T09:13:54.714545+0000","last_became_peered":"2024-04-25T09:13:54.714545+0000","last_unstale":"2024-04-25T09:13:56.717763+0000","last_undegraded":"2024-04-25T09:13:56.717763+0000","last_fullsized":"2024-04-25T09:13:56.717763+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:03.583888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.698666+0000","last_change":"2024-04-25T09:13:53.698666+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.698666+0000","last_undegraded":"2024-04-25T09:13:53.698666+0000","last_fullsized":"2024-04-25T09:13:53.698666+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.746962+0000","last_change":"2024-04-25T09:13:54.717287+0000","last_active":"2024-04-25T09:13:56.746962+0000","last_peered":"2024-04-25T09:13:56.746962+0000","last_clean":"2024-04-25T09:13:56.746962+0000","last_became_active":"2024-04-25T09:13:54.716916+0000","last_became_peered":"2024-04-25T09:13:54.716916+0000","last_unstale":"2024-04-25T09:13:56.746962+0000","last_undegraded":"2024-04-25T09:13:56.746962+0000","last_fullsized":"2024-04-25T09:13:56.746962+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:57.944637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:13:54.691694+0000","last_change":"2024-04-25T09:13:54.691694+0000","last_active":"2024-04-25T09:13:54.691694+0000","last_peered":"2024-04-25T09:13:54.691694+0000","last_clean":"2024-04-25T09:13:54.691694+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:54.691694+0000","last_undegraded":"2024-04-25T09:13:54.691694+0000","last_fullsized":"2024-04-25T09:13:54.691694+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2024-04-25T09:13:53.702782+0000","last_change":"2024-04-25T09:13:53.702782+0000","last_active":"2024-04-25T09:13:53.683860+0000","last_peered":"2024-04-25T09:13:53.683860+0000","last_clean":"2024-04-25T09:13:53.683860+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:13:53.702782+0000","last_undegraded":"2024-04-25T09:13:53.702782+0000","last_fullsized":"2024-04-25T09:13:53.702782+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":397,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747058+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:13:56.747058+0000","last_peered":"2024-04-25T09:13:56.747058+0000","last_clean":"2024-04-25T09:13:56.747058+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:13:56.747058+0000","last_undegraded":"2024-04-25T09:13:56.747058+0000","last_fullsized":"2024-04-25T09:13:56.747058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":2},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55100,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316740,"statfs":{"total":96636764160,"available":96580341760,"internally_reserved":0,"allocated":1748992,"data_stored":812963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50936,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320904,"statfs":{"total":96636764160,"available":96584605696,"internally_reserved":0,"allocated":1748992,"data_stored":812963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63420,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308420,"statfs":{"total":96636764160,"available":96571822080,"internally_reserved":0,"allocated":1748992,"data_stored":812963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77252,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294588,"statfs":{"total":96636764160,"available":96557658112,"internally_reserved":0,"allocated":1761280,"data_stored":819172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77330887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509579,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55156,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316684,"statfs":{"total":96636764160,"available":96580284416,"internally_reserved":0,"allocated":1806336,"data_stored":839810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55100,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316740,"statfs":{"total":96636764160,"available":96580341760,"internally_reserved":0,"allocated":1748992,"data_stored":812963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59836,"kb_used_data":2288,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312004,"statfs":{"total":96636764160,"available":96575492096,"internally_reserved":0,"allocated":2342912,"data_stored":1403331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574987,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55712,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316128,"statfs":{"total":96636764160,"available":96579715072,"internally_reserved":0,"allocated":2383872,"data_stored":1423396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:14:00.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3f is not active+clean 2024-04-25T09:14:00.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3e is not active+clean 2024-04-25T09:14:00.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3d is not active+clean 2024-04-25T09:14:00.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3c is not active+clean 2024-04-25T09:14:00.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3b is not active+clean 2024-04-25T09:14:00.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3a is not active+clean 2024-04-25T09:14:00.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.39 is not active+clean 2024-04-25T09:14:00.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.38 is not active+clean 2024-04-25T09:14:00.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.37 is not active+clean 2024-04-25T09:14:00.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.36 is not active+clean 2024-04-25T09:14:00.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.34 is not active+clean 2024-04-25T09:14:00.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.33 is not active+clean 2024-04-25T09:14:00.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.32 is not active+clean 2024-04-25T09:14:00.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.31 is not active+clean 2024-04-25T09:14:00.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.30 is not active+clean 2024-04-25T09:14:00.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2f is not active+clean 2024-04-25T09:14:00.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2c is not active+clean 2024-04-25T09:14:00.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2b is not active+clean 2024-04-25T09:14:00.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2a is not active+clean 2024-04-25T09:14:00.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.29 is not active+clean 2024-04-25T09:14:00.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.27 is not active+clean 2024-04-25T09:14:00.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.26 is not active+clean 2024-04-25T09:14:00.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.25 is not active+clean 2024-04-25T09:14:00.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.23 is not active+clean 2024-04-25T09:14:00.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.21 is not active+clean 2024-04-25T09:14:00.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.20 is not active+clean 2024-04-25T09:14:00.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1c is not active+clean 2024-04-25T09:14:00.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1f is not active+clean 2024-04-25T09:14:00.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.702653+0000', 'last_change': '2024-04-25T09:13:53.702653+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.702653+0000', 'last_undegraded': '2024-04-25T09:13:53.702653+0000', 'last_fullsized': '2024-04-25T09:13:53.702653+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:14:00.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1d is not active+clean 2024-04-25T09:14:00.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1e is not active+clean 2024-04-25T09:14:00.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1c is not active+clean 2024-04-25T09:14:00.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.704056+0000', 'last_change': '2024-04-25T09:13:53.704056+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.704056+0000', 'last_undegraded': '2024-04-25T09:13:53.704056+0000', 'last_fullsized': '2024-04-25T09:13:53.704056+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:14:00.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.18 is not active+clean 2024-04-25T09:14:00.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1b is not active+clean 2024-04-25T09:14:00.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.693480+0000', 'last_change': '2024-04-25T09:13:53.693480+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.693480+0000', 'last_undegraded': '2024-04-25T09:13:53.693480+0000', 'last_fullsized': '2024-04-25T09:13:53.693480+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:14:00.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.19 is not active+clean 2024-04-25T09:14:00.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1a is not active+clean 2024-04-25T09:14:00.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.703668+0000', 'last_change': '2024-04-25T09:13:53.703668+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.703668+0000', 'last_undegraded': '2024-04-25T09:13:53.703668+0000', 'last_fullsized': '2024-04-25T09:13:53.703668+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:14:00.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1a is not active+clean 2024-04-25T09:14:00.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.19 is not active+clean 2024-04-25T09:14:00.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.699625+0000', 'last_change': '2024-04-25T09:13:53.699625+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.699625+0000', 'last_undegraded': '2024-04-25T09:13:53.699625+0000', 'last_fullsized': '2024-04-25T09:13:53.699625+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:14:00.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1b is not active+clean 2024-04-25T09:14:00.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.18 is not active+clean 2024-04-25T09:14:00.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.702794+0000', 'last_change': '2024-04-25T09:13:53.702794+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.702794+0000', 'last_undegraded': '2024-04-25T09:13:53.702794+0000', 'last_fullsized': '2024-04-25T09:13:53.702794+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:14:00.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.14 is not active+clean 2024-04-25T09:14:00.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.16 is not active+clean 2024-04-25T09:14:00.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.699705+0000', 'last_change': '2024-04-25T09:13:53.699705+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.699705+0000', 'last_undegraded': '2024-04-25T09:13:53.699705+0000', 'last_fullsized': '2024-04-25T09:13:53.699705+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:14:00.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.10 is not active+clean 2024-04-25T09:14:00.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.13 is not active+clean 2024-04-25T09:14:00.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.703370+0000', 'last_change': '2024-04-25T09:13:53.703370+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.703370+0000', 'last_undegraded': '2024-04-25T09:13:53.703370+0000', 'last_fullsized': '2024-04-25T09:13:53.703370+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:14:00.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.11 is not active+clean 2024-04-25T09:14:00.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.12 is not active+clean 2024-04-25T09:14:00.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.698028+0000', 'last_change': '2024-04-25T09:13:53.698028+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.698028+0000', 'last_undegraded': '2024-04-25T09:13:53.698028+0000', 'last_fullsized': '2024-04-25T09:13:53.698028+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:14:00.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.12 is not active+clean 2024-04-25T09:14:00.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.11 is not active+clean 2024-04-25T09:14:00.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.696707+0000', 'last_change': '2024-04-25T09:13:53.696707+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.696707+0000', 'last_undegraded': '2024-04-25T09:13:53.696707+0000', 'last_fullsized': '2024-04-25T09:13:53.696707+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:14:00.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.13 is not active+clean 2024-04-25T09:14:00.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.10 is not active+clean 2024-04-25T09:14:00.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.698682+0000', 'last_change': '2024-04-25T09:13:53.698682+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.698682+0000', 'last_undegraded': '2024-04-25T09:13:53.698682+0000', 'last_fullsized': '2024-04-25T09:13:53.698682+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:14:00.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.e is not active+clean 2024-04-25T09:14:00.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.d is not active+clean 2024-04-25T09:14:00.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.704335+0000', 'last_change': '2024-04-25T09:13:53.704335+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.704335+0000', 'last_undegraded': '2024-04-25T09:13:53.704335+0000', 'last_fullsized': '2024-04-25T09:13:53.704335+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:14:00.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.f is not active+clean 2024-04-25T09:14:00.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.c is not active+clean 2024-04-25T09:14:00.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.696538+0000', 'last_change': '2024-04-25T09:13:53.696538+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.696538+0000', 'last_undegraded': '2024-04-25T09:13:53.696538+0000', 'last_fullsized': '2024-04-25T09:13:53.696538+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:14:00.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.b is not active+clean 2024-04-25T09:14:00.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.702706+0000', 'last_change': '2024-04-25T09:13:53.702706+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.702706+0000', 'last_undegraded': '2024-04-25T09:13:53.702706+0000', 'last_fullsized': '2024-04-25T09:13:53.702706+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:14:00.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.9 is not active+clean 2024-04-25T09:14:00.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.a is not active+clean 2024-04-25T09:14:00.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.693528+0000', 'last_change': '2024-04-25T09:13:53.693528+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.693528+0000', 'last_undegraded': '2024-04-25T09:13:53.693528+0000', 'last_fullsized': '2024-04-25T09:13:53.693528+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:14:00.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.9 is not active+clean 2024-04-25T09:14:00.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.702870+0000', 'last_change': '2024-04-25T09:13:53.702870+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.702870+0000', 'last_undegraded': '2024-04-25T09:13:53.702870+0000', 'last_fullsized': '2024-04-25T09:13:53.702870+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:14:00.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.b is not active+clean 2024-04-25T09:14:00.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.8 is not active+clean 2024-04-25T09:14:00.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.693458+0000', 'last_change': '2024-04-25T09:13:53.693458+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.693458+0000', 'last_undegraded': '2024-04-25T09:13:53.693458+0000', 'last_fullsized': '2024-04-25T09:13:53.693458+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:14:00.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.4 is not active+clean 2024-04-25T09:14:00.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.7 is not active+clean 2024-04-25T09:14:00.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.696748+0000', 'last_change': '2024-04-25T09:13:53.696748+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.696748+0000', 'last_undegraded': '2024-04-25T09:13:53.696748+0000', 'last_fullsized': '2024-04-25T09:13:53.696748+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:14:00.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.5 is not active+clean 2024-04-25T09:14:00.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.6 is not active+clean 2024-04-25T09:14:00.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.698900+0000', 'last_change': '2024-04-25T09:13:53.698900+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.698900+0000', 'last_undegraded': '2024-04-25T09:13:53.698900+0000', 'last_fullsized': '2024-04-25T09:13:53.698900+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:14:00.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.6 is not active+clean 2024-04-25T09:14:00.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.5 is not active+clean 2024-04-25T09:14:00.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.702401+0000', 'last_change': '2024-04-25T09:13:53.702401+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.702401+0000', 'last_undegraded': '2024-04-25T09:13:53.702401+0000', 'last_fullsized': '2024-04-25T09:13:53.702401+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:14:00.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.7 is not active+clean 2024-04-25T09:14:00.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.4 is not active+clean 2024-04-25T09:14:00.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.702622+0000', 'last_change': '2024-04-25T09:13:53.702622+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.702622+0000', 'last_undegraded': '2024-04-25T09:13:53.702622+0000', 'last_fullsized': '2024-04-25T09:13:53.702622+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:14:00.560 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.0 is not active+clean 2024-04-25T09:14:00.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.560 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3 is not active+clean 2024-04-25T09:14:00.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.698646+0000', 'last_change': '2024-04-25T09:13:53.698646+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.698646+0000', 'last_undegraded': '2024-04-25T09:13:53.698646+0000', 'last_fullsized': '2024-04-25T09:13:53.698646+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:14:00.560 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1 is not active+clean 2024-04-25T09:14:00.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.560 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2 is not active+clean 2024-04-25T09:14:00.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.560 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1 is not active+clean 2024-04-25T09:14:00.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.698666+0000', 'last_change': '2024-04-25T09:13:53.698666+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.698666+0000', 'last_undegraded': '2024-04-25T09:13:53.698666+0000', 'last_fullsized': '2024-04-25T09:13:53.698666+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:14:00.560 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3 is not active+clean 2024-04-25T09:14:00.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.561 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.17 is not active+clean 2024-04-25T09:14:00.561 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:13:54.691694+0000', 'last_change': '2024-04-25T09:13:54.691694+0000', 'last_active': '2024-04-25T09:13:54.691694+0000', 'last_peered': '2024-04-25T09:13:54.691694+0000', 'last_clean': '2024-04-25T09:13:54.691694+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:54.691694+0000', 'last_undegraded': '2024-04-25T09:13:54.691694+0000', 'last_fullsized': '2024-04-25T09:13:54.691694+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:54.691694+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:14:00.561 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.14 is not active+clean 2024-04-25T09:14:00.561 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:13:53.702782+0000', 'last_change': '2024-04-25T09:13:53.702782+0000', 'last_active': '2024-04-25T09:13:53.683860+0000', 'last_peered': '2024-04-25T09:13:53.683860+0000', 'last_clean': '2024-04-25T09:13:53.683860+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:13:53.702782+0000', 'last_undegraded': '2024-04-25T09:13:53.702782+0000', 'last_fullsized': '2024-04-25T09:13:53.702782+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'last_clean_scrub_stamp': '2024-04-25T09:13:53.683860+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:14:00.561 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:14:00.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.736+0000 7f4438200640 1 Processor -- start 2024-04-25T09:14:00.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.736+0000 7f4438200640 1 -- start start 2024-04-25T09:14:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.736+0000 7f4438200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44300cc8b0 0x7f44300ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.736+0000 7f4438200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443006e7c0 con 0x7f4430145250 2024-04-25T09:14:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.736+0000 7f4438200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443006d720 con 0x7f44300ce8f0 2024-04-25T09:14:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.736+0000 7f4438200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443006da00 con 0x7f44300cc8b0 2024-04-25T09:14:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.736+0000 7f4435800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4430145250 0x7f443015c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:55774/0 (socket says 172.21.15.173:55774) 2024-04-25T09:14:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.736+0000 7f4435800640 1 -- 172.21.15.173:0/892222651 learned_addr learned my addr 172.21.15.173:0/892222651 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:00.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.736+0000 7f4434e00640 1 --2- 172.21.15.173:0/892222651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44300cc8b0 0x7f44300ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.736+0000 7f442fe00640 1 -- 172.21.15.173:0/892222651 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443300640 0 0) 0x7f443006e7c0 con 0x7f4430145250 2024-04-25T09:14:00.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.740+0000 7f442fe00640 1 -- 172.21.15.173:0/892222651 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4418003530 con 0x7f4430145250 2024-04-25T09:14:00.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.740+0000 7f442fe00640 1 -- 172.21.15.173:0/892222651 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733504001 0 0) 0x7f443006d720 con 0x7f44300ce8f0 2024-04-25T09:14:00.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.740+0000 7f442fe00640 1 -- 172.21.15.173:0/892222651 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f443006e7c0 con 0x7f44300ce8f0 2024-04-25T09:14:00.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.740+0000 7f442fe00640 1 -- 172.21.15.173:0/892222651 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 172164023 0 0) 0x7f4418003530 con 0x7f4430145250 2024-04-25T09:14:00.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.740+0000 7f4434e00640 1 -- 172.21.15.173:0/892222651 >> v1:172.21.15.194:6789/0 conn(0x7f44300ce8f0 legacy=0x7f44300ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.740+0000 7f4434e00640 1 -- 172.21.15.173:0/892222651 >> v1:172.21.15.173:6789/0 conn(0x7f4430145250 legacy=0x7f443015c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.740+0000 7f4434e00640 1 -- 172.21.15.173:0/892222651 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443006dce0 con 0x7f44300cc8b0 2024-04-25T09:14:00.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.740+0000 7f4434e00640 1 --2- 172.21.15.173:0/892222651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44300cc8b0 0x7f44300ccd30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f441c0097f0 tx=0x7f441c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=718c1fc486c47904 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:00.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.740+0000 7f442fe00640 1 -- 172.21.15.173:0/892222651 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c0b0070 con 0x7f44300cc8b0 2024-04-25T09:14:00.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.740+0000 7f442fe00640 1 -- 172.21.15.173:0/892222651 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c0ab400 con 0x7f44300cc8b0 2024-04-25T09:14:00.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.740+0000 7f442fe00640 1 -- 172.21.15.173:0/892222651 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424001a00 con 0x7f44300cc8b0 2024-04-25T09:14:00.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4438200640 1 -- 172.21.15.173:0/892222651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44300cc8b0 msgr2=0x7f44300ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4438200640 1 --2- 172.21.15.173:0/892222651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44300cc8b0 0x7f44300ccd30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f441c0097f0 tx=0x7f441c01c400 comp rx=0 tx=0).stop 2024-04-25T09:14:00.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4438200640 1 -- 172.21.15.173:0/892222651 shutdown_connections 2024-04-25T09:14:00.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4438200640 1 --2- 172.21.15.173:0/892222651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44300cc8b0 0x7f44300ccd30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4438200640 1 -- 172.21.15.173:0/892222651 >> 172.21.15.173:0/892222651 conn(0x7f443006ac90 msgr2=0x7f443006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:00.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4438200640 1 -- 172.21.15.173:0/892222651 shutdown_connections 2024-04-25T09:14:00.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4438200640 1 -- 172.21.15.173:0/892222651 wait complete. 2024-04-25T09:14:00.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4438200640 1 Processor -- start 2024-04-25T09:14:00.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4438200640 1 -- start start 2024-04-25T09:14:00.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4438200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44300cc8b0 0x7f443013b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4438200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44300ce8f0 0x7f443013af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4438200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4430145250 0x7f443013fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4438200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443006d380 con 0x7f44300cc8b0 2024-04-25T09:14:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4438200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443006ef80 con 0x7f44300ce8f0 2024-04-25T09:14:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4438200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443006d500 con 0x7f4430145250 2024-04-25T09:14:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4435800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44300cc8b0 0x7f443013b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4435800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44300cc8b0 0x7f443013b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34944/0 (socket says 172.21.15.173:34944) 2024-04-25T09:14:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4435800640 1 -- 172.21.15.173:0/2935402153 learned_addr learned my addr 172.21.15.173:0/2935402153 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4434e00640 1 --2- 172.21.15.173:0/2935402153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44300ce8f0 0x7f443013af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4435800640 1 -- 172.21.15.173:0/2935402153 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4430145250 msgr2=0x7f443013fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4435800640 1 --2- 172.21.15.173:0/2935402153 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4430145250 0x7f443013fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4435800640 1 -- 172.21.15.173:0/2935402153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44300ce8f0 msgr2=0x7f443013af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4435800640 1 --2- 172.21.15.173:0/2935402153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44300ce8f0 0x7f443013af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4435800640 1 -- 172.21.15.173:0/2935402153 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4430154ad0 con 0x7f44300cc8b0 2024-04-25T09:14:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4434e00640 1 --2- 172.21.15.173:0/2935402153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44300ce8f0 0x7f443013af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.744+0000 7f4435800640 1 --2- 172.21.15.173:0/2935402153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44300cc8b0 0x7f443013b7a0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f4424002010 tx=0x7f442400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.748+0000 7f442d600640 1 -- 172.21.15.173:0/2935402153 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424012400 con 0x7f44300cc8b0 2024-04-25T09:14:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.748+0000 7f442d600640 1 -- 172.21.15.173:0/2935402153 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44240125a0 con 0x7f44300cc8b0 2024-04-25T09:14:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.748+0000 7f442d600640 1 -- 172.21.15.173:0/2935402153 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424012990 con 0x7f44300cc8b0 2024-04-25T09:14:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.748+0000 7f4438200640 1 -- 172.21.15.173:0/2935402153 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4430157810 con 0x7f44300cc8b0 2024-04-25T09:14:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.748+0000 7f4438200640 1 -- 172.21.15.173:0/2935402153 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4430157dd0 con 0x7f44300cc8b0 2024-04-25T09:14:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.748+0000 7f4438200640 1 -- 172.21.15.173:0/2935402153 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4430073a40 con 0x7f44300cc8b0 2024-04-25T09:14:00.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.748+0000 7f442d600640 1 -- 172.21.15.173:0/2935402153 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4424012b30 con 0x7f44300cc8b0 2024-04-25T09:14:00.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.748+0000 7f442d600640 1 --2- 172.21.15.173:0/2935402153 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4410066f60 0x7f4410069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.748+0000 7f442d600640 1 -- 172.21.15.173:0/2935402153 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4424085a40 con 0x7f44300cc8b0 2024-04-25T09:14:00.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.748+0000 7f4434e00640 1 --2- 172.21.15.173:0/2935402153 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4410066f60 0x7f4410069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.752+0000 7f4434e00640 1 --2- 172.21.15.173:0/2935402153 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4410066f60 0x7f4410069420 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f441c0ad000 tx=0x7f441c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:00.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.756+0000 7f442d600640 1 -- 172.21.15.173:0/2935402153 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4424012e20 con 0x7f44300cc8b0 2024-04-25T09:14:00.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.964+0000 7f4438200640 1 -- 172.21.15.173:0/2935402153 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f44300b0720 con 0x7f44300cc8b0 2024-04-25T09:14:00.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.964+0000 7f442d600640 1 -- 172.21.15.173:0/2935402153 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1178 (secure 0 0 0) 0x7f4424056a10 con 0x7f44300cc8b0 2024-04-25T09:14:00.950 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:00.950 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":695,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035757,"num_in_osds":8,"osd_in_since":1714035748,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":51},{"state_name":"creating+peering","count":24},{"state_name":"active+clean","count":22}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":590480,"bytes_used":483852288,"bytes_avail":772610260992,"bytes_total":773094113280,"unknown_pgs_ratio":0.52577316761016846,"inactive_pgs_ratio":0.24742268025875092,"write_bytes_sec":395,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":102,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"b","status":"up:active","gid":9969}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":33,"modified":"2024-04-25T09:13:32.870221+0000","services":{}},"progress_events":{}} 2024-04-25T09:14:00.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.968+0000 7f4438200640 1 -- 172.21.15.173:0/2935402153 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4410066f60 msgr2=0x7f4410069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.968+0000 7f4438200640 1 --2- 172.21.15.173:0/2935402153 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4410066f60 0x7f4410069420 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f441c0ad000 tx=0x7f441c008040 comp rx=0 tx=0).stop 2024-04-25T09:14:00.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.968+0000 7f4438200640 1 -- 172.21.15.173:0/2935402153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44300cc8b0 msgr2=0x7f443013b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.968+0000 7f4438200640 1 --2- 172.21.15.173:0/2935402153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44300cc8b0 0x7f443013b7a0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f4424002010 tx=0x7f442400a430 comp rx=0 tx=0).stop 2024-04-25T09:14:00.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.968+0000 7f4438200640 1 -- 172.21.15.173:0/2935402153 shutdown_connections 2024-04-25T09:14:00.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.968+0000 7f4438200640 1 --2- 172.21.15.173:0/2935402153 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4410066f60 0x7f4410069420 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.968+0000 7f4438200640 1 --2- 172.21.15.173:0/2935402153 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4430145250 0x7f443013fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.968+0000 7f4438200640 1 --2- 172.21.15.173:0/2935402153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44300ce8f0 0x7f443013af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.968+0000 7f4438200640 1 --2- 172.21.15.173:0/2935402153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44300cc8b0 0x7f443013b7a0 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.968+0000 7f4438200640 1 -- 172.21.15.173:0/2935402153 >> 172.21.15.173:0/2935402153 conn(0x7f443006ac90 msgr2=0x7f44300ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:00.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.968+0000 7f4438200640 1 -- 172.21.15.173:0/2935402153 shutdown_connections 2024-04-25T09:14:00.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:00.968+0000 7f4438200640 1 -- 172.21.15.173:0/2935402153 wait complete. 2024-04-25T09:14:00.971 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:14:00.971 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:14:01.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.120+0000 7f0dbca00640 1 Processor -- start 2024-04-25T09:14:01.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.120+0000 7f0dbca00640 1 -- start start 2024-04-25T09:14:01.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.124+0000 7f0dbca00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0db806dac0 0x7f0db80ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:01.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.124+0000 7f0dbca00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db806bca0 0x7f0db806c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:01.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.124+0000 7f0dbca00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db8061d60 con 0x7f0db8160fe0 2024-04-25T09:14:01.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.124+0000 7f0dbca00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db81613c0 con 0x7f0db806dac0 2024-04-25T09:14:01.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.124+0000 7f0dbca00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db806dfa0 con 0x7f0db806bca0 2024-04-25T09:14:01.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.124+0000 7f0dad400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0db806dac0 0x7f0db80ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.124+0000 7f0dad400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0db806dac0 0x7f0db80ace00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34952/0 (socket says 172.21.15.173:34952) 2024-04-25T09:14:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.124+0000 7f0dad400640 1 -- 172.21.15.173:0/3667157700 learned_addr learned my addr 172.21.15.173:0/3667157700 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.124+0000 7f0dad400640 1 -- 172.21.15.173:0/3667157700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db806bca0 msgr2=0x7f0db806c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.124+0000 7f0dad400640 1 --2- 172.21.15.173:0/3667157700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db806bca0 0x7f0db806c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.124+0000 7f0dad400640 1 -- 172.21.15.173:0/3667157700 >> v1:172.21.15.194:6789/0 conn(0x7f0db8160fe0 legacy=0x7f0db8161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.124+0000 7f0dad400640 1 -- 172.21.15.173:0/3667157700 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db806e280 con 0x7f0db806dac0 2024-04-25T09:14:01.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.124+0000 7f0dad400640 1 --2- 172.21.15.173:0/3667157700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db806dac0 0x7f0db80ace00 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f0da0009870 tx=0x7f0da001c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc104f35557de49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:01.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0db5400640 1 -- 172.21.15.173:0/3667157700 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da00b0070 con 0x7f0db806dac0 2024-04-25T09:14:01.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0db5400640 1 -- 172.21.15.173:0/3667157700 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da00ab600 con 0x7f0db806dac0 2024-04-25T09:14:01.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0db5400640 1 -- 172.21.15.173:0/3667157700 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da00ab9d0 con 0x7f0db806dac0 2024-04-25T09:14:01.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0dbca00640 1 -- 172.21.15.173:0/3667157700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db806dac0 msgr2=0x7f0db80ace00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:01.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0dbca00640 1 --2- 172.21.15.173:0/3667157700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db806dac0 0x7f0db80ace00 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f0da0009870 tx=0x7f0da001c2b0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0dbca00640 1 -- 172.21.15.173:0/3667157700 shutdown_connections 2024-04-25T09:14:01.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0dbca00640 1 --2- 172.21.15.173:0/3667157700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db806bca0 0x7f0db806c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0dbca00640 1 --2- 172.21.15.173:0/3667157700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db806dac0 0x7f0db80ace00 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0dbca00640 1 -- 172.21.15.173:0/3667157700 >> 172.21.15.173:0/3667157700 conn(0x7f0db8071c20 msgr2=0x7f0db8072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:01.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0dbca00640 1 -- 172.21.15.173:0/3667157700 shutdown_connections 2024-04-25T09:14:01.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0dbca00640 1 -- 172.21.15.173:0/3667157700 wait complete. 2024-04-25T09:14:01.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0dbca00640 1 Processor -- start 2024-04-25T09:14:01.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0dbca00640 1 -- start start 2024-04-25T09:14:01.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0dbca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db806bca0 0x7f0db814b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:01.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0dbca00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db806dac0 0x7f0db815f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:01.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0dbca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db8160fe0 0x7f0db81537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0dbca00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80ad4c0 con 0x7f0db8160fe0 2024-04-25T09:14:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0dbca00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80ad340 con 0x7f0db806bca0 2024-04-25T09:14:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0dbca00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db806f850 con 0x7f0db806dac0 2024-04-25T09:14:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0db6800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db8160fe0 0x7f0db81537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0db6800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db8160fe0 0x7f0db81537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34962/0 (socket says 172.21.15.173:34962) 2024-04-25T09:14:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.128+0000 7f0db6800640 1 -- 172.21.15.173:0/1916508424 learned_addr learned my addr 172.21.15.173:0/1916508424 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.132+0000 7f0db6800640 1 -- 172.21.15.173:0/1916508424 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db806dac0 msgr2=0x7f0db815f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.132+0000 7f0db6800640 1 --2- 172.21.15.173:0/1916508424 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db806dac0 0x7f0db815f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.132+0000 7f0db5e00640 1 --2- 172.21.15.173:0/1916508424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db806bca0 0x7f0db814b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.132+0000 7f0db6800640 1 -- 172.21.15.173:0/1916508424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db806bca0 msgr2=0x7f0db814b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.132+0000 7f0db6800640 1 --2- 172.21.15.173:0/1916508424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db806bca0 0x7f0db814b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.132+0000 7f0db6800640 1 -- 172.21.15.173:0/1916508424 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db8154080 con 0x7f0db8160fe0 2024-04-25T09:14:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.132+0000 7f0db5e00640 1 --2- 172.21.15.173:0/1916508424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db806bca0 0x7f0db814b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.132+0000 7f0db6800640 1 --2- 172.21.15.173:0/1916508424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db8160fe0 0x7f0db81537c0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f0db000b970 tx=0x7f0db000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:01.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.132+0000 7f0daea00640 1 -- 172.21.15.173:0/1916508424 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0019070 con 0x7f0db8160fe0 2024-04-25T09:14:01.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.132+0000 7f0daea00640 1 -- 172.21.15.173:0/1916508424 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db000cb60 con 0x7f0db8160fe0 2024-04-25T09:14:01.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.132+0000 7f0dbca00640 1 -- 172.21.15.173:0/1916508424 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db815b190 con 0x7f0db8160fe0 2024-04-25T09:14:01.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.132+0000 7f0daea00640 1 -- 172.21.15.173:0/1916508424 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0014440 con 0x7f0db8160fe0 2024-04-25T09:14:01.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.132+0000 7f0dbca00640 1 -- 172.21.15.173:0/1916508424 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db815b750 con 0x7f0db8160fe0 2024-04-25T09:14:01.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.132+0000 7f0dbca00640 1 -- 172.21.15.173:0/1916508424 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db8073a40 con 0x7f0db8160fe0 2024-04-25T09:14:01.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.132+0000 7f0daea00640 1 -- 172.21.15.173:0/1916508424 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0db001c070 con 0x7f0db8160fe0 2024-04-25T09:14:01.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.132+0000 7f0daea00640 1 --2- 172.21.15.173:0/1916508424 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d94066f60 0x7f0d94069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:01.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.132+0000 7f0daea00640 1 -- 172.21.15.173:0/1916508424 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0db0084f20 con 0x7f0db8160fe0 2024-04-25T09:14:01.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.132+0000 7f0db5e00640 1 --2- 172.21.15.173:0/1916508424 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d94066f60 0x7f0d94069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:01.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.136+0000 7f0db5e00640 1 --2- 172.21.15.173:0/1916508424 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d94066f60 0x7f0d94069420 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0da800a830 tx=0x7f0da8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:01.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.140+0000 7f0daea00640 1 -- 172.21.15.173:0/1916508424 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0db0055d90 con 0x7f0db8160fe0 2024-04-25T09:14:01.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.288+0000 7f0dbca00640 1 -- 172.21.15.173:0/1916508424 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0db8154360 con 0x7f0d94066f60 2024-04-25T09:14:01.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.296+0000 7f0daea00640 1 -- 172.21.15.173:0/1916508424 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252485 (secure 0 0 0) 0x7f0db8154360 con 0x7f0d94066f60 2024-04-25T09:14:01.284 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:14:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.300+0000 7f0dbca00640 1 -- 172.21.15.173:0/1916508424 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d94066f60 msgr2=0x7f0d94069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.300+0000 7f0dbca00640 1 --2- 172.21.15.173:0/1916508424 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d94066f60 0x7f0d94069420 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0da800a830 tx=0x7f0da8008040 comp rx=0 tx=0).stop 2024-04-25T09:14:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.300+0000 7f0dbca00640 1 -- 172.21.15.173:0/1916508424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db8160fe0 msgr2=0x7f0db81537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.300+0000 7f0dbca00640 1 --2- 172.21.15.173:0/1916508424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db8160fe0 0x7f0db81537c0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f0db000b970 tx=0x7f0db000be30 comp rx=0 tx=0).stop 2024-04-25T09:14:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.300+0000 7f0dbca00640 1 -- 172.21.15.173:0/1916508424 shutdown_connections 2024-04-25T09:14:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.300+0000 7f0dbca00640 1 --2- 172.21.15.173:0/1916508424 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0d94066f60 0x7f0d94069420 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.300+0000 7f0dbca00640 1 --2- 172.21.15.173:0/1916508424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db8160fe0 0x7f0db81537c0 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.300+0000 7f0dbca00640 1 --2- 172.21.15.173:0/1916508424 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0db806dac0 0x7f0db815f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.300+0000 7f0dbca00640 1 --2- 172.21.15.173:0/1916508424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0db806bca0 0x7f0db814b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.300+0000 7f0dbca00640 1 -- 172.21.15.173:0/1916508424 >> 172.21.15.173:0/1916508424 conn(0x7f0db8071c20 msgr2=0x7f0db80aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:01.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.300+0000 7f0dbca00640 1 -- 172.21.15.173:0/1916508424 shutdown_connections 2024-04-25T09:14:01.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:01.300+0000 7f0dbca00640 1 -- 172.21.15.173:0/1916508424 wait complete. 2024-04-25T09:14:01.304 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":479,"stamp":"2024-04-25T09:14:00.875921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":460372,"kb_used_data":15260,"kb_used_omap":12,"kb_used_meta":444979,"kb_avail":754514348,"statfs":{"total":773094113280,"available":772622692352,"internally_reserved":0,"allocated":15626240,"data_stored":7896448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":455659056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.178226"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744686+0000","last_change":"2024-04-25T09:13:55.739430+0000","last_active":"2024-04-25T09:13:56.744686+0000","last_peered":"2024-04-25T09:13:56.744686+0000","last_clean":"2024-04-25T09:13:56.744686+0000","last_became_active":"2024-04-25T09:13:55.739174+0000","last_became_peered":"2024-04-25T09:13:55.739174+0000","last_unstale":"2024-04-25T09:13:56.744686+0000","last_undegraded":"2024-04-25T09:13:56.744686+0000","last_fullsized":"2024-04-25T09:13:56.744686+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:27.328317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715411+0000","last_change":"2024-04-25T09:13:55.731753+0000","last_active":"2024-04-25T09:13:56.715411+0000","last_peered":"2024-04-25T09:13:56.715411+0000","last_clean":"2024-04-25T09:13:56.715411+0000","last_became_active":"2024-04-25T09:13:55.731459+0000","last_became_peered":"2024-04-25T09:13:55.731459+0000","last_unstale":"2024-04-25T09:13:56.715411+0000","last_undegraded":"2024-04-25T09:13:56.715411+0000","last_fullsized":"2024-04-25T09:13:56.715411+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:46.095714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715804+0000","last_change":"2024-04-25T09:13:55.743368+0000","last_active":"2024-04-25T09:13:56.715804+0000","last_peered":"2024-04-25T09:13:56.715804+0000","last_clean":"2024-04-25T09:13:56.715804+0000","last_became_active":"2024-04-25T09:13:55.743093+0000","last_became_peered":"2024-04-25T09:13:55.743093+0000","last_unstale":"2024-04-25T09:13:56.715804+0000","last_undegraded":"2024-04-25T09:13:56.715804+0000","last_fullsized":"2024-04-25T09:13:56.715804+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:14.878857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859477+0000","last_change":"2024-04-25T09:13:55.734486+0000","last_active":"2024-04-25T09:13:56.859477+0000","last_peered":"2024-04-25T09:13:56.859477+0000","last_clean":"2024-04-25T09:13:56.859477+0000","last_became_active":"2024-04-25T09:13:55.734217+0000","last_became_peered":"2024-04-25T09:13:55.734217+0000","last_unstale":"2024-04-25T09:13:56.859477+0000","last_undegraded":"2024-04-25T09:13:56.859477+0000","last_fullsized":"2024-04-25T09:13:56.859477+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:39.549827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861559+0000","last_change":"2024-04-25T09:13:55.741243+0000","last_active":"2024-04-25T09:13:56.861559+0000","last_peered":"2024-04-25T09:13:56.861559+0000","last_clean":"2024-04-25T09:13:56.861559+0000","last_became_active":"2024-04-25T09:13:55.740909+0000","last_became_peered":"2024-04-25T09:13:55.740909+0000","last_unstale":"2024-04-25T09:13:56.861559+0000","last_undegraded":"2024-04-25T09:13:56.861559+0000","last_fullsized":"2024-04-25T09:13:56.861559+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:03.210563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861005+0000","last_change":"2024-04-25T09:13:55.740799+0000","last_active":"2024-04-25T09:13:56.861005+0000","last_peered":"2024-04-25T09:13:56.861005+0000","last_clean":"2024-04-25T09:13:56.861005+0000","last_became_active":"2024-04-25T09:13:55.740524+0000","last_became_peered":"2024-04-25T09:13:55.740524+0000","last_unstale":"2024-04-25T09:13:56.861005+0000","last_undegraded":"2024-04-25T09:13:56.861005+0000","last_fullsized":"2024-04-25T09:13:56.861005+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:52.219293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744404+0000","last_change":"2024-04-25T09:13:55.733981+0000","last_active":"2024-04-25T09:13:56.744404+0000","last_peered":"2024-04-25T09:13:56.744404+0000","last_clean":"2024-04-25T09:13:56.744404+0000","last_became_active":"2024-04-25T09:13:55.733716+0000","last_became_peered":"2024-04-25T09:13:55.733716+0000","last_unstale":"2024-04-25T09:13:56.744404+0000","last_undegraded":"2024-04-25T09:13:56.744404+0000","last_fullsized":"2024-04-25T09:13:56.744404+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:11.094825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718572+0000","last_change":"2024-04-25T09:13:55.729955+0000","last_active":"2024-04-25T09:13:56.718572+0000","last_peered":"2024-04-25T09:13:56.718572+0000","last_clean":"2024-04-25T09:13:56.718572+0000","last_became_active":"2024-04-25T09:13:55.729182+0000","last_became_peered":"2024-04-25T09:13:55.729182+0000","last_unstale":"2024-04-25T09:13:56.718572+0000","last_undegraded":"2024-04-25T09:13:56.718572+0000","last_fullsized":"2024-04-25T09:13:56.718572+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:19.448933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861474+0000","last_change":"2024-04-25T09:13:55.745734+0000","last_active":"2024-04-25T09:13:56.861474+0000","last_peered":"2024-04-25T09:13:56.861474+0000","last_clean":"2024-04-25T09:13:56.861474+0000","last_became_active":"2024-04-25T09:13:55.745400+0000","last_became_peered":"2024-04-25T09:13:55.745400+0000","last_unstale":"2024-04-25T09:13:56.861474+0000","last_undegraded":"2024-04-25T09:13:56.861474+0000","last_fullsized":"2024-04-25T09:13:56.861474+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:16:40.067491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861419+0000","last_change":"2024-04-25T09:13:55.737735+0000","last_active":"2024-04-25T09:13:56.861419+0000","last_peered":"2024-04-25T09:13:56.861419+0000","last_clean":"2024-04-25T09:13:56.861419+0000","last_became_active":"2024-04-25T09:13:55.737220+0000","last_became_peered":"2024-04-25T09:13:55.737220+0000","last_unstale":"2024-04-25T09:13:56.861419+0000","last_undegraded":"2024-04-25T09:13:56.861419+0000","last_fullsized":"2024-04-25T09:13:56.861419+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:25:39.787497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717953+0000","last_change":"2024-04-25T09:13:55.742900+0000","last_active":"2024-04-25T09:13:56.717953+0000","last_peered":"2024-04-25T09:13:56.717953+0000","last_clean":"2024-04-25T09:13:56.717953+0000","last_became_active":"2024-04-25T09:13:55.742544+0000","last_became_peered":"2024-04-25T09:13:55.742544+0000","last_unstale":"2024-04-25T09:13:56.717953+0000","last_undegraded":"2024-04-25T09:13:56.717953+0000","last_fullsized":"2024-04-25T09:13:56.717953+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:41.376893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859536+0000","last_change":"2024-04-25T09:13:55.733790+0000","last_active":"2024-04-25T09:13:56.859536+0000","last_peered":"2024-04-25T09:13:56.859536+0000","last_clean":"2024-04-25T09:13:56.859536+0000","last_became_active":"2024-04-25T09:13:55.733509+0000","last_became_peered":"2024-04-25T09:13:55.733509+0000","last_unstale":"2024-04-25T09:13:56.859536+0000","last_undegraded":"2024-04-25T09:13:56.859536+0000","last_fullsized":"2024-04-25T09:13:56.859536+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:16.185850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861441+0000","last_change":"2024-04-25T09:13:55.736605+0000","last_active":"2024-04-25T09:13:56.861441+0000","last_peered":"2024-04-25T09:13:56.861441+0000","last_clean":"2024-04-25T09:13:56.861441+0000","last_became_active":"2024-04-25T09:13:55.735964+0000","last_became_peered":"2024-04-25T09:13:55.735964+0000","last_unstale":"2024-04-25T09:13:56.861441+0000","last_undegraded":"2024-04-25T09:13:56.861441+0000","last_fullsized":"2024-04-25T09:13:56.861441+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:56.853832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859398+0000","last_change":"2024-04-25T09:13:55.731244+0000","last_active":"2024-04-25T09:13:56.859398+0000","last_peered":"2024-04-25T09:13:56.859398+0000","last_clean":"2024-04-25T09:13:56.859398+0000","last_became_active":"2024-04-25T09:13:55.730979+0000","last_became_peered":"2024-04-25T09:13:55.730979+0000","last_unstale":"2024-04-25T09:13:56.859398+0000","last_undegraded":"2024-04-25T09:13:56.859398+0000","last_fullsized":"2024-04-25T09:13:56.859398+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:01.687460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715343+0000","last_change":"2024-04-25T09:13:55.731458+0000","last_active":"2024-04-25T09:13:56.715343+0000","last_peered":"2024-04-25T09:13:56.715343+0000","last_clean":"2024-04-25T09:13:56.715343+0000","last_became_active":"2024-04-25T09:13:55.730798+0000","last_became_peered":"2024-04-25T09:13:55.730798+0000","last_unstale":"2024-04-25T09:13:56.715343+0000","last_undegraded":"2024-04-25T09:13:56.715343+0000","last_fullsized":"2024-04-25T09:13:56.715343+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:29.286768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.860667+0000","last_change":"2024-04-25T09:13:55.741769+0000","last_active":"2024-04-25T09:13:56.860667+0000","last_peered":"2024-04-25T09:13:56.860667+0000","last_clean":"2024-04-25T09:13:56.860667+0000","last_became_active":"2024-04-25T09:13:55.741471+0000","last_became_peered":"2024-04-25T09:13:55.741471+0000","last_unstale":"2024-04-25T09:13:56.860667+0000","last_undegraded":"2024-04-25T09:13:56.860667+0000","last_fullsized":"2024-04-25T09:13:56.860667+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:43.633215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859832+0000","last_change":"2024-04-25T09:13:55.735014+0000","last_active":"2024-04-25T09:13:56.859832+0000","last_peered":"2024-04-25T09:13:56.859832+0000","last_clean":"2024-04-25T09:13:56.859832+0000","last_became_active":"2024-04-25T09:13:55.734723+0000","last_became_peered":"2024-04-25T09:13:55.734723+0000","last_unstale":"2024-04-25T09:13:56.859832+0000","last_undegraded":"2024-04-25T09:13:56.859832+0000","last_fullsized":"2024-04-25T09:13:56.859832+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:38.230239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718028+0000","last_change":"2024-04-25T09:13:55.722825+0000","last_active":"2024-04-25T09:13:56.718028+0000","last_peered":"2024-04-25T09:13:56.718028+0000","last_clean":"2024-04-25T09:13:56.718028+0000","last_became_active":"2024-04-25T09:13:55.722426+0000","last_became_peered":"2024-04-25T09:13:55.722426+0000","last_unstale":"2024-04-25T09:13:56.718028+0000","last_undegraded":"2024-04-25T09:13:56.718028+0000","last_fullsized":"2024-04-25T09:13:56.718028+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:22.040179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747436+0000","last_change":"2024-04-25T09:13:55.746333+0000","last_active":"2024-04-25T09:13:56.747436+0000","last_peered":"2024-04-25T09:13:56.747436+0000","last_clean":"2024-04-25T09:13:56.747436+0000","last_became_active":"2024-04-25T09:13:55.742104+0000","last_became_peered":"2024-04-25T09:13:55.742104+0000","last_unstale":"2024-04-25T09:13:56.747436+0000","last_undegraded":"2024-04-25T09:13:56.747436+0000","last_fullsized":"2024-04-25T09:13:56.747436+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:42.683250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.860917+0000","last_change":"2024-04-25T09:13:55.723883+0000","last_active":"2024-04-25T09:13:56.860917+0000","last_peered":"2024-04-25T09:13:56.860917+0000","last_clean":"2024-04-25T09:13:56.860917+0000","last_became_active":"2024-04-25T09:13:55.723607+0000","last_became_peered":"2024-04-25T09:13:55.723607+0000","last_unstale":"2024-04-25T09:13:56.860917+0000","last_undegraded":"2024-04-25T09:13:56.860917+0000","last_fullsized":"2024-04-25T09:13:56.860917+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:08.088176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861527+0000","last_change":"2024-04-25T09:13:55.744575+0000","last_active":"2024-04-25T09:13:56.861527+0000","last_peered":"2024-04-25T09:13:56.861527+0000","last_clean":"2024-04-25T09:13:56.861527+0000","last_became_active":"2024-04-25T09:13:55.744322+0000","last_became_peered":"2024-04-25T09:13:55.744322+0000","last_unstale":"2024-04-25T09:13:56.861527+0000","last_undegraded":"2024-04-25T09:13:56.861527+0000","last_fullsized":"2024-04-25T09:13:56.861527+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:21.219968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744296+0000","last_change":"2024-04-25T09:13:55.734873+0000","last_active":"2024-04-25T09:13:56.744296+0000","last_peered":"2024-04-25T09:13:56.744296+0000","last_clean":"2024-04-25T09:13:56.744296+0000","last_became_active":"2024-04-25T09:13:55.734615+0000","last_became_peered":"2024-04-25T09:13:55.734615+0000","last_unstale":"2024-04-25T09:13:56.744296+0000","last_undegraded":"2024-04-25T09:13:56.744296+0000","last_fullsized":"2024-04-25T09:13:56.744296+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:18.238741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718589+0000","last_change":"2024-04-25T09:13:55.735485+0000","last_active":"2024-04-25T09:13:56.718589+0000","last_peered":"2024-04-25T09:13:56.718589+0000","last_clean":"2024-04-25T09:13:56.718589+0000","last_became_active":"2024-04-25T09:13:55.735129+0000","last_became_peered":"2024-04-25T09:13:55.735129+0000","last_unstale":"2024-04-25T09:13:56.718589+0000","last_undegraded":"2024-04-25T09:13:56.718589+0000","last_fullsized":"2024-04-25T09:13:56.718589+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:42.307150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717775+0000","last_change":"2024-04-25T09:13:55.730791+0000","last_active":"2024-04-25T09:13:56.717775+0000","last_peered":"2024-04-25T09:13:56.717775+0000","last_clean":"2024-04-25T09:13:56.717775+0000","last_became_active":"2024-04-25T09:13:55.730465+0000","last_became_peered":"2024-04-25T09:13:55.730465+0000","last_unstale":"2024-04-25T09:13:56.717775+0000","last_undegraded":"2024-04-25T09:13:56.717775+0000","last_fullsized":"2024-04-25T09:13:56.717775+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:17.012203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744748+0000","last_change":"2024-04-25T09:13:55.718562+0000","last_active":"2024-04-25T09:13:56.744748+0000","last_peered":"2024-04-25T09:13:56.744748+0000","last_clean":"2024-04-25T09:13:56.744748+0000","last_became_active":"2024-04-25T09:13:55.717190+0000","last_became_peered":"2024-04-25T09:13:55.717190+0000","last_unstale":"2024-04-25T09:13:56.744748+0000","last_undegraded":"2024-04-25T09:13:56.744748+0000","last_fullsized":"2024-04-25T09:13:56.744748+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:39.295110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744620+0000","last_change":"2024-04-25T09:13:55.724430+0000","last_active":"2024-04-25T09:13:56.744620+0000","last_peered":"2024-04-25T09:13:56.744620+0000","last_clean":"2024-04-25T09:13:56.744620+0000","last_became_active":"2024-04-25T09:13:55.722760+0000","last_became_peered":"2024-04-25T09:13:55.722760+0000","last_unstale":"2024-04-25T09:13:56.744620+0000","last_undegraded":"2024-04-25T09:13:56.744620+0000","last_fullsized":"2024-04-25T09:13:56.744620+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:44.333225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861310+0000","last_change":"2024-04-25T09:13:55.745744+0000","last_active":"2024-04-25T09:13:56.861310+0000","last_peered":"2024-04-25T09:13:56.861310+0000","last_clean":"2024-04-25T09:13:56.861310+0000","last_became_active":"2024-04-25T09:13:55.745402+0000","last_became_peered":"2024-04-25T09:13:55.745402+0000","last_unstale":"2024-04-25T09:13:56.861310+0000","last_undegraded":"2024-04-25T09:13:56.861310+0000","last_fullsized":"2024-04-25T09:13:56.861310+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:19.880348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717921+0000","last_change":"2024-04-25T09:13:55.719281+0000","last_active":"2024-04-25T09:13:56.717921+0000","last_peered":"2024-04-25T09:13:56.717921+0000","last_clean":"2024-04-25T09:13:56.717921+0000","last_became_active":"2024-04-25T09:13:55.718404+0000","last_became_peered":"2024-04-25T09:13:55.718404+0000","last_unstale":"2024-04-25T09:13:56.717921+0000","last_undegraded":"2024-04-25T09:13:56.717921+0000","last_fullsized":"2024-04-25T09:13:56.717921+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:38.672115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718918+0000","last_change":"2024-04-25T09:13:55.738241+0000","last_active":"2024-04-25T09:13:56.718918+0000","last_peered":"2024-04-25T09:13:56.718918+0000","last_clean":"2024-04-25T09:13:56.718918+0000","last_became_active":"2024-04-25T09:13:55.737964+0000","last_became_peered":"2024-04-25T09:13:55.737964+0000","last_unstale":"2024-04-25T09:13:56.718918+0000","last_undegraded":"2024-04-25T09:13:56.718918+0000","last_fullsized":"2024-04-25T09:13:56.718918+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:51.326239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717841+0000","last_change":"2024-04-25T09:13:55.728441+0000","last_active":"2024-04-25T09:13:56.717841+0000","last_peered":"2024-04-25T09:13:56.717841+0000","last_clean":"2024-04-25T09:13:56.717841+0000","last_became_active":"2024-04-25T09:13:55.727618+0000","last_became_peered":"2024-04-25T09:13:55.727618+0000","last_unstale":"2024-04-25T09:13:56.717841+0000","last_undegraded":"2024-04-25T09:13:56.717841+0000","last_fullsized":"2024-04-25T09:13:56.717841+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:00.943778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.860738+0000","last_change":"2024-04-25T09:13:55.742537+0000","last_active":"2024-04-25T09:13:56.860738+0000","last_peered":"2024-04-25T09:13:56.860738+0000","last_clean":"2024-04-25T09:13:56.860738+0000","last_became_active":"2024-04-25T09:13:55.741611+0000","last_became_peered":"2024-04-25T09:13:55.741611+0000","last_unstale":"2024-04-25T09:13:56.860738+0000","last_undegraded":"2024-04-25T09:13:56.860738+0000","last_fullsized":"2024-04-25T09:13:56.860738+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:34.087251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718702+0000","last_change":"2024-04-25T09:13:55.732525+0000","last_active":"2024-04-25T09:13:56.718702+0000","last_peered":"2024-04-25T09:13:56.718702+0000","last_clean":"2024-04-25T09:13:56.718702+0000","last_became_active":"2024-04-25T09:13:55.731714+0000","last_became_peered":"2024-04-25T09:13:55.731714+0000","last_unstale":"2024-04-25T09:13:56.718702+0000","last_undegraded":"2024-04-25T09:13:56.718702+0000","last_fullsized":"2024-04-25T09:13:56.718702+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:07.209012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715501+0000","last_change":"2024-04-25T09:13:55.738656+0000","last_active":"2024-04-25T09:13:56.715501+0000","last_peered":"2024-04-25T09:13:56.715501+0000","last_clean":"2024-04-25T09:13:56.715501+0000","last_became_active":"2024-04-25T09:13:55.738364+0000","last_became_peered":"2024-04-25T09:13:55.738364+0000","last_unstale":"2024-04-25T09:13:56.715501+0000","last_undegraded":"2024-04-25T09:13:56.715501+0000","last_fullsized":"2024-04-25T09:13:56.715501+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:25:55.791917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"143'4","reported_seq":18,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861510+0000","last_change":"2024-04-25T09:13:54.712424+0000","last_active":"2024-04-25T09:13:56.861510+0000","last_peered":"2024-04-25T09:13:56.861510+0000","last_clean":"2024-04-25T09:13:56.861510+0000","last_became_active":"2024-04-25T09:13:54.712149+0000","last_became_peered":"2024-04-25T09:13:54.712149+0000","last_unstale":"2024-04-25T09:13:56.861510+0000","last_undegraded":"2024-04-25T09:13:56.861510+0000","last_fullsized":"2024-04-25T09:13:56.861510+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:08.263244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715730+0000","last_change":"2024-04-25T09:13:55.732239+0000","last_active":"2024-04-25T09:13:56.715730+0000","last_peered":"2024-04-25T09:13:56.715730+0000","last_clean":"2024-04-25T09:13:56.715730+0000","last_became_active":"2024-04-25T09:13:55.731565+0000","last_became_peered":"2024-04-25T09:13:55.731565+0000","last_unstale":"2024-04-25T09:13:56.715730+0000","last_undegraded":"2024-04-25T09:13:56.715730+0000","last_fullsized":"2024-04-25T09:13:56.715730+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:36.500545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747249+0000","last_change":"2024-04-25T09:13:54.714659+0000","last_active":"2024-04-25T09:13:56.747249+0000","last_peered":"2024-04-25T09:13:56.747249+0000","last_clean":"2024-04-25T09:13:56.747249+0000","last_became_active":"2024-04-25T09:13:54.713833+0000","last_became_peered":"2024-04-25T09:13:54.713833+0000","last_unstale":"2024-04-25T09:13:56.747249+0000","last_undegraded":"2024-04-25T09:13:56.747249+0000","last_fullsized":"2024-04-25T09:13:56.747249+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:08.263244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.719211+0000","last_change":"2024-04-25T09:13:55.733261+0000","last_active":"2024-04-25T09:13:56.719211+0000","last_peered":"2024-04-25T09:13:56.719211+0000","last_clean":"2024-04-25T09:13:56.719211+0000","last_became_active":"2024-04-25T09:13:55.733020+0000","last_became_peered":"2024-04-25T09:13:55.733020+0000","last_unstale":"2024-04-25T09:13:56.719211+0000","last_undegraded":"2024-04-25T09:13:56.719211+0000","last_fullsized":"2024-04-25T09:13:56.719211+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:54.903745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747551+0000","last_change":"2024-04-25T09:13:54.715020+0000","last_active":"2024-04-25T09:13:56.747551+0000","last_peered":"2024-04-25T09:13:56.747551+0000","last_clean":"2024-04-25T09:13:56.747551+0000","last_became_active":"2024-04-25T09:13:54.714699+0000","last_became_peered":"2024-04-25T09:13:54.714699+0000","last_unstale":"2024-04-25T09:13:56.747551+0000","last_undegraded":"2024-04-25T09:13:56.747551+0000","last_fullsized":"2024-04-25T09:13:56.747551+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:05.091617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747414+0000","last_change":"2024-04-25T09:13:55.742805+0000","last_active":"2024-04-25T09:13:56.747414+0000","last_peered":"2024-04-25T09:13:56.747414+0000","last_clean":"2024-04-25T09:13:56.747414+0000","last_became_active":"2024-04-25T09:13:55.742529+0000","last_became_peered":"2024-04-25T09:13:55.742529+0000","last_unstale":"2024-04-25T09:13:56.747414+0000","last_undegraded":"2024-04-25T09:13:56.747414+0000","last_fullsized":"2024-04-25T09:13:56.747414+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:38.099089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715554+0000","last_change":"2024-04-25T09:13:54.720172+0000","last_active":"2024-04-25T09:13:56.715554+0000","last_peered":"2024-04-25T09:13:56.715554+0000","last_clean":"2024-04-25T09:13:56.715554+0000","last_became_active":"2024-04-25T09:13:54.719871+0000","last_became_peered":"2024-04-25T09:13:54.719871+0000","last_unstale":"2024-04-25T09:13:56.715554+0000","last_undegraded":"2024-04-25T09:13:56.715554+0000","last_fullsized":"2024-04-25T09:13:56.715554+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:53.158181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.860987+0000","last_change":"2024-04-25T09:13:55.719950+0000","last_active":"2024-04-25T09:13:56.860987+0000","last_peered":"2024-04-25T09:13:56.860987+0000","last_clean":"2024-04-25T09:13:56.860987+0000","last_became_active":"2024-04-25T09:13:55.718648+0000","last_became_peered":"2024-04-25T09:13:55.718648+0000","last_unstale":"2024-04-25T09:13:56.860987+0000","last_undegraded":"2024-04-25T09:13:56.860987+0000","last_fullsized":"2024-04-25T09:13:56.860987+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:58.698810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718983+0000","last_change":"2024-04-25T09:13:54.722160+0000","last_active":"2024-04-25T09:13:56.718983+0000","last_peered":"2024-04-25T09:13:56.718983+0000","last_clean":"2024-04-25T09:13:56.718983+0000","last_became_active":"2024-04-25T09:13:54.721822+0000","last_became_peered":"2024-04-25T09:13:54.721822+0000","last_unstale":"2024-04-25T09:13:56.718983+0000","last_undegraded":"2024-04-25T09:13:56.718983+0000","last_fullsized":"2024-04-25T09:13:56.718983+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:43.002194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859785+0000","last_change":"2024-04-25T09:13:55.728385+0000","last_active":"2024-04-25T09:13:56.859785+0000","last_peered":"2024-04-25T09:13:56.859785+0000","last_clean":"2024-04-25T09:13:56.859785+0000","last_became_active":"2024-04-25T09:13:55.725682+0000","last_became_peered":"2024-04-25T09:13:55.725682+0000","last_unstale":"2024-04-25T09:13:56.859785+0000","last_undegraded":"2024-04-25T09:13:56.859785+0000","last_fullsized":"2024-04-25T09:13:56.859785+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:40.920356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861082+0000","last_change":"2024-04-25T09:13:54.715294+0000","last_active":"2024-04-25T09:13:56.861082+0000","last_peered":"2024-04-25T09:13:56.861082+0000","last_clean":"2024-04-25T09:13:56.861082+0000","last_became_active":"2024-04-25T09:13:54.715020+0000","last_became_peered":"2024-04-25T09:13:54.715020+0000","last_unstale":"2024-04-25T09:13:56.861082+0000","last_undegraded":"2024-04-25T09:13:56.861082+0000","last_fullsized":"2024-04-25T09:13:56.861082+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:13.989630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715360+0000","last_change":"2024-04-25T09:13:55.726245+0000","last_active":"2024-04-25T09:13:56.715360+0000","last_peered":"2024-04-25T09:13:56.715360+0000","last_clean":"2024-04-25T09:13:56.715360+0000","last_became_active":"2024-04-25T09:13:55.724732+0000","last_became_peered":"2024-04-25T09:13:55.724732+0000","last_unstale":"2024-04-25T09:13:56.715360+0000","last_undegraded":"2024-04-25T09:13:56.715360+0000","last_fullsized":"2024-04-25T09:13:56.715360+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:00.225839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744252+0000","last_change":"2024-04-25T09:13:54.718521+0000","last_active":"2024-04-25T09:13:56.744252+0000","last_peered":"2024-04-25T09:13:56.744252+0000","last_clean":"2024-04-25T09:13:56.744252+0000","last_became_active":"2024-04-25T09:13:54.718221+0000","last_became_peered":"2024-04-25T09:13:54.718221+0000","last_unstale":"2024-04-25T09:13:56.744252+0000","last_undegraded":"2024-04-25T09:13:56.744252+0000","last_fullsized":"2024-04-25T09:13:56.744252+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:17.473334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744439+0000","last_change":"2024-04-25T09:13:55.736243+0000","last_active":"2024-04-25T09:13:56.744439+0000","last_peered":"2024-04-25T09:13:56.744439+0000","last_clean":"2024-04-25T09:13:56.744439+0000","last_became_active":"2024-04-25T09:13:55.735982+0000","last_became_peered":"2024-04-25T09:13:55.735982+0000","last_unstale":"2024-04-25T09:13:56.744439+0000","last_undegraded":"2024-04-25T09:13:56.744439+0000","last_fullsized":"2024-04-25T09:13:56.744439+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:38.010004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.860624+0000","last_change":"2024-04-25T09:13:54.714496+0000","last_active":"2024-04-25T09:13:56.860624+0000","last_peered":"2024-04-25T09:13:56.860624+0000","last_clean":"2024-04-25T09:13:56.860624+0000","last_became_active":"2024-04-25T09:13:54.714235+0000","last_became_peered":"2024-04-25T09:13:54.714235+0000","last_unstale":"2024-04-25T09:13:56.860624+0000","last_undegraded":"2024-04-25T09:13:56.860624+0000","last_fullsized":"2024-04-25T09:13:56.860624+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:53.679821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.719173+0000","last_change":"2024-04-25T09:13:55.738261+0000","last_active":"2024-04-25T09:13:56.719173+0000","last_peered":"2024-04-25T09:13:56.719173+0000","last_clean":"2024-04-25T09:13:56.719173+0000","last_became_active":"2024-04-25T09:13:55.736409+0000","last_became_peered":"2024-04-25T09:13:55.736409+0000","last_unstale":"2024-04-25T09:13:56.719173+0000","last_undegraded":"2024-04-25T09:13:56.719173+0000","last_fullsized":"2024-04-25T09:13:56.719173+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:10.652545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747374+0000","last_change":"2024-04-25T09:13:54.706537+0000","last_active":"2024-04-25T09:13:56.747374+0000","last_peered":"2024-04-25T09:13:56.747374+0000","last_clean":"2024-04-25T09:13:56.747374+0000","last_became_active":"2024-04-25T09:13:54.706228+0000","last_became_peered":"2024-04-25T09:13:54.706228+0000","last_unstale":"2024-04-25T09:13:56.747374+0000","last_undegraded":"2024-04-25T09:13:56.747374+0000","last_fullsized":"2024-04-25T09:13:56.747374+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:01.382832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717999+0000","last_change":"2024-04-25T09:13:55.742803+0000","last_active":"2024-04-25T09:13:56.717999+0000","last_peered":"2024-04-25T09:13:56.717999+0000","last_clean":"2024-04-25T09:13:56.717999+0000","last_became_active":"2024-04-25T09:13:55.742513+0000","last_became_peered":"2024-04-25T09:13:55.742513+0000","last_unstale":"2024-04-25T09:13:56.717999+0000","last_undegraded":"2024-04-25T09:13:56.717999+0000","last_fullsized":"2024-04-25T09:13:56.717999+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:16.713216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744750+0000","last_change":"2024-04-25T09:13:54.716956+0000","last_active":"2024-04-25T09:13:56.744750+0000","last_peered":"2024-04-25T09:13:56.744750+0000","last_clean":"2024-04-25T09:13:56.744750+0000","last_became_active":"2024-04-25T09:13:54.716690+0000","last_became_peered":"2024-04-25T09:13:54.716690+0000","last_unstale":"2024-04-25T09:13:56.744750+0000","last_undegraded":"2024-04-25T09:13:56.744750+0000","last_fullsized":"2024-04-25T09:13:56.744750+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:55.037278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718134+0000","last_change":"2024-04-25T09:13:55.720321+0000","last_active":"2024-04-25T09:13:56.718134+0000","last_peered":"2024-04-25T09:13:56.718134+0000","last_clean":"2024-04-25T09:13:56.718134+0000","last_became_active":"2024-04-25T09:13:55.719998+0000","last_became_peered":"2024-04-25T09:13:55.719998+0000","last_unstale":"2024-04-25T09:13:56.718134+0000","last_undegraded":"2024-04-25T09:13:56.718134+0000","last_fullsized":"2024-04-25T09:13:56.718134+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:11.054761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"143'3","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718015+0000","last_change":"2024-04-25T09:13:54.716928+0000","last_active":"2024-04-25T09:13:56.718015+0000","last_peered":"2024-04-25T09:13:56.718015+0000","last_clean":"2024-04-25T09:13:56.718015+0000","last_became_active":"2024-04-25T09:13:54.716645+0000","last_became_peered":"2024-04-25T09:13:54.716645+0000","last_unstale":"2024-04-25T09:13:56.718015+0000","last_undegraded":"2024-04-25T09:13:56.718015+0000","last_fullsized":"2024-04-25T09:13:56.718015+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:04.981253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718807+0000","last_change":"2024-04-25T09:13:55.745233+0000","last_active":"2024-04-25T09:13:56.718807+0000","last_peered":"2024-04-25T09:13:56.718807+0000","last_clean":"2024-04-25T09:13:56.718807+0000","last_became_active":"2024-04-25T09:13:55.744918+0000","last_became_peered":"2024-04-25T09:13:55.744918+0000","last_unstale":"2024-04-25T09:13:56.718807+0000","last_undegraded":"2024-04-25T09:13:56.718807+0000","last_fullsized":"2024-04-25T09:13:56.718807+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:56.045112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861557+0000","last_change":"2024-04-25T09:13:54.704969+0000","last_active":"2024-04-25T09:13:56.861557+0000","last_peered":"2024-04-25T09:13:56.861557+0000","last_clean":"2024-04-25T09:13:56.861557+0000","last_became_active":"2024-04-25T09:13:54.704704+0000","last_became_peered":"2024-04-25T09:13:54.704704+0000","last_unstale":"2024-04-25T09:13:56.861557+0000","last_undegraded":"2024-04-25T09:13:56.861557+0000","last_fullsized":"2024-04-25T09:13:56.861557+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:57.944637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715358+0000","last_change":"2024-04-25T09:13:55.731197+0000","last_active":"2024-04-25T09:13:56.715358+0000","last_peered":"2024-04-25T09:13:56.715358+0000","last_clean":"2024-04-25T09:13:56.715358+0000","last_became_active":"2024-04-25T09:13:55.730734+0000","last_became_peered":"2024-04-25T09:13:55.730734+0000","last_unstale":"2024-04-25T09:13:56.715358+0000","last_undegraded":"2024-04-25T09:13:56.715358+0000","last_fullsized":"2024-04-25T09:13:56.715358+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:40.084792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859505+0000","last_change":"2024-04-25T09:13:54.720857+0000","last_active":"2024-04-25T09:13:56.859505+0000","last_peered":"2024-04-25T09:13:56.859505+0000","last_clean":"2024-04-25T09:13:56.859505+0000","last_became_active":"2024-04-25T09:13:54.720573+0000","last_became_peered":"2024-04-25T09:13:54.720573+0000","last_unstale":"2024-04-25T09:13:56.859505+0000","last_undegraded":"2024-04-25T09:13:56.859505+0000","last_fullsized":"2024-04-25T09:13:56.859505+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:32.716706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861121+0000","last_change":"2024-04-25T09:13:55.733785+0000","last_active":"2024-04-25T09:13:56.861121+0000","last_peered":"2024-04-25T09:13:56.861121+0000","last_clean":"2024-04-25T09:13:56.861121+0000","last_became_active":"2024-04-25T09:13:55.731849+0000","last_became_peered":"2024-04-25T09:13:55.731849+0000","last_unstale":"2024-04-25T09:13:56.861121+0000","last_undegraded":"2024-04-25T09:13:56.861121+0000","last_fullsized":"2024-04-25T09:13:56.861121+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:20.896002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859801+0000","last_change":"2024-04-25T09:13:54.719105+0000","last_active":"2024-04-25T09:13:56.859801+0000","last_peered":"2024-04-25T09:13:56.859801+0000","last_clean":"2024-04-25T09:13:56.859801+0000","last_became_active":"2024-04-25T09:13:54.718815+0000","last_became_peered":"2024-04-25T09:13:54.718815+0000","last_unstale":"2024-04-25T09:13:56.859801+0000","last_undegraded":"2024-04-25T09:13:56.859801+0000","last_fullsized":"2024-04-25T09:13:56.859801+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:17.230907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715722+0000","last_change":"2024-04-25T09:13:55.737771+0000","last_active":"2024-04-25T09:13:56.715722+0000","last_peered":"2024-04-25T09:13:56.715722+0000","last_clean":"2024-04-25T09:13:56.715722+0000","last_became_active":"2024-04-25T09:13:55.737464+0000","last_became_peered":"2024-04-25T09:13:55.737464+0000","last_unstale":"2024-04-25T09:13:56.715722+0000","last_undegraded":"2024-04-25T09:13:56.715722+0000","last_fullsized":"2024-04-25T09:13:56.715722+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:13.583189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"143'8","reported_seq":22,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744101+0000","last_change":"2024-04-25T09:13:54.713010+0000","last_active":"2024-04-25T09:13:56.744101+0000","last_peered":"2024-04-25T09:13:56.744101+0000","last_clean":"2024-04-25T09:13:56.744101+0000","last_became_active":"2024-04-25T09:13:54.712722+0000","last_became_peered":"2024-04-25T09:13:54.712722+0000","last_unstale":"2024-04-25T09:13:56.744101+0000","last_undegraded":"2024-04-25T09:13:56.744101+0000","last_fullsized":"2024-04-25T09:13:56.744101+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:23.728457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747260+0000","last_change":"2024-04-25T09:13:55.738271+0000","last_active":"2024-04-25T09:13:56.747260+0000","last_peered":"2024-04-25T09:13:56.747260+0000","last_clean":"2024-04-25T09:13:56.747260+0000","last_became_active":"2024-04-25T09:13:55.737962+0000","last_became_peered":"2024-04-25T09:13:55.737962+0000","last_unstale":"2024-04-25T09:13:56.747260+0000","last_undegraded":"2024-04-25T09:13:56.747260+0000","last_fullsized":"2024-04-25T09:13:56.747260+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:05.725971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718057+0000","last_change":"2024-04-25T09:13:54.715032+0000","last_active":"2024-04-25T09:13:56.718057+0000","last_peered":"2024-04-25T09:13:56.718057+0000","last_clean":"2024-04-25T09:13:56.718057+0000","last_became_active":"2024-04-25T09:13:54.714755+0000","last_became_peered":"2024-04-25T09:13:54.714755+0000","last_unstale":"2024-04-25T09:13:56.718057+0000","last_undegraded":"2024-04-25T09:13:56.718057+0000","last_fullsized":"2024-04-25T09:13:56.718057+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:19.649135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747476+0000","last_change":"2024-04-25T09:13:55.746491+0000","last_active":"2024-04-25T09:13:56.747476+0000","last_peered":"2024-04-25T09:13:56.747476+0000","last_clean":"2024-04-25T09:13:56.747476+0000","last_became_active":"2024-04-25T09:13:55.743362+0000","last_became_peered":"2024-04-25T09:13:55.743362+0000","last_unstale":"2024-04-25T09:13:56.747476+0000","last_undegraded":"2024-04-25T09:13:56.747476+0000","last_fullsized":"2024-04-25T09:13:56.747476+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:51.119070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747297+0000","last_change":"2024-04-25T09:13:54.714838+0000","last_active":"2024-04-25T09:13:56.747297+0000","last_peered":"2024-04-25T09:13:56.747297+0000","last_clean":"2024-04-25T09:13:56.747297+0000","last_became_active":"2024-04-25T09:13:54.714346+0000","last_became_peered":"2024-04-25T09:13:54.714346+0000","last_unstale":"2024-04-25T09:13:56.747297+0000","last_undegraded":"2024-04-25T09:13:56.747297+0000","last_fullsized":"2024-04-25T09:13:56.747297+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:13.989630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744687+0000","last_change":"2024-04-25T09:13:55.737660+0000","last_active":"2024-04-25T09:13:56.744687+0000","last_peered":"2024-04-25T09:13:56.744687+0000","last_clean":"2024-04-25T09:13:56.744687+0000","last_became_active":"2024-04-25T09:13:55.737350+0000","last_became_peered":"2024-04-25T09:13:55.737350+0000","last_unstale":"2024-04-25T09:13:56.744687+0000","last_undegraded":"2024-04-25T09:13:56.744687+0000","last_fullsized":"2024-04-25T09:13:56.744687+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:03.680484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715785+0000","last_change":"2024-04-25T09:13:54.714725+0000","last_active":"2024-04-25T09:13:56.715785+0000","last_peered":"2024-04-25T09:13:56.715785+0000","last_clean":"2024-04-25T09:13:56.715785+0000","last_became_active":"2024-04-25T09:13:54.714438+0000","last_became_peered":"2024-04-25T09:13:54.714438+0000","last_unstale":"2024-04-25T09:13:56.715785+0000","last_undegraded":"2024-04-25T09:13:56.715785+0000","last_fullsized":"2024-04-25T09:13:56.715785+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:05.095656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744870+0000","last_change":"2024-04-25T09:13:55.732119+0000","last_active":"2024-04-25T09:13:56.744870+0000","last_peered":"2024-04-25T09:13:56.744870+0000","last_clean":"2024-04-25T09:13:56.744870+0000","last_became_active":"2024-04-25T09:13:55.724999+0000","last_became_peered":"2024-04-25T09:13:55.724999+0000","last_unstale":"2024-04-25T09:13:56.744870+0000","last_undegraded":"2024-04-25T09:13:56.744870+0000","last_fullsized":"2024-04-25T09:13:56.744870+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:01.687460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859554+0000","last_change":"2024-04-25T09:13:54.714787+0000","last_active":"2024-04-25T09:13:56.859554+0000","last_peered":"2024-04-25T09:13:56.859554+0000","last_clean":"2024-04-25T09:13:56.859554+0000","last_became_active":"2024-04-25T09:13:54.714521+0000","last_became_peered":"2024-04-25T09:13:54.714521+0000","last_unstale":"2024-04-25T09:13:56.859554+0000","last_undegraded":"2024-04-25T09:13:56.859554+0000","last_fullsized":"2024-04-25T09:13:56.859554+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:31.744436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747044+0000","last_change":"2024-04-25T09:13:55.741720+0000","last_active":"2024-04-25T09:13:56.747044+0000","last_peered":"2024-04-25T09:13:56.747044+0000","last_clean":"2024-04-25T09:13:56.747044+0000","last_became_active":"2024-04-25T09:13:55.739951+0000","last_became_peered":"2024-04-25T09:13:55.739951+0000","last_unstale":"2024-04-25T09:13:56.747044+0000","last_undegraded":"2024-04-25T09:13:56.747044+0000","last_fullsized":"2024-04-25T09:13:56.747044+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:58.698810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.860891+0000","last_change":"2024-04-25T09:13:54.716217+0000","last_active":"2024-04-25T09:13:56.860891+0000","last_peered":"2024-04-25T09:13:56.860891+0000","last_clean":"2024-04-25T09:13:56.860891+0000","last_became_active":"2024-04-25T09:13:54.715938+0000","last_became_peered":"2024-04-25T09:13:54.715938+0000","last_unstale":"2024-04-25T09:13:56.860891+0000","last_undegraded":"2024-04-25T09:13:56.860891+0000","last_fullsized":"2024-04-25T09:13:56.860891+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:41.737578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715506+0000","last_change":"2024-04-25T09:13:55.729301+0000","last_active":"2024-04-25T09:13:56.715506+0000","last_peered":"2024-04-25T09:13:56.715506+0000","last_clean":"2024-04-25T09:13:56.715506+0000","last_became_active":"2024-04-25T09:13:55.729015+0000","last_became_peered":"2024-04-25T09:13:55.729015+0000","last_unstale":"2024-04-25T09:13:56.715506+0000","last_undegraded":"2024-04-25T09:13:56.715506+0000","last_fullsized":"2024-04-25T09:13:56.715506+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:31.954500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718529+0000","last_change":"2024-04-25T09:13:54.713069+0000","last_active":"2024-04-25T09:13:56.718529+0000","last_peered":"2024-04-25T09:13:56.718529+0000","last_clean":"2024-04-25T09:13:56.718529+0000","last_became_active":"2024-04-25T09:13:54.710852+0000","last_became_peered":"2024-04-25T09:13:54.710852+0000","last_unstale":"2024-04-25T09:13:56.718529+0000","last_undegraded":"2024-04-25T09:13:56.718529+0000","last_fullsized":"2024-04-25T09:13:56.718529+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:50:48.645725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747176+0000","last_change":"2024-04-25T09:13:55.734783+0000","last_active":"2024-04-25T09:13:56.747176+0000","last_peered":"2024-04-25T09:13:56.747176+0000","last_clean":"2024-04-25T09:13:56.747176+0000","last_became_active":"2024-04-25T09:13:55.734488+0000","last_became_peered":"2024-04-25T09:13:55.734488+0000","last_unstale":"2024-04-25T09:13:56.747176+0000","last_undegraded":"2024-04-25T09:13:56.747176+0000","last_fullsized":"2024-04-25T09:13:56.747176+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:08.088176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.860581+0000","last_change":"2024-04-25T09:13:54.716559+0000","last_active":"2024-04-25T09:13:56.860581+0000","last_peered":"2024-04-25T09:13:56.860581+0000","last_clean":"2024-04-25T09:13:56.860581+0000","last_became_active":"2024-04-25T09:13:54.716276+0000","last_became_peered":"2024-04-25T09:13:54.716276+0000","last_unstale":"2024-04-25T09:13:56.860581+0000","last_undegraded":"2024-04-25T09:13:56.860581+0000","last_fullsized":"2024-04-25T09:13:56.860581+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:51.506227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715578+0000","last_change":"2024-04-25T09:13:55.740795+0000","last_active":"2024-04-25T09:13:56.715578+0000","last_peered":"2024-04-25T09:13:56.715578+0000","last_clean":"2024-04-25T09:13:56.715578+0000","last_became_active":"2024-04-25T09:13:55.740520+0000","last_became_peered":"2024-04-25T09:13:55.740520+0000","last_unstale":"2024-04-25T09:13:56.715578+0000","last_undegraded":"2024-04-25T09:13:56.715578+0000","last_fullsized":"2024-04-25T09:13:56.715578+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:35.649423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718983+0000","last_change":"2024-04-25T09:13:54.721471+0000","last_active":"2024-04-25T09:13:56.718983+0000","last_peered":"2024-04-25T09:13:56.718983+0000","last_clean":"2024-04-25T09:13:56.718983+0000","last_became_active":"2024-04-25T09:13:54.721191+0000","last_became_peered":"2024-04-25T09:13:54.721191+0000","last_unstale":"2024-04-25T09:13:56.718983+0000","last_undegraded":"2024-04-25T09:13:56.718983+0000","last_fullsized":"2024-04-25T09:13:56.718983+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:46.269519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861307+0000","last_change":"2024-04-25T09:13:55.732604+0000","last_active":"2024-04-25T09:13:56.861307+0000","last_peered":"2024-04-25T09:13:56.861307+0000","last_clean":"2024-04-25T09:13:56.861307+0000","last_became_active":"2024-04-25T09:13:55.732324+0000","last_became_peered":"2024-04-25T09:13:55.732324+0000","last_unstale":"2024-04-25T09:13:56.861307+0000","last_undegraded":"2024-04-25T09:13:56.861307+0000","last_fullsized":"2024-04-25T09:13:56.861307+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:15.045000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859797+0000","last_change":"2024-04-25T09:13:54.716876+0000","last_active":"2024-04-25T09:13:56.859797+0000","last_peered":"2024-04-25T09:13:56.859797+0000","last_clean":"2024-04-25T09:13:56.859797+0000","last_became_active":"2024-04-25T09:13:54.716393+0000","last_became_peered":"2024-04-25T09:13:54.716393+0000","last_unstale":"2024-04-25T09:13:56.859797+0000","last_undegraded":"2024-04-25T09:13:56.859797+0000","last_fullsized":"2024-04-25T09:13:56.859797+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:59.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859707+0000","last_change":"2024-04-25T09:13:55.735375+0000","last_active":"2024-04-25T09:13:56.859707+0000","last_peered":"2024-04-25T09:13:56.859707+0000","last_clean":"2024-04-25T09:13:56.859707+0000","last_became_active":"2024-04-25T09:13:55.735029+0000","last_became_peered":"2024-04-25T09:13:55.735029+0000","last_unstale":"2024-04-25T09:13:56.859707+0000","last_undegraded":"2024-04-25T09:13:56.859707+0000","last_fullsized":"2024-04-25T09:13:56.859707+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:36.437723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"144'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744839+0000","last_change":"2024-04-25T09:13:54.711897+0000","last_active":"2024-04-25T09:13:56.744839+0000","last_peered":"2024-04-25T09:13:56.744839+0000","last_clean":"2024-04-25T09:13:56.744839+0000","last_became_active":"2024-04-25T09:13:54.711470+0000","last_became_peered":"2024-04-25T09:13:54.711470+0000","last_unstale":"2024-04-25T09:13:56.744839+0000","last_undegraded":"2024-04-25T09:13:56.744839+0000","last_fullsized":"2024-04-25T09:13:56.744839+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:06.201178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744776+0000","last_change":"2024-04-25T09:13:55.733685+0000","last_active":"2024-04-25T09:13:56.744776+0000","last_peered":"2024-04-25T09:13:56.744776+0000","last_clean":"2024-04-25T09:13:56.744776+0000","last_became_active":"2024-04-25T09:13:55.733414+0000","last_became_peered":"2024-04-25T09:13:55.733414+0000","last_unstale":"2024-04-25T09:13:56.744776+0000","last_undegraded":"2024-04-25T09:13:56.744776+0000","last_fullsized":"2024-04-25T09:13:56.744776+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:27.123060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715849+0000","last_change":"2024-04-25T09:13:54.720758+0000","last_active":"2024-04-25T09:13:56.715849+0000","last_peered":"2024-04-25T09:13:56.715849+0000","last_clean":"2024-04-25T09:13:56.715849+0000","last_became_active":"2024-04-25T09:13:54.720451+0000","last_became_peered":"2024-04-25T09:13:54.720451+0000","last_unstale":"2024-04-25T09:13:56.715849+0000","last_undegraded":"2024-04-25T09:13:56.715849+0000","last_fullsized":"2024-04-25T09:13:56.715849+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:57.122054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861484+0000","last_change":"2024-04-25T09:13:55.744092+0000","last_active":"2024-04-25T09:13:56.861484+0000","last_peered":"2024-04-25T09:13:56.861484+0000","last_clean":"2024-04-25T09:13:56.861484+0000","last_became_active":"2024-04-25T09:13:55.743840+0000","last_became_peered":"2024-04-25T09:13:55.743840+0000","last_unstale":"2024-04-25T09:13:56.861484+0000","last_undegraded":"2024-04-25T09:13:56.861484+0000","last_fullsized":"2024-04-25T09:13:56.861484+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:58:31.565197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861229+0000","last_change":"2024-04-25T09:13:54.716548+0000","last_active":"2024-04-25T09:13:56.861229+0000","last_peered":"2024-04-25T09:13:56.861229+0000","last_clean":"2024-04-25T09:13:56.861229+0000","last_became_active":"2024-04-25T09:13:54.716256+0000","last_became_peered":"2024-04-25T09:13:54.716256+0000","last_unstale":"2024-04-25T09:13:56.861229+0000","last_undegraded":"2024-04-25T09:13:56.861229+0000","last_fullsized":"2024-04-25T09:13:56.861229+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:05.091617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718969+0000","last_change":"2024-04-25T09:13:55.732029+0000","last_active":"2024-04-25T09:13:56.718969+0000","last_peered":"2024-04-25T09:13:56.718969+0000","last_clean":"2024-04-25T09:13:56.718969+0000","last_became_active":"2024-04-25T09:13:55.729693+0000","last_became_peered":"2024-04-25T09:13:55.729693+0000","last_unstale":"2024-04-25T09:13:56.718969+0000","last_undegraded":"2024-04-25T09:13:56.718969+0000","last_fullsized":"2024-04-25T09:13:56.718969+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:38.859358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744314+0000","last_change":"2024-04-25T09:13:54.716381+0000","last_active":"2024-04-25T09:13:56.744314+0000","last_peered":"2024-04-25T09:13:56.744314+0000","last_clean":"2024-04-25T09:13:56.744314+0000","last_became_active":"2024-04-25T09:13:54.716074+0000","last_became_peered":"2024-04-25T09:13:54.716074+0000","last_unstale":"2024-04-25T09:13:56.744314+0000","last_undegraded":"2024-04-25T09:13:56.744314+0000","last_fullsized":"2024-04-25T09:13:56.744314+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:18.441099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859730+0000","last_change":"2024-04-25T09:13:55.733661+0000","last_active":"2024-04-25T09:13:56.859730+0000","last_peered":"2024-04-25T09:13:56.859730+0000","last_clean":"2024-04-25T09:13:56.859730+0000","last_became_active":"2024-04-25T09:13:55.730714+0000","last_became_peered":"2024-04-25T09:13:55.730714+0000","last_unstale":"2024-04-25T09:13:56.859730+0000","last_undegraded":"2024-04-25T09:13:56.859730+0000","last_fullsized":"2024-04-25T09:13:56.859730+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:21.063293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717763+0000","last_change":"2024-04-25T09:13:54.714803+0000","last_active":"2024-04-25T09:13:56.717763+0000","last_peered":"2024-04-25T09:13:56.717763+0000","last_clean":"2024-04-25T09:13:56.717763+0000","last_became_active":"2024-04-25T09:13:54.714545+0000","last_became_peered":"2024-04-25T09:13:54.714545+0000","last_unstale":"2024-04-25T09:13:56.717763+0000","last_undegraded":"2024-04-25T09:13:56.717763+0000","last_fullsized":"2024-04-25T09:13:56.717763+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:03.583888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715691+0000","last_change":"2024-04-25T09:13:55.734874+0000","last_active":"2024-04-25T09:13:56.715691+0000","last_peered":"2024-04-25T09:13:56.715691+0000","last_clean":"2024-04-25T09:13:56.715691+0000","last_became_active":"2024-04-25T09:13:55.734098+0000","last_became_peered":"2024-04-25T09:13:55.734098+0000","last_unstale":"2024-04-25T09:13:56.715691+0000","last_undegraded":"2024-04-25T09:13:56.715691+0000","last_fullsized":"2024-04-25T09:13:56.715691+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:22.352749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744390+0000","last_change":"2024-04-25T09:13:54.717868+0000","last_active":"2024-04-25T09:13:56.744390+0000","last_peered":"2024-04-25T09:13:56.744390+0000","last_clean":"2024-04-25T09:13:56.744390+0000","last_became_active":"2024-04-25T09:13:54.717368+0000","last_became_peered":"2024-04-25T09:13:54.717368+0000","last_unstale":"2024-04-25T09:13:56.744390+0000","last_undegraded":"2024-04-25T09:13:56.744390+0000","last_fullsized":"2024-04-25T09:13:56.744390+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:41.299316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718956+0000","last_change":"2024-04-25T09:13:55.739080+0000","last_active":"2024-04-25T09:13:56.718956+0000","last_peered":"2024-04-25T09:13:56.718956+0000","last_clean":"2024-04-25T09:13:56.718956+0000","last_became_active":"2024-04-25T09:13:55.738763+0000","last_became_peered":"2024-04-25T09:13:55.738763+0000","last_unstale":"2024-04-25T09:13:56.718956+0000","last_undegraded":"2024-04-25T09:13:56.718956+0000","last_fullsized":"2024-04-25T09:13:56.718956+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:38.876620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.746962+0000","last_change":"2024-04-25T09:13:54.717287+0000","last_active":"2024-04-25T09:13:56.746962+0000","last_peered":"2024-04-25T09:13:56.746962+0000","last_clean":"2024-04-25T09:13:56.746962+0000","last_became_active":"2024-04-25T09:13:54.716916+0000","last_became_peered":"2024-04-25T09:13:54.716916+0000","last_unstale":"2024-04-25T09:13:56.746962+0000","last_undegraded":"2024-04-25T09:13:56.746962+0000","last_fullsized":"2024-04-25T09:13:56.746962+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:57.944637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.719329+0000","last_change":"2024-04-25T09:13:55.729921+0000","last_active":"2024-04-25T09:13:56.719329+0000","last_peered":"2024-04-25T09:13:56.719329+0000","last_clean":"2024-04-25T09:13:56.719329+0000","last_became_active":"2024-04-25T09:13:55.729571+0000","last_became_peered":"2024-04-25T09:13:55.729571+0000","last_unstale":"2024-04-25T09:13:56.719329+0000","last_undegraded":"2024-04-25T09:13:56.719329+0000","last_fullsized":"2024-04-25T09:13:56.719329+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:32.958371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"143'6","reported_seq":20,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.860971+0000","last_change":"2024-04-25T09:13:54.720531+0000","last_active":"2024-04-25T09:13:56.860971+0000","last_peered":"2024-04-25T09:13:56.860971+0000","last_clean":"2024-04-25T09:13:56.860971+0000","last_became_active":"2024-04-25T09:13:54.719653+0000","last_became_peered":"2024-04-25T09:13:54.719653+0000","last_unstale":"2024-04-25T09:13:56.860971+0000","last_undegraded":"2024-04-25T09:13:56.860971+0000","last_fullsized":"2024-04-25T09:13:56.860971+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:23.224519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":397,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747058+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:13:56.747058+0000","last_peered":"2024-04-25T09:13:56.747058+0000","last_clean":"2024-04-25T09:13:56.747058+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:13:56.747058+0000","last_undegraded":"2024-04-25T09:13:56.747058+0000","last_fullsized":"2024-04-25T09:13:56.747058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509579,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55152,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316688,"statfs":{"total":96636764160,"available":96580288512,"internally_reserved":0,"allocated":1802240,"data_stored":839768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509579,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50988,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320852,"statfs":{"total":96636764160,"available":96584552448,"internally_reserved":0,"allocated":1798144,"data_stored":839698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509580,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46836,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325004,"statfs":{"total":96636764160,"available":96588804096,"internally_reserved":0,"allocated":1810432,"data_stored":841310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509579,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81460,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":94290380,"statfs":{"total":96636764160,"available":96553349120,"internally_reserved":0,"allocated":1806336,"data_stored":840314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":81590727},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509579,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55156,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316684,"statfs":{"total":96636764160,"available":96580284416,"internally_reserved":0,"allocated":1806336,"data_stored":839810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509580,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55156,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316684,"statfs":{"total":96636764160,"available":96580284416,"internally_reserved":0,"allocated":1802240,"data_stored":839768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509580,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59912,"kb_used_data":2360,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311928,"statfs":{"total":96636764160,"available":96575414272,"internally_reserved":0,"allocated":2416640,"data_stored":1432384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574987,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55712,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316128,"statfs":{"total":96636764160,"available":96579715072,"internally_reserved":0,"allocated":2383872,"data_stored":1423396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:14:04.309 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:14:04.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.468+0000 7faa2a400640 1 Processor -- start 2024-04-25T09:14:04.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.468+0000 7faa2a400640 1 -- start start 2024-04-25T09:14:04.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.472+0000 7faa2a400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa24145250 0x7faa2415c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.472+0000 7faa2a400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7faa240ccd30 0x7faa24071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.472+0000 7faa2a400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2415cec0 con 0x7faa240cc8b0 2024-04-25T09:14:04.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.472+0000 7faa2a400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa2406e7c0 con 0x7faa240ccd30 2024-04-25T09:14:04.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.472+0000 7faa2a400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2406d720 con 0x7faa24145250 2024-04-25T09:14:04.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.472+0000 7faa23e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7faa240ccd30 0x7faa24071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.472+0000 7faa23400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa24145250 0x7faa2415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.472+0000 7faa23e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7faa240ccd30 0x7faa24071a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:36502/0 (socket says 172.21.15.173:36502) 2024-04-25T09:14:04.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.472+0000 7faa23e00640 1 -- 172.21.15.173:0/1889169872 learned_addr learned my addr 172.21.15.173:0/1889169872 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:04.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.472+0000 7faa23e00640 1 -- 172.21.15.173:0/1889169872 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa24145250 msgr2=0x7faa2415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:04.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.472+0000 7faa23e00640 1 --2- 172.21.15.173:0/1889169872 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa24145250 0x7faa2415c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.472+0000 7faa23e00640 1 -- 172.21.15.173:0/1889169872 >> v1:172.21.15.194:6789/0 conn(0x7faa240cc8b0 legacy=0x7faa24071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.472+0000 7faa23e00640 1 -- 172.21.15.173:0/1889169872 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2406da00 con 0x7faa240ccd30 2024-04-25T09:14:04.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.476+0000 7faa23e00640 1 --2- 172.21.15.173:0/1889169872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa240ccd30 0x7faa24071a30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7faa1c009e50 tx=0x7faa1c01ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a1bf4ab1a4a4193 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:04.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.476+0000 7faa22a00640 1 -- 172.21.15.173:0/1889169872 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c0a58d0 con 0x7faa240ccd30 2024-04-25T09:14:04.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.476+0000 7faa22a00640 1 -- 172.21.15.173:0/1889169872 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1c0a5a70 con 0x7faa240ccd30 2024-04-25T09:14:04.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.476+0000 7faa22a00640 1 -- 172.21.15.173:0/1889169872 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c0a5e40 con 0x7faa240ccd30 2024-04-25T09:14:04.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.476+0000 7faa2a400640 1 -- 172.21.15.173:0/1889169872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa240ccd30 msgr2=0x7faa24071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.476+0000 7faa2a400640 1 --2- 172.21.15.173:0/1889169872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa240ccd30 0x7faa24071a30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7faa1c009e50 tx=0x7faa1c01ca00 comp rx=0 tx=0).stop 2024-04-25T09:14:04.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.476+0000 7faa2a400640 1 -- 172.21.15.173:0/1889169872 shutdown_connections 2024-04-25T09:14:04.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.476+0000 7faa2a400640 1 --2- 172.21.15.173:0/1889169872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa240ccd30 0x7faa24071a30 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.476+0000 7faa2a400640 1 --2- 172.21.15.173:0/1889169872 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa24145250 0x7faa2415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.476+0000 7faa2a400640 1 -- 172.21.15.173:0/1889169872 >> 172.21.15.173:0/1889169872 conn(0x7faa2406ac90 msgr2=0x7faa2406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:04.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.476+0000 7faa2a400640 1 -- 172.21.15.173:0/1889169872 shutdown_connections 2024-04-25T09:14:04.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.476+0000 7faa2a400640 1 -- 172.21.15.173:0/1889169872 wait complete. 2024-04-25T09:14:04.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.476+0000 7faa2a400640 1 Processor -- start 2024-04-25T09:14:04.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.476+0000 7faa2a400640 1 -- start start 2024-04-25T09:14:04.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa2a400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa240cc8b0 0x7faa2415b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa2a400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa240ccd30 0x7faa2413fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa2a400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa24145250 0x7faa241433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa2a400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa24145630 con 0x7faa240ccd30 2024-04-25T09:14:04.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa2a400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa240cd1a0 con 0x7faa240cc8b0 2024-04-25T09:14:04.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa2a400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2406ef80 con 0x7faa24145250 2024-04-25T09:14:04.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa1be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa240ccd30 0x7faa2413fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa1be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa240ccd30 0x7faa2413fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44258/0 (socket says 172.21.15.173:44258) 2024-04-25T09:14:04.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa1be00640 1 -- 172.21.15.173:0/3245143965 learned_addr learned my addr 172.21.15.173:0/3245143965 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:04.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa23400640 1 --2- 172.21.15.173:0/3245143965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa240cc8b0 0x7faa2415b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa23e00640 1 --2- 172.21.15.173:0/3245143965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa24145250 0x7faa241433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa1be00640 1 -- 172.21.15.173:0/3245143965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa24145250 msgr2=0x7faa241433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa1be00640 1 --2- 172.21.15.173:0/3245143965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa24145250 0x7faa241433b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa1be00640 1 -- 172.21.15.173:0/3245143965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa240cc8b0 msgr2=0x7faa2415b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa1be00640 1 --2- 172.21.15.173:0/3245143965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa240cc8b0 0x7faa2415b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa1be00640 1 -- 172.21.15.173:0/3245143965 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa24140240 con 0x7faa240ccd30 2024-04-25T09:14:04.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa23e00640 1 --2- 172.21.15.173:0/3245143965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa24145250 0x7faa241433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:04.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa1be00640 1 --2- 172.21.15.173:0/3245143965 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa240ccd30 0x7faa2413fac0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00c3a0 tx=0x7faa0c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:04.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa1b400640 1 -- 172.21.15.173:0/3245143965 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0052d0 con 0x7faa240ccd30 2024-04-25T09:14:04.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa1b400640 1 -- 172.21.15.173:0/3245143965 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c005470 con 0x7faa240ccd30 2024-04-25T09:14:04.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa2a400640 1 -- 172.21.15.173:0/3245143965 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa24140520 con 0x7faa240ccd30 2024-04-25T09:14:04.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa1b400640 1 -- 172.21.15.173:0/3245143965 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c007260 con 0x7faa240ccd30 2024-04-25T09:14:04.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa2a400640 1 -- 172.21.15.173:0/3245143965 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa24140ae0 con 0x7faa240ccd30 2024-04-25T09:14:04.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.480+0000 7faa2a400640 1 -- 172.21.15.173:0/3245143965 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa24073a40 con 0x7faa240ccd30 2024-04-25T09:14:04.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.484+0000 7faa1b400640 1 -- 172.21.15.173:0/3245143965 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faa0c007400 con 0x7faa240ccd30 2024-04-25T09:14:04.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.484+0000 7faa1b400640 1 --2- 172.21.15.173:0/3245143965 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faa00066f60 0x7faa00069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.484+0000 7faa1b400640 1 -- 172.21.15.173:0/3245143965 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faa0c084530 con 0x7faa240ccd30 2024-04-25T09:14:04.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.484+0000 7faa23400640 1 --2- 172.21.15.173:0/3245143965 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faa00066f60 0x7faa00069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.484+0000 7faa23400640 1 --2- 172.21.15.173:0/3245143965 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faa00066f60 0x7faa00069420 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7faa240cbf30 tx=0x7faa14009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:04.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.488+0000 7faa1b400640 1 -- 172.21.15.173:0/3245143965 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faa2415cec0 con 0x7faa240ccd30 2024-04-25T09:14:04.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.636+0000 7faa2a400640 1 -- 172.21.15.173:0/3245143965 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faa240aeae0 con 0x7faa00066f60 2024-04-25T09:14:04.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.644+0000 7faa1b400640 1 -- 172.21.15.173:0/3245143965 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252474 (secure 0 0 0) 0x7faa240aeae0 con 0x7faa00066f60 2024-04-25T09:14:04.632 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:04.633 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:14:04.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.648+0000 7faa2a400640 1 -- 172.21.15.173:0/3245143965 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faa00066f60 msgr2=0x7faa00069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.648+0000 7faa2a400640 1 --2- 172.21.15.173:0/3245143965 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faa00066f60 0x7faa00069420 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7faa240cbf30 tx=0x7faa14009190 comp rx=0 tx=0).stop 2024-04-25T09:14:04.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.648+0000 7faa2a400640 1 -- 172.21.15.173:0/3245143965 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa240ccd30 msgr2=0x7faa2413fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.648+0000 7faa2a400640 1 --2- 172.21.15.173:0/3245143965 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa240ccd30 0x7faa2413fac0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00c3a0 tx=0x7faa0c00c860 comp rx=0 tx=0).stop 2024-04-25T09:14:04.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.648+0000 7faa2a400640 1 -- 172.21.15.173:0/3245143965 shutdown_connections 2024-04-25T09:14:04.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.648+0000 7faa2a400640 1 --2- 172.21.15.173:0/3245143965 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7faa00066f60 0x7faa00069420 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.648+0000 7faa2a400640 1 --2- 172.21.15.173:0/3245143965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa24145250 0x7faa241433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.648+0000 7faa2a400640 1 --2- 172.21.15.173:0/3245143965 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa240ccd30 0x7faa2413fac0 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.648+0000 7faa2a400640 1 --2- 172.21.15.173:0/3245143965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa240cc8b0 0x7faa2415b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.648+0000 7faa2a400640 1 -- 172.21.15.173:0/3245143965 >> 172.21.15.173:0/3245143965 conn(0x7faa2406ac90 msgr2=0x7faa240ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:04.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.648+0000 7faa2a400640 1 -- 172.21.15.173:0/3245143965 shutdown_connections 2024-04-25T09:14:04.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.648+0000 7faa2a400640 1 -- 172.21.15.173:0/3245143965 wait complete. 2024-04-25T09:14:04.652 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":480,"stamp":"2024-04-25T09:14:02.876435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":460388,"kb_used_data":15272,"kb_used_omap":12,"kb_used_meta":444979,"kb_avail":754514332,"statfs":{"total":773094113280,"available":772622675968,"internally_reserved":0,"allocated":15638528,"data_stored":7903140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":455659056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001797"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744686+0000","last_change":"2024-04-25T09:13:55.739430+0000","last_active":"2024-04-25T09:13:56.744686+0000","last_peered":"2024-04-25T09:13:56.744686+0000","last_clean":"2024-04-25T09:13:56.744686+0000","last_became_active":"2024-04-25T09:13:55.739174+0000","last_became_peered":"2024-04-25T09:13:55.739174+0000","last_unstale":"2024-04-25T09:13:56.744686+0000","last_undegraded":"2024-04-25T09:13:56.744686+0000","last_fullsized":"2024-04-25T09:13:56.744686+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:27.328317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715411+0000","last_change":"2024-04-25T09:13:55.731753+0000","last_active":"2024-04-25T09:13:56.715411+0000","last_peered":"2024-04-25T09:13:56.715411+0000","last_clean":"2024-04-25T09:13:56.715411+0000","last_became_active":"2024-04-25T09:13:55.731459+0000","last_became_peered":"2024-04-25T09:13:55.731459+0000","last_unstale":"2024-04-25T09:13:56.715411+0000","last_undegraded":"2024-04-25T09:13:56.715411+0000","last_fullsized":"2024-04-25T09:13:56.715411+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:46.095714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715804+0000","last_change":"2024-04-25T09:13:55.743368+0000","last_active":"2024-04-25T09:13:56.715804+0000","last_peered":"2024-04-25T09:13:56.715804+0000","last_clean":"2024-04-25T09:13:56.715804+0000","last_became_active":"2024-04-25T09:13:55.743093+0000","last_became_peered":"2024-04-25T09:13:55.743093+0000","last_unstale":"2024-04-25T09:13:56.715804+0000","last_undegraded":"2024-04-25T09:13:56.715804+0000","last_fullsized":"2024-04-25T09:13:56.715804+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:14.878857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859477+0000","last_change":"2024-04-25T09:13:55.734486+0000","last_active":"2024-04-25T09:13:56.859477+0000","last_peered":"2024-04-25T09:13:56.859477+0000","last_clean":"2024-04-25T09:13:56.859477+0000","last_became_active":"2024-04-25T09:13:55.734217+0000","last_became_peered":"2024-04-25T09:13:55.734217+0000","last_unstale":"2024-04-25T09:13:56.859477+0000","last_undegraded":"2024-04-25T09:13:56.859477+0000","last_fullsized":"2024-04-25T09:13:56.859477+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:39.549827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861559+0000","last_change":"2024-04-25T09:13:55.741243+0000","last_active":"2024-04-25T09:13:56.861559+0000","last_peered":"2024-04-25T09:13:56.861559+0000","last_clean":"2024-04-25T09:13:56.861559+0000","last_became_active":"2024-04-25T09:13:55.740909+0000","last_became_peered":"2024-04-25T09:13:55.740909+0000","last_unstale":"2024-04-25T09:13:56.861559+0000","last_undegraded":"2024-04-25T09:13:56.861559+0000","last_fullsized":"2024-04-25T09:13:56.861559+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:03.210563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861005+0000","last_change":"2024-04-25T09:13:55.740799+0000","last_active":"2024-04-25T09:13:56.861005+0000","last_peered":"2024-04-25T09:13:56.861005+0000","last_clean":"2024-04-25T09:13:56.861005+0000","last_became_active":"2024-04-25T09:13:55.740524+0000","last_became_peered":"2024-04-25T09:13:55.740524+0000","last_unstale":"2024-04-25T09:13:56.861005+0000","last_undegraded":"2024-04-25T09:13:56.861005+0000","last_fullsized":"2024-04-25T09:13:56.861005+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:52.219293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744404+0000","last_change":"2024-04-25T09:13:55.733981+0000","last_active":"2024-04-25T09:13:56.744404+0000","last_peered":"2024-04-25T09:13:56.744404+0000","last_clean":"2024-04-25T09:13:56.744404+0000","last_became_active":"2024-04-25T09:13:55.733716+0000","last_became_peered":"2024-04-25T09:13:55.733716+0000","last_unstale":"2024-04-25T09:13:56.744404+0000","last_undegraded":"2024-04-25T09:13:56.744404+0000","last_fullsized":"2024-04-25T09:13:56.744404+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:11.094825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718572+0000","last_change":"2024-04-25T09:13:55.729955+0000","last_active":"2024-04-25T09:13:56.718572+0000","last_peered":"2024-04-25T09:13:56.718572+0000","last_clean":"2024-04-25T09:13:56.718572+0000","last_became_active":"2024-04-25T09:13:55.729182+0000","last_became_peered":"2024-04-25T09:13:55.729182+0000","last_unstale":"2024-04-25T09:13:56.718572+0000","last_undegraded":"2024-04-25T09:13:56.718572+0000","last_fullsized":"2024-04-25T09:13:56.718572+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:19.448933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861474+0000","last_change":"2024-04-25T09:13:55.745734+0000","last_active":"2024-04-25T09:13:56.861474+0000","last_peered":"2024-04-25T09:13:56.861474+0000","last_clean":"2024-04-25T09:13:56.861474+0000","last_became_active":"2024-04-25T09:13:55.745400+0000","last_became_peered":"2024-04-25T09:13:55.745400+0000","last_unstale":"2024-04-25T09:13:56.861474+0000","last_undegraded":"2024-04-25T09:13:56.861474+0000","last_fullsized":"2024-04-25T09:13:56.861474+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:16:40.067491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861419+0000","last_change":"2024-04-25T09:13:55.737735+0000","last_active":"2024-04-25T09:13:56.861419+0000","last_peered":"2024-04-25T09:13:56.861419+0000","last_clean":"2024-04-25T09:13:56.861419+0000","last_became_active":"2024-04-25T09:13:55.737220+0000","last_became_peered":"2024-04-25T09:13:55.737220+0000","last_unstale":"2024-04-25T09:13:56.861419+0000","last_undegraded":"2024-04-25T09:13:56.861419+0000","last_fullsized":"2024-04-25T09:13:56.861419+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:25:39.787497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717953+0000","last_change":"2024-04-25T09:13:55.742900+0000","last_active":"2024-04-25T09:13:56.717953+0000","last_peered":"2024-04-25T09:13:56.717953+0000","last_clean":"2024-04-25T09:13:56.717953+0000","last_became_active":"2024-04-25T09:13:55.742544+0000","last_became_peered":"2024-04-25T09:13:55.742544+0000","last_unstale":"2024-04-25T09:13:56.717953+0000","last_undegraded":"2024-04-25T09:13:56.717953+0000","last_fullsized":"2024-04-25T09:13:56.717953+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:41.376893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859536+0000","last_change":"2024-04-25T09:13:55.733790+0000","last_active":"2024-04-25T09:13:56.859536+0000","last_peered":"2024-04-25T09:13:56.859536+0000","last_clean":"2024-04-25T09:13:56.859536+0000","last_became_active":"2024-04-25T09:13:55.733509+0000","last_became_peered":"2024-04-25T09:13:55.733509+0000","last_unstale":"2024-04-25T09:13:56.859536+0000","last_undegraded":"2024-04-25T09:13:56.859536+0000","last_fullsized":"2024-04-25T09:13:56.859536+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:16.185850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861441+0000","last_change":"2024-04-25T09:13:55.736605+0000","last_active":"2024-04-25T09:13:56.861441+0000","last_peered":"2024-04-25T09:13:56.861441+0000","last_clean":"2024-04-25T09:13:56.861441+0000","last_became_active":"2024-04-25T09:13:55.735964+0000","last_became_peered":"2024-04-25T09:13:55.735964+0000","last_unstale":"2024-04-25T09:13:56.861441+0000","last_undegraded":"2024-04-25T09:13:56.861441+0000","last_fullsized":"2024-04-25T09:13:56.861441+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:56.853832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859398+0000","last_change":"2024-04-25T09:13:55.731244+0000","last_active":"2024-04-25T09:13:56.859398+0000","last_peered":"2024-04-25T09:13:56.859398+0000","last_clean":"2024-04-25T09:13:56.859398+0000","last_became_active":"2024-04-25T09:13:55.730979+0000","last_became_peered":"2024-04-25T09:13:55.730979+0000","last_unstale":"2024-04-25T09:13:56.859398+0000","last_undegraded":"2024-04-25T09:13:56.859398+0000","last_fullsized":"2024-04-25T09:13:56.859398+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:01.687460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715343+0000","last_change":"2024-04-25T09:13:55.731458+0000","last_active":"2024-04-25T09:13:56.715343+0000","last_peered":"2024-04-25T09:13:56.715343+0000","last_clean":"2024-04-25T09:13:56.715343+0000","last_became_active":"2024-04-25T09:13:55.730798+0000","last_became_peered":"2024-04-25T09:13:55.730798+0000","last_unstale":"2024-04-25T09:13:56.715343+0000","last_undegraded":"2024-04-25T09:13:56.715343+0000","last_fullsized":"2024-04-25T09:13:56.715343+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:29.286768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.860667+0000","last_change":"2024-04-25T09:13:55.741769+0000","last_active":"2024-04-25T09:13:56.860667+0000","last_peered":"2024-04-25T09:13:56.860667+0000","last_clean":"2024-04-25T09:13:56.860667+0000","last_became_active":"2024-04-25T09:13:55.741471+0000","last_became_peered":"2024-04-25T09:13:55.741471+0000","last_unstale":"2024-04-25T09:13:56.860667+0000","last_undegraded":"2024-04-25T09:13:56.860667+0000","last_fullsized":"2024-04-25T09:13:56.860667+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:43.633215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859832+0000","last_change":"2024-04-25T09:13:55.735014+0000","last_active":"2024-04-25T09:13:56.859832+0000","last_peered":"2024-04-25T09:13:56.859832+0000","last_clean":"2024-04-25T09:13:56.859832+0000","last_became_active":"2024-04-25T09:13:55.734723+0000","last_became_peered":"2024-04-25T09:13:55.734723+0000","last_unstale":"2024-04-25T09:13:56.859832+0000","last_undegraded":"2024-04-25T09:13:56.859832+0000","last_fullsized":"2024-04-25T09:13:56.859832+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:38.230239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718028+0000","last_change":"2024-04-25T09:13:55.722825+0000","last_active":"2024-04-25T09:13:56.718028+0000","last_peered":"2024-04-25T09:13:56.718028+0000","last_clean":"2024-04-25T09:13:56.718028+0000","last_became_active":"2024-04-25T09:13:55.722426+0000","last_became_peered":"2024-04-25T09:13:55.722426+0000","last_unstale":"2024-04-25T09:13:56.718028+0000","last_undegraded":"2024-04-25T09:13:56.718028+0000","last_fullsized":"2024-04-25T09:13:56.718028+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:22.040179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747436+0000","last_change":"2024-04-25T09:13:55.746333+0000","last_active":"2024-04-25T09:13:56.747436+0000","last_peered":"2024-04-25T09:13:56.747436+0000","last_clean":"2024-04-25T09:13:56.747436+0000","last_became_active":"2024-04-25T09:13:55.742104+0000","last_became_peered":"2024-04-25T09:13:55.742104+0000","last_unstale":"2024-04-25T09:13:56.747436+0000","last_undegraded":"2024-04-25T09:13:56.747436+0000","last_fullsized":"2024-04-25T09:13:56.747436+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:42.683250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.860917+0000","last_change":"2024-04-25T09:13:55.723883+0000","last_active":"2024-04-25T09:13:56.860917+0000","last_peered":"2024-04-25T09:13:56.860917+0000","last_clean":"2024-04-25T09:13:56.860917+0000","last_became_active":"2024-04-25T09:13:55.723607+0000","last_became_peered":"2024-04-25T09:13:55.723607+0000","last_unstale":"2024-04-25T09:13:56.860917+0000","last_undegraded":"2024-04-25T09:13:56.860917+0000","last_fullsized":"2024-04-25T09:13:56.860917+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:08.088176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861527+0000","last_change":"2024-04-25T09:13:55.744575+0000","last_active":"2024-04-25T09:13:56.861527+0000","last_peered":"2024-04-25T09:13:56.861527+0000","last_clean":"2024-04-25T09:13:56.861527+0000","last_became_active":"2024-04-25T09:13:55.744322+0000","last_became_peered":"2024-04-25T09:13:55.744322+0000","last_unstale":"2024-04-25T09:13:56.861527+0000","last_undegraded":"2024-04-25T09:13:56.861527+0000","last_fullsized":"2024-04-25T09:13:56.861527+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:21.219968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744296+0000","last_change":"2024-04-25T09:13:55.734873+0000","last_active":"2024-04-25T09:13:56.744296+0000","last_peered":"2024-04-25T09:13:56.744296+0000","last_clean":"2024-04-25T09:13:56.744296+0000","last_became_active":"2024-04-25T09:13:55.734615+0000","last_became_peered":"2024-04-25T09:13:55.734615+0000","last_unstale":"2024-04-25T09:13:56.744296+0000","last_undegraded":"2024-04-25T09:13:56.744296+0000","last_fullsized":"2024-04-25T09:13:56.744296+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:18.238741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718589+0000","last_change":"2024-04-25T09:13:55.735485+0000","last_active":"2024-04-25T09:13:56.718589+0000","last_peered":"2024-04-25T09:13:56.718589+0000","last_clean":"2024-04-25T09:13:56.718589+0000","last_became_active":"2024-04-25T09:13:55.735129+0000","last_became_peered":"2024-04-25T09:13:55.735129+0000","last_unstale":"2024-04-25T09:13:56.718589+0000","last_undegraded":"2024-04-25T09:13:56.718589+0000","last_fullsized":"2024-04-25T09:13:56.718589+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:42.307150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717775+0000","last_change":"2024-04-25T09:13:55.730791+0000","last_active":"2024-04-25T09:13:56.717775+0000","last_peered":"2024-04-25T09:13:56.717775+0000","last_clean":"2024-04-25T09:13:56.717775+0000","last_became_active":"2024-04-25T09:13:55.730465+0000","last_became_peered":"2024-04-25T09:13:55.730465+0000","last_unstale":"2024-04-25T09:13:56.717775+0000","last_undegraded":"2024-04-25T09:13:56.717775+0000","last_fullsized":"2024-04-25T09:13:56.717775+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:17.012203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744748+0000","last_change":"2024-04-25T09:13:55.718562+0000","last_active":"2024-04-25T09:13:56.744748+0000","last_peered":"2024-04-25T09:13:56.744748+0000","last_clean":"2024-04-25T09:13:56.744748+0000","last_became_active":"2024-04-25T09:13:55.717190+0000","last_became_peered":"2024-04-25T09:13:55.717190+0000","last_unstale":"2024-04-25T09:13:56.744748+0000","last_undegraded":"2024-04-25T09:13:56.744748+0000","last_fullsized":"2024-04-25T09:13:56.744748+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:39.295110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744620+0000","last_change":"2024-04-25T09:13:55.724430+0000","last_active":"2024-04-25T09:13:56.744620+0000","last_peered":"2024-04-25T09:13:56.744620+0000","last_clean":"2024-04-25T09:13:56.744620+0000","last_became_active":"2024-04-25T09:13:55.722760+0000","last_became_peered":"2024-04-25T09:13:55.722760+0000","last_unstale":"2024-04-25T09:13:56.744620+0000","last_undegraded":"2024-04-25T09:13:56.744620+0000","last_fullsized":"2024-04-25T09:13:56.744620+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:44.333225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861310+0000","last_change":"2024-04-25T09:13:55.745744+0000","last_active":"2024-04-25T09:13:56.861310+0000","last_peered":"2024-04-25T09:13:56.861310+0000","last_clean":"2024-04-25T09:13:56.861310+0000","last_became_active":"2024-04-25T09:13:55.745402+0000","last_became_peered":"2024-04-25T09:13:55.745402+0000","last_unstale":"2024-04-25T09:13:56.861310+0000","last_undegraded":"2024-04-25T09:13:56.861310+0000","last_fullsized":"2024-04-25T09:13:56.861310+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:19.880348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717921+0000","last_change":"2024-04-25T09:13:55.719281+0000","last_active":"2024-04-25T09:13:56.717921+0000","last_peered":"2024-04-25T09:13:56.717921+0000","last_clean":"2024-04-25T09:13:56.717921+0000","last_became_active":"2024-04-25T09:13:55.718404+0000","last_became_peered":"2024-04-25T09:13:55.718404+0000","last_unstale":"2024-04-25T09:13:56.717921+0000","last_undegraded":"2024-04-25T09:13:56.717921+0000","last_fullsized":"2024-04-25T09:13:56.717921+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:38.672115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718918+0000","last_change":"2024-04-25T09:13:55.738241+0000","last_active":"2024-04-25T09:13:56.718918+0000","last_peered":"2024-04-25T09:13:56.718918+0000","last_clean":"2024-04-25T09:13:56.718918+0000","last_became_active":"2024-04-25T09:13:55.737964+0000","last_became_peered":"2024-04-25T09:13:55.737964+0000","last_unstale":"2024-04-25T09:13:56.718918+0000","last_undegraded":"2024-04-25T09:13:56.718918+0000","last_fullsized":"2024-04-25T09:13:56.718918+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:51.326239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717841+0000","last_change":"2024-04-25T09:13:55.728441+0000","last_active":"2024-04-25T09:13:56.717841+0000","last_peered":"2024-04-25T09:13:56.717841+0000","last_clean":"2024-04-25T09:13:56.717841+0000","last_became_active":"2024-04-25T09:13:55.727618+0000","last_became_peered":"2024-04-25T09:13:55.727618+0000","last_unstale":"2024-04-25T09:13:56.717841+0000","last_undegraded":"2024-04-25T09:13:56.717841+0000","last_fullsized":"2024-04-25T09:13:56.717841+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:00.943778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.860738+0000","last_change":"2024-04-25T09:13:55.742537+0000","last_active":"2024-04-25T09:13:56.860738+0000","last_peered":"2024-04-25T09:13:56.860738+0000","last_clean":"2024-04-25T09:13:56.860738+0000","last_became_active":"2024-04-25T09:13:55.741611+0000","last_became_peered":"2024-04-25T09:13:55.741611+0000","last_unstale":"2024-04-25T09:13:56.860738+0000","last_undegraded":"2024-04-25T09:13:56.860738+0000","last_fullsized":"2024-04-25T09:13:56.860738+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:34.087251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718702+0000","last_change":"2024-04-25T09:13:55.732525+0000","last_active":"2024-04-25T09:13:56.718702+0000","last_peered":"2024-04-25T09:13:56.718702+0000","last_clean":"2024-04-25T09:13:56.718702+0000","last_became_active":"2024-04-25T09:13:55.731714+0000","last_became_peered":"2024-04-25T09:13:55.731714+0000","last_unstale":"2024-04-25T09:13:56.718702+0000","last_undegraded":"2024-04-25T09:13:56.718702+0000","last_fullsized":"2024-04-25T09:13:56.718702+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:07.209012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715501+0000","last_change":"2024-04-25T09:13:55.738656+0000","last_active":"2024-04-25T09:13:56.715501+0000","last_peered":"2024-04-25T09:13:56.715501+0000","last_clean":"2024-04-25T09:13:56.715501+0000","last_became_active":"2024-04-25T09:13:55.738364+0000","last_became_peered":"2024-04-25T09:13:55.738364+0000","last_unstale":"2024-04-25T09:13:56.715501+0000","last_undegraded":"2024-04-25T09:13:56.715501+0000","last_fullsized":"2024-04-25T09:13:56.715501+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:25:55.791917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"143'4","reported_seq":18,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861510+0000","last_change":"2024-04-25T09:13:54.712424+0000","last_active":"2024-04-25T09:13:56.861510+0000","last_peered":"2024-04-25T09:13:56.861510+0000","last_clean":"2024-04-25T09:13:56.861510+0000","last_became_active":"2024-04-25T09:13:54.712149+0000","last_became_peered":"2024-04-25T09:13:54.712149+0000","last_unstale":"2024-04-25T09:13:56.861510+0000","last_undegraded":"2024-04-25T09:13:56.861510+0000","last_fullsized":"2024-04-25T09:13:56.861510+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:08.263244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715730+0000","last_change":"2024-04-25T09:13:55.732239+0000","last_active":"2024-04-25T09:13:56.715730+0000","last_peered":"2024-04-25T09:13:56.715730+0000","last_clean":"2024-04-25T09:13:56.715730+0000","last_became_active":"2024-04-25T09:13:55.731565+0000","last_became_peered":"2024-04-25T09:13:55.731565+0000","last_unstale":"2024-04-25T09:13:56.715730+0000","last_undegraded":"2024-04-25T09:13:56.715730+0000","last_fullsized":"2024-04-25T09:13:56.715730+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:36.500545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747249+0000","last_change":"2024-04-25T09:13:54.714659+0000","last_active":"2024-04-25T09:13:56.747249+0000","last_peered":"2024-04-25T09:13:56.747249+0000","last_clean":"2024-04-25T09:13:56.747249+0000","last_became_active":"2024-04-25T09:13:54.713833+0000","last_became_peered":"2024-04-25T09:13:54.713833+0000","last_unstale":"2024-04-25T09:13:56.747249+0000","last_undegraded":"2024-04-25T09:13:56.747249+0000","last_fullsized":"2024-04-25T09:13:56.747249+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:08.263244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.719211+0000","last_change":"2024-04-25T09:13:55.733261+0000","last_active":"2024-04-25T09:13:56.719211+0000","last_peered":"2024-04-25T09:13:56.719211+0000","last_clean":"2024-04-25T09:13:56.719211+0000","last_became_active":"2024-04-25T09:13:55.733020+0000","last_became_peered":"2024-04-25T09:13:55.733020+0000","last_unstale":"2024-04-25T09:13:56.719211+0000","last_undegraded":"2024-04-25T09:13:56.719211+0000","last_fullsized":"2024-04-25T09:13:56.719211+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:54.903745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747551+0000","last_change":"2024-04-25T09:13:54.715020+0000","last_active":"2024-04-25T09:13:56.747551+0000","last_peered":"2024-04-25T09:13:56.747551+0000","last_clean":"2024-04-25T09:13:56.747551+0000","last_became_active":"2024-04-25T09:13:54.714699+0000","last_became_peered":"2024-04-25T09:13:54.714699+0000","last_unstale":"2024-04-25T09:13:56.747551+0000","last_undegraded":"2024-04-25T09:13:56.747551+0000","last_fullsized":"2024-04-25T09:13:56.747551+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:05.091617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747414+0000","last_change":"2024-04-25T09:13:55.742805+0000","last_active":"2024-04-25T09:13:56.747414+0000","last_peered":"2024-04-25T09:13:56.747414+0000","last_clean":"2024-04-25T09:13:56.747414+0000","last_became_active":"2024-04-25T09:13:55.742529+0000","last_became_peered":"2024-04-25T09:13:55.742529+0000","last_unstale":"2024-04-25T09:13:56.747414+0000","last_undegraded":"2024-04-25T09:13:56.747414+0000","last_fullsized":"2024-04-25T09:13:56.747414+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:38.099089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715554+0000","last_change":"2024-04-25T09:13:54.720172+0000","last_active":"2024-04-25T09:13:56.715554+0000","last_peered":"2024-04-25T09:13:56.715554+0000","last_clean":"2024-04-25T09:13:56.715554+0000","last_became_active":"2024-04-25T09:13:54.719871+0000","last_became_peered":"2024-04-25T09:13:54.719871+0000","last_unstale":"2024-04-25T09:13:56.715554+0000","last_undegraded":"2024-04-25T09:13:56.715554+0000","last_fullsized":"2024-04-25T09:13:56.715554+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:53.158181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.860987+0000","last_change":"2024-04-25T09:13:55.719950+0000","last_active":"2024-04-25T09:13:56.860987+0000","last_peered":"2024-04-25T09:13:56.860987+0000","last_clean":"2024-04-25T09:13:56.860987+0000","last_became_active":"2024-04-25T09:13:55.718648+0000","last_became_peered":"2024-04-25T09:13:55.718648+0000","last_unstale":"2024-04-25T09:13:56.860987+0000","last_undegraded":"2024-04-25T09:13:56.860987+0000","last_fullsized":"2024-04-25T09:13:56.860987+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:58.698810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718983+0000","last_change":"2024-04-25T09:13:54.722160+0000","last_active":"2024-04-25T09:13:56.718983+0000","last_peered":"2024-04-25T09:13:56.718983+0000","last_clean":"2024-04-25T09:13:56.718983+0000","last_became_active":"2024-04-25T09:13:54.721822+0000","last_became_peered":"2024-04-25T09:13:54.721822+0000","last_unstale":"2024-04-25T09:13:56.718983+0000","last_undegraded":"2024-04-25T09:13:56.718983+0000","last_fullsized":"2024-04-25T09:13:56.718983+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:43.002194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859785+0000","last_change":"2024-04-25T09:13:55.728385+0000","last_active":"2024-04-25T09:13:56.859785+0000","last_peered":"2024-04-25T09:13:56.859785+0000","last_clean":"2024-04-25T09:13:56.859785+0000","last_became_active":"2024-04-25T09:13:55.725682+0000","last_became_peered":"2024-04-25T09:13:55.725682+0000","last_unstale":"2024-04-25T09:13:56.859785+0000","last_undegraded":"2024-04-25T09:13:56.859785+0000","last_fullsized":"2024-04-25T09:13:56.859785+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:40.920356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861082+0000","last_change":"2024-04-25T09:13:54.715294+0000","last_active":"2024-04-25T09:13:56.861082+0000","last_peered":"2024-04-25T09:13:56.861082+0000","last_clean":"2024-04-25T09:13:56.861082+0000","last_became_active":"2024-04-25T09:13:54.715020+0000","last_became_peered":"2024-04-25T09:13:54.715020+0000","last_unstale":"2024-04-25T09:13:56.861082+0000","last_undegraded":"2024-04-25T09:13:56.861082+0000","last_fullsized":"2024-04-25T09:13:56.861082+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:13.989630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715360+0000","last_change":"2024-04-25T09:13:55.726245+0000","last_active":"2024-04-25T09:13:56.715360+0000","last_peered":"2024-04-25T09:13:56.715360+0000","last_clean":"2024-04-25T09:13:56.715360+0000","last_became_active":"2024-04-25T09:13:55.724732+0000","last_became_peered":"2024-04-25T09:13:55.724732+0000","last_unstale":"2024-04-25T09:13:56.715360+0000","last_undegraded":"2024-04-25T09:13:56.715360+0000","last_fullsized":"2024-04-25T09:13:56.715360+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:00.225839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744252+0000","last_change":"2024-04-25T09:13:54.718521+0000","last_active":"2024-04-25T09:13:56.744252+0000","last_peered":"2024-04-25T09:13:56.744252+0000","last_clean":"2024-04-25T09:13:56.744252+0000","last_became_active":"2024-04-25T09:13:54.718221+0000","last_became_peered":"2024-04-25T09:13:54.718221+0000","last_unstale":"2024-04-25T09:13:56.744252+0000","last_undegraded":"2024-04-25T09:13:56.744252+0000","last_fullsized":"2024-04-25T09:13:56.744252+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:17.473334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744439+0000","last_change":"2024-04-25T09:13:55.736243+0000","last_active":"2024-04-25T09:13:56.744439+0000","last_peered":"2024-04-25T09:13:56.744439+0000","last_clean":"2024-04-25T09:13:56.744439+0000","last_became_active":"2024-04-25T09:13:55.735982+0000","last_became_peered":"2024-04-25T09:13:55.735982+0000","last_unstale":"2024-04-25T09:13:56.744439+0000","last_undegraded":"2024-04-25T09:13:56.744439+0000","last_fullsized":"2024-04-25T09:13:56.744439+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:38.010004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.860624+0000","last_change":"2024-04-25T09:13:54.714496+0000","last_active":"2024-04-25T09:13:56.860624+0000","last_peered":"2024-04-25T09:13:56.860624+0000","last_clean":"2024-04-25T09:13:56.860624+0000","last_became_active":"2024-04-25T09:13:54.714235+0000","last_became_peered":"2024-04-25T09:13:54.714235+0000","last_unstale":"2024-04-25T09:13:56.860624+0000","last_undegraded":"2024-04-25T09:13:56.860624+0000","last_fullsized":"2024-04-25T09:13:56.860624+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:53.679821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.719173+0000","last_change":"2024-04-25T09:13:55.738261+0000","last_active":"2024-04-25T09:13:56.719173+0000","last_peered":"2024-04-25T09:13:56.719173+0000","last_clean":"2024-04-25T09:13:56.719173+0000","last_became_active":"2024-04-25T09:13:55.736409+0000","last_became_peered":"2024-04-25T09:13:55.736409+0000","last_unstale":"2024-04-25T09:13:56.719173+0000","last_undegraded":"2024-04-25T09:13:56.719173+0000","last_fullsized":"2024-04-25T09:13:56.719173+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:10.652545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747374+0000","last_change":"2024-04-25T09:13:54.706537+0000","last_active":"2024-04-25T09:13:56.747374+0000","last_peered":"2024-04-25T09:13:56.747374+0000","last_clean":"2024-04-25T09:13:56.747374+0000","last_became_active":"2024-04-25T09:13:54.706228+0000","last_became_peered":"2024-04-25T09:13:54.706228+0000","last_unstale":"2024-04-25T09:13:56.747374+0000","last_undegraded":"2024-04-25T09:13:56.747374+0000","last_fullsized":"2024-04-25T09:13:56.747374+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:01.382832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717999+0000","last_change":"2024-04-25T09:13:55.742803+0000","last_active":"2024-04-25T09:13:56.717999+0000","last_peered":"2024-04-25T09:13:56.717999+0000","last_clean":"2024-04-25T09:13:56.717999+0000","last_became_active":"2024-04-25T09:13:55.742513+0000","last_became_peered":"2024-04-25T09:13:55.742513+0000","last_unstale":"2024-04-25T09:13:56.717999+0000","last_undegraded":"2024-04-25T09:13:56.717999+0000","last_fullsized":"2024-04-25T09:13:56.717999+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:16.713216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744750+0000","last_change":"2024-04-25T09:13:54.716956+0000","last_active":"2024-04-25T09:13:56.744750+0000","last_peered":"2024-04-25T09:13:56.744750+0000","last_clean":"2024-04-25T09:13:56.744750+0000","last_became_active":"2024-04-25T09:13:54.716690+0000","last_became_peered":"2024-04-25T09:13:54.716690+0000","last_unstale":"2024-04-25T09:13:56.744750+0000","last_undegraded":"2024-04-25T09:13:56.744750+0000","last_fullsized":"2024-04-25T09:13:56.744750+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:55.037278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718134+0000","last_change":"2024-04-25T09:13:55.720321+0000","last_active":"2024-04-25T09:13:56.718134+0000","last_peered":"2024-04-25T09:13:56.718134+0000","last_clean":"2024-04-25T09:13:56.718134+0000","last_became_active":"2024-04-25T09:13:55.719998+0000","last_became_peered":"2024-04-25T09:13:55.719998+0000","last_unstale":"2024-04-25T09:13:56.718134+0000","last_undegraded":"2024-04-25T09:13:56.718134+0000","last_fullsized":"2024-04-25T09:13:56.718134+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:11.054761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"143'3","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718015+0000","last_change":"2024-04-25T09:13:54.716928+0000","last_active":"2024-04-25T09:13:56.718015+0000","last_peered":"2024-04-25T09:13:56.718015+0000","last_clean":"2024-04-25T09:13:56.718015+0000","last_became_active":"2024-04-25T09:13:54.716645+0000","last_became_peered":"2024-04-25T09:13:54.716645+0000","last_unstale":"2024-04-25T09:13:56.718015+0000","last_undegraded":"2024-04-25T09:13:56.718015+0000","last_fullsized":"2024-04-25T09:13:56.718015+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:04.981253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718807+0000","last_change":"2024-04-25T09:13:55.745233+0000","last_active":"2024-04-25T09:13:56.718807+0000","last_peered":"2024-04-25T09:13:56.718807+0000","last_clean":"2024-04-25T09:13:56.718807+0000","last_became_active":"2024-04-25T09:13:55.744918+0000","last_became_peered":"2024-04-25T09:13:55.744918+0000","last_unstale":"2024-04-25T09:13:56.718807+0000","last_undegraded":"2024-04-25T09:13:56.718807+0000","last_fullsized":"2024-04-25T09:13:56.718807+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:56.045112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861557+0000","last_change":"2024-04-25T09:13:54.704969+0000","last_active":"2024-04-25T09:13:56.861557+0000","last_peered":"2024-04-25T09:13:56.861557+0000","last_clean":"2024-04-25T09:13:56.861557+0000","last_became_active":"2024-04-25T09:13:54.704704+0000","last_became_peered":"2024-04-25T09:13:54.704704+0000","last_unstale":"2024-04-25T09:13:56.861557+0000","last_undegraded":"2024-04-25T09:13:56.861557+0000","last_fullsized":"2024-04-25T09:13:56.861557+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:57.944637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715358+0000","last_change":"2024-04-25T09:13:55.731197+0000","last_active":"2024-04-25T09:13:56.715358+0000","last_peered":"2024-04-25T09:13:56.715358+0000","last_clean":"2024-04-25T09:13:56.715358+0000","last_became_active":"2024-04-25T09:13:55.730734+0000","last_became_peered":"2024-04-25T09:13:55.730734+0000","last_unstale":"2024-04-25T09:13:56.715358+0000","last_undegraded":"2024-04-25T09:13:56.715358+0000","last_fullsized":"2024-04-25T09:13:56.715358+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:40.084792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859505+0000","last_change":"2024-04-25T09:13:54.720857+0000","last_active":"2024-04-25T09:13:56.859505+0000","last_peered":"2024-04-25T09:13:56.859505+0000","last_clean":"2024-04-25T09:13:56.859505+0000","last_became_active":"2024-04-25T09:13:54.720573+0000","last_became_peered":"2024-04-25T09:13:54.720573+0000","last_unstale":"2024-04-25T09:13:56.859505+0000","last_undegraded":"2024-04-25T09:13:56.859505+0000","last_fullsized":"2024-04-25T09:13:56.859505+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:32.716706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861121+0000","last_change":"2024-04-25T09:13:55.733785+0000","last_active":"2024-04-25T09:13:56.861121+0000","last_peered":"2024-04-25T09:13:56.861121+0000","last_clean":"2024-04-25T09:13:56.861121+0000","last_became_active":"2024-04-25T09:13:55.731849+0000","last_became_peered":"2024-04-25T09:13:55.731849+0000","last_unstale":"2024-04-25T09:13:56.861121+0000","last_undegraded":"2024-04-25T09:13:56.861121+0000","last_fullsized":"2024-04-25T09:13:56.861121+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:20.896002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859801+0000","last_change":"2024-04-25T09:13:54.719105+0000","last_active":"2024-04-25T09:13:56.859801+0000","last_peered":"2024-04-25T09:13:56.859801+0000","last_clean":"2024-04-25T09:13:56.859801+0000","last_became_active":"2024-04-25T09:13:54.718815+0000","last_became_peered":"2024-04-25T09:13:54.718815+0000","last_unstale":"2024-04-25T09:13:56.859801+0000","last_undegraded":"2024-04-25T09:13:56.859801+0000","last_fullsized":"2024-04-25T09:13:56.859801+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:17.230907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715722+0000","last_change":"2024-04-25T09:13:55.737771+0000","last_active":"2024-04-25T09:13:56.715722+0000","last_peered":"2024-04-25T09:13:56.715722+0000","last_clean":"2024-04-25T09:13:56.715722+0000","last_became_active":"2024-04-25T09:13:55.737464+0000","last_became_peered":"2024-04-25T09:13:55.737464+0000","last_unstale":"2024-04-25T09:13:56.715722+0000","last_undegraded":"2024-04-25T09:13:56.715722+0000","last_fullsized":"2024-04-25T09:13:56.715722+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:13.583189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"143'8","reported_seq":22,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744101+0000","last_change":"2024-04-25T09:13:54.713010+0000","last_active":"2024-04-25T09:13:56.744101+0000","last_peered":"2024-04-25T09:13:56.744101+0000","last_clean":"2024-04-25T09:13:56.744101+0000","last_became_active":"2024-04-25T09:13:54.712722+0000","last_became_peered":"2024-04-25T09:13:54.712722+0000","last_unstale":"2024-04-25T09:13:56.744101+0000","last_undegraded":"2024-04-25T09:13:56.744101+0000","last_fullsized":"2024-04-25T09:13:56.744101+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:23.728457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747260+0000","last_change":"2024-04-25T09:13:55.738271+0000","last_active":"2024-04-25T09:13:56.747260+0000","last_peered":"2024-04-25T09:13:56.747260+0000","last_clean":"2024-04-25T09:13:56.747260+0000","last_became_active":"2024-04-25T09:13:55.737962+0000","last_became_peered":"2024-04-25T09:13:55.737962+0000","last_unstale":"2024-04-25T09:13:56.747260+0000","last_undegraded":"2024-04-25T09:13:56.747260+0000","last_fullsized":"2024-04-25T09:13:56.747260+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:05.725971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718057+0000","last_change":"2024-04-25T09:13:54.715032+0000","last_active":"2024-04-25T09:13:56.718057+0000","last_peered":"2024-04-25T09:13:56.718057+0000","last_clean":"2024-04-25T09:13:56.718057+0000","last_became_active":"2024-04-25T09:13:54.714755+0000","last_became_peered":"2024-04-25T09:13:54.714755+0000","last_unstale":"2024-04-25T09:13:56.718057+0000","last_undegraded":"2024-04-25T09:13:56.718057+0000","last_fullsized":"2024-04-25T09:13:56.718057+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:19.649135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747476+0000","last_change":"2024-04-25T09:13:55.746491+0000","last_active":"2024-04-25T09:13:56.747476+0000","last_peered":"2024-04-25T09:13:56.747476+0000","last_clean":"2024-04-25T09:13:56.747476+0000","last_became_active":"2024-04-25T09:13:55.743362+0000","last_became_peered":"2024-04-25T09:13:55.743362+0000","last_unstale":"2024-04-25T09:13:56.747476+0000","last_undegraded":"2024-04-25T09:13:56.747476+0000","last_fullsized":"2024-04-25T09:13:56.747476+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:51.119070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747297+0000","last_change":"2024-04-25T09:13:54.714838+0000","last_active":"2024-04-25T09:13:56.747297+0000","last_peered":"2024-04-25T09:13:56.747297+0000","last_clean":"2024-04-25T09:13:56.747297+0000","last_became_active":"2024-04-25T09:13:54.714346+0000","last_became_peered":"2024-04-25T09:13:54.714346+0000","last_unstale":"2024-04-25T09:13:56.747297+0000","last_undegraded":"2024-04-25T09:13:56.747297+0000","last_fullsized":"2024-04-25T09:13:56.747297+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:13.989630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744687+0000","last_change":"2024-04-25T09:13:55.737660+0000","last_active":"2024-04-25T09:13:56.744687+0000","last_peered":"2024-04-25T09:13:56.744687+0000","last_clean":"2024-04-25T09:13:56.744687+0000","last_became_active":"2024-04-25T09:13:55.737350+0000","last_became_peered":"2024-04-25T09:13:55.737350+0000","last_unstale":"2024-04-25T09:13:56.744687+0000","last_undegraded":"2024-04-25T09:13:56.744687+0000","last_fullsized":"2024-04-25T09:13:56.744687+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:03.680484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"143'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715785+0000","last_change":"2024-04-25T09:13:54.714725+0000","last_active":"2024-04-25T09:13:56.715785+0000","last_peered":"2024-04-25T09:13:56.715785+0000","last_clean":"2024-04-25T09:13:56.715785+0000","last_became_active":"2024-04-25T09:13:54.714438+0000","last_became_peered":"2024-04-25T09:13:54.714438+0000","last_unstale":"2024-04-25T09:13:56.715785+0000","last_undegraded":"2024-04-25T09:13:56.715785+0000","last_fullsized":"2024-04-25T09:13:56.715785+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:05.095656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744870+0000","last_change":"2024-04-25T09:13:55.732119+0000","last_active":"2024-04-25T09:13:56.744870+0000","last_peered":"2024-04-25T09:13:56.744870+0000","last_clean":"2024-04-25T09:13:56.744870+0000","last_became_active":"2024-04-25T09:13:55.724999+0000","last_became_peered":"2024-04-25T09:13:55.724999+0000","last_unstale":"2024-04-25T09:13:56.744870+0000","last_undegraded":"2024-04-25T09:13:56.744870+0000","last_fullsized":"2024-04-25T09:13:56.744870+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:01.687460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859554+0000","last_change":"2024-04-25T09:13:54.714787+0000","last_active":"2024-04-25T09:13:56.859554+0000","last_peered":"2024-04-25T09:13:56.859554+0000","last_clean":"2024-04-25T09:13:56.859554+0000","last_became_active":"2024-04-25T09:13:54.714521+0000","last_became_peered":"2024-04-25T09:13:54.714521+0000","last_unstale":"2024-04-25T09:13:56.859554+0000","last_undegraded":"2024-04-25T09:13:56.859554+0000","last_fullsized":"2024-04-25T09:13:56.859554+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:31.744436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747044+0000","last_change":"2024-04-25T09:13:55.741720+0000","last_active":"2024-04-25T09:13:56.747044+0000","last_peered":"2024-04-25T09:13:56.747044+0000","last_clean":"2024-04-25T09:13:56.747044+0000","last_became_active":"2024-04-25T09:13:55.739951+0000","last_became_peered":"2024-04-25T09:13:55.739951+0000","last_unstale":"2024-04-25T09:13:56.747044+0000","last_undegraded":"2024-04-25T09:13:56.747044+0000","last_fullsized":"2024-04-25T09:13:56.747044+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:58.698810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.860891+0000","last_change":"2024-04-25T09:13:54.716217+0000","last_active":"2024-04-25T09:13:56.860891+0000","last_peered":"2024-04-25T09:13:56.860891+0000","last_clean":"2024-04-25T09:13:56.860891+0000","last_became_active":"2024-04-25T09:13:54.715938+0000","last_became_peered":"2024-04-25T09:13:54.715938+0000","last_unstale":"2024-04-25T09:13:56.860891+0000","last_undegraded":"2024-04-25T09:13:56.860891+0000","last_fullsized":"2024-04-25T09:13:56.860891+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:41.737578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715506+0000","last_change":"2024-04-25T09:13:55.729301+0000","last_active":"2024-04-25T09:13:56.715506+0000","last_peered":"2024-04-25T09:13:56.715506+0000","last_clean":"2024-04-25T09:13:56.715506+0000","last_became_active":"2024-04-25T09:13:55.729015+0000","last_became_peered":"2024-04-25T09:13:55.729015+0000","last_unstale":"2024-04-25T09:13:56.715506+0000","last_undegraded":"2024-04-25T09:13:56.715506+0000","last_fullsized":"2024-04-25T09:13:56.715506+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:31.954500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718529+0000","last_change":"2024-04-25T09:13:54.713069+0000","last_active":"2024-04-25T09:13:56.718529+0000","last_peered":"2024-04-25T09:13:56.718529+0000","last_clean":"2024-04-25T09:13:56.718529+0000","last_became_active":"2024-04-25T09:13:54.710852+0000","last_became_peered":"2024-04-25T09:13:54.710852+0000","last_unstale":"2024-04-25T09:13:56.718529+0000","last_undegraded":"2024-04-25T09:13:56.718529+0000","last_fullsized":"2024-04-25T09:13:56.718529+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:50:48.645725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747176+0000","last_change":"2024-04-25T09:13:55.734783+0000","last_active":"2024-04-25T09:13:56.747176+0000","last_peered":"2024-04-25T09:13:56.747176+0000","last_clean":"2024-04-25T09:13:56.747176+0000","last_became_active":"2024-04-25T09:13:55.734488+0000","last_became_peered":"2024-04-25T09:13:55.734488+0000","last_unstale":"2024-04-25T09:13:56.747176+0000","last_undegraded":"2024-04-25T09:13:56.747176+0000","last_fullsized":"2024-04-25T09:13:56.747176+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:08.088176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.860581+0000","last_change":"2024-04-25T09:13:54.716559+0000","last_active":"2024-04-25T09:13:56.860581+0000","last_peered":"2024-04-25T09:13:56.860581+0000","last_clean":"2024-04-25T09:13:56.860581+0000","last_became_active":"2024-04-25T09:13:54.716276+0000","last_became_peered":"2024-04-25T09:13:54.716276+0000","last_unstale":"2024-04-25T09:13:56.860581+0000","last_undegraded":"2024-04-25T09:13:56.860581+0000","last_fullsized":"2024-04-25T09:13:56.860581+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:51.506227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715578+0000","last_change":"2024-04-25T09:13:55.740795+0000","last_active":"2024-04-25T09:13:56.715578+0000","last_peered":"2024-04-25T09:13:56.715578+0000","last_clean":"2024-04-25T09:13:56.715578+0000","last_became_active":"2024-04-25T09:13:55.740520+0000","last_became_peered":"2024-04-25T09:13:55.740520+0000","last_unstale":"2024-04-25T09:13:56.715578+0000","last_undegraded":"2024-04-25T09:13:56.715578+0000","last_fullsized":"2024-04-25T09:13:56.715578+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:35.649423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718983+0000","last_change":"2024-04-25T09:13:54.721471+0000","last_active":"2024-04-25T09:13:56.718983+0000","last_peered":"2024-04-25T09:13:56.718983+0000","last_clean":"2024-04-25T09:13:56.718983+0000","last_became_active":"2024-04-25T09:13:54.721191+0000","last_became_peered":"2024-04-25T09:13:54.721191+0000","last_unstale":"2024-04-25T09:13:56.718983+0000","last_undegraded":"2024-04-25T09:13:56.718983+0000","last_fullsized":"2024-04-25T09:13:56.718983+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:46.269519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861307+0000","last_change":"2024-04-25T09:13:55.732604+0000","last_active":"2024-04-25T09:13:56.861307+0000","last_peered":"2024-04-25T09:13:56.861307+0000","last_clean":"2024-04-25T09:13:56.861307+0000","last_became_active":"2024-04-25T09:13:55.732324+0000","last_became_peered":"2024-04-25T09:13:55.732324+0000","last_unstale":"2024-04-25T09:13:56.861307+0000","last_undegraded":"2024-04-25T09:13:56.861307+0000","last_fullsized":"2024-04-25T09:13:56.861307+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:15.045000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"143'2","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859797+0000","last_change":"2024-04-25T09:13:54.716876+0000","last_active":"2024-04-25T09:13:56.859797+0000","last_peered":"2024-04-25T09:13:56.859797+0000","last_clean":"2024-04-25T09:13:56.859797+0000","last_became_active":"2024-04-25T09:13:54.716393+0000","last_became_peered":"2024-04-25T09:13:54.716393+0000","last_unstale":"2024-04-25T09:13:56.859797+0000","last_undegraded":"2024-04-25T09:13:56.859797+0000","last_fullsized":"2024-04-25T09:13:56.859797+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:59.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859707+0000","last_change":"2024-04-25T09:13:55.735375+0000","last_active":"2024-04-25T09:13:56.859707+0000","last_peered":"2024-04-25T09:13:56.859707+0000","last_clean":"2024-04-25T09:13:56.859707+0000","last_became_active":"2024-04-25T09:13:55.735029+0000","last_became_peered":"2024-04-25T09:13:55.735029+0000","last_unstale":"2024-04-25T09:13:56.859707+0000","last_undegraded":"2024-04-25T09:13:56.859707+0000","last_fullsized":"2024-04-25T09:13:56.859707+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:36.437723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"144'1","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744839+0000","last_change":"2024-04-25T09:13:54.711897+0000","last_active":"2024-04-25T09:13:56.744839+0000","last_peered":"2024-04-25T09:13:56.744839+0000","last_clean":"2024-04-25T09:13:56.744839+0000","last_became_active":"2024-04-25T09:13:54.711470+0000","last_became_peered":"2024-04-25T09:13:54.711470+0000","last_unstale":"2024-04-25T09:13:56.744839+0000","last_undegraded":"2024-04-25T09:13:56.744839+0000","last_fullsized":"2024-04-25T09:13:56.744839+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:06.201178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744776+0000","last_change":"2024-04-25T09:13:55.733685+0000","last_active":"2024-04-25T09:13:56.744776+0000","last_peered":"2024-04-25T09:13:56.744776+0000","last_clean":"2024-04-25T09:13:56.744776+0000","last_became_active":"2024-04-25T09:13:55.733414+0000","last_became_peered":"2024-04-25T09:13:55.733414+0000","last_unstale":"2024-04-25T09:13:56.744776+0000","last_undegraded":"2024-04-25T09:13:56.744776+0000","last_fullsized":"2024-04-25T09:13:56.744776+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:27.123060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715849+0000","last_change":"2024-04-25T09:13:54.720758+0000","last_active":"2024-04-25T09:13:56.715849+0000","last_peered":"2024-04-25T09:13:56.715849+0000","last_clean":"2024-04-25T09:13:56.715849+0000","last_became_active":"2024-04-25T09:13:54.720451+0000","last_became_peered":"2024-04-25T09:13:54.720451+0000","last_unstale":"2024-04-25T09:13:56.715849+0000","last_undegraded":"2024-04-25T09:13:56.715849+0000","last_fullsized":"2024-04-25T09:13:56.715849+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:57.122054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861484+0000","last_change":"2024-04-25T09:13:55.744092+0000","last_active":"2024-04-25T09:13:56.861484+0000","last_peered":"2024-04-25T09:13:56.861484+0000","last_clean":"2024-04-25T09:13:56.861484+0000","last_became_active":"2024-04-25T09:13:55.743840+0000","last_became_peered":"2024-04-25T09:13:55.743840+0000","last_unstale":"2024-04-25T09:13:56.861484+0000","last_undegraded":"2024-04-25T09:13:56.861484+0000","last_fullsized":"2024-04-25T09:13:56.861484+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:58:31.565197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.861229+0000","last_change":"2024-04-25T09:13:54.716548+0000","last_active":"2024-04-25T09:13:56.861229+0000","last_peered":"2024-04-25T09:13:56.861229+0000","last_clean":"2024-04-25T09:13:56.861229+0000","last_became_active":"2024-04-25T09:13:54.716256+0000","last_became_peered":"2024-04-25T09:13:54.716256+0000","last_unstale":"2024-04-25T09:13:56.861229+0000","last_undegraded":"2024-04-25T09:13:56.861229+0000","last_fullsized":"2024-04-25T09:13:56.861229+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:05.091617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718969+0000","last_change":"2024-04-25T09:13:55.732029+0000","last_active":"2024-04-25T09:13:56.718969+0000","last_peered":"2024-04-25T09:13:56.718969+0000","last_clean":"2024-04-25T09:13:56.718969+0000","last_became_active":"2024-04-25T09:13:55.729693+0000","last_became_peered":"2024-04-25T09:13:55.729693+0000","last_unstale":"2024-04-25T09:13:56.718969+0000","last_undegraded":"2024-04-25T09:13:56.718969+0000","last_fullsized":"2024-04-25T09:13:56.718969+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:38.859358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744314+0000","last_change":"2024-04-25T09:13:54.716381+0000","last_active":"2024-04-25T09:13:56.744314+0000","last_peered":"2024-04-25T09:13:56.744314+0000","last_clean":"2024-04-25T09:13:56.744314+0000","last_became_active":"2024-04-25T09:13:54.716074+0000","last_became_peered":"2024-04-25T09:13:54.716074+0000","last_unstale":"2024-04-25T09:13:56.744314+0000","last_undegraded":"2024-04-25T09:13:56.744314+0000","last_fullsized":"2024-04-25T09:13:56.744314+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:18.441099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.859730+0000","last_change":"2024-04-25T09:13:55.733661+0000","last_active":"2024-04-25T09:13:56.859730+0000","last_peered":"2024-04-25T09:13:56.859730+0000","last_clean":"2024-04-25T09:13:56.859730+0000","last_became_active":"2024-04-25T09:13:55.730714+0000","last_became_peered":"2024-04-25T09:13:55.730714+0000","last_unstale":"2024-04-25T09:13:56.859730+0000","last_undegraded":"2024-04-25T09:13:56.859730+0000","last_fullsized":"2024-04-25T09:13:56.859730+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:21.063293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.717763+0000","last_change":"2024-04-25T09:13:54.714803+0000","last_active":"2024-04-25T09:13:56.717763+0000","last_peered":"2024-04-25T09:13:56.717763+0000","last_clean":"2024-04-25T09:13:56.717763+0000","last_became_active":"2024-04-25T09:13:54.714545+0000","last_became_peered":"2024-04-25T09:13:54.714545+0000","last_unstale":"2024-04-25T09:13:56.717763+0000","last_undegraded":"2024-04-25T09:13:56.717763+0000","last_fullsized":"2024-04-25T09:13:56.717763+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:03.583888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.715691+0000","last_change":"2024-04-25T09:13:55.734874+0000","last_active":"2024-04-25T09:13:56.715691+0000","last_peered":"2024-04-25T09:13:56.715691+0000","last_clean":"2024-04-25T09:13:56.715691+0000","last_became_active":"2024-04-25T09:13:55.734098+0000","last_became_peered":"2024-04-25T09:13:55.734098+0000","last_unstale":"2024-04-25T09:13:56.715691+0000","last_undegraded":"2024-04-25T09:13:56.715691+0000","last_fullsized":"2024-04-25T09:13:56.715691+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:22.352749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.744390+0000","last_change":"2024-04-25T09:13:54.717868+0000","last_active":"2024-04-25T09:13:56.744390+0000","last_peered":"2024-04-25T09:13:56.744390+0000","last_clean":"2024-04-25T09:13:56.744390+0000","last_became_active":"2024-04-25T09:13:54.717368+0000","last_became_peered":"2024-04-25T09:13:54.717368+0000","last_unstale":"2024-04-25T09:13:56.744390+0000","last_undegraded":"2024-04-25T09:13:56.744390+0000","last_fullsized":"2024-04-25T09:13:56.744390+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:41.299316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.718956+0000","last_change":"2024-04-25T09:13:55.739080+0000","last_active":"2024-04-25T09:13:56.718956+0000","last_peered":"2024-04-25T09:13:56.718956+0000","last_clean":"2024-04-25T09:13:56.718956+0000","last_became_active":"2024-04-25T09:13:55.738763+0000","last_became_peered":"2024-04-25T09:13:55.738763+0000","last_unstale":"2024-04-25T09:13:56.718956+0000","last_undegraded":"2024-04-25T09:13:56.718956+0000","last_fullsized":"2024-04-25T09:13:56.718956+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:38.876620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.746962+0000","last_change":"2024-04-25T09:13:54.717287+0000","last_active":"2024-04-25T09:13:56.746962+0000","last_peered":"2024-04-25T09:13:56.746962+0000","last_clean":"2024-04-25T09:13:56.746962+0000","last_became_active":"2024-04-25T09:13:54.716916+0000","last_became_peered":"2024-04-25T09:13:54.716916+0000","last_unstale":"2024-04-25T09:13:56.746962+0000","last_undegraded":"2024-04-25T09:13:56.746962+0000","last_fullsized":"2024-04-25T09:13:56.746962+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:57.944637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.719329+0000","last_change":"2024-04-25T09:13:55.729921+0000","last_active":"2024-04-25T09:13:56.719329+0000","last_peered":"2024-04-25T09:13:56.719329+0000","last_clean":"2024-04-25T09:13:56.719329+0000","last_became_active":"2024-04-25T09:13:55.729571+0000","last_became_peered":"2024-04-25T09:13:55.729571+0000","last_unstale":"2024-04-25T09:13:56.719329+0000","last_undegraded":"2024-04-25T09:13:56.719329+0000","last_fullsized":"2024-04-25T09:13:56.719329+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:54.691694+0000","last_clean_scrub_stamp":"2024-04-25T09:13:54.691694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:32.958371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"143'6","reported_seq":20,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.860971+0000","last_change":"2024-04-25T09:13:54.720531+0000","last_active":"2024-04-25T09:13:56.860971+0000","last_peered":"2024-04-25T09:13:56.860971+0000","last_clean":"2024-04-25T09:13:56.860971+0000","last_became_active":"2024-04-25T09:13:54.719653+0000","last_became_peered":"2024-04-25T09:13:54.719653+0000","last_unstale":"2024-04-25T09:13:56.860971+0000","last_undegraded":"2024-04-25T09:13:56.860971+0000","last_fullsized":"2024-04-25T09:13:56.860971+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:13:53.683860+0000","last_clean_scrub_stamp":"2024-04-25T09:13:53.683860+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:23.224519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":397,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-04-25T09:13:56.747058+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:13:56.747058+0000","last_peered":"2024-04-25T09:13:56.747058+0000","last_clean":"2024-04-25T09:13:56.747058+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:13:56.747058+0000","last_undegraded":"2024-04-25T09:13:56.747058+0000","last_fullsized":"2024-04-25T09:13:56.747058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509579,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55152,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316688,"statfs":{"total":96636764160,"available":96580288512,"internally_reserved":0,"allocated":1802240,"data_stored":839768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509579,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50988,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320852,"statfs":{"total":96636764160,"available":96584552448,"internally_reserved":0,"allocated":1798144,"data_stored":839698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509580,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46836,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325004,"statfs":{"total":96636764160,"available":96588804096,"internally_reserved":0,"allocated":1810432,"data_stored":841310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509579,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81460,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":94290380,"statfs":{"total":96636764160,"available":96553349120,"internally_reserved":0,"allocated":1806336,"data_stored":840314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":81590727},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509579,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55156,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316684,"statfs":{"total":96636764160,"available":96580284416,"internally_reserved":0,"allocated":1806336,"data_stored":839810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509580,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55156,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316684,"statfs":{"total":96636764160,"available":96580284416,"internally_reserved":0,"allocated":1802240,"data_stored":839768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509580,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59912,"kb_used_data":2360,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311928,"statfs":{"total":96636764160,"available":96575414272,"internally_reserved":0,"allocated":2416640,"data_stored":1432384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574988,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55728,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316112,"statfs":{"total":96636764160,"available":96579698688,"internally_reserved":0,"allocated":2396160,"data_stored":1430088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:14:04.656 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:14:04.657 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:14:04.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.856+0000 7fa300a00640 1 Processor -- start 2024-04-25T09:14:04.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.856+0000 7fa300a00640 1 -- start start 2024-04-25T09:14:04.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.856+0000 7fa300a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa2fc06e1c0 0x7fa2fc06bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.860+0000 7fa300a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2fc06c410 0x7fa2fc0aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.860+0000 7fa300a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2fc06ae30 con 0x7fa2fc0ad3f0 2024-04-25T09:14:04.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.860+0000 7fa300a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2fc0b3170 con 0x7fa2fc06e1c0 2024-04-25T09:14:04.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.860+0000 7fa300a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc15e070 con 0x7fa2fc06c410 2024-04-25T09:14:04.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.860+0000 7fa2fa800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa2fc0ad3f0 0x7fa2fc06e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47130/0 (socket says 172.21.15.173:47130) 2024-04-25T09:14:04.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.860+0000 7fa2fa800640 1 -- 172.21.15.173:0/3057170205 learned_addr learned my addr 172.21.15.173:0/3057170205 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:04.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.860+0000 7fa2f9e00640 1 --2- 172.21.15.173:0/3057170205 >> v2:172.21.15.194:3300/0 conn(0x7fa2fc06e1c0 0x7fa2fc06bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.860+0000 7fa2f9400640 1 --2- 172.21.15.173:0/3057170205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2fc06c410 0x7fa2fc0aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.860+0000 7fa2f8a00640 1 -- 172.21.15.173:0/3057170205 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353965794 0 0) 0x7fa2fc06ae30 con 0x7fa2fc0ad3f0 2024-04-25T09:14:04.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.860+0000 7fa2f8a00640 1 -- 172.21.15.173:0/3057170205 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2e0003530 con 0x7fa2fc0ad3f0 2024-04-25T09:14:04.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.860+0000 7fa2f9400640 1 -- 172.21.15.173:0/3057170205 >> v2:172.21.15.194:3300/0 conn(0x7fa2fc06e1c0 msgr2=0x7fa2fc06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:04.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.860+0000 7fa2f9400640 1 --2- 172.21.15.173:0/3057170205 >> v2:172.21.15.194:3300/0 conn(0x7fa2fc06e1c0 0x7fa2fc06bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.860+0000 7fa2f9400640 1 -- 172.21.15.173:0/3057170205 >> v1:172.21.15.173:6789/0 conn(0x7fa2fc0ad3f0 legacy=0x7fa2fc06e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.860+0000 7fa2f9400640 1 -- 172.21.15.173:0/3057170205 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc06b110 con 0x7fa2fc06c410 2024-04-25T09:14:04.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.860+0000 7fa2f9400640 1 --2- 172.21.15.173:0/3057170205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2fc06c410 0x7fa2fc0aceb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40097f0 tx=0x7fa2e401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3d3f28b5063f26a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:04.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa2f8a00640 1 -- 172.21.15.173:0/3057170205 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40b5070 con 0x7fa2fc06c410 2024-04-25T09:14:04.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa2f8a00640 1 -- 172.21.15.173:0/3057170205 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e40a8990 con 0x7fa2fc06c410 2024-04-25T09:14:04.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa2f8a00640 1 -- 172.21.15.173:0/3057170205 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40a8d60 con 0x7fa2fc06c410 2024-04-25T09:14:04.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa300a00640 1 -- 172.21.15.173:0/3057170205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2fc06c410 msgr2=0x7fa2fc0aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa300a00640 1 --2- 172.21.15.173:0/3057170205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2fc06c410 0x7fa2fc0aceb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40097f0 tx=0x7fa2e401ec90 comp rx=0 tx=0).stop 2024-04-25T09:14:04.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa300a00640 1 -- 172.21.15.173:0/3057170205 shutdown_connections 2024-04-25T09:14:04.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa300a00640 1 --2- 172.21.15.173:0/3057170205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2fc06c410 0x7fa2fc0aceb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa300a00640 1 --2- 172.21.15.173:0/3057170205 >> v2:172.21.15.194:3300/0 conn(0x7fa2fc06e1c0 0x7fa2fc06bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa300a00640 1 -- 172.21.15.173:0/3057170205 >> 172.21.15.173:0/3057170205 conn(0x7fa2fc0cfed0 msgr2=0x7fa2fc0d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:04.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa300a00640 1 -- 172.21.15.173:0/3057170205 shutdown_connections 2024-04-25T09:14:04.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa300a00640 1 -- 172.21.15.173:0/3057170205 wait complete. 2024-04-25T09:14:04.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa300a00640 1 Processor -- start 2024-04-25T09:14:04.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa300a00640 1 -- start start 2024-04-25T09:14:04.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa300a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2fc06c410 0x7fa2fc145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa300a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2fc06e1c0 0x7fa2fc1464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa300a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2fc0ad3f0 0x7fa2fc1469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa300a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc06b9b0 con 0x7fa2fc0ad3f0 2024-04-25T09:14:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa300a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc06b6d0 con 0x7fa2fc06e1c0 2024-04-25T09:14:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa300a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc0ad8a0 con 0x7fa2fc06c410 2024-04-25T09:14:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.864+0000 7fa2fa800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2fc0ad3f0 0x7fa2fc1469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa2fa800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2fc0ad3f0 0x7fa2fc1469f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44260/0 (socket says 172.21.15.173:44260) 2024-04-25T09:14:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa2fa800640 1 -- 172.21.15.173:0/2901487870 learned_addr learned my addr 172.21.15.173:0/2901487870 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa2f9e00640 1 --2- 172.21.15.173:0/2901487870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2fc06c410 0x7fa2fc145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa2f9400640 1 --2- 172.21.15.173:0/2901487870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2fc06e1c0 0x7fa2fc1464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa2fa800640 1 -- 172.21.15.173:0/2901487870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2fc06c410 msgr2=0x7fa2fc145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa2fa800640 1 --2- 172.21.15.173:0/2901487870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2fc06c410 0x7fa2fc145ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa2fa800640 1 -- 172.21.15.173:0/2901487870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2fc06e1c0 msgr2=0x7fa2fc1464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa2fa800640 1 --2- 172.21.15.173:0/2901487870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2fc06e1c0 0x7fa2fc1464b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa2fa800640 1 -- 172.21.15.173:0/2901487870 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc154a70 con 0x7fa2fc0ad3f0 2024-04-25T09:14:04.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa2fa800640 1 --2- 172.21.15.173:0/2901487870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2fc0ad3f0 0x7fa2fc1469f0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400c3f0 tx=0x7fa2f400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:04.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa2f2000640 1 -- 172.21.15.173:0/2901487870 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4017070 con 0x7fa2fc0ad3f0 2024-04-25T09:14:04.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa2f2000640 1 -- 172.21.15.173:0/2901487870 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f4005cf0 con 0x7fa2fc0ad3f0 2024-04-25T09:14:04.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa300a00640 1 -- 172.21.15.173:0/2901487870 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2fc154d50 con 0x7fa2fc0ad3f0 2024-04-25T09:14:04.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa2f2000640 1 -- 172.21.15.173:0/2901487870 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4007310 con 0x7fa2fc0ad3f0 2024-04-25T09:14:04.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa300a00640 1 -- 172.21.15.173:0/2901487870 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2fc155310 con 0x7fa2fc0ad3f0 2024-04-25T09:14:04.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa300a00640 1 -- 172.21.15.173:0/2901487870 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2fc073ab0 con 0x7fa2fc0ad3f0 2024-04-25T09:14:04.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa2f2000640 1 -- 172.21.15.173:0/2901487870 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa2f401a070 con 0x7fa2fc0ad3f0 2024-04-25T09:14:04.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa2f2000640 1 --2- 172.21.15.173:0/2901487870 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2d8066f60 0x7fa2d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa2f2000640 1 -- 172.21.15.173:0/2901487870 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa2f4084630 con 0x7fa2fc0ad3f0 2024-04-25T09:14:04.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.868+0000 7fa2f9e00640 1 --2- 172.21.15.173:0/2901487870 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2d8066f60 0x7fa2d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.872+0000 7fa2f9e00640 1 --2- 172.21.15.173:0/2901487870 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2d8066f60 0x7fa2d8069420 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0113e0 tx=0x7fa2ec00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:04.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:04.876+0000 7fa2f2000640 1 -- 172.21.15.173:0/2901487870 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa2f4054d30 con 0x7fa2fc0ad3f0 2024-04-25T09:14:05.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.084+0000 7fa300a00640 1 -- 172.21.15.173:0/2901487870 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa2fc06f750 con 0x7fa2fc0ad3f0 2024-04-25T09:14:05.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.088+0000 7fa2f2000640 1 -- 172.21.15.173:0/2901487870 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa2f4058dd0 con 0x7fa2fc0ad3f0 2024-04-25T09:14:05.072 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2024-04-25T09:14:05.072 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQD6GypmOYscKhAAa4/QHbk8rKEv658ZYuaX7w== 2024-04-25T09:14:05.072 INFO:teuthology.orchestra.run.smithi173.stdout: caps mds = "allow" 2024-04-25T09:14:05.072 INFO:teuthology.orchestra.run.smithi173.stdout: caps mon = "allow r" 2024-04-25T09:14:05.072 INFO:teuthology.orchestra.run.smithi173.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:14:05.073 INFO:teuthology.orchestra.run.smithi173.stderr:updated caps for client.0 2024-04-25T09:14:05.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.088+0000 7fa300a00640 1 -- 172.21.15.173:0/2901487870 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2d8066f60 msgr2=0x7fa2d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:05.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.088+0000 7fa300a00640 1 --2- 172.21.15.173:0/2901487870 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2d8066f60 0x7fa2d8069420 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0113e0 tx=0x7fa2ec00b040 comp rx=0 tx=0).stop 2024-04-25T09:14:05.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.088+0000 7fa300a00640 1 -- 172.21.15.173:0/2901487870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2fc0ad3f0 msgr2=0x7fa2fc1469f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:05.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.088+0000 7fa300a00640 1 --2- 172.21.15.173:0/2901487870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2fc0ad3f0 0x7fa2fc1469f0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400c3f0 tx=0x7fa2f400c8b0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.088+0000 7fa300a00640 1 -- 172.21.15.173:0/2901487870 shutdown_connections 2024-04-25T09:14:05.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.088+0000 7fa300a00640 1 --2- 172.21.15.173:0/2901487870 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa2d8066f60 0x7fa2d8069420 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.088+0000 7fa300a00640 1 --2- 172.21.15.173:0/2901487870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2fc0ad3f0 0x7fa2fc1469f0 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.088+0000 7fa300a00640 1 --2- 172.21.15.173:0/2901487870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2fc06e1c0 0x7fa2fc1464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.088+0000 7fa300a00640 1 --2- 172.21.15.173:0/2901487870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2fc06c410 0x7fa2fc145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.088+0000 7fa300a00640 1 -- 172.21.15.173:0/2901487870 >> 172.21.15.173:0/2901487870 conn(0x7fa2fc0cfed0 msgr2=0x7fa2fc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:05.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.088+0000 7fa300a00640 1 -- 172.21.15.173:0/2901487870 shutdown_connections 2024-04-25T09:14:05.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.088+0000 7fa300a00640 1 -- 172.21.15.173:0/2901487870 wait complete. 2024-04-25T09:14:05.094 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:05.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a27a00640 1 Processor -- start 2024-04-25T09:14:05.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a27a00640 1 -- start start 2024-04-25T09:14:05.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a27a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2015df90 0x7f7a200d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:05.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a27a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2006d870 con 0x7f7a2006f830 2024-04-25T09:14:05.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a27a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a20161690 con 0x7f7a2015dbb0 2024-04-25T09:14:05.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a27a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2015e5c0 con 0x7f7a2015df90 2024-04-25T09:14:05.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a25a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f7a2006f830 0x7f7a20161b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47142/0 (socket says 172.21.15.173:47142) 2024-04-25T09:14:05.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a25a00640 1 -- 172.21.15.173:0/3666343647 learned_addr learned my addr 172.21.15.173:0/3666343647 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:05.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a1fe00640 1 --2- 172.21.15.173:0/3666343647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2015df90 0x7f7a200d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:05.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a1f400640 1 -- 172.21.15.173:0/3666343647 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600548446 0 0) 0x7f7a2006d870 con 0x7f7a2006f830 2024-04-25T09:14:05.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a1f400640 1 -- 172.21.15.173:0/3666343647 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a04003530 con 0x7f7a2006f830 2024-04-25T09:14:05.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a1f400640 1 -- 172.21.15.173:0/3666343647 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1337775719 0 0) 0x7f7a04003530 con 0x7f7a2006f830 2024-04-25T09:14:05.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a1f400640 1 -- 172.21.15.173:0/3666343647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2015df90 msgr2=0x7f7a200d2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:05.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a1f400640 1 --2- 172.21.15.173:0/3666343647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2015df90 0x7f7a200d2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a1f400640 1 -- 172.21.15.173:0/3666343647 >> v1:172.21.15.194:6789/0 conn(0x7f7a2015dbb0 legacy=0x7f7a2006c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:05.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a1f400640 1 -- 172.21.15.173:0/3666343647 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2015e8a0 con 0x7f7a2006f830 2024-04-25T09:14:05.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a1f400640 1 -- 172.21.15.173:0/3666343647 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f7a18001a00 con 0x7f7a2006f830 2024-04-25T09:14:05.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a1f400640 1 -- 172.21.15.173:0/3666343647 >> v1:172.21.15.173:6789/0 conn(0x7f7a2006f830 legacy=0x7f7a20161b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:05.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a1f400640 1 --2- 172.21.15.173:0/3666343647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a040039f0 0x7f7a04003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:05.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a1f400640 1 --2- 172.21.15.173:0/3666343647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2015df90 0x7f7a04004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:05.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a1f400640 1 --2- 172.21.15.173:0/3666343647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a04004d50 0x7f7a040051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:05.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a1f400640 1 -- 172.21.15.173:0/3666343647 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2015e5c0 con 0x7f7a040039f0 2024-04-25T09:14:05.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a1f400640 1 -- 172.21.15.173:0/3666343647 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0400ba80 con 0x7f7a04004d50 2024-04-25T09:14:05.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a1f400640 1 -- 172.21.15.173:0/3666343647 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0400bc80 con 0x7f7a2015df90 2024-04-25T09:14:05.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a25000640 1 --2- 172.21.15.173:0/3666343647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a040039f0 0x7f7a04003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:05.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a1fe00640 1 --2- 172.21.15.173:0/3666343647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2015df90 0x7f7a04004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:05.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a25a00640 1 --2- 172.21.15.173:0/3666343647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a04004d50 0x7f7a040051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:05.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a25000640 1 -- 172.21.15.173:0/3666343647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2015df90 msgr2=0x7f7a04004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:05.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a25000640 1 --2- 172.21.15.173:0/3666343647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2015df90 0x7f7a04004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a25000640 1 -- 172.21.15.173:0/3666343647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a04004d50 msgr2=0x7f7a040051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:05.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a25000640 1 --2- 172.21.15.173:0/3666343647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a04004d50 0x7f7a040051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.244+0000 7f7a25000640 1 -- 172.21.15.173:0/3666343647 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a04003530 con 0x7f7a040039f0 2024-04-25T09:14:05.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.248+0000 7f7a25000640 1 --2- 172.21.15.173:0/3666343647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a040039f0 0x7f7a04003e10 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f7a10001750 tx=0x7f7a1001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45cf4b9ac19d385d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:05.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.248+0000 7f7a1f400640 1 -- 172.21.15.173:0/3666343647 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a100013a0 con 0x7f7a040039f0 2024-04-25T09:14:05.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.248+0000 7f7a1f400640 1 -- 172.21.15.173:0/3666343647 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a100052f0 con 0x7f7a040039f0 2024-04-25T09:14:05.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.248+0000 7f7a1f400640 1 -- 172.21.15.173:0/3666343647 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a10003840 con 0x7f7a040039f0 2024-04-25T09:14:05.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.248+0000 7f7a27a00640 1 -- 172.21.15.173:0/3666343647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a040039f0 msgr2=0x7f7a04003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:05.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.248+0000 7f7a27a00640 1 --2- 172.21.15.173:0/3666343647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a040039f0 0x7f7a04003e10 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f7a10001750 tx=0x7f7a1001c3e0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.248+0000 7f7a25a00640 1 -- 172.21.15.173:0/3666343647 reap_dead start 2024-04-25T09:14:05.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.248+0000 7f7a27a00640 1 -- 172.21.15.173:0/3666343647 shutdown_connections 2024-04-25T09:14:05.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.248+0000 7f7a27a00640 1 -- 172.21.15.173:0/3666343647 >> 172.21.15.173:0/3666343647 conn(0x7f7a20061880 msgr2=0x7f7a20061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:05.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.248+0000 7f7a27a00640 1 -- 172.21.15.173:0/3666343647 shutdown_connections 2024-04-25T09:14:05.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.248+0000 7f7a27a00640 1 -- 172.21.15.173:0/3666343647 wait complete. 2024-04-25T09:14:05.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a27a00640 1 Processor -- start 2024-04-25T09:14:05.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a27a00640 1 -- start start 2024-04-25T09:14:05.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a27a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a040039f0 0x7f7a2015be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:05.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a27a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2015c680 0x7f7a200b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:05.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a27a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a200b5d30 0x7f7a200ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:05.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a27a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2006fc40 con 0x7f7a200b5d30 2024-04-25T09:14:05.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a27a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2015ee60 con 0x7f7a040039f0 2024-04-25T09:14:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a27a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2006fdc0 con 0x7f7a2015c680 2024-04-25T09:14:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a25a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a200b5d30 0x7f7a200ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a25a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a200b5d30 0x7f7a200ad4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44288/0 (socket says 172.21.15.173:44288) 2024-04-25T09:14:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a25a00640 1 -- 172.21.15.173:0/815852485 learned_addr learned my addr 172.21.15.173:0/815852485 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a25000640 1 --2- 172.21.15.173:0/815852485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a040039f0 0x7f7a2015be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a1fe00640 1 --2- 172.21.15.173:0/815852485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2015c680 0x7f7a200b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a25a00640 1 -- 172.21.15.173:0/815852485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2015c680 msgr2=0x7f7a200b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a25a00640 1 --2- 172.21.15.173:0/815852485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2015c680 0x7f7a200b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a25a00640 1 -- 172.21.15.173:0/815852485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a040039f0 msgr2=0x7f7a2015be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a25a00640 1 --2- 172.21.15.173:0/815852485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a040039f0 0x7f7a2015be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a25a00640 1 -- 172.21.15.173:0/815852485 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a200b6c10 con 0x7f7a200b5d30 2024-04-25T09:14:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a25a00640 1 --2- 172.21.15.173:0/815852485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a200b5d30 0x7f7a200ad4e0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f7a200ce630 tx=0x7f7a1800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a1cc00640 1 -- 172.21.15.173:0/815852485 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1800ebb0 con 0x7f7a200b5d30 2024-04-25T09:14:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a1cc00640 1 -- 172.21.15.173:0/815852485 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a18018070 con 0x7f7a200b5d30 2024-04-25T09:14:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a27a00640 1 -- 172.21.15.173:0/815852485 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a200b6ef0 con 0x7f7a200b5d30 2024-04-25T09:14:05.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a1cc00640 1 -- 172.21.15.173:0/815852485 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a18013420 con 0x7f7a200b5d30 2024-04-25T09:14:05.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.252+0000 7f7a27a00640 1 -- 172.21.15.173:0/815852485 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a200b4ff0 con 0x7f7a200b5d30 2024-04-25T09:14:05.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.256+0000 7f7a27a00640 1 -- 172.21.15.173:0/815852485 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a20073a40 con 0x7f7a200b5d30 2024-04-25T09:14:05.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.256+0000 7f7a1cc00640 1 -- 172.21.15.173:0/815852485 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7a180135c0 con 0x7f7a200b5d30 2024-04-25T09:14:05.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.256+0000 7f7a1cc00640 1 --2- 172.21.15.173:0/815852485 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7a00066f60 0x7f7a00069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:05.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.256+0000 7f7a1cc00640 1 -- 172.21.15.173:0/815852485 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7a180852d0 con 0x7f7a200b5d30 2024-04-25T09:14:05.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.256+0000 7f7a25000640 1 --2- 172.21.15.173:0/815852485 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7a00066f60 0x7f7a00069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:05.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.256+0000 7f7a25000640 1 --2- 172.21.15.173:0/815852485 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7a00066f60 0x7f7a00069420 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7a040057f0 tx=0x7f7a100011a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:05.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.260+0000 7f7a1cc00640 1 -- 172.21.15.173:0/815852485 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7a18056150 con 0x7f7a200b5d30 2024-04-25T09:14:05.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.448+0000 7f7a27a00640 1 -- 172.21.15.173:0/815852485 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a2006cf40 con 0x7f7a200b5d30 2024-04-25T09:14:05.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.448+0000 7f7a1cc00640 1 -- 172.21.15.173:0/815852485 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4950 (secure 0 0 0) 0x7f7a18055a50 con 0x7f7a200b5d30 2024-04-25T09:14:05.435 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:05.435 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":102,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/751187793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":751187793},{"type":"v1","addr":"172.21.15.173:6836","nonce":751187793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":9013,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1331227782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1331227782},{"type":"v1","addr":"172.21.15.194:6834","nonce":1331227782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":97},{"gid":9957,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/401620872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":401620872},{"type":"v1","addr":"172.21.15.173:6837","nonce":401620872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:13:55.081334+0000","modified":"2024-04-25T09:13:58.107523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9969":{"gid":9969,"name":"b","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/3308916795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":3308916795},{"type":"v1","addr":"172.21.15.194:6835","nonce":3308916795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T09:14:05.435 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 102 2024-04-25T09:14:05.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.452+0000 7f7a27a00640 1 -- 172.21.15.173:0/815852485 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7a00066f60 msgr2=0x7f7a00069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:05.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.452+0000 7f7a27a00640 1 --2- 172.21.15.173:0/815852485 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7a00066f60 0x7f7a00069420 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7a040057f0 tx=0x7f7a100011a0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.452+0000 7f7a27a00640 1 -- 172.21.15.173:0/815852485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a200b5d30 msgr2=0x7f7a200ad4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:05.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.452+0000 7f7a27a00640 1 --2- 172.21.15.173:0/815852485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a200b5d30 0x7f7a200ad4e0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f7a200ce630 tx=0x7f7a1800e530 comp rx=0 tx=0).stop 2024-04-25T09:14:05.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.452+0000 7f7a27a00640 1 -- 172.21.15.173:0/815852485 shutdown_connections 2024-04-25T09:14:05.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.452+0000 7f7a27a00640 1 --2- 172.21.15.173:0/815852485 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f7a00066f60 0x7f7a00069420 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.452+0000 7f7a27a00640 1 --2- 172.21.15.173:0/815852485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a200b5d30 0x7f7a200ad4e0 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.452+0000 7f7a27a00640 1 --2- 172.21.15.173:0/815852485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2015c680 0x7f7a200b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.452+0000 7f7a27a00640 1 --2- 172.21.15.173:0/815852485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a040039f0 0x7f7a2015be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.452+0000 7f7a27a00640 1 -- 172.21.15.173:0/815852485 >> 172.21.15.173:0/815852485 conn(0x7f7a20061880 msgr2=0x7f7a200b3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:05.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.452+0000 7f7a27a00640 1 -- 172.21.15.173:0/815852485 shutdown_connections 2024-04-25T09:14:05.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:05.452+0000 7f7a27a00640 1 -- 172.21.15.173:0/815852485 wait complete. 2024-04-25T09:14:05.859 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 102, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:13:55.081334+0000', 'modified': '2024-04-25T09:13:58.107523+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9969}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9969': {'gid': 9969, 'name': 'b', 'rank': 0, 'incarnation': 98, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.194:6835/3308916795', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6833', 'nonce': 3308916795}, {'type': 'v1', 'addr': '172.21.15.194:6835', 'nonce': 3308916795}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:14:05.859 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:14:05.859 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T09:14:05.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.012+0000 7fa247e00640 1 Processor -- start 2024-04-25T09:14:05.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.012+0000 7fa247e00640 1 -- start start 2024-04-25T09:14:05.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.012+0000 7fa247e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa2400b3fe0 0x7fa2400b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:05.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.012+0000 7fa247e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa2400cc260 0x7fa2400cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:05.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.012+0000 7fa247e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24006d4b0 con 0x7fa240145290 2024-04-25T09:14:05.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.012+0000 7fa247e00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24006d790 con 0x7fa2400cc260 2024-04-25T09:14:05.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.012+0000 7fa247e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24006da70 con 0x7fa2400b3fe0 2024-04-25T09:14:05.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.012+0000 7fa245e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa2400cc260 0x7fa2400cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:05.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.012+0000 7fa245400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa240145290 0x7fa24015c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47146/0 (socket says 172.21.15.173:47146) 2024-04-25T09:14:05.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.012+0000 7fa245400640 1 -- 172.21.15.173:0/491117938 learned_addr learned my addr 172.21.15.173:0/491117938 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:05.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.012+0000 7fa245e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa2400cc260 0x7fa2400cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44298/0 (socket says 172.21.15.173:44298) 2024-04-25T09:14:05.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.012+0000 7fa244a00640 1 --2- 172.21.15.173:0/491117938 >> v2:172.21.15.194:3300/0 conn(0x7fa2400b3fe0 0x7fa2400b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:05.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.012+0000 7fa245e00640 1 -- 172.21.15.173:0/491117938 >> v2:172.21.15.194:3300/0 conn(0x7fa2400b3fe0 msgr2=0x7fa2400b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:05.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.012+0000 7fa245e00640 1 --2- 172.21.15.173:0/491117938 >> v2:172.21.15.194:3300/0 conn(0x7fa2400b3fe0 0x7fa2400b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.012+0000 7fa245e00640 1 -- 172.21.15.173:0/491117938 >> v1:172.21.15.173:6789/0 conn(0x7fa240145290 legacy=0x7fa24015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:05.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.012+0000 7fa23fe00640 1 -- 172.21.15.173:0/491117938 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171328751 0 0) 0x7fa24006d4b0 con 0x7fa240145290 2024-04-25T09:14:05.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.012+0000 7fa245e00640 1 -- 172.21.15.173:0/491117938 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24006dd50 con 0x7fa2400cc260 2024-04-25T09:14:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.016+0000 7fa245e00640 1 --2- 172.21.15.173:0/491117938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2400cc260 0x7fa2400cc670 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7fa240071100 tx=0x7fa23801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5220a9c276e964 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.016+0000 7fa23fe00640 1 -- 172.21.15.173:0/491117938 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2380b0070 con 0x7fa2400cc260 2024-04-25T09:14:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.016+0000 7fa23fe00640 1 -- 172.21.15.173:0/491117938 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2380ab600 con 0x7fa2400cc260 2024-04-25T09:14:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.016+0000 7fa23fe00640 1 -- 172.21.15.173:0/491117938 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2380ab9d0 con 0x7fa2400cc260 2024-04-25T09:14:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.016+0000 7fa247e00640 1 -- 172.21.15.173:0/491117938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2400cc260 msgr2=0x7fa2400cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.016+0000 7fa247e00640 1 --2- 172.21.15.173:0/491117938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2400cc260 0x7fa2400cc670 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7fa240071100 tx=0x7fa23801c360 comp rx=0 tx=0).stop 2024-04-25T09:14:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.016+0000 7fa247e00640 1 -- 172.21.15.173:0/491117938 shutdown_connections 2024-04-25T09:14:06.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.016+0000 7fa247e00640 1 --2- 172.21.15.173:0/491117938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2400cc260 0x7fa2400cc670 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.016+0000 7fa247e00640 1 --2- 172.21.15.173:0/491117938 >> v2:172.21.15.194:3300/0 conn(0x7fa2400b3fe0 0x7fa2400b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.016+0000 7fa247e00640 1 -- 172.21.15.173:0/491117938 >> 172.21.15.173:0/491117938 conn(0x7fa24006ac90 msgr2=0x7fa24006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:06.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.016+0000 7fa247e00640 1 -- 172.21.15.173:0/491117938 shutdown_connections 2024-04-25T09:14:06.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.016+0000 7fa247e00640 1 -- 172.21.15.173:0/491117938 wait complete. 2024-04-25T09:14:06.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.016+0000 7fa247e00640 1 Processor -- start 2024-04-25T09:14:06.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.016+0000 7fa247e00640 1 -- start start 2024-04-25T09:14:06.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa247e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2400b3fe0 0x7fa2400af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa247e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2400cc260 0x7fa24013cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa247e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa240145290 0x7fa24013d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa247e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24006eee0 con 0x7fa240145290 2024-04-25T09:14:06.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa247e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24006ed60 con 0x7fa2400cc260 2024-04-25T09:14:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa247e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24006f060 con 0x7fa2400b3fe0 2024-04-25T09:14:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa245e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa240145290 0x7fa24013d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa245e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa240145290 0x7fa24013d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44300/0 (socket says 172.21.15.173:44300) 2024-04-25T09:14:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa245e00640 1 -- 172.21.15.173:0/2099814787 learned_addr learned my addr 172.21.15.173:0/2099814787 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa244a00640 1 --2- 172.21.15.173:0/2099814787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2400cc260 0x7fa24013cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa245400640 1 --2- 172.21.15.173:0/2099814787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2400b3fe0 0x7fa2400af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa245e00640 1 -- 172.21.15.173:0/2099814787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2400b3fe0 msgr2=0x7fa2400af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa245e00640 1 --2- 172.21.15.173:0/2099814787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2400b3fe0 0x7fa2400af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa245e00640 1 -- 172.21.15.173:0/2099814787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2400cc260 msgr2=0x7fa24013cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa245e00640 1 --2- 172.21.15.173:0/2099814787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2400cc260 0x7fa24013cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa245e00640 1 -- 172.21.15.173:0/2099814787 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2400cd780 con 0x7fa240145290 2024-04-25T09:14:06.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa245400640 1 --2- 172.21.15.173:0/2099814787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2400b3fe0 0x7fa2400af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:06.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa245e00640 1 --2- 172.21.15.173:0/2099814787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa240145290 0x7fa24013d480 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7fa2380ae040 tx=0x7fa238019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:06.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa23d600640 1 -- 172.21.15.173:0/2099814787 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2380b8020 con 0x7fa240145290 2024-04-25T09:14:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa23d600640 1 -- 172.21.15.173:0/2099814787 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2380b4410 con 0x7fa240145290 2024-04-25T09:14:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa23d600640 1 -- 172.21.15.173:0/2099814787 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2380b0040 con 0x7fa240145290 2024-04-25T09:14:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa247e00640 1 -- 172.21.15.173:0/2099814787 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2400cda60 con 0x7fa240145290 2024-04-25T09:14:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.020+0000 7fa247e00640 1 -- 172.21.15.173:0/2099814787 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2400ce020 con 0x7fa240145290 2024-04-25T09:14:06.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa23d600640 1 -- 172.21.15.173:0/2099814787 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa2380bb020 con 0x7fa240145290 2024-04-25T09:14:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa23d600640 1 --2- 172.21.15.173:0/2099814787 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa220066f60 0x7fa220069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa23d600640 1 -- 172.21.15.173:0/2099814787 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa23811ec00 con 0x7fa240145290 2024-04-25T09:14:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa245400640 1 --2- 172.21.15.173:0/2099814787 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa220066f60 0x7fa220069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa24b1e5000 1 Processor -- start 2024-04-25T09:14:06.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa24b1e5000 1 -- start start 2024-04-25T09:14:06.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa245400640 1 --2- 172.21.15.173:0/2099814787 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa220066f60 0x7fa220069420 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fa234007fd0 tx=0x7fa234005b80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:06.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa24b1e5000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c0920 0x5589169c0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa24b1e5000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c1240 0x5589169769f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa24b1e5000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x558916977310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa24b1e5000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55891685e5f0 con 0x5589169c1240 2024-04-25T09:14:06.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa24b1e5000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589167c5da0 con 0x558916976f30 2024-04-25T09:14:06.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa24b1e5000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55891674e150 con 0x5589169c0920 2024-04-25T09:14:06.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa244a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c1240 0x5589169769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa244a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c1240 0x5589169769f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44310/0 (socket says 172.21.15.173:44310) 2024-04-25T09:14:06.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa244a00640 1 -- 172.21.15.173:0/1830402931 learned_addr learned my addr 172.21.15.173:0/1830402931 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:06.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa245e00640 1 --2- 172.21.15.173:0/1830402931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x558916977310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa245400640 1 --2- 172.21.15.173:0/1830402931 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c0920 0x5589169c0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa244a00640 1 -- 172.21.15.173:0/1830402931 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c0920 msgr2=0x5589169c0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:06.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa244a00640 1 --2- 172.21.15.173:0/1830402931 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c0920 0x5589169c0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa244a00640 1 -- 172.21.15.173:0/1830402931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 msgr2=0x558916977310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:06.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa244a00640 1 --2- 172.21.15.173:0/1830402931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x558916977310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.024+0000 7fa244a00640 1 -- 172.21.15.173:0/1830402931 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558916767ca0 con 0x5589169c1240 2024-04-25T09:14:06.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa244a00640 1 --2- 172.21.15.173:0/1830402931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c1240 0x5589169769f0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0078e0 tx=0x7fa22c007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e113c9c22ffa5116 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:06.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa232000640 1 -- 172.21.15.173:0/1830402931 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c018070 con 0x5589169c1240 2024-04-25T09:14:06.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa232000640 1 -- 172.21.15.173:0/1830402931 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c010b00 con 0x5589169c1240 2024-04-25T09:14:06.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa232000640 1 -- 172.21.15.173:0/1830402931 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c014430 con 0x5589169c1240 2024-04-25T09:14:06.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa24b1e5000 1 -- 172.21.15.173:0/1830402931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c1240 msgr2=0x5589169769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/1830402931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c1240 0x5589169769f0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0078e0 tx=0x7fa22c007da0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa24b1e5000 1 -- 172.21.15.173:0/1830402931 shutdown_connections 2024-04-25T09:14:06.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/1830402931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x558916977310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/1830402931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c1240 0x5589169769f0 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/1830402931 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c0920 0x5589169c0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa24b1e5000 1 -- 172.21.15.173:0/1830402931 >> 172.21.15.173:0/1830402931 conn(0x55891697d2a0 msgr2=0x5589169752d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:06.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa24b1e5000 1 -- 172.21.15.173:0/1830402931 shutdown_connections 2024-04-25T09:14:06.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa24b1e5000 1 -- 172.21.15.173:0/1830402931 wait complete. 2024-04-25T09:14:06.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa24b1e5000 1 -- start start 2024-04-25T09:14:06.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa24b1e5000 1 Processor -- start 2024-04-25T09:14:06.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa24b1e5000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x5589169c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa24b1e5000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c0920 0x5589169c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa24b1e5000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c1240 0x55891697aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa24b1e5000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x558916780990 con 0x5589169c0920 2024-04-25T09:14:06.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa24b1e5000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589167c1e40 con 0x558916976f30 2024-04-25T09:14:06.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa24b1e5000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x558916751900 con 0x5589169c1240 2024-04-25T09:14:06.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa24b1e5000 10 client.0 _ll_register_callbacks cb 0x5589168791c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:14:06.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa244a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c0920 0x5589169c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa245400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x5589169c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa244a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c0920 0x5589169c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44326/0 (socket says 172.21.15.173:44326) 2024-04-25T09:14:06.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa244a00640 1 -- 172.21.15.173:0/4061656598 learned_addr learned my addr 172.21.15.173:0/4061656598 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:06.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa245e00640 1 --2- 172.21.15.173:0/4061656598 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c1240 0x55891697aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa245400640 1 -- 172.21.15.173:0/4061656598 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c1240 msgr2=0x55891697aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:06.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa245400640 1 --2- 172.21.15.173:0/4061656598 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c1240 0x55891697aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa245400640 1 -- 172.21.15.173:0/4061656598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c0920 msgr2=0x5589169c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:06.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa245400640 1 --2- 172.21.15.173:0/4061656598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c0920 0x5589169c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa245400640 1 -- 172.21.15.173:0/4061656598 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55891677e630 con 0x558916976f30 2024-04-25T09:14:06.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa244a00640 1 --2- 172.21.15.173:0/4061656598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c0920 0x5589169c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:06.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa245400640 1 --2- 172.21.15.173:0/4061656598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x5589169c7cf0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa2340012f0 tx=0x7fa234011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1bb94617d2a1fe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:06.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.028+0000 7fa226a00640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-04-25T09:14:06.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa226a00640 1 -- 172.21.15.173:0/4061656598 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa234027060 con 0x558916976f30 2024-04-25T09:14:06.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa226a00640 1 -- 172.21.15.173:0/4061656598 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa234010040 con 0x558916976f30 2024-04-25T09:14:06.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 1 -- 172.21.15.173:0/4061656598 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa22c010b00 con 0x558916976f30 2024-04-25T09:14:06.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa226a00640 1 -- 172.21.15.173:0/4061656598 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa234012440 con 0x558916976f30 2024-04-25T09:14:06.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 10 client.9124 fetch_fsmap learned FSMap version 102 2024-04-25T09:14:06.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 1 -- 172.21.15.173:0/4061656598 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) v3 -- 0x55891674e3a0 con 0x558916976f30 2024-04-25T09:14:06.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa226a00640 1 -- 172.21.15.173:0/4061656598 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c010b00 con 0x558916976f30 2024-04-25T09:14:06.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa226a00640 1 -- 172.21.15.173:0/4061656598 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 102) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa2340125e0 con 0x558916976f30 2024-04-25T09:14:06.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 10 client.9124 fetch_fsmap finished waiting for FSMap version 102 2024-04-25T09:14:06.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 10 client.9124 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T09:14:06.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 20 client.9124 populate_metadata read hostname 'smithi173' 2024-04-25T09:14:06.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/4061656598 >> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] conn(0x55891697b4b0 0x55891697b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 4 client.9124 mds_command: new command op to 9969 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:14:06.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 1 -- 172.21.15.173:0/4061656598 --> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558916761a50 con 0x55891697b4b0 2024-04-25T09:14:06.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa244a00640 1 --2- 172.21.15.173:0/4061656598 >> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] conn(0x55891697b4b0 0x55891697b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa244a00640 1 --2- 172.21.15.173:0/4061656598 >> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] conn(0x55891697b4b0 0x55891697b890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f3ee8a1593a96f2 server_cookie=89c32ebeb359576b in_seq=0 out_seq=0 2024-04-25T09:14:06.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa226a00640 10 client.9124 ms_handle_connect on v2:172.21.15.194:6833/3308916795 2024-04-25T09:14:06.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa226a00640 1 -- 172.21.15.173:0/4061656598 <== mds.0 v2:172.21.15.194:6833/3308916795 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558916761a50 con 0x55891697b4b0 2024-04-25T09:14:06.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa226a00640 10 client.9124 handle_command_reply: tid=0 2024-04-25T09:14:06.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 1 client.9124 shutdown 2024-04-25T09:14:06.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 1 -- 172.21.15.173:0/4061656598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 msgr2=0x5589169c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/4061656598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x5589169c7cf0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa2340012f0 tx=0x7fa234011000 comp rx=0 tx=0).stop 2024-04-25T09:14:06.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 1 -- 172.21.15.173:0/4061656598 shutdown_connections 2024-04-25T09:14:06.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/4061656598 >> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] conn(0x55891697b4b0 0x55891697b890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/4061656598 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c1240 0x55891697aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/4061656598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c0920 0x5589169c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/4061656598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x5589169c7cf0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa226a00640 0 client.9124 ms_handle_reset on v2:172.21.15.194:6833/3308916795 2024-04-25T09:14:06.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 1 -- 172.21.15.173:0/4061656598 >> 172.21.15.173:0/4061656598 conn(0x55891697d2a0 msgr2=0x5589169759e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:06.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 1 -- 172.21.15.173:0/4061656598 shutdown_connections 2024-04-25T09:14:06.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 1 -- 172.21.15.173:0/4061656598 wait complete. 2024-04-25T09:14:06.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.032+0000 7fa24b1e5000 20 client.9124 trim_cache size 0 max 16384 2024-04-25T09:14:06.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.048+0000 7fa24b1e5000 1 Processor -- start 2024-04-25T09:14:06.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.048+0000 7fa24b1e5000 1 -- start start 2024-04-25T09:14:06.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.048+0000 7fa24b1e5000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x5589169bece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.048+0000 7fa24b1e5000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c0920 0x5589169bf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.048+0000 7fa24b1e5000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c1240 0x5589169ca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.048+0000 7fa24b1e5000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa240202480 con 0x5589169c0920 2024-04-25T09:14:06.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.048+0000 7fa24b1e5000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2401f76d0 con 0x558916976f30 2024-04-25T09:14:06.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.048+0000 7fa24b1e5000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa240201e80 con 0x5589169c1240 2024-04-25T09:14:06.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.048+0000 7fa244a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c0920 0x5589169bf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.048+0000 7fa244a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c0920 0x5589169bf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44336/0 (socket says 172.21.15.173:44336) 2024-04-25T09:14:06.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.048+0000 7fa244a00640 1 -- 172.21.15.173:0/2384902105 learned_addr learned my addr 172.21.15.173:0/2384902105 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:06.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa244a00640 1 -- 172.21.15.173:0/2384902105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c1240 msgr2=0x5589169ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:06.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa244a00640 1 --2- 172.21.15.173:0/2384902105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c1240 0x5589169ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa244a00640 1 -- 172.21.15.173:0/2384902105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 msgr2=0x5589169bece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:06.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa245400640 1 --2- 172.21.15.173:0/2384902105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x5589169bece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa244a00640 1 --2- 172.21.15.173:0/2384902105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x5589169bece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa244a00640 1 -- 172.21.15.173:0/2384902105 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589169c1070 con 0x5589169c0920 2024-04-25T09:14:06.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa245400640 1 --2- 172.21.15.173:0/2384902105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x5589169bece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:06.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa244a00640 1 --2- 172.21.15.173:0/2384902105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c0920 0x5589169bf220 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x558916769200 tx=0x7fa22c009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f676a89bf6a2e3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:06.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa231600640 1 -- 172.21.15.173:0/2384902105 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c018040 con 0x5589169c0920 2024-04-25T09:14:06.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa231600640 1 -- 172.21.15.173:0/2384902105 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c004030 con 0x5589169c0920 2024-04-25T09:14:06.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa231600640 1 -- 172.21.15.173:0/2384902105 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c0043e0 con 0x5589169c0920 2024-04-25T09:14:06.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa24b1e5000 1 -- 172.21.15.173:0/2384902105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c0920 msgr2=0x5589169bf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/2384902105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c0920 0x5589169bf220 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x558916769200 tx=0x7fa22c009000 comp rx=0 tx=0).stop 2024-04-25T09:14:06.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa24b1e5000 1 -- 172.21.15.173:0/2384902105 shutdown_connections 2024-04-25T09:14:06.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/2384902105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c1240 0x5589169ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/2384902105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c0920 0x5589169bf220 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/2384902105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x5589169bece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa24b1e5000 1 -- 172.21.15.173:0/2384902105 >> 172.21.15.173:0/2384902105 conn(0x55891697d2a0 msgr2=0x55891697a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:06.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa24b1e5000 1 -- 172.21.15.173:0/2384902105 shutdown_connections 2024-04-25T09:14:06.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa24b1e5000 1 -- 172.21.15.173:0/2384902105 wait complete. 2024-04-25T09:14:06.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa24b1e5000 1 -- start start 2024-04-25T09:14:06.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa24b1e5000 1 Processor -- start 2024-04-25T09:14:06.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa24b1e5000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x5589169cd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa24b1e5000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c0920 0x558916a07b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa24b1e5000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c1240 0x558916a08040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa24b1e5000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589167ca3d0 con 0x5589169c1240 2024-04-25T09:14:06.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa24b1e5000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x558916881d50 con 0x558916976f30 2024-04-25T09:14:06.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa24b1e5000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x558916760980 con 0x5589169c0920 2024-04-25T09:14:06.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa24b1e5000 10 client.0 _ll_register_callbacks cb 0x7fa22c007550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:14:06.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa245e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c1240 0x558916a08040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa245e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c1240 0x558916a08040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44348/0 (socket says 172.21.15.173:44348) 2024-04-25T09:14:06.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa245e00640 1 -- 172.21.15.173:0/209833313 learned_addr learned my addr 172.21.15.173:0/209833313 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:06.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa245400640 1 --2- 172.21.15.173:0/209833313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x5589169cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa244a00640 1 --2- 172.21.15.173:0/209833313 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c0920 0x558916a07b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa245e00640 1 -- 172.21.15.173:0/209833313 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c0920 msgr2=0x558916a07b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:06.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa245e00640 1 --2- 172.21.15.173:0/209833313 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c0920 0x558916a07b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa245e00640 1 -- 172.21.15.173:0/209833313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 msgr2=0x5589169cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:06.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa245e00640 1 --2- 172.21.15.173:0/209833313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x5589169cd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa245e00640 1 -- 172.21.15.173:0/209833313 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558916847600 con 0x5589169c1240 2024-04-25T09:14:06.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa245400640 1 --2- 172.21.15.173:0/209833313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x5589169cd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:06.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa244a00640 1 --2- 172.21.15.173:0/209833313 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c0920 0x558916a07b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:06.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa245e00640 1 --2- 172.21.15.173:0/209833313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c1240 0x558916a08040 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fa238018f70 tx=0x7fa2380ab6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64e11cc85af8264 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:06.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.052+0000 7fa226a00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:14:06.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa226a00640 1 -- 172.21.15.173:0/209833313 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2380f32b0 con 0x5589169c1240 2024-04-25T09:14:06.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 1 -- 172.21.15.173:0/209833313 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa22c004030 con 0x5589169c1240 2024-04-25T09:14:06.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa226a00640 1 -- 172.21.15.173:0/209833313 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa2380bec40 con 0x5589169c1240 2024-04-25T09:14:06.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa226a00640 1 -- 172.21.15.173:0/209833313 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2380bee40 con 0x5589169c1240 2024-04-25T09:14:06.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 10 client.10143 fetch_fsmap learned FSMap version 102 2024-04-25T09:14:06.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 1 -- 172.21.15.173:0/209833313 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) v3 -- 0x55891675a9b0 con 0x5589169c1240 2024-04-25T09:14:06.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa226a00640 1 -- 172.21.15.173:0/209833313 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c004030 con 0x5589169c1240 2024-04-25T09:14:06.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa226a00640 1 -- 172.21.15.173:0/209833313 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 102) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa2380b3050 con 0x5589169c1240 2024-04-25T09:14:06.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 10 client.10143 fetch_fsmap finished waiting for FSMap version 102 2024-04-25T09:14:06.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 10 client.10143 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T09:14:06.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 20 client.10143 populate_metadata read hostname 'smithi173' 2024-04-25T09:14:06.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/209833313 >> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] conn(0x558916a1dec0 0x558916a1e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 4 client.10143 mds_command: new command op to 9969 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:14:06.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 1 -- 172.21.15.173:0/209833313 --> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5589167d32e0 con 0x558916a1dec0 2024-04-25T09:14:06.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa245400640 1 --2- 172.21.15.173:0/209833313 >> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] conn(0x558916a1dec0 0x558916a1e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa245400640 1 --2- 172.21.15.173:0/209833313 >> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] conn(0x558916a1dec0 0x558916a1e2a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d75dd7f446a5f794 server_cookie=fea30c910a93ede4 in_seq=0 out_seq=0 2024-04-25T09:14:06.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa226a00640 10 client.10143 ms_handle_connect on v2:172.21.15.194:6833/3308916795 2024-04-25T09:14:06.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa226a00640 1 -- 172.21.15.173:0/209833313 <== mds.0 v2:172.21.15.194:6833/3308916795 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x5589167d32e0 con 0x558916a1dec0 2024-04-25T09:14:06.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa226a00640 10 client.10143 handle_command_reply: tid=0 2024-04-25T09:14:06.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 1 client.10143 shutdown 2024-04-25T09:14:06.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 1 -- 172.21.15.173:0/209833313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c1240 msgr2=0x558916a08040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/209833313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c1240 0x558916a08040 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fa238018f70 tx=0x7fa2380ab6c0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 1 -- 172.21.15.173:0/209833313 shutdown_connections 2024-04-25T09:14:06.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/209833313 >> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] conn(0x558916a1dec0 0x558916a1e2a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/209833313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5589169c1240 0x558916a08040 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/209833313 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5589169c0920 0x558916a07b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa226a00640 0 client.10143 ms_handle_reset on v2:172.21.15.194:6833/3308916795 2024-04-25T09:14:06.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 1 --2- 172.21.15.173:0/209833313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558916976f30 0x5589169cd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 1 -- 172.21.15.173:0/209833313 >> 172.21.15.173:0/209833313 conn(0x55891697d2a0 msgr2=0x5589169bdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:06.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 1 -- 172.21.15.173:0/209833313 shutdown_connections 2024-04-25T09:14:06.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 1 -- 172.21.15.173:0/209833313 wait complete. 2024-04-25T09:14:06.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa24b1e5000 20 client.10143 trim_cache size 0 max 16384 2024-04-25T09:14:06.049 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:14:06.049 INFO:teuthology.orchestra.run.smithi173.stdout: "cluster_fsid": "ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6", 2024-04-25T09:14:06.049 INFO:teuthology.orchestra.run.smithi173.stdout: "whoami": 0, 2024-04-25T09:14:06.049 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 9969, 2024-04-25T09:14:06.050 INFO:teuthology.orchestra.run.smithi173.stdout: "want_state": "up:active", 2024-04-25T09:14:06.050 INFO:teuthology.orchestra.run.smithi173.stdout: "state": "up:active", 2024-04-25T09:14:06.050 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs", 2024-04-25T09:14:06.050 INFO:teuthology.orchestra.run.smithi173.stdout: "rank_uptime": 10.332612648, 2024-04-25T09:14:06.050 INFO:teuthology.orchestra.run.smithi173.stdout: "mdsmap_epoch": 102, 2024-04-25T09:14:06.050 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch": 144, 2024-04-25T09:14:06.050 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch_barrier": 144, 2024-04-25T09:14:06.050 INFO:teuthology.orchestra.run.smithi173.stdout: "uptime": 15.235744575 2024-04-25T09:14:06.050 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:14:06.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa247e00640 1 -- 172.21.15.173:0/2099814787 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa220066f60 msgr2=0x7fa220069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa247e00640 1 --2- 172.21.15.173:0/2099814787 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa220066f60 0x7fa220069420 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fa234007fd0 tx=0x7fa234005b80 comp rx=0 tx=0).stop 2024-04-25T09:14:06.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa247e00640 1 -- 172.21.15.173:0/2099814787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa240145290 msgr2=0x7fa24013d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa247e00640 1 --2- 172.21.15.173:0/2099814787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa240145290 0x7fa24013d480 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7fa2380ae040 tx=0x7fa238019100 comp rx=0 tx=0).stop 2024-04-25T09:14:06.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa247e00640 1 -- 172.21.15.173:0/2099814787 shutdown_connections 2024-04-25T09:14:06.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa247e00640 1 --2- 172.21.15.173:0/2099814787 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fa220066f60 0x7fa220069420 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa247e00640 1 --2- 172.21.15.173:0/2099814787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa240145290 0x7fa24013d480 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa247e00640 1 --2- 172.21.15.173:0/2099814787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2400cc260 0x7fa24013cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa247e00640 1 --2- 172.21.15.173:0/2099814787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2400b3fe0 0x7fa2400af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa247e00640 1 -- 172.21.15.173:0/2099814787 >> 172.21.15.173:0/2099814787 conn(0x7fa24006ac90 msgr2=0x7fa2400b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:06.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa247e00640 1 -- 172.21.15.173:0/2099814787 shutdown_connections 2024-04-25T09:14:06.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.056+0000 7fa247e00640 1 -- 172.21.15.173:0/2099814787 wait complete. 2024-04-25T09:14:06.061 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:14:06.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f535c800640 1 Processor -- start 2024-04-25T09:14:06.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f535c800640 1 -- start start 2024-04-25T09:14:06.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f535c800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53540d0dc0 0x7f53540717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f535c800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535415c8e0 con 0x7f535415be20 2024-04-25T09:14:06.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f535c800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535415cbc0 con 0x7f53540ce9b0 2024-04-25T09:14:06.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f535c800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53540d11a0 con 0x7f53540d0dc0 2024-04-25T09:14:06.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5359400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f535415be20 0x7f53540ce2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:47150/0 (socket says 172.21.15.173:47150) 2024-04-25T09:14:06.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5359400640 1 -- 172.21.15.173:0/4141336121 learned_addr learned my addr 172.21.15.173:0/4141336121 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:06.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5359e00640 1 --2- 172.21.15.173:0/4141336121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53540d0dc0 0x7f53540717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5358a00640 1 -- 172.21.15.173:0/4141336121 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894373289 0 0) 0x7f535415c8e0 con 0x7f535415be20 2024-04-25T09:14:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5358a00640 1 -- 172.21.15.173:0/4141336121 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f533c003530 con 0x7f535415be20 2024-04-25T09:14:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5358a00640 1 -- 172.21.15.173:0/4141336121 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1676805935 0 0) 0x7f533c003530 con 0x7f535415be20 2024-04-25T09:14:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5358a00640 1 -- 172.21.15.173:0/4141336121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53540d0dc0 msgr2=0x7f53540717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5358a00640 1 --2- 172.21.15.173:0/4141336121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53540d0dc0 0x7f53540717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5358a00640 1 -- 172.21.15.173:0/4141336121 >> v1:172.21.15.194:6789/0 conn(0x7f53540ce9b0 legacy=0x7f53540cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5358a00640 1 -- 172.21.15.173:0/4141336121 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5354070fb0 con 0x7f535415be20 2024-04-25T09:14:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5358a00640 1 -- 172.21.15.173:0/4141336121 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f5344001680 con 0x7f535415be20 2024-04-25T09:14:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5358a00640 1 -- 172.21.15.173:0/4141336121 >> v1:172.21.15.173:6789/0 conn(0x7f535415be20 legacy=0x7f53540ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5358a00640 1 --2- 172.21.15.173:0/4141336121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f533c0039f0 0x7f533c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5358a00640 1 --2- 172.21.15.173:0/4141336121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f533c0043a0 0x7f533c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5358a00640 1 --2- 172.21.15.173:0/4141336121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53540d0dc0 0x7f533c0050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5358a00640 1 -- 172.21.15.173:0/4141336121 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53540d11a0 con 0x7f533c0043a0 2024-04-25T09:14:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5358a00640 1 -- 172.21.15.173:0/4141336121 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c00b9d0 con 0x7f533c0039f0 2024-04-25T09:14:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5358a00640 1 -- 172.21.15.173:0/4141336121 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533c00bbd0 con 0x7f53540d0dc0 2024-04-25T09:14:06.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5359400640 1 --2- 172.21.15.173:0/4141336121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f533c0043a0 0x7f533c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5359e00640 1 --2- 172.21.15.173:0/4141336121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f533c0039f0 0x7f533c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f535a800640 1 --2- 172.21.15.173:0/4141336121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53540d0dc0 0x7f533c0050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5359400640 1 -- 172.21.15.173:0/4141336121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53540d0dc0 msgr2=0x7f533c0050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5359400640 1 --2- 172.21.15.173:0/4141336121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53540d0dc0 0x7f533c0050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5359400640 1 -- 172.21.15.173:0/4141336121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f533c0039f0 msgr2=0x7f533c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5359400640 1 --2- 172.21.15.173:0/4141336121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f533c0039f0 0x7f533c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f5359400640 1 -- 172.21.15.173:0/4141336121 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c003530 con 0x7f533c0043a0 2024-04-25T09:14:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.212+0000 7f535a800640 1 --2- 172.21.15.173:0/4141336121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53540d0dc0 0x7f533c0050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:06.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.216+0000 7f5359400640 1 --2- 172.21.15.173:0/4141336121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f533c0043a0 0x7f533c004870 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f534400c2c0 tx=0x7f534401cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb31842472f7933 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:06.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.216+0000 7f5358a00640 1 -- 172.21.15.173:0/4141336121 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5344007d60 con 0x7f533c0043a0 2024-04-25T09:14:06.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.216+0000 7f5358a00640 1 -- 172.21.15.173:0/4141336121 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53440a9070 con 0x7f533c0043a0 2024-04-25T09:14:06.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.216+0000 7f5358a00640 1 -- 172.21.15.173:0/4141336121 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53440a5df0 con 0x7f533c0043a0 2024-04-25T09:14:06.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.216+0000 7f535c800640 1 -- 172.21.15.173:0/4141336121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f533c0043a0 msgr2=0x7f533c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.216+0000 7f535c800640 1 --2- 172.21.15.173:0/4141336121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f533c0043a0 0x7f533c004870 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f534400c2c0 tx=0x7f534401cd20 comp rx=0 tx=0).stop 2024-04-25T09:14:06.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.216+0000 7f535a800640 1 -- 172.21.15.173:0/4141336121 reap_dead start 2024-04-25T09:14:06.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.216+0000 7f535c800640 1 -- 172.21.15.173:0/4141336121 shutdown_connections 2024-04-25T09:14:06.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.216+0000 7f535c800640 1 -- 172.21.15.173:0/4141336121 >> 172.21.15.173:0/4141336121 conn(0x7f53540b3540 msgr2=0x7f53540b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:06.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.216+0000 7f535c800640 1 -- 172.21.15.173:0/4141336121 shutdown_connections 2024-04-25T09:14:06.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.216+0000 7f535c800640 1 -- 172.21.15.173:0/4141336121 wait complete. 2024-04-25T09:14:06.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f535c800640 1 Processor -- start 2024-04-25T09:14:06.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f535c800640 1 -- start start 2024-04-25T09:14:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f535c800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f533c0043a0 0x7f535413f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f535c800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5354141920 0x7f5354141110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f535c800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f535413efe0 0x7f535415e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f535c800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5354158ed0 con 0x7f5354141920 2024-04-25T09:14:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f535c800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5354158d50 con 0x7f533c0043a0 2024-04-25T09:14:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f535c800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5354159050 con 0x7f535413efe0 2024-04-25T09:14:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f5359400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5354141920 0x7f5354141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f5359400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5354141920 0x7f5354141110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44364/0 (socket says 172.21.15.173:44364) 2024-04-25T09:14:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f5359400640 1 -- 172.21.15.173:0/3778106947 learned_addr learned my addr 172.21.15.173:0/3778106947 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f5359e00640 1 --2- 172.21.15.173:0/3778106947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f533c0043a0 0x7f535413f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f535a800640 1 --2- 172.21.15.173:0/3778106947 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f535413efe0 0x7f535415e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f5359400640 1 -- 172.21.15.173:0/3778106947 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f535413efe0 msgr2=0x7f535415e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f5359400640 1 --2- 172.21.15.173:0/3778106947 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f535413efe0 0x7f535415e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f5359400640 1 -- 172.21.15.173:0/3778106947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f533c0043a0 msgr2=0x7f535413f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f5359400640 1 --2- 172.21.15.173:0/3778106947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f533c0043a0 0x7f535413f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f5359400640 1 -- 172.21.15.173:0/3778106947 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535413fdd0 con 0x7f5354141920 2024-04-25T09:14:06.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f5359400640 1 --2- 172.21.15.173:0/3778106947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5354141920 0x7f5354141110 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f5344001980 tx=0x7f533c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:06.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f534e000640 1 -- 172.21.15.173:0/3778106947 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5344007d60 con 0x7f5354141920 2024-04-25T09:14:06.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f534e000640 1 -- 172.21.15.173:0/3778106947 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53440a5990 con 0x7f5354141920 2024-04-25T09:14:06.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f534e000640 1 -- 172.21.15.173:0/3778106947 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53440047f0 con 0x7f5354141920 2024-04-25T09:14:06.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f535c800640 1 -- 172.21.15.173:0/3778106947 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5354140070 con 0x7f5354141920 2024-04-25T09:14:06.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f535c800640 1 -- 172.21.15.173:0/3778106947 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5354140630 con 0x7f5354141920 2024-04-25T09:14:06.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.220+0000 7f535c800640 1 -- 172.21.15.173:0/3778106947 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5354073a40 con 0x7f5354141920 2024-04-25T09:14:06.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.224+0000 7f534e000640 1 -- 172.21.15.173:0/3778106947 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5344004990 con 0x7f5354141920 2024-04-25T09:14:06.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.224+0000 7f534e000640 1 --2- 172.21.15.173:0/3778106947 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5338066f90 0x7f5338069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.224+0000 7f534e000640 1 -- 172.21.15.173:0/3778106947 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f534411e470 con 0x7f5354141920 2024-04-25T09:14:06.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.224+0000 7f5359e00640 1 --2- 172.21.15.173:0/3778106947 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5338066f90 0x7f5338069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.224+0000 7f5359e00640 1 --2- 172.21.15.173:0/3778106947 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5338066f90 0x7f5338069450 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f5348009be0 tx=0x7f5348009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:06.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.228+0000 7f534e000640 1 -- 172.21.15.173:0/3778106947 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5344016a30 con 0x7f5354141920 2024-04-25T09:14:06.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.416+0000 7f535c800640 1 -- 172.21.15.173:0/3778106947 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f53540cf130 con 0x7f5354141920 2024-04-25T09:14:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.416+0000 7f534e000640 1 -- 172.21.15.173:0/3778106947 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v102) v1 ==== 53+0+73 (secure 0 0 0) 0x7f53440eeb70 con 0x7f5354141920 2024-04-25T09:14:06.401 INFO:teuthology.orchestra.run.smithi173.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:14:06.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.416+0000 7f535c800640 1 -- 172.21.15.173:0/3778106947 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5338066f90 msgr2=0x7f5338069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.416+0000 7f535c800640 1 --2- 172.21.15.173:0/3778106947 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5338066f90 0x7f5338069450 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f5348009be0 tx=0x7f5348009190 comp rx=0 tx=0).stop 2024-04-25T09:14:06.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.416+0000 7f535c800640 1 -- 172.21.15.173:0/3778106947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5354141920 msgr2=0x7f5354141110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.416+0000 7f535c800640 1 --2- 172.21.15.173:0/3778106947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5354141920 0x7f5354141110 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f5344001980 tx=0x7f533c005840 comp rx=0 tx=0).stop 2024-04-25T09:14:06.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.416+0000 7f535c800640 1 -- 172.21.15.173:0/3778106947 shutdown_connections 2024-04-25T09:14:06.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.416+0000 7f535c800640 1 --2- 172.21.15.173:0/3778106947 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5338066f90 0x7f5338069450 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.416+0000 7f535c800640 1 --2- 172.21.15.173:0/3778106947 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f535413efe0 0x7f535415e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.416+0000 7f535c800640 1 --2- 172.21.15.173:0/3778106947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5354141920 0x7f5354141110 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.416+0000 7f535c800640 1 --2- 172.21.15.173:0/3778106947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f533c0043a0 0x7f535413f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.416+0000 7f535c800640 1 -- 172.21.15.173:0/3778106947 >> 172.21.15.173:0/3778106947 conn(0x7f53540b3540 msgr2=0x7f5354158420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:06.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.416+0000 7f535c800640 1 -- 172.21.15.173:0/3778106947 shutdown_connections 2024-04-25T09:14:06.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:06.416+0000 7f535c800640 1 -- 172.21.15.173:0/3778106947 wait complete. 2024-04-25T09:14:06.423 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:14:06.423 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:14:06.423 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2024-04-25T09:14:06.423 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:14:06.423 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:06.423 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:14:06.423 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:14:06.423 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:14:06.423 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:14:06.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:06.424 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2024-04-25T09:14:06.432 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:14:06.432 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:14:06.432 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:14:06.432 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:06.432 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-25T09:14:06.433 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:06.433 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:14:06.433 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:06.433 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2024-04-25T09:14:06.433 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:14:06.433 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:06.433 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2024-04-25T09:14:06.433 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:14:06.433 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:06.433 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:14:06.433 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:06.434 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:14:06.434 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 41772sec preferred_lft 41772sec 2024-04-25T09:14:06.434 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2024-04-25T09:14:06.434 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:06.434 INFO:teuthology.orchestra.run.smithi173.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:14:06.434 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 02:42:00:0e:60:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:06.434 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:14:06.434 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:06.434 INFO:teuthology.orchestra.run.smithi173.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:14:06.434 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:06.434 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:14:06.434 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:06.434 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:14:06.435 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:06.435 INFO:teuthology.orchestra.run.smithi173.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:14:06.435 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:14:06.435 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:14:06.435 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:06.435 INFO:teuthology.orchestra.run.smithi173.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:14:06.435 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:14:06.435 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:14:06.435 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:06.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:06.436 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:14:06.500 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-04-25T09:14:06.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:06.503 DEBUG:teuthology.orchestra.run.smithi173:> route 2024-04-25T09:14:06.559 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2024-04-25T09:14:06.559 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:14:06.559 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:14:06.559 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:14:06.559 INFO:teuthology.orchestra.run.smithi173.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:14:06.559 INFO:teuthology.orchestra.run.smithi173.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:14:06.559 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:14:06.559 INFO:teuthology.orchestra.run.smithi173.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:14:06.559 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:14:06.560 INFO:teuthology.orchestra.run.smithi173.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:14:06.560 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:14:06.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:06.560 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2024-04-25T09:14:06.560 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:06.560 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:14:06.560 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:14:06.560 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:14:06.560 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:06.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:06.652 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-25T09:14:06.660 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:14:06.660 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:14:06.661 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:14:06.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:06.661 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2024-04-25T09:14:06.722 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:14:06.722 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:06.775 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:14:06.775 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:14:06.775 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:06.830 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:14:06.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:06.831 DEBUG:teuthology.orchestra.run.smithi173:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:06.918 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:06.918 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:14:06.918 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:14:06.933 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:06.933 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:14:06.934 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:14:06.934 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:14:06.934 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:14:06.943 INFO:teuthology.orchestra.run.smithi173.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:06.943 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:14:06.943 INFO:teuthology.orchestra.run.smithi173.stdout:invalid new device string format 2024-04-25T09:14:06.943 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-04-25T09:14:06.943 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:14:06.943 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: resolved to: "172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-04-25T09:14:06.943 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.173:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-04-25T09:14:06.943 INFO:teuthology.orchestra.run.smithi173.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6" will pass to kernel 2024-04-25T09:14:06.947 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:14:06.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:06.947 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:06.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:06.967 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:14:07.028 INFO:teuthology.orchestra.run.smithi173.stdout:client10152 2024-04-25T09:14:07.029 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:14:07.029 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:07.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:07.079 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:07.079 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:07.079 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.0 2024-04-25T09:14:07.079 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:07.079 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:07.079 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:07.079 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:07.162 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.163 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.163 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193371 s, 54.2 MB/s 2024-04-25T09:14:07.184 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.184 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.184 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194564 s, 53.9 MB/s 2024-04-25T09:14:07.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.206 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202917 s, 51.7 MB/s 2024-04-25T09:14:07.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.225 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.225 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166734 s, 62.9 MB/s 2024-04-25T09:14:07.246 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.246 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.246 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198198 s, 52.9 MB/s 2024-04-25T09:14:07.268 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.268 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.268 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193582 s, 54.2 MB/s 2024-04-25T09:14:07.285 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.285 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.285 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160942 s, 65.2 MB/s 2024-04-25T09:14:07.304 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.304 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.304 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166668 s, 62.9 MB/s 2024-04-25T09:14:07.325 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.325 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.325 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197264 s, 53.2 MB/s 2024-04-25T09:14:07.346 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.346 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.346 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186787 s, 56.1 MB/s 2024-04-25T09:14:07.364 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.364 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.365 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166935 s, 62.8 MB/s 2024-04-25T09:14:07.383 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.384 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.384 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173753 s, 60.3 MB/s 2024-04-25T09:14:07.411 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.411 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.411 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256519 s, 40.9 MB/s 2024-04-25T09:14:07.428 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.428 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.428 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153322 s, 68.4 MB/s 2024-04-25T09:14:07.445 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.445 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.445 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149156 s, 70.3 MB/s 2024-04-25T09:14:07.465 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.466 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.466 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191389 s, 54.8 MB/s 2024-04-25T09:14:07.480 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.480 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.480 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012426 s, 84.4 MB/s 2024-04-25T09:14:07.506 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.506 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.506 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241801 s, 43.4 MB/s 2024-04-25T09:14:07.526 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.527 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.527 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191248 s, 54.8 MB/s 2024-04-25T09:14:07.543 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.543 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.543 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149446 s, 70.2 MB/s 2024-04-25T09:14:07.565 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.565 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.565 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200707 s, 52.2 MB/s 2024-04-25T09:14:07.583 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.583 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.583 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159604 s, 65.7 MB/s 2024-04-25T09:14:07.600 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.600 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.600 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156649 s, 66.9 MB/s 2024-04-25T09:14:07.617 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.617 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.617 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148212 s, 70.7 MB/s 2024-04-25T09:14:07.635 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.636 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.636 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166406 s, 63.0 MB/s 2024-04-25T09:14:07.653 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.653 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.653 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155632 s, 67.4 MB/s 2024-04-25T09:14:07.674 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.674 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.674 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191737 s, 54.7 MB/s 2024-04-25T09:14:07.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.690 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014347 s, 73.1 MB/s 2024-04-25T09:14:07.714 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.715 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.715 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225918 s, 46.4 MB/s 2024-04-25T09:14:07.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.731 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148788 s, 70.5 MB/s 2024-04-25T09:14:07.751 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.751 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.751 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01838 s, 57.0 MB/s 2024-04-25T09:14:07.772 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.772 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.772 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191416 s, 54.8 MB/s 2024-04-25T09:14:07.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:07.774 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:07.774 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:07.774 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.1 2024-04-25T09:14:07.774 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:07.774 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:07.774 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:07.774 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:07.852 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.853 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.853 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190065 s, 55.2 MB/s 2024-04-25T09:14:07.869 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.869 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.869 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145261 s, 72.2 MB/s 2024-04-25T09:14:07.890 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.890 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.890 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189927 s, 55.2 MB/s 2024-04-25T09:14:07.911 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.911 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.911 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193719 s, 54.1 MB/s 2024-04-25T09:14:07.929 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.929 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.929 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161449 s, 64.9 MB/s 2024-04-25T09:14:07.945 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.946 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.946 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150607 s, 69.6 MB/s 2024-04-25T09:14:07.964 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.964 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.964 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167246 s, 62.7 MB/s 2024-04-25T09:14:07.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:07.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:07.982 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157364 s, 66.6 MB/s 2024-04-25T09:14:08.001 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.001 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.001 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172479 s, 60.8 MB/s 2024-04-25T09:14:08.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.022 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193007 s, 54.3 MB/s 2024-04-25T09:14:08.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.042 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179929 s, 58.3 MB/s 2024-04-25T09:14:08.060 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.060 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.060 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164061 s, 63.9 MB/s 2024-04-25T09:14:08.084 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.084 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.084 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219395 s, 47.8 MB/s 2024-04-25T09:14:08.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.101 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.102 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157723 s, 66.5 MB/s 2024-04-25T09:14:08.122 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.122 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.122 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183283 s, 57.2 MB/s 2024-04-25T09:14:08.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.136 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123342 s, 85.0 MB/s 2024-04-25T09:14:08.153 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.153 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.153 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153114 s, 68.5 MB/s 2024-04-25T09:14:08.169 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.169 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.170 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148037 s, 70.8 MB/s 2024-04-25T09:14:08.186 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.186 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.186 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144356 s, 72.6 MB/s 2024-04-25T09:14:08.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.205 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170725 s, 61.4 MB/s 2024-04-25T09:14:08.223 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.223 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.224 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169146 s, 62.0 MB/s 2024-04-25T09:14:08.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.240 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149577 s, 70.1 MB/s 2024-04-25T09:14:08.262 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.262 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.262 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205625 s, 51.0 MB/s 2024-04-25T09:14:08.283 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.283 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.283 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186106 s, 56.3 MB/s 2024-04-25T09:14:08.300 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.300 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.300 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154932 s, 67.7 MB/s 2024-04-25T09:14:08.318 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.318 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.318 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163506 s, 64.1 MB/s 2024-04-25T09:14:08.335 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.335 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.335 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149484 s, 70.1 MB/s 2024-04-25T09:14:08.359 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.359 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.359 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221599 s, 47.3 MB/s 2024-04-25T09:14:08.376 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.377 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.377 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160652 s, 65.3 MB/s 2024-04-25T09:14:08.394 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.394 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.394 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155598 s, 67.4 MB/s 2024-04-25T09:14:08.413 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.413 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.413 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171941 s, 61.0 MB/s 2024-04-25T09:14:08.434 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.434 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.434 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192292 s, 54.5 MB/s 2024-04-25T09:14:08.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:08.436 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:08.436 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:08.436 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.2 2024-04-25T09:14:08.436 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:08.436 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:08.436 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:08.436 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:08.515 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.516 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.516 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186875 s, 56.1 MB/s 2024-04-25T09:14:08.533 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.533 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.533 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156643 s, 66.9 MB/s 2024-04-25T09:14:08.550 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.550 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.551 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160121 s, 65.5 MB/s 2024-04-25T09:14:08.574 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.574 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.574 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219778 s, 47.7 MB/s 2024-04-25T09:14:08.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.592 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159595 s, 65.7 MB/s 2024-04-25T09:14:08.610 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.610 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.610 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155674 s, 67.4 MB/s 2024-04-25T09:14:08.630 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.630 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.630 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188967 s, 55.5 MB/s 2024-04-25T09:14:08.649 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.649 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.649 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167213 s, 62.7 MB/s 2024-04-25T09:14:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142954 s, 73.4 MB/s 2024-04-25T09:14:08.681 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.681 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.681 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147504 s, 71.1 MB/s 2024-04-25T09:14:08.706 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.706 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.706 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232424 s, 45.1 MB/s 2024-04-25T09:14:08.722 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.723 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.723 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145845 s, 71.9 MB/s 2024-04-25T09:14:08.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.739 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147645 s, 71.0 MB/s 2024-04-25T09:14:08.755 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.755 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.755 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140538 s, 74.6 MB/s 2024-04-25T09:14:08.781 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.781 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.781 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023777 s, 44.1 MB/s 2024-04-25T09:14:08.797 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.797 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.797 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146781 s, 71.4 MB/s 2024-04-25T09:14:08.814 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.814 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.814 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148789 s, 70.5 MB/s 2024-04-25T09:14:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.836 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194675 s, 53.9 MB/s 2024-04-25T09:14:08.851 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.852 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.852 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145391 s, 72.1 MB/s 2024-04-25T09:14:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015522 s, 67.6 MB/s 2024-04-25T09:14:08.890 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.891 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.891 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195372 s, 53.7 MB/s 2024-04-25T09:14:08.909 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.909 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.909 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168182 s, 62.3 MB/s 2024-04-25T09:14:08.925 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.925 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.925 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143553 s, 73.0 MB/s 2024-04-25T09:14:08.942 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.943 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.943 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157125 s, 66.7 MB/s 2024-04-25T09:14:08.957 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.957 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.957 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125793 s, 83.4 MB/s 2024-04-25T09:14:08.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:08.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:08.978 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019195 s, 54.6 MB/s 2024-04-25T09:14:09.000 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.000 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.000 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204057 s, 51.4 MB/s 2024-04-25T09:14:09.017 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.018 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.018 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154479 s, 67.9 MB/s 2024-04-25T09:14:09.034 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.034 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.034 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145057 s, 72.3 MB/s 2024-04-25T09:14:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.053 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172984 s, 60.6 MB/s 2024-04-25T09:14:09.070 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.071 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.071 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159421 s, 65.8 MB/s 2024-04-25T09:14:09.090 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.090 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.091 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180274 s, 58.2 MB/s 2024-04-25T09:14:09.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:09.092 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:09.092 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:09.092 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.3 2024-04-25T09:14:09.092 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:09.092 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:09.092 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:09.092 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:09.170 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.170 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.170 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165094 s, 63.5 MB/s 2024-04-25T09:14:09.186 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.186 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.186 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014551 s, 72.1 MB/s 2024-04-25T09:14:09.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.205 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169228 s, 62.0 MB/s 2024-04-25T09:14:09.221 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.221 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.221 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143163 s, 73.2 MB/s 2024-04-25T09:14:09.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.240 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017157 s, 61.1 MB/s 2024-04-25T09:14:09.259 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.259 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.259 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171972 s, 61.0 MB/s 2024-04-25T09:14:09.280 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.280 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.280 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187713 s, 55.9 MB/s 2024-04-25T09:14:09.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.298 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.298 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171033 s, 61.3 MB/s 2024-04-25T09:14:09.318 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.319 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.319 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185397 s, 56.6 MB/s 2024-04-25T09:14:09.343 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.344 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.344 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022435 s, 46.7 MB/s 2024-04-25T09:14:09.361 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.361 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.361 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169726 s, 61.8 MB/s 2024-04-25T09:14:09.383 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.384 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.384 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202295 s, 51.8 MB/s 2024-04-25T09:14:09.400 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.400 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.400 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015039 s, 69.7 MB/s 2024-04-25T09:14:09.417 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.417 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.417 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151027 s, 69.4 MB/s 2024-04-25T09:14:09.437 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.437 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.438 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184506 s, 56.8 MB/s 2024-04-25T09:14:09.457 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.458 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.458 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184642 s, 56.8 MB/s 2024-04-25T09:14:09.474 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.474 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.474 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142823 s, 73.4 MB/s 2024-04-25T09:14:09.490 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.490 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.490 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144668 s, 72.5 MB/s 2024-04-25T09:14:09.511 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.511 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.511 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019245 s, 54.5 MB/s 2024-04-25T09:14:09.529 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.529 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.529 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161 s, 65.1 MB/s 2024-04-25T09:14:09.548 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.548 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.548 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174172 s, 60.2 MB/s 2024-04-25T09:14:09.565 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.565 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.566 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154026 s, 68.1 MB/s 2024-04-25T09:14:09.582 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.582 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.582 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148153 s, 70.8 MB/s 2024-04-25T09:14:09.598 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.598 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.598 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142451 s, 73.6 MB/s 2024-04-25T09:14:09.615 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.615 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.615 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147688 s, 71.0 MB/s 2024-04-25T09:14:09.637 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.637 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.637 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197378 s, 53.1 MB/s 2024-04-25T09:14:09.650 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.650 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.650 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118835 s, 88.2 MB/s 2024-04-25T09:14:09.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.667 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148129 s, 70.8 MB/s 2024-04-25T09:14:09.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.690 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215699 s, 48.6 MB/s 2024-04-25T09:14:09.707 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.707 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.707 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147397 s, 71.1 MB/s 2024-04-25T09:14:09.725 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.725 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.725 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159761 s, 65.6 MB/s 2024-04-25T09:14:09.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.741 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.741 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148869 s, 70.4 MB/s 2024-04-25T09:14:09.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:09.743 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:09.743 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:09.743 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.4 2024-04-25T09:14:09.743 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:09.743 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:09.743 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:09.743 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:09.816 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.816 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.817 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151384 s, 69.3 MB/s 2024-04-25T09:14:09.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.837 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184368 s, 56.9 MB/s 2024-04-25T09:14:09.852 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.853 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.853 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140233 s, 74.8 MB/s 2024-04-25T09:14:09.871 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.871 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.871 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166286 s, 63.1 MB/s 2024-04-25T09:14:09.888 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.888 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.888 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158134 s, 66.3 MB/s 2024-04-25T09:14:09.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.912 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218474 s, 48.0 MB/s 2024-04-25T09:14:09.929 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.929 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.929 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151053 s, 69.4 MB/s 2024-04-25T09:14:09.947 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.947 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.947 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163959 s, 64.0 MB/s 2024-04-25T09:14:09.964 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.964 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.964 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015461 s, 67.8 MB/s 2024-04-25T09:14:09.988 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:09.988 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:09.988 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218813 s, 47.9 MB/s 2024-04-25T09:14:10.008 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.008 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.008 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182946 s, 57.3 MB/s 2024-04-25T09:14:10.029 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.029 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.029 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194329 s, 54.0 MB/s 2024-04-25T09:14:10.046 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.046 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.046 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149476 s, 70.1 MB/s 2024-04-25T09:14:10.067 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.067 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.067 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190238 s, 55.1 MB/s 2024-04-25T09:14:10.086 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.086 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.087 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173087 s, 60.6 MB/s 2024-04-25T09:14:10.107 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.107 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.108 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192581 s, 54.4 MB/s 2024-04-25T09:14:10.124 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.124 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.124 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144085 s, 72.8 MB/s 2024-04-25T09:14:10.142 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.142 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.142 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168273 s, 62.3 MB/s 2024-04-25T09:14:10.164 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.164 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.164 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201179 s, 52.1 MB/s 2024-04-25T09:14:10.181 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.181 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.182 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157841 s, 66.4 MB/s 2024-04-25T09:14:10.199 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.200 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.200 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016466 s, 63.7 MB/s 2024-04-25T09:14:10.218 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.218 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.218 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162185 s, 64.7 MB/s 2024-04-25T09:14:10.235 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.235 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.235 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152359 s, 68.8 MB/s 2024-04-25T09:14:10.251 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.251 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.251 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142863 s, 73.4 MB/s 2024-04-25T09:14:10.267 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.268 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.268 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148014 s, 70.8 MB/s 2024-04-25T09:14:10.288 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.289 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.289 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191103 s, 54.9 MB/s 2024-04-25T09:14:10.315 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.315 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.315 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244972 s, 42.8 MB/s 2024-04-25T09:14:10.336 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.336 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.336 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199198 s, 52.6 MB/s 2024-04-25T09:14:10.351 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.351 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.351 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012777 s, 82.1 MB/s 2024-04-25T09:14:10.368 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.368 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.368 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155465 s, 67.4 MB/s 2024-04-25T09:14:10.384 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.384 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.384 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140759 s, 74.5 MB/s 2024-04-25T09:14:10.400 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.400 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.400 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140706 s, 74.5 MB/s 2024-04-25T09:14:10.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:10.402 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:10.402 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:10.402 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.5 2024-04-25T09:14:10.402 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:10.402 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:10.402 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:10.402 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:10.474 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.474 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.474 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017457 s, 60.1 MB/s 2024-04-25T09:14:10.495 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.495 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.495 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194937 s, 53.8 MB/s 2024-04-25T09:14:10.511 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.512 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.512 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148665 s, 70.5 MB/s 2024-04-25T09:14:10.528 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.528 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.528 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014916 s, 70.3 MB/s 2024-04-25T09:14:10.545 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.545 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.545 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014827 s, 70.7 MB/s 2024-04-25T09:14:10.566 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.566 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.566 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192976 s, 54.3 MB/s 2024-04-25T09:14:10.580 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.580 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.580 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118064 s, 88.8 MB/s 2024-04-25T09:14:10.597 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.597 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.597 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015531 s, 67.5 MB/s 2024-04-25T09:14:10.619 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.619 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.619 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206593 s, 50.8 MB/s 2024-04-25T09:14:10.638 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.638 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.638 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168495 s, 62.2 MB/s 2024-04-25T09:14:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.651 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110592 s, 94.8 MB/s 2024-04-25T09:14:10.671 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.671 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.671 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188547 s, 55.6 MB/s 2024-04-25T09:14:10.688 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.688 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.688 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151195 s, 69.4 MB/s 2024-04-25T09:14:10.707 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.708 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.708 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174431 s, 60.1 MB/s 2024-04-25T09:14:10.724 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.724 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.724 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144927 s, 72.4 MB/s 2024-04-25T09:14:10.743 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.743 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.743 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168433 s, 62.3 MB/s 2024-04-25T09:14:10.762 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.762 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.762 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174752 s, 60.0 MB/s 2024-04-25T09:14:10.780 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.781 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.781 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164681 s, 63.7 MB/s 2024-04-25T09:14:10.801 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.801 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.801 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184603 s, 56.8 MB/s 2024-04-25T09:14:10.820 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.820 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.820 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175737 s, 59.7 MB/s 2024-04-25T09:14:10.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.838 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162029 s, 64.7 MB/s 2024-04-25T09:14:10.855 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.856 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.856 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155259 s, 67.5 MB/s 2024-04-25T09:14:10.873 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.873 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.873 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160026 s, 65.5 MB/s 2024-04-25T09:14:10.887 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.887 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.887 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118577 s, 88.4 MB/s 2024-04-25T09:14:10.906 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.906 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.906 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170311 s, 61.6 MB/s 2024-04-25T09:14:10.922 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.922 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.922 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146167 s, 71.7 MB/s 2024-04-25T09:14:10.938 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.938 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.938 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141637 s, 74.0 MB/s 2024-04-25T09:14:10.957 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.957 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.957 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166689 s, 62.9 MB/s 2024-04-25T09:14:10.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.978 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.978 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198109 s, 52.9 MB/s 2024-04-25T09:14:10.995 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:10.995 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:10.995 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146923 s, 71.4 MB/s 2024-04-25T09:14:11.015 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.015 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.015 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184915 s, 56.7 MB/s 2024-04-25T09:14:11.032 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.032 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.032 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156078 s, 67.2 MB/s 2024-04-25T09:14:11.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:11.034 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:11.034 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:11.034 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.6 2024-04-25T09:14:11.035 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:11.035 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:11.035 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:11.035 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:11.107 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.108 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.108 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145669 s, 72.0 MB/s 2024-04-25T09:14:11.125 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.126 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.126 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163278 s, 64.2 MB/s 2024-04-25T09:14:11.148 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.148 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.148 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201467 s, 52.0 MB/s 2024-04-25T09:14:11.172 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.173 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.173 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230386 s, 45.5 MB/s 2024-04-25T09:14:11.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.192 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175763 s, 59.7 MB/s 2024-04-25T09:14:11.208 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.209 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.209 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148683 s, 70.5 MB/s 2024-04-25T09:14:11.225 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.225 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.225 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148791 s, 70.5 MB/s 2024-04-25T09:14:11.243 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.243 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.243 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163371 s, 64.2 MB/s 2024-04-25T09:14:11.264 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.264 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.264 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189595 s, 55.3 MB/s 2024-04-25T09:14:11.281 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.281 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.281 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015119 s, 69.4 MB/s 2024-04-25T09:14:11.304 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.304 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.305 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218875 s, 47.9 MB/s 2024-04-25T09:14:11.321 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.321 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.321 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144121 s, 72.8 MB/s 2024-04-25T09:14:11.344 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.344 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.344 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210681 s, 49.8 MB/s 2024-04-25T09:14:11.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.360 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144126 s, 72.8 MB/s 2024-04-25T09:14:11.380 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.380 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.380 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018527 s, 56.6 MB/s 2024-04-25T09:14:11.397 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.397 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.397 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014782 s, 70.9 MB/s 2024-04-25T09:14:11.413 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.413 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.413 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145764 s, 71.9 MB/s 2024-04-25T09:14:11.429 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.429 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.429 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143735 s, 73.0 MB/s 2024-04-25T09:14:11.445 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.445 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.445 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143263 s, 73.2 MB/s 2024-04-25T09:14:11.464 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.464 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.464 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171547 s, 61.1 MB/s 2024-04-25T09:14:11.485 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.485 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.485 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189185 s, 55.4 MB/s 2024-04-25T09:14:11.507 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.507 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.507 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019966 s, 52.5 MB/s 2024-04-25T09:14:11.526 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.526 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.526 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171971 s, 61.0 MB/s 2024-04-25T09:14:11.547 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.547 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.547 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191597 s, 54.7 MB/s 2024-04-25T09:14:11.563 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.563 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.563 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146655 s, 71.5 MB/s 2024-04-25T09:14:11.581 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.581 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.582 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163987 s, 63.9 MB/s 2024-04-25T09:14:11.598 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.598 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.598 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148544 s, 70.6 MB/s 2024-04-25T09:14:11.617 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.617 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.617 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016622 s, 63.1 MB/s 2024-04-25T09:14:11.635 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.635 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.635 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166989 s, 62.8 MB/s 2024-04-25T09:14:11.656 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.656 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.656 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019129 s, 54.8 MB/s 2024-04-25T09:14:11.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.673 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.673 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015016 s, 69.8 MB/s 2024-04-25T09:14:11.689 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.689 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.690 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149992 s, 69.9 MB/s 2024-04-25T09:14:11.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:11.691 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:11.691 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:11.691 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.7 2024-04-25T09:14:11.691 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:11.692 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:11.692 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:11.692 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:11.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.767 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169418 s, 61.9 MB/s 2024-04-25T09:14:11.787 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.787 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.787 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182596 s, 57.4 MB/s 2024-04-25T09:14:11.810 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.810 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.810 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180363 s, 58.1 MB/s 2024-04-25T09:14:11.828 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.828 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.828 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194809 s, 53.8 MB/s 2024-04-25T09:14:11.849 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.849 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.850 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197958 s, 53.0 MB/s 2024-04-25T09:14:11.866 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.867 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.867 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015309 s, 68.5 MB/s 2024-04-25T09:14:11.885 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.885 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.885 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168366 s, 62.3 MB/s 2024-04-25T09:14:11.901 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.902 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.902 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145808 s, 71.9 MB/s 2024-04-25T09:14:11.926 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.926 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.926 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221877 s, 47.3 MB/s 2024-04-25T09:14:11.944 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.944 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.944 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169436 s, 61.9 MB/s 2024-04-25T09:14:11.961 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.961 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.961 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148552 s, 70.6 MB/s 2024-04-25T09:14:11.979 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.980 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.980 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169512 s, 61.9 MB/s 2024-04-25T09:14:11.999 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:11.999 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:11.999 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181055 s, 57.9 MB/s 2024-04-25T09:14:12.017 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.017 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.017 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156666 s, 66.9 MB/s 2024-04-25T09:14:12.033 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.033 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.033 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145847 s, 71.9 MB/s 2024-04-25T09:14:12.050 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.050 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.050 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153039 s, 68.5 MB/s 2024-04-25T09:14:12.067 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.067 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.067 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149146 s, 70.3 MB/s 2024-04-25T09:14:12.084 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.084 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.084 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155311 s, 67.5 MB/s 2024-04-25T09:14:12.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.100 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144505 s, 72.6 MB/s 2024-04-25T09:14:12.116 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.116 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.116 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144998 s, 72.3 MB/s 2024-04-25T09:14:12.132 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.132 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.132 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140045 s, 74.9 MB/s 2024-04-25T09:14:12.149 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.149 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.150 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154349 s, 67.9 MB/s 2024-04-25T09:14:12.167 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.167 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.167 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157611 s, 66.5 MB/s 2024-04-25T09:14:12.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.183 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141048 s, 74.3 MB/s 2024-04-25T09:14:12.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.207 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.207 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220196 s, 47.6 MB/s 2024-04-25T09:14:12.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.223 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.223 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145223 s, 72.2 MB/s 2024-04-25T09:14:12.239 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.239 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.239 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147029 s, 71.3 MB/s 2024-04-25T09:14:12.255 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.256 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.256 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147185 s, 71.2 MB/s 2024-04-25T09:14:12.272 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.272 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.272 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145026 s, 72.3 MB/s 2024-04-25T09:14:12.293 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.293 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.294 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194528 s, 53.9 MB/s 2024-04-25T09:14:12.311 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.311 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.311 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161178 s, 65.1 MB/s 2024-04-25T09:14:12.329 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.329 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.329 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163004 s, 64.3 MB/s 2024-04-25T09:14:12.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:12.330 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:12.330 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:12.330 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.8 2024-04-25T09:14:12.331 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:12.331 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:12.331 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:12.331 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:12.407 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.407 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.407 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222941 s, 47.0 MB/s 2024-04-25T09:14:12.425 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.425 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.426 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165696 s, 63.3 MB/s 2024-04-25T09:14:12.446 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.446 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.446 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018783 s, 55.8 MB/s 2024-04-25T09:14:12.459 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.459 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.459 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109822 s, 95.5 MB/s 2024-04-25T09:14:12.479 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.479 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.480 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019214 s, 54.6 MB/s 2024-04-25T09:14:12.495 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.496 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.496 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140693 s, 74.5 MB/s 2024-04-25T09:14:12.516 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.516 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.516 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188432 s, 55.6 MB/s 2024-04-25T09:14:12.533 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.533 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.533 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149089 s, 70.3 MB/s 2024-04-25T09:14:12.548 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.549 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.549 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139239 s, 75.3 MB/s 2024-04-25T09:14:12.565 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.565 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.565 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014465 s, 72.5 MB/s 2024-04-25T09:14:12.581 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.582 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.582 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150236 s, 69.8 MB/s 2024-04-25T09:14:12.595 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.596 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.596 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117789 s, 89.0 MB/s 2024-04-25T09:14:12.613 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.613 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.613 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162185 s, 64.7 MB/s 2024-04-25T09:14:12.636 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.636 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.636 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209653 s, 50.0 MB/s 2024-04-25T09:14:12.656 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.656 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.656 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018338 s, 57.2 MB/s 2024-04-25T09:14:12.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.673 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.673 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149891 s, 70.0 MB/s 2024-04-25T09:14:12.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.690 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.690 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158841 s, 66.0 MB/s 2024-04-25T09:14:12.708 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.708 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.708 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158039 s, 66.3 MB/s 2024-04-25T09:14:12.730 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.730 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.730 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209278 s, 50.1 MB/s 2024-04-25T09:14:12.753 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.753 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.754 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208947 s, 50.2 MB/s 2024-04-25T09:14:12.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.766 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113485 s, 92.4 MB/s 2024-04-25T09:14:12.783 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.783 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.783 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148567 s, 70.6 MB/s 2024-04-25T09:14:12.802 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.802 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.802 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171903 s, 61.0 MB/s 2024-04-25T09:14:12.820 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.820 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.820 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161069 s, 65.1 MB/s 2024-04-25T09:14:12.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.838 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160552 s, 65.3 MB/s 2024-04-25T09:14:12.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.858 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182587 s, 57.4 MB/s 2024-04-25T09:14:12.873 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.873 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.873 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132059 s, 79.4 MB/s 2024-04-25T09:14:12.894 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.894 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.894 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194574 s, 53.9 MB/s 2024-04-25T09:14:12.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.912 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.912 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163644 s, 64.1 MB/s 2024-04-25T09:14:12.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.934 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.934 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199358 s, 52.6 MB/s 2024-04-25T09:14:12.950 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.950 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.950 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147175 s, 71.2 MB/s 2024-04-25T09:14:12.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:12.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:12.969 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167577 s, 62.6 MB/s 2024-04-25T09:14:12.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:12.971 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:12.971 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:12.971 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.9 2024-04-25T09:14:12.971 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:12.971 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:12.971 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:12.971 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:13.044 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.044 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.044 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190906 s, 54.9 MB/s 2024-04-25T09:14:13.065 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.065 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.065 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192951 s, 54.3 MB/s 2024-04-25T09:14:13.081 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.081 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.081 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143949 s, 72.8 MB/s 2024-04-25T09:14:13.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.100 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016598 s, 63.2 MB/s 2024-04-25T09:14:13.117 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.117 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.117 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016038 s, 65.4 MB/s 2024-04-25T09:14:13.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.136 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165753 s, 63.3 MB/s 2024-04-25T09:14:13.152 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.152 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.152 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148203 s, 70.8 MB/s 2024-04-25T09:14:13.170 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.170 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.170 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015947 s, 65.8 MB/s 2024-04-25T09:14:13.194 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.194 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.194 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218463 s, 48.0 MB/s 2024-04-25T09:14:13.217 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.217 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.217 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211613 s, 49.6 MB/s 2024-04-25T09:14:13.237 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.237 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.237 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183068 s, 57.3 MB/s 2024-04-25T09:14:13.258 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.258 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.258 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195516 s, 53.6 MB/s 2024-04-25T09:14:13.276 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.276 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.276 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162164 s, 64.7 MB/s 2024-04-25T09:14:13.300 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.300 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.300 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219151 s, 47.8 MB/s 2024-04-25T09:14:13.322 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.322 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.322 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202809 s, 51.7 MB/s 2024-04-25T09:14:13.339 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.339 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.339 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150903 s, 69.5 MB/s 2024-04-25T09:14:13.357 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.357 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.358 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168224 s, 62.3 MB/s 2024-04-25T09:14:13.376 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.376 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.376 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170881 s, 61.4 MB/s 2024-04-25T09:14:13.393 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.393 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.393 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151947 s, 69.0 MB/s 2024-04-25T09:14:13.409 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.410 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.410 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146535 s, 71.6 MB/s 2024-04-25T09:14:13.430 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.430 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.430 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184076 s, 57.0 MB/s 2024-04-25T09:14:13.446 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.446 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.446 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141733 s, 74.0 MB/s 2024-04-25T09:14:13.463 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.463 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.463 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150537 s, 69.7 MB/s 2024-04-25T09:14:13.480 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.480 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.480 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154998 s, 67.7 MB/s 2024-04-25T09:14:13.496 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.496 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.496 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014457 s, 72.5 MB/s 2024-04-25T09:14:13.512 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.512 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.512 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140772 s, 74.5 MB/s 2024-04-25T09:14:13.529 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.529 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.529 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014949 s, 70.1 MB/s 2024-04-25T09:14:13.545 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.545 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.545 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143016 s, 73.3 MB/s 2024-04-25T09:14:13.568 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.568 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.569 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217223 s, 48.3 MB/s 2024-04-25T09:14:13.584 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.585 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.585 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143689 s, 73.0 MB/s 2024-04-25T09:14:13.603 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.604 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.604 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171117 s, 61.3 MB/s 2024-04-25T09:14:13.621 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.622 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161242 s, 65.0 MB/s 2024-04-25T09:14:13.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:13.623 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:13.623 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:13.623 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.10 2024-04-25T09:14:13.623 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:13.623 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:13.623 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:13.624 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:13.700 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.700 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.700 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189788 s, 55.2 MB/s 2024-04-25T09:14:13.718 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.719 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.719 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165682 s, 63.3 MB/s 2024-04-25T09:14:13.734 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.734 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.735 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143412 s, 73.1 MB/s 2024-04-25T09:14:13.751 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.752 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.752 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149712 s, 70.0 MB/s 2024-04-25T09:14:13.768 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.768 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.768 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152124 s, 68.9 MB/s 2024-04-25T09:14:13.785 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.785 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.785 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014951 s, 70.1 MB/s 2024-04-25T09:14:13.804 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.804 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.804 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166432 s, 63.0 MB/s 2024-04-25T09:14:13.824 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.824 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.824 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186781 s, 56.1 MB/s 2024-04-25T09:14:13.841 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.841 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.841 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147905 s, 70.9 MB/s 2024-04-25T09:14:13.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.858 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149125 s, 70.3 MB/s 2024-04-25T09:14:13.875 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.875 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.875 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156436 s, 67.0 MB/s 2024-04-25T09:14:13.892 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.892 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.892 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149717 s, 70.0 MB/s 2024-04-25T09:14:13.911 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.911 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.911 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173423 s, 60.5 MB/s 2024-04-25T09:14:13.927 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.927 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.927 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145117 s, 72.3 MB/s 2024-04-25T09:14:13.948 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.948 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.948 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193885 s, 54.1 MB/s 2024-04-25T09:14:13.965 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.965 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.965 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153077 s, 68.5 MB/s 2024-04-25T09:14:13.979 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.979 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.979 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121048 s, 86.6 MB/s 2024-04-25T09:14:13.996 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:13.996 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:13.996 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150021 s, 69.9 MB/s 2024-04-25T09:14:14.020 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.020 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.020 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022233 s, 47.2 MB/s 2024-04-25T09:14:14.040 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.041 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.041 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185332 s, 56.6 MB/s 2024-04-25T09:14:14.057 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.057 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.057 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148912 s, 70.4 MB/s 2024-04-25T09:14:14.077 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.077 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.078 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188208 s, 55.7 MB/s 2024-04-25T09:14:14.094 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.095 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.095 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151393 s, 69.3 MB/s 2024-04-25T09:14:14.111 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.111 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.111 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145667 s, 72.0 MB/s 2024-04-25T09:14:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.132 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195266 s, 53.7 MB/s 2024-04-25T09:14:14.149 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.149 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.149 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147321 s, 71.2 MB/s 2024-04-25T09:14:14.170 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.170 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.170 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193614 s, 54.2 MB/s 2024-04-25T09:14:14.191 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.191 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.192 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200123 s, 52.4 MB/s 2024-04-25T09:14:14.212 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.212 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.212 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189395 s, 55.4 MB/s 2024-04-25T09:14:14.229 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.229 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.229 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150426 s, 69.7 MB/s 2024-04-25T09:14:14.250 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.250 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.250 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192319 s, 54.5 MB/s 2024-04-25T09:14:14.271 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.271 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.271 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018859 s, 55.6 MB/s 2024-04-25T09:14:14.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:14.272 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:14.272 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:14.272 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.11 2024-04-25T09:14:14.272 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:14.272 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:14.273 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:14.273 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:14.343 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.343 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.344 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146142 s, 71.8 MB/s 2024-04-25T09:14:14.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.360 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148245 s, 70.7 MB/s 2024-04-25T09:14:14.377 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.378 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.378 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158063 s, 66.3 MB/s 2024-04-25T09:14:14.395 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.395 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.395 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156021 s, 67.2 MB/s 2024-04-25T09:14:14.411 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.411 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.411 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014638 s, 71.6 MB/s 2024-04-25T09:14:14.432 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.432 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.433 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192777 s, 54.4 MB/s 2024-04-25T09:14:14.450 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.450 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.450 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157733 s, 66.5 MB/s 2024-04-25T09:14:14.466 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.466 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.466 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145087 s, 72.3 MB/s 2024-04-25T09:14:14.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.484 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.484 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161072 s, 65.1 MB/s 2024-04-25T09:14:14.505 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.505 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.505 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195353 s, 53.7 MB/s 2024-04-25T09:14:14.525 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.525 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.525 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185291 s, 56.6 MB/s 2024-04-25T09:14:14.542 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.542 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.542 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148508 s, 70.6 MB/s 2024-04-25T09:14:14.558 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.559 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.559 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149503 s, 70.1 MB/s 2024-04-25T09:14:14.577 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.578 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172285 s, 60.9 MB/s 2024-04-25T09:14:14.598 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.598 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.598 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185873 s, 56.4 MB/s 2024-04-25T09:14:14.617 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.617 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.617 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169148 s, 62.0 MB/s 2024-04-25T09:14:14.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.632 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134308 s, 78.1 MB/s 2024-04-25T09:14:14.649 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.649 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.649 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156392 s, 67.0 MB/s 2024-04-25T09:14:14.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.667 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163474 s, 64.1 MB/s 2024-04-25T09:14:14.684 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.684 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.684 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147922 s, 70.9 MB/s 2024-04-25T09:14:14.700 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.700 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.700 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142361 s, 73.7 MB/s 2024-04-25T09:14:14.717 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.717 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.717 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151339 s, 69.3 MB/s 2024-04-25T09:14:14.734 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.734 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.734 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154948 s, 67.7 MB/s 2024-04-25T09:14:14.750 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.751 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.751 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145822 s, 71.9 MB/s 2024-04-25T09:14:14.771 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.771 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.772 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189512 s, 55.3 MB/s 2024-04-25T09:14:14.788 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.788 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.789 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152155 s, 68.9 MB/s 2024-04-25T09:14:14.807 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.807 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.807 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017127 s, 61.2 MB/s 2024-04-25T09:14:14.824 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.824 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.824 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150603 s, 69.6 MB/s 2024-04-25T09:14:14.844 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.844 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.844 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175396 s, 59.8 MB/s 2024-04-25T09:14:14.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.859 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129677 s, 80.9 MB/s 2024-04-25T09:14:14.875 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.875 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.875 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145618 s, 72.0 MB/s 2024-04-25T09:14:14.892 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.892 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.892 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150869 s, 69.5 MB/s 2024-04-25T09:14:14.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:14.893 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:14.893 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:14.894 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.12 2024-04-25T09:14:14.894 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:14.894 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:14.894 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:14.894 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:14.966 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.967 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.967 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169589 s, 61.8 MB/s 2024-04-25T09:14:14.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:14.983 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:14.983 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142813 s, 73.4 MB/s 2024-04-25T09:14:15.003 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.003 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.003 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189008 s, 55.5 MB/s 2024-04-25T09:14:15.021 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.021 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.021 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164171 s, 63.9 MB/s 2024-04-25T09:14:15.039 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.039 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.039 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015986 s, 65.6 MB/s 2024-04-25T09:14:15.060 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.060 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.060 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019481 s, 53.8 MB/s 2024-04-25T09:14:15.079 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.079 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.079 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166373 s, 63.0 MB/s 2024-04-25T09:14:15.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.097 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.098 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170619 s, 61.5 MB/s 2024-04-25T09:14:15.115 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.115 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.115 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158375 s, 66.2 MB/s 2024-04-25T09:14:15.131 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.131 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.131 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143947 s, 72.8 MB/s 2024-04-25T09:14:15.148 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.148 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.148 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151171 s, 69.4 MB/s 2024-04-25T09:14:15.165 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.165 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.165 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154898 s, 67.7 MB/s 2024-04-25T09:14:15.189 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.189 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.189 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216673 s, 48.4 MB/s 2024-04-25T09:14:15.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.206 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.206 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154836 s, 67.7 MB/s 2024-04-25T09:14:15.223 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.223 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.223 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015198 s, 69.0 MB/s 2024-04-25T09:14:15.239 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.239 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.239 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142478 s, 73.6 MB/s 2024-04-25T09:14:15.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.257 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.257 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163213 s, 64.2 MB/s 2024-04-25T09:14:15.273 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.273 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.273 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145087 s, 72.3 MB/s 2024-04-25T09:14:15.289 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.289 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.289 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141262 s, 74.2 MB/s 2024-04-25T09:14:15.305 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.305 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.305 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014089 s, 74.4 MB/s 2024-04-25T09:14:15.322 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.322 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.322 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150447 s, 69.7 MB/s 2024-04-25T09:14:15.339 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.339 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.339 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152007 s, 69.0 MB/s 2024-04-25T09:14:15.358 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.358 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.358 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169488 s, 61.9 MB/s 2024-04-25T09:14:15.378 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.378 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.378 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187352 s, 56.0 MB/s 2024-04-25T09:14:15.395 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.395 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.395 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015139 s, 69.3 MB/s 2024-04-25T09:14:15.411 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.412 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.412 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145662 s, 72.0 MB/s 2024-04-25T09:14:15.429 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.429 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.429 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155718 s, 67.3 MB/s 2024-04-25T09:14:15.443 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.444 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.444 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128729 s, 81.5 MB/s 2024-04-25T09:14:15.462 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.462 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.463 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170287 s, 61.6 MB/s 2024-04-25T09:14:15.479 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.481 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.481 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146225 s, 71.7 MB/s 2024-04-25T09:14:15.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.497 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167677 s, 62.5 MB/s 2024-04-25T09:14:15.510 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.510 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.510 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109186 s, 96.0 MB/s 2024-04-25T09:14:15.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:15.512 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:15.512 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:15.512 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.13 2024-04-25T09:14:15.512 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:15.512 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:15.512 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:15.512 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:15.572 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:14:15.584 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.584 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.584 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150814 s, 69.5 MB/s 2024-04-25T09:14:15.587 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:14:15.605 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.606 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.606 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01955 s, 53.6 MB/s 2024-04-25T09:14:15.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.622 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149182 s, 70.3 MB/s 2024-04-25T09:14:15.638 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.638 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.638 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143062 s, 73.3 MB/s 2024-04-25T09:14:15.655 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.655 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.655 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151257 s, 69.3 MB/s 2024-04-25T09:14:15.677 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.677 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.678 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199796 s, 52.5 MB/s 2024-04-25T09:14:15.693 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.693 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.693 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141426 s, 74.1 MB/s 2024-04-25T09:14:15.710 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.710 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.710 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147995 s, 70.9 MB/s 2024-04-25T09:14:15.726 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.726 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.726 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014299 s, 73.3 MB/s 2024-04-25T09:14:15.744 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.745 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.745 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168612 s, 62.2 MB/s 2024-04-25T09:14:15.762 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.762 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.762 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158032 s, 66.4 MB/s 2024-04-25T09:14:15.781 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.781 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.781 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016408 s, 63.9 MB/s 2024-04-25T09:14:15.797 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.797 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.797 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145271 s, 72.2 MB/s 2024-04-25T09:14:15.812 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.812 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.812 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133752 s, 78.4 MB/s 2024-04-25T09:14:15.832 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.832 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.832 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180819 s, 58.0 MB/s 2024-04-25T09:14:15.849 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.849 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.849 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149059 s, 70.3 MB/s 2024-04-25T09:14:15.870 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.870 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.870 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189789 s, 55.2 MB/s 2024-04-25T09:14:15.888 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.888 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.888 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160009 s, 65.5 MB/s 2024-04-25T09:14:15.907 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.907 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.907 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170134 s, 61.6 MB/s 2024-04-25T09:14:15.923 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.923 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.923 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148972 s, 70.4 MB/s 2024-04-25T09:14:15.940 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.940 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.940 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152285 s, 68.9 MB/s 2024-04-25T09:14:15.959 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.960 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.960 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174827 s, 60.0 MB/s 2024-04-25T09:14:15.976 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.976 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.976 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148683 s, 70.5 MB/s 2024-04-25T09:14:15.993 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:15.993 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:15.993 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015231 s, 68.8 MB/s 2024-04-25T09:14:16.009 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.009 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.009 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140611 s, 74.6 MB/s 2024-04-25T09:14:16.028 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.028 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.028 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171427 s, 61.2 MB/s 2024-04-25T09:14:16.048 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.048 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.048 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186832 s, 56.1 MB/s 2024-04-25T09:14:16.067 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.067 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.068 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175213 s, 59.8 MB/s 2024-04-25T09:14:16.084 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.084 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.084 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144778 s, 72.4 MB/s 2024-04-25T09:14:16.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.101 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150313 s, 69.8 MB/s 2024-04-25T09:14:16.118 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.119 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.119 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164314 s, 63.8 MB/s 2024-04-25T09:14:16.135 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.135 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.135 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146359 s, 71.6 MB/s 2024-04-25T09:14:16.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:16.137 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:16.137 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:16.137 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.14 2024-04-25T09:14:16.137 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:16.137 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:16.137 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:16.137 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:16.209 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.209 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.210 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166238 s, 63.1 MB/s 2024-04-25T09:14:16.229 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.229 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.229 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179478 s, 58.4 MB/s 2024-04-25T09:14:16.243 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.243 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.243 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012296 s, 85.3 MB/s 2024-04-25T09:14:16.262 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.262 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.262 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017072 s, 61.4 MB/s 2024-04-25T09:14:16.282 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.282 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.282 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182755 s, 57.4 MB/s 2024-04-25T09:14:16.299 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.300 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.300 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156108 s, 67.2 MB/s 2024-04-25T09:14:16.316 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.316 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.316 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145286 s, 72.2 MB/s 2024-04-25T09:14:16.332 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.333 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.333 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015088 s, 69.5 MB/s 2024-04-25T09:14:16.352 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.352 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.352 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171094 s, 61.3 MB/s 2024-04-25T09:14:16.369 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.369 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.369 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158084 s, 66.3 MB/s 2024-04-25T09:14:16.387 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.387 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.388 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165781 s, 63.3 MB/s 2024-04-25T09:14:16.408 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.408 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.408 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186397 s, 56.3 MB/s 2024-04-25T09:14:16.431 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.431 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.431 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206694 s, 50.7 MB/s 2024-04-25T09:14:16.448 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.449 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.449 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163185 s, 64.3 MB/s 2024-04-25T09:14:16.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.469 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.469 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187724 s, 55.9 MB/s 2024-04-25T09:14:16.487 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.487 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.487 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158991 s, 66.0 MB/s 2024-04-25T09:14:16.502 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.503 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.503 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140935 s, 74.4 MB/s 2024-04-25T09:14:16.519 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.520 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.520 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015226 s, 68.9 MB/s 2024-04-25T09:14:16.537 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.537 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.537 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157833 s, 66.4 MB/s 2024-04-25T09:14:16.554 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.555 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.555 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156154 s, 67.2 MB/s 2024-04-25T09:14:16.572 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.572 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.572 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157307 s, 66.7 MB/s 2024-04-25T09:14:16.589 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.589 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.590 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157206 s, 66.7 MB/s 2024-04-25T09:14:16.605 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.606 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.606 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144866 s, 72.4 MB/s 2024-04-25T09:14:16.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.623 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148169 s, 70.8 MB/s 2024-04-25T09:14:16.646 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.647 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.647 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223842 s, 46.8 MB/s 2024-04-25T09:14:16.663 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.663 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.663 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143539 s, 73.1 MB/s 2024-04-25T09:14:16.682 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.682 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.682 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180057 s, 58.2 MB/s 2024-04-25T09:14:16.704 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.704 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.704 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196439 s, 53.4 MB/s 2024-04-25T09:14:16.724 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.724 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.724 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185368 s, 56.6 MB/s 2024-04-25T09:14:16.742 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.742 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.742 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158434 s, 66.2 MB/s 2024-04-25T09:14:16.761 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.761 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.761 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176615 s, 59.4 MB/s 2024-04-25T09:14:16.778 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.778 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.778 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015039 s, 69.7 MB/s 2024-04-25T09:14:16.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:16.780 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:16.780 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:16.780 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.15 2024-04-25T09:14:16.780 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:16.780 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:16.780 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:16.780 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:16.853 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.853 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.853 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149344 s, 70.2 MB/s 2024-04-25T09:14:16.870 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.870 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.870 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156322 s, 67.1 MB/s 2024-04-25T09:14:16.887 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.887 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.887 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153745 s, 68.2 MB/s 2024-04-25T09:14:16.904 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.904 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.904 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150519 s, 69.7 MB/s 2024-04-25T09:14:16.920 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.920 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.920 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143697 s, 73.0 MB/s 2024-04-25T09:14:16.937 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.937 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.937 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150306 s, 69.8 MB/s 2024-04-25T09:14:16.951 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.952 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.952 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127157 s, 82.5 MB/s 2024-04-25T09:14:16.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.969 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151185 s, 69.4 MB/s 2024-04-25T09:14:16.985 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:16.985 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:16.985 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147627 s, 71.0 MB/s 2024-04-25T09:14:17.004 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.004 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.004 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171689 s, 61.1 MB/s 2024-04-25T09:14:17.021 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.021 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.021 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149011 s, 70.4 MB/s 2024-04-25T09:14:17.037 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.038 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.038 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150085 s, 69.9 MB/s 2024-04-25T09:14:17.059 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.059 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.059 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193794 s, 54.1 MB/s 2024-04-25T09:14:17.076 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.076 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.076 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149243 s, 70.3 MB/s 2024-04-25T09:14:17.096 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.096 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.096 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018505 s, 56.7 MB/s 2024-04-25T09:14:17.118 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.118 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.118 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204072 s, 51.4 MB/s 2024-04-25T09:14:17.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.136 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.136 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161373 s, 65.0 MB/s 2024-04-25T09:14:17.152 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.152 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.152 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143274 s, 73.2 MB/s 2024-04-25T09:14:17.168 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.169 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.169 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143173 s, 73.2 MB/s 2024-04-25T09:14:17.186 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.186 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.186 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015377 s, 68.2 MB/s 2024-04-25T09:14:17.202 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.202 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.202 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014069 s, 74.5 MB/s 2024-04-25T09:14:17.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.222 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.222 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186402 s, 56.3 MB/s 2024-04-25T09:14:17.238 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.238 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.238 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145031 s, 72.3 MB/s 2024-04-25T09:14:17.255 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.255 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.255 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146157 s, 71.7 MB/s 2024-04-25T09:14:17.275 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.275 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.275 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183842 s, 57.0 MB/s 2024-04-25T09:14:17.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.294 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174097 s, 60.2 MB/s 2024-04-25T09:14:17.315 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.315 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.315 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193516 s, 54.2 MB/s 2024-04-25T09:14:17.331 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.332 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.332 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146294 s, 71.7 MB/s 2024-04-25T09:14:17.353 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.353 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.353 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192794 s, 54.4 MB/s 2024-04-25T09:14:17.369 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.369 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.369 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014312 s, 73.3 MB/s 2024-04-25T09:14:17.385 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.385 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.385 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140639 s, 74.6 MB/s 2024-04-25T09:14:17.401 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.401 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.401 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145694 s, 72.0 MB/s 2024-04-25T09:14:17.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:17.402 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:17.403 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:17.403 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.16 2024-04-25T09:14:17.403 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:17.403 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:17.403 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:17.403 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:17.471 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.471 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.471 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145069 s, 72.3 MB/s 2024-04-25T09:14:17.490 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.490 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.490 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176613 s, 59.4 MB/s 2024-04-25T09:14:17.512 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.512 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.512 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193963 s, 54.1 MB/s 2024-04-25T09:14:17.529 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.529 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.529 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015758 s, 66.5 MB/s 2024-04-25T09:14:17.553 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.553 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.553 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219938 s, 47.7 MB/s 2024-04-25T09:14:17.571 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.571 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.571 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162039 s, 64.7 MB/s 2024-04-25T09:14:17.590 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.590 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.590 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179989 s, 58.3 MB/s 2024-04-25T09:14:17.608 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.608 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.608 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161109 s, 65.1 MB/s 2024-04-25T09:14:17.630 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.630 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.630 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195121 s, 53.7 MB/s 2024-04-25T09:14:17.652 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.652 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.652 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206581 s, 50.8 MB/s 2024-04-25T09:14:17.669 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.670 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.670 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156801 s, 66.9 MB/s 2024-04-25T09:14:17.686 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.687 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.687 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015547 s, 67.4 MB/s 2024-04-25T09:14:17.705 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.705 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.705 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162825 s, 64.4 MB/s 2024-04-25T09:14:17.722 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.722 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.722 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153805 s, 68.2 MB/s 2024-04-25T09:14:17.740 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.740 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.740 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166068 s, 63.1 MB/s 2024-04-25T09:14:17.758 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.758 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.758 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162336 s, 64.6 MB/s 2024-04-25T09:14:17.775 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.775 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.776 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155907 s, 67.3 MB/s 2024-04-25T09:14:17.795 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.795 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.795 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177496 s, 59.1 MB/s 2024-04-25T09:14:17.820 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.820 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.820 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231435 s, 45.3 MB/s 2024-04-25T09:14:17.842 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.842 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.842 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202086 s, 51.9 MB/s 2024-04-25T09:14:17.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.858 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014372 s, 73.0 MB/s 2024-04-25T09:14:17.874 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.874 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.874 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142694 s, 73.5 MB/s 2024-04-25T09:14:17.893 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.893 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.893 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169028 s, 62.0 MB/s 2024-04-25T09:14:17.910 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.910 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.910 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014737 s, 71.2 MB/s 2024-04-25T09:14:17.924 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.924 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.924 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012776 s, 82.1 MB/s 2024-04-25T09:14:17.945 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.945 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.945 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193479 s, 54.2 MB/s 2024-04-25T09:14:17.962 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.962 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.963 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155438 s, 67.5 MB/s 2024-04-25T09:14:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156795 s, 66.9 MB/s 2024-04-25T09:14:17.996 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:17.996 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:17.996 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014648 s, 71.6 MB/s 2024-04-25T09:14:18.014 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.014 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.014 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156978 s, 66.8 MB/s 2024-04-25T09:14:18.030 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.030 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.030 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146151 s, 71.7 MB/s 2024-04-25T09:14:18.050 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.050 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.050 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178043 s, 58.9 MB/s 2024-04-25T09:14:18.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:18.052 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:18.052 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:18.052 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.17 2024-04-25T09:14:18.052 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:18.052 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:18.052 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:18.052 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:18.125 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.125 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.125 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016188 s, 64.8 MB/s 2024-04-25T09:14:18.143 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.143 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.143 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158994 s, 66.0 MB/s 2024-04-25T09:14:18.165 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.165 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.165 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200576 s, 52.3 MB/s 2024-04-25T09:14:18.178 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.179 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.179 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122858 s, 85.3 MB/s 2024-04-25T09:14:18.196 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.196 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.196 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157827 s, 66.4 MB/s 2024-04-25T09:14:18.212 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.212 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.212 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142531 s, 73.6 MB/s 2024-04-25T09:14:18.232 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.232 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.232 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184791 s, 56.7 MB/s 2024-04-25T09:14:18.252 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.252 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.252 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184458 s, 56.8 MB/s 2024-04-25T09:14:18.269 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.269 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.269 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149292 s, 70.2 MB/s 2024-04-25T09:14:18.289 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.289 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.289 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184383 s, 56.9 MB/s 2024-04-25T09:14:18.307 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.307 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.307 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161275 s, 65.0 MB/s 2024-04-25T09:14:18.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.323 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143421 s, 73.1 MB/s 2024-04-25T09:14:18.340 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.340 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.340 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150168 s, 69.8 MB/s 2024-04-25T09:14:18.357 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.358 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.358 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159829 s, 65.6 MB/s 2024-04-25T09:14:18.377 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.377 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.377 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182903 s, 57.3 MB/s 2024-04-25T09:14:18.394 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.395 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.395 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152867 s, 68.6 MB/s 2024-04-25T09:14:18.417 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.417 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.417 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208875 s, 50.2 MB/s 2024-04-25T09:14:18.430 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.430 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.430 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111513 s, 94.0 MB/s 2024-04-25T09:14:18.446 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.446 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.446 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136978 s, 76.6 MB/s 2024-04-25T09:14:18.462 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.462 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.462 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139635 s, 75.1 MB/s 2024-04-25T09:14:18.478 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.478 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.478 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149405 s, 70.2 MB/s 2024-04-25T09:14:18.494 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.494 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.494 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140221 s, 74.8 MB/s 2024-04-25T09:14:18.515 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.515 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.515 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187317 s, 56.0 MB/s 2024-04-25T09:14:18.533 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.533 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.534 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167052 s, 62.8 MB/s 2024-04-25T09:14:18.549 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.550 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.550 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146513 s, 71.6 MB/s 2024-04-25T09:14:18.566 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.567 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.567 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014977 s, 70.0 MB/s 2024-04-25T09:14:18.585 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.586 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.586 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017267 s, 60.7 MB/s 2024-04-25T09:14:18.602 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.602 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.602 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146185 s, 71.7 MB/s 2024-04-25T09:14:18.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.622 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.622 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183883 s, 57.0 MB/s 2024-04-25T09:14:18.640 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.640 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.641 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165839 s, 63.2 MB/s 2024-04-25T09:14:18.659 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.659 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.659 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171044 s, 61.3 MB/s 2024-04-25T09:14:18.678 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.678 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.678 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168568 s, 62.2 MB/s 2024-04-25T09:14:18.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:18.679 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:18.679 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:18.680 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.18 2024-04-25T09:14:18.680 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:18.680 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:18.680 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:18.680 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:18.752 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.752 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.752 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150851 s, 69.5 MB/s 2024-04-25T09:14:18.768 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.768 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.768 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141863 s, 73.9 MB/s 2024-04-25T09:14:18.785 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.785 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.785 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158555 s, 66.1 MB/s 2024-04-25T09:14:18.803 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.803 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.803 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155099 s, 67.6 MB/s 2024-04-25T09:14:18.823 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.823 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.823 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185053 s, 56.7 MB/s 2024-04-25T09:14:18.842 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.842 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.842 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168368 s, 62.3 MB/s 2024-04-25T09:14:18.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.858 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.858 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146383 s, 71.6 MB/s 2024-04-25T09:14:18.879 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.879 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.879 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194112 s, 54.0 MB/s 2024-04-25T09:14:18.896 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.896 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.896 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147944 s, 70.9 MB/s 2024-04-25T09:14:18.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.914 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162675 s, 64.5 MB/s 2024-04-25T09:14:18.932 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.932 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.932 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162103 s, 64.7 MB/s 2024-04-25T09:14:18.948 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.948 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.948 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146313 s, 71.7 MB/s 2024-04-25T09:14:18.965 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.965 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.965 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148857 s, 70.4 MB/s 2024-04-25T09:14:18.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:18.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:18.982 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151068 s, 69.4 MB/s 2024-04-25T09:14:19.000 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.001 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.001 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167482 s, 62.6 MB/s 2024-04-25T09:14:19.019 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.019 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.019 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169568 s, 61.8 MB/s 2024-04-25T09:14:19.035 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.035 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.036 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145743 s, 71.9 MB/s 2024-04-25T09:14:19.052 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.052 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.052 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014625 s, 71.7 MB/s 2024-04-25T09:14:19.071 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.071 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.071 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178194 s, 58.8 MB/s 2024-04-25T09:14:19.090 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.090 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.091 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171166 s, 61.3 MB/s 2024-04-25T09:14:19.104 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.104 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.104 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115158 s, 91.1 MB/s 2024-04-25T09:14:19.119 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.120 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.120 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140479 s, 74.6 MB/s 2024-04-25T09:14:19.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.140 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186586 s, 56.2 MB/s 2024-04-25T09:14:19.161 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.161 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.161 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195704 s, 53.6 MB/s 2024-04-25T09:14:19.179 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.179 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.180 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016608 s, 63.1 MB/s 2024-04-25T09:14:19.196 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.196 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.196 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146398 s, 71.6 MB/s 2024-04-25T09:14:19.212 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.212 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.212 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138858 s, 75.5 MB/s 2024-04-25T09:14:19.234 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.234 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.234 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020297 s, 51.7 MB/s 2024-04-25T09:14:19.250 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.250 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.250 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01455 s, 72.1 MB/s 2024-04-25T09:14:19.268 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.268 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.268 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159271 s, 65.8 MB/s 2024-04-25T09:14:19.287 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.287 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.287 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169018 s, 62.0 MB/s 2024-04-25T09:14:19.310 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.310 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.310 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021335 s, 49.1 MB/s 2024-04-25T09:14:19.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:19.311 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:19.311 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:19.311 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.19 2024-04-25T09:14:19.312 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:19.312 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:19.312 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:19.312 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:19.391 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.391 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.391 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226415 s, 46.3 MB/s 2024-04-25T09:14:19.409 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.409 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.409 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158183 s, 66.3 MB/s 2024-04-25T09:14:19.425 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.425 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.425 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146349 s, 71.6 MB/s 2024-04-25T09:14:19.446 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.446 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.446 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019147 s, 54.8 MB/s 2024-04-25T09:14:19.464 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.464 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.464 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162666 s, 64.5 MB/s 2024-04-25T09:14:19.480 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.480 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.480 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139305 s, 75.3 MB/s 2024-04-25T09:14:19.498 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.498 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.498 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016066 s, 65.3 MB/s 2024-04-25T09:14:19.514 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.514 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.514 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143133 s, 73.3 MB/s 2024-04-25T09:14:19.533 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.533 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.533 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171069 s, 61.3 MB/s 2024-04-25T09:14:19.551 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.551 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.551 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159677 s, 65.7 MB/s 2024-04-25T09:14:19.566 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.566 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.567 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141923 s, 73.9 MB/s 2024-04-25T09:14:19.585 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.585 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.585 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168691 s, 62.2 MB/s 2024-04-25T09:14:19.610 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.610 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.610 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023358 s, 44.9 MB/s 2024-04-25T09:14:19.631 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.632 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.632 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194608 s, 53.9 MB/s 2024-04-25T09:14:19.648 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.648 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.648 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148717 s, 70.5 MB/s 2024-04-25T09:14:19.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.667 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173872 s, 60.3 MB/s 2024-04-25T09:14:19.688 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.688 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.688 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018718 s, 56.0 MB/s 2024-04-25T09:14:19.704 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.704 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.704 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149117 s, 70.3 MB/s 2024-04-25T09:14:19.722 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.723 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.723 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162595 s, 64.5 MB/s 2024-04-25T09:14:19.739 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.740 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.740 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150809 s, 69.5 MB/s 2024-04-25T09:14:19.761 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.761 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.761 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196423 s, 53.4 MB/s 2024-04-25T09:14:19.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.777 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.778 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145803 s, 71.9 MB/s 2024-04-25T09:14:19.796 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.796 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.796 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016826 s, 62.3 MB/s 2024-04-25T09:14:19.818 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.818 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.818 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195879 s, 53.5 MB/s 2024-04-25T09:14:19.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.837 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.837 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173445 s, 60.5 MB/s 2024-04-25T09:14:19.854 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.854 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.854 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153743 s, 68.2 MB/s 2024-04-25T09:14:19.875 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.876 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.876 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195486 s, 53.6 MB/s 2024-04-25T09:14:19.893 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.893 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.893 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159648 s, 65.7 MB/s 2024-04-25T09:14:19.910 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.910 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.910 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147781 s, 71.0 MB/s 2024-04-25T09:14:19.935 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.935 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.935 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231107 s, 45.4 MB/s 2024-04-25T09:14:19.951 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.951 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.951 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014204 s, 73.8 MB/s 2024-04-25T09:14:19.965 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:19.966 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:19.966 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129435 s, 81.0 MB/s 2024-04-25T09:14:19.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:19.967 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:19.967 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:19.967 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.20 2024-04-25T09:14:19.967 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:19.967 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:19.967 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:19.967 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:20.044 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.045 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.045 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148682 s, 70.5 MB/s 2024-04-25T09:14:20.062 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.062 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.062 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156562 s, 67.0 MB/s 2024-04-25T09:14:20.083 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.083 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.084 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195454 s, 53.6 MB/s 2024-04-25T09:14:20.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.101 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152512 s, 68.8 MB/s 2024-04-25T09:14:20.119 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.119 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.119 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016767 s, 62.5 MB/s 2024-04-25T09:14:20.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.140 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.140 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018846 s, 55.6 MB/s 2024-04-25T09:14:20.158 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.159 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.159 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169422 s, 61.9 MB/s 2024-04-25T09:14:20.180 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.180 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.180 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196172 s, 53.5 MB/s 2024-04-25T09:14:20.197 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.197 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.197 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149993 s, 69.9 MB/s 2024-04-25T09:14:20.213 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.213 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.213 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144032 s, 72.8 MB/s 2024-04-25T09:14:20.229 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.229 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.229 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143519 s, 73.1 MB/s 2024-04-25T09:14:20.250 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.250 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.250 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188923 s, 55.5 MB/s 2024-04-25T09:14:20.267 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.267 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.267 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156869 s, 66.8 MB/s 2024-04-25T09:14:20.288 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.288 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.288 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191303 s, 54.8 MB/s 2024-04-25T09:14:20.305 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.305 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.305 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145795 s, 71.9 MB/s 2024-04-25T09:14:20.328 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.328 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.328 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214685 s, 48.8 MB/s 2024-04-25T09:14:20.345 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.345 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.345 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149854 s, 70.0 MB/s 2024-04-25T09:14:20.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.361 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.361 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141457 s, 74.1 MB/s 2024-04-25T09:14:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.378 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157353 s, 66.6 MB/s 2024-04-25T09:14:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.399 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186745 s, 56.2 MB/s 2024-04-25T09:14:20.415 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.415 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.415 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149935 s, 69.9 MB/s 2024-04-25T09:14:20.436 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.436 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.436 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186856 s, 56.1 MB/s 2024-04-25T09:14:20.452 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.452 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.452 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142869 s, 73.4 MB/s 2024-04-25T09:14:20.473 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.473 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.473 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190435 s, 55.1 MB/s 2024-04-25T09:14:20.489 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.489 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.489 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146228 s, 71.7 MB/s 2024-04-25T09:14:20.509 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.509 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.509 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180585 s, 58.1 MB/s 2024-04-25T09:14:20.526 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.526 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.526 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149457 s, 70.2 MB/s 2024-04-25T09:14:20.546 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.546 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.547 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186457 s, 56.2 MB/s 2024-04-25T09:14:20.563 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.563 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.563 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149399 s, 70.2 MB/s 2024-04-25T09:14:20.579 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.579 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.580 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144643 s, 72.5 MB/s 2024-04-25T09:14:20.597 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.597 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.597 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161283 s, 65.0 MB/s 2024-04-25T09:14:20.614 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.614 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.614 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148205 s, 70.8 MB/s 2024-04-25T09:14:20.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:20.616 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:20.616 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:20.616 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.21 2024-04-25T09:14:20.616 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:20.616 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:20.616 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:20.616 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:20.686 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.686 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.686 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133024 s, 78.8 MB/s 2024-04-25T09:14:20.703 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.703 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.704 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155001 s, 67.6 MB/s 2024-04-25T09:14:20.724 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.724 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.724 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191398 s, 54.8 MB/s 2024-04-25T09:14:20.742 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.742 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.743 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163242 s, 64.2 MB/s 2024-04-25T09:14:20.761 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.762 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.762 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174369 s, 60.1 MB/s 2024-04-25T09:14:20.778 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.778 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.778 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147779 s, 71.0 MB/s 2024-04-25T09:14:20.795 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.795 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.795 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149002 s, 70.4 MB/s 2024-04-25T09:14:20.815 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.815 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.815 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180573 s, 58.1 MB/s 2024-04-25T09:14:20.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.839 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021123 s, 49.6 MB/s 2024-04-25T09:14:20.857 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.857 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.858 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170459 s, 61.5 MB/s 2024-04-25T09:14:20.874 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.875 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.875 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151675 s, 69.1 MB/s 2024-04-25T09:14:20.893 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.893 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.893 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159911 s, 65.6 MB/s 2024-04-25T09:14:20.909 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.909 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.909 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147452 s, 71.1 MB/s 2024-04-25T09:14:20.925 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.925 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.925 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014485 s, 72.4 MB/s 2024-04-25T09:14:20.940 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.940 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.940 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130255 s, 80.5 MB/s 2024-04-25T09:14:20.959 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.959 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.959 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171164 s, 61.3 MB/s 2024-04-25T09:14:20.973 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.973 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.973 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127608 s, 82.2 MB/s 2024-04-25T09:14:20.990 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:20.990 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:20.990 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149389 s, 70.2 MB/s 2024-04-25T09:14:21.006 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.006 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.006 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143308 s, 73.2 MB/s 2024-04-25T09:14:21.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.022 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143782 s, 72.9 MB/s 2024-04-25T09:14:21.047 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.047 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.047 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224053 s, 46.8 MB/s 2024-04-25T09:14:21.064 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.064 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.064 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015445 s, 67.9 MB/s 2024-04-25T09:14:21.080 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.080 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.080 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148586 s, 70.6 MB/s 2024-04-25T09:14:21.099 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.099 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.099 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016553 s, 63.3 MB/s 2024-04-25T09:14:21.116 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.116 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.116 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152977 s, 68.5 MB/s 2024-04-25T09:14:21.134 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.134 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.134 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163318 s, 64.2 MB/s 2024-04-25T09:14:21.154 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.154 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.154 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184038 s, 57.0 MB/s 2024-04-25T09:14:21.174 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.174 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.174 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185449 s, 56.5 MB/s 2024-04-25T09:14:21.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.192 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.192 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156734 s, 66.9 MB/s 2024-04-25T09:14:21.212 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.212 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.212 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189166 s, 55.4 MB/s 2024-04-25T09:14:21.228 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.229 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.229 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146994 s, 71.3 MB/s 2024-04-25T09:14:21.246 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.247 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.247 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162388 s, 64.6 MB/s 2024-04-25T09:14:21.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:21.248 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:21.248 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:21.248 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.22 2024-04-25T09:14:21.248 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:21.248 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:21.248 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:21.248 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:21.326 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.326 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.327 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176464 s, 59.4 MB/s 2024-04-25T09:14:21.342 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.342 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.342 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142607 s, 73.5 MB/s 2024-04-25T09:14:21.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.360 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161231 s, 65.0 MB/s 2024-04-25T09:14:21.376 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.376 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.377 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142603 s, 73.5 MB/s 2024-04-25T09:14:21.397 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.397 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.397 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191343 s, 54.8 MB/s 2024-04-25T09:14:21.414 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.414 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.414 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147443 s, 71.1 MB/s 2024-04-25T09:14:21.430 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.431 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.431 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149181 s, 70.3 MB/s 2024-04-25T09:14:21.446 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.447 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.447 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141462 s, 74.1 MB/s 2024-04-25T09:14:21.468 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.468 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.468 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198764 s, 52.8 MB/s 2024-04-25T09:14:21.492 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.492 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.492 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218125 s, 48.1 MB/s 2024-04-25T09:14:21.508 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.508 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.508 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148127 s, 70.8 MB/s 2024-04-25T09:14:21.527 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.527 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.527 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170015 s, 61.7 MB/s 2024-04-25T09:14:21.547 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.547 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.547 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184281 s, 56.9 MB/s 2024-04-25T09:14:21.568 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.568 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.568 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189359 s, 55.4 MB/s 2024-04-25T09:14:21.584 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.585 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.585 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149265 s, 70.2 MB/s 2024-04-25T09:14:21.601 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.601 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.601 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148515 s, 70.6 MB/s 2024-04-25T09:14:21.619 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.619 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.619 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163649 s, 64.1 MB/s 2024-04-25T09:14:21.640 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.640 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.640 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186239 s, 56.3 MB/s 2024-04-25T09:14:21.658 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.658 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.658 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162994 s, 64.3 MB/s 2024-04-25T09:14:21.679 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.679 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.679 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197593 s, 53.1 MB/s 2024-04-25T09:14:21.696 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.697 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.697 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153005 s, 68.5 MB/s 2024-04-25T09:14:21.713 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.713 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.713 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149548 s, 70.1 MB/s 2024-04-25T09:14:21.734 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.735 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.735 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195092 s, 53.7 MB/s 2024-04-25T09:14:21.752 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.752 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.752 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153373 s, 68.4 MB/s 2024-04-25T09:14:21.770 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.771 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.771 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169641 s, 61.8 MB/s 2024-04-25T09:14:21.788 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.788 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.788 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153603 s, 68.3 MB/s 2024-04-25T09:14:21.807 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.807 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.807 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176132 s, 59.5 MB/s 2024-04-25T09:14:21.827 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.829 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.829 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184052 s, 57.0 MB/s 2024-04-25T09:14:21.843 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.844 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.844 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146981 s, 71.3 MB/s 2024-04-25T09:14:21.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.865 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191993 s, 54.6 MB/s 2024-04-25T09:14:21.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.882 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.882 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155018 s, 67.6 MB/s 2024-04-25T09:14:21.903 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.903 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.903 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192728 s, 54.4 MB/s 2024-04-25T09:14:21.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:21.904 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:21.905 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:21.905 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.23 2024-04-25T09:14:21.905 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:21.905 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:21.905 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:21.905 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:21.984 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:21.985 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:21.985 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196667 s, 53.3 MB/s 2024-04-25T09:14:22.003 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.003 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.003 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016538 s, 63.4 MB/s 2024-04-25T09:14:22.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.022 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.022 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173069 s, 60.6 MB/s 2024-04-25T09:14:22.037 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.037 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.038 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141082 s, 74.3 MB/s 2024-04-25T09:14:22.058 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.058 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.058 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187372 s, 56.0 MB/s 2024-04-25T09:14:22.074 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.074 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.075 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146662 s, 71.5 MB/s 2024-04-25T09:14:22.092 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.092 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.092 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156812 s, 66.9 MB/s 2024-04-25T09:14:22.114 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.114 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.115 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207237 s, 50.6 MB/s 2024-04-25T09:14:22.134 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.134 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.134 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176303 s, 59.5 MB/s 2024-04-25T09:14:22.154 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.154 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.154 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184488 s, 56.8 MB/s 2024-04-25T09:14:22.170 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.170 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.170 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144212 s, 72.7 MB/s 2024-04-25T09:14:22.189 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.189 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.189 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166068 s, 63.1 MB/s 2024-04-25T09:14:22.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.205 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.205 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144509 s, 72.6 MB/s 2024-04-25T09:14:22.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.224 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169766 s, 61.8 MB/s 2024-04-25T09:14:22.242 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.242 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.242 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016715 s, 62.7 MB/s 2024-04-25T09:14:22.256 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.256 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.256 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120953 s, 86.7 MB/s 2024-04-25T09:14:22.273 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.273 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.273 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01492 s, 70.3 MB/s 2024-04-25T09:14:22.292 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.293 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.293 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177944 s, 58.9 MB/s 2024-04-25T09:14:22.309 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.309 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.309 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150807 s, 69.5 MB/s 2024-04-25T09:14:22.325 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.326 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.326 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144113 s, 72.8 MB/s 2024-04-25T09:14:22.342 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.342 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.342 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148002 s, 70.8 MB/s 2024-04-25T09:14:22.358 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.358 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.358 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142164 s, 73.8 MB/s 2024-04-25T09:14:22.376 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.376 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.376 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160133 s, 65.5 MB/s 2024-04-25T09:14:22.395 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.395 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.395 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173144 s, 60.6 MB/s 2024-04-25T09:14:22.413 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.413 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.413 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162359 s, 64.6 MB/s 2024-04-25T09:14:22.430 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.430 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.430 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152958 s, 68.6 MB/s 2024-04-25T09:14:22.449 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.449 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.449 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171095 s, 61.3 MB/s 2024-04-25T09:14:22.466 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.466 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.466 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014861 s, 70.6 MB/s 2024-04-25T09:14:22.482 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.482 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.482 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142723 s, 73.5 MB/s 2024-04-25T09:14:22.499 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.499 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.499 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151528 s, 69.2 MB/s 2024-04-25T09:14:22.515 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.516 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.516 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148105 s, 70.8 MB/s 2024-04-25T09:14:22.534 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.534 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.534 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164913 s, 63.6 MB/s 2024-04-25T09:14:22.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:22.535 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:22.535 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:22.535 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.24 2024-04-25T09:14:22.535 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:22.535 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:22.536 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:22.536 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:22.612 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.612 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.612 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149004 s, 70.4 MB/s 2024-04-25T09:14:22.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.628 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.628 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141549 s, 74.1 MB/s 2024-04-25T09:14:22.649 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.649 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.649 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190201 s, 55.1 MB/s 2024-04-25T09:14:22.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.667 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162486 s, 64.5 MB/s 2024-04-25T09:14:22.683 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.683 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.683 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145102 s, 72.3 MB/s 2024-04-25T09:14:22.702 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.702 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.702 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171331 s, 61.2 MB/s 2024-04-25T09:14:22.720 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.721 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.721 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166729 s, 62.9 MB/s 2024-04-25T09:14:22.740 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.740 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.740 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177785 s, 59.0 MB/s 2024-04-25T09:14:22.753 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.753 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.753 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115033 s, 91.2 MB/s 2024-04-25T09:14:22.770 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.771 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.771 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153619 s, 68.3 MB/s 2024-04-25T09:14:22.788 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.788 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.788 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162118 s, 64.7 MB/s 2024-04-25T09:14:22.806 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.806 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.806 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158741 s, 66.1 MB/s 2024-04-25T09:14:22.822 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.822 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.822 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145148 s, 72.2 MB/s 2024-04-25T09:14:22.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.839 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143401 s, 73.1 MB/s 2024-04-25T09:14:22.857 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.857 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.857 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166734 s, 62.9 MB/s 2024-04-25T09:14:22.878 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.878 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.878 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193444 s, 54.2 MB/s 2024-04-25T09:14:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.892 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125762 s, 83.4 MB/s 2024-04-25T09:14:22.910 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.910 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.910 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160073 s, 65.5 MB/s 2024-04-25T09:14:22.930 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.930 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.930 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017941 s, 58.4 MB/s 2024-04-25T09:14:22.949 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.949 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.949 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168947 s, 62.1 MB/s 2024-04-25T09:14:22.966 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.967 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.967 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160759 s, 65.2 MB/s 2024-04-25T09:14:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173534 s, 60.4 MB/s 2024-04-25T09:14:23.005 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.005 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.005 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173743 s, 60.4 MB/s 2024-04-25T09:14:23.023 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.023 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.023 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167983 s, 62.4 MB/s 2024-04-25T09:14:23.040 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.040 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.040 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147726 s, 71.0 MB/s 2024-04-25T09:14:23.056 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.056 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.056 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145397 s, 72.1 MB/s 2024-04-25T09:14:23.073 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.073 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.073 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014669 s, 71.5 MB/s 2024-04-25T09:14:23.090 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.090 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.090 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157738 s, 66.5 MB/s 2024-04-25T09:14:23.111 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.111 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.111 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018613 s, 56.3 MB/s 2024-04-25T09:14:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154201 s, 68.0 MB/s 2024-04-25T09:14:23.145 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.145 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.146 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015963 s, 65.7 MB/s 2024-04-25T09:14:23.165 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.165 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.165 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181374 s, 57.8 MB/s 2024-04-25T09:14:23.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:23.167 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:23.167 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:23.167 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.25 2024-04-25T09:14:23.167 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:23.167 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:23.167 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:23.167 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:23.243 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.244 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.244 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180888 s, 58.0 MB/s 2024-04-25T09:14:23.267 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.267 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.267 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214789 s, 48.8 MB/s 2024-04-25T09:14:23.288 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.288 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.288 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193627 s, 54.2 MB/s 2024-04-25T09:14:23.306 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.306 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.306 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163748 s, 64.0 MB/s 2024-04-25T09:14:23.324 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.324 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.324 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158751 s, 66.1 MB/s 2024-04-25T09:14:23.346 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.347 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.347 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210341 s, 49.9 MB/s 2024-04-25T09:14:23.364 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.364 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.364 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159175 s, 65.9 MB/s 2024-04-25T09:14:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190638 s, 55.0 MB/s 2024-04-25T09:14:23.409 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.409 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.409 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223001 s, 47.0 MB/s 2024-04-25T09:14:23.426 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.426 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.426 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150998 s, 69.4 MB/s 2024-04-25T09:14:23.442 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.442 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.442 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144808 s, 72.4 MB/s 2024-04-25T09:14:23.461 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.461 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.461 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166858 s, 62.8 MB/s 2024-04-25T09:14:23.477 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.477 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.477 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144058 s, 72.8 MB/s 2024-04-25T09:14:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.493 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146209 s, 71.7 MB/s 2024-04-25T09:14:23.511 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.511 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.511 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161088 s, 65.1 MB/s 2024-04-25T09:14:23.528 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.528 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.529 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156049 s, 67.2 MB/s 2024-04-25T09:14:23.547 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.547 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.547 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016797 s, 62.4 MB/s 2024-04-25T09:14:23.564 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.564 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.564 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153444 s, 68.3 MB/s 2024-04-25T09:14:23.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.579 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124886 s, 84.0 MB/s 2024-04-25T09:14:23.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.592 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115963 s, 90.4 MB/s 2024-04-25T09:14:23.609 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.609 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.609 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151565 s, 69.2 MB/s 2024-04-25T09:14:23.633 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.633 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.633 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223652 s, 46.9 MB/s 2024-04-25T09:14:23.650 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.650 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.650 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151453 s, 69.2 MB/s 2024-04-25T09:14:23.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.667 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.667 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149588 s, 70.1 MB/s 2024-04-25T09:14:23.683 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.683 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.683 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145315 s, 72.2 MB/s 2024-04-25T09:14:23.700 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.700 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.700 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154111 s, 68.0 MB/s 2024-04-25T09:14:23.719 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.719 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.719 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168364 s, 62.3 MB/s 2024-04-25T09:14:23.735 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.735 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.735 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147142 s, 71.3 MB/s 2024-04-25T09:14:23.752 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.752 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.752 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149231 s, 70.3 MB/s 2024-04-25T09:14:23.771 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.771 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.771 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173248 s, 60.5 MB/s 2024-04-25T09:14:23.791 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.791 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.792 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018392 s, 57.0 MB/s 2024-04-25T09:14:23.809 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.809 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.809 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154523 s, 67.9 MB/s 2024-04-25T09:14:23.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:23.811 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:23.811 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:23.811 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.26 2024-04-25T09:14:23.811 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:23.811 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:23.811 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:23.811 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:23.885 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.885 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.885 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160679 s, 65.3 MB/s 2024-04-25T09:14:23.902 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.902 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.902 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149629 s, 70.1 MB/s 2024-04-25T09:14:23.918 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.918 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.918 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139759 s, 75.0 MB/s 2024-04-25T09:14:23.938 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.938 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.938 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181864 s, 57.7 MB/s 2024-04-25T09:14:23.955 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.955 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.955 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150134 s, 69.8 MB/s 2024-04-25T09:14:23.971 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.971 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.971 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146973 s, 71.3 MB/s 2024-04-25T09:14:23.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:23.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:23.987 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143751 s, 72.9 MB/s 2024-04-25T09:14:24.006 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.006 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.006 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168395 s, 62.3 MB/s 2024-04-25T09:14:24.026 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.026 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.026 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179864 s, 58.3 MB/s 2024-04-25T09:14:24.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.042 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.042 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144552 s, 72.5 MB/s 2024-04-25T09:14:24.063 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.063 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.063 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194107 s, 54.0 MB/s 2024-04-25T09:14:24.079 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.079 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.079 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141475 s, 74.1 MB/s 2024-04-25T09:14:24.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.100 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.100 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187538 s, 55.9 MB/s 2024-04-25T09:14:24.119 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.119 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.119 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173142 s, 60.6 MB/s 2024-04-25T09:14:24.139 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.139 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.139 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188244 s, 55.7 MB/s 2024-04-25T09:14:24.156 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.156 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.156 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148722 s, 70.5 MB/s 2024-04-25T09:14:24.174 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.174 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.174 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016298 s, 64.3 MB/s 2024-04-25T09:14:24.191 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.191 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.191 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155362 s, 67.5 MB/s 2024-04-25T09:14:24.207 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.208 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.208 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014514 s, 72.2 MB/s 2024-04-25T09:14:24.221 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.221 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.222 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120075 s, 87.3 MB/s 2024-04-25T09:14:24.241 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.242 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.242 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182402 s, 57.5 MB/s 2024-04-25T09:14:24.259 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.259 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.259 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162764 s, 64.4 MB/s 2024-04-25T09:14:24.277 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.277 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.277 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159441 s, 65.8 MB/s 2024-04-25T09:14:24.293 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.294 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148871 s, 70.4 MB/s 2024-04-25T09:14:24.314 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.314 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.314 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183545 s, 57.1 MB/s 2024-04-25T09:14:24.330 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.330 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.330 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146875 s, 71.4 MB/s 2024-04-25T09:14:24.346 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.346 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.347 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144991 s, 72.3 MB/s 2024-04-25T09:14:24.362 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.362 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.362 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138838 s, 75.5 MB/s 2024-04-25T09:14:24.383 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.383 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.383 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193636 s, 54.2 MB/s 2024-04-25T09:14:24.402 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.402 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.402 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166674 s, 62.9 MB/s 2024-04-25T09:14:24.422 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.422 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.422 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018594 s, 56.4 MB/s 2024-04-25T09:14:24.438 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.438 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.438 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144437 s, 72.6 MB/s 2024-04-25T09:14:24.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:24.440 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:24.440 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:24.440 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.27 2024-04-25T09:14:24.440 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:24.440 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:24.440 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:24.440 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:24.515 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.515 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.516 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014508 s, 72.3 MB/s 2024-04-25T09:14:24.540 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.541 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.541 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230361 s, 45.5 MB/s 2024-04-25T09:14:24.562 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.562 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.562 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200016 s, 52.4 MB/s 2024-04-25T09:14:24.581 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.581 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.581 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175718 s, 59.7 MB/s 2024-04-25T09:14:24.602 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.602 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.602 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191207 s, 54.8 MB/s 2024-04-25T09:14:24.618 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.618 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.618 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144825 s, 72.4 MB/s 2024-04-25T09:14:24.635 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.635 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.635 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148366 s, 70.7 MB/s 2024-04-25T09:14:24.656 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.656 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.656 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198371 s, 52.9 MB/s 2024-04-25T09:14:24.678 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.678 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.678 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198562 s, 52.8 MB/s 2024-04-25T09:14:24.699 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.699 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.699 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189407 s, 55.4 MB/s 2024-04-25T09:14:24.716 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.716 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.716 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152695 s, 68.7 MB/s 2024-04-25T09:14:24.733 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.733 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.733 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149901 s, 70.0 MB/s 2024-04-25T09:14:24.749 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.749 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.749 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144403 s, 72.6 MB/s 2024-04-25T09:14:24.765 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.766 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.766 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148692 s, 70.5 MB/s 2024-04-25T09:14:24.786 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.786 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.786 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185312 s, 56.6 MB/s 2024-04-25T09:14:24.804 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.805 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.805 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166744 s, 62.9 MB/s 2024-04-25T09:14:24.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.821 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.821 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147343 s, 71.2 MB/s 2024-04-25T09:14:24.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.838 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.838 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150294 s, 69.8 MB/s 2024-04-25T09:14:24.854 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.854 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.855 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146852 s, 71.4 MB/s 2024-04-25T09:14:24.872 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.872 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.872 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158534 s, 66.1 MB/s 2024-04-25T09:14:24.894 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.894 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.894 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199969 s, 52.4 MB/s 2024-04-25T09:14:24.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.914 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.914 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184402 s, 56.9 MB/s 2024-04-25T09:14:24.933 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.933 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.933 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166715 s, 62.9 MB/s 2024-04-25T09:14:24.946 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.946 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.946 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117712 s, 89.1 MB/s 2024-04-25T09:14:24.964 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.964 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.964 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162693 s, 64.5 MB/s 2024-04-25T09:14:24.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.982 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163375 s, 64.2 MB/s 2024-04-25T09:14:24.998 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:24.999 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:24.999 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145982 s, 71.8 MB/s 2024-04-25T09:14:25.020 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.020 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.020 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019762 s, 53.1 MB/s 2024-04-25T09:14:25.036 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.036 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.036 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143168 s, 73.2 MB/s 2024-04-25T09:14:25.054 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.054 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.054 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164259 s, 63.8 MB/s 2024-04-25T09:14:25.070 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.070 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.070 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144707 s, 72.5 MB/s 2024-04-25T09:14:25.091 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.091 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.091 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190658 s, 55.0 MB/s 2024-04-25T09:14:25.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:25.093 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:25.093 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:25.093 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.28 2024-04-25T09:14:25.093 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:25.093 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:25.093 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:25.093 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:25.164 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.164 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.164 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157742 s, 66.5 MB/s 2024-04-25T09:14:25.182 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.182 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.182 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159701 s, 65.7 MB/s 2024-04-25T09:14:25.198 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.198 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.199 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015065 s, 69.6 MB/s 2024-04-25T09:14:25.214 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142834 s, 73.4 MB/s 2024-04-25T09:14:25.233 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.233 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.234 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170743 s, 61.4 MB/s 2024-04-25T09:14:25.247 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.247 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.247 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119942 s, 87.4 MB/s 2024-04-25T09:14:25.268 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.268 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.268 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019052 s, 55.0 MB/s 2024-04-25T09:14:25.285 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.285 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.285 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150122 s, 69.8 MB/s 2024-04-25T09:14:25.302 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.302 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.302 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157774 s, 66.5 MB/s 2024-04-25T09:14:25.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.323 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.323 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186655 s, 56.2 MB/s 2024-04-25T09:14:25.340 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.340 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.340 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153324 s, 68.4 MB/s 2024-04-25T09:14:25.359 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.360 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.360 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179455 s, 58.4 MB/s 2024-04-25T09:14:25.377 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.377 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.378 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159425 s, 65.8 MB/s 2024-04-25T09:14:25.398 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.398 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.398 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189065 s, 55.5 MB/s 2024-04-25T09:14:25.416 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.416 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.416 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160326 s, 65.4 MB/s 2024-04-25T09:14:25.432 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.432 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.432 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147021 s, 71.3 MB/s 2024-04-25T09:14:25.449 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.449 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.449 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152875 s, 68.6 MB/s 2024-04-25T09:14:25.465 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.465 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.465 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142667 s, 73.5 MB/s 2024-04-25T09:14:25.482 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.482 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.482 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149639 s, 70.1 MB/s 2024-04-25T09:14:25.500 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.500 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.500 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166927 s, 62.8 MB/s 2024-04-25T09:14:25.516 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.517 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.517 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01448 s, 72.4 MB/s 2024-04-25T09:14:25.537 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.537 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.537 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183848 s, 57.0 MB/s 2024-04-25T09:14:25.558 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.558 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.558 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199271 s, 52.6 MB/s 2024-04-25T09:14:25.572 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.572 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.572 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121311 s, 86.4 MB/s 2024-04-25T09:14:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151489 s, 69.2 MB/s 2024-04-25T09:14:25.606 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.606 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.606 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148613 s, 70.6 MB/s 2024-04-25T09:14:25.627 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.627 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.627 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193722 s, 54.1 MB/s 2024-04-25T09:14:25.647 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.647 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.647 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183506 s, 57.1 MB/s 2024-04-25T09:14:25.664 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.665 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152257 s, 68.9 MB/s 2024-04-25T09:14:25.681 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.682 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.682 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153722 s, 68.2 MB/s 2024-04-25T09:14:25.701 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.702 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.702 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182299 s, 57.5 MB/s 2024-04-25T09:14:25.720 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.720 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.720 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165923 s, 63.2 MB/s 2024-04-25T09:14:25.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:25.721 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:25.721 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:25.722 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.29 2024-04-25T09:14:25.722 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:25.722 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:25.722 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:25.722 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:25.790 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.790 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.790 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012491 s, 83.9 MB/s 2024-04-25T09:14:25.808 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.808 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.808 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160666 s, 65.3 MB/s 2024-04-25T09:14:25.827 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.827 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.827 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170986 s, 61.3 MB/s 2024-04-25T09:14:25.848 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.848 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.848 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019008 s, 55.2 MB/s 2024-04-25T09:14:25.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.865 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.865 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157475 s, 66.6 MB/s 2024-04-25T09:14:25.890 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.890 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.891 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229085 s, 45.8 MB/s 2024-04-25T09:14:25.910 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.911 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.911 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178631 s, 58.7 MB/s 2024-04-25T09:14:25.933 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.933 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.933 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203897 s, 51.4 MB/s 2024-04-25T09:14:25.950 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.950 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.950 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158124 s, 66.3 MB/s 2024-04-25T09:14:25.970 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.970 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.970 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179156 s, 58.5 MB/s 2024-04-25T09:14:25.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:25.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:25.987 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150386 s, 69.7 MB/s 2024-04-25T09:14:26.008 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.008 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.008 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019455 s, 53.9 MB/s 2024-04-25T09:14:26.027 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.027 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.027 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172835 s, 60.7 MB/s 2024-04-25T09:14:26.048 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.048 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.048 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188711 s, 55.6 MB/s 2024-04-25T09:14:26.068 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.068 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.068 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183959 s, 57.0 MB/s 2024-04-25T09:14:26.087 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.087 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.087 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173985 s, 60.3 MB/s 2024-04-25T09:14:26.106 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.106 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.106 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172762 s, 60.7 MB/s 2024-04-25T09:14:26.124 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.124 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.124 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158253 s, 66.3 MB/s 2024-04-25T09:14:26.141 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.141 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.141 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154048 s, 68.1 MB/s 2024-04-25T09:14:26.158 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.158 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.158 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152378 s, 68.8 MB/s 2024-04-25T09:14:26.175 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.175 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.175 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149491 s, 70.1 MB/s 2024-04-25T09:14:26.191 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.191 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.191 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147785 s, 71.0 MB/s 2024-04-25T09:14:26.210 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.210 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.210 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169562 s, 61.8 MB/s 2024-04-25T09:14:26.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.224 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.224 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121152 s, 86.6 MB/s 2024-04-25T09:14:26.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.240 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.240 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143192 s, 73.2 MB/s 2024-04-25T09:14:26.258 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.258 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.258 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158487 s, 66.2 MB/s 2024-04-25T09:14:26.278 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.278 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.278 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182346 s, 57.5 MB/s 2024-04-25T09:14:26.294 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.295 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.295 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148806 s, 70.5 MB/s 2024-04-25T09:14:26.311 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.311 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.311 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146228 s, 71.7 MB/s 2024-04-25T09:14:26.332 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.332 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.332 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194709 s, 53.9 MB/s 2024-04-25T09:14:26.354 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.354 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.354 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199029 s, 52.7 MB/s 2024-04-25T09:14:26.370 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.370 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.370 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014366 s, 73.0 MB/s 2024-04-25T09:14:26.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:26.372 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:26.372 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:26.372 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.30 2024-04-25T09:14:26.372 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:26.372 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:26.372 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:26.372 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:26.447 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.447 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.447 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147639 s, 71.0 MB/s 2024-04-25T09:14:26.472 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.472 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.472 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228682 s, 45.9 MB/s 2024-04-25T09:14:26.485 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.485 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.485 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115865 s, 90.5 MB/s 2024-04-25T09:14:26.505 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.505 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.505 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018419 s, 56.9 MB/s 2024-04-25T09:14:26.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.522 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.522 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150945 s, 69.5 MB/s 2024-04-25T09:14:26.539 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.539 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.539 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156664 s, 66.9 MB/s 2024-04-25T09:14:26.555 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.555 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.556 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142987 s, 73.3 MB/s 2024-04-25T09:14:26.571 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.572 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.572 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145121 s, 72.3 MB/s 2024-04-25T09:14:26.588 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.588 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.588 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144114 s, 72.8 MB/s 2024-04-25T09:14:26.606 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.606 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.606 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162144 s, 64.7 MB/s 2024-04-25T09:14:26.626 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.626 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.626 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185016 s, 56.7 MB/s 2024-04-25T09:14:26.647 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.647 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.647 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195404 s, 53.7 MB/s 2024-04-25T09:14:26.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.665 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.665 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161545 s, 64.9 MB/s 2024-04-25T09:14:26.683 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.683 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.683 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158144 s, 66.3 MB/s 2024-04-25T09:14:26.700 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.700 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.700 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161236 s, 65.0 MB/s 2024-04-25T09:14:26.714 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.714 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.715 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121948 s, 86.0 MB/s 2024-04-25T09:14:26.736 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.737 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.737 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202816 s, 51.7 MB/s 2024-04-25T09:14:26.754 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.754 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.754 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156178 s, 67.1 MB/s 2024-04-25T09:14:26.775 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.775 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.776 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194702 s, 53.9 MB/s 2024-04-25T09:14:26.796 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.796 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.796 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189832 s, 55.2 MB/s 2024-04-25T09:14:26.814 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.814 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.814 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160056 s, 65.5 MB/s 2024-04-25T09:14:26.832 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.832 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.832 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165273 s, 63.4 MB/s 2024-04-25T09:14:26.848 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.848 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.848 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146574 s, 71.5 MB/s 2024-04-25T09:14:26.872 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.872 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.872 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212976 s, 49.2 MB/s 2024-04-25T09:14:26.889 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.889 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.889 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015422 s, 68.0 MB/s 2024-04-25T09:14:26.908 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.908 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.908 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172365 s, 60.8 MB/s 2024-04-25T09:14:26.926 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.926 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.926 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166009 s, 63.2 MB/s 2024-04-25T09:14:26.947 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.948 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.948 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194632 s, 53.9 MB/s 2024-04-25T09:14:26.968 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.969 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.969 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191595 s, 54.7 MB/s 2024-04-25T09:14:26.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:26.987 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:26.987 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166878 s, 62.8 MB/s 2024-04-25T09:14:27.003 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.003 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.003 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014103 s, 74.4 MB/s 2024-04-25T09:14:27.024 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.024 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.025 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199342 s, 52.6 MB/s 2024-04-25T09:14:27.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:27.026 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T09:14:27.026 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-25T09:14:27.026 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p scrub_control_test_path/dir.31 2024-04-25T09:14:27.026 DEBUG:teuthology.orchestra.run.smithi173:> for ((i = 0; i < 32; i++)); do 2024-04-25T09:14:27.026 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T09:14:27.026 DEBUG:teuthology.orchestra.run.smithi173:> done 2024-04-25T09:14:27.026 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-25T09:14:27.095 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.095 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.095 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147772 s, 71.0 MB/s 2024-04-25T09:14:27.112 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.112 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.112 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149369 s, 70.2 MB/s 2024-04-25T09:14:27.129 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.129 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.129 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153062 s, 68.5 MB/s 2024-04-25T09:14:27.145 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.146 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.146 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145189 s, 72.2 MB/s 2024-04-25T09:14:27.164 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.164 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.164 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171052 s, 61.3 MB/s 2024-04-25T09:14:27.180 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.180 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.180 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143393 s, 73.1 MB/s 2024-04-25T09:14:27.198 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.198 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.198 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154459 s, 67.9 MB/s 2024-04-25T09:14:27.214 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.215 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.215 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147314 s, 71.2 MB/s 2024-04-25T09:14:27.235 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.235 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.236 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193088 s, 54.3 MB/s 2024-04-25T09:14:27.254 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.255 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.255 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170806 s, 61.4 MB/s 2024-04-25T09:14:27.273 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.273 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.273 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016864 s, 62.2 MB/s 2024-04-25T09:14:27.296 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.296 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.297 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215762 s, 48.6 MB/s 2024-04-25T09:14:27.316 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.317 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.317 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184671 s, 56.8 MB/s 2024-04-25T09:14:27.333 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.333 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.333 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146288 s, 71.7 MB/s 2024-04-25T09:14:27.349 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.350 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.350 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147671 s, 71.0 MB/s 2024-04-25T09:14:27.369 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.369 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.369 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174576 s, 60.1 MB/s 2024-04-25T09:14:27.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.386 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.386 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157467 s, 66.6 MB/s 2024-04-25T09:14:27.403 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.403 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.403 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149437 s, 70.2 MB/s 2024-04-25T09:14:27.422 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.422 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.422 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170585 s, 61.5 MB/s 2024-04-25T09:14:27.439 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.439 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.439 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153076 s, 68.5 MB/s 2024-04-25T09:14:27.459 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.459 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.459 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184406 s, 56.9 MB/s 2024-04-25T09:14:27.476 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.476 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.476 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147121 s, 71.3 MB/s 2024-04-25T09:14:27.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.497 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.497 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195882 s, 53.5 MB/s 2024-04-25T09:14:27.521 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.521 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.521 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218334 s, 48.0 MB/s 2024-04-25T09:14:27.537 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.537 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.537 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014517 s, 72.2 MB/s 2024-04-25T09:14:27.554 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.554 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.554 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152475 s, 68.8 MB/s 2024-04-25T09:14:27.574 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.574 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.574 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183027 s, 57.3 MB/s 2024-04-25T09:14:27.592 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.593 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.593 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163225 s, 64.2 MB/s 2024-04-25T09:14:27.609 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.609 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.609 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014805 s, 70.8 MB/s 2024-04-25T09:14:27.630 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.630 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.630 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195639 s, 53.6 MB/s 2024-04-25T09:14:27.651 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.651 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.651 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194613 s, 53.9 MB/s 2024-04-25T09:14:27.671 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-25T09:14:27.672 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-25T09:14:27.672 INFO:teuthology.orchestra.run.smithi173.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181354 s, 57.8 MB/s 2024-04-25T09:14:27.673 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-04-25T09:14:27.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.872+0000 7fc17c400640 1 Processor -- start 2024-04-25T09:14:27.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.872+0000 7fc17c400640 1 -- start start 2024-04-25T09:14:27.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.876+0000 7fc17c400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc1740aeb90 0x7fc1740cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:27.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.876+0000 7fc17c400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1740aef70 0x7fc1740cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:27.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.876+0000 7fc17c400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc174071570 con 0x7fc1740cdba0 2024-04-25T09:14:27.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.876+0000 7fc17c400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc174071320 con 0x7fc1740aeb90 2024-04-25T09:14:27.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.876+0000 7fc17c400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc174072330 con 0x7fc1740aef70 2024-04-25T09:14:27.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.876+0000 7fc179a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc1740aeb90 0x7fc1740cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:27.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.876+0000 7fc179a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc1740aeb90 0x7fc1740cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36052/0 (socket says 172.21.15.173:36052) 2024-04-25T09:14:27.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.876+0000 7fc179a00640 1 -- 172.21.15.173:0/4069211971 learned_addr learned my addr 172.21.15.173:0/4069211971 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:27.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.876+0000 7fc179000640 1 --2- 172.21.15.173:0/4069211971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1740aef70 0x7fc1740cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:27.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.876+0000 7fc179a00640 1 -- 172.21.15.173:0/4069211971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1740aef70 msgr2=0x7fc1740cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:27.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.876+0000 7fc179a00640 1 --2- 172.21.15.173:0/4069211971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1740aef70 0x7fc1740cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.876+0000 7fc179a00640 1 -- 172.21.15.173:0/4069211971 >> v1:172.21.15.194:6789/0 conn(0x7fc1740cdba0 legacy=0x7fc1740ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.876+0000 7fc179a00640 1 -- 172.21.15.173:0/4069211971 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc174071850 con 0x7fc1740aeb90 2024-04-25T09:14:27.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.880+0000 7fc179a00640 1 --2- 172.21.15.173:0/4069211971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1740aeb90 0x7fc1740cc0d0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7fc168009e50 tx=0x7fc16801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08bc30bcd3868a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:27.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.880+0000 7fc173e00640 1 -- 172.21.15.173:0/4069211971 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1680a5730 con 0x7fc1740aeb90 2024-04-25T09:14:27.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.880+0000 7fc173e00640 1 -- 172.21.15.173:0/4069211971 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1680a58d0 con 0x7fc1740aeb90 2024-04-25T09:14:27.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.880+0000 7fc173e00640 1 -- 172.21.15.173:0/4069211971 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1680a5ca0 con 0x7fc1740aeb90 2024-04-25T09:14:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.880+0000 7fc17c400640 1 -- 172.21.15.173:0/4069211971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1740aeb90 msgr2=0x7fc1740cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.880+0000 7fc17c400640 1 --2- 172.21.15.173:0/4069211971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1740aeb90 0x7fc1740cc0d0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7fc168009e50 tx=0x7fc16801c970 comp rx=0 tx=0).stop 2024-04-25T09:14:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.880+0000 7fc17c400640 1 -- 172.21.15.173:0/4069211971 shutdown_connections 2024-04-25T09:14:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.880+0000 7fc17c400640 1 --2- 172.21.15.173:0/4069211971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1740aef70 0x7fc1740cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.880+0000 7fc17c400640 1 --2- 172.21.15.173:0/4069211971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1740aeb90 0x7fc1740cc0d0 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.880+0000 7fc17c400640 1 -- 172.21.15.173:0/4069211971 >> 172.21.15.173:0/4069211971 conn(0x7fc17406ac90 msgr2=0x7fc17406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.880+0000 7fc17c400640 1 -- 172.21.15.173:0/4069211971 shutdown_connections 2024-04-25T09:14:27.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.880+0000 7fc17c400640 1 -- 172.21.15.173:0/4069211971 wait complete. 2024-04-25T09:14:27.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.880+0000 7fc17c400640 1 Processor -- start 2024-04-25T09:14:27.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.880+0000 7fc17c400640 1 -- start start 2024-04-25T09:14:27.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc17c400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1740aeb90 0x7fc174144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:27.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc17c400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1740aef70 0x7fc1741483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:27.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc17c400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1740cdba0 0x7fc174148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:27.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc17c400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17415bb30 con 0x7fc1740cdba0 2024-04-25T09:14:27.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc17c400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17415b9b0 con 0x7fc1740aef70 2024-04-25T09:14:27.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc17c400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17415bcb0 con 0x7fc1740aeb90 2024-04-25T09:14:27.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc17a400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1740cdba0 0x7fc174148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:27.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc17a400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1740cdba0 0x7fc174148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36066/0 (socket says 172.21.15.173:36066) 2024-04-25T09:14:27.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc17a400640 1 -- 172.21.15.173:0/248426627 learned_addr learned my addr 172.21.15.173:0/248426627 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:27.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc179a00640 1 --2- 172.21.15.173:0/248426627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1740aeb90 0x7fc174144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:27.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc179000640 1 --2- 172.21.15.173:0/248426627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1740aef70 0x7fc1741483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:27.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc17a400640 1 -- 172.21.15.173:0/248426627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1740aeb90 msgr2=0x7fc174144860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc17a400640 1 --2- 172.21.15.173:0/248426627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1740aeb90 0x7fc174144860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc17a400640 1 -- 172.21.15.173:0/248426627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1740aef70 msgr2=0x7fc1741483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc17a400640 1 --2- 172.21.15.173:0/248426627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1740aef70 0x7fc1741483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc17a400640 1 -- 172.21.15.173:0/248426627 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc174144da0 con 0x7fc1740cdba0 2024-04-25T09:14:27.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc17a400640 1 --2- 172.21.15.173:0/248426627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1740cdba0 0x7fc174148910 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00c430 tx=0x7fc16c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:27.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc171600640 1 -- 172.21.15.173:0/248426627 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c017070 con 0x7fc1740cdba0 2024-04-25T09:14:27.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc171600640 1 -- 172.21.15.173:0/248426627 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c0052d0 con 0x7fc1740cdba0 2024-04-25T09:14:27.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc17c400640 1 -- 172.21.15.173:0/248426627 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1740ad760 con 0x7fc1740cdba0 2024-04-25T09:14:27.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc171600640 1 -- 172.21.15.173:0/248426627 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c003800 con 0x7fc1740cdba0 2024-04-25T09:14:27.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc17c400640 1 -- 172.21.15.173:0/248426627 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc174147740 con 0x7fc1740cdba0 2024-04-25T09:14:27.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc17c400640 1 -- 172.21.15.173:0/248426627 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc174073ab0 con 0x7fc1740cdba0 2024-04-25T09:14:27.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.884+0000 7fc171600640 1 -- 172.21.15.173:0/248426627 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc16c01a070 con 0x7fc1740cdba0 2024-04-25T09:14:27.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.888+0000 7fc171600640 1 --2- 172.21.15.173:0/248426627 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc154066f90 0x7fc154069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:27.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.888+0000 7fc171600640 1 -- 172.21.15.173:0/248426627 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc16c084480 con 0x7fc1740cdba0 2024-04-25T09:14:27.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.888+0000 7fc179a00640 1 --2- 172.21.15.173:0/248426627 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc154066f90 0x7fc154069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:27.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.888+0000 7fc179a00640 1 --2- 172.21.15.173:0/248426627 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc154066f90 0x7fc154069450 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc1680ae000 tx=0x7fc1680a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:27.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:27.892+0000 7fc171600640 1 -- 172.21.15.173:0/248426627 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc16c005480 con 0x7fc1740cdba0 2024-04-25T09:14:28.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:28.080+0000 7fc17c400640 1 -- 172.21.15.173:0/248426627 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fc1740ce260 con 0x7fc1740cdba0 2024-04-25T09:14:28.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:28.944+0000 7fc171600640 1 -- 172.21.15.173:0/248426627 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v103) v1 ==== 105+0+0 (secure 0 0 0) 0x7fc16c054c10 con 0x7fc1740cdba0 2024-04-25T09:14:28.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:28.944+0000 7fc17c400640 1 -- 172.21.15.173:0/248426627 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc154066f90 msgr2=0x7fc154069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:28.944+0000 7fc17c400640 1 --2- 172.21.15.173:0/248426627 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc154066f90 0x7fc154069450 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc1680ae000 tx=0x7fc1680a7070 comp rx=0 tx=0).stop 2024-04-25T09:14:28.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:28.944+0000 7fc17c400640 1 -- 172.21.15.173:0/248426627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1740cdba0 msgr2=0x7fc174148910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:28.944+0000 7fc17c400640 1 --2- 172.21.15.173:0/248426627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1740cdba0 0x7fc174148910 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00c430 tx=0x7fc16c00c8f0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:28.948+0000 7fc17c400640 1 -- 172.21.15.173:0/248426627 shutdown_connections 2024-04-25T09:14:28.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:28.948+0000 7fc17c400640 1 --2- 172.21.15.173:0/248426627 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc154066f90 0x7fc154069450 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:28.948+0000 7fc17c400640 1 --2- 172.21.15.173:0/248426627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1740cdba0 0x7fc174148910 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:28.948+0000 7fc17c400640 1 --2- 172.21.15.173:0/248426627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1740aef70 0x7fc1741483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:28.948+0000 7fc17c400640 1 --2- 172.21.15.173:0/248426627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1740aeb90 0x7fc174144860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:28.948+0000 7fc17c400640 1 -- 172.21.15.173:0/248426627 >> 172.21.15.173:0/248426627 conn(0x7fc17406ac90 msgr2=0x7fc17415c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:28.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:28.948+0000 7fc17c400640 1 -- 172.21.15.173:0/248426627 shutdown_connections 2024-04-25T09:14:28.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:28.948+0000 7fc17c400640 1 -- 172.21.15.173:0/248426627 wait complete. 2024-04-25T09:14:28.954 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-04-25T09:14:29.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.112+0000 7fc9fae00640 1 Processor -- start 2024-04-25T09:14:29.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.112+0000 7fc9fae00640 1 -- start start 2024-04-25T09:14:29.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.112+0000 7fc9fae00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc9f40cc7e0 0x7fc9f40cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.112+0000 7fc9fae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9f40aef70 0x7fc9f40ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.112+0000 7fc9fae00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f4071570 con 0x7fc9f40aeb90 2024-04-25T09:14:29.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.112+0000 7fc9fae00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f4071320 con 0x7fc9f40cc7e0 2024-04-25T09:14:29.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.112+0000 7fc9fae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f4072330 con 0x7fc9f40aef70 2024-04-25T09:14:29.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.112+0000 7fc9f3e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc9f40aeb90 0x7fc9f40cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44506/0 (socket says 172.21.15.173:44506) 2024-04-25T09:14:29.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.112+0000 7fc9f3e00640 1 -- 172.21.15.173:0/494406819 learned_addr learned my addr 172.21.15.173:0/494406819 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:29.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.112+0000 7fc9f3400640 1 --2- 172.21.15.173:0/494406819 >> v2:172.21.15.173:3300/0 conn(0x7fc9f40cc7e0 0x7fc9f40cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.112+0000 7fc9f2a00640 1 -- 172.21.15.173:0/494406819 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671910371 0 0) 0x7fc9f4071570 con 0x7fc9f40aeb90 2024-04-25T09:14:29.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.112+0000 7fc9f2a00640 1 -- 172.21.15.173:0/494406819 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9d8003530 con 0x7fc9f40aeb90 2024-04-25T09:14:29.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.112+0000 7fc9f8e00640 1 --2- 172.21.15.173:0/494406819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9f40aef70 0x7fc9f40ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.112+0000 7fc9f3400640 1 -- 172.21.15.173:0/494406819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9f40aef70 msgr2=0x7fc9f40ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.112+0000 7fc9f3400640 1 --2- 172.21.15.173:0/494406819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9f40aef70 0x7fc9f40ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.112+0000 7fc9f3400640 1 -- 172.21.15.173:0/494406819 >> v1:172.21.15.173:6789/0 conn(0x7fc9f40aeb90 legacy=0x7fc9f40cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.112+0000 7fc9f2a00640 1 -- 172.21.15.173:0/494406819 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 700775404 0 0) 0x7fc9d8003530 con 0x7fc9f40aeb90 2024-04-25T09:14:29.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.112+0000 7fc9f3400640 1 -- 172.21.15.173:0/494406819 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f4071850 con 0x7fc9f40cc7e0 2024-04-25T09:14:29.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.116+0000 7fc9f3400640 1 --2- 172.21.15.173:0/494406819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9f40cc7e0 0x7fc9f40cdba0 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00097c0 tx=0x7fc9e001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5077b49e843ec65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.116+0000 7fc9f2a00640 1 -- 172.21.15.173:0/494406819 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00b0070 con 0x7fc9f40cc7e0 2024-04-25T09:14:29.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.116+0000 7fc9f2a00640 1 -- 172.21.15.173:0/494406819 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e00ab600 con 0x7fc9f40cc7e0 2024-04-25T09:14:29.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.116+0000 7fc9f2a00640 1 -- 172.21.15.173:0/494406819 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00ab9d0 con 0x7fc9f40cc7e0 2024-04-25T09:14:29.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.116+0000 7fc9fae00640 1 -- 172.21.15.173:0/494406819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9f40cc7e0 msgr2=0x7fc9f40cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.116+0000 7fc9fae00640 1 --2- 172.21.15.173:0/494406819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9f40cc7e0 0x7fc9f40cdba0 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00097c0 tx=0x7fc9e001c410 comp rx=0 tx=0).stop 2024-04-25T09:14:29.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.116+0000 7fc9fae00640 1 -- 172.21.15.173:0/494406819 shutdown_connections 2024-04-25T09:14:29.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.116+0000 7fc9fae00640 1 --2- 172.21.15.173:0/494406819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9f40aef70 0x7fc9f40ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.116+0000 7fc9fae00640 1 --2- 172.21.15.173:0/494406819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9f40cc7e0 0x7fc9f40cdba0 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.116+0000 7fc9fae00640 1 -- 172.21.15.173:0/494406819 >> 172.21.15.173:0/494406819 conn(0x7fc9f406ac90 msgr2=0x7fc9f406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:29.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.116+0000 7fc9fae00640 1 -- 172.21.15.173:0/494406819 shutdown_connections 2024-04-25T09:14:29.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.116+0000 7fc9fae00640 1 -- 172.21.15.173:0/494406819 wait complete. 2024-04-25T09:14:29.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9fae00640 1 Processor -- start 2024-04-25T09:14:29.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9fae00640 1 -- start start 2024-04-25T09:14:29.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9fae00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9f40aeb90 0x7fc9f414c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9fae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9f40aef70 0x7fc9f414d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9fae00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9f40cc7e0 0x7fc9f4159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9fae00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f415bb30 con 0x7fc9f40cc7e0 2024-04-25T09:14:29.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9fae00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f415b9b0 con 0x7fc9f40aeb90 2024-04-25T09:14:29.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9fae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f415bcb0 con 0x7fc9f40aef70 2024-04-25T09:14:29.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9f8e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9f40cc7e0 0x7fc9f4159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9f8e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9f40cc7e0 0x7fc9f4159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36086/0 (socket says 172.21.15.173:36086) 2024-04-25T09:14:29.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9f8e00640 1 -- 172.21.15.173:0/4220811636 learned_addr learned my addr 172.21.15.173:0/4220811636 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:29.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9f3400640 1 --2- 172.21.15.173:0/4220811636 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9f40aef70 0x7fc9f414d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9f3e00640 1 --2- 172.21.15.173:0/4220811636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9f40aeb90 0x7fc9f414c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9f8e00640 1 -- 172.21.15.173:0/4220811636 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9f40aef70 msgr2=0x7fc9f414d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9f8e00640 1 --2- 172.21.15.173:0/4220811636 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9f40aef70 0x7fc9f414d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9f8e00640 1 -- 172.21.15.173:0/4220811636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9f40aeb90 msgr2=0x7fc9f414c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9f8e00640 1 --2- 172.21.15.173:0/4220811636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9f40aeb90 0x7fc9f414c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9f8e00640 1 -- 172.21.15.173:0/4220811636 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f414dd00 con 0x7fc9f40cc7e0 2024-04-25T09:14:29.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9f8e00640 1 --2- 172.21.15.173:0/4220811636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9f40cc7e0 0x7fc9f4159a00 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec007e40 tx=0x7fc9ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9ebe00640 1 -- 172.21.15.173:0/4220811636 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec014620 con 0x7fc9f40cc7e0 2024-04-25T09:14:29.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9ebe00640 1 -- 172.21.15.173:0/4220811636 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ec019070 con 0x7fc9f40cc7e0 2024-04-25T09:14:29.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9ebe00640 1 -- 172.21.15.173:0/4220811636 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec014a20 con 0x7fc9f40cc7e0 2024-04-25T09:14:29.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9fae00640 1 -- 172.21.15.173:0/4220811636 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f414dfe0 con 0x7fc9f40cc7e0 2024-04-25T09:14:29.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9fae00640 1 -- 172.21.15.173:0/4220811636 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f414e5a0 con 0x7fc9f40cc7e0 2024-04-25T09:14:29.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.120+0000 7fc9fae00640 1 -- 172.21.15.173:0/4220811636 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f4073ab0 con 0x7fc9f40cc7e0 2024-04-25T09:14:29.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.124+0000 7fc9ebe00640 1 -- 172.21.15.173:0/4220811636 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc9ec014bc0 con 0x7fc9f40cc7e0 2024-04-25T09:14:29.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.124+0000 7fc9ebe00640 1 --2- 172.21.15.173:0/4220811636 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc9d4066f60 0x7fc9d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.124+0000 7fc9ebe00640 1 -- 172.21.15.173:0/4220811636 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc9ec085ab0 con 0x7fc9f40cc7e0 2024-04-25T09:14:29.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.124+0000 7fc9f3e00640 1 --2- 172.21.15.173:0/4220811636 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc9d4066f60 0x7fc9d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.124+0000 7fc9f3e00640 1 --2- 172.21.15.173:0/4220811636 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc9d4066f60 0x7fc9d4069420 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4072af0 tx=0x7fc9e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.128+0000 7fc9ebe00640 1 -- 172.21.15.173:0/4220811636 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc9ec056920 con 0x7fc9f40cc7e0 2024-04-25T09:14:29.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.312+0000 7fc9fae00640 1 -- 172.21.15.173:0/4220811636 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fc9f415c970 con 0x7fc9f40cc7e0 2024-04-25T09:14:29.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.952+0000 7fc9ebe00640 1 -- 172.21.15.173:0/4220811636 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v104) v1 ==== 121+0+0 (secure 0 0 0) 0x7fc9ec056220 con 0x7fc9f40cc7e0 2024-04-25T09:14:29.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.952+0000 7fc9fae00640 1 -- 172.21.15.173:0/4220811636 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc9d4066f60 msgr2=0x7fc9d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.952+0000 7fc9fae00640 1 --2- 172.21.15.173:0/4220811636 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc9d4066f60 0x7fc9d4069420 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4072af0 tx=0x7fc9e4009040 comp rx=0 tx=0).stop 2024-04-25T09:14:29.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.952+0000 7fc9fae00640 1 -- 172.21.15.173:0/4220811636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9f40cc7e0 msgr2=0x7fc9f4159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.952+0000 7fc9fae00640 1 --2- 172.21.15.173:0/4220811636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9f40cc7e0 0x7fc9f4159a00 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec007e40 tx=0x7fc9ec00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.952+0000 7fc9fae00640 1 -- 172.21.15.173:0/4220811636 shutdown_connections 2024-04-25T09:14:29.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.952+0000 7fc9fae00640 1 --2- 172.21.15.173:0/4220811636 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc9d4066f60 0x7fc9d4069420 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.952+0000 7fc9fae00640 1 --2- 172.21.15.173:0/4220811636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9f40cc7e0 0x7fc9f4159a00 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.952+0000 7fc9fae00640 1 --2- 172.21.15.173:0/4220811636 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc9f40aef70 0x7fc9f414d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.952+0000 7fc9fae00640 1 --2- 172.21.15.173:0/4220811636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9f40aeb90 0x7fc9f414c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.952+0000 7fc9fae00640 1 -- 172.21.15.173:0/4220811636 >> 172.21.15.173:0/4220811636 conn(0x7fc9f406ac90 msgr2=0x7fc9f4154060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:29.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.952+0000 7fc9fae00640 1 -- 172.21.15.173:0/4220811636 shutdown_connections 2024-04-25T09:14:29.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:29.952+0000 7fc9fae00640 1 -- 172.21.15.173:0/4220811636 wait complete. 2024-04-25T09:14:29.965 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:30.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.120+0000 7f0e6d000640 1 Processor -- start 2024-04-25T09:14:30.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.120+0000 7f0e6d000640 1 -- start start 2024-04-25T09:14:30.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.120+0000 7f0e6d000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0e6815ba20 0x7f0e6815be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.120+0000 7f0e6d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e680b70f0 0x7f0e6806f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.120+0000 7f0e6d000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e6815c460 con 0x7f0e680b7550 2024-04-25T09:14:30.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.120+0000 7f0e6d000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e6815c740 con 0x7f0e6815ba20 2024-04-25T09:14:30.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.120+0000 7f0e6d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6815ca20 con 0x7f0e680b70f0 2024-04-25T09:14:30.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.124+0000 7f0e5d400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e680b70f0 0x7f0e6806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.124+0000 7f0e65e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0e6815ba20 0x7f0e6815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.124+0000 7f0e66800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f0e680b7550 0x7f0e680d1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:47416/0 (socket says 172.21.15.173:47416) 2024-04-25T09:14:30.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.124+0000 7f0e65e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0e6815ba20 0x7f0e6815be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:49346/0 (socket says 172.21.15.173:49346) 2024-04-25T09:14:30.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.124+0000 7f0e66800640 1 -- 172.21.15.173:0/381849161 learned_addr learned my addr 172.21.15.173:0/381849161 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:30.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.124+0000 7f0e5d400640 1 -- 172.21.15.173:0/381849161 >> v2:172.21.15.194:3300/0 conn(0x7f0e6815ba20 msgr2=0x7f0e6815be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:30.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.124+0000 7f0e5d400640 1 --2- 172.21.15.173:0/381849161 >> v2:172.21.15.194:3300/0 conn(0x7f0e6815ba20 0x7f0e6815be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.124+0000 7f0e5d400640 1 -- 172.21.15.173:0/381849161 >> v1:172.21.15.194:6789/0 conn(0x7f0e680b7550 legacy=0x7f0e680d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.124+0000 7f0e5d400640 1 -- 172.21.15.173:0/381849161 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6815cd00 con 0x7f0e680b70f0 2024-04-25T09:14:30.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.124+0000 7f0e65400640 1 -- 172.21.15.173:0/381849161 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162913611 0 0) 0x7f0e6815c460 con 0x7f0e680b7550 2024-04-25T09:14:30.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.124+0000 7f0e65e00640 1 --2- 172.21.15.173:0/381849161 >> v2:172.21.15.194:3300/0 conn(0x7f0e6815ba20 0x7f0e6815be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:30.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e5d400640 1 --2- 172.21.15.173:0/381849161 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e680b70f0 0x7f0e6806f960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009d90 tx=0x7f0e5001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e758b982c69726a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:30.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e65400640 1 -- 172.21.15.173:0/381849161 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500b2070 con 0x7f0e680b70f0 2024-04-25T09:14:30.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e65400640 1 -- 172.21.15.173:0/381849161 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e500a5910 con 0x7f0e680b70f0 2024-04-25T09:14:30.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e65400640 1 -- 172.21.15.173:0/381849161 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500a5ce0 con 0x7f0e680b70f0 2024-04-25T09:14:30.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e6d000640 1 -- 172.21.15.173:0/381849161 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e680b70f0 msgr2=0x7f0e6806f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e6d000640 1 --2- 172.21.15.173:0/381849161 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e680b70f0 0x7f0e6806f960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009d90 tx=0x7f0e5001c940 comp rx=0 tx=0).stop 2024-04-25T09:14:30.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e6d000640 1 -- 172.21.15.173:0/381849161 shutdown_connections 2024-04-25T09:14:30.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e6d000640 1 --2- 172.21.15.173:0/381849161 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e680b70f0 0x7f0e6806f960 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e6d000640 1 --2- 172.21.15.173:0/381849161 >> v2:172.21.15.194:3300/0 conn(0x7f0e6815ba20 0x7f0e6815be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e6d000640 1 -- 172.21.15.173:0/381849161 >> 172.21.15.173:0/381849161 conn(0x7f0e68061880 msgr2=0x7f0e68061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:30.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e6d000640 1 -- 172.21.15.173:0/381849161 shutdown_connections 2024-04-25T09:14:30.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e6d000640 1 -- 172.21.15.173:0/381849161 wait complete. 2024-04-25T09:14:30.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e6d000640 1 Processor -- start 2024-04-25T09:14:30.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e6d000640 1 -- start start 2024-04-25T09:14:30.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e6d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e680b70f0 0x7f0e6806bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e6d000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6815ba20 0x7f0e680b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e6d000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e680b6310 0x7f0e680ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e6d000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6815e2b0 con 0x7f0e680b6310 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e6d000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6815e130 con 0x7f0e6815ba20 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e6d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6815e430 con 0x7f0e680b70f0 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.128+0000 7f0e66800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e680b6310 0x7f0e680ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e66800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e680b6310 0x7f0e680ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36096/0 (socket says 172.21.15.173:36096) 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e66800640 1 -- 172.21.15.173:0/3906744123 learned_addr learned my addr 172.21.15.173:0/3906744123 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e5d400640 1 --2- 172.21.15.173:0/3906744123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6815ba20 0x7f0e680b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e65e00640 1 --2- 172.21.15.173:0/3906744123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e680b70f0 0x7f0e6806bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e66800640 1 -- 172.21.15.173:0/3906744123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e680b70f0 msgr2=0x7f0e6806bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e66800640 1 --2- 172.21.15.173:0/3906744123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e680b70f0 0x7f0e6806bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e66800640 1 -- 172.21.15.173:0/3906744123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6815ba20 msgr2=0x7f0e680b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e66800640 1 --2- 172.21.15.173:0/3906744123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6815ba20 0x7f0e680b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e66800640 1 -- 172.21.15.173:0/3906744123 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e680ae970 con 0x7f0e680b6310 2024-04-25T09:14:30.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e66800640 1 --2- 172.21.15.173:0/3906744123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e680b6310 0x7f0e680ac8d0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000c450 tx=0x7f0e6000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:30.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e5ea00640 1 -- 172.21.15.173:0/3906744123 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e600074e0 con 0x7f0e680b6310 2024-04-25T09:14:30.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e5ea00640 1 -- 172.21.15.173:0/3906744123 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e600047f0 con 0x7f0e680b6310 2024-04-25T09:14:30.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e5ea00640 1 -- 172.21.15.173:0/3906744123 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60007680 con 0x7f0e680b6310 2024-04-25T09:14:30.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e6d000640 1 -- 172.21.15.173:0/3906744123 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e680aec50 con 0x7f0e680b6310 2024-04-25T09:14:30.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e6d000640 1 -- 172.21.15.173:0/3906744123 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e680af210 con 0x7f0e680b6310 2024-04-25T09:14:30.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e6d000640 1 -- 172.21.15.173:0/3906744123 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e68073a40 con 0x7f0e680b6310 2024-04-25T09:14:30.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e5ea00640 1 -- 172.21.15.173:0/3906744123 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0e60011070 con 0x7f0e680b6310 2024-04-25T09:14:30.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e5ea00640 1 --2- 172.21.15.173:0/3906744123 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e44066f60 0x7f0e44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.132+0000 7f0e5ea00640 1 -- 172.21.15.173:0/3906744123 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0e60084d20 con 0x7f0e680b6310 2024-04-25T09:14:30.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.136+0000 7f0e65e00640 1 --2- 172.21.15.173:0/3906744123 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e44066f60 0x7f0e44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.136+0000 7f0e65e00640 1 --2- 172.21.15.173:0/3906744123 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e44066f60 0x7f0e44069420 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009580 tx=0x7f0e58009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:30.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.136+0000 7f0e5ea00640 1 -- 172.21.15.173:0/3906744123 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0e600554b0 con 0x7f0e680b6310 2024-04-25T09:14:30.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.324+0000 7f0e6d000640 1 -- 172.21.15.173:0/3906744123 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e680cefc0 con 0x7f0e680b6310 2024-04-25T09:14:30.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.324+0000 7f0e5ea00640 1 -- 172.21.15.173:0/3906744123 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4957 (secure 0 0 0) 0x7f0e60059550 con 0x7f0e680b6310 2024-04-25T09:14:30.309 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:30.310 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":105,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/751187793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":751187793},{"type":"v1","addr":"172.21.15.173:6836","nonce":751187793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":9013,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1331227782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1331227782},{"type":"v1","addr":"172.21.15.194:6834","nonce":1331227782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":105,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T09:13:55.081334+0000","modified":"2024-04-25T09:14:29.957297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9957":{"gid":9957,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6837/401620872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":401620872},{"type":"v1","addr":"172.21.15.173:6837","nonce":401620872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_9969":{"gid":9969,"name":"b","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/3308916795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":3308916795},{"type":"v1","addr":"172.21.15.194:6835","nonce":3308916795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T09:14:30.310 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 105 2024-04-25T09:14:30.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.324+0000 7f0e6d000640 1 -- 172.21.15.173:0/3906744123 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e44066f60 msgr2=0x7f0e44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.324+0000 7f0e6d000640 1 --2- 172.21.15.173:0/3906744123 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e44066f60 0x7f0e44069420 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009580 tx=0x7f0e58009190 comp rx=0 tx=0).stop 2024-04-25T09:14:30.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.324+0000 7f0e6d000640 1 -- 172.21.15.173:0/3906744123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e680b6310 msgr2=0x7f0e680ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.324+0000 7f0e6d000640 1 --2- 172.21.15.173:0/3906744123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e680b6310 0x7f0e680ac8d0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000c450 tx=0x7f0e6000c910 comp rx=0 tx=0).stop 2024-04-25T09:14:30.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.324+0000 7f0e6d000640 1 -- 172.21.15.173:0/3906744123 shutdown_connections 2024-04-25T09:14:30.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.324+0000 7f0e6d000640 1 --2- 172.21.15.173:0/3906744123 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f0e44066f60 0x7f0e44069420 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.324+0000 7f0e6d000640 1 --2- 172.21.15.173:0/3906744123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e680b6310 0x7f0e680ac8d0 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.324+0000 7f0e6d000640 1 --2- 172.21.15.173:0/3906744123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6815ba20 0x7f0e680b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.324+0000 7f0e6d000640 1 --2- 172.21.15.173:0/3906744123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e680b70f0 0x7f0e6806bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.324+0000 7f0e6d000640 1 -- 172.21.15.173:0/3906744123 >> 172.21.15.173:0/3906744123 conn(0x7f0e68061880 msgr2=0x7f0e68061c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:30.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.324+0000 7f0e6d000640 1 -- 172.21.15.173:0/3906744123 shutdown_connections 2024-04-25T09:14:30.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.324+0000 7f0e6d000640 1 -- 172.21.15.173:0/3906744123 wait complete. 2024-04-25T09:14:30.732 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 105, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-25T09:13:55.081334+0000', 'modified': '2024-04-25T09:14:29.957297+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9969}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9957': {'gid': 9957, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6837/401620872', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6835', 'nonce': 401620872}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 401620872}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_9969': {'gid': 9969, 'name': 'b', 'rank': 0, 'incarnation': 98, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.194:6835/3308916795', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6833', 'nonce': 3308916795}, {'type': 'v1', 'addr': '172.21.15.194:6835', 'nonce': 3308916795}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:14:30.732 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:14:30.733 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T09:14:30.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.892+0000 7fcd6e000640 1 Processor -- start 2024-04-25T09:14:30.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.892+0000 7fcd6e000640 1 -- start start 2024-04-25T09:14:30.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.896+0000 7fcd6e000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd680cc7e0 0x7fcd680cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.896+0000 7fcd6e000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcd680aef70 0x7fcd680ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.896+0000 7fcd6e000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd68071570 con 0x7fcd680aeb90 2024-04-25T09:14:30.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.896+0000 7fcd6e000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd68071320 con 0x7fcd680aef70 2024-04-25T09:14:30.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.896+0000 7fcd6e000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68072330 con 0x7fcd680cc7e0 2024-04-25T09:14:30.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.896+0000 7fcd67e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcd680aef70 0x7fcd680ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.896+0000 7fcd5ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd680cc7e0 0x7fcd680cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.896+0000 7fcd67e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcd680aef70 0x7fcd680ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:49366/0 (socket says 172.21.15.173:49366) 2024-04-25T09:14:30.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.896+0000 7fcd67e00640 1 -- 172.21.15.173:0/134771301 learned_addr learned my addr 172.21.15.173:0/134771301 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:30.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.896+0000 7fcd67e00640 1 -- 172.21.15.173:0/134771301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd680cc7e0 msgr2=0x7fcd680cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:30.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.896+0000 7fcd67e00640 1 --2- 172.21.15.173:0/134771301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd680cc7e0 0x7fcd680cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.896+0000 7fcd67e00640 1 -- 172.21.15.173:0/134771301 >> v1:172.21.15.194:6789/0 conn(0x7fcd680aeb90 legacy=0x7fcd680cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.896+0000 7fcd67e00640 1 -- 172.21.15.173:0/134771301 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd68071850 con 0x7fcd680aef70 2024-04-25T09:14:30.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.900+0000 7fcd67e00640 1 --2- 172.21.15.173:0/134771301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd680aef70 0x7fcd680ce0e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009e50 tx=0x7fcd6001c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33219e7d7bd2c086 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:30.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.900+0000 7fcd66a00640 1 -- 172.21.15.173:0/134771301 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd600a5650 con 0x7fcd680aef70 2024-04-25T09:14:30.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.900+0000 7fcd66a00640 1 -- 172.21.15.173:0/134771301 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd600a57f0 con 0x7fcd680aef70 2024-04-25T09:14:30.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.900+0000 7fcd66a00640 1 -- 172.21.15.173:0/134771301 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd600a5bc0 con 0x7fcd680aef70 2024-04-25T09:14:30.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.900+0000 7fcd6e000640 1 -- 172.21.15.173:0/134771301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd680aef70 msgr2=0x7fcd680ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.900+0000 7fcd6e000640 1 --2- 172.21.15.173:0/134771301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd680aef70 0x7fcd680ce0e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009e50 tx=0x7fcd6001c9a0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.900+0000 7fcd6e000640 1 -- 172.21.15.173:0/134771301 shutdown_connections 2024-04-25T09:14:30.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.900+0000 7fcd6e000640 1 --2- 172.21.15.173:0/134771301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd680aef70 0x7fcd680ce0e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.900+0000 7fcd6e000640 1 --2- 172.21.15.173:0/134771301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd680cc7e0 0x7fcd680cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.900+0000 7fcd6e000640 1 -- 172.21.15.173:0/134771301 >> 172.21.15.173:0/134771301 conn(0x7fcd6806ac90 msgr2=0x7fcd6806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:30.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.900+0000 7fcd6e000640 1 -- 172.21.15.173:0/134771301 shutdown_connections 2024-04-25T09:14:30.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.900+0000 7fcd6e000640 1 -- 172.21.15.173:0/134771301 wait complete. 2024-04-25T09:14:30.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.900+0000 7fcd6e000640 1 Processor -- start 2024-04-25T09:14:30.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.900+0000 7fcd6e000640 1 -- start start 2024-04-25T09:14:30.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd6e000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd680aeb90 0x7fcd68144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd6e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd680aef70 0x7fcd681546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd6e000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd680cc7e0 0x7fcd6815cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd6e000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6815bb30 con 0x7fcd680aeb90 2024-04-25T09:14:30.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd6e000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6815b9b0 con 0x7fcd680aef70 2024-04-25T09:14:30.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd6e000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6815bcb0 con 0x7fcd680cc7e0 2024-04-25T09:14:30.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd67400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd680aeb90 0x7fcd68144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd67400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd680aeb90 0x7fcd68144280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36108/0 (socket says 172.21.15.173:36108) 2024-04-25T09:14:30.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd67400640 1 -- 172.21.15.173:0/1725585060 learned_addr learned my addr 172.21.15.173:0/1725585060 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:30.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd67e00640 1 --2- 172.21.15.173:0/1725585060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd680cc7e0 0x7fcd6815cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd5ea00640 1 --2- 172.21.15.173:0/1725585060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd680aef70 0x7fcd681546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd67400640 1 -- 172.21.15.173:0/1725585060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd680cc7e0 msgr2=0x7fcd6815cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd67400640 1 --2- 172.21.15.173:0/1725585060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd680cc7e0 0x7fcd6815cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd67400640 1 -- 172.21.15.173:0/1725585060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd680aef70 msgr2=0x7fcd681546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd67400640 1 --2- 172.21.15.173:0/1725585060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd680aef70 0x7fcd681546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd67400640 1 -- 172.21.15.173:0/1725585060 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd68152fd0 con 0x7fcd680aeb90 2024-04-25T09:14:30.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd67400640 1 --2- 172.21.15.173:0/1725585060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd680aeb90 0x7fcd68144280 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800c370 tx=0x7fcd5800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:30.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd5fe00640 1 -- 172.21.15.173:0/1725585060 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd580052d0 con 0x7fcd680aeb90 2024-04-25T09:14:30.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd5fe00640 1 -- 172.21.15.173:0/1725585060 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd58005470 con 0x7fcd680aeb90 2024-04-25T09:14:30.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd6e000640 1 -- 172.21.15.173:0/1725585060 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd68153920 con 0x7fcd680aeb90 2024-04-25T09:14:30.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd5fe00640 1 -- 172.21.15.173:0/1725585060 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58007260 con 0x7fcd680aeb90 2024-04-25T09:14:30.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd6e000640 1 -- 172.21.15.173:0/1725585060 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd68153ee0 con 0x7fcd680aeb90 2024-04-25T09:14:30.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.904+0000 7fcd5fe00640 1 -- 172.21.15.173:0/1725585060 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcd58007400 con 0x7fcd680aeb90 2024-04-25T09:14:30.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd5fe00640 1 --2- 172.21.15.173:0/1725585060 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd44066f60 0x7fcd44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd5fe00640 1 -- 172.21.15.173:0/1725585060 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcd580846f0 con 0x7fcd680aeb90 2024-04-25T09:14:30.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd5ea00640 1 --2- 172.21.15.173:0/1725585060 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd44066f60 0x7fcd44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd71598000 1 Processor -- start 2024-04-25T09:14:30.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd71598000 1 -- start start 2024-04-25T09:14:30.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd5ea00640 1 --2- 172.21.15.173:0/1725585060 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd44066f60 0x7fcd44069420 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fcd6815a9a0 tx=0x7fcd50009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:30.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd71598000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d449920 0x55ca6d449d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd71598000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d44a240 0x55ca6d3ff9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd71598000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d3fff30 0x55ca6d400310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd71598000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6d2e75f0 con 0x55ca6d449920 2024-04-25T09:14:30.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd71598000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6d24eda0 con 0x55ca6d44a240 2024-04-25T09:14:30.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd71598000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca6d1d7150 con 0x55ca6d3fff30 2024-04-25T09:14:30.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd67400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d449920 0x55ca6d449d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd67400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d449920 0x55ca6d449d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36110/0 (socket says 172.21.15.173:36110) 2024-04-25T09:14:30.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd67400640 1 -- 172.21.15.173:0/2831719759 learned_addr learned my addr 172.21.15.173:0/2831719759 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:30.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd67e00640 1 --2- 172.21.15.173:0/2831719759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d3fff30 0x55ca6d400310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd5ea00640 1 --2- 172.21.15.173:0/2831719759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d44a240 0x55ca6d3ff9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd67400640 1 -- 172.21.15.173:0/2831719759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d3fff30 msgr2=0x55ca6d400310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:30.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd67400640 1 --2- 172.21.15.173:0/2831719759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d3fff30 0x55ca6d400310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd67400640 1 -- 172.21.15.173:0/2831719759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d44a240 msgr2=0x55ca6d3ff9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:30.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd67400640 1 --2- 172.21.15.173:0/2831719759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d44a240 0x55ca6d3ff9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd67400640 1 -- 172.21.15.173:0/2831719759 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca6d1f0ca0 con 0x55ca6d449920 2024-04-25T09:14:30.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd67400640 1 --2- 172.21.15.173:0/2831719759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d449920 0x55ca6d449d00 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7fcd58054d90 tx=0x7fcd58054ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc12f422b091d0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:30.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd57e00640 1 -- 172.21.15.173:0/2831719759 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5805b0c0 con 0x55ca6d449920 2024-04-25T09:14:30.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd57e00640 1 -- 172.21.15.173:0/2831719759 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd58082e50 con 0x55ca6d449920 2024-04-25T09:14:30.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd57e00640 1 -- 172.21.15.173:0/2831719759 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58051470 con 0x55ca6d449920 2024-04-25T09:14:30.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd71598000 1 -- 172.21.15.173:0/2831719759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d449920 msgr2=0x55ca6d449d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.908+0000 7fcd71598000 1 --2- 172.21.15.173:0/2831719759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d449920 0x55ca6d449d00 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7fcd58054d90 tx=0x7fcd58054ec0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 -- 172.21.15.173:0/2831719759 shutdown_connections 2024-04-25T09:14:30.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 --2- 172.21.15.173:0/2831719759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d3fff30 0x55ca6d400310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 --2- 172.21.15.173:0/2831719759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d44a240 0x55ca6d3ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 --2- 172.21.15.173:0/2831719759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d449920 0x55ca6d449d00 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 -- 172.21.15.173:0/2831719759 >> 172.21.15.173:0/2831719759 conn(0x55ca6d4062a0 msgr2=0x55ca6d3fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:30.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 -- 172.21.15.173:0/2831719759 shutdown_connections 2024-04-25T09:14:30.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 -- 172.21.15.173:0/2831719759 wait complete. 2024-04-25T09:14:30.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 -- start start 2024-04-25T09:14:30.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 Processor -- start 2024-04-25T09:14:30.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d3fff30 0x55ca6d450c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d449920 0x55ca6d4511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d44a240 0x55ca6d403aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6d209990 con 0x55ca6d44a240 2024-04-25T09:14:30.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6d24ae40 con 0x55ca6d3fff30 2024-04-25T09:14:30.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca6d1da900 con 0x55ca6d449920 2024-04-25T09:14:30.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 10 client.0 _ll_register_callbacks cb 0x55ca6d3021c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:14:30.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd67e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d44a240 0x55ca6d403aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd67400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d3fff30 0x55ca6d450c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd67e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d44a240 0x55ca6d403aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36112/0 (socket says 172.21.15.173:36112) 2024-04-25T09:14:30.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd67e00640 1 -- 172.21.15.173:0/3384433342 learned_addr learned my addr 172.21.15.173:0/3384433342 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:30.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd5ea00640 1 --2- 172.21.15.173:0/3384433342 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d449920 0x55ca6d4511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd67e00640 1 -- 172.21.15.173:0/3384433342 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d449920 msgr2=0x55ca6d4511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:30.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd67e00640 1 --2- 172.21.15.173:0/3384433342 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d449920 0x55ca6d4511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd67e00640 1 -- 172.21.15.173:0/3384433342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d3fff30 msgr2=0x55ca6d450c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:30.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd67e00640 1 --2- 172.21.15.173:0/3384433342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d3fff30 0x55ca6d450c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd67e00640 1 -- 172.21.15.173:0/3384433342 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca6d207630 con 0x55ca6d44a240 2024-04-25T09:14:30.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd67400640 1 --2- 172.21.15.173:0/3384433342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d3fff30 0x55ca6d450c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:30.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd67e00640 1 --2- 172.21.15.173:0/3384433342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d44a240 0x55ca6d403aa0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fcd600af040 tx=0x7fcd60004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff66ac4cdddd0d5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:30.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd54c00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:14:30.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd54c00640 1 -- 172.21.15.173:0/3384433342 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd600a5900 con 0x55ca6d44a240 2024-04-25T09:14:30.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd54c00640 1 -- 172.21.15.173:0/3384433342 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcd600a5aa0 con 0x55ca6d44a240 2024-04-25T09:14:30.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 -- 172.21.15.173:0/3384433342 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcd58082e50 con 0x55ca6d44a240 2024-04-25T09:14:30.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd54c00640 1 -- 172.21.15.173:0/3384433342 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd600a5ca0 con 0x55ca6d44a240 2024-04-25T09:14:30.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 10 client.10179 fetch_fsmap learned FSMap version 105 2024-04-25T09:14:30.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 -- 172.21.15.173:0/3384433342 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=2+}) v3 -- 0x55ca6d1d73a0 con 0x55ca6d44a240 2024-04-25T09:14:30.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd54c00640 1 -- 172.21.15.173:0/3384433342 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd58082e50 con 0x55ca6d44a240 2024-04-25T09:14:30.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd54c00640 1 -- 172.21.15.173:0/3384433342 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 105) v1 ==== 3282+0+0 (secure 0 0 0) 0x7fcd600b63f0 con 0x55ca6d44a240 2024-04-25T09:14:30.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 10 client.10179 fetch_fsmap finished waiting for FSMap version 105 2024-04-25T09:14:30.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 10 client.10179 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T09:14:30.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 20 client.10179 populate_metadata read hostname 'smithi173' 2024-04-25T09:14:30.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 --2- 172.21.15.173:0/3384433342 >> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] conn(0x55ca6d405160 0x55ca6d45ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 4 client.10179 mds_command: new command op to 9969 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:14:30.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.912+0000 7fcd71598000 1 -- 172.21.15.173:0/3384433342 --> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca6d1eaa50 con 0x55ca6d405160 2024-04-25T09:14:30.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.916+0000 7fcd67400640 1 --2- 172.21.15.173:0/3384433342 >> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] conn(0x55ca6d405160 0x55ca6d45ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.916+0000 7fcd67400640 1 --2- 172.21.15.173:0/3384433342 >> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] conn(0x55ca6d405160 0x55ca6d45ace0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df2531fc89585f84 server_cookie=e2409c7df6c52efd in_seq=0 out_seq=0 2024-04-25T09:14:30.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.916+0000 7fcd54c00640 10 client.10179 ms_handle_connect on v2:172.21.15.194:6833/3308916795 2024-04-25T09:14:30.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.916+0000 7fcd54c00640 1 -- 172.21.15.173:0/3384433342 <== mds.0 v2:172.21.15.194:6833/3308916795 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ca6d1eaa50 con 0x55ca6d405160 2024-04-25T09:14:30.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.916+0000 7fcd54c00640 10 client.10179 handle_command_reply: tid=0 2024-04-25T09:14:30.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.916+0000 7fcd71598000 1 client.10179 shutdown 2024-04-25T09:14:30.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.916+0000 7fcd71598000 1 -- 172.21.15.173:0/3384433342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d44a240 msgr2=0x55ca6d403aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.916+0000 7fcd71598000 1 --2- 172.21.15.173:0/3384433342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d44a240 0x55ca6d403aa0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fcd600af040 tx=0x7fcd60004a50 comp rx=0 tx=0).stop 2024-04-25T09:14:30.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.916+0000 7fcd71598000 1 -- 172.21.15.173:0/3384433342 shutdown_connections 2024-04-25T09:14:30.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.916+0000 7fcd71598000 1 --2- 172.21.15.173:0/3384433342 >> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] conn(0x55ca6d405160 0x55ca6d45ace0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.916+0000 7fcd71598000 1 --2- 172.21.15.173:0/3384433342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d44a240 0x55ca6d403aa0 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.916+0000 7fcd71598000 1 --2- 172.21.15.173:0/3384433342 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d449920 0x55ca6d4511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.916+0000 7fcd71598000 1 --2- 172.21.15.173:0/3384433342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d3fff30 0x55ca6d450c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.916+0000 7fcd54c00640 0 client.10179 ms_handle_reset on v2:172.21.15.194:6833/3308916795 2024-04-25T09:14:30.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.916+0000 7fcd71598000 1 -- 172.21.15.173:0/3384433342 >> 172.21.15.173:0/3384433342 conn(0x55ca6d4062a0 msgr2=0x55ca6d3fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:30.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.916+0000 7fcd71598000 1 -- 172.21.15.173:0/3384433342 shutdown_connections 2024-04-25T09:14:30.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.916+0000 7fcd71598000 1 -- 172.21.15.173:0/3384433342 wait complete. 2024-04-25T09:14:30.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.916+0000 7fcd71598000 20 client.10179 trim_cache size 0 max 16384 2024-04-25T09:14:30.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd71598000 1 Processor -- start 2024-04-25T09:14:30.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd71598000 1 -- start start 2024-04-25T09:14:30.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd71598000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d3fff30 0x55ca6d4a5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd71598000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d449920 0x55ca6d4a56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd71598000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d44a240 0x55ca6d4a5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd71598000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68203440 con 0x55ca6d449920 2024-04-25T09:14:30.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd71598000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd680b0340 con 0x55ca6d44a240 2024-04-25T09:14:30.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd71598000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd682020d0 con 0x55ca6d3fff30 2024-04-25T09:14:30.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd5ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d449920 0x55ca6d4a56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd5ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d449920 0x55ca6d4a56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36126/0 (socket says 172.21.15.173:36126) 2024-04-25T09:14:30.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd5ea00640 1 -- 172.21.15.173:0/1485857594 learned_addr learned my addr 172.21.15.173:0/1485857594 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:30.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd67e00640 1 --2- 172.21.15.173:0/1485857594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d44a240 0x55ca6d4a5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd67400640 1 --2- 172.21.15.173:0/1485857594 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d3fff30 0x55ca6d4a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd5ea00640 1 -- 172.21.15.173:0/1485857594 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d3fff30 msgr2=0x55ca6d4a5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:30.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd5ea00640 1 --2- 172.21.15.173:0/1485857594 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d3fff30 0x55ca6d4a5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd5ea00640 1 -- 172.21.15.173:0/1485857594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d44a240 msgr2=0x55ca6d4a5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:30.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd5ea00640 1 --2- 172.21.15.173:0/1485857594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d44a240 0x55ca6d4a5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd5ea00640 1 -- 172.21.15.173:0/1485857594 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca6d44a070 con 0x55ca6d449920 2024-04-25T09:14:30.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd5ea00640 1 --2- 172.21.15.173:0/1485857594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d449920 0x55ca6d4a56d0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fcd50004040 tx=0x7fcd50014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c2e626a41d39cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:30.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd57400640 1 -- 172.21.15.173:0/1485857594 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd50003a30 con 0x55ca6d449920 2024-04-25T09:14:30.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd57400640 1 -- 172.21.15.173:0/1485857594 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd50028070 con 0x55ca6d449920 2024-04-25T09:14:30.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd57400640 1 -- 172.21.15.173:0/1485857594 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd50003e10 con 0x55ca6d449920 2024-04-25T09:14:30.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd71598000 1 -- 172.21.15.173:0/1485857594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d449920 msgr2=0x55ca6d4a56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd71598000 1 --2- 172.21.15.173:0/1485857594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d449920 0x55ca6d4a56d0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fcd50004040 tx=0x7fcd50014000 comp rx=0 tx=0).stop 2024-04-25T09:14:30.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd71598000 1 -- 172.21.15.173:0/1485857594 shutdown_connections 2024-04-25T09:14:30.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd71598000 1 --2- 172.21.15.173:0/1485857594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d44a240 0x55ca6d4a5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd71598000 1 --2- 172.21.15.173:0/1485857594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d449920 0x55ca6d4a56d0 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd71598000 1 --2- 172.21.15.173:0/1485857594 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d3fff30 0x55ca6d4a5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.932+0000 7fcd71598000 1 -- 172.21.15.173:0/1485857594 >> 172.21.15.173:0/1485857594 conn(0x55ca6d4062a0 msgr2=0x55ca6d403220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:30.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 1 -- 172.21.15.173:0/1485857594 shutdown_connections 2024-04-25T09:14:30.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 1 -- 172.21.15.173:0/1485857594 wait complete. 2024-04-25T09:14:30.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 1 -- start start 2024-04-25T09:14:30.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 1 Processor -- start 2024-04-25T09:14:30.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d3fff30 0x55ca6d456150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d449920 0x55ca6d4aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d44a240 0x55ca6d4aace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6d2533d0 con 0x55ca6d44a240 2024-04-25T09:14:30.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6d30ad50 con 0x55ca6d449920 2024-04-25T09:14:30.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca6d1e9980 con 0x55ca6d3fff30 2024-04-25T09:14:30.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 10 client.0 _ll_register_callbacks cb 0x7fcd50009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:14:30.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd67e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d44a240 0x55ca6d4aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd67e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d44a240 0x55ca6d4aace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36130/0 (socket says 172.21.15.173:36130) 2024-04-25T09:14:30.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd67e00640 1 -- 172.21.15.173:0/3895324641 learned_addr learned my addr 172.21.15.173:0/3895324641 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:30.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd5ea00640 1 --2- 172.21.15.173:0/3895324641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d449920 0x55ca6d4aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd67400640 1 --2- 172.21.15.173:0/3895324641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d3fff30 0x55ca6d456150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd67e00640 1 -- 172.21.15.173:0/3895324641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d3fff30 msgr2=0x55ca6d456150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:30.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd67e00640 1 --2- 172.21.15.173:0/3895324641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d3fff30 0x55ca6d456150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd67e00640 1 -- 172.21.15.173:0/3895324641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d449920 msgr2=0x55ca6d4aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:30.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd67e00640 1 --2- 172.21.15.173:0/3895324641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d449920 0x55ca6d4aa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd67e00640 1 -- 172.21.15.173:0/3895324641 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca6d2d0600 con 0x55ca6d44a240 2024-04-25T09:14:30.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd67400640 1 --2- 172.21.15.173:0/3895324641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d3fff30 0x55ca6d456150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:30.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd67e00640 1 --2- 172.21.15.173:0/3895324641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d44a240 0x55ca6d4aace0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7fcd600093e0 tx=0x7fcd6001b1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed0047e9a6f0d71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:30.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd54c00640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-04-25T09:14:30.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd54c00640 1 -- 172.21.15.173:0/3895324641 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd600d4060 con 0x55ca6d44a240 2024-04-25T09:14:30.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd54c00640 1 -- 172.21.15.173:0/3895324641 <== mon.0 v2:172.21.15.173:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcd600039a0 con 0x55ca6d44a240 2024-04-25T09:14:30.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 1 -- 172.21.15.173:0/3895324641 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcd50028070 con 0x55ca6d44a240 2024-04-25T09:14:30.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd54c00640 1 -- 172.21.15.173:0/3895324641 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd600a5650 con 0x55ca6d44a240 2024-04-25T09:14:30.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 10 client.10185 fetch_fsmap learned FSMap version 105 2024-04-25T09:14:30.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 1 -- 172.21.15.173:0/3895324641 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=2+}) v3 -- 0x55ca6d1e39b0 con 0x55ca6d44a240 2024-04-25T09:14:30.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd54c00640 1 -- 172.21.15.173:0/3895324641 <== mon.0 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd50028070 con 0x55ca6d44a240 2024-04-25T09:14:30.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd54c00640 1 -- 172.21.15.173:0/3895324641 <== mon.0 v2:172.21.15.173:3300/0 5 ==== fsmap(e 105) v1 ==== 3282+0+0 (secure 0 0 0) 0x7fcd60008040 con 0x55ca6d44a240 2024-04-25T09:14:30.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 10 client.10185 fetch_fsmap finished waiting for FSMap version 105 2024-04-25T09:14:30.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 10 client.10185 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T09:14:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 20 client.10185 populate_metadata read hostname 'smithi173' 2024-04-25T09:14:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 1 --2- 172.21.15.173:0/3895324641 >> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] conn(0x55ca6d4ab220 0x55ca6d464760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 4 client.10185 mds_command: new command op to 9969 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:14:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.936+0000 7fcd71598000 1 -- 172.21.15.173:0/3895324641 --> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ca6d25c2e0 con 0x55ca6d4ab220 2024-04-25T09:14:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd67400640 1 --2- 172.21.15.173:0/3895324641 >> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] conn(0x55ca6d4ab220 0x55ca6d464760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd67400640 1 --2- 172.21.15.173:0/3895324641 >> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] conn(0x55ca6d4ab220 0x55ca6d464760 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2ad5b5efbe36be server_cookie=1e86ce53ce8d013f in_seq=0 out_seq=0 2024-04-25T09:14:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd54c00640 10 client.10185 ms_handle_connect on v2:172.21.15.194:6833/3308916795 2024-04-25T09:14:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd54c00640 1 -- 172.21.15.173:0/3895324641 <== mds.0 v2:172.21.15.194:6833/3308916795 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x55ca6d25c2e0 con 0x55ca6d4ab220 2024-04-25T09:14:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd54c00640 10 client.10185 handle_command_reply: tid=0 2024-04-25T09:14:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd71598000 1 client.10185 shutdown 2024-04-25T09:14:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd71598000 1 -- 172.21.15.173:0/3895324641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d44a240 msgr2=0x55ca6d4aace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd71598000 1 --2- 172.21.15.173:0/3895324641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d44a240 0x55ca6d4aace0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7fcd600093e0 tx=0x7fcd6001b1e0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd71598000 1 -- 172.21.15.173:0/3895324641 shutdown_connections 2024-04-25T09:14:30.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd71598000 1 --2- 172.21.15.173:0/3895324641 >> [v2:172.21.15.194:6833/3308916795,v1:172.21.15.194:6835/3308916795] conn(0x55ca6d4ab220 0x55ca6d464760 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd71598000 1 --2- 172.21.15.173:0/3895324641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca6d44a240 0x55ca6d4aace0 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd71598000 1 --2- 172.21.15.173:0/3895324641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca6d449920 0x55ca6d4aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd54c00640 0 client.10185 ms_handle_reset on v2:172.21.15.194:6833/3308916795 2024-04-25T09:14:30.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd71598000 1 --2- 172.21.15.173:0/3895324641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55ca6d3fff30 0x55ca6d456150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd71598000 1 -- 172.21.15.173:0/3895324641 >> 172.21.15.173:0/3895324641 conn(0x55ca6d4062a0 msgr2=0x55ca6d451870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:30.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd71598000 1 -- 172.21.15.173:0/3895324641 shutdown_connections 2024-04-25T09:14:30.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd71598000 1 -- 172.21.15.173:0/3895324641 wait complete. 2024-04-25T09:14:30.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd71598000 20 client.10185 trim_cache size 0 max 16384 2024-04-25T09:14:30.929 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:14:30.929 INFO:teuthology.orchestra.run.smithi173.stdout: "cluster_fsid": "ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6", 2024-04-25T09:14:30.930 INFO:teuthology.orchestra.run.smithi173.stdout: "whoami": 0, 2024-04-25T09:14:30.930 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 9969, 2024-04-25T09:14:30.930 INFO:teuthology.orchestra.run.smithi173.stdout: "want_state": "up:active", 2024-04-25T09:14:30.930 INFO:teuthology.orchestra.run.smithi173.stdout: "state": "up:active", 2024-04-25T09:14:30.930 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs", 2024-04-25T09:14:30.930 INFO:teuthology.orchestra.run.smithi173.stdout: "rank_uptime": 35.215415747999998, 2024-04-25T09:14:30.930 INFO:teuthology.orchestra.run.smithi173.stdout: "mdsmap_epoch": 105, 2024-04-25T09:14:30.930 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch": 144, 2024-04-25T09:14:30.930 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_epoch_barrier": 144, 2024-04-25T09:14:30.930 INFO:teuthology.orchestra.run.smithi173.stdout: "uptime": 40.118543017 2024-04-25T09:14:30.930 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:14:30.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd6e000640 1 -- 172.21.15.173:0/1725585060 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd44066f60 msgr2=0x7fcd44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd6e000640 1 --2- 172.21.15.173:0/1725585060 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd44066f60 0x7fcd44069420 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fcd6815a9a0 tx=0x7fcd50009190 comp rx=0 tx=0).stop 2024-04-25T09:14:30.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd6e000640 1 -- 172.21.15.173:0/1725585060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd680aeb90 msgr2=0x7fcd68144280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd6e000640 1 --2- 172.21.15.173:0/1725585060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd680aeb90 0x7fcd68144280 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800c370 tx=0x7fcd5800c830 comp rx=0 tx=0).stop 2024-04-25T09:14:30.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd6e000640 1 -- 172.21.15.173:0/1725585060 shutdown_connections 2024-04-25T09:14:30.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd6e000640 1 --2- 172.21.15.173:0/1725585060 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcd44066f60 0x7fcd44069420 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd6e000640 1 --2- 172.21.15.173:0/1725585060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd680cc7e0 0x7fcd6815cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd6e000640 1 --2- 172.21.15.173:0/1725585060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd680aef70 0x7fcd681546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd6e000640 1 --2- 172.21.15.173:0/1725585060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd680aeb90 0x7fcd68144280 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd6e000640 1 -- 172.21.15.173:0/1725585060 >> 172.21.15.173:0/1725585060 conn(0x7fcd6806ac90 msgr2=0x7fcd680cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:30.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd6e000640 1 -- 172.21.15.173:0/1725585060 shutdown_connections 2024-04-25T09:14:30.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:30.940+0000 7fcd6e000640 1 -- 172.21.15.173:0/1725585060 wait complete. 2024-04-25T09:14:30.944 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:14:30.944 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:14:31.006 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:14:31.096 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:14:31.097 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:14:31.097 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:31.106 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:14:31.106 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:31.155 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:14:31.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.348+0000 7f9a7b200640 1 Processor -- start 2024-04-25T09:14:31.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.348+0000 7f9a7b200640 1 -- start start 2024-04-25T09:14:31.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.352+0000 7f9a7b200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9a740b3e70 0x7f9a740b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.352+0000 7f9a7b200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9a7415edd0 0x7f9a740b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.352+0000 7f9a7b200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a740b4790 con 0x7f9a740aefa0 2024-04-25T09:14:31.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.352+0000 7f9a7b200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7406dd50 con 0x7f9a740b3e70 2024-04-25T09:14:31.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.352+0000 7f9a7b200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7415f320 con 0x7f9a7415edd0 2024-04-25T09:14:31.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.352+0000 7f9a73e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9a740b3e70 0x7f9a740b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.352+0000 7f9a73e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9a740b3e70 0x7f9a740b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36136/0 (socket says 172.21.15.173:36136) 2024-04-25T09:14:31.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.352+0000 7f9a73e00640 1 -- 172.21.15.173:0/946764672 learned_addr learned my addr 172.21.15.173:0/946764672 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:31.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.352+0000 7f9a79200640 1 --2- 172.21.15.173:0/946764672 >> v2:172.21.15.194:3300/0 conn(0x7f9a7415edd0 0x7f9a740b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.352+0000 7f9a73e00640 1 -- 172.21.15.173:0/946764672 >> v2:172.21.15.194:3300/0 conn(0x7f9a7415edd0 msgr2=0x7f9a740b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:31.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.352+0000 7f9a73e00640 1 --2- 172.21.15.173:0/946764672 >> v2:172.21.15.194:3300/0 conn(0x7f9a7415edd0 0x7f9a740b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.352+0000 7f9a73e00640 1 -- 172.21.15.173:0/946764672 >> v1:172.21.15.194:6789/0 conn(0x7f9a740aefa0 legacy=0x7f9a740b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:31.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.352+0000 7f9a73e00640 1 -- 172.21.15.173:0/946764672 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7406d420 con 0x7f9a740b3e70 2024-04-25T09:14:31.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.352+0000 7f9a79200640 1 --2- 172.21.15.173:0/946764672 >> v2:172.21.15.194:3300/0 conn(0x7f9a7415edd0 0x7f9a740b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:31.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.356+0000 7f9a73e00640 1 --2- 172.21.15.173:0/946764672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a740b3e70 0x7f9a740b4250 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f9a7406ef40 tx=0x7f9a6401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8c2245400cdf25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:31.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.356+0000 7f9a72a00640 1 -- 172.21.15.173:0/946764672 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a640a58a0 con 0x7f9a740b3e70 2024-04-25T09:14:31.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.356+0000 7f9a72a00640 1 -- 172.21.15.173:0/946764672 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a640a5a40 con 0x7f9a740b3e70 2024-04-25T09:14:31.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.356+0000 7f9a72a00640 1 -- 172.21.15.173:0/946764672 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a640a5e10 con 0x7f9a740b3e70 2024-04-25T09:14:31.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.356+0000 7f9a7b200640 1 -- 172.21.15.173:0/946764672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a740b3e70 msgr2=0x7f9a740b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:31.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.356+0000 7f9a7b200640 1 --2- 172.21.15.173:0/946764672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a740b3e70 0x7f9a740b4250 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f9a7406ef40 tx=0x7f9a6401c9c0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.356+0000 7f9a7b200640 1 -- 172.21.15.173:0/946764672 shutdown_connections 2024-04-25T09:14:31.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.356+0000 7f9a7b200640 1 --2- 172.21.15.173:0/946764672 >> v2:172.21.15.194:3300/0 conn(0x7f9a7415edd0 0x7f9a740b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.356+0000 7f9a7b200640 1 --2- 172.21.15.173:0/946764672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a740b3e70 0x7f9a740b4250 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.356+0000 7f9a7b200640 1 -- 172.21.15.173:0/946764672 >> 172.21.15.173:0/946764672 conn(0x7f9a7406ac90 msgr2=0x7f9a7406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:31.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.356+0000 7f9a7b200640 1 -- 172.21.15.173:0/946764672 shutdown_connections 2024-04-25T09:14:31.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.356+0000 7f9a7b200640 1 -- 172.21.15.173:0/946764672 wait complete. 2024-04-25T09:14:31.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.356+0000 7f9a7b200640 1 Processor -- start 2024-04-25T09:14:31.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.356+0000 7f9a7b200640 1 -- start start 2024-04-25T09:14:31.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.356+0000 7f9a7b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a740aefa0 0x7f9a7414d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a7b200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a740b3e70 0x7f9a74152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a7b200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a7415edd0 0x7f9a741530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a7b200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7406e1e0 con 0x7f9a740b3e70 2024-04-25T09:14:31.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a7b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7415aba0 con 0x7f9a740aefa0 2024-04-25T09:14:31.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a7b200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7406e360 con 0x7f9a7415edd0 2024-04-25T09:14:31.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a73400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a740b3e70 0x7f9a74152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a73400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a740b3e70 0x7f9a74152b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36148/0 (socket says 172.21.15.173:36148) 2024-04-25T09:14:31.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a73400640 1 -- 172.21.15.173:0/1016579537 learned_addr learned my addr 172.21.15.173:0/1016579537 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:31.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a73e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a740aefa0 0x7f9a7414d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a79200640 1 --2- 172.21.15.173:0/1016579537 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a7415edd0 0x7f9a741530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a73400640 1 -- 172.21.15.173:0/1016579537 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a7415edd0 msgr2=0x7f9a741530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:31.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a73400640 1 --2- 172.21.15.173:0/1016579537 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a7415edd0 0x7f9a741530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a73400640 1 -- 172.21.15.173:0/1016579537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a740aefa0 msgr2=0x7f9a7414d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:31.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a73400640 1 --2- 172.21.15.173:0/1016579537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a740aefa0 0x7f9a7414d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a73400640 1 -- 172.21.15.173:0/1016579537 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a74136eb0 con 0x7f9a740b3e70 2024-04-25T09:14:31.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a79200640 1 --2- 172.21.15.173:0/1016579537 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a7415edd0 0x7f9a741530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:31.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a73400640 1 --2- 172.21.15.173:0/1016579537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a740b3e70 0x7f9a74152b80 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000c3a0 tx=0x7f9a6000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:31.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a6be00640 1 -- 172.21.15.173:0/1016579537 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a600052d0 con 0x7f9a740b3e70 2024-04-25T09:14:31.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a6be00640 1 -- 172.21.15.173:0/1016579537 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a60005470 con 0x7f9a740b3e70 2024-04-25T09:14:31.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a6be00640 1 -- 172.21.15.173:0/1016579537 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60007260 con 0x7f9a740b3e70 2024-04-25T09:14:31.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a7b200640 1 -- 172.21.15.173:0/1016579537 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a74153600 con 0x7f9a740b3e70 2024-04-25T09:14:31.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a7b200640 1 -- 172.21.15.173:0/1016579537 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a74137430 con 0x7f9a740b3e70 2024-04-25T09:14:31.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a7b200640 1 -- 172.21.15.173:0/1016579537 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a74137630 con 0x7f9a740b3e70 2024-04-25T09:14:31.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.360+0000 7f9a6be00640 1 -- 172.21.15.173:0/1016579537 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9a60007400 con 0x7f9a740b3e70 2024-04-25T09:14:31.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.364+0000 7f9a6be00640 1 --2- 172.21.15.173:0/1016579537 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9a54066f60 0x7f9a54069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.364+0000 7f9a6be00640 1 -- 172.21.15.173:0/1016579537 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9a600845b0 con 0x7f9a740b3e70 2024-04-25T09:14:31.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.364+0000 7f9a73e00640 1 --2- 172.21.15.173:0/1016579537 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9a54066f60 0x7f9a54069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.364+0000 7f9a73e00640 1 --2- 172.21.15.173:0/1016579537 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9a54066f60 0x7f9a54069420 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f9a640ae000 tx=0x7f9a640a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:31.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.368+0000 7f9a6be00640 1 -- 172.21.15.173:0/1016579537 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9a74137630 con 0x7f9a740b3e70 2024-04-25T09:14:31.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.524+0000 7f9a7b200640 1 -- 172.21.15.173:0/1016579537 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a74073a40 con 0x7f9a740b3e70 2024-04-25T09:14:31.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.524+0000 7f9a6be00640 1 -- 172.21.15.173:0/1016579537 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+16952 (secure 0 0 0) 0x7f9a60054dd0 con 0x7f9a740b3e70 2024-04-25T09:14:31.511 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:31.511 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":144,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:13:56.711320+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:13:53.493356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-04-25T09:13:54.078507+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:14:31.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.528+0000 7f9a7b200640 1 -- 172.21.15.173:0/1016579537 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9a54066f60 msgr2=0x7f9a54069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:31.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.528+0000 7f9a7b200640 1 --2- 172.21.15.173:0/1016579537 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9a54066f60 0x7f9a54069420 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f9a640ae000 tx=0x7f9a640a7070 comp rx=0 tx=0).stop 2024-04-25T09:14:31.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.528+0000 7f9a7b200640 1 -- 172.21.15.173:0/1016579537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a740b3e70 msgr2=0x7f9a74152b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:31.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.528+0000 7f9a7b200640 1 --2- 172.21.15.173:0/1016579537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a740b3e70 0x7f9a74152b80 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000c3a0 tx=0x7f9a6000c860 comp rx=0 tx=0).stop 2024-04-25T09:14:31.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.528+0000 7f9a7b200640 1 -- 172.21.15.173:0/1016579537 shutdown_connections 2024-04-25T09:14:31.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.528+0000 7f9a7b200640 1 --2- 172.21.15.173:0/1016579537 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9a54066f60 0x7f9a54069420 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.528+0000 7f9a7b200640 1 --2- 172.21.15.173:0/1016579537 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a7415edd0 0x7f9a741530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.528+0000 7f9a7b200640 1 --2- 172.21.15.173:0/1016579537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a740b3e70 0x7f9a74152b80 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.528+0000 7f9a7b200640 1 --2- 172.21.15.173:0/1016579537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a740aefa0 0x7f9a7414d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.528+0000 7f9a7b200640 1 -- 172.21.15.173:0/1016579537 >> 172.21.15.173:0/1016579537 conn(0x7f9a7406ac90 msgr2=0x7f9a7415cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:31.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.528+0000 7f9a7b200640 1 -- 172.21.15.173:0/1016579537 shutdown_connections 2024-04-25T09:14:31.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.528+0000 7f9a7b200640 1 -- 172.21.15.173:0/1016579537 wait complete. 2024-04-25T09:14:31.532 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:13:53.493356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:13:54.078507+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '144', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:14:31.532 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:14:31.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.684+0000 7fd01ae00640 1 Processor -- start 2024-04-25T09:14:31.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.684+0000 7fd01ae00640 1 -- start start 2024-04-25T09:14:31.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd01ae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd014145290 0x7fd01415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd01ae00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd0140b3fe0 0x7fd0140b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd01ae00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01415c5f0 con 0x7fd0140cc260 2024-04-25T09:14:31.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd01ae00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01406d4b0 con 0x7fd0140b3fe0 2024-04-25T09:14:31.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd01ae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01406d790 con 0x7fd014145290 2024-04-25T09:14:31.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd018e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd0140cc260 0x7fd0140cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44522/0 (socket says 172.21.15.173:44522) 2024-04-25T09:14:31.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd018e00640 1 -- 172.21.15.173:0/3747080432 learned_addr learned my addr 172.21.15.173:0/3747080432 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:31.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd00b400640 1 --2- 172.21.15.173:0/3747080432 >> v2:172.21.15.194:3300/0 conn(0x7fd0140b3fe0 0x7fd0140b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013e00640 1 --2- 172.21.15.173:0/3747080432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd014145290 0x7fd01415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013400640 1 -- 172.21.15.173:0/3747080432 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927498796 0 0) 0x7fd00c001120 con 0x7fd0140cc260 2024-04-25T09:14:31.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013400640 1 -- 172.21.15.173:0/3747080432 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcff8003530 con 0x7fd0140cc260 2024-04-25T09:14:31.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013400640 1 -- 172.21.15.173:0/3747080432 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1367587211 0 0) 0x7fcff8003530 con 0x7fd0140cc260 2024-04-25T09:14:31.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013400640 1 -- 172.21.15.173:0/3747080432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd014145290 msgr2=0x7fd01415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:31.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013400640 1 --2- 172.21.15.173:0/3747080432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd014145290 0x7fd01415c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013400640 1 -- 172.21.15.173:0/3747080432 >> v2:172.21.15.194:3300/0 conn(0x7fd0140b3fe0 msgr2=0x7fd0140b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:31.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013400640 1 --2- 172.21.15.173:0/3747080432 >> v2:172.21.15.194:3300/0 conn(0x7fd0140b3fe0 0x7fd0140b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013400640 1 -- 172.21.15.173:0/3747080432 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01406da70 con 0x7fd0140cc260 2024-04-25T09:14:31.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013400640 1 -- 172.21.15.173:0/3747080432 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fd00c001850 con 0x7fd0140cc260 2024-04-25T09:14:31.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013400640 1 -- 172.21.15.173:0/3747080432 >> v1:172.21.15.173:6789/0 conn(0x7fd0140cc260 legacy=0x7fd0140cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:31.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013400640 1 --2- 172.21.15.173:0/3747080432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff80039c0 0x7fcff8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013400640 1 --2- 172.21.15.173:0/3747080432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd014145290 0x7fcff8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013400640 1 --2- 172.21.15.173:0/3747080432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcff8004d50 0x7fcff80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013400640 1 -- 172.21.15.173:0/3747080432 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01406d4b0 con 0x7fcff80039c0 2024-04-25T09:14:31.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013400640 1 -- 172.21.15.173:0/3747080432 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01406d790 con 0x7fcff8004d50 2024-04-25T09:14:31.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013400640 1 -- 172.21.15.173:0/3747080432 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff800baa0 con 0x7fd014145290 2024-04-25T09:14:31.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013e00640 1 --2- 172.21.15.173:0/3747080432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff80039c0 0x7fcff8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd00b400640 1 --2- 172.21.15.173:0/3747080432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd014145290 0x7fcff8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd018e00640 1 --2- 172.21.15.173:0/3747080432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcff8004d50 0x7fcff80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013e00640 1 -- 172.21.15.173:0/3747080432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd014145290 msgr2=0x7fcff8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:31.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013e00640 1 --2- 172.21.15.173:0/3747080432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd014145290 0x7fcff8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013e00640 1 -- 172.21.15.173:0/3747080432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcff8004d50 msgr2=0x7fcff80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:31.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013e00640 1 --2- 172.21.15.173:0/3747080432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcff8004d50 0x7fcff80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd013e00640 1 -- 172.21.15.173:0/3747080432 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff8003530 con 0x7fcff80039c0 2024-04-25T09:14:31.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.688+0000 7fd00b400640 1 --2- 172.21.15.173:0/3747080432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd014145290 0x7fcff8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:31.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.692+0000 7fd013e00640 1 --2- 172.21.15.173:0/3747080432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff80039c0 0x7fcff8003de0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fd004009fc0 tx=0x7fd00401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a438f06e9b8ac16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:31.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.692+0000 7fd013400640 1 -- 172.21.15.173:0/3747080432 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0040b2070 con 0x7fcff80039c0 2024-04-25T09:14:31.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.692+0000 7fd013400640 1 -- 172.21.15.173:0/3747080432 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0040a5b80 con 0x7fcff80039c0 2024-04-25T09:14:31.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.692+0000 7fd013400640 1 -- 172.21.15.173:0/3747080432 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004009c10 con 0x7fcff80039c0 2024-04-25T09:14:31.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.692+0000 7fd01ae00640 1 -- 172.21.15.173:0/3747080432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff80039c0 msgr2=0x7fcff8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:31.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.692+0000 7fd01ae00640 1 --2- 172.21.15.173:0/3747080432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff80039c0 0x7fcff8003de0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fd004009fc0 tx=0x7fd00401cc80 comp rx=0 tx=0).stop 2024-04-25T09:14:31.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.692+0000 7fd018e00640 1 -- 172.21.15.173:0/3747080432 reap_dead start 2024-04-25T09:14:31.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.692+0000 7fd01ae00640 1 -- 172.21.15.173:0/3747080432 shutdown_connections 2024-04-25T09:14:31.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.692+0000 7fd01ae00640 1 -- 172.21.15.173:0/3747080432 >> 172.21.15.173:0/3747080432 conn(0x7fd01406ac90 msgr2=0x7fd01406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:31.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.692+0000 7fd01ae00640 1 -- 172.21.15.173:0/3747080432 shutdown_connections 2024-04-25T09:14:31.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.692+0000 7fd01ae00640 1 -- 172.21.15.173:0/3747080432 wait complete. 2024-04-25T09:14:31.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.692+0000 7fd01ae00640 1 Processor -- start 2024-04-25T09:14:31.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.692+0000 7fd01ae00640 1 -- start start 2024-04-25T09:14:31.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd01ae00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff80039c0 0x7fd0140ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd01ae00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd014140a20 0x7fd0141f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd01ae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0140adf00 0x7fd0140ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd01ae00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01406eee0 con 0x7fcff80039c0 2024-04-25T09:14:31.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd01ae00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01406ed60 con 0x7fd014140a20 2024-04-25T09:14:31.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd01ae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01406f060 con 0x7fd0140adf00 2024-04-25T09:14:31.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd013e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff80039c0 0x7fd0140ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd013e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff80039c0 0x7fd0140ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36164/0 (socket says 172.21.15.173:36164) 2024-04-25T09:14:31.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd013e00640 1 -- 172.21.15.173:0/1815156973 learned_addr learned my addr 172.21.15.173:0/1815156973 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:31.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd00b400640 1 --2- 172.21.15.173:0/1815156973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd014140a20 0x7fd0141f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd018e00640 1 --2- 172.21.15.173:0/1815156973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0140adf00 0x7fd0140ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd013e00640 1 -- 172.21.15.173:0/1815156973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0140adf00 msgr2=0x7fd0140ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:31.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd013e00640 1 --2- 172.21.15.173:0/1815156973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0140adf00 0x7fd0140ae390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd013e00640 1 -- 172.21.15.173:0/1815156973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd014140a20 msgr2=0x7fd0141f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:31.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd013e00640 1 --2- 172.21.15.173:0/1815156973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd014140a20 0x7fd0141f75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd013e00640 1 -- 172.21.15.173:0/1815156973 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0140ad600 con 0x7fcff80039c0 2024-04-25T09:14:31.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd00b400640 1 --2- 172.21.15.173:0/1815156973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd014140a20 0x7fd0141f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:31.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd018e00640 1 --2- 172.21.15.173:0/1815156973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0140adf00 0x7fd0140ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:31.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd013e00640 1 --2- 172.21.15.173:0/1815156973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff80039c0 0x7fd0140ce7c0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fd0040b0040 tx=0x7fd004009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:31.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd010c00640 1 -- 172.21.15.173:0/1815156973 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0040b2040 con 0x7fcff80039c0 2024-04-25T09:14:31.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd010c00640 1 -- 172.21.15.173:0/1815156973 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0040a5980 con 0x7fcff80039c0 2024-04-25T09:14:31.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd010c00640 1 -- 172.21.15.173:0/1815156973 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0040adbe0 con 0x7fcff80039c0 2024-04-25T09:14:31.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd01ae00640 1 -- 172.21.15.173:0/1815156973 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0140cd720 con 0x7fcff80039c0 2024-04-25T09:14:31.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd01ae00640 1 -- 172.21.15.173:0/1815156973 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0140cdce0 con 0x7fcff80039c0 2024-04-25T09:14:31.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd01ae00640 1 -- 172.21.15.173:0/1815156973 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd014073ab0 con 0x7fcff80039c0 2024-04-25T09:14:31.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.696+0000 7fd010c00640 1 -- 172.21.15.173:0/1815156973 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd0040bf030 con 0x7fcff80039c0 2024-04-25T09:14:31.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.700+0000 7fd010c00640 1 --2- 172.21.15.173:0/1815156973 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcff0066f90 0x7fcff0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.700+0000 7fd010c00640 1 -- 172.21.15.173:0/1815156973 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd00411f400 con 0x7fcff80039c0 2024-04-25T09:14:31.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.700+0000 7fd00b400640 1 --2- 172.21.15.173:0/1815156973 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcff0066f90 0x7fcff0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.700+0000 7fd00b400640 1 --2- 172.21.15.173:0/1815156973 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcff0066f90 0x7fcff0069450 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fd0141fa210 tx=0x7fcffc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:31.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.704+0000 7fd010c00640 1 -- 172.21.15.173:0/1815156973 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd0040c6060 con 0x7fcff80039c0 2024-04-25T09:14:31.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.860+0000 7fd01ae00640 1 -- 172.21.15.173:0/1815156973 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0140ced00 con 0x7fcff80039c0 2024-04-25T09:14:31.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.860+0000 7fd010c00640 1 -- 172.21.15.173:0/1815156973 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v144) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd004016990 con 0x7fcff80039c0 2024-04-25T09:14:31.845 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:14:31.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.860+0000 7fd01ae00640 1 -- 172.21.15.173:0/1815156973 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcff0066f90 msgr2=0x7fcff0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:31.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.860+0000 7fd01ae00640 1 --2- 172.21.15.173:0/1815156973 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcff0066f90 0x7fcff0069450 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fd0141fa210 tx=0x7fcffc008040 comp rx=0 tx=0).stop 2024-04-25T09:14:31.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.860+0000 7fd01ae00640 1 -- 172.21.15.173:0/1815156973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff80039c0 msgr2=0x7fd0140ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:31.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.860+0000 7fd01ae00640 1 --2- 172.21.15.173:0/1815156973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff80039c0 0x7fd0140ce7c0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fd0040b0040 tx=0x7fd004009750 comp rx=0 tx=0).stop 2024-04-25T09:14:31.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.860+0000 7fd01ae00640 1 -- 172.21.15.173:0/1815156973 shutdown_connections 2024-04-25T09:14:31.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.860+0000 7fd01ae00640 1 --2- 172.21.15.173:0/1815156973 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fcff0066f90 0x7fcff0069450 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.860+0000 7fd01ae00640 1 --2- 172.21.15.173:0/1815156973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0140adf00 0x7fd0140ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.860+0000 7fd01ae00640 1 --2- 172.21.15.173:0/1815156973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd014140a20 0x7fd0141f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.860+0000 7fd01ae00640 1 --2- 172.21.15.173:0/1815156973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff80039c0 0x7fd0140ce7c0 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.860+0000 7fd01ae00640 1 -- 172.21.15.173:0/1815156973 >> 172.21.15.173:0/1815156973 conn(0x7fd01406ac90 msgr2=0x7fd0140af5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:31.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.860+0000 7fd01ae00640 1 -- 172.21.15.173:0/1815156973 shutdown_connections 2024-04-25T09:14:31.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:31.860+0000 7fd01ae00640 1 -- 172.21.15.173:0/1815156973 wait complete. 2024-04-25T09:14:31.866 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:14:32.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.020+0000 7fdf91800640 1 Processor -- start 2024-04-25T09:14:32.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.020+0000 7fdf91800640 1 -- start start 2024-04-25T09:14:32.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.020+0000 7fdf91800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdf8c0b3fe0 0x7fdf8c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.020+0000 7fdf91800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdf8c0cc260 0x7fdf8c0cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.020+0000 7fdf91800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8c06d4b0 con 0x7fdf8c145290 2024-04-25T09:14:32.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.020+0000 7fdf91800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c06d790 con 0x7fdf8c0cc260 2024-04-25T09:14:32.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.020+0000 7fdf91800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c06da70 con 0x7fdf8c0b3fe0 2024-04-25T09:14:32.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.020+0000 7fdf8b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdf8c0cc260 0x7fdf8c0cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.020+0000 7fdf8b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdf8c0cc260 0x7fdf8c0cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36168/0 (socket says 172.21.15.173:36168) 2024-04-25T09:14:32.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.020+0000 7fdf8b400640 1 -- 172.21.15.173:0/1227663139 learned_addr learned my addr 172.21.15.173:0/1227663139 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:32.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.020+0000 7fdf8a000640 1 --2- 172.21.15.173:0/1227663139 >> v2:172.21.15.194:3300/0 conn(0x7fdf8c0b3fe0 0x7fdf8c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.020+0000 7fdf8b400640 1 -- 172.21.15.173:0/1227663139 >> v2:172.21.15.194:3300/0 conn(0x7fdf8c0b3fe0 msgr2=0x7fdf8c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:32.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.020+0000 7fdf8b400640 1 --2- 172.21.15.173:0/1227663139 >> v2:172.21.15.194:3300/0 conn(0x7fdf8c0b3fe0 0x7fdf8c0b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.020+0000 7fdf8b400640 1 -- 172.21.15.173:0/1227663139 >> v1:172.21.15.194:6789/0 conn(0x7fdf8c145290 legacy=0x7fdf8c15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.020+0000 7fdf8b400640 1 -- 172.21.15.173:0/1227663139 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c06dd50 con 0x7fdf8c0cc260 2024-04-25T09:14:32.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.024+0000 7fdf8b400640 1 --2- 172.21.15.173:0/1227663139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf8c0cc260 0x7fdf8c0cc670 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c071100 tx=0x7fdf8401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285120202ae455e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:32.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.024+0000 7fdf89600640 1 -- 172.21.15.173:0/1227663139 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf840a56a0 con 0x7fdf8c0cc260 2024-04-25T09:14:32.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.024+0000 7fdf89600640 1 -- 172.21.15.173:0/1227663139 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf840a5840 con 0x7fdf8c0cc260 2024-04-25T09:14:32.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.024+0000 7fdf89600640 1 -- 172.21.15.173:0/1227663139 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf840a5c10 con 0x7fdf8c0cc260 2024-04-25T09:14:32.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.024+0000 7fdf91800640 1 -- 172.21.15.173:0/1227663139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf8c0cc260 msgr2=0x7fdf8c0cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.024+0000 7fdf91800640 1 --2- 172.21.15.173:0/1227663139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf8c0cc260 0x7fdf8c0cc670 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c071100 tx=0x7fdf8401c8d0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.024+0000 7fdf91800640 1 -- 172.21.15.173:0/1227663139 shutdown_connections 2024-04-25T09:14:32.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.024+0000 7fdf91800640 1 --2- 172.21.15.173:0/1227663139 >> v2:172.21.15.194:3300/0 conn(0x7fdf8c0b3fe0 0x7fdf8c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.024+0000 7fdf91800640 1 --2- 172.21.15.173:0/1227663139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf8c0cc260 0x7fdf8c0cc670 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.024+0000 7fdf91800640 1 -- 172.21.15.173:0/1227663139 >> 172.21.15.173:0/1227663139 conn(0x7fdf8c06ac90 msgr2=0x7fdf8c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:32.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.024+0000 7fdf91800640 1 -- 172.21.15.173:0/1227663139 shutdown_connections 2024-04-25T09:14:32.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.024+0000 7fdf91800640 1 -- 172.21.15.173:0/1227663139 wait complete. 2024-04-25T09:14:32.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf91800640 1 Processor -- start 2024-04-25T09:14:32.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf91800640 1 -- start start 2024-04-25T09:14:32.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf91800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf8c0b3fe0 0x7fdf8c13e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf91800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf8c0cc260 0x7fdf8c0ce300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf91800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf8c145290 0x7fdf8c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf91800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c06eee0 con 0x7fdf8c145290 2024-04-25T09:14:32.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf91800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c06ed60 con 0x7fdf8c0b3fe0 2024-04-25T09:14:32.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf91800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c06f060 con 0x7fdf8c0cc260 2024-04-25T09:14:32.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf8b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf8c145290 0x7fdf8c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf8b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf8c145290 0x7fdf8c0ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36174/0 (socket says 172.21.15.173:36174) 2024-04-25T09:14:32.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf8b400640 1 -- 172.21.15.173:0/3058542625 learned_addr learned my addr 172.21.15.173:0/3058542625 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:32.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf8aa00640 1 --2- 172.21.15.173:0/3058542625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf8c0b3fe0 0x7fdf8c13e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf8a000640 1 --2- 172.21.15.173:0/3058542625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf8c0cc260 0x7fdf8c0ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf8b400640 1 -- 172.21.15.173:0/3058542625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf8c0cc260 msgr2=0x7fdf8c0ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf8b400640 1 --2- 172.21.15.173:0/3058542625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf8c0cc260 0x7fdf8c0ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf8b400640 1 -- 172.21.15.173:0/3058542625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf8c0b3fe0 msgr2=0x7fdf8c13e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf8b400640 1 --2- 172.21.15.173:0/3058542625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf8c0b3fe0 0x7fdf8c13e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf8b400640 1 -- 172.21.15.173:0/3058542625 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c0cd540 con 0x7fdf8c145290 2024-04-25T09:14:32.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf8aa00640 1 --2- 172.21.15.173:0/3058542625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf8c0b3fe0 0x7fdf8c13e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:32.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf8b400640 1 --2- 172.21.15.173:0/3058542625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf8c145290 0x7fdf8c0ce840 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fdf840af040 tx=0x7fdf84019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:32.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf82a00640 1 -- 172.21.15.173:0/3058542625 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf840bc030 con 0x7fdf8c145290 2024-04-25T09:14:32.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf82a00640 1 -- 172.21.15.173:0/3058542625 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf840b8470 con 0x7fdf8c145290 2024-04-25T09:14:32.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf82a00640 1 -- 172.21.15.173:0/3058542625 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84009510 con 0x7fdf8c145290 2024-04-25T09:14:32.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf91800640 1 -- 172.21.15.173:0/3058542625 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c0cd820 con 0x7fdf8c145290 2024-04-25T09:14:32.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf91800640 1 -- 172.21.15.173:0/3058542625 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c0cdde0 con 0x7fdf8c145290 2024-04-25T09:14:32.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.028+0000 7fdf91800640 1 -- 172.21.15.173:0/3058542625 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8c073ab0 con 0x7fdf8c145290 2024-04-25T09:14:32.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.032+0000 7fdf82a00640 1 -- 172.21.15.173:0/3058542625 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdf840bf070 con 0x7fdf8c145290 2024-04-25T09:14:32.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.032+0000 7fdf82a00640 1 --2- 172.21.15.173:0/3058542625 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdf6c066f60 0x7fdf6c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.032+0000 7fdf82a00640 1 -- 172.21.15.173:0/3058542625 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdf8411fc30 con 0x7fdf8c145290 2024-04-25T09:14:32.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.032+0000 7fdf8aa00640 1 --2- 172.21.15.173:0/3058542625 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdf6c066f60 0x7fdf6c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.032+0000 7fdf8aa00640 1 --2- 172.21.15.173:0/3058542625 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdf6c066f60 0x7fdf6c069420 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c001670 tx=0x7fdf7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:32.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.036+0000 7fdf82a00640 1 -- 172.21.15.173:0/3058542625 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdf840c6070 con 0x7fdf8c145290 2024-04-25T09:14:32.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.188+0000 7fdf91800640 1 -- 172.21.15.173:0/3058542625 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf8c0aef70 con 0x7fdf8c145290 2024-04-25T09:14:32.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.188+0000 7fdf82a00640 1 -- 172.21.15.173:0/3058542625 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v144) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdf840165e0 con 0x7fdf8c145290 2024-04-25T09:14:32.175 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:14:32.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.192+0000 7fdf91800640 1 -- 172.21.15.173:0/3058542625 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdf6c066f60 msgr2=0x7fdf6c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.192+0000 7fdf91800640 1 --2- 172.21.15.173:0/3058542625 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdf6c066f60 0x7fdf6c069420 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c001670 tx=0x7fdf7c009040 comp rx=0 tx=0).stop 2024-04-25T09:14:32.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.192+0000 7fdf91800640 1 -- 172.21.15.173:0/3058542625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf8c145290 msgr2=0x7fdf8c0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.192+0000 7fdf91800640 1 --2- 172.21.15.173:0/3058542625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf8c145290 0x7fdf8c0ce840 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fdf840af040 tx=0x7fdf84019670 comp rx=0 tx=0).stop 2024-04-25T09:14:32.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.192+0000 7fdf91800640 1 -- 172.21.15.173:0/3058542625 shutdown_connections 2024-04-25T09:14:32.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.192+0000 7fdf91800640 1 --2- 172.21.15.173:0/3058542625 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fdf6c066f60 0x7fdf6c069420 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.192+0000 7fdf91800640 1 --2- 172.21.15.173:0/3058542625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf8c145290 0x7fdf8c0ce840 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.192+0000 7fdf91800640 1 --2- 172.21.15.173:0/3058542625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf8c0cc260 0x7fdf8c0ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.192+0000 7fdf91800640 1 --2- 172.21.15.173:0/3058542625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf8c0b3fe0 0x7fdf8c13e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.192+0000 7fdf91800640 1 -- 172.21.15.173:0/3058542625 >> 172.21.15.173:0/3058542625 conn(0x7fdf8c06ac90 msgr2=0x7fdf8c1444b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:32.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.192+0000 7fdf91800640 1 -- 172.21.15.173:0/3058542625 shutdown_connections 2024-04-25T09:14:32.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.192+0000 7fdf91800640 1 -- 172.21.15.173:0/3058542625 wait complete. 2024-04-25T09:14:32.195 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:14:32.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.348+0000 7fba62400640 1 Processor -- start 2024-04-25T09:14:32.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.348+0000 7fba62400640 1 -- start start 2024-04-25T09:14:32.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.348+0000 7fba62400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fba5c1594e0 0x7fba5c0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.348+0000 7fba62400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fba5c071580 0x7fba5c15bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.348+0000 7fba62400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5c15cbd0 con 0x7fba5c0cf360 2024-04-25T09:14:32.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.348+0000 7fba62400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5c0ce990 con 0x7fba5c1594e0 2024-04-25T09:14:32.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.348+0000 7fba62400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5c15ceb0 con 0x7fba5c071580 2024-04-25T09:14:32.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.348+0000 7fba5aa00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fba5c0cf360 0x7fba5c070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44528/0 (socket says 172.21.15.173:44528) 2024-04-25T09:14:32.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.348+0000 7fba5aa00640 1 -- 172.21.15.173:0/601898975 learned_addr learned my addr 172.21.15.173:0/601898975 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:32.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.348+0000 7fba5b400640 1 --2- 172.21.15.173:0/601898975 >> v2:172.21.15.173:3300/0 conn(0x7fba5c1594e0 0x7fba5c0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.348+0000 7fba5be00640 1 --2- 172.21.15.173:0/601898975 >> v2:172.21.15.194:3300/0 conn(0x7fba5c071580 0x7fba5c15bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.348+0000 7fba5b400640 1 -- 172.21.15.173:0/601898975 >> v2:172.21.15.194:3300/0 conn(0x7fba5c071580 msgr2=0x7fba5c15bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:32.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.348+0000 7fba5b400640 1 --2- 172.21.15.173:0/601898975 >> v2:172.21.15.194:3300/0 conn(0x7fba5c071580 0x7fba5c15bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.348+0000 7fba5b400640 1 -- 172.21.15.173:0/601898975 >> v1:172.21.15.173:6789/0 conn(0x7fba5c0cf360 legacy=0x7fba5c070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.348+0000 7fba5b400640 1 -- 172.21.15.173:0/601898975 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c0ce340 con 0x7fba5c1594e0 2024-04-25T09:14:32.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.348+0000 7fba5a000640 1 -- 172.21.15.173:0/601898975 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306040877 0 0) 0x7fba5c15cbd0 con 0x7fba5c0cf360 2024-04-25T09:14:32.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.352+0000 7fba5b400640 1 --2- 172.21.15.173:0/601898975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba5c1594e0 0x7fba5c0cee20 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7fba5c070620 tx=0x7fba4c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3780cbb17377720a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:32.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.352+0000 7fba5a000640 1 -- 172.21.15.173:0/601898975 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0b0070 con 0x7fba5c1594e0 2024-04-25T09:14:32.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.352+0000 7fba5a000640 1 -- 172.21.15.173:0/601898975 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c0ab600 con 0x7fba5c1594e0 2024-04-25T09:14:32.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.352+0000 7fba5a000640 1 -- 172.21.15.173:0/601898975 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0ab9d0 con 0x7fba5c1594e0 2024-04-25T09:14:32.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.352+0000 7fba62400640 1 -- 172.21.15.173:0/601898975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba5c1594e0 msgr2=0x7fba5c0cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.352+0000 7fba62400640 1 --2- 172.21.15.173:0/601898975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba5c1594e0 0x7fba5c0cee20 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7fba5c070620 tx=0x7fba4c01c3c0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.352+0000 7fba62400640 1 -- 172.21.15.173:0/601898975 shutdown_connections 2024-04-25T09:14:32.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.352+0000 7fba62400640 1 --2- 172.21.15.173:0/601898975 >> v2:172.21.15.194:3300/0 conn(0x7fba5c071580 0x7fba5c15bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.352+0000 7fba62400640 1 --2- 172.21.15.173:0/601898975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba5c1594e0 0x7fba5c0cee20 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.352+0000 7fba62400640 1 -- 172.21.15.173:0/601898975 >> 172.21.15.173:0/601898975 conn(0x7fba5c0b3540 msgr2=0x7fba5c0b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:32.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.352+0000 7fba62400640 1 -- 172.21.15.173:0/601898975 shutdown_connections 2024-04-25T09:14:32.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.352+0000 7fba62400640 1 -- 172.21.15.173:0/601898975 wait complete. 2024-04-25T09:14:32.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba62400640 1 Processor -- start 2024-04-25T09:14:32.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba62400640 1 -- start start 2024-04-25T09:14:32.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba62400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba5c071580 0x7fba5c154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba62400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba5c1594e0 0x7fba5c1f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba62400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba5c1f7180 0x7fba5c157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba62400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c1688f0 con 0x7fba5c071580 2024-04-25T09:14:32.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba62400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c168770 con 0x7fba5c1594e0 2024-04-25T09:14:32.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba62400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c168a70 con 0x7fba5c1f7180 2024-04-25T09:14:32.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba5b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba5c071580 0x7fba5c154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba5b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba5c071580 0x7fba5c154040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36186/0 (socket says 172.21.15.173:36186) 2024-04-25T09:14:32.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba5b400640 1 -- 172.21.15.173:0/907364685 learned_addr learned my addr 172.21.15.173:0/907364685 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:32.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba5aa00640 1 --2- 172.21.15.173:0/907364685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba5c1594e0 0x7fba5c1f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba5be00640 1 --2- 172.21.15.173:0/907364685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba5c1f7180 0x7fba5c157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba5b400640 1 -- 172.21.15.173:0/907364685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba5c1f7180 msgr2=0x7fba5c157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba5b400640 1 --2- 172.21.15.173:0/907364685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba5c1f7180 0x7fba5c157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba5b400640 1 -- 172.21.15.173:0/907364685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba5c1594e0 msgr2=0x7fba5c1f6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba5b400640 1 --2- 172.21.15.173:0/907364685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba5c1594e0 0x7fba5c1f6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba5b400640 1 -- 172.21.15.173:0/907364685 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c156000 con 0x7fba5c071580 2024-04-25T09:14:32.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba5b400640 1 --2- 172.21.15.173:0/907364685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba5c071580 0x7fba5c154040 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7fba4c018fd0 tx=0x7fba4c01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:32.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba53400640 1 -- 172.21.15.173:0/907364685 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0b0040 con 0x7fba5c071580 2024-04-25T09:14:32.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba53400640 1 -- 172.21.15.173:0/907364685 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c004020 con 0x7fba5c071580 2024-04-25T09:14:32.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba62400640 1 -- 172.21.15.173:0/907364685 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5c1562e0 con 0x7fba5c071580 2024-04-25T09:14:32.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba53400640 1 -- 172.21.15.173:0/907364685 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c006e20 con 0x7fba5c071580 2024-04-25T09:14:32.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.356+0000 7fba62400640 1 -- 172.21.15.173:0/907364685 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba5c1568a0 con 0x7fba5c071580 2024-04-25T09:14:32.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.360+0000 7fba62400640 1 -- 172.21.15.173:0/907364685 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba5c073ab0 con 0x7fba5c071580 2024-04-25T09:14:32.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.360+0000 7fba53400640 1 -- 172.21.15.173:0/907364685 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fba4c0bf060 con 0x7fba5c071580 2024-04-25T09:14:32.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.360+0000 7fba53400640 1 --2- 172.21.15.173:0/907364685 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba38066f60 0x7fba38069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.360+0000 7fba53400640 1 -- 172.21.15.173:0/907364685 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fba4c11ec50 con 0x7fba5c071580 2024-04-25T09:14:32.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.360+0000 7fba5aa00640 1 --2- 172.21.15.173:0/907364685 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba38066f60 0x7fba38069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.360+0000 7fba5aa00640 1 --2- 172.21.15.173:0/907364685 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba38066f60 0x7fba38069420 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0b6330 tx=0x7fba44007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:32.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.364+0000 7fba53400640 1 -- 172.21.15.173:0/907364685 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fba4c016070 con 0x7fba5c071580 2024-04-25T09:14:32.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.520+0000 7fba62400640 1 -- 172.21.15.173:0/907364685 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fba5c166540 con 0x7fba5c071580 2024-04-25T09:14:32.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.520+0000 7fba53400640 1 -- 172.21.15.173:0/907364685 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v144) v1 ==== 100+0+11 (secure 0 0 0) 0x7fba4c0efac0 con 0x7fba5c071580 2024-04-25T09:14:32.505 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:14:32.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.520+0000 7fba62400640 1 -- 172.21.15.173:0/907364685 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba38066f60 msgr2=0x7fba38069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.520+0000 7fba62400640 1 --2- 172.21.15.173:0/907364685 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba38066f60 0x7fba38069420 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0b6330 tx=0x7fba44007d60 comp rx=0 tx=0).stop 2024-04-25T09:14:32.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.520+0000 7fba62400640 1 -- 172.21.15.173:0/907364685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba5c071580 msgr2=0x7fba5c154040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.520+0000 7fba62400640 1 --2- 172.21.15.173:0/907364685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba5c071580 0x7fba5c154040 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7fba4c018fd0 tx=0x7fba4c01ac00 comp rx=0 tx=0).stop 2024-04-25T09:14:32.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.520+0000 7fba62400640 1 -- 172.21.15.173:0/907364685 shutdown_connections 2024-04-25T09:14:32.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.520+0000 7fba62400640 1 --2- 172.21.15.173:0/907364685 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fba38066f60 0x7fba38069420 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.520+0000 7fba62400640 1 --2- 172.21.15.173:0/907364685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba5c1f7180 0x7fba5c157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.520+0000 7fba62400640 1 --2- 172.21.15.173:0/907364685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba5c1594e0 0x7fba5c1f6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.520+0000 7fba62400640 1 --2- 172.21.15.173:0/907364685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba5c071580 0x7fba5c154040 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.520+0000 7fba62400640 1 -- 172.21.15.173:0/907364685 >> 172.21.15.173:0/907364685 conn(0x7fba5c0b3540 msgr2=0x7fba5c15a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:32.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.520+0000 7fba62400640 1 -- 172.21.15.173:0/907364685 shutdown_connections 2024-04-25T09:14:32.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.520+0000 7fba62400640 1 -- 172.21.15.173:0/907364685 wait complete. 2024-04-25T09:14:32.527 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:14:32.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.680+0000 7f0501200640 1 Processor -- start 2024-04-25T09:14:32.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.680+0000 7f0501200640 1 -- start start 2024-04-25T09:14:32.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.680+0000 7f0501200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f04fc15dcb0 0x7f04fc0b9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.680+0000 7f0501200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f04fc161790 0x7f04fc0ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.680+0000 7f0501200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04fc0cf0d0 con 0x7f04fc0cecc0 2024-04-25T09:14:32.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.680+0000 7f0501200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04fc15e090 con 0x7f04fc161790 2024-04-25T09:14:32.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.680+0000 7f0501200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04fc161ce0 con 0x7f04fc15dcb0 2024-04-25T09:14:32.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.680+0000 7f04f1400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f04fc161790 0x7f04fc0ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.680+0000 7f04f1400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f04fc161790 0x7f04fc0ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36200/0 (socket says 172.21.15.173:36200) 2024-04-25T09:14:32.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.680+0000 7f04f1400640 1 -- 172.21.15.173:0/1179901258 learned_addr learned my addr 172.21.15.173:0/1179901258 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:32.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.680+0000 7f04f9e00640 1 --2- 172.21.15.173:0/1179901258 >> v2:172.21.15.194:3300/0 conn(0x7f04fc15dcb0 0x7f04fc0b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.680+0000 7f04f1400640 1 -- 172.21.15.173:0/1179901258 >> v2:172.21.15.194:3300/0 conn(0x7f04fc15dcb0 msgr2=0x7f04fc0b9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:32.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.680+0000 7f04f1400640 1 --2- 172.21.15.173:0/1179901258 >> v2:172.21.15.194:3300/0 conn(0x7f04fc15dcb0 0x7f04fc0b9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.680+0000 7f04f1400640 1 -- 172.21.15.173:0/1179901258 >> v1:172.21.15.194:6789/0 conn(0x7f04fc0cecc0 legacy=0x7f04fc06c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:32.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.680+0000 7f04f1400640 1 -- 172.21.15.173:0/1179901258 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04fc161fc0 con 0x7f04fc161790 2024-04-25T09:14:32.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.684+0000 7f04f1400640 1 --2- 172.21.15.173:0/1179901258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc161790 0x7f04fc0ce780 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0d4a20 tx=0x7f04e401c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83fbf5e815e0ab6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:32.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.684+0000 7f04f9400640 1 -- 172.21.15.173:0/1179901258 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40b0070 con 0x7f04fc161790 2024-04-25T09:14:32.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.684+0000 7f04f9400640 1 -- 172.21.15.173:0/1179901258 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e40ab600 con 0x7f04fc161790 2024-04-25T09:14:32.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.684+0000 7f04f9400640 1 -- 172.21.15.173:0/1179901258 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40ab9d0 con 0x7f04fc161790 2024-04-25T09:14:32.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.684+0000 7f0501200640 1 -- 172.21.15.173:0/1179901258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc161790 msgr2=0x7f04fc0ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.684+0000 7f0501200640 1 --2- 172.21.15.173:0/1179901258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc161790 0x7f04fc0ce780 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0d4a20 tx=0x7f04e401c2d0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.684+0000 7f0501200640 1 -- 172.21.15.173:0/1179901258 shutdown_connections 2024-04-25T09:14:32.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.684+0000 7f0501200640 1 --2- 172.21.15.173:0/1179901258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc161790 0x7f04fc0ce780 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.684+0000 7f0501200640 1 --2- 172.21.15.173:0/1179901258 >> v2:172.21.15.194:3300/0 conn(0x7f04fc15dcb0 0x7f04fc0b9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.684+0000 7f0501200640 1 -- 172.21.15.173:0/1179901258 >> 172.21.15.173:0/1179901258 conn(0x7f04fc0d0430 msgr2=0x7f04fc0d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:32.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.684+0000 7f0501200640 1 -- 172.21.15.173:0/1179901258 shutdown_connections 2024-04-25T09:14:32.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.684+0000 7f0501200640 1 -- 172.21.15.173:0/1179901258 wait complete. 2024-04-25T09:14:32.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f0501200640 1 Processor -- start 2024-04-25T09:14:32.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f0501200640 1 -- start start 2024-04-25T09:14:32.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f0501200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04fc0cecc0 0x7f04fc160c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f0501200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04fc15dcb0 0x7f04fc0c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f0501200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc161790 0x7f04fc155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f0501200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc16a900 con 0x7f04fc161790 2024-04-25T09:14:32.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f0501200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc0b9880 con 0x7f04fc15dcb0 2024-04-25T09:14:32.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f0501200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc16aa80 con 0x7f04fc0cecc0 2024-04-25T09:14:32.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f04fa800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc161790 0x7f04fc155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f04fa800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc161790 0x7f04fc155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36212/0 (socket says 172.21.15.173:36212) 2024-04-25T09:14:32.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f04fa800640 1 -- 172.21.15.173:0/1976066721 learned_addr learned my addr 172.21.15.173:0/1976066721 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:32.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f04f1400640 1 --2- 172.21.15.173:0/1976066721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04fc15dcb0 0x7f04fc0c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f04f9e00640 1 --2- 172.21.15.173:0/1976066721 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04fc0cecc0 0x7f04fc160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f04fa800640 1 -- 172.21.15.173:0/1976066721 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04fc0cecc0 msgr2=0x7f04fc160c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f04fa800640 1 --2- 172.21.15.173:0/1976066721 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04fc0cecc0 0x7f04fc160c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f04fa800640 1 -- 172.21.15.173:0/1976066721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04fc15dcb0 msgr2=0x7f04fc0c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f04fa800640 1 --2- 172.21.15.173:0/1976066721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04fc15dcb0 0x7f04fc0c9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f04fa800640 1 -- 172.21.15.173:0/1976066721 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04fc0ca360 con 0x7f04fc161790 2024-04-25T09:14:32.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f04fa800640 1 --2- 172.21.15.173:0/1976066721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc161790 0x7f04fc155b80 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f04f400b9a0 tx=0x7f04f400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:32.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f04f2a00640 1 -- 172.21.15.173:0/1976066721 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4019070 con 0x7f04fc161790 2024-04-25T09:14:32.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f04f2a00640 1 -- 172.21.15.173:0/1976066721 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f400cba0 con 0x7f04fc161790 2024-04-25T09:14:32.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f04f2a00640 1 -- 172.21.15.173:0/1976066721 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4014440 con 0x7f04fc161790 2024-04-25T09:14:32.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f0501200640 1 -- 172.21.15.173:0/1976066721 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04fc0c9da0 con 0x7f04fc161790 2024-04-25T09:14:32.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f0501200640 1 -- 172.21.15.173:0/1976066721 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04fc156510 con 0x7f04fc161790 2024-04-25T09:14:32.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.688+0000 7f0501200640 1 -- 172.21.15.173:0/1976066721 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04fc073ab0 con 0x7f04fc161790 2024-04-25T09:14:32.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.692+0000 7f04f2a00640 1 -- 172.21.15.173:0/1976066721 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f04f401c070 con 0x7f04fc161790 2024-04-25T09:14:32.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.692+0000 7f04f2a00640 1 --2- 172.21.15.173:0/1976066721 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f04d8066f60 0x7f04d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.692+0000 7f04f2a00640 1 -- 172.21.15.173:0/1976066721 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f04f4084e20 con 0x7f04fc161790 2024-04-25T09:14:32.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.692+0000 7f04f9e00640 1 --2- 172.21.15.173:0/1976066721 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f04d8066f60 0x7f04d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.692+0000 7f04f9e00640 1 --2- 172.21.15.173:0/1976066721 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f04d8066f60 0x7f04d8069420 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0079c0 tx=0x7f04ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:32.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.696+0000 7f04f2a00640 1 -- 172.21.15.173:0/1976066721 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f04f40555b0 con 0x7f04fc161790 2024-04-25T09:14:32.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.860+0000 7f0501200640 1 -- 172.21.15.173:0/1976066721 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f04fc1614b0 con 0x7f04fc161790 2024-04-25T09:14:32.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.864+0000 7f04f2a00640 1 -- 172.21.15.173:0/1976066721 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v144) v1 ==== 80+0+0 (secure 0 0 0) 0x7f04f4059650 con 0x7f04fc161790 2024-04-25T09:14:32.847 INFO:teuthology.orchestra.run.smithi173.stderr:listed 0 entries 2024-04-25T09:14:32.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.864+0000 7f0501200640 1 -- 172.21.15.173:0/1976066721 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f04d8066f60 msgr2=0x7f04d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.864+0000 7f0501200640 1 --2- 172.21.15.173:0/1976066721 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f04d8066f60 0x7f04d8069420 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0079c0 tx=0x7f04ec008040 comp rx=0 tx=0).stop 2024-04-25T09:14:32.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.864+0000 7f0501200640 1 -- 172.21.15.173:0/1976066721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc161790 msgr2=0x7f04fc155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.864+0000 7f0501200640 1 --2- 172.21.15.173:0/1976066721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc161790 0x7f04fc155b80 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f04f400b9a0 tx=0x7f04f400be60 comp rx=0 tx=0).stop 2024-04-25T09:14:32.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.864+0000 7f0501200640 1 -- 172.21.15.173:0/1976066721 shutdown_connections 2024-04-25T09:14:32.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.864+0000 7f0501200640 1 --2- 172.21.15.173:0/1976066721 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f04d8066f60 0x7f04d8069420 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.864+0000 7f0501200640 1 --2- 172.21.15.173:0/1976066721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04fc161790 0x7f04fc155b80 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.864+0000 7f0501200640 1 --2- 172.21.15.173:0/1976066721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04fc15dcb0 0x7f04fc0c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.864+0000 7f0501200640 1 --2- 172.21.15.173:0/1976066721 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04fc0cecc0 0x7f04fc160c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.864+0000 7f0501200640 1 -- 172.21.15.173:0/1976066721 >> 172.21.15.173:0/1976066721 conn(0x7f04fc0d0430 msgr2=0x7f04fc0d0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:32.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.864+0000 7f0501200640 1 -- 172.21.15.173:0/1976066721 shutdown_connections 2024-04-25T09:14:32.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:32.864+0000 7f0501200640 1 -- 172.21.15.173:0/1976066721 wait complete. 2024-04-25T09:14:32.868 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:14:32.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:32.868 DEBUG:teuthology.orchestra.run.smithi173:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:33.542 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:14:33.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:33.542 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:14:33.553 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:14:33.553 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:33.561 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:14:33.561 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:14:33.562 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:33.603 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:14:33.603 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:14:33.603 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:33.613 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:14:33.614 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:33.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.800+0000 7f3a71a00640 1 Processor -- start 2024-04-25T09:14:33.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.800+0000 7f3a71a00640 1 -- start start 2024-04-25T09:14:33.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.800+0000 7f3a71a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3a6c0b3e70 0x7f3a6c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:33.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.800+0000 7f3a71a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6c0b3590 con 0x7f3a6c0aefa0 2024-04-25T09:14:33.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.800+0000 7f3a71a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6c0b4790 con 0x7f3a6c15edd0 2024-04-25T09:14:33.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.800+0000 7f3a71a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a6c06dd50 con 0x7f3a6c0b3e70 2024-04-25T09:14:33.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.800+0000 7f3a6aa00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3a6c0b3e70 0x7f3a6c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:33.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.800+0000 7f3a6a000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f3a6c0aefa0 0x7f3a6c0b2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45390/0 (socket says 172.21.15.173:45390) 2024-04-25T09:14:33.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.800+0000 7f3a6a000640 1 -- 172.21.15.173:0/1771834977 learned_addr learned my addr 172.21.15.173:0/1771834977 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:33.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.800+0000 7f3a6aa00640 1 -- 172.21.15.173:0/1771834977 >> v1:172.21.15.194:6789/0 conn(0x7f3a6c15edd0 legacy=0x7f3a6c0b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:33.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.800+0000 7f3a6aa00640 1 -- 172.21.15.173:0/1771834977 >> v1:172.21.15.173:6789/0 conn(0x7f3a6c0aefa0 legacy=0x7f3a6c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:33.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.800+0000 7f3a6aa00640 1 -- 172.21.15.173:0/1771834977 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c15f320 con 0x7f3a6c0b3e70 2024-04-25T09:14:33.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.804+0000 7f3a6aa00640 1 --2- 172.21.15.173:0/1771834977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c0b3e70 0x7f3a6c0b4250 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0097c0 tx=0x7f3a5c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6acc5ca572ae6ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:33.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.804+0000 7f3a69600640 1 -- 172.21.15.173:0/1771834977 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0b0070 con 0x7f3a6c0b3e70 2024-04-25T09:14:33.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.804+0000 7f3a69600640 1 -- 172.21.15.173:0/1771834977 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c004230 con 0x7f3a6c0b3e70 2024-04-25T09:14:33.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.804+0000 7f3a69600640 1 -- 172.21.15.173:0/1771834977 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c003620 con 0x7f3a6c0b3e70 2024-04-25T09:14:33.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.804+0000 7f3a71a00640 1 -- 172.21.15.173:0/1771834977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c0b3e70 msgr2=0x7f3a6c0b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:33.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.804+0000 7f3a71a00640 1 --2- 172.21.15.173:0/1771834977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c0b3e70 0x7f3a6c0b4250 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0097c0 tx=0x7f3a5c01c430 comp rx=0 tx=0).stop 2024-04-25T09:14:33.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.804+0000 7f3a71a00640 1 -- 172.21.15.173:0/1771834977 shutdown_connections 2024-04-25T09:14:33.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.804+0000 7f3a71a00640 1 --2- 172.21.15.173:0/1771834977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c0b3e70 0x7f3a6c0b4250 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:33.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.804+0000 7f3a71a00640 1 -- 172.21.15.173:0/1771834977 >> 172.21.15.173:0/1771834977 conn(0x7f3a6c06ac90 msgr2=0x7f3a6c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:33.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.804+0000 7f3a71a00640 1 -- 172.21.15.173:0/1771834977 shutdown_connections 2024-04-25T09:14:33.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.804+0000 7f3a71a00640 1 -- 172.21.15.173:0/1771834977 wait complete. 2024-04-25T09:14:33.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.804+0000 7f3a71a00640 1 Processor -- start 2024-04-25T09:14:33.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.804+0000 7f3a71a00640 1 -- start start 2024-04-25T09:14:33.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a71a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c0aefa0 0x7f3a6c14b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:33.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a71a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a6c0b3e70 0x7f3a6c14c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:33.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a71a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a6c15edd0 0x7f3a6c0b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:33.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a71a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c15aba0 con 0x7f3a6c0aefa0 2024-04-25T09:14:33.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a71a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0ce7b0 con 0x7f3a6c15edd0 2024-04-25T09:14:33.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a71a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c06e1e0 con 0x7f3a6c0b3e70 2024-04-25T09:14:33.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a6aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c0aefa0 0x7f3a6c14b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:33.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a6aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c0aefa0 0x7f3a6c14b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39628/0 (socket says 172.21.15.173:39628) 2024-04-25T09:14:33.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a6aa00640 1 -- 172.21.15.173:0/3298358713 learned_addr learned my addr 172.21.15.173:0/3298358713 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:33.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a6a000640 1 --2- 172.21.15.173:0/3298358713 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a6c0b3e70 0x7f3a6c14c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:33.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a6b400640 1 --2- 172.21.15.173:0/3298358713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a6c15edd0 0x7f3a6c0b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:33.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a6aa00640 1 -- 172.21.15.173:0/3298358713 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a6c0b3e70 msgr2=0x7f3a6c14c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:33.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a6aa00640 1 --2- 172.21.15.173:0/3298358713 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a6c0b3e70 0x7f3a6c14c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:33.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a6aa00640 1 -- 172.21.15.173:0/3298358713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a6c15edd0 msgr2=0x7f3a6c0b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:33.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a6aa00640 1 --2- 172.21.15.173:0/3298358713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a6c15edd0 0x7f3a6c0b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:33.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a6aa00640 1 -- 172.21.15.173:0/3298358713 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c14d0c0 con 0x7f3a6c0aefa0 2024-04-25T09:14:33.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a6a000640 1 --2- 172.21.15.173:0/3298358713 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a6c0b3e70 0x7f3a6c14c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:33.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a6b400640 1 --2- 172.21.15.173:0/3298358713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a6c15edd0 0x7f3a6c0b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:33.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a6aa00640 1 --2- 172.21.15.173:0/3298358713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c0aefa0 0x7f3a6c14b040 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0ae040 tx=0x7f3a5c0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:33.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a62a00640 1 -- 172.21.15.173:0/3298358713 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0b0040 con 0x7f3a6c0aefa0 2024-04-25T09:14:33.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a62a00640 1 -- 172.21.15.173:0/3298358713 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c0bb070 con 0x7f3a6c0aefa0 2024-04-25T09:14:33.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a71a00640 1 -- 172.21.15.173:0/3298358713 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6c14d3a0 con 0x7f3a6c0aefa0 2024-04-25T09:14:33.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a62a00640 1 -- 172.21.15.173:0/3298358713 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0b5480 con 0x7f3a6c0aefa0 2024-04-25T09:14:33.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a71a00640 1 -- 172.21.15.173:0/3298358713 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6c14d960 con 0x7f3a6c0aefa0 2024-04-25T09:14:33.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a71a00640 1 -- 172.21.15.173:0/3298358713 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6c073a40 con 0x7f3a6c0aefa0 2024-04-25T09:14:33.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.808+0000 7f3a62a00640 1 -- 172.21.15.173:0/3298358713 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3a5c0b3070 con 0x7f3a6c0aefa0 2024-04-25T09:14:33.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.812+0000 7f3a62a00640 1 --2- 172.21.15.173:0/3298358713 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3a4c066f90 0x7f3a4c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:33.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.812+0000 7f3a62a00640 1 -- 172.21.15.173:0/3298358713 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f3a5c11efe0 con 0x7f3a6c0aefa0 2024-04-25T09:14:33.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.812+0000 7f3a6a000640 1 --2- 172.21.15.173:0/3298358713 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3a4c066f90 0x7f3a4c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:33.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.812+0000 7f3a6a000640 1 --2- 172.21.15.173:0/3298358713 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3a4c066f90 0x7f3a4c069450 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c150310 tx=0x7f3a58009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:33.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:33.816+0000 7f3a62a00640 1 -- 172.21.15.173:0/3298358713 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3a5c016050 con 0x7f3a6c0aefa0 2024-04-25T09:14:33.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.000+0000 7f3a71a00640 1 -- 172.21.15.173:0/3298358713 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a6c06e540 con 0x7f3a6c0aefa0 2024-04-25T09:14:33.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.004+0000 7f3a62a00640 1 -- 172.21.15.173:0/3298358713 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4957 (secure 0 0 0) 0x7f3a5c0aa3a0 con 0x7f3a6c0aefa0 2024-04-25T09:14:33.987 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:33.988 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":105,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/751187793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":751187793},{"type":"v1","addr":"172.21.15.173:6836","nonce":751187793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":9013,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1331227782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1331227782},{"type":"v1","addr":"172.21.15.194:6834","nonce":1331227782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":105,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T09:13:55.081334+0000","modified":"2024-04-25T09:14:29.957297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9957":{"gid":9957,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6837/401620872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":401620872},{"type":"v1","addr":"172.21.15.173:6837","nonce":401620872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_9969":{"gid":9969,"name":"b","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/3308916795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":3308916795},{"type":"v1","addr":"172.21.15.194:6835","nonce":3308916795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T09:14:33.988 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 105 2024-04-25T09:14:33.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.004+0000 7f3a71a00640 1 -- 172.21.15.173:0/3298358713 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3a4c066f90 msgr2=0x7f3a4c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:33.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.004+0000 7f3a71a00640 1 --2- 172.21.15.173:0/3298358713 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3a4c066f90 0x7f3a4c069450 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c150310 tx=0x7f3a58009040 comp rx=0 tx=0).stop 2024-04-25T09:14:33.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.004+0000 7f3a71a00640 1 -- 172.21.15.173:0/3298358713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c0aefa0 msgr2=0x7f3a6c14b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:33.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.004+0000 7f3a71a00640 1 --2- 172.21.15.173:0/3298358713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c0aefa0 0x7f3a6c14b040 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0ae040 tx=0x7f3a5c0191d0 comp rx=0 tx=0).stop 2024-04-25T09:14:33.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.004+0000 7f3a71a00640 1 -- 172.21.15.173:0/3298358713 shutdown_connections 2024-04-25T09:14:33.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.004+0000 7f3a71a00640 1 --2- 172.21.15.173:0/3298358713 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3a4c066f90 0x7f3a4c069450 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:33.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.004+0000 7f3a71a00640 1 --2- 172.21.15.173:0/3298358713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a6c15edd0 0x7f3a6c0b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:33.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.004+0000 7f3a71a00640 1 --2- 172.21.15.173:0/3298358713 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a6c0b3e70 0x7f3a6c14c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:33.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.004+0000 7f3a71a00640 1 --2- 172.21.15.173:0/3298358713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a6c0aefa0 0x7f3a6c14b040 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:33.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.004+0000 7f3a71a00640 1 -- 172.21.15.173:0/3298358713 >> 172.21.15.173:0/3298358713 conn(0x7f3a6c06ac90 msgr2=0x7f3a6c0afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:33.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.004+0000 7f3a71a00640 1 -- 172.21.15.173:0/3298358713 shutdown_connections 2024-04-25T09:14:33.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.004+0000 7f3a71a00640 1 -- 172.21.15.173:0/3298358713 wait complete. 2024-04-25T09:14:34.009 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:14:34.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.164+0000 7f6871600640 1 Processor -- start 2024-04-25T09:14:34.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.164+0000 7f6871600640 1 -- start start 2024-04-25T09:14:34.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.164+0000 7f6871600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f686c0cf6c0 0x7f686c0cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.164+0000 7f6871600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f686c0c7d20 0x7f686c0cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.164+0000 7f6871600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f686c0cd1b0 con 0x7f686c0ccc60 2024-04-25T09:14:34.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.164+0000 7f6871600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f686c0d0520 con 0x7f686c0cf6c0 2024-04-25T09:14:34.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.164+0000 7f6871600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f686c0c5230 con 0x7f686c0c7d20 2024-04-25T09:14:34.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.164+0000 7f686be00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f686c0cf6c0 0x7f686c0cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.164+0000 7f6870c00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f686c0ccc60 0x7f686c099a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45406/0 (socket says 172.21.15.173:45406) 2024-04-25T09:14:34.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.164+0000 7f6870c00640 1 -- 172.21.15.173:0/1949010157 learned_addr learned my addr 172.21.15.173:0/1949010157 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:34.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.164+0000 7f6863400640 1 --2- 172.21.15.173:0/1949010157 >> v2:172.21.15.194:3300/0 conn(0x7f686c0c7d20 0x7f686c0cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.164+0000 7f686be00640 1 -- 172.21.15.173:0/1949010157 >> v2:172.21.15.194:3300/0 conn(0x7f686c0c7d20 msgr2=0x7f686c0cffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:34.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.164+0000 7f686be00640 1 --2- 172.21.15.173:0/1949010157 >> v2:172.21.15.194:3300/0 conn(0x7f686c0c7d20 0x7f686c0cffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.164+0000 7f686be00640 1 -- 172.21.15.173:0/1949010157 >> v1:172.21.15.173:6789/0 conn(0x7f686c0ccc60 legacy=0x7f686c099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.164+0000 7f686be00640 1 -- 172.21.15.173:0/1949010157 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c0c5510 con 0x7f686c0cf6c0 2024-04-25T09:14:34.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.164+0000 7f6863400640 1 --2- 172.21.15.173:0/1949010157 >> v2:172.21.15.194:3300/0 conn(0x7f686c0c7d20 0x7f686c0cffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:34.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.168+0000 7f686be00640 1 --2- 172.21.15.173:0/1949010157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f686c0cf6c0 0x7f686c0cfaa0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f686c072550 tx=0x7f685c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4908472658ce547e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:34.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.168+0000 7f686b400640 1 -- 172.21.15.173:0/1949010157 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c0b1070 con 0x7f686c0cf6c0 2024-04-25T09:14:34.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.168+0000 7f686b400640 1 -- 172.21.15.173:0/1949010157 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c0ac640 con 0x7f686c0cf6c0 2024-04-25T09:14:34.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.168+0000 7f686b400640 1 -- 172.21.15.173:0/1949010157 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c0aca10 con 0x7f686c0cf6c0 2024-04-25T09:14:34.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.168+0000 7f6871600640 1 -- 172.21.15.173:0/1949010157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f686c0cf6c0 msgr2=0x7f686c0cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.168+0000 7f6871600640 1 --2- 172.21.15.173:0/1949010157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f686c0cf6c0 0x7f686c0cfaa0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f686c072550 tx=0x7f685c01c450 comp rx=0 tx=0).stop 2024-04-25T09:14:34.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.168+0000 7f6871600640 1 -- 172.21.15.173:0/1949010157 shutdown_connections 2024-04-25T09:14:34.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.168+0000 7f6871600640 1 --2- 172.21.15.173:0/1949010157 >> v2:172.21.15.194:3300/0 conn(0x7f686c0c7d20 0x7f686c0cffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.168+0000 7f6871600640 1 --2- 172.21.15.173:0/1949010157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f686c0cf6c0 0x7f686c0cfaa0 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.168+0000 7f6871600640 1 -- 172.21.15.173:0/1949010157 >> 172.21.15.173:0/1949010157 conn(0x7f686c0b3130 msgr2=0x7f686c0b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:34.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.168+0000 7f6871600640 1 -- 172.21.15.173:0/1949010157 shutdown_connections 2024-04-25T09:14:34.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.168+0000 7f6871600640 1 -- 172.21.15.173:0/1949010157 wait complete. 2024-04-25T09:14:34.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.168+0000 7f6871600640 1 Processor -- start 2024-04-25T09:14:34.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.168+0000 7f6871600640 1 -- start start 2024-04-25T09:14:34.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f6871600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f686c0c7d20 0x7f686c147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f6871600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f686c0ccc60 0x7f686c15abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f6871600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f686c0cf6c0 0x7f686c157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f6871600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c0cf4b0 con 0x7f686c0c7d20 2024-04-25T09:14:34.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f6871600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c0cf330 con 0x7f686c0ccc60 2024-04-25T09:14:34.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f6871600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686c168410 con 0x7f686c0cf6c0 2024-04-25T09:14:34.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f686be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f686c0c7d20 0x7f686c147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f686be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f686c0c7d20 0x7f686c147aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39640/0 (socket says 172.21.15.173:39640) 2024-04-25T09:14:34.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f686be00640 1 -- 172.21.15.173:0/2427014412 learned_addr learned my addr 172.21.15.173:0/2427014412 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:34.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f686be00640 1 -- 172.21.15.173:0/2427014412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f686c0cf6c0 msgr2=0x7f686c157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f6870c00640 1 --2- 172.21.15.173:0/2427014412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f686c0cf6c0 0x7f686c157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f6863400640 1 --2- 172.21.15.173:0/2427014412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f686c0ccc60 0x7f686c15abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f686be00640 1 --2- 172.21.15.173:0/2427014412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f686c0cf6c0 0x7f686c157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f686be00640 1 -- 172.21.15.173:0/2427014412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f686c0ccc60 msgr2=0x7f686c15abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f686be00640 1 --2- 172.21.15.173:0/2427014412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f686c0ccc60 0x7f686c15abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f686be00640 1 -- 172.21.15.173:0/2427014412 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c0c87b0 con 0x7f686c0c7d20 2024-04-25T09:14:34.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f6863400640 1 --2- 172.21.15.173:0/2427014412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f686c0ccc60 0x7f686c15abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:34.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f6870c00640 1 --2- 172.21.15.173:0/2427014412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f686c0cf6c0 0x7f686c157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:34.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f686be00640 1 --2- 172.21.15.173:0/2427014412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f686c0c7d20 0x7f686c147aa0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f685c01a080 tx=0x7f685c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:34.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f6868c00640 1 -- 172.21.15.173:0/2427014412 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c0b1040 con 0x7f686c0c7d20 2024-04-25T09:14:34.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f6868c00640 1 -- 172.21.15.173:0/2427014412 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c0b5410 con 0x7f686c0c7d20 2024-04-25T09:14:34.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f6871600640 1 -- 172.21.15.173:0/2427014412 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686c0c8a90 con 0x7f686c0c7d20 2024-04-25T09:14:34.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f6868c00640 1 -- 172.21.15.173:0/2427014412 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c0b57e0 con 0x7f686c0c7d20 2024-04-25T09:14:34.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f6871600640 1 -- 172.21.15.173:0/2427014412 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686c0c9050 con 0x7f686c0c7d20 2024-04-25T09:14:34.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.172+0000 7f6871600640 1 -- 172.21.15.173:0/2427014412 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686c073a40 con 0x7f686c0c7d20 2024-04-25T09:14:34.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.176+0000 7f6868c00640 1 -- 172.21.15.173:0/2427014412 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f685c0bd020 con 0x7f686c0c7d20 2024-04-25T09:14:34.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.176+0000 7f6868c00640 1 --2- 172.21.15.173:0/2427014412 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6848066f60 0x7f6848069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.176+0000 7f6868c00640 1 -- 172.21.15.173:0/2427014412 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f685c11e8a0 con 0x7f686c0c7d20 2024-04-25T09:14:34.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.176+0000 7f6863400640 1 --2- 172.21.15.173:0/2427014412 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6848066f60 0x7f6848069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.176+0000 7f6863400640 1 --2- 172.21.15.173:0/2427014412 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6848066f60 0x7f6848069420 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f686c099f50 tx=0x7f6854008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:34.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.180+0000 7f6868c00640 1 -- 172.21.15.173:0/2427014412 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f685c0c4020 con 0x7f686c0c7d20 2024-04-25T09:14:34.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.332+0000 7f6871600640 1 -- 172.21.15.173:0/2427014412 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f686c0b3cd0 con 0x7f686c0c7d20 2024-04-25T09:14:34.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.336+0000 7f6868c00640 1 -- 172.21.15.173:0/2427014412 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+17109 (secure 0 0 0) 0x7f685c016070 con 0x7f686c0c7d20 2024-04-25T09:14:34.320 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:34.320 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":145,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:14:33.528154+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:13:53.493356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-04-25T09:13:54.078507+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.5","mappings":[{"from":3,"to":0}]},{"pgid":"22.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:14:34.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.336+0000 7f6871600640 1 -- 172.21.15.173:0/2427014412 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6848066f60 msgr2=0x7f6848069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.336+0000 7f6871600640 1 --2- 172.21.15.173:0/2427014412 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6848066f60 0x7f6848069420 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f686c099f50 tx=0x7f6854008040 comp rx=0 tx=0).stop 2024-04-25T09:14:34.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.336+0000 7f6871600640 1 -- 172.21.15.173:0/2427014412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f686c0c7d20 msgr2=0x7f686c147aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.336+0000 7f6871600640 1 --2- 172.21.15.173:0/2427014412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f686c0c7d20 0x7f686c147aa0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f685c01a080 tx=0x7f685c0191f0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.336+0000 7f6871600640 1 -- 172.21.15.173:0/2427014412 shutdown_connections 2024-04-25T09:14:34.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.336+0000 7f6871600640 1 --2- 172.21.15.173:0/2427014412 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6848066f60 0x7f6848069420 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.336+0000 7f6871600640 1 --2- 172.21.15.173:0/2427014412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f686c0cf6c0 0x7f686c157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.336+0000 7f6871600640 1 --2- 172.21.15.173:0/2427014412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f686c0ccc60 0x7f686c15abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.336+0000 7f6871600640 1 --2- 172.21.15.173:0/2427014412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f686c0c7d20 0x7f686c147aa0 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.336+0000 7f6871600640 1 -- 172.21.15.173:0/2427014412 >> 172.21.15.173:0/2427014412 conn(0x7f686c0b3130 msgr2=0x7f686c0b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:34.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.336+0000 7f6871600640 1 -- 172.21.15.173:0/2427014412 shutdown_connections 2024-04-25T09:14:34.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.336+0000 7f6871600640 1 -- 172.21.15.173:0/2427014412 wait complete. 2024-04-25T09:14:34.342 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:02:38.786862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:13:53.493356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:13:54.078507+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '144', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:14:34.342 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:14:34.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.496+0000 7feb53600640 1 Processor -- start 2024-04-25T09:14:34.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.496+0000 7feb53600640 1 -- start start 2024-04-25T09:14:34.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.496+0000 7feb53600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4c15b710 0x7feb4c071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.496+0000 7feb53600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feb4c0cd3d0 0x7feb4c0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.496+0000 7feb53600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4c0ccaa0 con 0x7feb4c0cc670 2024-04-25T09:14:34.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.496+0000 7feb53600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb4c15eea0 con 0x7feb4c0cd3d0 2024-04-25T09:14:34.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.496+0000 7feb53600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c15e2d0 con 0x7feb4c15b710 2024-04-25T09:14:34.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.496+0000 7feb43e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feb4c0cd3d0 0x7feb4c0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.496+0000 7feb50c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4c15b710 0x7feb4c071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.500+0000 7feb43e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feb4c0cd3d0 0x7feb4c0cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:54872/0 (socket says 172.21.15.173:54872) 2024-04-25T09:14:34.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.500+0000 7feb43e00640 1 -- 172.21.15.173:0/1773192925 learned_addr learned my addr 172.21.15.173:0/1773192925 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:34.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.500+0000 7feb51600640 1 --1- 172.21.15.173:0/1773192925 >> v1:172.21.15.194:6789/0 conn(0x7feb4c0cc670 0x7feb4c06d380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:54146/0 (socket says 172.21.15.173:54146) 2024-04-25T09:14:34.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.500+0000 7feb43e00640 1 -- 172.21.15.173:0/1773192925 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4c15b710 msgr2=0x7feb4c071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:34.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.500+0000 7feb43e00640 1 --2- 172.21.15.173:0/1773192925 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4c15b710 0x7feb4c071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.500+0000 7feb43e00640 1 -- 172.21.15.173:0/1773192925 >> v1:172.21.15.194:6789/0 conn(0x7feb4c0cc670 legacy=0x7feb4c06d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.500+0000 7feb43e00640 1 -- 172.21.15.173:0/1773192925 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c15e570 con 0x7feb4c0cd3d0 2024-04-25T09:14:34.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.500+0000 7feb50c00640 1 --2- 172.21.15.173:0/1773192925 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4c15b710 0x7feb4c071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:34.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.500+0000 7feb43e00640 1 --2- 172.21.15.173:0/1773192925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb4c0cd3d0 0x7feb4c0cc130 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7feb34009870 tx=0x7feb3401c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35bd9045099fbd5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:34.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.500+0000 7feb4be00640 1 -- 172.21.15.173:0/1773192925 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb340ab640 con 0x7feb4c0cd3d0 2024-04-25T09:14:34.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.500+0000 7feb4be00640 1 -- 172.21.15.173:0/1773192925 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb340b0070 con 0x7feb4c0cd3d0 2024-04-25T09:14:34.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.500+0000 7feb4be00640 1 -- 172.21.15.173:0/1773192925 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb340aba00 con 0x7feb4c0cd3d0 2024-04-25T09:14:34.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb53600640 1 -- 172.21.15.173:0/1773192925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb4c0cd3d0 msgr2=0x7feb4c0cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb53600640 1 --2- 172.21.15.173:0/1773192925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb4c0cd3d0 0x7feb4c0cc130 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7feb34009870 tx=0x7feb3401c530 comp rx=0 tx=0).stop 2024-04-25T09:14:34.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb53600640 1 -- 172.21.15.173:0/1773192925 shutdown_connections 2024-04-25T09:14:34.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb53600640 1 --2- 172.21.15.173:0/1773192925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb4c0cd3d0 0x7feb4c0cc130 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb53600640 1 --2- 172.21.15.173:0/1773192925 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4c15b710 0x7feb4c071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb53600640 1 -- 172.21.15.173:0/1773192925 >> 172.21.15.173:0/1773192925 conn(0x7feb4c06ac90 msgr2=0x7feb4c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:34.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb53600640 1 -- 172.21.15.173:0/1773192925 shutdown_connections 2024-04-25T09:14:34.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb53600640 1 -- 172.21.15.173:0/1773192925 wait complete. 2024-04-25T09:14:34.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb53600640 1 Processor -- start 2024-04-25T09:14:34.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb53600640 1 -- start start 2024-04-25T09:14:34.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb53600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb4c0cc670 0x7feb4c1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb53600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb4c0cd3d0 0x7feb4c160670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb53600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4c15b710 0x7feb4c0b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb53600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c072540 con 0x7feb4c0cd3d0 2024-04-25T09:14:34.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb53600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c0723c0 con 0x7feb4c0cc670 2024-04-25T09:14:34.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb53600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c16a800 con 0x7feb4c15b710 2024-04-25T09:14:34.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb43e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb4c0cd3d0 0x7feb4c160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb43e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb4c0cd3d0 0x7feb4c160670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39642/0 (socket says 172.21.15.173:39642) 2024-04-25T09:14:34.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb43e00640 1 -- 172.21.15.173:0/1830783861 learned_addr learned my addr 172.21.15.173:0/1830783861 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:34.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb50c00640 1 --2- 172.21.15.173:0/1830783861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb4c0cc670 0x7feb4c1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb51600640 1 --2- 172.21.15.173:0/1830783861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4c15b710 0x7feb4c0b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb43e00640 1 -- 172.21.15.173:0/1830783861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4c15b710 msgr2=0x7feb4c0b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb43e00640 1 --2- 172.21.15.173:0/1830783861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4c15b710 0x7feb4c0b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb43e00640 1 -- 172.21.15.173:0/1830783861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb4c0cc670 msgr2=0x7feb4c1529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb43e00640 1 --2- 172.21.15.173:0/1830783861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb4c0cc670 0x7feb4c1529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.504+0000 7feb43e00640 1 -- 172.21.15.173:0/1830783861 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c0af3e0 con 0x7feb4c0cd3d0 2024-04-25T09:14:34.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.508+0000 7feb43e00640 1 --2- 172.21.15.173:0/1830783861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb4c0cd3d0 0x7feb4c160670 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7feb340ad040 tx=0x7feb3401ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:34.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.508+0000 7feb49600640 1 -- 172.21.15.173:0/1830783861 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb340be3f0 con 0x7feb4c0cd3d0 2024-04-25T09:14:34.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.508+0000 7feb49600640 1 -- 172.21.15.173:0/1830783861 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb340be590 con 0x7feb4c0cd3d0 2024-04-25T09:14:34.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.508+0000 7feb49600640 1 -- 172.21.15.173:0/1830783861 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb340be980 con 0x7feb4c0cd3d0 2024-04-25T09:14:34.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.508+0000 7feb53600640 1 -- 172.21.15.173:0/1830783861 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4c0af660 con 0x7feb4c0cd3d0 2024-04-25T09:14:34.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.508+0000 7feb53600640 1 -- 172.21.15.173:0/1830783861 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb4c0afc20 con 0x7feb4c0cd3d0 2024-04-25T09:14:34.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.508+0000 7feb53600640 1 -- 172.21.15.173:0/1830783861 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4c073ab0 con 0x7feb4c0cd3d0 2024-04-25T09:14:34.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.508+0000 7feb49600640 1 -- 172.21.15.173:0/1830783861 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feb340b43f0 con 0x7feb4c0cd3d0 2024-04-25T09:14:34.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.508+0000 7feb49600640 1 --2- 172.21.15.173:0/1830783861 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb28066f60 0x7feb28069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.508+0000 7feb49600640 1 -- 172.21.15.173:0/1830783861 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7feb3411f2f0 con 0x7feb4c0cd3d0 2024-04-25T09:14:34.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.508+0000 7feb50c00640 1 --2- 172.21.15.173:0/1830783861 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb28066f60 0x7feb28069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.512+0000 7feb50c00640 1 --2- 172.21.15.173:0/1830783861 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb28066f60 0x7feb28069420 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7feb4c15a3c0 tx=0x7feb3c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:34.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.512+0000 7feb49600640 1 -- 172.21.15.173:0/1830783861 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feb4c0af3e0 con 0x7feb4c0cd3d0 2024-04-25T09:14:34.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.692+0000 7feb53600640 1 -- 172.21.15.173:0/1830783861 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb4c06c300 con 0x7feb4c0cd3d0 2024-04-25T09:14:34.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.692+0000 7feb49600640 1 -- 172.21.15.173:0/1830783861 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v146) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb34016150 con 0x7feb4c0cd3d0 2024-04-25T09:14:34.679 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 1 2024-04-25T09:14:34.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.696+0000 7feb53600640 1 -- 172.21.15.173:0/1830783861 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb28066f60 msgr2=0x7feb28069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.696+0000 7feb53600640 1 --2- 172.21.15.173:0/1830783861 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb28066f60 0x7feb28069420 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7feb4c15a3c0 tx=0x7feb3c009190 comp rx=0 tx=0).stop 2024-04-25T09:14:34.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.696+0000 7feb53600640 1 -- 172.21.15.173:0/1830783861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb4c0cd3d0 msgr2=0x7feb4c160670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.696+0000 7feb53600640 1 --2- 172.21.15.173:0/1830783861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb4c0cd3d0 0x7feb4c160670 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7feb340ad040 tx=0x7feb3401ad70 comp rx=0 tx=0).stop 2024-04-25T09:14:34.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.696+0000 7feb53600640 1 -- 172.21.15.173:0/1830783861 shutdown_connections 2024-04-25T09:14:34.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.696+0000 7feb53600640 1 --2- 172.21.15.173:0/1830783861 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feb28066f60 0x7feb28069420 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.696+0000 7feb53600640 1 --2- 172.21.15.173:0/1830783861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb4c15b710 0x7feb4c0b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.696+0000 7feb53600640 1 --2- 172.21.15.173:0/1830783861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb4c0cd3d0 0x7feb4c160670 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.696+0000 7feb53600640 1 --2- 172.21.15.173:0/1830783861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb4c0cc670 0x7feb4c1529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.696+0000 7feb53600640 1 -- 172.21.15.173:0/1830783861 >> 172.21.15.173:0/1830783861 conn(0x7feb4c06ac90 msgr2=0x7feb4c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:34.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.696+0000 7feb53600640 1 -- 172.21.15.173:0/1830783861 shutdown_connections 2024-04-25T09:14:34.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.696+0000 7feb53600640 1 -- 172.21.15.173:0/1830783861 wait complete. 2024-04-25T09:14:34.700 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:14:34.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.856+0000 7fb4ffc00640 1 Processor -- start 2024-04-25T09:14:34.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.856+0000 7fb4ffc00640 1 -- start start 2024-04-25T09:14:34.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.856+0000 7fb4ffc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f815b750 0x7fb4f80cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.856+0000 7fb4ffc00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f815bda0 con 0x7fb4f8154e40 2024-04-25T09:14:34.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.856+0000 7fb4ffc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f806e6f0 con 0x7fb4f80cc820 2024-04-25T09:14:34.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.856+0000 7fb4ffc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f8071450 con 0x7fb4f815b750 2024-04-25T09:14:34.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.856+0000 7fb4fd200640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fb4f8154e40 0x7fb4f80cc110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45408/0 (socket says 172.21.15.173:45408) 2024-04-25T09:14:34.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.856+0000 7fb4fd200640 1 -- 172.21.15.173:0/855245109 learned_addr learned my addr 172.21.15.173:0/855245109 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:34.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.856+0000 7fb4fdc00640 1 --2- 172.21.15.173:0/855245109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f815b750 0x7fb4f80cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.856+0000 7fb4f7400640 1 -- 172.21.15.173:0/855245109 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969943485 0 0) 0x7fb4f815bda0 con 0x7fb4f8154e40 2024-04-25T09:14:34.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.856+0000 7fb4f7400640 1 -- 172.21.15.173:0/855245109 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4e0003530 con 0x7fb4f8154e40 2024-04-25T09:14:34.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.856+0000 7fb4f7400640 1 -- 172.21.15.173:0/855245109 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744986829 0 0) 0x7fb4e4001120 con 0x7fb4f80cc820 2024-04-25T09:14:34.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.856+0000 7fb4f7400640 1 -- 172.21.15.173:0/855245109 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4f815bda0 con 0x7fb4f80cc820 2024-04-25T09:14:34.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.856+0000 7fb4fdc00640 1 -- 172.21.15.173:0/855245109 >> v1:172.21.15.194:6789/0 conn(0x7fb4f80cc820 legacy=0x7fb4f815b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.856+0000 7fb4fdc00640 1 -- 172.21.15.173:0/855245109 >> v1:172.21.15.173:6789/0 conn(0x7fb4f8154e40 legacy=0x7fb4f80cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.856+0000 7fb4fdc00640 1 -- 172.21.15.173:0/855245109 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f8071730 con 0x7fb4f815b750 2024-04-25T09:14:34.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.860+0000 7fb4fdc00640 1 --2- 172.21.15.173:0/855245109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f815b750 0x7fb4f80cdae0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009dc0 tx=0x7fb4f001c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73812017f6c14da9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:34.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.860+0000 7fb4f7400640 1 -- 172.21.15.173:0/855245109 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f00b2070 con 0x7fb4f815b750 2024-04-25T09:14:34.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.860+0000 7fb4f7400640 1 -- 172.21.15.173:0/855245109 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f00a57c0 con 0x7fb4f815b750 2024-04-25T09:14:34.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.860+0000 7fb4f7400640 1 -- 172.21.15.173:0/855245109 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f00a5b90 con 0x7fb4f815b750 2024-04-25T09:14:34.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.860+0000 7fb4ffc00640 1 -- 172.21.15.173:0/855245109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f815b750 msgr2=0x7fb4f80cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.860+0000 7fb4ffc00640 1 --2- 172.21.15.173:0/855245109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f815b750 0x7fb4f80cdae0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009dc0 tx=0x7fb4f001c900 comp rx=0 tx=0).stop 2024-04-25T09:14:34.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.860+0000 7fb4ffc00640 1 -- 172.21.15.173:0/855245109 shutdown_connections 2024-04-25T09:14:34.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.860+0000 7fb4ffc00640 1 --2- 172.21.15.173:0/855245109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f815b750 0x7fb4f80cdae0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.860+0000 7fb4ffc00640 1 -- 172.21.15.173:0/855245109 >> 172.21.15.173:0/855245109 conn(0x7fb4f806ac90 msgr2=0x7fb4f806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:34.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.860+0000 7fb4ffc00640 1 -- 172.21.15.173:0/855245109 shutdown_connections 2024-04-25T09:14:34.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.860+0000 7fb4ffc00640 1 -- 172.21.15.173:0/855245109 wait complete. 2024-04-25T09:14:34.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4ffc00640 1 Processor -- start 2024-04-25T09:14:34.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4ffc00640 1 -- start start 2024-04-25T09:14:34.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4ffc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f80cc820 0x7fb4f8153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4ffc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4f8154e40 0x7fb4f8153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4ffc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4f815b750 0x7fb4f814fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4ffc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f81687e0 con 0x7fb4f815b750 2024-04-25T09:14:34.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4ffc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f8072210 con 0x7fb4f8154e40 2024-04-25T09:14:34.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4ffc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f8168960 con 0x7fb4f80cc820 2024-04-25T09:14:34.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4fdc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4f815b750 0x7fb4f814fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4fdc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4f815b750 0x7fb4f814fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39658/0 (socket says 172.21.15.173:39658) 2024-04-25T09:14:34.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4fdc00640 1 -- 172.21.15.173:0/3356939570 learned_addr learned my addr 172.21.15.173:0/3356939570 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:34.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4fd200640 1 --2- 172.21.15.173:0/3356939570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f80cc820 0x7fb4f8153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4f7e00640 1 --2- 172.21.15.173:0/3356939570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4f8154e40 0x7fb4f8153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4fdc00640 1 -- 172.21.15.173:0/3356939570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f80cc820 msgr2=0x7fb4f8153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4fdc00640 1 --2- 172.21.15.173:0/3356939570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f80cc820 0x7fb4f8153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4fdc00640 1 -- 172.21.15.173:0/3356939570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4f8154e40 msgr2=0x7fb4f8153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4fdc00640 1 --2- 172.21.15.173:0/3356939570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4f8154e40 0x7fb4f8153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4fdc00640 1 -- 172.21.15.173:0/3356939570 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f814e670 con 0x7fb4f815b750 2024-04-25T09:14:34.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4fdc00640 1 --2- 172.21.15.173:0/3356939570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4f815b750 0x7fb4f814fa60 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fb4f001cde0 tx=0x7fb4f00196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:34.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4f4c00640 1 -- 172.21.15.173:0/3356939570 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f00b2050 con 0x7fb4f815b750 2024-04-25T09:14:34.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4f4c00640 1 -- 172.21.15.173:0/3356939570 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f00be070 con 0x7fb4f815b750 2024-04-25T09:14:34.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4ffc00640 1 -- 172.21.15.173:0/3356939570 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f8151db0 con 0x7fb4f815b750 2024-04-25T09:14:34.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4f4c00640 1 -- 172.21.15.173:0/3356939570 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0009450 con 0x7fb4f815b750 2024-04-25T09:14:34.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4ffc00640 1 -- 172.21.15.173:0/3356939570 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f814b1a0 con 0x7fb4f815b750 2024-04-25T09:14:34.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.864+0000 7fb4ffc00640 1 -- 172.21.15.173:0/3356939570 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f8073ab0 con 0x7fb4f815b750 2024-04-25T09:14:34.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.868+0000 7fb4f4c00640 1 -- 172.21.15.173:0/3356939570 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb4f00ad8b0 con 0x7fb4f815b750 2024-04-25T09:14:34.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.868+0000 7fb4f4c00640 1 --2- 172.21.15.173:0/3356939570 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb4d8066f60 0x7fb4d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.868+0000 7fb4f4c00640 1 -- 172.21.15.173:0/3356939570 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb4f0120190 con 0x7fb4f815b750 2024-04-25T09:14:34.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.868+0000 7fb4fd200640 1 --2- 172.21.15.173:0/3356939570 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb4d8066f60 0x7fb4d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.868+0000 7fb4fd200640 1 --2- 172.21.15.173:0/3356939570 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb4d8066f60 0x7fb4d8069420 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec007fd0 tx=0x7fb4ec007d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:34.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:34.872+0000 7fb4f4c00640 1 -- 172.21.15.173:0/3356939570 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb4f0016580 con 0x7fb4f815b750 2024-04-25T09:14:35.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.024+0000 7fb4ffc00640 1 -- 172.21.15.173:0/3356939570 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4f8152260 con 0x7fb4f815b750 2024-04-25T09:14:35.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.024+0000 7fb4f4c00640 1 -- 172.21.15.173:0/3356939570 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v146) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb4f00f0ad0 con 0x7fb4f815b750 2024-04-25T09:14:35.011 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 32 2024-04-25T09:14:35.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.028+0000 7fb4ffc00640 1 -- 172.21.15.173:0/3356939570 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb4d8066f60 msgr2=0x7fb4d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.028+0000 7fb4ffc00640 1 --2- 172.21.15.173:0/3356939570 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb4d8066f60 0x7fb4d8069420 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec007fd0 tx=0x7fb4ec007d80 comp rx=0 tx=0).stop 2024-04-25T09:14:35.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.028+0000 7fb4ffc00640 1 -- 172.21.15.173:0/3356939570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4f815b750 msgr2=0x7fb4f814fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.028+0000 7fb4ffc00640 1 --2- 172.21.15.173:0/3356939570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4f815b750 0x7fb4f814fa60 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fb4f001cde0 tx=0x7fb4f00196a0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.028+0000 7fb4ffc00640 1 -- 172.21.15.173:0/3356939570 shutdown_connections 2024-04-25T09:14:35.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.028+0000 7fb4ffc00640 1 --2- 172.21.15.173:0/3356939570 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb4d8066f60 0x7fb4d8069420 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.028+0000 7fb4ffc00640 1 --2- 172.21.15.173:0/3356939570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4f815b750 0x7fb4f814fa60 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.028+0000 7fb4ffc00640 1 --2- 172.21.15.173:0/3356939570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4f8154e40 0x7fb4f8153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.028+0000 7fb4ffc00640 1 --2- 172.21.15.173:0/3356939570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f80cc820 0x7fb4f8153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.028+0000 7fb4ffc00640 1 -- 172.21.15.173:0/3356939570 >> 172.21.15.173:0/3356939570 conn(0x7fb4f806ac90 msgr2=0x7fb4f80b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:35.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.028+0000 7fb4ffc00640 1 -- 172.21.15.173:0/3356939570 shutdown_connections 2024-04-25T09:14:35.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.028+0000 7fb4ffc00640 1 -- 172.21.15.173:0/3356939570 wait complete. 2024-04-25T09:14:35.032 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:14:35.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.184+0000 7ff2a2600640 1 Processor -- start 2024-04-25T09:14:35.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.184+0000 7ff2a2600640 1 -- start start 2024-04-25T09:14:35.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.188+0000 7ff2a2600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff29c0cc7e0 0x7ff29c0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.188+0000 7ff2a2600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff29c0aef70 0x7ff29c0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.188+0000 7ff2a2600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29c071570 con 0x7ff29c0aeb90 2024-04-25T09:14:35.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.188+0000 7ff2a2600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29c071320 con 0x7ff29c0cc7e0 2024-04-25T09:14:35.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.188+0000 7ff2a2600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c072330 con 0x7ff29c0aef70 2024-04-25T09:14:35.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.188+0000 7ff29be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff29c0aef70 0x7ff29c0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.188+0000 7ff29b400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7ff29c0aeb90 0x7ff29c0cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:54154/0 (socket says 172.21.15.173:54154) 2024-04-25T09:14:35.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.188+0000 7ff29b400640 1 -- 172.21.15.173:0/1470028522 learned_addr learned my addr 172.21.15.173:0/1470028522 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:35.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.188+0000 7ff292a00640 1 --2- 172.21.15.173:0/1470028522 >> v2:172.21.15.194:3300/0 conn(0x7ff29c0cc7e0 0x7ff29c0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.188+0000 7ff29aa00640 1 -- 172.21.15.173:0/1470028522 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547908974 0 0) 0x7ff29c071570 con 0x7ff29c0aeb90 2024-04-25T09:14:35.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.188+0000 7ff29aa00640 1 -- 172.21.15.173:0/1470028522 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff280003530 con 0x7ff29c0aeb90 2024-04-25T09:14:35.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.188+0000 7ff29be00640 1 -- 172.21.15.173:0/1470028522 >> v2:172.21.15.194:3300/0 conn(0x7ff29c0cc7e0 msgr2=0x7ff29c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:35.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.188+0000 7ff29be00640 1 --2- 172.21.15.173:0/1470028522 >> v2:172.21.15.194:3300/0 conn(0x7ff29c0cc7e0 0x7ff29c0cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.188+0000 7ff29be00640 1 -- 172.21.15.173:0/1470028522 >> v1:172.21.15.194:6789/0 conn(0x7ff29c0aeb90 legacy=0x7ff29c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.188+0000 7ff29be00640 1 -- 172.21.15.173:0/1470028522 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c071850 con 0x7ff29c0aef70 2024-04-25T09:14:35.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.188+0000 7ff292a00640 1 --2- 172.21.15.173:0/1470028522 >> v2:172.21.15.194:3300/0 conn(0x7ff29c0cc7e0 0x7ff29c0cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:35.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.192+0000 7ff29be00640 1 --2- 172.21.15.173:0/1470028522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff29c0aef70 0x7ff29c0ce0e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff294009d90 tx=0x7ff29401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=109da4e278f1e3ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.192+0000 7ff29aa00640 1 -- 172.21.15.173:0/1470028522 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2940b2070 con 0x7ff29c0aef70 2024-04-25T09:14:35.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.192+0000 7ff29aa00640 1 -- 172.21.15.173:0/1470028522 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2940a5790 con 0x7ff29c0aef70 2024-04-25T09:14:35.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.192+0000 7ff29aa00640 1 -- 172.21.15.173:0/1470028522 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2940a5b60 con 0x7ff29c0aef70 2024-04-25T09:14:35.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.192+0000 7ff2a2600640 1 -- 172.21.15.173:0/1470028522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff29c0aef70 msgr2=0x7ff29c0ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.192+0000 7ff2a2600640 1 --2- 172.21.15.173:0/1470028522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff29c0aef70 0x7ff29c0ce0e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff294009d90 tx=0x7ff29401c8e0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.192+0000 7ff2a2600640 1 -- 172.21.15.173:0/1470028522 shutdown_connections 2024-04-25T09:14:35.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.192+0000 7ff2a2600640 1 --2- 172.21.15.173:0/1470028522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff29c0aef70 0x7ff29c0ce0e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.192+0000 7ff2a2600640 1 --2- 172.21.15.173:0/1470028522 >> v2:172.21.15.194:3300/0 conn(0x7ff29c0cc7e0 0x7ff29c0cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.192+0000 7ff2a2600640 1 -- 172.21.15.173:0/1470028522 >> 172.21.15.173:0/1470028522 conn(0x7ff29c06ac90 msgr2=0x7ff29c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:35.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.192+0000 7ff2a2600640 1 -- 172.21.15.173:0/1470028522 shutdown_connections 2024-04-25T09:14:35.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.192+0000 7ff2a2600640 1 -- 172.21.15.173:0/1470028522 wait complete. 2024-04-25T09:14:35.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.192+0000 7ff2a2600640 1 Processor -- start 2024-04-25T09:14:35.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.192+0000 7ff2a2600640 1 -- start start 2024-04-25T09:14:35.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff2a2600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff29c0aeb90 0x7ff29c1342b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff2a2600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff29c0aef70 0x7ff29c14d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff2a2600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff29c0cc7e0 0x7ff29c0b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff2a2600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c15bb30 con 0x7ff29c0cc7e0 2024-04-25T09:14:35.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff2a2600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c15b9b0 con 0x7ff29c0aeb90 2024-04-25T09:14:35.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff2a2600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c15bcb0 con 0x7ff29c0aef70 2024-04-25T09:14:35.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff29be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff29c0cc7e0 0x7ff29c0b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff29be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff29c0cc7e0 0x7ff29c0b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39666/0 (socket says 172.21.15.173:39666) 2024-04-25T09:14:35.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff29be00640 1 -- 172.21.15.173:0/2579666012 learned_addr learned my addr 172.21.15.173:0/2579666012 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:35.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff29b400640 1 --2- 172.21.15.173:0/2579666012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff29c0aeb90 0x7ff29c1342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff292a00640 1 --2- 172.21.15.173:0/2579666012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff29c0aef70 0x7ff29c14d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff29be00640 1 -- 172.21.15.173:0/2579666012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff29c0aef70 msgr2=0x7ff29c14d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff29be00640 1 --2- 172.21.15.173:0/2579666012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff29c0aef70 0x7ff29c14d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff29be00640 1 -- 172.21.15.173:0/2579666012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff29c0aeb90 msgr2=0x7ff29c1342b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff29be00640 1 --2- 172.21.15.173:0/2579666012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff29c0aeb90 0x7ff29c1342b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff29be00640 1 -- 172.21.15.173:0/2579666012 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c134900 con 0x7ff29c0cc7e0 2024-04-25T09:14:35.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff29be00640 1 --2- 172.21.15.173:0/2579666012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff29c0cc7e0 0x7ff29c0b1810 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7ff2940b0040 tx=0x7ff294019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff293e00640 1 -- 172.21.15.173:0/2579666012 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2940b2050 con 0x7ff29c0cc7e0 2024-04-25T09:14:35.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff293e00640 1 -- 172.21.15.173:0/2579666012 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2940be070 con 0x7ff29c0cc7e0 2024-04-25T09:14:35.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff293e00640 1 -- 172.21.15.173:0/2579666012 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294009450 con 0x7ff29c0cc7e0 2024-04-25T09:14:35.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff2a2600640 1 -- 172.21.15.173:0/2579666012 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29c134be0 con 0x7ff29c0cc7e0 2024-04-25T09:14:35.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff2a2600640 1 -- 172.21.15.173:0/2579666012 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29c1351a0 con 0x7ff29c0cc7e0 2024-04-25T09:14:35.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff2a2600640 1 -- 172.21.15.173:0/2579666012 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29c073ab0 con 0x7ff29c0cc7e0 2024-04-25T09:14:35.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.196+0000 7ff293e00640 1 -- 172.21.15.173:0/2579666012 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff2940ad870 con 0x7ff29c0cc7e0 2024-04-25T09:14:35.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.200+0000 7ff293e00640 1 --2- 172.21.15.173:0/2579666012 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff278066f60 0x7ff278069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.200+0000 7ff293e00640 1 -- 172.21.15.173:0/2579666012 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff294120130 con 0x7ff29c0cc7e0 2024-04-25T09:14:35.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.200+0000 7ff29b400640 1 --2- 172.21.15.173:0/2579666012 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff278066f60 0x7ff278069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.200+0000 7ff29b400640 1 --2- 172.21.15.173:0/2579666012 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff278066f60 0x7ff278069420 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ff28c007fd0 tx=0x7ff28c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.204+0000 7ff293e00640 1 -- 172.21.15.173:0/2579666012 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff294016560 con 0x7ff29c0cc7e0 2024-04-25T09:14:35.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.356+0000 7ff2a2600640 1 -- 172.21.15.173:0/2579666012 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff29c15d4d0 con 0x7ff29c0cc7e0 2024-04-25T09:14:35.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.356+0000 7ff293e00640 1 -- 172.21.15.173:0/2579666012 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v146) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff2940f0890 con 0x7ff29c0cc7e0 2024-04-25T09:14:35.341 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 64 2024-04-25T09:14:35.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.356+0000 7ff2a2600640 1 -- 172.21.15.173:0/2579666012 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff278066f60 msgr2=0x7ff278069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.356+0000 7ff2a2600640 1 --2- 172.21.15.173:0/2579666012 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff278066f60 0x7ff278069420 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ff28c007fd0 tx=0x7ff28c009040 comp rx=0 tx=0).stop 2024-04-25T09:14:35.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.356+0000 7ff2a2600640 1 -- 172.21.15.173:0/2579666012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff29c0cc7e0 msgr2=0x7ff29c0b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.356+0000 7ff2a2600640 1 --2- 172.21.15.173:0/2579666012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff29c0cc7e0 0x7ff29c0b1810 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7ff2940b0040 tx=0x7ff294019680 comp rx=0 tx=0).stop 2024-04-25T09:14:35.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.356+0000 7ff2a2600640 1 -- 172.21.15.173:0/2579666012 shutdown_connections 2024-04-25T09:14:35.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.356+0000 7ff2a2600640 1 --2- 172.21.15.173:0/2579666012 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7ff278066f60 0x7ff278069420 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.356+0000 7ff2a2600640 1 --2- 172.21.15.173:0/2579666012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff29c0cc7e0 0x7ff29c0b1810 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.356+0000 7ff2a2600640 1 --2- 172.21.15.173:0/2579666012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff29c0aef70 0x7ff29c14d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.356+0000 7ff2a2600640 1 --2- 172.21.15.173:0/2579666012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff29c0aeb90 0x7ff29c1342b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.356+0000 7ff2a2600640 1 -- 172.21.15.173:0/2579666012 >> 172.21.15.173:0/2579666012 conn(0x7ff29c06ac90 msgr2=0x7ff29c154060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:35.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.360+0000 7ff2a2600640 1 -- 172.21.15.173:0/2579666012 shutdown_connections 2024-04-25T09:14:35.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.360+0000 7ff2a2600640 1 -- 172.21.15.173:0/2579666012 wait complete. 2024-04-25T09:14:35.363 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:35.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.516+0000 7f8cede00640 1 Processor -- start 2024-04-25T09:14:35.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.516+0000 7f8cede00640 1 -- start start 2024-04-25T09:14:35.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.516+0000 7f8cede00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8ce806fd80 0x7f8ce80cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.516+0000 7f8cede00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ce806e270 0x7f8ce806ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.516+0000 7f8cede00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce80cf6d0 con 0x7f8ce80cba20 2024-04-25T09:14:35.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.516+0000 7f8cede00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce80cbf60 con 0x7f8ce806fd80 2024-04-25T09:14:35.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.516+0000 7f8cede00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80cf970 con 0x7f8ce806e270 2024-04-25T09:14:35.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.516+0000 7f8ceca00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8ce806fd80 0x7f8ce80cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.516+0000 7f8ceca00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8ce806fd80 0x7f8ce80cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39678/0 (socket says 172.21.15.173:39678) 2024-04-25T09:14:35.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.516+0000 7f8ceca00640 1 -- 172.21.15.173:0/1306703841 learned_addr learned my addr 172.21.15.173:0/1306703841 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:35.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.516+0000 7f8ce7e00640 1 --2- 172.21.15.173:0/1306703841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ce806e270 0x7f8ce806ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.516+0000 7f8ceca00640 1 -- 172.21.15.173:0/1306703841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ce806e270 msgr2=0x7f8ce806ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:35.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.516+0000 7f8ceca00640 1 --2- 172.21.15.173:0/1306703841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ce806e270 0x7f8ce806ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.516+0000 7f8ceca00640 1 -- 172.21.15.173:0/1306703841 >> v1:172.21.15.194:6789/0 conn(0x7f8ce80cba20 legacy=0x7f8ce815d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.516+0000 7f8ceca00640 1 -- 172.21.15.173:0/1306703841 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce80cfc50 con 0x7f8ce806fd80 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.520+0000 7f8ceca00640 1 --2- 172.21.15.173:0/1306703841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ce806fd80 0x7f8ce80cb4e0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc009870 tx=0x7f8cdc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2e0f808b424e8f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.520+0000 7f8ce7400640 1 -- 172.21.15.173:0/1306703841 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0b0070 con 0x7f8ce806fd80 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.520+0000 7f8ce7400640 1 -- 172.21.15.173:0/1306703841 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc0ab600 con 0x7f8ce806fd80 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.520+0000 7f8ce7400640 1 -- 172.21.15.173:0/1306703841 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0ab9d0 con 0x7f8ce806fd80 2024-04-25T09:14:35.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.520+0000 7f8cede00640 1 -- 172.21.15.173:0/1306703841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ce806fd80 msgr2=0x7f8ce80cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.520+0000 7f8cede00640 1 --2- 172.21.15.173:0/1306703841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ce806fd80 0x7f8ce80cb4e0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc009870 tx=0x7f8cdc01c560 comp rx=0 tx=0).stop 2024-04-25T09:14:35.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.520+0000 7f8cede00640 1 -- 172.21.15.173:0/1306703841 shutdown_connections 2024-04-25T09:14:35.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.520+0000 7f8cede00640 1 --2- 172.21.15.173:0/1306703841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ce806e270 0x7f8ce806ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.520+0000 7f8cede00640 1 --2- 172.21.15.173:0/1306703841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ce806fd80 0x7f8ce80cb4e0 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.520+0000 7f8cede00640 1 -- 172.21.15.173:0/1306703841 >> 172.21.15.173:0/1306703841 conn(0x7f8ce8072710 msgr2=0x7f8ce8099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:35.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.520+0000 7f8cede00640 1 -- 172.21.15.173:0/1306703841 shutdown_connections 2024-04-25T09:14:35.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.520+0000 7f8cede00640 1 -- 172.21.15.173:0/1306703841 wait complete. 2024-04-25T09:14:35.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.520+0000 7f8cede00640 1 Processor -- start 2024-04-25T09:14:35.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.520+0000 7f8cede00640 1 -- start start 2024-04-25T09:14:35.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8cede00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ce806e270 0x7f8ce80af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8cede00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ce806fd80 0x7f8ce8151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8cede00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ce80cba20 0x7f8ce81535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8cede00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80d0450 con 0x7f8ce806e270 2024-04-25T09:14:35.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8cede00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce8070370 con 0x7f8ce80cba20 2024-04-25T09:14:35.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8cede00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80d05d0 con 0x7f8ce806fd80 2024-04-25T09:14:35.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8ceca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ce806e270 0x7f8ce80af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8ceca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ce806e270 0x7f8ce80af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39694/0 (socket says 172.21.15.173:39694) 2024-04-25T09:14:35.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8ceca00640 1 -- 172.21.15.173:0/1623647449 learned_addr learned my addr 172.21.15.173:0/1623647449 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:35.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8ce7e00640 1 --2- 172.21.15.173:0/1623647449 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ce806fd80 0x7f8ce8151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8ced400640 1 --2- 172.21.15.173:0/1623647449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ce80cba20 0x7f8ce81535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8ceca00640 1 -- 172.21.15.173:0/1623647449 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ce806fd80 msgr2=0x7f8ce8151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8ceca00640 1 --2- 172.21.15.173:0/1623647449 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ce806fd80 0x7f8ce8151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8ceca00640 1 -- 172.21.15.173:0/1623647449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ce80cba20 msgr2=0x7f8ce81535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8ceca00640 1 --2- 172.21.15.173:0/1623647449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ce80cba20 0x7f8ce81535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8ceca00640 1 -- 172.21.15.173:0/1623647449 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce80c9600 con 0x7f8ce806e270 2024-04-25T09:14:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8ce7e00640 1 --2- 172.21.15.173:0/1623647449 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ce806fd80 0x7f8ce8151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:35.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8ceca00640 1 --2- 172.21.15.173:0/1623647449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ce806e270 0x7f8ce80af390 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc01a190 tx=0x7f8cdc01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8ce4c00640 1 -- 172.21.15.173:0/1623647449 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0ba020 con 0x7f8ce806e270 2024-04-25T09:14:35.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8ce4c00640 1 -- 172.21.15.173:0/1623647449 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc0b6640 con 0x7f8ce806e270 2024-04-25T09:14:35.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8ce4c00640 1 -- 172.21.15.173:0/1623647449 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0b0040 con 0x7f8ce806e270 2024-04-25T09:14:35.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8cede00640 1 -- 172.21.15.173:0/1623647449 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce80c98e0 con 0x7f8ce806e270 2024-04-25T09:14:35.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8cede00640 1 -- 172.21.15.173:0/1623647449 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce80c9ea0 con 0x7f8ce806e270 2024-04-25T09:14:35.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.524+0000 7f8cede00640 1 -- 172.21.15.173:0/1623647449 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce8073a40 con 0x7f8ce806e270 2024-04-25T09:14:35.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.528+0000 7f8ce4c00640 1 -- 172.21.15.173:0/1623647449 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8cdc0bd020 con 0x7f8ce806e270 2024-04-25T09:14:35.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.528+0000 7f8ce4c00640 1 --2- 172.21.15.173:0/1623647449 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8cc8066f60 0x7f8cc8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.528+0000 7f8ce4c00640 1 -- 172.21.15.173:0/1623647449 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8cdc11f490 con 0x7f8ce806e270 2024-04-25T09:14:35.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.528+0000 7f8ce7e00640 1 --2- 172.21.15.173:0/1623647449 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8cc8066f60 0x7f8cc8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.528+0000 7f8ce7e00640 1 --2- 172.21.15.173:0/1623647449 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8cc8066f60 0x7f8cc8069420 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8ce81fe710 tx=0x7f8cd4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.532+0000 7f8ce4c00640 1 -- 172.21.15.173:0/1623647449 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8cdc0c4030 con 0x7f8ce806e270 2024-04-25T09:14:35.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.720+0000 7f8cede00640 1 -- 172.21.15.173:0/1623647449 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ce80baa50 con 0x7f8ce806e270 2024-04-25T09:14:35.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.720+0000 7f8ce4c00640 1 -- 172.21.15.173:0/1623647449 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4957 (secure 0 0 0) 0x7f8cdc016150 con 0x7f8ce806e270 2024-04-25T09:14:35.705 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:35.705 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":105,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/751187793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":751187793},{"type":"v1","addr":"172.21.15.173:6836","nonce":751187793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":9013,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1331227782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1331227782},{"type":"v1","addr":"172.21.15.194:6834","nonce":1331227782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":105,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T09:13:55.081334+0000","modified":"2024-04-25T09:14:29.957297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9957":{"gid":9957,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6837/401620872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":401620872},{"type":"v1","addr":"172.21.15.173:6837","nonce":401620872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_9969":{"gid":9969,"name":"b","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/3308916795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":3308916795},{"type":"v1","addr":"172.21.15.194:6835","nonce":3308916795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T09:14:35.705 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 105 2024-04-25T09:14:35.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.720+0000 7f8cede00640 1 -- 172.21.15.173:0/1623647449 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8cc8066f60 msgr2=0x7f8cc8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.720+0000 7f8cede00640 1 --2- 172.21.15.173:0/1623647449 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8cc8066f60 0x7f8cc8069420 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8ce81fe710 tx=0x7f8cd4008040 comp rx=0 tx=0).stop 2024-04-25T09:14:35.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.720+0000 7f8cede00640 1 -- 172.21.15.173:0/1623647449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ce806e270 msgr2=0x7f8ce80af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.720+0000 7f8cede00640 1 --2- 172.21.15.173:0/1623647449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ce806e270 0x7f8ce80af390 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc01a190 tx=0x7f8cdc01ada0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.720+0000 7f8cede00640 1 -- 172.21.15.173:0/1623647449 shutdown_connections 2024-04-25T09:14:35.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.720+0000 7f8cede00640 1 --2- 172.21.15.173:0/1623647449 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8cc8066f60 0x7f8cc8069420 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.720+0000 7f8cede00640 1 --2- 172.21.15.173:0/1623647449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ce80cba20 0x7f8ce81535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.720+0000 7f8cede00640 1 --2- 172.21.15.173:0/1623647449 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ce806fd80 0x7f8ce8151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.720+0000 7f8cede00640 1 --2- 172.21.15.173:0/1623647449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ce806e270 0x7f8ce80af390 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.720+0000 7f8cede00640 1 -- 172.21.15.173:0/1623647449 >> 172.21.15.173:0/1623647449 conn(0x7f8ce8072710 msgr2=0x7f8ce8099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:35.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.720+0000 7f8cede00640 1 -- 172.21.15.173:0/1623647449 shutdown_connections 2024-04-25T09:14:35.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.720+0000 7f8cede00640 1 -- 172.21.15.173:0/1623647449 wait complete. 2024-04-25T09:14:35.729 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:14:35.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.880+0000 7f95b1200640 1 Processor -- start 2024-04-25T09:14:35.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.880+0000 7f95b1200640 1 -- start start 2024-04-25T09:14:35.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.880+0000 7f95b1200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95ac0aefa0 0x7f95ac0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.880+0000 7f95b1200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f95ac15edd0 0x7f95ac0cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.880+0000 7f95b1200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ac15f320 con 0x7f95ac0b3e70 2024-04-25T09:14:35.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.880+0000 7f95b1200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ac06dd50 con 0x7f95ac15edd0 2024-04-25T09:14:35.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.880+0000 7f95b1200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac06d420 con 0x7f95ac0aefa0 2024-04-25T09:14:35.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.880+0000 7f95a9e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f95ac0b3e70 0x7f95ac0b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45412/0 (socket says 172.21.15.173:45412) 2024-04-25T09:14:35.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.880+0000 7f95a9e00640 1 -- 172.21.15.173:0/1582439550 learned_addr learned my addr 172.21.15.173:0/1582439550 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:35.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.884+0000 7f95a9400640 1 --2- 172.21.15.173:0/1582439550 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95ac0aefa0 0x7f95ac0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.884+0000 7f95aa800640 1 --2- 172.21.15.173:0/1582439550 >> v2:172.21.15.194:3300/0 conn(0x7f95ac15edd0 0x7f95ac0cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.884+0000 7f95a8a00640 1 -- 172.21.15.173:0/1582439550 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870787651 0 0) 0x7f95ac15f320 con 0x7f95ac0b3e70 2024-04-25T09:14:35.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.884+0000 7f95a8a00640 1 -- 172.21.15.173:0/1582439550 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9590003530 con 0x7f95ac0b3e70 2024-04-25T09:14:35.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.884+0000 7f95a9400640 1 -- 172.21.15.173:0/1582439550 >> v2:172.21.15.194:3300/0 conn(0x7f95ac15edd0 msgr2=0x7f95ac0cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:35.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.884+0000 7f95a9400640 1 --2- 172.21.15.173:0/1582439550 >> v2:172.21.15.194:3300/0 conn(0x7f95ac15edd0 0x7f95ac0cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.884+0000 7f95a9400640 1 -- 172.21.15.173:0/1582439550 >> v1:172.21.15.173:6789/0 conn(0x7f95ac0b3e70 legacy=0x7f95ac0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.884+0000 7f95a9400640 1 -- 172.21.15.173:0/1582439550 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac06d700 con 0x7f95ac0aefa0 2024-04-25T09:14:35.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.884+0000 7f95aa800640 1 --2- 172.21.15.173:0/1582439550 >> v2:172.21.15.194:3300/0 conn(0x7f95ac15edd0 0x7f95ac0cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:35.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.884+0000 7f95a9400640 1 --2- 172.21.15.173:0/1582439550 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95ac0aefa0 0x7f95ac0cd7a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f95980097c0 tx=0x7f959801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0169760560199be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.884+0000 7f95a8a00640 1 -- 172.21.15.173:0/1582439550 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95980ab660 con 0x7f95ac0aefa0 2024-04-25T09:14:35.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.884+0000 7f95a8a00640 1 -- 172.21.15.173:0/1582439550 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95980b0070 con 0x7f95ac0aefa0 2024-04-25T09:14:35.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.884+0000 7f95a8a00640 1 -- 172.21.15.173:0/1582439550 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95980aba20 con 0x7f95ac0aefa0 2024-04-25T09:14:35.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95b1200640 1 -- 172.21.15.173:0/1582439550 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95ac0aefa0 msgr2=0x7f95ac0cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95b1200640 1 --2- 172.21.15.173:0/1582439550 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95ac0aefa0 0x7f95ac0cd7a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f95980097c0 tx=0x7f959801c470 comp rx=0 tx=0).stop 2024-04-25T09:14:35.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95b1200640 1 -- 172.21.15.173:0/1582439550 shutdown_connections 2024-04-25T09:14:35.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95b1200640 1 --2- 172.21.15.173:0/1582439550 >> v2:172.21.15.194:3300/0 conn(0x7f95ac15edd0 0x7f95ac0cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95b1200640 1 --2- 172.21.15.173:0/1582439550 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95ac0aefa0 0x7f95ac0cd7a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95b1200640 1 -- 172.21.15.173:0/1582439550 >> 172.21.15.173:0/1582439550 conn(0x7f95ac06ac90 msgr2=0x7f95ac06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:35.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95b1200640 1 -- 172.21.15.173:0/1582439550 shutdown_connections 2024-04-25T09:14:35.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95b1200640 1 -- 172.21.15.173:0/1582439550 wait complete. 2024-04-25T09:14:35.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95b1200640 1 Processor -- start 2024-04-25T09:14:35.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95b1200640 1 -- start start 2024-04-25T09:14:35.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95b1200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95ac0aefa0 0x7f95ac1498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95b1200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95ac0b3e70 0x7f95ac1f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95b1200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95ac15edd0 0x7f95ac0cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95b1200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac165920 con 0x7f95ac15edd0 2024-04-25T09:14:35.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95b1200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac1657a0 con 0x7f95ac0aefa0 2024-04-25T09:14:35.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95b1200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac165aa0 con 0x7f95ac0b3e70 2024-04-25T09:14:35.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95aa800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95ac15edd0 0x7f95ac0cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95aa800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95ac15edd0 0x7f95ac0cea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39706/0 (socket says 172.21.15.173:39706) 2024-04-25T09:14:35.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95aa800640 1 -- 172.21.15.173:0/3169385584 learned_addr learned my addr 172.21.15.173:0/3169385584 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:35.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95a9e00640 1 --2- 172.21.15.173:0/3169385584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95ac0aefa0 0x7f95ac1498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95a9400640 1 --2- 172.21.15.173:0/3169385584 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95ac0b3e70 0x7f95ac1f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95aa800640 1 -- 172.21.15.173:0/3169385584 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95ac0b3e70 msgr2=0x7f95ac1f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95aa800640 1 --2- 172.21.15.173:0/3169385584 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95ac0b3e70 0x7f95ac1f55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95aa800640 1 -- 172.21.15.173:0/3169385584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95ac0aefa0 msgr2=0x7f95ac1498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95aa800640 1 --2- 172.21.15.173:0/3169385584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95ac0aefa0 0x7f95ac1498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.888+0000 7f95aa800640 1 -- 172.21.15.173:0/3169385584 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac149fa0 con 0x7f95ac15edd0 2024-04-25T09:14:35.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.892+0000 7f95aa800640 1 --2- 172.21.15.173:0/3169385584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95ac15edd0 0x7f95ac0cea60 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f95a400e930 tx=0x7f95a400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.892+0000 7f95a2000640 1 -- 172.21.15.173:0/3169385584 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4017070 con 0x7f95ac15edd0 2024-04-25T09:14:35.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.892+0000 7f95a2000640 1 -- 172.21.15.173:0/3169385584 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a4004020 con 0x7f95ac15edd0 2024-04-25T09:14:35.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.892+0000 7f95a2000640 1 -- 172.21.15.173:0/3169385584 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4004430 con 0x7f95ac15edd0 2024-04-25T09:14:35.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.892+0000 7f95b1200640 1 -- 172.21.15.173:0/3169385584 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ac14a280 con 0x7f95ac15edd0 2024-04-25T09:14:35.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.892+0000 7f95b1200640 1 -- 172.21.15.173:0/3169385584 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ac14a560 con 0x7f95ac15edd0 2024-04-25T09:14:35.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.892+0000 7f95b1200640 1 -- 172.21.15.173:0/3169385584 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ac073a40 con 0x7f95ac15edd0 2024-04-25T09:14:35.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.892+0000 7f95a2000640 1 -- 172.21.15.173:0/3169385584 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f95a400c940 con 0x7f95ac15edd0 2024-04-25T09:14:35.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.892+0000 7f95a2000640 1 --2- 172.21.15.173:0/3169385584 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f958c066f60 0x7f958c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.892+0000 7f95a2000640 1 -- 172.21.15.173:0/3169385584 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f95a40850a0 con 0x7f95ac15edd0 2024-04-25T09:14:35.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.892+0000 7f95a9e00640 1 --2- 172.21.15.173:0/3169385584 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f958c066f60 0x7f958c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.896+0000 7f95a9e00640 1 --2- 172.21.15.173:0/3169385584 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f958c066f60 0x7f958c069420 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f959c005c10 tx=0x7f959c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:35.896+0000 7f95a2000640 1 -- 172.21.15.173:0/3169385584 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f95a4055e50 con 0x7f95ac15edd0 2024-04-25T09:14:36.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.052+0000 7f95b1200640 1 -- 172.21.15.173:0/3169385584 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95ac0b2620 con 0x7f95ac15edd0 2024-04-25T09:14:36.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.056+0000 7f95a2000640 1 -- 172.21.15.173:0/3169385584 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+17109 (secure 0 0 0) 0x7f95a4055750 con 0x7f95ac15edd0 2024-04-25T09:14:36.040 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:36.040 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":146,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:14:34.532591+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:13:53.493356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-04-25T09:13:54.078507+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.5","mappings":[{"from":3,"to":0}]},{"pgid":"22.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:14:36.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.056+0000 7f95b1200640 1 -- 172.21.15.173:0/3169385584 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f958c066f60 msgr2=0x7f958c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.056+0000 7f95b1200640 1 --2- 172.21.15.173:0/3169385584 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f958c066f60 0x7f958c069420 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f959c005c10 tx=0x7f959c009040 comp rx=0 tx=0).stop 2024-04-25T09:14:36.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.056+0000 7f95b1200640 1 -- 172.21.15.173:0/3169385584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95ac15edd0 msgr2=0x7f95ac0cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.056+0000 7f95b1200640 1 --2- 172.21.15.173:0/3169385584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95ac15edd0 0x7f95ac0cea60 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f95a400e930 tx=0x7f95a400edf0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.056+0000 7f95b1200640 1 -- 172.21.15.173:0/3169385584 shutdown_connections 2024-04-25T09:14:36.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.056+0000 7f95b1200640 1 --2- 172.21.15.173:0/3169385584 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f958c066f60 0x7f958c069420 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.056+0000 7f95b1200640 1 --2- 172.21.15.173:0/3169385584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95ac15edd0 0x7f95ac0cea60 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.056+0000 7f95b1200640 1 --2- 172.21.15.173:0/3169385584 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95ac0b3e70 0x7f95ac1f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.056+0000 7f95b1200640 1 --2- 172.21.15.173:0/3169385584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95ac0aefa0 0x7f95ac1498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.056+0000 7f95b1200640 1 -- 172.21.15.173:0/3169385584 >> 172.21.15.173:0/3169385584 conn(0x7f95ac06ac90 msgr2=0x7f95ac0b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:36.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.056+0000 7f95b1200640 1 -- 172.21.15.173:0/3169385584 shutdown_connections 2024-04-25T09:14:36.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.056+0000 7f95b1200640 1 -- 172.21.15.173:0/3169385584 wait complete. 2024-04-25T09:14:36.061 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:14:36.061 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:36.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.212+0000 7fe0c7800640 1 Processor -- start 2024-04-25T09:14:36.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.212+0000 7fe0c7800640 1 -- start start 2024-04-25T09:14:36.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.212+0000 7fe0c7800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c015a180 0x7fe0c00b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.212+0000 7fe0c7800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c006e860 con 0x7fe0c00b2ca0 2024-04-25T09:14:36.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.212+0000 7fe0c7800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c006eb20 con 0x7fe0c0071a30 2024-04-25T09:14:36.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.212+0000 7fe0c7800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00af230 con 0x7fe0c015a180 2024-04-25T09:14:36.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0b7e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe0c00b2ca0 0x7fe0c0071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45424/0 (socket says 172.21.15.173:45424) 2024-04-25T09:14:36.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0b7e00640 1 -- 172.21.15.173:0/2514317790 learned_addr learned my addr 172.21.15.173:0/2514317790 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:36.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0c4e00640 1 --2- 172.21.15.173:0/2514317790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c015a180 0x7fe0c00b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0bfe00640 1 -- 172.21.15.173:0/2514317790 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497638719 0 0) 0x7fe0c006e860 con 0x7fe0c00b2ca0 2024-04-25T09:14:36.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0bfe00640 1 -- 172.21.15.173:0/2514317790 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0a4003450 con 0x7fe0c00b2ca0 2024-04-25T09:14:36.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0bfe00640 1 -- 172.21.15.173:0/2514317790 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4080632790 0 0) 0x7fe0a4003450 con 0x7fe0c00b2ca0 2024-04-25T09:14:36.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0bfe00640 1 -- 172.21.15.173:0/2514317790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c015a180 msgr2=0x7fe0c00b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:36.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0bfe00640 1 --2- 172.21.15.173:0/2514317790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c015a180 0x7fe0c00b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0bfe00640 1 -- 172.21.15.173:0/2514317790 >> v1:172.21.15.194:6789/0 conn(0x7fe0c0071a30 legacy=0x7fe0c006d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0bfe00640 1 -- 172.21.15.173:0/2514317790 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00aebe0 con 0x7fe0c00b2ca0 2024-04-25T09:14:36.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0bfe00640 1 -- 172.21.15.173:0/2514317790 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fe0a8001680 con 0x7fe0c00b2ca0 2024-04-25T09:14:36.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0bfe00640 1 -- 172.21.15.173:0/2514317790 >> v1:172.21.15.173:6789/0 conn(0x7fe0c00b2ca0 legacy=0x7fe0c0071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0bfe00640 1 --2- 172.21.15.173:0/2514317790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0a4003ae0 0x7fe0a4003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0bfe00640 1 --2- 172.21.15.173:0/2514317790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c015a180 0x7fe0a400a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0bfe00640 1 --2- 172.21.15.173:0/2514317790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a400b040 0x7fe0a400d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0bfe00640 1 -- 172.21.15.173:0/2514317790 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00af230 con 0x7fe0a400b040 2024-04-25T09:14:36.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0bfe00640 1 -- 172.21.15.173:0/2514317790 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a400dcb0 con 0x7fe0a4003ae0 2024-04-25T09:14:36.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0bfe00640 1 -- 172.21.15.173:0/2514317790 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a400deb0 con 0x7fe0c015a180 2024-04-25T09:14:36.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0c5800640 1 --2- 172.21.15.173:0/2514317790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a400b040 0x7fe0a400d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0c4e00640 1 --2- 172.21.15.173:0/2514317790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0a4003ae0 0x7fe0a4003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0b7e00640 1 --2- 172.21.15.173:0/2514317790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c015a180 0x7fe0a400a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0c5800640 1 -- 172.21.15.173:0/2514317790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c015a180 msgr2=0x7fe0a400a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:36.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0c5800640 1 --2- 172.21.15.173:0/2514317790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c015a180 0x7fe0a400a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0c5800640 1 -- 172.21.15.173:0/2514317790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0a4003ae0 msgr2=0x7fe0a4003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:36.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0c5800640 1 --2- 172.21.15.173:0/2514317790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0a4003ae0 0x7fe0a4003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.216+0000 7fe0c5800640 1 -- 172.21.15.173:0/2514317790 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a4003450 con 0x7fe0a400b040 2024-04-25T09:14:36.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.220+0000 7fe0c5800640 1 --2- 172.21.15.173:0/2514317790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a400b040 0x7fe0a400d4d0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8001e40 tx=0x7fe0b801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e0a3122864e2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:36.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.220+0000 7fe0bfe00640 1 -- 172.21.15.173:0/2514317790 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8001a90 con 0x7fe0a400b040 2024-04-25T09:14:36.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.220+0000 7fe0bfe00640 1 -- 172.21.15.173:0/2514317790 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b8003b80 con 0x7fe0a400b040 2024-04-25T09:14:36.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.220+0000 7fe0bfe00640 1 -- 172.21.15.173:0/2514317790 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8005080 con 0x7fe0a400b040 2024-04-25T09:14:36.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.220+0000 7fe0c7800640 1 -- 172.21.15.173:0/2514317790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a400b040 msgr2=0x7fe0a400d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.220+0000 7fe0c7800640 1 --2- 172.21.15.173:0/2514317790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a400b040 0x7fe0a400d4d0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8001e40 tx=0x7fe0b801c760 comp rx=0 tx=0).stop 2024-04-25T09:14:36.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.220+0000 7fe0c5800640 1 -- 172.21.15.173:0/2514317790 reap_dead start 2024-04-25T09:14:36.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.220+0000 7fe0c7800640 1 -- 172.21.15.173:0/2514317790 shutdown_connections 2024-04-25T09:14:36.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.220+0000 7fe0c7800640 1 -- 172.21.15.173:0/2514317790 >> 172.21.15.173:0/2514317790 conn(0x7fe0c006ac90 msgr2=0x7fe0c006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:36.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.220+0000 7fe0c7800640 1 -- 172.21.15.173:0/2514317790 shutdown_connections 2024-04-25T09:14:36.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.220+0000 7fe0c7800640 1 -- 172.21.15.173:0/2514317790 wait complete. 2024-04-25T09:14:36.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.220+0000 7fe0c7800640 1 Processor -- start 2024-04-25T09:14:36.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.220+0000 7fe0c7800640 1 -- start start 2024-04-25T09:14:36.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c7800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a400b040 0x7fe0c01effa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c7800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c00a9d70 0x7fe0c01f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c7800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c00aa1f0 0x7fe0c01f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c7800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00b4260 con 0x7fe0a400b040 2024-04-25T09:14:36.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c7800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00b40e0 con 0x7fe0c00aa1f0 2024-04-25T09:14:36.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c7800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00b43e0 con 0x7fe0c00a9d70 2024-04-25T09:14:36.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c4e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a400b040 0x7fe0c01effa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c4e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a400b040 0x7fe0c01effa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39724/0 (socket says 172.21.15.173:39724) 2024-04-25T09:14:36.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c4e00640 1 -- 172.21.15.173:0/182728893 learned_addr learned my addr 172.21.15.173:0/182728893 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:36.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0b7e00640 1 --2- 172.21.15.173:0/182728893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c00a9d70 0x7fe0c01f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c4e00640 1 -- 172.21.15.173:0/182728893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c00a9d70 msgr2=0x7fe0c01f2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c5800640 1 --2- 172.21.15.173:0/182728893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c00aa1f0 0x7fe0c01f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c4e00640 1 --2- 172.21.15.173:0/182728893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c00a9d70 0x7fe0c01f2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c4e00640 1 -- 172.21.15.173:0/182728893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c00aa1f0 msgr2=0x7fe0c01f3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c4e00640 1 --2- 172.21.15.173:0/182728893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c00aa1f0 0x7fe0c01f3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c4e00640 1 -- 172.21.15.173:0/182728893 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c01f04e0 con 0x7fe0a400b040 2024-04-25T09:14:36.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0b7e00640 1 --2- 172.21.15.173:0/182728893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c00a9d70 0x7fe0c01f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:36.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c5800640 1 --2- 172.21.15.173:0/182728893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c00aa1f0 0x7fe0c01f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:36.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c4e00640 1 --2- 172.21.15.173:0/182728893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a400b040 0x7fe0c01effa0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00119d0 tx=0x7fe0b0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:36.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0bd600640 1 -- 172.21.15.173:0/182728893 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000fb50 con 0x7fe0a400b040 2024-04-25T09:14:36.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0bd600640 1 -- 172.21.15.173:0/182728893 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b000fcf0 con 0x7fe0a400b040 2024-04-25T09:14:36.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0bd600640 1 -- 172.21.15.173:0/182728893 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000fea0 con 0x7fe0a400b040 2024-04-25T09:14:36.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c7800640 1 -- 172.21.15.173:0/182728893 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c00a8830 con 0x7fe0a400b040 2024-04-25T09:14:36.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c7800640 1 -- 172.21.15.173:0/182728893 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c00a8df0 con 0x7fe0a400b040 2024-04-25T09:14:36.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0c7800640 1 -- 172.21.15.173:0/182728893 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c00a9510 con 0x7fe0a400b040 2024-04-25T09:14:36.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.224+0000 7fe0bd600640 1 -- 172.21.15.173:0/182728893 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe0b0012040 con 0x7fe0a400b040 2024-04-25T09:14:36.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.228+0000 7fe0bd600640 1 --2- 172.21.15.173:0/182728893 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe09c066f60 0x7fe09c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.228+0000 7fe0bd600640 1 -- 172.21.15.173:0/182728893 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe0b0085910 con 0x7fe0a400b040 2024-04-25T09:14:36.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.228+0000 7fe0b7e00640 1 --2- 172.21.15.173:0/182728893 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe09c066f60 0x7fe09c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.228+0000 7fe0b7e00640 1 --2- 172.21.15.173:0/182728893 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe09c066f60 0x7fe09c069420 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00b2840 tx=0x7fe0a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:36.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.232+0000 7fe0bd600640 1 -- 172.21.15.173:0/182728893 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe0c01f04e0 con 0x7fe0a400b040 2024-04-25T09:14:36.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.420+0000 7fe0c7800640 1 -- 172.21.15.173:0/182728893 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0c006b590 con 0x7fe0a400b040 2024-04-25T09:14:36.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.420+0000 7fe0bd600640 1 -- 172.21.15.173:0/182728893 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4957 (secure 0 0 0) 0x7fe0b0019030 con 0x7fe0a400b040 2024-04-25T09:14:36.404 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:36.404 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":105,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/751187793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":751187793},{"type":"v1","addr":"172.21.15.173:6836","nonce":751187793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":9013,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1331227782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1331227782},{"type":"v1","addr":"172.21.15.194:6834","nonce":1331227782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":105,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T09:13:55.081334+0000","modified":"2024-04-25T09:14:29.957297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9957":{"gid":9957,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6837/401620872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":401620872},{"type":"v1","addr":"172.21.15.173:6837","nonce":401620872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_9969":{"gid":9969,"name":"b","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/3308916795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":3308916795},{"type":"v1","addr":"172.21.15.194:6835","nonce":3308916795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T09:14:36.405 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 105 2024-04-25T09:14:36.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.420+0000 7fe0c7800640 1 -- 172.21.15.173:0/182728893 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe09c066f60 msgr2=0x7fe09c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.420+0000 7fe0c7800640 1 --2- 172.21.15.173:0/182728893 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe09c066f60 0x7fe09c069420 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00b2840 tx=0x7fe0a8009040 comp rx=0 tx=0).stop 2024-04-25T09:14:36.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.420+0000 7fe0c7800640 1 -- 172.21.15.173:0/182728893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a400b040 msgr2=0x7fe0c01effa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.420+0000 7fe0c7800640 1 --2- 172.21.15.173:0/182728893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a400b040 0x7fe0c01effa0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00119d0 tx=0x7fe0b0011e90 comp rx=0 tx=0).stop 2024-04-25T09:14:36.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.420+0000 7fe0c7800640 1 -- 172.21.15.173:0/182728893 shutdown_connections 2024-04-25T09:14:36.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.420+0000 7fe0c7800640 1 --2- 172.21.15.173:0/182728893 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe09c066f60 0x7fe09c069420 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.420+0000 7fe0c7800640 1 --2- 172.21.15.173:0/182728893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c00aa1f0 0x7fe0c01f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.420+0000 7fe0c7800640 1 --2- 172.21.15.173:0/182728893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0c00a9d70 0x7fe0c01f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.420+0000 7fe0c7800640 1 --2- 172.21.15.173:0/182728893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a400b040 0x7fe0c01effa0 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.420+0000 7fe0c7800640 1 -- 172.21.15.173:0/182728893 >> 172.21.15.173:0/182728893 conn(0x7fe0c006ac90 msgr2=0x7fe0c00b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:36.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.420+0000 7fe0c7800640 1 -- 172.21.15.173:0/182728893 shutdown_connections 2024-04-25T09:14:36.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.420+0000 7fe0c7800640 1 -- 172.21.15.173:0/182728893 wait complete. 2024-04-25T09:14:36.425 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:36.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.576+0000 7fd06b800640 1 Processor -- start 2024-04-25T09:14:36.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.576+0000 7fd06b800640 1 -- start start 2024-04-25T09:14:36.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.576+0000 7fd06b800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd0640aefa0 0x7fd0640cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.576+0000 7fd06b800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06415f320 con 0x7fd06415edd0 2024-04-25T09:14:36.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.576+0000 7fd06b800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06406d420 con 0x7fd0640b3e70 2024-04-25T09:14:36.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.576+0000 7fd06b800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06406dd50 con 0x7fd0640aefa0 2024-04-25T09:14:36.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.576+0000 7fd069800640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd06415edd0 0x7fd0640cdce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45428/0 (socket says 172.21.15.173:45428) 2024-04-25T09:14:36.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.576+0000 7fd069800640 1 -- 172.21.15.173:0/989934133 learned_addr learned my addr 172.21.15.173:0/989934133 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:36.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.576+0000 7fd05be00640 1 --2- 172.21.15.173:0/989934133 >> v2:172.21.15.194:3300/0 conn(0x7fd0640aefa0 0x7fd0640cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd063e00640 1 -- 172.21.15.173:0/989934133 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748271152 0 0) 0x7fd06415f320 con 0x7fd06415edd0 2024-04-25T09:14:36.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd063e00640 1 -- 172.21.15.173:0/989934133 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd048003530 con 0x7fd06415edd0 2024-04-25T09:14:36.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd063e00640 1 -- 172.21.15.173:0/989934133 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096591969 0 0) 0x7fd06406d420 con 0x7fd0640b3e70 2024-04-25T09:14:36.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd063e00640 1 -- 172.21.15.173:0/989934133 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd06415f320 con 0x7fd0640b3e70 2024-04-25T09:14:36.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd063e00640 1 -- 172.21.15.173:0/989934133 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3121985816 0 0) 0x7fd048003530 con 0x7fd06415edd0 2024-04-25T09:14:36.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd063e00640 1 -- 172.21.15.173:0/989934133 >> v2:172.21.15.194:3300/0 conn(0x7fd0640aefa0 msgr2=0x7fd0640cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:36.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd063e00640 1 --2- 172.21.15.173:0/989934133 >> v2:172.21.15.194:3300/0 conn(0x7fd0640aefa0 0x7fd0640cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd063e00640 1 -- 172.21.15.173:0/989934133 >> v1:172.21.15.194:6789/0 conn(0x7fd0640b3e70 legacy=0x7fd0640b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd063e00640 1 -- 172.21.15.173:0/989934133 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06406d700 con 0x7fd06415edd0 2024-04-25T09:14:36.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd063e00640 1 -- 172.21.15.173:0/989934133 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fd05c001a00 con 0x7fd06415edd0 2024-04-25T09:14:36.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd063e00640 1 -- 172.21.15.173:0/989934133 >> v1:172.21.15.173:6789/0 conn(0x7fd06415edd0 legacy=0x7fd0640cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd063e00640 1 --2- 172.21.15.173:0/989934133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd048003b50 0x7fd048003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd063e00640 1 --2- 172.21.15.173:0/989934133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd048004810 0x7fd048004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd063e00640 1 --2- 172.21.15.173:0/989934133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0480051d0 0x7fd04800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd063e00640 1 -- 172.21.15.173:0/989934133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06406dd50 con 0x7fd0480051d0 2024-04-25T09:14:36.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd063e00640 1 -- 172.21.15.173:0/989934133 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04800c050 con 0x7fd048003b50 2024-04-25T09:14:36.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd063e00640 1 -- 172.21.15.173:0/989934133 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04800c250 con 0x7fd048004810 2024-04-25T09:14:36.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd069800640 1 --2- 172.21.15.173:0/989934133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0480051d0 0x7fd04800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd068e00640 1 --2- 172.21.15.173:0/989934133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd048003b50 0x7fd048003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd05be00640 1 --2- 172.21.15.173:0/989934133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd048004810 0x7fd048004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd069800640 1 -- 172.21.15.173:0/989934133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd048004810 msgr2=0x7fd048004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:36.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd069800640 1 --2- 172.21.15.173:0/989934133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd048004810 0x7fd048004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd069800640 1 -- 172.21.15.173:0/989934133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd048003b50 msgr2=0x7fd048003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:36.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd069800640 1 --2- 172.21.15.173:0/989934133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd048003b50 0x7fd048003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.580+0000 7fd069800640 1 -- 172.21.15.173:0/989934133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd048003530 con 0x7fd0480051d0 2024-04-25T09:14:36.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd069800640 1 -- 172.21.15.173:0/989934133 reap_dead start 2024-04-25T09:14:36.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd069800640 1 --2- 172.21.15.173:0/989934133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0480051d0 0x7fd04800b9d0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00a7c0 tx=0x7fd05c01fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b36e88116daee82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:36.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd063e00640 1 -- 172.21.15.173:0/989934133 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c00a410 con 0x7fd0480051d0 2024-04-25T09:14:36.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd063e00640 1 -- 172.21.15.173:0/989934133 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c0aa690 con 0x7fd0480051d0 2024-04-25T09:14:36.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd063e00640 1 -- 172.21.15.173:0/989934133 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c0aaa80 con 0x7fd0480051d0 2024-04-25T09:14:36.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd06b800640 1 -- 172.21.15.173:0/989934133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0480051d0 msgr2=0x7fd04800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd06b800640 1 --2- 172.21.15.173:0/989934133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0480051d0 0x7fd04800b9d0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00a7c0 tx=0x7fd05c01fa40 comp rx=0 tx=0).stop 2024-04-25T09:14:36.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd06b800640 1 -- 172.21.15.173:0/989934133 shutdown_connections 2024-04-25T09:14:36.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd06b800640 1 --2- 172.21.15.173:0/989934133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0480051d0 0x7fd04800b9d0 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd06b800640 1 -- 172.21.15.173:0/989934133 >> 172.21.15.173:0/989934133 conn(0x7fd06406ac90 msgr2=0x7fd06406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:36.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd06b800640 1 -- 172.21.15.173:0/989934133 shutdown_connections 2024-04-25T09:14:36.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd06b800640 1 -- 172.21.15.173:0/989934133 wait complete. 2024-04-25T09:14:36.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd06b800640 1 Processor -- start 2024-04-25T09:14:36.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd06b800640 1 -- start start 2024-04-25T09:14:36.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd06b800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0480051d0 0x7fd0640cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd06b800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0641611d0 0x7fd064145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd06b800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0640cee70 0x7fd0640cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd06b800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06406e1c0 con 0x7fd0641611d0 2024-04-25T09:14:36.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd06b800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06415aba0 con 0x7fd0640cee70 2024-04-25T09:14:36.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd06b800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06406e340 con 0x7fd0480051d0 2024-04-25T09:14:36.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd05be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0641611d0 0x7fd064145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd05be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0641611d0 0x7fd064145130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39734/0 (socket says 172.21.15.173:39734) 2024-04-25T09:14:36.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd05be00640 1 -- 172.21.15.173:0/1635782439 learned_addr learned my addr 172.21.15.173:0/1635782439 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:36.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.584+0000 7fd068e00640 1 --2- 172.21.15.173:0/1635782439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0480051d0 0x7fd0640cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.588+0000 7fd069800640 1 --2- 172.21.15.173:0/1635782439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0640cee70 0x7fd0640cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.588+0000 7fd05be00640 1 -- 172.21.15.173:0/1635782439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0480051d0 msgr2=0x7fd0640cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.588+0000 7fd05be00640 1 --2- 172.21.15.173:0/1635782439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0480051d0 0x7fd0640cfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.588+0000 7fd05be00640 1 -- 172.21.15.173:0/1635782439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0640cee70 msgr2=0x7fd0640cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.588+0000 7fd05be00640 1 --2- 172.21.15.173:0/1635782439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0640cee70 0x7fd0640cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.588+0000 7fd05be00640 1 -- 172.21.15.173:0/1635782439 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd064154ff0 con 0x7fd0641611d0 2024-04-25T09:14:36.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.588+0000 7fd05be00640 1 --2- 172.21.15.173:0/1635782439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0641611d0 0x7fd064145130 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7fd04c011960 tx=0x7fd04c011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:36.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.588+0000 7fd061600640 1 -- 172.21.15.173:0/1635782439 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c00fa30 con 0x7fd0641611d0 2024-04-25T09:14:36.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.588+0000 7fd061600640 1 -- 172.21.15.173:0/1635782439 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c00fbf0 con 0x7fd0641611d0 2024-04-25T09:14:36.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.588+0000 7fd061600640 1 -- 172.21.15.173:0/1635782439 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c014440 con 0x7fd0641611d0 2024-04-25T09:14:36.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.588+0000 7fd06b800640 1 -- 172.21.15.173:0/1635782439 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd064161650 con 0x7fd0641611d0 2024-04-25T09:14:36.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.588+0000 7fd06b800640 1 -- 172.21.15.173:0/1635782439 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd064160390 con 0x7fd0641611d0 2024-04-25T09:14:36.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.588+0000 7fd06b800640 1 -- 172.21.15.173:0/1635782439 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd064073a40 con 0x7fd0641611d0 2024-04-25T09:14:36.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.588+0000 7fd061600640 1 -- 172.21.15.173:0/1635782439 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd04c012040 con 0x7fd0641611d0 2024-04-25T09:14:36.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.588+0000 7fd061600640 1 --2- 172.21.15.173:0/1635782439 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd040066f60 0x7fd040069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.592+0000 7fd061600640 1 -- 172.21.15.173:0/1635782439 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd04c0855e0 con 0x7fd0641611d0 2024-04-25T09:14:36.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.592+0000 7fd068e00640 1 --2- 172.21.15.173:0/1635782439 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd040066f60 0x7fd040069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.592+0000 7fd068e00640 1 --2- 172.21.15.173:0/1635782439 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd040066f60 0x7fd040069420 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd054000c10 tx=0x7fd054009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:36.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.596+0000 7fd061600640 1 -- 172.21.15.173:0/1635782439 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd064161650 con 0x7fd0641611d0 2024-04-25T09:14:36.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.780+0000 7fd06b800640 1 -- 172.21.15.173:0/1635782439 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0640b39c0 con 0x7fd0641611d0 2024-04-25T09:14:36.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.784+0000 7fd061600640 1 -- 172.21.15.173:0/1635782439 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4957 (secure 0 0 0) 0x7fd04c019030 con 0x7fd0641611d0 2024-04-25T09:14:36.768 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:36.768 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":105,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/751187793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":751187793},{"type":"v1","addr":"172.21.15.173:6836","nonce":751187793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":9013,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1331227782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1331227782},{"type":"v1","addr":"172.21.15.194:6834","nonce":1331227782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":105,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T09:13:55.081334+0000","modified":"2024-04-25T09:14:29.957297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9957":{"gid":9957,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6837/401620872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":401620872},{"type":"v1","addr":"172.21.15.173:6837","nonce":401620872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_9969":{"gid":9969,"name":"b","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/3308916795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":3308916795},{"type":"v1","addr":"172.21.15.194:6835","nonce":3308916795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T09:14:36.768 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 105 2024-04-25T09:14:36.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.784+0000 7fd06b800640 1 -- 172.21.15.173:0/1635782439 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd040066f60 msgr2=0x7fd040069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.784+0000 7fd06b800640 1 --2- 172.21.15.173:0/1635782439 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd040066f60 0x7fd040069420 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd054000c10 tx=0x7fd054009040 comp rx=0 tx=0).stop 2024-04-25T09:14:36.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.784+0000 7fd06b800640 1 -- 172.21.15.173:0/1635782439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0641611d0 msgr2=0x7fd064145130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.784+0000 7fd06b800640 1 --2- 172.21.15.173:0/1635782439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0641611d0 0x7fd064145130 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7fd04c011960 tx=0x7fd04c011d60 comp rx=0 tx=0).stop 2024-04-25T09:14:36.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.784+0000 7fd06b800640 1 -- 172.21.15.173:0/1635782439 shutdown_connections 2024-04-25T09:14:36.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.784+0000 7fd06b800640 1 --2- 172.21.15.173:0/1635782439 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd040066f60 0x7fd040069420 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.784+0000 7fd06b800640 1 --2- 172.21.15.173:0/1635782439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0640cee70 0x7fd0640cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.784+0000 7fd06b800640 1 --2- 172.21.15.173:0/1635782439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0641611d0 0x7fd064145130 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.784+0000 7fd06b800640 1 --2- 172.21.15.173:0/1635782439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0480051d0 0x7fd0640cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.784+0000 7fd06b800640 1 -- 172.21.15.173:0/1635782439 >> 172.21.15.173:0/1635782439 conn(0x7fd06406ac90 msgr2=0x7fd06406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:36.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.784+0000 7fd06b800640 1 -- 172.21.15.173:0/1635782439 shutdown_connections 2024-04-25T09:14:36.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.784+0000 7fd06b800640 1 -- 172.21.15.173:0/1635782439 wait complete. 2024-04-25T09:14:36.788 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:14:36.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.940+0000 7f903ba00640 1 Processor -- start 2024-04-25T09:14:36.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.940+0000 7f903ba00640 1 -- start start 2024-04-25T09:14:36.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.940+0000 7f903ba00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9034145250 0x7f903415c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.940+0000 7f903ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90340ccd30 0x7f9034071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.940+0000 7f903ba00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903415cec0 con 0x7f90340cc8b0 2024-04-25T09:14:36.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.940+0000 7f903ba00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903406e7c0 con 0x7f9034145250 2024-04-25T09:14:36.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.940+0000 7f903ba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903406d720 con 0x7f90340ccd30 2024-04-25T09:14:36.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.940+0000 7f9033e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f90340cc8b0 0x7f9034071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45442/0 (socket says 172.21.15.173:45442) 2024-04-25T09:14:36.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.940+0000 7f9033e00640 1 -- 172.21.15.173:0/759472299 learned_addr learned my addr 172.21.15.173:0/759472299 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:36.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.940+0000 7f9039a00640 1 --2- 172.21.15.173:0/759472299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90340ccd30 0x7f9034071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.940+0000 7f9039000640 1 --2- 172.21.15.173:0/759472299 >> v2:172.21.15.194:3300/0 conn(0x7f9034145250 0x7f903415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033400640 1 -- 172.21.15.173:0/759472299 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776518431 0 0) 0x7f9020001120 con 0x7f90340cc8b0 2024-04-25T09:14:36.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033400640 1 -- 172.21.15.173:0/759472299 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9018003530 con 0x7f90340cc8b0 2024-04-25T09:14:36.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033400640 1 -- 172.21.15.173:0/759472299 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3304075291 0 0) 0x7f9018003530 con 0x7f90340cc8b0 2024-04-25T09:14:36.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033400640 1 -- 172.21.15.173:0/759472299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90340ccd30 msgr2=0x7f9034071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:36.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033400640 1 --2- 172.21.15.173:0/759472299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90340ccd30 0x7f9034071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033400640 1 -- 172.21.15.173:0/759472299 >> v2:172.21.15.194:3300/0 conn(0x7f9034145250 msgr2=0x7f903415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:36.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033400640 1 --2- 172.21.15.173:0/759472299 >> v2:172.21.15.194:3300/0 conn(0x7f9034145250 0x7f903415c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033400640 1 -- 172.21.15.173:0/759472299 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903406da00 con 0x7f90340cc8b0 2024-04-25T09:14:36.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033400640 1 -- 172.21.15.173:0/759472299 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f9020001850 con 0x7f90340cc8b0 2024-04-25T09:14:36.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9039a00640 1 --2- 172.21.15.173:0/759472299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90340ccd30 0x7f9034071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:36.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033400640 1 -- 172.21.15.173:0/759472299 >> v1:172.21.15.173:6789/0 conn(0x7f90340cc8b0 legacy=0x7f9034071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033400640 1 --2- 172.21.15.173:0/759472299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90180039c0 0x7f9018003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033400640 1 --2- 172.21.15.173:0/759472299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9018004810 0x7f9018004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033400640 1 --2- 172.21.15.173:0/759472299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90340ccd30 0x7f90180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033400640 1 -- 172.21.15.173:0/759472299 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903406e7c0 con 0x7f9018004810 2024-04-25T09:14:36.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033400640 1 -- 172.21.15.173:0/759472299 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903406d720 con 0x7f90180039c0 2024-04-25T09:14:36.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033400640 1 -- 172.21.15.173:0/759472299 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901800b9d0 con 0x7f90340ccd30 2024-04-25T09:14:36.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033e00640 1 --2- 172.21.15.173:0/759472299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9018004810 0x7f9018004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9039a00640 1 --2- 172.21.15.173:0/759472299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90340ccd30 0x7f90180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9039000640 1 --2- 172.21.15.173:0/759472299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90180039c0 0x7f9018003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033e00640 1 -- 172.21.15.173:0/759472299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90340ccd30 msgr2=0x7f90180051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:36.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033e00640 1 --2- 172.21.15.173:0/759472299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90340ccd30 0x7f90180051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033e00640 1 -- 172.21.15.173:0/759472299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90180039c0 msgr2=0x7f9018003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:36.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033e00640 1 --2- 172.21.15.173:0/759472299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90180039c0 0x7f9018003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033e00640 1 -- 172.21.15.173:0/759472299 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9018003530 con 0x7f9018004810 2024-04-25T09:14:36.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.944+0000 7f9033e00640 1 --2- 172.21.15.173:0/759472299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9018004810 0x7f9018004c90 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f902000c4c0 tx=0x7f902001f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf7bdc8c5bc2d79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:36.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f9033400640 1 -- 172.21.15.173:0/759472299 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902000c0e0 con 0x7f9018004810 2024-04-25T09:14:36.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f9033400640 1 -- 172.21.15.173:0/759472299 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9020005b00 con 0x7f9018004810 2024-04-25T09:14:36.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f9033400640 1 -- 172.21.15.173:0/759472299 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020007070 con 0x7f9018004810 2024-04-25T09:14:36.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f903ba00640 1 -- 172.21.15.173:0/759472299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9018004810 msgr2=0x7f9018004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f903ba00640 1 --2- 172.21.15.173:0/759472299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9018004810 0x7f9018004c90 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f902000c4c0 tx=0x7f902001f420 comp rx=0 tx=0).stop 2024-04-25T09:14:36.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f9039a00640 1 -- 172.21.15.173:0/759472299 reap_dead start 2024-04-25T09:14:36.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f903ba00640 1 -- 172.21.15.173:0/759472299 shutdown_connections 2024-04-25T09:14:36.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f903ba00640 1 -- 172.21.15.173:0/759472299 >> 172.21.15.173:0/759472299 conn(0x7f903406ac90 msgr2=0x7f903406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:36.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f903ba00640 1 -- 172.21.15.173:0/759472299 shutdown_connections 2024-04-25T09:14:36.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f903ba00640 1 -- 172.21.15.173:0/759472299 wait complete. 2024-04-25T09:14:36.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f903ba00640 1 Processor -- start 2024-04-25T09:14:36.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f903ba00640 1 -- start start 2024-04-25T09:14:36.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f903ba00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9018004810 0x7f90340b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f903ba00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90341e4120 0x7f90340ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f903ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f903415ade0 0x7f903415b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f903ba00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903406e2a0 con 0x7f90341e4120 2024-04-25T09:14:36.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f903ba00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903406dfc0 con 0x7f9018004810 2024-04-25T09:14:36.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f903ba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9034145630 con 0x7f903415ade0 2024-04-25T09:14:36.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f9033e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90341e4120 0x7f90340ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f9033e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90341e4120 0x7f90340ceb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39752/0 (socket says 172.21.15.173:39752) 2024-04-25T09:14:36.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f9033e00640 1 -- 172.21.15.173:0/3592497415 learned_addr learned my addr 172.21.15.173:0/3592497415 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:36.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f9039000640 1 --2- 172.21.15.173:0/3592497415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9018004810 0x7f90340b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.948+0000 7f9039a00640 1 --2- 172.21.15.173:0/3592497415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f903415ade0 0x7f903415b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.952+0000 7f9033e00640 1 -- 172.21.15.173:0/3592497415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f903415ade0 msgr2=0x7f903415b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.952+0000 7f9033e00640 1 --2- 172.21.15.173:0/3592497415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f903415ade0 0x7f903415b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.952+0000 7f9033e00640 1 -- 172.21.15.173:0/3592497415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9018004810 msgr2=0x7f90340b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:36.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.952+0000 7f9033e00640 1 --2- 172.21.15.173:0/3592497415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9018004810 0x7f90340b3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:36.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.952+0000 7f9033e00640 1 -- 172.21.15.173:0/3592497415 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90341e5680 con 0x7f90341e4120 2024-04-25T09:14:36.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.952+0000 7f9039000640 1 --2- 172.21.15.173:0/3592497415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9018004810 0x7f90340b3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:36.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.952+0000 7f9033e00640 1 --2- 172.21.15.173:0/3592497415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90341e4120 0x7f90340ceb10 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f902001f250 tx=0x7f9018005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:36.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.952+0000 7f9030c00640 1 -- 172.21.15.173:0/3592497415 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020001120 con 0x7f90341e4120 2024-04-25T09:14:36.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.952+0000 7f9030c00640 1 -- 172.21.15.173:0/3592497415 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9020005cb0 con 0x7f90341e4120 2024-04-25T09:14:36.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.952+0000 7f9030c00640 1 -- 172.21.15.173:0/3592497415 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020005e60 con 0x7f90341e4120 2024-04-25T09:14:36.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.952+0000 7f903ba00640 1 -- 172.21.15.173:0/3592497415 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903415b7b0 con 0x7f90341e4120 2024-04-25T09:14:36.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.952+0000 7f903ba00640 1 -- 172.21.15.173:0/3592497415 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90341e48c0 con 0x7f90341e4120 2024-04-25T09:14:36.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.952+0000 7f903ba00640 1 -- 172.21.15.173:0/3592497415 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9034073a40 con 0x7f90341e4120 2024-04-25T09:14:36.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.952+0000 7f9030c00640 1 -- 172.21.15.173:0/3592497415 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9020004a10 con 0x7f90341e4120 2024-04-25T09:14:36.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.952+0000 7f9030c00640 1 --2- 172.21.15.173:0/3592497415 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9014066f60 0x7f9014069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:36.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.952+0000 7f9030c00640 1 -- 172.21.15.173:0/3592497415 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9020121990 con 0x7f90341e4120 2024-04-25T09:14:36.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.952+0000 7f9039000640 1 --2- 172.21.15.173:0/3592497415 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9014066f60 0x7f9014069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:36.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.956+0000 7f9039000640 1 --2- 172.21.15.173:0/3592497415 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9014066f60 0x7f9014069420 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9024007520 tx=0x7f902400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:36.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:36.956+0000 7f9030c00640 1 -- 172.21.15.173:0/3592497415 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f90200c3070 con 0x7f90341e4120 2024-04-25T09:14:37.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.112+0000 7f903ba00640 1 -- 172.21.15.173:0/3592497415 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f903406f5c0 con 0x7f90341e4120 2024-04-25T09:14:37.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.116+0000 7f9030c00640 1 -- 172.21.15.173:0/3592497415 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+17109 (secure 0 0 0) 0x7f903415cec0 con 0x7f90341e4120 2024-04-25T09:14:37.100 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:37.100 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":146,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:14:34.532591+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:13:53.493356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-04-25T09:13:54.078507+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.5","mappings":[{"from":3,"to":0}]},{"pgid":"22.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:14:37.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.116+0000 7f903ba00640 1 -- 172.21.15.173:0/3592497415 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9014066f60 msgr2=0x7f9014069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:37.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.116+0000 7f903ba00640 1 --2- 172.21.15.173:0/3592497415 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9014066f60 0x7f9014069420 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9024007520 tx=0x7f902400b040 comp rx=0 tx=0).stop 2024-04-25T09:14:37.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.116+0000 7f903ba00640 1 -- 172.21.15.173:0/3592497415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90341e4120 msgr2=0x7f90340ceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:37.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.116+0000 7f903ba00640 1 --2- 172.21.15.173:0/3592497415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90341e4120 0x7f90340ceb10 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f902001f250 tx=0x7f9018005840 comp rx=0 tx=0).stop 2024-04-25T09:14:37.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.116+0000 7f903ba00640 1 -- 172.21.15.173:0/3592497415 shutdown_connections 2024-04-25T09:14:37.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.116+0000 7f903ba00640 1 --2- 172.21.15.173:0/3592497415 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f9014066f60 0x7f9014069420 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.116+0000 7f903ba00640 1 --2- 172.21.15.173:0/3592497415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f903415ade0 0x7f903415b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.116+0000 7f903ba00640 1 --2- 172.21.15.173:0/3592497415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90341e4120 0x7f90340ceb10 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.116+0000 7f903ba00640 1 --2- 172.21.15.173:0/3592497415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9018004810 0x7f90340b3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.116+0000 7f903ba00640 1 -- 172.21.15.173:0/3592497415 >> 172.21.15.173:0/3592497415 conn(0x7f903406ac90 msgr2=0x7f90340b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:37.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.116+0000 7f903ba00640 1 -- 172.21.15.173:0/3592497415 shutdown_connections 2024-04-25T09:14:37.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.116+0000 7f903ba00640 1 -- 172.21.15.173:0/3592497415 wait complete. 2024-04-25T09:14:37.122 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:14:37.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.272+0000 7fe378200640 1 Processor -- start 2024-04-25T09:14:37.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.272+0000 7fe378200640 1 -- start start 2024-04-25T09:14:37.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.276+0000 7fe378200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe3700b3fe0 0x7fe3700b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:37.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.276+0000 7fe378200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3700cc260 0x7fe3700cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:37.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.276+0000 7fe378200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37006d4b0 con 0x7fe370145290 2024-04-25T09:14:37.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.276+0000 7fe378200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37006d790 con 0x7fe3700b3fe0 2024-04-25T09:14:37.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.276+0000 7fe378200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37006da70 con 0x7fe3700cc260 2024-04-25T09:14:37.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.276+0000 7fe374e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe3700b3fe0 0x7fe3700b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:37.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.276+0000 7fe374e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe3700b3fe0 0x7fe3700b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39756/0 (socket says 172.21.15.173:39756) 2024-04-25T09:14:37.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.276+0000 7fe374e00640 1 -- 172.21.15.173:0/3219891881 learned_addr learned my addr 172.21.15.173:0/3219891881 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:37.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.276+0000 7fe374e00640 1 -- 172.21.15.173:0/3219891881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3700cc260 msgr2=0x7fe3700cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:37.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.276+0000 7fe374e00640 1 --2- 172.21.15.173:0/3219891881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3700cc260 0x7fe3700cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.276+0000 7fe374e00640 1 -- 172.21.15.173:0/3219891881 >> v1:172.21.15.194:6789/0 conn(0x7fe370145290 legacy=0x7fe37015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:37.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.276+0000 7fe374e00640 1 -- 172.21.15.173:0/3219891881 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37006dd50 con 0x7fe3700b3fe0 2024-04-25T09:14:37.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.280+0000 7fe374e00640 1 --2- 172.21.15.173:0/3219891881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3700b3fe0 0x7fe3700b4450 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7fe35c009870 tx=0x7fe35c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96c928f88658d8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:37.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.280+0000 7fe36fe00640 1 -- 172.21.15.173:0/3219891881 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c0b0070 con 0x7fe3700b3fe0 2024-04-25T09:14:37.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.280+0000 7fe36fe00640 1 -- 172.21.15.173:0/3219891881 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35c0ab600 con 0x7fe3700b3fe0 2024-04-25T09:14:37.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.280+0000 7fe36fe00640 1 -- 172.21.15.173:0/3219891881 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c0ab9d0 con 0x7fe3700b3fe0 2024-04-25T09:14:37.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.280+0000 7fe378200640 1 -- 172.21.15.173:0/3219891881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3700b3fe0 msgr2=0x7fe3700b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:37.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.280+0000 7fe378200640 1 --2- 172.21.15.173:0/3219891881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3700b3fe0 0x7fe3700b4450 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7fe35c009870 tx=0x7fe35c01c400 comp rx=0 tx=0).stop 2024-04-25T09:14:37.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.280+0000 7fe378200640 1 -- 172.21.15.173:0/3219891881 shutdown_connections 2024-04-25T09:14:37.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.280+0000 7fe378200640 1 --2- 172.21.15.173:0/3219891881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3700cc260 0x7fe3700cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.280+0000 7fe378200640 1 --2- 172.21.15.173:0/3219891881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3700b3fe0 0x7fe3700b4450 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.280+0000 7fe378200640 1 -- 172.21.15.173:0/3219891881 >> 172.21.15.173:0/3219891881 conn(0x7fe37006ac90 msgr2=0x7fe37006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:37.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.280+0000 7fe378200640 1 -- 172.21.15.173:0/3219891881 shutdown_connections 2024-04-25T09:14:37.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.280+0000 7fe378200640 1 -- 172.21.15.173:0/3219891881 wait complete. 2024-04-25T09:14:37.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.280+0000 7fe378200640 1 Processor -- start 2024-04-25T09:14:37.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.280+0000 7fe378200640 1 -- start start 2024-04-25T09:14:37.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe378200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3700b3fe0 0x7fe37015b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:37.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe378200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3700cc260 0x7fe3700ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:37.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe378200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe370145290 0x7fe370143200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:37.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe378200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37006eee0 con 0x7fe3700cc260 2024-04-25T09:14:37.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe378200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37006ed60 con 0x7fe3700b3fe0 2024-04-25T09:14:37.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe378200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37006f060 con 0x7fe370145290 2024-04-25T09:14:37.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe374e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3700cc260 0x7fe3700ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:37.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe374e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3700cc260 0x7fe3700ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39772/0 (socket says 172.21.15.173:39772) 2024-04-25T09:14:37.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe374e00640 1 -- 172.21.15.173:0/1904687720 learned_addr learned my addr 172.21.15.173:0/1904687720 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:37.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe376200640 1 --2- 172.21.15.173:0/1904687720 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe370145290 0x7fe370143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:37.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe375800640 1 --2- 172.21.15.173:0/1904687720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3700b3fe0 0x7fe37015b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:37.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe374e00640 1 -- 172.21.15.173:0/1904687720 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe370145290 msgr2=0x7fe370143200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:37.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe374e00640 1 --2- 172.21.15.173:0/1904687720 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe370145290 0x7fe370143200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe374e00640 1 -- 172.21.15.173:0/1904687720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3700b3fe0 msgr2=0x7fe37015b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:37.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe374e00640 1 --2- 172.21.15.173:0/1904687720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3700b3fe0 0x7fe37015b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe374e00640 1 -- 172.21.15.173:0/1904687720 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3700ace80 con 0x7fe3700cc260 2024-04-25T09:14:37.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe375800640 1 --2- 172.21.15.173:0/1904687720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3700b3fe0 0x7fe37015b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:37.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe374e00640 1 --2- 172.21.15.173:0/1904687720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3700cc260 0x7fe3700ce600 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7fe35c01aab0 tx=0x7fe35c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:37.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe36d600640 1 -- 172.21.15.173:0/1904687720 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c0ba020 con 0x7fe3700cc260 2024-04-25T09:14:37.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe36d600640 1 -- 172.21.15.173:0/1904687720 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35c0b6640 con 0x7fe3700cc260 2024-04-25T09:14:37.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe36d600640 1 -- 172.21.15.173:0/1904687720 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c0b0040 con 0x7fe3700cc260 2024-04-25T09:14:37.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe378200640 1 -- 172.21.15.173:0/1904687720 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe37015b6c0 con 0x7fe3700cc260 2024-04-25T09:14:37.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe378200640 1 -- 172.21.15.173:0/1904687720 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37013d5f0 con 0x7fe3700cc260 2024-04-25T09:14:37.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe378200640 1 -- 172.21.15.173:0/1904687720 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3700ad050 con 0x7fe3700cc260 2024-04-25T09:14:37.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.284+0000 7fe36d600640 1 -- 172.21.15.173:0/1904687720 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe35c0bd020 con 0x7fe3700cc260 2024-04-25T09:14:37.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.288+0000 7fe36d600640 1 --2- 172.21.15.173:0/1904687720 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe350066f60 0x7fe350069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:37.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.288+0000 7fe36d600640 1 -- 172.21.15.173:0/1904687720 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe35c11f4c0 con 0x7fe3700cc260 2024-04-25T09:14:37.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.288+0000 7fe375800640 1 --2- 172.21.15.173:0/1904687720 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe350066f60 0x7fe350069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:37.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.288+0000 7fe375800640 1 --2- 172.21.15.173:0/1904687720 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe350066f60 0x7fe350069420 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe370140f60 tx=0x7fe364008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:37.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.288+0000 7fe36d600640 1 -- 172.21.15.173:0/1904687720 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe35c0c4030 con 0x7fe3700cc260 2024-04-25T09:14:37.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.476+0000 7fe378200640 1 -- 172.21.15.173:0/1904687720 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe370073ab0 con 0x7fe3700cc260 2024-04-25T09:14:37.462 INFO:tasks.ceph.mon.a.smithi173.stderr:2024-04-25T09:14:37.476+0000 7f537be00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:14:37.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.480+0000 7fe36d600640 1 -- 172.21.15.173:0/1904687720 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v106) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe35c016110 con 0x7fe3700cc260 2024-04-25T09:14:37.464 INFO:teuthology.orchestra.run.smithi173.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:14:37.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.480+0000 7fe378200640 1 -- 172.21.15.173:0/1904687720 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe350066f60 msgr2=0x7fe350069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:37.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.480+0000 7fe378200640 1 --2- 172.21.15.173:0/1904687720 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe350066f60 0x7fe350069420 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe370140f60 tx=0x7fe364008040 comp rx=0 tx=0).stop 2024-04-25T09:14:37.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.480+0000 7fe378200640 1 -- 172.21.15.173:0/1904687720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3700cc260 msgr2=0x7fe3700ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:37.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.480+0000 7fe378200640 1 --2- 172.21.15.173:0/1904687720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3700cc260 0x7fe3700ce600 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7fe35c01aab0 tx=0x7fe35c01ac40 comp rx=0 tx=0).stop 2024-04-25T09:14:37.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.480+0000 7fe378200640 1 -- 172.21.15.173:0/1904687720 shutdown_connections 2024-04-25T09:14:37.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.480+0000 7fe378200640 1 --2- 172.21.15.173:0/1904687720 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe350066f60 0x7fe350069420 secure :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe370140f60 tx=0x7fe364008040 comp rx=0 tx=0).stop 2024-04-25T09:14:37.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.480+0000 7fe378200640 1 --2- 172.21.15.173:0/1904687720 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe370145290 0x7fe370143200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.480+0000 7fe378200640 1 --2- 172.21.15.173:0/1904687720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3700cc260 0x7fe3700ce600 secure :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7fe35c01aab0 tx=0x7fe35c01ac40 comp rx=0 tx=0).stop 2024-04-25T09:14:37.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.480+0000 7fe378200640 1 --2- 172.21.15.173:0/1904687720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3700b3fe0 0x7fe37015b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.480+0000 7fe378200640 1 -- 172.21.15.173:0/1904687720 >> 172.21.15.173:0/1904687720 conn(0x7fe37006ac90 msgr2=0x7fe3700cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:37.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.480+0000 7fe378200640 1 -- 172.21.15.173:0/1904687720 shutdown_connections 2024-04-25T09:14:37.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.480+0000 7fe378200640 1 -- 172.21.15.173:0/1904687720 wait complete. 2024-04-25T09:14:37.489 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:14:37.532 INFO:tasks.ceph.mds.c.smithi173.stdout:starting mds.c at 2024-04-25T09:14:37.538 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-04-25T09:14:37.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.644+0000 7f1191800640 1 Processor -- start 2024-04-25T09:14:37.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.644+0000 7f1191800640 1 -- start start 2024-04-25T09:14:37.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.644+0000 7f1191800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f118c0b3fe0 0x7f118c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:37.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.644+0000 7f1191800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c06d4b0 con 0x7f118c145290 2024-04-25T09:14:37.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.644+0000 7f1191800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c06d790 con 0x7f118c0cc260 2024-04-25T09:14:37.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.644+0000 7f1191800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c0ccd80 con 0x7f118c0b3fe0 2024-04-25T09:14:37.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.644+0000 7f118aa00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f118c145290 0x7f118c15c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45464/0 (socket says 172.21.15.173:45464) 2024-04-25T09:14:37.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.644+0000 7f118aa00640 1 -- 172.21.15.173:0/530095483 learned_addr learned my addr 172.21.15.173:0/530095483 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:37.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.644+0000 7f118a000640 1 --2- 172.21.15.173:0/530095483 >> v2:172.21.15.194:3300/0 conn(0x7f118c0b3fe0 0x7f118c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:37.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.648+0000 7f118a000640 1 -- 172.21.15.173:0/530095483 >> v1:172.21.15.194:6789/0 conn(0x7f118c0cc260 legacy=0x7f118c0cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:37.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.648+0000 7f118a000640 1 -- 172.21.15.173:0/530095483 >> v1:172.21.15.173:6789/0 conn(0x7f118c145290 legacy=0x7f118c15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:37.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.648+0000 7f118a000640 1 -- 172.21.15.173:0/530095483 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c06da70 con 0x7f118c0b3fe0 2024-04-25T09:14:37.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.648+0000 7f1189600640 1 -- 172.21.15.173:0/530095483 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671136447 0 0) 0x7f118c06d4b0 con 0x7f118c145290 2024-04-25T09:14:37.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.648+0000 7f118a000640 1 --2- 172.21.15.173:0/530095483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f118c0b3fe0 0x7f118c0b4450 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f117c0097c0 tx=0x7f117c01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5f9ec621e37d5e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:37.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.648+0000 7f1189600640 1 -- 172.21.15.173:0/530095483 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c0b0070 con 0x7f118c0b3fe0 2024-04-25T09:14:37.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.648+0000 7f1189600640 1 -- 172.21.15.173:0/530095483 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117c0ab600 con 0x7f118c0b3fe0 2024-04-25T09:14:37.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.648+0000 7f1189600640 1 -- 172.21.15.173:0/530095483 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c0ab9d0 con 0x7f118c0b3fe0 2024-04-25T09:14:37.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.648+0000 7f1191800640 1 -- 172.21.15.173:0/530095483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f118c0b3fe0 msgr2=0x7f118c0b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:37.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.648+0000 7f1191800640 1 --2- 172.21.15.173:0/530095483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f118c0b3fe0 0x7f118c0b4450 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f117c0097c0 tx=0x7f117c01c380 comp rx=0 tx=0).stop 2024-04-25T09:14:37.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.648+0000 7f1191800640 1 -- 172.21.15.173:0/530095483 shutdown_connections 2024-04-25T09:14:37.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.648+0000 7f1191800640 1 --2- 172.21.15.173:0/530095483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f118c0b3fe0 0x7f118c0b4450 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.648+0000 7f1191800640 1 -- 172.21.15.173:0/530095483 >> 172.21.15.173:0/530095483 conn(0x7f118c06ac90 msgr2=0x7f118c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:37.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f1191800640 1 -- 172.21.15.173:0/530095483 shutdown_connections 2024-04-25T09:14:37.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f1191800640 1 -- 172.21.15.173:0/530095483 wait complete. 2024-04-25T09:14:37.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f1191800640 1 Processor -- start 2024-04-25T09:14:37.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f1191800640 1 -- start start 2024-04-25T09:14:37.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f1191800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f118c0b3fe0 0x7f118c142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:37.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f1191800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f118c0cc260 0x7f118c0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:37.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f1191800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f118c145290 0x7f118c0ce040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:37.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f1191800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c06eee0 con 0x7f118c145290 2024-04-25T09:14:37.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f1191800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c06ed60 con 0x7f118c0cc260 2024-04-25T09:14:37.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f1191800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c06f060 con 0x7f118c0b3fe0 2024-04-25T09:14:37.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f118b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f118c145290 0x7f118c0ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f118b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f118c145290 0x7f118c0ce040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39788/0 (socket says 172.21.15.173:39788) 2024-04-25T09:14:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f118b400640 1 -- 172.21.15.173:0/1010909547 learned_addr learned my addr 172.21.15.173:0/1010909547 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f118aa00640 1 --2- 172.21.15.173:0/1010909547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f118c0b3fe0 0x7f118c142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f118a000640 1 --2- 172.21.15.173:0/1010909547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f118c0cc260 0x7f118c0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f118b400640 1 -- 172.21.15.173:0/1010909547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f118c0b3fe0 msgr2=0x7f118c142ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f118b400640 1 --2- 172.21.15.173:0/1010909547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f118c0b3fe0 0x7f118c142ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f118b400640 1 -- 172.21.15.173:0/1010909547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f118c0cc260 msgr2=0x7f118c0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f118b400640 1 --2- 172.21.15.173:0/1010909547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f118c0cc260 0x7f118c0cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f118b400640 1 -- 172.21.15.173:0/1010909547 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c0ce580 con 0x7f118c145290 2024-04-25T09:14:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f118a000640 1 --2- 172.21.15.173:0/1010909547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f118c0cc260 0x7f118c0cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f118aa00640 1 --2- 172.21.15.173:0/1010909547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f118c0b3fe0 0x7f118c142ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:37.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f118b400640 1 --2- 172.21.15.173:0/1010909547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f118c145290 0x7f118c0ce040 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f118400c760 tx=0x7f118400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:37.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f1182a00640 1 -- 172.21.15.173:0/1010909547 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1184003b80 con 0x7f118c145290 2024-04-25T09:14:37.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f1182a00640 1 -- 172.21.15.173:0/1010909547 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1184003d20 con 0x7f118c145290 2024-04-25T09:14:37.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f1182a00640 1 -- 172.21.15.173:0/1010909547 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118400aa30 con 0x7f118c145290 2024-04-25T09:14:37.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.652+0000 7f1191800640 1 -- 172.21.15.173:0/1010909547 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118c0ce820 con 0x7f118c145290 2024-04-25T09:14:37.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.656+0000 7f1191800640 1 -- 172.21.15.173:0/1010909547 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118c0cede0 con 0x7f118c145290 2024-04-25T09:14:37.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.656+0000 7f1191800640 1 -- 172.21.15.173:0/1010909547 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118c073ab0 con 0x7f118c145290 2024-04-25T09:14:37.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.656+0000 7f1182a00640 1 -- 172.21.15.173:0/1010909547 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f118400abd0 con 0x7f118c145290 2024-04-25T09:14:37.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.656+0000 7f1182a00640 1 --2- 172.21.15.173:0/1010909547 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1168066f60 0x7f1168069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:37.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.656+0000 7f1182a00640 1 -- 172.21.15.173:0/1010909547 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f1184085060 con 0x7f118c145290 2024-04-25T09:14:37.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.656+0000 7f118aa00640 1 --2- 172.21.15.173:0/1010909547 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1168066f60 0x7f1168069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:37.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.656+0000 7f118aa00640 1 --2- 172.21.15.173:0/1010909547 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1168066f60 0x7f1168069420 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1174000f70 tx=0x7f1174007c60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:37.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.660+0000 7f1182a00640 1 -- 172.21.15.173:0/1010909547 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1184055ee0 con 0x7f118c145290 2024-04-25T09:14:37.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:37.848+0000 7f1191800640 1 -- 172.21.15.173:0/1010909547 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f118c0b2210 con 0x7f118c145290 2024-04-25T09:14:38.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.548+0000 7f1182a00640 1 -- 172.21.15.173:0/1010909547 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v107) v1 ==== 104+0+0 (secure 0 0 0) 0x7f11840557e0 con 0x7f118c145290 2024-04-25T09:14:38.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.552+0000 7f1191800640 1 -- 172.21.15.173:0/1010909547 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1168066f60 msgr2=0x7f1168069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.552+0000 7f1191800640 1 --2- 172.21.15.173:0/1010909547 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1168066f60 0x7f1168069420 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1174000f70 tx=0x7f1174007c60 comp rx=0 tx=0).stop 2024-04-25T09:14:38.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.552+0000 7f1191800640 1 -- 172.21.15.173:0/1010909547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f118c145290 msgr2=0x7f118c0ce040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.552+0000 7f1191800640 1 --2- 172.21.15.173:0/1010909547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f118c145290 0x7f118c0ce040 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f118400c760 tx=0x7f118400cc20 comp rx=0 tx=0).stop 2024-04-25T09:14:38.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.552+0000 7f1191800640 1 -- 172.21.15.173:0/1010909547 shutdown_connections 2024-04-25T09:14:38.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.552+0000 7f1191800640 1 --2- 172.21.15.173:0/1010909547 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1168066f60 0x7f1168069420 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.552+0000 7f1191800640 1 --2- 172.21.15.173:0/1010909547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f118c145290 0x7f118c0ce040 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.552+0000 7f1191800640 1 --2- 172.21.15.173:0/1010909547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f118c0cc260 0x7f118c0cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.552+0000 7f1191800640 1 --2- 172.21.15.173:0/1010909547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f118c0b3fe0 0x7f118c142ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.552+0000 7f1191800640 1 -- 172.21.15.173:0/1010909547 >> 172.21.15.173:0/1010909547 conn(0x7f118c06ac90 msgr2=0x7f118c13d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:38.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.552+0000 7f1191800640 1 -- 172.21.15.173:0/1010909547 shutdown_connections 2024-04-25T09:14:38.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.552+0000 7f1191800640 1 -- 172.21.15.173:0/1010909547 wait complete. 2024-04-25T09:14:38.559 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:14:38.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.756+0000 7f2e0dc00640 1 Processor -- start 2024-04-25T09:14:38.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.760+0000 7f2e0dc00640 1 -- start start 2024-04-25T09:14:38.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.760+0000 7f2e0dc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2e08145290 0x7f2e0815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.760+0000 7f2e0dc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e080cc260 0x7f2e080cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.760+0000 7f2e0dc00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0815c5f0 con 0x7f2e080b3fe0 2024-04-25T09:14:38.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.760+0000 7f2e0dc00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0806d4b0 con 0x7f2e08145290 2024-04-25T09:14:38.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.760+0000 7f2e0dc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0806d790 con 0x7f2e080cc260 2024-04-25T09:14:38.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.760+0000 7f2e06a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2e08145290 0x7f2e0815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.760+0000 7f2dfe000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f2e080b3fe0 0x7f2e080b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45480/0 (socket says 172.21.15.173:45480) 2024-04-25T09:14:38.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.760+0000 7f2e06a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2e08145290 0x7f2e0815c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39802/0 (socket says 172.21.15.173:39802) 2024-04-25T09:14:38.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.760+0000 7f2dfe000640 1 -- 172.21.15.173:0/2309608814 learned_addr learned my addr 172.21.15.173:0/2309608814 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:38.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.760+0000 7f2e07400640 1 --2- 172.21.15.173:0/2309608814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e080cc260 0x7f2e080cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.760+0000 7f2e06a00640 1 -- 172.21.15.173:0/2309608814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e080cc260 msgr2=0x7f2e080cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:38.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.760+0000 7f2e06a00640 1 --2- 172.21.15.173:0/2309608814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e080cc260 0x7f2e080cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.760+0000 7f2e06a00640 1 -- 172.21.15.173:0/2309608814 >> v1:172.21.15.173:6789/0 conn(0x7f2e080b3fe0 legacy=0x7f2e080b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.760+0000 7f2e06a00640 1 -- 172.21.15.173:0/2309608814 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0806da70 con 0x7f2e08145290 2024-04-25T09:14:38.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.760+0000 7f2e07400640 1 --2- 172.21.15.173:0/2309608814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e080cc260 0x7f2e080cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:38.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.760+0000 7f2e06000640 1 -- 172.21.15.173:0/2309608814 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796062506 0 0) 0x7f2df0001120 con 0x7f2e080b3fe0 2024-04-25T09:14:38.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.764+0000 7f2e06a00640 1 --2- 172.21.15.173:0/2309608814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e08145290 0x7f2e0815c0b0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f2df80097c0 tx=0x7f2df801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fe967d5a9ac16c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:38.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.764+0000 7f2e06000640 1 -- 172.21.15.173:0/2309608814 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df80b0070 con 0x7f2e08145290 2024-04-25T09:14:38.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.764+0000 7f2e06000640 1 -- 172.21.15.173:0/2309608814 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df80ab600 con 0x7f2e08145290 2024-04-25T09:14:38.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.764+0000 7f2e06000640 1 -- 172.21.15.173:0/2309608814 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df80ab9d0 con 0x7f2e08145290 2024-04-25T09:14:38.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.764+0000 7f2e0dc00640 1 -- 172.21.15.173:0/2309608814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e08145290 msgr2=0x7f2e0815c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.764+0000 7f2e0dc00640 1 --2- 172.21.15.173:0/2309608814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e08145290 0x7f2e0815c0b0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f2df80097c0 tx=0x7f2df801c380 comp rx=0 tx=0).stop 2024-04-25T09:14:38.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.764+0000 7f2e0dc00640 1 -- 172.21.15.173:0/2309608814 shutdown_connections 2024-04-25T09:14:38.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.764+0000 7f2e0dc00640 1 --2- 172.21.15.173:0/2309608814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e080cc260 0x7f2e080cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.764+0000 7f2e0dc00640 1 --2- 172.21.15.173:0/2309608814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e08145290 0x7f2e0815c0b0 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.764+0000 7f2e0dc00640 1 -- 172.21.15.173:0/2309608814 >> 172.21.15.173:0/2309608814 conn(0x7f2e0806ac90 msgr2=0x7f2e0806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:38.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.764+0000 7f2e0dc00640 1 -- 172.21.15.173:0/2309608814 shutdown_connections 2024-04-25T09:14:38.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.764+0000 7f2e0dc00640 1 -- 172.21.15.173:0/2309608814 wait complete. 2024-04-25T09:14:38.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.764+0000 7f2e0dc00640 1 Processor -- start 2024-04-25T09:14:38.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.764+0000 7f2e0dc00640 1 -- start start 2024-04-25T09:14:38.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2e0dc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e080b3fe0 0x7f2e0815b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2e0dc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e080cc260 0x7f2e08140550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2e0dc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e08145290 0x7f2e08140a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2e0dc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0806ed60 con 0x7f2e080cc260 2024-04-25T09:14:38.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2e0dc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0806eee0 con 0x7f2e080b3fe0 2024-04-25T09:14:38.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2e0dc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0806f060 con 0x7f2e08145290 2024-04-25T09:14:38.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2dfe000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e080cc260 0x7f2e08140550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2dfe000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e080cc260 0x7f2e08140550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39818/0 (socket says 172.21.15.173:39818) 2024-04-25T09:14:38.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2dfe000640 1 -- 172.21.15.173:0/3153545510 learned_addr learned my addr 172.21.15.173:0/3153545510 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:38.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2e07400640 1 --2- 172.21.15.173:0/3153545510 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e08145290 0x7f2e08140a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2e06a00640 1 --2- 172.21.15.173:0/3153545510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e080b3fe0 0x7f2e0815b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2dfe000640 1 -- 172.21.15.173:0/3153545510 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e08145290 msgr2=0x7f2e08140a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2dfe000640 1 --2- 172.21.15.173:0/3153545510 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e08145290 0x7f2e08140a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2dfe000640 1 -- 172.21.15.173:0/3153545510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e080b3fe0 msgr2=0x7f2e0815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2dfe000640 1 --2- 172.21.15.173:0/3153545510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e080b3fe0 0x7f2e0815b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2dfe000640 1 -- 172.21.15.173:0/3153545510 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0813ddb0 con 0x7f2e080cc260 2024-04-25T09:14:38.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2dfe000640 1 --2- 172.21.15.173:0/3153545510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e080cc260 0x7f2e08140550 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f2df000c4b0 tx=0x7f2df000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:38.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2dff400640 1 -- 172.21.15.173:0/3153545510 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df0018070 con 0x7f2e080cc260 2024-04-25T09:14:38.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2dff400640 1 -- 172.21.15.173:0/3153545510 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df0007500 con 0x7f2e080cc260 2024-04-25T09:14:38.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2e0dc00640 1 -- 172.21.15.173:0/3153545510 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0813e090 con 0x7f2e080cc260 2024-04-25T09:14:38.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2dff400640 1 -- 172.21.15.173:0/3153545510 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df0004a30 con 0x7f2e080cc260 2024-04-25T09:14:38.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2e0dc00640 1 -- 172.21.15.173:0/3153545510 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0813e650 con 0x7f2e080cc260 2024-04-25T09:14:38.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2e0dc00640 1 -- 172.21.15.173:0/3153545510 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e081425f0 con 0x7f2e080cc260 2024-04-25T09:14:38.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.768+0000 7f2dff400640 1 -- 172.21.15.173:0/3153545510 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2df001b070 con 0x7f2e080cc260 2024-04-25T09:14:38.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.772+0000 7f2dff400640 1 --2- 172.21.15.173:0/3153545510 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2de4066f90 0x7f2de4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.772+0000 7f2dff400640 1 -- 172.21.15.173:0/3153545510 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f2df0084440 con 0x7f2e080cc260 2024-04-25T09:14:38.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.772+0000 7f2e06a00640 1 --2- 172.21.15.173:0/3153545510 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2de4066f90 0x7f2de4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.772+0000 7f2e06a00640 1 --2- 172.21.15.173:0/3153545510 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2de4066f90 0x7f2de4069450 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2df80ad000 tx=0x7f2df80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:38.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.776+0000 7f2dff400640 1 -- 172.21.15.173:0/3153545510 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2e081425f0 con 0x7f2e080cc260 2024-04-25T09:14:38.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:38.932+0000 7f2e0dc00640 1 -- 172.21.15.173:0/3153545510 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2e08073ab0 con 0x7f2e080cc260 2024-04-25T09:14:39.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.556+0000 7f2dff400640 1 -- 172.21.15.173:0/3153545510 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v148) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2e0815c5f0 con 0x7f2e080cc260 2024-04-25T09:14:39.540 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:14:39.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.556+0000 7f2e0dc00640 1 -- 172.21.15.173:0/3153545510 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2de4066f90 msgr2=0x7f2de4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.556+0000 7f2e0dc00640 1 --2- 172.21.15.173:0/3153545510 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2de4066f90 0x7f2de4069450 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2df80ad000 tx=0x7f2df80a6000 comp rx=0 tx=0).stop 2024-04-25T09:14:39.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.556+0000 7f2e0dc00640 1 -- 172.21.15.173:0/3153545510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e080cc260 msgr2=0x7f2e08140550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.556+0000 7f2e0dc00640 1 --2- 172.21.15.173:0/3153545510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e080cc260 0x7f2e08140550 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f2df000c4b0 tx=0x7f2df000c970 comp rx=0 tx=0).stop 2024-04-25T09:14:39.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.560+0000 7f2e0dc00640 1 -- 172.21.15.173:0/3153545510 shutdown_connections 2024-04-25T09:14:39.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.560+0000 7f2e0dc00640 1 --2- 172.21.15.173:0/3153545510 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2de4066f90 0x7f2de4069450 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.560+0000 7f2e0dc00640 1 --2- 172.21.15.173:0/3153545510 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e08145290 0x7f2e08140a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.560+0000 7f2e0dc00640 1 --2- 172.21.15.173:0/3153545510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e080cc260 0x7f2e08140550 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.560+0000 7f2e0dc00640 1 --2- 172.21.15.173:0/3153545510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e080b3fe0 0x7f2e0815b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.560+0000 7f2e0dc00640 1 -- 172.21.15.173:0/3153545510 >> 172.21.15.173:0/3153545510 conn(0x7f2e0806ac90 msgr2=0x7f2e0815bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:39.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.560+0000 7f2e0dc00640 1 -- 172.21.15.173:0/3153545510 shutdown_connections 2024-04-25T09:14:39.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.560+0000 7f2e0dc00640 1 -- 172.21.15.173:0/3153545510 wait complete. 2024-04-25T09:14:39.567 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:14:39.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.720+0000 7fd529c00640 1 Processor -- start 2024-04-25T09:14:39.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.720+0000 7fd529c00640 1 -- start start 2024-04-25T09:14:39.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.720+0000 7fd529c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd5240cd3d0 0x7fd5240cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.720+0000 7fd529c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd5240cc670 0x7fd5240ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.720+0000 7fd529c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd524072590 con 0x7fd52415b710 2024-04-25T09:14:39.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.720+0000 7fd529c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5240ccae0 con 0x7fd5240cd3d0 2024-04-25T09:14:39.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.720+0000 7fd529c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52415eea0 con 0x7fd5240cc670 2024-04-25T09:14:39.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.720+0000 7fd522000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd5240cd3d0 0x7fd5240cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.720+0000 7fd522a00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd52415b710 0x7fd524071e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45492/0 (socket says 172.21.15.173:45492) 2024-04-25T09:14:39.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.720+0000 7fd522000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd5240cd3d0 0x7fd5240cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39828/0 (socket says 172.21.15.173:39828) 2024-04-25T09:14:39.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.720+0000 7fd522a00640 1 -- 172.21.15.173:0/2151667166 learned_addr learned my addr 172.21.15.173:0/2151667166 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:39.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.720+0000 7fd523400640 1 --2- 172.21.15.173:0/2151667166 >> v2:172.21.15.194:3300/0 conn(0x7fd5240cc670 0x7fd5240ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.720+0000 7fd522000640 1 -- 172.21.15.173:0/2151667166 >> v2:172.21.15.194:3300/0 conn(0x7fd5240cc670 msgr2=0x7fd5240ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:39.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.720+0000 7fd522000640 1 --2- 172.21.15.173:0/2151667166 >> v2:172.21.15.194:3300/0 conn(0x7fd5240cc670 0x7fd5240ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.720+0000 7fd522000640 1 -- 172.21.15.173:0/2151667166 >> v1:172.21.15.173:6789/0 conn(0x7fd52415b710 legacy=0x7fd524071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.720+0000 7fd522000640 1 -- 172.21.15.173:0/2151667166 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52415e2d0 con 0x7fd5240cd3d0 2024-04-25T09:14:39.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.724+0000 7fd522000640 1 --2- 172.21.15.173:0/2151667166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5240cd3d0 0x7fd5240cc130 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7fd5240cdb30 tx=0x7fd51001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b47e5d10d766da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:39.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.724+0000 7fd521600640 1 -- 172.21.15.173:0/2151667166 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5100b1070 con 0x7fd5240cd3d0 2024-04-25T09:14:39.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.724+0000 7fd521600640 1 -- 172.21.15.173:0/2151667166 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5100ac620 con 0x7fd5240cd3d0 2024-04-25T09:14:39.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.724+0000 7fd521600640 1 -- 172.21.15.173:0/2151667166 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5100ac9f0 con 0x7fd5240cd3d0 2024-04-25T09:14:39.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.724+0000 7fd529c00640 1 -- 172.21.15.173:0/2151667166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5240cd3d0 msgr2=0x7fd5240cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.724+0000 7fd529c00640 1 --2- 172.21.15.173:0/2151667166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5240cd3d0 0x7fd5240cc130 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7fd5240cdb30 tx=0x7fd51001c3c0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.724+0000 7fd529c00640 1 -- 172.21.15.173:0/2151667166 shutdown_connections 2024-04-25T09:14:39.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.724+0000 7fd529c00640 1 --2- 172.21.15.173:0/2151667166 >> v2:172.21.15.194:3300/0 conn(0x7fd5240cc670 0x7fd5240ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.724+0000 7fd529c00640 1 --2- 172.21.15.173:0/2151667166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5240cd3d0 0x7fd5240cc130 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.724+0000 7fd529c00640 1 -- 172.21.15.173:0/2151667166 >> 172.21.15.173:0/2151667166 conn(0x7fd52406ac90 msgr2=0x7fd52406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:39.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.724+0000 7fd529c00640 1 -- 172.21.15.173:0/2151667166 shutdown_connections 2024-04-25T09:14:39.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.724+0000 7fd529c00640 1 -- 172.21.15.173:0/2151667166 wait complete. 2024-04-25T09:14:39.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd529c00640 1 Processor -- start 2024-04-25T09:14:39.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd529c00640 1 -- start start 2024-04-25T09:14:39.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd529c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5240cc670 0x7fd524149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd529c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5240cd3d0 0x7fd52414d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd529c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd52415b710 0x7fd5241482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd529c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240cf890 con 0x7fd5240cc670 2024-04-25T09:14:39.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd529c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52415baf0 con 0x7fd5240cd3d0 2024-04-25T09:14:39.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd529c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240cfa10 con 0x7fd52415b710 2024-04-25T09:14:39.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd522a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5240cc670 0x7fd524149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd522a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5240cc670 0x7fd524149ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39832/0 (socket says 172.21.15.173:39832) 2024-04-25T09:14:39.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd522a00640 1 -- 172.21.15.173:0/4198519681 learned_addr learned my addr 172.21.15.173:0/4198519681 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:39.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd522000640 1 --2- 172.21.15.173:0/4198519681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5240cd3d0 0x7fd52414d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd523400640 1 --2- 172.21.15.173:0/4198519681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd52415b710 0x7fd5241482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd522a00640 1 -- 172.21.15.173:0/4198519681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd52415b710 msgr2=0x7fd5241482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd522a00640 1 --2- 172.21.15.173:0/4198519681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd52415b710 0x7fd5241482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd522a00640 1 -- 172.21.15.173:0/4198519681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5240cd3d0 msgr2=0x7fd52414d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd522a00640 1 --2- 172.21.15.173:0/4198519681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5240cd3d0 0x7fd52414d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd522a00640 1 -- 172.21.15.173:0/4198519681 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52414dbe0 con 0x7fd5240cc670 2024-04-25T09:14:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd523400640 1 --2- 172.21.15.173:0/4198519681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd52415b710 0x7fd5241482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd522000640 1 --2- 172.21.15.173:0/4198519681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5240cd3d0 0x7fd52414d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd522a00640 1 --2- 172.21.15.173:0/4198519681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5240cc670 0x7fd524149ca0 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7fd51400ca70 tx=0x7fd51400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd51aa00640 1 -- 172.21.15.173:0/4198519681 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514017070 con 0x7fd5240cc670 2024-04-25T09:14:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd51aa00640 1 -- 172.21.15.173:0/4198519681 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51400abd0 con 0x7fd5240cc670 2024-04-25T09:14:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd529c00640 1 -- 172.21.15.173:0/4198519681 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52414dec0 con 0x7fd5240cc670 2024-04-25T09:14:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd51aa00640 1 -- 172.21.15.173:0/4198519681 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514012400 con 0x7fd5240cc670 2024-04-25T09:14:39.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.728+0000 7fd529c00640 1 -- 172.21.15.173:0/4198519681 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52414e480 con 0x7fd5240cc670 2024-04-25T09:14:39.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.732+0000 7fd529c00640 1 -- 172.21.15.173:0/4198519681 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd524073ab0 con 0x7fd5240cc670 2024-04-25T09:14:39.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.732+0000 7fd51aa00640 1 -- 172.21.15.173:0/4198519681 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd51401a070 con 0x7fd5240cc670 2024-04-25T09:14:39.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.732+0000 7fd51aa00640 1 --2- 172.21.15.173:0/4198519681 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd504066f60 0x7fd504069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.732+0000 7fd51aa00640 1 -- 172.21.15.173:0/4198519681 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5807+0+0 (secure 0 0 0) 0x7fd514084da0 con 0x7fd5240cc670 2024-04-25T09:14:39.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.732+0000 7fd522000640 1 --2- 172.21.15.173:0/4198519681 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd504066f60 0x7fd504069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.732+0000 7fd522000640 1 --2- 172.21.15.173:0/4198519681 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd504066f60 0x7fd504069420 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd5100ae000 tx=0x7fd510008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:39.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.736+0000 7fd51aa00640 1 -- 172.21.15.173:0/4198519681 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd524072590 con 0x7fd5240cc670 2024-04-25T09:14:39.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:39.892+0000 7fd529c00640 1 -- 172.21.15.173:0/4198519681 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd52415f580 con 0x7fd5240cc670 2024-04-25T09:14:40.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.568+0000 7fd51aa00640 1 -- 172.21.15.173:0/4198519681 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v149) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd514055d40 con 0x7fd5240cc670 2024-04-25T09:14:40.554 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'cephfs_data' removed 2024-04-25T09:14:40.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.572+0000 7fd529c00640 1 -- 172.21.15.173:0/4198519681 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd504066f60 msgr2=0x7fd504069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.572+0000 7fd529c00640 1 --2- 172.21.15.173:0/4198519681 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd504066f60 0x7fd504069420 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd5100ae000 tx=0x7fd510008040 comp rx=0 tx=0).stop 2024-04-25T09:14:40.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.572+0000 7fd529c00640 1 -- 172.21.15.173:0/4198519681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5240cc670 msgr2=0x7fd524149ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.572+0000 7fd529c00640 1 --2- 172.21.15.173:0/4198519681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5240cc670 0x7fd524149ca0 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7fd51400ca70 tx=0x7fd51400cf30 comp rx=0 tx=0).stop 2024-04-25T09:14:40.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.572+0000 7fd529c00640 1 -- 172.21.15.173:0/4198519681 shutdown_connections 2024-04-25T09:14:40.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.572+0000 7fd529c00640 1 --2- 172.21.15.173:0/4198519681 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd504066f60 0x7fd504069420 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.572+0000 7fd529c00640 1 --2- 172.21.15.173:0/4198519681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd52415b710 0x7fd5241482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.572+0000 7fd529c00640 1 --2- 172.21.15.173:0/4198519681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5240cd3d0 0x7fd52414d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.572+0000 7fd529c00640 1 --2- 172.21.15.173:0/4198519681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5240cc670 0x7fd524149ca0 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.572+0000 7fd529c00640 1 -- 172.21.15.173:0/4198519681 >> 172.21.15.173:0/4198519681 conn(0x7fd52406ac90 msgr2=0x7fd52415d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:40.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.572+0000 7fd529c00640 1 -- 172.21.15.173:0/4198519681 shutdown_connections 2024-04-25T09:14:40.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.572+0000 7fd529c00640 1 -- 172.21.15.173:0/4198519681 wait complete. 2024-04-25T09:14:40.585 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:14:40.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f185ba00640 1 Processor -- start 2024-04-25T09:14:40.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f185ba00640 1 -- start start 2024-04-25T09:14:40.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f185ba00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f18540cc7e0 0x7f18540cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f185ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18540aef70 0x7f18540ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f185ba00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1854071570 con 0x7f18540aeb90 2024-04-25T09:14:40.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f185ba00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1854071320 con 0x7f18540cc7e0 2024-04-25T09:14:40.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f185ba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1854072330 con 0x7f18540aef70 2024-04-25T09:14:40.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f1859a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18540aef70 0x7f18540ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f1859000640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f18540aeb90 0x7f18540cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:54238/0 (socket says 172.21.15.173:54238) 2024-04-25T09:14:40.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f1859a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18540aef70 0x7f18540ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:42704/0 (socket says 172.21.15.173:42704) 2024-04-25T09:14:40.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f1859000640 1 -- 172.21.15.173:0/1113252528 learned_addr learned my addr 172.21.15.173:0/1113252528 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:40.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f184be00640 1 --2- 172.21.15.173:0/1113252528 >> v2:172.21.15.194:3300/0 conn(0x7f18540cc7e0 0x7f18540cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f1853e00640 1 -- 172.21.15.173:0/1113252528 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555050173 0 0) 0x7f1854071570 con 0x7f18540aeb90 2024-04-25T09:14:40.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f1853e00640 1 -- 172.21.15.173:0/1113252528 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1838003530 con 0x7f18540aeb90 2024-04-25T09:14:40.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f1859a00640 1 -- 172.21.15.173:0/1113252528 >> v2:172.21.15.194:3300/0 conn(0x7f18540cc7e0 msgr2=0x7f18540cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:40.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f1859a00640 1 --2- 172.21.15.173:0/1113252528 >> v2:172.21.15.194:3300/0 conn(0x7f18540cc7e0 0x7f18540cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f1859a00640 1 -- 172.21.15.173:0/1113252528 >> v1:172.21.15.194:6789/0 conn(0x7f18540aeb90 legacy=0x7f18540cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f1859a00640 1 -- 172.21.15.173:0/1113252528 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1854071850 con 0x7f18540aef70 2024-04-25T09:14:40.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.748+0000 7f184be00640 1 --2- 172.21.15.173:0/1113252528 >> v2:172.21.15.194:3300/0 conn(0x7f18540cc7e0 0x7f18540cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:40.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.752+0000 7f1859a00640 1 --2- 172.21.15.173:0/1113252528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18540aef70 0x7f18540ce0e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f184c009d90 tx=0x7f184c01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48e7eae6c03f2b82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:40.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.752+0000 7f1853e00640 1 -- 172.21.15.173:0/1113252528 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c0b2070 con 0x7f18540aef70 2024-04-25T09:14:40.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.752+0000 7f1853e00640 1 -- 172.21.15.173:0/1113252528 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184c0a5790 con 0x7f18540aef70 2024-04-25T09:14:40.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.752+0000 7f1853e00640 1 -- 172.21.15.173:0/1113252528 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c0a5b60 con 0x7f18540aef70 2024-04-25T09:14:40.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.752+0000 7f185ba00640 1 -- 172.21.15.173:0/1113252528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18540aef70 msgr2=0x7f18540ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.752+0000 7f185ba00640 1 --2- 172.21.15.173:0/1113252528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18540aef70 0x7f18540ce0e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f184c009d90 tx=0x7f184c01c8e0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.752+0000 7f185ba00640 1 -- 172.21.15.173:0/1113252528 shutdown_connections 2024-04-25T09:14:40.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.752+0000 7f185ba00640 1 --2- 172.21.15.173:0/1113252528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18540aef70 0x7f18540ce0e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.752+0000 7f185ba00640 1 --2- 172.21.15.173:0/1113252528 >> v2:172.21.15.194:3300/0 conn(0x7f18540cc7e0 0x7f18540cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.752+0000 7f185ba00640 1 -- 172.21.15.173:0/1113252528 >> 172.21.15.173:0/1113252528 conn(0x7f185406ac90 msgr2=0x7f185406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:40.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.752+0000 7f185ba00640 1 -- 172.21.15.173:0/1113252528 shutdown_connections 2024-04-25T09:14:40.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.752+0000 7f185ba00640 1 -- 172.21.15.173:0/1113252528 wait complete. 2024-04-25T09:14:40.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f185ba00640 1 Processor -- start 2024-04-25T09:14:40.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f185ba00640 1 -- start start 2024-04-25T09:14:40.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f185ba00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18540aeb90 0x7f1854150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f185ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18540aef70 0x7f18540cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f185ba00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18540cc7e0 0x7f18540cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f185ba00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185415bb30 con 0x7f18540cc7e0 2024-04-25T09:14:40.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f185ba00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185415b9b0 con 0x7f18540aeb90 2024-04-25T09:14:40.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f185ba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185415bcb0 con 0x7f18540aef70 2024-04-25T09:14:40.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f1859a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18540cc7e0 0x7f18540cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f1859a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18540cc7e0 0x7f18540cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39846/0 (socket says 172.21.15.173:39846) 2024-04-25T09:14:40.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f1859a00640 1 -- 172.21.15.173:0/1749421777 learned_addr learned my addr 172.21.15.173:0/1749421777 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:40.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f1859000640 1 --2- 172.21.15.173:0/1749421777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18540aeb90 0x7f1854150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f184be00640 1 --2- 172.21.15.173:0/1749421777 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18540aef70 0x7f18540cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f1859a00640 1 -- 172.21.15.173:0/1749421777 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18540aef70 msgr2=0x7f18540cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f1859a00640 1 --2- 172.21.15.173:0/1749421777 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18540aef70 0x7f18540cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f1859a00640 1 -- 172.21.15.173:0/1749421777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18540aeb90 msgr2=0x7f1854150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f1859a00640 1 --2- 172.21.15.173:0/1749421777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18540aeb90 0x7f1854150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f1859a00640 1 -- 172.21.15.173:0/1749421777 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18541507d0 con 0x7f18540cc7e0 2024-04-25T09:14:40.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f1859a00640 1 --2- 172.21.15.173:0/1749421777 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18540cc7e0 0x7f18540cc170 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f184c0b0040 tx=0x7f184c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:40.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f1851600640 1 -- 172.21.15.173:0/1749421777 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c0b2050 con 0x7f18540cc7e0 2024-04-25T09:14:40.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f1851600640 1 -- 172.21.15.173:0/1749421777 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184c0be070 con 0x7f18540cc7e0 2024-04-25T09:14:40.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f185ba00640 1 -- 172.21.15.173:0/1749421777 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18540af3e0 con 0x7f18540cc7e0 2024-04-25T09:14:40.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f1851600640 1 -- 172.21.15.173:0/1749421777 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c009450 con 0x7f18540cc7e0 2024-04-25T09:14:40.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.756+0000 7f185ba00640 1 -- 172.21.15.173:0/1749421777 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18540af9a0 con 0x7f18540cc7e0 2024-04-25T09:14:40.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.760+0000 7f185ba00640 1 -- 172.21.15.173:0/1749421777 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1854073ab0 con 0x7f18540cc7e0 2024-04-25T09:14:40.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.760+0000 7f1851600640 1 -- 172.21.15.173:0/1749421777 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f184c0ad870 con 0x7f18540cc7e0 2024-04-25T09:14:40.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.760+0000 7f1851600640 1 --2- 172.21.15.173:0/1749421777 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1830066f60 0x7f1830069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.760+0000 7f1851600640 1 -- 172.21.15.173:0/1749421777 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f184c11fd10 con 0x7f18540cc7e0 2024-04-25T09:14:40.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.760+0000 7f1859000640 1 --2- 172.21.15.173:0/1749421777 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1830066f60 0x7f1830069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.760+0000 7f1859000640 1 --2- 172.21.15.173:0/1749421777 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1830066f60 0x7f1830069420 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1844007fd0 tx=0x7f1844009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:40.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.764+0000 7f1851600640 1 -- 172.21.15.173:0/1749421777 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f184c016560 con 0x7f18540cc7e0 2024-04-25T09:14:40.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.920+0000 7f185ba00640 1 -- 172.21.15.173:0/1749421777 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f185406b2c0 con 0x7f18540cc7e0 2024-04-25T09:14:40.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.924+0000 7f1851600640 1 -- 172.21.15.173:0/1749421777 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f184c0f0840 con 0x7f18540cc7e0 2024-04-25T09:14:40.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.928+0000 7f185ba00640 1 -- 172.21.15.173:0/1749421777 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1830066f60 msgr2=0x7f1830069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.928+0000 7f185ba00640 1 --2- 172.21.15.173:0/1749421777 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1830066f60 0x7f1830069420 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1844007fd0 tx=0x7f1844009040 comp rx=0 tx=0).stop 2024-04-25T09:14:40.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.928+0000 7f185ba00640 1 -- 172.21.15.173:0/1749421777 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18540cc7e0 msgr2=0x7f18540cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.928+0000 7f185ba00640 1 --2- 172.21.15.173:0/1749421777 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18540cc7e0 0x7f18540cc170 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f184c0b0040 tx=0x7f184c019680 comp rx=0 tx=0).stop 2024-04-25T09:14:40.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.928+0000 7f185ba00640 1 -- 172.21.15.173:0/1749421777 shutdown_connections 2024-04-25T09:14:40.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.928+0000 7f185ba00640 1 --2- 172.21.15.173:0/1749421777 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f1830066f60 0x7f1830069420 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.928+0000 7f185ba00640 1 --2- 172.21.15.173:0/1749421777 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18540cc7e0 0x7f18540cc170 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.928+0000 7f185ba00640 1 --2- 172.21.15.173:0/1749421777 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18540aef70 0x7f18540cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.928+0000 7f185ba00640 1 --2- 172.21.15.173:0/1749421777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18540aeb90 0x7f1854150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.928+0000 7f185ba00640 1 -- 172.21.15.173:0/1749421777 >> 172.21.15.173:0/1749421777 conn(0x7f185406ac90 msgr2=0x7f185406e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:40.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.928+0000 7f185ba00640 1 -- 172.21.15.173:0/1749421777 shutdown_connections 2024-04-25T09:14:40.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:40.928+0000 7f185ba00640 1 -- 172.21.15.173:0/1749421777 wait complete. 2024-04-25T09:14:40.932 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-04-25T09:14:41.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.096+0000 7fefbbe00640 1 Processor -- start 2024-04-25T09:14:41.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.096+0000 7fefbbe00640 1 -- start start 2024-04-25T09:14:41.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.096+0000 7fefbbe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fefbc0b0de0 0x7fefbc09a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.096+0000 7fefbbe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fefbc06c0b0 0x7fefbc06c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.096+0000 7fefbbe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefbc15dd20 con 0x7fefbc15d940 2024-04-25T09:14:41.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.096+0000 7fefbbe00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefbc0b13a0 con 0x7fefbc0b0de0 2024-04-25T09:14:41.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.096+0000 7fefbbe00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefbc0b1680 con 0x7fefbc06c0b0 2024-04-25T09:14:41.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.096+0000 7fefb2000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fefbc0b0de0 0x7fefbc09a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.096+0000 7fefb2000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fefbc0b0de0 0x7fefbc09a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39852/0 (socket says 172.21.15.173:39852) 2024-04-25T09:14:41.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.096+0000 7fefb2000640 1 -- 172.21.15.173:0/2409740484 learned_addr learned my addr 172.21.15.173:0/2409740484 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:41.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.096+0000 7fefbb400640 1 --2- 172.21.15.173:0/2409740484 >> v2:172.21.15.194:3300/0 conn(0x7fefbc06c0b0 0x7fefbc06c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.096+0000 7fefb2000640 1 -- 172.21.15.173:0/2409740484 >> v2:172.21.15.194:3300/0 conn(0x7fefbc06c0b0 msgr2=0x7fefbc06c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:41.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.096+0000 7fefb2000640 1 --2- 172.21.15.173:0/2409740484 >> v2:172.21.15.194:3300/0 conn(0x7fefbc06c0b0 0x7fefbc06c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.096+0000 7fefb2000640 1 -- 172.21.15.173:0/2409740484 >> v1:172.21.15.194:6789/0 conn(0x7fefbc15d940 legacy=0x7fefbc099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:41.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.096+0000 7fefb2000640 1 -- 172.21.15.173:0/2409740484 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc0b1960 con 0x7fefbc0b0de0 2024-04-25T09:14:41.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.100+0000 7fefb2000640 1 --2- 172.21.15.173:0/2409740484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefbc0b0de0 0x7fefbc09a160 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0cbc00 tx=0x7fefa401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4207c563106fa76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:41.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.100+0000 7fefba000640 1 -- 172.21.15.173:0/2409740484 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa40ab660 con 0x7fefbc0b0de0 2024-04-25T09:14:41.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.100+0000 7fefba000640 1 -- 172.21.15.173:0/2409740484 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa40b0070 con 0x7fefbc0b0de0 2024-04-25T09:14:41.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.100+0000 7fefba000640 1 -- 172.21.15.173:0/2409740484 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa40aba20 con 0x7fefbc0b0de0 2024-04-25T09:14:41.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.100+0000 7fefbbe00640 1 -- 172.21.15.173:0/2409740484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefbc0b0de0 msgr2=0x7fefbc09a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.100+0000 7fefbbe00640 1 --2- 172.21.15.173:0/2409740484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefbc0b0de0 0x7fefbc09a160 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0cbc00 tx=0x7fefa401c460 comp rx=0 tx=0).stop 2024-04-25T09:14:41.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.100+0000 7fefbbe00640 1 -- 172.21.15.173:0/2409740484 shutdown_connections 2024-04-25T09:14:41.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.100+0000 7fefbbe00640 1 --2- 172.21.15.173:0/2409740484 >> v2:172.21.15.194:3300/0 conn(0x7fefbc06c0b0 0x7fefbc06c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.100+0000 7fefbbe00640 1 --2- 172.21.15.173:0/2409740484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefbc0b0de0 0x7fefbc09a160 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.100+0000 7fefbbe00640 1 -- 172.21.15.173:0/2409740484 >> 172.21.15.173:0/2409740484 conn(0x7fefbc0d1620 msgr2=0x7fefbc0d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:41.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.100+0000 7fefbbe00640 1 -- 172.21.15.173:0/2409740484 shutdown_connections 2024-04-25T09:14:41.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.100+0000 7fefbbe00640 1 -- 172.21.15.173:0/2409740484 wait complete. 2024-04-25T09:14:41.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbbe00640 1 Processor -- start 2024-04-25T09:14:41.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbbe00640 1 -- start start 2024-04-25T09:14:41.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbbe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefbc06c0b0 0x7fefbc154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefbc0b0de0 0x7fefbc15e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefbc15d940 0x7fefbc156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbbe00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc09a6a0 con 0x7fefbc06c0b0 2024-04-25T09:14:41.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbbe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0b2440 con 0x7fefbc15d940 2024-04-25T09:14:41.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbbe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc09a820 con 0x7fefbc0b0de0 2024-04-25T09:14:41.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbaa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefbc06c0b0 0x7fefbc154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefb2000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefbc0b0de0 0x7fefbc15e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbb400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefbc15d940 0x7fefbc156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbaa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefbc06c0b0 0x7fefbc154220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39858/0 (socket says 172.21.15.173:39858) 2024-04-25T09:14:41.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbaa00640 1 -- 172.21.15.173:0/1041863458 learned_addr learned my addr 172.21.15.173:0/1041863458 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:41.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbaa00640 1 -- 172.21.15.173:0/1041863458 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefbc0b0de0 msgr2=0x7fefbc15e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbaa00640 1 --2- 172.21.15.173:0/1041863458 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefbc0b0de0 0x7fefbc15e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbaa00640 1 -- 172.21.15.173:0/1041863458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefbc15d940 msgr2=0x7fefbc156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbaa00640 1 --2- 172.21.15.173:0/1041863458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefbc15d940 0x7fefbc156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbaa00640 1 -- 172.21.15.173:0/1041863458 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc15e6e0 con 0x7fefbc06c0b0 2024-04-25T09:14:41.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbaa00640 1 --2- 172.21.15.173:0/1041863458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefbc06c0b0 0x7fefbc154220 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7fefac00c790 tx=0x7fefac00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:41.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefb3400640 1 -- 172.21.15.173:0/1041863458 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac016020 con 0x7fefbc06c0b0 2024-04-25T09:14:41.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefb3400640 1 -- 172.21.15.173:0/1041863458 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac006d60 con 0x7fefbc06c0b0 2024-04-25T09:14:41.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbbe00640 1 -- 172.21.15.173:0/1041863458 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefbc154a90 con 0x7fefbc06c0b0 2024-04-25T09:14:41.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefb3400640 1 -- 172.21.15.173:0/1041863458 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac003bc0 con 0x7fefbc06c0b0 2024-04-25T09:14:41.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbbe00640 1 -- 172.21.15.173:0/1041863458 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefbc155050 con 0x7fefbc06c0b0 2024-04-25T09:14:41.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.104+0000 7fefbbe00640 1 -- 172.21.15.173:0/1041863458 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefbc073a40 con 0x7fefbc06c0b0 2024-04-25T09:14:41.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.108+0000 7fefb3400640 1 -- 172.21.15.173:0/1041863458 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fefac0050d0 con 0x7fefbc06c0b0 2024-04-25T09:14:41.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.108+0000 7fefb3400640 1 --2- 172.21.15.173:0/1041863458 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fef98066f90 0x7fef98069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.108+0000 7fefb3400640 1 -- 172.21.15.173:0/1041863458 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fefac084c40 con 0x7fefbc06c0b0 2024-04-25T09:14:41.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.108+0000 7fefb2000640 1 --2- 172.21.15.173:0/1041863458 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fef98066f90 0x7fef98069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.108+0000 7fefb2000640 1 --2- 172.21.15.173:0/1041863458 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fef98066f90 0x7fef98069450 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fefa40af000 tx=0x7fefa40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:41.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.112+0000 7fefb3400640 1 -- 172.21.15.173:0/1041863458 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fefac020020 con 0x7fefbc06c0b0 2024-04-25T09:14:41.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.360+0000 7fefbbe00640 1 -- 172.21.15.173:0/1041863458 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) v1 -- 0x7fefbc15a840 con 0x7fefbc06c0b0 2024-04-25T09:14:41.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.576+0000 7fefb3400640 1 -- 172.21.15.173:0/1041863458 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v567) v1 ==== 159+0+0 (secure 0 0 0) 0x7fefac055db0 con 0x7fefbc06c0b0 2024-04-25T09:14:41.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.576+0000 7fefbbe00640 1 -- 172.21.15.173:0/1041863458 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fef98066f90 msgr2=0x7fef98069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.576+0000 7fefbbe00640 1 --2- 172.21.15.173:0/1041863458 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fef98066f90 0x7fef98069450 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fefa40af000 tx=0x7fefa40a7000 comp rx=0 tx=0).stop 2024-04-25T09:14:41.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.576+0000 7fefbbe00640 1 -- 172.21.15.173:0/1041863458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefbc06c0b0 msgr2=0x7fefbc154220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.576+0000 7fefbbe00640 1 --2- 172.21.15.173:0/1041863458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefbc06c0b0 0x7fefbc154220 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7fefac00c790 tx=0x7fefac00cb90 comp rx=0 tx=0).stop 2024-04-25T09:14:41.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.576+0000 7fefbbe00640 1 -- 172.21.15.173:0/1041863458 shutdown_connections 2024-04-25T09:14:41.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.576+0000 7fefbbe00640 1 --2- 172.21.15.173:0/1041863458 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fef98066f90 0x7fef98069450 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.576+0000 7fefbbe00640 1 --2- 172.21.15.173:0/1041863458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefbc15d940 0x7fefbc156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.576+0000 7fefbbe00640 1 --2- 172.21.15.173:0/1041863458 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefbc0b0de0 0x7fefbc15e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.576+0000 7fefbbe00640 1 --2- 172.21.15.173:0/1041863458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefbc06c0b0 0x7fefbc154220 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.576+0000 7fefbbe00640 1 -- 172.21.15.173:0/1041863458 >> 172.21.15.173:0/1041863458 conn(0x7fefbc0d1620 msgr2=0x7fefbc0ae390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:41.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.576+0000 7fefbbe00640 1 -- 172.21.15.173:0/1041863458 shutdown_connections 2024-04-25T09:14:41.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:41.576+0000 7fefbbe00640 1 -- 172.21.15.173:0/1041863458 wait complete. 2024-04-25T09:14:41.581 INFO:tasks.cephfs_test_runner:test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ERROR 2024-04-25T09:14:41.582 INFO:tasks.cephfs_test_runner: 2024-04-25T09:14:41.582 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-25T09:14:41.582 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T09:14:41.582 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T09:14:41.582 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-25T09:14:41.582 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa/tasks/cephfs/test_scrub_checks.py", line 190, in test_scrub_when_mds_is_inactive 2024-04-25T09:14:41.582 INFO:tasks.cephfs_test_runner: sr_mds_id = self.get_daemon_names('up:standby-replay', status=status)[0] 2024-04-25T09:14:41.583 INFO:tasks.cephfs_test_runner:AttributeError: 'TestScrubControls' object has no attribute 'get_daemon_names' 2024-04-25T09:14:41.583 INFO:tasks.cephfs_test_runner: 2024-04-25T09:14:41.583 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T09:14:41.583 INFO:tasks.cephfs_test_runner:Ran 9 tests in 666.018s 2024-04-25T09:14:41.583 INFO:tasks.cephfs_test_runner: 2024-04-25T09:14:41.583 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-04-25T09:14:41.583 INFO:tasks.cephfs_test_runner: 2024-04-25T09:14:41.583 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-25T09:14:41.583 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T09:14:41.583 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T09:14:41.583 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-25T09:14:41.583 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa/tasks/cephfs/test_scrub_checks.py", line 190, in test_scrub_when_mds_is_inactive 2024-04-25T09:14:41.584 INFO:tasks.cephfs_test_runner: sr_mds_id = self.get_daemon_names('up:standby-replay', status=status)[0] 2024-04-25T09:14:41.584 INFO:tasks.cephfs_test_runner:AttributeError: 'TestScrubControls' object has no attribute 'get_daemon_names' 2024-04-25T09:14:41.584 INFO:tasks.cephfs_test_runner: 2024-04-25T09:14:41.584 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T09:14:41.805 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=af9e065c13d542a7b9b51918007a9ec9 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T09:14:41.807 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-25T09:14:41.817 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T09:14:41.900 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T09:14:41.900 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:14:41.900 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:41.916 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:14:41.916 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-25T09:14:41.916 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:41.962 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350316k,nr_inodes=4087579,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6528 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:14:41.963 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:14:41.963 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:41.972 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:14:41.972 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-25T09:14:41.972 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:42.021 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:14:42.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:42.021 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-25T09:14:42.030 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:14:42.030 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:14:42.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:42.031 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:14:42.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:42.093 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:14:42.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:42.160 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link delete ceph-brx 2024-04-25T09:14:42.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:42.346 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-25T09:14:42.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:42.355 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link delete ceph-brx 2024-04-25T09:14:42.421 INFO:teuthology.orchestra.run.smithi173.stderr:Cannot find device "ceph-brx" 2024-04-25T09:14:42.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:14:42.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:42.424 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-04-25T09:14:42.433 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T09:14:42.433 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T09:14:42.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:42.434 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T09:14:42.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:42.501 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T09:14:42.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:42.564 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2024-04-25T09:14:42.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:42.749 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-04-25T09:14:42.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:42.757 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2024-04-25T09:14:42.823 INFO:teuthology.orchestra.run.smithi194.stderr:Cannot find device "ceph-brx" 2024-04-25T09:14:42.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:14:42.826 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T09:14:42.836 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T09:14:42.836 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:14:42.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.988+0000 7fc026000640 1 Processor -- start 2024-04-25T09:14:42.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.988+0000 7fc026000640 1 -- start start 2024-04-25T09:14:42.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.988+0000 7fc026000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc0200b3e70 0x7fc0200b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.988+0000 7fc026000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0200b3590 con 0x7fc0200aefa0 2024-04-25T09:14:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.992+0000 7fc026000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0200b4790 con 0x7fc02015edd0 2024-04-25T09:14:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.992+0000 7fc026000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02006dd50 con 0x7fc0200b3e70 2024-04-25T09:14:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.992+0000 7fc01f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc0200b3e70 0x7fc0200b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.992+0000 7fc01f400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc0200b3e70 0x7fc0200b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39868/0 (socket says 172.21.15.173:39868) 2024-04-25T09:14:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.992+0000 7fc01f400640 1 -- 172.21.15.173:0/506321473 learned_addr learned my addr 172.21.15.173:0/506321473 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.992+0000 7fc01ea00640 1 --1- 172.21.15.173:0/506321473 >> v1:172.21.15.173:6789/0 conn(0x7fc0200aefa0 0x7fc0200b2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45508/0 (socket says 172.21.15.173:45508) 2024-04-25T09:14:42.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.992+0000 7fc01f400640 1 -- 172.21.15.173:0/506321473 >> v1:172.21.15.194:6789/0 conn(0x7fc02015edd0 legacy=0x7fc0200b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.992+0000 7fc01f400640 1 -- 172.21.15.173:0/506321473 >> v1:172.21.15.173:6789/0 conn(0x7fc0200aefa0 legacy=0x7fc0200b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.992+0000 7fc01f400640 1 -- 172.21.15.173:0/506321473 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02015f320 con 0x7fc0200b3e70 2024-04-25T09:14:42.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.992+0000 7fc01f400640 1 --2- 172.21.15.173:0/506321473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0200b3e70 0x7fc0200b4250 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7fc010009e50 tx=0x7fc01001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c53e4869e3182bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:42.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.992+0000 7fc01e000640 1 -- 172.21.15.173:0/506321473 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100a58f0 con 0x7fc0200b3e70 2024-04-25T09:14:42.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.992+0000 7fc01e000640 1 -- 172.21.15.173:0/506321473 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0100a5a90 con 0x7fc0200b3e70 2024-04-25T09:14:42.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.992+0000 7fc01e000640 1 -- 172.21.15.173:0/506321473 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100a5e60 con 0x7fc0200b3e70 2024-04-25T09:14:42.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc026000640 1 -- 172.21.15.173:0/506321473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0200b3e70 msgr2=0x7fc0200b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc026000640 1 --2- 172.21.15.173:0/506321473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0200b3e70 0x7fc0200b4250 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7fc010009e50 tx=0x7fc01001ca00 comp rx=0 tx=0).stop 2024-04-25T09:14:42.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc026000640 1 -- 172.21.15.173:0/506321473 shutdown_connections 2024-04-25T09:14:42.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc026000640 1 --2- 172.21.15.173:0/506321473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0200b3e70 0x7fc0200b4250 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc026000640 1 -- 172.21.15.173:0/506321473 >> 172.21.15.173:0/506321473 conn(0x7fc02006ac90 msgr2=0x7fc02006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:42.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc026000640 1 -- 172.21.15.173:0/506321473 shutdown_connections 2024-04-25T09:14:42.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc026000640 1 -- 172.21.15.173:0/506321473 wait complete. 2024-04-25T09:14:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc026000640 1 Processor -- start 2024-04-25T09:14:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc026000640 1 -- start start 2024-04-25T09:14:42.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc026000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0200aefa0 0x7fc02014c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc026000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0200b3e70 0x7fc020144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc026000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc02015edd0 0x7fc0200ce930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc026000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02015aba0 con 0x7fc02015edd0 2024-04-25T09:14:42.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc026000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0200ce7b0 con 0x7fc0200b3e70 2024-04-25T09:14:42.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc026000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02006e1e0 con 0x7fc0200aefa0 2024-04-25T09:14:42.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc01fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc02015edd0 0x7fc0200ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc01fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc02015edd0 0x7fc0200ce930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39870/0 (socket says 172.21.15.173:39870) 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc01fe00640 1 -- 172.21.15.173:0/395943584 learned_addr learned my addr 172.21.15.173:0/395943584 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc01ea00640 1 --2- 172.21.15.173:0/395943584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0200b3e70 0x7fc020144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc01f400640 1 --2- 172.21.15.173:0/395943584 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0200aefa0 0x7fc02014c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc01fe00640 1 -- 172.21.15.173:0/395943584 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0200aefa0 msgr2=0x7fc02014c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc01fe00640 1 --2- 172.21.15.173:0/395943584 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0200aefa0 0x7fc02014c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc01fe00640 1 -- 172.21.15.173:0/395943584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0200b3e70 msgr2=0x7fc020144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc01fe00640 1 --2- 172.21.15.173:0/395943584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0200b3e70 0x7fc020144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc01fe00640 1 -- 172.21.15.173:0/395943584 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02014ce40 con 0x7fc02015edd0 2024-04-25T09:14:42.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:42.996+0000 7fc01fe00640 1 --2- 172.21.15.173:0/395943584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc02015edd0 0x7fc0200ce930 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7fc01800c430 tx=0x7fc01800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:42.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.000+0000 7fc017400640 1 -- 172.21.15.173:0/395943584 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018005220 con 0x7fc02015edd0 2024-04-25T09:14:42.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.000+0000 7fc017400640 1 -- 172.21.15.173:0/395943584 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0180053c0 con 0x7fc02015edd0 2024-04-25T09:14:42.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.000+0000 7fc017400640 1 -- 172.21.15.173:0/395943584 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018007270 con 0x7fc02015edd0 2024-04-25T09:14:42.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.000+0000 7fc026000640 1 -- 172.21.15.173:0/395943584 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02014d120 con 0x7fc02015edd0 2024-04-25T09:14:42.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.000+0000 7fc026000640 1 -- 172.21.15.173:0/395943584 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02014d6e0 con 0x7fc02015edd0 2024-04-25T09:14:42.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.000+0000 7fc026000640 1 -- 172.21.15.173:0/395943584 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc02015cef0 con 0x7fc02015edd0 2024-04-25T09:14:42.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.000+0000 7fc017400640 1 -- 172.21.15.173:0/395943584 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc018019020 con 0x7fc02015edd0 2024-04-25T09:14:42.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.000+0000 7fc017400640 1 --2- 172.21.15.173:0/395943584 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc000066f60 0x7fc000069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.000+0000 7fc017400640 1 -- 172.21.15.173:0/395943584 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc018084300 con 0x7fc02015edd0 2024-04-25T09:14:42.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.000+0000 7fc01f400640 1 --2- 172.21.15.173:0/395943584 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc000066f60 0x7fc000069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.000+0000 7fc01f400640 1 --2- 172.21.15.173:0/395943584 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc000066f60 0x7fc000069420 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc0100ae000 tx=0x7fc0100a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.004+0000 7fc017400640 1 -- 172.21.15.173:0/395943584 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc0180553e0 con 0x7fc02015edd0 2024-04-25T09:14:43.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.156+0000 7fc026000640 1 -- 172.21.15.173:0/395943584 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc02006f1c0 con 0x7fc000066f60 2024-04-25T09:14:43.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.156+0000 7fc017400640 1 -- 172.21.15.173:0/395943584 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13542 (secure 0 0 0) 0x7fc02006f1c0 con 0x7fc000066f60 2024-04-25T09:14:43.141 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:43.142 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:14:43.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.156+0000 7fc026000640 1 -- 172.21.15.173:0/395943584 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc000066f60 msgr2=0x7fc000069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.156+0000 7fc026000640 1 --2- 172.21.15.173:0/395943584 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc000066f60 0x7fc000069420 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc0100ae000 tx=0x7fc0100a7070 comp rx=0 tx=0).stop 2024-04-25T09:14:43.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.156+0000 7fc026000640 1 -- 172.21.15.173:0/395943584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc02015edd0 msgr2=0x7fc0200ce930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.156+0000 7fc026000640 1 --2- 172.21.15.173:0/395943584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc02015edd0 0x7fc0200ce930 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7fc01800c430 tx=0x7fc01800c8f0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.160+0000 7fc026000640 1 -- 172.21.15.173:0/395943584 shutdown_connections 2024-04-25T09:14:43.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.160+0000 7fc026000640 1 --2- 172.21.15.173:0/395943584 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fc000066f60 0x7fc000069420 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.160+0000 7fc026000640 1 --2- 172.21.15.173:0/395943584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc02015edd0 0x7fc0200ce930 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.160+0000 7fc026000640 1 --2- 172.21.15.173:0/395943584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0200b3e70 0x7fc020144d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.160+0000 7fc026000640 1 --2- 172.21.15.173:0/395943584 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0200aefa0 0x7fc02014c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.160+0000 7fc026000640 1 -- 172.21.15.173:0/395943584 >> 172.21.15.173:0/395943584 conn(0x7fc02006ac90 msgr2=0x7fc0200b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:43.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.160+0000 7fc026000640 1 -- 172.21.15.173:0/395943584 shutdown_connections 2024-04-25T09:14:43.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.160+0000 7fc026000640 1 -- 172.21.15.173:0/395943584 wait complete. 2024-04-25T09:14:43.163 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":505,"stamp":"2024-04-25T09:14:42.885082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2305004,"kb_used_data":1850240,"kb_used_omap":12,"kb_used_meta":454643,"kb_avail":752669716,"statfs":{"total":773094113280,"available":770733789184,"internally_reserved":0,"allocated":1894645760,"data_stored":1886774519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":465554992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1078296488,"num_objects":-1047,"num_object_clones":0,"num_object_copies":-2094,"num_objects_missing_on_primary":0,"num_objects_missing":-10,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1047,"num_whiteouts":0,"num_read":-17,"num_read_kb":-2427,"num_write":-1136,"num_write_kb":-1053172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001155"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":408,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-25T09:14:41.162903+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:14:41.162903+0000","last_peered":"2024-04-25T09:14:41.162903+0000","last_clean":"2024-04-25T09:14:41.162903+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:14:41.162903+0000","last_undegraded":"2024-04-25T09:14:41.162903+0000","last_fullsized":"2024-04-25T09:14:41.162903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509587,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306420,"kb_used_data":253032,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94065420,"statfs":{"total":96636764160,"available":96322990080,"internally_reserved":0,"allocated":259104768,"data_stored":258123326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509587,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325440,"kb_used_data":276212,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94046400,"statfs":{"total":96636764160,"available":96303513600,"internally_reserved":0,"allocated":282841088,"data_stored":281870858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509588,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":377528,"kb_used_data":314476,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":93994312,"statfs":{"total":96636764160,"available":96250175488,"internally_reserved":0,"allocated":322023424,"data_stored":321038488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509587,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":409940,"kb_used_data":346888,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":93961900,"statfs":{"total":96636764160,"available":96216985600,"internally_reserved":0,"allocated":355213312,"data_stored":354229749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64551367},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509587,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":287692,"kb_used_data":230140,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94084148,"statfs":{"total":96636764160,"available":96342167552,"internally_reserved":0,"allocated":235663360,"data_stored":234685050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509588,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289680,"kb_used_data":236292,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94082160,"statfs":{"total":96636764160,"available":96340131840,"internally_reserved":0,"allocated":241963008,"data_stored":240982995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509588,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248348,"kb_used_data":190796,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94123492,"statfs":{"total":96636764160,"available":96382455808,"internally_reserved":0,"allocated":195375104,"data_stored":194382220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574996,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59956,"kb_used_data":2404,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311884,"statfs":{"total":96636764160,"available":96575369216,"internally_reserved":0,"allocated":2461696,"data_stored":1461833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:14:43.164 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:14:43.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.316+0000 7fe080000640 1 Processor -- start 2024-04-25T09:14:43.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.316+0000 7fe080000640 1 -- start start 2024-04-25T09:14:43.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.316+0000 7fe080000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe078145250 0x7fe07815c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.316+0000 7fe080000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe0780cc8b0 0x7fe0780ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.316+0000 7fe080000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe078071320 0x7fe078071770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.316+0000 7fe080000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07815cec0 con 0x7fe0780cc8b0 2024-04-25T09:14:43.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.316+0000 7fe080000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07806e7c0 con 0x7fe078145250 2024-04-25T09:14:43.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.316+0000 7fe080000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07806d720 con 0x7fe078071320 2024-04-25T09:14:43.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.316+0000 7fe07cc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe0780cc8b0 0x7fe0780ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.316+0000 7fe07cc00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe0780cc8b0 0x7fe0780ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44222/0 (socket says 172.21.15.173:44222) 2024-04-25T09:14:43.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.316+0000 7fe07e000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe078071320 0x7fe078071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.316+0000 7fe07cc00640 1 -- 172.21.15.173:0/516888547 learned_addr learned my addr 172.21.15.173:0/516888547 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:43.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.316+0000 7fe07d600640 1 --2- 172.21.15.173:0/516888547 >> v2:172.21.15.194:3300/0 conn(0x7fe078145250 0x7fe07815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.316+0000 7fe07cc00640 1 -- 172.21.15.173:0/516888547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe078071320 msgr2=0x7fe078071770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:43.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.316+0000 7fe07cc00640 1 --2- 172.21.15.173:0/516888547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe078071320 0x7fe078071770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.316+0000 7fe07cc00640 1 -- 172.21.15.173:0/516888547 >> v2:172.21.15.194:3300/0 conn(0x7fe078145250 msgr2=0x7fe07815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:43.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.316+0000 7fe07cc00640 1 --2- 172.21.15.173:0/516888547 >> v2:172.21.15.194:3300/0 conn(0x7fe078145250 0x7fe07815c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.316+0000 7fe07cc00640 1 -- 172.21.15.173:0/516888547 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07806da00 con 0x7fe0780cc8b0 2024-04-25T09:14:43.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.320+0000 7fe07cc00640 1 --2- 172.21.15.173:0/516888547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0780cc8b0 0x7fe0780ccd30 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7fe0780d0420 tx=0x7fe06401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfcd9b47a7fb0a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:43.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.320+0000 7fe077e00640 1 -- 172.21.15.173:0/516888547 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0640b1070 con 0x7fe0780cc8b0 2024-04-25T09:14:43.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.320+0000 7fe077e00640 1 -- 172.21.15.173:0/516888547 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0640ac630 con 0x7fe0780cc8b0 2024-04-25T09:14:43.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.320+0000 7fe077e00640 1 -- 172.21.15.173:0/516888547 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0640a8050 con 0x7fe0780cc8b0 2024-04-25T09:14:43.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.320+0000 7fe080000640 1 -- 172.21.15.173:0/516888547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0780cc8b0 msgr2=0x7fe0780ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.320+0000 7fe080000640 1 --2- 172.21.15.173:0/516888547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0780cc8b0 0x7fe0780ccd30 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7fe0780d0420 tx=0x7fe06401c520 comp rx=0 tx=0).stop 2024-04-25T09:14:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.320+0000 7fe080000640 1 -- 172.21.15.173:0/516888547 shutdown_connections 2024-04-25T09:14:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.320+0000 7fe080000640 1 --2- 172.21.15.173:0/516888547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe078071320 0x7fe078071770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.320+0000 7fe080000640 1 --2- 172.21.15.173:0/516888547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0780cc8b0 0x7fe0780ccd30 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.320+0000 7fe080000640 1 --2- 172.21.15.173:0/516888547 >> v2:172.21.15.194:3300/0 conn(0x7fe078145250 0x7fe07815c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.320+0000 7fe080000640 1 -- 172.21.15.173:0/516888547 >> 172.21.15.173:0/516888547 conn(0x7fe07806ac90 msgr2=0x7fe07806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.320+0000 7fe080000640 1 -- 172.21.15.173:0/516888547 shutdown_connections 2024-04-25T09:14:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.320+0000 7fe080000640 1 -- 172.21.15.173:0/516888547 wait complete. 2024-04-25T09:14:43.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.320+0000 7fe080000640 1 Processor -- start 2024-04-25T09:14:43.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.320+0000 7fe080000640 1 -- start start 2024-04-25T09:14:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe080000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe078071320 0x7fe0780b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe080000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0780cc8b0 0x7fe078137f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe080000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe078145250 0x7fe078153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe080000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07806ef80 con 0x7fe0780cc8b0 2024-04-25T09:14:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe080000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe078145630 con 0x7fe078071320 2024-04-25T09:14:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe080000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780720c0 con 0x7fe078145250 2024-04-25T09:14:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe07cc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0780cc8b0 0x7fe078137f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe07cc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0780cc8b0 0x7fe078137f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44226/0 (socket says 172.21.15.173:44226) 2024-04-25T09:14:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe07cc00640 1 -- 172.21.15.173:0/3304557197 learned_addr learned my addr 172.21.15.173:0/3304557197 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe07e000640 1 --2- 172.21.15.173:0/3304557197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe078145250 0x7fe078153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe07d600640 1 --2- 172.21.15.173:0/3304557197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe078071320 0x7fe0780b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe07cc00640 1 -- 172.21.15.173:0/3304557197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe078145250 msgr2=0x7fe078153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe07cc00640 1 --2- 172.21.15.173:0/3304557197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe078145250 0x7fe078153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe07cc00640 1 -- 172.21.15.173:0/3304557197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe078071320 msgr2=0x7fe0780b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe07cc00640 1 --2- 172.21.15.173:0/3304557197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe078071320 0x7fe0780b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe07cc00640 1 -- 172.21.15.173:0/3304557197 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0780b1e00 con 0x7fe0780cc8b0 2024-04-25T09:14:43.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe07cc00640 1 --2- 172.21.15.173:0/3304557197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0780cc8b0 0x7fe078137f50 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7fe06401abd0 tx=0x7fe0640192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:43.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe075600640 1 -- 172.21.15.173:0/3304557197 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0640bc070 con 0x7fe0780cc8b0 2024-04-25T09:14:43.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe075600640 1 -- 172.21.15.173:0/3304557197 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0640ace50 con 0x7fe0780cc8b0 2024-04-25T09:14:43.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe080000640 1 -- 172.21.15.173:0/3304557197 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07813f3e0 con 0x7fe0780cc8b0 2024-04-25T09:14:43.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe075600640 1 -- 172.21.15.173:0/3304557197 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0640b1070 con 0x7fe0780cc8b0 2024-04-25T09:14:43.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe080000640 1 -- 172.21.15.173:0/3304557197 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0780b2350 con 0x7fe0780cc8b0 2024-04-25T09:14:43.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.324+0000 7fe080000640 1 -- 172.21.15.173:0/3304557197 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe078073a40 con 0x7fe0780cc8b0 2024-04-25T09:14:43.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.328+0000 7fe075600640 1 -- 172.21.15.173:0/3304557197 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe0640bf070 con 0x7fe0780cc8b0 2024-04-25T09:14:43.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.328+0000 7fe075600640 1 --2- 172.21.15.173:0/3304557197 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe058066f60 0x7fe058069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.328+0000 7fe075600640 1 -- 172.21.15.173:0/3304557197 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe06411e5d0 con 0x7fe0780cc8b0 2024-04-25T09:14:43.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.328+0000 7fe07d600640 1 --2- 172.21.15.173:0/3304557197 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe058066f60 0x7fe058069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.328+0000 7fe07d600640 1 --2- 172.21.15.173:0/3304557197 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe058066f60 0x7fe058069420 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe06c009b60 tx=0x7fe06c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:43.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.332+0000 7fe075600640 1 -- 172.21.15.173:0/3304557197 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe064016110 con 0x7fe0780cc8b0 2024-04-25T09:14:43.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.480+0000 7fe080000640 1 -- 172.21.15.173:0/3304557197 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe07813a7a0 con 0x7fe058066f60 2024-04-25T09:14:43.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.480+0000 7fe075600640 1 -- 172.21.15.173:0/3304557197 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13542 (secure 0 0 0) 0x7fe06c011ac0 con 0x7fe058066f60 2024-04-25T09:14:43.466 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:43.467 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:14:43.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.484+0000 7fe080000640 1 -- 172.21.15.173:0/3304557197 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe058066f60 msgr2=0x7fe058069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.484+0000 7fe080000640 1 --2- 172.21.15.173:0/3304557197 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe058066f60 0x7fe058069420 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe06c009b60 tx=0x7fe06c009190 comp rx=0 tx=0).stop 2024-04-25T09:14:43.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.484+0000 7fe080000640 1 -- 172.21.15.173:0/3304557197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0780cc8b0 msgr2=0x7fe078137f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.484+0000 7fe080000640 1 --2- 172.21.15.173:0/3304557197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0780cc8b0 0x7fe078137f50 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7fe06401abd0 tx=0x7fe0640192c0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.484+0000 7fe080000640 1 -- 172.21.15.173:0/3304557197 shutdown_connections 2024-04-25T09:14:43.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.484+0000 7fe080000640 1 --2- 172.21.15.173:0/3304557197 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe058066f60 0x7fe058069420 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.484+0000 7fe080000640 1 --2- 172.21.15.173:0/3304557197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe078145250 0x7fe078153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.484+0000 7fe080000640 1 --2- 172.21.15.173:0/3304557197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0780cc8b0 0x7fe078137f50 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.484+0000 7fe080000640 1 --2- 172.21.15.173:0/3304557197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe078071320 0x7fe0780b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.484+0000 7fe080000640 1 -- 172.21.15.173:0/3304557197 >> 172.21.15.173:0/3304557197 conn(0x7fe07806ac90 msgr2=0x7fe0780b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:43.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.484+0000 7fe080000640 1 -- 172.21.15.173:0/3304557197 shutdown_connections 2024-04-25T09:14:43.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.484+0000 7fe080000640 1 -- 172.21.15.173:0/3304557197 wait complete. 2024-04-25T09:14:43.486 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":505,"stamp":"2024-04-25T09:14:42.885082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2305004,"kb_used_data":1850240,"kb_used_omap":12,"kb_used_meta":454643,"kb_avail":752669716,"statfs":{"total":773094113280,"available":770733789184,"internally_reserved":0,"allocated":1894645760,"data_stored":1886774519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":465554992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1078296488,"num_objects":-1047,"num_object_clones":0,"num_object_copies":-2094,"num_objects_missing_on_primary":0,"num_objects_missing":-10,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1047,"num_whiteouts":0,"num_read":-17,"num_read_kb":-2427,"num_write":-1136,"num_write_kb":-1053172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001155"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":408,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-25T09:14:41.162903+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:14:41.162903+0000","last_peered":"2024-04-25T09:14:41.162903+0000","last_clean":"2024-04-25T09:14:41.162903+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:14:41.162903+0000","last_undegraded":"2024-04-25T09:14:41.162903+0000","last_fullsized":"2024-04-25T09:14:41.162903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509587,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306420,"kb_used_data":253032,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94065420,"statfs":{"total":96636764160,"available":96322990080,"internally_reserved":0,"allocated":259104768,"data_stored":258123326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509587,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325440,"kb_used_data":276212,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94046400,"statfs":{"total":96636764160,"available":96303513600,"internally_reserved":0,"allocated":282841088,"data_stored":281870858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509588,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":377528,"kb_used_data":314476,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":93994312,"statfs":{"total":96636764160,"available":96250175488,"internally_reserved":0,"allocated":322023424,"data_stored":321038488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509587,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":409940,"kb_used_data":346888,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":93961900,"statfs":{"total":96636764160,"available":96216985600,"internally_reserved":0,"allocated":355213312,"data_stored":354229749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64551367},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509587,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":287692,"kb_used_data":230140,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94084148,"statfs":{"total":96636764160,"available":96342167552,"internally_reserved":0,"allocated":235663360,"data_stored":234685050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509588,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289680,"kb_used_data":236292,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94082160,"statfs":{"total":96636764160,"available":96340131840,"internally_reserved":0,"allocated":241963008,"data_stored":240982995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509588,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248348,"kb_used_data":190796,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94123492,"statfs":{"total":96636764160,"available":96382455808,"internally_reserved":0,"allocated":195375104,"data_stored":194382220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574996,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59956,"kb_used_data":2404,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311884,"statfs":{"total":96636764160,"available":96575369216,"internally_reserved":0,"allocated":2461696,"data_stored":1461833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:14:43.487 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T09:14:43.487 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:14:43.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.640+0000 7f5657400640 1 Processor -- start 2024-04-25T09:14:43.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.640+0000 7f5657400640 1 -- start start 2024-04-25T09:14:43.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.640+0000 7f5657400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f56500b3e70 0x7f56500b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.640+0000 7f5657400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f565015edd0 0x7f56500b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.640+0000 7f5657400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56500b4790 con 0x7f56500aefa0 2024-04-25T09:14:43.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.640+0000 7f5657400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565006dd50 con 0x7f56500b3e70 2024-04-25T09:14:43.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.640+0000 7f5657400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565015f320 con 0x7f565015edd0 2024-04-25T09:14:43.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.640+0000 7f564fe00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f56500aefa0 0x7f56500b2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44458/0 (socket says 172.21.15.173:44458) 2024-04-25T09:14:43.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.640+0000 7f564fe00640 1 -- 172.21.15.173:0/1693022675 learned_addr learned my addr 172.21.15.173:0/1693022675 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:43.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.640+0000 7f5655400640 1 --2- 172.21.15.173:0/1693022675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f565015edd0 0x7f56500b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.640+0000 7f5654a00640 1 --2- 172.21.15.173:0/1693022675 >> v2:172.21.15.194:3300/0 conn(0x7f56500b3e70 0x7f56500b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.640+0000 7f564f400640 1 -- 172.21.15.173:0/1693022675 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434961264 0 0) 0x7f56500b4790 con 0x7f56500aefa0 2024-04-25T09:14:43.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.640+0000 7f564f400640 1 -- 172.21.15.173:0/1693022675 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5634003530 con 0x7f56500aefa0 2024-04-25T09:14:43.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.640+0000 7f5655400640 1 -- 172.21.15.173:0/1693022675 >> v2:172.21.15.194:3300/0 conn(0x7f56500b3e70 msgr2=0x7f56500b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:43.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.640+0000 7f5655400640 1 --2- 172.21.15.173:0/1693022675 >> v2:172.21.15.194:3300/0 conn(0x7f56500b3e70 0x7f56500b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.640+0000 7f5655400640 1 -- 172.21.15.173:0/1693022675 >> v1:172.21.15.173:6789/0 conn(0x7f56500aefa0 legacy=0x7f56500b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.640+0000 7f5655400640 1 -- 172.21.15.173:0/1693022675 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565006d420 con 0x7f565015edd0 2024-04-25T09:14:43.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.640+0000 7f5654a00640 1 --2- 172.21.15.173:0/1693022675 >> v2:172.21.15.194:3300/0 conn(0x7f56500b3e70 0x7f56500b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:43.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.644+0000 7f5655400640 1 --2- 172.21.15.173:0/1693022675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f565015edd0 0x7f56500b2e80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5648009d90 tx=0x7f564801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4847234c4ba168b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:43.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.644+0000 7f564f400640 1 -- 172.21.15.173:0/1693022675 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56480b2070 con 0x7f565015edd0 2024-04-25T09:14:43.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.644+0000 7f564f400640 1 -- 172.21.15.173:0/1693022675 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56480a5a20 con 0x7f565015edd0 2024-04-25T09:14:43.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.644+0000 7f564f400640 1 -- 172.21.15.173:0/1693022675 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56480a5dd0 con 0x7f565015edd0 2024-04-25T09:14:43.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.644+0000 7f5657400640 1 -- 172.21.15.173:0/1693022675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f565015edd0 msgr2=0x7f56500b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.644+0000 7f5657400640 1 --2- 172.21.15.173:0/1693022675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f565015edd0 0x7f56500b2e80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5648009d90 tx=0x7f564801c940 comp rx=0 tx=0).stop 2024-04-25T09:14:43.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.644+0000 7f5657400640 1 -- 172.21.15.173:0/1693022675 shutdown_connections 2024-04-25T09:14:43.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.644+0000 7f5657400640 1 --2- 172.21.15.173:0/1693022675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f565015edd0 0x7f56500b2e80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.644+0000 7f5657400640 1 --2- 172.21.15.173:0/1693022675 >> v2:172.21.15.194:3300/0 conn(0x7f56500b3e70 0x7f56500b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.644+0000 7f5657400640 1 -- 172.21.15.173:0/1693022675 >> 172.21.15.173:0/1693022675 conn(0x7f565006ac90 msgr2=0x7f565006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:43.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.644+0000 7f5657400640 1 -- 172.21.15.173:0/1693022675 shutdown_connections 2024-04-25T09:14:43.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.644+0000 7f5657400640 1 -- 172.21.15.173:0/1693022675 wait complete. 2024-04-25T09:14:43.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5657400640 1 Processor -- start 2024-04-25T09:14:43.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5657400640 1 -- start start 2024-04-25T09:14:43.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5657400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56500aefa0 0x7f5650144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5657400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56500b3e70 0x7f56500cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5657400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f565015edd0 0x7f56500cff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5657400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565006e1c0 con 0x7f565015edd0 2024-04-25T09:14:43.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5657400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565015aba0 con 0x7f56500b3e70 2024-04-25T09:14:43.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5657400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565006e340 con 0x7f56500aefa0 2024-04-25T09:14:43.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5654a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56500aefa0 0x7f5650144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5655400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f565015edd0 0x7f56500cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5654a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56500aefa0 0x7f5650144a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:59444/0 (socket says 172.21.15.173:59444) 2024-04-25T09:14:43.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5654a00640 1 -- 172.21.15.173:0/581578966 learned_addr learned my addr 172.21.15.173:0/581578966 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:43.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f564fe00640 1 --2- 172.21.15.173:0/581578966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56500b3e70 0x7f56500cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5655400640 1 -- 172.21.15.173:0/581578966 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56500aefa0 msgr2=0x7f5650144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5655400640 1 --2- 172.21.15.173:0/581578966 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56500aefa0 0x7f5650144a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5655400640 1 -- 172.21.15.173:0/581578966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56500b3e70 msgr2=0x7f56500cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5655400640 1 --2- 172.21.15.173:0/581578966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56500b3e70 0x7f56500cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5655400640 1 -- 172.21.15.173:0/581578966 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565014d7a0 con 0x7f565015edd0 2024-04-25T09:14:43.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5655400640 1 --2- 172.21.15.173:0/581578966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f565015edd0 0x7f56500cff30 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f56480ac000 tx=0x7f56480196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:43.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f564cc00640 1 -- 172.21.15.173:0/581578966 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56480b2050 con 0x7f565015edd0 2024-04-25T09:14:43.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f564cc00640 1 -- 172.21.15.173:0/581578966 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56480b3040 con 0x7f565015edd0 2024-04-25T09:14:43.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f564cc00640 1 -- 172.21.15.173:0/581578966 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56480ad870 con 0x7f565015edd0 2024-04-25T09:14:43.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5657400640 1 -- 172.21.15.173:0/581578966 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565014da80 con 0x7f565015edd0 2024-04-25T09:14:43.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.648+0000 7f5657400640 1 -- 172.21.15.173:0/581578966 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565014e040 con 0x7f565015edd0 2024-04-25T09:14:43.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.652+0000 7f5657400640 1 -- 172.21.15.173:0/581578966 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5650073a40 con 0x7f565015edd0 2024-04-25T09:14:43.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.652+0000 7f564cc00640 1 -- 172.21.15.173:0/581578966 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f56480c0020 con 0x7f565015edd0 2024-04-25T09:14:43.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.652+0000 7f564cc00640 1 --2- 172.21.15.173:0/581578966 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5630066f60 0x7f5630069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.652+0000 7f564cc00640 1 -- 172.21.15.173:0/581578966 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f564811f480 con 0x7f565015edd0 2024-04-25T09:14:43.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.652+0000 7f5654a00640 1 --2- 172.21.15.173:0/581578966 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5630066f60 0x7f5630069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.652+0000 7f5654a00640 1 --2- 172.21.15.173:0/581578966 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5630066f60 0x7f5630069420 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f5640009600 tx=0x7f5640009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.656+0000 7f564cc00640 1 -- 172.21.15.173:0/581578966 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f56480c7020 con 0x7f565015edd0 2024-04-25T09:14:43.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.812+0000 7f5657400640 1 -- 172.21.15.173:0/581578966 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f565006e540 con 0x7f5630066f60 2024-04-25T09:14:43.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.812+0000 7f564cc00640 1 -- 172.21.15.173:0/581578966 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13542 (secure 0 0 0) 0x7f565006e540 con 0x7f5630066f60 2024-04-25T09:14:43.799 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:43.799 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:14:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.816+0000 7f5657400640 1 -- 172.21.15.173:0/581578966 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5630066f60 msgr2=0x7f5630069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.816+0000 7f5657400640 1 --2- 172.21.15.173:0/581578966 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5630066f60 0x7f5630069420 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f5640009600 tx=0x7f5640009190 comp rx=0 tx=0).stop 2024-04-25T09:14:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.816+0000 7f5657400640 1 -- 172.21.15.173:0/581578966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f565015edd0 msgr2=0x7f56500cff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.816+0000 7f5657400640 1 --2- 172.21.15.173:0/581578966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f565015edd0 0x7f56500cff30 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f56480ac000 tx=0x7f56480196e0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.816+0000 7f5657400640 1 -- 172.21.15.173:0/581578966 shutdown_connections 2024-04-25T09:14:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.816+0000 7f5657400640 1 --2- 172.21.15.173:0/581578966 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5630066f60 0x7f5630069420 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.816+0000 7f5657400640 1 --2- 172.21.15.173:0/581578966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f565015edd0 0x7f56500cff30 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.816+0000 7f5657400640 1 --2- 172.21.15.173:0/581578966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56500b3e70 0x7f56500cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.816+0000 7f5657400640 1 --2- 172.21.15.173:0/581578966 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56500aefa0 0x7f5650144a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.816+0000 7f5657400640 1 -- 172.21.15.173:0/581578966 >> 172.21.15.173:0/581578966 conn(0x7f565006ac90 msgr2=0x7f56500b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:43.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.816+0000 7f5657400640 1 -- 172.21.15.173:0/581578966 shutdown_connections 2024-04-25T09:14:43.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.816+0000 7f5657400640 1 -- 172.21.15.173:0/581578966 wait complete. 2024-04-25T09:14:43.819 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":505,"stamp":"2024-04-25T09:14:42.885082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2305004,"kb_used_data":1850240,"kb_used_omap":12,"kb_used_meta":454643,"kb_avail":752669716,"statfs":{"total":773094113280,"available":770733789184,"internally_reserved":0,"allocated":1894645760,"data_stored":1886774519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":465554992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1078296488,"num_objects":-1047,"num_object_clones":0,"num_object_copies":-2094,"num_objects_missing_on_primary":0,"num_objects_missing":-10,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1047,"num_whiteouts":0,"num_read":-17,"num_read_kb":-2427,"num_write":-1136,"num_write_kb":-1053172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001155"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":408,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-25T09:14:41.162903+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:14:41.162903+0000","last_peered":"2024-04-25T09:14:41.162903+0000","last_clean":"2024-04-25T09:14:41.162903+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:14:41.162903+0000","last_undegraded":"2024-04-25T09:14:41.162903+0000","last_fullsized":"2024-04-25T09:14:41.162903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509587,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306420,"kb_used_data":253032,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94065420,"statfs":{"total":96636764160,"available":96322990080,"internally_reserved":0,"allocated":259104768,"data_stored":258123326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509587,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325440,"kb_used_data":276212,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94046400,"statfs":{"total":96636764160,"available":96303513600,"internally_reserved":0,"allocated":282841088,"data_stored":281870858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509588,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":377528,"kb_used_data":314476,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":93994312,"statfs":{"total":96636764160,"available":96250175488,"internally_reserved":0,"allocated":322023424,"data_stored":321038488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509587,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":409940,"kb_used_data":346888,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":93961900,"statfs":{"total":96636764160,"available":96216985600,"internally_reserved":0,"allocated":355213312,"data_stored":354229749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64551367},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509587,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":287692,"kb_used_data":230140,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94084148,"statfs":{"total":96636764160,"available":96342167552,"internally_reserved":0,"allocated":235663360,"data_stored":234685050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509588,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289680,"kb_used_data":236292,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94082160,"statfs":{"total":96636764160,"available":96340131840,"internally_reserved":0,"allocated":241963008,"data_stored":240982995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509588,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248348,"kb_used_data":190796,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94123492,"statfs":{"total":96636764160,"available":96382455808,"internally_reserved":0,"allocated":195375104,"data_stored":194382220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574996,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59956,"kb_used_data":2404,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311884,"statfs":{"total":96636764160,"available":96575369216,"internally_reserved":0,"allocated":2461696,"data_stored":1461833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:14:43.820 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:14:43.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.972+0000 7f8c6d400640 1 Processor -- start 2024-04-25T09:14:43.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.972+0000 7f8c6d400640 1 -- start start 2024-04-25T09:14:43.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.972+0000 7f8c6d400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8c68147200 0x7f8c680cf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.972+0000 7f8c6d400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6815f080 con 0x7f8c681475e0 2024-04-25T09:14:43.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.972+0000 7f8c6d400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c680cd080 con 0x7f8c68071460 2024-04-25T09:14:43.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.972+0000 7f8c6d400640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c680cd360 con 0x7f8c68147200 2024-04-25T09:14:43.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.972+0000 7f8c66800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8c68147200 0x7f8c680cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.972+0000 7f8c5de00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f8c681475e0 0x7f8c6815e970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44472/0 (socket says 172.21.15.173:44472) 2024-04-25T09:14:43.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.972+0000 7f8c5de00640 1 -- 172.21.15.173:0/2796665898 learned_addr learned my addr 172.21.15.173:0/2796665898 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:43.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.972+0000 7f8c66800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8c68147200 0x7f8c680cf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44236/0 (socket says 172.21.15.173:44236) 2024-04-25T09:14:43.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.972+0000 7f8c66800640 1 -- 172.21.15.173:0/2796665898 >> v1:172.21.15.194:6789/0 conn(0x7f8c68071460 legacy=0x7f8c680ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:43.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.972+0000 7f8c66800640 1 -- 172.21.15.173:0/2796665898 >> v1:172.21.15.173:6789/0 conn(0x7f8c681475e0 legacy=0x7f8c6815e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.972+0000 7f8c66800640 1 -- 172.21.15.173:0/2796665898 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c680cd640 con 0x7f8c68147200 2024-04-25T09:14:43.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.976+0000 7f8c66800640 1 --2- 172.21.15.173:0/2796665898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c68147200 0x7f8c680cf380 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f8c580097c0 tx=0x7f8c5801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6c48f51ea329c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:43.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.976+0000 7f8c65e00640 1 -- 172.21.15.173:0/2796665898 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c580b1070 con 0x7f8c68147200 2024-04-25T09:14:43.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.976+0000 7f8c65e00640 1 -- 172.21.15.173:0/2796665898 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c580ac600 con 0x7f8c68147200 2024-04-25T09:14:43.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.976+0000 7f8c65e00640 1 -- 172.21.15.173:0/2796665898 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c580ac9d0 con 0x7f8c68147200 2024-04-25T09:14:43.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.976+0000 7f8c6d400640 1 -- 172.21.15.173:0/2796665898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c68147200 msgr2=0x7f8c680cf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.976+0000 7f8c6d400640 1 --2- 172.21.15.173:0/2796665898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c68147200 0x7f8c680cf380 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f8c580097c0 tx=0x7f8c5801c3a0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.976+0000 7f8c6d400640 1 -- 172.21.15.173:0/2796665898 shutdown_connections 2024-04-25T09:14:43.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.976+0000 7f8c6d400640 1 --2- 172.21.15.173:0/2796665898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c68147200 0x7f8c680cf380 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.976+0000 7f8c6d400640 1 -- 172.21.15.173:0/2796665898 >> 172.21.15.173:0/2796665898 conn(0x7f8c680b3460 msgr2=0x7f8c680b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:43.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.976+0000 7f8c6d400640 1 -- 172.21.15.173:0/2796665898 shutdown_connections 2024-04-25T09:14:43.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.976+0000 7f8c6d400640 1 -- 172.21.15.173:0/2796665898 wait complete. 2024-04-25T09:14:43.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c6d400640 1 Processor -- start 2024-04-25T09:14:43.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c6d400640 1 -- start start 2024-04-25T09:14:43.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c6d400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c68071460 0x7f8c680b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c6d400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c68147200 0x7f8c6813dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c6d400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c681475e0 0x7f8c680b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c6d400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c68071d00 con 0x7f8c68071460 2024-04-25T09:14:43.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c6d400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c680cf8c0 con 0x7f8c681475e0 2024-04-25T09:14:43.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c6d400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6815e340 con 0x7f8c68147200 2024-04-25T09:14:43.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c66800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c68071460 0x7f8c680b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c66800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c68071460 0x7f8c680b2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44244/0 (socket says 172.21.15.173:44244) 2024-04-25T09:14:43.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c66800640 1 -- 172.21.15.173:0/1901187367 learned_addr learned my addr 172.21.15.173:0/1901187367 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:43.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c66800640 1 -- 172.21.15.173:0/1901187367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c68147200 msgr2=0x7f8c6813dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c66800640 1 --2- 172.21.15.173:0/1901187367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c68147200 0x7f8c6813dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c66800640 1 -- 172.21.15.173:0/1901187367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c681475e0 msgr2=0x7f8c680b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c66800640 1 --2- 172.21.15.173:0/1901187367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c681475e0 0x7f8c680b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c66800640 1 -- 172.21.15.173:0/1901187367 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c680b3250 con 0x7f8c68071460 2024-04-25T09:14:43.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c66800640 1 --2- 172.21.15.173:0/1901187367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c68071460 0x7f8c680b2d10 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f8c58019fd0 tx=0x7f8c5801abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:43.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c5f400640 1 -- 172.21.15.173:0/1901187367 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c580bb020 con 0x7f8c68071460 2024-04-25T09:14:43.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c5f400640 1 -- 172.21.15.173:0/1901187367 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c580b7620 con 0x7f8c68071460 2024-04-25T09:14:43.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c5f400640 1 -- 172.21.15.173:0/1901187367 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c580b1040 con 0x7f8c68071460 2024-04-25T09:14:43.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c6d400640 1 -- 172.21.15.173:0/1901187367 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c680b1c70 con 0x7f8c68071460 2024-04-25T09:14:43.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c6d400640 1 -- 172.21.15.173:0/1901187367 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c680b2230 con 0x7f8c68071460 2024-04-25T09:14:43.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.980+0000 7f8c6d400640 1 -- 172.21.15.173:0/1901187367 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c68073a40 con 0x7f8c68071460 2024-04-25T09:14:43.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.984+0000 7f8c5f400640 1 -- 172.21.15.173:0/1901187367 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8c580be020 con 0x7f8c68071460 2024-04-25T09:14:43.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.984+0000 7f8c5f400640 1 --2- 172.21.15.173:0/1901187367 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8c44066f90 0x7f8c44069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.984+0000 7f8c5f400640 1 -- 172.21.15.173:0/1901187367 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f8c5811f0a0 con 0x7f8c68071460 2024-04-25T09:14:43.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.984+0000 7f8c5de00640 1 --2- 172.21.15.173:0/1901187367 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8c44066f90 0x7f8c44069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.984+0000 7f8c5de00640 1 --2- 172.21.15.173:0/1901187367 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8c44066f90 0x7f8c44069450 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f8c50000f70 tx=0x7f8c50007a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:43.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:43.988+0000 7f8c5f400640 1 -- 172.21.15.173:0/1901187367 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8c580c5070 con 0x7f8c68071460 2024-04-25T09:14:44.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:44.144+0000 7f8c6d400640 1 -- 172.21.15.173:0/1901187367 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c68070d30 con 0x7f8c68071460 2024-04-25T09:14:44.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:44.144+0000 7f8c5f400640 1 -- 172.21.15.173:0/1901187367 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+13365 (secure 0 0 0) 0x7f8c58016050 con 0x7f8c68071460 2024-04-25T09:14:44.128 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:44.129 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":149,"fsid":"ad8733b9-afc9-44f8-a7bb-5aa5a06fb9b6","created":"2024-04-25T09:02:25.653913+0000","modified":"2024-04-25T09:14:40.566561+0000","last_up_change":"2024-04-25T09:02:37.888279+0000","last_in_change":"2024-04-25T09:02:28.969921+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:02:38.786862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eb61d40-d12c-4be7-8270-3cbf406bec4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6804","nonce":3393779300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6808","nonce":3393779300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6815","nonce":3393779300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3393779300},{"type":"v1","addr":"172.21.15.173:6812","nonce":3393779300}]},"public_addr":"172.21.15.173:6804/3393779300","cluster_addr":"172.21.15.173:6808/3393779300","heartbeat_back_addr":"172.21.15.173:6815/3393779300","heartbeat_front_addr":"172.21.15.173:6812/3393779300","state":["exists","up"]},{"osd":1,"uuid":"7f4c7b25-46c1-451e-b31c-28ebc5f0fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6801","nonce":3130238007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6805","nonce":3130238007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6813","nonce":3130238007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":3130238007},{"type":"v1","addr":"172.21.15.173:6809","nonce":3130238007}]},"public_addr":"172.21.15.173:6801/3130238007","cluster_addr":"172.21.15.173:6805/3130238007","heartbeat_back_addr":"172.21.15.173:6813/3130238007","heartbeat_front_addr":"172.21.15.173:6809/3130238007","state":["exists","up"]},{"osd":2,"uuid":"7caf451e-2594-4ac7-a21f-b860c220f0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6817","nonce":3226999603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6819","nonce":3226999603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6823","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6825","nonce":3226999603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3226999603},{"type":"v1","addr":"172.21.15.173:6821","nonce":3226999603}]},"public_addr":"172.21.15.173:6817/3226999603","cluster_addr":"172.21.15.173:6819/3226999603","heartbeat_back_addr":"172.21.15.173:6825/3226999603","heartbeat_front_addr":"172.21.15.173:6821/3226999603","state":["exists","up"]},{"osd":3,"uuid":"acaf3e24-f28d-430d-be7e-a83609b4b156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6824","nonce":4263773184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6827","nonce":4263773184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6831","nonce":4263773184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4263773184},{"type":"v1","addr":"172.21.15.173:6829","nonce":4263773184}]},"public_addr":"172.21.15.173:6824/4263773184","cluster_addr":"172.21.15.173:6827/4263773184","heartbeat_back_addr":"172.21.15.173:6831/4263773184","heartbeat_front_addr":"172.21.15.173:6829/4263773184","state":["exists","up"]},{"osd":4,"uuid":"84fb0c8f-5eba-4af1-a81c-65cc23168cf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6807","nonce":3578285787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6809","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6811","nonce":3578285787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6815","nonce":3578285787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3578285787},{"type":"v1","addr":"172.21.15.194:6813","nonce":3578285787}]},"public_addr":"172.21.15.194:6807/3578285787","cluster_addr":"172.21.15.194:6811/3578285787","heartbeat_back_addr":"172.21.15.194:6815/3578285787","heartbeat_front_addr":"172.21.15.194:6813/3578285787","state":["exists","up"]},{"osd":5,"uuid":"f01be7f3-d7fd-43d9-b56e-6414e227a029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6801","nonce":2762622538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6803","nonce":2762622538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6810","nonce":2762622538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2762622538},{"type":"v1","addr":"172.21.15.194:6806","nonce":2762622538}]},"public_addr":"172.21.15.194:6801/2762622538","cluster_addr":"172.21.15.194:6803/2762622538","heartbeat_back_addr":"172.21.15.194:6810/2762622538","heartbeat_front_addr":"172.21.15.194:6806/2762622538","state":["exists","up"]},{"osd":6,"uuid":"8d53ce00-6e97-445b-83e5-1a20e68c6729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6825","nonce":2953817121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6827","nonce":2953817121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6831","nonce":2953817121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2953817121},{"type":"v1","addr":"172.21.15.194:6829","nonce":2953817121}]},"public_addr":"172.21.15.194:6825/2953817121","cluster_addr":"172.21.15.194:6827/2953817121","heartbeat_back_addr":"172.21.15.194:6831/2953817121","heartbeat_front_addr":"172.21.15.194:6829/2953817121","state":["exists","up"]},{"osd":7,"uuid":"1f7e8a2f-6e91-4f65-898b-935b49e35deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6817","nonce":1567729259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6819","nonce":1567729259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6823","nonce":1567729259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1567729259},{"type":"v1","addr":"172.21.15.194:6821","nonce":1567729259}]},"public_addr":"172.21.15.194:6817/1567729259","cluster_addr":"172.21.15.194:6819/1567729259","heartbeat_back_addr":"172.21.15.194:6823/1567729259","heartbeat_front_addr":"172.21.15.194:6821/1567729259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.633440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.567283+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.654644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.632200+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.721849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.789392+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.867391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:02:34.625543+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.194:6835/3308916795":"2024-04-26T09:14:37.481425+0000","172.21.15.194:6833/3308916795":"2024-04-26T09:14:37.481425+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:14:44.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:44.144+0000 7f8c6d400640 1 -- 172.21.15.173:0/1901187367 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8c44066f90 msgr2=0x7f8c44069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:44.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:44.144+0000 7f8c6d400640 1 --2- 172.21.15.173:0/1901187367 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8c44066f90 0x7f8c44069450 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f8c50000f70 tx=0x7f8c50007a90 comp rx=0 tx=0).stop 2024-04-25T09:14:44.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:44.144+0000 7f8c6d400640 1 -- 172.21.15.173:0/1901187367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c68071460 msgr2=0x7f8c680b2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:44.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:44.144+0000 7f8c6d400640 1 --2- 172.21.15.173:0/1901187367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c68071460 0x7f8c680b2d10 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f8c58019fd0 tx=0x7f8c5801abe0 comp rx=0 tx=0).stop 2024-04-25T09:14:44.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:44.144+0000 7f8c6d400640 1 -- 172.21.15.173:0/1901187367 shutdown_connections 2024-04-25T09:14:44.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:44.144+0000 7f8c6d400640 1 --2- 172.21.15.173:0/1901187367 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8c44066f90 0x7f8c44069450 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:44.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:44.144+0000 7f8c6d400640 1 --2- 172.21.15.173:0/1901187367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c681475e0 0x7f8c680b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:44.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:44.144+0000 7f8c6d400640 1 --2- 172.21.15.173:0/1901187367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c68147200 0x7f8c6813dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:44.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:44.144+0000 7f8c6d400640 1 --2- 172.21.15.173:0/1901187367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c68071460 0x7f8c680b2d10 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:44.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:44.144+0000 7f8c6d400640 1 -- 172.21.15.173:0/1901187367 >> 172.21.15.173:0/1901187367 conn(0x7f8c680b3460 msgr2=0x7f8c68142200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:44.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:44.144+0000 7f8c6d400640 1 -- 172.21.15.173:0/1901187367 shutdown_connections 2024-04-25T09:14:44.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:44.144+0000 7f8c6d400640 1 -- 172.21.15.173:0/1901187367 wait complete. 2024-04-25T09:14:45.151 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T09:14:45.151 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:14:45.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.308+0000 7f88f1200640 1 Processor -- start 2024-04-25T09:14:45.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.308+0000 7f88f1200640 1 -- start start 2024-04-25T09:14:45.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.308+0000 7f88f1200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f88ec145290 0x7f88ec15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.308+0000 7f88f1200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ec15c5f0 con 0x7f88ec0b3fe0 2024-04-25T09:14:45.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.308+0000 7f88f1200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ec06d4b0 con 0x7f88ec0cc260 2024-04-25T09:14:45.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.308+0000 7f88f1200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ec0ccd80 con 0x7f88ec145290 2024-04-25T09:14:45.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.312+0000 7f88e3e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f88ec0b3fe0 0x7f88ec0b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44482/0 (socket says 172.21.15.173:44482) 2024-04-25T09:14:45.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.312+0000 7f88e3e00640 1 -- 172.21.15.173:0/588210638 learned_addr learned my addr 172.21.15.173:0/588210638 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:45.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.312+0000 7f88e9e00640 1 --2- 172.21.15.173:0/588210638 >> v2:172.21.15.194:3300/0 conn(0x7f88ec145290 0x7f88ec15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.312+0000 7f88e9400640 1 -- 172.21.15.173:0/588210638 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280415703 0 0) 0x7f88d4001120 con 0x7f88ec0b3fe0 2024-04-25T09:14:45.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.312+0000 7f88e9400640 1 -- 172.21.15.173:0/588210638 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88d0003530 con 0x7f88ec0b3fe0 2024-04-25T09:14:45.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.312+0000 7f88e9400640 1 -- 172.21.15.173:0/588210638 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171013265 0 0) 0x7f88ec06d4b0 con 0x7f88ec0cc260 2024-04-25T09:14:45.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.312+0000 7f88e9400640 1 -- 172.21.15.173:0/588210638 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88d4001120 con 0x7f88ec0cc260 2024-04-25T09:14:45.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.312+0000 7f88e9e00640 1 -- 172.21.15.173:0/588210638 >> v1:172.21.15.194:6789/0 conn(0x7f88ec0cc260 legacy=0x7f88ec0cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.312+0000 7f88e9e00640 1 -- 172.21.15.173:0/588210638 >> v1:172.21.15.173:6789/0 conn(0x7f88ec0b3fe0 legacy=0x7f88ec0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.312+0000 7f88e9e00640 1 -- 172.21.15.173:0/588210638 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec06d790 con 0x7f88ec145290 2024-04-25T09:14:45.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.312+0000 7f88e9e00640 1 --2- 172.21.15.173:0/588210638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88ec145290 0x7f88ec15c0b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0097c0 tx=0x7f88dc01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cef77f7a79e5e16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:45.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.312+0000 7f88e9400640 1 -- 172.21.15.173:0/588210638 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0b0070 con 0x7f88ec145290 2024-04-25T09:14:45.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.316+0000 7f88e9400640 1 -- 172.21.15.173:0/588210638 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc0ab600 con 0x7f88ec145290 2024-04-25T09:14:45.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.316+0000 7f88e9400640 1 -- 172.21.15.173:0/588210638 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0ab9d0 con 0x7f88ec145290 2024-04-25T09:14:45.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.316+0000 7f88f1200640 1 -- 172.21.15.173:0/588210638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88ec145290 msgr2=0x7f88ec15c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.316+0000 7f88f1200640 1 --2- 172.21.15.173:0/588210638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88ec145290 0x7f88ec15c0b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0097c0 tx=0x7f88dc01c380 comp rx=0 tx=0).stop 2024-04-25T09:14:45.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.316+0000 7f88f1200640 1 -- 172.21.15.173:0/588210638 shutdown_connections 2024-04-25T09:14:45.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.316+0000 7f88f1200640 1 --2- 172.21.15.173:0/588210638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88ec145290 0x7f88ec15c0b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.316+0000 7f88f1200640 1 -- 172.21.15.173:0/588210638 >> 172.21.15.173:0/588210638 conn(0x7f88ec06ac90 msgr2=0x7f88ec06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:45.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.316+0000 7f88f1200640 1 -- 172.21.15.173:0/588210638 shutdown_connections 2024-04-25T09:14:45.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.316+0000 7f88f1200640 1 -- 172.21.15.173:0/588210638 wait complete. 2024-04-25T09:14:45.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.316+0000 7f88f1200640 1 Processor -- start 2024-04-25T09:14:45.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.316+0000 7f88f1200640 1 -- start start 2024-04-25T09:14:45.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.316+0000 7f88f1200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88ec0b3fe0 0x7f88ec0cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.316+0000 7f88f1200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88ec0cc260 0x7f88ec0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.316+0000 7f88f1200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88ec145290 0x7f88ec143a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.316+0000 7f88f1200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec06eee0 con 0x7f88ec145290 2024-04-25T09:14:45.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.316+0000 7f88f1200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec06ed60 con 0x7f88ec0b3fe0 2024-04-25T09:14:45.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.316+0000 7f88f1200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec06f060 con 0x7f88ec0cc260 2024-04-25T09:14:45.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.320+0000 7f88ea800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88ec145290 0x7f88ec143a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.320+0000 7f88ea800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88ec145290 0x7f88ec143a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44256/0 (socket says 172.21.15.173:44256) 2024-04-25T09:14:45.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.320+0000 7f88e9e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88ec0b3fe0 0x7f88ec0cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.320+0000 7f88e3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88ec0cc260 0x7f88ec0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.320+0000 7f88ea800640 1 -- 172.21.15.173:0/2433797788 learned_addr learned my addr 172.21.15.173:0/2433797788 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:45.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.320+0000 7f88ea800640 1 -- 172.21.15.173:0/2433797788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88ec0cc260 msgr2=0x7f88ec0ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.320+0000 7f88ea800640 1 --2- 172.21.15.173:0/2433797788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88ec0cc260 0x7f88ec0ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.320+0000 7f88ea800640 1 -- 172.21.15.173:0/2433797788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88ec0b3fe0 msgr2=0x7f88ec0cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.320+0000 7f88ea800640 1 --2- 172.21.15.173:0/2433797788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88ec0b3fe0 0x7f88ec0cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.320+0000 7f88ea800640 1 -- 172.21.15.173:0/2433797788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec0ad3c0 con 0x7f88ec145290 2024-04-25T09:14:45.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.320+0000 7f88ea800640 1 --2- 172.21.15.173:0/2433797788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88ec145290 0x7f88ec143a40 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f88e400c730 tx=0x7f88e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:45.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.320+0000 7f88e2000640 1 -- 172.21.15.173:0/2433797788 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4003b80 con 0x7f88ec145290 2024-04-25T09:14:45.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.320+0000 7f88e2000640 1 -- 172.21.15.173:0/2433797788 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e4003d20 con 0x7f88ec145290 2024-04-25T09:14:45.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.320+0000 7f88e2000640 1 -- 172.21.15.173:0/2433797788 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e400aa90 con 0x7f88ec145290 2024-04-25T09:14:45.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.320+0000 7f88f1200640 1 -- 172.21.15.173:0/2433797788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ec0ad6a0 con 0x7f88ec145290 2024-04-25T09:14:45.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.320+0000 7f88f1200640 1 -- 172.21.15.173:0/2433797788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ec0adc60 con 0x7f88ec145290 2024-04-25T09:14:45.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.320+0000 7f88f1200640 1 -- 172.21.15.173:0/2433797788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f88ec073ab0 con 0x7f88ec145290 2024-04-25T09:14:45.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.320+0000 7f88e2000640 1 -- 172.21.15.173:0/2433797788 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f88e400ac30 con 0x7f88ec145290 2024-04-25T09:14:45.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.324+0000 7f88e2000640 1 --2- 172.21.15.173:0/2433797788 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88c8066f90 0x7f88c8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.324+0000 7f88e2000640 1 -- 172.21.15.173:0/2433797788 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f88e4084d00 con 0x7f88ec145290 2024-04-25T09:14:45.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.324+0000 7f88e9e00640 1 --2- 172.21.15.173:0/2433797788 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88c8066f90 0x7f88c8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.324+0000 7f88e2000640 1 --2- 172.21.15.173:0/2433797788 >> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] conn(0x7f88c806d430 0x7f88c806f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.324+0000 7f88e2000640 1 -- 172.21.15.173:0/2433797788 --> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88c806ff40 con 0x7f88c806d430 2024-04-25T09:14:45.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.324+0000 7f88e2000640 1 -- 172.21.15.173:0/2433797788 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=149) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88e40872c0 con 0x7f88ec145290 2024-04-25T09:14:45.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.324+0000 7f88e3e00640 1 --2- 172.21.15.173:0/2433797788 >> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] conn(0x7f88c806d430 0x7f88c806f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.324+0000 7f88e9e00640 1 --2- 172.21.15.173:0/2433797788 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88c8066f90 0x7f88c8069450 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0ad000 tx=0x7f88dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:45.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.324+0000 7f88e3e00640 1 --2- 172.21.15.173:0/2433797788 >> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] conn(0x7f88c806d430 0x7f88c806f870 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:45.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.324+0000 7f88e2000640 1 -- 172.21.15.173:0/2433797788 <== osd.0 v2:172.21.15.173:6802/3393779300 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f88c806ff40 con 0x7f88c806d430 2024-04-25T09:14:45.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.336+0000 7f88f1200640 1 -- 172.21.15.173:0/2433797788 --> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f88ec0af7f0 con 0x7f88c806d430 2024-04-25T09:14:45.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.336+0000 7f88e2000640 1 -- 172.21.15.173:0/2433797788 <== osd.0 v2:172.21.15.173:6802/3393779300 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f88ec0af7f0 con 0x7f88c806d430 2024-04-25T09:14:45.322 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:14:45.323 INFO:teuthology.orchestra.run.smithi173.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:14:45.323 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:14:45.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.336+0000 7f88f1200640 1 -- 172.21.15.173:0/2433797788 >> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] conn(0x7f88c806d430 msgr2=0x7f88c806f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.336+0000 7f88f1200640 1 --2- 172.21.15.173:0/2433797788 >> [v2:172.21.15.173:6802/3393779300,v1:172.21.15.173:6804/3393779300] conn(0x7f88c806d430 0x7f88c806f870 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.336+0000 7f88f1200640 1 -- 172.21.15.173:0/2433797788 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88c8066f90 msgr2=0x7f88c8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.336+0000 7f88f1200640 1 --2- 172.21.15.173:0/2433797788 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f88c8066f90 0x7f88c8069450 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0ad000 tx=0x7f88dc008040 comp rx=0 tx=0).stop 2024-04-25T09:14:45.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.336+0000 7f88f1200640 1 -- 172.21.15.173:0/2433797788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88ec145290 msgr2=0x7f88ec143a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.336+0000 7f88f1200640 1 --2- 172.21.15.173:0/2433797788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88ec145290 0x7f88ec143a40 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f88e400c730 tx=0x7f88e400cbf0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.336+0000 7f88ea800640 1 -- 172.21.15.173:0/2433797788 reap_dead start 2024-04-25T09:14:45.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.336+0000 7f88f1200640 1 -- 172.21.15.173:0/2433797788 shutdown_connections 2024-04-25T09:14:45.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.336+0000 7f88f1200640 1 -- 172.21.15.173:0/2433797788 >> 172.21.15.173:0/2433797788 conn(0x7f88ec06ac90 msgr2=0x7f88ec0b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:45.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.336+0000 7f88f1200640 1 -- 172.21.15.173:0/2433797788 shutdown_connections 2024-04-25T09:14:45.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.336+0000 7f88f1200640 1 -- 172.21.15.173:0/2433797788 wait complete. 2024-04-25T09:14:45.341 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T09:14:45.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.496+0000 7f02ed800640 1 Processor -- start 2024-04-25T09:14:45.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.496+0000 7f02ed800640 1 -- start start 2024-04-25T09:14:45.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.496+0000 7f02ed800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f02e8145290 0x7f02e815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.496+0000 7f02ed800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02e80cc260 0x7f02e80cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.496+0000 7f02ed800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e815c5f0 con 0x7f02e80b3fe0 2024-04-25T09:14:45.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.496+0000 7f02ed800640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e806d4b0 con 0x7f02e8145290 2024-04-25T09:14:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.496+0000 7f02ed800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e806d790 con 0x7f02e80cc260 2024-04-25T09:14:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.496+0000 7f02e6a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f02e8145290 0x7f02e815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.496+0000 7f02e6a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f02e8145290 0x7f02e815c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44266/0 (socket says 172.21.15.173:44266) 2024-04-25T09:14:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.496+0000 7f02e6000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f02e80b3fe0 0x7f02e80b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44492/0 (socket says 172.21.15.173:44492) 2024-04-25T09:14:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.496+0000 7f02e6a00640 1 -- 172.21.15.173:0/4071891797 learned_addr learned my addr 172.21.15.173:0/4071891797 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.496+0000 7f02e6a00640 1 -- 172.21.15.173:0/4071891797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02e80cc260 msgr2=0x7f02e80cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.496+0000 7f02e7400640 1 --2- 172.21.15.173:0/4071891797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02e80cc260 0x7f02e80cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.496+0000 7f02e6a00640 1 --2- 172.21.15.173:0/4071891797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02e80cc260 0x7f02e80cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.496+0000 7f02e6a00640 1 -- 172.21.15.173:0/4071891797 >> v1:172.21.15.173:6789/0 conn(0x7f02e80b3fe0 legacy=0x7f02e80b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.496+0000 7f02e6a00640 1 -- 172.21.15.173:0/4071891797 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e806da70 con 0x7f02e8145290 2024-04-25T09:14:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.496+0000 7f02e5600640 1 -- 172.21.15.173:0/4071891797 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1467823501 0 0) 0x7f02d4001120 con 0x7f02e80b3fe0 2024-04-25T09:14:45.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.500+0000 7f02e6a00640 1 --2- 172.21.15.173:0/4071891797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02e8145290 0x7f02e815c0b0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009870 tx=0x7f02d801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0a32e6f300a2d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:45.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.500+0000 7f02e5600640 1 -- 172.21.15.173:0/4071891797 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d80b0070 con 0x7f02e8145290 2024-04-25T09:14:45.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.500+0000 7f02e5600640 1 -- 172.21.15.173:0/4071891797 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d8004230 con 0x7f02e8145290 2024-04-25T09:14:45.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.500+0000 7f02e5600640 1 -- 172.21.15.173:0/4071891797 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8003620 con 0x7f02e8145290 2024-04-25T09:14:45.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.500+0000 7f02ed800640 1 -- 172.21.15.173:0/4071891797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02e8145290 msgr2=0x7f02e815c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.500+0000 7f02ed800640 1 --2- 172.21.15.173:0/4071891797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02e8145290 0x7f02e815c0b0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009870 tx=0x7f02d801c440 comp rx=0 tx=0).stop 2024-04-25T09:14:45.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.500+0000 7f02ed800640 1 -- 172.21.15.173:0/4071891797 shutdown_connections 2024-04-25T09:14:45.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.500+0000 7f02ed800640 1 --2- 172.21.15.173:0/4071891797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02e80cc260 0x7f02e80cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.500+0000 7f02ed800640 1 --2- 172.21.15.173:0/4071891797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02e8145290 0x7f02e815c0b0 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.500+0000 7f02ed800640 1 -- 172.21.15.173:0/4071891797 >> 172.21.15.173:0/4071891797 conn(0x7f02e806ac90 msgr2=0x7f02e806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:45.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.500+0000 7f02ed800640 1 -- 172.21.15.173:0/4071891797 shutdown_connections 2024-04-25T09:14:45.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.500+0000 7f02ed800640 1 -- 172.21.15.173:0/4071891797 wait complete. 2024-04-25T09:14:45.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.500+0000 7f02ed800640 1 Processor -- start 2024-04-25T09:14:45.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.500+0000 7f02ed800640 1 -- start start 2024-04-25T09:14:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02ed800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02e80b3fe0 0x7f02e815b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02ed800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02e80cc260 0x7f02e8140550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02ed800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02e8145290 0x7f02e8140a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02ed800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e806ed60 con 0x7f02e8145290 2024-04-25T09:14:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02ed800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e806eee0 con 0x7f02e80cc260 2024-04-25T09:14:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02ed800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e806f060 con 0x7f02e80b3fe0 2024-04-25T09:14:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02e7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02e8145290 0x7f02e8140a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02e7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02e8145290 0x7f02e8140a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44274/0 (socket says 172.21.15.173:44274) 2024-04-25T09:14:45.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02e7400640 1 -- 172.21.15.173:0/2428077408 learned_addr learned my addr 172.21.15.173:0/2428077408 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02e6000640 1 --2- 172.21.15.173:0/2428077408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02e80cc260 0x7f02e8140550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02e6a00640 1 --2- 172.21.15.173:0/2428077408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02e80b3fe0 0x7f02e815b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02e7400640 1 -- 172.21.15.173:0/2428077408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02e80b3fe0 msgr2=0x7f02e815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02e7400640 1 --2- 172.21.15.173:0/2428077408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02e80b3fe0 0x7f02e815b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02e7400640 1 -- 172.21.15.173:0/2428077408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02e80cc260 msgr2=0x7f02e8140550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02e7400640 1 --2- 172.21.15.173:0/2428077408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02e80cc260 0x7f02e8140550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02e7400640 1 -- 172.21.15.173:0/2428077408 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e813ddb0 con 0x7f02e8145290 2024-04-25T09:14:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02e6a00640 1 --2- 172.21.15.173:0/2428077408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02e80b3fe0 0x7f02e815b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02e6000640 1 --2- 172.21.15.173:0/2428077408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02e80cc260 0x7f02e8140550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02e7400640 1 --2- 172.21.15.173:0/2428077408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02e8145290 0x7f02e8140a90 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f02e000cc60 tx=0x7f02e000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02dea00640 1 -- 172.21.15.173:0/2428077408 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e00039a0 con 0x7f02e8145290 2024-04-25T09:14:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02dea00640 1 -- 172.21.15.173:0/2428077408 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e0003b40 con 0x7f02e8145290 2024-04-25T09:14:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02dea00640 1 -- 172.21.15.173:0/2428077408 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0004020 con 0x7f02e8145290 2024-04-25T09:14:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02ed800640 1 -- 172.21.15.173:0/2428077408 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e813e090 con 0x7f02e8145290 2024-04-25T09:14:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02ed800640 1 -- 172.21.15.173:0/2428077408 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e813e650 con 0x7f02e8145290 2024-04-25T09:14:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02ed800640 1 -- 172.21.15.173:0/2428077408 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e81425f0 con 0x7f02e8145290 2024-04-25T09:14:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.504+0000 7f02dea00640 1 -- 172.21.15.173:0/2428077408 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f02e00041c0 con 0x7f02e8145290 2024-04-25T09:14:45.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.508+0000 7f02dea00640 1 --2- 172.21.15.173:0/2428077408 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f02c8066f90 0x7f02c8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.508+0000 7f02dea00640 1 -- 172.21.15.173:0/2428077408 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f02e0085400 con 0x7f02e8145290 2024-04-25T09:14:45.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.508+0000 7f02e6a00640 1 --2- 172.21.15.173:0/2428077408 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f02c8066f90 0x7f02c8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.508+0000 7f02e6a00640 1 --2- 172.21.15.173:0/2428077408 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f02c8066f90 0x7f02c8069450 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f02d80ad000 tx=0x7f02d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:45.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.512+0000 7f02dea00640 1 -- 172.21.15.173:0/2428077408 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f02e81425f0 con 0x7f02e8145290 2024-04-25T09:14:45.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.668+0000 7f02ed800640 1 -- 172.21.15.173:0/2428077408 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f02e813db60 con 0x7f02c8066f90 2024-04-25T09:14:45.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.668+0000 7f02dea00640 1 -- 172.21.15.173:0/2428077408 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f02e813db60 con 0x7f02c8066f90 2024-04-25T09:14:45.653 INFO:teuthology.orchestra.run.smithi173.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T09:14:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.668+0000 7f02ed800640 1 -- 172.21.15.173:0/2428077408 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f02c8066f90 msgr2=0x7f02c8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.668+0000 7f02ed800640 1 --2- 172.21.15.173:0/2428077408 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f02c8066f90 0x7f02c8069450 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f02d80ad000 tx=0x7f02d8008040 comp rx=0 tx=0).stop 2024-04-25T09:14:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.668+0000 7f02ed800640 1 -- 172.21.15.173:0/2428077408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02e8145290 msgr2=0x7f02e8140a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.668+0000 7f02ed800640 1 --2- 172.21.15.173:0/2428077408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02e8145290 0x7f02e8140a90 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f02e000cc60 tx=0x7f02e000a5c0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.668+0000 7f02ed800640 1 -- 172.21.15.173:0/2428077408 shutdown_connections 2024-04-25T09:14:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.668+0000 7f02ed800640 1 --2- 172.21.15.173:0/2428077408 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f02c8066f90 0x7f02c8069450 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.668+0000 7f02ed800640 1 --2- 172.21.15.173:0/2428077408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02e8145290 0x7f02e8140a90 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.668+0000 7f02ed800640 1 --2- 172.21.15.173:0/2428077408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02e80cc260 0x7f02e8140550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.668+0000 7f02ed800640 1 --2- 172.21.15.173:0/2428077408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02e80b3fe0 0x7f02e815b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.668+0000 7f02ed800640 1 -- 172.21.15.173:0/2428077408 >> 172.21.15.173:0/2428077408 conn(0x7f02e806ac90 msgr2=0x7f02e815bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.668+0000 7f02ed800640 1 -- 172.21.15.173:0/2428077408 shutdown_connections 2024-04-25T09:14:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.668+0000 7f02ed800640 1 -- 172.21.15.173:0/2428077408 wait complete. 2024-04-25T09:14:45.674 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T09:14:45.675 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:14:45.693 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:14:45.721 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:14:45.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.828+0000 7f35c8c00640 1 Processor -- start 2024-04-25T09:14:45.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.828+0000 7f35c8c00640 1 -- start start 2024-04-25T09:14:45.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.832+0000 7f35c8c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f35c4144f10 0x7f35c415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.832+0000 7f35c8c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c41452f0 0x7f35c406ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.832+0000 7f35c8c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c40720a0 con 0x7f35c40ce420 2024-04-25T09:14:45.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.832+0000 7f35c8c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c415fa40 con 0x7f35c4144f10 2024-04-25T09:14:45.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.832+0000 7f35c8c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c4071490 con 0x7f35c41452f0 2024-04-25T09:14:45.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.832+0000 7f35c3400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f35c4144f10 0x7f35c415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.832+0000 7f35c2a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c41452f0 0x7f35c406ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.832+0000 7f35c3400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f35c4144f10 0x7f35c415f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.173:60832/0 (socket says 172.21.15.173:60832) 2024-04-25T09:14:45.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.832+0000 7f35c3400640 1 -- 172.21.15.173:0/359722639 learned_addr learned my addr 172.21.15.173:0/359722639 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:45.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.832+0000 7f35c2a00640 1 -- 172.21.15.173:0/359722639 >> v2:172.21.15.194:3300/0 conn(0x7f35c4144f10 msgr2=0x7f35c415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:45.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.832+0000 7f35c2a00640 1 --2- 172.21.15.173:0/359722639 >> v2:172.21.15.194:3300/0 conn(0x7f35c4144f10 0x7f35c415f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.832+0000 7f35c2a00640 1 -- 172.21.15.173:0/359722639 >> v1:172.21.15.194:6789/0 conn(0x7f35c40ce420 legacy=0x7f35c415c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.832+0000 7f35c2a00640 1 -- 172.21.15.173:0/359722639 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c4071770 con 0x7f35c41452f0 2024-04-25T09:14:45.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.832+0000 7f35c3400640 1 --2- 172.21.15.173:0/359722639 >> v2:172.21.15.194:3300/0 conn(0x7f35c4144f10 0x7f35c415f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:45.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.836+0000 7f35c2a00640 1 --2- 172.21.15.173:0/359722639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c41452f0 0x7f35c406ea80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35b00097c0 tx=0x7f35b001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32392e08c716a06b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:45.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.836+0000 7f35c2000640 1 -- 172.21.15.173:0/359722639 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00b2070 con 0x7f35c41452f0 2024-04-25T09:14:45.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.836+0000 7f35c2000640 1 -- 172.21.15.173:0/359722639 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b00ad640 con 0x7f35c41452f0 2024-04-25T09:14:45.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.836+0000 7f35c2000640 1 -- 172.21.15.173:0/359722639 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00ada10 con 0x7f35c41452f0 2024-04-25T09:14:45.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.836+0000 7f35c8c00640 1 -- 172.21.15.173:0/359722639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c41452f0 msgr2=0x7f35c406ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.836+0000 7f35c8c00640 1 --2- 172.21.15.173:0/359722639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c41452f0 0x7f35c406ea80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35b00097c0 tx=0x7f35b001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.836+0000 7f35c8c00640 1 -- 172.21.15.173:0/359722639 shutdown_connections 2024-04-25T09:14:45.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.836+0000 7f35c8c00640 1 --2- 172.21.15.173:0/359722639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c41452f0 0x7f35c406ea80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.836+0000 7f35c8c00640 1 --2- 172.21.15.173:0/359722639 >> v2:172.21.15.194:3300/0 conn(0x7f35c4144f10 0x7f35c415f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.836+0000 7f35c8c00640 1 -- 172.21.15.173:0/359722639 >> 172.21.15.173:0/359722639 conn(0x7f35c4061d40 msgr2=0x7f35c406ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:45.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.836+0000 7f35c8c00640 1 -- 172.21.15.173:0/359722639 shutdown_connections 2024-04-25T09:14:45.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.836+0000 7f35c8c00640 1 -- 172.21.15.173:0/359722639 wait complete. 2024-04-25T09:14:45.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.836+0000 7f35c8c00640 1 Processor -- start 2024-04-25T09:14:45.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c8c00640 1 -- start start 2024-04-25T09:14:45.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c8c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35c40ce420 0x7f35c413a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c8c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c4144f10 0x7f35c413b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c8c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c41452f0 0x7f35c415a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c8c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c415cd40 con 0x7f35c4144f10 2024-04-25T09:14:45.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c8c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40cec60 con 0x7f35c40ce420 2024-04-25T09:14:45.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c8c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c415cec0 con 0x7f35c41452f0 2024-04-25T09:14:45.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c4144f10 0x7f35c413b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c2a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c4144f10 0x7f35c413b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44282/0 (socket says 172.21.15.173:44282) 2024-04-25T09:14:45.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c2a00640 1 -- 172.21.15.173:0/3789054549 learned_addr learned my addr 172.21.15.173:0/3789054549 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:45.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c3400640 1 --2- 172.21.15.173:0/3789054549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35c40ce420 0x7f35c413a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c3e00640 1 --2- 172.21.15.173:0/3789054549 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c41452f0 0x7f35c415a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c2a00640 1 -- 172.21.15.173:0/3789054549 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c41452f0 msgr2=0x7f35c415a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c2a00640 1 --2- 172.21.15.173:0/3789054549 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35c41452f0 0x7f35c415a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c2a00640 1 -- 172.21.15.173:0/3789054549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35c40ce420 msgr2=0x7f35c413a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c2a00640 1 --2- 172.21.15.173:0/3789054549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35c40ce420 0x7f35c413a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c2a00640 1 -- 172.21.15.173:0/3789054549 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c413b9a0 con 0x7f35c4144f10 2024-04-25T09:14:45.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c3400640 1 --2- 172.21.15.173:0/3789054549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35c40ce420 0x7f35c413a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:45.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c2a00640 1 --2- 172.21.15.173:0/3789054549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c4144f10 0x7f35c413b050 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f35b001a0d0 tx=0x7f35b0019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:45.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35bb400640 1 -- 172.21.15.173:0/3789054549 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00b2040 con 0x7f35c4144f10 2024-04-25T09:14:45.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35bb400640 1 -- 172.21.15.173:0/3789054549 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b00bc070 con 0x7f35c4144f10 2024-04-25T09:14:45.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35bb400640 1 -- 172.21.15.173:0/3789054549 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00b6630 con 0x7f35c4144f10 2024-04-25T09:14:45.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c8c00640 1 -- 172.21.15.173:0/3789054549 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c413bc80 con 0x7f35c4144f10 2024-04-25T09:14:45.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c8c00640 1 -- 172.21.15.173:0/3789054549 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c413c240 con 0x7f35c4144f10 2024-04-25T09:14:45.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.840+0000 7f35c8c00640 1 -- 172.21.15.173:0/3789054549 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f35c4073a40 con 0x7f35c4144f10 2024-04-25T09:14:45.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.844+0000 7f35bb400640 1 -- 172.21.15.173:0/3789054549 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f35b00b67d0 con 0x7f35c4144f10 2024-04-25T09:14:45.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.844+0000 7f35bb400640 1 --2- 172.21.15.173:0/3789054549 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f35a4066f90 0x7f35a4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.844+0000 7f35bb400640 1 -- 172.21.15.173:0/3789054549 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f35b011f790 con 0x7f35c4144f10 2024-04-25T09:14:45.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.844+0000 7f35c3400640 1 --2- 172.21.15.173:0/3789054549 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f35a4066f90 0x7f35a4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.844+0000 7f35bb400640 1 --2- 172.21.15.173:0/3789054549 >> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] conn(0x7f35a406d430 0x7f35a406f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.844+0000 7f35bb400640 1 -- 172.21.15.173:0/3789054549 --> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35b00ad640 con 0x7f35a406d430 2024-04-25T09:14:45.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.844+0000 7f35bb400640 1 -- 172.21.15.173:0/3789054549 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=149) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35b011fb40 con 0x7f35c4144f10 2024-04-25T09:14:45.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.844+0000 7f35c3e00640 1 --2- 172.21.15.173:0/3789054549 >> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] conn(0x7f35a406d430 0x7f35a406f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.844+0000 7f35c3400640 1 --2- 172.21.15.173:0/3789054549 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f35a4066f90 0x7f35a4069450 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009240 tx=0x7f35b400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:45.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.844+0000 7f35c3e00640 1 --2- 172.21.15.173:0/3789054549 >> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] conn(0x7f35a406d430 0x7f35a406f870 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:45.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.844+0000 7f35bb400640 1 -- 172.21.15.173:0/3789054549 <== osd.1 v2:172.21.15.173:6800/3130238007 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f35b00ad640 con 0x7f35a406d430 2024-04-25T09:14:45.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.856+0000 7f35c8c00640 1 -- 172.21.15.173:0/3789054549 --> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f35c4166670 con 0x7f35a406d430 2024-04-25T09:14:45.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.856+0000 7f35bb400640 1 -- 172.21.15.173:0/3789054549 <== osd.1 v2:172.21.15.173:6800/3130238007 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f35c4166670 con 0x7f35a406d430 2024-04-25T09:14:45.843 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:14:45.843 INFO:teuthology.orchestra.run.smithi173.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:14:45.843 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:14:45.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.860+0000 7f35c8c00640 1 -- 172.21.15.173:0/3789054549 >> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] conn(0x7f35a406d430 msgr2=0x7f35a406f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.860+0000 7f35c8c00640 1 --2- 172.21.15.173:0/3789054549 >> [v2:172.21.15.173:6800/3130238007,v1:172.21.15.173:6801/3130238007] conn(0x7f35a406d430 0x7f35a406f870 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.860+0000 7f35c8c00640 1 -- 172.21.15.173:0/3789054549 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f35a4066f90 msgr2=0x7f35a4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.860+0000 7f35c8c00640 1 --2- 172.21.15.173:0/3789054549 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f35a4066f90 0x7f35a4069450 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009240 tx=0x7f35b400b040 comp rx=0 tx=0).stop 2024-04-25T09:14:45.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.860+0000 7f35c8c00640 1 -- 172.21.15.173:0/3789054549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c4144f10 msgr2=0x7f35c413b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.860+0000 7f35c8c00640 1 --2- 172.21.15.173:0/3789054549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c4144f10 0x7f35c413b050 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f35b001a0d0 tx=0x7f35b0019240 comp rx=0 tx=0).stop 2024-04-25T09:14:45.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.860+0000 7f35c3e00640 1 -- 172.21.15.173:0/3789054549 reap_dead start 2024-04-25T09:14:45.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.860+0000 7f35c8c00640 1 -- 172.21.15.173:0/3789054549 shutdown_connections 2024-04-25T09:14:45.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.860+0000 7f35c8c00640 1 -- 172.21.15.173:0/3789054549 >> 172.21.15.173:0/3789054549 conn(0x7f35c4061d40 msgr2=0x7f35c40c4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:45.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.860+0000 7f35c8c00640 1 -- 172.21.15.173:0/3789054549 shutdown_connections 2024-04-25T09:14:45.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:45.860+0000 7f35c8c00640 1 -- 172.21.15.173:0/3789054549 wait complete. 2024-04-25T09:14:45.862 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T09:14:46.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.052+0000 7fbdf9600640 1 Processor -- start 2024-04-25T09:14:46.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.052+0000 7fbdf9600640 1 -- start start 2024-04-25T09:14:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.056+0000 7fbdf9600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdf4145290 0x7fbdf415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.056+0000 7fbdf9600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbdf40b3fe0 0x7fbdf40b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.056+0000 7fbdf9600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf415c5f0 con 0x7fbdf40cc260 2024-04-25T09:14:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.056+0000 7fbdf9600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf406d4b0 con 0x7fbdf40b3fe0 2024-04-25T09:14:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.056+0000 7fbdf9600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf406d790 con 0x7fbdf4145290 2024-04-25T09:14:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.056+0000 7fbdf2000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbdf40b3fe0 0x7fbdf40b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.056+0000 7fbdf2000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbdf40b3fe0 0x7fbdf40b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44290/0 (socket says 172.21.15.173:44290) 2024-04-25T09:14:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.056+0000 7fbdf2000640 1 -- 172.21.15.173:0/2723781892 learned_addr learned my addr 172.21.15.173:0/2723781892 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.056+0000 7fbdf2a00640 1 --2- 172.21.15.173:0/2723781892 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdf4145290 0x7fbdf415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.056+0000 7fbdf2000640 1 -- 172.21.15.173:0/2723781892 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdf4145290 msgr2=0x7fbdf415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.056+0000 7fbdf2000640 1 --2- 172.21.15.173:0/2723781892 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdf4145290 0x7fbdf415c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.056+0000 7fbdf2000640 1 -- 172.21.15.173:0/2723781892 >> v1:172.21.15.194:6789/0 conn(0x7fbdf40cc260 legacy=0x7fbdf40cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.056+0000 7fbdf2000640 1 -- 172.21.15.173:0/2723781892 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf406da70 con 0x7fbdf40b3fe0 2024-04-25T09:14:46.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.056+0000 7fbdf2a00640 1 --2- 172.21.15.173:0/2723781892 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdf4145290 0x7fbdf415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:46.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.056+0000 7fbdf2000640 1 --2- 172.21.15.173:0/2723781892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdf40b3fe0 0x7fbdf40b4420 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009870 tx=0x7fbde001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e82ef37325e8f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.056+0000 7fbdf1600640 1 -- 172.21.15.173:0/2723781892 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde00b0070 con 0x7fbdf40b3fe0 2024-04-25T09:14:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf1600640 1 -- 172.21.15.173:0/2723781892 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde0004230 con 0x7fbdf40b3fe0 2024-04-25T09:14:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf1600640 1 -- 172.21.15.173:0/2723781892 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0003620 con 0x7fbdf40b3fe0 2024-04-25T09:14:46.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf9600640 1 -- 172.21.15.173:0/2723781892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdf40b3fe0 msgr2=0x7fbdf40b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf9600640 1 --2- 172.21.15.173:0/2723781892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdf40b3fe0 0x7fbdf40b4420 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009870 tx=0x7fbde001c440 comp rx=0 tx=0).stop 2024-04-25T09:14:46.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf9600640 1 -- 172.21.15.173:0/2723781892 shutdown_connections 2024-04-25T09:14:46.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf9600640 1 --2- 172.21.15.173:0/2723781892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdf40b3fe0 0x7fbdf40b4420 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf9600640 1 --2- 172.21.15.173:0/2723781892 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdf4145290 0x7fbdf415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf9600640 1 -- 172.21.15.173:0/2723781892 >> 172.21.15.173:0/2723781892 conn(0x7fbdf406ac90 msgr2=0x7fbdf406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:46.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf9600640 1 -- 172.21.15.173:0/2723781892 shutdown_connections 2024-04-25T09:14:46.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf9600640 1 -- 172.21.15.173:0/2723781892 wait complete. 2024-04-25T09:14:46.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf9600640 1 Processor -- start 2024-04-25T09:14:46.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf9600640 1 -- start start 2024-04-25T09:14:46.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf9600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdf40b3fe0 0x7fbdf413f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf9600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdf40cc260 0x7fbdf413dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf9600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdf4145290 0x7fbdf4158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf9600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf406eee0 con 0x7fbdf4145290 2024-04-25T09:14:46.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf9600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf406ed60 con 0x7fbdf40b3fe0 2024-04-25T09:14:46.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf9600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf406f060 con 0x7fbdf40cc260 2024-04-25T09:14:46.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdf4145290 0x7fbdf4158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdf4145290 0x7fbdf4158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44306/0 (socket says 172.21.15.173:44306) 2024-04-25T09:14:46.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf3400640 1 -- 172.21.15.173:0/1631179972 learned_addr learned my addr 172.21.15.173:0/1631179972 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:46.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf2a00640 1 --2- 172.21.15.173:0/1631179972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdf40b3fe0 0x7fbdf413f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf2000640 1 --2- 172.21.15.173:0/1631179972 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdf40cc260 0x7fbdf413dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf3400640 1 -- 172.21.15.173:0/1631179972 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdf40cc260 msgr2=0x7fbdf413dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf3400640 1 --2- 172.21.15.173:0/1631179972 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdf40cc260 0x7fbdf413dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf3400640 1 -- 172.21.15.173:0/1631179972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdf40b3fe0 msgr2=0x7fbdf413f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf3400640 1 --2- 172.21.15.173:0/1631179972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdf40b3fe0 0x7fbdf413f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.060+0000 7fbdf3400640 1 -- 172.21.15.173:0/1631179972 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf413e500 con 0x7fbdf4145290 2024-04-25T09:14:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.064+0000 7fbdf3400640 1 --2- 172.21.15.173:0/1631179972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdf4145290 0x7fbdf4158a00 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7fbdec00c340 tx=0x7fbdec00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.064+0000 7fbdeaa00640 1 -- 172.21.15.173:0/1631179972 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec005220 con 0x7fbdf4145290 2024-04-25T09:14:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.064+0000 7fbdeaa00640 1 -- 172.21.15.173:0/1631179972 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdec0053c0 con 0x7fbdf4145290 2024-04-25T09:14:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.064+0000 7fbdeaa00640 1 -- 172.21.15.173:0/1631179972 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec007270 con 0x7fbdf4145290 2024-04-25T09:14:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.064+0000 7fbdf9600640 1 -- 172.21.15.173:0/1631179972 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf413e7e0 con 0x7fbdf4145290 2024-04-25T09:14:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.064+0000 7fbdf9600640 1 -- 172.21.15.173:0/1631179972 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf413eda0 con 0x7fbdf4145290 2024-04-25T09:14:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.064+0000 7fbdf9600640 1 -- 172.21.15.173:0/1631179972 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf4073ab0 con 0x7fbdf4145290 2024-04-25T09:14:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.064+0000 7fbdeaa00640 1 -- 172.21.15.173:0/1631179972 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbdec019020 con 0x7fbdf4145290 2024-04-25T09:14:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.064+0000 7fbdeaa00640 1 --2- 172.21.15.173:0/1631179972 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbdd4066f60 0x7fbdd4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.064+0000 7fbdeaa00640 1 -- 172.21.15.173:0/1631179972 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fbdec084070 con 0x7fbdf4145290 2024-04-25T09:14:46.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.064+0000 7fbdf2a00640 1 --2- 172.21.15.173:0/1631179972 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbdd4066f60 0x7fbdd4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.064+0000 7fbdf2a00640 1 --2- 172.21.15.173:0/1631179972 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbdd4066f60 0x7fbdd4069420 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fbde400d620 tx=0x7fbde4007810 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:46.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.068+0000 7fbdeaa00640 1 -- 172.21.15.173:0/1631179972 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbdf415c5f0 con 0x7fbdf4145290 2024-04-25T09:14:46.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.224+0000 7fbdf9600640 1 -- 172.21.15.173:0/1631179972 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdf4144110 con 0x7fbdd4066f60 2024-04-25T09:14:46.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.224+0000 7fbdeaa00640 1 -- 172.21.15.173:0/1631179972 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbdf4144110 con 0x7fbdd4066f60 2024-04-25T09:14:46.208 INFO:teuthology.orchestra.run.smithi173.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T09:14:46.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.224+0000 7fbdf9600640 1 -- 172.21.15.173:0/1631179972 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbdd4066f60 msgr2=0x7fbdd4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.224+0000 7fbdf9600640 1 --2- 172.21.15.173:0/1631179972 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbdd4066f60 0x7fbdd4069420 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fbde400d620 tx=0x7fbde4007810 comp rx=0 tx=0).stop 2024-04-25T09:14:46.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.224+0000 7fbdf9600640 1 -- 172.21.15.173:0/1631179972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdf4145290 msgr2=0x7fbdf4158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.224+0000 7fbdf9600640 1 --2- 172.21.15.173:0/1631179972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdf4145290 0x7fbdf4158a00 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7fbdec00c340 tx=0x7fbdec00c800 comp rx=0 tx=0).stop 2024-04-25T09:14:46.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.224+0000 7fbdf9600640 1 -- 172.21.15.173:0/1631179972 shutdown_connections 2024-04-25T09:14:46.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.224+0000 7fbdf9600640 1 --2- 172.21.15.173:0/1631179972 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fbdd4066f60 0x7fbdd4069420 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.224+0000 7fbdf9600640 1 --2- 172.21.15.173:0/1631179972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdf4145290 0x7fbdf4158a00 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.224+0000 7fbdf9600640 1 --2- 172.21.15.173:0/1631179972 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdf40cc260 0x7fbdf413dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.224+0000 7fbdf9600640 1 --2- 172.21.15.173:0/1631179972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdf40b3fe0 0x7fbdf413f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.224+0000 7fbdf9600640 1 -- 172.21.15.173:0/1631179972 >> 172.21.15.173:0/1631179972 conn(0x7fbdf406ac90 msgr2=0x7fbdf40cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:46.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.224+0000 7fbdf9600640 1 -- 172.21.15.173:0/1631179972 shutdown_connections 2024-04-25T09:14:46.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.224+0000 7fbdf9600640 1 -- 172.21.15.173:0/1631179972 wait complete. 2024-04-25T09:14:46.229 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T09:14:46.230 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:14:46.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.384+0000 7f6107a00640 1 Processor -- start 2024-04-25T09:14:46.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.384+0000 7f6107a00640 1 -- start start 2024-04-25T09:14:46.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.384+0000 7f6107a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f610006e1c0 0x7f610006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.384+0000 7f6107a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f610006c410 0x7f61000aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.384+0000 7f6107a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610006ae30 con 0x7f61000ad3f0 2024-04-25T09:14:46.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.384+0000 7f6107a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61000b3170 con 0x7f610006e1c0 2024-04-25T09:14:46.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.384+0000 7f6107a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610015e070 con 0x7f610006c410 2024-04-25T09:14:46.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.384+0000 7f6105000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f610006e1c0 0x7f610006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.384+0000 7f6105000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f610006e1c0 0x7f610006bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44322/0 (socket says 172.21.15.173:44322) 2024-04-25T09:14:46.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.384+0000 7f6105000640 1 -- 172.21.15.173:0/2143756923 learned_addr learned my addr 172.21.15.173:0/2143756923 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:46.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.384+0000 7f60ffe00640 1 --2- 172.21.15.173:0/2143756923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f610006c410 0x7f61000aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.384+0000 7f6105000640 1 -- 172.21.15.173:0/2143756923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f610006c410 msgr2=0x7f61000aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:46.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.384+0000 7f6105000640 1 --2- 172.21.15.173:0/2143756923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f610006c410 0x7f61000aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.384+0000 7f6105000640 1 -- 172.21.15.173:0/2143756923 >> v1:172.21.15.194:6789/0 conn(0x7f61000ad3f0 legacy=0x7f610006e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:46.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.384+0000 7f6105000640 1 -- 172.21.15.173:0/2143756923 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610006b110 con 0x7f610006e1c0 2024-04-25T09:14:46.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.388+0000 7f6105000640 1 --2- 172.21.15.173:0/2143756923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f610006e1c0 0x7f610006bed0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f60f40098a0 tx=0x7f60f401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc1bb0232b41e70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:46.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.388+0000 7f60ff400640 1 -- 172.21.15.173:0/2143756923 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f40b5070 con 0x7f610006e1c0 2024-04-25T09:14:46.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.388+0000 7f60ff400640 1 -- 172.21.15.173:0/2143756923 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f40a89b0 con 0x7f610006e1c0 2024-04-25T09:14:46.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.388+0000 7f60ff400640 1 -- 172.21.15.173:0/2143756923 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f40a8d80 con 0x7f610006e1c0 2024-04-25T09:14:46.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.388+0000 7f6107a00640 1 -- 172.21.15.173:0/2143756923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f610006e1c0 msgr2=0x7f610006bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.388+0000 7f6107a00640 1 --2- 172.21.15.173:0/2143756923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f610006e1c0 0x7f610006bed0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f60f40098a0 tx=0x7f60f401ecf0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.388+0000 7f6107a00640 1 -- 172.21.15.173:0/2143756923 shutdown_connections 2024-04-25T09:14:46.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.388+0000 7f6107a00640 1 --2- 172.21.15.173:0/2143756923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f610006c410 0x7f61000aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.388+0000 7f6107a00640 1 --2- 172.21.15.173:0/2143756923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f610006e1c0 0x7f610006bed0 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.388+0000 7f6107a00640 1 -- 172.21.15.173:0/2143756923 >> 172.21.15.173:0/2143756923 conn(0x7f61000cfed0 msgr2=0x7f61000d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:46.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.388+0000 7f6107a00640 1 -- 172.21.15.173:0/2143756923 shutdown_connections 2024-04-25T09:14:46.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.388+0000 7f6107a00640 1 -- 172.21.15.173:0/2143756923 wait complete. 2024-04-25T09:14:46.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6107a00640 1 Processor -- start 2024-04-25T09:14:46.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6107a00640 1 -- start start 2024-04-25T09:14:46.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6107a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f610006c410 0x7f610015cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6107a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f610006e1c0 0x7f6100155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6107a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61000ad3f0 0x7f61001f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6107a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610006b9b0 con 0x7f610006c410 2024-04-25T09:14:46.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6107a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610006b6d0 con 0x7f61000ad3f0 2024-04-25T09:14:46.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6107a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61000ad8a0 con 0x7f610006e1c0 2024-04-25T09:14:46.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6105000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f610006c410 0x7f610015cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6105000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f610006c410 0x7f610015cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44330/0 (socket says 172.21.15.173:44330) 2024-04-25T09:14:46.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6105000640 1 -- 172.21.15.173:0/428615174 learned_addr learned my addr 172.21.15.173:0/428615174 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:46.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6105000640 1 -- 172.21.15.173:0/428615174 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f610006e1c0 msgr2=0x7f6100155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6105000640 1 --2- 172.21.15.173:0/428615174 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f610006e1c0 0x7f6100155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6105000640 1 -- 172.21.15.173:0/428615174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61000ad3f0 msgr2=0x7f61001f6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6105000640 1 --2- 172.21.15.173:0/428615174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61000ad3f0 0x7f61001f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6105000640 1 -- 172.21.15.173:0/428615174 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6100155a60 con 0x7f610006c410 2024-04-25T09:14:46.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6105000640 1 --2- 172.21.15.173:0/428615174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f610006c410 0x7f610015cdd0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f60f40b3040 tx=0x7f60f401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:46.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f60fcc00640 1 -- 172.21.15.173:0/428615174 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f40c0070 con 0x7f610006c410 2024-04-25T09:14:46.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f60fcc00640 1 -- 172.21.15.173:0/428615174 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f40b0a50 con 0x7f610006c410 2024-04-25T09:14:46.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6107a00640 1 -- 172.21.15.173:0/428615174 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6100155cf0 con 0x7f610006c410 2024-04-25T09:14:46.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f60fcc00640 1 -- 172.21.15.173:0/428615174 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f40b5070 con 0x7f610006c410 2024-04-25T09:14:46.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.392+0000 7f6107a00640 1 -- 172.21.15.173:0/428615174 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61001562b0 con 0x7f610006c410 2024-04-25T09:14:46.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.396+0000 7f6107a00640 1 -- 172.21.15.173:0/428615174 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6100156900 con 0x7f610006c410 2024-04-25T09:14:46.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.396+0000 7f60fcc00640 1 -- 172.21.15.173:0/428615174 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f60f40c3070 con 0x7f610006c410 2024-04-25T09:14:46.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.396+0000 7f60fcc00640 1 --2- 172.21.15.173:0/428615174 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f60e0066f60 0x7f60e0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.396+0000 7f60fcc00640 1 -- 172.21.15.173:0/428615174 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f60f4122960 con 0x7f610006c410 2024-04-25T09:14:46.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.396+0000 7f60ffe00640 1 --2- 172.21.15.173:0/428615174 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f60e0066f60 0x7f60e0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.396+0000 7f60fcc00640 1 --2- 172.21.15.173:0/428615174 >> [v2:172.21.15.173:6816/3226999603,v1:172.21.15.173:6817/3226999603] conn(0x7f60e006d400 0x7f60e006f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.396+0000 7f60fcc00640 1 -- 172.21.15.173:0/428615174 --> [v2:172.21.15.173:6816/3226999603,v1:172.21.15.173:6817/3226999603] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f60e006ff10 con 0x7f60e006d400 2024-04-25T09:14:46.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.396+0000 7f60fcc00640 1 -- 172.21.15.173:0/428615174 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=149) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60f4122df0 con 0x7f610006c410 2024-04-25T09:14:46.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.396+0000 7f6105a00640 1 --2- 172.21.15.173:0/428615174 >> [v2:172.21.15.173:6816/3226999603,v1:172.21.15.173:6817/3226999603] conn(0x7f60e006d400 0x7f60e006f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.396+0000 7f60ffe00640 1 --2- 172.21.15.173:0/428615174 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f60e0066f60 0x7f60e0069420 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f610014f1c0 tx=0x7f60ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:46.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.396+0000 7f6105a00640 1 --2- 172.21.15.173:0/428615174 >> [v2:172.21.15.173:6816/3226999603,v1:172.21.15.173:6817/3226999603] conn(0x7f60e006d400 0x7f60e006f840 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:46.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.396+0000 7f60fcc00640 1 -- 172.21.15.173:0/428615174 <== osd.2 v2:172.21.15.173:6816/3226999603 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f60e006ff10 con 0x7f60e006d400 2024-04-25T09:14:46.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.412+0000 7f6107a00640 1 -- 172.21.15.173:0/428615174 --> [v2:172.21.15.173:6816/3226999603,v1:172.21.15.173:6817/3226999603] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6100073ab0 con 0x7f60e006d400 2024-04-25T09:14:46.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.412+0000 7f60fcc00640 1 -- 172.21.15.173:0/428615174 <== osd.2 v2:172.21.15.173:6816/3226999603 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6100073ab0 con 0x7f60e006d400 2024-04-25T09:14:46.396 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:14:46.397 INFO:teuthology.orchestra.run.smithi173.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:14:46.397 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:14:46.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.412+0000 7f6107a00640 1 -- 172.21.15.173:0/428615174 >> [v2:172.21.15.173:6816/3226999603,v1:172.21.15.173:6817/3226999603] conn(0x7f60e006d400 msgr2=0x7f60e006f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.412+0000 7f6107a00640 1 --2- 172.21.15.173:0/428615174 >> [v2:172.21.15.173:6816/3226999603,v1:172.21.15.173:6817/3226999603] conn(0x7f60e006d400 0x7f60e006f840 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.412+0000 7f6107a00640 1 -- 172.21.15.173:0/428615174 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f60e0066f60 msgr2=0x7f60e0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.412+0000 7f6107a00640 1 --2- 172.21.15.173:0/428615174 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f60e0066f60 0x7f60e0069420 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f610014f1c0 tx=0x7f60ec008040 comp rx=0 tx=0).stop 2024-04-25T09:14:46.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.412+0000 7f6107a00640 1 -- 172.21.15.173:0/428615174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f610006c410 msgr2=0x7f610015cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.412+0000 7f6107a00640 1 --2- 172.21.15.173:0/428615174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f610006c410 0x7f610015cdd0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f60f40b3040 tx=0x7f60f401ba90 comp rx=0 tx=0).stop 2024-04-25T09:14:46.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.412+0000 7f6105a00640 1 -- 172.21.15.173:0/428615174 reap_dead start 2024-04-25T09:14:46.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.412+0000 7f6107a00640 1 -- 172.21.15.173:0/428615174 shutdown_connections 2024-04-25T09:14:46.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.412+0000 7f6107a00640 1 -- 172.21.15.173:0/428615174 >> 172.21.15.173:0/428615174 conn(0x7f61000cfed0 msgr2=0x7f61000cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:46.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.412+0000 7f6107a00640 1 -- 172.21.15.173:0/428615174 shutdown_connections 2024-04-25T09:14:46.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.412+0000 7f6107a00640 1 -- 172.21.15.173:0/428615174 wait complete. 2024-04-25T09:14:46.415 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T09:14:46.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.564+0000 7feac8a00640 1 Processor -- start 2024-04-25T09:14:46.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.568+0000 7feac8a00640 1 -- start start 2024-04-25T09:14:46.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.568+0000 7feac8a00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7feac40aeb90 0x7feac40cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.568+0000 7feac8a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feac40ce2b0 0x7feac40cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.568+0000 7feac8a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac4071570 con 0x7feac40aef70 2024-04-25T09:14:46.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.568+0000 7feac8a00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac4071320 con 0x7feac40aeb90 2024-04-25T09:14:46.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.568+0000 7feac8a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac4072330 con 0x7feac40ce2b0 2024-04-25T09:14:46.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.568+0000 7feac1e00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7feac40aeb90 0x7feac40cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.568+0000 7feab9400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7feac40aef70 0x7feac40cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44494/0 (socket says 172.21.15.173:44494) 2024-04-25T09:14:46.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.568+0000 7feab9400640 1 -- 172.21.15.173:0/3460086044 learned_addr learned my addr 172.21.15.173:0/3460086044 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:46.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.568+0000 7feac2800640 1 --2- 172.21.15.173:0/3460086044 >> v2:172.21.15.194:3300/0 conn(0x7feac40ce2b0 0x7feac40cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.568+0000 7feac1400640 1 -- 172.21.15.173:0/3460086044 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3899568675 0 0) 0x7feac4071570 con 0x7feac40aef70 2024-04-25T09:14:46.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.568+0000 7feac1400640 1 -- 172.21.15.173:0/3460086044 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaa8003530 con 0x7feac40aef70 2024-04-25T09:14:46.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.568+0000 7feac1e00640 1 -- 172.21.15.173:0/3460086044 >> v2:172.21.15.194:3300/0 conn(0x7feac40ce2b0 msgr2=0x7feac40cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:46.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.568+0000 7feac1e00640 1 --2- 172.21.15.173:0/3460086044 >> v2:172.21.15.194:3300/0 conn(0x7feac40ce2b0 0x7feac40cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.568+0000 7feac1e00640 1 -- 172.21.15.173:0/3460086044 >> v1:172.21.15.173:6789/0 conn(0x7feac40aef70 legacy=0x7feac40cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.568+0000 7feac1e00640 1 -- 172.21.15.173:0/3460086044 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac4071850 con 0x7feac40aeb90 2024-04-25T09:14:46.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.572+0000 7feac1e00640 1 --2- 172.21.15.173:0/3460086044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feac40aeb90 0x7feac40cc0d0 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7feac415e4f0 tx=0x7feab401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b423a6bad0a2a906 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:46.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.572+0000 7feac1400640 1 -- 172.21.15.173:0/3460086044 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab40b0070 con 0x7feac40aeb90 2024-04-25T09:14:46.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.572+0000 7feac1400640 1 -- 172.21.15.173:0/3460086044 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab40ab600 con 0x7feac40aeb90 2024-04-25T09:14:46.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.572+0000 7feac1400640 1 -- 172.21.15.173:0/3460086044 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab40ab9b0 con 0x7feac40aeb90 2024-04-25T09:14:46.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.572+0000 7feac8a00640 1 -- 172.21.15.173:0/3460086044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feac40aeb90 msgr2=0x7feac40cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.572+0000 7feac8a00640 1 --2- 172.21.15.173:0/3460086044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feac40aeb90 0x7feac40cc0d0 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7feac415e4f0 tx=0x7feab401c3c0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.572+0000 7feac8a00640 1 -- 172.21.15.173:0/3460086044 shutdown_connections 2024-04-25T09:14:46.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.572+0000 7feac8a00640 1 --2- 172.21.15.173:0/3460086044 >> v2:172.21.15.194:3300/0 conn(0x7feac40ce2b0 0x7feac40cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.572+0000 7feac8a00640 1 --2- 172.21.15.173:0/3460086044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feac40aeb90 0x7feac40cc0d0 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.572+0000 7feac8a00640 1 -- 172.21.15.173:0/3460086044 >> 172.21.15.173:0/3460086044 conn(0x7feac406ac90 msgr2=0x7feac406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:46.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.572+0000 7feac8a00640 1 -- 172.21.15.173:0/3460086044 shutdown_connections 2024-04-25T09:14:46.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.572+0000 7feac8a00640 1 -- 172.21.15.173:0/3460086044 wait complete. 2024-04-25T09:14:46.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.572+0000 7feac8a00640 1 Processor -- start 2024-04-25T09:14:46.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.572+0000 7feac8a00640 1 -- start start 2024-04-25T09:14:46.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac8a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feac40aeb90 0x7feac414e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac8a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feac40aef70 0x7feac41452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac8a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feac40ce2b0 0x7feac4154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac8a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac415bb30 con 0x7feac40ce2b0 2024-04-25T09:14:46.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac8a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac415b9b0 con 0x7feac40aeb90 2024-04-25T09:14:46.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac8a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac415bcb0 con 0x7feac40aef70 2024-04-25T09:14:46.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac2800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feac40ce2b0 0x7feac4154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac2800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feac40ce2b0 0x7feac4154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44356/0 (socket says 172.21.15.173:44356) 2024-04-25T09:14:46.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac2800640 1 -- 172.21.15.173:0/3838625676 learned_addr learned my addr 172.21.15.173:0/3838625676 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:46.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feab9400640 1 --2- 172.21.15.173:0/3838625676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feac40aef70 0x7feac41452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac1e00640 1 --2- 172.21.15.173:0/3838625676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feac40aeb90 0x7feac414e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac2800640 1 -- 172.21.15.173:0/3838625676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feac40aef70 msgr2=0x7feac41452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac2800640 1 --2- 172.21.15.173:0/3838625676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feac40aef70 0x7feac41452f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac2800640 1 -- 172.21.15.173:0/3838625676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feac40aeb90 msgr2=0x7feac414e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac2800640 1 --2- 172.21.15.173:0/3838625676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feac40aeb90 0x7feac414e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac2800640 1 -- 172.21.15.173:0/3838625676 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac4146ad0 con 0x7feac40ce2b0 2024-04-25T09:14:46.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac1e00640 1 --2- 172.21.15.173:0/3838625676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feac40aeb90 0x7feac414e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:46.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feab9400640 1 --2- 172.21.15.173:0/3838625676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feac40aef70 0x7feac41452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:46.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac2800640 1 --2- 172.21.15.173:0/3838625676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feac40ce2b0 0x7feac4154200 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7feabc00efc0 tx=0x7feabc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:46.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feabaa00640 1 -- 172.21.15.173:0/3838625676 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc018020 con 0x7feac40ce2b0 2024-04-25T09:14:46.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feabaa00640 1 -- 172.21.15.173:0/3838625676 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feabc014480 con 0x7feac40ce2b0 2024-04-25T09:14:46.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feabaa00640 1 -- 172.21.15.173:0/3838625676 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc014870 con 0x7feac40ce2b0 2024-04-25T09:14:46.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac8a00640 1 -- 172.21.15.173:0/3838625676 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac4146db0 con 0x7feac40ce2b0 2024-04-25T09:14:46.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac8a00640 1 -- 172.21.15.173:0/3838625676 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac4131d90 con 0x7feac40ce2b0 2024-04-25T09:14:46.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.576+0000 7feac8a00640 1 -- 172.21.15.173:0/3838625676 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac4073ab0 con 0x7feac40ce2b0 2024-04-25T09:14:46.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.580+0000 7feabaa00640 1 -- 172.21.15.173:0/3838625676 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feabc01b020 con 0x7feac40ce2b0 2024-04-25T09:14:46.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.580+0000 7feabaa00640 1 --2- 172.21.15.173:0/3838625676 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feaa0066f60 0x7feaa0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.580+0000 7feabaa00640 1 -- 172.21.15.173:0/3838625676 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7feabc085d30 con 0x7feac40ce2b0 2024-04-25T09:14:46.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.580+0000 7feac1e00640 1 --2- 172.21.15.173:0/3838625676 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feaa0066f60 0x7feaa0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.580+0000 7feac1e00640 1 --2- 172.21.15.173:0/3838625676 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feaa0066f60 0x7feaa0069420 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7feab40ad000 tx=0x7feab4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:46.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.584+0000 7feabaa00640 1 -- 172.21.15.173:0/3838625676 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feabc022030 con 0x7feac40ce2b0 2024-04-25T09:14:46.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.736+0000 7feac8a00640 1 -- 172.21.15.173:0/3838625676 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7feac415dec0 con 0x7feaa0066f60 2024-04-25T09:14:46.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.740+0000 7feabaa00640 1 -- 172.21.15.173:0/3838625676 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7feac415dec0 con 0x7feaa0066f60 2024-04-25T09:14:46.723 INFO:teuthology.orchestra.run.smithi173.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T09:14:46.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.740+0000 7feac8a00640 1 -- 172.21.15.173:0/3838625676 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feaa0066f60 msgr2=0x7feaa0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.740+0000 7feac8a00640 1 --2- 172.21.15.173:0/3838625676 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feaa0066f60 0x7feaa0069420 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7feab40ad000 tx=0x7feab4008040 comp rx=0 tx=0).stop 2024-04-25T09:14:46.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.740+0000 7feac8a00640 1 -- 172.21.15.173:0/3838625676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feac40ce2b0 msgr2=0x7feac4154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.740+0000 7feac8a00640 1 --2- 172.21.15.173:0/3838625676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feac40ce2b0 0x7feac4154200 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7feabc00efc0 tx=0x7feabc00c490 comp rx=0 tx=0).stop 2024-04-25T09:14:46.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.740+0000 7feac8a00640 1 -- 172.21.15.173:0/3838625676 shutdown_connections 2024-04-25T09:14:46.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.740+0000 7feac8a00640 1 --2- 172.21.15.173:0/3838625676 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7feaa0066f60 0x7feaa0069420 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.740+0000 7feac8a00640 1 --2- 172.21.15.173:0/3838625676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feac40ce2b0 0x7feac4154200 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.740+0000 7feac8a00640 1 --2- 172.21.15.173:0/3838625676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feac40aef70 0x7feac41452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.740+0000 7feac8a00640 1 --2- 172.21.15.173:0/3838625676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feac40aeb90 0x7feac414e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.740+0000 7feac8a00640 1 -- 172.21.15.173:0/3838625676 >> 172.21.15.173:0/3838625676 conn(0x7feac406ac90 msgr2=0x7feac415d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:46.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.740+0000 7feac8a00640 1 -- 172.21.15.173:0/3838625676 shutdown_connections 2024-04-25T09:14:46.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.740+0000 7feac8a00640 1 -- 172.21.15.173:0/3838625676 wait complete. 2024-04-25T09:14:46.745 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T09:14:46.745 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:14:46.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.900+0000 7f2e94600640 1 Processor -- start 2024-04-25T09:14:46.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.900+0000 7f2e94600640 1 -- start start 2024-04-25T09:14:46.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.904+0000 7f2e94600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2e8c0aeb90 0x7f2e8c0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.904+0000 7f2e94600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e8c0ce2b0 0x7f2e8c0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.904+0000 7f2e94600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8c071570 con 0x7f2e8c0aef70 2024-04-25T09:14:46.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.904+0000 7f2e94600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8c071320 con 0x7f2e8c0aeb90 2024-04-25T09:14:46.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.904+0000 7f2e94600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c072330 con 0x7f2e8c0ce2b0 2024-04-25T09:14:46.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.904+0000 7f2e91c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2e8c0aeb90 0x7f2e8c0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.904+0000 7f2e92600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e8c0ce2b0 0x7f2e8c0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.904+0000 7f2e91200640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f2e8c0aef70 0x7f2e8c0cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.173:36932/0 (socket says 172.21.15.173:36932) 2024-04-25T09:14:46.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.904+0000 7f2e92600640 1 --2- 172.21.15.173:0/3429003782 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e8c0ce2b0 0x7f2e8c0cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.173:59540/0 (socket says 172.21.15.173:59540) 2024-04-25T09:14:46.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.904+0000 7f2e91200640 1 -- 172.21.15.173:0/3429003782 learned_addr learned my addr 172.21.15.173:0/3429003782 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:46.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.904+0000 7f2e91c00640 1 -- 172.21.15.173:0/3429003782 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e8c0ce2b0 msgr2=0x7f2e8c0cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:46.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.904+0000 7f2e91c00640 1 --2- 172.21.15.173:0/3429003782 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e8c0ce2b0 0x7f2e8c0cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.904+0000 7f2e91c00640 1 -- 172.21.15.173:0/3429003782 >> v1:172.21.15.194:6789/0 conn(0x7f2e8c0aef70 legacy=0x7f2e8c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.904+0000 7f2e91c00640 1 -- 172.21.15.173:0/3429003782 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c071850 con 0x7f2e8c0aeb90 2024-04-25T09:14:46.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.904+0000 7f2e8be00640 1 -- 172.21.15.173:0/3429003782 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192121760 0 0) 0x7f2e8c071570 con 0x7f2e8c0aef70 2024-04-25T09:14:46.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e91c00640 1 --2- 172.21.15.173:0/3429003782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e8c0aeb90 0x7f2e8c0cc0d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2e800097c0 tx=0x7f2e8001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87eb3fccaba86da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:46.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e8be00640 1 -- 172.21.15.173:0/3429003782 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e800b0070 con 0x7f2e8c0aeb90 2024-04-25T09:14:46.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e8be00640 1 -- 172.21.15.173:0/3429003782 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e800ab600 con 0x7f2e8c0aeb90 2024-04-25T09:14:46.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e8be00640 1 -- 172.21.15.173:0/3429003782 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e800ab9d0 con 0x7f2e8c0aeb90 2024-04-25T09:14:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e94600640 1 -- 172.21.15.173:0/3429003782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e8c0aeb90 msgr2=0x7f2e8c0cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e94600640 1 --2- 172.21.15.173:0/3429003782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e8c0aeb90 0x7f2e8c0cc0d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2e800097c0 tx=0x7f2e8001c3e0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e94600640 1 -- 172.21.15.173:0/3429003782 shutdown_connections 2024-04-25T09:14:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e94600640 1 --2- 172.21.15.173:0/3429003782 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e8c0ce2b0 0x7f2e8c0cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e94600640 1 --2- 172.21.15.173:0/3429003782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e8c0aeb90 0x7f2e8c0cc0d0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e94600640 1 -- 172.21.15.173:0/3429003782 >> 172.21.15.173:0/3429003782 conn(0x7f2e8c06ac90 msgr2=0x7f2e8c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:46.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e94600640 1 -- 172.21.15.173:0/3429003782 shutdown_connections 2024-04-25T09:14:46.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e94600640 1 -- 172.21.15.173:0/3429003782 wait complete. 2024-04-25T09:14:46.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e94600640 1 Processor -- start 2024-04-25T09:14:46.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e94600640 1 -- start start 2024-04-25T09:14:46.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e94600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e8c0aeb90 0x7f2e8c13fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e94600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e8c0aef70 0x7f2e8c143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e94600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e8c0ce2b0 0x7f2e8c143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e94600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c15bb70 con 0x7f2e8c0ce2b0 2024-04-25T09:14:46.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e94600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c15b9f0 con 0x7f2e8c0aef70 2024-04-25T09:14:46.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.908+0000 7f2e94600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c15bcf0 con 0x7f2e8c0aeb90 2024-04-25T09:14:46.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e92600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e8c0ce2b0 0x7f2e8c143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e92600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e8c0ce2b0 0x7f2e8c143f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44372/0 (socket says 172.21.15.173:44372) 2024-04-25T09:14:46.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e92600640 1 -- 172.21.15.173:0/465703782 learned_addr learned my addr 172.21.15.173:0/465703782 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:46.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e91c00640 1 --2- 172.21.15.173:0/465703782 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e8c0aeb90 0x7f2e8c13fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e91200640 1 --2- 172.21.15.173:0/465703782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e8c0aef70 0x7f2e8c143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e92600640 1 -- 172.21.15.173:0/465703782 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e8c0aeb90 msgr2=0x7f2e8c13fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e92600640 1 --2- 172.21.15.173:0/465703782 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e8c0aeb90 0x7f2e8c13fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e92600640 1 -- 172.21.15.173:0/465703782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e8c0aef70 msgr2=0x7f2e8c143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e92600640 1 --2- 172.21.15.173:0/465703782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e8c0aef70 0x7f2e8c143a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e92600640 1 -- 172.21.15.173:0/465703782 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c0b13b0 con 0x7f2e8c0ce2b0 2024-04-25T09:14:46.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e92600640 1 --2- 172.21.15.173:0/465703782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e8c0ce2b0 0x7f2e8c143f50 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009e30 tx=0x7f2e8400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:46.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e89600640 1 -- 172.21.15.173:0/465703782 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84018020 con 0x7f2e8c0ce2b0 2024-04-25T09:14:46.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e89600640 1 -- 172.21.15.173:0/465703782 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e84014480 con 0x7f2e8c0ce2b0 2024-04-25T09:14:46.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e89600640 1 -- 172.21.15.173:0/465703782 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84014870 con 0x7f2e8c0ce2b0 2024-04-25T09:14:46.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e94600640 1 -- 172.21.15.173:0/465703782 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8c0b1690 con 0x7f2e8c0ce2b0 2024-04-25T09:14:46.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e94600640 1 -- 172.21.15.173:0/465703782 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8c0b1c50 con 0x7f2e8c0ce2b0 2024-04-25T09:14:46.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e94600640 1 -- 172.21.15.173:0/465703782 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2e8c073ab0 con 0x7f2e8c0ce2b0 2024-04-25T09:14:46.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e89600640 1 -- 172.21.15.173:0/465703782 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2e8401b020 con 0x7f2e8c0ce2b0 2024-04-25T09:14:46.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.912+0000 7f2e89600640 1 --2- 172.21.15.173:0/465703782 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2e6c066f60 0x7f2e6c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.916+0000 7f2e89600640 1 -- 172.21.15.173:0/465703782 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f2e84085d50 con 0x7f2e8c0ce2b0 2024-04-25T09:14:46.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.916+0000 7f2e89600640 1 --2- 172.21.15.173:0/465703782 >> [v2:172.21.15.173:6822/4263773184,v1:172.21.15.173:6824/4263773184] conn(0x7f2e6c06d400 0x7f2e6c06f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.916+0000 7f2e91c00640 1 --2- 172.21.15.173:0/465703782 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2e6c066f60 0x7f2e6c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.916+0000 7f2e89600640 1 -- 172.21.15.173:0/465703782 --> [v2:172.21.15.173:6822/4263773184,v1:172.21.15.173:6824/4263773184] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2e840020c0 con 0x7f2e6c06d400 2024-04-25T09:14:46.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.916+0000 7f2e89600640 1 -- 172.21.15.173:0/465703782 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=149) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e84088310 con 0x7f2e8c0ce2b0 2024-04-25T09:14:46.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.916+0000 7f2e91200640 1 --2- 172.21.15.173:0/465703782 >> [v2:172.21.15.173:6822/4263773184,v1:172.21.15.173:6824/4263773184] conn(0x7f2e6c06d400 0x7f2e6c06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.916+0000 7f2e91c00640 1 --2- 172.21.15.173:0/465703782 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2e6c066f60 0x7f2e6c069420 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2e800ad000 tx=0x7f2e800a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:46.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.916+0000 7f2e91200640 1 --2- 172.21.15.173:0/465703782 >> [v2:172.21.15.173:6822/4263773184,v1:172.21.15.173:6824/4263773184] conn(0x7f2e6c06d400 0x7f2e6c06f840 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:46.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.916+0000 7f2e89600640 1 -- 172.21.15.173:0/465703782 <== osd.3 v2:172.21.15.173:6822/4263773184 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2e840020c0 con 0x7f2e6c06d400 2024-04-25T09:14:46.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.928+0000 7f2e94600640 1 -- 172.21.15.173:0/465703782 --> [v2:172.21.15.173:6822/4263773184,v1:172.21.15.173:6824/4263773184] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2e8c140230 con 0x7f2e6c06d400 2024-04-25T09:14:46.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.928+0000 7f2e89600640 1 -- 172.21.15.173:0/465703782 <== osd.3 v2:172.21.15.173:6822/4263773184 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2e8c140230 con 0x7f2e6c06d400 2024-04-25T09:14:46.914 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:14:46.915 INFO:teuthology.orchestra.run.smithi173.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:14:46.915 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:14:46.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.928+0000 7f2e94600640 1 -- 172.21.15.173:0/465703782 >> [v2:172.21.15.173:6822/4263773184,v1:172.21.15.173:6824/4263773184] conn(0x7f2e6c06d400 msgr2=0x7f2e6c06f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.928+0000 7f2e94600640 1 --2- 172.21.15.173:0/465703782 >> [v2:172.21.15.173:6822/4263773184,v1:172.21.15.173:6824/4263773184] conn(0x7f2e6c06d400 0x7f2e6c06f840 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.928+0000 7f2e94600640 1 -- 172.21.15.173:0/465703782 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2e6c066f60 msgr2=0x7f2e6c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.928+0000 7f2e94600640 1 --2- 172.21.15.173:0/465703782 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2e6c066f60 0x7f2e6c069420 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2e800ad000 tx=0x7f2e800a6000 comp rx=0 tx=0).stop 2024-04-25T09:14:46.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.928+0000 7f2e94600640 1 -- 172.21.15.173:0/465703782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e8c0ce2b0 msgr2=0x7f2e8c143f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.928+0000 7f2e94600640 1 --2- 172.21.15.173:0/465703782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e8c0ce2b0 0x7f2e8c143f50 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009e30 tx=0x7f2e8400c490 comp rx=0 tx=0).stop 2024-04-25T09:14:46.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.928+0000 7f2e92600640 1 -- 172.21.15.173:0/465703782 reap_dead start 2024-04-25T09:14:46.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.928+0000 7f2e94600640 1 -- 172.21.15.173:0/465703782 shutdown_connections 2024-04-25T09:14:46.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.928+0000 7f2e94600640 1 -- 172.21.15.173:0/465703782 >> 172.21.15.173:0/465703782 conn(0x7f2e8c06ac90 msgr2=0x7f2e8c0b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:46.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.928+0000 7f2e94600640 1 -- 172.21.15.173:0/465703782 shutdown_connections 2024-04-25T09:14:46.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:46.928+0000 7f2e94600640 1 -- 172.21.15.173:0/465703782 wait complete. 2024-04-25T09:14:46.933 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T09:14:47.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.084+0000 7fd224200640 1 Processor -- start 2024-04-25T09:14:47.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.084+0000 7fd224200640 1 -- start start 2024-04-25T09:14:47.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.084+0000 7fd224200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd21c0aeb90 0x7fd21c0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.084+0000 7fd224200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21c071570 con 0x7fd21c0aef70 2024-04-25T09:14:47.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.084+0000 7fd224200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21c071850 con 0x7fd21c0ce2b0 2024-04-25T09:14:47.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.084+0000 7fd224200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c071320 con 0x7fd21c0aeb90 2024-04-25T09:14:47.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.084+0000 7fd220e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd21c0aef70 0x7fd21c0cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44500/0 (socket says 172.21.15.173:44500) 2024-04-25T09:14:47.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.084+0000 7fd220e00640 1 -- 172.21.15.173:0/2996919440 learned_addr learned my addr 172.21.15.173:0/2996919440 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:47.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.084+0000 7fd221800640 1 --2- 172.21.15.173:0/2996919440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd21c0aeb90 0x7fd21c0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.084+0000 7fd21be00640 1 -- 172.21.15.173:0/2996919440 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171601936 0 0) 0x7fd21c071570 con 0x7fd21c0aef70 2024-04-25T09:14:47.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.084+0000 7fd21be00640 1 -- 172.21.15.173:0/2996919440 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd204005740 con 0x7fd21c0aef70 2024-04-25T09:14:47.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.088+0000 7fd21be00640 1 -- 172.21.15.173:0/2996919440 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405440159 0 0) 0x7fd21c071850 con 0x7fd21c0ce2b0 2024-04-25T09:14:47.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.088+0000 7fd221800640 1 -- 172.21.15.173:0/2996919440 >> v1:172.21.15.194:6789/0 conn(0x7fd21c0ce2b0 legacy=0x7fd21c15af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.088+0000 7fd221800640 1 -- 172.21.15.173:0/2996919440 >> v1:172.21.15.173:6789/0 conn(0x7fd21c0aef70 legacy=0x7fd21c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.088+0000 7fd221800640 1 -- 172.21.15.173:0/2996919440 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c071b30 con 0x7fd21c0aeb90 2024-04-25T09:14:47.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.088+0000 7fd221800640 1 --2- 172.21.15.173:0/2996919440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd21c0aeb90 0x7fd21c0cc0d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd2100097f0 tx=0x7fd21001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=309290ea0a8656c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:47.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.088+0000 7fd21be00640 1 -- 172.21.15.173:0/2996919440 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2100b0070 con 0x7fd21c0aeb90 2024-04-25T09:14:47.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.088+0000 7fd21be00640 1 -- 172.21.15.173:0/2996919440 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2100ab600 con 0x7fd21c0aeb90 2024-04-25T09:14:47.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.088+0000 7fd21be00640 1 -- 172.21.15.173:0/2996919440 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2100ab9d0 con 0x7fd21c0aeb90 2024-04-25T09:14:47.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.088+0000 7fd224200640 1 -- 172.21.15.173:0/2996919440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd21c0aeb90 msgr2=0x7fd21c0cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.088+0000 7fd224200640 1 --2- 172.21.15.173:0/2996919440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd21c0aeb90 0x7fd21c0cc0d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd2100097f0 tx=0x7fd21001c450 comp rx=0 tx=0).stop 2024-04-25T09:14:47.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.088+0000 7fd224200640 1 -- 172.21.15.173:0/2996919440 shutdown_connections 2024-04-25T09:14:47.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.088+0000 7fd224200640 1 --2- 172.21.15.173:0/2996919440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd21c0aeb90 0x7fd21c0cc0d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.088+0000 7fd224200640 1 -- 172.21.15.173:0/2996919440 >> 172.21.15.173:0/2996919440 conn(0x7fd21c06ac90 msgr2=0x7fd21c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:47.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.088+0000 7fd224200640 1 -- 172.21.15.173:0/2996919440 shutdown_connections 2024-04-25T09:14:47.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd224200640 1 -- 172.21.15.173:0/2996919440 wait complete. 2024-04-25T09:14:47.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd224200640 1 Processor -- start 2024-04-25T09:14:47.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd224200640 1 -- start start 2024-04-25T09:14:47.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd224200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd21c0aeb90 0x7fd21c148630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd224200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd21c0aef70 0x7fd21c1f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd224200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd21c0ce2b0 0x7fd21c1f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd224200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c0cfb30 con 0x7fd21c0ce2b0 2024-04-25T09:14:47.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd224200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c0cf9b0 con 0x7fd21c0aeb90 2024-04-25T09:14:47.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd224200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c0cfcb0 con 0x7fd21c0aef70 2024-04-25T09:14:47.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd222200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd21c0ce2b0 0x7fd21c1f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd222200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd21c0ce2b0 0x7fd21c1f68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44374/0 (socket says 172.21.15.173:44374) 2024-04-25T09:14:47.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd222200640 1 -- 172.21.15.173:0/67296266 learned_addr learned my addr 172.21.15.173:0/67296266 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:47.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd221800640 1 --2- 172.21.15.173:0/67296266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd21c0aeb90 0x7fd21c148630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd220e00640 1 --2- 172.21.15.173:0/67296266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd21c0aef70 0x7fd21c1f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd222200640 1 -- 172.21.15.173:0/67296266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd21c0aef70 msgr2=0x7fd21c1f2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd222200640 1 --2- 172.21.15.173:0/67296266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd21c0aef70 0x7fd21c1f2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd222200640 1 -- 172.21.15.173:0/67296266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd21c0aeb90 msgr2=0x7fd21c148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd222200640 1 --2- 172.21.15.173:0/67296266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd21c0aeb90 0x7fd21c148630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd222200640 1 -- 172.21.15.173:0/67296266 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c1f3140 con 0x7fd21c0ce2b0 2024-04-25T09:14:47.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd220e00640 1 --2- 172.21.15.173:0/67296266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd21c0aef70 0x7fd21c1f2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:47.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd222200640 1 --2- 172.21.15.173:0/67296266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd21c0ce2b0 0x7fd21c1f68b0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7fd21400c750 tx=0x7fd21400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:47.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd219600640 1 -- 172.21.15.173:0/67296266 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21400ce60 con 0x7fd21c0ce2b0 2024-04-25T09:14:47.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd219600640 1 -- 172.21.15.173:0/67296266 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd214003db0 con 0x7fd21c0ce2b0 2024-04-25T09:14:47.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd219600640 1 -- 172.21.15.173:0/67296266 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2140052b0 con 0x7fd21c0ce2b0 2024-04-25T09:14:47.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd224200640 1 -- 172.21.15.173:0/67296266 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21c1f33c0 con 0x7fd21c0ce2b0 2024-04-25T09:14:47.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.092+0000 7fd224200640 1 -- 172.21.15.173:0/67296266 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21c1f3980 con 0x7fd21c0ce2b0 2024-04-25T09:14:47.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.096+0000 7fd224200640 1 -- 172.21.15.173:0/67296266 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21c073ab0 con 0x7fd21c0ce2b0 2024-04-25T09:14:47.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.096+0000 7fd219600640 1 -- 172.21.15.173:0/67296266 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd214005450 con 0x7fd21c0ce2b0 2024-04-25T09:14:47.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.096+0000 7fd219600640 1 --2- 172.21.15.173:0/67296266 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd1fc066f90 0x7fd1fc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.096+0000 7fd219600640 1 -- 172.21.15.173:0/67296266 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fd214084d80 con 0x7fd21c0ce2b0 2024-04-25T09:14:47.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.096+0000 7fd221800640 1 --2- 172.21.15.173:0/67296266 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd1fc066f90 0x7fd1fc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.096+0000 7fd221800640 1 --2- 172.21.15.173:0/67296266 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd1fc066f90 0x7fd1fc069450 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd2100ad000 tx=0x7fd2100a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:47.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.100+0000 7fd219600640 1 -- 172.21.15.173:0/67296266 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd21c1f3140 con 0x7fd21c0ce2b0 2024-04-25T09:14:47.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.256+0000 7fd224200640 1 -- 172.21.15.173:0/67296266 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd21c0b2260 con 0x7fd1fc066f90 2024-04-25T09:14:47.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.256+0000 7fd219600640 1 -- 172.21.15.173:0/67296266 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd21c0b2260 con 0x7fd1fc066f90 2024-04-25T09:14:47.241 INFO:teuthology.orchestra.run.smithi173.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T09:14:47.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.256+0000 7fd224200640 1 -- 172.21.15.173:0/67296266 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd1fc066f90 msgr2=0x7fd1fc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.256+0000 7fd224200640 1 --2- 172.21.15.173:0/67296266 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd1fc066f90 0x7fd1fc069450 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd2100ad000 tx=0x7fd2100a6000 comp rx=0 tx=0).stop 2024-04-25T09:14:47.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.256+0000 7fd224200640 1 -- 172.21.15.173:0/67296266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd21c0ce2b0 msgr2=0x7fd21c1f68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.256+0000 7fd224200640 1 --2- 172.21.15.173:0/67296266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd21c0ce2b0 0x7fd21c1f68b0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7fd21400c750 tx=0x7fd21400cc10 comp rx=0 tx=0).stop 2024-04-25T09:14:47.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.256+0000 7fd224200640 1 -- 172.21.15.173:0/67296266 shutdown_connections 2024-04-25T09:14:47.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.256+0000 7fd224200640 1 --2- 172.21.15.173:0/67296266 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd1fc066f90 0x7fd1fc069450 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.256+0000 7fd224200640 1 --2- 172.21.15.173:0/67296266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd21c0ce2b0 0x7fd21c1f68b0 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.256+0000 7fd224200640 1 --2- 172.21.15.173:0/67296266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd21c0aef70 0x7fd21c1f2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.256+0000 7fd224200640 1 --2- 172.21.15.173:0/67296266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd21c0aeb90 0x7fd21c148630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.256+0000 7fd224200640 1 -- 172.21.15.173:0/67296266 >> 172.21.15.173:0/67296266 conn(0x7fd21c06ac90 msgr2=0x7fd21c15c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:47.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.256+0000 7fd224200640 1 -- 172.21.15.173:0/67296266 shutdown_connections 2024-04-25T09:14:47.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.256+0000 7fd224200640 1 -- 172.21.15.173:0/67296266 wait complete. 2024-04-25T09:14:47.262 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T09:14:47.262 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:14:47.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.416+0000 7f4d29200640 1 Processor -- start 2024-04-25T09:14:47.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.416+0000 7f4d29200640 1 -- start start 2024-04-25T09:14:47.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.416+0000 7f4d29200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4d24145290 0x7f4d2415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.416+0000 7f4d29200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4d240cc260 0x7f4d240cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.416+0000 7f4d29200640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2415c5f0 con 0x7f4d240b3fe0 2024-04-25T09:14:47.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.416+0000 7f4d29200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2406d4b0 con 0x7f4d240cc260 2024-04-25T09:14:47.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.416+0000 7f4d29200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2406d790 con 0x7f4d24145290 2024-04-25T09:14:47.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.420+0000 7f4d22800640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4d240cc260 0x7f4d240cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.420+0000 7f4d19400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4d240b3fe0 0x7f4d240b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44516/0 (socket says 172.21.15.173:44516) 2024-04-25T09:14:47.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.420+0000 7f4d19400640 1 -- 172.21.15.173:0/4065782977 learned_addr learned my addr 172.21.15.173:0/4065782977 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:47.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.420+0000 7f4d21e00640 1 --2- 172.21.15.173:0/4065782977 >> v2:172.21.15.194:3300/0 conn(0x7f4d24145290 0x7f4d2415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.420+0000 7f4d22800640 1 -- 172.21.15.173:0/4065782977 >> v2:172.21.15.194:3300/0 conn(0x7f4d24145290 msgr2=0x7f4d2415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:47.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.420+0000 7f4d22800640 1 --2- 172.21.15.173:0/4065782977 >> v2:172.21.15.194:3300/0 conn(0x7f4d24145290 0x7f4d2415c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.420+0000 7f4d22800640 1 -- 172.21.15.173:0/4065782977 >> v1:172.21.15.173:6789/0 conn(0x7f4d240b3fe0 legacy=0x7f4d240b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.420+0000 7f4d22800640 1 -- 172.21.15.173:0/4065782977 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2406da70 con 0x7f4d240cc260 2024-04-25T09:14:47.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.420+0000 7f4d21400640 1 -- 172.21.15.173:0/4065782977 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208682079 0 0) 0x7f4d0c001120 con 0x7f4d240b3fe0 2024-04-25T09:14:47.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.420+0000 7f4d22800640 1 --2- 172.21.15.173:0/4065782977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d240cc260 0x7f4d240cc670 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f4d240d0800 tx=0x7f4d1c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92a6e9f5ce2f771 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:47.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.420+0000 7f4d21400640 1 -- 172.21.15.173:0/4065782977 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0b0070 con 0x7f4d240cc260 2024-04-25T09:14:47.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.420+0000 7f4d21400640 1 -- 172.21.15.173:0/4065782977 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c0ab600 con 0x7f4d240cc260 2024-04-25T09:14:47.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.420+0000 7f4d21400640 1 -- 172.21.15.173:0/4065782977 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0ab9d0 con 0x7f4d240cc260 2024-04-25T09:14:47.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d29200640 1 -- 172.21.15.173:0/4065782977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d240cc260 msgr2=0x7f4d240cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d29200640 1 --2- 172.21.15.173:0/4065782977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d240cc260 0x7f4d240cc670 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f4d240d0800 tx=0x7f4d1c01c360 comp rx=0 tx=0).stop 2024-04-25T09:14:47.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d29200640 1 -- 172.21.15.173:0/4065782977 shutdown_connections 2024-04-25T09:14:47.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d29200640 1 --2- 172.21.15.173:0/4065782977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d240cc260 0x7f4d240cc670 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d29200640 1 --2- 172.21.15.173:0/4065782977 >> v2:172.21.15.194:3300/0 conn(0x7f4d24145290 0x7f4d2415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d29200640 1 -- 172.21.15.173:0/4065782977 >> 172.21.15.173:0/4065782977 conn(0x7f4d2406ac90 msgr2=0x7f4d2406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:47.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d29200640 1 -- 172.21.15.173:0/4065782977 shutdown_connections 2024-04-25T09:14:47.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d29200640 1 -- 172.21.15.173:0/4065782977 wait complete. 2024-04-25T09:14:47.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d29200640 1 Processor -- start 2024-04-25T09:14:47.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d29200640 1 -- start start 2024-04-25T09:14:47.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d29200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d240b3fe0 0x7f4d241589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d29200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d240cc260 0x7f4d2413d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d29200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d24145290 0x7f4d2413d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d29200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2406ed60 con 0x7f4d24145290 2024-04-25T09:14:47.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d29200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2406eee0 con 0x7f4d240b3fe0 2024-04-25T09:14:47.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d29200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2406f060 con 0x7f4d240cc260 2024-04-25T09:14:47.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d22800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d24145290 0x7f4d2413d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d22800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d24145290 0x7f4d2413d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44386/0 (socket says 172.21.15.173:44386) 2024-04-25T09:14:47.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d22800640 1 -- 172.21.15.173:0/620075347 learned_addr learned my addr 172.21.15.173:0/620075347 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:47.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d22800640 1 -- 172.21.15.173:0/620075347 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d240cc260 msgr2=0x7f4d2413d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d22800640 1 --2- 172.21.15.173:0/620075347 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d240cc260 0x7f4d2413d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d22800640 1 -- 172.21.15.173:0/620075347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d240b3fe0 msgr2=0x7f4d241589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d22800640 1 --2- 172.21.15.173:0/620075347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d240b3fe0 0x7f4d241589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d22800640 1 -- 172.21.15.173:0/620075347 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d241590e0 con 0x7f4d24145290 2024-04-25T09:14:47.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.424+0000 7f4d22800640 1 --2- 172.21.15.173:0/620075347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d24145290 0x7f4d2413d590 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0ae040 tx=0x7f4d1c01aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:47.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.428+0000 7f4d1aa00640 1 -- 172.21.15.173:0/620075347 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0bc070 con 0x7f4d24145290 2024-04-25T09:14:47.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.428+0000 7f4d1aa00640 1 -- 172.21.15.173:0/620075347 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c0b1040 con 0x7f4d24145290 2024-04-25T09:14:47.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.428+0000 7f4d1aa00640 1 -- 172.21.15.173:0/620075347 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0b0050 con 0x7f4d24145290 2024-04-25T09:14:47.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.428+0000 7f4d29200640 1 -- 172.21.15.173:0/620075347 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d241593c0 con 0x7f4d24145290 2024-04-25T09:14:47.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.428+0000 7f4d29200640 1 -- 172.21.15.173:0/620075347 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d24159980 con 0x7f4d24145290 2024-04-25T09:14:47.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.428+0000 7f4d29200640 1 -- 172.21.15.173:0/620075347 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d2415a460 con 0x7f4d24145290 2024-04-25T09:14:47.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.428+0000 7f4d1aa00640 1 -- 172.21.15.173:0/620075347 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4d1c0bf070 con 0x7f4d24145290 2024-04-25T09:14:47.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.428+0000 7f4d1aa00640 1 --2- 172.21.15.173:0/620075347 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4d00066f60 0x7f4d00069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.428+0000 7f4d1aa00640 1 -- 172.21.15.173:0/620075347 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f4d1c11e8a0 con 0x7f4d24145290 2024-04-25T09:14:47.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.428+0000 7f4d21e00640 1 --2- 172.21.15.173:0/620075347 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4d00066f60 0x7f4d00069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.428+0000 7f4d1aa00640 1 --2- 172.21.15.173:0/620075347 >> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] conn(0x7f4d0006d400 0x7f4d0006f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.428+0000 7f4d1aa00640 1 -- 172.21.15.173:0/620075347 --> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d0006ff10 con 0x7f4d0006d400 2024-04-25T09:14:47.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.428+0000 7f4d1aa00640 1 -- 172.21.15.173:0/620075347 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=149) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d1c123280 con 0x7f4d24145290 2024-04-25T09:14:47.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.428+0000 7f4d19400640 1 --2- 172.21.15.173:0/620075347 >> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] conn(0x7f4d0006d400 0x7f4d0006f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.428+0000 7f4d21e00640 1 --2- 172.21.15.173:0/620075347 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4d00066f60 0x7f4d00069420 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4d140070b0 tx=0x7f4d14007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:47.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.432+0000 7f4d19400640 1 --2- 172.21.15.173:0/620075347 >> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] conn(0x7f4d0006d400 0x7f4d0006f840 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:47.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.432+0000 7f4d1aa00640 1 -- 172.21.15.173:0/620075347 <== osd.4 v2:172.21.15.194:6805/3578285787 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4d0006ff10 con 0x7f4d0006d400 2024-04-25T09:14:47.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.444+0000 7f4d29200640 1 -- 172.21.15.173:0/620075347 --> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4d24159e10 con 0x7f4d0006d400 2024-04-25T09:14:47.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.444+0000 7f4d1aa00640 1 -- 172.21.15.173:0/620075347 <== osd.4 v2:172.21.15.194:6805/3578285787 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4d24159e10 con 0x7f4d0006d400 2024-04-25T09:14:47.430 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:14:47.430 INFO:teuthology.orchestra.run.smithi173.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:14:47.430 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:14:47.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.444+0000 7f4d29200640 1 -- 172.21.15.173:0/620075347 >> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] conn(0x7f4d0006d400 msgr2=0x7f4d0006f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.444+0000 7f4d29200640 1 --2- 172.21.15.173:0/620075347 >> [v2:172.21.15.194:6805/3578285787,v1:172.21.15.194:6807/3578285787] conn(0x7f4d0006d400 0x7f4d0006f840 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.444+0000 7f4d29200640 1 -- 172.21.15.173:0/620075347 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4d00066f60 msgr2=0x7f4d00069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.444+0000 7f4d29200640 1 --2- 172.21.15.173:0/620075347 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f4d00066f60 0x7f4d00069420 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4d140070b0 tx=0x7f4d14007040 comp rx=0 tx=0).stop 2024-04-25T09:14:47.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.444+0000 7f4d29200640 1 -- 172.21.15.173:0/620075347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d24145290 msgr2=0x7f4d2413d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.444+0000 7f4d29200640 1 --2- 172.21.15.173:0/620075347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d24145290 0x7f4d2413d590 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0ae040 tx=0x7f4d1c01aba0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.444+0000 7f4d22800640 1 -- 172.21.15.173:0/620075347 reap_dead start 2024-04-25T09:14:47.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.444+0000 7f4d29200640 1 -- 172.21.15.173:0/620075347 shutdown_connections 2024-04-25T09:14:47.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.444+0000 7f4d29200640 1 -- 172.21.15.173:0/620075347 >> 172.21.15.173:0/620075347 conn(0x7f4d2406ac90 msgr2=0x7f4d2406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:47.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.444+0000 7f4d29200640 1 -- 172.21.15.173:0/620075347 shutdown_connections 2024-04-25T09:14:47.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.444+0000 7f4d29200640 1 -- 172.21.15.173:0/620075347 wait complete. 2024-04-25T09:14:47.448 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T09:14:47.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.600+0000 7f3de9a00640 1 Processor -- start 2024-04-25T09:14:47.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.600+0000 7f3de9a00640 1 -- start start 2024-04-25T09:14:47.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.604+0000 7f3de9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3de40d02a0 0x7f3de4099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.604+0000 7f3de9a00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de40cc7a0 con 0x7f3de4099f90 2024-04-25T09:14:47.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.604+0000 7f3de9a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de40cca80 con 0x7f3de415bab0 2024-04-25T09:14:47.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.604+0000 7f3de9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40ccd60 con 0x7f3de40d02a0 2024-04-25T09:14:47.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.604+0000 7f3de3400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f3de4099f90 0x7f3de40c5300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44530/0 (socket says 172.21.15.173:44530) 2024-04-25T09:14:47.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.604+0000 7f3de3400640 1 -- 172.21.15.173:0/4044404394 learned_addr learned my addr 172.21.15.173:0/4044404394 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:47.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.604+0000 7f3de2000640 1 --2- 172.21.15.173:0/4044404394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3de40d02a0 0x7f3de4099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.604+0000 7f3de1600640 1 -- 172.21.15.173:0/4044404394 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786130246 0 0) 0x7f3de40cc7a0 con 0x7f3de4099f90 2024-04-25T09:14:47.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.604+0000 7f3de1600640 1 -- 172.21.15.173:0/4044404394 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dc8003530 con 0x7f3de4099f90 2024-04-25T09:14:47.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.604+0000 7f3de1600640 1 -- 172.21.15.173:0/4044404394 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957791287 0 0) 0x7f3de40cca80 con 0x7f3de415bab0 2024-04-25T09:14:47.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.604+0000 7f3de1600640 1 -- 172.21.15.173:0/4044404394 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3de40cc7a0 con 0x7f3de415bab0 2024-04-25T09:14:47.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.604+0000 7f3de2000640 1 -- 172.21.15.173:0/4044404394 >> v1:172.21.15.194:6789/0 conn(0x7f3de415bab0 legacy=0x7f3de40cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.604+0000 7f3de2000640 1 -- 172.21.15.173:0/4044404394 >> v1:172.21.15.173:6789/0 conn(0x7f3de4099f90 legacy=0x7f3de40c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.604+0000 7f3de2000640 1 -- 172.21.15.173:0/4044404394 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de40cd040 con 0x7f3de40d02a0 2024-04-25T09:14:47.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de2000640 1 --2- 172.21.15.173:0/4044404394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3de40d02a0 0x7f3de4099a50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00097f0 tx=0x7f3dd001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39dc53b3f8860cae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:47.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de1600640 1 -- 172.21.15.173:0/4044404394 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00ab5f0 con 0x7f3de40d02a0 2024-04-25T09:14:47.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de1600640 1 -- 172.21.15.173:0/4044404394 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd00b0070 con 0x7f3de40d02a0 2024-04-25T09:14:47.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de1600640 1 -- 172.21.15.173:0/4044404394 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00ab9b0 con 0x7f3de40d02a0 2024-04-25T09:14:47.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de9a00640 1 -- 172.21.15.173:0/4044404394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3de40d02a0 msgr2=0x7f3de4099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de9a00640 1 --2- 172.21.15.173:0/4044404394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3de40d02a0 0x7f3de4099a50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00097f0 tx=0x7f3dd001c4e0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de9a00640 1 -- 172.21.15.173:0/4044404394 shutdown_connections 2024-04-25T09:14:47.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de9a00640 1 --2- 172.21.15.173:0/4044404394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3de40d02a0 0x7f3de4099a50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de9a00640 1 -- 172.21.15.173:0/4044404394 >> 172.21.15.173:0/4044404394 conn(0x7f3de40b32a0 msgr2=0x7f3de40b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:47.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de9a00640 1 -- 172.21.15.173:0/4044404394 shutdown_connections 2024-04-25T09:14:47.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de9a00640 1 -- 172.21.15.173:0/4044404394 wait complete. 2024-04-25T09:14:47.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de9a00640 1 Processor -- start 2024-04-25T09:14:47.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de9a00640 1 -- start start 2024-04-25T09:14:47.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3de4099f90 0x7f3de40c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de9a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3de40d02a0 0x7f3de40c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de9a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3de415bab0 0x7f3de413b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de9a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de415c010 con 0x7f3de415bab0 2024-04-25T09:14:47.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de9a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de415be90 con 0x7f3de40d02a0 2024-04-25T09:14:47.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40cc3c0 con 0x7f3de4099f90 2024-04-25T09:14:47.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3de415bab0 0x7f3de413b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de3400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3de415bab0 0x7f3de413b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44388/0 (socket says 172.21.15.173:44388) 2024-04-25T09:14:47.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de3400640 1 -- 172.21.15.173:0/4040057299 learned_addr learned my addr 172.21.15.173:0/4040057299 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:47.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.608+0000 7f3de2000640 1 --2- 172.21.15.173:0/4040057299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3de40d02a0 0x7f3de40c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.612+0000 7f3de2a00640 1 --2- 172.21.15.173:0/4040057299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3de4099f90 0x7f3de40c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.612+0000 7f3de3400640 1 -- 172.21.15.173:0/4040057299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3de4099f90 msgr2=0x7f3de40c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.612+0000 7f3de3400640 1 --2- 172.21.15.173:0/4040057299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3de4099f90 0x7f3de40c4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.612+0000 7f3de3400640 1 -- 172.21.15.173:0/4040057299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3de40d02a0 msgr2=0x7f3de40c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.612+0000 7f3de3400640 1 --2- 172.21.15.173:0/4040057299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3de40d02a0 0x7f3de40c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.612+0000 7f3de3400640 1 -- 172.21.15.173:0/4040057299 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de40ca290 con 0x7f3de415bab0 2024-04-25T09:14:47.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.612+0000 7f3de3400640 1 --2- 172.21.15.173:0/4040057299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3de415bab0 0x7f3de413b530 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00caf0 tx=0x7f3ddc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:47.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.612+0000 7f3ddaa00640 1 -- 172.21.15.173:0/4040057299 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc017070 con 0x7f3de415bab0 2024-04-25T09:14:47.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.612+0000 7f3ddaa00640 1 -- 172.21.15.173:0/4040057299 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc00aca0 con 0x7f3de415bab0 2024-04-25T09:14:47.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.612+0000 7f3de9a00640 1 -- 172.21.15.173:0/4040057299 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de40ca550 con 0x7f3de415bab0 2024-04-25T09:14:47.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.612+0000 7f3ddaa00640 1 -- 172.21.15.173:0/4040057299 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc012600 con 0x7f3de415bab0 2024-04-25T09:14:47.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.612+0000 7f3de9a00640 1 -- 172.21.15.173:0/4040057299 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de40cab10 con 0x7f3de415bab0 2024-04-25T09:14:47.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.612+0000 7f3de9a00640 1 -- 172.21.15.173:0/4040057299 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de4073ab0 con 0x7f3de415bab0 2024-04-25T09:14:47.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.612+0000 7f3ddaa00640 1 -- 172.21.15.173:0/4040057299 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3ddc01a070 con 0x7f3de415bab0 2024-04-25T09:14:47.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.612+0000 7f3ddaa00640 1 --2- 172.21.15.173:0/4040057299 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3dc4066f60 0x7f3dc4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.612+0000 7f3ddaa00640 1 -- 172.21.15.173:0/4040057299 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f3ddc084b60 con 0x7f3de415bab0 2024-04-25T09:14:47.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.616+0000 7f3de2a00640 1 --2- 172.21.15.173:0/4040057299 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3dc4066f60 0x7f3dc4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.616+0000 7f3de2a00640 1 --2- 172.21.15.173:0/4040057299 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3dc4066f60 0x7f3dc4069420 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40017c0 tx=0x7f3dd4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:47.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.616+0000 7f3ddaa00640 1 -- 172.21.15.173:0/4040057299 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3ddc055690 con 0x7f3de415bab0 2024-04-25T09:14:47.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.772+0000 7f3de9a00640 1 -- 172.21.15.173:0/4040057299 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3de409b0e0 con 0x7f3dc4066f60 2024-04-25T09:14:47.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.772+0000 7f3ddaa00640 1 -- 172.21.15.173:0/4040057299 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3de409b0e0 con 0x7f3dc4066f60 2024-04-25T09:14:47.757 INFO:teuthology.orchestra.run.smithi173.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T09:14:47.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.772+0000 7f3de9a00640 1 -- 172.21.15.173:0/4040057299 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3dc4066f60 msgr2=0x7f3dc4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.772+0000 7f3de9a00640 1 --2- 172.21.15.173:0/4040057299 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3dc4066f60 0x7f3dc4069420 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40017c0 tx=0x7f3dd4009040 comp rx=0 tx=0).stop 2024-04-25T09:14:47.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.772+0000 7f3de9a00640 1 -- 172.21.15.173:0/4040057299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3de415bab0 msgr2=0x7f3de413b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.772+0000 7f3de9a00640 1 --2- 172.21.15.173:0/4040057299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3de415bab0 0x7f3de413b530 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00caf0 tx=0x7f3ddc00a060 comp rx=0 tx=0).stop 2024-04-25T09:14:47.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.772+0000 7f3de9a00640 1 -- 172.21.15.173:0/4040057299 shutdown_connections 2024-04-25T09:14:47.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.772+0000 7f3de9a00640 1 --2- 172.21.15.173:0/4040057299 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f3dc4066f60 0x7f3dc4069420 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.772+0000 7f3de9a00640 1 --2- 172.21.15.173:0/4040057299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3de415bab0 0x7f3de413b530 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.772+0000 7f3de9a00640 1 --2- 172.21.15.173:0/4040057299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3de40d02a0 0x7f3de40c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.772+0000 7f3de9a00640 1 --2- 172.21.15.173:0/4040057299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3de4099f90 0x7f3de40c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.772+0000 7f3de9a00640 1 -- 172.21.15.173:0/4040057299 >> 172.21.15.173:0/4040057299 conn(0x7f3de40b32a0 msgr2=0x7f3de40cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:47.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.772+0000 7f3de9a00640 1 -- 172.21.15.173:0/4040057299 shutdown_connections 2024-04-25T09:14:47.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.772+0000 7f3de9a00640 1 -- 172.21.15.173:0/4040057299 wait complete. 2024-04-25T09:14:47.778 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T09:14:47.778 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:14:47.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.932+0000 7f4281c00640 1 Processor -- start 2024-04-25T09:14:47.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.932+0000 7f4281c00640 1 -- start start 2024-04-25T09:14:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.936+0000 7f4281c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f427c0cda00 0x7f427c1650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.936+0000 7f4281c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427c15ddd0 con 0x7f427c0cff40 2024-04-25T09:14:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.936+0000 7f4281c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427c15e0b0 con 0x7f427c159f00 2024-04-25T09:14:47.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.936+0000 7f4281c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427c072330 con 0x7f427c0cda00 2024-04-25T09:14:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.936+0000 7f427b400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f427c0cda00 0x7f427c1650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.936+0000 7f427a000640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f427c0cff40 0x7f427c0cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44544/0 (socket says 172.21.15.173:44544) 2024-04-25T09:14:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.936+0000 7f427a000640 1 -- 172.21.15.173:0/3657894759 learned_addr learned my addr 172.21.15.173:0/3657894759 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.936+0000 7f427b400640 1 -- 172.21.15.173:0/3657894759 >> v1:172.21.15.194:6789/0 conn(0x7f427c159f00 legacy=0x7f427c0cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.936+0000 7f427b400640 1 -- 172.21.15.173:0/3657894759 >> v1:172.21.15.173:6789/0 conn(0x7f427c0cff40 legacy=0x7f427c0cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.936+0000 7f427b400640 1 -- 172.21.15.173:0/3657894759 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c15e390 con 0x7f427c0cda00 2024-04-25T09:14:47.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.936+0000 7f4279600640 1 -- 172.21.15.173:0/3657894759 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303941654 0 0) 0x7f427c15ddd0 con 0x7f427c0cff40 2024-04-25T09:14:47.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.936+0000 7f427b400640 1 --2- 172.21.15.173:0/3657894759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f427c0cda00 0x7f427c1650c0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f42740097c0 tx=0x7f427401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa858d7c42056e99 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:47.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.936+0000 7f4279600640 1 -- 172.21.15.173:0/3657894759 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42740b1070 con 0x7f427c0cda00 2024-04-25T09:14:47.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f4279600640 1 -- 172.21.15.173:0/3657894759 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42740ac410 con 0x7f427c0cda00 2024-04-25T09:14:47.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f4279600640 1 -- 172.21.15.173:0/3657894759 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42740ac7e0 con 0x7f427c0cda00 2024-04-25T09:14:47.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f4281c00640 1 -- 172.21.15.173:0/3657894759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f427c0cda00 msgr2=0x7f427c1650c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f4281c00640 1 --2- 172.21.15.173:0/3657894759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f427c0cda00 0x7f427c1650c0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f42740097c0 tx=0x7f427401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f4281c00640 1 -- 172.21.15.173:0/3657894759 shutdown_connections 2024-04-25T09:14:47.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f4281c00640 1 --2- 172.21.15.173:0/3657894759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f427c0cda00 0x7f427c1650c0 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f4281c00640 1 -- 172.21.15.173:0/3657894759 >> 172.21.15.173:0/3657894759 conn(0x7f427c06ac90 msgr2=0x7f427c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:47.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f4281c00640 1 -- 172.21.15.173:0/3657894759 shutdown_connections 2024-04-25T09:14:47.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f4281c00640 1 -- 172.21.15.173:0/3657894759 wait complete. 2024-04-25T09:14:47.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f4281c00640 1 Processor -- start 2024-04-25T09:14:47.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f4281c00640 1 -- start start 2024-04-25T09:14:47.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f4281c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f427c0cda00 0x7f427c150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f4281c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f427c0cff40 0x7f427c157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f4281c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f427c159f00 0x7f427c149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f4281c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c168ac0 con 0x7f427c0cda00 2024-04-25T09:14:47.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f4281c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c168940 con 0x7f427c159f00 2024-04-25T09:14:47.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f4281c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427c168c40 con 0x7f427c0cff40 2024-04-25T09:14:47.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f427aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f427c0cda00 0x7f427c150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f427aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f427c0cda00 0x7f427c150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44402/0 (socket says 172.21.15.173:44402) 2024-04-25T09:14:47.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f427aa00640 1 -- 172.21.15.173:0/926312863 learned_addr learned my addr 172.21.15.173:0/926312863 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:47.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f427a000640 1 --2- 172.21.15.173:0/926312863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f427c0cff40 0x7f427c157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f427aa00640 1 -- 172.21.15.173:0/926312863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f427c0cff40 msgr2=0x7f427c157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f427b400640 1 --2- 172.21.15.173:0/926312863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f427c159f00 0x7f427c149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f427aa00640 1 --2- 172.21.15.173:0/926312863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f427c0cff40 0x7f427c157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f427aa00640 1 -- 172.21.15.173:0/926312863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f427c159f00 msgr2=0x7f427c149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f427aa00640 1 --2- 172.21.15.173:0/926312863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f427c159f00 0x7f427c149b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f427aa00640 1 -- 172.21.15.173:0/926312863 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c0acb10 con 0x7f427c0cda00 2024-04-25T09:14:47.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.940+0000 7f427a000640 1 --2- 172.21.15.173:0/926312863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f427c0cff40 0x7f427c157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:47.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.944+0000 7f427aa00640 1 --2- 172.21.15.173:0/926312863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f427c0cda00 0x7f427c150d90 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f426c00c7a0 tx=0x7f426c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:47.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.944+0000 7f4272a00640 1 -- 172.21.15.173:0/926312863 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c003b80 con 0x7f427c0cda00 2024-04-25T09:14:47.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.944+0000 7f4272a00640 1 -- 172.21.15.173:0/926312863 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c003d20 con 0x7f427c0cda00 2024-04-25T09:14:47.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.944+0000 7f4281c00640 1 -- 172.21.15.173:0/926312863 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427c0ace50 con 0x7f427c0cda00 2024-04-25T09:14:47.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.944+0000 7f4272a00640 1 -- 172.21.15.173:0/926312863 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c00aa90 con 0x7f427c0cda00 2024-04-25T09:14:47.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.944+0000 7f4281c00640 1 -- 172.21.15.173:0/926312863 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427c0ad690 con 0x7f427c0cda00 2024-04-25T09:14:47.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.944+0000 7f4281c00640 1 -- 172.21.15.173:0/926312863 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f427c073ab0 con 0x7f427c0cda00 2024-04-25T09:14:47.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.944+0000 7f4272a00640 1 -- 172.21.15.173:0/926312863 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f426c00ac30 con 0x7f427c0cda00 2024-04-25T09:14:47.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.944+0000 7f4272a00640 1 --2- 172.21.15.173:0/926312863 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f425c066f60 0x7f425c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.944+0000 7f4272a00640 1 -- 172.21.15.173:0/926312863 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f426c084e10 con 0x7f427c0cda00 2024-04-25T09:14:47.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.944+0000 7f427a000640 1 --2- 172.21.15.173:0/926312863 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f425c066f60 0x7f425c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.944+0000 7f4272a00640 1 --2- 172.21.15.173:0/926312863 >> [v2:172.21.15.194:6800/2762622538,v1:172.21.15.194:6801/2762622538] conn(0x7f425c06d400 0x7f425c06f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.944+0000 7f4272a00640 1 -- 172.21.15.173:0/926312863 --> [v2:172.21.15.194:6800/2762622538,v1:172.21.15.194:6801/2762622538] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f425c06ff10 con 0x7f425c06d400 2024-04-25T09:14:47.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.944+0000 7f4272a00640 1 -- 172.21.15.173:0/926312863 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=149) v2 ==== 24+0+0 (secure 0 0 0) 0x7f426c087430 con 0x7f427c0cda00 2024-04-25T09:14:47.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.948+0000 7f427b400640 1 --2- 172.21.15.173:0/926312863 >> [v2:172.21.15.194:6800/2762622538,v1:172.21.15.194:6801/2762622538] conn(0x7f425c06d400 0x7f425c06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.948+0000 7f427a000640 1 --2- 172.21.15.173:0/926312863 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f425c066f60 0x7f425c069420 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f427c0b0e90 tx=0x7f4268009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:47.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.948+0000 7f427b400640 1 --2- 172.21.15.173:0/926312863 >> [v2:172.21.15.194:6800/2762622538,v1:172.21.15.194:6801/2762622538] conn(0x7f425c06d400 0x7f425c06f840 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:47.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.948+0000 7f4272a00640 1 -- 172.21.15.173:0/926312863 <== osd.5 v2:172.21.15.194:6800/2762622538 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f425c06ff10 con 0x7f425c06d400 2024-04-25T09:14:47.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.960+0000 7f4281c00640 1 -- 172.21.15.173:0/926312863 --> [v2:172.21.15.194:6800/2762622538,v1:172.21.15.194:6801/2762622538] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f427c0ccb20 con 0x7f425c06d400 2024-04-25T09:14:47.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.960+0000 7f4272a00640 1 -- 172.21.15.173:0/926312863 <== osd.5 v2:172.21.15.194:6800/2762622538 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f427c0ccb20 con 0x7f425c06d400 2024-04-25T09:14:47.947 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:14:47.947 INFO:teuthology.orchestra.run.smithi173.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:14:47.947 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:14:47.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.960+0000 7f4281c00640 1 -- 172.21.15.173:0/926312863 >> [v2:172.21.15.194:6800/2762622538,v1:172.21.15.194:6801/2762622538] conn(0x7f425c06d400 msgr2=0x7f425c06f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.960+0000 7f4281c00640 1 --2- 172.21.15.173:0/926312863 >> [v2:172.21.15.194:6800/2762622538,v1:172.21.15.194:6801/2762622538] conn(0x7f425c06d400 0x7f425c06f840 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.960+0000 7f4281c00640 1 -- 172.21.15.173:0/926312863 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f425c066f60 msgr2=0x7f425c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.960+0000 7f4281c00640 1 --2- 172.21.15.173:0/926312863 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f425c066f60 0x7f425c069420 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f427c0b0e90 tx=0x7f4268009040 comp rx=0 tx=0).stop 2024-04-25T09:14:47.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.960+0000 7f4281c00640 1 -- 172.21.15.173:0/926312863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f427c0cda00 msgr2=0x7f427c150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.960+0000 7f4281c00640 1 --2- 172.21.15.173:0/926312863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f427c0cda00 0x7f427c150d90 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f426c00c7a0 tx=0x7f426c00cc60 comp rx=0 tx=0).stop 2024-04-25T09:14:47.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.960+0000 7f427b400640 1 -- 172.21.15.173:0/926312863 reap_dead start 2024-04-25T09:14:47.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.960+0000 7f4281c00640 1 -- 172.21.15.173:0/926312863 shutdown_connections 2024-04-25T09:14:47.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.960+0000 7f4281c00640 1 -- 172.21.15.173:0/926312863 >> 172.21.15.173:0/926312863 conn(0x7f427c06ac90 msgr2=0x7f427c0ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:47.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.964+0000 7f4281c00640 1 -- 172.21.15.173:0/926312863 shutdown_connections 2024-04-25T09:14:47.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:47.964+0000 7f4281c00640 1 -- 172.21.15.173:0/926312863 wait complete. 2024-04-25T09:14:47.966 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T09:14:48.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.116+0000 7f6d7e200640 1 Processor -- start 2024-04-25T09:14:48.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.116+0000 7f6d7e200640 1 -- start start 2024-04-25T09:14:48.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.120+0000 7f6d7e200640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6d780aeb90 0x7f6d780cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.120+0000 7f6d7e200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6d780aef70 0x7f6d780cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.120+0000 7f6d7e200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d780cdba0 0x7f6d780ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.120+0000 7f6d7e200640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d78071320 con 0x7f6d780aeb90 2024-04-25T09:14:48.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.120+0000 7f6d7e200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d78072330 con 0x7f6d780aef70 2024-04-25T09:14:48.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.120+0000 7f6d7e200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780ce570 con 0x7f6d780cdba0 2024-04-25T09:14:48.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.120+0000 7f6d77400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6d780aeb90 0x7f6d780cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.120+0000 7f6d77400640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6d780aeb90 0x7f6d780cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44414/0 (socket says 172.21.15.173:44414) 2024-04-25T09:14:48.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.120+0000 7f6d77400640 1 -- 172.21.15.173:0/3530723722 learned_addr learned my addr 172.21.15.173:0/3530723722 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:48.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.120+0000 7f6d6ea00640 1 --2- 172.21.15.173:0/3530723722 >> v2:172.21.15.194:3300/0 conn(0x7f6d780aef70 0x7f6d780cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.120+0000 7f6d77e00640 1 --2- 172.21.15.173:0/3530723722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d780cdba0 0x7f6d780ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.120+0000 7f6d77400640 1 -- 172.21.15.173:0/3530723722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d780cdba0 msgr2=0x7f6d780ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:48.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.120+0000 7f6d77400640 1 --2- 172.21.15.173:0/3530723722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d780cdba0 0x7f6d780ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.120+0000 7f6d77400640 1 -- 172.21.15.173:0/3530723722 >> v2:172.21.15.194:3300/0 conn(0x7f6d780aef70 msgr2=0x7f6d780cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:48.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.120+0000 7f6d77400640 1 --2- 172.21.15.173:0/3530723722 >> v2:172.21.15.194:3300/0 conn(0x7f6d780aef70 0x7f6d780cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.120+0000 7f6d77400640 1 -- 172.21.15.173:0/3530723722 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d78071570 con 0x7f6d780aeb90 2024-04-25T09:14:48.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d77400640 1 --2- 172.21.15.173:0/3530723722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d780aeb90 0x7f6d780cc0d0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f6d780cd960 tx=0x7f6d6801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5944c3487dcfee9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:48.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d76a00640 1 -- 172.21.15.173:0/3530723722 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d680ab620 con 0x7f6d780aeb90 2024-04-25T09:14:48.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d76a00640 1 -- 172.21.15.173:0/3530723722 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d680b0070 con 0x7f6d780aeb90 2024-04-25T09:14:48.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d76a00640 1 -- 172.21.15.173:0/3530723722 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d680ab9e0 con 0x7f6d780aeb90 2024-04-25T09:14:48.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d7e200640 1 -- 172.21.15.173:0/3530723722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d780aeb90 msgr2=0x7f6d780cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d7e200640 1 --2- 172.21.15.173:0/3530723722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d780aeb90 0x7f6d780cc0d0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f6d780cd960 tx=0x7f6d6801c460 comp rx=0 tx=0).stop 2024-04-25T09:14:48.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d7e200640 1 -- 172.21.15.173:0/3530723722 shutdown_connections 2024-04-25T09:14:48.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d7e200640 1 --2- 172.21.15.173:0/3530723722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d780cdba0 0x7f6d780ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d7e200640 1 --2- 172.21.15.173:0/3530723722 >> v2:172.21.15.194:3300/0 conn(0x7f6d780aef70 0x7f6d780cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d7e200640 1 --2- 172.21.15.173:0/3530723722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d780aeb90 0x7f6d780cc0d0 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d7e200640 1 -- 172.21.15.173:0/3530723722 >> 172.21.15.173:0/3530723722 conn(0x7f6d7806ac90 msgr2=0x7f6d7806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:48.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d7e200640 1 -- 172.21.15.173:0/3530723722 shutdown_connections 2024-04-25T09:14:48.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d7e200640 1 -- 172.21.15.173:0/3530723722 wait complete. 2024-04-25T09:14:48.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d7e200640 1 Processor -- start 2024-04-25T09:14:48.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d7e200640 1 -- start start 2024-04-25T09:14:48.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d7e200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d780aeb90 0x7f6d7814b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d7e200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d780aef70 0x7f6d7806e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d7e200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d780cdba0 0x7f6d7806e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d7e200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7815ef40 con 0x7f6d780cdba0 2024-04-25T09:14:48.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d7e200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7815edc0 con 0x7f6d780aeb90 2024-04-25T09:14:48.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.124+0000 7f6d7e200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7815f0c0 con 0x7f6d780aef70 2024-04-25T09:14:48.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d77e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d780cdba0 0x7f6d7806e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d77e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d780cdba0 0x7f6d7806e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44416/0 (socket says 172.21.15.173:44416) 2024-04-25T09:14:48.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d77e00640 1 -- 172.21.15.173:0/449633892 learned_addr learned my addr 172.21.15.173:0/449633892 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:48.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d6ea00640 1 --2- 172.21.15.173:0/449633892 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d780aef70 0x7f6d7806e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d77400640 1 --2- 172.21.15.173:0/449633892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d780aeb90 0x7f6d7814b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d77e00640 1 -- 172.21.15.173:0/449633892 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d780aef70 msgr2=0x7f6d7806e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d77e00640 1 --2- 172.21.15.173:0/449633892 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d780aef70 0x7f6d7806e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d77e00640 1 -- 172.21.15.173:0/449633892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d780aeb90 msgr2=0x7f6d7814b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d77e00640 1 --2- 172.21.15.173:0/449633892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d780aeb90 0x7f6d7814b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d77e00640 1 -- 172.21.15.173:0/449633892 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d78150720 con 0x7f6d780cdba0 2024-04-25T09:14:48.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d77e00640 1 --2- 172.21.15.173:0/449633892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d780cdba0 0x7f6d7806e640 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000efc0 tx=0x7f6d7000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:48.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d6fe00640 1 -- 172.21.15.173:0/449633892 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d70018020 con 0x7f6d780cdba0 2024-04-25T09:14:48.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d6fe00640 1 -- 172.21.15.173:0/449633892 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d70014480 con 0x7f6d780cdba0 2024-04-25T09:14:48.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d7e200640 1 -- 172.21.15.173:0/449633892 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d78150a00 con 0x7f6d780cdba0 2024-04-25T09:14:48.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d6fe00640 1 -- 172.21.15.173:0/449633892 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d70014870 con 0x7f6d780cdba0 2024-04-25T09:14:48.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d7e200640 1 -- 172.21.15.173:0/449633892 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d78153370 con 0x7f6d780cdba0 2024-04-25T09:14:48.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d7e200640 1 -- 172.21.15.173:0/449633892 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d78153570 con 0x7f6d780cdba0 2024-04-25T09:14:48.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d6fe00640 1 -- 172.21.15.173:0/449633892 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6d7001b020 con 0x7f6d780cdba0 2024-04-25T09:14:48.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d6fe00640 1 --2- 172.21.15.173:0/449633892 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d54066f60 0x7f6d54069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.128+0000 7f6d6fe00640 1 -- 172.21.15.173:0/449633892 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f6d700858a0 con 0x7f6d780cdba0 2024-04-25T09:14:48.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.132+0000 7f6d77400640 1 --2- 172.21.15.173:0/449633892 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d54066f60 0x7f6d54069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.132+0000 7f6d77400640 1 --2- 172.21.15.173:0/449633892 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d54066f60 0x7f6d54069420 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f6d680af000 tx=0x7f6d680a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:48.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.132+0000 7f6d6fe00640 1 -- 172.21.15.173:0/449633892 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6d78153570 con 0x7f6d780cdba0 2024-04-25T09:14:48.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.288+0000 7f6d7e200640 1 -- 172.21.15.173:0/449633892 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d78073ab0 con 0x7f6d54066f60 2024-04-25T09:14:48.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.288+0000 7f6d6fe00640 1 -- 172.21.15.173:0/449633892 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6d78073ab0 con 0x7f6d54066f60 2024-04-25T09:14:48.274 INFO:teuthology.orchestra.run.smithi173.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T09:14:48.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.292+0000 7f6d7e200640 1 -- 172.21.15.173:0/449633892 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d54066f60 msgr2=0x7f6d54069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.292+0000 7f6d7e200640 1 --2- 172.21.15.173:0/449633892 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d54066f60 0x7f6d54069420 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f6d680af000 tx=0x7f6d680a7000 comp rx=0 tx=0).stop 2024-04-25T09:14:48.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.292+0000 7f6d7e200640 1 -- 172.21.15.173:0/449633892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d780cdba0 msgr2=0x7f6d7806e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.292+0000 7f6d7e200640 1 --2- 172.21.15.173:0/449633892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d780cdba0 0x7f6d7806e640 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000efc0 tx=0x7f6d7000c490 comp rx=0 tx=0).stop 2024-04-25T09:14:48.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.292+0000 7f6d7e200640 1 -- 172.21.15.173:0/449633892 shutdown_connections 2024-04-25T09:14:48.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.292+0000 7f6d7e200640 1 --2- 172.21.15.173:0/449633892 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f6d54066f60 0x7f6d54069420 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.292+0000 7f6d7e200640 1 --2- 172.21.15.173:0/449633892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d780cdba0 0x7f6d7806e640 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.292+0000 7f6d7e200640 1 --2- 172.21.15.173:0/449633892 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d780aef70 0x7f6d7806e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.292+0000 7f6d7e200640 1 --2- 172.21.15.173:0/449633892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d780aeb90 0x7f6d7814b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.292+0000 7f6d7e200640 1 -- 172.21.15.173:0/449633892 >> 172.21.15.173:0/449633892 conn(0x7f6d7806ac90 msgr2=0x7f6d7815d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:48.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.292+0000 7f6d7e200640 1 -- 172.21.15.173:0/449633892 shutdown_connections 2024-04-25T09:14:48.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.292+0000 7f6d7e200640 1 -- 172.21.15.173:0/449633892 wait complete. 2024-04-25T09:14:48.294 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T09:14:48.295 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:14:48.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.448+0000 7fb462c00640 1 Processor -- start 2024-04-25T09:14:48.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.448+0000 7fb462c00640 1 -- start start 2024-04-25T09:14:48.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.448+0000 7fb462c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb45c0cc7e0 0x7fb45c0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.448+0000 7fb462c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb45c0aef70 0x7fb45c0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.448+0000 7fb462c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45c071570 con 0x7fb45c0aeb90 2024-04-25T09:14:48.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.448+0000 7fb462c00640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45c071320 con 0x7fb45c0aef70 2024-04-25T09:14:48.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.448+0000 7fb462c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45c072330 con 0x7fb45c0cc7e0 2024-04-25T09:14:48.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.452+0000 7fb460c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb45c0aef70 0x7fb45c0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.452+0000 7fb460c00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb45c0aef70 0x7fb45c0ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44422/0 (socket says 172.21.15.173:44422) 2024-04-25T09:14:48.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.452+0000 7fb460c00640 1 -- 172.21.15.173:0/3523003907 learned_addr learned my addr 172.21.15.173:0/3523003907 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:48.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.452+0000 7fb45be00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fb45c0aeb90 0x7fb45c0cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44546/0 (socket says 172.21.15.173:44546) 2024-04-25T09:14:48.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.452+0000 7fb45b400640 1 --2- 172.21.15.173:0/3523003907 >> v2:172.21.15.194:3300/0 conn(0x7fb45c0cc7e0 0x7fb45c0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.452+0000 7fb460c00640 1 -- 172.21.15.173:0/3523003907 >> v2:172.21.15.194:3300/0 conn(0x7fb45c0cc7e0 msgr2=0x7fb45c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:48.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.452+0000 7fb460c00640 1 --2- 172.21.15.173:0/3523003907 >> v2:172.21.15.194:3300/0 conn(0x7fb45c0cc7e0 0x7fb45c0cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.452+0000 7fb460c00640 1 -- 172.21.15.173:0/3523003907 >> v1:172.21.15.173:6789/0 conn(0x7fb45c0aeb90 legacy=0x7fb45c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.452+0000 7fb460c00640 1 -- 172.21.15.173:0/3523003907 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c071850 con 0x7fb45c0aef70 2024-04-25T09:14:48.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.452+0000 7fb45aa00640 1 -- 172.21.15.173:0/3523003907 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092811895 0 0) 0x7fb45c071570 con 0x7fb45c0aeb90 2024-04-25T09:14:48.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.452+0000 7fb460c00640 1 --2- 172.21.15.173:0/3523003907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb45c0aef70 0x7fb45c0ce0e0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0cd960 tx=0x7fb45401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e31556818f8a156 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:48.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.452+0000 7fb45aa00640 1 -- 172.21.15.173:0/3523003907 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4540b0070 con 0x7fb45c0aef70 2024-04-25T09:14:48.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.452+0000 7fb45aa00640 1 -- 172.21.15.173:0/3523003907 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4540ab600 con 0x7fb45c0aef70 2024-04-25T09:14:48.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.452+0000 7fb45aa00640 1 -- 172.21.15.173:0/3523003907 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4540ab9d0 con 0x7fb45c0aef70 2024-04-25T09:14:48.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb462c00640 1 -- 172.21.15.173:0/3523003907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb45c0aef70 msgr2=0x7fb45c0ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb462c00640 1 --2- 172.21.15.173:0/3523003907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb45c0aef70 0x7fb45c0ce0e0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0cd960 tx=0x7fb45401c490 comp rx=0 tx=0).stop 2024-04-25T09:14:48.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb462c00640 1 -- 172.21.15.173:0/3523003907 shutdown_connections 2024-04-25T09:14:48.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb462c00640 1 --2- 172.21.15.173:0/3523003907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb45c0aef70 0x7fb45c0ce0e0 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb462c00640 1 --2- 172.21.15.173:0/3523003907 >> v2:172.21.15.194:3300/0 conn(0x7fb45c0cc7e0 0x7fb45c0cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb462c00640 1 -- 172.21.15.173:0/3523003907 >> 172.21.15.173:0/3523003907 conn(0x7fb45c06ac90 msgr2=0x7fb45c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:48.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb462c00640 1 -- 172.21.15.173:0/3523003907 shutdown_connections 2024-04-25T09:14:48.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb462c00640 1 -- 172.21.15.173:0/3523003907 wait complete. 2024-04-25T09:14:48.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb462c00640 1 Processor -- start 2024-04-25T09:14:48.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb462c00640 1 -- start start 2024-04-25T09:14:48.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb462c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb45c0aeb90 0x7fb45c13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb462c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb45c0aef70 0x7fb45c14ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb462c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb45c0cc7e0 0x7fb45c1f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb462c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c15bb30 con 0x7fb45c0aef70 2024-04-25T09:14:48.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb462c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c15b9b0 con 0x7fb45c0cc7e0 2024-04-25T09:14:48.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb462c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c15bcb0 con 0x7fb45c0aeb90 2024-04-25T09:14:48.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb45b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb45c0aef70 0x7fb45c14ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb45b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb45c0aef70 0x7fb45c14ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44430/0 (socket says 172.21.15.173:44430) 2024-04-25T09:14:48.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb45b400640 1 -- 172.21.15.173:0/2525080025 learned_addr learned my addr 172.21.15.173:0/2525080025 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:48.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb45be00640 1 --2- 172.21.15.173:0/2525080025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb45c0aeb90 0x7fb45c13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb460c00640 1 --2- 172.21.15.173:0/2525080025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb45c0cc7e0 0x7fb45c1f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb45b400640 1 -- 172.21.15.173:0/2525080025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb45c0aeb90 msgr2=0x7fb45c13b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb45b400640 1 --2- 172.21.15.173:0/2525080025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb45c0aeb90 0x7fb45c13b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb45b400640 1 -- 172.21.15.173:0/2525080025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb45c0cc7e0 msgr2=0x7fb45c1f5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb45b400640 1 --2- 172.21.15.173:0/2525080025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb45c0cc7e0 0x7fb45c1f5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb45b400640 1 -- 172.21.15.173:0/2525080025 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c14b3c0 con 0x7fb45c0aef70 2024-04-25T09:14:48.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.456+0000 7fb460c00640 1 --2- 172.21.15.173:0/2525080025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb45c0cc7e0 0x7fb45c1f5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:48.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.460+0000 7fb45b400640 1 --2- 172.21.15.173:0/2525080025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb45c0aef70 0x7fb45c14ae80 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7fb44800d800 tx=0x7fb44800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:48.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.460+0000 7fb453e00640 1 -- 172.21.15.173:0/2525080025 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44800b6c0 con 0x7fb45c0aef70 2024-04-25T09:14:48.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.460+0000 7fb453e00640 1 -- 172.21.15.173:0/2525080025 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb448019070 con 0x7fb45c0aef70 2024-04-25T09:14:48.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.460+0000 7fb462c00640 1 -- 172.21.15.173:0/2525080025 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c14b690 con 0x7fb45c0aef70 2024-04-25T09:14:48.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.460+0000 7fb453e00640 1 -- 172.21.15.173:0/2525080025 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44800ba60 con 0x7fb45c0aef70 2024-04-25T09:14:48.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.460+0000 7fb462c00640 1 -- 172.21.15.173:0/2525080025 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c14bc50 con 0x7fb45c0aef70 2024-04-25T09:14:48.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.460+0000 7fb462c00640 1 -- 172.21.15.173:0/2525080025 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb45c073ab0 con 0x7fb45c0aef70 2024-04-25T09:14:48.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.460+0000 7fb453e00640 1 -- 172.21.15.173:0/2525080025 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb44800bc00 con 0x7fb45c0aef70 2024-04-25T09:14:48.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.460+0000 7fb453e00640 1 --2- 172.21.15.173:0/2525080025 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb43c066f60 0x7fb43c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.460+0000 7fb453e00640 1 -- 172.21.15.173:0/2525080025 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fb448085dc0 con 0x7fb45c0aef70 2024-04-25T09:14:48.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.460+0000 7fb453e00640 1 --2- 172.21.15.173:0/2525080025 >> [v2:172.21.15.194:6824/2953817121,v1:172.21.15.194:6825/2953817121] conn(0x7fb43c06d400 0x7fb43c06f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.460+0000 7fb45be00640 1 --2- 172.21.15.173:0/2525080025 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb43c066f60 0x7fb43c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.460+0000 7fb453e00640 1 -- 172.21.15.173:0/2525080025 --> [v2:172.21.15.194:6824/2953817121,v1:172.21.15.194:6825/2953817121] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb43c06ff10 con 0x7fb43c06d400 2024-04-25T09:14:48.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.460+0000 7fb453e00640 1 -- 172.21.15.173:0/2525080025 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=149) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb448086170 con 0x7fb45c0aef70 2024-04-25T09:14:48.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.460+0000 7fb45be00640 1 --2- 172.21.15.173:0/2525080025 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb43c066f60 0x7fb43c069420 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb44c005fd0 tx=0x7fb44c005b80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:48.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.460+0000 7fb460c00640 1 --2- 172.21.15.173:0/2525080025 >> [v2:172.21.15.194:6824/2953817121,v1:172.21.15.194:6825/2953817121] conn(0x7fb43c06d400 0x7fb43c06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.464+0000 7fb460c00640 1 --2- 172.21.15.173:0/2525080025 >> [v2:172.21.15.194:6824/2953817121,v1:172.21.15.194:6825/2953817121] conn(0x7fb43c06d400 0x7fb43c06f840 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:48.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.464+0000 7fb453e00640 1 -- 172.21.15.173:0/2525080025 <== osd.6 v2:172.21.15.194:6824/2953817121 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb43c06ff10 con 0x7fb43c06d400 2024-04-25T09:14:48.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.476+0000 7fb462c00640 1 -- 172.21.15.173:0/2525080025 --> [v2:172.21.15.194:6824/2953817121,v1:172.21.15.194:6825/2953817121] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb45c0ac9f0 con 0x7fb43c06d400 2024-04-25T09:14:48.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.476+0000 7fb453e00640 1 -- 172.21.15.173:0/2525080025 <== osd.6 v2:172.21.15.194:6824/2953817121 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb45c0ac9f0 con 0x7fb43c06d400 2024-04-25T09:14:48.462 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:14:48.462 INFO:teuthology.orchestra.run.smithi173.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:14:48.462 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:14:48.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.476+0000 7fb462c00640 1 -- 172.21.15.173:0/2525080025 >> [v2:172.21.15.194:6824/2953817121,v1:172.21.15.194:6825/2953817121] conn(0x7fb43c06d400 msgr2=0x7fb43c06f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.476+0000 7fb462c00640 1 --2- 172.21.15.173:0/2525080025 >> [v2:172.21.15.194:6824/2953817121,v1:172.21.15.194:6825/2953817121] conn(0x7fb43c06d400 0x7fb43c06f840 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.476+0000 7fb462c00640 1 -- 172.21.15.173:0/2525080025 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb43c066f60 msgr2=0x7fb43c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.476+0000 7fb462c00640 1 --2- 172.21.15.173:0/2525080025 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb43c066f60 0x7fb43c069420 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb44c005fd0 tx=0x7fb44c005b80 comp rx=0 tx=0).stop 2024-04-25T09:14:48.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.476+0000 7fb462c00640 1 -- 172.21.15.173:0/2525080025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb45c0aef70 msgr2=0x7fb45c14ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.476+0000 7fb462c00640 1 --2- 172.21.15.173:0/2525080025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb45c0aef70 0x7fb45c14ae80 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7fb44800d800 tx=0x7fb44800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.476+0000 7fb460c00640 1 -- 172.21.15.173:0/2525080025 reap_dead start 2024-04-25T09:14:48.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.476+0000 7fb462c00640 1 -- 172.21.15.173:0/2525080025 shutdown_connections 2024-04-25T09:14:48.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.476+0000 7fb462c00640 1 -- 172.21.15.173:0/2525080025 >> 172.21.15.173:0/2525080025 conn(0x7fb45c06ac90 msgr2=0x7fb45c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:48.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.476+0000 7fb462c00640 1 -- 172.21.15.173:0/2525080025 shutdown_connections 2024-04-25T09:14:48.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.476+0000 7fb462c00640 1 -- 172.21.15.173:0/2525080025 wait complete. 2024-04-25T09:14:48.480 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T09:14:48.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.632+0000 7f509e800640 1 Processor -- start 2024-04-25T09:14:48.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.632+0000 7f509e800640 1 -- start start 2024-04-25T09:14:48.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f509e800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f509815dbc0 0x7f5098099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f509e800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50980b1040 con 0x7f5098099f90 2024-04-25T09:14:48.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f509e800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509806cab0 con 0x7f509806c4b0 2024-04-25T09:14:48.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f509e800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50980cfce0 con 0x7f509815dbc0 2024-04-25T09:14:48.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f509ca00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f5098099f90 0x7f509806bda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44550/0 (socket says 172.21.15.173:44550) 2024-04-25T09:14:48.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f509ca00640 1 -- 172.21.15.173:0/671892986 learned_addr learned my addr 172.21.15.173:0/671892986 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:48.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f509d400640 1 --2- 172.21.15.173:0/671892986 >> v2:172.21.15.194:3300/0 conn(0x7f509815dbc0 0x7f5098099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f5097e00640 1 -- 172.21.15.173:0/671892986 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579102131 0 0) 0x7f5084001120 con 0x7f5098099f90 2024-04-25T09:14:48.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f5097e00640 1 -- 172.21.15.173:0/671892986 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5080003530 con 0x7f5098099f90 2024-04-25T09:14:48.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f5097e00640 1 -- 172.21.15.173:0/671892986 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1103949059 0 0) 0x7f5080003530 con 0x7f5098099f90 2024-04-25T09:14:48.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f5097e00640 1 -- 172.21.15.173:0/671892986 >> v2:172.21.15.194:3300/0 conn(0x7f509815dbc0 msgr2=0x7f5098099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:48.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f5097e00640 1 --2- 172.21.15.173:0/671892986 >> v2:172.21.15.194:3300/0 conn(0x7f509815dbc0 0x7f5098099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f5097e00640 1 -- 172.21.15.173:0/671892986 >> v1:172.21.15.194:6789/0 conn(0x7f509806c4b0 legacy=0x7f50980d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f5097e00640 1 -- 172.21.15.173:0/671892986 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509806cd90 con 0x7f5098099f90 2024-04-25T09:14:48.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f5097e00640 1 -- 172.21.15.173:0/671892986 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7f5084001850 con 0x7f5098099f90 2024-04-25T09:14:48.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f5097e00640 1 -- 172.21.15.173:0/671892986 >> v1:172.21.15.173:6789/0 conn(0x7f5098099f90 legacy=0x7f509806bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f5097e00640 1 --2- 172.21.15.173:0/671892986 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50800039c0 0x7f5080003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f5097e00640 1 --2- 172.21.15.173:0/671892986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5080004810 0x7f5080004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f5097e00640 1 --2- 172.21.15.173:0/671892986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50800051d0 0x7f508000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f5097e00640 1 -- 172.21.15.173:0/671892986 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50980cfce0 con 0x7f50800051d0 2024-04-25T09:14:48.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f5097e00640 1 -- 172.21.15.173:0/671892986 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508000c070 con 0x7f5080004810 2024-04-25T09:14:48.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f5097e00640 1 -- 172.21.15.173:0/671892986 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508000c270 con 0x7f50800039c0 2024-04-25T09:14:48.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f509de00640 1 --2- 172.21.15.173:0/671892986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50800051d0 0x7f508000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f509d400640 1 --2- 172.21.15.173:0/671892986 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50800039c0 0x7f5080003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f509ca00640 1 --2- 172.21.15.173:0/671892986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5080004810 0x7f5080004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f509de00640 1 -- 172.21.15.173:0/671892986 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50800039c0 msgr2=0x7f5080003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:48.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f509de00640 1 --2- 172.21.15.173:0/671892986 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50800039c0 0x7f5080003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f509de00640 1 -- 172.21.15.173:0/671892986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5080004810 msgr2=0x7f5080004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:48.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f509de00640 1 --2- 172.21.15.173:0/671892986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5080004810 0x7f5080004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.636+0000 7f509de00640 1 -- 172.21.15.173:0/671892986 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5080003530 con 0x7f50800051d0 2024-04-25T09:14:48.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.640+0000 7f509de00640 1 -- 172.21.15.173:0/671892986 reap_dead start 2024-04-25T09:14:48.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.640+0000 7f509de00640 1 --2- 172.21.15.173:0/671892986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50800051d0 0x7f508000b9d0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f5090001e70 tx=0x7f509001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bd909f55ced983 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:48.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.640+0000 7f5097e00640 1 -- 172.21.15.173:0/671892986 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090001a90 con 0x7f50800051d0 2024-04-25T09:14:48.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.640+0000 7f5097e00640 1 -- 172.21.15.173:0/671892986 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5090003bc0 con 0x7f50800051d0 2024-04-25T09:14:48.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.640+0000 7f5097e00640 1 -- 172.21.15.173:0/671892986 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090005020 con 0x7f50800051d0 2024-04-25T09:14:48.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.640+0000 7f509e800640 1 -- 172.21.15.173:0/671892986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50800051d0 msgr2=0x7f508000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.640+0000 7f509e800640 1 --2- 172.21.15.173:0/671892986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50800051d0 0x7f508000b9d0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f5090001e70 tx=0x7f509001c780 comp rx=0 tx=0).stop 2024-04-25T09:14:48.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.640+0000 7f509e800640 1 -- 172.21.15.173:0/671892986 shutdown_connections 2024-04-25T09:14:48.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.640+0000 7f509e800640 1 --2- 172.21.15.173:0/671892986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50800051d0 0x7f508000b9d0 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.640+0000 7f509e800640 1 -- 172.21.15.173:0/671892986 >> 172.21.15.173:0/671892986 conn(0x7f50980b31d0 msgr2=0x7f50980b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:48.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.640+0000 7f509e800640 1 -- 172.21.15.173:0/671892986 shutdown_connections 2024-04-25T09:14:48.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.640+0000 7f509e800640 1 -- 172.21.15.173:0/671892986 wait complete. 2024-04-25T09:14:48.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509e800640 1 Processor -- start 2024-04-25T09:14:48.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509e800640 1 -- start start 2024-04-25T09:14:48.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509e800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50800051d0 0x7f509815bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509e800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50980c5210 0x7f50980b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50980c5690 0x7f50980b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509e800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509806c900 con 0x7f50980c5690 2024-04-25T09:14:48.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509e800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509809a3d0 con 0x7f50980c5210 2024-04-25T09:14:48.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509e800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50980cf920 con 0x7f50800051d0 2024-04-25T09:14:48.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50980c5690 0x7f50980b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509de00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50980c5690 0x7f50980b5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44458/0 (socket says 172.21.15.173:44458) 2024-04-25T09:14:48.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509de00640 1 -- 172.21.15.173:0/3507873781 learned_addr learned my addr 172.21.15.173:0/3507873781 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:48.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509ca00640 1 --2- 172.21.15.173:0/3507873781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50980c5210 0x7f50980b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509d400640 1 --2- 172.21.15.173:0/3507873781 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50800051d0 0x7f509815bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509de00640 1 -- 172.21.15.173:0/3507873781 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50800051d0 msgr2=0x7f509815bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509de00640 1 --2- 172.21.15.173:0/3507873781 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50800051d0 0x7f509815bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509de00640 1 -- 172.21.15.173:0/3507873781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50980c5210 msgr2=0x7f50980b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509de00640 1 --2- 172.21.15.173:0/3507873781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50980c5210 0x7f50980b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509de00640 1 -- 172.21.15.173:0/3507873781 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50980c9840 con 0x7f50980c5690 2024-04-25T09:14:48.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509de00640 1 --2- 172.21.15.173:0/3507873781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50980c5690 0x7f50980b5ac0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f509001c5b0 tx=0x7f5080005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:48.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f5095600640 1 -- 172.21.15.173:0/3507873781 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090007dc0 con 0x7f50980c5690 2024-04-25T09:14:48.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f5095600640 1 -- 172.21.15.173:0/3507873781 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5090003980 con 0x7f50980c5690 2024-04-25T09:14:48.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f5095600640 1 -- 172.21.15.173:0/3507873781 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090006dc0 con 0x7f50980c5690 2024-04-25T09:14:48.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509e800640 1 -- 172.21.15.173:0/3507873781 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50980b60f0 con 0x7f50980c5690 2024-04-25T09:14:48.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509e800640 1 -- 172.21.15.173:0/3507873781 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50980c9ae0 con 0x7f50980c5690 2024-04-25T09:14:48.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.644+0000 7f509e800640 1 -- 172.21.15.173:0/3507873781 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5098073a40 con 0x7f50980c5690 2024-04-25T09:14:48.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.648+0000 7f5095600640 1 -- 172.21.15.173:0/3507873781 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f50900a6480 con 0x7f50980c5690 2024-04-25T09:14:48.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.648+0000 7f5095600640 1 --2- 172.21.15.173:0/3507873781 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5078066f60 0x7f5078069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.648+0000 7f5095600640 1 -- 172.21.15.173:0/3507873781 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f509011e500 con 0x7f50980c5690 2024-04-25T09:14:48.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.648+0000 7f509d400640 1 --2- 172.21.15.173:0/3507873781 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5078066f60 0x7f5078069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.648+0000 7f509d400640 1 --2- 172.21.15.173:0/3507873781 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5078066f60 0x7f5078069420 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f508c0099b0 tx=0x7f508c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:48.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.652+0000 7f5095600640 1 -- 172.21.15.173:0/3507873781 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f50900b9030 con 0x7f50980c5690 2024-04-25T09:14:48.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.808+0000 7f509e800640 1 -- 172.21.15.173:0/3507873781 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f50980b4030 con 0x7f5078066f60 2024-04-25T09:14:48.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.808+0000 7f5095600640 1 -- 172.21.15.173:0/3507873781 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f50980b4030 con 0x7f5078066f60 2024-04-25T09:14:48.794 INFO:teuthology.orchestra.run.smithi173.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T09:14:48.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.812+0000 7f509e800640 1 -- 172.21.15.173:0/3507873781 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5078066f60 msgr2=0x7f5078069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.812+0000 7f509e800640 1 --2- 172.21.15.173:0/3507873781 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5078066f60 0x7f5078069420 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f508c0099b0 tx=0x7f508c008040 comp rx=0 tx=0).stop 2024-04-25T09:14:48.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.812+0000 7f509e800640 1 -- 172.21.15.173:0/3507873781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50980c5690 msgr2=0x7f50980b5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.812+0000 7f509e800640 1 --2- 172.21.15.173:0/3507873781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50980c5690 0x7f50980b5ac0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f509001c5b0 tx=0x7f5080005840 comp rx=0 tx=0).stop 2024-04-25T09:14:48.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.812+0000 7f509e800640 1 -- 172.21.15.173:0/3507873781 shutdown_connections 2024-04-25T09:14:48.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.812+0000 7f509e800640 1 --2- 172.21.15.173:0/3507873781 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f5078066f60 0x7f5078069420 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.812+0000 7f509e800640 1 --2- 172.21.15.173:0/3507873781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50980c5690 0x7f50980b5ac0 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.812+0000 7f509e800640 1 --2- 172.21.15.173:0/3507873781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50980c5210 0x7f50980b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.812+0000 7f509e800640 1 --2- 172.21.15.173:0/3507873781 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50800051d0 0x7f509815bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.812+0000 7f509e800640 1 -- 172.21.15.173:0/3507873781 >> 172.21.15.173:0/3507873781 conn(0x7f50980b31d0 msgr2=0x7f509815c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:48.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.812+0000 7f509e800640 1 -- 172.21.15.173:0/3507873781 shutdown_connections 2024-04-25T09:14:48.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.812+0000 7f509e800640 1 -- 172.21.15.173:0/3507873781 wait complete. 2024-04-25T09:14:48.816 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T09:14:48.817 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:14:48.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.972+0000 7f8b73600640 1 Processor -- start 2024-04-25T09:14:48.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.972+0000 7f8b73600640 1 -- start start 2024-04-25T09:14:48.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.976+0000 7f8b73600640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8b6c0ad5c0 0x7f8b6c1687d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.976+0000 7f8b73600640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6c06fa20 con 0x7f8b6c06e1c0 2024-04-25T09:14:48.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.976+0000 7f8b73600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6c06ae30 con 0x7f8b6c06f5b0 2024-04-25T09:14:48.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.976+0000 7f8b73600640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b6c0b3170 con 0x7f8b6c0ad5c0 2024-04-25T09:14:48.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.976+0000 7f8b70c00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f8b6c06e1c0 0x7f8b6c06bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44556/0 (socket says 172.21.15.173:44556) 2024-04-25T09:14:48.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.976+0000 7f8b70c00640 1 -- 172.21.15.173:0/1194361148 learned_addr learned my addr 172.21.15.173:0/1194361148 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:48.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.976+0000 7f8b71600640 1 --2- 172.21.15.173:0/1194361148 >> v2:172.21.15.173:3300/0 conn(0x7f8b6c0ad5c0 0x7f8b6c1687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.976+0000 7f8b71600640 1 -- 172.21.15.173:0/1194361148 >> v1:172.21.15.194:6789/0 conn(0x7f8b6c06f5b0 legacy=0x7f8b6c0aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.976+0000 7f8b71600640 1 -- 172.21.15.173:0/1194361148 >> v1:172.21.15.173:6789/0 conn(0x7f8b6c06e1c0 legacy=0x7f8b6c06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.976+0000 7f8b71600640 1 -- 172.21.15.173:0/1194361148 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c06b110 con 0x7f8b6c0ad5c0 2024-04-25T09:14:48.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.980+0000 7f8b71600640 1 --2- 172.21.15.173:0/1194361148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6c0ad5c0 0x7f8b6c1687d0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009d90 tx=0x7f8b6401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13576db75491eda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:48.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.980+0000 7f8b6b400640 1 -- 172.21.15.173:0/1194361148 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b640b4070 con 0x7f8b6c0ad5c0 2024-04-25T09:14:48.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.980+0000 7f8b6b400640 1 -- 172.21.15.173:0/1194361148 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b640af600 con 0x7f8b6c0ad5c0 2024-04-25T09:14:48.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.980+0000 7f8b6b400640 1 -- 172.21.15.173:0/1194361148 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b640af9d0 con 0x7f8b6c0ad5c0 2024-04-25T09:14:48.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.980+0000 7f8b73600640 1 -- 172.21.15.173:0/1194361148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6c0ad5c0 msgr2=0x7f8b6c1687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.980+0000 7f8b73600640 1 --2- 172.21.15.173:0/1194361148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6c0ad5c0 0x7f8b6c1687d0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009d90 tx=0x7f8b6401f150 comp rx=0 tx=0).stop 2024-04-25T09:14:48.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.980+0000 7f8b73600640 1 -- 172.21.15.173:0/1194361148 shutdown_connections 2024-04-25T09:14:48.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.980+0000 7f8b73600640 1 --2- 172.21.15.173:0/1194361148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6c0ad5c0 0x7f8b6c1687d0 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.980+0000 7f8b73600640 1 -- 172.21.15.173:0/1194361148 >> 172.21.15.173:0/1194361148 conn(0x7f8b6c0cfed0 msgr2=0x7f8b6c0d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:48.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.980+0000 7f8b73600640 1 -- 172.21.15.173:0/1194361148 shutdown_connections 2024-04-25T09:14:48.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.980+0000 7f8b73600640 1 -- 172.21.15.173:0/1194361148 wait complete. 2024-04-25T09:14:48.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.980+0000 7f8b73600640 1 Processor -- start 2024-04-25T09:14:48.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.980+0000 7f8b73600640 1 -- start start 2024-04-25T09:14:48.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b73600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6c06e1c0 0x7f8b6c1f7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b73600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b6c06f5b0 0x7f8b6c14a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b73600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b6c0ad5c0 0x7f8b6c0adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b73600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c06b6d0 con 0x7f8b6c06e1c0 2024-04-25T09:14:48.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b73600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c15e070 con 0x7f8b6c0ad5c0 2024-04-25T09:14:48.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b73600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c06b9b0 con 0x7f8b6c06f5b0 2024-04-25T09:14:48.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b70c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6c06e1c0 0x7f8b6c1f7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b70c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6c06e1c0 0x7f8b6c1f7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44482/0 (socket says 172.21.15.173:44482) 2024-04-25T09:14:48.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b70c00640 1 -- 172.21.15.173:0/3833159101 learned_addr learned my addr 172.21.15.173:0/3833159101 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:48.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b71600640 1 --2- 172.21.15.173:0/3833159101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b6c0ad5c0 0x7f8b6c0adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b6be00640 1 --2- 172.21.15.173:0/3833159101 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b6c06f5b0 0x7f8b6c14a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b70c00640 1 -- 172.21.15.173:0/3833159101 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b6c06f5b0 msgr2=0x7f8b6c14a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b70c00640 1 --2- 172.21.15.173:0/3833159101 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b6c06f5b0 0x7f8b6c14a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b70c00640 1 -- 172.21.15.173:0/3833159101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b6c0ad5c0 msgr2=0x7f8b6c0adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b70c00640 1 --2- 172.21.15.173:0/3833159101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b6c0ad5c0 0x7f8b6c0adfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b70c00640 1 -- 172.21.15.173:0/3833159101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c14f560 con 0x7f8b6c06e1c0 2024-04-25T09:14:48.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b71600640 1 --2- 172.21.15.173:0/3833159101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b6c0ad5c0 0x7f8b6c0adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:48.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b70c00640 1 --2- 172.21.15.173:0/3833159101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6c06e1c0 0x7f8b6c1f7ac0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00c500 tx=0x7f8b5c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:48.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b68c00640 1 -- 172.21.15.173:0/3833159101 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c017070 con 0x7f8b6c06e1c0 2024-04-25T09:14:48.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b68c00640 1 -- 172.21.15.173:0/3833159101 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5c005cf0 con 0x7f8b6c06e1c0 2024-04-25T09:14:48.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b68c00640 1 -- 172.21.15.173:0/3833159101 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c0072f0 con 0x7f8b6c06e1c0 2024-04-25T09:14:48.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b73600640 1 -- 172.21.15.173:0/3833159101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6c14f840 con 0x7f8b6c06e1c0 2024-04-25T09:14:48.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b73600640 1 -- 172.21.15.173:0/3833159101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6c155020 con 0x7f8b6c06e1c0 2024-04-25T09:14:48.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b73600640 1 -- 172.21.15.173:0/3833159101 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8b6c073ab0 con 0x7f8b6c06e1c0 2024-04-25T09:14:48.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.984+0000 7f8b68c00640 1 -- 172.21.15.173:0/3833159101 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8b5c01a070 con 0x7f8b6c06e1c0 2024-04-25T09:14:48.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.988+0000 7f8b68c00640 1 --2- 172.21.15.173:0/3833159101 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8b48066f60 0x7f8b48069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.988+0000 7f8b68c00640 1 -- 172.21.15.173:0/3833159101 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f8b5c0841e0 con 0x7f8b6c06e1c0 2024-04-25T09:14:48.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.988+0000 7f8b6be00640 1 --2- 172.21.15.173:0/3833159101 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8b48066f60 0x7f8b48069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.988+0000 7f8b68c00640 1 --2- 172.21.15.173:0/3833159101 >> [v2:172.21.15.194:6816/1567729259,v1:172.21.15.194:6817/1567729259] conn(0x7f8b4806d400 0x7f8b4806f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.988+0000 7f8b68c00640 1 -- 172.21.15.173:0/3833159101 --> [v2:172.21.15.194:6816/1567729259,v1:172.21.15.194:6817/1567729259] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b5c016ec0 con 0x7f8b4806d400 2024-04-25T09:14:48.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.988+0000 7f8b68c00640 1 -- 172.21.15.173:0/3833159101 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=149) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b5c08b050 con 0x7f8b6c06e1c0 2024-04-25T09:14:48.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.988+0000 7f8b6be00640 1 --2- 172.21.15.173:0/3833159101 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8b48066f60 0x7f8b48069420 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c1f7010 tx=0x7f8b54009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:48.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.988+0000 7f8b71600640 1 --2- 172.21.15.173:0/3833159101 >> [v2:172.21.15.194:6816/1567729259,v1:172.21.15.194:6817/1567729259] conn(0x7f8b4806d400 0x7f8b4806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.988+0000 7f8b71600640 1 --2- 172.21.15.173:0/3833159101 >> [v2:172.21.15.194:6816/1567729259,v1:172.21.15.194:6817/1567729259] conn(0x7f8b4806d400 0x7f8b4806f840 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:48.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:48.988+0000 7f8b68c00640 1 -- 172.21.15.173:0/3833159101 <== osd.7 v2:172.21.15.194:6816/1567729259 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8b5c016ec0 con 0x7f8b4806d400 2024-04-25T09:14:48.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.000+0000 7f8b73600640 1 -- 172.21.15.173:0/3833159101 --> [v2:172.21.15.194:6816/1567729259,v1:172.21.15.194:6817/1567729259] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8b6c06c620 con 0x7f8b4806d400 2024-04-25T09:14:48.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.004+0000 7f8b68c00640 1 -- 172.21.15.173:0/3833159101 <== osd.7 v2:172.21.15.194:6816/1567729259 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8b6c06c620 con 0x7f8b4806d400 2024-04-25T09:14:48.988 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-25T09:14:48.989 INFO:teuthology.orchestra.run.smithi173.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:14:48.989 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-25T09:14:48.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.004+0000 7f8b73600640 1 -- 172.21.15.173:0/3833159101 >> [v2:172.21.15.194:6816/1567729259,v1:172.21.15.194:6817/1567729259] conn(0x7f8b4806d400 msgr2=0x7f8b4806f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.004+0000 7f8b73600640 1 --2- 172.21.15.173:0/3833159101 >> [v2:172.21.15.194:6816/1567729259,v1:172.21.15.194:6817/1567729259] conn(0x7f8b4806d400 0x7f8b4806f840 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.004+0000 7f8b73600640 1 -- 172.21.15.173:0/3833159101 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8b48066f60 msgr2=0x7f8b48069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.004+0000 7f8b73600640 1 --2- 172.21.15.173:0/3833159101 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f8b48066f60 0x7f8b48069420 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c1f7010 tx=0x7f8b54009040 comp rx=0 tx=0).stop 2024-04-25T09:14:48.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.004+0000 7f8b73600640 1 -- 172.21.15.173:0/3833159101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6c06e1c0 msgr2=0x7f8b6c1f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.004+0000 7f8b73600640 1 --2- 172.21.15.173:0/3833159101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b6c06e1c0 0x7f8b6c1f7ac0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00c500 tx=0x7f8b5c00c9c0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.004+0000 7f8b71600640 1 -- 172.21.15.173:0/3833159101 reap_dead start 2024-04-25T09:14:48.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.004+0000 7f8b73600640 1 -- 172.21.15.173:0/3833159101 shutdown_connections 2024-04-25T09:14:48.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.004+0000 7f8b73600640 1 -- 172.21.15.173:0/3833159101 >> 172.21.15.173:0/3833159101 conn(0x7f8b6c0cfed0 msgr2=0x7f8b6c0b35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:48.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.004+0000 7f8b73600640 1 -- 172.21.15.173:0/3833159101 shutdown_connections 2024-04-25T09:14:48.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.004+0000 7f8b73600640 1 -- 172.21.15.173:0/3833159101 wait complete. 2024-04-25T09:14:49.006 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T09:14:49.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.160+0000 7f22b6000640 1 Processor -- start 2024-04-25T09:14:49.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.160+0000 7f22b6000640 1 -- start start 2024-04-25T09:14:49.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.160+0000 7f22b6000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f22b00cc7e0 0x7f22b00cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.160+0000 7f22b6000640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f22b00aef70 0x7f22b00ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.160+0000 7f22b6000640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b0071570 con 0x7f22b00aeb90 2024-04-25T09:14:49.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.160+0000 7f22b6000640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b0071320 con 0x7f22b00aef70 2024-04-25T09:14:49.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.160+0000 7f22b6000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b0072330 con 0x7f22b00cc7e0 2024-04-25T09:14:49.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.160+0000 7f22afe00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f22b00aef70 0x7f22b00ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.160+0000 7f22af400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f22b00aeb90 0x7f22b00cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44560/0 (socket says 172.21.15.173:44560) 2024-04-25T09:14:49.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.160+0000 7f22af400640 1 -- 172.21.15.173:0/239055131 learned_addr learned my addr 172.21.15.173:0/239055131 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:49.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.160+0000 7f22a6a00640 1 --2- 172.21.15.173:0/239055131 >> v2:172.21.15.194:3300/0 conn(0x7f22b00cc7e0 0x7f22b00cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.160+0000 7f22afe00640 1 -- 172.21.15.173:0/239055131 >> v2:172.21.15.194:3300/0 conn(0x7f22b00cc7e0 msgr2=0x7f22b00cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:49.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.160+0000 7f22afe00640 1 --2- 172.21.15.173:0/239055131 >> v2:172.21.15.194:3300/0 conn(0x7f22b00cc7e0 0x7f22b00cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.160+0000 7f22afe00640 1 -- 172.21.15.173:0/239055131 >> v1:172.21.15.173:6789/0 conn(0x7f22b00aeb90 legacy=0x7f22b00cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.160+0000 7f22afe00640 1 -- 172.21.15.173:0/239055131 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b0071850 con 0x7f22b00aef70 2024-04-25T09:14:49.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.160+0000 7f22aea00640 1 -- 172.21.15.173:0/239055131 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326374715 0 0) 0x7f22b0071570 con 0x7f22b00aeb90 2024-04-25T09:14:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.164+0000 7f22afe00640 1 --2- 172.21.15.173:0/239055131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22b00aef70 0x7f22b00ce0e0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f22b00cd960 tx=0x7f22a801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d913bf65daad8bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.164+0000 7f22aea00640 1 -- 172.21.15.173:0/239055131 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a80b0070 con 0x7f22b00aef70 2024-04-25T09:14:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.164+0000 7f22aea00640 1 -- 172.21.15.173:0/239055131 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a80ab600 con 0x7f22b00aef70 2024-04-25T09:14:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.164+0000 7f22aea00640 1 -- 172.21.15.173:0/239055131 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a80ab9d0 con 0x7f22b00aef70 2024-04-25T09:14:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.164+0000 7f22b6000640 1 -- 172.21.15.173:0/239055131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22b00aef70 msgr2=0x7f22b00ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.164+0000 7f22b6000640 1 --2- 172.21.15.173:0/239055131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22b00aef70 0x7f22b00ce0e0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f22b00cd960 tx=0x7f22a801c3f0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.164+0000 7f22b6000640 1 -- 172.21.15.173:0/239055131 shutdown_connections 2024-04-25T09:14:49.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.164+0000 7f22b6000640 1 --2- 172.21.15.173:0/239055131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22b00aef70 0x7f22b00ce0e0 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.164+0000 7f22b6000640 1 --2- 172.21.15.173:0/239055131 >> v2:172.21.15.194:3300/0 conn(0x7f22b00cc7e0 0x7f22b00cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.164+0000 7f22b6000640 1 -- 172.21.15.173:0/239055131 >> 172.21.15.173:0/239055131 conn(0x7f22b006ac90 msgr2=0x7f22b006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:49.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.164+0000 7f22b6000640 1 -- 172.21.15.173:0/239055131 shutdown_connections 2024-04-25T09:14:49.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.164+0000 7f22b6000640 1 -- 172.21.15.173:0/239055131 wait complete. 2024-04-25T09:14:49.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.164+0000 7f22b6000640 1 Processor -- start 2024-04-25T09:14:49.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.164+0000 7f22b6000640 1 -- start start 2024-04-25T09:14:49.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22b6000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22b00aeb90 0x7f22b014bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22b6000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22b00aef70 0x7f22b01434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22b6000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22b00cc7e0 0x7f22b014d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22b6000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b015bb30 con 0x7f22b00cc7e0 2024-04-25T09:14:49.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22b6000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b015b9b0 con 0x7f22b00aef70 2024-04-25T09:14:49.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22b6000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b015bcb0 con 0x7f22b00aeb90 2024-04-25T09:14:49.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22afe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22b00cc7e0 0x7f22b014d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22afe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22b00cc7e0 0x7f22b014d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44502/0 (socket says 172.21.15.173:44502) 2024-04-25T09:14:49.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22afe00640 1 -- 172.21.15.173:0/4126586990 learned_addr learned my addr 172.21.15.173:0/4126586990 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:49.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22af400640 1 --2- 172.21.15.173:0/4126586990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22b00aeb90 0x7f22b014bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22a6a00640 1 --2- 172.21.15.173:0/4126586990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22b00aef70 0x7f22b01434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22afe00640 1 -- 172.21.15.173:0/4126586990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22b00aeb90 msgr2=0x7f22b014bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22afe00640 1 --2- 172.21.15.173:0/4126586990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22b00aeb90 0x7f22b014bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22afe00640 1 -- 172.21.15.173:0/4126586990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22b00aef70 msgr2=0x7f22b01434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22afe00640 1 --2- 172.21.15.173:0/4126586990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22b00aef70 0x7f22b01434a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22afe00640 1 -- 172.21.15.173:0/4126586990 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b014f1f0 con 0x7f22b00cc7e0 2024-04-25T09:14:49.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22a6a00640 1 --2- 172.21.15.173:0/4126586990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22b00aef70 0x7f22b01434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:49.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22afe00640 1 --2- 172.21.15.173:0/4126586990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22b00cc7e0 0x7f22b014d690 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7f22a80ae040 tx=0x7f22a801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:49.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22a7e00640 1 -- 172.21.15.173:0/4126586990 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a80b0050 con 0x7f22b00cc7e0 2024-04-25T09:14:49.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22a7e00640 1 -- 172.21.15.173:0/4126586990 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a80bc070 con 0x7f22b00cc7e0 2024-04-25T09:14:49.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22b6000640 1 -- 172.21.15.173:0/4126586990 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b014f4d0 con 0x7f22b00cc7e0 2024-04-25T09:14:49.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22a7e00640 1 -- 172.21.15.173:0/4126586990 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a80b5870 con 0x7f22b00cc7e0 2024-04-25T09:14:49.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22b6000640 1 -- 172.21.15.173:0/4126586990 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b01439e0 con 0x7f22b00cc7e0 2024-04-25T09:14:49.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22b6000640 1 -- 172.21.15.173:0/4126586990 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b0073ab0 con 0x7f22b00cc7e0 2024-04-25T09:14:49.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.168+0000 7f22a7e00640 1 -- 172.21.15.173:0/4126586990 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f22a80b5a10 con 0x7f22b00cc7e0 2024-04-25T09:14:49.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.172+0000 7f22a7e00640 1 --2- 172.21.15.173:0/4126586990 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f228c066f60 0x7f228c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.172+0000 7f22a7e00640 1 -- 172.21.15.173:0/4126586990 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f22a811f810 con 0x7f22b00cc7e0 2024-04-25T09:14:49.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.172+0000 7f22af400640 1 --2- 172.21.15.173:0/4126586990 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f228c066f60 0x7f228c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.172+0000 7f22af400640 1 --2- 172.21.15.173:0/4126586990 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f228c066f60 0x7f228c069420 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f22a00012f0 tx=0x7f22a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:49.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.176+0000 7f22a7e00640 1 -- 172.21.15.173:0/4126586990 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f22a8016070 con 0x7f22b00cc7e0 2024-04-25T09:14:49.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.332+0000 7f22b6000640 1 -- 172.21.15.173:0/4126586990 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f22b006d9e0 con 0x7f228c066f60 2024-04-25T09:14:49.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.332+0000 7f22a7e00640 1 -- 172.21.15.173:0/4126586990 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f22b006d9e0 con 0x7f228c066f60 2024-04-25T09:14:49.317 INFO:teuthology.orchestra.run.smithi173.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T09:14:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.332+0000 7f22b6000640 1 -- 172.21.15.173:0/4126586990 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f228c066f60 msgr2=0x7f228c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.332+0000 7f22b6000640 1 --2- 172.21.15.173:0/4126586990 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f228c066f60 0x7f228c069420 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f22a00012f0 tx=0x7f22a0009040 comp rx=0 tx=0).stop 2024-04-25T09:14:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.332+0000 7f22b6000640 1 -- 172.21.15.173:0/4126586990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22b00cc7e0 msgr2=0x7f22b014d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.332+0000 7f22b6000640 1 --2- 172.21.15.173:0/4126586990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22b00cc7e0 0x7f22b014d690 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7f22a80ae040 tx=0x7f22a801ac30 comp rx=0 tx=0).stop 2024-04-25T09:14:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.332+0000 7f22b6000640 1 -- 172.21.15.173:0/4126586990 shutdown_connections 2024-04-25T09:14:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.332+0000 7f22b6000640 1 --2- 172.21.15.173:0/4126586990 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f228c066f60 0x7f228c069420 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.332+0000 7f22b6000640 1 --2- 172.21.15.173:0/4126586990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22b00cc7e0 0x7f22b014d690 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.332+0000 7f22b6000640 1 --2- 172.21.15.173:0/4126586990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22b00aef70 0x7f22b01434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.332+0000 7f22b6000640 1 --2- 172.21.15.173:0/4126586990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22b00aeb90 0x7f22b014bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.332+0000 7f22b6000640 1 -- 172.21.15.173:0/4126586990 >> 172.21.15.173:0/4126586990 conn(0x7f22b006ac90 msgr2=0x7f22b006dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:49.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.332+0000 7f22b6000640 1 -- 172.21.15.173:0/4126586990 shutdown_connections 2024-04-25T09:14:49.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.332+0000 7f22b6000640 1 -- 172.21.15.173:0/4126586990 wait complete. 2024-04-25T09:14:49.338 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:14:49.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.488+0000 7fb573e00640 1 Processor -- start 2024-04-25T09:14:49.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.488+0000 7fb573e00640 1 -- start start 2024-04-25T09:14:49.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.488+0000 7fb573e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb5740cef40 0x7fb5740cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.488+0000 7fb573e00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57415ac90 con 0x7fb57406e920 2024-04-25T09:14:49.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.488+0000 7fb573e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57415af70 con 0x7fb5740b2c80 2024-04-25T09:14:49.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.488+0000 7fb573e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57415b8a0 con 0x7fb5740cef40 2024-04-25T09:14:49.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb573400640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fb57406e920 0x7fb5740711e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44570/0 (socket says 172.21.15.173:44570) 2024-04-25T09:14:49.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb573400640 1 -- 172.21.15.173:0/896965654 learned_addr learned my addr 172.21.15.173:0/896965654 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:14:49.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb572a00640 1 --2- 172.21.15.173:0/896965654 >> v2:172.21.15.194:3300/0 conn(0x7fb5740cef40 0x7fb5740cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb572000640 1 -- 172.21.15.173:0/896965654 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097437818 0 0) 0x7fb57415ac90 con 0x7fb57406e920 2024-04-25T09:14:49.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb572000640 1 -- 172.21.15.173:0/896965654 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb558003530 con 0x7fb57406e920 2024-04-25T09:14:49.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb572000640 1 -- 172.21.15.173:0/896965654 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3527529849 0 0) 0x7fb558003530 con 0x7fb57406e920 2024-04-25T09:14:49.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb572000640 1 -- 172.21.15.173:0/896965654 >> v2:172.21.15.194:3300/0 conn(0x7fb5740cef40 msgr2=0x7fb5740cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:49.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb572000640 1 --2- 172.21.15.173:0/896965654 >> v2:172.21.15.194:3300/0 conn(0x7fb5740cef40 0x7fb5740cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb572000640 1 -- 172.21.15.173:0/896965654 >> v1:172.21.15.194:6789/0 conn(0x7fb5740b2c80 legacy=0x7fb57406e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb572000640 1 -- 172.21.15.173:0/896965654 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57415b250 con 0x7fb57406e920 2024-04-25T09:14:49.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb572000640 1 -- 172.21.15.173:0/896965654 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fb56c001680 con 0x7fb57406e920 2024-04-25T09:14:49.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb572000640 1 -- 172.21.15.173:0/896965654 >> v1:172.21.15.173:6789/0 conn(0x7fb57406e920 legacy=0x7fb5740711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb572000640 1 --2- 172.21.15.173:0/896965654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5580039c0 0x7fb558003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb572000640 1 --2- 172.21.15.173:0/896965654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb558004810 0x7fb558004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb572000640 1 --2- 172.21.15.173:0/896965654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5580051d0 0x7fb55800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb572000640 1 -- 172.21.15.173:0/896965654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57415b8a0 con 0x7fb5580051d0 2024-04-25T09:14:49.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb572000640 1 -- 172.21.15.173:0/896965654 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55800c070 con 0x7fb5580039c0 2024-04-25T09:14:49.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb572000640 1 -- 172.21.15.173:0/896965654 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55800c270 con 0x7fb558004810 2024-04-25T09:14:49.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb573400640 1 --2- 172.21.15.173:0/896965654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5580051d0 0x7fb55800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb572a00640 1 --2- 172.21.15.173:0/896965654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5580039c0 0x7fb558003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb56a000640 1 --2- 172.21.15.173:0/896965654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb558004810 0x7fb558004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb573400640 1 -- 172.21.15.173:0/896965654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb558004810 msgr2=0x7fb558004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:49.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb573400640 1 --2- 172.21.15.173:0/896965654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb558004810 0x7fb558004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb573400640 1 -- 172.21.15.173:0/896965654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5580039c0 msgr2=0x7fb558003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:49.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb573400640 1 --2- 172.21.15.173:0/896965654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5580039c0 0x7fb558003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.492+0000 7fb573400640 1 -- 172.21.15.173:0/896965654 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb558003530 con 0x7fb5580051d0 2024-04-25T09:14:49.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.496+0000 7fb573400640 1 -- 172.21.15.173:0/896965654 reap_dead start 2024-04-25T09:14:49.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.496+0000 7fb573400640 1 --2- 172.21.15.173:0/896965654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5580051d0 0x7fb55800b9d0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7fb574158670 tx=0x7fb56c01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1f189dbe9668a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:49.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.496+0000 7fb572000640 1 -- 172.21.15.173:0/896965654 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c007d00 con 0x7fb5580051d0 2024-04-25T09:14:49.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.496+0000 7fb572000640 1 -- 172.21.15.173:0/896965654 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56c0a9070 con 0x7fb5580051d0 2024-04-25T09:14:49.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.496+0000 7fb572000640 1 -- 172.21.15.173:0/896965654 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c0a5d60 con 0x7fb5580051d0 2024-04-25T09:14:49.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.496+0000 7fb573e00640 1 -- 172.21.15.173:0/896965654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5580051d0 msgr2=0x7fb55800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.496+0000 7fb573e00640 1 --2- 172.21.15.173:0/896965654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5580051d0 0x7fb55800b9d0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7fb574158670 tx=0x7fb56c01cc00 comp rx=0 tx=0).stop 2024-04-25T09:14:49.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.496+0000 7fb573e00640 1 -- 172.21.15.173:0/896965654 shutdown_connections 2024-04-25T09:14:49.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.496+0000 7fb573e00640 1 --2- 172.21.15.173:0/896965654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5580051d0 0x7fb55800b9d0 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.496+0000 7fb573e00640 1 -- 172.21.15.173:0/896965654 >> 172.21.15.173:0/896965654 conn(0x7fb57406ac90 msgr2=0x7fb57406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:49.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.496+0000 7fb573e00640 1 -- 172.21.15.173:0/896965654 shutdown_connections 2024-04-25T09:14:49.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.496+0000 7fb573e00640 1 -- 172.21.15.173:0/896965654 wait complete. 2024-04-25T09:14:49.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.496+0000 7fb573e00640 1 Processor -- start 2024-04-25T09:14:49.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.496+0000 7fb573e00640 1 -- start start 2024-04-25T09:14:49.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb573e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5580051d0 0x7fb574153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb573e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5740adb60 0x7fb574143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb573e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb574151a10 0x7fb574151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb573e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740cc3e0 con 0x7fb5580051d0 2024-04-25T09:14:49.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb573e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57415ab10 con 0x7fb574151a10 2024-04-25T09:14:49.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb573e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740cc6d0 con 0x7fb5740adb60 2024-04-25T09:14:49.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb572a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5580051d0 0x7fb574153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb572a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5580051d0 0x7fb574153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:44510/0 (socket says 172.21.15.173:44510) 2024-04-25T09:14:49.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb572a00640 1 -- 172.21.15.173:0/976926319 learned_addr learned my addr 172.21.15.173:0/976926319 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:14:49.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb573400640 1 --2- 172.21.15.173:0/976926319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb574151a10 0x7fb574151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb572a00640 1 -- 172.21.15.173:0/976926319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5740adb60 msgr2=0x7fb574143980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb572a00640 1 --2- 172.21.15.173:0/976926319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5740adb60 0x7fb574143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb572a00640 1 -- 172.21.15.173:0/976926319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb574151a10 msgr2=0x7fb574151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb572a00640 1 --2- 172.21.15.173:0/976926319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb574151a10 0x7fb574151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb572a00640 1 -- 172.21.15.173:0/976926319 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5740ae3d0 con 0x7fb5580051d0 2024-04-25T09:14:49.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb573400640 1 --2- 172.21.15.173:0/976926319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb574151a10 0x7fb574151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:49.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb572a00640 1 --2- 172.21.15.173:0/976926319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5580051d0 0x7fb574153b90 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7fb564009fc0 tx=0x7fb56400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:49.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb56b400640 1 -- 172.21.15.173:0/976926319 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56400fea0 con 0x7fb5580051d0 2024-04-25T09:14:49.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb56b400640 1 -- 172.21.15.173:0/976926319 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb564015630 con 0x7fb5580051d0 2024-04-25T09:14:49.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb56b400640 1 -- 172.21.15.173:0/976926319 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564015a20 con 0x7fb5580051d0 2024-04-25T09:14:49.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb573e00640 1 -- 172.21.15.173:0/976926319 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5740ae6b0 con 0x7fb5580051d0 2024-04-25T09:14:49.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb573e00640 1 -- 172.21.15.173:0/976926319 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5740aec70 con 0x7fb5580051d0 2024-04-25T09:14:49.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb573e00640 1 -- 172.21.15.173:0/976926319 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb574073a40 con 0x7fb5580051d0 2024-04-25T09:14:49.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.500+0000 7fb56b400640 1 -- 172.21.15.173:0/976926319 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb564015bc0 con 0x7fb5580051d0 2024-04-25T09:14:49.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.504+0000 7fb56b400640 1 --2- 172.21.15.173:0/976926319 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb550066f60 0x7fb550069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.504+0000 7fb56b400640 1 -- 172.21.15.173:0/976926319 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fb5640860e0 con 0x7fb5580051d0 2024-04-25T09:14:49.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.504+0000 7fb56a000640 1 --2- 172.21.15.173:0/976926319 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb550066f60 0x7fb550069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.504+0000 7fb56a000640 1 --2- 172.21.15.173:0/976926319 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb550066f60 0x7fb550069420 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb55c001060 tx=0x7fb55c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:49.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.508+0000 7fb56b400640 1 -- 172.21.15.173:0/976926319 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb564019030 con 0x7fb5580051d0 2024-04-25T09:14:49.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.660+0000 7fb573e00640 1 -- 172.21.15.173:0/976926319 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5740b2500 con 0x7fb550066f60 2024-04-25T09:14:49.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.660+0000 7fb56b400640 1 -- 172.21.15.173:0/976926319 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13502 (secure 0 0 0) 0x7fb5740b2500 con 0x7fb550066f60 2024-04-25T09:14:49.645 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:14:49.646 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:14:49.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.664+0000 7fb573e00640 1 -- 172.21.15.173:0/976926319 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb550066f60 msgr2=0x7fb550069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.664+0000 7fb573e00640 1 --2- 172.21.15.173:0/976926319 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb550066f60 0x7fb550069420 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb55c001060 tx=0x7fb55c009040 comp rx=0 tx=0).stop 2024-04-25T09:14:49.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.664+0000 7fb573e00640 1 -- 172.21.15.173:0/976926319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5580051d0 msgr2=0x7fb574153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.664+0000 7fb573e00640 1 --2- 172.21.15.173:0/976926319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5580051d0 0x7fb574153b90 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7fb564009fc0 tx=0x7fb56400f580 comp rx=0 tx=0).stop 2024-04-25T09:14:49.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.664+0000 7fb573e00640 1 -- 172.21.15.173:0/976926319 shutdown_connections 2024-04-25T09:14:49.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.664+0000 7fb573e00640 1 --2- 172.21.15.173:0/976926319 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fb550066f60 0x7fb550069420 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.664+0000 7fb573e00640 1 --2- 172.21.15.173:0/976926319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb574151a10 0x7fb574151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.664+0000 7fb573e00640 1 --2- 172.21.15.173:0/976926319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5740adb60 0x7fb574143980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.664+0000 7fb573e00640 1 --2- 172.21.15.173:0/976926319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5580051d0 0x7fb574153b90 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.664+0000 7fb573e00640 1 -- 172.21.15.173:0/976926319 >> 172.21.15.173:0/976926319 conn(0x7fb57406ac90 msgr2=0x7fb5740b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:49.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.664+0000 7fb573e00640 1 -- 172.21.15.173:0/976926319 shutdown_connections 2024-04-25T09:14:49.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:14:49.664+0000 7fb573e00640 1 -- 172.21.15.173:0/976926319 wait complete. 2024-04-25T09:14:49.666 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":508,"stamp":"2024-04-25T09:14:48.886110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":474680,"kb_used_data":15752,"kb_used_omap":12,"kb_used_meta":458803,"kb_avail":754500040,"statfs":{"total":773094113280,"available":772608040960,"internally_reserved":0,"allocated":16130048,"data_stored":8152456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":469814832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1073741824,"num_objects":-1024,"num_object_clones":0,"num_object_copies":-2048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1024,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1024,"num_write_kb":-1048576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-23,"num_bytes_recovered":-24117248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.326037"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":408,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-25T09:14:41.162903+0000","last_change":"2024-04-25T09:02:40.711263+0000","last_active":"2024-04-25T09:14:41.162903+0000","last_peered":"2024-04-25T09:14:41.162903+0000","last_clean":"2024-04-25T09:14:41.162903+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:14:41.162903+0000","last_undegraded":"2024-04-25T09:14:41.162903+0000","last_fullsized":"2024-04-25T09:14:41.162903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:38.890231+0000","last_clean_scrub_stamp":"2024-04-25T09:02:38.890231+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:40.748331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509588,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55212,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316628,"statfs":{"total":96636764160,"available":96580227072,"internally_reserved":0,"allocated":1867776,"data_stored":871465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509588,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55212,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316628,"statfs":{"total":96636764160,"available":96580227072,"internally_reserved":0,"allocated":1867776,"data_stored":871465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64876,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306964,"statfs":{"total":96636764160,"available":96570331136,"internally_reserved":0,"allocated":1867776,"data_stored":871465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509588,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64884,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306956,"statfs":{"total":96636764160,"available":96570322944,"internally_reserved":0,"allocated":1867776,"data_stored":871465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64551367},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59372,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312468,"statfs":{"total":96636764160,"available":96575967232,"internally_reserved":0,"allocated":1867776,"data_stored":871465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55216,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316624,"statfs":{"total":96636764160,"available":96580222976,"internally_reserved":0,"allocated":1867776,"data_stored":871465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509589,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59952,"kb_used_data":2404,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311888,"statfs":{"total":96636764160,"available":96575373312,"internally_reserved":0,"allocated":2461696,"data_stored":1461833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574997,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59956,"kb_used_data":2404,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311884,"statfs":{"total":96636764160,"available":96575369216,"internally_reserved":0,"allocated":2461696,"data_stored":1461833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:14:49.670 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T09:02:38.890231+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=2, tm_sec=38, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=14, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:14:49.670 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T09:15:09.671 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:15:09.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.835+0000 7fd842800640 1 Processor -- start 2024-04-25T09:15:09.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.835+0000 7fd842800640 1 -- start start 2024-04-25T09:15:09.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.835+0000 7fd842800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd83c0cc8b0 0x7fd83c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:09.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.835+0000 7fd842800640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83c06e7c0 con 0x7fd83c0ce8f0 2024-04-25T09:15:09.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.835+0000 7fd842800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83c06d720 con 0x7fd83c145250 2024-04-25T09:15:09.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.835+0000 7fd842800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83c06da00 con 0x7fd83c0cc8b0 2024-04-25T09:15:09.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.835+0000 7fd83be00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd83c0ce8f0 0x7fd83c0ced00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39318/0 (socket says 172.21.15.173:39318) 2024-04-25T09:15:09.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.835+0000 7fd83be00640 1 -- 172.21.15.173:0/912261644 learned_addr learned my addr 172.21.15.173:0/912261644 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:15:09.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.835+0000 7fd83aa00640 1 --2- 172.21.15.173:0/912261644 >> v2:172.21.15.194:3300/0 conn(0x7fd83c0cc8b0 0x7fd83c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:09.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.835+0000 7fd83a000640 1 -- 172.21.15.173:0/912261644 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477386978 0 0) 0x7fd83c06e7c0 con 0x7fd83c0ce8f0 2024-04-25T09:15:09.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.835+0000 7fd83a000640 1 -- 172.21.15.173:0/912261644 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd820003530 con 0x7fd83c0ce8f0 2024-04-25T09:15:09.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.835+0000 7fd83aa00640 1 -- 172.21.15.173:0/912261644 >> v1:172.21.15.194:6789/0 conn(0x7fd83c145250 legacy=0x7fd83c15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:09.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.835+0000 7fd83aa00640 1 -- 172.21.15.173:0/912261644 >> v1:172.21.15.173:6789/0 conn(0x7fd83c0ce8f0 legacy=0x7fd83c0ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:09.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.835+0000 7fd83aa00640 1 -- 172.21.15.173:0/912261644 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c06dce0 con 0x7fd83c0cc8b0 2024-04-25T09:15:09.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.839+0000 7fd83aa00640 1 --2- 172.21.15.173:0/912261644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83c0cc8b0 0x7fd83c0ccd30 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd8280097c0 tx=0x7fd82801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c403013032a0a4f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:15:09.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.839+0000 7fd83a000640 1 -- 172.21.15.173:0/912261644 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8280b1070 con 0x7fd83c0cc8b0 2024-04-25T09:15:09.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.839+0000 7fd83a000640 1 -- 172.21.15.173:0/912261644 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8280ac5f0 con 0x7fd83c0cc8b0 2024-04-25T09:15:09.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.839+0000 7fd83a000640 1 -- 172.21.15.173:0/912261644 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8280ac9c0 con 0x7fd83c0cc8b0 2024-04-25T09:15:09.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.839+0000 7fd842800640 1 -- 172.21.15.173:0/912261644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83c0cc8b0 msgr2=0x7fd83c0ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:09.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.839+0000 7fd842800640 1 --2- 172.21.15.173:0/912261644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83c0cc8b0 0x7fd83c0ccd30 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd8280097c0 tx=0x7fd82801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:15:09.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.839+0000 7fd842800640 1 -- 172.21.15.173:0/912261644 shutdown_connections 2024-04-25T09:15:09.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.839+0000 7fd842800640 1 --2- 172.21.15.173:0/912261644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83c0cc8b0 0x7fd83c0ccd30 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:09.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.839+0000 7fd842800640 1 -- 172.21.15.173:0/912261644 >> 172.21.15.173:0/912261644 conn(0x7fd83c06ac90 msgr2=0x7fd83c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:15:09.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.839+0000 7fd842800640 1 -- 172.21.15.173:0/912261644 shutdown_connections 2024-04-25T09:15:09.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.839+0000 7fd842800640 1 -- 172.21.15.173:0/912261644 wait complete. 2024-04-25T09:15:09.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd842800640 1 Processor -- start 2024-04-25T09:15:09.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd842800640 1 -- start start 2024-04-25T09:15:09.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd842800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd83c0cc8b0 0x7fd83c15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:09.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd842800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd83c0ce8f0 0x7fd83c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:09.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd842800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83c145250 0x7fd83c15b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:09.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd842800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c06d380 con 0x7fd83c0ce8f0 2024-04-25T09:15:09.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd842800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c06ef80 con 0x7fd83c145250 2024-04-25T09:15:09.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd842800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c06d500 con 0x7fd83c0cc8b0 2024-04-25T09:15:09.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd83aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd83c0ce8f0 0x7fd83c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:09.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd83aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd83c0ce8f0 0x7fd83c15ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:37738/0 (socket says 172.21.15.173:37738) 2024-04-25T09:15:09.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd83aa00640 1 -- 172.21.15.173:0/4143741620 learned_addr learned my addr 172.21.15.173:0/4143741620 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:15:09.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd83b400640 1 --2- 172.21.15.173:0/4143741620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd83c0cc8b0 0x7fd83c15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:09.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd83be00640 1 --2- 172.21.15.173:0/4143741620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83c145250 0x7fd83c15b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:09.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd83aa00640 1 -- 172.21.15.173:0/4143741620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd83c0cc8b0 msgr2=0x7fd83c15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:09.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd83aa00640 1 --2- 172.21.15.173:0/4143741620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd83c0cc8b0 0x7fd83c15a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:09.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd83aa00640 1 -- 172.21.15.173:0/4143741620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83c145250 msgr2=0x7fd83c15b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:09.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd83aa00640 1 --2- 172.21.15.173:0/4143741620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83c145250 0x7fd83c15b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:09.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd83aa00640 1 -- 172.21.15.173:0/4143741620 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c15c980 con 0x7fd83c0ce8f0 2024-04-25T09:15:09.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd83aa00640 1 --2- 172.21.15.173:0/4143741620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd83c0ce8f0 0x7fd83c15ab00 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7fd82801ab50 tx=0x7fd828019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:15:09.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd833400640 1 -- 172.21.15.173:0/4143741620 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8280b9020 con 0x7fd83c0ce8f0 2024-04-25T09:15:09.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd833400640 1 -- 172.21.15.173:0/4143741620 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8280b5410 con 0x7fd83c0ce8f0 2024-04-25T09:15:09.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd833400640 1 -- 172.21.15.173:0/4143741620 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8280b1040 con 0x7fd83c0ce8f0 2024-04-25T09:15:09.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd842800640 1 -- 172.21.15.173:0/4143741620 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83c15cc60 con 0x7fd83c0ce8f0 2024-04-25T09:15:09.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.843+0000 7fd842800640 1 -- 172.21.15.173:0/4143741620 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83c0acba0 con 0x7fd83c0ce8f0 2024-04-25T09:15:09.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.847+0000 7fd842800640 1 -- 172.21.15.173:0/4143741620 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83c073a40 con 0x7fd83c0ce8f0 2024-04-25T09:15:09.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.847+0000 7fd833400640 1 -- 172.21.15.173:0/4143741620 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd8280bc020 con 0x7fd83c0ce8f0 2024-04-25T09:15:09.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.847+0000 7fd833400640 1 --2- 172.21.15.173:0/4143741620 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd81c066f60 0x7fd81c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:09.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.847+0000 7fd833400640 1 -- 172.21.15.173:0/4143741620 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fd82811ebc0 con 0x7fd83c0ce8f0 2024-04-25T09:15:09.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.847+0000 7fd83b400640 1 --2- 172.21.15.173:0/4143741620 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd81c066f60 0x7fd81c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:09.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.847+0000 7fd83b400640 1 --2- 172.21.15.173:0/4143741620 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd81c066f60 0x7fd81c069420 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0b1f60 tx=0x7fd82c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:15:09.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:09.851+0000 7fd833400640 1 -- 172.21.15.173:0/4143741620 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd8280c3030 con 0x7fd83c0ce8f0 2024-04-25T09:15:09.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.003+0000 7fd842800640 1 -- 172.21.15.173:0/4143741620 --> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd83c0b45f0 con 0x7fd81c066f60 2024-04-25T09:15:09.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.003+0000 7fd833400640 1 -- 172.21.15.173:0/4143741620 <== mgr.4101 v2:172.21.15.173:6832/2040182084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13380 (secure 0 0 0) 0x7fd83c0b45f0 con 0x7fd81c066f60 2024-04-25T09:15:09.989 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:15:09.990 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2024-04-25T09:15:09.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.007+0000 7fd842800640 1 -- 172.21.15.173:0/4143741620 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd81c066f60 msgr2=0x7fd81c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:09.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.007+0000 7fd842800640 1 --2- 172.21.15.173:0/4143741620 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd81c066f60 0x7fd81c069420 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0b1f60 tx=0x7fd82c009040 comp rx=0 tx=0).stop 2024-04-25T09:15:09.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.007+0000 7fd842800640 1 -- 172.21.15.173:0/4143741620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd83c0ce8f0 msgr2=0x7fd83c15ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:09.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.007+0000 7fd842800640 1 --2- 172.21.15.173:0/4143741620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd83c0ce8f0 0x7fd83c15ab00 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7fd82801ab50 tx=0x7fd828019240 comp rx=0 tx=0).stop 2024-04-25T09:15:09.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.007+0000 7fd842800640 1 -- 172.21.15.173:0/4143741620 shutdown_connections 2024-04-25T09:15:09.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.007+0000 7fd842800640 1 --2- 172.21.15.173:0/4143741620 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fd81c066f60 0x7fd81c069420 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:09.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.007+0000 7fd842800640 1 --2- 172.21.15.173:0/4143741620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83c145250 0x7fd83c15b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:09.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.007+0000 7fd842800640 1 --2- 172.21.15.173:0/4143741620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd83c0ce8f0 0x7fd83c15ab00 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:09.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.007+0000 7fd842800640 1 --2- 172.21.15.173:0/4143741620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd83c0cc8b0 0x7fd83c15a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:09.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.007+0000 7fd842800640 1 -- 172.21.15.173:0/4143741620 >> 172.21.15.173:0/4143741620 conn(0x7fd83c06ac90 msgr2=0x7fd83c0cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:15:09.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.007+0000 7fd842800640 1 -- 172.21.15.173:0/4143741620 shutdown_connections 2024-04-25T09:15:09.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.007+0000 7fd842800640 1 -- 172.21.15.173:0/4143741620 wait complete. 2024-04-25T09:15:10.011 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":518,"stamp":"2024-04-25T09:15:08.890771+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":474668,"kb_used_data":15752,"kb_used_omap":12,"kb_used_meta":458803,"kb_avail":754500052,"statfs":{"total":773094113280,"available":772608053248,"internally_reserved":0,"allocated":16130048,"data_stored":8152456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":469814832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002960"},"pg_stats":[{"pgid":"1.0","version":"149'119","reported_seq":419,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-25T09:14:49.522335+0000","last_change":"2024-04-25T09:14:49.522369+0000","last_active":"2024-04-25T09:14:49.522335+0000","last_peered":"2024-04-25T09:14:49.522335+0000","last_clean":"2024-04-25T09:14:49.522335+0000","last_became_active":"2024-04-25T09:02:40.710204+0000","last_became_peered":"2024-04-25T09:02:40.710204+0000","last_unstale":"2024-04-25T09:14:49.522335+0000","last_undegraded":"2024-04-25T09:14:49.522335+0000","last_fullsized":"2024-04-25T09:14:49.522335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"149'119","last_scrub_stamp":"2024-04-25T09:14:49.522263+0000","last_deep_scrub":"149'119","last_deep_scrub_stamp":"2024-04-25T09:14:49.522263+0000","last_clean_scrub_stamp":"2024-04-25T09:14:49.522263+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:10.000883+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55212,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316628,"statfs":{"total":96636764160,"available":96580227072,"internally_reserved":0,"allocated":1867776,"data_stored":871465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55212,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316628,"statfs":{"total":96636764160,"available":96580227072,"internally_reserved":0,"allocated":1867776,"data_stored":871465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64876,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306964,"statfs":{"total":96636764160,"available":96570331136,"internally_reserved":0,"allocated":1867776,"data_stored":871465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64884,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306956,"statfs":{"total":96636764160,"available":96570322944,"internally_reserved":0,"allocated":1867776,"data_stored":871465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64551367},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59372,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312468,"statfs":{"total":96636764160,"available":96575967232,"internally_reserved":0,"allocated":1867776,"data_stored":871465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55216,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316624,"statfs":{"total":96636764160,"available":96580222976,"internally_reserved":0,"allocated":1867776,"data_stored":871465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509593,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59948,"kb_used_data":2404,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311892,"statfs":{"total":96636764160,"available":96575377408,"internally_reserved":0,"allocated":2461696,"data_stored":1461833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59948,"kb_used_data":2404,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311892,"statfs":{"total":96636764160,"available":96575377408,"internally_reserved":0,"allocated":2461696,"data_stored":1461833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:15:10.012 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T09:15:10.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.159+0000 7f2182400640 1 Processor -- start 2024-04-25T09:15:10.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.159+0000 7f2182400640 1 -- start start 2024-04-25T09:15:10.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.159+0000 7f2182400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f217c159f00 0x7f217c0cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:10.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.159+0000 7f2182400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f217c0cda00 0x7f217c071320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:10.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.159+0000 7f2182400640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f217c15ddd0 con 0x7f217c0cff40 2024-04-25T09:15:10.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.159+0000 7f2182400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f217c15e0b0 con 0x7f217c159f00 2024-04-25T09:15:10.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.159+0000 7f2182400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217c15e390 con 0x7f217c0cda00 2024-04-25T09:15:10.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.159+0000 7f217aa00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f217c0cff40 0x7f217c0cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39332/0 (socket says 172.21.15.173:39332) 2024-04-25T09:15:10.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.159+0000 7f217aa00640 1 -- 172.21.15.173:0/1593347929 learned_addr learned my addr 172.21.15.173:0/1593347929 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:15:10.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.159+0000 7f217b400640 1 --2- 172.21.15.173:0/1593347929 >> v2:172.21.15.194:3300/0 conn(0x7f217c159f00 0x7f217c0cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:10.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.159+0000 7f217be00640 1 --2- 172.21.15.173:0/1593347929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f217c0cda00 0x7f217c071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:10.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.163+0000 7f217a000640 1 -- 172.21.15.173:0/1593347929 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204989527 0 0) 0x7f217c15ddd0 con 0x7f217c0cff40 2024-04-25T09:15:10.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.163+0000 7f217a000640 1 -- 172.21.15.173:0/1593347929 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2160003530 con 0x7f217c0cff40 2024-04-25T09:15:10.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.163+0000 7f217b400640 1 -- 172.21.15.173:0/1593347929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f217c0cda00 msgr2=0x7f217c071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:15:10.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.163+0000 7f217b400640 1 --2- 172.21.15.173:0/1593347929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f217c0cda00 0x7f217c071320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.163+0000 7f217b400640 1 -- 172.21.15.173:0/1593347929 >> v1:172.21.15.173:6789/0 conn(0x7f217c0cff40 legacy=0x7f217c0cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:10.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.163+0000 7f217b400640 1 -- 172.21.15.173:0/1593347929 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217c15e670 con 0x7f217c159f00 2024-04-25T09:15:10.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.163+0000 7f217b400640 1 --2- 172.21.15.173:0/1593347929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f217c159f00 0x7f217c0cb960 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f216c009d90 tx=0x7f216c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8166b652f6ff3b9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:15:10.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.163+0000 7f217a000640 1 -- 172.21.15.173:0/1593347929 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c0b2070 con 0x7f217c159f00 2024-04-25T09:15:10.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.163+0000 7f217a000640 1 -- 172.21.15.173:0/1593347929 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c0a5940 con 0x7f217c159f00 2024-04-25T09:15:10.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.163+0000 7f217a000640 1 -- 172.21.15.173:0/1593347929 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c0a5d10 con 0x7f217c159f00 2024-04-25T09:15:10.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f2182400640 1 -- 172.21.15.173:0/1593347929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f217c159f00 msgr2=0x7f217c0cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:10.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f2182400640 1 --2- 172.21.15.173:0/1593347929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f217c159f00 0x7f217c0cb960 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f216c009d90 tx=0x7f216c01c970 comp rx=0 tx=0).stop 2024-04-25T09:15:10.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f2182400640 1 -- 172.21.15.173:0/1593347929 shutdown_connections 2024-04-25T09:15:10.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f2182400640 1 --2- 172.21.15.173:0/1593347929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f217c0cda00 0x7f217c071320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f2182400640 1 --2- 172.21.15.173:0/1593347929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f217c159f00 0x7f217c0cb960 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f2182400640 1 -- 172.21.15.173:0/1593347929 >> 172.21.15.173:0/1593347929 conn(0x7f217c06ac90 msgr2=0x7f217c06b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:15:10.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f2182400640 1 -- 172.21.15.173:0/1593347929 shutdown_connections 2024-04-25T09:15:10.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f2182400640 1 -- 172.21.15.173:0/1593347929 wait complete. 2024-04-25T09:15:10.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f2182400640 1 Processor -- start 2024-04-25T09:15:10.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f2182400640 1 -- start start 2024-04-25T09:15:10.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f2182400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f217c0cda00 0x7f217c14dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:10.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f2182400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f217c0cff40 0x7f217c1f7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:10.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f2182400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f217c159f00 0x7f217c144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:10.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f2182400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c071bf0 con 0x7f217c159f00 2024-04-25T09:15:10.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f2182400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c071a70 con 0x7f217c0cda00 2024-04-25T09:15:10.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f2182400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217c071d70 con 0x7f217c0cff40 2024-04-25T09:15:10.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f217be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f217c159f00 0x7f217c144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:10.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f217be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f217c159f00 0x7f217c144d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:37754/0 (socket says 172.21.15.173:37754) 2024-04-25T09:15:10.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f217be00640 1 -- 172.21.15.173:0/3757287390 learned_addr learned my addr 172.21.15.173:0/3757287390 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:15:10.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f217aa00640 1 --2- 172.21.15.173:0/3757287390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f217c0cff40 0x7f217c1f7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:10.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f217b400640 1 --2- 172.21.15.173:0/3757287390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f217c0cda00 0x7f217c14dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:10.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f217be00640 1 -- 172.21.15.173:0/3757287390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f217c0cff40 msgr2=0x7f217c1f7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:10.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f217be00640 1 --2- 172.21.15.173:0/3757287390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f217c0cff40 0x7f217c1f7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f217be00640 1 -- 172.21.15.173:0/3757287390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f217c0cda00 msgr2=0x7f217c14dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:10.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f217be00640 1 --2- 172.21.15.173:0/3757287390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f217c0cda00 0x7f217c14dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f217be00640 1 -- 172.21.15.173:0/3757287390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217c1f6260 con 0x7f217c159f00 2024-04-25T09:15:10.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f217aa00640 1 --2- 172.21.15.173:0/3757287390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f217c0cff40 0x7f217c1f7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:15:10.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.167+0000 7f217be00640 1 --2- 172.21.15.173:0/3757287390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f217c159f00 0x7f217c144d70 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f217400e890 tx=0x7f217400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:15:10.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.171+0000 7f2173400640 1 -- 172.21.15.173:0/3757287390 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174016070 con 0x7f217c159f00 2024-04-25T09:15:10.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.171+0000 7f2173400640 1 -- 172.21.15.173:0/3757287390 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217400cbe0 con 0x7f217c159f00 2024-04-25T09:15:10.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.171+0000 7f2173400640 1 -- 172.21.15.173:0/3757287390 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217400b040 con 0x7f217c159f00 2024-04-25T09:15:10.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.171+0000 7f2182400640 1 -- 172.21.15.173:0/3757287390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217c1f6540 con 0x7f217c159f00 2024-04-25T09:15:10.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.171+0000 7f2182400640 1 -- 172.21.15.173:0/3757287390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217c1f6de0 con 0x7f217c159f00 2024-04-25T09:15:10.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.171+0000 7f2182400640 1 -- 172.21.15.173:0/3757287390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217c1f6fe0 con 0x7f217c159f00 2024-04-25T09:15:10.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.171+0000 7f2173400640 1 -- 172.21.15.173:0/3757287390 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2174019070 con 0x7f217c159f00 2024-04-25T09:15:10.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.171+0000 7f2173400640 1 --2- 172.21.15.173:0/3757287390 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2158066f90 0x7f2158069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:10.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.171+0000 7f2173400640 1 -- 172.21.15.173:0/3757287390 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f2174084d90 con 0x7f217c159f00 2024-04-25T09:15:10.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.171+0000 7f217b400640 1 --2- 172.21.15.173:0/3757287390 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2158066f90 0x7f2158069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:10.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.175+0000 7f217b400640 1 --2- 172.21.15.173:0/3757287390 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2158066f90 0x7f2158069450 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f216c0af000 tx=0x7f216c0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:15:10.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.175+0000 7f2173400640 1 -- 172.21.15.173:0/3757287390 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f217c1f6fe0 con 0x7f217c159f00 2024-04-25T09:15:10.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.331+0000 7f2182400640 1 -- 172.21.15.173:0/3757287390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f217c1f6710 con 0x7f217c159f00 2024-04-25T09:15:10.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.335+0000 7f2173400640 1 -- 172.21.15.173:0/3757287390 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v28)=0 v28) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2174055820 con 0x7f217c159f00 2024-04-25T09:15:10.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.335+0000 7f2173400640 1 -- 172.21.15.173:0/3757287390 <== mon.0 v2:172.21.15.173:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f21740598c0 con 0x7f217c159f00 2024-04-25T09:15:10.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.339+0000 7f2182400640 1 -- 172.21.15.173:0/3757287390 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2158066f90 msgr2=0x7f2158069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:10.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.339+0000 7f2182400640 1 --2- 172.21.15.173:0/3757287390 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2158066f90 0x7f2158069450 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f216c0af000 tx=0x7f216c0a7070 comp rx=0 tx=0).stop 2024-04-25T09:15:10.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.339+0000 7f2182400640 1 -- 172.21.15.173:0/3757287390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f217c159f00 msgr2=0x7f217c144d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:10.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.339+0000 7f2182400640 1 --2- 172.21.15.173:0/3757287390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f217c159f00 0x7f217c144d70 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f217400e890 tx=0x7f217400ec90 comp rx=0 tx=0).stop 2024-04-25T09:15:10.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.339+0000 7f2182400640 1 -- 172.21.15.173:0/3757287390 shutdown_connections 2024-04-25T09:15:10.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.339+0000 7f2182400640 1 --2- 172.21.15.173:0/3757287390 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7f2158066f90 0x7f2158069450 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.339+0000 7f2182400640 1 --2- 172.21.15.173:0/3757287390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f217c159f00 0x7f217c144d70 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.339+0000 7f2182400640 1 --2- 172.21.15.173:0/3757287390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f217c0cff40 0x7f217c1f7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.339+0000 7f2182400640 1 --2- 172.21.15.173:0/3757287390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f217c0cda00 0x7f217c14dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.339+0000 7f2182400640 1 -- 172.21.15.173:0/3757287390 >> 172.21.15.173:0/3757287390 conn(0x7f217c06ac90 msgr2=0x7f217c0af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:15:10.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.339+0000 7f2182400640 1 -- 172.21.15.173:0/3757287390 shutdown_connections 2024-04-25T09:15:10.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.339+0000 7f2182400640 1 -- 172.21.15.173:0/3757287390 wait complete. 2024-04-25T09:15:10.343 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:15:10.344 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:15:10.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe370c00640 1 Processor -- start 2024-04-25T09:15:10.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe370c00640 1 -- start start 2024-04-25T09:15:10.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe370c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe36c0cf6c0 0x7fe36c0cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:10.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe370c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe36c0ccc60 0x7fe36c0cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:10.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe370c00640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe36c0cd1b0 con 0x7fe36c0c7d20 2024-04-25T09:15:10.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe370c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36c0d0520 con 0x7fe36c0ccc60 2024-04-25T09:15:10.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe370c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0c5230 con 0x7fe36c0cf6c0 2024-04-25T09:15:10.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe363e00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fe36c0c7d20 0x7fe36c099a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:39346/0 (socket says 172.21.15.173:39346) 2024-04-25T09:15:10.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe363e00640 1 -- 172.21.15.173:0/1310423245 learned_addr learned my addr 172.21.15.173:0/1310423245 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-25T09:15:10.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36be00640 1 --2- 172.21.15.173:0/1310423245 >> v2:172.21.15.194:3300/0 conn(0x7fe36c0ccc60 0x7fe36c0cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:10.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36b400640 1 --2- 172.21.15.173:0/1310423245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe36c0cf6c0 0x7fe36c0cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:10.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36aa00640 1 -- 172.21.15.173:0/1310423245 <== mon.0 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617773421 0 0) 0x7fe36c0cd1b0 con 0x7fe36c0c7d20 2024-04-25T09:15:10.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36aa00640 1 -- 172.21.15.173:0/1310423245 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe350003530 con 0x7fe36c0c7d20 2024-04-25T09:15:10.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36aa00640 1 -- 172.21.15.173:0/1310423245 <== mon.0 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2394058657 0 0) 0x7fe350003530 con 0x7fe36c0c7d20 2024-04-25T09:15:10.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36aa00640 1 -- 172.21.15.173:0/1310423245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe36c0cf6c0 msgr2=0x7fe36c0cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:15:10.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36aa00640 1 --2- 172.21.15.173:0/1310423245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe36c0cf6c0 0x7fe36c0cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36aa00640 1 -- 172.21.15.173:0/1310423245 >> v2:172.21.15.194:3300/0 conn(0x7fe36c0ccc60 msgr2=0x7fe36c0cffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:15:10.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36aa00640 1 --2- 172.21.15.173:0/1310423245 >> v2:172.21.15.194:3300/0 conn(0x7fe36c0ccc60 0x7fe36c0cffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36aa00640 1 -- 172.21.15.173:0/1310423245 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c0c5510 con 0x7fe36c0c7d20 2024-04-25T09:15:10.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36aa00640 1 -- 172.21.15.173:0/1310423245 <== mon.0 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147691979 0 0) 0x7fe354001680 con 0x7fe36c0c7d20 2024-04-25T09:15:10.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36be00640 1 --2- 172.21.15.173:0/1310423245 >> v2:172.21.15.194:3300/0 conn(0x7fe36c0ccc60 0x7fe36c0cffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:15:10.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36aa00640 1 -- 172.21.15.173:0/1310423245 >> v1:172.21.15.173:6789/0 conn(0x7fe36c0c7d20 legacy=0x7fe36c099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:10.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36aa00640 1 --2- 172.21.15.173:0/1310423245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3500039c0 0x7fe350003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:10.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36aa00640 1 --2- 172.21.15.173:0/1310423245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe36c0cf6c0 0x7fe350004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:10.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36aa00640 1 --2- 172.21.15.173:0/1310423245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe350004d50 0x7fe3500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:10.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36aa00640 1 -- 172.21.15.173:0/1310423245 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0d0520 con 0x7fe350004d50 2024-04-25T09:15:10.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36aa00640 1 -- 172.21.15.173:0/1310423245 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0c5230 con 0x7fe3500039c0 2024-04-25T09:15:10.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36aa00640 1 -- 172.21.15.173:0/1310423245 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35000b9d0 con 0x7fe36c0cf6c0 2024-04-25T09:15:10.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36be00640 1 --2- 172.21.15.173:0/1310423245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe350004d50 0x7fe3500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:10.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe363e00640 1 --2- 172.21.15.173:0/1310423245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe36c0cf6c0 0x7fe350004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:10.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36b400640 1 --2- 172.21.15.173:0/1310423245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3500039c0 0x7fe350003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:10.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36be00640 1 -- 172.21.15.173:0/1310423245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe36c0cf6c0 msgr2=0x7fe350004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:15:10.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36be00640 1 --2- 172.21.15.173:0/1310423245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe36c0cf6c0 0x7fe350004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36be00640 1 -- 172.21.15.173:0/1310423245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3500039c0 msgr2=0x7fe350003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:15:10.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36be00640 1 --2- 172.21.15.173:0/1310423245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3500039c0 0x7fe350003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.495+0000 7fe36be00640 1 -- 172.21.15.173:0/1310423245 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe350003530 con 0x7fe350004d50 2024-04-25T09:15:10.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.499+0000 7fe36be00640 1 --2- 172.21.15.173:0/1310423245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe350004d50 0x7fe3500051d0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fe36400e350 tx=0x7fe36401ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5e19f6ba7df9af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:15:10.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.499+0000 7fe36aa00640 1 -- 172.21.15.173:0/1310423245 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3640b2070 con 0x7fe350004d50 2024-04-25T09:15:10.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.499+0000 7fe36aa00640 1 -- 172.21.15.173:0/1310423245 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe3640ad440 con 0x7fe350004d50 2024-04-25T09:15:10.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.499+0000 7fe36aa00640 1 -- 172.21.15.173:0/1310423245 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364009de0 con 0x7fe350004d50 2024-04-25T09:15:10.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.499+0000 7fe370c00640 1 -- 172.21.15.173:0/1310423245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe350004d50 msgr2=0x7fe3500051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:10.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.499+0000 7fe370c00640 1 --2- 172.21.15.173:0/1310423245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe350004d50 0x7fe3500051d0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fe36400e350 tx=0x7fe36401ce80 comp rx=0 tx=0).stop 2024-04-25T09:15:10.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.499+0000 7fe36be00640 1 -- 172.21.15.173:0/1310423245 reap_dead start 2024-04-25T09:15:10.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.499+0000 7fe370c00640 1 -- 172.21.15.173:0/1310423245 shutdown_connections 2024-04-25T09:15:10.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.499+0000 7fe370c00640 1 -- 172.21.15.173:0/1310423245 >> 172.21.15.173:0/1310423245 conn(0x7fe36c0b3130 msgr2=0x7fe36c0b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:15:10.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.499+0000 7fe370c00640 1 -- 172.21.15.173:0/1310423245 shutdown_connections 2024-04-25T09:15:10.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.499+0000 7fe370c00640 1 -- 172.21.15.173:0/1310423245 wait complete. 2024-04-25T09:15:10.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe370c00640 1 Processor -- start 2024-04-25T09:15:10.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe370c00640 1 -- start start 2024-04-25T09:15:10.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe370c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe350004d50 0x7fe36c0cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:10.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe370c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe36c158e50 0x7fe36c0ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:10.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe370c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe36c0caa50 0x7fe36c15d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:10.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe370c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c15bbe0 con 0x7fe36c158e50 2024-04-25T09:15:10.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe370c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0cd490 con 0x7fe350004d50 2024-04-25T09:15:10.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe370c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0cf330 con 0x7fe36c0caa50 2024-04-25T09:15:10.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe363e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe36c158e50 0x7fe36c0ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:10.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe363e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe36c158e50 0x7fe36c0ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:37768/0 (socket says 172.21.15.173:37768) 2024-04-25T09:15:10.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe363e00640 1 -- 172.21.15.173:0/1061889104 learned_addr learned my addr 172.21.15.173:0/1061889104 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-25T09:15:10.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe36b400640 1 --2- 172.21.15.173:0/1061889104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe350004d50 0x7fe36c0cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:10.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe36be00640 1 --2- 172.21.15.173:0/1061889104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe36c0caa50 0x7fe36c15d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:10.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe363e00640 1 -- 172.21.15.173:0/1061889104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe36c0caa50 msgr2=0x7fe36c15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:10.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe363e00640 1 --2- 172.21.15.173:0/1061889104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe36c0caa50 0x7fe36c15d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe363e00640 1 -- 172.21.15.173:0/1061889104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe350004d50 msgr2=0x7fe36c0cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:10.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe363e00640 1 --2- 172.21.15.173:0/1061889104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe350004d50 0x7fe36c0cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe363e00640 1 -- 172.21.15.173:0/1061889104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c15ca60 con 0x7fe36c158e50 2024-04-25T09:15:10.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe363e00640 1 --2- 172.21.15.173:0/1061889104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe36c158e50 0x7fe36c0ca510 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fe354007310 tx=0x7fe354007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:15:10.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe363400640 1 -- 172.21.15.173:0/1061889104 <== mon.0 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35401a070 con 0x7fe36c158e50 2024-04-25T09:15:10.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe363400640 1 -- 172.21.15.173:0/1061889104 <== mon.0 v2:172.21.15.173:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe35400f9c0 con 0x7fe36c158e50 2024-04-25T09:15:10.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe363400640 1 -- 172.21.15.173:0/1061889104 <== mon.0 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35400fdb0 con 0x7fe36c158e50 2024-04-25T09:15:10.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe370c00640 1 -- 172.21.15.173:0/1061889104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36c0cb8b0 con 0x7fe36c158e50 2024-04-25T09:15:10.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.503+0000 7fe370c00640 1 -- 172.21.15.173:0/1061889104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36c15ccd0 con 0x7fe36c158e50 2024-04-25T09:15:10.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.507+0000 7fe370c00640 1 -- 172.21.15.173:0/1061889104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe36c073a40 con 0x7fe36c158e50 2024-04-25T09:15:10.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.507+0000 7fe363400640 1 -- 172.21.15.173:0/1061889104 <== mon.0 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe35401d070 con 0x7fe36c158e50 2024-04-25T09:15:10.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.507+0000 7fe363400640 1 --2- 172.21.15.173:0/1061889104 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe348066ea0 0x7fe348069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:10.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.507+0000 7fe363400640 1 -- 172.21.15.173:0/1061889104 <== mon.0 v2:172.21.15.173:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe354084980 con 0x7fe36c158e50 2024-04-25T09:15:10.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.507+0000 7fe36b400640 1 --2- 172.21.15.173:0/1061889104 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe348066ea0 0x7fe348069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:10.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.507+0000 7fe36b400640 1 --2- 172.21.15.173:0/1061889104 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe348066ea0 0x7fe348069360 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe36c1f2a80 tx=0x7fe35c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:15:10.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.511+0000 7fe363400640 1 -- 172.21.15.173:0/1061889104 <== mon.0 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe354055410 con 0x7fe36c158e50 2024-04-25T09:15:10.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.703+0000 7fe370c00640 1 -- 172.21.15.173:0/1061889104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe36c0cca40 con 0x7fe36c158e50 2024-04-25T09:15:10.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.703+0000 7fe363400640 1 -- 172.21.15.173:0/1061889104 <== mon.0 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+3712 (secure 0 0 0) 0x7fe3540594b0 con 0x7fe36c158e50 2024-04-25T09:15:10.688 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-25T09:15:10.688 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":107,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8171,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1426124994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1426124994},{"type":"v1","addr":"172.21.15.194:6835","nonce":1426124994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":107},{"gid":9004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/751187793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":751187793},{"type":"v1","addr":"172.21.15.173:6836","nonce":751187793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":9013,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1331227782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1331227782},{"type":"v1","addr":"172.21.15.194:6834","nonce":1331227782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":97},{"gid":10299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/1580673423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":1580673423},{"type":"v1","addr":"172.21.15.173:6837","nonce":1580673423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":107}],"filesystems":[]} 2024-04-25T09:15:10.688 INFO:teuthology.orchestra.run.smithi173.stderr:dumped fsmap epoch 107 2024-04-25T09:15:10.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.703+0000 7fe370c00640 1 -- 172.21.15.173:0/1061889104 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe348066ea0 msgr2=0x7fe348069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:10.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.703+0000 7fe370c00640 1 --2- 172.21.15.173:0/1061889104 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe348066ea0 0x7fe348069360 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe36c1f2a80 tx=0x7fe35c009190 comp rx=0 tx=0).stop 2024-04-25T09:15:10.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.703+0000 7fe370c00640 1 -- 172.21.15.173:0/1061889104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe36c158e50 msgr2=0x7fe36c0ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:10.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.703+0000 7fe370c00640 1 --2- 172.21.15.173:0/1061889104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe36c158e50 0x7fe36c0ca510 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fe354007310 tx=0x7fe354007710 comp rx=0 tx=0).stop 2024-04-25T09:15:10.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.703+0000 7fe370c00640 1 -- 172.21.15.173:0/1061889104 shutdown_connections 2024-04-25T09:15:10.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.703+0000 7fe370c00640 1 --2- 172.21.15.173:0/1061889104 >> [v2:172.21.15.173:6832/2040182084,v1:172.21.15.173:6833/2040182084] conn(0x7fe348066ea0 0x7fe348069360 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.703+0000 7fe370c00640 1 --2- 172.21.15.173:0/1061889104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe36c0caa50 0x7fe36c15d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.703+0000 7fe370c00640 1 --2- 172.21.15.173:0/1061889104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe36c158e50 0x7fe36c0ca510 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.703+0000 7fe370c00640 1 --2- 172.21.15.173:0/1061889104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe350004d50 0x7fe36c0cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:10.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.703+0000 7fe370c00640 1 -- 172.21.15.173:0/1061889104 >> 172.21.15.173:0/1061889104 conn(0x7fe36c0b3130 msgr2=0x7fe36c06f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:15:10.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.703+0000 7fe370c00640 1 -- 172.21.15.173:0/1061889104 shutdown_connections 2024-04-25T09:15:10.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-25T09:15:10.703+0000 7fe370c00640 1 -- 172.21.15.173:0/1061889104 wait complete. 2024-04-25T09:15:10.709 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-25T09:15:10.709 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T09:15:10.709 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:15:10.709 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:10.720 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:15:10.720 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:15:10.720 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:10.776 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:15:10.777 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:15:10.777 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:10.792 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:15:10.792 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:15:10.793 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:10.847 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:15:10.847 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T09:15:10.847 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T09:15:10.847 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:10.934 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T09:15:10.935 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T09:15:10.935 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:15.801 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:15:15.805 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:15:15.875 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-25T09:15:17.036 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T09:15:17.037 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T09:15:17.037 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:17.104 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T09:15:17.104 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T09:15:17.104 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:17.193 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T09:15:17.193 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T09:15:17.193 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:17.282 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T09:15:17.283 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T09:15:17.283 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:17.351 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T09:15:17.351 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T09:15:17.351 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:17.439 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T09:15:17.439 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T09:15:17.439 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:21.380 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-25T09:15:21.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-25T09:15:23.541 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T09:15:23.541 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T09:15:23.541 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T09:15:23.541 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:23.601 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T09:15:23.602 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T09:15:23.602 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:23.657 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T09:15:23.657 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T09:15:23.657 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T09:15:23.657 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:23.676 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T09:15:23.677 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T09:15:23.677 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:23.692 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T09:15:23.693 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T09:15:23.693 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:23.749 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T09:15:23.749 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T09:15:23.749 DEBUG:teuthology.orchestra.run.smithi173:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2024-04-25T09:15:23.782 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:15:23.782 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T09:15:24.130 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:15:24.131 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T09:15:24.367 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:15:24.367 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T09:15:24.543 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:15:24.544 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T09:15:24.770 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi194.front.sepia.ceph.com 2024-04-25T09:15:24.770 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T09:15:25.000 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi194.front.sepia.ceph.com 2024-04-25T09:15:25.000 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T09:15:25.200 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi194.front.sepia.ceph.com 2024-04-25T09:15:25.200 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T09:15:25.360 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi194.front.sepia.ceph.com 2024-04-25T09:15:25.360 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T09:15:25.501 INFO:tasks.ceph:Archiving mon data... 2024-04-25T09:15:25.502 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673000/data/mon.a.tgz 2024-04-25T09:15:25.502 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2024-04-25T09:15:25.511 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.t8eJV0QGhC 2024-04-25T09:15:25.511 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.t8eJV0QGhC 2024-04-25T09:15:25.670 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.t8eJV0QGhC 2024-04-25T09:15:25.747 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.t8eJV0QGhC is 495KB 2024-04-25T09:15:25.817 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.t8eJV0QGhC 2024-04-25T09:15:25.825 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673000/data/mon.b.tgz 2024-04-25T09:15:25.825 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-04-25T09:15:25.834 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.iwe8YAZcBz 2024-04-25T09:15:25.834 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.iwe8YAZcBz 2024-04-25T09:15:25.996 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.iwe8YAZcBz 2024-04-25T09:15:26.069 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.iwe8YAZcBz is 513KB 2024-04-25T09:15:26.136 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.iwe8YAZcBz 2024-04-25T09:15:26.144 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673000/data/mon.c.tgz 2024-04-25T09:15:26.144 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-04-25T09:15:26.192 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.Nqgl16bDwC 2024-04-25T09:15:26.192 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Nqgl16bDwC 2024-04-25T09:15:26.349 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.Nqgl16bDwC 2024-04-25T09:15:26.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-25T09:15:26.421 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.Nqgl16bDwC is 513KB 2024-04-25T09:15:26.492 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.Nqgl16bDwC 2024-04-25T09:15:26.499 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T09:15:26.500 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T09:15:26.503 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T09:15:26.575 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T09:15:26.609 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T09:15:26.609 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T09:15:26.611 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673000/remote/smithi173/crash 2024-04-25T09:15:26.612 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T09:15:26.643 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673000/remote/smithi194/crash 2024-04-25T09:15:26.644 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T09:15:26.671 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T09:15:26.671 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:15:26.689 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:15:26.761 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T09:15:26.782 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T09:15:26.801 INFO:tasks.ceph:Compressing logs... 2024-04-25T09:15:26.801 DEBUG:teuthology.orchestra.run.smithi173:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T09:15:26.833 DEBUG:teuthology.orchestra.run.smithi194:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T09:15:26.862 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38882.log 2024-04-25T09:15:26.863 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70954.log 2024-04-25T09:15:26.864 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.38882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35018.log 2024-04-25T09:15:26.864 INFO:teuthology.orchestra.run.smithi173.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.38882.log.gz 2024-04-25T09:15:26.864 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53635.log 2024-04-25T09:15:26.865 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70954.log.gz 2024-04-25T09:15:26.865 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77338.log 2024-04-25T09:15:26.866 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35018.log.gz 2024-04-25T09:15:26.866 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72704.log 2024-04-25T09:15:26.867 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53635.log.gz 2024-04-25T09:15:26.867 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.77338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52474.log 2024-04-25T09:15:26.867 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.77338.log.gz 2024-04-25T09:15:26.868 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.72704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82857.log 2024-04-25T09:15:26.868 INFO:teuthology.orchestra.run.smithi173.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.72704.log.gz 2024-04-25T09:15:26.869 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56553.log 2024-04-25T09:15:26.869 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52474.log.gz 2024-04-25T09:15:26.870 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56527.log 2024-04-25T09:15:26.870 INFO:teuthology.orchestra.run.smithi173.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.82857.log.gz 2024-04-25T09:15:26.871 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83820.log 2024-04-25T09:15:26.871 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56553.log.gz 2024-04-25T09:15:26.872 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79722.log 2024-04-25T09:15:26.872 INFO:teuthology.orchestra.run.smithi173.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56527.log.gz 2024-04-25T09:15:26.872 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27790.log 2024-04-25T09:15:26.873 INFO:teuthology.orchestra.run.smithi173.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.83820.log.gz 2024-04-25T09:15:26.873 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35023.log 2024-04-25T09:15:26.873 INFO:teuthology.orchestra.run.smithi173.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.79722.log.gz 2024-04-25T09:15:26.874 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.27790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77131.log 2024-04-25T09:15:26.874 INFO:teuthology.orchestra.run.smithi173.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27790.log.gz 2024-04-25T09:15:26.875 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54482.log 2024-04-25T09:15:26.875 INFO:teuthology.orchestra.run.smithi173.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35023.log.gz 2024-04-25T09:15:26.876 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.77131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53535.log 2024-04-25T09:15:26.876 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.77131.log.gz 2024-04-25T09:15:26.877 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52602.log 2024-04-25T09:15:26.877 INFO:teuthology.orchestra.run.smithi173.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54482.log.gz 2024-04-25T09:15:26.877 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72528.log 2024-04-25T09:15:26.879 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33104.log 2024-04-25T09:15:26.879 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33185.log 2024-04-25T09:15:26.879 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.1.33104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33104.log.gz 2024-04-25T09:15:26.879 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T09:15:26.880 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52602.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.53535.log.gz 2024-04-25T09:15:26.880 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79975.log 2024-04-25T09:15:26.881 INFO:teuthology.orchestra.run.smithi173.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52602.log.gz 2024-04-25T09:15:26.881 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.72528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85494.log 2024-04-25T09:15:26.881 INFO:teuthology.orchestra.run.smithi173.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.72528.log.gz 2024-04-25T09:15:26.881 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76517.log 2024-04-25T09:15:26.881 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.79975.log.gz 2024-04-25T09:15:26.881 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34810.log 2024-04-25T09:15:26.881 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.85494.log.gz 2024-04-25T09:15:26.886 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.3.33185.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T09:15:26.887 INFO:teuthology.orchestra.run.smithi194.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.33185.log.gz 2024-04-25T09:15:26.887 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27739.log 2024-04-25T09:15:26.887 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27835.log 2024-04-25T09:15:26.887 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.27739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27859.log 2024-04-25T09:15:26.887 INFO:teuthology.orchestra.run.smithi194.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27739.log.gz 2024-04-25T09:15:26.887 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.27835.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T09:15:26.887 INFO:teuthology.orchestra.run.smithi194.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27835.log.gz 2024-04-25T09:15:26.887 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.27859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33180.log 2024-04-25T09:15:26.888 INFO:teuthology.orchestra.run.smithi194.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27859.log.gz 2024-04-25T09:15:26.888 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27787.log 2024-04-25T09:15:26.888 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.3.33180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.33180.log.gz 2024-04-25T09:15:26.888 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T09:15:26.888 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.27787.log: /var/log/ceph/ceph-client.admin.27691.log 2024-04-25T09:15:26.890 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54945.log 2024-04-25T09:15:26.890 INFO:teuthology.orchestra.run.smithi173.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.76517.log.gz 2024-04-25T09:15:26.891 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35921.log 2024-04-25T09:15:26.891 INFO:teuthology.orchestra.run.smithi173.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34810.log.gz 2024-04-25T09:15:26.891 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69975.log 2024-04-25T09:15:26.891 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54945.log.gz 2024-04-25T09:15:26.891 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82799.log 2024-04-25T09:15:26.891 INFO:teuthology.orchestra.run.smithi173.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35921.log.gz 2024-04-25T09:15:26.891 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.69975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55691.log 2024-04-25T09:15:26.891 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69975.log.gz 2024-04-25T09:15:26.892 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78983.log 2024-04-25T09:15:26.892 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82799.log.gz 2024-04-25T09:15:26.892 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36255.log 2024-04-25T09:15:26.892 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55691.log.gz 2024-04-25T09:15:26.892 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.78983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57527.log 2024-04-25T09:15:26.892 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.78983.log.gz 2024-04-25T09:15:26.892 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76660.log 2024-04-25T09:15:26.892 INFO:teuthology.orchestra.run.smithi173.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36255.log.gz 2024-04-25T09:15:26.892 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.57527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33311.log 2024-04-25T09:15:26.893 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57527.log.gz 2024-04-25T09:15:26.893 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51603.log 2024-04-25T09:15:26.893 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.76660.log.gz 2024-04-25T09:15:26.893 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33311.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T09:15:26.893 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33311.log.gz 2024-04-25T09:15:26.894 INFO:teuthology.orchestra.run.smithi194.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27787.log.gz 2024-04-25T09:15:26.894 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T09:15:26.895 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.27691.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T09:15:26.895 INFO:teuthology.orchestra.run.smithi194.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27691.log.gz 2024-04-25T09:15:26.895 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T09:15:26.895 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T09:15:26.898 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82459.log 2024-04-25T09:15:26.898 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51603.log.gz 2024-04-25T09:15:26.898 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85295.log 2024-04-25T09:15:26.898 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86567.log 2024-04-25T09:15:26.898 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82459.log.gz 2024-04-25T09:15:26.899 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57573.log 2024-04-25T09:15:26.899 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.85295.log.gz 2024-04-25T09:15:26.899 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54100.log 2024-04-25T09:15:26.899 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86567.log.gz 2024-04-25T09:15:26.899 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.57573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83768.log 2024-04-25T09:15:26.899 INFO:teuthology.orchestra.run.smithi173.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57573.log.gz 2024-04-25T09:15:26.899 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74082.log 2024-04-25T09:15:26.899 INFO:teuthology.orchestra.run.smithi173.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54100.log.gz 2024-04-25T09:15:26.899 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82381.log 2024-04-25T09:15:26.900 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.83768.log.gz 2024-04-25T09:15:26.900 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.74082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52714.log 2024-04-25T09:15:26.903 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.d.log: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T09:15:26.903 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27811.log 2024-04-25T09:15:26.903 INFO:teuthology.orchestra.run.smithi194.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 94.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T09:15:26.903 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-04-25T09:15:26.903 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T09:15:26.903 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27763.log 2024-04-25T09:15:26.903 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.27811.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27811.log.gz 2024-04-25T09:15:26.903 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T09:15:26.904 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.27763.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27763.log.gz 2024-04-25T09:15:26.905 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82381.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.74082.log.gz 2024-04-25T09:15:26.905 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71162.log 2024-04-25T09:15:26.905 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.82381.log.gz 2024-04-25T09:15:26.905 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80564.log 2024-04-25T09:15:26.905 INFO:teuthology.orchestra.run.smithi173.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52714.log.gz 2024-04-25T09:15:26.906 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.71162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86201.log 2024-04-25T09:15:26.906 INFO:teuthology.orchestra.run.smithi173.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71162.log.gz 2024-04-25T09:15:26.906 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34631.log 2024-04-25T09:15:26.906 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.80564.log.gz 2024-04-25T09:15:26.906 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57015.log 2024-04-25T09:15:26.906 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86201.log.gz 2024-04-25T09:15:26.906 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85358.log 2024-04-25T09:15:26.906 INFO:teuthology.orchestra.run.smithi173.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34631.log.gz 2024-04-25T09:15:26.906 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.57015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73160.log 2024-04-25T09:15:26.907 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57015.log.gz 2024-04-25T09:15:26.907 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55478.log 2024-04-25T09:15:26.907 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.85358.log.gz 2024-04-25T09:15:26.908 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27715.log 2024-04-25T09:15:26.908 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T09:15:26.908 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33086.log 2024-04-25T09:15:26.909 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71337.log 2024-04-25T09:15:26.909 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73160.log.gz 2024-04-25T09:15:26.910 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.55478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53455.log 2024-04-25T09:15:26.910 INFO:teuthology.orchestra.run.smithi173.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55478.log.gz 2024-04-25T09:15:26.910 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.71337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.71337.log.gz 2024-04-25T09:15:26.910 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54215.log 2024-04-25T09:15:26.910 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38680.log 2024-04-25T09:15:26.910 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53455.log.gz 2024-04-25T09:15:26.910 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82721.log 2024-04-25T09:15:26.910 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54215.log.gz 2024-04-25T09:15:26.912 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56910.log 2024-04-25T09:15:26.912 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38680.log.gz 2024-04-25T09:15:26.912 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85997.log 2024-04-25T09:15:26.912 INFO:teuthology.orchestra.run.smithi173.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.82721.log.gz 2024-04-25T09:15:26.912 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36385.log 2024-04-25T09:15:26.912 INFO:teuthology.orchestra.run.smithi173.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.56910.log.gz 2024-04-25T09:15:26.913 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71291.log 2024-04-25T09:15:26.913 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.85997.log.gz 2024-04-25T09:15:26.913 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37683.log 2024-04-25T09:15:26.914 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.27715.log: /var/log/ceph/ceph-client.1.33086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33086.log.gz 2024-04-25T09:15:26.915 INFO:teuthology.orchestra.run.smithi194.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27715.log.gz 2024-04-25T09:15:26.915 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36385.log.gz 2024-04-25T09:15:26.915 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.71291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74183.log 2024-04-25T09:15:26.915 INFO:teuthology.orchestra.run.smithi173.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.71291.log.gz 2024-04-25T09:15:26.916 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37683.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37683.log.gz 2024-04-25T09:15:26.916 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85919.log 2024-04-25T09:15:26.916 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.74183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.74183.log.gzgzip 2024-04-25T09:15:26.916 INFO:teuthology.orchestra.run.smithi173.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36697.log 2024-04-25T09:15:26.917 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83581.log 2024-04-25T09:15:26.917 INFO:teuthology.orchestra.run.smithi173.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.85919.log.gz 2024-04-25T09:15:26.918 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37787.log 2024-04-25T09:15:26.918 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36697.log.gz 2024-04-25T09:15:26.919 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69923.log 2024-04-25T09:15:26.919 INFO:teuthology.orchestra.run.smithi173.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.83581.log.gz 2024-04-25T09:15:26.920 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53924.log 2024-04-25T09:15:26.920 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37787.log.gz 2024-04-25T09:15:26.920 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.69923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36723.log 2024-04-25T09:15:26.921 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69923.log.gz 2024-04-25T09:15:26.921 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83188.log 2024-04-25T09:15:26.922 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36723.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53924.log.gz 2024-04-25T09:15:26.922 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76048.log 2024-04-25T09:15:26.922 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36723.log.gz 2024-04-25T09:15:26.923 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33504.log 2024-04-25T09:15:26.923 INFO:teuthology.orchestra.run.smithi173.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.83188.log.gz 2024-04-25T09:15:26.924 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82883.log 2024-04-25T09:15:26.924 INFO:teuthology.orchestra.run.smithi173.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.76048.log.gz 2024-04-25T09:15:26.925 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75679.log 2024-04-25T09:15:26.925 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33504.log.gz 2024-04-25T09:15:26.925 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72578.log 2024-04-25T09:15:26.926 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.82883.log.gz 2024-04-25T09:15:26.926 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35203.log 2024-04-25T09:15:26.927 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.72578.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.75679.log.gz 2024-04-25T09:15:26.927 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83690.log 2024-04-25T09:15:26.928 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35203.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.72578.log.gz 2024-04-25T09:15:26.928 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80485.log 2024-04-25T09:15:26.928 INFO:teuthology.orchestra.run.smithi173.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35203.log.gz 2024-04-25T09:15:26.929 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71214.log 2024-04-25T09:15:26.929 INFO:teuthology.orchestra.run.smithi173.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.83690.log.gz 2024-04-25T09:15:26.930 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80485.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T09:15:26.930 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.80485.log.gz 2024-04-25T09:15:26.931 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.71214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51832.log 2024-04-25T09:15:26.931 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71214.log.gz 2024-04-25T09:15:26.931 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79560.log 2024-04-25T09:15:26.932 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82515.log 2024-04-25T09:15:26.933 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51832.log.gz 2024-04-25T09:15:26.933 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80170.log 2024-04-25T09:15:26.933 INFO:teuthology.orchestra.run.smithi173.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.79560.log.gz 2024-04-25T09:15:26.934 INFO:teuthology.orchestra.run.smithi194.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T09:15:26.935 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51045.log 2024-04-25T09:15:26.935 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.82515.log.gz 2024-04-25T09:15:26.935 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57578.log 2024-04-25T09:15:26.935 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.80170.log.gz 2024-04-25T09:15:26.936 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83346.log 2024-04-25T09:15:26.936 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51045.log.gz 2024-04-25T09:15:26.937 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.57578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57578.log.gz 2024-04-25T09:15:26.937 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38524.log 2024-04-25T09:15:26.938 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73257.log 2024-04-25T09:15:26.938 INFO:teuthology.orchestra.run.smithi173.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.83346.log.gz 2024-04-25T09:15:26.939 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70980.log 2024-04-25T09:15:26.939 INFO:teuthology.orchestra.run.smithi173.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38524.log.gz 2024-04-25T09:15:26.940 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53071.log 2024-04-25T09:15:26.940 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73257.log.gz 2024-04-25T09:15:26.941 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33771.log 2024-04-25T09:15:26.941 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70980.log.gz 2024-04-25T09:15:26.941 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35543.log 2024-04-25T09:15:26.942 INFO:teuthology.orchestra.run.smithi173.stderr: 91.5%/var/log/ceph/ceph-client.admin.33771.log: -- replaced with /var/log/ceph/ceph-client.admin.53071.log.gz 2024-04-25T09:15:26.942 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33771.log.gz 2024-04-25T09:15:26.943 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33413.log 2024-04-25T09:15:26.943 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52764.log 2024-04-25T09:15:26.943 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35543.log.gz 2024-04-25T09:15:26.944 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37709.log 2024-04-25T09:15:26.944 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33413.log.gz 2024-04-25T09:15:26.945 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36203.log 2024-04-25T09:15:26.945 INFO:teuthology.orchestra.run.smithi173.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52764.log.gz 2024-04-25T09:15:26.946 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86541.log 2024-04-25T09:15:26.946 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37709.log.gz 2024-04-25T09:15:26.947 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75420.log 2024-04-25T09:15:26.947 INFO:teuthology.orchestra.run.smithi173.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36203.log.gz 2024-04-25T09:15:26.948 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54657.log 2024-04-25T09:15:26.948 INFO:teuthology.orchestra.run.smithi173.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.86541.log.gz 2024-04-25T09:15:26.949 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75859.log 2024-04-25T09:15:26.949 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.75420.log.gz 2024-04-25T09:15:26.950 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70392.log 2024-04-25T09:15:26.950 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54657.log.gz 2024-04-25T09:15:26.950 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36489.log 2024-04-25T09:15:26.950 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75859.log.gz 2024-04-25T09:15:26.951 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34796.log 2024-04-25T09:15:26.951 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70392.log.gz 2024-04-25T09:15:26.952 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54050.log 2024-04-25T09:15:26.952 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36489.log.gz 2024-04-25T09:15:26.953 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73653.log 2024-04-25T09:15:26.953 INFO:teuthology.orchestra.run.smithi173.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34796.log.gz 2024-04-25T09:15:26.954 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72678.log 2024-04-25T09:15:26.954 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73653.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.54050.log.gz 2024-04-25T09:15:26.955 INFO:teuthology.orchestra.run.smithi173.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73653.log.gz 2024-04-25T09:15:26.955 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36229.log 2024-04-25T09:15:26.956 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.72678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72842.log 2024-04-25T09:15:26.956 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72678.log.gz 2024-04-25T09:15:26.957 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71342.log 2024-04-25T09:15:26.957 INFO:teuthology.orchestra.run.smithi173.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36229.log.gz 2024-04-25T09:15:26.957 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.72842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36515.log 2024-04-25T09:15:26.958 INFO:teuthology.orchestra.run.smithi173.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72842.log.gz 2024-04-25T09:15:26.958 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.71342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.71342.log.gz 2024-04-25T09:15:26.958 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54560.log 2024-04-25T09:15:26.959 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55694.log 2024-04-25T09:15:26.959 INFO:teuthology.orchestra.run.smithi173.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36515.log.gz 2024-04-25T09:15:26.960 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69949.log 2024-04-25T09:15:26.960 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54560.log.gz 2024-04-25T09:15:26.961 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54761.log 2024-04-25T09:15:26.961 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55694.log.gz 2024-04-25T09:15:26.962 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.69949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36307.log 2024-04-25T09:15:26.962 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69949.log.gz 2024-04-25T09:15:26.963 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55578.log 2024-04-25T09:15:26.963 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54761.log.gz 2024-04-25T09:15:26.964 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38171.log 2024-04-25T09:15:26.964 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36307.log.gz 2024-04-25T09:15:26.964 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56371.log 2024-04-25T09:15:26.965 INFO:teuthology.orchestra.run.smithi173.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55578.log.gz 2024-04-25T09:15:26.965 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56475.log 2024-04-25T09:15:26.966 INFO:teuthology.orchestra.run.smithi173.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38171.log.gz 2024-04-25T09:15:26.966 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53245.log 2024-04-25T09:15:26.966 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56371.log.gz 2024-04-25T09:15:26.967 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33875.log 2024-04-25T09:15:26.967 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56475.log.gz 2024-04-25T09:15:26.968 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34579.log 2024-04-25T09:15:26.969 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33875.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.53245.log.gz 2024-04-25T09:15:26.969 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57345.log 2024-04-25T09:15:26.970 INFO:teuthology.orchestra.run.smithi173.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33875.log.gz 2024-04-25T09:15:26.970 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33691.log 2024-04-25T09:15:26.971 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34579.log.gz 2024-04-25T09:15:26.971 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.57345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86333.log 2024-04-25T09:15:26.971 INFO:teuthology.orchestra.run.smithi173.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.57345.log.gz 2024-04-25T09:15:26.972 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82407.log 2024-04-25T09:15:26.972 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33691.log.gz 2024-04-25T09:15:26.973 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77384.log 2024-04-25T09:15:26.973 INFO:teuthology.orchestra.run.smithi173.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86333.log.gz 2024-04-25T09:15:26.974 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83555.log 2024-04-25T09:15:26.974 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.82407.log.gz 2024-04-25T09:15:26.975 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.77384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.77384.log.gz 2024-04-25T09:15:26.975 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83268.log 2024-04-25T09:15:26.975 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80642.log 2024-04-25T09:15:26.976 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.83555.log.gz 2024-04-25T09:15:26.976 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52015.log 2024-04-25T09:15:26.976 INFO:teuthology.orchestra.run.smithi173.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.83268.log.gz 2024-04-25T09:15:26.977 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83635.log 2024-04-25T09:15:26.977 INFO:teuthology.orchestra.run.smithi173.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.80642.log.gz 2024-04-25T09:15:26.978 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53145.log 2024-04-25T09:15:26.978 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52015.log.gz 2024-04-25T09:15:26.979 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52318.log 2024-04-25T09:15:26.979 INFO:teuthology.orchestra.run.smithi173.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.83635.log.gz 2024-04-25T09:15:26.980 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38444.log 2024-04-25T09:15:26.980 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52318.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53145.log.gz 2024-04-25T09:15:26.981 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52318.log.gz 2024-04-25T09:15:26.981 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54683.log 2024-04-25T09:15:26.982 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80001.log 2024-04-25T09:15:26.982 INFO:teuthology.orchestra.run.smithi173.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38444.log.gz 2024-04-25T09:15:26.983 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76465.log 2024-04-25T09:15:26.983 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54683.log.gz 2024-04-25T09:15:26.983 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73900.log 2024-04-25T09:15:26.984 INFO:teuthology.orchestra.run.smithi173.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.80001.log.gz 2024-04-25T09:15:26.984 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34683.log 2024-04-25T09:15:26.984 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76465.log.gz 2024-04-25T09:15:26.985 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57074.log 2024-04-25T09:15:26.985 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73900.log.gz 2024-04-25T09:15:26.986 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52648.log 2024-04-25T09:15:26.986 INFO:teuthology.orchestra.run.smithi173.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34683.log.gz 2024-04-25T09:15:26.987 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.57074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76080.log 2024-04-25T09:15:26.987 INFO:teuthology.orchestra.run.smithi173.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57074.log.gz 2024-04-25T09:15:26.988 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.52648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52648.log.gz 2024-04-25T09:15:26.988 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54351.log 2024-04-25T09:15:26.989 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70548.log 2024-04-25T09:15:26.989 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76080.log.gz 2024-04-25T09:15:26.990 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38197.log 2024-04-25T09:15:26.990 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54351.log.gz 2024-04-25T09:15:26.990 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83742.log 2024-04-25T09:15:26.991 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70548.log.gz 2024-04-25T09:15:26.991 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69790.log 2024-04-25T09:15:26.991 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38197.log.gz 2024-04-25T09:15:26.992 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83216.log 2024-04-25T09:15:26.992 INFO:teuthology.orchestra.run.smithi173.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.83742.log.gz 2024-04-25T09:15:26.993 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.69790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83039.log 2024-04-25T09:15:26.994 INFO:teuthology.orchestra.run.smithi173.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.69790.log.gz 2024-04-25T09:15:26.994 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77079.log 2024-04-25T09:15:26.994 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.83216.log.gz 2024-04-25T09:15:26.995 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76210.log 2024-04-25T09:15:26.995 INFO:teuthology.orchestra.run.smithi173.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.83039.log.gz 2024-04-25T09:15:26.996 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.77079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51233.log 2024-04-25T09:15:26.996 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.77079.log.gz 2024-04-25T09:15:26.997 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53687.log 2024-04-25T09:15:26.997 INFO:teuthology.orchestra.run.smithi173.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76210.log.gz 2024-04-25T09:15:26.998 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53195.log 2024-04-25T09:15:26.998 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51233.log.gz 2024-04-25T09:15:26.999 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51858.log 2024-04-25T09:15:26.999 INFO:teuthology.orchestra.run.smithi173.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53687.log.gz 2024-04-25T09:15:27.000 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73363.log 2024-04-25T09:15:27.000 INFO:teuthology.orchestra.run.smithi173.stderr: 91.2%/var/log/ceph/ceph-client.admin.51858.log: -- replaced with /var/log/ceph/ceph-client.admin.53195.log.gz 2024-04-25T09:15:27.001 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51858.log.gz 2024-04-25T09:15:27.001 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53824.log 2024-04-25T09:15:27.002 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55299.log 2024-04-25T09:15:27.002 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73363.log.gz 2024-04-25T09:15:27.002 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73030.log 2024-04-25T09:15:27.003 INFO:teuthology.orchestra.run.smithi173.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53824.log.gz 2024-04-25T09:15:27.004 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55299.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55299.log.gz 2024-04-25T09:15:27.004 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78727.log 2024-04-25T09:15:27.004 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86359.log 2024-04-25T09:15:27.005 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73030.log.gz 2024-04-25T09:15:27.005 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.78727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52500.log 2024-04-25T09:15:27.006 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78727.log.gz 2024-04-25T09:15:27.006 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36411.log 2024-04-25T09:15:27.006 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86359.log.gz 2024-04-25T09:15:27.007 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78883.log 2024-04-25T09:15:27.007 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52500.log.gz 2024-04-25T09:15:27.008 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56070.log 2024-04-25T09:15:27.008 INFO:teuthology.orchestra.run.smithi173.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36411.log.gz 2024-04-25T09:15:27.009 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.78883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34392.log 2024-04-25T09:15:27.009 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56070.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.78883.log.gz 2024-04-25T09:15:27.010 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T09:15:27.010 INFO:teuthology.orchestra.run.smithi173.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.56070.log.gz 2024-04-25T09:15:27.011 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34392.log: gzip 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34392.log.gz -5 2024-04-25T09:15:27.011 INFO:teuthology.orchestra.run.smithi173.stderr: --verbose -- /var/log/ceph/ceph-client.admin.76288.log 2024-04-25T09:15:27.011 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75885.log 2024-04-25T09:15:27.013 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79317.log 2024-04-25T09:15:27.013 INFO:teuthology.orchestra.run.smithi173.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.76288.log.gz 2024-04-25T09:15:27.014 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79187.log 2024-04-25T09:15:27.014 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75885.log.gz 2024-04-25T09:15:27.014 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80941.log 2024-04-25T09:15:27.015 INFO:teuthology.orchestra.run.smithi173.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.79317.log.gz 2024-04-25T09:15:27.015 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33635.log 2024-04-25T09:15:27.016 INFO:teuthology.orchestra.run.smithi173.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.79187.log.gz 2024-04-25T09:15:27.017 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73926.log 2024-04-25T09:15:27.017 INFO:teuthology.orchestra.run.smithi173.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.80941.log.gz 2024-04-25T09:15:27.017 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35020.log 2024-04-25T09:15:27.018 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33635.log.gz 2024-04-25T09:15:27.019 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33823.log 2024-04-25T09:15:27.019 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73926.log.gz 2024-04-25T09:15:27.020 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33901.log 2024-04-25T09:15:27.020 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35020.log.gz 2024-04-25T09:15:27.021 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36966.log 2024-04-25T09:15:27.021 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33823.log: /var/log/ceph/ceph-client.admin.33901.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33823.log.gz 2024-04-25T09:15:27.022 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55024.log 2024-04-25T09:15:27.022 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33901.log.gz 2024-04-25T09:15:27.023 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52552.log 2024-04-25T09:15:27.023 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36966.log.gz 2024-04-25T09:15:27.023 INFO:teuthology.orchestra.run.smithi173.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T09:15:27.024 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85321.log 2024-04-25T09:15:27.024 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55024.log: /var/log/ceph/ceph-client.admin.52552.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55024.log.gz 2024-04-25T09:15:27.024 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70085.log 2024-04-25T09:15:27.025 INFO:teuthology.orchestra.run.smithi173.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.52552.log.gz 2024-04-25T09:15:27.025 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79035.log 2024-04-25T09:15:27.026 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.85321.log.gz 2024-04-25T09:15:27.026 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73389.log 2024-04-25T09:15:27.026 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70085.log.gz 2024-04-25T09:15:27.027 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80512.log 2024-04-25T09:15:27.027 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.79035.log.gz 2024-04-25T09:15:27.028 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34261.log 2024-04-25T09:15:27.028 INFO:teuthology.orchestra.run.smithi173.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.73389.log.gz 2024-04-25T09:15:27.029 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55080.log 2024-04-25T09:15:27.029 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.80512.log.gz 2024-04-25T09:15:27.030 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85604.log 2024-04-25T09:15:27.030 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34261.log.gz 2024-04-25T09:15:27.031 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52093.log 2024-04-25T09:15:27.031 INFO:teuthology.orchestra.run.smithi173.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55080.log.gz 2024-04-25T09:15:27.032 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36593.log 2024-04-25T09:15:27.032 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.85604.log.gz 2024-04-25T09:15:27.033 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33953.log 2024-04-25T09:15:27.033 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52093.log.gz 2024-04-25T09:15:27.033 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37605.log 2024-04-25T09:15:27.033 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36593.log.gz 2024-04-25T09:15:27.034 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38887.log 2024-04-25T09:15:27.035 INFO:teuthology.orchestra.run.smithi173.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.33953.log.gz 2024-04-25T09:15:27.035 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54822.log 2024-04-25T09:15:27.036 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37605.log.gz 2024-04-25T09:15:27.036 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.38887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55873.log 2024-04-25T09:15:27.036 INFO:teuthology.orchestra.run.smithi173.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.38887.log.gz 2024-04-25T09:15:27.037 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56209.log 2024-04-25T09:15:27.037 INFO:teuthology.orchestra.run.smithi173.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54822.log.gz 2024-04-25T09:15:27.038 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56936.log 2024-04-25T09:15:27.038 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55873.log.gz 2024-04-25T09:15:27.039 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82202.log 2024-04-25T09:15:27.039 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56209.log.gz 2024-04-25T09:15:27.040 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34235.log 2024-04-25T09:15:27.040 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56936.log.gz 2024-04-25T09:15:27.041 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82202.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T09:15:27.041 INFO:teuthology.orchestra.run.smithi173.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.82202.log.gz 2024-04-25T09:15:27.042 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84105.log 2024-04-25T09:15:27.042 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34235.log.gz 2024-04-25T09:15:27.043 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82662.log 2024-04-25T09:15:27.043 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77027.log 2024-04-25T09:15:27.044 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.84105.log: /var/log/ceph/ceph-client.admin.82662.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.84105.log.gz 2024-04-25T09:15:27.045 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.82662.log.gz 2024-04-25T09:15:27.045 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36940.log 2024-04-25T09:15:27.045 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79508.log 2024-04-25T09:15:27.046 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.77027.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77027.log.gz 2024-04-25T09:15:27.047 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73952.log 2024-04-25T09:15:27.047 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36940.log.gz 2024-04-25T09:15:27.048 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35699.log 2024-04-25T09:15:27.048 INFO:teuthology.orchestra.run.smithi173.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.79508.log.gz 2024-04-25T09:15:27.049 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76184.log 2024-04-25T09:15:27.049 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73952.log: /var/log/ceph/ceph-client.admin.35699.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.73952.log.gz 2024-04-25T09:15:27.050 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55927.log 2024-04-25T09:15:27.050 INFO:teuthology.orchestra.run.smithi173.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35699.log.gz 2024-04-25T09:15:27.051 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36619.log 2024-04-25T09:15:27.051 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.76184.log.gz 2024-04-25T09:15:27.051 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55273.log 2024-04-25T09:15:27.052 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36619.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55927.log.gz 2024-04-25T09:15:27.053 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36619.log.gz 2024-04-25T09:15:27.053 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82606.log 2024-04-25T09:15:27.053 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72738.log 2024-04-25T09:15:27.054 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55273.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55273.log.gz 2024-04-25T09:15:27.055 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84156.log 2024-04-25T09:15:27.055 INFO:teuthology.orchestra.run.smithi173.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.82606.log.gz 2024-04-25T09:15:27.056 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.72738.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72738.log.gz 2024-04-25T09:15:27.056 INFO:teuthology.orchestra.run.smithi173.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51674.log 2024-04-25T09:15:27.056 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.0.84156.log: /var/log/ceph/ceph-client.admin.75496.log 2024-04-25T09:15:27.057 INFO:teuthology.orchestra.run.smithi173.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.84156.log.gz 2024-04-25T09:15:27.057 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72764.log 2024-04-25T09:15:27.058 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51674.log.gz 2024-04-25T09:15:27.058 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38145.log 2024-04-25T09:15:27.059 INFO:teuthology.orchestra.run.smithi173.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.75496.log.gz 2024-04-25T09:15:27.059 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.72764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71032.log 2024-04-25T09:15:27.060 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72764.log.gz 2024-04-25T09:15:27.060 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38145.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38145.log.gz 2024-04-25T09:15:27.061 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55604.log 2024-04-25T09:15:27.061 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.71032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70678.log 2024-04-25T09:15:27.062 INFO:teuthology.orchestra.run.smithi173.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71032.log.gz 2024-04-25T09:15:27.063 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86463.log 2024-04-25T09:15:27.063 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55604.log.gz 2024-04-25T09:15:27.064 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73848.log 2024-04-25T09:15:27.064 INFO:teuthology.orchestra.run.smithi173.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.70678.log.gz 2024-04-25T09:15:27.064 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50995.log 2024-04-25T09:15:27.065 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73848.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86463.log.gz 2024-04-25T09:15:27.066 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78933.log 2024-04-25T09:15:27.066 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73848.log.gz 2024-04-25T09:15:27.066 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.50995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70900.log 2024-04-25T09:15:27.067 INFO:teuthology.orchestra.run.smithi173.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50995.log.gz 2024-04-25T09:15:27.068 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.78933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70874.log 2024-04-25T09:15:27.069 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70900.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.78933.log.gz 2024-04-25T09:15:27.069 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52067.log 2024-04-25T09:15:27.069 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70900.log.gz 2024-04-25T09:15:27.070 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83143.log 2024-04-25T09:15:27.070 INFO:teuthology.orchestra.run.smithi173.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70874.log.gz 2024-04-25T09:15:27.071 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35855.log 2024-04-25T09:15:27.071 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52067.log.gz 2024-04-25T09:15:27.072 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73716.log 2024-04-25T09:15:27.072 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.83143.log.gz 2024-04-25T09:15:27.073 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53874.log 2024-04-25T09:15:27.073 INFO:teuthology.orchestra.run.smithi173.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.35855.log.gz 2024-04-25T09:15:27.074 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85578.log 2024-04-25T09:15:27.075 INFO:teuthology.orchestra.run.smithi173.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73716.log.gz 2024-04-25T09:15:27.075 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82485.log 2024-04-25T09:15:27.075 INFO:teuthology.orchestra.run.smithi173.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53874.log.gz 2024-04-25T09:15:27.076 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76491.log 2024-04-25T09:15:27.076 INFO:teuthology.orchestra.run.smithi173.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.85578.log.gz 2024-04-25T09:15:27.077 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85795.log 2024-04-25T09:15:27.078 INFO:teuthology.orchestra.run.smithi173.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.82485.log.gz 2024-04-25T09:15:27.078 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83503.log 2024-04-25T09:15:27.079 INFO:teuthology.orchestra.run.smithi173.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.76491.log.gz 2024-04-25T09:15:27.079 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75550.log 2024-04-25T09:15:27.080 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83503.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.85795.log.gz 2024-04-25T09:15:27.080 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34553.log 2024-04-25T09:15:27.081 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.83503.log.gz 2024-04-25T09:15:27.081 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36671.log 2024-04-25T09:15:27.081 INFO:teuthology.orchestra.run.smithi173.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.75550.log.gz 2024-04-25T09:15:27.082 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38576.log 2024-04-25T09:15:27.083 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34553.log.gz 2024-04-25T09:15:27.083 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70839.log 2024-04-25T09:15:27.084 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36671.log.gz 2024-04-25T09:15:27.084 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57592.log 2024-04-25T09:15:27.085 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38576.log.gz 2024-04-25T09:15:27.085 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69638.log 2024-04-25T09:15:27.086 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70839.log: /var/log/ceph/ceph-client.admin.57592.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70839.log.gz 2024-04-25T09:15:27.086 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55698.log 2024-04-25T09:15:27.087 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57592.log.gz 2024-04-25T09:15:27.087 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.69638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52954.log 2024-04-25T09:15:27.088 INFO:teuthology.orchestra.run.smithi173.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.69638.log.gz 2024-04-25T09:15:27.089 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53752.log 2024-04-25T09:15:27.089 INFO:teuthology.orchestra.run.smithi173.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.55698.log.gz 2024-04-25T09:15:27.090 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79696.log 2024-04-25T09:15:27.090 INFO:teuthology.orchestra.run.smithi173.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52954.log.gz 2024-04-25T09:15:27.091 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38550.log 2024-04-25T09:15:27.092 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79696.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.53752.log.gz 2024-04-25T09:15:27.092 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80053.log 2024-04-25T09:15:27.092 INFO:teuthology.orchestra.run.smithi173.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79696.log.gz 2024-04-25T09:15:27.093 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72952.log 2024-04-25T09:15:27.093 INFO:teuthology.orchestra.run.smithi173.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38550.log.gz 2024-04-25T09:15:27.094 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36070.log 2024-04-25T09:15:27.094 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7%/var/log/ceph/ceph-client.admin.72952.log: -- replaced with /var/log/ceph/ceph-client.admin.80053.log.gz 2024-04-25T09:15:27.095 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70241.log 2024-04-25T09:15:27.095 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72952.log.gz 2024-04-25T09:15:27.096 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82302.log 2024-04-25T09:15:27.096 INFO:teuthology.orchestra.run.smithi173.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36070.log.gz 2024-04-25T09:15:27.097 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53485.log 2024-04-25T09:15:27.098 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.70241.log.gz 2024-04-25T09:15:27.098 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52653.log 2024-04-25T09:15:27.098 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.82302.log.gz 2024-04-25T09:15:27.099 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37366.log 2024-04-25T09:15:27.100 INFO:teuthology.orchestra.run.smithi173.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53485.log.gz 2024-04-25T09:15:27.100 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.52653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38418.log 2024-04-25T09:15:27.100 INFO:teuthology.orchestra.run.smithi173.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52653.log.gz 2024-04-25T09:15:27.101 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80314.log 2024-04-25T09:15:27.102 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37366.log.gz 2024-04-25T09:15:27.103 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38602.log 2024-04-25T09:15:27.103 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38418.log.gz 2024-04-25T09:15:27.103 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5/var/log/ceph/ceph-client.admin.80314.log: --verbose -- /var/log/ceph/ceph-client.admin.71188.log 2024-04-25T09:15:27.106 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38602.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80314.log.gz 2024-04-25T09:15:27.106 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52121.log 2024-04-25T09:15:27.106 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38602.log.gz 2024-04-25T09:15:27.106 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.71188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72478.log 2024-04-25T09:15:27.106 INFO:teuthology.orchestra.run.smithi173.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.71188.log.gz 2024-04-25T09:15:27.107 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72874.log 2024-04-25T09:15:27.107 INFO:teuthology.orchestra.run.smithi173.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52121.log.gz 2024-04-25T09:15:27.108 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.72478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70704.log 2024-04-25T09:15:27.108 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.72478.log.gz 2024-04-25T09:15:27.109 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.72874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85520.log 2024-04-25T09:15:27.109 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72874.log.gz 2024-04-25T09:15:27.110 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54456.log 2024-04-25T09:15:27.110 INFO:teuthology.orchestra.run.smithi173.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.70704.log.gz 2024-04-25T09:15:27.111 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38066.log 2024-04-25T09:15:27.111 INFO:teuthology.orchestra.run.smithi173.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.85520.log.gz 2024-04-25T09:15:27.111 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73546.log 2024-04-25T09:15:27.112 INFO:teuthology.orchestra.run.smithi173.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54456.log.gz 2024-04-25T09:15:27.113 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55377.log 2024-04-25T09:15:27.113 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38066.log.gz 2024-04-25T09:15:27.114 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86385.log 2024-04-25T09:15:27.114 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73546.log.gz 2024-04-25T09:15:27.115 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78525.log 2024-04-25T09:15:27.116 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55377.log: /var/log/ceph/ceph-client.admin.86385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51447.log 2024-04-25T09:15:27.116 INFO:teuthology.orchestra.run.smithi173.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55377.log.gz 2024-04-25T09:15:27.116 INFO:teuthology.orchestra.run.smithi173.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86385.log.gz 2024-04-25T09:15:27.117 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.78525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72926.log 2024-04-25T09:15:27.117 INFO:teuthology.orchestra.run.smithi173.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.78525.log.gz 2024-04-25T09:15:27.118 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36567.log 2024-04-25T09:15:27.118 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51447.log.gz 2024-04-25T09:15:27.119 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.72926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77235.log 2024-04-25T09:15:27.119 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72926.log.gz 2024-04-25T09:15:27.120 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83529.log 2024-04-25T09:15:27.120 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36567.log.gz 2024-04-25T09:15:27.121 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.77235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76340.log 2024-04-25T09:15:27.121 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83529.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.77235.log.gz 2024-04-25T09:15:27.122 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38784.log 2024-04-25T09:15:27.122 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.83529.log.gz 2024-04-25T09:15:27.123 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70137.log 2024-04-25T09:15:27.123 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76340.log.gz 2024-04-25T09:15:27.124 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52448.log 2024-04-25T09:15:27.125 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76106.log 2024-04-25T09:15:27.125 INFO:teuthology.orchestra.run.smithi173.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.38784.log.gz 2024-04-25T09:15:27.125 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70137.log.gz 2024-04-25T09:15:27.126 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56676.log 2024-04-25T09:15:27.126 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52448.log.gz 2024-04-25T09:15:27.127 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5/var/log/ceph/ceph-client.admin.76106.log: --verbose -- /var/log/ceph/ceph-client.admin.76314.log 2024-04-25T09:15:27.127 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56676.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.76106.log.gz 2024-04-25T09:15:27.128 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80340.log 2024-04-25T09:15:27.129 INFO:teuthology.orchestra.run.smithi173.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56676.log.gz 2024-04-25T09:15:27.129 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70613.log 2024-04-25T09:15:27.129 INFO:teuthology.orchestra.run.smithi173.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76314.log.gz 2024-04-25T09:15:27.130 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.80340.log: /var/log/ceph/ceph-client.admin.79923.log 2024-04-25T09:15:27.131 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70613.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.80340.log.gz 2024-04-25T09:15:27.131 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36437.log 2024-04-25T09:15:27.131 INFO:teuthology.orchestra.run.smithi173.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70613.log.gz 2024-04-25T09:15:27.132 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86255.log 2024-04-25T09:15:27.132 INFO:teuthology.orchestra.run.smithi173.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.79923.log.gz 2024-04-25T09:15:27.133 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70418.log 2024-04-25T09:15:27.134 INFO:teuthology.orchestra.run.smithi173.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36437.log.gz 2024-04-25T09:15:27.134 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80915.log 2024-04-25T09:15:27.135 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86255.log.gz 2024-04-25T09:15:27.136 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36281.log 2024-04-25T09:15:27.136 INFO:teuthology.orchestra.run.smithi173.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70418.log.gz 2024-04-25T09:15:27.137 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33797.log 2024-04-25T09:15:27.137 INFO:teuthology.orchestra.run.smithi173.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.80915.log.gz 2024-04-25T09:15:27.138 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80616.log 2024-04-25T09:15:27.138 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36281.log.gz 2024-04-25T09:15:27.139 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37286.log 2024-04-25T09:15:27.139 INFO:teuthology.orchestra.run.smithi173.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33797.log.gz 2024-04-25T09:15:27.140 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38732.log 2024-04-25T09:15:27.140 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80616.log.gz 2024-04-25T09:15:27.140 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37553.log 2024-04-25T09:15:27.141 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37286.log.gz 2024-04-25T09:15:27.142 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52794.log 2024-04-25T09:15:27.142 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38732.log.gz 2024-04-25T09:15:27.143 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35647.log 2024-04-25T09:15:27.143 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37553.log.gz 2024-04-25T09:15:27.144 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86175.log 2024-04-25T09:15:27.145 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35647.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.52794.log.gz 2024-04-25T09:15:27.145 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34761.log 2024-04-25T09:15:27.145 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35647.log.gz 2024-04-25T09:15:27.146 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55500.log 2024-04-25T09:15:27.146 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86175.log.gz 2024-04-25T09:15:27.147 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82961.log 2024-04-25T09:15:27.147 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34761.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34761.log.gz 2024-04-25T09:15:27.148 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86229.log 2024-04-25T09:15:27.148 INFO:teuthology.orchestra.run.smithi173.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55500.log.gz 2024-04-25T09:15:27.149 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35000.log 2024-04-25T09:15:27.149 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82961.log.gz 2024-04-25T09:15:27.150 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83976.log 2024-04-25T09:15:27.150 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86229.log.gz 2024-04-25T09:15:27.151 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37475.log 2024-04-25T09:15:27.151 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35000.log.gz 2024-04-25T09:15:27.152 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77001.log 2024-04-25T09:15:27.152 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.83976.log.gz 2024-04-25T09:15:27.153 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52396.log 2024-04-25T09:15:27.153 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37475.log.gz 2024-04-25T09:15:27.154 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.77001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34807.log 2024-04-25T09:15:27.154 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77001.log.gz 2024-04-25T09:15:27.155 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37501.log 2024-04-25T09:15:27.155 INFO:teuthology.orchestra.run.smithi173.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52396.log.gz 2024-04-25T09:15:27.156 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82935.log 2024-04-25T09:15:27.156 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34807.log: /var/log/ceph/ceph-client.admin.37501.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34807.log.gz 2024-04-25T09:15:27.157 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38327.log 2024-04-25T09:15:27.157 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37501.log.gz 2024-04-25T09:15:27.158 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35725.log 2024-04-25T09:15:27.158 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82935.log.gz 2024-04-25T09:15:27.159 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37018.log 2024-04-25T09:15:27.159 INFO:teuthology.orchestra.run.smithi173.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38327.log.gz 2024-04-25T09:15:27.160 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35725.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35725.log.gz 2024-04-25T09:15:27.160 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T09:15:27.161 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80896.log 2024-04-25T09:15:27.161 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37018.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37018.log.gz 2024-04-25T09:15:27.162 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56397.log 2024-04-25T09:15:27.163 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.80896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.80896.log.gz 2024-04-25T09:15:27.163 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83607.log 2024-04-25T09:15:27.164 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53974.log 2024-04-25T09:15:27.164 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56397.log.gz 2024-04-25T09:15:27.166 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56054.log 2024-04-25T09:15:27.166 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.83607.log.gz 2024-04-25T09:15:27.167 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34003.log 2024-04-25T09:15:27.168 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.56054.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53974.log.gz 2024-04-25T09:15:27.168 INFO:teuthology.orchestra.run.smithi173.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56054.log.gz 2024-04-25T09:15:27.168 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56319.log 2024-04-25T09:15:27.169 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80431.log 2024-04-25T09:15:27.169 INFO:teuthology.orchestra.run.smithi173.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34003.log.gz 2024-04-25T09:15:27.170 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37865.log 2024-04-25T09:15:27.170 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56319.log.gz 2024-04-25T09:15:27.171 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82355.log 2024-04-25T09:15:27.172 INFO:teuthology.orchestra.run.smithi173.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.80431.log.gz 2024-04-25T09:15:27.173 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55473.log 2024-04-25T09:15:27.173 INFO:teuthology.orchestra.run.smithi173.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37865.log.gz 2024-04-25T09:15:27.174 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83716.log 2024-04-25T09:15:27.174 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.82355.log.gz 2024-04-25T09:15:27.174 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.55473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55473.log.gz 2024-04-25T09:15:27.175 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83846.log 2024-04-25T09:15:27.176 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76886.log 2024-04-25T09:15:27.176 INFO:teuthology.orchestra.run.smithi173.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.83716.log.gz 2024-04-25T09:15:27.177 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86123.log 2024-04-25T09:15:27.177 INFO:teuthology.orchestra.run.smithi173.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83846.log.gz 2024-04-25T09:15:27.178 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57425.log 2024-04-25T09:15:27.178 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.76886.log.gz 2024-04-25T09:15:27.180 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76751.log 2024-04-25T09:15:27.180 INFO:teuthology.orchestra.run.smithi173.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.86123.log.gz 2024-04-25T09:15:27.180 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.57425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56131.log 2024-04-25T09:15:27.181 INFO:teuthology.orchestra.run.smithi173.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57425.log.gz 2024-04-25T09:15:27.181 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38249.log 2024-04-25T09:15:27.181 INFO:teuthology.orchestra.run.smithi173.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76751.log.gz 2024-04-25T09:15:27.182 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35215.log 2024-04-25T09:15:27.183 INFO:teuthology.orchestra.run.smithi173.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.56131.log.gz 2024-04-25T09:15:27.184 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79748.log 2024-04-25T09:15:27.184 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38249.log.gz 2024-04-25T09:15:27.185 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36463.log 2024-04-25T09:15:27.185 INFO:teuthology.orchestra.run.smithi173.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35215.log.gz 2024-04-25T09:15:27.186 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56345.log 2024-04-25T09:15:27.186 INFO:teuthology.orchestra.run.smithi173.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.79748.log.gz 2024-04-25T09:15:27.187 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80235.log 2024-04-25T09:15:27.187 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36463.log.gz 2024-04-25T09:15:27.188 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55221.log 2024-04-25T09:15:27.188 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56345.log.gz 2024-04-25T09:15:27.189 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82747.log 2024-04-25T09:15:27.189 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.80235.log.gz 2024-04-25T09:15:27.190 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77053.log 2024-04-25T09:15:27.190 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55221.log.gz 2024-04-25T09:15:27.191 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34709.log 2024-04-25T09:15:27.191 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82747.log.gz 2024-04-25T09:15:27.192 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.77053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35230.log 2024-04-25T09:15:27.192 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.77053.log.gz 2024-04-25T09:15:27.193 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36050.log 2024-04-25T09:15:27.194 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34709.log.gz 2024-04-25T09:15:27.195 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54998.log 2024-04-25T09:15:27.195 INFO:teuthology.orchestra.run.smithi173.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35230.log.gz 2024-04-25T09:15:27.196 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.36050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36050.log.gz 2024-04-25T09:15:27.196 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55796.log 2024-04-25T09:15:27.197 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80850.log 2024-04-25T09:15:27.197 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54998.log.gz 2024-04-25T09:15:27.198 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55661.log 2024-04-25T09:15:27.198 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55796.log.gz 2024-04-25T09:15:27.199 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80105.log 2024-04-25T09:15:27.199 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.80850.log.gz 2024-04-25T09:15:27.200 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75833.log 2024-04-25T09:15:27.201 INFO:teuthology.orchestra.run.smithi173.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.55661.log.gz 2024-04-25T09:15:27.201 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36854.log 2024-04-25T09:15:27.202 INFO:teuthology.orchestra.run.smithi173.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.80105.log.gz 2024-04-25T09:15:27.203 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83405.log 2024-04-25T09:15:27.203 INFO:teuthology.orchestra.run.smithi173.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.75833.log.gz 2024-04-25T09:15:27.204 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82328.log 2024-04-25T09:15:27.204 INFO:teuthology.orchestra.run.smithi173.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36854.log.gz 2024-04-25T09:15:27.205 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52924.log 2024-04-25T09:15:27.205 INFO:teuthology.orchestra.run.smithi173.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.83405.log.gz 2024-04-25T09:15:27.206 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53295.log 2024-04-25T09:15:27.206 INFO:teuthology.orchestra.run.smithi173.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.82328.log.gz 2024-04-25T09:15:27.207 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83065.log 2024-04-25T09:15:27.207 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52924.log.gz 2024-04-25T09:15:27.208 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56845.log 2024-04-25T09:15:27.208 INFO:teuthology.orchestra.run.smithi173.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.53295.log.gz 2024-04-25T09:15:27.209 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56754.log 2024-04-25T09:15:27.209 INFO:teuthology.orchestra.run.smithi173.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.83065.log.gz 2024-04-25T09:15:27.210 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85848.log 2024-04-25T09:15:27.210 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56845.log.gz 2024-04-25T09:15:27.211 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53120.log 2024-04-25T09:15:27.212 INFO:teuthology.orchestra.run.smithi173.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56754.log.gz 2024-04-25T09:15:27.212 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54854.log 2024-04-25T09:15:27.213 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.85848.log.gz 2024-04-25T09:15:27.213 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76628.log 2024-04-25T09:15:27.214 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53120.log.gz 2024-04-25T09:15:27.214 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38355.log 2024-04-25T09:15:27.215 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54854.log.gz 2024-04-25T09:15:27.216 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76628.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.76628.log.gz 2024-04-25T09:15:27.217 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52844.log 2024-04-25T09:15:27.217 INFO:teuthology.orchestra.run.smithi173.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38355.log.gz 2024-04-25T09:15:27.217 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79670.log 2024-04-25T09:15:27.219 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51259.log 2024-04-25T09:15:27.219 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52844.log.gz 2024-04-25T09:15:27.220 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80720.log 2024-04-25T09:15:27.220 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.79670.log.gz 2024-04-25T09:15:27.221 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71006.log 2024-04-25T09:15:27.221 INFO:teuthology.orchestra.run.smithi173.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51259.log.gz 2024-04-25T09:15:27.222 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57399.log 2024-04-25T09:15:27.222 INFO:teuthology.orchestra.run.smithi173.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.80720.log.gz 2024-04-25T09:15:27.223 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.71006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35569.log 2024-04-25T09:15:27.223 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71006.log.gz 2024-04-25T09:15:27.224 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.57399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34444.log 2024-04-25T09:15:27.224 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57399.log.gz 2024-04-25T09:15:27.225 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71084.log 2024-04-25T09:15:27.226 INFO:teuthology.orchestra.run.smithi173.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35569.log.gz 2024-04-25T09:15:27.226 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77209.log 2024-04-25T09:15:27.227 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34444.log.gz 2024-04-25T09:15:27.227 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.71084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78625.log 2024-04-25T09:15:27.227 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.71084.log.gz 2024-04-25T09:15:27.229 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.77209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86411.log 2024-04-25T09:15:27.229 INFO:teuthology.orchestra.run.smithi173.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77209.log.gz 2024-04-25T09:15:27.229 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.78625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38498.log 2024-04-25T09:15:27.230 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86411.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.78625.log.gz 2024-04-25T09:15:27.231 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74178.log 2024-04-25T09:15:27.231 INFO:teuthology.orchestra.run.smithi173.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86411.log.gz 2024-04-25T09:15:27.232 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37392.log 2024-04-25T09:15:27.232 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38498.log.gz 2024-04-25T09:15:27.233 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55953.log 2024-04-25T09:15:27.233 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.74178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.74178.log.gz 2024-04-25T09:15:27.234 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37392.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T09:15:27.234 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37392.log.gz 2024-04-25T09:15:27.235 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80396.log 2024-04-25T09:15:27.236 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.1.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.55953.log.gz 2024-04-25T09:15:27.236 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51421.log 2024-04-25T09:15:27.237 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80746.log 2024-04-25T09:15:27.238 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.80396.log.gz 2024-04-25T09:15:27.238 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51421.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51421.log.gz 2024-04-25T09:15:27.239 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27570.log 2024-04-25T09:15:27.240 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80746.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.80746.log.gz 2024-04-25T09:15:27.240 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51499.log 2024-04-25T09:15:27.241 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.27570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70189.log 2024-04-25T09:15:27.243 INFO:teuthology.orchestra.run.smithi173.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.27570.log.gz/var/log/ceph/ceph-client.admin.51499.log: 2024-04-25T09:15:27.243 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51499.log.gz 2024-04-25T09:15:27.243 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75970.log 2024-04-25T09:15:27.244 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71241.log 2024-04-25T09:15:27.245 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.70189.log.gz 2024-04-25T09:15:27.245 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54299.log 2024-04-25T09:15:27.246 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75970.log.gz 2024-04-25T09:15:27.247 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.71241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72628.log 2024-04-25T09:15:27.248 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54299.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.71241.log.gz 2024-04-25T09:15:27.248 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54299.log.gz 2024-04-25T09:15:27.248 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38758.log 2024-04-25T09:15:27.249 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.72628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50945.log 2024-04-25T09:15:27.250 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38758.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.72628.log.gz 2024-04-25T09:15:27.251 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38758.log.gz 2024-04-25T09:15:27.251 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.50945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37579.log 2024-04-25T09:15:27.252 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50945.log.gz 2024-04-25T09:15:27.253 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33849.log 2024-04-25T09:15:27.254 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36177.log 2024-04-25T09:15:27.254 INFO:teuthology.orchestra.run.smithi173.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37579.log.gz 2024-04-25T09:15:27.255 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83372.log 2024-04-25T09:15:27.255 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33849.log.gz 2024-04-25T09:15:27.256 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37127.log 2024-04-25T09:15:27.256 INFO:teuthology.orchestra.run.smithi173.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36177.log.gz 2024-04-25T09:15:27.257 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83372.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.83372.log.gz 2024-04-25T09:15:27.258 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52370.log 2024-04-25T09:15:27.258 INFO:teuthology.orchestra.run.smithi194.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T09:15:27.259 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37127.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37127.log.gz 2024-04-25T09:15:27.259 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37205.log 2024-04-25T09:15:27.260 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70163.log 2024-04-25T09:15:27.261 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52370.log.gz 2024-04-25T09:15:27.261 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86620.log 2024-04-25T09:15:27.261 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37205.log.gz 2024-04-25T09:15:27.262 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76262.log 2024-04-25T09:15:27.263 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70163.log.gz 2024-04-25T09:15:27.264 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86620.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.86620.log.gz 2024-04-25T09:15:27.264 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55351.log 2024-04-25T09:15:27.265 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76262.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.76262.log.gz 2024-04-25T09:15:27.265 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57241.log 2024-04-25T09:15:27.266 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77105.log 2024-04-25T09:15:27.267 INFO:teuthology.orchestra.run.smithi173.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55351.log.gz 2024-04-25T09:15:27.268 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.57241.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57241.log.gz 2024-04-25T09:15:27.269 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.77105.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77105.log.gz 2024-04-25T09:15:27.269 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53720.log 2024-04-25T09:15:27.270 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38118.log 2024-04-25T09:15:27.272 INFO:teuthology.orchestra.run.smithi173.stderr:gzip/var/log/ceph/ceph-client.admin.53720.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.83091.log 2024-04-25T09:15:27.272 INFO:teuthology.orchestra.run.smithi173.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53720.log.gz 2024-04-25T09:15:27.273 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38118.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38118.log.gz 2024-04-25T09:15:27.274 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52238.log 2024-04-25T09:15:27.274 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.83091.log.gz 2024-04-25T09:15:27.275 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34805.log 2024-04-25T09:15:27.276 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84002.log 2024-04-25T09:15:27.276 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52238.log.gz 2024-04-25T09:15:27.277 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34805.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34805.log.gz 2024-04-25T09:15:27.277 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69897.log 2024-04-25T09:15:27.278 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.84002.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.84002.log.gz 2024-04-25T09:15:27.279 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57451.log 2024-04-25T09:15:27.279 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.69897.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69897.log.gz 2024-04-25T09:15:27.281 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.57451.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.57451.log.gz 2024-04-25T09:15:27.281 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51780.log 2024-04-25T09:15:27.282 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57043.log 2024-04-25T09:15:27.284 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38383.log 2024-04-25T09:15:27.284 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51780.log.gz 2024-04-25T09:15:27.285 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.57043.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57043.log.gz 2024-04-25T09:15:27.286 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38383.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38383.log.gz 2024-04-25T09:15:27.286 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79774.log 2024-04-25T09:15:27.287 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37735.log 2024-04-25T09:15:27.289 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37231.log 2024-04-25T09:15:27.289 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.79774.log.gz 2024-04-25T09:15:27.290 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37735.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37735.log.gz 2024-04-25T09:15:27.291 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37231.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37231.log.gz 2024-04-25T09:15:27.291 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80772.log 2024-04-25T09:15:27.292 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56989.log 2024-04-25T09:15:27.294 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34815.log 2024-04-25T09:15:27.294 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.80772.log.gz 2024-04-25T09:15:27.295 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79397.log 2024-04-25T09:15:27.295 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56989.log.gz 2024-04-25T09:15:27.296 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34815.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34815.log.gz 2024-04-25T09:15:27.297 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86596.log 2024-04-25T09:15:27.298 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79397.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.79397.log.gz 2024-04-25T09:15:27.298 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82635.log 2024-04-25T09:15:27.299 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54508.log 2024-04-25T09:15:27.300 INFO:teuthology.orchestra.run.smithi173.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86596.log.gz 2024-04-25T09:15:27.300 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82635.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.82635.log.gz 2024-04-25T09:15:27.301 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54508.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54508.log.gz 2024-04-25T09:15:27.302 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79265.log 2024-04-25T09:15:27.303 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52041.log 2024-04-25T09:15:27.305 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34313.log 2024-04-25T09:15:27.305 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.79265.log.gz 2024-04-25T09:15:27.305 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52041.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52041.log.gz 2024-04-25T09:15:27.306 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34313.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34313.log.gz 2024-04-25T09:15:27.307 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35229.log 2024-04-25T09:15:27.308 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35006.log 2024-04-25T09:15:27.310 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38706.log 2024-04-25T09:15:27.310 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35229.log.gz 2024-04-25T09:15:27.311 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35006.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35006.log.gz 2024-04-25T09:15:27.311 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38706.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38706.log.gz 2024-04-25T09:15:27.312 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82252.log 2024-04-25T09:15:27.313 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74030.log 2024-04-25T09:15:27.315 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77157.log 2024-04-25T09:15:27.315 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.74030.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.82252.log.gz 2024-04-25T09:15:27.316 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74030.log.gz 2024-04-25T09:15:27.316 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.77157.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.77157.log.gz 2024-04-25T09:15:27.317 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85384.log 2024-04-25T09:15:27.318 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54971.log 2024-04-25T09:15:27.320 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35621.log 2024-04-25T09:15:27.321 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54971.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.85384.log.gz 2024-04-25T09:15:27.321 INFO:teuthology.orchestra.run.smithi173.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54971.log.gz 2024-04-25T09:15:27.321 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35621.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35621.log.gz 2024-04-25T09:15:27.322 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51989.log 2024-04-25T09:15:27.323 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83663.log 2024-04-25T09:15:27.325 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84028.log 2024-04-25T09:15:27.325 INFO:teuthology.orchestra.run.smithi173.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51989.log.gz 2024-04-25T09:15:27.326 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34814.log 2024-04-25T09:15:27.326 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.83663.log.gz 2024-04-25T09:15:27.327 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.84028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73599.log 2024-04-25T09:15:27.327 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.84028.log.gz 2024-04-25T09:15:27.328 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34814.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34814.log.gz 2024-04-25T09:15:27.328 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54605.log 2024-04-25T09:15:27.329 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73599.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73599.log.gz 2024-04-25T09:15:27.330 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51285.log 2024-04-25T09:15:27.331 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86489.log 2024-04-25T09:15:27.332 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54605.log.gz 2024-04-25T09:15:27.332 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73311.log 2024-04-25T09:15:27.333 INFO:teuthology.orchestra.run.smithi194.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T09:15:27.333 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51285.log.gz 2024-04-25T09:15:27.333 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86489.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.86489.log.gz 2024-04-25T09:15:27.334 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70001.log 2024-04-25T09:15:27.335 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73311.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73311.log.gz 2024-04-25T09:15:27.335 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37070.log 2024-04-25T09:15:27.336 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75577.log 2024-04-25T09:15:27.336 INFO:teuthology.orchestra.run.smithi173.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70001.log.gz 2024-04-25T09:15:27.338 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37070.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37070.log.gz 2024-04-25T09:15:27.338 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56624.log 2024-04-25T09:15:27.339 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75577.log.gz 2024-04-25T09:15:27.340 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35021.log 2024-04-25T09:15:27.341 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53345.log 2024-04-25T09:15:27.342 INFO:teuthology.orchestra.run.smithi173.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56624.log.gz 2024-04-25T09:15:27.342 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79161.log 2024-04-25T09:15:27.342 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35021.log.gz 2024-04-25T09:15:27.343 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54024.log 2024-04-25T09:15:27.344 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53345.log.gz 2024-04-25T09:15:27.344 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79161.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.79161.log.gz 2024-04-25T09:15:27.345 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56267.log 2024-04-25T09:15:27.346 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38092.log 88.8% 2024-04-25T09:15:27.346 INFO:teuthology.orchestra.run.smithi173.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54024.log.gz 2024-04-25T09:15:27.347 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54241.log 2024-04-25T09:15:27.347 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56267.log.gz 2024-04-25T09:15:27.348 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79423.log 2024-04-25T09:15:27.348 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38092.log.gz 2024-04-25T09:15:27.349 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70522.log 2024-04-25T09:15:27.349 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54241.log.gz 2024-04-25T09:15:27.351 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79423.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.79423.log.gz 2024-04-25T09:15:27.351 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52422.log 2024-04-25T09:15:27.352 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70522.log: gzip -5 87.9% --verbose -- replaced with /var/log/ceph/ceph-client.admin.70522.log.gz -- 2024-04-25T09:15:27.352 INFO:teuthology.orchestra.run.smithi173.stderr: /var/log/ceph/ceph-client.admin.51207.log 2024-04-25T09:15:27.353 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35439.log 2024-04-25T09:15:27.353 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52422.log.gz 2024-04-25T09:15:27.355 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51207.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51207.log.gz 2024-04-25T09:15:27.355 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76132.log 2024-04-25T09:15:27.355 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35439.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35439.log.gz 2024-04-25T09:15:27.356 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73422.log 2024-04-25T09:15:27.357 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54273.log 2024-04-25T09:15:27.357 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.76132.log.gz 2024-04-25T09:15:27.359 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73422.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79291.log 2024-04-25T09:15:27.359 INFO:teuthology.orchestra.run.smithi173.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73422.log.gz 2024-04-25T09:15:27.360 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54273.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54273.log.gz 2024-04-25T09:15:27.361 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54789.log 2024-04-25T09:15:27.362 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79291.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.79291.log.gz 2024-04-25T09:15:27.362 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76858.log 2024-04-25T09:15:27.363 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79213.log 2024-04-25T09:15:27.364 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54789.log.gz 2024-04-25T09:15:27.364 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76858.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.76858.log.gz 2024-04-25T09:15:27.365 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51099.log 2024-04-25T09:15:27.366 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79213.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.79213.log.gz 2024-04-25T09:15:27.366 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T09:15:27.368 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79343.log 2024-04-25T09:15:27.368 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51099.log.gz 2024-04-25T09:15:27.369 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79343.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.79343.log.gz 2024-04-25T09:15:27.370 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77389.log 2024-04-25T09:15:27.371 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75729.log 2024-04-25T09:15:27.372 INFO:teuthology.orchestra.run.smithi173.stderr: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T09:15:27.372 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.77389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.77389.log.gz 2024-04-25T09:15:27.373 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75729.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75729.log.gz 2024-04-25T09:15:27.374 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80368.log 2024-04-25T09:15:27.375 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70496.log 2024-04-25T09:15:27.377 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35004.log 2024-04-25T09:15:27.377 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.80368.log.gz 2024-04-25T09:15:27.377 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70496.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70496.log.gz 2024-04-25T09:15:27.379 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35004.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35004.log.gz 2024-04-25T09:15:27.379 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75996.log 2024-04-25T09:15:27.380 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76236.log 2024-04-25T09:15:27.382 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80798.log 2024-04-25T09:15:27.382 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75996.log.gz 2024-04-25T09:15:27.383 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76236.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76236.log.gz 2024-04-25T09:15:27.384 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80798.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.80798.log.gz 2024-04-25T09:15:27.385 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54189.log 2024-04-25T09:15:27.386 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79239.log 2024-04-25T09:15:27.388 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75470.log 2024-04-25T09:15:27.388 INFO:teuthology.orchestra.run.smithi173.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54189.log.gz 2024-04-25T09:15:27.388 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79239.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.79239.log.gz 2024-04-25T09:15:27.389 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75470.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75470.log.gz 2024-04-25T09:15:27.390 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73874.log 2024-04-25T09:15:27.391 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33478.log 2024-04-25T09:15:27.393 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35465.log 2024-04-25T09:15:27.393 INFO:teuthology.orchestra.run.smithi173.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73874.log.gz 2024-04-25T09:15:27.393 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56650.log 2024-04-25T09:15:27.394 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33478.log.gz 2024-04-25T09:15:27.394 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35465.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35465.log.gz 2024-04-25T09:15:27.395 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37969.log 2024-04-25T09:15:27.396 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56650.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56650.log.gz 2024-04-25T09:15:27.396 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70215.log 2024-04-25T09:15:27.397 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75629.log 2024-04-25T09:15:27.398 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37969.log.gz 2024-04-25T09:15:27.398 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70215.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.70215.log.gz 2024-04-25T09:15:27.399 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85442.log 2024-04-25T09:15:27.400 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37340.log 2024-04-25T09:15:27.400 INFO:teuthology.orchestra.run.smithi173.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.75629.log.gz 2024-04-25T09:15:27.401 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57293.log 2024-04-25T09:15:27.401 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.85442.log.gz 2024-04-25T09:15:27.402 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37340.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37340.log.gz 2024-04-25T09:15:27.402 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38301.log 2024-04-25T09:15:27.403 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.57293.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57293.log.gz 2024-04-25T09:15:27.404 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79085.log 2024-04-25T09:15:27.405 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56728.log 2024-04-25T09:15:27.405 INFO:teuthology.orchestra.run.smithi173.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38301.log.gz 2024-04-25T09:15:27.406 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34340.log 2024-04-25T09:15:27.407 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56728.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.79085.log.gz 2024-04-25T09:15:27.407 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56728.log.gz 2024-04-25T09:15:27.408 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34340.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34340.log.gz 2024-04-25T09:15:27.409 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33583.log 2024-04-25T09:15:27.410 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86045.log 2024-04-25T09:15:27.411 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70757.log 2024-04-25T09:15:27.412 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33583.log.gz 2024-04-25T09:15:27.412 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86045.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86045.log.gz 2024-04-25T09:15:27.413 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70757.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70757.log.gz 2024-04-25T09:15:27.414 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52212.log 2024-04-25T09:15:27.415 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56813.log 2024-04-25T09:15:27.416 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70033.log 2024-04-25T09:15:27.416 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52212.log.gz 2024-04-25T09:15:27.418 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56813.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56813.log.gz 2024-04-25T09:15:27.419 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70033.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70033.log.gz 2024-04-25T09:15:27.419 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37179.log 2024-04-25T09:15:27.420 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27687.log 2024-04-25T09:15:27.422 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69738.log 2024-04-25T09:15:27.422 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37179.log.gz 2024-04-25T09:15:27.423 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.27687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38470.log 2024-04-25T09:15:27.423 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27687.log.gz 2024-04-25T09:15:27.424 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.69738.log: /var/log/ceph/ceph-client.admin.38470.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.69738.log.gz 2024-04-25T09:15:27.425 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83117.log 2024-04-25T09:15:27.425 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38470.log.gz 2024-04-25T09:15:27.425 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73625.log 2024-04-25T09:15:27.427 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34657.log 2024-04-25T09:15:27.427 INFO:teuthology.orchestra.run.smithi173.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.83117.log.gz 2024-04-25T09:15:27.428 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85742.log 2024-04-25T09:15:27.428 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73625.log.gz 2024-04-25T09:15:27.430 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34657.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34657.log.gz 2024-04-25T09:15:27.430 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85742.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.85742.log.gz 2024-04-25T09:15:27.431 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33609.log 2024-04-25T09:15:27.432 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83320.log 2024-04-25T09:15:27.433 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73822.log 2024-04-25T09:15:27.434 INFO:teuthology.orchestra.run.smithi173.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33609.log.gz 2024-04-25T09:15:27.435 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86646.log 2024-04-25T09:15:27.435 INFO:teuthology.orchestra.run.smithi173.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.83320.log.gz 2024-04-25T09:15:27.435 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73822.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73822.log.gz 2024-04-25T09:15:27.436 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51311.log 2024-04-25T09:15:27.437 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37044.log 2024-04-25T09:15:27.437 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.86646.log.gz 2024-04-25T09:15:27.438 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82825.log 2024-04-25T09:15:27.438 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51311.log.gz 2024-04-25T09:15:27.440 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37044.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37044.log.gz 2024-04-25T09:15:27.441 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82825.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.82825.log.gz 2024-04-25T09:15:27.441 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73978.log 2024-04-25T09:15:27.442 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73082.log 2024-04-25T09:15:27.444 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86437.log 2024-04-25T09:15:27.444 INFO:teuthology.orchestra.run.smithi173.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.73978.log.gz 2024-04-25T09:15:27.445 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73082.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.73082.log.gz 2024-04-25T09:15:27.445 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54378.log 2024-04-25T09:15:27.446 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86437.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.86437.log.gz 2024-04-25T09:15:27.446 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69688.log 2024-04-25T09:15:27.448 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85945.log 2024-04-25T09:15:27.448 INFO:teuthology.orchestra.run.smithi173.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54378.log.gz 2024-04-25T09:15:27.450 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.69688.log: /var/log/ceph/ceph-client.admin.85945.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.69688.log.gz 2024-04-25T09:15:27.450 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76830.log 2024-04-25T09:15:27.450 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.85945.log.gz 2024-04-25T09:15:27.451 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80694.log 2024-04-25T09:15:27.452 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80079.log 2024-04-25T09:15:27.452 INFO:teuthology.orchestra.run.smithi173.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.76830.log.gz 2024-04-25T09:15:27.454 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80694.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80694.log.gz 2024-04-25T09:15:27.454 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57477.log 2024-04-25T09:15:27.454 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80079.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.80079.log.gz 2024-04-25T09:15:27.455 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56235.log 2024-04-25T09:15:27.456 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.57477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55634.log 2024-04-25T09:15:27.457 INFO:teuthology.orchestra.run.smithi173.stderr: 90.9%/var/log/ceph/ceph-client.admin.56235.log: -- replaced with /var/log/ceph/ceph-client.admin.57477.log.gz 2024-04-25T09:15:27.457 INFO:teuthology.orchestra.run.smithi173.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56235.log.gz 2024-04-25T09:15:27.459 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55634.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55634.log.gz 2024-04-25T09:15:27.459 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73742.log 2024-04-25T09:15:27.460 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80538.log 2024-04-25T09:15:27.462 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55115.log 2024-04-25T09:15:27.462 INFO:teuthology.orchestra.run.smithi173.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.73742.log.gz 2024-04-25T09:15:27.463 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80538.log: gzip 88.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.80538.log.gz -- 2024-04-25T09:15:27.463 INFO:teuthology.orchestra.run.smithi173.stderr: /var/log/ceph/ceph-client.admin.85971.log 2024-04-25T09:15:27.464 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83794.log 2024-04-25T09:15:27.466 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55115.log.gz 2024-04-25T09:15:27.466 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51754.log 2024-04-25T09:15:27.466 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.85971.log.gz 2024-04-25T09:15:27.466 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83794.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.83794.log.gz 2024-04-25T09:15:27.468 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51754.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51754.log.gz 2024-04-25T09:15:27.468 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.36152.log 2024-04-25T09:15:27.469 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51629.log 2024-04-25T09:15:27.471 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.2.36152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80457.log 2024-04-25T09:15:27.471 INFO:teuthology.orchestra.run.smithi173.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.36152.log.gz 2024-04-25T09:15:27.472 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54735.log 2024-04-25T09:15:27.472 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51629.log.gz 2024-04-25T09:15:27.473 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80457.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.80457.log.gz 2024-04-25T09:15:27.474 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35231.log 2024-04-25T09:15:27.474 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54735.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54735.log.gz 2024-04-25T09:15:27.475 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86515.log 2024-04-25T09:15:27.476 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37527.log 2024-04-25T09:15:27.476 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35231.log.gz 2024-04-25T09:15:27.477 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86515.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86515.log.gz 2024-04-25T09:15:27.478 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51891.log 2024-04-25T09:15:27.478 INFO:teuthology.orchestra.run.smithi173.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37527.log.gz 2024-04-25T09:15:27.479 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85874.log 2024-04-25T09:15:27.480 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76973.log 2024-04-25T09:15:27.480 INFO:teuthology.orchestra.run.smithi173.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51891.log.gz 2024-04-25T09:15:27.482 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85874.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.85874.log.gz 2024-04-25T09:15:27.482 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76973.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76973.log.gz 2024-04-25T09:15:27.483 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55427.log 2024-04-25T09:15:27.484 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84055.log 2024-04-25T09:15:27.485 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85822.log 2024-04-25T09:15:27.486 INFO:teuthology.orchestra.run.smithi173.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55427.log.gz 2024-04-25T09:15:27.486 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.84055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79456.log 2024-04-25T09:15:27.487 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85822.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.84055.log.gz 2024-04-25T09:15:27.488 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72900.log 2024-04-25T09:15:27.488 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.85822.log.gz 2024-04-25T09:15:27.489 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36359.log 2024-04-25T09:15:27.489 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.79456.log.gz 2024-04-25T09:15:27.490 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.72900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79009.log 2024-04-25T09:15:27.490 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72900.log.gz 2024-04-25T09:15:27.492 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36359.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36359.log.gz 2024-04-25T09:15:27.492 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85546.log 2024-04-25T09:15:27.492 INFO:teuthology.orchestra.run.smithi173.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.79009.log.gz 2024-04-25T09:15:27.493 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75524.log 2024-04-25T09:15:27.494 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57109.log 2024-04-25T09:15:27.495 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.85546.log.gz 2024-04-25T09:15:27.496 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75524.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.75524.log.gz 2024-04-25T09:15:27.497 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.57109.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57109.log.gz 2024-04-25T09:15:27.497 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75755.log 2024-04-25T09:15:27.499 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78805.log 2024-04-25T09:15:27.500 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35413.log 2024-04-25T09:15:27.500 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.75755.log.gz 2024-04-25T09:15:27.502 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.78805.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78805.log.gz 2024-04-25T09:15:27.502 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83294.log 2024-04-25T09:15:27.502 INFO:teuthology.orchestra.run.smithi173.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35413.log.gz 2024-04-25T09:15:27.503 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37657.log 2024-04-25T09:15:27.504 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79135.log 2024-04-25T09:15:27.504 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.83294.log.gz 2024-04-25T09:15:27.506 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37657.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37657.log.gz 2024-04-25T09:15:27.507 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79135.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.79135.log.gz 2024-04-25T09:15:27.507 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52184.log 2024-04-25T09:15:27.508 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52526.log 2024-04-25T09:15:27.510 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80668.log 2024-04-25T09:15:27.510 INFO:teuthology.orchestra.run.smithi173.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52184.log.gz 2024-04-25T09:15:27.511 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70811.log 2024-04-25T09:15:27.511 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52526.log.gz 2024-04-25T09:15:27.512 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80668.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.80668.log.gz 2024-04-25T09:15:27.512 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36992.log 2024-04-25T09:15:27.513 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70811.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.70811.log.gz 2024-04-25T09:15:27.513 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86307.log 2024-04-25T09:15:27.518 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70319.log 2024-04-25T09:15:27.518 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36992.log.gz 2024-04-25T09:15:27.518 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86307.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86307.log.gz 2024-04-25T09:15:27.518 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70319.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70319.log.gz 2024-04-25T09:15:27.518 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73796.log 2024-04-25T09:15:27.519 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74132.log 2024-04-25T09:15:27.520 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73796.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.73796.log.gz 2024-04-25T09:15:27.520 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56780.log 2024-04-25T09:15:27.522 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.74132.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.74132.log.gz 2024-04-25T09:15:27.522 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34418.log 2024-04-25T09:15:27.523 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85468.log 2024-04-25T09:15:27.523 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56780.log.gz 2024-04-25T09:15:27.524 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73108.log 2024-04-25T09:15:27.524 INFO:teuthology.orchestra.run.smithi173.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34418.log.gz 2024-04-25T09:15:27.526 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85468.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.85468.log.gz 2024-04-25T09:15:27.526 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73108.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.73108.log.gz 2024-04-25T09:15:27.527 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52684.log 2024-04-25T09:15:27.528 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83898.log 2024-04-25T09:15:27.530 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80287.log 2024-04-25T09:15:27.530 INFO:teuthology.orchestra.run.smithi173.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52684.log.gz 2024-04-25T09:15:27.530 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83898.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.83898.log.gz 2024-04-25T09:15:27.532 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80287.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.80287.log.gz 2024-04-25T09:15:27.533 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34808.log 2024-04-25T09:15:27.533 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86149.log 2024-04-25T09:15:27.535 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77183.log 2024-04-25T09:15:27.535 INFO:teuthology.orchestra.run.smithi173.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34808.log.gz 2024-04-25T09:15:27.536 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86149.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86149.log.gz 2024-04-25T09:15:27.537 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.77183.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77183.log.gz 2024-04-25T09:15:27.537 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84151.log 2024-04-25T09:15:27.538 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55052.log 2024-04-25T09:15:27.540 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.84151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76439.log 2024-04-25T09:15:27.540 INFO:teuthology.orchestra.run.smithi173.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.84151.log.gz 2024-04-25T09:15:27.541 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55052.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T09:15:27.541 INFO:teuthology.orchestra.run.smithi173.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55052.log.gz 2024-04-25T09:15:27.542 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76158.log 2024-04-25T09:15:27.543 INFO:teuthology.orchestra.run.smithi173.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76439.log.gz 2024-04-25T09:15:27.544 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.76158.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.76158.log.gz 2024-04-25T09:15:27.545 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T09:15:27.546 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36906.log 2024-04-25T09:15:27.547 INFO:teuthology.orchestra.run.smithi173.stderr: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz/var/log/ceph/ceph-mds.c.log: 2024-04-25T09:15:27.548 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36906.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36906.log.gz 2024-04-25T09:15:27.549 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76543.log 2024-04-25T09:15:27.550 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75320.log 2024-04-25T09:15:27.552 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76543.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.76543.log.gz 2024-04-25T09:15:27.553 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75320.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.75320.log.gz 2024-04-25T09:15:27.554 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35007.log 2024-04-25T09:15:27.555 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55325.log 2024-04-25T09:15:27.556 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35007.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35007.log.gz 2024-04-25T09:15:27.557 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55325.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55325.log.gz 2024-04-25T09:15:27.558 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36802.log 2024-04-25T09:15:27.559 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73231.log 2024-04-25T09:15:27.561 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36802.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36802.log.gz 2024-04-25T09:15:27.561 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73231.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73231.log.gz 2024-04-25T09:15:27.562 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35491.log 2024-04-25T09:15:27.563 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T09:15:27.567 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35491.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.35491.log.gz 2024-04-25T09:15:27.567 INFO:teuthology.orchestra.run.smithi173.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56702.log 2024-04-25T09:15:27.567 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.56702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70581.log 2024-04-25T09:15:27.567 INFO:teuthology.orchestra.run.smithi173.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56702.log.gz 2024-04-25T09:15:27.570 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70581.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.70581.log.gz 2024-04-25T09:15:27.571 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55697.log 2024-04-25T09:15:27.573 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35673.log 2024-04-25T09:15:27.574 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55697.log.gz 2024-04-25T09:15:27.576 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33380.log 2024-04-25T09:15:27.577 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35673.log.gz 2024-04-25T09:15:27.579 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72978.log 2024-04-25T09:15:27.583 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.72978.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72978.log.gz 2024-04-25T09:15:27.583 INFO:teuthology.orchestra.run.smithi173.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33380.log.gz 2024-04-25T09:15:27.584 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38901.log 2024-04-25T09:15:27.586 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38901.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38901.log.gz 2024-04-25T09:15:27.586 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54137.log 2024-04-25T09:15:27.589 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37423.log 2024-04-25T09:15:27.589 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54137.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54137.log.gz 2024-04-25T09:15:27.592 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37423.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37423.log.gz 2024-04-25T09:15:27.592 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55247.log 2024-04-25T09:15:27.595 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55247.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55247.log.gz 2024-04-25T09:15:27.595 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54430.log 2024-04-25T09:15:27.596 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37101.log 2024-04-25T09:15:27.598 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54430.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54430.log.gz 2024-04-25T09:15:27.601 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37101.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37101.log.gz 2024-04-25T09:15:27.601 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73572.log 2024-04-25T09:15:27.603 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37839.log 2024-04-25T09:15:27.607 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37839.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37839.log.gz 2024-04-25T09:15:27.608 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73572.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73572.log.gz 2024-04-25T09:15:27.608 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75603.log 2024-04-25T09:15:27.610 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75603.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.75603.log.gz 2024-04-25T09:15:27.610 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51806.log 2024-04-25T09:15:27.613 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51806.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51806.log.gz 2024-04-25T09:15:27.613 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56293.log 2024-04-25T09:15:27.617 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52292.log 2024-04-25T09:15:27.617 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56293.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56293.log.gz 2024-04-25T09:15:27.617 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76413.log 2024-04-25T09:15:27.617 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52292.log.gz 2024-04-25T09:15:27.620 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76413.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.76413.log.gz 2024-04-25T09:15:27.620 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86097.log 2024-04-25T09:15:27.623 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86097.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.86097.log.gz 2024-04-25T09:15:27.623 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38275.log 2024-04-25T09:15:27.624 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79826.log 2024-04-25T09:15:27.626 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38275.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38275.log.gz 2024-04-25T09:15:27.629 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57319.log 2024-04-25T09:15:27.630 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.79826.log.gz 2024-04-25T09:15:27.632 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.57319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76725.log 2024-04-25T09:15:27.633 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57319.log.gz 2024-04-25T09:15:27.635 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70444.log 2024-04-25T09:15:27.639 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70444.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70444.log.gz 2024-04-25T09:15:27.639 INFO:teuthology.orchestra.run.smithi173.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.76725.log.gz 2024-04-25T09:15:27.639 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70730.log 2024-04-25T09:15:27.642 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70730.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70730.log.gz 2024-04-25T09:15:27.642 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56003.log 2024-04-25T09:15:27.645 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56003.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56003.log.gz 2024-04-25T09:15:27.645 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73520.log 2024-04-25T09:15:27.648 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73520.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.73520.log.gz 2024-04-25T09:15:27.648 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86071.log 2024-04-25T09:15:27.651 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53006.log 2024-04-25T09:15:27.651 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86071.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.86071.log.gz 2024-04-25T09:15:27.653 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85716.log 2024-04-25T09:15:27.654 INFO:teuthology.orchestra.run.smithi173.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53006.log.gz 2024-04-25T09:15:27.656 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34366.log 2024-04-25T09:15:27.657 INFO:teuthology.orchestra.run.smithi173.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.85716.log.gz 2024-04-25T09:15:27.660 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34366.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34366.log.gz 2024-04-25T09:15:27.660 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37891.log 2024-04-25T09:15:27.663 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37891.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37891.log.gz 2024-04-25T09:15:27.664 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73454.log 2024-04-25T09:15:27.666 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73454.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73454.log.gz 2024-04-25T09:15:27.667 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56423.log 2024-04-25T09:15:27.669 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56423.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56423.log.gz 2024-04-25T09:15:27.669 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51473.log 2024-04-25T09:15:27.672 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51473.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51473.log.gz 2024-04-25T09:15:27.672 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75944.log 2024-04-25T09:15:27.675 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75944.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.75944.log.gz 2024-04-25T09:15:27.675 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37761.log 2024-04-25T09:15:27.678 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37761.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37761.log.gz 2024-04-25T09:15:27.678 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86281.log 2024-04-25T09:15:27.683 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57189.log 2024-04-25T09:15:27.683 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.86281.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86281.log.gz 2024-04-25T09:15:27.683 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.57189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33717.log 2024-04-25T09:15:27.684 INFO:teuthology.orchestra.run.smithi173.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.57189.log.gz 2024-04-25T09:15:27.685 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34126.log 2024-04-25T09:15:27.687 INFO:teuthology.orchestra.run.smithi173.stderr:gzip/var/log/ceph/ceph-client.admin.33717.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37917.log 2024-04-25T09:15:27.688 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34126.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33717.log.gz 2024-04-25T09:15:27.691 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57161.log 2024-04-25T09:15:27.692 INFO:teuthology.orchestra.run.smithi173.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37917.log.gz 2024-04-25T09:15:27.693 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37449.log 92.6% -- replaced with /var/log/ceph/ceph-client.admin.34126.log.gz 2024-04-25T09:15:27.693 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-25T09:15:27.697 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.57161.log: /var/log/ceph/ceph-client.admin.37449.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37449.log.gz 2024-04-25T09:15:27.698 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80901.log 2024-04-25T09:15:27.698 INFO:teuthology.orchestra.run.smithi173.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57161.log.gz 2024-04-25T09:15:27.700 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.80901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83242.log 2024-04-25T09:15:27.700 INFO:teuthology.orchestra.run.smithi173.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.80901.log.gz 2024-04-25T09:15:27.703 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73134.log 2024-04-25T09:15:27.706 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73134.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73134.log.gz 2024-04-25T09:15:27.707 INFO:teuthology.orchestra.run.smithi173.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.83242.log.gz 2024-04-25T09:15:27.707 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82152.log 2024-04-25T09:15:27.710 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82152.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.82152.log.gz 2024-04-25T09:15:27.710 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83950.log 2024-04-25T09:15:27.714 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83950.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.83950.log.gz 2024-04-25T09:15:27.714 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71110.log 2024-04-25T09:15:27.716 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.71110.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.71110.log.gz 2024-04-25T09:15:27.716 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79878.log 2024-04-25T09:15:27.719 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82987.log 2024-04-25T09:15:27.719 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79878.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.79878.log.gz 2024-04-25T09:15:27.721 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69840.log 2024-04-25T09:15:27.722 INFO:teuthology.orchestra.run.smithi173.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.82987.log.gz 2024-04-25T09:15:27.726 INFO:teuthology.orchestra.run.smithi173.stderr:gzip/var/log/ceph/ceph-client.admin.69840.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.69840.log.gz 2024-04-25T09:15:27.726 INFO:teuthology.orchestra.run.smithi173.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56598.log 2024-04-25T09:15:27.728 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56598.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56598.log.gz 2024-04-25T09:15:27.729 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83872.log 2024-04-25T09:15:27.732 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83872.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.83872.log.gz 2024-04-25T09:15:27.732 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56449.log 2024-04-25T09:15:27.735 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56449.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56449.log.gz 2024-04-25T09:15:27.735 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57215.log 2024-04-25T09:15:27.738 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.57215.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57215.log.gz 2024-04-25T09:15:27.738 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38001.log 2024-04-25T09:15:27.740 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53039.log 2024-04-25T09:15:27.741 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38001.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38001.log.gz 2024-04-25T09:15:27.743 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53039.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53039.log.gz 2024-04-25T09:15:27.744 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52344.log 2024-04-25T09:15:27.746 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52344.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52344.log.gz 2024-04-25T09:15:27.747 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37631.log 2024-04-25T09:15:27.749 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37631.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37631.log.gz 2024-04-25T09:15:27.749 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34605.log 2024-04-25T09:15:27.751 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73681.log 2024-04-25T09:15:27.753 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34605.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34605.log.gz 2024-04-25T09:15:27.755 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73681.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73681.log.gz 2024-04-25T09:15:27.756 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80261.log 2024-04-25T09:15:27.758 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80261.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.80261.log.gz 2024-04-25T09:15:27.758 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35829.log 2024-04-25T09:15:27.763 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34735.log 2024-04-25T09:15:27.763 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35829.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35829.log.gz 2024-04-25T09:15:27.763 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36749.log 2024-04-25T09:15:27.763 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34735.log.gz 2024-04-25T09:15:27.766 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36749.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36749.log.gz 2024-04-25T09:15:27.767 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54919.log 2024-04-25T09:15:27.769 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85664.log 2024-04-25T09:15:27.770 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54919.log.gz 2024-04-25T09:15:27.771 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79534.log 2024-04-25T09:15:27.773 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85664.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.85664.log.gz 2024-04-25T09:15:27.776 INFO:teuthology.orchestra.run.smithi173.stderr:gzip/var/log/ceph/ceph-client.admin.79534.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35777.log 2024-04-25T09:15:27.777 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.79534.log.gz 2024-04-25T09:15:27.779 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82569.log 2024-04-25T09:15:27.782 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82569.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.82569.log.gz 2024-04-25T09:15:27.782 INFO:teuthology.orchestra.run.smithi173.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36880.log 2024-04-25T09:15:27.785 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36880.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36880.log.gz 2024-04-25T09:15:27.786 INFO:teuthology.orchestra.run.smithi173.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35777.log.gz 2024-04-25T09:15:27.786 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53421.log 2024-04-25T09:15:27.789 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53421.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53421.log.gz 2024-04-25T09:15:27.790 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78779.log 2024-04-25T09:15:27.791 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79369.log 2024-04-25T09:15:27.795 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79369.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79369.log.gz 2024-04-25T09:15:27.796 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.78779.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78779.log.gz 2024-04-25T09:15:27.796 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70926.log 2024-04-25T09:15:27.799 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70926.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70926.log.gz 2024-04-25T09:15:27.799 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78701.log 2024-04-25T09:15:27.802 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.78701.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.78701.log.gz 2024-04-25T09:15:27.802 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70783.log 2024-04-25T09:15:27.803 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79800.log 2024-04-25T09:15:27.805 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70783.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70783.log.gz 2024-04-25T09:15:27.808 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79800.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.79800.log.gz 2024-04-25T09:15:27.808 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78831.log 2024-04-25T09:15:27.811 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.78831.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78831.log.gz 2024-04-25T09:15:27.811 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37813.log 2024-04-25T09:15:27.814 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73770.log 2024-04-25T09:15:27.814 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37813.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37813.log.gz 2024-04-25T09:15:27.817 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73770.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73770.log.gz 2024-04-25T09:15:27.817 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75370.log 2024-04-25T09:15:27.820 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75370.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.75370.log.gz 2024-04-25T09:15:27.820 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35595.log 2024-04-25T09:15:27.823 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35595.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35595.log.gz 2024-04-25T09:15:27.824 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80590.log 2024-04-25T09:15:27.826 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80590.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.80590.log.gz 2024-04-25T09:15:27.827 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52264.log 2024-04-25T09:15:27.829 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52264.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52264.log.gz 2024-04-25T09:15:27.829 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35228.log 2024-04-25T09:15:27.832 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35228.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35228.log.gz 2024-04-25T09:15:27.833 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85690.log 2024-04-25T09:15:27.835 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85690.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.85690.log.gz 2024-04-25T09:15:27.836 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34287.log 2024-04-25T09:15:27.839 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76947.log 2024-04-25T09:15:27.839 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34287.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34287.log.gz 2024-04-25T09:15:27.840 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85768.log 88.6% -- replaced with /var/log/ceph/ceph-client.admin.76947.log.gz 2024-04-25T09:15:27.840 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-25T09:15:27.842 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85768.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.85768.log.gz 2024-04-25T09:15:27.842 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52874.log 2024-04-25T09:15:27.846 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52874.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52874.log.gz 2024-04-25T09:15:27.846 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71136.log 2024-04-25T09:15:27.848 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.71136.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.71136.log.gz 2024-04-25T09:15:27.849 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75781.log 2024-04-25T09:15:27.852 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75781.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75781.log.gz 2024-04-25T09:15:27.852 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38628.log 2024-04-25T09:15:27.855 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38628.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38628.log.gz 2024-04-25T09:15:27.855 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78857.log 2024-04-25T09:15:27.857 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.78857.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78857.log.gz 2024-04-25T09:15:27.858 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77288.log 2024-04-25T09:15:27.861 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85631.log 2024-04-25T09:15:27.861 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.77288.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.77288.log.gz 2024-04-25T09:15:27.864 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.85631.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.85631.log.gz 2024-04-25T09:15:27.864 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54631.log 2024-04-25T09:15:27.867 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54631.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54631.log.gz 2024-04-25T09:15:27.867 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33557.log 2024-04-25T09:15:27.870 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33557.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33557.log.gz 2024-04-25T09:15:27.870 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35213.log 2024-04-25T09:15:27.875 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83924.log 2024-04-25T09:15:27.875 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35213.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35213.log.gz 2024-04-25T09:15:27.875 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78675.log 2024-04-25T09:15:27.875 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83924.log.gz 2024-04-25T09:15:27.878 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.78675.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.78675.log.gz 2024-04-25T09:15:27.879 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51343.log 2024-04-25T09:15:27.881 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72790.log 2024-04-25T09:15:27.882 INFO:teuthology.orchestra.run.smithi173.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51343.log.gz 2024-04-25T09:15:27.883 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75911.log 2024-04-25T09:15:27.885 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.72790.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72790.log.gz 2024-04-25T09:15:27.888 INFO:teuthology.orchestra.run.smithi173.stderr:gzip/var/log/ceph/ceph-client.admin.75911.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.76022.log 2024-04-25T09:15:27.889 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75911.log.gz 2024-04-25T09:15:27.891 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54709.log 2024-04-25T09:15:27.892 INFO:teuthology.orchestra.run.smithi173.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.76022.log.gz 2024-04-25T09:15:27.895 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.54709.log: -- /var/log/ceph/ceph-client.admin.83013.log 2024-04-25T09:15:27.895 INFO:teuthology.orchestra.run.smithi173.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54709.log.gz 2024-04-25T09:15:27.896 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.36157.log 2024-04-25T09:15:27.898 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83013.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.83013.log.gz 2024-04-25T09:15:27.899 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76595.log 2024-04-25T09:15:27.903 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.2.36157.log: /var/log/ceph/ceph-client.admin.76595.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.76595.log.gz 2024-04-25T09:15:27.903 INFO:teuthology.orchestra.run.smithi173.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.36157.log.gz 2024-04-25T09:15:27.903 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38654.log 2024-04-25T09:15:27.906 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38654.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38654.log.gz 2024-04-25T09:15:27.907 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80027.log 2024-04-25T09:15:27.909 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80027.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.80027.log.gz 2024-04-25T09:15:27.910 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53585.log 2024-04-25T09:15:27.913 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53585.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.53585.log.gz 2024-04-25T09:15:27.913 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34799.log 2024-04-25T09:15:27.915 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36333.log 2024-04-25T09:15:27.917 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34799.log: 88.4%gzip -5 --verbose --/var/log/ceph/ceph-client.admin.36333.log: /var/log/ceph/ceph-client.admin.36541.log 2024-04-25T09:15:27.917 INFO:teuthology.orchestra.run.smithi173.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34799.log.gz 2024-04-25T09:15:27.917 INFO:teuthology.orchestra.run.smithi173.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36333.log.gz 2024-04-25T09:15:27.920 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36541.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36541.log.gz 2024-04-25T09:15:27.920 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57267.log 2024-04-25T09:15:27.923 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.57267.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57267.log.gz 2024-04-25T09:15:27.923 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51577.log 2024-04-25T09:15:27.926 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51577.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51577.log.gz 2024-04-25T09:15:27.926 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75807.log 2024-04-25T09:15:27.929 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.75807.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.75807.log.gz 2024-04-25T09:15:27.929 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51369.log 2024-04-25T09:15:27.931 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79618.log 2024-04-25T09:15:27.933 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51369.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51369.log.gz 2024-04-25T09:15:27.936 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79618.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.79618.log.gz 2024-04-25T09:15:27.936 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34470.log 2024-04-25T09:15:27.939 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34470.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34470.log.gz 2024-04-25T09:15:27.939 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82773.log 2024-04-25T09:15:27.942 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33663.log 2024-04-25T09:15:27.942 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82773.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.82773.log.gz 2024-04-25T09:15:27.944 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33663.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33663.log.gz 2024-04-25T09:15:27.945 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79592.log 2024-04-25T09:15:27.948 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79592.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.79592.log.gz 2024-04-25T09:15:27.948 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54163.log 2024-04-25T09:15:27.950 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54163.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54163.log.gz 2024-04-25T09:15:27.951 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82433.log 2024-04-25T09:15:27.955 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76804.log 2024-04-25T09:15:27.955 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82433.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.82433.log.gz 2024-04-25T09:15:27.956 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51395.log 2024-04-25T09:15:27.956 INFO:teuthology.orchestra.run.smithi173.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.76804.log.gz 2024-04-25T09:15:27.959 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51395.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51395.log.gz 2024-04-25T09:15:27.959 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36645.log 2024-04-25T09:15:27.961 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82688.log 2024-04-25T09:15:27.962 INFO:teuthology.orchestra.run.smithi173.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36645.log.gz 2024-04-25T09:15:27.964 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79482.log 2024-04-25T09:15:27.966 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82688.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.82688.log.gz 2024-04-25T09:15:27.968 INFO:teuthology.orchestra.run.smithi173.stderr:gzip/var/log/ceph/ceph-client.admin.79482.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53371.log 2024-04-25T09:15:27.969 INFO:teuthology.orchestra.run.smithi173.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.79482.log.gz 2024-04-25T09:15:27.971 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73004.log 2024-04-25T09:15:27.976 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73004.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73004.log.gz 2024-04-25T09:15:27.976 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53371.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.53371.log.gz 2024-04-25T09:15:27.976 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56962.log 2024-04-25T09:15:27.979 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56962.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56962.log.gz 2024-04-25T09:15:27.979 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70470.log 2024-04-25T09:15:27.982 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35751.log 2024-04-25T09:15:27.982 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70470.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70470.log.gz 2024-04-25T09:15:27.985 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35751.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35751.log.gz 2024-04-25T09:15:27.985 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70111.log 2024-04-25T09:15:27.988 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70111.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70111.log.gz 2024-04-25T09:15:27.988 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56157.log 2024-04-25T09:15:27.991 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56157.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56157.log.gz 2024-04-25T09:15:27.992 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35517.log 2024-04-25T09:15:27.994 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77261.log 2024-04-25T09:15:27.995 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35517.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35517.log.gz 2024-04-25T09:15:27.997 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.77261.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.77261.log.gz 2024-04-25T09:15:27.997 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73205.log 2024-04-25T09:15:28.000 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73205.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73205.log.gz 2024-04-25T09:15:28.000 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71058.log 2024-04-25T09:15:28.003 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.71058.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71058.log.gz 2024-04-25T09:15:28.003 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34527.log 2024-04-25T09:15:28.004 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54325.log 2024-04-25T09:15:28.006 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34527.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34527.log.gz 2024-04-25T09:15:28.009 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54325.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54325.log.gz 2024-04-25T09:15:28.009 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51551.log 2024-04-25T09:15:28.011 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73285.log 2024-04-25T09:15:28.013 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51551.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51551.log.gz 2024-04-25T09:15:28.016 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37943.log 2024-04-25T09:15:28.016 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73285.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73285.log.gz 2024-04-25T09:15:28.019 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37943.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37943.log.gz 2024-04-25T09:15:28.019 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82909.log 2024-04-25T09:15:28.022 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82909.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.82909.log.gz 2024-04-25T09:15:28.022 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56049.log 2024-04-25T09:15:28.024 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.56049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56049.log.gz 2024-04-25T09:15:28.024 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55167.log 2024-04-25T09:15:28.028 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55195.log 2024-04-25T09:15:28.028 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55167.log.gz 2024-04-25T09:15:28.029 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33927.log 2024-04-25T09:15:28.031 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55195.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55195.log.gz 2024-04-25T09:15:28.033 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55552.log 2024-04-25T09:15:28.034 INFO:teuthology.orchestra.run.smithi173.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.33927.log.gz 2024-04-25T09:15:28.036 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70293.log 2024-04-25T09:15:28.039 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70293.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.70293.log.gz 2024-04-25T09:15:28.040 INFO:teuthology.orchestra.run.smithi173.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55552.log.gz 2024-04-25T09:15:28.040 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37153.log 2024-04-25T09:15:28.043 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37153.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37153.log.gz 2024-04-25T09:15:28.043 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38223.log 2024-04-25T09:15:28.046 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38223.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38223.log.gz 2024-04-25T09:15:28.046 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52149.log 2024-04-25T09:15:28.049 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70267.log 2024-04-25T09:15:28.049 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.52149.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52149.log.gz 2024-04-25T09:15:28.052 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70267.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70267.log.gz 2024-04-25T09:15:28.052 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78575.log 2024-04-25T09:15:28.055 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.78575.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.78575.log.gz 2024-04-25T09:15:28.055 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53799.log 2024-04-25T09:15:28.058 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.53799.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.53799.log.gz 2024-04-25T09:15:28.059 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35214.log 2024-04-25T09:15:28.063 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36775.log 2024-04-25T09:15:28.063 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35214.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35214.log.gz 2024-04-25T09:15:28.064 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36775.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36775.log.gz 2024-04-25T09:15:28.064 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34183.log 2024-04-25T09:15:28.067 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74056.log 2024-04-25T09:15:28.068 INFO:teuthology.orchestra.run.smithi173.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34183.log.gz 2024-04-25T09:15:28.069 INFO:teuthology.orchestra.run.smithi173.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T09:15:28.069 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57135.log 2024-04-25T09:15:28.072 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.74056.log: /var/log/ceph/ceph-client.admin.57135.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.74056.log.gz 2024-04-25T09:15:28.073 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33531.log 2024-04-25T09:15:28.073 INFO:teuthology.orchestra.run.smithi173.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57135.log.gz 2024-04-25T09:15:28.074 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76569.log 2024-04-25T09:15:28.075 INFO:teuthology.orchestra.run.smithi173.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33531.log.gz 2024-04-25T09:15:28.075 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51525.log 2024-04-25T09:15:28.077 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76569.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76569.log.gz 2024-04-25T09:15:28.077 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76366.log 2024-04-25T09:15:28.078 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51525.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51525.log.gz 2024-04-25T09:15:28.079 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70366.log 2024-04-25T09:15:28.080 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76366.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.76366.log.gz 2024-04-25T09:15:28.081 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34209.log 2024-04-25T09:15:28.082 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70366.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70366.log.gz 2024-04-25T09:15:28.083 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34209.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34209.log.gz 2024-04-25T09:15:28.084 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56183.log 2024-04-25T09:15:28.085 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38834.log 2024-04-25T09:15:28.086 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56183.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56183.log.gz 2024-04-25T09:15:28.087 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.38834.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38834.log.gz 2024-04-25T09:15:28.088 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35803.log 2024-04-25T09:15:28.089 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73056.log 2024-04-25T09:15:28.090 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.35803.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35803.log.gz 2024-04-25T09:15:28.091 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73056.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73056.log.gz 2024-04-25T09:15:28.092 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37260.log 2024-04-25T09:15:28.093 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72816.log 2024-04-25T09:15:28.095 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37260.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37260.log.gz 2024-04-25T09:15:28.095 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.72816.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.72816.log.gz 2024-04-25T09:15:28.096 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79852.log 2024-04-25T09:15:28.097 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36828.log 2024-04-25T09:15:28.099 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79852.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.79852.log.gz 2024-04-25T09:15:28.099 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36828.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36828.log.gz 2024-04-25T09:15:28.100 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51728.log 2024-04-25T09:15:28.101 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55899.log 2024-04-25T09:15:28.103 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51728.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51728.log.gz 2024-04-25T09:15:28.103 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55899.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55899.log.gz 2024-04-25T09:15:28.104 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83439.log 2024-04-25T09:15:28.105 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76921.log 2024-04-25T09:15:28.106 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.83439.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.83439.log.gz 2024-04-25T09:15:28.107 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76921.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76921.log.gz 2024-04-25T09:15:28.108 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79949.log 2024-04-25T09:15:28.109 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51700.log 2024-04-25T09:15:28.110 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79949.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.79949.log.gz 2024-04-25T09:15:28.111 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55141.log 2024-04-25T09:15:28.114 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82543.log 2024-04-25T09:15:28.114 INFO:teuthology.orchestra.run.smithi173.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51700.log.gz 2024-04-25T09:15:28.114 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55141.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55141.log.gz 2024-04-25T09:15:28.115 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.82543.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.82543.log.gz 2024-04-25T09:15:28.115 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78753.log 2024-04-25T09:15:28.116 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51923.log 2024-04-25T09:15:28.118 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.78753.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.78753.log.gz 2024-04-25T09:15:28.119 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51923.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51923.log.gz 2024-04-25T09:15:28.119 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74004.log 2024-04-25T09:15:28.120 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80138.log 2024-04-25T09:15:28.122 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.74004.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74004.log.gz 2024-04-25T09:15:28.123 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.80138.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.80138.log.gz 2024-04-25T09:15:28.123 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54534.log 2024-04-25T09:15:28.125 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33743.log 2024-04-25T09:15:28.126 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54534.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54534.log.gz 2024-04-25T09:15:28.127 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.33743.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22761.log 2024-04-25T09:15:28.128 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33743.log.gz 2024-04-25T09:15:28.128 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73337.log 2024-04-25T09:15:28.130 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph.tmp-client.admin.22761.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22761.log.gz 2024-04-25T09:15:28.130 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.73337.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73337.log.gz 2024-04-25T09:15:28.131 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79644.log 2024-04-25T09:15:28.132 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36032.log 2024-04-25T09:15:28.134 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.79644.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.79644.log.gz 2024-04-25T09:15:28.134 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.36032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36032.log.gz 2024-04-25T09:15:28.135 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55526.log 2024-04-25T09:15:28.136 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54404.log 2024-04-25T09:15:28.138 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.55526.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55526.log.gz 2024-04-25T09:15:28.138 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.54404.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54404.log.gz 2024-04-25T09:15:28.139 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37312.log 2024-04-25T09:15:28.140 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57371.log 2024-04-25T09:15:28.142 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.37312.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37312.log.gz 2024-04-25T09:15:28.142 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.57371.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57371.log.gz 2024-04-25T09:15:28.143 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76777.log 2024-04-25T09:15:28.144 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34501.log 2024-04-25T09:15:28.146 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.76777.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.76777.log.gz 2024-04-25T09:15:28.146 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34501.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34501.log.gz 2024-04-25T09:15:28.147 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56501.log 2024-04-25T09:15:28.148 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51149.log 2024-04-25T09:15:28.150 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.56501.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56501.log.gz 2024-04-25T09:15:28.151 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.51149.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.51149.log.gz 2024-04-25T09:15:28.151 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70059.log 2024-04-25T09:15:28.154 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.70059.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70059.log.gz 2024-04-25T09:15:28.443 INFO:teuthology.orchestra.run.smithi194.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T09:15:30.954 INFO:teuthology.orchestra.run.smithi194.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T09:15:31.240 INFO:teuthology.orchestra.run.smithi194.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T09:15:31.457 INFO:teuthology.orchestra.run.smithi194.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T09:15:32.159 INFO:teuthology.orchestra.run.smithi194.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T09:15:32.161 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-04-25T09:15:32.161 INFO:teuthology.orchestra.run.smithi194.stderr:real 0m5.306s 2024-04-25T09:15:32.161 INFO:teuthology.orchestra.run.smithi194.stderr:user 0m19.251s 2024-04-25T09:15:32.161 INFO:teuthology.orchestra.run.smithi194.stderr:sys 0m1.478s 2024-04-25T09:15:32.468 INFO:teuthology.orchestra.run.smithi173.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T09:15:33.238 INFO:teuthology.orchestra.run.smithi173.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T09:15:33.410 INFO:teuthology.orchestra.run.smithi173.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T09:15:33.663 INFO:teuthology.orchestra.run.smithi173.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T09:15:50.056 INFO:teuthology.orchestra.run.smithi173.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T09:15:52.848 INFO:teuthology.orchestra.run.smithi173.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T09:15:52.850 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-25T09:15:52.850 INFO:teuthology.orchestra.run.smithi173.stderr:real 0m26.013s 2024-04-25T09:15:52.850 INFO:teuthology.orchestra.run.smithi173.stderr:user 1m9.089s 2024-04-25T09:15:52.850 INFO:teuthology.orchestra.run.smithi173.stderr:sys 0m6.200s 2024-04-25T09:15:52.851 INFO:tasks.ceph:Archiving logs... 2024-04-25T09:15:52.852 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/log/ceph to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673000/remote/smithi173/log 2024-04-25T09:15:52.853 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T09:16:01.377 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673000/remote/smithi194/log 2024-04-25T09:16:01.378 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T09:16:03.844 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T09:16:03.854 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T09:16:03.854 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T09:16:03.857 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T09:16:03.941 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T09:16:03.959 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T09:16:03.960 DEBUG:teuthology.orchestra.run.smithi173:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:16:03.963 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:16:03.976 INFO:teuthology.orchestra.run.smithi173.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T09:16:03.976 INFO:teuthology.orchestra.run.smithi173.stdout:============================================================================== 2024-04-25T09:16:03.976 INFO:teuthology.orchestra.run.smithi173.stdout:+hv01.front.sepi 44.4.53.2 2 u 10 64 377 0.077 -7.290 2.074 2024-04-25T09:16:03.977 INFO:teuthology.orchestra.run.smithi173.stdout:+hv02.front.sepi 63.231.80.2 3 u 15 64 377 0.087 -1.477 2.146 2024-04-25T09:16:03.977 INFO:teuthology.orchestra.run.smithi173.stdout:*hv03.front.sepi 74.6.168.72 3 u 9 64 377 0.102 -5.702 1.690 2024-04-25T09:16:03.977 INFO:teuthology.orchestra.run.smithi173.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-04-25T09:16:03.978 INFO:teuthology.orchestra.run.smithi194.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T09:16:03.979 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================== 2024-04-25T09:16:03.979 INFO:teuthology.orchestra.run.smithi194.stdout:+hv01.front.sepi 44.4.53.2 2 u 12 64 377 0.088 -4.792 0.769 2024-04-25T09:16:03.979 INFO:teuthology.orchestra.run.smithi194.stdout:+hv02.front.sepi 63.231.80.2 3 u 59 64 377 0.094 -2.084 0.967 2024-04-25T09:16:03.979 INFO:teuthology.orchestra.run.smithi194.stdout:*hv03.front.sepi 74.6.168.72 3 u 6 64 377 0.079 -3.753 0.877 2024-04-25T09:16:03.979 INFO:teuthology.orchestra.run.smithi194.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-04-25T09:16:03.980 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T09:16:04.023 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T09:16:04.024 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T09:16:04.142 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T09:16:04.181 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T09:16:04.229 INFO:teuthology.task.internal:Duration was 1535.212314 seconds 2024-04-25T09:16:04.229 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T09:16:04.299 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T09:16:04.299 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T09:16:04.302 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T09:16:04.391 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T09:16:04.392 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi173.front.sepia.ceph.com 2024-04-25T09:16:04.392 DEBUG:teuthology.orchestra.run.smithi173:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T09:16:04.412 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2024-04-25T09:16:04.413 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T09:16:04.434 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T09:16:04.434 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T09:16:04.462 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T09:16:04.518 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T09:16:04.518 DEBUG:teuthology.orchestra.run.smithi173:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T09:16:04.545 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T09:16:04.645 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T09:16:04.656 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T09:16:04.657 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T09:16:04.677 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T09:16:04.698 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T09:16:04.709 DEBUG:teuthology.orchestra.run.smithi173:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:16:04.721 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:16:04.735 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = core 2024-04-25T09:16:04.758 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2024-04-25T09:16:04.776 DEBUG:teuthology.orchestra.run.smithi173:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:16:04.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:16:04.801 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:16:04.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:16:04.824 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T09:16:04.837 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T09:16:04.837 DEBUG:teuthology.misc:Transferring archived files from smithi173:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673000/remote/smithi173 2024-04-25T09:16:04.838 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T09:16:04.869 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673000/remote/smithi194 2024-04-25T09:16:04.870 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T09:16:04.896 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T09:16:04.896 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T09:16:04.909 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T09:16:04.941 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T09:16:04.952 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T09:16:04.952 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T09:16:05.090 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T09:16:05.091 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T09:16:05.094 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T09:16:05.100 INFO:teuthology.orchestra.run.smithi173.stdout: 655443 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 09:16 /home/ubuntu/cephtest 2024-04-25T09:16:05.102 INFO:teuthology.orchestra.run.smithi194.stdout: 655441 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 09:16 /home/ubuntu/cephtest 2024-04-25T09:16:05.104 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T09:16:05.134 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T09:16:05.274 INFO:teuthology.nuke:Checking targets against current locks 2024-04-25T09:16:05.303 DEBUG:teuthology.nuke:shortname: smithi173 2024-04-25T09:16:05.303 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T09:16:05.326 DEBUG:teuthology.nuke:shortname: smithi194 2024-04-25T09:16:05.327 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T09:16:05.330 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673000', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:41:40.471430', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLkvIoXe1ldFsa6vib5Pod3FT+Y8mfSINne6Qh8b0hnzBal6UpcAhf1CpYuNHiW5h5pDSeDKtgpCOJcdBJlb11I='} 2024-04-25T09:16:05.348 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673000', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:41:40.473448', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKgNB14d8U35CxwERZTG5TB48fVp7dKCGBj1/xh8wDREGcGZyiP9UJgxSHiVCqaVM/UT+oR9XsyUNSYkhvSxFII='} 2024-04-25T09:16:05.378 INFO:teuthology.orchestra.console.smithi173:Power off 2024-04-25T09:16:05.378 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T09:16:05.402 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2024-04-25T09:16:05.402 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T09:16:05.419 INFO:teuthology.orchestra.console.smithi194:Power off 2024-04-25T09:16:05.420 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T09:16:05.429 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-04-25T09:16:05.442 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2024-04-25T09:16:05.443 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T09:16:05.465 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-04-25T09:16:09.430 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T09:16:09.466 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T09:16:09.540 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-04-25T09:16:09.579 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-04-25T09:16:13.542 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T09:16:13.580 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T09:16:13.654 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-04-25T09:16:13.693 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-04-25T09:16:17.656 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T09:16:17.694 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T09:16:17.766 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-04-25T09:16:17.803 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-04-25T09:16:17.868 INFO:teuthology.orchestra.console.smithi173:Power off completed 2024-04-25T09:16:17.905 INFO:teuthology.orchestra.console.smithi194:Power off completed 2024-04-25T09:16:18.010 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 client.1-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/scrub} duration: 1535.2123136520386 failure_reason: 'Test failure: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls)' flavor: default owner: scheduled_neesingh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=af9e065c13d542a7b9b51918007a9ec9 status: fail success: false 2024-04-25T09:16:18.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T09:16:18.092 INFO:teuthology.run:FAIL